2024-09-12T00:21:47.562 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T00:21:47.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T00:21:47.683 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901873 branch: wip-cls-rgw-busy-resharding description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} email: null first_in_suite: false job_id: '7901873' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-cls-rgw-busy-resharding ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw d3n l1 datacache persistent path: /tmp/rgw_datacache/ rgw d3n l1 datacache size: 10737418240 rgw d3n l1 local datacache enabled: true rgw enable ops log: true rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 rgw override bucket index max shards: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 compression type: random datacache: true datacache_path: /tmp/rgw_datacache ec-data-pool: false frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 s3 tenant: RGW33333333333333333 force-branch: ceph-master storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-67986 sha1: 6a169fc940965ab446a63954fde870aa497efde7 owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 2206 sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f sleep_before_teardown: 0 suite: rgw suite_branch: wip-67986 suite_path: /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa suite_relpath: qa suite_repo: https://github.com/cbodley/ceph.git suite_sha1: 6a169fc940965ab446a63954fde870aa497efde7 targets: smithi070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBasj4l2Q5nC44yDiQ/e2pQhqMqPvlKlD1bYTA+BkhT5dzCsJtS1KXpo2GDZHFucmrj5EYVbkUkmnY4JmReKd7Q= smithi187.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHvY5znKG735ONA5lXPDVs/f5eUYk0nF68piIBwSjjBl6Hwlg8ki4RX5jjJOZ3hqXSorcRTnxRgUIvsZA0DoQIo= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-datacache.sh env: RGW_DATACACHE_PATH: /tmp/rgw_datacache - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: force-branch: wip-67986 rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_23:33:24 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T00:21:47.684 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa; will attempt to use it 2024-09-12T00:21:47.684 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa/tasks 2024-09-12T00:21:47.685 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T00:21:47.686 INFO:teuthology.task.internal:Checking packages... 2024-09-12T00:21:47.709 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd011c522bb171e70fc5782f1e7a71ce5f37e573f' 2024-09-12T00:21:47.709 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T00:21:47.709 INFO:teuthology.packaging:ref: None 2024-09-12T00:21:47.710 INFO:teuthology.packaging:tag: None 2024-09-12T00:21:47.710 INFO:teuthology.packaging:branch: wip-cls-rgw-busy-resharding 2024-09-12T00:21:47.710 INFO:teuthology.packaging:sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:21:47.710 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-cls-rgw-busy-resharding 2024-09-12T00:21:47.863 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:21:47.865 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T00:21:47.873 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T00:21:47.873 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T00:21:47.885 INFO:teuthology.task.internal:Saving configuration 2024-09-12T00:21:47.903 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T00:21:47.909 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T00:21:47.942 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901873', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 00:16:16.834356', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIUSHi6weu4RV9Bdq9XvqWvcfmLIbxnObu6XacaX12qN'} 2024-09-12T00:21:47.974 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901873', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 00:16:16.836305', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAeXyJv+4LCOBCd6v8Tzc0aQjVTtWlGgaQemqmUM8Coj'} 2024-09-12T00:21:47.974 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T00:21:47.980 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T00:21:47.980 INFO:teuthology.task.internal:roles: ubuntu@smithi187.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T00:21:47.980 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T00:21:48.053 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1fd915f490>, signals=[15]) 2024-09-12T00:21:48.053 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T00:21:48.059 INFO:teuthology.task.internal:Opening connections... 2024-09-12T00:21:48.059 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi070.front.sepia.ceph.com 2024-09-12T00:21:48.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:21:48.148 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi187.front.sepia.ceph.com 2024-09-12T00:21:48.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:21:48.234 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T00:21:48.240 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2024-09-12T00:21:48.244 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2024-09-12T00:21:48.245 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-09-12T00:21:48.296 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T00:21:48.296 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="Ubuntu" 2024-09-12T00:21:48.296 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="22.04" 2024-09-12T00:21:48.297 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T00:21:48.297 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_CODENAME=jammy 2024-09-12T00:21:48.297 INFO:teuthology.orchestra.run.smithi070.stdout:ID=ubuntu 2024-09-12T00:21:48.297 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE=debian 2024-09-12T00:21:48.297 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T00:21:48.297 INFO:teuthology.orchestra.run.smithi070.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T00:21:48.297 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T00:21:48.297 INFO:teuthology.orchestra.run.smithi070.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T00:21:48.297 INFO:teuthology.orchestra.run.smithi070.stdout:UBUNTU_CODENAME=jammy 2024-09-12T00:21:48.298 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-09-12T00:21:48.327 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2024-09-12T00:21:48.332 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2024-09-12T00:21:48.332 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2024-09-12T00:21:48.377 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T00:21:48.377 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Ubuntu" 2024-09-12T00:21:48.377 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="22.04" 2024-09-12T00:21:48.377 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T00:21:48.377 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_CODENAME=jammy 2024-09-12T00:21:48.377 INFO:teuthology.orchestra.run.smithi187.stdout:ID=ubuntu 2024-09-12T00:21:48.377 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE=debian 2024-09-12T00:21:48.377 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T00:21:48.378 INFO:teuthology.orchestra.run.smithi187.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T00:21:48.378 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T00:21:48.378 INFO:teuthology.orchestra.run.smithi187.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T00:21:48.378 INFO:teuthology.orchestra.run.smithi187.stdout:UBUNTU_CODENAME=jammy 2024-09-12T00:21:48.378 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2024-09-12T00:21:48.410 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T00:21:48.420 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T00:21:48.448 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T00:21:48.448 DEBUG:teuthology.orchestra.run.smithi070:> test '!' -e /home/ubuntu/cephtest 2024-09-12T00:21:48.451 DEBUG:teuthology.orchestra.run.smithi187:> test '!' -e /home/ubuntu/cephtest 2024-09-12T00:21:48.455 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T00:21:48.461 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T00:21:48.461 DEBUG:teuthology.orchestra.run.smithi070:> test -z $(ls -A /var/lib/ceph) 2024-09-12T00:21:48.498 DEBUG:teuthology.orchestra.run.smithi187:> test -z $(ls -A /var/lib/ceph) 2024-09-12T00:21:48.511 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T00:21:48.579 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T00:21:48.593 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T00:21:48.593 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T00:21:48.594 DEBUG:teuthology.orchestra.run.smithi070:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T00:21:48.594 DEBUG:teuthology.orchestra.run.smithi187:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T00:21:48.598 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:21:48.599 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-09-12T00:21:48.600 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:21:48.600 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2024-09-12T00:21:48.645 INFO:teuthology.orchestra.run.smithi070.stdout:5.15.0-56-generic 2024-09-12T00:21:48.646 INFO:teuthology.task.kernel:Running kernel on smithi070: 5.15.0-56-generic 2024-09-12T00:21:48.646 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get clean 2024-09-12T00:21:48.647 INFO:teuthology.orchestra.run.smithi187.stdout:5.15.0-56-generic 2024-09-12T00:21:48.647 INFO:teuthology.task.kernel:Running kernel on smithi187: 5.15.0-56-generic 2024-09-12T00:21:48.647 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get clean 2024-09-12T00:21:48.784 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get update 2024-09-12T00:21:48.791 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get update 2024-09-12T00:21:48.920 INFO:teuthology.orchestra.run.smithi070.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T00:21:48.932 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:21:48.944 INFO:teuthology.orchestra.run.smithi187.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T00:21:49.014 INFO:teuthology.orchestra.run.smithi187.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T00:21:49.031 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:21:49.043 INFO:teuthology.orchestra.run.smithi187.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T00:21:49.113 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T00:21:49.130 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T00:21:49.179 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T00:21:49.197 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T00:21:49.235 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T00:21:49.237 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T00:21:49.237 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T00:21:49.255 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T00:21:49.256 INFO:teuthology.orchestra.run.smithi070.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T00:21:49.259 INFO:teuthology.orchestra.run.smithi070.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T00:21:49.259 INFO:teuthology.orchestra.run.smithi070.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T00:21:49.264 INFO:teuthology.orchestra.run.smithi070.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T00:21:49.272 INFO:teuthology.orchestra.run.smithi070.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T00:21:49.273 INFO:teuthology.orchestra.run.smithi070.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T00:21:49.274 INFO:teuthology.orchestra.run.smithi070.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T00:21:49.276 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T00:21:49.282 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T00:21:49.284 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T00:21:49.285 INFO:teuthology.orchestra.run.smithi187.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T00:21:49.285 INFO:teuthology.orchestra.run.smithi187.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T00:21:49.297 INFO:teuthology.orchestra.run.smithi070.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T00:21:49.298 INFO:teuthology.orchestra.run.smithi070.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T00:21:49.298 INFO:teuthology.orchestra.run.smithi070.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T00:21:49.302 INFO:teuthology.orchestra.run.smithi187.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T00:21:49.305 INFO:teuthology.orchestra.run.smithi187.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T00:21:49.306 INFO:teuthology.orchestra.run.smithi187.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T00:21:49.310 INFO:teuthology.orchestra.run.smithi187.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T00:21:49.318 INFO:teuthology.orchestra.run.smithi187.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T00:21:49.320 INFO:teuthology.orchestra.run.smithi187.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T00:21:49.320 INFO:teuthology.orchestra.run.smithi187.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T00:21:49.320 INFO:teuthology.orchestra.run.smithi187.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T00:21:49.353 INFO:teuthology.orchestra.run.smithi187.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T00:21:49.353 INFO:teuthology.orchestra.run.smithi187.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T00:21:49.353 INFO:teuthology.orchestra.run.smithi187.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T00:21:49.354 INFO:teuthology.orchestra.run.smithi187.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T00:21:49.354 INFO:teuthology.orchestra.run.smithi187.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T00:21:49.355 INFO:teuthology.orchestra.run.smithi187.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T00:21:49.355 INFO:teuthology.orchestra.run.smithi187.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T00:21:49.362 INFO:teuthology.orchestra.run.smithi187.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T00:21:49.369 INFO:teuthology.orchestra.run.smithi187.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T00:21:49.386 INFO:teuthology.orchestra.run.smithi187.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T00:21:49.468 INFO:teuthology.orchestra.run.smithi070.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T00:21:49.500 INFO:teuthology.orchestra.run.smithi187.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T00:21:49.607 INFO:teuthology.orchestra.run.smithi070.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T00:21:49.919 INFO:teuthology.orchestra.run.smithi187.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T00:21:49.921 INFO:teuthology.orchestra.run.smithi070.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T00:21:49.935 INFO:teuthology.orchestra.run.smithi187.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T00:21:49.944 INFO:teuthology.orchestra.run.smithi187.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T00:21:49.945 INFO:teuthology.orchestra.run.smithi187.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T00:21:49.958 INFO:teuthology.orchestra.run.smithi070.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T00:21:49.972 INFO:teuthology.orchestra.run.smithi070.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T00:21:49.973 INFO:teuthology.orchestra.run.smithi070.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T00:21:49.974 INFO:teuthology.orchestra.run.smithi070.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T00:21:50.041 INFO:teuthology.orchestra.run.smithi187.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T00:21:50.042 INFO:teuthology.orchestra.run.smithi187.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T00:21:50.043 INFO:teuthology.orchestra.run.smithi070.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T00:21:50.053 INFO:teuthology.orchestra.run.smithi187.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T00:21:50.053 INFO:teuthology.orchestra.run.smithi187.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T00:21:50.054 INFO:teuthology.orchestra.run.smithi070.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T00:21:50.054 INFO:teuthology.orchestra.run.smithi070.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T00:21:50.076 INFO:teuthology.orchestra.run.smithi187.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T00:21:50.089 INFO:teuthology.orchestra.run.smithi070.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T00:21:50.095 INFO:teuthology.orchestra.run.smithi187.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T00:21:50.101 INFO:teuthology.orchestra.run.smithi187.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T00:21:50.103 INFO:teuthology.orchestra.run.smithi187.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T00:21:50.103 INFO:teuthology.orchestra.run.smithi187.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T00:21:50.110 INFO:teuthology.orchestra.run.smithi070.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T00:21:50.116 INFO:teuthology.orchestra.run.smithi070.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T00:21:50.117 INFO:teuthology.orchestra.run.smithi070.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T00:21:50.118 INFO:teuthology.orchestra.run.smithi070.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T00:21:50.118 INFO:teuthology.orchestra.run.smithi070.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T00:21:50.166 INFO:teuthology.orchestra.run.smithi070.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T00:21:50.167 INFO:teuthology.orchestra.run.smithi070.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T00:21:50.168 INFO:teuthology.orchestra.run.smithi070.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T00:21:50.181 INFO:teuthology.orchestra.run.smithi187.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T00:21:50.181 INFO:teuthology.orchestra.run.smithi187.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T00:21:50.200 INFO:teuthology.orchestra.run.smithi070.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T00:21:50.201 INFO:teuthology.orchestra.run.smithi070.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T00:21:50.201 INFO:teuthology.orchestra.run.smithi070.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T00:21:50.202 INFO:teuthology.orchestra.run.smithi070.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T00:21:50.203 INFO:teuthology.orchestra.run.smithi070.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T00:21:50.247 INFO:teuthology.orchestra.run.smithi070.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T00:21:55.544 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 15.8 MB in 2s (7,652 kB/s) 2024-09-12T00:21:55.546 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 15.8 MB in 2s (7,371 kB/s) 2024-09-12T00:21:57.017 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-09-12T00:21:57.035 DEBUG:teuthology.orchestra.run.smithi187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T00:21:57.081 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-12T00:21:57.097 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-09-12T00:21:57.099 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T00:21:57.152 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-12T00:21:57.306 INFO:teuthology.orchestra.run.smithi187.stdout:Building dependency tree... 2024-09-12T00:21:57.306 INFO:teuthology.orchestra.run.smithi187.stdout:Reading state information... 2024-09-12T00:21:57.335 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2024-09-12T00:21:57.336 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2024-09-12T00:21:57.482 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:21:57.483 INFO:teuthology.orchestra.run.smithi187.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:21:57.483 INFO:teuthology.orchestra.run.smithi187.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:21:57.483 INFO:teuthology.orchestra.run.smithi187.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:21:57.483 INFO:teuthology.orchestra.run.smithi187.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T00:21:57.484 INFO:teuthology.orchestra.run.smithi187.stdout: python2.7-minimal 2024-09-12T00:21:57.484 INFO:teuthology.orchestra.run.smithi187.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:21:57.486 INFO:teuthology.orchestra.run.smithi187.stdout:The following additional packages will be installed: 2024-09-12T00:21:57.486 INFO:teuthology.orchestra.run.smithi187.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T00:21:57.486 INFO:teuthology.orchestra.run.smithi187.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T00:21:57.486 INFO:teuthology.orchestra.run.smithi187.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T00:21:57.486 INFO:teuthology.orchestra.run.smithi187.stdout:Suggested packages: 2024-09-12T00:21:57.486 INFO:teuthology.orchestra.run.smithi187.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T00:21:57.487 INFO:teuthology.orchestra.run.smithi187.stdout:Recommended packages: 2024-09-12T00:21:57.487 INFO:teuthology.orchestra.run.smithi187.stdout: thermald 2024-09-12T00:21:57.503 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:21:57.503 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:21:57.503 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:21:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:21:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T00:21:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: python2.7-minimal 2024-09-12T00:21:57.504 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:21:57.505 INFO:teuthology.orchestra.run.smithi070.stdout:The following additional packages will be installed: 2024-09-12T00:21:57.505 INFO:teuthology.orchestra.run.smithi070.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T00:21:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T00:21:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T00:21:57.507 INFO:teuthology.orchestra.run.smithi070.stdout:Suggested packages: 2024-09-12T00:21:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T00:21:57.507 INFO:teuthology.orchestra.run.smithi070.stdout:Recommended packages: 2024-09-12T00:21:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: thermald 2024-09-12T00:21:57.526 INFO:teuthology.orchestra.run.smithi187.stdout:The following NEW packages will be installed: 2024-09-12T00:21:57.526 INFO:teuthology.orchestra.run.smithi187.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T00:21:57.526 INFO:teuthology.orchestra.run.smithi187.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T00:21:57.526 INFO:teuthology.orchestra.run.smithi187.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T00:21:57.528 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages will be upgraded: 2024-09-12T00:21:57.528 INFO:teuthology.orchestra.run.smithi187.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T00:21:57.557 INFO:teuthology.orchestra.run.smithi070.stdout:The following NEW packages will be installed: 2024-09-12T00:21:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T00:21:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T00:21:57.558 INFO:teuthology.orchestra.run.smithi070.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T00:21:57.560 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages will be upgraded: 2024-09-12T00:21:57.560 INFO:teuthology.orchestra.run.smithi070.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T00:21:57.618 INFO:teuthology.orchestra.run.smithi070.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T00:21:57.618 INFO:teuthology.orchestra.run.smithi070.stdout:Need to get 113 MB of archives. 2024-09-12T00:21:57.618 INFO:teuthology.orchestra.run.smithi070.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T00:21:57.618 INFO:teuthology.orchestra.run.smithi070.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T00:21:57.707 INFO:teuthology.orchestra.run.smithi187.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T00:21:57.707 INFO:teuthology.orchestra.run.smithi187.stdout:Need to get 113 MB of archives. 2024-09-12T00:21:57.707 INFO:teuthology.orchestra.run.smithi187.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T00:21:57.708 INFO:teuthology.orchestra.run.smithi187.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T00:21:58.006 INFO:teuthology.orchestra.run.smithi070.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T00:21:58.095 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T00:21:58.906 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T00:21:58.906 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T00:21:58.906 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T00:21:59.026 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T00:21:59.047 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T00:21:59.202 INFO:teuthology.orchestra.run.smithi187.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T00:21:59.512 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 113 MB in 2s (73.4 MB/s) 2024-09-12T00:21:59.554 INFO:teuthology.orchestra.run.smithi187.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T00:21:59.882 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T00:22:01.801 INFO:teuthology.orchestra.run.smithi187.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T00:22:01.801 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T00:22:01.802 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T00:22:01.987 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T00:22:01.991 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:22:02.162 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T00:22:02.232 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:22:02.247 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T00:22:02.636 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 113 MB in 5s (24.1 MB/s) 2024-09-12T00:22:02.787 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T00:22:04.442 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T00:22:04.463 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:22:04.553 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:22:04.809 INFO:teuthology.orchestra.run.smithi187.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T00:22:04.813 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:22:04.892 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:22:04.996 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T00:22:05.016 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:22:05.054 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:22:06.927 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T00:22:06.948 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:22:07.035 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:22:07.498 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T00:22:07.519 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:22:07.557 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:22:11.908 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:22:12.033 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:22:12.291 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:22:12.395 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:22:12.723 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T00:22:12.746 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T00:22:12.790 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T00:22:14.008 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:22:14.136 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:22:14.445 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:22:14.573 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:22:14.876 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T00:22:14.899 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T00:22:14.934 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T00:22:18.970 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T00:22:19.007 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:22:19.061 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:22:20.296 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T00:22:20.333 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:22:20.379 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:22:21.823 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:22:21.949 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:22:22.316 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T00:22:22.446 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:22:22.572 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T00:22:22.701 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:22:23.414 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:22:23.540 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:22:23.872 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T00:22:23.986 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:22:24.019 INFO:teuthology.orchestra.run.smithi070.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:22:24.019 INFO:teuthology.orchestra.run.smithi070.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T00:22:24.019 INFO:teuthology.orchestra.run.smithi070.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:22:24.019 INFO:teuthology.orchestra.run.smithi070.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T00:22:24.112 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T00:22:24.178 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:22:24.241 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:22:25.546 INFO:teuthology.orchestra.run.smithi187.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:22:25.546 INFO:teuthology.orchestra.run.smithi187.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T00:22:25.547 INFO:teuthology.orchestra.run.smithi187.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:22:25.547 INFO:teuthology.orchestra.run.smithi187.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T00:22:25.701 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:22:25.755 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:22:27.140 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T00:22:27.144 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:22:27.283 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T00:22:27.409 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:22:27.475 INFO:teuthology.orchestra.run.smithi070.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T00:22:27.475 INFO:teuthology.orchestra.run.smithi070.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:22:28.503 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T00:22:28.612 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T00:22:28.747 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:22:28.820 INFO:teuthology.orchestra.run.smithi187.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T00:22:28.820 INFO:teuthology.orchestra.run.smithi187.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:22:42.078 INFO:teuthology.orchestra.run.smithi070.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T00:22:42.078 INFO:teuthology.orchestra.run.smithi070.stdout:Sourcing file `/etc/default/grub' 2024-09-12T00:22:42.109 INFO:teuthology.orchestra.run.smithi070.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T00:22:42.134 INFO:teuthology.orchestra.run.smithi070.stdout:Generating grub configuration file ... 2024-09-12T00:22:42.473 INFO:teuthology.orchestra.run.smithi070.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:22:42.493 INFO:teuthology.orchestra.run.smithi070.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:22:42.773 INFO:teuthology.orchestra.run.smithi070.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:22:42.779 INFO:teuthology.orchestra.run.smithi070.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T00:22:42.842 INFO:teuthology.orchestra.run.smithi070.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T00:22:42.848 INFO:teuthology.orchestra.run.smithi070.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T00:22:42.862 INFO:teuthology.orchestra.run.smithi187.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T00:22:42.862 INFO:teuthology.orchestra.run.smithi187.stdout:Sourcing file `/etc/default/grub' 2024-09-12T00:22:42.880 INFO:teuthology.orchestra.run.smithi187.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T00:22:42.909 INFO:teuthology.orchestra.run.smithi187.stdout:Generating grub configuration file ... 2024-09-12T00:22:43.029 INFO:teuthology.orchestra.run.smithi070.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T00:22:43.029 INFO:teuthology.orchestra.run.smithi070.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T00:22:43.029 INFO:teuthology.orchestra.run.smithi070.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T00:22:43.065 INFO:teuthology.orchestra.run.smithi070.stdout:done 2024-09-12T00:22:43.249 INFO:teuthology.orchestra.run.smithi187.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:22:43.262 INFO:teuthology.orchestra.run.smithi187.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:22:43.542 DEBUG:teuthology.orchestra.run.smithi070:> dpkg -s linux-image-generic 2024-09-12T00:22:43.562 INFO:teuthology.orchestra.run.smithi070.stdout:Package: linux-image-generic 2024-09-12T00:22:43.562 INFO:teuthology.orchestra.run.smithi070.stdout:Status: install ok installed 2024-09-12T00:22:43.563 INFO:teuthology.orchestra.run.smithi070.stdout:Priority: optional 2024-09-12T00:22:43.563 INFO:teuthology.orchestra.run.smithi070.stdout:Section: kernel 2024-09-12T00:22:43.563 INFO:teuthology.orchestra.run.smithi070.stdout:Installed-Size: 21 2024-09-12T00:22:43.563 INFO:teuthology.orchestra.run.smithi070.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T00:22:43.563 INFO:teuthology.orchestra.run.smithi070.stdout:Architecture: amd64 2024-09-12T00:22:43.563 INFO:teuthology.orchestra.run.smithi070.stdout:Source: linux-meta 2024-09-12T00:22:43.563 INFO:teuthology.orchestra.run.smithi070.stdout:Version: 5.15.0.119.119 2024-09-12T00:22:43.563 INFO:teuthology.orchestra.run.smithi070.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T00:22:43.563 INFO:teuthology.orchestra.run.smithi070.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T00:22:43.563 INFO:teuthology.orchestra.run.smithi070.stdout:Recommends: thermald 2024-09-12T00:22:43.563 INFO:teuthology.orchestra.run.smithi070.stdout:Description: Generic Linux kernel image 2024-09-12T00:22:43.564 INFO:teuthology.orchestra.run.smithi070.stdout: This package will always depend on the latest generic kernel image 2024-09-12T00:22:43.564 INFO:teuthology.orchestra.run.smithi070.stdout: available. 2024-09-12T00:22:43.564 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T00:22:43.564 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T00:22:43.564 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T00:22:43.564 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T00:22:43.565 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi070.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T00:22:43.565 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get clean 2024-09-12T00:22:43.635 INFO:teuthology.orchestra.run.smithi187.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:22:43.641 INFO:teuthology.orchestra.run.smithi187.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T00:22:43.714 INFO:teuthology.orchestra.run.smithi187.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T00:22:43.718 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get update 2024-09-12T00:22:43.719 INFO:teuthology.orchestra.run.smithi187.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T00:22:43.830 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:22:43.898 INFO:teuthology.orchestra.run.smithi187.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T00:22:43.898 INFO:teuthology.orchestra.run.smithi187.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T00:22:43.898 INFO:teuthology.orchestra.run.smithi187.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T00:22:43.935 INFO:teuthology.orchestra.run.smithi187.stdout:done 2024-09-12T00:22:43.952 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:22:44.034 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:22:44.119 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:22:44.443 DEBUG:teuthology.orchestra.run.smithi187:> dpkg -s linux-image-generic 2024-09-12T00:22:44.504 INFO:teuthology.orchestra.run.smithi187.stdout:Package: linux-image-generic 2024-09-12T00:22:44.504 INFO:teuthology.orchestra.run.smithi187.stdout:Status: install ok installed 2024-09-12T00:22:44.504 INFO:teuthology.orchestra.run.smithi187.stdout:Priority: optional 2024-09-12T00:22:44.504 INFO:teuthology.orchestra.run.smithi187.stdout:Section: kernel 2024-09-12T00:22:44.504 INFO:teuthology.orchestra.run.smithi187.stdout:Installed-Size: 21 2024-09-12T00:22:44.505 INFO:teuthology.orchestra.run.smithi187.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T00:22:44.505 INFO:teuthology.orchestra.run.smithi187.stdout:Architecture: amd64 2024-09-12T00:22:44.505 INFO:teuthology.orchestra.run.smithi187.stdout:Source: linux-meta 2024-09-12T00:22:44.505 INFO:teuthology.orchestra.run.smithi187.stdout:Version: 5.15.0.119.119 2024-09-12T00:22:44.505 INFO:teuthology.orchestra.run.smithi187.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T00:22:44.505 INFO:teuthology.orchestra.run.smithi187.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T00:22:44.505 INFO:teuthology.orchestra.run.smithi187.stdout:Recommends: thermald 2024-09-12T00:22:44.505 INFO:teuthology.orchestra.run.smithi187.stdout:Description: Generic Linux kernel image 2024-09-12T00:22:44.505 INFO:teuthology.orchestra.run.smithi187.stdout: This package will always depend on the latest generic kernel image 2024-09-12T00:22:44.505 INFO:teuthology.orchestra.run.smithi187.stdout: available. 2024-09-12T00:22:44.505 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T00:22:44.505 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T00:22:44.506 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T00:22:44.506 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T00:22:44.506 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi187.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T00:22:44.506 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get clean 2024-09-12T00:22:44.701 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get update 2024-09-12T00:22:44.819 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:22:44.942 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:22:45.024 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:22:45.105 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:22:45.310 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-12T00:22:45.328 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T00:22:45.394 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-12T00:22:45.603 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2024-09-12T00:22:45.604 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2024-09-12T00:22:45.795 INFO:teuthology.orchestra.run.smithi070.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T00:22:45.795 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:22:45.795 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:22:45.795 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:22:45.795 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:22:45.796 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:22:45.796 INFO:teuthology.orchestra.run.smithi070.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:22:45.796 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:22:45.838 INFO:teuthology.orchestra.run.smithi070.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T00:22:45.840 DEBUG:teuthology.orchestra.run.smithi070:> dpkg -s linux-image-generic 2024-09-12T00:22:45.855 INFO:teuthology.orchestra.run.smithi070.stdout:Package: linux-image-generic 2024-09-12T00:22:45.855 INFO:teuthology.orchestra.run.smithi070.stdout:Status: install ok installed 2024-09-12T00:22:45.855 INFO:teuthology.orchestra.run.smithi070.stdout:Priority: optional 2024-09-12T00:22:45.855 INFO:teuthology.orchestra.run.smithi070.stdout:Section: kernel 2024-09-12T00:22:45.855 INFO:teuthology.orchestra.run.smithi070.stdout:Installed-Size: 21 2024-09-12T00:22:45.855 INFO:teuthology.orchestra.run.smithi070.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T00:22:45.856 INFO:teuthology.orchestra.run.smithi070.stdout:Architecture: amd64 2024-09-12T00:22:45.856 INFO:teuthology.orchestra.run.smithi070.stdout:Source: linux-meta 2024-09-12T00:22:45.856 INFO:teuthology.orchestra.run.smithi070.stdout:Version: 5.15.0.119.119 2024-09-12T00:22:45.856 INFO:teuthology.orchestra.run.smithi070.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T00:22:45.856 INFO:teuthology.orchestra.run.smithi070.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T00:22:45.856 INFO:teuthology.orchestra.run.smithi070.stdout:Recommends: thermald 2024-09-12T00:22:45.856 INFO:teuthology.orchestra.run.smithi070.stdout:Description: Generic Linux kernel image 2024-09-12T00:22:45.856 INFO:teuthology.orchestra.run.smithi070.stdout: This package will always depend on the latest generic kernel image 2024-09-12T00:22:45.856 INFO:teuthology.orchestra.run.smithi070.stdout: available. 2024-09-12T00:22:45.857 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-09-12T00:22:45.908 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.iCfzXMxcPh 2024-09-12T00:22:45.908 DEBUG:teuthology.orchestra.run.smithi070:> sudo cp /boot/grub/grub.cfg /tmp/tmp.iCfzXMxcPh 2024-09-12T00:22:45.976 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.iCfzXMxcPh 2024-09-12T00:22:46.103 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.iCfzXMxcPh is 10KB 2024-09-12T00:22:46.115 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.iCfzXMxcPh 2024-09-12T00:22:46.121 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T00:22:46.175 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:22:46.175 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T00:22:46.175 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T00:22:46.251 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T00:22:46.251 DEBUG:teuthology.orchestra.run.smithi070:> sudo update-grub 2024-09-12T00:22:46.279 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-09-12T00:22:46.297 DEBUG:teuthology.orchestra.run.smithi187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T00:22:46.360 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-09-12T00:22:46.566 INFO:teuthology.orchestra.run.smithi187.stdout:Building dependency tree... 2024-09-12T00:22:46.567 INFO:teuthology.orchestra.run.smithi187.stdout:Reading state information... 2024-09-12T00:22:46.750 INFO:teuthology.orchestra.run.smithi187.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T00:22:46.750 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:22:46.750 INFO:teuthology.orchestra.run.smithi187.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:22:46.750 INFO:teuthology.orchestra.run.smithi187.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:22:46.750 INFO:teuthology.orchestra.run.smithi187.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:22:46.751 INFO:teuthology.orchestra.run.smithi187.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:22:46.751 INFO:teuthology.orchestra.run.smithi187.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:22:46.751 INFO:teuthology.orchestra.run.smithi187.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:22:46.790 INFO:teuthology.orchestra.run.smithi187.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T00:22:46.792 DEBUG:teuthology.orchestra.run.smithi187:> dpkg -s linux-image-generic 2024-09-12T00:22:46.808 INFO:teuthology.orchestra.run.smithi187.stdout:Package: linux-image-generic 2024-09-12T00:22:46.808 INFO:teuthology.orchestra.run.smithi187.stdout:Status: install ok installed 2024-09-12T00:22:46.808 INFO:teuthology.orchestra.run.smithi187.stdout:Priority: optional 2024-09-12T00:22:46.808 INFO:teuthology.orchestra.run.smithi187.stdout:Section: kernel 2024-09-12T00:22:46.808 INFO:teuthology.orchestra.run.smithi187.stdout:Installed-Size: 21 2024-09-12T00:22:46.808 INFO:teuthology.orchestra.run.smithi187.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T00:22:46.808 INFO:teuthology.orchestra.run.smithi187.stdout:Architecture: amd64 2024-09-12T00:22:46.809 INFO:teuthology.orchestra.run.smithi187.stdout:Source: linux-meta 2024-09-12T00:22:46.809 INFO:teuthology.orchestra.run.smithi187.stdout:Version: 5.15.0.119.119 2024-09-12T00:22:46.809 INFO:teuthology.orchestra.run.smithi187.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T00:22:46.809 INFO:teuthology.orchestra.run.smithi187.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T00:22:46.809 INFO:teuthology.orchestra.run.smithi187.stdout:Recommends: thermald 2024-09-12T00:22:46.809 INFO:teuthology.orchestra.run.smithi187.stdout:Description: Generic Linux kernel image 2024-09-12T00:22:46.809 INFO:teuthology.orchestra.run.smithi187.stdout: This package will always depend on the latest generic kernel image 2024-09-12T00:22:46.809 INFO:teuthology.orchestra.run.smithi187.stdout: available. 2024-09-12T00:22:46.809 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2024-09-12T00:22:46.853 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.HuxaRJMbSo 2024-09-12T00:22:46.853 DEBUG:teuthology.orchestra.run.smithi187:> sudo cp /boot/grub/grub.cfg /tmp/tmp.HuxaRJMbSo 2024-09-12T00:22:46.909 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.HuxaRJMbSo 2024-09-12T00:22:47.036 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.HuxaRJMbSo is 10KB 2024-09-12T00:22:47.048 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.HuxaRJMbSo 2024-09-12T00:22:47.054 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T00:22:47.108 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T00:22:47.108 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T00:22:47.108 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T00:22:47.172 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T00:22:47.172 DEBUG:teuthology.orchestra.run.smithi187:> sudo update-grub 2024-09-12T00:22:47.551 INFO:teuthology.orchestra.run.smithi070.stderr:Sourcing file `/etc/default/grub' 2024-09-12T00:22:47.552 INFO:teuthology.orchestra.run.smithi070.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T00:22:47.555 INFO:teuthology.orchestra.run.smithi070.stderr:Generating grub configuration file ... 2024-09-12T00:22:47.745 INFO:teuthology.orchestra.run.smithi070.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:22:47.751 INFO:teuthology.orchestra.run.smithi070.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:22:48.016 INFO:teuthology.orchestra.run.smithi070.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:22:48.021 INFO:teuthology.orchestra.run.smithi070.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T00:22:48.062 INFO:teuthology.orchestra.run.smithi070.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T00:22:48.067 INFO:teuthology.orchestra.run.smithi070.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T00:22:48.187 INFO:teuthology.orchestra.run.smithi070.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T00:22:48.187 INFO:teuthology.orchestra.run.smithi070.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T00:22:48.187 INFO:teuthology.orchestra.run.smithi070.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T00:22:48.197 INFO:teuthology.orchestra.run.smithi070.stderr:done 2024-09-12T00:22:48.210 DEBUG:teuthology.orchestra.run.smithi070:> sudo shutdown -r now 2024-09-12T00:22:48.395 INFO:teuthology.orchestra.run.smithi187.stderr:Sourcing file `/etc/default/grub' 2024-09-12T00:22:48.396 INFO:teuthology.orchestra.run.smithi187.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T00:22:48.400 INFO:teuthology.orchestra.run.smithi187.stderr:Generating grub configuration file ... 2024-09-12T00:22:48.643 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:22:48.650 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:22:48.951 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:22:48.957 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T00:22:49.000 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T00:22:49.005 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T00:22:49.134 INFO:teuthology.orchestra.run.smithi187.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T00:22:49.134 INFO:teuthology.orchestra.run.smithi187.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T00:22:49.134 INFO:teuthology.orchestra.run.smithi187.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T00:22:49.146 INFO:teuthology.orchestra.run.smithi187.stderr:done 2024-09-12T00:22:49.161 DEBUG:teuthology.orchestra.run.smithi187:> sudo shutdown -r now 2024-09-12T00:23:18.241 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T00:23:18.242 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-12T00:23:18.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:23:19.165 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T00:23:19.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-12T00:23:19.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:23:36.765 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-09-12T00:23:37.533 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-09-12T00:23:45.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-12T00:23:45.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:23:46.534 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-12T00:23:46.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:23:48.861 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-09-12T00:23:49.601 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-09-12T00:24:00.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-12T00:24:00.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:24:01.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-12T00:24:01.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:24:19.261 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-09-12T00:24:20.029 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-09-12T00:24:34.276 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-12T00:24:34.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:24:34.498 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-09-12T00:24:35.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-12T00:24:35.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:24:35.068 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-12T00:24:35.069 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-12T00:24:35.069 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-09-12T00:24:35.122 INFO:teuthology.orchestra.run.smithi070.stdout:5.15.0-119-generic 2024-09-12T00:24:35.122 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T00:24:35.123 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T00:24:35.123 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T00:24:35.318 DEBUG:teuthology.orchestra.run.smithi187:> true 2024-09-12T00:24:35.831 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-12T00:24:35.831 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-119-generic"... 2024-09-12T00:24:35.831 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2024-09-12T00:24:35.877 INFO:teuthology.orchestra.run.smithi187.stdout:5.15.0-119-generic 2024-09-12T00:24:35.878 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T00:24:35.878 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T00:24:35.878 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T00:24:36.123 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T00:24:36.124 DEBUG:teuthology.orchestra.run.smithi070:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T00:24:36.525 INFO:teuthology.orchestra.run.smithi070.stdout:ttyS1 2024-09-12T00:24:36.546 DEBUG:teuthology.parallel:result is None 2024-09-12T00:24:36.878 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T00:24:36.879 DEBUG:teuthology.orchestra.run.smithi187:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T00:24:36.940 INFO:teuthology.orchestra.run.smithi187.stdout:ttyS1 2024-09-12T00:24:36.960 DEBUG:teuthology.parallel:result is None 2024-09-12T00:24:36.960 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T00:24:37.114 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T00:24:37.115 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T00:24:37.117 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T00:24:37.123 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T00:24:37.131 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T00:24:37.141 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T00:24:37.141 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T00:24:37.165 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T00:24:37.192 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T00:24:37.197 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T00:24:37.198 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T00:24:37.230 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T00:24:37.247 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:24:37.250 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:24:37.257 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:24:37.258 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:24:37.260 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T00:24:37.265 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T00:24:37.266 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T00:24:37.302 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T00:24:37.315 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T00:24:37.322 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T00:24:37.322 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T00:24:37.358 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T00:24:37.363 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:24:37.408 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:24:37.457 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:24:37.457 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T00:24:37.517 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:24:37.523 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:24:37.570 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T00:24:37.570 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T00:24:37.626 DEBUG:teuthology.orchestra.run.smithi070:> sudo service rsyslog restart 2024-09-12T00:24:37.628 DEBUG:teuthology.orchestra.run.smithi187:> sudo service rsyslog restart 2024-09-12T00:24:37.719 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T00:24:37.797 INFO:teuthology.task.internal:Starting timer... 2024-09-12T00:24:37.797 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T00:24:37.810 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T00:24:37.822 DEBUG:teuthology.task.selinux:Excluding smithi070: OS 'ubuntu' does not support SELinux 2024-09-12T00:24:37.822 DEBUG:teuthology.task.selinux:Excluding smithi187: OS 'ubuntu' does not support SELinux 2024-09-12T00:24:37.822 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T00:24:37.822 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-12T00:24:37.822 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T00:24:37.822 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T00:24:37.830 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T00:24:37.844 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T00:24:37.845 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi070.front.sepia.ceph.com,smithi187.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T00:32:09.692 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi070.front.sepia.ceph.com'), Remote(name='ubuntu@smithi187.front.sepia.ceph.com')] 2024-09-12T00:32:09.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-12T00:32:09.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:32:09.789 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-09-12T00:32:09.869 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-12T00:32:09.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-12T00:32:09.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:32:09.962 DEBUG:teuthology.orchestra.run.smithi187:> true 2024-09-12T00:32:10.037 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-12T00:32:10.038 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T00:32:10.048 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T00:32:10.048 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:32:10.049 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:32:10.051 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:32:10.051 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:32:10.077 INFO:teuthology.orchestra.run.smithi070.stdout:12 Sep 00:32:10 ntpd[18502]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T00:32:10.078 INFO:teuthology.orchestra.run.smithi070.stdout:12 Sep 00:32:10 ntpd[18502]: Command line: ntpd -gq 2024-09-12T00:32:10.078 INFO:teuthology.orchestra.run.smithi070.stdout:12 Sep 00:32:10 ntpd[18502]: ---------------------------------------------------- 2024-09-12T00:32:10.078 INFO:teuthology.orchestra.run.smithi070.stdout:12 Sep 00:32:10 ntpd[18502]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T00:32:10.078 INFO:teuthology.orchestra.run.smithi070.stdout:12 Sep 00:32:10 ntpd[18502]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T00:32:10.078 INFO:teuthology.orchestra.run.smithi070.stdout:12 Sep 00:32:10 ntpd[18502]: corporation. Support and training for ntp-4 are 2024-09-12T00:32:10.078 INFO:teuthology.orchestra.run.smithi070.stdout:12 Sep 00:32:10 ntpd[18502]: available at https://www.nwtime.org/support 2024-09-12T00:32:10.078 INFO:teuthology.orchestra.run.smithi070.stdout:12 Sep 00:32:10 ntpd[18502]: ---------------------------------------------------- 2024-09-12T00:32:10.079 INFO:teuthology.orchestra.run.smithi070.stdout:12 Sep 00:32:10 ntpd[18502]: proto: precision = 0.058 usec (-24) 2024-09-12T00:32:10.079 INFO:teuthology.orchestra.run.smithi070.stdout:12 Sep 00:32:10 ntpd[18502]: basedate set to 2022-02-04 2024-09-12T00:32:10.079 INFO:teuthology.orchestra.run.smithi070.stdout:12 Sep 00:32:10 ntpd[18502]: gps base set to 2022-02-06 (week 2196) 2024-09-12T00:32:10.080 INFO:teuthology.orchestra.run.smithi070.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:32:10.080 INFO:teuthology.orchestra.run.smithi070.stdout:12 Sep 00:32:10 ntpd[18502]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:32:10.080 INFO:teuthology.orchestra.run.smithi070.stdout:12 Sep 00:32:10 ntpd[18502]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:32:10.080 INFO:teuthology.orchestra.run.smithi070.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:32:10.081 INFO:teuthology.orchestra.run.smithi070.stdout:12 Sep 00:32:10 ntpd[18502]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T00:32:10.081 INFO:teuthology.orchestra.run.smithi070.stdout:12 Sep 00:32:10 ntpd[18502]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T00:32:10.082 INFO:teuthology.orchestra.run.smithi070.stdout:12 Sep 00:32:10 ntpd[18502]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T00:32:10.082 INFO:teuthology.orchestra.run.smithi070.stdout:12 Sep 00:32:10 ntpd[18502]: Listen normally on 3 enp3s0f1 172.21.15.70:123 2024-09-12T00:32:10.082 INFO:teuthology.orchestra.run.smithi070.stdout:12 Sep 00:32:10 ntpd[18502]: Listen normally on 4 lo [::1]:123 2024-09-12T00:32:10.082 INFO:teuthology.orchestra.run.smithi070.stdout:12 Sep 00:32:10 ntpd[18502]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d3e7%5]:123 2024-09-12T00:32:10.082 INFO:teuthology.orchestra.run.smithi070.stdout:12 Sep 00:32:10 ntpd[18502]: Listening on routing socket on fd #22 for interface updates 2024-09-12T00:32:10.108 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 00:32:10 ntpd[18484]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T00:32:10.108 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 00:32:10 ntpd[18484]: Command line: ntpd -gq 2024-09-12T00:32:10.108 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 00:32:10 ntpd[18484]: ---------------------------------------------------- 2024-09-12T00:32:10.108 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 00:32:10 ntpd[18484]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T00:32:10.109 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 00:32:10 ntpd[18484]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T00:32:10.109 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 00:32:10 ntpd[18484]: corporation. Support and training for ntp-4 are 2024-09-12T00:32:10.109 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 00:32:10 ntpd[18484]: available at https://www.nwtime.org/support 2024-09-12T00:32:10.109 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 00:32:10 ntpd[18484]: ---------------------------------------------------- 2024-09-12T00:32:10.109 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 00:32:10 ntpd[18484]: proto: precision = 0.047 usec (-24) 2024-09-12T00:32:10.109 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 00:32:10 ntpd[18484]: basedate set to 2022-02-04 2024-09-12T00:32:10.110 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 00:32:10 ntpd[18484]: gps base set to 2022-02-06 (week 2196) 2024-09-12T00:32:10.110 INFO:teuthology.orchestra.run.smithi187.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:32:10.110 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 00:32:10 ntpd[18484]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:32:10.110 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 00:32:10 ntpd[18484]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:32:10.111 INFO:teuthology.orchestra.run.smithi187.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:32:10.111 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 00:32:10 ntpd[18484]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T00:32:10.111 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 00:32:10 ntpd[18484]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T00:32:10.111 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 00:32:10 ntpd[18484]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T00:32:10.112 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 00:32:10 ntpd[18484]: Listen normally on 3 enp3s0f1 172.21.15.187:123 2024-09-12T00:32:10.112 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 00:32:10 ntpd[18484]: Listen normally on 4 lo [::1]:123 2024-09-12T00:32:10.112 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 00:32:10 ntpd[18484]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:77b1%5]:123 2024-09-12T00:32:10.112 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 00:32:10 ntpd[18484]: Listening on routing socket on fd #22 for interface updates 2024-09-12T00:32:11.081 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:11 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:11.081 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:11 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:12.111 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:12 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:12.112 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:12 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:12.112 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:12 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:12.112 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:12 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:12.112 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:12 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:12.112 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:12 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:12.112 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:12 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:12.113 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:12 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:12.113 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:12 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:12.113 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:12 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:12.113 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:12 ntpd[18484]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:32:12.113 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:12 ntpd[18484]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:32:12.113 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:12 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:12.113 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:12 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:12.113 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:12 ntpd[18484]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:32:12.113 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:12 ntpd[18484]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:32:12.113 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:12 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:12.113 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:12 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:12.113 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:12 ntpd[18484]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:32:12.114 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:12 ntpd[18484]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:32:13.078 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:13 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:13.078 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:13 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:13.078 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:13 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:13.078 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:13 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:13.078 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:13 ntpd[18502]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:32:13.078 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:13 ntpd[18502]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:32:14.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:14 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:14.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:14 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:14.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:14 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:14.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:14 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:14.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:14 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:14.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:14 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:14.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:14 ntpd[18502]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:32:14.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:14 ntpd[18502]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:32:14.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:14 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:14.080 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:14 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:14.080 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:14 ntpd[18502]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:32:14.080 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:14 ntpd[18502]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:32:14.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:14 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:14.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:14 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:14.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:14 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:14.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:14 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:14.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:14 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:14.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:14 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:14.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:14 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:14.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:14 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:14.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:14 ntpd[18484]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:32:14.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:14 ntpd[18484]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:32:14.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:14 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:14.111 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:14 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:14.111 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:14 ntpd[18484]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:32:14.111 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:14 ntpd[18484]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:32:14.111 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:14 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:14.111 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:14 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:14.111 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:14 ntpd[18484]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:32:14.111 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:14 ntpd[18484]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:32:15.078 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:15 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:15.078 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:15 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:15.078 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:15 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:15.078 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:15 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:15.078 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:15 ntpd[18502]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:32:15.078 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:15 ntpd[18502]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:32:16.078 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:16 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:16.078 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:16 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:16.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:16 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:16.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:16 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:16.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:16 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:16.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:16 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:16.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:16 ntpd[18502]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:32:16.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:16 ntpd[18502]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:32:16.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:16 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:16.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:16 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:16.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:16 ntpd[18502]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:32:16.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:16 ntpd[18502]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:32:16.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:16 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:16.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:16 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:16.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:16 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:16.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:16 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:16.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:16 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:16.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:16 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:16.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:16 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:16.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:16 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:16.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:16 ntpd[18484]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:32:16.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:16 ntpd[18484]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:32:16.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:16 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:16.111 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:16 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:16.111 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:16 ntpd[18484]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:32:16.111 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:16 ntpd[18484]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:32:16.111 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:16 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:16.111 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:16 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:16.111 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:16 ntpd[18484]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:32:16.111 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:16 ntpd[18484]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:32:17.078 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:17 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:17.078 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:17 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:17.078 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:17 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:17.078 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:17 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:17.078 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:17 ntpd[18502]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:32:17.078 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:17 ntpd[18502]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:32:18.078 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:18 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:18.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:18 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:18.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:18 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:18.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:18 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:18.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:18 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:18.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:18 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:18.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:18 ntpd[18502]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:32:18.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:18 ntpd[18502]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:32:18.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:18 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:18.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:18 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:18.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:18 ntpd[18502]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:32:18.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:18 ntpd[18502]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:32:18.109 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:18 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:18.109 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:18 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:18.109 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:18 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:18.109 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:18 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:18.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:18 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:18.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:18 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:18.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:18 ntpd[18484]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:18.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:18 ntpd[18484]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:18.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:18 ntpd[18484]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:32:18.110 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:18 ntpd[18484]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:32:18.110 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 00:32:18 ntpd[18484]: ntpd: time slew -0.001602 s 2024-09-12T00:32:18.110 INFO:teuthology.orchestra.run.smithi187.stdout:ntpd: time slew -0.001602s 2024-09-12T00:32:18.111 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:18 ntpd[18484]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T00:32:18.111 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 00:32:18 ntpd[18484]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T00:32:18.161 INFO:teuthology.orchestra.run.smithi187.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T00:32:18.161 INFO:teuthology.orchestra.run.smithi187.stdout:============================================================================== 2024-09-12T00:32:18.161 INFO:teuthology.orchestra.run.smithi187.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:32:18.161 INFO:teuthology.orchestra.run.smithi187.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:32:18.161 INFO:teuthology.orchestra.run.smithi187.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:32:18.161 INFO:teuthology.orchestra.run.smithi187.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:32:19.078 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:19 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:19.078 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:19 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:19.078 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:19 ntpd[18502]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:32:19.078 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:19 ntpd[18502]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:32:19.078 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:19 ntpd[18502]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:32:19.078 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:19 ntpd[18502]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:32:19.079 INFO:teuthology.orchestra.run.smithi070.stdout:12 Sep 00:32:19 ntpd[18502]: ntpd: time slew -0.001816 s 2024-09-12T00:32:19.079 INFO:teuthology.orchestra.run.smithi070.stdout:ntpd: time slew -0.001816s 2024-09-12T00:32:19.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:19 ntpd[18502]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T00:32:19.079 INFO:teuthology.orchestra.run.smithi070.stderr:12 Sep 00:32:19 ntpd[18502]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T00:32:19.136 INFO:teuthology.orchestra.run.smithi070.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T00:32:19.136 INFO:teuthology.orchestra.run.smithi070.stdout:============================================================================== 2024-09-12T00:32:19.137 INFO:teuthology.orchestra.run.smithi070.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:32:19.137 INFO:teuthology.orchestra.run.smithi070.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:32:19.137 INFO:teuthology.orchestra.run.smithi070.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:32:19.137 INFO:teuthology.orchestra.run.smithi070.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:32:19.138 INFO:teuthology.run_tasks:Running task install... 2024-09-12T00:32:19.148 DEBUG:teuthology.task.install:project ceph 2024-09-12T00:32:19.148 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}} 2024-09-12T00:32:19.148 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'} 2024-09-12T00:32:19.148 INFO:teuthology.task.install:Using flavor: default 2024-09-12T00:32:19.154 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T00:32:19.154 INFO:teuthology.task.install:extra packages: [] 2024-09-12T00:32:19.154 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-key list | grep Ceph 2024-09-12T00:32:19.155 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-key list | grep Ceph 2024-09-12T00:32:19.215 INFO:teuthology.orchestra.run.smithi187.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T00:32:19.236 INFO:teuthology.orchestra.run.smithi070.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T00:32:19.243 INFO:teuthology.orchestra.run.smithi187.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T00:32:19.243 INFO:teuthology.orchestra.run.smithi187.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T00:32:19.244 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T00:32:19.244 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-12T00:32:19.245 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:32:19.264 INFO:teuthology.orchestra.run.smithi070.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T00:32:19.264 INFO:teuthology.orchestra.run.smithi070.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T00:32:19.264 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T00:32:19.264 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-12T00:32:19.264 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:32:19.397 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default/ 2024-09-12T00:32:19.397 INFO:teuthology.task.install.deb:Package version is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:32:19.411 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default/ 2024-09-12T00:32:19.412 INFO:teuthology.task.install.deb:Package version is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:32:19.516 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T00:32:19.516 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T00:32:19.527 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:32:19.527 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T00:32:19.530 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get update 2024-09-12T00:32:19.542 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get update 2024-09-12T00:32:19.695 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:32:19.715 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:32:19.715 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:32:19.725 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:32:19.742 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:32:19.750 INFO:teuthology.orchestra.run.smithi187.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T00:32:19.767 INFO:teuthology.orchestra.run.smithi070.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T00:32:19.771 INFO:teuthology.orchestra.run.smithi187.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T00:32:19.788 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T00:32:19.792 INFO:teuthology.orchestra.run.smithi187.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T00:32:19.811 INFO:teuthology.orchestra.run.smithi070.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T00:32:19.813 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-09-12T00:32:19.821 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:32:19.831 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-09-12T00:32:19.842 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-12T00:32:19.861 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-12T00:32:19.902 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T00:32:20.071 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 29.2 kB in 0s (85.7 kB/s) 2024-09-12T00:32:20.253 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:32:20.415 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 157 kB in 1s (224 kB/s) 2024-09-12T00:32:21.092 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-12T00:32:21.109 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4753-gd011c522-1jammy cephadm=19.3.0-4753-gd011c522-1jammy ceph-mds=19.3.0-4753-gd011c522-1jammy ceph-mgr=19.3.0-4753-gd011c522-1jammy ceph-common=19.3.0-4753-gd011c522-1jammy ceph-fuse=19.3.0-4753-gd011c522-1jammy ceph-test=19.3.0-4753-gd011c522-1jammy ceph-volume=19.3.0-4753-gd011c522-1jammy radosgw=19.3.0-4753-gd011c522-1jammy python3-rados=19.3.0-4753-gd011c522-1jammy python3-rgw=19.3.0-4753-gd011c522-1jammy python3-cephfs=19.3.0-4753-gd011c522-1jammy python3-rbd=19.3.0-4753-gd011c522-1jammy libcephfs2=19.3.0-4753-gd011c522-1jammy libcephfs-dev=19.3.0-4753-gd011c522-1jammy librados2=19.3.0-4753-gd011c522-1jammy librbd1=19.3.0-4753-gd011c522-1jammy rbd-fuse=19.3.0-4753-gd011c522-1jammy 2024-09-12T00:32:21.173 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-12T00:32:21.383 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2024-09-12T00:32:21.384 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2024-09-12T00:32:21.422 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-09-12T00:32:21.438 DEBUG:teuthology.orchestra.run.smithi187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4753-gd011c522-1jammy cephadm=19.3.0-4753-gd011c522-1jammy ceph-mds=19.3.0-4753-gd011c522-1jammy ceph-mgr=19.3.0-4753-gd011c522-1jammy ceph-common=19.3.0-4753-gd011c522-1jammy ceph-fuse=19.3.0-4753-gd011c522-1jammy ceph-test=19.3.0-4753-gd011c522-1jammy ceph-volume=19.3.0-4753-gd011c522-1jammy radosgw=19.3.0-4753-gd011c522-1jammy python3-rados=19.3.0-4753-gd011c522-1jammy python3-rgw=19.3.0-4753-gd011c522-1jammy python3-cephfs=19.3.0-4753-gd011c522-1jammy python3-rbd=19.3.0-4753-gd011c522-1jammy libcephfs2=19.3.0-4753-gd011c522-1jammy libcephfs-dev=19.3.0-4753-gd011c522-1jammy librados2=19.3.0-4753-gd011c522-1jammy librbd1=19.3.0-4753-gd011c522-1jammy rbd-fuse=19.3.0-4753-gd011c522-1jammy 2024-09-12T00:32:21.502 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-09-12T00:32:21.588 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:32:21.588 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:32:21.588 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:32:21.589 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:32:21.589 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:32:21.589 INFO:teuthology.orchestra.run.smithi070.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:32:21.589 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:32:21.590 INFO:teuthology.orchestra.run.smithi070.stdout:The following additional packages will be installed: 2024-09-12T00:32:21.590 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T00:32:21.590 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T00:32:21.590 INFO:teuthology.orchestra.run.smithi070.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T00:32:21.590 INFO:teuthology.orchestra.run.smithi070.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T00:32:21.591 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T00:32:21.592 INFO:teuthology.orchestra.run.smithi070.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T00:32:21.592 INFO:teuthology.orchestra.run.smithi070.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T00:32:21.592 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T00:32:21.592 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T00:32:21.592 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:32:21.592 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:32:21.592 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:32:21.592 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:32:21.592 INFO:teuthology.orchestra.run.smithi070.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:32:21.592 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:32:21.592 INFO:teuthology.orchestra.run.smithi070.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:32:21.592 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T00:32:21.592 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T00:32:21.593 INFO:teuthology.orchestra.run.smithi070.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T00:32:21.593 INFO:teuthology.orchestra.run.smithi070.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T00:32:21.593 INFO:teuthology.orchestra.run.smithi070.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T00:32:21.593 INFO:teuthology.orchestra.run.smithi070.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T00:32:21.593 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T00:32:21.593 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet zip 2024-09-12T00:32:21.593 INFO:teuthology.orchestra.run.smithi070.stdout:Suggested packages: 2024-09-12T00:32:21.593 INFO:teuthology.orchestra.run.smithi070.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T00:32:21.593 INFO:teuthology.orchestra.run.smithi070.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T00:32:21.594 INFO:teuthology.orchestra.run.smithi070.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T00:32:21.594 INFO:teuthology.orchestra.run.smithi070.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T00:32:21.594 INFO:teuthology.orchestra.run.smithi070.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T00:32:21.594 INFO:teuthology.orchestra.run.smithi070.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T00:32:21.594 INFO:teuthology.orchestra.run.smithi070.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T00:32:21.594 INFO:teuthology.orchestra.run.smithi070.stdout:Recommended packages: 2024-09-12T00:32:21.594 INFO:teuthology.orchestra.run.smithi070.stdout: btrfs-tools 2024-09-12T00:32:21.695 INFO:teuthology.orchestra.run.smithi070.stdout:The following NEW packages will be installed: 2024-09-12T00:32:21.696 INFO:teuthology.orchestra.run.smithi070.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T00:32:21.696 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T00:32:21.696 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T00:32:21.696 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T00:32:21.696 INFO:teuthology.orchestra.run.smithi070.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T00:32:21.696 INFO:teuthology.orchestra.run.smithi070.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T00:32:21.697 INFO:teuthology.orchestra.run.smithi070.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T00:32:21.697 INFO:teuthology.orchestra.run.smithi070.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T00:32:21.698 INFO:teuthology.orchestra.run.smithi070.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T00:32:21.698 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T00:32:21.698 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T00:32:21.698 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:32:21.698 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:32:21.698 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:32:21.698 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:32:21.698 INFO:teuthology.orchestra.run.smithi070.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:32:21.698 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:32:21.698 INFO:teuthology.orchestra.run.smithi070.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:32:21.698 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T00:32:21.699 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T00:32:21.699 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T00:32:21.699 INFO:teuthology.orchestra.run.smithi070.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T00:32:21.699 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T00:32:21.699 INFO:teuthology.orchestra.run.smithi070.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T00:32:21.699 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T00:32:21.699 INFO:teuthology.orchestra.run.smithi070.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T00:32:21.710 INFO:teuthology.orchestra.run.smithi187.stdout:Building dependency tree... 2024-09-12T00:32:21.711 INFO:teuthology.orchestra.run.smithi187.stdout:Reading state information... 2024-09-12T00:32:21.854 INFO:teuthology.orchestra.run.smithi070.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:32:21.854 INFO:teuthology.orchestra.run.smithi070.stdout:Need to get 251 MB of archives. 2024-09-12T00:32:21.854 INFO:teuthology.orchestra.run.smithi070.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-12T00:32:21.854 INFO:teuthology.orchestra.run.smithi070.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4753-gd011c522-1jammy [3,628 kB] 2024-09-12T00:32:21.885 INFO:teuthology.orchestra.run.smithi070.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T00:32:21.919 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:32:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:32:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:32:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:32:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:32:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:32:21.920 INFO:teuthology.orchestra.run.smithi187.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:32:21.920 INFO:teuthology.orchestra.run.smithi187.stdout:The following additional packages will be installed: 2024-09-12T00:32:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T00:32:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T00:32:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T00:32:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T00:32:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T00:32:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T00:32:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T00:32:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T00:32:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T00:32:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:32:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:32:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:32:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:32:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:32:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:32:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:32:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T00:32:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T00:32:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T00:32:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T00:32:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T00:32:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T00:32:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T00:32:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet zip 2024-09-12T00:32:21.924 INFO:teuthology.orchestra.run.smithi187.stdout:Suggested packages: 2024-09-12T00:32:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T00:32:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T00:32:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T00:32:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T00:32:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T00:32:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T00:32:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T00:32:21.924 INFO:teuthology.orchestra.run.smithi187.stdout:Recommended packages: 2024-09-12T00:32:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: btrfs-tools 2024-09-12T00:32:22.027 INFO:teuthology.orchestra.run.smithi187.stdout:The following NEW packages will be installed: 2024-09-12T00:32:22.028 INFO:teuthology.orchestra.run.smithi187.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T00:32:22.028 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T00:32:22.028 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T00:32:22.028 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T00:32:22.028 INFO:teuthology.orchestra.run.smithi187.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T00:32:22.028 INFO:teuthology.orchestra.run.smithi187.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T00:32:22.029 INFO:teuthology.orchestra.run.smithi187.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T00:32:22.029 INFO:teuthology.orchestra.run.smithi187.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T00:32:22.029 INFO:teuthology.orchestra.run.smithi187.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T00:32:22.029 INFO:teuthology.orchestra.run.smithi187.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T00:32:22.029 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T00:32:22.030 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:32:22.030 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:32:22.030 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:32:22.030 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:32:22.030 INFO:teuthology.orchestra.run.smithi187.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:32:22.030 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:32:22.030 INFO:teuthology.orchestra.run.smithi187.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:32:22.030 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T00:32:22.030 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T00:32:22.030 INFO:teuthology.orchestra.run.smithi187.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T00:32:22.030 INFO:teuthology.orchestra.run.smithi187.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T00:32:22.030 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T00:32:22.030 INFO:teuthology.orchestra.run.smithi187.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T00:32:22.031 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T00:32:22.031 INFO:teuthology.orchestra.run.smithi187.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T00:32:22.088 INFO:teuthology.orchestra.run.smithi187.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:32:22.089 INFO:teuthology.orchestra.run.smithi187.stdout:Need to get 251 MB of archives. 2024-09-12T00:32:22.089 INFO:teuthology.orchestra.run.smithi187.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-12T00:32:22.089 INFO:teuthology.orchestra.run.smithi187.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T00:32:22.103 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4753-gd011c522-1jammy [3,322 kB] 2024-09-12T00:32:22.178 INFO:teuthology.orchestra.run.smithi187.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T00:32:22.180 INFO:teuthology.orchestra.run.smithi187.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T00:32:22.197 INFO:teuthology.orchestra.run.smithi187.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T00:32:22.237 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4753-gd011c522-1jammy [722 kB] 2024-09-12T00:32:22.255 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4753-gd011c522-1jammy [356 kB] 2024-09-12T00:32:22.256 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T00:32:22.261 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T00:32:22.262 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4753-gd011c522-1jammy [32.8 kB] 2024-09-12T00:32:22.263 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4753-gd011c522-1jammy [180 kB] 2024-09-12T00:32:22.267 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4753-gd011c522-1jammy [71.3 kB] 2024-09-12T00:32:22.271 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4753-gd011c522-1jammy [338 kB] 2024-09-12T00:32:22.277 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T00:32:22.278 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T00:32:22.278 INFO:teuthology.orchestra.run.smithi070.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4753-gd011c522-1jammy [7,983 kB] 2024-09-12T00:32:22.278 INFO:teuthology.orchestra.run.smithi187.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T00:32:22.279 INFO:teuthology.orchestra.run.smithi187.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T00:32:22.288 INFO:teuthology.orchestra.run.smithi187.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T00:32:22.290 INFO:teuthology.orchestra.run.smithi187.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T00:32:22.292 INFO:teuthology.orchestra.run.smithi187.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T00:32:22.293 INFO:teuthology.orchestra.run.smithi187.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T00:32:22.295 INFO:teuthology.orchestra.run.smithi187.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T00:32:22.297 INFO:teuthology.orchestra.run.smithi187.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T00:32:22.307 INFO:teuthology.orchestra.run.smithi070.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T00:32:22.311 INFO:teuthology.orchestra.run.smithi187.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T00:32:22.313 INFO:teuthology.orchestra.run.smithi187.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T00:32:22.314 INFO:teuthology.orchestra.run.smithi187.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T00:32:22.314 INFO:teuthology.orchestra.run.smithi187.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T00:32:22.315 INFO:teuthology.orchestra.run.smithi187.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T00:32:22.315 INFO:teuthology.orchestra.run.smithi187.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T00:32:22.316 INFO:teuthology.orchestra.run.smithi187.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T00:32:22.316 INFO:teuthology.orchestra.run.smithi187.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T00:32:22.319 INFO:teuthology.orchestra.run.smithi070.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T00:32:22.329 INFO:teuthology.orchestra.run.smithi187.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T00:32:22.330 INFO:teuthology.orchestra.run.smithi187.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T00:32:22.347 INFO:teuthology.orchestra.run.smithi187.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T00:32:22.349 INFO:teuthology.orchestra.run.smithi187.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T00:32:22.350 INFO:teuthology.orchestra.run.smithi187.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T00:32:22.350 INFO:teuthology.orchestra.run.smithi187.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T00:32:22.351 INFO:teuthology.orchestra.run.smithi187.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T00:32:22.352 INFO:teuthology.orchestra.run.smithi187.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T00:32:22.352 INFO:teuthology.orchestra.run.smithi187.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T00:32:22.352 INFO:teuthology.orchestra.run.smithi187.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T00:32:22.364 INFO:teuthology.orchestra.run.smithi187.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T00:32:22.365 INFO:teuthology.orchestra.run.smithi187.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T00:32:22.381 INFO:teuthology.orchestra.run.smithi187.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T00:32:22.386 INFO:teuthology.orchestra.run.smithi187.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T00:32:22.387 INFO:teuthology.orchestra.run.smithi187.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T00:32:22.387 INFO:teuthology.orchestra.run.smithi187.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T00:32:22.388 INFO:teuthology.orchestra.run.smithi187.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T00:32:22.389 INFO:teuthology.orchestra.run.smithi187.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T00:32:22.391 INFO:teuthology.orchestra.run.smithi187.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T00:32:22.392 INFO:teuthology.orchestra.run.smithi187.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T00:32:22.398 INFO:teuthology.orchestra.run.smithi187.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T00:32:22.399 INFO:teuthology.orchestra.run.smithi187.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T00:32:22.400 INFO:teuthology.orchestra.run.smithi070.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T00:32:22.415 INFO:teuthology.orchestra.run.smithi187.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T00:32:22.416 INFO:teuthology.orchestra.run.smithi187.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T00:32:22.417 INFO:teuthology.orchestra.run.smithi187.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T00:32:22.419 INFO:teuthology.orchestra.run.smithi187.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T00:32:22.466 INFO:teuthology.orchestra.run.smithi070.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4753-gd011c522-1jammy [112 kB] 2024-09-12T00:32:22.468 INFO:teuthology.orchestra.run.smithi070.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4753-gd011c522-1jammy [473 kB] 2024-09-12T00:32:22.472 INFO:teuthology.orchestra.run.smithi187.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T00:32:22.473 INFO:teuthology.orchestra.run.smithi187.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T00:32:22.474 INFO:teuthology.orchestra.run.smithi187.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T00:32:22.474 INFO:teuthology.orchestra.run.smithi187.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T00:32:22.475 INFO:teuthology.orchestra.run.smithi187.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T00:32:22.475 INFO:teuthology.orchestra.run.smithi070.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4753-gd011c522-1jammy [28.3 MB] 2024-09-12T00:32:22.478 INFO:teuthology.orchestra.run.smithi187.stdout:Get:56 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4753-gd011c522-1jammy [3,628 kB] 2024-09-12T00:32:22.492 INFO:teuthology.orchestra.run.smithi187.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T00:32:22.494 INFO:teuthology.orchestra.run.smithi187.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T00:32:22.494 INFO:teuthology.orchestra.run.smithi187.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T00:32:22.509 INFO:teuthology.orchestra.run.smithi187.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T00:32:22.509 INFO:teuthology.orchestra.run.smithi187.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T00:32:22.509 INFO:teuthology.orchestra.run.smithi187.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T00:32:22.509 INFO:teuthology.orchestra.run.smithi187.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T00:32:22.510 INFO:teuthology.orchestra.run.smithi187.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T00:32:22.510 INFO:teuthology.orchestra.run.smithi187.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T00:32:22.526 INFO:teuthology.orchestra.run.smithi187.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T00:32:22.526 INFO:teuthology.orchestra.run.smithi187.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T00:32:22.529 INFO:teuthology.orchestra.run.smithi187.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T00:32:22.543 INFO:teuthology.orchestra.run.smithi187.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T00:32:22.545 INFO:teuthology.orchestra.run.smithi187.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T00:32:22.545 INFO:teuthology.orchestra.run.smithi187.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T00:32:22.548 INFO:teuthology.orchestra.run.smithi187.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T00:32:22.550 INFO:teuthology.orchestra.run.smithi187.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T00:32:22.550 INFO:teuthology.orchestra.run.smithi187.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T00:32:22.551 INFO:teuthology.orchestra.run.smithi187.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T00:32:22.560 INFO:teuthology.orchestra.run.smithi187.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T00:32:22.561 INFO:teuthology.orchestra.run.smithi187.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T00:32:22.563 INFO:teuthology.orchestra.run.smithi187.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T00:32:22.577 INFO:teuthology.orchestra.run.smithi187.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T00:32:22.578 INFO:teuthology.orchestra.run.smithi187.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T00:32:22.578 INFO:teuthology.orchestra.run.smithi187.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T00:32:22.579 INFO:teuthology.orchestra.run.smithi187.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T00:32:22.580 INFO:teuthology.orchestra.run.smithi187.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T00:32:22.586 INFO:teuthology.orchestra.run.smithi187.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T00:32:22.586 INFO:teuthology.orchestra.run.smithi187.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T00:32:22.594 INFO:teuthology.orchestra.run.smithi187.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T00:32:22.596 INFO:teuthology.orchestra.run.smithi187.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T00:32:22.597 INFO:teuthology.orchestra.run.smithi187.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T00:32:22.629 INFO:teuthology.orchestra.run.smithi070.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T00:32:22.640 INFO:teuthology.orchestra.run.smithi070.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T00:32:22.670 INFO:teuthology.orchestra.run.smithi070.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T00:32:22.679 INFO:teuthology.orchestra.run.smithi070.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T00:32:22.680 INFO:teuthology.orchestra.run.smithi070.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T00:32:22.681 INFO:teuthology.orchestra.run.smithi070.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T00:32:22.699 INFO:teuthology.orchestra.run.smithi070.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T00:32:22.703 INFO:teuthology.orchestra.run.smithi070.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T00:32:22.708 INFO:teuthology.orchestra.run.smithi070.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T00:32:22.711 INFO:teuthology.orchestra.run.smithi070.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T00:32:22.792 INFO:teuthology.orchestra.run.smithi070.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T00:32:22.796 INFO:teuthology.orchestra.run.smithi070.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T00:32:22.800 INFO:teuthology.orchestra.run.smithi070.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T00:32:22.803 INFO:teuthology.orchestra.run.smithi070.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T00:32:22.804 INFO:teuthology.orchestra.run.smithi070.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T00:32:22.805 INFO:teuthology.orchestra.run.smithi070.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T00:32:22.807 INFO:teuthology.orchestra.run.smithi070.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T00:32:22.808 INFO:teuthology.orchestra.run.smithi187.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4753-gd011c522-1jammy [3,322 kB] 2024-09-12T00:32:22.808 INFO:teuthology.orchestra.run.smithi070.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T00:32:22.808 INFO:teuthology.orchestra.run.smithi070.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T00:32:22.880 INFO:teuthology.orchestra.run.smithi070.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T00:32:22.890 INFO:teuthology.orchestra.run.smithi070.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T00:32:22.891 INFO:teuthology.orchestra.run.smithi070.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T00:32:22.891 INFO:teuthology.orchestra.run.smithi070.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T00:32:22.897 INFO:teuthology.orchestra.run.smithi070.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T00:32:22.898 INFO:teuthology.orchestra.run.smithi070.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T00:32:22.961 INFO:teuthology.orchestra.run.smithi070.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T00:32:22.961 INFO:teuthology.orchestra.run.smithi070.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T00:32:22.963 INFO:teuthology.orchestra.run.smithi070.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T00:32:22.964 INFO:teuthology.orchestra.run.smithi070.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T00:32:23.016 INFO:teuthology.orchestra.run.smithi187.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4753-gd011c522-1jammy [722 kB] 2024-09-12T00:32:23.042 INFO:teuthology.orchestra.run.smithi070.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T00:32:23.044 INFO:teuthology.orchestra.run.smithi070.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T00:32:23.046 INFO:teuthology.orchestra.run.smithi070.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T00:32:23.047 INFO:teuthology.orchestra.run.smithi070.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T00:32:23.070 INFO:teuthology.orchestra.run.smithi187.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4753-gd011c522-1jammy [356 kB] 2024-09-12T00:32:23.077 INFO:teuthology.orchestra.run.smithi187.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4753-gd011c522-1jammy [32.8 kB] 2024-09-12T00:32:23.078 INFO:teuthology.orchestra.run.smithi187.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4753-gd011c522-1jammy [180 kB] 2024-09-12T00:32:23.110 INFO:teuthology.orchestra.run.smithi187.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4753-gd011c522-1jammy [71.3 kB] 2024-09-12T00:32:23.112 INFO:teuthology.orchestra.run.smithi187.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4753-gd011c522-1jammy [338 kB] 2024-09-12T00:32:23.120 INFO:teuthology.orchestra.run.smithi187.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4753-gd011c522-1jammy [7,983 kB] 2024-09-12T00:32:23.136 INFO:teuthology.orchestra.run.smithi070.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T00:32:23.137 INFO:teuthology.orchestra.run.smithi070.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T00:32:23.138 INFO:teuthology.orchestra.run.smithi070.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T00:32:23.139 INFO:teuthology.orchestra.run.smithi070.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T00:32:23.251 INFO:teuthology.orchestra.run.smithi070.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T00:32:23.252 INFO:teuthology.orchestra.run.smithi070.stdout:Get:55 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4753-gd011c522-1jammy [5,210 kB] 2024-09-12T00:32:23.255 INFO:teuthology.orchestra.run.smithi070.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T00:32:23.256 INFO:teuthology.orchestra.run.smithi070.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T00:32:23.259 INFO:teuthology.orchestra.run.smithi070.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T00:32:23.260 INFO:teuthology.orchestra.run.smithi070.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T00:32:23.283 INFO:teuthology.orchestra.run.smithi187.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4753-gd011c522-1jammy [112 kB] 2024-09-12T00:32:23.285 INFO:teuthology.orchestra.run.smithi187.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4753-gd011c522-1jammy [473 kB] 2024-09-12T00:32:23.286 INFO:teuthology.orchestra.run.smithi070.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T00:32:23.287 INFO:teuthology.orchestra.run.smithi070.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T00:32:23.288 INFO:teuthology.orchestra.run.smithi070.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T00:32:23.292 INFO:teuthology.orchestra.run.smithi187.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4753-gd011c522-1jammy [28.3 MB] 2024-09-12T00:32:23.332 INFO:teuthology.orchestra.run.smithi070.stdout:Get:63 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4753-gd011c522-1jammy [251 kB] 2024-09-12T00:32:23.334 INFO:teuthology.orchestra.run.smithi070.stdout:Get:64 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4753-gd011c522-1jammy [124 kB] 2024-09-12T00:32:23.336 INFO:teuthology.orchestra.run.smithi070.stdout:Get:65 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4753-gd011c522-1jammy [1,562 kB] 2024-09-12T00:32:23.367 INFO:teuthology.orchestra.run.smithi070.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T00:32:23.368 INFO:teuthology.orchestra.run.smithi070.stdout:Get:67 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4753-gd011c522-1jammy [6,308 kB] 2024-09-12T00:32:23.485 INFO:teuthology.orchestra.run.smithi070.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T00:32:23.521 INFO:teuthology.orchestra.run.smithi070.stdout:Get:69 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4753-gd011c522-1jammy [23.1 MB] 2024-09-12T00:32:23.530 INFO:teuthology.orchestra.run.smithi070.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T00:32:23.532 INFO:teuthology.orchestra.run.smithi070.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T00:32:23.533 INFO:teuthology.orchestra.run.smithi070.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T00:32:23.535 INFO:teuthology.orchestra.run.smithi070.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T00:32:23.573 INFO:teuthology.orchestra.run.smithi070.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T00:32:23.576 INFO:teuthology.orchestra.run.smithi070.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T00:32:23.577 INFO:teuthology.orchestra.run.smithi070.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T00:32:23.632 INFO:teuthology.orchestra.run.smithi070.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T00:32:23.633 INFO:teuthology.orchestra.run.smithi070.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T00:32:23.692 INFO:teuthology.orchestra.run.smithi070.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T00:32:23.693 INFO:teuthology.orchestra.run.smithi070.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T00:32:23.694 INFO:teuthology.orchestra.run.smithi070.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T00:32:23.695 INFO:teuthology.orchestra.run.smithi070.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T00:32:23.696 INFO:teuthology.orchestra.run.smithi070.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T00:32:23.697 INFO:teuthology.orchestra.run.smithi070.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T00:32:23.704 INFO:teuthology.orchestra.run.smithi070.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T00:32:23.774 INFO:teuthology.orchestra.run.smithi070.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T00:32:23.777 INFO:teuthology.orchestra.run.smithi070.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T00:32:23.778 INFO:teuthology.orchestra.run.smithi070.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T00:32:23.855 INFO:teuthology.orchestra.run.smithi070.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T00:32:23.861 INFO:teuthology.orchestra.run.smithi070.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T00:32:23.863 INFO:teuthology.orchestra.run.smithi070.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T00:32:23.864 INFO:teuthology.orchestra.run.smithi070.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T00:32:23.875 INFO:teuthology.orchestra.run.smithi070.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T00:32:23.877 INFO:teuthology.orchestra.run.smithi070.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T00:32:23.884 INFO:teuthology.orchestra.run.smithi070.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T00:32:23.936 INFO:teuthology.orchestra.run.smithi070.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T00:32:23.938 INFO:teuthology.orchestra.run.smithi070.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T00:32:23.938 INFO:teuthology.orchestra.run.smithi070.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T00:32:24.017 INFO:teuthology.orchestra.run.smithi070.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T00:32:24.019 INFO:teuthology.orchestra.run.smithi070.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T00:32:24.036 INFO:teuthology.orchestra.run.smithi070.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T00:32:24.037 INFO:teuthology.orchestra.run.smithi070.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T00:32:24.038 INFO:teuthology.orchestra.run.smithi070.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T00:32:24.043 INFO:teuthology.orchestra.run.smithi070.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T00:32:24.044 INFO:teuthology.orchestra.run.smithi070.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T00:32:24.155 INFO:teuthology.orchestra.run.smithi070.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4753-gd011c522-1jammy [14.0 kB] 2024-09-12T00:32:24.156 INFO:teuthology.orchestra.run.smithi070.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4753-gd011c522-1jammy [880 kB] 2024-09-12T00:32:24.170 INFO:teuthology.orchestra.run.smithi070.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4753-gd011c522-1jammy [2,438 kB] 2024-09-12T00:32:24.205 INFO:teuthology.orchestra.run.smithi070.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4753-gd011c522-1jammy [812 kB] 2024-09-12T00:32:24.214 INFO:teuthology.orchestra.run.smithi070.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4753-gd011c522-1jammy [160 kB] 2024-09-12T00:32:24.216 INFO:teuthology.orchestra.run.smithi070.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4753-gd011c522-1jammy [61.4 MB] 2024-09-12T00:32:24.754 INFO:teuthology.orchestra.run.smithi187.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4753-gd011c522-1jammy [5,210 kB] 2024-09-12T00:32:24.944 INFO:teuthology.orchestra.run.smithi187.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4753-gd011c522-1jammy [251 kB] 2024-09-12T00:32:24.972 INFO:teuthology.orchestra.run.smithi187.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4753-gd011c522-1jammy [124 kB] 2024-09-12T00:32:24.975 INFO:teuthology.orchestra.run.smithi187.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4753-gd011c522-1jammy [1,562 kB] 2024-09-12T00:32:25.051 INFO:teuthology.orchestra.run.smithi187.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4753-gd011c522-1jammy [6,308 kB] 2024-09-12T00:32:25.356 INFO:teuthology.orchestra.run.smithi187.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4753-gd011c522-1jammy [23.1 MB] 2024-09-12T00:32:25.999 INFO:teuthology.orchestra.run.smithi070.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4753-gd011c522-1jammy [8,625 kB] 2024-09-12T00:32:26.173 INFO:teuthology.orchestra.run.smithi070.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4753-gd011c522-1jammy [14.2 kB] 2024-09-12T00:32:26.174 INFO:teuthology.orchestra.run.smithi070.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4753-gd011c522-1jammy [55.8 MB] 2024-09-12T00:32:26.249 INFO:teuthology.orchestra.run.smithi187.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4753-gd011c522-1jammy [14.0 kB] 2024-09-12T00:32:26.249 INFO:teuthology.orchestra.run.smithi187.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4753-gd011c522-1jammy [880 kB] 2024-09-12T00:32:26.266 INFO:teuthology.orchestra.run.smithi187.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4753-gd011c522-1jammy [2,438 kB] 2024-09-12T00:32:26.315 INFO:teuthology.orchestra.run.smithi187.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4753-gd011c522-1jammy [812 kB] 2024-09-12T00:32:26.362 INFO:teuthology.orchestra.run.smithi187.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4753-gd011c522-1jammy [160 kB] 2024-09-12T00:32:26.366 INFO:teuthology.orchestra.run.smithi187.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4753-gd011c522-1jammy [61.4 MB] 2024-09-12T00:32:27.919 INFO:teuthology.orchestra.run.smithi070.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4753-gd011c522-1jammy [130 kB] 2024-09-12T00:32:27.921 INFO:teuthology.orchestra.run.smithi070.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4753-gd011c522-1jammy [38.9 kB] 2024-09-12T00:32:27.922 INFO:teuthology.orchestra.run.smithi070.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4753-gd011c522-1jammy [15.9 MB] 2024-09-12T00:32:28.365 INFO:teuthology.orchestra.run.smithi070.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4753-gd011c522-1jammy [91.2 kB] 2024-09-12T00:32:28.811 INFO:teuthology.orchestra.run.smithi187.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4753-gd011c522-1jammy [8,625 kB] 2024-09-12T00:32:28.920 INFO:teuthology.orchestra.run.smithi187.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4753-gd011c522-1jammy [14.2 kB] 2024-09-12T00:32:28.920 INFO:teuthology.orchestra.run.smithi187.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4753-gd011c522-1jammy [55.8 MB] 2024-09-12T00:32:28.949 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 251 MB in 7s (37.7 MB/s) 2024-09-12T00:32:29.114 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T00:32:29.215 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T00:32:29.220 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T00:32:29.304 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:32:29.633 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T00:32:29.659 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T00:32:29.724 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:32:30.061 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T00:32:30.087 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T00:32:30.092 INFO:teuthology.orchestra.run.smithi187.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4753-gd011c522-1jammy [130 kB] 2024-09-12T00:32:30.095 INFO:teuthology.orchestra.run.smithi187.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4753-gd011c522-1jammy [38.9 kB] 2024-09-12T00:32:30.096 INFO:teuthology.orchestra.run.smithi187.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4753-gd011c522-1jammy [15.9 MB] 2024-09-12T00:32:30.127 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:32:30.414 INFO:teuthology.orchestra.run.smithi187.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4753-gd011c522-1jammy [91.2 kB] 2024-09-12T00:32:30.514 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T00:32:30.541 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:32:30.580 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:32:30.975 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T00:32:30.991 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 251 MB in 8s (30.0 MB/s) 2024-09-12T00:32:31.001 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:32:31.042 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:32:31.177 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T00:32:31.278 INFO:teuthology.orchestra.run.smithi187.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T00:32:31.284 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T00:32:31.370 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T00:32:31.384 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:32:31.397 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:32:31.428 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:32:31.748 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T00:32:31.774 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T00:32:31.814 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:32:31.911 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T00:32:31.938 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T00:32:32.004 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:32:32.125 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librados2. 2024-09-12T00:32:32.152 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../007-librados2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:32.192 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:32.350 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T00:32:32.376 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T00:32:32.416 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:32:32.645 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librbd1. 2024-09-12T00:32:32.671 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../008-librbd1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:32.711 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:32.920 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T00:32:32.946 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:32:33.003 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:32:33.098 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T00:32:33.124 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:33.164 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:33.440 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T00:32:33.467 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:32:33.506 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:32:33.700 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rados. 2024-09-12T00:32:33.717 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:33.758 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:33.851 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T00:32:33.877 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:32:33.918 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:32:34.077 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T00:32:34.104 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:32:34.144 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:34.346 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T00:32:34.372 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T00:32:34.405 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T00:32:34.421 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:32:34.421 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:34.463 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:34.766 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package librados2. 2024-09-12T00:32:34.766 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T00:32:34.792 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../007-librados2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:34.792 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:32:34.832 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:34.833 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:35.160 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T00:32:35.187 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T00:32:35.227 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:32:35.318 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package librbd1. 2024-09-12T00:32:35.345 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../008-librbd1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:35.385 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:35.530 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T00:32:35.557 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T00:32:35.597 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T00:32:35.807 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T00:32:35.823 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:35.857 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:35.871 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T00:32:35.898 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:35.946 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:36.193 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T00:32:36.220 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T00:32:36.260 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:32:36.265 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rados. 2024-09-12T00:32:36.292 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:36.340 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:36.537 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T00:32:36.553 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T00:32:36.596 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:32:36.660 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T00:32:36.676 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:32:36.718 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:36.882 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T00:32:36.897 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T00:32:36.940 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:32:36.970 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T00:32:36.986 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:37.029 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:37.210 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua5.1. 2024-09-12T00:32:37.237 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T00:32:37.276 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:32:37.557 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T00:32:37.584 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:32:37.638 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua-any. 2024-09-12T00:32:37.657 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:37.664 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T00:32:37.704 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T00:32:37.932 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package zip. 2024-09-12T00:32:37.958 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T00:32:37.998 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T00:32:38.019 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T00:32:38.045 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T00:32:38.085 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:32:38.285 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package unzip. 2024-09-12T00:32:38.311 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T00:32:38.351 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:32:38.405 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T00:32:38.431 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T00:32:38.471 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T00:32:38.766 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T00:32:38.792 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:38.841 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:38.891 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package luarocks. 2024-09-12T00:32:38.917 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T00:32:38.957 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:32:39.261 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T00:32:39.287 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T00:32:39.336 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:32:39.348 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librgw2. 2024-09-12T00:32:39.375 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../025-librgw2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:39.415 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:39.630 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T00:32:39.645 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T00:32:39.688 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:32:39.983 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T00:32:39.992 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T00:32:39.998 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T00:32:40.007 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:40.041 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:32:40.042 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:40.353 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T00:32:40.380 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T00:32:40.412 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package lua5.1. 2024-09-12T00:32:40.419 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:32:40.438 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T00:32:40.486 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:32:40.714 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T00:32:40.741 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:40.781 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:40.823 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package lua-any. 2024-09-12T00:32:40.849 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T00:32:40.890 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T00:32:41.159 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-common. 2024-09-12T00:32:41.176 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package zip. 2024-09-12T00:32:41.185 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:41.191 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T00:32:41.234 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T00:32:41.242 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:41.521 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package unzip. 2024-09-12T00:32:41.543 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T00:32:41.579 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:32:41.941 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package luarocks. 2024-09-12T00:32:41.968 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T00:32:42.008 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:32:42.541 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package librgw2. 2024-09-12T00:32:42.568 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../025-librgw2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:42.608 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:42.756 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-base. 2024-09-12T00:32:42.783 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:42.831 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:43.202 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T00:32:43.228 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:43.268 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:43.410 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T00:32:43.436 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T00:32:43.476 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:32:43.521 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T00:32:43.547 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T00:32:43.579 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:32:43.762 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T00:32:43.793 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T00:32:43.916 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T00:32:43.937 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:32:43.942 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:43.982 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:44.232 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T00:32:44.247 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T00:32:44.282 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:32:44.411 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-common. 2024-09-12T00:32:44.437 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:44.477 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:44.559 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T00:32:44.586 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T00:32:44.626 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:32:44.929 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T00:32:44.955 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T00:32:44.995 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:32:45.332 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T00:32:45.358 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T00:32:45.398 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T00:32:45.668 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-portend. 2024-09-12T00:32:45.694 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T00:32:45.726 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T00:32:46.000 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-base. 2024-09-12T00:32:46.026 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:46.028 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T00:32:46.055 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T00:32:46.075 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:46.095 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T00:32:46.398 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T00:32:46.425 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T00:32:46.465 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:32:46.704 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T00:32:46.731 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T00:32:46.770 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:32:46.801 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T00:32:46.828 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T00:32:46.868 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T00:32:47.082 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T00:32:47.109 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T00:32:47.149 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:32:47.179 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T00:32:47.206 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T00:32:47.254 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T00:32:47.557 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T00:32:47.584 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T00:32:47.585 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T00:32:47.612 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T00:32:47.624 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:32:47.660 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:32:47.901 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-mako. 2024-09-12T00:32:47.917 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T00:32:47.951 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:32:48.030 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T00:32:48.056 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T00:32:48.105 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:32:48.246 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T00:32:48.273 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T00:32:48.313 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:32:48.424 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T00:32:48.451 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T00:32:48.491 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:32:48.615 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T00:32:48.642 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T00:32:48.682 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:32:48.794 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T00:32:48.821 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T00:32:48.861 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T00:32:49.118 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-webob. 2024-09-12T00:32:49.145 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T00:32:49.185 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:32:49.214 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-portend. 2024-09-12T00:32:49.240 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T00:32:49.288 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T00:32:49.512 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T00:32:49.539 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T00:32:49.582 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:32:49.625 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T00:32:49.652 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T00:32:49.691 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T00:32:49.874 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T00:32:49.900 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T00:32:49.957 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:32:50.003 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T00:32:50.029 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T00:32:50.069 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:32:50.260 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-paste. 2024-09-12T00:32:50.286 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T00:32:50.326 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:32:50.398 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T00:32:50.425 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T00:32:50.465 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T00:32:50.654 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T00:32:50.681 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T00:32:50.721 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:32:50.743 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T00:32:50.770 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T00:32:50.801 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T00:32:51.024 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T00:32:51.051 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T00:32:51.091 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:32:51.104 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T00:32:51.131 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T00:32:51.171 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:32:51.393 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T00:32:51.420 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T00:32:51.460 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T00:32:51.490 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-mako. 2024-09-12T00:32:51.518 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T00:32:51.557 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:32:51.771 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T00:32:51.798 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T00:32:51.838 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:32:51.885 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T00:32:51.913 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T00:32:51.952 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:32:52.176 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T00:32:52.203 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T00:32:52.213 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T00:32:52.229 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T00:32:52.242 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T00:32:52.263 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:32:52.537 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-idna. 2024-09-12T00:32:52.549 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-webob. 2024-09-12T00:32:52.563 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T00:32:52.576 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T00:32:52.603 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:32:52.624 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:32:52.948 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T00:32:52.975 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T00:32:53.014 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:32:53.019 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T00:32:53.035 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T00:32:53.072 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:32:53.326 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-requests. 2024-09-12T00:32:53.353 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T00:32:53.380 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T00:32:53.392 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:32:53.407 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T00:32:53.447 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:32:53.703 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T00:32:53.730 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T00:32:53.750 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-paste. 2024-09-12T00:32:53.770 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:32:53.777 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T00:32:53.817 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:32:54.190 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T00:32:54.217 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:32:54.256 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:54.628 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T00:32:54.654 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:54.694 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:54.971 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T00:32:54.972 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T00:32:54.998 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T00:32:54.999 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T00:32:55.037 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:32:55.155 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:32:55.340 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T00:32:55.367 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T00:32:55.415 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:32:55.677 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T00:32:55.694 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T00:32:55.735 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T00:32:55.996 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T00:32:56.011 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T00:32:56.046 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:32:56.175 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T00:32:56.202 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T00:32:56.241 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T00:32:56.376 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T00:32:56.403 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T00:32:56.443 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T00:32:56.561 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T00:32:56.588 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:56.627 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:56.762 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-idna. 2024-09-12T00:32:56.789 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T00:32:56.829 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:32:56.997 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T00:32:57.024 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:57.063 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:57.148 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T00:32:57.175 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T00:32:57.215 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:32:57.527 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-requests. 2024-09-12T00:32:57.554 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T00:32:57.585 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:32:57.634 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T00:32:57.661 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:57.700 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:57.888 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T00:32:57.915 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T00:32:57.954 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:32:58.375 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T00:32:58.401 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:32:58.433 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:58.778 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph. 2024-09-12T00:32:58.794 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../066-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:58.829 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T00:32:58.836 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:58.856 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:58.896 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:59.157 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T00:32:59.164 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T00:32:59.172 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T00:32:59.190 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:59.207 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:32:59.230 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:59.502 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T00:32:59.529 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T00:32:59.568 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T00:32:59.609 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T00:32:59.635 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:59.675 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:32:59.913 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T00:32:59.940 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:32:59.980 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:00.028 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package cephadm. 2024-09-12T00:33:00.055 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../069-cephadm_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:33:00.094 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:00.342 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T00:33:00.369 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:33:00.399 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:00.439 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T00:33:00.466 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T00:33:00.506 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T00:33:00.800 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T00:33:00.815 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:33:00.858 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:33:01.020 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T00:33:01.047 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:33:01.087 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:01.888 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-babel. 2024-09-12T00:33:01.916 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:33:01.954 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:33:02.215 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph. 2024-09-12T00:33:02.242 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../066-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:33:02.257 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T00:33:02.281 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:02.284 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T00:33:02.324 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:33:02.569 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T00:33:02.596 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:33:02.636 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:02.668 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T00:33:02.696 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:33:02.735 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:03.006 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T00:33:03.032 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:33:03.072 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:03.088 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T00:33:03.115 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T00:33:03.155 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T00:33:03.458 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-routes. 2024-09-12T00:33:03.483 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package cephadm. 2024-09-12T00:33:03.484 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T00:33:03.510 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../069-cephadm_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:33:03.524 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:33:03.550 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:03.828 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T00:33:03.843 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T00:33:03.860 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T00:33:03.877 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T00:33:03.887 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:33:03.927 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:04.205 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T00:33:04.221 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:33:04.263 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:33:05.285 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-babel. 2024-09-12T00:33:05.313 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:33:05.351 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:33:05.646 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T00:33:05.673 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T00:33:05.712 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:33:06.041 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T00:33:06.067 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:33:06.107 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:06.444 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T00:33:06.459 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T00:33:06.494 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T00:33:06.771 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-routes. 2024-09-12T00:33:06.798 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T00:33:06.831 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T00:33:06.838 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:33:06.849 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T00:33:06.890 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:33:07.124 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T00:33:07.151 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:33:07.182 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:07.385 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T00:33:07.412 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T00:33:07.451 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:33:07.813 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T00:33:07.841 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T00:33:07.880 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:33:08.182 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T00:33:08.210 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T00:33:08.249 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:33:08.924 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T00:33:08.940 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:33:09.068 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:09.971 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T00:33:10.000 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T00:33:10.013 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T00:33:10.033 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T00:33:10.045 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:33:10.071 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T00:33:10.357 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T00:33:10.385 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T00:33:10.424 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:33:10.507 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T00:33:10.535 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T00:33:10.574 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:33:10.727 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T00:33:10.755 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T00:33:10.793 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:33:10.961 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T00:33:10.989 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T00:33:11.027 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:33:11.063 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T00:33:11.091 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T00:33:11.121 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T00:33:11.330 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T00:33:11.358 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T00:33:11.396 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:33:11.433 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T00:33:11.461 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T00:33:11.500 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T00:33:11.820 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T00:33:11.847 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T00:33:11.888 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:33:12.096 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T00:33:12.125 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:33:12.223 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T00:33:12.240 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:12.250 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T00:33:12.289 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T00:33:12.601 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T00:33:12.628 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T00:33:12.667 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:33:13.135 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T00:33:13.163 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T00:33:13.202 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T00:33:13.314 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T00:33:13.330 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:33:13.372 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:13.513 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T00:33:13.541 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T00:33:13.579 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:33:13.692 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T00:33:13.719 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T00:33:13.758 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:33:13.908 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T00:33:13.936 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T00:33:13.974 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:33:14.061 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T00:33:14.089 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:33:14.127 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:33:14.269 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T00:33:14.297 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T00:33:14.335 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T00:33:14.397 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package jq. 2024-09-12T00:33:14.413 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:33:14.455 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T00:33:14.708 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package socat. 2024-09-12T00:33:14.736 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T00:33:14.774 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:33:14.831 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T00:33:14.859 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T00:33:14.897 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T00:33:15.078 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T00:33:15.105 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T00:33:15.144 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:33:15.226 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T00:33:15.253 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T00:33:15.292 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:33:15.498 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-test. 2024-09-12T00:33:15.514 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:33:15.556 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:15.561 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T00:33:15.578 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T00:33:15.611 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T00:33:15.890 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T00:33:15.918 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T00:33:15.956 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:33:16.553 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T00:33:16.570 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:33:16.603 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:16.889 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T00:33:16.918 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T00:33:16.948 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:33:17.259 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T00:33:17.287 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:33:17.325 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:33:17.586 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package jq. 2024-09-12T00:33:17.614 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:33:17.653 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T00:33:17.905 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package socat. 2024-09-12T00:33:17.921 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T00:33:17.963 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:33:18.177 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T00:33:18.205 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:33:18.243 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:18.250 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T00:33:18.266 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T00:33:18.308 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:33:18.531 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T00:33:18.547 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:33:18.589 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:18.663 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-test. 2024-09-12T00:33:18.691 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:33:18.729 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:18.917 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T00:33:18.945 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T00:33:18.983 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:33:19.313 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T00:33:19.341 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T00:33:19.379 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:33:19.750 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T00:33:19.778 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T00:33:19.816 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:33:20.240 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package pkg-config. 2024-09-12T00:33:20.268 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T00:33:20.306 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:33:20.568 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T00:33:20.595 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T00:33:20.634 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:33:21.045 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T00:33:21.070 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T00:33:21.112 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T00:33:21.293 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T00:33:21.319 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:33:21.350 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:21.415 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T00:33:21.431 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T00:33:21.473 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T00:33:21.645 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T00:33:21.661 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:33:21.695 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:21.801 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T00:33:21.829 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T00:33:21.867 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:33:21.989 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T00:33:22.018 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T00:33:22.056 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:33:22.145 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T00:33:22.174 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T00:33:22.203 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T00:33:22.394 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T00:33:22.422 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T00:33:22.460 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:33:22.548 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-py. 2024-09-12T00:33:22.576 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T00:33:22.614 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T00:33:22.823 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T00:33:22.851 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T00:33:22.889 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:33:22.934 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T00:33:22.963 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T00:33:22.992 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:33:23.261 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package pkg-config. 2024-09-12T00:33:23.289 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T00:33:23.319 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:33:23.404 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T00:33:23.421 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T00:33:23.474 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:33:23.572 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T00:33:23.600 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T00:33:23.638 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:33:23.782 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-toml. 2024-09-12T00:33:23.810 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T00:33:23.848 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T00:33:24.025 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T00:33:24.053 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T00:33:24.091 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T00:33:24.152 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T00:33:24.180 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T00:33:24.218 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:33:24.403 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T00:33:24.431 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T00:33:24.469 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T00:33:24.571 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T00:33:24.599 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T00:33:24.637 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:33:24.747 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T00:33:24.763 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T00:33:24.797 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:33:24.907 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T00:33:24.923 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T00:33:24.965 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:33:25.100 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T00:33:25.128 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T00:33:25.167 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T00:33:25.503 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-py. 2024-09-12T00:33:25.531 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T00:33:25.569 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T00:33:25.686 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package radosgw. 2024-09-12T00:33:25.714 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../116-radosgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:33:25.752 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:25.889 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T00:33:25.917 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T00:33:25.956 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:33:26.376 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T00:33:26.405 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T00:33:26.443 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:33:26.630 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T00:33:26.658 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:33:26.696 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:26.729 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-toml. 2024-09-12T00:33:26.757 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T00:33:26.795 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T00:33:26.992 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T00:33:27.098 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T00:33:27.114 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T00:33:27.156 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:33:27.251 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:33:27.402 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:33:27.493 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T00:33:27.521 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T00:33:27.560 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:33:27.656 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T00:33:27.854 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T00:33:27.883 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T00:33:27.945 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:33:27.970 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T00:33:28.432 INFO:teuthology.orchestra.run.smithi070.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T00:33:28.503 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:28.660 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package radosgw. 2024-09-12T00:33:28.686 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../116-radosgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:33:28.724 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:29.070 INFO:teuthology.orchestra.run.smithi070.stdout:Adding system user cephadm....done 2024-09-12T00:33:29.218 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:33:29.502 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:33:29.627 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T00:33:29.644 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:33:29.686 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:29.754 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:33:29.871 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:33:29.972 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T00:33:30.139 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T00:33:30.207 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:33:30.333 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:33:30.382 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:33:30.508 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T00:33:30.589 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T00:33:30.818 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:33:30.963 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T00:33:31.169 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T00:33:31.412 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T00:33:31.427 INFO:teuthology.orchestra.run.smithi187.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T00:33:31.493 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:31.680 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:33:31.993 INFO:teuthology.orchestra.run.smithi187.stdout:Adding system user cephadm....done 2024-09-12T00:33:32.149 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:33:32.215 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:33:32.417 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:33:32.466 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:33:32.660 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:33:32.725 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:33:32.769 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:33:32.977 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:33.029 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T00:33:33.252 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:33:33.288 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:33:33.378 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:33:33.414 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T00:33:33.504 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:33:33.622 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:33:33.716 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:33:33.873 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:33:34.076 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T00:33:34.332 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T00:33:34.344 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T00:33:34.363 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T00:33:34.426 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:33:34.543 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T00:33:34.629 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:33:34.920 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:33:34.922 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:33:35.054 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T00:33:35.322 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:33:35.356 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:33:35.581 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:33:35.615 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:33:35.875 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:35.882 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T00:33:36.008 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:33:36.134 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:33:36.235 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:33:36.344 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:33:36.470 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:33:36.660 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:33:36.721 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:33:36.919 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:33:37.045 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:33:37.134 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T00:33:37.169 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T00:33:37.180 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:33:37.224 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:33:37.350 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T00:33:37.489 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T00:33:37.727 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:33:37.865 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T00:33:37.869 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T00:33:38.116 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:33:38.137 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:33:38.405 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:33:38.509 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:33:38.714 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T00:33:38.785 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:33:38.840 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:33:39.153 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:33:39.404 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:33:39.508 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:33:39.514 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:39.768 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:33:39.798 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:33:39.886 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:33:40.012 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:33:40.213 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:33:40.321 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T00:33:40.689 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T00:33:40.941 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:33:41.325 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:33:41.413 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:33:41.601 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:33:41.673 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:33:41.807 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T00:33:41.970 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:33:42.075 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:33:42.192 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:33:42.229 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:33:42.310 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:33:42.338 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:42.586 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:33:42.623 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:33:42.863 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T00:33:42.949 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:33:43.130 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:33:43.256 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:33:43.566 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:33:43.817 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T00:33:44.068 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T00:33:44.121 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:33:44.335 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:33:44.381 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:33:44.532 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T00:33:44.595 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T00:33:44.799 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:33:44.871 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:33:44.926 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:33:44.997 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T00:33:45.052 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:33:45.289 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:33:45.345 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:33:45.415 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:33:45.604 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T00:33:45.725 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:33:45.838 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:33:45.965 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:33:46.009 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:33:46.243 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:33:46.266 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:33:46.369 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:33:46.508 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T00:33:46.529 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:33:46.619 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T00:33:46.778 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T00:33:46.855 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:33:46.981 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:33:47.029 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:33:47.280 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T00:33:47.391 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:33:47.539 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:33:47.659 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T00:33:47.665 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T00:33:47.785 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T00:33:47.942 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:33:48.036 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:33:48.068 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:33:48.162 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:33:48.361 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:33:48.479 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:33:48.654 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:33:48.780 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:33:48.913 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:33:49.022 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:33:49.065 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T00:33:49.148 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:33:49.191 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T00:33:49.237 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T00:33:49.450 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T00:33:49.483 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:33:49.584 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:33:49.734 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:33:49.960 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:33:50.071 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:33:50.237 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T00:33:50.363 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T00:33:50.456 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T00:33:50.749 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:33:50.835 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:33:50.964 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:33:51.093 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:33:51.219 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:51.291 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:33:51.354 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:51.479 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:33:51.608 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:33:51.807 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:51.876 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T00:33:51.916 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:52.002 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T00:33:52.034 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T00:33:52.278 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T00:33:52.310 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:52.437 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:52.546 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:33:52.563 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:52.784 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:33:52.785 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:33:52.899 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:33:53.259 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T00:33:53.305 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:53.432 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:53.557 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:53.560 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:33:53.675 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:33:53.879 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:33:54.014 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:54.140 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:54.249 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:33:54.569 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:54.695 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:54.838 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T00:33:54.864 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:54.988 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:55.114 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:55.114 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:55.240 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:55.240 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:55.357 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:55.366 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:55.579 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:33:55.579 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:33:55.909 INFO:teuthology.orchestra.run.smithi070.stdout:Adding group ceph....done 2024-09-12T00:33:56.118 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:56.235 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:56.251 INFO:teuthology.orchestra.run.smithi070.stdout:Adding system user ceph....done 2024-09-12T00:33:56.361 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:56.411 INFO:teuthology.orchestra.run.smithi070.stdout:Setting system user ceph properties....done 2024-09-12T00:33:56.429 INFO:teuthology.orchestra.run.smithi070.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T00:33:56.488 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:33:56.564 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T00:33:56.861 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T00:33:57.384 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:57.611 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:57.724 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:57.850 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:57.951 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:58.077 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:58.203 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:58.229 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:33:58.229 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:33:58.678 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:58.746 INFO:teuthology.orchestra.run.smithi187.stdout:Adding group ceph....done 2024-09-12T00:33:59.028 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T00:33:59.106 INFO:teuthology.orchestra.run.smithi187.stdout:Adding system user ceph....done 2024-09-12T00:33:59.266 INFO:teuthology.orchestra.run.smithi187.stdout:Setting system user ceph properties....done 2024-09-12T00:33:59.281 INFO:teuthology.orchestra.run.smithi187.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T00:33:59.418 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T00:33:59.538 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:33:59.722 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T00:33:59.772 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:33:59.772 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:34:00.213 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:34:00.273 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:34:00.338 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:34:00.492 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:34:00.492 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:34:00.814 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:34:00.814 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:34:00.991 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:34:01.244 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:34:01.244 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:34:01.315 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:34:01.639 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T00:34:01.759 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:34:01.910 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:34:02.061 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:34:02.092 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:34:02.270 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:34:02.271 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:34:02.311 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:34:02.311 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:34:02.779 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:34:02.785 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:34:02.996 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:34:02.996 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:34:03.214 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:34:03.373 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:34:03.503 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:34:03.516 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:34:03.806 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:34:03.807 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:34:03.852 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T00:34:03.970 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T00:34:04.114 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:34:04.434 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:34:04.557 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:34:04.683 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:34:04.863 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T00:34:04.880 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:34:04.880 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:34:05.376 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:34:05.519 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:34:05.528 INFO:teuthology.orchestra.run.smithi070.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:34:05.532 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-12T00:34:05.588 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-12T00:34:05.645 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:34:05.796 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:34:05.797 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2024-09-12T00:34:05.798 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2024-09-12T00:34:05.987 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:34:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:34:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:34:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:34:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:34:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:34:05.989 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:34:05.990 INFO:teuthology.orchestra.run.smithi070.stdout:The following additional packages will be installed: 2024-09-12T00:34:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T00:34:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T00:34:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T00:34:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T00:34:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T00:34:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T00:34:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T00:34:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T00:34:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T00:34:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T00:34:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-12T00:34:05.991 INFO:teuthology.orchestra.run.smithi070.stdout:Suggested packages: 2024-09-12T00:34:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-12T00:34:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-12T00:34:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-12T00:34:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-12T00:34:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-12T00:34:06.029 INFO:teuthology.orchestra.run.smithi070.stdout:The following NEW packages will be installed: 2024-09-12T00:34:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T00:34:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T00:34:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T00:34:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T00:34:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T00:34:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T00:34:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T00:34:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T00:34:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T00:34:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T00:34:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-12T00:34:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: s3cmd 2024-09-12T00:34:06.148 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T00:34:06.211 INFO:teuthology.orchestra.run.smithi070.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:34:06.211 INFO:teuthology.orchestra.run.smithi070.stdout:Need to get 10.4 MB of archives. 2024-09-12T00:34:06.211 INFO:teuthology.orchestra.run.smithi070.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-12T00:34:06.211 INFO:teuthology.orchestra.run.smithi070.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-12T00:34:06.293 INFO:teuthology.orchestra.run.smithi070.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-12T00:34:06.293 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-12T00:34:06.310 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-12T00:34:06.377 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T00:34:06.473 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-12T00:34:06.544 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-12T00:34:06.552 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-12T00:34:06.563 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:34:06.686 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-12T00:34:06.782 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-12T00:34:06.783 INFO:teuthology.orchestra.run.smithi070.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-12T00:34:06.786 INFO:teuthology.orchestra.run.smithi070.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-12T00:34:06.932 INFO:teuthology.orchestra.run.smithi070.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-12T00:34:06.933 INFO:teuthology.orchestra.run.smithi070.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-12T00:34:06.972 INFO:teuthology.orchestra.run.smithi070.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-12T00:34:06.973 INFO:teuthology.orchestra.run.smithi070.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-12T00:34:06.974 INFO:teuthology.orchestra.run.smithi070.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-12T00:34:06.976 INFO:teuthology.orchestra.run.smithi070.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-12T00:34:06.976 INFO:teuthology.orchestra.run.smithi070.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-12T00:34:06.982 INFO:teuthology.orchestra.run.smithi070.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-12T00:34:06.983 INFO:teuthology.orchestra.run.smithi070.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-12T00:34:07.027 INFO:teuthology.orchestra.run.smithi070.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-12T00:34:07.030 INFO:teuthology.orchestra.run.smithi070.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-12T00:34:07.082 INFO:teuthology.orchestra.run.smithi070.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-12T00:34:07.083 INFO:teuthology.orchestra.run.smithi070.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-12T00:34:07.084 INFO:teuthology.orchestra.run.smithi070.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-12T00:34:07.086 INFO:teuthology.orchestra.run.smithi070.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-12T00:34:07.087 INFO:teuthology.orchestra.run.smithi070.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-12T00:34:07.109 INFO:teuthology.orchestra.run.smithi070.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-12T00:34:07.117 INFO:teuthology.orchestra.run.smithi070.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-12T00:34:07.121 INFO:teuthology.orchestra.run.smithi070.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-12T00:34:07.190 INFO:teuthology.orchestra.run.smithi070.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-12T00:34:07.191 INFO:teuthology.orchestra.run.smithi070.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-12T00:34:07.222 INFO:teuthology.orchestra.run.smithi070.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-12T00:34:07.222 INFO:teuthology.orchestra.run.smithi070.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-12T00:34:07.223 INFO:teuthology.orchestra.run.smithi070.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-12T00:34:07.668 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 10.4 MB in 1s (8,737 kB/s) 2024-09-12T00:34:07.680 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T00:34:07.751 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-12T00:34:07.834 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-09-12T00:34:07.839 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-12T00:34:07.883 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-12T00:34:08.144 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-12T00:34:08.173 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-12T00:34:08.210 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T00:34:08.343 INFO:teuthology.orchestra.run.smithi187.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:34:08.346 DEBUG:teuthology.orchestra.run.smithi187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-12T00:34:08.402 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-09-12T00:34:08.547 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-12T00:34:08.563 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-12T00:34:08.605 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T00:34:08.612 INFO:teuthology.orchestra.run.smithi187.stdout:Building dependency tree... 2024-09-12T00:34:08.613 INFO:teuthology.orchestra.run.smithi187.stdout:Reading state information... 2024-09-12T00:34:08.813 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:34:08.814 INFO:teuthology.orchestra.run.smithi187.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:34:08.814 INFO:teuthology.orchestra.run.smithi187.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:34:08.814 INFO:teuthology.orchestra.run.smithi187.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:34:08.814 INFO:teuthology.orchestra.run.smithi187.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:34:08.814 INFO:teuthology.orchestra.run.smithi187.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:34:08.815 INFO:teuthology.orchestra.run.smithi187.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:34:08.816 INFO:teuthology.orchestra.run.smithi187.stdout:The following additional packages will be installed: 2024-09-12T00:34:08.816 INFO:teuthology.orchestra.run.smithi187.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T00:34:08.816 INFO:teuthology.orchestra.run.smithi187.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T00:34:08.816 INFO:teuthology.orchestra.run.smithi187.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T00:34:08.816 INFO:teuthology.orchestra.run.smithi187.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T00:34:08.817 INFO:teuthology.orchestra.run.smithi187.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T00:34:08.817 INFO:teuthology.orchestra.run.smithi187.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T00:34:08.817 INFO:teuthology.orchestra.run.smithi187.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T00:34:08.817 INFO:teuthology.orchestra.run.smithi187.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T00:34:08.817 INFO:teuthology.orchestra.run.smithi187.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T00:34:08.817 INFO:teuthology.orchestra.run.smithi187.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T00:34:08.817 INFO:teuthology.orchestra.run.smithi187.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-12T00:34:08.818 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-12T00:34:08.818 INFO:teuthology.orchestra.run.smithi187.stdout:Suggested packages: 2024-09-12T00:34:08.818 INFO:teuthology.orchestra.run.smithi187.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-12T00:34:08.818 INFO:teuthology.orchestra.run.smithi187.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-12T00:34:08.818 INFO:teuthology.orchestra.run.smithi187.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-12T00:34:08.818 INFO:teuthology.orchestra.run.smithi187.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-12T00:34:08.818 INFO:teuthology.orchestra.run.smithi187.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-12T00:34:08.832 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-12T00:34:08.857 INFO:teuthology.orchestra.run.smithi187.stdout:The following NEW packages will be installed: 2024-09-12T00:34:08.857 INFO:teuthology.orchestra.run.smithi187.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T00:34:08.857 INFO:teuthology.orchestra.run.smithi187.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T00:34:08.857 INFO:teuthology.orchestra.run.smithi187.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T00:34:08.857 INFO:teuthology.orchestra.run.smithi187.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T00:34:08.857 INFO:teuthology.orchestra.run.smithi187.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T00:34:08.858 INFO:teuthology.orchestra.run.smithi187.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T00:34:08.858 INFO:teuthology.orchestra.run.smithi187.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T00:34:08.858 INFO:teuthology.orchestra.run.smithi187.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T00:34:08.858 INFO:teuthology.orchestra.run.smithi187.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T00:34:08.858 INFO:teuthology.orchestra.run.smithi187.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T00:34:08.858 INFO:teuthology.orchestra.run.smithi187.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-12T00:34:08.858 INFO:teuthology.orchestra.run.smithi187.stdout: s3cmd 2024-09-12T00:34:08.866 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-12T00:34:09.039 INFO:teuthology.orchestra.run.smithi187.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:34:09.039 INFO:teuthology.orchestra.run.smithi187.stdout:Need to get 10.4 MB of archives. 2024-09-12T00:34:09.039 INFO:teuthology.orchestra.run.smithi187.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-12T00:34:09.039 INFO:teuthology.orchestra.run.smithi187.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-12T00:34:09.121 INFO:teuthology.orchestra.run.smithi187.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-12T00:34:09.122 INFO:teuthology.orchestra.run.smithi187.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-12T00:34:09.127 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-12T00:34:09.138 INFO:teuthology.orchestra.run.smithi187.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-12T00:34:09.143 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-12T00:34:09.185 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-12T00:34:09.302 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-12T00:34:09.373 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-12T00:34:09.380 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-12T00:34:09.438 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-12T00:34:09.466 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-12T00:34:09.504 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-12T00:34:09.515 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-12T00:34:09.608 INFO:teuthology.orchestra.run.smithi187.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-12T00:34:09.608 INFO:teuthology.orchestra.run.smithi187.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-12T00:34:09.612 INFO:teuthology.orchestra.run.smithi187.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-12T00:34:09.757 INFO:teuthology.orchestra.run.smithi187.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-12T00:34:09.757 INFO:teuthology.orchestra.run.smithi187.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-12T00:34:09.781 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-12T00:34:09.799 INFO:teuthology.orchestra.run.smithi187.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-12T00:34:09.800 INFO:teuthology.orchestra.run.smithi187.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-12T00:34:09.801 INFO:teuthology.orchestra.run.smithi187.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-12T00:34:09.803 INFO:teuthology.orchestra.run.smithi187.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-12T00:34:09.804 INFO:teuthology.orchestra.run.smithi187.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-12T00:34:09.809 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-12T00:34:09.810 INFO:teuthology.orchestra.run.smithi187.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-12T00:34:09.811 INFO:teuthology.orchestra.run.smithi187.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-12T00:34:09.848 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-12T00:34:09.853 INFO:teuthology.orchestra.run.smithi187.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-12T00:34:09.857 INFO:teuthology.orchestra.run.smithi187.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-12T00:34:09.906 INFO:teuthology.orchestra.run.smithi187.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-12T00:34:09.907 INFO:teuthology.orchestra.run.smithi187.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-12T00:34:09.908 INFO:teuthology.orchestra.run.smithi187.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-12T00:34:09.911 INFO:teuthology.orchestra.run.smithi187.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-12T00:34:09.911 INFO:teuthology.orchestra.run.smithi187.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-12T00:34:09.935 INFO:teuthology.orchestra.run.smithi187.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-12T00:34:09.944 INFO:teuthology.orchestra.run.smithi187.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-12T00:34:09.949 INFO:teuthology.orchestra.run.smithi187.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-12T00:34:10.016 INFO:teuthology.orchestra.run.smithi187.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-12T00:34:10.017 INFO:teuthology.orchestra.run.smithi187.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-12T00:34:10.050 INFO:teuthology.orchestra.run.smithi187.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-12T00:34:10.050 INFO:teuthology.orchestra.run.smithi187.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-12T00:34:10.051 INFO:teuthology.orchestra.run.smithi187.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-12T00:34:10.083 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-12T00:34:10.100 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-12T00:34:10.133 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-12T00:34:10.428 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-12T00:34:10.444 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-12T00:34:10.486 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T00:34:10.496 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 10.4 MB in 1s (8,737 kB/s) 2024-09-12T00:34:10.584 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-12T00:34:10.643 INFO:teuthology.orchestra.run.smithi187.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-09-12T00:34:10.648 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-12T00:34:10.700 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-12T00:34:10.738 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libjsr305-java. 2024-09-12T00:34:10.755 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-12T00:34:10.797 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-12T00:34:10.936 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-12T00:34:10.953 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-12T00:34:10.994 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T00:34:11.049 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libguava-java. 2024-09-12T00:34:11.066 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-12T00:34:11.107 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-12T00:34:11.264 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-12T00:34:11.292 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-12T00:34:11.386 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T00:34:11.526 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-12T00:34:11.543 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-12T00:34:11.576 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-12T00:34:11.823 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libguice-java. 2024-09-12T00:34:11.839 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-12T00:34:11.881 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-12T00:34:12.252 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-12T00:34:12.280 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-12T00:34:12.318 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-12T00:34:12.371 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-12T00:34:12.401 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-12T00:34:12.438 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-12T00:34:12.571 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-12T00:34:12.587 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-12T00:34:12.621 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-12T00:34:12.690 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-12T00:34:12.707 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-12T00:34:12.748 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-12T00:34:12.874 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libjansi-java. 2024-09-12T00:34:12.890 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-12T00:34:12.932 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-12T00:34:12.976 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-12T00:34:12.992 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-12T00:34:13.034 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-12T00:34:13.185 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-12T00:34:13.201 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-12T00:34:13.243 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-12T00:34:13.295 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-12T00:34:13.324 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-12T00:34:13.362 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-12T00:34:13.614 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-12T00:34:13.614 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-12T00:34:13.630 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-12T00:34:13.642 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-12T00:34:13.664 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-12T00:34:13.672 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-12T00:34:13.950 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-12T00:34:13.958 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-12T00:34:13.966 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-12T00:34:13.975 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-12T00:34:14.008 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T00:34:14.016 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T00:34:14.261 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-12T00:34:14.269 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libjsr305-java. 2024-09-12T00:34:14.277 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-12T00:34:14.286 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-12T00:34:14.319 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T00:34:14.327 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-12T00:34:14.605 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libguava-java. 2024-09-12T00:34:14.622 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-12T00:34:14.623 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-12T00:34:14.652 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-12T00:34:14.663 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-12T00:34:14.690 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T00:34:14.909 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-12T00:34:14.926 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-12T00:34:14.967 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-12T00:34:15.082 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-12T00:34:15.099 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-12T00:34:15.132 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-12T00:34:15.220 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-12T00:34:15.248 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-12T00:34:15.287 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T00:34:15.385 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libguice-java. 2024-09-12T00:34:15.401 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-12T00:34:15.443 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-12T00:34:15.540 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-12T00:34:15.568 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-12T00:34:15.606 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T00:34:15.814 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-12T00:34:15.842 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-12T00:34:15.843 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-12T00:34:15.858 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-12T00:34:15.880 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-12T00:34:15.892 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-12T00:34:16.133 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-12T00:34:16.149 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-12T00:34:16.153 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-12T00:34:16.181 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-12T00:34:16.191 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-12T00:34:16.219 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T00:34:16.401 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libjansi-java. 2024-09-12T00:34:16.419 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-12T00:34:16.469 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-12T00:34:16.480 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libslf4j-java. 2024-09-12T00:34:16.497 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-12T00:34:16.539 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-12T00:34:16.729 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-12T00:34:16.745 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-12T00:34:16.788 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-12T00:34:16.793 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-12T00:34:16.809 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-12T00:34:16.851 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-12T00:34:17.023 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-12T00:34:17.039 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-12T00:34:17.081 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-12T00:34:17.095 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-12T00:34:17.112 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-12T00:34:17.154 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-12T00:34:17.342 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-12T00:34:17.358 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-12T00:34:17.392 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T00:34:17.449 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-12T00:34:17.477 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-12T00:34:17.515 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-12T00:34:17.637 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-12T00:34:17.665 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-12T00:34:17.703 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T00:34:17.895 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-12T00:34:17.923 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-12T00:34:17.961 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-12T00:34:17.990 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-12T00:34:18.006 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-12T00:34:18.049 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T00:34:18.230 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-12T00:34:18.247 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-12T00:34:18.288 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T00:34:18.309 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-12T00:34:18.326 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-12T00:34:18.367 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-12T00:34:18.587 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-12T00:34:18.615 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-12T00:34:18.645 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T00:34:18.784 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package maven. 2024-09-12T00:34:18.812 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-12T00:34:18.850 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking maven (3.6.3-5) ... 2024-09-12T00:34:18.897 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-12T00:34:18.914 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-12T00:34:18.956 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T00:34:19.170 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-magic. 2024-09-12T00:34:19.201 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-12T00:34:19.208 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-12T00:34:19.237 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-12T00:34:19.237 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-12T00:34:19.275 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-12T00:34:19.528 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-12T00:34:19.540 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package s3cmd. 2024-09-12T00:34:19.556 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-12T00:34:19.568 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-12T00:34:19.594 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T00:34:19.606 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-12T00:34:19.813 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libslf4j-java. 2024-09-12T00:34:19.830 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-12T00:34:19.872 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-12T00:34:19.978 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-12T00:34:20.103 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-12T00:34:20.150 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-12T00:34:20.167 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-12T00:34:20.208 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-12T00:34:20.321 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T00:34:20.494 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-12T00:34:20.498 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-12T00:34:20.511 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-12T00:34:20.544 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-12T00:34:20.599 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-12T00:34:20.725 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-12T00:34:20.806 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-12T00:34:20.834 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-12T00:34:20.851 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T00:34:20.872 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-12T00:34:20.977 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-12T00:34:21.119 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T00:34:21.245 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T00:34:21.268 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-12T00:34:21.296 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-12T00:34:21.334 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-12T00:34:21.380 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-12T00:34:21.506 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T00:34:21.578 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-12T00:34:21.595 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-12T00:34:21.615 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-12T00:34:21.628 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T00:34:21.733 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T00:34:21.859 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T00:34:21.985 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-12T00:34:22.101 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package maven. 2024-09-12T00:34:22.126 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-12T00:34:22.164 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking maven (3.6.3-5) ... 2024-09-12T00:34:22.236 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-12T00:34:22.362 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-12T00:34:22.484 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-magic. 2024-09-12T00:34:22.488 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T00:34:22.513 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-12T00:34:22.551 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-12T00:34:22.614 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-12T00:34:22.741 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-12T00:34:22.837 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package s3cmd. 2024-09-12T00:34:22.853 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-12T00:34:22.858 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-12T00:34:22.895 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-12T00:34:22.959 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-12T00:34:23.237 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-12T00:34:23.241 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-12T00:34:23.361 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T00:34:23.367 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-12T00:34:23.484 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T00:34:23.488 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libguava-java (29.0-6) ... 2024-09-12T00:34:23.586 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-12T00:34:23.622 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-12T00:34:23.687 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-12T00:34:23.740 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-12T00:34:23.796 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-12T00:34:23.849 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-12T00:34:23.922 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T00:34:24.035 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-12T00:34:24.048 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-12T00:34:24.161 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-12T00:34:24.174 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T00:34:24.287 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-12T00:34:24.300 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T00:34:24.421 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T00:34:24.443 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-12T00:34:24.544 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T00:34:24.547 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-12T00:34:24.645 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-12T00:34:24.673 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up maven (3.6.3-5) ... 2024-09-12T00:34:24.746 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T00:34:24.872 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T00:34:24.939 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-12T00:34:24.998 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-12T00:34:25.011 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:34:25.257 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-12T00:34:25.383 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-12T00:34:25.509 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T00:34:25.635 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-12T00:34:25.745 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-12T00:34:25.854 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-12T00:34:25.980 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-12T00:34:26.281 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-12T00:34:26.383 INFO:teuthology.orchestra.run.smithi070.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:34:26.390 DEBUG:teuthology.parallel:result is None 2024-09-12T00:34:26.407 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T00:34:26.559 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libguava-java (29.0-6) ... 2024-09-12T00:34:26.685 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-12T00:34:26.794 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-12T00:34:26.895 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-12T00:34:26.996 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-12T00:34:27.122 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-12T00:34:27.248 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-12T00:34:27.374 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T00:34:27.500 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-12T00:34:27.626 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up maven (3.6.3-5) ... 2024-09-12T00:34:27.868 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-12T00:34:27.931 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:34:29.263 INFO:teuthology.orchestra.run.smithi187.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:34:29.268 DEBUG:teuthology.parallel:result is None 2024-09-12T00:34:29.269 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:34:29.429 DEBUG:teuthology.orchestra.run.smithi070:> dpkg-query -W -f '${Version}' ceph 2024-09-12T00:34:29.449 INFO:teuthology.orchestra.run.smithi070.stdout:19.3.0-4753-gd011c522-1jammy 2024-09-12T00:34:29.450 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:34:29.450 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753-gd011c522-1jammy is installed. 2024-09-12T00:34:29.453 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:34:29.614 DEBUG:teuthology.orchestra.run.smithi187:> dpkg-query -W -f '${Version}' ceph 2024-09-12T00:34:29.632 INFO:teuthology.orchestra.run.smithi187.stdout:19.3.0-4753-gd011c522-1jammy 2024-09-12T00:34:29.632 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:34:29.632 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753-gd011c522-1jammy is installed. 2024-09-12T00:34:29.634 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T00:34:29.634 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:34:29.634 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:34:29.649 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T00:34:29.649 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:34:29.687 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T00:34:29.687 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:34:29.687 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:34:29.706 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:34:29.760 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T00:34:29.760 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:34:29.773 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:34:29.827 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T00:34:29.827 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:34:29.828 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:34:29.840 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:34:29.892 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T00:34:29.892 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:34:29.906 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:34:29.959 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T00:34:29.959 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:34:29.959 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:34:29.971 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:34:30.025 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T00:34:30.025 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:34:30.039 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:34:30.094 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T00:34:30.183 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T00:34:30.183 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 777 /var/log/ceph 2024-09-12T00:34:30.186 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 777 /var/log/ceph 2024-09-12T00:34:30.199 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T00:34:30.199 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:34:30.239 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:34:30.255 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T00:34:30.255 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:34:30.295 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:34:30.320 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T00:34:30.321 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T00:34:30.321 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901873', 'branch': 'wip-cls-rgw-busy-resharding', 'description': 'rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}', 'email': None, 'first_in_suite': False, 'job_id': '7901873', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-cls-rgw-busy-resharding'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0'}, 'compression type': 'random', 'datacache': True, 'datacache_path': '/tmp/rgw_datacache', 'ec-data-pool': False, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-67986', 'sha1': '6a169fc940965ab446a63954fde870aa497efde7'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 2206, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-67986', 'suite_path': '/home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/cbodley/ceph.git', 'suite_sha1': '6a169fc940965ab446a63954fde870aa497efde7', 'targets': {'smithi070.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBasj4l2Q5nC44yDiQ/e2pQhqMqPvlKlD1bYTA+BkhT5dzCsJtS1KXpo2GDZHFucmrj5EYVbkUkmnY4JmReKd7Q=', 'smithi187.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHvY5znKG735ONA5lXPDVs/f5eUYk0nF68piIBwSjjBl6Hwlg8ki4RX5jjJOZ3hqXSorcRTnxRgUIvsZA0DoQIo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-datacache.sh']}, 'env': {'RGW_DATACACHE_PATH': '/tmp/rgw_datacache'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'force-branch': 'wip-67986', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_23:33:24', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T00:34:30.321 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:34:30.351 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:34:30.360 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:34:30.399 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:34:30.416 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:34:30.416 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:34:30.458 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:34:30.458 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_1 2024-09-12T00:34:30.506 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:34:30.506 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:34:30.506 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 874 Links: 1 2024-09-12T00:34:30.506 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:34:30.506 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-12 00:28:38.953252285 +0000 2024-09-12T00:34:30.506 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-12 00:28:38.705254488 +0000 2024-09-12T00:34:30.506 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-12 00:28:38.705254488 +0000 2024-09-12T00:34:30.507 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-09-12T00:34:30.507 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:34:30.560 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-12T00:34:30.560 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-12T00:34:30.560 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000208098 s, 2.5 MB/s 2024-09-12T00:34:30.561 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:34:30.611 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_2 2024-09-12T00:34:30.658 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:34:30.658 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:34:30.658 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-09-12T00:34:30.658 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:34:30.658 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-12 00:28:39.401248304 +0000 2024-09-12T00:34:30.659 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-12 00:28:39.161250437 +0000 2024-09-12T00:34:30.659 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-12 00:28:39.161250437 +0000 2024-09-12T00:34:30.659 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-09-12T00:34:30.659 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:34:30.711 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-12T00:34:30.712 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-12T00:34:30.712 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000208507 s, 2.5 MB/s 2024-09-12T00:34:30.713 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:34:30.759 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_3 2024-09-12T00:34:30.806 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:34:30.806 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:34:30.806 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 909 Links: 1 2024-09-12T00:34:30.806 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:34:30.806 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-12 00:28:39.881244040 +0000 2024-09-12T00:34:30.806 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-12 00:28:39.637246209 +0000 2024-09-12T00:34:30.806 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-12 00:28:39.637246209 +0000 2024-09-12T00:34:30.806 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-09-12T00:34:30.807 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:34:30.859 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-12T00:34:30.860 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-12T00:34:30.860 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000206193 s, 2.5 MB/s 2024-09-12T00:34:30.861 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:34:30.911 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_4 2024-09-12T00:34:30.958 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:34:30.958 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:34:30.958 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 925 Links: 1 2024-09-12T00:34:30.958 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:34:30.958 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-12 00:28:40.361239777 +0000 2024-09-12T00:34:30.958 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-12 00:28:40.105242050 +0000 2024-09-12T00:34:30.958 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-12 00:28:40.105242050 +0000 2024-09-12T00:34:30.958 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-09-12T00:34:30.959 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:34:31.011 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-12T00:34:31.011 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-12T00:34:31.011 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.00020478 s, 2.5 MB/s 2024-09-12T00:34:31.013 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:34:31.059 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:34:31.059 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T00:34:31.059 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:34:31.065 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:34:31.065 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_1 2024-09-12T00:34:31.112 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:34:31.112 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:34:31.112 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 881 Links: 1 2024-09-12T00:34:31.113 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:34:31.113 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-09-12 00:28:35.665603779 +0000 2024-09-12T00:34:31.113 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-09-12 00:28:35.405606101 +0000 2024-09-12T00:34:31.113 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-09-12 00:28:35.405606101 +0000 2024-09-12T00:34:31.113 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2024-09-12T00:34:31.113 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:34:31.166 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-09-12T00:34:31.166 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-09-12T00:34:31.166 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000373653 s, 1.4 MB/s 2024-09-12T00:34:31.168 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:34:31.221 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_2 2024-09-12T00:34:31.268 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:34:31.268 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:34:31.268 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 898 Links: 1 2024-09-12T00:34:31.268 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:34:31.268 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-09-12 00:28:36.181599170 +0000 2024-09-12T00:34:31.269 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-09-12 00:28:35.913601564 +0000 2024-09-12T00:34:31.269 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-09-12 00:28:35.913601564 +0000 2024-09-12T00:34:31.269 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2024-09-12T00:34:31.269 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:34:31.321 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-09-12T00:34:31.322 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-09-12T00:34:31.322 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000363712 s, 1.4 MB/s 2024-09-12T00:34:31.323 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:34:31.373 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_3 2024-09-12T00:34:31.419 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:34:31.420 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:34:31.420 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 913 Links: 1 2024-09-12T00:34:31.420 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:34:31.420 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-09-12 00:28:36.685594668 +0000 2024-09-12T00:34:31.420 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-09-12 00:28:36.429596954 +0000 2024-09-12T00:34:31.420 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-09-12 00:28:36.429596954 +0000 2024-09-12T00:34:31.420 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2024-09-12T00:34:31.420 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:34:31.473 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-09-12T00:34:31.474 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-09-12T00:34:31.474 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000415007 s, 1.2 MB/s 2024-09-12T00:34:31.475 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:34:31.525 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_4 2024-09-12T00:34:31.571 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:34:31.571 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:34:31.572 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 930 Links: 1 2024-09-12T00:34:31.572 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:34:31.572 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-09-12 00:28:37.209589988 +0000 2024-09-12T00:34:31.572 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-09-12 00:28:36.937592417 +0000 2024-09-12T00:34:31.572 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-09-12 00:28:36.937592417 +0000 2024-09-12T00:34:31.572 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2024-09-12T00:34:31.572 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:34:31.625 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-09-12T00:34:31.625 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-09-12T00:34:31.625 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.00030121 s, 1.7 MB/s 2024-09-12T00:34:31.626 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:34:31.673 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:34:31.673 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi187.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:34:31.673 INFO:tasks.ceph:Generating config... 2024-09-12T00:34:31.675 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T00:34:31.675 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-12T00:34:31.675 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-12T00:34:31.675 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-12T00:34:31.675 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-12T00:34:31.675 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:34:31.675 INFO:tasks.ceph:[client] rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T00:34:31.675 INFO:tasks.ceph:[client] rgw d3n l1 datacache size = 10737418240 2024-09-12T00:34:31.675 INFO:tasks.ceph:[client] rgw d3n l1 local datacache enabled = True 2024-09-12T00:34:31.675 INFO:tasks.ceph:[client] rgw enable ops log = True 2024-09-12T00:34:31.675 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2024-09-12T00:34:31.675 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2024-09-12T00:34:31.676 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-12T00:34:31.676 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-12T00:34:31.676 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-12T00:34:31.676 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-12T00:34:31.676 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-12T00:34:31.676 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T00:34:31.676 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T00:34:31.676 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-12T00:34:31.676 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-12T00:34:31.677 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-12T00:34:31.677 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-12T00:34:31.677 INFO:tasks.ceph:[global] rgw override bucket index max shards = 1 2024-09-12T00:34:31.677 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T00:34:31.677 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T00:34:31.677 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T00:34:31.677 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T00:34:31.677 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T00:34:31.677 INFO:tasks.ceph:[mon] lockdep = True 2024-09-12T00:34:31.677 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T00:34:31.677 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T00:34:31.677 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T00:34:31.677 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T00:34:31.677 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T00:34:31.678 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T00:34:31.678 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T00:34:31.678 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T00:34:31.678 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T00:34:31.678 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T00:34:31.678 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T00:34:31.678 INFO:tasks.ceph:[osd] lockdep = True 2024-09-12T00:34:31.678 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T00:34:31.678 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T00:34:31.678 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T00:34:31.678 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T00:34:31.678 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T00:34:31.678 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T00:34:31.679 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T00:34:31.679 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T00:34:31.713 INFO:teuthology.orchestra.run.smithi070.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T00:34:31.723 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T00:34:31.798 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:34:31.852 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.70'), ('mon.c', '[v2:172.21.15.70:3301,v1:172.21.15.70:6790]'), ('mon.b', '172.21.15.187')] 2024-09-12T00:34:31.853 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790],172.21.15.187', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'lockdep': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': True, 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T00:34:31.854 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:34:31.854 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:34:31.898 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.70 --addv c '[v2:172.21.15.70:3301,v1:172.21.15.70:6790]' --add b 172.21.15.187 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:34:31.983 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:31.983 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:31.984 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:34:31.984 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: generated fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:34:31.984 INFO:teuthology.orchestra.run.smithi070.stdout:setting min_mon_release = quincy 2024-09-12T00:34:31.984 INFO:teuthology.orchestra.run.smithi070.stdout:epoch 0 2024-09-12T00:34:31.984 INFO:teuthology.orchestra.run.smithi070.stdout:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:34:31.984 INFO:teuthology.orchestra.run.smithi070.stdout:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:34:31.984 INFO:teuthology.orchestra.run.smithi070.stdout:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:34:31.984 INFO:teuthology.orchestra.run.smithi070.stdout:min_mon_release 17 (quincy) 2024-09-12T00:34:31.984 INFO:teuthology.orchestra.run.smithi070.stdout:election_strategy: 1 2024-09-12T00:34:31.984 INFO:teuthology.orchestra.run.smithi070.stdout:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:34:31.985 INFO:teuthology.orchestra.run.smithi070.stdout:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:34:31.985 INFO:teuthology.orchestra.run.smithi070.stdout:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:34:31.985 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T00:34:31.986 DEBUG:teuthology.orchestra.run.smithi070:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:34:32.034 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d... 2024-09-12T00:34:32.035 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:34:32.079 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:34:32.107 INFO:teuthology.orchestra.run.smithi070.stdout:[global] 2024-09-12T00:34:32.107 INFO:teuthology.orchestra.run.smithi070.stdout: chdir = "" 2024-09-12T00:34:32.107 INFO:teuthology.orchestra.run.smithi070.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:34:32.107 INFO:teuthology.orchestra.run.smithi070.stdout: auth supported = cephx 2024-09-12T00:34:32.107 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.107 INFO:teuthology.orchestra.run.smithi070.stdout: filestore xattr use omap = true 2024-09-12T00:34:32.107 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.107 INFO:teuthology.orchestra.run.smithi070.stdout: mon clock drift allowed = 1.000 2024-09-12T00:34:32.107 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.107 INFO:teuthology.orchestra.run.smithi070.stdout: osd crush chooseleaf type = 0 2024-09-12T00:34:32.107 INFO:teuthology.orchestra.run.smithi070.stdout: auth debug = true 2024-09-12T00:34:32.108 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.108 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on old message = true 2024-09-12T00:34:32.108 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on bug = true 2024-09-12T00:34:32.108 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.108 INFO:teuthology.orchestra.run.smithi070.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:34:32.108 INFO:teuthology.orchestra.run.smithi070.stdout: mon pg warn max object skew = 0 2024-09-12T00:34:32.108 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.108 INFO:teuthology.orchestra.run.smithi070.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:34:32.108 INFO:teuthology.orchestra.run.smithi070.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:34:32.108 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.108 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default size = 2 2024-09-12T00:34:32.108 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.108 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow primary affinity = true 2024-09-12T00:34:32.108 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow pg remap = true 2024-09-12T00:34:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:34:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:34:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on no sortbitwise = false 2024-09-12T00:34:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:34:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on too few osds = false 2024-09-12T00:34:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:34:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:34:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: mon_allow_pool_size_one = true 2024-09-12T00:34:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:34:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: osd default data pool replay window = 5 2024-09-12T00:34:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.110 INFO:teuthology.orchestra.run.smithi070.stdout: mon allow pool delete = true 2024-09-12T00:34:32.110 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.110 INFO:teuthology.orchestra.run.smithi070.stdout: mon cluster log file level = debug 2024-09-12T00:34:32.110 INFO:teuthology.orchestra.run.smithi070.stdout: debug asserts on shutdown = true 2024-09-12T00:34:32.110 INFO:teuthology.orchestra.run.smithi070.stdout: mon health detail to clog = false 2024-09-12T00:34:32.110 INFO:teuthology.orchestra.run.smithi070.stdout: mon host = "172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790],172.21.15.187" 2024-09-12T00:34:32.110 INFO:teuthology.orchestra.run.smithi070.stdout: mon client directed command retry = 5 2024-09-12T00:34:32.110 INFO:teuthology.orchestra.run.smithi070.stdout: ms inject socket failures = 5000 2024-09-12T00:34:32.110 INFO:teuthology.orchestra.run.smithi070.stdout: osd_max_pg_log_entries = 10 2024-09-12T00:34:32.110 INFO:teuthology.orchestra.run.smithi070.stdout: osd_min_pg_log_entries = 10 2024-09-12T00:34:32.110 INFO:teuthology.orchestra.run.smithi070.stdout: rgw override bucket index max shards = 1 2024-09-12T00:34:32.110 INFO:teuthology.orchestra.run.smithi070.stdout: fsid = 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:34:32.110 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.110 INFO:teuthology.orchestra.run.smithi070.stdout:[osd] 2024-09-12T00:34:32.111 INFO:teuthology.orchestra.run.smithi070.stdout: osd journal size = 100 2024-09-12T00:34:32.111 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.111 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub load threshold = 5.0 2024-09-12T00:34:32.111 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub max interval = 600 2024-09-12T00:34:32.111 INFO:teuthology.orchestra.run.smithi070.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:34:32.111 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.111 INFO:teuthology.orchestra.run.smithi070.stdout: osd recover clone overlap = true 2024-09-12T00:34:32.111 INFO:teuthology.orchestra.run.smithi070.stdout: osd recovery max chunk = 1048576 2024-09-12T00:34:32.111 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.111 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug shutdown = true 2024-09-12T00:34:32.111 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug op order = true 2024-09-12T00:34:32.111 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug verify stray on activate = true 2024-09-12T00:34:32.111 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug trim objects = true 2024-09-12T00:34:32.111 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.112 INFO:teuthology.orchestra.run.smithi070.stdout: osd open classes on start = true 2024-09-12T00:34:32.112 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug pg log writeout = true 2024-09-12T00:34:32.112 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.112 INFO:teuthology.orchestra.run.smithi070.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:34:32.112 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.112 INFO:teuthology.orchestra.run.smithi070.stdout: osd map max advance = 10 2024-09-12T00:34:32.112 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.112 INFO:teuthology.orchestra.run.smithi070.stdout: journal zero on create = true 2024-09-12T00:34:32.112 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.112 INFO:teuthology.orchestra.run.smithi070.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:34:32.112 INFO:teuthology.orchestra.run.smithi070.stdout: filestore apply finisher threads = 3 2024-09-12T00:34:32.112 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.112 INFO:teuthology.orchestra.run.smithi070.stdout: bdev debug aio = true 2024-09-12T00:34:32.112 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug misdirected ops = true 2024-09-12T00:34:32.113 INFO:teuthology.orchestra.run.smithi070.stdout: bdev async discard = True 2024-09-12T00:34:32.113 INFO:teuthology.orchestra.run.smithi070.stdout: bdev enable discard = True 2024-09-12T00:34:32.113 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore allocator = bitmap 2024-09-12T00:34:32.113 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore block size = 96636764160 2024-09-12T00:34:32.113 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore fsck on mount = True 2024-09-12T00:34:32.113 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluefs = 1/20 2024-09-12T00:34:32.113 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluestore = 1/20 2024-09-12T00:34:32.113 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-12T00:34:32.113 INFO:teuthology.orchestra.run.smithi070.stdout: debug objclass = 20 2024-09-12T00:34:32.113 INFO:teuthology.orchestra.run.smithi070.stdout: debug osd = 20 2024-09-12T00:34:32.113 INFO:teuthology.orchestra.run.smithi070.stdout: debug rocksdb = 4/10 2024-09-12T00:34:32.113 INFO:teuthology.orchestra.run.smithi070.stdout: lockdep = True 2024-09-12T00:34:32.113 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:34:32.113 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd full ratio = 0.9 2024-09-12T00:34:32.114 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:34:32.114 INFO:teuthology.orchestra.run.smithi070.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:34:32.114 INFO:teuthology.orchestra.run.smithi070.stdout: osd objectstore = bluestore 2024-09-12T00:34:32.114 INFO:teuthology.orchestra.run.smithi070.stdout: osd shutdown pgref assert = True 2024-09-12T00:34:32.114 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.114 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr] 2024-09-12T00:34:32.114 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-12T00:34:32.114 INFO:teuthology.orchestra.run.smithi070.stdout: debug mgr = 20 2024-09-12T00:34:32.114 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-09-12T00:34:32.114 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-09-12T00:34:32.114 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:34:32.114 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:34:32.114 INFO:teuthology.orchestra.run.smithi070.stdout: mgr/telemetry/nag = false 2024-09-12T00:34:32.114 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.115 INFO:teuthology.orchestra.run.smithi070.stdout:[mon] 2024-09-12T00:34:32.115 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-12T00:34:32.115 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-09-12T00:34:32.115 INFO:teuthology.orchestra.run.smithi070.stdout: debug paxos = 20 2024-09-12T00:34:32.115 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-09-12T00:34:32.115 INFO:teuthology.orchestra.run.smithi070.stdout: mon data avail warn = 5 2024-09-12T00:34:32.115 INFO:teuthology.orchestra.run.smithi070.stdout: mon mgr mkfs grace = 240 2024-09-12T00:34:32.115 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:34:32.115 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd reporter subtree level = osd 2024-09-12T00:34:32.115 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd prime pg temp = true 2024-09-12T00:34:32.115 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:34:32.115 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.115 INFO:teuthology.orchestra.run.smithi070.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:34:32.115 INFO:teuthology.orchestra.run.smithi070.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:34:32.116 INFO:teuthology.orchestra.run.smithi070.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:34:32.116 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.116 INFO:teuthology.orchestra.run.smithi070.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:34:32.116 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:34:32.116 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:34:32.116 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.116 INFO:teuthology.orchestra.run.smithi070.stdout: # 1m isn't quite enough 2024-09-12T00:34:32.116 INFO:teuthology.orchestra.run.smithi070.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:34:32.116 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.116 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:34:32.116 INFO:teuthology.orchestra.run.smithi070.stdout: lockdep = True 2024-09-12T00:34:32.116 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:34:32.116 INFO:teuthology.orchestra.run.smithi070.stdout:[client] 2024-09-12T00:34:32.117 INFO:teuthology.orchestra.run.smithi070.stdout: rgw cache enabled = true 2024-09-12T00:34:32.117 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable ops log = True 2024-09-12T00:34:32.117 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable usage log = true 2024-09-12T00:34:32.117 INFO:teuthology.orchestra.run.smithi070.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:34:32.117 INFO:teuthology.orchestra.run.smithi070.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:34:32.117 INFO:teuthology.orchestra.run.smithi070.stdout: debug rgw = 20 2024-09-12T00:34:32.117 INFO:teuthology.orchestra.run.smithi070.stdout: debug rgw notification = 20 2024-09-12T00:34:32.117 INFO:teuthology.orchestra.run.smithi070.stdout: rgw bucket counters cache = True 2024-09-12T00:34:32.117 INFO:teuthology.orchestra.run.smithi070.stdout: rgw crypt require ssl = False 2024-09-12T00:34:32.117 INFO:teuthology.orchestra.run.smithi070.stdout: rgw crypt s3 kms backend = testing 2024-09-12T00:34:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:34:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T00:34:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-12T00:34:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: rgw d3n l1 local datacache enabled = True 2024-09-12T00:34:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: rgw max chunk size = 4194304 2024-09-12T00:34:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: rgw obj stripe size = 6291456 2024-09-12T00:34:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: rgw reshard progress judge interval = 10 2024-09-12T00:34:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: rgw s3 auth use sts = True 2024-09-12T00:34:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T00:34:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: rgw torrent flag = True 2024-09-12T00:34:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: rgw user counters cache = True 2024-09-12T00:34:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: setgroup = ceph 2024-09-12T00:34:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: setuser = ceph 2024-09-12T00:34:32.118 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.a] 2024-09-12T00:34:32.119 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.c] 2024-09-12T00:34:32.119 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.b] 2024-09-12T00:34:32.120 INFO:teuthology.orchestra.run.smithi187.stdout:[global] 2024-09-12T00:34:32.120 INFO:teuthology.orchestra.run.smithi187.stdout: chdir = "" 2024-09-12T00:34:32.120 INFO:teuthology.orchestra.run.smithi187.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:34:32.120 INFO:teuthology.orchestra.run.smithi187.stdout: auth supported = cephx 2024-09-12T00:34:32.120 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.120 INFO:teuthology.orchestra.run.smithi187.stdout: filestore xattr use omap = true 2024-09-12T00:34:32.121 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.121 INFO:teuthology.orchestra.run.smithi187.stdout: mon clock drift allowed = 1.000 2024-09-12T00:34:32.121 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.121 INFO:teuthology.orchestra.run.smithi187.stdout: osd crush chooseleaf type = 0 2024-09-12T00:34:32.121 INFO:teuthology.orchestra.run.smithi187.stdout: auth debug = true 2024-09-12T00:34:32.121 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.121 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on old message = true 2024-09-12T00:34:32.121 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on bug = true 2024-09-12T00:34:32.121 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.121 INFO:teuthology.orchestra.run.smithi187.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:34:32.121 INFO:teuthology.orchestra.run.smithi187.stdout: mon pg warn max object skew = 0 2024-09-12T00:34:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:34:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:34:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: osd pool default size = 2 2024-09-12T00:34:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd allow primary affinity = true 2024-09-12T00:34:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd allow pg remap = true 2024-09-12T00:34:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:34:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:34:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on no sortbitwise = false 2024-09-12T00:34:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:34:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on too few osds = false 2024-09-12T00:34:32.122 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:34:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:34:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: mon_allow_pool_size_one = true 2024-09-12T00:34:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:34:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: osd default data pool replay window = 5 2024-09-12T00:34:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: mon allow pool delete = true 2024-09-12T00:34:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: mon cluster log file level = debug 2024-09-12T00:34:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: debug asserts on shutdown = true 2024-09-12T00:34:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: mon health detail to clog = false 2024-09-12T00:34:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: mon host = "172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790],172.21.15.187" 2024-09-12T00:34:32.123 INFO:teuthology.orchestra.run.smithi187.stdout: mon client directed command retry = 5 2024-09-12T00:34:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: ms inject socket failures = 5000 2024-09-12T00:34:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: osd_max_pg_log_entries = 10 2024-09-12T00:34:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: osd_min_pg_log_entries = 10 2024-09-12T00:34:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: rgw override bucket index max shards = 1 2024-09-12T00:34:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: fsid = 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:34:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.124 INFO:teuthology.orchestra.run.smithi187.stdout:[osd] 2024-09-12T00:34:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: osd journal size = 100 2024-09-12T00:34:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: osd scrub load threshold = 5.0 2024-09-12T00:34:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: osd scrub max interval = 600 2024-09-12T00:34:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:34:32.124 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: osd recover clone overlap = true 2024-09-12T00:34:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: osd recovery max chunk = 1048576 2024-09-12T00:34:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug shutdown = true 2024-09-12T00:34:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug op order = true 2024-09-12T00:34:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug verify stray on activate = true 2024-09-12T00:34:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug trim objects = true 2024-09-12T00:34:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: osd open classes on start = true 2024-09-12T00:34:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug pg log writeout = true 2024-09-12T00:34:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:34:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.125 INFO:teuthology.orchestra.run.smithi187.stdout: osd map max advance = 10 2024-09-12T00:34:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: journal zero on create = true 2024-09-12T00:34:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:34:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: filestore apply finisher threads = 3 2024-09-12T00:34:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: bdev debug aio = true 2024-09-12T00:34:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug misdirected ops = true 2024-09-12T00:34:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: bdev async discard = True 2024-09-12T00:34:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: bdev enable discard = True 2024-09-12T00:34:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore allocator = bitmap 2024-09-12T00:34:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore block size = 96636764160 2024-09-12T00:34:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore fsck on mount = True 2024-09-12T00:34:32.126 INFO:teuthology.orchestra.run.smithi187.stdout: debug bluefs = 1/20 2024-09-12T00:34:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: debug bluestore = 1/20 2024-09-12T00:34:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2024-09-12T00:34:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: debug objclass = 20 2024-09-12T00:34:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: debug osd = 20 2024-09-12T00:34:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: debug rocksdb = 4/10 2024-09-12T00:34:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: lockdep = True 2024-09-12T00:34:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:34:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd full ratio = 0.9 2024-09-12T00:34:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:34:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:34:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: osd objectstore = bluestore 2024-09-12T00:34:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: osd shutdown pgref assert = True 2024-09-12T00:34:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.127 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr] 2024-09-12T00:34:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2024-09-12T00:34:32.127 INFO:teuthology.orchestra.run.smithi187.stdout: debug mgr = 20 2024-09-12T00:34:32.128 INFO:teuthology.orchestra.run.smithi187.stdout: debug mon = 20 2024-09-12T00:34:32.128 INFO:teuthology.orchestra.run.smithi187.stdout: debug auth = 20 2024-09-12T00:34:32.128 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:34:32.128 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:34:32.128 INFO:teuthology.orchestra.run.smithi187.stdout: mgr/telemetry/nag = false 2024-09-12T00:34:32.128 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.128 INFO:teuthology.orchestra.run.smithi187.stdout:[mon] 2024-09-12T00:34:32.128 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2024-09-12T00:34:32.128 INFO:teuthology.orchestra.run.smithi187.stdout: debug mon = 20 2024-09-12T00:34:32.128 INFO:teuthology.orchestra.run.smithi187.stdout: debug paxos = 20 2024-09-12T00:34:32.128 INFO:teuthology.orchestra.run.smithi187.stdout: debug auth = 20 2024-09-12T00:34:32.128 INFO:teuthology.orchestra.run.smithi187.stdout: mon data avail warn = 5 2024-09-12T00:34:32.128 INFO:teuthology.orchestra.run.smithi187.stdout: mon mgr mkfs grace = 240 2024-09-12T00:34:32.128 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:34:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd reporter subtree level = osd 2024-09-12T00:34:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd prime pg temp = true 2024-09-12T00:34:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:34:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:34:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:34:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:34:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:34:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:34:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:34:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: # 1m isn't quite enough 2024-09-12T00:34:32.129 INFO:teuthology.orchestra.run.smithi187.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:34:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:34:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: lockdep = True 2024-09-12T00:34:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T00:34:32.130 INFO:teuthology.orchestra.run.smithi187.stdout:[client] 2024-09-12T00:34:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: rgw cache enabled = true 2024-09-12T00:34:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: rgw enable ops log = True 2024-09-12T00:34:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: rgw enable usage log = true 2024-09-12T00:34:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:34:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:34:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: debug rgw = 20 2024-09-12T00:34:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: debug rgw notification = 20 2024-09-12T00:34:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: rgw bucket counters cache = True 2024-09-12T00:34:32.130 INFO:teuthology.orchestra.run.smithi187.stdout: rgw crypt require ssl = False 2024-09-12T00:34:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: rgw crypt s3 kms backend = testing 2024-09-12T00:34:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:34:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T00:34:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-12T00:34:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: rgw d3n l1 local datacache enabled = True 2024-09-12T00:34:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: rgw max chunk size = 4194304 2024-09-12T00:34:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: rgw obj stripe size = 6291456 2024-09-12T00:34:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: rgw reshard progress judge interval = 10 2024-09-12T00:34:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: rgw s3 auth use sts = True 2024-09-12T00:34:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T00:34:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: rgw torrent flag = True 2024-09-12T00:34:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: rgw user counters cache = True 2024-09-12T00:34:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: setgroup = ceph 2024-09-12T00:34:32.131 INFO:teuthology.orchestra.run.smithi187.stdout: setuser = ceph 2024-09-12T00:34:32.132 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.a] 2024-09-12T00:34:32.132 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.c] 2024-09-12T00:34:32.132 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.b] 2024-09-12T00:34:32.132 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T00:34:32.132 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T00:34:32.209 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T00:34:32.209 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:34:32.209 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T00:34:32.214 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:34:32.214 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T00:34:32.262 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi070.front.sepia.ceph.com 2024-09-12T00:34:32.262 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:34:32.262 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:34:32.262 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:34:32.326 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:34:32.326 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:34:32.373 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi187.front.sepia.ceph.com 2024-09-12T00:34:32.374 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T00:34:32.374 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:34:32.374 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:34:32.396 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T00:34:32.396 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:34:32.448 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T00:34:32.448 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T00:34:32.449 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:34:32.491 INFO:teuthology.orchestra.run.smithi070.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:34:32.494 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:34:32.537 INFO:teuthology.orchestra.run.smithi187.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:34:32.544 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T00:34:32.544 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T00:34:32.544 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T00:34:32.576 INFO:teuthology.orchestra.run.smithi070.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T00:34:32.586 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T00:34:32.621 INFO:teuthology.orchestra.run.smithi187.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T00:34:32.632 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T00:34:32.632 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi187.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:34:32.632 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T00:34:32.643 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:34:32.643 INFO:tasks.ceph:role: osd.0 2024-09-12T00:34:32.644 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-12T00:34:32.644 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:34:32.697 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:34:32.698 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:34:32.698 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:34:32.698 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:34:32.698 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:34:32.698 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:34:32.698 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:34:32.698 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:34:32.699 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:34:32.699 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:34:32.723 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-09-12T00:34:32.725 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-09-12T00:34:32.725 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T00:34:32.781 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T00:34:32.834 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:34:32.835 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:34:32.835 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T00:34:32.888 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:34:32.888 INFO:tasks.ceph:role: osd.1 2024-09-12T00:34:32.888 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-12T00:34:32.889 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:34:32.942 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:34:32.942 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:34:32.942 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:34:32.942 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:34:32.942 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:34:32.942 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:34:32.942 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:34:32.942 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:34:32.942 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:34:32.943 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:34:32.966 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-09-12T00:34:32.968 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-09-12T00:34:32.968 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T00:34:33.024 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T00:34:33.074 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:34:33.074 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:34:33.075 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T00:34:33.127 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:34:33.127 INFO:tasks.ceph:role: osd.2 2024-09-12T00:34:33.127 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-12T00:34:33.127 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:34:33.181 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:34:33.182 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:34:33.182 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:34:33.182 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:34:33.182 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:34:33.182 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:34:33.182 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:34:33.182 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:34:33.182 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:34:33.182 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:34:33.205 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-09-12T00:34:33.207 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-09-12T00:34:33.207 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T00:34:33.269 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T00:34:33.322 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:34:33.322 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:34:33.323 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T00:34:33.375 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:34:33.375 INFO:tasks.ceph:role: osd.3 2024-09-12T00:34:33.375 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-12T00:34:33.376 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:34:33.430 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:34:33.430 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:34:33.430 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:34:33.430 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:34:33.430 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:34:33.430 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:34:33.430 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:34:33.430 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:34:33.430 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:34:33.431 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:34:33.454 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-09-12T00:34:33.455 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-09-12T00:34:33.456 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T00:34:33.514 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T00:34:33.566 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:34:33.566 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:34:33.567 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:34:33.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:34:33.671+0000 7f02866837c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T00:34:33.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:34:33.675+0000 7f02866837c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T00:34:33.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:34:33.675+0000 7f02866837c0 -1 bdev(0x56220bc69800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T00:34:33.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:34:33.675+0000 7f02866837c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T00:34:36.834 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T00:34:36.847 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:34:36.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:34:36.927+0000 7f9359d1b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T00:34:36.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:34:36.927+0000 7f9359d1b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T00:34:36.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:34:36.927+0000 7f9359d1b7c0 -1 bdev(0x55ebcb03b800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T00:34:36.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:34:36.927+0000 7f9359d1b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T00:34:40.093 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T00:34:40.150 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:34:40.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:34:40.231+0000 7f3b473b67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T00:34:40.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:34:40.231+0000 7f3b473b67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T00:34:40.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:34:40.231+0000 7f3b473b67c0 -1 bdev(0x555a58b27800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T00:34:40.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:34:40.231+0000 7f3b473b67c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T00:34:43.393 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T00:34:43.449 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:34:43.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:34:43.531+0000 7fd976d6c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T00:34:43.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:34:43.531+0000 7fd976d6c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T00:34:43.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:34:43.531+0000 7fd976d6c7c0 -1 bdev(0x55884a709800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T00:34:43.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:34:43.531+0000 7fd976d6c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T00:34:46.703 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T00:34:46.759 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T00:34:46.773 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:34:46.773 INFO:tasks.ceph:role: osd.4 2024-09-12T00:34:46.773 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi187.front.sepia.ceph.com 2024-09-12T00:34:46.773 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:34:46.835 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:34:46.836 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:34:46.836 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:34:46.836 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:34:46.836 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:34:46.836 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:34:46.836 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:34:46.836 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:34:46.836 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:34:46.836 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:34:47.292 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2024-09-12T00:34:47.294 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2024-09-12T00:34:47.294 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T00:34:47.383 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T00:34:47.392 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:34:47.392 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:34:47.393 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T00:34:47.447 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:34:47.448 INFO:tasks.ceph:role: osd.5 2024-09-12T00:34:47.448 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi187.front.sepia.ceph.com 2024-09-12T00:34:47.448 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:34:47.514 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:34:47.515 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:34:47.515 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:34:47.515 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:34:47.515 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:34:47.515 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:34:47.515 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:34:47.515 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:34:47.515 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:34:47.515 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:34:47.986 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2024-09-12T00:34:47.988 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2024-09-12T00:34:47.988 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T00:34:48.147 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T00:34:48.158 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:34:48.158 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:34:48.159 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T00:34:48.214 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:34:48.214 INFO:tasks.ceph:role: osd.6 2024-09-12T00:34:48.215 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi187.front.sepia.ceph.com 2024-09-12T00:34:48.215 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:34:48.279 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:34:48.280 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:34:48.280 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:34:48.280 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:34:48.280 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:34:48.280 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:34:48.280 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:34:48.280 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:34:48.280 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:34:48.280 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:34:48.753 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2024-09-12T00:34:48.755 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2024-09-12T00:34:48.756 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T00:34:48.923 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T00:34:48.933 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:34:48.934 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:34:48.934 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T00:34:48.991 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:34:48.992 INFO:tasks.ceph:role: osd.7 2024-09-12T00:34:48.992 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi187.front.sepia.ceph.com 2024-09-12T00:34:48.992 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:34:49.055 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:34:49.055 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:34:49.055 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:34:49.055 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:34:49.055 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:34:49.055 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:34:49.055 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:34:49.055 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:34:49.055 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:34:49.055 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:34:49.481 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2024-09-12T00:34:49.483 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2024-09-12T00:34:49.483 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T00:34:49.559 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T00:34:49.613 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:34:49.614 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:34:49.614 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:34:49.733 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T00:34:49.732+0000 7f600a9a67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T00:34:49.736 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T00:34:49.736+0000 7f600a9a67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T00:34:49.737 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T00:34:49.736+0000 7f600a9a67c0 -1 bdev(0x5617efed1800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T00:34:49.737 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T00:34:49.736+0000 7f600a9a67c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T00:34:52.888 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T00:34:52.902 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:34:52.982 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T00:34:52.979+0000 7fdb073b17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T00:34:52.982 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T00:34:52.979+0000 7fdb073b17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T00:34:52.982 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T00:34:52.979+0000 7fdb073b17c0 -1 bdev(0x563764a61800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T00:34:52.983 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T00:34:52.979+0000 7fdb073b17c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T00:34:56.134 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T00:34:56.192 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:34:56.273 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T00:34:56.271+0000 7f93c88487c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T00:34:56.273 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T00:34:56.271+0000 7f93c88487c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T00:34:56.274 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T00:34:56.271+0000 7f93c88487c0 -1 bdev(0x56186883b800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T00:34:56.274 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T00:34:56.271+0000 7f93c88487c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T00:34:59.450 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T00:34:59.507 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:34:59.588 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T00:34:59.587+0000 7f3850c367c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T00:34:59.589 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T00:34:59.587+0000 7f3850c367c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T00:34:59.589 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T00:34:59.587+0000 7f3850c367c0 -1 bdev(0x564e0a5c5800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T00:34:59.589 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T00:34:59.587+0000 7f3850c367c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T00:35:02.710 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T00:35:02.764 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T00:35:02.765 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:35:02.765 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T00:35:02.780 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:35:02.781 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T00:35:02.836 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:35:02.837 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T00:35:02.893 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:35:02.893 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T00:35:02.948 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:35:02.948 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T00:35:03.004 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T00:35:03.005 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T00:35:03.019 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T00:35:03.019 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T00:35:03.075 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T00:35:03.075 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T00:35:03.130 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T00:35:03.130 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T00:35:03.182 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T00:35:03.182 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T00:35:03.235 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:35:03.235 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T00:35:03.241 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T00:35:03.241 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T00:35:03.283 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T00:35:03.283 DEBUG:teuthology.orchestra.run.smithi070:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:35:03.286 DEBUG:teuthology.orchestra.run.smithi187:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:35:03.329 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.y] 2024-09-12T00:35:03.330 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAYN+Jmd72YHRAAXKc16MrXgi0uieGhyRPD1A== 2024-09-12T00:35:03.330 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.0] 2024-09-12T00:35:03.330 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAZN+Jmb2RuKBAAmj7JxMcK0yh6pJ6cSCqdLg== 2024-09-12T00:35:03.330 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.1] 2024-09-12T00:35:03.330 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAcN+JmdVygNxAAYO74E/LoRIbhNEr77x8D6w== 2024-09-12T00:35:03.330 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.2] 2024-09-12T00:35:03.330 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAgN+JmyTklDhAAptOKtHQO7AGdZDk1sIT64Q== 2024-09-12T00:35:03.330 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.3] 2024-09-12T00:35:03.330 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAjN+Jm0vsFIBAAnxX+Pyh51DOxfCKOWPMmmw== 2024-09-12T00:35:03.331 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.x] 2024-09-12T00:35:03.331 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAYN+Jm3K03IBAAlpH4DeIHw445MSy0Cy19qA== 2024-09-12T00:35:03.331 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.4] 2024-09-12T00:35:03.331 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQApN+JmAKjpKxAAWB6BuOMFcTokq+cj20oqyQ== 2024-09-12T00:35:03.331 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.5] 2024-09-12T00:35:03.331 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAsN+JmFH6+OhAAGZiAueIfGdZhA3/Y89MosA== 2024-09-12T00:35:03.331 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.6] 2024-09-12T00:35:03.331 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAwN+JmrS95EBAAxcpfMhLElfsIsgjzsnWf6g== 2024-09-12T00:35:03.331 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.7] 2024-09-12T00:35:03.331 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAzN+JmiV1OIxAAG2SSCxLYGjgh88Jhn5uwKg== 2024-09-12T00:35:03.331 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2024-09-12T00:35:03.331 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAYN+Jmga6xIhAAb5o7q0t5mW9CPmLyCI14aw== 2024-09-12T00:35:03.331 INFO:teuthology.orchestra.run.smithi070.stdout:[client.1] 2024-09-12T00:35:03.331 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAYN+JmuTY/JRAAJ0eKuaN0NeXIggnJWQM+RQ== 2024-09-12T00:35:03.338 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr.y] 2024-09-12T00:35:03.338 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQAYN+Jmd72YHRAAXKc16MrXgi0uieGhyRPD1A== 2024-09-12T00:35:03.338 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.0] 2024-09-12T00:35:03.338 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQAZN+Jmb2RuKBAAmj7JxMcK0yh6pJ6cSCqdLg== 2024-09-12T00:35:03.338 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.1] 2024-09-12T00:35:03.338 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQAcN+JmdVygNxAAYO74E/LoRIbhNEr77x8D6w== 2024-09-12T00:35:03.338 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.2] 2024-09-12T00:35:03.338 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQAgN+JmyTklDhAAptOKtHQO7AGdZDk1sIT64Q== 2024-09-12T00:35:03.338 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.3] 2024-09-12T00:35:03.338 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQAjN+Jm0vsFIBAAnxX+Pyh51DOxfCKOWPMmmw== 2024-09-12T00:35:03.339 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr.x] 2024-09-12T00:35:03.339 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQAYN+Jm3K03IBAAlpH4DeIHw445MSy0Cy19qA== 2024-09-12T00:35:03.339 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.4] 2024-09-12T00:35:03.339 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQApN+JmAKjpKxAAWB6BuOMFcTokq+cj20oqyQ== 2024-09-12T00:35:03.339 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.5] 2024-09-12T00:35:03.339 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQAsN+JmFH6+OhAAGZiAueIfGdZhA3/Y89MosA== 2024-09-12T00:35:03.339 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.6] 2024-09-12T00:35:03.339 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQAwN+JmrS95EBAAxcpfMhLElfsIsgjzsnWf6g== 2024-09-12T00:35:03.339 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.7] 2024-09-12T00:35:03.339 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQAzN+JmiV1OIxAAG2SSCxLYGjgh88Jhn5uwKg== 2024-09-12T00:35:03.339 INFO:teuthology.orchestra.run.smithi187.stdout:[client.0] 2024-09-12T00:35:03.339 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQAYN+Jmga6xIhAAb5o7q0t5mW9CPmLyCI14aw== 2024-09-12T00:35:03.339 INFO:teuthology.orchestra.run.smithi187.stdout:[client.1] 2024-09-12T00:35:03.340 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQAYN+JmuTY/JRAAJ0eKuaN0NeXIggnJWQM+RQ== 2024-09-12T00:35:03.340 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:35:03.378 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:35:03.427 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:35:03.467 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:35:03.510 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:35:03.554 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:35:03.597 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:35:03.600 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:35:03.678 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:35:03.682 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:35:03.758 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:35:03.766 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:35:03.837 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:35:03.854 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:35:03.922 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:35:03.938 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:35:04.007 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:35:04.022 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:35:04.090 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:35:04.106 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:35:04.175 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:35:04.178 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:35:04.222 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:35:04.225 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:35:04.306 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T00:35:04.307 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T00:35:04.318 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:35:04.410 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T00:35:04.420 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T00:35:04.474 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:35:04.563 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T00:35:04.618 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T00:35:04.632 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:35:04.726 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T00:35:04.738 DEBUG:teuthology.orchestra.run.smithi070:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:35:04.740 DEBUG:teuthology.orchestra.run.smithi187:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:35:04.782 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T00:35:04.783 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T00:35:04.783 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T00:35:04.786 INFO:tasks.ceph.mon.a:Started 2024-09-12T00:35:04.786 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T00:35:04.786 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T00:35:04.788 INFO:tasks.ceph.mon.c:Started 2024-09-12T00:35:04.789 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T00:35:04.789 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T00:35:04.828 INFO:tasks.ceph.mon.b:Started 2024-09-12T00:35:04.828 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T00:35:04.829 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T00:35:04.829 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T00:35:04.831 INFO:tasks.ceph.mgr.y:Started 2024-09-12T00:35:04.831 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T00:35:04.832 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T00:35:04.834 INFO:tasks.ceph.mgr.x:Started 2024-09-12T00:35:04.835 DEBUG:tasks.ceph:set 0 configs 2024-09-12T00:35:04.835 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T00:35:04.835 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T00:35:10.338 INFO:teuthology.orchestra.run.smithi070.stderr:adjusted tunables profile to default 2024-09-12T00:35:10.357 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T00:35:10.357 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T00:35:10.357 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:35:10.357 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T00:35:10.369 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:35:10.369 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T00:35:10.423 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:35:10.423 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T00:35:10.475 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:35:10.475 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T00:35:10.532 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T00:35:10.532 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T00:35:10.546 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T00:35:10.546 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T00:35:10.603 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T00:35:10.603 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T00:35:10.658 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T00:35:10.659 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T00:35:10.714 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new ba70ea6f-e898-4fa5-b77c-fe7610a092ff 0 2024-09-12T00:35:10.974 INFO:teuthology.orchestra.run.smithi187.stdout:0 2024-09-12T00:35:10.993 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 7297d677-8ba5-41c6-b527-d2f3478cf439 1 2024-09-12T00:35:11.204 INFO:teuthology.orchestra.run.smithi187.stdout:1 2024-09-12T00:35:11.222 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 6454a4f1-ae89-4c6c-a91e-f11c7cac7bf1 2 2024-09-12T00:35:11.423 INFO:teuthology.orchestra.run.smithi187.stdout:2 2024-09-12T00:35:11.441 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 5c936a97-b8a6-4ae7-af74-618bd51182cb 3 2024-09-12T00:35:11.636 INFO:teuthology.orchestra.run.smithi187.stdout:3 2024-09-12T00:35:11.652 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new c5b466a6-f6ff-4d36-bc87-732dd5ac0c55 4 2024-09-12T00:35:11.848 INFO:teuthology.orchestra.run.smithi187.stdout:4 2024-09-12T00:35:11.865 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new aeb3d2d0-34f5-4325-98cc-097e3b839193 5 2024-09-12T00:35:12.067 INFO:teuthology.orchestra.run.smithi187.stdout:5 2024-09-12T00:35:12.084 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new c9895de0-47c9-4b70-84a1-3179ed2e8772 6 2024-09-12T00:35:12.281 INFO:teuthology.orchestra.run.smithi187.stdout:6 2024-09-12T00:35:12.297 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 791cef60-f4d7-4656-b446-49116d64bf35 7 2024-09-12T00:35:12.489 INFO:teuthology.orchestra.run.smithi187.stdout:7 2024-09-12T00:35:12.505 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T00:35:12.506 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T00:35:12.508 INFO:tasks.ceph.osd.0:Started 2024-09-12T00:35:12.508 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T00:35:12.508 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T00:35:12.510 INFO:tasks.ceph.osd.1:Started 2024-09-12T00:35:12.510 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T00:35:12.510 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T00:35:12.512 INFO:tasks.ceph.osd.2:Started 2024-09-12T00:35:12.512 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T00:35:12.512 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T00:35:12.514 INFO:tasks.ceph.osd.3:Started 2024-09-12T00:35:12.514 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T00:35:12.514 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T00:35:12.516 INFO:tasks.ceph.osd.4:Started 2024-09-12T00:35:12.516 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T00:35:12.516 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T00:35:12.518 INFO:tasks.ceph.osd.5:Started 2024-09-12T00:35:12.518 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T00:35:12.518 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T00:35:12.520 INFO:tasks.ceph.osd.6:Started 2024-09-12T00:35:12.520 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T00:35:12.520 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T00:35:12.522 INFO:tasks.ceph.osd.7:Started 2024-09-12T00:35:12.523 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:35:12.724 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:35:12.725 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":10,"fsid":"6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d","created":"2024-09-12T00:35:10.203939+0000","modified":"2024-09-12T00:35:12.490394+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:35:12.490394+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ba70ea6f-e898-4fa5-b77c-fe7610a092ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7297d677-8ba5-41c6-b527-d2f3478cf439","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6454a4f1-ae89-4c6c-a91e-f11c7cac7bf1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5c936a97-b8a6-4ae7-af74-618bd51182cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c5b466a6-f6ff-4d36-bc87-732dd5ac0c55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"aeb3d2d0-34f5-4325-98cc-097e3b839193","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c9895de0-47c9-4b70-84a1-3179ed2e8772","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"791cef60-f4d7-4656-b446-49116d64bf35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:35:12.746 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T00:35:12.746 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T00:35:13.331 INFO:tasks.ceph.mgr.x.smithi187.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T00:35:13.331 INFO:tasks.ceph.mgr.x.smithi187.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T00:35:13.331 INFO:tasks.ceph.mgr.x.smithi187.stderr: from numpy import show_config as show_numpy_config 2024-09-12T00:35:13.553 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:35:13.698 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-12T00:35:13.699+0000 7f11eca447c0 -1 Falling back to public interface 2024-09-12T00:35:13.795 INFO:teuthology.misc.health.smithi070.stdout: 2024-09-12T00:35:13.795 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":10,"fsid":"6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d","created":"2024-09-12T00:35:10.203939+0000","modified":"2024-09-12T00:35:12.490394+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:35:12.490394+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ba70ea6f-e898-4fa5-b77c-fe7610a092ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7297d677-8ba5-41c6-b527-d2f3478cf439","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6454a4f1-ae89-4c6c-a91e-f11c7cac7bf1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5c936a97-b8a6-4ae7-af74-618bd51182cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c5b466a6-f6ff-4d36-bc87-732dd5ac0c55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"aeb3d2d0-34f5-4325-98cc-097e3b839193","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c9895de0-47c9-4b70-84a1-3179ed2e8772","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"791cef60-f4d7-4656-b446-49116d64bf35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:35:13.810 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T00:35:13.892 INFO:tasks.ceph.osd.7.smithi187.stderr:2024-09-12T00:35:13.891+0000 7f9b68d347c0 -1 Falling back to public interface 2024-09-12T00:35:13.923 INFO:tasks.ceph.osd.4.smithi187.stderr:2024-09-12T00:35:13.923+0000 7fcdf8b517c0 -1 Falling back to public interface 2024-09-12T00:35:13.931 INFO:tasks.ceph.osd.6.smithi187.stderr:2024-09-12T00:35:13.931+0000 7f195b9927c0 -1 Falling back to public interface 2024-09-12T00:35:14.020 INFO:tasks.ceph.mgr.y.smithi070.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T00:35:14.020 INFO:tasks.ceph.mgr.y.smithi070.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T00:35:14.020 INFO:tasks.ceph.mgr.y.smithi070.stderr: from numpy import show_config as show_numpy_config 2024-09-12T00:35:14.190 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-12T00:35:14.191+0000 7f107f5d17c0 -1 Falling back to public interface 2024-09-12T00:35:14.197 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-12T00:35:14.199+0000 7fead9eb77c0 -1 Falling back to public interface 2024-09-12T00:35:14.416 INFO:tasks.ceph.osd.5.smithi187.stderr:2024-09-12T00:35:14.415+0000 7fb638cc67c0 -1 Falling back to public interface 2024-09-12T00:35:14.446 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-12T00:35:14.447+0000 7fd4f69347c0 -1 Falling back to public interface 2024-09-12T00:35:16.313 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-12T00:35:16.311+0000 7f58daa08640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T00:35:16.313 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-12T00:35:16.311+0000 7f58daa08640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T00:35:17.824 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-12T00:35:17.823+0000 7f11eca447c0 -1 osd.2 0 log_to_monitors true 2024-09-12T00:35:17.865 INFO:tasks.ceph.osd.7.smithi187.stderr:2024-09-12T00:35:17.863+0000 7f9b68d347c0 -1 osd.7 0 log_to_monitors true 2024-09-12T00:35:18.014 INFO:tasks.ceph.osd.4.smithi187.stderr:2024-09-12T00:35:18.011+0000 7fcdf8b517c0 -1 osd.4 0 log_to_monitors true 2024-09-12T00:35:18.077 INFO:tasks.ceph.osd.6.smithi187.stderr:2024-09-12T00:35:18.075+0000 7f195b9927c0 -1 osd.6 0 log_to_monitors true 2024-09-12T00:35:18.511 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-12T00:35:18.511+0000 7fd4f69347c0 -1 osd.0 0 log_to_monitors true 2024-09-12T00:35:18.515 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-12T00:35:18.515+0000 7f107f5d17c0 -1 osd.3 0 log_to_monitors true 2024-09-12T00:35:18.548 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-12T00:35:18.547+0000 7fead9eb77c0 -1 osd.1 0 log_to_monitors true 2024-09-12T00:35:18.683 INFO:tasks.ceph.osd.5.smithi187.stderr:2024-09-12T00:35:18.683+0000 7fb638cc67c0 -1 osd.5 0 log_to_monitors true 2024-09-12T00:35:20.080 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-12T00:35:20.079+0000 7f11e89ed640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T00:35:20.105 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-12T00:35:20.107+0000 7f11e081f640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:35:20.617 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:35:21.031 INFO:teuthology.misc.health.smithi070.stdout: 2024-09-12T00:35:21.031 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":13,"fsid":"6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d","created":"2024-09-12T00:35:10.203939+0000","modified":"2024-09-12T00:35:20.359571+0000","last_up_change":"2024-09-12T00:35:20.359571+0000","last_in_change":"2024-09-12T00:35:12.490394+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ba70ea6f-e898-4fa5-b77c-fe7610a092ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7297d677-8ba5-41c6-b527-d2f3478cf439","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6454a4f1-ae89-4c6c-a91e-f11c7cac7bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":936993313},{"type":"v1","addr":"172.21.15.70:6801","nonce":936993313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":936993313},{"type":"v1","addr":"172.21.15.70:6803","nonce":936993313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":936993313},{"type":"v1","addr":"172.21.15.70:6807","nonce":936993313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":936993313},{"type":"v1","addr":"172.21.15.70:6805","nonce":936993313}]},"public_addr":"172.21.15.70:6801/936993313","cluster_addr":"172.21.15.70:6803/936993313","heartbeat_back_addr":"172.21.15.70:6807/936993313","heartbeat_front_addr":"172.21.15.70:6805/936993313","state":["exists","up"]},{"osd":3,"uuid":"5c936a97-b8a6-4ae7-af74-618bd51182cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c5b466a6-f6ff-4d36-bc87-732dd5ac0c55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"aeb3d2d0-34f5-4325-98cc-097e3b839193","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c9895de0-47c9-4b70-84a1-3179ed2e8772","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"791cef60-f4d7-4656-b446-49116d64bf35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:35:21.058 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-12T00:35:21.244 INFO:tasks.ceph.osd.4.smithi187.stderr:2024-09-12T00:35:21.243+0000 7fcdf4afa640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T00:35:21.272 INFO:tasks.ceph.osd.4.smithi187.stderr:2024-09-12T00:35:21.271+0000 7fcdec92c640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:35:21.297 INFO:tasks.ceph.osd.6.smithi187.stderr:2024-09-12T00:35:21.295+0000 7f195814d640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T00:35:21.302 INFO:tasks.ceph.osd.7.smithi187.stderr:2024-09-12T00:35:21.299+0000 7f9b64cdd640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T00:35:21.333 INFO:tasks.ceph.osd.6.smithi187.stderr:2024-09-12T00:35:21.331+0000 7f194f76d640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:35:21.351 INFO:tasks.ceph.osd.7.smithi187.stderr:2024-09-12T00:35:21.351+0000 7f9b5cb0f640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:35:21.581 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-12T00:35:21.583+0000 7fead5e60640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T00:35:21.585 INFO:tasks.ceph.osd.5.smithi187.stderr:2024-09-12T00:35:21.583+0000 7fb634c6f640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T00:35:21.598 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-12T00:35:21.599+0000 7fd4f28dd640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T00:35:21.599 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-12T00:35:21.599+0000 7f107b57a640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T00:35:21.605 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-12T00:35:21.607+0000 7feacdc92640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:35:21.615 INFO:tasks.ceph.osd.5.smithi187.stderr:2024-09-12T00:35:21.615+0000 7fb62caa1640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:35:21.617 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-12T00:35:21.619+0000 7fd4ea70f640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:35:21.637 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-12T00:35:21.639+0000 7f10733ac640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:35:27.866 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:35:28.176 INFO:teuthology.misc.health.smithi070.stdout: 2024-09-12T00:35:28.176 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":18,"fsid":"6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d","created":"2024-09-12T00:35:10.203939+0000","modified":"2024-09-12T00:35:25.632992+0000","last_up_change":"2024-09-12T00:35:22.610801+0000","last_in_change":"2024-09-12T00:35:12.490394+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:35:23.354290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba70ea6f-e898-4fa5-b77c-fe7610a092ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2477739226},{"type":"v1","addr":"172.21.15.70:6825","nonce":2477739226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2477739226},{"type":"v1","addr":"172.21.15.70:6827","nonce":2477739226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2477739226},{"type":"v1","addr":"172.21.15.70:6831","nonce":2477739226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2477739226},{"type":"v1","addr":"172.21.15.70:6829","nonce":2477739226}]},"public_addr":"172.21.15.70:6825/2477739226","cluster_addr":"172.21.15.70:6827/2477739226","heartbeat_back_addr":"172.21.15.70:6831/2477739226","heartbeat_front_addr":"172.21.15.70:6829/2477739226","state":["exists","up"]},{"osd":1,"uuid":"7297d677-8ba5-41c6-b527-d2f3478cf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":1979013808},{"type":"v1","addr":"172.21.15.70:6817","nonce":1979013808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1979013808},{"type":"v1","addr":"172.21.15.70:6819","nonce":1979013808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1979013808},{"type":"v1","addr":"172.21.15.70:6823","nonce":1979013808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1979013808},{"type":"v1","addr":"172.21.15.70:6821","nonce":1979013808}]},"public_addr":"172.21.15.70:6817/1979013808","cluster_addr":"172.21.15.70:6819/1979013808","heartbeat_back_addr":"172.21.15.70:6823/1979013808","heartbeat_front_addr":"172.21.15.70:6821/1979013808","state":["exists","up"]},{"osd":2,"uuid":"6454a4f1-ae89-4c6c-a91e-f11c7cac7bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":936993313},{"type":"v1","addr":"172.21.15.70:6801","nonce":936993313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":936993313},{"type":"v1","addr":"172.21.15.70:6803","nonce":936993313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":936993313},{"type":"v1","addr":"172.21.15.70:6807","nonce":936993313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":936993313},{"type":"v1","addr":"172.21.15.70:6805","nonce":936993313}]},"public_addr":"172.21.15.70:6801/936993313","cluster_addr":"172.21.15.70:6803/936993313","heartbeat_back_addr":"172.21.15.70:6807/936993313","heartbeat_front_addr":"172.21.15.70:6805/936993313","state":["exists","up"]},{"osd":3,"uuid":"5c936a97-b8a6-4ae7-af74-618bd51182cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":276433067},{"type":"v1","addr":"172.21.15.70:6809","nonce":276433067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":276433067},{"type":"v1","addr":"172.21.15.70:6811","nonce":276433067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":276433067},{"type":"v1","addr":"172.21.15.70:6815","nonce":276433067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":276433067},{"type":"v1","addr":"172.21.15.70:6813","nonce":276433067}]},"public_addr":"172.21.15.70:6809/276433067","cluster_addr":"172.21.15.70:6811/276433067","heartbeat_back_addr":"172.21.15.70:6815/276433067","heartbeat_front_addr":"172.21.15.70:6813/276433067","state":["exists","up"]},{"osd":4,"uuid":"c5b466a6-f6ff-4d36-bc87-732dd5ac0c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3474756626},{"type":"v1","addr":"172.21.15.187:6809","nonce":3474756626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3474756626},{"type":"v1","addr":"172.21.15.187:6811","nonce":3474756626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3474756626},{"type":"v1","addr":"172.21.15.187:6815","nonce":3474756626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3474756626},{"type":"v1","addr":"172.21.15.187:6813","nonce":3474756626}]},"public_addr":"172.21.15.187:6809/3474756626","cluster_addr":"172.21.15.187:6811/3474756626","heartbeat_back_addr":"172.21.15.187:6815/3474756626","heartbeat_front_addr":"172.21.15.187:6813/3474756626","state":["exists","up"]},{"osd":5,"uuid":"aeb3d2d0-34f5-4325-98cc-097e3b839193","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":1546875221},{"type":"v1","addr":"172.21.15.187:6825","nonce":1546875221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1546875221},{"type":"v1","addr":"172.21.15.187:6827","nonce":1546875221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":1546875221},{"type":"v1","addr":"172.21.15.187:6831","nonce":1546875221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":1546875221},{"type":"v1","addr":"172.21.15.187:6829","nonce":1546875221}]},"public_addr":"172.21.15.187:6825/1546875221","cluster_addr":"172.21.15.187:6827/1546875221","heartbeat_back_addr":"172.21.15.187:6831/1546875221","heartbeat_front_addr":"172.21.15.187:6829/1546875221","state":["exists","up"]},{"osd":6,"uuid":"c9895de0-47c9-4b70-84a1-3179ed2e8772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2182256562},{"type":"v1","addr":"172.21.15.187:6817","nonce":2182256562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2182256562},{"type":"v1","addr":"172.21.15.187:6819","nonce":2182256562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2182256562},{"type":"v1","addr":"172.21.15.187:6823","nonce":2182256562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2182256562},{"type":"v1","addr":"172.21.15.187:6821","nonce":2182256562}]},"public_addr":"172.21.15.187:6817/2182256562","cluster_addr":"172.21.15.187:6819/2182256562","heartbeat_back_addr":"172.21.15.187:6823/2182256562","heartbeat_front_addr":"172.21.15.187:6821/2182256562","state":["exists","up"]},{"osd":7,"uuid":"791cef60-f4d7-4656-b446-49116d64bf35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":354474645},{"type":"v1","addr":"172.21.15.187:6801","nonce":354474645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":354474645},{"type":"v1","addr":"172.21.15.187:6803","nonce":354474645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":354474645},{"type":"v1","addr":"172.21.15.187:6807","nonce":354474645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":354474645},{"type":"v1","addr":"172.21.15.187:6805","nonce":354474645}]},"public_addr":"172.21.15.187:6801/354474645","cluster_addr":"172.21.15.187:6803/354474645","heartbeat_back_addr":"172.21.15.187:6807/354474645","heartbeat_front_addr":"172.21.15.187:6805/354474645","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:19.522527+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:19.550700+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:18.810225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:19.567260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:18.975276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:19.654766+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:19.126591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:18.913839+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:35:28.194 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T00:35:28.194 INFO:tasks.ceph:Creating RBD pool 2024-09-12T00:35:28.195 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T00:35:28.643 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'rbd' created 2024-09-12T00:35:28.669 DEBUG:teuthology.orchestra.run.smithi070:> rbd --cluster ceph pool init rbd 2024-09-12T00:35:28.795 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:28.795 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:31.797 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T00:35:31.798 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T00:35:31.799 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T00:35:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:35:32.137 INFO:teuthology.orchestra.run.smithi070.stdout:[{"version":9,"timestamp":"2024-09-12T00:35:21.608619+0000","name":"","changes":[{"name":"osd.3/osd_mclock_max_capacity_iops_ssd","new_value":"5253.956769"}]}] 2024-09-12T00:35:32.137 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T00:35:32.137 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T00:35:32.137 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T00:35:32.137 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T00:35:32.491 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:35:32.509 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":48809792},{"type":"v1","addr":"172.21.15.187:6833","nonce":48809792}]},"active_addr":"172.21.15.187:6833/48809792","active_change":"2024-09-12T00:35:15.296398+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4106,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.187:0","nonce":2369078153}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.187:0","nonce":2724624401}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.187:0","nonce":428742299}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.187:0","nonce":4114581069}]}]} 2024-09-12T00:35:32.513 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T00:35:32.513 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T00:35:32.513 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:35:32.800 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:35:32.800 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":22,"fsid":"6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d","created":"2024-09-12T00:35:10.203939+0000","modified":"2024-09-12T00:35:31.676033+0000","last_up_change":"2024-09-12T00:35:22.610801+0000","last_in_change":"2024-09-12T00:35:12.490394+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:35:23.354290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:35:28.516192+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba70ea6f-e898-4fa5-b77c-fe7610a092ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2477739226},{"type":"v1","addr":"172.21.15.70:6825","nonce":2477739226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2477739226},{"type":"v1","addr":"172.21.15.70:6827","nonce":2477739226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2477739226},{"type":"v1","addr":"172.21.15.70:6831","nonce":2477739226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2477739226},{"type":"v1","addr":"172.21.15.70:6829","nonce":2477739226}]},"public_addr":"172.21.15.70:6825/2477739226","cluster_addr":"172.21.15.70:6827/2477739226","heartbeat_back_addr":"172.21.15.70:6831/2477739226","heartbeat_front_addr":"172.21.15.70:6829/2477739226","state":["exists","up"]},{"osd":1,"uuid":"7297d677-8ba5-41c6-b527-d2f3478cf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":1979013808},{"type":"v1","addr":"172.21.15.70:6817","nonce":1979013808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1979013808},{"type":"v1","addr":"172.21.15.70:6819","nonce":1979013808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1979013808},{"type":"v1","addr":"172.21.15.70:6823","nonce":1979013808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1979013808},{"type":"v1","addr":"172.21.15.70:6821","nonce":1979013808}]},"public_addr":"172.21.15.70:6817/1979013808","cluster_addr":"172.21.15.70:6819/1979013808","heartbeat_back_addr":"172.21.15.70:6823/1979013808","heartbeat_front_addr":"172.21.15.70:6821/1979013808","state":["exists","up"]},{"osd":2,"uuid":"6454a4f1-ae89-4c6c-a91e-f11c7cac7bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":936993313},{"type":"v1","addr":"172.21.15.70:6801","nonce":936993313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":936993313},{"type":"v1","addr":"172.21.15.70:6803","nonce":936993313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":936993313},{"type":"v1","addr":"172.21.15.70:6807","nonce":936993313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":936993313},{"type":"v1","addr":"172.21.15.70:6805","nonce":936993313}]},"public_addr":"172.21.15.70:6801/936993313","cluster_addr":"172.21.15.70:6803/936993313","heartbeat_back_addr":"172.21.15.70:6807/936993313","heartbeat_front_addr":"172.21.15.70:6805/936993313","state":["exists","up"]},{"osd":3,"uuid":"5c936a97-b8a6-4ae7-af74-618bd51182cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":276433067},{"type":"v1","addr":"172.21.15.70:6809","nonce":276433067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":276433067},{"type":"v1","addr":"172.21.15.70:6811","nonce":276433067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":276433067},{"type":"v1","addr":"172.21.15.70:6815","nonce":276433067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":276433067},{"type":"v1","addr":"172.21.15.70:6813","nonce":276433067}]},"public_addr":"172.21.15.70:6809/276433067","cluster_addr":"172.21.15.70:6811/276433067","heartbeat_back_addr":"172.21.15.70:6815/276433067","heartbeat_front_addr":"172.21.15.70:6813/276433067","state":["exists","up"]},{"osd":4,"uuid":"c5b466a6-f6ff-4d36-bc87-732dd5ac0c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3474756626},{"type":"v1","addr":"172.21.15.187:6809","nonce":3474756626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3474756626},{"type":"v1","addr":"172.21.15.187:6811","nonce":3474756626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3474756626},{"type":"v1","addr":"172.21.15.187:6815","nonce":3474756626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3474756626},{"type":"v1","addr":"172.21.15.187:6813","nonce":3474756626}]},"public_addr":"172.21.15.187:6809/3474756626","cluster_addr":"172.21.15.187:6811/3474756626","heartbeat_back_addr":"172.21.15.187:6815/3474756626","heartbeat_front_addr":"172.21.15.187:6813/3474756626","state":["exists","up"]},{"osd":5,"uuid":"aeb3d2d0-34f5-4325-98cc-097e3b839193","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":1546875221},{"type":"v1","addr":"172.21.15.187:6825","nonce":1546875221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1546875221},{"type":"v1","addr":"172.21.15.187:6827","nonce":1546875221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":1546875221},{"type":"v1","addr":"172.21.15.187:6831","nonce":1546875221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":1546875221},{"type":"v1","addr":"172.21.15.187:6829","nonce":1546875221}]},"public_addr":"172.21.15.187:6825/1546875221","cluster_addr":"172.21.15.187:6827/1546875221","heartbeat_back_addr":"172.21.15.187:6831/1546875221","heartbeat_front_addr":"172.21.15.187:6829/1546875221","state":["exists","up"]},{"osd":6,"uuid":"c9895de0-47c9-4b70-84a1-3179ed2e8772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2182256562},{"type":"v1","addr":"172.21.15.187:6817","nonce":2182256562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2182256562},{"type":"v1","addr":"172.21.15.187:6819","nonce":2182256562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2182256562},{"type":"v1","addr":"172.21.15.187:6823","nonce":2182256562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2182256562},{"type":"v1","addr":"172.21.15.187:6821","nonce":2182256562}]},"public_addr":"172.21.15.187:6817/2182256562","cluster_addr":"172.21.15.187:6819/2182256562","heartbeat_back_addr":"172.21.15.187:6823/2182256562","heartbeat_front_addr":"172.21.15.187:6821/2182256562","state":["exists","up"]},{"osd":7,"uuid":"791cef60-f4d7-4656-b446-49116d64bf35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":354474645},{"type":"v1","addr":"172.21.15.187:6801","nonce":354474645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":354474645},{"type":"v1","addr":"172.21.15.187:6803","nonce":354474645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":354474645},{"type":"v1","addr":"172.21.15.187:6807","nonce":354474645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":354474645},{"type":"v1","addr":"172.21.15.187:6805","nonce":354474645}]},"public_addr":"172.21.15.187:6801/354474645","cluster_addr":"172.21.15.187:6803/354474645","heartbeat_back_addr":"172.21.15.187:6807/354474645","heartbeat_front_addr":"172.21.15.187:6805/354474645","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:19.522527+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:19.550700+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:18.810225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:19.567260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:18.975276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:19.654766+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:19.126591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:18.913839+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:35:32.817 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T00:35:32.817 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:35:33.119 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:35:33.119 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":22,"fsid":"6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d","created":"2024-09-12T00:35:10.203939+0000","modified":"2024-09-12T00:35:31.676033+0000","last_up_change":"2024-09-12T00:35:22.610801+0000","last_in_change":"2024-09-12T00:35:12.490394+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:35:23.354290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:35:28.516192+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba70ea6f-e898-4fa5-b77c-fe7610a092ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2477739226},{"type":"v1","addr":"172.21.15.70:6825","nonce":2477739226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2477739226},{"type":"v1","addr":"172.21.15.70:6827","nonce":2477739226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2477739226},{"type":"v1","addr":"172.21.15.70:6831","nonce":2477739226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2477739226},{"type":"v1","addr":"172.21.15.70:6829","nonce":2477739226}]},"public_addr":"172.21.15.70:6825/2477739226","cluster_addr":"172.21.15.70:6827/2477739226","heartbeat_back_addr":"172.21.15.70:6831/2477739226","heartbeat_front_addr":"172.21.15.70:6829/2477739226","state":["exists","up"]},{"osd":1,"uuid":"7297d677-8ba5-41c6-b527-d2f3478cf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":1979013808},{"type":"v1","addr":"172.21.15.70:6817","nonce":1979013808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1979013808},{"type":"v1","addr":"172.21.15.70:6819","nonce":1979013808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1979013808},{"type":"v1","addr":"172.21.15.70:6823","nonce":1979013808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1979013808},{"type":"v1","addr":"172.21.15.70:6821","nonce":1979013808}]},"public_addr":"172.21.15.70:6817/1979013808","cluster_addr":"172.21.15.70:6819/1979013808","heartbeat_back_addr":"172.21.15.70:6823/1979013808","heartbeat_front_addr":"172.21.15.70:6821/1979013808","state":["exists","up"]},{"osd":2,"uuid":"6454a4f1-ae89-4c6c-a91e-f11c7cac7bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":936993313},{"type":"v1","addr":"172.21.15.70:6801","nonce":936993313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":936993313},{"type":"v1","addr":"172.21.15.70:6803","nonce":936993313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":936993313},{"type":"v1","addr":"172.21.15.70:6807","nonce":936993313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":936993313},{"type":"v1","addr":"172.21.15.70:6805","nonce":936993313}]},"public_addr":"172.21.15.70:6801/936993313","cluster_addr":"172.21.15.70:6803/936993313","heartbeat_back_addr":"172.21.15.70:6807/936993313","heartbeat_front_addr":"172.21.15.70:6805/936993313","state":["exists","up"]},{"osd":3,"uuid":"5c936a97-b8a6-4ae7-af74-618bd51182cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":276433067},{"type":"v1","addr":"172.21.15.70:6809","nonce":276433067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":276433067},{"type":"v1","addr":"172.21.15.70:6811","nonce":276433067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":276433067},{"type":"v1","addr":"172.21.15.70:6815","nonce":276433067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":276433067},{"type":"v1","addr":"172.21.15.70:6813","nonce":276433067}]},"public_addr":"172.21.15.70:6809/276433067","cluster_addr":"172.21.15.70:6811/276433067","heartbeat_back_addr":"172.21.15.70:6815/276433067","heartbeat_front_addr":"172.21.15.70:6813/276433067","state":["exists","up"]},{"osd":4,"uuid":"c5b466a6-f6ff-4d36-bc87-732dd5ac0c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3474756626},{"type":"v1","addr":"172.21.15.187:6809","nonce":3474756626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3474756626},{"type":"v1","addr":"172.21.15.187:6811","nonce":3474756626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3474756626},{"type":"v1","addr":"172.21.15.187:6815","nonce":3474756626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3474756626},{"type":"v1","addr":"172.21.15.187:6813","nonce":3474756626}]},"public_addr":"172.21.15.187:6809/3474756626","cluster_addr":"172.21.15.187:6811/3474756626","heartbeat_back_addr":"172.21.15.187:6815/3474756626","heartbeat_front_addr":"172.21.15.187:6813/3474756626","state":["exists","up"]},{"osd":5,"uuid":"aeb3d2d0-34f5-4325-98cc-097e3b839193","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":1546875221},{"type":"v1","addr":"172.21.15.187:6825","nonce":1546875221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1546875221},{"type":"v1","addr":"172.21.15.187:6827","nonce":1546875221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":1546875221},{"type":"v1","addr":"172.21.15.187:6831","nonce":1546875221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":1546875221},{"type":"v1","addr":"172.21.15.187:6829","nonce":1546875221}]},"public_addr":"172.21.15.187:6825/1546875221","cluster_addr":"172.21.15.187:6827/1546875221","heartbeat_back_addr":"172.21.15.187:6831/1546875221","heartbeat_front_addr":"172.21.15.187:6829/1546875221","state":["exists","up"]},{"osd":6,"uuid":"c9895de0-47c9-4b70-84a1-3179ed2e8772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2182256562},{"type":"v1","addr":"172.21.15.187:6817","nonce":2182256562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2182256562},{"type":"v1","addr":"172.21.15.187:6819","nonce":2182256562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2182256562},{"type":"v1","addr":"172.21.15.187:6823","nonce":2182256562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2182256562},{"type":"v1","addr":"172.21.15.187:6821","nonce":2182256562}]},"public_addr":"172.21.15.187:6817/2182256562","cluster_addr":"172.21.15.187:6819/2182256562","heartbeat_back_addr":"172.21.15.187:6823/2182256562","heartbeat_front_addr":"172.21.15.187:6821/2182256562","state":["exists","up"]},{"osd":7,"uuid":"791cef60-f4d7-4656-b446-49116d64bf35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":354474645},{"type":"v1","addr":"172.21.15.187:6801","nonce":354474645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":354474645},{"type":"v1","addr":"172.21.15.187:6803","nonce":354474645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":354474645},{"type":"v1","addr":"172.21.15.187:6807","nonce":354474645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":354474645},{"type":"v1","addr":"172.21.15.187:6805","nonce":354474645}]},"public_addr":"172.21.15.187:6801/354474645","cluster_addr":"172.21.15.187:6803/354474645","heartbeat_back_addr":"172.21.15.187:6807/354474645","heartbeat_front_addr":"172.21.15.187:6805/354474645","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:19.522527+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:19.550700+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:18.810225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:19.567260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:18.975276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:19.654766+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:19.126591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:18.913839+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:35:33.140 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T00:35:33.141 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T00:35:33.141 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T00:35:33.142 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T00:35:33.142 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T00:35:33.143 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T00:35:33.143 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T00:35:33.144 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T00:35:33.391 INFO:teuthology.orchestra.run.smithi070.stdout:64424509446 2024-09-12T00:35:33.392 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:35:33.399 INFO:teuthology.orchestra.run.smithi070.stdout:55834574852 2024-09-12T00:35:33.399 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:35:33.414 INFO:teuthology.orchestra.run.smithi070.stdout:64424509445 2024-09-12T00:35:33.414 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:35:33.416 INFO:teuthology.orchestra.run.smithi070.stdout:60129542149 2024-09-12T00:35:33.416 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:35:33.417 INFO:teuthology.orchestra.run.smithi070.stdout:60129542149 2024-09-12T00:35:33.418 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:35:33.419 INFO:teuthology.orchestra.run.smithi070.stdout:64424509446 2024-09-12T00:35:33.419 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:35:33.420 INFO:teuthology.orchestra.run.smithi070.stdout:60129542149 2024-09-12T00:35:33.420 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:35:33.421 INFO:teuthology.orchestra.run.smithi070.stdout:64424509446 2024-09-12T00:35:33.422 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:35:33.916 INFO:teuthology.orchestra.run.smithi070.stdout:64424509445 2024-09-12T00:35:33.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.5 2024-09-12T00:35:33.954 INFO:teuthology.orchestra.run.smithi070.stdout:60129542148 2024-09-12T00:35:33.958 INFO:teuthology.orchestra.run.smithi070.stdout:64424509444 2024-09-12T00:35:33.962 INFO:teuthology.orchestra.run.smithi070.stdout:64424509445 2024-09-12T00:35:33.966 INFO:teuthology.orchestra.run.smithi070.stdout:55834574851 2024-09-12T00:35:33.966 INFO:teuthology.orchestra.run.smithi070.stdout:60129542148 2024-09-12T00:35:33.967 INFO:teuthology.orchestra.run.smithi070.stdout:64424509444 2024-09-12T00:35:33.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.6 2024-09-12T00:35:33.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.2 2024-09-12T00:35:33.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.0 2024-09-12T00:35:33.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.3 2024-09-12T00:35:34.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.1 2024-09-12T00:35:34.001 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.4 2024-09-12T00:35:34.002 INFO:teuthology.orchestra.run.smithi070.stdout:60129542148 2024-09-12T00:35:34.019 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.7 2024-09-12T00:35:34.940 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:35:34.981 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:35:34.996 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:35:34.997 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:35:35.000 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:35:35.001 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:35:35.002 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:35:35.020 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:35:35.457 INFO:teuthology.orchestra.run.smithi070.stdout:64424509445 2024-09-12T00:35:35.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.5 2024-09-12T00:35:35.520 INFO:teuthology.orchestra.run.smithi070.stdout:55834574851 2024-09-12T00:35:35.535 INFO:teuthology.orchestra.run.smithi070.stdout:60129542148 2024-09-12T00:35:35.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.2 2024-09-12T00:35:35.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.6 2024-09-12T00:35:35.569 INFO:teuthology.orchestra.run.smithi070.stdout:64424509445 2024-09-12T00:35:35.579 INFO:teuthology.orchestra.run.smithi070.stdout:60129542148 2024-09-12T00:35:35.591 INFO:teuthology.orchestra.run.smithi070.stdout:64424509444 2024-09-12T00:35:35.592 INFO:teuthology.orchestra.run.smithi070.stdout:60129542148 2024-09-12T00:35:35.596 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.1 2024-09-12T00:35:35.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.7 2024-09-12T00:35:35.602 INFO:teuthology.orchestra.run.smithi070.stdout:64424509444 2024-09-12T00:35:35.613 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.3 2024-09-12T00:35:35.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.4 2024-09-12T00:35:35.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.0 2024-09-12T00:35:36.481 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:35:36.539 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:35:36.560 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:35:36.596 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:35:36.601 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:35:36.614 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:35:36.619 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:35:36.624 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:35:36.959 INFO:teuthology.orchestra.run.smithi070.stdout:64424509447 2024-09-12T00:35:36.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.5 2024-09-12T00:35:36.984 DEBUG:teuthology.parallel:result is None 2024-09-12T00:35:37.068 INFO:teuthology.orchestra.run.smithi070.stdout:64424509446 2024-09-12T00:35:37.071 INFO:teuthology.orchestra.run.smithi070.stdout:55834574852 2024-09-12T00:35:37.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.0 2024-09-12T00:35:37.089 DEBUG:teuthology.parallel:result is None 2024-09-12T00:35:37.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2024-09-12T00:35:37.096 DEBUG:teuthology.parallel:result is None 2024-09-12T00:35:37.119 INFO:teuthology.orchestra.run.smithi070.stdout:60129542149 2024-09-12T00:35:37.136 INFO:teuthology.orchestra.run.smithi070.stdout:64424509447 2024-09-12T00:35:37.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.6 2024-09-12T00:35:37.143 DEBUG:teuthology.parallel:result is None 2024-09-12T00:35:37.154 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.1 2024-09-12T00:35:37.154 DEBUG:teuthology.parallel:result is None 2024-09-12T00:35:37.155 INFO:teuthology.orchestra.run.smithi070.stdout:60129542149 2024-09-12T00:35:37.156 INFO:teuthology.orchestra.run.smithi070.stdout:60129542149 2024-09-12T00:35:37.167 INFO:teuthology.orchestra.run.smithi070.stdout:64424509446 2024-09-12T00:35:37.175 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.4 2024-09-12T00:35:37.175 DEBUG:teuthology.parallel:result is None 2024-09-12T00:35:37.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.7 2024-09-12T00:35:37.178 DEBUG:teuthology.parallel:result is None 2024-09-12T00:35:37.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.3 2024-09-12T00:35:37.186 DEBUG:teuthology.parallel:result is None 2024-09-12T00:35:37.186 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T00:35:37.186 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:35:37.501 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:35:37.502 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-12T00:35:37.518 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-12T00:35:37.309278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235788,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738932,"statfs":{"total":773094113280,"available":772852666368,"internally_reserved":0,"allocated":2965504,"data_stored":1787238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.651577"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:35:31.686791+0000","last_change":"2024-09-12T00:35:31.686791+0000","last_active":"2024-09-12T00:35:31.686791+0000","last_peered":"2024-09-12T00:35:31.686791+0000","last_clean":"2024-09-12T00:35:31.686791+0000","last_became_active":"2024-09-12T00:35:29.670571+0000","last_became_peered":"2024-09-12T00:35:29.670571+0000","last_unstale":"2024-09-12T00:35:31.686791+0000","last_undegraded":"2024-09-12T00:35:31.686791+0000","last_fullsized":"2024-09-12T00:35:31.686791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:53.106651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012596770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:35:31.699143+0000","last_change":"2024-09-12T00:35:31.699143+0000","last_active":"2024-09-12T00:35:31.699143+0000","last_peered":"2024-09-12T00:35:31.699143+0000","last_clean":"2024-09-12T00:35:31.699143+0000","last_became_active":"2024-09-12T00:35:29.671727+0000","last_became_peered":"2024-09-12T00:35:29.671727+0000","last_unstale":"2024-09-12T00:35:31.699143+0000","last_undegraded":"2024-09-12T00:35:31.699143+0000","last_fullsized":"2024-09-12T00:35:31.699143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:24.616311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010553139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:35:31.861538+0000","last_change":"2024-09-12T00:35:31.861538+0000","last_active":"2024-09-12T00:35:31.861538+0000","last_peered":"2024-09-12T00:35:31.861538+0000","last_clean":"2024-09-12T00:35:31.861538+0000","last_became_active":"2024-09-12T00:35:29.697973+0000","last_became_peered":"2024-09-12T00:35:29.697973+0000","last_unstale":"2024-09-12T00:35:31.861538+0000","last_undegraded":"2024-09-12T00:35:31.861538+0000","last_fullsized":"2024-09-12T00:35:31.861538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:08.455168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083354399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:35:31.699054+0000","last_change":"2024-09-12T00:35:31.699054+0000","last_active":"2024-09-12T00:35:31.699054+0000","last_peered":"2024-09-12T00:35:31.699054+0000","last_clean":"2024-09-12T00:35:31.699054+0000","last_became_active":"2024-09-12T00:35:29.700869+0000","last_became_peered":"2024-09-12T00:35:29.700869+0000","last_unstale":"2024-09-12T00:35:31.699054+0000","last_undegraded":"2024-09-12T00:35:31.699054+0000","last_fullsized":"2024-09-12T00:35:31.699054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:14.134437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099003299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:35:31.694495+0000","last_change":"2024-09-12T00:35:31.692803+0000","last_active":"2024-09-12T00:35:31.694495+0000","last_peered":"2024-09-12T00:35:31.694495+0000","last_clean":"2024-09-12T00:35:31.694495+0000","last_became_active":"2024-09-12T00:35:29.664963+0000","last_became_peered":"2024-09-12T00:35:29.664963+0000","last_unstale":"2024-09-12T00:35:31.694495+0000","last_undegraded":"2024-09-12T00:35:31.694495+0000","last_fullsized":"2024-09-12T00:35:31.694495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:27.056845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020842569999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:35:31.904089+0000","last_change":"2024-09-12T00:35:31.904599+0000","last_active":"2024-09-12T00:35:31.904089+0000","last_peered":"2024-09-12T00:35:31.904089+0000","last_clean":"2024-09-12T00:35:31.904089+0000","last_became_active":"2024-09-12T00:35:29.699432+0000","last_became_peered":"2024-09-12T00:35:29.699432+0000","last_unstale":"2024-09-12T00:35:31.904089+0000","last_undegraded":"2024-09-12T00:35:31.904089+0000","last_fullsized":"2024-09-12T00:35:31.904089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:03.035417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099979400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:35:31.861888+0000","last_change":"2024-09-12T00:35:31.861888+0000","last_active":"2024-09-12T00:35:31.861888+0000","last_peered":"2024-09-12T00:35:31.861888+0000","last_clean":"2024-09-12T00:35:31.861888+0000","last_became_active":"2024-09-12T00:35:29.671287+0000","last_became_peered":"2024-09-12T00:35:29.671287+0000","last_unstale":"2024-09-12T00:35:31.861888+0000","last_undegraded":"2024-09-12T00:35:31.861888+0000","last_fullsized":"2024-09-12T00:35:31.861888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:47.739072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075002000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:35:31.691879+0000","last_change":"2024-09-12T00:35:31.691879+0000","last_active":"2024-09-12T00:35:31.691879+0000","last_peered":"2024-09-12T00:35:31.691879+0000","last_clean":"2024-09-12T00:35:31.691879+0000","last_became_active":"2024-09-12T00:35:29.668145+0000","last_became_peered":"2024-09-12T00:35:29.668145+0000","last_unstale":"2024-09-12T00:35:31.691879+0000","last_undegraded":"2024-09-12T00:35:31.691879+0000","last_fullsized":"2024-09-12T00:35:31.691879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:18.650004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011070749999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:35:31.860588+0000","last_change":"2024-09-12T00:35:25.098793+0000","last_active":"2024-09-12T00:35:31.860588+0000","last_peered":"2024-09-12T00:35:31.860588+0000","last_clean":"2024-09-12T00:35:31.860588+0000","last_became_active":"2024-09-12T00:35:25.096843+0000","last_became_peered":"2024-09-12T00:35:25.096843+0000","last_unstale":"2024-09-12T00:35:31.860588+0000","last_undegraded":"2024-09-12T00:35:31.860588+0000","last_fullsized":"2024-09-12T00:35:31.860588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:23.614097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:23.614097+0000","last_clean_scrub_stamp":"2024-09-12T00:35:23.614097+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:42.023728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":75827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":75808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":225280,"data_stored":75827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":815104,"data_stored":666176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":666176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":75808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":75808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":75808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:35:37.519 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:35:37.801 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:35:37.801 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-12T00:35:37.817 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-12T00:35:37.309278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235788,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738932,"statfs":{"total":773094113280,"available":772852666368,"internally_reserved":0,"allocated":2965504,"data_stored":1787238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.651577"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:35:31.686791+0000","last_change":"2024-09-12T00:35:31.686791+0000","last_active":"2024-09-12T00:35:31.686791+0000","last_peered":"2024-09-12T00:35:31.686791+0000","last_clean":"2024-09-12T00:35:31.686791+0000","last_became_active":"2024-09-12T00:35:29.670571+0000","last_became_peered":"2024-09-12T00:35:29.670571+0000","last_unstale":"2024-09-12T00:35:31.686791+0000","last_undegraded":"2024-09-12T00:35:31.686791+0000","last_fullsized":"2024-09-12T00:35:31.686791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:53.106651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012596770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:35:31.699143+0000","last_change":"2024-09-12T00:35:31.699143+0000","last_active":"2024-09-12T00:35:31.699143+0000","last_peered":"2024-09-12T00:35:31.699143+0000","last_clean":"2024-09-12T00:35:31.699143+0000","last_became_active":"2024-09-12T00:35:29.671727+0000","last_became_peered":"2024-09-12T00:35:29.671727+0000","last_unstale":"2024-09-12T00:35:31.699143+0000","last_undegraded":"2024-09-12T00:35:31.699143+0000","last_fullsized":"2024-09-12T00:35:31.699143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:24.616311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010553139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:35:31.861538+0000","last_change":"2024-09-12T00:35:31.861538+0000","last_active":"2024-09-12T00:35:31.861538+0000","last_peered":"2024-09-12T00:35:31.861538+0000","last_clean":"2024-09-12T00:35:31.861538+0000","last_became_active":"2024-09-12T00:35:29.697973+0000","last_became_peered":"2024-09-12T00:35:29.697973+0000","last_unstale":"2024-09-12T00:35:31.861538+0000","last_undegraded":"2024-09-12T00:35:31.861538+0000","last_fullsized":"2024-09-12T00:35:31.861538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:08.455168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083354399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:35:31.699054+0000","last_change":"2024-09-12T00:35:31.699054+0000","last_active":"2024-09-12T00:35:31.699054+0000","last_peered":"2024-09-12T00:35:31.699054+0000","last_clean":"2024-09-12T00:35:31.699054+0000","last_became_active":"2024-09-12T00:35:29.700869+0000","last_became_peered":"2024-09-12T00:35:29.700869+0000","last_unstale":"2024-09-12T00:35:31.699054+0000","last_undegraded":"2024-09-12T00:35:31.699054+0000","last_fullsized":"2024-09-12T00:35:31.699054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:14.134437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099003299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:35:31.694495+0000","last_change":"2024-09-12T00:35:31.692803+0000","last_active":"2024-09-12T00:35:31.694495+0000","last_peered":"2024-09-12T00:35:31.694495+0000","last_clean":"2024-09-12T00:35:31.694495+0000","last_became_active":"2024-09-12T00:35:29.664963+0000","last_became_peered":"2024-09-12T00:35:29.664963+0000","last_unstale":"2024-09-12T00:35:31.694495+0000","last_undegraded":"2024-09-12T00:35:31.694495+0000","last_fullsized":"2024-09-12T00:35:31.694495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:27.056845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020842569999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:35:31.904089+0000","last_change":"2024-09-12T00:35:31.904599+0000","last_active":"2024-09-12T00:35:31.904089+0000","last_peered":"2024-09-12T00:35:31.904089+0000","last_clean":"2024-09-12T00:35:31.904089+0000","last_became_active":"2024-09-12T00:35:29.699432+0000","last_became_peered":"2024-09-12T00:35:29.699432+0000","last_unstale":"2024-09-12T00:35:31.904089+0000","last_undegraded":"2024-09-12T00:35:31.904089+0000","last_fullsized":"2024-09-12T00:35:31.904089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:03.035417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099979400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:35:31.861888+0000","last_change":"2024-09-12T00:35:31.861888+0000","last_active":"2024-09-12T00:35:31.861888+0000","last_peered":"2024-09-12T00:35:31.861888+0000","last_clean":"2024-09-12T00:35:31.861888+0000","last_became_active":"2024-09-12T00:35:29.671287+0000","last_became_peered":"2024-09-12T00:35:29.671287+0000","last_unstale":"2024-09-12T00:35:31.861888+0000","last_undegraded":"2024-09-12T00:35:31.861888+0000","last_fullsized":"2024-09-12T00:35:31.861888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:47.739072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075002000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:35:31.691879+0000","last_change":"2024-09-12T00:35:31.691879+0000","last_active":"2024-09-12T00:35:31.691879+0000","last_peered":"2024-09-12T00:35:31.691879+0000","last_clean":"2024-09-12T00:35:31.691879+0000","last_became_active":"2024-09-12T00:35:29.668145+0000","last_became_peered":"2024-09-12T00:35:29.668145+0000","last_unstale":"2024-09-12T00:35:31.691879+0000","last_undegraded":"2024-09-12T00:35:31.691879+0000","last_fullsized":"2024-09-12T00:35:31.691879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:18.650004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011070749999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:35:31.860588+0000","last_change":"2024-09-12T00:35:25.098793+0000","last_active":"2024-09-12T00:35:31.860588+0000","last_peered":"2024-09-12T00:35:31.860588+0000","last_clean":"2024-09-12T00:35:31.860588+0000","last_became_active":"2024-09-12T00:35:25.096843+0000","last_became_peered":"2024-09-12T00:35:25.096843+0000","last_unstale":"2024-09-12T00:35:31.860588+0000","last_undegraded":"2024-09-12T00:35:31.860588+0000","last_fullsized":"2024-09-12T00:35:31.860588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:23.614097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:23.614097+0000","last_clean_scrub_stamp":"2024-09-12T00:35:23.614097+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:42.023728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":75827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":75808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":225280,"data_stored":75827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":815104,"data_stored":666176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":666176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":75808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":75808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":75808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:35:37.818 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T00:35:37.818 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T00:35:37.818 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T00:35:37.818 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T00:35:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:35:38.135 INFO:teuthology.orchestra.run.smithi070.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T00:35:38.152 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T00:35:38.153 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-12T00:35:38.166 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-09-12T00:35:38.166 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-12T00:35:38.171 DEBUG:teuthology.orchestra.run.smithi070:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-09-12T00:35:38.614 INFO:teuthology.orchestra.run.smithi070.stderr:........+.+........+.+.....+....+...+..+...+...+......+......+...+..........+......+........+.+..+.......+........+...+.+...+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+.....+.+.....+.+......+.........+......+.........+...+...............+...+...+..............+.............+...+......+...................................+......+...+.+........................+.........+......+..+.......+........+...+.......+..+.....................+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T00:35:39.087 INFO:teuthology.orchestra.run.smithi070.stderr:...........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+.......+..................+..+.+..+....+...+........+..........+...+..+.......+...+...+.....+......+.+...+.....+....+.....+...+....+......+..............+.+..+.+..+......................+.....+.+.........+..+...+.......+........+...+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...............+.......+...+........+...+....+........+...+............+....+.........+............+..................+...........+.........................+.........+..+.............+..+.............+..+...+.+...+...+..+.+...........+.........+.+.......................+......+.......+...+..+.............+.....................+......+.....+.................................+.+........+......+....+..+....+..+.......+..+..........+...+.....+......+....+...........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T00:35:39.102 INFO:teuthology.orchestra.run.smithi070.stderr:----- 2024-09-12T00:35:39.111 DEBUG:teuthology.orchestra.run.smithi070:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/local/share/ca-certificates/root.crt 2024-09-12T00:35:39.183 DEBUG:teuthology.orchestra.run.smithi070:> sudo update-ca-certificates 2024-09-12T00:35:39.242 INFO:teuthology.orchestra.run.smithi070.stdout:Updating certificates in /etc/ssl/certs... 2024-09-12T00:35:39.833 INFO:teuthology.orchestra.run.smithi070.stderr:rehash: warning: skipping ca-certificates.crt,it does not contain exactly one certificate or CRL 2024-09-12T00:35:39.854 INFO:teuthology.orchestra.run.smithi070.stdout:1 added, 0 removed; done. 2024-09-12T00:35:39.862 INFO:teuthology.orchestra.run.smithi070.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-09-12T00:35:39.865 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:35:41.369 INFO:teuthology.orchestra.run.smithi070.stdout:Adding debian:root.pem 2024-09-12T00:35:41.393 INFO:teuthology.orchestra.run.smithi070.stdout:done. 2024-09-12T00:35:41.394 INFO:teuthology.orchestra.run.smithi070.stdout:done. 2024-09-12T00:35:41.398 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-12T00:35:41.445 DEBUG:teuthology.orchestra.run.smithi070:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi070.front.sepia.ceph.com 2024-09-12T00:35:41.734 INFO:teuthology.orchestra.run.smithi070.stderr:...+.......+..+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..........+........+....+...+......+......+.....+......+.........+.+..............+....+...........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+..........+......+.....+.............+..+...+......+..........+...+..+......+.......+...+..+.............+...+......+......+...+............+..+...+.........+.........+.........................+......+...+...+..+...+....+...+...+..+......+......+....+..+...+....+..+..........+.....+....+.....+....+..+...+.+......+.....+......+............+............+.+..+.+.....+......+...+...+..........+........+.+...+...+.....+.............+..+..............................+...+.+...+..+...+............+....+..............+.......+.........+.........+.....+..........+..+.............+...+.........+........+......+.+...........+...+.........+.......+.....+................+..+.+..............+.+.....+.+.........+............+...+......+........+.+..............+......+.+...+..+.........+.......+.........+..............+.+......+..+...+...+....+...+...+......+......+..+.+..+...+.........+......+......+......+.........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T00:35:41.824 INFO:teuthology.orchestra.run.smithi070.stderr:.+.....+.+........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+.............+.....+.......+...+..+....+.....+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.................+.+...+.....+.+.....+....+......+...+..+.+........+..........+..+.......+..+...+..........+..+...+...............+.............+...+......+......+........+....+..+......+.......+......+.....+.........+.+..+.........+......+..........+..+.+......+........+......+..........+..+...+....+........+...+.+...+...+.....+.........+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T00:35:41.827 INFO:teuthology.orchestra.run.smithi070.stderr:----- 2024-09-12T00:35:41.830 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:35:41.830 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T00:35:41.879 DEBUG:teuthology.orchestra.run.smithi070:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T00:35:41.927 INFO:teuthology.orchestra.run.smithi070.stderr:Certificate request self-signature ok 2024-09-12T00:35:41.928 INFO:teuthology.orchestra.run.smithi070.stderr:subject=CN = smithi070.front.sepia.ceph.com 2024-09-12T00:35:41.940 DEBUG:teuthology.orchestra.run.smithi070:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T00:35:41.989 DEBUG:teuthology.orchestra.run.smithi070:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-12T00:35:42.041 INFO:teuthology.orchestra.run.smithi070.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-09-12T00:35:42.041 DEBUG:teuthology.orchestra.run.smithi070:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-12T00:35:42.090 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T00:35:42.103 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0'}} 2024-09-12T00:35:42.103 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T00:35:42.103 INFO:tasks.rgw:Creating data pools 2024-09-12T00:35:42.104 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T00:35:42.104 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-12T00:35:42.897 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T00:35:42.926 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T00:35:43.908 INFO:teuthology.orchestra.run.smithi070.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T00:35:43.955 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T00:35:44.899 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T00:35:44.933 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T00:35:45.911 INFO:teuthology.orchestra.run.smithi070.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T00:35:45.961 DEBUG:tasks.rgw:Pools created 2024-09-12T00:35:45.961 INFO:tasks.rgw:Configuring compression type = random 2024-09-12T00:35:45.961 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:35:45.962 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:35:45.962 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:35:46.013 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:46.013 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:47.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:47.997+0000 7fef31c27640 0 -- 172.21.15.70:0/2877067828 >> [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] conn(0x7fee040709f0 msgr2=0x7fee04072eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:48.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.005+0000 7fef339209c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.005+0000 7fef30c25640 0 -- 172.21.15.70:0/4501045 >> [v2:172.21.15.70:6816/1979013808,v1:172.21.15.70:6817/1979013808] conn(0x55e42cb04b90 msgr2=0x55e42cb07000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:48.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.209+0000 7fef339209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:48.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.209+0000 7fef339209c0 20 realm 2024-09-12T00:35:48.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.209+0000 7fef339209c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.209+0000 7fef339209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:48.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.209+0000 7fef339209c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:48.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.209+0000 7fef339209c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.209+0000 7fef339209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:48.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.209+0000 7fef339209c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.213+0000 7fef339209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:48.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.213+0000 7fef339209c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.217+0000 7fef339209c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:35:48.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.217+0000 7fef339209c0 20 searching for the correct realm 2024-09-12T00:35:48.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.245+0000 7fef339209c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:48.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.245+0000 7fef339209c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:35:48.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.245+0000 7fef339209c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:48.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.245+0000 7fef339209c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:35:48.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.245+0000 7fef339209c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:48.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.245+0000 7fef339209c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:48.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.245+0000 7fef339209c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.245+0000 7fef339209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:48.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.245+0000 7fef339209c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.245+0000 7fef339209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:48.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.249+0000 7fef339209c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.249+0000 7fef339209c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:35:48.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.249+0000 7fef339209c0 20 zone default found 2024-09-12T00:35:48.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.249+0000 7fef339209c0 4 Realm: () 2024-09-12T00:35:48.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.249+0000 7fef339209c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:35:48.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.249+0000 7fef339209c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:35:48.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.249+0000 7fef339209c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:48.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.249+0000 7fef339209c0 20 zonegroup default 2024-09-12T00:35:48.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.249+0000 7fef339209c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.249+0000 7fef339209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:48.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:48.249+0000 7fef339209c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:49.941+0000 7fef339209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:49.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:49.941+0000 7fef339209c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:49.953+0000 7fef339209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:49.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:49.953+0000 7fef339209c0 20 started sync module instance, tier type = 2024-09-12T00:35:49.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:49.953+0000 7fef339209c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:35:51.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.001+0000 7fef339209c0 20 add_watcher() i=0 2024-09-12T00:35:52.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.001+0000 7fef339209c0 20 add_watcher() i=1 2024-09-12T00:35:52.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.001+0000 7fef339209c0 20 add_watcher() i=2 2024-09-12T00:35:52.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.001+0000 7fef339209c0 20 add_watcher() i=3 2024-09-12T00:35:52.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.001+0000 7fef339209c0 20 add_watcher() i=4 2024-09-12T00:35:52.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.001+0000 7fef339209c0 20 add_watcher() i=5 2024-09-12T00:35:52.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.001+0000 7fef339209c0 20 add_watcher() i=6 2024-09-12T00:35:52.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.005+0000 7fef339209c0 20 add_watcher() i=7 2024-09-12T00:35:52.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.005+0000 7fef339209c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:52.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.005+0000 7fef339209c0 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-12T00:35:52.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.005+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-12T00:35:52.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.005+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.005+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-12T00:35:52.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.005+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-12T00:35:52.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.005+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.005+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-12T00:35:52.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.005+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-12T00:35:52.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.005+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.005+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-12T00:35:52.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.005+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-12T00:35:52.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.005+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.005+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-12T00:35:52.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.005+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-12T00:35:52.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.005+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.005+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-12T00:35:52.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.005+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-12T00:35:52.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.005+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.009+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-12T00:35:52.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.009+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-12T00:35:52.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.009+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.009+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-12T00:35:52.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.009+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-12T00:35:52.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.009+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.009+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-12T00:35:52.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.009+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-12T00:35:52.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.009+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.009+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-12T00:35:52.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.009+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-12T00:35:52.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.009+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.009+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-12T00:35:52.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.009+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-12T00:35:52.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.009+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.009+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-12T00:35:52.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.009+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-12T00:35:52.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.009+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.009+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-12T00:35:52.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.009+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-12T00:35:52.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.009+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.013+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-12T00:35:52.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.013+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-12T00:35:52.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.013+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.013+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-12T00:35:52.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.013+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-12T00:35:52.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.013+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.013+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-12T00:35:52.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.013+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-12T00:35:52.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.013+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.013+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-12T00:35:52.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.013+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-12T00:35:52.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.013+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.013+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-12T00:35:52.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.013+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-12T00:35:52.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.013+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.013+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-12T00:35:52.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.013+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-12T00:35:52.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.013+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.013+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-12T00:35:52.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.013+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-12T00:35:52.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.013+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.017+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-12T00:35:52.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.017+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-12T00:35:52.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.017+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.017+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-12T00:35:52.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.017+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-12T00:35:52.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.017+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.017+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-12T00:35:52.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.017+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-12T00:35:52.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.017+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.017+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-12T00:35:52.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.017+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-12T00:35:52.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.017+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.017+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-12T00:35:52.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.017+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-12T00:35:52.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.017+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.017+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-12T00:35:52.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.017+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-12T00:35:52.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.017+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.021+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-12T00:35:52.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.021+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-12T00:35:52.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.021+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.021+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-12T00:35:52.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.021+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-12T00:35:52.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.021+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.021+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-12T00:35:52.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.021+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-12T00:35:52.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.021+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.021+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-12T00:35:52.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.021+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-12T00:35:52.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.021+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.021+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-12T00:35:52.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.021+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-12T00:35:52.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.021+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.021+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-12T00:35:52.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.021+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-12T00:35:52.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.021+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.021+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-12T00:35:52.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.021+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-12T00:35:52.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.021+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.025+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-12T00:35:52.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.025+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-12T00:35:52.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.025+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.025+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-12T00:35:52.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.025+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-12T00:35:52.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.025+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.025+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-12T00:35:52.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.025+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-12T00:35:52.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.025+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.025+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-12T00:35:52.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.025+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-12T00:35:52.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.025+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.025+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-12T00:35:52.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.025+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-12T00:35:52.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.025+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.025+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-12T00:35:52.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.025+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-12T00:35:52.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.025+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.025+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-12T00:35:52.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.025+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-12T00:35:52.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.025+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.029+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-12T00:35:52.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.029+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-12T00:35:52.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.029+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.029+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-12T00:35:52.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.029+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-12T00:35:52.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.029+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.029+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-12T00:35:52.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.029+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-12T00:35:52.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.029+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.029+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-12T00:35:52.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.029+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-12T00:35:52.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.029+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.029+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-12T00:35:52.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.029+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-12T00:35:52.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.029+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.029+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-12T00:35:52.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.029+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-12T00:35:52.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.029+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.029+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-12T00:35:52.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.029+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-12T00:35:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.029+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.029+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-12T00:35:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.029+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-12T00:35:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.029+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.033+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-12T00:35:52.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.033+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-12T00:35:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.033+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.033+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-12T00:35:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.033+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-12T00:35:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.033+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.033+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-12T00:35:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.033+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-12T00:35:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.033+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.033+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-12T00:35:52.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.033+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-12T00:35:52.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.033+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.033+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-12T00:35:52.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.033+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-12T00:35:52.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.033+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.033+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-12T00:35:52.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.033+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-12T00:35:52.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.033+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.033+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-12T00:35:52.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.033+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-12T00:35:52.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.033+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.033+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-12T00:35:52.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.033+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-12T00:35:52.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.033+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.037+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-12T00:35:52.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.037+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-12T00:35:52.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.037+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.037+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-12T00:35:52.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.037+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-12T00:35:52.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.037+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.037+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-12T00:35:52.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.037+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-12T00:35:52.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.037+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.037+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-12T00:35:52.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.037+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-12T00:35:52.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.037+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.037+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-12T00:35:52.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.037+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-12T00:35:52.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.037+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.037+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-12T00:35:52.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.037+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-12T00:35:52.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.037+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.037+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-12T00:35:52.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.037+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-12T00:35:52.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.037+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.041+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-12T00:35:52.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.041+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-12T00:35:52.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.041+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.041+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-12T00:35:52.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.041+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-12T00:35:52.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.041+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.041+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-12T00:35:52.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.041+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-12T00:35:52.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.041+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.041+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-12T00:35:52.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.041+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-12T00:35:52.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.041+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.041+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-12T00:35:52.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.041+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-12T00:35:52.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.041+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.041+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-12T00:35:52.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.041+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-12T00:35:52.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.041+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.041+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-12T00:35:52.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.041+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-12T00:35:52.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.041+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.041+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-12T00:35:52.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.041+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-12T00:35:52.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.041+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.045+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-12T00:35:52.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.045+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-12T00:35:52.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.045+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.045+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-12T00:35:52.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.045+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-12T00:35:52.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.045+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.045+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-12T00:35:52.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.045+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-12T00:35:52.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.045+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.045+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-12T00:35:52.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.045+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-12T00:35:52.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.045+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.045+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-12T00:35:52.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.045+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-12T00:35:52.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.045+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.045+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-12T00:35:52.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.045+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-12T00:35:52.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.045+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.045+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-12T00:35:52.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.045+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-12T00:35:52.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.045+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.045+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-12T00:35:52.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.045+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-12T00:35:52.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.045+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.049+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-12T00:35:52.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.049+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-12T00:35:52.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.049+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.049+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-12T00:35:52.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.049+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-12T00:35:52.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.049+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.049+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-12T00:35:52.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.049+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-12T00:35:52.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.049+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.049+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-12T00:35:52.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.049+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-12T00:35:52.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.049+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.049+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-12T00:35:52.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.049+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-12T00:35:52.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.049+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.049+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-12T00:35:52.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.049+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-12T00:35:52.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.049+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.049+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-12T00:35:52.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.049+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-12T00:35:52.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.049+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.053+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-12T00:35:52.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.053+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-12T00:35:52.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.053+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.053+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-12T00:35:52.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.053+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-12T00:35:52.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.053+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.053+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-12T00:35:52.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.053+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-12T00:35:52.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.053+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.053+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-12T00:35:52.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.053+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-12T00:35:52.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.053+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.053+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-12T00:35:52.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.053+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-12T00:35:52.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.053+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.053+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-12T00:35:52.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.053+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-12T00:35:52.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.053+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.053+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-12T00:35:52.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.053+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-12T00:35:52.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.053+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.053+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-12T00:35:52.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.053+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-12T00:35:52.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.053+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.057+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-12T00:35:52.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.057+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-12T00:35:52.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.057+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.057+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-12T00:35:52.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.057+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-12T00:35:52.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.057+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.057+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-12T00:35:52.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.057+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-12T00:35:52.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.057+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.057+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-12T00:35:52.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.057+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-12T00:35:52.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.057+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.057+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-12T00:35:52.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.057+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-12T00:35:52.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.057+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.057+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-12T00:35:52.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.057+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-12T00:35:52.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.057+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.057+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-12T00:35:52.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.057+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-12T00:35:52.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.057+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.061+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-12T00:35:52.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.061+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-12T00:35:52.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.061+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.061+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-12T00:35:52.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.061+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-12T00:35:52.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.061+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.061+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-12T00:35:52.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.061+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-12T00:35:52.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.061+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.061+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-12T00:35:52.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.061+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-12T00:35:52.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.061+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.061+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-12T00:35:52.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.061+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-12T00:35:52.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.061+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.061+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-12T00:35:52.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.061+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-12T00:35:52.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.061+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.065+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-12T00:35:52.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.065+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-12T00:35:52.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.065+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.065+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-12T00:35:52.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.065+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-12T00:35:52.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.065+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.065+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-12T00:35:52.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.065+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-12T00:35:52.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.065+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.065+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-12T00:35:52.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.065+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-12T00:35:52.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.065+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.065+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-12T00:35:52.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.065+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-12T00:35:52.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.065+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.065+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-12T00:35:52.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.065+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-12T00:35:52.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.065+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.065+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-12T00:35:52.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.065+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-12T00:35:52.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.065+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.069+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-12T00:35:52.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.069+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-12T00:35:52.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.069+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.069+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-12T00:35:52.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.069+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-12T00:35:52.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.069+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.069+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-12T00:35:52.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.069+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-12T00:35:52.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.069+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.069+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-12T00:35:52.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.069+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-12T00:35:52.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.069+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.069+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-12T00:35:52.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.069+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-12T00:35:52.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.069+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.069+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-12T00:35:52.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.069+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-12T00:35:52.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.069+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.069+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-12T00:35:52.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.069+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-12T00:35:52.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.069+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.073+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-12T00:35:52.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.073+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-12T00:35:52.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.073+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.073+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-12T00:35:52.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.073+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-12T00:35:52.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.073+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.073+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-12T00:35:52.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.073+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-12T00:35:52.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.073+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.073+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-12T00:35:52.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.073+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-12T00:35:52.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.073+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.073+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-12T00:35:52.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.073+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-12T00:35:52.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.073+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.073+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-12T00:35:52.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.073+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-12T00:35:52.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.073+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.073+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-12T00:35:52.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.073+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-12T00:35:52.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.073+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.077+0000 7fef339209c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-12T00:35:52.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.077+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-12T00:35:52.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.077+0000 7fef339209c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:35:52.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.085+0000 7fede37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:52.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.085+0000 7fef339209c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:52.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:52.085+0000 7fef339209c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:54.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:54.968+0000 7fef339209c0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-12T00:35:54.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:54.968+0000 7fef339209c0 5 note: GC not initialized 2024-09-12T00:35:55.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.060+0000 7fede27e4640 20 reqs_thread_entry: start 2024-09-12T00:35:55.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.060+0000 7fef339209c0 20 init_complete bucket index max shards: 1 2024-09-12T00:35:55.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.060+0000 7fef339209c0 20 Filter name: none 2024-09-12T00:35:55.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.060+0000 7fed43fff640 20 reqs_thread_entry: start 2024-09-12T00:35:55.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.104+0000 7fede37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:55.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.112+0000 7fef339209c0 20 remove_watcher() i=0 2024-09-12T00:35:55.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.112+0000 7fef339209c0 2 removed watcher, disabling cache 2024-09-12T00:35:55.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.112+0000 7fef339209c0 20 remove_watcher() i=1 2024-09-12T00:35:55.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.116+0000 7fef339209c0 20 remove_watcher() i=2 2024-09-12T00:35:55.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.124+0000 7fef339209c0 20 remove_watcher() i=3 2024-09-12T00:35:55.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.124+0000 7fef339209c0 20 remove_watcher() i=4 2024-09-12T00:35:55.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.128+0000 7fef339209c0 20 remove_watcher() i=5 2024-09-12T00:35:55.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.128+0000 7fef339209c0 20 remove_watcher() i=6 2024-09-12T00:35:55.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.132+0000 7fef339209c0 20 remove_watcher() i=7 2024-09-12T00:35:55.148 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T00:35:55.149 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:35:55.149 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T00:35:55.149 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T00:35:55.149 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-12T00:35:55.190 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:55.190 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:55.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.220+0000 7f27efbe39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:55.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.220+0000 7f27efbe39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:55.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.224+0000 7f262b7fe640 20 reqs_thread_entry: start 2024-09-12T00:35:55.242 INFO:teuthology.orchestra.run.smithi070.stdout:{"id":"81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T00:35:55.243 DEBUG:tasks.util.rgw: json result: {'id': '81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T00:35:55.243 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:35:55.243 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:35:55.243 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:35:55.315 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:55.315 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:55.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.352+0000 7f3776a5c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:55.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.356+0000 7f3776a5c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:55.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.356+0000 7f3776a5c9c0 20 realm 2024-09-12T00:35:55.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.356+0000 7f3776a5c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:55.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.356+0000 7f3776a5c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:55.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.356+0000 7f3776a5c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:55.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.356+0000 7f3776a5c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:55.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.356+0000 7f3776a5c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:55.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.356+0000 7f3776a5c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:55.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.356+0000 7f3776a5c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:55.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.356+0000 7f3776a5c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:55.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.356+0000 7f3776a5c9c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T00:35:55.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.356+0000 7f3776a5c9c0 20 searching for the correct realm 2024-09-12T00:35:55.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.360+0000 7f3774d63640 0 -- 172.21.15.70:0/1423836466 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f37680eba70 msgr2=0x7f37680ea4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:55.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.368+0000 7f3774d63640 0 -- 172.21.15.70:0/1423836466 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f363c07dbe0 msgr2=0x7f363c07ffd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:55.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.376+0000 7f3776a5c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:55.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.376+0000 7f3776a5c9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:35:55.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.376+0000 7f3776a5c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:55.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.376+0000 7f3776a5c9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:35:55.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.376+0000 7f3776a5c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:55.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.376+0000 7f3776a5c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:55.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.376+0000 7f3776a5c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:55.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.376+0000 7f3776a5c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:55.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.376+0000 7f3776a5c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:55.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.376+0000 7f3776a5c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:55.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.376+0000 7f3776a5c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:55.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.376+0000 7f3776a5c9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:35:55.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.376+0000 7f3776a5c9c0 20 zone default found 2024-09-12T00:35:55.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.376+0000 7f3776a5c9c0 4 Realm: () 2024-09-12T00:35:55.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.376+0000 7f3776a5c9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:35:55.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.376+0000 7f3776a5c9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:35:55.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.376+0000 7f3776a5c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:55.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.376+0000 7f3776a5c9c0 20 zonegroup default 2024-09-12T00:35:55.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.376+0000 7f3776a5c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:55.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.376+0000 7f3776a5c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:55.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.376+0000 7f3776a5c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:55.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.380+0000 7f3776a5c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:55.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.380+0000 7f3776a5c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:55.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.380+0000 7f3776a5c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:55.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.380+0000 7f3776a5c9c0 20 started sync module instance, tier type = 2024-09-12T00:35:55.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.380+0000 7f3776a5c9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:35:55.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.396+0000 7f3776a5c9c0 20 add_watcher() i=0 2024-09-12T00:35:55.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.396+0000 7f3776a5c9c0 20 add_watcher() i=1 2024-09-12T00:35:55.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.396+0000 7f3776a5c9c0 20 add_watcher() i=2 2024-09-12T00:35:55.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.396+0000 7f3776a5c9c0 20 add_watcher() i=3 2024-09-12T00:35:55.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.396+0000 7f3776a5c9c0 20 add_watcher() i=4 2024-09-12T00:35:55.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.396+0000 7f3776a5c9c0 20 add_watcher() i=5 2024-09-12T00:35:55.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.396+0000 7f3776a5c9c0 20 add_watcher() i=6 2024-09-12T00:35:55.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.396+0000 7f3776a5c9c0 20 add_watcher() i=7 2024-09-12T00:35:55.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.396+0000 7f3776a5c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:55.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.400+0000 7f362afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:55.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.400+0000 7f3776a5c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:55.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.400+0000 7f3776a5c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:55.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.400+0000 7f3776a5c9c0 5 note: GC not initialized 2024-09-12T00:35:55.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.400+0000 7f3629fdb640 20 reqs_thread_entry: start 2024-09-12T00:35:55.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.400+0000 7f3776a5c9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:35:55.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.400+0000 7f3776a5c9c0 20 Filter name: none 2024-09-12T00:35:55.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.400+0000 7f359b7fe640 20 reqs_thread_entry: start 2024-09-12T00:35:55.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.416+0000 7f362afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:55.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.420+0000 7f3776a5c9c0 20 remove_watcher() i=0 2024-09-12T00:35:55.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.420+0000 7f3776a5c9c0 2 removed watcher, disabling cache 2024-09-12T00:35:55.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.424+0000 7f3776a5c9c0 20 remove_watcher() i=1 2024-09-12T00:35:55.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.424+0000 7f3776a5c9c0 20 remove_watcher() i=2 2024-09-12T00:35:55.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.428+0000 7f3776a5c9c0 20 remove_watcher() i=3 2024-09-12T00:35:55.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.428+0000 7f3776a5c9c0 20 remove_watcher() i=4 2024-09-12T00:35:55.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.432+0000 7f3776a5c9c0 20 remove_watcher() i=5 2024-09-12T00:35:55.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.432+0000 7f3776a5c9c0 20 remove_watcher() i=6 2024-09-12T00:35:55.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.432+0000 7f3776a5c9c0 20 remove_watcher() i=7 2024-09-12T00:35:55.446 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T00:35:55.447 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:35:55.447 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T00:35:55.447 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T00:35:55.448 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-12T00:35:55.530 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:55.530 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:55.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.560+0000 7f21d446d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:55.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.560+0000 7f21d446d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:55.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.564+0000 7f2007fff640 20 reqs_thread_entry: start 2024-09-12T00:35:55.585 INFO:teuthology.orchestra.run.smithi070.stdout:{"id":"81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:35:55.586 DEBUG:tasks.util.rgw: json result: {'id': '81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:35:55.586 INFO:tasks.rgw:Preparing directory for rgw datacache at /tmp/rgw_datacache 2024-09-12T00:35:55.587 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p /tmp/rgw_datacache 2024-09-12T00:35:55.634 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a+rwx /tmp/rgw_datacache 2024-09-12T00:35:55.698 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:35:55.698 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:35:55.698 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:35:55.776 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:55.776 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:55.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.816+0000 7f52ac8849c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:55.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.820+0000 7f52ac8849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:55.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.820+0000 7f52ac8849c0 20 realm 2024-09-12T00:35:55.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.820+0000 7f52ac8849c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:55.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.820+0000 7f52ac8849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:55.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.820+0000 7f52ac8849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:55.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.820+0000 7f52ac8849c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:55.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.820+0000 7f52ac8849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:55.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.820+0000 7f52ac8849c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:55.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.820+0000 7f52ac8849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:55.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.820+0000 7f52ac8849c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:55.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.824+0000 7f52ac8849c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T00:35:55.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.824+0000 7f52ac8849c0 20 searching for the correct realm 2024-09-12T00:35:55.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.824+0000 7f52aa38a640 0 -- 172.21.15.70:0/4027274242 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f52a40bb070 msgr2=0x7f52a40f8cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:55.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:55.828+0000 7f52aa38a640 0 -- 172.21.15.70:0/4027274242 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f52a40ae040 msgr2=0x7f52a40ff9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:56.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.052+0000 7f52ac8849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:56.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.052+0000 7f52ac8849c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:35:56.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.052+0000 7f52ac8849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:56.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.052+0000 7f52ac8849c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:35:56.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.052+0000 7f52ac8849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:56.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.052+0000 7f52ac8849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:56.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.052+0000 7f52ac8849c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:56.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.052+0000 7f52ac8849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:56.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.052+0000 7f52ac8849c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:56.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.052+0000 7f52ac8849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:56.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.052+0000 7f52ac8849c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:56.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.056+0000 7f52ac8849c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:35:56.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.056+0000 7f52ac8849c0 20 zone default found 2024-09-12T00:35:56.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.056+0000 7f52ac8849c0 4 Realm: () 2024-09-12T00:35:56.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.056+0000 7f52ac8849c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:35:56.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.056+0000 7f52ac8849c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:35:56.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.056+0000 7f52ac8849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:56.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.056+0000 7f52ac8849c0 20 zonegroup default 2024-09-12T00:35:56.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.056+0000 7f52ac8849c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:56.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.056+0000 7f52ac8849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:56.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.056+0000 7f52ac8849c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:56.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.056+0000 7f52ac8849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:56.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.056+0000 7f52ac8849c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:56.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.056+0000 7f52ac8849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:56.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.056+0000 7f52ac8849c0 20 started sync module instance, tier type = 2024-09-12T00:35:56.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.056+0000 7f52ac8849c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:35:56.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.084+0000 7f52ac8849c0 20 add_watcher() i=0 2024-09-12T00:35:56.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.084+0000 7f52ac8849c0 20 add_watcher() i=1 2024-09-12T00:35:56.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.084+0000 7f52ac8849c0 20 add_watcher() i=2 2024-09-12T00:35:56.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.084+0000 7f52ac8849c0 20 add_watcher() i=3 2024-09-12T00:35:56.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.084+0000 7f52ac8849c0 20 add_watcher() i=4 2024-09-12T00:35:56.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.084+0000 7f52ac8849c0 20 add_watcher() i=5 2024-09-12T00:35:56.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.084+0000 7f52ac8849c0 20 add_watcher() i=6 2024-09-12T00:35:56.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.084+0000 7f52ac8849c0 20 add_watcher() i=7 2024-09-12T00:35:56.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.084+0000 7f52ac8849c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:56.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.088+0000 7f5160fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:56.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.088+0000 7f52ac8849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:56.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.088+0000 7f52ac8849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:56.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.088+0000 7f52ac8849c0 5 note: GC not initialized 2024-09-12T00:35:56.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.088+0000 7f50db7fe640 20 reqs_thread_entry: start 2024-09-12T00:35:56.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.092+0000 7f52ac8849c0 20 init_complete bucket index max shards: 1 2024-09-12T00:35:56.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.092+0000 7f52ac8849c0 20 Filter name: none 2024-09-12T00:35:56.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.092+0000 7f50d97fa640 20 reqs_thread_entry: start 2024-09-12T00:35:56.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.112+0000 7f5160fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:56.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.116+0000 7f52ac8849c0 20 remove_watcher() i=0 2024-09-12T00:35:56.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.116+0000 7f52ac8849c0 2 removed watcher, disabling cache 2024-09-12T00:35:56.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.120+0000 7f52ac8849c0 20 remove_watcher() i=1 2024-09-12T00:35:56.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.120+0000 7f52ac8849c0 20 remove_watcher() i=2 2024-09-12T00:35:56.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.124+0000 7f52ac8849c0 20 remove_watcher() i=3 2024-09-12T00:35:56.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.128+0000 7f52ac8849c0 20 remove_watcher() i=4 2024-09-12T00:35:56.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.128+0000 7f52ac8849c0 20 remove_watcher() i=5 2024-09-12T00:35:56.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.128+0000 7f52ac8849c0 20 remove_watcher() i=6 2024-09-12T00:35:56.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.132+0000 7f52ac8849c0 20 remove_watcher() i=7 2024-09-12T00:35:56.153 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T00:35:56.153 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:35:56.154 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-12T00:35:56.154 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T00:35:56.154 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T00:35:56.154 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-12T00:35:56.241 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:56.241 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:56.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.272+0000 7f977e5c39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:56.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.272+0000 7f977e5c39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:56.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.276+0000 7f95ca7fc640 20 reqs_thread_entry: start 2024-09-12T00:35:56.292 INFO:teuthology.orchestra.run.smithi070.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-12T00:35:56.292 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-12T00:35:56.292 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T00:35:56.293 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T00:35:56.293 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-12T00:35:56.372 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:56.372 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:56.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.400+0000 7fda9c2729c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:56.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.400+0000 7fda9c2729c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:56.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.404+0000 7fd95cfe1640 20 reqs_thread_entry: start 2024-09-12T00:35:56.423 INFO:teuthology.orchestra.run.smithi070.stdout:{"id":"81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:35:56.423 DEBUG:tasks.util.rgw: json result: {'id': '81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:35:56.424 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-12T00:35:56.424 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T00:35:56.424 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T00:35:56.424 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-12T00:35:56.500 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:56.500 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:56.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.528+0000 7fcc291f89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:56.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.528+0000 7fcc291f89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:56.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.532+0000 7fcae57fa640 20 reqs_thread_entry: start 2024-09-12T00:35:56.553 INFO:teuthology.orchestra.run.smithi070.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-12T00:35:56.553 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-12T00:35:56.553 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T00:35:56.553 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T00:35:56.553 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-12T00:35:56.631 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:56.631 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:56.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.660+0000 7fc73ab089c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:56.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.660+0000 7fc73ab089c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:56.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:35:56.664+0000 7fc57e7fc640 20 reqs_thread_entry: start 2024-09-12T00:35:56.685 INFO:teuthology.orchestra.run.smithi070.stdout:{"id":"81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:35:56.685 DEBUG:tasks.util.rgw: json result: {'id': '81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:35:56.685 INFO:tasks.rgw:Starting rgw... 2024-09-12T00:35:56.685 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0'} 2024-09-12T00:35:56.686 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T00:35:56.686 DEBUG:teuthology.orchestra.run.smithi070:> sudo echo -n https://smithi070.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T00:35:56.736 INFO:teuthology.orchestra.run.smithi070.stdout:https://smithi070.front.sepia.ceph.com:443 2024-09-12T00:35:56.737 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T00:35:56.787 DEBUG:teuthology.orchestra.run.smithi070:> sudo keytool -import -alias smithi070.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-09-12T00:35:57.094 INFO:teuthology.orchestra.run.smithi070.stderr:Warning: use -cacerts option to access cacerts keystore 2024-09-12T00:35:57.560 INFO:teuthology.orchestra.run.smithi070.stderr:Certificate was added to keystore 2024-09-12T00:35:57.608 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T00:35:57.608 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T00:35:57.610 INFO:tasks.rgw.client.0:Started 2024-09-12T00:35:57.610 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi070.front.sepia.ceph.com:443/ 2024-09-12T00:35:57.611 DEBUG:teuthology.orchestra.run.smithi070:> curl https://smithi070.front.sepia.ceph.com:443/ 2024-09-12T00:35:57.633 INFO:teuthology.orchestra.run.smithi070.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:35:57.633 INFO:teuthology.orchestra.run.smithi070.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:35:57.634 INFO:teuthology.orchestra.run.smithi070.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:35:57.634 INFO:teuthology.orchestra.run.smithi070.stderr:curl: (7) Failed to connect to smithi070.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-12T00:35:57.634 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:35:58.154 INFO:tasks.rgw.client.0.smithi070.stdout:2024-09-12T00:35:58.156+0000 7efe14ac9a40 -1 ssl_private_key was not found: rgw/cert//default.key 2024-09-12T00:35:58.635 DEBUG:teuthology.orchestra.run.smithi070:> curl https://smithi070.front.sepia.ceph.com:443/ 2024-09-12T00:35:58.647 INFO:teuthology.orchestra.run.smithi070.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:35:58.647 INFO:teuthology.orchestra.run.smithi070.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:35:58.762 INFO:teuthology.orchestra.run.smithi070.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 1614 0 --:--:-- --:--:-- --:--:-- 1626 2024-09-12T00:35:58.766 INFO:teuthology.orchestra.run.smithi070.stdout:anonymous 2024-09-12T00:35:58.766 INFO:teuthology.run_tasks:Running task tox... 2024-09-12T00:35:58.776 INFO:tasks.tox:Deploying tox from pip... 2024-09-12T00:35:58.776 DEBUG:teuthology.orchestra.run.smithi070:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-12T00:36:01.851 DEBUG:teuthology.orchestra.run.smithi070:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-12T00:36:02.520 INFO:teuthology.orchestra.run.smithi070.stdout:Collecting tox==3.15.0 2024-09-12T00:36:02.627 INFO:teuthology.orchestra.run.smithi070.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-12T00:36:02.676 INFO:teuthology.orchestra.run.smithi070.stdout: ---------------------------------------- 82.1/82.1 KB 1.6 MB/s eta 0:00:00 2024-09-12T00:36:03.001 INFO:teuthology.orchestra.run.smithi070.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-12T00:36:03.020 INFO:teuthology.orchestra.run.smithi070.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-12T00:36:03.238 INFO:teuthology.orchestra.run.smithi070.stdout: ---------------------------------------- 6.0/6.0 MB 28.0 MB/s eta 0:00:00 2024-09-12T00:36:03.359 INFO:teuthology.orchestra.run.smithi070.stdout:Collecting six<2,>=1.14.0 2024-09-12T00:36:03.375 INFO:teuthology.orchestra.run.smithi070.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:36:03.485 INFO:teuthology.orchestra.run.smithi070.stdout:Collecting pluggy<1,>=0.12.0 2024-09-12T00:36:03.503 INFO:teuthology.orchestra.run.smithi070.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-12T00:36:03.600 INFO:teuthology.orchestra.run.smithi070.stdout:Collecting toml>=0.9.4 2024-09-12T00:36:03.619 INFO:teuthology.orchestra.run.smithi070.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-12T00:36:03.777 INFO:teuthology.orchestra.run.smithi070.stdout:Collecting filelock<4,>=3.0.0 2024-09-12T00:36:03.806 INFO:teuthology.orchestra.run.smithi070.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-12T00:36:03.931 INFO:teuthology.orchestra.run.smithi070.stdout:Collecting py<2,>=1.4.17 2024-09-12T00:36:03.967 INFO:teuthology.orchestra.run.smithi070.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-12T00:36:04.007 INFO:teuthology.orchestra.run.smithi070.stdout: ---------------------------------------- 98.7/98.7 KB 2.5 MB/s eta 0:00:00 2024-09-12T00:36:04.121 INFO:teuthology.orchestra.run.smithi070.stdout:Collecting packaging>=14 2024-09-12T00:36:04.140 INFO:teuthology.orchestra.run.smithi070.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-12T00:36:04.166 INFO:teuthology.orchestra.run.smithi070.stdout: ---------------------------------------- 54.0/54.0 KB 1.8 MB/s eta 0:00:00 2024-09-12T00:36:04.333 INFO:teuthology.orchestra.run.smithi070.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-12T00:36:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: Downloading platformdirs-4.3.2-py3-none-any.whl (18 kB) 2024-09-12T00:36:04.454 INFO:teuthology.orchestra.run.smithi070.stdout:Collecting distlib<1,>=0.3.7 2024-09-12T00:36:04.475 INFO:teuthology.orchestra.run.smithi070.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-12T00:36:04.511 INFO:teuthology.orchestra.run.smithi070.stdout: -------------------------------------- 468.9/468.9 KB 15.2 MB/s eta 0:00:00 2024-09-12T00:36:04.671 INFO:teuthology.orchestra.run.smithi070.stdout:Installing collected packages: distlib, toml, six, py, pluggy, platformdirs, packaging, filelock, virtualenv, tox 2024-09-12T00:36:05.644 INFO:teuthology.orchestra.run.smithi070.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-12T00:36:05.732 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:36:05.747 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:36:05.747 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:36:05.747 DEBUG:teuthology.orchestra.run.smithi070:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:36:05.752 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:36:05.753 INFO:teuthology.orchestra.run.smithi070.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:36:05.753 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:36:05.803 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:36:05.804 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:36:05.851 INFO:tasks.workunit:timeout=3h 2024-09-12T00:36:05.851 INFO:tasks.workunit:cleanup=True 2024-09-12T00:36:05.852 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:36:05.901 INFO:tasks.workunit.client.0.smithi070.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:36:48.421 INFO:tasks.workunit.client.0.smithi070.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:36:48.421 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:36:48.421 INFO:tasks.workunit.client.0.smithi070.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:36:48.421 INFO:tasks.workunit.client.0.smithi070.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:36:48.421 INFO:tasks.workunit.client.0.smithi070.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:36:48.421 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:36:48.422 INFO:tasks.workunit.client.0.smithi070.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:36:48.422 INFO:tasks.workunit.client.0.smithi070.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:36:48.422 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:36:48.422 INFO:tasks.workunit.client.0.smithi070.stderr: git switch -c 2024-09-12T00:36:48.422 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:36:48.422 INFO:tasks.workunit.client.0.smithi070.stderr:Or undo this operation with: 2024-09-12T00:36:48.422 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:36:48.422 INFO:tasks.workunit.client.0.smithi070.stderr: git switch - 2024-09-12T00:36:48.422 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:36:48.422 INFO:tasks.workunit.client.0.smithi070.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:36:48.422 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:36:48.422 INFO:tasks.workunit.client.0.smithi070.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:36:48.427 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:36:48.476 INFO:tasks.workunit.client.0.smithi070.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:36:48.479 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:36:48.479 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:36:49.257 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:36:49.337 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:36:49.398 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:36:49.400 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:36:49.400 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:36:49.445 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:36:49.448 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:36:49.448 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:36:49.499 INFO:tasks.workunit:Running workunits matching rgw/run-datacache.sh on client.0... 2024-09-12T00:36:49.501 INFO:tasks.workunit:Running workunit rgw/run-datacache.sh... 2024-09-12T00:36:49.501 DEBUG:teuthology.orchestra.run.smithi070:workunit test rgw/run-datacache.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-12T00:36:49.557 INFO:tasks.workunit.client.0.smithi070.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-12T00:36:49.558 INFO:tasks.workunit.client.0.smithi070.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:36:49.558 INFO:tasks.workunit.client.0.smithi070.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:36:52.443 INFO:tasks.workunit.client.0.smithi070.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:36:52.443 INFO:tasks.workunit.client.0.smithi070.stderr:++ deactivate nondestructive 2024-09-12T00:36:52.443 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -n '' ']' 2024-09-12T00:36:52.443 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -n '' ']' 2024-09-12T00:36:52.443 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:36:52.443 INFO:tasks.workunit.client.0.smithi070.stderr:++ hash -r 2024-09-12T00:36:52.443 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -n '' ']' 2024-09-12T00:36:52.444 INFO:tasks.workunit.client.0.smithi070.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:36:52.444 INFO:tasks.workunit.client.0.smithi070.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:36:52.444 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:36:52.444 INFO:tasks.workunit.client.0.smithi070.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:36:52.444 INFO:tasks.workunit.client.0.smithi070.stderr:++ export VIRTUAL_ENV 2024-09-12T00:36:52.444 INFO:tasks.workunit.client.0.smithi070.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:36:52.444 INFO:tasks.workunit.client.0.smithi070.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:36:52.444 INFO:tasks.workunit.client.0.smithi070.stderr:++ export PATH 2024-09-12T00:36:52.444 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -n '' ']' 2024-09-12T00:36:52.444 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -z '' ']' 2024-09-12T00:36:52.444 INFO:tasks.workunit.client.0.smithi070.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:36:52.444 INFO:tasks.workunit.client.0.smithi070.stderr:++ PS1='(rgw) ' 2024-09-12T00:36:52.444 INFO:tasks.workunit.client.0.smithi070.stderr:++ export PS1 2024-09-12T00:36:52.445 INFO:tasks.workunit.client.0.smithi070.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T00:36:52.445 INFO:tasks.workunit.client.0.smithi070.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T00:36:52.445 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:36:52.445 INFO:tasks.workunit.client.0.smithi070.stderr:++ hash -r 2024-09-12T00:36:52.445 INFO:tasks.workunit.client.0.smithi070.stderr:+ pip install pip --upgrade 2024-09-12T00:36:52.830 INFO:tasks.workunit.client.0.smithi070.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T00:36:53.075 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting pip 2024-09-12T00:36:53.184 INFO:tasks.workunit.client.0.smithi070.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:36:53.470 INFO:tasks.workunit.client.0.smithi070.stdout: ---------------------------------------- 1.8/1.8 MB 6.4 MB/s eta 0:00:00 2024-09-12T00:36:53.545 INFO:tasks.workunit.client.0.smithi070.stdout:Installing collected packages: pip 2024-09-12T00:36:53.545 INFO:tasks.workunit.client.0.smithi070.stdout: Attempting uninstall: pip 2024-09-12T00:36:53.545 INFO:tasks.workunit.client.0.smithi070.stdout: Found existing installation: pip 22.0.2 2024-09-12T00:36:53.834 INFO:tasks.workunit.client.0.smithi070.stdout: Uninstalling pip-22.0.2: 2024-09-12T00:36:53.840 INFO:tasks.workunit.client.0.smithi070.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T00:36:54.915 INFO:tasks.workunit.client.0.smithi070.stdout:Successfully installed pip-24.2 2024-09-12T00:36:54.988 INFO:tasks.workunit.client.0.smithi070.stderr:+ pip install configobj 2024-09-12T00:36:55.608 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting configobj 2024-09-12T00:36:55.660 INFO:tasks.workunit.client.0.smithi070.stdout: Downloading configobj-5.0.8-py2.py3-none-any.whl.metadata (3.4 kB) 2024-09-12T00:36:55.795 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting six (from configobj) 2024-09-12T00:36:55.821 INFO:tasks.workunit.client.0.smithi070.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:36:55.894 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading configobj-5.0.8-py2.py3-none-any.whl (36 kB) 2024-09-12T00:36:55.962 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:36:56.043 INFO:tasks.workunit.client.0.smithi070.stdout:Installing collected packages: six, configobj 2024-09-12T00:36:56.200 INFO:tasks.workunit.client.0.smithi070.stdout:Successfully installed configobj-5.0.8 six-1.16.0 2024-09-12T00:36:56.592 INFO:tasks.workunit.client.0.smithi070.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_datacache.py 2024-09-12T00:36:56.630 INFO:tasks.workunit.client.0.smithi070.stderr:DEBUG:root:datacache dir from config is: /tmp/rgw_datacache 2024-09-12T00:36:56.630 INFO:tasks.workunit.client.0.smithi070.stderr:DEBUG:root:exec_cmd(pwd) 2024-09-12T00:36:56.632 INFO:tasks.workunit.client.0.smithi070.stderr:INFO:root:command succeeded 2024-09-12T00:36:56.632 INFO:tasks.workunit.client.0.smithi070.stderr:INFO:root:b'/home/ubuntu/cephtest/mnt.0/client.0/tmp\n' 2024-09-12T00:36:56.632 INFO:tasks.workunit.client.0.smithi070.stderr:DEBUG:root:pwd is: /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:36:56.632 INFO:tasks.workunit.client.0.smithi070.stderr:DEBUG:root:exec_cmd(sudo netstat -nltp | egrep "rados|valgr") 2024-09-12T00:36:56.664 INFO:tasks.workunit.client.0.smithi070.stderr:INFO:root:command succeeded 2024-09-12T00:36:56.664 INFO:tasks.workunit.client.0.smithi070.stderr:INFO:root:b'tcp 0 0 0.0.0.0:443 0.0.0.0:* LISTEN 38374/radosgw \ntcp6 0 0 :::443 :::* LISTEN 38374/radosgw \n' 2024-09-12T00:36:56.664 INFO:tasks.workunit.client.0.smithi070.stderr:INFO:root:radosgw port: 443 2024-09-12T00:36:56.664 INFO:tasks.workunit.client.0.smithi070.stderr:INFO:root:radosgw endpoint is: 127.0.0.1 2024-09-12T00:36:56.664 INFO:tasks.workunit.client.0.smithi070.stderr:DEBUG:root:exec_cmd(dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat bs=1M count=7) 2024-09-12T00:36:56.695 INFO:tasks.workunit.client.0.smithi070.stderr:INFO:root:command succeeded 2024-09-12T00:36:56.696 INFO:tasks.workunit.client.0.smithi070.stderr:INFO:root:b'' 2024-09-12T00:36:56.696 INFO:tasks.workunit.client.0.smithi070.stderr:DEBUG:root:exec_cmd(radosgw-admin user create --uid rgw_datacache_user --display-name DatacacheUser --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn) 2024-09-12T00:36:56.857 INFO:tasks.workunit.client.0.smithi070.stderr:INFO:root:command succeeded 2024-09-12T00:36:56.857 INFO:tasks.workunit.client.0.smithi070.stderr:INFO:root:b'{\n "user_id": "rgw_datacache_user",\n "display_name": "DatacacheUser",\n "email": "",\n "suspended": 0,\n "max_buckets": 1000,\n "subusers": [],\n "keys": [\n {\n "user": "rgw_datacache_user",\n "access_key": "NX5QOQKC6BH2IDN8HC7A",\n "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn",\n "active": true,\n "create_date": "2024-09-12T00:36:56.822327Z"\n }\n ],\n "swift_keys": [],\n "caps": [],\n "op_mask": "read, write, delete",\n "default_placement": "",\n "default_storage_class": "",\n "placement_tags": [],\n "bucket_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "user_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "temp_url_keys": [],\n "type": "rgw",\n "mfa_ids": [],\n "account_id": "",\n "path": "/",\n "create_date": "2024-09-12T00:36:56.822313Z",\n "tags": [],\n "group_ids": []\n}\n\n' 2024-09-12T00:36:56.858 INFO:tasks.workunit.client.0.smithi070.stderr:INFO:root:Creating s3cmd config... 2024-09-12T00:36:56.858 INFO:tasks.workunit.client.0.smithi070.stderr:INFO:root:proto for s3cmd config is https 2024-09-12T00:36:56.858 INFO:tasks.workunit.client.0.smithi070.stderr:INFO:root:s3cmd config written 2024-09-12T00:36:56.858 INFO:tasks.workunit.client.0.smithi070.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 mb s3://datacachebucket) 2024-09-12T00:36:57.098 INFO:tasks.workunit.client.0.smithi070.stderr:INFO:root:command succeeded 2024-09-12T00:36:57.098 INFO:tasks.workunit.client.0.smithi070.stderr:INFO:root:b"Bucket 's3://datacachebucket/' created\n" 2024-09-12T00:36:57.098 INFO:tasks.workunit.client.0.smithi070.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 put /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat s3://datacachebucket) 2024-09-12T00:36:57.488 INFO:tasks.workunit.client.0.smithi070.stderr:INFO:root:command succeeded 2024-09-12T00:36:57.488 INFO:tasks.workunit.client.0.smithi070.stderr:INFO:root:b"upload: '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat' -> 's3://datacachebucket/7M.dat' (7340032 bytes in 0.2 seconds, 37.79 MB/s) [1 of 1]\n" 2024-09-12T00:36:57.488 INFO:tasks.workunit.client.0.smithi070.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 get s3://datacachebucket/7M.dat /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat --force) 2024-09-12T00:36:57.730 INFO:tasks.workunit.client.0.smithi070.stderr:INFO:root:command succeeded 2024-09-12T00:36:57.730 INFO:tasks.workunit.client.0.smithi070.stderr:INFO:root:b"download: 's3://datacachebucket/7M.dat' -> '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat' (7340032 bytes in 0.0 seconds, 140.94 MB/s)\n" 2024-09-12T00:36:57.730 INFO:tasks.workunit.client.0.smithi070.stderr:DEBUG:root:exec_cmd(radosgw-admin object stat --bucket=datacachebucket --object=7M.dat) 2024-09-12T00:36:57.885 INFO:tasks.workunit.client.0.smithi070.stderr:INFO:root:command succeeded 2024-09-12T00:36:57.885 INFO:tasks.workunit.client.0.smithi070.stderr:INFO:root:b'{\n "name": "7M.dat",\n "size": 7340228,\n "policy": {\n "acl": {\n "acl_user_map": [\n {\n "user": "rgw_datacache_user",\n "acl": 15\n }\n ],\n "acl_group_map": [],\n "grant_map": [\n {\n "id": "rgw_datacache_user",\n "grant": {\n "type": {\n "type": 0\n },\n "id": "rgw_datacache_user",\n "name": "DatacacheUser",\n "permission": {\n "flags": 15\n }\n }\n }\n ]\n },\n "owner": {\n "id": "rgw_datacache_user",\n "display_name": "DatacacheUser"\n }\n },\n "compression": {\n "compression_type": "zstd",\n "orig_size": 7340032,\n "blocks": [\n {\n "old_ofs": 0,\n "new_ofs": 0,\n "len": 4194414\n },\n {\n "old_ofs": 4194304,\n "new_ofs": 4194414,\n "len": 3145814\n }\n ]\n },\n "etag": "bcca724b220f488cd86e2342c1948c4e",\n "tag": "81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.474891623019113228",\n "manifest": {\n "objs": [],\n "obj_size": 7340228,\n "explicit_objs": false,\n "head_size": 0,\n "max_head_size": 0,\n "prefix": ".wBamarLAGNhJan8L4eWREpbFjntdw00_",\n "rules": [\n {\n "key": 0,\n "val": {\n "start_part_num": 0,\n "start_ofs": 0,\n "part_size": 0,\n "stripe_max_size": 6291456,\n "override_prefix": ""\n }\n }\n ],\n "tail_instance": "",\n "tail_placement": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1",\n "bucket_id": "81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "placement_rule": "default-placement"\n },\n "tier_type": "",\n "begin_iter": {\n "part_ofs": 0,\n "stripe_ofs": 0,\n "ofs": 0,\n "stripe_size": 6291456,\n "cur_part_id": 0,\n "cur_stripe": 0,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1",\n "bucket_id": "81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".wBamarLAGNhJan8L4eWREpbFjntdw00_0",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n },\n "end_iter": {\n "part_ofs": 0,\n "stripe_ofs": 6291456,\n "ofs": 7340228,\n "stripe_size": 1048772,\n "cur_part_id": 0,\n "cur_stripe": 1,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1",\n "bucket_id": "81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".wBamarLAGNhJan8L4eWREpbFjntdw00_1",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n }\n },\n "pg_ver": 0,\n "source_zone": 0,\n "torrent": "",\n "mtime": "2024-09-12T00:36:57.460318Z",\n "attrs": {\n "user.rgw.content_type": "application/octet-stream",\n "user.rgw.storage_class": "STANDARD",\n "user.rgw.tail_tag": "81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.474891623019113228",\n "user.rgw.x-amz-meta-s3cmd-attrs": "atime:1726101416/ctime:1726101416/gid:1271/gname:ubuntu/md5:bcca724b220f488cd86e2342c1948c4e/mode:33204/mtime:1726101416/uid:1000/uname:ubuntu"\n }\n}\n' 2024-09-12T00:36:57.885 INFO:tasks.workunit.client.0.smithi070.stderr:DEBUG:root:Cached object name is: .wBamarLAGNhJan8L4eWREpbFjntdw00_ 2024-09-12T00:36:57.885 INFO:tasks.workunit.client.0.smithi070.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -type f | wc -l) 2024-09-12T00:36:57.886 INFO:tasks.workunit.client.0.smithi070.stderr:INFO:root:command succeeded 2024-09-12T00:36:57.886 INFO:tasks.workunit.client.0.smithi070.stderr:INFO:root:b'0\n' 2024-09-12T00:36:57.887 INFO:tasks.workunit.client.0.smithi070.stderr:DEBUG:root:Check cache dir content: 0 2024-09-12T00:36:57.887 INFO:tasks.workunit.client.0.smithi070.stderr:INFO:root:NOTICE: datacache test object not found, inspect if datacache was bypassed or disabled during this check. 2024-09-12T00:36:57.887 INFO:tasks.workunit.client.0.smithi070.stderr:INFO:root:Completed Datacache tests 2024-09-12T00:36:57.893 INFO:tasks.workunit.client.0.smithi070.stderr:+ deactivate 2024-09-12T00:36:57.893 INFO:tasks.workunit.client.0.smithi070.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T00:36:57.893 INFO:tasks.workunit.client.0.smithi070.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:36:57.893 INFO:tasks.workunit.client.0.smithi070.stderr:+ export PATH 2024-09-12T00:36:57.893 INFO:tasks.workunit.client.0.smithi070.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:36:57.893 INFO:tasks.workunit.client.0.smithi070.stderr:+ '[' -n '' ']' 2024-09-12T00:36:57.893 INFO:tasks.workunit.client.0.smithi070.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:36:57.893 INFO:tasks.workunit.client.0.smithi070.stderr:+ hash -r 2024-09-12T00:36:57.893 INFO:tasks.workunit.client.0.smithi070.stderr:+ '[' -n '' ']' 2024-09-12T00:36:57.894 INFO:tasks.workunit.client.0.smithi070.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:36:57.894 INFO:tasks.workunit.client.0.smithi070.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:36:57.894 INFO:tasks.workunit.client.0.smithi070.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:36:57.894 INFO:tasks.workunit.client.0.smithi070.stderr:+ unset -f deactivate 2024-09-12T00:36:57.894 INFO:tasks.workunit.client.0.smithi070.stderr:+ echo OK. 2024-09-12T00:36:57.895 INFO:tasks.workunit.client.0.smithi070.stdout:OK. 2024-09-12T00:36:57.895 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:36:57.895 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:36:57.952 INFO:tasks.workunit:Stopping ['rgw/run-datacache.sh'] on client.0... 2024-09-12T00:36:57.952 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:36:58.301 DEBUG:teuthology.parallel:result is None 2024-09-12T00:36:58.302 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:36:58.314 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:36:58.314 DEBUG:teuthology.orchestra.run.smithi070:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:36:58.363 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:36:58.363 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:36:58.375 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:36:58.376 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:36:58.376 DEBUG:teuthology.orchestra.run.smithi070:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:36:58.412 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:36:58.412 INFO:teuthology.orchestra.run.smithi070.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:36:58.412 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:36:58.460 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:36:58.460 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:36:58.508 INFO:tasks.workunit:timeout=3h 2024-09-12T00:36:58.508 INFO:tasks.workunit:cleanup=True 2024-09-12T00:36:58.509 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:36:58.558 INFO:tasks.workunit.client.0.smithi070.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:37:42.095 INFO:tasks.workunit.client.0.smithi070.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:37:42.095 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:37:42.095 INFO:tasks.workunit.client.0.smithi070.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:37:42.095 INFO:tasks.workunit.client.0.smithi070.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:37:42.095 INFO:tasks.workunit.client.0.smithi070.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:37:42.096 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:37:42.096 INFO:tasks.workunit.client.0.smithi070.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:37:42.096 INFO:tasks.workunit.client.0.smithi070.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:37:42.096 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:37:42.096 INFO:tasks.workunit.client.0.smithi070.stderr: git switch -c 2024-09-12T00:37:42.096 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:37:42.096 INFO:tasks.workunit.client.0.smithi070.stderr:Or undo this operation with: 2024-09-12T00:37:42.096 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:37:42.096 INFO:tasks.workunit.client.0.smithi070.stderr: git switch - 2024-09-12T00:37:42.096 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:37:42.096 INFO:tasks.workunit.client.0.smithi070.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:37:42.096 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:37:42.096 INFO:tasks.workunit.client.0.smithi070.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:37:42.102 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:37:42.149 INFO:tasks.workunit.client.0.smithi070.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:37:42.151 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:37:42.152 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:37:42.213 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:37:42.270 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:37:42.314 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:37:42.315 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:37:42.315 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:37:42.357 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:37:42.361 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:37:42.361 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:37:42.407 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-12T00:37:42.409 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-12T00:37:42.409 DEBUG:teuthology.orchestra.run.smithi070:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T00:37:42.462 INFO:tasks.workunit.client.0.smithi070.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T00:37:42.463 INFO:tasks.workunit.client.0.smithi070.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:37:42.463 INFO:tasks.workunit.client.0.smithi070.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:37:45.385 INFO:tasks.workunit.client.0.smithi070.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:37:45.386 INFO:tasks.workunit.client.0.smithi070.stderr:++ deactivate nondestructive 2024-09-12T00:37:45.386 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -n '' ']' 2024-09-12T00:37:45.386 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -n '' ']' 2024-09-12T00:37:45.386 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:37:45.386 INFO:tasks.workunit.client.0.smithi070.stderr:++ hash -r 2024-09-12T00:37:45.386 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -n '' ']' 2024-09-12T00:37:45.386 INFO:tasks.workunit.client.0.smithi070.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:37:45.386 INFO:tasks.workunit.client.0.smithi070.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:37:45.386 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:37:45.386 INFO:tasks.workunit.client.0.smithi070.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:37:45.387 INFO:tasks.workunit.client.0.smithi070.stderr:++ export VIRTUAL_ENV 2024-09-12T00:37:45.387 INFO:tasks.workunit.client.0.smithi070.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:37:45.387 INFO:tasks.workunit.client.0.smithi070.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:37:45.387 INFO:tasks.workunit.client.0.smithi070.stderr:++ export PATH 2024-09-12T00:37:45.387 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -n '' ']' 2024-09-12T00:37:45.387 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -z '' ']' 2024-09-12T00:37:45.387 INFO:tasks.workunit.client.0.smithi070.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:37:45.387 INFO:tasks.workunit.client.0.smithi070.stderr:++ PS1='(rgw) ' 2024-09-12T00:37:45.387 INFO:tasks.workunit.client.0.smithi070.stderr:++ export PS1 2024-09-12T00:37:45.387 INFO:tasks.workunit.client.0.smithi070.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T00:37:45.387 INFO:tasks.workunit.client.0.smithi070.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T00:37:45.387 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:37:45.387 INFO:tasks.workunit.client.0.smithi070.stderr:++ hash -r 2024-09-12T00:37:45.387 INFO:tasks.workunit.client.0.smithi070.stderr:+ pip install pip --upgrade 2024-09-12T00:37:45.781 INFO:tasks.workunit.client.0.smithi070.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T00:37:46.008 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting pip 2024-09-12T00:37:46.014 INFO:tasks.workunit.client.0.smithi070.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:37:46.049 INFO:tasks.workunit.client.0.smithi070.stdout:Installing collected packages: pip 2024-09-12T00:37:46.049 INFO:tasks.workunit.client.0.smithi070.stdout: Attempting uninstall: pip 2024-09-12T00:37:46.050 INFO:tasks.workunit.client.0.smithi070.stdout: Found existing installation: pip 22.0.2 2024-09-12T00:37:46.314 INFO:tasks.workunit.client.0.smithi070.stdout: Uninstalling pip-22.0.2: 2024-09-12T00:37:46.320 INFO:tasks.workunit.client.0.smithi070.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T00:37:47.038 INFO:tasks.workunit.client.0.smithi070.stdout:Successfully installed pip-24.2 2024-09-12T00:37:47.098 INFO:tasks.workunit.client.0.smithi070.stderr:+ pip install boto3 2024-09-12T00:37:48.114 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting boto3 2024-09-12T00:37:48.173 INFO:tasks.workunit.client.0.smithi070.stdout: Downloading boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:37:48.806 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:37:48.820 INFO:tasks.workunit.client.0.smithi070.stdout: Downloading botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:37:48.972 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:37:48.987 INFO:tasks.workunit.client.0.smithi070.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:37:49.154 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:37:49.171 INFO:tasks.workunit.client.0.smithi070.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:37:49.326 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:37:49.342 INFO:tasks.workunit.client.0.smithi070.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:37:49.533 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:37:49.548 INFO:tasks.workunit.client.0.smithi070.stdout: Downloading urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-12T00:37:49.765 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:37:49.767 INFO:tasks.workunit.client.0.smithi070.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:37:49.808 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:37:49.905 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:37:50.184 INFO:tasks.workunit.client.0.smithi070.stdout: ---------------------------------------- 12.5/12.5 MB 46.8 MB/s eta 0:00:00 2024-09-12T00:37:50.201 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:37:50.272 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:37:50.351 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:37:50.421 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-12T00:37:50.473 INFO:tasks.workunit.client.0.smithi070.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:37:50.597 INFO:tasks.workunit.client.0.smithi070.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:37:51.792 INFO:tasks.workunit.client.0.smithi070.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-12T00:37:52.024 INFO:tasks.workunit.client.0.smithi070.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-12T00:37:52.157 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-12T00:37:52.195 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:52.195 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:52.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.235+0000 7f36a676b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.235+0000 7f36a676b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:52.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.235+0000 7f36a676b9c0 20 realm 2024-09-12T00:37:52.239 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.235+0000 7f36a676b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.239 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.235+0000 7f36a676b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:52.239 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.235+0000 7f36a676b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:52.239 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.235+0000 7f36a676b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.239 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.235+0000 7f36a676b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:52.239 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.235+0000 7f36a676b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.241 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.239+0000 7f36a676b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:52.241 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.239+0000 7f36a676b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.242 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.239+0000 7f36a676b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:52.242 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.239+0000 7f36a676b9c0 20 searching for the correct realm 2024-09-12T00:37:52.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.243+0000 7f36a4a72640 0 -- 172.21.15.70:0/1120280383 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f368c05e7c0 msgr2=0x7f368c05d230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:52.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.251+0000 7f36a4a72640 0 -- 172.21.15.70:0/1120280383 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f356c07ddc0 msgr2=0x7f356c0801f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:52.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.259+0000 7f36a676b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:52.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.259+0000 7f36a676b9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:37:52.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.259+0000 7f36a676b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:52.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.259+0000 7f36a676b9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:37:52.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.259+0000 7f36a676b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:52.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.259+0000 7f36a676b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:52.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.259+0000 7f36a676b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.259+0000 7f36a676b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:52.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.259+0000 7f36a676b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.259+0000 7f36a676b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:52.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.259+0000 7f36a676b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.259+0000 7f36a676b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:52.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.259+0000 7f36a676b9c0 20 zone default found 2024-09-12T00:37:52.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.259+0000 7f36a676b9c0 4 Realm: () 2024-09-12T00:37:52.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.259+0000 7f36a676b9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:37:52.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.259+0000 7f36a676b9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:37:52.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.259+0000 7f36a676b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:52.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.259+0000 7f36a676b9c0 20 zonegroup default 2024-09-12T00:37:52.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.259+0000 7f36a676b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.259+0000 7f36a676b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:52.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.259+0000 7f36a676b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.264 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.259+0000 7f36a676b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:52.264 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.259+0000 7f36a676b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.264 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.263+0000 7f36a676b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:52.264 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.263+0000 7f36a676b9c0 20 started sync module instance, tier type = 2024-09-12T00:37:52.264 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.263+0000 7f36a676b9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:37:52.280 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.279+0000 7f36a676b9c0 20 add_watcher() i=0 2024-09-12T00:37:52.280 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.279+0000 7f36a676b9c0 20 add_watcher() i=1 2024-09-12T00:37:52.280 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.279+0000 7f36a676b9c0 20 add_watcher() i=2 2024-09-12T00:37:52.280 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.279+0000 7f36a676b9c0 20 add_watcher() i=3 2024-09-12T00:37:52.280 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.279+0000 7f36a676b9c0 20 add_watcher() i=4 2024-09-12T00:37:52.281 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.279+0000 7f36a676b9c0 20 add_watcher() i=5 2024-09-12T00:37:52.281 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.279+0000 7f36a676b9c0 20 add_watcher() i=6 2024-09-12T00:37:52.281 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.279+0000 7f36a676b9c0 20 add_watcher() i=7 2024-09-12T00:37:52.281 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.279+0000 7f36a676b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:52.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.283+0000 7f355b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:52.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.283+0000 7f36a676b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:52.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.283+0000 7f36a676b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:52.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.283+0000 7f36a676b9c0 5 note: GC not initialized 2024-09-12T00:37:52.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.283+0000 7f355a7dc640 20 reqs_thread_entry: start 2024-09-12T00:37:52.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.283+0000 7f36a676b9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:37:52.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.283+0000 7f36a676b9c0 20 Filter name: none 2024-09-12T00:37:52.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.283+0000 7f35537fe640 20 reqs_thread_entry: start 2024-09-12T00:37:52.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.283+0000 7f36a676b9c0 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-12T00:37:52.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.283+0000 7f36a676b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.283+0000 7f36a676b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:52.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.283+0000 7f36a676b9c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-12T00:37:52.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.283+0000 7f36a676b9c0 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:37:52.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.283+0000 7f36a676b9c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-12T00:37:52.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.283+0000 7f36a676b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.283+0000 7f36a676b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:52.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.283+0000 7f36a676b9c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-12T00:37:52.288 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.283+0000 7f36a676b9c0 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:37:52.288 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.283+0000 7f36a676b9c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T00:37:52.288 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.283+0000 7f36a676b9c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T00:37:52.290 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.287+0000 7f36a676b9c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T00:37:52.290 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.287+0000 7f36a676b9c0 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:37:52.290 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.287+0000 7f36a676b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-12T00:37:52.291 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.287+0000 7f357b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757250 cookie 94086493936640 notifier 4695 bl.length()=593 2024-09-12T00:37:52.291 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.287+0000 7f357b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T00:37:52.291 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.287+0000 7f357b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:37:52.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.291+0000 7f36a676b9c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T00:37:52.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.291+0000 7f36a676b9c0 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:37:52.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.291+0000 7f36a676b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-12T00:37:52.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.291+0000 7f357b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757248 cookie 94086493926640 notifier 4695 bl.length()=186 2024-09-12T00:37:52.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.291+0000 7f357b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T00:37:52.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.291+0000 7f357b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:37:52.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.295+0000 7f355b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:52.302 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.299+0000 7f36a676b9c0 20 remove_watcher() i=0 2024-09-12T00:37:52.302 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.299+0000 7f36a676b9c0 2 removed watcher, disabling cache 2024-09-12T00:37:52.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.303+0000 7f36a676b9c0 20 remove_watcher() i=1 2024-09-12T00:37:52.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.303+0000 7f36a676b9c0 20 remove_watcher() i=2 2024-09-12T00:37:52.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.307+0000 7f36a676b9c0 20 remove_watcher() i=3 2024-09-12T00:37:52.311 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.311+0000 7f36a676b9c0 20 remove_watcher() i=4 2024-09-12T00:37:52.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.311+0000 7f36a676b9c0 20 remove_watcher() i=5 2024-09-12T00:37:52.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.311+0000 7f36a676b9c0 20 remove_watcher() i=6 2024-09-12T00:37:52.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.311+0000 7f36a676b9c0 20 remove_watcher() i=7 2024-09-12T00:37:52.489 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:52.489 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:52.538 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:52.538 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:52.588 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:52.588 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:52.612 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:52.612 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:52.631 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:52.631 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:52.638 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:52.638 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:52.657 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:52.657 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:52.666 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:52.667 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:52.677 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:52.677 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:52.710 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:52.711 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:52.719 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:52.719 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:52.754 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:52.754 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:52.763 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:52.763 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:52.795 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:52.795 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:52.803 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:52.803 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:52.837 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:52.837 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:52.843 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: recalculated bucket check stats are correct 2024-09-12T00:37:52.843 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:37:52.844 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T00:37:52.878 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:52.878 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:52.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.919+0000 7f74ac5519c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.924 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.923+0000 7f74ac5519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:52.925 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.923+0000 7f74ac5519c0 20 realm 2024-09-12T00:37:52.925 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.923+0000 7f74ac5519c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.925 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.923+0000 7f74ac5519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:52.925 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.923+0000 7f74ac5519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:52.925 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.923+0000 7f74ac5519c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.925 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.923+0000 7f74ac5519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:52.925 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.923+0000 7f74ac5519c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.926 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.923+0000 7f74ac5519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:52.926 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.923+0000 7f74ac5519c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.927 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.923+0000 7f74ac5519c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:52.927 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.923+0000 7f74ac5519c0 20 searching for the correct realm 2024-09-12T00:37:52.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:52.927+0000 7f74aa858640 0 -- 172.21.15.70:0/96978880 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f74a01042a0 msgr2=0x7f74a00feb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:37:53.146 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.143+0000 7f74aa858640 0 -- 172.21.15.70:0/96978880 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f74a01042a0 msgr2=0x7f74a00feb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:53.157 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.155+0000 7f74ac5519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:53.157 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.155+0000 7f74ac5519c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:37:53.157 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.155+0000 7f74ac5519c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:53.157 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.155+0000 7f74ac5519c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:37:53.157 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.155+0000 7f74ac5519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:53.157 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.155+0000 7f74ac5519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:53.158 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.155+0000 7f74ac5519c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.158 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.155+0000 7f74ac5519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.158 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.155+0000 7f74ac5519c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.158 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.155+0000 7f74ac5519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:53.158 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.155+0000 7f74ac5519c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.159 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.155+0000 7f74ac5519c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:53.159 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.155+0000 7f74ac5519c0 20 zone default found 2024-09-12T00:37:53.159 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.155+0000 7f74ac5519c0 4 Realm: () 2024-09-12T00:37:53.159 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.155+0000 7f74ac5519c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:37:53.160 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.155+0000 7f74ac5519c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:37:53.160 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.155+0000 7f74ac5519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:53.160 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.155+0000 7f74ac5519c0 20 zonegroup default 2024-09-12T00:37:53.160 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.155+0000 7f74ac5519c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.160 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.159+0000 7f74ac5519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.160 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.159+0000 7f74ac5519c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.161 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.159+0000 7f74ac5519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.161 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.159+0000 7f74ac5519c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.161 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.159+0000 7f74ac5519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.161 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.159+0000 7f74ac5519c0 20 started sync module instance, tier type = 2024-09-12T00:37:53.161 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.159+0000 7f74ac5519c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:37:53.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.183+0000 7f74ac5519c0 20 add_watcher() i=0 2024-09-12T00:37:53.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.183+0000 7f74ac5519c0 20 add_watcher() i=1 2024-09-12T00:37:53.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.183+0000 7f74ac5519c0 20 add_watcher() i=2 2024-09-12T00:37:53.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.183+0000 7f74ac5519c0 20 add_watcher() i=3 2024-09-12T00:37:53.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.183+0000 7f74ac5519c0 20 add_watcher() i=4 2024-09-12T00:37:53.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.183+0000 7f74ac5519c0 20 add_watcher() i=5 2024-09-12T00:37:53.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.183+0000 7f74ac5519c0 20 add_watcher() i=6 2024-09-12T00:37:53.188 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.187+0000 7f74ac5519c0 20 add_watcher() i=7 2024-09-12T00:37:53.188 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.187+0000 7f74ac5519c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:53.192 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.191+0000 7f7360fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:53.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.191+0000 7f74ac5519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:53.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.191+0000 7f74ac5519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:53.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.191+0000 7f74ac5519c0 5 note: GC not initialized 2024-09-12T00:37:53.194 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.191+0000 7f72db7fe640 20 reqs_thread_entry: start 2024-09-12T00:37:53.194 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.191+0000 7f74ac5519c0 20 init_complete bucket index max shards: 1 2024-09-12T00:37:53.194 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.191+0000 7f74ac5519c0 20 Filter name: none 2024-09-12T00:37:53.195 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.191+0000 7f72d97fa640 20 reqs_thread_entry: start 2024-09-12T00:37:53.195 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.191+0000 7f74ac5519c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:37:53.195 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.191+0000 7f74ac5519c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.195+0000 7f74ac5519c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:37:53.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.195+0000 7f74ac5519c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:37:53.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.195+0000 7f74ac5519c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:37:53.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.195+0000 7f74ac5519c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 : miss 2024-09-12T00:37:53.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.195+0000 7f74ac5519c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.197 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.195+0000 7f74ac5519c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:37:53.197 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.195+0000 7f74ac5519c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 info.flags=0x17 2024-09-12T00:37:53.197 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.195+0000 7f74ac5519c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 to cache LRU end 2024-09-12T00:37:53.197 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.195+0000 7f74ac5519c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:53.197 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.195+0000 7f74ac5519c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:37:53.197 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.195+0000 7f74ac5519c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 2024-09-12T00:37:53.197 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.195+0000 7f74ac5519c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:53.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.199+0000 7f7360fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:53.206 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.203+0000 7f74ac5519c0 20 remove_watcher() i=0 2024-09-12T00:37:53.206 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.203+0000 7f74ac5519c0 2 removed watcher, disabling cache 2024-09-12T00:37:53.209 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.207+0000 7f74ac5519c0 20 remove_watcher() i=1 2024-09-12T00:37:53.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.211+0000 7f74ac5519c0 20 remove_watcher() i=2 2024-09-12T00:37:53.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.211+0000 7f74ac5519c0 20 remove_watcher() i=3 2024-09-12T00:37:53.215 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.215+0000 7f74ac5519c0 20 remove_watcher() i=4 2024-09-12T00:37:53.218 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.215+0000 7f74ac5519c0 20 remove_watcher() i=5 2024-09-12T00:37:53.219 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.215+0000 7f74ac5519c0 20 remove_watcher() i=6 2024-09-12T00:37:53.221 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.219+0000 7f74ac5519c0 20 remove_watcher() i=7 2024-09-12T00:37:53.238 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T00:37:53.265 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:53.265 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:53.308 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.307+0000 7f7ca17d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.307+0000 7f7ca17d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.307+0000 7f7ca17d59c0 20 realm 2024-09-12T00:37:53.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.307+0000 7f7ca17d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.307+0000 7f7ca17d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.307+0000 7f7ca17d59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:53.311 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.307+0000 7f7ca17d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.311 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.307+0000 7f7ca17d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.311 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.307+0000 7f7ca17d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.311+0000 7f7ca17d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:53.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.311+0000 7f7ca17d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.311+0000 7f7ca17d59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:53.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.311+0000 7f7ca17d59c0 20 searching for the correct realm 2024-09-12T00:37:53.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.311+0000 7f7c9f2db640 0 -- 172.21.15.70:0/2468911119 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f7c98021060 msgr2=0x7f7c9805dec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:53.320 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.319+0000 7f7c9f2db640 0 -- 172.21.15.70:0/2468911119 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x55fa646a2700 msgr2=0x7f7c980749c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:53.544 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.543+0000 7f7ca17d59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:53.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.543+0000 7f7ca17d59c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:37:53.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.543+0000 7f7ca17d59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:53.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.543+0000 7f7ca17d59c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:37:53.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.543+0000 7f7ca17d59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:53.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.543+0000 7f7ca17d59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:53.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.543+0000 7f7ca17d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.543+0000 7f7ca17d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.543+0000 7f7ca17d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.543+0000 7f7ca17d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:53.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.543+0000 7f7ca17d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.543+0000 7f7ca17d59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:53.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.543+0000 7f7ca17d59c0 20 zone default found 2024-09-12T00:37:53.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.543+0000 7f7ca17d59c0 4 Realm: () 2024-09-12T00:37:53.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.543+0000 7f7ca17d59c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:37:53.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.543+0000 7f7ca17d59c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:37:53.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.543+0000 7f7ca17d59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:53.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.543+0000 7f7ca17d59c0 20 zonegroup default 2024-09-12T00:37:53.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.543+0000 7f7ca17d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.547+0000 7f7ca17d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.547+0000 7f7ca17d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.547+0000 7f7ca17d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.547+0000 7f7ca17d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.547+0000 7f7ca17d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.547+0000 7f7ca17d59c0 20 started sync module instance, tier type = 2024-09-12T00:37:53.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.547+0000 7f7ca17d59c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:37:53.576 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.575+0000 7f7ca17d59c0 20 add_watcher() i=0 2024-09-12T00:37:53.576 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.575+0000 7f7ca17d59c0 20 add_watcher() i=1 2024-09-12T00:37:53.576 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.575+0000 7f7ca17d59c0 20 add_watcher() i=2 2024-09-12T00:37:53.576 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.575+0000 7f7ca17d59c0 20 add_watcher() i=3 2024-09-12T00:37:53.576 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.575+0000 7f7ca17d59c0 20 add_watcher() i=4 2024-09-12T00:37:53.576 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.575+0000 7f7ca17d59c0 20 add_watcher() i=5 2024-09-12T00:37:53.576 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.575+0000 7f7ca17d59c0 20 add_watcher() i=6 2024-09-12T00:37:53.578 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.575+0000 7f7ca17d59c0 20 add_watcher() i=7 2024-09-12T00:37:53.578 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.575+0000 7f7ca17d59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:53.583 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.579+0000 7f7b55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:53.584 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.583+0000 7f7ca17d59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:53.584 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.583+0000 7f7ca17d59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:53.584 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.583+0000 7f7ca17d59c0 5 note: GC not initialized 2024-09-12T00:37:53.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.583+0000 7f7b54fe1640 20 reqs_thread_entry: start 2024-09-12T00:37:53.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.583+0000 7f7ca17d59c0 20 init_complete bucket index max shards: 1 2024-09-12T00:37:53.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.583+0000 7f7ca17d59c0 20 Filter name: none 2024-09-12T00:37:53.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.583+0000 7f7ace7fc640 20 reqs_thread_entry: start 2024-09-12T00:37:53.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.583+0000 7f7ca17d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.583+0000 7f7ca17d59c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:37:53.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.583+0000 7f7ca17d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.587 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.583+0000 7f7ca17d59c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:37:53.587 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.583+0000 7f7ca17d59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:53.587 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.583+0000 7f7ca17d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.588 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.587+0000 7f7ca17d59c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:37:53.588 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.587+0000 7f7ca17d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.588 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.587+0000 7f7ca17d59c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:37:53.588 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.587+0000 7f7ca17d59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:53.590 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.587+0000 7f7b55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:53.596 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.595+0000 7f7ca17d59c0 20 remove_watcher() i=0 2024-09-12T00:37:53.596 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.595+0000 7f7ca17d59c0 2 removed watcher, disabling cache 2024-09-12T00:37:53.598 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.595+0000 7f7ca17d59c0 20 remove_watcher() i=1 2024-09-12T00:37:53.600 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.599+0000 7f7ca17d59c0 20 remove_watcher() i=2 2024-09-12T00:37:53.602 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.599+0000 7f7ca17d59c0 20 remove_watcher() i=3 2024-09-12T00:37:53.604 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.603+0000 7f7ca17d59c0 20 remove_watcher() i=4 2024-09-12T00:37:53.606 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.603+0000 7f7ca17d59c0 20 remove_watcher() i=5 2024-09-12T00:37:53.607 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.607+0000 7f7ca17d59c0 20 remove_watcher() i=6 2024-09-12T00:37:53.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.607+0000 7f7ca17d59c0 20 remove_watcher() i=7 2024-09-12T00:37:53.624 INFO:tasks.workunit.client.0.smithi070.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 121, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-12T00:37:53.624 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-12T00:37:53.624 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:37:53.625 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:37:53.657 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:53.657 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:53.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.699+0000 7fd77af679c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.699+0000 7fd77af679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.699+0000 7fd77af679c0 20 realm 2024-09-12T00:37:53.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.699+0000 7fd77af679c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.699+0000 7fd77af679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.699+0000 7fd77af679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:53.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.699+0000 7fd77af679c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.699+0000 7fd77af679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.699+0000 7fd77af679c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.703+0000 7fd77af679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:53.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.703+0000 7fd77af679c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.703+0000 7fd77af679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:53.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.703+0000 7fd77af679c0 20 searching for the correct realm 2024-09-12T00:37:53.711 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.707+0000 7fd77926e640 0 -- 172.21.15.70:0/1948484752 >> [v2:172.21.15.70:6816/1979013808,v1:172.21.15.70:6817/1979013808] conn(0x564e0dbafd40 msgr2=0x564e0dbb2130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:53.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.715+0000 7fd77826c640 0 -- 172.21.15.70:0/1948484752 >> [v2:172.21.15.70:6824/2477739226,v1:172.21.15.70:6825/2477739226] conn(0x564e0dbb77c0 msgr2=0x564e0dbb9bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:53.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.719+0000 7fd77af679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:53.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.719+0000 7fd77af679c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:37:53.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.719+0000 7fd77af679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:53.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.719+0000 7fd77af679c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:37:53.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.719+0000 7fd77af679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:53.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.719+0000 7fd77af679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:53.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.719+0000 7fd77af679c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.723+0000 7fd77af679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.723+0000 7fd77af679c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.725 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.723+0000 7fd77af679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:53.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.723+0000 7fd77af679c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.723+0000 7fd77af679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:53.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.723+0000 7fd77af679c0 20 zone default found 2024-09-12T00:37:53.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.723+0000 7fd77af679c0 4 Realm: () 2024-09-12T00:37:53.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.723+0000 7fd77af679c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:37:53.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.723+0000 7fd77af679c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:37:53.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.723+0000 7fd77af679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:53.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.723+0000 7fd77af679c0 20 zonegroup default 2024-09-12T00:37:53.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.723+0000 7fd77af679c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.723+0000 7fd77af679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.723+0000 7fd77af679c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.723+0000 7fd77af679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.723+0000 7fd77af679c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.723+0000 7fd77af679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.723+0000 7fd77af679c0 20 started sync module instance, tier type = 2024-09-12T00:37:53.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.723+0000 7fd77af679c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:37:53.742 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.739+0000 7fd77af679c0 20 add_watcher() i=0 2024-09-12T00:37:53.742 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.739+0000 7fd77af679c0 20 add_watcher() i=1 2024-09-12T00:37:53.742 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.739+0000 7fd77af679c0 20 add_watcher() i=2 2024-09-12T00:37:53.742 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.739+0000 7fd77af679c0 20 add_watcher() i=3 2024-09-12T00:37:53.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.739+0000 7fd77af679c0 20 add_watcher() i=4 2024-09-12T00:37:53.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.739+0000 7fd77af679c0 20 add_watcher() i=5 2024-09-12T00:37:53.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.739+0000 7fd77af679c0 20 add_watcher() i=6 2024-09-12T00:37:53.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.739+0000 7fd77af679c0 20 add_watcher() i=7 2024-09-12T00:37:53.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.739+0000 7fd77af679c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:53.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.743+0000 7fd62efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:53.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.743+0000 7fd77af679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:53.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.743+0000 7fd77af679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:53.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.743+0000 7fd77af679c0 5 note: GC not initialized 2024-09-12T00:37:53.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.743+0000 7fd62dfe3640 20 reqs_thread_entry: start 2024-09-12T00:37:53.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.743+0000 7fd77af679c0 20 init_complete bucket index max shards: 1 2024-09-12T00:37:53.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.743+0000 7fd77af679c0 20 Filter name: none 2024-09-12T00:37:53.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.743+0000 7fd59f7fe640 20 reqs_thread_entry: start 2024-09-12T00:37:53.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.743+0000 7fd77af679c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:37:53.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.743+0000 7fd77af679c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.743+0000 7fd77af679c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:37:53.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.743+0000 7fd77af679c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:37:53.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.743+0000 7fd77af679c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:37:53.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.743+0000 7fd77af679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 : miss 2024-09-12T00:37:53.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.743+0000 7fd77af679c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.747+0000 7fd77af679c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:37:53.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.747+0000 7fd77af679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 info.flags=0x17 2024-09-12T00:37:53.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.747+0000 7fd77af679c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 to cache LRU end 2024-09-12T00:37:53.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.747+0000 7fd77af679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:53.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.747+0000 7fd77af679c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:37:53.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.747+0000 7fd77af679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 2024-09-12T00:37:53.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.747+0000 7fd77af679c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:53.750 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.747+0000 7fd77af679c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:37:53.750 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.747+0000 7fd77af679c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:37:53.750 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.747+0000 7fd62efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:53.755 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.751+0000 7fd77af679c0 20 remove_watcher() i=0 2024-09-12T00:37:53.755 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.751+0000 7fd77af679c0 2 removed watcher, disabling cache 2024-09-12T00:37:53.756 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.755+0000 7fd77af679c0 20 remove_watcher() i=1 2024-09-12T00:37:53.758 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.755+0000 7fd77af679c0 20 remove_watcher() i=2 2024-09-12T00:37:53.760 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.759+0000 7fd77af679c0 20 remove_watcher() i=3 2024-09-12T00:37:53.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.759+0000 7fd77af679c0 20 remove_watcher() i=4 2024-09-12T00:37:53.764 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.763+0000 7fd77af679c0 20 remove_watcher() i=5 2024-09-12T00:37:53.765 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.763+0000 7fd77af679c0 20 remove_watcher() i=6 2024-09-12T00:37:53.766 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:53.763+0000 7fd77af679c0 20 remove_watcher() i=7 2024-09-12T00:37:53.779 INFO:tasks.workunit.client.0.smithi070.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:37:54.211 INFO:tasks.workunit.client.0.smithi070.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:37:55.651 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:55.651 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:55.716 INFO:tasks.workunit.client.0.smithi070.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:37:55.717 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:37:55.752 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:55.752 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:55.796 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.795+0000 7fb08070d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:55.798 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.795+0000 7fb08070d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:55.798 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.795+0000 7fb08070d9c0 20 realm 2024-09-12T00:37:55.798 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.795+0000 7fb08070d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:55.798 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.795+0000 7fb08070d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:55.799 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.795+0000 7fb08070d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:55.799 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.795+0000 7fb08070d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:55.799 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.795+0000 7fb08070d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:55.799 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.795+0000 7fb08070d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:55.800 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.799+0000 7fb08070d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:55.800 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.799+0000 7fb08070d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:55.801 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.799+0000 7fb08070d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:55.801 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.799+0000 7fb08070d9c0 20 searching for the correct realm 2024-09-12T00:37:55.805 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.803+0000 7fb07ea14640 0 -- 172.21.15.70:0/731462962 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fb074087020 msgr2=0x7fb074069ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:55.814 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.811+0000 7fb07ea14640 0 -- 172.21.15.70:0/731462962 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7faf4807ddc0 msgr2=0x7faf480801f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:55.821 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.819+0000 7fb08070d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:55.821 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.819+0000 7fb08070d9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:37:55.821 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.819+0000 7fb08070d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:55.821 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.819+0000 7fb08070d9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:37:55.822 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.819+0000 7fb08070d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:55.822 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.819+0000 7fb08070d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:55.822 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.819+0000 7fb08070d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:55.822 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.819+0000 7fb08070d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:55.822 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.819+0000 7fb08070d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:55.823 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.819+0000 7fb08070d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:55.823 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.819+0000 7fb08070d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:55.823 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.819+0000 7fb08070d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:55.823 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.819+0000 7fb08070d9c0 20 zone default found 2024-09-12T00:37:55.823 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.819+0000 7fb08070d9c0 4 Realm: () 2024-09-12T00:37:55.823 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.819+0000 7fb08070d9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:37:55.823 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.819+0000 7fb08070d9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:37:55.823 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.819+0000 7fb08070d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:55.823 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.819+0000 7fb08070d9c0 20 zonegroup default 2024-09-12T00:37:55.823 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.819+0000 7fb08070d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:55.824 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.819+0000 7fb08070d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:55.825 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.819+0000 7fb08070d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:55.825 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.823+0000 7fb08070d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:55.825 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.823+0000 7fb08070d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:55.825 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.823+0000 7fb08070d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:55.825 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.823+0000 7fb08070d9c0 20 started sync module instance, tier type = 2024-09-12T00:37:55.825 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.823+0000 7fb08070d9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:37:55.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.839+0000 7fb08070d9c0 20 add_watcher() i=0 2024-09-12T00:37:55.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.839+0000 7fb08070d9c0 20 add_watcher() i=1 2024-09-12T00:37:55.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.839+0000 7fb08070d9c0 20 add_watcher() i=2 2024-09-12T00:37:55.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.839+0000 7fb08070d9c0 20 add_watcher() i=3 2024-09-12T00:37:55.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.839+0000 7fb08070d9c0 20 add_watcher() i=4 2024-09-12T00:37:55.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.839+0000 7fb08070d9c0 20 add_watcher() i=5 2024-09-12T00:37:55.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.839+0000 7fb08070d9c0 20 add_watcher() i=6 2024-09-12T00:37:55.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.839+0000 7fb08070d9c0 20 add_watcher() i=7 2024-09-12T00:37:55.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.839+0000 7fb08070d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:55.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.843+0000 7faf34fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:55.846 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.843+0000 7fb08070d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:55.846 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.843+0000 7fb08070d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:55.846 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.843+0000 7fb08070d9c0 5 note: GC not initialized 2024-09-12T00:37:55.846 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.843+0000 7faeaf7fe640 20 reqs_thread_entry: start 2024-09-12T00:37:55.847 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.843+0000 7fb08070d9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:37:55.847 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.843+0000 7fb08070d9c0 20 Filter name: none 2024-09-12T00:37:55.847 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.843+0000 7faead7fa640 20 reqs_thread_entry: start 2024-09-12T00:37:55.847 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.843+0000 7fb08070d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:55.847 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.843+0000 7fb08070d9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:37:55.847 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.843+0000 7fb08070d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:55.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.843+0000 7fb08070d9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:37:55.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.843+0000 7fb08070d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:55.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.843+0000 7fb08070d9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:37:55.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.843+0000 7fb08070d9c0 20 INFO: main: starting shard=0 2024-09-12T00:37:55.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.843+0000 7fb08070d9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:55.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.847+0000 7fb08070d9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:37:55.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.847+0000 7fb08070d9c0 20 INFO: main: done 2024-09-12T00:37:55.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.847+0000 7faf34fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:55.853 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.851+0000 7fb08070d9c0 20 remove_watcher() i=0 2024-09-12T00:37:55.853 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.851+0000 7fb08070d9c0 2 removed watcher, disabling cache 2024-09-12T00:37:55.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.851+0000 7fb08070d9c0 20 remove_watcher() i=1 2024-09-12T00:37:55.857 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.855+0000 7fb08070d9c0 20 remove_watcher() i=2 2024-09-12T00:37:55.859 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.855+0000 7fb08070d9c0 20 remove_watcher() i=3 2024-09-12T00:37:55.861 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.859+0000 7fb08070d9c0 20 remove_watcher() i=4 2024-09-12T00:37:55.862 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.859+0000 7fb08070d9c0 20 remove_watcher() i=5 2024-09-12T00:37:55.864 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.863+0000 7fb08070d9c0 20 remove_watcher() i=6 2024-09-12T00:37:55.865 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:55.863+0000 7fb08070d9c0 20 remove_watcher() i=7 2024-09-12T00:37:55.880 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:55.880 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:55.884 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:55.884 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:55.940 INFO:tasks.workunit.client.0.smithi070.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:37:55.941 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:37:55.972 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:55.973 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:56.015 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.015+0000 7f0d2f64c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.017 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.015+0000 7f0d2f64c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:56.017 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.015+0000 7f0d2f64c9c0 20 realm 2024-09-12T00:37:56.017 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.015+0000 7f0d2f64c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.018 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.015+0000 7f0d2f64c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:56.018 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.015+0000 7f0d2f64c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:56.018 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.015+0000 7f0d2f64c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.018 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.015+0000 7f0d2f64c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:56.018 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.015+0000 7f0d2f64c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.019+0000 7f0d2f64c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:56.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.019+0000 7f0d2f64c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.020 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.019+0000 7f0d2f64c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:56.020 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.019+0000 7f0d2f64c9c0 20 searching for the correct realm 2024-09-12T00:37:56.024 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.023+0000 7f0d2d953640 0 -- 172.21.15.70:0/2463180184 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f0d18008050 msgr2=0x7f0d1803d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:56.242 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.239+0000 7f0d2d953640 0 -- 172.21.15.70:0/2463180184 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f0d18008050 msgr2=0x7f0d1803d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:56.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.251+0000 7f0d2f64c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:56.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.251+0000 7f0d2f64c9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:37:56.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.251+0000 7f0d2f64c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:56.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.251+0000 7f0d2f64c9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:37:56.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.251+0000 7f0d2f64c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:56.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.251+0000 7f0d2f64c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:56.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.251+0000 7f0d2f64c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.251+0000 7f0d2f64c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:56.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.251+0000 7f0d2f64c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.251+0000 7f0d2f64c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:56.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.251+0000 7f0d2f64c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.255+0000 7f0d2f64c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:56.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.255+0000 7f0d2f64c9c0 20 zone default found 2024-09-12T00:37:56.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.255+0000 7f0d2f64c9c0 4 Realm: () 2024-09-12T00:37:56.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.255+0000 7f0d2f64c9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:37:56.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.255+0000 7f0d2f64c9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:37:56.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.255+0000 7f0d2f64c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:56.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.255+0000 7f0d2f64c9c0 20 zonegroup default 2024-09-12T00:37:56.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.255+0000 7f0d2f64c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.255+0000 7f0d2f64c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:56.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.255+0000 7f0d2f64c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.257 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.255+0000 7f0d2f64c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:56.257 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.255+0000 7f0d2f64c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.257 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.255+0000 7f0d2f64c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:56.257 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.255+0000 7f0d2f64c9c0 20 started sync module instance, tier type = 2024-09-12T00:37:56.257 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.255+0000 7f0d2f64c9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:37:56.277 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.275+0000 7f0d2f64c9c0 20 add_watcher() i=0 2024-09-12T00:37:56.277 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.275+0000 7f0d2f64c9c0 20 add_watcher() i=1 2024-09-12T00:37:56.277 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.275+0000 7f0d2f64c9c0 20 add_watcher() i=2 2024-09-12T00:37:56.277 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.275+0000 7f0d2f64c9c0 20 add_watcher() i=3 2024-09-12T00:37:56.277 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.275+0000 7f0d2f64c9c0 20 add_watcher() i=4 2024-09-12T00:37:56.277 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.275+0000 7f0d2f64c9c0 20 add_watcher() i=5 2024-09-12T00:37:56.277 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.275+0000 7f0d2f64c9c0 20 add_watcher() i=6 2024-09-12T00:37:56.279 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.275+0000 7f0d2f64c9c0 20 add_watcher() i=7 2024-09-12T00:37:56.279 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.275+0000 7f0d2f64c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:56.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.279+0000 7f0be3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:56.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.283+0000 7f0d2f64c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:56.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.283+0000 7f0d2f64c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:56.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.283+0000 7f0d2f64c9c0 5 note: GC not initialized 2024-09-12T00:37:56.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.283+0000 7f0be2fe5640 20 reqs_thread_entry: start 2024-09-12T00:37:56.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.283+0000 7f0d2f64c9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:37:56.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.283+0000 7f0d2f64c9c0 20 Filter name: none 2024-09-12T00:37:56.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.283+0000 7f0be0fe1640 20 reqs_thread_entry: start 2024-09-12T00:37:56.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.283+0000 7f0d2f64c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.283+0000 7f0d2f64c9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:37:56.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.283+0000 7f0d2f64c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.283+0000 7f0d2f64c9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:37:56.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.283+0000 7f0d2f64c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:56.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.283+0000 7f0d2f64c9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:37:56.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.283+0000 7f0d2f64c9c0 20 INFO: main: starting shard=0 2024-09-12T00:37:56.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.283+0000 7f0d2f64c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:56.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.283+0000 7f0d2f64c9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:37:56.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.283+0000 7f0d2f64c9c0 20 INFO: main: done 2024-09-12T00:37:56.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.287+0000 7f0be3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:56.292 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.291+0000 7f0d2f64c9c0 20 remove_watcher() i=0 2024-09-12T00:37:56.292 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.291+0000 7f0d2f64c9c0 2 removed watcher, disabling cache 2024-09-12T00:37:56.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.291+0000 7f0d2f64c9c0 20 remove_watcher() i=1 2024-09-12T00:37:56.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.295+0000 7f0d2f64c9c0 20 remove_watcher() i=2 2024-09-12T00:37:56.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.295+0000 7f0d2f64c9c0 20 remove_watcher() i=3 2024-09-12T00:37:56.300 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.299+0000 7f0d2f64c9c0 20 remove_watcher() i=4 2024-09-12T00:37:56.302 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.299+0000 7f0d2f64c9c0 20 remove_watcher() i=5 2024-09-12T00:37:56.303 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.303+0000 7f0d2f64c9c0 20 remove_watcher() i=6 2024-09-12T00:37:56.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.303+0000 7f0d2f64c9c0 20 remove_watcher() i=7 2024-09-12T00:37:56.321 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:56.321 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:56.325 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:56.325 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:56.384 INFO:tasks.workunit.client.0.smithi070.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:37:56.385 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T00:37:56.420 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:56.420 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:56.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.463+0000 7fdda06b99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.463+0000 7fdda06b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:56.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.463+0000 7fdda06b99c0 20 realm 2024-09-12T00:37:56.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.463+0000 7fdda06b99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.463+0000 7fdda06b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:56.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.463+0000 7fdda06b99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:56.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.463+0000 7fdda06b99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.463+0000 7fdda06b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:56.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.463+0000 7fdda06b99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.468 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.467+0000 7fdda06b99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:56.468 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.467+0000 7fdda06b99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.468 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.467+0000 7fdda06b99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:56.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.467+0000 7fdda06b99c0 20 searching for the correct realm 2024-09-12T00:37:56.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.467+0000 7fdd9d9be640 0 -- 172.21.15.70:0/2278270799 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7fdd90093040 msgr2=0x7fdd9001f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:37:56.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.679+0000 7fdd9e1bf640 0 -- 172.21.15.70:0/2278270799 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7fdd98018040 msgr2=0x7fdd9805ce50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:56.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.695+0000 7fdda06b99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:56.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.695+0000 7fdda06b99c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:37:56.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.695+0000 7fdda06b99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:56.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.695+0000 7fdda06b99c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:37:56.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.695+0000 7fdda06b99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:56.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.695+0000 7fdda06b99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:56.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.695+0000 7fdda06b99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.695+0000 7fdda06b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:56.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.695+0000 7fdda06b99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.695+0000 7fdda06b99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:56.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.699+0000 7fdda06b99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.699+0000 7fdda06b99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:56.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.699+0000 7fdda06b99c0 20 zone default found 2024-09-12T00:37:56.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.699+0000 7fdda06b99c0 4 Realm: () 2024-09-12T00:37:56.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.699+0000 7fdda06b99c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:37:56.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.699+0000 7fdda06b99c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:37:56.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.699+0000 7fdda06b99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:56.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.699+0000 7fdda06b99c0 20 zonegroup default 2024-09-12T00:37:56.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.699+0000 7fdda06b99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.699+0000 7fdda06b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:56.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.699+0000 7fdda06b99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.699+0000 7fdda06b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:56.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.699+0000 7fdda06b99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.699+0000 7fdda06b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:56.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.699+0000 7fdda06b99c0 20 started sync module instance, tier type = 2024-09-12T00:37:56.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.699+0000 7fdda06b99c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:37:56.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.723+0000 7fdda06b99c0 20 add_watcher() i=0 2024-09-12T00:37:56.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.723+0000 7fdda06b99c0 20 add_watcher() i=1 2024-09-12T00:37:56.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.723+0000 7fdda06b99c0 20 add_watcher() i=2 2024-09-12T00:37:56.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.723+0000 7fdda06b99c0 20 add_watcher() i=3 2024-09-12T00:37:56.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.723+0000 7fdda06b99c0 20 add_watcher() i=4 2024-09-12T00:37:56.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.723+0000 7fdda06b99c0 20 add_watcher() i=5 2024-09-12T00:37:56.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.723+0000 7fdda06b99c0 20 add_watcher() i=6 2024-09-12T00:37:56.728 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.727+0000 7fdda06b99c0 20 add_watcher() i=7 2024-09-12T00:37:56.728 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.727+0000 7fdda06b99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:56.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.731+0000 7fdc54fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:56.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.731+0000 7fdda06b99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:56.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.731+0000 7fdda06b99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:56.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.731+0000 7fdda06b99c0 5 note: GC not initialized 2024-09-12T00:37:56.734 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.731+0000 7fdbcf7fe640 20 reqs_thread_entry: start 2024-09-12T00:37:56.734 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.731+0000 7fdda06b99c0 20 init_complete bucket index max shards: 1 2024-09-12T00:37:56.734 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.731+0000 7fdda06b99c0 20 Filter name: none 2024-09-12T00:37:56.734 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.731+0000 7fdbcd7fa640 20 reqs_thread_entry: start 2024-09-12T00:37:56.734 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.731+0000 7fdda06b99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.735 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.731+0000 7fdda06b99c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:37:56.735 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.731+0000 7fdda06b99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.736 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.735+0000 7fdda06b99c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:37:56.736 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.735+0000 7fdda06b99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:56.736 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.735+0000 7fdda06b99c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:37:56.736 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.735+0000 7fdda06b99c0 20 INFO: main: starting shard=0 2024-09-12T00:37:56.736 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.735+0000 7fdda06b99c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:56.737 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.735+0000 7fdda06b99c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:37:56.737 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.735+0000 7fdda06b99c0 20 INFO: main: done 2024-09-12T00:37:56.738 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.735+0000 7fdc54fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:56.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.743+0000 7fdda06b99c0 20 remove_watcher() i=0 2024-09-12T00:37:56.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.743+0000 7fdda06b99c0 2 removed watcher, disabling cache 2024-09-12T00:37:56.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.743+0000 7fdda06b99c0 20 remove_watcher() i=1 2024-09-12T00:37:56.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.747+0000 7fdda06b99c0 20 remove_watcher() i=2 2024-09-12T00:37:56.750 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.747+0000 7fdda06b99c0 20 remove_watcher() i=3 2024-09-12T00:37:56.753 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.751+0000 7fdda06b99c0 20 remove_watcher() i=4 2024-09-12T00:37:56.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.751+0000 7fdda06b99c0 20 remove_watcher() i=5 2024-09-12T00:37:56.756 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.755+0000 7fdda06b99c0 20 remove_watcher() i=6 2024-09-12T00:37:56.757 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.755+0000 7fdda06b99c0 20 remove_watcher() i=7 2024-09-12T00:37:56.774 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:56.775 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:56.779 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:56.779 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:56.840 INFO:tasks.workunit.client.0.smithi070.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:37:56.841 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T00:37:56.876 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:56.876 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:56.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.919+0000 7fd4affb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.919+0000 7fd4affb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:56.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.919+0000 7fd4affb09c0 20 realm 2024-09-12T00:37:56.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.919+0000 7fd4affb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.919+0000 7fd4affb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:56.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.919+0000 7fd4affb09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:56.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.919+0000 7fd4affb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.924 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.919+0000 7fd4affb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:56.924 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.919+0000 7fd4affb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.925 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.923+0000 7fd4affb09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:56.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.923+0000 7fd4affb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.923+0000 7fd4affb09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:56.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.923+0000 7fd4affb09c0 20 searching for the correct realm 2024-09-12T00:37:56.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.927+0000 7fd4ad2b5640 0 -- 172.21.15.70:0/4048493985 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7fd4a0073b00 msgr2=0x7fd4a0037040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:56.935 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.931+0000 7fd4adab6640 0 -- 172.21.15.70:0/4048493985 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7fd4a8018070 msgr2=0x7fd4a8077820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:37:56.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.943+0000 7fd4affb09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:56.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.943+0000 7fd4affb09c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:37:56.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.943+0000 7fd4affb09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:56.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.943+0000 7fd4affb09c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:37:56.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.943+0000 7fd4affb09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:56.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.943+0000 7fd4affb09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:56.948 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.943+0000 7fd4affb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.948 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.943+0000 7fd4affb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:56.948 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.943+0000 7fd4affb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.949 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.947+0000 7fd4affb09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:56.950 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.947+0000 7fd4affb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.950 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.947+0000 7fd4affb09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:56.950 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.947+0000 7fd4affb09c0 20 zone default found 2024-09-12T00:37:56.950 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.947+0000 7fd4affb09c0 4 Realm: () 2024-09-12T00:37:56.950 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.947+0000 7fd4affb09c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:37:56.950 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.947+0000 7fd4affb09c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:37:56.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.947+0000 7fd4affb09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:56.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.947+0000 7fd4affb09c0 20 zonegroup default 2024-09-12T00:37:56.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.947+0000 7fd4affb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.947+0000 7fd4affb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:56.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.947+0000 7fd4affb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.947+0000 7fd4affb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:56.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.947+0000 7fd4affb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.947+0000 7fd4affb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:56.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.947+0000 7fd4affb09c0 20 started sync module instance, tier type = 2024-09-12T00:37:56.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.947+0000 7fd4affb09c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:37:56.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.963+0000 7fd4affb09c0 20 add_watcher() i=0 2024-09-12T00:37:56.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.963+0000 7fd4affb09c0 20 add_watcher() i=1 2024-09-12T00:37:56.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.963+0000 7fd4affb09c0 20 add_watcher() i=2 2024-09-12T00:37:56.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.963+0000 7fd4affb09c0 20 add_watcher() i=3 2024-09-12T00:37:56.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.963+0000 7fd4affb09c0 20 add_watcher() i=4 2024-09-12T00:37:56.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.963+0000 7fd4affb09c0 20 add_watcher() i=5 2024-09-12T00:37:56.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.963+0000 7fd4affb09c0 20 add_watcher() i=6 2024-09-12T00:37:56.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.963+0000 7fd4affb09c0 20 add_watcher() i=7 2024-09-12T00:37:56.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.963+0000 7fd4affb09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:56.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.967+0000 7fd35f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:56.971 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.967+0000 7fd4affb09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:56.972 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.967+0000 7fd4affb09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:56.972 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.967+0000 7fd4affb09c0 5 note: GC not initialized 2024-09-12T00:37:56.972 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.967+0000 7fd35e7fc640 20 reqs_thread_entry: start 2024-09-12T00:37:56.972 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.967+0000 7fd4affb09c0 20 init_complete bucket index max shards: 1 2024-09-12T00:37:56.972 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.967+0000 7fd4affb09c0 20 Filter name: none 2024-09-12T00:37:56.972 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.967+0000 7fd2cffff640 20 reqs_thread_entry: start 2024-09-12T00:37:56.972 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.967+0000 7fd4affb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.967+0000 7fd4affb09c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:37:56.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.967+0000 7fd4affb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:56.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.967+0000 7fd4affb09c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:37:56.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.967+0000 7fd4affb09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:56.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.967+0000 7fd4affb09c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:37:56.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.967+0000 7fd4affb09c0 20 INFO: main: starting shard=0 2024-09-12T00:37:56.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.967+0000 7fd4affb09c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:56.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.971+0000 7fd4affb09c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:37:56.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.971+0000 7fd4affb09c0 20 INFO: main: done 2024-09-12T00:37:56.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.971+0000 7fd35f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:56.978 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.975+0000 7fd4affb09c0 20 remove_watcher() i=0 2024-09-12T00:37:56.978 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.975+0000 7fd4affb09c0 2 removed watcher, disabling cache 2024-09-12T00:37:56.981 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.979+0000 7fd4affb09c0 20 remove_watcher() i=1 2024-09-12T00:37:56.983 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.979+0000 7fd4affb09c0 20 remove_watcher() i=2 2024-09-12T00:37:56.985 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.983+0000 7fd4affb09c0 20 remove_watcher() i=3 2024-09-12T00:37:56.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.983+0000 7fd4affb09c0 20 remove_watcher() i=4 2024-09-12T00:37:56.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.987+0000 7fd4affb09c0 20 remove_watcher() i=5 2024-09-12T00:37:56.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.987+0000 7fd4affb09c0 20 remove_watcher() i=6 2024-09-12T00:37:56.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:56.987+0000 7fd4affb09c0 20 remove_watcher() i=7 2024-09-12T00:37:57.007 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:57.007 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:57.010 INFO:tasks.workunit.client.0.smithi070.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:37:57.436 INFO:tasks.workunit.client.0.smithi070.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:37:57.873 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-12T00:37:57.873 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:37:57.874 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:37:57.907 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:57.908 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:57.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:57.943+0000 7fb02cb249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:57.948 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:57.947+0000 7fb02cb249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:57.948 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:57.947+0000 7fb02cb249c0 20 realm 2024-09-12T00:37:57.949 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:57.947+0000 7fb02cb249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:57.949 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:57.947+0000 7fb02cb249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:57.949 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:57.947+0000 7fb02cb249c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:57.949 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:57.947+0000 7fb02cb249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:57.949 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:57.947+0000 7fb02cb249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:57.949 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:57.947+0000 7fb02cb249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:57.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:57.947+0000 7fb02cb249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:57.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:57.947+0000 7fb02cb249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:57.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:57.951+0000 7fb02cb249c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:57.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:57.951+0000 7fb02cb249c0 20 searching for the correct realm 2024-09-12T00:37:58.162 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.159+0000 7fb02ae2b640 0 -- 172.21.15.70:0/2390565599 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fb014004040 msgr2=0x7fb014134280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:58.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.375+0000 7fb02ae2b640 0 -- 172.21.15.70:0/2390565599 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fb014004040 msgr2=0x7fb014134280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:58.390 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.387+0000 7fb02cb249c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:58.390 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.387+0000 7fb02cb249c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:37:58.390 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.387+0000 7fb02cb249c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:58.390 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.387+0000 7fb02cb249c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:37:58.390 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.387+0000 7fb02cb249c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:58.391 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.387+0000 7fb02cb249c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:58.391 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.387+0000 7fb02cb249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.391 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.387+0000 7fb02cb249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:58.391 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.387+0000 7fb02cb249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.391 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.391+0000 7fb02cb249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:58.392 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.391+0000 7fb02cb249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.392 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.391+0000 7fb02cb249c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:58.392 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.391+0000 7fb02cb249c0 20 zone default found 2024-09-12T00:37:58.392 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.391+0000 7fb02cb249c0 4 Realm: () 2024-09-12T00:37:58.392 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.391+0000 7fb02cb249c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:37:58.393 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.391+0000 7fb02cb249c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:37:58.393 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.391+0000 7fb02cb249c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:58.393 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.391+0000 7fb02cb249c0 20 zonegroup default 2024-09-12T00:37:58.393 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.391+0000 7fb02cb249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.393 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.391+0000 7fb02cb249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:58.393 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.391+0000 7fb02cb249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.394 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.391+0000 7fb02cb249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:58.394 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.391+0000 7fb02cb249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.394 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.391+0000 7fb02cb249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:58.394 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.391+0000 7fb02cb249c0 20 started sync module instance, tier type = 2024-09-12T00:37:58.394 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.391+0000 7fb02cb249c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:37:58.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.415+0000 7fb02cb249c0 20 add_watcher() i=0 2024-09-12T00:37:58.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.415+0000 7fb02cb249c0 20 add_watcher() i=1 2024-09-12T00:37:58.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.415+0000 7fb02cb249c0 20 add_watcher() i=2 2024-09-12T00:37:58.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.415+0000 7fb02cb249c0 20 add_watcher() i=3 2024-09-12T00:37:58.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.415+0000 7fb02cb249c0 20 add_watcher() i=4 2024-09-12T00:37:58.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.415+0000 7fb02cb249c0 20 add_watcher() i=5 2024-09-12T00:37:58.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.415+0000 7fb02cb249c0 20 add_watcher() i=6 2024-09-12T00:37:58.421 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.419+0000 7fb02cb249c0 20 add_watcher() i=7 2024-09-12T00:37:58.422 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.419+0000 7fb02cb249c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:58.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.423+0000 7faee0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:58.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.423+0000 7fb02cb249c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:58.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.423+0000 7fb02cb249c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:58.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.423+0000 7fb02cb249c0 5 note: GC not initialized 2024-09-12T00:37:58.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.423+0000 7fae5b7fe640 20 reqs_thread_entry: start 2024-09-12T00:37:58.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.423+0000 7fb02cb249c0 20 init_complete bucket index max shards: 1 2024-09-12T00:37:58.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.427+0000 7fb02cb249c0 20 Filter name: none 2024-09-12T00:37:58.428 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.427+0000 7fae597fa640 20 reqs_thread_entry: start 2024-09-12T00:37:58.428 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.427+0000 7fb02cb249c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:37:58.428 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.427+0000 7fb02cb249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.428 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.427+0000 7fb02cb249c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:37:58.429 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.427+0000 7fb02cb249c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:37:58.429 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.427+0000 7fb02cb249c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:37:58.429 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.427+0000 7fb02cb249c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 : miss 2024-09-12T00:37:58.429 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.427+0000 7fb02cb249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.430 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.427+0000 7fb02cb249c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:37:58.430 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.427+0000 7fb02cb249c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 info.flags=0x17 2024-09-12T00:37:58.430 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.427+0000 7fb02cb249c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 to cache LRU end 2024-09-12T00:37:58.430 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.427+0000 7fb02cb249c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:58.430 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.427+0000 7fb02cb249c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:37:58.430 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.427+0000 7fb02cb249c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 2024-09-12T00:37:58.430 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.427+0000 7fb02cb249c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.432 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.431+0000 7fb02cb249c0 1 NOTICE: finished shard 0 (4 entries found) 2024-09-12T00:37:58.432 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.431+0000 7fb02cb249c0 1 NOTICE: finished all shards (4 entries found) 2024-09-12T00:37:58.433 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.431+0000 7faee0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:58.438 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.435+0000 7fb02cb249c0 20 remove_watcher() i=0 2024-09-12T00:37:58.438 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.435+0000 7fb02cb249c0 2 removed watcher, disabling cache 2024-09-12T00:37:58.440 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.439+0000 7fb02cb249c0 20 remove_watcher() i=1 2024-09-12T00:37:58.443 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.439+0000 7fb02cb249c0 20 remove_watcher() i=2 2024-09-12T00:37:58.445 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.443+0000 7fb02cb249c0 20 remove_watcher() i=3 2024-09-12T00:37:58.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.443+0000 7fb02cb249c0 20 remove_watcher() i=4 2024-09-12T00:37:58.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.447+0000 7fb02cb249c0 20 remove_watcher() i=5 2024-09-12T00:37:58.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.447+0000 7fb02cb249c0 20 remove_watcher() i=6 2024-09-12T00:37:58.452 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.451+0000 7fb02cb249c0 20 remove_watcher() i=7 2024-09-12T00:37:58.466 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: unlinked entries are not listable 2024-09-12T00:37:58.466 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:37:58.468 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:58.468 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:58.473 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-12T00:37:58.473 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:37:58.475 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:58.475 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:58.523 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:58.524 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:58.568 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-12T00:37:58.569 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:37:58.569 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:37:58.610 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:58.610 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:58.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.651+0000 7ffb4ef2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.654 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.651+0000 7ffb4ef2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:58.654 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.651+0000 7ffb4ef2a9c0 20 realm 2024-09-12T00:37:58.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.651+0000 7ffb4ef2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.651+0000 7ffb4ef2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:58.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.651+0000 7ffb4ef2a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:58.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.651+0000 7ffb4ef2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.651+0000 7ffb4ef2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:58.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.651+0000 7ffb4ef2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.655+0000 7ffb4ef2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:58.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.655+0000 7ffb4ef2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.655+0000 7ffb4ef2a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:58.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.655+0000 7ffb4ef2a9c0 20 searching for the correct realm 2024-09-12T00:37:58.662 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.659+0000 7ffb4d231640 0 -- 172.21.15.70:0/1246525234 >> [v2:172.21.15.70:6808/276433067,v1:172.21.15.70:6809/276433067] conn(0x5649dfd13f90 msgr2=0x5649dfd16450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:58.670 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.667+0000 7ffb4ca30640 0 -- 172.21.15.70:0/1246525234 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7ffb3c008050 msgr2=0x7ffb3c032920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:58.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.671+0000 7ffb4ef2a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:58.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.671+0000 7ffb4ef2a9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:37:58.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.671+0000 7ffb4ef2a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:58.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.671+0000 7ffb4ef2a9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:37:58.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.671+0000 7ffb4ef2a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:58.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.671+0000 7ffb4ef2a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:58.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.671+0000 7ffb4ef2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.675+0000 7ffb4ef2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:58.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.675+0000 7ffb4ef2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.675+0000 7ffb4ef2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:58.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.675+0000 7ffb4ef2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.675+0000 7ffb4ef2a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:58.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.675+0000 7ffb4ef2a9c0 20 zone default found 2024-09-12T00:37:58.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.675+0000 7ffb4ef2a9c0 4 Realm: () 2024-09-12T00:37:58.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.675+0000 7ffb4ef2a9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:37:58.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.675+0000 7ffb4ef2a9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:37:58.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.675+0000 7ffb4ef2a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:58.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.675+0000 7ffb4ef2a9c0 20 zonegroup default 2024-09-12T00:37:58.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.675+0000 7ffb4ef2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.675+0000 7ffb4ef2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:58.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.675+0000 7ffb4ef2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.675+0000 7ffb4ef2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:58.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.675+0000 7ffb4ef2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.675+0000 7ffb4ef2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:58.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.675+0000 7ffb4ef2a9c0 20 started sync module instance, tier type = 2024-09-12T00:37:58.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.675+0000 7ffb4ef2a9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:37:58.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.691+0000 7ffb4ef2a9c0 20 add_watcher() i=0 2024-09-12T00:37:58.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.691+0000 7ffb4ef2a9c0 20 add_watcher() i=1 2024-09-12T00:37:58.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.691+0000 7ffb4ef2a9c0 20 add_watcher() i=2 2024-09-12T00:37:58.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.691+0000 7ffb4ef2a9c0 20 add_watcher() i=3 2024-09-12T00:37:58.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.691+0000 7ffb4ef2a9c0 20 add_watcher() i=4 2024-09-12T00:37:58.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.691+0000 7ffb4ef2a9c0 20 add_watcher() i=5 2024-09-12T00:37:58.694 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.691+0000 7ffb4ef2a9c0 20 add_watcher() i=6 2024-09-12T00:37:58.694 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.691+0000 7ffb4ef2a9c0 20 add_watcher() i=7 2024-09-12T00:37:58.694 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.691+0000 7ffb4ef2a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:58.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.695+0000 7ffa02fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:58.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.695+0000 7ffb4ef2a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:58.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.695+0000 7ffb4ef2a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:58.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.695+0000 7ffb4ef2a9c0 5 note: GC not initialized 2024-09-12T00:37:58.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.695+0000 7ffa01fe3640 20 reqs_thread_entry: start 2024-09-12T00:37:58.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.695+0000 7ffb4ef2a9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:37:58.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.695+0000 7ffb4ef2a9c0 20 Filter name: none 2024-09-12T00:37:58.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.695+0000 7ff9737fe640 20 reqs_thread_entry: start 2024-09-12T00:37:58.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.695+0000 7ffb4ef2a9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:37:58.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.695+0000 7ffb4ef2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.695+0000 7ffb4ef2a9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:37:58.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.695+0000 7ffb4ef2a9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:37:58.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.695+0000 7ffb4ef2a9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:37:58.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.695+0000 7ffb4ef2a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 : miss 2024-09-12T00:37:58.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.695+0000 7ffb4ef2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.695+0000 7ffb4ef2a9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:37:58.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.695+0000 7ffb4ef2a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 info.flags=0x17 2024-09-12T00:37:58.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.695+0000 7ffb4ef2a9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 to cache LRU end 2024-09-12T00:37:58.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.695+0000 7ffb4ef2a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:58.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.695+0000 7ffb4ef2a9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:37:58.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.695+0000 7ffb4ef2a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 2024-09-12T00:37:58.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.695+0000 7ffb4ef2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.699+0000 7ffb4ef2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.699+0000 7ffb4ef2a9c0 20 get_obj_state: octx=0x5649dfa98740 obj=check-bucket:c state=0x5649dfd47748 s->prefetch_data=0 2024-09-12T00:37:58.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.699+0000 7ffb4ef2a9c0 20 get_obj_state: setting s->obj_tag to xyr33bcs4yqbzmzrewggz2ngeh5dv30b 2024-09-12T00:37:58.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.699+0000 7ffb4ef2a9c0 20 get_obj_state_impl: setting s->olh_tag to 9dxb4cb4uq1n1j8n4q8p562cmyqw0623 2024-09-12T00:37:58.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.699+0000 7ffb4ef2a9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=9dxb4cb4uq1n1j8n4q8p562cmyqw0623 2024-09-12T00:37:58.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.699+0000 7ffb4ef2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.699+0000 7ffb4ef2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.699+0000 7ffb4ef2a9c0 20 olh_log_entry: epoch=3 op=3 key=c[NrcXOdbIr3ThecnOgheCwXHsWgRlTpo] 2024-09-12T00:37:58.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.699+0000 7ffb4ef2a9c0 20 get_obj_state: octx=0x5649dfa98740 obj=check-bucket:_:NrcXOdbIr3ThecnOgheCwXHsWgRlTpo_c state=0x5649dfd41e58 s->prefetch_data=0 2024-09-12T00:37:58.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.703+0000 7ffb4ef2a9c0 10 manifest: total_size = 22 2024-09-12T00:37:58.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.703+0000 7ffb4ef2a9c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7456792959224360771 2024-09-12T00:37:58.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.703+0000 7ffb4ef2a9c0 20 get_obj_state: octx=0x5649dfa98740 obj=check-bucket:_:NrcXOdbIr3ThecnOgheCwXHsWgRlTpo_c state=0x5649dfd41e58 s->prefetch_data=0 2024-09-12T00:37:58.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.703+0000 7ffb4ef2a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5649dfd41e58 2024-09-12T00:37:58.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.703+0000 7ffb4ef2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.707+0000 7ffb4ef2a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:37:58.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.707+0000 7ffb4ef2a9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:37:58.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.707+0000 7ffb4ef2a9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:37:58.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.707+0000 7ffb4ef2a9c0 5 delete_objs_inline: removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2__shadow:NrcXOdbIr3ThecnOgheCwXHsWgRlTpo_.aMN-EQhSxCJoYdRoFewkAiGnQ0YbDGO_0 2024-09-12T00:37:58.708 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.707+0000 7ffb4ef2a9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:37:58.708 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.707+0000 7ffa237fe640 20 handle_completion(): completion ok for obj=c[NrcXOdbIr3ThecnOgheCwXHsWgRlTpo] 2024-09-12T00:37:58.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.707+0000 7ffb4ef2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.707+0000 7ffb4ef2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.707+0000 7ffb4ef2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.711 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.707+0000 7ffb4ef2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.711 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.711+0000 7ffb4ef2a9c0 20 get_obj_state: octx=0x5649dfa98740 obj=check-bucket:d state=0x5649dfd459c8 s->prefetch_data=0 2024-09-12T00:37:58.711 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.711+0000 7ffb4ef2a9c0 20 get_obj_state: setting s->obj_tag to g14603rb3p9f1yi0r6o0cg0gppi39jdu 2024-09-12T00:37:58.712 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.711+0000 7ffb4ef2a9c0 20 get_obj_state_impl: setting s->olh_tag to zo0z79pdojkkfcgu93vkyc2v0ffoyw6r 2024-09-12T00:37:58.712 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.711+0000 7ffb4ef2a9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zo0z79pdojkkfcgu93vkyc2v0ffoyw6r 2024-09-12T00:37:58.713 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.711+0000 7ffb4ef2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.714 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.711+0000 7ffb4ef2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.711+0000 7ffb4ef2a9c0 20 olh_log_entry: epoch=3 op=3 key=d[ce6TvmhDLrtqtaoPBz6VH8raMKwCM4d] 2024-09-12T00:37:58.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.711+0000 7ffb4ef2a9c0 20 get_obj_state: octx=0x5649dfa98740 obj=check-bucket:_:ce6TvmhDLrtqtaoPBz6VH8raMKwCM4d_d state=0x5649dfd41e58 s->prefetch_data=0 2024-09-12T00:37:58.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.711+0000 7ffb4ef2a9c0 10 manifest: total_size = 22 2024-09-12T00:37:58.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.711+0000 7ffb4ef2a9c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.253988306002595344 2024-09-12T00:37:58.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.711+0000 7ffb4ef2a9c0 20 get_obj_state: octx=0x5649dfa98740 obj=check-bucket:_:ce6TvmhDLrtqtaoPBz6VH8raMKwCM4d_d state=0x5649dfd41e58 s->prefetch_data=0 2024-09-12T00:37:58.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.711+0000 7ffb4ef2a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5649dfd41e58 2024-09-12T00:37:58.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.715+0000 7ffb4ef2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.715+0000 7ffb4ef2a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:37:58.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.715+0000 7ffb4ef2a9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:37:58.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.715+0000 7ffb4ef2a9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:37:58.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.715+0000 7ffb4ef2a9c0 5 delete_objs_inline: removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2__shadow:ce6TvmhDLrtqtaoPBz6VH8raMKwCM4d_.UjTL6IPFk2c-HKU1-EEFAvHKmBfDknI_0 2024-09-12T00:37:58.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.715+0000 7ffa23fff640 20 handle_completion(): completion ok for obj=d[ce6TvmhDLrtqtaoPBz6VH8raMKwCM4d] 2024-09-12T00:37:58.719 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.719+0000 7ffb4ef2a9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:37:58.721 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.719+0000 7ffb4ef2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.721 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.719+0000 7ffb4ef2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.722 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.719+0000 7ffb4ef2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.719+0000 7ffb4ef2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.719+0000 7ffb4ef2a9c0 20 get_obj_state: octx=0x5649dfa98740 obj=check-bucket:e state=0x5649dfd459c8 s->prefetch_data=0 2024-09-12T00:37:58.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.723+0000 7ffb4ef2a9c0 20 get_obj_state: setting s->obj_tag to 37lcir8e1wdtik3rpt7pvccsd3f5qgnn 2024-09-12T00:37:58.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.723+0000 7ffb4ef2a9c0 20 get_obj_state_impl: setting s->olh_tag to lrrsizesuih9ar03d7jzepoq61zwn55g 2024-09-12T00:37:58.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.723+0000 7ffb4ef2a9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=lrrsizesuih9ar03d7jzepoq61zwn55g 2024-09-12T00:37:58.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.723+0000 7ffb4ef2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.727+0000 7ffb4ef2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.728 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.727+0000 7ffb4ef2a9c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T00:37:58.728 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.727+0000 7ffb4ef2a9c0 20 olh_log_entry: epoch=2 op=3 key=e[cX17SF0HEsGdAGdiADUN1m8sFgQ7Pv7] 2024-09-12T00:37:58.728 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.727+0000 7ffb4ef2a9c0 20 get_obj_state: octx=0x5649dfa98740 obj=check-bucket:_:cX17SF0HEsGdAGdiADUN1m8sFgQ7Pv7_e state=0x5649dfd41e58 s->prefetch_data=0 2024-09-12T00:37:58.728 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.727+0000 7ffb4ef2a9c0 10 manifest: total_size = 9 2024-09-12T00:37:58.728 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.727+0000 7ffb4ef2a9c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11933505219776789761 2024-09-12T00:37:58.728 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.727+0000 7ffb4ef2a9c0 20 get_obj_state: octx=0x5649dfa98740 obj=check-bucket:_:cX17SF0HEsGdAGdiADUN1m8sFgQ7Pv7_e state=0x5649dfd41e58 s->prefetch_data=0 2024-09-12T00:37:58.728 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.727+0000 7ffb4ef2a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5649dfd41e58 2024-09-12T00:37:58.728 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.727+0000 7ffb4ef2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.730 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.727+0000 7ffb4ef2a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:37:58.730 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.727+0000 7ffb4ef2a9c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-12T00:37:58.730 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.727+0000 7ffb4ef2a9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:37:58.730 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.727+0000 7ffb4ef2a9c0 5 delete_objs_inline: removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2__shadow:cX17SF0HEsGdAGdiADUN1m8sFgQ7Pv7_.7sMb8jgAbd_rpqx1kfonGMtzrKdbBQx_0 2024-09-12T00:37:58.731 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.727+0000 7ffa23fff640 20 handle_completion(): completion ok for obj=e[cX17SF0HEsGdAGdiADUN1m8sFgQ7Pv7] 2024-09-12T00:37:58.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.731+0000 7ffb4ef2a9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:37:58.735 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.731+0000 7ffb4ef2a9c0 20 get_obj_state: octx=0x5649dfa98740 obj=check-bucket:e state=0x5649dfd459c8 s->prefetch_data=0 2024-09-12T00:37:58.735 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.731+0000 7ffb4ef2a9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=lrrsizesuih9ar03d7jzepoq61zwn55g 2024-09-12T00:37:58.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.739+0000 7ffb4ef2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.741 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.739+0000 7ffb4ef2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.742 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.739+0000 7ffb4ef2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.742 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.739+0000 7ffb4ef2a9c0 20 get_obj_state: octx=0x5649dfa98740 obj=check-bucket:f state=0x5649dfd459c8 s->prefetch_data=0 2024-09-12T00:37:58.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.739+0000 7ffb4ef2a9c0 20 get_obj_state: setting s->obj_tag to 00l1yum2zomd1jr4eeqdb9j2f41r8i43 2024-09-12T00:37:58.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.739+0000 7ffb4ef2a9c0 20 get_obj_state_impl: setting s->olh_tag to fehfomfpq1pp2oybjx4dk3r1lfa02r45 2024-09-12T00:37:58.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.739+0000 7ffb4ef2a9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=fehfomfpq1pp2oybjx4dk3r1lfa02r45 2024-09-12T00:37:58.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.743+0000 7ffb4ef2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.743+0000 7ffb4ef2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.743+0000 7ffb4ef2a9c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T00:37:58.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.743+0000 7ffb4ef2a9c0 20 olh_log_entry: epoch=2 op=3 key=f[gm1cMvTCBi0GBkXXOGE--eM8iJ0jebi] 2024-09-12T00:37:58.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.743+0000 7ffb4ef2a9c0 20 get_obj_state: octx=0x5649dfa98740 obj=check-bucket:_:gm1cMvTCBi0GBkXXOGE--eM8iJ0jebi_f state=0x5649dfd41e58 s->prefetch_data=0 2024-09-12T00:37:58.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.743+0000 7ffb4ef2a9c0 10 manifest: total_size = 12 2024-09-12T00:37:58.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.743+0000 7ffb4ef2a9c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17773819304824884807 2024-09-12T00:37:58.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.743+0000 7ffb4ef2a9c0 20 get_obj_state: octx=0x5649dfa98740 obj=check-bucket:_:gm1cMvTCBi0GBkXXOGE--eM8iJ0jebi_f state=0x5649dfd41e58 s->prefetch_data=0 2024-09-12T00:37:58.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.743+0000 7ffb4ef2a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5649dfd41e58 2024-09-12T00:37:58.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.743+0000 7ffb4ef2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.750 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.747+0000 7ffb4ef2a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:37:58.750 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.747+0000 7ffb4ef2a9c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T00:37:58.750 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.747+0000 7ffb4ef2a9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:37:58.750 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.747+0000 7ffb4ef2a9c0 5 delete_objs_inline: removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2__shadow:gm1cMvTCBi0GBkXXOGE--eM8iJ0jebi_.PjQ58IThF_C6TKP1YhLlXzx-mbX8Dqp_0 2024-09-12T00:37:58.751 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.747+0000 7ffa23fff640 20 handle_completion(): completion ok for obj=f[gm1cMvTCBi0GBkXXOGE--eM8iJ0jebi] 2024-09-12T00:37:58.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.751+0000 7ffb4ef2a9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:37:58.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.751+0000 7ffb4ef2a9c0 20 get_obj_state: octx=0x5649dfa98740 obj=check-bucket:f state=0x5649dfd459c8 s->prefetch_data=0 2024-09-12T00:37:58.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.751+0000 7ffb4ef2a9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=fehfomfpq1pp2oybjx4dk3r1lfa02r45 2024-09-12T00:37:58.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.755+0000 7ffb4ef2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.760 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.759+0000 7ffb4ef2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.760 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.759+0000 7ffb4ef2a9c0 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-12T00:37:58.760 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.759+0000 7ffb4ef2a9c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T00:37:58.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.759+0000 7ffa02fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:58.766 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.763+0000 7ffb4ef2a9c0 20 remove_watcher() i=0 2024-09-12T00:37:58.766 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.763+0000 7ffb4ef2a9c0 2 removed watcher, disabling cache 2024-09-12T00:37:58.768 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.767+0000 7ffb4ef2a9c0 20 remove_watcher() i=1 2024-09-12T00:37:58.770 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.767+0000 7ffb4ef2a9c0 20 remove_watcher() i=2 2024-09-12T00:37:58.773 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.771+0000 7ffb4ef2a9c0 20 remove_watcher() i=3 2024-09-12T00:37:58.775 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.771+0000 7ffb4ef2a9c0 20 remove_watcher() i=4 2024-09-12T00:37:58.776 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.775+0000 7ffb4ef2a9c0 20 remove_watcher() i=5 2024-09-12T00:37:58.777 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.775+0000 7ffb4ef2a9c0 20 remove_watcher() i=6 2024-09-12T00:37:58.778 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.775+0000 7ffb4ef2a9c0 20 remove_watcher() i=7 2024-09-12T00:37:58.791 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:58.791 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:58.794 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:58.794 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:58.797 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:58.797 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:58.799 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:58.800 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:58.801 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-12T00:37:58.801 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:37:58.802 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:58.802 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:58.852 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:58.852 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:58.856 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:58.856 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:58.861 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:58.861 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:58.865 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:58.866 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:58.869 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-12T00:37:58.869 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:37:58.869 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:37:58.900 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:58.900 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:58.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.939+0000 7f790602d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.939+0000 7f790602d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:58.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.939+0000 7f790602d9c0 20 realm 2024-09-12T00:37:58.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.939+0000 7f790602d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.939+0000 7f790602d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:58.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.939+0000 7f790602d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:58.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.939+0000 7f790602d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.944 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.943+0000 7f790602d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:58.944 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.943+0000 7f790602d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.945 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.943+0000 7f790602d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:58.945 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.943+0000 7f790602d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.946 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.943+0000 7f790602d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:58.946 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.943+0000 7f790602d9c0 20 searching for the correct realm 2024-09-12T00:37:58.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.951+0000 7f7904334640 0 -- 172.21.15.70:0/3064234934 >> [v2:172.21.15.70:6808/276433067,v1:172.21.15.70:6809/276433067] conn(0x5564f01fb910 msgr2=0x5564f01fddd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:58.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.959+0000 7f7904334640 0 -- 172.21.15.70:0/3064234934 >> [v2:172.21.15.70:6816/1979013808,v1:172.21.15.70:6817/1979013808] conn(0x5564f01ef030 msgr2=0x5564f01f14f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:58.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.963+0000 7f790602d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:58.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.963+0000 7f790602d9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:37:58.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.963+0000 7f790602d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:58.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.963+0000 7f790602d9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:37:58.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.963+0000 7f790602d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:58.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.963+0000 7f790602d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:58.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.963+0000 7f790602d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.963+0000 7f790602d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:58.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.963+0000 7f790602d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.963+0000 7f790602d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:58.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.963+0000 7f790602d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.963+0000 7f790602d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:58.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.963+0000 7f790602d9c0 20 zone default found 2024-09-12T00:37:58.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.963+0000 7f790602d9c0 4 Realm: () 2024-09-12T00:37:58.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.963+0000 7f790602d9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:37:58.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.963+0000 7f790602d9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:37:58.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.963+0000 7f790602d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:58.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.963+0000 7f790602d9c0 20 zonegroup default 2024-09-12T00:37:58.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.963+0000 7f790602d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.963+0000 7f790602d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:58.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.963+0000 7f790602d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.963+0000 7f790602d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:58.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.963+0000 7f790602d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.963+0000 7f790602d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:58.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.963+0000 7f790602d9c0 20 started sync module instance, tier type = 2024-09-12T00:37:58.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.963+0000 7f790602d9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:37:58.983 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.979+0000 7f790602d9c0 20 add_watcher() i=0 2024-09-12T00:37:58.983 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.979+0000 7f790602d9c0 20 add_watcher() i=1 2024-09-12T00:37:58.983 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.979+0000 7f790602d9c0 20 add_watcher() i=2 2024-09-12T00:37:58.983 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.979+0000 7f790602d9c0 20 add_watcher() i=3 2024-09-12T00:37:58.983 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.979+0000 7f790602d9c0 20 add_watcher() i=4 2024-09-12T00:37:58.983 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.979+0000 7f790602d9c0 20 add_watcher() i=5 2024-09-12T00:37:58.983 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.979+0000 7f790602d9c0 20 add_watcher() i=6 2024-09-12T00:37:58.984 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.983+0000 7f790602d9c0 20 add_watcher() i=7 2024-09-12T00:37:58.984 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.983+0000 7f790602d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:58.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.983+0000 7f77b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:58.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.983+0000 7f790602d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:58.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.983+0000 7f790602d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:58.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.983+0000 7f790602d9c0 5 note: GC not initialized 2024-09-12T00:37:58.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.983+0000 7f77b8fe1640 20 reqs_thread_entry: start 2024-09-12T00:37:58.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.983+0000 7f790602d9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:37:58.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.987+0000 7f790602d9c0 20 Filter name: none 2024-09-12T00:37:58.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.987+0000 7f77327fc640 20 reqs_thread_entry: start 2024-09-12T00:37:58.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.987+0000 7f790602d9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:37:58.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.987+0000 7f790602d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.987+0000 7f790602d9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:37:58.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.987+0000 7f790602d9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:37:58.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.987+0000 7f790602d9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:37:58.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.987+0000 7f790602d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 : miss 2024-09-12T00:37:58.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.987+0000 7f790602d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:58.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.987+0000 7f790602d9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:37:58.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.987+0000 7f790602d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 info.flags=0x17 2024-09-12T00:37:58.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.987+0000 7f790602d9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 to cache LRU end 2024-09-12T00:37:58.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.987+0000 7f790602d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:58.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.987+0000 7f790602d9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:37:58.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.987+0000 7f790602d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 2024-09-12T00:37:58.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.987+0000 7f790602d9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:58.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.987+0000 7f790602d9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:37:58.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.987+0000 7f790602d9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:37:58.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.987+0000 7f77b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:58.994 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.991+0000 7f790602d9c0 20 remove_watcher() i=0 2024-09-12T00:37:58.995 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.991+0000 7f790602d9c0 2 removed watcher, disabling cache 2024-09-12T00:37:58.997 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.995+0000 7f790602d9c0 20 remove_watcher() i=1 2024-09-12T00:37:58.998 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.995+0000 7f790602d9c0 20 remove_watcher() i=2 2024-09-12T00:37:59.000 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:58.999+0000 7f790602d9c0 20 remove_watcher() i=3 2024-09-12T00:37:59.005 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.003+0000 7f790602d9c0 20 remove_watcher() i=4 2024-09-12T00:37:59.006 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.003+0000 7f790602d9c0 20 remove_watcher() i=5 2024-09-12T00:37:59.007 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.007+0000 7f790602d9c0 20 remove_watcher() i=6 2024-09-12T00:37:59.008 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.007+0000 7f790602d9c0 20 remove_watcher() i=7 2024-09-12T00:37:59.024 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:59.024 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:59.040 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:59.040 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:37:59.057 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:37:59.085 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:59.086 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:59.128 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.127+0000 7f63947fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.127+0000 7f63947fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:59.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.127+0000 7f63947fa9c0 20 realm 2024-09-12T00:37:59.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.127+0000 7f63947fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.127+0000 7f63947fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:59.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.127+0000 7f63947fa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:59.131 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.127+0000 7f63947fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.131 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.127+0000 7f63947fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:59.131 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.127+0000 7f63947fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.131+0000 7f63947fa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:59.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.131+0000 7f63947fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.131+0000 7f63947fa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:59.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.131+0000 7f63947fa9c0 20 searching for the correct realm 2024-09-12T00:37:59.139 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.135+0000 7f6392b01640 0 -- 172.21.15.70:0/2661421173 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f637c008030 msgr2=0x7f637c05b880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:59.147 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.143+0000 7f6392300640 0 -- 172.21.15.70:0/2661421173 >> [v2:172.21.15.187:6824/1546875221,v1:172.21.15.187:6825/1546875221] conn(0x563f5c6a1e90 msgr2=0x563f5c6a4350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:59.151 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.147+0000 7f63947fa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:59.151 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.147+0000 7f63947fa9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:37:59.152 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.147+0000 7f63947fa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:59.152 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.147+0000 7f63947fa9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:37:59.152 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.147+0000 7f63947fa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:59.152 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.147+0000 7f63947fa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:59.152 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.151+0000 7f63947fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.152 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.151+0000 7f63947fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:59.152 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.151+0000 7f63947fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.151+0000 7f63947fa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:59.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.151+0000 7f63947fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.151+0000 7f63947fa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:59.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.151+0000 7f63947fa9c0 20 zone default found 2024-09-12T00:37:59.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.151+0000 7f63947fa9c0 4 Realm: () 2024-09-12T00:37:59.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.151+0000 7f63947fa9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:37:59.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.151+0000 7f63947fa9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:37:59.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.151+0000 7f63947fa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:59.154 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.151+0000 7f63947fa9c0 20 zonegroup default 2024-09-12T00:37:59.154 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.151+0000 7f63947fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.154 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.151+0000 7f63947fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:59.154 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.151+0000 7f63947fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.151+0000 7f63947fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:59.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.151+0000 7f63947fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.151+0000 7f63947fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:59.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.151+0000 7f63947fa9c0 20 started sync module instance, tier type = 2024-09-12T00:37:59.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.151+0000 7f63947fa9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:37:59.170 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.167+0000 7f63947fa9c0 20 add_watcher() i=0 2024-09-12T00:37:59.170 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.167+0000 7f63947fa9c0 20 add_watcher() i=1 2024-09-12T00:37:59.171 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.167+0000 7f63947fa9c0 20 add_watcher() i=2 2024-09-12T00:37:59.171 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.167+0000 7f63947fa9c0 20 add_watcher() i=3 2024-09-12T00:37:59.171 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.167+0000 7f63947fa9c0 20 add_watcher() i=4 2024-09-12T00:37:59.171 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.167+0000 7f63947fa9c0 20 add_watcher() i=5 2024-09-12T00:37:59.171 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.167+0000 7f63947fa9c0 20 add_watcher() i=6 2024-09-12T00:37:59.172 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.167+0000 7f63947fa9c0 20 add_watcher() i=7 2024-09-12T00:37:59.172 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.167+0000 7f63947fa9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:59.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.171+0000 7f6248fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:59.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.171+0000 7f63947fa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:59.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.171+0000 7f63947fa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:59.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.171+0000 7f63947fa9c0 5 note: GC not initialized 2024-09-12T00:37:59.177 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.171+0000 7f61c37fe640 20 reqs_thread_entry: start 2024-09-12T00:37:59.177 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.171+0000 7f63947fa9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:37:59.177 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.171+0000 7f63947fa9c0 20 Filter name: none 2024-09-12T00:37:59.177 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.171+0000 7f61c17fa640 20 reqs_thread_entry: start 2024-09-12T00:37:59.177 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.171+0000 7f63947fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.177 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.171+0000 7f63947fa9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:37:59.178 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.171+0000 7f63947fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.178 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.171+0000 7f63947fa9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:37:59.178 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.171+0000 7f63947fa9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:59.178 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.171+0000 7f63947fa9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:37:59.178 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.171+0000 7f63947fa9c0 20 INFO: main: starting shard=0 2024-09-12T00:37:59.178 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.171+0000 7f63947fa9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:59.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.175+0000 7f63947fa9c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T00:37:59.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.175+0000 7f63947fa9c0 20 INFO: main: done 2024-09-12T00:37:59.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.175+0000 7f6248fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:59.181 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.179+0000 7f63947fa9c0 20 remove_watcher() i=0 2024-09-12T00:37:59.181 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.179+0000 7f63947fa9c0 2 removed watcher, disabling cache 2024-09-12T00:37:59.183 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.179+0000 7f63947fa9c0 20 remove_watcher() i=1 2024-09-12T00:37:59.185 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.183+0000 7f63947fa9c0 20 remove_watcher() i=2 2024-09-12T00:37:59.187 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.183+0000 7f63947fa9c0 20 remove_watcher() i=3 2024-09-12T00:37:59.189 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.187+0000 7f63947fa9c0 20 remove_watcher() i=4 2024-09-12T00:37:59.190 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.187+0000 7f63947fa9c0 20 remove_watcher() i=5 2024-09-12T00:37:59.191 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.191+0000 7f63947fa9c0 20 remove_watcher() i=6 2024-09-12T00:37:59.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.191+0000 7f63947fa9c0 20 remove_watcher() i=7 2024-09-12T00:37:59.206 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:37:59.235 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:59.235 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:59.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.275+0000 7fa22f4299c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.275+0000 7fa22f4299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:59.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.275+0000 7fa22f4299c0 20 realm 2024-09-12T00:37:59.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.275+0000 7fa22f4299c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.275+0000 7fa22f4299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:59.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.275+0000 7fa22f4299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:59.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.275+0000 7fa22f4299c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.275+0000 7fa22f4299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:59.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.275+0000 7fa22f4299c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.279 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.279+0000 7fa22f4299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:59.280 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.279+0000 7fa22f4299c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.280 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.279+0000 7fa22f4299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:59.280 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.279+0000 7fa22f4299c0 20 searching for the correct realm 2024-09-12T00:37:59.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.283+0000 7fa22d730640 0 -- 172.21.15.70:0/3098630916 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fa214008050 msgr2=0x7fa214065ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:37:59.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.499+0000 7fa22d730640 0 -- 172.21.15.70:0/3098630916 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fa214008050 msgr2=0x7fa214065ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:59.513 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.511+0000 7fa22f4299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:59.513 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.511+0000 7fa22f4299c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:37:59.513 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.511+0000 7fa22f4299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:59.513 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.511+0000 7fa22f4299c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:37:59.513 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.511+0000 7fa22f4299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:59.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.511+0000 7fa22f4299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:59.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.511+0000 7fa22f4299c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.511+0000 7fa22f4299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:59.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.511+0000 7fa22f4299c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.511+0000 7fa22f4299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:59.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.511+0000 7fa22f4299c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.511+0000 7fa22f4299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:59.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.515+0000 7fa22f4299c0 20 zone default found 2024-09-12T00:37:59.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.515+0000 7fa22f4299c0 4 Realm: () 2024-09-12T00:37:59.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.515+0000 7fa22f4299c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:37:59.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.515+0000 7fa22f4299c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:37:59.516 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.515+0000 7fa22f4299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:59.516 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.515+0000 7fa22f4299c0 20 zonegroup default 2024-09-12T00:37:59.516 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.515+0000 7fa22f4299c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.515+0000 7fa22f4299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:59.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.515+0000 7fa22f4299c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.515+0000 7fa22f4299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:59.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.515+0000 7fa22f4299c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.515+0000 7fa22f4299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:59.518 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.515+0000 7fa22f4299c0 20 started sync module instance, tier type = 2024-09-12T00:37:59.518 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.515+0000 7fa22f4299c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:37:59.542 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.539+0000 7fa22f4299c0 20 add_watcher() i=0 2024-09-12T00:37:59.542 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.539+0000 7fa22f4299c0 20 add_watcher() i=1 2024-09-12T00:37:59.542 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.539+0000 7fa22f4299c0 20 add_watcher() i=2 2024-09-12T00:37:59.542 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.539+0000 7fa22f4299c0 20 add_watcher() i=3 2024-09-12T00:37:59.542 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.539+0000 7fa22f4299c0 20 add_watcher() i=4 2024-09-12T00:37:59.542 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.539+0000 7fa22f4299c0 20 add_watcher() i=5 2024-09-12T00:37:59.543 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.539+0000 7fa22f4299c0 20 add_watcher() i=6 2024-09-12T00:37:59.544 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.543+0000 7fa22f4299c0 20 add_watcher() i=7 2024-09-12T00:37:59.544 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.543+0000 7fa22f4299c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:59.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.547+0000 7fa0e2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:59.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.547+0000 7fa22f4299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:59.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.547+0000 7fa22f4299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:59.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.547+0000 7fa22f4299c0 5 note: GC not initialized 2024-09-12T00:37:59.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.547+0000 7fa0e1fe3640 20 reqs_thread_entry: start 2024-09-12T00:37:59.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.547+0000 7fa22f4299c0 20 init_complete bucket index max shards: 1 2024-09-12T00:37:59.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.547+0000 7fa22f4299c0 20 Filter name: none 2024-09-12T00:37:59.551 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.547+0000 7fa0537fe640 20 reqs_thread_entry: start 2024-09-12T00:37:59.551 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.547+0000 7fa22f4299c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.551 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.551+0000 7fa22f4299c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:37:59.552 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.551+0000 7fa22f4299c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.552 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.551+0000 7fa22f4299c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:37:59.552 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.551+0000 7fa22f4299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:59.552 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.551+0000 7fa22f4299c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:37:59.552 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.551+0000 7fa22f4299c0 20 INFO: main: starting shard=0 2024-09-12T00:37:59.553 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.551+0000 7fa22f4299c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:59.553 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.551+0000 7fa22f4299c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T00:37:59.553 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.551+0000 7fa22f4299c0 20 INFO: main: done 2024-09-12T00:37:59.554 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.551+0000 7fa0e2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:59.559 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.559+0000 7fa22f4299c0 20 remove_watcher() i=0 2024-09-12T00:37:59.559 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.559+0000 7fa22f4299c0 2 removed watcher, disabling cache 2024-09-12T00:37:59.562 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.559+0000 7fa22f4299c0 20 remove_watcher() i=1 2024-09-12T00:37:59.564 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.563+0000 7fa22f4299c0 20 remove_watcher() i=2 2024-09-12T00:37:59.566 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.563+0000 7fa22f4299c0 20 remove_watcher() i=3 2024-09-12T00:37:59.568 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.567+0000 7fa22f4299c0 20 remove_watcher() i=4 2024-09-12T00:37:59.570 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.567+0000 7fa22f4299c0 20 remove_watcher() i=5 2024-09-12T00:37:59.571 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.571+0000 7fa22f4299c0 20 remove_watcher() i=6 2024-09-12T00:37:59.573 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.571+0000 7fa22f4299c0 20 remove_watcher() i=7 2024-09-12T00:37:59.588 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-12T00:37:59.588 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:37:59.588 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T00:37:59.618 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:59.618 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:59.661 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.659+0000 7fa1c77cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.663+0000 7fa1c77cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:59.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.663+0000 7fa1c77cc9c0 20 realm 2024-09-12T00:37:59.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.663+0000 7fa1c77cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.663+0000 7fa1c77cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:59.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.663+0000 7fa1c77cc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:59.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.663+0000 7fa1c77cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.663+0000 7fa1c77cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:59.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.663+0000 7fa1c77cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.665 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.663+0000 7fa1c77cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:59.666 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.663+0000 7fa1c77cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.666 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.663+0000 7fa1c77cc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:59.666 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.663+0000 7fa1c77cc9c0 20 searching for the correct realm 2024-09-12T00:37:59.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.667+0000 7fa1c4ad1640 0 -- 172.21.15.70:0/2866926260 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7fa1c0089c20 msgr2=0x7fa1c0079e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:59.883 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.879+0000 7fa1c52d2640 0 -- 172.21.15.70:0/2866926260 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7fa1b802c060 msgr2=0x7fa1b805fe70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:59.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.895+0000 7fa1c77cc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:59.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.895+0000 7fa1c77cc9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:37:59.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.895+0000 7fa1c77cc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:59.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.895+0000 7fa1c77cc9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:37:59.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.895+0000 7fa1c77cc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:59.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.895+0000 7fa1c77cc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:59.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.895+0000 7fa1c77cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.899+0000 7fa1c77cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:59.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.899+0000 7fa1c77cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.899+0000 7fa1c77cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:59.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.899+0000 7fa1c77cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.899+0000 7fa1c77cc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:59.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.899+0000 7fa1c77cc9c0 20 zone default found 2024-09-12T00:37:59.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.899+0000 7fa1c77cc9c0 4 Realm: () 2024-09-12T00:37:59.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.899+0000 7fa1c77cc9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:37:59.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.899+0000 7fa1c77cc9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:37:59.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.899+0000 7fa1c77cc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:59.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.899+0000 7fa1c77cc9c0 20 zonegroup default 2024-09-12T00:37:59.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.899+0000 7fa1c77cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.899+0000 7fa1c77cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:59.903 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.899+0000 7fa1c77cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.903 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.903+0000 7fa1c77cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:59.903 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.903+0000 7fa1c77cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.904 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.903+0000 7fa1c77cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:59.904 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.903+0000 7fa1c77cc9c0 20 started sync module instance, tier type = 2024-09-12T00:37:59.904 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.903+0000 7fa1c77cc9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:37:59.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.927+0000 7fa1c77cc9c0 20 add_watcher() i=0 2024-09-12T00:37:59.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.927+0000 7fa1c77cc9c0 20 add_watcher() i=1 2024-09-12T00:37:59.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.927+0000 7fa1c77cc9c0 20 add_watcher() i=2 2024-09-12T00:37:59.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.927+0000 7fa1c77cc9c0 20 add_watcher() i=3 2024-09-12T00:37:59.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.927+0000 7fa1c77cc9c0 20 add_watcher() i=4 2024-09-12T00:37:59.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.927+0000 7fa1c77cc9c0 20 add_watcher() i=5 2024-09-12T00:37:59.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.927+0000 7fa1c77cc9c0 20 add_watcher() i=6 2024-09-12T00:37:59.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.927+0000 7fa1c77cc9c0 20 add_watcher() i=7 2024-09-12T00:37:59.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.931+0000 7fa1c77cc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:59.936 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.935+0000 7fa07b7ee640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:59.937 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.935+0000 7fa1c77cc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:59.937 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.935+0000 7fa1c77cc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:59.938 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.935+0000 7fa1c77cc9c0 5 note: GC not initialized 2024-09-12T00:37:59.938 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.935+0000 7fa07a7ec640 20 reqs_thread_entry: start 2024-09-12T00:37:59.938 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.935+0000 7fa1c77cc9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:37:59.938 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.935+0000 7fa1c77cc9c0 20 Filter name: none 2024-09-12T00:37:59.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.935+0000 7f9febfff640 20 reqs_thread_entry: start 2024-09-12T00:37:59.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.935+0000 7fa1c77cc9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:37:59.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.935+0000 7fa1c77cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.939+0000 7fa1c77cc9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:37:59.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.939+0000 7fa1c77cc9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:37:59.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.939+0000 7fa1c77cc9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:37:59.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.939+0000 7fa1c77cc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 : miss 2024-09-12T00:37:59.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.939+0000 7fa1c77cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:59.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.939+0000 7fa1c77cc9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:37:59.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.939+0000 7fa1c77cc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 info.flags=0x17 2024-09-12T00:37:59.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.939+0000 7fa1c77cc9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 to cache LRU end 2024-09-12T00:37:59.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.939+0000 7fa1c77cc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:59.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.939+0000 7fa1c77cc9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:37:59.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.939+0000 7fa1c77cc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 2024-09-12T00:37:59.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.939+0000 7fa1c77cc9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:37:59.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.939+0000 7fa1c77cc9c0 1 NOTICE: finished shard 0 (2 entries found) 2024-09-12T00:37:59.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.939+0000 7fa1c77cc9c0 1 NOTICE: finished all shards (2 entries found) 2024-09-12T00:37:59.942 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.939+0000 7fa07b7ee640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:59.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.947+0000 7fa1c77cc9c0 20 remove_watcher() i=0 2024-09-12T00:37:59.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.947+0000 7fa1c77cc9c0 2 removed watcher, disabling cache 2024-09-12T00:37:59.950 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.947+0000 7fa1c77cc9c0 20 remove_watcher() i=1 2024-09-12T00:37:59.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.951+0000 7fa1c77cc9c0 20 remove_watcher() i=2 2024-09-12T00:37:59.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.951+0000 7fa1c77cc9c0 20 remove_watcher() i=3 2024-09-12T00:37:59.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.955+0000 7fa1c77cc9c0 20 remove_watcher() i=4 2024-09-12T00:37:59.958 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.955+0000 7fa1c77cc9c0 20 remove_watcher() i=5 2024-09-12T00:37:59.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.959+0000 7fa1c77cc9c0 20 remove_watcher() i=6 2024-09-12T00:37:59.961 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:37:59.959+0000 7fa1c77cc9c0 20 remove_watcher() i=7 2024-09-12T00:37:59.977 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-12T00:37:59.978 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:37:59.978 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:38:00.012 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:00.013 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:00.054 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.051+0000 7f6f44d3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.055 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.051+0000 7f6f44d3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.055 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.051+0000 7f6f44d3e9c0 20 realm 2024-09-12T00:38:00.055 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.051+0000 7f6f44d3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.055 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.051+0000 7f6f44d3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.055 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.051+0000 7f6f44d3e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:00.056 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.051+0000 7f6f44d3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.056 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.055+0000 7f6f44d3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.056 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.055+0000 7f6f44d3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.057 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.055+0000 7f6f44d3e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:00.057 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.055+0000 7f6f44d3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.057 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.055+0000 7f6f44d3e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:00.057 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.055+0000 7f6f44d3e9c0 20 searching for the correct realm 2024-09-12T00:38:00.061 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.059+0000 7f6f43045640 0 -- 172.21.15.70:0/3797504942 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f6f380c9070 msgr2=0x7f6f3810a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:00.066 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.063+0000 7f6f42844640 0 -- 172.21.15.70:0/3797504942 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f6f3c064e80 msgr2=0x7f6f3c071900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:00.073 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.071+0000 7f6f44d3e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:00.073 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.071+0000 7f6f44d3e9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:38:00.073 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.071+0000 7f6f44d3e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:00.073 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.071+0000 7f6f44d3e9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:38:00.074 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.071+0000 7f6f44d3e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:00.074 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.071+0000 7f6f44d3e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:00.074 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.071+0000 7f6f44d3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.074 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.071+0000 7f6f44d3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.074 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.071+0000 7f6f44d3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.071+0000 7f6f44d3e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:00.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.071+0000 7f6f44d3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.071+0000 7f6f44d3e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:00.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.071+0000 7f6f44d3e9c0 20 zone default found 2024-09-12T00:38:00.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.071+0000 7f6f44d3e9c0 4 Realm: () 2024-09-12T00:38:00.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.071+0000 7f6f44d3e9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:38:00.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.071+0000 7f6f44d3e9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:38:00.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.071+0000 7f6f44d3e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:00.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.071+0000 7f6f44d3e9c0 20 zonegroup default 2024-09-12T00:38:00.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.071+0000 7f6f44d3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.071+0000 7f6f44d3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.071+0000 7f6f44d3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.077 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.075+0000 7f6f44d3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.077 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.075+0000 7f6f44d3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.077 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.075+0000 7f6f44d3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.077 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.075+0000 7f6f44d3e9c0 20 started sync module instance, tier type = 2024-09-12T00:38:00.077 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.075+0000 7f6f44d3e9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:38:00.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.087+0000 7f6f44d3e9c0 20 add_watcher() i=0 2024-09-12T00:38:00.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.087+0000 7f6f44d3e9c0 20 add_watcher() i=1 2024-09-12T00:38:00.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.087+0000 7f6f44d3e9c0 20 add_watcher() i=2 2024-09-12T00:38:00.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.087+0000 7f6f44d3e9c0 20 add_watcher() i=3 2024-09-12T00:38:00.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.087+0000 7f6f44d3e9c0 20 add_watcher() i=4 2024-09-12T00:38:00.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.087+0000 7f6f44d3e9c0 20 add_watcher() i=5 2024-09-12T00:38:00.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.087+0000 7f6f44d3e9c0 20 add_watcher() i=6 2024-09-12T00:38:00.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.087+0000 7f6f44d3e9c0 20 add_watcher() i=7 2024-09-12T00:38:00.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.087+0000 7f6f44d3e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:00.092 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.091+0000 7f6df9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:00.093 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.091+0000 7f6f44d3e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:00.093 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.091+0000 7f6f44d3e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:00.093 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.091+0000 7f6f44d3e9c0 5 note: GC not initialized 2024-09-12T00:38:00.094 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.091+0000 7f6df8fe1640 20 reqs_thread_entry: start 2024-09-12T00:38:00.094 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.091+0000 7f6f44d3e9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:38:00.094 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.091+0000 7f6f44d3e9c0 20 Filter name: none 2024-09-12T00:38:00.094 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.091+0000 7f6df1ffb640 20 reqs_thread_entry: start 2024-09-12T00:38:00.094 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.091+0000 7f6f44d3e9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:38:00.094 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.091+0000 7f6f44d3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.094 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.091+0000 7f6f44d3e9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:38:00.094 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.091+0000 7f6f44d3e9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:38:00.094 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.091+0000 7f6f44d3e9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:38:00.094 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.091+0000 7f6f44d3e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 : miss 2024-09-12T00:38:00.094 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.091+0000 7f6f44d3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.096 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.091+0000 7f6f44d3e9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:38:00.096 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.091+0000 7f6f44d3e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 info.flags=0x17 2024-09-12T00:38:00.096 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.091+0000 7f6f44d3e9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 to cache LRU end 2024-09-12T00:38:00.096 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.091+0000 7f6f44d3e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:00.096 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.091+0000 7f6f44d3e9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:38:00.096 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.091+0000 7f6f44d3e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 2024-09-12T00:38:00.096 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.091+0000 7f6f44d3e9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:00.096 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.091+0000 7f6f44d3e9c0 20 get_obj_state: octx=0x5578067bb730 obj=check-bucket:c state=0x557806a6d298 s->prefetch_data=0 2024-09-12T00:38:00.096 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.091+0000 7f6f44d3e9c0 20 get_obj_state: setting s->obj_tag to xyr33bcs4yqbzmzrewggz2ngeh5dv30b 2024-09-12T00:38:00.096 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.091+0000 7f6f44d3e9c0 20 get_obj_state_impl: setting s->olh_tag to 9dxb4cb4uq1n1j8n4q8p562cmyqw0623 2024-09-12T00:38:00.096 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.091+0000 7f6f44d3e9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:00.096 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.095+0000 7f6f44d3e9c0 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-12T00:38:00.096 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.095+0000 7f6f44d3e9c0 20 olh_log_entry: epoch=4 op=3 key=c[nx378LvW-xtPW42XVtq1R9jJ1GMqWrJ] 2024-09-12T00:38:00.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.095+0000 7f6f44d3e9c0 20 get_obj_state: octx=0x557806a966a0 obj=check-bucket:_:nx378LvW-xtPW42XVtq1R9jJ1GMqWrJ_c state=0x557806a67968 s->prefetch_data=0 2024-09-12T00:38:00.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.095+0000 7f6f44d3e9c0 20 get_obj_state: octx=0x557806a966a0 obj=check-bucket:c state=0x557806a69818 s->prefetch_data=0 2024-09-12T00:38:00.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.095+0000 7f6f44d3e9c0 20 get_obj_state: setting s->obj_tag to xyr33bcs4yqbzmzrewggz2ngeh5dv30b 2024-09-12T00:38:00.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.095+0000 7f6f44d3e9c0 20 get_obj_state_impl: setting s->olh_tag to 9dxb4cb4uq1n1j8n4q8p562cmyqw0623 2024-09-12T00:38:00.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.095+0000 7f6f44d3e9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=9dxb4cb4uq1n1j8n4q8p562cmyqw0623 2024-09-12T00:38:00.100 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.099+0000 7f6f44d3e9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:00.102 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.099+0000 7f6f44d3e9c0 20 get_obj_state: octx=0x5578067bb730 obj=check-bucket:d state=0x557806a6d298 s->prefetch_data=0 2024-09-12T00:38:00.103 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.099+0000 7f6f44d3e9c0 20 get_obj_state: setting s->obj_tag to g14603rb3p9f1yi0r6o0cg0gppi39jdu 2024-09-12T00:38:00.103 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.099+0000 7f6f44d3e9c0 20 get_obj_state_impl: setting s->olh_tag to zo0z79pdojkkfcgu93vkyc2v0ffoyw6r 2024-09-12T00:38:00.103 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.099+0000 7f6f44d3e9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:00.103 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.099+0000 7f6f44d3e9c0 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-12T00:38:00.103 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.099+0000 7f6f44d3e9c0 20 olh_log_entry: epoch=4 op=3 key=d[uF2TxJ8vtDign-dY3JLzcvhlgJAC9kZ] 2024-09-12T00:38:00.103 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.099+0000 7f6f44d3e9c0 20 get_obj_state: octx=0x557806a966a0 obj=check-bucket:_:uF2TxJ8vtDign-dY3JLzcvhlgJAC9kZ_d state=0x557806a970c8 s->prefetch_data=0 2024-09-12T00:38:00.105 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.103+0000 7f6f44d3e9c0 20 get_obj_state: octx=0x557806a966a0 obj=check-bucket:d state=0x557806a63928 s->prefetch_data=0 2024-09-12T00:38:00.106 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.103+0000 7f6f44d3e9c0 20 get_obj_state: setting s->obj_tag to g14603rb3p9f1yi0r6o0cg0gppi39jdu 2024-09-12T00:38:00.106 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.103+0000 7f6f44d3e9c0 20 get_obj_state_impl: setting s->olh_tag to zo0z79pdojkkfcgu93vkyc2v0ffoyw6r 2024-09-12T00:38:00.106 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.103+0000 7f6f44d3e9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zo0z79pdojkkfcgu93vkyc2v0ffoyw6r 2024-09-12T00:38:00.110 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.107+0000 7f6f44d3e9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:00.111 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.111+0000 7f6f44d3e9c0 1 NOTICE: finished shard 0 (2 entries removed) 2024-09-12T00:38:00.111 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.111+0000 7f6f44d3e9c0 1 NOTICE: finished all shards (2 entries removed) 2024-09-12T00:38:00.112 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.111+0000 7f6df9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:00.117 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.115+0000 7f6f44d3e9c0 20 remove_watcher() i=0 2024-09-12T00:38:00.117 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.115+0000 7f6f44d3e9c0 2 removed watcher, disabling cache 2024-09-12T00:38:00.119 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.119+0000 7f6f44d3e9c0 20 remove_watcher() i=1 2024-09-12T00:38:00.121 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.119+0000 7f6f44d3e9c0 20 remove_watcher() i=2 2024-09-12T00:38:00.123 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.123+0000 7f6f44d3e9c0 20 remove_watcher() i=3 2024-09-12T00:38:00.125 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.123+0000 7f6f44d3e9c0 20 remove_watcher() i=4 2024-09-12T00:38:00.126 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.123+0000 7f6f44d3e9c0 20 remove_watcher() i=5 2024-09-12T00:38:00.128 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.127+0000 7f6f44d3e9c0 20 remove_watcher() i=6 2024-09-12T00:38:00.129 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.127+0000 7f6f44d3e9c0 20 remove_watcher() i=7 2024-09-12T00:38:00.142 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:38:00.171 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:00.171 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:00.408 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.407+0000 7f0a2ec09640 0 --2- 172.21.15.70:0/275009577 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x564c5478abf0 0x564c5478bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:38:00.422 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.419+0000 7f0a319049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.423+0000 7f0a319049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.423+0000 7f0a319049c0 20 realm 2024-09-12T00:38:00.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.423+0000 7f0a319049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.423+0000 7f0a319049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.423+0000 7f0a319049c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:00.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.423+0000 7f0a319049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.423+0000 7f0a319049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.423+0000 7f0a319049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.423+0000 7f0a319049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:00.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.423+0000 7f0a319049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.428 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.427+0000 7f0a319049c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:00.428 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.427+0000 7f0a319049c0 20 searching for the correct realm 2024-09-12T00:38:00.429 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.427+0000 7f0a2f40a640 0 -- 172.21.15.70:0/1663084222 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f0a28033020 msgr2=0x7f0a28061f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:00.643 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.639+0000 7f0a2f40a640 0 -- 172.21.15.70:0/1663084222 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f0a28063510 msgr2=0x7f0a28096810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:00.865 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.863+0000 7f0a319049c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:00.865 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.863+0000 7f0a319049c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:38:00.865 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.863+0000 7f0a319049c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:00.865 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.863+0000 7f0a319049c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:38:00.865 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.863+0000 7f0a319049c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:00.865 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.863+0000 7f0a319049c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:00.865 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.863+0000 7f0a319049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.865 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.863+0000 7f0a319049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.866 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.863+0000 7f0a319049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.866 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.863+0000 7f0a319049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:00.866 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.863+0000 7f0a319049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.866 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.863+0000 7f0a319049c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:00.867 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.863+0000 7f0a319049c0 20 zone default found 2024-09-12T00:38:00.867 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.863+0000 7f0a319049c0 4 Realm: () 2024-09-12T00:38:00.867 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.863+0000 7f0a319049c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:38:00.867 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.863+0000 7f0a319049c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:38:00.867 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.863+0000 7f0a319049c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:00.867 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.863+0000 7f0a319049c0 20 zonegroup default 2024-09-12T00:38:00.867 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.863+0000 7f0a319049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.867 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.863+0000 7f0a319049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.867 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.863+0000 7f0a319049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.867 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.867+0000 7f0a319049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.867+0000 7f0a319049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.867+0000 7f0a319049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.867+0000 7f0a319049c0 20 started sync module instance, tier type = 2024-09-12T00:38:00.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.867+0000 7f0a319049c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:38:00.891 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.887+0000 7f0a319049c0 20 add_watcher() i=0 2024-09-12T00:38:00.892 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.887+0000 7f0a319049c0 20 add_watcher() i=1 2024-09-12T00:38:00.892 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.887+0000 7f0a319049c0 20 add_watcher() i=2 2024-09-12T00:38:00.892 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.887+0000 7f0a319049c0 20 add_watcher() i=3 2024-09-12T00:38:00.892 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.887+0000 7f0a319049c0 20 add_watcher() i=4 2024-09-12T00:38:00.892 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.887+0000 7f0a319049c0 20 add_watcher() i=5 2024-09-12T00:38:00.892 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.891+0000 7f0a319049c0 20 add_watcher() i=6 2024-09-12T00:38:00.894 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.891+0000 7f0a319049c0 20 add_watcher() i=7 2024-09-12T00:38:00.894 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.891+0000 7f0a319049c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:00.898 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.895+0000 7f08e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:00.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.895+0000 7f0a319049c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:00.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.895+0000 7f0a319049c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:00.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.895+0000 7f0a319049c0 5 note: GC not initialized 2024-09-12T00:38:00.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.895+0000 7f08e4fe1640 20 reqs_thread_entry: start 2024-09-12T00:38:00.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.899+0000 7f0a319049c0 20 init_complete bucket index max shards: 1 2024-09-12T00:38:00.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.899+0000 7f0a319049c0 20 Filter name: none 2024-09-12T00:38:00.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.899+0000 7f085e7fc640 20 reqs_thread_entry: start 2024-09-12T00:38:00.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.899+0000 7f0a319049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.899+0000 7f0a319049c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:38:00.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.899+0000 7f0a319049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.899+0000 7f0a319049c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:38:00.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.899+0000 7f0a319049c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:00.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.899+0000 7f0a319049c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:38:00.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.899+0000 7f0a319049c0 20 INFO: main: starting shard=0 2024-09-12T00:38:00.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.899+0000 7f0a319049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:00.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.899+0000 7f0a319049c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:38:00.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.899+0000 7f0a319049c0 20 INFO: main: done 2024-09-12T00:38:00.903 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.903+0000 7f08e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:00.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.907+0000 7f0a319049c0 20 remove_watcher() i=0 2024-09-12T00:38:00.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.907+0000 7f0a319049c0 2 removed watcher, disabling cache 2024-09-12T00:38:00.911 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.911+0000 7f0a319049c0 20 remove_watcher() i=1 2024-09-12T00:38:00.914 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.911+0000 7f0a319049c0 20 remove_watcher() i=2 2024-09-12T00:38:00.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.915+0000 7f0a319049c0 20 remove_watcher() i=3 2024-09-12T00:38:00.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.915+0000 7f0a319049c0 20 remove_watcher() i=4 2024-09-12T00:38:00.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.919+0000 7f0a319049c0 20 remove_watcher() i=5 2024-09-12T00:38:00.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.919+0000 7f0a319049c0 20 remove_watcher() i=6 2024-09-12T00:38:00.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:00.919+0000 7f0a319049c0 20 remove_watcher() i=7 2024-09-12T00:38:00.939 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:38:00.972 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:00.973 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:01.015 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.015+0000 7f257414a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.017 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.015+0000 7f257414a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:01.017 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.015+0000 7f257414a9c0 20 realm 2024-09-12T00:38:01.017 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.015+0000 7f257414a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.018 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.015+0000 7f257414a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:01.018 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.015+0000 7f257414a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:01.018 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.015+0000 7f257414a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.018 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.015+0000 7f257414a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:01.018 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.015+0000 7f257414a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.019+0000 7f257414a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:01.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.019+0000 7f257414a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.020 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.019+0000 7f257414a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:01.020 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.019+0000 7f257414a9c0 20 searching for the correct realm 2024-09-12T00:38:01.025 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.023+0000 7f2572451640 0 -- 172.21.15.70:0/1450007047 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f25680fea10 msgr2=0x7f2568100a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:01.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.031+0000 7f2571c50640 0 -- 172.21.15.70:0/1450007047 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f256c019bb0 msgr2=0x7f256c039430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:01.039 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.039+0000 7f257414a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:01.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.039+0000 7f257414a9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:38:01.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.039+0000 7f257414a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:01.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.039+0000 7f257414a9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:38:01.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.039+0000 7f257414a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:01.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.039+0000 7f257414a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:01.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.039+0000 7f257414a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.039+0000 7f257414a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:01.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.039+0000 7f257414a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.041 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.039+0000 7f257414a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:01.041 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.039+0000 7f257414a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.042 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.039+0000 7f257414a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:01.042 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.039+0000 7f257414a9c0 20 zone default found 2024-09-12T00:38:01.042 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.039+0000 7f257414a9c0 4 Realm: () 2024-09-12T00:38:01.042 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.039+0000 7f257414a9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:38:01.042 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.039+0000 7f257414a9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:38:01.042 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.039+0000 7f257414a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:01.042 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.039+0000 7f257414a9c0 20 zonegroup default 2024-09-12T00:38:01.042 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.039+0000 7f257414a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.042 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.039+0000 7f257414a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:01.042 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.039+0000 7f257414a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.043 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.039+0000 7f257414a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:01.043 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.039+0000 7f257414a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.043 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.039+0000 7f257414a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:01.043 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.039+0000 7f257414a9c0 20 started sync module instance, tier type = 2024-09-12T00:38:01.043 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.039+0000 7f257414a9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:38:01.059 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.055+0000 7f257414a9c0 20 add_watcher() i=0 2024-09-12T00:38:01.059 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.055+0000 7f257414a9c0 20 add_watcher() i=1 2024-09-12T00:38:01.059 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.055+0000 7f257414a9c0 20 add_watcher() i=2 2024-09-12T00:38:01.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.055+0000 7f257414a9c0 20 add_watcher() i=3 2024-09-12T00:38:01.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.055+0000 7f257414a9c0 20 add_watcher() i=4 2024-09-12T00:38:01.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.055+0000 7f257414a9c0 20 add_watcher() i=5 2024-09-12T00:38:01.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.055+0000 7f257414a9c0 20 add_watcher() i=6 2024-09-12T00:38:01.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.055+0000 7f257414a9c0 20 add_watcher() i=7 2024-09-12T00:38:01.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.055+0000 7f257414a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:01.062 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.059+0000 7f24237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:01.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.059+0000 7f257414a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:01.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.059+0000 7f257414a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:01.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.059+0000 7f257414a9c0 5 note: GC not initialized 2024-09-12T00:38:01.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.059+0000 7f24227fc640 20 reqs_thread_entry: start 2024-09-12T00:38:01.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.059+0000 7f257414a9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:38:01.064 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.059+0000 7f257414a9c0 20 Filter name: none 2024-09-12T00:38:01.064 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.059+0000 7f2393fff640 20 reqs_thread_entry: start 2024-09-12T00:38:01.064 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.059+0000 7f257414a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.064 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.059+0000 7f257414a9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:38:01.064 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.059+0000 7f257414a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.063+0000 7f257414a9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:38:01.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.063+0000 7f257414a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:01.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.063+0000 7f257414a9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:38:01.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.063+0000 7f257414a9c0 20 INFO: main: starting shard=0 2024-09-12T00:38:01.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.063+0000 7f257414a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:01.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.063+0000 7f257414a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:38:01.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.063+0000 7f257414a9c0 20 INFO: main: done 2024-09-12T00:38:01.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.063+0000 7f24237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:01.070 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.067+0000 7f257414a9c0 20 remove_watcher() i=0 2024-09-12T00:38:01.070 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.067+0000 7f257414a9c0 2 removed watcher, disabling cache 2024-09-12T00:38:01.072 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.071+0000 7f257414a9c0 20 remove_watcher() i=1 2024-09-12T00:38:01.074 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.071+0000 7f257414a9c0 20 remove_watcher() i=2 2024-09-12T00:38:01.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.075+0000 7f257414a9c0 20 remove_watcher() i=3 2024-09-12T00:38:01.078 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.075+0000 7f257414a9c0 20 remove_watcher() i=4 2024-09-12T00:38:01.079 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.079+0000 7f257414a9c0 20 remove_watcher() i=5 2024-09-12T00:38:01.080 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.079+0000 7f257414a9c0 20 remove_watcher() i=6 2024-09-12T00:38:01.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.079+0000 7f257414a9c0 20 remove_watcher() i=7 2024-09-12T00:38:01.095 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-12T00:38:01.095 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:38:01.095 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T00:38:01.125 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:01.125 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:01.167 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.163+0000 7f54c78489c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.169 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.167+0000 7f54c78489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:01.169 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.167+0000 7f54c78489c0 20 realm 2024-09-12T00:38:01.169 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.167+0000 7f54c78489c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.169 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.167+0000 7f54c78489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:01.169 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.167+0000 7f54c78489c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:01.169 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.167+0000 7f54c78489c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.170 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.167+0000 7f54c78489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:01.170 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.167+0000 7f54c78489c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.171 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.167+0000 7f54c78489c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:01.171 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.167+0000 7f54c78489c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.171 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.171+0000 7f54c78489c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:01.172 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.171+0000 7f54c78489c0 20 searching for the correct realm 2024-09-12T00:38:01.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.175+0000 7f54c5b4f640 0 -- 172.21.15.70:0/929971063 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f54b80dcc00 msgr2=0x7f54b80d1410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:01.183 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.183+0000 7f54c534e640 0 -- 172.21.15.70:0/929971063 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f54c001a070 msgr2=0x7f54c005ed20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:01.191 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.187+0000 7f54c78489c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:01.191 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.187+0000 7f54c78489c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:38:01.191 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.187+0000 7f54c78489c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:01.191 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.187+0000 7f54c78489c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:38:01.191 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.187+0000 7f54c78489c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:01.191 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.187+0000 7f54c78489c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:01.191 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.187+0000 7f54c78489c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.191 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.187+0000 7f54c78489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:01.191 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.187+0000 7f54c78489c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.192 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.191+0000 7f54c78489c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:01.192 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.191+0000 7f54c78489c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.192 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.191+0000 7f54c78489c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:01.192 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.191+0000 7f54c78489c0 20 zone default found 2024-09-12T00:38:01.192 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.191+0000 7f54c78489c0 4 Realm: () 2024-09-12T00:38:01.192 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.191+0000 7f54c78489c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:38:01.192 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.191+0000 7f54c78489c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:38:01.192 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.191+0000 7f54c78489c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:01.192 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.191+0000 7f54c78489c0 20 zonegroup default 2024-09-12T00:38:01.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.191+0000 7f54c78489c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.191+0000 7f54c78489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:01.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.191+0000 7f54c78489c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.191+0000 7f54c78489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:01.194 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.191+0000 7f54c78489c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.194 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.191+0000 7f54c78489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:01.194 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.191+0000 7f54c78489c0 20 started sync module instance, tier type = 2024-09-12T00:38:01.194 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.191+0000 7f54c78489c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:38:01.209 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.207+0000 7f54c78489c0 20 add_watcher() i=0 2024-09-12T00:38:01.209 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.207+0000 7f54c78489c0 20 add_watcher() i=1 2024-09-12T00:38:01.209 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.207+0000 7f54c78489c0 20 add_watcher() i=2 2024-09-12T00:38:01.209 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.207+0000 7f54c78489c0 20 add_watcher() i=3 2024-09-12T00:38:01.209 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.207+0000 7f54c78489c0 20 add_watcher() i=4 2024-09-12T00:38:01.209 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.207+0000 7f54c78489c0 20 add_watcher() i=5 2024-09-12T00:38:01.209 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.207+0000 7f54c78489c0 20 add_watcher() i=6 2024-09-12T00:38:01.210 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.207+0000 7f54c78489c0 20 add_watcher() i=7 2024-09-12T00:38:01.210 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.207+0000 7f54c78489c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:01.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.211+0000 7f537b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:01.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.211+0000 7f54c78489c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:01.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.211+0000 7f54c78489c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:01.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.211+0000 7f54c78489c0 5 note: GC not initialized 2024-09-12T00:38:01.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.211+0000 7f537a7e4640 20 reqs_thread_entry: start 2024-09-12T00:38:01.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.211+0000 7f54c78489c0 20 init_complete bucket index max shards: 1 2024-09-12T00:38:01.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.211+0000 7f54c78489c0 20 Filter name: none 2024-09-12T00:38:01.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.211+0000 7f52ebfff640 20 reqs_thread_entry: start 2024-09-12T00:38:01.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.211+0000 7f54c78489c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:38:01.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.211+0000 7f54c78489c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.216 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.211+0000 7f54c78489c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:38:01.216 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.211+0000 7f54c78489c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:38:01.216 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.211+0000 7f54c78489c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:38:01.216 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.211+0000 7f54c78489c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 : miss 2024-09-12T00:38:01.216 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.211+0000 7f54c78489c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.216 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.211+0000 7f54c78489c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:38:01.216 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.211+0000 7f54c78489c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 info.flags=0x17 2024-09-12T00:38:01.216 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.211+0000 7f54c78489c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 to cache LRU end 2024-09-12T00:38:01.216 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.211+0000 7f54c78489c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:01.216 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.211+0000 7f54c78489c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:38:01.216 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.211+0000 7f54c78489c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 2024-09-12T00:38:01.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.211+0000 7f54c78489c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:01.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.215+0000 7f54c78489c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:38:01.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.215+0000 7f54c78489c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:38:01.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.215+0000 7f537b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:01.221 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.219+0000 7f54c78489c0 20 remove_watcher() i=0 2024-09-12T00:38:01.221 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.219+0000 7f54c78489c0 2 removed watcher, disabling cache 2024-09-12T00:38:01.224 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.223+0000 7f54c78489c0 20 remove_watcher() i=1 2024-09-12T00:38:01.225 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.223+0000 7f54c78489c0 20 remove_watcher() i=2 2024-09-12T00:38:01.227 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.227+0000 7f54c78489c0 20 remove_watcher() i=3 2024-09-12T00:38:01.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.227+0000 7f54c78489c0 20 remove_watcher() i=4 2024-09-12T00:38:01.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.227+0000 7f54c78489c0 20 remove_watcher() i=5 2024-09-12T00:38:01.232 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.231+0000 7f54c78489c0 20 remove_watcher() i=6 2024-09-12T00:38:01.233 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:01.231+0000 7f54c78489c0 20 remove_watcher() i=7 2024-09-12T00:38:01.247 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-12T00:38:01.247 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:38:01.248 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:01.248 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:01.253 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:01.253 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:01.256 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:01.256 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:01.301 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-12T00:38:01.301 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:38:01.302 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:01.302 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:01.355 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:01.355 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:01.426 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:01.426 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:01.456 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:01.456 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:01.463 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:01.463 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:01.495 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:01.496 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:01.502 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:01.503 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:01.535 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:01.536 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:01.543 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:01.543 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:01.575 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:01.575 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:01.582 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:01.583 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:01.614 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:01.614 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:01.621 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:01.621 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:01.654 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:01.654 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:01.661 INFO:tasks.workunit.client.0.smithi070.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:38:02.105 INFO:tasks.workunit.client.0.smithi070.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:38:03.545 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:03.545 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:03.612 INFO:tasks.workunit.client.0.smithi070.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:38:03.613 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:38:03.650 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:03.650 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:03.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.691+0000 7fd629c919c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:03.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.695+0000 7fd629c919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:03.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.695+0000 7fd629c919c0 20 realm 2024-09-12T00:38:03.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.695+0000 7fd629c919c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:03.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.695+0000 7fd629c919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:03.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.695+0000 7fd629c919c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:03.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.695+0000 7fd629c919c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:03.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.695+0000 7fd629c919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:03.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.695+0000 7fd629c919c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:03.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.695+0000 7fd629c919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:03.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.695+0000 7fd629c919c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:03.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.695+0000 7fd629c919c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:03.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.695+0000 7fd629c919c0 20 searching for the correct realm 2024-09-12T00:38:03.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.699+0000 7fd627f98640 0 -- 172.21.15.70:0/3430758001 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fd61c01d040 msgr2=0x7fd61c066e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:03.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.915+0000 7fd627f98640 0 -- 172.21.15.70:0/3430758001 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fd61c01d040 msgr2=0x7fd61c066e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:03.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.927+0000 7fd629c919c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:03.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.927+0000 7fd629c919c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:38:03.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.927+0000 7fd629c919c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:03.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.927+0000 7fd629c919c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:38:03.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.927+0000 7fd629c919c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:03.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.927+0000 7fd629c919c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:03.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.927+0000 7fd629c919c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:03.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.927+0000 7fd629c919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:03.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.927+0000 7fd629c919c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:03.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.927+0000 7fd629c919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:03.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.927+0000 7fd629c919c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:03.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.927+0000 7fd629c919c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:03.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.927+0000 7fd629c919c0 20 zone default found 2024-09-12T00:38:03.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.927+0000 7fd629c919c0 4 Realm: () 2024-09-12T00:38:03.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.927+0000 7fd629c919c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:38:03.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.927+0000 7fd629c919c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:38:03.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.927+0000 7fd629c919c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:03.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.927+0000 7fd629c919c0 20 zonegroup default 2024-09-12T00:38:03.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.927+0000 7fd629c919c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:03.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.927+0000 7fd629c919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:03.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.927+0000 7fd629c919c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:03.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.931+0000 7fd629c919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:03.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.931+0000 7fd629c919c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:03.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.931+0000 7fd629c919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:03.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.931+0000 7fd629c919c0 20 started sync module instance, tier type = 2024-09-12T00:38:03.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.931+0000 7fd629c919c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:38:03.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.955+0000 7fd629c919c0 20 add_watcher() i=0 2024-09-12T00:38:03.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.955+0000 7fd629c919c0 20 add_watcher() i=1 2024-09-12T00:38:03.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.955+0000 7fd629c919c0 20 add_watcher() i=2 2024-09-12T00:38:03.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.955+0000 7fd629c919c0 20 add_watcher() i=3 2024-09-12T00:38:03.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.955+0000 7fd629c919c0 20 add_watcher() i=4 2024-09-12T00:38:03.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.955+0000 7fd629c919c0 20 add_watcher() i=5 2024-09-12T00:38:03.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.955+0000 7fd629c919c0 20 add_watcher() i=6 2024-09-12T00:38:03.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.955+0000 7fd629c919c0 20 add_watcher() i=7 2024-09-12T00:38:03.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.955+0000 7fd629c919c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:03.962 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.959+0000 7fd4ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:03.963 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.959+0000 7fd629c919c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:03.963 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.959+0000 7fd629c919c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:03.963 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.963+0000 7fd629c919c0 5 note: GC not initialized 2024-09-12T00:38:03.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.963+0000 7fd4dcfe1640 20 reqs_thread_entry: start 2024-09-12T00:38:03.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.963+0000 7fd629c919c0 20 init_complete bucket index max shards: 1 2024-09-12T00:38:03.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.963+0000 7fd629c919c0 20 Filter name: none 2024-09-12T00:38:03.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.963+0000 7fd4567fc640 20 reqs_thread_entry: start 2024-09-12T00:38:03.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.963+0000 7fd629c919c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:03.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.963+0000 7fd629c919c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:38:03.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.963+0000 7fd629c919c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:03.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.963+0000 7fd629c919c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:38:03.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.963+0000 7fd629c919c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:03.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.963+0000 7fd629c919c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:38:03.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.963+0000 7fd629c919c0 20 INFO: main: starting shard=0 2024-09-12T00:38:03.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.963+0000 7fd629c919c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:03.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.967+0000 7fd629c919c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:38:03.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.967+0000 7fd629c919c0 20 INFO: main: done 2024-09-12T00:38:03.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.967+0000 7fd4ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:03.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.971+0000 7fd629c919c0 20 remove_watcher() i=0 2024-09-12T00:38:03.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.971+0000 7fd629c919c0 2 removed watcher, disabling cache 2024-09-12T00:38:03.977 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.975+0000 7fd629c919c0 20 remove_watcher() i=1 2024-09-12T00:38:03.979 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.975+0000 7fd629c919c0 20 remove_watcher() i=2 2024-09-12T00:38:03.981 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.979+0000 7fd629c919c0 20 remove_watcher() i=3 2024-09-12T00:38:03.983 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.983+0000 7fd629c919c0 20 remove_watcher() i=4 2024-09-12T00:38:03.986 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.983+0000 7fd629c919c0 20 remove_watcher() i=5 2024-09-12T00:38:03.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.987+0000 7fd629c919c0 20 remove_watcher() i=6 2024-09-12T00:38:03.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:03.987+0000 7fd629c919c0 20 remove_watcher() i=7 2024-09-12T00:38:04.011 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:04.011 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:04.016 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:04.016 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:04.020 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:04.020 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:04.080 INFO:tasks.workunit.client.0.smithi070.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:38:04.081 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:38:04.116 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:04.116 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:04.159 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.155+0000 7f53fc9739c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.161 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.159+0000 7f53fc9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:04.162 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.159+0000 7f53fc9739c0 20 realm 2024-09-12T00:38:04.162 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.159+0000 7f53fc9739c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.162 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.159+0000 7f53fc9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:04.162 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.159+0000 7f53fc9739c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:04.162 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.159+0000 7f53fc9739c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.162 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.159+0000 7f53fc9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:04.162 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.159+0000 7f53fc9739c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.163 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.163+0000 7f53fc9739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:04.163 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.163+0000 7f53fc9739c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.164 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.163+0000 7f53fc9739c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:04.164 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.163+0000 7f53fc9739c0 20 searching for the correct realm 2024-09-12T00:38:04.168 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.167+0000 7f53fac7a640 0 -- 172.21.15.70:0/3421145652 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f53f003a040 msgr2=0x7f53f0008450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:04.386 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.383+0000 7f53fac7a640 0 -- 172.21.15.70:0/3421145652 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f53f003a040 msgr2=0x7f53f0008450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:04.397 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.395+0000 7f53fc9739c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:04.397 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.395+0000 7f53fc9739c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:38:04.398 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.395+0000 7f53fc9739c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:04.398 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.395+0000 7f53fc9739c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:38:04.398 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.395+0000 7f53fc9739c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:04.398 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.395+0000 7f53fc9739c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:04.398 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.395+0000 7f53fc9739c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.398 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.395+0000 7f53fc9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:04.398 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.395+0000 7f53fc9739c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.399 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.395+0000 7f53fc9739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:04.399 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.395+0000 7f53fc9739c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.400 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.399+0000 7f53fc9739c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:04.400 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.399+0000 7f53fc9739c0 20 zone default found 2024-09-12T00:38:04.400 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.399+0000 7f53fc9739c0 4 Realm: () 2024-09-12T00:38:04.400 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.399+0000 7f53fc9739c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:38:04.400 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.399+0000 7f53fc9739c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:38:04.400 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.399+0000 7f53fc9739c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:04.400 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.399+0000 7f53fc9739c0 20 zonegroup default 2024-09-12T00:38:04.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.399+0000 7f53fc9739c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.399+0000 7f53fc9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:04.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.399+0000 7f53fc9739c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.399+0000 7f53fc9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:04.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.399+0000 7f53fc9739c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.402 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.399+0000 7f53fc9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:04.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.399+0000 7f53fc9739c0 20 started sync module instance, tier type = 2024-09-12T00:38:04.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.399+0000 7f53fc9739c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:38:04.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.427+0000 7f53fc9739c0 20 add_watcher() i=0 2024-09-12T00:38:04.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.427+0000 7f53fc9739c0 20 add_watcher() i=1 2024-09-12T00:38:04.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.427+0000 7f53fc9739c0 20 add_watcher() i=2 2024-09-12T00:38:04.428 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.427+0000 7f53fc9739c0 20 add_watcher() i=3 2024-09-12T00:38:04.428 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.427+0000 7f53fc9739c0 20 add_watcher() i=4 2024-09-12T00:38:04.428 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.427+0000 7f53fc9739c0 20 add_watcher() i=5 2024-09-12T00:38:04.428 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.427+0000 7f53fc9739c0 20 add_watcher() i=6 2024-09-12T00:38:04.429 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.427+0000 7f53fc9739c0 20 add_watcher() i=7 2024-09-12T00:38:04.430 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.427+0000 7f53fc9739c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:04.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.431+0000 7f52b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:04.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.431+0000 7f53fc9739c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:04.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.431+0000 7f53fc9739c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:04.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.431+0000 7f53fc9739c0 5 note: GC not initialized 2024-09-12T00:38:04.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.435+0000 7f522b7fe640 20 reqs_thread_entry: start 2024-09-12T00:38:04.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.435+0000 7f53fc9739c0 20 init_complete bucket index max shards: 1 2024-09-12T00:38:04.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.435+0000 7f53fc9739c0 20 Filter name: none 2024-09-12T00:38:04.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.435+0000 7f52297fa640 20 reqs_thread_entry: start 2024-09-12T00:38:04.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.435+0000 7f53fc9739c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.437 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.435+0000 7f53fc9739c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:38:04.437 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.435+0000 7f53fc9739c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.438 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.435+0000 7f53fc9739c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:38:04.438 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.435+0000 7f53fc9739c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:04.438 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.435+0000 7f53fc9739c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:38:04.438 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.435+0000 7f53fc9739c0 20 INFO: main: starting shard=0 2024-09-12T00:38:04.438 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.435+0000 7f53fc9739c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:04.438 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.435+0000 7f53fc9739c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:38:04.438 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.435+0000 7f53fc9739c0 20 INFO: main: done 2024-09-12T00:38:04.440 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.439+0000 7f52b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:04.445 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.443+0000 7f53fc9739c0 20 remove_watcher() i=0 2024-09-12T00:38:04.445 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.443+0000 7f53fc9739c0 2 removed watcher, disabling cache 2024-09-12T00:38:04.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.447+0000 7f53fc9739c0 20 remove_watcher() i=1 2024-09-12T00:38:04.449 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.447+0000 7f53fc9739c0 20 remove_watcher() i=2 2024-09-12T00:38:04.451 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.451+0000 7f53fc9739c0 20 remove_watcher() i=3 2024-09-12T00:38:04.454 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.451+0000 7f53fc9739c0 20 remove_watcher() i=4 2024-09-12T00:38:04.455 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.455+0000 7f53fc9739c0 20 remove_watcher() i=5 2024-09-12T00:38:04.457 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.455+0000 7f53fc9739c0 20 remove_watcher() i=6 2024-09-12T00:38:04.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.455+0000 7f53fc9739c0 20 remove_watcher() i=7 2024-09-12T00:38:04.476 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:04.476 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:04.482 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:04.482 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:04.488 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:04.488 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:04.552 INFO:tasks.workunit.client.0.smithi070.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:38:04.553 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T00:38:04.589 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:04.589 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:04.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.631+0000 7fa33e75c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.631+0000 7fa33e75c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:04.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.631+0000 7fa33e75c9c0 20 realm 2024-09-12T00:38:04.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.631+0000 7fa33e75c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.631+0000 7fa33e75c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:04.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.631+0000 7fa33e75c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:04.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.631+0000 7fa33e75c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.631+0000 7fa33e75c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:04.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.631+0000 7fa33e75c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.636 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.635+0000 7fa33e75c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:04.636 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.635+0000 7fa33e75c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.635+0000 7fa33e75c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:04.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.635+0000 7fa33e75c9c0 20 searching for the correct realm 2024-09-12T00:38:04.642 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.639+0000 7fa33c262640 0 -- 172.21.15.70:0/3782374602 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7fa334128060 msgr2=0x7fa3340ba730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:04.650 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.647+0000 7fa33c262640 0 -- 172.21.15.70:0/3782374602 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7fa3340bf070 msgr2=0x7fa3340ba730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:04.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.655+0000 7fa33e75c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:04.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.655+0000 7fa33e75c9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:38:04.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.655+0000 7fa33e75c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:04.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.655+0000 7fa33e75c9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:38:04.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.655+0000 7fa33e75c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:04.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.655+0000 7fa33e75c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:04.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.655+0000 7fa33e75c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.655+0000 7fa33e75c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:04.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.655+0000 7fa33e75c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.655+0000 7fa33e75c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:04.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.655+0000 7fa33e75c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.655+0000 7fa33e75c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:04.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.655+0000 7fa33e75c9c0 20 zone default found 2024-09-12T00:38:04.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.655+0000 7fa33e75c9c0 4 Realm: () 2024-09-12T00:38:04.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.655+0000 7fa33e75c9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:38:04.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.655+0000 7fa33e75c9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:38:04.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.655+0000 7fa33e75c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:04.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.655+0000 7fa33e75c9c0 20 zonegroup default 2024-09-12T00:38:04.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.655+0000 7fa33e75c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.655+0000 7fa33e75c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:04.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.655+0000 7fa33e75c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.655+0000 7fa33e75c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:04.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.655+0000 7fa33e75c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.655+0000 7fa33e75c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:04.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.655+0000 7fa33e75c9c0 20 started sync module instance, tier type = 2024-09-12T00:38:04.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.655+0000 7fa33e75c9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:38:04.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.675+0000 7fa33e75c9c0 20 add_watcher() i=0 2024-09-12T00:38:04.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.675+0000 7fa33e75c9c0 20 add_watcher() i=1 2024-09-12T00:38:04.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.675+0000 7fa33e75c9c0 20 add_watcher() i=2 2024-09-12T00:38:04.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.675+0000 7fa33e75c9c0 20 add_watcher() i=3 2024-09-12T00:38:04.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.675+0000 7fa33e75c9c0 20 add_watcher() i=4 2024-09-12T00:38:04.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.675+0000 7fa33e75c9c0 20 add_watcher() i=5 2024-09-12T00:38:04.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.675+0000 7fa33e75c9c0 20 add_watcher() i=6 2024-09-12T00:38:04.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.675+0000 7fa33e75c9c0 20 add_watcher() i=7 2024-09-12T00:38:04.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.675+0000 7fa33e75c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:04.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.679+0000 7fa1f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:04.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.679+0000 7fa33e75c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:04.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.679+0000 7fa33e75c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:04.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.679+0000 7fa33e75c9c0 5 note: GC not initialized 2024-09-12T00:38:04.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.679+0000 7fa1f1fdb640 20 reqs_thread_entry: start 2024-09-12T00:38:04.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.679+0000 7fa33e75c9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:38:04.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.679+0000 7fa33e75c9c0 20 Filter name: none 2024-09-12T00:38:04.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.679+0000 7fa1637fe640 20 reqs_thread_entry: start 2024-09-12T00:38:04.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.679+0000 7fa33e75c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.679+0000 7fa33e75c9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:38:04.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.679+0000 7fa33e75c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.679+0000 7fa33e75c9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:38:04.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.679+0000 7fa33e75c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:04.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.679+0000 7fa33e75c9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:38:04.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.679+0000 7fa33e75c9c0 20 INFO: main: starting shard=0 2024-09-12T00:38:04.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.679+0000 7fa33e75c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:04.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.679+0000 7fa33e75c9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:38:04.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.679+0000 7fa33e75c9c0 20 INFO: main: done 2024-09-12T00:38:04.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.683+0000 7fa1f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:04.688 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.687+0000 7fa33e75c9c0 20 remove_watcher() i=0 2024-09-12T00:38:04.688 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.687+0000 7fa33e75c9c0 2 removed watcher, disabling cache 2024-09-12T00:38:04.690 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.687+0000 7fa33e75c9c0 20 remove_watcher() i=1 2024-09-12T00:38:04.692 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.691+0000 7fa33e75c9c0 20 remove_watcher() i=2 2024-09-12T00:38:04.694 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.691+0000 7fa33e75c9c0 20 remove_watcher() i=3 2024-09-12T00:38:04.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.695+0000 7fa33e75c9c0 20 remove_watcher() i=4 2024-09-12T00:38:04.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.695+0000 7fa33e75c9c0 20 remove_watcher() i=5 2024-09-12T00:38:04.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.695+0000 7fa33e75c9c0 20 remove_watcher() i=6 2024-09-12T00:38:04.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.699+0000 7fa33e75c9c0 20 remove_watcher() i=7 2024-09-12T00:38:04.715 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:04.715 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:04.719 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:04.720 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:04.772 INFO:tasks.workunit.client.0.smithi070.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:38:04.772 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T00:38:04.806 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:04.806 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:04.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.847+0000 7f4fdeb4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.852 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.851+0000 7f4fdeb4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:04.852 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.851+0000 7f4fdeb4c9c0 20 realm 2024-09-12T00:38:04.852 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.851+0000 7f4fdeb4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.852 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.851+0000 7f4fdeb4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:04.852 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.851+0000 7f4fdeb4c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:04.852 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.851+0000 7f4fdeb4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.852 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.851+0000 7f4fdeb4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:04.852 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.851+0000 7f4fdeb4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.853 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.851+0000 7f4fdeb4c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:04.853 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.851+0000 7f4fdeb4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:04.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.851+0000 7f4fdeb4c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:04.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.851+0000 7f4fdeb4c9c0 20 searching for the correct realm 2024-09-12T00:38:04.858 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:04.855+0000 7f4fdce53640 0 -- 172.21.15.70:0/2397784572 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f4fc406b040 msgr2=0x7f4fc4045750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:05.073 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.071+0000 7f4fdce53640 0 -- 172.21.15.70:0/2397784572 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f4fc406b040 msgr2=0x7f4fc4045750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:05.085 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.083+0000 7f4fdeb4c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:05.085 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.083+0000 7f4fdeb4c9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:38:05.085 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.083+0000 7f4fdeb4c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:05.085 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.083+0000 7f4fdeb4c9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:38:05.085 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.083+0000 7f4fdeb4c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:05.085 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.083+0000 7f4fdeb4c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:05.085 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.083+0000 7f4fdeb4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:05.085 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.083+0000 7f4fdeb4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:05.086 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.083+0000 7f4fdeb4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:05.086 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.083+0000 7f4fdeb4c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:05.086 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.083+0000 7f4fdeb4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:05.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.083+0000 7f4fdeb4c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:05.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.083+0000 7f4fdeb4c9c0 20 zone default found 2024-09-12T00:38:05.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.083+0000 7f4fdeb4c9c0 4 Realm: () 2024-09-12T00:38:05.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.083+0000 7f4fdeb4c9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:38:05.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.083+0000 7f4fdeb4c9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:38:05.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.083+0000 7f4fdeb4c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:05.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.083+0000 7f4fdeb4c9c0 20 zonegroup default 2024-09-12T00:38:05.088 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.083+0000 7f4fdeb4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:05.088 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.087+0000 7f4fdeb4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:05.088 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.087+0000 7f4fdeb4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:05.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.087+0000 7f4fdeb4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:05.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.087+0000 7f4fdeb4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:05.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.087+0000 7f4fdeb4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:05.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.087+0000 7f4fdeb4c9c0 20 started sync module instance, tier type = 2024-09-12T00:38:05.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.087+0000 7f4fdeb4c9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:38:05.116 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.115+0000 7f4fdeb4c9c0 20 add_watcher() i=0 2024-09-12T00:38:05.116 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.115+0000 7f4fdeb4c9c0 20 add_watcher() i=1 2024-09-12T00:38:05.116 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.115+0000 7f4fdeb4c9c0 20 add_watcher() i=2 2024-09-12T00:38:05.116 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.115+0000 7f4fdeb4c9c0 20 add_watcher() i=3 2024-09-12T00:38:05.116 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.115+0000 7f4fdeb4c9c0 20 add_watcher() i=4 2024-09-12T00:38:05.116 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.115+0000 7f4fdeb4c9c0 20 add_watcher() i=5 2024-09-12T00:38:05.116 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.115+0000 7f4fdeb4c9c0 20 add_watcher() i=6 2024-09-12T00:38:05.118 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.115+0000 7f4fdeb4c9c0 20 add_watcher() i=7 2024-09-12T00:38:05.118 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.115+0000 7f4fdeb4c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:05.122 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.119+0000 7f4e92fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:05.123 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.123+0000 7f4fdeb4c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:05.124 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.123+0000 7f4fdeb4c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:05.124 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.123+0000 7f4fdeb4c9c0 5 note: GC not initialized 2024-09-12T00:38:05.124 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.123+0000 7f4e91fdb640 20 reqs_thread_entry: start 2024-09-12T00:38:05.124 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.123+0000 7f4fdeb4c9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:38:05.125 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.123+0000 7f4fdeb4c9c0 20 Filter name: none 2024-09-12T00:38:05.125 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.123+0000 7f4e037fe640 20 reqs_thread_entry: start 2024-09-12T00:38:05.125 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.123+0000 7f4fdeb4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:05.125 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.123+0000 7f4fdeb4c9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:38:05.125 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.123+0000 7f4fdeb4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:05.127 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.123+0000 7f4fdeb4c9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:38:05.127 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.123+0000 7f4fdeb4c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:05.127 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.123+0000 7f4fdeb4c9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:38:05.127 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.123+0000 7f4fdeb4c9c0 20 INFO: main: starting shard=0 2024-09-12T00:38:05.127 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.123+0000 7f4fdeb4c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:05.127 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.127+0000 7f4fdeb4c9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:38:05.127 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.127+0000 7f4fdeb4c9c0 20 INFO: main: done 2024-09-12T00:38:05.129 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.127+0000 7f4e92fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:05.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.131+0000 7f4fdeb4c9c0 20 remove_watcher() i=0 2024-09-12T00:38:05.134 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.131+0000 7f4fdeb4c9c0 2 removed watcher, disabling cache 2024-09-12T00:38:05.135 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.135+0000 7f4fdeb4c9c0 20 remove_watcher() i=1 2024-09-12T00:38:05.138 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.135+0000 7f4fdeb4c9c0 20 remove_watcher() i=2 2024-09-12T00:38:05.140 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.139+0000 7f4fdeb4c9c0 20 remove_watcher() i=3 2024-09-12T00:38:05.142 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.139+0000 7f4fdeb4c9c0 20 remove_watcher() i=4 2024-09-12T00:38:05.143 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.143+0000 7f4fdeb4c9c0 20 remove_watcher() i=5 2024-09-12T00:38:05.145 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.143+0000 7f4fdeb4c9c0 20 remove_watcher() i=6 2024-09-12T00:38:05.146 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:05.143+0000 7f4fdeb4c9c0 20 remove_watcher() i=7 2024-09-12T00:38:05.163 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:05.163 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:05.168 INFO:tasks.workunit.client.0.smithi070.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:38:05.594 INFO:tasks.workunit.client.0.smithi070.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:38:06.018 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T00:38:06.048 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:06.049 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:06.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.083+0000 7f458e0729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.087+0000 7f458e0729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:06.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.087+0000 7f458e0729c0 20 realm 2024-09-12T00:38:06.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.087+0000 7f458e0729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.087+0000 7f458e0729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:06.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.087+0000 7f458e0729c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:06.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.087+0000 7f458e0729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.087+0000 7f458e0729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:06.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.087+0000 7f458e0729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.087+0000 7f458e0729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:06.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.087+0000 7f458e0729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.091+0000 7f458e0729c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:06.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.091+0000 7f458e0729c0 20 searching for the correct realm 2024-09-12T00:38:06.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.095+0000 7f458c379640 0 -- 172.21.15.70:0/1336765439 >> [v2:172.21.15.70:6808/276433067,v1:172.21.15.70:6809/276433067] conn(0x5647cf459da0 msgr2=0x5647cf45c260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:06.105 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.103+0000 7f458b377640 0 -- 172.21.15.70:0/1336765439 >> [v2:172.21.15.70:6816/1979013808,v1:172.21.15.70:6817/1979013808] conn(0x5647cf44d630 msgr2=0x5647cf44fa40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:06.110 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.107+0000 7f458e0729c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:06.110 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.107+0000 7f458e0729c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:38:06.110 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.107+0000 7f458e0729c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:06.111 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.107+0000 7f458e0729c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:38:06.111 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.107+0000 7f458e0729c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:06.111 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.107+0000 7f458e0729c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:06.111 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.107+0000 7f458e0729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.111 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.107+0000 7f458e0729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:06.111 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.107+0000 7f458e0729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.112 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.111+0000 7f458e0729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:06.112 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.111+0000 7f458e0729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.112 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.111+0000 7f458e0729c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:06.112 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.111+0000 7f458e0729c0 20 zone default found 2024-09-12T00:38:06.112 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.111+0000 7f458e0729c0 4 Realm: () 2024-09-12T00:38:06.112 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.111+0000 7f458e0729c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:38:06.112 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.111+0000 7f458e0729c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:38:06.112 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.111+0000 7f458e0729c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:06.112 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.111+0000 7f458e0729c0 20 zonegroup default 2024-09-12T00:38:06.112 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.111+0000 7f458e0729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.113 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.111+0000 7f458e0729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:06.113 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.111+0000 7f458e0729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.113 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.111+0000 7f458e0729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:06.113 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.111+0000 7f458e0729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.113 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.111+0000 7f458e0729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:06.113 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.111+0000 7f458e0729c0 20 started sync module instance, tier type = 2024-09-12T00:38:06.113 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.111+0000 7f458e0729c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:38:06.128 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.127+0000 7f458e0729c0 20 add_watcher() i=0 2024-09-12T00:38:06.128 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.127+0000 7f458e0729c0 20 add_watcher() i=1 2024-09-12T00:38:06.128 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.127+0000 7f458e0729c0 20 add_watcher() i=2 2024-09-12T00:38:06.128 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.127+0000 7f458e0729c0 20 add_watcher() i=3 2024-09-12T00:38:06.128 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.127+0000 7f458e0729c0 20 add_watcher() i=4 2024-09-12T00:38:06.128 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.127+0000 7f458e0729c0 20 add_watcher() i=5 2024-09-12T00:38:06.128 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.127+0000 7f458e0729c0 20 add_watcher() i=6 2024-09-12T00:38:06.129 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.127+0000 7f458e0729c0 20 add_watcher() i=7 2024-09-12T00:38:06.129 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.127+0000 7f458e0729c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:06.131 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.127+0000 7f4441fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:06.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.127+0000 7f458e0729c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:06.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.127+0000 7f458e0729c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:06.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.127+0000 7f458e0729c0 5 note: GC not initialized 2024-09-12T00:38:06.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.131+0000 7f4440fe1640 20 reqs_thread_entry: start 2024-09-12T00:38:06.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.131+0000 7f458e0729c0 20 init_complete bucket index max shards: 1 2024-09-12T00:38:06.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.131+0000 7f458e0729c0 20 Filter name: none 2024-09-12T00:38:06.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.131+0000 7f43ba7fc640 20 reqs_thread_entry: start 2024-09-12T00:38:06.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.131+0000 7f458e0729c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:38:06.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.131+0000 7f458e0729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.131+0000 7f458e0729c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:38:06.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.131+0000 7f458e0729c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:38:06.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.131+0000 7f458e0729c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:38:06.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.131+0000 7f458e0729c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 : miss 2024-09-12T00:38:06.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.131+0000 7f458e0729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.134 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.131+0000 7f458e0729c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:38:06.134 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.131+0000 7f458e0729c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 info.flags=0x17 2024-09-12T00:38:06.134 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.131+0000 7f458e0729c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 to cache LRU end 2024-09-12T00:38:06.134 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.131+0000 7f458e0729c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:06.134 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.131+0000 7f458e0729c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:38:06.134 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.131+0000 7f458e0729c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 2024-09-12T00:38:06.134 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.131+0000 7f458e0729c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.136 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.135+0000 7f4441fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:06.141 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.139+0000 7f458e0729c0 20 remove_watcher() i=0 2024-09-12T00:38:06.141 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.139+0000 7f458e0729c0 2 removed watcher, disabling cache 2024-09-12T00:38:06.143 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.139+0000 7f458e0729c0 20 remove_watcher() i=1 2024-09-12T00:38:06.145 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.143+0000 7f458e0729c0 20 remove_watcher() i=2 2024-09-12T00:38:06.147 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.143+0000 7f458e0729c0 20 remove_watcher() i=3 2024-09-12T00:38:06.149 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.147+0000 7f458e0729c0 20 remove_watcher() i=4 2024-09-12T00:38:06.149 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.147+0000 7f458e0729c0 20 remove_watcher() i=5 2024-09-12T00:38:06.150 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.147+0000 7f458e0729c0 20 remove_watcher() i=6 2024-09-12T00:38:06.151 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.151+0000 7f458e0729c0 20 remove_watcher() i=7 2024-09-12T00:38:06.162 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:38:06.191 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:06.191 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:06.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.227+0000 7f451f2049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.227+0000 7f451f2049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:06.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.227+0000 7f451f2049c0 20 realm 2024-09-12T00:38:06.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.227+0000 7f451f2049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.227+0000 7f451f2049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:06.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.227+0000 7f451f2049c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:06.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.227+0000 7f451f2049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.227+0000 7f451f2049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:06.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.227+0000 7f451f2049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.232 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.231+0000 7f451f2049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:06.232 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.231+0000 7f451f2049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.233 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.231+0000 7f451f2049c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:06.233 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.231+0000 7f451f2049c0 20 searching for the correct realm 2024-09-12T00:38:06.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.235+0000 7f451cd0a640 0 -- 172.21.15.70:0/3975062807 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f451400e070 msgr2=0x7f4514088dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:06.245 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.243+0000 7f451cd0a640 0 -- 172.21.15.70:0/3975062807 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f4514092b70 msgr2=0x7f4514088dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:06.251 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.247+0000 7f451f2049c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:06.251 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.247+0000 7f451f2049c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:38:06.251 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.247+0000 7f451f2049c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:06.251 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.247+0000 7f451f2049c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:38:06.251 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.247+0000 7f451f2049c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:06.251 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.247+0000 7f451f2049c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:06.251 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.247+0000 7f451f2049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.251 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.247+0000 7f451f2049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:06.251 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.247+0000 7f451f2049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.251+0000 7f451f2049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:06.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.251+0000 7f451f2049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.251+0000 7f451f2049c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:06.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.251+0000 7f451f2049c0 20 zone default found 2024-09-12T00:38:06.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.251+0000 7f451f2049c0 4 Realm: () 2024-09-12T00:38:06.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.251+0000 7f451f2049c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:38:06.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.251+0000 7f451f2049c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:38:06.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.251+0000 7f451f2049c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:06.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.251+0000 7f451f2049c0 20 zonegroup default 2024-09-12T00:38:06.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.251+0000 7f451f2049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.251+0000 7f451f2049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:06.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.251+0000 7f451f2049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.251+0000 7f451f2049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:06.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.251+0000 7f451f2049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.251+0000 7f451f2049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:06.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.251+0000 7f451f2049c0 20 started sync module instance, tier type = 2024-09-12T00:38:06.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.251+0000 7f451f2049c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:38:06.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.267+0000 7f451f2049c0 20 add_watcher() i=0 2024-09-12T00:38:06.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.267+0000 7f451f2049c0 20 add_watcher() i=1 2024-09-12T00:38:06.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.267+0000 7f451f2049c0 20 add_watcher() i=2 2024-09-12T00:38:06.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.267+0000 7f451f2049c0 20 add_watcher() i=3 2024-09-12T00:38:06.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.267+0000 7f451f2049c0 20 add_watcher() i=4 2024-09-12T00:38:06.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.267+0000 7f451f2049c0 20 add_watcher() i=5 2024-09-12T00:38:06.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.267+0000 7f451f2049c0 20 add_watcher() i=6 2024-09-12T00:38:06.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.267+0000 7f451f2049c0 20 add_watcher() i=7 2024-09-12T00:38:06.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.267+0000 7f451f2049c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:06.272 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.271+0000 7f43d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:06.273 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.271+0000 7f451f2049c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:06.273 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.271+0000 7f451f2049c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:06.273 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.271+0000 7f451f2049c0 5 note: GC not initialized 2024-09-12T00:38:06.273 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.271+0000 7f43d1fe3640 20 reqs_thread_entry: start 2024-09-12T00:38:06.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.271+0000 7f451f2049c0 20 init_complete bucket index max shards: 1 2024-09-12T00:38:06.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.271+0000 7f451f2049c0 20 Filter name: none 2024-09-12T00:38:06.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.271+0000 7f43437fe640 20 reqs_thread_entry: start 2024-09-12T00:38:06.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.271+0000 7f451f2049c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:38:06.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.271+0000 7f451f2049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.271+0000 7f451f2049c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:38:06.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.271+0000 7f451f2049c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:38:06.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.271+0000 7f451f2049c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:38:06.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.271+0000 7f451f2049c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 : miss 2024-09-12T00:38:06.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.271+0000 7f451f2049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.271+0000 7f451f2049c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:38:06.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.271+0000 7f451f2049c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 info.flags=0x17 2024-09-12T00:38:06.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.271+0000 7f451f2049c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 to cache LRU end 2024-09-12T00:38:06.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.271+0000 7f451f2049c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:06.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.271+0000 7f451f2049c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:38:06.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.271+0000 7f451f2049c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2 2024-09-12T00:38:06.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.271+0000 7f451f2049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.271+0000 7f451f2049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.275+0000 7f451f2049c0 20 get_obj_state: octx=0x55e3a0cca740 obj=check-bucket:c state=0x55e3a0f7b848 s->prefetch_data=0 2024-09-12T00:38:06.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.275+0000 7f451f2049c0 20 get_obj_state: setting s->obj_tag to wj74o4f5uh7zim12b22bo46mx3tun8g5 2024-09-12T00:38:06.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.275+0000 7f451f2049c0 20 get_obj_state_impl: setting s->olh_tag to xkf7tliu8oihb4mp2otkunen2qwaw3dm 2024-09-12T00:38:06.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.275+0000 7f451f2049c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=xkf7tliu8oihb4mp2otkunen2qwaw3dm 2024-09-12T00:38:06.277 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.275+0000 7f451f2049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.275+0000 7f451f2049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.275+0000 7f451f2049c0 20 olh_log_entry: epoch=3 op=3 key=c[acwBBJ1cpRgi.WA8IsC1NRi9BoZ4LsW] 2024-09-12T00:38:06.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.275+0000 7f451f2049c0 20 get_obj_state: octx=0x55e3a0cca740 obj=check-bucket:_:acwBBJ1cpRgi.WA8IsC1NRi9BoZ4LsW_c state=0x55e3a0f76168 s->prefetch_data=0 2024-09-12T00:38:06.279 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.275+0000 7f451f2049c0 10 manifest: total_size = 12 2024-09-12T00:38:06.279 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.275+0000 7f451f2049c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8777272128505969803 2024-09-12T00:38:06.279 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.275+0000 7f451f2049c0 20 get_obj_state: octx=0x55e3a0cca740 obj=check-bucket:_:acwBBJ1cpRgi.WA8IsC1NRi9BoZ4LsW_c state=0x55e3a0f76168 s->prefetch_data=0 2024-09-12T00:38:06.279 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.275+0000 7f451f2049c0 20 prepare_atomic_modification: state is not atomic. state=0x55e3a0f76168 2024-09-12T00:38:06.279 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.275+0000 7f451f2049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.280 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.279+0000 7f451f2049c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:06.281 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.279+0000 7f451f2049c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T00:38:06.281 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.279+0000 7f451f2049c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:38:06.281 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.279+0000 7f451f2049c0 5 delete_objs_inline: removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2__shadow:acwBBJ1cpRgi.WA8IsC1NRi9BoZ4LsW_.AdImzfQHLGM_7WUp_wTvbXv1uI4-ZqI_0 2024-09-12T00:38:06.281 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.279+0000 7f43f3fff640 20 handle_completion(): completion ok for obj=c[acwBBJ1cpRgi.WA8IsC1NRi9BoZ4LsW] 2024-09-12T00:38:06.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.283+0000 7f451f2049c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:38:06.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.283+0000 7f451f2049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.283+0000 7f451f2049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.283+0000 7f451f2049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.283+0000 7f451f2049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.283+0000 7f451f2049c0 20 get_obj_state: octx=0x55e3a0cca740 obj=check-bucket:d state=0x55e3a0f76168 s->prefetch_data=0 2024-09-12T00:38:06.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.287+0000 7f451f2049c0 20 get_obj_state: setting s->obj_tag to crm7795pz5oiaca8bdyvs0zq184yidt3 2024-09-12T00:38:06.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.287+0000 7f451f2049c0 20 get_obj_state_impl: setting s->olh_tag to rh9d8p3orw393dhxlczapg190g2n6uyw 2024-09-12T00:38:06.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.287+0000 7f451f2049c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rh9d8p3orw393dhxlczapg190g2n6uyw 2024-09-12T00:38:06.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.287+0000 7f451f2049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.290 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.287+0000 7f451f2049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.291 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.287+0000 7f451f2049c0 20 olh_log_entry: epoch=3 op=3 key=d[ZRuRYIv2U1FvZU2uZq4Hi-Aewo3qOVk] 2024-09-12T00:38:06.291 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.287+0000 7f451f2049c0 20 get_obj_state: octx=0x55e3a0cca740 obj=check-bucket:_:ZRuRYIv2U1FvZU2uZq4Hi-Aewo3qOVk_d state=0x55e3a0f72e28 s->prefetch_data=0 2024-09-12T00:38:06.291 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.287+0000 7f451f2049c0 10 manifest: total_size = 12 2024-09-12T00:38:06.291 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.287+0000 7f451f2049c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6337422508647546179 2024-09-12T00:38:06.291 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.287+0000 7f451f2049c0 20 get_obj_state: octx=0x55e3a0cca740 obj=check-bucket:_:ZRuRYIv2U1FvZU2uZq4Hi-Aewo3qOVk_d state=0x55e3a0f72e28 s->prefetch_data=0 2024-09-12T00:38:06.291 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.287+0000 7f451f2049c0 20 prepare_atomic_modification: state is not atomic. state=0x55e3a0f72e28 2024-09-12T00:38:06.292 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.287+0000 7f451f2049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.291+0000 7f451f2049c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:06.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.291+0000 7f451f2049c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T00:38:06.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.291+0000 7f451f2049c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:38:06.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.291+0000 7f451f2049c0 5 delete_objs_inline: removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2__shadow:ZRuRYIv2U1FvZU2uZq4Hi-Aewo3qOVk_.VVFpAz0Vc7RnorqIEVshFsDthneUUlp_0 2024-09-12T00:38:06.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.295+0000 7f43f3fff640 20 handle_completion(): completion ok for obj=d[ZRuRYIv2U1FvZU2uZq4Hi-Aewo3qOVk] 2024-09-12T00:38:06.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.295+0000 7f451f2049c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:38:06.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.295+0000 7f451f2049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.295+0000 7f451f2049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.299+0000 7f451f2049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.300 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.299+0000 7f451f2049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.300 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.299+0000 7f451f2049c0 20 get_obj_state: octx=0x55e3a0cca740 obj=check-bucket:e state=0x55e3a0f760c8 s->prefetch_data=0 2024-09-12T00:38:06.301 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.299+0000 7f451f2049c0 20 get_obj_state: setting s->obj_tag to ae428p2wha206s82slcfxvcbajduxwb2 2024-09-12T00:38:06.301 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.299+0000 7f451f2049c0 20 get_obj_state_impl: setting s->olh_tag to w7pt2yy8bf4hdntidhc9qudfaw77gti6 2024-09-12T00:38:06.301 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.299+0000 7f451f2049c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=w7pt2yy8bf4hdntidhc9qudfaw77gti6 2024-09-12T00:38:06.303 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.299+0000 7f451f2049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.303+0000 7f451f2049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.303+0000 7f451f2049c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T00:38:06.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.303+0000 7f451f2049c0 20 olh_log_entry: epoch=2 op=3 key=e[gwb1MxMicXnSmBNYEk.TeirlEDE5kw9] 2024-09-12T00:38:06.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.303+0000 7f451f2049c0 20 get_obj_state: octx=0x55e3a0cca740 obj=check-bucket:_:gwb1MxMicXnSmBNYEk.TeirlEDE5kw9_e state=0x55e3a0f73e38 s->prefetch_data=0 2024-09-12T00:38:06.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.303+0000 7f451f2049c0 10 manifest: total_size = 9 2024-09-12T00:38:06.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.303+0000 7f451f2049c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.548814526454663393 2024-09-12T00:38:06.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.303+0000 7f451f2049c0 20 get_obj_state: octx=0x55e3a0cca740 obj=check-bucket:_:gwb1MxMicXnSmBNYEk.TeirlEDE5kw9_e state=0x55e3a0f73e38 s->prefetch_data=0 2024-09-12T00:38:06.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.303+0000 7f451f2049c0 20 prepare_atomic_modification: state is not atomic. state=0x55e3a0f73e38 2024-09-12T00:38:06.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.303+0000 7f451f2049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.307+0000 7f451f2049c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:06.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.307+0000 7f451f2049c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-12T00:38:06.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.307+0000 7f451f2049c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:38:06.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.307+0000 7f451f2049c0 5 delete_objs_inline: removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2__shadow:gwb1MxMicXnSmBNYEk.TeirlEDE5kw9_.q-RiHl315l7xMt23Bh8HkBo0YPFiKJ2_0 2024-09-12T00:38:06.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.307+0000 7f43f3fff640 20 handle_completion(): completion ok for obj=e[gwb1MxMicXnSmBNYEk.TeirlEDE5kw9] 2024-09-12T00:38:06.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.307+0000 7f451f2049c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:38:06.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.311+0000 7f451f2049c0 20 get_obj_state: octx=0x55e3a0cca740 obj=check-bucket:e state=0x55e3a0f760c8 s->prefetch_data=0 2024-09-12T00:38:06.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.311+0000 7f451f2049c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=w7pt2yy8bf4hdntidhc9qudfaw77gti6 2024-09-12T00:38:06.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.315+0000 7f451f2049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.315+0000 7f451f2049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.315+0000 7f451f2049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.315+0000 7f451f2049c0 20 get_obj_state: octx=0x55e3a0cca740 obj=check-bucket:f state=0x55e3a0f760c8 s->prefetch_data=0 2024-09-12T00:38:06.319 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.315+0000 7f451f2049c0 20 get_obj_state: setting s->obj_tag to 93v61ml9r2nakywslxnh6imlz6qel6sh 2024-09-12T00:38:06.319 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.315+0000 7f451f2049c0 20 get_obj_state_impl: setting s->olh_tag to vfxtlptklz9e4pqgfv178g7ob0tuk929 2024-09-12T00:38:06.319 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.315+0000 7f451f2049c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=vfxtlptklz9e4pqgfv178g7ob0tuk929 2024-09-12T00:38:06.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.319+0000 7f451f2049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.322 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.319+0000 7f451f2049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.319+0000 7f451f2049c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T00:38:06.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.319+0000 7f451f2049c0 20 olh_log_entry: epoch=2 op=3 key=f[qLIaorRCYCiCWRJQ8Xzch7ZcI3sxYy3] 2024-09-12T00:38:06.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.319+0000 7f451f2049c0 20 get_obj_state: octx=0x55e3a0cca740 obj=check-bucket:_:qLIaorRCYCiCWRJQ8Xzch7ZcI3sxYy3_f state=0x55e3a0f73e38 s->prefetch_data=0 2024-09-12T00:38:06.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.323+0000 7f451f2049c0 10 manifest: total_size = 11 2024-09-12T00:38:06.324 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.323+0000 7f451f2049c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10339817132249473846 2024-09-12T00:38:06.324 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.323+0000 7f451f2049c0 20 get_obj_state: octx=0x55e3a0cca740 obj=check-bucket:_:qLIaorRCYCiCWRJQ8Xzch7ZcI3sxYy3_f state=0x55e3a0f73e38 s->prefetch_data=0 2024-09-12T00:38:06.324 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.323+0000 7f451f2049c0 20 prepare_atomic_modification: state is not atomic. state=0x55e3a0f73e38 2024-09-12T00:38:06.324 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.323+0000 7f451f2049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.325 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.323+0000 7f451f2049c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:38:06.325 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.323+0000 7f451f2049c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T00:38:06.325 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.323+0000 7f451f2049c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:38:06.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.323+0000 7f451f2049c0 5 delete_objs_inline: removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2__shadow:qLIaorRCYCiCWRJQ8Xzch7ZcI3sxYy3_.QdCq1mXxKoldHszhhkAQV2H55np3vxF_0 2024-09-12T00:38:06.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.323+0000 7f451f2049c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:38:06.327 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.323+0000 7f43f37fe640 20 handle_completion(): completion ok for obj=f[qLIaorRCYCiCWRJQ8Xzch7ZcI3sxYy3] 2024-09-12T00:38:06.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.327+0000 7f451f2049c0 20 get_obj_state: octx=0x55e3a0cca740 obj=check-bucket:f state=0x55e3a0f760c8 s->prefetch_data=0 2024-09-12T00:38:06.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.327+0000 7f451f2049c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=vfxtlptklz9e4pqgfv178g7ob0tuk929 2024-09-12T00:38:06.332 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.331+0000 7f451f2049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.334 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.331+0000 7f451f2049c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2.0 2024-09-12T00:38:06.334 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.331+0000 7f451f2049c0 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-12T00:38:06.334 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.331+0000 7f451f2049c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T00:38:06.335 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.331+0000 7f43d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:06.340 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.339+0000 7f451f2049c0 20 remove_watcher() i=0 2024-09-12T00:38:06.340 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.339+0000 7f451f2049c0 2 removed watcher, disabling cache 2024-09-12T00:38:06.342 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.339+0000 7f451f2049c0 20 remove_watcher() i=1 2024-09-12T00:38:06.344 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.343+0000 7f451f2049c0 20 remove_watcher() i=2 2024-09-12T00:38:06.346 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.343+0000 7f451f2049c0 20 remove_watcher() i=3 2024-09-12T00:38:06.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.347+0000 7f451f2049c0 20 remove_watcher() i=4 2024-09-12T00:38:06.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.347+0000 7f451f2049c0 20 remove_watcher() i=5 2024-09-12T00:38:06.350 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.347+0000 7f451f2049c0 20 remove_watcher() i=6 2024-09-12T00:38:06.351 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.351+0000 7f451f2049c0 20 remove_watcher() i=7 2024-09-12T00:38:06.364 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:06.364 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:06.371 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:06.371 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:06.416 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T00:38:06.442 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:06.442 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:06.480 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.479+0000 7f95fe3459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.482 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.479+0000 7f95fe3459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:06.482 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.479+0000 7f95fe3459c0 20 realm 2024-09-12T00:38:06.482 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.479+0000 7f95fe3459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.479+0000 7f95fe3459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:06.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.479+0000 7f95fe3459c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:06.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.479+0000 7f95fe3459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.479+0000 7f95fe3459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:06.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.479+0000 7f95fe3459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.483+0000 7f95fe3459c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:06.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.483+0000 7f95fe3459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.483+0000 7f95fe3459c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:06.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.483+0000 7f95fe3459c0 20 searching for the correct realm 2024-09-12T00:38:06.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.487+0000 7f95fc64c640 0 -- 172.21.15.70:0/3560676795 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f95e4047040 msgr2=0x7f95e403a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:06.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.703+0000 7f95fc64c640 0 -- 172.21.15.70:0/3560676795 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f95e4047040 msgr2=0x7f95e403a910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:06.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.715+0000 7f95fe3459c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:06.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.715+0000 7f95fe3459c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:38:06.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.715+0000 7f95fe3459c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:06.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.715+0000 7f95fe3459c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:38:06.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.715+0000 7f95fe3459c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:06.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.715+0000 7f95fe3459c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:06.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.715+0000 7f95fe3459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.715+0000 7f95fe3459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:06.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.715+0000 7f95fe3459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.715+0000 7f95fe3459c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:06.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.715+0000 7f95fe3459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.715+0000 7f95fe3459c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:06.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.715+0000 7f95fe3459c0 20 zone default found 2024-09-12T00:38:06.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.715+0000 7f95fe3459c0 4 Realm: () 2024-09-12T00:38:06.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.715+0000 7f95fe3459c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:38:06.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.715+0000 7f95fe3459c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:38:06.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.715+0000 7f95fe3459c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:06.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.715+0000 7f95fe3459c0 20 zonegroup default 2024-09-12T00:38:06.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.715+0000 7f95fe3459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.719 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.715+0000 7f95fe3459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:06.719 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.715+0000 7f95fe3459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.719 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.719+0000 7f95fe3459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:06.719 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.719+0000 7f95fe3459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.720 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.719+0000 7f95fe3459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:06.720 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.719+0000 7f95fe3459c0 20 started sync module instance, tier type = 2024-09-12T00:38:06.720 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.719+0000 7f95fe3459c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:38:06.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.739+0000 7f95fe3459c0 20 add_watcher() i=0 2024-09-12T00:38:06.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.743+0000 7f95fe3459c0 20 add_watcher() i=1 2024-09-12T00:38:06.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.743+0000 7f95fe3459c0 20 add_watcher() i=2 2024-09-12T00:38:06.744 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.743+0000 7f95fe3459c0 20 add_watcher() i=3 2024-09-12T00:38:06.744 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.743+0000 7f95fe3459c0 20 add_watcher() i=4 2024-09-12T00:38:06.744 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.743+0000 7f95fe3459c0 20 add_watcher() i=5 2024-09-12T00:38:06.744 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.743+0000 7f95fe3459c0 20 add_watcher() i=6 2024-09-12T00:38:06.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.743+0000 7f95fe3459c0 20 add_watcher() i=7 2024-09-12T00:38:06.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.743+0000 7f95fe3459c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:06.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.747+0000 7f94b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:06.750 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.747+0000 7f95fe3459c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:06.751 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.747+0000 7f95fe3459c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:06.751 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.747+0000 7f95fe3459c0 5 note: GC not initialized 2024-09-12T00:38:06.751 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.747+0000 7f94b0fe1640 20 reqs_thread_entry: start 2024-09-12T00:38:06.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.751+0000 7f95fe3459c0 20 init_complete bucket index max shards: 1 2024-09-12T00:38:06.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.751+0000 7f95fe3459c0 20 Filter name: none 2024-09-12T00:38:06.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.751+0000 7f942a7fc640 20 reqs_thread_entry: start 2024-09-12T00:38:06.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.751+0000 7f95fe3459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.751+0000 7f95fe3459c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:38:06.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.751+0000 7f95fe3459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.753 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.751+0000 7f95fe3459c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:38:06.753 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.751+0000 7f95fe3459c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:06.753 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.751+0000 7f95fe3459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.753 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.751+0000 7f95fe3459c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:38:06.753 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.751+0000 7f95fe3459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:06.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.751+0000 7f95fe3459c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:38:06.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.751+0000 7f95fe3459c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:06.755 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.755+0000 7f94b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:06.760 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.759+0000 7f95fe3459c0 20 remove_watcher() i=0 2024-09-12T00:38:06.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.759+0000 7f95fe3459c0 2 removed watcher, disabling cache 2024-09-12T00:38:06.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.759+0000 7f95fe3459c0 20 remove_watcher() i=1 2024-09-12T00:38:06.765 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.763+0000 7f95fe3459c0 20 remove_watcher() i=2 2024-09-12T00:38:06.767 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.767+0000 7f95fe3459c0 20 remove_watcher() i=3 2024-09-12T00:38:06.770 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.767+0000 7f95fe3459c0 20 remove_watcher() i=4 2024-09-12T00:38:06.771 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.771+0000 7f95fe3459c0 20 remove_watcher() i=5 2024-09-12T00:38:06.773 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.771+0000 7f95fe3459c0 20 remove_watcher() i=6 2024-09-12T00:38:06.774 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:38:06.771+0000 7f95fe3459c0 20 remove_watcher() i=7 2024-09-12T00:38:06.791 INFO:tasks.workunit.client.0.smithi070.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T00:38:06.791 INFO:tasks.workunit.client.0.smithi070.stderr:Deleting bucket check-bucket 2024-09-12T00:38:06.792 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:06.792 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:06.796 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:06.796 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:38:06.818 INFO:tasks.workunit.client.0.smithi070.stderr:Completed bucket check tests 2024-09-12T00:38:06.818 INFO:tasks.workunit.client.0.smithi070.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T00:38:06.818 INFO:tasks.workunit.client.0.smithi070.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T00:38:06.818 INFO:tasks.workunit.client.0.smithi070.stdout:connected to https://localhost:443 2024-09-12T00:38:06.890 INFO:tasks.workunit.client.0.smithi070.stderr:+ deactivate 2024-09-12T00:38:06.890 INFO:tasks.workunit.client.0.smithi070.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T00:38:06.890 INFO:tasks.workunit.client.0.smithi070.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:38:06.890 INFO:tasks.workunit.client.0.smithi070.stderr:+ export PATH 2024-09-12T00:38:06.890 INFO:tasks.workunit.client.0.smithi070.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:38:06.890 INFO:tasks.workunit.client.0.smithi070.stderr:+ '[' -n '' ']' 2024-09-12T00:38:06.890 INFO:tasks.workunit.client.0.smithi070.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:38:06.890 INFO:tasks.workunit.client.0.smithi070.stderr:+ hash -r 2024-09-12T00:38:06.890 INFO:tasks.workunit.client.0.smithi070.stderr:+ '[' -n '' ']' 2024-09-12T00:38:06.890 INFO:tasks.workunit.client.0.smithi070.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:38:06.891 INFO:tasks.workunit.client.0.smithi070.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:38:06.891 INFO:tasks.workunit.client.0.smithi070.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:38:06.891 INFO:tasks.workunit.client.0.smithi070.stderr:+ unset -f deactivate 2024-09-12T00:38:06.891 INFO:tasks.workunit.client.0.smithi070.stderr:+ echo OK. 2024-09-12T00:38:06.892 INFO:tasks.workunit.client.0.smithi070.stdout:OK. 2024-09-12T00:38:06.892 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:38:06.893 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:38:06.948 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-12T00:38:06.948 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:38:07.355 DEBUG:teuthology.parallel:result is None 2024-09-12T00:38:07.355 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:38:07.367 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:38:07.367 DEBUG:teuthology.orchestra.run.smithi070:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:38:07.416 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:38:07.416 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:38:07.428 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:38:07.428 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:38:07.429 DEBUG:teuthology.orchestra.run.smithi070:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:38:07.464 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:38:07.464 INFO:teuthology.orchestra.run.smithi070.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:38:07.465 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:38:07.512 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:38:07.512 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:38:07.560 INFO:tasks.workunit:timeout=3h 2024-09-12T00:38:07.560 INFO:tasks.workunit:cleanup=True 2024-09-12T00:38:07.561 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:38:07.610 INFO:tasks.workunit.client.0.smithi070.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:38:50.634 INFO:tasks.workunit.client.0.smithi070.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:38:50.635 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:38:50.635 INFO:tasks.workunit.client.0.smithi070.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:38:50.635 INFO:tasks.workunit.client.0.smithi070.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:38:50.635 INFO:tasks.workunit.client.0.smithi070.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:38:50.635 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:38:50.635 INFO:tasks.workunit.client.0.smithi070.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:38:50.635 INFO:tasks.workunit.client.0.smithi070.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:38:50.635 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:38:50.635 INFO:tasks.workunit.client.0.smithi070.stderr: git switch -c 2024-09-12T00:38:50.635 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:38:50.636 INFO:tasks.workunit.client.0.smithi070.stderr:Or undo this operation with: 2024-09-12T00:38:50.636 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:38:50.636 INFO:tasks.workunit.client.0.smithi070.stderr: git switch - 2024-09-12T00:38:50.636 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:38:50.636 INFO:tasks.workunit.client.0.smithi070.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:38:50.636 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:38:50.636 INFO:tasks.workunit.client.0.smithi070.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:38:50.641 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:38:50.688 INFO:tasks.workunit.client.0.smithi070.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:38:50.691 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:38:50.691 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:38:50.748 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:38:50.804 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:38:50.849 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:38:50.850 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:38:50.850 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:38:50.897 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:38:50.901 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:38:50.901 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:38:50.948 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-12T00:38:50.950 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-12T00:38:50.951 DEBUG:teuthology.orchestra.run.smithi070:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-12T00:38:51.015 INFO:tasks.workunit.client.0.smithi070.stdout:Running main() from gmock_main.cc 2024-09-12T00:38:51.015 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:38:51.015 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment set-up. 2024-09-12T00:38:51.015 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 11 tests from ClsLock 2024-09-12T00:38:51.015 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-12T00:38:52.345 INFO:tasks.workunit.client.0.smithi070.stdout:lock: mylock 2024-09-12T00:38:52.345 INFO:tasks.workunit.client.0.smithi070.stdout: lock_type: exclusive 2024-09-12T00:38:52.345 INFO:tasks.workunit.client.0.smithi070.stdout: tag: 2024-09-12T00:38:52.346 INFO:tasks.workunit.client.0.smithi070.stdout: lockers: 2024-09-12T00:38:52.346 INFO:tasks.workunit.client.0.smithi070.stdout: client.5196 expiration=2024-09-12T00:40:52.337100+0000 addr=v1:172.21.15.70:0/499795076 cookie= 2024-09-12T00:38:52.356 INFO:tasks.workunit.client.0.smithi070.stdout:lock: mylock 2024-09-12T00:38:52.356 INFO:tasks.workunit.client.0.smithi070.stdout: lock_type: shared 2024-09-12T00:38:52.356 INFO:tasks.workunit.client.0.smithi070.stdout: tag: 2024-09-12T00:38:52.356 INFO:tasks.workunit.client.0.smithi070.stdout: lockers: 2024-09-12T00:38:52.356 INFO:tasks.workunit.client.0.smithi070.stdout: client.5039 expiration=0.000000 addr=v1:172.21.15.70:0/2846009957 cookie= 2024-09-12T00:38:52.356 INFO:tasks.workunit.client.0.smithi070.stdout: client.5196 expiration=2024-09-12T00:40:52.354896+0000 addr=v1:172.21.15.70:0/499795076 cookie= 2024-09-12T00:38:52.360 INFO:tasks.workunit.client.0.smithi070.stdout:lock: mylock 2024-09-12T00:38:52.360 INFO:tasks.workunit.client.0.smithi070.stdout: lock_type: shared 2024-09-12T00:38:52.360 INFO:tasks.workunit.client.0.smithi070.stdout: tag: 2024-09-12T00:38:52.360 INFO:tasks.workunit.client.0.smithi070.stdout: lockers: 2024-09-12T00:38:52.360 INFO:tasks.workunit.client.0.smithi070.stdout: client.5039 expiration=0.000000 addr=v1:172.21.15.70:0/2846009957 cookie= 2024-09-12T00:38:53.103 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] ClsLock.TestMultiLocking (2089 ms) 2024-09-12T00:38:53.104 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] ClsLock.TestMeta 2024-09-12T00:38:55.205 INFO:tasks.workunit.client.0.smithi070.stdout:lock: mylock 2024-09-12T00:38:55.206 INFO:tasks.workunit.client.0.smithi070.stdout: lock_type: shared 2024-09-12T00:38:55.206 INFO:tasks.workunit.client.0.smithi070.stdout: tag: 2024-09-12T00:38:55.206 INFO:tasks.workunit.client.0.smithi070.stdout: lockers: 2024-09-12T00:38:55.206 INFO:tasks.workunit.client.0.smithi070.stdout: client.5051 expiration=0.000000 addr=v1:172.21.15.70:0/669263826 cookie= 2024-09-12T00:38:55.209 INFO:tasks.workunit.client.0.smithi070.stdout:lock: mylock 2024-09-12T00:38:55.210 INFO:tasks.workunit.client.0.smithi070.stdout: lock_type: exclusive 2024-09-12T00:38:55.210 INFO:tasks.workunit.client.0.smithi070.stdout: tag: new_tag 2024-09-12T00:38:55.210 INFO:tasks.workunit.client.0.smithi070.stdout: lockers: 2024-09-12T00:38:55.210 INFO:tasks.workunit.client.0.smithi070.stdout: client.5208 expiration=0.000000 addr=v1:172.21.15.70:0/2489181706 cookie= 2024-09-12T00:38:56.139 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] ClsLock.TestMeta (3036 ms) 2024-09-12T00:38:56.139 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] ClsLock.TestCookie 2024-09-12T00:38:58.178 INFO:tasks.workunit.client.0.smithi070.stdout:lock: mylock 2024-09-12T00:38:58.178 INFO:tasks.workunit.client.0.smithi070.stdout: lock_type: exclusive 2024-09-12T00:38:58.178 INFO:tasks.workunit.client.0.smithi070.stdout: tag: 2024-09-12T00:38:58.178 INFO:tasks.workunit.client.0.smithi070.stdout: lockers: 2024-09-12T00:38:58.182 INFO:tasks.workunit.client.0.smithi070.stdout:lock: mylock 2024-09-12T00:38:58.182 INFO:tasks.workunit.client.0.smithi070.stdout: lock_type: shared 2024-09-12T00:38:58.182 INFO:tasks.workunit.client.0.smithi070.stdout: tag: 2024-09-12T00:38:58.182 INFO:tasks.workunit.client.0.smithi070.stdout: lockers: 2024-09-12T00:38:58.182 INFO:tasks.workunit.client.0.smithi070.stdout: client.5057 expiration=0.000000 addr=v1:172.21.15.70:0/2059545721 cookie= 2024-09-12T00:38:58.182 INFO:tasks.workunit.client.0.smithi070.stdout: client.5057 expiration=0.000000 addr=v1:172.21.15.70:0/2059545721 cookie=new cookie 2024-09-12T00:38:59.145 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] ClsLock.TestCookie (3006 ms) 2024-09-12T00:38:59.145 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-12T00:39:02.211 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] ClsLock.TestMultipleLocks (3065 ms) 2024-09-12T00:39:02.211 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-12T00:39:10.271 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] ClsLock.TestLockDuration (8060 ms) 2024-09-12T00:39:10.271 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-12T00:39:13.288 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] ClsLock.TestAssertLocked (3017 ms) 2024-09-12T00:39:13.288 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-12T00:39:16.362 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] ClsLock.TestSetCookie (3075 ms) 2024-09-12T00:39:16.363 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] ClsLock.TestRenew 2024-09-12T00:39:36.525 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] ClsLock.TestRenew (20162 ms) 2024-09-12T00:39:36.525 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-12T00:39:43.598 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7074 ms) 2024-09-12T00:39:43.598 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-12T00:39:50.714 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7116 ms) 2024-09-12T00:39:50.714 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-12T00:39:58.778 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8063 ms) 2024-09-12T00:39:58.778 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 11 tests from ClsLock (67763 ms total) 2024-09-12T00:39:58.778 INFO:tasks.workunit.client.0.smithi070.stdout: 2024-09-12T00:39:58.778 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment tear-down 2024-09-12T00:39:58.778 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] 11 tests from 1 test suite ran. (67763 ms total) 2024-09-12T00:39:58.778 INFO:tasks.workunit.client.0.smithi070.stdout:[ PASSED ] 11 tests. 2024-09-12T00:39:58.785 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:39:58.786 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:39:58.839 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-12T00:39:58.840 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-12T00:39:58.841 DEBUG:teuthology.orchestra.run.smithi070:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-12T00:39:58.905 INFO:tasks.workunit.client.0.smithi070.stdout:Running main() from gmock_main.cc 2024-09-12T00:39:58.905 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:39:58.905 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment set-up. 2024-09-12T00:39:58.905 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 4 tests from cls_log 2024-09-12T00:39:58.905 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-12T00:40:01.823 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_log.test_log_add_same_time (2918 ms) 2024-09-12T00:40:01.824 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-12T00:40:04.834 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_log.test_log_add_different_time (3010 ms) 2024-09-12T00:40:04.834 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_log.trim_by_time 2024-09-12T00:40:07.880 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_log.trim_by_time (3046 ms) 2024-09-12T00:40:07.880 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-12T00:40:10.952 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_log.trim_by_marker (3073 ms) 2024-09-12T00:40:10.952 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 4 tests from cls_log (12047 ms total) 2024-09-12T00:40:10.952 INFO:tasks.workunit.client.0.smithi070.stdout: 2024-09-12T00:40:10.952 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment tear-down 2024-09-12T00:40:10.952 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] 4 tests from 1 test suite ran. (12047 ms total) 2024-09-12T00:40:10.952 INFO:tasks.workunit.client.0.smithi070.stdout:[ PASSED ] 4 tests. 2024-09-12T00:40:10.960 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:40:10.960 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:40:11.020 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-12T00:40:11.022 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-12T00:40:11.023 DEBUG:teuthology.orchestra.run.smithi070:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-12T00:40:11.086 INFO:tasks.workunit.client.0.smithi070.stdout:Running main() from gmock_main.cc 2024-09-12T00:40:11.087 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T00:40:11.087 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment set-up. 2024-09-12T00:40:11.087 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 10 tests from cls_refcount 2024-09-12T00:40:11.087 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-12T00:40:13.977 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_refcount.test_implicit (2891 ms) 2024-09-12T00:40:13.977 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-12T00:40:17.014 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3036 ms) 2024-09-12T00:40:17.014 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-12T00:40:26.103 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_refcount.test_put_snap (9089 ms) 2024-09-12T00:40:26.103 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-12T00:40:29.107 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_refcount.test_explicit (3005 ms) 2024-09-12T00:40:29.107 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_refcount.set 2024-09-12T00:40:32.165 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_refcount.set (3058 ms) 2024-09-12T00:40:32.165 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-12T00:40:39.258 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_refcount.test_implicit_ec (7093 ms) 2024-09-12T00:40:39.258 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-12T00:40:46.320 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7062 ms) 2024-09-12T00:40:46.321 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-12T00:40:58.461 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_refcount.test_put_snap_ec (12141 ms) 2024-09-12T00:40:58.461 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-12T00:41:05.543 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_refcount.test_explicit_ec (7082 ms) 2024-09-12T00:41:05.543 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_refcount.set_ec 2024-09-12T00:41:12.590 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_refcount.set_ec (7047 ms) 2024-09-12T00:41:12.590 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 10 tests from cls_refcount (61504 ms total) 2024-09-12T00:41:12.590 INFO:tasks.workunit.client.0.smithi070.stdout: 2024-09-12T00:41:12.591 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment tear-down 2024-09-12T00:41:12.591 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] 10 tests from 1 test suite ran. (61504 ms total) 2024-09-12T00:41:12.591 INFO:tasks.workunit.client.0.smithi070.stdout:[ PASSED ] 10 tests. 2024-09-12T00:41:12.598 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:41:12.598 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:41:12.654 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-12T00:41:12.656 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-12T00:41:12.656 DEBUG:teuthology.orchestra.run.smithi070:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-12T00:41:12.722 INFO:tasks.workunit.client.0.smithi070.stdout:Running main() from gmock_main.cc 2024-09-12T00:41:12.723 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:41:12.723 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment set-up. 2024-09-12T00:41:12.723 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 19 tests from cls_rgw 2024-09-12T00:41:14.622 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw.index_basic 2024-09-12T00:41:14.685 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw.index_basic (63 ms) 2024-09-12T00:41:14.685 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-12T00:41:14.769 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (85 ms) 2024-09-12T00:41:14.769 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-12T00:41:14.878 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw.index_remove_object (108 ms) 2024-09-12T00:41:14.878 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-12T00:41:17.347 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw.index_suggest (2469 ms) 2024-09-12T00:41:17.347 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-12T00:41:17.361 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw.index_suggest_complete (15 ms) 2024-09-12T00:41:17.361 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw.index_list 2024-09-12T00:41:17.412 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw.index_list (51 ms) 2024-09-12T00:41:17.413 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-12T00:41:59.187 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw.index_list_delimited (41775 ms) 2024-09-12T00:41:59.187 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw.bi_list 2024-09-12T00:41:59.355 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw.bi_list (168 ms) 2024-09-12T00:41:59.355 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw.gc_set 2024-09-12T00:41:59.378 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw.gc_set (23 ms) 2024-09-12T00:41:59.378 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw.gc_list 2024-09-12T00:41:59.401 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw.gc_list (24 ms) 2024-09-12T00:41:59.401 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-12T00:42:06.583 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw.gc_defer (7180 ms) 2024-09-12T00:42:06.584 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-12T00:42:07.063 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw.usage_basic (480 ms) 2024-09-12T00:42:07.063 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-12T00:42:07.065 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw.usage_clear_no_obj (3 ms) 2024-09-12T00:42:07.065 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-12T00:42:07.296 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw.usage_clear (231 ms) 2024-09-12T00:42:07.297 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-12T00:42:07.413 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw.bi_log_trim (116 ms) 2024-09-12T00:42:07.413 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-12T00:42:07.446 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw.index_racing_removes (34 ms) 2024-09-12T00:42:07.446 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-12T00:42:07.481 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw.reshardlog_list (34 ms) 2024-09-12T00:42:07.481 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-12T00:42:07.507 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw.reshardlog_num (27 ms) 2024-09-12T00:42:07.507 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw.bi_put_entries 2024-09-12T00:42:07.567 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw.bi_put_entries (60 ms) 2024-09-12T00:42:07.615 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 19 tests from cls_rgw (52947 ms total) 2024-09-12T00:42:07.616 INFO:tasks.workunit.client.0.smithi070.stdout: 2024-09-12T00:42:07.616 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment tear-down 2024-09-12T00:42:07.616 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] 19 tests from 1 test suite ran. (54894 ms total) 2024-09-12T00:42:07.616 INFO:tasks.workunit.client.0.smithi070.stdout:[ PASSED ] 19 tests. 2024-09-12T00:42:07.622 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:42:07.623 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:42:07.678 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-12T00:42:07.679 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-12T00:42:07.680 DEBUG:teuthology.orchestra.run.smithi070:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-12T00:42:07.744 INFO:tasks.workunit.client.0.smithi070.stdout:Running main() from gmock_main.cc 2024-09-12T00:42:07.744 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:42:07.744 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment set-up. 2024-09-12T00:42:07.744 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-12T00:42:07.744 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw_gc.init 2024-09-12T00:42:09.612 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw_gc.init (1867 ms) 2024-09-12T00:42:09.612 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-12T00:42:09.663 INFO:tasks.workunit.client.0.smithi070.stderr:[ ] list info tag = chain-0 2024-09-12T00:42:09.663 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (50 ms) 2024-09-12T00:42:09.663 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-12T00:42:09.676 INFO:tasks.workunit.client.0.smithi070.stderr:[ ] next_marker is: = 0/4263 2024-09-12T00:42:09.676 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (14 ms) 2024-09-12T00:42:09.676 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-12T00:42:09.692 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (16 ms) 2024-09-12T00:42:09.692 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-12T00:42:09.708 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (16 ms) 2024-09-12T00:42:09.709 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-12T00:42:09.727 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (18 ms) 2024-09-12T00:42:09.727 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-12T00:42:09.745 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (18 ms) 2024-09-12T00:42:09.745 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-12T00:42:09.760 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (16 ms) 2024-09-12T00:42:09.760 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-12T00:42:10.640 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw_gc.finalize (879 ms) 2024-09-12T00:42:10.640 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 9 tests from cls_rgw_gc (2895 ms total) 2024-09-12T00:42:10.640 INFO:tasks.workunit.client.0.smithi070.stdout: 2024-09-12T00:42:10.640 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment tear-down 2024-09-12T00:42:10.640 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] 9 tests from 1 test suite ran. (2896 ms total) 2024-09-12T00:42:10.640 INFO:tasks.workunit.client.0.smithi070.stdout:[ PASSED ] 9 tests. 2024-09-12T00:42:10.646 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:42:10.646 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:42:10.702 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-12T00:42:10.703 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-12T00:42:10.703 DEBUG:teuthology.orchestra.run.smithi070:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-12T00:42:10.778 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:10.778 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:10.779 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] Running 1 test from 1 test suite. 2024-09-12T00:42:10.779 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment set-up. 2024-09-12T00:42:12.663 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 1 test from cls_rgw_stats 2024-09-12T00:42:12.664 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-12T00:42:12.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.706+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~6KZJXZSPAV2M.0 size=386949 2024-09-12T00:42:12.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.706+0000 7fcde98768c0 1 > prepared multipart upload key=97030NBF3MI4 upload=6KZJXZSPAV2M tag=BX6S6EAHLD5C type=write size=1435525 2024-09-12T00:42:12.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.710+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=4LK3GJC1EZUU type=del size=2523503 2024-09-12T00:42:12.712 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.714+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~7WT3CI90AHXE.0 size=1048576 2024-09-12T00:42:12.713 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.714+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~7WT3CI90AHXE.1 size=424266 2024-09-12T00:42:12.713 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.714+0000 7fcde98768c0 1 > prepared multipart upload key=FUJIUIR1E00J upload=7WT3CI90AHXE tag=783UO08BZ9ZZ type=write size=2521418 2024-09-12T00:42:12.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.718+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~VNCY1A9GAT8P.0 size=1048576 2024-09-12T00:42:12.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.722+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~VNCY1A9GAT8P.1 size=1048576 2024-09-12T00:42:12.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.722+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~VNCY1A9GAT8P.2 size=713876 2024-09-12T00:42:12.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.722+0000 7fcde98768c0 1 > prepared multipart upload key=ZQD0QXDN1J1I upload=VNCY1A9GAT8P tag=4Z49R4E08XN1 type=write size=3859604 2024-09-12T00:42:12.722 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.726+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~0PTIV0KTUL3H.0 size=69226 2024-09-12T00:42:12.722 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.726+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=0PTIV0KTUL3H tag=43XINBAJI8AP type=write size=1117802 2024-09-12T00:42:12.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.726+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=MECKZDLAVBNY type=write size=772164 2024-09-12T00:42:12.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.730+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=KJ321P6WV814 type=del size=2122546 2024-09-12T00:42:12.731 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.734+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~7KRF80CJT55Z.0 size=754730 2024-09-12T00:42:12.731 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.734+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=7KRF80CJT55Z tag=8ZG1P5MDQ76M type=write size=1803306 2024-09-12T00:42:12.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.738+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=74CT0BJJDREY type=del size=3287528 2024-09-12T00:42:12.736 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.738+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=KB8PVYS62Q7F type=del size=2093970 2024-09-12T00:42:12.738 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.742+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=Q7YYO3R05CRE type=del size=1737854 2024-09-12T00:42:12.742 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.746+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~BYNTJKB9B6EY.0 size=1048576 2024-09-12T00:42:12.744 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.746+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~BYNTJKB9B6EY.1 size=1048576 2024-09-12T00:42:12.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.750+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~BYNTJKB9B6EY.2 size=948990 2024-09-12T00:42:12.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.750+0000 7fcde98768c0 1 > prepared multipart upload key=5B8C6E8L5N52 upload=BYNTJKB9B6EY tag=F514Z01PBLVB type=write size=4094718 2024-09-12T00:42:12.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.754+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=WN30VEQMKEHB type=del size=2814869 2024-09-12T00:42:12.751 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.754+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=T7LVTBFB9371 type=del size=1551759 2024-09-12T00:42:12.753 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.758+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=I8Q7O7TP8CWN type=del size=1240481 2024-09-12T00:42:12.756 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.758+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=RBR7IXM74XPF type=del size=3780110 2024-09-12T00:42:12.758 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.762+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~6KZJXZSPAV2M.0 size=386949 2024-09-12T00:42:12.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.766+0000 7fcde98768c0 1 < completed multipart upload key=97030NBF3MI4 upload=6KZJXZSPAV2M tag=BX6S6EAHLD5C type=write size=1435525 2024-09-12T00:42:12.765 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.770+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=G62F9JI7HQED type=del size=1050453 2024-09-12T00:42:12.767 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.770+0000 7fcde98768c0 1 < canceled operation key=Z4RNDW37GEK6 tag=4LK3GJC1EZUU type=del size=2523503 2024-09-12T00:42:12.772 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.774+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~VQ3O3AXTZUD0.0 size=1048576 2024-09-12T00:42:12.774 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.778+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~VQ3O3AXTZUD0.1 size=142355 2024-09-12T00:42:12.774 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.778+0000 7fcde98768c0 1 > prepared multipart upload key=RC9A2Y5TCP9C upload=VQ3O3AXTZUD0 tag=AS3PAUIZPCQ2 type=write size=2239507 2024-09-12T00:42:12.776 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.778+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~7WT3CI90AHXE.0 size=1048576 2024-09-12T00:42:12.778 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.782+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~7WT3CI90AHXE.1 size=424266 2024-09-12T00:42:12.782 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.786+0000 7fcde98768c0 1 < completed multipart upload key=FUJIUIR1E00J upload=7WT3CI90AHXE tag=783UO08BZ9ZZ type=write size=2521418 2024-09-12T00:42:12.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.790+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=R0BU136ZFZ05 type=del size=402719 2024-09-12T00:42:12.787 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.790+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~VNCY1A9GAT8P.0 size=1048576 2024-09-12T00:42:12.789 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.794+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~VNCY1A9GAT8P.1 size=1048576 2024-09-12T00:42:12.791 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.794+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~VNCY1A9GAT8P.2 size=713876 2024-09-12T00:42:12.796 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.798+0000 7fcde98768c0 1 < completed multipart upload key=ZQD0QXDN1J1I upload=VNCY1A9GAT8P tag=4Z49R4E08XN1 type=write size=3859604 2024-09-12T00:42:12.802 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.806+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~5LNO4XR1F0DJ.0 size=1048576 2024-09-12T00:42:12.804 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.806+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~5LNO4XR1F0DJ.1 size=335876 2024-09-12T00:42:12.804 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.806+0000 7fcde98768c0 1 > prepared multipart upload key=BQGIXJJWBAN0 upload=5LNO4XR1F0DJ tag=CTIPVASZ0PWG type=write size=2433028 2024-09-12T00:42:12.807 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.810+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~0PTIV0KTUL3H.0 size=69226 2024-09-12T00:42:12.811 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.814+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=0PTIV0KTUL3H tag=43XINBAJI8AP type=write size=1117802 2024-09-12T00:42:12.814 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.818+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=BOSW53USGK11 type=del size=1008290 2024-09-12T00:42:12.816 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.822+0000 7fcde98768c0 1 < completed write operation key=BZ4YUNTMOJBK tag=MECKZDLAVBNY type=write size=772164 2024-09-12T00:42:12.819 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.822+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=2LGDRUHBIAH5 type=del size=3707372 2024-09-12T00:42:12.822 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.826+0000 7fcde98768c0 1 < completed delete operation key=5YBVLUYJW40U tag=KJ321P6WV814 type=del 2024-09-12T00:42:12.824 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.826+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=ZFU4H4EZMCQD type=write size=510523 2024-09-12T00:42:12.826 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.830+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~7KRF80CJT55Z.0 size=754730 2024-09-12T00:42:12.830 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.834+0000 7fcde98768c0 1 < completed multipart upload key=IV4JCE1QJC70 upload=7KRF80CJT55Z tag=8ZG1P5MDQ76M type=write size=1803306 2024-09-12T00:42:12.835 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.838+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~PP07DEQ4KWTP.0 size=687226 2024-09-12T00:42:12.835 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.838+0000 7fcde98768c0 1 > prepared multipart upload key=F813QWV02TI0 upload=PP07DEQ4KWTP tag=HFV4G1W09SKK type=write size=1735802 2024-09-12T00:42:12.837 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.842+0000 7fcde98768c0 1 < completed delete operation key=Z1PY2MFUC1C4 tag=74CT0BJJDREY type=del 2024-09-12T00:42:12.839 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.842+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=GXRTC4O24UK9 type=del size=4127671 2024-09-12T00:42:12.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.846+0000 7fcde98768c0 1 < completed delete operation key=368TXYQVK9C3 tag=KB8PVYS62Q7F type=del 2024-09-12T00:42:12.846 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.850+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~QD6FF4T73TR3.0 size=1048576 2024-09-12T00:42:12.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.850+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~QD6FF4T73TR3.1 size=913523 2024-09-12T00:42:12.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.850+0000 7fcde98768c0 1 > prepared multipart upload key=7UR0FX8HA2A5 upload=QD6FF4T73TR3 tag=WU0X18Q3TP49 type=write size=3010675 2024-09-12T00:42:12.850 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.854+0000 7fcde98768c0 1 < completed delete operation key=RC9A2Y5TCP9C tag=Q7YYO3R05CRE type=del 2024-09-12T00:42:12.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.858+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~S4VJQBQNDU2Z.0 size=1048576 2024-09-12T00:42:12.857 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.862+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~S4VJQBQNDU2Z.1 size=1048576 2024-09-12T00:42:12.859 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.862+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~S4VJQBQNDU2Z.2 size=204475 2024-09-12T00:42:12.859 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.862+0000 7fcde98768c0 1 > prepared multipart upload key=3X9I78PMR1HV upload=S4VJQBQNDU2Z tag=C9JVNHMOSY3T type=write size=3350203 2024-09-12T00:42:12.861 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.866+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~BYNTJKB9B6EY.0 size=1048576 2024-09-12T00:42:12.863 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.866+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~BYNTJKB9B6EY.1 size=1048576 2024-09-12T00:42:12.865 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.870+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~BYNTJKB9B6EY.2 size=948990 2024-09-12T00:42:12.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.870+0000 7fcde98768c0 1 < completed multipart upload key=5B8C6E8L5N52 upload=BYNTJKB9B6EY tag=F514Z01PBLVB type=write size=4094718 2024-09-12T00:42:12.870 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.874+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=6JH8R0KU5R63 type=del size=3552906 2024-09-12T00:42:12.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.878+0000 7fcde98768c0 1 < canceled operation key=7UR0FX8HA2A5 tag=WN30VEQMKEHB type=del size=2814869 2024-09-12T00:42:12.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.882+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~63FIF3ECY2D5.0 size=77025 2024-09-12T00:42:12.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.882+0000 7fcde98768c0 1 > prepared multipart upload key=EDFNLQYP4L4L upload=63FIF3ECY2D5 tag=XQH9FLEOP4R0 type=write size=1125601 2024-09-12T00:42:12.879 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.882+0000 7fcde98768c0 1 < completed delete operation key=V80E1NH858IK tag=T7LVTBFB9371 type=del 2024-09-12T00:42:12.881 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.886+0000 7fcde98768c0 1 > prepared operation key=KME8ZTTUGOXY tag=RK5ZQ8HHLYKZ type=del size=694485 2024-09-12T00:42:12.883 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.886+0000 7fcde98768c0 1 < completed delete operation key=Z1PY2MFUC1C4 tag=I8Q7O7TP8CWN type=del 2024-09-12T00:42:12.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.890+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~6AICI0BM0I03.0 size=133399 2024-09-12T00:42:12.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.890+0000 7fcde98768c0 1 > prepared multipart upload key=NVOFV649MT0A upload=6AICI0BM0I03 tag=0PHMX5Y38NMI type=write size=1181975 2024-09-12T00:42:12.890 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.894+0000 7fcde98768c0 1 < canceled operation key=R2EBH0Q5885L tag=RBR7IXM74XPF type=del size=3780110 2024-09-12T00:42:12.892 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.894+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=6I96OCF4AKTZ type=del size=3652748 2024-09-12T00:42:12.894 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.898+0000 7fcde98768c0 1 < completed delete operation key=V80E1NH858IK tag=G62F9JI7HQED type=del 2024-09-12T00:42:12.897 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.902+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=Y88O1SDQRR9M type=del size=2636749 2024-09-12T00:42:12.897 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.902+0000 7fcde98768c0 1 < canceled part key=_multipart_RC9A2Y5TCP9C.2~VQ3O3AXTZUD0.0 size=1048576 2024-09-12T00:42:12.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.902+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~VQ3O3AXTZUD0.1 size=142355 2024-09-12T00:42:12.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.906+0000 7fcde98768c0 1 < canceled multipart upload key=RC9A2Y5TCP9C upload=VQ3O3AXTZUD0 tag=AS3PAUIZPCQ2 type=write size=2239507 2024-09-12T00:42:12.904 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.906+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=AM054OTSPSA2 type=del size=1037593 2024-09-12T00:42:12.906 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.910+0000 7fcde98768c0 1 < completed delete operation key=HVE3YQTFZWTV tag=R0BU136ZFZ05 type=del 2024-09-12T00:42:12.908 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.910+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=CYDEV16NTCQ4 type=del size=1431745 2024-09-12T00:42:12.910 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.914+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~5LNO4XR1F0DJ.0 size=1048576 2024-09-12T00:42:12.912 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.914+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~5LNO4XR1F0DJ.1 size=335876 2024-09-12T00:42:12.915 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.918+0000 7fcde98768c0 1 < completed multipart upload key=BQGIXJJWBAN0 upload=5LNO4XR1F0DJ tag=CTIPVASZ0PWG type=write size=2433028 2024-09-12T00:42:12.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.922+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=X3N3AH17OL3F type=write size=399398 2024-09-12T00:42:12.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.926+0000 7fcde98768c0 1 < suggested remove operation key=WLE5QLNPAGZA tag=BOSW53USGK11 type=del 2024-09-12T00:42:12.927 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.930+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~OZA2W6RF3O8U.0 size=1048576 2024-09-12T00:42:12.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.930+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~OZA2W6RF3O8U.1 size=1048576 2024-09-12T00:42:12.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.934+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~OZA2W6RF3O8U.2 size=879779 2024-09-12T00:42:12.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.934+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=OZA2W6RF3O8U tag=FVG4NJBYDP1Z type=write size=4025507 2024-09-12T00:42:12.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.938+0000 7fcde98768c0 1 < suggested update operation key=HVE3YQTFZWTV tag=2LGDRUHBIAH5 type=del size=3707372 2024-09-12T00:42:12.937 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.942+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=CTS0A6X0ZYNA type=del size=1787756 2024-09-12T00:42:12.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.942+0000 7fcde98768c0 1 < completed write operation key=F813QWV02TI0 tag=ZFU4H4EZMCQD type=write size=510523 2024-09-12T00:42:12.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.946+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=5LY026RI7K21 type=write size=1016951 2024-09-12T00:42:12.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.946+0000 7fcde98768c0 1 < canceled part key=_multipart_F813QWV02TI0.2~PP07DEQ4KWTP.0 size=687226 2024-09-12T00:42:12.944 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.946+0000 7fcde98768c0 1 < canceled multipart upload key=F813QWV02TI0 upload=PP07DEQ4KWTP tag=HFV4G1W09SKK type=write size=1735802 2024-09-12T00:42:12.948 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.950+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~DFEAN1FNA6B6.0 size=1048576 2024-09-12T00:42:12.949 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.954+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~DFEAN1FNA6B6.1 size=863414 2024-09-12T00:42:12.949 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.954+0000 7fcde98768c0 1 > prepared multipart upload key=Z1PY2MFUC1C4 upload=DFEAN1FNA6B6 tag=1ACF7R6UWGXV type=write size=2960566 2024-09-12T00:42:12.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.958+0000 7fcde98768c0 1 < suggested update operation key=QD5JXFL962R5 tag=GXRTC4O24UK9 type=del size=4127671 2024-09-12T00:42:12.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.958+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=2YU7NLLFGJV6 type=write size=925288 2024-09-12T00:42:12.957 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.962+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~QD6FF4T73TR3.0 size=1048576 2024-09-12T00:42:12.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.962+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~QD6FF4T73TR3.1 size=913523 2024-09-12T00:42:12.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.966+0000 7fcde98768c0 1 < completed multipart upload key=7UR0FX8HA2A5 upload=QD6FF4T73TR3 tag=WU0X18Q3TP49 type=write size=3010675 2024-09-12T00:42:12.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.970+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=ZU75O5QJWVQP type=del size=3634585 2024-09-12T00:42:12.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.970+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~S4VJQBQNDU2Z.0 size=1048576 2024-09-12T00:42:12.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.974+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~S4VJQBQNDU2Z.1 size=1048576 2024-09-12T00:42:12.970 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.974+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~S4VJQBQNDU2Z.2 size=204475 2024-09-12T00:42:12.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.978+0000 7fcde98768c0 1 < completed multipart upload key=3X9I78PMR1HV upload=S4VJQBQNDU2Z tag=C9JVNHMOSY3T type=write size=3350203 2024-09-12T00:42:12.978 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.982+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~QB8K7NMS509R.0 size=1048576 2024-09-12T00:42:12.980 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.982+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~QB8K7NMS509R.1 size=1048576 2024-09-12T00:42:12.982 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.986+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~QB8K7NMS509R.2 size=433304 2024-09-12T00:42:12.982 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.986+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=QB8K7NMS509R tag=OAJXXYMQ805S type=write size=3579032 2024-09-12T00:42:12.984 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.986+0000 7fcde98768c0 1 < completed delete operation key=Z4RNDW37GEK6 tag=6JH8R0KU5R63 type=del 2024-09-12T00:42:12.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.990+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=O02A7N6M7RXC type=write size=585259 2024-09-12T00:42:12.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.994+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~63FIF3ECY2D5.0 size=77025 2024-09-12T00:42:12.993 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.998+0000 7fcde98768c0 1 < completed multipart upload key=EDFNLQYP4L4L upload=63FIF3ECY2D5 tag=XQH9FLEOP4R0 type=write size=1125601 2024-09-12T00:42:12.996 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:12.998+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=70HH4OBLOKXX type=del size=1598502 2024-09-12T00:42:12.998 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.002+0000 7fcde98768c0 1 < completed delete operation key=KME8ZTTUGOXY tag=RK5ZQ8HHLYKZ type=del 2024-09-12T00:42:13.001 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.006+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=UKTH5IVERZCV type=del size=2543609 2024-09-12T00:42:13.004 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.006+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~6AICI0BM0I03.0 size=133399 2024-09-12T00:42:13.009 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.014+0000 7fcde98768c0 1 < completed multipart upload key=NVOFV649MT0A upload=6AICI0BM0I03 tag=0PHMX5Y38NMI type=write size=1181975 2024-09-12T00:42:13.011 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.014+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=LDVRYMEYZK1G type=del size=3302644 2024-09-12T00:42:13.015 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.018+0000 7fcde98768c0 1 < suggested update operation key=368TXYQVK9C3 tag=6I96OCF4AKTZ type=del size=3652748 2024-09-12T00:42:13.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.022+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~Q74DVOCEI0WR.0 size=1048576 2024-09-12T00:42:13.020 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.022+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~Q74DVOCEI0WR.1 size=1048576 2024-09-12T00:42:13.022 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.026+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~Q74DVOCEI0WR.2 size=45632 2024-09-12T00:42:13.022 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.026+0000 7fcde98768c0 1 > prepared multipart upload key=TUMAMUZUIR7E upload=Q74DVOCEI0WR tag=PG2W9RHWAPQS type=write size=3191360 2024-09-12T00:42:13.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.030+0000 7fcde98768c0 1 < suggested update operation key=G6R8BX1H7SPM tag=Y88O1SDQRR9M type=del size=2636749 2024-09-12T00:42:13.029 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.034+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=F15Q0816HSH0 type=del size=2263086 2024-09-12T00:42:13.031 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.034+0000 7fcde98768c0 1 < completed delete operation key=V80E1NH858IK tag=AM054OTSPSA2 type=del 2024-09-12T00:42:13.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.038+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=U147CQ4NATFN type=del size=2975921 2024-09-12T00:42:13.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.038+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=CYDEV16NTCQ4 type=del 2024-09-12T00:42:13.038 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.042+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=TF7QROMYBMC2 type=write size=969984 2024-09-12T00:42:13.042 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.046+0000 7fcde98768c0 1 < suggested remove operation key=5B8C6E8L5N52 tag=X3N3AH17OL3F type=write 2024-09-12T00:42:13.044 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.046+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=PX142EGSHKJH type=del size=3334893 2024-09-12T00:42:13.046 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.050+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~OZA2W6RF3O8U.0 size=1048576 2024-09-12T00:42:13.048 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.050+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~OZA2W6RF3O8U.1 size=1048576 2024-09-12T00:42:13.048 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.050+0000 7fcde98768c0 1 < canceled part key=_multipart_IV4JCE1QJC70.2~OZA2W6RF3O8U.2 size=879779 2024-09-12T00:42:13.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.054+0000 7fcde98768c0 1 < canceled multipart upload key=IV4JCE1QJC70 upload=OZA2W6RF3O8U tag=FVG4NJBYDP1Z type=write size=4025507 2024-09-12T00:42:13.053 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.058+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=3BTM4KL2ZBSK type=del size=2831904 2024-09-12T00:42:13.055 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.058+0000 7fcde98768c0 1 < completed delete operation key=HVE3YQTFZWTV tag=CTS0A6X0ZYNA type=del 2024-09-12T00:42:13.057 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.062+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=S15ZS21AJMFH type=del size=311147 2024-09-12T00:42:13.059 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.062+0000 7fcde98768c0 1 < completed write operation key=RC9A2Y5TCP9C tag=5LY026RI7K21 type=write size=1016951 2024-09-12T00:42:13.062 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.066+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~CHQGAJVLNHW7.0 size=1048576 2024-09-12T00:42:13.064 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.066+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~CHQGAJVLNHW7.1 size=1048576 2024-09-12T00:42:13.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.070+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~CHQGAJVLNHW7.2 size=388949 2024-09-12T00:42:13.066 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.070+0000 7fcde98768c0 1 > prepared multipart upload key=F813QWV02TI0 upload=CHQGAJVLNHW7 tag=GDQQ3JYD6G4U type=write size=3534677 2024-09-12T00:42:13.068 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.070+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~DFEAN1FNA6B6.0 size=1048576 2024-09-12T00:42:13.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.074+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~DFEAN1FNA6B6.1 size=863414 2024-09-12T00:42:13.073 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.078+0000 7fcde98768c0 1 < completed multipart upload key=Z1PY2MFUC1C4 upload=DFEAN1FNA6B6 tag=1ACF7R6UWGXV type=write size=2960566 2024-09-12T00:42:13.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.078+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~R9DW1A4V7FDG.0 size=1048576 2024-09-12T00:42:13.077 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.082+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~R9DW1A4V7FDG.1 size=1048576 2024-09-12T00:42:13.079 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.082+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~R9DW1A4V7FDG.2 size=965952 2024-09-12T00:42:13.079 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.082+0000 7fcde98768c0 1 > prepared multipart upload key=368TXYQVK9C3 upload=R9DW1A4V7FDG tag=E7ZFN10EWK07 type=write size=4111680 2024-09-12T00:42:13.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.086+0000 7fcde98768c0 1 < completed write operation key=ZQD0QXDN1J1I tag=2YU7NLLFGJV6 type=write size=925288 2024-09-12T00:42:13.085 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.090+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~Q8ZI5AUX13XM.0 size=742637 2024-09-12T00:42:13.085 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.090+0000 7fcde98768c0 1 > prepared multipart upload key=7UR0FX8HA2A5 upload=Q8ZI5AUX13XM tag=PLOPT8WSC3BL type=write size=1791213 2024-09-12T00:42:13.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.090+0000 7fcde98768c0 1 < completed delete operation key=4487IMSOLPDV tag=ZU75O5QJWVQP type=del 2024-09-12T00:42:13.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.094+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=OV5GET8QU3RF type=del size=4146248 2024-09-12T00:42:13.092 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.094+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~QB8K7NMS509R.0 size=1048576 2024-09-12T00:42:13.093 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.098+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~QB8K7NMS509R.1 size=1048576 2024-09-12T00:42:13.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.098+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~QB8K7NMS509R.2 size=433304 2024-09-12T00:42:13.100 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.102+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=QB8K7NMS509R tag=OAJXXYMQ805S type=write size=3579032 2024-09-12T00:42:13.103 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.106+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~UHV4A9NL1JQ7.0 size=1048576 2024-09-12T00:42:13.105 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.110+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~UHV4A9NL1JQ7.1 size=836988 2024-09-12T00:42:13.105 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.110+0000 7fcde98768c0 1 > prepared multipart upload key=Z1PY2MFUC1C4 upload=UHV4A9NL1JQ7 tag=NL9RTRI15616 type=write size=2934140 2024-09-12T00:42:13.107 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.110+0000 7fcde98768c0 1 < completed write operation key=5YBVLUYJW40U tag=O02A7N6M7RXC type=write size=585259 2024-09-12T00:42:13.111 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.114+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~NV3H23ORKVY0.0 size=1048576 2024-09-12T00:42:13.113 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.118+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~NV3H23ORKVY0.1 size=1048576 2024-09-12T00:42:13.114 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.118+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~NV3H23ORKVY0.2 size=378838 2024-09-12T00:42:13.115 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.118+0000 7fcde98768c0 1 > prepared multipart upload key=HVE3YQTFZWTV upload=NV3H23ORKVY0 tag=BTGNK9QNTP9K type=write size=3524566 2024-09-12T00:42:13.117 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.122+0000 7fcde98768c0 1 < completed delete operation key=C6PW0ETP4BG2 tag=70HH4OBLOKXX type=del 2024-09-12T00:42:13.120 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.122+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~KT25FZADSB7D.0 size=842067 2024-09-12T00:42:13.121 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.126+0000 7fcde98768c0 1 > prepared multipart upload key=ZQD0QXDN1J1I upload=KT25FZADSB7D tag=2F0N677HTQ6V type=write size=1890643 2024-09-12T00:42:13.124 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.126+0000 7fcde98768c0 1 < suggested remove operation key=WLE5QLNPAGZA tag=UKTH5IVERZCV type=del 2024-09-12T00:42:13.126 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.130+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=1XA450XSZCB0 type=del size=3465771 2024-09-12T00:42:13.128 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.130+0000 7fcde98768c0 1 < completed delete operation key=V80E1NH858IK tag=LDVRYMEYZK1G type=del 2024-09-12T00:42:13.131 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.134+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=XR9M06KUGEB3 type=del size=497299 2024-09-12T00:42:13.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.138+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~Q74DVOCEI0WR.0 size=1048576 2024-09-12T00:42:13.136 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.138+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~Q74DVOCEI0WR.1 size=1048576 2024-09-12T00:42:13.137 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.142+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~Q74DVOCEI0WR.2 size=45632 2024-09-12T00:42:13.141 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.146+0000 7fcde98768c0 1 < completed multipart upload key=TUMAMUZUIR7E upload=Q74DVOCEI0WR tag=PG2W9RHWAPQS type=write size=3191360 2024-09-12T00:42:13.143 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.146+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=8NGJDOEJFC7D type=del size=3981921 2024-09-12T00:42:13.145 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.150+0000 7fcde98768c0 1 < completed delete operation key=4487IMSOLPDV tag=F15Q0816HSH0 type=del 2024-09-12T00:42:13.149 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.154+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~5RIXAHWO9FT1.0 size=728927 2024-09-12T00:42:13.149 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.154+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=5RIXAHWO9FT1 tag=T5EBRZABZ0V1 type=write size=1777503 2024-09-12T00:42:13.151 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.154+0000 7fcde98768c0 1 < completed delete operation key=FUJIUIR1E00J tag=U147CQ4NATFN type=del 2024-09-12T00:42:13.154 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.158+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=32Q7Y8V3IB9E type=write size=746209 2024-09-12T00:42:13.158 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.162+0000 7fcde98768c0 1 < suggested remove operation key=BZ4YUNTMOJBK tag=TF7QROMYBMC2 type=write 2024-09-12T00:42:13.161 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.166+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=8ISEX4GK2343 type=del size=1199966 2024-09-12T00:42:13.163 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.166+0000 7fcde98768c0 1 < completed delete operation key=EDFNLQYP4L4L tag=PX142EGSHKJH type=del 2024-09-12T00:42:13.167 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.170+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~G3Z0VKF1D47P.0 size=491875 2024-09-12T00:42:13.167 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.170+0000 7fcde98768c0 1 > prepared multipart upload key=5B8C6E8L5N52 upload=G3Z0VKF1D47P tag=KK8SMX47OFUH type=write size=1540451 2024-09-12T00:42:13.169 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.174+0000 7fcde98768c0 1 < completed delete operation key=F813QWV02TI0 tag=3BTM4KL2ZBSK type=del 2024-09-12T00:42:13.172 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.174+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~0P9M1IBNVNT7.0 size=1048576 2024-09-12T00:42:13.174 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.178+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~0P9M1IBNVNT7.1 size=781785 2024-09-12T00:42:13.174 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.178+0000 7fcde98768c0 1 > prepared multipart upload key=IMITNCB1ST9E upload=0P9M1IBNVNT7 tag=6VV6FF0HEM3F type=write size=2878937 2024-09-12T00:42:13.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.178+0000 7fcde98768c0 1 < completed delete operation key=Z1PY2MFUC1C4 tag=S15ZS21AJMFH type=del 2024-09-12T00:42:13.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.182+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=MW9VGMTLH5HI type=del size=1378750 2024-09-12T00:42:13.181 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.186+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~CHQGAJVLNHW7.0 size=1048576 2024-09-12T00:42:13.183 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.186+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~CHQGAJVLNHW7.1 size=1048576 2024-09-12T00:42:13.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.190+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~CHQGAJVLNHW7.2 size=388949 2024-09-12T00:42:13.189 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.194+0000 7fcde98768c0 1 < completed multipart upload key=F813QWV02TI0 upload=CHQGAJVLNHW7 tag=GDQQ3JYD6G4U type=write size=3534677 2024-09-12T00:42:13.194 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.198+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~N4N1VDEYHIGE.0 size=612032 2024-09-12T00:42:13.194 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.198+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=N4N1VDEYHIGE tag=NQMJV220HPU2 type=write size=1660608 2024-09-12T00:42:13.197 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.202+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~R9DW1A4V7FDG.0 size=1048576 2024-09-12T00:42:13.199 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.202+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~R9DW1A4V7FDG.1 size=1048576 2024-09-12T00:42:13.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.206+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~R9DW1A4V7FDG.2 size=965952 2024-09-12T00:42:13.207 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.210+0000 7fcde98768c0 1 < completed multipart upload key=368TXYQVK9C3 upload=R9DW1A4V7FDG tag=E7ZFN10EWK07 type=write size=4111680 2024-09-12T00:42:13.210 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.214+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=IUBEYQCWSVOK type=del size=281481 2024-09-12T00:42:13.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.218+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~Q8ZI5AUX13XM.0 size=742637 2024-09-12T00:42:13.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.222+0000 7fcde98768c0 1 < completed multipart upload key=7UR0FX8HA2A5 upload=Q8ZI5AUX13XM tag=PLOPT8WSC3BL type=write size=1791213 2024-09-12T00:42:13.220 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.222+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=VBYI3CJYF9PB type=del size=798215 2024-09-12T00:42:13.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.230+0000 7fcde98768c0 1 < suggested remove operation key=RC9A2Y5TCP9C tag=OV5GET8QU3RF type=del 2024-09-12T00:42:13.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.234+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=7CGZOHWYSMTH type=del size=4146681 2024-09-12T00:42:13.233 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.234+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~UHV4A9NL1JQ7.0 size=1048576 2024-09-12T00:42:13.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.238+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~UHV4A9NL1JQ7.1 size=836988 2024-09-12T00:42:13.239 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.242+0000 7fcde98768c0 1 < completed multipart upload key=Z1PY2MFUC1C4 upload=UHV4A9NL1JQ7 tag=NL9RTRI15616 type=write size=2934140 2024-09-12T00:42:13.242 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.246+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=R8OGRJG1BZQ0 type=write size=538430 2024-09-12T00:42:13.244 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.246+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~NV3H23ORKVY0.0 size=1048576 2024-09-12T00:42:13.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.250+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~NV3H23ORKVY0.1 size=1048576 2024-09-12T00:42:13.249 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.254+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~NV3H23ORKVY0.2 size=378838 2024-09-12T00:42:13.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.258+0000 7fcde98768c0 1 < completed multipart upload key=HVE3YQTFZWTV upload=NV3H23ORKVY0 tag=BTGNK9QNTP9K type=write size=3524566 2024-09-12T00:42:13.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.258+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=D7YVIX9GNNY0 type=del size=1829800 2024-09-12T00:42:13.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.262+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~KT25FZADSB7D.0 size=842067 2024-09-12T00:42:13.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.266+0000 7fcde98768c0 1 < completed multipart upload key=ZQD0QXDN1J1I upload=KT25FZADSB7D tag=2F0N677HTQ6V type=write size=1890643 2024-09-12T00:42:13.267 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.270+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~LG7KU0PSXEZW.0 size=442914 2024-09-12T00:42:13.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.270+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=LG7KU0PSXEZW tag=1U2RJLX3TLB7 type=write size=1491490 2024-09-12T00:42:13.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.274+0000 7fcde98768c0 1 < completed delete operation key=ZQD0QXDN1J1I tag=1XA450XSZCB0 type=del 2024-09-12T00:42:13.272 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.278+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=0Z6U3DDNN1FK type=write size=678179 2024-09-12T00:42:13.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.282+0000 7fcde98768c0 1 < suggested remove operation key=V80E1NH858IK tag=XR9M06KUGEB3 type=del 2024-09-12T00:42:13.282 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.286+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~G33VF5K93PEY.0 size=1048576 2024-09-12T00:42:13.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.286+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~G33VF5K93PEY.1 size=39896 2024-09-12T00:42:13.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.286+0000 7fcde98768c0 1 > prepared multipart upload key=FUJIUIR1E00J upload=G33VF5K93PEY tag=LW0KTPI4FKCM type=write size=2137048 2024-09-12T00:42:13.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.290+0000 7fcde98768c0 1 < completed delete operation key=Z4RNDW37GEK6 tag=8NGJDOEJFC7D type=del 2024-09-12T00:42:13.290 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.294+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~AXJR7DGF1B68.0 size=174336 2024-09-12T00:42:13.290 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.294+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=AXJR7DGF1B68 tag=K9D1F4NRIQ81 type=write size=1222912 2024-09-12T00:42:13.293 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.298+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~5RIXAHWO9FT1.0 size=728927 2024-09-12T00:42:13.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.298+0000 7fcde98768c0 1 < completed multipart upload key=V80E1NH858IK upload=5RIXAHWO9FT1 tag=T5EBRZABZ0V1 type=write size=1777503 2024-09-12T00:42:13.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.302+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=P9IS7VLFKC7W type=del size=3542578 2024-09-12T00:42:13.301 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.306+0000 7fcde98768c0 1 < completed write operation key=Z1PY2MFUC1C4 tag=32Q7Y8V3IB9E type=write size=746209 2024-09-12T00:42:13.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.310+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~68506Z71R0FP.0 size=1048576 2024-09-12T00:42:13.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.310+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~68506Z71R0FP.1 size=1048576 2024-09-12T00:42:13.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.314+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~68506Z71R0FP.2 size=838453 2024-09-12T00:42:13.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.314+0000 7fcde98768c0 1 > prepared multipart upload key=97030NBF3MI4 upload=68506Z71R0FP tag=1JAVO2UW2WE0 type=write size=3984181 2024-09-12T00:42:13.311 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.314+0000 7fcde98768c0 1 < completed delete operation key=EDFNLQYP4L4L tag=8ISEX4GK2343 type=del 2024-09-12T00:42:13.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.318+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=CREFZ2EANJ8Q type=del size=1706906 2024-09-12T00:42:13.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.318+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~G3Z0VKF1D47P.0 size=491875 2024-09-12T00:42:13.319 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.322+0000 7fcde98768c0 1 < completed multipart upload key=5B8C6E8L5N52 upload=G3Z0VKF1D47P tag=KK8SMX47OFUH type=write size=1540451 2024-09-12T00:42:13.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.326+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=XYISO6PL12G6 type=del size=1730538 2024-09-12T00:42:13.324 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.326+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~0P9M1IBNVNT7.0 size=1048576 2024-09-12T00:42:13.324 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.326+0000 7fcde98768c0 1 < canceled part key=_multipart_IMITNCB1ST9E.2~0P9M1IBNVNT7.1 size=781785 2024-09-12T00:42:13.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.330+0000 7fcde98768c0 1 < canceled multipart upload key=IMITNCB1ST9E upload=0P9M1IBNVNT7 tag=6VV6FF0HEM3F type=write size=2878937 2024-09-12T00:42:13.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.334+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=MKXPPVKSVWFO type=del size=963290 2024-09-12T00:42:13.331 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.334+0000 7fcde98768c0 1 < completed delete operation key=NVOFV649MT0A tag=MW9VGMTLH5HI type=del 2024-09-12T00:42:13.335 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.338+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~TVLPF4C3Y0GP.0 size=1048576 2024-09-12T00:42:13.338 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.342+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~TVLPF4C3Y0GP.1 size=1048576 2024-09-12T00:42:13.339 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.342+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~TVLPF4C3Y0GP.2 size=338551 2024-09-12T00:42:13.339 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.342+0000 7fcde98768c0 1 > prepared multipart upload key=Z1PY2MFUC1C4 upload=TVLPF4C3Y0GP tag=RXIRRLA3X7AH type=write size=3484279 2024-09-12T00:42:13.342 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.346+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~N4N1VDEYHIGE.0 size=612032 2024-09-12T00:42:13.346 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.350+0000 7fcde98768c0 1 < completed multipart upload key=QD5JXFL962R5 upload=N4N1VDEYHIGE tag=NQMJV220HPU2 type=write size=1660608 2024-09-12T00:42:13.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.354+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=A30WXNO98J5K type=del size=80033 2024-09-12T00:42:13.351 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.354+0000 7fcde98768c0 1 < canceled operation key=BZ4YUNTMOJBK tag=IUBEYQCWSVOK type=del size=281481 2024-09-12T00:42:13.354 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.358+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=BB70H20CY1LM type=del size=3794820 2024-09-12T00:42:13.357 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.362+0000 7fcde98768c0 1 < completed delete operation key=NVOFV649MT0A tag=VBYI3CJYF9PB type=del 2024-09-12T00:42:13.364 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.366+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~DMTS1MJA7I1S.0 size=744274 2024-09-12T00:42:13.364 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.366+0000 7fcde98768c0 1 > prepared multipart upload key=ZQD0QXDN1J1I upload=DMTS1MJA7I1S tag=R4C19ROTPIA5 type=write size=1792850 2024-09-12T00:42:13.367 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.370+0000 7fcde98768c0 1 < canceled operation key=RC9A2Y5TCP9C tag=7CGZOHWYSMTH type=del size=4146681 2024-09-12T00:42:13.370 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.374+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=L0D0L9YBW91E type=del size=3038940 2024-09-12T00:42:13.373 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.378+0000 7fcde98768c0 1 < completed write operation key=WLE5QLNPAGZA tag=R8OGRJG1BZQ0 type=write size=538430 2024-09-12T00:42:13.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.382+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~OGNMHW1Z7UR3.0 size=784883 2024-09-12T00:42:13.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.382+0000 7fcde98768c0 1 > prepared multipart upload key=BQGIXJJWBAN0 upload=OGNMHW1Z7UR3 tag=CD0ZS5NXLFSD type=write size=1833459 2024-09-12T00:42:13.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.382+0000 7fcde98768c0 1 < completed delete operation key=368TXYQVK9C3 tag=D7YVIX9GNNY0 type=del 2024-09-12T00:42:13.386 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.390+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~E8QWZO0CMDII.0 size=105450 2024-09-12T00:42:13.386 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.390+0000 7fcde98768c0 1 > prepared multipart upload key=3QOENE572J7A upload=E8QWZO0CMDII tag=0AOTDBU968KQ type=write size=1154026 2024-09-12T00:42:13.389 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.394+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~LG7KU0PSXEZW.0 size=442914 2024-09-12T00:42:13.394 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.398+0000 7fcde98768c0 1 < completed multipart upload key=BZ4YUNTMOJBK upload=LG7KU0PSXEZW tag=1U2RJLX3TLB7 type=write size=1491490 2024-09-12T00:42:13.397 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.402+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=O8SXQ8SKPV6M type=del size=3190601 2024-09-12T00:42:13.399 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.402+0000 7fcde98768c0 1 < canceled operation key=C6PW0ETP4BG2 tag=0Z6U3DDNN1FK type=write size=678179 2024-09-12T00:42:13.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.406+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=7ELWCIZUDAV8 type=del size=2154255 2024-09-12T00:42:13.405 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.410+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~G33VF5K93PEY.0 size=1048576 2024-09-12T00:42:13.408 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.410+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~G33VF5K93PEY.1 size=39896 2024-09-12T00:42:13.413 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.418+0000 7fcde98768c0 1 < completed multipart upload key=FUJIUIR1E00J upload=G33VF5K93PEY tag=LW0KTPI4FKCM type=write size=2137048 2024-09-12T00:42:13.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.422+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~C73U44LQCKKE.0 size=1048576 2024-09-12T00:42:13.421 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.426+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~C73U44LQCKKE.1 size=137914 2024-09-12T00:42:13.421 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.426+0000 7fcde98768c0 1 > prepared multipart upload key=WLE5QLNPAGZA upload=C73U44LQCKKE tag=GYKHQV4AXQYE type=write size=2235066 2024-09-12T00:42:13.424 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.426+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~AXJR7DGF1B68.0 size=174336 2024-09-12T00:42:13.429 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.434+0000 7fcde98768c0 1 < completed multipart upload key=BZ4YUNTMOJBK upload=AXJR7DGF1B68 tag=K9D1F4NRIQ81 type=write size=1222912 2024-09-12T00:42:13.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.438+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~QHTFVJOSJH52.0 size=1048576 2024-09-12T00:42:13.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.438+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~QHTFVJOSJH52.1 size=1048576 2024-09-12T00:42:13.439 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.442+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~QHTFVJOSJH52.2 size=475478 2024-09-12T00:42:13.439 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.442+0000 7fcde98768c0 1 > prepared multipart upload key=WLE5QLNPAGZA upload=QHTFVJOSJH52 tag=N52OLV0US614 type=write size=3621206 2024-09-12T00:42:13.445 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.450+0000 7fcde98768c0 1 < suggested update operation key=7UR0FX8HA2A5 tag=P9IS7VLFKC7W type=del size=3542578 2024-09-12T00:42:13.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.450+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=2AGGY0GF0ANB type=del size=3526310 2024-09-12T00:42:13.451 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.454+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~68506Z71R0FP.0 size=1048576 2024-09-12T00:42:13.454 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.458+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~68506Z71R0FP.1 size=1048576 2024-09-12T00:42:13.457 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.458+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~68506Z71R0FP.2 size=838453 2024-09-12T00:42:13.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.466+0000 7fcde98768c0 1 < completed multipart upload key=97030NBF3MI4 upload=68506Z71R0FP tag=1JAVO2UW2WE0 type=write size=3984181 2024-09-12T00:42:13.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.470+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~7GRPGKKHF3AY.0 size=1048576 2024-09-12T00:42:13.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.474+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~7GRPGKKHF3AY.1 size=773116 2024-09-12T00:42:13.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.474+0000 7fcde98768c0 1 > prepared multipart upload key=97030NBF3MI4 upload=7GRPGKKHF3AY tag=6Q46LZU592HC type=write size=2870268 2024-09-12T00:42:13.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.478+0000 7fcde98768c0 1 < completed delete operation key=NVOFV649MT0A tag=CREFZ2EANJ8Q type=del 2024-09-12T00:42:13.476 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.478+0000 7fcde98768c0 1 > prepared operation key=KME8ZTTUGOXY tag=INENZ82DSP15 type=del size=3402716 2024-09-12T00:42:13.479 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.482+0000 7fcde98768c0 1 < completed delete operation key=EDFNLQYP4L4L tag=XYISO6PL12G6 type=del 2024-09-12T00:42:13.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.490+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~4AZO2ONYUN05.0 size=1048576 2024-09-12T00:42:13.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.490+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~4AZO2ONYUN05.1 size=649059 2024-09-12T00:42:13.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.490+0000 7fcde98768c0 1 > prepared multipart upload key=R2EBH0Q5885L upload=4AZO2ONYUN05 tag=VSQHEL0MWOE7 type=write size=2746211 2024-09-12T00:42:13.491 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.494+0000 7fcde98768c0 1 < completed delete operation key=F813QWV02TI0 tag=MKXPPVKSVWFO type=del 2024-09-12T00:42:13.497 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.502+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~8JIYSH0Q8ZC5.0 size=1048576 2024-09-12T00:42:13.499 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.502+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~8JIYSH0Q8ZC5.1 size=1048576 2024-09-12T00:42:13.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.506+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~8JIYSH0Q8ZC5.2 size=185940 2024-09-12T00:42:13.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.506+0000 7fcde98768c0 1 > prepared multipart upload key=97030NBF3MI4 upload=8JIYSH0Q8ZC5 tag=EWAAQD7X2GDS type=write size=3331668 2024-09-12T00:42:13.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.510+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~TVLPF4C3Y0GP.0 size=1048576 2024-09-12T00:42:13.507 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.510+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~TVLPF4C3Y0GP.1 size=1048576 2024-09-12T00:42:13.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.514+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~TVLPF4C3Y0GP.2 size=338551 2024-09-12T00:42:13.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.518+0000 7fcde98768c0 1 < completed multipart upload key=Z1PY2MFUC1C4 upload=TVLPF4C3Y0GP tag=RXIRRLA3X7AH type=write size=3484279 2024-09-12T00:42:13.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.522+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=RVLLJAJDLGLL type=del size=4181654 2024-09-12T00:42:13.520 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.522+0000 7fcde98768c0 1 < completed delete operation key=BZ4YUNTMOJBK tag=A30WXNO98J5K type=del 2024-09-12T00:42:13.524 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.530+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~2PC7FM1NMKTT.0 size=519305 2024-09-12T00:42:13.525 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.530+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=2PC7FM1NMKTT tag=CWVUHRZLLEOY type=write size=1567881 2024-09-12T00:42:13.528 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.530+0000 7fcde98768c0 1 < completed delete operation key=TUMAMUZUIR7E tag=BB70H20CY1LM type=del 2024-09-12T00:42:13.530 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.534+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=LDXFS58JV6CA type=del size=4033173 2024-09-12T00:42:13.533 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.538+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~DMTS1MJA7I1S.0 size=744274 2024-09-12T00:42:13.538 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.542+0000 7fcde98768c0 1 < completed multipart upload key=ZQD0QXDN1J1I upload=DMTS1MJA7I1S tag=R4C19ROTPIA5 type=write size=1792850 2024-09-12T00:42:13.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.546+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=BM3186NWPZKV type=del size=3412472 2024-09-12T00:42:13.544 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.546+0000 7fcde98768c0 1 < completed delete operation key=3QOENE572J7A tag=L0D0L9YBW91E type=del 2024-09-12T00:42:13.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.554+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~B3CZB0QCPWLX.0 size=1048576 2024-09-12T00:42:13.553 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.558+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~B3CZB0QCPWLX.1 size=1048576 2024-09-12T00:42:13.555 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.558+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~B3CZB0QCPWLX.2 size=35235 2024-09-12T00:42:13.555 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.558+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=B3CZB0QCPWLX tag=WNTX4P6CDWDO type=write size=3180963 2024-09-12T00:42:13.559 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.562+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~OGNMHW1Z7UR3.0 size=784883 2024-09-12T00:42:13.564 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.566+0000 7fcde98768c0 1 < completed multipart upload key=BQGIXJJWBAN0 upload=OGNMHW1Z7UR3 tag=CD0ZS5NXLFSD type=write size=1833459 2024-09-12T00:42:13.570 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.574+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~ENTYUDYMAFQI.0 size=1048576 2024-09-12T00:42:13.573 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.578+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~ENTYUDYMAFQI.1 size=1048576 2024-09-12T00:42:13.575 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.578+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~ENTYUDYMAFQI.2 size=476512 2024-09-12T00:42:13.575 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.578+0000 7fcde98768c0 1 > prepared multipart upload key=FUJIUIR1E00J upload=ENTYUDYMAFQI tag=7FTWJAGDFYUS type=write size=3622240 2024-09-12T00:42:13.578 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.582+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~E8QWZO0CMDII.0 size=105450 2024-09-12T00:42:13.583 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.586+0000 7fcde98768c0 1 < completed multipart upload key=3QOENE572J7A upload=E8QWZO0CMDII tag=0AOTDBU968KQ type=write size=1154026 2024-09-12T00:42:13.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.590+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=8HVS4JG06PIX type=write size=87354 2024-09-12T00:42:13.589 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.594+0000 7fcde98768c0 1 < completed delete operation key=G6R8BX1H7SPM tag=O8SXQ8SKPV6M type=del 2024-09-12T00:42:13.592 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.594+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=1LAG6AEJE0GL type=del size=2436588 2024-09-12T00:42:13.594 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.598+0000 7fcde98768c0 1 < completed delete operation key=C6PW0ETP4BG2 tag=7ELWCIZUDAV8 type=del 2024-09-12T00:42:13.597 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.602+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=T5EES3E94PWP type=del size=301711 2024-09-12T00:42:13.600 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.602+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~C73U44LQCKKE.0 size=1048576 2024-09-12T00:42:13.602 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.606+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~C73U44LQCKKE.1 size=137914 2024-09-12T00:42:13.607 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.610+0000 7fcde98768c0 1 < completed multipart upload key=WLE5QLNPAGZA upload=C73U44LQCKKE tag=GYKHQV4AXQYE type=write size=2235066 2024-09-12T00:42:13.612 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.614+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~7IZT1HDSRZYZ.0 size=1048576 2024-09-12T00:42:13.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.618+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~7IZT1HDSRZYZ.1 size=514383 2024-09-12T00:42:13.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.618+0000 7fcde98768c0 1 > prepared multipart upload key=4487IMSOLPDV upload=7IZT1HDSRZYZ tag=LLTM82BU540D type=write size=2611535 2024-09-12T00:42:13.618 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.622+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~QHTFVJOSJH52.0 size=1048576 2024-09-12T00:42:13.620 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.622+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~QHTFVJOSJH52.1 size=1048576 2024-09-12T00:42:13.622 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.626+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~QHTFVJOSJH52.2 size=475478 2024-09-12T00:42:13.628 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.630+0000 7fcde98768c0 1 < completed multipart upload key=WLE5QLNPAGZA upload=QHTFVJOSJH52 tag=N52OLV0US614 type=write size=3621206 2024-09-12T00:42:13.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.638+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~ZIYN4GCF5MPO.0 size=1048576 2024-09-12T00:42:13.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.642+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~ZIYN4GCF5MPO.1 size=565462 2024-09-12T00:42:13.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.642+0000 7fcde98768c0 1 > prepared multipart upload key=IMITNCB1ST9E upload=ZIYN4GCF5MPO tag=GC5V0PZRLPXL type=write size=2662614 2024-09-12T00:42:13.643 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.646+0000 7fcde98768c0 1 < completed delete operation key=NVOFV649MT0A tag=2AGGY0GF0ANB type=del 2024-09-12T00:42:13.646 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.650+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=S3Q73HNRFMAZ type=del size=1036858 2024-09-12T00:42:13.648 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.650+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~7GRPGKKHF3AY.0 size=1048576 2024-09-12T00:42:13.650 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.654+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~7GRPGKKHF3AY.1 size=773116 2024-09-12T00:42:13.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.658+0000 7fcde98768c0 1 < completed multipart upload key=97030NBF3MI4 upload=7GRPGKKHF3AY tag=6Q46LZU592HC type=write size=2870268 2024-09-12T00:42:13.660 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.662+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=NXTO1R9BX7M2 type=del size=131855 2024-09-12T00:42:13.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.666+0000 7fcde98768c0 1 < completed delete operation key=KME8ZTTUGOXY tag=INENZ82DSP15 type=del 2024-09-12T00:42:13.670 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.674+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~TL2T01QHVJUZ.0 size=1048576 2024-09-12T00:42:13.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.678+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~TL2T01QHVJUZ.1 size=784549 2024-09-12T00:42:13.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.678+0000 7fcde98768c0 1 > prepared multipart upload key=5B8C6E8L5N52 upload=TL2T01QHVJUZ tag=5WIDY3TDFMVV type=write size=2881701 2024-09-12T00:42:13.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.682+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~4AZO2ONYUN05.0 size=1048576 2024-09-12T00:42:13.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.686+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~4AZO2ONYUN05.1 size=649059 2024-09-12T00:42:13.686 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.690+0000 7fcde98768c0 1 < completed multipart upload key=R2EBH0Q5885L upload=4AZO2ONYUN05 tag=VSQHEL0MWOE7 type=write size=2746211 2024-09-12T00:42:13.688 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.690+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=CENN0GW3X1HT type=del size=3308428 2024-09-12T00:42:13.690 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.694+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~8JIYSH0Q8ZC5.0 size=1048576 2024-09-12T00:42:13.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.694+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~8JIYSH0Q8ZC5.1 size=1048576 2024-09-12T00:42:13.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.698+0000 7fcde98768c0 1 < canceled part key=_multipart_97030NBF3MI4.2~8JIYSH0Q8ZC5.2 size=185940 2024-09-12T00:42:13.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.698+0000 7fcde98768c0 1 < canceled multipart upload key=97030NBF3MI4 upload=8JIYSH0Q8ZC5 tag=EWAAQD7X2GDS type=write size=3331668 2024-09-12T00:42:13.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.706+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~U0E4XEWENQAR.0 size=146914 2024-09-12T00:42:13.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.706+0000 7fcde98768c0 1 > prepared multipart upload key=3X9I78PMR1HV upload=U0E4XEWENQAR tag=132TTOH7V5X0 type=write size=1195490 2024-09-12T00:42:13.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.706+0000 7fcde98768c0 1 < canceled operation key=G6R8BX1H7SPM tag=RVLLJAJDLGLL type=del size=4181654 2024-09-12T00:42:13.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.710+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=LJBRE9RCWQ8A type=del size=1534422 2024-09-12T00:42:13.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.714+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~2PC7FM1NMKTT.0 size=519305 2024-09-12T00:42:13.713 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.718+0000 7fcde98768c0 1 < completed multipart upload key=BZ4YUNTMOJBK upload=2PC7FM1NMKTT tag=CWVUHRZLLEOY type=write size=1567881 2024-09-12T00:42:13.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.718+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=7PIDBM447R7X type=del size=2805371 2024-09-12T00:42:13.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.722+0000 7fcde98768c0 1 < completed delete operation key=RC9A2Y5TCP9C tag=LDXFS58JV6CA type=del 2024-09-12T00:42:13.721 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.726+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=OBJ500SZ6C0O type=write size=744630 2024-09-12T00:42:13.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.726+0000 7fcde98768c0 1 < completed delete operation key=WLE5QLNPAGZA tag=BM3186NWPZKV type=del 2024-09-12T00:42:13.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.730+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=OM2MJ32QI8RI type=del size=2715451 2024-09-12T00:42:13.728 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.730+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~B3CZB0QCPWLX.0 size=1048576 2024-09-12T00:42:13.729 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.730+0000 7fcde98768c0 1 < canceled part key=_multipart_QD5JXFL962R5.2~B3CZB0QCPWLX.1 size=1048576 2024-09-12T00:42:13.730 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.734+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~B3CZB0QCPWLX.2 size=35235 2024-09-12T00:42:13.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.738+0000 7fcde98768c0 1 < canceled multipart upload key=QD5JXFL962R5 upload=B3CZB0QCPWLX tag=WNTX4P6CDWDO type=write size=3180963 2024-09-12T00:42:13.736 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.738+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=XUFXT4H0TIX0 type=write size=1036516 2024-09-12T00:42:13.738 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.742+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~ENTYUDYMAFQI.0 size=1048576 2024-09-12T00:42:13.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.742+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~ENTYUDYMAFQI.1 size=1048576 2024-09-12T00:42:13.742 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.746+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~ENTYUDYMAFQI.2 size=476512 2024-09-12T00:42:13.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.750+0000 7fcde98768c0 1 < completed multipart upload key=FUJIUIR1E00J upload=ENTYUDYMAFQI tag=7FTWJAGDFYUS type=write size=3622240 2024-09-12T00:42:13.750 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.754+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~VM3E0WC41LSY.0 size=1044982 2024-09-12T00:42:13.750 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.754+0000 7fcde98768c0 1 > prepared multipart upload key=3QOENE572J7A upload=VM3E0WC41LSY tag=3GZTUCF0MQ33 type=write size=2093558 2024-09-12T00:42:13.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.754+0000 7fcde98768c0 1 < completed write operation key=EDFNLQYP4L4L tag=8HVS4JG06PIX type=write size=87354 2024-09-12T00:42:13.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.758+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=JT9K5IN003XY type=write size=321877 2024-09-12T00:42:13.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.762+0000 7fcde98768c0 1 < suggested remove operation key=5B8C6E8L5N52 tag=1LAG6AEJE0GL type=del 2024-09-12T00:42:13.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.766+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=J3FFXKFIOOPP type=del size=2163833 2024-09-12T00:42:13.764 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.770+0000 7fcde98768c0 1 < completed delete operation key=HVE3YQTFZWTV tag=T5EES3E94PWP type=del 2024-09-12T00:42:13.767 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.770+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=1NV8079T3ORH type=del size=3098942 2024-09-12T00:42:13.770 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.774+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~7IZT1HDSRZYZ.0 size=1048576 2024-09-12T00:42:13.772 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.774+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~7IZT1HDSRZYZ.1 size=514383 2024-09-12T00:42:13.776 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.778+0000 7fcde98768c0 1 < completed multipart upload key=4487IMSOLPDV upload=7IZT1HDSRZYZ tag=LLTM82BU540D type=write size=2611535 2024-09-12T00:42:13.781 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.786+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~HDKLW49Y4Z0N.0 size=1048576 2024-09-12T00:42:13.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.786+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~HDKLW49Y4Z0N.1 size=1048576 2024-09-12T00:42:13.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.790+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~HDKLW49Y4Z0N.2 size=793495 2024-09-12T00:42:13.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.790+0000 7fcde98768c0 1 > prepared multipart upload key=JW2GNFAYFNEK upload=HDKLW49Y4Z0N tag=J1G4H214Z4OP type=write size=3939223 2024-09-12T00:42:13.786 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.790+0000 7fcde98768c0 1 < canceled part key=_multipart_IMITNCB1ST9E.2~ZIYN4GCF5MPO.0 size=1048576 2024-09-12T00:42:13.788 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.790+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~ZIYN4GCF5MPO.1 size=565462 2024-09-12T00:42:13.792 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.794+0000 7fcde98768c0 1 < canceled multipart upload key=IMITNCB1ST9E upload=ZIYN4GCF5MPO tag=GC5V0PZRLPXL type=write size=2662614 2024-09-12T00:42:13.795 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.798+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=T7T3XVGX2DZ2 type=write size=681976 2024-09-12T00:42:13.798 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.802+0000 7fcde98768c0 1 < completed delete operation key=NVOFV649MT0A tag=S3Q73HNRFMAZ type=del 2024-09-12T00:42:13.800 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.802+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=60QP8K2B13J0 type=write size=528087 2024-09-12T00:42:13.803 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.806+0000 7fcde98768c0 1 < completed delete operation key=7UR0FX8HA2A5 tag=NXTO1R9BX7M2 type=del 2024-09-12T00:42:13.808 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.810+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~QJR0BZZ7GQ9F.0 size=1048576 2024-09-12T00:42:13.810 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.814+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~QJR0BZZ7GQ9F.1 size=347933 2024-09-12T00:42:13.811 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.814+0000 7fcde98768c0 1 > prepared multipart upload key=97030NBF3MI4 upload=QJR0BZZ7GQ9F tag=ZPZE5J76FWGV type=write size=2445085 2024-09-12T00:42:13.813 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.818+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~TL2T01QHVJUZ.0 size=1048576 2024-09-12T00:42:13.816 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.818+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~TL2T01QHVJUZ.1 size=784549 2024-09-12T00:42:13.820 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.822+0000 7fcde98768c0 1 < completed multipart upload key=5B8C6E8L5N52 upload=TL2T01QHVJUZ tag=5WIDY3TDFMVV type=write size=2881701 2024-09-12T00:42:13.826 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.830+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~Z9VMV909JG5S.0 size=1048576 2024-09-12T00:42:13.828 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.830+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~Z9VMV909JG5S.1 size=576189 2024-09-12T00:42:13.828 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.830+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=Z9VMV909JG5S tag=21S5FLES128X type=write size=2673341 2024-09-12T00:42:13.831 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.834+0000 7fcde98768c0 1 < completed delete operation key=JW2GNFAYFNEK tag=CENN0GW3X1HT type=del 2024-09-12T00:42:13.835 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.838+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=WAOPGVH0PI2W type=del size=2928153 2024-09-12T00:42:13.837 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.842+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~U0E4XEWENQAR.0 size=146914 2024-09-12T00:42:13.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.846+0000 7fcde98768c0 1 < completed multipart upload key=3X9I78PMR1HV upload=U0E4XEWENQAR tag=132TTOH7V5X0 type=write size=1195490 2024-09-12T00:42:13.847 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.850+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~3109X67KU40T.0 size=1048576 2024-09-12T00:42:13.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.854+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~3109X67KU40T.1 size=1048576 2024-09-12T00:42:13.851 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.854+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~3109X67KU40T.2 size=683556 2024-09-12T00:42:13.851 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.854+0000 7fcde98768c0 1 > prepared multipart upload key=ZQD0QXDN1J1I upload=3109X67KU40T tag=LJMVUURYDE26 type=write size=3829284 2024-09-12T00:42:13.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.858+0000 7fcde98768c0 1 < completed delete operation key=HVE3YQTFZWTV tag=LJBRE9RCWQ8A type=del 2024-09-12T00:42:13.856 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.858+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=7QT903HV4WCO type=write size=528150 2024-09-12T00:42:13.861 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.866+0000 7fcde98768c0 1 < suggested remove operation key=5B8C6E8L5N52 tag=7PIDBM447R7X type=del 2024-09-12T00:42:13.866 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.870+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~NCKUOSB70GWC.0 size=1048576 2024-09-12T00:42:13.869 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.874+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~NCKUOSB70GWC.1 size=380027 2024-09-12T00:42:13.869 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.874+0000 7fcde98768c0 1 > prepared multipart upload key=F813QWV02TI0 upload=NCKUOSB70GWC tag=FZA6Z3U8YXD2 type=write size=2477179 2024-09-12T00:42:13.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.874+0000 7fcde98768c0 1 < completed write operation key=C6PW0ETP4BG2 tag=OBJ500SZ6C0O type=write size=744630 2024-09-12T00:42:13.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.878+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=Z0WN4A7T3Y54 type=del size=3079039 2024-09-12T00:42:13.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.882+0000 7fcde98768c0 -1 < failed to complete operation key=5B8C6E8L5N52 tag=OM2MJ32QI8RI type=del size=2715451: (22) Invalid argument 2024-09-12T00:42:13.882 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.886+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~UEE5QI0CQ4T3.0 size=1048576 2024-09-12T00:42:13.884 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.886+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~UEE5QI0CQ4T3.1 size=58484 2024-09-12T00:42:13.884 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.886+0000 7fcde98768c0 1 > prepared multipart upload key=R2EBH0Q5885L upload=UEE5QI0CQ4T3 tag=XHPE2PIGJHBF type=write size=2155636 2024-09-12T00:42:13.887 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.890+0000 7fcde98768c0 1 < completed write operation key=IMITNCB1ST9E tag=XUFXT4H0TIX0 type=write size=1036516 2024-09-12T00:42:13.892 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.894+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=9N7XBUBBEBRA type=del size=338198 2024-09-12T00:42:13.895 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.898+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~VM3E0WC41LSY.0 size=1044982 2024-09-12T00:42:13.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.902+0000 7fcde98768c0 1 < completed multipart upload key=3QOENE572J7A upload=VM3E0WC41LSY tag=3GZTUCF0MQ33 type=write size=2093558 2024-09-12T00:42:13.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.906+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=Y8JPDGOQC5DY type=del size=3342133 2024-09-12T00:42:13.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.910+0000 7fcde98768c0 1 < suggested update operation key=2T5IU2IUNGJX tag=JT9K5IN003XY type=write size=321877 2024-09-12T00:42:13.910 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.914+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=WK63NPLQCVE2 type=del size=240065 2024-09-12T00:42:13.912 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.914+0000 7fcde98768c0 -1 < failed to complete operation key=5B8C6E8L5N52 tag=J3FFXKFIOOPP type=del size=2163833: (22) Invalid argument 2024-09-12T00:42:13.914 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.918+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=Y36HFZ5B35TN type=del size=3201323 2024-09-12T00:42:13.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.922+0000 7fcde98768c0 1 < completed delete operation key=97030NBF3MI4 tag=1NV8079T3ORH type=del 2024-09-12T00:42:13.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.922+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=UCY1UF3RYDKV type=del size=3408982 2024-09-12T00:42:13.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.926+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~HDKLW49Y4Z0N.0 size=1048576 2024-09-12T00:42:13.924 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.926+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~HDKLW49Y4Z0N.1 size=1048576 2024-09-12T00:42:13.926 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.930+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~HDKLW49Y4Z0N.2 size=793495 2024-09-12T00:42:13.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.934+0000 7fcde98768c0 1 < completed multipart upload key=JW2GNFAYFNEK upload=HDKLW49Y4Z0N tag=J1G4H214Z4OP type=write size=3939223 2024-09-12T00:42:13.934 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.938+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=T3HNFWRLV36U type=del size=1781760 2024-09-12T00:42:13.937 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.942+0000 7fcde98768c0 1 < completed write operation key=NVOFV649MT0A tag=T7T3XVGX2DZ2 type=write size=681976 2024-09-12T00:42:13.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.942+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=3AMEQQ1WGKVZ type=del size=2900669 2024-09-12T00:42:13.944 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.946+0000 7fcde98768c0 1 < completed write operation key=Z4RNDW37GEK6 tag=60QP8K2B13J0 type=write size=528087 2024-09-12T00:42:13.948 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.950+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~BK5CYF7MN303.0 size=906115 2024-09-12T00:42:13.948 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.950+0000 7fcde98768c0 1 > prepared multipart upload key=IMITNCB1ST9E upload=BK5CYF7MN303 tag=7W8VJLAZQFYN type=write size=1954691 2024-09-12T00:42:13.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.954+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~QJR0BZZ7GQ9F.0 size=1048576 2024-09-12T00:42:13.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.958+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~QJR0BZZ7GQ9F.1 size=347933 2024-09-12T00:42:13.958 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.962+0000 7fcde98768c0 1 < completed multipart upload key=97030NBF3MI4 upload=QJR0BZZ7GQ9F tag=ZPZE5J76FWGV type=write size=2445085 2024-09-12T00:42:13.961 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.966+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=OAY11EF5TI3E type=del size=432509 2024-09-12T00:42:13.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.966+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~Z9VMV909JG5S.0 size=1048576 2024-09-12T00:42:13.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.970+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~Z9VMV909JG5S.1 size=576189 2024-09-12T00:42:13.972 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.974+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=Z9VMV909JG5S tag=21S5FLES128X type=write size=2673341 2024-09-12T00:42:13.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.978+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=RTN4S71WWZGB type=del size=1489611 2024-09-12T00:42:13.978 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.982+0000 7fcde98768c0 1 < completed delete operation key=4487IMSOLPDV tag=WAOPGVH0PI2W type=del 2024-09-12T00:42:13.981 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.986+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=IN2L0LEET23U type=del size=3493602 2024-09-12T00:42:13.984 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.986+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~3109X67KU40T.0 size=1048576 2024-09-12T00:42:13.986 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.990+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~3109X67KU40T.1 size=1048576 2024-09-12T00:42:13.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.990+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~3109X67KU40T.2 size=683556 2024-09-12T00:42:13.992 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:13.994+0000 7fcde98768c0 1 < completed multipart upload key=ZQD0QXDN1J1I upload=3109X67KU40T tag=LJMVUURYDE26 type=write size=3829284 2024-09-12T00:42:13.997 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.002+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~GY9A84EHP1DV.0 size=1048576 2024-09-12T00:42:13.999 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.002+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~GY9A84EHP1DV.1 size=1048576 2024-09-12T00:42:14.001 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.006+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~GY9A84EHP1DV.2 size=144360 2024-09-12T00:42:14.002 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.006+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=GY9A84EHP1DV tag=FM98QMIJIQ1T type=write size=3290088 2024-09-12T00:42:14.004 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.006+0000 7fcde98768c0 1 < completed write operation key=Z4RNDW37GEK6 tag=7QT903HV4WCO type=write size=528150 2024-09-12T00:42:14.007 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.010+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=XMCCF0AGLNLV type=del size=2691105 2024-09-12T00:42:14.009 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.014+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~NCKUOSB70GWC.0 size=1048576 2024-09-12T00:42:14.011 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.014+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~NCKUOSB70GWC.1 size=380027 2024-09-12T00:42:14.015 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.018+0000 7fcde98768c0 1 < completed multipart upload key=F813QWV02TI0 upload=NCKUOSB70GWC tag=FZA6Z3U8YXD2 type=write size=2477179 2024-09-12T00:42:14.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.022+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~H3Q1DD7G3JJ9.0 size=1048576 2024-09-12T00:42:14.021 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.026+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~H3Q1DD7G3JJ9.1 size=965065 2024-09-12T00:42:14.021 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.026+0000 7fcde98768c0 1 > prepared multipart upload key=97030NBF3MI4 upload=H3Q1DD7G3JJ9 tag=TNJRUGPT3OVJ type=write size=3062217 2024-09-12T00:42:14.023 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.026+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=Z0WN4A7T3Y54 type=del 2024-09-12T00:42:14.026 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.030+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=005XT60Q1WW4 type=del size=3454737 2024-09-12T00:42:14.028 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.030+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~UEE5QI0CQ4T3.0 size=1048576 2024-09-12T00:42:14.028 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.030+0000 7fcde98768c0 1 < canceled part key=_multipart_R2EBH0Q5885L.2~UEE5QI0CQ4T3.1 size=58484 2024-09-12T00:42:14.031 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.034+0000 7fcde98768c0 1 < canceled multipart upload key=R2EBH0Q5885L upload=UEE5QI0CQ4T3 tag=XHPE2PIGJHBF type=write size=2155636 2024-09-12T00:42:14.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.038+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=VBE49KA9BHCK type=del size=1485084 2024-09-12T00:42:14.038 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.042+0000 7fcde98768c0 1 < suggested remove operation key=JW2GNFAYFNEK tag=9N7XBUBBEBRA type=del 2024-09-12T00:42:14.043 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.046+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~89PUI4GE5584.0 size=186376 2024-09-12T00:42:14.043 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.046+0000 7fcde98768c0 1 > prepared multipart upload key=J9EUM073CZHF upload=89PUI4GE5584 tag=2X0CBE5DD3J6 type=write size=1234952 2024-09-12T00:42:14.045 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.050+0000 7fcde98768c0 1 < completed delete operation key=C6PW0ETP4BG2 tag=Y8JPDGOQC5DY type=del 2024-09-12T00:42:14.048 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.050+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=ETPMP2IT3SUB type=del size=1251082 2024-09-12T00:42:14.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.054+0000 7fcde98768c0 1 < completed delete operation key=G6R8BX1H7SPM tag=WK63NPLQCVE2 type=del 2024-09-12T00:42:14.053 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.058+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=6QJRVCPVD9KD type=del size=1144966 2024-09-12T00:42:14.055 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.058+0000 7fcde98768c0 1 < canceled operation key=WLE5QLNPAGZA tag=Y36HFZ5B35TN type=del size=3201323 2024-09-12T00:42:14.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.062+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~LDYYXJR84CSO.0 size=1048576 2024-09-12T00:42:14.061 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.066+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~LDYYXJR84CSO.1 size=573707 2024-09-12T00:42:14.062 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.066+0000 7fcde98768c0 1 > prepared multipart upload key=ZQD0QXDN1J1I upload=LDYYXJR84CSO tag=1VITCFBR2CKW type=write size=2670859 2024-09-12T00:42:14.064 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.066+0000 7fcde98768c0 1 < completed delete operation key=RC9A2Y5TCP9C tag=UCY1UF3RYDKV type=del 2024-09-12T00:42:14.068 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.070+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~YH95PG7IX3C1.0 size=1048576 2024-09-12T00:42:14.070 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.074+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~YH95PG7IX3C1.1 size=983463 2024-09-12T00:42:14.070 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.074+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=YH95PG7IX3C1 tag=POVHM6JX0V01 type=write size=3080615 2024-09-12T00:42:14.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.078+0000 7fcde98768c0 1 < suggested remove operation key=RC9A2Y5TCP9C tag=T3HNFWRLV36U type=del 2024-09-12T00:42:14.078 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.082+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=AA36GJKRLTHB type=del size=3882126 2024-09-12T00:42:14.080 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.086+0000 7fcde98768c0 1 < completed delete operation key=Z4RNDW37GEK6 tag=3AMEQQ1WGKVZ type=del 2024-09-12T00:42:14.083 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.086+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=00A6C81IGF1T type=write size=394400 2024-09-12T00:42:14.085 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.090+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~BK5CYF7MN303.0 size=906115 2024-09-12T00:42:14.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.094+0000 7fcde98768c0 1 < completed multipart upload key=IMITNCB1ST9E upload=BK5CYF7MN303 tag=7W8VJLAZQFYN type=write size=1954691 2024-09-12T00:42:14.094 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.098+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~O5IKYE9L078G.0 size=984885 2024-09-12T00:42:14.094 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.098+0000 7fcde98768c0 1 > prepared multipart upload key=NVOFV649MT0A upload=O5IKYE9L078G tag=BFMO8N0AB72C type=write size=2033461 2024-09-12T00:42:14.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.102+0000 7fcde98768c0 1 < completed delete operation key=5YBVLUYJW40U tag=OAY11EF5TI3E type=del 2024-09-12T00:42:14.099 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.102+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=04VOFRY18V6U type=write size=221761 2024-09-12T00:42:14.102 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.106+0000 7fcde98768c0 -1 < failed to complete operation key=RC9A2Y5TCP9C tag=RTN4S71WWZGB type=del size=1489611: (22) Invalid argument 2024-09-12T00:42:14.104 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.106+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=6MUO809G7626 type=del size=2784228 2024-09-12T00:42:14.107 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.110+0000 7fcde98768c0 1 < completed delete operation key=R2EBH0Q5885L tag=IN2L0LEET23U type=del 2024-09-12T00:42:14.111 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.114+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~Z11JRS7TR9UW.0 size=1048576 2024-09-12T00:42:14.113 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.118+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~Z11JRS7TR9UW.1 size=1041812 2024-09-12T00:42:14.113 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.118+0000 7fcde98768c0 1 > prepared multipart upload key=JW2GNFAYFNEK upload=Z11JRS7TR9UW tag=NXVIOK2TET4T type=write size=3138964 2024-09-12T00:42:14.116 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.118+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~GY9A84EHP1DV.0 size=1048576 2024-09-12T00:42:14.117 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.122+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~GY9A84EHP1DV.1 size=1048576 2024-09-12T00:42:14.119 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.122+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~GY9A84EHP1DV.2 size=144360 2024-09-12T00:42:14.123 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.126+0000 7fcde98768c0 1 < completed multipart upload key=IV4JCE1QJC70 upload=GY9A84EHP1DV tag=FM98QMIJIQ1T type=write size=3290088 2024-09-12T00:42:14.127 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.130+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~0PZKFTQXNA6B.0 size=748292 2024-09-12T00:42:14.128 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.130+0000 7fcde98768c0 1 > prepared multipart upload key=7UR0FX8HA2A5 upload=0PZKFTQXNA6B tag=8X49RLF1MMRQ type=write size=1796868 2024-09-12T00:42:14.134 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.138+0000 7fcde98768c0 1 < suggested update operation key=NVOFV649MT0A tag=XMCCF0AGLNLV type=del size=2691105 2024-09-12T00:42:14.139 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.142+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~C5RW2VO9QK1C.0 size=1048576 2024-09-12T00:42:14.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.146+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~C5RW2VO9QK1C.1 size=155968 2024-09-12T00:42:14.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.146+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=C5RW2VO9QK1C tag=I1T0UYZ10G0S type=write size=2253120 2024-09-12T00:42:14.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.146+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~H3Q1DD7G3JJ9.0 size=1048576 2024-09-12T00:42:14.145 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.150+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~H3Q1DD7G3JJ9.1 size=965065 2024-09-12T00:42:14.149 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.154+0000 7fcde98768c0 1 < completed multipart upload key=97030NBF3MI4 upload=H3Q1DD7G3JJ9 tag=TNJRUGPT3OVJ type=write size=3062217 2024-09-12T00:42:14.151 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.154+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=HVQYVTVV91BP type=del size=1502027 2024-09-12T00:42:14.154 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.158+0000 7fcde98768c0 1 < canceled operation key=EDFNLQYP4L4L tag=005XT60Q1WW4 type=del size=3454737 2024-09-12T00:42:14.156 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.158+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=I9YGI7VDX3G2 type=del size=1991941 2024-09-12T00:42:14.159 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.162+0000 7fcde98768c0 1 < completed delete operation key=5YBVLUYJW40U tag=VBE49KA9BHCK type=del 2024-09-12T00:42:14.161 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.166+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=GSADVBCW7CNB type=del size=2476005 2024-09-12T00:42:14.163 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.166+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~89PUI4GE5584.0 size=186376 2024-09-12T00:42:14.167 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.170+0000 7fcde98768c0 1 < completed multipart upload key=J9EUM073CZHF upload=89PUI4GE5584 tag=2X0CBE5DD3J6 type=write size=1234952 2024-09-12T00:42:14.169 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.174+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=HG8BUZODRZ23 type=del size=1891537 2024-09-12T00:42:14.171 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.174+0000 7fcde98768c0 1 < completed delete operation key=R2EBH0Q5885L tag=ETPMP2IT3SUB type=del 2024-09-12T00:42:14.174 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.178+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=EZZJ7DV7U5LP type=del size=3927297 2024-09-12T00:42:14.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.178+0000 7fcde98768c0 1 < completed delete operation key=WLE5QLNPAGZA tag=6QJRVCPVD9KD type=del 2024-09-12T00:42:14.178 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.182+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=XMWJTUGXWB71 type=write size=20741 2024-09-12T00:42:14.181 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.186+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~LDYYXJR84CSO.0 size=1048576 2024-09-12T00:42:14.183 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.186+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~LDYYXJR84CSO.1 size=573707 2024-09-12T00:42:14.187 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.190+0000 7fcde98768c0 1 < completed multipart upload key=ZQD0QXDN1J1I upload=LDYYXJR84CSO tag=1VITCFBR2CKW type=write size=2670859 2024-09-12T00:42:14.192 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.194+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~CELBSWDX0BXI.0 size=1048576 2024-09-12T00:42:14.194 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.198+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~CELBSWDX0BXI.1 size=514523 2024-09-12T00:42:14.194 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.198+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=CELBSWDX0BXI tag=1JDK7VZXVYHF type=write size=2611675 2024-09-12T00:42:14.197 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.202+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~YH95PG7IX3C1.0 size=1048576 2024-09-12T00:42:14.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.202+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~YH95PG7IX3C1.1 size=983463 2024-09-12T00:42:14.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.206+0000 7fcde98768c0 1 < completed multipart upload key=IV4JCE1QJC70 upload=YH95PG7IX3C1 tag=POVHM6JX0V01 type=write size=3080615 2024-09-12T00:42:14.207 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.210+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~46YJ3HEWO3JX.0 size=927452 2024-09-12T00:42:14.208 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.210+0000 7fcde98768c0 1 > prepared multipart upload key=F813QWV02TI0 upload=46YJ3HEWO3JX tag=AQMHZSTQ9ANW type=write size=1976028 2024-09-12T00:42:14.210 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.214+0000 7fcde98768c0 1 < completed delete operation key=4487IMSOLPDV tag=AA36GJKRLTHB type=del 2024-09-12T00:42:14.212 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.214+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=FFRLXSDIE1MY type=del size=4061058 2024-09-12T00:42:14.216 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.222+0000 7fcde98768c0 1 < suggested remove operation key=5YBVLUYJW40U tag=00A6C81IGF1T type=write 2024-09-12T00:42:14.219 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.222+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=66OD7698KMI5 type=del size=2754178 2024-09-12T00:42:14.221 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.226+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~O5IKYE9L078G.0 size=984885 2024-09-12T00:42:14.225 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.230+0000 7fcde98768c0 1 < completed multipart upload key=NVOFV649MT0A upload=O5IKYE9L078G tag=BFMO8N0AB72C type=write size=2033461 2024-09-12T00:42:14.227 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.230+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=JUU440VJBV35 type=del size=881968 2024-09-12T00:42:14.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.234+0000 7fcde98768c0 1 < suggested remove operation key=WLE5QLNPAGZA tag=04VOFRY18V6U type=write 2024-09-12T00:42:14.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.238+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~Z79NJ34IZBR1.0 size=1048576 2024-09-12T00:42:14.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.242+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~Z79NJ34IZBR1.1 size=655642 2024-09-12T00:42:14.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.242+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=Z79NJ34IZBR1 tag=AFZ6L46D9YO8 type=write size=2752794 2024-09-12T00:42:14.241 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.246+0000 7fcde98768c0 1 < suggested update operation key=FUJIUIR1E00J tag=6MUO809G7626 type=del size=2784228 2024-09-12T00:42:14.245 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.250+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~D6A6QFTS7GHO.0 size=285985 2024-09-12T00:42:14.245 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.250+0000 7fcde98768c0 1 > prepared multipart upload key=J9EUM073CZHF upload=D6A6QFTS7GHO tag=VZIPO0DUH5ZA type=write size=1334561 2024-09-12T00:42:14.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.250+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~Z11JRS7TR9UW.0 size=1048576 2024-09-12T00:42:14.249 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.254+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~Z11JRS7TR9UW.1 size=1041812 2024-09-12T00:42:14.252 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.254+0000 7fcde98768c0 1 < completed multipart upload key=JW2GNFAYFNEK upload=Z11JRS7TR9UW tag=NXVIOK2TET4T type=write size=3138964 2024-09-12T00:42:14.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.258+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=3GMPXFZ2IL07 type=del size=10206 2024-09-12T00:42:14.257 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.262+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~0PZKFTQXNA6B.0 size=748292 2024-09-12T00:42:14.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.262+0000 7fcde98768c0 1 < completed multipart upload key=7UR0FX8HA2A5 upload=0PZKFTQXNA6B tag=8X49RLF1MMRQ type=write size=1796868 2024-09-12T00:42:14.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.266+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=4LII8HN9KFZD type=del size=3043022 2024-09-12T00:42:14.264 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.270+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~C5RW2VO9QK1C.0 size=1048576 2024-09-12T00:42:14.266 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.270+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~C5RW2VO9QK1C.1 size=155968 2024-09-12T00:42:14.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.274+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=C5RW2VO9QK1C tag=I1T0UYZ10G0S type=write size=2253120 2024-09-12T00:42:14.272 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.274+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=F3IKIOAPSDMI type=del size=824652 2024-09-12T00:42:14.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.278+0000 7fcde98768c0 1 < canceled operation key=QD5JXFL962R5 tag=HVQYVTVV91BP type=del size=1502027 2024-09-12T00:42:14.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.282+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=TWOQVYLP07I6 type=del size=42133 2024-09-12T00:42:14.279 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.282+0000 7fcde98768c0 1 < completed delete operation key=97030NBF3MI4 tag=I9YGI7VDX3G2 type=del 2024-09-12T00:42:14.281 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.286+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=FJ3F11ZU0BTX type=del size=2307149 2024-09-12T00:42:14.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.286+0000 7fcde98768c0 1 < completed delete operation key=Z4RNDW37GEK6 tag=GSADVBCW7CNB type=del 2024-09-12T00:42:14.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.290+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=ITDOX5YO1FVT type=del size=3993221 2024-09-12T00:42:14.288 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.290+0000 7fcde98768c0 1 < completed delete operation key=4487IMSOLPDV tag=HG8BUZODRZ23 type=del 2024-09-12T00:42:14.292 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.294+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~QCWBHI9O3FWN.0 size=1048576 2024-09-12T00:42:14.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.298+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~QCWBHI9O3FWN.1 size=1048576 2024-09-12T00:42:14.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.298+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~QCWBHI9O3FWN.2 size=203791 2024-09-12T00:42:14.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.298+0000 7fcde98768c0 1 > prepared multipart upload key=NVOFV649MT0A upload=QCWBHI9O3FWN tag=50X1A4JZLLLC type=write size=3349519 2024-09-12T00:42:14.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.302+0000 7fcde98768c0 -1 < failed to complete operation key=5YBVLUYJW40U tag=EZZJ7DV7U5LP type=del size=3927297: (22) Invalid argument 2024-09-12T00:42:14.300 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.302+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=S6D1RXFIVOUO type=del size=293775 2024-09-12T00:42:14.302 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.306+0000 7fcde98768c0 1 < completed write operation key=IV4JCE1QJC70 tag=XMWJTUGXWB71 type=write size=20741 2024-09-12T00:42:14.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.306+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=1VHF8P5RQ1LL type=del size=1183428 2024-09-12T00:42:14.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.310+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~CELBSWDX0BXI.0 size=1048576 2024-09-12T00:42:14.308 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.310+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~CELBSWDX0BXI.1 size=514523 2024-09-12T00:42:14.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.314+0000 7fcde98768c0 1 < completed multipart upload key=IV4JCE1QJC70 upload=CELBSWDX0BXI tag=1JDK7VZXVYHF type=write size=2611675 2024-09-12T00:42:14.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.322+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~TRP14TH8K0I6.0 size=1048576 2024-09-12T00:42:14.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.322+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~TRP14TH8K0I6.1 size=1048576 2024-09-12T00:42:14.320 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.322+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~TRP14TH8K0I6.2 size=699706 2024-09-12T00:42:14.320 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.322+0000 7fcde98768c0 1 > prepared multipart upload key=Z1PY2MFUC1C4 upload=TRP14TH8K0I6 tag=SGT9FU3UHW5V type=write size=3845434 2024-09-12T00:42:14.322 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.326+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~46YJ3HEWO3JX.0 size=927452 2024-09-12T00:42:14.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.330+0000 7fcde98768c0 1 < completed multipart upload key=F813QWV02TI0 upload=46YJ3HEWO3JX tag=AQMHZSTQ9ANW type=write size=1976028 2024-09-12T00:42:14.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.334+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=8LTHIC5V6B9Q type=del size=3165918 2024-09-12T00:42:14.331 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.334+0000 7fcde98768c0 1 < completed delete operation key=Z1PY2MFUC1C4 tag=FFRLXSDIE1MY type=del 2024-09-12T00:42:14.334 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.338+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=AOVS1VWY6RNN type=del size=696642 2024-09-12T00:42:14.336 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.338+0000 7fcde98768c0 1 < canceled operation key=C6PW0ETP4BG2 tag=66OD7698KMI5 type=del size=2754178 2024-09-12T00:42:14.338 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.342+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=CZRWW9Q0GHU6 type=del size=972339 2024-09-12T00:42:14.341 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.346+0000 7fcde98768c0 1 < completed delete operation key=5B8C6E8L5N52 tag=JUU440VJBV35 type=del 2024-09-12T00:42:14.343 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.346+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=IIQVT80IQPL3 type=del size=2149846 2024-09-12T00:42:14.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.350+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~Z79NJ34IZBR1.0 size=1048576 2024-09-12T00:42:14.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.350+0000 7fcde98768c0 1 < canceled part key=_multipart_V80E1NH858IK.2~Z79NJ34IZBR1.1 size=655642 2024-09-12T00:42:14.351 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.354+0000 7fcde98768c0 1 < canceled multipart upload key=V80E1NH858IK upload=Z79NJ34IZBR1 tag=AFZ6L46D9YO8 type=write size=2752794 2024-09-12T00:42:14.353 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.358+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=7LWNAK4MS9G9 type=del size=3781404 2024-09-12T00:42:14.355 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.358+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~D6A6QFTS7GHO.0 size=285985 2024-09-12T00:42:14.359 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.362+0000 7fcde98768c0 1 < completed multipart upload key=J9EUM073CZHF upload=D6A6QFTS7GHO tag=VZIPO0DUH5ZA type=write size=1334561 2024-09-12T00:42:14.363 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.366+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~3QPBT6PRNB9D.0 size=832805 2024-09-12T00:42:14.363 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.366+0000 7fcde98768c0 1 > prepared multipart upload key=R2EBH0Q5885L upload=3QPBT6PRNB9D tag=EWXAZ6LLNDXH type=write size=1881381 2024-09-12T00:42:14.368 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.370+0000 7fcde98768c0 1 < suggested update operation key=BZ4YUNTMOJBK tag=3GMPXFZ2IL07 type=del size=10206 2024-09-12T00:42:14.370 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.374+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=KP858LXSPWI9 type=del size=3974069 2024-09-12T00:42:14.372 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.374+0000 7fcde98768c0 1 < completed delete operation key=HVE3YQTFZWTV tag=4LII8HN9KFZD type=del 2024-09-12T00:42:14.375 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.378+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=NIJVWPSB7FC1 type=del size=2437216 2024-09-12T00:42:14.377 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.382+0000 7fcde98768c0 1 < canceled operation key=Z4RNDW37GEK6 tag=F3IKIOAPSDMI type=del size=824652 2024-09-12T00:42:14.379 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.382+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=BJ32GV0EVC4A type=write size=207269 2024-09-12T00:42:14.382 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.386+0000 7fcde98768c0 1 < completed delete operation key=Z4RNDW37GEK6 tag=TWOQVYLP07I6 type=del 2024-09-12T00:42:14.384 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.386+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=ML2J2079NR1B type=del size=2899405 2024-09-12T00:42:14.387 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.390+0000 7fcde98768c0 1 < completed delete operation key=4487IMSOLPDV tag=FJ3F11ZU0BTX type=del 2024-09-12T00:42:14.389 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.394+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=1ZSG7VQ20H54 type=del size=3660634 2024-09-12T00:42:14.391 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.394+0000 7fcde98768c0 1 < completed delete operation key=NVOFV649MT0A tag=ITDOX5YO1FVT type=del 2024-09-12T00:42:14.393 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.398+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=FJXTWHJRC9HB type=del size=3243156 2024-09-12T00:42:14.395 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.398+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~QCWBHI9O3FWN.0 size=1048576 2024-09-12T00:42:14.397 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.402+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~QCWBHI9O3FWN.1 size=1048576 2024-09-12T00:42:14.399 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.402+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~QCWBHI9O3FWN.2 size=203791 2024-09-12T00:42:14.402 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.406+0000 7fcde98768c0 1 < completed multipart upload key=NVOFV649MT0A upload=QCWBHI9O3FWN tag=50X1A4JZLLLC type=write size=3349519 2024-09-12T00:42:14.407 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.410+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~H4LP0NN3TK3F.0 size=1048576 2024-09-12T00:42:14.408 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.410+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~H4LP0NN3TK3F.1 size=147973 2024-09-12T00:42:14.408 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.410+0000 7fcde98768c0 1 > prepared multipart upload key=7UR0FX8HA2A5 upload=H4LP0NN3TK3F tag=0GY9WP67GAG9 type=write size=2245125 2024-09-12T00:42:14.410 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.414+0000 7fcde98768c0 -1 < failed to complete operation key=BZ4YUNTMOJBK tag=S6D1RXFIVOUO type=del size=293775: (22) Invalid argument 2024-09-12T00:42:14.413 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.418+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=E4RRGKVWBWAP type=write size=822129 2024-09-12T00:42:14.416 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.418+0000 7fcde98768c0 1 < completed delete operation key=Z1PY2MFUC1C4 tag=1VHF8P5RQ1LL type=del 2024-09-12T00:42:14.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.422+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~9FUPVYDT7L5I.0 size=990649 2024-09-12T00:42:14.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.422+0000 7fcde98768c0 1 > prepared multipart upload key=3X9I78PMR1HV upload=9FUPVYDT7L5I tag=5Y2MFD267473 type=write size=2039225 2024-09-12T00:42:14.422 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.426+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~TRP14TH8K0I6.0 size=1048576 2024-09-12T00:42:14.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.426+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~TRP14TH8K0I6.1 size=1048576 2024-09-12T00:42:14.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.430+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~TRP14TH8K0I6.2 size=699706 2024-09-12T00:42:14.430 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.434+0000 7fcde98768c0 1 < completed multipart upload key=Z1PY2MFUC1C4 upload=TRP14TH8K0I6 tag=SGT9FU3UHW5V type=write size=3845434 2024-09-12T00:42:14.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.438+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~JRAR1IQWP2PC.0 size=382708 2024-09-12T00:42:14.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.438+0000 7fcde98768c0 1 > prepared multipart upload key=2T5IU2IUNGJX upload=JRAR1IQWP2PC tag=FHEOGIMK2YJE type=write size=1431284 2024-09-12T00:42:14.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.438+0000 7fcde98768c0 1 < canceled operation key=ZQD0QXDN1J1I tag=8LTHIC5V6B9Q type=del size=3165918 2024-09-12T00:42:14.438 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.442+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=88P54C83UU0S type=del size=1152830 2024-09-12T00:42:14.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.446+0000 7fcde98768c0 1 < completed delete operation key=HVE3YQTFZWTV tag=AOVS1VWY6RNN type=del 2024-09-12T00:42:14.443 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.446+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=E2NYG410HF1J type=del size=1206862 2024-09-12T00:42:14.445 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.450+0000 7fcde98768c0 1 < completed delete operation key=HVE3YQTFZWTV tag=CZRWW9Q0GHU6 type=del 2024-09-12T00:42:14.449 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.454+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~UU0FDG2E2071.0 size=1048576 2024-09-12T00:42:14.451 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.454+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~UU0FDG2E2071.1 size=1048576 2024-09-12T00:42:14.453 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.458+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~UU0FDG2E2071.2 size=882513 2024-09-12T00:42:14.453 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.458+0000 7fcde98768c0 1 > prepared multipart upload key=ZQD0QXDN1J1I upload=UU0FDG2E2071 tag=NXNNX1MY9O7E type=write size=4028241 2024-09-12T00:42:14.455 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.458+0000 7fcde98768c0 1 < canceled operation key=G6R8BX1H7SPM tag=IIQVT80IQPL3 type=del size=2149846 2024-09-12T00:42:14.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.462+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~BSBISWPREYWX.0 size=48023 2024-09-12T00:42:14.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.462+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=BSBISWPREYWX tag=0QESO3H526AG type=write size=1096599 2024-09-12T00:42:14.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.466+0000 7fcde98768c0 1 < completed delete operation key=G6R8BX1H7SPM tag=7LWNAK4MS9G9 type=del 2024-09-12T00:42:14.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.470+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~CZMTHHP9RQBB.0 size=365980 2024-09-12T00:42:14.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.470+0000 7fcde98768c0 1 > prepared multipart upload key=Z1PY2MFUC1C4 upload=CZMTHHP9RQBB tag=Z0QNR98TQSXQ type=write size=1414556 2024-09-12T00:42:14.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.474+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~3QPBT6PRNB9D.0 size=832805 2024-09-12T00:42:14.473 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.478+0000 7fcde98768c0 1 < completed multipart upload key=R2EBH0Q5885L upload=3QPBT6PRNB9D tag=EWXAZ6LLNDXH type=write size=1881381 2024-09-12T00:42:14.476 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.478+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=C03ZZIVW4OB0 type=del size=1765166 2024-09-12T00:42:14.478 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.482+0000 7fcde98768c0 1 < completed delete operation key=TUMAMUZUIR7E tag=KP858LXSPWI9 type=del 2024-09-12T00:42:14.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.486+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~KODLW91HEWWO.0 size=1048576 2024-09-12T00:42:14.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.490+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~KODLW91HEWWO.1 size=688062 2024-09-12T00:42:14.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.490+0000 7fcde98768c0 1 > prepared multipart upload key=97030NBF3MI4 upload=KODLW91HEWWO tag=HM3ORV5R2WWO type=write size=2785214 2024-09-12T00:42:14.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.490+0000 7fcde98768c0 1 < completed delete operation key=G6R8BX1H7SPM tag=NIJVWPSB7FC1 type=del 2024-09-12T00:42:14.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.494+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=78HP7BYSBLIW type=write size=752752 2024-09-12T00:42:14.492 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.494+0000 7fcde98768c0 1 < completed write operation key=FUJIUIR1E00J tag=BJ32GV0EVC4A type=write size=207269 2024-09-12T00:42:14.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.498+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=6HWD58U62T2Y type=del size=2157963 2024-09-12T00:42:14.499 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.502+0000 7fcde98768c0 1 < suggested remove operation key=368TXYQVK9C3 tag=ML2J2079NR1B type=del 2024-09-12T00:42:14.501 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.506+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=8T8BX92KOSZ0 type=del size=1157965 2024-09-12T00:42:14.504 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.506+0000 7fcde98768c0 1 < canceled operation key=C6PW0ETP4BG2 tag=1ZSG7VQ20H54 type=del size=3660634 2024-09-12T00:42:14.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.510+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=WD0AFR9I5OBE type=write size=447263 2024-09-12T00:42:14.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.514+0000 7fcde98768c0 1 < completed delete operation key=WLE5QLNPAGZA tag=FJXTWHJRC9HB type=del 2024-09-12T00:42:14.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.514+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=UGZ72CL8LRRR type=del size=1865186 2024-09-12T00:42:14.513 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.518+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~H4LP0NN3TK3F.0 size=1048576 2024-09-12T00:42:14.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.518+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~H4LP0NN3TK3F.1 size=147973 2024-09-12T00:42:14.519 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.522+0000 7fcde98768c0 1 < completed multipart upload key=7UR0FX8HA2A5 upload=H4LP0NN3TK3F tag=0GY9WP67GAG9 type=write size=2245125 2024-09-12T00:42:14.521 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.526+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=WXZJ47KLQFAV type=write size=940677 2024-09-12T00:42:14.523 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.526+0000 7fcde98768c0 -1 < failed to complete operation key=368TXYQVK9C3 tag=E4RRGKVWBWAP type=write size=822129: (22) Invalid argument 2024-09-12T00:42:14.526 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.530+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=JOBXNGD3P85K type=del size=2798709 2024-09-12T00:42:14.528 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.530+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~9FUPVYDT7L5I.0 size=990649 2024-09-12T00:42:14.532 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.534+0000 7fcde98768c0 1 < completed multipart upload key=3X9I78PMR1HV upload=9FUPVYDT7L5I tag=5Y2MFD267473 type=write size=2039225 2024-09-12T00:42:14.534 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.538+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=B6ZAHWHYQ04E type=del size=3668309 2024-09-12T00:42:14.537 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.542+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~JRAR1IQWP2PC.0 size=382708 2024-09-12T00:42:14.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.546+0000 7fcde98768c0 1 < completed multipart upload key=2T5IU2IUNGJX upload=JRAR1IQWP2PC tag=FHEOGIMK2YJE type=write size=1431284 2024-09-12T00:42:14.543 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.546+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=L9VLC4UU3O0W type=write size=921915 2024-09-12T00:42:14.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.550+0000 7fcde98768c0 1 < completed delete operation key=EDFNLQYP4L4L tag=88P54C83UU0S type=del 2024-09-12T00:42:14.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.550+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=4KY0ROT40DUS type=del size=2874272 2024-09-12T00:42:14.552 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.554+0000 7fcde98768c0 1 < completed delete operation key=QD5JXFL962R5 tag=E2NYG410HF1J type=del 2024-09-12T00:42:14.556 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.558+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~SC1DG5KL5O0Q.0 size=597538 2024-09-12T00:42:14.556 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.558+0000 7fcde98768c0 1 > prepared multipart upload key=WLE5QLNPAGZA upload=SC1DG5KL5O0Q tag=H5O5NDSWITUB type=write size=1646114 2024-09-12T00:42:14.559 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.562+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~UU0FDG2E2071.0 size=1048576 2024-09-12T00:42:14.561 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.566+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~UU0FDG2E2071.1 size=1048576 2024-09-12T00:42:14.563 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.566+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~UU0FDG2E2071.2 size=882513 2024-09-12T00:42:14.570 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.574+0000 7fcde98768c0 1 < completed multipart upload key=ZQD0QXDN1J1I upload=UU0FDG2E2071 tag=NXNNX1MY9O7E type=write size=4028241 2024-09-12T00:42:14.574 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.578+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~2UB5HP4CFAP8.0 size=1048576 2024-09-12T00:42:14.576 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.578+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~2UB5HP4CFAP8.1 size=1048576 2024-09-12T00:42:14.578 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.582+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~2UB5HP4CFAP8.2 size=475347 2024-09-12T00:42:14.578 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.582+0000 7fcde98768c0 1 > prepared multipart upload key=2T5IU2IUNGJX upload=2UB5HP4CFAP8 tag=T4L1429HDPPQ type=write size=3621075 2024-09-12T00:42:14.581 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.586+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~BSBISWPREYWX.0 size=48023 2024-09-12T00:42:14.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.590+0000 7fcde98768c0 1 < completed multipart upload key=QD5JXFL962R5 upload=BSBISWPREYWX tag=0QESO3H526AG type=write size=1096599 2024-09-12T00:42:14.588 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.590+0000 7fcde98768c0 1 > prepared operation key=KME8ZTTUGOXY tag=03UJ1T2IZQ1Y type=write size=766331 2024-09-12T00:42:14.591 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.594+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~CZMTHHP9RQBB.0 size=365980 2024-09-12T00:42:14.595 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.598+0000 7fcde98768c0 1 < completed multipart upload key=Z1PY2MFUC1C4 upload=CZMTHHP9RQBB tag=Z0QNR98TQSXQ type=write size=1414556 2024-09-12T00:42:14.598 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.602+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=XCZDYJ1CWGFY type=del size=1409803 2024-09-12T00:42:14.603 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.606+0000 7fcde98768c0 1 < suggested update operation key=JW2GNFAYFNEK tag=C03ZZIVW4OB0 type=del size=1765166 2024-09-12T00:42:14.606 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.610+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=OEYB67PC5IJ8 type=del size=1901772 2024-09-12T00:42:14.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.614+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~KODLW91HEWWO.0 size=1048576 2024-09-12T00:42:14.611 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.614+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~KODLW91HEWWO.1 size=688062 2024-09-12T00:42:14.616 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.618+0000 7fcde98768c0 1 < completed multipart upload key=97030NBF3MI4 upload=KODLW91HEWWO tag=HM3ORV5R2WWO type=write size=2785214 2024-09-12T00:42:14.619 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.622+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=KSDYLR51IYE2 type=del size=1327871 2024-09-12T00:42:14.622 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.626+0000 7fcde98768c0 1 < completed write operation key=BQGIXJJWBAN0 tag=78HP7BYSBLIW type=write size=752752 2024-09-12T00:42:14.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.630+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=ZJHSEE62NWXL type=del size=2133245 2024-09-12T00:42:14.628 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.630+0000 7fcde98768c0 1 < completed delete operation key=3QOENE572J7A tag=6HWD58U62T2Y type=del 2024-09-12T00:42:14.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.634+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=IS3444384I88 type=del size=94306 2024-09-12T00:42:14.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.638+0000 7fcde98768c0 1 < suggested update operation key=FUJIUIR1E00J tag=8T8BX92KOSZ0 type=del size=1157965 2024-09-12T00:42:14.641 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.646+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~997KHW7HMPIK.0 size=1006637 2024-09-12T00:42:14.641 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.646+0000 7fcde98768c0 1 > prepared multipart upload key=WLE5QLNPAGZA upload=997KHW7HMPIK tag=TPZ0HTHHRO98 type=write size=2055213 2024-09-12T00:42:14.644 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.650+0000 7fcde98768c0 1 < completed write operation key=F813QWV02TI0 tag=WD0AFR9I5OBE type=write size=447263 2024-09-12T00:42:14.650 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.654+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~85Z0QXQSM7FF.0 size=1048576 2024-09-12T00:42:14.652 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.654+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~85Z0QXQSM7FF.1 size=1048576 2024-09-12T00:42:14.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.658+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~85Z0QXQSM7FF.2 size=897271 2024-09-12T00:42:14.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.658+0000 7fcde98768c0 1 > prepared multipart upload key=JW2GNFAYFNEK upload=85Z0QXQSM7FF tag=5IAKSL6O6JLI type=write size=4042999 2024-09-12T00:42:14.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.662+0000 7fcde98768c0 1 < canceled operation key=R2EBH0Q5885L tag=UGZ72CL8LRRR type=del size=1865186 2024-09-12T00:42:14.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.666+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~JMB4ALTE4JJ1.0 size=1048576 2024-09-12T00:42:14.666 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.670+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~JMB4ALTE4JJ1.1 size=1048576 2024-09-12T00:42:14.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.670+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~JMB4ALTE4JJ1.2 size=542811 2024-09-12T00:42:14.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.670+0000 7fcde98768c0 1 > prepared multipart upload key=IMITNCB1ST9E upload=JMB4ALTE4JJ1 tag=UU0YGE33Z5ZI type=write size=3688539 2024-09-12T00:42:14.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.674+0000 7fcde98768c0 1 < completed write operation key=4487IMSOLPDV tag=WXZJ47KLQFAV type=write size=940677 2024-09-12T00:42:14.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.678+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~LG40OWI0VPLF.0 size=802738 2024-09-12T00:42:14.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.678+0000 7fcde98768c0 1 > prepared multipart upload key=368TXYQVK9C3 upload=LG40OWI0VPLF tag=JOS6OPHDMXVZ type=write size=1851314 2024-09-12T00:42:14.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.678+0000 7fcde98768c0 -1 < failed to complete operation key=FUJIUIR1E00J tag=JOBXNGD3P85K type=del size=2798709: (22) Invalid argument 2024-09-12T00:42:14.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.682+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~FPCQP0X1G6FK.0 size=1048576 2024-09-12T00:42:14.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.686+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~FPCQP0X1G6FK.1 size=1048576 2024-09-12T00:42:14.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.686+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~FPCQP0X1G6FK.2 size=341124 2024-09-12T00:42:14.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.686+0000 7fcde98768c0 1 > prepared multipart upload key=WLE5QLNPAGZA upload=FPCQP0X1G6FK tag=LKQW0E97QXX5 type=write size=3486852 2024-09-12T00:42:14.685 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.690+0000 7fcde98768c0 1 < completed delete operation key=TUMAMUZUIR7E tag=B6ZAHWHYQ04E type=del 2024-09-12T00:42:14.688 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.690+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=V6P8OS20VP53 type=del size=924974 2024-09-12T00:42:14.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.698+0000 7fcde98768c0 1 < suggested remove operation key=3X9I78PMR1HV tag=L9VLC4UU3O0W type=write 2024-09-12T00:42:14.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.702+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~HPDR2N0TKWLE.0 size=1048576 2024-09-12T00:42:14.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.702+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~HPDR2N0TKWLE.1 size=111185 2024-09-12T00:42:14.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.702+0000 7fcde98768c0 1 > prepared multipart upload key=EDFNLQYP4L4L upload=HPDR2N0TKWLE tag=MY6GH0V2SHMU type=write size=2208337 2024-09-12T00:42:14.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.706+0000 7fcde98768c0 1 < completed delete operation key=F813QWV02TI0 tag=4KY0ROT40DUS type=del 2024-09-12T00:42:14.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.706+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=PVNLDBZGPWIY type=del size=2263480 2024-09-12T00:42:14.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.710+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~SC1DG5KL5O0Q.0 size=597538 2024-09-12T00:42:14.711 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.714+0000 7fcde98768c0 1 < completed multipart upload key=WLE5QLNPAGZA upload=SC1DG5KL5O0Q tag=H5O5NDSWITUB type=write size=1646114 2024-09-12T00:42:14.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.718+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~J5U81XKCLD5N.0 size=2583 2024-09-12T00:42:14.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.718+0000 7fcde98768c0 1 > prepared multipart upload key=Z1PY2MFUC1C4 upload=J5U81XKCLD5N tag=O53GKP51GJCB type=write size=1051159 2024-09-12T00:42:14.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.722+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~2UB5HP4CFAP8.0 size=1048576 2024-09-12T00:42:14.720 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.722+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~2UB5HP4CFAP8.1 size=1048576 2024-09-12T00:42:14.722 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.726+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~2UB5HP4CFAP8.2 size=475347 2024-09-12T00:42:14.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.730+0000 7fcde98768c0 1 < completed multipart upload key=2T5IU2IUNGJX upload=2UB5HP4CFAP8 tag=T4L1429HDPPQ type=write size=3621075 2024-09-12T00:42:14.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.734+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~6XD017SV69V6.0 size=1048576 2024-09-12T00:42:14.734 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.738+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~6XD017SV69V6.1 size=1048576 2024-09-12T00:42:14.736 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.738+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~6XD017SV69V6.2 size=746701 2024-09-12T00:42:14.736 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.738+0000 7fcde98768c0 1 > prepared multipart upload key=2T5IU2IUNGJX upload=6XD017SV69V6 tag=ZIEBYY09ZVZN type=write size=3892429 2024-09-12T00:42:14.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.742+0000 7fcde98768c0 1 < completed write operation key=KME8ZTTUGOXY tag=03UJ1T2IZQ1Y type=write size=766331 2024-09-12T00:42:14.742 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.746+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=YHG936ZHK903 type=del size=948505 2024-09-12T00:42:14.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.750+0000 7fcde98768c0 1 < completed delete operation key=C6PW0ETP4BG2 tag=XCZDYJ1CWGFY type=del 2024-09-12T00:42:14.750 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.754+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~ERWA1UVIDA5M.0 size=1048576 2024-09-12T00:42:14.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.758+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~ERWA1UVIDA5M.1 size=1048576 2024-09-12T00:42:14.757 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.758+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~ERWA1UVIDA5M.2 size=228745 2024-09-12T00:42:14.757 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.758+0000 7fcde98768c0 1 > prepared multipart upload key=5YBVLUYJW40U upload=ERWA1UVIDA5M tag=3EYZ7S0120L9 type=write size=3374473 2024-09-12T00:42:14.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.762+0000 7fcde98768c0 -1 < failed to complete operation key=3X9I78PMR1HV tag=OEYB67PC5IJ8 type=del size=1901772: (22) Invalid argument 2024-09-12T00:42:14.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.766+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=I6IX26D5VKS5 type=del size=1711535 2024-09-12T00:42:14.765 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.770+0000 7fcde98768c0 1 < completed delete operation key=R2EBH0Q5885L tag=KSDYLR51IYE2 type=del 2024-09-12T00:42:14.769 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.774+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=ACZEEG88AQGU type=del size=1259857 2024-09-12T00:42:14.772 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.774+0000 7fcde98768c0 1 < completed delete operation key=RC9A2Y5TCP9C tag=ZJHSEE62NWXL type=del 2024-09-12T00:42:14.775 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.778+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=R9BY7XCEOQ61 type=del size=3751573 2024-09-12T00:42:14.779 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.782+0000 7fcde98768c0 1 < completed delete operation key=368TXYQVK9C3 tag=IS3444384I88 type=del 2024-09-12T00:42:14.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.790+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~POF1TIYN2FAR.0 size=1048576 2024-09-12T00:42:14.787 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.790+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~POF1TIYN2FAR.1 size=1048576 2024-09-12T00:42:14.790 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.794+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~POF1TIYN2FAR.2 size=312248 2024-09-12T00:42:14.790 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.794+0000 7fcde98768c0 1 > prepared multipart upload key=5B8C6E8L5N52 upload=POF1TIYN2FAR tag=23OMVB8EQDEX type=write size=3457976 2024-09-12T00:42:14.793 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.798+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~997KHW7HMPIK.0 size=1006637 2024-09-12T00:42:14.797 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.802+0000 7fcde98768c0 1 < completed multipart upload key=WLE5QLNPAGZA upload=997KHW7HMPIK tag=TPZ0HTHHRO98 type=write size=2055213 2024-09-12T00:42:14.803 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.806+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~JTLX63L1R9EN.0 size=982146 2024-09-12T00:42:14.804 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.806+0000 7fcde98768c0 1 > prepared multipart upload key=5YBVLUYJW40U upload=JTLX63L1R9EN tag=H9Z5CKOGA311 type=write size=2030722 2024-09-12T00:42:14.806 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.810+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~85Z0QXQSM7FF.0 size=1048576 2024-09-12T00:42:14.809 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.814+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~85Z0QXQSM7FF.1 size=1048576 2024-09-12T00:42:14.811 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.814+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~85Z0QXQSM7FF.2 size=897271 2024-09-12T00:42:14.816 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.818+0000 7fcde98768c0 1 < completed multipart upload key=JW2GNFAYFNEK upload=85Z0QXQSM7FF tag=5IAKSL6O6JLI type=write size=4042999 2024-09-12T00:42:14.819 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.822+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=AT0J5J1KC6EJ type=write size=242728 2024-09-12T00:42:14.822 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.826+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~JMB4ALTE4JJ1.0 size=1048576 2024-09-12T00:42:14.826 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.830+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~JMB4ALTE4JJ1.1 size=1048576 2024-09-12T00:42:14.829 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.834+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~JMB4ALTE4JJ1.2 size=542811 2024-09-12T00:42:14.835 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.838+0000 7fcde98768c0 1 < completed multipart upload key=IMITNCB1ST9E upload=JMB4ALTE4JJ1 tag=UU0YGE33Z5ZI type=write size=3688539 2024-09-12T00:42:14.838 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.842+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=DTIDA7VMPTSB type=write size=348028 2024-09-12T00:42:14.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.846+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~LG40OWI0VPLF.0 size=802738 2024-09-12T00:42:14.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.850+0000 7fcde98768c0 1 < completed multipart upload key=368TXYQVK9C3 upload=LG40OWI0VPLF tag=JOS6OPHDMXVZ type=write size=1851314 2024-09-12T00:42:14.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.850+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=L1WJO9DL77CR type=del size=2221605 2024-09-12T00:42:14.851 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.854+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~FPCQP0X1G6FK.0 size=1048576 2024-09-12T00:42:14.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.858+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~FPCQP0X1G6FK.1 size=1048576 2024-09-12T00:42:14.856 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.858+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~FPCQP0X1G6FK.2 size=341124 2024-09-12T00:42:14.861 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.866+0000 7fcde98768c0 1 < completed multipart upload key=WLE5QLNPAGZA upload=FPCQP0X1G6FK tag=LKQW0E97QXX5 type=write size=3486852 2024-09-12T00:42:14.866 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.870+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~SPIM0A50398Z.0 size=940579 2024-09-12T00:42:14.866 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.870+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=SPIM0A50398Z tag=G1DAPBP9DKC0 type=write size=1989155 2024-09-12T00:42:14.872 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.874+0000 7fcde98768c0 1 < suggested update operation key=V80E1NH858IK tag=V6P8OS20VP53 type=del size=924974 2024-09-12T00:42:14.874 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.878+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=QNOPRE3Q1192 type=del size=619109 2024-09-12T00:42:14.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.882+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~HPDR2N0TKWLE.0 size=1048576 2024-09-12T00:42:14.880 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.882+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~HPDR2N0TKWLE.1 size=111185 2024-09-12T00:42:14.885 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.890+0000 7fcde98768c0 1 < completed multipart upload key=EDFNLQYP4L4L upload=HPDR2N0TKWLE tag=MY6GH0V2SHMU type=write size=2208337 2024-09-12T00:42:14.891 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.894+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~ERV2OPFBNX3W.0 size=1048576 2024-09-12T00:42:14.893 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.898+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~ERV2OPFBNX3W.1 size=1048576 2024-09-12T00:42:14.895 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.898+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~ERV2OPFBNX3W.2 size=493636 2024-09-12T00:42:14.896 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.898+0000 7fcde98768c0 1 > prepared multipart upload key=R2EBH0Q5885L upload=ERV2OPFBNX3W tag=JI6XKLM2AZ3X type=write size=3639364 2024-09-12T00:42:14.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.902+0000 7fcde98768c0 1 < completed delete operation key=97030NBF3MI4 tag=PVNLDBZGPWIY type=del 2024-09-12T00:42:14.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.906+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=156IYENL9XSU type=del size=3881789 2024-09-12T00:42:14.904 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.906+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~J5U81XKCLD5N.0 size=2583 2024-09-12T00:42:14.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.914+0000 7fcde98768c0 1 < completed multipart upload key=Z1PY2MFUC1C4 upload=J5U81XKCLD5N tag=O53GKP51GJCB type=write size=1051159 2024-09-12T00:42:14.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.918+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=2B3ED5XCHDF3 type=write size=286654 2024-09-12T00:42:14.915 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.918+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~6XD017SV69V6.0 size=1048576 2024-09-12T00:42:14.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.918+0000 7fcde98768c0 1 < canceled part key=_multipart_2T5IU2IUNGJX.2~6XD017SV69V6.1 size=1048576 2024-09-12T00:42:14.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.922+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~6XD017SV69V6.2 size=746701 2024-09-12T00:42:14.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.926+0000 7fcde98768c0 1 < canceled multipart upload key=2T5IU2IUNGJX upload=6XD017SV69V6 tag=ZIEBYY09ZVZN type=write size=3892429 2024-09-12T00:42:14.926 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.930+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=BNZNE3AUELC0 type=del size=1982262 2024-09-12T00:42:14.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.934+0000 7fcde98768c0 1 < completed delete operation key=4487IMSOLPDV tag=YHG936ZHK903 type=del 2024-09-12T00:42:14.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.934+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=4V8ACL7NEB52 type=del size=1482391 2024-09-12T00:42:14.934 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.938+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~ERWA1UVIDA5M.0 size=1048576 2024-09-12T00:42:14.936 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.942+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~ERWA1UVIDA5M.1 size=1048576 2024-09-12T00:42:14.938 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.942+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~ERWA1UVIDA5M.2 size=228745 2024-09-12T00:42:14.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.946+0000 7fcde98768c0 1 < completed multipart upload key=5YBVLUYJW40U upload=ERWA1UVIDA5M tag=3EYZ7S0120L9 type=write size=3374473 2024-09-12T00:42:14.946 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.950+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=PFNGDF0IFG6W type=write size=77286 2024-09-12T00:42:14.949 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.954+0000 7fcde98768c0 1 < canceled operation key=JW2GNFAYFNEK tag=I6IX26D5VKS5 type=del size=1711535 2024-09-12T00:42:14.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.954+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=WAPEQBON61EZ type=del size=2709975 2024-09-12T00:42:14.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.958+0000 7fcde98768c0 1 < completed delete operation key=97030NBF3MI4 tag=ACZEEG88AQGU type=del 2024-09-12T00:42:14.958 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.962+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=1XXIDU2PPE7R type=del size=2848354 2024-09-12T00:42:14.961 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.966+0000 7fcde98768c0 1 < completed delete operation key=2T5IU2IUNGJX tag=R9BY7XCEOQ61 type=del 2024-09-12T00:42:14.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.970+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~QA132J713T0W.0 size=1048576 2024-09-12T00:42:14.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.974+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~QA132J713T0W.1 size=1048576 2024-09-12T00:42:14.971 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.974+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~QA132J713T0W.2 size=426802 2024-09-12T00:42:14.971 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.974+0000 7fcde98768c0 1 > prepared multipart upload key=3QOENE572J7A upload=QA132J713T0W tag=H18YJACF3364 type=write size=3572530 2024-09-12T00:42:14.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.978+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~POF1TIYN2FAR.0 size=1048576 2024-09-12T00:42:14.976 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.978+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~POF1TIYN2FAR.1 size=1048576 2024-09-12T00:42:14.979 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.982+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~POF1TIYN2FAR.2 size=312248 2024-09-12T00:42:14.984 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.990+0000 7fcde98768c0 1 < completed multipart upload key=5B8C6E8L5N52 upload=POF1TIYN2FAR tag=23OMVB8EQDEX type=write size=3457976 2024-09-12T00:42:14.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.994+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=ZTRM1FUBRDRG type=write size=414048 2024-09-12T00:42:14.992 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:14.994+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~JTLX63L1R9EN.0 size=982146 2024-09-12T00:42:14.997 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.002+0000 7fcde98768c0 1 < completed multipart upload key=5YBVLUYJW40U upload=JTLX63L1R9EN tag=H9Z5CKOGA311 type=write size=2030722 2024-09-12T00:42:15.000 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.002+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=CA0VLAPWCGX0 type=del size=3211404 2024-09-12T00:42:15.006 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.010+0000 7fcde98768c0 1 < suggested remove operation key=368TXYQVK9C3 tag=AT0J5J1KC6EJ type=write 2024-09-12T00:42:15.012 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.014+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~YJW6S51WH6EF.0 size=1048576 2024-09-12T00:42:15.014 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.018+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~YJW6S51WH6EF.1 size=1048576 2024-09-12T00:42:15.016 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.018+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~YJW6S51WH6EF.2 size=723228 2024-09-12T00:42:15.016 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.018+0000 7fcde98768c0 1 > prepared multipart upload key=ZQD0QXDN1J1I upload=YJW6S51WH6EF tag=L7XTW4EM4XHY type=write size=3868956 2024-09-12T00:42:15.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.022+0000 7fcde98768c0 1 < canceled operation key=IMITNCB1ST9E tag=DTIDA7VMPTSB type=write size=348028 2024-09-12T00:42:15.023 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.026+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=WMZ4U3MLAOT6 type=del size=2056089 2024-09-12T00:42:15.026 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.030+0000 7fcde98768c0 -1 < failed to complete operation key=V80E1NH858IK tag=L1WJO9DL77CR type=del size=2221605: (22) Invalid argument 2024-09-12T00:42:15.031 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.034+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~OUUOT9S9F7YT.0 size=1048576 2024-09-12T00:42:15.034 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.038+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~OUUOT9S9F7YT.1 size=1048576 2024-09-12T00:42:15.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.038+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~OUUOT9S9F7YT.2 size=54737 2024-09-12T00:42:15.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.038+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=OUUOT9S9F7YT tag=OJ52GQKVIN34 type=write size=3200465 2024-09-12T00:42:15.039 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.042+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~SPIM0A50398Z.0 size=940579 2024-09-12T00:42:15.044 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.046+0000 7fcde98768c0 1 < completed multipart upload key=IV4JCE1QJC70 upload=SPIM0A50398Z tag=G1DAPBP9DKC0 type=write size=1989155 2024-09-12T00:42:15.047 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.050+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=UZ9ENEDAAH2M type=del size=58735 2024-09-12T00:42:15.050 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.054+0000 7fcde98768c0 1 < completed delete operation key=97030NBF3MI4 tag=QNOPRE3Q1192 type=del 2024-09-12T00:42:15.053 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.058+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=39G1VDYUBX13 type=del size=1223102 2024-09-12T00:42:15.056 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.058+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~ERV2OPFBNX3W.0 size=1048576 2024-09-12T00:42:15.058 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.062+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~ERV2OPFBNX3W.1 size=1048576 2024-09-12T00:42:15.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.066+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~ERV2OPFBNX3W.2 size=493636 2024-09-12T00:42:15.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.070+0000 7fcde98768c0 1 < completed multipart upload key=R2EBH0Q5885L upload=ERV2OPFBNX3W tag=JI6XKLM2AZ3X type=write size=3639364 2024-09-12T00:42:15.068 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.070+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=FN82V22W379Y type=del size=684531 2024-09-12T00:42:15.071 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.074+0000 7fcde98768c0 1 < completed delete operation key=2T5IU2IUNGJX tag=156IYENL9XSU type=del 2024-09-12T00:42:15.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.078+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~URNRVJP4MAQ2.0 size=1048576 2024-09-12T00:42:15.078 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.082+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~URNRVJP4MAQ2.1 size=694179 2024-09-12T00:42:15.078 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.082+0000 7fcde98768c0 1 > prepared multipart upload key=J9EUM073CZHF upload=URNRVJP4MAQ2 tag=ZT2BPD80DPE3 type=write size=2791331 2024-09-12T00:42:15.084 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.086+0000 7fcde98768c0 1 < suggested remove operation key=ZQD0QXDN1J1I tag=2B3ED5XCHDF3 type=write 2024-09-12T00:42:15.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.090+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=2RL3RV3B0DP4 type=del size=3671580 2024-09-12T00:42:15.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.094+0000 7fcde98768c0 1 < completed delete operation key=IMITNCB1ST9E tag=BNZNE3AUELC0 type=del 2024-09-12T00:42:15.093 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.098+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=JA18G9C65MX4 type=del size=339350 2024-09-12T00:42:15.102 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.106+0000 7fcde98768c0 1 < suggested update operation key=3X9I78PMR1HV tag=4V8ACL7NEB52 type=del size=1482391 2024-09-12T00:42:15.106 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.110+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=H2FE05QGM0MW type=del size=2654875 2024-09-12T00:42:15.109 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.114+0000 7fcde98768c0 -1 < failed to complete operation key=ZQD0QXDN1J1I tag=PFNGDF0IFG6W type=write size=77286: (22) Invalid argument 2024-09-12T00:42:15.115 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.118+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~54YAHL340NWE.0 size=1048576 2024-09-12T00:42:15.117 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.122+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~54YAHL340NWE.1 size=1048576 2024-09-12T00:42:15.120 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.122+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~54YAHL340NWE.2 size=478187 2024-09-12T00:42:15.120 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.122+0000 7fcde98768c0 1 > prepared multipart upload key=4487IMSOLPDV upload=54YAHL340NWE tag=PDLEGNQ6QK9B type=write size=3623915 2024-09-12T00:42:15.123 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.126+0000 7fcde98768c0 1 < canceled operation key=HVE3YQTFZWTV tag=WAPEQBON61EZ type=del size=2709975 2024-09-12T00:42:15.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.134+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~PSXBEZX8WUXI.0 size=687049 2024-09-12T00:42:15.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.134+0000 7fcde98768c0 1 > prepared multipart upload key=3QOENE572J7A upload=PSXBEZX8WUXI tag=1DN5W982L1BP type=write size=1735625 2024-09-12T00:42:15.136 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.138+0000 7fcde98768c0 1 < suggested remove operation key=IV4JCE1QJC70 tag=1XXIDU2PPE7R type=del 2024-09-12T00:42:15.142 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.146+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~GNI31ERZ937N.0 size=1048576 2024-09-12T00:42:15.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.146+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~GNI31ERZ937N.1 size=724397 2024-09-12T00:42:15.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.146+0000 7fcde98768c0 1 > prepared multipart upload key=RC9A2Y5TCP9C upload=GNI31ERZ937N tag=TSVMPDGWHB2D type=write size=2821549 2024-09-12T00:42:15.148 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.150+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~QA132J713T0W.0 size=1048576 2024-09-12T00:42:15.151 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.154+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~QA132J713T0W.1 size=1048576 2024-09-12T00:42:15.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.158+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~QA132J713T0W.2 size=426802 2024-09-12T00:42:15.159 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.162+0000 7fcde98768c0 1 < completed multipart upload key=3QOENE572J7A upload=QA132J713T0W tag=H18YJACF3364 type=write size=3572530 2024-09-12T00:42:15.165 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.166+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=A3V182HGEU6Z type=del size=3198172 2024-09-12T00:42:15.166 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.170+0000 7fcde98768c0 1 < completed write operation key=IMITNCB1ST9E tag=ZTRM1FUBRDRG type=write size=414048 2024-09-12T00:42:15.173 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.178+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~WSMBS42J3M34.0 size=1048576 2024-09-12T00:42:15.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.178+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~WSMBS42J3M34.1 size=1048576 2024-09-12T00:42:15.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.182+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~WSMBS42J3M34.2 size=992624 2024-09-12T00:42:15.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.182+0000 7fcde98768c0 1 > prepared multipart upload key=FUJIUIR1E00J upload=WSMBS42J3M34 tag=4J62ELX3Z1TI type=write size=4138352 2024-09-12T00:42:15.182 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.186+0000 7fcde98768c0 -1 < failed to complete operation key=3X9I78PMR1HV tag=CA0VLAPWCGX0 type=del size=3211404: (22) Invalid argument 2024-09-12T00:42:15.188 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.190+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~Y9BQ6TD8AQ0U.0 size=1048576 2024-09-12T00:42:15.191 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.194+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~Y9BQ6TD8AQ0U.1 size=1048576 2024-09-12T00:42:15.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.198+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~Y9BQ6TD8AQ0U.2 size=142154 2024-09-12T00:42:15.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.198+0000 7fcde98768c0 1 > prepared multipart upload key=KME8ZTTUGOXY upload=Y9BQ6TD8AQ0U tag=7CV9W2I58GJC type=write size=3287882 2024-09-12T00:42:15.197 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.202+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~YJW6S51WH6EF.0 size=1048576 2024-09-12T00:42:15.199 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.202+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~YJW6S51WH6EF.1 size=1048576 2024-09-12T00:42:15.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.206+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~YJW6S51WH6EF.2 size=723228 2024-09-12T00:42:15.208 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.210+0000 7fcde98768c0 1 < completed multipart upload key=ZQD0QXDN1J1I upload=YJW6S51WH6EF tag=L7XTW4EM4XHY type=write size=3868956 2024-09-12T00:42:15.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.214+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=29KN3M58FDRY type=write size=614885 2024-09-12T00:42:15.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.218+0000 7fcde98768c0 1 < canceled operation key=2T5IU2IUNGJX tag=WMZ4U3MLAOT6 type=del size=2056089 2024-09-12T00:42:15.220 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.226+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~11AK0F44GODO.0 size=1048576 2024-09-12T00:42:15.223 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.226+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~11AK0F44GODO.1 size=483095 2024-09-12T00:42:15.223 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.226+0000 7fcde98768c0 1 > prepared multipart upload key=IMITNCB1ST9E upload=11AK0F44GODO tag=IJVSLBKYDYDB type=write size=2580247 2024-09-12T00:42:15.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.230+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~OUUOT9S9F7YT.0 size=1048576 2024-09-12T00:42:15.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.234+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~OUUOT9S9F7YT.1 size=1048576 2024-09-12T00:42:15.232 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.234+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~OUUOT9S9F7YT.2 size=54737 2024-09-12T00:42:15.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.242+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=OUUOT9S9F7YT tag=OJ52GQKVIN34 type=write size=3200465 2024-09-12T00:42:15.241 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.246+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=VJWK5VN2J238 type=del size=20720 2024-09-12T00:42:15.245 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.250+0000 7fcde98768c0 1 < completed delete operation key=HVE3YQTFZWTV tag=UZ9ENEDAAH2M type=del 2024-09-12T00:42:15.248 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.250+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=AD1MQ94QZWGB type=del size=1741225 2024-09-12T00:42:15.252 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.254+0000 7fcde98768c0 1 < completed delete operation key=C6PW0ETP4BG2 tag=39G1VDYUBX13 type=del 2024-09-12T00:42:15.258 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.262+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~IRU9OQMHHMSJ.0 size=1048576 2024-09-12T00:42:15.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.266+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~IRU9OQMHHMSJ.1 size=408070 2024-09-12T00:42:15.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.266+0000 7fcde98768c0 1 > prepared multipart upload key=368TXYQVK9C3 upload=IRU9OQMHHMSJ tag=ZSBKIK9QMZ4I type=write size=2505222 2024-09-12T00:42:15.264 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.266+0000 7fcde98768c0 1 < canceled operation key=TUMAMUZUIR7E tag=FN82V22W379Y type=del size=684531 2024-09-12T00:42:15.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.274+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~A0OUO21A8W14.0 size=479564 2024-09-12T00:42:15.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.274+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=A0OUO21A8W14 tag=52TCZP1TIPT9 type=write size=1528140 2024-09-12T00:42:15.273 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.278+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~URNRVJP4MAQ2.0 size=1048576 2024-09-12T00:42:15.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.278+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~URNRVJP4MAQ2.1 size=694179 2024-09-12T00:42:15.281 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.286+0000 7fcde98768c0 1 < completed multipart upload key=J9EUM073CZHF upload=URNRVJP4MAQ2 tag=ZT2BPD80DPE3 type=write size=2791331 2024-09-12T00:42:15.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.286+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=6NBKDDYUGPG2 type=del size=405814 2024-09-12T00:42:15.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.290+0000 7fcde98768c0 -1 < failed to complete operation key=IV4JCE1QJC70 tag=2RL3RV3B0DP4 type=del size=3671580: (22) Invalid argument 2024-09-12T00:42:15.290 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.294+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=2AL0VLU6NVJ5 type=write size=107744 2024-09-12T00:42:15.293 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.298+0000 7fcde98768c0 -1 < failed to complete operation key=IV4JCE1QJC70 tag=JA18G9C65MX4 type=del size=339350: (22) Invalid argument 2024-09-12T00:42:15.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.302+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=ZXKNAOJK9PLE type=del size=2708838 2024-09-12T00:42:15.300 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.302+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=H2FE05QGM0MW type=del 2024-09-12T00:42:15.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.310+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~621EZT8LG6TI.0 size=1048576 2024-09-12T00:42:15.308 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.314+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~621EZT8LG6TI.1 size=318068 2024-09-12T00:42:15.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.314+0000 7fcde98768c0 1 > prepared multipart upload key=IMITNCB1ST9E upload=621EZT8LG6TI tag=7DPHZ9AVX634 type=write size=2415220 2024-09-12T00:42:15.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.314+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~54YAHL340NWE.0 size=1048576 2024-09-12T00:42:15.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.318+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~54YAHL340NWE.1 size=1048576 2024-09-12T00:42:15.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.322+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~54YAHL340NWE.2 size=478187 2024-09-12T00:42:15.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.326+0000 7fcde98768c0 1 < completed multipart upload key=4487IMSOLPDV upload=54YAHL340NWE tag=PDLEGNQ6QK9B type=write size=3623915 2024-09-12T00:42:15.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.330+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=S03BX5B8E1GI type=del size=45490 2024-09-12T00:42:15.330 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.334+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~PSXBEZX8WUXI.0 size=687049 2024-09-12T00:42:15.335 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.338+0000 7fcde98768c0 1 < completed multipart upload key=3QOENE572J7A upload=PSXBEZX8WUXI tag=1DN5W982L1BP type=write size=1735625 2024-09-12T00:42:15.339 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.342+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=CW5PTSTNMR4D type=del size=2104 2024-09-12T00:42:15.342 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.346+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~GNI31ERZ937N.0 size=1048576 2024-09-12T00:42:15.344 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.350+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~GNI31ERZ937N.1 size=724397 2024-09-12T00:42:15.350 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.354+0000 7fcde98768c0 1 < completed multipart upload key=RC9A2Y5TCP9C upload=GNI31ERZ937N tag=TSVMPDGWHB2D type=write size=2821549 2024-09-12T00:42:15.356 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.358+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~4GXDK2AA3AVT.0 size=1048576 2024-09-12T00:42:15.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.362+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~4GXDK2AA3AVT.1 size=625441 2024-09-12T00:42:15.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.362+0000 7fcde98768c0 1 > prepared multipart upload key=97030NBF3MI4 upload=4GXDK2AA3AVT tag=FH9C9BCM1UBI type=write size=2722593 2024-09-12T00:42:15.362 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.366+0000 7fcde98768c0 1 < completed delete operation key=2T5IU2IUNGJX tag=A3V182HGEU6Z type=del 2024-09-12T00:42:15.365 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.370+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=W0ESBEWHL6BY type=del size=2042633 2024-09-12T00:42:15.369 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.370+0000 7fcde98768c0 1 < canceled part key=_multipart_FUJIUIR1E00J.2~WSMBS42J3M34.0 size=1048576 2024-09-12T00:42:15.369 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.370+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~WSMBS42J3M34.1 size=1048576 2024-09-12T00:42:15.371 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.374+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~WSMBS42J3M34.2 size=992624 2024-09-12T00:42:15.376 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.378+0000 7fcde98768c0 1 < canceled multipart upload key=FUJIUIR1E00J upload=WSMBS42J3M34 tag=4J62ELX3Z1TI type=write size=4138352 2024-09-12T00:42:15.379 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.382+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=AZGYWNDLON0L type=del size=1171629 2024-09-12T00:42:15.383 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.386+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~Y9BQ6TD8AQ0U.0 size=1048576 2024-09-12T00:42:15.386 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.390+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~Y9BQ6TD8AQ0U.1 size=1048576 2024-09-12T00:42:15.388 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.394+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~Y9BQ6TD8AQ0U.2 size=142154 2024-09-12T00:42:15.394 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.398+0000 7fcde98768c0 1 < completed multipart upload key=KME8ZTTUGOXY upload=Y9BQ6TD8AQ0U tag=7CV9W2I58GJC type=write size=3287882 2024-09-12T00:42:15.397 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.402+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=LC9SEXTM247X type=del size=903630 2024-09-12T00:42:15.400 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.406+0000 7fcde98768c0 1 < completed write operation key=3QOENE572J7A tag=29KN3M58FDRY type=write size=614885 2024-09-12T00:42:15.407 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.410+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=B0CI2DU5GF1K type=del size=75858 2024-09-12T00:42:15.411 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.414+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~11AK0F44GODO.0 size=1048576 2024-09-12T00:42:15.414 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.418+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~11AK0F44GODO.1 size=483095 2024-09-12T00:42:15.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.422+0000 7fcde98768c0 1 < completed multipart upload key=IMITNCB1ST9E upload=11AK0F44GODO tag=IJVSLBKYDYDB type=write size=2580247 2024-09-12T00:42:15.423 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.426+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=0NSNC2SKJP6O type=del size=4061169 2024-09-12T00:42:15.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.430+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=VJWK5VN2J238 type=del 2024-09-12T00:42:15.430 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.434+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=V9ASEMV8PZN9 type=del size=2111063 2024-09-12T00:42:15.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.438+0000 7fcde98768c0 1 < completed delete operation key=NVOFV649MT0A tag=AD1MQ94QZWGB type=del 2024-09-12T00:42:15.438 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.442+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=P5DNZJUZFYPH type=del size=3137912 2024-09-12T00:42:15.442 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.446+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~IRU9OQMHHMSJ.0 size=1048576 2024-09-12T00:42:15.445 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.446+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~IRU9OQMHHMSJ.1 size=408070 2024-09-12T00:42:15.449 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.454+0000 7fcde98768c0 1 < completed multipart upload key=368TXYQVK9C3 upload=IRU9OQMHHMSJ tag=ZSBKIK9QMZ4I type=write size=2505222 2024-09-12T00:42:15.452 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.454+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=8497JRP7VZQR type=del size=1623815 2024-09-12T00:42:15.452 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.454+0000 7fcde98768c0 1 < canceled part key=_multipart_QD5JXFL962R5.2~A0OUO21A8W14.0 size=479564 2024-09-12T00:42:15.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.462+0000 7fcde98768c0 1 < canceled multipart upload key=QD5JXFL962R5 upload=A0OUO21A8W14 tag=52TCZP1TIPT9 type=write size=1528140 2024-09-12T00:42:15.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.466+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=S03RJOJ3SSAI type=del size=385093 2024-09-12T00:42:15.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.466+0000 7fcde98768c0 1 < canceled operation key=QD5JXFL962R5 tag=6NBKDDYUGPG2 type=del size=405814 2024-09-12T00:42:15.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.474+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~O1PLSR1WWW16.0 size=1048576 2024-09-12T00:42:15.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.474+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~O1PLSR1WWW16.1 size=1048576 2024-09-12T00:42:15.474 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.478+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~O1PLSR1WWW16.2 size=134630 2024-09-12T00:42:15.474 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.478+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=O1PLSR1WWW16 tag=T1R5A8U2NETN type=write size=3280358 2024-09-12T00:42:15.477 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.482+0000 7fcde98768c0 1 < canceled operation key=TUMAMUZUIR7E tag=2AL0VLU6NVJ5 type=write size=107744 2024-09-12T00:42:15.482 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.486+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~KCZ3M4TZX4JO.0 size=269696 2024-09-12T00:42:15.482 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.486+0000 7fcde98768c0 1 > prepared multipart upload key=5YBVLUYJW40U upload=KCZ3M4TZX4JO tag=EW3TJ4Y5FV53 type=write size=1318272 2024-09-12T00:42:15.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.490+0000 7fcde98768c0 1 < suggested update operation key=BQGIXJJWBAN0 tag=ZXKNAOJK9PLE type=del size=2708838 2024-09-12T00:42:15.491 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.494+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=6MQ4QI3SJ8DI type=del size=3952005 2024-09-12T00:42:15.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.498+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~621EZT8LG6TI.0 size=1048576 2024-09-12T00:42:15.497 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.502+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~621EZT8LG6TI.1 size=318068 2024-09-12T00:42:15.503 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.506+0000 7fcde98768c0 1 < completed multipart upload key=IMITNCB1ST9E upload=621EZT8LG6TI tag=7DPHZ9AVX634 type=write size=2415220 2024-09-12T00:42:15.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.510+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=VJD4HC8UYVJU type=del size=651622 2024-09-12T00:42:15.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.514+0000 7fcde98768c0 1 < canceled operation key=5YBVLUYJW40U tag=S03BX5B8E1GI type=del size=45490 2024-09-12T00:42:15.512 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.514+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=EV2XRDVI6QXQ type=del size=2739275 2024-09-12T00:42:15.518 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.522+0000 7fcde98768c0 1 < suggested update operation key=WLE5QLNPAGZA tag=CW5PTSTNMR4D type=del size=2104 2024-09-12T00:42:15.523 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.526+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~8XFEW8JFIDY1.0 size=794902 2024-09-12T00:42:15.523 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.526+0000 7fcde98768c0 1 > prepared multipart upload key=TUMAMUZUIR7E upload=8XFEW8JFIDY1 tag=CA8W8XCA3FI2 type=write size=1843478 2024-09-12T00:42:15.526 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.530+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~4GXDK2AA3AVT.0 size=1048576 2024-09-12T00:42:15.528 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.530+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~4GXDK2AA3AVT.1 size=625441 2024-09-12T00:42:15.533 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.538+0000 7fcde98768c0 1 < completed multipart upload key=97030NBF3MI4 upload=4GXDK2AA3AVT tag=FH9C9BCM1UBI type=write size=2722593 2024-09-12T00:42:15.539 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.542+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~1Y5EAN8UE7E1.0 size=642857 2024-09-12T00:42:15.539 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.542+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=1Y5EAN8UE7E1 tag=KDOKWOT9O1GA type=write size=1691433 2024-09-12T00:42:15.542 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.546+0000 7fcde98768c0 1 < completed delete operation key=3X9I78PMR1HV tag=W0ESBEWHL6BY type=del 2024-09-12T00:42:15.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.550+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~Z1XOQAPZKRJ8.0 size=1048576 2024-09-12T00:42:15.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.554+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~Z1XOQAPZKRJ8.1 size=939718 2024-09-12T00:42:15.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.554+0000 7fcde98768c0 1 > prepared multipart upload key=97030NBF3MI4 upload=Z1XOQAPZKRJ8 tag=76413B6KDT6M type=write size=3036870 2024-09-12T00:42:15.555 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.558+0000 7fcde98768c0 1 < suggested remove operation key=WLE5QLNPAGZA tag=AZGYWNDLON0L type=del 2024-09-12T00:42:15.559 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.562+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~7W5RWKS2JX03.0 size=795931 2024-09-12T00:42:15.559 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.562+0000 7fcde98768c0 1 > prepared multipart upload key=5B8C6E8L5N52 upload=7W5RWKS2JX03 tag=32MNQM2VZ8IR type=write size=1844507 2024-09-12T00:42:15.562 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.566+0000 7fcde98768c0 1 < completed delete operation key=J9EUM073CZHF tag=LC9SEXTM247X type=del 2024-09-12T00:42:15.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.570+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~EVOI1WV8B1AI.0 size=684410 2024-09-12T00:42:15.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.570+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=EVOI1WV8B1AI tag=12FQI6A1WUH5 type=write size=1732986 2024-09-12T00:42:15.572 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.574+0000 7fcde98768c0 1 < completed delete operation key=JW2GNFAYFNEK tag=B0CI2DU5GF1K type=del 2024-09-12T00:42:15.575 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.578+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~HO50NHD0SID0.0 size=1048576 2024-09-12T00:42:15.578 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.582+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~HO50NHD0SID0.1 size=1048576 2024-09-12T00:42:15.580 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.582+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~HO50NHD0SID0.2 size=137372 2024-09-12T00:42:15.580 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.582+0000 7fcde98768c0 1 > prepared multipart upload key=J9EUM073CZHF upload=HO50NHD0SID0 tag=B9C85I8MCM96 type=write size=3283100 2024-09-12T00:42:15.583 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.586+0000 7fcde98768c0 1 < canceled operation key=368TXYQVK9C3 tag=0NSNC2SKJP6O type=del size=4061169 2024-09-12T00:42:15.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.590+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=JG081DEW6XAY type=del size=2267962 2024-09-12T00:42:15.591 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.594+0000 7fcde98768c0 1 < suggested remove operation key=IMITNCB1ST9E tag=V9ASEMV8PZN9 type=del 2024-09-12T00:42:15.594 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.598+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=00JZHE3AKZA0 type=del size=129539 2024-09-12T00:42:15.597 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.602+0000 7fcde98768c0 1 < canceled operation key=3X9I78PMR1HV tag=P5DNZJUZFYPH type=del size=3137912 2024-09-12T00:42:15.599 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.602+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=DNDNCJHI47UF type=del size=1701055 2024-09-12T00:42:15.602 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.606+0000 7fcde98768c0 1 < completed delete operation key=5YBVLUYJW40U tag=8497JRP7VZQR type=del 2024-09-12T00:42:15.607 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.610+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~HJY8S3GOW5UX.0 size=1048576 2024-09-12T00:42:15.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.614+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~HJY8S3GOW5UX.1 size=1048576 2024-09-12T00:42:15.612 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.614+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~HJY8S3GOW5UX.2 size=424462 2024-09-12T00:42:15.612 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.614+0000 7fcde98768c0 1 > prepared multipart upload key=IMITNCB1ST9E upload=HJY8S3GOW5UX tag=ZZD3CJ8SKN1R type=write size=3570190 2024-09-12T00:42:15.618 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.622+0000 7fcde98768c0 1 < suggested update operation key=FUJIUIR1E00J tag=S03RJOJ3SSAI type=del size=385093 2024-09-12T00:42:15.621 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.626+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=SK9MIU93LJP2 type=del size=3192225 2024-09-12T00:42:15.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.630+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~O1PLSR1WWW16.0 size=1048576 2024-09-12T00:42:15.628 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.630+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~O1PLSR1WWW16.1 size=1048576 2024-09-12T00:42:15.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.634+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~O1PLSR1WWW16.2 size=134630 2024-09-12T00:42:15.636 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.638+0000 7fcde98768c0 1 < completed multipart upload key=BZ4YUNTMOJBK upload=O1PLSR1WWW16 tag=T1R5A8U2NETN type=write size=3280358 2024-09-12T00:42:15.641 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.646+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~ZQJ9I9VUQJPH.0 size=1024302 2024-09-12T00:42:15.641 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.646+0000 7fcde98768c0 1 > prepared multipart upload key=RC9A2Y5TCP9C upload=ZQJ9I9VUQJPH tag=KTZ4JLH9NP13 type=write size=2072878 2024-09-12T00:42:15.642 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.646+0000 7fcde98768c0 1 < canceled part key=_multipart_5YBVLUYJW40U.2~KCZ3M4TZX4JO.0 size=269696 2024-09-12T00:42:15.647 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.650+0000 7fcde98768c0 1 < canceled multipart upload key=5YBVLUYJW40U upload=KCZ3M4TZX4JO tag=EW3TJ4Y5FV53 type=write size=1318272 2024-09-12T00:42:15.650 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.654+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=88GO15DTXY8C type=del size=2127182 2024-09-12T00:42:15.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.662+0000 7fcde98768c0 1 < suggested update operation key=97030NBF3MI4 tag=6MQ4QI3SJ8DI type=del size=3952005 2024-09-12T00:42:15.662 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.666+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~CG0I0HR2EI0T.0 size=1048576 2024-09-12T00:42:15.665 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.670+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~CG0I0HR2EI0T.1 size=606325 2024-09-12T00:42:15.665 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.670+0000 7fcde98768c0 1 > prepared multipart upload key=97030NBF3MI4 upload=CG0I0HR2EI0T tag=P2SZ7D9Z7RAN type=write size=2703477 2024-09-12T00:42:15.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.670+0000 7fcde98768c0 1 < completed delete operation key=R2EBH0Q5885L tag=VJD4HC8UYVJU type=del 2024-09-12T00:42:15.670 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.674+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=HNF72H9D4Q1L type=write size=336713 2024-09-12T00:42:15.672 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.674+0000 7fcde98768c0 1 < completed delete operation key=C6PW0ETP4BG2 tag=EV2XRDVI6QXQ type=del 2024-09-12T00:42:15.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.682+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~HK2GHLPOXFJE.0 size=1048576 2024-09-12T00:42:15.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.682+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~HK2GHLPOXFJE.1 size=1048576 2024-09-12T00:42:15.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.686+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~HK2GHLPOXFJE.2 size=393938 2024-09-12T00:42:15.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.686+0000 7fcde98768c0 1 > prepared multipart upload key=ZQD0QXDN1J1I upload=HK2GHLPOXFJE tag=FMQ5QVDRDBCD type=write size=3539666 2024-09-12T00:42:15.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.686+0000 7fcde98768c0 1 < canceled part key=_multipart_TUMAMUZUIR7E.2~8XFEW8JFIDY1.0 size=794902 2024-09-12T00:42:15.688 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.690+0000 7fcde98768c0 1 < canceled multipart upload key=TUMAMUZUIR7E upload=8XFEW8JFIDY1 tag=CA8W8XCA3FI2 type=write size=1843478 2024-09-12T00:42:15.690 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.694+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=763UO5WX9JGR type=del size=708793 2024-09-12T00:42:15.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.698+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~1Y5EAN8UE7E1.0 size=642857 2024-09-12T00:42:15.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.702+0000 7fcde98768c0 1 < completed multipart upload key=BZ4YUNTMOJBK upload=1Y5EAN8UE7E1 tag=KDOKWOT9O1GA type=write size=1691433 2024-09-12T00:42:15.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.706+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~6XSF0JI5H62C.0 size=1048576 2024-09-12T00:42:15.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.706+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~6XSF0JI5H62C.1 size=706441 2024-09-12T00:42:15.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.706+0000 7fcde98768c0 1 > prepared multipart upload key=3X9I78PMR1HV upload=6XSF0JI5H62C tag=Q2JS0QMJML57 type=write size=2803593 2024-09-12T00:42:15.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.710+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~Z1XOQAPZKRJ8.0 size=1048576 2024-09-12T00:42:15.708 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.710+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~Z1XOQAPZKRJ8.1 size=939718 2024-09-12T00:42:15.712 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.714+0000 7fcde98768c0 1 < completed multipart upload key=97030NBF3MI4 upload=Z1XOQAPZKRJ8 tag=76413B6KDT6M type=write size=3036870 2024-09-12T00:42:15.714 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.718+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=3QODDJFHB5TP type=del size=2280760 2024-09-12T00:42:15.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.722+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~7W5RWKS2JX03.0 size=795931 2024-09-12T00:42:15.721 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.726+0000 7fcde98768c0 1 < completed multipart upload key=5B8C6E8L5N52 upload=7W5RWKS2JX03 tag=32MNQM2VZ8IR type=write size=1844507 2024-09-12T00:42:15.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.726+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=11QRJQ2ZN0DI type=write size=367911 2024-09-12T00:42:15.725 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.730+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~EVOI1WV8B1AI.0 size=684410 2024-09-12T00:42:15.729 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.734+0000 7fcde98768c0 1 < completed multipart upload key=QD5JXFL962R5 upload=EVOI1WV8B1AI tag=12FQI6A1WUH5 type=write size=1732986 2024-09-12T00:42:15.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.738+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~C6JUX1MXRSE2.0 size=1048576 2024-09-12T00:42:15.735 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.738+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~C6JUX1MXRSE2.1 size=1048576 2024-09-12T00:42:15.737 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.742+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~C6JUX1MXRSE2.2 size=857645 2024-09-12T00:42:15.737 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.742+0000 7fcde98768c0 1 > prepared multipart upload key=TUMAMUZUIR7E upload=C6JUX1MXRSE2 tag=1C9HHLV10A1L type=write size=4003373 2024-09-12T00:42:15.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.742+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~HO50NHD0SID0.0 size=1048576 2024-09-12T00:42:15.741 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.746+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~HO50NHD0SID0.1 size=1048576 2024-09-12T00:42:15.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.746+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~HO50NHD0SID0.2 size=137372 2024-09-12T00:42:15.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.750+0000 7fcde98768c0 1 < completed multipart upload key=J9EUM073CZHF upload=HO50NHD0SID0 tag=B9C85I8MCM96 type=write size=3283100 2024-09-12T00:42:15.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.754+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=O8I07QXRQVLC type=del size=231174 2024-09-12T00:42:15.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.754+0000 7fcde98768c0 1 < completed delete operation key=3X9I78PMR1HV tag=JG081DEW6XAY type=del 2024-09-12T00:42:15.756 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.758+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~302ZRVU4V4UC.0 size=1048576 2024-09-12T00:42:15.758 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.762+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~302ZRVU4V4UC.1 size=1048576 2024-09-12T00:42:15.760 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.762+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~302ZRVU4V4UC.2 size=709300 2024-09-12T00:42:15.760 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.762+0000 7fcde98768c0 1 > prepared multipart upload key=F813QWV02TI0 upload=302ZRVU4V4UC tag=PTG9Y3GCVN47 type=write size=3855028 2024-09-12T00:42:15.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.766+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=00JZHE3AKZA0 type=del 2024-09-12T00:42:15.765 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.770+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=LFR5O818BPE9 type=del size=3580925 2024-09-12T00:42:15.768 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.774+0000 7fcde98768c0 1 < canceled operation key=NVOFV649MT0A tag=DNDNCJHI47UF type=del size=1701055 2024-09-12T00:42:15.771 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.774+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=0SFNVT4CA1FA type=del size=3626434 2024-09-12T00:42:15.774 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.778+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~HJY8S3GOW5UX.0 size=1048576 2024-09-12T00:42:15.776 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.778+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~HJY8S3GOW5UX.1 size=1048576 2024-09-12T00:42:15.777 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.782+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~HJY8S3GOW5UX.2 size=424462 2024-09-12T00:42:15.782 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.786+0000 7fcde98768c0 1 < completed multipart upload key=IMITNCB1ST9E upload=HJY8S3GOW5UX tag=ZZD3CJ8SKN1R type=write size=3570190 2024-09-12T00:42:15.784 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.786+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=HAP7SZBWYNYC type=del size=2926375 2024-09-12T00:42:15.786 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.790+0000 7fcde98768c0 1 < completed delete operation key=3QOENE572J7A tag=SK9MIU93LJP2 type=del 2024-09-12T00:42:15.789 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.794+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=TCD6WM51XC00 type=write size=991474 2024-09-12T00:42:15.792 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.794+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~ZQJ9I9VUQJPH.0 size=1024302 2024-09-12T00:42:15.796 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.798+0000 7fcde98768c0 1 < completed multipart upload key=RC9A2Y5TCP9C upload=ZQJ9I9VUQJPH tag=KTZ4JLH9NP13 type=write size=2072878 2024-09-12T00:42:15.799 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.802+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=V2MU55OGV38A type=del size=1510329 2024-09-12T00:42:15.803 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.806+0000 7fcde98768c0 1 < suggested remove operation key=IMITNCB1ST9E tag=88GO15DTXY8C type=del 2024-09-12T00:42:15.805 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.810+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=YM9YPTKJ8CFT type=del size=3998508 2024-09-12T00:42:15.808 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.810+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~CG0I0HR2EI0T.0 size=1048576 2024-09-12T00:42:15.810 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.814+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~CG0I0HR2EI0T.1 size=606325 2024-09-12T00:42:15.813 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.818+0000 7fcde98768c0 1 < completed multipart upload key=97030NBF3MI4 upload=CG0I0HR2EI0T tag=P2SZ7D9Z7RAN type=write size=2703477 2024-09-12T00:42:15.817 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.822+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~PJ7THG88DFWE.0 size=101753 2024-09-12T00:42:15.817 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.822+0000 7fcde98768c0 1 > prepared multipart upload key=97030NBF3MI4 upload=PJ7THG88DFWE tag=861OQY61QRMW type=write size=1150329 2024-09-12T00:42:15.819 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.822+0000 7fcde98768c0 1 < completed write operation key=7UR0FX8HA2A5 tag=HNF72H9D4Q1L type=write size=336713 2024-09-12T00:42:15.822 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.826+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=HO8K72W7YQP8 type=del size=3754397 2024-09-12T00:42:15.824 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.826+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~HK2GHLPOXFJE.0 size=1048576 2024-09-12T00:42:15.826 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.830+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~HK2GHLPOXFJE.1 size=1048576 2024-09-12T00:42:15.828 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.830+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~HK2GHLPOXFJE.2 size=393938 2024-09-12T00:42:15.832 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.834+0000 7fcde98768c0 1 < completed multipart upload key=ZQD0QXDN1J1I upload=HK2GHLPOXFJE tag=FMQ5QVDRDBCD type=write size=3539666 2024-09-12T00:42:15.836 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.838+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~IJ5I5TIETKUU.0 size=1048576 2024-09-12T00:42:15.838 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.842+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~IJ5I5TIETKUU.1 size=1048576 2024-09-12T00:42:15.839 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.842+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~IJ5I5TIETKUU.2 size=576858 2024-09-12T00:42:15.839 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.842+0000 7fcde98768c0 1 > prepared multipart upload key=J9EUM073CZHF upload=IJ5I5TIETKUU tag=ISVE00F1D9ZX type=write size=3722586 2024-09-12T00:42:15.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.846+0000 7fcde98768c0 1 < completed delete operation key=2T5IU2IUNGJX tag=763UO5WX9JGR type=del 2024-09-12T00:42:15.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.846+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=UVQX0UEEJM37 type=del size=2745990 2024-09-12T00:42:15.846 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.850+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~6XSF0JI5H62C.0 size=1048576 2024-09-12T00:42:15.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.854+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~6XSF0JI5H62C.1 size=706441 2024-09-12T00:42:15.852 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.854+0000 7fcde98768c0 1 < completed multipart upload key=3X9I78PMR1HV upload=6XSF0JI5H62C tag=Q2JS0QMJML57 type=write size=2803593 2024-09-12T00:42:15.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.858+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=TCUJBSF64PEO type=del size=1919873 2024-09-12T00:42:15.857 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.862+0000 7fcde98768c0 1 < canceled operation key=TUMAMUZUIR7E tag=3QODDJFHB5TP type=del size=2280760 2024-09-12T00:42:15.860 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.866+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~31O6AVUNIU6K.0 size=1048576 2024-09-12T00:42:15.862 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.866+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~31O6AVUNIU6K.1 size=240750 2024-09-12T00:42:15.862 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.866+0000 7fcde98768c0 1 > prepared multipart upload key=ZQD0QXDN1J1I upload=31O6AVUNIU6K tag=FI446X5QBA4U type=write size=2337902 2024-09-12T00:42:15.865 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.870+0000 7fcde98768c0 1 < completed write operation key=J9EUM073CZHF tag=11QRJQ2ZN0DI type=write size=367911 2024-09-12T00:42:15.869 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.874+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~7UOYCGW0M0HA.0 size=84312 2024-09-12T00:42:15.869 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.874+0000 7fcde98768c0 1 > prepared multipart upload key=TUMAMUZUIR7E upload=7UOYCGW0M0HA tag=QFTVY295DH39 type=write size=1132888 2024-09-12T00:42:15.872 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.874+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~C6JUX1MXRSE2.0 size=1048576 2024-09-12T00:42:15.874 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.878+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~C6JUX1MXRSE2.1 size=1048576 2024-09-12T00:42:15.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.878+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~C6JUX1MXRSE2.2 size=857645 2024-09-12T00:42:15.879 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.882+0000 7fcde98768c0 1 < completed multipart upload key=TUMAMUZUIR7E upload=C6JUX1MXRSE2 tag=1C9HHLV10A1L type=write size=4003373 2024-09-12T00:42:15.882 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.886+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=690ANJOMDJPC type=del size=137396 2024-09-12T00:42:15.884 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.886+0000 7fcde98768c0 1 < completed delete operation key=BZ4YUNTMOJBK tag=O8I07QXRQVLC type=del 2024-09-12T00:42:15.886 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.890+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=PCG0VWQNK5XQ type=write size=881065 2024-09-12T00:42:15.889 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.894+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~302ZRVU4V4UC.0 size=1048576 2024-09-12T00:42:15.891 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.894+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~302ZRVU4V4UC.1 size=1048576 2024-09-12T00:42:15.893 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.898+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~302ZRVU4V4UC.2 size=709300 2024-09-12T00:42:15.897 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.902+0000 7fcde98768c0 1 < completed multipart upload key=F813QWV02TI0 upload=302ZRVU4V4UC tag=PTG9Y3GCVN47 type=write size=3855028 2024-09-12T00:42:15.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.902+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=1KUYWN2DSMDL type=write size=894411 2024-09-12T00:42:15.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.906+0000 7fcde98768c0 1 < completed delete operation key=2T5IU2IUNGJX tag=LFR5O818BPE9 type=del 2024-09-12T00:42:15.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.910+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=S4DQRM4KN6FZ type=del size=1261800 2024-09-12T00:42:15.911 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.914+0000 7fcde98768c0 1 < suggested remove operation key=G6R8BX1H7SPM tag=0SFNVT4CA1FA type=del 2024-09-12T00:42:15.914 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.918+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=7A0OXETE2ZSF type=del size=1201735 2024-09-12T00:42:15.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.918+0000 7fcde98768c0 -1 < failed to complete operation key=G6R8BX1H7SPM tag=HAP7SZBWYNYC type=del size=2926375: (22) Invalid argument 2024-09-12T00:42:15.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.926+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~PMH1EYS4Q2IW.0 size=1048576 2024-09-12T00:42:15.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.926+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~PMH1EYS4Q2IW.1 size=478535 2024-09-12T00:42:15.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.926+0000 7fcde98768c0 1 > prepared multipart upload key=ZQD0QXDN1J1I upload=PMH1EYS4Q2IW tag=KWGX6YSW2X1B type=write size=2575687 2024-09-12T00:42:15.925 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.930+0000 7fcde98768c0 1 < completed write operation key=5YBVLUYJW40U tag=TCD6WM51XC00 type=write size=991474 2024-09-12T00:42:15.927 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.930+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=DD6LHIUMQWZL type=del size=2953290 2024-09-12T00:42:15.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.934+0000 7fcde98768c0 -1 < failed to complete operation key=G6R8BX1H7SPM tag=V2MU55OGV38A type=del size=1510329: (22) Invalid argument 2024-09-12T00:42:15.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.934+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=OUFTIXBOS6P8 type=del size=1856585 2024-09-12T00:42:15.934 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.938+0000 7fcde98768c0 1 < completed delete operation key=J9EUM073CZHF tag=YM9YPTKJ8CFT type=del 2024-09-12T00:42:15.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.942+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~S45U2YBTQ7Q4.0 size=1048576 2024-09-12T00:42:15.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.946+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~S45U2YBTQ7Q4.1 size=1048576 2024-09-12T00:42:15.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.946+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~S45U2YBTQ7Q4.2 size=693218 2024-09-12T00:42:15.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.946+0000 7fcde98768c0 1 > prepared multipart upload key=EDFNLQYP4L4L upload=S45U2YBTQ7Q4 tag=R3AIEYKFGEE2 type=write size=3838946 2024-09-12T00:42:15.945 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.950+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~PJ7THG88DFWE.0 size=101753 2024-09-12T00:42:15.949 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.954+0000 7fcde98768c0 1 < completed multipart upload key=97030NBF3MI4 upload=PJ7THG88DFWE tag=861OQY61QRMW type=write size=1150329 2024-09-12T00:42:15.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.954+0000 7fcde98768c0 1 > prepared operation key=KME8ZTTUGOXY tag=PVZLCQX49KLI type=write size=1896 2024-09-12T00:42:15.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.958+0000 7fcde98768c0 1 < completed delete operation key=5B8C6E8L5N52 tag=HO8K72W7YQP8 type=del 2024-09-12T00:42:15.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.958+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=OMNXBU4VI006 type=del size=2365731 2024-09-12T00:42:15.958 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.962+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~IJ5I5TIETKUU.0 size=1048576 2024-09-12T00:42:15.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.962+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~IJ5I5TIETKUU.1 size=1048576 2024-09-12T00:42:15.961 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.966+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~IJ5I5TIETKUU.2 size=576858 2024-09-12T00:42:15.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.970+0000 7fcde98768c0 1 < completed multipart upload key=J9EUM073CZHF upload=IJ5I5TIETKUU tag=ISVE00F1D9ZX type=write size=3722586 2024-09-12T00:42:15.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.970+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=4KUUT6O2W2QN type=del size=3448709 2024-09-12T00:42:15.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.974+0000 7fcde98768c0 1 < completed delete operation key=WLE5QLNPAGZA tag=UVQX0UEEJM37 type=del 2024-09-12T00:42:15.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.978+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~HWLQ8QD4FJFE.0 size=1048576 2024-09-12T00:42:15.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.978+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~HWLQ8QD4FJFE.1 size=1048576 2024-09-12T00:42:15.976 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.978+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~HWLQ8QD4FJFE.2 size=748111 2024-09-12T00:42:15.976 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.978+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=HWLQ8QD4FJFE tag=G0R4MT6TEFL5 type=write size=3893839 2024-09-12T00:42:15.979 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.982+0000 7fcde98768c0 1 < completed delete operation key=J9EUM073CZHF tag=TCUJBSF64PEO type=del 2024-09-12T00:42:15.986 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.986+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=XAA7ATBYGS5V type=del size=2302322 2024-09-12T00:42:15.986 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.986+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~31O6AVUNIU6K.0 size=1048576 2024-09-12T00:42:15.986 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.990+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~31O6AVUNIU6K.1 size=240750 2024-09-12T00:42:15.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.994+0000 7fcde98768c0 1 < completed multipart upload key=ZQD0QXDN1J1I upload=31O6AVUNIU6K tag=FI446X5QBA4U type=write size=2337902 2024-09-12T00:42:15.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.994+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=3OLCJ6TIMXF0 type=del size=1071701 2024-09-12T00:42:15.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.994+0000 7fcde98768c0 1 < canceled part key=_multipart_TUMAMUZUIR7E.2~7UOYCGW0M0HA.0 size=84312 2024-09-12T00:42:15.995 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:15.998+0000 7fcde98768c0 1 < canceled multipart upload key=TUMAMUZUIR7E upload=7UOYCGW0M0HA tag=QFTVY295DH39 type=write size=1132888 2024-09-12T00:42:15.997 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.002+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=4F7U1I4CWI5C type=write size=860682 2024-09-12T00:42:15.999 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.002+0000 7fcde98768c0 1 < canceled operation key=3QOENE572J7A tag=690ANJOMDJPC type=del size=137396 2024-09-12T00:42:16.001 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.006+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=5J2P6C5MQOFS type=del size=3235689 2024-09-12T00:42:16.003 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.006+0000 7fcde98768c0 1 < completed write operation key=5YBVLUYJW40U tag=PCG0VWQNK5XQ type=write size=881065 2024-09-12T00:42:16.004 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.010+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=OUI0C6XJHVWV type=del size=43329 2024-09-12T00:42:16.008 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.010+0000 7fcde98768c0 1 < suggested remove operation key=EDFNLQYP4L4L tag=1KUYWN2DSMDL type=write 2024-09-12T00:42:16.010 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.014+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=AHJUGJTRKKWQ type=del size=2996558 2024-09-12T00:42:16.012 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.014+0000 7fcde98768c0 1 < canceled operation key=7UR0FX8HA2A5 tag=S4DQRM4KN6FZ type=del size=1261800 2024-09-12T00:42:16.016 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.018+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~FLG89EZWE1MG.0 size=1048576 2024-09-12T00:42:16.017 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.022+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~FLG89EZWE1MG.1 size=1048576 2024-09-12T00:42:16.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.022+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~FLG89EZWE1MG.2 size=272830 2024-09-12T00:42:16.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.022+0000 7fcde98768c0 1 > prepared multipart upload key=C6PW0ETP4BG2 upload=FLG89EZWE1MG tag=OG7Z3L9O7M3C type=write size=3418558 2024-09-12T00:42:16.021 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.026+0000 7fcde98768c0 1 < completed delete operation key=JW2GNFAYFNEK tag=7A0OXETE2ZSF type=del 2024-09-12T00:42:16.025 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.030+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~DNCCM8EAPH8W.0 size=363195 2024-09-12T00:42:16.025 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.030+0000 7fcde98768c0 1 > prepared multipart upload key=Z4RNDW37GEK6 upload=DNCCM8EAPH8W tag=RBP3VA3LOIBK type=write size=1411771 2024-09-12T00:42:16.025 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.030+0000 7fcde98768c0 1 < canceled part key=_multipart_ZQD0QXDN1J1I.2~PMH1EYS4Q2IW.0 size=1048576 2024-09-12T00:42:16.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.030+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~PMH1EYS4Q2IW.1 size=478535 2024-09-12T00:42:16.030 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.034+0000 7fcde98768c0 1 < canceled multipart upload key=ZQD0QXDN1J1I upload=PMH1EYS4Q2IW tag=KWGX6YSW2X1B type=write size=2575687 2024-09-12T00:42:16.032 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.034+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=JRESCSJKPECW type=write size=1019668 2024-09-12T00:42:16.034 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.038+0000 7fcde98768c0 1 < completed delete operation key=Z1PY2MFUC1C4 tag=DD6LHIUMQWZL type=del 2024-09-12T00:42:16.038 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.042+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~P4QSG42YF75G.0 size=1048576 2024-09-12T00:42:16.039 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.042+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~P4QSG42YF75G.1 size=869409 2024-09-12T00:42:16.039 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.042+0000 7fcde98768c0 1 > prepared multipart upload key=JW2GNFAYFNEK upload=P4QSG42YF75G tag=2E70XV9607F6 type=write size=2966561 2024-09-12T00:42:16.041 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.046+0000 7fcde98768c0 1 < canceled operation key=HVE3YQTFZWTV tag=OUFTIXBOS6P8 type=del size=1856585 2024-09-12T00:42:16.043 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.046+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=XOGQFM2GH9CN type=del size=1150943 2024-09-12T00:42:16.045 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.050+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~S45U2YBTQ7Q4.0 size=1048576 2024-09-12T00:42:16.047 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.050+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~S45U2YBTQ7Q4.1 size=1048576 2024-09-12T00:42:16.047 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.050+0000 7fcde98768c0 1 < canceled part key=_multipart_EDFNLQYP4L4L.2~S45U2YBTQ7Q4.2 size=693218 2024-09-12T00:42:16.050 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.054+0000 7fcde98768c0 1 < canceled multipart upload key=EDFNLQYP4L4L upload=S45U2YBTQ7Q4 tag=R3AIEYKFGEE2 type=write size=3838946 2024-09-12T00:42:16.054 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.058+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~T75A0O97JNOG.0 size=5490 2024-09-12T00:42:16.054 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.058+0000 7fcde98768c0 1 > prepared multipart upload key=ZQD0QXDN1J1I upload=T75A0O97JNOG tag=G09RNRQM50UW type=write size=1054066 2024-09-12T00:42:16.056 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.058+0000 7fcde98768c0 1 < completed write operation key=KME8ZTTUGOXY tag=PVZLCQX49KLI type=write size=1896 2024-09-12T00:42:16.058 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.062+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=5BGQ2WP5T32P type=del size=695477 2024-09-12T00:42:16.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.062+0000 7fcde98768c0 1 < completed delete operation key=F813QWV02TI0 tag=OMNXBU4VI006 type=del 2024-09-12T00:42:16.064 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.066+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~8509QCCZVR6I.0 size=1048576 2024-09-12T00:42:16.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.070+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~8509QCCZVR6I.1 size=534864 2024-09-12T00:42:16.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.070+0000 7fcde98768c0 1 > prepared multipart upload key=IMITNCB1ST9E upload=8509QCCZVR6I tag=KOIGP5QCWQJL type=write size=2632016 2024-09-12T00:42:16.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.074+0000 7fcde98768c0 1 < suggested update operation key=ZQD0QXDN1J1I tag=4KUUT6O2W2QN type=del size=3448709 2024-09-12T00:42:16.071 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.074+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=L8PR9GEA4YKT type=del size=3771957 2024-09-12T00:42:16.072 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.074+0000 7fcde98768c0 1 < canceled part key=_multipart_V80E1NH858IK.2~HWLQ8QD4FJFE.0 size=1048576 2024-09-12T00:42:16.073 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.078+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~HWLQ8QD4FJFE.1 size=1048576 2024-09-12T00:42:16.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.078+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~HWLQ8QD4FJFE.2 size=748111 2024-09-12T00:42:16.078 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.082+0000 7fcde98768c0 1 < canceled multipart upload key=V80E1NH858IK upload=HWLQ8QD4FJFE tag=G0R4MT6TEFL5 type=write size=3893839 2024-09-12T00:42:16.080 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.082+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=MCNXV9C96EFB type=del size=1587469 2024-09-12T00:42:16.082 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.086+0000 7fcde98768c0 1 < completed delete operation key=V80E1NH858IK tag=XAA7ATBYGS5V type=del 2024-09-12T00:42:16.084 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.086+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=XERGKA17YCAE type=write size=173256 2024-09-12T00:42:16.086 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.090+0000 7fcde98768c0 1 < completed delete operation key=4487IMSOLPDV tag=3OLCJ6TIMXF0 type=del 2024-09-12T00:42:16.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.094+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~YG4L03Q4TEZF.0 size=1048576 2024-09-12T00:42:16.092 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.094+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~YG4L03Q4TEZF.1 size=824186 2024-09-12T00:42:16.092 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.094+0000 7fcde98768c0 1 > prepared multipart upload key=ZQD0QXDN1J1I upload=YG4L03Q4TEZF tag=CP1Y7A86T0JT type=write size=2921338 2024-09-12T00:42:16.096 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.098+0000 7fcde98768c0 1 < suggested remove operation key=HVE3YQTFZWTV tag=4F7U1I4CWI5C type=write 2024-09-12T00:42:16.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.102+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=XCI1BIP2NFYS type=write size=188777 2024-09-12T00:42:16.100 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.102+0000 7fcde98768c0 -1 < failed to complete operation key=HVE3YQTFZWTV tag=5J2P6C5MQOFS type=del size=3235689: (22) Invalid argument 2024-09-12T00:42:16.102 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.106+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=WDZA30GTD71B type=del size=3336741 2024-09-12T00:42:16.107 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.110+0000 7fcde98768c0 -1 < failed to complete operation key=EDFNLQYP4L4L tag=OUI0C6XJHVWV type=del size=43329: (22) Invalid argument 2024-09-12T00:42:16.110 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.114+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=ZNDF7ID9YFI4 type=write size=738100 2024-09-12T00:42:16.112 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.114+0000 7fcde98768c0 1 < completed delete operation key=3QOENE572J7A tag=AHJUGJTRKKWQ type=del 2024-09-12T00:42:16.114 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.118+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=A9J3YJJRMR5L type=write size=966925 2024-09-12T00:42:16.116 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.118+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~FLG89EZWE1MG.0 size=1048576 2024-09-12T00:42:16.118 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.122+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~FLG89EZWE1MG.1 size=1048576 2024-09-12T00:42:16.119 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.122+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~FLG89EZWE1MG.2 size=272830 2024-09-12T00:42:16.123 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.126+0000 7fcde98768c0 1 < completed multipart upload key=C6PW0ETP4BG2 upload=FLG89EZWE1MG tag=OG7Z3L9O7M3C type=write size=3418558 2024-09-12T00:42:16.125 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.130+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=65HAITIF76MM type=write size=515068 2024-09-12T00:42:16.127 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.130+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~DNCCM8EAPH8W.0 size=363195 2024-09-12T00:42:16.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.134+0000 7fcde98768c0 1 < completed multipart upload key=Z4RNDW37GEK6 upload=DNCCM8EAPH8W tag=RBP3VA3LOIBK type=write size=1411771 2024-09-12T00:42:16.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.134+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=X8PCW4X606JP type=del size=1922833 2024-09-12T00:42:16.134 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.138+0000 7fcde98768c0 1 < completed write operation key=7UR0FX8HA2A5 tag=JRESCSJKPECW type=write size=1019668 2024-09-12T00:42:16.136 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.138+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=4FH7BJ3XG1QC type=write size=421939 2024-09-12T00:42:16.138 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.142+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~P4QSG42YF75G.0 size=1048576 2024-09-12T00:42:16.138 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.142+0000 7fcde98768c0 1 < canceled part key=_multipart_JW2GNFAYFNEK.2~P4QSG42YF75G.1 size=869409 2024-09-12T00:42:16.141 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.146+0000 7fcde98768c0 1 < canceled multipart upload key=JW2GNFAYFNEK upload=P4QSG42YF75G tag=2E70XV9607F6 type=write size=2966561 2024-09-12T00:42:16.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.146+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~GTGAYVMZLVWF.0 size=1048576 2024-09-12T00:42:16.146 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.150+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~GTGAYVMZLVWF.1 size=596898 2024-09-12T00:42:16.146 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.150+0000 7fcde98768c0 1 > prepared multipart upload key=3QOENE572J7A upload=GTGAYVMZLVWF tag=KPUPW4MBHJZC type=write size=2694050 2024-09-12T00:42:16.149 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.154+0000 7fcde98768c0 1 < suggested remove operation key=WLE5QLNPAGZA tag=XOGQFM2GH9CN type=del 2024-09-12T00:42:16.152 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.154+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~J14BZ60IHWFM.0 size=1048576 2024-09-12T00:42:16.154 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.158+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~J14BZ60IHWFM.1 size=1048576 2024-09-12T00:42:16.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.158+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~J14BZ60IHWFM.2 size=688022 2024-09-12T00:42:16.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.158+0000 7fcde98768c0 1 > prepared multipart upload key=WLE5QLNPAGZA upload=J14BZ60IHWFM tag=3BNL4RU3H4J4 type=write size=3833750 2024-09-12T00:42:16.157 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.162+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~T75A0O97JNOG.0 size=5490 2024-09-12T00:42:16.159 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.162+0000 7fcde98768c0 1 < completed multipart upload key=ZQD0QXDN1J1I upload=T75A0O97JNOG tag=G09RNRQM50UW type=write size=1054066 2024-09-12T00:42:16.162 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.166+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~7N01ZF9OFCZ8.0 size=489460 2024-09-12T00:42:16.162 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.166+0000 7fcde98768c0 1 > prepared multipart upload key=2T5IU2IUNGJX upload=7N01ZF9OFCZ8 tag=Z5ZFJ99K76E9 type=write size=1538036 2024-09-12T00:42:16.164 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.166+0000 7fcde98768c0 1 < canceled operation key=7UR0FX8HA2A5 tag=5BGQ2WP5T32P type=del size=695477 2024-09-12T00:42:16.167 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.170+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~EF6J2KEE4MXP.0 size=725968 2024-09-12T00:42:16.167 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.170+0000 7fcde98768c0 1 > prepared multipart upload key=3QOENE572J7A upload=EF6J2KEE4MXP tag=8Z33ZUMPZDNB type=write size=1774544 2024-09-12T00:42:16.169 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.174+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~8509QCCZVR6I.0 size=1048576 2024-09-12T00:42:16.171 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.174+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~8509QCCZVR6I.1 size=534864 2024-09-12T00:42:16.173 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.178+0000 7fcde98768c0 1 < completed multipart upload key=IMITNCB1ST9E upload=8509QCCZVR6I tag=KOIGP5QCWQJL type=write size=2632016 2024-09-12T00:42:16.175 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.178+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=E8VSJQZK1XF7 type=write size=978211 2024-09-12T00:42:16.178 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.182+0000 7fcde98768c0 1 < suggested update operation key=NVOFV649MT0A tag=L8PR9GEA4YKT type=del size=3771957 2024-09-12T00:42:16.181 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.186+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=2ZEOBIRC5JRW type=write size=319411 2024-09-12T00:42:16.182 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.186+0000 7fcde98768c0 1 < completed delete operation key=IMITNCB1ST9E tag=MCNXV9C96EFB type=del 2024-09-12T00:42:16.189 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.190+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~70206HE359HX.0 size=318879 2024-09-12T00:42:16.189 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.190+0000 7fcde98768c0 1 > prepared multipart upload key=C6PW0ETP4BG2 upload=70206HE359HX tag=G00NOB6Q8GBT type=write size=1367455 2024-09-12T00:42:16.189 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.190+0000 7fcde98768c0 1 < completed write operation key=3QOENE572J7A tag=XERGKA17YCAE type=write size=173256 2024-09-12T00:42:16.189 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.194+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=3RHMV9G8WPEQ type=del size=112969 2024-09-12T00:42:16.190 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.194+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~YG4L03Q4TEZF.0 size=1048576 2024-09-12T00:42:16.192 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.194+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~YG4L03Q4TEZF.1 size=824186 2024-09-12T00:42:16.195 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.198+0000 7fcde98768c0 1 < completed multipart upload key=ZQD0QXDN1J1I upload=YG4L03Q4TEZF tag=CP1Y7A86T0JT type=write size=2921338 2024-09-12T00:42:16.198 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.202+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~FUYT9A27XTHJ.0 size=16139 2024-09-12T00:42:16.198 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.202+0000 7fcde98768c0 1 > prepared multipart upload key=HVE3YQTFZWTV upload=FUYT9A27XTHJ tag=9HG5MUIABEQK type=write size=1064715 2024-09-12T00:42:16.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.202+0000 7fcde98768c0 1 < canceled operation key=HVE3YQTFZWTV tag=XCI1BIP2NFYS type=write size=188777 2024-09-12T00:42:16.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.206+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=QZJQEO5TB7IU type=del size=2155109 2024-09-12T00:42:16.204 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.206+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=WDZA30GTD71B type=del 2024-09-12T00:42:16.207 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.210+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=JYCCDCUXCQDS type=write size=494020 2024-09-12T00:42:16.208 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.210+0000 7fcde98768c0 1 < completed write operation key=Z1PY2MFUC1C4 tag=ZNDF7ID9YFI4 type=write size=738100 2024-09-12T00:42:16.210 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.214+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=L25QGYSQVH6E type=del size=1646875 2024-09-12T00:42:16.212 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.214+0000 7fcde98768c0 1 < completed write operation key=5B8C6E8L5N52 tag=A9J3YJJRMR5L type=write size=966925 2024-09-12T00:42:16.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.218+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=RYEXOVX3PK61 type=write size=613467 2024-09-12T00:42:16.216 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.218+0000 7fcde98768c0 1 < completed write operation key=97030NBF3MI4 tag=65HAITIF76MM type=write size=515068 2024-09-12T00:42:16.218 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.222+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=A8W4OH8IBXB7 type=del size=3913940 2024-09-12T00:42:16.220 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.222+0000 7fcde98768c0 1 < completed delete operation key=ZQD0QXDN1J1I tag=X8PCW4X606JP type=del 2024-09-12T00:42:16.224 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.226+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~YH4EITZC5SBZ.0 size=1048576 2024-09-12T00:42:16.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.230+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~YH4EITZC5SBZ.1 size=159996 2024-09-12T00:42:16.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.230+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=YH4EITZC5SBZ tag=92M1QDL1X3T4 type=write size=2257148 2024-09-12T00:42:16.228 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.230+0000 7fcde98768c0 1 < completed write operation key=3X9I78PMR1HV tag=4FH7BJ3XG1QC type=write size=421939 2024-09-12T00:42:16.230 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.234+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=198VDOCZLPUR type=del size=1688633 2024-09-12T00:42:16.233 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.238+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~GTGAYVMZLVWF.0 size=1048576 2024-09-12T00:42:16.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.238+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~GTGAYVMZLVWF.1 size=596898 2024-09-12T00:42:16.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.242+0000 7fcde98768c0 1 < completed multipart upload key=3QOENE572J7A upload=GTGAYVMZLVWF tag=KPUPW4MBHJZC type=write size=2694050 2024-09-12T00:42:16.241 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.246+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=T4SW9IS0AB0W type=del size=191375 2024-09-12T00:42:16.243 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.246+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~J14BZ60IHWFM.0 size=1048576 2024-09-12T00:42:16.245 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.250+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~J14BZ60IHWFM.1 size=1048576 2024-09-12T00:42:16.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.250+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~J14BZ60IHWFM.2 size=688022 2024-09-12T00:42:16.249 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.254+0000 7fcde98768c0 1 < completed multipart upload key=WLE5QLNPAGZA upload=J14BZ60IHWFM tag=3BNL4RU3H4J4 type=write size=3833750 2024-09-12T00:42:16.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.258+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~BH9RH3XE1QI3.0 size=1048576 2024-09-12T00:42:16.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.258+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~BH9RH3XE1QI3.1 size=1048576 2024-09-12T00:42:16.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.258+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~BH9RH3XE1QI3.2 size=891127 2024-09-12T00:42:16.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.258+0000 7fcde98768c0 1 > prepared multipart upload key=3QOENE572J7A upload=BH9RH3XE1QI3 tag=OGX8C67XTHD6 type=write size=4036855 2024-09-12T00:42:16.258 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.262+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~7N01ZF9OFCZ8.0 size=489460 2024-09-12T00:42:16.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.266+0000 7fcde98768c0 1 < completed multipart upload key=2T5IU2IUNGJX upload=7N01ZF9OFCZ8 tag=Z5ZFJ99K76E9 type=write size=1538036 2024-09-12T00:42:16.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.266+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=IASTT0DVP9CW type=del size=3249881 2024-09-12T00:42:16.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.270+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~EF6J2KEE4MXP.0 size=725968 2024-09-12T00:42:16.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.270+0000 7fcde98768c0 1 < completed multipart upload key=3QOENE572J7A upload=EF6J2KEE4MXP tag=8Z33ZUMPZDNB type=write size=1774544 2024-09-12T00:42:16.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.274+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=PZPSK76EK0ZG type=write size=321119 2024-09-12T00:42:16.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.278+0000 7fcde98768c0 1 < suggested remove operation key=97030NBF3MI4 tag=E8VSJQZK1XF7 type=write 2024-09-12T00:42:16.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.278+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=GKNA20DEKTQF type=write size=830473 2024-09-12T00:42:16.280 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.282+0000 7fcde98768c0 1 < suggested remove operation key=Z1PY2MFUC1C4 tag=2ZEOBIRC5JRW type=write 2024-09-12T00:42:16.282 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.286+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=3A253ZK6IIQV type=write size=157658 2024-09-12T00:42:16.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.286+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~70206HE359HX.0 size=318879 2024-09-12T00:42:16.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.294+0000 7fcde98768c0 1 < completed multipart upload key=C6PW0ETP4BG2 upload=70206HE359HX tag=G00NOB6Q8GBT type=write size=1367455 2024-09-12T00:42:16.291 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.294+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=42UHM2RKXEIJ type=write size=472208 2024-09-12T00:42:16.293 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.298+0000 7fcde98768c0 1 < completed delete operation key=R2EBH0Q5885L tag=3RHMV9G8WPEQ type=del 2024-09-12T00:42:16.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.302+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~YXK6LRZBHNHN.0 size=1048576 2024-09-12T00:42:16.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.302+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~YXK6LRZBHNHN.1 size=14408 2024-09-12T00:42:16.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.302+0000 7fcde98768c0 1 > prepared multipart upload key=C6PW0ETP4BG2 upload=YXK6LRZBHNHN tag=EKQA2KPQLIQ1 type=write size=2111560 2024-09-12T00:42:16.300 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.302+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~FUYT9A27XTHJ.0 size=16139 2024-09-12T00:42:16.303 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.306+0000 7fcde98768c0 1 < completed multipart upload key=HVE3YQTFZWTV upload=FUYT9A27XTHJ tag=9HG5MUIABEQK type=write size=1064715 2024-09-12T00:42:16.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.310+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~25GOOPNR3YDS.0 size=127619 2024-09-12T00:42:16.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.310+0000 7fcde98768c0 1 > prepared multipart upload key=368TXYQVK9C3 upload=25GOOPNR3YDS tag=NP9QIVD2N3DM type=write size=1176195 2024-09-12T00:42:16.308 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.310+0000 7fcde98768c0 1 < completed delete operation key=QD5JXFL962R5 tag=QZJQEO5TB7IU type=del 2024-09-12T00:42:16.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.314+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~WMMEF2BH63PY.0 size=1048576 2024-09-12T00:42:16.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.318+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~WMMEF2BH63PY.1 size=1048576 2024-09-12T00:42:16.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.318+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~WMMEF2BH63PY.2 size=566274 2024-09-12T00:42:16.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.318+0000 7fcde98768c0 1 > prepared multipart upload key=3QOENE572J7A upload=WMMEF2BH63PY tag=EWCV60SOFHP0 type=write size=3712002 2024-09-12T00:42:16.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.321+0000 7fcde98768c0 1 < completed write operation key=TUMAMUZUIR7E tag=JYCCDCUXCQDS type=write size=494020 2024-09-12T00:42:16.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.325+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~HN4681380AO5.0 size=633142 2024-09-12T00:42:16.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.325+0000 7fcde98768c0 1 > prepared multipart upload key=JW2GNFAYFNEK upload=HN4681380AO5 tag=H6MQZ7ZMFOHT type=write size=1681718 2024-09-12T00:42:16.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.325+0000 7fcde98768c0 1 < completed delete operation key=IV4JCE1QJC70 tag=L25QGYSQVH6E type=del 2024-09-12T00:42:16.325 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.329+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=ST6KGR3BQ153 type=del size=3412016 2024-09-12T00:42:16.327 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.329+0000 7fcde98768c0 1 < completed write operation key=F813QWV02TI0 tag=RYEXOVX3PK61 type=write size=613467 2024-09-12T00:42:16.331 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.333+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~YD6GITU60BBE.0 size=1048576 2024-09-12T00:42:16.332 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.333+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~YD6GITU60BBE.1 size=1048576 2024-09-12T00:42:16.334 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.337+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~YD6GITU60BBE.2 size=985050 2024-09-12T00:42:16.334 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.337+0000 7fcde98768c0 1 > prepared multipart upload key=R2EBH0Q5885L upload=YD6GITU60BBE tag=UCRXJ7A1OQM2 type=write size=4130778 2024-09-12T00:42:16.338 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.341+0000 7fcde98768c0 1 < suggested update operation key=WLE5QLNPAGZA tag=A8W4OH8IBXB7 type=del size=3913940 2024-09-12T00:42:16.342 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.345+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~PN9UNT4TVH01.0 size=1048576 2024-09-12T00:42:16.343 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.345+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~PN9UNT4TVH01.1 size=1048576 2024-09-12T00:42:16.345 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.349+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~PN9UNT4TVH01.2 size=1008744 2024-09-12T00:42:16.345 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.349+0000 7fcde98768c0 1 > prepared multipart upload key=C6PW0ETP4BG2 upload=PN9UNT4TVH01 tag=8063FFNBKN3T type=write size=4154472 2024-09-12T00:42:16.347 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.349+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~YH4EITZC5SBZ.0 size=1048576 2024-09-12T00:42:16.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.349+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~YH4EITZC5SBZ.1 size=159996 2024-09-12T00:42:16.351 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.353+0000 7fcde98768c0 1 < completed multipart upload key=IV4JCE1QJC70 upload=YH4EITZC5SBZ tag=92M1QDL1X3T4 type=write size=2257148 2024-09-12T00:42:16.355 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.357+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~9SCAS707AT09.0 size=84798 2024-09-12T00:42:16.355 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.357+0000 7fcde98768c0 1 > prepared multipart upload key=RC9A2Y5TCP9C upload=9SCAS707AT09 tag=CPUYBFIUEBOZ type=write size=1133374 2024-09-12T00:42:16.357 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.361+0000 7fcde98768c0 1 < completed delete operation key=IV4JCE1QJC70 tag=198VDOCZLPUR type=del 2024-09-12T00:42:16.359 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.361+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=S9FR6LLT11DT type=del size=1768527 2024-09-12T00:42:16.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.365+0000 7fcde98768c0 1 < completed delete operation key=V80E1NH858IK tag=T4SW9IS0AB0W type=del 2024-09-12T00:42:16.364 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.365+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~R5B0XO9SP0HX.0 size=220064 2024-09-12T00:42:16.364 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.365+0000 7fcde98768c0 1 > prepared multipart upload key=Z1PY2MFUC1C4 upload=R5B0XO9SP0HX tag=DYPLY9LGWXVQ type=write size=1268640 2024-09-12T00:42:16.366 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.369+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~BH9RH3XE1QI3.0 size=1048576 2024-09-12T00:42:16.366 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.369+0000 7fcde98768c0 1 < canceled part key=_multipart_3QOENE572J7A.2~BH9RH3XE1QI3.1 size=1048576 2024-09-12T00:42:16.367 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.369+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~BH9RH3XE1QI3.2 size=891127 2024-09-12T00:42:16.371 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.373+0000 7fcde98768c0 1 < canceled multipart upload key=3QOENE572J7A upload=BH9RH3XE1QI3 tag=OGX8C67XTHD6 type=write size=4036855 2024-09-12T00:42:16.375 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.377+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~FXVQMJIJB6R0.0 size=1048576 2024-09-12T00:42:16.377 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.381+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~FXVQMJIJB6R0.1 size=304479 2024-09-12T00:42:16.377 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.381+0000 7fcde98768c0 1 > prepared multipart upload key=4487IMSOLPDV upload=FXVQMJIJB6R0 tag=2O8V3AQVY8OB type=write size=2401631 2024-09-12T00:42:16.379 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.381+0000 7fcde98768c0 1 < completed delete operation key=TUMAMUZUIR7E tag=IASTT0DVP9CW type=del 2024-09-12T00:42:16.383 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.385+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~DABQFOZZ2YEL.0 size=331817 2024-09-12T00:42:16.383 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.385+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=DABQFOZZ2YEL tag=KVM62O72D5NJ type=write size=1380393 2024-09-12T00:42:16.386 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.389+0000 7fcde98768c0 1 < completed write operation key=EDFNLQYP4L4L tag=PZPSK76EK0ZG type=write size=321119 2024-09-12T00:42:16.389 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.393+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~WM5I16FV1SDF.0 size=998911 2024-09-12T00:42:16.390 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.393+0000 7fcde98768c0 1 > prepared multipart upload key=97030NBF3MI4 upload=WM5I16FV1SDF tag=TIGP0FN3G24Y type=write size=2047487 2024-09-12T00:42:16.391 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.393+0000 7fcde98768c0 1 < completed write operation key=HVE3YQTFZWTV tag=GKNA20DEKTQF type=write size=830473 2024-09-12T00:42:16.393 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.397+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=LRBEFXKB90JM type=write size=951747 2024-09-12T00:42:16.397 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.401+0000 7fcde98768c0 1 < suggested remove operation key=IV4JCE1QJC70 tag=3A253ZK6IIQV type=write 2024-09-12T00:42:16.400 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.405+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~PTUJ8SVWB15P.0 size=1048576 2024-09-12T00:42:16.402 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.405+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~PTUJ8SVWB15P.1 size=756368 2024-09-12T00:42:16.402 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.405+0000 7fcde98768c0 1 > prepared multipart upload key=R2EBH0Q5885L upload=PTUJ8SVWB15P tag=K8Q56W5CXG23 type=write size=2853520 2024-09-12T00:42:16.404 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.405+0000 7fcde98768c0 1 < canceled operation key=Z4RNDW37GEK6 tag=42UHM2RKXEIJ type=write size=472208 2024-09-12T00:42:16.406 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.409+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=F98CJPFUK8WL type=del size=3168665 2024-09-12T00:42:16.408 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.409+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~YXK6LRZBHNHN.0 size=1048576 2024-09-12T00:42:16.408 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.409+0000 7fcde98768c0 1 < canceled part key=_multipart_C6PW0ETP4BG2.2~YXK6LRZBHNHN.1 size=14408 2024-09-12T00:42:16.411 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.413+0000 7fcde98768c0 1 < canceled multipart upload key=C6PW0ETP4BG2 upload=YXK6LRZBHNHN tag=EKQA2KPQLIQ1 type=write size=2111560 2024-09-12T00:42:16.413 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.417+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=UQ36T252OHAJ type=write size=654281 2024-09-12T00:42:16.415 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.417+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~25GOOPNR3YDS.0 size=127619 2024-09-12T00:42:16.418 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.421+0000 7fcde98768c0 1 < completed multipart upload key=368TXYQVK9C3 upload=25GOOPNR3YDS tag=NP9QIVD2N3DM type=write size=1176195 2024-09-12T00:42:16.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.421+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=4I0T3XOIWGVS type=del size=345704 2024-09-12T00:42:16.422 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.425+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~WMMEF2BH63PY.0 size=1048576 2024-09-12T00:42:16.424 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.425+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~WMMEF2BH63PY.1 size=1048576 2024-09-12T00:42:16.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.429+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~WMMEF2BH63PY.2 size=566274 2024-09-12T00:42:16.429 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.433+0000 7fcde98768c0 1 < completed multipart upload key=3QOENE572J7A upload=WMMEF2BH63PY tag=EWCV60SOFHP0 type=write size=3712002 2024-09-12T00:42:16.433 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.437+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~O6M67X4M3F1C.0 size=490968 2024-09-12T00:42:16.433 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.437+0000 7fcde98768c0 1 > prepared multipart upload key=JW2GNFAYFNEK upload=O6M67X4M3F1C tag=T0RDOPQOR0ER type=write size=1539544 2024-09-12T00:42:16.433 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.437+0000 7fcde98768c0 1 < canceled part key=_multipart_JW2GNFAYFNEK.2~HN4681380AO5.0 size=633142 2024-09-12T00:42:16.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.441+0000 7fcde98768c0 1 < canceled multipart upload key=JW2GNFAYFNEK upload=HN4681380AO5 tag=H6MQZ7ZMFOHT type=write size=1681718 2024-09-12T00:42:16.438 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.441+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=NY268MKWBXFU type=write size=900958 2024-09-12T00:42:16.443 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.445+0000 7fcde98768c0 1 < suggested update operation key=2T5IU2IUNGJX tag=ST6KGR3BQ153 type=del size=3412016 2024-09-12T00:42:16.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.449+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~W7DB7MESGU1Q.0 size=1048576 2024-09-12T00:42:16.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.449+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~W7DB7MESGU1Q.1 size=875235 2024-09-12T00:42:16.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.449+0000 7fcde98768c0 1 > prepared multipart upload key=WLE5QLNPAGZA upload=W7DB7MESGU1Q tag=1SPWJZYEYRBR type=write size=2972387 2024-09-12T00:42:16.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.453+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~YD6GITU60BBE.0 size=1048576 2024-09-12T00:42:16.452 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.453+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~YD6GITU60BBE.1 size=1048576 2024-09-12T00:42:16.454 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.457+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~YD6GITU60BBE.2 size=985050 2024-09-12T00:42:16.457 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.461+0000 7fcde98768c0 1 < completed multipart upload key=R2EBH0Q5885L upload=YD6GITU60BBE tag=UCRXJ7A1OQM2 type=write size=4130778 2024-09-12T00:42:16.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.465+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~485AIGHXEPEC.0 size=116439 2024-09-12T00:42:16.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.465+0000 7fcde98768c0 1 > prepared multipart upload key=4487IMSOLPDV upload=485AIGHXEPEC tag=6HSQ005EOEAI type=write size=1165015 2024-09-12T00:42:16.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.465+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~PN9UNT4TVH01.0 size=1048576 2024-09-12T00:42:16.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.469+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~PN9UNT4TVH01.1 size=1048576 2024-09-12T00:42:16.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.469+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~PN9UNT4TVH01.2 size=1008744 2024-09-12T00:42:16.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.473+0000 7fcde98768c0 1 < completed multipart upload key=C6PW0ETP4BG2 upload=PN9UNT4TVH01 tag=8063FFNBKN3T type=write size=4154472 2024-09-12T00:42:16.476 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.477+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~YWJHU1MB4YX4.0 size=61437 2024-09-12T00:42:16.476 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.477+0000 7fcde98768c0 1 > prepared multipart upload key=TUMAMUZUIR7E upload=YWJHU1MB4YX4 tag=94OAMIKP23YF type=write size=1110013 2024-09-12T00:42:16.478 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.481+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~9SCAS707AT09.0 size=84798 2024-09-12T00:42:16.481 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.485+0000 7fcde98768c0 1 < completed multipart upload key=RC9A2Y5TCP9C upload=9SCAS707AT09 tag=CPUYBFIUEBOZ type=write size=1133374 2024-09-12T00:42:16.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.489+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~J3MWUQNRXW5X.0 size=1048576 2024-09-12T00:42:16.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.489+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~J3MWUQNRXW5X.1 size=703127 2024-09-12T00:42:16.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.489+0000 7fcde98768c0 1 > prepared multipart upload key=FUJIUIR1E00J upload=J3MWUQNRXW5X tag=O0JRSK6T44OA type=write size=2800279 2024-09-12T00:42:16.490 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.493+0000 7fcde98768c0 1 < canceled operation key=Z1PY2MFUC1C4 tag=S9FR6LLT11DT type=del size=1768527 2024-09-12T00:42:16.493 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.497+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~A0I988S7LP57.0 size=1048576 2024-09-12T00:42:16.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.497+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~A0I988S7LP57.1 size=1048576 2024-09-12T00:42:16.497 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.501+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~A0I988S7LP57.2 size=681952 2024-09-12T00:42:16.497 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.501+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=A0I988S7LP57 tag=USRS6I2GEH62 type=write size=3827680 2024-09-12T00:42:16.499 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.501+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~R5B0XO9SP0HX.0 size=220064 2024-09-12T00:42:16.503 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.505+0000 7fcde98768c0 1 < completed multipart upload key=Z1PY2MFUC1C4 upload=R5B0XO9SP0HX tag=DYPLY9LGWXVQ type=write size=1268640 2024-09-12T00:42:16.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.509+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~KMZGYET2TCDY.0 size=75458 2024-09-12T00:42:16.507 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.509+0000 7fcde98768c0 1 > prepared multipart upload key=KME8ZTTUGOXY upload=KMZGYET2TCDY tag=OD3814RMIK68 type=write size=1124034 2024-09-12T00:42:16.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.513+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~FXVQMJIJB6R0.0 size=1048576 2024-09-12T00:42:16.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.513+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~FXVQMJIJB6R0.1 size=304479 2024-09-12T00:42:16.513 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.517+0000 7fcde98768c0 1 < completed multipart upload key=4487IMSOLPDV upload=FXVQMJIJB6R0 tag=2O8V3AQVY8OB type=write size=2401631 2024-09-12T00:42:16.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.517+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=VTQ5GOF9FIZJ type=del size=738613 2024-09-12T00:42:16.518 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.521+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~DABQFOZZ2YEL.0 size=331817 2024-09-12T00:42:16.521 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.525+0000 7fcde98768c0 1 < completed multipart upload key=BZ4YUNTMOJBK upload=DABQFOZZ2YEL tag=KVM62O72D5NJ type=write size=1380393 2024-09-12T00:42:16.523 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.525+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=K83JZSRSC5RB type=del size=1779592 2024-09-12T00:42:16.524 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.525+0000 7fcde98768c0 1 < canceled part key=_multipart_97030NBF3MI4.2~WM5I16FV1SDF.0 size=998911 2024-09-12T00:42:16.527 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.529+0000 7fcde98768c0 1 < canceled multipart upload key=97030NBF3MI4 upload=WM5I16FV1SDF tag=TIGP0FN3G24Y type=write size=2047487 2024-09-12T00:42:16.529 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.533+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=ANWFJDTVXA1Q type=del size=2140974 2024-09-12T00:42:16.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.533+0000 7fcde98768c0 1 < completed write operation key=WLE5QLNPAGZA tag=LRBEFXKB90JM type=write size=951747 2024-09-12T00:42:16.533 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.537+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=IAIWKUK2FU7P type=del size=2703793 2024-09-12T00:42:16.535 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.537+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~PTUJ8SVWB15P.0 size=1048576 2024-09-12T00:42:16.538 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.541+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~PTUJ8SVWB15P.1 size=756368 2024-09-12T00:42:16.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.545+0000 7fcde98768c0 1 < completed multipart upload key=R2EBH0Q5885L upload=PTUJ8SVWB15P tag=K8Q56W5CXG23 type=write size=2853520 2024-09-12T00:42:16.543 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.545+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=R8L074MT60K6 type=write size=737805 2024-09-12T00:42:16.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.549+0000 7fcde98768c0 1 < completed delete operation key=IV4JCE1QJC70 tag=F98CJPFUK8WL type=del 2024-09-12T00:42:16.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.553+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~O4VR5WZGMXSR.0 size=220838 2024-09-12T00:42:16.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.553+0000 7fcde98768c0 1 > prepared multipart upload key=97030NBF3MI4 upload=O4VR5WZGMXSR tag=C6X3GZSQR3PT type=write size=1269414 2024-09-12T00:42:16.551 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.553+0000 7fcde98768c0 1 < completed write operation key=3X9I78PMR1HV tag=UQ36T252OHAJ type=write size=654281 2024-09-12T00:42:16.553 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.557+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=UMEZ7IS4UO3H type=del size=1772302 2024-09-12T00:42:16.555 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.557+0000 7fcde98768c0 1 < completed delete operation key=BZ4YUNTMOJBK tag=4I0T3XOIWGVS type=del 2024-09-12T00:42:16.557 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.561+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=HW8NU5A36U49 type=del size=2620585 2024-09-12T00:42:16.559 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.561+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~O6M67X4M3F1C.0 size=490968 2024-09-12T00:42:16.563 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.565+0000 7fcde98768c0 1 < completed multipart upload key=JW2GNFAYFNEK upload=O6M67X4M3F1C tag=T0RDOPQOR0ER type=write size=1539544 2024-09-12T00:42:16.565 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.569+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=JSPKQ19Y6ZBM type=del size=45093 2024-09-12T00:42:16.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.569+0000 7fcde98768c0 1 < completed write operation key=FUJIUIR1E00J tag=NY268MKWBXFU type=write size=900958 2024-09-12T00:42:16.571 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.573+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~SGR4VODFNE8I.0 size=1048390 2024-09-12T00:42:16.571 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.573+0000 7fcde98768c0 1 > prepared multipart upload key=4487IMSOLPDV upload=SGR4VODFNE8I tag=4T1UJYG6TJ2U type=write size=2096966 2024-09-12T00:42:16.573 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.577+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~W7DB7MESGU1Q.0 size=1048576 2024-09-12T00:42:16.575 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.577+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~W7DB7MESGU1Q.1 size=875235 2024-09-12T00:42:16.579 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.581+0000 7fcde98768c0 1 < completed multipart upload key=WLE5QLNPAGZA upload=W7DB7MESGU1Q tag=1SPWJZYEYRBR type=write size=2972387 2024-09-12T00:42:16.581 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.585+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=CUD254M33BF0 type=del size=3371482 2024-09-12T00:42:16.583 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.585+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~485AIGHXEPEC.0 size=116439 2024-09-12T00:42:16.587 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.589+0000 7fcde98768c0 1 < completed multipart upload key=4487IMSOLPDV upload=485AIGHXEPEC tag=6HSQ005EOEAI type=write size=1165015 2024-09-12T00:42:16.589 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.593+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=VGAJORLPX40B type=del size=3333704 2024-09-12T00:42:16.591 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.593+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~YWJHU1MB4YX4.0 size=61437 2024-09-12T00:42:16.595 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.597+0000 7fcde98768c0 1 < completed multipart upload key=TUMAMUZUIR7E upload=YWJHU1MB4YX4 tag=94OAMIKP23YF type=write size=1110013 2024-09-12T00:42:16.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.601+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=U82MJSR2HNRK type=write size=438446 2024-09-12T00:42:16.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.601+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~J3MWUQNRXW5X.0 size=1048576 2024-09-12T00:42:16.602 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.605+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~J3MWUQNRXW5X.1 size=703127 2024-09-12T00:42:16.606 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.609+0000 7fcde98768c0 1 < completed multipart upload key=FUJIUIR1E00J upload=J3MWUQNRXW5X tag=O0JRSK6T44OA type=write size=2800279 2024-09-12T00:42:16.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.609+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=IY7B1QUNR4F5 type=del size=2651310 2024-09-12T00:42:16.611 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.613+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~A0I988S7LP57.0 size=1048576 2024-09-12T00:42:16.613 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.617+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~A0I988S7LP57.1 size=1048576 2024-09-12T00:42:16.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.617+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~A0I988S7LP57.2 size=681952 2024-09-12T00:42:16.619 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.621+0000 7fcde98768c0 1 < completed multipart upload key=IV4JCE1QJC70 upload=A0I988S7LP57 tag=USRS6I2GEH62 type=write size=3827680 2024-09-12T00:42:16.623 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.625+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~RANY5YAPX17D.0 size=351808 2024-09-12T00:42:16.623 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.625+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=RANY5YAPX17D tag=VZ0S529YTZAB type=write size=1400384 2024-09-12T00:42:16.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.629+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~KMZGYET2TCDY.0 size=75458 2024-09-12T00:42:16.628 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.633+0000 7fcde98768c0 1 < completed multipart upload key=KME8ZTTUGOXY upload=KMZGYET2TCDY tag=OD3814RMIK68 type=write size=1124034 2024-09-12T00:42:16.631 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.633+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=Q7VX8OUFT6EL type=write size=24818 2024-09-12T00:42:16.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.637+0000 7fcde98768c0 1 < suggested remove operation key=NVOFV649MT0A tag=VTQ5GOF9FIZJ type=del 2024-09-12T00:42:16.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.641+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=Z5ZJJ3LHOA56 type=del size=3418268 2024-09-12T00:42:16.640 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.641+0000 7fcde98768c0 1 < completed delete operation key=4487IMSOLPDV tag=K83JZSRSC5RB type=del 2024-09-12T00:42:16.642 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.645+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=CITIHKPUMI3F type=write size=804810 2024-09-12T00:42:16.644 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.645+0000 7fcde98768c0 1 < completed delete operation key=IV4JCE1QJC70 tag=ANWFJDTVXA1Q type=del 2024-09-12T00:42:16.648 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.649+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~K1CVG14JYFVI.0 size=1048576 2024-09-12T00:42:16.649 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.653+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~K1CVG14JYFVI.1 size=612268 2024-09-12T00:42:16.649 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.653+0000 7fcde98768c0 1 > prepared multipart upload key=KME8ZTTUGOXY upload=K1CVG14JYFVI tag=B0YL9SGQ6SRY type=write size=2709420 2024-09-12T00:42:16.651 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.653+0000 7fcde98768c0 1 < completed delete operation key=IV4JCE1QJC70 tag=IAIWKUK2FU7P type=del 2024-09-12T00:42:16.654 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.657+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=7B8COFQLRP1L type=del size=3710731 2024-09-12T00:42:16.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.661+0000 7fcde98768c0 1 < suggested remove operation key=3X9I78PMR1HV tag=R8L074MT60K6 type=write 2024-09-12T00:42:16.662 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.665+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~91FRQG8S3PWI.0 size=1048576 2024-09-12T00:42:16.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.669+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~91FRQG8S3PWI.1 size=288710 2024-09-12T00:42:16.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.669+0000 7fcde98768c0 1 > prepared multipart upload key=4487IMSOLPDV upload=91FRQG8S3PWI tag=FAXGS47SLKA7 type=write size=2385862 2024-09-12T00:42:16.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.669+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~O4VR5WZGMXSR.0 size=220838 2024-09-12T00:42:16.670 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.673+0000 7fcde98768c0 1 < completed multipart upload key=97030NBF3MI4 upload=O4VR5WZGMXSR tag=C6X3GZSQR3PT type=write size=1269414 2024-09-12T00:42:16.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.677+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=67L0VLRE8K4W type=del size=2883533 2024-09-12T00:42:16.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.677+0000 7fcde98768c0 1 < canceled operation key=IMITNCB1ST9E tag=UMEZ7IS4UO3H type=del size=1772302 2024-09-12T00:42:16.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.681+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~WNJOY6473RBU.0 size=1048576 2024-09-12T00:42:16.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.685+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~WNJOY6473RBU.1 size=864430 2024-09-12T00:42:16.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.685+0000 7fcde98768c0 1 > prepared multipart upload key=FUJIUIR1E00J upload=WNJOY6473RBU tag=T87YL252KBYB type=write size=2961582 2024-09-12T00:42:16.685 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.689+0000 7fcde98768c0 1 < suggested update operation key=BZ4YUNTMOJBK tag=HW8NU5A36U49 type=del size=2620585 2024-09-12T00:42:16.687 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.689+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=RGRMA63N32S1 type=del size=1645196 2024-09-12T00:42:16.689 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.693+0000 7fcde98768c0 1 < completed delete operation key=ZQD0QXDN1J1I tag=JSPKQ19Y6ZBM type=del 2024-09-12T00:42:16.691 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.693+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=5NS0XNKWC7IC type=write size=108137 2024-09-12T00:42:16.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.697+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~SGR4VODFNE8I.0 size=1048390 2024-09-12T00:42:16.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.701+0000 7fcde98768c0 1 < completed multipart upload key=4487IMSOLPDV upload=SGR4VODFNE8I tag=4T1UJYG6TJ2U type=write size=2096966 2024-09-12T00:42:16.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.701+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=MXZF7BGILF29 type=del size=3746340 2024-09-12T00:42:16.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.705+0000 7fcde98768c0 1 < completed delete operation key=4487IMSOLPDV tag=CUD254M33BF0 type=del 2024-09-12T00:42:16.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.705+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=W28YERC17466 type=del size=33306 2024-09-12T00:42:16.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.709+0000 7fcde98768c0 1 < suggested update operation key=5B8C6E8L5N52 tag=VGAJORLPX40B type=del size=3333704 2024-09-12T00:42:16.711 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.713+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~Y3Z2AUM2GKIP.0 size=1048576 2024-09-12T00:42:16.712 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.713+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~Y3Z2AUM2GKIP.1 size=1048576 2024-09-12T00:42:16.714 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.717+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~Y3Z2AUM2GKIP.2 size=687806 2024-09-12T00:42:16.714 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.717+0000 7fcde98768c0 1 > prepared multipart upload key=368TXYQVK9C3 upload=Y3Z2AUM2GKIP tag=N20J49H1KQLD type=write size=3833534 2024-09-12T00:42:16.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.717+0000 7fcde98768c0 1 < completed write operation key=ZQD0QXDN1J1I tag=U82MJSR2HNRK type=write size=438446 2024-09-12T00:42:16.720 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.721+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~GENDGC70NOWG.0 size=913913 2024-09-12T00:42:16.720 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.721+0000 7fcde98768c0 1 > prepared multipart upload key=97030NBF3MI4 upload=GENDGC70NOWG tag=06NQJ99EI2OY type=write size=1962489 2024-09-12T00:42:16.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.725+0000 7fcde98768c0 1 < completed delete operation key=IV4JCE1QJC70 tag=IY7B1QUNR4F5 type=del 2024-09-12T00:42:16.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.729+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~2E1NU1T4FFME.0 size=615788 2024-09-12T00:42:16.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.729+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=2E1NU1T4FFME tag=PEG25PRZCOO2 type=write size=1664364 2024-09-12T00:42:16.729 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.733+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~RANY5YAPX17D.0 size=351808 2024-09-12T00:42:16.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.733+0000 7fcde98768c0 1 < completed multipart upload key=BZ4YUNTMOJBK upload=RANY5YAPX17D tag=VZ0S529YTZAB type=write size=1400384 2024-09-12T00:42:16.734 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.737+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=SFACBOAI4JBY type=del size=1166355 2024-09-12T00:42:16.736 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.737+0000 7fcde98768c0 1 < completed write operation key=ZQD0QXDN1J1I tag=Q7VX8OUFT6EL type=write size=24818 2024-09-12T00:42:16.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.741+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~0SWHD4M5CY0A.0 size=1048576 2024-09-12T00:42:16.742 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.745+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~0SWHD4M5CY0A.1 size=1048576 2024-09-12T00:42:16.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.745+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~0SWHD4M5CY0A.2 size=919009 2024-09-12T00:42:16.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.745+0000 7fcde98768c0 1 > prepared multipart upload key=TUMAMUZUIR7E upload=0SWHD4M5CY0A tag=C61LZ9C70JS7 type=write size=4064737 2024-09-12T00:42:16.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.749+0000 7fcde98768c0 1 < completed delete operation key=Z1PY2MFUC1C4 tag=Z5ZJJ3LHOA56 type=del 2024-09-12T00:42:16.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.749+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=SANMYOH5WK53 type=del size=3544779 2024-09-12T00:42:16.750 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.753+0000 7fcde98768c0 1 < completed write operation key=Z4RNDW37GEK6 tag=CITIHKPUMI3F type=write size=804810 2024-09-12T00:42:16.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.753+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=4IL65BIAWYMQ type=write size=477273 2024-09-12T00:42:16.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.757+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~K1CVG14JYFVI.0 size=1048576 2024-09-12T00:42:16.756 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.757+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~K1CVG14JYFVI.1 size=612268 2024-09-12T00:42:16.760 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.761+0000 7fcde98768c0 1 < completed multipart upload key=KME8ZTTUGOXY upload=K1CVG14JYFVI tag=B0YL9SGQ6SRY type=write size=2709420 2024-09-12T00:42:16.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.765+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=W11FM07U0R83 type=del size=2187607 2024-09-12T00:42:16.764 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.765+0000 7fcde98768c0 1 < completed delete operation key=TUMAMUZUIR7E tag=7B8COFQLRP1L type=del 2024-09-12T00:42:16.767 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.769+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=EN3YGMN58D42 type=del size=3285974 2024-09-12T00:42:16.769 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.773+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~91FRQG8S3PWI.0 size=1048576 2024-09-12T00:42:16.771 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.773+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~91FRQG8S3PWI.1 size=288710 2024-09-12T00:42:16.775 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.777+0000 7fcde98768c0 1 < completed multipart upload key=4487IMSOLPDV upload=91FRQG8S3PWI tag=FAXGS47SLKA7 type=write size=2385862 2024-09-12T00:42:16.777 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.781+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=P0BTO4IL7ZJM type=del size=1411315 2024-09-12T00:42:16.782 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.785+0000 7fcde98768c0 1 < suggested remove operation key=BZ4YUNTMOJBK tag=67L0VLRE8K4W type=del 2024-09-12T00:42:16.786 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.789+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~2UBLV3WYMA0D.0 size=1048576 2024-09-12T00:42:16.788 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.789+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~2UBLV3WYMA0D.1 size=1048576 2024-09-12T00:42:16.790 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.793+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~2UBLV3WYMA0D.2 size=943994 2024-09-12T00:42:16.790 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.793+0000 7fcde98768c0 1 > prepared multipart upload key=RC9A2Y5TCP9C upload=2UBLV3WYMA0D tag=TZOAC19MINJY type=write size=4089722 2024-09-12T00:42:16.793 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.793+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~WNJOY6473RBU.0 size=1048576 2024-09-12T00:42:16.793 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.793+0000 7fcde98768c0 1 < canceled part key=_multipart_FUJIUIR1E00J.2~WNJOY6473RBU.1 size=864430 2024-09-12T00:42:16.796 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.797+0000 7fcde98768c0 1 < canceled multipart upload key=FUJIUIR1E00J upload=WNJOY6473RBU tag=T87YL252KBYB type=write size=2961582 2024-09-12T00:42:16.801 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.805+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~FW88PTUFTZ6G.0 size=1048576 2024-09-12T00:42:16.802 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.805+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~FW88PTUFTZ6G.1 size=140197 2024-09-12T00:42:16.802 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.805+0000 7fcde98768c0 1 > prepared multipart upload key=BQGIXJJWBAN0 upload=FW88PTUFTZ6G tag=Z3K0FCRUY765 type=write size=2237349 2024-09-12T00:42:16.809 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.809+0000 7fcde98768c0 1 < completed delete operation key=J9EUM073CZHF tag=RGRMA63N32S1 type=del 2024-09-12T00:42:16.809 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.813+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=WO5JVSVI4XBY type=del size=3827233 2024-09-12T00:42:16.814 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.817+0000 7fcde98768c0 1 < suggested update operation key=Z4RNDW37GEK6 tag=5NS0XNKWC7IC type=write size=108137 2024-09-12T00:42:16.820 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.821+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~GFDK1KGLRLOX.0 size=1048576 2024-09-12T00:42:16.823 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.825+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~GFDK1KGLRLOX.1 size=173276 2024-09-12T00:42:16.823 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.825+0000 7fcde98768c0 1 > prepared multipart upload key=2T5IU2IUNGJX upload=GFDK1KGLRLOX tag=2W169JD24175 type=write size=2270428 2024-09-12T00:42:16.825 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.829+0000 7fcde98768c0 1 < canceled operation key=HVE3YQTFZWTV tag=MXZF7BGILF29 type=del size=3746340 2024-09-12T00:42:16.828 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.829+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=DIAVH55PSGKY type=write size=73027 2024-09-12T00:42:16.831 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.833+0000 7fcde98768c0 1 < canceled operation key=4487IMSOLPDV tag=W28YERC17466 type=del size=33306 2024-09-12T00:42:16.833 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.837+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=SRL418FTXWGQ type=del size=2756815 2024-09-12T00:42:16.836 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.837+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~Y3Z2AUM2GKIP.0 size=1048576 2024-09-12T00:42:16.838 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.841+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~Y3Z2AUM2GKIP.1 size=1048576 2024-09-12T00:42:16.840 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.841+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~Y3Z2AUM2GKIP.2 size=687806 2024-09-12T00:42:16.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.845+0000 7fcde98768c0 1 < completed multipart upload key=368TXYQVK9C3 upload=Y3Z2AUM2GKIP tag=N20J49H1KQLD type=write size=3833534 2024-09-12T00:42:16.847 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.849+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=2MXHSD9NN17D type=del size=832773 2024-09-12T00:42:16.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.853+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~GENDGC70NOWG.0 size=913913 2024-09-12T00:42:16.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.857+0000 7fcde98768c0 1 < completed multipart upload key=97030NBF3MI4 upload=GENDGC70NOWG tag=06NQJ99EI2OY type=write size=1962489 2024-09-12T00:42:16.857 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.861+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=817P80IIA5E6 type=del size=2480825 2024-09-12T00:42:16.860 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.861+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~2E1NU1T4FFME.0 size=615788 2024-09-12T00:42:16.864 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.865+0000 7fcde98768c0 1 < completed multipart upload key=QD5JXFL962R5 upload=2E1NU1T4FFME tag=PEG25PRZCOO2 type=write size=1664364 2024-09-12T00:42:16.869 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.873+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~PT6Q2HPYMCJ9.0 size=1048576 2024-09-12T00:42:16.872 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.873+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~PT6Q2HPYMCJ9.1 size=316618 2024-09-12T00:42:16.872 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.873+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=PT6Q2HPYMCJ9 tag=0KW1GVILA977 type=write size=2413770 2024-09-12T00:42:16.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.877+0000 7fcde98768c0 1 < completed delete operation key=G6R8BX1H7SPM tag=SFACBOAI4JBY type=del 2024-09-12T00:42:16.879 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.881+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=LYHH8LIWYMUP type=del size=3127158 2024-09-12T00:42:16.882 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.885+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~0SWHD4M5CY0A.0 size=1048576 2024-09-12T00:42:16.885 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.889+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~0SWHD4M5CY0A.1 size=1048576 2024-09-12T00:42:16.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.889+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~0SWHD4M5CY0A.2 size=919009 2024-09-12T00:42:16.893 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.897+0000 7fcde98768c0 1 < completed multipart upload key=TUMAMUZUIR7E upload=0SWHD4M5CY0A tag=C61LZ9C70JS7 type=write size=4064737 2024-09-12T00:42:16.903 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.905+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~QHWM76IYU5Q9.0 size=1048576 2024-09-12T00:42:16.906 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.909+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~QHWM76IYU5Q9.1 size=516400 2024-09-12T00:42:16.906 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.909+0000 7fcde98768c0 1 > prepared multipart upload key=BQGIXJJWBAN0 upload=QHWM76IYU5Q9 tag=KUP9PI4P1U7U type=write size=2613552 2024-09-12T00:42:16.910 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.913+0000 7fcde98768c0 1 < completed delete operation key=RC9A2Y5TCP9C tag=SANMYOH5WK53 type=del 2024-09-12T00:42:16.915 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.917+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~EQES76FVCM7N.0 size=1048576 2024-09-12T00:42:16.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.921+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~EQES76FVCM7N.1 size=1048576 2024-09-12T00:42:16.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.921+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~EQES76FVCM7N.2 size=270978 2024-09-12T00:42:16.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.921+0000 7fcde98768c0 1 > prepared multipart upload key=7UR0FX8HA2A5 upload=EQES76FVCM7N tag=O6CWGD5236BN type=write size=3416706 2024-09-12T00:42:16.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.925+0000 7fcde98768c0 1 < completed write operation key=G6R8BX1H7SPM tag=4IL65BIAWYMQ type=write size=477273 2024-09-12T00:42:16.924 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.925+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=G52RKLD6S5B6 type=write size=135136 2024-09-12T00:42:16.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.929+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=W11FM07U0R83 type=del 2024-09-12T00:42:16.934 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.937+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~QT1PMTX64ZV7.0 size=1048576 2024-09-12T00:42:16.936 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.937+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~QT1PMTX64ZV7.1 size=1048576 2024-09-12T00:42:16.938 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.941+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~QT1PMTX64ZV7.2 size=486521 2024-09-12T00:42:16.938 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.941+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=QT1PMTX64ZV7 tag=LST37CTFKAC3 type=write size=3632249 2024-09-12T00:42:16.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.945+0000 7fcde98768c0 1 < completed delete operation key=TUMAMUZUIR7E tag=EN3YGMN58D42 type=del 2024-09-12T00:42:16.946 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.949+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~XE1NVSXYN06L.0 size=182944 2024-09-12T00:42:16.946 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.949+0000 7fcde98768c0 1 > prepared multipart upload key=R2EBH0Q5885L upload=XE1NVSXYN06L tag=9VZ7FU6QNZ2I type=write size=1231520 2024-09-12T00:42:16.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.953+0000 7fcde98768c0 1 < suggested update operation key=5B8C6E8L5N52 tag=P0BTO4IL7ZJM type=del size=1411315 2024-09-12T00:42:16.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.957+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~NRQ3RA30N0IX.0 size=895099 2024-09-12T00:42:16.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.957+0000 7fcde98768c0 1 > prepared multipart upload key=FUJIUIR1E00J upload=NRQ3RA30N0IX tag=SL9OGIPQLBC7 type=write size=1943675 2024-09-12T00:42:16.958 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.961+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~2UBLV3WYMA0D.0 size=1048576 2024-09-12T00:42:16.960 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.961+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~2UBLV3WYMA0D.1 size=1048576 2024-09-12T00:42:16.962 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.965+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~2UBLV3WYMA0D.2 size=943994 2024-09-12T00:42:16.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.969+0000 7fcde98768c0 1 < completed multipart upload key=RC9A2Y5TCP9C upload=2UBLV3WYMA0D tag=TZOAC19MINJY type=write size=4089722 2024-09-12T00:42:16.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.973+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=HGJTNNB44A7Z type=del size=1120205 2024-09-12T00:42:16.970 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.973+0000 7fcde98768c0 1 < canceled part key=_multipart_BQGIXJJWBAN0.2~FW88PTUFTZ6G.0 size=1048576 2024-09-12T00:42:16.970 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.973+0000 7fcde98768c0 1 < canceled part key=_multipart_BQGIXJJWBAN0.2~FW88PTUFTZ6G.1 size=140197 2024-09-12T00:42:16.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.977+0000 7fcde98768c0 1 < canceled multipart upload key=BQGIXJJWBAN0 upload=FW88PTUFTZ6G tag=Z3K0FCRUY765 type=write size=2237349 2024-09-12T00:42:16.977 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.981+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=QBCO8W1WXKB4 type=del size=3658973 2024-09-12T00:42:16.983 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.985+0000 7fcde98768c0 1 < suggested remove operation key=IV4JCE1QJC70 tag=WO5JVSVI4XBY type=del 2024-09-12T00:42:16.986 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.989+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=FWUYDCNM44E5 type=del size=500551 2024-09-12T00:42:16.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.989+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~GFDK1KGLRLOX.0 size=1048576 2024-09-12T00:42:16.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.993+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~GFDK1KGLRLOX.1 size=173276 2024-09-12T00:42:16.995 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:16.997+0000 7fcde98768c0 1 < completed multipart upload key=2T5IU2IUNGJX upload=GFDK1KGLRLOX tag=2W169JD24175 type=write size=2270428 2024-09-12T00:42:17.000 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.001+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~1Q2VY1PHOESV.0 size=283024 2024-09-12T00:42:17.000 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.001+0000 7fcde98768c0 1 > prepared multipart upload key=4487IMSOLPDV upload=1Q2VY1PHOESV tag=6ZER6OZQXHSP type=write size=1331600 2024-09-12T00:42:17.002 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.005+0000 7fcde98768c0 1 < completed write operation key=3X9I78PMR1HV tag=DIAVH55PSGKY type=write size=73027 2024-09-12T00:42:17.006 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.009+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=2HTHVWCYHXMD type=del size=3265218 2024-09-12T00:42:17.009 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.013+0000 7fcde98768c0 1 < completed delete operation key=4487IMSOLPDV tag=SRL418FTXWGQ type=del 2024-09-12T00:42:17.011 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.013+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=D0XIVMN32Z23 type=del size=2289461 2024-09-12T00:42:17.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.021+0000 7fcde98768c0 1 < suggested update operation key=JW2GNFAYFNEK tag=2MXHSD9NN17D type=del size=832773 2024-09-12T00:42:17.022 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.025+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=0B3ZXFZGS70N type=del size=3744743 2024-09-12T00:42:17.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.029+0000 7fcde98768c0 1 < suggested remove operation key=G6R8BX1H7SPM tag=817P80IIA5E6 type=del 2024-09-12T00:42:17.029 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.033+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=QXXMN07UNCRT type=del size=1405357 2024-09-12T00:42:17.032 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.033+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~PT6Q2HPYMCJ9.0 size=1048576 2024-09-12T00:42:17.034 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.037+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~PT6Q2HPYMCJ9.1 size=316618 2024-09-12T00:42:17.038 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.041+0000 7fcde98768c0 1 < completed multipart upload key=V80E1NH858IK upload=PT6Q2HPYMCJ9 tag=0KW1GVILA977 type=write size=2413770 2024-09-12T00:42:17.041 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.045+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=ODAYVTO76H1R type=del size=3598532 2024-09-12T00:42:17.043 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.045+0000 7fcde98768c0 1 < completed delete operation key=EDFNLQYP4L4L tag=LYHH8LIWYMUP type=del 2024-09-12T00:42:17.046 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.049+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=Q8E6U2K63UH6 type=del size=2574641 2024-09-12T00:42:17.048 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.053+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~QHWM76IYU5Q9.0 size=1048576 2024-09-12T00:42:17.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.053+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~QHWM76IYU5Q9.1 size=516400 2024-09-12T00:42:17.055 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.057+0000 7fcde98768c0 1 < completed multipart upload key=BQGIXJJWBAN0 upload=QHWM76IYU5Q9 tag=KUP9PI4P1U7U type=write size=2613552 2024-09-12T00:42:17.058 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.061+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=5KC1BGAW59L9 type=del size=3758250 2024-09-12T00:42:17.061 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.065+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~EQES76FVCM7N.0 size=1048576 2024-09-12T00:42:17.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.065+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~EQES76FVCM7N.1 size=1048576 2024-09-12T00:42:17.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.069+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~EQES76FVCM7N.2 size=270978 2024-09-12T00:42:17.070 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.073+0000 7fcde98768c0 1 < completed multipart upload key=7UR0FX8HA2A5 upload=EQES76FVCM7N tag=O6CWGD5236BN type=write size=3416706 2024-09-12T00:42:17.073 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.077+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=THI1TC2N27X6 type=del size=3198995 2024-09-12T00:42:17.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.077+0000 7fcde98768c0 1 < completed write operation key=QD5JXFL962R5 tag=G52RKLD6S5B6 type=write size=135136 2024-09-12T00:42:17.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.085+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~30G390QMG0O3.0 size=1048576 2024-09-12T00:42:17.084 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.085+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~30G390QMG0O3.1 size=486168 2024-09-12T00:42:17.084 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.085+0000 7fcde98768c0 1 > prepared multipart upload key=97030NBF3MI4 upload=30G390QMG0O3 tag=ZVANAOAEFSXT type=write size=2583320 2024-09-12T00:42:17.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.089+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~QT1PMTX64ZV7.0 size=1048576 2024-09-12T00:42:17.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.093+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~QT1PMTX64ZV7.1 size=1048576 2024-09-12T00:42:17.092 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.093+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~QT1PMTX64ZV7.2 size=486521 2024-09-12T00:42:17.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.101+0000 7fcde98768c0 1 < completed multipart upload key=IV4JCE1QJC70 upload=QT1PMTX64ZV7 tag=LST37CTFKAC3 type=write size=3632249 2024-09-12T00:42:17.100 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.101+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=URJ2ATQAT3W2 type=write size=290474 2024-09-12T00:42:17.103 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.105+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~XE1NVSXYN06L.0 size=182944 2024-09-12T00:42:17.107 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.109+0000 7fcde98768c0 1 < completed multipart upload key=R2EBH0Q5885L upload=XE1NVSXYN06L tag=9VZ7FU6QNZ2I type=write size=1231520 2024-09-12T00:42:17.109 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.113+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=FOJ1WER93LQA type=del size=1284413 2024-09-12T00:42:17.112 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.113+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~NRQ3RA30N0IX.0 size=895099 2024-09-12T00:42:17.116 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.117+0000 7fcde98768c0 1 < completed multipart upload key=FUJIUIR1E00J upload=NRQ3RA30N0IX tag=SL9OGIPQLBC7 type=write size=1943675 2024-09-12T00:42:17.121 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.125+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~FPQIV2UVAKLJ.0 size=1048576 2024-09-12T00:42:17.123 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.125+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~FPQIV2UVAKLJ.1 size=956672 2024-09-12T00:42:17.123 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.125+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=FPQIV2UVAKLJ tag=33Z7TCXSIMCA type=write size=3053824 2024-09-12T00:42:17.127 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.129+0000 7fcde98768c0 1 < canceled operation key=V80E1NH858IK tag=HGJTNNB44A7Z type=del size=1120205 2024-09-12T00:42:17.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.137+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~QUTN8RL7FBN3.0 size=123343 2024-09-12T00:42:17.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.137+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=QUTN8RL7FBN3 tag=JE832BZBPEJO type=write size=1171919 2024-09-12T00:42:17.136 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.137+0000 7fcde98768c0 1 < completed delete operation key=IMITNCB1ST9E tag=QBCO8W1WXKB4 type=del 2024-09-12T00:42:17.139 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.141+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=2X7Y8KCI03RI type=del size=4072564 2024-09-12T00:42:17.143 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.145+0000 7fcde98768c0 1 < completed delete operation key=5B8C6E8L5N52 tag=FWUYDCNM44E5 type=del 2024-09-12T00:42:17.145 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.149+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=XQHBYCG8ZPU1 type=del size=4022721 2024-09-12T00:42:17.149 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.153+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~1Q2VY1PHOESV.0 size=283024 2024-09-12T00:42:17.154 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.157+0000 7fcde98768c0 1 < completed multipart upload key=4487IMSOLPDV upload=1Q2VY1PHOESV tag=6ZER6OZQXHSP type=write size=1331600 2024-09-12T00:42:17.157 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.161+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=SR266Q4ITBWV type=del size=2020070 2024-09-12T00:42:17.161 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.165+0000 7fcde98768c0 1 < completed delete operation key=F813QWV02TI0 tag=2HTHVWCYHXMD type=del 2024-09-12T00:42:17.165 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.169+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=JP0EHGMDPR0Q type=del size=1981034 2024-09-12T00:42:17.171 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.173+0000 7fcde98768c0 1 < completed delete operation key=Z4RNDW37GEK6 tag=D0XIVMN32Z23 type=del 2024-09-12T00:42:17.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.177+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~0KZ1ETEJNK4V.0 size=1048576 2024-09-12T00:42:17.178 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.181+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~0KZ1ETEJNK4V.1 size=171 2024-09-12T00:42:17.178 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.181+0000 7fcde98768c0 1 > prepared multipart upload key=R2EBH0Q5885L upload=0KZ1ETEJNK4V tag=6Q8TZOG183BU type=write size=2097323 2024-09-12T00:42:17.181 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.185+0000 7fcde98768c0 1 < completed delete operation key=ZQD0QXDN1J1I tag=0B3ZXFZGS70N type=del 2024-09-12T00:42:17.184 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.185+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=3XSJXZPIJK7P type=del size=3684437 2024-09-12T00:42:17.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.189+0000 7fcde98768c0 1 < canceled operation key=368TXYQVK9C3 tag=QXXMN07UNCRT type=del size=1405357 2024-09-12T00:42:17.190 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.193+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~UWTUI03CG0J0.0 size=1048576 2024-09-12T00:42:17.192 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.193+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~UWTUI03CG0J0.1 size=1048576 2024-09-12T00:42:17.194 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.197+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~UWTUI03CG0J0.2 size=602347 2024-09-12T00:42:17.194 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.197+0000 7fcde98768c0 1 > prepared multipart upload key=J9EUM073CZHF upload=UWTUI03CG0J0 tag=61G3BY726A4G type=write size=3748075 2024-09-12T00:42:17.197 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.201+0000 7fcde98768c0 1 < completed delete operation key=3QOENE572J7A tag=ODAYVTO76H1R type=del 2024-09-12T00:42:17.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.205+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~YGO36MAEWGTK.0 size=1022981 2024-09-12T00:42:17.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.205+0000 7fcde98768c0 1 > prepared multipart upload key=3X9I78PMR1HV upload=YGO36MAEWGTK tag=GPM113VZVZZ8 type=write size=2071557 2024-09-12T00:42:17.205 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.209+0000 7fcde98768c0 1 < completed delete operation key=IMITNCB1ST9E tag=Q8E6U2K63UH6 type=del 2024-09-12T00:42:17.208 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.209+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=1WORWX8EH21B type=del size=752221 2024-09-12T00:42:17.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.213+0000 7fcde98768c0 1 < completed delete operation key=J9EUM073CZHF tag=5KC1BGAW59L9 type=del 2024-09-12T00:42:17.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.217+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=3FMRAKWJ8ZSF type=del size=2889443 2024-09-12T00:42:17.218 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.221+0000 7fcde98768c0 1 < completed delete operation key=F813QWV02TI0 tag=THI1TC2N27X6 type=del 2024-09-12T00:42:17.222 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.225+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~KCLMRHTX1U57.0 size=1048576 2024-09-12T00:42:17.224 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.225+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~KCLMRHTX1U57.1 size=1048576 2024-09-12T00:42:17.225 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.229+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~KCLMRHTX1U57.2 size=259748 2024-09-12T00:42:17.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.229+0000 7fcde98768c0 1 > prepared multipart upload key=5B8C6E8L5N52 upload=KCLMRHTX1U57 tag=XVIV442TRFUE type=write size=3405476 2024-09-12T00:42:17.228 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.229+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~30G390QMG0O3.0 size=1048576 2024-09-12T00:42:17.230 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.233+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~30G390QMG0O3.1 size=486168 2024-09-12T00:42:17.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.237+0000 7fcde98768c0 1 < completed multipart upload key=97030NBF3MI4 upload=30G390QMG0O3 tag=ZVANAOAEFSXT type=write size=2583320 2024-09-12T00:42:17.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.241+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=07R78C9N0GP2 type=del size=2878329 2024-09-12T00:42:17.243 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.245+0000 7fcde98768c0 1 < suggested remove operation key=2T5IU2IUNGJX tag=URJ2ATQAT3W2 type=write 2024-09-12T00:42:17.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.249+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=YK2AQFNONZU8 type=del size=743573 2024-09-12T00:42:17.249 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.253+0000 7fcde98768c0 1 < completed delete operation key=BZ4YUNTMOJBK tag=FOJ1WER93LQA type=del 2024-09-12T00:42:17.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.257+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~PCFOL1T8Y1JE.0 size=1048576 2024-09-12T00:42:17.257 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.261+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~PCFOL1T8Y1JE.1 size=788380 2024-09-12T00:42:17.257 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.261+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=PCFOL1T8Y1JE tag=WJ4HO9VHFFAT type=write size=2885532 2024-09-12T00:42:17.257 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.261+0000 7fcde98768c0 1 < canceled part key=_multipart_BZ4YUNTMOJBK.2~FPQIV2UVAKLJ.0 size=1048576 2024-09-12T00:42:17.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.261+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~FPQIV2UVAKLJ.1 size=956672 2024-09-12T00:42:17.264 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.265+0000 7fcde98768c0 1 < canceled multipart upload key=BZ4YUNTMOJBK upload=FPQIV2UVAKLJ tag=33Z7TCXSIMCA type=write size=3053824 2024-09-12T00:42:17.266 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.269+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=J09I250UZ4E6 type=write size=975428 2024-09-12T00:42:17.267 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.269+0000 7fcde98768c0 1 < canceled part key=_multipart_G6R8BX1H7SPM.2~QUTN8RL7FBN3.0 size=123343 2024-09-12T00:42:17.271 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.273+0000 7fcde98768c0 1 < canceled multipart upload key=G6R8BX1H7SPM upload=QUTN8RL7FBN3 tag=JE832BZBPEJO type=write size=1171919 2024-09-12T00:42:17.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.277+0000 7fcde98768c0 1 > prepared operation key=KME8ZTTUGOXY tag=3TRHEJDQ3W2T type=del size=3573449 2024-09-12T00:42:17.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.277+0000 7fcde98768c0 -1 < no bi entry to suggest for operation key=2T5IU2IUNGJX tag=2X7Y8KCI03RI type=del size=4072564: (2) No such file or directory 2024-09-12T00:42:17.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.281+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=1A9U42Z9Y3G7 type=del size=1442719 2024-09-12T00:42:17.281 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.285+0000 7fcde98768c0 1 < completed delete operation key=NVOFV649MT0A tag=XQHBYCG8ZPU1 type=del 2024-09-12T00:42:17.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.285+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=Y68AIWO1GJ3F type=del size=2160746 2024-09-12T00:42:17.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.289+0000 7fcde98768c0 1 < completed delete operation key=V80E1NH858IK tag=SR266Q4ITBWV type=del 2024-09-12T00:42:17.291 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.293+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~SS7R882DUBVA.0 size=1048576 2024-09-12T00:42:17.292 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.297+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~SS7R882DUBVA.1 size=255082 2024-09-12T00:42:17.293 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.297+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=SS7R882DUBVA tag=FAV0B6E0DXRU type=write size=2352234 2024-09-12T00:42:17.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.301+0000 7fcde98768c0 1 < suggested remove operation key=EDFNLQYP4L4L tag=JP0EHGMDPR0Q type=del 2024-09-12T00:42:17.302 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.305+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~DMA6D4JRM2W2.0 size=1048576 2024-09-12T00:42:17.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.305+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~DMA6D4JRM2W2.1 size=1048576 2024-09-12T00:42:17.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.309+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~DMA6D4JRM2W2.2 size=995877 2024-09-12T00:42:17.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.309+0000 7fcde98768c0 1 > prepared multipart upload key=4487IMSOLPDV upload=DMA6D4JRM2W2 tag=D607AJUHLHWW type=write size=4141605 2024-09-12T00:42:17.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.313+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~0KZ1ETEJNK4V.0 size=1048576 2024-09-12T00:42:17.311 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.313+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~0KZ1ETEJNK4V.1 size=171 2024-09-12T00:42:17.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.317+0000 7fcde98768c0 1 < completed multipart upload key=R2EBH0Q5885L upload=0KZ1ETEJNK4V tag=6Q8TZOG183BU type=write size=2097323 2024-09-12T00:42:17.319 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.321+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~AK9VJ6J3QKRV.0 size=1048576 2024-09-12T00:42:17.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.325+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~AK9VJ6J3QKRV.1 size=918866 2024-09-12T00:42:17.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.325+0000 7fcde98768c0 1 > prepared multipart upload key=Z4RNDW37GEK6 upload=AK9VJ6J3QKRV tag=3K25M1WRCHZQ type=write size=3016018 2024-09-12T00:42:17.324 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.325+0000 7fcde98768c0 1 < completed delete operation key=IMITNCB1ST9E tag=3XSJXZPIJK7P type=del 2024-09-12T00:42:17.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.329+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=XQCXERQ55WOE type=del size=3339594 2024-09-12T00:42:17.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.333+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~UWTUI03CG0J0.0 size=1048576 2024-09-12T00:42:17.331 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.333+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~UWTUI03CG0J0.1 size=1048576 2024-09-12T00:42:17.333 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.337+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~UWTUI03CG0J0.2 size=602347 2024-09-12T00:42:17.337 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.341+0000 7fcde98768c0 1 < completed multipart upload key=J9EUM073CZHF upload=UWTUI03CG0J0 tag=61G3BY726A4G type=write size=3748075 2024-09-12T00:42:17.340 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.341+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=DQ1RROJLCCSU type=del size=2323270 2024-09-12T00:42:17.342 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.345+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~YGO36MAEWGTK.0 size=1022981 2024-09-12T00:42:17.346 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.349+0000 7fcde98768c0 1 < completed multipart upload key=3X9I78PMR1HV upload=YGO36MAEWGTK tag=GPM113VZVZZ8 type=write size=2071557 2024-09-12T00:42:17.351 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.353+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~XRP1Z81GWUA9.0 size=1048576 2024-09-12T00:42:17.353 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.357+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~XRP1Z81GWUA9.1 size=688368 2024-09-12T00:42:17.354 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.357+0000 7fcde98768c0 1 > prepared multipart upload key=Z4RNDW37GEK6 upload=XRP1Z81GWUA9 tag=YO820YPH5I3Q type=write size=2785520 2024-09-12T00:42:17.356 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.357+0000 7fcde98768c0 1 < canceled operation key=HVE3YQTFZWTV tag=1WORWX8EH21B type=del size=752221 2024-09-12T00:42:17.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.361+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=ID9P2IRMRIZB type=del size=2366377 2024-09-12T00:42:17.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.365+0000 7fcde98768c0 1 < completed delete operation key=R2EBH0Q5885L tag=3FMRAKWJ8ZSF type=del 2024-09-12T00:42:17.366 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.369+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~LNLY75JS0NF1.0 size=1048576 2024-09-12T00:42:17.369 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.373+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~LNLY75JS0NF1.1 size=1048576 2024-09-12T00:42:17.371 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.373+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~LNLY75JS0NF1.2 size=269154 2024-09-12T00:42:17.371 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.373+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=LNLY75JS0NF1 tag=UZEQJCHXDMA7 type=write size=3414882 2024-09-12T00:42:17.371 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.373+0000 7fcde98768c0 1 < canceled part key=_multipart_5B8C6E8L5N52.2~KCLMRHTX1U57.0 size=1048576 2024-09-12T00:42:17.371 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.373+0000 7fcde98768c0 1 < canceled part key=_multipart_5B8C6E8L5N52.2~KCLMRHTX1U57.1 size=1048576 2024-09-12T00:42:17.373 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.377+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~KCLMRHTX1U57.2 size=259748 2024-09-12T00:42:17.377 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.381+0000 7fcde98768c0 1 < canceled multipart upload key=5B8C6E8L5N52 upload=KCLMRHTX1U57 tag=XVIV442TRFUE type=write size=3405476 2024-09-12T00:42:17.382 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.385+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~28T1K1VEO2KT.0 size=1048576 2024-09-12T00:42:17.384 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.385+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~28T1K1VEO2KT.1 size=1048576 2024-09-12T00:42:17.386 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.389+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~28T1K1VEO2KT.2 size=415167 2024-09-12T00:42:17.386 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.389+0000 7fcde98768c0 1 > prepared multipart upload key=5B8C6E8L5N52 upload=28T1K1VEO2KT tag=2E1Z7A08TL0Y type=write size=3560895 2024-09-12T00:42:17.388 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.389+0000 7fcde98768c0 1 < completed delete operation key=368TXYQVK9C3 tag=07R78C9N0GP2 type=del 2024-09-12T00:42:17.391 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.393+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=6SNCEVVQO9RH type=write size=360911 2024-09-12T00:42:17.394 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.397+0000 7fcde98768c0 1 < completed delete operation key=ZQD0QXDN1J1I tag=YK2AQFNONZU8 type=del 2024-09-12T00:42:17.396 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.397+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=4DYCYF4R9Q2F type=del size=2127683 2024-09-12T00:42:17.399 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.401+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~PCFOL1T8Y1JE.0 size=1048576 2024-09-12T00:42:17.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.405+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~PCFOL1T8Y1JE.1 size=788380 2024-09-12T00:42:17.405 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.409+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=PCFOL1T8Y1JE tag=WJ4HO9VHFFAT type=write size=2885532 2024-09-12T00:42:17.409 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.413+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=JW9WVWT4030S type=del size=1459910 2024-09-12T00:42:17.412 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.413+0000 7fcde98768c0 1 < completed write operation key=5YBVLUYJW40U tag=J09I250UZ4E6 type=write size=975428 2024-09-12T00:42:17.416 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.417+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=MHGE2XTDWBVC type=write size=491884 2024-09-12T00:42:17.423 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.425+0000 7fcde98768c0 1 < suggested update operation key=KME8ZTTUGOXY tag=3TRHEJDQ3W2T type=del size=3573449 2024-09-12T00:42:17.428 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.429+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~M9Y2EV2IQJ3A.0 size=619543 2024-09-12T00:42:17.428 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.429+0000 7fcde98768c0 1 > prepared multipart upload key=WLE5QLNPAGZA upload=M9Y2EV2IQJ3A tag=MF5K142VQSBS type=write size=1668119 2024-09-12T00:42:17.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.437+0000 7fcde98768c0 1 < suggested remove operation key=V80E1NH858IK tag=1A9U42Z9Y3G7 type=del 2024-09-12T00:42:17.439 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.441+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~IANLFBVM0ZH7.0 size=89970 2024-09-12T00:42:17.439 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.441+0000 7fcde98768c0 1 > prepared multipart upload key=NVOFV649MT0A upload=IANLFBVM0ZH7 tag=HWG96UU6F2VL type=write size=1138546 2024-09-12T00:42:17.442 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.445+0000 7fcde98768c0 1 < completed delete operation key=Z4RNDW37GEK6 tag=Y68AIWO1GJ3F type=del 2024-09-12T00:42:17.445 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.449+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=1OR2G4SILNEU type=del size=1693495 2024-09-12T00:42:17.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.449+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~SS7R882DUBVA.0 size=1048576 2024-09-12T00:42:17.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.449+0000 7fcde98768c0 1 < canceled part key=_multipart_IV4JCE1QJC70.2~SS7R882DUBVA.1 size=255082 2024-09-12T00:42:17.453 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.457+0000 7fcde98768c0 1 < canceled multipart upload key=IV4JCE1QJC70 upload=SS7R882DUBVA tag=FAV0B6E0DXRU type=write size=2352234 2024-09-12T00:42:17.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.461+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~S1ATQKTCCXWU.0 size=575481 2024-09-12T00:42:17.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.461+0000 7fcde98768c0 1 > prepared multipart upload key=HVE3YQTFZWTV upload=S1ATQKTCCXWU tag=YRRKT5TN3ZUG type=write size=1624057 2024-09-12T00:42:17.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.461+0000 7fcde98768c0 1 < canceled part key=_multipart_4487IMSOLPDV.2~DMA6D4JRM2W2.0 size=1048576 2024-09-12T00:42:17.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.465+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~DMA6D4JRM2W2.1 size=1048576 2024-09-12T00:42:17.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.469+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~DMA6D4JRM2W2.2 size=995877 2024-09-12T00:42:17.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.473+0000 7fcde98768c0 1 < canceled multipart upload key=4487IMSOLPDV upload=DMA6D4JRM2W2 tag=D607AJUHLHWW type=write size=4141605 2024-09-12T00:42:17.476 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.477+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~A693JHV3362S.0 size=1048576 2024-09-12T00:42:17.479 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.481+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~A693JHV3362S.1 size=649535 2024-09-12T00:42:17.479 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.481+0000 7fcde98768c0 1 > prepared multipart upload key=5YBVLUYJW40U upload=A693JHV3362S tag=06QIHL2B51B7 type=write size=2746687 2024-09-12T00:42:17.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.485+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~AK9VJ6J3QKRV.0 size=1048576 2024-09-12T00:42:17.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.489+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~AK9VJ6J3QKRV.1 size=918866 2024-09-12T00:42:17.492 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.497+0000 7fcde98768c0 1 < completed multipart upload key=Z4RNDW37GEK6 upload=AK9VJ6J3QKRV tag=3K25M1WRCHZQ type=write size=3016018 2024-09-12T00:42:17.496 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.497+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=WKK5EB457KES type=del size=1968387 2024-09-12T00:42:17.503 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.505+0000 7fcde98768c0 1 < suggested update operation key=368TXYQVK9C3 tag=XQCXERQ55WOE type=del size=3339594 2024-09-12T00:42:17.507 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.509+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=8IGKU3BUOTF7 type=write size=186248 2024-09-12T00:42:17.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.513+0000 7fcde98768c0 1 < completed delete operation key=IMITNCB1ST9E tag=DQ1RROJLCCSU type=del 2024-09-12T00:42:17.516 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.517+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~YD0RSLIVRHIK.0 size=1048576 2024-09-12T00:42:17.519 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.521+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~YD0RSLIVRHIK.1 size=97487 2024-09-12T00:42:17.519 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.521+0000 7fcde98768c0 1 > prepared multipart upload key=NVOFV649MT0A upload=YD0RSLIVRHIK tag=Q7550V3L3ALY type=write size=2194639 2024-09-12T00:42:17.522 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.525+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~XRP1Z81GWUA9.0 size=1048576 2024-09-12T00:42:17.525 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.529+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~XRP1Z81GWUA9.1 size=688368 2024-09-12T00:42:17.530 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.533+0000 7fcde98768c0 1 < completed multipart upload key=Z4RNDW37GEK6 upload=XRP1Z81GWUA9 tag=YO820YPH5I3Q type=write size=2785520 2024-09-12T00:42:17.534 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.537+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=S0SD494JR3JS type=del size=3607279 2024-09-12T00:42:17.538 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.541+0000 7fcde98768c0 1 < completed delete operation key=Z4RNDW37GEK6 tag=ID9P2IRMRIZB type=del 2024-09-12T00:42:17.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.545+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=9GSSFJZUY64D type=write size=636756 2024-09-12T00:42:17.544 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.545+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~LNLY75JS0NF1.0 size=1048576 2024-09-12T00:42:17.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.549+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~LNLY75JS0NF1.1 size=1048576 2024-09-12T00:42:17.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.549+0000 7fcde98768c0 1 < canceled part key=_multipart_BZ4YUNTMOJBK.2~LNLY75JS0NF1.2 size=269154 2024-09-12T00:42:17.554 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.557+0000 7fcde98768c0 1 < canceled multipart upload key=BZ4YUNTMOJBK upload=LNLY75JS0NF1 tag=UZEQJCHXDMA7 type=write size=3414882 2024-09-12T00:42:17.557 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.561+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=WRMWNGU4MJ0D type=del size=3205790 2024-09-12T00:42:17.561 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.565+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~28T1K1VEO2KT.0 size=1048576 2024-09-12T00:42:17.561 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.565+0000 7fcde98768c0 1 < canceled part key=_multipart_5B8C6E8L5N52.2~28T1K1VEO2KT.1 size=1048576 2024-09-12T00:42:17.563 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.565+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~28T1K1VEO2KT.2 size=415167 2024-09-12T00:42:17.568 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.573+0000 7fcde98768c0 1 < canceled multipart upload key=5B8C6E8L5N52 upload=28T1K1VEO2KT tag=2E1Z7A08TL0Y type=write size=3560895 2024-09-12T00:42:17.572 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.573+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=H0LUYEWPQQZL type=del size=2266851 2024-09-12T00:42:17.575 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.577+0000 7fcde98768c0 1 < completed write operation key=5YBVLUYJW40U tag=6SNCEVVQO9RH type=write size=360911 2024-09-12T00:42:17.578 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.581+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=ZY8I3ZX5UDU7 type=del size=462140 2024-09-12T00:42:17.584 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.585+0000 7fcde98768c0 1 < suggested remove operation key=97030NBF3MI4 tag=4DYCYF4R9Q2F type=del 2024-09-12T00:42:17.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.589+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=ZQMIXN48Z7X3 type=del size=4126611 2024-09-12T00:42:17.589 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.593+0000 7fcde98768c0 1 < completed delete operation key=NVOFV649MT0A tag=JW9WVWT4030S type=del 2024-09-12T00:42:17.594 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.597+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~3JBLD9Z1PUXL.0 size=1048576 2024-09-12T00:42:17.597 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.601+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~3JBLD9Z1PUXL.1 size=740501 2024-09-12T00:42:17.597 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.601+0000 7fcde98768c0 1 > prepared multipart upload key=EDFNLQYP4L4L upload=3JBLD9Z1PUXL tag=8U3H55KITUN0 type=write size=2837653 2024-09-12T00:42:17.600 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.601+0000 7fcde98768c0 1 < completed write operation key=IV4JCE1QJC70 tag=MHGE2XTDWBVC type=write size=491884 2024-09-12T00:42:17.605 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.609+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~W18671T8A09A.0 size=635467 2024-09-12T00:42:17.605 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.609+0000 7fcde98768c0 1 > prepared multipart upload key=4487IMSOLPDV upload=W18671T8A09A tag=Q8CG06GG6IDZ type=write size=1684043 2024-09-12T00:42:17.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.609+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~M9Y2EV2IQJ3A.0 size=619543 2024-09-12T00:42:17.612 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.617+0000 7fcde98768c0 1 < completed multipart upload key=WLE5QLNPAGZA upload=M9Y2EV2IQJ3A tag=MF5K142VQSBS type=write size=1668119 2024-09-12T00:42:17.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.617+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=FG5LCB5DEM6X type=write size=614753 2024-09-12T00:42:17.623 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.621+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~IANLFBVM0ZH7.0 size=89970 2024-09-12T00:42:17.623 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.625+0000 7fcde98768c0 1 < completed multipart upload key=NVOFV649MT0A upload=IANLFBVM0ZH7 tag=HWG96UU6F2VL type=write size=1138546 2024-09-12T00:42:17.628 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.629+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~06REERG3B1EB.0 size=1048576 2024-09-12T00:42:17.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.633+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~06REERG3B1EB.1 size=749285 2024-09-12T00:42:17.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.633+0000 7fcde98768c0 1 > prepared multipart upload key=7UR0FX8HA2A5 upload=06REERG3B1EB tag=U8C4O13G24DU type=write size=2846437 2024-09-12T00:42:17.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.637+0000 7fcde98768c0 1 < completed delete operation key=3QOENE572J7A tag=1OR2G4SILNEU type=del 2024-09-12T00:42:17.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.641+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~ZCE7ZB3MJ1Q3.0 size=308769 2024-09-12T00:42:17.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.641+0000 7fcde98768c0 1 > prepared multipart upload key=WLE5QLNPAGZA upload=ZCE7ZB3MJ1Q3 tag=CI6K1HQVZRVT type=write size=1357345 2024-09-12T00:42:17.640 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.641+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~S1ATQKTCCXWU.0 size=575481 2024-09-12T00:42:17.646 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.649+0000 7fcde98768c0 1 < completed multipart upload key=HVE3YQTFZWTV upload=S1ATQKTCCXWU tag=YRRKT5TN3ZUG type=write size=1624057 2024-09-12T00:42:17.651 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.653+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~L6AOXWWGQK26.0 size=1048576 2024-09-12T00:42:17.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.657+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~L6AOXWWGQK26.1 size=215937 2024-09-12T00:42:17.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.657+0000 7fcde98768c0 1 > prepared multipart upload key=4487IMSOLPDV upload=L6AOXWWGQK26 tag=MA2GE7DKBD49 type=write size=2313089 2024-09-12T00:42:17.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.657+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~A693JHV3362S.0 size=1048576 2024-09-12T00:42:17.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.661+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~A693JHV3362S.1 size=649535 2024-09-12T00:42:17.662 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.665+0000 7fcde98768c0 1 < completed multipart upload key=5YBVLUYJW40U upload=A693JHV3362S tag=06QIHL2B51B7 type=write size=2746687 2024-09-12T00:42:17.665 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.669+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=IQ233TKW9W1D type=write size=946097 2024-09-12T00:42:17.668 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.673+0000 7fcde98768c0 1 < completed delete operation key=R2EBH0Q5885L tag=WKK5EB457KES type=del 2024-09-12T00:42:17.671 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.673+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=YK94ZGJGXPA3 type=del size=773183 2024-09-12T00:42:17.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.677+0000 7fcde98768c0 1 < suggested update operation key=HVE3YQTFZWTV tag=8IGKU3BUOTF7 type=write size=186248 2024-09-12T00:42:17.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.681+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=DP2PCSTKM9B7 type=del size=491691 2024-09-12T00:42:17.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.685+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~YD0RSLIVRHIK.0 size=1048576 2024-09-12T00:42:17.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.685+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~YD0RSLIVRHIK.1 size=97487 2024-09-12T00:42:17.688 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.689+0000 7fcde98768c0 1 < completed multipart upload key=NVOFV649MT0A upload=YD0RSLIVRHIK tag=Q7550V3L3ALY type=write size=2194639 2024-09-12T00:42:17.691 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.693+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=KN6PYOCCCJNH type=del size=852782 2024-09-12T00:42:17.694 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.697+0000 7fcde98768c0 1 < completed delete operation key=JW2GNFAYFNEK tag=S0SD494JR3JS type=del 2024-09-12T00:42:17.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.701+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=PKB714P8EYJJ type=del size=667460 2024-09-12T00:42:17.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.705+0000 7fcde98768c0 1 < completed write operation key=2T5IU2IUNGJX tag=9GSSFJZUY64D type=write size=636756 2024-09-12T00:42:17.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.705+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=MXH972WNKMAS type=write size=560318 2024-09-12T00:42:17.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.709+0000 7fcde98768c0 1 < completed delete operation key=IMITNCB1ST9E tag=WRMWNGU4MJ0D type=del 2024-09-12T00:42:17.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.713+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=J46OPRGQ604P type=del size=1195781 2024-09-12T00:42:17.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.717+0000 7fcde98768c0 1 < suggested remove operation key=J9EUM073CZHF tag=H0LUYEWPQQZL type=del 2024-09-12T00:42:17.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.721+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=D7Z3A48JN9PJ type=del size=345640 2024-09-12T00:42:17.721 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.725+0000 7fcde98768c0 1 < completed delete operation key=Z1PY2MFUC1C4 tag=ZY8I3ZX5UDU7 type=del 2024-09-12T00:42:17.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.725+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=MUD0AHAJZJE5 type=del size=1539330 2024-09-12T00:42:17.729 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.733+0000 7fcde98768c0 1 < suggested remove operation key=IV4JCE1QJC70 tag=ZQMIXN48Z7X3 type=del 2024-09-12T00:42:17.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.733+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=R397PO71HDJ0 type=del size=3422480 2024-09-12T00:42:17.735 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.737+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~3JBLD9Z1PUXL.0 size=1048576 2024-09-12T00:42:17.737 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.741+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~3JBLD9Z1PUXL.1 size=740501 2024-09-12T00:42:17.742 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.745+0000 7fcde98768c0 1 < completed multipart upload key=EDFNLQYP4L4L upload=3JBLD9Z1PUXL tag=8U3H55KITUN0 type=write size=2837653 2024-09-12T00:42:17.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.749+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~R3P1WMV6YVKG.0 size=1048576 2024-09-12T00:42:17.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.749+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~R3P1WMV6YVKG.1 size=752210 2024-09-12T00:42:17.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.749+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=R3P1WMV6YVKG tag=7L9P18MW79FD type=write size=2849362 2024-09-12T00:42:17.751 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.753+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~W18671T8A09A.0 size=635467 2024-09-12T00:42:17.755 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.757+0000 7fcde98768c0 1 < completed multipart upload key=4487IMSOLPDV upload=W18671T8A09A tag=Q8CG06GG6IDZ type=write size=1684043 2024-09-12T00:42:17.757 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.761+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=4HMMUBF18EU7 type=del size=4067835 2024-09-12T00:42:17.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.761+0000 7fcde98768c0 1 < completed write operation key=5YBVLUYJW40U tag=FG5LCB5DEM6X type=write size=614753 2024-09-12T00:42:17.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.765+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=IMPSDG4YTD0S type=del size=3143587 2024-09-12T00:42:17.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.765+0000 7fcde98768c0 1 < canceled part key=_multipart_7UR0FX8HA2A5.2~06REERG3B1EB.0 size=1048576 2024-09-12T00:42:17.764 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.769+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~06REERG3B1EB.1 size=749285 2024-09-12T00:42:17.769 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.773+0000 7fcde98768c0 1 < canceled multipart upload key=7UR0FX8HA2A5 upload=06REERG3B1EB tag=U8C4O13G24DU type=write size=2846437 2024-09-12T00:42:17.772 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.773+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=1Q2T5X76RYD5 type=del size=3212385 2024-09-12T00:42:17.774 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.777+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~ZCE7ZB3MJ1Q3.0 size=308769 2024-09-12T00:42:17.779 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.781+0000 7fcde98768c0 1 < completed multipart upload key=WLE5QLNPAGZA upload=ZCE7ZB3MJ1Q3 tag=CI6K1HQVZRVT type=write size=1357345 2024-09-12T00:42:17.782 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.785+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=DY60NY5EUMKZ type=del size=1097865 2024-09-12T00:42:17.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.789+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~L6AOXWWGQK26.0 size=1048576 2024-09-12T00:42:17.787 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.789+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~L6AOXWWGQK26.1 size=215937 2024-09-12T00:42:17.792 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.793+0000 7fcde98768c0 1 < completed multipart upload key=4487IMSOLPDV upload=L6AOXWWGQK26 tag=MA2GE7DKBD49 type=write size=2313089 2024-09-12T00:42:17.795 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.797+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=71R8O3AXAZFS type=del size=2819823 2024-09-12T00:42:17.802 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.805+0000 7fcde98768c0 1 < suggested remove operation key=5YBVLUYJW40U tag=IQ233TKW9W1D type=write 2024-09-12T00:42:17.805 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.809+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=CX6CX7X0E94D type=del size=840068 2024-09-12T00:42:17.809 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.813+0000 7fcde98768c0 -1 < failed to complete operation key=5YBVLUYJW40U tag=YK94ZGJGXPA3 type=del size=773183: (22) Invalid argument 2024-09-12T00:42:17.812 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.817+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=JVKGVO727Z3J type=del size=4151848 2024-09-12T00:42:17.816 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.817+0000 7fcde98768c0 1 < completed delete operation key=Z1PY2MFUC1C4 tag=DP2PCSTKM9B7 type=del 2024-09-12T00:42:17.819 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.821+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=8BBNYMPP5UV3 type=del size=1120013 2024-09-12T00:42:17.825 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.829+0000 7fcde98768c0 1 < suggested remove operation key=HVE3YQTFZWTV tag=KN6PYOCCCJNH type=del 2024-09-12T00:42:17.828 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.829+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=Y08VT6A2FN27 type=del size=913411 2024-09-12T00:42:17.831 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.833+0000 7fcde98768c0 1 < completed delete operation key=EDFNLQYP4L4L tag=PKB714P8EYJJ type=del 2024-09-12T00:42:17.834 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.837+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=3LY809QDAKH1 type=write size=960751 2024-09-12T00:42:17.837 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.841+0000 7fcde98768c0 1 < completed write operation key=TUMAMUZUIR7E tag=MXH972WNKMAS type=write size=560318 2024-09-12T00:42:17.839 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.841+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=C8V299S9OZPR type=del size=2738938 2024-09-12T00:42:17.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.845+0000 7fcde98768c0 1 < completed delete operation key=QD5JXFL962R5 tag=J46OPRGQ604P type=del 2024-09-12T00:42:17.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.845+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=4USBBWU7RKHF type=del size=343580 2024-09-12T00:42:17.847 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.849+0000 7fcde98768c0 1 < canceled operation key=Z4RNDW37GEK6 tag=D7Z3A48JN9PJ type=del size=345640 2024-09-12T00:42:17.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.853+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=1H9HT6W0VE94 type=del size=1407270 2024-09-12T00:42:17.852 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.853+0000 7fcde98768c0 1 < canceled operation key=ZQD0QXDN1J1I tag=MUD0AHAJZJE5 type=del size=1539330 2024-09-12T00:42:17.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.857+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=VXRDYFP021Q7 type=del size=3161058 2024-09-12T00:42:17.858 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.861+0000 7fcde98768c0 1 < completed delete operation key=EDFNLQYP4L4L tag=R397PO71HDJ0 type=del 2024-09-12T00:42:17.860 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.861+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=5LM89I56V8S9 type=del size=1707375 2024-09-12T00:42:17.863 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.865+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~R3P1WMV6YVKG.0 size=1048576 2024-09-12T00:42:17.866 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.869+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~R3P1WMV6YVKG.1 size=752210 2024-09-12T00:42:17.870 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.873+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=R3P1WMV6YVKG tag=7L9P18MW79FD type=write size=2849362 2024-09-12T00:42:17.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.877+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~VOEG0KLF6RWU.0 size=1048576 2024-09-12T00:42:17.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.881+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~VOEG0KLF6RWU.1 size=997062 2024-09-12T00:42:17.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.881+0000 7fcde98768c0 1 > prepared multipart upload key=TUMAMUZUIR7E upload=VOEG0KLF6RWU tag=LRVVUV7U8E7D type=write size=3094214 2024-09-12T00:42:17.880 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.881+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=4HMMUBF18EU7 type=del 2024-09-12T00:42:17.883 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.885+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=87N35AZFR2Y0 type=del size=2899866 2024-09-12T00:42:17.885 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.889+0000 7fcde98768c0 1 < completed delete operation key=JW2GNFAYFNEK tag=IMPSDG4YTD0S type=del 2024-09-12T00:42:17.891 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.893+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~9EFJWPD7S24B.0 size=1048576 2024-09-12T00:42:17.893 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.897+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~9EFJWPD7S24B.1 size=938572 2024-09-12T00:42:17.893 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.897+0000 7fcde98768c0 1 > prepared multipart upload key=RC9A2Y5TCP9C upload=9EFJWPD7S24B tag=4YDPLURNRD6O type=write size=3035724 2024-09-12T00:42:17.897 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.901+0000 7fcde98768c0 1 < completed delete operation key=C6PW0ETP4BG2 tag=1Q2T5X76RYD5 type=del 2024-09-12T00:42:17.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.905+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~JK5W52Q1L9T7.0 size=1048576 2024-09-12T00:42:17.904 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.905+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~JK5W52Q1L9T7.1 size=1048576 2024-09-12T00:42:17.906 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.909+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~JK5W52Q1L9T7.2 size=94370 2024-09-12T00:42:17.906 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.909+0000 7fcde98768c0 1 > prepared multipart upload key=F813QWV02TI0 upload=JK5W52Q1L9T7 tag=GXA53A2HSM4E type=write size=3240098 2024-09-12T00:42:17.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.913+0000 7fcde98768c0 1 < canceled operation key=RC9A2Y5TCP9C tag=DY60NY5EUMKZ type=del size=1097865 2024-09-12T00:42:17.911 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.913+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=NYH2EGTDTUXF type=write size=1034360 2024-09-12T00:42:17.914 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.917+0000 7fcde98768c0 -1 < failed to complete operation key=5YBVLUYJW40U tag=71R8O3AXAZFS type=del size=2819823: (22) Invalid argument 2024-09-12T00:42:17.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.921+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~U37T6FBJRJHN.0 size=972892 2024-09-12T00:42:17.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.921+0000 7fcde98768c0 1 > prepared multipart upload key=ZQD0QXDN1J1I upload=U37T6FBJRJHN tag=Q4RK8ZH53CHQ type=write size=2021468 2024-09-12T00:42:17.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.925+0000 7fcde98768c0 1 < completed delete operation key=7UR0FX8HA2A5 tag=CX6CX7X0E94D type=del 2024-09-12T00:42:17.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.925+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=4ATP2CFG8R3I type=write size=843593 2024-09-12T00:42:17.926 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.929+0000 7fcde98768c0 1 < completed delete operation key=ZQD0QXDN1J1I tag=JVKGVO727Z3J type=del 2024-09-12T00:42:17.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.933+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~SZOELDG7GL1R.0 size=1048576 2024-09-12T00:42:17.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.937+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~SZOELDG7GL1R.1 size=1048576 2024-09-12T00:42:17.935 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.937+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~SZOELDG7GL1R.2 size=225998 2024-09-12T00:42:17.935 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.937+0000 7fcde98768c0 1 > prepared multipart upload key=WLE5QLNPAGZA upload=SZOELDG7GL1R tag=NEPVPKH6W7S4 type=write size=3371726 2024-09-12T00:42:17.937 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.941+0000 7fcde98768c0 1 < completed delete operation key=Z1PY2MFUC1C4 tag=8BBNYMPP5UV3 type=del 2024-09-12T00:42:17.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.941+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=FSNX8X5IZGQH type=del size=1799105 2024-09-12T00:42:17.946 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.949+0000 7fcde98768c0 1 < suggested update operation key=3QOENE572J7A tag=Y08VT6A2FN27 type=del size=913411 2024-09-12T00:42:17.949 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.953+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=VG6UINT8OKGL type=del size=3941027 2024-09-12T00:42:17.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.957+0000 7fcde98768c0 1 < suggested remove operation key=QD5JXFL962R5 tag=3LY809QDAKH1 type=write 2024-09-12T00:42:17.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.961+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~UHOGTQPQ6HDL.0 size=1048576 2024-09-12T00:42:17.960 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.965+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~UHOGTQPQ6HDL.1 size=1048576 2024-09-12T00:42:17.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.969+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~UHOGTQPQ6HDL.2 size=424382 2024-09-12T00:42:17.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.969+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=UHOGTQPQ6HDL tag=DFM639I1ZXAC type=write size=3570110 2024-09-12T00:42:17.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.969+0000 7fcde98768c0 1 < completed delete operation key=RC9A2Y5TCP9C tag=C8V299S9OZPR type=del 2024-09-12T00:42:17.971 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.973+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~CO15YFX1X3W2.0 size=1048576 2024-09-12T00:42:17.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.977+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~CO15YFX1X3W2.1 size=1048576 2024-09-12T00:42:17.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.977+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~CO15YFX1X3W2.2 size=298138 2024-09-12T00:42:17.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.977+0000 7fcde98768c0 1 > prepared multipart upload key=5YBVLUYJW40U upload=CO15YFX1X3W2 tag=74NO5LR0X1XE type=write size=3443866 2024-09-12T00:42:17.977 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.981+0000 7fcde98768c0 1 < completed delete operation key=RC9A2Y5TCP9C tag=4USBBWU7RKHF type=del 2024-09-12T00:42:17.981 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.985+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~UHGADLAVPKUA.0 size=600173 2024-09-12T00:42:17.981 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.985+0000 7fcde98768c0 1 > prepared multipart upload key=KME8ZTTUGOXY upload=UHGADLAVPKUA tag=SKCZE4LS74MB type=write size=1648749 2024-09-12T00:42:17.983 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.985+0000 7fcde98768c0 1 < completed delete operation key=J9EUM073CZHF tag=1H9HT6W0VE94 type=del 2024-09-12T00:42:17.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.989+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=P2HHLS68ZC3D type=del size=1146215 2024-09-12T00:42:17.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.989+0000 7fcde98768c0 1 < canceled operation key=BZ4YUNTMOJBK tag=VXRDYFP021Q7 type=del size=3161058 2024-09-12T00:42:17.992 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.993+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~RCLWTHX0VS07.0 size=1048576 2024-09-12T00:42:17.994 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.997+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~RCLWTHX0VS07.1 size=962961 2024-09-12T00:42:17.994 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:17.997+0000 7fcde98768c0 1 > prepared multipart upload key=7UR0FX8HA2A5 upload=RCLWTHX0VS07 tag=EP96B1OV072Y type=write size=3060113 2024-09-12T00:42:18.000 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.001+0000 7fcde98768c0 1 < suggested remove operation key=5B8C6E8L5N52 tag=5LM89I56V8S9 type=del 2024-09-12T00:42:18.004 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.005+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~8KALE1JEODHM.0 size=641814 2024-09-12T00:42:18.004 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.005+0000 7fcde98768c0 1 > prepared multipart upload key=2T5IU2IUNGJX upload=8KALE1JEODHM tag=98M0LI5KX59T type=write size=1690390 2024-09-12T00:42:18.007 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.009+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~VOEG0KLF6RWU.0 size=1048576 2024-09-12T00:42:18.008 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.013+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~VOEG0KLF6RWU.1 size=997062 2024-09-12T00:42:18.013 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.017+0000 7fcde98768c0 1 < completed multipart upload key=TUMAMUZUIR7E upload=VOEG0KLF6RWU tag=LRVVUV7U8E7D type=write size=3094214 2024-09-12T00:42:18.017 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.021+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~XKJN4I2VO16X.0 size=1048576 2024-09-12T00:42:18.018 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.021+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~XKJN4I2VO16X.1 size=495553 2024-09-12T00:42:18.018 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.021+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=XKJN4I2VO16X tag=T08C0VEGD049 type=write size=2592705 2024-09-12T00:42:18.021 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.025+0000 7fcde98768c0 1 < completed delete operation key=5YBVLUYJW40U tag=87N35AZFR2Y0 type=del 2024-09-12T00:42:18.023 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.025+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=KPTDQ7HY34DD type=del size=800694 2024-09-12T00:42:18.026 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.029+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~9EFJWPD7S24B.0 size=1048576 2024-09-12T00:42:18.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.029+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~9EFJWPD7S24B.1 size=938572 2024-09-12T00:42:18.031 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.033+0000 7fcde98768c0 1 < completed multipart upload key=RC9A2Y5TCP9C upload=9EFJWPD7S24B tag=4YDPLURNRD6O type=write size=3035724 2024-09-12T00:42:18.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.037+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=SJ6BL6ABI1W1 type=del size=628055 2024-09-12T00:42:18.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.037+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~JK5W52Q1L9T7.0 size=1048576 2024-09-12T00:42:18.037 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.041+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~JK5W52Q1L9T7.1 size=1048576 2024-09-12T00:42:18.039 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.041+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~JK5W52Q1L9T7.2 size=94370 2024-09-12T00:42:18.042 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.045+0000 7fcde98768c0 1 < completed multipart upload key=F813QWV02TI0 upload=JK5W52Q1L9T7 tag=GXA53A2HSM4E type=write size=3240098 2024-09-12T00:42:18.046 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.049+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~BS1HFWO1GN9F.0 size=1048576 2024-09-12T00:42:18.048 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.049+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~BS1HFWO1GN9F.1 size=500702 2024-09-12T00:42:18.048 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.049+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=BS1HFWO1GN9F tag=BT8QXMJU7051 type=write size=2597854 2024-09-12T00:42:18.050 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.053+0000 7fcde98768c0 1 < completed write operation key=WLE5QLNPAGZA tag=NYH2EGTDTUXF type=write size=1034360 2024-09-12T00:42:18.052 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.057+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=I9KZ414I9FIN type=del size=2070750 2024-09-12T00:42:18.054 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.057+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~U37T6FBJRJHN.0 size=972892 2024-09-12T00:42:18.058 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.061+0000 7fcde98768c0 1 < completed multipart upload key=ZQD0QXDN1J1I upload=U37T6FBJRJHN tag=Q4RK8ZH53CHQ type=write size=2021468 2024-09-12T00:42:18.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.061+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=U9SKZ5P6JOLU type=del size=3098110 2024-09-12T00:42:18.064 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.069+0000 7fcde98768c0 1 < suggested update operation key=R2EBH0Q5885L tag=4ATP2CFG8R3I type=write size=843593 2024-09-12T00:42:18.067 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.069+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=F1KF4YL46XZD type=del size=241812 2024-09-12T00:42:18.067 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.069+0000 7fcde98768c0 1 < canceled part key=_multipart_WLE5QLNPAGZA.2~SZOELDG7GL1R.0 size=1048576 2024-09-12T00:42:18.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.073+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~SZOELDG7GL1R.1 size=1048576 2024-09-12T00:42:18.071 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.073+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~SZOELDG7GL1R.2 size=225998 2024-09-12T00:42:18.074 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.077+0000 7fcde98768c0 1 < canceled multipart upload key=WLE5QLNPAGZA upload=SZOELDG7GL1R tag=NEPVPKH6W7S4 type=write size=3371726 2024-09-12T00:42:18.077 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.081+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=0J4G6DEBAUJO type=write size=994877 2024-09-12T00:42:18.079 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.081+0000 7fcde98768c0 1 < completed delete operation key=G6R8BX1H7SPM tag=FSNX8X5IZGQH type=del 2024-09-12T00:42:18.082 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.085+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=QQC8NUJ63HC1 type=del size=1890035 2024-09-12T00:42:18.084 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.085+0000 7fcde98768c0 -1 < failed to complete operation key=5B8C6E8L5N52 tag=VG6UINT8OKGL type=del size=3941027: (22) Invalid argument 2024-09-12T00:42:18.086 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.089+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=UJTGB1XSY1BT type=del size=3547816 2024-09-12T00:42:18.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.093+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~UHOGTQPQ6HDL.0 size=1048576 2024-09-12T00:42:18.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.093+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~UHOGTQPQ6HDL.1 size=1048576 2024-09-12T00:42:18.093 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.097+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~UHOGTQPQ6HDL.2 size=424382 2024-09-12T00:42:18.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.101+0000 7fcde98768c0 1 < completed multipart upload key=IV4JCE1QJC70 upload=UHOGTQPQ6HDL tag=DFM639I1ZXAC type=write size=3570110 2024-09-12T00:42:18.099 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.101+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=JEM5CUXJ02OA type=write size=113203 2024-09-12T00:42:18.102 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.105+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~CO15YFX1X3W2.0 size=1048576 2024-09-12T00:42:18.104 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.105+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~CO15YFX1X3W2.1 size=1048576 2024-09-12T00:42:18.106 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.109+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~CO15YFX1X3W2.2 size=298138 2024-09-12T00:42:18.110 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.113+0000 7fcde98768c0 1 < completed multipart upload key=5YBVLUYJW40U upload=CO15YFX1X3W2 tag=74NO5LR0X1XE type=write size=3443866 2024-09-12T00:42:18.113 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.117+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=2EZ1V4LKFASD type=del size=1556859 2024-09-12T00:42:18.116 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.117+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~UHGADLAVPKUA.0 size=600173 2024-09-12T00:42:18.120 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.121+0000 7fcde98768c0 1 < completed multipart upload key=KME8ZTTUGOXY upload=UHGADLAVPKUA tag=SKCZE4LS74MB type=write size=1648749 2024-09-12T00:42:18.124 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.125+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~3J0ZC6S0F2U0.0 size=858495 2024-09-12T00:42:18.124 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.125+0000 7fcde98768c0 1 > prepared multipart upload key=NVOFV649MT0A upload=3J0ZC6S0F2U0 tag=3GVV3Y45DEPF type=write size=1907071 2024-09-12T00:42:18.127 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.129+0000 7fcde98768c0 1 < completed delete operation key=97030NBF3MI4 tag=P2HHLS68ZC3D type=del 2024-09-12T00:42:18.129 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.133+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=YHAAEIME9V56 type=del size=2573436 2024-09-12T00:42:18.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.133+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~RCLWTHX0VS07.0 size=1048576 2024-09-12T00:42:18.134 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.137+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~RCLWTHX0VS07.1 size=962961 2024-09-12T00:42:18.138 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.141+0000 7fcde98768c0 1 < completed multipart upload key=7UR0FX8HA2A5 upload=RCLWTHX0VS07 tag=EP96B1OV072Y type=write size=3060113 2024-09-12T00:42:18.141 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.145+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=0WWVHA4GEFHX type=del size=1655051 2024-09-12T00:42:18.141 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.145+0000 7fcde98768c0 1 < canceled part key=_multipart_2T5IU2IUNGJX.2~8KALE1JEODHM.0 size=641814 2024-09-12T00:42:18.145 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.149+0000 7fcde98768c0 1 < canceled multipart upload key=2T5IU2IUNGJX upload=8KALE1JEODHM tag=98M0LI5KX59T type=write size=1690390 2024-09-12T00:42:18.148 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.149+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=MTO7IFIQ2AS6 type=write size=57149 2024-09-12T00:42:18.151 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.153+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~XKJN4I2VO16X.0 size=1048576 2024-09-12T00:42:18.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.157+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~XKJN4I2VO16X.1 size=495553 2024-09-12T00:42:18.157 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.161+0000 7fcde98768c0 1 < completed multipart upload key=V80E1NH858IK upload=XKJN4I2VO16X tag=T08C0VEGD049 type=write size=2592705 2024-09-12T00:42:18.161 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.165+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~B29FN4O77MF6.0 size=1048576 2024-09-12T00:42:18.163 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.165+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~B29FN4O77MF6.1 size=1048576 2024-09-12T00:42:18.165 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.169+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~B29FN4O77MF6.2 size=896332 2024-09-12T00:42:18.165 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.169+0000 7fcde98768c0 1 > prepared multipart upload key=WLE5QLNPAGZA upload=B29FN4O77MF6 tag=NRNIUPCC2KW8 type=write size=4042060 2024-09-12T00:42:18.168 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.169+0000 7fcde98768c0 1 < completed delete operation key=368TXYQVK9C3 tag=KPTDQ7HY34DD type=del 2024-09-12T00:42:18.172 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.173+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~OP0AFJPHGF42.0 size=1048576 2024-09-12T00:42:18.174 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.177+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~OP0AFJPHGF42.1 size=981654 2024-09-12T00:42:18.174 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.177+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=OP0AFJPHGF42 tag=GT70A1JP3WAA type=write size=3078806 2024-09-12T00:42:18.177 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.181+0000 7fcde98768c0 1 < completed delete operation key=RC9A2Y5TCP9C tag=SJ6BL6ABI1W1 type=del 2024-09-12T00:42:18.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.181+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=1QBABAN4VLEF type=del size=1311911 2024-09-12T00:42:18.184 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.189+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~BS1HFWO1GN9F.0 size=1048576 2024-09-12T00:42:18.187 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.189+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~BS1HFWO1GN9F.1 size=500702 2024-09-12T00:42:18.191 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.193+0000 7fcde98768c0 1 < completed multipart upload key=IV4JCE1QJC70 upload=BS1HFWO1GN9F tag=BT8QXMJU7051 type=write size=2597854 2024-09-12T00:42:18.194 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.197+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=DMAU51HESDDD type=write size=877930 2024-09-12T00:42:18.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.197+0000 7fcde98768c0 1 < canceled operation key=HVE3YQTFZWTV tag=I9KZ414I9FIN type=del size=2070750 2024-09-12T00:42:18.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.205+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~5TGDBZ4QNN2A.0 size=576917 2024-09-12T00:42:18.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.205+0000 7fcde98768c0 1 > prepared multipart upload key=4487IMSOLPDV upload=5TGDBZ4QNN2A tag=LXQ2ISPJ0UJ4 type=write size=1625493 2024-09-12T00:42:18.204 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.205+0000 7fcde98768c0 1 < completed delete operation key=3QOENE572J7A tag=U9SKZ5P6JOLU type=del 2024-09-12T00:42:18.207 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.209+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~0R08Q2XPFE66.0 size=469106 2024-09-12T00:42:18.207 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.209+0000 7fcde98768c0 1 > prepared multipart upload key=3X9I78PMR1HV upload=0R08Q2XPFE66 tag=TA63F73V7ZVO type=write size=1517682 2024-09-12T00:42:18.210 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.213+0000 7fcde98768c0 1 < completed delete operation key=V80E1NH858IK tag=F1KF4YL46XZD type=del 2024-09-12T00:42:18.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.217+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~820DCV5AADNY.0 size=1048576 2024-09-12T00:42:18.216 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.217+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~820DCV5AADNY.1 size=1048576 2024-09-12T00:42:18.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.221+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~820DCV5AADNY.2 size=810819 2024-09-12T00:42:18.218 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.221+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=820DCV5AADNY tag=8S3UPEQZISCC type=write size=3956547 2024-09-12T00:42:18.220 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.221+0000 7fcde98768c0 1 < completed write operation key=7UR0FX8HA2A5 tag=0J4G6DEBAUJO type=write size=994877 2024-09-12T00:42:18.225 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.229+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~AR5B23BCKLFQ.0 size=1048576 2024-09-12T00:42:18.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.229+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~AR5B23BCKLFQ.1 size=712017 2024-09-12T00:42:18.227 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.229+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=AR5B23BCKLFQ tag=SKBYQ6N7WGAS type=write size=2809169 2024-09-12T00:42:18.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.233+0000 7fcde98768c0 1 < completed delete operation key=Z4RNDW37GEK6 tag=QQC8NUJ63HC1 type=del 2024-09-12T00:42:18.233 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.237+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~2VZUHNDKGKEO.0 size=1048576 2024-09-12T00:42:18.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.237+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~2VZUHNDKGKEO.1 size=1048576 2024-09-12T00:42:18.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.241+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~2VZUHNDKGKEO.2 size=995193 2024-09-12T00:42:18.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.241+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=2VZUHNDKGKEO tag=0SEM9T7QN68A type=write size=4140921 2024-09-12T00:42:18.239 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.241+0000 7fcde98768c0 1 < completed delete operation key=4487IMSOLPDV tag=UJTGB1XSY1BT type=del 2024-09-12T00:42:18.243 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.245+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~064TKXPY3Z01.0 size=1048576 2024-09-12T00:42:18.245 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.249+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~064TKXPY3Z01.1 size=1048576 2024-09-12T00:42:18.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.249+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~064TKXPY3Z01.2 size=358386 2024-09-12T00:42:18.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.249+0000 7fcde98768c0 1 > prepared multipart upload key=EDFNLQYP4L4L upload=064TKXPY3Z01 tag=HOM3FWQIC3MM type=write size=3504114 2024-09-12T00:42:18.249 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.253+0000 7fcde98768c0 1 < completed write operation key=F813QWV02TI0 tag=JEM5CUXJ02OA type=write size=113203 2024-09-12T00:42:18.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.257+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~75AUSD0JURLU.0 size=1048576 2024-09-12T00:42:18.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.257+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~75AUSD0JURLU.1 size=284028 2024-09-12T00:42:18.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.257+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=75AUSD0JURLU tag=GG0185FCUJXT type=write size=2381180 2024-09-12T00:42:18.258 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.261+0000 7fcde98768c0 1 < completed delete operation key=3X9I78PMR1HV tag=2EZ1V4LKFASD type=del 2024-09-12T00:42:18.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.261+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=Q3MF56SHWXLO type=del size=2703657 2024-09-12T00:42:18.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.265+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~3J0ZC6S0F2U0.0 size=858495 2024-09-12T00:42:18.267 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.269+0000 7fcde98768c0 1 < completed multipart upload key=NVOFV649MT0A upload=3J0ZC6S0F2U0 tag=3GVV3Y45DEPF type=write size=1907071 2024-09-12T00:42:18.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.273+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=WDQBEW4HNACQ type=write size=867604 2024-09-12T00:42:18.272 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.273+0000 7fcde98768c0 1 < completed delete operation key=3QOENE572J7A tag=YHAAEIME9V56 type=del 2024-09-12T00:42:18.277 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.281+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~39L7QT11Z723.0 size=1048576 2024-09-12T00:42:18.279 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.281+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~39L7QT11Z723.1 size=57810 2024-09-12T00:42:18.280 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.281+0000 7fcde98768c0 1 > prepared multipart upload key=BQGIXJJWBAN0 upload=39L7QT11Z723 tag=QLIZ2Y1TOBFD type=write size=2154962 2024-09-12T00:42:18.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.285+0000 7fcde98768c0 1 < suggested remove operation key=HVE3YQTFZWTV tag=0WWVHA4GEFHX type=del 2024-09-12T00:42:18.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.289+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=4Z1G4KM5HBV5 type=write size=590202 2024-09-12T00:42:18.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.293+0000 7fcde98768c0 1 < completed write operation key=3X9I78PMR1HV tag=MTO7IFIQ2AS6 type=write size=57149 2024-09-12T00:42:18.292 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.293+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=CXIE1TH3HITU type=write size=299731 2024-09-12T00:42:18.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.297+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~B29FN4O77MF6.0 size=1048576 2024-09-12T00:42:18.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.301+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~B29FN4O77MF6.1 size=1048576 2024-09-12T00:42:18.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.301+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~B29FN4O77MF6.2 size=896332 2024-09-12T00:42:18.303 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.305+0000 7fcde98768c0 1 < completed multipart upload key=WLE5QLNPAGZA upload=B29FN4O77MF6 tag=NRNIUPCC2KW8 type=write size=4042060 2024-09-12T00:42:18.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.309+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~WANDSXJOGS1C.0 size=1048576 2024-09-12T00:42:18.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.313+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~WANDSXJOGS1C.1 size=1048576 2024-09-12T00:42:18.311 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.313+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~WANDSXJOGS1C.2 size=1015173 2024-09-12T00:42:18.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.313+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=WANDSXJOGS1C tag=S0F083T392S2 type=write size=4160901 2024-09-12T00:42:18.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.317+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~OP0AFJPHGF42.0 size=1048576 2024-09-12T00:42:18.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.321+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~OP0AFJPHGF42.1 size=981654 2024-09-12T00:42:18.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.325+0000 7fcde98768c0 1 < completed multipart upload key=BZ4YUNTMOJBK upload=OP0AFJPHGF42 tag=GT70A1JP3WAA type=write size=3078806 2024-09-12T00:42:18.324 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.325+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=6AMLFECMJCNX type=write size=6021 2024-09-12T00:42:18.327 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.329+0000 7fcde98768c0 1 < canceled operation key=R2EBH0Q5885L tag=1QBABAN4VLEF type=del size=1311911 2024-09-12T00:42:18.332 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.333+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~2WL11K4U8DC2.0 size=1048576 2024-09-12T00:42:18.334 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.337+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~2WL11K4U8DC2.1 size=1048576 2024-09-12T00:42:18.337 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.341+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~2WL11K4U8DC2.2 size=626036 2024-09-12T00:42:18.337 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.341+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=2WL11K4U8DC2 tag=O7AALU8KNHTM type=write size=3771764 2024-09-12T00:42:18.339 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.341+0000 7fcde98768c0 1 < completed write operation key=Z4RNDW37GEK6 tag=DMAU51HESDDD type=write size=877930 2024-09-12T00:42:18.343 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.345+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~M67D95093P6N.0 size=1048576 2024-09-12T00:42:18.345 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.349+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~M67D95093P6N.1 size=723292 2024-09-12T00:42:18.345 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.349+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=M67D95093P6N tag=LLALDUO5WAIP type=write size=2820444 2024-09-12T00:42:18.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.349+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~5TGDBZ4QNN2A.0 size=576917 2024-09-12T00:42:18.351 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.353+0000 7fcde98768c0 1 < completed multipart upload key=4487IMSOLPDV upload=5TGDBZ4QNN2A tag=LXQ2ISPJ0UJ4 type=write size=1625493 2024-09-12T00:42:18.354 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.357+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=901N8MSNQ1JM type=del size=1827142 2024-09-12T00:42:18.357 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.361+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~0R08Q2XPFE66.0 size=469106 2024-09-12T00:42:18.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.365+0000 7fcde98768c0 1 < completed multipart upload key=3X9I78PMR1HV upload=0R08Q2XPFE66 tag=TA63F73V7ZVO type=write size=1517682 2024-09-12T00:42:18.365 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.369+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~50DLQ953JDA3.0 size=1048576 2024-09-12T00:42:18.368 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.369+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~50DLQ953JDA3.1 size=1048576 2024-09-12T00:42:18.370 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.373+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~50DLQ953JDA3.2 size=209896 2024-09-12T00:42:18.370 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.373+0000 7fcde98768c0 1 > prepared multipart upload key=RC9A2Y5TCP9C upload=50DLQ953JDA3 tag=NHFF7AMH3L3B type=write size=3355624 2024-09-12T00:42:18.370 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.373+0000 7fcde98768c0 1 < canceled part key=_multipart_QD5JXFL962R5.2~820DCV5AADNY.0 size=1048576 2024-09-12T00:42:18.372 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.377+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~820DCV5AADNY.1 size=1048576 2024-09-12T00:42:18.374 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.377+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~820DCV5AADNY.2 size=810819 2024-09-12T00:42:18.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.381+0000 7fcde98768c0 1 < canceled multipart upload key=QD5JXFL962R5 upload=820DCV5AADNY tag=8S3UPEQZISCC type=write size=3956547 2024-09-12T00:42:18.381 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.385+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=CA9BD253P2H4 type=del size=4179537 2024-09-12T00:42:18.384 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.385+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~AR5B23BCKLFQ.0 size=1048576 2024-09-12T00:42:18.387 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.389+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~AR5B23BCKLFQ.1 size=712017 2024-09-12T00:42:18.392 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.393+0000 7fcde98768c0 1 < completed multipart upload key=QD5JXFL962R5 upload=AR5B23BCKLFQ tag=SKBYQ6N7WGAS type=write size=2809169 2024-09-12T00:42:18.395 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.397+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=Q0M1T1SAAJU9 type=del size=3030807 2024-09-12T00:42:18.395 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.397+0000 7fcde98768c0 1 < canceled part key=_multipart_BZ4YUNTMOJBK.2~2VZUHNDKGKEO.0 size=1048576 2024-09-12T00:42:18.398 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.401+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~2VZUHNDKGKEO.1 size=1048576 2024-09-12T00:42:18.400 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.401+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~2VZUHNDKGKEO.2 size=995193 2024-09-12T00:42:18.405 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.409+0000 7fcde98768c0 1 < canceled multipart upload key=BZ4YUNTMOJBK upload=2VZUHNDKGKEO tag=0SEM9T7QN68A type=write size=4140921 2024-09-12T00:42:18.410 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.413+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~TM0XZOEYVRY1.0 size=1048576 2024-09-12T00:42:18.412 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.413+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~TM0XZOEYVRY1.1 size=1048576 2024-09-12T00:42:18.416 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.417+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~TM0XZOEYVRY1.2 size=641666 2024-09-12T00:42:18.416 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.417+0000 7fcde98768c0 1 > prepared multipart upload key=5YBVLUYJW40U upload=TM0XZOEYVRY1 tag=KQ8T29BLF73Q type=write size=3787394 2024-09-12T00:42:18.418 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.421+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~064TKXPY3Z01.0 size=1048576 2024-09-12T00:42:18.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.425+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~064TKXPY3Z01.1 size=1048576 2024-09-12T00:42:18.423 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.425+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~064TKXPY3Z01.2 size=358386 2024-09-12T00:42:18.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.429+0000 7fcde98768c0 1 < completed multipart upload key=EDFNLQYP4L4L upload=064TKXPY3Z01 tag=HOM3FWQIC3MM type=write size=3504114 2024-09-12T00:42:18.429 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.433+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=ZA9JFK2XYPJD type=write size=944061 2024-09-12T00:42:18.431 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.433+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~75AUSD0JURLU.0 size=1048576 2024-09-12T00:42:18.433 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.437+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~75AUSD0JURLU.1 size=284028 2024-09-12T00:42:18.437 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.441+0000 7fcde98768c0 1 < completed multipart upload key=QD5JXFL962R5 upload=75AUSD0JURLU tag=GG0185FCUJXT type=write size=2381180 2024-09-12T00:42:18.440 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.441+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=0MACQBQHQVRT type=del size=2988899 2024-09-12T00:42:18.444 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.445+0000 7fcde98768c0 1 < completed delete operation key=5YBVLUYJW40U tag=Q3MF56SHWXLO type=del 2024-09-12T00:42:18.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.449+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~7TC3NN4PIENU.0 size=1048576 2024-09-12T00:42:18.449 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.453+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~7TC3NN4PIENU.1 size=378965 2024-09-12T00:42:18.449 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.453+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=7TC3NN4PIENU tag=ZY72OJZKA5EO type=write size=2476117 2024-09-12T00:42:18.452 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.453+0000 7fcde98768c0 1 < completed write operation key=4487IMSOLPDV tag=WDQBEW4HNACQ type=write size=867604 2024-09-12T00:42:18.455 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.457+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=9K1NPWM599EA type=del size=143842 2024-09-12T00:42:18.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.461+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~39L7QT11Z723.0 size=1048576 2024-09-12T00:42:18.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.461+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~39L7QT11Z723.1 size=57810 2024-09-12T00:42:18.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.465+0000 7fcde98768c0 1 < completed multipart upload key=BQGIXJJWBAN0 upload=39L7QT11Z723 tag=QLIZ2Y1TOBFD type=write size=2154962 2024-09-12T00:42:18.468 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.469+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~9P9IVZFN5V7A.0 size=186811 2024-09-12T00:42:18.468 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.469+0000 7fcde98768c0 1 > prepared multipart upload key=NVOFV649MT0A upload=9P9IVZFN5V7A tag=VD1BQC5ISWQ0 type=write size=1235387 2024-09-12T00:42:18.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.473+0000 7fcde98768c0 1 < completed write operation key=3QOENE572J7A tag=4Z1G4KM5HBV5 type=write size=590202 2024-09-12T00:42:18.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.477+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~PH6E3D19YRO2.0 size=1048576 2024-09-12T00:42:18.477 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.481+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~PH6E3D19YRO2.1 size=1048576 2024-09-12T00:42:18.479 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.481+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~PH6E3D19YRO2.2 size=94317 2024-09-12T00:42:18.479 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.481+0000 7fcde98768c0 1 > prepared multipart upload key=7UR0FX8HA2A5 upload=PH6E3D19YRO2 tag=B1T1ILPM37CC type=write size=3240045 2024-09-12T00:42:18.482 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.485+0000 7fcde98768c0 1 < completed write operation key=FUJIUIR1E00J tag=CXIE1TH3HITU type=write size=299731 2024-09-12T00:42:18.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.489+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=1DTEK8VD80HI type=del size=2155453 2024-09-12T00:42:18.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.489+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~WANDSXJOGS1C.0 size=1048576 2024-09-12T00:42:18.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.493+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~WANDSXJOGS1C.1 size=1048576 2024-09-12T00:42:18.492 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.493+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~WANDSXJOGS1C.2 size=1015173 2024-09-12T00:42:18.497 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.501+0000 7fcde98768c0 1 < completed multipart upload key=QD5JXFL962R5 upload=WANDSXJOGS1C tag=S0F083T392S2 type=write size=4160901 2024-09-12T00:42:18.501 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.505+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~GZEZX3S842V1.0 size=1048576 2024-09-12T00:42:18.504 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.505+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~GZEZX3S842V1.1 size=1048576 2024-09-12T00:42:18.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.509+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~GZEZX3S842V1.2 size=305641 2024-09-12T00:42:18.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.509+0000 7fcde98768c0 1 > prepared multipart upload key=ZQD0QXDN1J1I upload=GZEZX3S842V1 tag=65STXA45B2O1 type=write size=3451369 2024-09-12T00:42:18.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.513+0000 7fcde98768c0 1 < completed write operation key=V80E1NH858IK tag=6AMLFECMJCNX type=write size=6021 2024-09-12T00:42:18.512 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.513+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=RVHSBF29RGAP type=write size=27978 2024-09-12T00:42:18.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.517+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~2WL11K4U8DC2.0 size=1048576 2024-09-12T00:42:18.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.517+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~2WL11K4U8DC2.1 size=1048576 2024-09-12T00:42:18.519 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.521+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~2WL11K4U8DC2.2 size=626036 2024-09-12T00:42:18.523 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.525+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=2WL11K4U8DC2 tag=O7AALU8KNHTM type=write size=3771764 2024-09-12T00:42:18.529 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.533+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~J9GX5N3HJHKE.0 size=1048576 2024-09-12T00:42:18.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.533+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~J9GX5N3HJHKE.1 size=116168 2024-09-12T00:42:18.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.533+0000 7fcde98768c0 1 > prepared multipart upload key=BQGIXJJWBAN0 upload=J9GX5N3HJHKE tag=W9Y5O9UE23WV type=write size=2213320 2024-09-12T00:42:18.534 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.537+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~M67D95093P6N.0 size=1048576 2024-09-12T00:42:18.536 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.537+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~M67D95093P6N.1 size=723292 2024-09-12T00:42:18.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.545+0000 7fcde98768c0 1 < completed multipart upload key=IV4JCE1QJC70 upload=M67D95093P6N tag=LLALDUO5WAIP type=write size=2820444 2024-09-12T00:42:18.544 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.545+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=6M90VA7I7UMC type=del size=2484590 2024-09-12T00:42:18.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.549+0000 7fcde98768c0 1 < completed delete operation key=EDFNLQYP4L4L tag=901N8MSNQ1JM type=del 2024-09-12T00:42:18.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.553+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=5OKA4YTXZADM type=write size=916572 2024-09-12T00:42:18.553 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.557+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~50DLQ953JDA3.0 size=1048576 2024-09-12T00:42:18.555 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.557+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~50DLQ953JDA3.1 size=1048576 2024-09-12T00:42:18.557 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.561+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~50DLQ953JDA3.2 size=209896 2024-09-12T00:42:18.562 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.565+0000 7fcde98768c0 1 < completed multipart upload key=RC9A2Y5TCP9C upload=50DLQ953JDA3 tag=NHFF7AMH3L3B type=write size=3355624 2024-09-12T00:42:18.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.569+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~TSMBPV69B96E.0 size=788492 2024-09-12T00:42:18.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.569+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=TSMBPV69B96E tag=FHBEBGTQMGUB type=write size=1837068 2024-09-12T00:42:18.570 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.573+0000 7fcde98768c0 1 < completed delete operation key=EDFNLQYP4L4L tag=CA9BD253P2H4 type=del 2024-09-12T00:42:18.576 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.577+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~OE1995ESX6GG.0 size=1048576 2024-09-12T00:42:18.590 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.581+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~OE1995ESX6GG.1 size=922955 2024-09-12T00:42:18.591 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.581+0000 7fcde98768c0 1 > prepared multipart upload key=R2EBH0Q5885L upload=OE1995ESX6GG tag=G0EQHAE6IOHH type=write size=3020107 2024-09-12T00:42:18.591 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.585+0000 7fcde98768c0 1 < suggested remove operation key=C6PW0ETP4BG2 tag=Q0M1T1SAAJU9 type=del 2024-09-12T00:42:18.591 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.589+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=GVXII0D4YPID type=write size=391913 2024-09-12T00:42:18.591 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.593+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~TM0XZOEYVRY1.0 size=1048576 2024-09-12T00:42:18.592 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.593+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~TM0XZOEYVRY1.1 size=1048576 2024-09-12T00:42:18.594 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.597+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~TM0XZOEYVRY1.2 size=641666 2024-09-12T00:42:18.598 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.601+0000 7fcde98768c0 1 < completed multipart upload key=5YBVLUYJW40U upload=TM0XZOEYVRY1 tag=KQ8T29BLF73Q type=write size=3787394 2024-09-12T00:42:18.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.601+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=DSK0ER62ZEFJ type=del size=2968265 2024-09-12T00:42:18.603 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.605+0000 7fcde98768c0 -1 < failed to complete operation key=C6PW0ETP4BG2 tag=ZA9JFK2XYPJD type=write size=944061: (22) Invalid argument 2024-09-12T00:42:18.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.609+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~2XDPL2PW71A7.0 size=1023921 2024-09-12T00:42:18.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.609+0000 7fcde98768c0 1 > prepared multipart upload key=KME8ZTTUGOXY upload=2XDPL2PW71A7 tag=PUOMTV9IK96S type=write size=2072497 2024-09-12T00:42:18.611 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.613+0000 7fcde98768c0 1 < completed delete operation key=NVOFV649MT0A tag=0MACQBQHQVRT type=del 2024-09-12T00:42:18.613 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.617+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=JK6L9K8I1FYH type=write size=958363 2024-09-12T00:42:18.616 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.617+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~7TC3NN4PIENU.0 size=1048576 2024-09-12T00:42:18.618 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.621+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~7TC3NN4PIENU.1 size=378965 2024-09-12T00:42:18.622 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.625+0000 7fcde98768c0 1 < completed multipart upload key=BZ4YUNTMOJBK upload=7TC3NN4PIENU tag=ZY72OJZKA5EO type=write size=2476117 2024-09-12T00:42:18.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.629+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=ZT52E84FJ8O5 type=del size=148651 2024-09-12T00:42:18.627 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.629+0000 7fcde98768c0 1 < completed delete operation key=2T5IU2IUNGJX tag=9K1NPWM599EA type=del 2024-09-12T00:42:18.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.633+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=N8LGF5985036 type=del size=3982632 2024-09-12T00:42:18.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.637+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~9P9IVZFN5V7A.0 size=186811 2024-09-12T00:42:18.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.641+0000 7fcde98768c0 1 < completed multipart upload key=NVOFV649MT0A upload=9P9IVZFN5V7A tag=VD1BQC5ISWQ0 type=write size=1235387 2024-09-12T00:42:18.643 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.645+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~H4J3BG42TL60.0 size=1048576 2024-09-12T00:42:18.649 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.649+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~H4J3BG42TL60.1 size=843890 2024-09-12T00:42:18.649 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.649+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=H4J3BG42TL60 tag=HLME2S5FLKQ8 type=write size=2941042 2024-09-12T00:42:18.650 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.649+0000 7fcde98768c0 1 < canceled part key=_multipart_7UR0FX8HA2A5.2~PH6E3D19YRO2.0 size=1048576 2024-09-12T00:42:18.650 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.653+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~PH6E3D19YRO2.1 size=1048576 2024-09-12T00:42:18.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.653+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~PH6E3D19YRO2.2 size=94317 2024-09-12T00:42:18.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.657+0000 7fcde98768c0 1 < canceled multipart upload key=7UR0FX8HA2A5 upload=PH6E3D19YRO2 tag=B1T1ILPM37CC type=write size=3240045 2024-09-12T00:42:18.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.665+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~6KWS7QIWXUEP.0 size=1048576 2024-09-12T00:42:18.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.669+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~6KWS7QIWXUEP.1 size=1048576 2024-09-12T00:42:18.670 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.673+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~6KWS7QIWXUEP.2 size=245295 2024-09-12T00:42:18.671 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.673+0000 7fcde98768c0 1 > prepared multipart upload key=BQGIXJJWBAN0 upload=6KWS7QIWXUEP tag=R6BBJBCY7P2W type=write size=3391023 2024-09-12T00:42:18.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.673+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=1DTEK8VD80HI type=del 2024-09-12T00:42:18.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.677+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=3R8TUNY1L8IP type=del size=2186091 2024-09-12T00:42:18.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.681+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~GZEZX3S842V1.0 size=1048576 2024-09-12T00:42:18.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.681+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~GZEZX3S842V1.1 size=1048576 2024-09-12T00:42:18.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.685+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~GZEZX3S842V1.2 size=305641 2024-09-12T00:42:18.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.689+0000 7fcde98768c0 1 < completed multipart upload key=ZQD0QXDN1J1I upload=GZEZX3S842V1 tag=65STXA45B2O1 type=write size=3451369 2024-09-12T00:42:18.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.693+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~BWJI2YRQ32MY.0 size=309212 2024-09-12T00:42:18.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.693+0000 7fcde98768c0 1 > prepared multipart upload key=BQGIXJJWBAN0 upload=BWJI2YRQ32MY tag=QUONUZT7GER8 type=write size=1357788 2024-09-12T00:42:18.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.701+0000 7fcde98768c0 1 < suggested update operation key=3X9I78PMR1HV tag=RVHSBF29RGAP type=write size=27978 2024-09-12T00:42:18.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.705+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~A8WDQLECTIV2.0 size=56693 2024-09-12T00:42:18.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.705+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=A8WDQLECTIV2 tag=5RX28F5UIS37 type=write size=1105269 2024-09-12T00:42:18.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.709+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~J9GX5N3HJHKE.0 size=1048576 2024-09-12T00:42:18.708 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.709+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~J9GX5N3HJHKE.1 size=116168 2024-09-12T00:42:18.713 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.717+0000 7fcde98768c0 1 < completed multipart upload key=BQGIXJJWBAN0 upload=J9GX5N3HJHKE tag=W9Y5O9UE23WV type=write size=2213320 2024-09-12T00:42:18.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.721+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~1FHOV1LAWLD6.0 size=1048576 2024-09-12T00:42:18.720 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.721+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~1FHOV1LAWLD6.1 size=1048576 2024-09-12T00:42:18.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.725+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~1FHOV1LAWLD6.2 size=415905 2024-09-12T00:42:18.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.725+0000 7fcde98768c0 1 > prepared multipart upload key=KME8ZTTUGOXY upload=1FHOV1LAWLD6 tag=O96X5L27EFIY type=write size=3561633 2024-09-12T00:42:18.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.729+0000 7fcde98768c0 1 < completed delete operation key=RC9A2Y5TCP9C tag=6M90VA7I7UMC type=del 2024-09-12T00:42:18.729 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.733+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=1SE28QG5HXQE type=del size=2643627 2024-09-12T00:42:18.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.733+0000 7fcde98768c0 1 < completed write operation key=J9EUM073CZHF tag=5OKA4YTXZADM type=write size=916572 2024-09-12T00:42:18.738 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.741+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~OX48IUJGTTA8.0 size=1048576 2024-09-12T00:42:18.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.741+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~OX48IUJGTTA8.1 size=415555 2024-09-12T00:42:18.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.741+0000 7fcde98768c0 1 > prepared multipart upload key=JW2GNFAYFNEK upload=OX48IUJGTTA8 tag=1YOKKP8AH3PR type=write size=2512707 2024-09-12T00:42:18.741 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.745+0000 7fcde98768c0 1 < canceled part key=_multipart_QD5JXFL962R5.2~TSMBPV69B96E.0 size=788492 2024-09-12T00:42:18.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.749+0000 7fcde98768c0 1 < canceled multipart upload key=QD5JXFL962R5 upload=TSMBPV69B96E tag=FHBEBGTQMGUB type=write size=1837068 2024-09-12T00:42:18.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.753+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=A5DICGD2NENB type=del size=2040927 2024-09-12T00:42:18.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.753+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~OE1995ESX6GG.0 size=1048576 2024-09-12T00:42:18.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.757+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~OE1995ESX6GG.1 size=922955 2024-09-12T00:42:18.760 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.761+0000 7fcde98768c0 1 < completed multipart upload key=R2EBH0Q5885L upload=OE1995ESX6GG tag=G0EQHAE6IOHH type=write size=3020107 2024-09-12T00:42:18.765 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.769+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~MBDDTAZRRKSS.0 size=1048576 2024-09-12T00:42:18.767 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.769+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~MBDDTAZRRKSS.1 size=1048576 2024-09-12T00:42:18.769 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.773+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~MBDDTAZRRKSS.2 size=597959 2024-09-12T00:42:18.769 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.773+0000 7fcde98768c0 1 > prepared multipart upload key=5B8C6E8L5N52 upload=MBDDTAZRRKSS tag=0DBM62ZDZ7LG type=write size=3743687 2024-09-12T00:42:18.772 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.773+0000 7fcde98768c0 1 < canceled operation key=ZQD0QXDN1J1I tag=GVXII0D4YPID type=write size=391913 2024-09-12T00:42:18.775 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.777+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=VJNM6LXF0GEL type=del size=4149827 2024-09-12T00:42:18.780 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.781+0000 7fcde98768c0 1 < suggested remove operation key=3X9I78PMR1HV tag=DSK0ER62ZEFJ type=del 2024-09-12T00:42:18.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.785+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=SWQV3VVIOFUI type=del size=1760004 2024-09-12T00:42:18.786 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.789+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~2XDPL2PW71A7.0 size=1023921 2024-09-12T00:42:18.791 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.793+0000 7fcde98768c0 1 < completed multipart upload key=KME8ZTTUGOXY upload=2XDPL2PW71A7 tag=PUOMTV9IK96S type=write size=2072497 2024-09-12T00:42:18.794 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.797+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=M4ZBG173WHTM type=del size=2557377 2024-09-12T00:42:18.797 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.801+0000 7fcde98768c0 1 < completed write operation key=RC9A2Y5TCP9C tag=JK6L9K8I1FYH type=write size=958363 2024-09-12T00:42:18.803 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.805+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~1WHL1XI7DL1S.0 size=1048576 2024-09-12T00:42:18.805 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.809+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~1WHL1XI7DL1S.1 size=551648 2024-09-12T00:42:18.805 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.809+0000 7fcde98768c0 1 > prepared multipart upload key=KME8ZTTUGOXY upload=1WHL1XI7DL1S tag=ZFIWZG4LIY7X type=write size=2648800 2024-09-12T00:42:18.810 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.813+0000 7fcde98768c0 1 < suggested remove operation key=C6PW0ETP4BG2 tag=ZT52E84FJ8O5 type=del 2024-09-12T00:42:18.816 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.817+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~YFM4JK2JB7TU.0 size=1048576 2024-09-12T00:42:18.818 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.821+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~YFM4JK2JB7TU.1 size=1048576 2024-09-12T00:42:18.820 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.821+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~YFM4JK2JB7TU.2 size=658041 2024-09-12T00:42:18.820 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.821+0000 7fcde98768c0 1 > prepared multipart upload key=NVOFV649MT0A upload=YFM4JK2JB7TU tag=HTHFE2H2876H type=write size=3803769 2024-09-12T00:42:18.823 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.825+0000 7fcde98768c0 1 < completed delete operation key=JW2GNFAYFNEK tag=N8LGF5985036 type=del 2024-09-12T00:42:18.829 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.833+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~IEVQ7810HXR6.0 size=1048576 2024-09-12T00:42:18.832 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.833+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~IEVQ7810HXR6.1 size=1048576 2024-09-12T00:42:18.834 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.837+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~IEVQ7810HXR6.2 size=229291 2024-09-12T00:42:18.834 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.837+0000 7fcde98768c0 1 > prepared multipart upload key=Z1PY2MFUC1C4 upload=IEVQ7810HXR6 tag=TX6RWS37HGX0 type=write size=3375019 2024-09-12T00:42:18.838 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.841+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~H4J3BG42TL60.0 size=1048576 2024-09-12T00:42:18.838 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.841+0000 7fcde98768c0 1 < canceled part key=_multipart_QD5JXFL962R5.2~H4J3BG42TL60.1 size=843890 2024-09-12T00:42:18.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.845+0000 7fcde98768c0 1 < canceled multipart upload key=QD5JXFL962R5 upload=H4J3BG42TL60 tag=HLME2S5FLKQ8 type=write size=2941042 2024-09-12T00:42:18.847 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.849+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~J3OCHYLAG00J.0 size=130425 2024-09-12T00:42:18.847 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.849+0000 7fcde98768c0 1 > prepared multipart upload key=RC9A2Y5TCP9C upload=J3OCHYLAG00J tag=N6IB2P2U3HM8 type=write size=1179001 2024-09-12T00:42:18.850 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.853+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~6KWS7QIWXUEP.0 size=1048576 2024-09-12T00:42:18.850 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.853+0000 7fcde98768c0 1 < canceled part key=_multipart_BQGIXJJWBAN0.2~6KWS7QIWXUEP.1 size=1048576 2024-09-12T00:42:18.852 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.853+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~6KWS7QIWXUEP.2 size=245295 2024-09-12T00:42:18.858 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.861+0000 7fcde98768c0 1 < canceled multipart upload key=BQGIXJJWBAN0 upload=6KWS7QIWXUEP tag=R6BBJBCY7P2W type=write size=3391023 2024-09-12T00:42:18.860 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.861+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=H2JVC8KKO8Q0 type=del size=2563792 2024-09-12T00:42:18.862 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.865+0000 7fcde98768c0 -1 < failed to complete operation key=3X9I78PMR1HV tag=3R8TUNY1L8IP type=del size=2186091: (22) Invalid argument 2024-09-12T00:42:18.865 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.869+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=I0JL2L20AP74 type=write size=780435 2024-09-12T00:42:18.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.869+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~BWJI2YRQ32MY.0 size=309212 2024-09-12T00:42:18.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.877+0000 7fcde98768c0 1 < completed multipart upload key=BQGIXJJWBAN0 upload=BWJI2YRQ32MY tag=QUONUZT7GER8 type=write size=1357788 2024-09-12T00:42:18.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.877+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=QHYMKBKG7VFH type=write size=450289 2024-09-12T00:42:18.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.881+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~A8WDQLECTIV2.0 size=56693 2024-09-12T00:42:18.882 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.885+0000 7fcde98768c0 1 < completed multipart upload key=QD5JXFL962R5 upload=A8WDQLECTIV2 tag=5RX28F5UIS37 type=write size=1105269 2024-09-12T00:42:18.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.889+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~41I6VFSYTXT0.0 size=94816 2024-09-12T00:42:18.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.889+0000 7fcde98768c0 1 > prepared multipart upload key=C6PW0ETP4BG2 upload=41I6VFSYTXT0 tag=KY2SQIX274IM type=write size=1143392 2024-09-12T00:42:18.890 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.893+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~1FHOV1LAWLD6.0 size=1048576 2024-09-12T00:42:18.892 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.893+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~1FHOV1LAWLD6.1 size=1048576 2024-09-12T00:42:18.894 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.897+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~1FHOV1LAWLD6.2 size=415905 2024-09-12T00:42:18.898 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.901+0000 7fcde98768c0 1 < completed multipart upload key=KME8ZTTUGOXY upload=1FHOV1LAWLD6 tag=O96X5L27EFIY type=write size=3561633 2024-09-12T00:42:18.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.905+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=HRCSAULTL02J type=write size=13477 2024-09-12T00:42:18.903 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.905+0000 7fcde98768c0 1 < completed delete operation key=3QOENE572J7A tag=1SE28QG5HXQE type=del 2024-09-12T00:42:18.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.913+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~RLCRYXU7M8N4.0 size=1048576 2024-09-12T00:42:18.911 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.913+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~RLCRYXU7M8N4.1 size=1048576 2024-09-12T00:42:18.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.917+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~RLCRYXU7M8N4.2 size=71763 2024-09-12T00:42:18.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.917+0000 7fcde98768c0 1 > prepared multipart upload key=KME8ZTTUGOXY upload=RLCRYXU7M8N4 tag=3YMDXCXFFO5Y type=write size=3217491 2024-09-12T00:42:18.915 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.917+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~OX48IUJGTTA8.0 size=1048576 2024-09-12T00:42:18.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.921+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~OX48IUJGTTA8.1 size=415555 2024-09-12T00:42:18.924 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.925+0000 7fcde98768c0 1 < completed multipart upload key=JW2GNFAYFNEK upload=OX48IUJGTTA8 tag=1YOKKP8AH3PR type=write size=2512707 2024-09-12T00:42:18.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.929+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~T4Z96SPU5HNU.0 size=256054 2024-09-12T00:42:18.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.929+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=T4Z96SPU5HNU tag=E4UU9KF81NIJ type=write size=1304630 2024-09-12T00:42:18.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.933+0000 7fcde98768c0 1 < completed delete operation key=IMITNCB1ST9E tag=A5DICGD2NENB type=del 2024-09-12T00:42:18.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.937+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=301RERW8DVZJ type=del size=3465670 2024-09-12T00:42:18.936 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.937+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~MBDDTAZRRKSS.0 size=1048576 2024-09-12T00:42:18.938 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.941+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~MBDDTAZRRKSS.1 size=1048576 2024-09-12T00:42:18.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.941+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~MBDDTAZRRKSS.2 size=597959 2024-09-12T00:42:18.944 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.949+0000 7fcde98768c0 1 < completed multipart upload key=5B8C6E8L5N52 upload=MBDDTAZRRKSS tag=0DBM62ZDZ7LG type=write size=3743687 2024-09-12T00:42:18.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.949+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=P74LHO17TXB0 type=del size=3887046 2024-09-12T00:42:18.950 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.953+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=VJNM6LXF0GEL type=del 2024-09-12T00:42:18.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.957+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~JPB2MSSY8HPE.0 size=436746 2024-09-12T00:42:18.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.957+0000 7fcde98768c0 1 > prepared multipart upload key=BQGIXJJWBAN0 upload=JPB2MSSY8HPE tag=K7W75L1NUKLI type=write size=1485322 2024-09-12T00:42:18.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.961+0000 7fcde98768c0 1 < suggested remove operation key=EDFNLQYP4L4L tag=SWQV3VVIOFUI type=del 2024-09-12T00:42:18.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.965+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~E8Z222OM0MTF.0 size=560126 2024-09-12T00:42:18.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.965+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=E8Z222OM0MTF tag=857QABI72F2W type=write size=1608702 2024-09-12T00:42:18.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.969+0000 7fcde98768c0 1 < completed delete operation key=5YBVLUYJW40U tag=M4ZBG173WHTM type=del 2024-09-12T00:42:18.971 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.973+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~0WRCHV3WXJFK.0 size=1048576 2024-09-12T00:42:18.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.977+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~0WRCHV3WXJFK.1 size=376342 2024-09-12T00:42:18.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.977+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=0WRCHV3WXJFK tag=PDL22SQWJVL2 type=write size=2473494 2024-09-12T00:42:18.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.977+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~1WHL1XI7DL1S.0 size=1048576 2024-09-12T00:42:18.977 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.981+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~1WHL1XI7DL1S.1 size=551648 2024-09-12T00:42:18.981 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.985+0000 7fcde98768c0 1 < completed multipart upload key=KME8ZTTUGOXY upload=1WHL1XI7DL1S tag=ZFIWZG4LIY7X type=write size=2648800 2024-09-12T00:42:18.986 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.989+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~42869T99LVTH.0 size=1048576 2024-09-12T00:42:18.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.989+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~42869T99LVTH.1 size=198746 2024-09-12T00:42:18.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.989+0000 7fcde98768c0 1 > prepared multipart upload key=3QOENE572J7A upload=42869T99LVTH tag=BNVTWMYSWZQL type=write size=2295898 2024-09-12T00:42:18.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.993+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~YFM4JK2JB7TU.0 size=1048576 2024-09-12T00:42:18.993 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.997+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~YFM4JK2JB7TU.1 size=1048576 2024-09-12T00:42:18.995 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:18.997+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~YFM4JK2JB7TU.2 size=658041 2024-09-12T00:42:18.999 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.001+0000 7fcde98768c0 1 < completed multipart upload key=NVOFV649MT0A upload=YFM4JK2JB7TU tag=HTHFE2H2876H type=write size=3803769 2024-09-12T00:42:19.004 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.005+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~T18F8BLX0IAC.0 size=1048576 2024-09-12T00:42:19.008 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.009+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~T18F8BLX0IAC.1 size=1048576 2024-09-12T00:42:19.009 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.009+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~T18F8BLX0IAC.2 size=463212 2024-09-12T00:42:19.009 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.009+0000 7fcde98768c0 1 > prepared multipart upload key=R2EBH0Q5885L upload=T18F8BLX0IAC tag=7FLCSSKHWTGL type=write size=3608940 2024-09-12T00:42:19.011 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.013+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~IEVQ7810HXR6.0 size=1048576 2024-09-12T00:42:19.013 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.017+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~IEVQ7810HXR6.1 size=1048576 2024-09-12T00:42:19.015 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.017+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~IEVQ7810HXR6.2 size=229291 2024-09-12T00:42:19.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.021+0000 7fcde98768c0 1 < completed multipart upload key=Z1PY2MFUC1C4 upload=IEVQ7810HXR6 tag=TX6RWS37HGX0 type=write size=3375019 2024-09-12T00:42:19.022 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.025+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=OHEDMCTGFNKL type=del size=3722721 2024-09-12T00:42:19.024 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.025+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~J3OCHYLAG00J.0 size=130425 2024-09-12T00:42:19.029 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.033+0000 7fcde98768c0 1 < completed multipart upload key=RC9A2Y5TCP9C upload=J3OCHYLAG00J tag=N6IB2P2U3HM8 type=write size=1179001 2024-09-12T00:42:19.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.037+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~XL31O24OPOAK.0 size=508020 2024-09-12T00:42:19.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.037+0000 7fcde98768c0 1 > prepared multipart upload key=RC9A2Y5TCP9C upload=XL31O24OPOAK tag=RBLM950STSWM type=write size=1556596 2024-09-12T00:42:19.039 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.041+0000 7fcde98768c0 1 < suggested remove operation key=BQGIXJJWBAN0 tag=H2JVC8KKO8Q0 type=del 2024-09-12T00:42:19.042 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.045+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=NEZL530Y2AG0 type=del size=2007835 2024-09-12T00:42:19.045 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.049+0000 7fcde98768c0 1 < completed write operation key=Z1PY2MFUC1C4 tag=I0JL2L20AP74 type=write size=780435 2024-09-12T00:42:19.048 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.049+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=KXFQGTH6FRN1 type=del size=2389393 2024-09-12T00:42:19.050 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.053+0000 7fcde98768c0 1 < completed write operation key=TUMAMUZUIR7E tag=QHYMKBKG7VFH type=write size=450289 2024-09-12T00:42:19.056 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.057+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~VI31VCMWLC4T.0 size=970252 2024-09-12T00:42:19.056 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.057+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=VI31VCMWLC4T tag=7HY6UAMTZE7T type=write size=2018828 2024-09-12T00:42:19.059 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.061+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~41I6VFSYTXT0.0 size=94816 2024-09-12T00:42:19.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.065+0000 7fcde98768c0 1 < completed multipart upload key=C6PW0ETP4BG2 upload=41I6VFSYTXT0 tag=KY2SQIX274IM type=write size=1143392 2024-09-12T00:42:19.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.069+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=SU6OVERTHHF5 type=write size=224657 2024-09-12T00:42:19.068 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.069+0000 7fcde98768c0 1 < completed write operation key=JW2GNFAYFNEK tag=HRCSAULTL02J type=write size=13477 2024-09-12T00:42:19.071 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.073+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=VJ4IT9QAMUET type=del size=253168 2024-09-12T00:42:19.074 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.077+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~RLCRYXU7M8N4.0 size=1048576 2024-09-12T00:42:19.077 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.081+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~RLCRYXU7M8N4.1 size=1048576 2024-09-12T00:42:19.077 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.081+0000 7fcde98768c0 1 < canceled part key=_multipart_KME8ZTTUGOXY.2~RLCRYXU7M8N4.2 size=71763 2024-09-12T00:42:19.082 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.085+0000 7fcde98768c0 1 < canceled multipart upload key=KME8ZTTUGOXY upload=RLCRYXU7M8N4 tag=3YMDXCXFFO5Y type=write size=3217491 2024-09-12T00:42:19.085 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.089+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=TU9ZVBYRR0U8 type=write size=280611 2024-09-12T00:42:19.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.089+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~T4Z96SPU5HNU.0 size=256054 2024-09-12T00:42:19.093 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.093+0000 7fcde98768c0 1 < completed multipart upload key=QD5JXFL962R5 upload=T4Z96SPU5HNU tag=E4UU9KF81NIJ type=write size=1304630 2024-09-12T00:42:19.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.101+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~MBNWRTE4ICB9.0 size=1048576 2024-09-12T00:42:19.100 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.101+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~MBNWRTE4ICB9.1 size=1048576 2024-09-12T00:42:19.102 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.105+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~MBNWRTE4ICB9.2 size=911100 2024-09-12T00:42:19.103 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.105+0000 7fcde98768c0 1 > prepared multipart upload key=KME8ZTTUGOXY upload=MBNWRTE4ICB9 tag=6VVN2JZX8VLH type=write size=4056828 2024-09-12T00:42:19.105 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.109+0000 7fcde98768c0 1 < completed delete operation key=5YBVLUYJW40U tag=301RERW8DVZJ type=del 2024-09-12T00:42:19.109 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.109+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=ZXR5DCZVKL16 type=del size=2929156 2024-09-12T00:42:19.111 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.113+0000 7fcde98768c0 1 < completed delete operation key=C6PW0ETP4BG2 tag=P74LHO17TXB0 type=del 2024-09-12T00:42:19.114 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.117+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=9A0IHP54OFR1 type=del size=1636658 2024-09-12T00:42:19.117 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.121+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~JPB2MSSY8HPE.0 size=436746 2024-09-12T00:42:19.122 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.125+0000 7fcde98768c0 1 < completed multipart upload key=BQGIXJJWBAN0 upload=JPB2MSSY8HPE tag=K7W75L1NUKLI type=write size=1485322 2024-09-12T00:42:19.124 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.125+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=N0IGVHNUY8V4 type=del size=1658481 2024-09-12T00:42:19.127 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.129+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~E8Z222OM0MTF.0 size=560126 2024-09-12T00:42:19.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.133+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=E8Z222OM0MTF tag=857QABI72F2W type=write size=1608702 2024-09-12T00:42:19.136 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.137+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=TQIOEB4KB6DD type=del size=2568684 2024-09-12T00:42:19.138 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.141+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~0WRCHV3WXJFK.0 size=1048576 2024-09-12T00:42:19.141 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.141+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~0WRCHV3WXJFK.1 size=376342 2024-09-12T00:42:19.145 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.149+0000 7fcde98768c0 1 < completed multipart upload key=IV4JCE1QJC70 upload=0WRCHV3WXJFK tag=PDL22SQWJVL2 type=write size=2473494 2024-09-12T00:42:19.148 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.149+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=W6F9J8R5O0MN type=write size=953972 2024-09-12T00:42:19.151 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.153+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~42869T99LVTH.0 size=1048576 2024-09-12T00:42:19.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.157+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~42869T99LVTH.1 size=198746 2024-09-12T00:42:19.158 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.161+0000 7fcde98768c0 1 < completed multipart upload key=3QOENE572J7A upload=42869T99LVTH tag=BNVTWMYSWZQL type=write size=2295898 2024-09-12T00:42:19.161 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.165+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=G5HC9FDTB830 type=del size=3235121 2024-09-12T00:42:19.164 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.165+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~T18F8BLX0IAC.0 size=1048576 2024-09-12T00:42:19.167 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.169+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~T18F8BLX0IAC.1 size=1048576 2024-09-12T00:42:19.169 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.173+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~T18F8BLX0IAC.2 size=463212 2024-09-12T00:42:19.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.177+0000 7fcde98768c0 1 < completed multipart upload key=R2EBH0Q5885L upload=T18F8BLX0IAC tag=7FLCSSKHWTGL type=write size=3608940 2024-09-12T00:42:19.181 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.185+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~OC6ZZV1V620H.0 size=1048576 2024-09-12T00:42:19.184 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.185+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~OC6ZZV1V620H.1 size=1048576 2024-09-12T00:42:19.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.189+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~OC6ZZV1V620H.2 size=380130 2024-09-12T00:42:19.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.189+0000 7fcde98768c0 1 > prepared multipart upload key=C6PW0ETP4BG2 upload=OC6ZZV1V620H tag=9XY4LCIJO0Q2 type=write size=3525858 2024-09-12T00:42:19.188 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.189+0000 7fcde98768c0 1 < completed delete operation key=4487IMSOLPDV tag=OHEDMCTGFNKL type=del 2024-09-12T00:42:19.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.197+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=NNGPULG98TTV type=del size=297119 2024-09-12T00:42:19.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.197+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~XL31O24OPOAK.0 size=508020 2024-09-12T00:42:19.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.201+0000 7fcde98768c0 1 < completed multipart upload key=RC9A2Y5TCP9C upload=XL31O24OPOAK tag=RBLM950STSWM type=write size=1556596 2024-09-12T00:42:19.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.205+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=GEL27PHYZ7T7 type=del size=2379485 2024-09-12T00:42:19.207 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.209+0000 7fcde98768c0 1 < suggested remove operation key=IMITNCB1ST9E tag=NEZL530Y2AG0 type=del 2024-09-12T00:42:19.209 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.213+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=UPWRBA2ET223 type=del size=3944013 2024-09-12T00:42:19.215 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.217+0000 7fcde98768c0 1 < suggested update operation key=3X9I78PMR1HV tag=KXFQGTH6FRN1 type=del size=2389393 2024-09-12T00:42:19.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.221+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=62HIAC5ED48A type=del size=3864149 2024-09-12T00:42:19.220 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.221+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~VI31VCMWLC4T.0 size=970252 2024-09-12T00:42:19.224 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.225+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=VI31VCMWLC4T tag=7HY6UAMTZE7T type=write size=2018828 2024-09-12T00:42:19.227 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.229+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=D1J49UHCLZB8 type=del size=2640823 2024-09-12T00:42:19.230 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.233+0000 7fcde98768c0 1 < completed write operation key=4487IMSOLPDV tag=SU6OVERTHHF5 type=write size=224657 2024-09-12T00:42:19.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.237+0000 7fcde98768c0 1 > prepared operation key=KME8ZTTUGOXY tag=284M32HM0L24 type=del size=3140847 2024-09-12T00:42:19.240 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.241+0000 7fcde98768c0 1 < suggested update operation key=RC9A2Y5TCP9C tag=VJ4IT9QAMUET type=del size=253168 2024-09-12T00:42:19.243 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.245+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=2LEZ2XNIEQKJ type=del size=68520 2024-09-12T00:42:19.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.249+0000 7fcde98768c0 1 < canceled operation key=J9EUM073CZHF tag=TU9ZVBYRR0U8 type=write size=280611 2024-09-12T00:42:19.250 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.253+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=UG844H8VX59M type=del size=3302023 2024-09-12T00:42:19.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.257+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~MBNWRTE4ICB9.0 size=1048576 2024-09-12T00:42:19.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.257+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~MBNWRTE4ICB9.1 size=1048576 2024-09-12T00:42:19.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.261+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~MBNWRTE4ICB9.2 size=911100 2024-09-12T00:42:19.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.265+0000 7fcde98768c0 1 < completed multipart upload key=KME8ZTTUGOXY upload=MBNWRTE4ICB9 tag=6VVN2JZX8VLH type=write size=4056828 2024-09-12T00:42:19.266 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.269+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=681H0LPOMT6N type=del size=2922919 2024-09-12T00:42:19.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.273+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=ZXR5DCZVKL16 type=del 2024-09-12T00:42:19.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.277+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~123NA6QIB4YE.0 size=1048576 2024-09-12T00:42:19.277 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.281+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~123NA6QIB4YE.1 size=1048576 2024-09-12T00:42:19.280 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.281+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~123NA6QIB4YE.2 size=860198 2024-09-12T00:42:19.280 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.281+0000 7fcde98768c0 1 > prepared multipart upload key=J9EUM073CZHF upload=123NA6QIB4YE tag=CS3V4IOOWYGL type=write size=4005926 2024-09-12T00:42:19.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.285+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=9A0IHP54OFR1 type=del 2024-09-12T00:42:19.288 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.289+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~GSSS6YTCIZBS.0 size=1048576 2024-09-12T00:42:19.290 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.293+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~GSSS6YTCIZBS.1 size=1048576 2024-09-12T00:42:19.292 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.293+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~GSSS6YTCIZBS.2 size=465786 2024-09-12T00:42:19.293 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.293+0000 7fcde98768c0 1 > prepared multipart upload key=FUJIUIR1E00J upload=GSSS6YTCIZBS tag=R0441OA4PIIQ type=write size=3611514 2024-09-12T00:42:19.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.297+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=N0IGVHNUY8V4 type=del 2024-09-12T00:42:19.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.301+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=93YTCYIHTRWQ type=del size=3069571 2024-09-12T00:42:19.301 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.305+0000 7fcde98768c0 -1 < failed to complete operation key=IMITNCB1ST9E tag=TQIOEB4KB6DD type=del size=2568684: (22) Invalid argument 2024-09-12T00:42:19.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.309+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~E4BUL6ZSAMJH.0 size=1048576 2024-09-12T00:42:19.308 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.309+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~E4BUL6ZSAMJH.1 size=882045 2024-09-12T00:42:19.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.309+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=E4BUL6ZSAMJH tag=KPYA35YFLO7N type=write size=2979197 2024-09-12T00:42:19.311 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.313+0000 7fcde98768c0 1 < completed write operation key=C6PW0ETP4BG2 tag=W6F9J8R5O0MN type=write size=953972 2024-09-12T00:42:19.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.317+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~U80A1MRVP1PS.0 size=1048576 2024-09-12T00:42:19.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.321+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~U80A1MRVP1PS.1 size=1048576 2024-09-12T00:42:19.320 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.321+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~U80A1MRVP1PS.2 size=626681 2024-09-12T00:42:19.320 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.321+0000 7fcde98768c0 1 > prepared multipart upload key=Z1PY2MFUC1C4 upload=U80A1MRVP1PS tag=X8YNM88EJMM6 type=write size=3772409 2024-09-12T00:42:19.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.325+0000 7fcde98768c0 1 < completed delete operation key=7UR0FX8HA2A5 tag=G5HC9FDTB830 type=del 2024-09-12T00:42:19.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.329+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~JZWL16JGY7R1.0 size=986170 2024-09-12T00:42:19.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.329+0000 7fcde98768c0 1 > prepared multipart upload key=IMITNCB1ST9E upload=JZWL16JGY7R1 tag=PK3W641ZKK5N type=write size=2034746 2024-09-12T00:42:19.331 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.333+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~OC6ZZV1V620H.0 size=1048576 2024-09-12T00:42:19.333 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.337+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~OC6ZZV1V620H.1 size=1048576 2024-09-12T00:42:19.335 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.337+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~OC6ZZV1V620H.2 size=380130 2024-09-12T00:42:19.339 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.341+0000 7fcde98768c0 1 < completed multipart upload key=C6PW0ETP4BG2 upload=OC6ZZV1V620H tag=9XY4LCIJO0Q2 type=write size=3525858 2024-09-12T00:42:19.342 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.345+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=FUI80B6W6PAP type=del size=3234956 2024-09-12T00:42:19.345 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.349+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=NNGPULG98TTV type=del 2024-09-12T00:42:19.347 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.349+0000 7fcde98768c0 1 > prepared operation key=KME8ZTTUGOXY tag=SYEV6MBQ4L24 type=del size=612236 2024-09-12T00:42:19.350 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.353+0000 7fcde98768c0 1 < completed delete operation key=V80E1NH858IK tag=GEL27PHYZ7T7 type=del 2024-09-12T00:42:19.356 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.357+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~094WIVK5DSG6.0 size=1048576 2024-09-12T00:42:19.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.361+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~094WIVK5DSG6.1 size=1048576 2024-09-12T00:42:19.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.365+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~094WIVK5DSG6.2 size=352807 2024-09-12T00:42:19.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.365+0000 7fcde98768c0 1 > prepared multipart upload key=HVE3YQTFZWTV upload=094WIVK5DSG6 tag=0SZJPM90ZFCS type=write size=3498535 2024-09-12T00:42:19.364 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.365+0000 7fcde98768c0 -1 < failed to complete operation key=RC9A2Y5TCP9C tag=UPWRBA2ET223 type=del size=3944013: (22) Invalid argument 2024-09-12T00:42:19.368 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.369+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=DZUHKA5EZUDI type=del size=238015 2024-09-12T00:42:19.370 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.373+0000 7fcde98768c0 1 < completed delete operation key=J9EUM073CZHF tag=62HIAC5ED48A type=del 2024-09-12T00:42:19.376 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.377+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~G3RV647S7THP.0 size=1048576 2024-09-12T00:42:19.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.381+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~G3RV647S7THP.1 size=206 2024-09-12T00:42:19.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.381+0000 7fcde98768c0 1 > prepared multipart upload key=KME8ZTTUGOXY upload=G3RV647S7THP tag=Y3IWTRN6BMER type=write size=2097358 2024-09-12T00:42:19.382 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.385+0000 7fcde98768c0 1 < completed delete operation key=HVE3YQTFZWTV tag=D1J49UHCLZB8 type=del 2024-09-12T00:42:19.385 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.389+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=QG3RDU249J6E type=write size=951549 2024-09-12T00:42:19.388 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.389+0000 7fcde98768c0 1 < completed delete operation key=KME8ZTTUGOXY tag=284M32HM0L24 type=del 2024-09-12T00:42:19.391 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.393+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=HGSN39VJY4CH type=del size=2468731 2024-09-12T00:42:19.397 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.401+0000 7fcde98768c0 1 < suggested update operation key=QD5JXFL962R5 tag=2LEZ2XNIEQKJ type=del size=68520 2024-09-12T00:42:19.400 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.401+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=F9A01DT1U2ZA type=del size=3823182 2024-09-12T00:42:19.404 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.405+0000 7fcde98768c0 1 < completed delete operation key=HVE3YQTFZWTV tag=UG844H8VX59M type=del 2024-09-12T00:42:19.407 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.409+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=VKLUH8U0YRNG type=del size=3285996 2024-09-12T00:42:19.410 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.413+0000 7fcde98768c0 1 < completed delete operation key=3QOENE572J7A tag=681H0LPOMT6N type=del 2024-09-12T00:42:19.413 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.417+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=9QM6W4YAXOEF type=del size=1470706 2024-09-12T00:42:19.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.421+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~123NA6QIB4YE.0 size=1048576 2024-09-12T00:42:19.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.421+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~123NA6QIB4YE.1 size=1048576 2024-09-12T00:42:19.422 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.425+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~123NA6QIB4YE.2 size=860198 2024-09-12T00:42:19.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.429+0000 7fcde98768c0 1 < completed multipart upload key=J9EUM073CZHF upload=123NA6QIB4YE tag=CS3V4IOOWYGL type=write size=4005926 2024-09-12T00:42:19.433 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.437+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~68JDED8DWYVU.0 size=1048576 2024-09-12T00:42:19.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.437+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~68JDED8DWYVU.1 size=616760 2024-09-12T00:42:19.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.437+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=68JDED8DWYVU tag=3IRKTWH714ZK type=write size=2713912 2024-09-12T00:42:19.439 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.441+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~GSSS6YTCIZBS.0 size=1048576 2024-09-12T00:42:19.442 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.445+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~GSSS6YTCIZBS.1 size=1048576 2024-09-12T00:42:19.445 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.449+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~GSSS6YTCIZBS.2 size=465786 2024-09-12T00:42:19.453 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.457+0000 7fcde98768c0 1 < completed multipart upload key=FUJIUIR1E00J upload=GSSS6YTCIZBS tag=R0441OA4PIIQ type=write size=3611514 2024-09-12T00:42:19.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.461+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~TV1F22JH6B5E.0 size=982879 2024-09-12T00:42:19.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.461+0000 7fcde98768c0 1 > prepared multipart upload key=IMITNCB1ST9E upload=TV1F22JH6B5E tag=E0WCRANKSP0U type=write size=2031455 2024-09-12T00:42:19.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.465+0000 7fcde98768c0 -1 < failed to complete operation key=QD5JXFL962R5 tag=93YTCYIHTRWQ type=del size=3069571: (22) Invalid argument 2024-09-12T00:42:19.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.469+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=KWD0QMZTNLWT type=del size=3346601 2024-09-12T00:42:19.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.473+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~E4BUL6ZSAMJH.0 size=1048576 2024-09-12T00:42:19.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.473+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~E4BUL6ZSAMJH.1 size=882045 2024-09-12T00:42:19.478 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.481+0000 7fcde98768c0 1 < completed multipart upload key=V80E1NH858IK upload=E4BUL6ZSAMJH tag=KPYA35YFLO7N type=write size=2979197 2024-09-12T00:42:19.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.489+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~E7JRPKPAQYQH.0 size=1048576 2024-09-12T00:42:19.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.489+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~E7JRPKPAQYQH.1 size=1048576 2024-09-12T00:42:19.490 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.493+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~E7JRPKPAQYQH.2 size=563098 2024-09-12T00:42:19.491 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.493+0000 7fcde98768c0 1 > prepared multipart upload key=FUJIUIR1E00J upload=E7JRPKPAQYQH tag=51U4TV6FZ0H1 type=write size=3708826 2024-09-12T00:42:19.496 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.497+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~U80A1MRVP1PS.0 size=1048576 2024-09-12T00:42:19.497 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.501+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~U80A1MRVP1PS.1 size=1048576 2024-09-12T00:42:19.499 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.501+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~U80A1MRVP1PS.2 size=626681 2024-09-12T00:42:19.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.509+0000 7fcde98768c0 1 < completed multipart upload key=Z1PY2MFUC1C4 upload=U80A1MRVP1PS tag=X8YNM88EJMM6 type=write size=3772409 2024-09-12T00:42:19.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.513+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=C1X86JQ2AJRF type=del size=909384 2024-09-12T00:42:19.512 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.513+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~JZWL16JGY7R1.0 size=986170 2024-09-12T00:42:19.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.521+0000 7fcde98768c0 1 < completed multipart upload key=IMITNCB1ST9E upload=JZWL16JGY7R1 tag=PK3W641ZKK5N type=write size=2034746 2024-09-12T00:42:19.521 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.521+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=I1V0GP4KTW25 type=del size=2374859 2024-09-12T00:42:19.524 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.525+0000 7fcde98768c0 1 < completed delete operation key=368TXYQVK9C3 tag=FUI80B6W6PAP type=del 2024-09-12T00:42:19.530 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.533+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~1K6JDIS19CWX.0 size=1048576 2024-09-12T00:42:19.532 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.533+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~1K6JDIS19CWX.1 size=1048576 2024-09-12T00:42:19.535 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.537+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~1K6JDIS19CWX.2 size=28203 2024-09-12T00:42:19.535 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.537+0000 7fcde98768c0 1 > prepared multipart upload key=EDFNLQYP4L4L upload=1K6JDIS19CWX tag=WIHLXM3CXEO6 type=write size=3173931 2024-09-12T00:42:19.538 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.541+0000 7fcde98768c0 1 < completed delete operation key=KME8ZTTUGOXY tag=SYEV6MBQ4L24 type=del 2024-09-12T00:42:19.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.545+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=8TGC24GS8L6M type=del size=2667461 2024-09-12T00:42:19.544 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.545+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~094WIVK5DSG6.0 size=1048576 2024-09-12T00:42:19.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.549+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~094WIVK5DSG6.1 size=1048576 2024-09-12T00:42:19.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.553+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~094WIVK5DSG6.2 size=352807 2024-09-12T00:42:19.554 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.557+0000 7fcde98768c0 1 < completed multipart upload key=HVE3YQTFZWTV upload=094WIVK5DSG6 tag=0SZJPM90ZFCS type=write size=3498535 2024-09-12T00:42:19.556 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.557+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=L9Y6A8PASTVV type=del size=3759841 2024-09-12T00:42:19.559 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.561+0000 7fcde98768c0 1 < completed delete operation key=Z4RNDW37GEK6 tag=DZUHKA5EZUDI type=del 2024-09-12T00:42:19.564 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.565+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~2M30I6EOWKE7.0 size=1048576 2024-09-12T00:42:19.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.569+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~2M30I6EOWKE7.1 size=1048576 2024-09-12T00:42:19.569 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.573+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~2M30I6EOWKE7.2 size=860979 2024-09-12T00:42:19.569 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.573+0000 7fcde98768c0 1 > prepared multipart upload key=TUMAMUZUIR7E upload=2M30I6EOWKE7 tag=F2OBGNC2DKY2 type=write size=4006707 2024-09-12T00:42:19.572 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.573+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~G3RV647S7THP.0 size=1048576 2024-09-12T00:42:19.574 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.577+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~G3RV647S7THP.1 size=206 2024-09-12T00:42:19.580 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.581+0000 7fcde98768c0 1 < completed multipart upload key=KME8ZTTUGOXY upload=G3RV647S7THP tag=Y3IWTRN6BMER type=write size=2097358 2024-09-12T00:42:19.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.589+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~ZXAOZ9S6H11V.0 size=1048576 2024-09-12T00:42:19.588 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.589+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~ZXAOZ9S6H11V.1 size=1048576 2024-09-12T00:42:19.591 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.593+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~ZXAOZ9S6H11V.2 size=1014716 2024-09-12T00:42:19.591 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.593+0000 7fcde98768c0 1 > prepared multipart upload key=5YBVLUYJW40U upload=ZXAOZ9S6H11V tag=AZTNWEJN5FML type=write size=4160444 2024-09-12T00:42:19.594 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.597+0000 7fcde98768c0 1 < completed write operation key=HVE3YQTFZWTV tag=QG3RDU249J6E type=write size=951549 2024-09-12T00:42:19.597 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.601+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=P5AHIBB7EBGA type=write size=97798 2024-09-12T00:42:19.604 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.605+0000 7fcde98768c0 1 < suggested update operation key=2T5IU2IUNGJX tag=HGSN39VJY4CH type=del size=2468731 2024-09-12T00:42:19.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.609+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=TWT3D9F18FOC type=del size=4023698 2024-09-12T00:42:19.610 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.613+0000 7fcde98768c0 1 < completed delete operation key=HVE3YQTFZWTV tag=F9A01DT1U2ZA type=del 2024-09-12T00:42:19.616 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.617+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~LKEPZ9IN4FS2.0 size=1048576 2024-09-12T00:42:19.619 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.621+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~LKEPZ9IN4FS2.1 size=1013201 2024-09-12T00:42:19.619 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.621+0000 7fcde98768c0 1 > prepared multipart upload key=F813QWV02TI0 upload=LKEPZ9IN4FS2 tag=OZHFCKKPW4G7 type=write size=3110353 2024-09-12T00:42:19.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.629+0000 7fcde98768c0 1 < suggested update operation key=ZQD0QXDN1J1I tag=VKLUH8U0YRNG type=del size=3285996 2024-09-12T00:42:19.629 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.633+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=IH0E1AVYZR84 type=del size=3531556 2024-09-12T00:42:19.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.633+0000 7fcde98768c0 1 < completed delete operation key=5B8C6E8L5N52 tag=9QM6W4YAXOEF type=del 2024-09-12T00:42:19.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.637+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=KGRTT6DGFHNG type=write size=250120 2024-09-12T00:42:19.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.641+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~68JDED8DWYVU.0 size=1048576 2024-09-12T00:42:19.640 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.641+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~68JDED8DWYVU.1 size=616760 2024-09-12T00:42:19.644 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.645+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=68JDED8DWYVU tag=3IRKTWH714ZK type=write size=2713912 2024-09-12T00:42:19.647 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.649+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=5SH27U0DOLPU type=write size=835751 2024-09-12T00:42:19.651 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.653+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~TV1F22JH6B5E.0 size=982879 2024-09-12T00:42:19.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.657+0000 7fcde98768c0 1 < completed multipart upload key=IMITNCB1ST9E upload=TV1F22JH6B5E tag=E0WCRANKSP0U type=write size=2031455 2024-09-12T00:42:19.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.661+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=HNU703OC9Y2W type=del size=1453541 2024-09-12T00:42:19.663 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.665+0000 7fcde98768c0 1 < suggested update operation key=J9EUM073CZHF tag=KWD0QMZTNLWT type=del size=3346601 2024-09-12T00:42:19.666 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.669+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=J8EV4FZC93WK type=del size=1323738 2024-09-12T00:42:19.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.673+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~E7JRPKPAQYQH.0 size=1048576 2024-09-12T00:42:19.673 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.673+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~E7JRPKPAQYQH.1 size=1048576 2024-09-12T00:42:19.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.677+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~E7JRPKPAQYQH.2 size=563098 2024-09-12T00:42:19.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.681+0000 7fcde98768c0 1 < completed multipart upload key=FUJIUIR1E00J upload=E7JRPKPAQYQH tag=51U4TV6FZ0H1 type=write size=3708826 2024-09-12T00:42:19.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.685+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=CSB13YYUM2XM type=del size=2993785 2024-09-12T00:42:19.686 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.689+0000 7fcde98768c0 1 < completed delete operation key=G6R8BX1H7SPM tag=C1X86JQ2AJRF type=del 2024-09-12T00:42:19.692 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.693+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~5YIEJ5V8FWP0.0 size=431404 2024-09-12T00:42:19.692 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.693+0000 7fcde98768c0 1 > prepared multipart upload key=JW2GNFAYFNEK upload=5YIEJ5V8FWP0 tag=UEEMWROT9Q8F type=write size=1479980 2024-09-12T00:42:19.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.697+0000 7fcde98768c0 -1 < failed to complete operation key=J9EUM073CZHF tag=I1V0GP4KTW25 type=del size=2374859: (22) Invalid argument 2024-09-12T00:42:19.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.705+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~4UTPVWIL283J.0 size=1048576 2024-09-12T00:42:19.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.705+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~4UTPVWIL283J.1 size=262958 2024-09-12T00:42:19.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.705+0000 7fcde98768c0 1 > prepared multipart upload key=2T5IU2IUNGJX upload=4UTPVWIL283J tag=FSDPYD00X7S6 type=write size=2360110 2024-09-12T00:42:19.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.709+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~1K6JDIS19CWX.0 size=1048576 2024-09-12T00:42:19.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.713+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~1K6JDIS19CWX.1 size=1048576 2024-09-12T00:42:19.712 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.713+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~1K6JDIS19CWX.2 size=28203 2024-09-12T00:42:19.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.721+0000 7fcde98768c0 1 < completed multipart upload key=EDFNLQYP4L4L upload=1K6JDIS19CWX tag=WIHLXM3CXEO6 type=write size=3173931 2024-09-12T00:42:19.721 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.725+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=XZSX8Z9FBQ2D type=write size=605871 2024-09-12T00:42:19.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.725+0000 7fcde98768c0 1 < canceled operation key=G6R8BX1H7SPM tag=8TGC24GS8L6M type=del size=2667461 2024-09-12T00:42:19.728 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.729+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=BQDJ9CF60Q1M type=del size=1711229 2024-09-12T00:42:19.731 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.733+0000 7fcde98768c0 1 < completed delete operation key=F813QWV02TI0 tag=L9Y6A8PASTVV type=del 2024-09-12T00:42:19.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.741+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~CB14ZG90PZGT.0 size=13900 2024-09-12T00:42:19.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.741+0000 7fcde98768c0 1 > prepared multipart upload key=4487IMSOLPDV upload=CB14ZG90PZGT tag=NEAMF1T50IQK type=write size=1062476 2024-09-12T00:42:19.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.745+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~2M30I6EOWKE7.0 size=1048576 2024-09-12T00:42:19.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.749+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~2M30I6EOWKE7.1 size=1048576 2024-09-12T00:42:19.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.753+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~2M30I6EOWKE7.2 size=860979 2024-09-12T00:42:19.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.757+0000 7fcde98768c0 1 < completed multipart upload key=TUMAMUZUIR7E upload=2M30I6EOWKE7 tag=F2OBGNC2DKY2 type=write size=4006707 2024-09-12T00:42:19.757 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.761+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=BAAYSNBEF6LN type=del size=1159184 2024-09-12T00:42:19.760 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.761+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~ZXAOZ9S6H11V.0 size=1048576 2024-09-12T00:42:19.760 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.761+0000 7fcde98768c0 1 < canceled part key=_multipart_5YBVLUYJW40U.2~ZXAOZ9S6H11V.1 size=1048576 2024-09-12T00:42:19.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.765+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~ZXAOZ9S6H11V.2 size=1014716 2024-09-12T00:42:19.767 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.769+0000 7fcde98768c0 1 < canceled multipart upload key=5YBVLUYJW40U upload=ZXAOZ9S6H11V tag=AZTNWEJN5FML type=write size=4160444 2024-09-12T00:42:19.770 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.773+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=JB6EJBEEC0BH type=del size=2485903 2024-09-12T00:42:19.773 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.777+0000 7fcde98768c0 1 < completed write operation key=WLE5QLNPAGZA tag=P5AHIBB7EBGA type=write size=97798 2024-09-12T00:42:19.775 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.777+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=7UBGHFPLNTWJ type=write size=339022 2024-09-12T00:42:19.778 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.781+0000 7fcde98768c0 1 < completed delete operation key=V80E1NH858IK tag=TWT3D9F18FOC type=del 2024-09-12T00:42:19.781 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.785+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=JAICX384SGG7 type=write size=776414 2024-09-12T00:42:19.781 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.785+0000 7fcde98768c0 1 < canceled part key=_multipart_F813QWV02TI0.2~LKEPZ9IN4FS2.0 size=1048576 2024-09-12T00:42:19.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.785+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~LKEPZ9IN4FS2.1 size=1013201 2024-09-12T00:42:19.788 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.789+0000 7fcde98768c0 1 < canceled multipart upload key=F813QWV02TI0 upload=LKEPZ9IN4FS2 tag=OZHFCKKPW4G7 type=write size=3110353 2024-09-12T00:42:19.791 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.793+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=AKX162JG0PZK type=del size=2380057 2024-09-12T00:42:19.794 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.797+0000 7fcde98768c0 1 < completed delete operation key=QD5JXFL962R5 tag=IH0E1AVYZR84 type=del 2024-09-12T00:42:19.799 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.801+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~ZZ7PVX5GNTCL.0 size=608863 2024-09-12T00:42:19.799 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.801+0000 7fcde98768c0 1 > prepared multipart upload key=ZQD0QXDN1J1I upload=ZZ7PVX5GNTCL tag=1EXV8IO8XI0M type=write size=1657439 2024-09-12T00:42:19.802 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.805+0000 7fcde98768c0 1 < completed write operation key=7UR0FX8HA2A5 tag=KGRTT6DGFHNG type=write size=250120 2024-09-12T00:42:19.806 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.809+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=7YEV1SWV0Y34 type=del size=2796681 2024-09-12T00:42:19.808 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.813+0000 7fcde98768c0 1 < completed write operation key=ZQD0QXDN1J1I tag=5SH27U0DOLPU type=write size=835751 2024-09-12T00:42:19.812 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.813+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=6IM38L2H8TW5 type=del size=1468980 2024-09-12T00:42:19.815 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.817+0000 7fcde98768c0 1 < completed delete operation key=97030NBF3MI4 tag=HNU703OC9Y2W type=del 2024-09-12T00:42:19.820 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.821+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~RL2MH17ZKET7.0 size=1048576 2024-09-12T00:42:19.822 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.825+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~RL2MH17ZKET7.1 size=1048576 2024-09-12T00:42:19.825 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.829+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~RL2MH17ZKET7.2 size=225417 2024-09-12T00:42:19.825 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.829+0000 7fcde98768c0 1 > prepared multipart upload key=C6PW0ETP4BG2 upload=RL2MH17ZKET7 tag=C79J3SL3Q2DG type=write size=3371145 2024-09-12T00:42:19.831 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.833+0000 7fcde98768c0 1 < suggested update operation key=R2EBH0Q5885L tag=J8EV4FZC93WK type=del size=1323738 2024-09-12T00:42:19.833 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.837+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=IKCM6MDZVDRW type=del size=3887134 2024-09-12T00:42:19.836 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.837+0000 7fcde98768c0 1 < completed delete operation key=IV4JCE1QJC70 tag=CSB13YYUM2XM type=del 2024-09-12T00:42:19.839 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.841+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=HTO5QKASM33C type=del size=2590886 2024-09-12T00:42:19.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.845+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~5YIEJ5V8FWP0.0 size=431404 2024-09-12T00:42:19.847 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.849+0000 7fcde98768c0 1 < completed multipart upload key=JW2GNFAYFNEK upload=5YIEJ5V8FWP0 tag=UEEMWROT9Q8F type=write size=1479980 2024-09-12T00:42:19.852 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.853+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~MFMIKTZVMRF3.0 size=207135 2024-09-12T00:42:19.852 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.853+0000 7fcde98768c0 1 > prepared multipart upload key=7UR0FX8HA2A5 upload=MFMIKTZVMRF3 tag=F64X0FMGJWWB type=write size=1255711 2024-09-12T00:42:19.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.857+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~4UTPVWIL283J.0 size=1048576 2024-09-12T00:42:19.858 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.861+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~4UTPVWIL283J.1 size=262958 2024-09-12T00:42:19.863 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.865+0000 7fcde98768c0 1 < completed multipart upload key=2T5IU2IUNGJX upload=4UTPVWIL283J tag=FSDPYD00X7S6 type=write size=2360110 2024-09-12T00:42:19.865 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.869+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=WXSWWHO8L1T6 type=del size=185518 2024-09-12T00:42:19.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.869+0000 7fcde98768c0 1 < completed write operation key=F813QWV02TI0 tag=XZSX8Z9FBQ2D type=write size=605871 2024-09-12T00:42:19.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.873+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=CXI841YLPT3L type=write size=476213 2024-09-12T00:42:19.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.877+0000 7fcde98768c0 1 < completed delete operation key=Z4RNDW37GEK6 tag=BQDJ9CF60Q1M type=del 2024-09-12T00:42:19.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.881+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~SVWMOSXG75JW.0 size=552526 2024-09-12T00:42:19.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.881+0000 7fcde98768c0 1 > prepared multipart upload key=2T5IU2IUNGJX upload=SVWMOSXG75JW tag=BXVMJGSEMPEB type=write size=1601102 2024-09-12T00:42:19.881 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.885+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~CB14ZG90PZGT.0 size=13900 2024-09-12T00:42:19.885 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.889+0000 7fcde98768c0 1 < completed multipart upload key=4487IMSOLPDV upload=CB14ZG90PZGT tag=NEAMF1T50IQK type=write size=1062476 2024-09-12T00:42:19.891 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.893+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~RX8ZXJUOTECN.0 size=11706 2024-09-12T00:42:19.891 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.893+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=RX8ZXJUOTECN tag=JLB41Y3LF4IL type=write size=1060282 2024-09-12T00:42:19.894 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.897+0000 7fcde98768c0 1 < completed delete operation key=C6PW0ETP4BG2 tag=BAAYSNBEF6LN type=del 2024-09-12T00:42:19.897 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.901+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=LO02QQGUDGBJ type=del size=2155724 2024-09-12T00:42:19.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.901+0000 7fcde98768c0 1 < completed delete operation key=QD5JXFL962R5 tag=JB6EJBEEC0BH type=del 2024-09-12T00:42:19.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.905+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=02PCDC8VB1K1 type=write size=620859 2024-09-12T00:42:19.906 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.909+0000 7fcde98768c0 1 < completed write operation key=FUJIUIR1E00J tag=7UBGHFPLNTWJ type=write size=339022 2024-09-12T00:42:19.911 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.913+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~D2UPPY4F1DTM.0 size=26096 2024-09-12T00:42:19.911 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.913+0000 7fcde98768c0 1 > prepared multipart upload key=368TXYQVK9C3 upload=D2UPPY4F1DTM tag=V5TRMWLYVA52 type=write size=1074672 2024-09-12T00:42:19.914 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.917+0000 7fcde98768c0 1 < completed write operation key=EDFNLQYP4L4L tag=JAICX384SGG7 type=write size=776414 2024-09-12T00:42:19.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.921+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~HUP00K912WTG.0 size=595348 2024-09-12T00:42:19.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.921+0000 7fcde98768c0 1 > prepared multipart upload key=Z1PY2MFUC1C4 upload=HUP00K912WTG tag=1QUAS38FKC99 type=write size=1643924 2024-09-12T00:42:19.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.925+0000 7fcde98768c0 1 < completed delete operation key=3QOENE572J7A tag=AKX162JG0PZK type=del 2024-09-12T00:42:19.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.929+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~4T1D9E9UHLHB.0 size=1048576 2024-09-12T00:42:19.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.933+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~4T1D9E9UHLHB.1 size=1048576 2024-09-12T00:42:19.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.937+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~4T1D9E9UHLHB.2 size=219330 2024-09-12T00:42:19.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.937+0000 7fcde98768c0 1 > prepared multipart upload key=HVE3YQTFZWTV upload=4T1D9E9UHLHB tag=ZSNHR5E2R6QP type=write size=3365058 2024-09-12T00:42:19.936 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.937+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~ZZ7PVX5GNTCL.0 size=608863 2024-09-12T00:42:19.942 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.945+0000 7fcde98768c0 1 < completed multipart upload key=ZQD0QXDN1J1I upload=ZZ7PVX5GNTCL tag=1EXV8IO8XI0M type=write size=1657439 2024-09-12T00:42:19.945 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.949+0000 7fcde98768c0 1 > prepared operation key=KME8ZTTUGOXY tag=K6RJHJ7AS1QI type=del size=1162313 2024-09-12T00:42:19.948 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.953+0000 7fcde98768c0 1 < completed delete operation key=5YBVLUYJW40U tag=7YEV1SWV0Y34 type=del 2024-09-12T00:42:19.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.957+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~TIF7DCSWRAKJ.0 size=1048576 2024-09-12T00:42:19.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.957+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~TIF7DCSWRAKJ.1 size=1048576 2024-09-12T00:42:19.960 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.961+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~TIF7DCSWRAKJ.2 size=1024612 2024-09-12T00:42:19.961 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.961+0000 7fcde98768c0 1 > prepared multipart upload key=TUMAMUZUIR7E upload=TIF7DCSWRAKJ tag=HZ3XTPZ8DF4G type=write size=4170340 2024-09-12T00:42:19.961 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.965+0000 7fcde98768c0 1 < completed delete operation key=3X9I78PMR1HV tag=6IM38L2H8TW5 type=del 2024-09-12T00:42:19.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.965+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=XWOMAXXVKJPB type=del size=3992487 2024-09-12T00:42:19.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.969+0000 7fcde98768c0 1 < canceled part key=_multipart_C6PW0ETP4BG2.2~RL2MH17ZKET7.0 size=1048576 2024-09-12T00:42:19.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.969+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~RL2MH17ZKET7.1 size=1048576 2024-09-12T00:42:19.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.969+0000 7fcde98768c0 1 < canceled part key=_multipart_C6PW0ETP4BG2.2~RL2MH17ZKET7.2 size=225417 2024-09-12T00:42:19.971 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.973+0000 7fcde98768c0 1 < canceled multipart upload key=C6PW0ETP4BG2 upload=RL2MH17ZKET7 tag=C79J3SL3Q2DG type=write size=3371145 2024-09-12T00:42:19.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.977+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=T3UQVSKZ9P2K type=del size=3479150 2024-09-12T00:42:19.977 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.981+0000 7fcde98768c0 1 < canceled operation key=J9EUM073CZHF tag=IKCM6MDZVDRW type=del size=3887134 2024-09-12T00:42:19.979 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.981+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=KASFBCDOYXTM type=del size=798792 2024-09-12T00:42:19.982 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.985+0000 7fcde98768c0 1 < completed delete operation key=NVOFV649MT0A tag=HTO5QKASM33C type=del 2024-09-12T00:42:19.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.989+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~X4BC64MPYH8U.0 size=1048576 2024-09-12T00:42:19.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.993+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~X4BC64MPYH8U.1 size=557322 2024-09-12T00:42:19.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.993+0000 7fcde98768c0 1 > prepared multipart upload key=4487IMSOLPDV upload=X4BC64MPYH8U tag=GAJTUVXARA5U type=write size=2654474 2024-09-12T00:42:19.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.993+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~MFMIKTZVMRF3.0 size=207135 2024-09-12T00:42:19.995 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:19.997+0000 7fcde98768c0 1 < completed multipart upload key=7UR0FX8HA2A5 upload=MFMIKTZVMRF3 tag=F64X0FMGJWWB type=write size=1255711 2024-09-12T00:42:19.998 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.001+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=B2JQDJ7G7O49 type=del size=1197256 2024-09-12T00:42:20.004 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.005+0000 7fcde98768c0 1 < suggested update operation key=JW2GNFAYFNEK tag=WXSWWHO8L1T6 type=del size=185518 2024-09-12T00:42:20.008 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.009+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~4EK7CVSEFGWR.0 size=1048576 2024-09-12T00:42:20.012 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.013+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~4EK7CVSEFGWR.1 size=1046199 2024-09-12T00:42:20.012 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.013+0000 7fcde98768c0 1 > prepared multipart upload key=ZQD0QXDN1J1I upload=4EK7CVSEFGWR tag=RS3N55NKRVEP type=write size=3143351 2024-09-12T00:42:20.016 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.017+0000 7fcde98768c0 1 < suggested update operation key=IV4JCE1QJC70 tag=CXI841YLPT3L type=write size=476213 2024-09-12T00:42:20.021 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.025+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~V87XMECWBM2E.0 size=356848 2024-09-12T00:42:20.021 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.025+0000 7fcde98768c0 1 > prepared multipart upload key=HVE3YQTFZWTV upload=V87XMECWBM2E tag=HIZSZJDV5K62 type=write size=1405424 2024-09-12T00:42:20.023 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.025+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~SVWMOSXG75JW.0 size=552526 2024-09-12T00:42:20.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.029+0000 7fcde98768c0 1 < completed multipart upload key=2T5IU2IUNGJX upload=SVWMOSXG75JW tag=BXVMJGSEMPEB type=write size=1601102 2024-09-12T00:42:20.032 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.033+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~2ZCNQ5X4TGX2.0 size=1048576 2024-09-12T00:42:20.034 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.037+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~2ZCNQ5X4TGX2.1 size=1030936 2024-09-12T00:42:20.034 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.037+0000 7fcde98768c0 1 > prepared multipart upload key=3QOENE572J7A upload=2ZCNQ5X4TGX2 tag=HGXSXGDQ78O5 type=write size=3128088 2024-09-12T00:42:20.034 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.037+0000 7fcde98768c0 1 < canceled part key=_multipart_G6R8BX1H7SPM.2~RX8ZXJUOTECN.0 size=11706 2024-09-12T00:42:20.038 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.041+0000 7fcde98768c0 1 < canceled multipart upload key=G6R8BX1H7SPM upload=RX8ZXJUOTECN tag=JLB41Y3LF4IL type=write size=1060282 2024-09-12T00:42:20.043 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.045+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~DTIAGO2VW88H.0 size=872046 2024-09-12T00:42:20.043 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.045+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=DTIAGO2VW88H tag=378XJSJ10K6I type=write size=1920622 2024-09-12T00:42:20.045 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.049+0000 7fcde98768c0 1 < canceled operation key=Z1PY2MFUC1C4 tag=LO02QQGUDGBJ type=del size=2155724 2024-09-12T00:42:20.049 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.053+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~1IPQTC2UF31Q.0 size=1048576 2024-09-12T00:42:20.050 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.053+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~1IPQTC2UF31Q.1 size=83201 2024-09-12T00:42:20.050 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.053+0000 7fcde98768c0 1 > prepared multipart upload key=R2EBH0Q5885L upload=1IPQTC2UF31Q tag=2G5L1RXGHA8M type=write size=2180353 2024-09-12T00:42:20.053 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.057+0000 7fcde98768c0 1 < completed write operation key=C6PW0ETP4BG2 tag=02PCDC8VB1K1 type=write size=620859 2024-09-12T00:42:20.055 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.057+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=PMODMI7MDJKH type=del size=4170441 2024-09-12T00:42:20.057 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.061+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~D2UPPY4F1DTM.0 size=26096 2024-09-12T00:42:20.061 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.065+0000 7fcde98768c0 1 < completed multipart upload key=368TXYQVK9C3 upload=D2UPPY4F1DTM tag=V5TRMWLYVA52 type=write size=1074672 2024-09-12T00:42:20.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.069+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~6YMPDGVY7R1V.0 size=1048576 2024-09-12T00:42:20.067 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.069+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~6YMPDGVY7R1V.1 size=1048576 2024-09-12T00:42:20.068 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.073+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~6YMPDGVY7R1V.2 size=286776 2024-09-12T00:42:20.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.073+0000 7fcde98768c0 1 > prepared multipart upload key=HVE3YQTFZWTV upload=6YMPDGVY7R1V tag=8RNZXGPKUEEM type=write size=3432504 2024-09-12T00:42:20.071 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.073+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~HUP00K912WTG.0 size=595348 2024-09-12T00:42:20.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.077+0000 7fcde98768c0 1 < completed multipart upload key=Z1PY2MFUC1C4 upload=HUP00K912WTG tag=1QUAS38FKC99 type=write size=1643924 2024-09-12T00:42:20.080 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.081+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=65V0NWD1S66Q type=del size=3084561 2024-09-12T00:42:20.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.081+0000 7fcde98768c0 1 < canceled part key=_multipart_HVE3YQTFZWTV.2~4T1D9E9UHLHB.0 size=1048576 2024-09-12T00:42:20.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.081+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~4T1D9E9UHLHB.1 size=1048576 2024-09-12T00:42:20.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.085+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~4T1D9E9UHLHB.2 size=219330 2024-09-12T00:42:20.085 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.089+0000 7fcde98768c0 1 < canceled multipart upload key=HVE3YQTFZWTV upload=4T1D9E9UHLHB tag=ZSNHR5E2R6QP type=write size=3365058 2024-09-12T00:42:20.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.093+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~NEG2NB6Y1XEA.0 size=554624 2024-09-12T00:42:20.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.093+0000 7fcde98768c0 1 > prepared multipart upload key=R2EBH0Q5885L upload=NEG2NB6Y1XEA tag=KROLHG0EX8SI type=write size=1603200 2024-09-12T00:42:20.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.093+0000 7fcde98768c0 1 < completed delete operation key=KME8ZTTUGOXY tag=K6RJHJ7AS1QI type=del 2024-09-12T00:42:20.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.101+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~GIEBRZL8PDCH.0 size=496507 2024-09-12T00:42:20.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.101+0000 7fcde98768c0 1 > prepared multipart upload key=368TXYQVK9C3 upload=GIEBRZL8PDCH tag=MCSOR0GMB67L type=write size=1545083 2024-09-12T00:42:20.100 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.101+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~TIF7DCSWRAKJ.0 size=1048576 2024-09-12T00:42:20.102 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.105+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~TIF7DCSWRAKJ.1 size=1048576 2024-09-12T00:42:20.104 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.105+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~TIF7DCSWRAKJ.2 size=1024612 2024-09-12T00:42:20.109 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.113+0000 7fcde98768c0 1 < completed multipart upload key=TUMAMUZUIR7E upload=TIF7DCSWRAKJ tag=HZ3XTPZ8DF4G type=write size=4170340 2024-09-12T00:42:20.113 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.117+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~13SCN79U66OC.0 size=1048576 2024-09-12T00:42:20.115 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.117+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~13SCN79U66OC.1 size=724377 2024-09-12T00:42:20.115 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.117+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=13SCN79U66OC tag=ECRG10Z0F6TX type=write size=2821529 2024-09-12T00:42:20.118 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.121+0000 7fcde98768c0 1 < canceled operation key=IMITNCB1ST9E tag=XWOMAXXVKJPB type=del size=3992487 2024-09-12T00:42:20.122 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.125+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~MBMA622MAY2R.0 size=1048576 2024-09-12T00:42:20.124 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.125+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~MBMA622MAY2R.1 size=1048576 2024-09-12T00:42:20.126 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.129+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~MBMA622MAY2R.2 size=776867 2024-09-12T00:42:20.126 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.129+0000 7fcde98768c0 1 > prepared multipart upload key=Z4RNDW37GEK6 upload=MBMA622MAY2R tag=TKN8Q2J4UZCT type=write size=3922595 2024-09-12T00:42:20.128 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.129+0000 7fcde98768c0 1 < completed delete operation key=R2EBH0Q5885L tag=T3UQVSKZ9P2K type=del 2024-09-12T00:42:20.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.133+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=ARPD5F61U3ZC type=del size=2408003 2024-09-12T00:42:20.135 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.137+0000 7fcde98768c0 1 < suggested remove operation key=JW2GNFAYFNEK tag=KASFBCDOYXTM type=del 2024-09-12T00:42:20.137 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.141+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=NGG4S7U3G4W3 type=del size=1361103 2024-09-12T00:42:20.139 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.141+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~X4BC64MPYH8U.0 size=1048576 2024-09-12T00:42:20.142 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.145+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~X4BC64MPYH8U.1 size=557322 2024-09-12T00:42:20.145 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.149+0000 7fcde98768c0 1 < completed multipart upload key=4487IMSOLPDV upload=X4BC64MPYH8U tag=GAJTUVXARA5U type=write size=2654474 2024-09-12T00:42:20.148 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.149+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=8H4YP2787MTI type=del size=789250 2024-09-12T00:42:20.150 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.153+0000 7fcde98768c0 1 < completed delete operation key=F813QWV02TI0 tag=B2JQDJ7G7O49 type=del 2024-09-12T00:42:20.152 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.153+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=B6EAFMCIF21Y type=del size=2756320 2024-09-12T00:42:20.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.157+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~4EK7CVSEFGWR.0 size=1048576 2024-09-12T00:42:20.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.157+0000 7fcde98768c0 1 < canceled part key=_multipart_ZQD0QXDN1J1I.2~4EK7CVSEFGWR.1 size=1046199 2024-09-12T00:42:20.158 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.161+0000 7fcde98768c0 1 < canceled multipart upload key=ZQD0QXDN1J1I upload=4EK7CVSEFGWR tag=RS3N55NKRVEP type=write size=3143351 2024-09-12T00:42:20.160 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.161+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=17E85K50LAUN type=del size=3847081 2024-09-12T00:42:20.162 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.165+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~V87XMECWBM2E.0 size=356848 2024-09-12T00:42:20.166 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.169+0000 7fcde98768c0 1 < completed multipart upload key=HVE3YQTFZWTV upload=V87XMECWBM2E tag=HIZSZJDV5K62 type=write size=1405424 2024-09-12T00:42:20.169 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.173+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=MAM2P54DCOK8 type=del size=2296966 2024-09-12T00:42:20.171 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.173+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~2ZCNQ5X4TGX2.0 size=1048576 2024-09-12T00:42:20.173 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.177+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~2ZCNQ5X4TGX2.1 size=1030936 2024-09-12T00:42:20.177 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.181+0000 7fcde98768c0 1 < completed multipart upload key=3QOENE572J7A upload=2ZCNQ5X4TGX2 tag=HGXSXGDQ78O5 type=write size=3128088 2024-09-12T00:42:20.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.181+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=MQMD4OH5DLM8 type=del size=3936525 2024-09-12T00:42:20.182 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.185+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~DTIAGO2VW88H.0 size=872046 2024-09-12T00:42:20.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.189+0000 7fcde98768c0 1 < completed multipart upload key=V80E1NH858IK upload=DTIAGO2VW88H tag=378XJSJ10K6I type=write size=1920622 2024-09-12T00:42:20.188 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.189+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=RG1R1AKA6RGS type=del size=1468135 2024-09-12T00:42:20.190 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.193+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~1IPQTC2UF31Q.0 size=1048576 2024-09-12T00:42:20.192 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.193+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~1IPQTC2UF31Q.1 size=83201 2024-09-12T00:42:20.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.197+0000 7fcde98768c0 1 < completed multipart upload key=R2EBH0Q5885L upload=1IPQTC2UF31Q tag=2G5L1RXGHA8M type=write size=2180353 2024-09-12T00:42:20.198 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.201+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=OD6VYEZZGDQT type=del size=172522 2024-09-12T00:42:20.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.205+0000 7fcde98768c0 1 < completed delete operation key=FUJIUIR1E00J tag=PMODMI7MDJKH type=del 2024-09-12T00:42:20.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.205+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=15SHHL7F1T0V type=del size=70824 2024-09-12T00:42:20.205 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.209+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~6YMPDGVY7R1V.0 size=1048576 2024-09-12T00:42:20.207 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.209+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~6YMPDGVY7R1V.1 size=1048576 2024-09-12T00:42:20.209 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.213+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~6YMPDGVY7R1V.2 size=286776 2024-09-12T00:42:20.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.217+0000 7fcde98768c0 1 < completed multipart upload key=HVE3YQTFZWTV upload=6YMPDGVY7R1V tag=8RNZXGPKUEEM type=write size=3432504 2024-09-12T00:42:20.215 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.217+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=0XX6B54LPFMM type=write size=983092 2024-09-12T00:42:20.219 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.221+0000 7fcde98768c0 1 < completed delete operation key=R2EBH0Q5885L tag=65V0NWD1S66Q type=del 2024-09-12T00:42:20.220 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.221+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=QUUKU4VZM2M5 type=write size=194878 2024-09-12T00:42:20.223 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.225+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~NEG2NB6Y1XEA.0 size=554624 2024-09-12T00:42:20.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.233+0000 7fcde98768c0 1 < completed multipart upload key=R2EBH0Q5885L upload=NEG2NB6Y1XEA tag=KROLHG0EX8SI type=write size=1603200 2024-09-12T00:42:20.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.237+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~IQLLOIS2EU70.0 size=3711 2024-09-12T00:42:20.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.237+0000 7fcde98768c0 1 > prepared multipart upload key=HVE3YQTFZWTV upload=IQLLOIS2EU70 tag=41WIB6GNM28O type=write size=1052287 2024-09-12T00:42:20.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.241+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~GIEBRZL8PDCH.0 size=496507 2024-09-12T00:42:20.242 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.245+0000 7fcde98768c0 1 < completed multipart upload key=368TXYQVK9C3 upload=GIEBRZL8PDCH tag=MCSOR0GMB67L type=write size=1545083 2024-09-12T00:42:20.244 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.245+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=Y9MATP8C0YI1 type=del size=3947850 2024-09-12T00:42:20.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.249+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~13SCN79U66OC.0 size=1048576 2024-09-12T00:42:20.249 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.253+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~13SCN79U66OC.1 size=724377 2024-09-12T00:42:20.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.257+0000 7fcde98768c0 1 < completed multipart upload key=IV4JCE1QJC70 upload=13SCN79U66OC tag=ECRG10Z0F6TX type=write size=2821529 2024-09-12T00:42:20.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.257+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=HEGY9EBHWFP7 type=write size=613950 2024-09-12T00:42:20.257 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.261+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~MBMA622MAY2R.0 size=1048576 2024-09-12T00:42:20.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.261+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~MBMA622MAY2R.1 size=1048576 2024-09-12T00:42:20.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.265+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~MBMA622MAY2R.2 size=776867 2024-09-12T00:42:20.267 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.269+0000 7fcde98768c0 1 < completed multipart upload key=Z4RNDW37GEK6 upload=MBMA622MAY2R tag=TKN8Q2J4UZCT type=write size=3922595 2024-09-12T00:42:20.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.269+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=CA290GNBY1Q6 type=write size=1025642 2024-09-12T00:42:20.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.273+0000 7fcde98768c0 1 < completed delete operation key=RC9A2Y5TCP9C tag=ARPD5F61U3ZC type=del 2024-09-12T00:42:20.273 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.277+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=1PVWH8402H1P type=del size=999 2024-09-12T00:42:20.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.277+0000 7fcde98768c0 1 < completed delete operation key=BZ4YUNTMOJBK tag=NGG4S7U3G4W3 type=del 2024-09-12T00:42:20.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.281+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=D6RFLMUH1JYU type=del size=806034 2024-09-12T00:42:20.281 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.285+0000 7fcde98768c0 1 < completed delete operation key=J9EUM073CZHF tag=8H4YP2787MTI type=del 2024-09-12T00:42:20.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.285+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=6LG4D5Q6FHEC type=del size=1084316 2024-09-12T00:42:20.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.289+0000 7fcde98768c0 1 < completed delete operation key=J9EUM073CZHF tag=B6EAFMCIF21Y type=del 2024-09-12T00:42:20.288 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.289+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=PS1SJRJOVPSJ type=del size=3672504 2024-09-12T00:42:20.290 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.293+0000 7fcde98768c0 1 < completed delete operation key=ZQD0QXDN1J1I tag=17E85K50LAUN type=del 2024-09-12T00:42:20.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.297+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~FB5EXC66S2YD.0 size=1048576 2024-09-12T00:42:20.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.301+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~FB5EXC66S2YD.1 size=1048576 2024-09-12T00:42:20.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.301+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~FB5EXC66S2YD.2 size=887113 2024-09-12T00:42:20.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.301+0000 7fcde98768c0 1 > prepared multipart upload key=3X9I78PMR1HV upload=FB5EXC66S2YD tag=PV8GGEP346ML type=write size=4032841 2024-09-12T00:42:20.301 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.305+0000 7fcde98768c0 1 < completed delete operation key=J9EUM073CZHF tag=MAM2P54DCOK8 type=del 2024-09-12T00:42:20.303 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.305+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=9TXBZW023I13 type=del size=969206 2024-09-12T00:42:20.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.313+0000 7fcde98768c0 1 < suggested update operation key=J9EUM073CZHF tag=MQMD4OH5DLM8 type=del size=3936525 2024-09-12T00:42:20.311 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.313+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=A8GBYIBJFZUS type=del size=2391463 2024-09-12T00:42:20.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.321+0000 7fcde98768c0 1 < suggested update operation key=IV4JCE1QJC70 tag=RG1R1AKA6RGS type=del size=1468135 2024-09-12T00:42:20.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.325+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~M5520APSNSL6.0 size=1048576 2024-09-12T00:42:20.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.325+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~M5520APSNSL6.1 size=761555 2024-09-12T00:42:20.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.325+0000 7fcde98768c0 1 > prepared multipart upload key=FUJIUIR1E00J upload=M5520APSNSL6 tag=XEM6SQ2M4RGQ type=write size=2858707 2024-09-12T00:42:20.325 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.329+0000 7fcde98768c0 1 < completed delete operation key=R2EBH0Q5885L tag=OD6VYEZZGDQT type=del 2024-09-12T00:42:20.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.329+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=LYPURHW1I2RM type=del size=361352 2024-09-12T00:42:20.332 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.333+0000 7fcde98768c0 1 < suggested update operation key=FUJIUIR1E00J tag=15SHHL7F1T0V type=del size=70824 2024-09-12T00:42:20.334 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.337+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=U3I2N7756KI6 type=write size=528575 2024-09-12T00:42:20.337 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.341+0000 7fcde98768c0 -1 < failed to complete operation key=FUJIUIR1E00J tag=0XX6B54LPFMM type=write size=983092: (22) Invalid argument 2024-09-12T00:42:20.339 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.341+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=I07UPBMOK7XC type=del size=908152 2024-09-12T00:42:20.341 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.345+0000 7fcde98768c0 1 < completed write operation key=R2EBH0Q5885L tag=QUUKU4VZM2M5 type=write size=194878 2024-09-12T00:42:20.344 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.345+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=GX86BQ08UNIB type=del size=1731857 2024-09-12T00:42:20.346 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.349+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~IQLLOIS2EU70.0 size=3711 2024-09-12T00:42:20.350 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.353+0000 7fcde98768c0 1 < completed multipart upload key=HVE3YQTFZWTV upload=IQLLOIS2EU70 tag=41WIB6GNM28O type=write size=1052287 2024-09-12T00:42:20.352 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.357+0000 7fcde98768c0 1 > prepared operation key=KME8ZTTUGOXY tag=0VQWKFHEF9XP type=del size=2721128 2024-09-12T00:42:20.355 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.357+0000 7fcde98768c0 -1 < failed to complete operation key=FUJIUIR1E00J tag=Y9MATP8C0YI1 type=del size=3947850: (22) Invalid argument 2024-09-12T00:42:20.357 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.361+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=MGC76YK7BKFF type=del size=1282951 2024-09-12T00:42:20.359 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.361+0000 7fcde98768c0 1 < completed write operation key=ZQD0QXDN1J1I tag=HEGY9EBHWFP7 type=write size=613950 2024-09-12T00:42:20.362 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.365+0000 7fcde98768c0 1 > prepared operation key=KME8ZTTUGOXY tag=6KT2W6GRQW60 type=del size=1337021 2024-09-12T00:42:20.368 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.369+0000 7fcde98768c0 1 < suggested update operation key=5YBVLUYJW40U tag=CA290GNBY1Q6 type=write size=1025642 2024-09-12T00:42:20.372 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.373+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~HZ1LTKXBZGFN.0 size=1048576 2024-09-12T00:42:20.374 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.377+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~HZ1LTKXBZGFN.1 size=762287 2024-09-12T00:42:20.374 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.377+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=HZ1LTKXBZGFN tag=5M5R34XYPANO type=write size=2859439 2024-09-12T00:42:20.377 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.381+0000 7fcde98768c0 1 < completed delete operation key=97030NBF3MI4 tag=1PVWH8402H1P type=del 2024-09-12T00:42:20.381 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.385+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~RYTSNXUHMWW2.0 size=104069 2024-09-12T00:42:20.381 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.385+0000 7fcde98768c0 1 > prepared multipart upload key=3X9I78PMR1HV upload=RYTSNXUHMWW2 tag=UEMWLMZGT1UE type=write size=1152645 2024-09-12T00:42:20.383 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.385+0000 7fcde98768c0 1 < completed delete operation key=RC9A2Y5TCP9C tag=D6RFLMUH1JYU type=del 2024-09-12T00:42:20.388 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.389+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~DZPTA4VH22L5.0 size=1048576 2024-09-12T00:42:20.390 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.393+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~DZPTA4VH22L5.1 size=305278 2024-09-12T00:42:20.391 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.393+0000 7fcde98768c0 1 > prepared multipart upload key=NVOFV649MT0A upload=DZPTA4VH22L5 tag=AWQ5Q2ES50WT type=write size=2402430 2024-09-12T00:42:20.393 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.397+0000 7fcde98768c0 -1 < failed to complete operation key=IV4JCE1QJC70 tag=6LG4D5Q6FHEC type=del size=1084316: (22) Invalid argument 2024-09-12T00:42:20.396 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.397+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=LMRC6M0S01LY type=del size=1823766 2024-09-12T00:42:20.398 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.401+0000 7fcde98768c0 1 < completed delete operation key=7UR0FX8HA2A5 tag=PS1SJRJOVPSJ type=del 2024-09-12T00:42:20.402 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.405+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~AT0QL1F3WOD0.0 size=1048576 2024-09-12T00:42:20.404 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.405+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~AT0QL1F3WOD0.1 size=1048576 2024-09-12T00:42:20.406 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.409+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~AT0QL1F3WOD0.2 size=619 2024-09-12T00:42:20.406 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.409+0000 7fcde98768c0 1 > prepared multipart upload key=J9EUM073CZHF upload=AT0QL1F3WOD0 tag=19B0690VMOVT type=write size=3146347 2024-09-12T00:42:20.409 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.413+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~FB5EXC66S2YD.0 size=1048576 2024-09-12T00:42:20.411 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.413+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~FB5EXC66S2YD.1 size=1048576 2024-09-12T00:42:20.413 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.417+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~FB5EXC66S2YD.2 size=887113 2024-09-12T00:42:20.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.421+0000 7fcde98768c0 1 < completed multipart upload key=3X9I78PMR1HV upload=FB5EXC66S2YD tag=PV8GGEP346ML type=write size=4032841 2024-09-12T00:42:20.421 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.425+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~ARDT154FFTQZ.0 size=1048576 2024-09-12T00:42:20.423 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.425+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~ARDT154FFTQZ.1 size=588483 2024-09-12T00:42:20.423 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.425+0000 7fcde98768c0 1 > prepared multipart upload key=BQGIXJJWBAN0 upload=ARDT154FFTQZ tag=GPL68RDQCADX type=write size=2685635 2024-09-12T00:42:20.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.429+0000 7fcde98768c0 1 < completed delete operation key=TUMAMUZUIR7E tag=9TXBZW023I13 type=del 2024-09-12T00:42:20.428 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.429+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=K3OI8PZZV2EZ type=del size=4134303 2024-09-12T00:42:20.433 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.437+0000 7fcde98768c0 1 < suggested remove operation key=RC9A2Y5TCP9C tag=A8GBYIBJFZUS type=del 2024-09-12T00:42:20.438 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.441+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~J6URN5T3SZ8J.0 size=394362 2024-09-12T00:42:20.438 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.441+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=J6URN5T3SZ8J tag=YR2NQ9R1OABG type=write size=1442938 2024-09-12T00:42:20.440 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.445+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~M5520APSNSL6.0 size=1048576 2024-09-12T00:42:20.442 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.445+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~M5520APSNSL6.1 size=761555 2024-09-12T00:42:20.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.449+0000 7fcde98768c0 1 < completed multipart upload key=FUJIUIR1E00J upload=M5520APSNSL6 tag=XEM6SQ2M4RGQ type=write size=2858707 2024-09-12T00:42:20.451 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.453+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~YHJU08EUA2SL.0 size=1048576 2024-09-12T00:42:20.452 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.457+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~YHJU08EUA2SL.1 size=1048576 2024-09-12T00:42:20.454 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.457+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~YHJU08EUA2SL.2 size=98004 2024-09-12T00:42:20.454 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.457+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=YHJU08EUA2SL tag=S4YEB7O2JH4D type=write size=3243732 2024-09-12T00:42:20.457 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.461+0000 7fcde98768c0 -1 < failed to complete operation key=RC9A2Y5TCP9C tag=LYPURHW1I2RM type=del size=361352: (22) Invalid argument 2024-09-12T00:42:20.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.465+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=LCA6YEEEJSOE type=del size=3446439 2024-09-12T00:42:20.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.469+0000 7fcde98768c0 1 < suggested remove operation key=TUMAMUZUIR7E tag=U3I2N7756KI6 type=write 2024-09-12T00:42:20.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.473+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=DYP2POSE2DJ1 type=del size=2719321 2024-09-12T00:42:20.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.473+0000 7fcde98768c0 1 < completed delete operation key=3QOENE572J7A tag=I07UPBMOK7XC type=del 2024-09-12T00:42:20.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.477+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=9J2MDVG3HBBN type=write size=981356 2024-09-12T00:42:20.478 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.481+0000 7fcde98768c0 1 < completed delete operation key=BZ4YUNTMOJBK tag=GX86BQ08UNIB type=del 2024-09-12T00:42:20.481 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.485+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=5DJLUIFMM1CW type=del size=775274 2024-09-12T00:42:20.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.489+0000 7fcde98768c0 1 < completed delete operation key=KME8ZTTUGOXY tag=0VQWKFHEF9XP type=del 2024-09-12T00:42:20.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.489+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=VWW8IACBOUY5 type=del size=1550699 2024-09-12T00:42:20.492 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.493+0000 7fcde98768c0 1 < completed delete operation key=HVE3YQTFZWTV tag=MGC76YK7BKFF type=del 2024-09-12T00:42:20.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.497+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=B0R93ETY528Y type=del size=4184974 2024-09-12T00:42:20.499 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.501+0000 7fcde98768c0 1 < completed delete operation key=KME8ZTTUGOXY tag=6KT2W6GRQW60 type=del 2024-09-12T00:42:20.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.505+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=AFVX5IXNYF9P type=del size=783498 2024-09-12T00:42:20.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.509+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~HZ1LTKXBZGFN.0 size=1048576 2024-09-12T00:42:20.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.509+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~HZ1LTKXBZGFN.1 size=762287 2024-09-12T00:42:20.513 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.517+0000 7fcde98768c0 1 < completed multipart upload key=BZ4YUNTMOJBK upload=HZ1LTKXBZGFN tag=5M5R34XYPANO type=write size=2859439 2024-09-12T00:42:20.516 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.517+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=GM9ZLXRP5HZI type=del size=2936891 2024-09-12T00:42:20.519 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.521+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~RYTSNXUHMWW2.0 size=104069 2024-09-12T00:42:20.523 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.525+0000 7fcde98768c0 1 < completed multipart upload key=3X9I78PMR1HV upload=RYTSNXUHMWW2 tag=UEMWLMZGT1UE type=write size=1152645 2024-09-12T00:42:20.526 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.529+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=XP2020PUD2ZA type=del size=2931138 2024-09-12T00:42:20.530 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.533+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~DZPTA4VH22L5.0 size=1048576 2024-09-12T00:42:20.532 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.533+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~DZPTA4VH22L5.1 size=305278 2024-09-12T00:42:20.537 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.541+0000 7fcde98768c0 1 < completed multipart upload key=NVOFV649MT0A upload=DZPTA4VH22L5 tag=AWQ5Q2ES50WT type=write size=2402430 2024-09-12T00:42:20.542 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.545+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~SHAQXRM93GGQ.0 size=1048576 2024-09-12T00:42:20.544 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.549+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~SHAQXRM93GGQ.1 size=1048576 2024-09-12T00:42:20.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.549+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~SHAQXRM93GGQ.2 size=606706 2024-09-12T00:42:20.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.549+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=SHAQXRM93GGQ tag=JO9MX7OO7JEQ type=write size=3752434 2024-09-12T00:42:20.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.553+0000 7fcde98768c0 1 < canceled operation key=G6R8BX1H7SPM tag=LMRC6M0S01LY type=del size=1823766 2024-09-12T00:42:20.551 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.553+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=CRJZKC4AX71R type=del size=442257 2024-09-12T00:42:20.554 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.557+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~AT0QL1F3WOD0.0 size=1048576 2024-09-12T00:42:20.556 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.557+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~AT0QL1F3WOD0.1 size=1048576 2024-09-12T00:42:20.558 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.561+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~AT0QL1F3WOD0.2 size=619 2024-09-12T00:42:20.563 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.565+0000 7fcde98768c0 1 < completed multipart upload key=J9EUM073CZHF upload=AT0QL1F3WOD0 tag=19B0690VMOVT type=write size=3146347 2024-09-12T00:42:20.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.569+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~560932JH7HWZ.0 size=1048576 2024-09-12T00:42:20.569 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.573+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~560932JH7HWZ.1 size=88186 2024-09-12T00:42:20.569 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.573+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=560932JH7HWZ tag=1JPB4ZP9GVLM type=write size=2185338 2024-09-12T00:42:20.572 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.573+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~ARDT154FFTQZ.0 size=1048576 2024-09-12T00:42:20.574 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.577+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~ARDT154FFTQZ.1 size=588483 2024-09-12T00:42:20.578 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.581+0000 7fcde98768c0 1 < completed multipart upload key=BQGIXJJWBAN0 upload=ARDT154FFTQZ tag=GPL68RDQCADX type=write size=2685635 2024-09-12T00:42:20.581 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.585+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=KC4B2PNJKOW8 type=del size=1950628 2024-09-12T00:42:20.584 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.585+0000 7fcde98768c0 1 < canceled operation key=J9EUM073CZHF tag=K3OI8PZZV2EZ type=del size=4134303 2024-09-12T00:42:20.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.589+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=RL3XZJTA4H5E type=del size=314226 2024-09-12T00:42:20.588 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.593+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~J6URN5T3SZ8J.0 size=394362 2024-09-12T00:42:20.592 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.593+0000 7fcde98768c0 1 < completed multipart upload key=V80E1NH858IK upload=J6URN5T3SZ8J tag=YR2NQ9R1OABG type=write size=1442938 2024-09-12T00:42:20.596 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.597+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~P2O0U415D2FC.0 size=1048576 2024-09-12T00:42:20.599 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.601+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~P2O0U415D2FC.1 size=539456 2024-09-12T00:42:20.599 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.601+0000 7fcde98768c0 1 > prepared multipart upload key=TUMAMUZUIR7E upload=P2O0U415D2FC tag=UXUYWOE4G8OW type=write size=2636608 2024-09-12T00:42:20.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.605+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~YHJU08EUA2SL.0 size=1048576 2024-09-12T00:42:20.603 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.605+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~YHJU08EUA2SL.1 size=1048576 2024-09-12T00:42:20.604 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.609+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~YHJU08EUA2SL.2 size=98004 2024-09-12T00:42:20.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.609+0000 7fcde98768c0 1 < completed multipart upload key=V80E1NH858IK upload=YHJU08EUA2SL tag=S4YEB7O2JH4D type=write size=3243732 2024-09-12T00:42:20.612 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.617+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~ANP6TFV0KNP0.0 size=1048576 2024-09-12T00:42:20.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.617+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~ANP6TFV0KNP0.1 size=853165 2024-09-12T00:42:20.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.617+0000 7fcde98768c0 1 > prepared multipart upload key=TUMAMUZUIR7E upload=ANP6TFV0KNP0 tag=7S1ZDAH5PJLO type=write size=2950317 2024-09-12T00:42:20.619 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.621+0000 7fcde98768c0 1 < suggested update operation key=WLE5QLNPAGZA tag=LCA6YEEEJSOE type=del size=3446439 2024-09-12T00:42:20.623 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.625+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~YINY8U0PR1OJ.0 size=1048576 2024-09-12T00:42:20.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.625+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~YINY8U0PR1OJ.1 size=1048576 2024-09-12T00:42:20.626 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.629+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~YINY8U0PR1OJ.2 size=1009827 2024-09-12T00:42:20.626 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.629+0000 7fcde98768c0 1 > prepared multipart upload key=2T5IU2IUNGJX upload=YINY8U0PR1OJ tag=E82NMRDMJ1H1 type=write size=4155555 2024-09-12T00:42:20.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.633+0000 7fcde98768c0 1 < suggested remove operation key=7UR0FX8HA2A5 tag=DYP2POSE2DJ1 type=del 2024-09-12T00:42:20.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.633+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=1DTCXOSYYWFQ type=del size=1459679 2024-09-12T00:42:20.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.637+0000 7fcde98768c0 1 < completed write operation key=FUJIUIR1E00J tag=9J2MDVG3HBBN type=write size=981356 2024-09-12T00:42:20.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.641+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~3VU8E0QQVO2I.0 size=388917 2024-09-12T00:42:20.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.641+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=3VU8E0QQVO2I tag=GSSI0VDOFLFI type=write size=1437493 2024-09-12T00:42:20.640 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.641+0000 7fcde98768c0 -1 < failed to complete operation key=7UR0FX8HA2A5 tag=5DJLUIFMM1CW type=del size=775274: (22) Invalid argument 2024-09-12T00:42:20.642 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.645+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=3HIDWH9CH5RC type=del size=3720651 2024-09-12T00:42:20.644 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.649+0000 7fcde98768c0 1 < completed delete operation key=EDFNLQYP4L4L tag=VWW8IACBOUY5 type=del 2024-09-12T00:42:20.648 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.653+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~XF55TYWMOAG9.0 size=1048576 2024-09-12T00:42:20.650 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.653+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~XF55TYWMOAG9.1 size=668964 2024-09-12T00:42:20.650 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.653+0000 7fcde98768c0 1 > prepared multipart upload key=Z4RNDW37GEK6 upload=XF55TYWMOAG9 tag=1OMJA24C5D0Z type=write size=2766116 2024-09-12T00:42:20.652 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.657+0000 7fcde98768c0 1 < completed delete operation key=2T5IU2IUNGJX tag=B0R93ETY528Y type=del 2024-09-12T00:42:20.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.657+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=ND6VWJZFSMYY type=del size=1799090 2024-09-12T00:42:20.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.661+0000 7fcde98768c0 -1 < failed to complete operation key=7UR0FX8HA2A5 tag=AFVX5IXNYF9P type=del size=783498: (22) Invalid argument 2024-09-12T00:42:20.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.661+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=V7ZSBZZYMRO3 type=del size=2686603 2024-09-12T00:42:20.661 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.665+0000 7fcde98768c0 1 < completed delete operation key=3X9I78PMR1HV tag=GM9ZLXRP5HZI type=del 2024-09-12T00:42:20.665 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.669+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~BVKEFBD1VBXF.0 size=1048576 2024-09-12T00:42:20.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.669+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~BVKEFBD1VBXF.1 size=1048576 2024-09-12T00:42:20.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.673+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~BVKEFBD1VBXF.2 size=1027423 2024-09-12T00:42:20.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.673+0000 7fcde98768c0 1 > prepared multipart upload key=Z4RNDW37GEK6 upload=BVKEFBD1VBXF tag=IL49XVVMDJG9 type=write size=4173151 2024-09-12T00:42:20.672 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.673+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=XP2020PUD2ZA type=del 2024-09-12T00:42:20.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.677+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=AM30O4UHJG8I type=del size=2848150 2024-09-12T00:42:20.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.681+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~SHAQXRM93GGQ.0 size=1048576 2024-09-12T00:42:20.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.681+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~SHAQXRM93GGQ.1 size=1048576 2024-09-12T00:42:20.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.685+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~SHAQXRM93GGQ.2 size=606706 2024-09-12T00:42:20.686 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.689+0000 7fcde98768c0 1 < completed multipart upload key=IV4JCE1QJC70 upload=SHAQXRM93GGQ tag=JO9MX7OO7JEQ type=write size=3752434 2024-09-12T00:42:20.688 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.693+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=3JK8M3XUVL8I type=del size=2337612 2024-09-12T00:42:20.691 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.693+0000 7fcde98768c0 1 < completed delete operation key=4487IMSOLPDV tag=CRJZKC4AX71R type=del 2024-09-12T00:42:20.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.697+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~L60KYOFFIZXB.0 size=927513 2024-09-12T00:42:20.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.697+0000 7fcde98768c0 1 > prepared multipart upload key=RC9A2Y5TCP9C upload=L60KYOFFIZXB tag=KXU9OAHHE992 type=write size=1976089 2024-09-12T00:42:20.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.705+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~560932JH7HWZ.0 size=1048576 2024-09-12T00:42:20.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.705+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~560932JH7HWZ.1 size=88186 2024-09-12T00:42:20.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.709+0000 7fcde98768c0 1 < completed multipart upload key=V80E1NH858IK upload=560932JH7HWZ tag=1JPB4ZP9GVLM type=write size=2185338 2024-09-12T00:42:20.708 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.709+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=I1KFYJMQHL8A type=del size=1934837 2024-09-12T00:42:20.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.713+0000 7fcde98768c0 1 < completed delete operation key=Z1PY2MFUC1C4 tag=KC4B2PNJKOW8 type=del 2024-09-12T00:42:20.712 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.717+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=JX72OFFNNSN8 type=del size=226248 2024-09-12T00:42:20.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.717+0000 7fcde98768c0 1 < completed delete operation key=5B8C6E8L5N52 tag=RL3XZJTA4H5E type=del 2024-09-12T00:42:20.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.721+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=Z2D5TAAQBZQJ type=write size=539742 2024-09-12T00:42:20.719 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.721+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~P2O0U415D2FC.0 size=1048576 2024-09-12T00:42:20.721 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.725+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~P2O0U415D2FC.1 size=539456 2024-09-12T00:42:20.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.725+0000 7fcde98768c0 1 < completed multipart upload key=TUMAMUZUIR7E upload=P2O0U415D2FC tag=UXUYWOE4G8OW type=write size=2636608 2024-09-12T00:42:20.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.729+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=OM7YA3N11JA0 type=del size=1887524 2024-09-12T00:42:20.728 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.729+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~ANP6TFV0KNP0.0 size=1048576 2024-09-12T00:42:20.730 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.733+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~ANP6TFV0KNP0.1 size=853165 2024-09-12T00:42:20.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.737+0000 7fcde98768c0 1 < completed multipart upload key=TUMAMUZUIR7E upload=ANP6TFV0KNP0 tag=7S1ZDAH5PJLO type=write size=2950317 2024-09-12T00:42:20.735 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.737+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=W6PLC58RBT0I type=del size=3100186 2024-09-12T00:42:20.737 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.741+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~YINY8U0PR1OJ.0 size=1048576 2024-09-12T00:42:20.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.741+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~YINY8U0PR1OJ.1 size=1048576 2024-09-12T00:42:20.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.745+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~YINY8U0PR1OJ.2 size=1009827 2024-09-12T00:42:20.744 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.745+0000 7fcde98768c0 1 < completed multipart upload key=2T5IU2IUNGJX upload=YINY8U0PR1OJ tag=E82NMRDMJ1H1 type=write size=4155555 2024-09-12T00:42:20.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.749+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~SNL07U7Y1DAT.0 size=1048576 2024-09-12T00:42:20.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.753+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~SNL07U7Y1DAT.1 size=828429 2024-09-12T00:42:20.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.753+0000 7fcde98768c0 1 > prepared multipart upload key=C6PW0ETP4BG2 upload=SNL07U7Y1DAT tag=QPEZDJP1FN44 type=write size=2925581 2024-09-12T00:42:20.753 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.757+0000 7fcde98768c0 1 < suggested remove operation key=JW2GNFAYFNEK tag=1DTCXOSYYWFQ type=del 2024-09-12T00:42:20.755 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.757+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=3Z599D7XYGIG type=write size=341604 2024-09-12T00:42:20.758 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.761+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~3VU8E0QQVO2I.0 size=388917 2024-09-12T00:42:20.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.765+0000 7fcde98768c0 1 < completed multipart upload key=BZ4YUNTMOJBK upload=3VU8E0QQVO2I tag=GSSI0VDOFLFI type=write size=1437493 2024-09-12T00:42:20.766 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.769+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~XM5FT3D91XPI.0 size=1048576 2024-09-12T00:42:20.768 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.769+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~XM5FT3D91XPI.1 size=1048576 2024-09-12T00:42:20.770 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.773+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~XM5FT3D91XPI.2 size=977223 2024-09-12T00:42:20.770 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.773+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=XM5FT3D91XPI tag=H2SNWNV8DUL8 type=write size=4122951 2024-09-12T00:42:20.773 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.777+0000 7fcde98768c0 1 < completed delete operation key=7UR0FX8HA2A5 tag=3HIDWH9CH5RC type=del 2024-09-12T00:42:20.775 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.777+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=97KMC41CGW46 type=write size=268899 2024-09-12T00:42:20.777 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.781+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~XF55TYWMOAG9.0 size=1048576 2024-09-12T00:42:20.778 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.781+0000 7fcde98768c0 1 < canceled part key=_multipart_Z4RNDW37GEK6.2~XF55TYWMOAG9.1 size=668964 2024-09-12T00:42:20.782 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.785+0000 7fcde98768c0 1 < canceled multipart upload key=Z4RNDW37GEK6 upload=XF55TYWMOAG9 tag=1OMJA24C5D0Z type=write size=2766116 2024-09-12T00:42:20.784 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.785+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=S244BGKZSMS9 type=del size=356376 2024-09-12T00:42:20.789 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.793+0000 7fcde98768c0 1 < suggested remove operation key=NVOFV649MT0A tag=ND6VWJZFSMYY type=del 2024-09-12T00:42:20.791 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.793+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=EIMKIQ7J8N3A type=del size=3309646 2024-09-12T00:42:20.795 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.797+0000 7fcde98768c0 1 < suggested update operation key=3X9I78PMR1HV tag=V7ZSBZZYMRO3 type=del size=2686603 2024-09-12T00:42:20.797 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.801+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=SNLKEYPKN194 type=del size=2020720 2024-09-12T00:42:20.799 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.801+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~BVKEFBD1VBXF.0 size=1048576 2024-09-12T00:42:20.801 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.805+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~BVKEFBD1VBXF.1 size=1048576 2024-09-12T00:42:20.803 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.805+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~BVKEFBD1VBXF.2 size=1027423 2024-09-12T00:42:20.808 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.809+0000 7fcde98768c0 1 < completed multipart upload key=Z4RNDW37GEK6 upload=BVKEFBD1VBXF tag=IL49XVVMDJG9 type=write size=4173151 2024-09-12T00:42:20.811 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.813+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=5DC92AKGSRTW type=write size=682377 2024-09-12T00:42:20.814 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.817+0000 7fcde98768c0 1 < canceled operation key=7UR0FX8HA2A5 tag=AM30O4UHJG8I type=del size=2848150 2024-09-12T00:42:20.818 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.821+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~DO17XA3VT48L.0 size=1048576 2024-09-12T00:42:20.821 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.825+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~DO17XA3VT48L.1 size=1048576 2024-09-12T00:42:20.823 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.825+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~DO17XA3VT48L.2 size=188517 2024-09-12T00:42:20.823 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.825+0000 7fcde98768c0 1 > prepared multipart upload key=4487IMSOLPDV upload=DO17XA3VT48L tag=EAP8JS8T6CXC type=write size=3334245 2024-09-12T00:42:20.826 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.829+0000 7fcde98768c0 1 < completed delete operation key=EDFNLQYP4L4L tag=3JK8M3XUVL8I type=del 2024-09-12T00:42:20.829 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.833+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=50FCZLL2MB8G type=write size=764296 2024-09-12T00:42:20.833 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.837+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~L60KYOFFIZXB.0 size=927513 2024-09-12T00:42:20.838 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.841+0000 7fcde98768c0 1 < completed multipart upload key=RC9A2Y5TCP9C upload=L60KYOFFIZXB tag=KXU9OAHHE992 type=write size=1976089 2024-09-12T00:42:20.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.845+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=YHFBZQ0Y89KP type=write size=325908 2024-09-12T00:42:20.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.849+0000 7fcde98768c0 1 < completed delete operation key=4487IMSOLPDV tag=I1KFYJMQHL8A type=del 2024-09-12T00:42:20.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.849+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=7Z7JPZOO87ZZ type=del size=172103 2024-09-12T00:42:20.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.857+0000 7fcde98768c0 1 < suggested remove operation key=4487IMSOLPDV tag=JX72OFFNNSN8 type=del 2024-09-12T00:42:20.857 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.861+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=ZD6KD1LTB5LF type=del size=1709136 2024-09-12T00:42:20.861 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.865+0000 7fcde98768c0 1 < completed write operation key=ZQD0QXDN1J1I tag=Z2D5TAAQBZQJ type=write size=539742 2024-09-12T00:42:20.864 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.865+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=9EA04SRP7SZ1 type=del size=1158199 2024-09-12T00:42:20.867 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.869+0000 7fcde98768c0 1 < completed delete operation key=J9EUM073CZHF tag=OM7YA3N11JA0 type=del 2024-09-12T00:42:20.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.877+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~0N6TOFB41LLI.0 size=1048576 2024-09-12T00:42:20.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.877+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~0N6TOFB41LLI.1 size=1048576 2024-09-12T00:42:20.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.881+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~0N6TOFB41LLI.2 size=739813 2024-09-12T00:42:20.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.881+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=0N6TOFB41LLI tag=5Z707SB40ZRL type=write size=3885541 2024-09-12T00:42:20.880 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.881+0000 7fcde98768c0 1 < completed delete operation key=RC9A2Y5TCP9C tag=W6PLC58RBT0I type=del 2024-09-12T00:42:20.883 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.885+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=L4HTSOAP0RLH type=del size=2514225 2024-09-12T00:42:20.884 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.885+0000 7fcde98768c0 1 < canceled part key=_multipart_C6PW0ETP4BG2.2~SNL07U7Y1DAT.0 size=1048576 2024-09-12T00:42:20.886 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.889+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~SNL07U7Y1DAT.1 size=828429 2024-09-12T00:42:20.890 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.893+0000 7fcde98768c0 1 < canceled multipart upload key=C6PW0ETP4BG2 upload=SNL07U7Y1DAT tag=QPEZDJP1FN44 type=write size=2925581 2024-09-12T00:42:20.895 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.897+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~7XQ2SKT9J6CL.0 size=1048576 2024-09-12T00:42:20.897 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.901+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~7XQ2SKT9J6CL.1 size=184788 2024-09-12T00:42:20.897 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.901+0000 7fcde98768c0 1 > prepared multipart upload key=BQGIXJJWBAN0 upload=7XQ2SKT9J6CL tag=CI12D9KL2DIB type=write size=2281940 2024-09-12T00:42:20.904 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.905+0000 7fcde98768c0 1 < suggested update operation key=QD5JXFL962R5 tag=3Z599D7XYGIG type=write size=341604 2024-09-12T00:42:20.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.909+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~8MCJHQ3W318W.0 size=1048576 2024-09-12T00:42:20.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.913+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~8MCJHQ3W318W.1 size=1048576 2024-09-12T00:42:20.912 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.913+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~8MCJHQ3W318W.2 size=194574 2024-09-12T00:42:20.912 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.913+0000 7fcde98768c0 1 > prepared multipart upload key=2T5IU2IUNGJX upload=8MCJHQ3W318W tag=ITEH2WD6Z9CL type=write size=3340302 2024-09-12T00:42:20.914 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.917+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~XM5FT3D91XPI.0 size=1048576 2024-09-12T00:42:20.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.917+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~XM5FT3D91XPI.1 size=1048576 2024-09-12T00:42:20.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.921+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~XM5FT3D91XPI.2 size=977223 2024-09-12T00:42:20.924 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.925+0000 7fcde98768c0 1 < completed multipart upload key=BZ4YUNTMOJBK upload=XM5FT3D91XPI tag=H2SNWNV8DUL8 type=write size=4122951 2024-09-12T00:42:20.926 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.929+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=9UBELZNTXTBF type=del size=3915944 2024-09-12T00:42:20.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.933+0000 7fcde98768c0 1 < completed write operation key=HVE3YQTFZWTV tag=97KMC41CGW46 type=write size=268899 2024-09-12T00:42:20.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.937+0000 7fcde98768c0 1 > prepared operation key=KME8ZTTUGOXY tag=EB6WJOLWANDC type=del size=1429466 2024-09-12T00:42:20.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.941+0000 7fcde98768c0 1 < completed delete operation key=BZ4YUNTMOJBK tag=S244BGKZSMS9 type=del 2024-09-12T00:42:20.942 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.945+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=IJCWJ9UPNO1F type=write size=914718 2024-09-12T00:42:20.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.949+0000 7fcde98768c0 1 < suggested remove operation key=EDFNLQYP4L4L tag=EIMKIQ7J8N3A type=del 2024-09-12T00:42:20.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.953+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~84HXEPKLNJ3M.0 size=867404 2024-09-12T00:42:20.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.953+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=84HXEPKLNJ3M tag=EOMP42P1MEZ1 type=write size=1915980 2024-09-12T00:42:20.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.957+0000 7fcde98768c0 1 < completed delete operation key=JW2GNFAYFNEK tag=SNLKEYPKN194 type=del 2024-09-12T00:42:20.957 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.961+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=J493D2JAOETZ type=del size=3952802 2024-09-12T00:42:20.960 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.961+0000 7fcde98768c0 1 < completed write operation key=BZ4YUNTMOJBK tag=5DC92AKGSRTW type=write size=682377 2024-09-12T00:42:20.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.969+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~ARSDP60CUOWP.0 size=1012142 2024-09-12T00:42:20.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.969+0000 7fcde98768c0 1 > prepared multipart upload key=WLE5QLNPAGZA upload=ARSDP60CUOWP tag=4RJCZ0MC7IRQ type=write size=2060718 2024-09-12T00:42:20.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.969+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~DO17XA3VT48L.0 size=1048576 2024-09-12T00:42:20.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.973+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~DO17XA3VT48L.1 size=1048576 2024-09-12T00:42:20.971 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.973+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~DO17XA3VT48L.2 size=188517 2024-09-12T00:42:20.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.977+0000 7fcde98768c0 1 < completed multipart upload key=4487IMSOLPDV upload=DO17XA3VT48L tag=EAP8JS8T6CXC type=write size=3334245 2024-09-12T00:42:20.978 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.981+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=G1JYNM9HDXSV type=del size=1210659 2024-09-12T00:42:20.981 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.985+0000 7fcde98768c0 1 < completed write operation key=5B8C6E8L5N52 tag=50FCZLL2MB8G type=write size=764296 2024-09-12T00:42:20.985 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.989+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~1S1OQ6PGQES9.0 size=837338 2024-09-12T00:42:20.985 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.989+0000 7fcde98768c0 1 > prepared multipart upload key=HVE3YQTFZWTV upload=1S1OQ6PGQES9 tag=KWCNKXJVEDXQ type=write size=1885914 2024-09-12T00:42:20.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.993+0000 7fcde98768c0 1 < suggested remove operation key=368TXYQVK9C3 tag=YHFBZQ0Y89KP type=write 2024-09-12T00:42:20.993 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.997+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=TW01I6TOB340 type=write size=84011 2024-09-12T00:42:20.995 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:20.997+0000 7fcde98768c0 -1 < failed to complete operation key=EDFNLQYP4L4L tag=7Z7JPZOO87ZZ type=del size=172103: (22) Invalid argument 2024-09-12T00:42:21.000 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.001+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~1ZSKUXC679Z9.0 size=199814 2024-09-12T00:42:21.000 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.001+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=1ZSKUXC679Z9 tag=LO75BX520YZC type=write size=1248390 2024-09-12T00:42:21.003 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.005+0000 7fcde98768c0 -1 < failed to complete operation key=QD5JXFL962R5 tag=ZD6KD1LTB5LF type=del size=1709136: (22) Invalid argument 2024-09-12T00:42:21.006 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.009+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=Z9GFDYO187X6 type=del size=2276347 2024-09-12T00:42:21.009 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.013+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=9EA04SRP7SZ1 type=del 2024-09-12T00:42:21.012 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.013+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=Y61XCALLQIUE type=del size=2790921 2024-09-12T00:42:21.015 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.017+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~0N6TOFB41LLI.0 size=1048576 2024-09-12T00:42:21.018 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.021+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~0N6TOFB41LLI.1 size=1048576 2024-09-12T00:42:21.020 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.021+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~0N6TOFB41LLI.2 size=739813 2024-09-12T00:42:21.025 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.029+0000 7fcde98768c0 1 < completed multipart upload key=V80E1NH858IK upload=0N6TOFB41LLI tag=5Z707SB40ZRL type=write size=3885541 2024-09-12T00:42:21.030 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.033+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~JXN4RJCUIYEJ.0 size=181288 2024-09-12T00:42:21.030 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.033+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=JXN4RJCUIYEJ tag=EHQR0OF1XFP3 type=write size=1229864 2024-09-12T00:42:21.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.037+0000 7fcde98768c0 1 < completed delete operation key=97030NBF3MI4 tag=L4HTSOAP0RLH type=del 2024-09-12T00:42:21.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.037+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=CB6444FQ7S0T type=del size=3538737 2024-09-12T00:42:21.039 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.041+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~7XQ2SKT9J6CL.0 size=1048576 2024-09-12T00:42:21.041 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.045+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~7XQ2SKT9J6CL.1 size=184788 2024-09-12T00:42:21.046 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.049+0000 7fcde98768c0 1 < completed multipart upload key=BQGIXJJWBAN0 upload=7XQ2SKT9J6CL tag=CI12D9KL2DIB type=write size=2281940 2024-09-12T00:42:21.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.053+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~IT7903ATFM2U.0 size=1048576 2024-09-12T00:42:21.053 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.057+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~IT7903ATFM2U.1 size=1048576 2024-09-12T00:42:21.055 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.057+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~IT7903ATFM2U.2 size=509372 2024-09-12T00:42:21.055 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.057+0000 7fcde98768c0 1 > prepared multipart upload key=RC9A2Y5TCP9C upload=IT7903ATFM2U tag=BDP83IB7X8Q9 type=write size=3655100 2024-09-12T00:42:21.058 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.061+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~8MCJHQ3W318W.0 size=1048576 2024-09-12T00:42:21.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.061+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~8MCJHQ3W318W.1 size=1048576 2024-09-12T00:42:21.062 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.065+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~8MCJHQ3W318W.2 size=194574 2024-09-12T00:42:21.067 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.069+0000 7fcde98768c0 1 < completed multipart upload key=2T5IU2IUNGJX upload=8MCJHQ3W318W tag=ITEH2WD6Z9CL type=write size=3340302 2024-09-12T00:42:21.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.073+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=8VU4OGO1TOHC type=del size=226764 2024-09-12T00:42:21.072 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.077+0000 7fcde98768c0 1 < completed delete operation key=3QOENE572J7A tag=9UBELZNTXTBF type=del 2024-09-12T00:42:21.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.077+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=TVSDZYE466LT type=del size=137704 2024-09-12T00:42:21.078 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.081+0000 7fcde98768c0 1 < completed delete operation key=KME8ZTTUGOXY tag=EB6WJOLWANDC type=del 2024-09-12T00:42:21.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.085+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=79WLVC52XR36 type=del size=363190 2024-09-12T00:42:21.083 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.085+0000 7fcde98768c0 1 < completed write operation key=R2EBH0Q5885L tag=IJCWJ9UPNO1F type=write size=914718 2024-09-12T00:42:21.088 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.089+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~MWL37BY5G937.0 size=239079 2024-09-12T00:42:21.088 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.089+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=MWL37BY5G937 tag=GXM42MATQKET type=write size=1287655 2024-09-12T00:42:21.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.093+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~84HXEPKLNJ3M.0 size=867404 2024-09-12T00:42:21.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.097+0000 7fcde98768c0 1 < completed multipart upload key=QD5JXFL962R5 upload=84HXEPKLNJ3M tag=EOMP42P1MEZ1 type=write size=1915980 2024-09-12T00:42:21.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.101+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=WBY5V1YDMQH4 type=del size=3323822 2024-09-12T00:42:21.100 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.101+0000 7fcde98768c0 1 < completed delete operation key=TUMAMUZUIR7E tag=J493D2JAOETZ type=del 2024-09-12T00:42:21.106 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.109+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~KFZIHMYHS5PA.0 size=1048576 2024-09-12T00:42:21.108 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.109+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~KFZIHMYHS5PA.1 size=1048576 2024-09-12T00:42:21.110 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.113+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~KFZIHMYHS5PA.2 size=167492 2024-09-12T00:42:21.111 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.113+0000 7fcde98768c0 1 > prepared multipart upload key=NVOFV649MT0A upload=KFZIHMYHS5PA tag=GSDDRWFSIKI3 type=write size=3313220 2024-09-12T00:42:21.114 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.117+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~ARSDP60CUOWP.0 size=1012142 2024-09-12T00:42:21.119 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.121+0000 7fcde98768c0 1 < completed multipart upload key=WLE5QLNPAGZA upload=ARSDP60CUOWP tag=4RJCZ0MC7IRQ type=write size=2060718 2024-09-12T00:42:21.125 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.129+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~VKB53BMH3J7E.0 size=970903 2024-09-12T00:42:21.125 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.129+0000 7fcde98768c0 1 > prepared multipart upload key=IMITNCB1ST9E upload=VKB53BMH3J7E tag=DAG0LWY0XI65 type=write size=2019479 2024-09-12T00:42:21.128 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.129+0000 7fcde98768c0 1 < completed delete operation key=RC9A2Y5TCP9C tag=G1JYNM9HDXSV type=del 2024-09-12T00:42:21.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.137+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~BC1OE2YPWAGT.0 size=1048576 2024-09-12T00:42:21.135 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.137+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~BC1OE2YPWAGT.1 size=1048576 2024-09-12T00:42:21.137 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.141+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~BC1OE2YPWAGT.2 size=351185 2024-09-12T00:42:21.138 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.141+0000 7fcde98768c0 1 > prepared multipart upload key=5YBVLUYJW40U upload=BC1OE2YPWAGT tag=5E411N7FH577 type=write size=3496913 2024-09-12T00:42:21.141 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.145+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~1S1OQ6PGQES9.0 size=837338 2024-09-12T00:42:21.146 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.149+0000 7fcde98768c0 1 < completed multipart upload key=HVE3YQTFZWTV upload=1S1OQ6PGQES9 tag=KWCNKXJVEDXQ type=write size=1885914 2024-09-12T00:42:21.148 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.153+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=BEV9AD24RV3L type=del size=2246306 2024-09-12T00:42:21.151 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.153+0000 7fcde98768c0 1 < completed write operation key=NVOFV649MT0A tag=TW01I6TOB340 type=write size=84011 2024-09-12T00:42:21.154 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.157+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=0L3LJAB1D2ND type=del size=1329741 2024-09-12T00:42:21.158 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.161+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~1ZSKUXC679Z9.0 size=199814 2024-09-12T00:42:21.162 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.165+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=1ZSKUXC679Z9 tag=LO75BX520YZC type=write size=1248390 2024-09-12T00:42:21.165 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.169+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=8Y5G8TJR3YIQ type=del size=1775770 2024-09-12T00:42:21.168 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.169+0000 7fcde98768c0 1 < completed delete operation key=G6R8BX1H7SPM tag=Z9GFDYO187X6 type=del 2024-09-12T00:42:21.171 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.173+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=AAW5BRI0XZ9B type=del size=3651270 2024-09-12T00:42:21.174 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.177+0000 7fcde98768c0 1 < completed delete operation key=G6R8BX1H7SPM tag=Y61XCALLQIUE type=del 2024-09-12T00:42:21.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.181+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=4AAG7LP167M2 type=del size=2601727 2024-09-12T00:42:21.177 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.181+0000 7fcde98768c0 1 < canceled part key=_multipart_QD5JXFL962R5.2~JXN4RJCUIYEJ.0 size=181288 2024-09-12T00:42:21.181 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.185+0000 7fcde98768c0 1 < canceled multipart upload key=QD5JXFL962R5 upload=JXN4RJCUIYEJ tag=EHQR0OF1XFP3 type=write size=1229864 2024-09-12T00:42:21.183 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.185+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=5T9747JXSFOX type=del size=466282 2024-09-12T00:42:21.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.189+0000 7fcde98768c0 1 < completed delete operation key=7UR0FX8HA2A5 tag=CB6444FQ7S0T type=del 2024-09-12T00:42:21.188 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.189+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=VE8KAELHB1YT type=write size=65696 2024-09-12T00:42:21.191 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.193+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~IT7903ATFM2U.0 size=1048576 2024-09-12T00:42:21.192 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.197+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~IT7903ATFM2U.1 size=1048576 2024-09-12T00:42:21.197 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.201+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~IT7903ATFM2U.2 size=509372 2024-09-12T00:42:21.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.205+0000 7fcde98768c0 1 < completed multipart upload key=RC9A2Y5TCP9C upload=IT7903ATFM2U tag=BDP83IB7X8Q9 type=write size=3655100 2024-09-12T00:42:21.204 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.205+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=DACEGXF9KDNC type=del size=555909 2024-09-12T00:42:21.208 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.209+0000 7fcde98768c0 1 < suggested remove operation key=R2EBH0Q5885L tag=8VU4OGO1TOHC type=del 2024-09-12T00:42:21.210 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.213+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=90H9BUJLYMEB type=del size=454474 2024-09-12T00:42:21.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.217+0000 7fcde98768c0 -1 < failed to complete operation key=R2EBH0Q5885L tag=TVSDZYE466LT type=del size=137704: (22) Invalid argument 2024-09-12T00:42:21.218 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.221+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~0NEWOY69LF6C.0 size=1048576 2024-09-12T00:42:21.219 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.221+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~0NEWOY69LF6C.1 size=1048576 2024-09-12T00:42:21.221 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.225+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~0NEWOY69LF6C.2 size=171210 2024-09-12T00:42:21.221 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.225+0000 7fcde98768c0 1 > prepared multipart upload key=HVE3YQTFZWTV upload=0NEWOY69LF6C tag=EN3OC1AH6M0C type=write size=3316938 2024-09-12T00:42:21.223 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.225+0000 7fcde98768c0 1 < completed delete operation key=V80E1NH858IK tag=79WLVC52XR36 type=del 2024-09-12T00:42:21.225 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.229+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=NQZ6ON04S5RN type=del size=1932396 2024-09-12T00:42:21.228 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.229+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~MWL37BY5G937.0 size=239079 2024-09-12T00:42:21.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.233+0000 7fcde98768c0 1 < completed multipart upload key=BZ4YUNTMOJBK upload=MWL37BY5G937 tag=GXM42MATQKET type=write size=1287655 2024-09-12T00:42:21.233 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.237+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=DUOQ79TA75AQ type=del size=2942060 2024-09-12T00:42:21.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.241+0000 7fcde98768c0 1 < suggested update operation key=3X9I78PMR1HV tag=WBY5V1YDMQH4 type=del size=3323822 2024-09-12T00:42:21.240 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.245+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=C1SM2XFGMB4O type=del size=1166559 2024-09-12T00:42:21.243 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.245+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~KFZIHMYHS5PA.0 size=1048576 2024-09-12T00:42:21.243 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.245+0000 7fcde98768c0 1 < canceled part key=_multipart_NVOFV649MT0A.2~KFZIHMYHS5PA.1 size=1048576 2024-09-12T00:42:21.245 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.249+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~KFZIHMYHS5PA.2 size=167492 2024-09-12T00:42:21.249 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.253+0000 7fcde98768c0 1 < canceled multipart upload key=NVOFV649MT0A upload=KFZIHMYHS5PA tag=GSDDRWFSIKI3 type=write size=3313220 2024-09-12T00:42:21.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.257+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~MS2KNI3R912C.0 size=1048576 2024-09-12T00:42:21.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.257+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~MS2KNI3R912C.1 size=1047960 2024-09-12T00:42:21.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.257+0000 7fcde98768c0 1 > prepared multipart upload key=3X9I78PMR1HV upload=MS2KNI3R912C tag=LQF5YCEWRXEN type=write size=3145112 2024-09-12T00:42:21.258 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.261+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~VKB53BMH3J7E.0 size=970903 2024-09-12T00:42:21.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.265+0000 7fcde98768c0 1 < completed multipart upload key=IMITNCB1ST9E upload=VKB53BMH3J7E tag=DAG0LWY0XI65 type=write size=2019479 2024-09-12T00:42:21.266 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.269+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~A138ZMX2EQ2O.0 size=1048576 2024-09-12T00:42:21.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.269+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~A138ZMX2EQ2O.1 size=1048576 2024-09-12T00:42:21.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.273+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~A138ZMX2EQ2O.2 size=19077 2024-09-12T00:42:21.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.273+0000 7fcde98768c0 1 > prepared multipart upload key=RC9A2Y5TCP9C upload=A138ZMX2EQ2O tag=M0YZDFO6TYWF type=write size=3164805 2024-09-12T00:42:21.273 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.277+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~BC1OE2YPWAGT.0 size=1048576 2024-09-12T00:42:21.273 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.277+0000 7fcde98768c0 1 < canceled part key=_multipart_5YBVLUYJW40U.2~BC1OE2YPWAGT.1 size=1048576 2024-09-12T00:42:21.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.277+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~BC1OE2YPWAGT.2 size=351185 2024-09-12T00:42:21.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.281+0000 7fcde98768c0 1 < canceled multipart upload key=5YBVLUYJW40U upload=BC1OE2YPWAGT tag=5E411N7FH577 type=write size=3496913 2024-09-12T00:42:21.281 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.285+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=EDBZT5ALO3R3 type=del size=2175148 2024-09-12T00:42:21.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.285+0000 7fcde98768c0 1 < canceled operation key=RC9A2Y5TCP9C tag=BEV9AD24RV3L type=del size=2246306 2024-09-12T00:42:21.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.289+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=U1D24SH56JML type=del size=2979353 2024-09-12T00:42:21.290 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.293+0000 7fcde98768c0 1 < suggested remove operation key=7UR0FX8HA2A5 tag=0L3LJAB1D2ND type=del 2024-09-12T00:42:21.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.297+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~RFY77K753KB7.0 size=1048576 2024-09-12T00:42:21.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.301+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~RFY77K753KB7.1 size=956682 2024-09-12T00:42:21.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.301+0000 7fcde98768c0 1 > prepared multipart upload key=5B8C6E8L5N52 upload=RFY77K753KB7 tag=6JAKJHS9F3C3 type=write size=3053834 2024-09-12T00:42:21.301 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.305+0000 7fcde98768c0 1 < suggested update operation key=368TXYQVK9C3 tag=8Y5G8TJR3YIQ type=del size=1775770 2024-09-12T00:42:21.303 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.305+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=AWP77UC6M684 type=write size=897072 2024-09-12T00:42:21.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.309+0000 7fcde98768c0 -1 < failed to complete operation key=3X9I78PMR1HV tag=AAW5BRI0XZ9B type=del size=3651270: (22) Invalid argument 2024-09-12T00:42:21.308 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.309+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=CXTAL0DY9EJP type=write size=84385 2024-09-12T00:42:21.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.313+0000 7fcde98768c0 -1 < failed to complete operation key=3X9I78PMR1HV tag=4AAG7LP167M2 type=del size=2601727: (22) Invalid argument 2024-09-12T00:42:21.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.317+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=BX8AOWDKFXZX type=del size=184986 2024-09-12T00:42:21.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.317+0000 7fcde98768c0 1 < completed delete operation key=97030NBF3MI4 tag=5T9747JXSFOX type=del 2024-09-12T00:42:21.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.321+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=NU87X7HWLO4I type=del size=818369 2024-09-12T00:42:21.320 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.321+0000 7fcde98768c0 -1 < failed to complete operation key=R2EBH0Q5885L tag=VE8KAELHB1YT type=write size=65696: (22) Invalid argument 2024-09-12T00:42:21.325 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.329+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~QM11F820F1QW.0 size=1048576 2024-09-12T00:42:21.327 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.329+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~QM11F820F1QW.1 size=154252 2024-09-12T00:42:21.327 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.329+0000 7fcde98768c0 1 > prepared multipart upload key=368TXYQVK9C3 upload=QM11F820F1QW tag=AGDWD9YAEPSJ type=write size=2251404 2024-09-12T00:42:21.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.333+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=DACEGXF9KDNC type=del 2024-09-12T00:42:21.332 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.333+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=R03CSPQI61YW type=del size=159391 2024-09-12T00:42:21.335 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.337+0000 7fcde98768c0 1 < completed delete operation key=EDFNLQYP4L4L tag=90H9BUJLYMEB type=del 2024-09-12T00:42:21.337 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.341+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=9J0Y2DP5POK4 type=write size=503352 2024-09-12T00:42:21.338 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.341+0000 7fcde98768c0 1 < canceled part key=_multipart_HVE3YQTFZWTV.2~0NEWOY69LF6C.0 size=1048576 2024-09-12T00:42:21.340 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.341+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~0NEWOY69LF6C.1 size=1048576 2024-09-12T00:42:21.342 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.345+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~0NEWOY69LF6C.2 size=171210 2024-09-12T00:42:21.347 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.349+0000 7fcde98768c0 1 < canceled multipart upload key=HVE3YQTFZWTV upload=0NEWOY69LF6C tag=EN3OC1AH6M0C type=write size=3316938 2024-09-12T00:42:21.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.353+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=R2YH0BQUKY3D type=del size=3946441 2024-09-12T00:42:21.352 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.353+0000 7fcde98768c0 1 < completed delete operation key=Z1PY2MFUC1C4 tag=NQZ6ON04S5RN type=del 2024-09-12T00:42:21.356 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.357+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~UJBSYR1YT34I.0 size=388876 2024-09-12T00:42:21.356 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.357+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=UJBSYR1YT34I tag=Q4QTGCI6KMTD type=write size=1437452 2024-09-12T00:42:21.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.361+0000 7fcde98768c0 1 < completed delete operation key=QD5JXFL962R5 tag=DUOQ79TA75AQ type=del 2024-09-12T00:42:21.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.365+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=RJ9GBKYMATTR type=del size=503984 2024-09-12T00:42:21.363 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.365+0000 7fcde98768c0 1 < completed delete operation key=EDFNLQYP4L4L tag=C1SM2XFGMB4O type=del 2024-09-12T00:42:21.368 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.369+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~CPCLM4YN4L1O.0 size=1048576 2024-09-12T00:42:21.370 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.373+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~CPCLM4YN4L1O.1 size=1048576 2024-09-12T00:42:21.372 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.373+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~CPCLM4YN4L1O.2 size=951196 2024-09-12T00:42:21.372 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.373+0000 7fcde98768c0 1 > prepared multipart upload key=BQGIXJJWBAN0 upload=CPCLM4YN4L1O tag=VKRMUYYG5F1R type=write size=4096924 2024-09-12T00:42:21.374 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.377+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~MS2KNI3R912C.0 size=1048576 2024-09-12T00:42:21.376 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.377+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~MS2KNI3R912C.1 size=1047960 2024-09-12T00:42:21.381 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.385+0000 7fcde98768c0 1 < completed multipart upload key=3X9I78PMR1HV upload=MS2KNI3R912C tag=LQF5YCEWRXEN type=write size=3145112 2024-09-12T00:42:21.385 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.389+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=S0E5MQMWEOXX type=del size=786044 2024-09-12T00:42:21.388 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.389+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~A138ZMX2EQ2O.0 size=1048576 2024-09-12T00:42:21.390 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.393+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~A138ZMX2EQ2O.1 size=1048576 2024-09-12T00:42:21.393 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.397+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~A138ZMX2EQ2O.2 size=19077 2024-09-12T00:42:21.398 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.401+0000 7fcde98768c0 1 < completed multipart upload key=RC9A2Y5TCP9C upload=A138ZMX2EQ2O tag=M0YZDFO6TYWF type=write size=3164805 2024-09-12T00:42:21.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.405+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=F1CM3LWXX1UW type=del size=1269209 2024-09-12T00:42:21.404 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.405+0000 7fcde98768c0 1 < completed delete operation key=5YBVLUYJW40U tag=EDBZT5ALO3R3 type=del 2024-09-12T00:42:21.410 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.413+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~H95YFAWK1UNW.0 size=186098 2024-09-12T00:42:21.410 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.413+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=H95YFAWK1UNW tag=URP35P37ZBBI type=write size=1234674 2024-09-12T00:42:21.413 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.417+0000 7fcde98768c0 1 < completed delete operation key=TUMAMUZUIR7E tag=U1D24SH56JML type=del 2024-09-12T00:42:21.416 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.417+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=34KE29YS4BOG type=del size=2184666 2024-09-12T00:42:21.416 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.421+0000 7fcde98768c0 1 < canceled part key=_multipart_5B8C6E8L5N52.2~RFY77K753KB7.0 size=1048576 2024-09-12T00:42:21.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.421+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~RFY77K753KB7.1 size=956682 2024-09-12T00:42:21.424 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.425+0000 7fcde98768c0 1 < canceled multipart upload key=5B8C6E8L5N52 upload=RFY77K753KB7 tag=6JAKJHS9F3C3 type=write size=3053834 2024-09-12T00:42:21.428 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.429+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=8SXSWFOIQFMC type=del size=3853745 2024-09-12T00:42:21.437 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.441+0000 7fcde98768c0 1 < suggested update operation key=FUJIUIR1E00J tag=AWP77UC6M684 type=write size=897072 2024-09-12T00:42:21.440 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.445+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=QDX8SDSX4WL0 type=del size=279745 2024-09-12T00:42:21.443 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.445+0000 7fcde98768c0 1 < completed write operation key=5B8C6E8L5N52 tag=CXTAL0DY9EJP type=write size=84385 2024-09-12T00:42:21.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.449+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=RGZ24OBEZ365 type=write size=326147 2024-09-12T00:42:21.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.453+0000 7fcde98768c0 1 < completed delete operation key=ZQD0QXDN1J1I tag=BX8AOWDKFXZX type=del 2024-09-12T00:42:21.456 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.457+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~A1H16M4JB059.0 size=1048576 2024-09-12T00:42:21.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.461+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~A1H16M4JB059.1 size=985244 2024-09-12T00:42:21.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.461+0000 7fcde98768c0 1 > prepared multipart upload key=RC9A2Y5TCP9C upload=A1H16M4JB059 tag=4DKYZJYRYE9L type=write size=3082396 2024-09-12T00:42:21.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.465+0000 7fcde98768c0 1 < completed delete operation key=G6R8BX1H7SPM tag=NU87X7HWLO4I type=del 2024-09-12T00:42:21.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.465+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=3DIM10LXFQFX type=write size=957136 2024-09-12T00:42:21.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.469+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~QM11F820F1QW.0 size=1048576 2024-09-12T00:42:21.468 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.469+0000 7fcde98768c0 1 < canceled part key=_multipart_368TXYQVK9C3.2~QM11F820F1QW.1 size=154252 2024-09-12T00:42:21.473 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.473+0000 7fcde98768c0 1 < canceled multipart upload key=368TXYQVK9C3 upload=QM11F820F1QW tag=AGDWD9YAEPSJ type=write size=2251404 2024-09-12T00:42:21.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.477+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=4LG2159H22A0 type=del size=3093288 2024-09-12T00:42:21.478 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.481+0000 7fcde98768c0 1 < completed delete operation key=R2EBH0Q5885L tag=R03CSPQI61YW type=del 2024-09-12T00:42:21.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.485+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~NM3X6S12V0Y3.0 size=1048576 2024-09-12T00:42:21.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.489+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~NM3X6S12V0Y3.1 size=1048576 2024-09-12T00:42:21.490 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.493+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~NM3X6S12V0Y3.2 size=413097 2024-09-12T00:42:21.490 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.493+0000 7fcde98768c0 1 > prepared multipart upload key=JW2GNFAYFNEK upload=NM3X6S12V0Y3 tag=H5X8KHKM4H2P type=write size=3558825 2024-09-12T00:42:21.493 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.497+0000 7fcde98768c0 1 < completed write operation key=BZ4YUNTMOJBK tag=9J0Y2DP5POK4 type=write size=503352 2024-09-12T00:42:21.496 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.497+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=XKZJT5JE4TMB type=write size=597590 2024-09-12T00:42:21.499 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.501+0000 7fcde98768c0 1 < completed delete operation key=2T5IU2IUNGJX tag=R2YH0BQUKY3D type=del 2024-09-12T00:42:21.503 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.505+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=PYJBVF8SEUX6 type=del size=4128268 2024-09-12T00:42:21.503 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.505+0000 7fcde98768c0 1 < canceled part key=_multipart_BZ4YUNTMOJBK.2~UJBSYR1YT34I.0 size=388876 2024-09-12T00:42:21.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.509+0000 7fcde98768c0 1 < canceled multipart upload key=BZ4YUNTMOJBK upload=UJBSYR1YT34I tag=Q4QTGCI6KMTD type=write size=1437452 2024-09-12T00:42:21.513 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.517+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~MSER3P3MQGQ1.0 size=179747 2024-09-12T00:42:21.513 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.517+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=MSER3P3MQGQ1 tag=7CIU93ERIEBV type=write size=1228323 2024-09-12T00:42:21.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.521+0000 7fcde98768c0 1 < completed delete operation key=368TXYQVK9C3 tag=RJ9GBKYMATTR type=del 2024-09-12T00:42:21.520 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.521+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=EEE5PQDPRJMA type=del size=2678705 2024-09-12T00:42:21.523 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.525+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~CPCLM4YN4L1O.0 size=1048576 2024-09-12T00:42:21.523 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.525+0000 7fcde98768c0 1 < canceled part key=_multipart_BQGIXJJWBAN0.2~CPCLM4YN4L1O.1 size=1048576 2024-09-12T00:42:21.525 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.529+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~CPCLM4YN4L1O.2 size=951196 2024-09-12T00:42:21.530 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.533+0000 7fcde98768c0 1 < canceled multipart upload key=BQGIXJJWBAN0 upload=CPCLM4YN4L1O tag=VKRMUYYG5F1R type=write size=4096924 2024-09-12T00:42:21.533 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.537+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=R7VBG3IHEQDB type=del size=2867227 2024-09-12T00:42:21.536 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.537+0000 7fcde98768c0 1 < completed delete operation key=QD5JXFL962R5 tag=S0E5MQMWEOXX type=del 2024-09-12T00:42:21.539 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.541+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=RK8IJNQWUUIQ type=write size=287322 2024-09-12T00:42:21.542 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.545+0000 7fcde98768c0 1 < canceled operation key=97030NBF3MI4 tag=F1CM3LWXX1UW type=del size=1269209 2024-09-12T00:42:21.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.549+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=XICONDWV2C7K type=del size=3336135 2024-09-12T00:42:21.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.549+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~H95YFAWK1UNW.0 size=186098 2024-09-12T00:42:21.553 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.557+0000 7fcde98768c0 1 < completed multipart upload key=IV4JCE1QJC70 upload=H95YFAWK1UNW tag=URP35P37ZBBI type=write size=1234674 2024-09-12T00:42:21.559 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.561+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~AOSVJXC18VVS.0 size=1048576 2024-09-12T00:42:21.561 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.565+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~AOSVJXC18VVS.1 size=200662 2024-09-12T00:42:21.562 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.565+0000 7fcde98768c0 1 > prepared multipart upload key=WLE5QLNPAGZA upload=AOSVJXC18VVS tag=2JQU52I2VRWU type=write size=2297814 2024-09-12T00:42:21.564 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.569+0000 7fcde98768c0 1 < completed delete operation key=R2EBH0Q5885L tag=34KE29YS4BOG type=del 2024-09-12T00:42:21.570 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.573+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~L30KGJWZSIRJ.0 size=1048576 2024-09-12T00:42:21.572 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.577+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~L30KGJWZSIRJ.1 size=751589 2024-09-12T00:42:21.573 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.577+0000 7fcde98768c0 1 > prepared multipart upload key=C6PW0ETP4BG2 upload=L30KGJWZSIRJ tag=HFI0EDOZF1JV type=write size=2848741 2024-09-12T00:42:21.575 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.577+0000 7fcde98768c0 1 < completed delete operation key=7UR0FX8HA2A5 tag=8SXSWFOIQFMC type=del 2024-09-12T00:42:21.579 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.581+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=6W1NIC2KXIML type=del size=1690574 2024-09-12T00:42:21.582 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.585+0000 7fcde98768c0 1 < canceled operation key=C6PW0ETP4BG2 tag=QDX8SDSX4WL0 type=del size=279745 2024-09-12T00:42:21.588 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.589+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~IZF6CRJ2ROQP.0 size=499660 2024-09-12T00:42:21.588 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.589+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=IZF6CRJ2ROQP tag=TW5SN2T3JDKA type=write size=1548236 2024-09-12T00:42:21.591 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.593+0000 7fcde98768c0 1 < completed write operation key=4487IMSOLPDV tag=RGZ24OBEZ365 type=write size=326147 2024-09-12T00:42:21.594 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.597+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=TMO5LYWZ2TEB type=del size=699635 2024-09-12T00:42:21.595 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.597+0000 7fcde98768c0 1 < canceled part key=_multipart_RC9A2Y5TCP9C.2~A1H16M4JB059.0 size=1048576 2024-09-12T00:42:21.598 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.601+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~A1H16M4JB059.1 size=985244 2024-09-12T00:42:21.603 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.605+0000 7fcde98768c0 1 < canceled multipart upload key=RC9A2Y5TCP9C upload=A1H16M4JB059 tag=4DKYZJYRYE9L type=write size=3082396 2024-09-12T00:42:21.606 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.609+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=MMZQCZKSWIJN type=del size=84756 2024-09-12T00:42:21.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.613+0000 7fcde98768c0 1 < completed write operation key=JW2GNFAYFNEK tag=3DIM10LXFQFX type=write size=957136 2024-09-12T00:42:21.612 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.613+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=O6AVMP5Q9KX0 type=del size=1908364 2024-09-12T00:42:21.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.617+0000 7fcde98768c0 1 < canceled operation key=RC9A2Y5TCP9C tag=4LG2159H22A0 type=del size=3093288 2024-09-12T00:42:21.618 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.621+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=C2G2X44XUIMX type=del size=2192137 2024-09-12T00:42:21.621 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.625+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~NM3X6S12V0Y3.0 size=1048576 2024-09-12T00:42:21.623 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.625+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~NM3X6S12V0Y3.1 size=1048576 2024-09-12T00:42:21.626 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.629+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~NM3X6S12V0Y3.2 size=413097 2024-09-12T00:42:21.631 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.633+0000 7fcde98768c0 1 < completed multipart upload key=JW2GNFAYFNEK upload=NM3X6S12V0Y3 tag=H5X8KHKM4H2P type=write size=3558825 2024-09-12T00:42:21.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.637+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=KT61Z0LW3T60 type=write size=293256 2024-09-12T00:42:21.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.641+0000 7fcde98768c0 1 < completed write operation key=V80E1NH858IK tag=XKZJT5JE4TMB type=write size=597590 2024-09-12T00:42:21.640 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.641+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=KFXXCX42X0G8 type=del size=898746 2024-09-12T00:42:21.643 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.645+0000 7fcde98768c0 1 < completed delete operation key=J9EUM073CZHF tag=PYJBVF8SEUX6 type=del 2024-09-12T00:42:21.648 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.653+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~3BCT17OOGW61.0 size=1048576 2024-09-12T00:42:21.651 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.653+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~3BCT17OOGW61.1 size=294715 2024-09-12T00:42:21.651 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.653+0000 7fcde98768c0 1 > prepared multipart upload key=IMITNCB1ST9E upload=3BCT17OOGW61 tag=ACINZGEHFQVV type=write size=2391867 2024-09-12T00:42:21.654 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.657+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~MSER3P3MQGQ1.0 size=179747 2024-09-12T00:42:21.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.661+0000 7fcde98768c0 1 < completed multipart upload key=V80E1NH858IK upload=MSER3P3MQGQ1 tag=7CIU93ERIEBV type=write size=1228323 2024-09-12T00:42:21.662 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.665+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=YA1HUY515URM type=del size=2308834 2024-09-12T00:42:21.665 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.669+0000 7fcde98768c0 1 < completed delete operation key=3QOENE572J7A tag=EEE5PQDPRJMA type=del 2024-09-12T00:42:21.668 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.669+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=Q8IOEM90PH0F type=del size=2562180 2024-09-12T00:42:21.671 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.673+0000 7fcde98768c0 1 < completed delete operation key=FUJIUIR1E00J tag=R7VBG3IHEQDB type=del 2024-09-12T00:42:21.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.677+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~CKE7V9HXQGG3.0 size=1048576 2024-09-12T00:42:21.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.681+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~CKE7V9HXQGG3.1 size=696440 2024-09-12T00:42:21.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.681+0000 7fcde98768c0 1 > prepared multipart upload key=KME8ZTTUGOXY upload=CKE7V9HXQGG3 tag=P0JU8H43U4V7 type=write size=2793592 2024-09-12T00:42:21.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.685+0000 7fcde98768c0 1 < completed write operation key=RC9A2Y5TCP9C tag=RK8IJNQWUUIQ type=write size=287322 2024-09-12T00:42:21.686 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.689+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~EIFTQIRV7HIK.0 size=860380 2024-09-12T00:42:21.686 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.689+0000 7fcde98768c0 1 > prepared multipart upload key=97030NBF3MI4 upload=EIFTQIRV7HIK tag=LXBLQITYUY6A type=write size=1908956 2024-09-12T00:42:21.689 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.693+0000 7fcde98768c0 1 < completed delete operation key=EDFNLQYP4L4L tag=XICONDWV2C7K type=del 2024-09-12T00:42:21.692 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.693+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=JFWNJQZA4RKP type=del size=1762640 2024-09-12T00:42:21.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.697+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~AOSVJXC18VVS.0 size=1048576 2024-09-12T00:42:21.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.701+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~AOSVJXC18VVS.1 size=200662 2024-09-12T00:42:21.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.705+0000 7fcde98768c0 1 < completed multipart upload key=WLE5QLNPAGZA upload=AOSVJXC18VVS tag=2JQU52I2VRWU type=write size=2297814 2024-09-12T00:42:21.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.713+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~LHGWIPI05ACB.0 size=1048576 2024-09-12T00:42:21.711 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.713+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~LHGWIPI05ACB.1 size=810675 2024-09-12T00:42:21.711 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.713+0000 7fcde98768c0 1 > prepared multipart upload key=Z1PY2MFUC1C4 upload=LHGWIPI05ACB tag=YBZ8CJ3IPEVV type=write size=2907827 2024-09-12T00:42:21.714 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.717+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~L30KGJWZSIRJ.0 size=1048576 2024-09-12T00:42:21.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.721+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~L30KGJWZSIRJ.1 size=751589 2024-09-12T00:42:21.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.725+0000 7fcde98768c0 1 < completed multipart upload key=C6PW0ETP4BG2 upload=L30KGJWZSIRJ tag=HFI0EDOZF1JV type=write size=2848741 2024-09-12T00:42:21.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.729+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=UAG1M2IYDO3A type=del size=1724711 2024-09-12T00:42:21.730 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.733+0000 7fcde98768c0 1 < completed delete operation key=HVE3YQTFZWTV tag=6W1NIC2KXIML type=del 2024-09-12T00:42:21.736 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.737+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~3214WJNKX7AB.0 size=1048576 2024-09-12T00:42:21.738 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.741+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~3214WJNKX7AB.1 size=1048576 2024-09-12T00:42:21.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.745+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~3214WJNKX7AB.2 size=446490 2024-09-12T00:42:21.741 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.745+0000 7fcde98768c0 1 > prepared multipart upload key=R2EBH0Q5885L upload=3214WJNKX7AB tag=XDH1F0RE2C3X type=write size=3592218 2024-09-12T00:42:21.744 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.745+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~IZF6CRJ2ROQP.0 size=499660 2024-09-12T00:42:21.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.749+0000 7fcde98768c0 1 < completed multipart upload key=QD5JXFL962R5 upload=IZF6CRJ2ROQP tag=TW5SN2T3JDKA type=write size=1548236 2024-09-12T00:42:21.751 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.753+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=09OCEYTFH46Q type=del size=878982 2024-09-12T00:42:21.757 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.761+0000 7fcde98768c0 1 < suggested remove operation key=QD5JXFL962R5 tag=TMO5LYWZ2TEB type=del 2024-09-12T00:42:21.760 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.761+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=7K0U7W2AI0Z5 type=write size=465403 2024-09-12T00:42:21.766 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.769+0000 7fcde98768c0 1 < suggested remove operation key=BZ4YUNTMOJBK tag=MMZQCZKSWIJN type=del 2024-09-12T00:42:21.769 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.773+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=IE4D2M79HWJU type=del size=4014537 2024-09-12T00:42:21.775 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.777+0000 7fcde98768c0 1 < suggested remove operation key=3QOENE572J7A tag=O6AVMP5Q9KX0 type=del 2024-09-12T00:42:21.781 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.785+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~5S7UGDLDNCVE.0 size=1048576 2024-09-12T00:42:21.784 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.785+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~5S7UGDLDNCVE.1 size=1048576 2024-09-12T00:42:21.787 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.789+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~5S7UGDLDNCVE.2 size=664078 2024-09-12T00:42:21.787 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.789+0000 7fcde98768c0 1 > prepared multipart upload key=KME8ZTTUGOXY upload=5S7UGDLDNCVE tag=Y0I92O11MQX7 type=write size=3809806 2024-09-12T00:42:21.790 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.793+0000 7fcde98768c0 1 < completed delete operation key=JW2GNFAYFNEK tag=C2G2X44XUIMX type=del 2024-09-12T00:42:21.793 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.797+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=99W5HAEAVQ11 type=del size=3131961 2024-09-12T00:42:21.797 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.801+0000 7fcde98768c0 1 < completed write operation key=97030NBF3MI4 tag=KT61Z0LW3T60 type=write size=293256 2024-09-12T00:42:21.800 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.801+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=V7WG1KLHX0WG type=del size=3419981 2024-09-12T00:42:21.804 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.805+0000 7fcde98768c0 1 < completed delete operation key=97030NBF3MI4 tag=KFXXCX42X0G8 type=del 2024-09-12T00:42:21.807 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.809+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=AGAYY8LP48HA type=del size=1853144 2024-09-12T00:42:21.810 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.813+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~3BCT17OOGW61.0 size=1048576 2024-09-12T00:42:21.812 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.813+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~3BCT17OOGW61.1 size=294715 2024-09-12T00:42:21.818 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.821+0000 7fcde98768c0 1 < completed multipart upload key=IMITNCB1ST9E upload=3BCT17OOGW61 tag=ACINZGEHFQVV type=write size=2391867 2024-09-12T00:42:21.821 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.825+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=4ABB1HJ7VBND type=del size=3174555 2024-09-12T00:42:21.825 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.829+0000 7fcde98768c0 -1 < failed to complete operation key=3QOENE572J7A tag=YA1HUY515URM type=del size=2308834: (22) Invalid argument 2024-09-12T00:42:21.831 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.833+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~2CJX0QKMQYWP.0 size=1048576 2024-09-12T00:42:21.834 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.837+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~2CJX0QKMQYWP.1 size=1048576 2024-09-12T00:42:21.836 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.841+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~2CJX0QKMQYWP.2 size=476341 2024-09-12T00:42:21.836 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.841+0000 7fcde98768c0 1 > prepared multipart upload key=2T5IU2IUNGJX upload=2CJX0QKMQYWP tag=8X3410FBP02Q type=write size=3622069 2024-09-12T00:42:21.840 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.841+0000 7fcde98768c0 1 < completed delete operation key=IV4JCE1QJC70 tag=Q8IOEM90PH0F type=del 2024-09-12T00:42:21.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.845+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=KPUJZN19Q7T3 type=del size=3404505 2024-09-12T00:42:21.847 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.849+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~CKE7V9HXQGG3.0 size=1048576 2024-09-12T00:42:21.850 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.853+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~CKE7V9HXQGG3.1 size=696440 2024-09-12T00:42:21.856 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.857+0000 7fcde98768c0 1 < completed multipart upload key=KME8ZTTUGOXY upload=CKE7V9HXQGG3 tag=P0JU8H43U4V7 type=write size=2793592 2024-09-12T00:42:21.860 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.861+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=O1I16416PLFH type=write size=807695 2024-09-12T00:42:21.865 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.865+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~EIFTQIRV7HIK.0 size=860380 2024-09-12T00:42:21.870 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.873+0000 7fcde98768c0 1 < completed multipart upload key=97030NBF3MI4 upload=EIFTQIRV7HIK tag=LXBLQITYUY6A type=write size=1908956 2024-09-12T00:42:21.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.877+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=FZL1WQOZ09TW type=del size=2974031 2024-09-12T00:42:21.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.881+0000 7fcde98768c0 1 < completed delete operation key=EDFNLQYP4L4L tag=JFWNJQZA4RKP type=del 2024-09-12T00:42:21.880 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.881+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=6SP2BO9ZH3BX type=del size=5715 2024-09-12T00:42:21.883 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.885+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~LHGWIPI05ACB.0 size=1048576 2024-09-12T00:42:21.886 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.889+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~LHGWIPI05ACB.1 size=810675 2024-09-12T00:42:21.892 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.893+0000 7fcde98768c0 1 < completed multipart upload key=Z1PY2MFUC1C4 upload=LHGWIPI05ACB tag=YBZ8CJ3IPEVV type=write size=2907827 2024-09-12T00:42:21.895 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.897+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=B0X0ZB193J29 type=del size=263137 2024-09-12T00:42:21.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.901+0000 7fcde98768c0 1 < completed delete operation key=7UR0FX8HA2A5 tag=UAG1M2IYDO3A type=del 2024-09-12T00:42:21.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.905+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=MI4O0PIKAF3R type=del size=1093148 2024-09-12T00:42:21.906 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.909+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~3214WJNKX7AB.0 size=1048576 2024-09-12T00:42:21.908 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.909+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~3214WJNKX7AB.1 size=1048576 2024-09-12T00:42:21.911 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.913+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~3214WJNKX7AB.2 size=446490 2024-09-12T00:42:21.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.917+0000 7fcde98768c0 1 < completed multipart upload key=R2EBH0Q5885L upload=3214WJNKX7AB tag=XDH1F0RE2C3X type=write size=3592218 2024-09-12T00:42:21.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.921+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=GZ87I8I30HP8 type=del size=1464834 2024-09-12T00:42:21.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.929+0000 7fcde98768c0 1 < suggested remove operation key=ZQD0QXDN1J1I tag=09OCEYTFH46Q type=del 2024-09-12T00:42:21.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.929+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=3DDU8YCIMVF5 type=del size=1614244 2024-09-12T00:42:21.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.933+0000 7fcde98768c0 1 < completed write operation key=V80E1NH858IK tag=7K0U7W2AI0Z5 type=write size=465403 2024-09-12T00:42:21.938 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.941+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~HV5050V1PT7X.0 size=1048576 2024-09-12T00:42:21.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.945+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~HV5050V1PT7X.1 size=1048576 2024-09-12T00:42:21.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.945+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~HV5050V1PT7X.2 size=720493 2024-09-12T00:42:21.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.945+0000 7fcde98768c0 1 > prepared multipart upload key=F813QWV02TI0 upload=HV5050V1PT7X tag=REG0AYPDL3MO type=write size=3866221 2024-09-12T00:42:21.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.949+0000 7fcde98768c0 1 < canceled operation key=V80E1NH858IK tag=IE4D2M79HWJU type=del size=4014537 2024-09-12T00:42:21.950 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.953+0000 7fcde98768c0 1 > prepared operation key=KME8ZTTUGOXY tag=QWX719YJ9Z4Z type=del size=524332 2024-09-12T00:42:21.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.957+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~5S7UGDLDNCVE.0 size=1048576 2024-09-12T00:42:21.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.957+0000 7fcde98768c0 1 < canceled part key=_multipart_KME8ZTTUGOXY.2~5S7UGDLDNCVE.1 size=1048576 2024-09-12T00:42:21.957 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.961+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~5S7UGDLDNCVE.2 size=664078 2024-09-12T00:42:21.962 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.965+0000 7fcde98768c0 1 < canceled multipart upload key=KME8ZTTUGOXY upload=5S7UGDLDNCVE tag=Y0I92O11MQX7 type=write size=3809806 2024-09-12T00:42:21.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.969+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=8451G3ZVUZ6Q type=del size=2431870 2024-09-12T00:42:21.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.969+0000 7fcde98768c0 1 < completed delete operation key=QD5JXFL962R5 tag=99W5HAEAVQ11 type=del 2024-09-12T00:42:21.970 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.973+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=Q1YGF0CVWJS8 type=write size=196265 2024-09-12T00:42:21.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.977+0000 7fcde98768c0 -1 < failed to complete operation key=ZQD0QXDN1J1I tag=V7WG1KLHX0WG type=del size=3419981: (22) Invalid argument 2024-09-12T00:42:21.978 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.981+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~VG6GDS2GVE7I.0 size=108063 2024-09-12T00:42:21.978 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.981+0000 7fcde98768c0 1 > prepared multipart upload key=5YBVLUYJW40U upload=VG6GDS2GVE7I tag=KKZK5RIEEQ9J type=write size=1156639 2024-09-12T00:42:21.981 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.985+0000 7fcde98768c0 1 < completed delete operation key=3QOENE572J7A tag=AGAYY8LP48HA type=del 2024-09-12T00:42:21.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.989+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~PUIUSBOZPBKG.0 size=1048576 2024-09-12T00:42:21.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.993+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~PUIUSBOZPBKG.1 size=1048576 2024-09-12T00:42:21.992 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.993+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~PUIUSBOZPBKG.2 size=211703 2024-09-12T00:42:21.992 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:21.993+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=PUIUSBOZPBKG tag=44RCNUEM0RYS type=write size=3357431 2024-09-12T00:42:21.997 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.001+0000 7fcde98768c0 1 < suggested remove operation key=IV4JCE1QJC70 tag=4ABB1HJ7VBND type=del 2024-09-12T00:42:22.000 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.005+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=VAL8USTPJ5ZK type=write size=50099 2024-09-12T00:42:22.003 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.005+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~2CJX0QKMQYWP.0 size=1048576 2024-09-12T00:42:22.006 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.009+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~2CJX0QKMQYWP.1 size=1048576 2024-09-12T00:42:22.006 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.009+0000 7fcde98768c0 1 < canceled part key=_multipart_2T5IU2IUNGJX.2~2CJX0QKMQYWP.2 size=476341 2024-09-12T00:42:22.010 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.013+0000 7fcde98768c0 1 < canceled multipart upload key=2T5IU2IUNGJX upload=2CJX0QKMQYWP tag=8X3410FBP02Q type=write size=3622069 2024-09-12T00:42:22.013 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.017+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=Q7MRWPEYJCR8 type=del size=1069242 2024-09-12T00:42:22.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.021+0000 7fcde98768c0 1 < suggested update operation key=4487IMSOLPDV tag=KPUJZN19Q7T3 type=del size=3404505 2024-09-12T00:42:22.026 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.029+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=VFJYO2TST0FX type=del size=89332 2024-09-12T00:42:22.032 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.033+0000 7fcde98768c0 1 < suggested remove operation key=NVOFV649MT0A tag=O1I16416PLFH type=write 2024-09-12T00:42:22.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.037+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=8D5M8ZB8C6XL type=write size=621469 2024-09-12T00:42:22.039 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.041+0000 7fcde98768c0 -1 < failed to complete operation key=4487IMSOLPDV tag=FZL1WQOZ09TW type=del size=2974031: (22) Invalid argument 2024-09-12T00:42:22.044 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.045+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~NV19ROO2XV1T.0 size=1048576 2024-09-12T00:42:22.046 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.049+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~NV19ROO2XV1T.1 size=1048576 2024-09-12T00:42:22.049 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.053+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~NV19ROO2XV1T.2 size=317573 2024-09-12T00:42:22.049 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.053+0000 7fcde98768c0 1 > prepared multipart upload key=EDFNLQYP4L4L upload=NV19ROO2XV1T tag=14BVCJ1ZGCDX type=write size=3463301 2024-09-12T00:42:22.052 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.053+0000 7fcde98768c0 1 < completed delete operation key=5YBVLUYJW40U tag=6SP2BO9ZH3BX type=del 2024-09-12T00:42:22.055 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.057+0000 7fcde98768c0 1 > prepared operation key=KME8ZTTUGOXY tag=V9T3S1PEDTQL type=del size=931860 2024-09-12T00:42:22.058 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.061+0000 7fcde98768c0 -1 < failed to complete operation key=ZQD0QXDN1J1I tag=B0X0ZB193J29 type=del size=263137: (22) Invalid argument 2024-09-12T00:42:22.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.065+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=C6YL2F6YQCX5 type=write size=411090 2024-09-12T00:42:22.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.065+0000 7fcde98768c0 1 < canceled operation key=G6R8BX1H7SPM tag=MI4O0PIKAF3R type=del size=1093148 2024-09-12T00:42:22.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.069+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=3JSYZ202NORT type=del size=4102411 2024-09-12T00:42:22.068 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.069+0000 7fcde98768c0 -1 < failed to complete operation key=IV4JCE1QJC70 tag=GZ87I8I30HP8 type=del size=1464834: (22) Invalid argument 2024-09-12T00:42:22.070 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.073+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=FDBHOS070VD4 type=del size=3356934 2024-09-12T00:42:22.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.077+0000 7fcde98768c0 1 < suggested remove operation key=7UR0FX8HA2A5 tag=3DDU8YCIMVF5 type=del 2024-09-12T00:42:22.079 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.081+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~LAJBIA3BMDG2.0 size=1048576 2024-09-12T00:42:22.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.085+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~LAJBIA3BMDG2.1 size=993187 2024-09-12T00:42:22.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.085+0000 7fcde98768c0 1 > prepared multipart upload key=J9EUM073CZHF upload=LAJBIA3BMDG2 tag=ZS5HENBEXEGZ type=write size=3090339 2024-09-12T00:42:22.084 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.085+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~HV5050V1PT7X.0 size=1048576 2024-09-12T00:42:22.084 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.085+0000 7fcde98768c0 1 < canceled part key=_multipart_F813QWV02TI0.2~HV5050V1PT7X.1 size=1048576 2024-09-12T00:42:22.084 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.085+0000 7fcde98768c0 1 < canceled part key=_multipart_F813QWV02TI0.2~HV5050V1PT7X.2 size=720493 2024-09-12T00:42:22.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.089+0000 7fcde98768c0 1 < canceled multipart upload key=F813QWV02TI0 upload=HV5050V1PT7X tag=REG0AYPDL3MO type=write size=3866221 2024-09-12T00:42:22.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.093+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=OOIWQZIPAKDB type=del size=4124199 2024-09-12T00:42:22.092 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.097+0000 7fcde98768c0 1 < completed delete operation key=KME8ZTTUGOXY tag=QWX719YJ9Z4Z type=del 2024-09-12T00:42:22.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.101+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~U89WR4JRVMFN.0 size=1048576 2024-09-12T00:42:22.099 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.101+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~U89WR4JRVMFN.1 size=989898 2024-09-12T00:42:22.099 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.101+0000 7fcde98768c0 1 > prepared multipart upload key=JW2GNFAYFNEK upload=U89WR4JRVMFN tag=YQAMUY4PC9EH type=write size=3087050 2024-09-12T00:42:22.102 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.105+0000 7fcde98768c0 1 < completed delete operation key=2T5IU2IUNGJX tag=8451G3ZVUZ6Q type=del 2024-09-12T00:42:22.107 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.109+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~AM0S7XJHYROQ.0 size=505454 2024-09-12T00:42:22.107 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.109+0000 7fcde98768c0 1 > prepared multipart upload key=NVOFV649MT0A upload=AM0S7XJHYROQ tag=VHCHQYLABBN3 type=write size=1554030 2024-09-12T00:42:22.110 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.113+0000 7fcde98768c0 1 < completed write operation key=3X9I78PMR1HV tag=Q1YGF0CVWJS8 type=write size=196265 2024-09-12T00:42:22.115 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.117+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~C013BK1R1V47.0 size=670749 2024-09-12T00:42:22.115 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.117+0000 7fcde98768c0 1 > prepared multipart upload key=5B8C6E8L5N52 upload=C013BK1R1V47 tag=UIQEU4SJW4ER type=write size=1719325 2024-09-12T00:42:22.116 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.117+0000 7fcde98768c0 1 < canceled part key=_multipart_5YBVLUYJW40U.2~VG6GDS2GVE7I.0 size=108063 2024-09-12T00:42:22.121 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.125+0000 7fcde98768c0 1 < canceled multipart upload key=5YBVLUYJW40U upload=VG6GDS2GVE7I tag=KKZK5RIEEQ9J type=write size=1156639 2024-09-12T00:42:22.126 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.129+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~RCGKFZWASQN3.0 size=116745 2024-09-12T00:42:22.127 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.129+0000 7fcde98768c0 1 > prepared multipart upload key=NVOFV649MT0A upload=RCGKFZWASQN3 tag=LUK2OEA0UDJK type=write size=1165321 2024-09-12T00:42:22.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.133+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~PUIUSBOZPBKG.0 size=1048576 2024-09-12T00:42:22.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.137+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~PUIUSBOZPBKG.1 size=1048576 2024-09-12T00:42:22.135 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.137+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~PUIUSBOZPBKG.2 size=211703 2024-09-12T00:42:22.140 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.141+0000 7fcde98768c0 1 < completed multipart upload key=V80E1NH858IK upload=PUIUSBOZPBKG tag=44RCNUEM0RYS type=write size=3357431 2024-09-12T00:42:22.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.145+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=BOHDDLJ453OR type=del size=1280373 2024-09-12T00:42:22.147 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.149+0000 7fcde98768c0 1 < completed write operation key=JW2GNFAYFNEK tag=VAL8USTPJ5ZK type=write size=50099 2024-09-12T00:42:22.151 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.153+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=TIKPQIRIJ2VX type=del size=456713 2024-09-12T00:42:22.154 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.157+0000 7fcde98768c0 1 < completed delete operation key=R2EBH0Q5885L tag=Q7MRWPEYJCR8 type=del 2024-09-12T00:42:22.160 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.161+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~VU602JKIVPG9.0 size=1048576 2024-09-12T00:42:22.162 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.165+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~VU602JKIVPG9.1 size=1048576 2024-09-12T00:42:22.165 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.169+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~VU602JKIVPG9.2 size=450732 2024-09-12T00:42:22.165 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.169+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=VU602JKIVPG9 tag=Y3OQ5HR1YTKN type=write size=3596460 2024-09-12T00:42:22.171 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.173+0000 7fcde98768c0 1 < suggested remove operation key=FUJIUIR1E00J tag=VFJYO2TST0FX type=del 2024-09-12T00:42:22.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.177+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~3B0PQ42BDTSQ.0 size=1048576 2024-09-12T00:42:22.178 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.181+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~3B0PQ42BDTSQ.1 size=758424 2024-09-12T00:42:22.178 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.181+0000 7fcde98768c0 1 > prepared multipart upload key=F813QWV02TI0 upload=3B0PQ42BDTSQ tag=N295RQ5V4QQO type=write size=2855576 2024-09-12T00:42:22.185 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.189+0000 7fcde98768c0 1 < suggested remove operation key=RC9A2Y5TCP9C tag=8D5M8ZB8C6XL type=write 2024-09-12T00:42:22.188 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.189+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=J5AEXNRO8G6C type=del size=3960450 2024-09-12T00:42:22.190 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.193+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~NV19ROO2XV1T.0 size=1048576 2024-09-12T00:42:22.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.197+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~NV19ROO2XV1T.1 size=1048576 2024-09-12T00:42:22.195 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.197+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~NV19ROO2XV1T.2 size=317573 2024-09-12T00:42:22.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.205+0000 7fcde98768c0 1 < completed multipart upload key=EDFNLQYP4L4L upload=NV19ROO2XV1T tag=14BVCJ1ZGCDX type=write size=3463301 2024-09-12T00:42:22.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.205+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=OEH262Q5PVUG type=del size=1315590 2024-09-12T00:42:22.206 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.209+0000 7fcde98768c0 1 < completed delete operation key=KME8ZTTUGOXY tag=V9T3S1PEDTQL type=del 2024-09-12T00:42:22.209 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.213+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=WTMATN4X1JHQ type=del size=1143323 2024-09-12T00:42:22.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.213+0000 7fcde98768c0 1 < completed write operation key=JW2GNFAYFNEK tag=C6YL2F6YQCX5 type=write size=411090 2024-09-12T00:42:22.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.217+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=HWL8ALE35AEX type=del size=3221736 2024-09-12T00:42:22.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.221+0000 7fcde98768c0 1 < completed delete operation key=Z4RNDW37GEK6 tag=3JSYZ202NORT type=del 2024-09-12T00:42:22.222 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.225+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~MZLD5G32LFPJ.0 size=1048576 2024-09-12T00:42:22.224 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.229+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~MZLD5G32LFPJ.1 size=1048576 2024-09-12T00:42:22.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.229+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~MZLD5G32LFPJ.2 size=518663 2024-09-12T00:42:22.227 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.229+0000 7fcde98768c0 1 > prepared multipart upload key=368TXYQVK9C3 upload=MZLD5G32LFPJ tag=IC8BEDTC6X7W type=write size=3664391 2024-09-12T00:42:22.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.233+0000 7fcde98768c0 1 < completed delete operation key=IMITNCB1ST9E tag=FDBHOS070VD4 type=del 2024-09-12T00:42:22.232 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.233+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=7B2LZONINH6J type=del size=3512743 2024-09-12T00:42:22.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.237+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~LAJBIA3BMDG2.0 size=1048576 2024-09-12T00:42:22.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.241+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~LAJBIA3BMDG2.1 size=993187 2024-09-12T00:42:22.241 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.245+0000 7fcde98768c0 1 < completed multipart upload key=J9EUM073CZHF upload=LAJBIA3BMDG2 tag=ZS5HENBEXEGZ type=write size=3090339 2024-09-12T00:42:22.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.249+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~IZSVRQA7T1ZI.0 size=985720 2024-09-12T00:42:22.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.249+0000 7fcde98768c0 1 > prepared multipart upload key=NVOFV649MT0A upload=IZSVRQA7T1ZI tag=9GSKACVSQA70 type=write size=2034296 2024-09-12T00:42:22.249 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.253+0000 7fcde98768c0 1 < completed delete operation key=3QOENE572J7A tag=OOIWQZIPAKDB type=del 2024-09-12T00:42:22.252 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.253+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=AKPC9HQX2FR0 type=del size=840428 2024-09-12T00:42:22.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.257+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~U89WR4JRVMFN.0 size=1048576 2024-09-12T00:42:22.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.257+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~U89WR4JRVMFN.1 size=989898 2024-09-12T00:42:22.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.265+0000 7fcde98768c0 1 < completed multipart upload key=JW2GNFAYFNEK upload=U89WR4JRVMFN tag=YQAMUY4PC9EH type=write size=3087050 2024-09-12T00:42:22.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.265+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=8RWVJY5AZNP8 type=del size=1813681 2024-09-12T00:42:22.266 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.269+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~AM0S7XJHYROQ.0 size=505454 2024-09-12T00:42:22.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.273+0000 7fcde98768c0 1 < completed multipart upload key=NVOFV649MT0A upload=AM0S7XJHYROQ tag=VHCHQYLABBN3 type=write size=1554030 2024-09-12T00:42:22.273 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.277+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=RTZPTXB7OF3R type=del size=1807939 2024-09-12T00:42:22.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.277+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~C013BK1R1V47.0 size=670749 2024-09-12T00:42:22.280 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.281+0000 7fcde98768c0 1 < completed multipart upload key=5B8C6E8L5N52 upload=C013BK1R1V47 tag=UIQEU4SJW4ER type=write size=1719325 2024-09-12T00:42:22.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.285+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=P1ZSI7ADLS1Z type=del size=452213 2024-09-12T00:42:22.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.289+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~RCGKFZWASQN3.0 size=116745 2024-09-12T00:42:22.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.297+0000 7fcde98768c0 1 < completed multipart upload key=NVOFV649MT0A upload=RCGKFZWASQN3 tag=LUK2OEA0UDJK type=write size=1165321 2024-09-12T00:42:22.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.301+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~U926JKOWD8A7.0 size=1048576 2024-09-12T00:42:22.301 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.305+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~U926JKOWD8A7.1 size=991023 2024-09-12T00:42:22.301 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.305+0000 7fcde98768c0 1 > prepared multipart upload key=3X9I78PMR1HV upload=U926JKOWD8A7 tag=FE839G7IMJ3K type=write size=3088175 2024-09-12T00:42:22.303 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.305+0000 7fcde98768c0 1 < completed delete operation key=368TXYQVK9C3 tag=BOHDDLJ453OR type=del 2024-09-12T00:42:22.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.309+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=H6ZKDDU59Z6M type=del size=3600596 2024-09-12T00:42:22.308 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.309+0000 7fcde98768c0 1 < completed delete operation key=IMITNCB1ST9E tag=TIKPQIRIJ2VX type=del 2024-09-12T00:42:22.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.313+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=PVCEJJDE5G2F type=del size=1977176 2024-09-12T00:42:22.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.317+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~VU602JKIVPG9.0 size=1048576 2024-09-12T00:42:22.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.317+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~VU602JKIVPG9.1 size=1048576 2024-09-12T00:42:22.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.321+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~VU602JKIVPG9.2 size=450732 2024-09-12T00:42:22.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.325+0000 7fcde98768c0 1 < completed multipart upload key=V80E1NH858IK upload=VU602JKIVPG9 tag=Y3OQ5HR1YTKN type=write size=3596460 2024-09-12T00:42:22.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.325+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=D61HX06EEMD6 type=del size=3861764 2024-09-12T00:42:22.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.329+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~3B0PQ42BDTSQ.0 size=1048576 2024-09-12T00:42:22.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.333+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~3B0PQ42BDTSQ.1 size=758424 2024-09-12T00:42:22.336 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.337+0000 7fcde98768c0 1 < completed multipart upload key=F813QWV02TI0 upload=3B0PQ42BDTSQ tag=N295RQ5V4QQO type=write size=2855576 2024-09-12T00:42:22.337 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.337+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=C5Y2LSHB59O8 type=del size=1819983 2024-09-12T00:42:22.338 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.341+0000 7fcde98768c0 1 < completed delete operation key=NVOFV649MT0A tag=J5AEXNRO8G6C type=del 2024-09-12T00:42:22.343 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.345+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~LVX34UBET623.0 size=337368 2024-09-12T00:42:22.343 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.345+0000 7fcde98768c0 1 > prepared multipart upload key=5B8C6E8L5N52 upload=LVX34UBET623 tag=OMK1RZ4YW37D type=write size=1385944 2024-09-12T00:42:22.345 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.349+0000 7fcde98768c0 1 < completed delete operation key=IV4JCE1QJC70 tag=OEH262Q5PVUG type=del 2024-09-12T00:42:22.350 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.353+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~TP062S5I2NRK.0 size=373164 2024-09-12T00:42:22.350 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.353+0000 7fcde98768c0 1 > prepared multipart upload key=2T5IU2IUNGJX upload=TP062S5I2NRK tag=G2BKGYG52OAQ type=write size=1421740 2024-09-12T00:42:22.352 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.357+0000 7fcde98768c0 1 < completed delete operation key=Z4RNDW37GEK6 tag=WTMATN4X1JHQ type=del 2024-09-12T00:42:22.355 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.357+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=86S83TAWH32Z type=del size=290209 2024-09-12T00:42:22.357 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.361+0000 7fcde98768c0 1 < completed delete operation key=G6R8BX1H7SPM tag=HWL8ALE35AEX type=del 2024-09-12T00:42:22.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.361+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=PDPJ00NO13AV type=del size=1407306 2024-09-12T00:42:22.363 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.365+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~MZLD5G32LFPJ.0 size=1048576 2024-09-12T00:42:22.365 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.369+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~MZLD5G32LFPJ.1 size=1048576 2024-09-12T00:42:22.367 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.369+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~MZLD5G32LFPJ.2 size=518663 2024-09-12T00:42:22.371 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.373+0000 7fcde98768c0 1 < completed multipart upload key=368TXYQVK9C3 upload=MZLD5G32LFPJ tag=IC8BEDTC6X7W type=write size=3664391 2024-09-12T00:42:22.374 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.377+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=MN3838KT7MRK type=del size=4004243 2024-09-12T00:42:22.376 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.381+0000 7fcde98768c0 1 < canceled operation key=BZ4YUNTMOJBK tag=7B2LZONINH6J type=del size=3512743 2024-09-12T00:42:22.379 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.381+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=3G5FR9LF9MK9 type=del size=2375724 2024-09-12T00:42:22.381 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.385+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~IZSVRQA7T1ZI.0 size=985720 2024-09-12T00:42:22.385 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.389+0000 7fcde98768c0 1 < completed multipart upload key=NVOFV649MT0A upload=IZSVRQA7T1ZI tag=9GSKACVSQA70 type=write size=2034296 2024-09-12T00:42:22.388 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.389+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=K51Q6ECE0JHX type=del size=856720 2024-09-12T00:42:22.393 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.397+0000 7fcde98768c0 1 < suggested remove operation key=WLE5QLNPAGZA tag=AKPC9HQX2FR0 type=del 2024-09-12T00:42:22.397 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.401+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~HPVRGF8UNNG5.0 size=1048576 2024-09-12T00:42:22.399 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.401+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~HPVRGF8UNNG5.1 size=1048576 2024-09-12T00:42:22.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.405+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~HPVRGF8UNNG5.2 size=109579 2024-09-12T00:42:22.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.405+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=HPVRGF8UNNG5 tag=MQ0WX8NU2C1I type=write size=3255307 2024-09-12T00:42:22.404 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.405+0000 7fcde98768c0 1 < completed delete operation key=368TXYQVK9C3 tag=8RWVJY5AZNP8 type=del 2024-09-12T00:42:22.406 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.409+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=8DY0IHC1H3PY type=del size=1784298 2024-09-12T00:42:22.409 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.413+0000 7fcde98768c0 1 < completed delete operation key=R2EBH0Q5885L tag=RTZPTXB7OF3R type=del 2024-09-12T00:42:22.412 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.413+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=MRM3Q65ZIT4Z type=del size=919717 2024-09-12T00:42:22.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.421+0000 7fcde98768c0 1 < suggested update operation key=IV4JCE1QJC70 tag=P1ZSI7ADLS1Z type=del size=452213 2024-09-12T00:42:22.422 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.425+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~Z8VFTKS298DN.0 size=652256 2024-09-12T00:42:22.422 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.425+0000 7fcde98768c0 1 > prepared multipart upload key=368TXYQVK9C3 upload=Z8VFTKS298DN tag=M00AP6WFSR8V type=write size=1700832 2024-09-12T00:42:22.422 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.425+0000 7fcde98768c0 1 < canceled part key=_multipart_3X9I78PMR1HV.2~U926JKOWD8A7.0 size=1048576 2024-09-12T00:42:22.424 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.425+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~U926JKOWD8A7.1 size=991023 2024-09-12T00:42:22.428 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.433+0000 7fcde98768c0 1 < canceled multipart upload key=3X9I78PMR1HV upload=U926JKOWD8A7 tag=FE839G7IMJ3K type=write size=3088175 2024-09-12T00:42:22.431 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.433+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=D45WPAGVVD4M type=write size=677469 2024-09-12T00:42:22.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.437+0000 7fcde98768c0 1 < completed delete operation key=F813QWV02TI0 tag=H6ZKDDU59Z6M type=del 2024-09-12T00:42:22.437 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.441+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=S36KQPZTYQK7 type=del size=1263045 2024-09-12T00:42:22.442 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.445+0000 7fcde98768c0 1 < suggested remove operation key=Z4RNDW37GEK6 tag=PVCEJJDE5G2F type=del 2024-09-12T00:42:22.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.449+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~NMM34ICNN8P8.0 size=1048576 2024-09-12T00:42:22.449 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.453+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~NMM34ICNN8P8.1 size=1048576 2024-09-12T00:42:22.451 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.453+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~NMM34ICNN8P8.2 size=786675 2024-09-12T00:42:22.451 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.453+0000 7fcde98768c0 1 > prepared multipart upload key=JW2GNFAYFNEK upload=NMM34ICNN8P8 tag=IZA813KWO3PM type=write size=3932403 2024-09-12T00:42:22.454 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.457+0000 7fcde98768c0 1 < completed delete operation key=IMITNCB1ST9E tag=D61HX06EEMD6 type=del 2024-09-12T00:42:22.457 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.461+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=MA1J8CZZ52J5 type=del size=615117 2024-09-12T00:42:22.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.461+0000 7fcde98768c0 1 < canceled operation key=C6PW0ETP4BG2 tag=C5Y2LSHB59O8 type=del size=1819983 2024-09-12T00:42:22.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.469+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~1I3SH725U0DR.0 size=1048576 2024-09-12T00:42:22.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.469+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~1I3SH725U0DR.1 size=88537 2024-09-12T00:42:22.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.469+0000 7fcde98768c0 1 > prepared multipart upload key=FUJIUIR1E00J upload=1I3SH725U0DR tag=27I3RI3KPVDO type=write size=2185689 2024-09-12T00:42:22.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.473+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~LVX34UBET623.0 size=337368 2024-09-12T00:42:22.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.477+0000 7fcde98768c0 1 < completed multipart upload key=5B8C6E8L5N52 upload=LVX34UBET623 tag=OMK1RZ4YW37D type=write size=1385944 2024-09-12T00:42:22.477 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.481+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=5ZUJ1KG4BF1C type=write size=403718 2024-09-12T00:42:22.480 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.481+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~TP062S5I2NRK.0 size=373164 2024-09-12T00:42:22.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.489+0000 7fcde98768c0 1 < completed multipart upload key=2T5IU2IUNGJX upload=TP062S5I2NRK tag=G2BKGYG52OAQ type=write size=1421740 2024-09-12T00:42:22.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.489+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=S2KBO820WRIE type=write size=837135 2024-09-12T00:42:22.490 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.493+0000 7fcde98768c0 1 < completed delete operation key=ZQD0QXDN1J1I tag=86S83TAWH32Z type=del 2024-09-12T00:42:22.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.497+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~V5MQBMN43EWC.0 size=1048576 2024-09-12T00:42:22.498 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.501+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~V5MQBMN43EWC.1 size=581554 2024-09-12T00:42:22.498 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.501+0000 7fcde98768c0 1 > prepared multipart upload key=3X9I78PMR1HV upload=V5MQBMN43EWC tag=AXNDNC2B474H type=write size=2678706 2024-09-12T00:42:22.500 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.505+0000 7fcde98768c0 -1 < failed to complete operation key=Z4RNDW37GEK6 tag=PDPJ00NO13AV type=del size=1407306: (22) Invalid argument 2024-09-12T00:42:22.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.509+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~VJ6UK95XGVFE.0 size=542078 2024-09-12T00:42:22.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.509+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=VJ6UK95XGVFE tag=5JAAMQNK2ZPP type=write size=1590654 2024-09-12T00:42:22.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.509+0000 7fcde98768c0 1 < completed delete operation key=4487IMSOLPDV tag=MN3838KT7MRK type=del 2024-09-12T00:42:22.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.513+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=8RJ6BWAR4LSO type=write size=458316 2024-09-12T00:42:22.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.517+0000 7fcde98768c0 1 < completed delete operation key=7UR0FX8HA2A5 tag=3G5FR9LF9MK9 type=del 2024-09-12T00:42:22.520 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.521+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~CV6KLOZMLP8M.0 size=1048576 2024-09-12T00:42:22.522 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.525+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~CV6KLOZMLP8M.1 size=935377 2024-09-12T00:42:22.522 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.525+0000 7fcde98768c0 1 > prepared multipart upload key=RC9A2Y5TCP9C upload=CV6KLOZMLP8M tag=J90J2V8YTWRV type=write size=3032529 2024-09-12T00:42:22.525 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.529+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=K51Q6ECE0JHX type=del 2024-09-12T00:42:22.530 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.533+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~X83V6XVFB28M.0 size=1048576 2024-09-12T00:42:22.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.533+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~X83V6XVFB28M.1 size=1048576 2024-09-12T00:42:22.533 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.537+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~X83V6XVFB28M.2 size=877071 2024-09-12T00:42:22.534 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.537+0000 7fcde98768c0 1 > prepared multipart upload key=C6PW0ETP4BG2 upload=X83V6XVFB28M tag=H7ZC2K2S2OUK type=write size=4022799 2024-09-12T00:42:22.539 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.541+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~HPVRGF8UNNG5.0 size=1048576 2024-09-12T00:42:22.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.545+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~HPVRGF8UNNG5.1 size=1048576 2024-09-12T00:42:22.543 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.545+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~HPVRGF8UNNG5.2 size=109579 2024-09-12T00:42:22.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.549+0000 7fcde98768c0 1 < completed multipart upload key=BZ4YUNTMOJBK upload=HPVRGF8UNNG5 tag=MQ0WX8NU2C1I type=write size=3255307 2024-09-12T00:42:22.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.553+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=T5YYT1UKMCFZ type=write size=847758 2024-09-12T00:42:22.552 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.557+0000 7fcde98768c0 1 < completed delete operation key=RC9A2Y5TCP9C tag=8DY0IHC1H3PY type=del 2024-09-12T00:42:22.557 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.561+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~JI602RW6ADM0.0 size=1048576 2024-09-12T00:42:22.559 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.561+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~JI602RW6ADM0.1 size=1048576 2024-09-12T00:42:22.561 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.565+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~JI602RW6ADM0.2 size=893945 2024-09-12T00:42:22.561 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.565+0000 7fcde98768c0 1 > prepared multipart upload key=7UR0FX8HA2A5 upload=JI602RW6ADM0 tag=6IDV5G15Y414 type=write size=4039673 2024-09-12T00:42:22.564 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.565+0000 7fcde98768c0 1 < completed delete operation key=4487IMSOLPDV tag=MRM3Q65ZIT4Z type=del 2024-09-12T00:42:22.566 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.569+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=3ZBU4P8R2R2I type=del size=572765 2024-09-12T00:42:22.569 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.573+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~Z8VFTKS298DN.0 size=652256 2024-09-12T00:42:22.573 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.577+0000 7fcde98768c0 1 < completed multipart upload key=368TXYQVK9C3 upload=Z8VFTKS298DN tag=M00AP6WFSR8V type=write size=1700832 2024-09-12T00:42:22.575 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.577+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=CLQLY288L5CU type=del size=3555308 2024-09-12T00:42:22.578 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.581+0000 7fcde98768c0 1 < completed write operation key=G6R8BX1H7SPM tag=D45WPAGVVD4M type=write size=677469 2024-09-12T00:42:22.580 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.581+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=WD5IGSNXDMBJ type=del size=679625 2024-09-12T00:42:22.583 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.585+0000 7fcde98768c0 1 < canceled operation key=4487IMSOLPDV tag=S36KQPZTYQK7 type=del size=1263045 2024-09-12T00:42:22.587 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.589+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~GW7CLN0CFSB1.0 size=1048576 2024-09-12T00:42:22.589 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.593+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~GW7CLN0CFSB1.1 size=1048576 2024-09-12T00:42:22.592 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.593+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~GW7CLN0CFSB1.2 size=678229 2024-09-12T00:42:22.592 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.593+0000 7fcde98768c0 1 > prepared multipart upload key=FUJIUIR1E00J upload=GW7CLN0CFSB1 tag=2PJ5MCX0ZE7L type=write size=3823957 2024-09-12T00:42:22.592 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.597+0000 7fcde98768c0 1 < canceled part key=_multipart_JW2GNFAYFNEK.2~NMM34ICNN8P8.0 size=1048576 2024-09-12T00:42:22.594 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.597+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~NMM34ICNN8P8.1 size=1048576 2024-09-12T00:42:22.597 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.601+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~NMM34ICNN8P8.2 size=786675 2024-09-12T00:42:22.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.605+0000 7fcde98768c0 1 < canceled multipart upload key=JW2GNFAYFNEK upload=NMM34ICNN8P8 tag=IZA813KWO3PM type=write size=3932403 2024-09-12T00:42:22.604 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.609+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=EZATEZKE029H type=del size=71424 2024-09-12T00:42:22.607 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.609+0000 7fcde98768c0 1 < completed delete operation key=5B8C6E8L5N52 tag=MA1J8CZZ52J5 type=del 2024-09-12T00:42:22.610 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.613+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=1M4IZSHMD382 type=del size=2945177 2024-09-12T00:42:22.613 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.617+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~1I3SH725U0DR.0 size=1048576 2024-09-12T00:42:22.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.617+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~1I3SH725U0DR.1 size=88537 2024-09-12T00:42:22.619 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.621+0000 7fcde98768c0 1 < completed multipart upload key=FUJIUIR1E00J upload=1I3SH725U0DR tag=27I3RI3KPVDO type=write size=2185689 2024-09-12T00:42:22.624 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.629+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~HOXTC7MJPHGK.0 size=1048576 2024-09-12T00:42:22.627 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.629+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~HOXTC7MJPHGK.1 size=761693 2024-09-12T00:42:22.627 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.629+0000 7fcde98768c0 1 > prepared multipart upload key=NVOFV649MT0A upload=HOXTC7MJPHGK tag=YE8CHV2FCJ5Z type=write size=2858845 2024-09-12T00:42:22.629 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.633+0000 7fcde98768c0 1 < completed write operation key=EDFNLQYP4L4L tag=5ZUJ1KG4BF1C type=write size=403718 2024-09-12T00:42:22.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.633+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=WPWLP1V1X6BE type=del size=487902 2024-09-12T00:42:22.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.641+0000 7fcde98768c0 1 < suggested remove operation key=7UR0FX8HA2A5 tag=S2KBO820WRIE type=write 2024-09-12T00:42:22.642 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.645+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~804JX952UM6O.0 size=1048576 2024-09-12T00:42:22.644 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.649+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~804JX952UM6O.1 size=188464 2024-09-12T00:42:22.645 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.649+0000 7fcde98768c0 1 > prepared multipart upload key=ZQD0QXDN1J1I upload=804JX952UM6O tag=40NXB2EAG6U5 type=write size=2285616 2024-09-12T00:42:22.647 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.649+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~V5MQBMN43EWC.0 size=1048576 2024-09-12T00:42:22.649 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.653+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~V5MQBMN43EWC.1 size=581554 2024-09-12T00:42:22.654 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.657+0000 7fcde98768c0 1 < completed multipart upload key=3X9I78PMR1HV upload=V5MQBMN43EWC tag=AXNDNC2B474H type=write size=2678706 2024-09-12T00:42:22.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.661+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=TR50ATG50V89 type=del size=1901318 2024-09-12T00:42:22.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.661+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~VJ6UK95XGVFE.0 size=542078 2024-09-12T00:42:22.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.665+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=VJ6UK95XGVFE tag=5JAAMQNK2ZPP type=write size=1590654 2024-09-12T00:42:22.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.673+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~P3UVG1MDEXO7.0 size=1048576 2024-09-12T00:42:22.671 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.673+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~P3UVG1MDEXO7.1 size=1048576 2024-09-12T00:42:22.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.677+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~P3UVG1MDEXO7.2 size=837665 2024-09-12T00:42:22.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.677+0000 7fcde98768c0 1 > prepared multipart upload key=J9EUM073CZHF upload=P3UVG1MDEXO7 tag=04EGDTC8FM7X type=write size=3983393 2024-09-12T00:42:22.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.681+0000 7fcde98768c0 1 < completed write operation key=F813QWV02TI0 tag=8RJ6BWAR4LSO type=write size=458316 2024-09-12T00:42:22.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.685+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~PG4J46BRBT6Q.0 size=1048576 2024-09-12T00:42:22.684 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.685+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~PG4J46BRBT6Q.1 size=866688 2024-09-12T00:42:22.684 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.685+0000 7fcde98768c0 1 > prepared multipart upload key=7UR0FX8HA2A5 upload=PG4J46BRBT6Q tag=CGEUY69NWWV9 type=write size=2963840 2024-09-12T00:42:22.687 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.689+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~CV6KLOZMLP8M.0 size=1048576 2024-09-12T00:42:22.687 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.689+0000 7fcde98768c0 1 < canceled part key=_multipart_RC9A2Y5TCP9C.2~CV6KLOZMLP8M.1 size=935377 2024-09-12T00:42:22.691 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.693+0000 7fcde98768c0 1 < canceled multipart upload key=RC9A2Y5TCP9C upload=CV6KLOZMLP8M tag=J90J2V8YTWRV type=write size=3032529 2024-09-12T00:42:22.694 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.697+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=UVWH9SB8S2V7 type=write size=767847 2024-09-12T00:42:22.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.701+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~X83V6XVFB28M.0 size=1048576 2024-09-12T00:42:22.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.701+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~X83V6XVFB28M.1 size=1048576 2024-09-12T00:42:22.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.705+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~X83V6XVFB28M.2 size=877071 2024-09-12T00:42:22.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.709+0000 7fcde98768c0 1 < completed multipart upload key=C6PW0ETP4BG2 upload=X83V6XVFB28M tag=H7ZC2K2S2OUK type=write size=4022799 2024-09-12T00:42:22.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.709+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=NH3RRAU6PQDM type=del size=3212524 2024-09-12T00:42:22.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.713+0000 7fcde98768c0 1 < completed write operation key=G6R8BX1H7SPM tag=T5YYT1UKMCFZ type=write size=847758 2024-09-12T00:42:22.713 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.717+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=1YBO713ECX1V type=del size=4138492 2024-09-12T00:42:22.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.717+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~JI602RW6ADM0.0 size=1048576 2024-09-12T00:42:22.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.721+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~JI602RW6ADM0.1 size=1048576 2024-09-12T00:42:22.719 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.721+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~JI602RW6ADM0.2 size=893945 2024-09-12T00:42:22.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.725+0000 7fcde98768c0 1 < completed multipart upload key=7UR0FX8HA2A5 upload=JI602RW6ADM0 tag=6IDV5G15Y414 type=write size=4039673 2024-09-12T00:42:22.725 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.729+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=FL7M8JX335CY type=del size=3385303 2024-09-12T00:42:22.728 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.729+0000 7fcde98768c0 1 < completed delete operation key=5B8C6E8L5N52 tag=3ZBU4P8R2R2I type=del 2024-09-12T00:42:22.730 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.733+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=HUDM7U3PDTZB type=del size=3082658 2024-09-12T00:42:22.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.737+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=CLQLY288L5CU type=del 2024-09-12T00:42:22.737 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.741+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~I8T4B56KZ6N8.0 size=1038220 2024-09-12T00:42:22.737 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.741+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=I8T4B56KZ6N8 tag=W8QIOZ359N91 type=write size=2086796 2024-09-12T00:42:22.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.741+0000 7fcde98768c0 1 < completed delete operation key=R2EBH0Q5885L tag=WD5IGSNXDMBJ type=del 2024-09-12T00:42:22.744 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.745+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~DD7GHA9JD5N8.0 size=1048576 2024-09-12T00:42:22.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.749+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~DD7GHA9JD5N8.1 size=1048576 2024-09-12T00:42:22.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.749+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~DD7GHA9JD5N8.2 size=479886 2024-09-12T00:42:22.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.749+0000 7fcde98768c0 1 > prepared multipart upload key=97030NBF3MI4 upload=DD7GHA9JD5N8 tag=J1PNGTFY0455 type=write size=3625614 2024-09-12T00:42:22.750 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.753+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~GW7CLN0CFSB1.0 size=1048576 2024-09-12T00:42:22.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.753+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~GW7CLN0CFSB1.1 size=1048576 2024-09-12T00:42:22.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.757+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~GW7CLN0CFSB1.2 size=678229 2024-09-12T00:42:22.758 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.761+0000 7fcde98768c0 1 < completed multipart upload key=FUJIUIR1E00J upload=GW7CLN0CFSB1 tag=2PJ5MCX0ZE7L type=write size=3823957 2024-09-12T00:42:22.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.765+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~32MQBHNQS4CJ.0 size=1048576 2024-09-12T00:42:22.765 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.769+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~32MQBHNQS4CJ.1 size=1048576 2024-09-12T00:42:22.767 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.769+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~32MQBHNQS4CJ.2 size=131296 2024-09-12T00:42:22.767 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.769+0000 7fcde98768c0 1 > prepared multipart upload key=NVOFV649MT0A upload=32MQBHNQS4CJ tag=WXRB5VA1SJ1T type=write size=3277024 2024-09-12T00:42:22.770 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.773+0000 7fcde98768c0 1 < completed delete operation key=3X9I78PMR1HV tag=EZATEZKE029H type=del 2024-09-12T00:42:22.773 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.777+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=WDHQTB9GV2FP type=del size=542461 2024-09-12T00:42:22.779 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.781+0000 7fcde98768c0 1 < completed delete operation key=3QOENE572J7A tag=1M4IZSHMD382 type=del 2024-09-12T00:42:22.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.789+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~IZKIY3IEIYM6.0 size=1048576 2024-09-12T00:42:22.787 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.789+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~IZKIY3IEIYM6.1 size=381382 2024-09-12T00:42:22.787 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.789+0000 7fcde98768c0 1 > prepared multipart upload key=5YBVLUYJW40U upload=IZKIY3IEIYM6 tag=Z7SYUXKVOH2T type=write size=2478534 2024-09-12T00:42:22.790 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.793+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~HOXTC7MJPHGK.0 size=1048576 2024-09-12T00:42:22.792 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.793+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~HOXTC7MJPHGK.1 size=761693 2024-09-12T00:42:22.796 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.797+0000 7fcde98768c0 1 < completed multipart upload key=NVOFV649MT0A upload=HOXTC7MJPHGK tag=YE8CHV2FCJ5Z type=write size=2858845 2024-09-12T00:42:22.799 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.801+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=F81DX823IOXX type=del size=2670707 2024-09-12T00:42:22.801 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.805+0000 7fcde98768c0 1 < completed delete operation key=EDFNLQYP4L4L tag=WPWLP1V1X6BE type=del 2024-09-12T00:42:22.806 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.809+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~EGHM8CN9TJ7Y.0 size=1048576 2024-09-12T00:42:22.808 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.813+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~EGHM8CN9TJ7Y.1 size=1048576 2024-09-12T00:42:22.811 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.813+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~EGHM8CN9TJ7Y.2 size=337353 2024-09-12T00:42:22.811 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.813+0000 7fcde98768c0 1 > prepared multipart upload key=C6PW0ETP4BG2 upload=EGHM8CN9TJ7Y tag=IXYK8PYH0I7R type=write size=3483081 2024-09-12T00:42:22.813 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.817+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~804JX952UM6O.0 size=1048576 2024-09-12T00:42:22.814 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.817+0000 7fcde98768c0 1 < canceled part key=_multipart_ZQD0QXDN1J1I.2~804JX952UM6O.1 size=188464 2024-09-12T00:42:22.818 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.821+0000 7fcde98768c0 1 < canceled multipart upload key=ZQD0QXDN1J1I upload=804JX952UM6O tag=40NXB2EAG6U5 type=write size=2285616 2024-09-12T00:42:22.823 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.825+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~SFVH1YDG72W3.0 size=866601 2024-09-12T00:42:22.823 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.825+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=SFVH1YDG72W3 tag=8KGIEV7IB1YD type=write size=1915177 2024-09-12T00:42:22.826 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.829+0000 7fcde98768c0 1 < completed delete operation key=TUMAMUZUIR7E tag=TR50ATG50V89 type=del 2024-09-12T00:42:22.831 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.833+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~KATJJR6SVMDI.0 size=1048576 2024-09-12T00:42:22.833 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.837+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~KATJJR6SVMDI.1 size=593819 2024-09-12T00:42:22.833 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.837+0000 7fcde98768c0 1 > prepared multipart upload key=F813QWV02TI0 upload=KATJJR6SVMDI tag=RQVL7DF7K7SZ type=write size=2690971 2024-09-12T00:42:22.836 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.837+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~P3UVG1MDEXO7.0 size=1048576 2024-09-12T00:42:22.838 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.841+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~P3UVG1MDEXO7.1 size=1048576 2024-09-12T00:42:22.840 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.841+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~P3UVG1MDEXO7.2 size=837665 2024-09-12T00:42:22.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.849+0000 7fcde98768c0 1 < completed multipart upload key=J9EUM073CZHF upload=P3UVG1MDEXO7 tag=04EGDTC8FM7X type=write size=3983393 2024-09-12T00:42:22.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.849+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=NY1A9TTKLDRW type=del size=3066999 2024-09-12T00:42:22.851 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.853+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~PG4J46BRBT6Q.0 size=1048576 2024-09-12T00:42:22.853 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.857+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~PG4J46BRBT6Q.1 size=866688 2024-09-12T00:42:22.858 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.861+0000 7fcde98768c0 1 < completed multipart upload key=7UR0FX8HA2A5 upload=PG4J46BRBT6Q tag=CGEUY69NWWV9 type=write size=2963840 2024-09-12T00:42:22.860 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.865+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=8KPM3NJ2IAPR type=del size=33554 2024-09-12T00:42:22.866 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.869+0000 7fcde98768c0 1 < suggested update operation key=3QOENE572J7A tag=UVWH9SB8S2V7 type=write size=767847 2024-09-12T00:42:22.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.873+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~HZ93CX40TWU8.0 size=1048576 2024-09-12T00:42:22.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.877+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~HZ93CX40TWU8.1 size=1048576 2024-09-12T00:42:22.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.877+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~HZ93CX40TWU8.2 size=183543 2024-09-12T00:42:22.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.877+0000 7fcde98768c0 1 > prepared multipart upload key=2T5IU2IUNGJX upload=HZ93CX40TWU8 tag=EWD0H74T19VZ type=write size=3329271 2024-09-12T00:42:22.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.881+0000 7fcde98768c0 1 < completed delete operation key=EDFNLQYP4L4L tag=NH3RRAU6PQDM type=del 2024-09-12T00:42:22.883 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.885+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~BVLCQPULHY0Z.0 size=1048576 2024-09-12T00:42:22.886 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.889+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~BVLCQPULHY0Z.1 size=1048576 2024-09-12T00:42:22.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.889+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~BVLCQPULHY0Z.2 size=319501 2024-09-12T00:42:22.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.889+0000 7fcde98768c0 1 > prepared multipart upload key=BQGIXJJWBAN0 upload=BVLCQPULHY0Z tag=AWAS6ZO7SZ2G type=write size=3465229 2024-09-12T00:42:22.891 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.893+0000 7fcde98768c0 1 < completed delete operation key=7UR0FX8HA2A5 tag=1YBO713ECX1V type=del 2024-09-12T00:42:22.894 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.897+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=RUF58OTTUDX2 type=del size=3261522 2024-09-12T00:42:22.898 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.901+0000 7fcde98768c0 1 < completed delete operation key=HVE3YQTFZWTV tag=FL7M8JX335CY type=del 2024-09-12T00:42:22.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.905+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=O6LZ0TXIK21T type=del size=1211381 2024-09-12T00:42:22.904 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.909+0000 7fcde98768c0 1 < completed delete operation key=NVOFV649MT0A tag=HUDM7U3PDTZB type=del 2024-09-12T00:42:22.908 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.909+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=0IT0Z8B7OI1O type=del size=3101990 2024-09-12T00:42:22.911 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.913+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~I8T4B56KZ6N8.0 size=1038220 2024-09-12T00:42:22.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.921+0000 7fcde98768c0 1 < completed multipart upload key=QD5JXFL962R5 upload=I8T4B56KZ6N8 tag=W8QIOZ359N91 type=write size=2086796 2024-09-12T00:42:22.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.921+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=2SYTL44S470J type=del size=1822244 2024-09-12T00:42:22.924 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.925+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~DD7GHA9JD5N8.0 size=1048576 2024-09-12T00:42:22.926 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.929+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~DD7GHA9JD5N8.1 size=1048576 2024-09-12T00:42:22.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.933+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~DD7GHA9JD5N8.2 size=479886 2024-09-12T00:42:22.934 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.937+0000 7fcde98768c0 1 < completed multipart upload key=97030NBF3MI4 upload=DD7GHA9JD5N8 tag=J1PNGTFY0455 type=write size=3625614 2024-09-12T00:42:22.938 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.941+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=WYS6SB166UMW type=del size=3707887 2024-09-12T00:42:22.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.945+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~32MQBHNQS4CJ.0 size=1048576 2024-09-12T00:42:22.944 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.945+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~32MQBHNQS4CJ.1 size=1048576 2024-09-12T00:42:22.946 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.949+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~32MQBHNQS4CJ.2 size=131296 2024-09-12T00:42:22.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.953+0000 7fcde98768c0 1 < completed multipart upload key=NVOFV649MT0A upload=32MQBHNQS4CJ tag=WXRB5VA1SJ1T type=write size=3277024 2024-09-12T00:42:22.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.957+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=CDACNUN1TFS1 type=del size=4070926 2024-09-12T00:42:22.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.961+0000 7fcde98768c0 1 < completed delete operation key=G6R8BX1H7SPM tag=WDHQTB9GV2FP type=del 2024-09-12T00:42:22.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.965+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~HB99A5CX8CZS.0 size=1048576 2024-09-12T00:42:22.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.969+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~HB99A5CX8CZS.1 size=1048576 2024-09-12T00:42:22.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.973+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~HB99A5CX8CZS.2 size=7182 2024-09-12T00:42:22.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.973+0000 7fcde98768c0 1 > prepared multipart upload key=3X9I78PMR1HV upload=HB99A5CX8CZS tag=IWFAW2TDIHMI type=write size=3152910 2024-09-12T00:42:22.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.977+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~IZKIY3IEIYM6.0 size=1048576 2024-09-12T00:42:22.976 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.977+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~IZKIY3IEIYM6.1 size=381382 2024-09-12T00:42:22.981 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.985+0000 7fcde98768c0 1 < completed multipart upload key=5YBVLUYJW40U upload=IZKIY3IEIYM6 tag=Z7SYUXKVOH2T type=write size=2478534 2024-09-12T00:42:22.985 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.989+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=PFB34SXX560C type=write size=877078 2024-09-12T00:42:22.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.989+0000 7fcde98768c0 1 < completed delete operation key=368TXYQVK9C3 tag=F81DX823IOXX type=del 2024-09-12T00:42:22.992 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.993+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=YN3FEKAKDNE5 type=write size=24254 2024-09-12T00:42:22.996 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:22.997+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~EGHM8CN9TJ7Y.0 size=1048576 2024-09-12T00:42:22.999 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.001+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~EGHM8CN9TJ7Y.1 size=1048576 2024-09-12T00:42:23.002 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.005+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~EGHM8CN9TJ7Y.2 size=337353 2024-09-12T00:42:23.008 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.009+0000 7fcde98768c0 1 < completed multipart upload key=C6PW0ETP4BG2 upload=EGHM8CN9TJ7Y tag=IXYK8PYH0I7R type=write size=3483081 2024-09-12T00:42:23.011 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.013+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=5JY72AQ4782G type=del size=2240036 2024-09-12T00:42:23.016 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.017+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~SFVH1YDG72W3.0 size=866601 2024-09-12T00:42:23.022 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.025+0000 7fcde98768c0 1 < completed multipart upload key=QD5JXFL962R5 upload=SFVH1YDG72W3 tag=8KGIEV7IB1YD type=write size=1915177 2024-09-12T00:42:23.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.029+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~W4D8FES25P01.0 size=759019 2024-09-12T00:42:23.028 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.029+0000 7fcde98768c0 1 > prepared multipart upload key=5B8C6E8L5N52 upload=W4D8FES25P01 tag=Q5Y27CXHEDJ2 type=write size=1807595 2024-09-12T00:42:23.028 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.029+0000 7fcde98768c0 1 < canceled part key=_multipart_F813QWV02TI0.2~KATJJR6SVMDI.0 size=1048576 2024-09-12T00:42:23.030 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.033+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~KATJJR6SVMDI.1 size=593819 2024-09-12T00:42:23.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.037+0000 7fcde98768c0 1 < canceled multipart upload key=F813QWV02TI0 upload=KATJJR6SVMDI tag=RQVL7DF7K7SZ type=write size=2690971 2024-09-12T00:42:23.038 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.041+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=2W8KG5A8SLOJ type=del size=902340 2024-09-12T00:42:23.041 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.045+0000 7fcde98768c0 1 < completed delete operation key=R2EBH0Q5885L tag=NY1A9TTKLDRW type=del 2024-09-12T00:42:23.047 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.049+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~UX6E0AB4P13O.0 size=1048576 2024-09-12T00:42:23.049 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.053+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~UX6E0AB4P13O.1 size=1048576 2024-09-12T00:42:23.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.053+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~UX6E0AB4P13O.2 size=714616 2024-09-12T00:42:23.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.053+0000 7fcde98768c0 1 > prepared multipart upload key=4487IMSOLPDV upload=UX6E0AB4P13O tag=1Z6WF4GGXQW0 type=write size=3860344 2024-09-12T00:42:23.054 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.057+0000 7fcde98768c0 1 < completed delete operation key=TUMAMUZUIR7E tag=8KPM3NJ2IAPR type=del 2024-09-12T00:42:23.062 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.065+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=C97ZAB6XANJY type=del size=270002 2024-09-12T00:42:23.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.069+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~HZ93CX40TWU8.0 size=1048576 2024-09-12T00:42:23.067 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.069+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~HZ93CX40TWU8.1 size=1048576 2024-09-12T00:42:23.070 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.073+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~HZ93CX40TWU8.2 size=183543 2024-09-12T00:42:23.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.077+0000 7fcde98768c0 1 < completed multipart upload key=2T5IU2IUNGJX upload=HZ93CX40TWU8 tag=EWD0H74T19VZ type=write size=3329271 2024-09-12T00:42:23.078 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.081+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=E36MJO4J24C0 type=del size=222713 2024-09-12T00:42:23.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.085+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~BVLCQPULHY0Z.0 size=1048576 2024-09-12T00:42:23.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.085+0000 7fcde98768c0 1 < canceled part key=_multipart_BQGIXJJWBAN0.2~BVLCQPULHY0Z.1 size=1048576 2024-09-12T00:42:23.083 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.085+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~BVLCQPULHY0Z.2 size=319501 2024-09-12T00:42:23.088 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.089+0000 7fcde98768c0 1 < canceled multipart upload key=BQGIXJJWBAN0 upload=BVLCQPULHY0Z tag=AWAS6ZO7SZ2G type=write size=3465229 2024-09-12T00:42:23.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.093+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=OE4EU5C44QUZ type=del size=1505054 2024-09-12T00:42:23.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.101+0000 7fcde98768c0 1 < suggested update operation key=TUMAMUZUIR7E tag=RUF58OTTUDX2 type=del size=3261522 2024-09-12T00:42:23.102 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.105+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~82R22YX4D6PN.0 size=1048576 2024-09-12T00:42:23.104 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.105+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~82R22YX4D6PN.1 size=1048576 2024-09-12T00:42:23.106 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.109+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~82R22YX4D6PN.2 size=718973 2024-09-12T00:42:23.107 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.109+0000 7fcde98768c0 1 > prepared multipart upload key=97030NBF3MI4 upload=82R22YX4D6PN tag=U34HQXCYBZLV type=write size=3864701 2024-09-12T00:42:23.109 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.113+0000 7fcde98768c0 1 < completed delete operation key=NVOFV649MT0A tag=O6LZ0TXIK21T type=del 2024-09-12T00:42:23.114 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.117+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~43CQH4FISZQ7.0 size=322863 2024-09-12T00:42:23.115 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.117+0000 7fcde98768c0 1 > prepared multipart upload key=IMITNCB1ST9E upload=43CQH4FISZQ7 tag=H1BPRUWWWB75 type=write size=1371439 2024-09-12T00:42:23.118 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.121+0000 7fcde98768c0 1 < completed delete operation key=2T5IU2IUNGJX tag=0IT0Z8B7OI1O type=del 2024-09-12T00:42:23.120 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.121+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=528EEEH0ODPE type=write size=204319 2024-09-12T00:42:23.126 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.129+0000 7fcde98768c0 1 < suggested update operation key=NVOFV649MT0A tag=2SYTL44S470J type=del size=1822244 2024-09-12T00:42:23.129 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.133+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=RC3VTTDJ8MGE type=write size=250012 2024-09-12T00:42:23.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.133+0000 7fcde98768c0 1 < completed delete operation key=RC9A2Y5TCP9C tag=WYS6SB166UMW type=del 2024-09-12T00:42:23.134 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.137+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=WV8P3XMC8AYZ type=del size=1696713 2024-09-12T00:42:23.137 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.141+0000 7fcde98768c0 1 < completed delete operation key=G6R8BX1H7SPM tag=CDACNUN1TFS1 type=del 2024-09-12T00:42:23.140 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.141+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=ID33MSN5CQRR type=write size=749125 2024-09-12T00:42:23.143 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.145+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~HB99A5CX8CZS.0 size=1048576 2024-09-12T00:42:23.145 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.149+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~HB99A5CX8CZS.1 size=1048576 2024-09-12T00:42:23.147 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.149+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~HB99A5CX8CZS.2 size=7182 2024-09-12T00:42:23.152 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.153+0000 7fcde98768c0 1 < completed multipart upload key=3X9I78PMR1HV upload=HB99A5CX8CZS tag=IWFAW2TDIHMI type=write size=3152910 2024-09-12T00:42:23.156 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.157+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=6P65FAEXLJR1 type=write size=658559 2024-09-12T00:42:23.157 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.161+0000 7fcde98768c0 -1 < failed to complete operation key=TUMAMUZUIR7E tag=PFB34SXX560C type=write size=877078: (22) Invalid argument 2024-09-12T00:42:23.160 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.161+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=W6IJDYA87IFN type=del size=224528 2024-09-12T00:42:23.163 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.165+0000 7fcde98768c0 1 < completed write operation key=5YBVLUYJW40U tag=YN3FEKAKDNE5 type=write size=24254 2024-09-12T00:42:23.166 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.169+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=H3RAW7V98ZRO type=del size=2468454 2024-09-12T00:42:23.169 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.173+0000 7fcde98768c0 1 < canceled operation key=HVE3YQTFZWTV tag=5JY72AQ4782G type=del size=2240036 2024-09-12T00:42:23.172 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.173+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=NJZCCSX3JFPX type=del size=1796469 2024-09-12T00:42:23.175 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.177+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~W4D8FES25P01.0 size=759019 2024-09-12T00:42:23.181 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.185+0000 7fcde98768c0 1 < completed multipart upload key=5B8C6E8L5N52 upload=W4D8FES25P01 tag=Q5Y27CXHEDJ2 type=write size=1807595 2024-09-12T00:42:23.184 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.185+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=2MUM7OIKR43H type=del size=3629311 2024-09-12T00:42:23.187 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.189+0000 7fcde98768c0 1 < completed delete operation key=ZQD0QXDN1J1I tag=2W8KG5A8SLOJ type=del 2024-09-12T00:42:23.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.197+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~T28QXROY39EU.0 size=1048576 2024-09-12T00:42:23.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.197+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~T28QXROY39EU.1 size=560098 2024-09-12T00:42:23.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.197+0000 7fcde98768c0 1 > prepared multipart upload key=WLE5QLNPAGZA upload=T28QXROY39EU tag=IAEJAEZKEY9V type=write size=2657250 2024-09-12T00:42:23.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.201+0000 7fcde98768c0 1 < canceled part key=_multipart_4487IMSOLPDV.2~UX6E0AB4P13O.0 size=1048576 2024-09-12T00:42:23.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.201+0000 7fcde98768c0 1 < canceled part key=_multipart_4487IMSOLPDV.2~UX6E0AB4P13O.1 size=1048576 2024-09-12T00:42:23.199 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.201+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~UX6E0AB4P13O.2 size=714616 2024-09-12T00:42:23.205 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.209+0000 7fcde98768c0 1 < canceled multipart upload key=4487IMSOLPDV upload=UX6E0AB4P13O tag=1Z6WF4GGXQW0 type=write size=3860344 2024-09-12T00:42:23.208 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.209+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=KI2FL78FZ4YN type=del size=2645772 2024-09-12T00:42:23.215 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.217+0000 7fcde98768c0 1 < suggested update operation key=WLE5QLNPAGZA tag=C97ZAB6XANJY type=del size=270002 2024-09-12T00:42:23.221 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.225+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~U7ZUPG0X2H5I.0 size=1048576 2024-09-12T00:42:23.223 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.225+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~U7ZUPG0X2H5I.1 size=774746 2024-09-12T00:42:23.223 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.225+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=U7ZUPG0X2H5I tag=J1YO3W810U4F type=write size=2871898 2024-09-12T00:42:23.227 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.229+0000 7fcde98768c0 1 < completed delete operation key=HVE3YQTFZWTV tag=E36MJO4J24C0 type=del 2024-09-12T00:42:23.230 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.233+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=T5C8X3K1M4LC type=write size=1039955 2024-09-12T00:42:23.233 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.237+0000 7fcde98768c0 -1 < failed to complete operation key=NVOFV649MT0A tag=OE4EU5C44QUZ type=del size=1505054: (22) Invalid argument 2024-09-12T00:42:23.239 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.241+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~Y9ZJODB7VK8N.0 size=1048576 2024-09-12T00:42:23.240 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.241+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~Y9ZJODB7VK8N.1 size=1048576 2024-09-12T00:42:23.242 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.245+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~Y9ZJODB7VK8N.2 size=1012917 2024-09-12T00:42:23.243 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.245+0000 7fcde98768c0 1 > prepared multipart upload key=JW2GNFAYFNEK upload=Y9ZJODB7VK8N tag=CK76ZC9FLK8J type=write size=4158645 2024-09-12T00:42:23.245 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.249+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~82R22YX4D6PN.0 size=1048576 2024-09-12T00:42:23.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.249+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~82R22YX4D6PN.1 size=1048576 2024-09-12T00:42:23.250 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.253+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~82R22YX4D6PN.2 size=718973 2024-09-12T00:42:23.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.257+0000 7fcde98768c0 1 < completed multipart upload key=97030NBF3MI4 upload=82R22YX4D6PN tag=U34HQXCYBZLV type=write size=3864701 2024-09-12T00:42:23.257 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.261+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=8A97HDBQ7WHQ type=del size=2010873 2024-09-12T00:42:23.258 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.261+0000 7fcde98768c0 1 < canceled part key=_multipart_IMITNCB1ST9E.2~43CQH4FISZQ7.0 size=322863 2024-09-12T00:42:23.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.265+0000 7fcde98768c0 1 < canceled multipart upload key=IMITNCB1ST9E upload=43CQH4FISZQ7 tag=H1BPRUWWWB75 type=write size=1371439 2024-09-12T00:42:23.267 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.269+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~32DD7SDXUV1Z.0 size=1048576 2024-09-12T00:42:23.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.273+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~32DD7SDXUV1Z.1 size=441957 2024-09-12T00:42:23.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.273+0000 7fcde98768c0 1 > prepared multipart upload key=R2EBH0Q5885L upload=32DD7SDXUV1Z tag=7H3D1IWKMBMA type=write size=2539109 2024-09-12T00:42:23.273 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.277+0000 7fcde98768c0 1 < completed write operation key=7UR0FX8HA2A5 tag=528EEEH0ODPE type=write size=204319 2024-09-12T00:42:23.279 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.281+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~YM6KURFADQ3J.0 size=1048576 2024-09-12T00:42:23.281 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.285+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~YM6KURFADQ3J.1 size=1048576 2024-09-12T00:42:23.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.285+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~YM6KURFADQ3J.2 size=976877 2024-09-12T00:42:23.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.285+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=YM6KURFADQ3J tag=9HMMQMMOTSMZ type=write size=4122605 2024-09-12T00:42:23.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.289+0000 7fcde98768c0 1 < completed write operation key=NVOFV649MT0A tag=RC3VTTDJ8MGE type=write size=250012 2024-09-12T00:42:23.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.293+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=PIVZYXJMHE3Q type=write size=879403 2024-09-12T00:42:23.292 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.293+0000 7fcde98768c0 1 < completed delete operation key=NVOFV649MT0A tag=WV8P3XMC8AYZ type=del 2024-09-12T00:42:23.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.297+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=LETVP9WMXGPJ type=write size=259054 2024-09-12T00:42:23.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.301+0000 7fcde98768c0 1 < canceled operation key=IMITNCB1ST9E tag=ID33MSN5CQRR type=write size=749125 2024-09-12T00:42:23.301 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.305+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=I9THIQQR5L1E type=del size=662671 2024-09-12T00:42:23.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.309+0000 7fcde98768c0 1 < suggested update operation key=F813QWV02TI0 tag=6P65FAEXLJR1 type=write size=658559 2024-09-12T00:42:23.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.313+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=MTNYZNY1ZMLX type=del size=3078336 2024-09-12T00:42:23.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.317+0000 7fcde98768c0 1 < suggested update operation key=7UR0FX8HA2A5 tag=W6IJDYA87IFN type=del size=224528 2024-09-12T00:42:23.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.321+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=ZIWHBB7BTM08 type=del size=1810041 2024-09-12T00:42:23.319 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.321+0000 7fcde98768c0 1 < completed delete operation key=4487IMSOLPDV tag=H3RAW7V98ZRO type=del 2024-09-12T00:42:23.322 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.325+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=98GLVJ83JD8A type=del size=1435948 2024-09-12T00:42:23.325 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.329+0000 7fcde98768c0 1 < completed delete operation key=J9EUM073CZHF tag=NJZCCSX3JFPX type=del 2024-09-12T00:42:23.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.329+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=A42KTZD1IS7D type=write size=621987 2024-09-12T00:42:23.330 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.333+0000 7fcde98768c0 1 < completed delete operation key=QD5JXFL962R5 tag=2MUM7OIKR43H type=del 2024-09-12T00:42:23.333 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.337+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=D6HAUQAXOJ9S type=del size=2413840 2024-09-12T00:42:23.338 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.341+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~T28QXROY39EU.0 size=1048576 2024-09-12T00:42:23.340 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.341+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~T28QXROY39EU.1 size=560098 2024-09-12T00:42:23.344 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.345+0000 7fcde98768c0 1 < completed multipart upload key=WLE5QLNPAGZA upload=T28QXROY39EU tag=IAEJAEZKEY9V type=write size=2657250 2024-09-12T00:42:23.347 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.349+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=B9OI61MI2O7Y type=del size=2514495 2024-09-12T00:42:23.352 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.357+0000 7fcde98768c0 1 < suggested update operation key=5YBVLUYJW40U tag=KI2FL78FZ4YN type=del size=2645772 2024-09-12T00:42:23.357 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.361+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~12AVV9262MDW.0 size=1048576 2024-09-12T00:42:23.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.361+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~12AVV9262MDW.1 size=483399 2024-09-12T00:42:23.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.361+0000 7fcde98768c0 1 > prepared multipart upload key=F813QWV02TI0 upload=12AVV9262MDW tag=8S5GXE8XYU45 type=write size=2580551 2024-09-12T00:42:23.362 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.365+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~U7ZUPG0X2H5I.0 size=1048576 2024-09-12T00:42:23.362 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.365+0000 7fcde98768c0 1 < canceled part key=_multipart_G6R8BX1H7SPM.2~U7ZUPG0X2H5I.1 size=774746 2024-09-12T00:42:23.367 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.369+0000 7fcde98768c0 1 < canceled multipart upload key=G6R8BX1H7SPM upload=U7ZUPG0X2H5I tag=J1YO3W810U4F type=write size=2871898 2024-09-12T00:42:23.369 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.373+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=LS7S8LE9BH7T type=del size=1998493 2024-09-12T00:42:23.372 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.373+0000 7fcde98768c0 1 < completed write operation key=2T5IU2IUNGJX tag=T5C8X3K1M4LC type=write size=1039955 2024-09-12T00:42:23.377 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.381+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~JXRODU0Y1GRU.0 size=1048576 2024-09-12T00:42:23.379 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.381+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~JXRODU0Y1GRU.1 size=1048576 2024-09-12T00:42:23.382 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.385+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~JXRODU0Y1GRU.2 size=884517 2024-09-12T00:42:23.382 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.385+0000 7fcde98768c0 1 > prepared multipart upload key=7UR0FX8HA2A5 upload=JXRODU0Y1GRU tag=OLO7EC4WCI4N type=write size=4030245 2024-09-12T00:42:23.383 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.385+0000 7fcde98768c0 1 < canceled part key=_multipart_JW2GNFAYFNEK.2~Y9ZJODB7VK8N.0 size=1048576 2024-09-12T00:42:23.384 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.385+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~Y9ZJODB7VK8N.1 size=1048576 2024-09-12T00:42:23.386 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.389+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~Y9ZJODB7VK8N.2 size=1012917 2024-09-12T00:42:23.391 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.393+0000 7fcde98768c0 1 < canceled multipart upload key=JW2GNFAYFNEK upload=Y9ZJODB7VK8N tag=CK76ZC9FLK8J type=write size=4158645 2024-09-12T00:42:23.394 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.397+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=KK2Y05LSXSMI type=del size=2554830 2024-09-12T00:42:23.397 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.401+0000 7fcde98768c0 1 < completed delete operation key=TUMAMUZUIR7E tag=8A97HDBQ7WHQ type=del 2024-09-12T00:42:23.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.405+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~F0DPZ9J6QG3I.0 size=1048576 2024-09-12T00:42:23.405 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.409+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~F0DPZ9J6QG3I.1 size=380515 2024-09-12T00:42:23.405 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.409+0000 7fcde98768c0 1 > prepared multipart upload key=4487IMSOLPDV upload=F0DPZ9J6QG3I tag=ABF81IE79ZMP type=write size=2477667 2024-09-12T00:42:23.408 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.409+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~32DD7SDXUV1Z.0 size=1048576 2024-09-12T00:42:23.411 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.413+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~32DD7SDXUV1Z.1 size=441957 2024-09-12T00:42:23.415 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.417+0000 7fcde98768c0 1 < completed multipart upload key=R2EBH0Q5885L upload=32DD7SDXUV1Z tag=7H3D1IWKMBMA type=write size=2539109 2024-09-12T00:42:23.422 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.425+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~VZRNJUZCCLDR.0 size=1048576 2024-09-12T00:42:23.424 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.425+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~VZRNJUZCCLDR.1 size=1048576 2024-09-12T00:42:23.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.429+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~VZRNJUZCCLDR.2 size=803952 2024-09-12T00:42:23.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.429+0000 7fcde98768c0 1 > prepared multipart upload key=3X9I78PMR1HV upload=VZRNJUZCCLDR tag=K5K32D0ECT73 type=write size=3949680 2024-09-12T00:42:23.429 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.433+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~YM6KURFADQ3J.0 size=1048576 2024-09-12T00:42:23.430 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.433+0000 7fcde98768c0 1 < canceled part key=_multipart_V80E1NH858IK.2~YM6KURFADQ3J.1 size=1048576 2024-09-12T00:42:23.432 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.433+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~YM6KURFADQ3J.2 size=976877 2024-09-12T00:42:23.437 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.441+0000 7fcde98768c0 1 < canceled multipart upload key=V80E1NH858IK upload=YM6KURFADQ3J tag=9HMMQMMOTSMZ type=write size=4122605 2024-09-12T00:42:23.442 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.445+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~CKK0K51QEWRV.0 size=1048576 2024-09-12T00:42:23.445 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.449+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~CKK0K51QEWRV.1 size=1048576 2024-09-12T00:42:23.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.449+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~CKK0K51QEWRV.2 size=612473 2024-09-12T00:42:23.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.449+0000 7fcde98768c0 1 > prepared multipart upload key=Z1PY2MFUC1C4 upload=CKK0K51QEWRV tag=V83HXAFL6PDW type=write size=3758201 2024-09-12T00:42:23.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.453+0000 7fcde98768c0 1 < canceled operation key=Z1PY2MFUC1C4 tag=PIVZYXJMHE3Q type=write size=879403 2024-09-12T00:42:23.453 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.457+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=UAZ03F05G7CR type=del size=1736886 2024-09-12T00:42:23.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.461+0000 7fcde98768c0 1 < suggested remove operation key=2T5IU2IUNGJX tag=LETVP9WMXGPJ type=write 2024-09-12T00:42:23.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.465+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=ZER6EZD51L3P type=del size=301077 2024-09-12T00:42:23.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.465+0000 7fcde98768c0 -1 < failed to complete operation key=7UR0FX8HA2A5 tag=I9THIQQR5L1E type=del size=662671: (22) Invalid argument 2024-09-12T00:42:23.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.473+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~MFYMJQ5196RL.0 size=1048576 2024-09-12T00:42:23.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.473+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~MFYMJQ5196RL.1 size=211114 2024-09-12T00:42:23.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.473+0000 7fcde98768c0 1 > prepared multipart upload key=97030NBF3MI4 upload=MFYMJQ5196RL tag=1XPCDWXOD2S7 type=write size=2308266 2024-09-12T00:42:23.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.477+0000 7fcde98768c0 1 < completed delete operation key=C6PW0ETP4BG2 tag=MTNYZNY1ZMLX type=del 2024-09-12T00:42:23.687 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.689+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~3I4VRI1V2U2F.0 size=386136 2024-09-12T00:42:23.688 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.689+0000 7fcde98768c0 1 > prepared multipart upload key=RC9A2Y5TCP9C upload=3I4VRI1V2U2F tag=6COBGRTY8H0K type=write size=1434712 2024-09-12T00:42:23.691 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.693+0000 7fcde98768c0 -1 < failed to complete operation key=5YBVLUYJW40U tag=ZIWHBB7BTM08 type=del size=1810041: (22) Invalid argument 2024-09-12T00:42:23.694 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.697+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=C7N8T6BNHTPW type=del size=520725 2024-09-12T00:42:23.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.701+0000 7fcde98768c0 1 < completed delete operation key=TUMAMUZUIR7E tag=98GLVJ83JD8A type=del 2024-09-12T00:42:23.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.705+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~MY9H7NC5MDO0.0 size=1048576 2024-09-12T00:42:23.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.709+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~MY9H7NC5MDO0.1 size=1048576 2024-09-12T00:42:23.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.713+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~MY9H7NC5MDO0.2 size=313223 2024-09-12T00:42:23.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.713+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=MY9H7NC5MDO0 tag=TEPIEU65ZS5V type=write size=3458951 2024-09-12T00:42:23.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.717+0000 7fcde98768c0 1 < suggested remove operation key=FUJIUIR1E00J tag=A42KTZD1IS7D type=write 2024-09-12T00:42:23.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.725+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~QPJ97OKHJIXG.0 size=730429 2024-09-12T00:42:23.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.725+0000 7fcde98768c0 1 > prepared multipart upload key=Z4RNDW37GEK6 upload=QPJ97OKHJIXG tag=FVGJ6V6DL8FH type=write size=1779005 2024-09-12T00:42:23.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.729+0000 7fcde98768c0 1 < completed delete operation key=3QOENE572J7A tag=D6HAUQAXOJ9S type=del 2024-09-12T00:42:23.731 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.733+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=RDU5ID23ESZN type=del size=3330920 2024-09-12T00:42:23.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.741+0000 7fcde98768c0 1 < suggested remove operation key=IMITNCB1ST9E tag=B9OI61MI2O7Y type=del 2024-09-12T00:42:23.742 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.745+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=LDE2AJTLSHMI type=write size=906216 2024-09-12T00:42:23.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.749+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~12AVV9262MDW.0 size=1048576 2024-09-12T00:42:23.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.749+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~12AVV9262MDW.1 size=483399 2024-09-12T00:42:23.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.757+0000 7fcde98768c0 1 < completed multipart upload key=F813QWV02TI0 upload=12AVV9262MDW tag=8S5GXE8XYU45 type=write size=2580551 2024-09-12T00:42:23.757 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.761+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=SFPMFINTR561 type=del size=1943439 2024-09-12T00:42:23.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.765+0000 7fcde98768c0 1 < completed delete operation key=EDFNLQYP4L4L tag=LS7S8LE9BH7T type=del 2024-09-12T00:42:23.764 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.765+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=23XYLA1T0I4F type=del size=3140072 2024-09-12T00:42:23.764 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.769+0000 7fcde98768c0 1 < canceled part key=_multipart_7UR0FX8HA2A5.2~JXRODU0Y1GRU.0 size=1048576 2024-09-12T00:42:23.769 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.769+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~JXRODU0Y1GRU.1 size=1048576 2024-09-12T00:42:23.770 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.773+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~JXRODU0Y1GRU.2 size=884517 2024-09-12T00:42:23.775 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.777+0000 7fcde98768c0 1 < canceled multipart upload key=7UR0FX8HA2A5 upload=JXRODU0Y1GRU tag=OLO7EC4WCI4N type=write size=4030245 2024-09-12T00:42:23.779 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.781+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=XFUS4DP0HGJ6 type=del size=936952 2024-09-12T00:42:23.786 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.789+0000 7fcde98768c0 1 < suggested update operation key=5B8C6E8L5N52 tag=KK2Y05LSXSMI type=del size=2554830 2024-09-12T00:42:23.790 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.793+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=TG30UMNODGW9 type=del size=775484 2024-09-12T00:42:23.794 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.797+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~F0DPZ9J6QG3I.0 size=1048576 2024-09-12T00:42:23.797 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.801+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~F0DPZ9J6QG3I.1 size=380515 2024-09-12T00:42:23.802 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.805+0000 7fcde98768c0 1 < completed multipart upload key=4487IMSOLPDV upload=F0DPZ9J6QG3I tag=ABF81IE79ZMP type=write size=2477667 2024-09-12T00:42:23.808 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.813+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~UYUXOZPT0OMR.0 size=1048576 2024-09-12T00:42:23.811 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.813+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~UYUXOZPT0OMR.1 size=1048576 2024-09-12T00:42:23.814 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.817+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~UYUXOZPT0OMR.2 size=1010600 2024-09-12T00:42:23.814 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.817+0000 7fcde98768c0 1 > prepared multipart upload key=BQGIXJJWBAN0 upload=UYUXOZPT0OMR tag=KK2U8T96SAFP type=write size=4156328 2024-09-12T00:42:23.817 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.821+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~VZRNJUZCCLDR.0 size=1048576 2024-09-12T00:42:23.820 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.821+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~VZRNJUZCCLDR.1 size=1048576 2024-09-12T00:42:23.822 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.825+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~VZRNJUZCCLDR.2 size=803952 2024-09-12T00:42:23.828 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.829+0000 7fcde98768c0 1 < completed multipart upload key=3X9I78PMR1HV upload=VZRNJUZCCLDR tag=K5K32D0ECT73 type=write size=3949680 2024-09-12T00:42:23.835 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.837+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=6TG48RBMKZOF type=del size=3566833 2024-09-12T00:42:23.839 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.841+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~CKK0K51QEWRV.0 size=1048576 2024-09-12T00:42:23.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.845+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~CKK0K51QEWRV.1 size=1048576 2024-09-12T00:42:23.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.849+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~CKK0K51QEWRV.2 size=612473 2024-09-12T00:42:23.851 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.853+0000 7fcde98768c0 1 < completed multipart upload key=Z1PY2MFUC1C4 upload=CKK0K51QEWRV tag=V83HXAFL6PDW type=write size=3758201 2024-09-12T00:42:23.857 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.861+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~JHS5U2DFHIFF.0 size=1048576 2024-09-12T00:42:23.859 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.861+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~JHS5U2DFHIFF.1 size=1048576 2024-09-12T00:42:23.861 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.865+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~JHS5U2DFHIFF.2 size=110188 2024-09-12T00:42:23.861 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.865+0000 7fcde98768c0 1 > prepared multipart upload key=C6PW0ETP4BG2 upload=JHS5U2DFHIFF tag=ZQ7U46N32VYU type=write size=3255916 2024-09-12T00:42:23.865 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.869+0000 7fcde98768c0 1 < completed delete operation key=G6R8BX1H7SPM tag=UAZ03F05G7CR type=del 2024-09-12T00:42:23.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.869+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=UYMD0GR6U60I type=del size=2339337 2024-09-12T00:42:23.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.873+0000 7fcde98768c0 1 < completed delete operation key=2T5IU2IUNGJX tag=ZER6EZD51L3P type=del 2024-09-12T00:42:23.874 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.877+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=D8LYE0Y4DQDL type=del size=4033567 2024-09-12T00:42:23.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.881+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~MFYMJQ5196RL.0 size=1048576 2024-09-12T00:42:23.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.881+0000 7fcde98768c0 1 < canceled part key=_multipart_97030NBF3MI4.2~MFYMJQ5196RL.1 size=211114 2024-09-12T00:42:23.882 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.885+0000 7fcde98768c0 1 < canceled multipart upload key=97030NBF3MI4 upload=MFYMJQ5196RL tag=1XPCDWXOD2S7 type=write size=2308266 2024-09-12T00:42:23.889 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.889+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~D0GMFVS6AI5G.0 size=1048576 2024-09-12T00:42:23.891 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.893+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~D0GMFVS6AI5G.1 size=1048576 2024-09-12T00:42:23.893 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.897+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~D0GMFVS6AI5G.2 size=396794 2024-09-12T00:42:23.894 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.897+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=D0GMFVS6AI5G tag=M6WKPV7ZK9IX type=write size=3542522 2024-09-12T00:42:23.897 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.901+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~3I4VRI1V2U2F.0 size=386136 2024-09-12T00:42:23.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.905+0000 7fcde98768c0 1 < completed multipart upload key=RC9A2Y5TCP9C upload=3I4VRI1V2U2F tag=6COBGRTY8H0K type=write size=1434712 2024-09-12T00:42:23.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.909+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~M1RH6GIBFLKN.0 size=1048576 2024-09-12T00:42:23.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.913+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~M1RH6GIBFLKN.1 size=1048576 2024-09-12T00:42:23.912 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.913+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~M1RH6GIBFLKN.2 size=260174 2024-09-12T00:42:23.912 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.913+0000 7fcde98768c0 1 > prepared multipart upload key=RC9A2Y5TCP9C upload=M1RH6GIBFLKN tag=QMST6ZJ8BFO0 type=write size=3405902 2024-09-12T00:42:23.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.921+0000 7fcde98768c0 1 < suggested update operation key=3X9I78PMR1HV tag=C7N8T6BNHTPW type=del size=520725 2024-09-12T00:42:23.924 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.925+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~BTTDDWWER5GR.0 size=564487 2024-09-12T00:42:23.924 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.925+0000 7fcde98768c0 1 > prepared multipart upload key=FUJIUIR1E00J upload=BTTDDWWER5GR tag=VTTKKYOFRKFF type=write size=1613063 2024-09-12T00:42:23.925 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.929+0000 7fcde98768c0 1 < canceled part key=_multipart_G6R8BX1H7SPM.2~MY9H7NC5MDO0.0 size=1048576 2024-09-12T00:42:23.927 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.929+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~MY9H7NC5MDO0.1 size=1048576 2024-09-12T00:42:23.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.933+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~MY9H7NC5MDO0.2 size=313223 2024-09-12T00:42:23.935 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.937+0000 7fcde98768c0 1 < canceled multipart upload key=G6R8BX1H7SPM upload=MY9H7NC5MDO0 tag=TEPIEU65ZS5V type=write size=3458951 2024-09-12T00:42:23.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.941+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=4A14TEJW0JO5 type=del size=2000372 2024-09-12T00:42:23.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.945+0000 7fcde98768c0 1 < canceled part key=_multipart_Z4RNDW37GEK6.2~QPJ97OKHJIXG.0 size=730429 2024-09-12T00:42:23.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.949+0000 7fcde98768c0 1 < canceled multipart upload key=Z4RNDW37GEK6 upload=QPJ97OKHJIXG tag=FVGJ6V6DL8FH type=write size=1779005 2024-09-12T00:42:23.950 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.953+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=CJFQN1SWLVYD type=del size=1911880 2024-09-12T00:42:23.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.957+0000 7fcde98768c0 1 < suggested update operation key=G6R8BX1H7SPM tag=RDU5ID23ESZN type=del size=3330920 2024-09-12T00:42:23.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.961+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=JU9UPMZLUCTY type=del size=2475848 2024-09-12T00:42:23.962 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.965+0000 7fcde98768c0 1 < completed write operation key=WLE5QLNPAGZA tag=LDE2AJTLSHMI type=write size=906216 2024-09-12T00:42:23.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.969+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~FU8VO7MEBN7Z.0 size=952476 2024-09-12T00:42:23.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.969+0000 7fcde98768c0 1 > prepared multipart upload key=JW2GNFAYFNEK upload=FU8VO7MEBN7Z tag=XKSWXC1ETHOG type=write size=2001052 2024-09-12T00:42:23.970 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.973+0000 7fcde98768c0 1 < completed delete operation key=BZ4YUNTMOJBK tag=SFPMFINTR561 type=del 2024-09-12T00:42:23.976 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.977+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~N6P1ZJ9S2IWI.0 size=438720 2024-09-12T00:42:23.976 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.977+0000 7fcde98768c0 1 > prepared multipart upload key=IMITNCB1ST9E upload=N6P1ZJ9S2IWI tag=7ZI9HQFG0ES3 type=write size=1487296 2024-09-12T00:42:23.982 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.985+0000 7fcde98768c0 1 < suggested update operation key=FUJIUIR1E00J tag=23XYLA1T0I4F type=del size=3140072 2024-09-12T00:42:23.986 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.989+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=2RM9FEBR2C4T type=del size=3269563 2024-09-12T00:42:23.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.993+0000 7fcde98768c0 1 < completed delete operation key=368TXYQVK9C3 tag=XFUS4DP0HGJ6 type=del 2024-09-12T00:42:23.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.993+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=U7UBH61O0WB3 type=del size=1816435 2024-09-12T00:42:23.994 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:23.997+0000 7fcde98768c0 1 < completed delete operation key=F813QWV02TI0 tag=TG30UMNODGW9 type=del 2024-09-12T00:42:23.998 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.001+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~297A6DRC930J.0 size=1048576 2024-09-12T00:42:24.000 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.001+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~297A6DRC930J.1 size=1048576 2024-09-12T00:42:24.002 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.005+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~297A6DRC930J.2 size=774912 2024-09-12T00:42:24.002 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.005+0000 7fcde98768c0 1 > prepared multipart upload key=JW2GNFAYFNEK upload=297A6DRC930J tag=NMMMR40LQOIU type=write size=3920640 2024-09-12T00:42:24.005 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.009+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~UYUXOZPT0OMR.0 size=1048576 2024-09-12T00:42:24.005 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.009+0000 7fcde98768c0 1 < canceled part key=_multipart_BQGIXJJWBAN0.2~UYUXOZPT0OMR.1 size=1048576 2024-09-12T00:42:24.007 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.009+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~UYUXOZPT0OMR.2 size=1010600 2024-09-12T00:42:24.012 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.013+0000 7fcde98768c0 1 < canceled multipart upload key=BQGIXJJWBAN0 upload=UYUXOZPT0OMR tag=KK2U8T96SAFP type=write size=4156328 2024-09-12T00:42:24.017 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.021+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~3HGBB94O2G2I.0 size=1048576 2024-09-12T00:42:24.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.021+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~3HGBB94O2G2I.1 size=638703 2024-09-12T00:42:24.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.021+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=3HGBB94O2G2I tag=HJY0I89Q3EWM type=write size=2735855 2024-09-12T00:42:24.022 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.025+0000 7fcde98768c0 1 < completed delete operation key=TUMAMUZUIR7E tag=6TG48RBMKZOF type=del 2024-09-12T00:42:24.025 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.029+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=0NIDP80A0VUU type=del size=3259608 2024-09-12T00:42:24.026 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.029+0000 7fcde98768c0 1 < canceled part key=_multipart_C6PW0ETP4BG2.2~JHS5U2DFHIFF.0 size=1048576 2024-09-12T00:42:24.028 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.033+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~JHS5U2DFHIFF.1 size=1048576 2024-09-12T00:42:24.031 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.033+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~JHS5U2DFHIFF.2 size=110188 2024-09-12T00:42:24.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.037+0000 7fcde98768c0 1 < canceled multipart upload key=C6PW0ETP4BG2 upload=JHS5U2DFHIFF tag=ZQ7U46N32VYU type=write size=3255916 2024-09-12T00:42:24.039 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.041+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=FGPI0EYZNJ9I type=write size=454477 2024-09-12T00:42:24.043 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.045+0000 7fcde98768c0 1 < completed delete operation key=RC9A2Y5TCP9C tag=UYMD0GR6U60I type=del 2024-09-12T00:42:24.046 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.049+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=C0N9TPAFL6RZ type=del size=2899077 2024-09-12T00:42:24.052 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.053+0000 7fcde98768c0 1 < suggested remove operation key=3X9I78PMR1HV tag=D8LYE0Y4DQDL type=del 2024-09-12T00:42:24.056 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.057+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=1M479YWB8FJU type=del size=2926565 2024-09-12T00:42:24.059 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.061+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~D0GMFVS6AI5G.0 size=1048576 2024-09-12T00:42:24.061 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.065+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~D0GMFVS6AI5G.1 size=1048576 2024-09-12T00:42:24.064 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.065+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~D0GMFVS6AI5G.2 size=396794 2024-09-12T00:42:24.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.073+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=D0GMFVS6AI5G tag=M6WKPV7ZK9IX type=write size=3542522 2024-09-12T00:42:24.072 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.077+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=DFDW6GYUFGYB type=del size=937243 2024-09-12T00:42:24.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.077+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~M1RH6GIBFLKN.0 size=1048576 2024-09-12T00:42:24.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.077+0000 7fcde98768c0 1 < canceled part key=_multipart_RC9A2Y5TCP9C.2~M1RH6GIBFLKN.1 size=1048576 2024-09-12T00:42:24.078 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.081+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~M1RH6GIBFLKN.2 size=260174 2024-09-12T00:42:24.084 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.085+0000 7fcde98768c0 1 < canceled multipart upload key=RC9A2Y5TCP9C upload=M1RH6GIBFLKN tag=QMST6ZJ8BFO0 type=write size=3405902 2024-09-12T00:42:24.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.089+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=FPLSCUDZS9UG type=write size=692096 2024-09-12T00:42:24.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.093+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~BTTDDWWER5GR.0 size=564487 2024-09-12T00:42:24.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.097+0000 7fcde98768c0 1 < completed multipart upload key=FUJIUIR1E00J upload=BTTDDWWER5GR tag=VTTKKYOFRKFF type=write size=1613063 2024-09-12T00:42:24.100 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.101+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~0DGCWSS91BPK.0 size=1048576 2024-09-12T00:42:24.102 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.105+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~0DGCWSS91BPK.1 size=1048576 2024-09-12T00:42:24.104 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.109+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~0DGCWSS91BPK.2 size=915472 2024-09-12T00:42:24.104 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.109+0000 7fcde98768c0 1 > prepared multipart upload key=5YBVLUYJW40U upload=0DGCWSS91BPK tag=XU3PTEWO7992 type=write size=4061200 2024-09-12T00:42:24.107 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.109+0000 7fcde98768c0 1 < completed delete operation key=HVE3YQTFZWTV tag=4A14TEJW0JO5 type=del 2024-09-12T00:42:24.113 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.117+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~CQ802B6CCT6R.0 size=1048576 2024-09-12T00:42:24.115 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.117+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~CQ802B6CCT6R.1 size=1048576 2024-09-12T00:42:24.121 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.125+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~CQ802B6CCT6R.2 size=651280 2024-09-12T00:42:24.121 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.125+0000 7fcde98768c0 1 > prepared multipart upload key=Z1PY2MFUC1C4 upload=CQ802B6CCT6R tag=R23SK2UJSBZU type=write size=3797008 2024-09-12T00:42:24.127 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.129+0000 7fcde98768c0 1 < suggested remove operation key=BZ4YUNTMOJBK tag=CJFQN1SWLVYD type=del 2024-09-12T00:42:24.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.133+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=SXXFDQPHHCZQ type=write size=17359 2024-09-12T00:42:24.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.137+0000 7fcde98768c0 1 < completed delete operation key=IV4JCE1QJC70 tag=JU9UPMZLUCTY type=del 2024-09-12T00:42:24.139 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.141+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~7KR4PUH1L4YD.0 size=63 2024-09-12T00:42:24.139 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.141+0000 7fcde98768c0 1 > prepared multipart upload key=ZQD0QXDN1J1I upload=7KR4PUH1L4YD tag=9DO12EPJDHJ4 type=write size=1048639 2024-09-12T00:42:24.142 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.145+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~FU8VO7MEBN7Z.0 size=952476 2024-09-12T00:42:24.148 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.149+0000 7fcde98768c0 1 < completed multipart upload key=JW2GNFAYFNEK upload=FU8VO7MEBN7Z tag=XKSWXC1ETHOG type=write size=2001052 2024-09-12T00:42:24.154 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.157+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~023PPO1069JF.0 size=1048576 2024-09-12T00:42:24.156 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.157+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~023PPO1069JF.1 size=1048576 2024-09-12T00:42:24.159 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.161+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~023PPO1069JF.2 size=315139 2024-09-12T00:42:24.159 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.161+0000 7fcde98768c0 1 > prepared multipart upload key=Z4RNDW37GEK6 upload=023PPO1069JF tag=WLSKL9TSNLAW type=write size=3460867 2024-09-12T00:42:24.162 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.165+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~N6P1ZJ9S2IWI.0 size=438720 2024-09-12T00:42:24.167 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.169+0000 7fcde98768c0 1 < completed multipart upload key=IMITNCB1ST9E upload=N6P1ZJ9S2IWI tag=7ZI9HQFG0ES3 type=write size=1487296 2024-09-12T00:42:24.171 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.173+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=ONPJPXIS9ZPN type=write size=129400 2024-09-12T00:42:24.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.177+0000 7fcde98768c0 1 < completed delete operation key=V80E1NH858IK tag=2RM9FEBR2C4T type=del 2024-09-12T00:42:24.180 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.181+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~0VU71YCT2QKD.0 size=1048576 2024-09-12T00:42:24.183 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.185+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~0VU71YCT2QKD.1 size=1048576 2024-09-12T00:42:24.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.189+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~0VU71YCT2QKD.2 size=2819 2024-09-12T00:42:24.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.189+0000 7fcde98768c0 1 > prepared multipart upload key=368TXYQVK9C3 upload=0VU71YCT2QKD tag=IZF27FJJEFQG type=write size=3148547 2024-09-12T00:42:24.190 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.193+0000 7fcde98768c0 1 < completed delete operation key=7UR0FX8HA2A5 tag=U7UBH61O0WB3 type=del 2024-09-12T00:42:24.195 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.197+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~C3TASR00EYLN.0 size=1048576 2024-09-12T00:42:24.198 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.201+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~C3TASR00EYLN.1 size=428625 2024-09-12T00:42:24.198 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.201+0000 7fcde98768c0 1 > prepared multipart upload key=ZQD0QXDN1J1I upload=C3TASR00EYLN tag=Z6AV6MCU81GV type=write size=2525777 2024-09-12T00:42:24.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.205+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~297A6DRC930J.0 size=1048576 2024-09-12T00:42:24.204 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.209+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~297A6DRC930J.1 size=1048576 2024-09-12T00:42:24.207 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.209+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~297A6DRC930J.2 size=774912 2024-09-12T00:42:24.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.217+0000 7fcde98768c0 1 < completed multipart upload key=JW2GNFAYFNEK upload=297A6DRC930J tag=NMMMR40LQOIU type=write size=3920640 2024-09-12T00:42:24.220 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.221+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~33SFL6J05921.0 size=1048576 2024-09-12T00:42:24.222 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.225+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~33SFL6J05921.1 size=1048576 2024-09-12T00:42:24.225 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.229+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~33SFL6J05921.2 size=895887 2024-09-12T00:42:24.225 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.229+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=33SFL6J05921 tag=HGLZI0SNFODX type=write size=4041615 2024-09-12T00:42:24.228 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.229+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~3HGBB94O2G2I.0 size=1048576 2024-09-12T00:42:24.228 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.229+0000 7fcde98768c0 1 < canceled part key=_multipart_V80E1NH858IK.2~3HGBB94O2G2I.1 size=638703 2024-09-12T00:42:24.233 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.237+0000 7fcde98768c0 1 < canceled multipart upload key=V80E1NH858IK upload=3HGBB94O2G2I tag=HJY0I89Q3EWM type=write size=2735855 2024-09-12T00:42:24.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.237+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=LSV8TXJ2ZZDS type=write size=397651 2024-09-12T00:42:24.239 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.241+0000 7fcde98768c0 1 < completed delete operation key=G6R8BX1H7SPM tag=0NIDP80A0VUU type=del 2024-09-12T00:42:24.242 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.245+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=8Z8WLGVCGDRI type=del size=3824355 2024-09-12T00:42:24.245 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.249+0000 7fcde98768c0 1 < completed write operation key=JW2GNFAYFNEK tag=FGPI0EYZNJ9I type=write size=454477 2024-09-12T00:42:24.251 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.253+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~GVESEAR3ET72.0 size=1048576 2024-09-12T00:42:24.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.257+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~GVESEAR3ET72.1 size=185384 2024-09-12T00:42:24.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.257+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=GVESEAR3ET72 tag=HR7SIVA5EAV9 type=write size=2282536 2024-09-12T00:42:24.257 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.261+0000 7fcde98768c0 1 < completed delete operation key=WLE5QLNPAGZA tag=C0N9TPAFL6RZ type=del 2024-09-12T00:42:24.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.261+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=LXYWX6MY43Z0 type=del size=3158050 2024-09-12T00:42:24.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.265+0000 7fcde98768c0 1 < completed delete operation key=FUJIUIR1E00J tag=1M479YWB8FJU type=del 2024-09-12T00:42:24.266 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.269+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=B0AJAYPIFNKJ type=write size=479465 2024-09-12T00:42:24.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.273+0000 7fcde98768c0 1 < completed delete operation key=V80E1NH858IK tag=DFDW6GYUFGYB type=del 2024-09-12T00:42:24.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.277+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~6GQJY13C53NU.0 size=1048576 2024-09-12T00:42:24.277 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.281+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~6GQJY13C53NU.1 size=1048576 2024-09-12T00:42:24.280 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.281+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~6GQJY13C53NU.2 size=605604 2024-09-12T00:42:24.280 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.281+0000 7fcde98768c0 1 > prepared multipart upload key=EDFNLQYP4L4L upload=6GQJY13C53NU tag=KY1DUKMPY2OS type=write size=3751332 2024-09-12T00:42:24.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.285+0000 7fcde98768c0 1 < completed write operation key=JW2GNFAYFNEK tag=FPLSCUDZS9UG type=write size=692096 2024-09-12T00:42:24.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.289+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=F986I2KPGE64 type=write size=500012 2024-09-12T00:42:24.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.293+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~0DGCWSS91BPK.0 size=1048576 2024-09-12T00:42:24.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.293+0000 7fcde98768c0 1 < canceled part key=_multipart_5YBVLUYJW40U.2~0DGCWSS91BPK.1 size=1048576 2024-09-12T00:42:24.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.293+0000 7fcde98768c0 1 < canceled part key=_multipart_5YBVLUYJW40U.2~0DGCWSS91BPK.2 size=915472 2024-09-12T00:42:24.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.297+0000 7fcde98768c0 1 < canceled multipart upload key=5YBVLUYJW40U upload=0DGCWSS91BPK tag=XU3PTEWO7992 type=write size=4061200 2024-09-12T00:42:24.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.301+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=ZYX8HZN66BWD type=del size=2448973 2024-09-12T00:42:24.301 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.305+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~CQ802B6CCT6R.0 size=1048576 2024-09-12T00:42:24.303 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.305+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~CQ802B6CCT6R.1 size=1048576 2024-09-12T00:42:24.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.309+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~CQ802B6CCT6R.2 size=651280 2024-09-12T00:42:24.311 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.313+0000 7fcde98768c0 1 < completed multipart upload key=Z1PY2MFUC1C4 upload=CQ802B6CCT6R tag=R23SK2UJSBZU type=write size=3797008 2024-09-12T00:42:24.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.317+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=M5Q9GTFC719K type=del size=1892237 2024-09-12T00:42:24.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.321+0000 7fcde98768c0 1 < completed write operation key=RC9A2Y5TCP9C tag=SXXFDQPHHCZQ type=write size=17359 2024-09-12T00:42:24.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.325+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~4N1MCIS1DX1F.0 size=1048576 2024-09-12T00:42:24.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.329+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~4N1MCIS1DX1F.1 size=66882 2024-09-12T00:42:24.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.329+0000 7fcde98768c0 1 > prepared multipart upload key=3QOENE572J7A upload=4N1MCIS1DX1F tag=M9H45317552A type=write size=2164034 2024-09-12T00:42:24.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.333+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~7KR4PUH1L4YD.0 size=63 2024-09-12T00:42:24.334 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.337+0000 7fcde98768c0 1 < completed multipart upload key=ZQD0QXDN1J1I upload=7KR4PUH1L4YD tag=9DO12EPJDHJ4 type=write size=1048639 2024-09-12T00:42:24.340 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.341+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~1KTF9FW092CX.0 size=724930 2024-09-12T00:42:24.340 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.341+0000 7fcde98768c0 1 > prepared multipart upload key=HVE3YQTFZWTV upload=1KTF9FW092CX tag=Q39YD8W1TXVR type=write size=1773506 2024-09-12T00:42:24.344 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.345+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~023PPO1069JF.0 size=1048576 2024-09-12T00:42:24.346 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.349+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~023PPO1069JF.1 size=1048576 2024-09-12T00:42:24.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.353+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~023PPO1069JF.2 size=315139 2024-09-12T00:42:24.354 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.357+0000 7fcde98768c0 1 < completed multipart upload key=Z4RNDW37GEK6 upload=023PPO1069JF tag=WLSKL9TSNLAW type=write size=3460867 2024-09-12T00:42:24.357 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.361+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=58JTNMJLN8XY type=del size=4049185 2024-09-12T00:42:24.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.361+0000 7fcde98768c0 1 < completed write operation key=2T5IU2IUNGJX tag=ONPJPXIS9ZPN type=write size=129400 2024-09-12T00:42:24.365 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.369+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~WHBXK8ZJOC4N.0 size=548722 2024-09-12T00:42:24.365 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.369+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=WHBXK8ZJOC4N tag=LDDBCBT2CYP9 type=write size=1597298 2024-09-12T00:42:24.366 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.369+0000 7fcde98768c0 1 < canceled part key=_multipart_368TXYQVK9C3.2~0VU71YCT2QKD.0 size=1048576 2024-09-12T00:42:24.366 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.369+0000 7fcde98768c0 1 < canceled part key=_multipart_368TXYQVK9C3.2~0VU71YCT2QKD.1 size=1048576 2024-09-12T00:42:24.368 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.369+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~0VU71YCT2QKD.2 size=2819 2024-09-12T00:42:24.373 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.377+0000 7fcde98768c0 1 < canceled multipart upload key=368TXYQVK9C3 upload=0VU71YCT2QKD tag=IZF27FJJEFQG type=write size=3148547 2024-09-12T00:42:24.379 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.381+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~K7NY4R6AHOQ0.0 size=304193 2024-09-12T00:42:24.379 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.381+0000 7fcde98768c0 1 > prepared multipart upload key=NVOFV649MT0A upload=K7NY4R6AHOQ0 tag=140RH3XYPPTQ type=write size=1352769 2024-09-12T00:42:24.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.381+0000 7fcde98768c0 1 < canceled part key=_multipart_ZQD0QXDN1J1I.2~C3TASR00EYLN.0 size=1048576 2024-09-12T00:42:24.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.381+0000 7fcde98768c0 1 < canceled part key=_multipart_ZQD0QXDN1J1I.2~C3TASR00EYLN.1 size=428625 2024-09-12T00:42:24.384 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.389+0000 7fcde98768c0 1 < canceled multipart upload key=ZQD0QXDN1J1I upload=C3TASR00EYLN tag=Z6AV6MCU81GV type=write size=2525777 2024-09-12T00:42:24.387 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.389+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=XP0Q1QXH3SU1 type=del size=462202 2024-09-12T00:42:24.391 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.393+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~33SFL6J05921.0 size=1048576 2024-09-12T00:42:24.393 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.397+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~33SFL6J05921.1 size=1048576 2024-09-12T00:42:24.396 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.397+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~33SFL6J05921.2 size=895887 2024-09-12T00:42:24.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.405+0000 7fcde98768c0 1 < completed multipart upload key=V80E1NH858IK upload=33SFL6J05921 tag=HGLZI0SNFODX type=write size=4041615 2024-09-12T00:42:24.406 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.409+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~L1Z4A84ZMWYU.0 size=1048576 2024-09-12T00:42:24.413 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.417+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~L1Z4A84ZMWYU.1 size=1015891 2024-09-12T00:42:24.413 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.417+0000 7fcde98768c0 1 > prepared multipart upload key=3QOENE572J7A upload=L1Z4A84ZMWYU tag=W1QMTUCSRKB8 type=write size=3113043 2024-09-12T00:42:24.416 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.421+0000 7fcde98768c0 1 < completed write operation key=JW2GNFAYFNEK tag=LSV8TXJ2ZZDS type=write size=397651 2024-09-12T00:42:24.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.421+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=3RPI9J4W9GUG type=write size=836473 2024-09-12T00:42:24.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.429+0000 7fcde98768c0 1 < suggested remove operation key=IMITNCB1ST9E tag=8Z8WLGVCGDRI type=del 2024-09-12T00:42:24.429 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.433+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=BYD8NNZV4EPA type=del size=4097651 2024-09-12T00:42:24.432 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.437+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~GVESEAR3ET72.0 size=1048576 2024-09-12T00:42:24.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.437+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~GVESEAR3ET72.1 size=185384 2024-09-12T00:42:24.440 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.441+0000 7fcde98768c0 1 < completed multipart upload key=BZ4YUNTMOJBK upload=GVESEAR3ET72 tag=HR7SIVA5EAV9 type=write size=2282536 2024-09-12T00:42:24.446 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.449+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~0TT5SK1OM5PK.0 size=1048576 2024-09-12T00:42:24.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.449+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~0TT5SK1OM5PK.1 size=303675 2024-09-12T00:42:24.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.449+0000 7fcde98768c0 1 > prepared multipart upload key=368TXYQVK9C3 upload=0TT5SK1OM5PK tag=M1AQC41X12V0 type=write size=2400827 2024-09-12T00:42:24.452 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.453+0000 7fcde98768c0 1 < completed delete operation key=NVOFV649MT0A tag=LXYWX6MY43Z0 type=del 2024-09-12T00:42:24.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.461+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~QX4TQFMK4S2Y.0 size=901612 2024-09-12T00:42:24.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.461+0000 7fcde98768c0 1 > prepared multipart upload key=Z1PY2MFUC1C4 upload=QX4TQFMK4S2Y tag=3R43ETEPNJIX type=write size=1950188 2024-09-12T00:42:24.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.465+0000 7fcde98768c0 -1 < failed to complete operation key=IMITNCB1ST9E tag=B0AJAYPIFNKJ type=write size=479465: (22) Invalid argument 2024-09-12T00:42:24.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.465+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=J77KBLTOVKCO type=del size=3435260 2024-09-12T00:42:24.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.469+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~6GQJY13C53NU.0 size=1048576 2024-09-12T00:42:24.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.473+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~6GQJY13C53NU.1 size=1048576 2024-09-12T00:42:24.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.473+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~6GQJY13C53NU.2 size=605604 2024-09-12T00:42:24.477 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.481+0000 7fcde98768c0 1 < completed multipart upload key=EDFNLQYP4L4L upload=6GQJY13C53NU tag=KY1DUKMPY2OS type=write size=3751332 2024-09-12T00:42:24.480 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.485+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=X08LZOYMSAJH type=write size=999551 2024-09-12T00:42:24.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.489+0000 7fcde98768c0 1 < completed write operation key=4487IMSOLPDV tag=F986I2KPGE64 type=write size=500012 2024-09-12T00:42:24.491 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.493+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~L8NI6OIBY4S4.0 size=1048576 2024-09-12T00:42:24.493 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.497+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~L8NI6OIBY4S4.1 size=1048576 2024-09-12T00:42:24.496 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.497+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~L8NI6OIBY4S4.2 size=503183 2024-09-12T00:42:24.496 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.497+0000 7fcde98768c0 1 > prepared multipart upload key=368TXYQVK9C3 upload=L8NI6OIBY4S4 tag=157X7L66DANV type=write size=3648911 2024-09-12T00:42:24.499 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.501+0000 7fcde98768c0 1 < completed delete operation key=Z4RNDW37GEK6 tag=ZYX8HZN66BWD type=del 2024-09-12T00:42:24.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.505+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=WRQ50C0X6QYW type=del size=1795900 2024-09-12T00:42:24.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.509+0000 7fcde98768c0 1 < suggested remove operation key=F813QWV02TI0 tag=M5Q9GTFC719K type=del 2024-09-12T00:42:24.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.513+0000 7fcde98768c0 1 > prepared operation key=KME8ZTTUGOXY tag=NC7C2BDLNAFS type=del size=2495949 2024-09-12T00:42:24.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.517+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~4N1MCIS1DX1F.0 size=1048576 2024-09-12T00:42:24.518 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.521+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~4N1MCIS1DX1F.1 size=66882 2024-09-12T00:42:24.524 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.525+0000 7fcde98768c0 1 < completed multipart upload key=3QOENE572J7A upload=4N1MCIS1DX1F tag=M9H45317552A type=write size=2164034 2024-09-12T00:42:24.527 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.529+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=ZGUX6YZRMWY2 type=write size=906477 2024-09-12T00:42:24.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.533+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~1KTF9FW092CX.0 size=724930 2024-09-12T00:42:24.536 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.537+0000 7fcde98768c0 1 < completed multipart upload key=HVE3YQTFZWTV upload=1KTF9FW092CX tag=Q39YD8W1TXVR type=write size=1773506 2024-09-12T00:42:24.539 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.541+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=16E7K7QR1GYQ type=write size=780644 2024-09-12T00:42:24.542 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.545+0000 7fcde98768c0 1 < canceled operation key=5B8C6E8L5N52 tag=58JTNMJLN8XY type=del size=4049185 2024-09-12T00:42:24.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.549+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=HBHMDHV8WUOR type=write size=543999 2024-09-12T00:42:24.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.553+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~WHBXK8ZJOC4N.0 size=548722 2024-09-12T00:42:24.554 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.557+0000 7fcde98768c0 1 < completed multipart upload key=BZ4YUNTMOJBK upload=WHBXK8ZJOC4N tag=LDDBCBT2CYP9 type=write size=1597298 2024-09-12T00:42:24.557 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.561+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=XI2F503XK617 type=del size=784339 2024-09-12T00:42:24.560 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.561+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~K7NY4R6AHOQ0.0 size=304193 2024-09-12T00:42:24.565 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.569+0000 7fcde98768c0 1 < completed multipart upload key=NVOFV649MT0A upload=K7NY4R6AHOQ0 tag=140RH3XYPPTQ type=write size=1352769 2024-09-12T00:42:24.569 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.573+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=EZC3TQRXIIBO type=del size=3314105 2024-09-12T00:42:24.572 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.573+0000 7fcde98768c0 1 < canceled operation key=ZQD0QXDN1J1I tag=XP0Q1QXH3SU1 type=del size=462202 2024-09-12T00:42:24.575 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.577+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=3RWF74539REA type=write size=988131 2024-09-12T00:42:24.578 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.581+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~L1Z4A84ZMWYU.0 size=1048576 2024-09-12T00:42:24.581 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.585+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~L1Z4A84ZMWYU.1 size=1015891 2024-09-12T00:42:24.588 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.589+0000 7fcde98768c0 1 < completed multipart upload key=3QOENE572J7A upload=L1Z4A84ZMWYU tag=W1QMTUCSRKB8 type=write size=3113043 2024-09-12T00:42:24.592 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.593+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~D1BACLLF980S.0 size=1048576 2024-09-12T00:42:24.594 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.597+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~D1BACLLF980S.1 size=1048576 2024-09-12T00:42:24.598 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.601+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~D1BACLLF980S.2 size=575808 2024-09-12T00:42:24.598 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.601+0000 7fcde98768c0 1 > prepared multipart upload key=97030NBF3MI4 upload=D1BACLLF980S tag=B6MHZJSPP8JL type=write size=3721536 2024-09-12T00:42:24.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.605+0000 7fcde98768c0 -1 < failed to complete operation key=F813QWV02TI0 tag=3RPI9J4W9GUG type=write size=836473: (22) Invalid argument 2024-09-12T00:42:24.606 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.609+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~70AY0MUKGLNT.0 size=124803 2024-09-12T00:42:24.606 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.609+0000 7fcde98768c0 1 > prepared multipart upload key=TUMAMUZUIR7E upload=70AY0MUKGLNT tag=QZPMMKK83RGT type=write size=1173379 2024-09-12T00:42:24.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.613+0000 7fcde98768c0 1 < completed delete operation key=368TXYQVK9C3 tag=BYD8NNZV4EPA type=del 2024-09-12T00:42:24.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.617+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~9AGQNGZVTLRD.0 size=1048576 2024-09-12T00:42:24.616 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.617+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~9AGQNGZVTLRD.1 size=1048576 2024-09-12T00:42:24.619 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.621+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~9AGQNGZVTLRD.2 size=225082 2024-09-12T00:42:24.619 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.621+0000 7fcde98768c0 1 > prepared multipart upload key=Z1PY2MFUC1C4 upload=9AGQNGZVTLRD tag=9STAQPE32NL0 type=write size=3370810 2024-09-12T00:42:24.622 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.625+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~0TT5SK1OM5PK.0 size=1048576 2024-09-12T00:42:24.624 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.629+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~0TT5SK1OM5PK.1 size=303675 2024-09-12T00:42:24.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.633+0000 7fcde98768c0 1 < completed multipart upload key=368TXYQVK9C3 upload=0TT5SK1OM5PK tag=M1AQC41X12V0 type=write size=2400827 2024-09-12T00:42:24.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.637+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=CCNFFM5BUXTM type=del size=3362124 2024-09-12T00:42:24.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.637+0000 7fcde98768c0 1 < canceled part key=_multipart_Z1PY2MFUC1C4.2~QX4TQFMK4S2Y.0 size=901612 2024-09-12T00:42:24.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.641+0000 7fcde98768c0 1 < canceled multipart upload key=Z1PY2MFUC1C4 upload=QX4TQFMK4S2Y tag=3R43ETEPNJIX type=write size=1950188 2024-09-12T00:42:24.644 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.645+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~39KKH8FZUBZW.0 size=144837 2024-09-12T00:42:24.644 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.645+0000 7fcde98768c0 1 > prepared multipart upload key=JW2GNFAYFNEK upload=39KKH8FZUBZW tag=TZEB2MQF0I22 type=write size=1193413 2024-09-12T00:42:24.647 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.649+0000 7fcde98768c0 1 < completed delete operation key=5YBVLUYJW40U tag=J77KBLTOVKCO type=del 2024-09-12T00:42:24.650 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.653+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=1CVLNL5U0JQ0 type=del size=3451853 2024-09-12T00:42:24.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.657+0000 7fcde98768c0 1 < completed write operation key=IV4JCE1QJC70 tag=X08LZOYMSAJH type=write size=999551 2024-09-12T00:42:24.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.661+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~9OHSI32L0I2D.0 size=1048576 2024-09-12T00:42:24.660 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.661+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~9OHSI32L0I2D.1 size=1048576 2024-09-12T00:42:24.662 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.665+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~9OHSI32L0I2D.2 size=946389 2024-09-12T00:42:24.662 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.665+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=9OHSI32L0I2D tag=LI82T767PSBQ type=write size=4092117 2024-09-12T00:42:24.665 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.669+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~L8NI6OIBY4S4.0 size=1048576 2024-09-12T00:42:24.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.669+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~L8NI6OIBY4S4.1 size=1048576 2024-09-12T00:42:24.670 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.673+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~L8NI6OIBY4S4.2 size=503183 2024-09-12T00:42:24.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.677+0000 7fcde98768c0 1 < completed multipart upload key=368TXYQVK9C3 upload=L8NI6OIBY4S4 tag=157X7L66DANV type=write size=3648911 2024-09-12T00:42:24.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.681+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=PMGRH0I1A2LL type=del size=2256673 2024-09-12T00:42:24.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.685+0000 7fcde98768c0 1 < canceled operation key=NVOFV649MT0A tag=WRQ50C0X6QYW type=del size=1795900 2024-09-12T00:42:24.685 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.689+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=BQPWLD4URHVE type=write size=631435 2024-09-12T00:42:24.690 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.693+0000 7fcde98768c0 1 < suggested remove operation key=KME8ZTTUGOXY tag=NC7C2BDLNAFS type=del 2024-09-12T00:42:24.694 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.697+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~EDZEPLW2JUH7.0 size=1048576 2024-09-12T00:42:24.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.697+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~EDZEPLW2JUH7.1 size=1048576 2024-09-12T00:42:24.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.701+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~EDZEPLW2JUH7.2 size=700026 2024-09-12T00:42:24.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.701+0000 7fcde98768c0 1 > prepared multipart upload key=J9EUM073CZHF upload=EDZEPLW2JUH7 tag=ZFRN63H7AF35 type=write size=3845754 2024-09-12T00:42:24.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.709+0000 7fcde98768c0 1 < suggested remove operation key=QD5JXFL962R5 tag=ZGUX6YZRMWY2 type=write 2024-09-12T00:42:24.708 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.713+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~1G0C81QYIF3X.0 size=1048576 2024-09-12T00:42:24.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.713+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~1G0C81QYIF3X.1 size=1048576 2024-09-12T00:42:24.712 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.713+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~1G0C81QYIF3X.2 size=68055 2024-09-12T00:42:24.712 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.713+0000 7fcde98768c0 1 > prepared multipart upload key=KME8ZTTUGOXY upload=1G0C81QYIF3X tag=BWZCIU8TFCYV type=write size=3213783 2024-09-12T00:42:24.714 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.717+0000 7fcde98768c0 1 < completed write operation key=4487IMSOLPDV tag=16E7K7QR1GYQ type=write size=780644 2024-09-12T00:42:24.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.721+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=KABWU1HV78FX type=del size=3086379 2024-09-12T00:42:24.721 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.725+0000 7fcde98768c0 1 < suggested remove operation key=3X9I78PMR1HV tag=HBHMDHV8WUOR type=write 2024-09-12T00:42:24.725 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.729+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~2C62P3A6Y6CO.0 size=1048576 2024-09-12T00:42:24.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.729+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~2C62P3A6Y6CO.1 size=1048576 2024-09-12T00:42:24.729 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.733+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~2C62P3A6Y6CO.2 size=46048 2024-09-12T00:42:24.729 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.733+0000 7fcde98768c0 1 > prepared multipart upload key=7UR0FX8HA2A5 upload=2C62P3A6Y6CO tag=SQX3JN2JWFGI type=write size=3191776 2024-09-12T00:42:24.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.733+0000 7fcde98768c0 1 < completed delete operation key=IMITNCB1ST9E tag=XI2F503XK617 type=del 2024-09-12T00:42:24.734 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.737+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=YDJU85K2QFN7 type=del size=31947 2024-09-12T00:42:24.737 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.741+0000 7fcde98768c0 1 < completed delete operation key=Z4RNDW37GEK6 tag=EZC3TQRXIIBO type=del 2024-09-12T00:42:24.741 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.745+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~3J83PZCOCO58.0 size=1048576 2024-09-12T00:42:24.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.745+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~3J83PZCOCO58.1 size=983486 2024-09-12T00:42:24.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.745+0000 7fcde98768c0 1 > prepared multipart upload key=EDFNLQYP4L4L upload=3J83PZCOCO58 tag=TMK7UUNLN3S2 type=write size=3080638 2024-09-12T00:42:24.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.749+0000 7fcde98768c0 1 < completed write operation key=IV4JCE1QJC70 tag=3RWF74539REA type=write size=988131 2024-09-12T00:42:24.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.749+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=00JW98QJ1J91 type=write size=861245 2024-09-12T00:42:24.751 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.753+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~D1BACLLF980S.0 size=1048576 2024-09-12T00:42:24.753 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.757+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~D1BACLLF980S.1 size=1048576 2024-09-12T00:42:24.755 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.757+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~D1BACLLF980S.2 size=575808 2024-09-12T00:42:24.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.761+0000 7fcde98768c0 1 < completed multipart upload key=97030NBF3MI4 upload=D1BACLLF980S tag=B6MHZJSPP8JL type=write size=3721536 2024-09-12T00:42:24.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.765+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~DZ6C1T2NKIQY.0 size=1048576 2024-09-12T00:42:24.765 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.769+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~DZ6C1T2NKIQY.1 size=565190 2024-09-12T00:42:24.765 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.769+0000 7fcde98768c0 1 > prepared multipart upload key=EDFNLQYP4L4L upload=DZ6C1T2NKIQY tag=E889WSMHQFGF type=write size=2662342 2024-09-12T00:42:24.768 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.769+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~70AY0MUKGLNT.0 size=124803 2024-09-12T00:42:24.772 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.773+0000 7fcde98768c0 1 < completed multipart upload key=TUMAMUZUIR7E upload=70AY0MUKGLNT tag=QZPMMKK83RGT type=write size=1173379 2024-09-12T00:42:24.774 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.777+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=RZ3VK485HFHU type=del size=3180189 2024-09-12T00:42:24.777 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.781+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~9AGQNGZVTLRD.0 size=1048576 2024-09-12T00:42:24.779 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.781+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~9AGQNGZVTLRD.1 size=1048576 2024-09-12T00:42:24.782 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.785+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~9AGQNGZVTLRD.2 size=225082 2024-09-12T00:42:24.786 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.789+0000 7fcde98768c0 1 < completed multipart upload key=Z1PY2MFUC1C4 upload=9AGQNGZVTLRD tag=9STAQPE32NL0 type=write size=3370810 2024-09-12T00:42:24.789 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.793+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=ZHZ8Z4AK73T0 type=del size=373093 2024-09-12T00:42:24.791 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.793+0000 7fcde98768c0 1 < canceled operation key=NVOFV649MT0A tag=CCNFFM5BUXTM type=del size=3362124 2024-09-12T00:42:24.796 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.797+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~KBAK306VF4AQ.0 size=1048576 2024-09-12T00:42:24.798 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.801+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~KBAK306VF4AQ.1 size=1048576 2024-09-12T00:42:24.800 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.801+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~KBAK306VF4AQ.2 size=697517 2024-09-12T00:42:24.800 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.801+0000 7fcde98768c0 1 > prepared multipart upload key=ZQD0QXDN1J1I upload=KBAK306VF4AQ tag=ASFATL2OY83H type=write size=3843245 2024-09-12T00:42:24.802 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.805+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~39KKH8FZUBZW.0 size=144837 2024-09-12T00:42:24.806 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.809+0000 7fcde98768c0 1 < completed multipart upload key=JW2GNFAYFNEK upload=39KKH8FZUBZW tag=TZEB2MQF0I22 type=write size=1193413 2024-09-12T00:42:24.811 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.813+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~3JQI91ZSMGRN.0 size=1048576 2024-09-12T00:42:24.813 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.817+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~3JQI91ZSMGRN.1 size=1048576 2024-09-12T00:42:24.814 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.817+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~3JQI91ZSMGRN.2 size=145945 2024-09-12T00:42:24.814 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.817+0000 7fcde98768c0 1 > prepared multipart upload key=TUMAMUZUIR7E upload=3JQI91ZSMGRN tag=8E7MJ5KQX47C type=write size=3291673 2024-09-12T00:42:24.817 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.821+0000 7fcde98768c0 1 < completed delete operation key=FUJIUIR1E00J tag=1CVLNL5U0JQ0 type=del 2024-09-12T00:42:24.819 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.821+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=HC4V1QOLHGLB type=write size=631399 2024-09-12T00:42:24.823 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.825+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~9OHSI32L0I2D.0 size=1048576 2024-09-12T00:42:24.825 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.829+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~9OHSI32L0I2D.1 size=1048576 2024-09-12T00:42:24.828 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.829+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~9OHSI32L0I2D.2 size=946389 2024-09-12T00:42:24.832 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.837+0000 7fcde98768c0 1 < completed multipart upload key=IV4JCE1QJC70 upload=9OHSI32L0I2D tag=LI82T767PSBQ type=write size=4092117 2024-09-12T00:42:24.838 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.841+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~81AWAOGET3HR.0 size=1048576 2024-09-12T00:42:24.840 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.841+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~81AWAOGET3HR.1 size=106978 2024-09-12T00:42:24.840 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.841+0000 7fcde98768c0 1 > prepared multipart upload key=5YBVLUYJW40U upload=81AWAOGET3HR tag=L8506TMGS572 type=write size=2204130 2024-09-12T00:42:24.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.845+0000 7fcde98768c0 1 < completed delete operation key=F813QWV02TI0 tag=PMGRH0I1A2LL type=del 2024-09-12T00:42:24.846 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.849+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=ZGFYPEE28213 type=del size=1916272 2024-09-12T00:42:24.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.853+0000 7fcde98768c0 1 < completed write operation key=WLE5QLNPAGZA tag=BQPWLD4URHVE type=write size=631435 2024-09-12T00:42:24.853 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.857+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~0206L2EPIV9Q.0 size=1048576 2024-09-12T00:42:24.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.857+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~0206L2EPIV9Q.1 size=331110 2024-09-12T00:42:24.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.857+0000 7fcde98768c0 1 > prepared multipart upload key=JW2GNFAYFNEK upload=0206L2EPIV9Q tag=HK2VRJSUKK55 type=write size=2428262 2024-09-12T00:42:24.857 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.861+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~EDZEPLW2JUH7.0 size=1048576 2024-09-12T00:42:24.859 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.861+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~EDZEPLW2JUH7.1 size=1048576 2024-09-12T00:42:24.861 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.865+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~EDZEPLW2JUH7.2 size=700026 2024-09-12T00:42:24.865 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.869+0000 7fcde98768c0 1 < completed multipart upload key=J9EUM073CZHF upload=EDZEPLW2JUH7 tag=ZFRN63H7AF35 type=write size=3845754 2024-09-12T00:42:24.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.869+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=2YM2CQTFN9X0 type=del size=1169779 2024-09-12T00:42:24.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.873+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~1G0C81QYIF3X.0 size=1048576 2024-09-12T00:42:24.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.877+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~1G0C81QYIF3X.1 size=1048576 2024-09-12T00:42:24.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.877+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~1G0C81QYIF3X.2 size=68055 2024-09-12T00:42:24.879 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.881+0000 7fcde98768c0 1 < completed multipart upload key=KME8ZTTUGOXY upload=1G0C81QYIF3X tag=BWZCIU8TFCYV type=write size=3213783 2024-09-12T00:42:24.881 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.885+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=R636PMJI6TQ3 type=del size=3848992 2024-09-12T00:42:24.886 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.889+0000 7fcde98768c0 1 < suggested update operation key=3QOENE572J7A tag=KABWU1HV78FX type=del size=3086379 2024-09-12T00:42:24.889 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.893+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=PBH89V1G5165 type=del size=1402945 2024-09-12T00:42:24.892 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.893+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~2C62P3A6Y6CO.0 size=1048576 2024-09-12T00:42:24.894 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.897+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~2C62P3A6Y6CO.1 size=1048576 2024-09-12T00:42:24.896 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.897+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~2C62P3A6Y6CO.2 size=46048 2024-09-12T00:42:24.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.901+0000 7fcde98768c0 1 < completed multipart upload key=7UR0FX8HA2A5 upload=2C62P3A6Y6CO tag=SQX3JN2JWFGI type=write size=3191776 2024-09-12T00:42:24.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.905+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=6FRMG4D7ISUS type=del size=927073 2024-09-12T00:42:24.905 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.909+0000 7fcde98768c0 1 < completed delete operation key=V80E1NH858IK tag=YDJU85K2QFN7 type=del 2024-09-12T00:42:24.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.909+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=ANKRDLW31H89 type=del size=264240 2024-09-12T00:42:24.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.913+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~3J83PZCOCO58.0 size=1048576 2024-09-12T00:42:24.912 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.913+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~3J83PZCOCO58.1 size=983486 2024-09-12T00:42:24.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.921+0000 7fcde98768c0 1 < completed multipart upload key=EDFNLQYP4L4L upload=3J83PZCOCO58 tag=TMK7UUNLN3S2 type=write size=3080638 2024-09-12T00:42:24.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.921+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=27WSCPX5YHGR type=del size=2122319 2024-09-12T00:42:24.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.925+0000 7fcde98768c0 1 < completed write operation key=G6R8BX1H7SPM tag=00JW98QJ1J91 type=write size=861245 2024-09-12T00:42:24.926 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.929+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=0L9OWS2Y92TH type=del size=207306 2024-09-12T00:42:24.926 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.929+0000 7fcde98768c0 1 < canceled part key=_multipart_EDFNLQYP4L4L.2~DZ6C1T2NKIQY.0 size=1048576 2024-09-12T00:42:24.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.933+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~DZ6C1T2NKIQY.1 size=565190 2024-09-12T00:42:24.936 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.937+0000 7fcde98768c0 1 < canceled multipart upload key=EDFNLQYP4L4L upload=DZ6C1T2NKIQY tag=E889WSMHQFGF type=write size=2662342 2024-09-12T00:42:24.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.945+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~MZV2SB9R04TC.0 size=1048576 2024-09-12T00:42:24.944 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.945+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~MZV2SB9R04TC.1 size=1008532 2024-09-12T00:42:24.944 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.945+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=MZV2SB9R04TC tag=V79653H51T1F type=write size=3105684 2024-09-12T00:42:24.946 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.949+0000 7fcde98768c0 1 < completed delete operation key=TUMAMUZUIR7E tag=RZ3VK485HFHU type=del 2024-09-12T00:42:24.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.953+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~5467OSGH9P2A.0 size=156306 2024-09-12T00:42:24.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.953+0000 7fcde98768c0 1 > prepared multipart upload key=KME8ZTTUGOXY upload=5467OSGH9P2A tag=VJUL6L9AC7Y4 type=write size=1204882 2024-09-12T00:42:24.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.957+0000 7fcde98768c0 1 < completed delete operation key=R2EBH0Q5885L tag=ZHZ8Z4AK73T0 type=del 2024-09-12T00:42:24.957 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.961+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=XKPAHE8MV7XW type=del size=2917494 2024-09-12T00:42:24.961 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.965+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~KBAK306VF4AQ.0 size=1048576 2024-09-12T00:42:24.961 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.965+0000 7fcde98768c0 1 < canceled part key=_multipart_ZQD0QXDN1J1I.2~KBAK306VF4AQ.1 size=1048576 2024-09-12T00:42:24.963 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.965+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~KBAK306VF4AQ.2 size=697517 2024-09-12T00:42:24.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.969+0000 7fcde98768c0 1 < canceled multipart upload key=ZQD0QXDN1J1I upload=KBAK306VF4AQ tag=ASFATL2OY83H type=write size=3843245 2024-09-12T00:42:24.970 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.973+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=QXLF00O2Y0WB type=write size=787159 2024-09-12T00:42:24.971 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.973+0000 7fcde98768c0 1 < canceled part key=_multipart_TUMAMUZUIR7E.2~3JQI91ZSMGRN.0 size=1048576 2024-09-12T00:42:24.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.977+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~3JQI91ZSMGRN.1 size=1048576 2024-09-12T00:42:24.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.977+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~3JQI91ZSMGRN.2 size=145945 2024-09-12T00:42:24.980 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.985+0000 7fcde98768c0 1 < canceled multipart upload key=TUMAMUZUIR7E upload=3JQI91ZSMGRN tag=8E7MJ5KQX47C type=write size=3291673 2024-09-12T00:42:24.984 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.985+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=QJDRS9VEMUKP type=write size=260441 2024-09-12T00:42:24.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.989+0000 7fcde98768c0 1 < completed write operation key=EDFNLQYP4L4L tag=HC4V1QOLHGLB type=write size=631399 2024-09-12T00:42:24.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.993+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=PK4UL8A6AQQI type=del size=3585242 2024-09-12T00:42:24.994 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:24.997+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~81AWAOGET3HR.0 size=1048576 2024-09-12T00:42:24.996 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.001+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~81AWAOGET3HR.1 size=106978 2024-09-12T00:42:25.002 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.005+0000 7fcde98768c0 1 < completed multipart upload key=5YBVLUYJW40U upload=81AWAOGET3HR tag=L8506TMGS572 type=write size=2204130 2024-09-12T00:42:25.005 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.009+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=UKRE9OENS1MV type=del size=1411498 2024-09-12T00:42:25.008 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.009+0000 7fcde98768c0 1 < completed delete operation key=BZ4YUNTMOJBK tag=ZGFYPEE28213 type=del 2024-09-12T00:42:25.011 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.013+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=4AQESRP56WT4 type=del size=1112679 2024-09-12T00:42:25.015 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.017+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~0206L2EPIV9Q.0 size=1048576 2024-09-12T00:42:25.018 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.021+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~0206L2EPIV9Q.1 size=331110 2024-09-12T00:42:25.024 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.025+0000 7fcde98768c0 1 < completed multipart upload key=JW2GNFAYFNEK upload=0206L2EPIV9Q tag=HK2VRJSUKK55 type=write size=2428262 2024-09-12T00:42:25.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.029+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=THGPIDSYR3JA type=del size=1026708 2024-09-12T00:42:25.031 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.033+0000 7fcde98768c0 1 < canceled operation key=3X9I78PMR1HV tag=2YM2CQTFN9X0 type=del size=1169779 2024-09-12T00:42:25.034 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.037+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=0P6DNK1J4R73 type=del size=2775919 2024-09-12T00:42:25.037 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.041+0000 7fcde98768c0 1 < completed delete operation key=QD5JXFL962R5 tag=R636PMJI6TQ3 type=del 2024-09-12T00:42:25.044 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.045+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~KYWNMEVE081K.0 size=314412 2024-09-12T00:42:25.044 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.045+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=KYWNMEVE081K tag=0AZ6E3UYZUVT type=write size=1362988 2024-09-12T00:42:25.047 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.049+0000 7fcde98768c0 1 < completed delete operation key=Z1PY2MFUC1C4 tag=PBH89V1G5165 type=del 2024-09-12T00:42:25.050 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.053+0000 7fcde98768c0 1 > prepared operation key=KME8ZTTUGOXY tag=13M895VFZIAG type=del size=2065346 2024-09-12T00:42:25.057 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.057+0000 7fcde98768c0 1 < completed delete operation key=IV4JCE1QJC70 tag=6FRMG4D7ISUS type=del 2024-09-12T00:42:25.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.061+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~81UPEQSQ9K0S.0 size=1048576 2024-09-12T00:42:25.062 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.065+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~81UPEQSQ9K0S.1 size=1048576 2024-09-12T00:42:25.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.069+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~81UPEQSQ9K0S.2 size=865376 2024-09-12T00:42:25.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.069+0000 7fcde98768c0 1 > prepared multipart upload key=KME8ZTTUGOXY upload=81UPEQSQ9K0S tag=GM62CR93RI3J type=write size=4011104 2024-09-12T00:42:25.067 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.069+0000 7fcde98768c0 1 < completed delete operation key=ZQD0QXDN1J1I tag=ANKRDLW31H89 type=del 2024-09-12T00:42:25.070 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.073+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=H604K6C4FU8L type=write size=204030 2024-09-12T00:42:25.074 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.077+0000 7fcde98768c0 1 < completed delete operation key=BZ4YUNTMOJBK tag=27WSCPX5YHGR type=del 2024-09-12T00:42:25.077 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.081+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=3EDATVDWCMQD type=del size=30410 2024-09-12T00:42:25.080 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.081+0000 7fcde98768c0 1 < completed delete operation key=WLE5QLNPAGZA tag=0L9OWS2Y92TH type=del 2024-09-12T00:42:25.084 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.085+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=XZLPFZA3G7B4 type=del size=3640266 2024-09-12T00:42:25.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.089+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~MZV2SB9R04TC.0 size=1048576 2024-09-12T00:42:25.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.093+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~MZV2SB9R04TC.1 size=1008532 2024-09-12T00:42:25.094 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.097+0000 7fcde98768c0 1 < completed multipart upload key=IV4JCE1QJC70 upload=MZV2SB9R04TC tag=V79653H51T1F type=write size=3105684 2024-09-12T00:42:25.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.101+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=7KK96H02ZXM2 type=del size=3499454 2024-09-12T00:42:25.101 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.105+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~5467OSGH9P2A.0 size=156306 2024-09-12T00:42:25.106 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.109+0000 7fcde98768c0 1 < completed multipart upload key=KME8ZTTUGOXY upload=5467OSGH9P2A tag=VJUL6L9AC7Y4 type=write size=1204882 2024-09-12T00:42:25.109 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.113+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=T707YFRVK66J type=del size=1207692 2024-09-12T00:42:25.112 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.117+0000 7fcde98768c0 1 < completed delete operation key=IV4JCE1QJC70 tag=XKPAHE8MV7XW type=del 2024-09-12T00:42:25.116 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.117+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=6EQSXXLNVEG1 type=del size=243372 2024-09-12T00:42:25.119 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.121+0000 7fcde98768c0 1 < completed write operation key=G6R8BX1H7SPM tag=QXLF00O2Y0WB type=write size=787159 2024-09-12T00:42:25.125 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.129+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~W4MWLMX6FP3P.0 size=1048576 2024-09-12T00:42:25.128 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.129+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~W4MWLMX6FP3P.1 size=1048576 2024-09-12T00:42:25.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.133+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~W4MWLMX6FP3P.2 size=1032617 2024-09-12T00:42:25.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.133+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=W4MWLMX6FP3P tag=3WISNXVSLYTS type=write size=4178345 2024-09-12T00:42:25.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.137+0000 7fcde98768c0 1 < completed write operation key=TUMAMUZUIR7E tag=QJDRS9VEMUKP type=write size=260441 2024-09-12T00:42:25.136 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.137+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=62JL8TVEGE14 type=del size=1957467 2024-09-12T00:42:25.139 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.141+0000 7fcde98768c0 1 < completed delete operation key=QD5JXFL962R5 tag=PK4UL8A6AQQI type=del 2024-09-12T00:42:25.145 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.149+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~URYYD5LNYRSV.0 size=658028 2024-09-12T00:42:25.146 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.149+0000 7fcde98768c0 1 > prepared multipart upload key=368TXYQVK9C3 upload=URYYD5LNYRSV tag=4TP2HGRKVI1U type=write size=1706604 2024-09-12T00:42:25.152 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.153+0000 7fcde98768c0 1 < suggested update operation key=WLE5QLNPAGZA tag=UKRE9OENS1MV type=del size=1411498 2024-09-12T00:42:25.157 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.161+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~R0H3CNTJDRCC.0 size=1048576 2024-09-12T00:42:25.160 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.161+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~R0H3CNTJDRCC.1 size=549895 2024-09-12T00:42:25.160 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.161+0000 7fcde98768c0 1 > prepared multipart upload key=5B8C6E8L5N52 upload=R0H3CNTJDRCC tag=DNMYN37V2ESD type=write size=2647047 2024-09-12T00:42:25.166 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.169+0000 7fcde98768c0 1 < suggested remove operation key=2T5IU2IUNGJX tag=4AQESRP56WT4 type=del 2024-09-12T00:42:25.169 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.173+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=KCT1I4ESX5H0 type=del size=2195261 2024-09-12T00:42:25.172 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.173+0000 7fcde98768c0 1 < completed delete operation key=F813QWV02TI0 tag=THGPIDSYR3JA type=del 2024-09-12T00:42:25.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.177+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=KCXXB3LMZAH4 type=del size=1762185 2024-09-12T00:42:25.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.181+0000 7fcde98768c0 1 < completed delete operation key=J9EUM073CZHF tag=0P6DNK1J4R73 type=del 2024-09-12T00:42:25.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.189+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~1H32IMHQ7K32.0 size=720933 2024-09-12T00:42:25.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.189+0000 7fcde98768c0 1 > prepared multipart upload key=Z4RNDW37GEK6 upload=1H32IMHQ7K32 tag=PEPTROILC7PY type=write size=1769509 2024-09-12T00:42:25.189 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.193+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~KYWNMEVE081K.0 size=314412 2024-09-12T00:42:25.195 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.197+0000 7fcde98768c0 1 < completed multipart upload key=IV4JCE1QJC70 upload=KYWNMEVE081K tag=0AZ6E3UYZUVT type=write size=1362988 2024-09-12T00:42:25.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.201+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~6D4B2LGI0RHU.0 size=1048576 2024-09-12T00:42:25.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.205+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~6D4B2LGI0RHU.1 size=1048576 2024-09-12T00:42:25.205 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.209+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~6D4B2LGI0RHU.2 size=1020214 2024-09-12T00:42:25.205 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.209+0000 7fcde98768c0 1 > prepared multipart upload key=3QOENE572J7A upload=6D4B2LGI0RHU tag=N7YEZ0740CK3 type=write size=4165942 2024-09-12T00:42:25.209 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.213+0000 7fcde98768c0 1 < completed delete operation key=KME8ZTTUGOXY tag=13M895VFZIAG type=del 2024-09-12T00:42:25.212 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.217+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=ESK8DAS3620A type=del size=3653229 2024-09-12T00:42:25.216 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.217+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~81UPEQSQ9K0S.0 size=1048576 2024-09-12T00:42:25.218 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.221+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~81UPEQSQ9K0S.1 size=1048576 2024-09-12T00:42:25.221 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.225+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~81UPEQSQ9K0S.2 size=865376 2024-09-12T00:42:25.227 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.229+0000 7fcde98768c0 1 < completed multipart upload key=KME8ZTTUGOXY upload=81UPEQSQ9K0S tag=GM62CR93RI3J type=write size=4011104 2024-09-12T00:42:25.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.237+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~ANZXLTBPNHQW.0 size=723396 2024-09-12T00:42:25.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.241+0000 7fcde98768c0 1 > prepared multipart upload key=WLE5QLNPAGZA upload=ANZXLTBPNHQW tag=A1L9RL8ME70Y type=write size=1771972 2024-09-12T00:42:25.240 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.241+0000 7fcde98768c0 1 < completed write operation key=7UR0FX8HA2A5 tag=H604K6C4FU8L type=write size=204030 2024-09-12T00:42:25.244 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.245+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=M0VHAQWJ7VHL type=del size=3069269 2024-09-12T00:42:25.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.249+0000 7fcde98768c0 -1 < failed to complete operation key=2T5IU2IUNGJX tag=3EDATVDWCMQD type=del size=30410: (22) Invalid argument 2024-09-12T00:42:25.249 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.253+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=CL71T62XYDTZ type=write size=636046 2024-09-12T00:42:25.252 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.253+0000 7fcde98768c0 1 < completed delete operation key=QD5JXFL962R5 tag=XZLPFZA3G7B4 type=del 2024-09-12T00:42:25.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.257+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=HE8NDB606WAK type=del size=267409 2024-09-12T00:42:25.258 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.261+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=7KK96H02ZXM2 type=del 2024-09-12T00:42:25.264 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.265+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~08LPMHA2VMHE.0 size=1048576 2024-09-12T00:42:25.266 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.269+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~08LPMHA2VMHE.1 size=1048576 2024-09-12T00:42:25.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.269+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~08LPMHA2VMHE.2 size=1032851 2024-09-12T00:42:25.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.269+0000 7fcde98768c0 1 > prepared multipart upload key=R2EBH0Q5885L upload=08LPMHA2VMHE tag=3XWLD14DRGC6 type=write size=4178579 2024-09-12T00:42:25.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.277+0000 7fcde98768c0 1 < suggested remove operation key=RC9A2Y5TCP9C tag=T707YFRVK66J type=del 2024-09-12T00:42:25.277 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.281+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=TL11FI2ME1DD type=write size=663798 2024-09-12T00:42:25.280 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.285+0000 7fcde98768c0 1 < completed delete operation key=3QOENE572J7A tag=6EQSXXLNVEG1 type=del 2024-09-12T00:42:25.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.285+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=2KUMJW7CWC55 type=del size=2549997 2024-09-12T00:42:25.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.289+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~W4MWLMX6FP3P.0 size=1048576 2024-09-12T00:42:25.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.293+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~W4MWLMX6FP3P.1 size=1048576 2024-09-12T00:42:25.292 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.293+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~W4MWLMX6FP3P.2 size=1032617 2024-09-12T00:42:25.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.301+0000 7fcde98768c0 1 < completed multipart upload key=BZ4YUNTMOJBK upload=W4MWLMX6FP3P tag=3WISNXVSLYTS type=write size=4178345 2024-09-12T00:42:25.302 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.305+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~BF93ONB5IGAP.0 size=1048576 2024-09-12T00:42:25.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.309+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~BF93ONB5IGAP.1 size=1048576 2024-09-12T00:42:25.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.309+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~BF93ONB5IGAP.2 size=922721 2024-09-12T00:42:25.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.309+0000 7fcde98768c0 1 > prepared multipart upload key=5B8C6E8L5N52 upload=BF93ONB5IGAP tag=O1ZEFD4K7F8G type=write size=4068449 2024-09-12T00:42:25.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.313+0000 7fcde98768c0 -1 < failed to complete operation key=WLE5QLNPAGZA tag=62JL8TVEGE14 type=del size=1957467: (22) Invalid argument 2024-09-12T00:42:25.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.317+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=ALNQX92B069H type=del size=3003018 2024-09-12T00:42:25.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.321+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~URYYD5LNYRSV.0 size=658028 2024-09-12T00:42:25.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.325+0000 7fcde98768c0 1 < completed multipart upload key=368TXYQVK9C3 upload=URYYD5LNYRSV tag=4TP2HGRKVI1U type=write size=1706604 2024-09-12T00:42:25.325 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.329+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=6XCI4VNAP39D type=del size=1662518 2024-09-12T00:42:25.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.329+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~R0H3CNTJDRCC.0 size=1048576 2024-09-12T00:42:25.330 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.333+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~R0H3CNTJDRCC.1 size=549895 2024-09-12T00:42:25.335 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.337+0000 7fcde98768c0 1 < completed multipart upload key=5B8C6E8L5N52 upload=R0H3CNTJDRCC tag=DNMYN37V2ESD type=write size=2647047 2024-09-12T00:42:25.338 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.341+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=D63PCC0A4E5M type=del size=2887329 2024-09-12T00:42:25.344 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.345+0000 7fcde98768c0 1 < suggested remove operation key=JW2GNFAYFNEK tag=KCT1I4ESX5H0 type=del 2024-09-12T00:42:25.347 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.349+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=NC5IGR4OIDMF type=del size=1668216 2024-09-12T00:42:25.350 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.353+0000 7fcde98768c0 1 < completed delete operation key=J9EUM073CZHF tag=KCXXB3LMZAH4 type=del 2024-09-12T00:42:25.353 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.357+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=1E8UVTK7VWZ2 type=write size=133708 2024-09-12T00:42:25.357 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.361+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~1H32IMHQ7K32.0 size=720933 2024-09-12T00:42:25.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.365+0000 7fcde98768c0 1 < completed multipart upload key=Z4RNDW37GEK6 upload=1H32IMHQ7K32 tag=PEPTROILC7PY type=write size=1769509 2024-09-12T00:42:25.368 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.369+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~0K502HYFHOIY.0 size=1048576 2024-09-12T00:42:25.370 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.373+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~0K502HYFHOIY.1 size=1048576 2024-09-12T00:42:25.373 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.377+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~0K502HYFHOIY.2 size=1020468 2024-09-12T00:42:25.373 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.377+0000 7fcde98768c0 1 > prepared multipart upload key=2T5IU2IUNGJX upload=0K502HYFHOIY tag=JO4Z93O4ECJS type=write size=4166196 2024-09-12T00:42:25.376 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.377+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~6D4B2LGI0RHU.0 size=1048576 2024-09-12T00:42:25.379 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.381+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~6D4B2LGI0RHU.1 size=1048576 2024-09-12T00:42:25.382 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.385+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~6D4B2LGI0RHU.2 size=1020214 2024-09-12T00:42:25.388 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.389+0000 7fcde98768c0 1 < completed multipart upload key=3QOENE572J7A upload=6D4B2LGI0RHU tag=N7YEZ0740CK3 type=write size=4165942 2024-09-12T00:42:25.394 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.397+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~CJH2ECQASR83.0 size=981072 2024-09-12T00:42:25.394 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.397+0000 7fcde98768c0 1 > prepared multipart upload key=5YBVLUYJW40U upload=CJH2ECQASR83 tag=RCSR8R259SLW type=write size=2029648 2024-09-12T00:42:25.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.405+0000 7fcde98768c0 1 < suggested update operation key=4487IMSOLPDV tag=ESK8DAS3620A type=del size=3653229 2024-09-12T00:42:25.405 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.409+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=NR9I4OINB6C3 type=del size=1579126 2024-09-12T00:42:25.408 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.409+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~ANZXLTBPNHQW.0 size=723396 2024-09-12T00:42:25.414 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.417+0000 7fcde98768c0 1 < completed multipart upload key=WLE5QLNPAGZA upload=ANZXLTBPNHQW tag=A1L9RL8ME70Y type=write size=1771972 2024-09-12T00:42:25.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.421+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=BY2LXGKKQZ8Z type=del size=4174020 2024-09-12T00:42:25.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.421+0000 7fcde98768c0 1 < canceled operation key=R2EBH0Q5885L tag=M0VHAQWJ7VHL type=del size=3069269 2024-09-12T00:42:25.423 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.425+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=KGVCRJMALJYJ type=write size=935982 2024-09-12T00:42:25.428 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.429+0000 7fcde98768c0 1 < suggested remove operation key=BQGIXJJWBAN0 tag=CL71T62XYDTZ type=write 2024-09-12T00:42:25.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.437+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~4Y2IF2P3DVD4.0 size=1048576 2024-09-12T00:42:25.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.437+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~4Y2IF2P3DVD4.1 size=872736 2024-09-12T00:42:25.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.437+0000 7fcde98768c0 1 > prepared multipart upload key=EDFNLQYP4L4L upload=4Y2IF2P3DVD4 tag=L6DDM8NYZLGT type=write size=2969888 2024-09-12T00:42:25.439 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.441+0000 7fcde98768c0 -1 < failed to complete operation key=RC9A2Y5TCP9C tag=HE8NDB606WAK type=del size=267409: (22) Invalid argument 2024-09-12T00:42:25.443 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.445+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=FHA8PBDBK46C type=del size=1310349 2024-09-12T00:42:25.446 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.449+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~08LPMHA2VMHE.0 size=1048576 2024-09-12T00:42:25.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.453+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~08LPMHA2VMHE.1 size=1048576 2024-09-12T00:42:25.451 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.453+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~08LPMHA2VMHE.2 size=1032851 2024-09-12T00:42:25.455 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.457+0000 7fcde98768c0 1 < completed multipart upload key=R2EBH0Q5885L upload=08LPMHA2VMHE tag=3XWLD14DRGC6 type=write size=4178579 2024-09-12T00:42:25.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.461+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~H0EY61NY19X1.0 size=1048576 2024-09-12T00:42:25.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.465+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~H0EY61NY19X1.1 size=1048576 2024-09-12T00:42:25.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.469+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~H0EY61NY19X1.2 size=516430 2024-09-12T00:42:25.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.469+0000 7fcde98768c0 1 > prepared multipart upload key=ZQD0QXDN1J1I upload=H0EY61NY19X1 tag=JFB8VMFH4E36 type=write size=3662158 2024-09-12T00:42:25.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.469+0000 7fcde98768c0 1 < completed write operation key=R2EBH0Q5885L tag=TL11FI2ME1DD type=write size=663798 2024-09-12T00:42:25.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.473+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=BNV67PVPC1AJ type=del size=3340353 2024-09-12T00:42:25.473 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.477+0000 7fcde98768c0 1 < completed delete operation key=368TXYQVK9C3 tag=2KUMJW7CWC55 type=del 2024-09-12T00:42:25.476 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.477+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=8WML1TNEML26 type=del size=482504 2024-09-12T00:42:25.479 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.481+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~BF93ONB5IGAP.0 size=1048576 2024-09-12T00:42:25.481 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.485+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~BF93ONB5IGAP.1 size=1048576 2024-09-12T00:42:25.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.485+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~BF93ONB5IGAP.2 size=922721 2024-09-12T00:42:25.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.489+0000 7fcde98768c0 1 < completed multipart upload key=5B8C6E8L5N52 upload=BF93ONB5IGAP tag=O1ZEFD4K7F8G type=write size=4068449 2024-09-12T00:42:25.491 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.493+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=40CDY72C0CUE type=del size=1512094 2024-09-12T00:42:25.497 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.501+0000 7fcde98768c0 1 < suggested remove operation key=Z4RNDW37GEK6 tag=ALNQX92B069H type=del 2024-09-12T00:42:25.501 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.505+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=KYVPKVIT190F type=del size=134688 2024-09-12T00:42:25.504 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.509+0000 7fcde98768c0 1 < completed delete operation key=368TXYQVK9C3 tag=6XCI4VNAP39D type=del 2024-09-12T00:42:25.507 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.509+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=TU6S0UIL7AA5 type=del size=1548972 2024-09-12T00:42:25.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.513+0000 7fcde98768c0 1 < completed delete operation key=NVOFV649MT0A tag=D63PCC0A4E5M type=del 2024-09-12T00:42:25.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.517+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=3X3U3QA3S70V type=del size=757473 2024-09-12T00:42:25.518 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.521+0000 7fcde98768c0 1 < completed delete operation key=IV4JCE1QJC70 tag=NC5IGR4OIDMF type=del 2024-09-12T00:42:25.524 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.529+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=30BI2GA7MBK1 type=del size=1270406 2024-09-12T00:42:25.527 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.529+0000 7fcde98768c0 1 < completed write operation key=5YBVLUYJW40U tag=1E8UVTK7VWZ2 type=write size=133708 2024-09-12T00:42:25.530 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.533+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=GAEW6VNXCCMM type=del size=1137062 2024-09-12T00:42:25.533 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.537+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~0K502HYFHOIY.0 size=1048576 2024-09-12T00:42:25.535 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.537+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~0K502HYFHOIY.1 size=1048576 2024-09-12T00:42:25.538 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.541+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~0K502HYFHOIY.2 size=1020468 2024-09-12T00:42:25.542 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.545+0000 7fcde98768c0 1 < completed multipart upload key=2T5IU2IUNGJX upload=0K502HYFHOIY tag=JO4Z93O4ECJS type=write size=4166196 2024-09-12T00:42:25.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.549+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=FJTHWWD2TQRM type=write size=94465 2024-09-12T00:42:25.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.553+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~CJH2ECQASR83.0 size=981072 2024-09-12T00:42:25.553 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.557+0000 7fcde98768c0 1 < completed multipart upload key=5YBVLUYJW40U upload=CJH2ECQASR83 tag=RCSR8R259SLW type=write size=2029648 2024-09-12T00:42:25.556 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.557+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=1ZCRL0IPAHYR type=del size=2151167 2024-09-12T00:42:25.562 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.565+0000 7fcde98768c0 1 < suggested update operation key=TUMAMUZUIR7E tag=NR9I4OINB6C3 type=del size=1579126 2024-09-12T00:42:25.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.569+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~IOCURA20R7IO.0 size=305556 2024-09-12T00:42:25.568 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.569+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=IOCURA20R7IO tag=XNP9M1406E6N type=write size=1354132 2024-09-12T00:42:25.571 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.573+0000 7fcde98768c0 1 < completed delete operation key=BZ4YUNTMOJBK tag=BY2LXGKKQZ8Z type=del 2024-09-12T00:42:25.574 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.577+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=L1UNVXKGKDQI type=del size=2005573 2024-09-12T00:42:25.578 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.581+0000 7fcde98768c0 1 < completed write operation key=JW2GNFAYFNEK tag=KGVCRJMALJYJ type=write size=935982 2024-09-12T00:42:25.581 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.585+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=H5K49EI64MO0 type=del size=2815911 2024-09-12T00:42:25.584 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.589+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~4Y2IF2P3DVD4.0 size=1048576 2024-09-12T00:42:25.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.589+0000 7fcde98768c0 1 < canceled part key=_multipart_EDFNLQYP4L4L.2~4Y2IF2P3DVD4.1 size=872736 2024-09-12T00:42:25.591 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.593+0000 7fcde98768c0 1 < canceled multipart upload key=EDFNLQYP4L4L upload=4Y2IF2P3DVD4 tag=L6DDM8NYZLGT type=write size=2969888 2024-09-12T00:42:25.594 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.597+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=IUQNI6TP7EG1 type=del size=127308 2024-09-12T00:42:25.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.605+0000 7fcde98768c0 1 < suggested update operation key=R2EBH0Q5885L tag=FHA8PBDBK46C type=del size=1310349 2024-09-12T00:42:25.605 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.609+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=VB3Y93CD7WFD type=del size=1194872 2024-09-12T00:42:25.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.609+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~H0EY61NY19X1.0 size=1048576 2024-09-12T00:42:25.612 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.613+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~H0EY61NY19X1.1 size=1048576 2024-09-12T00:42:25.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.617+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~H0EY61NY19X1.2 size=516430 2024-09-12T00:42:25.620 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.625+0000 7fcde98768c0 1 < completed multipart upload key=ZQD0QXDN1J1I upload=H0EY61NY19X1 tag=JFB8VMFH4E36 type=write size=3662158 2024-09-12T00:42:25.624 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.625+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=U3BFC9LBR975 type=write size=751736 2024-09-12T00:42:25.627 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.629+0000 7fcde98768c0 1 < completed delete operation key=368TXYQVK9C3 tag=BNV67PVPC1AJ type=del 2024-09-12T00:42:25.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.637+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~ATQSSVAAT0YN.0 size=1048576 2024-09-12T00:42:25.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.641+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~ATQSSVAAT0YN.1 size=766972 2024-09-12T00:42:25.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.641+0000 7fcde98768c0 1 > prepared multipart upload key=7UR0FX8HA2A5 upload=ATQSSVAAT0YN tag=5M4IGYHT6L65 type=write size=2864124 2024-09-12T00:42:25.641 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.645+0000 7fcde98768c0 1 < completed delete operation key=V80E1NH858IK tag=8WML1TNEML26 type=del 2024-09-12T00:42:25.647 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.649+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~MT3TZGSS49VD.0 size=111879 2024-09-12T00:42:25.647 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.649+0000 7fcde98768c0 1 > prepared multipart upload key=HVE3YQTFZWTV upload=MT3TZGSS49VD tag=U4FM4P7GPVZ6 type=write size=1160455 2024-09-12T00:42:25.651 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.653+0000 7fcde98768c0 1 < completed delete operation key=FUJIUIR1E00J tag=40CDY72C0CUE type=del 2024-09-12T00:42:25.654 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.657+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=WT105EXU6M8Y type=write size=855160 2024-09-12T00:42:25.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.661+0000 7fcde98768c0 1 < canceled operation key=J9EUM073CZHF tag=KYVPKVIT190F type=del size=134688 2024-09-12T00:42:25.661 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.665+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=NQJGBTFKPIEF type=del size=1430902 2024-09-12T00:42:25.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.665+0000 7fcde98768c0 1 < completed delete operation key=Z4RNDW37GEK6 tag=TU6S0UIL7AA5 type=del 2024-09-12T00:42:25.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.669+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=AMBBPFCUTOM3 type=del size=3607449 2024-09-12T00:42:25.673 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.677+0000 7fcde98768c0 1 < suggested update operation key=4487IMSOLPDV tag=3X3U3QA3S70V type=del size=757473 2024-09-12T00:42:25.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.681+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~BLEI95SCB07J.0 size=1048576 2024-09-12T00:42:25.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.685+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~BLEI95SCB07J.1 size=174138 2024-09-12T00:42:25.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.685+0000 7fcde98768c0 1 > prepared multipart upload key=EDFNLQYP4L4L upload=BLEI95SCB07J tag=VE3E408TUUGC type=write size=2271290 2024-09-12T00:42:25.686 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.689+0000 7fcde98768c0 1 < completed delete operation key=RC9A2Y5TCP9C tag=30BI2GA7MBK1 type=del 2024-09-12T00:42:25.689 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.693+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=3PPSUWK0DOI7 type=write size=956016 2024-09-12T00:42:25.692 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.693+0000 7fcde98768c0 1 < completed delete operation key=EDFNLQYP4L4L tag=GAEW6VNXCCMM type=del 2024-09-12T00:42:25.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.697+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=SUFV795O0O47 type=del size=4145687 2024-09-12T00:42:25.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.701+0000 7fcde98768c0 1 < completed write operation key=JW2GNFAYFNEK tag=FJTHWWD2TQRM type=write size=94465 2024-09-12T00:42:25.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.701+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=7DUT5X78RVKS type=del size=1312637 2024-09-12T00:42:25.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.705+0000 7fcde98768c0 1 < completed delete operation key=7UR0FX8HA2A5 tag=1ZCRL0IPAHYR type=del 2024-09-12T00:42:25.708 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.713+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~CKBM525JJP0S.0 size=1048576 2024-09-12T00:42:25.711 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.713+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~CKBM525JJP0S.1 size=1048576 2024-09-12T00:42:25.713 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.717+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~CKBM525JJP0S.2 size=795407 2024-09-12T00:42:25.713 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.717+0000 7fcde98768c0 1 > prepared multipart upload key=4487IMSOLPDV upload=CKBM525JJP0S tag=06Q5478HQ6N9 type=write size=3941135 2024-09-12T00:42:25.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.717+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~IOCURA20R7IO.0 size=305556 2024-09-12T00:42:25.721 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.725+0000 7fcde98768c0 1 < completed multipart upload key=QD5JXFL962R5 upload=IOCURA20R7IO tag=XNP9M1406E6N type=write size=1354132 2024-09-12T00:42:25.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.725+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=H322YOMIIE2I type=write size=404720 2024-09-12T00:42:25.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.729+0000 7fcde98768c0 1 < completed delete operation key=IMITNCB1ST9E tag=L1UNVXKGKDQI type=del 2024-09-12T00:42:25.729 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.733+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=7X1JI12D7L3P type=del size=2176021 2024-09-12T00:42:25.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.737+0000 7fcde98768c0 1 < completed delete operation key=IMITNCB1ST9E tag=H5K49EI64MO0 type=del 2024-09-12T00:42:25.738 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.741+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~GS9LRKDMDNY1.0 size=1048576 2024-09-12T00:42:25.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.741+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~GS9LRKDMDNY1.1 size=1048576 2024-09-12T00:42:25.742 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.745+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~GS9LRKDMDNY1.2 size=42104 2024-09-12T00:42:25.742 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.745+0000 7fcde98768c0 1 > prepared multipart upload key=NVOFV649MT0A upload=GS9LRKDMDNY1 tag=LDB8JQ1M1J60 type=write size=3187832 2024-09-12T00:42:25.744 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.749+0000 7fcde98768c0 1 < canceled operation key=3QOENE572J7A tag=IUQNI6TP7EG1 type=del size=127308 2024-09-12T00:42:25.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.753+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~UHROK3NDL3F2.0 size=1048576 2024-09-12T00:42:25.751 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.753+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~UHROK3NDL3F2.1 size=484968 2024-09-12T00:42:25.751 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.753+0000 7fcde98768c0 1 > prepared multipart upload key=7UR0FX8HA2A5 upload=UHROK3NDL3F2 tag=0EWYJ5B2WK55 type=write size=2582120 2024-09-12T00:42:25.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.757+0000 7fcde98768c0 1 < completed delete operation key=BZ4YUNTMOJBK tag=VB3Y93CD7WFD type=del 2024-09-12T00:42:25.756 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.761+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=ZHMD842DBBB9 type=del size=1785819 2024-09-12T00:42:25.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.761+0000 7fcde98768c0 1 < completed write operation key=F813QWV02TI0 tag=U3BFC9LBR975 type=write size=751736 2024-09-12T00:42:25.765 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.769+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~UMKDFTUOJWY7.0 size=673770 2024-09-12T00:42:25.765 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.769+0000 7fcde98768c0 1 > prepared multipart upload key=3QOENE572J7A upload=UMKDFTUOJWY7 tag=NXIEO733XZKL type=write size=1722346 2024-09-12T00:42:25.768 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.769+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~ATQSSVAAT0YN.0 size=1048576 2024-09-12T00:42:25.770 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.773+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~ATQSSVAAT0YN.1 size=766972 2024-09-12T00:42:25.775 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.777+0000 7fcde98768c0 1 < completed multipart upload key=7UR0FX8HA2A5 upload=ATQSSVAAT0YN tag=5M4IGYHT6L65 type=write size=2864124 2024-09-12T00:42:25.779 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.781+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~Q7KKOGU29CZM.0 size=50047 2024-09-12T00:42:25.780 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.781+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=Q7KKOGU29CZM tag=ZFSSZIM03JI5 type=write size=1098623 2024-09-12T00:42:25.782 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.785+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~MT3TZGSS49VD.0 size=111879 2024-09-12T00:42:25.787 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.789+0000 7fcde98768c0 1 < completed multipart upload key=HVE3YQTFZWTV upload=MT3TZGSS49VD tag=U4FM4P7GPVZ6 type=write size=1160455 2024-09-12T00:42:25.792 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.793+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~JWZS2CYVZTBG.0 size=923947 2024-09-12T00:42:25.792 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.793+0000 7fcde98768c0 1 > prepared multipart upload key=WLE5QLNPAGZA upload=JWZS2CYVZTBG tag=G64216J0ARIM type=write size=1972523 2024-09-12T00:42:25.794 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.797+0000 7fcde98768c0 1 < completed write operation key=3QOENE572J7A tag=WT105EXU6M8Y type=write size=855160 2024-09-12T00:42:25.797 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.801+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=S9U7I21TBC93 type=del size=726057 2024-09-12T00:42:25.800 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.801+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=NQJGBTFKPIEF type=del 2024-09-12T00:42:25.802 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.805+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=TNZATBGRU60O type=del size=680101 2024-09-12T00:42:25.804 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.809+0000 7fcde98768c0 1 < completed delete operation key=TUMAMUZUIR7E tag=AMBBPFCUTOM3 type=del 2024-09-12T00:42:25.812 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.813+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~4ZPG5LOP423M.0 size=1048576 2024-09-12T00:42:25.817 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.817+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~4ZPG5LOP423M.1 size=1048576 2024-09-12T00:42:25.817 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.817+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~4ZPG5LOP423M.2 size=638707 2024-09-12T00:42:25.817 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.817+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=4ZPG5LOP423M tag=D7DDSAKQ9KNQ type=write size=3784435 2024-09-12T00:42:25.818 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.821+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~BLEI95SCB07J.0 size=1048576 2024-09-12T00:42:25.820 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.821+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~BLEI95SCB07J.1 size=174138 2024-09-12T00:42:25.823 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.825+0000 7fcde98768c0 1 < completed multipart upload key=EDFNLQYP4L4L upload=BLEI95SCB07J tag=VE3E408TUUGC type=write size=2271290 2024-09-12T00:42:25.827 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.829+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~6O27H2KIKNJ2.0 size=1048576 2024-09-12T00:42:25.829 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.833+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~6O27H2KIKNJ2.1 size=684966 2024-09-12T00:42:25.829 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.833+0000 7fcde98768c0 1 > prepared multipart upload key=EDFNLQYP4L4L upload=6O27H2KIKNJ2 tag=V4D437XLQNNO type=write size=2782118 2024-09-12T00:42:25.832 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.833+0000 7fcde98768c0 1 < completed write operation key=Z4RNDW37GEK6 tag=3PPSUWK0DOI7 type=write size=956016 2024-09-12T00:42:25.836 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.837+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~HZAFQ87DGPPD.0 size=1048576 2024-09-12T00:42:25.838 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.841+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~HZAFQ87DGPPD.1 size=55176 2024-09-12T00:42:25.838 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.841+0000 7fcde98768c0 1 > prepared multipart upload key=EDFNLQYP4L4L upload=HZAFQ87DGPPD tag=B4DUW2S1K91J type=write size=2152328 2024-09-12T00:42:25.840 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.841+0000 7fcde98768c0 1 < completed delete operation key=3QOENE572J7A tag=SUFV795O0O47 type=del 2024-09-12T00:42:25.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.849+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~ZXMWY4JLL9Q2.0 size=4627 2024-09-12T00:42:25.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.849+0000 7fcde98768c0 1 > prepared multipart upload key=3X9I78PMR1HV upload=ZXMWY4JLL9Q2 tag=WX7J885147DB type=write size=1053203 2024-09-12T00:42:25.847 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.849+0000 7fcde98768c0 1 < canceled operation key=BZ4YUNTMOJBK tag=7DUT5X78RVKS type=del size=1312637 2024-09-12T00:42:25.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.853+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=JKVYRW3C7QBE type=write size=152175 2024-09-12T00:42:25.852 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.853+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~CKBM525JJP0S.0 size=1048576 2024-09-12T00:42:25.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.857+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~CKBM525JJP0S.1 size=1048576 2024-09-12T00:42:25.856 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.857+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~CKBM525JJP0S.2 size=795407 2024-09-12T00:42:25.861 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.865+0000 7fcde98768c0 1 < completed multipart upload key=4487IMSOLPDV upload=CKBM525JJP0S tag=06Q5478HQ6N9 type=write size=3941135 2024-09-12T00:42:25.863 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.865+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=JL0ZUDJHA43D type=del size=2866708 2024-09-12T00:42:25.865 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.869+0000 7fcde98768c0 1 < completed write operation key=97030NBF3MI4 tag=H322YOMIIE2I type=write size=404720 2024-09-12T00:42:25.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.869+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=R65FLB38HOKG type=del size=3410272 2024-09-12T00:42:25.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.873+0000 7fcde98768c0 1 < completed delete operation key=2T5IU2IUNGJX tag=7X1JI12D7L3P type=del 2024-09-12T00:42:25.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.877+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~YRQEK9MUZ2ZN.0 size=505720 2024-09-12T00:42:25.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.877+0000 7fcde98768c0 1 > prepared multipart upload key=TUMAMUZUIR7E upload=YRQEK9MUZ2ZN tag=E1993BRQL4IG type=write size=1554296 2024-09-12T00:42:25.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.877+0000 7fcde98768c0 1 < canceled part key=_multipart_NVOFV649MT0A.2~GS9LRKDMDNY1.0 size=1048576 2024-09-12T00:42:25.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.881+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~GS9LRKDMDNY1.1 size=1048576 2024-09-12T00:42:25.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.881+0000 7fcde98768c0 1 < canceled part key=_multipart_NVOFV649MT0A.2~GS9LRKDMDNY1.2 size=42104 2024-09-12T00:42:25.881 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.885+0000 7fcde98768c0 1 < canceled multipart upload key=NVOFV649MT0A upload=GS9LRKDMDNY1 tag=LDB8JQ1M1J60 type=write size=3187832 2024-09-12T00:42:25.884 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.885+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=3BWX83LTO5T6 type=del size=1261399 2024-09-12T00:42:25.886 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.889+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~UHROK3NDL3F2.0 size=1048576 2024-09-12T00:42:25.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.893+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~UHROK3NDL3F2.1 size=484968 2024-09-12T00:42:25.892 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.893+0000 7fcde98768c0 1 < completed multipart upload key=7UR0FX8HA2A5 upload=UHROK3NDL3F2 tag=0EWYJ5B2WK55 type=write size=2582120 2024-09-12T00:42:25.897 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.901+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~2TSWH7TLPSZ9.0 size=1048576 2024-09-12T00:42:25.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.901+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~2TSWH7TLPSZ9.1 size=331583 2024-09-12T00:42:25.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.901+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=2TSWH7TLPSZ9 tag=4DZ3CEKNFZVE type=write size=2428735 2024-09-12T00:42:25.904 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.909+0000 7fcde98768c0 1 < suggested update operation key=TUMAMUZUIR7E tag=ZHMD842DBBB9 type=del size=1785819 2024-09-12T00:42:25.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.909+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=DRP4ZV26RYTA type=write size=957494 2024-09-12T00:42:25.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.913+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~UMKDFTUOJWY7.0 size=673770 2024-09-12T00:42:25.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.917+0000 7fcde98768c0 1 < completed multipart upload key=3QOENE572J7A upload=UMKDFTUOJWY7 tag=NXIEO733XZKL type=write size=1722346 2024-09-12T00:42:25.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.921+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~XD8NNL6UWY1A.0 size=1048576 2024-09-12T00:42:25.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.921+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~XD8NNL6UWY1A.1 size=411694 2024-09-12T00:42:25.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.921+0000 7fcde98768c0 1 > prepared multipart upload key=5YBVLUYJW40U upload=XD8NNL6UWY1A tag=YEMHDMW4GC90 type=write size=2508846 2024-09-12T00:42:25.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.925+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~Q7KKOGU29CZM.0 size=50047 2024-09-12T00:42:25.926 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.929+0000 7fcde98768c0 1 < completed multipart upload key=IV4JCE1QJC70 upload=Q7KKOGU29CZM tag=ZFSSZIM03JI5 type=write size=1098623 2024-09-12T00:42:25.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.929+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=Q86Y18EZ7PQ5 type=del size=1708510 2024-09-12T00:42:25.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.933+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~JWZS2CYVZTBG.0 size=923947 2024-09-12T00:42:25.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.937+0000 7fcde98768c0 1 < completed multipart upload key=WLE5QLNPAGZA upload=JWZS2CYVZTBG tag=G64216J0ARIM type=write size=1972523 2024-09-12T00:42:25.935 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.937+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=9RSWHN1S8DY2 type=del size=539349 2024-09-12T00:42:25.938 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.941+0000 7fcde98768c0 1 < canceled operation key=368TXYQVK9C3 tag=S9U7I21TBC93 type=del size=726057 2024-09-12T00:42:25.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.945+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=HEDQHSAFKRFM type=del size=4133823 2024-09-12T00:42:25.945 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.949+0000 7fcde98768c0 1 < suggested remove operation key=WLE5QLNPAGZA tag=TNZATBGRU60O type=del 2024-09-12T00:42:25.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.949+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=T89FKSXD4PLU type=write size=346442 2024-09-12T00:42:25.950 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.953+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~4ZPG5LOP423M.0 size=1048576 2024-09-12T00:42:25.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.953+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~4ZPG5LOP423M.1 size=1048576 2024-09-12T00:42:25.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.953+0000 7fcde98768c0 1 < canceled part key=_multipart_QD5JXFL962R5.2~4ZPG5LOP423M.2 size=638707 2024-09-12T00:42:25.957 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.961+0000 7fcde98768c0 1 < canceled multipart upload key=QD5JXFL962R5 upload=4ZPG5LOP423M tag=D7DDSAKQ9KNQ type=write size=3784435 2024-09-12T00:42:25.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.961+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=8CNYB3OJZGLZ type=write size=710967 2024-09-12T00:42:25.961 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.965+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~6O27H2KIKNJ2.0 size=1048576 2024-09-12T00:42:25.963 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.965+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~6O27H2KIKNJ2.1 size=684966 2024-09-12T00:42:25.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.969+0000 7fcde98768c0 1 < completed multipart upload key=EDFNLQYP4L4L upload=6O27H2KIKNJ2 tag=V4D437XLQNNO type=write size=2782118 2024-09-12T00:42:25.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.973+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=7OW1603UBLL9 type=del size=1237707 2024-09-12T00:42:25.971 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.973+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~HZAFQ87DGPPD.0 size=1048576 2024-09-12T00:42:25.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.977+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~HZAFQ87DGPPD.1 size=55176 2024-09-12T00:42:25.976 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.981+0000 7fcde98768c0 1 < completed multipart upload key=EDFNLQYP4L4L upload=HZAFQ87DGPPD tag=B4DUW2S1K91J type=write size=2152328 2024-09-12T00:42:25.979 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.981+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=T2WGOVGL2RB3 type=del size=264962 2024-09-12T00:42:25.981 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.985+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~ZXMWY4JLL9Q2.0 size=4627 2024-09-12T00:42:25.984 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.985+0000 7fcde98768c0 1 < completed multipart upload key=3X9I78PMR1HV upload=ZXMWY4JLL9Q2 tag=WX7J885147DB type=write size=1053203 2024-09-12T00:42:25.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.989+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~5E72DD794U5X.0 size=923182 2024-09-12T00:42:25.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.989+0000 7fcde98768c0 1 > prepared multipart upload key=ZQD0QXDN1J1I upload=5E72DD794U5X tag=1BHPD0ZB5894 type=write size=1971758 2024-09-12T00:42:25.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.993+0000 7fcde98768c0 1 < completed write operation key=EDFNLQYP4L4L tag=JKVYRW3C7QBE type=write size=152175 2024-09-12T00:42:25.994 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.997+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~KJHPPZS9132A.0 size=1048576 2024-09-12T00:42:25.995 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:25.997+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~KJHPPZS9132A.1 size=1048576 2024-09-12T00:42:25.997 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.001+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~KJHPPZS9132A.2 size=779858 2024-09-12T00:42:25.997 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.001+0000 7fcde98768c0 1 > prepared multipart upload key=3QOENE572J7A upload=KJHPPZS9132A tag=O9IA0Q16R08L type=write size=3925586 2024-09-12T00:42:25.999 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.001+0000 7fcde98768c0 1 < completed delete operation key=JW2GNFAYFNEK tag=JL0ZUDJHA43D type=del 2024-09-12T00:42:26.001 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.005+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=35EXV3LQWA7Q type=del size=721929 2024-09-12T00:42:26.005 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.009+0000 7fcde98768c0 1 < suggested update operation key=R2EBH0Q5885L tag=R65FLB38HOKG type=del size=3410272 2024-09-12T00:42:26.009 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.013+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~MPTN0KHMVG5V.0 size=1048576 2024-09-12T00:42:26.011 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.013+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~MPTN0KHMVG5V.1 size=1048576 2024-09-12T00:42:26.012 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.013+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~MPTN0KHMVG5V.2 size=778700 2024-09-12T00:42:26.012 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.013+0000 7fcde98768c0 1 > prepared multipart upload key=HVE3YQTFZWTV upload=MPTN0KHMVG5V tag=20WD0DZ6MF3J type=write size=3924428 2024-09-12T00:42:26.014 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.017+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~YRQEK9MUZ2ZN.0 size=505720 2024-09-12T00:42:26.017 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.021+0000 7fcde98768c0 1 < completed multipart upload key=TUMAMUZUIR7E upload=YRQEK9MUZ2ZN tag=E1993BRQL4IG type=write size=1554296 2024-09-12T00:42:26.024 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.025+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~5IJXUTFVD4EJ.0 size=1048576 2024-09-12T00:42:26.026 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.029+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~5IJXUTFVD4EJ.1 size=1048576 2024-09-12T00:42:26.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.029+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~5IJXUTFVD4EJ.2 size=337464 2024-09-12T00:42:26.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.029+0000 7fcde98768c0 1 > prepared multipart upload key=4487IMSOLPDV upload=5IJXUTFVD4EJ tag=KQ45VYB6WHPI type=write size=3483192 2024-09-12T00:42:26.030 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.033+0000 7fcde98768c0 1 < suggested remove operation key=3QOENE572J7A tag=3BWX83LTO5T6 type=del 2024-09-12T00:42:26.034 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.037+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~UV8YBC6MWXNC.0 size=1048576 2024-09-12T00:42:26.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.037+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~UV8YBC6MWXNC.1 size=1048576 2024-09-12T00:42:26.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.037+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~UV8YBC6MWXNC.2 size=707333 2024-09-12T00:42:26.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.037+0000 7fcde98768c0 1 > prepared multipart upload key=C6PW0ETP4BG2 upload=UV8YBC6MWXNC tag=H68SRB3SLBDJ type=write size=3853061 2024-09-12T00:42:26.038 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.041+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~2TSWH7TLPSZ9.0 size=1048576 2024-09-12T00:42:26.039 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.041+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~2TSWH7TLPSZ9.1 size=331583 2024-09-12T00:42:26.042 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.045+0000 7fcde98768c0 1 < completed multipart upload key=V80E1NH858IK upload=2TSWH7TLPSZ9 tag=4DZ3CEKNFZVE type=write size=2428735 2024-09-12T00:42:26.044 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.045+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=OTD02AQP0E6P type=del size=2255866 2024-09-12T00:42:26.046 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.049+0000 7fcde98768c0 1 < completed write operation key=368TXYQVK9C3 tag=DRP4ZV26RYTA type=write size=957494 2024-09-12T00:42:26.048 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.049+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=UB01MH8L0MKW type=del size=99129 2024-09-12T00:42:26.050 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.053+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~XD8NNL6UWY1A.0 size=1048576 2024-09-12T00:42:26.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.053+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~XD8NNL6UWY1A.1 size=411694 2024-09-12T00:42:26.054 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.057+0000 7fcde98768c0 1 < completed multipart upload key=5YBVLUYJW40U upload=XD8NNL6UWY1A tag=YEMHDMW4GC90 type=write size=2508846 2024-09-12T00:42:26.056 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.057+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=C8OXI76CTQXX type=del size=977461 2024-09-12T00:42:26.059 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.061+0000 7fcde98768c0 1 < suggested update operation key=97030NBF3MI4 tag=Q86Y18EZ7PQ5 type=del size=1708510 2024-09-12T00:42:26.061 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.065+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=ZFQVKAEY2P8L type=del size=2839987 2024-09-12T00:42:26.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.065+0000 7fcde98768c0 1 < completed delete operation key=IV4JCE1QJC70 tag=9RSWHN1S8DY2 type=del 2024-09-12T00:42:26.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.069+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=83H4RUFS964J type=del size=2714658 2024-09-12T00:42:26.066 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.069+0000 7fcde98768c0 1 < completed delete operation key=3X9I78PMR1HV tag=HEDQHSAFKRFM type=del 2024-09-12T00:42:26.068 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.073+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=G5NAT02W9HX2 type=del size=1829758 2024-09-12T00:42:26.070 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.073+0000 7fcde98768c0 1 < completed write operation key=IV4JCE1QJC70 tag=T89FKSXD4PLU type=write size=346442 2024-09-12T00:42:26.072 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.073+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=25CB4AWC4ZJM type=del size=2251703 2024-09-12T00:42:26.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.077+0000 7fcde98768c0 1 < suggested update operation key=97030NBF3MI4 tag=8CNYB3OJZGLZ type=write size=710967 2024-09-12T00:42:26.077 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.081+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=F89W8PNJX6NY type=write size=587362 2024-09-12T00:42:26.079 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.081+0000 7fcde98768c0 1 < canceled operation key=C6PW0ETP4BG2 tag=7OW1603UBLL9 type=del size=1237707 2024-09-12T00:42:26.082 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.085+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~BMU04XB8QPP0.0 size=1048576 2024-09-12T00:42:26.084 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.085+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~BMU04XB8QPP0.1 size=750529 2024-09-12T00:42:26.084 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.085+0000 7fcde98768c0 1 > prepared multipart upload key=368TXYQVK9C3 upload=BMU04XB8QPP0 tag=9MUY64MLMU98 type=write size=2847681 2024-09-12T00:42:26.086 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.089+0000 7fcde98768c0 1 < completed delete operation key=368TXYQVK9C3 tag=T2WGOVGL2RB3 type=del 2024-09-12T00:42:26.088 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.089+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=SX4EKS45DUI1 type=del size=3385060 2024-09-12T00:42:26.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.093+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~5E72DD794U5X.0 size=923182 2024-09-12T00:42:26.093 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.097+0000 7fcde98768c0 1 < completed multipart upload key=ZQD0QXDN1J1I upload=5E72DD794U5X tag=1BHPD0ZB5894 type=write size=1971758 2024-09-12T00:42:26.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.097+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=QW7Z2U5XM8SR type=del size=2703529 2024-09-12T00:42:26.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.101+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~KJHPPZS9132A.0 size=1048576 2024-09-12T00:42:26.099 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.101+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~KJHPPZS9132A.1 size=1048576 2024-09-12T00:42:26.101 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.105+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~KJHPPZS9132A.2 size=779858 2024-09-12T00:42:26.104 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.105+0000 7fcde98768c0 1 < completed multipart upload key=3QOENE572J7A upload=KJHPPZS9132A tag=O9IA0Q16R08L type=write size=3925586 2024-09-12T00:42:26.106 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.109+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=S4OXE6PV847Q type=del size=3223926 2024-09-12T00:42:26.109 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.113+0000 7fcde98768c0 -1 < failed to complete operation key=3QOENE572J7A tag=35EXV3LQWA7Q type=del size=721929: (22) Invalid argument 2024-09-12T00:42:26.111 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.113+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=MSAG2570DB9C type=write size=602430 2024-09-12T00:42:26.113 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.117+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~MPTN0KHMVG5V.0 size=1048576 2024-09-12T00:42:26.115 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.117+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~MPTN0KHMVG5V.1 size=1048576 2024-09-12T00:42:26.117 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.121+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~MPTN0KHMVG5V.2 size=778700 2024-09-12T00:42:26.121 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.125+0000 7fcde98768c0 1 < completed multipart upload key=HVE3YQTFZWTV upload=MPTN0KHMVG5V tag=20WD0DZ6MF3J type=write size=3924428 2024-09-12T00:42:26.125 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.129+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~QSEVGHYS748B.0 size=1048576 2024-09-12T00:42:26.128 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.129+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~QSEVGHYS748B.1 size=1048576 2024-09-12T00:42:26.129 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.133+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~QSEVGHYS748B.2 size=681984 2024-09-12T00:42:26.129 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.133+0000 7fcde98768c0 1 > prepared multipart upload key=ZQD0QXDN1J1I upload=QSEVGHYS748B tag=RP0Z769PRL30 type=write size=3827712 2024-09-12T00:42:26.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.133+0000 7fcde98768c0 1 < canceled part key=_multipart_4487IMSOLPDV.2~5IJXUTFVD4EJ.0 size=1048576 2024-09-12T00:42:26.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.133+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~5IJXUTFVD4EJ.1 size=1048576 2024-09-12T00:42:26.134 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.137+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~5IJXUTFVD4EJ.2 size=337464 2024-09-12T00:42:26.138 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.141+0000 7fcde98768c0 1 < canceled multipart upload key=4487IMSOLPDV upload=5IJXUTFVD4EJ tag=KQ45VYB6WHPI type=write size=3483192 2024-09-12T00:42:26.142 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.145+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~9UYPLV4V5YAC.0 size=1048576 2024-09-12T00:42:26.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.145+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~9UYPLV4V5YAC.1 size=432103 2024-09-12T00:42:26.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.145+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=9UYPLV4V5YAC tag=8XJOR2WASET1 type=write size=2529255 2024-09-12T00:42:26.147 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.149+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~UV8YBC6MWXNC.0 size=1048576 2024-09-12T00:42:26.149 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.153+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~UV8YBC6MWXNC.1 size=1048576 2024-09-12T00:42:26.151 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.153+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~UV8YBC6MWXNC.2 size=707333 2024-09-12T00:42:26.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.157+0000 7fcde98768c0 1 < completed multipart upload key=C6PW0ETP4BG2 upload=UV8YBC6MWXNC tag=H68SRB3SLBDJ type=write size=3853061 2024-09-12T00:42:26.160 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.161+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~J4NA5HMNQ2H5.0 size=1048576 2024-09-12T00:42:26.161 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.165+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~J4NA5HMNQ2H5.1 size=1048576 2024-09-12T00:42:26.163 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.165+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~J4NA5HMNQ2H5.2 size=987158 2024-09-12T00:42:26.163 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.165+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=J4NA5HMNQ2H5 tag=IANPBG93QGKD type=write size=4132886 2024-09-12T00:42:26.165 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.169+0000 7fcde98768c0 1 < completed delete operation key=RC9A2Y5TCP9C tag=OTD02AQP0E6P type=del 2024-09-12T00:42:26.167 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.169+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=3HT0U6AQFNQM type=del size=2814477 2024-09-12T00:42:26.169 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.173+0000 7fcde98768c0 1 < completed delete operation key=R2EBH0Q5885L tag=UB01MH8L0MKW type=del 2024-09-12T00:42:26.171 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.173+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=14D66E1UWYFC type=del size=2349024 2024-09-12T00:42:26.174 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.177+0000 7fcde98768c0 1 < completed delete operation key=QD5JXFL962R5 tag=C8OXI76CTQXX type=del 2024-09-12T00:42:26.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.177+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=GZ1UDQZTYTR0 type=del size=2531385 2024-09-12T00:42:26.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.181+0000 7fcde98768c0 1 < completed delete operation key=TUMAMUZUIR7E tag=ZFQVKAEY2P8L type=del 2024-09-12T00:42:26.183 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.185+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~RBNGPLYGQFU0.0 size=1048576 2024-09-12T00:42:26.185 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.189+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~RBNGPLYGQFU0.1 size=1048576 2024-09-12T00:42:26.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.189+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~RBNGPLYGQFU0.2 size=995346 2024-09-12T00:42:26.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.189+0000 7fcde98768c0 1 > prepared multipart upload key=NVOFV649MT0A upload=RBNGPLYGQFU0 tag=BVHSZHBXO41N type=write size=4141074 2024-09-12T00:42:26.190 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.193+0000 7fcde98768c0 1 < suggested remove operation key=HVE3YQTFZWTV tag=83H4RUFS964J type=del 2024-09-12T00:42:26.192 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.193+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=AARPW16B36BB type=del size=2190747 2024-09-12T00:42:26.194 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.197+0000 7fcde98768c0 1 < completed delete operation key=Z1PY2MFUC1C4 tag=G5NAT02W9HX2 type=del 2024-09-12T00:42:26.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.197+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=53Q2JNSXUBVG type=del size=572654 2024-09-12T00:42:26.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.205+0000 7fcde98768c0 1 < suggested update operation key=IV4JCE1QJC70 tag=25CB4AWC4ZJM type=del size=2251703 2024-09-12T00:42:26.204 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.205+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~T0T3II19IU35.0 size=1048576 2024-09-12T00:42:26.205 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.209+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~T0T3II19IU35.1 size=938682 2024-09-12T00:42:26.206 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.209+0000 7fcde98768c0 1 > prepared multipart upload key=EDFNLQYP4L4L upload=T0T3II19IU35 tag=06NM0AZ48QIC type=write size=3035834 2024-09-12T00:42:26.209 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.213+0000 7fcde98768c0 1 < suggested update operation key=Z4RNDW37GEK6 tag=F89W8PNJX6NY type=write size=587362 2024-09-12T00:42:26.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.217+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~ZNLWOK6QHT1L.0 size=1048576 2024-09-12T00:42:26.215 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.217+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~ZNLWOK6QHT1L.1 size=773647 2024-09-12T00:42:26.215 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.217+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=ZNLWOK6QHT1L tag=1ZPPKASJEQYC type=write size=2870799 2024-09-12T00:42:26.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.221+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~BMU04XB8QPP0.0 size=1048576 2024-09-12T00:42:26.219 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.221+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~BMU04XB8QPP0.1 size=750529 2024-09-12T00:42:26.222 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.225+0000 7fcde98768c0 1 < completed multipart upload key=368TXYQVK9C3 upload=BMU04XB8QPP0 tag=9MUY64MLMU98 type=write size=2847681 2024-09-12T00:42:26.224 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.225+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=0MKD55XDO0FS type=write size=552222 2024-09-12T00:42:26.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.229+0000 7fcde98768c0 1 < completed delete operation key=NVOFV649MT0A tag=SX4EKS45DUI1 type=del 2024-09-12T00:42:26.230 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.233+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~03OCBL0IKE9W.0 size=929202 2024-09-12T00:42:26.230 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.233+0000 7fcde98768c0 1 > prepared multipart upload key=TUMAMUZUIR7E upload=03OCBL0IKE9W tag=2LGTBTNPS5QR type=write size=1977778 2024-09-12T00:42:26.232 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.233+0000 7fcde98768c0 1 < completed delete operation key=2T5IU2IUNGJX tag=QW7Z2U5XM8SR type=del 2024-09-12T00:42:26.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.237+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=QX0LY8ESVIEU type=del size=2957541 2024-09-12T00:42:26.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.237+0000 7fcde98768c0 1 < canceled operation key=R2EBH0Q5885L tag=S4OXE6PV847Q type=del size=3223926 2024-09-12T00:42:26.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.241+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=7F0T6FOLQJ10 type=del size=3081010 2024-09-12T00:42:26.240 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.241+0000 7fcde98768c0 1 < completed write operation key=WLE5QLNPAGZA tag=MSAG2570DB9C type=write size=602430 2024-09-12T00:42:26.242 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.245+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=1IM4LLPA1LYU type=del size=2915936 2024-09-12T00:42:26.245 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.249+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~QSEVGHYS748B.0 size=1048576 2024-09-12T00:42:26.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.249+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~QSEVGHYS748B.1 size=1048576 2024-09-12T00:42:26.249 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.253+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~QSEVGHYS748B.2 size=681984 2024-09-12T00:42:26.252 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.253+0000 7fcde98768c0 1 < completed multipart upload key=ZQD0QXDN1J1I upload=QSEVGHYS748B tag=RP0Z769PRL30 type=write size=3827712 2024-09-12T00:42:26.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.261+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~3IIJZNPEZOTB.0 size=536670 2024-09-12T00:42:26.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.261+0000 7fcde98768c0 1 > prepared multipart upload key=EDFNLQYP4L4L upload=3IIJZNPEZOTB tag=P8PXOIJLBBWU type=write size=1585246 2024-09-12T00:42:26.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.261+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~9UYPLV4V5YAC.0 size=1048576 2024-09-12T00:42:26.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.265+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~9UYPLV4V5YAC.1 size=432103 2024-09-12T00:42:26.264 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.269+0000 7fcde98768c0 1 < completed multipart upload key=BZ4YUNTMOJBK upload=9UYPLV4V5YAC tag=8XJOR2WASET1 type=write size=2529255 2024-09-12T00:42:26.267 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.269+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=JBHIMS88U0BG type=del size=778541 2024-09-12T00:42:26.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.273+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~J4NA5HMNQ2H5.0 size=1048576 2024-09-12T00:42:26.271 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.273+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~J4NA5HMNQ2H5.1 size=1048576 2024-09-12T00:42:26.273 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.277+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~J4NA5HMNQ2H5.2 size=987158 2024-09-12T00:42:26.277 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.281+0000 7fcde98768c0 1 < completed multipart upload key=IV4JCE1QJC70 upload=J4NA5HMNQ2H5 tag=IANPBG93QGKD type=write size=4132886 2024-09-12T00:42:26.280 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.281+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=HZA1N1HMGTAG type=del size=1836483 2024-09-12T00:42:26.282 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.285+0000 7fcde98768c0 -1 < failed to complete operation key=HVE3YQTFZWTV tag=3HT0U6AQFNQM type=del size=2814477: (22) Invalid argument 2024-09-12T00:42:26.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.289+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~W4AJVA6A9L13.0 size=1048576 2024-09-12T00:42:26.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.293+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~W4AJVA6A9L13.1 size=83152 2024-09-12T00:42:26.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.293+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=W4AJVA6A9L13 tag=E2XDIS9WB3TE type=write size=2180304 2024-09-12T00:42:26.291 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.293+0000 7fcde98768c0 1 < completed delete operation key=R2EBH0Q5885L tag=14D66E1UWYFC type=del 2024-09-12T00:42:26.293 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.297+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=B0W2R9R8BG92 type=del size=2406930 2024-09-12T00:42:26.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.297+0000 7fcde98768c0 1 < completed delete operation key=C6PW0ETP4BG2 tag=GZ1UDQZTYTR0 type=del 2024-09-12T00:42:26.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.301+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=4JW5EX3H4WTY type=del size=1413291 2024-09-12T00:42:26.301 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.305+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~RBNGPLYGQFU0.0 size=1048576 2024-09-12T00:42:26.303 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.305+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~RBNGPLYGQFU0.1 size=1048576 2024-09-12T00:42:26.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.309+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~RBNGPLYGQFU0.2 size=995346 2024-09-12T00:42:26.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.313+0000 7fcde98768c0 1 < completed multipart upload key=NVOFV649MT0A upload=RBNGPLYGQFU0 tag=BVHSZHBXO41N type=write size=4141074 2024-09-12T00:42:26.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.317+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~3D155FV2XOH9.0 size=340491 2024-09-12T00:42:26.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.317+0000 7fcde98768c0 1 > prepared multipart upload key=KME8ZTTUGOXY upload=3D155FV2XOH9 tag=5DYLOH79MWGM type=write size=1389067 2024-09-12T00:42:26.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.321+0000 7fcde98768c0 1 < suggested remove operation key=NVOFV649MT0A tag=AARPW16B36BB type=del 2024-09-12T00:42:26.320 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.325+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=YPFTARLXDFM1 type=del size=3823891 2024-09-12T00:42:26.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.325+0000 7fcde98768c0 -1 < failed to complete operation key=Z4RNDW37GEK6 tag=53Q2JNSXUBVG type=del size=572654: (22) Invalid argument 2024-09-12T00:42:26.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.329+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=9U38U3P3ABSQ type=del size=484959 2024-09-12T00:42:26.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.333+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~T0T3II19IU35.0 size=1048576 2024-09-12T00:42:26.330 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.333+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~T0T3II19IU35.1 size=938682 2024-09-12T00:42:26.334 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.337+0000 7fcde98768c0 1 < completed multipart upload key=EDFNLQYP4L4L upload=T0T3II19IU35 tag=06NM0AZ48QIC type=write size=3035834 2024-09-12T00:42:26.336 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.341+0000 7fcde98768c0 1 > prepared operation key=KME8ZTTUGOXY tag=THTXA68HD175 type=write size=584949 2024-09-12T00:42:26.339 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.341+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~ZNLWOK6QHT1L.0 size=1048576 2024-09-12T00:42:26.339 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.341+0000 7fcde98768c0 1 < canceled part key=_multipart_IV4JCE1QJC70.2~ZNLWOK6QHT1L.1 size=773647 2024-09-12T00:42:26.342 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.345+0000 7fcde98768c0 1 < canceled multipart upload key=IV4JCE1QJC70 upload=ZNLWOK6QHT1L tag=1ZPPKASJEQYC type=write size=2870799 2024-09-12T00:42:26.345 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.349+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=UVRGCT6ZGML4 type=del size=1204080 2024-09-12T00:42:26.347 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.349+0000 7fcde98768c0 1 < completed write operation key=ZQD0QXDN1J1I tag=0MKD55XDO0FS type=write size=552222 2024-09-12T00:42:26.351 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.353+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~VIUHYMBQH0DQ.0 size=1048576 2024-09-12T00:42:26.353 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.357+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~VIUHYMBQH0DQ.1 size=928534 2024-09-12T00:42:26.353 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.357+0000 7fcde98768c0 1 > prepared multipart upload key=IMITNCB1ST9E upload=VIUHYMBQH0DQ tag=HPYMNOFZ5RCM type=write size=3025686 2024-09-12T00:42:26.355 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.357+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~03OCBL0IKE9W.0 size=929202 2024-09-12T00:42:26.359 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.361+0000 7fcde98768c0 1 < completed multipart upload key=TUMAMUZUIR7E upload=03OCBL0IKE9W tag=2LGTBTNPS5QR type=write size=1977778 2024-09-12T00:42:26.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.365+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=CNFUNI7SE6MA type=write size=581537 2024-09-12T00:42:26.363 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.365+0000 7fcde98768c0 1 < completed delete operation key=5YBVLUYJW40U tag=QX0LY8ESVIEU type=del 2024-09-12T00:42:26.365 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.369+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=DRM3WZTFETHK type=del size=1276613 2024-09-12T00:42:26.367 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.369+0000 7fcde98768c0 1 < completed delete operation key=RC9A2Y5TCP9C tag=7F0T6FOLQJ10 type=del 2024-09-12T00:42:26.371 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.373+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~R12B80CI9013.0 size=914645 2024-09-12T00:42:26.371 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.373+0000 7fcde98768c0 1 > prepared multipart upload key=KME8ZTTUGOXY upload=R12B80CI9013 tag=WS218Y29NALH type=write size=1963221 2024-09-12T00:42:26.374 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.377+0000 7fcde98768c0 1 < completed delete operation key=QD5JXFL962R5 tag=1IM4LLPA1LYU type=del 2024-09-12T00:42:26.376 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.377+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=NL4093LRIE58 type=del size=1596871 2024-09-12T00:42:26.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.381+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~3IIJZNPEZOTB.0 size=536670 2024-09-12T00:42:26.382 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.385+0000 7fcde98768c0 1 < completed multipart upload key=EDFNLQYP4L4L upload=3IIJZNPEZOTB tag=P8PXOIJLBBWU type=write size=1585246 2024-09-12T00:42:26.384 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.389+0000 7fcde98768c0 1 > prepared operation key=KME8ZTTUGOXY tag=SHQH2CK2NL9Z type=del size=1668839 2024-09-12T00:42:26.390 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.393+0000 7fcde98768c0 1 < suggested update operation key=IMITNCB1ST9E tag=JBHIMS88U0BG type=del size=778541 2024-09-12T00:42:26.392 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.397+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=6E870J3BHGL7 type=del size=3227676 2024-09-12T00:42:26.395 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.397+0000 7fcde98768c0 1 < completed delete operation key=Z1PY2MFUC1C4 tag=HZA1N1HMGTAG type=del 2024-09-12T00:42:26.400 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.401+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~D6Q7317SLCC4.0 size=1048576 2024-09-12T00:42:26.402 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.405+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~D6Q7317SLCC4.1 size=1048576 2024-09-12T00:42:26.404 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.405+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~D6Q7317SLCC4.2 size=361683 2024-09-12T00:42:26.404 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.405+0000 7fcde98768c0 1 > prepared multipart upload key=BQGIXJJWBAN0 upload=D6Q7317SLCC4 tag=JNZ9GO6N3ILO type=write size=3507411 2024-09-12T00:42:26.404 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.409+0000 7fcde98768c0 1 < canceled part key=_multipart_IV4JCE1QJC70.2~W4AJVA6A9L13.0 size=1048576 2024-09-12T00:42:26.406 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.409+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~W4AJVA6A9L13.1 size=83152 2024-09-12T00:42:26.410 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.413+0000 7fcde98768c0 1 < canceled multipart upload key=IV4JCE1QJC70 upload=W4AJVA6A9L13 tag=E2XDIS9WB3TE type=write size=2180304 2024-09-12T00:42:26.413 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.417+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=ZIP01LM73ZYZ type=write size=699371 2024-09-12T00:42:26.415 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.417+0000 7fcde98768c0 1 < completed delete operation key=3X9I78PMR1HV tag=B0W2R9R8BG92 type=del 2024-09-12T00:42:26.418 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.421+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=C9OKN4GSG356 type=del size=1354323 2024-09-12T00:42:26.421 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.425+0000 7fcde98768c0 1 < completed delete operation key=2T5IU2IUNGJX tag=4JW5EX3H4WTY type=del 2024-09-12T00:42:26.423 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.425+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=BOGCUUSZU9P2 type=write size=863056 2024-09-12T00:42:26.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.429+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~3D155FV2XOH9.0 size=340491 2024-09-12T00:42:26.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.437+0000 7fcde98768c0 1 < completed multipart upload key=KME8ZTTUGOXY upload=3D155FV2XOH9 tag=5DYLOH79MWGM type=write size=1389067 2024-09-12T00:42:26.439 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.441+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~C8YAG1HCH9SV.0 size=1048576 2024-09-12T00:42:26.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.445+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~C8YAG1HCH9SV.1 size=1048576 2024-09-12T00:42:26.443 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.445+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~C8YAG1HCH9SV.2 size=1047596 2024-09-12T00:42:26.443 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.445+0000 7fcde98768c0 1 > prepared multipart upload key=ZQD0QXDN1J1I upload=C8YAG1HCH9SV tag=RMZE1AAKA7PE type=write size=4193324 2024-09-12T00:42:26.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.453+0000 7fcde98768c0 1 < suggested remove operation key=368TXYQVK9C3 tag=YPFTARLXDFM1 type=del 2024-09-12T00:42:26.455 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.457+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~93ZJ7HASC7ZL.0 size=840647 2024-09-12T00:42:26.455 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.457+0000 7fcde98768c0 1 > prepared multipart upload key=JW2GNFAYFNEK upload=93ZJ7HASC7ZL tag=E25MM9SMHWDV type=write size=1889223 2024-09-12T00:42:26.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.461+0000 7fcde98768c0 1 < completed delete operation key=FUJIUIR1E00J tag=9U38U3P3ABSQ type=del 2024-09-12T00:42:26.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.465+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~788G42DIH74G.0 size=1048576 2024-09-12T00:42:26.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.469+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~788G42DIH74G.1 size=1048576 2024-09-12T00:42:26.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.469+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~788G42DIH74G.2 size=1036816 2024-09-12T00:42:26.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.469+0000 7fcde98768c0 1 > prepared multipart upload key=EDFNLQYP4L4L upload=788G42DIH74G tag=CNMR5JMPDB3H type=write size=4182544 2024-09-12T00:42:26.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.473+0000 7fcde98768c0 1 < suggested update operation key=KME8ZTTUGOXY tag=THTXA68HD175 type=write size=584949 2024-09-12T00:42:26.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.477+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=ZB8J2Q96ZH5R type=del size=825555 2024-09-12T00:42:26.477 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.481+0000 7fcde98768c0 1 < completed delete operation key=C6PW0ETP4BG2 tag=UVRGCT6ZGML4 type=del 2024-09-12T00:42:26.482 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.485+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~DPPQLCZJV37Q.0 size=1048576 2024-09-12T00:42:26.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.485+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~DPPQLCZJV37Q.1 size=1048576 2024-09-12T00:42:26.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.489+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~DPPQLCZJV37Q.2 size=364871 2024-09-12T00:42:26.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.489+0000 7fcde98768c0 1 > prepared multipart upload key=ZQD0QXDN1J1I upload=DPPQLCZJV37Q tag=IY9XUC7HI0GP type=write size=3510599 2024-09-12T00:42:26.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.493+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~VIUHYMBQH0DQ.0 size=1048576 2024-09-12T00:42:26.490 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.493+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~VIUHYMBQH0DQ.1 size=928534 2024-09-12T00:42:26.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.497+0000 7fcde98768c0 1 < completed multipart upload key=IMITNCB1ST9E upload=VIUHYMBQH0DQ tag=HPYMNOFZ5RCM type=write size=3025686 2024-09-12T00:42:26.496 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.497+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=84Y7ZBB1G14A type=del size=1911736 2024-09-12T00:42:26.498 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.501+0000 7fcde98768c0 1 < completed write operation key=F813QWV02TI0 tag=CNFUNI7SE6MA type=write size=581537 2024-09-12T00:42:26.500 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.505+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=QYPJACED3E8K type=del size=2847298 2024-09-12T00:42:26.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.509+0000 7fcde98768c0 1 < suggested update operation key=IV4JCE1QJC70 tag=DRM3WZTFETHK type=del size=1276613 2024-09-12T00:42:26.507 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.509+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=EG3HMJQP2XJ7 type=del size=1629308 2024-09-12T00:42:26.507 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.509+0000 7fcde98768c0 1 < canceled part key=_multipart_KME8ZTTUGOXY.2~R12B80CI9013.0 size=914645 2024-09-12T00:42:26.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.513+0000 7fcde98768c0 1 < canceled multipart upload key=KME8ZTTUGOXY upload=R12B80CI9013 tag=WS218Y29NALH type=write size=1963221 2024-09-12T00:42:26.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.517+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~GHDGRUT0X0OQ.0 size=1048576 2024-09-12T00:42:26.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.521+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~GHDGRUT0X0OQ.1 size=1015090 2024-09-12T00:42:26.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.521+0000 7fcde98768c0 1 > prepared multipart upload key=C6PW0ETP4BG2 upload=GHDGRUT0X0OQ tag=7W33A3S4H39R type=write size=3112242 2024-09-12T00:42:26.519 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.521+0000 7fcde98768c0 -1 < failed to complete operation key=IV4JCE1QJC70 tag=NL4093LRIE58 type=del size=1596871: (22) Invalid argument 2024-09-12T00:42:26.523 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.525+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~RBD18W6H3Y1Q.0 size=1048576 2024-09-12T00:42:26.525 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.529+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~RBD18W6H3Y1Q.1 size=1048576 2024-09-12T00:42:26.527 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.529+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~RBD18W6H3Y1Q.2 size=832965 2024-09-12T00:42:26.527 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.529+0000 7fcde98768c0 1 > prepared multipart upload key=3X9I78PMR1HV upload=RBD18W6H3Y1Q tag=PGXTN6GZ5ZHL type=write size=3978693 2024-09-12T00:42:26.529 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.533+0000 7fcde98768c0 -1 < failed to complete operation key=KME8ZTTUGOXY tag=SHQH2CK2NL9Z type=del size=1668839: (22) Invalid argument 2024-09-12T00:42:26.533 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.537+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~V1GCPZNLBQG2.0 size=1048576 2024-09-12T00:42:26.536 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.537+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~V1GCPZNLBQG2.1 size=870760 2024-09-12T00:42:26.536 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.537+0000 7fcde98768c0 1 > prepared multipart upload key=Z4RNDW37GEK6 upload=V1GCPZNLBQG2 tag=MR5YLMOT551N type=write size=2967912 2024-09-12T00:42:26.538 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.541+0000 7fcde98768c0 1 < completed delete operation key=F813QWV02TI0 tag=6E870J3BHGL7 type=del 2024-09-12T00:42:26.542 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.545+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~3POUZFIZXRNN.0 size=1048576 2024-09-12T00:42:26.544 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.545+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~3POUZFIZXRNN.1 size=1048576 2024-09-12T00:42:26.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.549+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~3POUZFIZXRNN.2 size=942242 2024-09-12T00:42:26.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.549+0000 7fcde98768c0 1 > prepared multipart upload key=4487IMSOLPDV upload=3POUZFIZXRNN tag=IQZNO867XSYZ type=write size=4087970 2024-09-12T00:42:26.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.549+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~D6Q7317SLCC4.0 size=1048576 2024-09-12T00:42:26.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.553+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~D6Q7317SLCC4.1 size=1048576 2024-09-12T00:42:26.552 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.553+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~D6Q7317SLCC4.2 size=361683 2024-09-12T00:42:26.556 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.557+0000 7fcde98768c0 1 < completed multipart upload key=BQGIXJJWBAN0 upload=D6Q7317SLCC4 tag=JNZ9GO6N3ILO type=write size=3507411 2024-09-12T00:42:26.560 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.561+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~VNMXL0YKPWBF.0 size=415141 2024-09-12T00:42:26.560 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.561+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=VNMXL0YKPWBF tag=LUUALBVFRZS8 type=write size=1463717 2024-09-12T00:42:26.562 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.565+0000 7fcde98768c0 1 < completed write operation key=R2EBH0Q5885L tag=ZIP01LM73ZYZ type=write size=699371 2024-09-12T00:42:26.564 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.565+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=ACNSFYO87KUI type=del size=1396309 2024-09-12T00:42:26.568 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.569+0000 7fcde98768c0 1 < suggested remove operation key=TUMAMUZUIR7E tag=C9OKN4GSG356 type=del 2024-09-12T00:42:26.570 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.573+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=MCAZMER8N9NM type=del size=138466 2024-09-12T00:42:26.572 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.577+0000 7fcde98768c0 1 < completed write operation key=IMITNCB1ST9E tag=BOGCUUSZU9P2 type=write size=863056 2024-09-12T00:42:26.574 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.577+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=4A0JMWH7LSNE type=del size=3559614 2024-09-12T00:42:26.577 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.581+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~C8YAG1HCH9SV.0 size=1048576 2024-09-12T00:42:26.579 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.581+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~C8YAG1HCH9SV.1 size=1048576 2024-09-12T00:42:26.579 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.581+0000 7fcde98768c0 1 < canceled part key=_multipart_ZQD0QXDN1J1I.2~C8YAG1HCH9SV.2 size=1047596 2024-09-12T00:42:26.583 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.585+0000 7fcde98768c0 1 < canceled multipart upload key=ZQD0QXDN1J1I upload=C8YAG1HCH9SV tag=RMZE1AAKA7PE type=write size=4193324 2024-09-12T00:42:26.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.589+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=B07A6N4UTNQ4 type=del size=387330 2024-09-12T00:42:26.587 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.589+0000 7fcde98768c0 1 < canceled part key=_multipart_JW2GNFAYFNEK.2~93ZJ7HASC7ZL.0 size=840647 2024-09-12T00:42:26.590 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.593+0000 7fcde98768c0 1 < canceled multipart upload key=JW2GNFAYFNEK upload=93ZJ7HASC7ZL tag=E25MM9SMHWDV type=write size=1889223 2024-09-12T00:42:26.592 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.597+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=L627TKTXV0IB type=del size=3799781 2024-09-12T00:42:26.595 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.597+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~788G42DIH74G.0 size=1048576 2024-09-12T00:42:26.596 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.601+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~788G42DIH74G.1 size=1048576 2024-09-12T00:42:26.598 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.601+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~788G42DIH74G.2 size=1036816 2024-09-12T00:42:26.603 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.605+0000 7fcde98768c0 1 < completed multipart upload key=EDFNLQYP4L4L upload=788G42DIH74G tag=CNMR5JMPDB3H type=write size=4182544 2024-09-12T00:42:26.606 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.609+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=RXSKOMP01CPF type=del size=3156154 2024-09-12T00:42:26.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.609+0000 7fcde98768c0 1 < completed delete operation key=V80E1NH858IK tag=ZB8J2Q96ZH5R type=del 2024-09-12T00:42:26.613 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.617+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~AZAOGZ9FEZMI.0 size=354805 2024-09-12T00:42:26.613 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.617+0000 7fcde98768c0 1 > prepared multipart upload key=3X9I78PMR1HV upload=AZAOGZ9FEZMI tag=GFRC7958WQV3 type=write size=1403381 2024-09-12T00:42:26.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.617+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~DPPQLCZJV37Q.0 size=1048576 2024-09-12T00:42:26.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.617+0000 7fcde98768c0 1 < canceled part key=_multipart_ZQD0QXDN1J1I.2~DPPQLCZJV37Q.1 size=1048576 2024-09-12T00:42:26.617 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.621+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~DPPQLCZJV37Q.2 size=364871 2024-09-12T00:42:26.621 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.625+0000 7fcde98768c0 1 < canceled multipart upload key=ZQD0QXDN1J1I upload=DPPQLCZJV37Q tag=IY9XUC7HI0GP type=write size=3510599 2024-09-12T00:42:26.626 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.629+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~ZNYT09DBZI5E.0 size=439489 2024-09-12T00:42:26.626 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.629+0000 7fcde98768c0 1 > prepared multipart upload key=C6PW0ETP4BG2 upload=ZNYT09DBZI5E tag=2EHAMBU930BI type=write size=1488065 2024-09-12T00:42:26.631 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.633+0000 7fcde98768c0 1 < suggested update operation key=IV4JCE1QJC70 tag=84Y7ZBB1G14A type=del size=1911736 2024-09-12T00:42:26.636 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.637+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=W29UASPS354V type=del size=1179994 2024-09-12T00:42:26.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.641+0000 7fcde98768c0 1 < suggested update operation key=V80E1NH858IK tag=QYPJACED3E8K type=del size=2847298 2024-09-12T00:42:26.641 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.645+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=HUOLE492HC44 type=del size=3546794 2024-09-12T00:42:26.644 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.645+0000 7fcde98768c0 1 < completed delete operation key=HVE3YQTFZWTV tag=EG3HMJQP2XJ7 type=del 2024-09-12T00:42:26.647 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.649+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=4LV536WIFHCF type=del size=3075842 2024-09-12T00:42:26.649 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.653+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~GHDGRUT0X0OQ.0 size=1048576 2024-09-12T00:42:26.649 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.653+0000 7fcde98768c0 1 < canceled part key=_multipart_C6PW0ETP4BG2.2~GHDGRUT0X0OQ.1 size=1015090 2024-09-12T00:42:26.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.657+0000 7fcde98768c0 1 < canceled multipart upload key=C6PW0ETP4BG2 upload=GHDGRUT0X0OQ tag=7W33A3S4H39R type=write size=3112242 2024-09-12T00:42:26.661 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.665+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~3AAMSB8VR15F.0 size=969562 2024-09-12T00:42:26.661 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.665+0000 7fcde98768c0 1 > prepared multipart upload key=EDFNLQYP4L4L upload=3AAMSB8VR15F tag=89SHO8XACSY7 type=write size=2018138 2024-09-12T00:42:26.662 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.665+0000 7fcde98768c0 1 < canceled part key=_multipart_3X9I78PMR1HV.2~RBD18W6H3Y1Q.0 size=1048576 2024-09-12T00:42:26.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.665+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~RBD18W6H3Y1Q.1 size=1048576 2024-09-12T00:42:26.666 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.669+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~RBD18W6H3Y1Q.2 size=832965 2024-09-12T00:42:26.671 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.673+0000 7fcde98768c0 1 < canceled multipart upload key=3X9I78PMR1HV upload=RBD18W6H3Y1Q tag=PGXTN6GZ5ZHL type=write size=3978693 2024-09-12T00:42:26.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.681+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~KTFO5F16BIRA.0 size=1048576 2024-09-12T00:42:26.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.681+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~KTFO5F16BIRA.1 size=240190 2024-09-12T00:42:26.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.681+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=KTFO5F16BIRA tag=GELD443QFA1M type=write size=2337342 2024-09-12T00:42:26.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.685+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~V1GCPZNLBQG2.0 size=1048576 2024-09-12T00:42:26.684 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.685+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~V1GCPZNLBQG2.1 size=870760 2024-09-12T00:42:26.689 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.693+0000 7fcde98768c0 1 < completed multipart upload key=Z4RNDW37GEK6 upload=V1GCPZNLBQG2 tag=MR5YLMOT551N type=write size=2967912 2024-09-12T00:42:26.691 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.693+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=H818HJFY5B2N type=del size=852150 2024-09-12T00:42:26.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.697+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~3POUZFIZXRNN.0 size=1048576 2024-09-12T00:42:26.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.701+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~3POUZFIZXRNN.1 size=1048576 2024-09-12T00:42:26.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.701+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~3POUZFIZXRNN.2 size=942242 2024-09-12T00:42:26.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.705+0000 7fcde98768c0 1 < completed multipart upload key=4487IMSOLPDV upload=3POUZFIZXRNN tag=IQZNO867XSYZ type=write size=4087970 2024-09-12T00:42:26.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.713+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~IKIWUDEED9JN.0 size=391135 2024-09-12T00:42:26.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.713+0000 7fcde98768c0 1 > prepared multipart upload key=3X9I78PMR1HV upload=IKIWUDEED9JN tag=BF5ZRLS9BR9Y type=write size=1439711 2024-09-12T00:42:26.712 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.717+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~VNMXL0YKPWBF.0 size=415141 2024-09-12T00:42:26.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.721+0000 7fcde98768c0 1 < completed multipart upload key=V80E1NH858IK upload=VNMXL0YKPWBF tag=LUUALBVFRZS8 type=write size=1463717 2024-09-12T00:42:26.721 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.725+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=Q0ETS2DEAI5M type=write size=720958 2024-09-12T00:42:26.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.725+0000 7fcde98768c0 1 < completed delete operation key=F813QWV02TI0 tag=ACNSFYO87KUI type=del 2024-09-12T00:42:26.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.729+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=DWZUPQR8H7T0 type=del size=3546407 2024-09-12T00:42:26.730 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.733+0000 7fcde98768c0 1 < canceled operation key=WLE5QLNPAGZA tag=MCAZMER8N9NM type=del size=138466 2024-09-12T00:42:26.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.737+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=G23O0ICOUI0T type=del size=2844495 2024-09-12T00:42:26.735 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.737+0000 7fcde98768c0 1 < completed delete operation key=G6R8BX1H7SPM tag=4A0JMWH7LSNE type=del 2024-09-12T00:42:26.741 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.745+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~WLX21DQYTNN2.0 size=1048576 2024-09-12T00:42:26.744 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.745+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~WLX21DQYTNN2.1 size=1048576 2024-09-12T00:42:26.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.749+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~WLX21DQYTNN2.2 size=519590 2024-09-12T00:42:26.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.749+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=WLX21DQYTNN2 tag=4IEX4EI9OG44 type=write size=3665318 2024-09-12T00:42:26.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.753+0000 7fcde98768c0 -1 < failed to complete operation key=V80E1NH858IK tag=B07A6N4UTNQ4 type=del size=387330: (22) Invalid argument 2024-09-12T00:42:26.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.757+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~R25CFZCMBL15.0 size=806309 2024-09-12T00:42:26.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.757+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=R25CFZCMBL15 tag=YY4GCCG99B3C type=write size=1854885 2024-09-12T00:42:26.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.761+0000 7fcde98768c0 1 < suggested update operation key=C6PW0ETP4BG2 tag=L627TKTXV0IB type=del size=3799781 2024-09-12T00:42:26.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.765+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=WVEN0XFROKXH type=write size=298231 2024-09-12T00:42:26.766 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.769+0000 7fcde98768c0 -1 < failed to complete operation key=C6PW0ETP4BG2 tag=RXSKOMP01CPF type=del size=3156154: (22) Invalid argument 2024-09-12T00:42:26.769 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.773+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=6I4VWM5JSPI8 type=del size=2246458 2024-09-12T00:42:26.772 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.773+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~AZAOGZ9FEZMI.0 size=354805 2024-09-12T00:42:26.777 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.781+0000 7fcde98768c0 1 < completed multipart upload key=3X9I78PMR1HV upload=AZAOGZ9FEZMI tag=GFRC7958WQV3 type=write size=1403381 2024-09-12T00:42:26.780 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.781+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=V9YAVJDQNFKY type=del size=1150942 2024-09-12T00:42:26.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.785+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~ZNYT09DBZI5E.0 size=439489 2024-09-12T00:42:26.788 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.789+0000 7fcde98768c0 1 < completed multipart upload key=C6PW0ETP4BG2 upload=ZNYT09DBZI5E tag=2EHAMBU930BI type=write size=1488065 2024-09-12T00:42:26.791 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.793+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=MYQS1RQADHFI type=write size=921453 2024-09-12T00:42:26.799 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.801+0000 7fcde98768c0 1 < suggested update operation key=WLE5QLNPAGZA tag=W29UASPS354V type=del size=1179994 2024-09-12T00:42:26.802 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.805+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=3WGK30S1TVWN type=write size=271476 2024-09-12T00:42:26.806 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.809+0000 7fcde98768c0 1 < completed delete operation key=5YBVLUYJW40U tag=HUOLE492HC44 type=del 2024-09-12T00:42:26.810 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.813+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=SVRMCEVAK9JS type=write size=654398 2024-09-12T00:42:26.816 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.821+0000 7fcde98768c0 1 < suggested update operation key=368TXYQVK9C3 tag=4LV536WIFHCF type=del size=3075842 2024-09-12T00:42:26.820 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.821+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=6N1TAM0557K0 type=del size=2624011 2024-09-12T00:42:26.824 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.825+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~3AAMSB8VR15F.0 size=969562 2024-09-12T00:42:26.829 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.833+0000 7fcde98768c0 1 < completed multipart upload key=EDFNLQYP4L4L upload=3AAMSB8VR15F tag=89SHO8XACSY7 type=write size=2018138 2024-09-12T00:42:26.836 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.837+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~RE1Z6J6Y3MU6.0 size=1048576 2024-09-12T00:42:26.839 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.841+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~RE1Z6J6Y3MU6.1 size=1048576 2024-09-12T00:42:26.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.845+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~RE1Z6J6Y3MU6.2 size=987421 2024-09-12T00:42:26.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.845+0000 7fcde98768c0 1 > prepared multipart upload key=97030NBF3MI4 upload=RE1Z6J6Y3MU6 tag=9VOAQBCITP6M type=write size=4133149 2024-09-12T00:42:26.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.849+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~KTFO5F16BIRA.0 size=1048576 2024-09-12T00:42:26.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.849+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~KTFO5F16BIRA.1 size=240190 2024-09-12T00:42:26.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.857+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=KTFO5F16BIRA tag=GELD443QFA1M type=write size=2337342 2024-09-12T00:42:26.860 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.861+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~K3R2BQABMB6D.0 size=1048576 2024-09-12T00:42:26.863 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.865+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~K3R2BQABMB6D.1 size=893710 2024-09-12T00:42:26.863 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.865+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=K3R2BQABMB6D tag=V0PAXUD7EBWZ type=write size=2990862 2024-09-12T00:42:26.869 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.873+0000 7fcde98768c0 1 < suggested remove operation key=QD5JXFL962R5 tag=H818HJFY5B2N type=del 2024-09-12T00:42:26.872 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.873+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=9RAPUBCM62ZA type=del size=3295456 2024-09-12T00:42:26.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.877+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~IKIWUDEED9JN.0 size=391135 2024-09-12T00:42:26.880 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.881+0000 7fcde98768c0 1 < completed multipart upload key=3X9I78PMR1HV upload=IKIWUDEED9JN tag=BF5ZRLS9BR9Y type=write size=1439711 2024-09-12T00:42:26.883 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.885+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=LU6SW9K1G070 type=del size=3654179 2024-09-12T00:42:26.885 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.889+0000 7fcde98768c0 1 < canceled operation key=Z4RNDW37GEK6 tag=Q0ETS2DEAI5M type=write size=720958 2024-09-12T00:42:26.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.889+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=S6O01RCKS3MT type=del size=2571749 2024-09-12T00:42:26.893 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.897+0000 7fcde98768c0 1 < suggested update operation key=J9EUM073CZHF tag=DWZUPQR8H7T0 type=del size=3546407 2024-09-12T00:42:26.895 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.897+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=BEGCUR3N83BJ type=del size=19861 2024-09-12T00:42:26.898 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.901+0000 7fcde98768c0 1 < completed delete operation key=IMITNCB1ST9E tag=G23O0ICOUI0T type=del 2024-09-12T00:42:26.903 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.905+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~ALQWC0SV1QJM.0 size=1048576 2024-09-12T00:42:26.905 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.909+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~ALQWC0SV1QJM.1 size=1048576 2024-09-12T00:42:26.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.909+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~ALQWC0SV1QJM.2 size=204796 2024-09-12T00:42:26.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.909+0000 7fcde98768c0 1 > prepared multipart upload key=JW2GNFAYFNEK upload=ALQWC0SV1QJM tag=ADAPSW3F1L2R type=write size=3350524 2024-09-12T00:42:26.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.913+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~WLX21DQYTNN2.0 size=1048576 2024-09-12T00:42:26.912 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.913+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~WLX21DQYTNN2.1 size=1048576 2024-09-12T00:42:26.914 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.917+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~WLX21DQYTNN2.2 size=519590 2024-09-12T00:42:26.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.921+0000 7fcde98768c0 1 < completed multipart upload key=BZ4YUNTMOJBK upload=WLX21DQYTNN2 tag=4IEX4EI9OG44 type=write size=3665318 2024-09-12T00:42:26.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.925+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=OXEFD74MBTOZ type=write size=913671 2024-09-12T00:42:26.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.925+0000 7fcde98768c0 1 < canceled part key=_multipart_IV4JCE1QJC70.2~R25CFZCMBL15.0 size=806309 2024-09-12T00:42:26.925 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.929+0000 7fcde98768c0 1 < canceled multipart upload key=IV4JCE1QJC70 upload=R25CFZCMBL15 tag=YY4GCCG99B3C type=write size=1854885 2024-09-12T00:42:26.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.933+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~ZOSI8WQYOOIU.0 size=1048576 2024-09-12T00:42:26.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.933+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~ZOSI8WQYOOIU.1 size=1048576 2024-09-12T00:42:26.934 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.937+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~ZOSI8WQYOOIU.2 size=1008350 2024-09-12T00:42:26.934 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.937+0000 7fcde98768c0 1 > prepared multipart upload key=2T5IU2IUNGJX upload=ZOSI8WQYOOIU tag=AZG6CHSCI523 type=write size=4154078 2024-09-12T00:42:26.942 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.945+0000 7fcde98768c0 1 < suggested remove operation key=4487IMSOLPDV tag=WVEN0XFROKXH type=write 2024-09-12T00:42:26.945 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.949+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=R20FRDFP93M6 type=del size=1997836 2024-09-12T00:42:26.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.949+0000 7fcde98768c0 1 < completed delete operation key=7UR0FX8HA2A5 tag=6I4VWM5JSPI8 type=del 2024-09-12T00:42:26.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.953+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~ITDDNFAC3N7F.0 size=1048576 2024-09-12T00:42:26.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.957+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~ITDDNFAC3N7F.1 size=1048576 2024-09-12T00:42:26.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.961+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~ITDDNFAC3N7F.2 size=601096 2024-09-12T00:42:26.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.961+0000 7fcde98768c0 1 > prepared multipart upload key=C6PW0ETP4BG2 upload=ITDDNFAC3N7F tag=OY5CA3HFW63V type=write size=3746824 2024-09-12T00:42:26.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.961+0000 7fcde98768c0 1 < completed delete operation key=Z4RNDW37GEK6 tag=V9YAVJDQNFKY type=del 2024-09-12T00:42:26.962 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.965+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=PAEH8EKI7DAK type=write size=877598 2024-09-12T00:42:26.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.969+0000 7fcde98768c0 -1 < failed to complete operation key=QD5JXFL962R5 tag=MYQS1RQADHFI type=write size=921453: (22) Invalid argument 2024-09-12T00:42:26.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.973+0000 7fcde98768c0 1 > prepared operation key=KME8ZTTUGOXY tag=T6M99X92F2DS type=del size=1361400 2024-09-12T00:42:26.972 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.973+0000 7fcde98768c0 1 < completed write operation key=TUMAMUZUIR7E tag=3WGK30S1TVWN type=write size=271476 2024-09-12T00:42:26.978 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.981+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~JK7FW9GKFNDI.0 size=1048576 2024-09-12T00:42:26.981 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.985+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~JK7FW9GKFNDI.1 size=492220 2024-09-12T00:42:26.981 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.985+0000 7fcde98768c0 1 > prepared multipart upload key=3QOENE572J7A upload=JK7FW9GKFNDI tag=DCS16H17QOD5 type=write size=2589372 2024-09-12T00:42:26.984 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.985+0000 7fcde98768c0 -1 < failed to complete operation key=4487IMSOLPDV tag=SVRMCEVAK9JS type=write size=654398: (22) Invalid argument 2024-09-12T00:42:26.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.993+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~NMB934WR6PPW.0 size=1048576 2024-09-12T00:42:26.992 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.993+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~NMB934WR6PPW.1 size=1048576 2024-09-12T00:42:26.994 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.997+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~NMB934WR6PPW.2 size=394433 2024-09-12T00:42:26.994 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:26.997+0000 7fcde98768c0 1 > prepared multipart upload key=WLE5QLNPAGZA upload=NMB934WR6PPW tag=Z5TD90A3Z8X9 type=write size=3540161 2024-09-12T00:42:26.997 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.001+0000 7fcde98768c0 1 < canceled operation key=EDFNLQYP4L4L tag=6N1TAM0557K0 type=del size=2624011 2024-09-12T00:42:27.000 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.001+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=QVN2PB9XCVPG type=write size=275410 2024-09-12T00:42:27.003 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.005+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~RE1Z6J6Y3MU6.0 size=1048576 2024-09-12T00:42:27.006 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.009+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~RE1Z6J6Y3MU6.1 size=1048576 2024-09-12T00:42:27.008 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.009+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~RE1Z6J6Y3MU6.2 size=987421 2024-09-12T00:42:27.013 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.017+0000 7fcde98768c0 1 < completed multipart upload key=97030NBF3MI4 upload=RE1Z6J6Y3MU6 tag=9VOAQBCITP6M type=write size=4133149 2024-09-12T00:42:27.015 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.017+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=13TRTMGCI0SV type=del size=3621726 2024-09-12T00:42:27.018 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.021+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~K3R2BQABMB6D.0 size=1048576 2024-09-12T00:42:27.018 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.021+0000 7fcde98768c0 1 < canceled part key=_multipart_G6R8BX1H7SPM.2~K3R2BQABMB6D.1 size=893710 2024-09-12T00:42:27.023 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.025+0000 7fcde98768c0 1 < canceled multipart upload key=G6R8BX1H7SPM upload=K3R2BQABMB6D tag=V0PAXUD7EBWZ type=write size=2990862 2024-09-12T00:42:27.025 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.029+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=TTPZ97YGEBLG type=del size=4105480 2024-09-12T00:42:27.028 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.029+0000 7fcde98768c0 1 < completed delete operation key=IV4JCE1QJC70 tag=9RAPUBCM62ZA type=del 2024-09-12T00:42:27.031 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.033+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=0OCIXVUI62Y3 type=del size=1685177 2024-09-12T00:42:27.034 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.037+0000 7fcde98768c0 1 < completed delete operation key=368TXYQVK9C3 tag=LU6SW9K1G070 type=del 2024-09-12T00:42:27.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.041+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~K2MXSRYESTGJ.0 size=1048576 2024-09-12T00:42:27.042 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.045+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~K2MXSRYESTGJ.1 size=1048576 2024-09-12T00:42:27.044 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.045+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~K2MXSRYESTGJ.2 size=123622 2024-09-12T00:42:27.044 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.045+0000 7fcde98768c0 1 > prepared multipart upload key=368TXYQVK9C3 upload=K2MXSRYESTGJ tag=IN4WQE5JY415 type=write size=3269350 2024-09-12T00:42:27.048 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.049+0000 7fcde98768c0 -1 < failed to complete operation key=J9EUM073CZHF tag=S6O01RCKS3MT type=del size=2571749: (22) Invalid argument 2024-09-12T00:42:27.049 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.053+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=TERBPETVRJT2 type=del size=1062064 2024-09-12T00:42:27.052 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.057+0000 7fcde98768c0 1 < completed delete operation key=5B8C6E8L5N52 tag=BEGCUR3N83BJ type=del 2024-09-12T00:42:27.058 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.061+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~R4YEUZ2107RE.0 size=1048576 2024-09-12T00:42:27.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.061+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~R4YEUZ2107RE.1 size=1048576 2024-09-12T00:42:27.062 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.065+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~R4YEUZ2107RE.2 size=990471 2024-09-12T00:42:27.062 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.065+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=R4YEUZ2107RE tag=3HYJHKMERNIG type=write size=4136199 2024-09-12T00:42:27.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.069+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~ALQWC0SV1QJM.0 size=1048576 2024-09-12T00:42:27.067 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.069+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~ALQWC0SV1QJM.1 size=1048576 2024-09-12T00:42:27.070 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.073+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~ALQWC0SV1QJM.2 size=204796 2024-09-12T00:42:27.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.077+0000 7fcde98768c0 1 < completed multipart upload key=JW2GNFAYFNEK upload=ALQWC0SV1QJM tag=ADAPSW3F1L2R type=write size=3350524 2024-09-12T00:42:27.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.085+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~NIK7B8N87NNY.0 size=1048576 2024-09-12T00:42:27.083 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.085+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~NIK7B8N87NNY.1 size=1048576 2024-09-12T00:42:27.086 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.089+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~NIK7B8N87NNY.2 size=321706 2024-09-12T00:42:27.086 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.089+0000 7fcde98768c0 1 > prepared multipart upload key=2T5IU2IUNGJX upload=NIK7B8N87NNY tag=Q7VWNKPCTJXY type=write size=3467434 2024-09-12T00:42:27.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.093+0000 7fcde98768c0 1 < suggested remove operation key=5YBVLUYJW40U tag=OXEFD74MBTOZ type=write 2024-09-12T00:42:27.094 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.097+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=G0B0G9QQNEWC type=write size=539155 2024-09-12T00:42:27.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.101+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~ZOSI8WQYOOIU.0 size=1048576 2024-09-12T00:42:27.100 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.101+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~ZOSI8WQYOOIU.1 size=1048576 2024-09-12T00:42:27.102 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.105+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~ZOSI8WQYOOIU.2 size=1008350 2024-09-12T00:42:27.108 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.109+0000 7fcde98768c0 1 < completed multipart upload key=2T5IU2IUNGJX upload=ZOSI8WQYOOIU tag=AZG6CHSCI523 type=write size=4154078 2024-09-12T00:42:27.114 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.117+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~KT6W12D54EAO.0 size=559794 2024-09-12T00:42:27.114 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.117+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=KT6W12D54EAO tag=53QZVPBO0FFZ type=write size=1608370 2024-09-12T00:42:27.118 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.121+0000 7fcde98768c0 1 < completed delete operation key=JW2GNFAYFNEK tag=R20FRDFP93M6 type=del 2024-09-12T00:42:27.121 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.125+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=PBT1PA1084VM type=del size=477562 2024-09-12T00:42:27.125 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.129+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~ITDDNFAC3N7F.0 size=1048576 2024-09-12T00:42:27.127 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.129+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~ITDDNFAC3N7F.1 size=1048576 2024-09-12T00:42:27.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.133+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~ITDDNFAC3N7F.2 size=601096 2024-09-12T00:42:27.135 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.137+0000 7fcde98768c0 1 < completed multipart upload key=C6PW0ETP4BG2 upload=ITDDNFAC3N7F tag=OY5CA3HFW63V type=write size=3746824 2024-09-12T00:42:27.140 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.145+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~RZTEGYANJKTG.0 size=1048576 2024-09-12T00:42:27.143 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.145+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~RZTEGYANJKTG.1 size=1048576 2024-09-12T00:42:27.145 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.149+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~RZTEGYANJKTG.2 size=990321 2024-09-12T00:42:27.145 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.149+0000 7fcde98768c0 1 > prepared multipart upload key=FUJIUIR1E00J upload=RZTEGYANJKTG tag=3GUF8MT8NAU4 type=write size=4136049 2024-09-12T00:42:27.150 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.153+0000 7fcde98768c0 1 < suggested update operation key=JW2GNFAYFNEK tag=PAEH8EKI7DAK type=write size=877598 2024-09-12T00:42:27.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.157+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=7DS0VUI7W61T type=del size=1855967 2024-09-12T00:42:27.156 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.157+0000 7fcde98768c0 1 < completed delete operation key=KME8ZTTUGOXY tag=T6M99X92F2DS type=del 2024-09-12T00:42:27.161 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.165+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~YSH7Q5KD4DX6.0 size=1048576 2024-09-12T00:42:27.164 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.165+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~YSH7Q5KD4DX6.1 size=51252 2024-09-12T00:42:27.164 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.165+0000 7fcde98768c0 1 > prepared multipart upload key=FUJIUIR1E00J upload=YSH7Q5KD4DX6 tag=1GLR449CNU4Y type=write size=2148404 2024-09-12T00:42:27.164 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.169+0000 7fcde98768c0 1 < canceled part key=_multipart_3QOENE572J7A.2~JK7FW9GKFNDI.0 size=1048576 2024-09-12T00:42:27.166 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.169+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~JK7FW9GKFNDI.1 size=492220 2024-09-12T00:42:27.171 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.173+0000 7fcde98768c0 1 < canceled multipart upload key=3QOENE572J7A upload=JK7FW9GKFNDI tag=DCS16H17QOD5 type=write size=2589372 2024-09-12T00:42:27.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.177+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~DZM1L5M424AV.0 size=932058 2024-09-12T00:42:27.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.177+0000 7fcde98768c0 1 > prepared multipart upload key=97030NBF3MI4 upload=DZM1L5M424AV tag=2RNOOHUW5KXR type=write size=1980634 2024-09-12T00:42:27.177 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.181+0000 7fcde98768c0 1 < canceled part key=_multipart_WLE5QLNPAGZA.2~NMB934WR6PPW.0 size=1048576 2024-09-12T00:42:27.177 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.181+0000 7fcde98768c0 1 < canceled part key=_multipart_WLE5QLNPAGZA.2~NMB934WR6PPW.1 size=1048576 2024-09-12T00:42:27.180 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.181+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~NMB934WR6PPW.2 size=394433 2024-09-12T00:42:27.185 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.189+0000 7fcde98768c0 1 < canceled multipart upload key=WLE5QLNPAGZA upload=NMB934WR6PPW tag=Z5TD90A3Z8X9 type=write size=3540161 2024-09-12T00:42:27.191 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.193+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~U3F5CHPKC97J.0 size=1048576 2024-09-12T00:42:27.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.197+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~U3F5CHPKC97J.1 size=1048576 2024-09-12T00:42:27.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.197+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~U3F5CHPKC97J.2 size=227506 2024-09-12T00:42:27.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.197+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=U3F5CHPKC97J tag=YEWYC29QW0QE type=write size=3373234 2024-09-12T00:42:27.199 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.201+0000 7fcde98768c0 1 < completed write operation key=F813QWV02TI0 tag=QVN2PB9XCVPG type=write size=275410 2024-09-12T00:42:27.204 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.209+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~DSBJIQEN968R.0 size=1048576 2024-09-12T00:42:27.206 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.209+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~DSBJIQEN968R.1 size=1048576 2024-09-12T00:42:27.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.213+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~DSBJIQEN968R.2 size=963757 2024-09-12T00:42:27.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.213+0000 7fcde98768c0 1 > prepared multipart upload key=TUMAMUZUIR7E upload=DSBJIQEN968R tag=ICZ58ADNMORL type=write size=4109485 2024-09-12T00:42:27.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.217+0000 7fcde98768c0 1 < completed delete operation key=IV4JCE1QJC70 tag=13TRTMGCI0SV type=del 2024-09-12T00:42:27.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.221+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~M76SYRBQDM06.0 size=1048576 2024-09-12T00:42:27.219 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.221+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~M76SYRBQDM06.1 size=371896 2024-09-12T00:42:27.219 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.221+0000 7fcde98768c0 1 > prepared multipart upload key=IMITNCB1ST9E upload=M76SYRBQDM06 tag=2IMVR5GE39M2 type=write size=2469048 2024-09-12T00:42:27.221 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.225+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=TTPZ97YGEBLG type=del 2024-09-12T00:42:27.224 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.225+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=U76S04Z57HI9 type=del size=1854116 2024-09-12T00:42:27.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.233+0000 7fcde98768c0 1 < suggested update operation key=FUJIUIR1E00J tag=0OCIXVUI62Y3 type=del size=1685177 2024-09-12T00:42:27.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.237+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~ATPH2AR1L9TH.0 size=334431 2024-09-12T00:42:27.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.237+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=ATPH2AR1L9TH tag=JPZNS57U7A5H type=write size=1383007 2024-09-12T00:42:27.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.237+0000 7fcde98768c0 1 < canceled part key=_multipart_368TXYQVK9C3.2~K2MXSRYESTGJ.0 size=1048576 2024-09-12T00:42:27.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.241+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~K2MXSRYESTGJ.1 size=1048576 2024-09-12T00:42:27.240 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.241+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~K2MXSRYESTGJ.2 size=123622 2024-09-12T00:42:27.245 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.249+0000 7fcde98768c0 1 < canceled multipart upload key=368TXYQVK9C3 upload=K2MXSRYESTGJ tag=IN4WQE5JY415 type=write size=3269350 2024-09-12T00:42:27.248 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.249+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=BMAZGJ7VV3CI type=write size=441277 2024-09-12T00:42:27.252 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.253+0000 7fcde98768c0 1 < completed delete operation key=5B8C6E8L5N52 tag=TERBPETVRJT2 type=del 2024-09-12T00:42:27.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.257+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=9H3J1FJ4TD0E type=del size=3286272 2024-09-12T00:42:27.258 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.261+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~R4YEUZ2107RE.0 size=1048576 2024-09-12T00:42:27.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.265+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~R4YEUZ2107RE.1 size=1048576 2024-09-12T00:42:27.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.265+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~R4YEUZ2107RE.2 size=990471 2024-09-12T00:42:27.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.269+0000 7fcde98768c0 1 < completed multipart upload key=IV4JCE1QJC70 upload=R4YEUZ2107RE tag=3HYJHKMERNIG type=write size=4136199 2024-09-12T00:42:27.271 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.273+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=CORTL4QC5P33 type=del size=4036674 2024-09-12T00:42:27.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.277+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~NIK7B8N87NNY.0 size=1048576 2024-09-12T00:42:27.277 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.281+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~NIK7B8N87NNY.1 size=1048576 2024-09-12T00:42:27.280 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.281+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~NIK7B8N87NNY.2 size=321706 2024-09-12T00:42:27.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.289+0000 7fcde98768c0 1 < completed multipart upload key=2T5IU2IUNGJX upload=NIK7B8N87NNY tag=Q7VWNKPCTJXY type=write size=3467434 2024-09-12T00:42:27.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.293+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~SWS5GW8V5HH6.0 size=1048576 2024-09-12T00:42:27.291 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.293+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~SWS5GW8V5HH6.1 size=1021529 2024-09-12T00:42:27.291 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.293+0000 7fcde98768c0 1 > prepared multipart upload key=3X9I78PMR1HV upload=SWS5GW8V5HH6 tag=0W407HOWAGJ0 type=write size=3118681 2024-09-12T00:42:27.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.297+0000 7fcde98768c0 1 < completed write operation key=V80E1NH858IK tag=G0B0G9QQNEWC type=write size=539155 2024-09-12T00:42:27.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.301+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~IO5YYPAV5NPP.0 size=1048576 2024-09-12T00:42:27.300 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.301+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~IO5YYPAV5NPP.1 size=1048576 2024-09-12T00:42:27.302 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.305+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~IO5YYPAV5NPP.2 size=565542 2024-09-12T00:42:27.302 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.305+0000 7fcde98768c0 1 > prepared multipart upload key=Z4RNDW37GEK6 upload=IO5YYPAV5NPP tag=EPD9HISM3JAB type=write size=3711270 2024-09-12T00:42:27.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.309+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~KT6W12D54EAO.0 size=559794 2024-09-12T00:42:27.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.313+0000 7fcde98768c0 1 < completed multipart upload key=BZ4YUNTMOJBK upload=KT6W12D54EAO tag=53QZVPBO0FFZ type=write size=1608370 2024-09-12T00:42:27.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.317+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=RFO7UOL9D24G type=write size=293154 2024-09-12T00:42:27.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.321+0000 7fcde98768c0 1 < completed delete operation key=5B8C6E8L5N52 tag=PBT1PA1084VM type=del 2024-09-12T00:42:27.320 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.321+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=MFR3EZSLEA3H type=del size=1045314 2024-09-12T00:42:27.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.325+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~RZTEGYANJKTG.0 size=1048576 2024-09-12T00:42:27.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.329+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~RZTEGYANJKTG.1 size=1048576 2024-09-12T00:42:27.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.333+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~RZTEGYANJKTG.2 size=990321 2024-09-12T00:42:27.334 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.337+0000 7fcde98768c0 1 < completed multipart upload key=FUJIUIR1E00J upload=RZTEGYANJKTG tag=3GUF8MT8NAU4 type=write size=4136049 2024-09-12T00:42:27.337 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.341+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=BH115YMQT0OR type=del size=2102198 2024-09-12T00:42:27.344 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.345+0000 7fcde98768c0 1 < suggested remove operation key=Z1PY2MFUC1C4 tag=7DS0VUI7W61T type=del 2024-09-12T00:42:27.350 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.353+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~DL86IDD2POO8.0 size=43134 2024-09-12T00:42:27.350 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.353+0000 7fcde98768c0 1 > prepared multipart upload key=RC9A2Y5TCP9C upload=DL86IDD2POO8 tag=P4I0INZJTRC2 type=write size=1091710 2024-09-12T00:42:27.351 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.353+0000 7fcde98768c0 1 < canceled part key=_multipart_FUJIUIR1E00J.2~YSH7Q5KD4DX6.0 size=1048576 2024-09-12T00:42:27.354 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.357+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~YSH7Q5KD4DX6.1 size=51252 2024-09-12T00:42:27.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.361+0000 7fcde98768c0 1 < canceled multipart upload key=FUJIUIR1E00J upload=YSH7Q5KD4DX6 tag=1GLR449CNU4Y type=write size=2148404 2024-09-12T00:42:27.366 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.369+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~ZKYZM8PWBGMN.0 size=672449 2024-09-12T00:42:27.366 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.369+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=ZKYZM8PWBGMN tag=WUXG7S8FAH88 type=write size=1721025 2024-09-12T00:42:27.370 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.373+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~DZM1L5M424AV.0 size=932058 2024-09-12T00:42:27.377 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.381+0000 7fcde98768c0 1 < completed multipart upload key=97030NBF3MI4 upload=DZM1L5M424AV tag=2RNOOHUW5KXR type=write size=1980634 2024-09-12T00:42:27.383 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.385+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~BBHIYH4F33DZ.0 size=1048576 2024-09-12T00:42:27.386 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.389+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~BBHIYH4F33DZ.1 size=1048576 2024-09-12T00:42:27.389 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.393+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~BBHIYH4F33DZ.2 size=82123 2024-09-12T00:42:27.389 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.393+0000 7fcde98768c0 1 > prepared multipart upload key=KME8ZTTUGOXY upload=BBHIYH4F33DZ tag=QB51FAA3G8PV type=write size=3227851 2024-09-12T00:42:27.390 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.393+0000 7fcde98768c0 1 < canceled part key=_multipart_V80E1NH858IK.2~U3F5CHPKC97J.0 size=1048576 2024-09-12T00:42:27.393 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.397+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~U3F5CHPKC97J.1 size=1048576 2024-09-12T00:42:27.395 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.397+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~U3F5CHPKC97J.2 size=227506 2024-09-12T00:42:27.400 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.405+0000 7fcde98768c0 1 < canceled multipart upload key=V80E1NH858IK upload=U3F5CHPKC97J tag=YEWYC29QW0QE type=write size=3373234 2024-09-12T00:42:27.404 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.405+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=EP0CS6IED01G type=del size=2653001 2024-09-12T00:42:27.405 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.409+0000 7fcde98768c0 1 < canceled part key=_multipart_TUMAMUZUIR7E.2~DSBJIQEN968R.0 size=1048576 2024-09-12T00:42:27.408 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.409+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~DSBJIQEN968R.1 size=1048576 2024-09-12T00:42:27.408 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.409+0000 7fcde98768c0 1 < canceled part key=_multipart_TUMAMUZUIR7E.2~DSBJIQEN968R.2 size=963757 2024-09-12T00:42:27.414 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.417+0000 7fcde98768c0 1 < canceled multipart upload key=TUMAMUZUIR7E upload=DSBJIQEN968R tag=ICZ58ADNMORL type=write size=4109485 2024-09-12T00:42:27.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.425+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~NUXIFIFV5RM5.0 size=1048576 2024-09-12T00:42:27.424 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.425+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~NUXIFIFV5RM5.1 size=1048576 2024-09-12T00:42:27.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.429+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~NUXIFIFV5RM5.2 size=773794 2024-09-12T00:42:27.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.429+0000 7fcde98768c0 1 > prepared multipart upload key=C6PW0ETP4BG2 upload=NUXIFIFV5RM5 tag=VO3RG9Q5M3C2 type=write size=3919522 2024-09-12T00:42:27.430 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.433+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~M76SYRBQDM06.0 size=1048576 2024-09-12T00:42:27.433 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.437+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~M76SYRBQDM06.1 size=371896 2024-09-12T00:42:27.438 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.441+0000 7fcde98768c0 1 < completed multipart upload key=IMITNCB1ST9E upload=M76SYRBQDM06 tag=2IMVR5GE39M2 type=write size=2469048 2024-09-12T00:42:27.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.445+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=KEEBA194H9MZ type=del size=146656 2024-09-12T00:42:27.444 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.445+0000 7fcde98768c0 1 < completed delete operation key=5YBVLUYJW40U tag=U76S04Z57HI9 type=del 2024-09-12T00:42:27.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.449+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=IEWZ3X4167HM type=write size=988237 2024-09-12T00:42:27.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.453+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~ATPH2AR1L9TH.0 size=334431 2024-09-12T00:42:27.456 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.457+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=ATPH2AR1L9TH tag=JPZNS57U7A5H type=write size=1383007 2024-09-12T00:42:27.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.461+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=R0W82NWSP7VY type=del size=3239064 2024-09-12T00:42:27.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.465+0000 7fcde98768c0 1 < completed write operation key=RC9A2Y5TCP9C tag=BMAZGJ7VV3CI type=write size=441277 2024-09-12T00:42:27.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.469+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=EWA39BX2RXH3 type=write size=813995 2024-09-12T00:42:27.468 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.473+0000 7fcde98768c0 1 < completed delete operation key=IMITNCB1ST9E tag=9H3J1FJ4TD0E type=del 2024-09-12T00:42:27.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.473+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=5GY5N1TTBDR2 type=del size=1585604 2024-09-12T00:42:27.478 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.481+0000 7fcde98768c0 1 < suggested remove operation key=F813QWV02TI0 tag=CORTL4QC5P33 type=del 2024-09-12T00:42:27.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.489+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~F8CV6ARR05Q4.0 size=184593 2024-09-12T00:42:27.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.489+0000 7fcde98768c0 1 > prepared multipart upload key=4487IMSOLPDV upload=F8CV6ARR05Q4 tag=EZ024E6JKPLD type=write size=1233169 2024-09-12T00:42:27.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.489+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~SWS5GW8V5HH6.0 size=1048576 2024-09-12T00:42:27.491 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.493+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~SWS5GW8V5HH6.1 size=1021529 2024-09-12T00:42:27.496 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.501+0000 7fcde98768c0 1 < completed multipart upload key=3X9I78PMR1HV upload=SWS5GW8V5HH6 tag=0W407HOWAGJ0 type=write size=3118681 2024-09-12T00:42:27.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.509+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=F3LQI8OS2GZ5 type=del size=3624947 2024-09-12T00:42:27.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.513+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~IO5YYPAV5NPP.0 size=1048576 2024-09-12T00:42:27.512 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.513+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~IO5YYPAV5NPP.1 size=1048576 2024-09-12T00:42:27.512 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.513+0000 7fcde98768c0 1 < canceled part key=_multipart_Z4RNDW37GEK6.2~IO5YYPAV5NPP.2 size=565542 2024-09-12T00:42:27.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.521+0000 7fcde98768c0 1 < canceled multipart upload key=Z4RNDW37GEK6 upload=IO5YYPAV5NPP tag=EPD9HISM3JAB type=write size=3711270 2024-09-12T00:42:27.520 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.521+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=0O4JJMFPHORU type=del size=3722379 2024-09-12T00:42:27.525 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.529+0000 7fcde98768c0 1 < completed write operation key=BZ4YUNTMOJBK tag=RFO7UOL9D24G type=write size=293154 2024-09-12T00:42:27.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.533+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~4VEVB2436NU6.0 size=75370 2024-09-12T00:42:27.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.533+0000 7fcde98768c0 1 > prepared multipart upload key=3X9I78PMR1HV upload=4VEVB2436NU6 tag=MQJ591G6ZVNT type=write size=1123946 2024-09-12T00:42:27.534 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.537+0000 7fcde98768c0 1 < completed delete operation key=J9EUM073CZHF tag=MFR3EZSLEA3H type=del 2024-09-12T00:42:27.537 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.541+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=9CGMR0HQPDJV type=del size=677658 2024-09-12T00:42:27.544 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.545+0000 7fcde98768c0 1 < suggested update operation key=NVOFV649MT0A tag=BH115YMQT0OR type=del size=2102198 2024-09-12T00:42:27.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.549+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=WD0WAWEIT5PR type=del size=98915 2024-09-12T00:42:27.551 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.553+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~DL86IDD2POO8.0 size=43134 2024-09-12T00:42:27.557 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.561+0000 7fcde98768c0 1 < completed multipart upload key=RC9A2Y5TCP9C upload=DL86IDD2POO8 tag=P4I0INZJTRC2 type=write size=1091710 2024-09-12T00:42:27.560 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.565+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=8PVN7O3LMRVY type=del size=354715 2024-09-12T00:42:27.564 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.565+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~ZKYZM8PWBGMN.0 size=672449 2024-09-12T00:42:27.569 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.573+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=ZKYZM8PWBGMN tag=WUXG7S8FAH88 type=write size=1721025 2024-09-12T00:42:27.576 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.577+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~MA9QB1CA2EFI.0 size=1048576 2024-09-12T00:42:27.578 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.581+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~MA9QB1CA2EFI.1 size=1048576 2024-09-12T00:42:27.581 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.585+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~MA9QB1CA2EFI.2 size=958719 2024-09-12T00:42:27.581 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.585+0000 7fcde98768c0 1 > prepared multipart upload key=BQGIXJJWBAN0 upload=MA9QB1CA2EFI tag=RLZGPRGKN7VE type=write size=4104447 2024-09-12T00:42:27.584 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.589+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~BBHIYH4F33DZ.0 size=1048576 2024-09-12T00:42:27.587 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.589+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~BBHIYH4F33DZ.1 size=1048576 2024-09-12T00:42:27.590 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.593+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~BBHIYH4F33DZ.2 size=82123 2024-09-12T00:42:27.595 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.597+0000 7fcde98768c0 1 < completed multipart upload key=KME8ZTTUGOXY upload=BBHIYH4F33DZ tag=QB51FAA3G8PV type=write size=3227851 2024-09-12T00:42:27.602 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.605+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~SI596VD77M5Z.0 size=567305 2024-09-12T00:42:27.602 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.605+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=SI596VD77M5Z tag=0E8W95YC2BHO type=write size=1615881 2024-09-12T00:42:27.605 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.609+0000 7fcde98768c0 1 < completed delete operation key=7UR0FX8HA2A5 tag=EP0CS6IED01G type=del 2024-09-12T00:42:27.611 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.613+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~SRRXIQ45EOOA.0 size=1048576 2024-09-12T00:42:27.613 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.617+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~SRRXIQ45EOOA.1 size=1048576 2024-09-12T00:42:27.616 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.617+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~SRRXIQ45EOOA.2 size=380042 2024-09-12T00:42:27.616 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.617+0000 7fcde98768c0 1 > prepared multipart upload key=Z4RNDW37GEK6 upload=SRRXIQ45EOOA tag=LEPFY0L48EF3 type=write size=3525770 2024-09-12T00:42:27.619 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.621+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~NUXIFIFV5RM5.0 size=1048576 2024-09-12T00:42:27.621 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.625+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~NUXIFIFV5RM5.1 size=1048576 2024-09-12T00:42:27.624 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.625+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~NUXIFIFV5RM5.2 size=773794 2024-09-12T00:42:27.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.633+0000 7fcde98768c0 1 < completed multipart upload key=C6PW0ETP4BG2 upload=NUXIFIFV5RM5 tag=VO3RG9Q5M3C2 type=write size=3919522 2024-09-12T00:42:27.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.637+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=13THWWLUONYN type=del size=1682600 2024-09-12T00:42:27.640 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.641+0000 7fcde98768c0 1 < suggested update operation key=IV4JCE1QJC70 tag=KEEBA194H9MZ type=del size=146656 2024-09-12T00:42:27.646 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.649+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~JGMSN09YKHXP.0 size=112006 2024-09-12T00:42:27.646 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.649+0000 7fcde98768c0 1 > prepared multipart upload key=5YBVLUYJW40U upload=JGMSN09YKHXP tag=27COAZR78GFB type=write size=1160582 2024-09-12T00:42:27.649 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.653+0000 7fcde98768c0 1 < completed write operation key=TUMAMUZUIR7E tag=IEWZ3X4167HM type=write size=988237 2024-09-12T00:42:27.652 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.657+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=Y12COVSMC01H type=del size=2571049 2024-09-12T00:42:27.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.657+0000 7fcde98768c0 1 < completed delete operation key=Z1PY2MFUC1C4 tag=R0W82NWSP7VY type=del 2024-09-12T00:42:27.660 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.661+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=US1N2FIQJEH1 type=del size=4022271 2024-09-12T00:42:27.665 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.669+0000 7fcde98768c0 1 < suggested update operation key=7UR0FX8HA2A5 tag=EWA39BX2RXH3 type=write size=813995 2024-09-12T00:42:27.671 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.673+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~12HKR9D83J56.0 size=1048576 2024-09-12T00:42:27.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.677+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~12HKR9D83J56.1 size=1048576 2024-09-12T00:42:27.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.681+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~12HKR9D83J56.2 size=344705 2024-09-12T00:42:27.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.681+0000 7fcde98768c0 1 > prepared multipart upload key=2T5IU2IUNGJX upload=12HKR9D83J56 tag=1D91CQNW8RZ8 type=write size=3490433 2024-09-12T00:42:27.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.685+0000 7fcde98768c0 1 < suggested update operation key=Z1PY2MFUC1C4 tag=5GY5N1TTBDR2 type=del size=1585604 2024-09-12T00:42:27.687 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.689+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=YAJUGUFBVMHT type=write size=245810 2024-09-12T00:42:27.688 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.689+0000 7fcde98768c0 1 < canceled part key=_multipart_4487IMSOLPDV.2~F8CV6ARR05Q4.0 size=184593 2024-09-12T00:42:27.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.697+0000 7fcde98768c0 1 < canceled multipart upload key=4487IMSOLPDV upload=F8CV6ARR05Q4 tag=EZ024E6JKPLD type=write size=1233169 2024-09-12T00:42:27.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.701+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~WPIG4K84PBK3.0 size=1048576 2024-09-12T00:42:27.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.705+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~WPIG4K84PBK3.1 size=454241 2024-09-12T00:42:27.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.705+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=WPIG4K84PBK3 tag=H9Q77NBB71OM type=write size=2551393 2024-09-12T00:42:27.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.705+0000 7fcde98768c0 1 < completed delete operation key=FUJIUIR1E00J tag=F3LQI8OS2GZ5 type=del 2024-09-12T00:42:27.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.709+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=FEFRUO3KTLSN type=write size=957686 2024-09-12T00:42:27.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.713+0000 7fcde98768c0 1 < canceled operation key=V80E1NH858IK tag=0O4JJMFPHORU type=del size=3722379 2024-09-12T00:42:27.713 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.717+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=AT8J68ON6SFT type=del size=293702 2024-09-12T00:42:27.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.717+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~4VEVB2436NU6.0 size=75370 2024-09-12T00:42:27.720 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.725+0000 7fcde98768c0 1 < completed multipart upload key=3X9I78PMR1HV upload=4VEVB2436NU6 tag=MQJ591G6ZVNT type=write size=1123946 2024-09-12T00:42:27.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.725+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=B30L5Q9YDEZY type=del size=3377756 2024-09-12T00:42:27.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.729+0000 7fcde98768c0 1 < completed delete operation key=V80E1NH858IK tag=9CGMR0HQPDJV type=del 2024-09-12T00:42:27.730 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.733+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=3H617SMUTX9J type=del size=2511719 2024-09-12T00:42:27.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.737+0000 7fcde98768c0 1 < canceled operation key=5YBVLUYJW40U tag=WD0WAWEIT5PR type=del size=98915 2024-09-12T00:42:27.735 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.737+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=TLT8TVPLYTMU type=del size=3966052 2024-09-12T00:42:27.738 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.741+0000 7fcde98768c0 1 < completed delete operation key=F813QWV02TI0 tag=8PVN7O3LMRVY type=del 2024-09-12T00:42:27.744 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.745+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~92XIE7H9BH4C.0 size=1048576 2024-09-12T00:42:27.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.749+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~92XIE7H9BH4C.1 size=75540 2024-09-12T00:42:27.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.749+0000 7fcde98768c0 1 > prepared multipart upload key=NVOFV649MT0A upload=92XIE7H9BH4C tag=97NYBHKWTWB5 type=write size=2172692 2024-09-12T00:42:27.750 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.753+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~MA9QB1CA2EFI.0 size=1048576 2024-09-12T00:42:27.750 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.753+0000 7fcde98768c0 1 < canceled part key=_multipart_BQGIXJJWBAN0.2~MA9QB1CA2EFI.1 size=1048576 2024-09-12T00:42:27.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.753+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~MA9QB1CA2EFI.2 size=958719 2024-09-12T00:42:27.757 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.761+0000 7fcde98768c0 1 < canceled multipart upload key=BQGIXJJWBAN0 upload=MA9QB1CA2EFI tag=RLZGPRGKN7VE type=write size=4104447 2024-09-12T00:42:27.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.765+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=ZJL1KCI5R0P1 type=write size=331035 2024-09-12T00:42:27.764 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.765+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~SI596VD77M5Z.0 size=567305 2024-09-12T00:42:27.769 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.773+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=SI596VD77M5Z tag=0E8W95YC2BHO type=write size=1615881 2024-09-12T00:42:27.774 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.777+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~OSH1FFOXFPRW.0 size=1048576 2024-09-12T00:42:27.777 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.781+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~OSH1FFOXFPRW.1 size=1048576 2024-09-12T00:42:27.779 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.781+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~OSH1FFOXFPRW.2 size=28878 2024-09-12T00:42:27.779 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.781+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=OSH1FFOXFPRW tag=BTR4Z8IBJH5X type=write size=3174606 2024-09-12T00:42:27.782 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.785+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~SRRXIQ45EOOA.0 size=1048576 2024-09-12T00:42:27.784 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.789+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~SRRXIQ45EOOA.1 size=1048576 2024-09-12T00:42:27.787 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.789+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~SRRXIQ45EOOA.2 size=380042 2024-09-12T00:42:27.791 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.793+0000 7fcde98768c0 1 < completed multipart upload key=Z4RNDW37GEK6 upload=SRRXIQ45EOOA tag=LEPFY0L48EF3 type=write size=3525770 2024-09-12T00:42:27.795 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.797+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=VAKRD7M7S139 type=del size=2182734 2024-09-12T00:42:27.798 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.801+0000 7fcde98768c0 1 < completed delete operation key=3QOENE572J7A tag=13THWWLUONYN type=del 2024-09-12T00:42:27.804 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.809+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=QSCI5L4TYETB type=write size=878829 2024-09-12T00:42:27.807 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.809+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~JGMSN09YKHXP.0 size=112006 2024-09-12T00:42:27.812 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.813+0000 7fcde98768c0 1 < completed multipart upload key=5YBVLUYJW40U upload=JGMSN09YKHXP tag=27COAZR78GFB type=write size=1160582 2024-09-12T00:42:27.815 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.817+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=039METG2IE3X type=del size=2533838 2024-09-12T00:42:27.818 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.821+0000 7fcde98768c0 1 < completed delete operation key=IMITNCB1ST9E tag=Y12COVSMC01H type=del 2024-09-12T00:42:27.824 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.825+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~15F5X1SGVZS0.0 size=1048576 2024-09-12T00:42:27.826 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.829+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~15F5X1SGVZS0.1 size=750670 2024-09-12T00:42:27.827 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.829+0000 7fcde98768c0 1 > prepared multipart upload key=368TXYQVK9C3 upload=15F5X1SGVZS0 tag=JO1QB53HIJL1 type=write size=2847822 2024-09-12T00:42:27.832 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.833+0000 7fcde98768c0 1 < suggested remove operation key=3X9I78PMR1HV tag=US1N2FIQJEH1 type=del 2024-09-12T00:42:27.835 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.837+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=U6F7L8Y1ERFC type=del size=2173024 2024-09-12T00:42:27.839 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.841+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~12HKR9D83J56.0 size=1048576 2024-09-12T00:42:27.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.845+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~12HKR9D83J56.1 size=1048576 2024-09-12T00:42:27.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.845+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~12HKR9D83J56.2 size=344705 2024-09-12T00:42:27.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.853+0000 7fcde98768c0 1 < completed multipart upload key=2T5IU2IUNGJX upload=12HKR9D83J56 tag=1D91CQNW8RZ8 type=write size=3490433 2024-09-12T00:42:27.852 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.853+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=5AE81RBUVH3J type=write size=919646 2024-09-12T00:42:27.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.857+0000 7fcde98768c0 1 < completed write operation key=IV4JCE1QJC70 tag=YAJUGUFBVMHT type=write size=245810 2024-09-12T00:42:27.859 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.861+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=HSNF58VCUUHT type=del size=1549817 2024-09-12T00:42:27.862 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.865+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~WPIG4K84PBK3.0 size=1048576 2024-09-12T00:42:27.864 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.869+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~WPIG4K84PBK3.1 size=454241 2024-09-12T00:42:27.870 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.873+0000 7fcde98768c0 1 < completed multipart upload key=QD5JXFL962R5 upload=WPIG4K84PBK3 tag=H9Q77NBB71OM type=write size=2551393 2024-09-12T00:42:27.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.877+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~QTPEVPPHJZYS.0 size=1048576 2024-09-12T00:42:27.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.881+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~QTPEVPPHJZYS.1 size=305815 2024-09-12T00:42:27.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.881+0000 7fcde98768c0 1 > prepared multipart upload key=IMITNCB1ST9E upload=QTPEVPPHJZYS tag=7H9MG9CFMSHK type=write size=2402967 2024-09-12T00:42:27.883 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.885+0000 7fcde98768c0 1 < suggested update operation key=ZQD0QXDN1J1I tag=FEFRUO3KTLSN type=write size=957686 2024-09-12T00:42:27.886 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.889+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=991KT6WBKRPT type=del size=2589605 2024-09-12T00:42:27.889 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.893+0000 7fcde98768c0 -1 < failed to complete operation key=3X9I78PMR1HV tag=AT8J68ON6SFT type=del size=293702: (22) Invalid argument 2024-09-12T00:42:27.895 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.897+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~DY7S25GZ81XP.0 size=1048576 2024-09-12T00:42:27.898 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.901+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~DY7S25GZ81XP.1 size=956523 2024-09-12T00:42:27.898 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.901+0000 7fcde98768c0 1 > prepared multipart upload key=FUJIUIR1E00J upload=DY7S25GZ81XP tag=DSZU8G4JLEPG type=write size=3053675 2024-09-12T00:42:27.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.905+0000 7fcde98768c0 1 < completed delete operation key=2T5IU2IUNGJX tag=B30L5Q9YDEZY type=del 2024-09-12T00:42:27.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.909+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~XG79C7K8HTB2.0 size=673267 2024-09-12T00:42:27.908 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.909+0000 7fcde98768c0 1 > prepared multipart upload key=5YBVLUYJW40U upload=XG79C7K8HTB2 tag=8F16RC4Z8WQJ type=write size=1721843 2024-09-12T00:42:27.914 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.917+0000 7fcde98768c0 1 < suggested update operation key=7UR0FX8HA2A5 tag=3H617SMUTX9J type=del size=2511719 2024-09-12T00:42:27.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.921+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=6XW397N5ZFI9 type=del size=1188153 2024-09-12T00:42:27.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.925+0000 7fcde98768c0 1 < completed delete operation key=F813QWV02TI0 tag=TLT8TVPLYTMU type=del 2024-09-12T00:42:27.927 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.929+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~8WCY12FVREAQ.0 size=1048576 2024-09-12T00:42:27.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.933+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~8WCY12FVREAQ.1 size=891453 2024-09-12T00:42:27.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.933+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=8WCY12FVREAQ tag=VERSB5I65UXT type=write size=2988605 2024-09-12T00:42:27.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.937+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~92XIE7H9BH4C.0 size=1048576 2024-09-12T00:42:27.935 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.937+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~92XIE7H9BH4C.1 size=75540 2024-09-12T00:42:27.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.945+0000 7fcde98768c0 1 < completed multipart upload key=NVOFV649MT0A upload=92XIE7H9BH4C tag=97NYBHKWTWB5 type=write size=2172692 2024-09-12T00:42:27.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.949+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~O28FC3ARUULU.0 size=1048576 2024-09-12T00:42:27.950 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.953+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~O28FC3ARUULU.1 size=107938 2024-09-12T00:42:27.950 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.953+0000 7fcde98768c0 1 > prepared multipart upload key=BQGIXJJWBAN0 upload=O28FC3ARUULU tag=EBXQPI7M0RWN type=write size=2205090 2024-09-12T00:42:27.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.957+0000 7fcde98768c0 1 < completed write operation key=Z1PY2MFUC1C4 tag=ZJL1KCI5R0P1 type=write size=331035 2024-09-12T00:42:27.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.957+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=3PSGW0BYPH9A type=del size=3442193 2024-09-12T00:42:27.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.961+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~OSH1FFOXFPRW.0 size=1048576 2024-09-12T00:42:27.961 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.965+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~OSH1FFOXFPRW.1 size=1048576 2024-09-12T00:42:27.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.965+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~OSH1FFOXFPRW.2 size=28878 2024-09-12T00:42:27.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.973+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=OSH1FFOXFPRW tag=BTR4Z8IBJH5X type=write size=3174606 2024-09-12T00:42:27.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.977+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~KUNAGNFZ9CEV.0 size=1048576 2024-09-12T00:42:27.976 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.977+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~KUNAGNFZ9CEV.1 size=1048576 2024-09-12T00:42:27.978 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.981+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~KUNAGNFZ9CEV.2 size=964870 2024-09-12T00:42:27.978 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.981+0000 7fcde98768c0 1 > prepared multipart upload key=J9EUM073CZHF upload=KUNAGNFZ9CEV tag=YFCU1ORAAAJH type=write size=4110598 2024-09-12T00:42:27.981 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.985+0000 7fcde98768c0 1 < completed delete operation key=QD5JXFL962R5 tag=VAKRD7M7S139 type=del 2024-09-12T00:42:27.986 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.989+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~AQXEH33UJ763.0 size=1048576 2024-09-12T00:42:27.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.993+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~AQXEH33UJ763.1 size=1048576 2024-09-12T00:42:27.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.993+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~AQXEH33UJ763.2 size=1033707 2024-09-12T00:42:27.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.993+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=AQXEH33UJ763 tag=ML60T9AUSDEO type=write size=4179435 2024-09-12T00:42:27.994 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:27.997+0000 7fcde98768c0 1 < completed write operation key=RC9A2Y5TCP9C tag=QSCI5L4TYETB type=write size=878829 2024-09-12T00:42:27.997 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.001+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=SZ9P29R5XEQ1 type=del size=1307915 2024-09-12T00:42:28.000 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.001+0000 7fcde98768c0 1 < completed delete operation key=WLE5QLNPAGZA tag=039METG2IE3X type=del 2024-09-12T00:42:28.003 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.005+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=W595NDES370R type=del size=1027808 2024-09-12T00:42:28.007 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.009+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~15F5X1SGVZS0.0 size=1048576 2024-09-12T00:42:28.009 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.013+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~15F5X1SGVZS0.1 size=750670 2024-09-12T00:42:28.015 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.017+0000 7fcde98768c0 1 < completed multipart upload key=368TXYQVK9C3 upload=15F5X1SGVZS0 tag=JO1QB53HIJL1 type=write size=2847822 2024-09-12T00:42:28.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.021+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=T6L421LK257K type=del size=2918269 2024-09-12T00:42:28.021 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.025+0000 7fcde98768c0 1 < completed delete operation key=QD5JXFL962R5 tag=U6F7L8Y1ERFC type=del 2024-09-12T00:42:28.026 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.029+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~HB06JKJMQEXK.0 size=1048576 2024-09-12T00:42:28.029 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.033+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~HB06JKJMQEXK.1 size=78976 2024-09-12T00:42:28.029 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.033+0000 7fcde98768c0 1 > prepared multipart upload key=3X9I78PMR1HV upload=HB06JKJMQEXK tag=2OPQQMX9IMLS type=write size=2176128 2024-09-12T00:42:28.032 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.033+0000 7fcde98768c0 1 < completed write operation key=3QOENE572J7A tag=5AE81RBUVH3J type=write size=919646 2024-09-12T00:42:28.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.037+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=B4HGSN29YSI4 type=write size=424069 2024-09-12T00:42:28.037 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.041+0000 7fcde98768c0 1 < completed delete operation key=TUMAMUZUIR7E tag=HSNF58VCUUHT type=del 2024-09-12T00:42:28.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.041+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=60CIW9KI0E7H type=del size=401239 2024-09-12T00:42:28.043 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.045+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~QTPEVPPHJZYS.0 size=1048576 2024-09-12T00:42:28.045 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.049+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~QTPEVPPHJZYS.1 size=305815 2024-09-12T00:42:28.050 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.053+0000 7fcde98768c0 1 < completed multipart upload key=IMITNCB1ST9E upload=QTPEVPPHJZYS tag=7H9MG9CFMSHK type=write size=2402967 2024-09-12T00:42:28.056 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.057+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~90MMD1EES3RQ.0 size=1048576 2024-09-12T00:42:28.058 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.061+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~90MMD1EES3RQ.1 size=1048576 2024-09-12T00:42:28.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.065+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~90MMD1EES3RQ.2 size=334325 2024-09-12T00:42:28.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.065+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=90MMD1EES3RQ tag=AL6F1HKNJUYI type=write size=3480053 2024-09-12T00:42:28.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.065+0000 7fcde98768c0 1 < completed delete operation key=BZ4YUNTMOJBK tag=991KT6WBKRPT type=del 2024-09-12T00:42:28.068 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.069+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=WXU2L7VFB5DD type=del size=1135409 2024-09-12T00:42:28.070 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.073+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~DY7S25GZ81XP.0 size=1048576 2024-09-12T00:42:28.072 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.077+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~DY7S25GZ81XP.1 size=956523 2024-09-12T00:42:28.077 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.081+0000 7fcde98768c0 1 < completed multipart upload key=FUJIUIR1E00J upload=DY7S25GZ81XP tag=DSZU8G4JLEPG type=write size=3053675 2024-09-12T00:42:28.080 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.085+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=GQ21GV4EKXMK type=del size=160621 2024-09-12T00:42:28.083 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.085+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~XG79C7K8HTB2.0 size=673267 2024-09-12T00:42:28.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.093+0000 7fcde98768c0 1 < completed multipart upload key=5YBVLUYJW40U upload=XG79C7K8HTB2 tag=8F16RC4Z8WQJ type=write size=1721843 2024-09-12T00:42:28.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.101+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~FZQ2H3WLDLB3.0 size=1048576 2024-09-12T00:42:28.099 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.101+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~FZQ2H3WLDLB3.1 size=1048576 2024-09-12T00:42:28.101 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.105+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~FZQ2H3WLDLB3.2 size=74116 2024-09-12T00:42:28.101 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.105+0000 7fcde98768c0 1 > prepared multipart upload key=FUJIUIR1E00J upload=FZQ2H3WLDLB3 tag=QNKG8L3HWO0C type=write size=3219844 2024-09-12T00:42:28.104 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.109+0000 7fcde98768c0 1 < canceled operation key=QD5JXFL962R5 tag=6XW397N5ZFI9 type=del size=1188153 2024-09-12T00:42:28.110 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.113+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~KKHW7YBTI2U2.0 size=717066 2024-09-12T00:42:28.110 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.113+0000 7fcde98768c0 1 > prepared multipart upload key=Z1PY2MFUC1C4 upload=KKHW7YBTI2U2 tag=R1W9KTPJZLLV type=write size=1765642 2024-09-12T00:42:28.113 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.117+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~8WCY12FVREAQ.0 size=1048576 2024-09-12T00:42:28.115 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.117+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~8WCY12FVREAQ.1 size=891453 2024-09-12T00:42:28.120 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.125+0000 7fcde98768c0 1 < completed multipart upload key=V80E1NH858IK upload=8WCY12FVREAQ tag=VERSB5I65UXT type=write size=2988605 2024-09-12T00:42:28.123 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.125+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=PHZ5TXMEN10K type=del size=661035 2024-09-12T00:42:28.127 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.129+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~O28FC3ARUULU.0 size=1048576 2024-09-12T00:42:28.129 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.133+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~O28FC3ARUULU.1 size=107938 2024-09-12T00:42:28.134 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.137+0000 7fcde98768c0 1 < completed multipart upload key=BQGIXJJWBAN0 upload=O28FC3ARUULU tag=EBXQPI7M0RWN type=write size=2205090 2024-09-12T00:42:28.138 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.141+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=ZUZD4H6P2A8I type=del size=1586865 2024-09-12T00:42:28.142 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.145+0000 7fcde98768c0 1 < completed delete operation key=IV4JCE1QJC70 tag=3PSGW0BYPH9A type=del 2024-09-12T00:42:28.145 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.149+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=JBCOTX54S200 type=del size=1588927 2024-09-12T00:42:28.148 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.153+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~KUNAGNFZ9CEV.0 size=1048576 2024-09-12T00:42:28.151 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.153+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~KUNAGNFZ9CEV.1 size=1048576 2024-09-12T00:42:28.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.157+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~KUNAGNFZ9CEV.2 size=964870 2024-09-12T00:42:28.158 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.161+0000 7fcde98768c0 1 < completed multipart upload key=J9EUM073CZHF upload=KUNAGNFZ9CEV tag=YFCU1ORAAAJH type=write size=4110598 2024-09-12T00:42:28.161 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.165+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=YAUO84HL5BXK type=write size=478610 2024-09-12T00:42:28.162 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.165+0000 7fcde98768c0 1 < canceled part key=_multipart_BZ4YUNTMOJBK.2~AQXEH33UJ763.0 size=1048576 2024-09-12T00:42:28.164 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.165+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~AQXEH33UJ763.1 size=1048576 2024-09-12T00:42:28.166 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.169+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~AQXEH33UJ763.2 size=1033707 2024-09-12T00:42:28.171 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.173+0000 7fcde98768c0 1 < canceled multipart upload key=BZ4YUNTMOJBK upload=AQXEH33UJ763 tag=ML60T9AUSDEO type=write size=4179435 2024-09-12T00:42:28.177 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.181+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~E6XEJYKGP25S.0 size=499042 2024-09-12T00:42:28.177 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.181+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=E6XEJYKGP25S tag=HZBYJYUDIM60 type=write size=1547618 2024-09-12T00:42:28.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.181+0000 7fcde98768c0 1 < completed delete operation key=QD5JXFL962R5 tag=SZ9P29R5XEQ1 type=del 2024-09-12T00:42:28.182 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.185+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=I2HIQ955K7OO type=del size=675063 2024-09-12T00:42:28.185 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.189+0000 7fcde98768c0 1 < completed delete operation key=V80E1NH858IK tag=W595NDES370R type=del 2024-09-12T00:42:28.188 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.193+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=MS6IBA9Z8HKI type=del size=2182928 2024-09-12T00:42:28.195 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.197+0000 7fcde98768c0 1 < suggested update operation key=HVE3YQTFZWTV tag=T6L421LK257K type=del size=2918269 2024-09-12T00:42:28.197 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.201+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=BBBQSCC0GVBZ type=del size=1613645 2024-09-12T00:42:28.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.201+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~HB06JKJMQEXK.0 size=1048576 2024-09-12T00:42:28.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.205+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~HB06JKJMQEXK.1 size=78976 2024-09-12T00:42:28.207 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.209+0000 7fcde98768c0 1 < completed multipart upload key=3X9I78PMR1HV upload=HB06JKJMQEXK tag=2OPQQMX9IMLS type=write size=2176128 2024-09-12T00:42:28.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.217+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~CN1WIC42EGKJ.0 size=1048576 2024-09-12T00:42:28.216 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.217+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~CN1WIC42EGKJ.1 size=696051 2024-09-12T00:42:28.216 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.217+0000 7fcde98768c0 1 > prepared multipart upload key=5YBVLUYJW40U upload=CN1WIC42EGKJ tag=8IBJEFSQYO5D type=write size=2793203 2024-09-12T00:42:28.219 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.221+0000 7fcde98768c0 1 < completed write operation key=368TXYQVK9C3 tag=B4HGSN29YSI4 type=write size=424069 2024-09-12T00:42:28.222 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.225+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=70KCH9RTLZXE type=del size=1186534 2024-09-12T00:42:28.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.233+0000 7fcde98768c0 1 < suggested remove operation key=97030NBF3MI4 tag=60CIW9KI0E7H type=del 2024-09-12T00:42:28.233 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.237+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=SZCM8DXJOKHY type=del size=2803455 2024-09-12T00:42:28.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.241+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~90MMD1EES3RQ.0 size=1048576 2024-09-12T00:42:28.239 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.241+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~90MMD1EES3RQ.1 size=1048576 2024-09-12T00:42:28.242 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.245+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~90MMD1EES3RQ.2 size=334325 2024-09-12T00:42:28.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.249+0000 7fcde98768c0 1 < completed multipart upload key=QD5JXFL962R5 upload=90MMD1EES3RQ tag=AL6F1HKNJUYI type=write size=3480053 2024-09-12T00:42:28.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.257+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~E0V8SMG4GLMM.0 size=1048576 2024-09-12T00:42:28.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.257+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~E0V8SMG4GLMM.1 size=230780 2024-09-12T00:42:28.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.257+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=E0V8SMG4GLMM tag=CPX4MBSWOGWF type=write size=2327932 2024-09-12T00:42:28.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.261+0000 7fcde98768c0 1 < canceled operation key=F813QWV02TI0 tag=WXU2L7VFB5DD type=del size=1135409 2024-09-12T00:42:28.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.269+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~TOSNK4MKUJZO.0 size=683073 2024-09-12T00:42:28.266 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.269+0000 7fcde98768c0 1 > prepared multipart upload key=7UR0FX8HA2A5 upload=TOSNK4MKUJZO tag=2V6EQ4GN5SO6 type=write size=1731649 2024-09-12T00:42:28.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.273+0000 7fcde98768c0 1 < completed delete operation key=RC9A2Y5TCP9C tag=GQ21GV4EKXMK type=del 2024-09-12T00:42:28.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.277+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~7W2AREB4P0NG.0 size=767729 2024-09-12T00:42:28.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.277+0000 7fcde98768c0 1 > prepared multipart upload key=Z1PY2MFUC1C4 upload=7W2AREB4P0NG tag=PFGUL9A0TFX1 type=write size=1816305 2024-09-12T00:42:28.277 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.281+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~FZQ2H3WLDLB3.0 size=1048576 2024-09-12T00:42:28.280 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.281+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~FZQ2H3WLDLB3.1 size=1048576 2024-09-12T00:42:28.282 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.285+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~FZQ2H3WLDLB3.2 size=74116 2024-09-12T00:42:28.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.289+0000 7fcde98768c0 1 < completed multipart upload key=FUJIUIR1E00J upload=FZQ2H3WLDLB3 tag=QNKG8L3HWO0C type=write size=3219844 2024-09-12T00:42:28.291 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.293+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~PSJC5VU8PJ1P.0 size=461072 2024-09-12T00:42:28.292 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.293+0000 7fcde98768c0 1 > prepared multipart upload key=3QOENE572J7A upload=PSJC5VU8PJ1P tag=R46GBYDA92FO type=write size=1509648 2024-09-12T00:42:28.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.297+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~KKHW7YBTI2U2.0 size=717066 2024-09-12T00:42:28.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.301+0000 7fcde98768c0 1 < completed multipart upload key=Z1PY2MFUC1C4 upload=KKHW7YBTI2U2 tag=R1W9KTPJZLLV type=write size=1765642 2024-09-12T00:42:28.302 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.305+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=6V32O773WKPN type=write size=660054 2024-09-12T00:42:28.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.309+0000 7fcde98768c0 1 < completed delete operation key=QD5JXFL962R5 tag=PHZ5TXMEN10K type=del 2024-09-12T00:42:28.308 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.309+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=Y1K8217CZ0EF type=write size=39719 2024-09-12T00:42:28.311 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.313+0000 7fcde98768c0 1 < completed delete operation key=NVOFV649MT0A tag=ZUZD4H6P2A8I type=del 2024-09-12T00:42:28.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.317+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=TCCZBOTX18FZ type=del size=679213 2024-09-12T00:42:28.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.321+0000 7fcde98768c0 1 < completed delete operation key=J9EUM073CZHF tag=JBCOTX54S200 type=del 2024-09-12T00:42:28.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.325+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~I1721QC6ORWA.0 size=1048576 2024-09-12T00:42:28.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.329+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~I1721QC6ORWA.1 size=1048576 2024-09-12T00:42:28.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.333+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~I1721QC6ORWA.2 size=228268 2024-09-12T00:42:28.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.333+0000 7fcde98768c0 1 > prepared multipart upload key=C6PW0ETP4BG2 upload=I1721QC6ORWA tag=EDDYJRF0ZWWU type=write size=3373996 2024-09-12T00:42:28.332 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.333+0000 7fcde98768c0 1 < completed write operation key=QD5JXFL962R5 tag=YAUO84HL5BXK type=write size=478610 2024-09-12T00:42:28.338 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.341+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~99G0F7MKZ8Z6.0 size=1048576 2024-09-12T00:42:28.341 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.345+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~99G0F7MKZ8Z6.1 size=1048576 2024-09-12T00:42:28.343 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.345+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~99G0F7MKZ8Z6.2 size=618845 2024-09-12T00:42:28.343 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.345+0000 7fcde98768c0 1 > prepared multipart upload key=TUMAMUZUIR7E upload=99G0F7MKZ8Z6 tag=K7NRAYQ5GVPT type=write size=3764573 2024-09-12T00:42:28.346 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.349+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~E6XEJYKGP25S.0 size=499042 2024-09-12T00:42:28.351 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.353+0000 7fcde98768c0 1 < completed multipart upload key=QD5JXFL962R5 upload=E6XEJYKGP25S tag=HZBYJYUDIM60 type=write size=1547618 2024-09-12T00:42:28.353 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.357+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=2576GUVO61H6 type=del size=1743653 2024-09-12T00:42:28.356 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.361+0000 7fcde98768c0 1 < completed delete operation key=J9EUM073CZHF tag=I2HIQ955K7OO type=del 2024-09-12T00:42:28.362 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.365+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~8WKVF30KJKH7.0 size=1048576 2024-09-12T00:42:28.364 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.365+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~8WKVF30KJKH7.1 size=378317 2024-09-12T00:42:28.364 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.365+0000 7fcde98768c0 1 > prepared multipart upload key=BQGIXJJWBAN0 upload=8WKVF30KJKH7 tag=TQ184TWRJIHN type=write size=2475469 2024-09-12T00:42:28.367 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.369+0000 7fcde98768c0 1 < canceled operation key=4487IMSOLPDV tag=MS6IBA9Z8HKI type=del size=2182928 2024-09-12T00:42:28.375 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.377+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=DN3BF098CKRD type=del size=2018401 2024-09-12T00:42:28.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.385+0000 7fcde98768c0 1 < suggested update operation key=IV4JCE1QJC70 tag=BBBQSCC0GVBZ type=del size=1613645 2024-09-12T00:42:28.383 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.385+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=PK3F6QBN3C2C type=del size=3633684 2024-09-12T00:42:28.384 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.385+0000 7fcde98768c0 1 < canceled part key=_multipart_5YBVLUYJW40U.2~CN1WIC42EGKJ.0 size=1048576 2024-09-12T00:42:28.386 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.389+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~CN1WIC42EGKJ.1 size=696051 2024-09-12T00:42:28.391 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.393+0000 7fcde98768c0 1 < canceled multipart upload key=5YBVLUYJW40U upload=CN1WIC42EGKJ tag=8IBJEFSQYO5D type=write size=2793203 2024-09-12T00:42:28.394 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.397+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=LXGT1PL9NCRK type=write size=644021 2024-09-12T00:42:28.396 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.401+0000 7fcde98768c0 1 < completed delete operation key=J9EUM073CZHF tag=70KCH9RTLZXE type=del 2024-09-12T00:42:28.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.405+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~EDOI2M0OB6AU.0 size=1048576 2024-09-12T00:42:28.404 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.405+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~EDOI2M0OB6AU.1 size=135883 2024-09-12T00:42:28.404 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.405+0000 7fcde98768c0 1 > prepared multipart upload key=5B8C6E8L5N52 upload=EDOI2M0OB6AU tag=UANWSLVNE1WF type=write size=2233035 2024-09-12T00:42:28.407 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.409+0000 7fcde98768c0 -1 < failed to complete operation key=IV4JCE1QJC70 tag=SZCM8DXJOKHY type=del size=2803455: (22) Invalid argument 2024-09-12T00:42:28.409 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.413+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=ZE87U8RAAXVD type=del size=1246397 2024-09-12T00:42:28.413 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.417+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~E0V8SMG4GLMM.0 size=1048576 2024-09-12T00:42:28.415 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.417+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~E0V8SMG4GLMM.1 size=230780 2024-09-12T00:42:28.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.421+0000 7fcde98768c0 1 < completed multipart upload key=QD5JXFL962R5 upload=E0V8SMG4GLMM tag=CPX4MBSWOGWF type=write size=2327932 2024-09-12T00:42:28.423 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.425+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=57H89T61WCS3 type=del size=2255159 2024-09-12T00:42:28.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.429+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~TOSNK4MKUJZO.0 size=683073 2024-09-12T00:42:28.431 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.433+0000 7fcde98768c0 1 < completed multipart upload key=7UR0FX8HA2A5 upload=TOSNK4MKUJZO tag=2V6EQ4GN5SO6 type=write size=1731649 2024-09-12T00:42:28.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.437+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=ZQM9REONQUT3 type=del size=606938 2024-09-12T00:42:28.437 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.441+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~7W2AREB4P0NG.0 size=767729 2024-09-12T00:42:28.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.445+0000 7fcde98768c0 1 < completed multipart upload key=Z1PY2MFUC1C4 upload=7W2AREB4P0NG tag=PFGUL9A0TFX1 type=write size=1816305 2024-09-12T00:42:28.446 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.449+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~0JIBHYXBP8AR.0 size=501368 2024-09-12T00:42:28.446 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.449+0000 7fcde98768c0 1 > prepared multipart upload key=HVE3YQTFZWTV upload=0JIBHYXBP8AR tag=ZEPYW14AVM2M type=write size=1549944 2024-09-12T00:42:28.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.453+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~PSJC5VU8PJ1P.0 size=461072 2024-09-12T00:42:28.454 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.457+0000 7fcde98768c0 1 < completed multipart upload key=3QOENE572J7A upload=PSJC5VU8PJ1P tag=R46GBYDA92FO type=write size=1509648 2024-09-12T00:42:28.457 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.461+0000 7fcde98768c0 1 > prepared operation key=KME8ZTTUGOXY tag=B344FYXFULOP type=del size=1518923 2024-09-12T00:42:28.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.461+0000 7fcde98768c0 1 < completed write operation key=Z4RNDW37GEK6 tag=6V32O773WKPN type=write size=660054 2024-09-12T00:42:28.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.469+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~O83CE80TYX84.0 size=1048576 2024-09-12T00:42:28.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.469+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~O83CE80TYX84.1 size=1048576 2024-09-12T00:42:28.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.473+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~O83CE80TYX84.2 size=919425 2024-09-12T00:42:28.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.473+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=O83CE80TYX84 tag=I150G328Y5G1 type=write size=4065153 2024-09-12T00:42:28.473 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.477+0000 7fcde98768c0 -1 < failed to complete operation key=IV4JCE1QJC70 tag=Y1K8217CZ0EF type=write size=39719: (22) Invalid argument 2024-09-12T00:42:28.479 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.481+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~TBES3DWWVR5L.0 size=1048576 2024-09-12T00:42:28.481 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.485+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~TBES3DWWVR5L.1 size=1048576 2024-09-12T00:42:28.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.485+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~TBES3DWWVR5L.2 size=666608 2024-09-12T00:42:28.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.485+0000 7fcde98768c0 1 > prepared multipart upload key=KME8ZTTUGOXY upload=TBES3DWWVR5L tag=676X9134M1XH type=write size=3812336 2024-09-12T00:42:28.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.489+0000 7fcde98768c0 1 < completed delete operation key=FUJIUIR1E00J tag=TCCZBOTX18FZ type=del 2024-09-12T00:42:28.492 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.493+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~R2DIIMUTOZR5.0 size=1048576 2024-09-12T00:42:28.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.497+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~R2DIIMUTOZR5.1 size=41480 2024-09-12T00:42:28.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.497+0000 7fcde98768c0 1 > prepared multipart upload key=EDFNLQYP4L4L upload=R2DIIMUTOZR5 tag=6RHY29DPN2ET type=write size=2138632 2024-09-12T00:42:28.498 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.501+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~I1721QC6ORWA.0 size=1048576 2024-09-12T00:42:28.501 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.505+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~I1721QC6ORWA.1 size=1048576 2024-09-12T00:42:28.503 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.505+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~I1721QC6ORWA.2 size=228268 2024-09-12T00:42:28.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.513+0000 7fcde98768c0 1 < completed multipart upload key=C6PW0ETP4BG2 upload=I1721QC6ORWA tag=EDDYJRF0ZWWU type=write size=3373996 2024-09-12T00:42:28.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.517+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~JYK353XAP3F0.0 size=1048576 2024-09-12T00:42:28.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.521+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~JYK353XAP3F0.1 size=1048576 2024-09-12T00:42:28.519 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.521+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~JYK353XAP3F0.2 size=418847 2024-09-12T00:42:28.519 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.521+0000 7fcde98768c0 1 > prepared multipart upload key=C6PW0ETP4BG2 upload=JYK353XAP3F0 tag=H4DV6O7LPQNN type=write size=3564575 2024-09-12T00:42:28.522 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.525+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~99G0F7MKZ8Z6.0 size=1048576 2024-09-12T00:42:28.525 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.529+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~99G0F7MKZ8Z6.1 size=1048576 2024-09-12T00:42:28.528 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.529+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~99G0F7MKZ8Z6.2 size=618845 2024-09-12T00:42:28.533 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.537+0000 7fcde98768c0 1 < completed multipart upload key=TUMAMUZUIR7E upload=99G0F7MKZ8Z6 tag=K7NRAYQ5GVPT type=write size=3764573 2024-09-12T00:42:28.536 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.537+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=NEXO2NDRXZ8K type=del size=1820622 2024-09-12T00:42:28.542 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.545+0000 7fcde98768c0 1 < suggested update operation key=3X9I78PMR1HV tag=2576GUVO61H6 type=del size=1743653 2024-09-12T00:42:28.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.549+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=35ARL7HDVPGD type=write size=581112 2024-09-12T00:42:28.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.549+0000 7fcde98768c0 1 < canceled part key=_multipart_BQGIXJJWBAN0.2~8WKVF30KJKH7.0 size=1048576 2024-09-12T00:42:28.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.549+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~8WKVF30KJKH7.1 size=378317 2024-09-12T00:42:28.553 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.557+0000 7fcde98768c0 1 < canceled multipart upload key=BQGIXJJWBAN0 upload=8WKVF30KJKH7 tag=TQ184TWRJIHN type=write size=2475469 2024-09-12T00:42:28.559 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.561+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~9UKH21I0EZFM.0 size=1048576 2024-09-12T00:42:28.561 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.565+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~9UKH21I0EZFM.1 size=1048576 2024-09-12T00:42:28.564 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.565+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~9UKH21I0EZFM.2 size=346779 2024-09-12T00:42:28.564 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.565+0000 7fcde98768c0 1 > prepared multipart upload key=7UR0FX8HA2A5 upload=9UKH21I0EZFM tag=6Q3TXV631PBQ type=write size=3492507 2024-09-12T00:42:28.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.569+0000 7fcde98768c0 1 < completed delete operation key=G6R8BX1H7SPM tag=DN3BF098CKRD type=del 2024-09-12T00:42:28.570 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.573+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=76WEW1ETIOZD type=del size=3963369 2024-09-12T00:42:28.573 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.577+0000 7fcde98768c0 1 < completed delete operation key=3QOENE572J7A tag=PK3F6QBN3C2C type=del 2024-09-12T00:42:28.579 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.581+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~7O5I4BJZEY3B.0 size=113142 2024-09-12T00:42:28.579 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.581+0000 7fcde98768c0 1 > prepared multipart upload key=Z1PY2MFUC1C4 upload=7O5I4BJZEY3B tag=FGJS348YXS51 type=write size=1161718 2024-09-12T00:42:28.582 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.585+0000 7fcde98768c0 1 < canceled operation key=QD5JXFL962R5 tag=LXGT1PL9NCRK type=write size=644021 2024-09-12T00:42:28.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.589+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=GCW2BQSO8BOM type=del size=1324459 2024-09-12T00:42:28.588 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.589+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~EDOI2M0OB6AU.0 size=1048576 2024-09-12T00:42:28.590 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.593+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~EDOI2M0OB6AU.1 size=135883 2024-09-12T00:42:28.596 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.597+0000 7fcde98768c0 1 < completed multipart upload key=5B8C6E8L5N52 upload=EDOI2M0OB6AU tag=UANWSLVNE1WF type=write size=2233035 2024-09-12T00:42:28.599 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.601+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=AIFD8PG1BH02 type=write size=509381 2024-09-12T00:42:28.605 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.609+0000 7fcde98768c0 1 < suggested update operation key=2T5IU2IUNGJX tag=ZE87U8RAAXVD type=del size=1246397 2024-09-12T00:42:28.611 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.613+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~T42FANWPU75T.0 size=1048576 2024-09-12T00:42:28.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.617+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~T42FANWPU75T.1 size=907882 2024-09-12T00:42:28.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.617+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=T42FANWPU75T tag=H1KH4CER1MIX type=write size=3005034 2024-09-12T00:42:28.618 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.621+0000 7fcde98768c0 1 < completed delete operation key=5YBVLUYJW40U tag=57H89T61WCS3 type=del 2024-09-12T00:42:28.623 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.625+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~PLCOH0XCKYDQ.0 size=66393 2024-09-12T00:42:28.623 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.625+0000 7fcde98768c0 1 > prepared multipart upload key=HVE3YQTFZWTV upload=PLCOH0XCKYDQ tag=1J54BPO3GBOF type=write size=1114969 2024-09-12T00:42:28.626 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.629+0000 7fcde98768c0 1 < canceled operation key=5YBVLUYJW40U tag=ZQM9REONQUT3 type=del size=606938 2024-09-12T00:42:28.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.633+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~Q6XK1MEUZM00.0 size=996544 2024-09-12T00:42:28.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.633+0000 7fcde98768c0 1 > prepared multipart upload key=2T5IU2IUNGJX upload=Q6XK1MEUZM00 tag=EIG37EQA59DZ type=write size=2045120 2024-09-12T00:42:28.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.637+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~0JIBHYXBP8AR.0 size=501368 2024-09-12T00:42:28.640 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.641+0000 7fcde98768c0 1 < completed multipart upload key=HVE3YQTFZWTV upload=0JIBHYXBP8AR tag=ZEPYW14AVM2M type=write size=1549944 2024-09-12T00:42:28.645 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.649+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~4WS2V5D6KDHW.0 size=1048576 2024-09-12T00:42:28.647 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.649+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~4WS2V5D6KDHW.1 size=198982 2024-09-12T00:42:28.647 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.649+0000 7fcde98768c0 1 > prepared multipart upload key=Z4RNDW37GEK6 upload=4WS2V5D6KDHW tag=MJ6GNJHQQU0X type=write size=2296134 2024-09-12T00:42:28.654 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.657+0000 7fcde98768c0 1 < completed delete operation key=KME8ZTTUGOXY tag=B344FYXFULOP type=del 2024-09-12T00:42:28.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.661+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=WWSQC89P8P9C type=del size=3943511 2024-09-12T00:42:28.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.661+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~O83CE80TYX84.0 size=1048576 2024-09-12T00:42:28.662 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.665+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~O83CE80TYX84.1 size=1048576 2024-09-12T00:42:28.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.665+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~O83CE80TYX84.2 size=919425 2024-09-12T00:42:28.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.673+0000 7fcde98768c0 1 < completed multipart upload key=IV4JCE1QJC70 upload=O83CE80TYX84 tag=I150G328Y5G1 type=write size=4065153 2024-09-12T00:42:28.672 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.673+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=FP3S3PWNB31Y type=write size=1046289 2024-09-12T00:42:28.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.677+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~TBES3DWWVR5L.0 size=1048576 2024-09-12T00:42:28.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.681+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~TBES3DWWVR5L.1 size=1048576 2024-09-12T00:42:28.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.681+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~TBES3DWWVR5L.2 size=666608 2024-09-12T00:42:28.686 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.689+0000 7fcde98768c0 1 < completed multipart upload key=KME8ZTTUGOXY upload=TBES3DWWVR5L tag=676X9134M1XH type=write size=3812336 2024-09-12T00:42:28.690 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.693+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=003VUWRT14RR type=del size=1168368 2024-09-12T00:42:28.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.697+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~R2DIIMUTOZR5.0 size=1048576 2024-09-12T00:42:28.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.697+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~R2DIIMUTOZR5.1 size=41480 2024-09-12T00:42:28.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.701+0000 7fcde98768c0 1 < completed multipart upload key=EDFNLQYP4L4L upload=R2DIIMUTOZR5 tag=6RHY29DPN2ET type=write size=2138632 2024-09-12T00:42:28.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.705+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=QN6ZUU4FF35V type=del size=2616248 2024-09-12T00:42:28.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.705+0000 7fcde98768c0 1 < canceled part key=_multipart_C6PW0ETP4BG2.2~JYK353XAP3F0.0 size=1048576 2024-09-12T00:42:28.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.709+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~JYK353XAP3F0.1 size=1048576 2024-09-12T00:42:28.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.709+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~JYK353XAP3F0.2 size=418847 2024-09-12T00:42:28.711 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.713+0000 7fcde98768c0 1 < canceled multipart upload key=C6PW0ETP4BG2 upload=JYK353XAP3F0 tag=H4DV6O7LPQNN type=write size=3564575 2024-09-12T00:42:28.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.717+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~T0U8QRNSEI6F.0 size=1048576 2024-09-12T00:42:28.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.721+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~T0U8QRNSEI6F.1 size=1048576 2024-09-12T00:42:28.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.721+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~T0U8QRNSEI6F.2 size=341288 2024-09-12T00:42:28.719 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.721+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=T0U8QRNSEI6F tag=UCHFLSUN7QO7 type=write size=3487016 2024-09-12T00:42:28.721 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.725+0000 7fcde98768c0 -1 < failed to complete operation key=3X9I78PMR1HV tag=NEXO2NDRXZ8K type=del size=1820622: (22) Invalid argument 2024-09-12T00:42:28.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.725+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=MMLYQUKOWH6M type=write size=518999 2024-09-12T00:42:28.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.729+0000 7fcde98768c0 1 < completed write operation key=5YBVLUYJW40U tag=35ARL7HDVPGD type=write size=581112 2024-09-12T00:42:28.730 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.733+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~Y83I3DZ3XBAJ.0 size=1048576 2024-09-12T00:42:28.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.737+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~Y83I3DZ3XBAJ.1 size=1048576 2024-09-12T00:42:28.734 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.737+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~Y83I3DZ3XBAJ.2 size=964354 2024-09-12T00:42:28.734 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.737+0000 7fcde98768c0 1 > prepared multipart upload key=3X9I78PMR1HV upload=Y83I3DZ3XBAJ tag=F0W362IZXENX type=write size=4110082 2024-09-12T00:42:28.737 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.741+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~9UKH21I0EZFM.0 size=1048576 2024-09-12T00:42:28.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.741+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~9UKH21I0EZFM.1 size=1048576 2024-09-12T00:42:28.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.741+0000 7fcde98768c0 1 < canceled part key=_multipart_7UR0FX8HA2A5.2~9UKH21I0EZFM.2 size=346779 2024-09-12T00:42:28.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.745+0000 7fcde98768c0 1 < canceled multipart upload key=7UR0FX8HA2A5 upload=9UKH21I0EZFM tag=6Q3TXV631PBQ type=write size=3492507 2024-09-12T00:42:28.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.749+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~WCBPAHCU2VVI.0 size=1048576 2024-09-12T00:42:28.750 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.753+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~WCBPAHCU2VVI.1 size=1048576 2024-09-12T00:42:28.751 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.753+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~WCBPAHCU2VVI.2 size=831069 2024-09-12T00:42:28.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.753+0000 7fcde98768c0 1 > prepared multipart upload key=F813QWV02TI0 upload=WCBPAHCU2VVI tag=W1AVLOBXQOQ7 type=write size=3976797 2024-09-12T00:42:28.756 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.757+0000 7fcde98768c0 1 < suggested remove operation key=ZQD0QXDN1J1I tag=76WEW1ETIOZD type=del 2024-09-12T00:42:28.760 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.761+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~MY8BZSYNAW9D.0 size=1048576 2024-09-12T00:42:28.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.765+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~MY8BZSYNAW9D.1 size=1048576 2024-09-12T00:42:28.764 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.765+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~MY8BZSYNAW9D.2 size=388729 2024-09-12T00:42:28.764 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.765+0000 7fcde98768c0 1 > prepared multipart upload key=ZQD0QXDN1J1I upload=MY8BZSYNAW9D tag=O6F1XWFI5OKF type=write size=3534457 2024-09-12T00:42:28.766 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.769+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~7O5I4BJZEY3B.0 size=113142 2024-09-12T00:42:28.770 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.773+0000 7fcde98768c0 1 < completed multipart upload key=Z1PY2MFUC1C4 upload=7O5I4BJZEY3B tag=FGJS348YXS51 type=write size=1161718 2024-09-12T00:42:28.773 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.777+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=7BMJ555E8OII type=del size=2464248 2024-09-12T00:42:28.777 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.781+0000 7fcde98768c0 1 < suggested remove operation key=JW2GNFAYFNEK tag=GCW2BQSO8BOM type=del 2024-09-12T00:42:28.779 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.781+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=XMYJNOQYJ9M3 type=del size=3003139 2024-09-12T00:42:28.781 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.785+0000 7fcde98768c0 1 < completed write operation key=QD5JXFL962R5 tag=AIFD8PG1BH02 type=write size=509381 2024-09-12T00:42:28.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.789+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~KO22WT9UH9BZ.0 size=1048576 2024-09-12T00:42:28.787 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.789+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~KO22WT9UH9BZ.1 size=1048576 2024-09-12T00:42:28.789 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.793+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~KO22WT9UH9BZ.2 size=225333 2024-09-12T00:42:28.789 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.793+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=KO22WT9UH9BZ tag=B4M7KV5THKTM type=write size=3371061 2024-09-12T00:42:28.791 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.793+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~T42FANWPU75T.0 size=1048576 2024-09-12T00:42:28.793 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.797+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~T42FANWPU75T.1 size=907882 2024-09-12T00:42:28.797 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.801+0000 7fcde98768c0 1 < completed multipart upload key=BZ4YUNTMOJBK upload=T42FANWPU75T tag=H1KH4CER1MIX type=write size=3005034 2024-09-12T00:42:28.801 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.805+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~VXP082UCIJ1X.0 size=1048576 2024-09-12T00:42:28.802 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.805+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~VXP082UCIJ1X.1 size=669223 2024-09-12T00:42:28.802 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.805+0000 7fcde98768c0 1 > prepared multipart upload key=4487IMSOLPDV upload=VXP082UCIJ1X tag=WQYRSURJZ5EZ type=write size=2766375 2024-09-12T00:42:28.805 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.809+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~PLCOH0XCKYDQ.0 size=66393 2024-09-12T00:42:28.808 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.809+0000 7fcde98768c0 1 < completed multipart upload key=HVE3YQTFZWTV upload=PLCOH0XCKYDQ tag=1J54BPO3GBOF type=write size=1114969 2024-09-12T00:42:28.812 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.813+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~607W6V5P5MA0.0 size=1048576 2024-09-12T00:42:28.813 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.817+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~607W6V5P5MA0.1 size=1048576 2024-09-12T00:42:28.815 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.817+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~607W6V5P5MA0.2 size=1019856 2024-09-12T00:42:28.815 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.817+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=607W6V5P5MA0 tag=60YV9955GOTK type=write size=4165584 2024-09-12T00:42:28.817 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.821+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~Q6XK1MEUZM00.0 size=996544 2024-09-12T00:42:28.821 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.825+0000 7fcde98768c0 1 < completed multipart upload key=2T5IU2IUNGJX upload=Q6XK1MEUZM00 tag=EIG37EQA59DZ type=write size=2045120 2024-09-12T00:42:28.824 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.825+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=JF9BBQOERGK5 type=del size=1804427 2024-09-12T00:42:28.826 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.829+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~4WS2V5D6KDHW.0 size=1048576 2024-09-12T00:42:28.828 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.829+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~4WS2V5D6KDHW.1 size=198982 2024-09-12T00:42:28.831 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.833+0000 7fcde98768c0 1 < completed multipart upload key=Z4RNDW37GEK6 upload=4WS2V5D6KDHW tag=MJ6GNJHQQU0X type=write size=2296134 2024-09-12T00:42:28.834 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.837+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=RADJ26N3LCKM type=del size=2521100 2024-09-12T00:42:28.836 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.841+0000 7fcde98768c0 1 < completed delete operation key=3X9I78PMR1HV tag=WWSQC89P8P9C type=del 2024-09-12T00:42:28.839 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.841+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=AJT1TRJXNQD9 type=del size=4036174 2024-09-12T00:42:28.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.845+0000 7fcde98768c0 1 < completed write operation key=F813QWV02TI0 tag=FP3S3PWNB31Y type=write size=1046289 2024-09-12T00:42:28.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.845+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=TV0XZ8SMZ49L type=del size=858210 2024-09-12T00:42:28.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.849+0000 7fcde98768c0 1 < suggested remove operation key=BZ4YUNTMOJBK tag=003VUWRT14RR type=del 2024-09-12T00:42:28.853 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.857+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~MGFD52LK69IG.0 size=1048576 2024-09-12T00:42:28.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.857+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~MGFD52LK69IG.1 size=1048576 2024-09-12T00:42:28.856 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.861+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~MGFD52LK69IG.2 size=546649 2024-09-12T00:42:28.857 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.861+0000 7fcde98768c0 1 > prepared multipart upload key=TUMAMUZUIR7E upload=MGFD52LK69IG tag=YIGP2EFKMQ78 type=write size=3692377 2024-09-12T00:42:28.859 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.861+0000 7fcde98768c0 -1 < failed to complete operation key=ZQD0QXDN1J1I tag=QN6ZUU4FF35V type=del size=2616248: (22) Invalid argument 2024-09-12T00:42:28.861 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.865+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=TA3MQXPL06FG type=del size=3872437 2024-09-12T00:42:28.864 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.865+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~T0U8QRNSEI6F.0 size=1048576 2024-09-12T00:42:28.866 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.869+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~T0U8QRNSEI6F.1 size=1048576 2024-09-12T00:42:28.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.869+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~T0U8QRNSEI6F.2 size=341288 2024-09-12T00:42:28.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.873+0000 7fcde98768c0 1 < completed multipart upload key=IV4JCE1QJC70 upload=T0U8QRNSEI6F tag=UCHFLSUN7QO7 type=write size=3487016 2024-09-12T00:42:28.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.881+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~TFFMCC5157TD.0 size=253361 2024-09-12T00:42:28.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.881+0000 7fcde98768c0 1 > prepared multipart upload key=NVOFV649MT0A upload=TFFMCC5157TD tag=P3EF37K2SV9N type=write size=1301937 2024-09-12T00:42:28.881 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.885+0000 7fcde98768c0 1 < completed write operation key=3X9I78PMR1HV tag=MMLYQUKOWH6M type=write size=518999 2024-09-12T00:42:28.885 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.885+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=PAKKXSYITUW3 type=del size=2725613 2024-09-12T00:42:28.885 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.889+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~Y83I3DZ3XBAJ.0 size=1048576 2024-09-12T00:42:28.887 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.889+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~Y83I3DZ3XBAJ.1 size=1048576 2024-09-12T00:42:28.889 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.893+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~Y83I3DZ3XBAJ.2 size=964354 2024-09-12T00:42:28.893 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.897+0000 7fcde98768c0 1 < completed multipart upload key=3X9I78PMR1HV upload=Y83I3DZ3XBAJ tag=F0W362IZXENX type=write size=4110082 2024-09-12T00:42:28.897 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.901+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~I0UH6QTXGKSZ.0 size=659349 2024-09-12T00:42:28.897 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.901+0000 7fcde98768c0 1 > prepared multipart upload key=RC9A2Y5TCP9C upload=I0UH6QTXGKSZ tag=JS53B9Q0IIQ8 type=write size=1707925 2024-09-12T00:42:28.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.901+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~WCBPAHCU2VVI.0 size=1048576 2024-09-12T00:42:28.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.905+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~WCBPAHCU2VVI.1 size=1048576 2024-09-12T00:42:28.903 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.905+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~WCBPAHCU2VVI.2 size=831069 2024-09-12T00:42:28.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.909+0000 7fcde98768c0 1 < completed multipart upload key=F813QWV02TI0 upload=WCBPAHCU2VVI tag=W1AVLOBXQOQ7 type=write size=3976797 2024-09-12T00:42:28.911 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.913+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~LJZZFX2ZRL0W.0 size=1048576 2024-09-12T00:42:28.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.917+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~LJZZFX2ZRL0W.1 size=740498 2024-09-12T00:42:28.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.917+0000 7fcde98768c0 1 > prepared multipart upload key=RC9A2Y5TCP9C upload=LJZZFX2ZRL0W tag=F07FP2ZL8MFK type=write size=2837650 2024-09-12T00:42:28.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.917+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~MY8BZSYNAW9D.0 size=1048576 2024-09-12T00:42:28.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.921+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~MY8BZSYNAW9D.1 size=1048576 2024-09-12T00:42:28.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.921+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~MY8BZSYNAW9D.2 size=388729 2024-09-12T00:42:28.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.925+0000 7fcde98768c0 1 < completed multipart upload key=ZQD0QXDN1J1I upload=MY8BZSYNAW9D tag=O6F1XWFI5OKF type=write size=3534457 2024-09-12T00:42:28.926 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.929+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=J20JSSGMQJUJ type=del size=2711982 2024-09-12T00:42:28.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.933+0000 7fcde98768c0 1 < completed delete operation key=4487IMSOLPDV tag=7BMJ555E8OII type=del 2024-09-12T00:42:28.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.933+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=M383YRGU01GU type=del size=1091573 2024-09-12T00:42:28.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.937+0000 7fcde98768c0 1 < completed delete operation key=NVOFV649MT0A tag=XMYJNOQYJ9M3 type=del 2024-09-12T00:42:28.936 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.937+0000 7fcde98768c0 1 > prepared operation key=KME8ZTTUGOXY tag=9WB1ADUAQFWT type=del size=918050 2024-09-12T00:42:28.938 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.941+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~KO22WT9UH9BZ.0 size=1048576 2024-09-12T00:42:28.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.941+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~KO22WT9UH9BZ.1 size=1048576 2024-09-12T00:42:28.942 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.945+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~KO22WT9UH9BZ.2 size=225333 2024-09-12T00:42:28.945 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.949+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=KO22WT9UH9BZ tag=B4M7KV5THKTM type=write size=3371061 2024-09-12T00:42:28.949 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.953+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~92U6H1SYCYZ4.0 size=1048576 2024-09-12T00:42:28.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.953+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~92U6H1SYCYZ4.1 size=1048576 2024-09-12T00:42:28.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.957+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~92U6H1SYCYZ4.2 size=588751 2024-09-12T00:42:28.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.957+0000 7fcde98768c0 1 > prepared multipart upload key=Z4RNDW37GEK6 upload=92U6H1SYCYZ4 tag=MAO3AUV5P07Q type=write size=3734479 2024-09-12T00:42:28.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.957+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~VXP082UCIJ1X.0 size=1048576 2024-09-12T00:42:28.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.961+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~VXP082UCIJ1X.1 size=669223 2024-09-12T00:42:28.960 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.961+0000 7fcde98768c0 1 < completed multipart upload key=4487IMSOLPDV upload=VXP082UCIJ1X tag=WQYRSURJZ5EZ type=write size=2766375 2024-09-12T00:42:28.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.969+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~6WQLRTEIU3FP.0 size=1048576 2024-09-12T00:42:28.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.969+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~6WQLRTEIU3FP.1 size=383560 2024-09-12T00:42:28.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.969+0000 7fcde98768c0 1 > prepared multipart upload key=F813QWV02TI0 upload=6WQLRTEIU3FP tag=NJLRS1NVCBU5 type=write size=2480712 2024-09-12T00:42:28.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.969+0000 7fcde98768c0 1 < canceled part key=_multipart_V80E1NH858IK.2~607W6V5P5MA0.0 size=1048576 2024-09-12T00:42:28.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.973+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~607W6V5P5MA0.1 size=1048576 2024-09-12T00:42:28.971 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.973+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~607W6V5P5MA0.2 size=1019856 2024-09-12T00:42:28.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.977+0000 7fcde98768c0 1 < canceled multipart upload key=V80E1NH858IK upload=607W6V5P5MA0 tag=60YV9955GOTK type=write size=4165584 2024-09-12T00:42:28.978 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.981+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=QF38EN0X5J9J type=del size=2616757 2024-09-12T00:42:28.983 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.985+0000 7fcde98768c0 1 < suggested update operation key=IMITNCB1ST9E tag=JF9BBQOERGK5 type=del size=1804427 2024-09-12T00:42:28.985 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.989+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=6XZDTCHDZDI0 type=del size=3150108 2024-09-12T00:42:28.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.993+0000 7fcde98768c0 1 < suggested update operation key=BQGIXJJWBAN0 tag=RADJ26N3LCKM type=del size=2521100 2024-09-12T00:42:28.996 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:28.997+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~WKFMG4P7RLGF.0 size=1048576 2024-09-12T00:42:28.998 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.001+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~WKFMG4P7RLGF.1 size=1048576 2024-09-12T00:42:29.001 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.005+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~WKFMG4P7RLGF.2 size=517220 2024-09-12T00:42:29.001 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.005+0000 7fcde98768c0 1 > prepared multipart upload key=IMITNCB1ST9E upload=WKFMG4P7RLGF tag=8A3SN48125QW type=write size=3662948 2024-09-12T00:42:29.007 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.009+0000 7fcde98768c0 1 < suggested update operation key=5B8C6E8L5N52 tag=AJT1TRJXNQD9 type=del size=4036174 2024-09-12T00:42:29.012 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.013+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~1M26921CIR1R.0 size=1048576 2024-09-12T00:42:29.014 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.017+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~1M26921CIR1R.1 size=1048576 2024-09-12T00:42:29.017 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.021+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~1M26921CIR1R.2 size=501392 2024-09-12T00:42:29.017 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.021+0000 7fcde98768c0 1 > prepared multipart upload key=RC9A2Y5TCP9C upload=1M26921CIR1R tag=02U47404FBHC type=write size=3647120 2024-09-12T00:42:29.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.021+0000 7fcde98768c0 -1 < failed to complete operation key=5B8C6E8L5N52 tag=TV0XZ8SMZ49L type=del size=858210: (22) Invalid argument 2024-09-12T00:42:29.022 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.025+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=M1MM678EFRLB type=del size=409795 2024-09-12T00:42:29.025 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.029+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~MGFD52LK69IG.0 size=1048576 2024-09-12T00:42:29.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.029+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~MGFD52LK69IG.1 size=1048576 2024-09-12T00:42:29.028 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.033+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~MGFD52LK69IG.2 size=546649 2024-09-12T00:42:29.032 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.037+0000 7fcde98768c0 1 < completed multipart upload key=TUMAMUZUIR7E upload=MGFD52LK69IG tag=YIGP2EFKMQ78 type=write size=3692377 2024-09-12T00:42:29.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.037+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=HBTXQXXKTX1H type=del size=765688 2024-09-12T00:42:29.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.041+0000 7fcde98768c0 1 < suggested update operation key=NVOFV649MT0A tag=TA3MQXPL06FG type=del size=3872437 2024-09-12T00:42:29.042 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.045+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=RYXNMSVYD79T type=del size=569344 2024-09-12T00:42:29.045 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.049+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~TFFMCC5157TD.0 size=253361 2024-09-12T00:42:29.050 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.053+0000 7fcde98768c0 1 < completed multipart upload key=NVOFV649MT0A upload=TFFMCC5157TD tag=P3EF37K2SV9N type=write size=1301937 2024-09-12T00:42:29.053 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.057+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=0NSNJNK9ZDFB type=del size=575247 2024-09-12T00:42:29.055 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.057+0000 7fcde98768c0 -1 < failed to complete operation key=5B8C6E8L5N52 tag=PAKKXSYITUW3 type=del size=2725613: (22) Invalid argument 2024-09-12T00:42:29.058 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.061+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=1WP1X0ATYLHH type=del size=2264348 2024-09-12T00:42:29.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.061+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~I0UH6QTXGKSZ.0 size=659349 2024-09-12T00:42:29.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.069+0000 7fcde98768c0 1 < completed multipart upload key=RC9A2Y5TCP9C upload=I0UH6QTXGKSZ tag=JS53B9Q0IIQ8 type=write size=1707925 2024-09-12T00:42:29.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.073+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~Y9QDPHKLXLWE.0 size=397397 2024-09-12T00:42:29.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.073+0000 7fcde98768c0 1 > prepared multipart upload key=EDFNLQYP4L4L upload=Y9QDPHKLXLWE tag=XUV73P4P18PA type=write size=1445973 2024-09-12T00:42:29.072 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.073+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~LJZZFX2ZRL0W.0 size=1048576 2024-09-12T00:42:29.074 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.077+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~LJZZFX2ZRL0W.1 size=740498 2024-09-12T00:42:29.077 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.081+0000 7fcde98768c0 1 < completed multipart upload key=RC9A2Y5TCP9C upload=LJZZFX2ZRL0W tag=F07FP2ZL8MFK type=write size=2837650 2024-09-12T00:42:29.080 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.081+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=RYLC97KWTVBS type=del size=473310 2024-09-12T00:42:29.083 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.085+0000 7fcde98768c0 1 < completed delete operation key=HVE3YQTFZWTV tag=J20JSSGMQJUJ type=del 2024-09-12T00:42:29.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.089+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~VEDYFPKZLGQE.0 size=1048576 2024-09-12T00:42:29.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.093+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~VEDYFPKZLGQE.1 size=1048576 2024-09-12T00:42:29.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.093+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~VEDYFPKZLGQE.2 size=619753 2024-09-12T00:42:29.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.093+0000 7fcde98768c0 1 > prepared multipart upload key=C6PW0ETP4BG2 upload=VEDYFPKZLGQE tag=GR46A0F1JJ6P type=write size=3765481 2024-09-12T00:42:29.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.097+0000 7fcde98768c0 1 < suggested update operation key=F813QWV02TI0 tag=M383YRGU01GU type=del size=1091573 2024-09-12T00:42:29.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.101+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=22NFXEIET3N5 type=del size=1837891 2024-09-12T00:42:29.104 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.105+0000 7fcde98768c0 1 < suggested remove operation key=KME8ZTTUGOXY tag=9WB1ADUAQFWT type=del 2024-09-12T00:42:29.108 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.109+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~CWLXQ30V0ES4.0 size=1048576 2024-09-12T00:42:29.110 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.113+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~CWLXQ30V0ES4.1 size=246871 2024-09-12T00:42:29.110 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.113+0000 7fcde98768c0 1 > prepared multipart upload key=WLE5QLNPAGZA upload=CWLXQ30V0ES4 tag=LIHRYSF35WQ0 type=write size=2344023 2024-09-12T00:42:29.112 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.113+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~92U6H1SYCYZ4.0 size=1048576 2024-09-12T00:42:29.114 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.117+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~92U6H1SYCYZ4.1 size=1048576 2024-09-12T00:42:29.115 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.117+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~92U6H1SYCYZ4.2 size=588751 2024-09-12T00:42:29.119 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.121+0000 7fcde98768c0 1 < completed multipart upload key=Z4RNDW37GEK6 upload=92U6H1SYCYZ4 tag=MAO3AUV5P07Q type=write size=3734479 2024-09-12T00:42:29.121 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.125+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=HRPPAZM1ANOY type=write size=681833 2024-09-12T00:42:29.123 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.125+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~6WQLRTEIU3FP.0 size=1048576 2024-09-12T00:42:29.125 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.129+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~6WQLRTEIU3FP.1 size=383560 2024-09-12T00:42:29.128 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.129+0000 7fcde98768c0 1 < completed multipart upload key=F813QWV02TI0 upload=6WQLRTEIU3FP tag=NJLRS1NVCBU5 type=write size=2480712 2024-09-12T00:42:29.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.133+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~WBE0QNFBX8S0.0 size=1048576 2024-09-12T00:42:29.134 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.137+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~WBE0QNFBX8S0.1 size=321459 2024-09-12T00:42:29.134 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.137+0000 7fcde98768c0 1 > prepared multipart upload key=97030NBF3MI4 upload=WBE0QNFBX8S0 tag=M69WVBS9JLUN type=write size=2418611 2024-09-12T00:42:29.136 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.137+0000 7fcde98768c0 1 < completed delete operation key=Z1PY2MFUC1C4 tag=QF38EN0X5J9J type=del 2024-09-12T00:42:29.138 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.141+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=0TL2GGIVIBQQ type=del size=614756 2024-09-12T00:42:29.141 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.145+0000 7fcde98768c0 1 < completed delete operation key=JW2GNFAYFNEK tag=6XZDTCHDZDI0 type=del 2024-09-12T00:42:29.143 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.145+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=TLINQP88NF6I type=del size=87677 2024-09-12T00:42:29.146 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.149+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~WKFMG4P7RLGF.0 size=1048576 2024-09-12T00:42:29.148 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.149+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~WKFMG4P7RLGF.1 size=1048576 2024-09-12T00:42:29.149 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.153+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~WKFMG4P7RLGF.2 size=517220 2024-09-12T00:42:29.154 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.157+0000 7fcde98768c0 1 < completed multipart upload key=IMITNCB1ST9E upload=WKFMG4P7RLGF tag=8A3SN48125QW type=write size=3662948 2024-09-12T00:42:29.158 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.161+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~2J2ZIVQD2FQD.0 size=1048576 2024-09-12T00:42:29.160 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.161+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~2J2ZIVQD2FQD.1 size=1048576 2024-09-12T00:42:29.162 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.165+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~2J2ZIVQD2FQD.2 size=766794 2024-09-12T00:42:29.162 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.165+0000 7fcde98768c0 1 > prepared multipart upload key=RC9A2Y5TCP9C upload=2J2ZIVQD2FQD tag=S4TRVTHX7SLP type=write size=3912522 2024-09-12T00:42:29.165 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.165+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~1M26921CIR1R.0 size=1048576 2024-09-12T00:42:29.166 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.169+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~1M26921CIR1R.1 size=1048576 2024-09-12T00:42:29.168 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.169+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~1M26921CIR1R.2 size=501392 2024-09-12T00:42:29.172 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.173+0000 7fcde98768c0 1 < completed multipart upload key=RC9A2Y5TCP9C upload=1M26921CIR1R tag=02U47404FBHC type=write size=3647120 2024-09-12T00:42:29.177 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.181+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~KM4U7KSBSR9X.0 size=1048576 2024-09-12T00:42:29.178 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.181+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~KM4U7KSBSR9X.1 size=1048576 2024-09-12T00:42:29.180 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.181+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~KM4U7KSBSR9X.2 size=503648 2024-09-12T00:42:29.180 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.181+0000 7fcde98768c0 1 > prepared multipart upload key=368TXYQVK9C3 upload=KM4U7KSBSR9X tag=399AMAAY7YFC type=write size=3649376 2024-09-12T00:42:29.183 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.185+0000 7fcde98768c0 1 < completed delete operation key=IV4JCE1QJC70 tag=M1MM678EFRLB type=del 2024-09-12T00:42:29.187 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.189+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~DAO9300LAMZN.0 size=1048576 2024-09-12T00:42:29.189 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.193+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~DAO9300LAMZN.1 size=711269 2024-09-12T00:42:29.189 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.193+0000 7fcde98768c0 1 > prepared multipart upload key=TUMAMUZUIR7E upload=DAO9300LAMZN tag=61S8N770NQM2 type=write size=2808421 2024-09-12T00:42:29.192 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.193+0000 7fcde98768c0 1 < completed delete operation key=V80E1NH858IK tag=HBTXQXXKTX1H type=del 2024-09-12T00:42:29.197 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.201+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~ACFD2A7YLIVC.0 size=1048576 2024-09-12T00:42:29.199 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.201+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~ACFD2A7YLIVC.1 size=759016 2024-09-12T00:42:29.199 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.201+0000 7fcde98768c0 1 > prepared multipart upload key=7UR0FX8HA2A5 upload=ACFD2A7YLIVC tag=2PJE4EA7KH1N type=write size=2856168 2024-09-12T00:42:29.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.205+0000 7fcde98768c0 1 < completed delete operation key=IV4JCE1QJC70 tag=RYXNMSVYD79T type=del 2024-09-12T00:42:29.206 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.209+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~9XFI3GTUS145.0 size=1048576 2024-09-12T00:42:29.208 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.209+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~9XFI3GTUS145.1 size=804577 2024-09-12T00:42:29.208 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.209+0000 7fcde98768c0 1 > prepared multipart upload key=368TXYQVK9C3 upload=9XFI3GTUS145 tag=NLNVU8QWBXG4 type=write size=2901729 2024-09-12T00:42:29.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.213+0000 7fcde98768c0 1 < completed delete operation key=C6PW0ETP4BG2 tag=0NSNJNK9ZDFB type=del 2024-09-12T00:42:29.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.217+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=SYXYUMLTRWN0 type=del size=603822 2024-09-12T00:42:29.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.221+0000 7fcde98768c0 1 < completed delete operation key=IV4JCE1QJC70 tag=1WP1X0ATYLHH type=del 2024-09-12T00:42:29.222 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.225+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~IALIGPV5B2J2.0 size=1048576 2024-09-12T00:42:29.225 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.229+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~IALIGPV5B2J2.1 size=197694 2024-09-12T00:42:29.225 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.229+0000 7fcde98768c0 1 > prepared multipart upload key=RC9A2Y5TCP9C upload=IALIGPV5B2J2 tag=1M9T9NO74XCS type=write size=2294846 2024-09-12T00:42:29.228 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.233+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~Y9QDPHKLXLWE.0 size=397397 2024-09-12T00:42:29.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.237+0000 7fcde98768c0 1 < completed multipart upload key=EDFNLQYP4L4L upload=Y9QDPHKLXLWE tag=XUV73P4P18PA type=write size=1445973 2024-09-12T00:42:29.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.241+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=B63QVF2ZUQM3 type=del size=1332044 2024-09-12T00:42:29.243 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.245+0000 7fcde98768c0 1 < suggested remove operation key=IV4JCE1QJC70 tag=RYLC97KWTVBS type=del 2024-09-12T00:42:29.249 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.253+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~1OW8VQBR629D.0 size=37946 2024-09-12T00:42:29.249 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.253+0000 7fcde98768c0 1 > prepared multipart upload key=97030NBF3MI4 upload=1OW8VQBR629D tag=ZR5R2X3RM5RK type=write size=1086522 2024-09-12T00:42:29.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.257+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~VEDYFPKZLGQE.0 size=1048576 2024-09-12T00:42:29.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.257+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~VEDYFPKZLGQE.1 size=1048576 2024-09-12T00:42:29.257 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.261+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~VEDYFPKZLGQE.2 size=619753 2024-09-12T00:42:29.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.265+0000 7fcde98768c0 1 < completed multipart upload key=C6PW0ETP4BG2 upload=VEDYFPKZLGQE tag=GR46A0F1JJ6P type=write size=3765481 2024-09-12T00:42:29.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.269+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=BXUERHCFT2QR type=del size=3440836 2024-09-12T00:42:29.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.273+0000 7fcde98768c0 1 < completed delete operation key=BZ4YUNTMOJBK tag=22NFXEIET3N5 type=del 2024-09-12T00:42:29.271 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.273+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=NJM4UNDS900K type=del size=1687753 2024-09-12T00:42:29.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.277+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~CWLXQ30V0ES4.0 size=1048576 2024-09-12T00:42:29.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.281+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~CWLXQ30V0ES4.1 size=246871 2024-09-12T00:42:29.281 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.285+0000 7fcde98768c0 1 < completed multipart upload key=WLE5QLNPAGZA upload=CWLXQ30V0ES4 tag=LIHRYSF35WQ0 type=write size=2344023 2024-09-12T00:42:29.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.289+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=DTORZLTRZDCV type=del size=1667541 2024-09-12T00:42:29.288 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.289+0000 7fcde98768c0 1 < completed write operation key=BZ4YUNTMOJBK tag=HRPPAZM1ANOY type=write size=681833 2024-09-12T00:42:29.291 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.293+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=J6D6DL7RFCXY type=del size=2369240 2024-09-12T00:42:29.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.297+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~WBE0QNFBX8S0.0 size=1048576 2024-09-12T00:42:29.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.297+0000 7fcde98768c0 1 < canceled part key=_multipart_97030NBF3MI4.2~WBE0QNFBX8S0.1 size=321459 2024-09-12T00:42:29.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.301+0000 7fcde98768c0 1 < canceled multipart upload key=97030NBF3MI4 upload=WBE0QNFBX8S0 tag=M69WVBS9JLUN type=write size=2418611 2024-09-12T00:42:29.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.305+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~425R7WT1OLDZ.0 size=43663 2024-09-12T00:42:29.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.305+0000 7fcde98768c0 1 > prepared multipart upload key=2T5IU2IUNGJX upload=425R7WT1OLDZ tag=EJM7W6RWXF0G type=write size=1092239 2024-09-12T00:42:29.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.313+0000 7fcde98768c0 1 < suggested update operation key=BZ4YUNTMOJBK tag=0TL2GGIVIBQQ type=del size=614756 2024-09-12T00:42:29.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.317+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~G3YH5WW9H3R2.0 size=1048576 2024-09-12T00:42:29.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.321+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~G3YH5WW9H3R2.1 size=1048576 2024-09-12T00:42:29.320 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.321+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~G3YH5WW9H3R2.2 size=681219 2024-09-12T00:42:29.320 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.321+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=G3YH5WW9H3R2 tag=1MUZST4NZOBB type=write size=3826947 2024-09-12T00:42:29.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.325+0000 7fcde98768c0 1 < canceled operation key=V80E1NH858IK tag=TLINQP88NF6I type=del size=87677 2024-09-12T00:42:29.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.329+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=VV1SMQRN2486 type=write size=742228 2024-09-12T00:42:29.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.333+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~2J2ZIVQD2FQD.0 size=1048576 2024-09-12T00:42:29.331 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.333+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~2J2ZIVQD2FQD.1 size=1048576 2024-09-12T00:42:29.333 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.337+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~2J2ZIVQD2FQD.2 size=766794 2024-09-12T00:42:29.338 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.341+0000 7fcde98768c0 1 < completed multipart upload key=RC9A2Y5TCP9C upload=2J2ZIVQD2FQD tag=S4TRVTHX7SLP type=write size=3912522 2024-09-12T00:42:29.347 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.349+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~127FYQHEJCX1.0 size=1048576 2024-09-12T00:42:29.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.353+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~127FYQHEJCX1.1 size=685439 2024-09-12T00:42:29.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.353+0000 7fcde98768c0 1 > prepared multipart upload key=5YBVLUYJW40U upload=127FYQHEJCX1 tag=OEZWZGO806IF type=write size=2782591 2024-09-12T00:42:29.352 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.353+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~KM4U7KSBSR9X.0 size=1048576 2024-09-12T00:42:29.354 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.357+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~KM4U7KSBSR9X.1 size=1048576 2024-09-12T00:42:29.356 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.361+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~KM4U7KSBSR9X.2 size=503648 2024-09-12T00:42:29.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.365+0000 7fcde98768c0 1 < completed multipart upload key=368TXYQVK9C3 upload=KM4U7KSBSR9X tag=399AMAAY7YFC type=write size=3649376 2024-09-12T00:42:29.364 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.365+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=ESHEY5TTQIVE type=del size=2337471 2024-09-12T00:42:29.367 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.369+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~DAO9300LAMZN.0 size=1048576 2024-09-12T00:42:29.370 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.373+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~DAO9300LAMZN.1 size=711269 2024-09-12T00:42:29.375 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.377+0000 7fcde98768c0 1 < completed multipart upload key=TUMAMUZUIR7E upload=DAO9300LAMZN tag=61S8N770NQM2 type=write size=2808421 2024-09-12T00:42:29.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.381+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=X3271T3HNOFF type=del size=1756912 2024-09-12T00:42:29.381 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.385+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~ACFD2A7YLIVC.0 size=1048576 2024-09-12T00:42:29.383 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.385+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~ACFD2A7YLIVC.1 size=759016 2024-09-12T00:42:29.388 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.389+0000 7fcde98768c0 1 < completed multipart upload key=7UR0FX8HA2A5 upload=ACFD2A7YLIVC tag=2PJE4EA7KH1N type=write size=2856168 2024-09-12T00:42:29.390 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.393+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=Y2NX28IVR7LG type=del size=2418267 2024-09-12T00:42:29.393 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.397+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~9XFI3GTUS145.0 size=1048576 2024-09-12T00:42:29.394 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.397+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~9XFI3GTUS145.1 size=804577 2024-09-12T00:42:29.399 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.401+0000 7fcde98768c0 1 < completed multipart upload key=368TXYQVK9C3 upload=9XFI3GTUS145 tag=NLNVU8QWBXG4 type=write size=2901729 2024-09-12T00:42:29.402 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.405+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=LD8T77T60MC2 type=write size=676548 2024-09-12T00:42:29.405 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.409+0000 7fcde98768c0 1 < completed delete operation key=3X9I78PMR1HV tag=SYXYUMLTRWN0 type=del 2024-09-12T00:42:29.408 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.413+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=SVLPC1PYQ16Z type=write size=535233 2024-09-12T00:42:29.411 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.413+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~IALIGPV5B2J2.0 size=1048576 2024-09-12T00:42:29.413 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.417+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~IALIGPV5B2J2.1 size=197694 2024-09-12T00:42:29.418 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.421+0000 7fcde98768c0 1 < completed multipart upload key=RC9A2Y5TCP9C upload=IALIGPV5B2J2 tag=1M9T9NO74XCS type=write size=2294846 2024-09-12T00:42:29.421 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.425+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=UD1BQY5ZR3VP type=del size=1504164 2024-09-12T00:42:29.424 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.425+0000 7fcde98768c0 1 < completed delete operation key=EDFNLQYP4L4L tag=B63QVF2ZUQM3 type=del 2024-09-12T00:42:29.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.429+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=YJ723QB3AU4E type=del size=400585 2024-09-12T00:42:29.428 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.429+0000 7fcde98768c0 1 < canceled part key=_multipart_97030NBF3MI4.2~1OW8VQBR629D.0 size=37946 2024-09-12T00:42:29.433 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.437+0000 7fcde98768c0 1 < canceled multipart upload key=97030NBF3MI4 upload=1OW8VQBR629D tag=ZR5R2X3RM5RK type=write size=1086522 2024-09-12T00:42:29.439 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.441+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~0WTMSH23B2G5.0 size=1048576 2024-09-12T00:42:29.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.445+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~0WTMSH23B2G5.1 size=1048576 2024-09-12T00:42:29.443 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.445+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~0WTMSH23B2G5.2 size=521683 2024-09-12T00:42:29.444 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.445+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=0WTMSH23B2G5 tag=KNM89BLBT9UE type=write size=3667411 2024-09-12T00:42:29.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.449+0000 7fcde98768c0 1 < completed delete operation key=NVOFV649MT0A tag=BXUERHCFT2QR type=del 2024-09-12T00:42:29.452 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.453+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~VO30UR041BXX.0 size=1048576 2024-09-12T00:42:29.454 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.457+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~VO30UR041BXX.1 size=1048576 2024-09-12T00:42:29.457 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.461+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~VO30UR041BXX.2 size=351167 2024-09-12T00:42:29.457 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.461+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=VO30UR041BXX tag=O4FT3Y47H07M type=write size=3496895 2024-09-12T00:42:29.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.461+0000 7fcde98768c0 1 < canceled operation key=V80E1NH858IK tag=NJM4UNDS900K type=del size=1687753 2024-09-12T00:42:29.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.465+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=METW08JMWBEX type=del size=3976273 2024-09-12T00:42:29.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.473+0000 7fcde98768c0 1 < suggested remove operation key=FUJIUIR1E00J tag=DTORZLTRZDCV type=del 2024-09-12T00:42:29.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.477+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~SPPI8O3XB3E5.0 size=1048576 2024-09-12T00:42:29.478 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.481+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~SPPI8O3XB3E5.1 size=1048576 2024-09-12T00:42:29.480 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.481+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~SPPI8O3XB3E5.2 size=36728 2024-09-12T00:42:29.480 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.481+0000 7fcde98768c0 1 > prepared multipart upload key=NVOFV649MT0A upload=SPPI8O3XB3E5 tag=65I99JGNURAW type=write size=3182456 2024-09-12T00:42:29.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.485+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=J6D6DL7RFCXY type=del 2024-09-12T00:42:29.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.493+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~UAZOVQ8U8W8J.0 size=667357 2024-09-12T00:42:29.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.493+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=UAZOVQ8U8W8J tag=D84OQHIS86HT type=write size=1715933 2024-09-12T00:42:29.491 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.493+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~425R7WT1OLDZ.0 size=43663 2024-09-12T00:42:29.497 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.501+0000 7fcde98768c0 1 < completed multipart upload key=2T5IU2IUNGJX upload=425R7WT1OLDZ tag=EJM7W6RWXF0G type=write size=1092239 2024-09-12T00:42:29.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.505+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~7M3KL7GXA9UB.0 size=482705 2024-09-12T00:42:29.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.505+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=7M3KL7GXA9UB tag=GURME91YGWRW type=write size=1531281 2024-09-12T00:42:29.503 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.505+0000 7fcde98768c0 1 < canceled part key=_multipart_IV4JCE1QJC70.2~G3YH5WW9H3R2.0 size=1048576 2024-09-12T00:42:29.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.509+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~G3YH5WW9H3R2.1 size=1048576 2024-09-12T00:42:29.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.513+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~G3YH5WW9H3R2.2 size=681219 2024-09-12T00:42:29.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.517+0000 7fcde98768c0 1 < canceled multipart upload key=IV4JCE1QJC70 upload=G3YH5WW9H3R2 tag=1MUZST4NZOBB type=write size=3826947 2024-09-12T00:42:29.519 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.521+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=MWDYBK5OA95F type=del size=197325 2024-09-12T00:42:29.526 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.529+0000 7fcde98768c0 1 < suggested update operation key=7UR0FX8HA2A5 tag=VV1SMQRN2486 type=write size=742228 2024-09-12T00:42:29.532 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.533+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~9YNRXXD3B3SR.0 size=1048576 2024-09-12T00:42:29.534 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.537+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~9YNRXXD3B3SR.1 size=902407 2024-09-12T00:42:29.534 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.537+0000 7fcde98768c0 1 > prepared multipart upload key=4487IMSOLPDV upload=9YNRXXD3B3SR tag=2JNQD79L2GWQ type=write size=2999559 2024-09-12T00:42:29.535 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.537+0000 7fcde98768c0 1 < canceled part key=_multipart_5YBVLUYJW40U.2~127FYQHEJCX1.0 size=1048576 2024-09-12T00:42:29.538 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.541+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~127FYQHEJCX1.1 size=685439 2024-09-12T00:42:29.543 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.545+0000 7fcde98768c0 1 < canceled multipart upload key=5YBVLUYJW40U upload=127FYQHEJCX1 tag=OEZWZGO806IF type=write size=2782591 2024-09-12T00:42:29.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.553+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~UUJ7CQ2QK57V.0 size=1048576 2024-09-12T00:42:29.552 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.553+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~UUJ7CQ2QK57V.1 size=540902 2024-09-12T00:42:29.552 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.553+0000 7fcde98768c0 1 > prepared multipart upload key=7UR0FX8HA2A5 upload=UUJ7CQ2QK57V tag=GC22VEPCQ9BA type=write size=2638054 2024-09-12T00:42:29.558 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.561+0000 7fcde98768c0 1 < suggested remove operation key=WLE5QLNPAGZA tag=ESHEY5TTQIVE type=del 2024-09-12T00:42:29.561 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.565+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=MC2O9453VWAI type=del size=2144608 2024-09-12T00:42:29.565 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.569+0000 7fcde98768c0 1 < completed delete operation key=ZQD0QXDN1J1I tag=X3271T3HNOFF type=del 2024-09-12T00:42:29.569 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.573+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=4EC9YU25XIBG type=del size=184350 2024-09-12T00:42:29.576 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.577+0000 7fcde98768c0 1 < suggested remove operation key=Z1PY2MFUC1C4 tag=Y2NX28IVR7LG type=del 2024-09-12T00:42:29.582 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.585+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~ECZSUPOG40KC.0 size=1048576 2024-09-12T00:42:29.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.589+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~ECZSUPOG40KC.1 size=586373 2024-09-12T00:42:29.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.589+0000 7fcde98768c0 1 > prepared multipart upload key=IMITNCB1ST9E upload=ECZSUPOG40KC tag=6HZW04M26CD9 type=write size=2683525 2024-09-12T00:42:29.591 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.593+0000 7fcde98768c0 1 < suggested update operation key=7UR0FX8HA2A5 tag=LD8T77T60MC2 type=write size=676548 2024-09-12T00:42:29.594 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.597+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=L34QHJK64U4S type=del size=4162285 2024-09-12T00:42:29.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.605+0000 7fcde98768c0 1 < suggested update operation key=R2EBH0Q5885L tag=SVLPC1PYQ16Z type=write size=535233 2024-09-12T00:42:29.607 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.609+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~00105194AJS8.0 size=1048576 2024-09-12T00:42:29.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.613+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~00105194AJS8.1 size=1048576 2024-09-12T00:42:29.612 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.613+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~00105194AJS8.2 size=642912 2024-09-12T00:42:29.612 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.613+0000 7fcde98768c0 1 > prepared multipart upload key=C6PW0ETP4BG2 upload=00105194AJS8 tag=3SXOOXB4NF4J type=write size=3788640 2024-09-12T00:42:29.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.617+0000 7fcde98768c0 1 < completed delete operation key=NVOFV649MT0A tag=UD1BQY5ZR3VP type=del 2024-09-12T00:42:29.622 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.625+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~IU5F54LO973F.0 size=252236 2024-09-12T00:42:29.622 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.625+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=IU5F54LO973F tag=493BOH370KLM type=write size=1300812 2024-09-12T00:42:29.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.629+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=YJ723QB3AU4E type=del 2024-09-12T00:42:29.628 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.629+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=QZYZPHDW3BY4 type=del size=2766292 2024-09-12T00:42:29.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.633+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~0WTMSH23B2G5.0 size=1048576 2024-09-12T00:42:29.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.641+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~0WTMSH23B2G5.1 size=1048576 2024-09-12T00:42:29.641 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.645+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~0WTMSH23B2G5.2 size=521683 2024-09-12T00:42:29.646 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.649+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=0WTMSH23B2G5 tag=KNM89BLBT9UE type=write size=3667411 2024-09-12T00:42:29.652 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.657+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~0KIZ7ZFK8EZR.0 size=457275 2024-09-12T00:42:29.652 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.657+0000 7fcde98768c0 1 > prepared multipart upload key=BQGIXJJWBAN0 upload=0KIZ7ZFK8EZR tag=J8J7FQWT890I type=write size=1505851 2024-09-12T00:42:29.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.657+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~VO30UR041BXX.0 size=1048576 2024-09-12T00:42:29.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.661+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~VO30UR041BXX.1 size=1048576 2024-09-12T00:42:29.661 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.665+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~VO30UR041BXX.2 size=351167 2024-09-12T00:42:29.666 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.669+0000 7fcde98768c0 1 < completed multipart upload key=BZ4YUNTMOJBK upload=VO30UR041BXX tag=O4FT3Y47H07M type=write size=3496895 2024-09-12T00:42:29.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.673+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=XZH816ZUW63U type=write size=349277 2024-09-12T00:42:29.671 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.673+0000 7fcde98768c0 1 < completed delete operation key=HVE3YQTFZWTV tag=METW08JMWBEX type=del 2024-09-12T00:42:29.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.681+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~OU8BUOU8VFL5.0 size=271883 2024-09-12T00:42:29.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.681+0000 7fcde98768c0 1 > prepared multipart upload key=R2EBH0Q5885L upload=OU8BUOU8VFL5 tag=MC4C1H5O3DSB type=write size=1320459 2024-09-12T00:42:29.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.681+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~SPPI8O3XB3E5.0 size=1048576 2024-09-12T00:42:29.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.685+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~SPPI8O3XB3E5.1 size=1048576 2024-09-12T00:42:29.685 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.689+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~SPPI8O3XB3E5.2 size=36728 2024-09-12T00:42:29.691 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.693+0000 7fcde98768c0 1 < completed multipart upload key=NVOFV649MT0A upload=SPPI8O3XB3E5 tag=65I99JGNURAW type=write size=3182456 2024-09-12T00:42:29.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.697+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~31XLIQQDK516.0 size=982922 2024-09-12T00:42:29.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.697+0000 7fcde98768c0 1 > prepared multipart upload key=2T5IU2IUNGJX upload=31XLIQQDK516 tag=4INCPTPKMI8R type=write size=2031498 2024-09-12T00:42:29.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.701+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~UAZOVQ8U8W8J.0 size=667357 2024-09-12T00:42:29.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.705+0000 7fcde98768c0 1 < completed multipart upload key=V80E1NH858IK upload=UAZOVQ8U8W8J tag=D84OQHIS86HT type=write size=1715933 2024-09-12T00:42:29.708 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.709+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~2TNPXY0CFHXV.0 size=1048576 2024-09-12T00:42:29.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.713+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~2TNPXY0CFHXV.1 size=1048576 2024-09-12T00:42:29.712 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.713+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~2TNPXY0CFHXV.2 size=838705 2024-09-12T00:42:29.712 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.713+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=2TNPXY0CFHXV tag=0TW0IIFKQG9N type=write size=3984433 2024-09-12T00:42:29.714 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.717+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~7M3KL7GXA9UB.0 size=482705 2024-09-12T00:42:29.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.721+0000 7fcde98768c0 1 < completed multipart upload key=QD5JXFL962R5 upload=7M3KL7GXA9UB tag=GURME91YGWRW type=write size=1531281 2024-09-12T00:42:29.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.725+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~IJK2FJQ0JS7V.0 size=1048576 2024-09-12T00:42:29.725 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.729+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~IJK2FJQ0JS7V.1 size=1048576 2024-09-12T00:42:29.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.729+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~IJK2FJQ0JS7V.2 size=57612 2024-09-12T00:42:29.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.729+0000 7fcde98768c0 1 > prepared multipart upload key=BQGIXJJWBAN0 upload=IJK2FJQ0JS7V tag=M1VUPAG96SRV type=write size=3203340 2024-09-12T00:42:29.729 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.733+0000 7fcde98768c0 1 < canceled operation key=F813QWV02TI0 tag=MWDYBK5OA95F type=del size=197325 2024-09-12T00:42:29.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.733+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=TJIY0ARSVVMF type=del size=3404624 2024-09-12T00:42:29.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.737+0000 7fcde98768c0 1 < canceled part key=_multipart_4487IMSOLPDV.2~9YNRXXD3B3SR.0 size=1048576 2024-09-12T00:42:29.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.737+0000 7fcde98768c0 1 < canceled part key=_multipart_4487IMSOLPDV.2~9YNRXXD3B3SR.1 size=902407 2024-09-12T00:42:29.737 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.741+0000 7fcde98768c0 1 < canceled multipart upload key=4487IMSOLPDV upload=9YNRXXD3B3SR tag=2JNQD79L2GWQ type=write size=2999559 2024-09-12T00:42:29.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.741+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=JDSM411M70E3 type=del size=1523431 2024-09-12T00:42:29.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.745+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~UUJ7CQ2QK57V.0 size=1048576 2024-09-12T00:42:29.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.749+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~UUJ7CQ2QK57V.1 size=540902 2024-09-12T00:42:29.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.753+0000 7fcde98768c0 1 < completed multipart upload key=7UR0FX8HA2A5 upload=UUJ7CQ2QK57V tag=GC22VEPCQ9BA type=write size=2638054 2024-09-12T00:42:29.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.757+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~ISK5BUILOF0M.0 size=627278 2024-09-12T00:42:29.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.757+0000 7fcde98768c0 1 > prepared multipart upload key=Z1PY2MFUC1C4 upload=ISK5BUILOF0M tag=6C4NX92AO0OZ type=write size=1675854 2024-09-12T00:42:29.760 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.761+0000 7fcde98768c0 1 < suggested remove operation key=F813QWV02TI0 tag=MC2O9453VWAI type=del 2024-09-12T00:42:29.765 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.769+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~NW7RK74OKB2Z.0 size=505502 2024-09-12T00:42:29.765 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.769+0000 7fcde98768c0 1 > prepared multipart upload key=Z1PY2MFUC1C4 upload=NW7RK74OKB2Z tag=QBMZEGF3RP2K type=write size=1554078 2024-09-12T00:42:29.771 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.773+0000 7fcde98768c0 1 < suggested update operation key=4487IMSOLPDV tag=4EC9YU25XIBG type=del size=184350 2024-09-12T00:42:29.774 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.777+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=GWHRGVRR3XDG type=del size=1889146 2024-09-12T00:42:29.777 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.781+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~ECZSUPOG40KC.0 size=1048576 2024-09-12T00:42:29.780 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.781+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~ECZSUPOG40KC.1 size=586373 2024-09-12T00:42:29.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.789+0000 7fcde98768c0 1 < completed multipart upload key=IMITNCB1ST9E upload=ECZSUPOG40KC tag=6HZW04M26CD9 type=write size=2683525 2024-09-12T00:42:29.789 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.793+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=GS89MIMV8XZX type=del size=1512604 2024-09-12T00:42:29.792 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.793+0000 7fcde98768c0 1 < completed delete operation key=ZQD0QXDN1J1I tag=L34QHJK64U4S type=del 2024-09-12T00:42:29.797 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.801+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~NQ1VSA7JA4YB.0 size=656327 2024-09-12T00:42:29.798 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.801+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=NQ1VSA7JA4YB tag=G4KJJ5PT39VQ type=write size=1704903 2024-09-12T00:42:29.800 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.801+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~00105194AJS8.0 size=1048576 2024-09-12T00:42:29.803 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.805+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~00105194AJS8.1 size=1048576 2024-09-12T00:42:29.805 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.809+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~00105194AJS8.2 size=642912 2024-09-12T00:42:29.810 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.813+0000 7fcde98768c0 1 < completed multipart upload key=C6PW0ETP4BG2 upload=00105194AJS8 tag=3SXOOXB4NF4J type=write size=3788640 2024-09-12T00:42:29.816 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.817+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~P8W5EMI2NEOY.0 size=17257 2024-09-12T00:42:29.816 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.817+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=P8W5EMI2NEOY tag=QFYGJZSSDZ9Q type=write size=1065833 2024-09-12T00:42:29.819 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.821+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~IU5F54LO973F.0 size=252236 2024-09-12T00:42:29.824 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.825+0000 7fcde98768c0 1 < completed multipart upload key=QD5JXFL962R5 upload=IU5F54LO973F tag=493BOH370KLM type=write size=1300812 2024-09-12T00:42:29.827 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.829+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=7FH7SD3T033F type=del size=3583304 2024-09-12T00:42:29.831 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.833+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=QZYZPHDW3BY4 type=del 2024-09-12T00:42:29.834 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.837+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=0S1VU666ACO1 type=del size=2316386 2024-09-12T00:42:29.837 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.841+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~0KIZ7ZFK8EZR.0 size=457275 2024-09-12T00:42:29.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.845+0000 7fcde98768c0 1 < completed multipart upload key=BQGIXJJWBAN0 upload=0KIZ7ZFK8EZR tag=J8J7FQWT890I type=write size=1505851 2024-09-12T00:42:29.846 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.849+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=8LPBQMQ830LL type=del size=893458 2024-09-12T00:42:29.853 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.857+0000 7fcde98768c0 1 < suggested update operation key=368TXYQVK9C3 tag=XZH816ZUW63U type=write size=349277 2024-09-12T00:42:29.857 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.861+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=AK1CTFC9CAEP type=write size=414224 2024-09-12T00:42:29.860 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.865+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~OU8BUOU8VFL5.0 size=271883 2024-09-12T00:42:29.866 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.869+0000 7fcde98768c0 1 < completed multipart upload key=R2EBH0Q5885L upload=OU8BUOU8VFL5 tag=MC4C1H5O3DSB type=write size=1320459 2024-09-12T00:42:29.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.877+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~FZPPH57J9CQC.0 size=1048576 2024-09-12T00:42:29.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.877+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~FZPPH57J9CQC.1 size=1048576 2024-09-12T00:42:29.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.881+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~FZPPH57J9CQC.2 size=225442 2024-09-12T00:42:29.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.881+0000 7fcde98768c0 1 > prepared multipart upload key=KME8ZTTUGOXY upload=FZPPH57J9CQC tag=EV3N7JBO8H5T type=write size=3371170 2024-09-12T00:42:29.882 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.885+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~31XLIQQDK516.0 size=982922 2024-09-12T00:42:29.887 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.889+0000 7fcde98768c0 1 < completed multipart upload key=2T5IU2IUNGJX upload=31XLIQQDK516 tag=4INCPTPKMI8R type=write size=2031498 2024-09-12T00:42:29.894 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.897+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~A3BS5OKE2OVC.0 size=971893 2024-09-12T00:42:29.894 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.897+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=A3BS5OKE2OVC tag=UOCXB2WCJ5VF type=write size=2020469 2024-09-12T00:42:29.897 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.901+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~2TNPXY0CFHXV.0 size=1048576 2024-09-12T00:42:29.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.901+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~2TNPXY0CFHXV.1 size=1048576 2024-09-12T00:42:29.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.901+0000 7fcde98768c0 1 < canceled part key=_multipart_BZ4YUNTMOJBK.2~2TNPXY0CFHXV.2 size=838705 2024-09-12T00:42:29.905 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.909+0000 7fcde98768c0 1 < canceled multipart upload key=BZ4YUNTMOJBK upload=2TNPXY0CFHXV tag=0TW0IIFKQG9N type=write size=3984433 2024-09-12T00:42:29.910 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.913+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~9RKCH5RENBCE.0 size=597575 2024-09-12T00:42:29.910 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.913+0000 7fcde98768c0 1 > prepared multipart upload key=4487IMSOLPDV upload=9RKCH5RENBCE tag=37P448S3NVOH type=write size=1646151 2024-09-12T00:42:29.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.921+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~IJK2FJQ0JS7V.0 size=1048576 2024-09-12T00:42:29.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.921+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~IJK2FJQ0JS7V.1 size=1048576 2024-09-12T00:42:29.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.921+0000 7fcde98768c0 1 < canceled part key=_multipart_BQGIXJJWBAN0.2~IJK2FJQ0JS7V.2 size=57612 2024-09-12T00:42:29.925 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.929+0000 7fcde98768c0 1 < canceled multipart upload key=BQGIXJJWBAN0 upload=IJK2FJQ0JS7V tag=M1VUPAG96SRV type=write size=3203340 2024-09-12T00:42:29.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.933+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~CDOYGBTYL1XP.0 size=1048576 2024-09-12T00:42:29.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.937+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~CDOYGBTYL1XP.1 size=172555 2024-09-12T00:42:29.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.937+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=CDOYGBTYL1XP tag=0YFNZMI026CQ type=write size=2269707 2024-09-12T00:42:29.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.941+0000 7fcde98768c0 1 < suggested update operation key=ZQD0QXDN1J1I tag=TJIY0ARSVVMF type=del size=3404624 2024-09-12T00:42:29.942 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.945+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=NOP3397I8M69 type=del size=4136020 2024-09-12T00:42:29.945 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.949+0000 7fcde98768c0 1 < canceled operation key=Z1PY2MFUC1C4 tag=JDSM411M70E3 type=del size=1523431 2024-09-12T00:42:29.950 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.953+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~G4BTFL75FRRY.0 size=1048576 2024-09-12T00:42:29.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.957+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~G4BTFL75FRRY.1 size=1048576 2024-09-12T00:42:29.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.957+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~G4BTFL75FRRY.2 size=10135 2024-09-12T00:42:29.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.957+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=G4BTFL75FRRY tag=SH0QDA2IMF0P type=write size=3155863 2024-09-12T00:42:29.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.961+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~ISK5BUILOF0M.0 size=627278 2024-09-12T00:42:29.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.965+0000 7fcde98768c0 1 < completed multipart upload key=Z1PY2MFUC1C4 upload=ISK5BUILOF0M tag=6C4NX92AO0OZ type=write size=1675854 2024-09-12T00:42:29.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.969+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=F974CO7VVSNS type=del size=720726 2024-09-12T00:42:29.970 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.973+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~NW7RK74OKB2Z.0 size=505502 2024-09-12T00:42:29.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.977+0000 7fcde98768c0 1 < completed multipart upload key=Z1PY2MFUC1C4 upload=NW7RK74OKB2Z tag=QBMZEGF3RP2K type=write size=1554078 2024-09-12T00:42:29.977 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.981+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=XSAB36142FJ0 type=del size=2712506 2024-09-12T00:42:29.980 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.981+0000 7fcde98768c0 1 < canceled operation key=FUJIUIR1E00J tag=GWHRGVRR3XDG type=del size=1889146 2024-09-12T00:42:29.983 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.985+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=5EU40G7FM1VP type=write size=908243 2024-09-12T00:42:29.986 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.989+0000 7fcde98768c0 1 < completed delete operation key=J9EUM073CZHF tag=GS89MIMV8XZX type=del 2024-09-12T00:42:29.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.993+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~8NUXZUPCIAT6.0 size=1048576 2024-09-12T00:42:29.993 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.997+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~8NUXZUPCIAT6.1 size=322409 2024-09-12T00:42:29.993 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.997+0000 7fcde98768c0 1 > prepared multipart upload key=BQGIXJJWBAN0 upload=8NUXZUPCIAT6 tag=K3O6PMIP1LLT type=write size=2419561 2024-09-12T00:42:29.996 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:29.997+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~NQ1VSA7JA4YB.0 size=656327 2024-09-12T00:42:30.000 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.005+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=NQ1VSA7JA4YB tag=G4KJJ5PT39VQ type=write size=1704903 2024-09-12T00:42:30.003 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.005+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=56N95OSVXDUB type=del size=3362306 2024-09-12T00:42:30.006 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.009+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~P8W5EMI2NEOY.0 size=17257 2024-09-12T00:42:30.010 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.013+0000 7fcde98768c0 1 < completed multipart upload key=IV4JCE1QJC70 upload=P8W5EMI2NEOY tag=QFYGJZSSDZ9Q type=write size=1065833 2024-09-12T00:42:30.013 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.017+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=XC19N492TI36 type=write size=577432 2024-09-12T00:42:30.015 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.017+0000 7fcde98768c0 1 < completed delete operation key=Z1PY2MFUC1C4 tag=7FH7SD3T033F type=del 2024-09-12T00:42:30.020 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.021+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~9S68XS8X2CI1.0 size=1048576 2024-09-12T00:42:30.022 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.025+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~9S68XS8X2CI1.1 size=1048576 2024-09-12T00:42:30.024 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.029+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~9S68XS8X2CI1.2 size=477459 2024-09-12T00:42:30.025 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.029+0000 7fcde98768c0 1 > prepared multipart upload key=HVE3YQTFZWTV upload=9S68XS8X2CI1 tag=QECWN7HBF04C type=write size=3623187 2024-09-12T00:42:30.029 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.033+0000 7fcde98768c0 1 < suggested update operation key=368TXYQVK9C3 tag=0S1VU666ACO1 type=del size=2316386 2024-09-12T00:42:30.032 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.033+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=50N5N8NEK25D type=write size=784056 2024-09-12T00:42:30.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.037+0000 7fcde98768c0 1 < completed delete operation key=5YBVLUYJW40U tag=8LPBQMQ830LL type=del 2024-09-12T00:42:30.038 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.041+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=958GK5YQPBEC type=del size=391274 2024-09-12T00:42:30.041 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.045+0000 7fcde98768c0 1 < completed write operation key=3QOENE572J7A tag=AK1CTFC9CAEP type=write size=414224 2024-09-12T00:42:30.046 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.049+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~73UVF0BCDVTR.0 size=1048576 2024-09-12T00:42:30.048 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.049+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~73UVF0BCDVTR.1 size=1416 2024-09-12T00:42:30.048 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.049+0000 7fcde98768c0 1 > prepared multipart upload key=EDFNLQYP4L4L upload=73UVF0BCDVTR tag=IP76ZN455A1M type=write size=2098568 2024-09-12T00:42:30.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.053+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~FZPPH57J9CQC.0 size=1048576 2024-09-12T00:42:30.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.053+0000 7fcde98768c0 1 < canceled part key=_multipart_KME8ZTTUGOXY.2~FZPPH57J9CQC.1 size=1048576 2024-09-12T00:42:30.054 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.057+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~FZPPH57J9CQC.2 size=225442 2024-09-12T00:42:30.058 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.061+0000 7fcde98768c0 1 < canceled multipart upload key=KME8ZTTUGOXY upload=FZPPH57J9CQC tag=EV3N7JBO8H5T type=write size=3371170 2024-09-12T00:42:30.062 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.065+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=5VI2TWMGOAYI type=del size=692538 2024-09-12T00:42:30.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.069+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~A3BS5OKE2OVC.0 size=971893 2024-09-12T00:42:30.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.073+0000 7fcde98768c0 1 < completed multipart upload key=V80E1NH858IK upload=A3BS5OKE2OVC tag=UOCXB2WCJ5VF type=write size=2020469 2024-09-12T00:42:30.074 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.077+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~EBFQRYSPA2ZT.0 size=5131 2024-09-12T00:42:30.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.077+0000 7fcde98768c0 1 > prepared multipart upload key=Z4RNDW37GEK6 upload=EBFQRYSPA2ZT tag=6INN5GBS1T3E type=write size=1053707 2024-09-12T00:42:30.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.077+0000 7fcde98768c0 1 < canceled part key=_multipart_4487IMSOLPDV.2~9RKCH5RENBCE.0 size=597575 2024-09-12T00:42:30.080 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.081+0000 7fcde98768c0 1 < canceled multipart upload key=4487IMSOLPDV upload=9RKCH5RENBCE tag=37P448S3NVOH type=write size=1646151 2024-09-12T00:42:30.085 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.089+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~9S1Y17RVT47N.0 size=442803 2024-09-12T00:42:30.085 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.089+0000 7fcde98768c0 1 > prepared multipart upload key=F813QWV02TI0 upload=9S1Y17RVT47N tag=K9YVP9VPS2UI type=write size=1491379 2024-09-12T00:42:30.088 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.089+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~CDOYGBTYL1XP.0 size=1048576 2024-09-12T00:42:30.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.093+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~CDOYGBTYL1XP.1 size=172555 2024-09-12T00:42:30.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.097+0000 7fcde98768c0 1 < completed multipart upload key=QD5JXFL962R5 upload=CDOYGBTYL1XP tag=0YFNZMI026CQ type=write size=2269707 2024-09-12T00:42:30.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.101+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=CAORBDP40C91 type=del size=3394001 2024-09-12T00:42:30.101 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.105+0000 7fcde98768c0 1 < completed delete operation key=97030NBF3MI4 tag=NOP3397I8M69 type=del 2024-09-12T00:42:30.104 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.105+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=7C5KPSF3AJM4 type=write size=148120 2024-09-12T00:42:30.107 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.109+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~G4BTFL75FRRY.0 size=1048576 2024-09-12T00:42:30.110 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.113+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~G4BTFL75FRRY.1 size=1048576 2024-09-12T00:42:30.113 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.117+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~G4BTFL75FRRY.2 size=10135 2024-09-12T00:42:30.118 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.121+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=G4BTFL75FRRY tag=SH0QDA2IMF0P type=write size=3155863 2024-09-12T00:42:30.121 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.125+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=ZHN8QFPJ1O04 type=write size=620544 2024-09-12T00:42:30.124 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.125+0000 7fcde98768c0 1 < completed delete operation key=F813QWV02TI0 tag=F974CO7VVSNS type=del 2024-09-12T00:42:30.127 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.129+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=03Y80ROPE7BI type=del size=2010922 2024-09-12T00:42:30.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.137+0000 7fcde98768c0 1 < suggested remove operation key=5B8C6E8L5N52 tag=XSAB36142FJ0 type=del 2024-09-12T00:42:30.138 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.141+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~WT4S7YFNEDAW.0 size=473671 2024-09-12T00:42:30.138 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.141+0000 7fcde98768c0 1 > prepared multipart upload key=Z4RNDW37GEK6 upload=WT4S7YFNEDAW tag=DJH81TB7WS80 type=write size=1522247 2024-09-12T00:42:30.140 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.145+0000 7fcde98768c0 1 < completed write operation key=WLE5QLNPAGZA tag=5EU40G7FM1VP type=write size=908243 2024-09-12T00:42:30.145 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.149+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~QUC0MF1D9JL5.0 size=310092 2024-09-12T00:42:30.145 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.149+0000 7fcde98768c0 1 > prepared multipart upload key=3X9I78PMR1HV upload=QUC0MF1D9JL5 tag=4JI1LQAYW3CJ type=write size=1358668 2024-09-12T00:42:30.148 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.149+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~8NUXZUPCIAT6.0 size=1048576 2024-09-12T00:42:30.148 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.149+0000 7fcde98768c0 1 < canceled part key=_multipart_BQGIXJJWBAN0.2~8NUXZUPCIAT6.1 size=322409 2024-09-12T00:42:30.152 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.153+0000 7fcde98768c0 1 < canceled multipart upload key=BQGIXJJWBAN0 upload=8NUXZUPCIAT6 tag=K3O6PMIP1LLT type=write size=2419561 2024-09-12T00:42:30.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.157+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=0NAIKUKEUWDF type=write size=476114 2024-09-12T00:42:30.160 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.165+0000 7fcde98768c0 1 < suggested update operation key=JW2GNFAYFNEK tag=56N95OSVXDUB type=del size=3362306 2024-09-12T00:42:30.163 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.165+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=7AHU3C8LPHXV type=del size=1427631 2024-09-12T00:42:30.166 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.169+0000 7fcde98768c0 1 < completed write operation key=4487IMSOLPDV tag=XC19N492TI36 type=write size=577432 2024-09-12T00:42:30.169 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.173+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=WRVU8JC9XCKB type=del size=1723270 2024-09-12T00:42:30.172 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.173+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~9S68XS8X2CI1.0 size=1048576 2024-09-12T00:42:30.172 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.173+0000 7fcde98768c0 1 < canceled part key=_multipart_HVE3YQTFZWTV.2~9S68XS8X2CI1.1 size=1048576 2024-09-12T00:42:30.174 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.177+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~9S68XS8X2CI1.2 size=477459 2024-09-12T00:42:30.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.181+0000 7fcde98768c0 1 < canceled multipart upload key=HVE3YQTFZWTV upload=9S68XS8X2CI1 tag=QECWN7HBF04C type=write size=3623187 2024-09-12T00:42:30.185 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.189+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=0TNKPJJQN34A type=del size=2636527 2024-09-12T00:42:30.191 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.193+0000 7fcde98768c0 1 < suggested update operation key=WLE5QLNPAGZA tag=50N5N8NEK25D type=write size=784056 2024-09-12T00:42:30.194 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.197+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=1YNB19J6VBVK type=del size=4113042 2024-09-12T00:42:30.199 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.201+0000 7fcde98768c0 1 < suggested update operation key=HVE3YQTFZWTV tag=958GK5YQPBEC type=del size=391274 2024-09-12T00:42:30.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.205+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=L56TB6R47GTC type=del size=3226899 2024-09-12T00:42:30.206 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.209+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~73UVF0BCDVTR.0 size=1048576 2024-09-12T00:42:30.208 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.213+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~73UVF0BCDVTR.1 size=1416 2024-09-12T00:42:30.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.217+0000 7fcde98768c0 1 < completed multipart upload key=EDFNLQYP4L4L upload=73UVF0BCDVTR tag=IP76ZN455A1M type=write size=2098568 2024-09-12T00:42:30.219 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.221+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~Q85XH6X63J4A.0 size=1048576 2024-09-12T00:42:30.222 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.225+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~Q85XH6X63J4A.1 size=446624 2024-09-12T00:42:30.222 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.225+0000 7fcde98768c0 1 > prepared multipart upload key=KME8ZTTUGOXY upload=Q85XH6X63J4A tag=15JREG5BJBEC type=write size=2543776 2024-09-12T00:42:30.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.233+0000 7fcde98768c0 1 < suggested remove operation key=WLE5QLNPAGZA tag=5VI2TWMGOAYI type=del 2024-09-12T00:42:30.232 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.233+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=Y31S6FVJMU3O type=del size=395493 2024-09-12T00:42:30.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.237+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~EBFQRYSPA2ZT.0 size=5131 2024-09-12T00:42:30.240 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.241+0000 7fcde98768c0 1 < completed multipart upload key=Z4RNDW37GEK6 upload=EBFQRYSPA2ZT tag=6INN5GBS1T3E type=write size=1053707 2024-09-12T00:42:30.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.249+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~I7LU191VG7QK.0 size=1048576 2024-09-12T00:42:30.248 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.253+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~I7LU191VG7QK.1 size=1048576 2024-09-12T00:42:30.251 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.253+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~I7LU191VG7QK.2 size=568740 2024-09-12T00:42:30.251 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.253+0000 7fcde98768c0 1 > prepared multipart upload key=4487IMSOLPDV upload=I7LU191VG7QK tag=PU9KFUIOBRK0 type=write size=3714468 2024-09-12T00:42:30.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.257+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~9S1Y17RVT47N.0 size=442803 2024-09-12T00:42:30.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.261+0000 7fcde98768c0 1 < completed multipart upload key=F813QWV02TI0 upload=9S1Y17RVT47N tag=K9YVP9VPS2UI type=write size=1491379 2024-09-12T00:42:30.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.269+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~41ML6157O6A2.0 size=1048576 2024-09-12T00:42:30.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.269+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~41ML6157O6A2.1 size=1048576 2024-09-12T00:42:30.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.273+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~41ML6157O6A2.2 size=944257 2024-09-12T00:42:30.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.273+0000 7fcde98768c0 1 > prepared multipart upload key=Z1PY2MFUC1C4 upload=41ML6157O6A2 tag=BSS82VY123TF type=write size=4089985 2024-09-12T00:42:30.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.277+0000 7fcde98768c0 1 < completed delete operation key=5YBVLUYJW40U tag=CAORBDP40C91 type=del 2024-09-12T00:42:30.279 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.281+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~81IJPWUC26H5.0 size=1048576 2024-09-12T00:42:30.282 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.285+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~81IJPWUC26H5.1 size=1048576 2024-09-12T00:42:30.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.289+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~81IJPWUC26H5.2 size=433835 2024-09-12T00:42:30.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.289+0000 7fcde98768c0 1 > prepared multipart upload key=C6PW0ETP4BG2 upload=81IJPWUC26H5 tag=8Z66LQ4VX705 type=write size=3579563 2024-09-12T00:42:30.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.293+0000 7fcde98768c0 1 < completed write operation key=5YBVLUYJW40U tag=7C5KPSF3AJM4 type=write size=148120 2024-09-12T00:42:30.292 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.293+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=YHAWWH27IRPC type=write size=488898 2024-09-12T00:42:30.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.301+0000 7fcde98768c0 1 < suggested remove operation key=HVE3YQTFZWTV tag=ZHN8QFPJ1O04 type=write 2024-09-12T00:42:30.300 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.301+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=AKPKQSW1I177 type=write size=515295 2024-09-12T00:42:30.302 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.305+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=03Y80ROPE7BI type=del 2024-09-12T00:42:30.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.309+0000 7fcde98768c0 1 > prepared operation key=KME8ZTTUGOXY tag=LL9UOCLLZXB8 type=write size=570217 2024-09-12T00:42:30.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.309+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~WT4S7YFNEDAW.0 size=473671 2024-09-12T00:42:30.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.313+0000 7fcde98768c0 1 < completed multipart upload key=Z4RNDW37GEK6 upload=WT4S7YFNEDAW tag=DJH81TB7WS80 type=write size=1522247 2024-09-12T00:42:30.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.321+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~R6JDJPK54EP7.0 size=1048576 2024-09-12T00:42:30.319 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.321+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~R6JDJPK54EP7.1 size=554083 2024-09-12T00:42:30.320 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.321+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=R6JDJPK54EP7 tag=H5GFOY3PLWWU type=write size=2651235 2024-09-12T00:42:30.320 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.325+0000 7fcde98768c0 1 < canceled part key=_multipart_3X9I78PMR1HV.2~QUC0MF1D9JL5.0 size=310092 2024-09-12T00:42:30.325 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.329+0000 7fcde98768c0 1 < canceled multipart upload key=3X9I78PMR1HV upload=QUC0MF1D9JL5 tag=4JI1LQAYW3CJ type=write size=1358668 2024-09-12T00:42:30.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.333+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=EA8GAE7JFGRW type=write size=411576 2024-09-12T00:42:30.332 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.333+0000 7fcde98768c0 1 < canceled operation key=RC9A2Y5TCP9C tag=0NAIKUKEUWDF type=write size=476114 2024-09-12T00:42:30.338 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.341+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~O0B5ZNG9JEO3.0 size=244701 2024-09-12T00:42:30.338 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.341+0000 7fcde98768c0 1 > prepared multipart upload key=BQGIXJJWBAN0 upload=O0B5ZNG9JEO3 tag=0RWJ1VANKOWN type=write size=1293277 2024-09-12T00:42:30.344 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.345+0000 7fcde98768c0 1 < suggested update operation key=G6R8BX1H7SPM tag=7AHU3C8LPHXV type=del size=1427631 2024-09-12T00:42:30.346 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.349+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=VA7YZZINP2JI type=del size=228479 2024-09-12T00:42:30.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.353+0000 7fcde98768c0 1 < completed delete operation key=7UR0FX8HA2A5 tag=WRVU8JC9XCKB type=del 2024-09-12T00:42:30.352 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.357+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=EZO6E7CTA0O9 type=write size=224986 2024-09-12T00:42:30.356 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.357+0000 7fcde98768c0 1 < completed delete operation key=4487IMSOLPDV tag=0TNKPJJQN34A type=del 2024-09-12T00:42:30.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.365+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~48WNO2H2TI9C.0 size=1048576 2024-09-12T00:42:30.362 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.365+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~48WNO2H2TI9C.1 size=389884 2024-09-12T00:42:30.363 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.365+0000 7fcde98768c0 1 > prepared multipart upload key=3QOENE572J7A upload=48WNO2H2TI9C tag=814HE63LNAUK type=write size=2487036 2024-09-12T00:42:30.365 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.369+0000 7fcde98768c0 1 < completed delete operation key=97030NBF3MI4 tag=1YNB19J6VBVK type=del 2024-09-12T00:42:30.368 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.373+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=8A4HZXOPLE3Z type=del size=2220867 2024-09-12T00:42:30.372 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.373+0000 7fcde98768c0 1 < completed delete operation key=Z4RNDW37GEK6 tag=L56TB6R47GTC type=del 2024-09-12T00:42:30.375 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.377+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=6V6NLN8VBGVP type=del size=3643806 2024-09-12T00:42:30.377 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.381+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~Q85XH6X63J4A.0 size=1048576 2024-09-12T00:42:30.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.381+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~Q85XH6X63J4A.1 size=446624 2024-09-12T00:42:30.385 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.389+0000 7fcde98768c0 1 < completed multipart upload key=KME8ZTTUGOXY upload=Q85XH6X63J4A tag=15JREG5BJBEC type=write size=2543776 2024-09-12T00:42:30.390 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.393+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~PJ6EOH9QLUZT.0 size=1048576 2024-09-12T00:42:30.392 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.393+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~PJ6EOH9QLUZT.1 size=1048576 2024-09-12T00:42:30.394 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.397+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~PJ6EOH9QLUZT.2 size=115726 2024-09-12T00:42:30.394 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.397+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=PJ6EOH9QLUZT tag=HVTJGJ2XETNZ type=write size=3261454 2024-09-12T00:42:30.397 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.401+0000 7fcde98768c0 1 < completed delete operation key=C6PW0ETP4BG2 tag=Y31S6FVJMU3O type=del 2024-09-12T00:42:30.402 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.405+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~32TG8NTBR0MI.0 size=724567 2024-09-12T00:42:30.402 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.405+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=32TG8NTBR0MI tag=258SFEEQNCMB type=write size=1773143 2024-09-12T00:42:30.404 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.405+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~I7LU191VG7QK.0 size=1048576 2024-09-12T00:42:30.406 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.409+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~I7LU191VG7QK.1 size=1048576 2024-09-12T00:42:30.408 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.413+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~I7LU191VG7QK.2 size=568740 2024-09-12T00:42:30.413 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.417+0000 7fcde98768c0 1 < completed multipart upload key=4487IMSOLPDV upload=I7LU191VG7QK tag=PU9KFUIOBRK0 type=write size=3714468 2024-09-12T00:42:30.415 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.417+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=A94UNUI7WJM0 type=del size=655690 2024-09-12T00:42:30.418 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.421+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~41ML6157O6A2.0 size=1048576 2024-09-12T00:42:30.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.425+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~41ML6157O6A2.1 size=1048576 2024-09-12T00:42:30.422 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.425+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~41ML6157O6A2.2 size=944257 2024-09-12T00:42:30.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.429+0000 7fcde98768c0 1 < completed multipart upload key=Z1PY2MFUC1C4 upload=41ML6157O6A2 tag=BSS82VY123TF type=write size=4089985 2024-09-12T00:42:30.431 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.433+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~BMTC3W1FOFEK.0 size=624027 2024-09-12T00:42:30.431 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.433+0000 7fcde98768c0 1 > prepared multipart upload key=FUJIUIR1E00J upload=BMTC3W1FOFEK tag=2G57YW0VVSX1 type=write size=1672603 2024-09-12T00:42:30.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.437+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~81IJPWUC26H5.0 size=1048576 2024-09-12T00:42:30.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.437+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~81IJPWUC26H5.1 size=1048576 2024-09-12T00:42:30.438 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.441+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~81IJPWUC26H5.2 size=433835 2024-09-12T00:42:30.442 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.445+0000 7fcde98768c0 1 < completed multipart upload key=C6PW0ETP4BG2 upload=81IJPWUC26H5 tag=8Z66LQ4VX705 type=write size=3579563 2024-09-12T00:42:30.445 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.449+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=V2ZXBX14I1LI type=write size=131077 2024-09-12T00:42:30.451 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.453+0000 7fcde98768c0 1 < suggested remove operation key=Z1PY2MFUC1C4 tag=YHAWWH27IRPC type=write 2024-09-12T00:42:30.457 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.461+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=8S5VR66YRATJ type=del size=1996282 2024-09-12T00:42:30.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.461+0000 7fcde98768c0 1 < completed write operation key=97030NBF3MI4 tag=AKPKQSW1I177 type=write size=515295 2024-09-12T00:42:30.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.469+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~JEA01OLCLX4W.0 size=1048576 2024-09-12T00:42:30.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.469+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~JEA01OLCLX4W.1 size=1048576 2024-09-12T00:42:30.468 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.473+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~JEA01OLCLX4W.2 size=1038902 2024-09-12T00:42:30.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.473+0000 7fcde98768c0 1 > prepared multipart upload key=Z4RNDW37GEK6 upload=JEA01OLCLX4W tag=QJH4GX7U6B5W type=write size=4184630 2024-09-12T00:42:30.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.473+0000 7fcde98768c0 1 < completed write operation key=KME8ZTTUGOXY tag=LL9UOCLLZXB8 type=write size=570217 2024-09-12T00:42:30.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.477+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~H9ZAX6282RG9.0 size=1048576 2024-09-12T00:42:30.477 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.481+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~H9ZAX6282RG9.1 size=1048576 2024-09-12T00:42:30.479 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.481+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~H9ZAX6282RG9.2 size=604892 2024-09-12T00:42:30.479 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.481+0000 7fcde98768c0 1 > prepared multipart upload key=Z1PY2MFUC1C4 upload=H9ZAX6282RG9 tag=NP9LCCI9BDY3 type=write size=3750620 2024-09-12T00:42:30.482 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.485+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~R6JDJPK54EP7.0 size=1048576 2024-09-12T00:42:30.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.485+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~R6JDJPK54EP7.1 size=554083 2024-09-12T00:42:30.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.489+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=R6JDJPK54EP7 tag=H5GFOY3PLWWU type=write size=2651235 2024-09-12T00:42:30.492 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.493+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~XWEYEEPY4KYG.0 size=1048576 2024-09-12T00:42:30.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.497+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~XWEYEEPY4KYG.1 size=778829 2024-09-12T00:42:30.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.497+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=XWEYEEPY4KYG tag=EZSKOSYDWY00 type=write size=2875981 2024-09-12T00:42:30.497 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.501+0000 7fcde98768c0 1 < completed write operation key=NVOFV649MT0A tag=EA8GAE7JFGRW type=write size=411576 2024-09-12T00:42:30.501 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.505+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~3Q6ZLNE4KPT8.0 size=1048576 2024-09-12T00:42:30.503 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.505+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~3Q6ZLNE4KPT8.1 size=1048576 2024-09-12T00:42:30.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.509+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~3Q6ZLNE4KPT8.2 size=344115 2024-09-12T00:42:30.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.509+0000 7fcde98768c0 1 > prepared multipart upload key=HVE3YQTFZWTV upload=3Q6ZLNE4KPT8 tag=02QAJZMS2YYU type=write size=3489843 2024-09-12T00:42:30.507 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.509+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~O0B5ZNG9JEO3.0 size=244701 2024-09-12T00:42:30.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.513+0000 7fcde98768c0 1 < completed multipart upload key=BQGIXJJWBAN0 upload=O0B5ZNG9JEO3 tag=0RWJ1VANKOWN type=write size=1293277 2024-09-12T00:42:30.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.517+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=W2CSV25HD8YD type=del size=3629197 2024-09-12T00:42:30.518 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.521+0000 7fcde98768c0 1 < suggested update operation key=4487IMSOLPDV tag=VA7YZZINP2JI type=del size=228479 2024-09-12T00:42:30.521 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.525+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=HUE9OXTH2P2K type=del size=1319318 2024-09-12T00:42:30.524 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.525+0000 7fcde98768c0 1 < completed write operation key=FUJIUIR1E00J tag=EZO6E7CTA0O9 type=write size=224986 2024-09-12T00:42:30.526 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.529+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=2TV6UU4V2N8L type=del size=1764058 2024-09-12T00:42:30.529 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.533+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~48WNO2H2TI9C.0 size=1048576 2024-09-12T00:42:30.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.533+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~48WNO2H2TI9C.1 size=389884 2024-09-12T00:42:30.535 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.537+0000 7fcde98768c0 1 < completed multipart upload key=3QOENE572J7A upload=48WNO2H2TI9C tag=814HE63LNAUK type=write size=2487036 2024-09-12T00:42:30.537 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.541+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=0ZCSOUPAGRY1 type=del size=3298567 2024-09-12T00:42:30.540 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.541+0000 7fcde98768c0 1 < completed delete operation key=HVE3YQTFZWTV tag=8A4HZXOPLE3Z type=del 2024-09-12T00:42:30.543 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.545+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=CV05JGBBYHYB type=del size=2967801 2024-09-12T00:42:30.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.549+0000 7fcde98768c0 1 < canceled operation key=IV4JCE1QJC70 tag=6V6NLN8VBGVP type=del size=3643806 2024-09-12T00:42:30.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.549+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=8KGI8JHWYRVK type=del size=182992 2024-09-12T00:42:30.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.553+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~PJ6EOH9QLUZT.0 size=1048576 2024-09-12T00:42:30.552 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.557+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~PJ6EOH9QLUZT.1 size=1048576 2024-09-12T00:42:30.554 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.557+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~PJ6EOH9QLUZT.2 size=115726 2024-09-12T00:42:30.558 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.561+0000 7fcde98768c0 1 < completed multipart upload key=QD5JXFL962R5 upload=PJ6EOH9QLUZT tag=HVTJGJ2XETNZ type=write size=3261454 2024-09-12T00:42:30.561 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.565+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=ULR24UQ5FT9H type=del size=2435853 2024-09-12T00:42:30.563 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.565+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~32TG8NTBR0MI.0 size=724567 2024-09-12T00:42:30.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.569+0000 7fcde98768c0 1 < completed multipart upload key=IV4JCE1QJC70 upload=32TG8NTBR0MI tag=258SFEEQNCMB type=write size=1773143 2024-09-12T00:42:30.570 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.573+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=TTU4CDYKKKKZ type=del size=2652607 2024-09-12T00:42:30.572 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.573+0000 7fcde98768c0 -1 < failed to complete operation key=4487IMSOLPDV tag=A94UNUI7WJM0 type=del size=655690: (22) Invalid argument 2024-09-12T00:42:30.575 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.577+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=240OJ2XXKS6C type=del size=1384630 2024-09-12T00:42:30.577 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.581+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~BMTC3W1FOFEK.0 size=624027 2024-09-12T00:42:30.581 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.585+0000 7fcde98768c0 1 < completed multipart upload key=FUJIUIR1E00J upload=BMTC3W1FOFEK tag=2G57YW0VVSX1 type=write size=1672603 2024-09-12T00:42:30.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.589+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~3M3F55L2ALOJ.0 size=313631 2024-09-12T00:42:30.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.589+0000 7fcde98768c0 1 > prepared multipart upload key=TUMAMUZUIR7E upload=3M3F55L2ALOJ tag=O93ZEINF6QXJ type=write size=1362207 2024-09-12T00:42:30.588 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.593+0000 7fcde98768c0 1 < completed write operation key=BZ4YUNTMOJBK tag=V2ZXBX14I1LI type=write size=131077 2024-09-12T00:42:30.591 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.593+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=NYN0QXXQVM00 type=del size=1322005 2024-09-12T00:42:30.593 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.597+0000 7fcde98768c0 1 < canceled operation key=97030NBF3MI4 tag=8S5VR66YRATJ type=del size=1996282 2024-09-12T00:42:30.599 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.601+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~1WQ81SLNFLC9.0 size=86030 2024-09-12T00:42:30.599 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.601+0000 7fcde98768c0 1 > prepared multipart upload key=C6PW0ETP4BG2 upload=1WQ81SLNFLC9 tag=SBKQGL6Y0L06 type=write size=1134606 2024-09-12T00:42:30.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.605+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~JEA01OLCLX4W.0 size=1048576 2024-09-12T00:42:30.603 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.605+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~JEA01OLCLX4W.1 size=1048576 2024-09-12T00:42:30.605 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.609+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~JEA01OLCLX4W.2 size=1038902 2024-09-12T00:42:30.611 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.613+0000 7fcde98768c0 1 < completed multipart upload key=Z4RNDW37GEK6 upload=JEA01OLCLX4W tag=QJH4GX7U6B5W type=write size=4184630 2024-09-12T00:42:30.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.617+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=47X8PBGNT1AU type=del size=3453194 2024-09-12T00:42:30.617 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.621+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~H9ZAX6282RG9.0 size=1048576 2024-09-12T00:42:30.620 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.621+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~H9ZAX6282RG9.1 size=1048576 2024-09-12T00:42:30.623 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.625+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~H9ZAX6282RG9.2 size=604892 2024-09-12T00:42:30.628 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.633+0000 7fcde98768c0 1 < completed multipart upload key=Z1PY2MFUC1C4 upload=H9ZAX6282RG9 tag=NP9LCCI9BDY3 type=write size=3750620 2024-09-12T00:42:30.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.637+0000 7fcde98768c0 1 > prepared part key=_multipart_ZQD0QXDN1J1I.2~A8X1S3ZEHJVJ.0 size=1009668 2024-09-12T00:42:30.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.637+0000 7fcde98768c0 1 > prepared multipart upload key=ZQD0QXDN1J1I upload=A8X1S3ZEHJVJ tag=11LEJY4UESY4 type=write size=2058244 2024-09-12T00:42:30.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.641+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~XWEYEEPY4KYG.0 size=1048576 2024-09-12T00:42:30.640 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.645+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~XWEYEEPY4KYG.1 size=778829 2024-09-12T00:42:30.645 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.649+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=XWEYEEPY4KYG tag=EZSKOSYDWY00 type=write size=2875981 2024-09-12T00:42:30.648 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.649+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=IQMGU70VKJ3B type=del size=3288766 2024-09-12T00:42:30.651 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.653+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~3Q6ZLNE4KPT8.0 size=1048576 2024-09-12T00:42:30.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.657+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~3Q6ZLNE4KPT8.1 size=1048576 2024-09-12T00:42:30.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.657+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~3Q6ZLNE4KPT8.2 size=344115 2024-09-12T00:42:30.660 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.661+0000 7fcde98768c0 1 < completed multipart upload key=HVE3YQTFZWTV upload=3Q6ZLNE4KPT8 tag=02QAJZMS2YYU type=write size=3489843 2024-09-12T00:42:30.665 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.669+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~3A0E66KKZES0.0 size=1048576 2024-09-12T00:42:30.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.669+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~3A0E66KKZES0.1 size=1011775 2024-09-12T00:42:30.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.669+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=3A0E66KKZES0 tag=B3DMWFVTAG4J type=write size=3108927 2024-09-12T00:42:30.670 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.673+0000 7fcde98768c0 1 < completed delete operation key=J9EUM073CZHF tag=W2CSV25HD8YD type=del 2024-09-12T00:42:30.673 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.677+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=CP8UCJS3HV1C type=del size=819598 2024-09-12T00:42:30.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.677+0000 7fcde98768c0 1 < completed delete operation key=IMITNCB1ST9E tag=HUE9OXTH2P2K type=del 2024-09-12T00:42:30.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.685+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~AIJ3E3DSLVED.0 size=497934 2024-09-12T00:42:30.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.685+0000 7fcde98768c0 1 > prepared multipart upload key=R2EBH0Q5885L upload=AIJ3E3DSLVED tag=U5FS5IQ2HUVU type=write size=1546510 2024-09-12T00:42:30.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.685+0000 7fcde98768c0 1 < completed delete operation key=5YBVLUYJW40U tag=2TV6UU4V2N8L type=del 2024-09-12T00:42:30.686 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.689+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=D1FYCPLXNDW4 type=del size=4131139 2024-09-12T00:42:30.690 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.693+0000 7fcde98768c0 1 < completed delete operation key=C6PW0ETP4BG2 tag=0ZCSOUPAGRY1 type=del 2024-09-12T00:42:30.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.697+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=D9SDSFDJWRLL type=del size=2649208 2024-09-12T00:42:30.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.697+0000 7fcde98768c0 1 < completed delete operation key=R2EBH0Q5885L tag=CV05JGBBYHYB type=del 2024-09-12T00:42:30.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.705+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~SQ57DJZJ5QBZ.0 size=1048576 2024-09-12T00:42:30.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.709+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~SQ57DJZJ5QBZ.1 size=203552 2024-09-12T00:42:30.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.709+0000 7fcde98768c0 1 > prepared multipart upload key=RC9A2Y5TCP9C upload=SQ57DJZJ5QBZ tag=7LRQ0S1652FO type=write size=2300704 2024-09-12T00:42:30.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.713+0000 7fcde98768c0 1 < suggested update operation key=HVE3YQTFZWTV tag=8KGI8JHWYRVK type=del size=182992 2024-09-12T00:42:30.711 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.713+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=TQ1PV4VHCCUR type=del size=3120697 2024-09-12T00:42:30.713 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.717+0000 7fcde98768c0 -1 < failed to complete operation key=HVE3YQTFZWTV tag=ULR24UQ5FT9H type=del size=2435853: (22) Invalid argument 2024-09-12T00:42:30.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.717+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=AMNHHKZF3DME type=del size=33836 2024-09-12T00:42:30.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.721+0000 7fcde98768c0 1 < completed delete operation key=QD5JXFL962R5 tag=TTU4CDYKKKKZ type=del 2024-09-12T00:42:30.721 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.725+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=VYBJF8E0NOHW type=del size=2429089 2024-09-12T00:42:30.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.725+0000 7fcde98768c0 1 < completed delete operation key=TUMAMUZUIR7E tag=240OJ2XXKS6C type=del 2024-09-12T00:42:30.729 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.733+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~DQ5ELNQLVLIZ.0 size=1033153 2024-09-12T00:42:30.729 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.733+0000 7fcde98768c0 1 > prepared multipart upload key=Z4RNDW37GEK6 upload=DQ5ELNQLVLIZ tag=KQUH62COI7FB type=write size=2081729 2024-09-12T00:42:30.731 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.733+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~3M3F55L2ALOJ.0 size=313631 2024-09-12T00:42:30.735 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.737+0000 7fcde98768c0 1 < completed multipart upload key=TUMAMUZUIR7E upload=3M3F55L2ALOJ tag=O93ZEINF6QXJ type=write size=1362207 2024-09-12T00:42:30.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.741+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~34E0NO40Z86P.0 size=1048576 2024-09-12T00:42:30.742 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.745+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~34E0NO40Z86P.1 size=1048576 2024-09-12T00:42:30.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.745+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~34E0NO40Z86P.2 size=649701 2024-09-12T00:42:30.744 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.745+0000 7fcde98768c0 1 > prepared multipart upload key=Z4RNDW37GEK6 upload=34E0NO40Z86P tag=KF21J81Q7P20 type=write size=3795429 2024-09-12T00:42:30.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.749+0000 7fcde98768c0 1 < completed delete operation key=7UR0FX8HA2A5 tag=NYN0QXXQVM00 type=del 2024-09-12T00:42:30.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.753+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=57M8XKYPP70X type=del size=1461080 2024-09-12T00:42:30.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.753+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~1WQ81SLNFLC9.0 size=86030 2024-09-12T00:42:30.756 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.757+0000 7fcde98768c0 1 < completed multipart upload key=C6PW0ETP4BG2 upload=1WQ81SLNFLC9 tag=SBKQGL6Y0L06 type=write size=1134606 2024-09-12T00:42:30.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.765+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~NIKJPADJQGAQ.0 size=729146 2024-09-12T00:42:30.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.765+0000 7fcde98768c0 1 > prepared multipart upload key=WLE5QLNPAGZA upload=NIKJPADJQGAQ tag=Y6BV8CVYC1YP type=write size=1777722 2024-09-12T00:42:30.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.765+0000 7fcde98768c0 1 < completed delete operation key=97030NBF3MI4 tag=47X8PBGNT1AU type=del 2024-09-12T00:42:30.769 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.773+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~31PPA6EY1YAV.0 size=1048576 2024-09-12T00:42:30.771 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.773+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~31PPA6EY1YAV.1 size=1048576 2024-09-12T00:42:30.773 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.777+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~31PPA6EY1YAV.2 size=263621 2024-09-12T00:42:30.774 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.777+0000 7fcde98768c0 1 > prepared multipart upload key=EDFNLQYP4L4L upload=31PPA6EY1YAV tag=U07NY5JUB354 type=write size=3409349 2024-09-12T00:42:30.777 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.781+0000 7fcde98768c0 1 < completed part key=_multipart_ZQD0QXDN1J1I.2~A8X1S3ZEHJVJ.0 size=1009668 2024-09-12T00:42:30.782 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.785+0000 7fcde98768c0 1 < completed multipart upload key=ZQD0QXDN1J1I upload=A8X1S3ZEHJVJ tag=11LEJY4UESY4 type=write size=2058244 2024-09-12T00:42:30.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.789+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=ML79OTJ2OLXW type=del size=4096481 2024-09-12T00:42:30.787 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.789+0000 7fcde98768c0 1 < completed delete operation key=FUJIUIR1E00J tag=IQMGU70VKJ3B type=del 2024-09-12T00:42:30.790 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.793+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=EUULE6XOO7MU type=del size=266979 2024-09-12T00:42:30.792 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.797+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~3A0E66KKZES0.0 size=1048576 2024-09-12T00:42:30.794 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.797+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~3A0E66KKZES0.1 size=1011775 2024-09-12T00:42:30.799 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.801+0000 7fcde98768c0 1 < completed multipart upload key=V80E1NH858IK upload=3A0E66KKZES0 tag=B3DMWFVTAG4J type=write size=3108927 2024-09-12T00:42:30.803 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.805+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~90N4WFS5F8BM.0 size=1048576 2024-09-12T00:42:30.805 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.809+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~90N4WFS5F8BM.1 size=397591 2024-09-12T00:42:30.805 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.809+0000 7fcde98768c0 1 > prepared multipart upload key=IMITNCB1ST9E upload=90N4WFS5F8BM tag=AIFRNL903YDP type=write size=2494743 2024-09-12T00:42:30.810 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.813+0000 7fcde98768c0 1 < suggested update operation key=368TXYQVK9C3 tag=CP8UCJS3HV1C type=del size=819598 2024-09-12T00:42:30.813 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.817+0000 7fcde98768c0 1 > prepared operation key=KME8ZTTUGOXY tag=KCW789DGIU30 type=del size=2234444 2024-09-12T00:42:30.815 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.817+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~AIJ3E3DSLVED.0 size=497934 2024-09-12T00:42:30.819 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.821+0000 7fcde98768c0 1 < completed multipart upload key=R2EBH0Q5885L upload=AIJ3E3DSLVED tag=U5FS5IQ2HUVU type=write size=1546510 2024-09-12T00:42:30.822 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.825+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=3WJLA7CLWNPK type=write size=980466 2024-09-12T00:42:30.828 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.829+0000 7fcde98768c0 1 < suggested update operation key=HVE3YQTFZWTV tag=D1FYCPLXNDW4 type=del size=4131139 2024-09-12T00:42:30.833 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.837+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~E7YMRVNSYXET.0 size=1048576 2024-09-12T00:42:30.835 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.837+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~E7YMRVNSYXET.1 size=1048576 2024-09-12T00:42:30.837 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.841+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~E7YMRVNSYXET.2 size=894661 2024-09-12T00:42:30.837 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.841+0000 7fcde98768c0 1 > prepared multipart upload key=R2EBH0Q5885L upload=E7YMRVNSYXET tag=C0274PYIZ6IC type=write size=4040389 2024-09-12T00:42:30.840 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.841+0000 7fcde98768c0 1 < completed delete operation key=NVOFV649MT0A tag=D9SDSFDJWRLL type=del 2024-09-12T00:42:30.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.845+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=IUVXXZXN6NP3 type=write size=1986 2024-09-12T00:42:30.846 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.849+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~SQ57DJZJ5QBZ.0 size=1048576 2024-09-12T00:42:30.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.849+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~SQ57DJZJ5QBZ.1 size=203552 2024-09-12T00:42:30.853 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.857+0000 7fcde98768c0 1 < completed multipart upload key=RC9A2Y5TCP9C upload=SQ57DJZJ5QBZ tag=7LRQ0S1652FO type=write size=2300704 2024-09-12T00:42:30.856 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.857+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=CJ4OB321ZGAI type=del size=1910730 2024-09-12T00:42:30.859 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.861+0000 7fcde98768c0 1 < completed delete operation key=G6R8BX1H7SPM tag=TQ1PV4VHCCUR type=del 2024-09-12T00:42:30.863 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.865+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~HIH7SMKU0GWY.0 size=745957 2024-09-12T00:42:30.863 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.865+0000 7fcde98768c0 1 > prepared multipart upload key=3X9I78PMR1HV upload=HIH7SMKU0GWY tag=ZHCLVCEKXB3R type=write size=1794533 2024-09-12T00:42:30.865 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.869+0000 7fcde98768c0 -1 < failed to complete operation key=368TXYQVK9C3 tag=AMNHHKZF3DME type=del size=33836: (22) Invalid argument 2024-09-12T00:42:30.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.869+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=C0QF78VTZU5Y type=del size=1180728 2024-09-12T00:42:30.870 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.873+0000 7fcde98768c0 1 < canceled operation key=C6PW0ETP4BG2 tag=VYBJF8E0NOHW type=del size=2429089 2024-09-12T00:42:30.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.877+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=JMBWR2MLU38V type=del size=3211378 2024-09-12T00:42:30.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.877+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~DQ5ELNQLVLIZ.0 size=1033153 2024-09-12T00:42:30.880 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.881+0000 7fcde98768c0 1 < completed multipart upload key=Z4RNDW37GEK6 upload=DQ5ELNQLVLIZ tag=KQUH62COI7FB type=write size=2081729 2024-09-12T00:42:30.882 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.885+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=0L0BG22JTJ9U type=write size=448693 2024-09-12T00:42:30.885 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.889+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~34E0NO40Z86P.0 size=1048576 2024-09-12T00:42:30.887 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.889+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~34E0NO40Z86P.1 size=1048576 2024-09-12T00:42:30.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.893+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~34E0NO40Z86P.2 size=649701 2024-09-12T00:42:30.892 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.897+0000 7fcde98768c0 1 < completed multipart upload key=Z4RNDW37GEK6 upload=34E0NO40Z86P tag=KF21J81Q7P20 type=write size=3795429 2024-09-12T00:42:30.895 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.897+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=1Y2PMU309SXX type=del size=2970588 2024-09-12T00:42:30.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.901+0000 7fcde98768c0 1 < suggested update operation key=BZ4YUNTMOJBK tag=57M8XKYPP70X type=del size=1461080 2024-09-12T00:42:30.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.905+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=89YO6I9GNL7N type=del size=3619824 2024-09-12T00:42:30.905 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.909+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~NIKJPADJQGAQ.0 size=729146 2024-09-12T00:42:30.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.913+0000 7fcde98768c0 1 < completed multipart upload key=WLE5QLNPAGZA upload=NIKJPADJQGAQ tag=Y6BV8CVYC1YP type=write size=1777722 2024-09-12T00:42:30.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.917+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~6YP506W5ZD9Z.0 size=1048576 2024-09-12T00:42:30.915 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.917+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~6YP506W5ZD9Z.1 size=1048576 2024-09-12T00:42:30.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.921+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~6YP506W5ZD9Z.2 size=153800 2024-09-12T00:42:30.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.921+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=6YP506W5ZD9Z tag=A6X21IDNJO9F type=write size=3299528 2024-09-12T00:42:30.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.921+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~31PPA6EY1YAV.0 size=1048576 2024-09-12T00:42:30.925 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.925+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~31PPA6EY1YAV.1 size=1048576 2024-09-12T00:42:30.925 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.925+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~31PPA6EY1YAV.2 size=263621 2024-09-12T00:42:30.927 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.929+0000 7fcde98768c0 1 < completed multipart upload key=EDFNLQYP4L4L upload=31PPA6EY1YAV tag=U07NY5JUB354 type=write size=3409349 2024-09-12T00:42:30.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.933+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=BV38712V3TOC type=del size=157252 2024-09-12T00:42:30.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.937+0000 7fcde98768c0 1 < completed delete operation key=4487IMSOLPDV tag=ML79OTJ2OLXW type=del 2024-09-12T00:42:30.935 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.937+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=B9K5X0O0EGQQ type=del size=1100254 2024-09-12T00:42:30.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.945+0000 7fcde98768c0 1 < suggested remove operation key=IMITNCB1ST9E tag=EUULE6XOO7MU type=del 2024-09-12T00:42:30.945 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.949+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=ABM0P9TZVV3Z type=del size=1075642 2024-09-12T00:42:30.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.949+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~90N4WFS5F8BM.0 size=1048576 2024-09-12T00:42:30.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.949+0000 7fcde98768c0 1 < canceled part key=_multipart_IMITNCB1ST9E.2~90N4WFS5F8BM.1 size=397591 2024-09-12T00:42:30.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.953+0000 7fcde98768c0 1 < canceled multipart upload key=IMITNCB1ST9E upload=90N4WFS5F8BM tag=AIFRNL903YDP type=write size=2494743 2024-09-12T00:42:30.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.957+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~RC2G4RBEVFO3.0 size=1048576 2024-09-12T00:42:30.957 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.961+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~RC2G4RBEVFO3.1 size=679846 2024-09-12T00:42:30.957 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.961+0000 7fcde98768c0 1 > prepared multipart upload key=R2EBH0Q5885L upload=RC2G4RBEVFO3 tag=3S9HF02V2COO type=write size=2776998 2024-09-12T00:42:30.960 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.961+0000 7fcde98768c0 1 < completed delete operation key=KME8ZTTUGOXY tag=KCW789DGIU30 type=del 2024-09-12T00:42:30.962 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.965+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=2MINSHM2CRU4 type=del size=3281509 2024-09-12T00:42:30.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.969+0000 7fcde98768c0 1 < completed write operation key=G6R8BX1H7SPM tag=3WJLA7CLWNPK type=write size=980466 2024-09-12T00:42:30.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.973+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~AZU7QCBD39LX.0 size=1048576 2024-09-12T00:42:30.971 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.973+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~AZU7QCBD39LX.1 size=1048576 2024-09-12T00:42:30.972 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.977+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~AZU7QCBD39LX.2 size=509489 2024-09-12T00:42:30.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.977+0000 7fcde98768c0 1 > prepared multipart upload key=FUJIUIR1E00J upload=AZU7QCBD39LX tag=JQG4ORT9AC4H type=write size=3655217 2024-09-12T00:42:30.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.977+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~E7YMRVNSYXET.0 size=1048576 2024-09-12T00:42:30.977 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.981+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~E7YMRVNSYXET.1 size=1048576 2024-09-12T00:42:30.979 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.981+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~E7YMRVNSYXET.2 size=894661 2024-09-12T00:42:30.984 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.985+0000 7fcde98768c0 1 < completed multipart upload key=R2EBH0Q5885L upload=E7YMRVNSYXET tag=C0274PYIZ6IC type=write size=4040389 2024-09-12T00:42:30.986 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.989+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=J3EVYM4OCF67 type=del size=1965043 2024-09-12T00:42:30.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.993+0000 7fcde98768c0 1 < completed write operation key=368TXYQVK9C3 tag=IUVXXZXN6NP3 type=write size=1986 2024-09-12T00:42:30.992 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.993+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=0U6D7HPFQPRW type=del size=2206107 2024-09-12T00:42:30.994 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:30.997+0000 7fcde98768c0 1 < completed delete operation key=NVOFV649MT0A tag=CJ4OB321ZGAI type=del 2024-09-12T00:42:30.997 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.001+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=7TE0RBX1H8T4 type=del size=1423505 2024-09-12T00:42:31.000 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.001+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~HIH7SMKU0GWY.0 size=745957 2024-09-12T00:42:31.005 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.009+0000 7fcde98768c0 1 < completed multipart upload key=3X9I78PMR1HV upload=HIH7SMKU0GWY tag=ZHCLVCEKXB3R type=write size=1794533 2024-09-12T00:42:31.007 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.009+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=0HUUY4F2W05A type=del size=3091716 2024-09-12T00:42:31.010 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.013+0000 7fcde98768c0 1 < completed delete operation key=QD5JXFL962R5 tag=C0QF78VTZU5Y type=del 2024-09-12T00:42:31.012 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.017+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=ZAN6DSEIXK9Q type=del size=3981006 2024-09-12T00:42:31.013 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.017+0000 7fcde98768c0 -1 < no bi entry to suggest for operation key=IMITNCB1ST9E tag=JMBWR2MLU38V type=del size=3211378: (2) No such file or directory 2024-09-12T00:42:31.016 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.017+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=LU9ZITF1ZOJ4 type=del size=3779399 2024-09-12T00:42:31.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.021+0000 7fcde98768c0 1 < completed write operation key=3X9I78PMR1HV tag=0L0BG22JTJ9U type=write size=448693 2024-09-12T00:42:31.024 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.025+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~I3UDO7R9UKTK.0 size=1048576 2024-09-12T00:42:31.026 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.029+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~I3UDO7R9UKTK.1 size=1048576 2024-09-12T00:42:31.028 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.029+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~I3UDO7R9UKTK.2 size=404437 2024-09-12T00:42:31.029 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.029+0000 7fcde98768c0 1 > prepared multipart upload key=2T5IU2IUNGJX upload=I3UDO7R9UKTK tag=1E961GD8X08H type=write size=3550165 2024-09-12T00:42:31.031 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.033+0000 7fcde98768c0 1 < canceled operation key=Z1PY2MFUC1C4 tag=1Y2PMU309SXX type=del size=2970588 2024-09-12T00:42:31.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.037+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=26S69SKZIZOF type=del size=3593368 2024-09-12T00:42:31.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.037+0000 7fcde98768c0 1 < completed delete operation key=97030NBF3MI4 tag=89YO6I9GNL7N type=del 2024-09-12T00:42:31.041 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.045+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~P3C9WMUCFC1Z.0 size=1048576 2024-09-12T00:42:31.043 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.045+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~P3C9WMUCFC1Z.1 size=1048576 2024-09-12T00:42:31.045 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.049+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~P3C9WMUCFC1Z.2 size=128209 2024-09-12T00:42:31.045 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.049+0000 7fcde98768c0 1 > prepared multipart upload key=368TXYQVK9C3 upload=P3C9WMUCFC1Z tag=JU8URB1PKRD2 type=write size=3273937 2024-09-12T00:42:31.048 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.049+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~6YP506W5ZD9Z.0 size=1048576 2024-09-12T00:42:31.050 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.053+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~6YP506W5ZD9Z.1 size=1048576 2024-09-12T00:42:31.052 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.053+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~6YP506W5ZD9Z.2 size=153800 2024-09-12T00:42:31.056 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.061+0000 7fcde98768c0 1 < completed multipart upload key=BZ4YUNTMOJBK upload=6YP506W5ZD9Z tag=A6X21IDNJO9F type=write size=3299528 2024-09-12T00:42:31.061 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.065+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~01GXO512G2CA.0 size=1048576 2024-09-12T00:42:31.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.065+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~01GXO512G2CA.1 size=1048576 2024-09-12T00:42:31.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.069+0000 7fcde98768c0 1 > prepared part key=_multipart_BZ4YUNTMOJBK.2~01GXO512G2CA.2 size=532627 2024-09-12T00:42:31.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.069+0000 7fcde98768c0 1 > prepared multipart upload key=BZ4YUNTMOJBK upload=01GXO512G2CA tag=9UKQMGMJ1YY3 type=write size=3678355 2024-09-12T00:42:31.067 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.069+0000 7fcde98768c0 1 < completed delete operation key=3QOENE572J7A tag=BV38712V3TOC type=del 2024-09-12T00:42:31.070 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.073+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=904KWZE70IP9 type=del size=2574653 2024-09-12T00:42:31.073 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.077+0000 7fcde98768c0 1 < completed delete operation key=HVE3YQTFZWTV tag=B9K5X0O0EGQQ type=del 2024-09-12T00:42:31.078 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.081+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~6W4ZNQSOOJIE.0 size=1048576 2024-09-12T00:42:31.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.085+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~6W4ZNQSOOJIE.1 size=96511 2024-09-12T00:42:31.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.085+0000 7fcde98768c0 1 > prepared multipart upload key=RC9A2Y5TCP9C upload=6W4ZNQSOOJIE tag=F42U1TZ8WQ42 type=write size=2193663 2024-09-12T00:42:31.084 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.085+0000 7fcde98768c0 1 < canceled operation key=F813QWV02TI0 tag=ABM0P9TZVV3Z type=del size=1075642 2024-09-12T00:42:31.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.093+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~RNL0OXV670E9.0 size=1048576 2024-09-12T00:42:31.093 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.097+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~RNL0OXV670E9.1 size=1048576 2024-09-12T00:42:31.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.097+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~RNL0OXV670E9.2 size=801586 2024-09-12T00:42:31.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.097+0000 7fcde98768c0 1 > prepared multipart upload key=HVE3YQTFZWTV upload=RNL0OXV670E9 tag=U1QQREC1LE8J type=write size=3947314 2024-09-12T00:42:31.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.101+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~RC2G4RBEVFO3.0 size=1048576 2024-09-12T00:42:31.101 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.105+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~RC2G4RBEVFO3.1 size=679846 2024-09-12T00:42:31.106 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.109+0000 7fcde98768c0 1 < completed multipart upload key=R2EBH0Q5885L upload=RC2G4RBEVFO3 tag=3S9HF02V2COO type=write size=2776998 2024-09-12T00:42:31.109 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.113+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=C93IGH6WAZ98 type=write size=80044 2024-09-12T00:42:31.116 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.117+0000 7fcde98768c0 1 < suggested update operation key=ZQD0QXDN1J1I tag=2MINSHM2CRU4 type=del size=3281509 2024-09-12T00:42:31.119 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.121+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=PQ0VFC1668A2 type=del size=2868622 2024-09-12T00:42:31.123 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.125+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~AZU7QCBD39LX.0 size=1048576 2024-09-12T00:42:31.126 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.129+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~AZU7QCBD39LX.1 size=1048576 2024-09-12T00:42:31.129 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.133+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~AZU7QCBD39LX.2 size=509489 2024-09-12T00:42:31.135 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.137+0000 7fcde98768c0 1 < completed multipart upload key=FUJIUIR1E00J upload=AZU7QCBD39LX tag=JQG4ORT9AC4H type=write size=3655217 2024-09-12T00:42:31.138 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.141+0000 7fcde98768c0 1 > prepared operation key=KME8ZTTUGOXY tag=S4PZO5AFBXJU type=write size=929316 2024-09-12T00:42:31.141 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.145+0000 7fcde98768c0 1 < completed delete operation key=97030NBF3MI4 tag=J3EVYM4OCF67 type=del 2024-09-12T00:42:31.145 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.149+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=88272OVZ76LJ type=del size=830819 2024-09-12T00:42:31.148 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.149+0000 7fcde98768c0 1 < completed delete operation key=5B8C6E8L5N52 tag=0U6D7HPFQPRW type=del 2024-09-12T00:42:31.151 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.153+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=NTQ554VT84B4 type=del size=3943346 2024-09-12T00:42:31.154 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.157+0000 7fcde98768c0 1 < completed delete operation key=3X9I78PMR1HV tag=7TE0RBX1H8T4 type=del 2024-09-12T00:42:31.160 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.165+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~L5G7F5WQ8Q89.0 size=1048576 2024-09-12T00:42:31.163 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.165+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~L5G7F5WQ8Q89.1 size=1048576 2024-09-12T00:42:31.166 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.169+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~L5G7F5WQ8Q89.2 size=548120 2024-09-12T00:42:31.166 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.169+0000 7fcde98768c0 1 > prepared multipart upload key=HVE3YQTFZWTV upload=L5G7F5WQ8Q89 tag=1ICP2WD8D2JZ type=write size=3693848 2024-09-12T00:42:31.170 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.173+0000 7fcde98768c0 1 < completed delete operation key=IV4JCE1QJC70 tag=0HUUY4F2W05A type=del 2024-09-12T00:42:31.174 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.177+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=98KI80KG6Y70 type=del size=3758550 2024-09-12T00:42:31.178 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.181+0000 7fcde98768c0 1 < completed delete operation key=JW2GNFAYFNEK tag=ZAN6DSEIXK9Q type=del 2024-09-12T00:42:31.181 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.185+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=78JTCGA6OHQC type=write size=295105 2024-09-12T00:42:31.187 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.189+0000 7fcde98768c0 1 < suggested remove operation key=J9EUM073CZHF tag=LU9ZITF1ZOJ4 type=del 2024-09-12T00:42:31.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.197+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~FG4L95W4ZQ92.0 size=1048576 2024-09-12T00:42:31.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.197+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~FG4L95W4ZQ92.1 size=56616 2024-09-12T00:42:31.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.197+0000 7fcde98768c0 1 > prepared multipart upload key=5YBVLUYJW40U upload=FG4L95W4ZQ92 tag=J2MMYOX8385P type=write size=2153768 2024-09-12T00:42:31.199 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.201+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~I3UDO7R9UKTK.0 size=1048576 2024-09-12T00:42:31.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.205+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~I3UDO7R9UKTK.1 size=1048576 2024-09-12T00:42:31.205 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.209+0000 7fcde98768c0 1 < completed part key=_multipart_2T5IU2IUNGJX.2~I3UDO7R9UKTK.2 size=404437 2024-09-12T00:42:31.215 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.217+0000 7fcde98768c0 1 < completed multipart upload key=2T5IU2IUNGJX upload=I3UDO7R9UKTK tag=1E961GD8X08H type=write size=3550165 2024-09-12T00:42:31.219 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.221+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=P0FPNMO7AK9M type=del size=562869 2024-09-12T00:42:31.222 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.225+0000 7fcde98768c0 1 < canceled operation key=3X9I78PMR1HV tag=26S69SKZIZOF type=del size=3593368 2024-09-12T00:42:31.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.233+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~Y3AGTB2J4MSO.0 size=1048576 2024-09-12T00:42:31.232 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.233+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~Y3AGTB2J4MSO.1 size=1048576 2024-09-12T00:42:31.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.237+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~Y3AGTB2J4MSO.2 size=1001044 2024-09-12T00:42:31.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.237+0000 7fcde98768c0 1 > prepared multipart upload key=RC9A2Y5TCP9C upload=Y3AGTB2J4MSO tag=CEMOPSFTLBXK type=write size=4146772 2024-09-12T00:42:31.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.237+0000 7fcde98768c0 1 < canceled part key=_multipart_368TXYQVK9C3.2~P3C9WMUCFC1Z.0 size=1048576 2024-09-12T00:42:31.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.241+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~P3C9WMUCFC1Z.1 size=1048576 2024-09-12T00:42:31.241 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.245+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~P3C9WMUCFC1Z.2 size=128209 2024-09-12T00:42:31.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.249+0000 7fcde98768c0 1 < canceled multipart upload key=368TXYQVK9C3 upload=P3C9WMUCFC1Z tag=JU8URB1PKRD2 type=write size=3273937 2024-09-12T00:42:31.252 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.257+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~U49SI1YT9H0I.0 size=1048576 2024-09-12T00:42:31.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.257+0000 7fcde98768c0 1 > prepared part key=_multipart_FUJIUIR1E00J.2~U49SI1YT9H0I.1 size=159855 2024-09-12T00:42:31.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.257+0000 7fcde98768c0 1 > prepared multipart upload key=FUJIUIR1E00J upload=U49SI1YT9H0I tag=DQC174GTYREP type=write size=2257007 2024-09-12T00:42:31.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.261+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~01GXO512G2CA.0 size=1048576 2024-09-12T00:42:31.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.265+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~01GXO512G2CA.1 size=1048576 2024-09-12T00:42:31.264 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.265+0000 7fcde98768c0 1 < completed part key=_multipart_BZ4YUNTMOJBK.2~01GXO512G2CA.2 size=532627 2024-09-12T00:42:31.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.273+0000 7fcde98768c0 1 < completed multipart upload key=BZ4YUNTMOJBK upload=01GXO512G2CA tag=9UKQMGMJ1YY3 type=write size=3678355 2024-09-12T00:42:31.273 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.277+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=0BFY0PD38SE0 type=write size=423946 2024-09-12T00:42:31.277 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.281+0000 7fcde98768c0 1 < completed delete operation key=2T5IU2IUNGJX tag=904KWZE70IP9 type=del 2024-09-12T00:42:31.281 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.285+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=BXDSNYD9IGX2 type=del size=1842743 2024-09-12T00:42:31.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.285+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~6W4ZNQSOOJIE.0 size=1048576 2024-09-12T00:42:31.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.289+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~6W4ZNQSOOJIE.1 size=96511 2024-09-12T00:42:31.293 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.297+0000 7fcde98768c0 1 < completed multipart upload key=RC9A2Y5TCP9C upload=6W4ZNQSOOJIE tag=F42U1TZ8WQ42 type=write size=2193663 2024-09-12T00:42:31.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.301+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=WJLM48O2TH5O type=del size=842767 2024-09-12T00:42:31.300 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.301+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~RNL0OXV670E9.0 size=1048576 2024-09-12T00:42:31.303 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.305+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~RNL0OXV670E9.1 size=1048576 2024-09-12T00:42:31.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.309+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~RNL0OXV670E9.2 size=801586 2024-09-12T00:42:31.311 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.313+0000 7fcde98768c0 1 < completed multipart upload key=HVE3YQTFZWTV upload=RNL0OXV670E9 tag=U1QQREC1LE8J type=write size=3947314 2024-09-12T00:42:31.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.321+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~VCN7P7TZ9ZES.0 size=1048576 2024-09-12T00:42:31.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.325+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~VCN7P7TZ9ZES.1 size=1048576 2024-09-12T00:42:31.324 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.325+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~VCN7P7TZ9ZES.2 size=776750 2024-09-12T00:42:31.324 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.325+0000 7fcde98768c0 1 > prepared multipart upload key=TUMAMUZUIR7E upload=VCN7P7TZ9ZES tag=ZD9URMNND0AS type=write size=3922478 2024-09-12T00:42:31.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.329+0000 7fcde98768c0 1 < canceled operation key=368TXYQVK9C3 tag=C93IGH6WAZ98 type=write size=80044 2024-09-12T00:42:31.335 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.337+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~LKBORIEO8DER.0 size=189630 2024-09-12T00:42:31.335 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.337+0000 7fcde98768c0 1 > prepared multipart upload key=7UR0FX8HA2A5 upload=LKBORIEO8DER tag=2IONT87QI00B type=write size=1238206 2024-09-12T00:42:31.339 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.341+0000 7fcde98768c0 1 < completed delete operation key=3X9I78PMR1HV tag=PQ0VFC1668A2 type=del 2024-09-12T00:42:31.345 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.349+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~3AGCGQP73SIK.0 size=1048576 2024-09-12T00:42:31.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.349+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~3AGCGQP73SIK.1 size=1048576 2024-09-12T00:42:31.351 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.353+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~3AGCGQP73SIK.2 size=740765 2024-09-12T00:42:31.351 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.353+0000 7fcde98768c0 1 > prepared multipart upload key=4487IMSOLPDV upload=3AGCGQP73SIK tag=1BAUT1YXRY6E type=write size=3886493 2024-09-12T00:42:31.357 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.361+0000 7fcde98768c0 1 < suggested update operation key=KME8ZTTUGOXY tag=S4PZO5AFBXJU type=write size=929316 2024-09-12T00:42:31.363 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.365+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~1MQ83UHMQ8YR.0 size=621713 2024-09-12T00:42:31.364 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.365+0000 7fcde98768c0 1 > prepared multipart upload key=7UR0FX8HA2A5 upload=1MQ83UHMQ8YR tag=YO1AOKTI03XI type=write size=1670289 2024-09-12T00:42:31.367 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.369+0000 7fcde98768c0 1 < completed delete operation key=EDFNLQYP4L4L tag=88272OVZ76LJ type=del 2024-09-12T00:42:31.370 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.373+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=7CW3J7RW4SFA type=del size=1752233 2024-09-12T00:42:31.374 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.377+0000 7fcde98768c0 1 < completed delete operation key=3QOENE572J7A tag=NTQ554VT84B4 type=del 2024-09-12T00:42:31.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.381+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=EGY20QU992K1 type=del size=3294797 2024-09-12T00:42:31.381 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.385+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~L5G7F5WQ8Q89.0 size=1048576 2024-09-12T00:42:31.384 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.385+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~L5G7F5WQ8Q89.1 size=1048576 2024-09-12T00:42:31.387 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.389+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~L5G7F5WQ8Q89.2 size=548120 2024-09-12T00:42:31.392 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.393+0000 7fcde98768c0 1 < completed multipart upload key=HVE3YQTFZWTV upload=L5G7F5WQ8Q89 tag=1ICP2WD8D2JZ type=write size=3693848 2024-09-12T00:42:31.395 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.397+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=ZU293J0FDGSV type=write size=521712 2024-09-12T00:42:31.399 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.401+0000 7fcde98768c0 1 < completed delete operation key=ZQD0QXDN1J1I tag=98KI80KG6Y70 type=del 2024-09-12T00:42:31.402 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.405+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=3J9DIP4ESZDR type=del size=1108621 2024-09-12T00:42:31.406 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.409+0000 7fcde98768c0 1 < completed write operation key=7UR0FX8HA2A5 tag=78JTCGA6OHQC type=write size=295105 2024-09-12T00:42:31.412 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.413+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~3LUGX1UIUGWV.0 size=1048576 2024-09-12T00:42:31.415 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.417+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~3LUGX1UIUGWV.1 size=1048576 2024-09-12T00:42:31.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.421+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~3LUGX1UIUGWV.2 size=649399 2024-09-12T00:42:31.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.421+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=3LUGX1UIUGWV tag=AWJ7LHUC3ABH type=write size=3795127 2024-09-12T00:42:31.421 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.425+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~FG4L95W4ZQ92.0 size=1048576 2024-09-12T00:42:31.424 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.425+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~FG4L95W4ZQ92.1 size=56616 2024-09-12T00:42:31.429 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.433+0000 7fcde98768c0 1 < completed multipart upload key=5YBVLUYJW40U upload=FG4L95W4ZQ92 tag=J2MMYOX8385P type=write size=2153768 2024-09-12T00:42:31.433 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.437+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=61CJBPBAKR92 type=write size=392871 2024-09-12T00:42:31.439 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.441+0000 7fcde98768c0 1 < suggested update operation key=JW2GNFAYFNEK tag=P0FPNMO7AK9M type=del size=562869 2024-09-12T00:42:31.443 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.445+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=PDVBU7SJHHXV type=del size=2436228 2024-09-12T00:42:31.446 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.449+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~Y3AGTB2J4MSO.0 size=1048576 2024-09-12T00:42:31.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.453+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~Y3AGTB2J4MSO.1 size=1048576 2024-09-12T00:42:31.451 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.453+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~Y3AGTB2J4MSO.2 size=1001044 2024-09-12T00:42:31.457 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.461+0000 7fcde98768c0 1 < completed multipart upload key=RC9A2Y5TCP9C upload=Y3AGTB2J4MSO tag=CEMOPSFTLBXK type=write size=4146772 2024-09-12T00:42:31.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.465+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~OC8E32PNJGSJ.0 size=1048576 2024-09-12T00:42:31.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.469+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~OC8E32PNJGSJ.1 size=1048576 2024-09-12T00:42:31.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.469+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~OC8E32PNJGSJ.2 size=1023226 2024-09-12T00:42:31.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.469+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=OC8E32PNJGSJ tag=QETJTHL4W47U type=write size=4168954 2024-09-12T00:42:31.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.473+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~U49SI1YT9H0I.0 size=1048576 2024-09-12T00:42:31.473 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.477+0000 7fcde98768c0 1 < completed part key=_multipart_FUJIUIR1E00J.2~U49SI1YT9H0I.1 size=159855 2024-09-12T00:42:31.479 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.481+0000 7fcde98768c0 1 < completed multipart upload key=FUJIUIR1E00J upload=U49SI1YT9H0I tag=DQC174GTYREP type=write size=2257007 2024-09-12T00:42:31.482 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.485+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=M65C0L0LPX7I type=del size=229927 2024-09-12T00:42:31.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.489+0000 7fcde98768c0 1 < completed write operation key=IV4JCE1QJC70 tag=0BFY0PD38SE0 type=write size=423946 2024-09-12T00:42:31.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.493+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=7D1XGGMWLFLU type=del size=67966 2024-09-12T00:42:31.492 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.493+0000 7fcde98768c0 1 < completed delete operation key=7UR0FX8HA2A5 tag=BXDSNYD9IGX2 type=del 2024-09-12T00:42:31.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.497+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=ZVRL1J5ARTD9 type=del size=1549683 2024-09-12T00:42:31.498 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.501+0000 7fcde98768c0 -1 < failed to complete operation key=JW2GNFAYFNEK tag=WJLM48O2TH5O type=del size=842767: (22) Invalid argument 2024-09-12T00:42:31.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.509+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~EJ2I974BI85Y.0 size=1048576 2024-09-12T00:42:31.507 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.509+0000 7fcde98768c0 1 > prepared part key=_multipart_368TXYQVK9C3.2~EJ2I974BI85Y.1 size=363121 2024-09-12T00:42:31.507 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.509+0000 7fcde98768c0 1 > prepared multipart upload key=368TXYQVK9C3 upload=EJ2I974BI85Y tag=0ICXR0UI1J5L type=write size=2460273 2024-09-12T00:42:31.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.513+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~VCN7P7TZ9ZES.0 size=1048576 2024-09-12T00:42:31.513 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.517+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~VCN7P7TZ9ZES.1 size=1048576 2024-09-12T00:42:31.516 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.517+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~VCN7P7TZ9ZES.2 size=776750 2024-09-12T00:42:31.522 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.525+0000 7fcde98768c0 1 < completed multipart upload key=TUMAMUZUIR7E upload=VCN7P7TZ9ZES tag=ZD9URMNND0AS type=write size=3922478 2024-09-12T00:42:31.533 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.537+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~MXH2T33HI8HP.0 size=1048576 2024-09-12T00:42:31.536 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.537+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~MXH2T33HI8HP.1 size=155482 2024-09-12T00:42:31.536 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.537+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=MXH2T33HI8HP tag=L8XNT5HXB6PV type=write size=2252634 2024-09-12T00:42:31.540 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.541+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~LKBORIEO8DER.0 size=189630 2024-09-12T00:42:31.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.549+0000 7fcde98768c0 1 < completed multipart upload key=7UR0FX8HA2A5 upload=LKBORIEO8DER tag=2IONT87QI00B type=write size=1238206 2024-09-12T00:42:31.551 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.553+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~MLCYA739PTCU.0 size=1048576 2024-09-12T00:42:31.554 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.557+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~MLCYA739PTCU.1 size=1048576 2024-09-12T00:42:31.556 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.561+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~MLCYA739PTCU.2 size=772795 2024-09-12T00:42:31.557 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.561+0000 7fcde98768c0 1 > prepared multipart upload key=R2EBH0Q5885L upload=MLCYA739PTCU tag=BCOLUJ2ASQF2 type=write size=3918523 2024-09-12T00:42:31.560 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.561+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~3AGCGQP73SIK.0 size=1048576 2024-09-12T00:42:31.563 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.565+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~3AGCGQP73SIK.1 size=1048576 2024-09-12T00:42:31.566 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.569+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~3AGCGQP73SIK.2 size=740765 2024-09-12T00:42:31.571 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.573+0000 7fcde98768c0 1 < completed multipart upload key=4487IMSOLPDV upload=3AGCGQP73SIK tag=1BAUT1YXRY6E type=write size=3886493 2024-09-12T00:42:31.575 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.577+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=6TBYQ35O79BS type=del size=116684 2024-09-12T00:42:31.578 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.581+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~1MQ83UHMQ8YR.0 size=621713 2024-09-12T00:42:31.584 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.585+0000 7fcde98768c0 1 < completed multipart upload key=7UR0FX8HA2A5 upload=1MQ83UHMQ8YR tag=YO1AOKTI03XI type=write size=1670289 2024-09-12T00:42:31.587 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.589+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=O2G7UZMREN8Z type=del size=209474 2024-09-12T00:42:31.590 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.593+0000 7fcde98768c0 1 < completed delete operation key=V80E1NH858IK tag=7CW3J7RW4SFA type=del 2024-09-12T00:42:31.596 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.597+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~Q1L40VYX3Q75.0 size=1048576 2024-09-12T00:42:31.598 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.601+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~Q1L40VYX3Q75.1 size=229071 2024-09-12T00:42:31.598 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.601+0000 7fcde98768c0 1 > prepared multipart upload key=JW2GNFAYFNEK upload=Q1L40VYX3Q75 tag=85VOKPCG7B4I type=write size=2326223 2024-09-12T00:42:31.604 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.609+0000 7fcde98768c0 1 < suggested remove operation key=7UR0FX8HA2A5 tag=EGY20QU992K1 type=del 2024-09-12T00:42:31.607 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.609+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=Z8R9P8JYB4HO type=del size=1691524 2024-09-12T00:42:31.610 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.613+0000 7fcde98768c0 1 < completed write operation key=EDFNLQYP4L4L tag=ZU293J0FDGSV type=write size=521712 2024-09-12T00:42:31.613 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.617+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=CFIP29X4R63Z type=del size=3626751 2024-09-12T00:42:31.616 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.621+0000 7fcde98768c0 1 < completed delete operation key=V80E1NH858IK tag=3J9DIP4ESZDR type=del 2024-09-12T00:42:31.622 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.625+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~DUHKU1VCQU1X.0 size=734167 2024-09-12T00:42:31.622 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.625+0000 7fcde98768c0 1 > prepared multipart upload key=JW2GNFAYFNEK upload=DUHKU1VCQU1X tag=1239HA7BXSKX type=write size=1782743 2024-09-12T00:42:31.624 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.625+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~3LUGX1UIUGWV.0 size=1048576 2024-09-12T00:42:31.627 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.629+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~3LUGX1UIUGWV.1 size=1048576 2024-09-12T00:42:31.629 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.633+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~3LUGX1UIUGWV.2 size=649399 2024-09-12T00:42:31.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.637+0000 7fcde98768c0 1 < completed multipart upload key=V80E1NH858IK upload=3LUGX1UIUGWV tag=AWJ7LHUC3ABH type=write size=3795127 2024-09-12T00:42:31.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.641+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=4S0N7Q7UWE0I type=del size=4011704 2024-09-12T00:42:31.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.641+0000 7fcde98768c0 1 < completed write operation key=3QOENE572J7A tag=61CJBPBAKR92 type=write size=392871 2024-09-12T00:42:31.642 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.645+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=KWRD6KWM66NQ type=write size=119085 2024-09-12T00:42:31.648 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.649+0000 7fcde98768c0 1 < suggested remove operation key=FUJIUIR1E00J tag=PDVBU7SJHHXV type=del 2024-09-12T00:42:31.651 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.653+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=BK63R241FT7H type=del size=3956185 2024-09-12T00:42:31.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.657+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~OC8E32PNJGSJ.0 size=1048576 2024-09-12T00:42:31.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.661+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~OC8E32PNJGSJ.1 size=1048576 2024-09-12T00:42:31.660 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.661+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~OC8E32PNJGSJ.2 size=1023226 2024-09-12T00:42:31.665 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.669+0000 7fcde98768c0 1 < completed multipart upload key=V80E1NH858IK upload=OC8E32PNJGSJ tag=QETJTHL4W47U type=write size=4168954 2024-09-12T00:42:31.670 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.673+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~3I7WB8XHCSU3.0 size=124256 2024-09-12T00:42:31.670 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.673+0000 7fcde98768c0 1 > prepared multipart upload key=EDFNLQYP4L4L upload=3I7WB8XHCSU3 tag=W7F7IO0XLQGC type=write size=1172832 2024-09-12T00:42:31.673 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.677+0000 7fcde98768c0 1 < completed delete operation key=5B8C6E8L5N52 tag=M65C0L0LPX7I type=del 2024-09-12T00:42:31.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.677+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=N1162DTSIKWB type=del size=3856588 2024-09-12T00:42:31.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.681+0000 7fcde98768c0 1 < completed delete operation key=IMITNCB1ST9E tag=7D1XGGMWLFLU type=del 2024-09-12T00:42:31.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.685+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=40SAEDXU56ZY type=del size=3256145 2024-09-12T00:42:31.688 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.689+0000 7fcde98768c0 1 < suggested remove operation key=RC9A2Y5TCP9C tag=ZVRL1J5ARTD9 type=del 2024-09-12T00:42:31.694 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.697+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~EX7T5A5LSI81.0 size=1048576 2024-09-12T00:42:31.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.697+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~EX7T5A5LSI81.1 size=1048576 2024-09-12T00:42:31.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.701+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~EX7T5A5LSI81.2 size=1014619 2024-09-12T00:42:31.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.701+0000 7fcde98768c0 1 > prepared multipart upload key=R2EBH0Q5885L upload=EX7T5A5LSI81 tag=RF32P1TW53NM type=write size=4160347 2024-09-12T00:42:31.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.705+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~EJ2I974BI85Y.0 size=1048576 2024-09-12T00:42:31.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.705+0000 7fcde98768c0 1 < completed part key=_multipart_368TXYQVK9C3.2~EJ2I974BI85Y.1 size=363121 2024-09-12T00:42:31.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.709+0000 7fcde98768c0 1 < completed multipart upload key=368TXYQVK9C3 upload=EJ2I974BI85Y tag=0ICXR0UI1J5L type=write size=2460273 2024-09-12T00:42:31.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.713+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=JT1VVEJ7Y5NC type=del size=1716345 2024-09-12T00:42:31.712 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.717+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~MXH2T33HI8HP.0 size=1048576 2024-09-12T00:42:31.714 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.717+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~MXH2T33HI8HP.1 size=155482 2024-09-12T00:42:31.719 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.721+0000 7fcde98768c0 1 < completed multipart upload key=QD5JXFL962R5 upload=MXH2T33HI8HP tag=L8XNT5HXB6PV type=write size=2252634 2024-09-12T00:42:31.722 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.725+0000 7fcde98768c0 1 > prepared operation key=KME8ZTTUGOXY tag=IBQ6S254W64N type=del size=545886 2024-09-12T00:42:31.725 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.729+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~MLCYA739PTCU.0 size=1048576 2024-09-12T00:42:31.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.729+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~MLCYA739PTCU.1 size=1048576 2024-09-12T00:42:31.729 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.733+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~MLCYA739PTCU.2 size=772795 2024-09-12T00:42:31.735 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.737+0000 7fcde98768c0 1 < completed multipart upload key=R2EBH0Q5885L upload=MLCYA739PTCU tag=BCOLUJ2ASQF2 type=write size=3918523 2024-09-12T00:42:31.738 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.741+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=NADNB98YHUK4 type=del size=2505942 2024-09-12T00:42:31.741 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.745+0000 7fcde98768c0 1 < completed delete operation key=3X9I78PMR1HV tag=6TBYQ35O79BS type=del 2024-09-12T00:42:31.744 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.749+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=Q39343SVD012 type=write size=233731 2024-09-12T00:42:31.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.749+0000 7fcde98768c0 1 < completed delete operation key=3QOENE572J7A tag=O2G7UZMREN8Z type=del 2024-09-12T00:42:31.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.753+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~7QGW79T3CUUS.0 size=1048576 2024-09-12T00:42:31.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.757+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~7QGW79T3CUUS.1 size=1048576 2024-09-12T00:42:31.756 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.757+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~7QGW79T3CUUS.2 size=421731 2024-09-12T00:42:31.756 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.757+0000 7fcde98768c0 1 > prepared multipart upload key=IMITNCB1ST9E upload=7QGW79T3CUUS tag=GCUX5EW0ROTQ type=write size=3567459 2024-09-12T00:42:31.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.761+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~Q1L40VYX3Q75.0 size=1048576 2024-09-12T00:42:31.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.761+0000 7fcde98768c0 1 < canceled part key=_multipart_JW2GNFAYFNEK.2~Q1L40VYX3Q75.1 size=229071 2024-09-12T00:42:31.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.765+0000 7fcde98768c0 1 < canceled multipart upload key=JW2GNFAYFNEK upload=Q1L40VYX3Q75 tag=85VOKPCG7B4I type=write size=2326223 2024-09-12T00:42:31.766 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.769+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=RO5OCQA1ADQD type=del size=914619 2024-09-12T00:42:31.769 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.773+0000 7fcde98768c0 1 < completed delete operation key=G6R8BX1H7SPM tag=Z8R9P8JYB4HO type=del 2024-09-12T00:42:31.771 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.773+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=JIBBP1TJ8HGC type=write size=310546 2024-09-12T00:42:31.774 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.777+0000 7fcde98768c0 1 < completed delete operation key=G6R8BX1H7SPM tag=CFIP29X4R63Z type=del 2024-09-12T00:42:31.778 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.781+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~BKM8OHKD7CP6.0 size=1048576 2024-09-12T00:42:31.780 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.785+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~BKM8OHKD7CP6.1 size=1048576 2024-09-12T00:42:31.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.785+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~BKM8OHKD7CP6.2 size=180428 2024-09-12T00:42:31.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.785+0000 7fcde98768c0 1 > prepared multipart upload key=KME8ZTTUGOXY upload=BKM8OHKD7CP6 tag=4ZTJRRJA1YG9 type=write size=3326156 2024-09-12T00:42:31.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.789+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~DUHKU1VCQU1X.0 size=734167 2024-09-12T00:42:31.790 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.793+0000 7fcde98768c0 1 < completed multipart upload key=JW2GNFAYFNEK upload=DUHKU1VCQU1X tag=1239HA7BXSKX type=write size=1782743 2024-09-12T00:42:31.792 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.797+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=WGJ7VRDCB5WM type=del size=3235326 2024-09-12T00:42:31.795 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.797+0000 7fcde98768c0 1 < completed delete operation key=WLE5QLNPAGZA tag=4S0N7Q7UWE0I type=del 2024-09-12T00:42:31.804 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.805+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~4QU19CO14ED9.0 size=1048576 2024-09-12T00:42:31.806 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.809+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~4QU19CO14ED9.1 size=1048576 2024-09-12T00:42:31.808 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.809+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~4QU19CO14ED9.2 size=923689 2024-09-12T00:42:31.808 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.809+0000 7fcde98768c0 1 > prepared multipart upload key=WLE5QLNPAGZA upload=4QU19CO14ED9 tag=09WHY25UI187 type=write size=4069417 2024-09-12T00:42:31.811 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.813+0000 7fcde98768c0 1 < completed write operation key=368TXYQVK9C3 tag=KWRD6KWM66NQ type=write size=119085 2024-09-12T00:42:31.816 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.817+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~X42P4YFK23H1.0 size=1048576 2024-09-12T00:42:31.818 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.821+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~X42P4YFK23H1.1 size=1048576 2024-09-12T00:42:31.820 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.821+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~X42P4YFK23H1.2 size=185674 2024-09-12T00:42:31.820 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.821+0000 7fcde98768c0 1 > prepared multipart upload key=3X9I78PMR1HV upload=X42P4YFK23H1 tag=LY78ZFFCD0Q7 type=write size=3331402 2024-09-12T00:42:31.825 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.829+0000 7fcde98768c0 1 < suggested update operation key=NVOFV649MT0A tag=BK63R241FT7H type=del size=3956185 2024-09-12T00:42:31.830 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.833+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~TA967N8W472Y.0 size=1048576 2024-09-12T00:42:31.832 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.833+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~TA967N8W472Y.1 size=650289 2024-09-12T00:42:31.832 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.833+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=TA967N8W472Y tag=D26Q29WGXWHE type=write size=2747441 2024-09-12T00:42:31.834 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.837+0000 7fcde98768c0 1 < completed part key=_multipart_EDFNLQYP4L4L.2~3I7WB8XHCSU3.0 size=124256 2024-09-12T00:42:31.839 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.841+0000 7fcde98768c0 1 < completed multipart upload key=EDFNLQYP4L4L upload=3I7WB8XHCSU3 tag=W7F7IO0XLQGC type=write size=1172832 2024-09-12T00:42:31.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.845+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=8K2UBU4PMZTF type=del size=3136048 2024-09-12T00:42:31.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.845+0000 7fcde98768c0 1 < completed delete operation key=QD5JXFL962R5 tag=N1162DTSIKWB type=del 2024-09-12T00:42:31.850 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.853+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~25Q1PXWMR845.0 size=1048576 2024-09-12T00:42:31.852 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.853+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~25Q1PXWMR845.1 size=1048576 2024-09-12T00:42:31.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.857+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~25Q1PXWMR845.2 size=888071 2024-09-12T00:42:31.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.857+0000 7fcde98768c0 1 > prepared multipart upload key=3X9I78PMR1HV upload=25Q1PXWMR845 tag=7CYTU2O87XIA type=write size=4033799 2024-09-12T00:42:31.859 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.861+0000 7fcde98768c0 1 < suggested remove operation key=V80E1NH858IK tag=40SAEDXU56ZY type=del 2024-09-12T00:42:31.862 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.865+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=BTJ19QNODPQH type=del size=1125104 2024-09-12T00:42:31.865 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.869+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~EX7T5A5LSI81.0 size=1048576 2024-09-12T00:42:31.867 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.869+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~EX7T5A5LSI81.1 size=1048576 2024-09-12T00:42:31.867 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.869+0000 7fcde98768c0 1 < canceled part key=_multipart_R2EBH0Q5885L.2~EX7T5A5LSI81.2 size=1014619 2024-09-12T00:42:31.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.873+0000 7fcde98768c0 1 < canceled multipart upload key=R2EBH0Q5885L upload=EX7T5A5LSI81 tag=RF32P1TW53NM type=write size=4160347 2024-09-12T00:42:31.874 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.877+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=96BOJ5DXPVBU type=del size=2327383 2024-09-12T00:42:31.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.881+0000 7fcde98768c0 1 < completed delete operation key=J9EUM073CZHF tag=JT1VVEJ7Y5NC type=del 2024-09-12T00:42:31.879 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.881+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=N2XE1TRKNFW0 type=del size=2487315 2024-09-12T00:42:31.882 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.885+0000 7fcde98768c0 1 < completed delete operation key=KME8ZTTUGOXY tag=IBQ6S254W64N type=del 2024-09-12T00:42:31.887 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.889+0000 7fcde98768c0 1 > prepared part key=_multipart_JW2GNFAYFNEK.2~FGBL71ZXI8P4.0 size=1007529 2024-09-12T00:42:31.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.889+0000 7fcde98768c0 1 > prepared multipart upload key=JW2GNFAYFNEK upload=FGBL71ZXI8P4 tag=8DJN23EONL8N type=write size=2056105 2024-09-12T00:42:31.890 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.893+0000 7fcde98768c0 1 < completed delete operation key=IV4JCE1QJC70 tag=NADNB98YHUK4 type=del 2024-09-12T00:42:31.894 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.897+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=N86K4XX7VO6F type=del size=3949545 2024-09-12T00:42:31.897 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.901+0000 7fcde98768c0 1 < completed write operation key=368TXYQVK9C3 tag=Q39343SVD012 type=write size=233731 2024-09-12T00:42:31.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.901+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=ZVXUD2ZZEGN7 type=del size=224631 2024-09-12T00:42:31.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.905+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~7QGW79T3CUUS.0 size=1048576 2024-09-12T00:42:31.904 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.909+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~7QGW79T3CUUS.1 size=1048576 2024-09-12T00:42:31.906 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.909+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~7QGW79T3CUUS.2 size=421731 2024-09-12T00:42:31.911 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.913+0000 7fcde98768c0 1 < completed multipart upload key=IMITNCB1ST9E upload=7QGW79T3CUUS tag=GCUX5EW0ROTQ type=write size=3567459 2024-09-12T00:42:31.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.917+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~5Y869COQ208Q.0 size=1048576 2024-09-12T00:42:31.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.921+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~5Y869COQ208Q.1 size=1048576 2024-09-12T00:42:31.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.925+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~5Y869COQ208Q.2 size=710633 2024-09-12T00:42:31.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.925+0000 7fcde98768c0 1 > prepared multipart upload key=KME8ZTTUGOXY upload=5Y869COQ208Q tag=UG5J1Q8SSHVJ type=write size=3856361 2024-09-12T00:42:31.924 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.925+0000 7fcde98768c0 1 < completed delete operation key=JW2GNFAYFNEK tag=RO5OCQA1ADQD type=del 2024-09-12T00:42:31.927 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.929+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=DWGCAHNG9TCD type=write size=815735 2024-09-12T00:42:31.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.933+0000 7fcde98768c0 1 < completed write operation key=ZQD0QXDN1J1I tag=JIBBP1TJ8HGC type=write size=310546 2024-09-12T00:42:31.935 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.937+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~IO2X8JOVF5NI.0 size=625154 2024-09-12T00:42:31.935 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.937+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=IO2X8JOVF5NI tag=I4T2SG180G0N type=write size=1673730 2024-09-12T00:42:31.938 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.941+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~BKM8OHKD7CP6.0 size=1048576 2024-09-12T00:42:31.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.945+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~BKM8OHKD7CP6.1 size=1048576 2024-09-12T00:42:31.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.945+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~BKM8OHKD7CP6.2 size=180428 2024-09-12T00:42:31.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.949+0000 7fcde98768c0 1 < completed multipart upload key=KME8ZTTUGOXY upload=BKM8OHKD7CP6 tag=4ZTJRRJA1YG9 type=write size=3326156 2024-09-12T00:42:31.949 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.953+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=PXK0GFURI8WE type=del size=3811181 2024-09-12T00:42:31.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.953+0000 7fcde98768c0 -1 < failed to complete operation key=NVOFV649MT0A tag=WGJ7VRDCB5WM type=del size=3235326: (22) Invalid argument 2024-09-12T00:42:31.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.957+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=IBUM1JUVR9T4 type=write size=718997 2024-09-12T00:42:31.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.957+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~4QU19CO14ED9.0 size=1048576 2024-09-12T00:42:31.958 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.961+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~4QU19CO14ED9.1 size=1048576 2024-09-12T00:42:31.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.961+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~4QU19CO14ED9.2 size=923689 2024-09-12T00:42:31.963 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.965+0000 7fcde98768c0 1 < completed multipart upload key=WLE5QLNPAGZA upload=4QU19CO14ED9 tag=09WHY25UI187 type=write size=4069417 2024-09-12T00:42:31.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.969+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=P5N51BDYGTEX type=del size=2877266 2024-09-12T00:42:31.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.969+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~X42P4YFK23H1.0 size=1048576 2024-09-12T00:42:31.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.969+0000 7fcde98768c0 1 < canceled part key=_multipart_3X9I78PMR1HV.2~X42P4YFK23H1.1 size=1048576 2024-09-12T00:42:31.970 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.973+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~X42P4YFK23H1.2 size=185674 2024-09-12T00:42:31.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.977+0000 7fcde98768c0 1 < canceled multipart upload key=3X9I78PMR1HV upload=X42P4YFK23H1 tag=LY78ZFFCD0Q7 type=write size=3331402 2024-09-12T00:42:31.978 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.981+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~3LPN3IZK801G.0 size=1048576 2024-09-12T00:42:31.980 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.981+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~3LPN3IZK801G.1 size=1048576 2024-09-12T00:42:31.982 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.985+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~3LPN3IZK801G.2 size=964425 2024-09-12T00:42:31.982 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.985+0000 7fcde98768c0 1 > prepared multipart upload key=TUMAMUZUIR7E upload=3LPN3IZK801G tag=DDR1UT7BW3D7 type=write size=4110153 2024-09-12T00:42:31.984 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.989+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~TA967N8W472Y.0 size=1048576 2024-09-12T00:42:31.986 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.989+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~TA967N8W472Y.1 size=650289 2024-09-12T00:42:31.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.993+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=TA967N8W472Y tag=D26Q29WGXWHE type=write size=2747441 2024-09-12T00:42:31.992 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.997+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=Y2MSY69J4MVQ type=write size=1043956 2024-09-12T00:42:31.994 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:31.997+0000 7fcde98768c0 1 < canceled operation key=WLE5QLNPAGZA tag=8K2UBU4PMZTF type=del size=3136048 2024-09-12T00:42:31.998 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.001+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~125R2PMAKMTP.0 size=802417 2024-09-12T00:42:31.998 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.001+0000 7fcde98768c0 1 > prepared multipart upload key=3QOENE572J7A upload=125R2PMAKMTP tag=N7A4SY684MU8 type=write size=1850993 2024-09-12T00:42:32.000 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.005+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~25Q1PXWMR845.0 size=1048576 2024-09-12T00:42:32.002 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.005+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~25Q1PXWMR845.1 size=1048576 2024-09-12T00:42:32.002 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.005+0000 7fcde98768c0 1 < canceled part key=_multipart_3X9I78PMR1HV.2~25Q1PXWMR845.2 size=888071 2024-09-12T00:42:32.005 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.009+0000 7fcde98768c0 1 < canceled multipart upload key=3X9I78PMR1HV upload=25Q1PXWMR845 tag=7CYTU2O87XIA type=write size=4033799 2024-09-12T00:42:32.008 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.009+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=JYO45ETNSQ50 type=del size=1020670 2024-09-12T00:42:32.010 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.013+0000 7fcde98768c0 1 < completed delete operation key=HVE3YQTFZWTV tag=BTJ19QNODPQH type=del 2024-09-12T00:42:32.014 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.017+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~SJ0HUKJW0Z4R.0 size=1048576 2024-09-12T00:42:32.015 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.017+0000 7fcde98768c0 1 > prepared part key=_multipart_KME8ZTTUGOXY.2~SJ0HUKJW0Z4R.1 size=23228 2024-09-12T00:42:32.015 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.017+0000 7fcde98768c0 1 > prepared multipart upload key=KME8ZTTUGOXY upload=SJ0HUKJW0Z4R tag=I6AWRF4GU34C type=write size=2120380 2024-09-12T00:42:32.017 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.021+0000 7fcde98768c0 1 < completed delete operation key=3QOENE572J7A tag=96BOJ5DXPVBU type=del 2024-09-12T00:42:32.020 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.021+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=5AMVRXXYS9BY type=write size=357721 2024-09-12T00:42:32.022 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.025+0000 7fcde98768c0 1 < completed delete operation key=Z1PY2MFUC1C4 tag=N2XE1TRKNFW0 type=del 2024-09-12T00:42:32.025 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.029+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~9DG7715S0Z1V.0 size=1048576 2024-09-12T00:42:32.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.029+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~9DG7715S0Z1V.1 size=938562 2024-09-12T00:42:32.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.029+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=9DG7715S0Z1V tag=AHM30AWJBOIJ type=write size=3035714 2024-09-12T00:42:32.029 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.033+0000 7fcde98768c0 1 < completed part key=_multipart_JW2GNFAYFNEK.2~FGBL71ZXI8P4.0 size=1007529 2024-09-12T00:42:32.034 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.037+0000 7fcde98768c0 1 < completed multipart upload key=JW2GNFAYFNEK upload=FGBL71ZXI8P4 tag=8DJN23EONL8N type=write size=2056105 2024-09-12T00:42:32.038 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.041+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~TP0US16KUQ17.0 size=1048576 2024-09-12T00:42:32.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.041+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~TP0US16KUQ17.1 size=61523 2024-09-12T00:42:32.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.041+0000 7fcde98768c0 1 > prepared multipart upload key=5YBVLUYJW40U upload=TP0US16KUQ17 tag=BGDM17BW5NRV type=write size=2158675 2024-09-12T00:42:32.044 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.045+0000 7fcde98768c0 1 < suggested update operation key=V80E1NH858IK tag=N86K4XX7VO6F type=del size=3949545 2024-09-12T00:42:32.046 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.049+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=VB8NHCZ9MY6H type=write size=873308 2024-09-12T00:42:32.048 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.049+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=ZVXUD2ZZEGN7 type=del 2024-09-12T00:42:32.050 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.053+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=N9TJ7ZGXQO07 type=del size=411493 2024-09-12T00:42:32.052 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.053+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~5Y869COQ208Q.0 size=1048576 2024-09-12T00:42:32.053 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.057+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~5Y869COQ208Q.1 size=1048576 2024-09-12T00:42:32.053 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.057+0000 7fcde98768c0 1 < canceled part key=_multipart_KME8ZTTUGOXY.2~5Y869COQ208Q.2 size=710633 2024-09-12T00:42:32.056 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.061+0000 7fcde98768c0 1 < canceled multipart upload key=KME8ZTTUGOXY upload=5Y869COQ208Q tag=UG5J1Q8SSHVJ type=write size=3856361 2024-09-12T00:42:32.058 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.061+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=XEC0P5GKSDTU type=write size=633164 2024-09-12T00:42:32.062 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.065+0000 7fcde98768c0 1 < suggested update operation key=HVE3YQTFZWTV tag=DWGCAHNG9TCD type=write size=815735 2024-09-12T00:42:32.066 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.069+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~QNAG2FZ83JDP.0 size=1048576 2024-09-12T00:42:32.068 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.069+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~QNAG2FZ83JDP.1 size=1048576 2024-09-12T00:42:32.070 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.073+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~QNAG2FZ83JDP.2 size=827542 2024-09-12T00:42:32.070 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.073+0000 7fcde98768c0 1 > prepared multipart upload key=WLE5QLNPAGZA upload=QNAG2FZ83JDP tag=8V4PABUXT6Z2 type=write size=3973270 2024-09-12T00:42:32.072 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.077+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~IO2X8JOVF5NI.0 size=625154 2024-09-12T00:42:32.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.077+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=IO2X8JOVF5NI tag=I4T2SG180G0N type=write size=1673730 2024-09-12T00:42:32.078 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.081+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=FGHL7IZ5BQX1 type=write size=8350 2024-09-12T00:42:32.080 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.081+0000 7fcde98768c0 1 < completed delete operation key=RC9A2Y5TCP9C tag=PXK0GFURI8WE type=del 2024-09-12T00:42:32.082 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.085+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=46FOM3X3BQHK type=del size=1641057 2024-09-12T00:42:32.084 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.085+0000 7fcde98768c0 1 < canceled operation key=5YBVLUYJW40U tag=IBUM1JUVR9T4 type=write size=718997 2024-09-12T00:42:32.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.089+0000 7fcde98768c0 1 > prepared part key=_multipart_IMITNCB1ST9E.2~RB1G4NMXE325.0 size=72180 2024-09-12T00:42:32.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.089+0000 7fcde98768c0 1 > prepared multipart upload key=IMITNCB1ST9E upload=RB1G4NMXE325 tag=0WUTIEI1XR5L type=write size=1120756 2024-09-12T00:42:32.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.093+0000 7fcde98768c0 1 < suggested remove operation key=WLE5QLNPAGZA tag=P5N51BDYGTEX type=del 2024-09-12T00:42:32.093 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.097+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=06EHQ81UGK3S type=del size=1018406 2024-09-12T00:42:32.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.097+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~3LPN3IZK801G.0 size=1048576 2024-09-12T00:42:32.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.101+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~3LPN3IZK801G.1 size=1048576 2024-09-12T00:42:32.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.101+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~3LPN3IZK801G.2 size=964425 2024-09-12T00:42:32.102 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.105+0000 7fcde98768c0 1 < completed multipart upload key=TUMAMUZUIR7E upload=3LPN3IZK801G tag=DDR1UT7BW3D7 type=write size=4110153 2024-09-12T00:42:32.105 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.109+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~G3RY3VSQ2W9O.0 size=1048576 2024-09-12T00:42:32.107 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.109+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~G3RY3VSQ2W9O.1 size=1048576 2024-09-12T00:42:32.109 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.113+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~G3RY3VSQ2W9O.2 size=240162 2024-09-12T00:42:32.109 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.113+0000 7fcde98768c0 1 > prepared multipart upload key=97030NBF3MI4 upload=G3RY3VSQ2W9O tag=80JQB6KBVQ13 type=write size=3385890 2024-09-12T00:42:32.113 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.117+0000 7fcde98768c0 1 < suggested update operation key=368TXYQVK9C3 tag=Y2MSY69J4MVQ type=write size=1043956 2024-09-12T00:42:32.117 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.121+0000 7fcde98768c0 1 > prepared part key=_multipart_TUMAMUZUIR7E.2~E311Q208V7IN.0 size=177066 2024-09-12T00:42:32.117 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.121+0000 7fcde98768c0 1 > prepared multipart upload key=TUMAMUZUIR7E upload=E311Q208V7IN tag=C8UK41MA3PDQ type=write size=1225642 2024-09-12T00:42:32.119 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.121+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~125R2PMAKMTP.0 size=802417 2024-09-12T00:42:32.123 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.125+0000 7fcde98768c0 1 < completed multipart upload key=3QOENE572J7A upload=125R2PMAKMTP tag=N7A4SY684MU8 type=write size=1850993 2024-09-12T00:42:32.127 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.129+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~ZYEYRXN3ZKD7.0 size=441195 2024-09-12T00:42:32.127 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.129+0000 7fcde98768c0 1 > prepared multipart upload key=WLE5QLNPAGZA upload=ZYEYRXN3ZKD7 tag=VYBHD2TR6L3U type=write size=1489771 2024-09-12T00:42:32.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.133+0000 7fcde98768c0 1 < canceled operation key=4487IMSOLPDV tag=JYO45ETNSQ50 type=del size=1020670 2024-09-12T00:42:32.134 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.137+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~5UXZ94BH0GR5.0 size=1048576 2024-09-12T00:42:32.136 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.137+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~5UXZ94BH0GR5.1 size=1048576 2024-09-12T00:42:32.138 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.141+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~5UXZ94BH0GR5.2 size=455617 2024-09-12T00:42:32.138 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.141+0000 7fcde98768c0 1 > prepared multipart upload key=5YBVLUYJW40U upload=5UXZ94BH0GR5 tag=6Y22MXYN48AG type=write size=3601345 2024-09-12T00:42:32.141 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.145+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~SJ0HUKJW0Z4R.0 size=1048576 2024-09-12T00:42:32.143 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.145+0000 7fcde98768c0 1 < completed part key=_multipart_KME8ZTTUGOXY.2~SJ0HUKJW0Z4R.1 size=23228 2024-09-12T00:42:32.147 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.149+0000 7fcde98768c0 1 < completed multipart upload key=KME8ZTTUGOXY upload=SJ0HUKJW0Z4R tag=I6AWRF4GU34C type=write size=2120380 2024-09-12T00:42:32.150 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.153+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=DRZTGEFF0J3X type=del size=3576817 2024-09-12T00:42:32.152 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.157+0000 7fcde98768c0 1 < completed write operation key=BQGIXJJWBAN0 tag=5AMVRXXYS9BY type=write size=357721 2024-09-12T00:42:32.157 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.157+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=4AJYTDDTKO83 type=write size=426530 2024-09-12T00:42:32.157 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.161+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~9DG7715S0Z1V.0 size=1048576 2024-09-12T00:42:32.159 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.161+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~9DG7715S0Z1V.1 size=938562 2024-09-12T00:42:32.163 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.165+0000 7fcde98768c0 1 < completed multipart upload key=QD5JXFL962R5 upload=9DG7715S0Z1V tag=AHM30AWJBOIJ type=write size=3035714 2024-09-12T00:42:32.165 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.169+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=TKCRL3W9CI29 type=del size=3182350 2024-09-12T00:42:32.165 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.169+0000 7fcde98768c0 1 < canceled part key=_multipart_5YBVLUYJW40U.2~TP0US16KUQ17.0 size=1048576 2024-09-12T00:42:32.167 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.169+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~TP0US16KUQ17.1 size=61523 2024-09-12T00:42:32.171 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.173+0000 7fcde98768c0 1 < canceled multipart upload key=5YBVLUYJW40U upload=TP0US16KUQ17 tag=BGDM17BW5NRV type=write size=2158675 2024-09-12T00:42:32.173 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.177+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=3YQFY1F1K68K type=del size=1812244 2024-09-12T00:42:32.175 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.177+0000 7fcde98768c0 1 < completed write operation key=F813QWV02TI0 tag=VB8NHCZ9MY6H type=write size=873308 2024-09-12T00:42:32.178 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.181+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~T9D40D3RH4KX.0 size=1048576 2024-09-12T00:42:32.180 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.181+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~T9D40D3RH4KX.1 size=677378 2024-09-12T00:42:32.180 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.181+0000 7fcde98768c0 1 > prepared multipart upload key=NVOFV649MT0A upload=T9D40D3RH4KX tag=PAQ1P7W19OQQ type=write size=2774530 2024-09-12T00:42:32.184 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.185+0000 7fcde98768c0 1 < suggested update operation key=C6PW0ETP4BG2 tag=N9TJ7ZGXQO07 type=del size=411493 2024-09-12T00:42:32.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.189+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=FEFHEJUC9E63 type=del size=194383 2024-09-12T00:42:32.188 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.189+0000 7fcde98768c0 1 < completed write operation key=7UR0FX8HA2A5 tag=XEC0P5GKSDTU type=write size=633164 2024-09-12T00:42:32.191 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.193+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~4PG9J776OO54.0 size=1048576 2024-09-12T00:42:32.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.197+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~4PG9J776OO54.1 size=113598 2024-09-12T00:42:32.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.197+0000 7fcde98768c0 1 > prepared multipart upload key=F813QWV02TI0 upload=4PG9J776OO54 tag=A2C7MJ08K9RK type=write size=2210750 2024-09-12T00:42:32.195 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.197+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~QNAG2FZ83JDP.0 size=1048576 2024-09-12T00:42:32.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.201+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~QNAG2FZ83JDP.1 size=1048576 2024-09-12T00:42:32.198 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.201+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~QNAG2FZ83JDP.2 size=827542 2024-09-12T00:42:32.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.205+0000 7fcde98768c0 1 < completed multipart upload key=WLE5QLNPAGZA upload=QNAG2FZ83JDP tag=8V4PABUXT6Z2 type=write size=3973270 2024-09-12T00:42:32.207 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.209+0000 7fcde98768c0 1 > prepared operation key=KME8ZTTUGOXY tag=CI6NJC8XGQM7 type=del size=3239661 2024-09-12T00:42:32.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.213+0000 7fcde98768c0 1 < suggested remove operation key=V80E1NH858IK tag=FGHL7IZ5BQX1 type=write 2024-09-12T00:42:32.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.217+0000 7fcde98768c0 1 > prepared operation key=KME8ZTTUGOXY tag=NP8IFE9K4G0D type=write size=206022 2024-09-12T00:42:32.215 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.217+0000 7fcde98768c0 -1 < failed to complete operation key=C6PW0ETP4BG2 tag=46FOM3X3BQHK type=del size=1641057: (22) Invalid argument 2024-09-12T00:42:32.219 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.221+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~1B7GPC3Q39IV.0 size=1048576 2024-09-12T00:42:32.222 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.225+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~1B7GPC3Q39IV.1 size=1048576 2024-09-12T00:42:32.223 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.225+0000 7fcde98768c0 1 > prepared part key=_multipart_3X9I78PMR1HV.2~1B7GPC3Q39IV.2 size=608601 2024-09-12T00:42:32.223 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.225+0000 7fcde98768c0 1 > prepared multipart upload key=3X9I78PMR1HV upload=1B7GPC3Q39IV tag=D9Z3X0J9ARS0 type=write size=3754329 2024-09-12T00:42:32.225 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.229+0000 7fcde98768c0 1 < completed part key=_multipart_IMITNCB1ST9E.2~RB1G4NMXE325.0 size=72180 2024-09-12T00:42:32.228 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.233+0000 7fcde98768c0 1 < completed multipart upload key=IMITNCB1ST9E upload=RB1G4NMXE325 tag=0WUTIEI1XR5L type=write size=1120756 2024-09-12T00:42:32.230 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.233+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=D9K6PHYR5T24 type=del size=1387813 2024-09-12T00:42:32.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.241+0000 7fcde98768c0 1 < suggested remove operation key=TUMAMUZUIR7E tag=06EHQ81UGK3S type=del 2024-09-12T00:42:32.239 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.241+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=4DES5TR06GWK type=del size=2893926 2024-09-12T00:42:32.241 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.245+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~G3RY3VSQ2W9O.0 size=1048576 2024-09-12T00:42:32.242 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.245+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~G3RY3VSQ2W9O.1 size=1048576 2024-09-12T00:42:32.244 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.245+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~G3RY3VSQ2W9O.2 size=240162 2024-09-12T00:42:32.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.249+0000 7fcde98768c0 1 < completed multipart upload key=97030NBF3MI4 upload=G3RY3VSQ2W9O tag=80JQB6KBVQ13 type=write size=3385890 2024-09-12T00:42:32.251 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.253+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~UBQPARRVGKK0.0 size=1048576 2024-09-12T00:42:32.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.257+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~UBQPARRVGKK0.1 size=1048576 2024-09-12T00:42:32.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.257+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~UBQPARRVGKK0.2 size=489743 2024-09-12T00:42:32.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.257+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=UBQPARRVGKK0 tag=45D7GVN2K68M type=write size=3635471 2024-09-12T00:42:32.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.261+0000 7fcde98768c0 1 < completed part key=_multipart_TUMAMUZUIR7E.2~E311Q208V7IN.0 size=177066 2024-09-12T00:42:32.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.261+0000 7fcde98768c0 1 < completed multipart upload key=TUMAMUZUIR7E upload=E311Q208V7IN tag=C8UK41MA3PDQ type=write size=1225642 2024-09-12T00:42:32.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.265+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~Z5KWDMPU71DG.0 size=147779 2024-09-12T00:42:32.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.265+0000 7fcde98768c0 1 > prepared multipart upload key=4487IMSOLPDV upload=Z5KWDMPU71DG tag=NZQJCKAOORI3 type=write size=1196355 2024-09-12T00:42:32.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.269+0000 7fcde98768c0 1 < completed part key=_multipart_WLE5QLNPAGZA.2~ZYEYRXN3ZKD7.0 size=441195 2024-09-12T00:42:32.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.273+0000 7fcde98768c0 1 < completed multipart upload key=WLE5QLNPAGZA upload=ZYEYRXN3ZKD7 tag=VYBHD2TR6L3U type=write size=1489771 2024-09-12T00:42:32.271 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.273+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=K543PMFJSGHU type=write size=511541 2024-09-12T00:42:32.273 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.277+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~5UXZ94BH0GR5.0 size=1048576 2024-09-12T00:42:32.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.277+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~5UXZ94BH0GR5.1 size=1048576 2024-09-12T00:42:32.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.277+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~5UXZ94BH0GR5.2 size=455617 2024-09-12T00:42:32.279 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.281+0000 7fcde98768c0 1 < completed multipart upload key=5YBVLUYJW40U upload=5UXZ94BH0GR5 tag=6Y22MXYN48AG type=write size=3601345 2024-09-12T00:42:32.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.285+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~DJK90Z8L7W9J.0 size=1048576 2024-09-12T00:42:32.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.289+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~DJK90Z8L7W9J.1 size=591568 2024-09-12T00:42:32.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.289+0000 7fcde98768c0 1 > prepared multipart upload key=97030NBF3MI4 upload=DJK90Z8L7W9J tag=Y6K9RMVUN26Q type=write size=2688720 2024-09-12T00:42:32.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.289+0000 7fcde98768c0 1 < completed delete operation key=368TXYQVK9C3 tag=DRZTGEFF0J3X type=del 2024-09-12T00:42:32.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.293+0000 7fcde98768c0 1 > prepared operation key=TUMAMUZUIR7E tag=20B9J6YJY9I3 type=write size=57649 2024-09-12T00:42:32.291 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.293+0000 7fcde98768c0 -1 < failed to complete operation key=V80E1NH858IK tag=4AJYTDDTKO83 type=write size=426530: (22) Invalid argument 2024-09-12T00:42:32.293 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.297+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=US8VY9MY3LPQ type=del size=921428 2024-09-12T00:42:32.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.297+0000 7fcde98768c0 1 < canceled operation key=5B8C6E8L5N52 tag=TKCRL3W9CI29 type=del size=3182350 2024-09-12T00:42:32.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.301+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~HJVOVR3OQS0P.0 size=1048576 2024-09-12T00:42:32.301 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.305+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~HJVOVR3OQS0P.1 size=1048576 2024-09-12T00:42:32.303 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.305+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~HJVOVR3OQS0P.2 size=857955 2024-09-12T00:42:32.303 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.305+0000 7fcde98768c0 1 > prepared multipart upload key=3QOENE572J7A upload=HJVOVR3OQS0P tag=3GSY2GY9OPYK type=write size=4003683 2024-09-12T00:42:32.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.309+0000 7fcde98768c0 1 < completed delete operation key=FUJIUIR1E00J tag=3YQFY1F1K68K type=del 2024-09-12T00:42:32.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.313+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~93V0JSS15KPS.0 size=1048576 2024-09-12T00:42:32.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.313+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~93V0JSS15KPS.1 size=606131 2024-09-12T00:42:32.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.313+0000 7fcde98768c0 1 > prepared multipart upload key=7UR0FX8HA2A5 upload=93V0JSS15KPS tag=H0P0VTC55E8T type=write size=2703283 2024-09-12T00:42:32.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.317+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~T9D40D3RH4KX.0 size=1048576 2024-09-12T00:42:32.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.317+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~T9D40D3RH4KX.1 size=677378 2024-09-12T00:42:32.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.321+0000 7fcde98768c0 1 < completed multipart upload key=NVOFV649MT0A upload=T9D40D3RH4KX tag=PAQ1P7W19OQQ type=write size=2774530 2024-09-12T00:42:32.320 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.321+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=DYKQBV5ITDDV type=del size=1844436 2024-09-12T00:42:32.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.325+0000 7fcde98768c0 -1 < failed to complete operation key=V80E1NH858IK tag=FEFHEJUC9E63 type=del size=194383: (22) Invalid argument 2024-09-12T00:42:32.325 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.329+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=53MR44E9JQ2M type=del size=755139 2024-09-12T00:42:32.325 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.329+0000 7fcde98768c0 1 < canceled part key=_multipart_F813QWV02TI0.2~4PG9J776OO54.0 size=1048576 2024-09-12T00:42:32.327 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.329+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~4PG9J776OO54.1 size=113598 2024-09-12T00:42:32.331 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.333+0000 7fcde98768c0 1 < canceled multipart upload key=F813QWV02TI0 upload=4PG9J776OO54 tag=A2C7MJ08K9RK type=write size=2210750 2024-09-12T00:42:32.333 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.337+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=2Q8WF7YC60Z2 type=del size=1009528 2024-09-12T00:42:32.335 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.337+0000 7fcde98768c0 1 < completed delete operation key=KME8ZTTUGOXY tag=CI6NJC8XGQM7 type=del 2024-09-12T00:42:32.338 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.341+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=1791UYO50Z3U type=del size=131114 2024-09-12T00:42:32.340 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.341+0000 7fcde98768c0 1 < completed write operation key=KME8ZTTUGOXY tag=NP8IFE9K4G0D type=write size=206022 2024-09-12T00:42:32.343 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.345+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=2YDJHUEX83P2 type=del size=2437020 2024-09-12T00:42:32.346 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.349+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~1B7GPC3Q39IV.0 size=1048576 2024-09-12T00:42:32.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.349+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~1B7GPC3Q39IV.1 size=1048576 2024-09-12T00:42:32.350 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.353+0000 7fcde98768c0 1 < completed part key=_multipart_3X9I78PMR1HV.2~1B7GPC3Q39IV.2 size=608601 2024-09-12T00:42:32.355 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.357+0000 7fcde98768c0 1 < completed multipart upload key=3X9I78PMR1HV upload=1B7GPC3Q39IV tag=D9Z3X0J9ARS0 type=write size=3754329 2024-09-12T00:42:32.357 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.361+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=L0L5MZGTB17B type=del size=18816 2024-09-12T00:42:32.362 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.365+0000 7fcde98768c0 1 < suggested remove operation key=EDFNLQYP4L4L tag=D9K6PHYR5T24 type=del 2024-09-12T00:42:32.364 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.369+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=3WHRB2DZFP46 type=del size=2506408 2024-09-12T00:42:32.367 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.369+0000 7fcde98768c0 1 < completed delete operation key=368TXYQVK9C3 tag=4DES5TR06GWK type=del 2024-09-12T00:42:32.369 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.373+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=OQ387259GA3I type=del size=716815 2024-09-12T00:42:32.371 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.373+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~UBQPARRVGKK0.0 size=1048576 2024-09-12T00:42:32.373 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.377+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~UBQPARRVGKK0.1 size=1048576 2024-09-12T00:42:32.374 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.377+0000 7fcde98768c0 1 < canceled part key=_multipart_V80E1NH858IK.2~UBQPARRVGKK0.2 size=489743 2024-09-12T00:42:32.377 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.381+0000 7fcde98768c0 1 < canceled multipart upload key=V80E1NH858IK upload=UBQPARRVGKK0 tag=45D7GVN2K68M type=write size=3635471 2024-09-12T00:42:32.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.381+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=V18RJM48J6NA type=write size=683037 2024-09-12T00:42:32.382 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.385+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~Z5KWDMPU71DG.0 size=147779 2024-09-12T00:42:32.387 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.389+0000 7fcde98768c0 1 < completed multipart upload key=4487IMSOLPDV upload=Z5KWDMPU71DG tag=NZQJCKAOORI3 type=write size=1196355 2024-09-12T00:42:32.391 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.393+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~LDNPYUYDK90F.0 size=1048576 2024-09-12T00:42:32.393 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.397+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~LDNPYUYDK90F.1 size=1048576 2024-09-12T00:42:32.395 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.397+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~LDNPYUYDK90F.2 size=657243 2024-09-12T00:42:32.395 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.397+0000 7fcde98768c0 1 > prepared multipart upload key=Z4RNDW37GEK6 upload=LDNPYUYDK90F tag=K4MOIRDYBYRX type=write size=3802971 2024-09-12T00:42:32.399 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.401+0000 7fcde98768c0 1 < suggested update operation key=G6R8BX1H7SPM tag=K543PMFJSGHU type=write size=511541 2024-09-12T00:42:32.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.405+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=DWUJDS9P0SRD type=del size=1399381 2024-09-12T00:42:32.404 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.405+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~DJK90Z8L7W9J.0 size=1048576 2024-09-12T00:42:32.406 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.409+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~DJK90Z8L7W9J.1 size=591568 2024-09-12T00:42:32.409 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.413+0000 7fcde98768c0 1 < completed multipart upload key=97030NBF3MI4 upload=DJK90Z8L7W9J tag=Y6K9RMVUN26Q type=write size=2688720 2024-09-12T00:42:32.411 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.413+0000 7fcde98768c0 1 > prepared operation key=368TXYQVK9C3 tag=L8OYHE0707IG type=del size=2834446 2024-09-12T00:42:32.414 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.417+0000 7fcde98768c0 1 < completed write operation key=TUMAMUZUIR7E tag=20B9J6YJY9I3 type=write size=57649 2024-09-12T00:42:32.418 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.421+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~3FA65HU8TP89.0 size=1048576 2024-09-12T00:42:32.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.421+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~3FA65HU8TP89.1 size=1048576 2024-09-12T00:42:32.421 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.425+0000 7fcde98768c0 1 > prepared part key=_multipart_NVOFV649MT0A.2~3FA65HU8TP89.2 size=616889 2024-09-12T00:42:32.421 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.425+0000 7fcde98768c0 1 > prepared multipart upload key=NVOFV649MT0A upload=3FA65HU8TP89 tag=VN5046D1KFF5 type=write size=3762617 2024-09-12T00:42:32.424 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.425+0000 7fcde98768c0 1 < completed delete operation key=V80E1NH858IK tag=US8VY9MY3LPQ type=del 2024-09-12T00:42:32.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.429+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=578FRIWY0JZH type=write size=913461 2024-09-12T00:42:32.428 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.433+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~HJVOVR3OQS0P.0 size=1048576 2024-09-12T00:42:32.430 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.433+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~HJVOVR3OQS0P.1 size=1048576 2024-09-12T00:42:32.430 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.433+0000 7fcde98768c0 1 < canceled part key=_multipart_3QOENE572J7A.2~HJVOVR3OQS0P.2 size=857955 2024-09-12T00:42:32.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.437+0000 7fcde98768c0 1 < canceled multipart upload key=3QOENE572J7A upload=HJVOVR3OQS0P tag=3GSY2GY9OPYK type=write size=4003683 2024-09-12T00:42:32.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.445+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~B3H68Q3HIB7L.0 size=1048576 2024-09-12T00:42:32.443 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.445+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~B3H68Q3HIB7L.1 size=904115 2024-09-12T00:42:32.443 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.445+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=B3H68Q3HIB7L tag=YUESGJHSD3I7 type=write size=3001267 2024-09-12T00:42:32.445 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.449+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~93V0JSS15KPS.0 size=1048576 2024-09-12T00:42:32.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.449+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~93V0JSS15KPS.1 size=606131 2024-09-12T00:42:32.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.453+0000 7fcde98768c0 1 < completed multipart upload key=7UR0FX8HA2A5 upload=93V0JSS15KPS tag=H0P0VTC55E8T type=write size=2703283 2024-09-12T00:42:32.453 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.457+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=OEDLDE05QNB9 type=del size=1733554 2024-09-12T00:42:32.455 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.457+0000 7fcde98768c0 1 < completed delete operation key=IMITNCB1ST9E tag=DYKQBV5ITDDV type=del 2024-09-12T00:42:32.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.461+0000 7fcde98768c0 1 > prepared operation key=NVOFV649MT0A tag=S5SS4496QNLS type=del size=1975776 2024-09-12T00:42:32.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.465+0000 7fcde98768c0 1 < completed delete operation key=3X9I78PMR1HV tag=53MR44E9JQ2M type=del 2024-09-12T00:42:32.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.465+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=8PY4HBY7N5LZ type=del size=1242271 2024-09-12T00:42:32.468 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.473+0000 7fcde98768c0 1 < suggested update operation key=Z4RNDW37GEK6 tag=2Q8WF7YC60Z2 type=del size=1009528 2024-09-12T00:42:32.473 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.477+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~XZLKO1T8DXCB.0 size=1048576 2024-09-12T00:42:32.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.477+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~XZLKO1T8DXCB.1 size=1048576 2024-09-12T00:42:32.477 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.481+0000 7fcde98768c0 1 > prepared part key=_multipart_5YBVLUYJW40U.2~XZLKO1T8DXCB.2 size=432501 2024-09-12T00:42:32.477 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.481+0000 7fcde98768c0 1 > prepared multipart upload key=5YBVLUYJW40U upload=XZLKO1T8DXCB tag=KB5K1JU0KY3E type=write size=3578229 2024-09-12T00:42:32.479 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.481+0000 7fcde98768c0 1 < completed delete operation key=V80E1NH858IK tag=1791UYO50Z3U type=del 2024-09-12T00:42:32.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.489+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~FYNCWSMJZG82.0 size=491871 2024-09-12T00:42:32.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.489+0000 7fcde98768c0 1 > prepared multipart upload key=Z4RNDW37GEK6 upload=FYNCWSMJZG82 tag=7ZT5BDF6GSY3 type=write size=1540447 2024-09-12T00:42:32.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.489+0000 7fcde98768c0 1 < completed delete operation key=QD5JXFL962R5 tag=2YDJHUEX83P2 type=del 2024-09-12T00:42:32.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.493+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=SVV4QVR6KAQQ type=del size=2154370 2024-09-12T00:42:32.492 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.493+0000 7fcde98768c0 1 < completed delete operation key=JW2GNFAYFNEK tag=L0L5MZGTB17B type=del 2024-09-12T00:42:32.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.497+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=87PWGBHOUGPC type=del size=2977170 2024-09-12T00:42:32.497 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.501+0000 7fcde98768c0 1 < completed delete operation key=R2EBH0Q5885L tag=3WHRB2DZFP46 type=del 2024-09-12T00:42:32.500 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.501+0000 7fcde98768c0 1 > prepared operation key=2T5IU2IUNGJX tag=TESJXX9E8ESY type=del size=3512353 2024-09-12T00:42:32.503 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.505+0000 7fcde98768c0 1 < completed delete operation key=3X9I78PMR1HV tag=OQ387259GA3I type=del 2024-09-12T00:42:32.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.509+0000 7fcde98768c0 1 > prepared operation key=HVE3YQTFZWTV tag=G1RLT54DOB8V type=del size=2016718 2024-09-12T00:42:32.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.513+0000 7fcde98768c0 1 < completed write operation key=QD5JXFL962R5 tag=V18RJM48J6NA type=write size=683037 2024-09-12T00:42:32.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.513+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=6Q9VF9JRTK0K type=del size=4135627 2024-09-12T00:42:32.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.517+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~LDNPYUYDK90F.0 size=1048576 2024-09-12T00:42:32.516 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.517+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~LDNPYUYDK90F.1 size=1048576 2024-09-12T00:42:32.516 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.517+0000 7fcde98768c0 1 < canceled part key=_multipart_Z4RNDW37GEK6.2~LDNPYUYDK90F.2 size=657243 2024-09-12T00:42:32.520 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.521+0000 7fcde98768c0 1 < canceled multipart upload key=Z4RNDW37GEK6 upload=LDNPYUYDK90F tag=K4MOIRDYBYRX type=write size=3802971 2024-09-12T00:42:32.523 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.525+0000 7fcde98768c0 1 > prepared operation key=J9EUM073CZHF tag=7R2DLM2WGKWV type=del size=1049355 2024-09-12T00:42:32.525 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.529+0000 7fcde98768c0 1 < completed delete operation key=BZ4YUNTMOJBK tag=DWUJDS9P0SRD type=del 2024-09-12T00:42:32.529 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.533+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~6TREX4DYVZUO.0 size=1048576 2024-09-12T00:42:32.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.533+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~6TREX4DYVZUO.1 size=575164 2024-09-12T00:42:32.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.533+0000 7fcde98768c0 1 > prepared multipart upload key=Z4RNDW37GEK6 upload=6TREX4DYVZUO tag=EJY3EQLW88LB type=write size=2672316 2024-09-12T00:42:32.534 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.537+0000 7fcde98768c0 1 < completed delete operation key=368TXYQVK9C3 tag=L8OYHE0707IG type=del 2024-09-12T00:42:32.536 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.537+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=FANXOSB6W0E8 type=del size=3469686 2024-09-12T00:42:32.539 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.541+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~3FA65HU8TP89.0 size=1048576 2024-09-12T00:42:32.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.545+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~3FA65HU8TP89.1 size=1048576 2024-09-12T00:42:32.543 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.545+0000 7fcde98768c0 1 < completed part key=_multipart_NVOFV649MT0A.2~3FA65HU8TP89.2 size=616889 2024-09-12T00:42:32.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.549+0000 7fcde98768c0 1 < completed multipart upload key=NVOFV649MT0A upload=3FA65HU8TP89 tag=VN5046D1KFF5 type=write size=3762617 2024-09-12T00:42:32.552 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.553+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~6RS3B1HYL7YC.0 size=973924 2024-09-12T00:42:32.552 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.557+0000 7fcde98768c0 1 > prepared multipart upload key=Z1PY2MFUC1C4 upload=6RS3B1HYL7YC tag=2IQ08C51UIXJ type=write size=2022500 2024-09-12T00:42:32.555 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.557+0000 7fcde98768c0 -1 < failed to complete operation key=Z4RNDW37GEK6 tag=578FRIWY0JZH type=write size=913461: (22) Invalid argument 2024-09-12T00:42:32.557 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.561+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=E75I5NRZA3VT type=del size=3962317 2024-09-12T00:42:32.560 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.561+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~B3H68Q3HIB7L.0 size=1048576 2024-09-12T00:42:32.565 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.565+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~B3H68Q3HIB7L.1 size=904115 2024-09-12T00:42:32.566 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.569+0000 7fcde98768c0 1 < completed multipart upload key=QD5JXFL962R5 upload=B3H68Q3HIB7L tag=YUESGJHSD3I7 type=write size=3001267 2024-09-12T00:42:32.569 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.573+0000 7fcde98768c0 1 > prepared operation key=C6PW0ETP4BG2 tag=XWGV7KBBAXBL type=del size=865737 2024-09-12T00:42:32.571 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.573+0000 7fcde98768c0 1 < completed delete operation key=V80E1NH858IK tag=OEDLDE05QNB9 type=del 2024-09-12T00:42:32.576 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.577+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~RH9BA9MG01HK.0 size=1048576 2024-09-12T00:42:32.577 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.581+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~RH9BA9MG01HK.1 size=1048576 2024-09-12T00:42:32.580 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.581+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~RH9BA9MG01HK.2 size=966294 2024-09-12T00:42:32.580 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.581+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=RH9BA9MG01HK tag=VQ95MTLM67X8 type=write size=4112022 2024-09-12T00:42:32.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.589+0000 7fcde98768c0 1 < suggested update operation key=NVOFV649MT0A tag=S5SS4496QNLS type=del size=1975776 2024-09-12T00:42:32.588 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.589+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=JOM2RLA317HK type=write size=927570 2024-09-12T00:42:32.590 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.593+0000 7fcde98768c0 1 < completed delete operation key=5B8C6E8L5N52 tag=8PY4HBY7N5LZ type=del 2024-09-12T00:42:32.595 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.597+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~HRB5BILHH31C.0 size=310102 2024-09-12T00:42:32.595 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.597+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=HRB5BILHH31C tag=K5NBCTC9A5VV type=write size=1358678 2024-09-12T00:42:32.597 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.601+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~XZLKO1T8DXCB.0 size=1048576 2024-09-12T00:42:32.597 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.601+0000 7fcde98768c0 1 < canceled part key=_multipart_5YBVLUYJW40U.2~XZLKO1T8DXCB.1 size=1048576 2024-09-12T00:42:32.598 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.601+0000 7fcde98768c0 1 < completed part key=_multipart_5YBVLUYJW40U.2~XZLKO1T8DXCB.2 size=432501 2024-09-12T00:42:32.602 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.605+0000 7fcde98768c0 1 < canceled multipart upload key=5YBVLUYJW40U upload=XZLKO1T8DXCB tag=KB5K1JU0KY3E type=write size=3578229 2024-09-12T00:42:32.607 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.609+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~7YGVFBBX1C6C.0 size=1048576 2024-09-12T00:42:32.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.613+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~7YGVFBBX1C6C.1 size=56422 2024-09-12T00:42:32.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.613+0000 7fcde98768c0 1 > prepared multipart upload key=Z1PY2MFUC1C4 upload=7YGVFBBX1C6C tag=5DZFCELN1CW4 type=write size=2153574 2024-09-12T00:42:32.611 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.613+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~FYNCWSMJZG82.0 size=491871 2024-09-12T00:42:32.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.617+0000 7fcde98768c0 1 < completed multipart upload key=Z4RNDW37GEK6 upload=FYNCWSMJZG82 tag=7ZT5BDF6GSY3 type=write size=1540447 2024-09-12T00:42:32.618 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.621+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=XWSAURX4ZCP9 type=del size=2117902 2024-09-12T00:42:32.620 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.625+0000 7fcde98768c0 1 < canceled operation key=BZ4YUNTMOJBK tag=SVV4QVR6KAQQ type=del size=2154370 2024-09-12T00:42:32.623 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.625+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=TC6876JA1851 type=del size=419706 2024-09-12T00:42:32.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.629+0000 7fcde98768c0 1 < completed delete operation key=BZ4YUNTMOJBK tag=87PWGBHOUGPC type=del 2024-09-12T00:42:32.627 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.629+0000 7fcde98768c0 1 > prepared operation key=QD5JXFL962R5 tag=CO67F0B33W3L type=write size=231380 2024-09-12T00:42:32.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.633+0000 7fcde98768c0 1 < completed delete operation key=2T5IU2IUNGJX tag=TESJXX9E8ESY type=del 2024-09-12T00:42:32.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.633+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=BTJHTW5M83FT type=del size=769216 2024-09-12T00:42:32.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.637+0000 7fcde98768c0 1 < completed delete operation key=HVE3YQTFZWTV tag=G1RLT54DOB8V type=del 2024-09-12T00:42:32.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.641+0000 7fcde98768c0 1 > prepared operation key=BZ4YUNTMOJBK tag=CNHVRE6OLPKO type=del size=3376265 2024-09-12T00:42:32.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.641+0000 7fcde98768c0 1 < completed delete operation key=Z4RNDW37GEK6 tag=6Q9VF9JRTK0K type=del 2024-09-12T00:42:32.642 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.645+0000 7fcde98768c0 1 > prepared operation key=G6R8BX1H7SPM tag=KU4TIU2HBKN6 type=del size=3830580 2024-09-12T00:42:32.644 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.649+0000 7fcde98768c0 1 < completed delete operation key=J9EUM073CZHF tag=7R2DLM2WGKWV type=del 2024-09-12T00:42:32.646 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.649+0000 7fcde98768c0 1 > prepared operation key=KME8ZTTUGOXY tag=AZO3E3C7WX2J type=del size=3899551 2024-09-12T00:42:32.648 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.653+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~6TREX4DYVZUO.0 size=1048576 2024-09-12T00:42:32.650 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.653+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~6TREX4DYVZUO.1 size=575164 2024-09-12T00:42:32.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.657+0000 7fcde98768c0 1 < completed multipart upload key=Z4RNDW37GEK6 upload=6TREX4DYVZUO tag=EJY3EQLW88LB type=write size=2672316 2024-09-12T00:42:32.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.661+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~KF42WWZ1TUX2.0 size=571902 2024-09-12T00:42:32.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.661+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=KF42WWZ1TUX2 tag=FO01O7GMY3K4 type=write size=1620478 2024-09-12T00:42:32.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.661+0000 7fcde98768c0 1 < completed delete operation key=Z1PY2MFUC1C4 tag=FANXOSB6W0E8 type=del 2024-09-12T00:42:32.662 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.665+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=I0GEJL8YVOO9 type=write size=941973 2024-09-12T00:42:32.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.665+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~6RS3B1HYL7YC.0 size=973924 2024-09-12T00:42:32.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.669+0000 7fcde98768c0 1 < completed multipart upload key=Z1PY2MFUC1C4 upload=6RS3B1HYL7YC tag=2IQ08C51UIXJ type=write size=2022500 2024-09-12T00:42:32.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.677+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~YIOUZV6HQPEC.0 size=1048576 2024-09-12T00:42:32.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.677+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~YIOUZV6HQPEC.1 size=1048576 2024-09-12T00:42:32.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.681+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~YIOUZV6HQPEC.2 size=843245 2024-09-12T00:42:32.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.681+0000 7fcde98768c0 1 > prepared multipart upload key=BQGIXJJWBAN0 upload=YIOUZV6HQPEC tag=2QYV04X6H2L4 type=write size=3988973 2024-09-12T00:42:32.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.681+0000 7fcde98768c0 1 < completed delete operation key=F813QWV02TI0 tag=E75I5NRZA3VT type=del 2024-09-12T00:42:32.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.685+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=OCEHM78QRN46 type=del size=2781825 2024-09-12T00:42:32.686 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.689+0000 7fcde98768c0 1 < suggested remove operation key=C6PW0ETP4BG2 tag=XWGV7KBBAXBL type=del 2024-09-12T00:42:32.688 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.689+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=0YC83ZTSH8MO type=del size=3133677 2024-09-12T00:42:32.690 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.693+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~RH9BA9MG01HK.0 size=1048576 2024-09-12T00:42:32.690 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.693+0000 7fcde98768c0 1 < canceled part key=_multipart_V80E1NH858IK.2~RH9BA9MG01HK.1 size=1048576 2024-09-12T00:42:32.692 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.697+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~RH9BA9MG01HK.2 size=966294 2024-09-12T00:42:32.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.701+0000 7fcde98768c0 1 < canceled multipart upload key=V80E1NH858IK upload=RH9BA9MG01HK tag=VQ95MTLM67X8 type=write size=4112022 2024-09-12T00:42:32.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.701+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=X10TWHF9Y1KY type=del size=2059964 2024-09-12T00:42:32.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.705+0000 7fcde98768c0 1 < completed write operation key=QD5JXFL962R5 tag=JOM2RLA317HK type=write size=927570 2024-09-12T00:42:32.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.709+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~MTPYAHIVYGIS.0 size=752889 2024-09-12T00:42:32.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.709+0000 7fcde98768c0 1 > prepared multipart upload key=F813QWV02TI0 upload=MTPYAHIVYGIS tag=BW6LBRL62O9A type=write size=1801465 2024-09-12T00:42:32.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.709+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~HRB5BILHH31C.0 size=310102 2024-09-12T00:42:32.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.713+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=HRB5BILHH31C tag=K5NBCTC9A5VV type=write size=1358678 2024-09-12T00:42:32.712 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.717+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=2K4HWURD80GN type=write size=302476 2024-09-12T00:42:32.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.717+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~7YGVFBBX1C6C.0 size=1048576 2024-09-12T00:42:32.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.721+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~7YGVFBBX1C6C.1 size=56422 2024-09-12T00:42:32.721 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.725+0000 7fcde98768c0 1 < completed multipart upload key=Z1PY2MFUC1C4 upload=7YGVFBBX1C6C tag=5DZFCELN1CW4 type=write size=2153574 2024-09-12T00:42:32.725 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.729+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~G6ONVAROG0CC.0 size=1048576 2024-09-12T00:42:32.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.729+0000 7fcde98768c0 1 > prepared part key=_multipart_Z1PY2MFUC1C4.2~G6ONVAROG0CC.1 size=645454 2024-09-12T00:42:32.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.729+0000 7fcde98768c0 1 > prepared multipart upload key=Z1PY2MFUC1C4 upload=G6ONVAROG0CC tag=0CIFX2ISAQP9 type=write size=2742606 2024-09-12T00:42:32.729 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.733+0000 7fcde98768c0 1 < completed delete operation key=EDFNLQYP4L4L tag=XWSAURX4ZCP9 type=del 2024-09-12T00:42:32.734 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.737+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~DC0PXODOUEMS.0 size=1048576 2024-09-12T00:42:32.736 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.737+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~DC0PXODOUEMS.1 size=276856 2024-09-12T00:42:32.736 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.737+0000 7fcde98768c0 1 > prepared multipart upload key=R2EBH0Q5885L upload=DC0PXODOUEMS tag=ZMYFUVHL9FYN type=write size=2374008 2024-09-12T00:42:32.738 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.741+0000 7fcde98768c0 1 < completed delete operation key=RC9A2Y5TCP9C tag=TC6876JA1851 type=del 2024-09-12T00:42:32.742 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.745+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~PYEFJ276NNP8.0 size=1048576 2024-09-12T00:42:32.744 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.745+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~PYEFJ276NNP8.1 size=28555 2024-09-12T00:42:32.744 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.745+0000 7fcde98768c0 1 > prepared multipart upload key=C6PW0ETP4BG2 upload=PYEFJ276NNP8 tag=D8E3J1Y2SXMU type=write size=2125707 2024-09-12T00:42:32.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.753+0000 7fcde98768c0 1 < suggested remove operation key=QD5JXFL962R5 tag=CO67F0B33W3L type=write 2024-09-12T00:42:32.753 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.757+0000 7fcde98768c0 1 > prepared part key=_multipart_R2EBH0Q5885L.2~L2QHQ08DIA05.0 size=29604 2024-09-12T00:42:32.753 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.757+0000 7fcde98768c0 1 > prepared multipart upload key=R2EBH0Q5885L upload=L2QHQ08DIA05 tag=PGWATJCUP8AU type=write size=1078180 2024-09-12T00:42:32.755 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.757+0000 7fcde98768c0 1 < completed delete operation key=BZ4YUNTMOJBK tag=BTJHTW5M83FT type=del 2024-09-12T00:42:32.758 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.761+0000 7fcde98768c0 1 > prepared operation key=R2EBH0Q5885L tag=M98LAPTDYPTO type=del size=2096285 2024-09-12T00:42:32.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.765+0000 7fcde98768c0 1 < completed delete operation key=BZ4YUNTMOJBK tag=CNHVRE6OLPKO type=del 2024-09-12T00:42:32.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.765+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=3XGX5Z8EWD0L type=del size=3119005 2024-09-12T00:42:32.769 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.769+0000 7fcde98768c0 1 < completed delete operation key=G6R8BX1H7SPM tag=KU4TIU2HBKN6 type=del 2024-09-12T00:42:32.769 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.769+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=2J2SF4331926 type=write size=435056 2024-09-12T00:42:32.770 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.773+0000 7fcde98768c0 1 < completed delete operation key=KME8ZTTUGOXY tag=AZO3E3C7WX2J type=del 2024-09-12T00:42:32.772 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.777+0000 7fcde98768c0 1 > prepared operation key=RC9A2Y5TCP9C tag=UJO80EDHCIQO type=del size=3592295 2024-09-12T00:42:32.775 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.777+0000 7fcde98768c0 1 < completed part key=_multipart_QD5JXFL962R5.2~KF42WWZ1TUX2.0 size=571902 2024-09-12T00:42:32.779 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.781+0000 7fcde98768c0 1 < completed multipart upload key=QD5JXFL962R5 upload=KF42WWZ1TUX2 tag=FO01O7GMY3K4 type=write size=1620478 2024-09-12T00:42:32.782 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.785+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=K6CCUJHF0YAJ type=write size=74326 2024-09-12T00:42:32.787 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.789+0000 7fcde98768c0 1 < suggested remove operation key=Z4RNDW37GEK6 tag=I0GEJL8YVOO9 type=write 2024-09-12T00:42:32.791 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.793+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~26CHY63E2JR6.0 size=1048576 2024-09-12T00:42:32.794 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.797+0000 7fcde98768c0 1 > prepared part key=_multipart_V80E1NH858IK.2~26CHY63E2JR6.1 size=701091 2024-09-12T00:42:32.794 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.797+0000 7fcde98768c0 1 > prepared multipart upload key=V80E1NH858IK upload=26CHY63E2JR6 tag=F8U9P82FL0YU type=write size=2798243 2024-09-12T00:42:32.797 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.801+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~YIOUZV6HQPEC.0 size=1048576 2024-09-12T00:42:32.799 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.801+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~YIOUZV6HQPEC.1 size=1048576 2024-09-12T00:42:32.801 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.805+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~YIOUZV6HQPEC.2 size=843245 2024-09-12T00:42:32.805 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.809+0000 7fcde98768c0 1 < completed multipart upload key=BQGIXJJWBAN0 upload=YIOUZV6HQPEC tag=2QYV04X6H2L4 type=write size=3988973 2024-09-12T00:42:32.810 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.813+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~05VPQ5R0MEER.0 size=1048576 2024-09-12T00:42:32.812 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.813+0000 7fcde98768c0 1 > prepared part key=_multipart_3QOENE572J7A.2~05VPQ5R0MEER.1 size=1023559 2024-09-12T00:42:32.812 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.813+0000 7fcde98768c0 1 > prepared multipart upload key=3QOENE572J7A upload=05VPQ5R0MEER tag=O74AV3HOMLTI type=write size=3120711 2024-09-12T00:42:32.815 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.817+0000 7fcde98768c0 1 < completed delete operation key=5YBVLUYJW40U tag=OCEHM78QRN46 type=del 2024-09-12T00:42:32.817 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.821+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=EHO3J9CIXJ5X type=write size=711152 2024-09-12T00:42:32.820 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.821+0000 7fcde98768c0 1 < canceled operation key=BQGIXJJWBAN0 tag=0YC83ZTSH8MO type=del size=3133677 2024-09-12T00:42:32.823 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.825+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=P7FL1L7UH4S7 type=del size=3681183 2024-09-12T00:42:32.826 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.829+0000 7fcde98768c0 1 < canceled operation key=97030NBF3MI4 tag=X10TWHF9Y1KY type=del size=2059964 2024-09-12T00:42:32.829 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.833+0000 7fcde98768c0 1 > prepared operation key=FUJIUIR1E00J tag=V6G2C5TIMFOD type=write size=701212 2024-09-12T00:42:32.832 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.837+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~MTPYAHIVYGIS.0 size=752889 2024-09-12T00:42:32.837 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.841+0000 7fcde98768c0 1 < completed multipart upload key=F813QWV02TI0 upload=MTPYAHIVYGIS tag=BW6LBRL62O9A type=write size=1801465 2024-09-12T00:42:32.839 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.841+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=54KJ1U2K6L5R type=write size=588999 2024-09-12T00:42:32.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.845+0000 7fcde98768c0 1 < completed write operation key=IMITNCB1ST9E tag=2K4HWURD80GN type=write size=302476 2024-09-12T00:42:32.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.845+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=R41K8P95R0Z8 type=del size=2119872 2024-09-12T00:42:32.846 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.849+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~G6ONVAROG0CC.0 size=1048576 2024-09-12T00:42:32.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.849+0000 7fcde98768c0 1 < completed part key=_multipart_Z1PY2MFUC1C4.2~G6ONVAROG0CC.1 size=645454 2024-09-12T00:42:32.851 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.853+0000 7fcde98768c0 1 < completed multipart upload key=Z1PY2MFUC1C4 upload=G6ONVAROG0CC tag=0CIFX2ISAQP9 type=write size=2742606 2024-09-12T00:42:32.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.857+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=NWWMKD2UR7D4 type=write size=966362 2024-09-12T00:42:32.856 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.861+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~DC0PXODOUEMS.0 size=1048576 2024-09-12T00:42:32.858 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.861+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~DC0PXODOUEMS.1 size=276856 2024-09-12T00:42:32.862 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.865+0000 7fcde98768c0 1 < completed multipart upload key=R2EBH0Q5885L upload=DC0PXODOUEMS tag=ZMYFUVHL9FYN type=write size=2374008 2024-09-12T00:42:32.865 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.869+0000 7fcde98768c0 1 > prepared operation key=JW2GNFAYFNEK tag=4D673VDKG6DS type=del size=3659305 2024-09-12T00:42:32.867 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.869+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~PYEFJ276NNP8.0 size=1048576 2024-09-12T00:42:32.869 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.873+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~PYEFJ276NNP8.1 size=28555 2024-09-12T00:42:32.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.877+0000 7fcde98768c0 1 < completed multipart upload key=C6PW0ETP4BG2 upload=PYEFJ276NNP8 tag=D8E3J1Y2SXMU type=write size=2125707 2024-09-12T00:42:32.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.881+0000 7fcde98768c0 1 > prepared part key=_multipart_BQGIXJJWBAN0.2~R7CZSTS7V4D1.0 size=482434 2024-09-12T00:42:32.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.881+0000 7fcde98768c0 1 > prepared multipart upload key=BQGIXJJWBAN0 upload=R7CZSTS7V4D1 tag=KWHCC42ID1V4 type=write size=1531010 2024-09-12T00:42:32.879 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.881+0000 7fcde98768c0 1 < completed part key=_multipart_R2EBH0Q5885L.2~L2QHQ08DIA05.0 size=29604 2024-09-12T00:42:32.882 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.885+0000 7fcde98768c0 1 < completed multipart upload key=R2EBH0Q5885L upload=L2QHQ08DIA05 tag=PGWATJCUP8AU type=write size=1078180 2024-09-12T00:42:32.886 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.889+0000 7fcde98768c0 1 > prepared part key=_multipart_RC9A2Y5TCP9C.2~11A9T6WK8S0Y.0 size=802975 2024-09-12T00:42:32.886 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.889+0000 7fcde98768c0 1 > prepared multipart upload key=RC9A2Y5TCP9C upload=11A9T6WK8S0Y tag=O1PDEK7GZE0J type=write size=1851551 2024-09-12T00:42:32.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.889+0000 7fcde98768c0 1 < completed delete operation key=R2EBH0Q5885L tag=M98LAPTDYPTO type=del 2024-09-12T00:42:32.890 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.893+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=SWMJ95BCN9KW type=del size=1479890 2024-09-12T00:42:32.895 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.897+0000 7fcde98768c0 1 < completed delete operation key=BQGIXJJWBAN0 tag=3XGX5Z8EWD0L type=del 2024-09-12T00:42:32.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.901+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~AT71BTL81CZV.0 size=1048576 2024-09-12T00:42:32.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.901+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~AT71BTL81CZV.1 size=1048576 2024-09-12T00:42:32.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.905+0000 7fcde98768c0 1 > prepared part key=_multipart_7UR0FX8HA2A5.2~AT71BTL81CZV.2 size=495938 2024-09-12T00:42:32.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.905+0000 7fcde98768c0 1 > prepared multipart upload key=7UR0FX8HA2A5 upload=AT71BTL81CZV tag=UOCUPTNKATR5 type=write size=3641666 2024-09-12T00:42:32.904 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.905+0000 7fcde98768c0 1 < canceled operation key=3QOENE572J7A tag=2J2SF4331926 type=write size=435056 2024-09-12T00:42:32.906 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.909+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=3XO6BNJ8OWC9 type=del size=913583 2024-09-12T00:42:32.908 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.909+0000 7fcde98768c0 1 < completed delete operation key=RC9A2Y5TCP9C tag=UJO80EDHCIQO type=del 2024-09-12T00:42:32.910 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.913+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=SILQLG7VO9K2 type=del size=2601180 2024-09-12T00:42:32.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.917+0000 7fcde98768c0 1 < completed write operation key=3X9I78PMR1HV tag=K6CCUJHF0YAJ type=write size=74326 2024-09-12T00:42:32.915 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.917+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=I0NSFHWNY5E2 type=del size=1936690 2024-09-12T00:42:32.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.921+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~26CHY63E2JR6.0 size=1048576 2024-09-12T00:42:32.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.921+0000 7fcde98768c0 1 < completed part key=_multipart_V80E1NH858IK.2~26CHY63E2JR6.1 size=701091 2024-09-12T00:42:32.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.925+0000 7fcde98768c0 1 < completed multipart upload key=V80E1NH858IK upload=26CHY63E2JR6 tag=F8U9P82FL0YU type=write size=2798243 2024-09-12T00:42:32.926 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.929+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~KBL1N1A3L0CH.0 size=1048576 2024-09-12T00:42:32.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.929+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~KBL1N1A3L0CH.1 size=33283 2024-09-12T00:42:32.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.929+0000 7fcde98768c0 1 > prepared multipart upload key=J9EUM073CZHF upload=KBL1N1A3L0CH tag=0I19QOSODD7M type=write size=2130435 2024-09-12T00:42:32.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.933+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~05VPQ5R0MEER.0 size=1048576 2024-09-12T00:42:32.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.933+0000 7fcde98768c0 1 < completed part key=_multipart_3QOENE572J7A.2~05VPQ5R0MEER.1 size=1023559 2024-09-12T00:42:32.935 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.937+0000 7fcde98768c0 1 < completed multipart upload key=3QOENE572J7A upload=05VPQ5R0MEER tag=O74AV3HOMLTI type=write size=3120711 2024-09-12T00:42:32.937 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.941+0000 7fcde98768c0 1 > prepared operation key=BQGIXJJWBAN0 tag=2VNR193KBUL4 type=del size=258095 2024-09-12T00:42:32.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.945+0000 7fcde98768c0 1 < suggested update operation key=IMITNCB1ST9E tag=EHO3J9CIXJ5X type=write size=711152 2024-09-12T00:42:32.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.945+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=RZW6G0E5O1C6 type=del size=4164129 2024-09-12T00:42:32.945 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.949+0000 7fcde98768c0 1 < completed delete operation key=4487IMSOLPDV tag=P7FL1L7UH4S7 type=del 2024-09-12T00:42:32.949 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.953+0000 7fcde98768c0 1 > prepared part key=_multipart_WLE5QLNPAGZA.2~OR4WKDPX7TXL.0 size=456228 2024-09-12T00:42:32.949 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.953+0000 7fcde98768c0 1 > prepared multipart upload key=WLE5QLNPAGZA upload=OR4WKDPX7TXL tag=HOQ9FTRKXDG1 type=write size=1504804 2024-09-12T00:42:32.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.957+0000 7fcde98768c0 1 < suggested update operation key=FUJIUIR1E00J tag=V6G2C5TIMFOD type=write size=701212 2024-09-12T00:42:32.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.957+0000 7fcde98768c0 1 > prepared operation key=Z4RNDW37GEK6 tag=2WNM7SUVTICY type=del size=839931 2024-09-12T00:42:32.960 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.961+0000 7fcde98768c0 1 < suggested update operation key=5YBVLUYJW40U tag=54KJ1U2K6L5R type=write size=588999 2024-09-12T00:42:32.962 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.965+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=CQ87R336G83M type=write size=311897 2024-09-12T00:42:32.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.969+0000 7fcde98768c0 1 < completed delete operation key=F813QWV02TI0 tag=R41K8P95R0Z8 type=del 2024-09-12T00:42:32.970 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.973+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~WTJQI609DWBO.0 size=1048576 2024-09-12T00:42:32.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.973+0000 7fcde98768c0 1 > prepared part key=_multipart_G6R8BX1H7SPM.2~WTJQI609DWBO.1 size=780527 2024-09-12T00:42:32.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.973+0000 7fcde98768c0 1 > prepared multipart upload key=G6R8BX1H7SPM upload=WTJQI609DWBO tag=9861SGEO58KU type=write size=2877679 2024-09-12T00:42:32.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.977+0000 7fcde98768c0 1 < completed write operation key=Z1PY2MFUC1C4 tag=NWWMKD2UR7D4 type=write size=966362 2024-09-12T00:42:32.977 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.981+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=P3BXX3BM5CRA type=del size=4112550 2024-09-12T00:42:32.983 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.985+0000 7fcde98768c0 1 < suggested remove operation key=JW2GNFAYFNEK tag=4D673VDKG6DS type=del 2024-09-12T00:42:32.986 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.989+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=GZUDO7YRNLCL type=del size=2417553 2024-09-12T00:42:32.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.989+0000 7fcde98768c0 1 < completed part key=_multipart_BQGIXJJWBAN0.2~R7CZSTS7V4D1.0 size=482434 2024-09-12T00:42:32.992 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.993+0000 7fcde98768c0 1 < completed multipart upload key=BQGIXJJWBAN0 upload=R7CZSTS7V4D1 tag=KWHCC42ID1V4 type=write size=1531010 2024-09-12T00:42:32.994 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:32.997+0000 7fcde98768c0 1 > prepared operation key=ZQD0QXDN1J1I tag=5Q69YJJGA0U3 type=del size=2680366 2024-09-12T00:42:32.996 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.001+0000 7fcde98768c0 1 < completed part key=_multipart_RC9A2Y5TCP9C.2~11A9T6WK8S0Y.0 size=802975 2024-09-12T00:42:33.000 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.001+0000 7fcde98768c0 1 < completed multipart upload key=RC9A2Y5TCP9C upload=11A9T6WK8S0Y tag=O1PDEK7GZE0J type=write size=1851551 2024-09-12T00:42:33.004 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.005+0000 7fcde98768c0 1 > prepared part key=_multipart_IV4JCE1QJC70.2~91FXHWX2ETXR.0 size=658178 2024-09-12T00:42:33.004 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.005+0000 7fcde98768c0 1 > prepared multipart upload key=IV4JCE1QJC70 upload=91FXHWX2ETXR tag=9S4QJ86KC32W type=write size=1706754 2024-09-12T00:42:33.006 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.009+0000 7fcde98768c0 1 < completed delete operation key=ZQD0QXDN1J1I tag=SWMJ95BCN9KW type=del 2024-09-12T00:42:33.008 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.013+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=5QRTH7IA7RWI type=del size=648926 2024-09-12T00:42:33.010 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.013+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~AT71BTL81CZV.0 size=1048576 2024-09-12T00:42:33.012 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.017+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~AT71BTL81CZV.1 size=1048576 2024-09-12T00:42:33.014 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.017+0000 7fcde98768c0 1 < completed part key=_multipart_7UR0FX8HA2A5.2~AT71BTL81CZV.2 size=495938 2024-09-12T00:42:33.018 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.021+0000 7fcde98768c0 1 < completed multipart upload key=7UR0FX8HA2A5 upload=AT71BTL81CZV tag=UOCUPTNKATR5 type=write size=3641666 2024-09-12T00:42:33.021 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.025+0000 7fcde98768c0 1 > prepared operation key=Z1PY2MFUC1C4 tag=N1X4PPRB1EZR type=del size=728873 2024-09-12T00:42:33.023 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.025+0000 7fcde98768c0 -1 < failed to complete operation key=5YBVLUYJW40U tag=3XO6BNJ8OWC9 type=del size=913583: (22) Invalid argument 2024-09-12T00:42:33.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.029+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~ZOPKG77L6CI2.0 size=1048576 2024-09-12T00:42:33.029 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.033+0000 7fcde98768c0 1 > prepared part key=_multipart_5B8C6E8L5N52.2~ZOPKG77L6CI2.1 size=250423 2024-09-12T00:42:33.029 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.033+0000 7fcde98768c0 1 > prepared multipart upload key=5B8C6E8L5N52 upload=ZOPKG77L6CI2 tag=595BR7D9493G type=write size=2347575 2024-09-12T00:42:33.031 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.033+0000 7fcde98768c0 1 < completed delete operation key=5B8C6E8L5N52 tag=SILQLG7VO9K2 type=del 2024-09-12T00:42:33.034 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.037+0000 7fcde98768c0 1 > prepared operation key=WLE5QLNPAGZA tag=Y5FSV5RTJ3FD type=del size=2239107 2024-09-12T00:42:33.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.037+0000 7fcde98768c0 1 < completed delete operation key=Z1PY2MFUC1C4 tag=I0NSFHWNY5E2 type=del 2024-09-12T00:42:33.041 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.045+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~RKDOW0SVAIDQ.0 size=1048576 2024-09-12T00:42:33.042 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.045+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~RKDOW0SVAIDQ.1 size=1048576 2024-09-12T00:42:33.044 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.045+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~RKDOW0SVAIDQ.2 size=304006 2024-09-12T00:42:33.044 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.045+0000 7fcde98768c0 1 > prepared multipart upload key=F813QWV02TI0 upload=RKDOW0SVAIDQ tag=81VE4BY5V391 type=write size=3449734 2024-09-12T00:42:33.046 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.049+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~KBL1N1A3L0CH.0 size=1048576 2024-09-12T00:42:33.048 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.049+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~KBL1N1A3L0CH.1 size=33283 2024-09-12T00:42:33.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.053+0000 7fcde98768c0 1 < completed multipart upload key=J9EUM073CZHF upload=KBL1N1A3L0CH tag=0I19QOSODD7M type=write size=2130435 2024-09-12T00:42:33.054 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.057+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=G6VYNWAYJQNW type=del size=925919 2024-09-12T00:42:33.056 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.057+0000 7fcde98768c0 1 < canceled operation key=BQGIXJJWBAN0 tag=2VNR193KBUL4 type=del size=258095 2024-09-12T00:42:33.058 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.061+0000 7fcde98768c0 1 > prepared operation key=4487IMSOLPDV tag=UAHL94IYOUQG type=del size=3240796 2024-09-12T00:42:33.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.065+0000 7fcde98768c0 1 < completed delete operation key=3X9I78PMR1HV tag=RZW6G0E5O1C6 type=del 2024-09-12T00:42:33.064 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.065+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~BWOKTX1FBYKT.0 size=1048576 2024-09-12T00:42:33.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.069+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~BWOKTX1FBYKT.1 size=1048576 2024-09-12T00:42:33.067 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.069+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~BWOKTX1FBYKT.2 size=889270 2024-09-12T00:42:33.067 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.069+0000 7fcde98768c0 1 > prepared multipart upload key=J9EUM073CZHF upload=BWOKTX1FBYKT tag=GR46Q714H1MU type=write size=4034998 2024-09-12T00:42:33.068 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.069+0000 7fcde98768c0 1 < canceled part key=_multipart_WLE5QLNPAGZA.2~OR4WKDPX7TXL.0 size=456228 2024-09-12T00:42:33.071 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.073+0000 7fcde98768c0 1 < canceled multipart upload key=WLE5QLNPAGZA upload=OR4WKDPX7TXL tag=HOQ9FTRKXDG1 type=write size=1504804 2024-09-12T00:42:33.074 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.077+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=5UHGPVK35LH3 type=write size=607667 2024-09-12T00:42:33.078 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.081+0000 7fcde98768c0 1 < suggested remove operation key=Z4RNDW37GEK6 tag=2WNM7SUVTICY type=del 2024-09-12T00:42:33.082 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.085+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~BI5K0NGV0LN3.0 size=1048576 2024-09-12T00:42:33.084 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.085+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~BI5K0NGV0LN3.1 size=1048576 2024-09-12T00:42:33.086 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.089+0000 7fcde98768c0 1 > prepared part key=_multipart_97030NBF3MI4.2~BI5K0NGV0LN3.2 size=652079 2024-09-12T00:42:33.086 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.089+0000 7fcde98768c0 1 > prepared multipart upload key=97030NBF3MI4 upload=BI5K0NGV0LN3 tag=NO6IE4P75KDE type=write size=3797807 2024-09-12T00:42:33.088 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.089+0000 7fcde98768c0 1 < completed write operation key=5B8C6E8L5N52 tag=CQ87R336G83M type=write size=311897 2024-09-12T00:42:33.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.093+0000 7fcde98768c0 1 > prepared operation key=3QOENE572J7A tag=NJ1BGERMR05B type=del size=3864434 2024-09-12T00:42:33.092 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.093+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~WTJQI609DWBO.0 size=1048576 2024-09-12T00:42:33.094 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.097+0000 7fcde98768c0 1 < completed part key=_multipart_G6R8BX1H7SPM.2~WTJQI609DWBO.1 size=780527 2024-09-12T00:42:33.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.101+0000 7fcde98768c0 1 < completed multipart upload key=G6R8BX1H7SPM upload=WTJQI609DWBO tag=9861SGEO58KU type=write size=2877679 2024-09-12T00:42:33.103 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.105+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~0Q8WVL6HW8UY.0 size=1048576 2024-09-12T00:42:33.105 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.109+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~0Q8WVL6HW8UY.1 size=1048576 2024-09-12T00:42:33.106 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.109+0000 7fcde98768c0 1 > prepared part key=_multipart_C6PW0ETP4BG2.2~0Q8WVL6HW8UY.2 size=468374 2024-09-12T00:42:33.107 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.109+0000 7fcde98768c0 1 > prepared multipart upload key=C6PW0ETP4BG2 upload=0Q8WVL6HW8UY tag=AMPNU7D9ZD9F type=write size=3614102 2024-09-12T00:42:33.109 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.113+0000 7fcde98768c0 1 < completed delete operation key=7UR0FX8HA2A5 tag=P3BXX3BM5CRA type=del 2024-09-12T00:42:33.113 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.117+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~15VFQCHUAFSK.0 size=1048576 2024-09-12T00:42:33.114 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.117+0000 7fcde98768c0 1 > prepared part key=_multipart_Z4RNDW37GEK6.2~15VFQCHUAFSK.1 size=95767 2024-09-12T00:42:33.115 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.117+0000 7fcde98768c0 1 > prepared multipart upload key=Z4RNDW37GEK6 upload=15VFQCHUAFSK tag=1XLEMH1GUWCG type=write size=2192919 2024-09-12T00:42:33.120 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.121+0000 7fcde98768c0 1 < canceled operation key=Z1PY2MFUC1C4 tag=GZUDO7YRNLCL type=del size=2417553 2024-09-12T00:42:33.121 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.125+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~PPKNSTFR5SWC.0 size=1048576 2024-09-12T00:42:33.123 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.125+0000 7fcde98768c0 1 > prepared part key=_multipart_HVE3YQTFZWTV.2~PPKNSTFR5SWC.1 size=908511 2024-09-12T00:42:33.123 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.125+0000 7fcde98768c0 1 > prepared multipart upload key=HVE3YQTFZWTV upload=PPKNSTFR5SWC tag=51M895M7VNPL type=write size=3005663 2024-09-12T00:42:33.125 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.129+0000 7fcde98768c0 1 < completed delete operation key=ZQD0QXDN1J1I tag=5Q69YJJGA0U3 type=del 2024-09-12T00:42:33.129 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.133+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~P59ATT9L5ZIE.0 size=1048576 2024-09-12T00:42:33.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.133+0000 7fcde98768c0 1 > prepared part key=_multipart_4487IMSOLPDV.2~P59ATT9L5ZIE.1 size=9757 2024-09-12T00:42:33.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.133+0000 7fcde98768c0 1 > prepared multipart upload key=4487IMSOLPDV upload=P59ATT9L5ZIE tag=AVM2UPSVQDFD type=write size=2106909 2024-09-12T00:42:33.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.137+0000 7fcde98768c0 1 < completed part key=_multipart_IV4JCE1QJC70.2~91FXHWX2ETXR.0 size=658178 2024-09-12T00:42:33.136 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.137+0000 7fcde98768c0 1 < completed multipart upload key=IV4JCE1QJC70 upload=91FXHWX2ETXR tag=9S4QJ86KC32W type=write size=1706754 2024-09-12T00:42:33.138 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.141+0000 7fcde98768c0 1 > prepared operation key=97030NBF3MI4 tag=QL8A6RXNQBSR type=del size=3475179 2024-09-12T00:42:33.142 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.145+0000 7fcde98768c0 1 < suggested update operation key=EDFNLQYP4L4L tag=5QRTH7IA7RWI type=del size=648926 2024-09-12T00:42:33.145 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.149+0000 7fcde98768c0 1 > prepared operation key=5YBVLUYJW40U tag=I7O3AJTRYXW8 type=del size=396199 2024-09-12T00:42:33.147 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.149+0000 7fcde98768c0 1 < completed delete operation key=Z1PY2MFUC1C4 tag=N1X4PPRB1EZR type=del 2024-09-12T00:42:33.149 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.153+0000 7fcde98768c0 1 > prepared operation key=EDFNLQYP4L4L tag=4G8PQ2VXUHFZ type=del size=1770766 2024-09-12T00:42:33.151 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.153+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~ZOPKG77L6CI2.0 size=1048576 2024-09-12T00:42:33.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.157+0000 7fcde98768c0 1 < completed part key=_multipart_5B8C6E8L5N52.2~ZOPKG77L6CI2.1 size=250423 2024-09-12T00:42:33.156 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.161+0000 7fcde98768c0 1 < completed multipart upload key=5B8C6E8L5N52 upload=ZOPKG77L6CI2 tag=595BR7D9493G type=write size=2347575 2024-09-12T00:42:33.158 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.161+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=4G7J0QERM5VI type=del size=1095026 2024-09-12T00:42:33.160 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.161+0000 7fcde98768c0 1 < completed delete operation key=WLE5QLNPAGZA tag=Y5FSV5RTJ3FD type=del 2024-09-12T00:42:33.165 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.169+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~QSMO28Y2YRXY.0 size=1048576 2024-09-12T00:42:33.166 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.169+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~QSMO28Y2YRXY.1 size=1048576 2024-09-12T00:42:33.167 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.169+0000 7fcde98768c0 1 > prepared part key=_multipart_QD5JXFL962R5.2~QSMO28Y2YRXY.2 size=297003 2024-09-12T00:42:33.168 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.169+0000 7fcde98768c0 1 > prepared multipart upload key=QD5JXFL962R5 upload=QSMO28Y2YRXY tag=31233IE4FL1Q type=write size=3442731 2024-09-12T00:42:33.170 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.173+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~RKDOW0SVAIDQ.0 size=1048576 2024-09-12T00:42:33.172 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.173+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~RKDOW0SVAIDQ.1 size=1048576 2024-09-12T00:42:33.174 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.177+0000 7fcde98768c0 1 < completed part key=_multipart_F813QWV02TI0.2~RKDOW0SVAIDQ.2 size=304006 2024-09-12T00:42:33.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.181+0000 7fcde98768c0 1 < completed multipart upload key=F813QWV02TI0 upload=RKDOW0SVAIDQ tag=81VE4BY5V391 type=write size=3449734 2024-09-12T00:42:33.182 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.185+0000 7fcde98768c0 1 > prepared operation key=IV4JCE1QJC70 tag=ICTD4925YV0Q type=del size=1087596 2024-09-12T00:42:33.184 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.189+0000 7fcde98768c0 1 < completed delete operation key=5YBVLUYJW40U tag=G6VYNWAYJQNW type=del 2024-09-12T00:42:33.187 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.189+0000 7fcde98768c0 1 > prepared operation key=IMITNCB1ST9E tag=S72JH3X2H64F type=del size=1794581 2024-09-12T00:42:33.190 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.193+0000 7fcde98768c0 1 < canceled operation key=4487IMSOLPDV tag=UAHL94IYOUQG type=del size=3240796 2024-09-12T00:42:33.194 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.197+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~RWGN6HM7J0XA.0 size=1048576 2024-09-12T00:42:33.197 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.201+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~RWGN6HM7J0XA.1 size=1048576 2024-09-12T00:42:33.198 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.201+0000 7fcde98768c0 1 > prepared part key=_multipart_J9EUM073CZHF.2~RWGN6HM7J0XA.2 size=549650 2024-09-12T00:42:33.198 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.201+0000 7fcde98768c0 1 > prepared multipart upload key=J9EUM073CZHF upload=RWGN6HM7J0XA tag=QP4IDY0S6JR2 type=write size=3695378 2024-09-12T00:42:33.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.205+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~BWOKTX1FBYKT.0 size=1048576 2024-09-12T00:42:33.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.205+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~BWOKTX1FBYKT.1 size=1048576 2024-09-12T00:42:33.205 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.209+0000 7fcde98768c0 1 < completed part key=_multipart_J9EUM073CZHF.2~BWOKTX1FBYKT.2 size=889270 2024-09-12T00:42:33.208 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.213+0000 7fcde98768c0 1 < completed multipart upload key=J9EUM073CZHF upload=BWOKTX1FBYKT tag=GR46Q714H1MU type=write size=4034998 2024-09-12T00:42:33.212 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.217+0000 7fcde98768c0 1 > prepared part key=_multipart_F813QWV02TI0.2~UXMWPLMC93J4.0 size=428672 2024-09-12T00:42:33.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.217+0000 7fcde98768c0 1 > prepared multipart upload key=F813QWV02TI0 upload=UXMWPLMC93J4 tag=QEX0OA0P4WS8 type=write size=1477248 2024-09-12T00:42:33.215 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.217+0000 7fcde98768c0 1 < completed write operation key=97030NBF3MI4 tag=5UHGPVK35LH3 type=write size=607667 2024-09-12T00:42:33.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.221+0000 7fcde98768c0 1 > prepared operation key=5B8C6E8L5N52 tag=8ER1PIPNH39H type=del size=2935247 2024-09-12T00:42:33.219 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.221+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~BI5K0NGV0LN3.0 size=1048576 2024-09-12T00:42:33.221 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.225+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~BI5K0NGV0LN3.1 size=1048576 2024-09-12T00:42:33.223 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.225+0000 7fcde98768c0 1 < completed part key=_multipart_97030NBF3MI4.2~BI5K0NGV0LN3.2 size=652079 2024-09-12T00:42:33.227 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.229+0000 7fcde98768c0 1 < completed multipart upload key=97030NBF3MI4 upload=BI5K0NGV0LN3 tag=NO6IE4P75KDE type=write size=3797807 2024-09-12T00:42:33.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.233+0000 7fcde98768c0 1 > prepared operation key=V80E1NH858IK tag=ABJ4PP16EW1C type=del size=1785730 2024-09-12T00:42:33.232 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.233+0000 7fcde98768c0 1 < completed delete operation key=3QOENE572J7A tag=NJ1BGERMR05B type=del 2024-09-12T00:42:33.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.237+0000 7fcde98768c0 1 > prepared operation key=F813QWV02TI0 tag=5RSWT7GL3Y6I type=del size=131601 2024-09-12T00:42:33.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.241+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~0Q8WVL6HW8UY.0 size=1048576 2024-09-12T00:42:33.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.241+0000 7fcde98768c0 1 < completed part key=_multipart_C6PW0ETP4BG2.2~0Q8WVL6HW8UY.1 size=1048576 2024-09-12T00:42:33.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.241+0000 7fcde98768c0 1 < canceled part key=_multipart_C6PW0ETP4BG2.2~0Q8WVL6HW8UY.2 size=468374 2024-09-12T00:42:33.242 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.245+0000 7fcde98768c0 1 < canceled multipart upload key=C6PW0ETP4BG2 upload=0Q8WVL6HW8UY tag=AMPNU7D9ZD9F type=write size=3614102 2024-09-12T00:42:33.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.249+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~TTTSZ43Q9Z5B.0 size=1048576 2024-09-12T00:42:33.248 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.249+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~TTTSZ43Q9Z5B.1 size=1048576 2024-09-12T00:42:33.249 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.253+0000 7fcde98768c0 1 > prepared part key=_multipart_EDFNLQYP4L4L.2~TTTSZ43Q9Z5B.2 size=900980 2024-09-12T00:42:33.249 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.253+0000 7fcde98768c0 1 > prepared multipart upload key=EDFNLQYP4L4L upload=TTTSZ43Q9Z5B tag=8ZK0BGSFN64I type=write size=4046708 2024-09-12T00:42:33.252 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.253+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~15VFQCHUAFSK.0 size=1048576 2024-09-12T00:42:33.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.257+0000 7fcde98768c0 1 < completed part key=_multipart_Z4RNDW37GEK6.2~15VFQCHUAFSK.1 size=95767 2024-09-12T00:42:33.257 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.261+0000 7fcde98768c0 1 < completed multipart upload key=Z4RNDW37GEK6 upload=15VFQCHUAFSK tag=1XLEMH1GUWCG type=write size=2192919 2024-09-12T00:42:33.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.261+0000 7fcde98768c0 1 > prepared operation key=7UR0FX8HA2A5 tag=9L2H8JOWH7P2 type=write size=927903 2024-09-12T00:42:33.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.265+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~PPKNSTFR5SWC.0 size=1048576 2024-09-12T00:42:33.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.265+0000 7fcde98768c0 1 < completed part key=_multipart_HVE3YQTFZWTV.2~PPKNSTFR5SWC.1 size=908511 2024-09-12T00:42:33.267 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.269+0000 7fcde98768c0 1 < completed multipart upload key=HVE3YQTFZWTV upload=PPKNSTFR5SWC tag=51M895M7VNPL type=write size=3005663 2024-09-12T00:42:33.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.273+0000 7fcde98768c0 1 > prepared operation key=3X9I78PMR1HV tag=XB3S2TSMRA7M type=del size=656351 2024-09-12T00:42:33.272 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.273+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~P59ATT9L5ZIE.0 size=1048576 2024-09-12T00:42:33.273 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.277+0000 7fcde98768c0 1 < completed part key=_multipart_4487IMSOLPDV.2~P59ATT9L5ZIE.1 size=9757 2024-09-12T00:42:33.277 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.281+0000 7fcde98768c0 1 < completed multipart upload key=4487IMSOLPDV upload=P59ATT9L5ZIE tag=AVM2UPSVQDFD type=write size=2106909 2024-09-12T00:42:33.282 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.285+0000 7fcde98768c0 1 > prepared part key=_multipart_2T5IU2IUNGJX.2~F2U2JG8SUGNJ.0 size=556639 2024-09-12T00:42:33.282 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:42:33.285+0000 7fcde98768c0 1 > prepared multipart upload key=2T5IU2IUNGJX upload=F2U2JG8SUGNJ tag=3OTKZX407MBY type=write size=1605215 2024-09-12T00:42:33.282 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] cls_rgw_stats.simulate (20619 ms) 2024-09-12T00:42:33.282 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 1 test from cls_rgw_stats (20619 ms total) 2024-09-12T00:42:33.282 INFO:tasks.workunit.client.0.smithi070.stdout: 2024-09-12T00:42:33.283 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment tear-down 2024-09-12T00:42:33.715 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] 1 test from 1 test suite ran. (22937 ms total) 2024-09-12T00:42:33.715 INFO:tasks.workunit.client.0.smithi070.stdout:[ PASSED ] 1 test. 2024-09-12T00:42:33.725 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:42:33.725 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:42:33.782 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-12T00:42:33.784 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-12T00:42:33.784 DEBUG:teuthology.orchestra.run.smithi070:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-12T00:42:33.847 INFO:tasks.workunit.client.0.smithi070.stdout:Running main() from gmock_main.cc 2024-09-12T00:42:33.847 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-12T00:42:33.847 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment set-up. 2024-09-12T00:42:35.723 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 31 tests from CmpOmap 2024-09-12T00:42:35.723 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-12T00:42:35.742 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (19 ms) 2024-09-12T00:42:35.743 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-12T00:42:35.764 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (22 ms) 2024-09-12T00:42:35.764 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-12T00:42:35.769 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (5 ms) 2024-09-12T00:42:35.770 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-12T00:42:35.774 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (5 ms) 2024-09-12T00:42:35.774 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-12T00:42:35.791 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_vals_str (17 ms) 2024-09-12T00:42:35.791 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-12T00:42:35.802 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_vals_u64 (11 ms) 2024-09-12T00:42:35.802 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-12T00:42:35.809 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (7 ms) 2024-09-12T00:42:35.809 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-12T00:42:35.817 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (8 ms) 2024-09-12T00:42:35.817 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-12T00:42:35.827 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (10 ms) 2024-09-12T00:42:35.827 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-12T00:42:35.837 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (11 ms) 2024-09-12T00:42:35.838 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-12T00:42:35.839 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-12T00:42:35.839 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-12T00:42:35.840 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-09-12T00:42:35.840 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-12T00:42:35.856 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (16 ms) 2024-09-12T00:42:35.857 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-12T00:42:35.873 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (17 ms) 2024-09-12T00:42:35.873 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-12T00:42:35.889 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (16 ms) 2024-09-12T00:42:35.889 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-12T00:42:35.906 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (17 ms) 2024-09-12T00:42:35.906 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-12T00:42:35.928 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_set_vals_str (22 ms) 2024-09-12T00:42:35.928 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-12T00:42:35.949 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (21 ms) 2024-09-12T00:42:35.949 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-12T00:42:35.956 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (7 ms) 2024-09-12T00:42:35.956 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-12T00:42:35.962 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (7 ms) 2024-09-12T00:42:35.963 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-12T00:42:35.965 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (2 ms) 2024-09-12T00:42:35.965 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-12T00:42:35.967 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (3 ms) 2024-09-12T00:42:35.967 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-12T00:42:35.984 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (16 ms) 2024-09-12T00:42:35.984 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-12T00:42:36.000 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (16 ms) 2024-09-12T00:42:36.000 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-12T00:42:36.019 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (19 ms) 2024-09-12T00:42:36.019 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-12T00:42:36.045 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (23 ms) 2024-09-12T00:42:36.045 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-12T00:42:36.047 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (5 ms) 2024-09-12T00:42:36.047 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-12T00:42:36.055 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (7 ms) 2024-09-12T00:42:36.055 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-12T00:42:36.058 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (3 ms) 2024-09-12T00:42:36.058 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-12T00:42:36.060 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (2 ms) 2024-09-12T00:42:36.060 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-12T00:42:36.079 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (19 ms) 2024-09-12T00:42:36.079 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 31 tests from CmpOmap (356 ms total) 2024-09-12T00:42:36.079 INFO:tasks.workunit.client.0.smithi070.stdout: 2024-09-12T00:42:36.079 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment tear-down 2024-09-12T00:42:36.721 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] 31 tests from 1 test suite ran. (2873 ms total) 2024-09-12T00:42:36.721 INFO:tasks.workunit.client.0.smithi070.stdout:[ PASSED ] 31 tests. 2024-09-12T00:42:36.725 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:42:36.725 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:42:36.782 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-12T00:42:36.783 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-12T00:42:36.783 DEBUG:teuthology.orchestra.run.smithi070:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-12T00:42:36.848 INFO:tasks.workunit.client.0.smithi070.stdout:Running main() from gmock_main.cc 2024-09-12T00:42:36.848 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:42:36.848 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment set-up. 2024-09-12T00:42:36.848 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-12T00:42:36.848 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-12T00:42:39.765 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2917 ms) 2024-09-12T00:42:39.765 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-12T00:42:42.805 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3040 ms) 2024-09-12T00:42:42.805 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-12T00:42:45.849 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestCls2PCQueue.Reserve (3044 ms) 2024-09-12T00:42:45.849 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-12T00:42:48.856 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3007 ms) 2024-09-12T00:42:48.856 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-12T00:42:52.951 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestCls2PCQueue.Commit (4095 ms) 2024-09-12T00:42:52.951 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-12T00:42:56.997 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestCls2PCQueue.Stats (4046 ms) 2024-09-12T00:42:56.998 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-12T00:43:01.051 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4053 ms) 2024-09-12T00:43:01.052 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-12T00:43:04.101 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestCls2PCQueue.Abort (3050 ms) 2024-09-12T00:43:04.101 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-12T00:43:07.112 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestCls2PCQueue.ReserveError (3011 ms) 2024-09-12T00:43:07.112 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-12T00:43:10.168 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestCls2PCQueue.CommitError (3053 ms) 2024-09-12T00:43:10.168 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-12T00:43:13.242 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestCls2PCQueue.AbortError (3077 ms) 2024-09-12T00:43:13.242 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-12T00:43:16.275 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3033 ms) 2024-09-12T00:43:16.275 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-12T00:43:19.277 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3002 ms) 2024-09-12T00:43:19.277 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-12T00:43:22.329 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3052 ms) 2024-09-12T00:43:22.329 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-12T00:43:25.335 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3007 ms) 2024-09-12T00:43:25.336 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-12T00:43:28.403 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3067 ms) 2024-09-12T00:43:28.403 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-12T00:43:31.434 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3031 ms) 2024-09-12T00:43:31.434 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-12T00:43:34.456 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestCls2PCQueue.Cleanup (3016 ms) 2024-09-12T00:43:34.456 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-12T00:43:45.634 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestCls2PCQueue.MultiProducer (11184 ms) 2024-09-12T00:43:45.634 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-12T00:43:51.007 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (5373 ms) 2024-09-12T00:43:51.008 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-12T00:44:05.065 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (14058 ms) 2024-09-12T00:44:05.065 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-12T00:44:11.135 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (6070 ms) 2024-09-12T00:44:11.135 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-12T00:44:21.229 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (10094 ms) 2024-09-12T00:44:21.229 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-12T00:44:31.277 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (10048 ms) 2024-09-12T00:44:31.277 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 24 tests from TestCls2PCQueue (114430 ms total) 2024-09-12T00:44:31.278 INFO:tasks.workunit.client.0.smithi070.stdout: 2024-09-12T00:44:31.278 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment tear-down 2024-09-12T00:44:31.278 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] 24 tests from 1 test suite ran. (114430 ms total) 2024-09-12T00:44:31.278 INFO:tasks.workunit.client.0.smithi070.stdout:[ PASSED ] 24 tests. 2024-09-12T00:44:31.283 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:44:31.283 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:44:31.335 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-12T00:44:31.337 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-12T00:44:31.338 DEBUG:teuthology.orchestra.run.smithi070:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-12T00:44:31.412 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:44:31.412 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:44:31.413 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:44:31.413 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment set-up. 2024-09-12T00:44:33.302 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 4 tests from ClsAccount 2024-09-12T00:44:33.302 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] ClsAccount.add 2024-09-12T00:44:33.350 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] ClsAccount.add (37 ms) 2024-09-12T00:44:33.350 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] ClsAccount.get 2024-09-12T00:44:33.352 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] ClsAccount.get (7 ms) 2024-09-12T00:44:33.352 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] ClsAccount.rm 2024-09-12T00:44:33.440 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] ClsAccount.rm (95 ms) 2024-09-12T00:44:33.441 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] ClsAccount.list 2024-09-12T00:44:33.484 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] ClsAccount.list (43 ms) 2024-09-12T00:44:33.484 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 4 tests from ClsAccount (182 ms total) 2024-09-12T00:44:33.484 INFO:tasks.workunit.client.0.smithi070.stdout: 2024-09-12T00:44:33.484 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment tear-down 2024-09-12T00:44:34.328 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] 4 tests from 1 test suite ran. (2916 ms total) 2024-09-12T00:44:34.329 INFO:tasks.workunit.client.0.smithi070.stdout:[ PASSED ] 4 tests. 2024-09-12T00:44:34.334 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:44:34.334 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:44:34.392 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-12T00:44:34.393 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-12T00:44:34.393 DEBUG:teuthology.orchestra.run.smithi070:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-12T00:44:34.469 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:44:34.469 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:44:34.470 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-12T00:44:34.471 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment set-up. 2024-09-12T00:44:36.328 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 6 tests from rgw_gc_log 2024-09-12T00:44:36.328 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-12T00:44:36.357 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] rgw_gc_log.init_existing_queue (29 ms) 2024-09-12T00:44:36.358 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-12T00:44:36.366 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] rgw_gc_log.init_existing_omap (8 ms) 2024-09-12T00:44:36.366 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-12T00:44:36.373 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (7 ms) 2024-09-12T00:44:36.373 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-12T00:44:36.375 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2024-09-12T00:44:36.375 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-12T00:44:36.379 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] rgw_gc_log.defer1_after_init (4 ms) 2024-09-12T00:44:36.379 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-12T00:44:36.385 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] rgw_gc_log.defer2_before_init (3 ms) 2024-09-12T00:44:36.385 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 6 tests from rgw_gc_log (54 ms total) 2024-09-12T00:44:36.385 INFO:tasks.workunit.client.0.smithi070.stdout: 2024-09-12T00:44:36.386 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment tear-down 2024-09-12T00:44:37.340 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] 6 tests from 1 test suite ran. (2870 ms total) 2024-09-12T00:44:37.340 INFO:tasks.workunit.client.0.smithi070.stdout:[ PASSED ] 6 tests. 2024-09-12T00:44:37.346 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:44:37.346 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:44:37.399 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-12T00:44:37.400 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-12T00:44:37.400 DEBUG:teuthology.orchestra.run.smithi070:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-12T00:44:37.475 INFO:tasks.workunit.client.0.smithi070.stdout:Running main() from gmock_main.cc 2024-09-12T00:44:37.475 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:44:37.475 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment set-up. 2024-09-12T00:44:37.476 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 4 tests from TestRGWObj 2024-09-12T00:44:37.476 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestRGWObj.underscore 2024-09-12T00:44:37.476 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: _obj 2024-09-12T00:44:37.476 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: _obj 2024-09-12T00:44:37.476 INFO:tasks.workunit.client.0.smithi070.stdout:stripped: _obj ns= i= 2024-09-12T00:44:37.476 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: _obj 2024-09-12T00:44:37.476 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: _obj 2024-09-12T00:44:37.476 INFO:tasks.workunit.client.0.smithi070.stdout:stripped: _obj ns= i= 2024-09-12T00:44:37.476 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: _obj 2024-09-12T00:44:37.476 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: _obj 2024-09-12T00:44:37.476 INFO:tasks.workunit.client.0.smithi070.stdout:stripped: _obj ns= i= 2024-09-12T00:44:37.476 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.477 INFO:tasks.workunit.client.0.smithi070.stdout: "obj1": { 2024-09-12T00:44:37.477 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.477 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.477 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.477 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.477 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.477 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.477 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.477 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.477 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.477 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.477 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.477 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.478 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_obj", 2024-09-12T00:44:37.478 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.478 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.478 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.478 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.478 INFO:tasks.workunit.client.0.smithi070.stdout: "obj2": { 2024-09-12T00:44:37.478 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.478 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.478 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.478 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.478 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.478 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.478 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.479 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.479 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.479 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.479 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.479 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.479 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_obj", 2024-09-12T00:44:37.479 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.479 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.479 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.480 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.480 INFO:tasks.workunit.client.0.smithi070.stdout: "obj3": { 2024-09-12T00:44:37.480 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.481 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.481 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.481 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.481 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.481 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.481 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.481 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.481 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.481 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.481 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.481 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.481 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_obj", 2024-09-12T00:44:37.481 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.482 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.482 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.482 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.482 INFO:tasks.workunit.client.0.smithi070.stdout: "obj3-2": { 2024-09-12T00:44:37.482 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.482 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.482 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.482 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.482 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.482 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.482 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.482 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.482 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.482 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.483 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.483 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.483 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_obj", 2024-09-12T00:44:37.483 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.483 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.483 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.483 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.483 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.483 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: _obj 2024-09-12T00:44:37.483 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: _obj 2024-09-12T00:44:37.483 INFO:tasks.workunit.client.0.smithi070.stdout:stripped: _obj ns=ns i= 2024-09-12T00:44:37.483 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: _obj 2024-09-12T00:44:37.483 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: _obj 2024-09-12T00:44:37.483 INFO:tasks.workunit.client.0.smithi070.stdout:stripped: _obj ns=ns i= 2024-09-12T00:44:37.484 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: _obj 2024-09-12T00:44:37.484 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: _obj 2024-09-12T00:44:37.484 INFO:tasks.workunit.client.0.smithi070.stdout:stripped: _obj ns=ns i= 2024-09-12T00:44:37.484 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.484 INFO:tasks.workunit.client.0.smithi070.stdout: "obj1": { 2024-09-12T00:44:37.484 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.484 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.484 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.484 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.484 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.484 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.484 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.484 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.485 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.485 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.485 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.485 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.485 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_obj", 2024-09-12T00:44:37.485 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.485 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.485 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.485 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.485 INFO:tasks.workunit.client.0.smithi070.stdout: "obj2": { 2024-09-12T00:44:37.485 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.485 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.485 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.485 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.486 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.486 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.486 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.486 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.486 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.486 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.486 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.486 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.486 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_obj", 2024-09-12T00:44:37.486 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.486 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.486 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.486 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.486 INFO:tasks.workunit.client.0.smithi070.stdout: "obj3": { 2024-09-12T00:44:37.487 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.487 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.487 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.487 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.487 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.487 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.487 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.487 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.487 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.487 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.487 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.487 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.487 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_obj", 2024-09-12T00:44:37.488 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.488 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.488 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.488 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.488 INFO:tasks.workunit.client.0.smithi070.stdout: "obj3-2": { 2024-09-12T00:44:37.488 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.488 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.488 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.488 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.488 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.488 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.488 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.488 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.488 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.489 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.489 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.489 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.489 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_obj", 2024-09-12T00:44:37.489 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.489 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.489 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.489 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.489 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.489 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: _obj[v1] 2024-09-12T00:44:37.489 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: _obj[v1] 2024-09-12T00:44:37.489 INFO:tasks.workunit.client.0.smithi070.stdout:stripped: _obj ns= i=v1 2024-09-12T00:44:37.489 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: _obj[v1] 2024-09-12T00:44:37.489 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: _obj[v1] 2024-09-12T00:44:37.490 INFO:tasks.workunit.client.0.smithi070.stdout:stripped: _obj ns= i=v1 2024-09-12T00:44:37.490 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: _obj[v1] 2024-09-12T00:44:37.490 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: _obj[v1] 2024-09-12T00:44:37.490 INFO:tasks.workunit.client.0.smithi070.stdout:stripped: _obj ns= i=v1 2024-09-12T00:44:37.490 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.490 INFO:tasks.workunit.client.0.smithi070.stdout: "obj1": { 2024-09-12T00:44:37.490 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.490 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.490 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.490 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.490 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.490 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.491 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.491 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.491 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.491 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.491 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.491 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.491 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_obj", 2024-09-12T00:44:37.491 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "v1", 2024-09-12T00:44:37.491 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.491 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.492 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.492 INFO:tasks.workunit.client.0.smithi070.stdout: "obj2": { 2024-09-12T00:44:37.492 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.492 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.492 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.492 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.492 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.492 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.492 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.492 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.492 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.492 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.493 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.493 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.493 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_obj", 2024-09-12T00:44:37.493 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "v1", 2024-09-12T00:44:37.493 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.493 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.493 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.493 INFO:tasks.workunit.client.0.smithi070.stdout: "obj3": { 2024-09-12T00:44:37.493 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.493 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.493 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.493 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.493 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.494 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.494 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.494 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.494 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.494 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.494 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.494 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.494 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_obj", 2024-09-12T00:44:37.494 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.494 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.494 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.494 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.495 INFO:tasks.workunit.client.0.smithi070.stdout: "obj3-2": { 2024-09-12T00:44:37.495 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.495 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.495 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.495 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.495 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.495 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.495 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.495 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.495 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.495 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.495 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.495 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.495 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_obj", 2024-09-12T00:44:37.496 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "v1", 2024-09-12T00:44:37.496 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.496 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.496 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.496 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.496 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: _obj[v1] 2024-09-12T00:44:37.496 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: _obj[v1] 2024-09-12T00:44:37.496 INFO:tasks.workunit.client.0.smithi070.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:44:37.496 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: _obj[v1] 2024-09-12T00:44:37.496 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: _obj[v1] 2024-09-12T00:44:37.496 INFO:tasks.workunit.client.0.smithi070.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:44:37.496 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: _obj[v1] 2024-09-12T00:44:37.496 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: _obj[v1] 2024-09-12T00:44:37.496 INFO:tasks.workunit.client.0.smithi070.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:44:37.497 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.497 INFO:tasks.workunit.client.0.smithi070.stdout: "obj1": { 2024-09-12T00:44:37.497 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.498 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.498 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.498 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.498 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.498 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.498 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.498 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.498 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.498 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.498 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.498 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.498 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_obj", 2024-09-12T00:44:37.498 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "v1", 2024-09-12T00:44:37.499 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.499 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.499 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.499 INFO:tasks.workunit.client.0.smithi070.stdout: "obj2": { 2024-09-12T00:44:37.499 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.499 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.499 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.499 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.499 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.499 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.499 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.499 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.499 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.499 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.500 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.500 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.500 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_obj", 2024-09-12T00:44:37.500 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "v1", 2024-09-12T00:44:37.500 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.500 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.500 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.500 INFO:tasks.workunit.client.0.smithi070.stdout: "obj3": { 2024-09-12T00:44:37.500 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.500 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.500 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.500 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.500 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.501 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.501 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.501 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.501 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.501 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.501 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.501 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.501 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_obj", 2024-09-12T00:44:37.501 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.502 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.502 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.502 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.502 INFO:tasks.workunit.client.0.smithi070.stdout: "obj3-2": { 2024-09-12T00:44:37.502 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.502 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.502 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.502 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.502 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.502 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.503 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.503 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.503 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.503 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.503 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.503 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.503 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_obj", 2024-09-12T00:44:37.503 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "v1", 2024-09-12T00:44:37.503 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.503 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.503 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.503 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.503 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-12T00:44:37.503 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-12T00:44:37.504 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: obj 2024-09-12T00:44:37.504 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: obj 2024-09-12T00:44:37.504 INFO:tasks.workunit.client.0.smithi070.stdout:stripped: obj ns= i= 2024-09-12T00:44:37.504 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: obj 2024-09-12T00:44:37.504 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: obj 2024-09-12T00:44:37.504 INFO:tasks.workunit.client.0.smithi070.stdout:stripped: obj ns= i= 2024-09-12T00:44:37.504 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: obj 2024-09-12T00:44:37.504 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: obj 2024-09-12T00:44:37.504 INFO:tasks.workunit.client.0.smithi070.stdout:stripped: obj ns= i= 2024-09-12T00:44:37.504 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.504 INFO:tasks.workunit.client.0.smithi070.stdout: "obj1": { 2024-09-12T00:44:37.504 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.504 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.504 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.505 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.505 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.505 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.505 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.505 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.505 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.505 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.505 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.505 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.505 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "obj", 2024-09-12T00:44:37.505 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.505 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.505 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.506 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.506 INFO:tasks.workunit.client.0.smithi070.stdout: "obj2": { 2024-09-12T00:44:37.506 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.506 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.506 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.506 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.506 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.506 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.506 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.506 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.506 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.506 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.506 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.506 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.507 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "obj", 2024-09-12T00:44:37.507 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.507 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.507 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.507 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.507 INFO:tasks.workunit.client.0.smithi070.stdout: "obj3": { 2024-09-12T00:44:37.507 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.507 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.507 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.507 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.507 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.507 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.507 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.507 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.508 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.508 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.508 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.508 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.508 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "obj", 2024-09-12T00:44:37.508 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.508 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.508 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.508 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.508 INFO:tasks.workunit.client.0.smithi070.stdout: "obj3-2": { 2024-09-12T00:44:37.508 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.508 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.508 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.509 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.509 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.509 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.509 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.509 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.509 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.509 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.509 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.509 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.509 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "obj", 2024-09-12T00:44:37.509 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.509 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.509 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.509 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.510 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.510 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: obj 2024-09-12T00:44:37.510 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: obj 2024-09-12T00:44:37.510 INFO:tasks.workunit.client.0.smithi070.stdout:stripped: obj ns=ns i= 2024-09-12T00:44:37.510 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: obj 2024-09-12T00:44:37.510 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: obj 2024-09-12T00:44:37.510 INFO:tasks.workunit.client.0.smithi070.stdout:stripped: obj ns=ns i= 2024-09-12T00:44:37.510 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: obj 2024-09-12T00:44:37.510 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: obj 2024-09-12T00:44:37.510 INFO:tasks.workunit.client.0.smithi070.stdout:stripped: obj ns=ns i= 2024-09-12T00:44:37.510 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.510 INFO:tasks.workunit.client.0.smithi070.stdout: "obj1": { 2024-09-12T00:44:37.510 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.510 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.511 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.511 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.511 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.511 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.511 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.511 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.511 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.511 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.511 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.511 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.511 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "obj", 2024-09-12T00:44:37.511 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.511 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.512 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.512 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.512 INFO:tasks.workunit.client.0.smithi070.stdout: "obj2": { 2024-09-12T00:44:37.512 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.512 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.512 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.512 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.512 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.512 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.512 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.512 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.512 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.512 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.512 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.513 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.513 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "obj", 2024-09-12T00:44:37.513 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.513 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.513 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.513 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.513 INFO:tasks.workunit.client.0.smithi070.stdout: "obj3": { 2024-09-12T00:44:37.513 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.513 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.513 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.513 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.513 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.513 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.514 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.514 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.514 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.514 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.514 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.514 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.514 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "obj", 2024-09-12T00:44:37.514 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.514 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.514 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.514 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.514 INFO:tasks.workunit.client.0.smithi070.stdout: "obj3-2": { 2024-09-12T00:44:37.514 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.514 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.515 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.515 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.515 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.515 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.515 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.515 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.515 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.515 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.515 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.515 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.515 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "obj", 2024-09-12T00:44:37.515 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.515 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.516 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.516 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.516 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.516 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: obj[v1] 2024-09-12T00:44:37.516 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: obj[v1] 2024-09-12T00:44:37.516 INFO:tasks.workunit.client.0.smithi070.stdout:stripped: obj ns= i=v1 2024-09-12T00:44:37.516 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: obj[v1] 2024-09-12T00:44:37.516 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: obj[v1] 2024-09-12T00:44:37.516 INFO:tasks.workunit.client.0.smithi070.stdout:stripped: obj ns= i=v1 2024-09-12T00:44:37.516 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: obj[v1] 2024-09-12T00:44:37.517 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: obj[v1] 2024-09-12T00:44:37.517 INFO:tasks.workunit.client.0.smithi070.stdout:stripped: obj ns= i=v1 2024-09-12T00:44:37.517 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.517 INFO:tasks.workunit.client.0.smithi070.stdout: "obj1": { 2024-09-12T00:44:37.517 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.517 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.517 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.517 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.517 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.517 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.517 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.517 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.517 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.517 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.518 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.518 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.518 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "obj", 2024-09-12T00:44:37.518 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "v1", 2024-09-12T00:44:37.518 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.518 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.518 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.518 INFO:tasks.workunit.client.0.smithi070.stdout: "obj2": { 2024-09-12T00:44:37.518 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.518 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.518 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.518 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.518 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.518 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.519 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.519 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.519 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.519 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.519 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.519 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.519 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "obj", 2024-09-12T00:44:37.519 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "v1", 2024-09-12T00:44:37.519 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.519 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.519 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.519 INFO:tasks.workunit.client.0.smithi070.stdout: "obj3": { 2024-09-12T00:44:37.519 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.519 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.520 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.520 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.520 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.520 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.520 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.520 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.520 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.520 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.520 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.520 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.520 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "obj", 2024-09-12T00:44:37.520 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.520 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.521 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.521 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.521 INFO:tasks.workunit.client.0.smithi070.stdout: "obj3-2": { 2024-09-12T00:44:37.521 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.521 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.521 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.521 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.521 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.521 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.522 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.522 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.522 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.522 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.522 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.522 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.522 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "obj", 2024-09-12T00:44:37.522 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "v1", 2024-09-12T00:44:37.522 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.522 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.522 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.522 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.522 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: obj[v1] 2024-09-12T00:44:37.523 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: obj[v1] 2024-09-12T00:44:37.523 INFO:tasks.workunit.client.0.smithi070.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:44:37.523 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: obj[v1] 2024-09-12T00:44:37.523 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: obj[v1] 2024-09-12T00:44:37.523 INFO:tasks.workunit.client.0.smithi070.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:44:37.523 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: obj[v1] 2024-09-12T00:44:37.523 INFO:tasks.workunit.client.0.smithi070.stdout:parsed: obj[v1] 2024-09-12T00:44:37.523 INFO:tasks.workunit.client.0.smithi070.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:44:37.523 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.523 INFO:tasks.workunit.client.0.smithi070.stdout: "obj1": { 2024-09-12T00:44:37.523 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.523 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.523 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.523 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.524 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.524 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.524 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.524 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.524 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.524 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.524 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.524 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.524 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "obj", 2024-09-12T00:44:37.524 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "v1", 2024-09-12T00:44:37.524 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.524 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.524 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.524 INFO:tasks.workunit.client.0.smithi070.stdout: "obj2": { 2024-09-12T00:44:37.525 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.525 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.525 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.525 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.525 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.525 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.525 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.525 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.525 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.525 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.525 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.525 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.525 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "obj", 2024-09-12T00:44:37.526 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "v1", 2024-09-12T00:44:37.526 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.526 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.526 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.526 INFO:tasks.workunit.client.0.smithi070.stdout: "obj3": { 2024-09-12T00:44:37.526 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.526 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.526 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.526 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.526 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.526 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.526 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.526 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.526 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.527 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.527 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.527 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.527 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "obj", 2024-09-12T00:44:37.527 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.527 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.527 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.527 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.527 INFO:tasks.workunit.client.0.smithi070.stdout: "obj3-2": { 2024-09-12T00:44:37.527 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.527 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.527 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.527 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.527 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.528 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.528 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.528 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.528 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.528 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.528 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.528 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.528 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "obj", 2024-09-12T00:44:37.528 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "v1", 2024-09-12T00:44:37.528 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.528 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.528 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.528 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.528 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-12T00:44:37.529 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-12T00:44:37.529 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.529 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.529 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.529 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.529 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.529 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.529 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.529 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.529 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.529 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.529 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.529 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.529 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.530 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.530 INFO:tasks.workunit.client.0.smithi070.stdout: "obj": { 2024-09-12T00:44:37.530 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.530 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.530 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.530 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.530 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.530 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.530 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.530 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.530 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.530 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.530 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.531 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.531 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "myobj", 2024-09-12T00:44:37.531 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.531 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.531 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.531 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.531 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.531 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.531 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.531 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": "default-placement.data", 2024-09-12T00:44:37.531 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker_myobj", 2024-09-12T00:44:37.531 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.531 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.532 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.532 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.532 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.532 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.532 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.532 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.532 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.532 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.532 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.532 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.533 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.533 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.533 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.533 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.533 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.533 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "myobj", 2024-09-12T00:44:37.533 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.533 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.533 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.533 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.533 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.533 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.533 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.534 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.534 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.534 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.534 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.534 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.534 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.534 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.534 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.534 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.534 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.534 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.534 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.534 INFO:tasks.workunit.client.0.smithi070.stdout: "obj": { 2024-09-12T00:44:37.534 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.535 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.535 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.535 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.535 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.535 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.535 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.535 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.535 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.535 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.535 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.535 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.535 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "myobj", 2024-09-12T00:44:37.535 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.535 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.536 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.536 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.536 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.536 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.536 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.536 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.536 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker_myobj", 2024-09-12T00:44:37.536 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.536 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.536 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.536 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.536 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.536 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.537 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.537 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.537 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.537 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.537 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.537 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.537 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.537 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.537 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.537 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.537 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.537 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "myobj", 2024-09-12T00:44:37.538 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.538 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.538 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.538 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.538 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.538 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.538 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.538 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.539 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.539 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.539 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.539 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.539 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.539 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.539 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.539 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.539 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.539 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.539 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.539 INFO:tasks.workunit.client.0.smithi070.stdout: "obj": { 2024-09-12T00:44:37.539 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.540 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.540 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.540 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.540 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.540 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.540 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.540 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.540 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.540 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.540 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.540 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.540 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "myobj", 2024-09-12T00:44:37.540 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.541 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.541 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.541 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.541 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.541 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.541 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.541 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": "default-placement.data", 2024-09-12T00:44:37.541 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:44:37.541 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.541 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.541 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.541 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.541 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.541 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.542 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.542 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.542 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.542 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.542 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.542 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.542 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.542 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.542 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.542 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.542 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.542 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "myobj", 2024-09-12T00:44:37.542 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.543 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.543 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.543 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.543 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.543 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.543 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.543 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.543 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.543 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.543 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.543 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.543 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.543 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.544 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.544 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.544 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.544 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.544 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.544 INFO:tasks.workunit.client.0.smithi070.stdout: "obj": { 2024-09-12T00:44:37.544 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.544 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.544 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.544 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.544 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.544 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.544 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.544 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.545 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.545 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.545 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.545 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.545 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "myobj", 2024-09-12T00:44:37.545 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.545 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.545 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.545 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.545 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.546 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.546 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.546 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.546 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:44:37.546 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.546 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.546 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.546 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.546 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.546 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.546 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.546 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.546 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.547 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.547 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.547 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.547 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.547 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.547 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.547 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.547 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.547 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "myobj", 2024-09-12T00:44:37.547 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.547 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.547 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.547 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.548 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.548 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.548 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.548 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.548 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.548 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.548 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.548 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.548 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.548 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.548 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.548 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.548 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.549 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.549 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.549 INFO:tasks.workunit.client.0.smithi070.stdout: "obj": { 2024-09-12T00:44:37.549 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.549 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.549 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.549 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.549 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.549 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.549 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.549 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.549 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.549 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.549 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.550 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.550 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "myobj", 2024-09-12T00:44:37.550 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.550 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.550 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.550 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.550 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.550 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.550 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.550 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": "default-placement.data", 2024-09-12T00:44:37.550 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:44:37.550 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.550 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.550 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.551 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.551 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.551 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.551 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.551 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.551 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.551 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.551 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.551 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.551 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.551 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.551 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.551 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.551 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.552 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "myobj", 2024-09-12T00:44:37.552 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.552 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.552 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.552 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.552 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.552 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.552 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.552 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.552 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.552 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.552 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.552 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.553 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.553 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.553 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.553 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.553 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.553 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.553 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.553 INFO:tasks.workunit.client.0.smithi070.stdout: "obj": { 2024-09-12T00:44:37.553 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.553 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.553 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.553 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.553 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.553 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.554 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.554 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.554 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.554 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.554 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.554 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.554 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "myobj", 2024-09-12T00:44:37.554 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.554 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.554 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.554 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.554 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.554 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.554 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.555 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.555 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:44:37.555 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.555 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.555 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.555 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.555 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.555 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.555 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.555 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.555 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.555 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.555 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.555 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.556 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.556 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.556 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.556 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.556 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.556 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "myobj", 2024-09-12T00:44:37.556 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.556 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.556 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.556 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.556 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.556 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.556 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.556 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.557 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.557 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.557 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.557 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.557 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.557 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.557 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.557 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.557 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.557 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.557 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.557 INFO:tasks.workunit.client.0.smithi070.stdout: "obj": { 2024-09-12T00:44:37.557 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.557 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.558 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.558 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.558 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.558 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.558 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.558 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.558 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.558 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.558 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.558 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.558 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "myobj", 2024-09-12T00:44:37.558 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.558 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.559 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.559 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.559 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.559 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.559 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.559 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": "default-placement.data", 2024-09-12T00:44:37.559 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:44:37.559 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.559 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.559 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.559 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.559 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.559 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.560 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.560 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.560 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.560 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.560 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.560 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.560 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.560 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.560 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.560 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.560 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.560 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "myobj", 2024-09-12T00:44:37.560 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.560 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.561 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.561 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.561 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.561 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.561 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.561 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.561 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.561 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.561 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.561 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.561 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.561 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.561 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.561 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.562 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.562 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.562 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.562 INFO:tasks.workunit.client.0.smithi070.stdout: "obj": { 2024-09-12T00:44:37.562 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.562 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.562 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.562 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.562 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.562 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.562 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.562 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.562 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.562 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.563 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.563 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.563 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "myobj", 2024-09-12T00:44:37.563 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.563 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.563 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.563 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.563 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.563 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.563 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.563 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.563 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:44:37.563 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.563 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.564 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.564 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.564 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.564 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.564 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.564 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.564 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.564 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.564 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.564 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.564 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.564 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.564 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.564 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.565 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.565 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "myobj", 2024-09-12T00:44:37.565 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.565 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.565 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.565 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.565 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.565 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.565 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.565 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.565 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.565 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.565 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.565 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.566 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.566 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.566 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.566 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.566 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.566 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.566 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.566 INFO:tasks.workunit.client.0.smithi070.stdout: "obj": { 2024-09-12T00:44:37.566 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.566 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.566 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.566 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.566 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.567 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.567 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.567 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.567 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.567 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.567 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.567 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.567 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj", 2024-09-12T00:44:37.567 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.567 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.567 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.567 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.567 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.567 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.568 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.568 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": "default-placement.data", 2024-09-12T00:44:37.568 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker___myobj", 2024-09-12T00:44:37.568 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "marker__myobj" 2024-09-12T00:44:37.568 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.568 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.568 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.568 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.568 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.568 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.568 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.568 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.568 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.569 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.569 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.569 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.569 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.569 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.569 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.569 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.569 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj", 2024-09-12T00:44:37.569 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.569 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.569 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.569 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.570 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.570 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.570 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.570 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.570 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.570 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.570 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.570 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.570 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.570 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.570 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.570 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.570 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.570 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.571 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.571 INFO:tasks.workunit.client.0.smithi070.stdout: "obj": { 2024-09-12T00:44:37.571 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.571 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.571 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.571 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.571 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.571 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.571 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.571 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.571 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.571 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.571 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.571 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.572 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj", 2024-09-12T00:44:37.572 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.572 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.572 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.572 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.572 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.572 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.572 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.572 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.572 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker___myobj", 2024-09-12T00:44:37.572 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "marker__myobj" 2024-09-12T00:44:37.572 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.572 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.573 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.573 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.573 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.573 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.573 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.573 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.573 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.573 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.573 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.573 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.573 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.573 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.573 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.574 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.574 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj", 2024-09-12T00:44:37.574 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.574 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.574 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.574 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.574 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.574 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.574 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.574 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.574 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.574 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.574 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.574 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.575 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.575 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.575 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.575 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.575 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.575 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.575 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.575 INFO:tasks.workunit.client.0.smithi070.stdout: "obj": { 2024-09-12T00:44:37.575 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.575 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.575 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.575 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.576 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.576 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.576 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.576 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.576 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.576 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.576 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.576 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.576 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj", 2024-09-12T00:44:37.576 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.576 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.576 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.576 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.577 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.577 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.577 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.577 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": "default-placement.data", 2024-09-12T00:44:37.577 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:44:37.577 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.577 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.577 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.577 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.577 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.577 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.577 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.577 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.577 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.578 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.578 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.578 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.578 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.578 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.578 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.578 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.578 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.578 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj", 2024-09-12T00:44:37.578 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.578 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.578 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.578 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.579 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.579 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.579 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.579 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.579 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.579 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.579 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.579 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.579 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.579 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.580 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.580 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.580 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.580 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.580 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.580 INFO:tasks.workunit.client.0.smithi070.stdout: "obj": { 2024-09-12T00:44:37.580 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.580 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.580 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.581 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.581 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.581 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.581 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.581 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.581 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.581 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.581 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.581 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.581 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj", 2024-09-12T00:44:37.581 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.581 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.581 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.581 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.582 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.582 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.582 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.582 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.582 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:44:37.582 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.582 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.582 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.582 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.582 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.582 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.582 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.582 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.582 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.583 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.583 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.583 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.583 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.583 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.583 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.583 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.583 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.583 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj", 2024-09-12T00:44:37.583 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.583 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.583 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.583 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.584 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.584 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.584 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.584 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.584 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.584 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.584 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.584 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.584 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.584 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.584 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.584 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.584 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.584 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.585 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.585 INFO:tasks.workunit.client.0.smithi070.stdout: "obj": { 2024-09-12T00:44:37.585 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.585 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.585 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.585 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.585 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.585 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.585 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.585 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.585 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.585 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.585 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.585 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.586 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj", 2024-09-12T00:44:37.586 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.586 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.586 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.586 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.586 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.586 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.586 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.586 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": "default-placement.data", 2024-09-12T00:44:37.586 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:44:37.586 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "marker__myobj" 2024-09-12T00:44:37.586 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.586 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.586 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.587 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.587 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.587 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.587 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.587 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.587 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.587 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.587 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.587 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.587 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.587 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.587 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.587 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.587 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj", 2024-09-12T00:44:37.588 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.588 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.588 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.588 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.588 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.588 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.588 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.588 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.588 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.588 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.588 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.588 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.588 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.589 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.589 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.589 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.589 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.589 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.589 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.589 INFO:tasks.workunit.client.0.smithi070.stdout: "obj": { 2024-09-12T00:44:37.589 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.589 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.589 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.589 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.589 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.589 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.589 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.590 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.590 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.590 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.590 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.590 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.590 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj", 2024-09-12T00:44:37.590 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.590 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.590 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.590 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.590 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.590 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.590 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.590 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.591 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:44:37.591 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "marker__myobj" 2024-09-12T00:44:37.591 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.591 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.591 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.591 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.591 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.591 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.591 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.591 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.591 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.591 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.591 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.591 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.592 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.592 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.592 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.592 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.592 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj", 2024-09-12T00:44:37.592 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.592 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.592 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.592 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.592 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.592 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.592 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.592 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.592 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.593 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.593 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.593 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.593 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.593 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.593 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.593 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.593 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.593 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.593 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.593 INFO:tasks.workunit.client.0.smithi070.stdout: "obj": { 2024-09-12T00:44:37.593 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.593 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.593 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.594 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.594 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.594 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.594 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.594 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.594 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.594 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.594 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.594 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.594 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj", 2024-09-12T00:44:37.594 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.594 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.594 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.594 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.595 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.595 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.595 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.595 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": "default-placement.data", 2024-09-12T00:44:37.595 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:44:37.595 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.595 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.595 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.595 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.595 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.595 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.595 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.595 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.596 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.596 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.596 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.596 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.596 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.596 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.596 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.596 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.596 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.596 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj", 2024-09-12T00:44:37.596 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.596 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.596 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.597 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.597 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.597 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.597 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.597 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.597 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.597 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.597 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.597 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.597 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.598 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.598 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.598 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.598 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.598 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.598 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.598 INFO:tasks.workunit.client.0.smithi070.stdout: "obj": { 2024-09-12T00:44:37.598 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.598 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.598 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.598 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.598 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.598 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.599 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.599 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.599 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.599 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.599 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.599 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.599 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj", 2024-09-12T00:44:37.599 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.599 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.599 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.600 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.600 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.600 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.600 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.600 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.600 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:44:37.600 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.600 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.601 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.601 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.601 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.601 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.601 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.601 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.601 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.601 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.601 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.601 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.601 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.601 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.601 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.601 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.602 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.602 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj", 2024-09-12T00:44:37.602 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.602 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.602 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.602 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.602 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.602 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.602 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.602 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.602 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.602 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.602 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.602 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.603 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.603 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.603 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.603 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.603 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.603 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.603 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.603 INFO:tasks.workunit.client.0.smithi070.stdout: "obj": { 2024-09-12T00:44:37.603 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.603 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.603 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.603 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.603 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.603 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.604 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.604 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.604 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.604 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.604 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.604 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.604 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj_", 2024-09-12T00:44:37.604 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.604 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.604 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.604 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.604 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.604 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.605 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.605 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": "default-placement.data", 2024-09-12T00:44:37.605 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker___myobj_", 2024-09-12T00:44:37.605 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "marker__myobj_" 2024-09-12T00:44:37.605 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.605 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.605 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.605 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.605 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.605 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.605 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.606 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.606 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.606 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.606 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.606 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.606 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.606 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.606 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.606 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.606 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj_", 2024-09-12T00:44:37.607 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.607 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.610 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.610 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.610 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.610 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.610 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.611 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.611 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.611 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.611 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.611 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.611 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.611 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.611 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.611 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.611 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.611 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.611 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.611 INFO:tasks.workunit.client.0.smithi070.stdout: "obj": { 2024-09-12T00:44:37.612 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.612 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.612 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.612 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.612 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.612 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.612 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.612 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.612 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.612 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.612 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.612 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.612 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj_", 2024-09-12T00:44:37.612 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.612 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.613 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.613 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.613 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.613 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.613 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.613 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.613 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker___myobj_", 2024-09-12T00:44:37.613 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "marker__myobj_" 2024-09-12T00:44:37.613 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.613 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.614 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.614 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.614 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.614 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.614 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.614 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.614 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.614 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.614 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.614 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.614 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.614 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.614 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.615 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.615 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj_", 2024-09-12T00:44:37.615 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.615 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.615 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.615 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.615 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.615 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.615 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.615 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.615 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.615 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.615 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.615 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.616 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.616 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.616 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.616 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.616 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.616 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.616 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.616 INFO:tasks.workunit.client.0.smithi070.stdout: "obj": { 2024-09-12T00:44:37.616 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.616 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.617 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.617 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.617 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.617 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.617 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.617 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.617 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.617 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.617 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.617 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.617 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj_", 2024-09-12T00:44:37.617 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.617 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.618 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.618 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.618 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.618 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.618 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.618 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": "default-placement.data", 2024-09-12T00:44:37.618 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:44:37.618 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.618 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.618 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.618 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.618 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.618 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.618 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.619 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.619 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.619 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.619 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.619 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.619 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.619 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.619 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.619 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.619 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.619 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj_", 2024-09-12T00:44:37.619 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.619 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.619 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.620 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.620 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.620 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.620 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.620 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.620 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.620 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.620 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.620 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.620 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.620 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.620 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.620 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.621 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.621 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.621 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.621 INFO:tasks.workunit.client.0.smithi070.stdout: "obj": { 2024-09-12T00:44:37.621 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.621 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.621 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.621 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.621 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.622 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.622 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.622 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.622 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.622 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.622 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.622 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.622 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj_", 2024-09-12T00:44:37.622 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.622 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.622 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.623 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.623 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.623 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.623 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.623 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.623 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:44:37.623 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.623 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.623 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.623 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.623 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.623 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.623 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.623 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.624 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.624 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.624 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.624 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.624 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.624 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.624 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.624 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.624 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.624 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj_", 2024-09-12T00:44:37.624 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.624 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.624 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.624 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.625 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.625 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.625 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.625 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.625 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.625 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.625 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.625 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.625 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.625 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.625 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.625 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.626 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.626 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.626 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.626 INFO:tasks.workunit.client.0.smithi070.stdout: "obj": { 2024-09-12T00:44:37.626 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.626 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.626 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.626 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.626 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.626 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.626 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.626 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.626 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.627 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.627 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.627 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.627 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj_", 2024-09-12T00:44:37.627 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.627 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.627 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.627 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.627 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.627 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.627 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.627 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": "default-placement.data", 2024-09-12T00:44:37.628 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:44:37.628 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "marker__myobj_" 2024-09-12T00:44:37.628 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.628 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.628 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.628 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.628 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.628 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.628 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.628 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.628 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.628 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.628 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.628 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.629 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.629 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.629 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.629 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.629 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj_", 2024-09-12T00:44:37.629 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.629 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.629 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.629 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.629 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.629 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.629 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.629 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.629 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.630 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.630 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.630 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.630 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.630 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.630 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.630 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.630 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.630 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.630 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.630 INFO:tasks.workunit.client.0.smithi070.stdout: "obj": { 2024-09-12T00:44:37.630 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.630 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.630 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.631 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.631 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.631 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.631 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.631 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.631 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.631 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.631 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.631 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.631 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj_", 2024-09-12T00:44:37.632 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.632 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.632 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.632 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.632 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.632 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.632 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.632 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.632 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:44:37.632 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "marker__myobj_" 2024-09-12T00:44:37.632 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.632 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.632 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.633 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.633 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.633 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.633 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.633 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.633 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.633 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.633 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.633 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.633 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.633 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.633 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.633 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.633 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj_", 2024-09-12T00:44:37.634 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.634 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.634 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.634 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.634 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.634 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.634 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.634 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.634 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.634 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.634 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.634 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.635 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.635 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.635 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.635 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.635 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.635 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.635 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.635 INFO:tasks.workunit.client.0.smithi070.stdout: "obj": { 2024-09-12T00:44:37.635 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.635 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.635 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.635 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.635 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.635 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.636 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.636 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.636 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.636 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.636 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.636 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.636 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj_", 2024-09-12T00:44:37.636 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.636 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.636 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.636 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.636 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.636 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.636 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.637 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": "default-placement.data", 2024-09-12T00:44:37.637 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:44:37.637 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.637 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.637 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.637 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.637 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.637 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.637 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "test", 2024-09-12T00:44:37.637 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.637 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.638 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.638 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.638 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": "", 2024-09-12T00:44:37.638 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.638 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": "" 2024-09-12T00:44:37.638 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.638 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.638 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.638 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj_", 2024-09-12T00:44:37.638 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.638 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.638 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.639 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.639 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.639 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.639 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.639 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.639 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.639 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.639 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.639 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.639 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.639 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.639 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.639 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.639 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.639 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.640 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.640 INFO:tasks.workunit.client.0.smithi070.stdout: "obj": { 2024-09-12T00:44:37.640 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.640 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.640 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.640 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.641 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.641 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.641 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.641 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.641 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.641 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.641 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.641 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.641 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj_", 2024-09-12T00:44:37.641 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.641 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.641 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.641 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.642 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.642 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.642 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.642 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.642 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:44:37.642 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.642 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.642 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.642 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.642 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.643 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.643 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.643 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.643 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.643 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.643 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.643 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.643 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.643 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.643 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.643 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.644 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.644 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj_", 2024-09-12T00:44:37.644 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.644 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.644 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.644 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.644 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.644 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2024-09-12T00:44:37.644 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-12T00:44:37.644 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.644 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.644 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.644 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker_myobj", 2024-09-12T00:44:37.645 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.645 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.645 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.645 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.645 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.645 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.645 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.645 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.645 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.645 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.645 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.645 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.646 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.646 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.646 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.646 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.646 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.646 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "myobj", 2024-09-12T00:44:37.646 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.646 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.646 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.646 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.646 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.646 INFO:tasks.workunit.client.0.smithi070.stdout:raw=.data-pool:marker_myobj 2024-09-12T00:44:37.646 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.646 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj2": { 2024-09-12T00:44:37.647 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.647 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker_myobj", 2024-09-12T00:44:37.647 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.647 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.647 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.647 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.647 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj2": { 2024-09-12T00:44:37.647 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.647 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.647 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.647 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.647 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.647 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.647 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.647 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.648 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.648 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.648 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.648 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.648 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "myobj", 2024-09-12T00:44:37.648 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.648 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.648 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.648 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.648 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.648 INFO:tasks.workunit.client.0.smithi070.stdout:raw2=.data-pool:marker_myobj 2024-09-12T00:44:37.648 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.648 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.649 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.649 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:44:37.649 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.649 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.649 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.649 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.649 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.649 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.649 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.649 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.649 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.649 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.649 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.650 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.650 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.650 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.650 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.650 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.650 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.650 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "myobj", 2024-09-12T00:44:37.650 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.650 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.650 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.650 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.650 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.650 INFO:tasks.workunit.client.0.smithi070.stdout:raw=.data-pool:marker__ns_myobj 2024-09-12T00:44:37.650 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.651 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj2": { 2024-09-12T00:44:37.651 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.651 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:44:37.651 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.651 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.651 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.651 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.651 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj2": { 2024-09-12T00:44:37.651 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.651 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.651 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.651 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.651 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.652 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.652 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.652 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.652 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.652 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.652 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.652 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.652 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "myobj", 2024-09-12T00:44:37.652 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.652 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.653 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.653 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.653 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.653 INFO:tasks.workunit.client.0.smithi070.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-12T00:44:37.653 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.653 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.653 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.653 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:44:37.653 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.653 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.653 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.653 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.653 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.654 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.654 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.654 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.654 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.654 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.654 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.654 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.654 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.654 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.654 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.654 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.654 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.654 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "myobj", 2024-09-12T00:44:37.654 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.655 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.655 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.655 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.655 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.655 INFO:tasks.workunit.client.0.smithi070.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-12T00:44:37.655 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.655 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj2": { 2024-09-12T00:44:37.655 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.655 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:44:37.655 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.655 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.655 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.655 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.655 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj2": { 2024-09-12T00:44:37.656 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.656 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.656 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.656 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.656 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.656 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.656 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.656 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.656 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.656 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.656 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.656 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.656 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "myobj", 2024-09-12T00:44:37.657 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.657 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.657 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.657 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.657 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.657 INFO:tasks.workunit.client.0.smithi070.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-12T00:44:37.657 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.657 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.657 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.657 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:44:37.657 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.658 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.658 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.658 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.658 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.658 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.658 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.658 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.658 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.658 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.658 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.658 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.658 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.658 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.658 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.659 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.659 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.659 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "myobj", 2024-09-12T00:44:37.659 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.659 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.659 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.659 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.659 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.659 INFO:tasks.workunit.client.0.smithi070.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-12T00:44:37.659 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.659 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj2": { 2024-09-12T00:44:37.659 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.659 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:44:37.659 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.660 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.660 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.660 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.660 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj2": { 2024-09-12T00:44:37.660 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.660 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.660 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.660 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.660 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.660 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.660 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.660 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.660 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.661 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.661 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.661 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.661 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "myobj", 2024-09-12T00:44:37.661 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.661 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.661 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.661 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.661 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.661 INFO:tasks.workunit.client.0.smithi070.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-12T00:44:37.661 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.661 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.661 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.661 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker___myobj", 2024-09-12T00:44:37.661 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "marker__myobj" 2024-09-12T00:44:37.662 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.662 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.662 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.662 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.662 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.662 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.662 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.662 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.662 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.662 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.662 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.662 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.662 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.663 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.663 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.663 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.663 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj", 2024-09-12T00:44:37.663 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.663 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.663 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.663 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.664 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.664 INFO:tasks.workunit.client.0.smithi070.stdout:raw=.data-pool:marker___myobj 2024-09-12T00:44:37.664 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.664 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj2": { 2024-09-12T00:44:37.664 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.664 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker___myobj", 2024-09-12T00:44:37.664 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "marker__myobj" 2024-09-12T00:44:37.664 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.664 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.664 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.665 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj2": { 2024-09-12T00:44:37.665 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.665 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.665 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.665 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.665 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.665 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.665 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.665 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.665 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.665 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.665 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.665 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.665 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj", 2024-09-12T00:44:37.666 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.666 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.666 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.666 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.666 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.666 INFO:tasks.workunit.client.0.smithi070.stdout:raw2=.data-pool:marker___myobj 2024-09-12T00:44:37.666 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.666 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.666 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.666 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:44:37.666 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.666 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.666 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.666 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.667 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.667 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.667 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.667 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.667 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.667 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.667 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.667 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.667 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.667 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.667 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.667 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.667 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.667 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj", 2024-09-12T00:44:37.667 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.668 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.668 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.668 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.668 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.668 INFO:tasks.workunit.client.0.smithi070.stdout:raw=.data-pool:marker__ns__myobj 2024-09-12T00:44:37.668 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.668 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj2": { 2024-09-12T00:44:37.668 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.668 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:44:37.668 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.668 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.668 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.668 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.668 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj2": { 2024-09-12T00:44:37.669 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.669 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.669 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.669 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.669 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.669 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.669 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.669 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.669 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.669 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.669 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.669 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.669 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj", 2024-09-12T00:44:37.669 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.670 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.670 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.670 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.670 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.670 INFO:tasks.workunit.client.0.smithi070.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-12T00:44:37.670 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.670 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.670 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.670 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:44:37.670 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "marker__myobj" 2024-09-12T00:44:37.670 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.670 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.670 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.670 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.670 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.671 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.671 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.671 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.671 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.671 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.671 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.671 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.671 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.671 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.671 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.671 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.671 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj", 2024-09-12T00:44:37.671 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.671 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.671 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.672 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.672 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.672 INFO:tasks.workunit.client.0.smithi070.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-12T00:44:37.672 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.672 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj2": { 2024-09-12T00:44:37.672 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.672 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:44:37.672 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "marker__myobj" 2024-09-12T00:44:37.672 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.672 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.672 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.672 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj2": { 2024-09-12T00:44:37.672 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.672 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.673 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.673 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.673 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.673 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.673 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.673 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.673 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.673 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.673 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.673 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.674 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj", 2024-09-12T00:44:37.674 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.674 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.674 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.674 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.674 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.674 INFO:tasks.workunit.client.0.smithi070.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-12T00:44:37.674 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.674 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.674 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.674 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:44:37.674 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.674 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.674 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.675 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.675 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.675 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.675 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.675 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.675 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.675 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.675 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.675 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.675 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.675 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.675 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.675 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.675 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.676 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj", 2024-09-12T00:44:37.676 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.676 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.676 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.676 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.676 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.676 INFO:tasks.workunit.client.0.smithi070.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-12T00:44:37.676 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.676 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj2": { 2024-09-12T00:44:37.676 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.676 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:44:37.676 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.676 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.676 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.677 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.677 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj2": { 2024-09-12T00:44:37.677 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.677 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.677 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.677 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.677 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.677 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.677 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.677 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.677 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.677 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.677 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.677 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.677 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj", 2024-09-12T00:44:37.678 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.678 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.678 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.678 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.678 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.678 INFO:tasks.workunit.client.0.smithi070.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-12T00:44:37.678 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.678 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.678 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.678 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker___myobj_", 2024-09-12T00:44:37.678 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "marker__myobj_" 2024-09-12T00:44:37.678 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.678 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.678 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.679 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.679 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.679 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.679 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.679 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.679 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.679 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.679 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.679 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.679 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.679 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.679 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.679 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.679 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj_", 2024-09-12T00:44:37.680 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.680 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.680 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.680 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.680 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.680 INFO:tasks.workunit.client.0.smithi070.stdout:raw=.data-pool:marker___myobj_ 2024-09-12T00:44:37.680 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.680 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj2": { 2024-09-12T00:44:37.680 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.680 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker___myobj_", 2024-09-12T00:44:37.681 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "marker__myobj_" 2024-09-12T00:44:37.681 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.681 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.681 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.681 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj2": { 2024-09-12T00:44:37.681 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.681 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.682 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.682 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.682 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.682 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.682 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.682 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.682 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.682 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.682 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.682 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.682 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj_", 2024-09-12T00:44:37.682 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.682 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.682 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.683 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.683 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.683 INFO:tasks.workunit.client.0.smithi070.stdout:raw2=.data-pool:marker___myobj_ 2024-09-12T00:44:37.683 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.683 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.683 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.683 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:44:37.683 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.683 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.683 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.683 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.683 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.683 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.684 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.684 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.684 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.684 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.684 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.684 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.684 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.684 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.684 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.685 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.685 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.685 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj_", 2024-09-12T00:44:37.685 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.685 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.685 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.685 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.685 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.685 INFO:tasks.workunit.client.0.smithi070.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-12T00:44:37.685 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.685 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj2": { 2024-09-12T00:44:37.685 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.685 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:44:37.685 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.685 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.686 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.686 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.686 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj2": { 2024-09-12T00:44:37.686 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.686 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.686 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.686 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.686 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.686 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.686 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.686 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.686 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.686 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.686 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.687 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.687 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj_", 2024-09-12T00:44:37.687 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "", 2024-09-12T00:44:37.687 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.687 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.687 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.687 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.687 INFO:tasks.workunit.client.0.smithi070.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-12T00:44:37.687 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.687 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.687 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.688 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:44:37.688 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "marker__myobj_" 2024-09-12T00:44:37.688 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.688 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.688 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.688 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.688 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.688 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.688 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.688 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.688 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.688 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.688 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.688 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.688 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.689 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.689 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.689 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.689 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj_", 2024-09-12T00:44:37.689 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.689 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.689 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.689 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.689 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.689 INFO:tasks.workunit.client.0.smithi070.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-12T00:44:37.689 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.689 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj2": { 2024-09-12T00:44:37.689 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.689 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:44:37.690 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "marker__myobj_" 2024-09-12T00:44:37.690 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.690 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.690 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.690 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj2": { 2024-09-12T00:44:37.690 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.690 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.690 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.690 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.690 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.690 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.690 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.690 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.690 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.691 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.691 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.691 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.691 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj_", 2024-09-12T00:44:37.691 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.691 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "" 2024-09-12T00:44:37.691 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.691 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.691 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.691 INFO:tasks.workunit.client.0.smithi070.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-12T00:44:37.691 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.691 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj": { 2024-09-12T00:44:37.691 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.691 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:44:37.691 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.692 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.692 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.692 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.692 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj": { 2024-09-12T00:44:37.692 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.692 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.692 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.692 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.692 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.692 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.692 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.692 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.692 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.693 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.693 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.693 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.693 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj_", 2024-09-12T00:44:37.693 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.693 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.693 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.693 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.693 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.693 INFO:tasks.workunit.client.0.smithi070.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-12T00:44:37.693 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.693 INFO:tasks.workunit.client.0.smithi070.stdout: "raw_obj2": { 2024-09-12T00:44:37.693 INFO:tasks.workunit.client.0.smithi070.stdout: "pool": ".data-pool", 2024-09-12T00:44:37.693 INFO:tasks.workunit.client.0.smithi070.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:44:37.694 INFO:tasks.workunit.client.0.smithi070.stdout: "loc": "" 2024-09-12T00:44:37.694 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.694 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.694 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.694 INFO:tasks.workunit.client.0.smithi070.stdout: "new_obj2": { 2024-09-12T00:44:37.694 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket": { 2024-09-12T00:44:37.694 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "ebtest", 2024-09-12T00:44:37.694 INFO:tasks.workunit.client.0.smithi070.stdout: "marker": "marker", 2024-09-12T00:44:37.694 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_id": "bucket-id", 2024-09-12T00:44:37.694 INFO:tasks.workunit.client.0.smithi070.stdout: "tenant": "", 2024-09-12T00:44:37.694 INFO:tasks.workunit.client.0.smithi070.stdout: "explicit_placement": { 2024-09-12T00:44:37.695 INFO:tasks.workunit.client.0.smithi070.stdout: "data_pool": ".data-pool", 2024-09-12T00:44:37.695 INFO:tasks.workunit.client.0.smithi070.stdout: "data_extra_pool": "", 2024-09-12T00:44:37.695 INFO:tasks.workunit.client.0.smithi070.stdout: "index_pool": ".index-pool" 2024-09-12T00:44:37.695 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.695 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.695 INFO:tasks.workunit.client.0.smithi070.stdout: "key": { 2024-09-12T00:44:37.695 INFO:tasks.workunit.client.0.smithi070.stdout: "name": "_myobj_", 2024-09-12T00:44:37.695 INFO:tasks.workunit.client.0.smithi070.stdout: "instance": "inst", 2024-09-12T00:44:37.695 INFO:tasks.workunit.client.0.smithi070.stdout: "ns": "ns" 2024-09-12T00:44:37.695 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.695 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.695 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.695 INFO:tasks.workunit.client.0.smithi070.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-12T00:44:37.696 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] TestRGWObj.old_to_raw (1 ms) 2024-09-12T00:44:37.696 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 4 tests from TestRGWObj (2 ms total) 2024-09-12T00:44:37.696 INFO:tasks.workunit.client.0.smithi070.stdout: 2024-09-12T00:44:37.696 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment tear-down 2024-09-12T00:44:37.696 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] 4 tests from 1 test suite ran. (2 ms total) 2024-09-12T00:44:37.696 INFO:tasks.workunit.client.0.smithi070.stdout:[ PASSED ] 4 tests. 2024-09-12T00:44:37.696 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:44:37.696 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:44:37.711 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-12T00:44:37.712 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-12T00:44:37.712 DEBUG:teuthology.orchestra.run.smithi070:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-12T00:44:37.816 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:44:37.816 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:44:37.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.871+0000 7f533a9609c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:37.869 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.871+0000 7f533a9609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:37.869 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.871+0000 7f533a9609c0 20 realm 2024-09-12T00:44:37.869 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.871+0000 7f533a9609c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:37.870 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.871+0000 7f533a9609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:37.870 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.871+0000 7f533a9609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:44:37.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.871+0000 7f533a9609c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:37.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.871+0000 7f533a9609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:37.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.871+0000 7f533a9609c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:37.872 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.875+0000 7f533a9609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:37.872 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.875+0000 7f533a9609c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:37.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.875+0000 7f533a9609c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:44:37.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.875+0000 7f533a9609c0 20 searching for the correct realm 2024-09-12T00:44:37.892 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.895+0000 7f5338c67640 0 -- 172.21.15.70:0/4274057805 >> [v2:172.21.15.70:6808/276433067,v1:172.21.15.70:6809/276433067] conn(0x562c3b1d3c00 msgr2=0x562c3b1d60c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:44:37.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.911+0000 7f5338466640 0 -- 172.21.15.70:0/4274057805 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f53300c8410 msgr2=0x7f53300c8870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:37.914 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.915+0000 7f533a9609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:44:37.914 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.915+0000 7f533a9609c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:44:37.914 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.915+0000 7f533a9609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:44:37.914 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.915+0000 7f533a9609c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:44:37.915 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.915+0000 7f533a9609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:44:37.915 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.915+0000 7f533a9609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:44:37.915 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.915+0000 7f533a9609c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:37.915 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.915+0000 7f533a9609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:37.915 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.915+0000 7f533a9609c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:37.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.919+0000 7f533a9609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:37.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.919+0000 7f533a9609c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:37.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.919+0000 7f533a9609c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:44:37.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.919+0000 7f533a9609c0 20 zone default found 2024-09-12T00:44:37.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.919+0000 7f533a9609c0 4 Realm: () 2024-09-12T00:44:37.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.919+0000 7f533a9609c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:44:37.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.919+0000 7f533a9609c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:44:37.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.919+0000 7f533a9609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:44:37.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.919+0000 7f533a9609c0 20 zonegroup default 2024-09-12T00:44:37.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.919+0000 7f533a9609c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:37.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.919+0000 7f533a9609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:37.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.919+0000 7f533a9609c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:37.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.919+0000 7f533a9609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:37.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.919+0000 7f533a9609c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:37.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.919+0000 7f533a9609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:37.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.919+0000 7f533a9609c0 20 started sync module instance, tier type = 2024-09-12T00:44:37.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.919+0000 7f533a9609c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:44:37.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.935+0000 7f533a9609c0 20 add_watcher() i=0 2024-09-12T00:44:37.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.935+0000 7f533a9609c0 20 add_watcher() i=1 2024-09-12T00:44:37.934 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.935+0000 7f533a9609c0 20 add_watcher() i=2 2024-09-12T00:44:37.934 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.935+0000 7f533a9609c0 20 add_watcher() i=3 2024-09-12T00:44:37.934 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.935+0000 7f533a9609c0 20 add_watcher() i=4 2024-09-12T00:44:37.934 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.935+0000 7f533a9609c0 20 add_watcher() i=5 2024-09-12T00:44:37.934 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.935+0000 7f533a9609c0 20 add_watcher() i=6 2024-09-12T00:44:37.935 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.935+0000 7f533a9609c0 20 add_watcher() i=7 2024-09-12T00:44:37.935 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.935+0000 7f533a9609c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:44:37.938 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.939+0000 7f51eefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:37.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.939+0000 7f533a9609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:44:37.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.939+0000 7f533a9609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:44:37.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.939+0000 7f533a9609c0 5 note: GC not initialized 2024-09-12T00:44:37.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.939+0000 7f51edfdb640 20 reqs_thread_entry: start 2024-09-12T00:44:37.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.939+0000 7f533a9609c0 20 init_complete bucket index max shards: 1 2024-09-12T00:44:37.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.939+0000 7f533a9609c0 20 Filter name: none 2024-09-12T00:44:37.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.939+0000 7f515f7fe640 20 reqs_thread_entry: start 2024-09-12T00:44:37.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.939+0000 7f533a9609c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-12T00:44:37.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.939+0000 7f533a9609c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:37.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.939+0000 7f533a9609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:37.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.939+0000 7f533a9609c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-12T00:44:37.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.939+0000 7f533a9609c0 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:44:37.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.939+0000 7f533a9609c0 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-12T00:44:37.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.939+0000 7f533a9609c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:37.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.939+0000 7f533a9609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:37.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.939+0000 7f533a9609c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-12T00:44:37.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.939+0000 7f533a9609c0 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:44:37.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.939+0000 7f533a9609c0 10 cache get: name=default.rgw.meta+users.keys+AzWQP+li2/FrnQ9ZWgH6sm8n0R8= : miss 2024-09-12T00:44:37.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.939+0000 7f533a9609c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:37.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.943+0000 7f533a9609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:37.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.943+0000 7f533a9609c0 10 cache put: name=default.rgw.meta+users.keys+AzWQP+li2/FrnQ9ZWgH6sm8n0R8= info.flags=0x0 2024-09-12T00:44:37.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.943+0000 7f533a9609c0 10 adding default.rgw.meta+users.keys+AzWQP+li2/FrnQ9ZWgH6sm8n0R8= to cache LRU end 2024-09-12T00:44:37.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.943+0000 7f533a9609c0 10 cache get: name=default.rgw.meta+users.keys+AzWQP+li2/FrnQ9ZWgH6sm8n0R8= : hit (negative entry) 2024-09-12T00:44:37.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.943+0000 7f533a9609c0 10 cache get: name=default.rgw.meta+users.keys+AzWQP+li2/FrnQ9ZWgH6sm8n0R8= : hit (negative entry) 2024-09-12T00:44:37.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.943+0000 7f533a9609c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T00:44:37.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.943+0000 7f533a9609c0 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:44:37.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.943+0000 7f533a9609c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-12T00:44:37.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.947+0000 7f520f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791299 cookie 94747970337136 notifier 5550 bl.length()=697 2024-09-12T00:44:37.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.947+0000 7f520f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T00:44:37.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.947+0000 7f520f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:44:37.946 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.947+0000 7f533a9609c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T00:44:37.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.947+0000 7f533a9609c0 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:44:37.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.947+0000 7f533a9609c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-12T00:44:37.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.951+0000 7f520f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791296 cookie 94747970330704 notifier 5550 bl.length()=194 2024-09-12T00:44:37.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.951+0000 7f520f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T00:44:37.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.951+0000 7f520f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:44:37.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.955+0000 7f533a9609c0 10 cache put: name=default.rgw.meta+users.keys+AzWQP+li2/FrnQ9ZWgH6sm8n0R8= info.flags=0x7 2024-09-12T00:44:37.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.955+0000 7f533a9609c0 10 moving default.rgw.meta+users.keys+AzWQP+li2/FrnQ9ZWgH6sm8n0R8= to cache LRU end 2024-09-12T00:44:37.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.955+0000 7f533a9609c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:AzWQP+li2/FrnQ9ZWgH6sm8n0R8=, ofs0, ns] 2024-09-12T00:44:37.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.955+0000 7f520f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791301 cookie 94747970334496 notifier 5550 bl.length()=203 2024-09-12T00:44:37.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.955+0000 7f520f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+AzWQP+li2/FrnQ9ZWgH6sm8n0R8= info.flags=0x7 2024-09-12T00:44:37.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.955+0000 7f520f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+AzWQP+li2/FrnQ9ZWgH6sm8n0R8= to cache LRU end 2024-09-12T00:44:37.952 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:44:37.952 INFO:tasks.workunit.client.0.smithi070.stdout: "user_id": "ceph-test-librgw-file", 2024-09-12T00:44:37.952 INFO:tasks.workunit.client.0.smithi070.stdout: "display_name": "librgw test user", 2024-09-12T00:44:37.952 INFO:tasks.workunit.client.0.smithi070.stdout: "email": "librgw@example.com", 2024-09-12T00:44:37.953 INFO:tasks.workunit.client.0.smithi070.stdout: "suspended": 0, 2024-09-12T00:44:37.953 INFO:tasks.workunit.client.0.smithi070.stdout: "max_buckets": 1000, 2024-09-12T00:44:37.953 INFO:tasks.workunit.client.0.smithi070.stdout: "subusers": [], 2024-09-12T00:44:37.953 INFO:tasks.workunit.client.0.smithi070.stdout: "keys": [ 2024-09-12T00:44:37.953 INFO:tasks.workunit.client.0.smithi070.stdout: { 2024-09-12T00:44:37.953 INFO:tasks.workunit.client.0.smithi070.stdout: "user": "ceph-test-librgw-file", 2024-09-12T00:44:37.953 INFO:tasks.workunit.client.0.smithi070.stdout: "access_key": "AzWQP+li2/FrnQ9ZWgH6sm8n0R8=", 2024-09-12T00:44:37.953 INFO:tasks.workunit.client.0.smithi070.stdout: "secret_key": "vbVI0uCVmd8/DeF8t0sMFMM1WsVniBR8ur90PuOQt75LRm5Nk0gOxQ==", 2024-09-12T00:44:37.953 INFO:tasks.workunit.client.0.smithi070.stdout: "active": true, 2024-09-12T00:44:37.953 INFO:tasks.workunit.client.0.smithi070.stdout: "create_date": "2024-09-12T00:44:37.947360Z" 2024-09-12T00:44:37.953 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:44:37.953 INFO:tasks.workunit.client.0.smithi070.stdout: ], 2024-09-12T00:44:37.953 INFO:tasks.workunit.client.0.smithi070.stdout: "swift_keys": [], 2024-09-12T00:44:37.954 INFO:tasks.workunit.client.0.smithi070.stdout: "caps": [], 2024-09-12T00:44:37.954 INFO:tasks.workunit.client.0.smithi070.stdout: "op_mask": "read, write, delete", 2024-09-12T00:44:37.954 INFO:tasks.workunit.client.0.smithi070.stdout: "default_placement": "", 2024-09-12T00:44:37.954 INFO:tasks.workunit.client.0.smithi070.stdout: "default_storage_class": "", 2024-09-12T00:44:37.954 INFO:tasks.workunit.client.0.smithi070.stdout: "placement_tags": [], 2024-09-12T00:44:37.954 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_quota": { 2024-09-12T00:44:37.954 INFO:tasks.workunit.client.0.smithi070.stdout: "enabled": false, 2024-09-12T00:44:37.954 INFO:tasks.workunit.client.0.smithi070.stdout: "check_on_raw": false, 2024-09-12T00:44:37.954 INFO:tasks.workunit.client.0.smithi070.stdout: "max_size": -1, 2024-09-12T00:44:37.954 INFO:tasks.workunit.client.0.smithi070.stdout: "max_size_kb": 0, 2024-09-12T00:44:37.955 INFO:tasks.workunit.client.0.smithi070.stdout: "max_objects": -1 2024-09-12T00:44:37.955 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.955 INFO:tasks.workunit.client.0.smithi070.stdout: "user_quota": { 2024-09-12T00:44:37.955 INFO:tasks.workunit.client.0.smithi070.stdout: "enabled": false, 2024-09-12T00:44:37.955 INFO:tasks.workunit.client.0.smithi070.stdout: "check_on_raw": false, 2024-09-12T00:44:37.955 INFO:tasks.workunit.client.0.smithi070.stdout: "max_size": -1, 2024-09-12T00:44:37.955 INFO:tasks.workunit.client.0.smithi070.stdout: "max_size_kb": 0, 2024-09-12T00:44:37.955 INFO:tasks.workunit.client.0.smithi070.stdout: "max_objects": -1 2024-09-12T00:44:37.955 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:44:37.955 INFO:tasks.workunit.client.0.smithi070.stdout: "temp_url_keys": [], 2024-09-12T00:44:37.955 INFO:tasks.workunit.client.0.smithi070.stdout: "type": "rgw", 2024-09-12T00:44:37.955 INFO:tasks.workunit.client.0.smithi070.stdout: "mfa_ids": [], 2024-09-12T00:44:37.955 INFO:tasks.workunit.client.0.smithi070.stdout: "account_id": "", 2024-09-12T00:44:37.955 INFO:tasks.workunit.client.0.smithi070.stdout: "path": "/", 2024-09-12T00:44:37.956 INFO:tasks.workunit.client.0.smithi070.stdout: "create_date": "2024-09-12T00:44:37.947342Z", 2024-09-12T00:44:37.956 INFO:tasks.workunit.client.0.smithi070.stdout: "tags": [], 2024-09-12T00:44:37.956 INFO:tasks.workunit.client.0.smithi070.stdout: "group_ids": [] 2024-09-12T00:44:37.956 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:44:37.956 INFO:tasks.workunit.client.0.smithi070.stdout: 2024-09-12T00:44:37.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.955+0000 7f51eefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:37.958 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.959+0000 7f533a9609c0 20 remove_watcher() i=0 2024-09-12T00:44:37.958 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.959+0000 7f533a9609c0 2 removed watcher, disabling cache 2024-09-12T00:44:37.960 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.963+0000 7f533a9609c0 20 remove_watcher() i=1 2024-09-12T00:44:37.961 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.963+0000 7f533a9609c0 20 remove_watcher() i=2 2024-09-12T00:44:37.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.967+0000 7f533a9609c0 20 remove_watcher() i=3 2024-09-12T00:44:37.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.967+0000 7f533a9609c0 20 remove_watcher() i=4 2024-09-12T00:44:37.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.971+0000 7f533a9609c0 20 remove_watcher() i=5 2024-09-12T00:44:37.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.971+0000 7f533a9609c0 20 remove_watcher() i=6 2024-09-12T00:44:37.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:37.971+0000 7f533a9609c0 20 remove_watcher() i=7 2024-09-12T00:44:37.983 INFO:tasks.workunit.client.0.smithi070.stdout:phase 1.1 2024-09-12T00:44:38.001 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:44:38.001 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment set-up. 2024-09-12T00:44:38.001 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:44:38.002 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:44:38.018 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:44:38.018 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:44:38.429 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.INIT (427 ms) 2024-09-12T00:44:38.429 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:44:38.431 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MOUNT_NOROOT (3 ms) 2024-09-12T00:44:38.431 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:44:38.431 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:44:38.432 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:44:38.446 INFO:tasks.workunit.client.0.smithi070.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-12T00:44:38.453 INFO:tasks.workunit.client.0.smithi070.stdout:creating: nfsroot:foo/f1 2024-09-12T00:44:38.459 INFO:tasks.workunit.client.0.smithi070.stdout:creating: nfsroot:foo/f2 2024-09-12T00:44:38.462 INFO:tasks.workunit.client.0.smithi070.stdout:creating: nfsroot:foo/bar/f1 2024-09-12T00:44:38.467 INFO:tasks.workunit.client.0.smithi070.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-12T00:44:38.472 INFO:tasks.workunit.client.0.smithi070.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-12T00:44:38.477 INFO:tasks.workunit.client.0.smithi070.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-12T00:44:38.481 INFO:tasks.workunit.client.0.smithi070.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-12T00:44:38.485 INFO:tasks.workunit.client.0.smithi070.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-12T00:44:38.491 INFO:tasks.workunit.client.0.smithi070.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-12T00:44:38.496 INFO:tasks.workunit.client.0.smithi070.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-12T00:44:38.502 INFO:tasks.workunit.client.0.smithi070.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-12T00:44:38.508 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.SETUP_HIER1 (77 ms) 2024-09-12T00:44:38.508 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:44:38.758 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.SETUP_DIRS1 (250 ms) 2024-09-12T00:44:38.759 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:44:38.759 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:44:38.759 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:44:38.801 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (42 ms) 2024-09-12T00:44:38.801 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:44:38.898 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (97 ms) 2024-09-12T00:44:38.898 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:44:38.898 INFO:tasks.workunit.client.0.smithi070.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-12T00:44:38.915 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (17 ms) 2024-09-12T00:44:38.915 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:44:38.915 INFO:tasks.workunit.client.0.smithi070.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-12T00:44:38.931 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (17 ms) 2024-09-12T00:44:38.932 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:44:38.932 INFO:tasks.workunit.client.0.smithi070.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T00:44:38.932 INFO:tasks.workunit.client.0.smithi070.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:44:38.932 INFO:tasks.workunit.client.0.smithi070.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:44:38.932 INFO:tasks.workunit.client.0.smithi070.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:44:38.932 INFO:tasks.workunit.client.0.smithi070.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:44:38.932 INFO:tasks.workunit.client.0.smithi070.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T00:44:38.932 INFO:tasks.workunit.client.0.smithi070.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:44:38.933 INFO:tasks.workunit.client.0.smithi070.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:44:38.933 INFO:tasks.workunit.client.0.smithi070.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:44:38.933 INFO:tasks.workunit.client.0.smithi070.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:44:38.933 INFO:tasks.workunit.client.0.smithi070.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T00:44:38.933 INFO:tasks.workunit.client.0.smithi070.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:44:38.933 INFO:tasks.workunit.client.0.smithi070.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:44:38.933 INFO:tasks.workunit.client.0.smithi070.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:44:38.933 INFO:tasks.workunit.client.0.smithi070.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:44:38.933 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:44:38.933 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:44:38.934 INFO:tasks.workunit.client.0.smithi070.stdout:read back objects in /bdirs1/dir_0 2024-09-12T00:44:38.934 INFO:tasks.workunit.client.0.smithi070.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T00:44:38.935 INFO:tasks.workunit.client.0.smithi070.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:44:38.935 INFO:tasks.workunit.client.0.smithi070.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T00:44:38.938 INFO:tasks.workunit.client.0.smithi070.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:44:38.938 INFO:tasks.workunit.client.0.smithi070.stdout:read back objects in /bdirs1/dir_1 2024-09-12T00:44:38.938 INFO:tasks.workunit.client.0.smithi070.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T00:44:38.941 INFO:tasks.workunit.client.0.smithi070.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:44:38.941 INFO:tasks.workunit.client.0.smithi070.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T00:44:38.943 INFO:tasks.workunit.client.0.smithi070.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:44:38.943 INFO:tasks.workunit.client.0.smithi070.stdout:read back objects in /bdirs1/dir_2 2024-09-12T00:44:38.943 INFO:tasks.workunit.client.0.smithi070.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T00:44:38.946 INFO:tasks.workunit.client.0.smithi070.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:44:38.947 INFO:tasks.workunit.client.0.smithi070.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T00:44:38.949 INFO:tasks.workunit.client.0.smithi070.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:44:38.949 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.READ_DIRS1 (18 ms) 2024-09-12T00:44:38.949 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:44:39.179 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.READF_SETUP1 (230 ms) 2024-09-12T00:44:39.180 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:44:39.180 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:44:39.180 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:44:39.180 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:44:39.180 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:44:39.180 INFO:tasks.workunit.client.0.smithi070.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:44:39.180 INFO:tasks.workunit.client.0.smithi070.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:44:39.180 INFO:tasks.workunit.client.0.smithi070.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:44:39.180 INFO:tasks.workunit.client.0.smithi070.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:44:39.180 INFO:tasks.workunit.client.0.smithi070.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:44:39.180 INFO:tasks.workunit.client.0.smithi070.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:44:39.180 INFO:tasks.workunit.client.0.smithi070.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:44:39.181 INFO:tasks.workunit.client.0.smithi070.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:44:39.181 INFO:tasks.workunit.client.0.smithi070.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:44:39.181 INFO:tasks.workunit.client.0.smithi070.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:44:39.181 INFO:tasks.workunit.client.0.smithi070.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:44:39.181 INFO:tasks.workunit.client.0.smithi070.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:44:39.181 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:44:39.181 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:44:39.194 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T00:44:39.194 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T00:44:39.199 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T00:44:39.201 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T00:44:39.208 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:44:39.209 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:44:39.210 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T00:44:39.212 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T00:44:39.213 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:44:39.214 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:44:39.215 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T00:44:39.219 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T00:44:39.219 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T00:44:39.219 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T00:44:39.219 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo (foo): DIR 2024-09-12T00:44:39.219 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot (nfsroot): DIR 2024-09-12T00:44:39.220 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.HIER1 (39 ms) 2024-09-12T00:44:39.220 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:44:39.220 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:44:39.220 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:44:39.220 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:44:39.220 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:44:39.220 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:44:39.220 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:44:39.220 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:44:39.220 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:44:39.220 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:44:39.220 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:44:39.220 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:44:39.221 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:44:39.221 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:39.223+0000 7ff0a0cc8a80 -1 shutting down 2024-09-12T00:44:39.222 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:44:39.223+0000 7fef7aa1a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57205, si_uid : 1000, si_addr0x3e80000df75, si_status0 2024-09-12T00:45:08.441 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.SHUTDOWN (29223 ms) 2024-09-12T00:45:08.442 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 24 tests from LibRGW (30440 ms total) 2024-09-12T00:45:08.442 INFO:tasks.workunit.client.0.smithi070.stdout: 2024-09-12T00:45:08.442 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment tear-down 2024-09-12T00:45:08.442 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] 24 tests from 1 test suite ran. (30440 ms total) 2024-09-12T00:45:08.442 INFO:tasks.workunit.client.0.smithi070.stdout:[ PASSED ] 24 tests. 2024-09-12T00:45:08.453 INFO:tasks.workunit.client.0.smithi070.stdout:phase 1.2 2024-09-12T00:45:08.475 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:45:08.476 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment set-up. 2024-09-12T00:45:08.476 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:45:08.476 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:45:08.485 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:45:08.486 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:45:09.001 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.INIT (526 ms) 2024-09-12T00:45:09.001 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:45:09.003 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T00:45:09.003 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:45:09.003 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:45:09.003 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:45:09.004 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-12T00:45:09.004 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:45:09.004 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-12T00:45:09.004 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:45:09.004 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:45:09.004 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:45:09.004 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T00:45:09.004 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:45:09.004 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T00:45:09.004 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:45:09.004 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T00:45:09.004 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:45:09.004 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T00:45:09.005 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:45:09.005 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:45:09.005 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:45:09.005 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-12T00:45:09.005 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:45:09.005 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T00:45:09.005 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:45:09.005 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:45:09.005 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:45:09.005 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:45:09.005 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:45:09.005 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:45:09.005 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:45:09.005 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-12T00:45:09.006 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:45:09.006 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:45:09.006 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:45:09.006 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:45:09.006 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:45:09.006 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:45:09.006 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:45:09.006 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:45:09.006 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:45:09.006 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:45:09.006 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:45:09.006 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:45:09.006 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:45:09.007 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:45:09.006+0000 7f7a6ecc0a80 -1 shutting down 2024-09-12T00:45:09.007 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:45:09.006+0000 7f7948a12640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57854, si_uid : 1000, si_addr0x3e80000e1fe, si_status0 2024-09-12T00:45:39.188 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.SHUTDOWN (30185 ms) 2024-09-12T00:45:39.188 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 24 tests from LibRGW (30713 ms total) 2024-09-12T00:45:39.188 INFO:tasks.workunit.client.0.smithi070.stdout: 2024-09-12T00:45:39.188 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment tear-down 2024-09-12T00:45:39.188 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] 24 tests from 1 test suite ran. (30713 ms total) 2024-09-12T00:45:39.188 INFO:tasks.workunit.client.0.smithi070.stdout:[ PASSED ] 24 tests. 2024-09-12T00:45:39.202 INFO:tasks.workunit.client.0.smithi070.stdout:phase 1.3 2024-09-12T00:45:39.226 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:45:39.226 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment set-up. 2024-09-12T00:45:39.226 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:45:39.226 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:45:39.238 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:45:39.238 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:45:39.998 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.INIT (772 ms) 2024-09-12T00:45:39.998 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:45:39.999 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T00:45:40.000 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:45:40.000 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:45:40.000 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:45:40.007 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.SETUP_HIER1 (8 ms) 2024-09-12T00:45:40.007 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:45:40.124 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.SETUP_DIRS1 (116 ms) 2024-09-12T00:45:40.124 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:45:40.125 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:45:40.125 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:45:40.125 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T00:45:40.125 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:45:40.125 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T00:45:40.125 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:45:40.125 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T00:45:40.125 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:45:40.125 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T00:45:40.125 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:45:40.125 INFO:tasks.workunit.client.0.smithi070.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T00:45:40.125 INFO:tasks.workunit.client.0.smithi070.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:45:40.126 INFO:tasks.workunit.client.0.smithi070.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:45:40.126 INFO:tasks.workunit.client.0.smithi070.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:45:40.126 INFO:tasks.workunit.client.0.smithi070.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:45:40.126 INFO:tasks.workunit.client.0.smithi070.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T00:45:40.126 INFO:tasks.workunit.client.0.smithi070.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:45:40.126 INFO:tasks.workunit.client.0.smithi070.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:45:40.126 INFO:tasks.workunit.client.0.smithi070.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:45:40.126 INFO:tasks.workunit.client.0.smithi070.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:45:40.126 INFO:tasks.workunit.client.0.smithi070.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T00:45:40.126 INFO:tasks.workunit.client.0.smithi070.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:45:40.126 INFO:tasks.workunit.client.0.smithi070.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:45:40.126 INFO:tasks.workunit.client.0.smithi070.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:45:40.127 INFO:tasks.workunit.client.0.smithi070.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:45:40.127 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:45:40.127 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:45:40.127 INFO:tasks.workunit.client.0.smithi070.stdout:read back objects in /bdirs1/dir_0 2024-09-12T00:45:40.127 INFO:tasks.workunit.client.0.smithi070.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T00:45:40.127 INFO:tasks.workunit.client.0.smithi070.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:45:40.127 INFO:tasks.workunit.client.0.smithi070.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T00:45:40.129 INFO:tasks.workunit.client.0.smithi070.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:45:40.129 INFO:tasks.workunit.client.0.smithi070.stdout:read back objects in /bdirs1/dir_1 2024-09-12T00:45:40.129 INFO:tasks.workunit.client.0.smithi070.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T00:45:40.132 INFO:tasks.workunit.client.0.smithi070.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:45:40.132 INFO:tasks.workunit.client.0.smithi070.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T00:45:40.135 INFO:tasks.workunit.client.0.smithi070.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:45:40.135 INFO:tasks.workunit.client.0.smithi070.stdout:read back objects in /bdirs1/dir_2 2024-09-12T00:45:40.135 INFO:tasks.workunit.client.0.smithi070.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T00:45:40.137 INFO:tasks.workunit.client.0.smithi070.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:45:40.138 INFO:tasks.workunit.client.0.smithi070.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T00:45:40.140 INFO:tasks.workunit.client.0.smithi070.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:45:40.140 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.READ_DIRS1 (16 ms) 2024-09-12T00:45:40.140 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:45:40.140 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T00:45:40.140 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:45:40.140 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:45:40.140 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:45:40.140 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:45:40.140 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:45:40.140 INFO:tasks.workunit.client.0.smithi070.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:45:40.140 INFO:tasks.workunit.client.0.smithi070.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:45:40.140 INFO:tasks.workunit.client.0.smithi070.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:45:40.140 INFO:tasks.workunit.client.0.smithi070.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:45:40.141 INFO:tasks.workunit.client.0.smithi070.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:45:40.141 INFO:tasks.workunit.client.0.smithi070.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:45:40.141 INFO:tasks.workunit.client.0.smithi070.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:45:40.141 INFO:tasks.workunit.client.0.smithi070.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:45:40.141 INFO:tasks.workunit.client.0.smithi070.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:45:40.141 INFO:tasks.workunit.client.0.smithi070.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:45:40.141 INFO:tasks.workunit.client.0.smithi070.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:45:40.141 INFO:tasks.workunit.client.0.smithi070.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:45:40.141 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:45:40.141 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:45:40.155 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T00:45:40.156 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T00:45:40.163 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T00:45:40.167 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T00:45:40.174 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:45:40.175 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:45:40.176 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T00:45:40.178 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T00:45:40.179 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:45:40.180 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:45:40.181 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T00:45:40.185 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T00:45:40.185 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T00:45:40.186 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T00:45:40.186 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot/foo (foo): DIR 2024-09-12T00:45:40.186 INFO:tasks.workunit.client.0.smithi070.stdout:/nfsroot (nfsroot): DIR 2024-09-12T00:45:40.186 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.HIER1 (46 ms) 2024-09-12T00:45:40.186 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:45:40.186 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:45:40.186 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:45:40.186 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:45:40.186 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:45:40.186 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:45:40.186 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:45:40.186 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:45:40.186 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:45:40.186 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:45:40.186 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:45:40.187 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:45:40.187 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:45:40.187 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:45:40.190+0000 7f831bcbfa80 -1 shutting down 2024-09-12T00:45:40.188 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:45:40.194+0000 7f81f5a11640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58499, si_uid : 1000, si_addr0x3e80000e483, si_status0 2024-09-12T00:46:10.098 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.SHUTDOWN (29912 ms) 2024-09-12T00:46:10.098 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 24 tests from LibRGW (30872 ms total) 2024-09-12T00:46:10.098 INFO:tasks.workunit.client.0.smithi070.stdout: 2024-09-12T00:46:10.098 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment tear-down 2024-09-12T00:46:10.098 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] 24 tests from 1 test suite ran. (30872 ms total) 2024-09-12T00:46:10.098 INFO:tasks.workunit.client.0.smithi070.stdout:[ PASSED ] 24 tests. 2024-09-12T00:46:10.111 INFO:tasks.workunit.client.0.smithi070.stdout:phase 2.1 2024-09-12T00:46:10.134 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:46:10.135 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment set-up. 2024-09-12T00:46:10.135 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 9 tests from LibRGW 2024-09-12T00:46:10.135 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:46:10.146 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:10.146 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:10.478 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.INIT (344 ms) 2024-09-12T00:46:10.479 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:46:10.480 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:46:10.480 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:46:10.495 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.CREATE_BUCKET (16 ms) 2024-09-12T00:46:10.496 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:46:10.496 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:46:10.496 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T00:46:10.508 INFO:tasks.workunit.client.0.smithi070.stdout:created: sorrydave0 2024-09-12T00:46:10.524 INFO:tasks.workunit.client.0.smithi070.stdout:created: sorrydave1 2024-09-12T00:46:10.539 INFO:tasks.workunit.client.0.smithi070.stdout:created: sorrydave2 2024-09-12T00:46:10.554 INFO:tasks.workunit.client.0.smithi070.stdout:created: sorrydave3 2024-09-12T00:46:10.569 INFO:tasks.workunit.client.0.smithi070.stdout:created: sorrydave4 2024-09-12T00:46:10.582 INFO:tasks.workunit.client.0.smithi070.stdout:created: sorrydave5 2024-09-12T00:46:10.599 INFO:tasks.workunit.client.0.smithi070.stdout:created: sorrydave6 2024-09-12T00:46:10.615 INFO:tasks.workunit.client.0.smithi070.stdout:created: sorrydave7 2024-09-12T00:46:10.633 INFO:tasks.workunit.client.0.smithi070.stdout:created: sorrydave8 2024-09-12T00:46:10.653 INFO:tasks.workunit.client.0.smithi070.stdout:created: sorrydave9 2024-09-12T00:46:10.653 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (157 ms) 2024-09-12T00:46:10.653 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T00:46:11.047 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (394 ms) 2024-09-12T00:46:11.047 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:46:11.047 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:46:11.047 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:46:11.047 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:46:11.047 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:46:11.048 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:46:11.053+0000 7fcc884dca80 -1 shutting down 2024-09-12T00:46:11.050 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:46:11.057+0000 7fcb6222e640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59145, si_uid : 1000, si_addr0x3e80000e709, si_status0 2024-09-12T00:46:40.834 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.SHUTDOWN (29787 ms) 2024-09-12T00:46:40.834 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 9 tests from LibRGW (30700 ms total) 2024-09-12T00:46:40.834 INFO:tasks.workunit.client.0.smithi070.stdout: 2024-09-12T00:46:40.834 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment tear-down 2024-09-12T00:46:40.834 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] 9 tests from 1 test suite ran. (30700 ms total) 2024-09-12T00:46:40.834 INFO:tasks.workunit.client.0.smithi070.stdout:[ PASSED ] 9 tests. 2024-09-12T00:46:40.848 INFO:tasks.workunit.client.0.smithi070.stdout:phase 2.2 2024-09-12T00:46:40.870 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:46:40.871 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment set-up. 2024-09-12T00:46:40.871 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 9 tests from LibRGW 2024-09-12T00:46:40.871 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:46:40.882 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:40.882 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:41.223 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.INIT (352 ms) 2024-09-12T00:46:41.223 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:46:41.225 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:46:41.225 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:46:41.225 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:46:41.225 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:46:41.254 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.DELETE_BUCKET (30 ms) 2024-09-12T00:46:41.255 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T00:46:41.266 INFO:tasks.workunit.client.0.smithi070.stdout:created: sorrydave0 2024-09-12T00:46:41.280 INFO:tasks.workunit.client.0.smithi070.stdout:created: sorrydave1 2024-09-12T00:46:41.295 INFO:tasks.workunit.client.0.smithi070.stdout:created: sorrydave2 2024-09-12T00:46:41.307 INFO:tasks.workunit.client.0.smithi070.stdout:created: sorrydave3 2024-09-12T00:46:41.324 INFO:tasks.workunit.client.0.smithi070.stdout:created: sorrydave4 2024-09-12T00:46:41.338 INFO:tasks.workunit.client.0.smithi070.stdout:created: sorrydave5 2024-09-12T00:46:41.355 INFO:tasks.workunit.client.0.smithi070.stdout:created: sorrydave6 2024-09-12T00:46:41.372 INFO:tasks.workunit.client.0.smithi070.stdout:created: sorrydave7 2024-09-12T00:46:41.391 INFO:tasks.workunit.client.0.smithi070.stdout:created: sorrydave8 2024-09-12T00:46:41.409 INFO:tasks.workunit.client.0.smithi070.stdout:created: sorrydave9 2024-09-12T00:46:41.409 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (155 ms) 2024-09-12T00:46:41.409 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T00:46:41.813 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (403 ms) 2024-09-12T00:46:41.813 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:46:41.813 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:46:41.813 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:46:41.813 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:46:41.813 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:46:41.813 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:46:41.817+0000 7f1fcddf2a80 -1 shutting down 2024-09-12T00:46:41.815 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:46:41.821+0000 7f1ea7b44640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59790, si_uid : 1000, si_addr0x3e80000e98e, si_status0 2024-09-12T00:47:11.413 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.SHUTDOWN (29601 ms) 2024-09-12T00:47:11.414 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 9 tests from LibRGW (30543 ms total) 2024-09-12T00:47:11.414 INFO:tasks.workunit.client.0.smithi070.stdout: 2024-09-12T00:47:11.414 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment tear-down 2024-09-12T00:47:11.414 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] 9 tests from 1 test suite ran. (30543 ms total) 2024-09-12T00:47:11.414 INFO:tasks.workunit.client.0.smithi070.stdout:[ PASSED ] 9 tests. 2024-09-12T00:47:11.427 INFO:tasks.workunit.client.0.smithi070.stdout:phase 3.1 2024-09-12T00:47:11.768 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T00:47:11.768 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment set-up. 2024-09-12T00:47:11.768 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 13 tests from LibRGW 2024-09-12T00:47:11.768 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:47:11.778 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:11.778 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:12.082 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.INIT (315 ms) 2024-09-12T00:47:12.083 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:47:12.085 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:47:12.085 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:47:12.098 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.CREATE_BUCKET (13 ms) 2024-09-12T00:47:12.098 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:47:12.103 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-12T00:47:12.103 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:47:12.104 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (1 ms) 2024-09-12T00:47:12.104 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T00:47:12.172 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.LARGE1 (68 ms) 2024-09-12T00:47:12.172 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T00:47:12.225 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.LARGE2 (52 ms) 2024-09-12T00:47:12.225 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:47:12.225 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:47:12.225 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:47:12.225 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T00:47:12.225 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:47:12.225 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:47:12.225 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:47:12.225 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.CLEANUP (1 ms) 2024-09-12T00:47:12.225 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:47:12.226 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:47:12.226 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:47:12.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:47:12.233+0000 7f403b6a4a80 -1 shutting down 2024-09-12T00:47:12.228 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:47:12.237+0000 7f3f153f6640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60435, si_uid : 1000, si_addr0x3e80000ec13, si_status0 2024-09-12T00:47:42.445 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.SHUTDOWN (30220 ms) 2024-09-12T00:47:42.446 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 13 tests from LibRGW (30677 ms total) 2024-09-12T00:47:42.446 INFO:tasks.workunit.client.0.smithi070.stdout: 2024-09-12T00:47:42.446 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment tear-down 2024-09-12T00:47:42.446 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] 13 tests from 1 test suite ran. (30677 ms total) 2024-09-12T00:47:42.446 INFO:tasks.workunit.client.0.smithi070.stdout:[ PASSED ] 13 tests. 2024-09-12T00:47:42.458 INFO:tasks.workunit.client.0.smithi070.stdout:phase 3.2 2024-09-12T00:47:42.800 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T00:47:42.800 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment set-up. 2024-09-12T00:47:42.800 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 13 tests from LibRGW 2024-09-12T00:47:42.800 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:47:42.808 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:42.809 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:43.344 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.INIT (545 ms) 2024-09-12T00:47:43.345 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:47:43.346 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:47:43.346 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:47:43.346 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:47:43.346 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:47:43.353 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-12T00:47:43.353 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:47:43.357 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (5 ms) 2024-09-12T00:47:43.358 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T00:47:43.444 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.LARGE1 (87 ms) 2024-09-12T00:47:43.445 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T00:47:43.445 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-12T00:47:43.445 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:47:43.445 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:47:43.445 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:47:43.454 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.DELETE_OBJECT (10 ms) 2024-09-12T00:47:43.454 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:47:43.486 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.DELETE_BUCKET (31 ms) 2024-09-12T00:47:43.486 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:47:43.486 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:47:43.486 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:47:43.486 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:47:43.486 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:47:43.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:47:43.492+0000 7fc95dd55a80 -1 shutting down 2024-09-12T00:47:43.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:47:43.496+0000 7fc837aa7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61080, si_uid : 1000, si_addr0x3e80000ee98, si_status0 2024-09-12T00:48:13.584 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.SHUTDOWN (30098 ms) 2024-09-12T00:48:13.584 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 13 tests from LibRGW (30784 ms total) 2024-09-12T00:48:13.584 INFO:tasks.workunit.client.0.smithi070.stdout: 2024-09-12T00:48:13.584 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment tear-down 2024-09-12T00:48:13.584 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] 13 tests from 1 test suite ran. (30784 ms total) 2024-09-12T00:48:13.584 INFO:tasks.workunit.client.0.smithi070.stdout:[ PASSED ] 13 tests. 2024-09-12T00:48:13.602 INFO:tasks.workunit.client.0.smithi070.stdout:phase 4.1 2024-09-12T00:48:13.625 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:48:13.625 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment set-up. 2024-09-12T00:48:13.625 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 11 tests from LibRGW 2024-09-12T00:48:13.625 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T00:48:13.625 INFO:tasks.workunit.client.0.smithi070.stdout:read i1: 64001 2024-09-12T00:48:13.625 INFO:tasks.workunit.client.0.smithi070.stdout:read s1: blunderbuss 2024-09-12T00:48:13.625 INFO:tasks.workunit.client.0.smithi070.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T00:48:13.625 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:48:13.638 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:13.638 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:13.948 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.INIT (323 ms) 2024-09-12T00:48:13.949 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:48:13.950 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:48:13.951 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:48:13.976 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (25 ms) 2024-09-12T00:48:13.976 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:48:15.254 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_0 2024-09-12T00:48:15.254 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_1 2024-09-12T00:48:15.254 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_2 2024-09-12T00:48:15.254 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_3 2024-09-12T00:48:15.254 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_4 2024-09-12T00:48:15.254 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_5 2024-09-12T00:48:15.254 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_6 2024-09-12T00:48:15.254 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_7 2024-09-12T00:48:15.254 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_8 2024-09-12T00:48:15.255 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_9 2024-09-12T00:48:15.255 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_10 2024-09-12T00:48:15.255 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_11 2024-09-12T00:48:15.255 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_12 2024-09-12T00:48:15.255 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_13 2024-09-12T00:48:15.255 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_14 2024-09-12T00:48:15.255 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_15 2024-09-12T00:48:15.255 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_16 2024-09-12T00:48:15.255 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_17 2024-09-12T00:48:15.255 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_18 2024-09-12T00:48:15.255 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_19 2024-09-12T00:48:15.255 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_20 2024-09-12T00:48:15.255 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_21 2024-09-12T00:48:15.255 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_22 2024-09-12T00:48:15.255 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_23 2024-09-12T00:48:15.256 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_24 2024-09-12T00:48:15.256 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_25 2024-09-12T00:48:15.256 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_26 2024-09-12T00:48:15.256 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_27 2024-09-12T00:48:15.256 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_28 2024-09-12T00:48:15.256 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_29 2024-09-12T00:48:15.256 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_30 2024-09-12T00:48:15.256 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_31 2024-09-12T00:48:15.256 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_32 2024-09-12T00:48:15.256 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_33 2024-09-12T00:48:15.256 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_34 2024-09-12T00:48:15.256 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_35 2024-09-12T00:48:15.256 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_36 2024-09-12T00:48:15.256 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_37 2024-09-12T00:48:15.257 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_38 2024-09-12T00:48:15.257 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_39 2024-09-12T00:48:15.257 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_40 2024-09-12T00:48:15.257 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_41 2024-09-12T00:48:15.257 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_42 2024-09-12T00:48:15.257 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_43 2024-09-12T00:48:15.257 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_44 2024-09-12T00:48:15.257 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_45 2024-09-12T00:48:15.257 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_46 2024-09-12T00:48:15.257 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_47 2024-09-12T00:48:15.257 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_48 2024-09-12T00:48:15.257 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_49 2024-09-12T00:48:15.257 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_50 2024-09-12T00:48:15.257 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_51 2024-09-12T00:48:15.257 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_52 2024-09-12T00:48:15.258 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_53 2024-09-12T00:48:15.258 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_54 2024-09-12T00:48:15.258 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_55 2024-09-12T00:48:15.258 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_56 2024-09-12T00:48:15.258 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_57 2024-09-12T00:48:15.258 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_58 2024-09-12T00:48:15.258 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_59 2024-09-12T00:48:15.258 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_60 2024-09-12T00:48:15.258 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_61 2024-09-12T00:48:15.258 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_62 2024-09-12T00:48:15.258 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_63 2024-09-12T00:48:15.258 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_64 2024-09-12T00:48:15.258 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_65 2024-09-12T00:48:15.258 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_66 2024-09-12T00:48:15.259 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_67 2024-09-12T00:48:15.259 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_68 2024-09-12T00:48:15.259 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_69 2024-09-12T00:48:15.259 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_70 2024-09-12T00:48:15.259 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_71 2024-09-12T00:48:15.259 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_72 2024-09-12T00:48:15.259 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_73 2024-09-12T00:48:15.259 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_74 2024-09-12T00:48:15.259 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_75 2024-09-12T00:48:15.259 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_76 2024-09-12T00:48:15.259 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_77 2024-09-12T00:48:15.259 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_78 2024-09-12T00:48:15.259 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_79 2024-09-12T00:48:15.260 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_80 2024-09-12T00:48:15.260 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_81 2024-09-12T00:48:15.260 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_82 2024-09-12T00:48:15.260 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_83 2024-09-12T00:48:15.260 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_84 2024-09-12T00:48:15.260 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_85 2024-09-12T00:48:15.260 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_86 2024-09-12T00:48:15.260 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_87 2024-09-12T00:48:15.260 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_88 2024-09-12T00:48:15.260 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_89 2024-09-12T00:48:15.260 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_90 2024-09-12T00:48:15.260 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_91 2024-09-12T00:48:15.260 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_92 2024-09-12T00:48:15.260 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_93 2024-09-12T00:48:15.261 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_94 2024-09-12T00:48:15.261 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_95 2024-09-12T00:48:15.261 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_96 2024-09-12T00:48:15.261 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_97 2024-09-12T00:48:15.261 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_98 2024-09-12T00:48:15.261 INFO:tasks.workunit.client.0.smithi070.stdout:created: dmarker:f_99 2024-09-12T00:48:15.261 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (1278 ms) 2024-09-12T00:48:15.261 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:48:15.262 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-12T00:48:15.262 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-12T00:48:15.262 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:48:15.262 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:48:15.262 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:48:15.262 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:48:15.262 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:48:15.262 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:48:15.263 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:48:15.263 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:48:15.263 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:48:15.263 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:48:15.263 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:48:15.263 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:48:15.263 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:48:15.263 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:48:15.263 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:48:15.263 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:48:15.263 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:48:15.263 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:48:15.263 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:48:15.264 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:48:15.264 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:48:15.264 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:48:15.264 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:48:15.264 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:48:15.264 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:48:15.264 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:48:15.264 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:48:15.264 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:48:15.264 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:48:15.264 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:48:15.264 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:48:15.264 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:48:15.265 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:48:15.265 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:48:15.265 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:48:15.265 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:48:15.265 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:48:15.265 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:48:15.265 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:48:15.265 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:48:15.265 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:48:15.265 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:48:15.265 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:48:15.265 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:48:15.265 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:48:15.266 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:48:15.266 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:48:15.266 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:48:15.266 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:48:15.266 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:48:15.266 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:48:15.266 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:48:15.266 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:48:15.266 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:48:15.266 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:48:15.266 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:48:15.266 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:48:15.266 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:48:15.267 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:48:15.267 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:48:15.267 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:48:15.267 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:48:15.267 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:48:15.267 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:48:15.267 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:48:15.267 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:48:15.267 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:48:15.267 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:48:15.267 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:48:15.267 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:48:15.267 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:48:15.268 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:48:15.268 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:48:15.268 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:48:15.268 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:48:15.268 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:48:15.268 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:48:15.268 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:48:15.268 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:48:15.268 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:48:15.268 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:48:15.268 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:48:15.268 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:48:15.268 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:48:15.268 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:48:15.268 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:48:15.269 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:48:15.269 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:48:15.269 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:48:15.269 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:48:15.269 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:48:15.269 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:48:15.269 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:48:15.269 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:48:15.269 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:48:15.269 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:48:15.269 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:48:15.269 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:48:15.269 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:48:15.269 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:48:15.269 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MARKER1_READDIR (9 ms) 2024-09-12T00:48:15.270 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T00:48:15.270 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:48:15.270 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:48:15.270 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:48:15.270 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:48:15.271 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:48:15.271 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:48:15.271 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:48:15.271 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:48:15.271 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:48:15.271 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:48:15.271 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:48:15.271 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:48:15.271 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:48:15.271 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:48:15.271 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:48:15.271 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:48:15.271 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:48:15.271 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:48:15.271 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:48:15.272 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:48:15.272 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:48:15.272 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:48:15.272 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:48:15.272 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:48:15.272 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:48:15.272 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:48:15.272 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:48:15.272 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:48:15.272 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:48:15.272 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:48:15.272 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:48:15.272 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:48:15.272 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:48:15.273 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:48:15.273 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:48:15.273 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:48:15.273 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:48:15.273 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:48:15.273 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:48:15.273 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:48:15.273 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:48:15.273 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:48:15.273 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:48:15.273 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:48:15.273 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:48:15.273 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:48:15.274 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:48:15.274 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:48:15.274 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:48:15.274 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:48:15.274 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:48:15.274 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:48:15.274 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:48:15.274 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:48:15.274 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:48:15.274 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:48:15.274 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:48:15.274 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:48:15.274 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:48:15.274 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:48:15.275 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:48:15.275 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:48:15.275 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:48:15.275 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:48:15.275 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:48:15.275 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:48:15.275 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:48:15.275 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:48:15.275 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:48:15.275 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:48:15.275 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:48:15.275 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:48:15.275 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:48:15.275 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:48:15.276 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:48:15.276 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:48:15.276 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:48:15.276 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:48:15.276 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:48:15.276 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:48:15.276 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:48:15.276 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:48:15.276 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:48:15.276 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:48:15.276 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:48:15.276 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:48:15.276 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:48:15.276 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:48:15.276 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:48:15.277 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:48:15.277 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:48:15.277 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:48:15.277 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:48:15.277 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:48:15.277 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:48:15.277 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:48:15.277 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:48:15.277 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:48:15.277 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:48:15.277 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:48:15.277 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MARKER2_READDIR (5 ms) 2024-09-12T00:48:15.277 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:48:15.277 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:48:15.277 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:48:15.278 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:48:15.278 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:48:15.278 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:48:15.278 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:48:15.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:48:15.275+0000 7ffa38916a80 -1 shutting down 2024-09-12T00:48:15.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:48:15.275+0000 7ff912668640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61725, si_uid : 1000, si_addr0x3e80000f11d, si_status0 2024-09-12T00:48:44.201 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.SHUTDOWN (28932 ms) 2024-09-12T00:48:44.202 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 11 tests from LibRGW (30575 ms total) 2024-09-12T00:48:44.202 INFO:tasks.workunit.client.0.smithi070.stdout: 2024-09-12T00:48:44.202 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment tear-down 2024-09-12T00:48:44.202 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] 11 tests from 1 test suite ran. (30576 ms total) 2024-09-12T00:48:44.202 INFO:tasks.workunit.client.0.smithi070.stdout:[ PASSED ] 11 tests. 2024-09-12T00:48:44.215 INFO:tasks.workunit.client.0.smithi070.stdout:phase 4.2 2024-09-12T00:48:44.240 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:48:44.240 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment set-up. 2024-09-12T00:48:44.240 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 11 tests from LibRGW 2024-09-12T00:48:44.240 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T00:48:44.241 INFO:tasks.workunit.client.0.smithi070.stdout:read i1: 64001 2024-09-12T00:48:44.241 INFO:tasks.workunit.client.0.smithi070.stdout:read s1: blunderbuss 2024-09-12T00:48:44.241 INFO:tasks.workunit.client.0.smithi070.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T00:48:44.241 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:48:44.250 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:44.250 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:44.524 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.INIT (284 ms) 2024-09-12T00:48:44.525 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:48:44.526 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:48:44.526 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:48:44.538 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (12 ms) 2024-09-12T00:48:44.538 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:48:44.538 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:48:44.538 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:48:44.538 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:48:44.538 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T00:48:44.542 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:48:44.542 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:48:44.542 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:48:44.542 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:48:44.542 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:48:44.542 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:48:44.542 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:48:44.542 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:48:44.542 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:48:44.542 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:48:44.543 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:48:44.543 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:48:44.543 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:48:44.543 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:48:44.543 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:48:44.543 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:48:44.543 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:48:44.543 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:48:44.543 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:48:44.543 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:48:44.544 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:48:44.544 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:48:44.544 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:48:44.544 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:48:44.544 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:48:44.544 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:48:44.544 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:48:44.544 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:48:44.544 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:48:44.544 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:48:44.545 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:48:44.545 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:48:44.545 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:48:44.545 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:48:44.545 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:48:44.545 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:48:44.545 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:48:44.545 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:48:44.545 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:48:44.545 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:48:44.545 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:48:44.546 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:48:44.546 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:48:44.546 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:48:44.546 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:48:44.546 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:48:44.546 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:48:44.546 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:48:44.546 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:48:44.546 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:48:44.546 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:48:44.546 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:48:44.546 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:48:44.547 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:48:44.547 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:48:44.547 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:48:44.547 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:48:44.547 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:48:44.547 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:48:44.547 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:48:44.547 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:48:44.547 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:48:44.547 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:48:44.547 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:48:44.547 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:48:44.548 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:48:44.548 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:48:44.548 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:48:44.548 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:48:44.548 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:48:44.548 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:48:44.548 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:48:44.548 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:48:44.548 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:48:44.548 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:48:44.548 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:48:44.548 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:48:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:48:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:48:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:48:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:48:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:48:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:48:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:48:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:48:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:48:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:48:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:48:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:48:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:48:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:48:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:48:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:48:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:48:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:48:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:48:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:48:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:48:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:48:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:48:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MARKER2_READDIR (4 ms) 2024-09-12T00:48:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:48:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:48:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:48:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:48:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:48:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:48:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:48:44.552 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:48:44.547+0000 7f70b14dfa80 -1 shutting down 2024-09-12T00:48:44.552 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:48:44.551+0000 7f6f8b231640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62370, si_uid : 1000, si_addr0x3e80000f3a2, si_status0 2024-09-12T00:49:14.726 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.SHUTDOWN (30184 ms) 2024-09-12T00:49:14.726 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 11 tests from LibRGW (30486 ms total) 2024-09-12T00:49:14.726 INFO:tasks.workunit.client.0.smithi070.stdout: 2024-09-12T00:49:14.726 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment tear-down 2024-09-12T00:49:14.726 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] 11 tests from 1 test suite ran. (30486 ms total) 2024-09-12T00:49:14.727 INFO:tasks.workunit.client.0.smithi070.stdout:[ PASSED ] 11 tests. 2024-09-12T00:49:14.740 INFO:tasks.workunit.client.0.smithi070.stdout:phase 5.1 2024-09-12T00:49:14.778 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:49:14.778 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment set-up. 2024-09-12T00:49:14.778 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 19 tests from LibRGW 2024-09-12T00:49:14.778 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:49:14.790 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:14.790 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:15.339 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.INIT (561 ms) 2024-09-12T00:49:15.339 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:49:15.341 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:49:15.341 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:49:15.354 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.CREATE_BUCKET (13 ms) 2024-09-12T00:49:15.354 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:49:15.359 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-12T00:49:15.359 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T00:49:15.359 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T00:49:15.359 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:49:15.361 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-12T00:49:15.361 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T00:49:15.361 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T00:49:15.362 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T00:49:15.372 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.PUT_OBJECT (11 ms) 2024-09-12T00:49:15.372 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T00:49:15.375 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.GET_OBJECT (3 ms) 2024-09-12T00:49:15.375 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:49:15.375 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:49:15.375 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T00:49:15.375 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T00:49:15.375 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T00:49:15.376 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T00:49:15.376 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.READV 2024-09-12T00:49:15.376 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T00:49:15.376 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T00:49:15.376 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T00:49:15.376 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:49:15.376 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T00:49:15.376 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:49:15.376 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:49:15.376 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:49:15.376 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:49:15.376 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:49:15.376 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:49:15.377 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:49:15.377 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:49:15.382+0000 7faf57dd9a80 -1 shutting down 2024-09-12T00:49:15.377 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:49:15.386+0000 7fae31b2b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63015, si_uid : 1000, si_addr0x3e80000f627, si_status0 2024-09-12T00:49:45.448 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.SHUTDOWN (30073 ms) 2024-09-12T00:49:45.449 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 19 tests from LibRGW (30670 ms total) 2024-09-12T00:49:45.449 INFO:tasks.workunit.client.0.smithi070.stdout: 2024-09-12T00:49:45.449 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment tear-down 2024-09-12T00:49:45.449 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] 19 tests from 1 test suite ran. (30670 ms total) 2024-09-12T00:49:45.449 INFO:tasks.workunit.client.0.smithi070.stdout:[ PASSED ] 19 tests. 2024-09-12T00:49:45.458 INFO:tasks.workunit.client.0.smithi070.stdout:phase 5.2 2024-09-12T00:49:45.491 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:49:45.491 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment set-up. 2024-09-12T00:49:45.491 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 19 tests from LibRGW 2024-09-12T00:49:45.491 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:49:45.500 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:45.500 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:45.829 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.INIT (338 ms) 2024-09-12T00:49:45.830 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:49:45.831 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:49:45.831 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:49:45.831 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:49:45.832 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:49:45.839 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (8 ms) 2024-09-12T00:49:45.839 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T00:49:45.840 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T00:49:45.840 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:49:45.840 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-12T00:49:45.840 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T00:49:45.840 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T00:49:45.840 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T00:49:45.840 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-12T00:49:45.840 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T00:49:45.840 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-12T00:49:45.840 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:49:45.840 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:49:45.841 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T00:49:45.841 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T00:49:45.841 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T00:49:45.841 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T00:49:45.841 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.READV 2024-09-12T00:49:45.841 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T00:49:45.841 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T00:49:45.841 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T00:49:45.841 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:49:45.848 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.DELETE_OBJECT (9 ms) 2024-09-12T00:49:45.848 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:49:45.871 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.DELETE_BUCKET (23 ms) 2024-09-12T00:49:45.872 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:49:45.872 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:49:45.872 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:49:45.872 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:49:45.872 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:49:45.872 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:49:45.881+0000 7f5ca7c79a80 -1 shutting down 2024-09-12T00:49:45.874 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:49:45.881+0000 7f5b819cb640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63661, si_uid : 1000, si_addr0x3e80000f8ad, si_status0 2024-09-12T00:50:16.117 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.SHUTDOWN (30245 ms) 2024-09-12T00:50:16.118 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 19 tests from LibRGW (30626 ms total) 2024-09-12T00:50:16.118 INFO:tasks.workunit.client.0.smithi070.stdout: 2024-09-12T00:50:16.118 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment tear-down 2024-09-12T00:50:16.118 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] 19 tests from 1 test suite ran. (30626 ms total) 2024-09-12T00:50:16.118 INFO:tasks.workunit.client.0.smithi070.stdout:[ PASSED ] 19 tests. 2024-09-12T00:50:16.128 INFO:tasks.workunit.client.0.smithi070.stdout:phase 6.1 2024-09-12T00:50:16.151 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T00:50:16.151 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment set-up. 2024-09-12T00:50:16.151 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 10 tests from LibRGW 2024-09-12T00:50:16.151 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:50:16.160 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:16.160 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:16.725 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.INIT (574 ms) 2024-09-12T00:50:16.725 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:50:16.727 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.MOUNT (3 ms) 2024-09-12T00:50:16.727 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-12T00:50:16.756 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.CREATE_BUCKETS (29 ms) 2024-09-12T00:50:16.757 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-12T00:50:16.767 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (10 ms) 2024-09-12T00:50:16.767 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-12T00:50:16.801 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.TOPDIR_RENAME (35 ms) 2024-09-12T00:50:16.801 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-12T00:50:16.855 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.SUBDIR_RENAME (53 ms) 2024-09-12T00:50:16.855 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-12T00:50:16.910 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (56 ms) 2024-09-12T00:50:16.911 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:50:16.911 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:50:16.911 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:50:16.911 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:50:16.911 INFO:tasks.workunit.client.0.smithi070.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:50:16.911 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:16.916+0000 7f1ef73e4a80 -1 shutting down 2024-09-12T00:50:16.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:16.920+0000 7f1dd1136640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64308, si_uid : 1000, si_addr0x3e80000fb34, si_status0 2024-09-12T00:50:47.099 INFO:tasks.workunit.client.0.smithi070.stdout:[ OK ] LibRGW.SHUTDOWN (30187 ms) 2024-09-12T00:50:47.099 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] 10 tests from LibRGW (30947 ms total) 2024-09-12T00:50:47.099 INFO:tasks.workunit.client.0.smithi070.stdout: 2024-09-12T00:50:47.099 INFO:tasks.workunit.client.0.smithi070.stdout:[----------] Global test environment tear-down 2024-09-12T00:50:47.099 INFO:tasks.workunit.client.0.smithi070.stdout:[==========] 10 tests from 1 test suite ran. (30947 ms total) 2024-09-12T00:50:47.099 INFO:tasks.workunit.client.0.smithi070.stdout:[ PASSED ] 10 tests. 2024-09-12T00:50:47.111 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:50:47.111 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:50:47.128 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-12T00:50:47.129 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-12T00:50:47.129 DEBUG:teuthology.orchestra.run.smithi070:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-12T00:50:47.180 INFO:tasks.workunit.client.0.smithi070.stderr:+ [ -z ] 2024-09-12T00:50:47.180 INFO:tasks.workunit.client.0.smithi070.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:50:47.180 INFO:tasks.workunit.client.0.smithi070.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:50:47.180 INFO:tasks.workunit.client.0.smithi070.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name maven test user --email sigv4@example.com 2024-09-12T00:50:47.220 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:47.220 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:47.264 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.271+0000 7f14289df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.271+0000 7f14289df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:47.266 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.271+0000 7f14289df9c0 20 realm 2024-09-12T00:50:47.266 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.271+0000 7f14289df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.266 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.271+0000 7f14289df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:47.266 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.271+0000 7f14289df9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:47.266 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.271+0000 7f14289df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.266 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.271+0000 7f14289df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:47.266 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.271+0000 7f14289df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.267 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.275+0000 7f14289df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:47.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.275+0000 7f14289df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.275+0000 7f14289df9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:47.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.275+0000 7f14289df9c0 20 searching for the correct realm 2024-09-12T00:50:47.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.275+0000 7f14264e5640 0 -- 172.21.15.70:0/450282828 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f1420063600 msgr2=0x7f1420062070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:47.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.283+0000 7f14264e5640 0 -- 172.21.15.70:0/450282828 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f142006c1a0 msgr2=0x7f14200980b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:47.499 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.507+0000 7f14289df9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:47.500 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.507+0000 7f14289df9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:50:47.500 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.507+0000 7f14289df9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:47.500 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.507+0000 7f14289df9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:50:47.500 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.507+0000 7f14289df9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:47.500 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.507+0000 7f14289df9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:47.500 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.507+0000 7f14289df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.500 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.507+0000 7f14289df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:47.501 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.507+0000 7f14289df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.501 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.507+0000 7f14289df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:47.501 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.507+0000 7f14289df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.507+0000 7f14289df9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:47.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.507+0000 7f14289df9c0 20 zone default found 2024-09-12T00:50:47.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.507+0000 7f14289df9c0 4 Realm: () 2024-09-12T00:50:47.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.507+0000 7f14289df9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:50:47.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.507+0000 7f14289df9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:50:47.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.507+0000 7f14289df9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:47.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.507+0000 7f14289df9c0 20 zonegroup default 2024-09-12T00:50:47.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.507+0000 7f14289df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.503 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.507+0000 7f14289df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:47.503 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.507+0000 7f14289df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.504 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.511+0000 7f14289df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:47.504 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.511+0000 7f14289df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.511+0000 7f14289df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:47.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.511+0000 7f14289df9c0 20 started sync module instance, tier type = 2024-09-12T00:50:47.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.511+0000 7f14289df9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:50:47.529 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.535+0000 7f14289df9c0 20 add_watcher() i=0 2024-09-12T00:50:47.529 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.535+0000 7f14289df9c0 20 add_watcher() i=1 2024-09-12T00:50:47.529 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.535+0000 7f14289df9c0 20 add_watcher() i=2 2024-09-12T00:50:47.529 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.535+0000 7f14289df9c0 20 add_watcher() i=3 2024-09-12T00:50:47.529 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.535+0000 7f14289df9c0 20 add_watcher() i=4 2024-09-12T00:50:47.529 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.535+0000 7f14289df9c0 20 add_watcher() i=5 2024-09-12T00:50:47.529 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.535+0000 7f14289df9c0 20 add_watcher() i=6 2024-09-12T00:50:47.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.539+0000 7f14289df9c0 20 add_watcher() i=7 2024-09-12T00:50:47.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.539+0000 7f14289df9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:47.535 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.543+0000 7f12dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:47.536 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.543+0000 7f14289df9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:47.536 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.543+0000 7f14289df9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:47.536 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.543+0000 7f14289df9c0 5 note: GC not initialized 2024-09-12T00:50:47.537 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.543+0000 7f12577fe640 20 reqs_thread_entry: start 2024-09-12T00:50:47.537 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.543+0000 7f14289df9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:50:47.537 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.543+0000 7f14289df9c0 20 Filter name: none 2024-09-12T00:50:47.538 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.543+0000 7f12557fa640 20 reqs_thread_entry: start 2024-09-12T00:50:47.538 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.543+0000 7f14289df9c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-12T00:50:47.538 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.543+0000 7f14289df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.538 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.543+0000 7f14289df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:47.538 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.543+0000 7f14289df9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-12T00:50:47.538 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.543+0000 7f14289df9c0 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:50:47.539 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.543+0000 7f14289df9c0 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-12T00:50:47.539 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.543+0000 7f14289df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.539 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.543+0000 7f14289df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:47.540 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.543+0000 7f14289df9c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-12T00:50:47.540 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.543+0000 7f14289df9c0 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:50:47.540 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.543+0000 7f14289df9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-12T00:50:47.540 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.543+0000 7f14289df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.540 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.547+0000 7f14289df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:47.540 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.547+0000 7f14289df9c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-12T00:50:47.540 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.547+0000 7f14289df9c0 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:50:47.540 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.547+0000 7f14289df9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T00:50:47.540 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.547+0000 7f14289df9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T00:50:47.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.547+0000 7f14289df9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T00:50:47.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.547+0000 7f14289df9c0 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:50:47.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.547+0000 7f14289df9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-12T00:50:47.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.547+0000 7f1309ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791301 cookie 94286746638768 notifier 5790 bl.length()=677 2024-09-12T00:50:47.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.547+0000 7f1309ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T00:50:47.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.547+0000 7f1309ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:50:47.544 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.551+0000 7f14289df9c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T00:50:47.544 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.551+0000 7f14289df9c0 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:50:47.544 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.551+0000 7f14289df9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-12T00:50:47.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.551+0000 7f1309ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791310 cookie 94286746625728 notifier 5790 bl.length()=187 2024-09-12T00:50:47.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.551+0000 7f1309ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T00:50:47.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.551+0000 7f1309ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:50:47.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.555+0000 7f14289df9c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T00:50:47.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.555+0000 7f14289df9c0 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:50:47.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.555+0000 7f14289df9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-12T00:50:47.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.555+0000 7f13097fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791311 cookie 94286746625728 notifier 5790 bl.length()=197 2024-09-12T00:50:47.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.555+0000 7f13097fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T00:50:47.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.555+0000 7f13097fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:50:47.550 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:50:47.551 INFO:tasks.workunit.client.0.smithi070.stdout: "user_id": "ceph-test-maven", 2024-09-12T00:50:47.551 INFO:tasks.workunit.client.0.smithi070.stdout: "display_name": "maven test user", 2024-09-12T00:50:47.551 INFO:tasks.workunit.client.0.smithi070.stdout: "email": "sigv4@example.com", 2024-09-12T00:50:47.551 INFO:tasks.workunit.client.0.smithi070.stdout: "suspended": 0, 2024-09-12T00:50:47.551 INFO:tasks.workunit.client.0.smithi070.stdout: "max_buckets": 1000, 2024-09-12T00:50:47.551 INFO:tasks.workunit.client.0.smithi070.stdout: "subusers": [], 2024-09-12T00:50:47.551 INFO:tasks.workunit.client.0.smithi070.stdout: "keys": [ 2024-09-12T00:50:47.551 INFO:tasks.workunit.client.0.smithi070.stdout: { 2024-09-12T00:50:47.551 INFO:tasks.workunit.client.0.smithi070.stdout: "user": "ceph-test-maven", 2024-09-12T00:50:47.551 INFO:tasks.workunit.client.0.smithi070.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-12T00:50:47.551 INFO:tasks.workunit.client.0.smithi070.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-12T00:50:47.551 INFO:tasks.workunit.client.0.smithi070.stdout: "active": true, 2024-09-12T00:50:47.551 INFO:tasks.workunit.client.0.smithi070.stdout: "create_date": "2024-09-12T00:50:47.550850Z" 2024-09-12T00:50:47.552 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:50:47.552 INFO:tasks.workunit.client.0.smithi070.stdout: ], 2024-09-12T00:50:47.552 INFO:tasks.workunit.client.0.smithi070.stdout: "swift_keys": [], 2024-09-12T00:50:47.552 INFO:tasks.workunit.client.0.smithi070.stdout: "caps": [], 2024-09-12T00:50:47.552 INFO:tasks.workunit.client.0.smithi070.stdout: "op_mask": "read, write, delete", 2024-09-12T00:50:47.552 INFO:tasks.workunit.client.0.smithi070.stdout: "default_placement": "", 2024-09-12T00:50:47.552 INFO:tasks.workunit.client.0.smithi070.stdout: "default_storage_class": "", 2024-09-12T00:50:47.552 INFO:tasks.workunit.client.0.smithi070.stdout: "placement_tags": [], 2024-09-12T00:50:47.552 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_quota": { 2024-09-12T00:50:47.552 INFO:tasks.workunit.client.0.smithi070.stdout: "enabled": false, 2024-09-12T00:50:47.552 INFO:tasks.workunit.client.0.smithi070.stdout: "check_on_raw": false, 2024-09-12T00:50:47.552 INFO:tasks.workunit.client.0.smithi070.stdout: "max_size": -1, 2024-09-12T00:50:47.552 INFO:tasks.workunit.client.0.smithi070.stdout: "max_size_kb": 0, 2024-09-12T00:50:47.552 INFO:tasks.workunit.client.0.smithi070.stdout: "max_objects": -1 2024-09-12T00:50:47.552 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:50:47.553 INFO:tasks.workunit.client.0.smithi070.stdout: "user_quota": { 2024-09-12T00:50:47.553 INFO:tasks.workunit.client.0.smithi070.stdout: "enabled": false, 2024-09-12T00:50:47.553 INFO:tasks.workunit.client.0.smithi070.stdout: "check_on_raw": false, 2024-09-12T00:50:47.553 INFO:tasks.workunit.client.0.smithi070.stdout: "max_size": -1, 2024-09-12T00:50:47.553 INFO:tasks.workunit.client.0.smithi070.stdout: "max_size_kb": 0, 2024-09-12T00:50:47.553 INFO:tasks.workunit.client.0.smithi070.stdout: "max_objects": -1 2024-09-12T00:50:47.553 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:50:47.553 INFO:tasks.workunit.client.0.smithi070.stdout: "temp_url_keys": [], 2024-09-12T00:50:47.553 INFO:tasks.workunit.client.0.smithi070.stdout: "type": "rgw", 2024-09-12T00:50:47.553 INFO:tasks.workunit.client.0.smithi070.stdout: "mfa_ids": [], 2024-09-12T00:50:47.553 INFO:tasks.workunit.client.0.smithi070.stdout: "account_id": "", 2024-09-12T00:50:47.553 INFO:tasks.workunit.client.0.smithi070.stdout: "path": "/", 2024-09-12T00:50:47.553 INFO:tasks.workunit.client.0.smithi070.stdout: "create_date": "2024-09-12T00:50:47.550823Z", 2024-09-12T00:50:47.553 INFO:tasks.workunit.client.0.smithi070.stdout: "tags": [], 2024-09-12T00:50:47.554 INFO:tasks.workunit.client.0.smithi070.stdout: "group_ids": [] 2024-09-12T00:50:47.554 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:50:47.554 INFO:tasks.workunit.client.0.smithi070.stdout: 2024-09-12T00:50:47.554 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.559+0000 7f12dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:47.557 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.563+0000 7f14289df9c0 20 remove_watcher() i=0 2024-09-12T00:50:47.557 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.563+0000 7f14289df9c0 2 removed watcher, disabling cache 2024-09-12T00:50:47.559 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.567+0000 7f14289df9c0 20 remove_watcher() i=1 2024-09-12T00:50:47.561 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.567+0000 7f14289df9c0 20 remove_watcher() i=2 2024-09-12T00:50:47.563 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.571+0000 7f14289df9c0 20 remove_watcher() i=3 2024-09-12T00:50:47.565 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.571+0000 7f14289df9c0 20 remove_watcher() i=4 2024-09-12T00:50:47.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.575+0000 7f14289df9c0 20 remove_watcher() i=5 2024-09-12T00:50:47.568 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.575+0000 7f14289df9c0 20 remove_watcher() i=6 2024-09-12T00:50:47.570 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:50:47.575+0000 7f14289df9c0 20 remove_watcher() i=7 2024-09-12T00:50:47.586 INFO:tasks.workunit.client.0.smithi070.stderr:+ [ -z ] 2024-09-12T00:50:47.588 INFO:tasks.workunit.client.0.smithi070.stderr:+ [ -z /home/ubuntu/cephtest ] 2024-09-12T00:50:47.588 INFO:tasks.workunit.client.0.smithi070.stderr:+ cat /home/ubuntu/cephtest/url_file 2024-09-12T00:50:47.589 INFO:tasks.workunit.client.0.smithi070.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi070.front.sepia.ceph.com:443 2024-09-12T00:50:47.589 INFO:tasks.workunit.client.0.smithi070.stderr:+ [ -z /home/ubuntu/cephtest/clone.client.0 ] 2024-09-12T00:50:47.589 INFO:tasks.workunit.client.0.smithi070.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-12T00:50:47.589 INFO:tasks.workunit.client.0.smithi070.stderr:+ ./mvnw clean package 2024-09-12T00:50:47.594 INFO:tasks.workunit.client.0.smithi070.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T00:50:50.372 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] Scanning for projects... 2024-09-12T00:50:50.538 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-12T00:50:50.649 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 49 kB/s) 2024-09-12T00:50:50.672 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-12T00:50:50.712 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 32/83 kB Progress (1): 49/83 kB Progress (1): 65/83 kB Progress (1): 81/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.0 MB/s) 2024-09-12T00:50:50.724 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-12T00:50:50.744 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 62/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.7 MB/s) 2024-09-12T00:50:50.780 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] 2024-09-12T00:50:50.780 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T00:50:50.780 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] Building jcksum 1.0 2024-09-12T00:50:50.780 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] from pom.xml 2024-09-12T00:50:50.780 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T00:50:50.784 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-12T00:50:50.801 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 295 kB/s) 2024-09-12T00:50:50.810 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-12T00:50:50.827 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 582 kB/s) 2024-09-12T00:50:50.831 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-12T00:50:50.848 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.7 MB/s) 2024-09-12T00:50:50.859 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-12T00:50:50.876 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.1 MB/s) 2024-09-12T00:50:50.896 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-12T00:50:50.915 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 1.8 MB/s) 2024-09-12T00:50:50.926 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-12T00:50:50.943 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 480 kB/s) 2024-09-12T00:50:50.947 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-12T00:50:50.964 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 476 kB/s) 2024-09-12T00:50:50.968 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-12T00:50:50.985 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 2.7 MB/s) 2024-09-12T00:50:50.991 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-12T00:50:51.007 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.2 MB/s) 2024-09-12T00:50:51.015 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-12T00:50:51.032 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.8 MB/s) 2024-09-12T00:50:51.042 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-12T00:50:51.058 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 577 kB/s) 2024-09-12T00:50:51.068 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-12T00:50:51.087 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/66 kB Progress (1): 32/66 kB Progress (1): 49/66 kB Progress (1): 65/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.5 MB/s) 2024-09-12T00:50:51.097 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-12T00:50:51.114 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 296 kB/s) 2024-09-12T00:50:51.118 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-12T00:50:51.138 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.2 MB/s) 2024-09-12T00:50:51.142 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-12T00:50:51.161 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/50 kB Progress (1): 32/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.8 MB/s) 2024-09-12T00:50:51.168 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-12T00:50:51.189 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.1 MB/s) 2024-09-12T00:50:51.199 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-12T00:50:51.216 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 331 kB/s) 2024-09-12T00:50:51.223 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-12T00:50:51.245 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 1.9 MB/s) 2024-09-12T00:50:51.254 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-12T00:50:51.270 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 398 kB/s) 2024-09-12T00:50:51.274 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-12T00:50:51.290 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 619 kB/s) 2024-09-12T00:50:51.294 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-12T00:50:51.312 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/46 kB Progress (1): 32/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.5 MB/s) 2024-09-12T00:50:51.319 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-12T00:50:51.335 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.2 MB/s) 2024-09-12T00:50:51.343 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-12T00:50:51.361 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.6 MB/s) 2024-09-12T00:50:51.387 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-12T00:50:51.405 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 358 kB/s) 2024-09-12T00:50:51.409 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-12T00:50:51.426 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.2 MB/s) 2024-09-12T00:50:51.435 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-12T00:50:51.453 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.1 MB/s) 2024-09-12T00:50:51.466 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-12T00:50:51.484 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 222 kB/s) 2024-09-12T00:50:51.487 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-12T00:50:51.504 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 91 kB/s) 2024-09-12T00:50:51.508 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-12T00:50:51.532 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 89 kB/s) 2024-09-12T00:50:51.540 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-12T00:50:51.557 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 214 kB/s) 2024-09-12T00:50:51.564 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-12T00:50:51.581 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 190 kB/s) 2024-09-12T00:50:51.587 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-12T00:50:51.605 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 645 kB/s) 2024-09-12T00:50:51.611 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-12T00:50:51.629 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 94 kB/s) 2024-09-12T00:50:51.635 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-12T00:50:51.652 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 225 kB/s) 2024-09-12T00:50:51.661 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-12T00:50:51.681 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 273 kB/s) 2024-09-12T00:50:51.687 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-12T00:50:51.704 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 64 kB/s) 2024-09-12T00:50:51.709 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-12T00:50:51.726 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 226 kB/s) 2024-09-12T00:50:51.730 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-12T00:50:51.747 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 812 kB/s) 2024-09-12T00:50:51.753 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-12T00:50:51.770 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 216 kB/s) 2024-09-12T00:50:51.781 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-12T00:50:51.800 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 129 kB/s) 2024-09-12T00:50:51.808 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-12T00:50:51.826 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 162 kB/s) 2024-09-12T00:50:51.834 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-12T00:50:51.853 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 390 kB/s) 2024-09-12T00:50:51.863 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-12T00:50:51.882 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 287 kB/s) 2024-09-12T00:50:51.891 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-12T00:50:51.909 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 194 kB/s) 2024-09-12T00:50:51.918 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-12T00:50:51.936 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 244 kB/s) 2024-09-12T00:50:51.942 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-12T00:50:51.961 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 127 kB/s) 2024-09-12T00:50:51.967 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-12T00:50:51.984 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 402 kB/s) 2024-09-12T00:50:51.991 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-12T00:50:52.007 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 379 kB/s) 2024-09-12T00:50:52.014 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-12T00:50:52.029 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 175 kB/s) 2024-09-12T00:50:52.035 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-12T00:50:52.052 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 204 kB/s) 2024-09-12T00:50:52.059 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-12T00:50:52.076 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 227 kB/s) 2024-09-12T00:50:52.080 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-12T00:50:52.097 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 105 kB/s) 2024-09-12T00:50:52.107 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-12T00:50:52.125 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 389 kB/s) 2024-09-12T00:50:52.129 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-12T00:50:52.147 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 964 kB/s) 2024-09-12T00:50:52.152 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-12T00:50:52.171 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.9 MB/s) 2024-09-12T00:50:52.178 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-12T00:50:52.196 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.0 MB/s) 2024-09-12T00:50:52.205 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-12T00:50:52.223 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 276 kB/s) 2024-09-12T00:50:52.227 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-12T00:50:52.245 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 732 kB/s) 2024-09-12T00:50:52.254 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-12T00:50:52.272 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 822 kB/s) 2024-09-12T00:50:52.277 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-12T00:50:52.296 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 65/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.4 MB/s) 2024-09-12T00:50:52.323 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-12T00:50:52.340 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 870 kB/s) 2024-09-12T00:50:52.350 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-12T00:50:52.367 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 908 kB/s) 2024-09-12T00:50:52.372 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-12T00:50:52.392 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 3.8 MB/s) 2024-09-12T00:50:52.403 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-12T00:50:52.420 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.0 MB/s) 2024-09-12T00:50:52.429 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-12T00:50:52.448 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.1 MB/s) 2024-09-12T00:50:52.453 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-12T00:50:52.473 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 3.9 MB/s) 2024-09-12T00:50:52.487 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-12T00:50:52.504 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 226 kB/s) 2024-09-12T00:50:52.508 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-12T00:50:52.525 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 767 kB/s) 2024-09-12T00:50:52.546 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-12T00:50:52.563 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 189 kB/s) 2024-09-12T00:50:52.568 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-12T00:50:52.587 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 177 kB/s) 2024-09-12T00:50:52.591 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-12T00:50:52.608 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 120 kB/s) 2024-09-12T00:50:52.613 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-12T00:50:52.632 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 149 kB/s) 2024-09-12T00:50:52.637 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-12T00:50:52.655 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 85 kB/s) 2024-09-12T00:50:52.660 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-12T00:50:52.678 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 167 kB/s) 2024-09-12T00:50:52.683 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-12T00:50:52.701 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 178 kB/s) 2024-09-12T00:50:52.706 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-12T00:50:52.723 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 178 kB/s) 2024-09-12T00:50:52.730 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-12T00:50:52.747 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 60 kB/s) 2024-09-12T00:50:52.755 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-12T00:50:52.772 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 57 kB/s) 2024-09-12T00:50:52.778 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-12T00:50:52.796 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 180 kB/s) 2024-09-12T00:50:52.801 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-12T00:50:52.819 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 160 kB/s) 2024-09-12T00:50:52.824 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-12T00:50:52.841 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 191 kB/s) 2024-09-12T00:50:52.847 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-12T00:50:52.864 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 202 kB/s) 2024-09-12T00:50:52.869 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-12T00:50:52.886 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 168 kB/s) 2024-09-12T00:50:52.934 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-12T00:50:53.055 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 27 MB/s) 2024-09-12T00:50:53.058 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-12T00:50:53.058 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-12T00:50:53.058 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-12T00:50:53.058 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-12T00:50:53.059 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-12T00:50:53.078 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 15/35 kB Progress (1): 31/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 1.7 MB/s) 2024-09-12T00:50:53.078 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-12T00:50:53.093 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 458 kB/s) 2024-09-12T00:50:53.094 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-12T00:50:53.121 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/782 kB Progress (1): 33/782 kB Progress (1): 49/782 kB Progress (1): 66/782 kB Progress (1): 82/782 kB Progress (1): 98/782 kB Progress (1): 115/782 kB Progress (1): 131/782 kB Progress (2): 131/782 kB | 1.4/71 kB Progress (2): 147/782 kB | 1.4/71 kB Progress (2): 147/782 kB | 2.8/71 kB Progress (2): 147/782 kB | 4.1/71 kB Progress (2): 147/782 kB | 5.5/71 kB Progress (2): 147/782 kB | 6.9/71 kB Progress (2): 164/782 kB | 6.9/71 kB Progress (2): 164/782 kB | 8.3/71 kB Progress (2): 164/782 kB | 9.7/71 kB Progress (3): 164/782 kB | 9.7/71 kB | 1.4/16 kB Progress (3): 164/782 kB | 11/71 kB | 1.4/16 kB Progress (3): 180/782 kB | 11/71 kB | 1.4/16 kB Progress (3): 180/782 kB | 12/71 kB | 1.4/16 kB Progress (3): 180/782 kB | 12/71 kB | 2.8/16 kB Progress (3): 180/782 kB | 14/71 kB | 2.8/16 kB Progress (3): 180/782 kB | 14/71 kB | 4.1/16 kB Progress (3): 197/782 kB | 14/71 kB | 4.1/16 kB Progress (3): 197/782 kB | 15/71 kB | 4.1/16 kB Progress (4): 197/782 kB | 15/71 kB | 4.1/16 kB | 1.4/49 kB Progress (4): 197/782 kB | 15/71 kB | 5.5/16 kB | 1.4/49 kB Progress (4): 197/782 kB | 15/71 kB | 5.5/16 kB | 2.8/49 kB Progress (4): 213/782 kB | 15/71 kB | 5.5/16 kB | 2.8/49 kB Progress (4): 213/782 kB | 15/71 kB | 5.5/16 kB | 4.1/49 kB Progress (4): 213/782 kB | 16/71 kB | 5.5/16 kB | 4.1/49 kB Progress (4): 229/782 kB | 16/71 kB | 5.5/16 kB | 4.1/49 kB Progress (4): 229/782 kB | 16/71 kB | 5.5/16 kB | 5.5/49 kB Progress (4): 229/782 kB | 16/71 kB | 6.9/16 kB | 5.5/49 kB Progress (4): 229/782 kB | 16/71 kB | 6.9/16 kB | 6.9/49 kB Progress (4): 229/782 kB | 18/71 kB | 6.9/16 kB | 6.9/49 kB Progress (4): 229/782 kB | 18/71 kB | 6.9/16 kB | 8.3/49 kB Progress (4): 229/782 kB | 18/71 kB | 8.3/16 kB | 8.3/49 kB Progress (4): 246/782 kB | 18/71 kB | 8.3/16 kB | 8.3/49 kB Progress (4): 246/782 kB | 18/71 kB | 9.7/16 kB | 8.3/49 kB Progress (4): 246/782 kB | 18/71 kB | 9.7/16 kB | 9.7/49 kB Progress (4): 246/782 kB | 19/71 kB | 9.7/16 kB | 9.7/49 kB Progress (4): 246/782 kB | 19/71 kB | 9.7/16 kB | 11/49 kB Progress (4): 246/782 kB | 19/71 kB | 11/16 kB | 11/49 kB Progress (4): 246/782 kB | 19/71 kB | 11/16 kB | 12/49 kB Progress (4): 246/782 kB | 21/71 kB | 11/16 kB | 12/49 kB Progress (4): 246/782 kB | 21/71 kB | 11/16 kB | 14/49 kB Progress (4): 262/782 kB | 21/71 kB | 11/16 kB | 14/49 kB Progress (4): 262/782 kB | 21/71 kB | 11/16 kB | 15/49 kB Progress (4): 262/782 kB | 22/71 kB | 11/16 kB | 15/49 kB Progress (4): 262/782 kB | 22/71 kB | 12/16 kB | 15/49 kB Progress (4): 262/782 kB | 23/71 kB | 12/16 kB | 15/49 kB Progress (4): 278/782 kB | 23/71 kB | 12/16 kB | 15/49 kB Progress (4): 278/782 kB | 23/71 kB | 12/16 kB | 16/49 kB Progress (4): 278/782 kB | 25/71 kB | 12/16 kB | 16/49 kB Progress (4): 278/782 kB | 25/71 kB | 14/16 kB | 16/49 kB Progress (4): 278/782 kB | 26/71 kB | 14/16 kB | 16/49 kB Progress (4): 294/782 kB | 26/71 kB | 14/16 kB | 16/49 kB Progress (4): 294/782 kB | 26/71 kB | 14/16 kB | 18/49 kB Progress (4): 294/782 kB | 27/71 kB | 14/16 kB | 18/49 kB Progress (5): 294/782 kB | 27/71 kB | 14/16 kB | 18/49 kB | 1.4/98 kB Progress (5): 294/782 kB | 27/71 kB | 15/16 kB | 18/49 kB | 1.4/98 kB Progress (5): 294/782 kB | 29/71 kB | 15/16 kB | 18/49 kB | 1.4/98 kB Progress (5): 294/782 kB | 29/71 kB | 15/16 kB | 19/49 kB | 1.4/98 kB Progress (5): 294/782 kB | 30/71 kB | 15/16 kB | 19/49 kB | 1.4/98 kB Progress (5): 294/782 kB | 30/71 kB | 16 kB | 19/49 kB | 1.4/98 kB Progress (5): 294/782 kB | 30/71 kB | 16 kB | 19/49 kB | 2.8/98 kB Progress (5): 311/782 kB | 30/71 kB | 16 kB | 19/49 kB | 2.8/98 kB Progress (5): 311/782 kB | 32/71 kB | 16 kB | 19/49 kB | 2.8/98 kB Progress (5): 311/782 kB | 32/71 kB | 16 kB | 21/49 kB | 2.8/98 kB Progress (5): 311/782 kB | 33/71 kB | 16 kB | 21/49 kB | 2.8/98 kB Progress (5): 311/782 kB | 33/71 kB | 16 kB | 21/49 kB | 4.1/98 kB Progress (5): 327/782 kB | 33/71 kB | 16 kB | 21/49 kB | 4.1/98 kB Progress (5): 327/782 kB | 34/71 kB | 16 kB | 21/49 kB | 4.1/98 kB Progress (5): 327/782 kB | 34/71 kB | 16 kB | 22/49 kB | 4.1/98 kB Progress (5): 327/782 kB | 36/71 kB | 16 kB | 22/49 kB | 4.1/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 259 kB/s) 2024-09-12T00:50:53.121 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (4): 327/782 kB | 36/71 kB | 22/49 kB | 5.5/98 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-12T00:50:53.127 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (4): 327/782 kB | 37/71 kB | 22/49 kB | 5.5/98 kB Progress (4): 343/782 kB | 37/71 kB | 22/49 kB | 5.5/98 kB Progress (4): 343/782 kB | 37/71 kB | 23/49 kB | 5.5/98 kB Progress (4): 343/782 kB | 38/71 kB | 23/49 kB | 5.5/98 kB Progress (4): 343/782 kB | 38/71 kB | 25/49 kB | 5.5/98 kB Progress (4): 343/782 kB | 38/71 kB | 25/49 kB | 6.9/98 kB Progress (4): 343/782 kB | 38/71 kB | 26/49 kB | 6.9/98 kB Progress (4): 360/782 kB | 38/71 kB | 26/49 kB | 6.9/98 kB Progress (4): 360/782 kB | 38/71 kB | 26/49 kB | 8.3/98 kB Progress (4): 360/782 kB | 38/71 kB | 27/49 kB | 8.3/98 kB Progress (4): 360/782 kB | 38/71 kB | 27/49 kB | 9.7/98 kB Progress (4): 360/782 kB | 38/71 kB | 29/49 kB | 9.7/98 kB Progress (4): 360/782 kB | 38/71 kB | 29/49 kB | 11/98 kB Progress (4): 360/782 kB | 38/71 kB | 30/49 kB | 11/98 kB Progress (4): 360/782 kB | 38/71 kB | 30/49 kB | 12/98 kB Progress (4): 360/782 kB | 38/71 kB | 32/49 kB | 12/98 kB Progress (4): 376/782 kB | 38/71 kB | 32/49 kB | 12/98 kB Progress (4): 376/782 kB | 38/71 kB | 32/49 kB | 14/98 kB Progress (4): 376/782 kB | 38/71 kB | 33/49 kB | 14/98 kB Progress (4): 376/782 kB | 38/71 kB | 33/49 kB | 15/98 kB Progress (4): 376/782 kB | 38/71 kB | 34/49 kB | 15/98 kB Progress (4): 393/782 kB | 38/71 kB | 34/49 kB | 15/98 kB Progress (4): 393/782 kB | 38/71 kB | 34/49 kB | 16/98 kB Progress (4): 393/782 kB | 38/71 kB | 36/49 kB | 16/98 kB Progress (4): 393/782 kB | 38/71 kB | 37/49 kB | 16/98 kB Progress (4): 393/782 kB | 38/71 kB | 37/49 kB | 32/98 kB Progress (4): 393/782 kB | 38/71 kB | 38/49 kB | 32/98 kB Progress (4): 409/782 kB | 38/71 kB | 38/49 kB | 32/98 kB Progress (4): 425/782 kB | 38/71 kB | 38/49 kB | 32/98 kB Progress (4): 442/782 kB | 38/71 kB | 38/49 kB | 32/98 kB Progress (4): 458/782 kB | 38/71 kB | 38/49 kB | 32/98 kB Progress (4): 475/782 kB | 38/71 kB | 38/49 kB | 32/98 kB Progress (4): 491/782 kB | 38/71 kB | 38/49 kB | 32/98 kB Progress (4): 491/782 kB | 40/71 kB | 38/49 kB | 32/98 kB Progress (4): 491/782 kB | 41/71 kB | 38/49 kB | 32/98 kB Progress (4): 491/782 kB | 42/71 kB | 38/49 kB | 32/98 kB Progress (4): 507/782 kB | 42/71 kB | 38/49 kB | 32/98 kB Progress (4): 507/782 kB | 44/71 kB | 38/49 kB | 32/98 kB Progress (4): 507/782 kB | 45/71 kB | 38/49 kB | 32/98 kB Progress (4): 507/782 kB | 47/71 kB | 38/49 kB | 32/98 kB Progress (4): 524/782 kB | 47/71 kB | 38/49 kB | 32/98 kB Progress (4): 524/782 kB | 48/71 kB | 38/49 kB | 32/98 kB Progress (4): 540/782 kB | 48/71 kB | 38/49 kB | 32/98 kB Progress (4): 540/782 kB | 49/71 kB | 38/49 kB | 32/98 kB Progress (4): 556/782 kB | 49/71 kB | 38/49 kB | 32/98 kB Progress (4): 556/782 kB | 49/71 kB | 40/49 kB | 32/98 kB Progress (4): 556/782 kB | 51/71 kB | 40/49 kB | 32/98 kB Progress (4): 556/782 kB | 51/71 kB | 41/49 kB | 32/98 kB Progress (4): 556/782 kB | 52/71 kB | 41/49 kB | 32/98 kB Progress (4): 556/782 kB | 52/71 kB | 43/49 kB | 32/98 kB Progress (4): 556/782 kB | 53/71 kB | 43/49 kB | 32/98 kB Progress (4): 573/782 kB | 53/71 kB | 43/49 kB | 32/98 kB Progress (4): 573/782 kB | 53/71 kB | 44/49 kB | 32/98 kB Progress (4): 573/782 kB | 55/71 kB | 44/49 kB | 32/98 kB Progress (4): 589/782 kB | 55/71 kB | 44/49 kB | 32/98 kB Progress (4): 589/782 kB | 56/71 kB | 44/49 kB | 32/98 kB Progress (4): 589/782 kB | 56/71 kB | 45/49 kB | 32/98 kB Progress (4): 589/782 kB | 58/71 kB | 45/49 kB | 32/98 kB Progress (4): 589/782 kB | 58/71 kB | 47/49 kB | 32/98 kB Progress (4): 589/782 kB | 59/71 kB | 47/49 kB | 32/98 kB Progress (4): 606/782 kB | 59/71 kB | 47/49 kB | 32/98 kB Progress (4): 606/782 kB | 59/71 kB | 48/49 kB | 32/98 kB Progress (4): 606/782 kB | 59/71 kB | 49 kB | 32/98 kB Progress (4): 606/782 kB | 60/71 kB | 49 kB | 32/98 kB Progress (4): 622/782 kB | 60/71 kB | 49 kB | 32/98 kB Progress (4): 622/782 kB | 62/71 kB | 49 kB | 32/98 kB Progress (4): 622/782 kB | 62/71 kB | 49 kB | 32/98 kB Progress (4): 638/782 kB | 62/71 kB | 49 kB | 32/98 kB Progress (4): 655/782 kB | 62/71 kB | 49 kB | 32/98 kB Progress (4): 671/782 kB | 62/71 kB | 49 kB | 32/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 714 kB/s) 2024-09-12T00:50:53.127 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-12T00:50:53.129 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (3): 688/782 kB | 62/71 kB | 32/98 kB Progress (3): 704/782 kB | 62/71 kB | 32/98 kB Progress (3): 704/782 kB | 71 kB | 32/98 kB Progress (3): 720/782 kB | 71 kB | 32/98 kB Progress (3): 737/782 kB | 71 kB | 32/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 980 kB/s) 2024-09-12T00:50:53.129 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (2): 753/782 kB | 32/98 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-12T00:50:53.130 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (2): 753/782 kB | 49/98 kB Progress (2): 769/782 kB | 49/98 kB Progress (2): 782 kB | 49/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 11 MB/s) 2024-09-12T00:50:53.130 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-12T00:50:53.135 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 65/98 kB Progress (2): 65/98 kB | 1.4/11 kB Progress (2): 65/98 kB | 2.8/11 kB Progress (2): 65/98 kB | 4.1/11 kB Progress (2): 65/98 kB | 5.5/11 kB Progress (2): 65/98 kB | 6.9/11 kB Progress (2): 65/98 kB | 8.3/11 kB Progress (2): 65/98 kB | 9.7/11 kB Progress (2): 65/98 kB | 11/11 kB Progress (2): 65/98 kB | 11 kB Progress (2): 81/98 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 150 kB/s) 2024-09-12T00:50:53.135 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-12T00:50:53.137 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 98/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.2 MB/s) 2024-09-12T00:50:53.137 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-12T00:50:53.145 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Progress (2): 30 kB | 16/205 kB Progress (3): 30 kB | 16/205 kB | 16/81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 351 kB/s) 2024-09-12T00:50:53.145 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-12T00:50:53.146 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (2): 16/205 kB | 33/81 kB Progress (2): 16/205 kB | 49/81 kB Progress (2): 32/205 kB | 49/81 kB Progress (2): 32/205 kB | 66/81 kB Progress (2): 32/205 kB | 81 kB Progress (2): 49/205 kB | 81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 956 kB/s) 2024-09-12T00:50:53.146 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-12T00:50:53.152 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 65/205 kB Progress (2): 65/205 kB | 1.4/798 kB Progress (2): 65/205 kB | 2.8/798 kB Progress (2): 65/205 kB | 4.1/798 kB Progress (2): 65/205 kB | 5.5/798 kB Progress (2): 65/205 kB | 6.9/798 kB Progress (2): 65/205 kB | 8.3/798 kB Progress (2): 65/205 kB | 9.7/798 kB Progress (2): 65/205 kB | 11/798 kB Progress (2): 65/205 kB | 12/798 kB Progress (2): 65/205 kB | 14/798 kB Progress (2): 65/205 kB | 15/798 kB Progress (3): 65/205 kB | 15/798 kB | 13 kB Progress (3): 65/205 kB | 16/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 147 kB/s) 2024-09-12T00:50:53.152 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-12T00:50:53.163 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (2): 65/205 kB | 32/798 kB Progress (2): 81/205 kB | 32/798 kB Progress (2): 98/205 kB | 32/798 kB Progress (2): 114/205 kB | 32/798 kB Progress (2): 130/205 kB | 32/798 kB Progress (2): 146/205 kB | 32/798 kB Progress (2): 162/205 kB | 32/798 kB Progress (3): 162/205 kB | 32/798 kB | 15/182 kB Progress (3): 162/205 kB | 32/798 kB | 31/182 kB Progress (3): 179/205 kB | 32/798 kB | 31/182 kB Progress (3): 179/205 kB | 32/798 kB | 48/182 kB Progress (3): 195/205 kB | 32/798 kB | 48/182 kB Progress (3): 205 kB | 32/798 kB | 48/182 kB Progress (4): 205 kB | 32/798 kB | 48/182 kB | 16/151 kB Progress (4): 205 kB | 32/798 kB | 64/182 kB | 16/151 kB Progress (4): 205 kB | 32/798 kB | 64/182 kB | 33/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.0 MB/s) 2024-09-12T00:50:53.163 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (3): 49/798 kB | 64/182 kB | 33/151 kB Progress (3): 49/798 kB | 64/182 kB | 49/151 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-12T00:50:53.165 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (3): 49/798 kB | 81/182 kB | 49/151 kB Progress (3): 49/798 kB | 81/182 kB | 63/151 kB Progress (3): 49/798 kB | 81/182 kB | 79/151 kB Progress (3): 49/798 kB | 81/182 kB | 96/151 kB Progress (3): 49/798 kB | 95/182 kB | 96/151 kB Progress (3): 49/798 kB | 95/182 kB | 112/151 kB Progress (3): 49/798 kB | 95/182 kB | 128/151 kB Progress (3): 64/798 kB | 95/182 kB | 128/151 kB Progress (3): 64/798 kB | 95/182 kB | 145/151 kB Progress (3): 64/798 kB | 95/182 kB | 151 kB Progress (3): 64/798 kB | 111/182 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.5 MB/s) 2024-09-12T00:50:53.165 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-12T00:50:53.168 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (2): 81/798 kB | 111/182 kB Progress (3): 81/798 kB | 111/182 kB | 16/27 kB Progress (3): 81/798 kB | 111/182 kB | 27 kB Progress (3): 97/798 kB | 111/182 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 260 kB/s) 2024-09-12T00:50:53.168 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-12T00:50:53.174 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (2): 97/798 kB | 128/182 kB Progress (2): 97/798 kB | 144/182 kB Progress (2): 97/798 kB | 160/182 kB Progress (2): 97/798 kB | 177/182 kB Progress (2): 97/798 kB | 182 kB Progress (2): 114/798 kB | 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.6 MB/s) 2024-09-12T00:50:53.175 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-12T00:50:53.178 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 130/798 kB Progress (1): 146/798 kB Progress (1): 163/798 kB Progress (2): 163/798 kB | 16/30 kB Progress (2): 163/798 kB | 30 kB Progress (2): 179/798 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 259 kB/s) 2024-09-12T00:50:53.178 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-12T00:50:53.183 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 195/798 kB Progress (1): 212/798 kB Progress (2): 212/798 kB | 16/385 kB Progress (2): 212/798 kB | 32/385 kB Progress (2): 212/798 kB | 49/385 kB Progress (2): 212/798 kB | 65/385 kB Progress (2): 228/798 kB | 65/385 kB Progress (2): 228/798 kB | 81/385 kB Progress (2): 228/798 kB | 98/385 kB Progress (2): 245/798 kB | 98/385 kB Progress (2): 245/798 kB | 114/385 kB Progress (2): 245/798 kB | 130/385 kB Progress (2): 245/798 kB | 147/385 kB Progress (2): 245/798 kB | 163/385 kB Progress (2): 245/798 kB | 180/385 kB Progress (3): 245/798 kB | 180/385 kB | 13 kB Progress (3): 245/798 kB | 196/385 kB | 13 kB Progress (3): 245/798 kB | 212/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 109 kB/s) 2024-09-12T00:50:53.183 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-12T00:50:53.186 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (2): 245/798 kB | 229/385 kB Progress (2): 245/798 kB | 245/385 kB Progress (2): 245/798 kB | 262/385 kB Progress (2): 245/798 kB | 278/385 kB Progress (2): 245/798 kB | 294/385 kB Progress (2): 245/798 kB | 311/385 kB Progress (2): 245/798 kB | 327/385 kB Progress (2): 245/798 kB | 343/385 kB Progress (2): 245/798 kB | 360/385 kB Progress (2): 245/798 kB | 376/385 kB Progress (2): 245/798 kB | 385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 3.1 MB/s) 2024-09-12T00:50:53.186 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-12T00:50:53.191 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 261/798 kB Progress (1): 277/798 kB Progress (1): 294/798 kB Progress (1): 310/798 kB Progress (1): 327/798 kB Progress (1): 343/798 kB Progress (1): 359/798 kB Progress (2): 359/798 kB | 16/75 kB Progress (2): 359/798 kB | 33/75 kB Progress (2): 376/798 kB | 33/75 kB Progress (2): 376/798 kB | 49/75 kB Progress (2): 392/798 kB | 49/75 kB Progress (2): 392/798 kB | 64/75 kB Progress (2): 392/798 kB | 75 kB Progress (2): 408/798 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 578 kB/s) 2024-09-12T00:50:53.192 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 425/798 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-12T00:50:53.206 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 441/798 kB Progress (1): 458/798 kB Progress (1): 474/798 kB Progress (1): 490/798 kB Progress (2): 490/798 kB | 16/780 kB Progress (2): 507/798 kB | 16/780 kB Progress (2): 523/798 kB | 16/780 kB Progress (2): 523/798 kB | 33/780 kB Progress (2): 540/798 kB | 33/780 kB Progress (2): 540/798 kB | 49/780 kB Progress (2): 540/798 kB | 63/780 kB Progress (2): 540/798 kB | 79/780 kB Progress (2): 540/798 kB | 96/780 kB Progress (2): 540/798 kB | 112/780 kB Progress (3): 540/798 kB | 112/780 kB | 16/329 kB Progress (3): 540/798 kB | 129/780 kB | 16/329 kB Progress (3): 540/798 kB | 129/780 kB | 32/329 kB Progress (3): 540/798 kB | 129/780 kB | 49/329 kB Progress (3): 540/798 kB | 145/780 kB | 49/329 kB Progress (3): 556/798 kB | 145/780 kB | 49/329 kB Progress (3): 556/798 kB | 161/780 kB | 49/329 kB Progress (3): 556/798 kB | 161/780 kB | 65/329 kB Progress (3): 572/798 kB | 161/780 kB | 65/329 kB Progress (3): 589/798 kB | 161/780 kB | 65/329 kB Progress (3): 589/798 kB | 178/780 kB | 65/329 kB Progress (3): 605/798 kB | 178/780 kB | 65/329 kB Progress (3): 605/798 kB | 178/780 kB | 78/329 kB Progress (3): 605/798 kB | 194/780 kB | 78/329 kB Progress (4): 605/798 kB | 194/780 kB | 78/329 kB | 16/501 kB Progress (4): 621/798 kB | 194/780 kB | 78/329 kB | 16/501 kB Progress (4): 621/798 kB | 194/780 kB | 78/329 kB | 33/501 kB Progress (4): 638/798 kB | 194/780 kB | 78/329 kB | 33/501 kB Progress (4): 638/798 kB | 211/780 kB | 78/329 kB | 33/501 kB Progress (4): 638/798 kB | 211/780 kB | 95/329 kB | 33/501 kB Progress (4): 638/798 kB | 211/780 kB | 95/329 kB | 49/501 kB Progress (4): 654/798 kB | 211/780 kB | 95/329 kB | 49/501 kB Progress (4): 654/798 kB | 211/780 kB | 95/329 kB | 64/501 kB Progress (4): 654/798 kB | 227/780 kB | 95/329 kB | 64/501 kB Progress (4): 671/798 kB | 227/780 kB | 95/329 kB | 64/501 kB Progress (4): 671/798 kB | 227/780 kB | 111/329 kB | 64/501 kB Progress (4): 671/798 kB | 227/780 kB | 111/329 kB | 81/501 kB Progress (4): 687/798 kB | 227/780 kB | 111/329 kB | 81/501 kB Progress (4): 687/798 kB | 243/780 kB | 111/329 kB | 81/501 kB Progress (4): 687/798 kB | 243/780 kB | 111/329 kB | 97/501 kB Progress (4): 703/798 kB | 243/780 kB | 111/329 kB | 97/501 kB Progress (4): 703/798 kB | 243/780 kB | 111/329 kB | 114/501 kB Progress (4): 720/798 kB | 243/780 kB | 111/329 kB | 114/501 kB Progress (4): 720/798 kB | 260/780 kB | 111/329 kB | 114/501 kB Progress (4): 720/798 kB | 260/780 kB | 111/329 kB | 130/501 kB Progress (4): 736/798 kB | 260/780 kB | 111/329 kB | 130/501 kB Progress (4): 736/798 kB | 260/780 kB | 111/329 kB | 146/501 kB Progress (4): 753/798 kB | 260/780 kB | 111/329 kB | 146/501 kB Progress (4): 753/798 kB | 276/780 kB | 111/329 kB | 146/501 kB Progress (4): 753/798 kB | 276/780 kB | 111/329 kB | 163/501 kB Progress (4): 769/798 kB | 276/780 kB | 111/329 kB | 163/501 kB Progress (4): 769/798 kB | 276/780 kB | 111/329 kB | 179/501 kB Progress (4): 785/798 kB | 276/780 kB | 111/329 kB | 179/501 kB Progress (4): 785/798 kB | 292/780 kB | 111/329 kB | 179/501 kB Progress (4): 785/798 kB | 292/780 kB | 111/329 kB | 195/501 kB Progress (4): 798 kB | 292/780 kB | 111/329 kB | 195/501 kB Progress (4): 798 kB | 292/780 kB | 111/329 kB | 212/501 kB Progress (5): 798 kB | 292/780 kB | 111/329 kB | 212/501 kB | 16/354 kB Progress (5): 798 kB | 309/780 kB | 111/329 kB | 212/501 kB | 16/354 kB Progress (5): 798 kB | 309/780 kB | 111/329 kB | 228/501 kB | 16/354 kB Progress (5): 798 kB | 309/780 kB | 111/329 kB | 228/501 kB | 33/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 5.5 MB/s) 2024-09-12T00:50:53.207 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-12T00:50:53.213 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (4): 309/780 kB | 111/329 kB | 245/501 kB | 33/354 kB Progress (4): 325/780 kB | 111/329 kB | 245/501 kB | 33/354 kB Progress (4): 325/780 kB | 111/329 kB | 245/501 kB | 49/354 kB Progress (4): 325/780 kB | 111/329 kB | 261/501 kB | 49/354 kB Progress (4): 325/780 kB | 111/329 kB | 261/501 kB | 64/354 kB Progress (4): 342/780 kB | 111/329 kB | 261/501 kB | 64/354 kB Progress (4): 342/780 kB | 111/329 kB | 277/501 kB | 64/354 kB Progress (4): 342/780 kB | 111/329 kB | 277/501 kB | 81/354 kB Progress (4): 342/780 kB | 111/329 kB | 294/501 kB | 81/354 kB Progress (4): 342/780 kB | 111/329 kB | 294/501 kB | 97/354 kB Progress (4): 358/780 kB | 111/329 kB | 294/501 kB | 97/354 kB Progress (4): 358/780 kB | 111/329 kB | 310/501 kB | 97/354 kB Progress (4): 358/780 kB | 111/329 kB | 310/501 kB | 114/354 kB Progress (4): 358/780 kB | 111/329 kB | 327/501 kB | 114/354 kB Progress (4): 358/780 kB | 111/329 kB | 343/501 kB | 114/354 kB Progress (4): 374/780 kB | 111/329 kB | 343/501 kB | 114/354 kB Progress (4): 374/780 kB | 111/329 kB | 343/501 kB | 130/354 kB Progress (4): 374/780 kB | 111/329 kB | 359/501 kB | 130/354 kB Progress (4): 374/780 kB | 111/329 kB | 376/501 kB | 130/354 kB Progress (4): 374/780 kB | 111/329 kB | 376/501 kB | 146/354 kB Progress (4): 391/780 kB | 111/329 kB | 376/501 kB | 146/354 kB Progress (4): 391/780 kB | 111/329 kB | 392/501 kB | 146/354 kB Progress (4): 391/780 kB | 127/329 kB | 392/501 kB | 146/354 kB Progress (4): 391/780 kB | 127/329 kB | 392/501 kB | 163/354 kB Progress (4): 391/780 kB | 127/329 kB | 408/501 kB | 163/354 kB Progress (4): 391/780 kB | 144/329 kB | 408/501 kB | 163/354 kB Progress (4): 407/780 kB | 144/329 kB | 408/501 kB | 163/354 kB Progress (4): 407/780 kB | 144/329 kB | 408/501 kB | 179/354 kB Progress (4): 407/780 kB | 144/329 kB | 425/501 kB | 179/354 kB Progress (4): 407/780 kB | 144/329 kB | 441/501 kB | 179/354 kB Progress (4): 407/780 kB | 144/329 kB | 441/501 kB | 195/354 kB Progress (4): 424/780 kB | 144/329 kB | 441/501 kB | 195/354 kB Progress (4): 424/780 kB | 144/329 kB | 458/501 kB | 195/354 kB Progress (4): 424/780 kB | 144/329 kB | 458/501 kB | 212/354 kB Progress (4): 424/780 kB | 160/329 kB | 458/501 kB | 212/354 kB Progress (4): 424/780 kB | 160/329 kB | 474/501 kB | 212/354 kB Progress (4): 440/780 kB | 160/329 kB | 474/501 kB | 212/354 kB Progress (4): 440/780 kB | 177/329 kB | 474/501 kB | 212/354 kB Progress (4): 440/780 kB | 177/329 kB | 474/501 kB | 228/354 kB Progress (4): 440/780 kB | 177/329 kB | 490/501 kB | 228/354 kB Progress (4): 440/780 kB | 177/329 kB | 501 kB | 228/354 kB Progress (4): 456/780 kB | 177/329 kB | 501 kB | 228/354 kB Progress (4): 456/780 kB | 193/329 kB | 501 kB | 228/354 kB Progress (4): 456/780 kB | 193/329 kB | 501 kB | 245/354 kB Progress (4): 473/780 kB | 193/329 kB | 501 kB | 245/354 kB Progress (4): 473/780 kB | 193/329 kB | 501 kB | 261/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 3.4 MB/s) 2024-09-12T00:50:53.213 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (3): 473/780 kB | 209/329 kB | 261/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-12T00:50:53.217 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (3): 489/780 kB | 209/329 kB | 261/354 kB Progress (3): 489/780 kB | 209/329 kB | 277/354 kB Progress (3): 489/780 kB | 226/329 kB | 277/354 kB Progress (3): 489/780 kB | 226/329 kB | 294/354 kB Progress (3): 505/780 kB | 226/329 kB | 294/354 kB Progress (3): 505/780 kB | 242/329 kB | 294/354 kB Progress (3): 522/780 kB | 242/329 kB | 294/354 kB Progress (3): 538/780 kB | 242/329 kB | 294/354 kB Progress (3): 538/780 kB | 259/329 kB | 294/354 kB Progress (3): 555/780 kB | 259/329 kB | 294/354 kB Progress (3): 555/780 kB | 275/329 kB | 294/354 kB Progress (3): 571/780 kB | 275/329 kB | 294/354 kB Progress (3): 571/780 kB | 291/329 kB | 294/354 kB Progress (3): 587/780 kB | 291/329 kB | 294/354 kB Progress (3): 587/780 kB | 308/329 kB | 294/354 kB Progress (3): 604/780 kB | 308/329 kB | 294/354 kB Progress (3): 604/780 kB | 324/329 kB | 294/354 kB Progress (3): 620/780 kB | 324/329 kB | 294/354 kB Progress (3): 620/780 kB | 329 kB | 294/354 kB Progress (3): 637/780 kB | 329 kB | 294/354 kB Progress (3): 653/780 kB | 329 kB | 294/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.1 MB/s) 2024-09-12T00:50:53.217 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-12T00:50:53.220 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (2): 669/780 kB | 294/354 kB Progress (2): 669/780 kB | 310/354 kB Progress (2): 686/780 kB | 310/354 kB Progress (2): 686/780 kB | 327/354 kB Progress (2): 702/780 kB | 327/354 kB Progress (2): 702/780 kB | 343/354 kB Progress (2): 718/780 kB | 343/354 kB Progress (2): 718/780 kB | 354 kB Progress (2): 735/780 kB | 354 kB Progress (2): 751/780 kB | 354 kB Progress (2): 768/780 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.3 MB/s) 2024-09-12T00:50:53.220 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-12T00:50:53.221 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 780 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 5.0 MB/s) 2024-09-12T00:50:53.221 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-12T00:50:53.223 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/41 kB Progress (1): 33/41 kB Progress (1): 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 257 kB/s) 2024-09-12T00:50:53.223 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-12T00:50:53.228 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 39 kB/s) 2024-09-12T00:50:53.228 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-12T00:50:53.238 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/586 kB Progress (1): 32/586 kB Progress (1): 49/586 kB Progress (1): 65/586 kB Progress (1): 81/586 kB Progress (1): 98/586 kB Progress (1): 114/586 kB Progress (1): 130/586 kB Progress (1): 147/586 kB Progress (1): 163/586 kB Progress (1): 180/586 kB Progress (2): 180/586 kB | 16/211 kB Progress (2): 196/586 kB | 16/211 kB Progress (2): 196/586 kB | 32/211 kB Progress (2): 212/586 kB | 32/211 kB Progress (3): 212/586 kB | 32/211 kB | 14 kB Progress (3): 212/586 kB | 49/211 kB | 14 kB Progress (3): 229/586 kB | 49/211 kB | 14 kB Progress (3): 245/586 kB | 49/211 kB | 14 kB Progress (3): 245/586 kB | 65/211 kB | 14 kB Progress (3): 262/586 kB | 65/211 kB | 14 kB Progress (3): 262/586 kB | 81/211 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 82 kB/s) 2024-09-12T00:50:53.238 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (2): 278/586 kB | 81/211 kB Progress (2): 278/586 kB | 98/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-12T00:50:53.242 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (2): 294/586 kB | 98/211 kB Progress (2): 294/586 kB | 114/211 kB Progress (2): 311/586 kB | 114/211 kB Progress (2): 311/586 kB | 130/211 kB Progress (3): 311/586 kB | 130/211 kB | 16/106 kB Progress (3): 327/586 kB | 130/211 kB | 16/106 kB Progress (3): 327/586 kB | 147/211 kB | 16/106 kB Progress (3): 327/586 kB | 147/211 kB | 32/106 kB Progress (3): 343/586 kB | 147/211 kB | 32/106 kB Progress (3): 343/586 kB | 163/211 kB | 32/106 kB Progress (3): 343/586 kB | 163/211 kB | 49/106 kB Progress (3): 360/586 kB | 163/211 kB | 49/106 kB Progress (3): 360/586 kB | 180/211 kB | 49/106 kB Progress (3): 360/586 kB | 180/211 kB | 65/106 kB Progress (3): 376/586 kB | 180/211 kB | 65/106 kB Progress (3): 376/586 kB | 196/211 kB | 65/106 kB Progress (3): 376/586 kB | 196/211 kB | 81/106 kB Progress (3): 393/586 kB | 196/211 kB | 81/106 kB Progress (3): 393/586 kB | 211 kB | 81/106 kB Progress (3): 402/586 kB | 211 kB | 81/106 kB Progress (3): 402/586 kB | 211 kB | 98/106 kB Progress (3): 402/586 kB | 211 kB | 106 kB Progress (3): 418/586 kB | 211 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.2 MB/s) 2024-09-12T00:50:53.242 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-12T00:50:53.242 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (2): 435/586 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 597 kB/s) 2024-09-12T00:50:53.242 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-12T00:50:53.243 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (2): 435/586 kB | 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 38 kB/s) 2024-09-12T00:50:53.243 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-12T00:50:53.247 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 451/586 kB Progress (1): 468/586 kB Progress (1): 484/586 kB Progress (1): 500/586 kB Progress (1): 517/586 kB Progress (1): 533/586 kB Progress (1): 549/586 kB Progress (1): 566/586 kB Progress (1): 582/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.2 MB/s) 2024-09-12T00:50:53.247 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-12T00:50:53.257 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/245 kB Progress (1): 32/245 kB Progress (1): 49/245 kB Progress (1): 65/245 kB Progress (1): 81/245 kB Progress (1): 98/245 kB Progress (1): 114/245 kB Progress (2): 114/245 kB | 15 kB Progress (3): 114/245 kB | 15 kB | 16/205 kB Progress (3): 130/245 kB | 15 kB | 16/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 79 kB/s) 2024-09-12T00:50:53.257 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-12T00:50:53.259 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (2): 130/245 kB | 33/205 kB Progress (2): 147/245 kB | 33/205 kB Progress (2): 147/245 kB | 49/205 kB Progress (3): 147/245 kB | 49/205 kB | 16/16 kB Progress (3): 147/245 kB | 49/205 kB | 16 kB Progress (3): 147/245 kB | 64/205 kB | 16 kB Progress (3): 163/245 kB | 64/205 kB | 16 kB Progress (3): 163/245 kB | 80/205 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 84 kB/s) 2024-09-12T00:50:53.259 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-12T00:50:53.262 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (2): 163/245 kB | 96/205 kB Progress (2): 180/245 kB | 96/205 kB Progress (2): 180/245 kB | 113/205 kB Progress (2): 196/245 kB | 113/205 kB Progress (2): 196/245 kB | 129/205 kB Progress (2): 196/245 kB | 145/205 kB Progress (2): 212/245 kB | 145/205 kB Progress (2): 212/245 kB | 162/205 kB Progress (2): 229/245 kB | 162/205 kB Progress (2): 229/245 kB | 178/205 kB Progress (2): 229/245 kB | 195/205 kB Progress (2): 245 kB | 195/205 kB Progress (2): 245 kB | 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 1.0 MB/s) 2024-09-12T00:50:53.262 INFO:tasks.workunit.client.0.smithi070.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.2 MB/s) 2024-09-12T00:50:53.262 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-12T00:50:53.262 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-12T00:50:53.263 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 32 kB/s) 2024-09-12T00:50:53.272 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 108 kB/s) 2024-09-12T00:50:53.274 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 114 kB/s) 2024-09-12T00:50:53.278 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (2): 33/184 kB | 16/17 kB Progress (2): 49/184 kB | 16/17 kB Progress (2): 49/184 kB | 17 kB Progress (2): 61/184 kB | 17 kB Progress (2): 78/184 kB | 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 81 kB/s) 2024-09-12T00:50:53.280 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 94/184 kB Progress (1): 111/184 kB Progress (1): 127/184 kB Progress (1): 143/184 kB Progress (1): 160/184 kB Progress (1): 176/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 855 kB/s) 2024-09-12T00:50:53.299 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] 2024-09-12T00:50:53.299 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-12T00:50:53.307 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-12T00:50:53.322 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 364 kB/s) 2024-09-12T00:50:53.325 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-12T00:50:53.340 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 340 kB/s) 2024-09-12T00:50:53.342 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-12T00:50:53.361 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/43 kB Progress (1): 32/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.3 MB/s) 2024-09-12T00:50:53.365 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-12T00:50:53.380 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 891 kB/s) 2024-09-12T00:50:53.385 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-12T00:50:53.402 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/153 kB Progress (1): 32/153 kB Progress (1): 49/153 kB Progress (1): 65/153 kB Progress (1): 78/153 kB Progress (1): 94/153 kB Progress (1): 111/153 kB Progress (1): 127/153 kB Progress (1): 144/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 9.0 MB/s) 2024-09-12T00:50:53.403 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-12T00:50:53.422 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/215 kB Progress (1): 32/215 kB Progress (1): 49/215 kB Progress (1): 65/215 kB Progress (1): 79/215 kB Progress (1): 96/215 kB Progress (1): 112/215 kB Progress (1): 128/215 kB Progress (1): 145/215 kB Progress (1): 161/215 kB Progress (1): 178/215 kB Progress (1): 194/215 kB Progress (1): 210/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 11 MB/s) 2024-09-12T00:50:53.511 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] 2024-09-12T00:50:53.512 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T00:50:53.518 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-12T00:50:53.535 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 166 kB/s) 2024-09-12T00:50:53.538 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-12T00:50:53.555 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.4 MB/s) 2024-09-12T00:50:53.561 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-12T00:50:53.578 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 548 kB/s) 2024-09-12T00:50:53.583 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-12T00:50:53.599 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.5 MB/s) 2024-09-12T00:50:53.605 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-12T00:50:53.622 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 355 kB/s) 2024-09-12T00:50:53.625 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-12T00:50:53.641 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 201 kB/s) 2024-09-12T00:50:53.647 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-12T00:50:53.662 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 38 kB/s) 2024-09-12T00:50:53.666 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-12T00:50:53.681 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 171 kB/s) 2024-09-12T00:50:53.685 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-12T00:50:53.700 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 881 kB/s) 2024-09-12T00:50:53.705 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-12T00:50:53.720 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 200 kB/s) 2024-09-12T00:50:53.723 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-12T00:50:53.739 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 522 kB/s) 2024-09-12T00:50:53.743 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-12T00:50:53.759 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 492 kB/s) 2024-09-12T00:50:53.765 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-12T00:50:53.781 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 501 kB/s) 2024-09-12T00:50:53.788 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-12T00:50:53.803 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.2 MB/s) 2024-09-12T00:50:53.814 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-12T00:50:53.830 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 340 kB/s) 2024-09-12T00:50:53.835 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-12T00:50:53.852 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 1.7 MB/s) 2024-09-12T00:50:53.863 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-12T00:50:53.879 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 319 kB/s) 2024-09-12T00:50:53.888 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-12T00:50:53.906 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/85 kB Progress (1): 32/85 kB Progress (1): 49/85 kB Progress (1): 65/85 kB Progress (1): 81/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 4.5 MB/s) 2024-09-12T00:50:53.907 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-12T00:50:53.908 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-12T00:50:53.908 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-12T00:50:53.908 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-12T00:50:53.909 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-12T00:50:53.925 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/269 kB Progress (2): 16/269 kB | 16/55 kB Progress (2): 33/269 kB | 16/55 kB Progress (3): 33/269 kB | 16/55 kB | 8.5 kB Progress (4): 33/269 kB | 16/55 kB | 8.5 kB | 16/41 kB Progress (4): 49/269 kB | 16/55 kB | 8.5 kB | 16/41 kB Progress (4): 49/269 kB | 32/55 kB | 8.5 kB | 16/41 kB Progress (4): 62/269 kB | 32/55 kB | 8.5 kB | 16/41 kB Progress (4): 62/269 kB | 32/55 kB | 8.5 kB | 33/41 kB Progress (4): 62/269 kB | 49/55 kB | 8.5 kB | 33/41 kB Progress (4): 78/269 kB | 49/55 kB | 8.5 kB | 33/41 kB Progress (4): 78/269 kB | 49/55 kB | 8.5 kB | 41 kB Progress (4): 78/269 kB | 55 kB | 8.5 kB | 41 kB Progress (4): 94/269 kB | 55 kB | 8.5 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 530 kB/s) 2024-09-12T00:50:53.925 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-12T00:50:53.925 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (3): 111/269 kB | 55 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.4 MB/s) 2024-09-12T00:50:53.925 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-12T00:50:53.925 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (2): 127/269 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.2 MB/s) 2024-09-12T00:50:53.926 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 144/269 kB Progress (2): 144/269 kB | 2.5 kB Progress (2): 160/269 kB | 2.5 kB Progress (2): 176/269 kB | 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 139 kB/s) 2024-09-12T00:50:53.928 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 193/269 kB Progress (1): 209/269 kB Progress (1): 225/269 kB Progress (1): 242/269 kB Progress (1): 258/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 13 MB/s) 2024-09-12T00:50:53.948 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/587 kB Progress (2): 16/587 kB | 16/327 kB Progress (2): 33/587 kB | 16/327 kB Progress (2): 49/587 kB | 16/327 kB Progress (2): 49/587 kB | 32/327 kB Progress (2): 65/587 kB | 32/327 kB Progress (2): 81/587 kB | 32/327 kB Progress (2): 81/587 kB | 49/327 kB Progress (2): 98/587 kB | 49/327 kB Progress (2): 114/587 kB | 49/327 kB Progress (2): 114/587 kB | 65/327 kB Progress (2): 131/587 kB | 65/327 kB Progress (2): 131/587 kB | 78/327 kB Progress (2): 147/587 kB | 78/327 kB Progress (2): 163/587 kB | 78/327 kB Progress (2): 163/587 kB | 94/327 kB Progress (2): 180/587 kB | 94/327 kB Progress (2): 196/587 kB | 94/327 kB Progress (2): 196/587 kB | 111/327 kB Progress (2): 212/587 kB | 111/327 kB Progress (2): 229/587 kB | 111/327 kB Progress (2): 229/587 kB | 127/327 kB Progress (2): 245/587 kB | 127/327 kB Progress (2): 245/587 kB | 143/327 kB Progress (2): 262/587 kB | 143/327 kB Progress (2): 278/587 kB | 143/327 kB Progress (2): 278/587 kB | 160/327 kB Progress (2): 294/587 kB | 160/327 kB Progress (2): 311/587 kB | 160/327 kB Progress (2): 311/587 kB | 176/327 kB Progress (2): 327/587 kB | 176/327 kB Progress (2): 344/587 kB | 176/327 kB Progress (2): 344/587 kB | 192/327 kB Progress (2): 360/587 kB | 192/327 kB Progress (2): 376/587 kB | 192/327 kB Progress (2): 376/587 kB | 209/327 kB Progress (2): 393/587 kB | 209/327 kB Progress (2): 393/587 kB | 225/327 kB Progress (2): 409/587 kB | 225/327 kB Progress (2): 425/587 kB | 225/327 kB Progress (2): 425/587 kB | 242/327 kB Progress (2): 442/587 kB | 242/327 kB Progress (2): 458/587 kB | 242/327 kB Progress (2): 458/587 kB | 258/327 kB Progress (2): 475/587 kB | 258/327 kB Progress (2): 491/587 kB | 258/327 kB Progress (2): 491/587 kB | 274/327 kB Progress (2): 491/587 kB | 278/327 kB Progress (2): 507/587 kB | 278/327 kB Progress (2): 524/587 kB | 278/327 kB Progress (2): 524/587 kB | 295/327 kB Progress (2): 540/587 kB | 295/327 kB Progress (2): 557/587 kB | 295/327 kB Progress (2): 557/587 kB | 311/327 kB Progress (2): 573/587 kB | 311/327 kB Progress (2): 587 kB | 311/327 kB Progress (2): 587 kB | 327 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 15 MB/s) 2024-09-12T00:50:53.949 INFO:tasks.workunit.client.0.smithi070.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 8.2 MB/s) 2024-09-12T00:50:53.986 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T00:50:53.987 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] 2024-09-12T00:50:53.987 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T00:50:53.991 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-12T00:50:54.006 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 316 kB/s) 2024-09-12T00:50:54.009 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-12T00:50:54.023 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 424 kB/s) 2024-09-12T00:50:54.026 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-12T00:50:54.041 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/33 kB Progress (1): 32/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.2 MB/s) 2024-09-12T00:50:54.043 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-12T00:50:54.058 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 932 kB/s) 2024-09-12T00:50:54.063 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-12T00:50:54.078 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 54 kB/s) 2024-09-12T00:50:54.080 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-12T00:50:54.095 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 283 kB/s) 2024-09-12T00:50:54.097 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-12T00:50:54.114 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.1 MB/s) 2024-09-12T00:50:54.118 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-12T00:50:54.133 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 331 kB/s) 2024-09-12T00:50:54.136 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-12T00:50:54.152 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 259 kB/s) 2024-09-12T00:50:54.156 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-12T00:50:54.171 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 148 kB/s) 2024-09-12T00:50:54.174 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-12T00:50:54.189 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 706 kB/s) 2024-09-12T00:50:54.193 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-12T00:50:54.208 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-09-12T00:50:54.212 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-12T00:50:54.228 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 386 kB/s) 2024-09-12T00:50:54.232 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-12T00:50:54.247 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 70 kB/s) 2024-09-12T00:50:54.249 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-12T00:50:54.264 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 559 kB/s) 2024-09-12T00:50:54.267 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-12T00:50:54.281 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 179 kB/s) 2024-09-12T00:50:54.285 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-12T00:50:54.299 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 375 kB/s) 2024-09-12T00:50:54.302 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-12T00:50:54.317 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 81 kB/s) 2024-09-12T00:50:54.321 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-12T00:50:54.337 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 48 kB/s) 2024-09-12T00:50:54.339 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-12T00:50:54.354 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 431 kB/s) 2024-09-12T00:50:54.356 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-12T00:50:54.371 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.7 MB/s) 2024-09-12T00:50:54.374 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-12T00:50:54.389 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 80 kB/s) 2024-09-12T00:50:54.391 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-12T00:50:54.406 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 88 kB/s) 2024-09-12T00:50:54.419 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-12T00:50:54.435 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 846 kB/s) 2024-09-12T00:50:54.436 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-12T00:50:54.436 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-12T00:50:54.436 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-12T00:50:54.436 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-12T00:50:54.437 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-12T00:50:54.453 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/122 kB Progress (3): 4.2 kB | 16/122 kB | 16/55 kB Progress (3): 4.2 kB | 33/122 kB | 16/55 kB Progress (3): 4.2 kB | 33/122 kB | 32/55 kB Progress (3): 4.2 kB | 49/122 kB | 32/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 248 kB/s) 2024-09-12T00:50:54.453 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (2): 49/122 kB | 49/55 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-12T00:50:54.453 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (2): 49/122 kB | 55 kB Progress (3): 49/122 kB | 55 kB | 16/27 kB Progress (3): 66/122 kB | 55 kB | 16/27 kB Progress (4): 66/122 kB | 55 kB | 16/27 kB | 16/334 kB Progress (4): 66/122 kB | 55 kB | 27 kB | 16/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.2 MB/s) 2024-09-12T00:50:54.453 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-12T00:50:54.453 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (3): 82/122 kB | 27 kB | 16/334 kB Progress (3): 82/122 kB | 27 kB | 33/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.7 MB/s) 2024-09-12T00:50:54.453 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-12T00:50:54.455 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (2): 82/122 kB | 49/334 kB Progress (2): 98/122 kB | 49/334 kB Progress (2): 98/122 kB | 62/334 kB Progress (2): 98/122 kB | 79/334 kB Progress (2): 115/122 kB | 79/334 kB Progress (2): 115/122 kB | 95/334 kB Progress (2): 122 kB | 95/334 kB Progress (2): 122 kB | 111/334 kB Progress (2): 122 kB | 128/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 6.4 MB/s) 2024-09-12T00:50:54.459 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 144/334 kB Progress (1): 161/334 kB Progress (1): 177/334 kB Progress (1): 193/334 kB Progress (1): 210/334 kB Progress (1): 226/334 kB Progress (1): 242/334 kB Progress (1): 259/334 kB Progress (1): 275/334 kB Progress (1): 292/334 kB Progress (1): 308/334 kB Progress (1): 324/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 15 MB/s) 2024-09-12T00:50:54.468 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/267 kB Progress (1): 33/267 kB Progress (1): 49/267 kB Progress (2): 49/267 kB | 4.7 kB Progress (2): 65/267 kB | 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 155 kB/s) 2024-09-12T00:50:54.469 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 81/267 kB Progress (1): 98/267 kB Progress (1): 114/267 kB Progress (2): 114/267 kB | 16/23 kB Progress (2): 114/267 kB | 23 kB Progress (2): 131/267 kB | 23 kB Progress (2): 147/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 712 kB/s) 2024-09-12T00:50:54.472 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 163/267 kB Progress (1): 180/267 kB Progress (1): 196/267 kB Progress (1): 212/267 kB Progress (1): 229/267 kB Progress (1): 245/267 kB Progress (1): 262/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 7.6 MB/s) 2024-09-12T00:50:54.923 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-12T00:50:54.925 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-12T00:50:56.103 INFO:tasks.workunit.client.0.smithi070.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T00:50:56.103 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] 2024-09-12T00:50:56.103 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T00:50:56.106 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T00:50:56.106 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] 2024-09-12T00:50:56.106 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T00:50:56.111 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-12T00:50:56.112 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-12T00:50:56.275 INFO:tasks.workunit.client.0.smithi070.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T00:50:56.275 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] 2024-09-12T00:50:56.275 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T00:50:56.279 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-12T00:50:56.295 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 416 kB/s) 2024-09-12T00:50:56.298 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-12T00:50:56.314 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 221 kB/s) 2024-09-12T00:50:56.317 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-12T00:50:56.334 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 204 kB/s) 2024-09-12T00:50:56.337 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-12T00:50:56.352 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 271 kB/s) 2024-09-12T00:50:56.355 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-12T00:50:56.371 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 220 kB/s) 2024-09-12T00:50:56.374 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-12T00:50:56.391 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 262 kB/s) 2024-09-12T00:50:56.394 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-12T00:50:56.409 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 110 kB/s) 2024-09-12T00:50:56.412 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-12T00:50:56.426 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 157 kB/s) 2024-09-12T00:50:56.427 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-12T00:50:56.442 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.2 MB/s) 2024-09-12T00:50:56.444 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-12T00:50:56.458 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 126 kB/s) 2024-09-12T00:50:56.461 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-12T00:50:56.476 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 362 kB/s) 2024-09-12T00:50:56.480 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-12T00:50:56.495 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 147 kB/s) 2024-09-12T00:50:56.497 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-12T00:50:56.513 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.5 MB/s) 2024-09-12T00:50:56.516 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-12T00:50:56.532 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.2 MB/s) 2024-09-12T00:50:56.535 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-12T00:50:56.551 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 952 kB/s) 2024-09-12T00:50:56.557 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-12T00:50:56.575 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 481 kB/s) 2024-09-12T00:50:56.579 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-12T00:50:56.595 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.6 MB/s) 2024-09-12T00:50:56.601 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-12T00:50:56.618 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 504 kB/s) 2024-09-12T00:50:56.625 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-12T00:50:56.642 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 128 kB/s) 2024-09-12T00:50:56.649 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-12T00:50:56.665 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 153 kB/s) 2024-09-12T00:50:56.672 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-12T00:50:56.689 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 86 kB/s) 2024-09-12T00:50:56.693 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-12T00:50:56.709 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 192 kB/s) 2024-09-12T00:50:56.712 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-12T00:50:56.729 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.2 MB/s) 2024-09-12T00:50:56.734 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-12T00:50:56.751 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 422 kB/s) 2024-09-12T00:50:56.755 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-12T00:50:56.771 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 798 kB/s) 2024-09-12T00:50:56.779 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-12T00:50:56.795 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 174 kB/s) 2024-09-12T00:50:56.799 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-12T00:50:56.816 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 400 kB/s) 2024-09-12T00:50:56.819 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-12T00:50:56.835 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 525 kB/s) 2024-09-12T00:50:56.841 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-12T00:50:56.857 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 129 kB/s) 2024-09-12T00:50:56.862 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-12T00:50:56.878 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 149 kB/s) 2024-09-12T00:50:56.885 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-12T00:50:56.901 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 189 kB/s) 2024-09-12T00:50:56.909 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-12T00:50:56.928 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 788 kB/s) 2024-09-12T00:50:56.932 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-12T00:50:56.949 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 853 kB/s) 2024-09-12T00:50:56.955 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-12T00:50:56.976 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 640 kB/s) 2024-09-12T00:50:56.980 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-12T00:50:56.996 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 299 kB/s) 2024-09-12T00:50:57.001 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-12T00:50:57.017 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 392 kB/s) 2024-09-12T00:50:57.021 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-12T00:50:57.038 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 1.9 MB/s) 2024-09-12T00:50:57.044 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-12T00:50:57.060 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.0 MB/s) 2024-09-12T00:50:57.064 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-12T00:50:57.080 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 925 kB/s) 2024-09-12T00:50:57.086 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-12T00:50:57.103 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 47 kB/s) 2024-09-12T00:50:57.106 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-12T00:50:57.122 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 300 kB/s) 2024-09-12T00:50:57.127 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-12T00:50:57.143 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 494 kB/s) 2024-09-12T00:50:57.149 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-12T00:50:57.164 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 187 kB/s) 2024-09-12T00:50:57.171 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-12T00:50:57.188 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 266 kB/s) 2024-09-12T00:50:57.194 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-12T00:50:57.211 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 121 kB/s) 2024-09-12T00:50:57.217 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-12T00:50:57.233 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 217 kB/s) 2024-09-12T00:50:57.239 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-12T00:50:57.255 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 684 kB/s) 2024-09-12T00:50:57.259 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-12T00:50:57.275 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 842 kB/s) 2024-09-12T00:50:57.278 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-12T00:50:57.295 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.2 MB/s) 2024-09-12T00:50:57.301 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-12T00:50:57.316 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 23 kB/s) 2024-09-12T00:50:57.320 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-12T00:50:57.336 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 381 kB/s) 2024-09-12T00:50:57.340 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-12T00:50:57.358 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 408 kB/s) 2024-09-12T00:50:57.361 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-12T00:50:57.377 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 322 kB/s) 2024-09-12T00:50:57.382 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-12T00:50:57.398 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 430 kB/s) 2024-09-12T00:50:57.404 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-12T00:50:57.420 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.4 MB/s) 2024-09-12T00:50:57.425 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-12T00:50:57.443 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 4.3 MB/s) 2024-09-12T00:50:57.451 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-12T00:50:57.471 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.2 MB/s) 2024-09-12T00:50:57.478 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-12T00:50:57.494 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 377 kB/s) 2024-09-12T00:50:57.499 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-12T00:50:57.514 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 267 kB/s) 2024-09-12T00:50:57.518 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-12T00:50:57.534 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 213 kB/s) 2024-09-12T00:50:57.537 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-12T00:50:57.553 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.6 MB/s) 2024-09-12T00:50:57.559 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-12T00:50:57.574 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 148 kB/s) 2024-09-12T00:50:57.587 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-12T00:50:57.615 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 66/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 115/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 164/308 kB Progress (1): 180/308 kB Progress (1): 197/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 246/308 kB Progress (1): 262/308 kB Progress (1): 279/308 kB Progress (1): 295/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 11 MB/s) 2024-09-12T00:50:57.615 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-12T00:50:57.616 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-12T00:50:57.616 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-12T00:50:57.616 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-12T00:50:57.617 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-12T00:50:57.635 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/171 kB Progress (1): 33/171 kB Progress (1): 49/171 kB Progress (1): 66/171 kB Progress (1): 82/171 kB Progress (2): 82/171 kB | 14 kB Progress (2): 98/171 kB | 14 kB Progress (3): 98/171 kB | 14 kB | 16/118 kB Progress (4): 98/171 kB | 14 kB | 16/118 kB | 8.2 kB Progress (4): 112/171 kB | 14 kB | 16/118 kB | 8.2 kB Progress (4): 112/171 kB | 14 kB | 32/118 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 715 kB/s) 2024-09-12T00:50:57.635 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (3): 128/171 kB | 32/118 kB | 8.2 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-12T00:50:57.636 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (3): 128/171 kB | 49/118 kB | 8.2 kB Progress (3): 144/171 kB | 49/118 kB | 8.2 kB Progress (3): 144/171 kB | 65/118 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 454 kB/s) 2024-09-12T00:50:57.636 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-12T00:50:57.637 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (2): 161/171 kB | 65/118 kB Progress (2): 161/171 kB | 81/118 kB Progress (2): 171 kB | 81/118 kB Progress (2): 171 kB | 98/118 kB Progress (2): 171 kB | 114/118 kB Progress (2): 171 kB | 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 7.8 MB/s) 2024-09-12T00:50:57.637 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-12T00:50:57.637 INFO:tasks.workunit.client.0.smithi070.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 5.6 MB/s) 2024-09-12T00:50:57.637 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-12T00:50:57.639 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.1 MB/s) 2024-09-12T00:50:57.639 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-12T00:50:57.653 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/146 kB Progress (1): 33/146 kB Progress (2): 33/146 kB | 16/136 kB Progress (3): 33/146 kB | 16/136 kB | 16/61 kB Progress (3): 49/146 kB | 16/136 kB | 16/61 kB Progress (3): 49/146 kB | 32/136 kB | 16/61 kB Progress (3): 49/146 kB | 32/136 kB | 33/61 kB Progress (3): 49/146 kB | 49/136 kB | 33/61 kB Progress (3): 62/146 kB | 49/136 kB | 33/61 kB Progress (3): 62/146 kB | 49/136 kB | 49/61 kB Progress (3): 62/146 kB | 65/136 kB | 49/61 kB Progress (3): 78/146 kB | 65/136 kB | 49/61 kB Progress (4): 78/146 kB | 65/136 kB | 49/61 kB | 15/501 kB Progress (4): 78/146 kB | 65/136 kB | 61 kB | 15/501 kB Progress (4): 78/146 kB | 79/136 kB | 61 kB | 15/501 kB Progress (4): 95/146 kB | 79/136 kB | 61 kB | 15/501 kB Progress (4): 95/146 kB | 79/136 kB | 61 kB | 31/501 kB Progress (4): 95/146 kB | 95/136 kB | 61 kB | 31/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.7 MB/s) 2024-09-12T00:50:57.654 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (4): 95/146 kB | 95/136 kB | 31/501 kB | 16/58 kB Progress (4): 95/146 kB | 112/136 kB | 31/501 kB | 16/58 kB Progress (4): 95/146 kB | 112/136 kB | 31/501 kB | 33/58 kB Progress (4): 95/146 kB | 128/136 kB | 31/501 kB | 33/58 kB Progress (4): 95/146 kB | 128/136 kB | 31/501 kB | 49/58 kB Progress (4): 95/146 kB | 136 kB | 31/501 kB | 49/58 kB Progress (4): 95/146 kB | 136 kB | 31/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.6 MB/s) 2024-09-12T00:50:57.655 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-12T00:50:57.656 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (3): 95/146 kB | 136 kB | 48/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 3.6 MB/s) 2024-09-12T00:50:57.656 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (2): 111/146 kB | 48/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-12T00:50:57.657 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (2): 111/146 kB | 64/501 kB Progress (2): 127/146 kB | 64/501 kB Progress (2): 127/146 kB | 81/501 kB Progress (2): 144/146 kB | 81/501 kB Progress (2): 146 kB | 81/501 kB Progress (2): 146 kB | 96/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 3.6 MB/s) 2024-09-12T00:50:57.673 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 113/501 kB Progress (1): 129/501 kB Progress (1): 145/501 kB Progress (1): 162/501 kB Progress (1): 178/501 kB Progress (1): 194/501 kB Progress (1): 211/501 kB Progress (1): 227/501 kB Progress (1): 244/501 kB Progress (1): 260/501 kB Progress (1): 276/501 kB Progress (1): 293/501 kB Progress (1): 309/501 kB Progress (1): 325/501 kB Progress (1): 342/501 kB Progress (1): 358/501 kB Progress (1): 375/501 kB Progress (1): 391/501 kB Progress (1): 407/501 kB Progress (1): 424/501 kB Progress (1): 440/501 kB Progress (2): 440/501 kB | 16/124 kB Progress (3): 440/501 kB | 16/124 kB | 0/2.4 MB Progress (3): 440/501 kB | 32/124 kB | 0/2.4 MB Progress (3): 457/501 kB | 32/124 kB | 0/2.4 MB Progress (3): 457/501 kB | 32/124 kB | 0/2.4 MB Progress (3): 457/501 kB | 49/124 kB | 0/2.4 MB Progress (3): 457/501 kB | 49/124 kB | 0/2.4 MB Progress (3): 473/501 kB | 49/124 kB | 0/2.4 MB Progress (3): 473/501 kB | 65/124 kB | 0/2.4 MB Progress (3): 473/501 kB | 65/124 kB | 0.1/2.4 MB Progress (3): 473/501 kB | 81/124 kB | 0.1/2.4 MB Progress (3): 489/501 kB | 81/124 kB | 0.1/2.4 MB Progress (3): 489/501 kB | 81/124 kB | 0.1/2.4 MB Progress (3): 489/501 kB | 98/124 kB | 0.1/2.4 MB Progress (3): 501 kB | 98/124 kB | 0.1/2.4 MB Progress (3): 501 kB | 98/124 kB | 0.1/2.4 MB Progress (3): 501 kB | 114/124 kB | 0.1/2.4 MB Progress (3): 501 kB | 114/124 kB | 0.1/2.4 MB Progress (3): 501 kB | 124 kB | 0.1/2.4 MB Progress (3): 501 kB | 124 kB | 0.1/2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 9.1 MB/s) 2024-09-12T00:50:57.673 INFO:tasks.workunit.client.0.smithi070.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.2 MB/s) 2024-09-12T00:50:57.710 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 26 MB/s) 2024-09-12T00:50:57.822 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] 2024-09-12T00:50:57.823 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-12T00:50:57.827 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-12T00:50:57.842 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 280 kB/s) 2024-09-12T00:50:57.844 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-12T00:50:57.859 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 326 kB/s) 2024-09-12T00:50:57.861 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-12T00:50:57.876 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.0 MB/s) 2024-09-12T00:50:57.878 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-12T00:50:57.893 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.4 MB/s) 2024-09-12T00:50:57.897 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-12T00:50:57.912 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 370 kB/s) 2024-09-12T00:50:57.914 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-12T00:50:57.930 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 245 kB/s) 2024-09-12T00:50:57.933 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-12T00:50:57.947 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 430 kB/s) 2024-09-12T00:50:57.950 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-12T00:50:57.965 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 447 kB/s) 2024-09-12T00:50:57.969 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-12T00:50:57.994 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.4 MB/s) 2024-09-12T00:50:57.994 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-12T00:50:58.003 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 969 kB/s) 2024-09-12T00:50:58.005 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-12T00:50:58.021 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 136 kB/s) 2024-09-12T00:50:58.023 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-12T00:50:58.037 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 548 kB/s) 2024-09-12T00:50:58.039 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-12T00:50:58.054 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.7 MB/s) 2024-09-12T00:50:58.060 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-12T00:50:58.075 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.3 MB/s) 2024-09-12T00:50:58.076 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-12T00:50:58.076 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-12T00:50:58.076 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-12T00:50:58.076 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-12T00:50:58.076 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-12T00:50:58.094 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 2.7/211 kB Progress (2): 2.7/211 kB | 16/58 kB Progress (3): 2.7/211 kB | 16/58 kB | 0/1.0 MB Progress (4): 2.7/211 kB | 16/58 kB | 0/1.0 MB | 16/79 kB Progress (5): 2.7/211 kB | 16/58 kB | 0/1.0 MB | 16/79 kB | 16/26 kB Progress (5): 2.7/211 kB | 33/58 kB | 0/1.0 MB | 16/79 kB | 16/26 kB Progress (5): 19/211 kB | 33/58 kB | 0/1.0 MB | 16/79 kB | 16/26 kB Progress (5): 19/211 kB | 33/58 kB | 0/1.0 MB | 32/79 kB | 16/26 kB Progress (5): 19/211 kB | 33/58 kB | 0/1.0 MB | 32/79 kB | 26 kB Progress (5): 19/211 kB | 49/58 kB | 0/1.0 MB | 32/79 kB | 26 kB Progress (5): 36/211 kB | 49/58 kB | 0/1.0 MB | 32/79 kB | 26 kB Progress (5): 36/211 kB | 49/58 kB | 0/1.0 MB | 32/79 kB | 26 kB Progress (5): 36/211 kB | 49/58 kB | 0/1.0 MB | 49/79 kB | 26 kB Progress (5): 36/211 kB | 58 kB | 0/1.0 MB | 49/79 kB | 26 kB Progress (5): 52/211 kB | 58 kB | 0/1.0 MB | 49/79 kB | 26 kB Progress (5): 52/211 kB | 58 kB | 0/1.0 MB | 49/79 kB | 26 kB Progress (5): 52/211 kB | 58 kB | 0/1.0 MB | 65/79 kB | 26 kB Progress (5): 64/211 kB | 58 kB | 0/1.0 MB | 65/79 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.5 MB/s) 2024-09-12T00:50:58.094 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (4): 64/211 kB | 58 kB | 0.1/1.0 MB | 65/79 kB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-12T00:50:58.094 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (4): 64/211 kB | 58 kB | 0.1/1.0 MB | 79 kB Progress (4): 81/211 kB | 58 kB | 0.1/1.0 MB | 79 kB Progress (4): 81/211 kB | 58 kB | 0.1/1.0 MB | 79 kB Progress (4): 97/211 kB | 58 kB | 0.1/1.0 MB | 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.4 MB/s) 2024-09-12T00:50:58.094 INFO:tasks.workunit.client.0.smithi070.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.4 MB/s) 2024-09-12T00:50:58.094 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-12T00:50:58.096 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (2): 97/211 kB | 0.1/1.0 MB Progress (2): 113/211 kB | 0.1/1.0 MB Progress (2): 113/211 kB | 0.1/1.0 MB Progress (2): 130/211 kB | 0.1/1.0 MB Progress (2): 146/211 kB | 0.1/1.0 MB Progress (2): 146/211 kB | 0.1/1.0 MB Progress (2): 162/211 kB | 0.1/1.0 MB Progress (2): 162/211 kB | 0.1/1.0 MB Progress (2): 179/211 kB | 0.1/1.0 MB Progress (2): 179/211 kB | 0.2/1.0 MB Progress (2): 195/211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 11 MB/s) 2024-09-12T00:50:58.113 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (2): 0.7/1.0 MB | 16/116 kB Progress (2): 0.8/1.0 MB | 16/116 kB Progress (2): 0.8/1.0 MB | 33/116 kB Progress (2): 0.8/1.0 MB | 33/116 kB Progress (2): 0.8/1.0 MB | 49/116 kB Progress (3): 0.8/1.0 MB | 49/116 kB | 16/267 kB Progress (3): 0.8/1.0 MB | 66/116 kB | 16/267 kB Progress (3): 0.8/1.0 MB | 66/116 kB | 16/267 kB Progress (3): 0.8/1.0 MB | 66/116 kB | 33/267 kB Progress (3): 0.8/1.0 MB | 82/116 kB | 33/267 kB Progress (3): 0.8/1.0 MB | 82/116 kB | 49/267 kB Progress (3): 0.8/1.0 MB | 82/116 kB | 49/267 kB Progress (3): 0.8/1.0 MB | 98/116 kB | 49/267 kB Progress (3): 0.8/1.0 MB | 98/116 kB | 63/267 kB Progress (3): 0.8/1.0 MB | 98/116 kB | 63/267 kB Progress (3): 0.8/1.0 MB | 115/116 kB | 63/267 kB Progress (3): 0.8/1.0 MB | 115/116 kB | 79/267 kB Progress (3): 0.8/1.0 MB | 116 kB | 79/267 kB Progress (3): 0.8/1.0 MB | 116 kB | 96/267 kB Progress (3): 0.8/1.0 MB | 116 kB | 96/267 kB Progress (3): 0.8/1.0 MB | 116 kB | 112/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.5 MB/s) 2024-09-12T00:50:58.113 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (2): 0.9/1.0 MB | 112/267 kB Progress (2): 0.9/1.0 MB | 128/267 kB Progress (2): 0.9/1.0 MB | 128/267 kB Progress (2): 0.9/1.0 MB | 145/267 kB Progress (2): 0.9/1.0 MB | 161/267 kB Progress (2): 0.9/1.0 MB | 161/267 kB Progress (2): 0.9/1.0 MB | 178/267 kB Progress (2): 0.9/1.0 MB | 178/267 kB Progress (2): 0.9/1.0 MB | 194/267 kB Progress (2): 0.9/1.0 MB | 210/267 kB Progress (2): 0.9/1.0 MB | 210/267 kB Progress (2): 0.9/1.0 MB | 227/267 kB Progress (2): 0.9/1.0 MB | 227/267 kB Progress (2): 0.9/1.0 MB | 243/267 kB Progress (2): 1.0/1.0 MB | 243/267 kB Progress (2): 1.0/1.0 MB | 259/267 kB Progress (2): 1.0/1.0 MB | 267 kB Progress (2): 1.0/1.0 MB | 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.4 MB/s) 2024-09-12T00:50:58.114 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 26 MB/s) 2024-09-12T00:50:58.312 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-12T00:50:58.343 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:50:58.343 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] BUILD SUCCESS 2024-09-12T00:50:58.343 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:50:58.344 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] Total time: 7.997 s 2024-09-12T00:50:58.344 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] Finished at: 2024-09-12T00:50:58Z 2024-09-12T00:50:58.344 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:50:58.377 INFO:tasks.workunit.client.0.smithi070.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-12T00:50:58.383 INFO:tasks.workunit.client.0.smithi070.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T00:50:59.548 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] Scanning for projects... 2024-09-12T00:50:59.650 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] 2024-09-12T00:50:59.650 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T00:50:59.650 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] Building jcksum 1.0 2024-09-12T00:50:59.650 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] from pom.xml 2024-09-12T00:50:59.650 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T00:51:00.009 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] 2024-09-12T00:51:00.009 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T00:51:00.151 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T00:51:00.152 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] 2024-09-12T00:51:00.152 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T00:51:00.248 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T00:51:00.248 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] 2024-09-12T00:51:00.248 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T00:51:00.250 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T00:51:00.250 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] 2024-09-12T00:51:00.250 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T00:51:00.255 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T00:51:00.255 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] 2024-09-12T00:51:00.255 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T00:51:00.473 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-12T00:51:00.697 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-12T00:51:00.895 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 23 kB/s) 2024-09-12T00:51:00.903 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-12T00:51:00.922 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 137 kB/s) 2024-09-12T00:51:00.931 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-12T00:51:00.951 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 134 kB/s) 2024-09-12T00:51:00.958 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-12T00:51:00.978 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 159 kB/s) 2024-09-12T00:51:00.981 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-12T00:51:01.000 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 169 kB/s) 2024-09-12T00:51:01.004 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-12T00:51:01.022 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 94 kB/s) 2024-09-12T00:51:01.025 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-12T00:51:01.043 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 157 kB/s) 2024-09-12T00:51:01.050 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-12T00:51:01.075 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.1 MB/s) 2024-09-12T00:51:01.077 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-12T00:51:01.078 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-12T00:51:01.081 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-12T00:51:01.082 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-12T00:51:01.082 INFO:tasks.workunit.client.0.smithi070.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-12T00:51:01.102 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 627 kB/s) 2024-09-12T00:51:01.138 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 1.4/189 kB Progress (2): 1.4/189 kB | 1.4/169 kB Progress (2): 2.8/189 kB | 1.4/169 kB Progress (2): 2.8/189 kB | 2.8/169 kB Progress (2): 2.8/189 kB | 4.1/169 kB Progress (3): 2.8/189 kB | 4.1/169 kB | 16/103 kB Progress (3): 2.8/189 kB | 5.5/169 kB | 16/103 kB Progress (4): 2.8/189 kB | 5.5/169 kB | 16/103 kB | 1.4/7.7 kB Progress (4): 2.8/189 kB | 6.9/169 kB | 16/103 kB | 1.4/7.7 kB Progress (4): 4.1/189 kB | 6.9/169 kB | 16/103 kB | 1.4/7.7 kB Progress (4): 4.1/189 kB | 8.3/169 kB | 16/103 kB | 1.4/7.7 kB Progress (4): 4.1/189 kB | 8.3/169 kB | 16/103 kB | 2.8/7.7 kB Progress (4): 5.5/189 kB | 8.3/169 kB | 16/103 kB | 2.8/7.7 kB Progress (4): 5.5/189 kB | 8.3/169 kB | 16/103 kB | 4.1/7.7 kB Progress (4): 5.5/189 kB | 9.7/169 kB | 16/103 kB | 4.1/7.7 kB Progress (4): 5.5/189 kB | 9.7/169 kB | 16/103 kB | 5.5/7.7 kB Progress (4): 6.9/189 kB | 9.7/169 kB | 16/103 kB | 5.5/7.7 kB Progress (4): 6.9/189 kB | 9.7/169 kB | 33/103 kB | 5.5/7.7 kB Progress (4): 6.9/189 kB | 9.7/169 kB | 33/103 kB | 6.9/7.7 kB Progress (4): 6.9/189 kB | 11/169 kB | 33/103 kB | 6.9/7.7 kB Progress (4): 6.9/189 kB | 11/169 kB | 33/103 kB | 7.7 kB Progress (4): 8.3/189 kB | 11/169 kB | 33/103 kB | 7.7 kB Progress (4): 8.3/189 kB | 12/169 kB | 33/103 kB | 7.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 123 kB/s) 2024-09-12T00:51:01.158 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (3): 9.7/189 kB | 12/169 kB | 33/103 kB Progress (3): 9.7/189 kB | 14/169 kB | 33/103 kB Progress (3): 11/189 kB | 14/169 kB | 33/103 kB Progress (3): 11/189 kB | 15/169 kB | 33/103 kB Progress (3): 12/189 kB | 15/169 kB | 33/103 kB Progress (3): 12/189 kB | 17/169 kB | 33/103 kB Progress (3): 14/189 kB | 17/169 kB | 33/103 kB Progress (3): 14/189 kB | 18/169 kB | 33/103 kB Progress (3): 15/189 kB | 18/169 kB | 33/103 kB Progress (3): 15/189 kB | 19/169 kB | 33/103 kB Progress (3): 17/189 kB | 19/169 kB | 33/103 kB Progress (3): 17/189 kB | 21/169 kB | 33/103 kB Progress (3): 18/189 kB | 21/169 kB | 33/103 kB Progress (3): 18/189 kB | 22/169 kB | 33/103 kB Progress (3): 19/189 kB | 22/169 kB | 33/103 kB Progress (3): 19/189 kB | 23/169 kB | 33/103 kB Progress (3): 21/189 kB | 23/169 kB | 33/103 kB Progress (3): 21/189 kB | 25/169 kB | 33/103 kB Progress (3): 22/189 kB | 25/169 kB | 33/103 kB Progress (3): 22/189 kB | 26/169 kB | 33/103 kB Progress (3): 23/189 kB | 26/169 kB | 33/103 kB Progress (3): 23/189 kB | 26/169 kB | 49/103 kB Progress (3): 23/189 kB | 28/169 kB | 49/103 kB Progress (3): 25/189 kB | 28/169 kB | 49/103 kB Progress (3): 25/189 kB | 29/169 kB | 49/103 kB Progress (3): 26/189 kB | 29/169 kB | 49/103 kB Progress (3): 26/189 kB | 30/169 kB | 49/103 kB Progress (3): 28/189 kB | 30/169 kB | 49/103 kB Progress (3): 28/189 kB | 30/169 kB | 66/103 kB Progress (3): 28/189 kB | 32/169 kB | 66/103 kB Progress (3): 29/189 kB | 32/169 kB | 66/103 kB Progress (3): 29/189 kB | 33/169 kB | 66/103 kB Progress (3): 30/189 kB | 33/169 kB | 66/103 kB Progress (3): 30/189 kB | 33/169 kB | 82/103 kB Progress (3): 30/189 kB | 34/169 kB | 82/103 kB Progress (3): 32/189 kB | 34/169 kB | 82/103 kB Progress (3): 32/189 kB | 36/169 kB | 82/103 kB Progress (3): 33/189 kB | 36/169 kB | 82/103 kB Progress (3): 33/189 kB | 37/169 kB | 82/103 kB Progress (3): 34/189 kB | 37/169 kB | 82/103 kB Progress (3): 34/189 kB | 39/169 kB | 82/103 kB Progress (3): 36/189 kB | 39/169 kB | 82/103 kB Progress (3): 36/189 kB | 40/169 kB | 82/103 kB Progress (3): 37/189 kB | 40/169 kB | 82/103 kB Progress (3): 37/189 kB | 41/169 kB | 82/103 kB Progress (3): 39/189 kB | 41/169 kB | 82/103 kB Progress (3): 39/189 kB | 43/169 kB | 82/103 kB Progress (3): 40/189 kB | 43/169 kB | 82/103 kB Progress (3): 40/189 kB | 44/169 kB | 82/103 kB Progress (3): 41/189 kB | 44/169 kB | 82/103 kB Progress (3): 41/189 kB | 46/169 kB | 82/103 kB Progress (3): 43/189 kB | 46/169 kB | 82/103 kB Progress (3): 43/189 kB | 47/169 kB | 82/103 kB Progress (3): 44/189 kB | 47/169 kB | 82/103 kB Progress (3): 44/189 kB | 48/169 kB | 82/103 kB Progress (3): 44/189 kB | 48/169 kB | 98/103 kB Progress (3): 46/189 kB | 48/169 kB | 98/103 kB Progress (3): 46/189 kB | 48/169 kB | 103 kB Progress (3): 46/189 kB | 50/169 kB | 103 kB Progress (3): 47/189 kB | 50/169 kB | 103 kB Progress (3): 47/189 kB | 51/169 kB | 103 kB Progress (3): 48/189 kB | 51/169 kB | 103 kB Progress (3): 48/189 kB | 52/169 kB | 103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.3 MB/s) 2024-09-12T00:51:01.174 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (2): 50/189 kB | 52/169 kB Progress (2): 50/189 kB | 54/169 kB Progress (2): 51/189 kB | 54/169 kB Progress (2): 51/189 kB | 55/169 kB Progress (2): 52/189 kB | 55/169 kB Progress (2): 52/189 kB | 57/169 kB Progress (2): 54/189 kB | 57/169 kB Progress (2): 54/189 kB | 58/169 kB Progress (2): 55/189 kB | 58/169 kB Progress (2): 55/189 kB | 59/169 kB Progress (2): 57/189 kB | 59/169 kB Progress (2): 57/189 kB | 61/169 kB Progress (2): 58/189 kB | 61/169 kB Progress (2): 58/189 kB | 62/169 kB Progress (2): 59/189 kB | 62/169 kB Progress (2): 59/189 kB | 63/169 kB Progress (2): 61/189 kB | 63/169 kB Progress (2): 61/189 kB | 64/169 kB Progress (2): 62/189 kB | 64/169 kB Progress (2): 62/189 kB | 64/169 kB Progress (2): 62/189 kB | 81/169 kB Progress (2): 79/189 kB | 81/169 kB Progress (2): 95/189 kB | 81/169 kB Progress (2): 95/189 kB | 97/169 kB Progress (2): 112/189 kB | 97/169 kB Progress (2): 112/189 kB | 113/169 kB Progress (2): 128/189 kB | 113/169 kB Progress (2): 128/189 kB | 130/169 kB Progress (2): 144/189 kB | 130/169 kB Progress (2): 144/189 kB | 146/169 kB Progress (2): 161/189 kB | 146/169 kB Progress (2): 161/189 kB | 163/169 kB Progress (2): 177/189 kB | 163/169 kB Progress (2): 177/189 kB | 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.7 MB/s) 2024-09-12T00:51:01.176 INFO:tasks.workunit.client.0.smithi070.stdout:Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 1.9 MB/s) 2024-09-12T00:51:01.194 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] 2024-09-12T00:51:01.194 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] ------------------------------------------------------- 2024-09-12T00:51:01.194 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] T E S T S 2024-09-12T00:51:01.194 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] ------------------------------------------------------- 2024-09-12T00:51:01.731 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-12T00:51:01.841 INFO:tasks.workunit.client.0.smithi070.stdout:PutObjects.java: starting test run: 2024-09-12T00:51:01.841 INFO:tasks.workunit.client.0.smithi070.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:51:01.841 INFO:tasks.workunit.client.0.smithi070.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:51:01.841 INFO:tasks.workunit.client.0.smithi070.stdout: EndpointUrl=https://smithi070.front.sepia.ceph.com:443 2024-09-12T00:51:01.841 INFO:tasks.workunit.client.0.smithi070.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-12T00:51:01.937 INFO:tasks.workunit.client.0.smithi070.stdout:DEBUG: Environment Variables Read 2024-09-12T00:51:02.338 INFO:tasks.workunit.client.0.smithi070.stdout:DEBUG: S3 Client Initialized 2024-09-12T00:51:02.338 INFO:tasks.workunit.client.0.smithi070.stdout:DEBUG: Generating File 2024-09-12T00:51:02.339 INFO:tasks.workunit.client.0.smithi070.stdout:DEBUG: File Generated 2024-09-12T00:51:02.339 INFO:tasks.workunit.client.0.smithi070.stdout:DEBUG: Generating File 2024-09-12T00:51:02.339 INFO:tasks.workunit.client.0.smithi070.stdout:DEBUG: File Generated 2024-09-12T00:51:02.339 INFO:tasks.workunit.client.0.smithi070.stdout:DEBUG: Generating File 2024-09-12T00:51:02.439 INFO:tasks.workunit.client.0.smithi070.stdout:DEBUG: File Generated 2024-09-12T00:51:02.439 INFO:tasks.workunit.client.0.smithi070.stdout:DEBUG: Generating File 2024-09-12T00:51:02.439 INFO:tasks.workunit.client.0.smithi070.stdout:DEBUG: File Generated 2024-09-12T00:51:02.439 INFO:tasks.workunit.client.0.smithi070.stdout:DEBUG: Generating File 2024-09-12T00:51:02.439 INFO:tasks.workunit.client.0.smithi070.stdout:DEBUG: File Generated 2024-09-12T00:51:02.439 INFO:tasks.workunit.client.0.smithi070.stdout:DEBUG: Generating File 2024-09-12T00:51:02.439 INFO:tasks.workunit.client.0.smithi070.stdout:DEBUG: File Generated 2024-09-12T00:51:02.439 INFO:tasks.workunit.client.0.smithi070.stdout:DEBUG: Generated Big Files 2024-09-12T00:51:02.706 INFO:tasks.workunit.client.0.smithi070.stdout:HeadBucketResponse() 2024-09-12T00:51:02.706 INFO:tasks.workunit.client.0.smithi070.stdout:sheik is ready 2024-09-12T00:51:02.707 INFO:tasks.workunit.client.0.smithi070.stdout:DEBUG: Test Bucket Created 2024-09-12T00:51:02.739 INFO:tasks.workunit.client.0.smithi070.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-12T00:51:02.839 INFO:tasks.workunit.client.0.smithi070.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-12T00:51:02.940 INFO:tasks.workunit.client.0.smithi070.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-12T00:51:03.039 INFO:tasks.workunit.client.0.smithi070.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-12T00:51:03.140 INFO:tasks.workunit.client.0.smithi070.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-12T00:51:03.240 INFO:tasks.workunit.client.0.smithi070.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-12T00:51:03.340 INFO:tasks.workunit.client.0.smithi070.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-12T00:51:03.441 INFO:tasks.workunit.client.0.smithi070.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-12T00:51:03.541 INFO:tasks.workunit.client.0.smithi070.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-12T00:51:03.741 INFO:tasks.workunit.client.0.smithi070.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-12T00:51:05.847 INFO:tasks.workunit.client.0.smithi070.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-12T00:51:06.449 INFO:tasks.workunit.client.0.smithi070.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-12T00:51:12.503 INFO:tasks.workunit.client.0.smithi070.stdout:arg: file-0b 2024-09-12T00:51:12.504 INFO:tasks.workunit.client.0.smithi070.stdout:arg: file-8b 2024-09-12T00:51:12.506 INFO:tasks.workunit.client.0.smithi070.stdout:arg: file-200b 2024-09-12T00:51:12.508 INFO:tasks.workunit.client.0.smithi070.stdout:arg: file-21983b 2024-09-12T00:51:12.509 INFO:tasks.workunit.client.0.smithi070.stdout:arg: file-5519b 2024-09-12T00:51:12.511 INFO:tasks.workunit.client.0.smithi070.stdout:arg: file-204329b 2024-09-12T00:51:12.512 INFO:tasks.workunit.client.0.smithi070.stdout:arg: file-256k 2024-09-12T00:51:12.513 INFO:tasks.workunit.client.0.smithi070.stdout:arg: file-1m 2024-09-12T00:51:12.515 INFO:tasks.workunit.client.0.smithi070.stdout:arg: file-1038757b 2024-09-12T00:51:12.562 INFO:tasks.workunit.client.0.smithi070.stdout:putObjectFromFileCksum called with file-0b 2024-09-12T00:51:12.563 INFO:tasks.workunit.client.0.smithi070.stdout:PutObjectResponse 2024-09-12T00:51:12.629 INFO:tasks.workunit.client.0.smithi070.stdout:putObjectFromFileCksum called with file-8b 2024-09-12T00:51:12.629 INFO:tasks.workunit.client.0.smithi070.stdout:PutObjectResponse 2024-09-12T00:51:12.663 INFO:tasks.workunit.client.0.smithi070.stdout:putObjectFromFileCksum called with file-200b 2024-09-12T00:51:12.663 INFO:tasks.workunit.client.0.smithi070.stdout:PutObjectResponse 2024-09-12T00:51:12.763 INFO:tasks.workunit.client.0.smithi070.stdout:putObjectFromFileCksum called with file-21983b 2024-09-12T00:51:12.763 INFO:tasks.workunit.client.0.smithi070.stdout:PutObjectResponse 2024-09-12T00:51:12.863 INFO:tasks.workunit.client.0.smithi070.stdout:putObjectFromFileCksum called with file-5519b 2024-09-12T00:51:12.863 INFO:tasks.workunit.client.0.smithi070.stdout:PutObjectResponse 2024-09-12T00:51:12.939 INFO:tasks.workunit.client.0.smithi070.stdout:putObjectFromFileCksum called with file-204329b 2024-09-12T00:51:12.940 INFO:tasks.workunit.client.0.smithi070.stdout:PutObjectResponse 2024-09-12T00:51:12.965 INFO:tasks.workunit.client.0.smithi070.stdout:putObjectFromFileCksum called with file-256k 2024-09-12T00:51:13.023 INFO:tasks.workunit.client.0.smithi070.stdout:PutObjectResponse 2024-09-12T00:51:13.063 INFO:tasks.workunit.client.0.smithi070.stdout:putObjectFromFileCksum called with file-1m 2024-09-12T00:51:13.163 INFO:tasks.workunit.client.0.smithi070.stdout:PutObjectResponse 2024-09-12T00:51:13.264 INFO:tasks.workunit.client.0.smithi070.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-12T00:51:13.264 INFO:tasks.workunit.client.0.smithi070.stdout:PutObjectResponse 2024-09-12T00:51:13.364 INFO:tasks.workunit.client.0.smithi070.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-12T00:51:13.865 INFO:tasks.workunit.client.0.smithi070.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-12T00:51:14.466 INFO:tasks.workunit.client.0.smithi070.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-12T00:51:18.848 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.08 s -- in io.ceph.jcksum.PutObjects 2024-09-12T00:51:18.881 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] 2024-09-12T00:51:18.881 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] Results: 2024-09-12T00:51:18.882 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] 2024-09-12T00:51:18.882 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-12T00:51:18.882 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] 2024-09-12T00:51:18.884 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:51:18.884 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] BUILD SUCCESS 2024-09-12T00:51:18.884 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:51:18.885 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] Total time: 19.361 s 2024-09-12T00:51:18.885 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] Finished at: 2024-09-12T00:51:18Z 2024-09-12T00:51:18.885 INFO:tasks.workunit.client.0.smithi070.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:51:18.903 INFO:tasks.workunit.client.0.smithi070.stderr:+ exit 2024-09-12T00:51:18.904 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:51:18.904 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:51:18.957 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-12T00:51:18.957 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:51:19.353 DEBUG:teuthology.parallel:result is None 2024-09-12T00:51:19.353 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:51:19.365 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:51:19.365 DEBUG:teuthology.orchestra.run.smithi070:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:51:19.411 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:51:19.411 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:51:19.422 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:51:19.422 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:51:19.422 DEBUG:teuthology.orchestra.run.smithi070:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:51:19.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:51:19.460 INFO:teuthology.orchestra.run.smithi070.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:51:19.460 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:51:19.508 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:51:19.508 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:51:19.556 INFO:tasks.workunit:timeout=3h 2024-09-12T00:51:19.556 INFO:tasks.workunit:cleanup=True 2024-09-12T00:51:19.556 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:51:19.606 INFO:tasks.workunit.client.0.smithi070.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:52:01.729 INFO:tasks.workunit.client.0.smithi070.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:52:01.729 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:52:01.729 INFO:tasks.workunit.client.0.smithi070.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:52:01.730 INFO:tasks.workunit.client.0.smithi070.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:52:01.730 INFO:tasks.workunit.client.0.smithi070.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:52:01.730 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:52:01.730 INFO:tasks.workunit.client.0.smithi070.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:52:01.730 INFO:tasks.workunit.client.0.smithi070.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:52:01.730 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:52:01.730 INFO:tasks.workunit.client.0.smithi070.stderr: git switch -c 2024-09-12T00:52:01.730 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:52:01.730 INFO:tasks.workunit.client.0.smithi070.stderr:Or undo this operation with: 2024-09-12T00:52:01.730 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:52:01.730 INFO:tasks.workunit.client.0.smithi070.stderr: git switch - 2024-09-12T00:52:01.730 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:52:01.730 INFO:tasks.workunit.client.0.smithi070.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:52:01.731 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:52:01.731 INFO:tasks.workunit.client.0.smithi070.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:52:01.737 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:52:01.786 INFO:tasks.workunit.client.0.smithi070.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:52:01.788 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:52:01.788 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:52:01.849 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:52:01.905 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:52:01.946 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:52:01.946 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:52:01.947 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:52:01.996 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:52:01.999 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:52:02.000 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:52:02.048 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-12T00:52:02.049 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-12T00:52:02.050 DEBUG:teuthology.orchestra.run.smithi070:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-12T00:52:02.108 INFO:tasks.workunit.client.0.smithi070.stdout:INFO: fully qualified domain name: smithi070.front.sepia.ceph.com 2024-09-12T00:52:02.108 INFO:tasks.workunit.client.0.smithi070.stdout:== TESTING *ABORTING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-12T00:52:02.108 INFO:tasks.workunit.client.0.smithi070.stdout:== TESTING NON-VERSIONED BUCKET == 2024-09-12T00:52:05.411 INFO:tasks.workunit.client.0.smithi070.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T00:52:05.613 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting pip 2024-09-12T00:52:05.619 INFO:tasks.workunit.client.0.smithi070.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:52:05.654 INFO:tasks.workunit.client.0.smithi070.stdout:Installing collected packages: pip 2024-09-12T00:52:05.654 INFO:tasks.workunit.client.0.smithi070.stdout: Attempting uninstall: pip 2024-09-12T00:52:05.654 INFO:tasks.workunit.client.0.smithi070.stdout: Found existing installation: pip 22.0.2 2024-09-12T00:52:05.910 INFO:tasks.workunit.client.0.smithi070.stdout: Uninstalling pip-22.0.2: 2024-09-12T00:52:05.916 INFO:tasks.workunit.client.0.smithi070.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T00:52:06.667 INFO:tasks.workunit.client.0.smithi070.stdout:Successfully installed pip-24.2 2024-09-12T00:52:07.730 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting boto3 2024-09-12T00:52:07.731 INFO:tasks.workunit.client.0.smithi070.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:52:08.249 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:52:08.251 INFO:tasks.workunit.client.0.smithi070.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:52:08.328 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:52:08.329 INFO:tasks.workunit.client.0.smithi070.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:52:08.382 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:52:08.383 INFO:tasks.workunit.client.0.smithi070.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:52:08.434 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:52:08.435 INFO:tasks.workunit.client.0.smithi070.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:52:08.544 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:52:08.545 INFO:tasks.workunit.client.0.smithi070.stdout: Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-12T00:52:08.690 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:52:08.691 INFO:tasks.workunit.client.0.smithi070.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:52:08.695 INFO:tasks.workunit.client.0.smithi070.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:52:08.696 INFO:tasks.workunit.client.0.smithi070.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:52:08.707 INFO:tasks.workunit.client.0.smithi070.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:52:08.708 INFO:tasks.workunit.client.0.smithi070.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:52:08.709 INFO:tasks.workunit.client.0.smithi070.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:52:08.711 INFO:tasks.workunit.client.0.smithi070.stdout:Using cached urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-12T00:52:08.712 INFO:tasks.workunit.client.0.smithi070.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:52:08.782 INFO:tasks.workunit.client.0.smithi070.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:52:09.767 INFO:tasks.workunit.client.0.smithi070.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-12T00:52:10.550 INFO:tasks.workunit.client.0.smithi070.stdout:INFO: creating user 2024-09-12T00:52:10.688 INFO:tasks.workunit.client.0.smithi070.stdout:{ 2024-09-12T00:52:10.688 INFO:tasks.workunit.client.0.smithi070.stdout: "user_id": "testid", 2024-09-12T00:52:10.688 INFO:tasks.workunit.client.0.smithi070.stdout: "display_name": "M. Tester", 2024-09-12T00:52:10.688 INFO:tasks.workunit.client.0.smithi070.stdout: "email": "tester@ceph.com", 2024-09-12T00:52:10.689 INFO:tasks.workunit.client.0.smithi070.stdout: "suspended": 0, 2024-09-12T00:52:10.689 INFO:tasks.workunit.client.0.smithi070.stdout: "max_buckets": 1000, 2024-09-12T00:52:10.689 INFO:tasks.workunit.client.0.smithi070.stdout: "subusers": [], 2024-09-12T00:52:10.689 INFO:tasks.workunit.client.0.smithi070.stdout: "keys": [ 2024-09-12T00:52:10.689 INFO:tasks.workunit.client.0.smithi070.stdout: { 2024-09-12T00:52:10.689 INFO:tasks.workunit.client.0.smithi070.stdout: "user": "testid", 2024-09-12T00:52:10.689 INFO:tasks.workunit.client.0.smithi070.stdout: "access_key": "0555b35654ad1656d804", 2024-09-12T00:52:10.689 INFO:tasks.workunit.client.0.smithi070.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-12T00:52:10.689 INFO:tasks.workunit.client.0.smithi070.stdout: "active": true, 2024-09-12T00:52:10.689 INFO:tasks.workunit.client.0.smithi070.stdout: "create_date": "2024-09-12T00:52:10.689808Z" 2024-09-12T00:52:10.689 INFO:tasks.workunit.client.0.smithi070.stdout: } 2024-09-12T00:52:10.689 INFO:tasks.workunit.client.0.smithi070.stdout: ], 2024-09-12T00:52:10.690 INFO:tasks.workunit.client.0.smithi070.stdout: "swift_keys": [], 2024-09-12T00:52:10.690 INFO:tasks.workunit.client.0.smithi070.stdout: "caps": [], 2024-09-12T00:52:10.690 INFO:tasks.workunit.client.0.smithi070.stdout: "op_mask": "read, write, delete", 2024-09-12T00:52:10.690 INFO:tasks.workunit.client.0.smithi070.stdout: "default_placement": "", 2024-09-12T00:52:10.690 INFO:tasks.workunit.client.0.smithi070.stdout: "default_storage_class": "", 2024-09-12T00:52:10.690 INFO:tasks.workunit.client.0.smithi070.stdout: "placement_tags": [], 2024-09-12T00:52:10.690 INFO:tasks.workunit.client.0.smithi070.stdout: "bucket_quota": { 2024-09-12T00:52:10.690 INFO:tasks.workunit.client.0.smithi070.stdout: "enabled": false, 2024-09-12T00:52:10.690 INFO:tasks.workunit.client.0.smithi070.stdout: "check_on_raw": false, 2024-09-12T00:52:10.690 INFO:tasks.workunit.client.0.smithi070.stdout: "max_size": -1, 2024-09-12T00:52:10.690 INFO:tasks.workunit.client.0.smithi070.stdout: "max_size_kb": 0, 2024-09-12T00:52:10.690 INFO:tasks.workunit.client.0.smithi070.stdout: "max_objects": -1 2024-09-12T00:52:10.691 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:52:10.691 INFO:tasks.workunit.client.0.smithi070.stdout: "user_quota": { 2024-09-12T00:52:10.691 INFO:tasks.workunit.client.0.smithi070.stdout: "enabled": false, 2024-09-12T00:52:10.691 INFO:tasks.workunit.client.0.smithi070.stdout: "check_on_raw": false, 2024-09-12T00:52:10.691 INFO:tasks.workunit.client.0.smithi070.stdout: "max_size": -1, 2024-09-12T00:52:10.691 INFO:tasks.workunit.client.0.smithi070.stdout: "max_size_kb": 0, 2024-09-12T00:52:10.691 INFO:tasks.workunit.client.0.smithi070.stdout: "max_objects": -1 2024-09-12T00:52:10.691 INFO:tasks.workunit.client.0.smithi070.stdout: }, 2024-09-12T00:52:10.691 INFO:tasks.workunit.client.0.smithi070.stdout: "temp_url_keys": [], 2024-09-12T00:52:10.691 INFO:tasks.workunit.client.0.smithi070.stdout: "type": "rgw", 2024-09-12T00:52:10.691 INFO:tasks.workunit.client.0.smithi070.stdout: "mfa_ids": [], 2024-09-12T00:52:10.691 INFO:tasks.workunit.client.0.smithi070.stdout: "account_id": "", 2024-09-12T00:52:10.692 INFO:tasks.workunit.client.0.smithi070.stdout: "path": "/", 2024-09-12T00:52:10.692 INFO:tasks.workunit.client.0.smithi070.stdout: "create_date": "2024-09-12T00:52:10.689796Z", 2024-09-12T00:52:10.692 INFO:tasks.workunit.client.0.smithi070.stdout: "tags": [], 2024-09-12T00:52:10.692 INFO:tasks.workunit.client.0.smithi070.stdout: "group_ids": [] 2024-09-12T00:52:10.692 INFO:tasks.workunit.client.0.smithi070.stdout:} 2024-09-12T00:52:10.692 INFO:tasks.workunit.client.0.smithi070.stdout: 2024-09-12T00:52:15.296 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi070.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:52:15.296 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:52:15.340 INFO:tasks.workunit.client.0.smithi070.stderr:5+0 records in 2024-09-12T00:52:15.340 INFO:tasks.workunit.client.0.smithi070.stderr:5+0 records out 2024-09-12T00:52:15.340 INFO:tasks.workunit.client.0.smithi070.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0228481 s, 229 MB/s 2024-09-12T00:52:15.344 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi070.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:52:15.344 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:52:15.422 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi070.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:52:15.422 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:52:15.536 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi070.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:52:15.536 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:52:15.661 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi070.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:52:15.662 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:52:15.784 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi070.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:52:15.785 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:52:15.919 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi070.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:52:15.919 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:52:16.060 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi070.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:52:16.060 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:52:16.192 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi070.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:52:16.193 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:52:16.323 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi070.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:52:16.324 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:52:16.453 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi070.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:52:16.454 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:52:16.592 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi070.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:52:16.592 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:52:16.728 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi070.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:52:16.728 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:52:16.860 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi070.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:52:16.861 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:52:16.998 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi070.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:52:16.998 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:52:17.109 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi070.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:52:17.109 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:52:17.130 INFO:tasks.workunit.client.0.smithi070.stdout:bucket nams is reupload-bkt-128617 2024-09-12T00:52:17.130 INFO:tasks.workunit.client.0.smithi070.stdout:endpoint is https://smithi070.front.sepia.ceph.com:443 2024-09-12T00:52:17.130 INFO:tasks.workunit.client.0.smithi070.stdout:start UploadId=2~hcXVCSKhak64vs9GAGykZda7uaKiHjE 2024-09-12T00:52:17.130 INFO:tasks.workunit.client.0.smithi070.stdout:phase 1 uploaded part {'ETag': '"95cc657d2514e0f930eda1588cbc4c9b"', 'PartNumber': 1} 2024-09-12T00:52:17.130 INFO:tasks.workunit.client.0.smithi070.stdout:phase 1 uploaded part {'ETag': '"95cc657d2514e0f930eda1588cbc4c9b"', 'PartNumber': 2} 2024-09-12T00:52:17.130 INFO:tasks.workunit.client.0.smithi070.stdout:phase 2 uploaded part {'ETag': '"95cc657d2514e0f930eda1588cbc4c9b"', 'PartNumber': 1} 2024-09-12T00:52:17.130 INFO:tasks.workunit.client.0.smithi070.stdout:phase 2 uploaded part {'ETag': '"95cc657d2514e0f930eda1588cbc4c9b"', 'PartNumber': 1} 2024-09-12T00:52:17.130 INFO:tasks.workunit.client.0.smithi070.stdout:phase 2 uploaded part {'ETag': '"95cc657d2514e0f930eda1588cbc4c9b"', 'PartNumber': 1} 2024-09-12T00:52:17.130 INFO:tasks.workunit.client.0.smithi070.stdout:phase 2 uploaded part {'ETag': '"95cc657d2514e0f930eda1588cbc4c9b"', 'PartNumber': 1} 2024-09-12T00:52:17.131 INFO:tasks.workunit.client.0.smithi070.stdout:phase 2 uploaded part {'ETag': '"95cc657d2514e0f930eda1588cbc4c9b"', 'PartNumber': 1} 2024-09-12T00:52:17.131 INFO:tasks.workunit.client.0.smithi070.stdout:phase 2 uploaded part {'ETag': '"95cc657d2514e0f930eda1588cbc4c9b"', 'PartNumber': 1} 2024-09-12T00:52:17.131 INFO:tasks.workunit.client.0.smithi070.stdout:phase 2 uploaded part {'ETag': '"95cc657d2514e0f930eda1588cbc4c9b"', 'PartNumber': 1} 2024-09-12T00:52:17.131 INFO:tasks.workunit.client.0.smithi070.stdout:phase 2 uploaded part {'ETag': '"95cc657d2514e0f930eda1588cbc4c9b"', 'PartNumber': 1} 2024-09-12T00:52:17.131 INFO:tasks.workunit.client.0.smithi070.stdout:phase 2 uploaded part {'ETag': '"95cc657d2514e0f930eda1588cbc4c9b"', 'PartNumber': 1} 2024-09-12T00:52:17.131 INFO:tasks.workunit.client.0.smithi070.stdout:phase 2 uploaded part {'ETag': '"95cc657d2514e0f930eda1588cbc4c9b"', 'PartNumber': 1} 2024-09-12T00:52:17.131 INFO:tasks.workunit.client.0.smithi070.stdout:phase 2 uploaded part {'ETag': '"95cc657d2514e0f930eda1588cbc4c9b"', 'PartNumber': 1} 2024-09-12T00:52:17.131 INFO:tasks.workunit.client.0.smithi070.stdout:aborting multipart upload, parts=[{'ETag': '"95cc657d2514e0f930eda1588cbc4c9b"', 'PartNumber': 1}, {'ETag': '"95cc657d2514e0f930eda1588cbc4c9b"', 'PartNumber': 2}] 2024-09-12T00:52:18.925 INFO:tasks.workunit.client.0.smithi070.stdout:radosgw-admin bucket radoslist: 2024-09-12T00:52:19.011 INFO:tasks.workunit.client.0.smithi070.stdout:rados ls: 2024-09-12T00:52:19.111 INFO:tasks.workunit.client.0.smithi070.stdout:== PASSED == 2024-09-12T00:52:19.111 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:52:19.112 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:52:19.169 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-12T00:52:19.170 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:52:19.582 DEBUG:teuthology.parallel:result is None 2024-09-12T00:52:19.583 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:52:19.595 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:52:19.595 DEBUG:teuthology.orchestra.run.smithi070:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:52:19.640 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:52:19.640 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-12T00:52:19.654 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'force-branch': 'wip-67986', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-12T00:52:19.654 INFO:tasks.ragweed:Downloading ragweed... 2024-09-12T00:52:19.654 INFO:tasks.ragweed:Using branch 'wip-67986' for ragweed 2024-09-12T00:52:19.655 DEBUG:teuthology.orchestra.run.smithi070:> git clone -b wip-67986 https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:52:19.688 INFO:teuthology.orchestra.run.smithi070.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T00:52:19.875 INFO:tasks.ragweed:Creating rgw users... 2024-09-12T00:52:19.875 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-12T00:52:19.876 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key CKGADROBBTWJSQWNSFPG --secret 6c4KvAserQNNgDoLziwqvoavhlHeEV0nft8xB/xNbxn2ZW2gRFreUA== --email ragweed.client.0+test@test.test --system false 2024-09-12T00:52:19.968 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:19.969 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:20.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.012+0000 7f3cb65559c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.016+0000 7f3cb65559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.016+0000 7f3cb65559c0 20 realm 2024-09-12T00:52:20.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.016+0000 7f3cb65559c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.016+0000 7f3cb65559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.016+0000 7f3cb65559c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:20.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.016+0000 7f3cb65559c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.016+0000 7f3cb65559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.016+0000 7f3cb65559c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.016+0000 7f3cb65559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:20.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.016+0000 7f3cb65559c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.020+0000 7f3cb65559c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:20.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.020+0000 7f3cb65559c0 20 searching for the correct realm 2024-09-12T00:52:20.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.024+0000 7f3cb485c640 0 -- 172.21.15.70:0/2262088555 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f3c9c0d7430 msgr2=0x7f3c9c0d78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:20.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.240+0000 7f3cb485c640 0 -- 172.21.15.70:0/2262088555 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f3c9c0d7430 msgr2=0x7f3c9c0d78b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:20.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.252+0000 7f3cb65559c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:20.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.252+0000 7f3cb65559c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:52:20.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.252+0000 7f3cb65559c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:20.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.252+0000 7f3cb65559c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:52:20.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.252+0000 7f3cb65559c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:20.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.252+0000 7f3cb65559c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:20.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.252+0000 7f3cb65559c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.252+0000 7f3cb65559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.252+0000 7f3cb65559c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.252+0000 7f3cb65559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:20.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.252+0000 7f3cb65559c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.256+0000 7f3cb65559c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:20.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.256+0000 7f3cb65559c0 20 zone default found 2024-09-12T00:52:20.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.256+0000 7f3cb65559c0 4 Realm: () 2024-09-12T00:52:20.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.256+0000 7f3cb65559c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:52:20.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.256+0000 7f3cb65559c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:52:20.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.256+0000 7f3cb65559c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:20.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.256+0000 7f3cb65559c0 20 zonegroup default 2024-09-12T00:52:20.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.256+0000 7f3cb65559c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.256+0000 7f3cb65559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.256+0000 7f3cb65559c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.256+0000 7f3cb65559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.256+0000 7f3cb65559c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.256+0000 7f3cb65559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.256+0000 7f3cb65559c0 20 started sync module instance, tier type = 2024-09-12T00:52:20.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.256+0000 7f3cb65559c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:52:20.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.280+0000 7f3cb65559c0 20 add_watcher() i=0 2024-09-12T00:52:20.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.280+0000 7f3cb65559c0 20 add_watcher() i=1 2024-09-12T00:52:20.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.280+0000 7f3cb65559c0 20 add_watcher() i=2 2024-09-12T00:52:20.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.280+0000 7f3cb65559c0 20 add_watcher() i=3 2024-09-12T00:52:20.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.280+0000 7f3cb65559c0 20 add_watcher() i=4 2024-09-12T00:52:20.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.280+0000 7f3cb65559c0 20 add_watcher() i=5 2024-09-12T00:52:20.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.280+0000 7f3cb65559c0 20 add_watcher() i=6 2024-09-12T00:52:20.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.284+0000 7f3cb65559c0 20 add_watcher() i=7 2024-09-12T00:52:20.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.284+0000 7f3cb65559c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:20.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.288+0000 7f3b6a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:20.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.288+0000 7f3cb65559c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:20.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.288+0000 7f3cb65559c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:20.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.288+0000 7f3cb65559c0 5 note: GC not initialized 2024-09-12T00:52:20.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.288+0000 7f3b697e2640 20 reqs_thread_entry: start 2024-09-12T00:52:20.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.288+0000 7f3cb65559c0 20 init_complete bucket index max shards: 1 2024-09-12T00:52:20.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.288+0000 7f3cb65559c0 20 Filter name: none 2024-09-12T00:52:20.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.288+0000 7f3adaffd640 20 reqs_thread_entry: start 2024-09-12T00:52:20.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.288+0000 7f3cb65559c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T00:52:20.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.288+0000 7f3cb65559c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.288+0000 7f3cb65559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.288+0000 7f3cb65559c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-12T00:52:20.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.288+0000 7f3cb65559c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:52:20.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.288+0000 7f3cb65559c0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-12T00:52:20.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.288+0000 7f3cb65559c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.288+0000 7f3cb65559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.288+0000 7f3cb65559c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-12T00:52:20.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.288+0000 7f3cb65559c0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:52:20.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.288+0000 7f3cb65559c0 10 cache get: name=default.rgw.meta+users.keys+CKGADROBBTWJSQWNSFPG : miss 2024-09-12T00:52:20.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.288+0000 7f3cb65559c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.292+0000 7f3cb65559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.292+0000 7f3cb65559c0 10 cache put: name=default.rgw.meta+users.keys+CKGADROBBTWJSQWNSFPG info.flags=0x0 2024-09-12T00:52:20.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.292+0000 7f3cb65559c0 10 adding default.rgw.meta+users.keys+CKGADROBBTWJSQWNSFPG to cache LRU end 2024-09-12T00:52:20.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.292+0000 7f3cb65559c0 10 cache get: name=default.rgw.meta+users.keys+CKGADROBBTWJSQWNSFPG : hit (negative entry) 2024-09-12T00:52:20.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.292+0000 7f3cb65559c0 10 cache get: name=default.rgw.meta+users.keys+CKGADROBBTWJSQWNSFPG : hit (negative entry) 2024-09-12T00:52:20.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.292+0000 7f3cb65559c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T00:52:20.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.292+0000 7f3cb65559c0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:52:20.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.292+0000 7f3cb65559c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T00:52:20.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.296+0000 7f3b8b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693206 cookie 94243980183808 notifier 5913 bl.length()=675 2024-09-12T00:52:20.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.296+0000 7f3b8b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T00:52:20.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.296+0000 7f3b8b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:52:20.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.300+0000 7f3cb65559c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T00:52:20.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.300+0000 7f3cb65559c0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:52:20.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.300+0000 7f3cb65559c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T00:52:20.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.300+0000 7f3b8affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693200 cookie 94243980177920 notifier 5913 bl.length()=202 2024-09-12T00:52:20.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.300+0000 7f3b8affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T00:52:20.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.300+0000 7f3b8affd640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:52:20.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.304+0000 7f3cb65559c0 10 cache put: name=default.rgw.meta+users.keys+CKGADROBBTWJSQWNSFPG info.flags=0x7 2024-09-12T00:52:20.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.304+0000 7f3cb65559c0 10 moving default.rgw.meta+users.keys+CKGADROBBTWJSQWNSFPG to cache LRU end 2024-09-12T00:52:20.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.304+0000 7f3cb65559c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:CKGADROBBTWJSQWNSFPG, ofs0, ns] 2024-09-12T00:52:20.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.304+0000 7f3b8affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693240 cookie 94243980182752 notifier 5913 bl.length()=190 2024-09-12T00:52:20.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.304+0000 7f3b8affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+CKGADROBBTWJSQWNSFPG info.flags=0x7 2024-09-12T00:52:20.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.304+0000 7f3b8affd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+CKGADROBBTWJSQWNSFPG to cache LRU end 2024-09-12T00:52:20.299 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T00:52:20.299 INFO:teuthology.orchestra.run.smithi070.stdout: "user_id": "ragweed.client.0", 2024-09-12T00:52:20.299 INFO:teuthology.orchestra.run.smithi070.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-12T00:52:20.299 INFO:teuthology.orchestra.run.smithi070.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-12T00:52:20.299 INFO:teuthology.orchestra.run.smithi070.stdout: "suspended": 0, 2024-09-12T00:52:20.299 INFO:teuthology.orchestra.run.smithi070.stdout: "max_buckets": 1000, 2024-09-12T00:52:20.299 INFO:teuthology.orchestra.run.smithi070.stdout: "subusers": [], 2024-09-12T00:52:20.299 INFO:teuthology.orchestra.run.smithi070.stdout: "keys": [ 2024-09-12T00:52:20.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T00:52:20.299 INFO:teuthology.orchestra.run.smithi070.stdout: "user": "ragweed.client.0", 2024-09-12T00:52:20.299 INFO:teuthology.orchestra.run.smithi070.stdout: "access_key": "CKGADROBBTWJSQWNSFPG", 2024-09-12T00:52:20.299 INFO:teuthology.orchestra.run.smithi070.stdout: "secret_key": "6c4KvAserQNNgDoLziwqvoavhlHeEV0nft8xB/xNbxn2ZW2gRFreUA==", 2024-09-12T00:52:20.300 INFO:teuthology.orchestra.run.smithi070.stdout: "active": true, 2024-09-12T00:52:20.300 INFO:teuthology.orchestra.run.smithi070.stdout: "create_date": "2024-09-12T00:52:20.295419Z" 2024-09-12T00:52:20.300 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T00:52:20.300 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T00:52:20.300 INFO:teuthology.orchestra.run.smithi070.stdout: "swift_keys": [], 2024-09-12T00:52:20.300 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": [], 2024-09-12T00:52:20.300 INFO:teuthology.orchestra.run.smithi070.stdout: "op_mask": "read, write, delete", 2024-09-12T00:52:20.300 INFO:teuthology.orchestra.run.smithi070.stdout: "default_placement": "", 2024-09-12T00:52:20.300 INFO:teuthology.orchestra.run.smithi070.stdout: "default_storage_class": "", 2024-09-12T00:52:20.300 INFO:teuthology.orchestra.run.smithi070.stdout: "placement_tags": [], 2024-09-12T00:52:20.300 INFO:teuthology.orchestra.run.smithi070.stdout: "bucket_quota": { 2024-09-12T00:52:20.300 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T00:52:20.301 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T00:52:20.301 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T00:52:20.301 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T00:52:20.301 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T00:52:20.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T00:52:20.301 INFO:teuthology.orchestra.run.smithi070.stdout: "user_quota": { 2024-09-12T00:52:20.301 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T00:52:20.301 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T00:52:20.301 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T00:52:20.301 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T00:52:20.301 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T00:52:20.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T00:52:20.302 INFO:teuthology.orchestra.run.smithi070.stdout: "temp_url_keys": [], 2024-09-12T00:52:20.302 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "rgw", 2024-09-12T00:52:20.302 INFO:teuthology.orchestra.run.smithi070.stdout: "mfa_ids": [], 2024-09-12T00:52:20.302 INFO:teuthology.orchestra.run.smithi070.stdout: "account_id": "", 2024-09-12T00:52:20.302 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2024-09-12T00:52:20.302 INFO:teuthology.orchestra.run.smithi070.stdout: "create_date": "2024-09-12T00:52:20.295384Z", 2024-09-12T00:52:20.302 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T00:52:20.302 INFO:teuthology.orchestra.run.smithi070.stdout: "group_ids": [] 2024-09-12T00:52:20.302 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T00:52:20.302 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:52:20.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.308+0000 7f3b6a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:20.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.312+0000 7f3cb65559c0 20 remove_watcher() i=0 2024-09-12T00:52:20.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.312+0000 7f3cb65559c0 2 removed watcher, disabling cache 2024-09-12T00:52:20.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.312+0000 7f3cb65559c0 20 remove_watcher() i=1 2024-09-12T00:52:20.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.316+0000 7f3cb65559c0 20 remove_watcher() i=2 2024-09-12T00:52:20.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.316+0000 7f3cb65559c0 20 remove_watcher() i=3 2024-09-12T00:52:20.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.320+0000 7f3cb65559c0 20 remove_watcher() i=4 2024-09-12T00:52:20.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.320+0000 7f3cb65559c0 20 remove_watcher() i=5 2024-09-12T00:52:20.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.324+0000 7f3cb65559c0 20 remove_watcher() i=6 2024-09-12T00:52:20.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.324+0000 7f3cb65559c0 20 remove_watcher() i=7 2024-09-12T00:52:20.334 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-12T00:52:20.334 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key KOMSHZNJVEZKDBRFBCOY --secret +4XvmENdqcRLEGBILf2Uoneb894jMJ+RCYQGcvbim5X0ZjLMpziZWw== --email sysuser.client.0+test@test.test --system true 2024-09-12T00:52:20.378 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:20.379 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:20.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.424+0000 7fc8da6329c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.424+0000 7fc8da6329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.424+0000 7fc8da6329c0 20 realm 2024-09-12T00:52:20.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.424+0000 7fc8da6329c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.428+0000 7fc8da6329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.428+0000 7fc8da6329c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:20.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.428+0000 7fc8da6329c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.428+0000 7fc8da6329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.428+0000 7fc8da6329c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.428+0000 7fc8da6329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:20.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.428+0000 7fc8da6329c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.428+0000 7fc8da6329c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:20.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.428+0000 7fc8da6329c0 20 searching for the correct realm 2024-09-12T00:52:20.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.432+0000 7fc8d8939640 0 -- 172.21.15.70:0/3608741413 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fc8c0027070 msgr2=0x7fc8c005d100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:20.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.440+0000 7fc8d8138640 0 -- 172.21.15.70:0/3608741413 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7fc8d0068b80 msgr2=0x7fc8d00678e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:20.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.448+0000 7fc8da6329c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:20.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.448+0000 7fc8da6329c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:52:20.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.448+0000 7fc8da6329c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:20.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.448+0000 7fc8da6329c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:52:20.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.448+0000 7fc8da6329c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:20.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.448+0000 7fc8da6329c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:20.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.448+0000 7fc8da6329c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.448+0000 7fc8da6329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.448+0000 7fc8da6329c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.448+0000 7fc8da6329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:20.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.448+0000 7fc8da6329c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.448+0000 7fc8da6329c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:20.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.448+0000 7fc8da6329c0 20 zone default found 2024-09-12T00:52:20.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.448+0000 7fc8da6329c0 4 Realm: () 2024-09-12T00:52:20.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.448+0000 7fc8da6329c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:52:20.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.448+0000 7fc8da6329c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:52:20.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.448+0000 7fc8da6329c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:20.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.448+0000 7fc8da6329c0 20 zonegroup default 2024-09-12T00:52:20.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.448+0000 7fc8da6329c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.448+0000 7fc8da6329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.448+0000 7fc8da6329c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.448+0000 7fc8da6329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.448+0000 7fc8da6329c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.448+0000 7fc8da6329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.448+0000 7fc8da6329c0 20 started sync module instance, tier type = 2024-09-12T00:52:20.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.448+0000 7fc8da6329c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:52:20.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.464+0000 7fc8da6329c0 20 add_watcher() i=0 2024-09-12T00:52:20.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.464+0000 7fc8da6329c0 20 add_watcher() i=1 2024-09-12T00:52:20.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.464+0000 7fc8da6329c0 20 add_watcher() i=2 2024-09-12T00:52:20.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.464+0000 7fc8da6329c0 20 add_watcher() i=3 2024-09-12T00:52:20.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.464+0000 7fc8da6329c0 20 add_watcher() i=4 2024-09-12T00:52:20.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.464+0000 7fc8da6329c0 20 add_watcher() i=5 2024-09-12T00:52:20.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.464+0000 7fc8da6329c0 20 add_watcher() i=6 2024-09-12T00:52:20.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.464+0000 7fc8da6329c0 20 add_watcher() i=7 2024-09-12T00:52:20.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.464+0000 7fc8da6329c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.468+0000 7fc78efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.468+0000 7fc8da6329c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.468+0000 7fc8da6329c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.468+0000 7fc8da6329c0 5 note: GC not initialized 2024-09-12T00:52:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.468+0000 7fc78dfdb640 20 reqs_thread_entry: start 2024-09-12T00:52:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.468+0000 7fc8da6329c0 20 init_complete bucket index max shards: 1 2024-09-12T00:52:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.468+0000 7fc8da6329c0 20 Filter name: none 2024-09-12T00:52:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.468+0000 7fc6ff7fe640 20 reqs_thread_entry: start 2024-09-12T00:52:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.468+0000 7fc8da6329c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T00:52:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.468+0000 7fc8da6329c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.468+0000 7fc8da6329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.468+0000 7fc8da6329c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-12T00:52:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.468+0000 7fc8da6329c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:52:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.468+0000 7fc8da6329c0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-12T00:52:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.468+0000 7fc8da6329c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.472+0000 7fc8da6329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.472+0000 7fc8da6329c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-12T00:52:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.472+0000 7fc8da6329c0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:52:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.472+0000 7fc8da6329c0 10 cache get: name=default.rgw.meta+users.keys+KOMSHZNJVEZKDBRFBCOY : miss 2024-09-12T00:52:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.472+0000 7fc8da6329c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.472+0000 7fc8da6329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.472+0000 7fc8da6329c0 10 cache put: name=default.rgw.meta+users.keys+KOMSHZNJVEZKDBRFBCOY info.flags=0x0 2024-09-12T00:52:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.472+0000 7fc8da6329c0 10 adding default.rgw.meta+users.keys+KOMSHZNJVEZKDBRFBCOY to cache LRU end 2024-09-12T00:52:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.472+0000 7fc8da6329c0 10 cache get: name=default.rgw.meta+users.keys+KOMSHZNJVEZKDBRFBCOY : hit (negative entry) 2024-09-12T00:52:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.472+0000 7fc8da6329c0 10 cache get: name=default.rgw.meta+users.keys+KOMSHZNJVEZKDBRFBCOY : hit (negative entry) 2024-09-12T00:52:20.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.472+0000 7fc8da6329c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T00:52:20.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.472+0000 7fc8da6329c0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:52:20.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.472+0000 7fc8da6329c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T00:52:20.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.476+0000 7fc7af7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693201 cookie 94241332783856 notifier 5681 bl.length()=675 2024-09-12T00:52:20.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.476+0000 7fc7af7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T00:52:20.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.476+0000 7fc7af7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:52:20.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.476+0000 7fc8da6329c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T00:52:20.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.476+0000 7fc8da6329c0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:52:20.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.476+0000 7fc8da6329c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T00:52:20.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.476+0000 7fc7aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693207 cookie 94241332788416 notifier 5681 bl.length()=202 2024-09-12T00:52:20.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.476+0000 7fc7aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T00:52:20.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.476+0000 7fc7aeffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:52:20.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.480+0000 7fc8da6329c0 10 cache put: name=default.rgw.meta+users.keys+KOMSHZNJVEZKDBRFBCOY info.flags=0x7 2024-09-12T00:52:20.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.480+0000 7fc8da6329c0 10 moving default.rgw.meta+users.keys+KOMSHZNJVEZKDBRFBCOY to cache LRU end 2024-09-12T00:52:20.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.480+0000 7fc8da6329c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:KOMSHZNJVEZKDBRFBCOY, ofs0, ns] 2024-09-12T00:52:20.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.484+0000 7fc7af7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693229 cookie 94241332779824 notifier 5681 bl.length()=190 2024-09-12T00:52:20.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.484+0000 7fc7af7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+KOMSHZNJVEZKDBRFBCOY info.flags=0x7 2024-09-12T00:52:20.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.484+0000 7fc7af7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+KOMSHZNJVEZKDBRFBCOY to cache LRU end 2024-09-12T00:52:20.477 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T00:52:20.477 INFO:teuthology.orchestra.run.smithi070.stdout: "user_id": "sysuser.client.0", 2024-09-12T00:52:20.477 INFO:teuthology.orchestra.run.smithi070.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-12T00:52:20.477 INFO:teuthology.orchestra.run.smithi070.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-12T00:52:20.477 INFO:teuthology.orchestra.run.smithi070.stdout: "suspended": 0, 2024-09-12T00:52:20.477 INFO:teuthology.orchestra.run.smithi070.stdout: "max_buckets": 1000, 2024-09-12T00:52:20.477 INFO:teuthology.orchestra.run.smithi070.stdout: "subusers": [], 2024-09-12T00:52:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: "keys": [ 2024-09-12T00:52:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T00:52:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: "user": "sysuser.client.0", 2024-09-12T00:52:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: "access_key": "KOMSHZNJVEZKDBRFBCOY", 2024-09-12T00:52:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: "secret_key": "+4XvmENdqcRLEGBILf2Uoneb894jMJ+RCYQGcvbim5X0ZjLMpziZWw==", 2024-09-12T00:52:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: "active": true, 2024-09-12T00:52:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: "create_date": "2024-09-12T00:52:20.475706Z" 2024-09-12T00:52:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T00:52:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T00:52:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: "swift_keys": [], 2024-09-12T00:52:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": [], 2024-09-12T00:52:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: "op_mask": "read, write, delete", 2024-09-12T00:52:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: "system": true, 2024-09-12T00:52:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: "default_placement": "", 2024-09-12T00:52:20.478 INFO:teuthology.orchestra.run.smithi070.stdout: "default_storage_class": "", 2024-09-12T00:52:20.479 INFO:teuthology.orchestra.run.smithi070.stdout: "placement_tags": [], 2024-09-12T00:52:20.479 INFO:teuthology.orchestra.run.smithi070.stdout: "bucket_quota": { 2024-09-12T00:52:20.479 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T00:52:20.479 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T00:52:20.479 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T00:52:20.479 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T00:52:20.479 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T00:52:20.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T00:52:20.479 INFO:teuthology.orchestra.run.smithi070.stdout: "user_quota": { 2024-09-12T00:52:20.479 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T00:52:20.479 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T00:52:20.479 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T00:52:20.479 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T00:52:20.479 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T00:52:20.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T00:52:20.480 INFO:teuthology.orchestra.run.smithi070.stdout: "temp_url_keys": [], 2024-09-12T00:52:20.480 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "rgw", 2024-09-12T00:52:20.480 INFO:teuthology.orchestra.run.smithi070.stdout: "mfa_ids": [], 2024-09-12T00:52:20.480 INFO:teuthology.orchestra.run.smithi070.stdout: "account_id": "", 2024-09-12T00:52:20.480 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2024-09-12T00:52:20.480 INFO:teuthology.orchestra.run.smithi070.stdout: "create_date": "2024-09-12T00:52:20.475689Z", 2024-09-12T00:52:20.480 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T00:52:20.480 INFO:teuthology.orchestra.run.smithi070.stdout: "group_ids": [] 2024-09-12T00:52:20.480 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T00:52:20.480 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:52:20.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.484+0000 7fc78efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:20.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.488+0000 7fc8da6329c0 20 remove_watcher() i=0 2024-09-12T00:52:20.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.488+0000 7fc8da6329c0 2 removed watcher, disabling cache 2024-09-12T00:52:20.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.492+0000 7fc8da6329c0 20 remove_watcher() i=1 2024-09-12T00:52:20.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.492+0000 7fc8da6329c0 20 remove_watcher() i=2 2024-09-12T00:52:20.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.496+0000 7fc8da6329c0 20 remove_watcher() i=3 2024-09-12T00:52:20.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.496+0000 7fc8da6329c0 20 remove_watcher() i=4 2024-09-12T00:52:20.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.496+0000 7fc8da6329c0 20 remove_watcher() i=5 2024-09-12T00:52:20.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.500+0000 7fc8da6329c0 20 remove_watcher() i=6 2024-09-12T00:52:20.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:20.500+0000 7fc8da6329c0 20 remove_watcher() i=7 2024-09-12T00:52:20.507 INFO:tasks.ragweed:Configuring ragweed... 2024-09-12T00:52:20.507 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:52:20.507 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-12T00:52:20.553 INFO:tasks.ragweed:Configuring boto... 2024-09-12T00:52:20.553 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:52:20.553 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-12T00:52:20.605 DEBUG:teuthology.orchestra.run.smithi070:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-12T00:52:20.801 INFO:teuthology.orchestra.run.smithi070.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-12T00:52:20.986 INFO:teuthology.orchestra.run.smithi070.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-12T00:52:21.568 INFO:teuthology.orchestra.run.smithi070.stdout:py installdeps: -rrequirements.txt 2024-09-12T00:52:24.193 INFO:teuthology.orchestra.run.smithi070.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-12T00:52:28.412 INFO:teuthology.orchestra.run.smithi070.stdout:py installed: appdirs==1.4.4,asyncssh==2.5.0,attrs==21.2.0,Babel==2.8.0,bcrypt==3.2.0,beautifulsoup4==4.10.0,beniget==0.4.1,blinker==1.4,boto==2.49.0,Brotli==1.0.9,cachetools==5.0.0,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2020.6.20,chardet==4.0.0,cheroot==8.5.2+ds1,CherryPy==18.6.1,command-not-found==0.3,configobj==5.0.6,cryptography==3.4.8,cycler==0.11.0,dbus-python==1.2.18,decorator==4.4.2,distlib==0.3.4,distro==1.7.0,distro-info===1.1build1,docopt==0.6.2,execnet==1.9.0,filelock==3.6.0,fonttools==4.29.1,fs==2.4.12,gast==0.5.2,gevent==21.8.0,google-auth==1.5.1,greenlet==1.1.2,html5lib==1.1,httplib2==0.20.2,idna==3.3,importlib-metadata==4.6.4,iniconfig==1.1.1,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.4.0,jaraco.functools==3.4.0,jaraco.text==3.6.0,jeepney==0.7.1,Jinja2==3.0.3,joblib==0.17.0,keyring==23.5.0,kiwisolver==1.3.2,kubernetes==12.0.1,language-selector==0.1,launchpadlib==1.10.16,lazr.restfulclient==0.14.4,lazr.uri==1.0.6,logutils==0.3.3,lxml==4.8.0,lz4==3.1.3+dfsg,Mako==1.1.3,MarkupSafe==2.0.1,matplotlib==3.5.1,more-itertools==8.10.0,mpmath==0.0.0,munch==4.0.0,natsort==8.0.2,netifaces==0.11.0,nose==1.3.7,numpy==1.21.5,oauthlib==3.2.0,olefile==0.46,packaging==21.3,Paste==3.5.0,PasteDeploy==2.1.1,PasteScript==2.0.2,pecan==1.3.3,Pillow==9.0.1,platformdirs==2.5.1,pluggy==0.13.0,ply==3.11,portend==3.0.0,prettytable==2.5.0,psutil==5.9.0,py==1.10.0,pyasn1==0.4.8,pyasn1-modules==0.2.1,Pygments==2.11.2,PyGObject==3.42.1,pyinotify==0.9.6,PyJWT==2.3.0,pymacaroons==0.13.0,PyNaCl==1.5.0,pyOpenSSL==21.0.0,pyparsing==2.4.7,pytest==6.2.5,python-apt==2.3.0+ubuntu2.1,python-dateutil==2.8.1,python-magic==0.4.24,pythran==0.10.0,pytz==2022.1,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=e046b6c665873ff844372459ab7e81a3f8360af2c9b9fff878ab0fb4fb291120,rbd==2.0.0,registries-conf-ctl @ git+https://github.com/sebastian-philipp/registries-conf-ctl@0e9bf2dc202aa9be9b0bf8e8265aac3f2308f9db,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rsa==4.8,s3cmd==2.2.0,scikit-learn==0.23.2,scipy==1.8.0,SecretStorage==3.3.1,simplegeneric==0.8.1,simplejson==3.17.6,six==1.16.0,soupsieve==2.3.1,ssh-import-id==5.11,sympy==1.9,Tempita==0.5.2,tempora==4.1.2,threadpoolctl==3.1.0,toml==0.10.2,ubuntu-advantage-tools==27.12,ufoLib2==0.13.1,ufw==0.36.1,unattended-upgrades==0.1,unicodedata2==14.0.0,urllib3==1.26.5,virtualenv==20.13.0+ds,wadllib==1.3.6,waitress==1.4.4,wcwidth==0.2.5,webencodings==0.5.1,WebOb==1.8.6,websocket-client==1.2.3,WebTest==2.0.35,Werkzeug==2.0.2,zc.lockfile==2.0,zipp==1.0.0,zope.event==4.4,zope.interface==5.4.0 2024-09-12T00:52:28.412 INFO:teuthology.orchestra.run.smithi070.stdout:py run-test-pre: PYTHONHASHSEED='449697715' 2024-09-12T00:52:28.412 INFO:teuthology.orchestra.run.smithi070.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-12T00:52:28.560 INFO:teuthology.orchestra.run.smithi070.stdout:============================= test session starts ============================== 2024-09-12T00:52:28.560 INFO:teuthology.orchestra.run.smithi070.stdout:platform linux -- Python 3.10.6, pytest-6.2.5, py-1.10.0, pluggy-0.13.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-12T00:52:28.560 INFO:teuthology.orchestra.run.smithi070.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T00:52:28.561 INFO:teuthology.orchestra.run.smithi070.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0, configfile: pytest.ini 2024-09-12T00:52:28.704 INFO:teuthology.orchestra.run.smithi070.stdout:collecting ... collected 9 items 2024-09-12T00:52:28.704 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:52:30.930 INFO:teuthology.orchestra.run.smithi070.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-12T00:52:32.302 INFO:teuthology.orchestra.run.smithi070.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-12T00:52:33.379 INFO:teuthology.orchestra.run.smithi070.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-12T00:52:34.503 INFO:teuthology.orchestra.run.smithi070.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-12T00:52:35.619 INFO:teuthology.orchestra.run.smithi070.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-12T00:52:42.438 INFO:teuthology.orchestra.run.smithi070.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-12T00:52:44.772 INFO:teuthology.orchestra.run.smithi070.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-12T00:52:47.756 INFO:teuthology.orchestra.run.smithi070.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-12T00:52:52.499 INFO:teuthology.orchestra.run.smithi070.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-12T00:52:52.499 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:52:52.499 INFO:teuthology.orchestra.run.smithi070.stdout:=============================== warnings summary =============================== 2024-09-12T00:52:52.499 INFO:teuthology.orchestra.run.smithi070.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-12T00:52:52.499 INFO:teuthology.orchestra.run.smithi070.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-12T00:52:52.499 INFO:teuthology.orchestra.run.smithi070.stdout: import imp 2024-09-12T00:52:52.499 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T00:52:52.500 INFO:teuthology.orchestra.run.smithi070.stdout:-- Docs: https://docs.pytest.org/en/stable/warnings.html 2024-09-12T00:52:52.500 INFO:teuthology.orchestra.run.smithi070.stdout:======================== 9 passed, 1 warning in 23.94s ========================= 2024-09-12T00:52:52.545 INFO:teuthology.orchestra.run.smithi070.stdout:___________________________________ summary ____________________________________ 2024-09-12T00:52:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: py: commands succeeded 2024-09-12T00:52:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: congratulations :) 2024-09-12T00:52:52.564 INFO:tasks.ragweed:Cleaning up boto... 2024-09-12T00:52:52.564 DEBUG:teuthology.orchestra.run.smithi070:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-12T00:52:52.569 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-12T00:52:52.646 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:52.647 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:52.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.690+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:52.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.690+0000 7f07401539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:52.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.690+0000 7f07401539c0 20 realm 2024-09-12T00:52:52.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.690+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:52.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.690+0000 7f07401539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:52.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.690+0000 7f07401539c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:52.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.690+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:52.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.690+0000 7f07401539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:52.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.690+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:52.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.694+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:52.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.694+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:52.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.694+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:52.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.694+0000 7f07401539c0 20 searching for the correct realm 2024-09-12T00:52:52.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.698+0000 7f073e45a640 0 -- 172.21.15.70:0/341635799 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f072803b040 msgr2=0x7f072803c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:52.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.914+0000 7f073e45a640 0 -- 172.21.15.70:0/341635799 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f072803b040 msgr2=0x7f072803c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:52.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.926+0000 7f07401539c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:52.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.926+0000 7f07401539c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:52:52.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.926+0000 7f07401539c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:52.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.926+0000 7f07401539c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:52:52.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.926+0000 7f07401539c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:52.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.926+0000 7f07401539c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:52.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.926+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:52.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.926+0000 7f07401539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:52.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.926+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:52.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.926+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:52.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.926+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:52.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.930+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:52.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.930+0000 7f07401539c0 20 zone default found 2024-09-12T00:52:52.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.930+0000 7f07401539c0 4 Realm: () 2024-09-12T00:52:52.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.930+0000 7f07401539c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:52:52.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.930+0000 7f07401539c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:52:52.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.930+0000 7f07401539c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:52.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.930+0000 7f07401539c0 20 zonegroup default 2024-09-12T00:52:52.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.930+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:52.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.930+0000 7f07401539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:52.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.930+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:52.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.930+0000 7f07401539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:52.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.930+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:52.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.930+0000 7f07401539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:52.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.930+0000 7f07401539c0 20 started sync module instance, tier type = 2024-09-12T00:52:52.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.930+0000 7f07401539c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:52:52.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.954+0000 7f07401539c0 20 add_watcher() i=0 2024-09-12T00:52:52.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.954+0000 7f07401539c0 20 add_watcher() i=1 2024-09-12T00:52:52.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.954+0000 7f07401539c0 20 add_watcher() i=2 2024-09-12T00:52:52.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.954+0000 7f07401539c0 20 add_watcher() i=3 2024-09-12T00:52:52.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.954+0000 7f07401539c0 20 add_watcher() i=4 2024-09-12T00:52:52.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.954+0000 7f07401539c0 20 add_watcher() i=5 2024-09-12T00:52:52.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.954+0000 7f07401539c0 20 add_watcher() i=6 2024-09-12T00:52:52.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.958+0000 7f07401539c0 20 add_watcher() i=7 2024-09-12T00:52:52.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.958+0000 7f07401539c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:52.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.962+0000 7f05ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:52.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.962+0000 7f07401539c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:52.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:52.962+0000 7f07401539c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:53.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.050+0000 7f05ee7fc640 20 reqs_thread_entry: start 2024-09-12T00:52:53.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.054+0000 7f07401539c0 20 init_complete bucket index max shards: 1 2024-09-12T00:52:53.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.054+0000 7f07401539c0 20 Filter name: none 2024-09-12T00:52:53.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.054+0000 7f055ffff640 20 reqs_thread_entry: start 2024-09-12T00:52:53.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.054+0000 7f07401539c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T00:52:53.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.054+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.054+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:52:53.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.054+0000 7f07401539c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-12T00:52:53.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.054+0000 7f07401539c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:52:53.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.054+0000 7f07401539c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:53.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.054+0000 7f07401539c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5 : miss 2024-09-12T00:52:53.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.054+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.054+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=426 2024-09-12T00:52:53.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.054+0000 7f07401539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5 info.flags=0x17 2024-09-12T00:52:53.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.054+0000 7f07401539c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5 to cache LRU end 2024-09-12T00:52:53.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.054+0000 7f07401539c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:53.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.054+0000 7f07401539c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:52:53.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.054+0000 7f07401539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5 2024-09-12T00:52:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.058+0000 7f07401539c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-12T00:52:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.058+0000 7f07401539c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-12T00:52:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.058+0000 7f07401539c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-12T00:52:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.058+0000 7f07401539c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-12T00:52:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.058+0000 7f07401539c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-12T00:52:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.058+0000 7f07401539c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-12T00:52:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.058+0000 7f07401539c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-12T00:52:53.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.058+0000 7f07401539c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-12T00:52:53.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.058+0000 7f07401539c0 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-12T00:52:53.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.058+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f283850 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55d31f38eb08 s->prefetch_data=0 2024-09-12T00:52:53.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.058+0000 7f07401539c0 10 manifest: total_size = 5205 2024-09-12T00:52:53.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.058+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5163093847101808498 2024-09-12T00:52:53.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.058+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f283850 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55d31f38eb08 s->prefetch_data=0 2024-09-12T00:52:53.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.058+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f38eb08 2024-09-12T00:52:53.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.058+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5.0 2024-09-12T00:52:53.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.062+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.062+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=5205 stripe_ofs=5205 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.062+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5163093847101808498 2024-09-12T00:52:53.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.062+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.062+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5__shadow_.uGHuvANgkR5yzkSsiCYNjKqGA1WO4Xo_0 2024-09-12T00:52:53.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.062+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:52:53.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.062+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.062+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5163093847101808498 2024-09-12T00:52:53.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.066+0000 7f06217fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-12T00:52:53.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.066+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f283850 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55d31f38eb08 s->prefetch_data=0 2024-09-12T00:52:53.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.066+0000 7f07401539c0 10 manifest: total_size = 5209 2024-09-12T00:52:53.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.066+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3807657173666510560 2024-09-12T00:52:53.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.066+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f283850 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55d31f38eb08 s->prefetch_data=0 2024-09-12T00:52:53.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.066+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f38eb08 2024-09-12T00:52:53.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.066+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5.0 2024-09-12T00:52:53.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.070+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.070+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=5209 stripe_ofs=5209 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.070+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3807657173666510560 2024-09-12T00:52:53.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.070+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.070+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5__shadow_.7X2dpjtuDZaUtayGIk6Ov_OuAPkFHEG_0 2024-09-12T00:52:53.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.070+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:52:53.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.070+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.070+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3807657173666510560 2024-09-12T00:52:53.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.074+0000 7f0620ff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-12T00:52:53.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.074+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f283850 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55d31f38eb08 s->prefetch_data=0 2024-09-12T00:52:53.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.074+0000 7f07401539c0 10 manifest: total_size = 4888 2024-09-12T00:52:53.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.074+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14720083465958919231 2024-09-12T00:52:53.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.074+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f283850 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55d31f38eb08 s->prefetch_data=0 2024-09-12T00:52:53.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.074+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f38eb08 2024-09-12T00:52:53.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.074+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5.0 2024-09-12T00:52:53.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.082+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.082+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=4888 stripe_ofs=4888 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.082+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14720083465958919231 2024-09-12T00:52:53.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.082+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.082+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5__shadow_.SSLZiouLmUiT5YoHatXDtcUXH1wqd1N_0 2024-09-12T00:52:53.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.082+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:52:53.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.082+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.082+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14720083465958919231 2024-09-12T00:52:53.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.082+0000 7f06217fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-12T00:52:53.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.086+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f283850 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55d31f38eb08 s->prefetch_data=0 2024-09-12T00:52:53.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.086+0000 7f07401539c0 10 manifest: total_size = 4905 2024-09-12T00:52:53.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.086+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2065410714995267126 2024-09-12T00:52:53.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.086+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f283850 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55d31f38eb08 s->prefetch_data=0 2024-09-12T00:52:53.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.086+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f38eb08 2024-09-12T00:52:53.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.086+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5.0 2024-09-12T00:52:53.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.090+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.090+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=4905 stripe_ofs=4905 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.090+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2065410714995267126 2024-09-12T00:52:53.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.090+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.090+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5__shadow_.glbkoVXtq7kuyioLyXEhUFXg0qpiUp8_0 2024-09-12T00:52:53.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.090+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:52:53.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.090+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.090+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2065410714995267126 2024-09-12T00:52:53.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.094+0000 7f0620ff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-12T00:52:53.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.094+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f283850 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55d31f38eb08 s->prefetch_data=0 2024-09-12T00:52:53.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.094+0000 7f07401539c0 10 manifest: total_size = 5180 2024-09-12T00:52:53.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.094+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7922636097674205713 2024-09-12T00:52:53.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.094+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f283850 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55d31f38eb08 s->prefetch_data=0 2024-09-12T00:52:53.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.094+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f38eb08 2024-09-12T00:52:53.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.094+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5.0 2024-09-12T00:52:53.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.098+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.098+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=5180 stripe_ofs=5180 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.098+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7922636097674205713 2024-09-12T00:52:53.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.098+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.098+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5__shadow_.7R44TPDs7KRMrwUAzfBhku7rWIJePiN_0 2024-09-12T00:52:53.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.098+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:52:53.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.098+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.098+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7922636097674205713 2024-09-12T00:52:53.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.098+0000 7f06217fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-12T00:52:53.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.102+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f283850 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55d31f38eb08 s->prefetch_data=0 2024-09-12T00:52:53.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.102+0000 7f07401539c0 10 manifest: total_size = 5246 2024-09-12T00:52:53.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.102+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13732457892508302789 2024-09-12T00:52:53.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.102+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f283850 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55d31f38eb08 s->prefetch_data=0 2024-09-12T00:52:53.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.102+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f38eb08 2024-09-12T00:52:53.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.102+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5.0 2024-09-12T00:52:53.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.106+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.106+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=5246 stripe_ofs=5246 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.106+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13732457892508302789 2024-09-12T00:52:53.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.106+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.106+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5__shadow_.P4SI_oeVCyXxOm5P-xWYwBjEq1W3dPQ_0 2024-09-12T00:52:53.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.106+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:52:53.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.106+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.106+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13732457892508302789 2024-09-12T00:52:53.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.110+0000 7f0620ff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-12T00:52:53.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.110+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f283850 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55d31f38eb08 s->prefetch_data=0 2024-09-12T00:52:53.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.110+0000 7f07401539c0 10 manifest: total_size = 7815 2024-09-12T00:52:53.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.110+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13130071577082273037 2024-09-12T00:52:53.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.110+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f283850 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55d31f38eb08 s->prefetch_data=0 2024-09-12T00:52:53.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.110+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f38eb08 2024-09-12T00:52:53.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.110+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5.0 2024-09-12T00:52:53.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.114+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.114+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=7815 stripe_ofs=7815 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.114+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13130071577082273037 2024-09-12T00:52:53.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.114+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.114+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5__shadow_.4X5DEE7cw9lnR-AmQhAf1RTVULMNZOg_0 2024-09-12T00:52:53.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.114+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:52:53.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.114+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.114+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13130071577082273037 2024-09-12T00:52:53.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.118+0000 7f06217fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-12T00:52:53.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.118+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f283850 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55d31f38eb08 s->prefetch_data=0 2024-09-12T00:52:53.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.118+0000 7f07401539c0 10 manifest: total_size = 7824 2024-09-12T00:52:53.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.118+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13179550444940031412 2024-09-12T00:52:53.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.118+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f283850 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55d31f38eb08 s->prefetch_data=0 2024-09-12T00:52:53.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.118+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f38eb08 2024-09-12T00:52:53.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.118+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5.0 2024-09-12T00:52:53.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.126+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.126+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=7824 stripe_ofs=7824 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.126+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13179550444940031412 2024-09-12T00:52:53.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.126+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.126+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5__shadow_.PqcYjRnk76vsa9GBChgIO60xG6oKri0_0 2024-09-12T00:52:53.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.126+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:52:53.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.126+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.126+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13179550444940031412 2024-09-12T00:52:53.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.126+0000 7f07401539c0 20 get_obj_state: octx=0x7f0730058180 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55d31f38eb08 s->prefetch_data=0 2024-09-12T00:52:53.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.126+0000 7f0620ff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-12T00:52:53.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.126+0000 7f07401539c0 10 manifest: total_size = 7775 2024-09-12T00:52:53.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.126+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11829806707158470828 2024-09-12T00:52:53.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.126+0000 7f07401539c0 20 get_obj_state: octx=0x7f0730058180 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55d31f38eb08 s->prefetch_data=0 2024-09-12T00:52:53.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.126+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f38eb08 2024-09-12T00:52:53.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.126+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5.0 2024-09-12T00:52:53.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.134+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.134+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=7775 stripe_ofs=7775 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.134+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11829806707158470828 2024-09-12T00:52:53.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.134+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.134+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5__shadow_.3pVFEeqMFHfsGTyoHjDItVp9I4KUMa2_0 2024-09-12T00:52:53.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.134+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:52:53.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.134+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.134+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11829806707158470828 2024-09-12T00:52:53.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.134+0000 7f07401539c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:52:53.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.134+0000 7f07401539c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:52:53.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.134+0000 7f06217fa640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-12T00:52:53.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.134+0000 7f07401539c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:52:53.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.134+0000 7f07401539c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:52:53.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.134+0000 7f07401539c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:52:53.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.134+0000 7f07401539c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:52:53.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.134+0000 7f07401539c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5])"; uploads.size()=0; is_truncated=0 2024-09-12T00:52:53.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.138+0000 7f07401539c0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-12T00:52:53.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.138+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.138+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=204 2024-09-12T00:52:53.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.138+0000 7f07401539c0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-12T00:52:53.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.138+0000 7f07401539c0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-12T00:52:53.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.142+0000 7f07401539c0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-12T00:52:53.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.142+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-12T00:52:53.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.142+0000 7f0620ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496987 cookie 94365249574496 notifier 5970 bl.length()=162 2024-09-12T00:52:53.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.146+0000 7f07401539c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5 from cache 2024-09-12T00:52:53.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.146+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5, ofs0, ns] 2024-09-12T00:52:53.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.146+0000 7f06217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496985 cookie 94365249585440 notifier 5970 bl.length()=219 2024-09-12T00:52:53.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.150+0000 7f07401539c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5 : miss 2024-09-12T00:52:53.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.150+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.150+0000 7f07401539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:53.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.150+0000 7f07401539c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5 info.flags=0x0 2024-09-12T00:52:53.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.150+0000 7f07401539c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5 to cache LRU end 2024-09-12T00:52:53.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.154+0000 7f07401539c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12 : miss 2024-09-12T00:52:53.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.154+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.154+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=457 2024-09-12T00:52:53.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.154+0000 7f07401539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12 info.flags=0x17 2024-09-12T00:52:53.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.154+0000 7f07401539c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12 to cache LRU end 2024-09-12T00:52:53.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.154+0000 7f07401539c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:53.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.154+0000 7f07401539c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:52:53.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.154+0000 7f07401539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12 2024-09-12T00:52:53.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.158+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo 2024-09-12T00:52:53.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.158+0000 7f07401539c0 20 get_obj_state: octx=0x7f0730065990 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55d31f314878 s->prefetch_data=0 2024-09-12T00:52:53.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.158+0000 7f07401539c0 10 manifest: total_size = 74198 2024-09-12T00:52:53.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.158+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12345318604046130217 2024-09-12T00:52:53.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.158+0000 7f07401539c0 20 get_obj_state: octx=0x7f0730065990 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55d31f314878 s->prefetch_data=0 2024-09-12T00:52:53.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.158+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f314878 2024-09-12T00:52:53.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.158+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12.0 2024-09-12T00:52:53.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.162+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:52:53.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.162+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-12T00:52:53.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.162+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T00:52:53.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.162+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:52:53.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.162+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-12T00:52:53.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.162+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-12T00:52:53.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.162+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:52:53.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.162+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=20613 2024-09-12T00:52:53.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.162+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-12T00:52:53.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.162+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-12T00:52:53.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.162+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6353295 part_ofs=61839 rule->part_size=12359 2024-09-12T00:52:53.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.162+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-12T00:52:53.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.162+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12345318604046130217 2024-09-12T00:52:53.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.162+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.162+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12__multipart_foo.2~SdGAWjDWW4Jrfo-zTyW_5b_RlyUJjX2.1 2024-09-12T00:52:53.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.162+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T00:52:53.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.162+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12__multipart_foo.2~SdGAWjDWW4Jrfo-zTyW_5b_RlyUJjX2.2 2024-09-12T00:52:53.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.162+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T00:52:53.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.162+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12__multipart_foo.2~SdGAWjDWW4Jrfo-zTyW_5b_RlyUJjX2.3 2024-09-12T00:52:53.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.162+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T00:52:53.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.162+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12__multipart_foo.2~SdGAWjDWW4Jrfo-zTyW_5b_RlyUJjX2.4 2024-09-12T00:52:53.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.162+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T00:52:53.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.162+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.162+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12345318604046130217 2024-09-12T00:52:53.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.166+0000 7f06217fa640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:52:53.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.166+0000 7f07401539c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:52:53.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.166+0000 7f07401539c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:52:53.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.166+0000 7f07401539c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:52:53.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.166+0000 7f07401539c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:52:53.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.166+0000 7f07401539c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:52:53.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.166+0000 7f07401539c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:52:53.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.166+0000 7f07401539c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12])"; uploads.size()=0; is_truncated=0 2024-09-12T00:52:53.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.170+0000 7f07401539c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-12T00:52:53.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.170+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.170+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=235 2024-09-12T00:52:53.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.170+0000 7f07401539c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-12T00:52:53.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.170+0000 7f07401539c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-12T00:52:53.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.174+0000 7f07401539c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-12T00:52:53.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.174+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-12T00:52:53.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.174+0000 7f0620ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497011 cookie 94365249581888 notifier 5970 bl.length()=191 2024-09-12T00:52:53.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.178+0000 7f07401539c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12 from cache 2024-09-12T00:52:53.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.178+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12, ofs0, ns] 2024-09-12T00:52:53.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.178+0000 7f0620ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496988 cookie 94365249574496 notifier 5970 bl.length()=249 2024-09-12T00:52:53.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.182+0000 7f07401539c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12 : miss 2024-09-12T00:52:53.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.182+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.182+0000 7f07401539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:53.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.182+0000 7f07401539c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12 info.flags=0x0 2024-09-12T00:52:53.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.182+0000 7f07401539c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12 to cache LRU end 2024-09-12T00:52:53.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.186+0000 7f07401539c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13 : miss 2024-09-12T00:52:53.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.186+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.190+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=464 2024-09-12T00:52:53.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.190+0000 7f07401539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13 info.flags=0x17 2024-09-12T00:52:53.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.190+0000 7f07401539c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13 to cache LRU end 2024-09-12T00:52:53.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.190+0000 7f07401539c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:53.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.190+0000 7f07401539c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:52:53.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.190+0000 7f07401539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13 2024-09-12T00:52:53.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.190+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo 2024-09-12T00:52:53.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.190+0000 7f07401539c0 20 get_obj_state: octx=0x7f073007a6a0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55d31f2f0068 s->prefetch_data=0 2024-09-12T00:52:53.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.190+0000 7f07401539c0 10 manifest: total_size = 74198 2024-09-12T00:52:53.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.190+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13247872177563701367 2024-09-12T00:52:53.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.190+0000 7f07401539c0 20 get_obj_state: octx=0x7f073007a6a0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55d31f2f0068 s->prefetch_data=0 2024-09-12T00:52:53.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.190+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f2f0068 2024-09-12T00:52:53.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.190+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13.0 2024-09-12T00:52:53.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.194+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:52:53.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.194+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-12T00:52:53.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.194+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T00:52:53.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.194+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:52:53.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.194+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-12T00:52:53.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.194+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-12T00:52:53.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.194+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:52:53.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.194+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=20613 2024-09-12T00:52:53.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.194+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-12T00:52:53.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.194+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-12T00:52:53.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.194+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6353295 part_ofs=61839 rule->part_size=12359 2024-09-12T00:52:53.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.194+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-12T00:52:53.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.194+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13247872177563701367 2024-09-12T00:52:53.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.194+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.194+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13__multipart_foo.2~JbN7136mF67L8MVHNpDjFIb2WS-t0Kx.1 2024-09-12T00:52:53.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.194+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T00:52:53.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.194+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13__multipart_foo.2~JbN7136mF67L8MVHNpDjFIb2WS-t0Kx.2 2024-09-12T00:52:53.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.194+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T00:52:53.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.194+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13__multipart_foo.2~JbN7136mF67L8MVHNpDjFIb2WS-t0Kx.3 2024-09-12T00:52:53.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.194+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T00:52:53.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.194+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13__multipart_foo.2~JbN7136mF67L8MVHNpDjFIb2WS-t0Kx.4 2024-09-12T00:52:53.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.194+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T00:52:53.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.194+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.194+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13247872177563701367 2024-09-12T00:52:53.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.198+0000 7f06217fa640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:52:53.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.198+0000 7f07401539c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:52:53.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.198+0000 7f07401539c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:52:53.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.198+0000 7f07401539c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:52:53.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.198+0000 7f07401539c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:52:53.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.198+0000 7f07401539c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:52:53.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.198+0000 7f07401539c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:52:53.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.198+0000 7f07401539c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13])"; uploads.size()=0; is_truncated=0 2024-09-12T00:52:53.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.202+0000 7f07401539c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-12T00:52:53.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.202+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.202+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=242 2024-09-12T00:52:53.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.202+0000 7f07401539c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-12T00:52:53.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.202+0000 7f07401539c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-12T00:52:53.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.206+0000 7f07401539c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-12T00:52:53.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.206+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-12T00:52:53.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.206+0000 7f0620ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496986 cookie 94365249585440 notifier 5970 bl.length()=198 2024-09-12T00:52:53.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.210+0000 7f07401539c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13 from cache 2024-09-12T00:52:53.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.210+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13, ofs0, ns] 2024-09-12T00:52:53.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.210+0000 7f06217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496986 cookie 94365249591248 notifier 5970 bl.length()=256 2024-09-12T00:52:53.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.214+0000 7f07401539c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13 : miss 2024-09-12T00:52:53.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.214+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.214+0000 7f07401539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:53.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.214+0000 7f07401539c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13 info.flags=0x0 2024-09-12T00:52:53.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.214+0000 7f07401539c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13 to cache LRU end 2024-09-12T00:52:53.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.218+0000 7f07401539c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11 : miss 2024-09-12T00:52:53.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.218+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.218+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=459 2024-09-12T00:52:53.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.218+0000 7f07401539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11 info.flags=0x17 2024-09-12T00:52:53.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.218+0000 7f07401539c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11 to cache LRU end 2024-09-12T00:52:53.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.218+0000 7f07401539c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:53.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.218+0000 7f07401539c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:52:53.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.218+0000 7f07401539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11 2024-09-12T00:52:53.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.222+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo[1xbwZf.6uUqJDR8kAbVtpQR7RaAZvBW] 2024-09-12T00:52:53.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.222+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11.0 2024-09-12T00:52:53.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.222+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380fb530 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55d31f314318 s->prefetch_data=0 2024-09-12T00:52:53.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.222+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to tt8kfbfldrry8aytubehf0kyj273asvf 2024-09-12T00:52:53.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.222+0000 7f07401539c0 20 get_obj_state_impl: setting s->olh_tag to rzfkrw8d38tynps8m9g7n2oj2yjp38cw 2024-09-12T00:52:53.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.222+0000 7f07401539c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rzfkrw8d38tynps8m9g7n2oj2yjp38cw 2024-09-12T00:52:53.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.226+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11.0 2024-09-12T00:52:53.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.230+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11.0 2024-09-12T00:52:53.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.230+0000 7f07401539c0 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-12T00:52:53.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.230+0000 7f07401539c0 20 olh_log_entry: epoch=3 op=3 key=foo[1xbwZf.6uUqJDR8kAbVtpQR7RaAZvBW] 2024-09-12T00:52:53.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.230+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380fb530 obj=test-client.0-r-test-multipart-index-versioning.1:_:1xbwZf.6uUqJDR8kAbVtpQR7RaAZvBW_foo state=0x55d31f326288 s->prefetch_data=0 2024-09-12T00:52:53.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.230+0000 7f07401539c0 10 manifest: total_size = 18874368 2024-09-12T00:52:53.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.230+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2222175213655723263 2024-09-12T00:52:53.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.230+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380fb530 obj=test-client.0-r-test-multipart-index-versioning.1:_:1xbwZf.6uUqJDR8kAbVtpQR7RaAZvBW_foo state=0x55d31f326288 s->prefetch_data=0 2024-09-12T00:52:53.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.230+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f326288 2024-09-12T00:52:53.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.230+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11.0 2024-09-12T00:52:53.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.238+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:52:53.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.238+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:52:53.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.238+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:52:53.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.238+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:52:53.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.238+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:52:53.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.238+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-12T00:52:53.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.238+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:52:53.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.238+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2024-09-12T00:52:53.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.238+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-12T00:52:53.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.238+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-12T00:52:53.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.238+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2024-09-12T00:52:53.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.238+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-12T00:52:53.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.238+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2222175213655723263 2024-09-12T00:52:53.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.238+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.238+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11__multipart_foo.2~y8qEU0pmYUk9MtxNCAsKeMhFLqh5p-e.1 2024-09-12T00:52:53.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.238+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T00:52:53.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.238+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11__multipart_foo.2~y8qEU0pmYUk9MtxNCAsKeMhFLqh5p-e.2 2024-09-12T00:52:53.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.238+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T00:52:53.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.238+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11__multipart_foo.2~y8qEU0pmYUk9MtxNCAsKeMhFLqh5p-e.3 2024-09-12T00:52:53.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.238+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T00:52:53.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.238+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11__multipart_foo.2~y8qEU0pmYUk9MtxNCAsKeMhFLqh5p-e.4 2024-09-12T00:52:53.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.238+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T00:52:53.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.238+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.238+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2222175213655723263 2024-09-12T00:52:53.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.238+0000 7f0620ff9640 20 handle_completion(): completion ok for obj=foo[1xbwZf.6uUqJDR8kAbVtpQR7RaAZvBW] 2024-09-12T00:52:53.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.242+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380fb530 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55d31f314318 s->prefetch_data=0 2024-09-12T00:52:53.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.246+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11.0 2024-09-12T00:52:53.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.250+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11.0 2024-09-12T00:52:53.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.250+0000 7f07401539c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:52:53.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.250+0000 7f07401539c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:52:53.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.250+0000 7f07401539c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:52:53.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.250+0000 7f07401539c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:52:53.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.250+0000 7f07401539c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:52:53.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.250+0000 7f07401539c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:52:53.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.250+0000 7f07401539c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11])"; uploads.size()=0; is_truncated=0 2024-09-12T00:52:53.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.254+0000 7f07401539c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-12T00:52:53.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.254+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.254+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=237 2024-09-12T00:52:53.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.254+0000 7f07401539c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-12T00:52:53.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.254+0000 7f07401539c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-12T00:52:53.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.254+0000 7f07401539c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-12T00:52:53.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.254+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-12T00:52:53.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.254+0000 7f06217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496987 cookie 94365249585440 notifier 5970 bl.length()=193 2024-09-12T00:52:53.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.262+0000 7f07401539c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11 from cache 2024-09-12T00:52:53.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.262+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11, ofs0, ns] 2024-09-12T00:52:53.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.262+0000 7f0620ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497021 cookie 94365249580320 notifier 5970 bl.length()=251 2024-09-12T00:52:53.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.266+0000 7f07401539c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11 : miss 2024-09-12T00:52:53.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.266+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.266+0000 7f07401539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:53.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.266+0000 7f07401539c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11 info.flags=0x0 2024-09-12T00:52:53.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.266+0000 7f07401539c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11 to cache LRU end 2024-09-12T00:52:53.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.270+0000 7f07401539c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10 : miss 2024-09-12T00:52:53.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.270+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.270+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=449 2024-09-12T00:52:53.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.270+0000 7f07401539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10 info.flags=0x17 2024-09-12T00:52:53.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.270+0000 7f07401539c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10 to cache LRU end 2024-09-12T00:52:53.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.270+0000 7f07401539c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:53.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.270+0000 7f07401539c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:52:53.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.270+0000 7f07401539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10 2024-09-12T00:52:53.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.270+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo 2024-09-12T00:52:53.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.270+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f318670 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55d31f314318 s->prefetch_data=0 2024-09-12T00:52:53.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.274+0000 7f07401539c0 10 manifest: total_size = 26081 2024-09-12T00:52:53.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.274+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.564683416628051245 2024-09-12T00:52:53.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.274+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f318670 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55d31f314318 s->prefetch_data=0 2024-09-12T00:52:53.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.274+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f314318 2024-09-12T00:52:53.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.274+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10.0 2024-09-12T00:52:53.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.278+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-09-12T00:52:53.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.278+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7672 2024-09-12T00:52:53.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.278+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7672 2024-09-12T00:52:53.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.278+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-09-12T00:52:53.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.278+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6299128 part_ofs=7672 rule->part_size=7672 2024-09-12T00:52:53.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.278+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=15344 stripe_ofs=15344 part_ofs=15344 rule->part_size=7670 2024-09-12T00:52:53.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.278+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=3 2024-09-12T00:52:53.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.278+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6306800 part_ofs=15344 rule->part_size=7670 2024-09-12T00:52:53.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.278+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=23014 stripe_ofs=23014 part_ofs=23014 rule->part_size=3067 2024-09-12T00:52:53.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.278+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=3 2024-09-12T00:52:53.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.278+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6314470 part_ofs=23014 rule->part_size=3067 2024-09-12T00:52:53.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.278+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=26081 stripe_ofs=26081 part_ofs=26081 rule->part_size=3067 2024-09-12T00:52:53.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.278+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.564683416628051245 2024-09-12T00:52:53.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.278+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.278+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10__multipart_foo.2~DqU3uok9KgvZP0AhGCiW7uszsaxB8ie.1 2024-09-12T00:52:53.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.278+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2024-09-12T00:52:53.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.278+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10__multipart_foo.2~DqU3uok9KgvZP0AhGCiW7uszsaxB8ie.2 2024-09-12T00:52:53.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.278+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 591 2024-09-12T00:52:53.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.278+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10__multipart_foo.2~DqU3uok9KgvZP0AhGCiW7uszsaxB8ie.3 2024-09-12T00:52:53.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.278+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 837 2024-09-12T00:52:53.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.278+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10__multipart_foo.2~DqU3uok9KgvZP0AhGCiW7uszsaxB8ie.4 2024-09-12T00:52:53.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.278+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1083 2024-09-12T00:52:53.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.278+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.278+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.564683416628051245 2024-09-12T00:52:53.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.278+0000 7f0620ff9640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:52:53.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.282+0000 7f07401539c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:52:53.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.282+0000 7f07401539c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:52:53.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.282+0000 7f07401539c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:52:53.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.282+0000 7f07401539c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:52:53.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.282+0000 7f07401539c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:52:53.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.282+0000 7f07401539c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:52:53.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.282+0000 7f07401539c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10])"; uploads.size()=0; is_truncated=0 2024-09-12T00:52:53.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.282+0000 7f07401539c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-12T00:52:53.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.282+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.286+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=227 2024-09-12T00:52:53.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.286+0000 7f07401539c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-12T00:52:53.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.286+0000 7f07401539c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-12T00:52:53.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.286+0000 7f07401539c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-12T00:52:53.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.286+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-12T00:52:53.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.290+0000 7f06217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496989 cookie 94365249588112 notifier 5970 bl.length()=183 2024-09-12T00:52:53.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.290+0000 7f07401539c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10 from cache 2024-09-12T00:52:53.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.290+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10, ofs0, ns] 2024-09-12T00:52:53.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.294+0000 7f0620ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497012 cookie 94365249581888 notifier 5970 bl.length()=241 2024-09-12T00:52:53.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.294+0000 7f07401539c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10 : miss 2024-09-12T00:52:53.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.294+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.298+0000 7f07401539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:53.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.298+0000 7f07401539c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10 info.flags=0x0 2024-09-12T00:52:53.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.298+0000 7f07401539c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10 to cache LRU end 2024-09-12T00:52:53.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.302+0000 7f07401539c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16 : miss 2024-09-12T00:52:53.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.302+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.302+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:52:53.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.302+0000 7f07401539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16 info.flags=0x17 2024-09-12T00:52:53.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.302+0000 7f07401539c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16 to cache LRU end 2024-09-12T00:52:53.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.302+0000 7f07401539c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:53.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.302+0000 7f07401539c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:52:53.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.302+0000 7f07401539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16 2024-09-12T00:52:53.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.302+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:52:53.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.302+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T00:52:53.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.302+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T00:52:53.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.302+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T00:52:53.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.302+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:52:53.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.302+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T00:52:53.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.302+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T00:52:53.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.302+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T00:52:53.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.302+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:52:53.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.302+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T00:52:53.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.302+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T00:52:53.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.302+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T00:52:53.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.302+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f319500 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55d31f2efb58 s->prefetch_data=0 2024-09-12T00:52:53.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.302+0000 7f07401539c0 10 manifest: total_size = 5242880 2024-09-12T00:52:53.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.302+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9013878756968447880 2024-09-12T00:52:53.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.302+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f319500 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55d31f2efb58 s->prefetch_data=0 2024-09-12T00:52:53.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.302+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f2efb58 2024-09-12T00:52:53.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.302+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16.0 2024-09-12T00:52:53.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.310+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.310+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.310+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9013878756968447880 2024-09-12T00:52:53.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.310+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.310+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16__shadow_.wc0KX0K7eP0wpAu4U0p_mQ9dvgLDX4Y_0 2024-09-12T00:52:53.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.310+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T00:52:53.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.310+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.310+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9013878756968447880 2024-09-12T00:52:53.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.310+0000 7f0620ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:52:53.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.310+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f319500 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55d31f2efb58 s->prefetch_data=0 2024-09-12T00:52:53.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.314+0000 7f07401539c0 10 manifest: total_size = 5242880 2024-09-12T00:52:53.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.314+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9294444906539097941 2024-09-12T00:52:53.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.314+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f319500 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55d31f2efb58 s->prefetch_data=0 2024-09-12T00:52:53.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.314+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f2efb58 2024-09-12T00:52:53.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.314+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16.0 2024-09-12T00:52:53.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.318+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.318+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.318+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9294444906539097941 2024-09-12T00:52:53.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.318+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.318+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16__shadow_.wc0KX0K7eP0wpAu4U0p_mQ9dvgLDX4Y_0 2024-09-12T00:52:53.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.318+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T00:52:53.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.318+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.318+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9294444906539097941 2024-09-12T00:52:53.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.318+0000 7f06217fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T00:52:53.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.322+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f2f13a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55d31f2efb58 s->prefetch_data=0 2024-09-12T00:52:53.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.322+0000 7f07401539c0 10 manifest: total_size = 5242880 2024-09-12T00:52:53.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.322+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to _yOeFoUl3cYHPCxwMgr3Xqp2xqh9vlGq 2024-09-12T00:52:53.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.322+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f2f13a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55d31f2efb58 s->prefetch_data=0 2024-09-12T00:52:53.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.322+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f2efb58 2024-09-12T00:52:53.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.322+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16.0 2024-09-12T00:52:53.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.326+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.326+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.326+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: _yOeFoUl3cYHPCxwMgr3Xqp2xqh9vlGq 2024-09-12T00:52:53.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.326+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.326+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16__shadow_.3UYobEYtSPdgeFBU5dQaJYuwpkOkHaQ_0 2024-09-12T00:52:53.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.326+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:52:53.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.326+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.326+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _yOeFoUl3cYHPCxwMgr3Xqp2xqh9vlGq 2024-09-12T00:52:53.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.326+0000 7f0620ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T00:52:53.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.330+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f314d70 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55d31f2efb58 s->prefetch_data=0 2024-09-12T00:52:53.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.330+0000 7f07401539c0 10 manifest: total_size = 5242880 2024-09-12T00:52:53.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.330+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to _8AHn-9agfIvEAlSU9ZVj2jrHhi1gM6R 2024-09-12T00:52:53.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.330+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f314d70 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55d31f2efb58 s->prefetch_data=0 2024-09-12T00:52:53.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.330+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f2efb58 2024-09-12T00:52:53.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.330+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16.0 2024-09-12T00:52:53.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.334+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.334+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.334+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: _8AHn-9agfIvEAlSU9ZVj2jrHhi1gM6R 2024-09-12T00:52:53.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.334+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.334+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16__shadow_.UuN35_zHUCuDENQvZpOCU0NN2b1xO14_0 2024-09-12T00:52:53.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.334+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:52:53.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.334+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.334+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: _8AHn-9agfIvEAlSU9ZVj2jrHhi1gM6R 2024-09-12T00:52:53.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.338+0000 7f06217fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T00:52:53.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.338+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380fb530 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55d31f2efb58 s->prefetch_data=0 2024-09-12T00:52:53.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.338+0000 7f07401539c0 10 manifest: total_size = 5242880 2024-09-12T00:52:53.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.338+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8875906474275719318 2024-09-12T00:52:53.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.338+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380fb530 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55d31f2efb58 s->prefetch_data=0 2024-09-12T00:52:53.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.338+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f2efb58 2024-09-12T00:52:53.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.338+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16.0 2024-09-12T00:52:53.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.342+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.342+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.342+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8875906474275719318 2024-09-12T00:52:53.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.342+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.342+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16__shadow_.tbh4rDFjapnGCjrjU7hp0rlC-6Y7tGg_0 2024-09-12T00:52:53.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.342+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T00:52:53.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.342+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.342+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8875906474275719318 2024-09-12T00:52:53.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.346+0000 7f0620ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:52:53.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.346+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380f9ab0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55d31f2efb58 s->prefetch_data=0 2024-09-12T00:52:53.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.346+0000 7f07401539c0 10 manifest: total_size = 5242880 2024-09-12T00:52:53.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.346+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to _GXqCTUVblKyKb9kJ-wlsL_zEcbV1Ca0 2024-09-12T00:52:53.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.346+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380f9ab0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55d31f2efb58 s->prefetch_data=0 2024-09-12T00:52:53.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.346+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f2efb58 2024-09-12T00:52:53.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.346+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16.0 2024-09-12T00:52:53.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.350+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.350+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.350+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: _GXqCTUVblKyKb9kJ-wlsL_zEcbV1Ca0 2024-09-12T00:52:53.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.350+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.350+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16__shadow_.eOZSJxihxAOygIZVINk1SNYJFHGQFGW_0 2024-09-12T00:52:53.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.350+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:52:53.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.350+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.350+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: _GXqCTUVblKyKb9kJ-wlsL_zEcbV1Ca0 2024-09-12T00:52:53.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.354+0000 7f06217fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T00:52:53.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.354+0000 7f07401539c0 20 get_obj_state: octx=0x7f072805da20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55d31f2efb58 s->prefetch_data=0 2024-09-12T00:52:53.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.354+0000 7f07401539c0 10 manifest: total_size = 5242880 2024-09-12T00:52:53.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.354+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17850917356400394834 2024-09-12T00:52:53.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.354+0000 7f07401539c0 20 get_obj_state: octx=0x7f072805da20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55d31f2efb58 s->prefetch_data=0 2024-09-12T00:52:53.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.354+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f2efb58 2024-09-12T00:52:53.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.354+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16.0 2024-09-12T00:52:53.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.362+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.362+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.362+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17850917356400394834 2024-09-12T00:52:53.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.362+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.362+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16__shadow_.tbh4rDFjapnGCjrjU7hp0rlC-6Y7tGg_0 2024-09-12T00:52:53.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.362+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T00:52:53.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.362+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.362+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17850917356400394834 2024-09-12T00:52:53.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.362+0000 7f0620ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T00:52:53.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.362+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380fb530 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55d31f2efb58 s->prefetch_data=0 2024-09-12T00:52:53.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.362+0000 7f07401539c0 10 manifest: total_size = 5242880 2024-09-12T00:52:53.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.362+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to _vYFNOtmyNKJ-tNgZbpaTeIxuEBIddv4 2024-09-12T00:52:53.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.362+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380fb530 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55d31f2efb58 s->prefetch_data=0 2024-09-12T00:52:53.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.362+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f2efb58 2024-09-12T00:52:53.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.362+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16.0 2024-09-12T00:52:53.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.370+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.370+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.370+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: _vYFNOtmyNKJ-tNgZbpaTeIxuEBIddv4 2024-09-12T00:52:53.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.370+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.370+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16__shadow_.fYcSgKuT_4-DP59vRT-h662PqxkGceX_0 2024-09-12T00:52:53.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.370+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:52:53.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.370+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.370+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: _vYFNOtmyNKJ-tNgZbpaTeIxuEBIddv4 2024-09-12T00:52:53.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.370+0000 7f06217fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T00:52:53.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.370+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380fb530 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55d31f2efb58 s->prefetch_data=0 2024-09-12T00:52:53.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.374+0000 7f07401539c0 10 manifest: total_size = 22651 2024-09-12T00:52:53.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.374+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8037190132740592407 2024-09-12T00:52:53.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.374+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380fb530 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55d31f2efb58 s->prefetch_data=0 2024-09-12T00:52:53.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.374+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f2efb58 2024-09-12T00:52:53.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.374+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16.0 2024-09-12T00:52:53.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.378+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.378+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.378+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8037190132740592407 2024-09-12T00:52:53.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.378+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.378+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16__shadow_.lYx_XDrDZpRxhJ5LYaFm9mzOmj4a7fF_0 2024-09-12T00:52:53.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.378+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T00:52:53.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.378+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.378+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8037190132740592407 2024-09-12T00:52:53.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.382+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380fb530 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55d31f2efb58 s->prefetch_data=0 2024-09-12T00:52:53.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.382+0000 7f0620ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:52:53.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.382+0000 7f07401539c0 10 manifest: total_size = 22651 2024-09-12T00:52:53.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.382+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to _5c79iPDBqHR3gW-U0TkDW7c8464ydty 2024-09-12T00:52:53.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.382+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380fb530 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55d31f2efb58 s->prefetch_data=0 2024-09-12T00:52:53.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.382+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f2efb58 2024-09-12T00:52:53.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.382+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16.0 2024-09-12T00:52:53.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.386+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.386+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.386+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: _5c79iPDBqHR3gW-U0TkDW7c8464ydty 2024-09-12T00:52:53.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.386+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.386+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16__shadow_.Joz6JNzzm2rFFY_Q2BoVLr7pYL6xi_5_0 2024-09-12T00:52:53.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.386+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:52:53.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.386+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.386+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: _5c79iPDBqHR3gW-U0TkDW7c8464ydty 2024-09-12T00:52:53.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.390+0000 7f06217fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T00:52:53.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.390+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380fb530 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55d31f2efb58 s->prefetch_data=0 2024-09-12T00:52:53.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.390+0000 7f07401539c0 10 manifest: total_size = 22651 2024-09-12T00:52:53.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.390+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to _Gq53fD97oDKnsQwaFEVqcS3FGfGY4lk 2024-09-12T00:52:53.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.390+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380fb530 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55d31f2efb58 s->prefetch_data=0 2024-09-12T00:52:53.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.390+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f2efb58 2024-09-12T00:52:53.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.390+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16.0 2024-09-12T00:52:53.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.398+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.398+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.398+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: _Gq53fD97oDKnsQwaFEVqcS3FGfGY4lk 2024-09-12T00:52:53.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.398+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.398+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16__shadow_.LOEWlZmF_Gq9M5F-wxHvegDQNfdmcj4_0 2024-09-12T00:52:53.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.398+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:52:53.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.398+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.398+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: _Gq53fD97oDKnsQwaFEVqcS3FGfGY4lk 2024-09-12T00:52:53.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.398+0000 7f0620ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T00:52:53.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.402+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f319500 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55d31f2efb58 s->prefetch_data=0 2024-09-12T00:52:53.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.402+0000 7f07401539c0 10 manifest: total_size = 22651 2024-09-12T00:52:53.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.402+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3025751644496200708 2024-09-12T00:52:53.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.402+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f319500 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55d31f2efb58 s->prefetch_data=0 2024-09-12T00:52:53.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.402+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f2efb58 2024-09-12T00:52:53.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.402+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16.0 2024-09-12T00:52:53.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.406+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.406+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.406+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3025751644496200708 2024-09-12T00:52:53.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.406+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.406+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16__shadow_.lYx_XDrDZpRxhJ5LYaFm9mzOmj4a7fF_0 2024-09-12T00:52:53.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.406+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T00:52:53.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.406+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.406+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3025751644496200708 2024-09-12T00:52:53.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.410+0000 7f06217fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T00:52:53.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.410+0000 7f07401539c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:52:53.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.410+0000 7f07401539c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:52:53.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.410+0000 7f07401539c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:52:53.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.410+0000 7f07401539c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:52:53.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.410+0000 7f07401539c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:52:53.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.410+0000 7f07401539c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:52:53.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.410+0000 7f07401539c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16])"; uploads.size()=0; is_truncated=0 2024-09-12T00:52:53.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.414+0000 7f07401539c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-12T00:52:53.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.414+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.414+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=233 2024-09-12T00:52:53.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.414+0000 7f07401539c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-12T00:52:53.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.414+0000 7f07401539c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-12T00:52:53.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.418+0000 7f07401539c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-12T00:52:53.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.418+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-12T00:52:53.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.418+0000 7f0620ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496988 cookie 94365249585440 notifier 5970 bl.length()=189 2024-09-12T00:52:53.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.422+0000 7f07401539c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16 from cache 2024-09-12T00:52:53.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.422+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16, ofs0, ns] 2024-09-12T00:52:53.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.422+0000 7f0620ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497022 cookie 94365249580320 notifier 5970 bl.length()=247 2024-09-12T00:52:53.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.426+0000 7f07401539c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16 : miss 2024-09-12T00:52:53.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.426+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.426+0000 7f07401539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:53.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.426+0000 7f07401539c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16 info.flags=0x0 2024-09-12T00:52:53.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.426+0000 7f07401539c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16 to cache LRU end 2024-09-12T00:52:53.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.430+0000 7f07401539c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17 : miss 2024-09-12T00:52:53.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.430+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.430+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:52:53.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.430+0000 7f07401539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17 info.flags=0x17 2024-09-12T00:52:53.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.430+0000 7f07401539c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17 to cache LRU end 2024-09-12T00:52:53.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.430+0000 7f07401539c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:53.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.430+0000 7f07401539c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:52:53.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.430+0000 7f07401539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17 2024-09-12T00:52:53.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.430+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:52:53.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.430+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T00:52:53.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.430+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T00:52:53.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.430+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T00:52:53.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.430+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:52:53.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.430+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T00:52:53.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.430+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T00:52:53.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.430+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T00:52:53.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.430+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:52:53.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.430+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T00:52:53.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.430+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T00:52:53.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.430+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T00:52:53.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.430+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f31cbd0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55d31f32cad8 s->prefetch_data=0 2024-09-12T00:52:53.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.434+0000 7f07401539c0 10 manifest: total_size = 11534336 2024-09-12T00:52:53.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.434+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16867643948170622502 2024-09-12T00:52:53.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.434+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f31cbd0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55d31f32cad8 s->prefetch_data=0 2024-09-12T00:52:53.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.434+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f32cad8 2024-09-12T00:52:53.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.434+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17.0 2024-09-12T00:52:53.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.438+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:52:53.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.438+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:52:53.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.438+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:52:53.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.438+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:52:53.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.438+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:52:53.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.438+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:52:53.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.438+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:52:53.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.438+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:52:53.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.438+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:52:53.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.438+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16867643948170622502 2024-09-12T00:52:53.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.438+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.438+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-FROZEN.2~kk6D8u9Aevg_gComp_eamoMf75fAjgg.1 2024-09-12T00:52:53.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.438+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T00:52:53.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.438+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-FROZEN.2~kk6D8u9Aevg_gComp_eamoMf75fAjgg.2 2024-09-12T00:52:53.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.438+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-12T00:52:53.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.438+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-FROZEN.2~kk6D8u9Aevg_gComp_eamoMf75fAjgg.3 2024-09-12T00:52:53.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.438+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-12T00:52:53.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.438+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.438+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16867643948170622502 2024-09-12T00:52:53.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.442+0000 7f07401539c0 20 get_obj_state: octx=0x7f072801f8c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55d31f32cad8 s->prefetch_data=0 2024-09-12T00:52:53.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.442+0000 7f0620ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:52:53.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.442+0000 7f07401539c0 10 manifest: total_size = 11534336 2024-09-12T00:52:53.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.442+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1169328827368255590 2024-09-12T00:52:53.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.442+0000 7f07401539c0 20 get_obj_state: octx=0x7f072801f8c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55d31f32cad8 s->prefetch_data=0 2024-09-12T00:52:53.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.442+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f32cad8 2024-09-12T00:52:53.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.442+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17.0 2024-09-12T00:52:53.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.446+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:52:53.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.446+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:52:53.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.446+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:52:53.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.446+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:52:53.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.446+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:52:53.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.446+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:52:53.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.446+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:52:53.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.446+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:52:53.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.446+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:52:53.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.446+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1169328827368255590 2024-09-12T00:52:53.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.446+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.446+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-FROZEN.2~kk6D8u9Aevg_gComp_eamoMf75fAjgg.1 2024-09-12T00:52:53.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.446+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T00:52:53.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.446+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-FROZEN.2~kk6D8u9Aevg_gComp_eamoMf75fAjgg.2 2024-09-12T00:52:53.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.446+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-12T00:52:53.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.446+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-FROZEN.2~kk6D8u9Aevg_gComp_eamoMf75fAjgg.3 2024-09-12T00:52:53.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.446+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-12T00:52:53.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.446+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.446+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1169328827368255590 2024-09-12T00:52:53.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.450+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f321cc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55d31f32cad8 s->prefetch_data=0 2024-09-12T00:52:53.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.450+0000 7f06217fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T00:52:53.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.450+0000 7f07401539c0 10 manifest: total_size = 11534336 2024-09-12T00:52:53.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.450+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to _hsSv__iHHUwjgvX88Xiw2YDev5ZcFz7 2024-09-12T00:52:53.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.450+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f321cc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55d31f32cad8 s->prefetch_data=0 2024-09-12T00:52:53.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.450+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f32cad8 2024-09-12T00:52:53.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.450+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17.0 2024-09-12T00:52:53.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.458+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.458+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.458+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.458+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.458+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: _hsSv__iHHUwjgvX88Xiw2YDev5ZcFz7 2024-09-12T00:52:53.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.458+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.458+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__shadow_.1pDCtVwCS-3RqpTxGBME6sCQSCCdWSy_0 2024-09-12T00:52:53.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.458+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:52:53.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.458+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__shadow_.1pDCtVwCS-3RqpTxGBME6sCQSCCdWSy_1 2024-09-12T00:52:53.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.458+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T00:52:53.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.458+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.458+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _hsSv__iHHUwjgvX88Xiw2YDev5ZcFz7 2024-09-12T00:52:53.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.458+0000 7f0620ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T00:52:53.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.462+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380fb530 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55d31f32b288 s->prefetch_data=0 2024-09-12T00:52:53.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.462+0000 7f07401539c0 10 manifest: total_size = 11534336 2024-09-12T00:52:53.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.462+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to _wXZcbg-xk7JXVjGj3uQ-fjqua3c5SqI 2024-09-12T00:52:53.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.462+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380fb530 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55d31f32b288 s->prefetch_data=0 2024-09-12T00:52:53.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.462+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f32b288 2024-09-12T00:52:53.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.462+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17.0 2024-09-12T00:52:53.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.466+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.466+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.466+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.466+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.466+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: _wXZcbg-xk7JXVjGj3uQ-fjqua3c5SqI 2024-09-12T00:52:53.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.466+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.466+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__shadow_.mvLzeNvHR6fPnT17KnE8DUr5zSHoEEY_0 2024-09-12T00:52:53.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.466+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:52:53.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.466+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__shadow_.mvLzeNvHR6fPnT17KnE8DUr5zSHoEEY_1 2024-09-12T00:52:53.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.466+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:52:53.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.466+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.466+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _wXZcbg-xk7JXVjGj3uQ-fjqua3c5SqI 2024-09-12T00:52:53.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.470+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380fb530 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55d31f32b288 s->prefetch_data=0 2024-09-12T00:52:53.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.470+0000 7f06217fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T00:52:53.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.470+0000 7f07401539c0 10 manifest: total_size = 11534336 2024-09-12T00:52:53.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.470+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4367089232274005736 2024-09-12T00:52:53.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.470+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380fb530 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55d31f32b288 s->prefetch_data=0 2024-09-12T00:52:53.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.470+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f32b288 2024-09-12T00:52:53.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.470+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17.0 2024-09-12T00:52:53.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.478+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:52:53.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.478+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:52:53.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.478+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:52:53.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.478+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:52:53.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.478+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:52:53.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.478+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:52:53.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.478+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:52:53.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.478+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:52:53.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.478+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:52:53.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.478+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4367089232274005736 2024-09-12T00:52:53.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.478+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.478+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-LUKEWARM.2~XZVlofY5U0WQ__CprNDClyfvtCdI_Gb.1 2024-09-12T00:52:53.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.478+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T00:52:53.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.478+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-LUKEWARM.2~XZVlofY5U0WQ__CprNDClyfvtCdI_Gb.2 2024-09-12T00:52:53.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.478+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-12T00:52:53.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.478+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-LUKEWARM.2~XZVlofY5U0WQ__CprNDClyfvtCdI_Gb.3 2024-09-12T00:52:53.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.478+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-12T00:52:53.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.478+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.478+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4367089232274005736 2024-09-12T00:52:53.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.482+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f319500 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55d31f32b288 s->prefetch_data=0 2024-09-12T00:52:53.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.482+0000 7f0620ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:52:53.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.482+0000 7f07401539c0 10 manifest: total_size = 11534336 2024-09-12T00:52:53.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.482+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to _OAHMCuXbN0jMaVKtN9dynwsqSlNADIS 2024-09-12T00:52:53.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.482+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f319500 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55d31f32b288 s->prefetch_data=0 2024-09-12T00:52:53.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.482+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f32b288 2024-09-12T00:52:53.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.482+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17.0 2024-09-12T00:52:53.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.486+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.486+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.486+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.486+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.486+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: _OAHMCuXbN0jMaVKtN9dynwsqSlNADIS 2024-09-12T00:52:53.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.486+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.486+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__shadow_.n5kP9r1pmd9OlrKJ0bH-ruFo-0iO4y-_0 2024-09-12T00:52:53.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.486+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:52:53.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.486+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__shadow_.n5kP9r1pmd9OlrKJ0bH-ruFo-0iO4y-_1 2024-09-12T00:52:53.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.486+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T00:52:53.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.486+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.486+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _OAHMCuXbN0jMaVKtN9dynwsqSlNADIS 2024-09-12T00:52:53.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.490+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f319500 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55d31f32b288 s->prefetch_data=0 2024-09-12T00:52:53.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.490+0000 7f06217fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T00:52:53.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.490+0000 7f07401539c0 10 manifest: total_size = 11534336 2024-09-12T00:52:53.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.490+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9801922626271500422 2024-09-12T00:52:53.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.490+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f319500 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55d31f32b288 s->prefetch_data=0 2024-09-12T00:52:53.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.490+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f32b288 2024-09-12T00:52:53.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.490+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17.0 2024-09-12T00:52:53.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.494+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:52:53.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.494+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:52:53.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.494+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:52:53.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.494+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:52:53.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.494+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:52:53.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.494+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:52:53.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.494+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:52:53.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.494+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:52:53.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.494+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:52:53.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.494+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9801922626271500422 2024-09-12T00:52:53.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.494+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.494+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-LUKEWARM.2~XZVlofY5U0WQ__CprNDClyfvtCdI_Gb.1 2024-09-12T00:52:53.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.494+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T00:52:53.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.494+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-LUKEWARM.2~XZVlofY5U0WQ__CprNDClyfvtCdI_Gb.2 2024-09-12T00:52:53.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.494+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-12T00:52:53.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.494+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-LUKEWARM.2~XZVlofY5U0WQ__CprNDClyfvtCdI_Gb.3 2024-09-12T00:52:53.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.494+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-12T00:52:53.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.494+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.494+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9801922626271500422 2024-09-12T00:52:53.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.498+0000 7f0620ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T00:52:53.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.498+0000 7f07401539c0 20 get_obj_state: octx=0x7f072801f8c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55d31f32b288 s->prefetch_data=0 2024-09-12T00:52:53.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.498+0000 7f07401539c0 10 manifest: total_size = 11534336 2024-09-12T00:52:53.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.498+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to _b5BTzNNqnE4qStOHYbIeaBdNuoQFUpN 2024-09-12T00:52:53.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.498+0000 7f07401539c0 20 get_obj_state: octx=0x7f072801f8c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55d31f32b288 s->prefetch_data=0 2024-09-12T00:52:53.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.498+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f32b288 2024-09-12T00:52:53.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.498+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17.0 2024-09-12T00:52:53.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.506+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.506+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.506+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.506+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.506+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: _b5BTzNNqnE4qStOHYbIeaBdNuoQFUpN 2024-09-12T00:52:53.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.506+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.506+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__shadow_.2C29D1r_YURNbtEByPFezCNdDAw5tj4_0 2024-09-12T00:52:53.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.506+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:52:53.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.506+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__shadow_.2C29D1r_YURNbtEByPFezCNdDAw5tj4_1 2024-09-12T00:52:53.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.506+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:52:53.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.506+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.506+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _b5BTzNNqnE4qStOHYbIeaBdNuoQFUpN 2024-09-12T00:52:53.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.510+0000 7f06217fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T00:52:53.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.510+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380fb530 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55d31f32b288 s->prefetch_data=0 2024-09-12T00:52:53.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.510+0000 7f07401539c0 10 manifest: total_size = 16379 2024-09-12T00:52:53.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.510+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13695404232489827019 2024-09-12T00:52:53.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.510+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380fb530 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55d31f32b288 s->prefetch_data=0 2024-09-12T00:52:53.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.510+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f32b288 2024-09-12T00:52:53.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.510+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17.0 2024-09-12T00:52:53.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.514+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=2 2024-09-12T00:52:53.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.514+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7672 2024-09-12T00:52:53.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.514+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7672 2024-09-12T00:52:53.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.514+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=2 2024-09-12T00:52:53.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.514+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6299128 part_ofs=7672 rule->part_size=7672 2024-09-12T00:52:53.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.514+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=15344 stripe_ofs=15344 part_ofs=15344 rule->part_size=1035 2024-09-12T00:52:53.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.514+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=2 2024-09-12T00:52:53.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.514+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6306800 part_ofs=15344 rule->part_size=1035 2024-09-12T00:52:53.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.514+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=16379 stripe_ofs=16379 part_ofs=16379 rule->part_size=1035 2024-09-12T00:52:53.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.514+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13695404232489827019 2024-09-12T00:52:53.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.514+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.514+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-STANDARD.2~Dh-pUyYeRw5CB5t7tB6fcp5s7ff99aC.1 2024-09-12T00:52:53.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.514+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T00:52:53.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.514+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-STANDARD.2~Dh-pUyYeRw5CB5t7tB6fcp5s7ff99aC.2 2024-09-12T00:52:53.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.514+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T00:52:53.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.514+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-STANDARD.2~Dh-pUyYeRw5CB5t7tB6fcp5s7ff99aC.3 2024-09-12T00:52:53.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.514+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T00:52:53.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.514+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.514+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13695404232489827019 2024-09-12T00:52:53.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.518+0000 7f0620ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:52:53.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.518+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380f9ab0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55d31f32b288 s->prefetch_data=0 2024-09-12T00:52:53.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.522+0000 7f07401539c0 10 manifest: total_size = 16379 2024-09-12T00:52:53.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.522+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to _5sq_OpTGfmc3jFt3fmyUc9PnefY07pK 2024-09-12T00:52:53.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.522+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380f9ab0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55d31f32b288 s->prefetch_data=0 2024-09-12T00:52:53.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.522+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f32b288 2024-09-12T00:52:53.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.522+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17.0 2024-09-12T00:52:53.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.526+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.526+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=16379 stripe_ofs=16379 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.526+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: _5sq_OpTGfmc3jFt3fmyUc9PnefY07pK 2024-09-12T00:52:53.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.526+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.526+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__shadow_.bAwYYehVSa0WjGW3Gj5xx84RGcZOb7D_0 2024-09-12T00:52:53.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.526+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:52:53.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.526+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.526+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: _5sq_OpTGfmc3jFt3fmyUc9PnefY07pK 2024-09-12T00:52:53.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.530+0000 7f06217fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T00:52:53.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.530+0000 7f07401539c0 20 get_obj_state: octx=0x7f072801f8c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55d31f32b288 s->prefetch_data=0 2024-09-12T00:52:53.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.530+0000 7f07401539c0 10 manifest: total_size = 16379 2024-09-12T00:52:53.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.530+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to _rLLNJZRbZlC8Vr1GCYBievHOP0C1eeK 2024-09-12T00:52:53.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.530+0000 7f07401539c0 20 get_obj_state: octx=0x7f072801f8c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55d31f32b288 s->prefetch_data=0 2024-09-12T00:52:53.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.530+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f32b288 2024-09-12T00:52:53.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.530+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17.0 2024-09-12T00:52:53.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.534+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.534+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=16379 stripe_ofs=16379 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.534+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: _rLLNJZRbZlC8Vr1GCYBievHOP0C1eeK 2024-09-12T00:52:53.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.534+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.534+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__shadow_.TAQ9f0sw8GkctnecDMlNp2GqPmjKsZk_0 2024-09-12T00:52:53.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.534+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:52:53.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.534+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.534+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _rLLNJZRbZlC8Vr1GCYBievHOP0C1eeK 2024-09-12T00:52:53.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.538+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f32ad00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55d31f32b288 s->prefetch_data=0 2024-09-12T00:52:53.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.538+0000 7f0620ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T00:52:53.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.538+0000 7f07401539c0 10 manifest: total_size = 16379 2024-09-12T00:52:53.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.538+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12287527414774459180 2024-09-12T00:52:53.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.538+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f32ad00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55d31f32b288 s->prefetch_data=0 2024-09-12T00:52:53.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.538+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f32b288 2024-09-12T00:52:53.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.538+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17.0 2024-09-12T00:52:53.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.546+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=2 2024-09-12T00:52:53.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.546+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7672 2024-09-12T00:52:53.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.546+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7672 2024-09-12T00:52:53.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.546+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=2 2024-09-12T00:52:53.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.546+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6299128 part_ofs=7672 rule->part_size=7672 2024-09-12T00:52:53.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.546+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=15344 stripe_ofs=15344 part_ofs=15344 rule->part_size=1035 2024-09-12T00:52:53.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.546+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=2 2024-09-12T00:52:53.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.546+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6306800 part_ofs=15344 rule->part_size=1035 2024-09-12T00:52:53.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.546+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=16379 stripe_ofs=16379 part_ofs=16379 rule->part_size=1035 2024-09-12T00:52:53.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.546+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12287527414774459180 2024-09-12T00:52:53.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.546+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.546+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-STANDARD.2~Dh-pUyYeRw5CB5t7tB6fcp5s7ff99aC.1 2024-09-12T00:52:53.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.546+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T00:52:53.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.546+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-STANDARD.2~Dh-pUyYeRw5CB5t7tB6fcp5s7ff99aC.2 2024-09-12T00:52:53.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.546+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T00:52:53.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.546+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-STANDARD.2~Dh-pUyYeRw5CB5t7tB6fcp5s7ff99aC.3 2024-09-12T00:52:53.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.546+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T00:52:53.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.546+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.546+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12287527414774459180 2024-09-12T00:52:53.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.550+0000 7f06217fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T00:52:53.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.550+0000 7f07401539c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:52:53.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.550+0000 7f07401539c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:52:53.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.550+0000 7f07401539c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:52:53.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.550+0000 7f07401539c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:52:53.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.550+0000 7f07401539c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:52:53.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.550+0000 7f07401539c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:52:53.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.550+0000 7f07401539c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17])"; uploads.size()=0; is_truncated=0 2024-09-12T00:52:53.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.554+0000 7f07401539c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-12T00:52:53.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.554+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.554+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=243 2024-09-12T00:52:53.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.554+0000 7f07401539c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-12T00:52:53.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.554+0000 7f07401539c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-12T00:52:53.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.558+0000 7f07401539c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-12T00:52:53.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.558+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-12T00:52:53.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.558+0000 7f0620ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497023 cookie 94365249580320 notifier 5970 bl.length()=199 2024-09-12T00:52:53.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.562+0000 7f07401539c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17 from cache 2024-09-12T00:52:53.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.562+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17, ofs0, ns] 2024-09-12T00:52:53.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.562+0000 7f06217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496987 cookie 94365249589168 notifier 5970 bl.length()=257 2024-09-12T00:52:53.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.566+0000 7f07401539c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17 : miss 2024-09-12T00:52:53.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.566+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.570+0000 7f07401539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:53.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.570+0000 7f07401539c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17 info.flags=0x0 2024-09-12T00:52:53.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.570+0000 7f07401539c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17 to cache LRU end 2024-09-12T00:52:53.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.574+0000 7f07401539c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15 : miss 2024-09-12T00:52:53.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.574+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.574+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T00:52:53.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.574+0000 7f07401539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15 info.flags=0x17 2024-09-12T00:52:53.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.574+0000 7f07401539c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15 to cache LRU end 2024-09-12T00:52:53.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.574+0000 7f07401539c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:53.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.574+0000 7f07401539c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:52:53.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.574+0000 7f07401539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15 2024-09-12T00:52:53.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.578+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:52:53.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.578+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:52:53.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.578+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:52:53.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.578+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f3134d0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55d31f329928 s->prefetch_data=0 2024-09-12T00:52:53.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.578+0000 7f07401539c0 10 manifest: total_size = 11534336 2024-09-12T00:52:53.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.578+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17966126031209906754 2024-09-12T00:52:53.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.578+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f3134d0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55d31f329928 s->prefetch_data=0 2024-09-12T00:52:53.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.578+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f329928 2024-09-12T00:52:53.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.578+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15.0 2024-09-12T00:52:53.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.582+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:52:53.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.582+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:52:53.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.582+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:52:53.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.582+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:52:53.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.582+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:52:53.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.582+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:52:53.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.582+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:52:53.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.582+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:52:53.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.582+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:52:53.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.582+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17966126031209906754 2024-09-12T00:52:53.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.582+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.582+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15__multipart_foo-FROZEN.2~ItzYME0v2B31XWGwh2hAB1WcQV66kDd.1 2024-09-12T00:52:53.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.582+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T00:52:53.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.582+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15__multipart_foo-FROZEN.2~ItzYME0v2B31XWGwh2hAB1WcQV66kDd.2 2024-09-12T00:52:53.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.582+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-12T00:52:53.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.582+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15__multipart_foo-FROZEN.2~ItzYME0v2B31XWGwh2hAB1WcQV66kDd.3 2024-09-12T00:52:53.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.582+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-12T00:52:53.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.582+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.582+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17966126031209906754 2024-09-12T00:52:53.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.586+0000 7f06217fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:52:53.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.586+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380f9ab0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55d31f329928 s->prefetch_data=0 2024-09-12T00:52:53.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.586+0000 7f07401539c0 10 manifest: total_size = 11534336 2024-09-12T00:52:53.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.586+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14222544290276087193 2024-09-12T00:52:53.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.586+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380f9ab0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55d31f329928 s->prefetch_data=0 2024-09-12T00:52:53.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.586+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f329928 2024-09-12T00:52:53.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.586+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15.0 2024-09-12T00:52:53.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.594+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:52:53.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.594+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:52:53.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.594+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:52:53.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.594+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:52:53.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.594+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:52:53.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.594+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:52:53.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.594+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:52:53.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.594+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:52:53.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.594+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:52:53.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.594+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14222544290276087193 2024-09-12T00:52:53.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.594+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.594+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15__multipart_foo-LUKEWARM.2~KU50ShJksbHUlXgh8dpfa-9MP-Lt4El.1 2024-09-12T00:52:53.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.594+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T00:52:53.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.594+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15__multipart_foo-LUKEWARM.2~KU50ShJksbHUlXgh8dpfa-9MP-Lt4El.2 2024-09-12T00:52:53.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.594+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-12T00:52:53.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.594+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15__multipart_foo-LUKEWARM.2~KU50ShJksbHUlXgh8dpfa-9MP-Lt4El.3 2024-09-12T00:52:53.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.594+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-12T00:52:53.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.594+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.594+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14222544290276087193 2024-09-12T00:52:53.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.598+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380fb530 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55d31f329928 s->prefetch_data=0 2024-09-12T00:52:53.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.598+0000 7f0620ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:52:53.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.598+0000 7f07401539c0 10 manifest: total_size = 1087 2024-09-12T00:52:53.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.598+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7318172752022423514 2024-09-12T00:52:53.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.598+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380fb530 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55d31f329928 s->prefetch_data=0 2024-09-12T00:52:53.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.598+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f329928 2024-09-12T00:52:53.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.598+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15.0 2024-09-12T00:52:53.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.602+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:52:53.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.602+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-12T00:52:53.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.602+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T00:52:53.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.602+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:52:53.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.602+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-12T00:52:53.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.602+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-12T00:52:53.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.602+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-12T00:52:53.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.602+0000 7f07401539c0 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=55 2024-09-12T00:52:53.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.602+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-12T00:52:53.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.602+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7318172752022423514 2024-09-12T00:52:53.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.602+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.602+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15__multipart_foo-STANDARD.2~OiD9y35-lQYed-XXBC9ZrgaAJ5A2mUv.1 2024-09-12T00:52:53.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.602+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T00:52:53.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.602+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15__multipart_foo-STANDARD.2~OiD9y35-lQYed-XXBC9ZrgaAJ5A2mUv.2 2024-09-12T00:52:53.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.602+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T00:52:53.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.602+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15__multipart_foo-STANDARD.2~OiD9y35-lQYed-XXBC9ZrgaAJ5A2mUv.3 2024-09-12T00:52:53.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.602+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T00:52:53.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.602+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.602+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7318172752022423514 2024-09-12T00:52:53.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.606+0000 7f06217fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:52:53.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.606+0000 7f07401539c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:52:53.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.606+0000 7f07401539c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:52:53.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.606+0000 7f07401539c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:52:53.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.606+0000 7f07401539c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:52:53.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.606+0000 7f07401539c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:52:53.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.606+0000 7f07401539c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:52:53.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.606+0000 7f07401539c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15])"; uploads.size()=0; is_truncated=0 2024-09-12T00:52:53.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.610+0000 7f07401539c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-12T00:52:53.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.610+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.610+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=238 2024-09-12T00:52:53.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.610+0000 7f07401539c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-12T00:52:53.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.610+0000 7f07401539c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-12T00:52:53.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.614+0000 7f07401539c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-12T00:52:53.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.614+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-12T00:52:53.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.614+0000 7f0620ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496988 cookie 94365249591248 notifier 5970 bl.length()=194 2024-09-12T00:52:53.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.618+0000 7f07401539c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15 from cache 2024-09-12T00:52:53.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.618+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15, ofs0, ns] 2024-09-12T00:52:53.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.618+0000 7f06217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496989 cookie 94365249589168 notifier 5970 bl.length()=252 2024-09-12T00:52:53.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.622+0000 7f07401539c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15 : miss 2024-09-12T00:52:53.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.622+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.622+0000 7f07401539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:53.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.622+0000 7f07401539c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15 info.flags=0x0 2024-09-12T00:52:53.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.622+0000 7f07401539c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15 to cache LRU end 2024-09-12T00:52:53.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.630+0000 7f07401539c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14 : miss 2024-09-12T00:52:53.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.630+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.630+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=450 2024-09-12T00:52:53.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.630+0000 7f07401539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14 info.flags=0x17 2024-09-12T00:52:53.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.630+0000 7f07401539c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14 to cache LRU end 2024-09-12T00:52:53.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.630+0000 7f07401539c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:53.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.630+0000 7f07401539c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:52:53.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.630+0000 7f07401539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14 2024-09-12T00:52:53.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.630+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:52:53.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.630+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:52:53.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.630+0000 7f07401539c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:52:53.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.630+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f3140b0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55d31f329de8 s->prefetch_data=0 2024-09-12T00:52:53.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.634+0000 7f07401539c0 10 manifest: total_size = 10485760 2024-09-12T00:52:53.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.634+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14529082512191924793 2024-09-12T00:52:53.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.634+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f3140b0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55d31f329de8 s->prefetch_data=0 2024-09-12T00:52:53.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.634+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f329de8 2024-09-12T00:52:53.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.634+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14.0 2024-09-12T00:52:53.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.638+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.638+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.638+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.638+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.638+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14529082512191924793 2024-09-12T00:52:53.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.638+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.638+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14__shadow_.TQGkmJaMDrbFbhmnespkAsbREWIql61_0 2024-09-12T00:52:53.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.638+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T00:52:53.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.638+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14__shadow_.TQGkmJaMDrbFbhmnespkAsbREWIql61_1 2024-09-12T00:52:53.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.638+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T00:52:53.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.638+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.638+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14529082512191924793 2024-09-12T00:52:53.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.642+0000 7f07401539c0 20 get_obj_state: octx=0x7f072801f8c0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55d31f329dc8 s->prefetch_data=0 2024-09-12T00:52:53.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.642+0000 7f06217fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:52:53.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.642+0000 7f07401539c0 10 manifest: total_size = 10485760 2024-09-12T00:52:53.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.642+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14533884258780104905 2024-09-12T00:52:53.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.642+0000 7f07401539c0 20 get_obj_state: octx=0x7f072801f8c0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55d31f329dc8 s->prefetch_data=0 2024-09-12T00:52:53.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.642+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f329dc8 2024-09-12T00:52:53.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.642+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14.0 2024-09-12T00:52:53.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.646+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.646+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.646+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.646+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.646+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14533884258780104905 2024-09-12T00:52:53.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.646+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.646+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14__shadow_.UU_E3Qt2XI2eMKz59sgfz-r2j6V8ITX_0 2024-09-12T00:52:53.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.646+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T00:52:53.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.646+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14__shadow_.UU_E3Qt2XI2eMKz59sgfz-r2j6V8ITX_1 2024-09-12T00:52:53.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.646+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-12T00:52:53.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.646+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.646+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14533884258780104905 2024-09-12T00:52:53.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.650+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380f9ab0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55d31f3298b8 s->prefetch_data=0 2024-09-12T00:52:53.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.650+0000 7f0620ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:52:53.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.650+0000 7f07401539c0 10 manifest: total_size = 3303 2024-09-12T00:52:53.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.650+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6987965815207392944 2024-09-12T00:52:53.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.650+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380f9ab0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55d31f3298b8 s->prefetch_data=0 2024-09-12T00:52:53.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.650+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f3298b8 2024-09-12T00:52:53.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.650+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14.0 2024-09-12T00:52:53.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.658+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.658+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=3303 stripe_ofs=3303 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.658+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6987965815207392944 2024-09-12T00:52:53.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.658+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.658+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14__shadow_.UrgYgjlMf55QGfP6Q4k-QVoiUeHDOHT_0 2024-09-12T00:52:53.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.658+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T00:52:53.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.658+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.658+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6987965815207392944 2024-09-12T00:52:53.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.658+0000 7f07401539c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:52:53.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.658+0000 7f07401539c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:52:53.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.658+0000 7f06217fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:52:53.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.662+0000 7f07401539c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:52:53.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.662+0000 7f07401539c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:52:53.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.662+0000 7f07401539c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:52:53.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.662+0000 7f07401539c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:52:53.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.662+0000 7f07401539c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14])"; uploads.size()=0; is_truncated=0 2024-09-12T00:52:53.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.662+0000 7f07401539c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-12T00:52:53.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.662+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.666+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=228 2024-09-12T00:52:53.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.666+0000 7f07401539c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-12T00:52:53.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.666+0000 7f07401539c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-12T00:52:53.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.666+0000 7f07401539c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-12T00:52:53.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.666+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-12T00:52:53.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.666+0000 7f0620ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496989 cookie 94365249585440 notifier 5970 bl.length()=184 2024-09-12T00:52:53.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.670+0000 7f07401539c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14 from cache 2024-09-12T00:52:53.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.670+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14, ofs0, ns] 2024-09-12T00:52:53.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.674+0000 7f0620ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496990 cookie 94365249591248 notifier 5970 bl.length()=242 2024-09-12T00:52:53.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.674+0000 7f07401539c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14 : miss 2024-09-12T00:52:53.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.674+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.678+0000 7f07401539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:53.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.678+0000 7f07401539c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14 info.flags=0x0 2024-09-12T00:52:53.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.678+0000 7f07401539c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14 to cache LRU end 2024-09-12T00:52:53.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.682+0000 7f07401539c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7 : miss 2024-09-12T00:52:53.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.682+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.682+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:52:53.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.682+0000 7f07401539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7 info.flags=0x17 2024-09-12T00:52:53.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.682+0000 7f07401539c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7 to cache LRU end 2024-09-12T00:52:53.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.682+0000 7f07401539c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:53.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.682+0000 7f07401539c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:52:53.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.682+0000 7f07401539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7 2024-09-12T00:52:53.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.682+0000 7f07401539c0 10 cls_bucket_list_unordered: got __ 2024-09-12T00:52:53.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.682+0000 7f07401539c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:52:53.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.682+0000 7f07401539c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:52:53.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.682+0000 7f07401539c0 10 cls_bucket_list_unordered: got obj 2024-09-12T00:52:53.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.682+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f32be30 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55d31f32d4a8 s->prefetch_data=0 2024-09-12T00:52:53.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.686+0000 7f07401539c0 10 manifest: total_size = 0 2024-09-12T00:52:53.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.686+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2287248405163934822 2024-09-12T00:52:53.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.686+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f32be30 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55d31f32d4a8 s->prefetch_data=0 2024-09-12T00:52:53.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.686+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f32d4a8 2024-09-12T00:52:53.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.686+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7.0 2024-09-12T00:52:53.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.690+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f32be30 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55d31f329878 s->prefetch_data=0 2024-09-12T00:52:53.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.690+0000 7f07401539c0 10 manifest: total_size = 0 2024-09-12T00:52:53.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.690+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.883853665709315327 2024-09-12T00:52:53.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.690+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f32be30 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55d31f329878 s->prefetch_data=0 2024-09-12T00:52:53.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.690+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f329878 2024-09-12T00:52:53.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.690+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7.0 2024-09-12T00:52:53.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.694+0000 7f0620ff9640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:52:53.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.694+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f32be30 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55d31f32d4a8 s->prefetch_data=0 2024-09-12T00:52:53.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.698+0000 7f07401539c0 10 manifest: total_size = 0 2024-09-12T00:52:53.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.698+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14958700702458155271 2024-09-12T00:52:53.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.698+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f32be30 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55d31f32d4a8 s->prefetch_data=0 2024-09-12T00:52:53.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.698+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f32d4a8 2024-09-12T00:52:53.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.698+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7.0 2024-09-12T00:52:53.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.698+0000 7f06217fa640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:52:53.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.702+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f32be30 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55d31f329878 s->prefetch_data=0 2024-09-12T00:52:53.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.702+0000 7f07401539c0 10 manifest: total_size = 0 2024-09-12T00:52:53.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.702+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6570637688429420522 2024-09-12T00:52:53.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.702+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f32be30 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55d31f329878 s->prefetch_data=0 2024-09-12T00:52:53.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.702+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f329878 2024-09-12T00:52:53.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.702+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7.0 2024-09-12T00:52:53.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.706+0000 7f0620ff9640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:52:53.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.710+0000 7f07401539c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:52:53.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.710+0000 7f07401539c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:52:53.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.710+0000 7f06217fa640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:52:53.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.710+0000 7f07401539c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:52:53.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.710+0000 7f07401539c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:52:53.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.710+0000 7f07401539c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:52:53.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.710+0000 7f07401539c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:52:53.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.710+0000 7f07401539c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7])"; uploads.size()=0; is_truncated=0 2024-09-12T00:52:53.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.714+0000 7f07401539c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-12T00:52:53.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.714+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.714+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:52:53.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.714+0000 7f07401539c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-12T00:52:53.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.714+0000 7f07401539c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-12T00:52:53.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.718+0000 7f07401539c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-12T00:52:53.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.718+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-12T00:52:53.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.718+0000 7f0620ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497013 cookie 94365249581888 notifier 5970 bl.length()=181 2024-09-12T00:52:53.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.722+0000 7f07401539c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7 from cache 2024-09-12T00:52:53.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.722+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7, ofs0, ns] 2024-09-12T00:52:53.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.722+0000 7f06217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 94365249591248 notifier 5970 bl.length()=238 2024-09-12T00:52:53.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.726+0000 7f07401539c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7 : miss 2024-09-12T00:52:53.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.726+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.726+0000 7f07401539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:53.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.726+0000 7f07401539c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7 info.flags=0x0 2024-09-12T00:52:53.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.726+0000 7f07401539c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7 to cache LRU end 2024-09-12T00:52:53.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.730+0000 7f07401539c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8 : miss 2024-09-12T00:52:53.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.730+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.734+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:52:53.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.734+0000 7f07401539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8 info.flags=0x17 2024-09-12T00:52:53.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.734+0000 7f07401539c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8 to cache LRU end 2024-09-12T00:52:53.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.734+0000 7f07401539c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:53.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.734+0000 7f07401539c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:52:53.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.734+0000 7f07401539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8 2024-09-12T00:52:53.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.734+0000 7f07401539c0 10 cls_bucket_list_unordered: got __ 2024-09-12T00:52:53.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.734+0000 7f07401539c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:52:53.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.734+0000 7f07401539c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:52:53.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.734+0000 7f07401539c0 10 cls_bucket_list_unordered: got obj 2024-09-12T00:52:53.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.734+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380f7360 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55d31f329878 s->prefetch_data=0 2024-09-12T00:52:53.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.734+0000 7f07401539c0 10 manifest: total_size = 524288 2024-09-12T00:52:53.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.734+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13098655859525934196 2024-09-12T00:52:53.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.734+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380f7360 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55d31f329878 s->prefetch_data=0 2024-09-12T00:52:53.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.734+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f329878 2024-09-12T00:52:53.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.734+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8.0 2024-09-12T00:52:53.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.742+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.742+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.742+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13098655859525934196 2024-09-12T00:52:53.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.742+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.742+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8__shadow_.jIrpme9nyp1zLT3Ncp6IZLczF1LgfOw_0 2024-09-12T00:52:53.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.742+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:52:53.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.742+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.742+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13098655859525934196 2024-09-12T00:52:53.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.742+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380f7360 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55d31f329878 s->prefetch_data=0 2024-09-12T00:52:53.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.742+0000 7f0620ff9640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:52:53.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.742+0000 7f07401539c0 10 manifest: total_size = 2078 2024-09-12T00:52:53.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.742+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17928953827018908125 2024-09-12T00:52:53.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.742+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380f7360 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55d31f329878 s->prefetch_data=0 2024-09-12T00:52:53.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.742+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f329878 2024-09-12T00:52:53.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.742+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8.0 2024-09-12T00:52:53.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.746+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.746+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.746+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17928953827018908125 2024-09-12T00:52:53.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.746+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.746+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8__shadow_.NfTmJ-CCBH6lUtXdwYmiAmbWGSHtWv1_0 2024-09-12T00:52:53.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.746+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:52:53.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.746+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.746+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17928953827018908125 2024-09-12T00:52:53.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.750+0000 7f06217fa640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:52:53.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.750+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380f7360 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55d31f329878 s->prefetch_data=0 2024-09-12T00:52:53.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.750+0000 7f07401539c0 10 manifest: total_size = 524288 2024-09-12T00:52:53.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.750+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1455286193073946991 2024-09-12T00:52:53.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.750+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380f7360 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55d31f329878 s->prefetch_data=0 2024-09-12T00:52:53.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.750+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f329878 2024-09-12T00:52:53.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.750+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8.0 2024-09-12T00:52:53.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.758+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.758+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.758+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1455286193073946991 2024-09-12T00:52:53.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.758+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.758+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8__shadow_.-wuw0qrf4M4DgNvgFJ3MFEULmnPR7A8_0 2024-09-12T00:52:53.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.758+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:52:53.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.758+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.758+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1455286193073946991 2024-09-12T00:52:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.758+0000 7f0620ff9640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:52:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.758+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380f7360 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55d31f329878 s->prefetch_data=0 2024-09-12T00:52:53.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.758+0000 7f07401539c0 10 manifest: total_size = 24595 2024-09-12T00:52:53.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.758+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11016226772527220143 2024-09-12T00:52:53.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.758+0000 7f07401539c0 20 get_obj_state: octx=0x7f07380f7360 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55d31f329878 s->prefetch_data=0 2024-09-12T00:52:53.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.758+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f329878 2024-09-12T00:52:53.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.758+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8.0 2024-09-12T00:52:53.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.766+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.766+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.766+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11016226772527220143 2024-09-12T00:52:53.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.766+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.766+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8__shadow_.Pk9KwJ-NfW1utdxILT2arEEpdbxNJ9r_0 2024-09-12T00:52:53.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.766+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:52:53.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.766+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.766+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11016226772527220143 2024-09-12T00:52:53.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.766+0000 7f06217fa640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:52:53.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.766+0000 7f07401539c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:52:53.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.766+0000 7f07401539c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:52:53.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.770+0000 7f07401539c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:52:53.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.770+0000 7f07401539c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:52:53.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.770+0000 7f07401539c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:52:53.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.770+0000 7f07401539c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:52:53.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.770+0000 7f07401539c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8])"; uploads.size()=0; is_truncated=0 2024-09-12T00:52:53.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.770+0000 7f07401539c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-12T00:52:53.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.770+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.774+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:52:53.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.774+0000 7f07401539c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-12T00:52:53.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.774+0000 7f07401539c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-12T00:52:53.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.774+0000 7f07401539c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-12T00:52:53.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.774+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-12T00:52:53.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.774+0000 7f0620ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497014 cookie 94365249581888 notifier 5970 bl.length()=181 2024-09-12T00:52:53.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.778+0000 7f07401539c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8 from cache 2024-09-12T00:52:53.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.778+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8, ofs0, ns] 2024-09-12T00:52:53.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.778+0000 7f06217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496992 cookie 94365249591248 notifier 5970 bl.length()=238 2024-09-12T00:52:53.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.782+0000 7f07401539c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8 : miss 2024-09-12T00:52:53.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.782+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.782+0000 7f07401539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:53.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.782+0000 7f07401539c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8 info.flags=0x0 2024-09-12T00:52:53.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.782+0000 7f07401539c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8 to cache LRU end 2024-09-12T00:52:53.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.790+0000 7f07401539c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9 : miss 2024-09-12T00:52:53.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.790+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.790+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:52:53.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.790+0000 7f07401539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9 info.flags=0x17 2024-09-12T00:52:53.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.790+0000 7f07401539c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9 to cache LRU end 2024-09-12T00:52:53.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.790+0000 7f07401539c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:53.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.790+0000 7f07401539c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:52:53.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.790+0000 7f07401539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9 2024-09-12T00:52:53.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.790+0000 7f07401539c0 10 cls_bucket_list_unordered: got __ 2024-09-12T00:52:53.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.790+0000 7f07401539c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:52:53.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.790+0000 7f07401539c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:52:53.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.790+0000 7f07401539c0 10 cls_bucket_list_unordered: got obj 2024-09-12T00:52:53.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.790+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f31cab0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55d31f329878 s->prefetch_data=0 2024-09-12T00:52:53.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.790+0000 7f07401539c0 10 manifest: total_size = 1048576 2024-09-12T00:52:53.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.790+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5832606828329333299 2024-09-12T00:52:53.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.790+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f31cab0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55d31f329878 s->prefetch_data=0 2024-09-12T00:52:53.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.790+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f329878 2024-09-12T00:52:53.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.790+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9.0 2024-09-12T00:52:53.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.798+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.798+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.798+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5832606828329333299 2024-09-12T00:52:53.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.798+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.798+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9__shadow_.ST0_NyHgLP34BzRAwhpbUfP4UKDuaYg_0 2024-09-12T00:52:53.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.798+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:52:53.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.798+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.798+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5832606828329333299 2024-09-12T00:52:53.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.798+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f313150 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55d31f329878 s->prefetch_data=0 2024-09-12T00:52:53.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.798+0000 7f06217fa640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:52:53.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.802+0000 7f07401539c0 10 manifest: total_size = 55 2024-09-12T00:52:53.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.802+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12711597887662585071 2024-09-12T00:52:53.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.802+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f313150 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55d31f329878 s->prefetch_data=0 2024-09-12T00:52:53.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.802+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f329878 2024-09-12T00:52:53.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.802+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9.0 2024-09-12T00:52:53.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.806+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.806+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.806+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12711597887662585071 2024-09-12T00:52:53.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.806+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.806+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9__shadow_.rMqPMttmb5fZBt-S8XJDZ4RxME7uJwD_0 2024-09-12T00:52:53.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.806+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:52:53.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.806+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.806+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12711597887662585071 2024-09-12T00:52:53.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.810+0000 7f0620ff9640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:52:53.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.810+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f313150 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55d31f329878 s->prefetch_data=0 2024-09-12T00:52:53.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.810+0000 7f07401539c0 10 manifest: total_size = 1035 2024-09-12T00:52:53.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.810+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13360118321810603596 2024-09-12T00:52:53.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.810+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f313150 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55d31f329878 s->prefetch_data=0 2024-09-12T00:52:53.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.810+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f329878 2024-09-12T00:52:53.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.810+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9.0 2024-09-12T00:52:53.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.814+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.814+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.814+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13360118321810603596 2024-09-12T00:52:53.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.814+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.814+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9__shadow_.a5X_HnrJF-kYV-g0pSWz7x_pWpb5p5z_0 2024-09-12T00:52:53.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.814+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:52:53.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.814+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.814+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13360118321810603596 2024-09-12T00:52:53.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.818+0000 7f06217fa640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:52:53.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.818+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f313150 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55d31f329878 s->prefetch_data=0 2024-09-12T00:52:53.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.818+0000 7f07401539c0 10 manifest: total_size = 1048576 2024-09-12T00:52:53.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.818+0000 7f07401539c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10554355494147963022 2024-09-12T00:52:53.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.818+0000 7f07401539c0 20 get_obj_state: octx=0x55d31f313150 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55d31f329878 s->prefetch_data=0 2024-09-12T00:52:53.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.818+0000 7f07401539c0 20 prepare_atomic_modification: state is not atomic. state=0x55d31f329878 2024-09-12T00:52:53.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.818+0000 7f07401539c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9.0 2024-09-12T00:52:53.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.822+0000 7f07401539c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:52:53.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.822+0000 7f07401539c0 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-09-12T00:52:53.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.822+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10554355494147963022 2024-09-12T00:52:53.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.822+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:52:53.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.822+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9__shadow_.YOdGzw2N_B0E_FcjrOyEahp_Y11EDAS_0 2024-09-12T00:52:53.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.822+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:52:53.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.822+0000 7f07401539c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:52:53.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.822+0000 7f07401539c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10554355494147963022 2024-09-12T00:52:53.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.826+0000 7f0620ff9640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:52:53.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.826+0000 7f07401539c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:52:53.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.826+0000 7f07401539c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:52:53.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.826+0000 7f07401539c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:52:53.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.826+0000 7f07401539c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:52:53.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.826+0000 7f07401539c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:52:53.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.826+0000 7f07401539c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:52:53.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.826+0000 7f07401539c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9])"; uploads.size()=0; is_truncated=0 2024-09-12T00:52:53.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.830+0000 7f07401539c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-12T00:52:53.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.830+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.830+0000 7f07401539c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:52:53.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.830+0000 7f07401539c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-12T00:52:53.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.830+0000 7f07401539c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-12T00:52:53.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.834+0000 7f07401539c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-12T00:52:53.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.834+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-12T00:52:53.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.834+0000 7f06217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497015 cookie 94365249581888 notifier 5970 bl.length()=181 2024-09-12T00:52:53.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.838+0000 7f07401539c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9 from cache 2024-09-12T00:52:53.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.838+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9, ofs0, ns] 2024-09-12T00:52:53.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.838+0000 7f0620ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496993 cookie 94365249591248 notifier 5970 bl.length()=238 2024-09-12T00:52:53.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.842+0000 7f07401539c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9 : miss 2024-09-12T00:52:53.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.842+0000 7f07401539c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:53.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.842+0000 7f07401539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:53.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.842+0000 7f07401539c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9 info.flags=0x0 2024-09-12T00:52:53.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.842+0000 7f07401539c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9 to cache LRU end 2024-09-12T00:52:53.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.846+0000 7f07401539c0 10 removing key index: CKGADROBBTWJSQWNSFPG 2024-09-12T00:52:53.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.850+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:CKGADROBBTWJSQWNSFPG, ofs0, ns] 2024-09-12T00:52:53.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.850+0000 7f0620ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497024 cookie 94365249580320 notifier 5970 bl.length()=170 2024-09-12T00:52:53.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.850+0000 7f07401539c0 10 removing email index: ragweed.client.0+test@test.test 2024-09-12T00:52:53.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.854+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T00:52:53.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.854+0000 7f0620ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496990 cookie 94365249585440 notifier 5970 bl.length()=182 2024-09-12T00:52:53.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.854+0000 7f07401539c0 10 removing user buckets index 2024-09-12T00:52:53.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.858+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-12T00:52:53.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.858+0000 7f06217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496994 cookie 94365249591248 notifier 5970 bl.length()=173 2024-09-12T00:52:53.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.858+0000 7f07401539c0 10 removing user index: ragweed.client.0 2024-09-12T00:52:53.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.862+0000 7f07401539c0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-12T00:52:53.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.862+0000 7f07401539c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T00:52:53.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.862+0000 7f0620ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496990 cookie 94365249588112 notifier 5970 bl.length()=165 2024-09-12T00:52:53.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.866+0000 7f05ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:53.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.870+0000 7f07401539c0 20 remove_watcher() i=0 2024-09-12T00:52:53.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.870+0000 7f07401539c0 2 removed watcher, disabling cache 2024-09-12T00:52:53.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.874+0000 7f07401539c0 20 remove_watcher() i=1 2024-09-12T00:52:53.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.874+0000 7f07401539c0 20 remove_watcher() i=2 2024-09-12T00:52:53.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.878+0000 7f07401539c0 20 remove_watcher() i=3 2024-09-12T00:52:53.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.878+0000 7f07401539c0 20 remove_watcher() i=4 2024-09-12T00:52:53.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.882+0000 7f07401539c0 20 remove_watcher() i=5 2024-09-12T00:52:53.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.882+0000 7f07401539c0 20 remove_watcher() i=6 2024-09-12T00:52:53.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:53.886+0000 7f07401539c0 20 remove_watcher() i=7 2024-09-12T00:52:53.895 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-12T00:52:53.972 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:53.972 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:54.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.018+0000 7f70e09ea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:54.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.018+0000 7f70e09ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:54.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.018+0000 7f70e09ea9c0 20 realm 2024-09-12T00:52:54.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.018+0000 7f70e09ea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:54.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.018+0000 7f70e09ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:54.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.018+0000 7f70e09ea9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:54.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.018+0000 7f70e09ea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:54.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.018+0000 7f70e09ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:54.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.018+0000 7f70e09ea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:54.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.022+0000 7f70e09ea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:54.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.022+0000 7f70e09ea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:54.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.022+0000 7f70e09ea9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:54.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.022+0000 7f70e09ea9c0 20 searching for the correct realm 2024-09-12T00:52:54.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.026+0000 7f70decf1640 0 -- 172.21.15.70:0/757996450 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f70d4061c40 msgr2=0x7f70d40616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:54.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.242+0000 7f70decf1640 0 -- 172.21.15.70:0/757996450 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f70d4061c40 msgr2=0x7f70d40616b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:54.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.254+0000 7f70e09ea9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:54.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.254+0000 7f70e09ea9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:52:54.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.254+0000 7f70e09ea9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:54.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.254+0000 7f70e09ea9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:52:54.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.254+0000 7f70e09ea9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:54.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.254+0000 7f70e09ea9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:54.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.254+0000 7f70e09ea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:54.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.254+0000 7f70e09ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:54.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.254+0000 7f70e09ea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:54.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.254+0000 7f70e09ea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:54.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.254+0000 7f70e09ea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:54.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.254+0000 7f70e09ea9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:54.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.254+0000 7f70e09ea9c0 20 zone default found 2024-09-12T00:52:54.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.254+0000 7f70e09ea9c0 4 Realm: () 2024-09-12T00:52:54.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.254+0000 7f70e09ea9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:52:54.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.254+0000 7f70e09ea9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:52:54.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.254+0000 7f70e09ea9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:54.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.254+0000 7f70e09ea9c0 20 zonegroup default 2024-09-12T00:52:54.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.254+0000 7f70e09ea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:54.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.254+0000 7f70e09ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:54.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.254+0000 7f70e09ea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:54.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.258+0000 7f70e09ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:54.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.258+0000 7f70e09ea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:54.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.258+0000 7f70e09ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:54.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.258+0000 7f70e09ea9c0 20 started sync module instance, tier type = 2024-09-12T00:52:54.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.258+0000 7f70e09ea9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:52:54.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.278+0000 7f70e09ea9c0 20 add_watcher() i=0 2024-09-12T00:52:54.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.278+0000 7f70e09ea9c0 20 add_watcher() i=1 2024-09-12T00:52:54.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.278+0000 7f70e09ea9c0 20 add_watcher() i=2 2024-09-12T00:52:54.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.278+0000 7f70e09ea9c0 20 add_watcher() i=3 2024-09-12T00:52:54.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.278+0000 7f70e09ea9c0 20 add_watcher() i=4 2024-09-12T00:52:54.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.278+0000 7f70e09ea9c0 20 add_watcher() i=5 2024-09-12T00:52:54.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.278+0000 7f70e09ea9c0 20 add_watcher() i=6 2024-09-12T00:52:54.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.282+0000 7f70e09ea9c0 20 add_watcher() i=7 2024-09-12T00:52:54.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.282+0000 7f70e09ea9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:54.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.286+0000 7f6f94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:54.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.286+0000 7f70e09ea9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:54.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.286+0000 7f70e09ea9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:54.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.426+0000 7f6f0f7fe640 20 reqs_thread_entry: start 2024-09-12T00:52:54.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.426+0000 7f70e09ea9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:52:54.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.426+0000 7f70e09ea9c0 20 Filter name: none 2024-09-12T00:52:54.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.426+0000 7f6f0d7fa640 20 reqs_thread_entry: start 2024-09-12T00:52:54.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.426+0000 7f70e09ea9c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T00:52:54.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.426+0000 7f70e09ea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:54.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.430+0000 7f70e09ea9c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:52:54.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.430+0000 7f70e09ea9c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-12T00:52:54.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.430+0000 7f70e09ea9c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:52:54.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.430+0000 7f70e09ea9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:54.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.430+0000 7f70e09ea9c0 10 removing key index: KOMSHZNJVEZKDBRFBCOY 2024-09-12T00:52:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.430+0000 7f70e09ea9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:KOMSHZNJVEZKDBRFBCOY, ofs0, ns] 2024-09-12T00:52:54.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.434+0000 7f6fc1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497016 cookie 94803991323168 notifier 5991 bl.length()=170 2024-09-12T00:52:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.434+0000 7f70e09ea9c0 10 removing email index: sysuser.client.0+test@test.test 2024-09-12T00:52:54.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.438+0000 7f70e09ea9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T00:52:54.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.438+0000 7f6fc1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 94803991331072 notifier 5991 bl.length()=182 2024-09-12T00:52:54.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.438+0000 7f70e09ea9c0 10 removing user buckets index 2024-09-12T00:52:54.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.442+0000 7f70e09ea9c0 10 removing user index: sysuser.client.0 2024-09-12T00:52:54.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.442+0000 7f70e09ea9c0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-12T00:52:54.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.442+0000 7f70e09ea9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T00:52:54.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.442+0000 7f6fc17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 94803991332544 notifier 5991 bl.length()=165 2024-09-12T00:52:54.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.446+0000 7f6f94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:54.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.450+0000 7f70e09ea9c0 20 remove_watcher() i=0 2024-09-12T00:52:54.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.450+0000 7f70e09ea9c0 2 removed watcher, disabling cache 2024-09-12T00:52:54.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.454+0000 7f70e09ea9c0 20 remove_watcher() i=1 2024-09-12T00:52:54.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.458+0000 7f70e09ea9c0 20 remove_watcher() i=2 2024-09-12T00:52:54.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.458+0000 7f70e09ea9c0 20 remove_watcher() i=3 2024-09-12T00:52:54.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.462+0000 7f70e09ea9c0 20 remove_watcher() i=4 2024-09-12T00:52:54.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.462+0000 7f70e09ea9c0 20 remove_watcher() i=5 2024-09-12T00:52:54.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.462+0000 7f70e09ea9c0 20 remove_watcher() i=6 2024-09-12T00:52:54.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T00:52:54.466+0000 7f70e09ea9c0 20 remove_watcher() i=7 2024-09-12T00:52:54.479 INFO:tasks.ragweed:Removing ragweed... 2024-09-12T00:52:54.479 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:52:54.565 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:52:54.575 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:52:54.575 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:52:54.576 DEBUG:teuthology.orchestra.run.smithi070:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:52:54.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:52:54.582 INFO:teuthology.orchestra.run.smithi070.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:52:54.582 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:52:54.629 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:52:54.630 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:52:54.677 INFO:tasks.workunit:timeout=3h 2024-09-12T00:52:54.677 INFO:tasks.workunit:cleanup=True 2024-09-12T00:52:54.677 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:52:54.730 INFO:tasks.workunit.client.0.smithi070.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:53:37.361 INFO:tasks.workunit.client.0.smithi070.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:53:37.361 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:53:37.361 INFO:tasks.workunit.client.0.smithi070.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:53:37.362 INFO:tasks.workunit.client.0.smithi070.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:53:37.362 INFO:tasks.workunit.client.0.smithi070.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:53:37.362 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:53:37.362 INFO:tasks.workunit.client.0.smithi070.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:53:37.362 INFO:tasks.workunit.client.0.smithi070.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:53:37.362 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:53:37.362 INFO:tasks.workunit.client.0.smithi070.stderr: git switch -c 2024-09-12T00:53:37.362 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:53:37.362 INFO:tasks.workunit.client.0.smithi070.stderr:Or undo this operation with: 2024-09-12T00:53:37.362 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:53:37.362 INFO:tasks.workunit.client.0.smithi070.stderr: git switch - 2024-09-12T00:53:37.362 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:53:37.362 INFO:tasks.workunit.client.0.smithi070.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:53:37.363 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:53:37.363 INFO:tasks.workunit.client.0.smithi070.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:53:37.368 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:53:37.418 INFO:tasks.workunit.client.0.smithi070.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:53:37.421 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:53:37.421 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:53:37.480 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:53:37.530 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:53:37.573 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:53:37.574 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:53:37.574 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:53:37.616 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:53:37.620 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T00:53:37.620 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:53:37.669 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-12T00:53:37.670 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-12T00:53:37.670 DEBUG:teuthology.orchestra.run.smithi070:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T00:53:37.724 INFO:tasks.workunit.client.0.smithi070.stderr:+ ulimit -c 0 2024-09-12T00:53:37.724 INFO:tasks.workunit.client.0.smithi070.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T00:53:37.725 INFO:tasks.workunit.client.0.smithi070.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:53:37.725 INFO:tasks.workunit.client.0.smithi070.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:53:40.573 INFO:tasks.workunit.client.0.smithi070.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:53:40.573 INFO:tasks.workunit.client.0.smithi070.stderr:++ deactivate nondestructive 2024-09-12T00:53:40.573 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -n '' ']' 2024-09-12T00:53:40.573 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -n '' ']' 2024-09-12T00:53:40.573 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:53:40.573 INFO:tasks.workunit.client.0.smithi070.stderr:++ hash -r 2024-09-12T00:53:40.573 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -n '' ']' 2024-09-12T00:53:40.574 INFO:tasks.workunit.client.0.smithi070.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:53:40.574 INFO:tasks.workunit.client.0.smithi070.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:53:40.574 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:53:40.574 INFO:tasks.workunit.client.0.smithi070.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:53:40.574 INFO:tasks.workunit.client.0.smithi070.stderr:++ export VIRTUAL_ENV 2024-09-12T00:53:40.574 INFO:tasks.workunit.client.0.smithi070.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:53:40.574 INFO:tasks.workunit.client.0.smithi070.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:53:40.574 INFO:tasks.workunit.client.0.smithi070.stderr:++ export PATH 2024-09-12T00:53:40.574 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -n '' ']' 2024-09-12T00:53:40.574 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -z '' ']' 2024-09-12T00:53:40.574 INFO:tasks.workunit.client.0.smithi070.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:53:40.574 INFO:tasks.workunit.client.0.smithi070.stderr:++ PS1='(rgw) ' 2024-09-12T00:53:40.574 INFO:tasks.workunit.client.0.smithi070.stderr:++ export PS1 2024-09-12T00:53:40.574 INFO:tasks.workunit.client.0.smithi070.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T00:53:40.574 INFO:tasks.workunit.client.0.smithi070.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T00:53:40.575 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:53:40.575 INFO:tasks.workunit.client.0.smithi070.stderr:++ hash -r 2024-09-12T00:53:40.575 INFO:tasks.workunit.client.0.smithi070.stderr:+ pip install pip --upgrade 2024-09-12T00:53:40.968 INFO:tasks.workunit.client.0.smithi070.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T00:53:41.179 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting pip 2024-09-12T00:53:41.185 INFO:tasks.workunit.client.0.smithi070.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:53:41.220 INFO:tasks.workunit.client.0.smithi070.stdout:Installing collected packages: pip 2024-09-12T00:53:41.220 INFO:tasks.workunit.client.0.smithi070.stdout: Attempting uninstall: pip 2024-09-12T00:53:41.220 INFO:tasks.workunit.client.0.smithi070.stdout: Found existing installation: pip 22.0.2 2024-09-12T00:53:41.488 INFO:tasks.workunit.client.0.smithi070.stdout: Uninstalling pip-22.0.2: 2024-09-12T00:53:41.494 INFO:tasks.workunit.client.0.smithi070.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T00:53:42.235 INFO:tasks.workunit.client.0.smithi070.stdout:Successfully installed pip-24.2 2024-09-12T00:53:42.299 INFO:tasks.workunit.client.0.smithi070.stderr:+ pip install boto3 2024-09-12T00:53:43.246 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting boto3 2024-09-12T00:53:43.247 INFO:tasks.workunit.client.0.smithi070.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:53:43.779 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:53:43.781 INFO:tasks.workunit.client.0.smithi070.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:53:43.826 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:53:43.827 INFO:tasks.workunit.client.0.smithi070.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:53:43.880 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:53:43.881 INFO:tasks.workunit.client.0.smithi070.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:53:43.932 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:53:43.933 INFO:tasks.workunit.client.0.smithi070.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:53:44.033 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:53:44.035 INFO:tasks.workunit.client.0.smithi070.stdout: Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-12T00:53:44.296 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:53:44.297 INFO:tasks.workunit.client.0.smithi070.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:53:44.300 INFO:tasks.workunit.client.0.smithi070.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:53:44.302 INFO:tasks.workunit.client.0.smithi070.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:53:44.313 INFO:tasks.workunit.client.0.smithi070.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:53:44.314 INFO:tasks.workunit.client.0.smithi070.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:53:44.315 INFO:tasks.workunit.client.0.smithi070.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:53:44.317 INFO:tasks.workunit.client.0.smithi070.stdout:Using cached urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-12T00:53:44.318 INFO:tasks.workunit.client.0.smithi070.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:53:44.394 INFO:tasks.workunit.client.0.smithi070.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:53:45.543 INFO:tasks.workunit.client.0.smithi070.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-12T00:53:45.750 INFO:tasks.workunit.client.0.smithi070.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-12T00:53:45.889 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-12T00:53:45.927 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:45.927 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:45.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:45.977+0000 7fca0fec99c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:45.971 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:45.977+0000 7fca0fec99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:45.972 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:45.977+0000 7fca0fec99c0 20 realm 2024-09-12T00:53:45.972 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:45.977+0000 7fca0fec99c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:45.972 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:45.977+0000 7fca0fec99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:45.972 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:45.977+0000 7fca0fec99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:45.972 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:45.977+0000 7fca0fec99c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:45.972 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:45.977+0000 7fca0fec99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:45.972 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:45.977+0000 7fca0fec99c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:45.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:45.981+0000 7fca0fec99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:45.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:45.981+0000 7fca0fec99c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:45.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:45.981+0000 7fca0fec99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:45.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:45.981+0000 7fca0fec99c0 20 searching for the correct realm 2024-09-12T00:53:45.979 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:45.985+0000 7fca0e1d0640 0 -- 172.21.15.70:0/104233163 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fca04089bb0 msgr2=0x7fca0405d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:46.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.201+0000 7fca0e1d0640 0 -- 172.21.15.70:0/104233163 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fca04089bb0 msgr2=0x7fca0405d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:46.207 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.213+0000 7fca0fec99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:46.208 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.213+0000 7fca0fec99c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:53:46.208 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.213+0000 7fca0fec99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:46.208 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.213+0000 7fca0fec99c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:53:46.208 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.213+0000 7fca0fec99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:46.208 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.213+0000 7fca0fec99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:46.208 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.213+0000 7fca0fec99c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:46.208 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.213+0000 7fca0fec99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:46.208 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.213+0000 7fca0fec99c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:46.209 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.217+0000 7fca0fec99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:46.209 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.217+0000 7fca0fec99c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:46.210 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.217+0000 7fca0fec99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:46.210 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.217+0000 7fca0fec99c0 20 zone default found 2024-09-12T00:53:46.210 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.217+0000 7fca0fec99c0 4 Realm: () 2024-09-12T00:53:46.210 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.217+0000 7fca0fec99c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:53:46.210 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.217+0000 7fca0fec99c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:53:46.210 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.217+0000 7fca0fec99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:46.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.217+0000 7fca0fec99c0 20 zonegroup default 2024-09-12T00:53:46.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.217+0000 7fca0fec99c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:46.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.217+0000 7fca0fec99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:46.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.217+0000 7fca0fec99c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:46.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.217+0000 7fca0fec99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:46.212 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.217+0000 7fca0fec99c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:46.212 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.217+0000 7fca0fec99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:46.212 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.217+0000 7fca0fec99c0 20 started sync module instance, tier type = 2024-09-12T00:53:46.212 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.217+0000 7fca0fec99c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:53:46.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.241+0000 7fca0fec99c0 20 add_watcher() i=0 2024-09-12T00:53:46.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.241+0000 7fca0fec99c0 20 add_watcher() i=1 2024-09-12T00:53:46.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.241+0000 7fca0fec99c0 20 add_watcher() i=2 2024-09-12T00:53:46.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.241+0000 7fca0fec99c0 20 add_watcher() i=3 2024-09-12T00:53:46.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.241+0000 7fca0fec99c0 20 add_watcher() i=4 2024-09-12T00:53:46.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.241+0000 7fca0fec99c0 20 add_watcher() i=5 2024-09-12T00:53:46.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.241+0000 7fca0fec99c0 20 add_watcher() i=6 2024-09-12T00:53:46.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.245+0000 7fca0fec99c0 20 add_watcher() i=7 2024-09-12T00:53:46.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.245+0000 7fca0fec99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:46.240 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.249+0000 7fc8bf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:46.241 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.249+0000 7fca0fec99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:46.241 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.249+0000 7fca0fec99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:46.241 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.249+0000 7fca0fec99c0 5 note: GC not initialized 2024-09-12T00:53:46.242 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.249+0000 7fc8be7fc640 20 reqs_thread_entry: start 2024-09-12T00:53:46.242 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.249+0000 7fca0fec99c0 20 init_complete bucket index max shards: 1 2024-09-12T00:53:46.242 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.249+0000 7fca0fec99c0 20 Filter name: none 2024-09-12T00:53:46.243 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.249+0000 7fc82ffff640 20 reqs_thread_entry: start 2024-09-12T00:53:46.243 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.249+0000 7fca0fec99c0 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-12T00:53:46.243 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.249+0000 7fca0fec99c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:46.244 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.249+0000 7fca0fec99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:46.244 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.249+0000 7fca0fec99c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-12T00:53:46.244 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.249+0000 7fca0fec99c0 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:53:46.244 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.249+0000 7fca0fec99c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T00:53:46.244 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.249+0000 7fca0fec99c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:46.244 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.249+0000 7fca0fec99c0 20 rados_obj.operate() r=0 bl.length=22 2024-09-12T00:53:46.244 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.249+0000 7fca0fec99c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x5 2024-09-12T00:53:46.244 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.249+0000 7fca0fec99c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:53:46.244 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.249+0000 7fca0fec99c0 10 cache get: name=default.rgw.meta+users.uid+rgw_datacache_user : miss 2024-09-12T00:53:46.245 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.249+0000 7fca0fec99c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:46.245 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.253+0000 7fca0fec99c0 20 rados_obj.operate() r=0 bl.length=420 2024-09-12T00:53:46.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.253+0000 7fca0fec99c0 10 cache put: name=default.rgw.meta+users.uid+rgw_datacache_user info.flags=0x13 2024-09-12T00:53:46.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.253+0000 7fca0fec99c0 10 adding default.rgw.meta+users.uid+rgw_datacache_user to cache LRU end 2024-09-12T00:53:46.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.253+0000 7fca0fec99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:46.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.253+0000 7fca0fec99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+rgw_datacache_user 2024-09-12T00:53:46.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.253+0000 7fca0fec99c0 20 get_user_info_from_index found 0 xattrs 2024-09-12T00:53:46.246 INFO:tasks.workunit.client.0.smithi070.stderr:could not create user: unable to parse parameters, duplicate key provided 2024-09-12T00:53:46.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.253+0000 7fc8bf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:46.251 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.257+0000 7fca0fec99c0 20 remove_watcher() i=0 2024-09-12T00:53:46.251 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.257+0000 7fca0fec99c0 2 removed watcher, disabling cache 2024-09-12T00:53:46.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.261+0000 7fca0fec99c0 20 remove_watcher() i=1 2024-09-12T00:53:46.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.265+0000 7fca0fec99c0 20 remove_watcher() i=2 2024-09-12T00:53:46.258 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.265+0000 7fca0fec99c0 20 remove_watcher() i=3 2024-09-12T00:53:46.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.269+0000 7fca0fec99c0 20 remove_watcher() i=4 2024-09-12T00:53:46.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.269+0000 7fca0fec99c0 20 remove_watcher() i=5 2024-09-12T00:53:46.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.269+0000 7fca0fec99c0 20 remove_watcher() i=6 2024-09-12T00:53:46.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:53:46.273+0000 7fca0fec99c0 20 remove_watcher() i=7 2024-09-12T00:53:59.929 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:53:59.929 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:53:59.986 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:53:59.986 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:00.010 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:00.043 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:00.043 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:00.043 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:00.049 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:00.049 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:00.096 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:00.096 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:00.141 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: reshard add 2024-09-12T00:54:00.141 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:00.142 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:54:00.176 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:00.176 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:00.221 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.228+0000 7fa4b5efa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.222 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.228+0000 7fa4b5efa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.223 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.228+0000 7fa4b5efa9c0 20 realm 2024-09-12T00:54:00.223 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.228+0000 7fa4b5efa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.223 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.228+0000 7fa4b5efa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.223 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.228+0000 7fa4b5efa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:00.223 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.228+0000 7fa4b5efa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.223 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.228+0000 7fa4b5efa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.223 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.228+0000 7fa4b5efa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.225 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.232+0000 7fa4b5efa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:00.225 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.232+0000 7fa4b5efa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.225 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.232+0000 7fa4b5efa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:00.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.232+0000 7fa4b5efa9c0 20 searching for the correct realm 2024-09-12T00:54:00.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.236+0000 7fa4b4201640 0 -- 172.21.15.70:0/4281896012 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fa4a803e040 msgr2=0x7fa4a8031920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:00.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.452+0000 7fa4b4201640 0 -- 172.21.15.70:0/4281896012 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fa4a803e040 msgr2=0x7fa4a8031920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:00.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.464+0000 7fa4b5efa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:00.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.464+0000 7fa4b5efa9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:00.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.464+0000 7fa4b5efa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:00.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.464+0000 7fa4b5efa9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:00.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.464+0000 7fa4b5efa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:00.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.464+0000 7fa4b5efa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:00.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.464+0000 7fa4b5efa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.464+0000 7fa4b5efa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.464+0000 7fa4b5efa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.468+0000 7fa4b5efa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:00.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.468+0000 7fa4b5efa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.468+0000 7fa4b5efa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:00.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.468+0000 7fa4b5efa9c0 20 zone default found 2024-09-12T00:54:00.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.468+0000 7fa4b5efa9c0 4 Realm: () 2024-09-12T00:54:00.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.468+0000 7fa4b5efa9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:00.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.468+0000 7fa4b5efa9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:00.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.468+0000 7fa4b5efa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:00.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.468+0000 7fa4b5efa9c0 20 zonegroup default 2024-09-12T00:54:00.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.468+0000 7fa4b5efa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.468+0000 7fa4b5efa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.468+0000 7fa4b5efa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.468+0000 7fa4b5efa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.468+0000 7fa4b5efa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.468+0000 7fa4b5efa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.468+0000 7fa4b5efa9c0 20 started sync module instance, tier type = 2024-09-12T00:54:00.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.468+0000 7fa4b5efa9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:00.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.492+0000 7fa4b5efa9c0 20 add_watcher() i=0 2024-09-12T00:54:00.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.492+0000 7fa4b5efa9c0 20 add_watcher() i=1 2024-09-12T00:54:00.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.492+0000 7fa4b5efa9c0 20 add_watcher() i=2 2024-09-12T00:54:00.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.492+0000 7fa4b5efa9c0 20 add_watcher() i=3 2024-09-12T00:54:00.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.492+0000 7fa4b5efa9c0 20 add_watcher() i=4 2024-09-12T00:54:00.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.492+0000 7fa4b5efa9c0 20 add_watcher() i=5 2024-09-12T00:54:00.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.492+0000 7fa4b5efa9c0 20 add_watcher() i=6 2024-09-12T00:54:00.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.492+0000 7fa4b5efa9c0 20 add_watcher() i=7 2024-09-12T00:54:00.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.492+0000 7fa4b5efa9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:00.490 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.496+0000 7fa369fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:00.491 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.496+0000 7fa4b5efa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:00.491 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.496+0000 7fa4b5efa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:00.491 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.496+0000 7fa4b5efa9c0 5 note: GC not initialized 2024-09-12T00:54:00.492 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.496+0000 7fa368fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:00.492 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.496+0000 7fa4b5efa9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:00.492 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.496+0000 7fa4b5efa9c0 20 Filter name: none 2024-09-12T00:54:00.492 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.496+0000 7fa2e27fc640 20 reqs_thread_entry: start 2024-09-12T00:54:00.492 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.500+0000 7fa4b5efa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.500+0000 7fa4b5efa9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:00.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.500+0000 7fa4b5efa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.500+0000 7fa4b5efa9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:54:00.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.500+0000 7fa4b5efa9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:00.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.500+0000 7fa4b5efa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.496 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.504+0000 7fa4b5efa9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:00.496 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.504+0000 7fa4b5efa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.497 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.504+0000 7fa4b5efa9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:54:00.498 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.504+0000 7fa4b5efa9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:00.499 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.504+0000 7fa369fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:00.504 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.512+0000 7fa4b5efa9c0 20 remove_watcher() i=0 2024-09-12T00:54:00.504 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.512+0000 7fa4b5efa9c0 2 removed watcher, disabling cache 2024-09-12T00:54:00.507 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.512+0000 7fa4b5efa9c0 20 remove_watcher() i=1 2024-09-12T00:54:00.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.516+0000 7fa4b5efa9c0 20 remove_watcher() i=2 2024-09-12T00:54:00.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.516+0000 7fa4b5efa9c0 20 remove_watcher() i=3 2024-09-12T00:54:00.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.520+0000 7fa4b5efa9c0 20 remove_watcher() i=4 2024-09-12T00:54:00.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.520+0000 7fa4b5efa9c0 20 remove_watcher() i=5 2024-09-12T00:54:00.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.524+0000 7fa4b5efa9c0 20 remove_watcher() i=6 2024-09-12T00:54:00.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.524+0000 7fa4b5efa9c0 20 remove_watcher() i=7 2024-09-12T00:54:00.534 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:00.534 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:54:00.534 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: a-bucket id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-12T00:54:00.534 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:00.535 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 2 2024-09-12T00:54:00.564 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:00.564 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:00.607 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.612+0000 7f360db579c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.616+0000 7f360db579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.616+0000 7f360db579c0 20 realm 2024-09-12T00:54:00.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.616+0000 7f360db579c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.616+0000 7f360db579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.616+0000 7f360db579c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:00.610 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.616+0000 7f360db579c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.610 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.616+0000 7f360db579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.610 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.616+0000 7f360db579c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.611 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.616+0000 7f360db579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:00.611 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.616+0000 7f360db579c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.611 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.616+0000 7f360db579c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:00.611 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.616+0000 7f360db579c0 20 searching for the correct realm 2024-09-12T00:54:00.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.620+0000 7f360be5e640 0 -- 172.21.15.70:0/3506743448 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f36000dc040 msgr2=0x7f36000dc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:00.829 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.836+0000 7f360be5e640 0 -- 172.21.15.70:0/3506743448 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f36000dc040 msgr2=0x7f36000dc420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:00.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.848+0000 7f360db579c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:00.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.848+0000 7f360db579c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:00.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.848+0000 7f360db579c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:00.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.848+0000 7f360db579c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:00.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.848+0000 7f360db579c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:00.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.848+0000 7f360db579c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:00.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.848+0000 7f360db579c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.848+0000 7f360db579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.848+0000 7f360db579c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.848+0000 7f360db579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:00.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.848+0000 7f360db579c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.848+0000 7f360db579c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:00.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.848+0000 7f360db579c0 20 zone default found 2024-09-12T00:54:00.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.848+0000 7f360db579c0 4 Realm: () 2024-09-12T00:54:00.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.848+0000 7f360db579c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:00.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.848+0000 7f360db579c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:00.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.848+0000 7f360db579c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:00.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.848+0000 7f360db579c0 20 zonegroup default 2024-09-12T00:54:00.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.848+0000 7f360db579c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.848+0000 7f360db579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.848+0000 7f360db579c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.852+0000 7f360db579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.852+0000 7f360db579c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.852+0000 7f360db579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.846 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.852+0000 7f360db579c0 20 started sync module instance, tier type = 2024-09-12T00:54:00.846 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.852+0000 7f360db579c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:00.869 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.876+0000 7f360db579c0 20 add_watcher() i=0 2024-09-12T00:54:00.869 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.876+0000 7f360db579c0 20 add_watcher() i=1 2024-09-12T00:54:00.869 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.876+0000 7f360db579c0 20 add_watcher() i=2 2024-09-12T00:54:00.869 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.876+0000 7f360db579c0 20 add_watcher() i=3 2024-09-12T00:54:00.869 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.876+0000 7f360db579c0 20 add_watcher() i=4 2024-09-12T00:54:00.869 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.876+0000 7f360db579c0 20 add_watcher() i=5 2024-09-12T00:54:00.869 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.876+0000 7f360db579c0 20 add_watcher() i=6 2024-09-12T00:54:00.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.876+0000 7f360db579c0 20 add_watcher() i=7 2024-09-12T00:54:00.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.876+0000 7f360db579c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:00.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.880+0000 7f34c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:00.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.880+0000 7f360db579c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:00.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.880+0000 7f360db579c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:00.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.880+0000 7f360db579c0 5 note: GC not initialized 2024-09-12T00:54:00.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.884+0000 7f34c0fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:00.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.884+0000 7f360db579c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:00.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.884+0000 7f360db579c0 20 Filter name: none 2024-09-12T00:54:00.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.884+0000 7f343a7fc640 20 reqs_thread_entry: start 2024-09-12T00:54:00.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.884+0000 7f360db579c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:54:00.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.884+0000 7f360db579c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.879 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.884+0000 7f360db579c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:00.879 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.884+0000 7f360db579c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:54:00.879 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.884+0000 7f360db579c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:54:00.879 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.884+0000 7f360db579c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : miss 2024-09-12T00:54:00.879 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.884+0000 7f360db579c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.880 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.884+0000 7f360db579c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:54:00.880 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.884+0000 7f360db579c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:54:00.880 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.884+0000 7f360db579c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:54:00.880 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.884+0000 7f360db579c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:00.880 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.884+0000 7f360db579c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:00.880 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.884+0000 7f360db579c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T00:54:00.884 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.892+0000 7f34c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:00.889 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.896+0000 7f360db579c0 20 remove_watcher() i=0 2024-09-12T00:54:00.889 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.896+0000 7f360db579c0 2 removed watcher, disabling cache 2024-09-12T00:54:00.892 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.896+0000 7f360db579c0 20 remove_watcher() i=1 2024-09-12T00:54:00.894 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.900+0000 7f360db579c0 20 remove_watcher() i=2 2024-09-12T00:54:00.896 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.904+0000 7f360db579c0 20 remove_watcher() i=3 2024-09-12T00:54:00.898 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.904+0000 7f360db579c0 20 remove_watcher() i=4 2024-09-12T00:54:00.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.904+0000 7f360db579c0 20 remove_watcher() i=5 2024-09-12T00:54:00.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.908+0000 7f360db579c0 20 remove_watcher() i=6 2024-09-12T00:54:00.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:00.908+0000 7f360db579c0 20 remove_watcher() i=7 2024-09-12T00:54:00.923 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin reshard list 2024-09-12T00:54:00.949 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:00.949 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:00.998 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.004+0000 7f4fccb5f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.000 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.004+0000 7f4fccb5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:01.001 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.004+0000 7f4fccb5f9c0 20 realm 2024-09-12T00:54:01.001 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.004+0000 7f4fccb5f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.001 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.004+0000 7f4fccb5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:01.001 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.004+0000 7f4fccb5f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:01.001 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.004+0000 7f4fccb5f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.001 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.008+0000 7f4fccb5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:01.002 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.008+0000 7f4fccb5f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.002 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.008+0000 7f4fccb5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:01.002 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.008+0000 7f4fccb5f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.004 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.008+0000 7f4fccb5f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:01.004 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.008+0000 7f4fccb5f9c0 20 searching for the correct realm 2024-09-12T00:54:01.009 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.012+0000 7f4fcae66640 0 -- 172.21.15.70:0/2798008527 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f4fc001a040 msgr2=0x7f4fc0031410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:01.223 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.228+0000 7f4fcae66640 0 -- 172.21.15.70:0/2798008527 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f4fc001a040 msgr2=0x7f4fc0031410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:01.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.240+0000 7f4fccb5f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:01.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.240+0000 7f4fccb5f9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:01.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.240+0000 7f4fccb5f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:01.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.240+0000 7f4fccb5f9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:01.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.240+0000 7f4fccb5f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:01.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.240+0000 7f4fccb5f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:01.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.240+0000 7f4fccb5f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.240+0000 7f4fccb5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:01.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.240+0000 7f4fccb5f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.240+0000 7f4fccb5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:01.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.240+0000 7f4fccb5f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.244+0000 7f4fccb5f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:01.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.244+0000 7f4fccb5f9c0 20 zone default found 2024-09-12T00:54:01.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.244+0000 7f4fccb5f9c0 4 Realm: () 2024-09-12T00:54:01.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.244+0000 7f4fccb5f9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:01.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.244+0000 7f4fccb5f9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:01.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.244+0000 7f4fccb5f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:01.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.244+0000 7f4fccb5f9c0 20 zonegroup default 2024-09-12T00:54:01.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.244+0000 7f4fccb5f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.244+0000 7f4fccb5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:01.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.244+0000 7f4fccb5f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.244+0000 7f4fccb5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:01.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.244+0000 7f4fccb5f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.244+0000 7f4fccb5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:01.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.244+0000 7f4fccb5f9c0 20 started sync module instance, tier type = 2024-09-12T00:54:01.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.244+0000 7f4fccb5f9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:01.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.264+0000 7f4fccb5f9c0 20 add_watcher() i=0 2024-09-12T00:54:01.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.264+0000 7f4fccb5f9c0 20 add_watcher() i=1 2024-09-12T00:54:01.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.264+0000 7f4fccb5f9c0 20 add_watcher() i=2 2024-09-12T00:54:01.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.264+0000 7f4fccb5f9c0 20 add_watcher() i=3 2024-09-12T00:54:01.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.264+0000 7f4fccb5f9c0 20 add_watcher() i=4 2024-09-12T00:54:01.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.264+0000 7f4fccb5f9c0 20 add_watcher() i=5 2024-09-12T00:54:01.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.264+0000 7f4fccb5f9c0 20 add_watcher() i=6 2024-09-12T00:54:01.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.268+0000 7f4fccb5f9c0 20 add_watcher() i=7 2024-09-12T00:54:01.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.268+0000 7f4fccb5f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:01.264 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.272+0000 7f4e80fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:01.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.272+0000 7f4fccb5f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:01.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.272+0000 7f4fccb5f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:01.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.272+0000 7f4fccb5f9c0 5 note: GC not initialized 2024-09-12T00:54:01.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.272+0000 7f4dfb7fe640 20 reqs_thread_entry: start 2024-09-12T00:54:01.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.272+0000 7f4fccb5f9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:01.266 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.272+0000 7f4fccb5f9c0 20 Filter name: none 2024-09-12T00:54:01.266 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.272+0000 7f4df97fa640 20 reqs_thread_entry: start 2024-09-12T00:54:01.277 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.284+0000 7f4e80fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:01.282 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.288+0000 7f4fccb5f9c0 20 remove_watcher() i=0 2024-09-12T00:54:01.282 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.288+0000 7f4fccb5f9c0 2 removed watcher, disabling cache 2024-09-12T00:54:01.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.292+0000 7f4fccb5f9c0 20 remove_watcher() i=1 2024-09-12T00:54:01.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.292+0000 7f4fccb5f9c0 20 remove_watcher() i=2 2024-09-12T00:54:01.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.296+0000 7f4fccb5f9c0 20 remove_watcher() i=3 2024-09-12T00:54:01.291 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.296+0000 7f4fccb5f9c0 20 remove_watcher() i=4 2024-09-12T00:54:01.293 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.300+0000 7f4fccb5f9c0 20 remove_watcher() i=5 2024-09-12T00:54:01.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.300+0000 7f4fccb5f9c0 20 remove_watcher() i=6 2024-09-12T00:54:01.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.304+0000 7f4fccb5f9c0 20 remove_watcher() i=7 2024-09-12T00:54:01.314 INFO:tasks.workunit.client.0.smithi070.stderr:bucket name a-bucket 2024-09-12T00:54:01.314 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: reshard process 2024-09-12T00:54:01.314 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:01.314 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin reshard process 2024-09-12T00:54:01.343 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:01.344 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:01.387 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.392+0000 7f72f004c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.389 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.396+0000 7f72f004c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:01.389 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.396+0000 7f72f004c9c0 20 realm 2024-09-12T00:54:01.389 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.396+0000 7f72f004c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.389 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.396+0000 7f72f004c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:01.389 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.396+0000 7f72f004c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:01.389 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.396+0000 7f72f004c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.389 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.396+0000 7f72f004c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:01.390 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.396+0000 7f72f004c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.390 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.396+0000 7f72f004c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:01.391 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.396+0000 7f72f004c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.391 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.396+0000 7f72f004c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:01.391 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.396+0000 7f72f004c9c0 20 searching for the correct realm 2024-09-12T00:54:01.395 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.400+0000 7f72ee353640 0 -- 172.21.15.70:0/975790314 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f72d8065380 msgr2=0x7f72d8063df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:01.610 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.616+0000 7f72ee353640 0 -- 172.21.15.70:0/975790314 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f72d8065380 msgr2=0x7f72d8063df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:01.623 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.628+0000 7f72f004c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:01.623 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.628+0000 7f72f004c9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:01.623 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.628+0000 7f72f004c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:01.623 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.628+0000 7f72f004c9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:01.623 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.628+0000 7f72f004c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:01.623 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.628+0000 7f72f004c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:01.623 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.628+0000 7f72f004c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.623 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.628+0000 7f72f004c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:01.624 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.628+0000 7f72f004c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.624 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.628+0000 7f72f004c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:01.624 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.628+0000 7f72f004c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.624 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.632+0000 7f72f004c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:01.624 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.632+0000 7f72f004c9c0 20 zone default found 2024-09-12T00:54:01.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.632+0000 7f72f004c9c0 4 Realm: () 2024-09-12T00:54:01.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.632+0000 7f72f004c9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:01.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.632+0000 7f72f004c9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:01.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.632+0000 7f72f004c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:01.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.632+0000 7f72f004c9c0 20 zonegroup default 2024-09-12T00:54:01.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.632+0000 7f72f004c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.632+0000 7f72f004c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:01.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.632+0000 7f72f004c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.626 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.632+0000 7f72f004c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:01.626 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.632+0000 7f72f004c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.626 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.632+0000 7f72f004c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:01.626 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.632+0000 7f72f004c9c0 20 started sync module instance, tier type = 2024-09-12T00:54:01.627 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.632+0000 7f72f004c9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:01.646 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.652+0000 7f72f004c9c0 20 add_watcher() i=0 2024-09-12T00:54:01.647 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.652+0000 7f72f004c9c0 20 add_watcher() i=1 2024-09-12T00:54:01.647 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.652+0000 7f72f004c9c0 20 add_watcher() i=2 2024-09-12T00:54:01.647 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.652+0000 7f72f004c9c0 20 add_watcher() i=3 2024-09-12T00:54:01.647 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.652+0000 7f72f004c9c0 20 add_watcher() i=4 2024-09-12T00:54:01.647 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.652+0000 7f72f004c9c0 20 add_watcher() i=5 2024-09-12T00:54:01.647 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.652+0000 7f72f004c9c0 20 add_watcher() i=6 2024-09-12T00:54:01.648 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.656+0000 7f72f004c9c0 20 add_watcher() i=7 2024-09-12T00:54:01.648 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.656+0000 7f72f004c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:01.651 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.656+0000 7f719f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:01.652 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.656+0000 7f72f004c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:01.652 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.656+0000 7f72f004c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:01.652 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.656+0000 7f72f004c9c0 5 note: GC not initialized 2024-09-12T00:54:01.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.660+0000 7f719e7fc640 20 reqs_thread_entry: start 2024-09-12T00:54:01.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.660+0000 7f72f004c9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:01.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.660+0000 7f72f004c9c0 20 Filter name: none 2024-09-12T00:54:01.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.660+0000 7f710ffff640 20 reqs_thread_entry: start 2024-09-12T00:54:01.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.660+0000 7f72f004c9c0 20 processing logshard = reshard.0000000000 2024-09-12T00:54:01.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.664+0000 7f72f004c9c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T00:54:01.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.664+0000 7f72f004c9c0 20 processing logshard = reshard.0000000001 2024-09-12T00:54:01.662 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.668+0000 7f72f004c9c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T00:54:01.662 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.668+0000 7f72f004c9c0 20 processing logshard = reshard.0000000002 2024-09-12T00:54:01.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.672+0000 7f72f004c9c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T00:54:01.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.672+0000 7f72f004c9c0 20 processing logshard = reshard.0000000003 2024-09-12T00:54:01.672 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.676+0000 7f72f004c9c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T00:54:01.672 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.676+0000 7f72f004c9c0 20 processing logshard = reshard.0000000004 2024-09-12T00:54:01.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.684+0000 7f72f004c9c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T00:54:01.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.684+0000 7f72f004c9c0 20 processing logshard = reshard.0000000005 2024-09-12T00:54:01.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.688+0000 7f72f004c9c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T00:54:01.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.688+0000 7f72f004c9c0 20 processing logshard = reshard.0000000006 2024-09-12T00:54:01.685 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.692+0000 7f72f004c9c0 20 process_entry resharding a-bucket 2024-09-12T00:54:01.685 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.692+0000 7f72f004c9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:54:01.686 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.692+0000 7f72f004c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.686 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.692+0000 7f72f004c9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:01.686 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.692+0000 7f72f004c9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T00:54:01.686 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.692+0000 7f72f004c9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:54:01.686 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.692+0000 7f72f004c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : miss 2024-09-12T00:54:01.686 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.692+0000 7f72f004c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.687 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.692+0000 7f72f004c9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:54:01.687 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.692+0000 7f72f004c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:54:01.687 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.692+0000 7f72f004c9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:54:01.687 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.692+0000 7f72f004c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:01.687 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.692+0000 7f72f004c9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:01.687 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.692+0000 7f72f004c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T00:54:01.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.704+0000 7f72f004c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:54:01.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.704+0000 7f72f004c9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:54:01.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.704+0000 7f72f004c9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:01.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.704+0000 7f72f004c9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18, ofs0, ns] 2024-09-12T00:54:01.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.704+0000 7f71d17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431586 cookie 94154120321536 notifier 6084 bl.length()=911 2024-09-12T00:54:01.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.704+0000 7f71d17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:54:01.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.704+0000 7f71d17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:54:01.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.704+0000 7f71d17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:01.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.704+0000 7f72f004c9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_sources= new_sources= 2024-09-12T00:54:01.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.704+0000 7f72f004c9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential sources added=[] removed=[] 2024-09-12T00:54:01.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.704+0000 7f72f004c9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_dests= new_dests= 2024-09-12T00:54:01.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.704+0000 7f72f004c9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential dests added=[] removed=[] 2024-09-12T00:54:01.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.708+0000 7f72f004c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.1.0 2024-09-12T00:54:01.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.708+0000 7f72f004c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.1.0 2024-09-12T00:54:01.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.708+0000 7f72f004c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.1.1 2024-09-12T00:54:01.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.708+0000 7f72f004c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.1.1 2024-09-12T00:54:01.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.708+0000 7f72f004c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.0 2024-09-12T00:54:01.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.712+0000 7f72f004c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:01.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.712+0000 7f72f004c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T00:54:01.708 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.712+0000 7f72f004c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:54:01.708 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.712+0000 7f72f004c9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:54:01.708 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.712+0000 7f72f004c9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:01.708 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.712+0000 7f72f004c9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18, ofs0, ns] 2024-09-12T00:54:01.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.716+0000 7f71d17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431587 cookie 94154120321536 notifier 6084 bl.length()=911 2024-09-12T00:54:01.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.716+0000 7f71d17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:54:01.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.716+0000 7f71d17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:54:01.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.716+0000 7f71d17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:01.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.716+0000 7f72f004c9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_sources= new_sources= 2024-09-12T00:54:01.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.716+0000 7f72f004c9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential sources added=[] removed=[] 2024-09-12T00:54:01.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.716+0000 7f72f004c9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_dests= new_dests= 2024-09-12T00:54:01.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.716+0000 7f72f004c9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential dests added=[] removed=[] 2024-09-12T00:54:01.712 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.720+0000 7f72f004c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.0 2024-09-12T00:54:01.713 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.720+0000 7f72f004c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:01.713 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.720+0000 7f72f004c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T00:54:01.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.724+0000 7f72f004c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:54:01.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.724+0000 7f72f004c9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:54:01.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.724+0000 7f72f004c9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:01.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.724+0000 7f72f004c9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18, ofs0, ns] 2024-09-12T00:54:01.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.724+0000 7f71d0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431588 cookie 94154120321536 notifier 6084 bl.length()=879 2024-09-12T00:54:01.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.724+0000 7f71d0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:54:01.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.724+0000 7f71d0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:54:01.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.724+0000 7f71d0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:01.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.724+0000 7f72f004c9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_sources= new_sources= 2024-09-12T00:54:01.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.724+0000 7f72f004c9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential sources added=[] removed=[] 2024-09-12T00:54:01.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.724+0000 7f72f004c9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_dests= new_dests= 2024-09-12T00:54:01.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.724+0000 7f72f004c9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential dests added=[] removed=[] 2024-09-12T00:54:01.720 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.728+0000 7f72f004c9c0 1 execute INFO: reshard of bucket "a-bucket" from 1 shards to 2 shards completed successfully 2024-09-12T00:54:01.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.728+0000 7f72f004c9c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T00:54:01.728 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.732+0000 7f72f004c9c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T00:54:01.728 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.732+0000 7f72f004c9c0 20 processing logshard = reshard.0000000007 2024-09-12T00:54:01.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.740+0000 7f72f004c9c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T00:54:01.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.740+0000 7f72f004c9c0 20 processing logshard = reshard.0000000008 2024-09-12T00:54:01.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.744+0000 7f72f004c9c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T00:54:01.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.744+0000 7f72f004c9c0 20 processing logshard = reshard.0000000009 2024-09-12T00:54:01.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.752+0000 7f72f004c9c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T00:54:01.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.752+0000 7f72f004c9c0 20 processing logshard = reshard.0000000010 2024-09-12T00:54:01.750 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.756+0000 7f72f004c9c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T00:54:01.751 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.756+0000 7f72f004c9c0 20 processing logshard = reshard.0000000011 2024-09-12T00:54:01.757 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.764+0000 7f72f004c9c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T00:54:01.758 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.764+0000 7f72f004c9c0 20 processing logshard = reshard.0000000012 2024-09-12T00:54:01.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.768+0000 7f72f004c9c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T00:54:01.764 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.768+0000 7f72f004c9c0 20 processing logshard = reshard.0000000013 2024-09-12T00:54:01.770 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.776+0000 7f72f004c9c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T00:54:01.770 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.776+0000 7f72f004c9c0 20 processing logshard = reshard.0000000014 2024-09-12T00:54:01.775 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.780+0000 7f72f004c9c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T00:54:01.775 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.780+0000 7f72f004c9c0 20 processing logshard = reshard.0000000015 2024-09-12T00:54:01.782 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.788+0000 7f72f004c9c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T00:54:01.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.788+0000 7f719f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:01.789 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.796+0000 7f72f004c9c0 20 remove_watcher() i=0 2024-09-12T00:54:01.789 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.796+0000 7f72f004c9c0 2 removed watcher, disabling cache 2024-09-12T00:54:01.791 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.796+0000 7f72f004c9c0 20 remove_watcher() i=1 2024-09-12T00:54:01.794 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.800+0000 7f72f004c9c0 20 remove_watcher() i=2 2024-09-12T00:54:01.797 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.804+0000 7f72f004c9c0 20 remove_watcher() i=3 2024-09-12T00:54:01.799 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.804+0000 7f72f004c9c0 20 remove_watcher() i=4 2024-09-12T00:54:01.801 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.808+0000 7f72f004c9c0 20 remove_watcher() i=5 2024-09-12T00:54:01.803 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.808+0000 7f72f004c9c0 20 remove_watcher() i=6 2024-09-12T00:54:01.805 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:01.812+0000 7f72f004c9c0 20 remove_watcher() i=7 2024-09-12T00:54:06.833 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:54:06.868 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:06.868 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:06.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.920+0000 7fdff35829c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:06.915 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.920+0000 7fdff35829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:06.915 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.920+0000 7fdff35829c0 20 realm 2024-09-12T00:54:06.915 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.920+0000 7fdff35829c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:06.915 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.920+0000 7fdff35829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:06.915 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.920+0000 7fdff35829c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:06.915 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.920+0000 7fdff35829c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:06.915 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.920+0000 7fdff35829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:06.915 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.920+0000 7fdff35829c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:06.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.924+0000 7fdff35829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:06.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.924+0000 7fdff35829c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:06.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.924+0000 7fdff35829c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:06.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.924+0000 7fdff35829c0 20 searching for the correct realm 2024-09-12T00:54:06.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.928+0000 7fdff1889640 0 -- 172.21.15.70:0/1011370002 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fdfdc030070 msgr2=0x7fdfdc063d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:06.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.936+0000 7fdff1889640 0 -- 172.21.15.70:0/1011370002 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fdec0080880 msgr2=0x7fdec0082cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:06.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.944+0000 7fdff35829c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:06.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.944+0000 7fdff35829c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:06.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.944+0000 7fdff35829c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:06.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.944+0000 7fdff35829c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:06.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.944+0000 7fdff35829c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:06.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.944+0000 7fdff35829c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:06.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.944+0000 7fdff35829c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:06.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.944+0000 7fdff35829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:06.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.944+0000 7fdff35829c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:06.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.948+0000 7fdff35829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:06.944 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.948+0000 7fdff35829c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:06.944 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.948+0000 7fdff35829c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:06.944 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.948+0000 7fdff35829c0 20 zone default found 2024-09-12T00:54:06.944 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.948+0000 7fdff35829c0 4 Realm: () 2024-09-12T00:54:06.944 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.948+0000 7fdff35829c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:06.944 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.948+0000 7fdff35829c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:06.945 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.948+0000 7fdff35829c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:06.945 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.948+0000 7fdff35829c0 20 zonegroup default 2024-09-12T00:54:06.945 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.948+0000 7fdff35829c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:06.945 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.948+0000 7fdff35829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:06.945 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.948+0000 7fdff35829c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:06.946 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.948+0000 7fdff35829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:06.946 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.948+0000 7fdff35829c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:06.946 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.948+0000 7fdff35829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:06.946 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.948+0000 7fdff35829c0 20 started sync module instance, tier type = 2024-09-12T00:54:06.946 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.948+0000 7fdff35829c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:06.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.964+0000 7fdff35829c0 20 add_watcher() i=0 2024-09-12T00:54:06.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.964+0000 7fdff35829c0 20 add_watcher() i=1 2024-09-12T00:54:06.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.964+0000 7fdff35829c0 20 add_watcher() i=2 2024-09-12T00:54:06.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.964+0000 7fdff35829c0 20 add_watcher() i=3 2024-09-12T00:54:06.960 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.964+0000 7fdff35829c0 20 add_watcher() i=4 2024-09-12T00:54:06.960 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.964+0000 7fdff35829c0 20 add_watcher() i=5 2024-09-12T00:54:06.960 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.964+0000 7fdff35829c0 20 add_watcher() i=6 2024-09-12T00:54:06.960 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.968+0000 7fdff35829c0 20 add_watcher() i=7 2024-09-12T00:54:06.960 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.968+0000 7fdff35829c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:06.963 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.968+0000 7fdea6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:06.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.968+0000 7fdff35829c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:06.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.968+0000 7fdff35829c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:06.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.968+0000 7fdff35829c0 5 note: GC not initialized 2024-09-12T00:54:06.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.968+0000 7fdea5fe3640 20 reqs_thread_entry: start 2024-09-12T00:54:06.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.968+0000 7fdff35829c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:06.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.972+0000 7fdff35829c0 20 Filter name: none 2024-09-12T00:54:06.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.972+0000 7fde9effd640 20 reqs_thread_entry: start 2024-09-12T00:54:06.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.972+0000 7fdff35829c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:06.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.972+0000 7fdff35829c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:06.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.972+0000 7fdff35829c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:06.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.972+0000 7fdff35829c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:54:06.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.972+0000 7fdff35829c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:06.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.972+0000 7fdff35829c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:06.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.976+0000 7fdff35829c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:06.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.976+0000 7fdff35829c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:06.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.976+0000 7fdff35829c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:54:06.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.976+0000 7fdff35829c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:06.971 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.976+0000 7fdea6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:06.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.980+0000 7fdff35829c0 20 remove_watcher() i=0 2024-09-12T00:54:06.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.980+0000 7fdff35829c0 2 removed watcher, disabling cache 2024-09-12T00:54:06.977 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.984+0000 7fdff35829c0 20 remove_watcher() i=1 2024-09-12T00:54:06.980 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.984+0000 7fdff35829c0 20 remove_watcher() i=2 2024-09-12T00:54:06.982 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.988+0000 7fdff35829c0 20 remove_watcher() i=3 2024-09-12T00:54:06.984 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.992+0000 7fdff35829c0 20 remove_watcher() i=4 2024-09-12T00:54:06.985 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.992+0000 7fdff35829c0 20 remove_watcher() i=5 2024-09-12T00:54:06.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.992+0000 7fdff35829c0 20 remove_watcher() i=6 2024-09-12T00:54:06.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:06.996+0000 7fdff35829c0 20 remove_watcher() i=7 2024-09-12T00:54:07.005 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:07.005 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:54:07.005 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: a-bucket id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T00:54:07.005 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:07.005 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: reshard add non empty bucket 2024-09-12T00:54:07.006 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:07.008 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:07.009 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:07.020 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:07.020 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:07.030 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:07.030 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:07.041 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:07.041 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:07.053 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:07.053 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:07.063 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:07.064 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:07.074 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:07.075 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:07.088 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:07.088 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:07.100 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:54:07.133 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:07.134 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:07.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.184+0000 7f13c74889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.184+0000 7f13c74889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.184+0000 7f13c74889c0 20 realm 2024-09-12T00:54:07.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.184+0000 7f13c74889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.184+0000 7f13c74889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.184+0000 7f13c74889c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:07.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.184+0000 7f13c74889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.184+0000 7f13c74889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.184+0000 7f13c74889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.180 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.188+0000 7f13c74889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:07.181 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.188+0000 7f13c74889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.181 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.188+0000 7f13c74889c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:07.182 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.188+0000 7f13c74889c0 20 searching for the correct realm 2024-09-12T00:54:07.185 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.192+0000 7f13c578f640 0 -- 172.21.15.70:0/2891341735 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f13b80c53f0 msgr2=0x7f13b80c5870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:07.402 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.408+0000 7f13c578f640 0 -- 172.21.15.70:0/2891341735 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f13b80c53f0 msgr2=0x7f13b80c5870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:07.414 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.420+0000 7f13c74889c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:07.414 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.420+0000 7f13c74889c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:07.414 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.420+0000 7f13c74889c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:07.414 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.420+0000 7f13c74889c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:07.414 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.420+0000 7f13c74889c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:07.414 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.420+0000 7f13c74889c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:07.414 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.420+0000 7f13c74889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.415 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.420+0000 7f13c74889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.415 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.420+0000 7f13c74889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.415 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.420+0000 7f13c74889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:07.416 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.420+0000 7f13c74889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.424+0000 7f13c74889c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:07.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.424+0000 7f13c74889c0 20 zone default found 2024-09-12T00:54:07.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.424+0000 7f13c74889c0 4 Realm: () 2024-09-12T00:54:07.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.424+0000 7f13c74889c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:07.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.424+0000 7f13c74889c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:07.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.424+0000 7f13c74889c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:07.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.424+0000 7f13c74889c0 20 zonegroup default 2024-09-12T00:54:07.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.424+0000 7f13c74889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.418 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.424+0000 7f13c74889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.418 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.424+0000 7f13c74889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.418 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.424+0000 7f13c74889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.418 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.424+0000 7f13c74889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.424+0000 7f13c74889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.424+0000 7f13c74889c0 20 started sync module instance, tier type = 2024-09-12T00:54:07.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.424+0000 7f13c74889c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:07.443 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.448+0000 7f13c74889c0 20 add_watcher() i=0 2024-09-12T00:54:07.443 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.448+0000 7f13c74889c0 20 add_watcher() i=1 2024-09-12T00:54:07.443 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.448+0000 7f13c74889c0 20 add_watcher() i=2 2024-09-12T00:54:07.443 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.448+0000 7f13c74889c0 20 add_watcher() i=3 2024-09-12T00:54:07.443 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.448+0000 7f13c74889c0 20 add_watcher() i=4 2024-09-12T00:54:07.443 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.448+0000 7f13c74889c0 20 add_watcher() i=5 2024-09-12T00:54:07.444 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.448+0000 7f13c74889c0 20 add_watcher() i=6 2024-09-12T00:54:07.445 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.452+0000 7f13c74889c0 20 add_watcher() i=7 2024-09-12T00:54:07.445 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.452+0000 7f13c74889c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:07.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.456+0000 7f127afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:07.449 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.456+0000 7f13c74889c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:07.449 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.456+0000 7f13c74889c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:07.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.456+0000 7f13c74889c0 5 note: GC not initialized 2024-09-12T00:54:07.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.456+0000 7f1279fe3640 20 reqs_thread_entry: start 2024-09-12T00:54:07.451 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.456+0000 7f13c74889c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:07.451 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.456+0000 7f13c74889c0 20 Filter name: none 2024-09-12T00:54:07.451 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.456+0000 7f11eb7fe640 20 reqs_thread_entry: start 2024-09-12T00:54:07.451 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.456+0000 7f13c74889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.452 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.456+0000 7f13c74889c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:07.452 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.456+0000 7f13c74889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.453 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.460+0000 7f13c74889c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:54:07.453 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.460+0000 7f13c74889c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:07.453 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.460+0000 7f13c74889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.454 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.460+0000 7f13c74889c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:07.454 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.460+0000 7f13c74889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.454 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.460+0000 7f13c74889c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:54:07.455 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.460+0000 7f13c74889c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:07.457 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.464+0000 7f127afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:07.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.468+0000 7f13c74889c0 20 remove_watcher() i=0 2024-09-12T00:54:07.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.468+0000 7f13c74889c0 2 removed watcher, disabling cache 2024-09-12T00:54:07.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.472+0000 7f13c74889c0 20 remove_watcher() i=1 2024-09-12T00:54:07.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.472+0000 7f13c74889c0 20 remove_watcher() i=2 2024-09-12T00:54:07.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.476+0000 7f13c74889c0 20 remove_watcher() i=3 2024-09-12T00:54:07.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.476+0000 7f13c74889c0 20 remove_watcher() i=4 2024-09-12T00:54:07.473 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.480+0000 7f13c74889c0 20 remove_watcher() i=5 2024-09-12T00:54:07.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.480+0000 7f13c74889c0 20 remove_watcher() i=6 2024-09-12T00:54:07.477 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.484+0000 7f13c74889c0 20 remove_watcher() i=7 2024-09-12T00:54:07.492 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:07.492 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:54:07.492 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: a-bucket id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 num_objects: 8 size_kb: 1 num_shards: 2 2024-09-12T00:54:07.492 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:07.492 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 3 2024-09-12T00:54:07.526 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:07.526 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:07.570 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.576+0000 7f0b6a8e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.573 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.580+0000 7f0b6a8e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.573 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.580+0000 7f0b6a8e09c0 20 realm 2024-09-12T00:54:07.573 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.580+0000 7f0b6a8e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.573 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.580+0000 7f0b6a8e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.573 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.580+0000 7f0b6a8e09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:07.573 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.580+0000 7f0b6a8e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.573 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.580+0000 7f0b6a8e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.573 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.580+0000 7f0b6a8e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.575 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.580+0000 7f0b6a8e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:07.575 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.580+0000 7f0b6a8e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.576 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.580+0000 7f0b6a8e09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:07.576 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.580+0000 7f0b6a8e09c0 20 searching for the correct realm 2024-09-12T00:54:07.580 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.584+0000 7f0b68be7640 0 -- 172.21.15.70:0/1178681097 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f0b5c04a040 msgr2=0x7f0b5c03a460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:07.589 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.596+0000 7f0b68be7640 0 -- 172.21.15.70:0/1178681097 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f0a30080800 msgr2=0x7f0a30082c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:07.596 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.604+0000 7f0b6a8e09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:07.596 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.604+0000 7f0b6a8e09c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:07.597 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.604+0000 7f0b6a8e09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:07.597 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.604+0000 7f0b6a8e09c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:07.597 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.604+0000 7f0b6a8e09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:07.597 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.604+0000 7f0b6a8e09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:07.597 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.604+0000 7f0b6a8e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.597 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.604+0000 7f0b6a8e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.597 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.604+0000 7f0b6a8e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.598 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.604+0000 7f0b6a8e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:07.598 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.604+0000 7f0b6a8e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.598 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.604+0000 7f0b6a8e09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:07.598 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.604+0000 7f0b6a8e09c0 20 zone default found 2024-09-12T00:54:07.598 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.604+0000 7f0b6a8e09c0 4 Realm: () 2024-09-12T00:54:07.598 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.604+0000 7f0b6a8e09c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:07.598 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.604+0000 7f0b6a8e09c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:07.598 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.604+0000 7f0b6a8e09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:07.598 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.604+0000 7f0b6a8e09c0 20 zonegroup default 2024-09-12T00:54:07.599 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.604+0000 7f0b6a8e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.599 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.604+0000 7f0b6a8e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.599 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.604+0000 7f0b6a8e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.599 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.604+0000 7f0b6a8e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.599 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.604+0000 7f0b6a8e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.599 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.604+0000 7f0b6a8e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.600 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.604+0000 7f0b6a8e09c0 20 started sync module instance, tier type = 2024-09-12T00:54:07.600 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.604+0000 7f0b6a8e09c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:07.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.620+0000 7f0b6a8e09c0 20 add_watcher() i=0 2024-09-12T00:54:07.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.620+0000 7f0b6a8e09c0 20 add_watcher() i=1 2024-09-12T00:54:07.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.620+0000 7f0b6a8e09c0 20 add_watcher() i=2 2024-09-12T00:54:07.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.620+0000 7f0b6a8e09c0 20 add_watcher() i=3 2024-09-12T00:54:07.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.620+0000 7f0b6a8e09c0 20 add_watcher() i=4 2024-09-12T00:54:07.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.620+0000 7f0b6a8e09c0 20 add_watcher() i=5 2024-09-12T00:54:07.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.620+0000 7f0b6a8e09c0 20 add_watcher() i=6 2024-09-12T00:54:07.616 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.620+0000 7f0b6a8e09c0 20 add_watcher() i=7 2024-09-12T00:54:07.616 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.620+0000 7f0b6a8e09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:07.618 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.624+0000 7f0a1efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:07.618 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.624+0000 7f0b6a8e09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:07.619 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.624+0000 7f0b6a8e09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:07.619 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.624+0000 7f0b6a8e09c0 5 note: GC not initialized 2024-09-12T00:54:07.620 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.624+0000 7f0a1dfdb640 20 reqs_thread_entry: start 2024-09-12T00:54:07.620 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.624+0000 7f0b6a8e09c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:07.620 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.624+0000 7f0b6a8e09c0 20 Filter name: none 2024-09-12T00:54:07.620 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.624+0000 7f098f7fe640 20 reqs_thread_entry: start 2024-09-12T00:54:07.620 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.624+0000 7f0b6a8e09c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:54:07.620 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.624+0000 7f0b6a8e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.620 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.628+0000 7f0b6a8e09c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:07.621 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.628+0000 7f0b6a8e09c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:54:07.621 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.628+0000 7f0b6a8e09c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:54:07.621 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.628+0000 7f0b6a8e09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : miss 2024-09-12T00:54:07.621 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.628+0000 7f0b6a8e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.621 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.628+0000 7f0b6a8e09c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:54:07.621 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.628+0000 7f0b6a8e09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:54:07.622 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.628+0000 7f0b6a8e09c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:54:07.622 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.628+0000 7f0b6a8e09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:07.622 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.628+0000 7f0b6a8e09c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:07.622 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.628+0000 7f0b6a8e09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T00:54:07.624 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.632+0000 7f0a1efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:07.629 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.636+0000 7f0b6a8e09c0 20 remove_watcher() i=0 2024-09-12T00:54:07.629 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.636+0000 7f0b6a8e09c0 2 removed watcher, disabling cache 2024-09-12T00:54:07.631 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.636+0000 7f0b6a8e09c0 20 remove_watcher() i=1 2024-09-12T00:54:07.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.640+0000 7f0b6a8e09c0 20 remove_watcher() i=2 2024-09-12T00:54:07.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.640+0000 7f0b6a8e09c0 20 remove_watcher() i=3 2024-09-12T00:54:07.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.644+0000 7f0b6a8e09c0 20 remove_watcher() i=4 2024-09-12T00:54:07.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.644+0000 7f0b6a8e09c0 20 remove_watcher() i=5 2024-09-12T00:54:07.640 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.648+0000 7f0b6a8e09c0 20 remove_watcher() i=6 2024-09-12T00:54:07.641 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.648+0000 7f0b6a8e09c0 20 remove_watcher() i=7 2024-09-12T00:54:07.655 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin reshard list 2024-09-12T00:54:07.679 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:07.679 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:07.721 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.728+0000 7fb22bb3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.728+0000 7fb22bb3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.728+0000 7fb22bb3e9c0 20 realm 2024-09-12T00:54:07.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.728+0000 7fb22bb3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.728+0000 7fb22bb3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.728+0000 7fb22bb3e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:07.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.728+0000 7fb22bb3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.728+0000 7fb22bb3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.728+0000 7fb22bb3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.725 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.732+0000 7fb22bb3e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:07.725 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.732+0000 7fb22bb3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.732+0000 7fb22bb3e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:07.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.732+0000 7fb22bb3e9c0 20 searching for the correct realm 2024-09-12T00:54:07.730 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.736+0000 7fb229e45640 0 -- 172.21.15.70:0/2744100714 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fb220013030 msgr2=0x7fb220034410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:07.737 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.744+0000 7fb229e45640 0 -- 172.21.15.70:0/2744100714 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fb0f4080880 msgr2=0x7fb0f4082cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:07.744 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.752+0000 7fb22bb3e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:07.744 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.752+0000 7fb22bb3e9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:07.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.752+0000 7fb22bb3e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:07.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.752+0000 7fb22bb3e9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:07.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.752+0000 7fb22bb3e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:07.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.752+0000 7fb22bb3e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:07.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.752+0000 7fb22bb3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.752+0000 7fb22bb3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.752+0000 7fb22bb3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.752+0000 7fb22bb3e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:07.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.752+0000 7fb22bb3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.752+0000 7fb22bb3e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:07.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.752+0000 7fb22bb3e9c0 20 zone default found 2024-09-12T00:54:07.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.752+0000 7fb22bb3e9c0 4 Realm: () 2024-09-12T00:54:07.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.752+0000 7fb22bb3e9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:07.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.752+0000 7fb22bb3e9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:07.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.752+0000 7fb22bb3e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:07.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.752+0000 7fb22bb3e9c0 20 zonegroup default 2024-09-12T00:54:07.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.752+0000 7fb22bb3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.752+0000 7fb22bb3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.752+0000 7fb22bb3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.752+0000 7fb22bb3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.752+0000 7fb22bb3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.752+0000 7fb22bb3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.752+0000 7fb22bb3e9c0 20 started sync module instance, tier type = 2024-09-12T00:54:07.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.752+0000 7fb22bb3e9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:07.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.768+0000 7fb22bb3e9c0 20 add_watcher() i=0 2024-09-12T00:54:07.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.768+0000 7fb22bb3e9c0 20 add_watcher() i=1 2024-09-12T00:54:07.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.768+0000 7fb22bb3e9c0 20 add_watcher() i=2 2024-09-12T00:54:07.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.768+0000 7fb22bb3e9c0 20 add_watcher() i=3 2024-09-12T00:54:07.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.768+0000 7fb22bb3e9c0 20 add_watcher() i=4 2024-09-12T00:54:07.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.768+0000 7fb22bb3e9c0 20 add_watcher() i=5 2024-09-12T00:54:07.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.768+0000 7fb22bb3e9c0 20 add_watcher() i=6 2024-09-12T00:54:07.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.768+0000 7fb22bb3e9c0 20 add_watcher() i=7 2024-09-12T00:54:07.764 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.768+0000 7fb22bb3e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:07.766 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.772+0000 7fb0df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:07.767 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.772+0000 7fb22bb3e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:07.767 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.772+0000 7fb22bb3e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:07.767 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.772+0000 7fb22bb3e9c0 5 note: GC not initialized 2024-09-12T00:54:07.767 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.772+0000 7fb0de7e4640 20 reqs_thread_entry: start 2024-09-12T00:54:07.767 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.772+0000 7fb22bb3e9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:07.767 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.772+0000 7fb22bb3e9c0 20 Filter name: none 2024-09-12T00:54:07.767 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.772+0000 7fb04ffff640 20 reqs_thread_entry: start 2024-09-12T00:54:07.776 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.780+0000 7fb0df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:07.780 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.788+0000 7fb22bb3e9c0 20 remove_watcher() i=0 2024-09-12T00:54:07.780 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.788+0000 7fb22bb3e9c0 2 removed watcher, disabling cache 2024-09-12T00:54:07.782 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.788+0000 7fb22bb3e9c0 20 remove_watcher() i=1 2024-09-12T00:54:07.784 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.792+0000 7fb22bb3e9c0 20 remove_watcher() i=2 2024-09-12T00:54:07.786 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.792+0000 7fb22bb3e9c0 20 remove_watcher() i=3 2024-09-12T00:54:07.788 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.796+0000 7fb22bb3e9c0 20 remove_watcher() i=4 2024-09-12T00:54:07.789 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.796+0000 7fb22bb3e9c0 20 remove_watcher() i=5 2024-09-12T00:54:07.791 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.796+0000 7fb22bb3e9c0 20 remove_watcher() i=6 2024-09-12T00:54:07.792 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.796+0000 7fb22bb3e9c0 20 remove_watcher() i=7 2024-09-12T00:54:07.805 INFO:tasks.workunit.client.0.smithi070.stderr:bucket name a-bucket 2024-09-12T00:54:07.805 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: reshard process non empty bucket 2024-09-12T00:54:07.805 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:07.806 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin reshard process 2024-09-12T00:54:07.829 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:07.830 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:07.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.876+0000 7fbcaefab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.880+0000 7fbcaefab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.880+0000 7fbcaefab9c0 20 realm 2024-09-12T00:54:07.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.880+0000 7fbcaefab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.880+0000 7fbcaefab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.874 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.880+0000 7fbcaefab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:07.874 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.880+0000 7fbcaefab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.874 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.880+0000 7fbcaefab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.874 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.880+0000 7fbcaefab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.880+0000 7fbcaefab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:07.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.880+0000 7fbcaefab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.880+0000 7fbcaefab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:07.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.880+0000 7fbcaefab9c0 20 searching for the correct realm 2024-09-12T00:54:07.881 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.888+0000 7fbcad2b2640 0 -- 172.21.15.70:0/2429570497 >> [v2:172.21.15.70:6808/276433067,v1:172.21.15.70:6809/276433067] conn(0x5557234a9a10 msgr2=0x5557234abed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:07.890 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.896+0000 7fbcacab1640 0 -- 172.21.15.70:0/2429570497 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7fbca401e410 msgr2=0x7fbca401e830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:07.896 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.900+0000 7fbcaefab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:07.896 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.900+0000 7fbcaefab9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:07.896 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.900+0000 7fbcaefab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:07.896 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.900+0000 7fbcaefab9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:07.896 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.900+0000 7fbcaefab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:07.896 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.900+0000 7fbcaefab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:07.896 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.900+0000 7fbcaefab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.896 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.900+0000 7fbcaefab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.897 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.900+0000 7fbcaefab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.897 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.904+0000 7fbcaefab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:07.898 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.904+0000 7fbcaefab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.898 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.904+0000 7fbcaefab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:07.898 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.904+0000 7fbcaefab9c0 20 zone default found 2024-09-12T00:54:07.898 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.904+0000 7fbcaefab9c0 4 Realm: () 2024-09-12T00:54:07.898 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.904+0000 7fbcaefab9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:07.898 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.904+0000 7fbcaefab9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:07.898 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.904+0000 7fbcaefab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:07.898 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.904+0000 7fbcaefab9c0 20 zonegroup default 2024-09-12T00:54:07.898 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.904+0000 7fbcaefab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.898 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.904+0000 7fbcaefab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.898 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.904+0000 7fbcaefab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.904+0000 7fbcaefab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.904+0000 7fbcaefab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.904+0000 7fbcaefab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.904+0000 7fbcaefab9c0 20 started sync module instance, tier type = 2024-09-12T00:54:07.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.904+0000 7fbcaefab9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:07.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.920+0000 7fbcaefab9c0 20 add_watcher() i=0 2024-09-12T00:54:07.914 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.920+0000 7fbcaefab9c0 20 add_watcher() i=1 2024-09-12T00:54:07.914 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.920+0000 7fbcaefab9c0 20 add_watcher() i=2 2024-09-12T00:54:07.914 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.920+0000 7fbcaefab9c0 20 add_watcher() i=3 2024-09-12T00:54:07.914 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.920+0000 7fbcaefab9c0 20 add_watcher() i=4 2024-09-12T00:54:07.914 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.920+0000 7fbcaefab9c0 20 add_watcher() i=5 2024-09-12T00:54:07.914 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.920+0000 7fbcaefab9c0 20 add_watcher() i=6 2024-09-12T00:54:07.914 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.920+0000 7fbcaefab9c0 20 add_watcher() i=7 2024-09-12T00:54:07.914 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.920+0000 7fbcaefab9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:07.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.924+0000 7fbb62fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:07.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.924+0000 7fbcaefab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:07.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.924+0000 7fbcaefab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:07.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.924+0000 7fbcaefab9c0 5 note: GC not initialized 2024-09-12T00:54:07.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.924+0000 7fbb61fe3640 20 reqs_thread_entry: start 2024-09-12T00:54:07.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.924+0000 7fbcaefab9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:07.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.924+0000 7fbcaefab9c0 20 Filter name: none 2024-09-12T00:54:07.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.924+0000 7fbad37fe640 20 reqs_thread_entry: start 2024-09-12T00:54:07.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.924+0000 7fbcaefab9c0 20 processing logshard = reshard.0000000000 2024-09-12T00:54:07.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.928+0000 7fbcaefab9c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T00:54:07.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.928+0000 7fbcaefab9c0 20 processing logshard = reshard.0000000001 2024-09-12T00:54:07.927 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.932+0000 7fbcaefab9c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T00:54:07.927 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.932+0000 7fbcaefab9c0 20 processing logshard = reshard.0000000002 2024-09-12T00:54:07.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.936+0000 7fbcaefab9c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T00:54:07.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.936+0000 7fbcaefab9c0 20 processing logshard = reshard.0000000003 2024-09-12T00:54:07.937 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.944+0000 7fbcaefab9c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T00:54:07.937 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.944+0000 7fbcaefab9c0 20 processing logshard = reshard.0000000004 2024-09-12T00:54:07.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.948+0000 7fbcaefab9c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T00:54:07.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.948+0000 7fbcaefab9c0 20 processing logshard = reshard.0000000005 2024-09-12T00:54:07.948 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.952+0000 7fbcaefab9c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T00:54:07.948 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.952+0000 7fbcaefab9c0 20 processing logshard = reshard.0000000006 2024-09-12T00:54:07.950 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.956+0000 7fbcaefab9c0 20 process_entry resharding a-bucket 2024-09-12T00:54:07.950 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.956+0000 7fbcaefab9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:54:07.950 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.956+0000 7fbcaefab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.956+0000 7fbcaefab9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:07.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.956+0000 7fbcaefab9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T00:54:07.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.956+0000 7fbcaefab9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:54:07.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.956+0000 7fbcaefab9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : miss 2024-09-12T00:54:07.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.956+0000 7fbcaefab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.956+0000 7fbcaefab9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:54:07.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.956+0000 7fbcaefab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:54:07.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.956+0000 7fbcaefab9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:54:07.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.956+0000 7fbcaefab9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:07.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.956+0000 7fbcaefab9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:07.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.956+0000 7fbcaefab9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T00:54:07.962 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.968+0000 7fbcaefab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:54:07.962 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.968+0000 7fbcaefab9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:54:07.962 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.968+0000 7fbcaefab9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:07.962 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.968+0000 7fbcaefab9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18, ofs0, ns] 2024-09-12T00:54:07.963 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.968+0000 7fbb837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431589 cookie 93832742616480 notifier 6177 bl.length()=911 2024-09-12T00:54:07.963 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.968+0000 7fbb837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:54:07.963 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.968+0000 7fbb837fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:54:07.963 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.968+0000 7fbb837fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:07.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.968+0000 7fbcaefab9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_sources= new_sources= 2024-09-12T00:54:07.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.968+0000 7fbcaefab9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential sources added=[] removed=[] 2024-09-12T00:54:07.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.968+0000 7fbcaefab9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_dests= new_dests= 2024-09-12T00:54:07.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.968+0000 7fbcaefab9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential dests added=[] removed=[] 2024-09-12T00:54:07.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.976+0000 7fbcaefab9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.0 2024-09-12T00:54:07.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.976+0000 7fbcaefab9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.0 2024-09-12T00:54:07.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.976+0000 7fbcaefab9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.1 2024-09-12T00:54:07.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.976+0000 7fbcaefab9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.1 2024-09-12T00:54:07.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.976+0000 7fbcaefab9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.2 2024-09-12T00:54:07.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.976+0000 7fbcaefab9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.2 2024-09-12T00:54:07.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.976+0000 7fbcaefab9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.1.0 2024-09-12T00:54:07.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.976+0000 7fbcaefab9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.1.0 2024-09-12T00:54:07.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.976+0000 7fbcaefab9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.1.1 2024-09-12T00:54:07.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.976+0000 7fbcaefab9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.1.1 2024-09-12T00:54:07.972 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.980+0000 7fbcaefab9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:07.972 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.980+0000 7fbcaefab9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T00:54:07.976 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.984+0000 7fbcaefab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:54:07.976 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.984+0000 7fbcaefab9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:54:07.976 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.984+0000 7fbcaefab9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:07.976 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.984+0000 7fbcaefab9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18, ofs0, ns] 2024-09-12T00:54:07.977 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.984+0000 7fbb83fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431590 cookie 93832742616480 notifier 6177 bl.length()=911 2024-09-12T00:54:07.977 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.984+0000 7fbb83fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:54:07.977 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.984+0000 7fbb83fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:54:07.977 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.984+0000 7fbb83fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:07.978 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.984+0000 7fbcaefab9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_sources= new_sources= 2024-09-12T00:54:07.978 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.984+0000 7fbcaefab9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential sources added=[] removed=[] 2024-09-12T00:54:07.978 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.984+0000 7fbcaefab9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_dests= new_dests= 2024-09-12T00:54:07.979 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.984+0000 7fbcaefab9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential dests added=[] removed=[] 2024-09-12T00:54:07.981 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.988+0000 7fbcaefab9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.1.0 2024-09-12T00:54:07.981 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.988+0000 7fbcaefab9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.1.0 2024-09-12T00:54:07.981 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.988+0000 7fbcaefab9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.1.1 2024-09-12T00:54:07.981 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.988+0000 7fbcaefab9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.1.1 2024-09-12T00:54:07.982 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.988+0000 7fbcaefab9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:07.982 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.988+0000 7fbcaefab9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T00:54:07.985 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.992+0000 7fbcaefab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:54:07.985 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.992+0000 7fbcaefab9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:54:07.985 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.992+0000 7fbcaefab9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:07.985 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.992+0000 7fbcaefab9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18, ofs0, ns] 2024-09-12T00:54:07.986 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.992+0000 7fbb837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431591 cookie 93832742616480 notifier 6177 bl.length()=879 2024-09-12T00:54:07.986 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.992+0000 7fbb837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:54:07.986 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.992+0000 7fbb837fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:54:07.986 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.992+0000 7fbb837fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:07.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.992+0000 7fbcaefab9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_sources= new_sources= 2024-09-12T00:54:07.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.992+0000 7fbcaefab9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential sources added=[] removed=[] 2024-09-12T00:54:07.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.992+0000 7fbcaefab9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_dests= new_dests= 2024-09-12T00:54:07.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.992+0000 7fbcaefab9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential dests added=[] removed=[] 2024-09-12T00:54:07.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.996+0000 7fbcaefab9c0 1 execute INFO: reshard of bucket "a-bucket" from 2 shards to 3 shards completed successfully 2024-09-12T00:54:07.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:07.996+0000 7fbcaefab9c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T00:54:07.995 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.000+0000 7fbcaefab9c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T00:54:07.995 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.000+0000 7fbcaefab9c0 20 processing logshard = reshard.0000000007 2024-09-12T00:54:08.000 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.008+0000 7fbcaefab9c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T00:54:08.000 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.008+0000 7fbcaefab9c0 20 processing logshard = reshard.0000000008 2024-09-12T00:54:08.005 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.012+0000 7fbcaefab9c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T00:54:08.005 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.012+0000 7fbcaefab9c0 20 processing logshard = reshard.0000000009 2024-09-12T00:54:08.011 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.016+0000 7fbcaefab9c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T00:54:08.011 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.016+0000 7fbcaefab9c0 20 processing logshard = reshard.0000000010 2024-09-12T00:54:08.014 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.020+0000 7fbcaefab9c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T00:54:08.014 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.020+0000 7fbcaefab9c0 20 processing logshard = reshard.0000000011 2024-09-12T00:54:08.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.024+0000 7fbcaefab9c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T00:54:08.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.024+0000 7fbcaefab9c0 20 processing logshard = reshard.0000000012 2024-09-12T00:54:08.025 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.032+0000 7fbcaefab9c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T00:54:08.025 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.032+0000 7fbcaefab9c0 20 processing logshard = reshard.0000000013 2024-09-12T00:54:08.030 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.036+0000 7fbcaefab9c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T00:54:08.030 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.036+0000 7fbcaefab9c0 20 processing logshard = reshard.0000000014 2024-09-12T00:54:08.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.040+0000 7fbcaefab9c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T00:54:08.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.040+0000 7fbcaefab9c0 20 processing logshard = reshard.0000000015 2024-09-12T00:54:08.039 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.044+0000 7fbcaefab9c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T00:54:08.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.048+0000 7fbb62fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:08.045 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.052+0000 7fbcaefab9c0 20 remove_watcher() i=0 2024-09-12T00:54:08.045 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.052+0000 7fbcaefab9c0 2 removed watcher, disabling cache 2024-09-12T00:54:08.047 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.052+0000 7fbcaefab9c0 20 remove_watcher() i=1 2024-09-12T00:54:08.049 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.056+0000 7fbcaefab9c0 20 remove_watcher() i=2 2024-09-12T00:54:08.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.056+0000 7fbcaefab9c0 20 remove_watcher() i=3 2024-09-12T00:54:08.053 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.060+0000 7fbcaefab9c0 20 remove_watcher() i=4 2024-09-12T00:54:08.054 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.060+0000 7fbcaefab9c0 20 remove_watcher() i=5 2024-09-12T00:54:08.056 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.060+0000 7fbcaefab9c0 20 remove_watcher() i=6 2024-09-12T00:54:08.057 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.064+0000 7fbcaefab9c0 20 remove_watcher() i=7 2024-09-12T00:54:08.072 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:54:08.099 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:08.099 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:08.141 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.148+0000 7f6c3f8da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:08.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.148+0000 7f6c3f8da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:08.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.148+0000 7f6c3f8da9c0 20 realm 2024-09-12T00:54:08.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.148+0000 7f6c3f8da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:08.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.148+0000 7f6c3f8da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:08.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.148+0000 7f6c3f8da9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:08.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.148+0000 7f6c3f8da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:08.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.148+0000 7f6c3f8da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:08.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.148+0000 7f6c3f8da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:08.145 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.152+0000 7f6c3f8da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:08.146 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.152+0000 7f6c3f8da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:08.146 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.152+0000 7f6c3f8da9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:08.146 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.152+0000 7f6c3f8da9c0 20 searching for the correct realm 2024-09-12T00:54:08.150 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.156+0000 7f6c3dbe1640 0 -- 172.21.15.70:0/2051905619 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f6c340d4040 msgr2=0x7f6c340df400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:08.366 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.372+0000 7f6c3dbe1640 0 -- 172.21.15.70:0/2051905619 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f6c340d4040 msgr2=0x7f6c340df400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:08.377 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.384+0000 7f6c3f8da9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:08.377 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.384+0000 7f6c3f8da9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:08.377 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.384+0000 7f6c3f8da9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:08.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.384+0000 7f6c3f8da9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:08.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.384+0000 7f6c3f8da9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:08.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.384+0000 7f6c3f8da9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:08.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.384+0000 7f6c3f8da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:08.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.384+0000 7f6c3f8da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:08.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.384+0000 7f6c3f8da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:08.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.384+0000 7f6c3f8da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:08.379 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.384+0000 7f6c3f8da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:08.379 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.384+0000 7f6c3f8da9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:08.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.384+0000 7f6c3f8da9c0 20 zone default found 2024-09-12T00:54:08.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.384+0000 7f6c3f8da9c0 4 Realm: () 2024-09-12T00:54:08.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.384+0000 7f6c3f8da9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:08.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.384+0000 7f6c3f8da9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:08.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.384+0000 7f6c3f8da9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:08.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.384+0000 7f6c3f8da9c0 20 zonegroup default 2024-09-12T00:54:08.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.384+0000 7f6c3f8da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:08.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.384+0000 7f6c3f8da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:08.381 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.388+0000 7f6c3f8da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:08.381 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.388+0000 7f6c3f8da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:08.381 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.388+0000 7f6c3f8da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:08.382 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.388+0000 7f6c3f8da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:08.382 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.388+0000 7f6c3f8da9c0 20 started sync module instance, tier type = 2024-09-12T00:54:08.382 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.388+0000 7f6c3f8da9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:08.405 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.412+0000 7f6c3f8da9c0 20 add_watcher() i=0 2024-09-12T00:54:08.405 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.412+0000 7f6c3f8da9c0 20 add_watcher() i=1 2024-09-12T00:54:08.405 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.412+0000 7f6c3f8da9c0 20 add_watcher() i=2 2024-09-12T00:54:08.405 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.412+0000 7f6c3f8da9c0 20 add_watcher() i=3 2024-09-12T00:54:08.405 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.412+0000 7f6c3f8da9c0 20 add_watcher() i=4 2024-09-12T00:54:08.406 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.412+0000 7f6c3f8da9c0 20 add_watcher() i=5 2024-09-12T00:54:08.406 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.412+0000 7f6c3f8da9c0 20 add_watcher() i=6 2024-09-12T00:54:08.407 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.412+0000 7f6c3f8da9c0 20 add_watcher() i=7 2024-09-12T00:54:08.407 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.412+0000 7f6c3f8da9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:08.411 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.416+0000 7f6af37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:08.412 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.416+0000 7f6c3f8da9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:08.412 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.416+0000 7f6c3f8da9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:08.412 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.416+0000 7f6c3f8da9c0 5 note: GC not initialized 2024-09-12T00:54:08.413 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.420+0000 7f6af27e4640 20 reqs_thread_entry: start 2024-09-12T00:54:08.413 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.420+0000 7f6c3f8da9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:08.413 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.420+0000 7f6c3f8da9c0 20 Filter name: none 2024-09-12T00:54:08.413 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.420+0000 7f6a63fff640 20 reqs_thread_entry: start 2024-09-12T00:54:08.413 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.420+0000 7f6c3f8da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:08.414 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.420+0000 7f6c3f8da9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:08.414 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.420+0000 7f6c3f8da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:08.415 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.420+0000 7f6c3f8da9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:54:08.416 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.420+0000 7f6c3f8da9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:08.416 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.420+0000 7f6c3f8da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:08.416 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.424+0000 7f6c3f8da9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:08.416 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.424+0000 7f6c3f8da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:08.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.424+0000 7f6c3f8da9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:54:08.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.424+0000 7f6c3f8da9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:08.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.428+0000 7f6af37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:08.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.432+0000 7f6c3f8da9c0 20 remove_watcher() i=0 2024-09-12T00:54:08.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.432+0000 7f6c3f8da9c0 2 removed watcher, disabling cache 2024-09-12T00:54:08.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.432+0000 7f6c3f8da9c0 20 remove_watcher() i=1 2024-09-12T00:54:08.430 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.436+0000 7f6c3f8da9c0 20 remove_watcher() i=2 2024-09-12T00:54:08.432 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.440+0000 7f6c3f8da9c0 20 remove_watcher() i=3 2024-09-12T00:54:08.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.440+0000 7f6c3f8da9c0 20 remove_watcher() i=4 2024-09-12T00:54:08.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.444+0000 7f6c3f8da9c0 20 remove_watcher() i=5 2024-09-12T00:54:08.438 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.444+0000 7f6c3f8da9c0 20 remove_watcher() i=6 2024-09-12T00:54:08.439 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.444+0000 7f6c3f8da9c0 20 remove_watcher() i=7 2024-09-12T00:54:08.455 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:08.456 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:54:08.456 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: a-bucket id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-12T00:54:08.456 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:08.456 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-12T00:54:08.456 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:08.457 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:08.457 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:08.476 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:08.476 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:08.524 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:08.524 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:08.544 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:08.544 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:08.564 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:08.564 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:08.582 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:08.582 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:08.601 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:08.601 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:08.621 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:08.621 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:08.642 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:08.642 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:08.662 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:08.662 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:08.683 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:08.683 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:08.702 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:08.702 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:08.722 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:08.723 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:08.742 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:08.743 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:08.762 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:08.762 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:08.784 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:08.784 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:08.801 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:08.801 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:08.819 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:08.820 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:08.838 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:08.838 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:08.854 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:08.854 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:08.873 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:08.873 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:08.892 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:08.892 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:08.908 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:54:08.942 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:08.942 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:08.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.996+0000 7f2d6d6d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:08.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.996+0000 7f2d6d6d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:08.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.996+0000 7f2d6d6d99c0 20 realm 2024-09-12T00:54:08.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.996+0000 7f2d6d6d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:08.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.996+0000 7f2d6d6d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:08.992 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.996+0000 7f2d6d6d99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:08.992 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.996+0000 7f2d6d6d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:08.992 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.996+0000 7f2d6d6d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:08.992 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:08.996+0000 7f2d6d6d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:08.993 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.000+0000 7f2d6d6d99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:08.993 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.000+0000 7f2d6d6d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:08.994 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.000+0000 7f2d6d6d99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:08.994 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.000+0000 7f2d6d6d99c0 20 searching for the correct realm 2024-09-12T00:54:08.998 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.004+0000 7f2d6b9e0640 0 -- 172.21.15.70:0/1808589068 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f2d600d6020 msgr2=0x7f2d600fe9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:09.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.220+0000 7f2d6b9e0640 0 -- 172.21.15.70:0/1808589068 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f2d600d6020 msgr2=0x7f2d600fe9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:09.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.232+0000 7f2d6d6d99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:09.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.232+0000 7f2d6d6d99c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:09.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.232+0000 7f2d6d6d99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:09.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.232+0000 7f2d6d6d99c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:09.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.232+0000 7f2d6d6d99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:09.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.232+0000 7f2d6d6d99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:09.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.232+0000 7f2d6d6d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.227 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.232+0000 7f2d6d6d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:09.227 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.232+0000 7f2d6d6d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.228 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.232+0000 7f2d6d6d99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:09.228 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.232+0000 7f2d6d6d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.236+0000 7f2d6d6d99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:09.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.236+0000 7f2d6d6d99c0 20 zone default found 2024-09-12T00:54:09.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.236+0000 7f2d6d6d99c0 4 Realm: () 2024-09-12T00:54:09.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.236+0000 7f2d6d6d99c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:09.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.236+0000 7f2d6d6d99c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:09.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.236+0000 7f2d6d6d99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:09.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.236+0000 7f2d6d6d99c0 20 zonegroup default 2024-09-12T00:54:09.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.236+0000 7f2d6d6d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.230 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.236+0000 7f2d6d6d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:09.230 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.236+0000 7f2d6d6d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.230 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.236+0000 7f2d6d6d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:09.230 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.236+0000 7f2d6d6d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.236+0000 7f2d6d6d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:09.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.236+0000 7f2d6d6d99c0 20 started sync module instance, tier type = 2024-09-12T00:54:09.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.236+0000 7f2d6d6d99c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:09.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.260+0000 7f2d6d6d99c0 20 add_watcher() i=0 2024-09-12T00:54:09.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.260+0000 7f2d6d6d99c0 20 add_watcher() i=1 2024-09-12T00:54:09.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.260+0000 7f2d6d6d99c0 20 add_watcher() i=2 2024-09-12T00:54:09.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.260+0000 7f2d6d6d99c0 20 add_watcher() i=3 2024-09-12T00:54:09.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.260+0000 7f2d6d6d99c0 20 add_watcher() i=4 2024-09-12T00:54:09.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.260+0000 7f2d6d6d99c0 20 add_watcher() i=5 2024-09-12T00:54:09.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.260+0000 7f2d6d6d99c0 20 add_watcher() i=6 2024-09-12T00:54:09.257 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.264+0000 7f2d6d6d99c0 20 add_watcher() i=7 2024-09-12T00:54:09.257 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.264+0000 7f2d6d6d99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:09.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.268+0000 7f2c21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:09.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.268+0000 7f2d6d6d99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:09.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.268+0000 7f2d6d6d99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:09.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.268+0000 7f2d6d6d99c0 5 note: GC not initialized 2024-09-12T00:54:09.264 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.268+0000 7f2c20fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:09.264 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.268+0000 7f2d6d6d99c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:09.264 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.268+0000 7f2d6d6d99c0 20 Filter name: none 2024-09-12T00:54:09.264 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.268+0000 7f2b9a7fc640 20 reqs_thread_entry: start 2024-09-12T00:54:09.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.272+0000 7f2d6d6d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.272+0000 7f2d6d6d99c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:54:09.266 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.272+0000 7f2d6d6d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.267 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.272+0000 7f2d6d6d99c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:54:09.267 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.272+0000 7f2d6d6d99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:09.267 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.272+0000 7f2d6d6d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.276+0000 7f2d6d6d99c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:54:09.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.276+0000 7f2d6d6d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.276+0000 7f2d6d6d99c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:54:09.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.276+0000 7f2d6d6d99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:09.272 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.276+0000 7f2c21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:09.277 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.284+0000 7f2d6d6d99c0 20 remove_watcher() i=0 2024-09-12T00:54:09.277 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.284+0000 7f2d6d6d99c0 2 removed watcher, disabling cache 2024-09-12T00:54:09.279 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.284+0000 7f2d6d6d99c0 20 remove_watcher() i=1 2024-09-12T00:54:09.281 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.288+0000 7f2d6d6d99c0 20 remove_watcher() i=2 2024-09-12T00:54:09.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.288+0000 7f2d6d6d99c0 20 remove_watcher() i=3 2024-09-12T00:54:09.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.292+0000 7f2d6d6d99c0 20 remove_watcher() i=4 2024-09-12T00:54:09.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.292+0000 7f2d6d6d99c0 20 remove_watcher() i=5 2024-09-12T00:54:09.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.296+0000 7f2d6d6d99c0 20 remove_watcher() i=6 2024-09-12T00:54:09.291 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.296+0000 7f2d6d6d99c0 20 remove_watcher() i=7 2024-09-12T00:54:09.311 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:09.311 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:54:09.311 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-init-index id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:54:09.312 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:09.312 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-12T00:54:09.349 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:09.349 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:09.393 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.400+0000 7f33316d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.395 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.400+0000 7f33316d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:09.395 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.400+0000 7f33316d89c0 20 realm 2024-09-12T00:54:09.395 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.400+0000 7f33316d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.395 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.400+0000 7f33316d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:09.395 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.400+0000 7f33316d89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:09.395 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.400+0000 7f33316d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.396 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.400+0000 7f33316d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:09.396 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.400+0000 7f33316d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.397 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.404+0000 7f33316d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:09.397 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.404+0000 7f33316d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.402 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.404+0000 7f33316d89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:09.402 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.404+0000 7f33316d89c0 20 searching for the correct realm 2024-09-12T00:54:09.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.408+0000 7f332f9df640 0 -- 172.21.15.70:0/1106417023 >> [v2:172.21.15.70:6808/276433067,v1:172.21.15.70:6809/276433067] conn(0x55fb86c9e6b0 msgr2=0x55fb86ca0b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:09.411 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.416+0000 7f332f1de640 0 -- 172.21.15.70:0/1106417023 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f332800e040 msgr2=0x7f332808a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:09.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.424+0000 7f33316d89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:09.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.424+0000 7f33316d89c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:09.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.424+0000 7f33316d89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:09.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.424+0000 7f33316d89c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:09.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.424+0000 7f33316d89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:09.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.424+0000 7f33316d89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:09.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.424+0000 7f33316d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.418 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.424+0000 7f33316d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:09.418 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.424+0000 7f33316d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.424+0000 7f33316d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:09.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.424+0000 7f33316d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.424+0000 7f33316d89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:09.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.424+0000 7f33316d89c0 20 zone default found 2024-09-12T00:54:09.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.424+0000 7f33316d89c0 4 Realm: () 2024-09-12T00:54:09.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.424+0000 7f33316d89c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:09.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.424+0000 7f33316d89c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:09.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.424+0000 7f33316d89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:09.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.424+0000 7f33316d89c0 20 zonegroup default 2024-09-12T00:54:09.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.424+0000 7f33316d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.424+0000 7f33316d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:09.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.424+0000 7f33316d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.424+0000 7f33316d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:09.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.424+0000 7f33316d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.424+0000 7f33316d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:09.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.424+0000 7f33316d89c0 20 started sync module instance, tier type = 2024-09-12T00:54:09.421 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.424+0000 7f33316d89c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:09.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.440+0000 7f33316d89c0 20 add_watcher() i=0 2024-09-12T00:54:09.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.440+0000 7f33316d89c0 20 add_watcher() i=1 2024-09-12T00:54:09.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.440+0000 7f33316d89c0 20 add_watcher() i=2 2024-09-12T00:54:09.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.440+0000 7f33316d89c0 20 add_watcher() i=3 2024-09-12T00:54:09.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.440+0000 7f33316d89c0 20 add_watcher() i=4 2024-09-12T00:54:09.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.440+0000 7f33316d89c0 20 add_watcher() i=5 2024-09-12T00:54:09.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.440+0000 7f33316d89c0 20 add_watcher() i=6 2024-09-12T00:54:09.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.444+0000 7f33316d89c0 20 add_watcher() i=7 2024-09-12T00:54:09.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.444+0000 7f33316d89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:09.438 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.444+0000 7f31e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:09.439 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.444+0000 7f33316d89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:09.440 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.444+0000 7f33316d89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:09.440 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.444+0000 7f33316d89c0 5 note: GC not initialized 2024-09-12T00:54:09.440 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.444+0000 7f31e57e2640 20 reqs_thread_entry: start 2024-09-12T00:54:09.440 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.444+0000 7f33316d89c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:09.440 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.444+0000 7f33316d89c0 20 Filter name: none 2024-09-12T00:54:09.440 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.444+0000 7f31de7fc640 20 reqs_thread_entry: start 2024-09-12T00:54:09.440 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.444+0000 7f33316d89c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:54:09.440 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.444+0000 7f33316d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.448+0000 7f33316d89c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:54:09.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.448+0000 7f33316d89c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:54:09.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.448+0000 7f33316d89c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:54:09.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.448+0000 7f33316d89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20 : miss 2024-09-12T00:54:09.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.448+0000 7f33316d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.442 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.448+0000 7f33316d89c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:54:09.442 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.448+0000 7f33316d89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20 info.flags=0x17 2024-09-12T00:54:09.442 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.448+0000 7f33316d89c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20 to cache LRU end 2024-09-12T00:54:09.442 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.448+0000 7f33316d89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:09.442 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.448+0000 7f33316d89c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:09.442 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.448+0000 7f33316d89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20 2024-09-12T00:54:09.443 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.448+0000 7f33316d89c0 -1 Injecting error=-5 at location=init_index 2024-09-12T00:54:09.443 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.448+0000 7f33316d89c0 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-12T00:54:09.446 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.452+0000 7f31e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:09.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.456+0000 7f33316d89c0 20 remove_watcher() i=0 2024-09-12T00:54:09.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.456+0000 7f33316d89c0 2 removed watcher, disabling cache 2024-09-12T00:54:09.452 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.460+0000 7f33316d89c0 20 remove_watcher() i=1 2024-09-12T00:54:09.455 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.460+0000 7f33316d89c0 20 remove_watcher() i=2 2024-09-12T00:54:09.457 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.464+0000 7f33316d89c0 20 remove_watcher() i=3 2024-09-12T00:54:09.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.464+0000 7f33316d89c0 20 remove_watcher() i=4 2024-09-12T00:54:09.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.468+0000 7f33316d89c0 20 remove_watcher() i=5 2024-09-12T00:54:09.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.468+0000 7f33316d89c0 20 remove_watcher() i=6 2024-09-12T00:54:09.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.468+0000 7f33316d89c0 20 remove_watcher() i=7 2024-09-12T00:54:09.477 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:54:09.503 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:09.503 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:09.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.552+0000 7f02660f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.552+0000 7f02660f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:09.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.552+0000 7f02660f49c0 20 realm 2024-09-12T00:54:09.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.552+0000 7f02660f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.552+0000 7f02660f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:09.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.552+0000 7f02660f49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:09.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.552+0000 7f02660f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.552+0000 7f02660f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:09.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.552+0000 7f02660f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.556+0000 7f02660f49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:09.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.556+0000 7f02660f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.556+0000 7f02660f49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:09.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.556+0000 7f02660f49c0 20 searching for the correct realm 2024-09-12T00:54:09.554 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.560+0000 7f02643fb640 0 -- 172.21.15.70:0/265681770 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f0258045040 msgr2=0x7f025800e430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:09.562 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.568+0000 7f0263bfa640 0 -- 172.21.15.70:0/265681770 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f025c0642b0 msgr2=0x7f025c082990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:09.568 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.572+0000 7f02660f49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:09.568 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.572+0000 7f02660f49c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:09.568 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.572+0000 7f02660f49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:09.568 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.572+0000 7f02660f49c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:09.568 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.572+0000 7f02660f49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:09.568 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.572+0000 7f02660f49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:09.568 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.572+0000 7f02660f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.568 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.572+0000 7f02660f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:09.568 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.572+0000 7f02660f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.569 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.576+0000 7f02660f49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:09.569 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.576+0000 7f02660f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.569 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.576+0000 7f02660f49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:09.570 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.576+0000 7f02660f49c0 20 zone default found 2024-09-12T00:54:09.570 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.576+0000 7f02660f49c0 4 Realm: () 2024-09-12T00:54:09.570 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.576+0000 7f02660f49c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:09.570 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.576+0000 7f02660f49c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:09.570 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.576+0000 7f02660f49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:09.570 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.576+0000 7f02660f49c0 20 zonegroup default 2024-09-12T00:54:09.570 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.576+0000 7f02660f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.570 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.576+0000 7f02660f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:09.570 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.576+0000 7f02660f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.571 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.576+0000 7f02660f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:09.571 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.576+0000 7f02660f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.571 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.576+0000 7f02660f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:09.571 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.576+0000 7f02660f49c0 20 started sync module instance, tier type = 2024-09-12T00:54:09.571 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.576+0000 7f02660f49c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:09.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.592+0000 7f02660f49c0 20 add_watcher() i=0 2024-09-12T00:54:09.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.592+0000 7f02660f49c0 20 add_watcher() i=1 2024-09-12T00:54:09.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.592+0000 7f02660f49c0 20 add_watcher() i=2 2024-09-12T00:54:09.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.592+0000 7f02660f49c0 20 add_watcher() i=3 2024-09-12T00:54:09.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.592+0000 7f02660f49c0 20 add_watcher() i=4 2024-09-12T00:54:09.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.592+0000 7f02660f49c0 20 add_watcher() i=5 2024-09-12T00:54:09.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.592+0000 7f02660f49c0 20 add_watcher() i=6 2024-09-12T00:54:09.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.592+0000 7f02660f49c0 20 add_watcher() i=7 2024-09-12T00:54:09.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.592+0000 7f02660f49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:09.588 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.596+0000 7f0119fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:09.589 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.596+0000 7f02660f49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:09.589 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.596+0000 7f02660f49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:09.589 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.596+0000 7f02660f49c0 5 note: GC not initialized 2024-09-12T00:54:09.590 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.596+0000 7f0118fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:09.590 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.596+0000 7f02660f49c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:09.590 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.596+0000 7f02660f49c0 20 Filter name: none 2024-09-12T00:54:09.590 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.596+0000 7f00927fc640 20 reqs_thread_entry: start 2024-09-12T00:54:09.590 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.596+0000 7f02660f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.590 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.596+0000 7f02660f49c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:54:09.591 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.596+0000 7f02660f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.591 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.596+0000 7f02660f49c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:54:09.591 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.596+0000 7f02660f49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:09.591 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.596+0000 7f02660f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.592 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.600+0000 7f02660f49c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:54:09.592 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.600+0000 7f02660f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.593 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.600+0000 7f02660f49c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:54:09.593 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.600+0000 7f02660f49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:09.594 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.600+0000 7f0119fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:09.599 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.604+0000 7f02660f49c0 20 remove_watcher() i=0 2024-09-12T00:54:09.599 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.604+0000 7f02660f49c0 2 removed watcher, disabling cache 2024-09-12T00:54:09.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.608+0000 7f02660f49c0 20 remove_watcher() i=1 2024-09-12T00:54:09.603 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.608+0000 7f02660f49c0 20 remove_watcher() i=2 2024-09-12T00:54:09.605 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.612+0000 7f02660f49c0 20 remove_watcher() i=3 2024-09-12T00:54:09.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.612+0000 7f02660f49c0 20 remove_watcher() i=4 2024-09-12T00:54:09.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.616+0000 7f02660f49c0 20 remove_watcher() i=5 2024-09-12T00:54:09.610 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.616+0000 7f02660f49c0 20 remove_watcher() i=6 2024-09-12T00:54:09.611 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.616+0000 7f02660f49c0 20 remove_watcher() i=7 2024-09-12T00:54:09.624 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:09.624 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:54:09.624 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-init-index id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:54:09.624 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:09.626 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:09.626 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:09.636 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:09.637 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:09.682 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:54:09.714 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:09.714 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:09.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.764+0000 7f7b2226d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.760 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.764+0000 7f7b2226d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:09.760 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.764+0000 7f7b2226d9c0 20 realm 2024-09-12T00:54:09.760 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.764+0000 7f7b2226d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.768+0000 7f7b2226d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:09.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.768+0000 7f7b2226d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:09.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.768+0000 7f7b2226d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.768+0000 7f7b2226d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:09.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.768+0000 7f7b2226d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.768+0000 7f7b2226d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:09.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.768+0000 7f7b2226d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:09.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.768+0000 7f7b2226d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:09.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.768+0000 7f7b2226d9c0 20 searching for the correct realm 2024-09-12T00:54:09.764 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.772+0000 7f7b1fd73640 0 -- 172.21.15.70:0/3163856810 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f7b180cd040 msgr2=0x7f7b180cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:09.980 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:09.984+0000 7f7b1fd73640 0 -- 172.21.15.70:0/3163856810 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f7b08003640 msgr2=0x7f7b180bd440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:10.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.208+0000 7f7b2226d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:10.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.208+0000 7f7b2226d9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:10.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.208+0000 7f7b2226d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:10.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.208+0000 7f7b2226d9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:10.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.208+0000 7f7b2226d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:10.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.208+0000 7f7b2226d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:10.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.208+0000 7f7b2226d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.208+0000 7f7b2226d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:10.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.208+0000 7f7b2226d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.208+0000 7f7b2226d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:10.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.208+0000 7f7b2226d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.208+0000 7f7b2226d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:10.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.208+0000 7f7b2226d9c0 20 zone default found 2024-09-12T00:54:10.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.208+0000 7f7b2226d9c0 4 Realm: () 2024-09-12T00:54:10.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.208+0000 7f7b2226d9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:10.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.208+0000 7f7b2226d9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:10.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.208+0000 7f7b2226d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:10.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.208+0000 7f7b2226d9c0 20 zonegroup default 2024-09-12T00:54:10.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.208+0000 7f7b2226d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.204 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.208+0000 7f7b2226d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:10.204 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.208+0000 7f7b2226d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.204 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.212+0000 7f7b2226d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:10.204 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.212+0000 7f7b2226d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.205 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.212+0000 7f7b2226d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:10.205 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.212+0000 7f7b2226d9c0 20 started sync module instance, tier type = 2024-09-12T00:54:10.205 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.212+0000 7f7b2226d9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:10.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.236+0000 7f7b2226d9c0 20 add_watcher() i=0 2024-09-12T00:54:10.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.236+0000 7f7b2226d9c0 20 add_watcher() i=1 2024-09-12T00:54:10.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.236+0000 7f7b2226d9c0 20 add_watcher() i=2 2024-09-12T00:54:10.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.236+0000 7f7b2226d9c0 20 add_watcher() i=3 2024-09-12T00:54:10.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.236+0000 7f7b2226d9c0 20 add_watcher() i=4 2024-09-12T00:54:10.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.236+0000 7f7b2226d9c0 20 add_watcher() i=5 2024-09-12T00:54:10.230 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.236+0000 7f7b2226d9c0 20 add_watcher() i=6 2024-09-12T00:54:10.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.236+0000 7f7b2226d9c0 20 add_watcher() i=7 2024-09-12T00:54:10.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.236+0000 7f7b2226d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:10.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.240+0000 7f79d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:10.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.240+0000 7f7b2226d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:10.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.240+0000 7f7b2226d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:10.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.240+0000 7f7b2226d9c0 5 note: GC not initialized 2024-09-12T00:54:10.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.244+0000 7f79d4fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:10.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.244+0000 7f7b2226d9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:10.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.244+0000 7f7b2226d9c0 20 Filter name: none 2024-09-12T00:54:10.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.244+0000 7f794e7fc640 20 reqs_thread_entry: start 2024-09-12T00:54:10.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.244+0000 7f7b2226d9c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:54:10.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.244+0000 7f7b2226d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.244+0000 7f7b2226d9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:54:10.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.244+0000 7f7b2226d9c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:54:10.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.244+0000 7f7b2226d9c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:54:10.239 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.244+0000 7f7b2226d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20 : miss 2024-09-12T00:54:10.239 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.244+0000 7f7b2226d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.239 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.244+0000 7f7b2226d9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:54:10.240 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.244+0000 7f7b2226d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20 info.flags=0x17 2024-09-12T00:54:10.240 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.244+0000 7f7b2226d9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20 to cache LRU end 2024-09-12T00:54:10.240 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.244+0000 7f7b2226d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:10.240 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.244+0000 7f7b2226d9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:10.240 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.244+0000 7f7b2226d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20 2024-09-12T00:54:10.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.252+0000 7f7b2226d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20 info.flags=0x17 2024-09-12T00:54:10.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.252+0000 7f7b2226d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20 to cache LRU end 2024-09-12T00:54:10.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.252+0000 7f7b2226d9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:10.248 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.252+0000 7f7b2226d9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20, ofs0, ns] 2024-09-12T00:54:10.248 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.256+0000 7f79feffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431585 cookie 94599388687808 notifier 5981 bl.length()=995 2024-09-12T00:54:10.248 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.256+0000 7f79feffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20 info.flags=0x17 2024-09-12T00:54:10.248 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.256+0000 7f79feffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20 to cache LRU end 2024-09-12T00:54:10.248 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.256+0000 7f79feffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:10.250 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.256+0000 7f7b2226d9c0 20 handle_bi_update(): bucket=:error-at-init-index[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20]): orig_sources= new_sources= 2024-09-12T00:54:10.250 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.256+0000 7f7b2226d9c0 20 handle_bi_update(): bucket=:error-at-init-index[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20]): potential sources added=[] removed=[] 2024-09-12T00:54:10.250 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.256+0000 7f7b2226d9c0 20 handle_bi_update(): bucket=:error-at-init-index[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20]): orig_dests= new_dests= 2024-09-12T00:54:10.250 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.256+0000 7f7b2226d9c0 20 handle_bi_update(): bucket=:error-at-init-index[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20]): potential dests added=[] removed=[] 2024-09-12T00:54:10.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.260+0000 7f7b2226d9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20.1.0 2024-09-12T00:54:10.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.260+0000 7f7b2226d9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20.1.0 2024-09-12T00:54:10.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.260+0000 7f7b2226d9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20.1.1 2024-09-12T00:54:10.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.260+0000 7f7b2226d9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20.1.1 2024-09-12T00:54:10.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.260+0000 7f7b2226d9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20.0 2024-09-12T00:54:10.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.264+0000 7f7b2226d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:10.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.264+0000 7f7b2226d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20 2024-09-12T00:54:10.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.268+0000 7f7b2226d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20 info.flags=0x17 2024-09-12T00:54:10.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.268+0000 7f7b2226d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20 to cache LRU end 2024-09-12T00:54:10.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.268+0000 7f7b2226d9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:10.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.268+0000 7f7b2226d9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20, ofs0, ns] 2024-09-12T00:54:10.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.268+0000 7f79feffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431586 cookie 94599388687808 notifier 5981 bl.length()=995 2024-09-12T00:54:10.264 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.268+0000 7f79feffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20 info.flags=0x17 2024-09-12T00:54:10.264 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.268+0000 7f79feffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20 to cache LRU end 2024-09-12T00:54:10.264 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.268+0000 7f79feffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:10.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.272+0000 7f7b2226d9c0 20 handle_bi_update(): bucket=:error-at-init-index[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20]): orig_sources= new_sources= 2024-09-12T00:54:10.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.272+0000 7f7b2226d9c0 20 handle_bi_update(): bucket=:error-at-init-index[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20]): potential sources added=[] removed=[] 2024-09-12T00:54:10.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.272+0000 7f7b2226d9c0 20 handle_bi_update(): bucket=:error-at-init-index[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20]): orig_dests= new_dests= 2024-09-12T00:54:10.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.272+0000 7f7b2226d9c0 20 handle_bi_update(): bucket=:error-at-init-index[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20]): potential dests added=[] removed=[] 2024-09-12T00:54:10.267 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.272+0000 7f7b2226d9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20.0 2024-09-12T00:54:10.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.276+0000 7f7b2226d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:10.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.276+0000 7f7b2226d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20 2024-09-12T00:54:10.271 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.276+0000 7f7b2226d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20 info.flags=0x17 2024-09-12T00:54:10.271 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.276+0000 7f7b2226d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20 to cache LRU end 2024-09-12T00:54:10.271 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.276+0000 7f7b2226d9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:10.271 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.276+0000 7f7b2226d9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20, ofs0, ns] 2024-09-12T00:54:10.272 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.276+0000 7f79fe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431587 cookie 94599388687808 notifier 5981 bl.length()=963 2024-09-12T00:54:10.272 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.276+0000 7f79fe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20 info.flags=0x17 2024-09-12T00:54:10.272 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.276+0000 7f79fe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20 to cache LRU end 2024-09-12T00:54:10.272 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.276+0000 7f79fe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:10.273 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.280+0000 7f7b2226d9c0 20 handle_bi_update(): bucket=:error-at-init-index[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20]): orig_sources= new_sources= 2024-09-12T00:54:10.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.280+0000 7f7b2226d9c0 20 handle_bi_update(): bucket=:error-at-init-index[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20]): potential sources added=[] removed=[] 2024-09-12T00:54:10.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.280+0000 7f7b2226d9c0 20 handle_bi_update(): bucket=:error-at-init-index[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20]): orig_dests= new_dests= 2024-09-12T00:54:10.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.280+0000 7f7b2226d9c0 20 handle_bi_update(): bucket=:error-at-init-index[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20]): potential dests added=[] removed=[] 2024-09-12T00:54:10.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.280+0000 7f7b2226d9c0 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-12T00:54:10.279 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.284+0000 7f79d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:10.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.292+0000 7f7b2226d9c0 20 remove_watcher() i=0 2024-09-12T00:54:10.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.292+0000 7f7b2226d9c0 2 removed watcher, disabling cache 2024-09-12T00:54:10.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.292+0000 7f7b2226d9c0 20 remove_watcher() i=1 2024-09-12T00:54:10.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.296+0000 7f7b2226d9c0 20 remove_watcher() i=2 2024-09-12T00:54:10.292 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.296+0000 7f7b2226d9c0 20 remove_watcher() i=3 2024-09-12T00:54:10.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.300+0000 7f7b2226d9c0 20 remove_watcher() i=4 2024-09-12T00:54:10.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.304+0000 7f7b2226d9c0 20 remove_watcher() i=5 2024-09-12T00:54:10.300 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.304+0000 7f7b2226d9c0 20 remove_watcher() i=6 2024-09-12T00:54:10.301 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.308+0000 7f7b2226d9c0 20 remove_watcher() i=7 2024-09-12T00:54:10.319 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:54:10.349 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:10.349 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:10.393 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.400+0000 7fc995dc09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.395 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.400+0000 7fc995dc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:10.395 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.400+0000 7fc995dc09c0 20 realm 2024-09-12T00:54:10.395 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.400+0000 7fc995dc09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.395 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.400+0000 7fc995dc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:10.395 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.400+0000 7fc995dc09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:10.395 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.400+0000 7fc995dc09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.395 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.400+0000 7fc995dc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:10.396 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.400+0000 7fc995dc09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.397 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.404+0000 7fc995dc09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:10.397 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.404+0000 7fc995dc09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.397 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.404+0000 7fc995dc09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:10.398 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.404+0000 7fc995dc09c0 20 searching for the correct realm 2024-09-12T00:54:10.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.408+0000 7fc9940c7640 0 -- 172.21.15.70:0/2333109088 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fc988099bb0 msgr2=0x7fc9880963f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:10.409 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.416+0000 7fc9930c5640 0 -- 172.21.15.70:0/2333109088 >> [v2:172.21.15.70:6824/2477739226,v1:172.21.15.70:6825/2477739226] conn(0x55f19bc60530 msgr2=0x55f19bc62920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:10.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.424+0000 7fc995dc09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:10.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.424+0000 7fc995dc09c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:10.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.424+0000 7fc995dc09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:10.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.424+0000 7fc995dc09c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:10.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.424+0000 7fc995dc09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:10.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.424+0000 7fc995dc09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:10.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.424+0000 7fc995dc09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.424+0000 7fc995dc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:10.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.424+0000 7fc995dc09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.418 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.424+0000 7fc995dc09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:10.418 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.424+0000 7fc995dc09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.418 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.424+0000 7fc995dc09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:10.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.424+0000 7fc995dc09c0 20 zone default found 2024-09-12T00:54:10.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.424+0000 7fc995dc09c0 4 Realm: () 2024-09-12T00:54:10.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.424+0000 7fc995dc09c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:10.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.424+0000 7fc995dc09c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:10.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.424+0000 7fc995dc09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:10.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.424+0000 7fc995dc09c0 20 zonegroup default 2024-09-12T00:54:10.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.424+0000 7fc995dc09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.424+0000 7fc995dc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:10.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.424+0000 7fc995dc09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.424+0000 7fc995dc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:10.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.424+0000 7fc995dc09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.424+0000 7fc995dc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:10.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.424+0000 7fc995dc09c0 20 started sync module instance, tier type = 2024-09-12T00:54:10.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.424+0000 7fc995dc09c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:10.437 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.444+0000 7fc995dc09c0 20 add_watcher() i=0 2024-09-12T00:54:10.437 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.444+0000 7fc995dc09c0 20 add_watcher() i=1 2024-09-12T00:54:10.437 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.444+0000 7fc995dc09c0 20 add_watcher() i=2 2024-09-12T00:54:10.437 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.444+0000 7fc995dc09c0 20 add_watcher() i=3 2024-09-12T00:54:10.437 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.444+0000 7fc995dc09c0 20 add_watcher() i=4 2024-09-12T00:54:10.437 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.444+0000 7fc995dc09c0 20 add_watcher() i=5 2024-09-12T00:54:10.437 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.444+0000 7fc995dc09c0 20 add_watcher() i=6 2024-09-12T00:54:10.438 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.444+0000 7fc995dc09c0 20 add_watcher() i=7 2024-09-12T00:54:10.438 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.444+0000 7fc995dc09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:10.440 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.448+0000 7fc849fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:10.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.448+0000 7fc995dc09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:10.442 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.448+0000 7fc995dc09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:10.442 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.448+0000 7fc995dc09c0 5 note: GC not initialized 2024-09-12T00:54:10.442 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.448+0000 7fc848fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:10.442 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.448+0000 7fc995dc09c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:10.442 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.448+0000 7fc995dc09c0 20 Filter name: none 2024-09-12T00:54:10.442 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.448+0000 7fc7c27fc640 20 reqs_thread_entry: start 2024-09-12T00:54:10.442 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.448+0000 7fc995dc09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.442 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.448+0000 7fc995dc09c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:54:10.443 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.448+0000 7fc995dc09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.444 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.448+0000 7fc995dc09c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:54:10.444 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.448+0000 7fc995dc09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:10.444 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.448+0000 7fc995dc09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.445 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.452+0000 7fc995dc09c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:54:10.445 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.452+0000 7fc995dc09c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.446 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.452+0000 7fc995dc09c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:54:10.446 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.452+0000 7fc995dc09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:10.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.452+0000 7fc849fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:10.456 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.460+0000 7fc995dc09c0 20 remove_watcher() i=0 2024-09-12T00:54:10.456 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.460+0000 7fc995dc09c0 2 removed watcher, disabling cache 2024-09-12T00:54:10.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.464+0000 7fc995dc09c0 20 remove_watcher() i=1 2024-09-12T00:54:10.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.464+0000 7fc995dc09c0 20 remove_watcher() i=2 2024-09-12T00:54:10.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.468+0000 7fc995dc09c0 20 remove_watcher() i=3 2024-09-12T00:54:10.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.472+0000 7fc995dc09c0 20 remove_watcher() i=4 2024-09-12T00:54:10.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.472+0000 7fc995dc09c0 20 remove_watcher() i=5 2024-09-12T00:54:10.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.476+0000 7fc995dc09c0 20 remove_watcher() i=6 2024-09-12T00:54:10.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:10.476+0000 7fc995dc09c0 20 remove_watcher() i=7 2024-09-12T00:54:10.484 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:10.484 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:54:10.484 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-init-index id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:54:10.484 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:10.485 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:10.485 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:10.489 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:10.489 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:10.540 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:10.540 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:10.566 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-12T00:54:10.567 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:10.567 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:10.567 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:10.585 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:10.585 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:10.631 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:10.631 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:10.651 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:10.651 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:10.670 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:10.670 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:10.691 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:10.691 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:10.710 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:10.710 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:10.729 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:10.729 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:10.747 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:10.747 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:10.765 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:10.765 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:10.783 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:10.783 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:10.800 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:10.801 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:10.818 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:10.818 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:10.837 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:10.837 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:10.855 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:10.855 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:10.873 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:10.874 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:10.891 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:10.891 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:10.910 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:10.910 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:10.927 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:10.928 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:10.946 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:10.946 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:10.966 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:10.966 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:10.985 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:10.985 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:11.002 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:54:11.034 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:11.035 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:11.079 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.084+0000 7f2be464b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.088+0000 7f2be464b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:11.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.088+0000 7f2be464b9c0 20 realm 2024-09-12T00:54:11.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.088+0000 7f2be464b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.082 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.088+0000 7f2be464b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:11.082 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.088+0000 7f2be464b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:11.082 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.088+0000 7f2be464b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.082 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.088+0000 7f2be464b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:11.082 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.088+0000 7f2be464b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.083 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.088+0000 7f2be464b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:11.083 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.088+0000 7f2be464b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.084 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.088+0000 7f2be464b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:11.084 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.088+0000 7f2be464b9c0 20 searching for the correct realm 2024-09-12T00:54:11.086 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.092+0000 7f2be1950640 0 -- 172.21.15.70:0/2755575222 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7f2bd4017020 msgr2=0x7f2bd405be20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:11.300 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.304+0000 7f2be2151640 0 -- 172.21.15.70:0/2755575222 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f2bdc0cc040 msgr2=0x7f2bdc0079e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:11.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.320+0000 7f2be464b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:11.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.320+0000 7f2be464b9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:11.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.320+0000 7f2be464b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:11.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.320+0000 7f2be464b9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:11.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.320+0000 7f2be464b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:11.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.320+0000 7f2be464b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:11.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.320+0000 7f2be464b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.320+0000 7f2be464b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:11.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.320+0000 7f2be464b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.324+0000 7f2be464b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:11.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.324+0000 7f2be464b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.324+0000 7f2be464b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:11.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.324+0000 7f2be464b9c0 20 zone default found 2024-09-12T00:54:11.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.324+0000 7f2be464b9c0 4 Realm: () 2024-09-12T00:54:11.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.324+0000 7f2be464b9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:11.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.324+0000 7f2be464b9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:11.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.324+0000 7f2be464b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:11.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.324+0000 7f2be464b9c0 20 zonegroup default 2024-09-12T00:54:11.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.324+0000 7f2be464b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.324+0000 7f2be464b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:11.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.324+0000 7f2be464b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.319 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.324+0000 7f2be464b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:11.319 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.324+0000 7f2be464b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.320 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.324+0000 7f2be464b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:11.320 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.324+0000 7f2be464b9c0 20 started sync module instance, tier type = 2024-09-12T00:54:11.320 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.324+0000 7f2be464b9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:11.345 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.352+0000 7f2be464b9c0 20 add_watcher() i=0 2024-09-12T00:54:11.346 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.352+0000 7f2be464b9c0 20 add_watcher() i=1 2024-09-12T00:54:11.346 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.352+0000 7f2be464b9c0 20 add_watcher() i=2 2024-09-12T00:54:11.346 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.352+0000 7f2be464b9c0 20 add_watcher() i=3 2024-09-12T00:54:11.346 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.352+0000 7f2be464b9c0 20 add_watcher() i=4 2024-09-12T00:54:11.346 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.352+0000 7f2be464b9c0 20 add_watcher() i=5 2024-09-12T00:54:11.346 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.352+0000 7f2be464b9c0 20 add_watcher() i=6 2024-09-12T00:54:11.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.352+0000 7f2be464b9c0 20 add_watcher() i=7 2024-09-12T00:54:11.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.352+0000 7f2be464b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:11.353 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.360+0000 7f2a98fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:11.354 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.360+0000 7f2be464b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:11.354 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.360+0000 7f2be464b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:11.354 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.360+0000 7f2be464b9c0 5 note: GC not initialized 2024-09-12T00:54:11.354 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.360+0000 7f2a137fe640 20 reqs_thread_entry: start 2024-09-12T00:54:11.355 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.360+0000 7f2be464b9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:11.355 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.360+0000 7f2be464b9c0 20 Filter name: none 2024-09-12T00:54:11.355 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.360+0000 7f2a117fa640 20 reqs_thread_entry: start 2024-09-12T00:54:11.355 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.360+0000 7f2be464b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.356 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.364+0000 7f2be464b9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:54:11.356 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.364+0000 7f2be464b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.357 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.364+0000 7f2be464b9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:54:11.357 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.364+0000 7f2be464b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:11.357 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.364+0000 7f2be464b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.364+0000 7f2be464b9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:54:11.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.364+0000 7f2be464b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.364+0000 7f2be464b9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:54:11.359 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.364+0000 7f2be464b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:11.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.368+0000 7f2a98fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:11.365 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.372+0000 7f2be464b9c0 20 remove_watcher() i=0 2024-09-12T00:54:11.366 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.372+0000 7f2be464b9c0 2 removed watcher, disabling cache 2024-09-12T00:54:11.368 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.372+0000 7f2be464b9c0 20 remove_watcher() i=1 2024-09-12T00:54:11.370 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.376+0000 7f2be464b9c0 20 remove_watcher() i=2 2024-09-12T00:54:11.372 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.380+0000 7f2be464b9c0 20 remove_watcher() i=3 2024-09-12T00:54:11.374 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.380+0000 7f2be464b9c0 20 remove_watcher() i=4 2024-09-12T00:54:11.375 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.380+0000 7f2be464b9c0 20 remove_watcher() i=5 2024-09-12T00:54:11.377 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.384+0000 7f2be464b9c0 20 remove_watcher() i=6 2024-09-12T00:54:11.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.384+0000 7f2be464b9c0 20 remove_watcher() i=7 2024-09-12T00:54:11.393 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:11.393 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:54:11.393 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-init-index id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:54:11.394 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:11.394 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-12T00:54:11.428 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:11.428 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:11.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.476+0000 7f49d0d889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.476+0000 7f49d0d889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:11.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.476+0000 7f49d0d889c0 20 realm 2024-09-12T00:54:11.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.476+0000 7f49d0d889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.476+0000 7f49d0d889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:11.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.476+0000 7f49d0d889c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:11.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.476+0000 7f49d0d889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.476+0000 7f49d0d889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:11.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.476+0000 7f49d0d889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.473 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.480+0000 7f49d0d889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:11.473 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.480+0000 7f49d0d889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.474 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.480+0000 7f49d0d889c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:11.474 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.480+0000 7f49d0d889c0 20 searching for the correct realm 2024-09-12T00:54:11.479 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.484+0000 7f49cf08f640 0 -- 172.21.15.70:0/533338458 >> [v2:172.21.15.70:6808/276433067,v1:172.21.15.70:6809/276433067] conn(0x55a168087900 msgr2=0x55a168089dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:11.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.492+0000 7f49ce08d640 0 -- 172.21.15.70:0/533338458 >> [v2:172.21.15.70:6816/1979013808,v1:172.21.15.70:6817/1979013808] conn(0x55a16807b120 msgr2=0x55a16807d5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:11.493 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.500+0000 7f49d0d889c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:11.493 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.500+0000 7f49d0d889c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:11.493 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.500+0000 7f49d0d889c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:11.493 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.500+0000 7f49d0d889c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:11.493 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.500+0000 7f49d0d889c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:11.493 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.500+0000 7f49d0d889c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:11.493 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.500+0000 7f49d0d889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.500+0000 7f49d0d889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:11.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.500+0000 7f49d0d889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.500+0000 7f49d0d889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:11.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.500+0000 7f49d0d889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.500+0000 7f49d0d889c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:11.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.500+0000 7f49d0d889c0 20 zone default found 2024-09-12T00:54:11.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.500+0000 7f49d0d889c0 4 Realm: () 2024-09-12T00:54:11.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.500+0000 7f49d0d889c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:11.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.500+0000 7f49d0d889c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:11.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.500+0000 7f49d0d889c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:11.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.500+0000 7f49d0d889c0 20 zonegroup default 2024-09-12T00:54:11.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.500+0000 7f49d0d889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.500+0000 7f49d0d889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:11.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.500+0000 7f49d0d889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.496 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.500+0000 7f49d0d889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:11.496 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.500+0000 7f49d0d889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.496 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.500+0000 7f49d0d889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:11.496 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.500+0000 7f49d0d889c0 20 started sync module instance, tier type = 2024-09-12T00:54:11.496 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.500+0000 7f49d0d889c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:11.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.516+0000 7f49d0d889c0 20 add_watcher() i=0 2024-09-12T00:54:11.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.516+0000 7f49d0d889c0 20 add_watcher() i=1 2024-09-12T00:54:11.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.516+0000 7f49d0d889c0 20 add_watcher() i=2 2024-09-12T00:54:11.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.516+0000 7f49d0d889c0 20 add_watcher() i=3 2024-09-12T00:54:11.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.516+0000 7f49d0d889c0 20 add_watcher() i=4 2024-09-12T00:54:11.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.516+0000 7f49d0d889c0 20 add_watcher() i=5 2024-09-12T00:54:11.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.516+0000 7f49d0d889c0 20 add_watcher() i=6 2024-09-12T00:54:11.512 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.516+0000 7f49d0d889c0 20 add_watcher() i=7 2024-09-12T00:54:11.512 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.516+0000 7f49d0d889c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:11.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.520+0000 7f48857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:11.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.520+0000 7f49d0d889c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:11.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.520+0000 7f49d0d889c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:11.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.520+0000 7f49d0d889c0 5 note: GC not initialized 2024-09-12T00:54:11.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.520+0000 7f47fffff640 20 reqs_thread_entry: start 2024-09-12T00:54:11.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.520+0000 7f49d0d889c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:11.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.520+0000 7f49d0d889c0 20 Filter name: none 2024-09-12T00:54:11.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.520+0000 7f47fdffb640 20 reqs_thread_entry: start 2024-09-12T00:54:11.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.520+0000 7f49d0d889c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:54:11.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.520+0000 7f49d0d889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.516 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.520+0000 7f49d0d889c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:54:11.516 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.520+0000 7f49d0d889c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:54:11.516 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.520+0000 7f49d0d889c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:54:11.516 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.520+0000 7f49d0d889c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21 : miss 2024-09-12T00:54:11.516 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.520+0000 7f49d0d889c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.524+0000 7f49d0d889c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:54:11.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.524+0000 7f49d0d889c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21 info.flags=0x17 2024-09-12T00:54:11.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.524+0000 7f49d0d889c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21 to cache LRU end 2024-09-12T00:54:11.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.524+0000 7f49d0d889c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:11.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.524+0000 7f49d0d889c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:11.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.524+0000 7f49d0d889c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21 2024-09-12T00:54:11.518 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.524+0000 7f49d0d889c0 -1 Injecting error=-95 at location=init_index 2024-09-12T00:54:11.518 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.524+0000 7f49d0d889c0 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-12T00:54:11.523 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.528+0000 7f49d0d889c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21 info.flags=0x17 2024-09-12T00:54:11.523 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.528+0000 7f49d0d889c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21 to cache LRU end 2024-09-12T00:54:11.523 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.528+0000 7f49d0d889c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:11.523 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.528+0000 7f49d0d889c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21, ofs0, ns] 2024-09-12T00:54:11.523 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.528+0000 7f48b27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431590 cookie 94151723434912 notifier 6032 bl.length()=995 2024-09-12T00:54:11.523 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.528+0000 7f48b27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21 info.flags=0x17 2024-09-12T00:54:11.523 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.528+0000 7f48b27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21 to cache LRU end 2024-09-12T00:54:11.524 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.528+0000 7f48b27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:11.524 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.532+0000 7f49d0d889c0 20 handle_bi_update(): bucket=:error-at-init-index[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21]): orig_sources= new_sources= 2024-09-12T00:54:11.524 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.532+0000 7f49d0d889c0 20 handle_bi_update(): bucket=:error-at-init-index[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21]): potential sources added=[] removed=[] 2024-09-12T00:54:11.524 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.532+0000 7f49d0d889c0 20 handle_bi_update(): bucket=:error-at-init-index[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21]): orig_dests= new_dests= 2024-09-12T00:54:11.525 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.532+0000 7f49d0d889c0 20 handle_bi_update(): bucket=:error-at-init-index[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21]): potential dests added=[] removed=[] 2024-09-12T00:54:11.526 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.532+0000 7f49d0d889c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21.1.0 2024-09-12T00:54:11.526 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.532+0000 7f49d0d889c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21.1.0 2024-09-12T00:54:11.526 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.532+0000 7f49d0d889c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21.1.1 2024-09-12T00:54:11.526 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.532+0000 7f49d0d889c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21.1.1 2024-09-12T00:54:11.526 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.532+0000 7f49d0d889c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21.0 2024-09-12T00:54:11.530 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.536+0000 7f49d0d889c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:11.530 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.536+0000 7f49d0d889c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21 2024-09-12T00:54:11.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.536+0000 7f49d0d889c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21 info.flags=0x17 2024-09-12T00:54:11.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.536+0000 7f49d0d889c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21 to cache LRU end 2024-09-12T00:54:11.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.536+0000 7f49d0d889c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:11.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.536+0000 7f49d0d889c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21, ofs0, ns] 2024-09-12T00:54:11.532 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.536+0000 7f48b27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431591 cookie 94151723434912 notifier 6032 bl.length()=963 2024-09-12T00:54:11.532 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.536+0000 7f48b27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21 info.flags=0x17 2024-09-12T00:54:11.532 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.536+0000 7f48b27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21 to cache LRU end 2024-09-12T00:54:11.532 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.536+0000 7f48b27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:11.533 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.540+0000 7f49d0d889c0 20 handle_bi_update(): bucket=:error-at-init-index[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21]): orig_sources= new_sources= 2024-09-12T00:54:11.533 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.540+0000 7f49d0d889c0 20 handle_bi_update(): bucket=:error-at-init-index[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21]): potential sources added=[] removed=[] 2024-09-12T00:54:11.533 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.540+0000 7f49d0d889c0 20 handle_bi_update(): bucket=:error-at-init-index[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21]): orig_dests= new_dests= 2024-09-12T00:54:11.533 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.540+0000 7f49d0d889c0 20 handle_bi_update(): bucket=:error-at-init-index[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21]): potential dests added=[] removed=[] 2024-09-12T00:54:11.534 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.540+0000 7f49d0d889c0 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-12T00:54:11.537 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.544+0000 7f48857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:11.542 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.548+0000 7f49d0d889c0 20 remove_watcher() i=0 2024-09-12T00:54:11.542 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.548+0000 7f49d0d889c0 2 removed watcher, disabling cache 2024-09-12T00:54:11.544 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.548+0000 7f49d0d889c0 20 remove_watcher() i=1 2024-09-12T00:54:11.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.552+0000 7f49d0d889c0 20 remove_watcher() i=2 2024-09-12T00:54:11.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.552+0000 7f49d0d889c0 20 remove_watcher() i=3 2024-09-12T00:54:11.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.556+0000 7f49d0d889c0 20 remove_watcher() i=4 2024-09-12T00:54:11.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.556+0000 7f49d0d889c0 20 remove_watcher() i=5 2024-09-12T00:54:11.551 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.556+0000 7f49d0d889c0 20 remove_watcher() i=6 2024-09-12T00:54:11.553 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.560+0000 7f49d0d889c0 20 remove_watcher() i=7 2024-09-12T00:54:11.566 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:54:11.592 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:11.592 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:11.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.640+0000 7fe04af769c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.640+0000 7fe04af769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:11.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.640+0000 7fe04af769c0 20 realm 2024-09-12T00:54:11.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.640+0000 7fe04af769c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.640+0000 7fe04af769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:11.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.640+0000 7fe04af769c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:11.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.640+0000 7fe04af769c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.640+0000 7fe04af769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:11.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.640+0000 7fe04af769c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.636 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.644+0000 7fe04af769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:11.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.644+0000 7fe04af769c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.644+0000 7fe04af769c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:11.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.644+0000 7fe04af769c0 20 searching for the correct realm 2024-09-12T00:54:11.642 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.648+0000 7fe04927d640 0 -- 172.21.15.70:0/3535675008 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fe03c017040 msgr2=0x7fe03c05da50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:11.650 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.656+0000 7fe048a7c640 0 -- 172.21.15.70:0/3535675008 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7fe040027420 msgr2=0x7fe040027880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:11.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.660+0000 7fe04af769c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:11.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.660+0000 7fe04af769c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:11.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.660+0000 7fe04af769c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:11.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.660+0000 7fe04af769c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:11.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.660+0000 7fe04af769c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:11.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.660+0000 7fe04af769c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:11.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.660+0000 7fe04af769c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.660+0000 7fe04af769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:11.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.660+0000 7fe04af769c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.664+0000 7fe04af769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:11.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.664+0000 7fe04af769c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.664+0000 7fe04af769c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:11.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.664+0000 7fe04af769c0 20 zone default found 2024-09-12T00:54:11.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.664+0000 7fe04af769c0 4 Realm: () 2024-09-12T00:54:11.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.664+0000 7fe04af769c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:11.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.664+0000 7fe04af769c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:11.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.664+0000 7fe04af769c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:11.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.664+0000 7fe04af769c0 20 zonegroup default 2024-09-12T00:54:11.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.664+0000 7fe04af769c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.664+0000 7fe04af769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:11.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.664+0000 7fe04af769c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.664+0000 7fe04af769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:11.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.664+0000 7fe04af769c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.664+0000 7fe04af769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:11.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.664+0000 7fe04af769c0 20 started sync module instance, tier type = 2024-09-12T00:54:11.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.664+0000 7fe04af769c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:11.673 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.680+0000 7fe04af769c0 20 add_watcher() i=0 2024-09-12T00:54:11.673 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.680+0000 7fe04af769c0 20 add_watcher() i=1 2024-09-12T00:54:11.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.680+0000 7fe04af769c0 20 add_watcher() i=2 2024-09-12T00:54:11.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.680+0000 7fe04af769c0 20 add_watcher() i=3 2024-09-12T00:54:11.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.680+0000 7fe04af769c0 20 add_watcher() i=4 2024-09-12T00:54:11.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.680+0000 7fe04af769c0 20 add_watcher() i=5 2024-09-12T00:54:11.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.680+0000 7fe04af769c0 20 add_watcher() i=6 2024-09-12T00:54:11.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.680+0000 7fe04af769c0 20 add_watcher() i=7 2024-09-12T00:54:11.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.680+0000 7fe04af769c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:11.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.684+0000 7fdefefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:11.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.684+0000 7fe04af769c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:11.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.684+0000 7fe04af769c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:11.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.684+0000 7fe04af769c0 5 note: GC not initialized 2024-09-12T00:54:11.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.684+0000 7fdefdfe3640 20 reqs_thread_entry: start 2024-09-12T00:54:11.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.684+0000 7fe04af769c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:11.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.684+0000 7fe04af769c0 20 Filter name: none 2024-09-12T00:54:11.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.684+0000 7fde6f7fe640 20 reqs_thread_entry: start 2024-09-12T00:54:11.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.684+0000 7fe04af769c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.684+0000 7fe04af769c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:54:11.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.684+0000 7fe04af769c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.684+0000 7fe04af769c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:54:11.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.684+0000 7fe04af769c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:11.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.684+0000 7fe04af769c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.688+0000 7fe04af769c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:54:11.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.688+0000 7fe04af769c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:11.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.688+0000 7fe04af769c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:54:11.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.688+0000 7fe04af769c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:11.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.688+0000 7fdefefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:11.686 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.692+0000 7fe04af769c0 20 remove_watcher() i=0 2024-09-12T00:54:11.687 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.692+0000 7fe04af769c0 2 removed watcher, disabling cache 2024-09-12T00:54:11.688 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.696+0000 7fe04af769c0 20 remove_watcher() i=1 2024-09-12T00:54:11.690 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.696+0000 7fe04af769c0 20 remove_watcher() i=2 2024-09-12T00:54:11.692 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.700+0000 7fe04af769c0 20 remove_watcher() i=3 2024-09-12T00:54:11.694 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.700+0000 7fe04af769c0 20 remove_watcher() i=4 2024-09-12T00:54:11.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.700+0000 7fe04af769c0 20 remove_watcher() i=5 2024-09-12T00:54:11.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.704+0000 7fe04af769c0 20 remove_watcher() i=6 2024-09-12T00:54:11.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:11.704+0000 7fe04af769c0 20 remove_watcher() i=7 2024-09-12T00:54:11.711 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:11.711 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:54:11.711 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-init-index id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:54:11.711 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:11.713 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:11.713 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:11.715 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:11.716 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:11.763 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:11.764 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:11.788 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: reshard bucket with abort at init_index 2024-09-12T00:54:11.789 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:11.790 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:11.790 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:11.803 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:11.803 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:11.848 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:11.848 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:11.868 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:11.868 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:11.888 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:11.888 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:11.909 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:11.909 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:11.930 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:11.930 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:11.949 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:11.949 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:11.971 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:11.971 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:11.990 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:11.991 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:12.010 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:12.010 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:12.029 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:12.030 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:12.048 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:12.049 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:12.068 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:12.068 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:12.086 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:12.087 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:12.105 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:12.105 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:12.125 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:12.125 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:12.143 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:12.143 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:12.162 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:12.162 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:12.181 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:12.182 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:12.199 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:12.200 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:12.218 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:12.218 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:12.234 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:54:12.266 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:12.266 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:12.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.316+0000 7f563acd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.320+0000 7f563acd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.320+0000 7f563acd39c0 20 realm 2024-09-12T00:54:12.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.320+0000 7f563acd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.320+0000 7f563acd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.320+0000 7f563acd39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:12.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.320+0000 7f563acd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.320+0000 7f563acd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.320+0000 7f563acd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.320+0000 7f563acd39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:12.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.320+0000 7f563acd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.320+0000 7f563acd39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:12.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.320+0000 7f563acd39c0 20 searching for the correct realm 2024-09-12T00:54:12.319 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.324+0000 7f5638fda640 0 -- 172.21.15.70:0/3312898655 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f563001a040 msgr2=0x7f563005d940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:12.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.336+0000 7f5638fda640 0 -- 172.21.15.70:0/3312898655 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f55000808b0 msgr2=0x7f5500082d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:12.336 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.340+0000 7f563acd39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:12.336 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.340+0000 7f563acd39c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:12.336 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.340+0000 7f563acd39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:12.336 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.340+0000 7f563acd39c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:12.336 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.340+0000 7f563acd39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:12.337 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.340+0000 7f563acd39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:12.337 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.340+0000 7f563acd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.337 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.344+0000 7f563acd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.337 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.344+0000 7f563acd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.337 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.344+0000 7f563acd39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:12.337 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.344+0000 7f563acd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.338 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.344+0000 7f563acd39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:12.338 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.344+0000 7f563acd39c0 20 zone default found 2024-09-12T00:54:12.338 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.344+0000 7f563acd39c0 4 Realm: () 2024-09-12T00:54:12.338 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.344+0000 7f563acd39c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:12.338 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.344+0000 7f563acd39c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:12.338 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.344+0000 7f563acd39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:12.338 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.344+0000 7f563acd39c0 20 zonegroup default 2024-09-12T00:54:12.339 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.344+0000 7f563acd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.339 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.344+0000 7f563acd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.339 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.344+0000 7f563acd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.339 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.344+0000 7f563acd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.339 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.344+0000 7f563acd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.339 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.344+0000 7f563acd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.340 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.344+0000 7f563acd39c0 20 started sync module instance, tier type = 2024-09-12T00:54:12.340 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.344+0000 7f563acd39c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:12.354 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.360+0000 7f563acd39c0 20 add_watcher() i=0 2024-09-12T00:54:12.354 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.360+0000 7f563acd39c0 20 add_watcher() i=1 2024-09-12T00:54:12.354 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.360+0000 7f563acd39c0 20 add_watcher() i=2 2024-09-12T00:54:12.354 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.360+0000 7f563acd39c0 20 add_watcher() i=3 2024-09-12T00:54:12.354 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.360+0000 7f563acd39c0 20 add_watcher() i=4 2024-09-12T00:54:12.354 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.360+0000 7f563acd39c0 20 add_watcher() i=5 2024-09-12T00:54:12.354 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.360+0000 7f563acd39c0 20 add_watcher() i=6 2024-09-12T00:54:12.355 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.360+0000 7f563acd39c0 20 add_watcher() i=7 2024-09-12T00:54:12.355 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.360+0000 7f563acd39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:12.357 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.364+0000 7f54eefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:12.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.364+0000 7f563acd39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:12.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.364+0000 7f563acd39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:12.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.364+0000 7f563acd39c0 5 note: GC not initialized 2024-09-12T00:54:12.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.364+0000 7f54edfdb640 20 reqs_thread_entry: start 2024-09-12T00:54:12.359 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.364+0000 7f563acd39c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:12.359 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.364+0000 7f563acd39c0 20 Filter name: none 2024-09-12T00:54:12.359 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.364+0000 7f545f7fe640 20 reqs_thread_entry: start 2024-09-12T00:54:12.359 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.364+0000 7f563acd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.364+0000 7f563acd39c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:54:12.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.364+0000 7f563acd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.364+0000 7f563acd39c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:54:12.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.364+0000 7f563acd39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:12.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.364+0000 7f563acd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.364+0000 7f563acd39c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:54:12.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.364+0000 7f563acd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.368+0000 7f563acd39c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:54:12.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.368+0000 7f563acd39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:12.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.368+0000 7f54eefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:12.367 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.372+0000 7f563acd39c0 20 remove_watcher() i=0 2024-09-12T00:54:12.367 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.372+0000 7f563acd39c0 2 removed watcher, disabling cache 2024-09-12T00:54:12.368 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.376+0000 7f563acd39c0 20 remove_watcher() i=1 2024-09-12T00:54:12.370 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.376+0000 7f563acd39c0 20 remove_watcher() i=2 2024-09-12T00:54:12.373 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.380+0000 7f563acd39c0 20 remove_watcher() i=3 2024-09-12T00:54:12.374 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.380+0000 7f563acd39c0 20 remove_watcher() i=4 2024-09-12T00:54:12.375 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.380+0000 7f563acd39c0 20 remove_watcher() i=5 2024-09-12T00:54:12.377 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.384+0000 7f563acd39c0 20 remove_watcher() i=6 2024-09-12T00:54:12.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.384+0000 7f563acd39c0 20 remove_watcher() i=7 2024-09-12T00:54:12.391 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.391 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:54:12.391 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: abort-at-init-indext id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:54:12.392 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.392 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-12T00:54:12.424 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:12.424 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:12.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.472+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.472+0000 7fee07cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.472+0000 7fee07cd69c0 20 realm 2024-09-12T00:54:12.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.472+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.472+0000 7fee07cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.472+0000 7fee07cd69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:12.468 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.472+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.468 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.472+0000 7fee07cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.468 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.472+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.476+0000 7fee07cd69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:12.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.476+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.476+0000 7fee07cd69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:12.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.476+0000 7fee07cd69c0 20 searching for the correct realm 2024-09-12T00:54:12.474 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.480+0000 7fee05fdd640 0 -- 172.21.15.70:0/448923671 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fedf80f7bf0 msgr2=0x7fedf8100a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:12.691 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.696+0000 7fee05fdd640 0 -- 172.21.15.70:0/448923671 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fedf80f7bf0 msgr2=0x7fedf8100a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:12.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:12.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:12.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:12.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:12.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:12.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:12.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:12.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:12.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 zone default found 2024-09-12T00:54:12.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.712+0000 7fee07cd69c0 4 Realm: () 2024-09-12T00:54:12.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.712+0000 7fee07cd69c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:12.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.712+0000 7fee07cd69c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:12.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.712+0000 7fee07cd69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:12.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 zonegroup default 2024-09-12T00:54:12.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 started sync module instance, tier type = 2024-09-12T00:54:12.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:12.730 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.736+0000 7fee07cd69c0 20 add_watcher() i=0 2024-09-12T00:54:12.730 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.736+0000 7fee07cd69c0 20 add_watcher() i=1 2024-09-12T00:54:12.730 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.736+0000 7fee07cd69c0 20 add_watcher() i=2 2024-09-12T00:54:12.730 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.736+0000 7fee07cd69c0 20 add_watcher() i=3 2024-09-12T00:54:12.730 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.736+0000 7fee07cd69c0 20 add_watcher() i=4 2024-09-12T00:54:12.731 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.736+0000 7fee07cd69c0 20 add_watcher() i=5 2024-09-12T00:54:12.731 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.736+0000 7fee07cd69c0 20 add_watcher() i=6 2024-09-12T00:54:12.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.740+0000 7fee07cd69c0 20 add_watcher() i=7 2024-09-12T00:54:12.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.740+0000 7fee07cd69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:12.736 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.744+0000 7fecbbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:12.737 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.744+0000 7fee07cd69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:12.737 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.744+0000 7fee07cd69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:12.737 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 note: GC not initialized 2024-09-12T00:54:12.738 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.744+0000 7fecbafe5640 20 reqs_thread_entry: start 2024-09-12T00:54:12.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.744+0000 7fee07cd69c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:12.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.744+0000 7fee07cd69c0 20 Filter name: none 2024-09-12T00:54:12.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.744+0000 7fecb8fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:12.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.744+0000 7fee07cd69c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:54:12.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.744+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.744+0000 7fee07cd69c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:54:12.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.744+0000 7fee07cd69c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:54:12.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.744+0000 7fee07cd69c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:54:12.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.744+0000 7fee07cd69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 : miss 2024-09-12T00:54:12.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.744+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.744+0000 7fee07cd69c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:54:12.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.744+0000 7fee07cd69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 info.flags=0x17 2024-09-12T00:54:12.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.744+0000 7fee07cd69c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 to cache LRU end 2024-09-12T00:54:12.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.744+0000 7fee07cd69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:12.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.744+0000 7fee07cd69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:12.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.744+0000 7fee07cd69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 2024-09-12T00:54:12.743 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fee07cd69c0 time 2024-09-12T00:54:12.753413+0000 2024-09-12T00:54:12.743 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:12.746 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:12.746 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fee0b5b02eb] 2024-09-12T00:54:12.746 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fee0b5b049f] 2024-09-12T00:54:12.746 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ebe23c1cc1] 2024-09-12T00:54:12.746 INFO:tasks.workunit.client.0.smithi070.stderr: 4: radosgw-admin(+0x1421f32) [0x55ebe2e1ef32] 2024-09-12T00:54:12.747 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ebe23d6ced] 2024-09-12T00:54:12.747 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:54:12.747 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fee0a416d90] 2024-09-12T00:54:12.747 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:54:12.747 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:54:12.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.752+0000 7fee07cd69c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fee07cd69c0 time 2024-09-12T00:54:12.753413+0000 2024-09-12T00:54:12.747 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:12.747 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.747 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:12.747 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fee0b5b02eb] 2024-09-12T00:54:12.747 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fee0b5b049f] 2024-09-12T00:54:12.747 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ebe23c1cc1] 2024-09-12T00:54:12.747 INFO:tasks.workunit.client.0.smithi070.stderr: 4: radosgw-admin(+0x1421f32) [0x55ebe2e1ef32] 2024-09-12T00:54:12.748 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ebe23d6ced] 2024-09-12T00:54:12.748 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:54:12.748 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fee0a416d90] 2024-09-12T00:54:12.748 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:54:12.748 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:54:12.748 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.748 INFO:tasks.workunit.client.0.smithi070.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:54:12.748 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7fee07cd69c0 thread_name:radosgw-admin 2024-09-12T00:54:12.800 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:12.800 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fee0a42f520] 2024-09-12T00:54:12.800 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:54:12.800 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:54:12.800 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:54:12.800 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fee0b5b0345] 2024-09-12T00:54:12.800 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fee0b5b049f] 2024-09-12T00:54:12.800 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ebe23c1cc1] 2024-09-12T00:54:12.801 INFO:tasks.workunit.client.0.smithi070.stderr: 8: radosgw-admin(+0x1421f32) [0x55ebe2e1ef32] 2024-09-12T00:54:12.801 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ebe23d6ced] 2024-09-12T00:54:12.801 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:54:12.801 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fee0a416d90] 2024-09-12T00:54:12.801 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:54:12.801 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:54:12.801 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.756+0000 7fee07cd69c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:54:12.801 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7fee07cd69c0 thread_name:radosgw-admin 2024-09-12T00:54:12.801 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.801 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:12.801 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fee0a42f520] 2024-09-12T00:54:12.801 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:54:12.801 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:54:12.802 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:54:12.802 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fee0b5b0345] 2024-09-12T00:54:12.802 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fee0b5b049f] 2024-09-12T00:54:12.802 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ebe23c1cc1] 2024-09-12T00:54:12.802 INFO:tasks.workunit.client.0.smithi070.stderr: 8: radosgw-admin(+0x1421f32) [0x55ebe2e1ef32] 2024-09-12T00:54:12.802 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ebe23d6ced] 2024-09-12T00:54:12.802 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:54:12.802 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fee0a416d90] 2024-09-12T00:54:12.802 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:54:12.802 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:54:12.802 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:54:12.802 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.803 INFO:tasks.workunit.client.0.smithi070.stderr:--- begin dump of recent events --- 2024-09-12T00:54:12.803 INFO:tasks.workunit.client.0.smithi070.stderr: -499> 2024-09-12T00:54:12.448+0000 7fee07cd69c0 10 monclient(hunting): _renew_subs 2024-09-12T00:54:12.803 INFO:tasks.workunit.client.0.smithi070.stderr: -498> 2024-09-12T00:54:12.448+0000 7fee07cd69c0 10 monclient(hunting): authenticate will time out at 2102.899991s 2024-09-12T00:54:12.803 INFO:tasks.workunit.client.0.smithi070.stderr: -497> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): get_auth_request con 0x55ebe3cdf920 auth_method 0 2024-09-12T00:54:12.803 INFO:tasks.workunit.client.0.smithi070.stderr: -496> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:12.803 INFO:tasks.workunit.client.0.smithi070.stderr: -495> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:12.803 INFO:tasks.workunit.client.0.smithi070.stderr: -494> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:12.803 INFO:tasks.workunit.client.0.smithi070.stderr: -493> 2024-09-12T00:54:12.452+0000 7fee057dc640 10 monclient(hunting): get_auth_request con 0x55ebe3c53230 auth_method 0 2024-09-12T00:54:12.803 INFO:tasks.workunit.client.0.smithi070.stderr: -492> 2024-09-12T00:54:12.452+0000 7fee057dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:12.803 INFO:tasks.workunit.client.0.smithi070.stderr: -491> 2024-09-12T00:54:12.452+0000 7fee057dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:12.803 INFO:tasks.workunit.client.0.smithi070.stderr: -490> 2024-09-12T00:54:12.452+0000 7fee057dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:12.803 INFO:tasks.workunit.client.0.smithi070.stderr: -489> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:12.803 INFO:tasks.workunit.client.0.smithi070.stderr: -488> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:12.804 INFO:tasks.workunit.client.0.smithi070.stderr: -487> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:12.804 INFO:tasks.workunit.client.0.smithi070.stderr: -486> 2024-09-12T00:54:12.452+0000 7fee057dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:12.804 INFO:tasks.workunit.client.0.smithi070.stderr: -485> 2024-09-12T00:54:12.452+0000 7fee057dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:12.804 INFO:tasks.workunit.client.0.smithi070.stderr: -484> 2024-09-12T00:54:12.452+0000 7fee057dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:12.804 INFO:tasks.workunit.client.0.smithi070.stderr: -483> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): handle_auth_done global_id 6074 payload 274 2024-09-12T00:54:12.804 INFO:tasks.workunit.client.0.smithi070.stderr: -482> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient: _finish_hunting 0 2024-09-12T00:54:12.804 INFO:tasks.workunit.client.0.smithi070.stderr: -481> 2024-09-12T00:54:12.452+0000 7fee04fdb640 1 monclient: found mon.noname-c 2024-09-12T00:54:12.804 INFO:tasks.workunit.client.0.smithi070.stderr: -480> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:54:12.804 INFO:tasks.workunit.client.0.smithi070.stderr: -479> 2024-09-12T00:54:12.452+0000 7fecf3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:12.804 INFO:tasks.workunit.client.0.smithi070.stderr: -478> 2024-09-12T00:54:12.452+0000 7fecf3606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:12.804 INFO:tasks.workunit.client.0.smithi070.stderr: -477> 2024-09-12T00:54:12.452+0000 7fecf3606640 10 monclient: dump: 2024-09-12T00:54:12.804 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:12.804 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:12.805 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.805 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.805 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:12.805 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.805 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:12.805 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:12.805 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:12.805 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.805 INFO:tasks.workunit.client.0.smithi070.stderr: -476> 2024-09-12T00:54:12.452+0000 7fecf3606640 10 monclient: _finish_auth 0 2024-09-12T00:54:12.805 INFO:tasks.workunit.client.0.smithi070.stderr: -475> 2024-09-12T00:54:12.452+0000 7fecf3606640 10 monclient: _check_auth_tickets 2024-09-12T00:54:12.805 INFO:tasks.workunit.client.0.smithi070.stderr: -474> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 monclient: authenticate success, global_id 6074 2024-09-12T00:54:12.805 INFO:tasks.workunit.client.0.smithi070.stderr: -473> 2024-09-12T00:54:12.452+0000 7fecf3606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:12.805 INFO:tasks.workunit.client.0.smithi070.stderr: -472> 2024-09-12T00:54:12.452+0000 7fecf3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:12.806 INFO:tasks.workunit.client.0.smithi070.stderr: -471> 2024-09-12T00:54:12.452+0000 7fecf3606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:12.806 INFO:tasks.workunit.client.0.smithi070.stderr: -470> 2024-09-12T00:54:12.452+0000 7fecf3606640 10 monclient: dump: 2024-09-12T00:54:12.806 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:12.806 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:12.806 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.806 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.806 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:12.806 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.806 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:12.806 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:12.806 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:12.806 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.806 INFO:tasks.workunit.client.0.smithi070.stderr: -469> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient: get_monmap_and_config success 2024-09-12T00:54:12.806 INFO:tasks.workunit.client.0.smithi070.stderr: -468> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 4 set_mon_vals no callback set 2024-09-12T00:54:12.807 INFO:tasks.workunit.client.0.smithi070.stderr: -467> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient: shutdown 2024-09-12T00:54:12.807 INFO:tasks.workunit.client.0.smithi070.stderr: -466> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) unregister_commands rotate-key 2024-09-12T00:54:12.807 INFO:tasks.workunit.client.0.smithi070.stderr: -465> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient: build_initial_monmap 2024-09-12T00:54:12.807 INFO:tasks.workunit.client.0.smithi070.stderr: -464> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 1 build_initial for_mkfs: 0 2024-09-12T00:54:12.807 INFO:tasks.workunit.client.0.smithi070.stderr: -463> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient: monmap: 2024-09-12T00:54:12.807 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:54:12.807 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:12.807 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:54:12.807 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:54:12.807 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:12.807 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.807 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:54:12.807 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:54:12.808 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:54:12.808 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.808 INFO:tasks.workunit.client.0.smithi070.stderr: -462> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding auth protocol: cephx 2024-09-12T00:54:12.808 INFO:tasks.workunit.client.0.smithi070.stderr: -461> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding auth protocol: cephx 2024-09-12T00:54:12.808 INFO:tasks.workunit.client.0.smithi070.stderr: -460> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding auth protocol: cephx 2024-09-12T00:54:12.808 INFO:tasks.workunit.client.0.smithi070.stderr: -459> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding con mode: secure 2024-09-12T00:54:12.808 INFO:tasks.workunit.client.0.smithi070.stderr: -458> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding con mode: crc 2024-09-12T00:54:12.808 INFO:tasks.workunit.client.0.smithi070.stderr: -457> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding con mode: secure 2024-09-12T00:54:12.808 INFO:tasks.workunit.client.0.smithi070.stderr: -456> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding con mode: crc 2024-09-12T00:54:12.808 INFO:tasks.workunit.client.0.smithi070.stderr: -455> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding con mode: secure 2024-09-12T00:54:12.808 INFO:tasks.workunit.client.0.smithi070.stderr: -454> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding con mode: crc 2024-09-12T00:54:12.808 INFO:tasks.workunit.client.0.smithi070.stderr: -453> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding con mode: crc 2024-09-12T00:54:12.809 INFO:tasks.workunit.client.0.smithi070.stderr: -452> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding con mode: secure 2024-09-12T00:54:12.809 INFO:tasks.workunit.client.0.smithi070.stderr: -451> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding con mode: crc 2024-09-12T00:54:12.809 INFO:tasks.workunit.client.0.smithi070.stderr: -450> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding con mode: secure 2024-09-12T00:54:12.809 INFO:tasks.workunit.client.0.smithi070.stderr: -449> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding con mode: crc 2024-09-12T00:54:12.809 INFO:tasks.workunit.client.0.smithi070.stderr: -448> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding con mode: secure 2024-09-12T00:54:12.809 INFO:tasks.workunit.client.0.smithi070.stderr: -447> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:12.809 INFO:tasks.workunit.client.0.smithi070.stderr: -446> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 1 librados: starting msgr at 2024-09-12T00:54:12.809 INFO:tasks.workunit.client.0.smithi070.stderr: -445> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 1 librados: starting objecter 2024-09-12T00:54:12.809 INFO:tasks.workunit.client.0.smithi070.stderr: -444> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command objecter_requests hook 0x55ebe3b0d290 2024-09-12T00:54:12.809 INFO:tasks.workunit.client.0.smithi070.stderr: -443> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 1 librados: setting wanted keys 2024-09-12T00:54:12.809 INFO:tasks.workunit.client.0.smithi070.stderr: -442> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 1 librados: calling monclient init 2024-09-12T00:54:12.809 INFO:tasks.workunit.client.0.smithi070.stderr: -441> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient: init 2024-09-12T00:54:12.809 INFO:tasks.workunit.client.0.smithi070.stderr: -440> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding auth protocol: cephx 2024-09-12T00:54:12.809 INFO:tasks.workunit.client.0.smithi070.stderr: -439> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding auth protocol: cephx 2024-09-12T00:54:12.810 INFO:tasks.workunit.client.0.smithi070.stderr: -438> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding auth protocol: cephx 2024-09-12T00:54:12.810 INFO:tasks.workunit.client.0.smithi070.stderr: -437> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding con mode: secure 2024-09-12T00:54:12.810 INFO:tasks.workunit.client.0.smithi070.stderr: -436> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding con mode: crc 2024-09-12T00:54:12.810 INFO:tasks.workunit.client.0.smithi070.stderr: -435> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding con mode: secure 2024-09-12T00:54:12.810 INFO:tasks.workunit.client.0.smithi070.stderr: -434> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding con mode: crc 2024-09-12T00:54:12.810 INFO:tasks.workunit.client.0.smithi070.stderr: -433> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding con mode: secure 2024-09-12T00:54:12.810 INFO:tasks.workunit.client.0.smithi070.stderr: -432> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding con mode: crc 2024-09-12T00:54:12.810 INFO:tasks.workunit.client.0.smithi070.stderr: -431> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding con mode: crc 2024-09-12T00:54:12.810 INFO:tasks.workunit.client.0.smithi070.stderr: -430> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding con mode: secure 2024-09-12T00:54:12.810 INFO:tasks.workunit.client.0.smithi070.stderr: -429> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding con mode: crc 2024-09-12T00:54:12.810 INFO:tasks.workunit.client.0.smithi070.stderr: -428> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding con mode: secure 2024-09-12T00:54:12.810 INFO:tasks.workunit.client.0.smithi070.stderr: -427> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding con mode: crc 2024-09-12T00:54:12.811 INFO:tasks.workunit.client.0.smithi070.stderr: -426> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding con mode: secure 2024-09-12T00:54:12.811 INFO:tasks.workunit.client.0.smithi070.stderr: -425> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:12.811 INFO:tasks.workunit.client.0.smithi070.stderr: -424> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:12.811 INFO:tasks.workunit.client.0.smithi070.stderr: -423> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command rotate-key hook 0x55ebe3d93b78 2024-09-12T00:54:12.811 INFO:tasks.workunit.client.0.smithi070.stderr: -422> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient: _reopen_session rank -1 2024-09-12T00:54:12.811 INFO:tasks.workunit.client.0.smithi070.stderr: -421> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:54:12.811 INFO:tasks.workunit.client.0.smithi070.stderr: -420> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient(hunting): picked mon.noname-b con 0x55ebe3c53230 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:54:12.811 INFO:tasks.workunit.client.0.smithi070.stderr: -419> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient(hunting): picked mon.noname-c con 0x55ebe3cdf920 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:54:12.811 INFO:tasks.workunit.client.0.smithi070.stderr: -418> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient(hunting): picked mon.noname-a con 0x55ebe3d9a510 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:54:12.811 INFO:tasks.workunit.client.0.smithi070.stderr: -417> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:12.811 INFO:tasks.workunit.client.0.smithi070.stderr: -416> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:12.811 INFO:tasks.workunit.client.0.smithi070.stderr: -415> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:12.811 INFO:tasks.workunit.client.0.smithi070.stderr: -414> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient(hunting): _renew_subs 2024-09-12T00:54:12.812 INFO:tasks.workunit.client.0.smithi070.stderr: -413> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient(hunting): authenticate will time out at 2102.903073s 2024-09-12T00:54:12.812 INFO:tasks.workunit.client.0.smithi070.stderr: -412> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): get_auth_request con 0x55ebe3cdf920 auth_method 0 2024-09-12T00:54:12.812 INFO:tasks.workunit.client.0.smithi070.stderr: -411> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:12.812 INFO:tasks.workunit.client.0.smithi070.stderr: -410> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:12.812 INFO:tasks.workunit.client.0.smithi070.stderr: -409> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:12.812 INFO:tasks.workunit.client.0.smithi070.stderr: -408> 2024-09-12T00:54:12.452+0000 7fee05fdd640 10 monclient(hunting): get_auth_request con 0x55ebe3d9a510 auth_method 0 2024-09-12T00:54:12.812 INFO:tasks.workunit.client.0.smithi070.stderr: -407> 2024-09-12T00:54:12.452+0000 7fee05fdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:12.812 INFO:tasks.workunit.client.0.smithi070.stderr: -406> 2024-09-12T00:54:12.452+0000 7fee05fdd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:12.812 INFO:tasks.workunit.client.0.smithi070.stderr: -405> 2024-09-12T00:54:12.452+0000 7fee05fdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:12.812 INFO:tasks.workunit.client.0.smithi070.stderr: -404> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:12.812 INFO:tasks.workunit.client.0.smithi070.stderr: -403> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:12.812 INFO:tasks.workunit.client.0.smithi070.stderr: -402> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:12.812 INFO:tasks.workunit.client.0.smithi070.stderr: -401> 2024-09-12T00:54:12.452+0000 7fee05fdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:12.813 INFO:tasks.workunit.client.0.smithi070.stderr: -400> 2024-09-12T00:54:12.452+0000 7fee05fdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:12.813 INFO:tasks.workunit.client.0.smithi070.stderr: -399> 2024-09-12T00:54:12.452+0000 7fee05fdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:12.813 INFO:tasks.workunit.client.0.smithi070.stderr: -398> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): handle_auth_done global_id 6077 payload 824 2024-09-12T00:54:12.813 INFO:tasks.workunit.client.0.smithi070.stderr: -397> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient: _finish_hunting 0 2024-09-12T00:54:12.813 INFO:tasks.workunit.client.0.smithi070.stderr: -396> 2024-09-12T00:54:12.452+0000 7fee04fdb640 1 monclient: found mon.noname-c 2024-09-12T00:54:12.813 INFO:tasks.workunit.client.0.smithi070.stderr: -395> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:54:12.813 INFO:tasks.workunit.client.0.smithi070.stderr: -394> 2024-09-12T00:54:12.452+0000 7fecf1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:12.813 INFO:tasks.workunit.client.0.smithi070.stderr: -393> 2024-09-12T00:54:12.452+0000 7fecf1e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:12.813 INFO:tasks.workunit.client.0.smithi070.stderr: -392> 2024-09-12T00:54:12.452+0000 7fecf1e03640 10 monclient: dump: 2024-09-12T00:54:12.813 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:12.813 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:12.813 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.813 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.814 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:12.814 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.814 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:12.814 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:12.814 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:12.814 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.814 INFO:tasks.workunit.client.0.smithi070.stderr: -391> 2024-09-12T00:54:12.452+0000 7fecf1e03640 10 monclient: _finish_auth 0 2024-09-12T00:54:12.814 INFO:tasks.workunit.client.0.smithi070.stderr: -390> 2024-09-12T00:54:12.452+0000 7fecf1e03640 10 monclient: _check_auth_tickets 2024-09-12T00:54:12.814 INFO:tasks.workunit.client.0.smithi070.stderr: -389> 2024-09-12T00:54:12.452+0000 7fecf1e03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:12.814 INFO:tasks.workunit.client.0.smithi070.stderr: -388> 2024-09-12T00:54:12.452+0000 7fecf1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:12.814 INFO:tasks.workunit.client.0.smithi070.stderr: -387> 2024-09-12T00:54:12.452+0000 7fecf1e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:12.814 INFO:tasks.workunit.client.0.smithi070.stderr: -386> 2024-09-12T00:54:12.452+0000 7fecf1e03640 10 monclient: dump: 2024-09-12T00:54:12.814 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:12.814 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:12.815 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.815 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.815 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:12.815 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.815 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:12.815 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:12.815 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:12.815 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.815 INFO:tasks.workunit.client.0.smithi070.stderr: -385> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 monclient: authenticate success, global_id 6077 2024-09-12T00:54:12.815 INFO:tasks.workunit.client.0.smithi070.stderr: -384> 2024-09-12T00:54:12.452+0000 7fecf3606640 4 set_mon_vals no callback set 2024-09-12T00:54:12.815 INFO:tasks.workunit.client.0.smithi070.stderr: -383> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient: _renew_subs 2024-09-12T00:54:12.815 INFO:tasks.workunit.client.0.smithi070.stderr: -382> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:54:12.815 INFO:tasks.workunit.client.0.smithi070.stderr: -381> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient: _renew_subs 2024-09-12T00:54:12.816 INFO:tasks.workunit.client.0.smithi070.stderr: -380> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:54:12.816 INFO:tasks.workunit.client.0.smithi070.stderr: -379> 2024-09-12T00:54:12.456+0000 7fee07cd69c0 1 librados: init done 2024-09-12T00:54:12.816 INFO:tasks.workunit.client.0.smithi070.stderr: -378> 2024-09-12T00:54:12.456+0000 7fecf1e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:12.816 INFO:tasks.workunit.client.0.smithi070.stderr: -377> 2024-09-12T00:54:12.456+0000 7fecf1e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:54:12.816 INFO:tasks.workunit.client.0.smithi070.stderr: -376> 2024-09-12T00:54:12.456+0000 7fecf1e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:54:12.816 INFO:tasks.workunit.client.0.smithi070.stderr: -375> 2024-09-12T00:54:12.456+0000 7fee057dc640 10 monclient: get_auth_request con 0x7fecec070b10 auth_method 0 2024-09-12T00:54:12.816 INFO:tasks.workunit.client.0.smithi070.stderr: -374> 2024-09-12T00:54:12.456+0000 7fee05fdd640 10 monclient: get_auth_request con 0x55ebe3dbb840 auth_method 0 2024-09-12T00:54:12.816 INFO:tasks.workunit.client.0.smithi070.stderr: -373> 2024-09-12T00:54:12.456+0000 7fee057dc640 10 monclient: get_auth_request con 0x55ebe3dde2b0 auth_method 0 2024-09-12T00:54:12.816 INFO:tasks.workunit.client.0.smithi070.stderr: -372> 2024-09-12T00:54:12.460+0000 7fee04fdb640 10 monclient: get_auth_request con 0x55ebe3de24a0 auth_method 0 2024-09-12T00:54:12.816 INFO:tasks.workunit.client.0.smithi070.stderr: -371> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 10 monclient: build_initial_monmap 2024-09-12T00:54:12.816 INFO:tasks.workunit.client.0.smithi070.stderr: -370> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 1 build_initial for_mkfs: 0 2024-09-12T00:54:12.816 INFO:tasks.workunit.client.0.smithi070.stderr: -369> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 10 monclient: monmap: 2024-09-12T00:54:12.816 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:54:12.816 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:12.817 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:54:12.817 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:54:12.817 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:12.817 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.817 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:54:12.817 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:54:12.817 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:54:12.817 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.817 INFO:tasks.workunit.client.0.smithi070.stderr: -368> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding auth protocol: cephx 2024-09-12T00:54:12.817 INFO:tasks.workunit.client.0.smithi070.stderr: -367> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding auth protocol: cephx 2024-09-12T00:54:12.817 INFO:tasks.workunit.client.0.smithi070.stderr: -366> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding auth protocol: cephx 2024-09-12T00:54:12.817 INFO:tasks.workunit.client.0.smithi070.stderr: -365> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding con mode: secure 2024-09-12T00:54:12.817 INFO:tasks.workunit.client.0.smithi070.stderr: -364> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding con mode: crc 2024-09-12T00:54:12.818 INFO:tasks.workunit.client.0.smithi070.stderr: -363> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding con mode: secure 2024-09-12T00:54:12.818 INFO:tasks.workunit.client.0.smithi070.stderr: -362> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding con mode: crc 2024-09-12T00:54:12.818 INFO:tasks.workunit.client.0.smithi070.stderr: -361> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding con mode: secure 2024-09-12T00:54:12.818 INFO:tasks.workunit.client.0.smithi070.stderr: -360> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding con mode: crc 2024-09-12T00:54:12.818 INFO:tasks.workunit.client.0.smithi070.stderr: -359> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding con mode: crc 2024-09-12T00:54:12.818 INFO:tasks.workunit.client.0.smithi070.stderr: -358> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding con mode: secure 2024-09-12T00:54:12.818 INFO:tasks.workunit.client.0.smithi070.stderr: -357> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding con mode: crc 2024-09-12T00:54:12.818 INFO:tasks.workunit.client.0.smithi070.stderr: -356> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding con mode: secure 2024-09-12T00:54:12.819 INFO:tasks.workunit.client.0.smithi070.stderr: -355> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding con mode: crc 2024-09-12T00:54:12.819 INFO:tasks.workunit.client.0.smithi070.stderr: -354> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding con mode: secure 2024-09-12T00:54:12.819 INFO:tasks.workunit.client.0.smithi070.stderr: -353> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:12.819 INFO:tasks.workunit.client.0.smithi070.stderr: -352> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command objecter_requests cmddesc objecter_requests hook 0x55ebe3deabe0 EEXIST 2024-09-12T00:54:12.819 INFO:tasks.workunit.client.0.smithi070.stderr: -351> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 10 monclient: init 2024-09-12T00:54:12.819 INFO:tasks.workunit.client.0.smithi070.stderr: -350> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding auth protocol: cephx 2024-09-12T00:54:12.819 INFO:tasks.workunit.client.0.smithi070.stderr: -349> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding auth protocol: cephx 2024-09-12T00:54:12.819 INFO:tasks.workunit.client.0.smithi070.stderr: -348> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding auth protocol: cephx 2024-09-12T00:54:12.819 INFO:tasks.workunit.client.0.smithi070.stderr: -347> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding con mode: secure 2024-09-12T00:54:12.819 INFO:tasks.workunit.client.0.smithi070.stderr: -346> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding con mode: crc 2024-09-12T00:54:12.819 INFO:tasks.workunit.client.0.smithi070.stderr: -345> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding con mode: secure 2024-09-12T00:54:12.819 INFO:tasks.workunit.client.0.smithi070.stderr: -344> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding con mode: crc 2024-09-12T00:54:12.819 INFO:tasks.workunit.client.0.smithi070.stderr: -343> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding con mode: secure 2024-09-12T00:54:12.820 INFO:tasks.workunit.client.0.smithi070.stderr: -342> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding con mode: crc 2024-09-12T00:54:12.820 INFO:tasks.workunit.client.0.smithi070.stderr: -341> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding con mode: crc 2024-09-12T00:54:12.820 INFO:tasks.workunit.client.0.smithi070.stderr: -340> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding con mode: secure 2024-09-12T00:54:12.820 INFO:tasks.workunit.client.0.smithi070.stderr: -339> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding con mode: crc 2024-09-12T00:54:12.820 INFO:tasks.workunit.client.0.smithi070.stderr: -338> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding con mode: secure 2024-09-12T00:54:12.820 INFO:tasks.workunit.client.0.smithi070.stderr: -337> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding con mode: crc 2024-09-12T00:54:12.820 INFO:tasks.workunit.client.0.smithi070.stderr: -336> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding con mode: secure 2024-09-12T00:54:12.820 INFO:tasks.workunit.client.0.smithi070.stderr: -335> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:12.820 INFO:tasks.workunit.client.0.smithi070.stderr: -334> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:12.820 INFO:tasks.workunit.client.0.smithi070.stderr: -333> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command rotate-key cmddesc rotate-key hook 0x55ebe3de5980 EEXIST 2024-09-12T00:54:12.820 INFO:tasks.workunit.client.0.smithi070.stderr: -332> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient: _reopen_session rank -1 2024-09-12T00:54:12.820 INFO:tasks.workunit.client.0.smithi070.stderr: -331> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:54:12.820 INFO:tasks.workunit.client.0.smithi070.stderr: -330> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient(hunting): picked mon.noname-c con 0x55ebe3e0ed90 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:54:12.821 INFO:tasks.workunit.client.0.smithi070.stderr: -329> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient(hunting): picked mon.noname-b con 0x55ebe3e0e6c0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:54:12.821 INFO:tasks.workunit.client.0.smithi070.stderr: -328> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient(hunting): picked mon.noname-a con 0x55ebe3e0d0a0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:54:12.821 INFO:tasks.workunit.client.0.smithi070.stderr: -327> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:12.821 INFO:tasks.workunit.client.0.smithi070.stderr: -326> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:12.821 INFO:tasks.workunit.client.0.smithi070.stderr: -325> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:12.821 INFO:tasks.workunit.client.0.smithi070.stderr: -324> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient(hunting): _renew_subs 2024-09-12T00:54:12.821 INFO:tasks.workunit.client.0.smithi070.stderr: -323> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient(hunting): authenticate will time out at 2102.912090s 2024-09-12T00:54:12.821 INFO:tasks.workunit.client.0.smithi070.stderr: -322> 2024-09-12T00:54:12.464+0000 7fee057dc640 10 monclient(hunting): get_auth_request con 0x55ebe3e0ed90 auth_method 0 2024-09-12T00:54:12.821 INFO:tasks.workunit.client.0.smithi070.stderr: -321> 2024-09-12T00:54:12.464+0000 7fee057dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:12.821 INFO:tasks.workunit.client.0.smithi070.stderr: -320> 2024-09-12T00:54:12.464+0000 7fee057dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:12.821 INFO:tasks.workunit.client.0.smithi070.stderr: -319> 2024-09-12T00:54:12.464+0000 7fee057dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:12.821 INFO:tasks.workunit.client.0.smithi070.stderr: -318> 2024-09-12T00:54:12.464+0000 7fee05fdd640 10 monclient(hunting): get_auth_request con 0x55ebe3e0d0a0 auth_method 0 2024-09-12T00:54:12.821 INFO:tasks.workunit.client.0.smithi070.stderr: -317> 2024-09-12T00:54:12.464+0000 7fee05fdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:12.822 INFO:tasks.workunit.client.0.smithi070.stderr: -316> 2024-09-12T00:54:12.464+0000 7fee05fdd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:12.822 INFO:tasks.workunit.client.0.smithi070.stderr: -315> 2024-09-12T00:54:12.464+0000 7fee05fdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:12.822 INFO:tasks.workunit.client.0.smithi070.stderr: -314> 2024-09-12T00:54:12.464+0000 7fee05fdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:12.822 INFO:tasks.workunit.client.0.smithi070.stderr: -313> 2024-09-12T00:54:12.464+0000 7fee05fdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:12.822 INFO:tasks.workunit.client.0.smithi070.stderr: -312> 2024-09-12T00:54:12.464+0000 7fee05fdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:12.822 INFO:tasks.workunit.client.0.smithi070.stderr: -311> 2024-09-12T00:54:12.464+0000 7fee057dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:12.822 INFO:tasks.workunit.client.0.smithi070.stderr: -310> 2024-09-12T00:54:12.464+0000 7fee057dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:12.822 INFO:tasks.workunit.client.0.smithi070.stderr: -309> 2024-09-12T00:54:12.464+0000 7fee057dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:12.822 INFO:tasks.workunit.client.0.smithi070.stderr: -308> 2024-09-12T00:54:12.464+0000 7fee04fdb640 10 monclient(hunting): get_auth_request con 0x55ebe3e0e6c0 auth_method 0 2024-09-12T00:54:12.822 INFO:tasks.workunit.client.0.smithi070.stderr: -307> 2024-09-12T00:54:12.464+0000 7fee04fdb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:12.822 INFO:tasks.workunit.client.0.smithi070.stderr: -306> 2024-09-12T00:54:12.464+0000 7fee04fdb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:12.822 INFO:tasks.workunit.client.0.smithi070.stderr: -305> 2024-09-12T00:54:12.464+0000 7fee04fdb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:12.822 INFO:tasks.workunit.client.0.smithi070.stderr: -304> 2024-09-12T00:54:12.464+0000 7fee057dc640 10 monclient(hunting): handle_auth_done global_id 6080 payload 824 2024-09-12T00:54:12.823 INFO:tasks.workunit.client.0.smithi070.stderr: -303> 2024-09-12T00:54:12.464+0000 7fee057dc640 10 monclient: _finish_hunting 0 2024-09-12T00:54:12.823 INFO:tasks.workunit.client.0.smithi070.stderr: -302> 2024-09-12T00:54:12.464+0000 7fee057dc640 1 monclient: found mon.noname-c 2024-09-12T00:54:12.823 INFO:tasks.workunit.client.0.smithi070.stderr: -301> 2024-09-12T00:54:12.464+0000 7fee057dc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:54:12.823 INFO:tasks.workunit.client.0.smithi070.stderr: -300> 2024-09-12T00:54:12.464+0000 7feceaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:12.823 INFO:tasks.workunit.client.0.smithi070.stderr: -299> 2024-09-12T00:54:12.464+0000 7feceaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:12.823 INFO:tasks.workunit.client.0.smithi070.stderr: -298> 2024-09-12T00:54:12.464+0000 7feceaffd640 10 monclient: dump: 2024-09-12T00:54:12.823 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:12.823 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:12.823 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.823 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.823 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:12.823 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.823 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:12.824 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:12.824 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:12.824 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.824 INFO:tasks.workunit.client.0.smithi070.stderr: -297> 2024-09-12T00:54:12.464+0000 7feceaffd640 10 monclient: _finish_auth 0 2024-09-12T00:54:12.824 INFO:tasks.workunit.client.0.smithi070.stderr: -296> 2024-09-12T00:54:12.464+0000 7feceaffd640 10 monclient: _check_auth_tickets 2024-09-12T00:54:12.824 INFO:tasks.workunit.client.0.smithi070.stderr: -295> 2024-09-12T00:54:12.464+0000 7feceaffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:12.824 INFO:tasks.workunit.client.0.smithi070.stderr: -294> 2024-09-12T00:54:12.464+0000 7feceaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:12.824 INFO:tasks.workunit.client.0.smithi070.stderr: -293> 2024-09-12T00:54:12.464+0000 7feceaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:12.824 INFO:tasks.workunit.client.0.smithi070.stderr: -292> 2024-09-12T00:54:12.464+0000 7feceaffd640 10 monclient: dump: 2024-09-12T00:54:12.824 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:12.824 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:12.824 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.825 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.825 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:12.825 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.825 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:12.825 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:12.825 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:12.825 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.825 INFO:tasks.workunit.client.0.smithi070.stderr: -291> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 monclient: authenticate success, global_id 6080 2024-09-12T00:54:12.825 INFO:tasks.workunit.client.0.smithi070.stderr: -290> 2024-09-12T00:54:12.464+0000 7fee067de640 4 set_mon_vals no callback set 2024-09-12T00:54:12.825 INFO:tasks.workunit.client.0.smithi070.stderr: -289> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient: _renew_subs 2024-09-12T00:54:12.825 INFO:tasks.workunit.client.0.smithi070.stderr: -288> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:54:12.825 INFO:tasks.workunit.client.0.smithi070.stderr: -287> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient: _renew_subs 2024-09-12T00:54:12.825 INFO:tasks.workunit.client.0.smithi070.stderr: -286> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:54:12.826 INFO:tasks.workunit.client.0.smithi070.stderr: -285> 2024-09-12T00:54:12.464+0000 7feceaffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:12.826 INFO:tasks.workunit.client.0.smithi070.stderr: -284> 2024-09-12T00:54:12.464+0000 7feceaffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:54:12.826 INFO:tasks.workunit.client.0.smithi070.stderr: -283> 2024-09-12T00:54:12.464+0000 7feceaffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:54:12.826 INFO:tasks.workunit.client.0.smithi070.stderr: -282> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient: get_monmap_and_config 2024-09-12T00:54:12.826 INFO:tasks.workunit.client.0.smithi070.stderr: -281> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient: build_initial_monmap 2024-09-12T00:54:12.826 INFO:tasks.workunit.client.0.smithi070.stderr: -280> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 1 build_initial for_mkfs: 0 2024-09-12T00:54:12.826 INFO:tasks.workunit.client.0.smithi070.stderr: -279> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient: monmap: 2024-09-12T00:54:12.826 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:54:12.826 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:12.826 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:54:12.826 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:54:12.826 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:12.826 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.827 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:54:12.827 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:54:12.827 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:54:12.827 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.827 INFO:tasks.workunit.client.0.smithi070.stderr: -278> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding auth protocol: cephx 2024-09-12T00:54:12.827 INFO:tasks.workunit.client.0.smithi070.stderr: -277> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding auth protocol: cephx 2024-09-12T00:54:12.827 INFO:tasks.workunit.client.0.smithi070.stderr: -276> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding auth protocol: cephx 2024-09-12T00:54:12.827 INFO:tasks.workunit.client.0.smithi070.stderr: -275> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding con mode: secure 2024-09-12T00:54:12.827 INFO:tasks.workunit.client.0.smithi070.stderr: -274> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding con mode: crc 2024-09-12T00:54:12.827 INFO:tasks.workunit.client.0.smithi070.stderr: -273> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding con mode: secure 2024-09-12T00:54:12.827 INFO:tasks.workunit.client.0.smithi070.stderr: -272> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding con mode: crc 2024-09-12T00:54:12.827 INFO:tasks.workunit.client.0.smithi070.stderr: -271> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding con mode: secure 2024-09-12T00:54:12.827 INFO:tasks.workunit.client.0.smithi070.stderr: -270> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding con mode: crc 2024-09-12T00:54:12.827 INFO:tasks.workunit.client.0.smithi070.stderr: -269> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding con mode: crc 2024-09-12T00:54:12.828 INFO:tasks.workunit.client.0.smithi070.stderr: -268> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding con mode: secure 2024-09-12T00:54:12.828 INFO:tasks.workunit.client.0.smithi070.stderr: -267> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding con mode: crc 2024-09-12T00:54:12.828 INFO:tasks.workunit.client.0.smithi070.stderr: -266> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding con mode: secure 2024-09-12T00:54:12.828 INFO:tasks.workunit.client.0.smithi070.stderr: -265> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding con mode: crc 2024-09-12T00:54:12.828 INFO:tasks.workunit.client.0.smithi070.stderr: -264> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding con mode: secure 2024-09-12T00:54:12.828 INFO:tasks.workunit.client.0.smithi070.stderr: -263> 2024-09-12T00:54:12.464+0000 7fee04fdb640 10 monclient: get_auth_request con 0x7fece0070a20 auth_method 0 2024-09-12T00:54:12.828 INFO:tasks.workunit.client.0.smithi070.stderr: -262> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:12.828 INFO:tasks.workunit.client.0.smithi070.stderr: -261> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient: init 2024-09-12T00:54:12.828 INFO:tasks.workunit.client.0.smithi070.stderr: -260> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding auth protocol: cephx 2024-09-12T00:54:12.828 INFO:tasks.workunit.client.0.smithi070.stderr: -259> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding auth protocol: cephx 2024-09-12T00:54:12.828 INFO:tasks.workunit.client.0.smithi070.stderr: -258> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding auth protocol: cephx 2024-09-12T00:54:12.828 INFO:tasks.workunit.client.0.smithi070.stderr: -257> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding con mode: secure 2024-09-12T00:54:12.828 INFO:tasks.workunit.client.0.smithi070.stderr: -256> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding con mode: crc 2024-09-12T00:54:12.828 INFO:tasks.workunit.client.0.smithi070.stderr: -255> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding con mode: secure 2024-09-12T00:54:12.829 INFO:tasks.workunit.client.0.smithi070.stderr: -254> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding con mode: crc 2024-09-12T00:54:12.829 INFO:tasks.workunit.client.0.smithi070.stderr: -253> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding con mode: secure 2024-09-12T00:54:12.829 INFO:tasks.workunit.client.0.smithi070.stderr: -252> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding con mode: crc 2024-09-12T00:54:12.829 INFO:tasks.workunit.client.0.smithi070.stderr: -251> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding con mode: crc 2024-09-12T00:54:12.829 INFO:tasks.workunit.client.0.smithi070.stderr: -250> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding con mode: secure 2024-09-12T00:54:12.829 INFO:tasks.workunit.client.0.smithi070.stderr: -249> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding con mode: crc 2024-09-12T00:54:12.829 INFO:tasks.workunit.client.0.smithi070.stderr: -248> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding con mode: secure 2024-09-12T00:54:12.829 INFO:tasks.workunit.client.0.smithi070.stderr: -247> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding con mode: crc 2024-09-12T00:54:12.829 INFO:tasks.workunit.client.0.smithi070.stderr: -246> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding con mode: secure 2024-09-12T00:54:12.829 INFO:tasks.workunit.client.0.smithi070.stderr: -245> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:12.829 INFO:tasks.workunit.client.0.smithi070.stderr: -244> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:12.829 INFO:tasks.workunit.client.0.smithi070.stderr: -243> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd08939a88 EEXIST 2024-09-12T00:54:12.830 INFO:tasks.workunit.client.0.smithi070.stderr: -242> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient: _reopen_session rank -1 2024-09-12T00:54:12.830 INFO:tasks.workunit.client.0.smithi070.stderr: -241> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:54:12.830 INFO:tasks.workunit.client.0.smithi070.stderr: -240> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): picked mon.noname-b con 0x55ebe3e33900 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:54:12.830 INFO:tasks.workunit.client.0.smithi070.stderr: -239> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): picked mon.noname-a con 0x55ebe3e68f30 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:54:12.830 INFO:tasks.workunit.client.0.smithi070.stderr: -238> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): picked mon.noname-c con 0x55ebe3e5e2b0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:54:12.830 INFO:tasks.workunit.client.0.smithi070.stderr: -237> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:12.830 INFO:tasks.workunit.client.0.smithi070.stderr: -236> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:12.830 INFO:tasks.workunit.client.0.smithi070.stderr: -235> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:12.830 INFO:tasks.workunit.client.0.smithi070.stderr: -234> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): _renew_subs 2024-09-12T00:54:12.830 INFO:tasks.workunit.client.0.smithi070.stderr: -233> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): authenticate will time out at 2102.916173s 2024-09-12T00:54:12.830 INFO:tasks.workunit.client.0.smithi070.stderr: -232> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): get_auth_request con 0x55ebe3e68f30 auth_method 0 2024-09-12T00:54:12.830 INFO:tasks.workunit.client.0.smithi070.stderr: -231> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:12.830 INFO:tasks.workunit.client.0.smithi070.stderr: -230> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:12.831 INFO:tasks.workunit.client.0.smithi070.stderr: -229> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:12.831 INFO:tasks.workunit.client.0.smithi070.stderr: -228> 2024-09-12T00:54:12.468+0000 7fee05fdd640 10 monclient(hunting): get_auth_request con 0x55ebe3e5e2b0 auth_method 0 2024-09-12T00:54:12.831 INFO:tasks.workunit.client.0.smithi070.stderr: -227> 2024-09-12T00:54:12.468+0000 7fee05fdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:12.831 INFO:tasks.workunit.client.0.smithi070.stderr: -226> 2024-09-12T00:54:12.468+0000 7fee05fdd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:12.831 INFO:tasks.workunit.client.0.smithi070.stderr: -225> 2024-09-12T00:54:12.468+0000 7fee05fdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:12.831 INFO:tasks.workunit.client.0.smithi070.stderr: -224> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:12.831 INFO:tasks.workunit.client.0.smithi070.stderr: -223> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:12.831 INFO:tasks.workunit.client.0.smithi070.stderr: -222> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:12.831 INFO:tasks.workunit.client.0.smithi070.stderr: -221> 2024-09-12T00:54:12.468+0000 7fee05fdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:12.831 INFO:tasks.workunit.client.0.smithi070.stderr: -220> 2024-09-12T00:54:12.468+0000 7fee05fdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:12.831 INFO:tasks.workunit.client.0.smithi070.stderr: -219> 2024-09-12T00:54:12.468+0000 7fee05fdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:12.831 INFO:tasks.workunit.client.0.smithi070.stderr: -218> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): handle_auth_done global_id 6378 payload 274 2024-09-12T00:54:12.831 INFO:tasks.workunit.client.0.smithi070.stderr: -217> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient: _finish_hunting 0 2024-09-12T00:54:12.831 INFO:tasks.workunit.client.0.smithi070.stderr: -216> 2024-09-12T00:54:12.468+0000 7fee04fdb640 1 monclient: found mon.noname-a 2024-09-12T00:54:12.832 INFO:tasks.workunit.client.0.smithi070.stderr: -215> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:54:12.832 INFO:tasks.workunit.client.0.smithi070.stderr: -214> 2024-09-12T00:54:12.468+0000 7fece8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:12.832 INFO:tasks.workunit.client.0.smithi070.stderr: -213> 2024-09-12T00:54:12.468+0000 7fece8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:12.832 INFO:tasks.workunit.client.0.smithi070.stderr: -212> 2024-09-12T00:54:12.468+0000 7fece8ff9640 10 monclient: dump: 2024-09-12T00:54:12.832 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:12.832 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:12.832 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.832 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.832 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:12.832 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.832 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:12.832 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:12.832 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:12.833 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.833 INFO:tasks.workunit.client.0.smithi070.stderr: -211> 2024-09-12T00:54:12.468+0000 7fece8ff9640 10 monclient: _finish_auth 0 2024-09-12T00:54:12.833 INFO:tasks.workunit.client.0.smithi070.stderr: -210> 2024-09-12T00:54:12.468+0000 7fece8ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:54:12.833 INFO:tasks.workunit.client.0.smithi070.stderr: -209> 2024-09-12T00:54:12.468+0000 7fece8ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:12.833 INFO:tasks.workunit.client.0.smithi070.stderr: -208> 2024-09-12T00:54:12.468+0000 7fece8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:12.833 INFO:tasks.workunit.client.0.smithi070.stderr: -207> 2024-09-12T00:54:12.468+0000 7fece8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:12.833 INFO:tasks.workunit.client.0.smithi070.stderr: -206> 2024-09-12T00:54:12.468+0000 7fece8ff9640 10 monclient: dump: 2024-09-12T00:54:12.833 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:12.833 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:12.833 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.833 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.833 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:12.834 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.834 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:12.834 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:12.834 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:12.834 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.834 INFO:tasks.workunit.client.0.smithi070.stderr: -205> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 monclient: authenticate success, global_id 6378 2024-09-12T00:54:12.834 INFO:tasks.workunit.client.0.smithi070.stderr: -204> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient: get_monmap_and_config success 2024-09-12T00:54:12.834 INFO:tasks.workunit.client.0.smithi070.stderr: -203> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 4 set_mon_vals no callback set 2024-09-12T00:54:12.834 INFO:tasks.workunit.client.0.smithi070.stderr: -202> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient: shutdown 2024-09-12T00:54:12.834 INFO:tasks.workunit.client.0.smithi070.stderr: -201> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient: build_initial_monmap 2024-09-12T00:54:12.834 INFO:tasks.workunit.client.0.smithi070.stderr: -200> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 1 build_initial for_mkfs: 0 2024-09-12T00:54:12.834 INFO:tasks.workunit.client.0.smithi070.stderr: -199> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient: monmap: 2024-09-12T00:54:12.834 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:54:12.835 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:12.835 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:54:12.835 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:54:12.835 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:12.835 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.835 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:54:12.835 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:54:12.835 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:54:12.835 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.835 INFO:tasks.workunit.client.0.smithi070.stderr: -198> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding auth protocol: cephx 2024-09-12T00:54:12.835 INFO:tasks.workunit.client.0.smithi070.stderr: -197> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding auth protocol: cephx 2024-09-12T00:54:12.835 INFO:tasks.workunit.client.0.smithi070.stderr: -196> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding auth protocol: cephx 2024-09-12T00:54:12.835 INFO:tasks.workunit.client.0.smithi070.stderr: -195> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding con mode: secure 2024-09-12T00:54:12.836 INFO:tasks.workunit.client.0.smithi070.stderr: -194> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding con mode: crc 2024-09-12T00:54:12.836 INFO:tasks.workunit.client.0.smithi070.stderr: -193> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding con mode: secure 2024-09-12T00:54:12.836 INFO:tasks.workunit.client.0.smithi070.stderr: -192> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding con mode: crc 2024-09-12T00:54:12.836 INFO:tasks.workunit.client.0.smithi070.stderr: -191> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding con mode: secure 2024-09-12T00:54:12.836 INFO:tasks.workunit.client.0.smithi070.stderr: -190> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding con mode: crc 2024-09-12T00:54:12.836 INFO:tasks.workunit.client.0.smithi070.stderr: -189> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding con mode: crc 2024-09-12T00:54:12.836 INFO:tasks.workunit.client.0.smithi070.stderr: -188> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding con mode: secure 2024-09-12T00:54:12.836 INFO:tasks.workunit.client.0.smithi070.stderr: -187> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding con mode: crc 2024-09-12T00:54:12.836 INFO:tasks.workunit.client.0.smithi070.stderr: -186> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding con mode: secure 2024-09-12T00:54:12.836 INFO:tasks.workunit.client.0.smithi070.stderr: -185> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding con mode: crc 2024-09-12T00:54:12.836 INFO:tasks.workunit.client.0.smithi070.stderr: -184> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding con mode: secure 2024-09-12T00:54:12.836 INFO:tasks.workunit.client.0.smithi070.stderr: -183> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:12.836 INFO:tasks.workunit.client.0.smithi070.stderr: -182> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 1 librados: starting msgr at 2024-09-12T00:54:12.836 INFO:tasks.workunit.client.0.smithi070.stderr: -181> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 1 librados: starting objecter 2024-09-12T00:54:12.837 INFO:tasks.workunit.client.0.smithi070.stderr: -180> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command objecter_requests cmddesc objecter_requests hook 0x55ebe3e0f800 EEXIST 2024-09-12T00:54:12.837 INFO:tasks.workunit.client.0.smithi070.stderr: -179> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 1 librados: setting wanted keys 2024-09-12T00:54:12.837 INFO:tasks.workunit.client.0.smithi070.stderr: -178> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 1 librados: calling monclient init 2024-09-12T00:54:12.837 INFO:tasks.workunit.client.0.smithi070.stderr: -177> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient: init 2024-09-12T00:54:12.837 INFO:tasks.workunit.client.0.smithi070.stderr: -176> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding auth protocol: cephx 2024-09-12T00:54:12.837 INFO:tasks.workunit.client.0.smithi070.stderr: -175> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding auth protocol: cephx 2024-09-12T00:54:12.837 INFO:tasks.workunit.client.0.smithi070.stderr: -174> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding auth protocol: cephx 2024-09-12T00:54:12.837 INFO:tasks.workunit.client.0.smithi070.stderr: -173> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding con mode: secure 2024-09-12T00:54:12.837 INFO:tasks.workunit.client.0.smithi070.stderr: -172> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding con mode: crc 2024-09-12T00:54:12.837 INFO:tasks.workunit.client.0.smithi070.stderr: -171> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding con mode: secure 2024-09-12T00:54:12.837 INFO:tasks.workunit.client.0.smithi070.stderr: -170> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding con mode: crc 2024-09-12T00:54:12.837 INFO:tasks.workunit.client.0.smithi070.stderr: -169> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding con mode: secure 2024-09-12T00:54:12.838 INFO:tasks.workunit.client.0.smithi070.stderr: -168> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding con mode: crc 2024-09-12T00:54:12.838 INFO:tasks.workunit.client.0.smithi070.stderr: -167> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding con mode: crc 2024-09-12T00:54:12.838 INFO:tasks.workunit.client.0.smithi070.stderr: -166> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding con mode: secure 2024-09-12T00:54:12.838 INFO:tasks.workunit.client.0.smithi070.stderr: -165> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding con mode: crc 2024-09-12T00:54:12.838 INFO:tasks.workunit.client.0.smithi070.stderr: -164> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding con mode: secure 2024-09-12T00:54:12.838 INFO:tasks.workunit.client.0.smithi070.stderr: -163> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding con mode: crc 2024-09-12T00:54:12.838 INFO:tasks.workunit.client.0.smithi070.stderr: -162> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding con mode: secure 2024-09-12T00:54:12.838 INFO:tasks.workunit.client.0.smithi070.stderr: -161> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:12.838 INFO:tasks.workunit.client.0.smithi070.stderr: -160> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:12.838 INFO:tasks.workunit.client.0.smithi070.stderr: -159> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command rotate-key cmddesc rotate-key hook 0x55ebe3e10cf8 EEXIST 2024-09-12T00:54:12.838 INFO:tasks.workunit.client.0.smithi070.stderr: -158> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient: _reopen_session rank -1 2024-09-12T00:54:12.838 INFO:tasks.workunit.client.0.smithi070.stderr: -157> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:54:12.838 INFO:tasks.workunit.client.0.smithi070.stderr: -156> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): picked mon.noname-c con 0x55ebe3e33900 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:54:12.839 INFO:tasks.workunit.client.0.smithi070.stderr: -155> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): picked mon.noname-a con 0x55ebe3e5e2b0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:54:12.839 INFO:tasks.workunit.client.0.smithi070.stderr: -154> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): picked mon.noname-b con 0x55ebe3e68f30 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:54:12.839 INFO:tasks.workunit.client.0.smithi070.stderr: -153> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:12.839 INFO:tasks.workunit.client.0.smithi070.stderr: -152> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:12.839 INFO:tasks.workunit.client.0.smithi070.stderr: -151> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:12.839 INFO:tasks.workunit.client.0.smithi070.stderr: -150> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): _renew_subs 2024-09-12T00:54:12.839 INFO:tasks.workunit.client.0.smithi070.stderr: -149> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): authenticate will time out at 2102.918807s 2024-09-12T00:54:12.839 INFO:tasks.workunit.client.0.smithi070.stderr: -148> 2024-09-12T00:54:12.468+0000 7fee057dc640 10 monclient(hunting): get_auth_request con 0x55ebe3e33900 auth_method 0 2024-09-12T00:54:12.839 INFO:tasks.workunit.client.0.smithi070.stderr: -147> 2024-09-12T00:54:12.468+0000 7fee057dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:12.839 INFO:tasks.workunit.client.0.smithi070.stderr: -146> 2024-09-12T00:54:12.468+0000 7fee057dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:12.839 INFO:tasks.workunit.client.0.smithi070.stderr: -145> 2024-09-12T00:54:12.468+0000 7fee057dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:12.839 INFO:tasks.workunit.client.0.smithi070.stderr: -144> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): get_auth_request con 0x55ebe3e5e2b0 auth_method 0 2024-09-12T00:54:12.839 INFO:tasks.workunit.client.0.smithi070.stderr: -143> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:12.839 INFO:tasks.workunit.client.0.smithi070.stderr: -142> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:12.840 INFO:tasks.workunit.client.0.smithi070.stderr: -141> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:12.840 INFO:tasks.workunit.client.0.smithi070.stderr: -140> 2024-09-12T00:54:12.468+0000 7fee057dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:12.840 INFO:tasks.workunit.client.0.smithi070.stderr: -139> 2024-09-12T00:54:12.468+0000 7fee057dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:12.840 INFO:tasks.workunit.client.0.smithi070.stderr: -138> 2024-09-12T00:54:12.468+0000 7fee057dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:12.840 INFO:tasks.workunit.client.0.smithi070.stderr: -137> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:12.840 INFO:tasks.workunit.client.0.smithi070.stderr: -136> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:12.840 INFO:tasks.workunit.client.0.smithi070.stderr: -135> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:12.840 INFO:tasks.workunit.client.0.smithi070.stderr: -134> 2024-09-12T00:54:12.468+0000 7fee057dc640 10 monclient(hunting): handle_auth_done global_id 6086 payload 824 2024-09-12T00:54:12.840 INFO:tasks.workunit.client.0.smithi070.stderr: -133> 2024-09-12T00:54:12.468+0000 7fee057dc640 10 monclient: _finish_hunting 0 2024-09-12T00:54:12.840 INFO:tasks.workunit.client.0.smithi070.stderr: -132> 2024-09-12T00:54:12.468+0000 7fee057dc640 1 monclient: found mon.noname-c 2024-09-12T00:54:12.840 INFO:tasks.workunit.client.0.smithi070.stderr: -131> 2024-09-12T00:54:12.468+0000 7fee057dc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:54:12.840 INFO:tasks.workunit.client.0.smithi070.stderr: -130> 2024-09-12T00:54:12.468+0000 7fecd6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:12.840 INFO:tasks.workunit.client.0.smithi070.stderr: -129> 2024-09-12T00:54:12.468+0000 7fecd6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:12.841 INFO:tasks.workunit.client.0.smithi070.stderr: -128> 2024-09-12T00:54:12.468+0000 7fecd6ffd640 10 monclient: dump: 2024-09-12T00:54:12.841 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:12.841 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:12.841 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.841 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.841 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:12.841 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.841 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:12.841 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:12.841 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:12.841 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.841 INFO:tasks.workunit.client.0.smithi070.stderr: -127> 2024-09-12T00:54:12.468+0000 7fecd6ffd640 10 monclient: _finish_auth 0 2024-09-12T00:54:12.841 INFO:tasks.workunit.client.0.smithi070.stderr: -126> 2024-09-12T00:54:12.468+0000 7fecd6ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:54:12.842 INFO:tasks.workunit.client.0.smithi070.stderr: -125> 2024-09-12T00:54:12.468+0000 7fecd6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:12.842 INFO:tasks.workunit.client.0.smithi070.stderr: -124> 2024-09-12T00:54:12.468+0000 7fecd6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:12.842 INFO:tasks.workunit.client.0.smithi070.stderr: -123> 2024-09-12T00:54:12.468+0000 7fecd6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:12.842 INFO:tasks.workunit.client.0.smithi070.stderr: -122> 2024-09-12T00:54:12.468+0000 7fecd6ffd640 10 monclient: dump: 2024-09-12T00:54:12.842 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:12.842 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:12.842 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.842 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.842 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:12.842 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.842 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:12.842 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:12.842 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:12.842 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.843 INFO:tasks.workunit.client.0.smithi070.stderr: -121> 2024-09-12T00:54:12.468+0000 7fece8ff9640 4 set_mon_vals no callback set 2024-09-12T00:54:12.843 INFO:tasks.workunit.client.0.smithi070.stderr: -120> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 monclient: authenticate success, global_id 6086 2024-09-12T00:54:12.843 INFO:tasks.workunit.client.0.smithi070.stderr: -119> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient: _renew_subs 2024-09-12T00:54:12.843 INFO:tasks.workunit.client.0.smithi070.stderr: -118> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:54:12.843 INFO:tasks.workunit.client.0.smithi070.stderr: -117> 2024-09-12T00:54:12.472+0000 7fee07cd69c0 10 monclient: _renew_subs 2024-09-12T00:54:12.843 INFO:tasks.workunit.client.0.smithi070.stderr: -116> 2024-09-12T00:54:12.472+0000 7fee07cd69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:54:12.843 INFO:tasks.workunit.client.0.smithi070.stderr: -115> 2024-09-12T00:54:12.472+0000 7fee07cd69c0 1 librados: init done 2024-09-12T00:54:12.843 INFO:tasks.workunit.client.0.smithi070.stderr: -114> 2024-09-12T00:54:12.472+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command cr dump hook 0x55ebe3e5c2d8 2024-09-12T00:54:12.843 INFO:tasks.workunit.client.0.smithi070.stderr: -113> 2024-09-12T00:54:12.472+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.843 INFO:tasks.workunit.client.0.smithi070.stderr: -112> 2024-09-12T00:54:12.472+0000 7fecd6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:12.843 INFO:tasks.workunit.client.0.smithi070.stderr: -111> 2024-09-12T00:54:12.472+0000 7fecd6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:54:12.843 INFO:tasks.workunit.client.0.smithi070.stderr: -110> 2024-09-12T00:54:12.472+0000 7fecd6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:54:12.843 INFO:tasks.workunit.client.0.smithi070.stderr: -109> 2024-09-12T00:54:12.472+0000 7fee05fdd640 10 monclient: get_auth_request con 0x55ebe3e7d6e0 auth_method 0 2024-09-12T00:54:12.843 INFO:tasks.workunit.client.0.smithi070.stderr: -108> 2024-09-12T00:54:12.472+0000 7fee04fdb640 10 monclient: get_auth_request con 0x7fecd0070ae0 auth_method 0 2024-09-12T00:54:12.844 INFO:tasks.workunit.client.0.smithi070.stderr: -107> 2024-09-12T00:54:12.472+0000 7fee07cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.844 INFO:tasks.workunit.client.0.smithi070.stderr: -106> 2024-09-12T00:54:12.472+0000 7fee07cd69c0 20 realm 2024-09-12T00:54:12.844 INFO:tasks.workunit.client.0.smithi070.stderr: -105> 2024-09-12T00:54:12.472+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.844 INFO:tasks.workunit.client.0.smithi070.stderr: -104> 2024-09-12T00:54:12.472+0000 7fee07cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.844 INFO:tasks.workunit.client.0.smithi070.stderr: -103> 2024-09-12T00:54:12.472+0000 7fee07cd69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:12.844 INFO:tasks.workunit.client.0.smithi070.stderr: -102> 2024-09-12T00:54:12.472+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.844 INFO:tasks.workunit.client.0.smithi070.stderr: -101> 2024-09-12T00:54:12.472+0000 7fee07cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.844 INFO:tasks.workunit.client.0.smithi070.stderr: -100> 2024-09-12T00:54:12.472+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.844 INFO:tasks.workunit.client.0.smithi070.stderr: -99> 2024-09-12T00:54:12.472+0000 7fee057dc640 10 monclient: get_auth_request con 0x55ebe3e81ad0 auth_method 0 2024-09-12T00:54:12.844 INFO:tasks.workunit.client.0.smithi070.stderr: -98> 2024-09-12T00:54:12.476+0000 7fee07cd69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:12.844 INFO:tasks.workunit.client.0.smithi070.stderr: -97> 2024-09-12T00:54:12.476+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.844 INFO:tasks.workunit.client.0.smithi070.stderr: -96> 2024-09-12T00:54:12.476+0000 7fee04fdb640 10 monclient: get_auth_request con 0x55ebe3e851f0 auth_method 0 2024-09-12T00:54:12.844 INFO:tasks.workunit.client.0.smithi070.stderr: -95> 2024-09-12T00:54:12.476+0000 7fee07cd69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:12.845 INFO:tasks.workunit.client.0.smithi070.stderr: -94> 2024-09-12T00:54:12.476+0000 7fee07cd69c0 20 searching for the correct realm 2024-09-12T00:54:12.845 INFO:tasks.workunit.client.0.smithi070.stderr: -93> 2024-09-12T00:54:12.476+0000 7fee05fdd640 10 monclient: get_auth_request con 0x55ebe3e89f70 auth_method 0 2024-09-12T00:54:12.845 INFO:tasks.workunit.client.0.smithi070.stderr: -92> 2024-09-12T00:54:12.476+0000 7fee057dc640 10 monclient: get_auth_request con 0x7fee00018040 auth_method 0 2024-09-12T00:54:12.845 INFO:tasks.workunit.client.0.smithi070.stderr: -91> 2024-09-12T00:54:12.480+0000 7fee04fdb640 10 monclient: get_auth_request con 0x7fedf0008040 auth_method 0 2024-09-12T00:54:12.845 INFO:tasks.workunit.client.0.smithi070.stderr: -90> 2024-09-12T00:54:12.480+0000 7fee05fdd640 10 monclient: get_auth_request con 0x7fedf80f7bf0 auth_method 0 2024-09-12T00:54:12.845 INFO:tasks.workunit.client.0.smithi070.stderr: -89> 2024-09-12T00:54:12.480+0000 7fee05fdd640 0 -- 172.21.15.70:0/448923671 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fedf80f7bf0 msgr2=0x7fedf8100a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:12.845 INFO:tasks.workunit.client.0.smithi070.stderr: -88> 2024-09-12T00:54:12.684+0000 7fee05fdd640 10 monclient: get_auth_request con 0x7fedf80f7bf0 auth_method 0 2024-09-12T00:54:12.845 INFO:tasks.workunit.client.0.smithi070.stderr: -87> 2024-09-12T00:54:12.688+0000 7fee057dc640 10 monclient: get_auth_request con 0x7fee00035930 auth_method 0 2024-09-12T00:54:12.845 INFO:tasks.workunit.client.0.smithi070.stderr: -86> 2024-09-12T00:54:12.696+0000 7fee05fdd640 0 -- 172.21.15.70:0/448923671 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fedf80f7bf0 msgr2=0x7fedf8100a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:12.845 INFO:tasks.workunit.client.0.smithi070.stderr: -85> 2024-09-12T00:54:12.696+0000 7fecd6ffd640 1 client.6086.objecter ms_handle_reset 0x7fedf80f7bf0 session 0x7fedf80a6070 osd.4 2024-09-12T00:54:12.845 INFO:tasks.workunit.client.0.smithi070.stderr: -84> 2024-09-12T00:54:12.696+0000 7fecd6ffd640 10 monclient: _renew_subs 2024-09-12T00:54:12.845 INFO:tasks.workunit.client.0.smithi070.stderr: -83> 2024-09-12T00:54:12.696+0000 7fecd6ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:54:12.845 INFO:tasks.workunit.client.0.smithi070.stderr: -82> 2024-09-12T00:54:12.696+0000 7fee05fdd640 10 monclient: get_auth_request con 0x7fecd0080880 auth_method 0 2024-09-12T00:54:12.846 INFO:tasks.workunit.client.0.smithi070.stderr: -81> 2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:12.846 INFO:tasks.workunit.client.0.smithi070.stderr: -80> 2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:12.846 INFO:tasks.workunit.client.0.smithi070.stderr: -79> 2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:12.846 INFO:tasks.workunit.client.0.smithi070.stderr: -78> 2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:12.846 INFO:tasks.workunit.client.0.smithi070.stderr: -77> 2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:12.846 INFO:tasks.workunit.client.0.smithi070.stderr: -76> 2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:12.846 INFO:tasks.workunit.client.0.smithi070.stderr: -75> 2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.846 INFO:tasks.workunit.client.0.smithi070.stderr: -74> 2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.846 INFO:tasks.workunit.client.0.smithi070.stderr: -73> 2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.846 INFO:tasks.workunit.client.0.smithi070.stderr: -72> 2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:12.846 INFO:tasks.workunit.client.0.smithi070.stderr: -71> 2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.846 INFO:tasks.workunit.client.0.smithi070.stderr: -70> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:12.846 INFO:tasks.workunit.client.0.smithi070.stderr: -69> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 zone default found 2024-09-12T00:54:12.846 INFO:tasks.workunit.client.0.smithi070.stderr: -68> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 4 Realm: () 2024-09-12T00:54:12.847 INFO:tasks.workunit.client.0.smithi070.stderr: -67> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:12.847 INFO:tasks.workunit.client.0.smithi070.stderr: -66> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:12.847 INFO:tasks.workunit.client.0.smithi070.stderr: -65> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:12.847 INFO:tasks.workunit.client.0.smithi070.stderr: -64> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 zonegroup default 2024-09-12T00:54:12.847 INFO:tasks.workunit.client.0.smithi070.stderr: -63> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.847 INFO:tasks.workunit.client.0.smithi070.stderr: -62> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.847 INFO:tasks.workunit.client.0.smithi070.stderr: -61> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.847 INFO:tasks.workunit.client.0.smithi070.stderr: -60> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.847 INFO:tasks.workunit.client.0.smithi070.stderr: -59> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.847 INFO:tasks.workunit.client.0.smithi070.stderr: -58> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.847 INFO:tasks.workunit.client.0.smithi070.stderr: -57> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 started sync module instance, tier type = 2024-09-12T00:54:12.847 INFO:tasks.workunit.client.0.smithi070.stderr: -56> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:12.847 INFO:tasks.workunit.client.0.smithi070.stderr: -55> 2024-09-12T00:54:12.736+0000 7fee07cd69c0 20 add_watcher() i=0 2024-09-12T00:54:12.848 INFO:tasks.workunit.client.0.smithi070.stderr: -54> 2024-09-12T00:54:12.736+0000 7fee07cd69c0 20 add_watcher() i=1 2024-09-12T00:54:12.848 INFO:tasks.workunit.client.0.smithi070.stderr: -53> 2024-09-12T00:54:12.736+0000 7fee07cd69c0 20 add_watcher() i=2 2024-09-12T00:54:12.848 INFO:tasks.workunit.client.0.smithi070.stderr: -52> 2024-09-12T00:54:12.736+0000 7fee07cd69c0 20 add_watcher() i=3 2024-09-12T00:54:12.848 INFO:tasks.workunit.client.0.smithi070.stderr: -51> 2024-09-12T00:54:12.736+0000 7fee07cd69c0 20 add_watcher() i=4 2024-09-12T00:54:12.848 INFO:tasks.workunit.client.0.smithi070.stderr: -50> 2024-09-12T00:54:12.736+0000 7fee07cd69c0 20 add_watcher() i=5 2024-09-12T00:54:12.848 INFO:tasks.workunit.client.0.smithi070.stderr: -49> 2024-09-12T00:54:12.736+0000 7fee07cd69c0 20 add_watcher() i=6 2024-09-12T00:54:12.848 INFO:tasks.workunit.client.0.smithi070.stderr: -48> 2024-09-12T00:54:12.740+0000 7fee07cd69c0 20 add_watcher() i=7 2024-09-12T00:54:12.848 INFO:tasks.workunit.client.0.smithi070.stderr: -47> 2024-09-12T00:54:12.740+0000 7fee07cd69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:12.848 INFO:tasks.workunit.client.0.smithi070.stderr: -46> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding auth protocol: cephx 2024-09-12T00:54:12.848 INFO:tasks.workunit.client.0.smithi070.stderr: -45> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding auth protocol: cephx 2024-09-12T00:54:12.848 INFO:tasks.workunit.client.0.smithi070.stderr: -44> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding auth protocol: cephx 2024-09-12T00:54:12.848 INFO:tasks.workunit.client.0.smithi070.stderr: -43> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding con mode: secure 2024-09-12T00:54:12.848 INFO:tasks.workunit.client.0.smithi070.stderr: -42> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding con mode: crc 2024-09-12T00:54:12.849 INFO:tasks.workunit.client.0.smithi070.stderr: -41> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding con mode: secure 2024-09-12T00:54:12.849 INFO:tasks.workunit.client.0.smithi070.stderr: -40> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding con mode: crc 2024-09-12T00:54:12.849 INFO:tasks.workunit.client.0.smithi070.stderr: -39> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding con mode: secure 2024-09-12T00:54:12.849 INFO:tasks.workunit.client.0.smithi070.stderr: -38> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding con mode: crc 2024-09-12T00:54:12.849 INFO:tasks.workunit.client.0.smithi070.stderr: -37> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding con mode: crc 2024-09-12T00:54:12.849 INFO:tasks.workunit.client.0.smithi070.stderr: -36> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding con mode: secure 2024-09-12T00:54:12.849 INFO:tasks.workunit.client.0.smithi070.stderr: -35> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding con mode: crc 2024-09-12T00:54:12.849 INFO:tasks.workunit.client.0.smithi070.stderr: -34> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding con mode: secure 2024-09-12T00:54:12.849 INFO:tasks.workunit.client.0.smithi070.stderr: -33> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding con mode: crc 2024-09-12T00:54:12.849 INFO:tasks.workunit.client.0.smithi070.stderr: -32> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding con mode: secure 2024-09-12T00:54:12.849 INFO:tasks.workunit.client.0.smithi070.stderr: -31> 2024-09-12T00:54:12.744+0000 7fecbbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:12.849 INFO:tasks.workunit.client.0.smithi070.stderr: -30> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:12.849 INFO:tasks.workunit.client.0.smithi070.stderr: -29> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:12.850 INFO:tasks.workunit.client.0.smithi070.stderr: -28> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:12.850 INFO:tasks.workunit.client.0.smithi070.stderr: -27> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command cache list hook 0x55ebe3e61c40 2024-09-12T00:54:12.850 INFO:tasks.workunit.client.0.smithi070.stderr: -26> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command cache inspect hook 0x55ebe3e61c40 2024-09-12T00:54:12.850 INFO:tasks.workunit.client.0.smithi070.stderr: -25> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command cache erase hook 0x55ebe3e61c40 2024-09-12T00:54:12.850 INFO:tasks.workunit.client.0.smithi070.stderr: -24> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command cache zap hook 0x55ebe3e61c40 2024-09-12T00:54:12.850 INFO:tasks.workunit.client.0.smithi070.stderr: -23> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 note: GC not initialized 2024-09-12T00:54:12.850 INFO:tasks.workunit.client.0.smithi070.stderr: -22> 2024-09-12T00:54:12.744+0000 7fecbafe5640 20 reqs_thread_entry: start 2024-09-12T00:54:12.850 INFO:tasks.workunit.client.0.smithi070.stderr: -21> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command sync trace show hook 0x7fee00001690 2024-09-12T00:54:12.850 INFO:tasks.workunit.client.0.smithi070.stderr: -20> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command sync trace history hook 0x7fee00001690 2024-09-12T00:54:12.850 INFO:tasks.workunit.client.0.smithi070.stderr: -19> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command sync trace active hook 0x7fee00001690 2024-09-12T00:54:12.850 INFO:tasks.workunit.client.0.smithi070.stderr: -18> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command sync trace active_short hook 0x7fee00001690 2024-09-12T00:54:12.850 INFO:tasks.workunit.client.0.smithi070.stderr: -17> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:12.850 INFO:tasks.workunit.client.0.smithi070.stderr: -16> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 20 Filter name: none 2024-09-12T00:54:12.850 INFO:tasks.workunit.client.0.smithi070.stderr: -15> 2024-09-12T00:54:12.744+0000 7fecb8fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:12.851 INFO:tasks.workunit.client.0.smithi070.stderr: -14> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:54:12.851 INFO:tasks.workunit.client.0.smithi070.stderr: -13> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.851 INFO:tasks.workunit.client.0.smithi070.stderr: -12> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:54:12.851 INFO:tasks.workunit.client.0.smithi070.stderr: -11> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:54:12.851 INFO:tasks.workunit.client.0.smithi070.stderr: -10> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:54:12.851 INFO:tasks.workunit.client.0.smithi070.stderr: -9> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 : miss 2024-09-12T00:54:12.851 INFO:tasks.workunit.client.0.smithi070.stderr: -8> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.851 INFO:tasks.workunit.client.0.smithi070.stderr: -7> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:54:12.851 INFO:tasks.workunit.client.0.smithi070.stderr: -6> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 info.flags=0x17 2024-09-12T00:54:12.851 INFO:tasks.workunit.client.0.smithi070.stderr: -5> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 to cache LRU end 2024-09-12T00:54:12.851 INFO:tasks.workunit.client.0.smithi070.stderr: -4> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:12.851 INFO:tasks.workunit.client.0.smithi070.stderr: -3> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:12.851 INFO:tasks.workunit.client.0.smithi070.stderr: -2> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 2024-09-12T00:54:12.851 INFO:tasks.workunit.client.0.smithi070.stderr: -1> 2024-09-12T00:54:12.752+0000 7fee07cd69c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fee07cd69c0 time 2024-09-12T00:54:12.753413+0000 2024-09-12T00:54:12.852 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:12.852 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.852 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:12.852 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fee0b5b02eb] 2024-09-12T00:54:12.852 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fee0b5b049f] 2024-09-12T00:54:12.852 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ebe23c1cc1] 2024-09-12T00:54:12.852 INFO:tasks.workunit.client.0.smithi070.stderr: 4: radosgw-admin(+0x1421f32) [0x55ebe2e1ef32] 2024-09-12T00:54:12.852 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ebe23d6ced] 2024-09-12T00:54:12.852 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:54:12.852 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fee0a416d90] 2024-09-12T00:54:12.852 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:54:12.852 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:54:12.853 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.853 INFO:tasks.workunit.client.0.smithi070.stderr: 0> 2024-09-12T00:54:12.756+0000 7fee07cd69c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:54:12.853 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7fee07cd69c0 thread_name:radosgw-admin 2024-09-12T00:54:12.853 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.853 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:12.853 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fee0a42f520] 2024-09-12T00:54:12.853 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:54:12.853 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:54:12.853 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:54:12.853 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fee0b5b0345] 2024-09-12T00:54:12.853 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fee0b5b049f] 2024-09-12T00:54:12.853 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ebe23c1cc1] 2024-09-12T00:54:12.853 INFO:tasks.workunit.client.0.smithi070.stderr: 8: radosgw-admin(+0x1421f32) [0x55ebe2e1ef32] 2024-09-12T00:54:12.854 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ebe23d6ced] 2024-09-12T00:54:12.854 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:54:12.854 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fee0a416d90] 2024-09-12T00:54:12.854 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:54:12.854 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:54:12.854 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:54:12.854 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.854 INFO:tasks.workunit.client.0.smithi070.stderr:--- logging levels --- 2024-09-12T00:54:12.854 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 none 2024-09-12T00:54:12.854 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 lockdep 2024-09-12T00:54:12.854 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 context 2024-09-12T00:54:12.854 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 crush 2024-09-12T00:54:12.854 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds 2024-09-12T00:54:12.855 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_balancer 2024-09-12T00:54:12.855 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_locker 2024-09-12T00:54:12.855 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log 2024-09-12T00:54:12.855 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log_expire 2024-09-12T00:54:12.855 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_migrator 2024-09-12T00:54:12.855 INFO:tasks.workunit.client.0.smithi070.stderr: 3/ 5 mds_quiesce 2024-09-12T00:54:12.855 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 buffer 2024-09-12T00:54:12.855 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 timer 2024-09-12T00:54:12.855 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 filer 2024-09-12T00:54:12.855 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 striper 2024-09-12T00:54:12.855 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 objecter 2024-09-12T00:54:12.855 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rados 2024-09-12T00:54:12.855 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd 2024-09-12T00:54:12.855 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_mirror 2024-09-12T00:54:12.856 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_replay 2024-09-12T00:54:12.856 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_pwl 2024-09-12T00:54:12.856 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 journaler 2024-09-12T00:54:12.856 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objectcacher 2024-09-12T00:54:12.856 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:54:12.856 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 client 2024-09-12T00:54:12.856 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 osd 2024-09-12T00:54:12.856 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 optracker 2024-09-12T00:54:12.856 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objclass 2024-09-12T00:54:12.856 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 filestore 2024-09-12T00:54:12.856 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 journal 2024-09-12T00:54:12.856 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 ms 2024-09-12T00:54:12.856 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mon 2024-09-12T00:54:12.857 INFO:tasks.workunit.client.0.smithi070.stderr: 0/10 monc 2024-09-12T00:54:12.857 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 paxos 2024-09-12T00:54:12.857 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 tp 2024-09-12T00:54:12.857 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 auth 2024-09-12T00:54:12.857 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 crypto 2024-09-12T00:54:12.857 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 finisher 2024-09-12T00:54:12.857 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 reserver 2024-09-12T00:54:12.857 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 heartbeatmap 2024-09-12T00:54:12.857 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 perfcounter 2024-09-12T00:54:12.857 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw 2024-09-12T00:54:12.857 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_sync 2024-09-12T00:54:12.857 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_datacache 2024-09-12T00:54:12.857 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_access 2024-09-12T00:54:12.857 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:54:12.858 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_flight 2024-09-12T00:54:12.858 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:54:12.858 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw_notification 2024-09-12T00:54:12.858 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 javaclient 2024-09-12T00:54:12.858 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 asok 2024-09-12T00:54:12.858 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 throttle 2024-09-12T00:54:12.858 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 refs 2024-09-12T00:54:12.858 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 compressor 2024-09-12T00:54:12.858 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluestore 2024-09-12T00:54:12.858 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluefs 2024-09-12T00:54:12.858 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 bdev 2024-09-12T00:54:12.858 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 kstore 2024-09-12T00:54:12.858 INFO:tasks.workunit.client.0.smithi070.stderr: 4/ 5 rocksdb 2024-09-12T00:54:12.858 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 fuse 2024-09-12T00:54:12.858 INFO:tasks.workunit.client.0.smithi070.stderr: 2/ 5 mgr 2024-09-12T00:54:12.859 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mgrc 2024-09-12T00:54:12.859 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 dpdk 2024-09-12T00:54:12.859 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 eventtrace 2024-09-12T00:54:12.859 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 prioritycache 2024-09-12T00:54:12.859 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 test 2024-09-12T00:54:12.859 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:54:12.859 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephsqlite 2024-09-12T00:54:12.859 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:54:12.859 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore 2024-09-12T00:54:12.859 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_onode 2024-09-12T00:54:12.859 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_odata 2024-09-12T00:54:12.859 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_omap 2024-09-12T00:54:12.860 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_tm 2024-09-12T00:54:12.860 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_t 2024-09-12T00:54:12.860 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:54:12.860 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_epm 2024-09-12T00:54:12.860 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_lba 2024-09-12T00:54:12.860 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:54:12.860 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cache 2024-09-12T00:54:12.860 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_journal 2024-09-12T00:54:12.860 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_device 2024-09-12T00:54:12.860 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_backref 2024-09-12T00:54:12.860 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 alienstore 2024-09-12T00:54:12.860 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mclock 2024-09-12T00:54:12.860 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cyanstore 2024-09-12T00:54:12.861 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 ceph_exporter 2024-09-12T00:54:12.861 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 memstore 2024-09-12T00:54:12.861 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 trace 2024-09-12T00:54:12.861 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 ceph_dedup 2024-09-12T00:54:12.861 INFO:tasks.workunit.client.0.smithi070.stderr: -2/-2 (syslog threshold) 2024-09-12T00:54:12.861 INFO:tasks.workunit.client.0.smithi070.stderr: 99/99 (stderr threshold) 2024-09-12T00:54:12.861 INFO:tasks.workunit.client.0.smithi070.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:54:12.861 INFO:tasks.workunit.client.0.smithi070.stderr: 7fecb8fe1640 / http_manager 2024-09-12T00:54:12.861 INFO:tasks.workunit.client.0.smithi070.stderr: 7fecbafe5640 / http_manager 2024-09-12T00:54:12.861 INFO:tasks.workunit.client.0.smithi070.stderr: 7fecbbfe7640 / rgw_dt_lg_renew 2024-09-12T00:54:12.861 INFO:tasks.workunit.client.0.smithi070.stderr: 7fecd6ffd640 / ms_dispatch 2024-09-12T00:54:12.861 INFO:tasks.workunit.client.0.smithi070.stderr: 7fece8ff9640 / io_context_pool 2024-09-12T00:54:12.861 INFO:tasks.workunit.client.0.smithi070.stderr: 7feceaffd640 / ms_dispatch 2024-09-12T00:54:12.862 INFO:tasks.workunit.client.0.smithi070.stderr: 7fecf1e03640 / ms_dispatch 2024-09-12T00:54:12.862 INFO:tasks.workunit.client.0.smithi070.stderr: 7fecf3606640 / io_context_pool 2024-09-12T00:54:12.862 INFO:tasks.workunit.client.0.smithi070.stderr: 7fee04fdb640 / msgr-worker-2 2024-09-12T00:54:12.862 INFO:tasks.workunit.client.0.smithi070.stderr: 7fee057dc640 / msgr-worker-1 2024-09-12T00:54:12.862 INFO:tasks.workunit.client.0.smithi070.stderr: 7fee05fdd640 / msgr-worker-0 2024-09-12T00:54:12.862 INFO:tasks.workunit.client.0.smithi070.stderr: 7fee067de640 / io_context_pool 2024-09-12T00:54:12.862 INFO:tasks.workunit.client.0.smithi070.stderr: 7fee07cd69c0 / radosgw-admin 2024-09-12T00:54:12.862 INFO:tasks.workunit.client.0.smithi070.stderr: max_recent 500 2024-09-12T00:54:12.862 INFO:tasks.workunit.client.0.smithi070.stderr: max_new 1000 2024-09-12T00:54:12.862 INFO:tasks.workunit.client.0.smithi070.stderr: log_file /var/log/ceph/ceph-client.admin.83131.log 2024-09-12T00:54:12.862 INFO:tasks.workunit.client.0.smithi070.stderr:--- end dump of recent events --- 2024-09-12T00:54:12.862 INFO:tasks.workunit.client.0.smithi070.stderr:--- begin dump of recent events --- 2024-09-12T00:54:12.862 INFO:tasks.workunit.client.0.smithi070.stderr: -499> 2024-09-12T00:54:12.448+0000 7fee07cd69c0 10 monclient(hunting): _renew_subs 2024-09-12T00:54:12.862 INFO:tasks.workunit.client.0.smithi070.stderr: -498> 2024-09-12T00:54:12.448+0000 7fee07cd69c0 10 monclient(hunting): authenticate will time out at 2102.899991s 2024-09-12T00:54:12.863 INFO:tasks.workunit.client.0.smithi070.stderr: -497> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): get_auth_request con 0x55ebe3cdf920 auth_method 0 2024-09-12T00:54:12.863 INFO:tasks.workunit.client.0.smithi070.stderr: -496> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:12.863 INFO:tasks.workunit.client.0.smithi070.stderr: -495> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:12.863 INFO:tasks.workunit.client.0.smithi070.stderr: -494> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:12.863 INFO:tasks.workunit.client.0.smithi070.stderr: -493> 2024-09-12T00:54:12.452+0000 7fee057dc640 10 monclient(hunting): get_auth_request con 0x55ebe3c53230 auth_method 0 2024-09-12T00:54:12.863 INFO:tasks.workunit.client.0.smithi070.stderr: -492> 2024-09-12T00:54:12.452+0000 7fee057dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:12.863 INFO:tasks.workunit.client.0.smithi070.stderr: -491> 2024-09-12T00:54:12.452+0000 7fee057dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:12.863 INFO:tasks.workunit.client.0.smithi070.stderr: -490> 2024-09-12T00:54:12.452+0000 7fee057dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:12.863 INFO:tasks.workunit.client.0.smithi070.stderr: -489> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:12.863 INFO:tasks.workunit.client.0.smithi070.stderr: -488> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:12.863 INFO:tasks.workunit.client.0.smithi070.stderr: -487> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:12.863 INFO:tasks.workunit.client.0.smithi070.stderr: -486> 2024-09-12T00:54:12.452+0000 7fee057dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:12.863 INFO:tasks.workunit.client.0.smithi070.stderr: -485> 2024-09-12T00:54:12.452+0000 7fee057dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:12.864 INFO:tasks.workunit.client.0.smithi070.stderr: -484> 2024-09-12T00:54:12.452+0000 7fee057dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:12.864 INFO:tasks.workunit.client.0.smithi070.stderr: -483> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): handle_auth_done global_id 6074 payload 274 2024-09-12T00:54:12.864 INFO:tasks.workunit.client.0.smithi070.stderr: -482> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient: _finish_hunting 0 2024-09-12T00:54:12.864 INFO:tasks.workunit.client.0.smithi070.stderr: -481> 2024-09-12T00:54:12.452+0000 7fee04fdb640 1 monclient: found mon.noname-c 2024-09-12T00:54:12.864 INFO:tasks.workunit.client.0.smithi070.stderr: -480> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:54:12.864 INFO:tasks.workunit.client.0.smithi070.stderr: -479> 2024-09-12T00:54:12.452+0000 7fecf3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:12.864 INFO:tasks.workunit.client.0.smithi070.stderr: -478> 2024-09-12T00:54:12.452+0000 7fecf3606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:12.864 INFO:tasks.workunit.client.0.smithi070.stderr: -477> 2024-09-12T00:54:12.452+0000 7fecf3606640 10 monclient: dump: 2024-09-12T00:54:12.864 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:12.864 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:12.864 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.864 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.864 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:12.865 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.865 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:12.865 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:12.865 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:12.865 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.865 INFO:tasks.workunit.client.0.smithi070.stderr: -476> 2024-09-12T00:54:12.452+0000 7fecf3606640 10 monclient: _finish_auth 0 2024-09-12T00:54:12.865 INFO:tasks.workunit.client.0.smithi070.stderr: -475> 2024-09-12T00:54:12.452+0000 7fecf3606640 10 monclient: _check_auth_tickets 2024-09-12T00:54:12.865 INFO:tasks.workunit.client.0.smithi070.stderr: -474> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 monclient: authenticate success, global_id 6074 2024-09-12T00:54:12.865 INFO:tasks.workunit.client.0.smithi070.stderr: -473> 2024-09-12T00:54:12.452+0000 7fecf3606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:12.865 INFO:tasks.workunit.client.0.smithi070.stderr: -472> 2024-09-12T00:54:12.452+0000 7fecf3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:12.865 INFO:tasks.workunit.client.0.smithi070.stderr: -471> 2024-09-12T00:54:12.452+0000 7fecf3606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:12.865 INFO:tasks.workunit.client.0.smithi070.stderr: -470> 2024-09-12T00:54:12.452+0000 7fecf3606640 10 monclient: dump: 2024-09-12T00:54:12.865 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:12.866 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:12.866 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.866 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.866 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:12.866 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.866 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:12.866 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:12.866 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:12.866 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.866 INFO:tasks.workunit.client.0.smithi070.stderr: -469> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient: get_monmap_and_config success 2024-09-12T00:54:12.866 INFO:tasks.workunit.client.0.smithi070.stderr: -468> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 4 set_mon_vals no callback set 2024-09-12T00:54:12.866 INFO:tasks.workunit.client.0.smithi070.stderr: -467> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient: shutdown 2024-09-12T00:54:12.866 INFO:tasks.workunit.client.0.smithi070.stderr: -466> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) unregister_commands rotate-key 2024-09-12T00:54:12.867 INFO:tasks.workunit.client.0.smithi070.stderr: -465> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient: build_initial_monmap 2024-09-12T00:54:12.867 INFO:tasks.workunit.client.0.smithi070.stderr: -464> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 1 build_initial for_mkfs: 0 2024-09-12T00:54:12.867 INFO:tasks.workunit.client.0.smithi070.stderr: -463> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient: monmap: 2024-09-12T00:54:12.867 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:54:12.867 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:12.867 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:54:12.867 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:54:12.867 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:12.867 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.867 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:54:12.867 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:54:12.867 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:54:12.867 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.867 INFO:tasks.workunit.client.0.smithi070.stderr: -462> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding auth protocol: cephx 2024-09-12T00:54:12.868 INFO:tasks.workunit.client.0.smithi070.stderr: -461> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding auth protocol: cephx 2024-09-12T00:54:12.868 INFO:tasks.workunit.client.0.smithi070.stderr: -460> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding auth protocol: cephx 2024-09-12T00:54:12.868 INFO:tasks.workunit.client.0.smithi070.stderr: -459> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding con mode: secure 2024-09-12T00:54:12.868 INFO:tasks.workunit.client.0.smithi070.stderr: -458> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding con mode: crc 2024-09-12T00:54:12.868 INFO:tasks.workunit.client.0.smithi070.stderr: -457> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding con mode: secure 2024-09-12T00:54:12.868 INFO:tasks.workunit.client.0.smithi070.stderr: -456> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding con mode: crc 2024-09-12T00:54:12.868 INFO:tasks.workunit.client.0.smithi070.stderr: -455> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding con mode: secure 2024-09-12T00:54:12.868 INFO:tasks.workunit.client.0.smithi070.stderr: -454> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding con mode: crc 2024-09-12T00:54:12.868 INFO:tasks.workunit.client.0.smithi070.stderr: -453> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding con mode: crc 2024-09-12T00:54:12.868 INFO:tasks.workunit.client.0.smithi070.stderr: -452> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding con mode: secure 2024-09-12T00:54:12.868 INFO:tasks.workunit.client.0.smithi070.stderr: -451> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding con mode: crc 2024-09-12T00:54:12.868 INFO:tasks.workunit.client.0.smithi070.stderr: -450> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding con mode: secure 2024-09-12T00:54:12.868 INFO:tasks.workunit.client.0.smithi070.stderr: -449> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding con mode: crc 2024-09-12T00:54:12.869 INFO:tasks.workunit.client.0.smithi070.stderr: -448> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d99610) adding con mode: secure 2024-09-12T00:54:12.869 INFO:tasks.workunit.client.0.smithi070.stderr: -447> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:12.869 INFO:tasks.workunit.client.0.smithi070.stderr: -446> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 1 librados: starting msgr at 2024-09-12T00:54:12.869 INFO:tasks.workunit.client.0.smithi070.stderr: -445> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 1 librados: starting objecter 2024-09-12T00:54:12.869 INFO:tasks.workunit.client.0.smithi070.stderr: -444> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command objecter_requests hook 0x55ebe3b0d290 2024-09-12T00:54:12.869 INFO:tasks.workunit.client.0.smithi070.stderr: -443> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 1 librados: setting wanted keys 2024-09-12T00:54:12.869 INFO:tasks.workunit.client.0.smithi070.stderr: -442> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 1 librados: calling monclient init 2024-09-12T00:54:12.869 INFO:tasks.workunit.client.0.smithi070.stderr: -441> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient: init 2024-09-12T00:54:12.869 INFO:tasks.workunit.client.0.smithi070.stderr: -440> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding auth protocol: cephx 2024-09-12T00:54:12.869 INFO:tasks.workunit.client.0.smithi070.stderr: -439> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding auth protocol: cephx 2024-09-12T00:54:12.869 INFO:tasks.workunit.client.0.smithi070.stderr: -438> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding auth protocol: cephx 2024-09-12T00:54:12.869 INFO:tasks.workunit.client.0.smithi070.stderr: -437> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding con mode: secure 2024-09-12T00:54:12.869 INFO:tasks.workunit.client.0.smithi070.stderr: -436> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding con mode: crc 2024-09-12T00:54:12.870 INFO:tasks.workunit.client.0.smithi070.stderr: -435> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding con mode: secure 2024-09-12T00:54:12.870 INFO:tasks.workunit.client.0.smithi070.stderr: -434> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding con mode: crc 2024-09-12T00:54:12.870 INFO:tasks.workunit.client.0.smithi070.stderr: -433> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding con mode: secure 2024-09-12T00:54:12.870 INFO:tasks.workunit.client.0.smithi070.stderr: -432> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding con mode: crc 2024-09-12T00:54:12.870 INFO:tasks.workunit.client.0.smithi070.stderr: -431> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding con mode: crc 2024-09-12T00:54:12.870 INFO:tasks.workunit.client.0.smithi070.stderr: -430> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding con mode: secure 2024-09-12T00:54:12.870 INFO:tasks.workunit.client.0.smithi070.stderr: -429> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding con mode: crc 2024-09-12T00:54:12.870 INFO:tasks.workunit.client.0.smithi070.stderr: -428> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding con mode: secure 2024-09-12T00:54:12.870 INFO:tasks.workunit.client.0.smithi070.stderr: -427> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding con mode: crc 2024-09-12T00:54:12.870 INFO:tasks.workunit.client.0.smithi070.stderr: -426> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3d93a30) adding con mode: secure 2024-09-12T00:54:12.870 INFO:tasks.workunit.client.0.smithi070.stderr: -425> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:12.870 INFO:tasks.workunit.client.0.smithi070.stderr: -424> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:12.870 INFO:tasks.workunit.client.0.smithi070.stderr: -423> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command rotate-key hook 0x55ebe3d93b78 2024-09-12T00:54:12.871 INFO:tasks.workunit.client.0.smithi070.stderr: -422> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient: _reopen_session rank -1 2024-09-12T00:54:12.871 INFO:tasks.workunit.client.0.smithi070.stderr: -421> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:54:12.871 INFO:tasks.workunit.client.0.smithi070.stderr: -420> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient(hunting): picked mon.noname-b con 0x55ebe3c53230 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:54:12.871 INFO:tasks.workunit.client.0.smithi070.stderr: -419> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient(hunting): picked mon.noname-c con 0x55ebe3cdf920 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:54:12.871 INFO:tasks.workunit.client.0.smithi070.stderr: -418> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient(hunting): picked mon.noname-a con 0x55ebe3d9a510 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:54:12.871 INFO:tasks.workunit.client.0.smithi070.stderr: -417> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:12.871 INFO:tasks.workunit.client.0.smithi070.stderr: -416> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:12.871 INFO:tasks.workunit.client.0.smithi070.stderr: -415> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:12.871 INFO:tasks.workunit.client.0.smithi070.stderr: -414> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient(hunting): _renew_subs 2024-09-12T00:54:12.871 INFO:tasks.workunit.client.0.smithi070.stderr: -413> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient(hunting): authenticate will time out at 2102.903073s 2024-09-12T00:54:12.871 INFO:tasks.workunit.client.0.smithi070.stderr: -412> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): get_auth_request con 0x55ebe3cdf920 auth_method 0 2024-09-12T00:54:12.871 INFO:tasks.workunit.client.0.smithi070.stderr: -411> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:12.871 INFO:tasks.workunit.client.0.smithi070.stderr: -410> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:12.871 INFO:tasks.workunit.client.0.smithi070.stderr: -409> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:12.872 INFO:tasks.workunit.client.0.smithi070.stderr: -408> 2024-09-12T00:54:12.452+0000 7fee05fdd640 10 monclient(hunting): get_auth_request con 0x55ebe3d9a510 auth_method 0 2024-09-12T00:54:12.872 INFO:tasks.workunit.client.0.smithi070.stderr: -407> 2024-09-12T00:54:12.452+0000 7fee05fdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:12.872 INFO:tasks.workunit.client.0.smithi070.stderr: -406> 2024-09-12T00:54:12.452+0000 7fee05fdd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:12.872 INFO:tasks.workunit.client.0.smithi070.stderr: -405> 2024-09-12T00:54:12.452+0000 7fee05fdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:12.872 INFO:tasks.workunit.client.0.smithi070.stderr: -404> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:12.872 INFO:tasks.workunit.client.0.smithi070.stderr: -403> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:12.872 INFO:tasks.workunit.client.0.smithi070.stderr: -402> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:12.872 INFO:tasks.workunit.client.0.smithi070.stderr: -401> 2024-09-12T00:54:12.452+0000 7fee05fdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:12.872 INFO:tasks.workunit.client.0.smithi070.stderr: -400> 2024-09-12T00:54:12.452+0000 7fee05fdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:12.872 INFO:tasks.workunit.client.0.smithi070.stderr: -399> 2024-09-12T00:54:12.452+0000 7fee05fdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:12.872 INFO:tasks.workunit.client.0.smithi070.stderr: -398> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient(hunting): handle_auth_done global_id 6077 payload 824 2024-09-12T00:54:12.872 INFO:tasks.workunit.client.0.smithi070.stderr: -397> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient: _finish_hunting 0 2024-09-12T00:54:12.873 INFO:tasks.workunit.client.0.smithi070.stderr: -396> 2024-09-12T00:54:12.452+0000 7fee04fdb640 1 monclient: found mon.noname-c 2024-09-12T00:54:12.873 INFO:tasks.workunit.client.0.smithi070.stderr: -395> 2024-09-12T00:54:12.452+0000 7fee04fdb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:54:12.873 INFO:tasks.workunit.client.0.smithi070.stderr: -394> 2024-09-12T00:54:12.452+0000 7fecf1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:12.873 INFO:tasks.workunit.client.0.smithi070.stderr: -393> 2024-09-12T00:54:12.452+0000 7fecf1e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:12.873 INFO:tasks.workunit.client.0.smithi070.stderr: -392> 2024-09-12T00:54:12.452+0000 7fecf1e03640 10 monclient: dump: 2024-09-12T00:54:12.873 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:12.873 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:12.873 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.873 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.873 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:12.873 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.873 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:12.873 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:12.874 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:12.874 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.874 INFO:tasks.workunit.client.0.smithi070.stderr: -391> 2024-09-12T00:54:12.452+0000 7fecf1e03640 10 monclient: _finish_auth 0 2024-09-12T00:54:12.874 INFO:tasks.workunit.client.0.smithi070.stderr: -390> 2024-09-12T00:54:12.452+0000 7fecf1e03640 10 monclient: _check_auth_tickets 2024-09-12T00:54:12.874 INFO:tasks.workunit.client.0.smithi070.stderr: -389> 2024-09-12T00:54:12.452+0000 7fecf1e03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:12.874 INFO:tasks.workunit.client.0.smithi070.stderr: -388> 2024-09-12T00:54:12.452+0000 7fecf1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:12.874 INFO:tasks.workunit.client.0.smithi070.stderr: -387> 2024-09-12T00:54:12.452+0000 7fecf1e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:12.874 INFO:tasks.workunit.client.0.smithi070.stderr: -386> 2024-09-12T00:54:12.452+0000 7fecf1e03640 10 monclient: dump: 2024-09-12T00:54:12.874 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:12.874 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:12.874 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.874 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.874 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:12.874 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.875 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:12.875 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:12.875 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:12.875 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.875 INFO:tasks.workunit.client.0.smithi070.stderr: -385> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 5 monclient: authenticate success, global_id 6077 2024-09-12T00:54:12.875 INFO:tasks.workunit.client.0.smithi070.stderr: -384> 2024-09-12T00:54:12.452+0000 7fecf3606640 4 set_mon_vals no callback set 2024-09-12T00:54:12.875 INFO:tasks.workunit.client.0.smithi070.stderr: -383> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient: _renew_subs 2024-09-12T00:54:12.875 INFO:tasks.workunit.client.0.smithi070.stderr: -382> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:54:12.875 INFO:tasks.workunit.client.0.smithi070.stderr: -381> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient: _renew_subs 2024-09-12T00:54:12.875 INFO:tasks.workunit.client.0.smithi070.stderr: -380> 2024-09-12T00:54:12.452+0000 7fee07cd69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:54:12.875 INFO:tasks.workunit.client.0.smithi070.stderr: -379> 2024-09-12T00:54:12.456+0000 7fee07cd69c0 1 librados: init done 2024-09-12T00:54:12.875 INFO:tasks.workunit.client.0.smithi070.stderr: -378> 2024-09-12T00:54:12.456+0000 7fecf1e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:12.875 INFO:tasks.workunit.client.0.smithi070.stderr: -377> 2024-09-12T00:54:12.456+0000 7fecf1e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:54:12.876 INFO:tasks.workunit.client.0.smithi070.stderr: -376> 2024-09-12T00:54:12.456+0000 7fecf1e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:54:12.876 INFO:tasks.workunit.client.0.smithi070.stderr: -375> 2024-09-12T00:54:12.456+0000 7fee057dc640 10 monclient: get_auth_request con 0x7fecec070b10 auth_method 0 2024-09-12T00:54:12.876 INFO:tasks.workunit.client.0.smithi070.stderr: -374> 2024-09-12T00:54:12.456+0000 7fee05fdd640 10 monclient: get_auth_request con 0x55ebe3dbb840 auth_method 0 2024-09-12T00:54:12.876 INFO:tasks.workunit.client.0.smithi070.stderr: -373> 2024-09-12T00:54:12.456+0000 7fee057dc640 10 monclient: get_auth_request con 0x55ebe3dde2b0 auth_method 0 2024-09-12T00:54:12.876 INFO:tasks.workunit.client.0.smithi070.stderr: -372> 2024-09-12T00:54:12.460+0000 7fee04fdb640 10 monclient: get_auth_request con 0x55ebe3de24a0 auth_method 0 2024-09-12T00:54:12.876 INFO:tasks.workunit.client.0.smithi070.stderr: -371> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 10 monclient: build_initial_monmap 2024-09-12T00:54:12.876 INFO:tasks.workunit.client.0.smithi070.stderr: -370> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 1 build_initial for_mkfs: 0 2024-09-12T00:54:12.876 INFO:tasks.workunit.client.0.smithi070.stderr: -369> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 10 monclient: monmap: 2024-09-12T00:54:12.876 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:54:12.876 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:12.876 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:54:12.876 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:54:12.876 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:12.876 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.877 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:54:12.877 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:54:12.877 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:54:12.877 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.877 INFO:tasks.workunit.client.0.smithi070.stderr: -368> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding auth protocol: cephx 2024-09-12T00:54:12.877 INFO:tasks.workunit.client.0.smithi070.stderr: -367> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding auth protocol: cephx 2024-09-12T00:54:12.877 INFO:tasks.workunit.client.0.smithi070.stderr: -366> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding auth protocol: cephx 2024-09-12T00:54:12.877 INFO:tasks.workunit.client.0.smithi070.stderr: -365> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding con mode: secure 2024-09-12T00:54:12.877 INFO:tasks.workunit.client.0.smithi070.stderr: -364> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding con mode: crc 2024-09-12T00:54:12.877 INFO:tasks.workunit.client.0.smithi070.stderr: -363> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding con mode: secure 2024-09-12T00:54:12.877 INFO:tasks.workunit.client.0.smithi070.stderr: -362> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding con mode: crc 2024-09-12T00:54:12.877 INFO:tasks.workunit.client.0.smithi070.stderr: -361> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding con mode: secure 2024-09-12T00:54:12.877 INFO:tasks.workunit.client.0.smithi070.stderr: -360> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding con mode: crc 2024-09-12T00:54:12.878 INFO:tasks.workunit.client.0.smithi070.stderr: -359> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding con mode: crc 2024-09-12T00:54:12.878 INFO:tasks.workunit.client.0.smithi070.stderr: -358> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding con mode: secure 2024-09-12T00:54:12.878 INFO:tasks.workunit.client.0.smithi070.stderr: -357> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding con mode: crc 2024-09-12T00:54:12.878 INFO:tasks.workunit.client.0.smithi070.stderr: -356> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding con mode: secure 2024-09-12T00:54:12.878 INFO:tasks.workunit.client.0.smithi070.stderr: -355> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding con mode: crc 2024-09-12T00:54:12.878 INFO:tasks.workunit.client.0.smithi070.stderr: -354> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de7210) adding con mode: secure 2024-09-12T00:54:12.878 INFO:tasks.workunit.client.0.smithi070.stderr: -353> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:12.878 INFO:tasks.workunit.client.0.smithi070.stderr: -352> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command objecter_requests cmddesc objecter_requests hook 0x55ebe3deabe0 EEXIST 2024-09-12T00:54:12.878 INFO:tasks.workunit.client.0.smithi070.stderr: -351> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 10 monclient: init 2024-09-12T00:54:12.878 INFO:tasks.workunit.client.0.smithi070.stderr: -350> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding auth protocol: cephx 2024-09-12T00:54:12.878 INFO:tasks.workunit.client.0.smithi070.stderr: -349> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding auth protocol: cephx 2024-09-12T00:54:12.878 INFO:tasks.workunit.client.0.smithi070.stderr: -348> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding auth protocol: cephx 2024-09-12T00:54:12.878 INFO:tasks.workunit.client.0.smithi070.stderr: -347> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding con mode: secure 2024-09-12T00:54:12.879 INFO:tasks.workunit.client.0.smithi070.stderr: -346> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding con mode: crc 2024-09-12T00:54:12.879 INFO:tasks.workunit.client.0.smithi070.stderr: -345> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding con mode: secure 2024-09-12T00:54:12.879 INFO:tasks.workunit.client.0.smithi070.stderr: -344> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding con mode: crc 2024-09-12T00:54:12.879 INFO:tasks.workunit.client.0.smithi070.stderr: -343> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding con mode: secure 2024-09-12T00:54:12.879 INFO:tasks.workunit.client.0.smithi070.stderr: -342> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding con mode: crc 2024-09-12T00:54:12.879 INFO:tasks.workunit.client.0.smithi070.stderr: -341> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding con mode: crc 2024-09-12T00:54:12.879 INFO:tasks.workunit.client.0.smithi070.stderr: -340> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding con mode: secure 2024-09-12T00:54:12.879 INFO:tasks.workunit.client.0.smithi070.stderr: -339> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding con mode: crc 2024-09-12T00:54:12.879 INFO:tasks.workunit.client.0.smithi070.stderr: -338> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding con mode: secure 2024-09-12T00:54:12.879 INFO:tasks.workunit.client.0.smithi070.stderr: -337> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding con mode: crc 2024-09-12T00:54:12.879 INFO:tasks.workunit.client.0.smithi070.stderr: -336> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3de5838) adding con mode: secure 2024-09-12T00:54:12.879 INFO:tasks.workunit.client.0.smithi070.stderr: -335> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:12.879 INFO:tasks.workunit.client.0.smithi070.stderr: -334> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:12.879 INFO:tasks.workunit.client.0.smithi070.stderr: -333> 2024-09-12T00:54:12.460+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command rotate-key cmddesc rotate-key hook 0x55ebe3de5980 EEXIST 2024-09-12T00:54:12.880 INFO:tasks.workunit.client.0.smithi070.stderr: -332> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient: _reopen_session rank -1 2024-09-12T00:54:12.880 INFO:tasks.workunit.client.0.smithi070.stderr: -331> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:54:12.880 INFO:tasks.workunit.client.0.smithi070.stderr: -330> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient(hunting): picked mon.noname-c con 0x55ebe3e0ed90 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:54:12.880 INFO:tasks.workunit.client.0.smithi070.stderr: -329> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient(hunting): picked mon.noname-b con 0x55ebe3e0e6c0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:54:12.880 INFO:tasks.workunit.client.0.smithi070.stderr: -328> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient(hunting): picked mon.noname-a con 0x55ebe3e0d0a0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:54:12.880 INFO:tasks.workunit.client.0.smithi070.stderr: -327> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:12.880 INFO:tasks.workunit.client.0.smithi070.stderr: -326> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:12.880 INFO:tasks.workunit.client.0.smithi070.stderr: -325> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:12.880 INFO:tasks.workunit.client.0.smithi070.stderr: -324> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient(hunting): _renew_subs 2024-09-12T00:54:12.880 INFO:tasks.workunit.client.0.smithi070.stderr: -323> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient(hunting): authenticate will time out at 2102.912090s 2024-09-12T00:54:12.880 INFO:tasks.workunit.client.0.smithi070.stderr: -322> 2024-09-12T00:54:12.464+0000 7fee057dc640 10 monclient(hunting): get_auth_request con 0x55ebe3e0ed90 auth_method 0 2024-09-12T00:54:12.880 INFO:tasks.workunit.client.0.smithi070.stderr: -321> 2024-09-12T00:54:12.464+0000 7fee057dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:12.880 INFO:tasks.workunit.client.0.smithi070.stderr: -320> 2024-09-12T00:54:12.464+0000 7fee057dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:12.881 INFO:tasks.workunit.client.0.smithi070.stderr: -319> 2024-09-12T00:54:12.464+0000 7fee057dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:12.881 INFO:tasks.workunit.client.0.smithi070.stderr: -318> 2024-09-12T00:54:12.464+0000 7fee05fdd640 10 monclient(hunting): get_auth_request con 0x55ebe3e0d0a0 auth_method 0 2024-09-12T00:54:12.881 INFO:tasks.workunit.client.0.smithi070.stderr: -317> 2024-09-12T00:54:12.464+0000 7fee05fdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:12.881 INFO:tasks.workunit.client.0.smithi070.stderr: -316> 2024-09-12T00:54:12.464+0000 7fee05fdd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:12.881 INFO:tasks.workunit.client.0.smithi070.stderr: -315> 2024-09-12T00:54:12.464+0000 7fee05fdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:12.881 INFO:tasks.workunit.client.0.smithi070.stderr: -314> 2024-09-12T00:54:12.464+0000 7fee05fdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:12.881 INFO:tasks.workunit.client.0.smithi070.stderr: -313> 2024-09-12T00:54:12.464+0000 7fee05fdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:12.881 INFO:tasks.workunit.client.0.smithi070.stderr: -312> 2024-09-12T00:54:12.464+0000 7fee05fdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:12.881 INFO:tasks.workunit.client.0.smithi070.stderr: -311> 2024-09-12T00:54:12.464+0000 7fee057dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:12.881 INFO:tasks.workunit.client.0.smithi070.stderr: -310> 2024-09-12T00:54:12.464+0000 7fee057dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:12.881 INFO:tasks.workunit.client.0.smithi070.stderr: -309> 2024-09-12T00:54:12.464+0000 7fee057dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:12.881 INFO:tasks.workunit.client.0.smithi070.stderr: -308> 2024-09-12T00:54:12.464+0000 7fee04fdb640 10 monclient(hunting): get_auth_request con 0x55ebe3e0e6c0 auth_method 0 2024-09-12T00:54:12.881 INFO:tasks.workunit.client.0.smithi070.stderr: -307> 2024-09-12T00:54:12.464+0000 7fee04fdb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:12.881 INFO:tasks.workunit.client.0.smithi070.stderr: -306> 2024-09-12T00:54:12.464+0000 7fee04fdb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:12.882 INFO:tasks.workunit.client.0.smithi070.stderr: -305> 2024-09-12T00:54:12.464+0000 7fee04fdb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:12.882 INFO:tasks.workunit.client.0.smithi070.stderr: -304> 2024-09-12T00:54:12.464+0000 7fee057dc640 10 monclient(hunting): handle_auth_done global_id 6080 payload 824 2024-09-12T00:54:12.882 INFO:tasks.workunit.client.0.smithi070.stderr: -303> 2024-09-12T00:54:12.464+0000 7fee057dc640 10 monclient: _finish_hunting 0 2024-09-12T00:54:12.882 INFO:tasks.workunit.client.0.smithi070.stderr: -302> 2024-09-12T00:54:12.464+0000 7fee057dc640 1 monclient: found mon.noname-c 2024-09-12T00:54:12.882 INFO:tasks.workunit.client.0.smithi070.stderr: -301> 2024-09-12T00:54:12.464+0000 7fee057dc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:54:12.882 INFO:tasks.workunit.client.0.smithi070.stderr: -300> 2024-09-12T00:54:12.464+0000 7feceaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:12.882 INFO:tasks.workunit.client.0.smithi070.stderr: -299> 2024-09-12T00:54:12.464+0000 7feceaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:12.882 INFO:tasks.workunit.client.0.smithi070.stderr: -298> 2024-09-12T00:54:12.464+0000 7feceaffd640 10 monclient: dump: 2024-09-12T00:54:12.882 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:12.882 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:12.882 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.882 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.882 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:12.882 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.883 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:12.883 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:12.883 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:12.883 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.883 INFO:tasks.workunit.client.0.smithi070.stderr: -297> 2024-09-12T00:54:12.464+0000 7feceaffd640 10 monclient: _finish_auth 0 2024-09-12T00:54:12.883 INFO:tasks.workunit.client.0.smithi070.stderr: -296> 2024-09-12T00:54:12.464+0000 7feceaffd640 10 monclient: _check_auth_tickets 2024-09-12T00:54:12.883 INFO:tasks.workunit.client.0.smithi070.stderr: -295> 2024-09-12T00:54:12.464+0000 7feceaffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:12.883 INFO:tasks.workunit.client.0.smithi070.stderr: -294> 2024-09-12T00:54:12.464+0000 7feceaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:12.883 INFO:tasks.workunit.client.0.smithi070.stderr: -293> 2024-09-12T00:54:12.464+0000 7feceaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:12.883 INFO:tasks.workunit.client.0.smithi070.stderr: -292> 2024-09-12T00:54:12.464+0000 7feceaffd640 10 monclient: dump: 2024-09-12T00:54:12.883 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:12.883 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:12.883 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.884 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.884 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:12.884 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.884 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:12.884 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:12.884 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:12.884 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.884 INFO:tasks.workunit.client.0.smithi070.stderr: -291> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 monclient: authenticate success, global_id 6080 2024-09-12T00:54:12.884 INFO:tasks.workunit.client.0.smithi070.stderr: -290> 2024-09-12T00:54:12.464+0000 7fee067de640 4 set_mon_vals no callback set 2024-09-12T00:54:12.884 INFO:tasks.workunit.client.0.smithi070.stderr: -289> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient: _renew_subs 2024-09-12T00:54:12.884 INFO:tasks.workunit.client.0.smithi070.stderr: -288> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:54:12.884 INFO:tasks.workunit.client.0.smithi070.stderr: -287> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient: _renew_subs 2024-09-12T00:54:12.884 INFO:tasks.workunit.client.0.smithi070.stderr: -286> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:54:12.885 INFO:tasks.workunit.client.0.smithi070.stderr: -285> 2024-09-12T00:54:12.464+0000 7feceaffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:12.885 INFO:tasks.workunit.client.0.smithi070.stderr: -284> 2024-09-12T00:54:12.464+0000 7feceaffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:54:12.885 INFO:tasks.workunit.client.0.smithi070.stderr: -283> 2024-09-12T00:54:12.464+0000 7feceaffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:54:12.885 INFO:tasks.workunit.client.0.smithi070.stderr: -282> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient: get_monmap_and_config 2024-09-12T00:54:12.885 INFO:tasks.workunit.client.0.smithi070.stderr: -281> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient: build_initial_monmap 2024-09-12T00:54:12.885 INFO:tasks.workunit.client.0.smithi070.stderr: -280> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 1 build_initial for_mkfs: 0 2024-09-12T00:54:12.885 INFO:tasks.workunit.client.0.smithi070.stderr: -279> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient: monmap: 2024-09-12T00:54:12.885 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:54:12.885 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:12.885 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:54:12.885 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:54:12.885 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:12.885 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.886 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:54:12.886 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:54:12.886 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:54:12.886 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.886 INFO:tasks.workunit.client.0.smithi070.stderr: -278> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding auth protocol: cephx 2024-09-12T00:54:12.886 INFO:tasks.workunit.client.0.smithi070.stderr: -277> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding auth protocol: cephx 2024-09-12T00:54:12.886 INFO:tasks.workunit.client.0.smithi070.stderr: -276> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding auth protocol: cephx 2024-09-12T00:54:12.886 INFO:tasks.workunit.client.0.smithi070.stderr: -275> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding con mode: secure 2024-09-12T00:54:12.886 INFO:tasks.workunit.client.0.smithi070.stderr: -274> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding con mode: crc 2024-09-12T00:54:12.886 INFO:tasks.workunit.client.0.smithi070.stderr: -273> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding con mode: secure 2024-09-12T00:54:12.886 INFO:tasks.workunit.client.0.smithi070.stderr: -272> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding con mode: crc 2024-09-12T00:54:12.886 INFO:tasks.workunit.client.0.smithi070.stderr: -271> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding con mode: secure 2024-09-12T00:54:12.886 INFO:tasks.workunit.client.0.smithi070.stderr: -270> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding con mode: crc 2024-09-12T00:54:12.887 INFO:tasks.workunit.client.0.smithi070.stderr: -269> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding con mode: crc 2024-09-12T00:54:12.887 INFO:tasks.workunit.client.0.smithi070.stderr: -268> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding con mode: secure 2024-09-12T00:54:12.887 INFO:tasks.workunit.client.0.smithi070.stderr: -267> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding con mode: crc 2024-09-12T00:54:12.887 INFO:tasks.workunit.client.0.smithi070.stderr: -266> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding con mode: secure 2024-09-12T00:54:12.887 INFO:tasks.workunit.client.0.smithi070.stderr: -265> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding con mode: crc 2024-09-12T00:54:12.887 INFO:tasks.workunit.client.0.smithi070.stderr: -264> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e2e700) adding con mode: secure 2024-09-12T00:54:12.887 INFO:tasks.workunit.client.0.smithi070.stderr: -263> 2024-09-12T00:54:12.464+0000 7fee04fdb640 10 monclient: get_auth_request con 0x7fece0070a20 auth_method 0 2024-09-12T00:54:12.887 INFO:tasks.workunit.client.0.smithi070.stderr: -262> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:12.887 INFO:tasks.workunit.client.0.smithi070.stderr: -261> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 10 monclient: init 2024-09-12T00:54:12.887 INFO:tasks.workunit.client.0.smithi070.stderr: -260> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding auth protocol: cephx 2024-09-12T00:54:12.887 INFO:tasks.workunit.client.0.smithi070.stderr: -259> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding auth protocol: cephx 2024-09-12T00:54:12.887 INFO:tasks.workunit.client.0.smithi070.stderr: -258> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding auth protocol: cephx 2024-09-12T00:54:12.887 INFO:tasks.workunit.client.0.smithi070.stderr: -257> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding con mode: secure 2024-09-12T00:54:12.887 INFO:tasks.workunit.client.0.smithi070.stderr: -256> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding con mode: crc 2024-09-12T00:54:12.888 INFO:tasks.workunit.client.0.smithi070.stderr: -255> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding con mode: secure 2024-09-12T00:54:12.888 INFO:tasks.workunit.client.0.smithi070.stderr: -254> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding con mode: crc 2024-09-12T00:54:12.888 INFO:tasks.workunit.client.0.smithi070.stderr: -253> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding con mode: secure 2024-09-12T00:54:12.888 INFO:tasks.workunit.client.0.smithi070.stderr: -252> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding con mode: crc 2024-09-12T00:54:12.888 INFO:tasks.workunit.client.0.smithi070.stderr: -251> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding con mode: crc 2024-09-12T00:54:12.888 INFO:tasks.workunit.client.0.smithi070.stderr: -250> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding con mode: secure 2024-09-12T00:54:12.888 INFO:tasks.workunit.client.0.smithi070.stderr: -249> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding con mode: crc 2024-09-12T00:54:12.888 INFO:tasks.workunit.client.0.smithi070.stderr: -248> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding con mode: secure 2024-09-12T00:54:12.888 INFO:tasks.workunit.client.0.smithi070.stderr: -247> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding con mode: crc 2024-09-12T00:54:12.888 INFO:tasks.workunit.client.0.smithi070.stderr: -246> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939940) adding con mode: secure 2024-09-12T00:54:12.888 INFO:tasks.workunit.client.0.smithi070.stderr: -245> 2024-09-12T00:54:12.464+0000 7fee07cd69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:12.888 INFO:tasks.workunit.client.0.smithi070.stderr: -244> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:12.888 INFO:tasks.workunit.client.0.smithi070.stderr: -243> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd08939a88 EEXIST 2024-09-12T00:54:12.888 INFO:tasks.workunit.client.0.smithi070.stderr: -242> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient: _reopen_session rank -1 2024-09-12T00:54:12.889 INFO:tasks.workunit.client.0.smithi070.stderr: -241> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:54:12.889 INFO:tasks.workunit.client.0.smithi070.stderr: -240> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): picked mon.noname-b con 0x55ebe3e33900 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:54:12.889 INFO:tasks.workunit.client.0.smithi070.stderr: -239> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): picked mon.noname-a con 0x55ebe3e68f30 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:54:12.889 INFO:tasks.workunit.client.0.smithi070.stderr: -238> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): picked mon.noname-c con 0x55ebe3e5e2b0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:54:12.889 INFO:tasks.workunit.client.0.smithi070.stderr: -237> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:12.889 INFO:tasks.workunit.client.0.smithi070.stderr: -236> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:12.889 INFO:tasks.workunit.client.0.smithi070.stderr: -235> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:12.889 INFO:tasks.workunit.client.0.smithi070.stderr: -234> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): _renew_subs 2024-09-12T00:54:12.889 INFO:tasks.workunit.client.0.smithi070.stderr: -233> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): authenticate will time out at 2102.916173s 2024-09-12T00:54:12.889 INFO:tasks.workunit.client.0.smithi070.stderr: -232> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): get_auth_request con 0x55ebe3e68f30 auth_method 0 2024-09-12T00:54:12.889 INFO:tasks.workunit.client.0.smithi070.stderr: -231> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:12.889 INFO:tasks.workunit.client.0.smithi070.stderr: -230> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:12.889 INFO:tasks.workunit.client.0.smithi070.stderr: -229> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:12.889 INFO:tasks.workunit.client.0.smithi070.stderr: -228> 2024-09-12T00:54:12.468+0000 7fee05fdd640 10 monclient(hunting): get_auth_request con 0x55ebe3e5e2b0 auth_method 0 2024-09-12T00:54:12.890 INFO:tasks.workunit.client.0.smithi070.stderr: -227> 2024-09-12T00:54:12.468+0000 7fee05fdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:12.890 INFO:tasks.workunit.client.0.smithi070.stderr: -226> 2024-09-12T00:54:12.468+0000 7fee05fdd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:12.890 INFO:tasks.workunit.client.0.smithi070.stderr: -225> 2024-09-12T00:54:12.468+0000 7fee05fdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:12.890 INFO:tasks.workunit.client.0.smithi070.stderr: -224> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:12.890 INFO:tasks.workunit.client.0.smithi070.stderr: -223> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:12.890 INFO:tasks.workunit.client.0.smithi070.stderr: -222> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:12.890 INFO:tasks.workunit.client.0.smithi070.stderr: -221> 2024-09-12T00:54:12.468+0000 7fee05fdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:12.890 INFO:tasks.workunit.client.0.smithi070.stderr: -220> 2024-09-12T00:54:12.468+0000 7fee05fdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:12.890 INFO:tasks.workunit.client.0.smithi070.stderr: -219> 2024-09-12T00:54:12.468+0000 7fee05fdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:12.890 INFO:tasks.workunit.client.0.smithi070.stderr: -218> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): handle_auth_done global_id 6378 payload 274 2024-09-12T00:54:12.890 INFO:tasks.workunit.client.0.smithi070.stderr: -217> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient: _finish_hunting 0 2024-09-12T00:54:12.890 INFO:tasks.workunit.client.0.smithi070.stderr: -216> 2024-09-12T00:54:12.468+0000 7fee04fdb640 1 monclient: found mon.noname-a 2024-09-12T00:54:12.890 INFO:tasks.workunit.client.0.smithi070.stderr: -215> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:54:12.891 INFO:tasks.workunit.client.0.smithi070.stderr: -214> 2024-09-12T00:54:12.468+0000 7fece8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:12.891 INFO:tasks.workunit.client.0.smithi070.stderr: -213> 2024-09-12T00:54:12.468+0000 7fece8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:12.891 INFO:tasks.workunit.client.0.smithi070.stderr: -212> 2024-09-12T00:54:12.468+0000 7fece8ff9640 10 monclient: dump: 2024-09-12T00:54:12.891 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:12.891 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:12.891 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.891 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.891 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:12.891 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.891 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:12.891 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:12.891 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:12.891 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.891 INFO:tasks.workunit.client.0.smithi070.stderr: -211> 2024-09-12T00:54:12.468+0000 7fece8ff9640 10 monclient: _finish_auth 0 2024-09-12T00:54:12.892 INFO:tasks.workunit.client.0.smithi070.stderr: -210> 2024-09-12T00:54:12.468+0000 7fece8ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:54:12.892 INFO:tasks.workunit.client.0.smithi070.stderr: -209> 2024-09-12T00:54:12.468+0000 7fece8ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:12.892 INFO:tasks.workunit.client.0.smithi070.stderr: -208> 2024-09-12T00:54:12.468+0000 7fece8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:12.892 INFO:tasks.workunit.client.0.smithi070.stderr: -207> 2024-09-12T00:54:12.468+0000 7fece8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:12.892 INFO:tasks.workunit.client.0.smithi070.stderr: -206> 2024-09-12T00:54:12.468+0000 7fece8ff9640 10 monclient: dump: 2024-09-12T00:54:12.892 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:12.892 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:12.892 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.892 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.892 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:12.892 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.892 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:12.892 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:12.893 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:12.893 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.893 INFO:tasks.workunit.client.0.smithi070.stderr: -205> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 monclient: authenticate success, global_id 6378 2024-09-12T00:54:12.893 INFO:tasks.workunit.client.0.smithi070.stderr: -204> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient: get_monmap_and_config success 2024-09-12T00:54:12.893 INFO:tasks.workunit.client.0.smithi070.stderr: -203> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 4 set_mon_vals no callback set 2024-09-12T00:54:12.893 INFO:tasks.workunit.client.0.smithi070.stderr: -202> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient: shutdown 2024-09-12T00:54:12.893 INFO:tasks.workunit.client.0.smithi070.stderr: -201> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient: build_initial_monmap 2024-09-12T00:54:12.893 INFO:tasks.workunit.client.0.smithi070.stderr: -200> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 1 build_initial for_mkfs: 0 2024-09-12T00:54:12.893 INFO:tasks.workunit.client.0.smithi070.stderr: -199> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient: monmap: 2024-09-12T00:54:12.893 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:54:12.893 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:12.893 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:54:12.893 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:54:12.893 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:12.894 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.894 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:54:12.894 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:54:12.894 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:54:12.894 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.894 INFO:tasks.workunit.client.0.smithi070.stderr: -198> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding auth protocol: cephx 2024-09-12T00:54:12.894 INFO:tasks.workunit.client.0.smithi070.stderr: -197> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding auth protocol: cephx 2024-09-12T00:54:12.894 INFO:tasks.workunit.client.0.smithi070.stderr: -196> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding auth protocol: cephx 2024-09-12T00:54:12.894 INFO:tasks.workunit.client.0.smithi070.stderr: -195> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding con mode: secure 2024-09-12T00:54:12.894 INFO:tasks.workunit.client.0.smithi070.stderr: -194> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding con mode: crc 2024-09-12T00:54:12.894 INFO:tasks.workunit.client.0.smithi070.stderr: -193> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding con mode: secure 2024-09-12T00:54:12.894 INFO:tasks.workunit.client.0.smithi070.stderr: -192> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding con mode: crc 2024-09-12T00:54:12.894 INFO:tasks.workunit.client.0.smithi070.stderr: -191> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding con mode: secure 2024-09-12T00:54:12.894 INFO:tasks.workunit.client.0.smithi070.stderr: -190> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding con mode: crc 2024-09-12T00:54:12.895 INFO:tasks.workunit.client.0.smithi070.stderr: -189> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding con mode: crc 2024-09-12T00:54:12.895 INFO:tasks.workunit.client.0.smithi070.stderr: -188> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding con mode: secure 2024-09-12T00:54:12.895 INFO:tasks.workunit.client.0.smithi070.stderr: -187> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding con mode: crc 2024-09-12T00:54:12.895 INFO:tasks.workunit.client.0.smithi070.stderr: -186> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding con mode: secure 2024-09-12T00:54:12.895 INFO:tasks.workunit.client.0.smithi070.stderr: -185> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding con mode: crc 2024-09-12T00:54:12.895 INFO:tasks.workunit.client.0.smithi070.stderr: -184> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3c224a0) adding con mode: secure 2024-09-12T00:54:12.895 INFO:tasks.workunit.client.0.smithi070.stderr: -183> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:12.895 INFO:tasks.workunit.client.0.smithi070.stderr: -182> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 1 librados: starting msgr at 2024-09-12T00:54:12.895 INFO:tasks.workunit.client.0.smithi070.stderr: -181> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 1 librados: starting objecter 2024-09-12T00:54:12.895 INFO:tasks.workunit.client.0.smithi070.stderr: -180> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command objecter_requests cmddesc objecter_requests hook 0x55ebe3e0f800 EEXIST 2024-09-12T00:54:12.895 INFO:tasks.workunit.client.0.smithi070.stderr: -179> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 1 librados: setting wanted keys 2024-09-12T00:54:12.895 INFO:tasks.workunit.client.0.smithi070.stderr: -178> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 1 librados: calling monclient init 2024-09-12T00:54:12.895 INFO:tasks.workunit.client.0.smithi070.stderr: -177> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient: init 2024-09-12T00:54:12.896 INFO:tasks.workunit.client.0.smithi070.stderr: -176> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding auth protocol: cephx 2024-09-12T00:54:12.896 INFO:tasks.workunit.client.0.smithi070.stderr: -175> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding auth protocol: cephx 2024-09-12T00:54:12.896 INFO:tasks.workunit.client.0.smithi070.stderr: -174> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding auth protocol: cephx 2024-09-12T00:54:12.896 INFO:tasks.workunit.client.0.smithi070.stderr: -173> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding con mode: secure 2024-09-12T00:54:12.896 INFO:tasks.workunit.client.0.smithi070.stderr: -172> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding con mode: crc 2024-09-12T00:54:12.896 INFO:tasks.workunit.client.0.smithi070.stderr: -171> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding con mode: secure 2024-09-12T00:54:12.896 INFO:tasks.workunit.client.0.smithi070.stderr: -170> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding con mode: crc 2024-09-12T00:54:12.896 INFO:tasks.workunit.client.0.smithi070.stderr: -169> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding con mode: secure 2024-09-12T00:54:12.896 INFO:tasks.workunit.client.0.smithi070.stderr: -168> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding con mode: crc 2024-09-12T00:54:12.896 INFO:tasks.workunit.client.0.smithi070.stderr: -167> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding con mode: crc 2024-09-12T00:54:12.896 INFO:tasks.workunit.client.0.smithi070.stderr: -166> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding con mode: secure 2024-09-12T00:54:12.896 INFO:tasks.workunit.client.0.smithi070.stderr: -165> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding con mode: crc 2024-09-12T00:54:12.896 INFO:tasks.workunit.client.0.smithi070.stderr: -164> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding con mode: secure 2024-09-12T00:54:12.896 INFO:tasks.workunit.client.0.smithi070.stderr: -163> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding con mode: crc 2024-09-12T00:54:12.897 INFO:tasks.workunit.client.0.smithi070.stderr: -162> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 AuthRegistry(0x55ebe3e10bb0) adding con mode: secure 2024-09-12T00:54:12.897 INFO:tasks.workunit.client.0.smithi070.stderr: -161> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:12.897 INFO:tasks.workunit.client.0.smithi070.stderr: -160> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:12.897 INFO:tasks.workunit.client.0.smithi070.stderr: -159> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command rotate-key cmddesc rotate-key hook 0x55ebe3e10cf8 EEXIST 2024-09-12T00:54:12.897 INFO:tasks.workunit.client.0.smithi070.stderr: -158> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient: _reopen_session rank -1 2024-09-12T00:54:12.897 INFO:tasks.workunit.client.0.smithi070.stderr: -157> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:54:12.897 INFO:tasks.workunit.client.0.smithi070.stderr: -156> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): picked mon.noname-c con 0x55ebe3e33900 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:54:12.897 INFO:tasks.workunit.client.0.smithi070.stderr: -155> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): picked mon.noname-a con 0x55ebe3e5e2b0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:54:12.897 INFO:tasks.workunit.client.0.smithi070.stderr: -154> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): picked mon.noname-b con 0x55ebe3e68f30 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:54:12.897 INFO:tasks.workunit.client.0.smithi070.stderr: -153> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:12.897 INFO:tasks.workunit.client.0.smithi070.stderr: -152> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:12.897 INFO:tasks.workunit.client.0.smithi070.stderr: -151> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:12.897 INFO:tasks.workunit.client.0.smithi070.stderr: -150> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): _renew_subs 2024-09-12T00:54:12.898 INFO:tasks.workunit.client.0.smithi070.stderr: -149> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient(hunting): authenticate will time out at 2102.918807s 2024-09-12T00:54:12.898 INFO:tasks.workunit.client.0.smithi070.stderr: -148> 2024-09-12T00:54:12.468+0000 7fee057dc640 10 monclient(hunting): get_auth_request con 0x55ebe3e33900 auth_method 0 2024-09-12T00:54:12.898 INFO:tasks.workunit.client.0.smithi070.stderr: -147> 2024-09-12T00:54:12.468+0000 7fee057dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:12.898 INFO:tasks.workunit.client.0.smithi070.stderr: -146> 2024-09-12T00:54:12.468+0000 7fee057dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:12.898 INFO:tasks.workunit.client.0.smithi070.stderr: -145> 2024-09-12T00:54:12.468+0000 7fee057dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:12.898 INFO:tasks.workunit.client.0.smithi070.stderr: -144> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): get_auth_request con 0x55ebe3e5e2b0 auth_method 0 2024-09-12T00:54:12.898 INFO:tasks.workunit.client.0.smithi070.stderr: -143> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:12.898 INFO:tasks.workunit.client.0.smithi070.stderr: -142> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:12.898 INFO:tasks.workunit.client.0.smithi070.stderr: -141> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:12.898 INFO:tasks.workunit.client.0.smithi070.stderr: -140> 2024-09-12T00:54:12.468+0000 7fee057dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:12.898 INFO:tasks.workunit.client.0.smithi070.stderr: -139> 2024-09-12T00:54:12.468+0000 7fee057dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:12.898 INFO:tasks.workunit.client.0.smithi070.stderr: -138> 2024-09-12T00:54:12.468+0000 7fee057dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:12.898 INFO:tasks.workunit.client.0.smithi070.stderr: -137> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:12.898 INFO:tasks.workunit.client.0.smithi070.stderr: -136> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:12.899 INFO:tasks.workunit.client.0.smithi070.stderr: -135> 2024-09-12T00:54:12.468+0000 7fee04fdb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:12.899 INFO:tasks.workunit.client.0.smithi070.stderr: -134> 2024-09-12T00:54:12.468+0000 7fee057dc640 10 monclient(hunting): handle_auth_done global_id 6086 payload 824 2024-09-12T00:54:12.899 INFO:tasks.workunit.client.0.smithi070.stderr: -133> 2024-09-12T00:54:12.468+0000 7fee057dc640 10 monclient: _finish_hunting 0 2024-09-12T00:54:12.899 INFO:tasks.workunit.client.0.smithi070.stderr: -132> 2024-09-12T00:54:12.468+0000 7fee057dc640 1 monclient: found mon.noname-c 2024-09-12T00:54:12.899 INFO:tasks.workunit.client.0.smithi070.stderr: -131> 2024-09-12T00:54:12.468+0000 7fee057dc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:54:12.899 INFO:tasks.workunit.client.0.smithi070.stderr: -130> 2024-09-12T00:54:12.468+0000 7fecd6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:12.899 INFO:tasks.workunit.client.0.smithi070.stderr: -129> 2024-09-12T00:54:12.468+0000 7fecd6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:12.899 INFO:tasks.workunit.client.0.smithi070.stderr: -128> 2024-09-12T00:54:12.468+0000 7fecd6ffd640 10 monclient: dump: 2024-09-12T00:54:12.899 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:12.899 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:12.899 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.899 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.899 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:12.899 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.900 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:12.900 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:12.900 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:12.900 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.900 INFO:tasks.workunit.client.0.smithi070.stderr: -127> 2024-09-12T00:54:12.468+0000 7fecd6ffd640 10 monclient: _finish_auth 0 2024-09-12T00:54:12.900 INFO:tasks.workunit.client.0.smithi070.stderr: -126> 2024-09-12T00:54:12.468+0000 7fecd6ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:54:12.900 INFO:tasks.workunit.client.0.smithi070.stderr: -125> 2024-09-12T00:54:12.468+0000 7fecd6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:12.900 INFO:tasks.workunit.client.0.smithi070.stderr: -124> 2024-09-12T00:54:12.468+0000 7fecd6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:12.900 INFO:tasks.workunit.client.0.smithi070.stderr: -123> 2024-09-12T00:54:12.468+0000 7fecd6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:12.900 INFO:tasks.workunit.client.0.smithi070.stderr: -122> 2024-09-12T00:54:12.468+0000 7fecd6ffd640 10 monclient: dump: 2024-09-12T00:54:12.900 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:12.900 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:12.900 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.901 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:12.901 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:12.901 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:12.901 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:12.901 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:12.901 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:12.901 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.901 INFO:tasks.workunit.client.0.smithi070.stderr: -121> 2024-09-12T00:54:12.468+0000 7fece8ff9640 4 set_mon_vals no callback set 2024-09-12T00:54:12.901 INFO:tasks.workunit.client.0.smithi070.stderr: -120> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 5 monclient: authenticate success, global_id 6086 2024-09-12T00:54:12.901 INFO:tasks.workunit.client.0.smithi070.stderr: -119> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient: _renew_subs 2024-09-12T00:54:12.901 INFO:tasks.workunit.client.0.smithi070.stderr: -118> 2024-09-12T00:54:12.468+0000 7fee07cd69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:54:12.901 INFO:tasks.workunit.client.0.smithi070.stderr: -117> 2024-09-12T00:54:12.472+0000 7fee07cd69c0 10 monclient: _renew_subs 2024-09-12T00:54:12.901 INFO:tasks.workunit.client.0.smithi070.stderr: -116> 2024-09-12T00:54:12.472+0000 7fee07cd69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:54:12.902 INFO:tasks.workunit.client.0.smithi070.stderr: -115> 2024-09-12T00:54:12.472+0000 7fee07cd69c0 1 librados: init done 2024-09-12T00:54:12.902 INFO:tasks.workunit.client.0.smithi070.stderr: -114> 2024-09-12T00:54:12.472+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command cr dump hook 0x55ebe3e5c2d8 2024-09-12T00:54:12.902 INFO:tasks.workunit.client.0.smithi070.stderr: -113> 2024-09-12T00:54:12.472+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.902 INFO:tasks.workunit.client.0.smithi070.stderr: -112> 2024-09-12T00:54:12.472+0000 7fecd6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:12.902 INFO:tasks.workunit.client.0.smithi070.stderr: -111> 2024-09-12T00:54:12.472+0000 7fecd6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:54:12.902 INFO:tasks.workunit.client.0.smithi070.stderr: -110> 2024-09-12T00:54:12.472+0000 7fecd6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:54:12.902 INFO:tasks.workunit.client.0.smithi070.stderr: -109> 2024-09-12T00:54:12.472+0000 7fee05fdd640 10 monclient: get_auth_request con 0x55ebe3e7d6e0 auth_method 0 2024-09-12T00:54:12.902 INFO:tasks.workunit.client.0.smithi070.stderr: -108> 2024-09-12T00:54:12.472+0000 7fee04fdb640 10 monclient: get_auth_request con 0x7fecd0070ae0 auth_method 0 2024-09-12T00:54:12.902 INFO:tasks.workunit.client.0.smithi070.stderr: -107> 2024-09-12T00:54:12.472+0000 7fee07cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.902 INFO:tasks.workunit.client.0.smithi070.stderr: -106> 2024-09-12T00:54:12.472+0000 7fee07cd69c0 20 realm 2024-09-12T00:54:12.902 INFO:tasks.workunit.client.0.smithi070.stderr: -105> 2024-09-12T00:54:12.472+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.902 INFO:tasks.workunit.client.0.smithi070.stderr: -104> 2024-09-12T00:54:12.472+0000 7fee07cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.902 INFO:tasks.workunit.client.0.smithi070.stderr: -103> 2024-09-12T00:54:12.472+0000 7fee07cd69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:12.902 INFO:tasks.workunit.client.0.smithi070.stderr: -102> 2024-09-12T00:54:12.472+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.903 INFO:tasks.workunit.client.0.smithi070.stderr: -101> 2024-09-12T00:54:12.472+0000 7fee07cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.903 INFO:tasks.workunit.client.0.smithi070.stderr: -100> 2024-09-12T00:54:12.472+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.903 INFO:tasks.workunit.client.0.smithi070.stderr: -99> 2024-09-12T00:54:12.472+0000 7fee057dc640 10 monclient: get_auth_request con 0x55ebe3e81ad0 auth_method 0 2024-09-12T00:54:12.903 INFO:tasks.workunit.client.0.smithi070.stderr: -98> 2024-09-12T00:54:12.476+0000 7fee07cd69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:12.903 INFO:tasks.workunit.client.0.smithi070.stderr: -97> 2024-09-12T00:54:12.476+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.903 INFO:tasks.workunit.client.0.smithi070.stderr: -96> 2024-09-12T00:54:12.476+0000 7fee04fdb640 10 monclient: get_auth_request con 0x55ebe3e851f0 auth_method 0 2024-09-12T00:54:12.903 INFO:tasks.workunit.client.0.smithi070.stderr: -95> 2024-09-12T00:54:12.476+0000 7fee07cd69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:12.903 INFO:tasks.workunit.client.0.smithi070.stderr: -94> 2024-09-12T00:54:12.476+0000 7fee07cd69c0 20 searching for the correct realm 2024-09-12T00:54:12.903 INFO:tasks.workunit.client.0.smithi070.stderr: -93> 2024-09-12T00:54:12.476+0000 7fee05fdd640 10 monclient: get_auth_request con 0x55ebe3e89f70 auth_method 0 2024-09-12T00:54:12.903 INFO:tasks.workunit.client.0.smithi070.stderr: -92> 2024-09-12T00:54:12.476+0000 7fee057dc640 10 monclient: get_auth_request con 0x7fee00018040 auth_method 0 2024-09-12T00:54:12.903 INFO:tasks.workunit.client.0.smithi070.stderr: -91> 2024-09-12T00:54:12.480+0000 7fee04fdb640 10 monclient: get_auth_request con 0x7fedf0008040 auth_method 0 2024-09-12T00:54:12.903 INFO:tasks.workunit.client.0.smithi070.stderr: -90> 2024-09-12T00:54:12.480+0000 7fee05fdd640 10 monclient: get_auth_request con 0x7fedf80f7bf0 auth_method 0 2024-09-12T00:54:12.903 INFO:tasks.workunit.client.0.smithi070.stderr: -89> 2024-09-12T00:54:12.480+0000 7fee05fdd640 0 -- 172.21.15.70:0/448923671 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fedf80f7bf0 msgr2=0x7fedf8100a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:12.903 INFO:tasks.workunit.client.0.smithi070.stderr: -88> 2024-09-12T00:54:12.684+0000 7fee05fdd640 10 monclient: get_auth_request con 0x7fedf80f7bf0 auth_method 0 2024-09-12T00:54:12.904 INFO:tasks.workunit.client.0.smithi070.stderr: -87> 2024-09-12T00:54:12.688+0000 7fee057dc640 10 monclient: get_auth_request con 0x7fee00035930 auth_method 0 2024-09-12T00:54:12.904 INFO:tasks.workunit.client.0.smithi070.stderr: -86> 2024-09-12T00:54:12.696+0000 7fee05fdd640 0 -- 172.21.15.70:0/448923671 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fedf80f7bf0 msgr2=0x7fedf8100a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:12.904 INFO:tasks.workunit.client.0.smithi070.stderr: -85> 2024-09-12T00:54:12.696+0000 7fecd6ffd640 1 client.6086.objecter ms_handle_reset 0x7fedf80f7bf0 session 0x7fedf80a6070 osd.4 2024-09-12T00:54:12.904 INFO:tasks.workunit.client.0.smithi070.stderr: -84> 2024-09-12T00:54:12.696+0000 7fecd6ffd640 10 monclient: _renew_subs 2024-09-12T00:54:12.904 INFO:tasks.workunit.client.0.smithi070.stderr: -83> 2024-09-12T00:54:12.696+0000 7fecd6ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:54:12.904 INFO:tasks.workunit.client.0.smithi070.stderr: -82> 2024-09-12T00:54:12.696+0000 7fee05fdd640 10 monclient: get_auth_request con 0x7fecd0080880 auth_method 0 2024-09-12T00:54:12.904 INFO:tasks.workunit.client.0.smithi070.stderr: -81> 2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:12.904 INFO:tasks.workunit.client.0.smithi070.stderr: -80> 2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:12.904 INFO:tasks.workunit.client.0.smithi070.stderr: -79> 2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:12.904 INFO:tasks.workunit.client.0.smithi070.stderr: -78> 2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:12.904 INFO:tasks.workunit.client.0.smithi070.stderr: -77> 2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:12.904 INFO:tasks.workunit.client.0.smithi070.stderr: -76> 2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:12.905 INFO:tasks.workunit.client.0.smithi070.stderr: -75> 2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.905 INFO:tasks.workunit.client.0.smithi070.stderr: -74> 2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.905 INFO:tasks.workunit.client.0.smithi070.stderr: -73> 2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.905 INFO:tasks.workunit.client.0.smithi070.stderr: -72> 2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:12.905 INFO:tasks.workunit.client.0.smithi070.stderr: -71> 2024-09-12T00:54:12.708+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.905 INFO:tasks.workunit.client.0.smithi070.stderr: -70> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:12.905 INFO:tasks.workunit.client.0.smithi070.stderr: -69> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 zone default found 2024-09-12T00:54:12.905 INFO:tasks.workunit.client.0.smithi070.stderr: -68> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 4 Realm: () 2024-09-12T00:54:12.905 INFO:tasks.workunit.client.0.smithi070.stderr: -67> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:12.905 INFO:tasks.workunit.client.0.smithi070.stderr: -66> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:12.905 INFO:tasks.workunit.client.0.smithi070.stderr: -65> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:12.905 INFO:tasks.workunit.client.0.smithi070.stderr: -64> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 zonegroup default 2024-09-12T00:54:12.905 INFO:tasks.workunit.client.0.smithi070.stderr: -63> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.906 INFO:tasks.workunit.client.0.smithi070.stderr: -62> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.906 INFO:tasks.workunit.client.0.smithi070.stderr: -61> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.906 INFO:tasks.workunit.client.0.smithi070.stderr: -60> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.906 INFO:tasks.workunit.client.0.smithi070.stderr: -59> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.906 INFO:tasks.workunit.client.0.smithi070.stderr: -58> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.906 INFO:tasks.workunit.client.0.smithi070.stderr: -57> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 started sync module instance, tier type = 2024-09-12T00:54:12.906 INFO:tasks.workunit.client.0.smithi070.stderr: -56> 2024-09-12T00:54:12.712+0000 7fee07cd69c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:12.906 INFO:tasks.workunit.client.0.smithi070.stderr: -55> 2024-09-12T00:54:12.736+0000 7fee07cd69c0 20 add_watcher() i=0 2024-09-12T00:54:12.906 INFO:tasks.workunit.client.0.smithi070.stderr: -54> 2024-09-12T00:54:12.736+0000 7fee07cd69c0 20 add_watcher() i=1 2024-09-12T00:54:12.906 INFO:tasks.workunit.client.0.smithi070.stderr: -53> 2024-09-12T00:54:12.736+0000 7fee07cd69c0 20 add_watcher() i=2 2024-09-12T00:54:12.906 INFO:tasks.workunit.client.0.smithi070.stderr: -52> 2024-09-12T00:54:12.736+0000 7fee07cd69c0 20 add_watcher() i=3 2024-09-12T00:54:12.906 INFO:tasks.workunit.client.0.smithi070.stderr: -51> 2024-09-12T00:54:12.736+0000 7fee07cd69c0 20 add_watcher() i=4 2024-09-12T00:54:12.906 INFO:tasks.workunit.client.0.smithi070.stderr: -50> 2024-09-12T00:54:12.736+0000 7fee07cd69c0 20 add_watcher() i=5 2024-09-12T00:54:12.907 INFO:tasks.workunit.client.0.smithi070.stderr: -49> 2024-09-12T00:54:12.736+0000 7fee07cd69c0 20 add_watcher() i=6 2024-09-12T00:54:12.907 INFO:tasks.workunit.client.0.smithi070.stderr: -48> 2024-09-12T00:54:12.740+0000 7fee07cd69c0 20 add_watcher() i=7 2024-09-12T00:54:12.907 INFO:tasks.workunit.client.0.smithi070.stderr: -47> 2024-09-12T00:54:12.740+0000 7fee07cd69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:12.907 INFO:tasks.workunit.client.0.smithi070.stderr: -46> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding auth protocol: cephx 2024-09-12T00:54:12.907 INFO:tasks.workunit.client.0.smithi070.stderr: -45> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding auth protocol: cephx 2024-09-12T00:54:12.907 INFO:tasks.workunit.client.0.smithi070.stderr: -44> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding auth protocol: cephx 2024-09-12T00:54:12.907 INFO:tasks.workunit.client.0.smithi070.stderr: -43> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding con mode: secure 2024-09-12T00:54:12.907 INFO:tasks.workunit.client.0.smithi070.stderr: -42> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding con mode: crc 2024-09-12T00:54:12.907 INFO:tasks.workunit.client.0.smithi070.stderr: -41> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding con mode: secure 2024-09-12T00:54:12.907 INFO:tasks.workunit.client.0.smithi070.stderr: -40> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding con mode: crc 2024-09-12T00:54:12.907 INFO:tasks.workunit.client.0.smithi070.stderr: -39> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding con mode: secure 2024-09-12T00:54:12.907 INFO:tasks.workunit.client.0.smithi070.stderr: -38> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding con mode: crc 2024-09-12T00:54:12.907 INFO:tasks.workunit.client.0.smithi070.stderr: -37> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding con mode: crc 2024-09-12T00:54:12.907 INFO:tasks.workunit.client.0.smithi070.stderr: -36> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding con mode: secure 2024-09-12T00:54:12.908 INFO:tasks.workunit.client.0.smithi070.stderr: -35> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding con mode: crc 2024-09-12T00:54:12.908 INFO:tasks.workunit.client.0.smithi070.stderr: -34> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding con mode: secure 2024-09-12T00:54:12.908 INFO:tasks.workunit.client.0.smithi070.stderr: -33> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding con mode: crc 2024-09-12T00:54:12.908 INFO:tasks.workunit.client.0.smithi070.stderr: -32> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 AuthRegistry(0x7ffd08939e20) adding con mode: secure 2024-09-12T00:54:12.908 INFO:tasks.workunit.client.0.smithi070.stderr: -31> 2024-09-12T00:54:12.744+0000 7fecbbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:12.908 INFO:tasks.workunit.client.0.smithi070.stderr: -30> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:12.908 INFO:tasks.workunit.client.0.smithi070.stderr: -29> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:12.908 INFO:tasks.workunit.client.0.smithi070.stderr: -28> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:12.908 INFO:tasks.workunit.client.0.smithi070.stderr: -27> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command cache list hook 0x55ebe3e61c40 2024-09-12T00:54:12.908 INFO:tasks.workunit.client.0.smithi070.stderr: -26> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command cache inspect hook 0x55ebe3e61c40 2024-09-12T00:54:12.908 INFO:tasks.workunit.client.0.smithi070.stderr: -25> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command cache erase hook 0x55ebe3e61c40 2024-09-12T00:54:12.908 INFO:tasks.workunit.client.0.smithi070.stderr: -24> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command cache zap hook 0x55ebe3e61c40 2024-09-12T00:54:12.908 INFO:tasks.workunit.client.0.smithi070.stderr: -23> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 note: GC not initialized 2024-09-12T00:54:12.909 INFO:tasks.workunit.client.0.smithi070.stderr: -22> 2024-09-12T00:54:12.744+0000 7fecbafe5640 20 reqs_thread_entry: start 2024-09-12T00:54:12.909 INFO:tasks.workunit.client.0.smithi070.stderr: -21> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command sync trace show hook 0x7fee00001690 2024-09-12T00:54:12.909 INFO:tasks.workunit.client.0.smithi070.stderr: -20> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command sync trace history hook 0x7fee00001690 2024-09-12T00:54:12.909 INFO:tasks.workunit.client.0.smithi070.stderr: -19> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command sync trace active hook 0x7fee00001690 2024-09-12T00:54:12.909 INFO:tasks.workunit.client.0.smithi070.stderr: -18> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 5 asok(0x55ebe3b892b0) register_command sync trace active_short hook 0x7fee00001690 2024-09-12T00:54:12.909 INFO:tasks.workunit.client.0.smithi070.stderr: -17> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:12.909 INFO:tasks.workunit.client.0.smithi070.stderr: -16> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 20 Filter name: none 2024-09-12T00:54:12.909 INFO:tasks.workunit.client.0.smithi070.stderr: -15> 2024-09-12T00:54:12.744+0000 7fecb8fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:12.909 INFO:tasks.workunit.client.0.smithi070.stderr: -14> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:54:12.909 INFO:tasks.workunit.client.0.smithi070.stderr: -13> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.909 INFO:tasks.workunit.client.0.smithi070.stderr: -12> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:54:12.909 INFO:tasks.workunit.client.0.smithi070.stderr: -11> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:54:12.909 INFO:tasks.workunit.client.0.smithi070.stderr: -10> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:54:12.910 INFO:tasks.workunit.client.0.smithi070.stderr: -9> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 : miss 2024-09-12T00:54:12.910 INFO:tasks.workunit.client.0.smithi070.stderr: -8> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.910 INFO:tasks.workunit.client.0.smithi070.stderr: -7> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:54:12.910 INFO:tasks.workunit.client.0.smithi070.stderr: -6> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 info.flags=0x17 2024-09-12T00:54:12.910 INFO:tasks.workunit.client.0.smithi070.stderr: -5> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 to cache LRU end 2024-09-12T00:54:12.910 INFO:tasks.workunit.client.0.smithi070.stderr: -4> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:12.910 INFO:tasks.workunit.client.0.smithi070.stderr: -3> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:12.910 INFO:tasks.workunit.client.0.smithi070.stderr: -2> 2024-09-12T00:54:12.744+0000 7fee07cd69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 2024-09-12T00:54:12.910 INFO:tasks.workunit.client.0.smithi070.stderr: -1> 2024-09-12T00:54:12.752+0000 7fee07cd69c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fee07cd69c0 time 2024-09-12T00:54:12.753413+0000 2024-09-12T00:54:12.910 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:12.910 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.910 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:12.910 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fee0b5b02eb] 2024-09-12T00:54:12.911 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fee0b5b049f] 2024-09-12T00:54:12.911 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ebe23c1cc1] 2024-09-12T00:54:12.911 INFO:tasks.workunit.client.0.smithi070.stderr: 4: radosgw-admin(+0x1421f32) [0x55ebe2e1ef32] 2024-09-12T00:54:12.911 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ebe23d6ced] 2024-09-12T00:54:12.911 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:54:12.911 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fee0a416d90] 2024-09-12T00:54:12.911 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:54:12.911 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:54:12.911 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.911 INFO:tasks.workunit.client.0.smithi070.stderr: 0> 2024-09-12T00:54:12.756+0000 7fee07cd69c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:54:12.911 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7fee07cd69c0 thread_name:radosgw-admin 2024-09-12T00:54:12.911 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.911 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:12.912 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fee0a42f520] 2024-09-12T00:54:12.912 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:54:12.912 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:54:12.912 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:54:12.912 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fee0b5b0345] 2024-09-12T00:54:12.912 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fee0b5b049f] 2024-09-12T00:54:12.912 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ebe23c1cc1] 2024-09-12T00:54:12.912 INFO:tasks.workunit.client.0.smithi070.stderr: 8: radosgw-admin(+0x1421f32) [0x55ebe2e1ef32] 2024-09-12T00:54:12.912 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ebe23d6ced] 2024-09-12T00:54:12.912 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:54:12.912 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fee0a416d90] 2024-09-12T00:54:12.912 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:54:12.912 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:54:12.913 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:54:12.913 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.913 INFO:tasks.workunit.client.0.smithi070.stderr:--- logging levels --- 2024-09-12T00:54:12.913 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 none 2024-09-12T00:54:12.913 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 lockdep 2024-09-12T00:54:12.913 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 context 2024-09-12T00:54:12.913 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 crush 2024-09-12T00:54:12.913 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds 2024-09-12T00:54:12.913 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_balancer 2024-09-12T00:54:12.913 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_locker 2024-09-12T00:54:12.913 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log 2024-09-12T00:54:12.913 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log_expire 2024-09-12T00:54:12.913 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_migrator 2024-09-12T00:54:12.914 INFO:tasks.workunit.client.0.smithi070.stderr: 3/ 5 mds_quiesce 2024-09-12T00:54:12.914 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 buffer 2024-09-12T00:54:12.914 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 timer 2024-09-12T00:54:12.914 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 filer 2024-09-12T00:54:12.914 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 striper 2024-09-12T00:54:12.914 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 objecter 2024-09-12T00:54:12.914 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rados 2024-09-12T00:54:12.914 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd 2024-09-12T00:54:12.914 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_mirror 2024-09-12T00:54:12.914 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_replay 2024-09-12T00:54:12.914 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_pwl 2024-09-12T00:54:12.914 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 journaler 2024-09-12T00:54:12.914 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objectcacher 2024-09-12T00:54:12.914 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:54:12.915 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 client 2024-09-12T00:54:12.915 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 osd 2024-09-12T00:54:12.915 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 optracker 2024-09-12T00:54:12.915 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objclass 2024-09-12T00:54:12.915 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 filestore 2024-09-12T00:54:12.915 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 journal 2024-09-12T00:54:12.915 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 ms 2024-09-12T00:54:12.915 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mon 2024-09-12T00:54:12.915 INFO:tasks.workunit.client.0.smithi070.stderr: 0/10 monc 2024-09-12T00:54:12.915 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 paxos 2024-09-12T00:54:12.915 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 tp 2024-09-12T00:54:12.915 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 auth 2024-09-12T00:54:12.915 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 crypto 2024-09-12T00:54:12.916 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 finisher 2024-09-12T00:54:12.916 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 reserver 2024-09-12T00:54:12.916 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 heartbeatmap 2024-09-12T00:54:12.916 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 perfcounter 2024-09-12T00:54:12.916 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw 2024-09-12T00:54:12.916 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_sync 2024-09-12T00:54:12.916 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_datacache 2024-09-12T00:54:12.916 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_access 2024-09-12T00:54:12.916 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:54:12.916 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_flight 2024-09-12T00:54:12.916 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:54:12.916 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw_notification 2024-09-12T00:54:12.916 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 javaclient 2024-09-12T00:54:12.916 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 asok 2024-09-12T00:54:12.917 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 throttle 2024-09-12T00:54:12.917 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 refs 2024-09-12T00:54:12.917 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 compressor 2024-09-12T00:54:12.917 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluestore 2024-09-12T00:54:12.917 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluefs 2024-09-12T00:54:12.917 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 bdev 2024-09-12T00:54:12.917 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 kstore 2024-09-12T00:54:12.917 INFO:tasks.workunit.client.0.smithi070.stderr: 4/ 5 rocksdb 2024-09-12T00:54:12.917 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 fuse 2024-09-12T00:54:12.917 INFO:tasks.workunit.client.0.smithi070.stderr: 2/ 5 mgr 2024-09-12T00:54:12.917 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mgrc 2024-09-12T00:54:12.917 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 dpdk 2024-09-12T00:54:12.917 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 eventtrace 2024-09-12T00:54:12.918 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 prioritycache 2024-09-12T00:54:12.918 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 test 2024-09-12T00:54:12.918 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:54:12.918 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephsqlite 2024-09-12T00:54:12.918 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:54:12.918 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore 2024-09-12T00:54:12.918 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_onode 2024-09-12T00:54:12.918 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_odata 2024-09-12T00:54:12.918 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_omap 2024-09-12T00:54:12.918 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_tm 2024-09-12T00:54:12.918 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_t 2024-09-12T00:54:12.918 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:54:12.918 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_epm 2024-09-12T00:54:12.918 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_lba 2024-09-12T00:54:12.919 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:54:12.919 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cache 2024-09-12T00:54:12.919 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_journal 2024-09-12T00:54:12.919 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_device 2024-09-12T00:54:12.919 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_backref 2024-09-12T00:54:12.919 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 alienstore 2024-09-12T00:54:12.919 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mclock 2024-09-12T00:54:12.919 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cyanstore 2024-09-12T00:54:12.919 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 ceph_exporter 2024-09-12T00:54:12.919 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 memstore 2024-09-12T00:54:12.919 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 trace 2024-09-12T00:54:12.919 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 ceph_dedup 2024-09-12T00:54:12.919 INFO:tasks.workunit.client.0.smithi070.stderr: -2/-2 (syslog threshold) 2024-09-12T00:54:12.919 INFO:tasks.workunit.client.0.smithi070.stderr: 99/99 (stderr threshold) 2024-09-12T00:54:12.920 INFO:tasks.workunit.client.0.smithi070.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:54:12.920 INFO:tasks.workunit.client.0.smithi070.stderr: 7fecb8fe1640 / http_manager 2024-09-12T00:54:12.920 INFO:tasks.workunit.client.0.smithi070.stderr: 7fecbafe5640 / http_manager 2024-09-12T00:54:12.920 INFO:tasks.workunit.client.0.smithi070.stderr: 7fecbbfe7640 / rgw_dt_lg_renew 2024-09-12T00:54:12.920 INFO:tasks.workunit.client.0.smithi070.stderr: 7fecd6ffd640 / ms_dispatch 2024-09-12T00:54:12.920 INFO:tasks.workunit.client.0.smithi070.stderr: 7fece8ff9640 / io_context_pool 2024-09-12T00:54:12.920 INFO:tasks.workunit.client.0.smithi070.stderr: 7feceaffd640 / ms_dispatch 2024-09-12T00:54:12.920 INFO:tasks.workunit.client.0.smithi070.stderr: 7fecf1e03640 / ms_dispatch 2024-09-12T00:54:12.920 INFO:tasks.workunit.client.0.smithi070.stderr: 7fecf3606640 / io_context_pool 2024-09-12T00:54:12.920 INFO:tasks.workunit.client.0.smithi070.stderr: 7fee04fdb640 / msgr-worker-2 2024-09-12T00:54:12.920 INFO:tasks.workunit.client.0.smithi070.stderr: 7fee057dc640 / msgr-worker-1 2024-09-12T00:54:12.920 INFO:tasks.workunit.client.0.smithi070.stderr: 7fee05fdd640 / msgr-worker-0 2024-09-12T00:54:12.920 INFO:tasks.workunit.client.0.smithi070.stderr: 7fee067de640 / io_context_pool 2024-09-12T00:54:12.921 INFO:tasks.workunit.client.0.smithi070.stderr: 7fee07cd69c0 / radosgw-admin 2024-09-12T00:54:12.921 INFO:tasks.workunit.client.0.smithi070.stderr: max_recent 500 2024-09-12T00:54:12.921 INFO:tasks.workunit.client.0.smithi070.stderr: max_new 1000 2024-09-12T00:54:12.921 INFO:tasks.workunit.client.0.smithi070.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:54:12.760386Z_b9ce0f9c-183e-4fd4-b173-48ea436a059f/log 2024-09-12T00:54:12.921 INFO:tasks.workunit.client.0.smithi070.stderr:--- end dump of recent events --- 2024-09-12T00:54:12.921 INFO:tasks.workunit.client.0.smithi070.stderr:Aborted 2024-09-12T00:54:12.921 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:54:12.921 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:12.921 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:12.926 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.844+0000 7f5e504519c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.926 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.848+0000 7f5e504519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.926 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.848+0000 7f5e504519c0 20 realm 2024-09-12T00:54:12.926 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.848+0000 7f5e504519c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.927 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.848+0000 7f5e504519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.927 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.848+0000 7f5e504519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:12.927 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.848+0000 7f5e504519c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.927 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.848+0000 7f5e504519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.927 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.848+0000 7f5e504519c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.927 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.848+0000 7f5e504519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:12.927 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.848+0000 7f5e504519c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.927 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.848+0000 7f5e504519c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:12.927 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.848+0000 7f5e504519c0 20 searching for the correct realm 2024-09-12T00:54:12.927 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.852+0000 7f5e4e758640 0 -- 172.21.15.70:0/3385637484 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f5e440e4950 msgr2=0x7f5e440e2430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:12.927 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.860+0000 7f5e4df57640 0 -- 172.21.15.70:0/3385637484 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f5e48095060 msgr2=0x7f5e48044aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:12.927 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.868+0000 7f5e504519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:12.927 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.868+0000 7f5e504519c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:12.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.868+0000 7f5e504519c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:12.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.868+0000 7f5e504519c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:12.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.868+0000 7f5e504519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:12.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.868+0000 7f5e504519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:12.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.868+0000 7f5e504519c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.868+0000 7f5e504519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.868+0000 7f5e504519c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.872+0000 7f5e504519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:12.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.872+0000 7f5e504519c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.872+0000 7f5e504519c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:12.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.872+0000 7f5e504519c0 20 zone default found 2024-09-12T00:54:12.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.872+0000 7f5e504519c0 4 Realm: () 2024-09-12T00:54:12.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.872+0000 7f5e504519c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:12.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.872+0000 7f5e504519c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:12.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.872+0000 7f5e504519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:12.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.872+0000 7f5e504519c0 20 zonegroup default 2024-09-12T00:54:12.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.872+0000 7f5e504519c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.872+0000 7f5e504519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.872+0000 7f5e504519c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.872+0000 7f5e504519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.872+0000 7f5e504519c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.872+0000 7f5e504519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:12.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.872+0000 7f5e504519c0 20 started sync module instance, tier type = 2024-09-12T00:54:12.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.872+0000 7f5e504519c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:12.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.888+0000 7f5e504519c0 20 add_watcher() i=0 2024-09-12T00:54:12.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.888+0000 7f5e504519c0 20 add_watcher() i=1 2024-09-12T00:54:12.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.888+0000 7f5e504519c0 20 add_watcher() i=2 2024-09-12T00:54:12.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.888+0000 7f5e504519c0 20 add_watcher() i=3 2024-09-12T00:54:12.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.888+0000 7f5e504519c0 20 add_watcher() i=4 2024-09-12T00:54:12.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.888+0000 7f5e504519c0 20 add_watcher() i=5 2024-09-12T00:54:12.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.888+0000 7f5e504519c0 20 add_watcher() i=6 2024-09-12T00:54:12.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.888+0000 7f5e504519c0 20 add_watcher() i=7 2024-09-12T00:54:12.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.888+0000 7f5e504519c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:12.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.892+0000 7f5cff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:12.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.892+0000 7f5e504519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:12.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.892+0000 7f5e504519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:12.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.892+0000 7f5e504519c0 5 note: GC not initialized 2024-09-12T00:54:12.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.892+0000 7f5cfe7fc640 20 reqs_thread_entry: start 2024-09-12T00:54:12.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.892+0000 7f5e504519c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:12.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.892+0000 7f5e504519c0 20 Filter name: none 2024-09-12T00:54:12.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.892+0000 7f5c6ffff640 20 reqs_thread_entry: start 2024-09-12T00:54:12.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.892+0000 7f5e504519c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.892+0000 7f5e504519c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:54:12.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.892+0000 7f5e504519c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.892+0000 7f5e504519c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:54:12.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.892+0000 7f5e504519c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:12.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.892+0000 7f5e504519c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.892+0000 7f5e504519c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:54:12.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.892+0000 7f5e504519c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:12.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.896+0000 7f5e504519c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:54:12.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.896+0000 7f5e504519c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:12.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.896+0000 7f5cff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:12.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.900+0000 7f5e504519c0 20 remove_watcher() i=0 2024-09-12T00:54:12.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.900+0000 7f5e504519c0 2 removed watcher, disabling cache 2024-09-12T00:54:12.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.904+0000 7f5e504519c0 20 remove_watcher() i=1 2024-09-12T00:54:12.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.904+0000 7f5e504519c0 20 remove_watcher() i=2 2024-09-12T00:54:12.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.908+0000 7f5e504519c0 20 remove_watcher() i=3 2024-09-12T00:54:12.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.908+0000 7f5e504519c0 20 remove_watcher() i=4 2024-09-12T00:54:12.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.908+0000 7f5e504519c0 20 remove_watcher() i=5 2024-09-12T00:54:12.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.912+0000 7f5e504519c0 20 remove_watcher() i=6 2024-09-12T00:54:12.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:12.912+0000 7f5e504519c0 20 remove_watcher() i=7 2024-09-12T00:54:12.932 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.932 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:54:12.932 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: abort-at-init-indext id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:54:12.932 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:12.932 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:12.932 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:12.933 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:12.933 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:12.974 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:54:13.004 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:13.005 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:13.049 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.056+0000 7f0f7f5269c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.056+0000 7f0f7f5269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.056+0000 7f0f7f5269c0 20 realm 2024-09-12T00:54:13.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.056+0000 7f0f7f5269c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.056+0000 7f0f7f5269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.056+0000 7f0f7f5269c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:13.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.056+0000 7f0f7f5269c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.056+0000 7f0f7f5269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.052 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.056+0000 7f0f7f5269c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.053 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.060+0000 7f0f7f5269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:13.053 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.060+0000 7f0f7f5269c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.054 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.060+0000 7f0f7f5269c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:13.054 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.060+0000 7f0f7f5269c0 20 searching for the correct realm 2024-09-12T00:54:13.058 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.064+0000 7f0f7d82d640 0 -- 172.21.15.70:0/995967116 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f0f74100d30 msgr2=0x7f0f740ba9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:13.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.280+0000 7f0f7d82d640 0 -- 172.21.15.70:0/995967116 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f0f74100d30 msgr2=0x7f0f740ba9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:13.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.292+0000 7f0f7f5269c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:13.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.292+0000 7f0f7f5269c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:13.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.292+0000 7f0f7f5269c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:13.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.292+0000 7f0f7f5269c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:13.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.292+0000 7f0f7f5269c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:13.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.292+0000 7f0f7f5269c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:13.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.292+0000 7f0f7f5269c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.292+0000 7f0f7f5269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.292+0000 7f0f7f5269c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.292+0000 7f0f7f5269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:13.288 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.292+0000 7f0f7f5269c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.288 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.296+0000 7f0f7f5269c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:13.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.296+0000 7f0f7f5269c0 20 zone default found 2024-09-12T00:54:13.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.296+0000 7f0f7f5269c0 4 Realm: () 2024-09-12T00:54:13.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.296+0000 7f0f7f5269c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:13.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.296+0000 7f0f7f5269c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:13.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.296+0000 7f0f7f5269c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:13.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.296+0000 7f0f7f5269c0 20 zonegroup default 2024-09-12T00:54:13.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.296+0000 7f0f7f5269c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.290 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.296+0000 7f0f7f5269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.290 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.296+0000 7f0f7f5269c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.290 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.296+0000 7f0f7f5269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.290 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.296+0000 7f0f7f5269c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.290 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.296+0000 7f0f7f5269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:13.291 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.296+0000 7f0f7f5269c0 20 started sync module instance, tier type = 2024-09-12T00:54:13.291 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.296+0000 7f0f7f5269c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:13.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.320+0000 7f0f7f5269c0 20 add_watcher() i=0 2024-09-12T00:54:13.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.320+0000 7f0f7f5269c0 20 add_watcher() i=1 2024-09-12T00:54:13.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.320+0000 7f0f7f5269c0 20 add_watcher() i=2 2024-09-12T00:54:13.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.320+0000 7f0f7f5269c0 20 add_watcher() i=3 2024-09-12T00:54:13.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.320+0000 7f0f7f5269c0 20 add_watcher() i=4 2024-09-12T00:54:13.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.320+0000 7f0f7f5269c0 20 add_watcher() i=5 2024-09-12T00:54:13.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.320+0000 7f0f7f5269c0 20 add_watcher() i=6 2024-09-12T00:54:13.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.320+0000 7f0f7f5269c0 20 add_watcher() i=7 2024-09-12T00:54:13.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.320+0000 7f0f7f5269c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:13.319 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.324+0000 7f0e33fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:13.319 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.324+0000 7f0f7f5269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:13.320 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.324+0000 7f0f7f5269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:13.320 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.324+0000 7f0f7f5269c0 5 note: GC not initialized 2024-09-12T00:54:13.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.328+0000 7f0e32fe5640 20 reqs_thread_entry: start 2024-09-12T00:54:13.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.328+0000 7f0f7f5269c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:13.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.328+0000 7f0f7f5269c0 20 Filter name: none 2024-09-12T00:54:13.322 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.328+0000 7f0e30fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:13.322 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.328+0000 7f0f7f5269c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:54:13.322 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.328+0000 7f0f7f5269c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.322 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.328+0000 7f0f7f5269c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:54:13.322 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.328+0000 7f0f7f5269c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:54:13.322 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.328+0000 7f0f7f5269c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:54:13.322 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.328+0000 7f0f7f5269c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 : miss 2024-09-12T00:54:13.322 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.328+0000 7f0f7f5269c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:13.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.328+0000 7f0f7f5269c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:54:13.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.328+0000 7f0f7f5269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 info.flags=0x17 2024-09-12T00:54:13.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.328+0000 7f0f7f5269c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 to cache LRU end 2024-09-12T00:54:13.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.328+0000 7f0f7f5269c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:13.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.328+0000 7f0f7f5269c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:13.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.328+0000 7f0f7f5269c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 2024-09-12T00:54:13.325 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.332+0000 7f0f7f5269c0 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 to be held by another RGW process; skipping for now 2024-09-12T00:54:13.327 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.332+0000 7f0e33fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:13.332 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.336+0000 7f0f7f5269c0 20 remove_watcher() i=0 2024-09-12T00:54:13.332 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.336+0000 7f0f7f5269c0 2 removed watcher, disabling cache 2024-09-12T00:54:13.334 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.340+0000 7f0f7f5269c0 20 remove_watcher() i=1 2024-09-12T00:54:13.336 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.344+0000 7f0f7f5269c0 20 remove_watcher() i=2 2024-09-12T00:54:13.338 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.344+0000 7f0f7f5269c0 20 remove_watcher() i=3 2024-09-12T00:54:13.341 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.348+0000 7f0f7f5269c0 20 remove_watcher() i=4 2024-09-12T00:54:13.343 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.348+0000 7f0f7f5269c0 20 remove_watcher() i=5 2024-09-12T00:54:13.344 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.352+0000 7f0f7f5269c0 20 remove_watcher() i=6 2024-09-12T00:54:13.346 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:13.352+0000 7f0f7f5269c0 20 remove_watcher() i=7 2024-09-12T00:54:13.364 INFO:tasks.workunit.client.0.smithi070.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:54:43.381 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:54:43.417 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:43.418 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:43.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.467+0000 7f67df6389c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:43.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.467+0000 7f67df6389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:43.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.467+0000 7f67df6389c0 20 realm 2024-09-12T00:54:43.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.467+0000 7f67df6389c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:43.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.467+0000 7f67df6389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:43.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.467+0000 7f67df6389c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:43.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.467+0000 7f67df6389c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:43.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.467+0000 7f67df6389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:43.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.467+0000 7f67df6389c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:43.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.471+0000 7f67df6389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:43.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.471+0000 7f67df6389c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:43.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.471+0000 7f67df6389c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:43.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.471+0000 7f67df6389c0 20 searching for the correct realm 2024-09-12T00:54:43.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.475+0000 7f67dd93f640 0 -- 172.21.15.70:0/772775538 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f67d4044070 msgr2=0x7f67d4050960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:43.686 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.691+0000 7f67dd93f640 0 -- 172.21.15.70:0/772775538 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f67d4044070 msgr2=0x7f67d4050960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:43.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.703+0000 7f67df6389c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:43.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.703+0000 7f67df6389c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:43.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.703+0000 7f67df6389c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:43.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.703+0000 7f67df6389c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:43.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.703+0000 7f67df6389c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:43.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.703+0000 7f67df6389c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:43.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.703+0000 7f67df6389c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:43.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.703+0000 7f67df6389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:43.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.703+0000 7f67df6389c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:43.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.703+0000 7f67df6389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:43.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.703+0000 7f67df6389c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:43.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.707+0000 7f67df6389c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:43.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.707+0000 7f67df6389c0 20 zone default found 2024-09-12T00:54:43.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.707+0000 7f67df6389c0 4 Realm: () 2024-09-12T00:54:43.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.707+0000 7f67df6389c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:43.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.707+0000 7f67df6389c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:43.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.707+0000 7f67df6389c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:43.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.707+0000 7f67df6389c0 20 zonegroup default 2024-09-12T00:54:43.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.707+0000 7f67df6389c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:43.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.707+0000 7f67df6389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:43.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.707+0000 7f67df6389c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:43.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.707+0000 7f67df6389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:43.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.707+0000 7f67df6389c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:43.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.707+0000 7f67df6389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:43.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.707+0000 7f67df6389c0 20 started sync module instance, tier type = 2024-09-12T00:54:43.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.707+0000 7f67df6389c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:43.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.727+0000 7f67df6389c0 20 add_watcher() i=0 2024-09-12T00:54:43.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.727+0000 7f67df6389c0 20 add_watcher() i=1 2024-09-12T00:54:43.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.727+0000 7f67df6389c0 20 add_watcher() i=2 2024-09-12T00:54:43.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.727+0000 7f67df6389c0 20 add_watcher() i=3 2024-09-12T00:54:43.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.727+0000 7f67df6389c0 20 add_watcher() i=4 2024-09-12T00:54:43.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.727+0000 7f67df6389c0 20 add_watcher() i=5 2024-09-12T00:54:43.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.727+0000 7f67df6389c0 20 add_watcher() i=6 2024-09-12T00:54:43.725 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.731+0000 7f67df6389c0 20 add_watcher() i=7 2024-09-12T00:54:43.725 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.731+0000 7f67df6389c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:43.729 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.735+0000 7f66937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:43.730 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.735+0000 7f67df6389c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:43.730 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.735+0000 7f67df6389c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:43.730 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.735+0000 7f67df6389c0 5 note: GC not initialized 2024-09-12T00:54:43.731 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.735+0000 7f66927e4640 20 reqs_thread_entry: start 2024-09-12T00:54:43.731 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.735+0000 7f67df6389c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:43.731 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.735+0000 7f67df6389c0 20 Filter name: none 2024-09-12T00:54:43.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.735+0000 7f6603fff640 20 reqs_thread_entry: start 2024-09-12T00:54:43.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.735+0000 7f67df6389c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:54:43.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.735+0000 7f67df6389c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:43.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.739+0000 7f67df6389c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:54:43.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.739+0000 7f67df6389c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:54:43.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.739+0000 7f67df6389c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:54:43.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.739+0000 7f67df6389c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 : miss 2024-09-12T00:54:43.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.739+0000 7f67df6389c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:43.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.739+0000 7f67df6389c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:54:43.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.739+0000 7f67df6389c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 info.flags=0x17 2024-09-12T00:54:43.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.739+0000 7f67df6389c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 to cache LRU end 2024-09-12T00:54:43.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.739+0000 7f67df6389c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:43.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.739+0000 7f67df6389c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:43.734 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.739+0000 7f67df6389c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 2024-09-12T00:54:43.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.747+0000 7f67df6389c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 info.flags=0x17 2024-09-12T00:54:43.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.747+0000 7f67df6389c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 to cache LRU end 2024-09-12T00:54:43.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.747+0000 7f67df6389c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:43.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.747+0000 7f67df6389c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22, ofs0, ns] 2024-09-12T00:54:43.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.747+0000 7f66c0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431594 cookie 94219931192512 notifier 6438 bl.length()=997 2024-09-12T00:54:43.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.747+0000 7f66c0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 info.flags=0x17 2024-09-12T00:54:43.744 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.747+0000 7f66c0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 to cache LRU end 2024-09-12T00:54:43.744 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.747+0000 7f66c0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:43.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.751+0000 7f67df6389c0 20 handle_bi_update(): bucket=:abort-at-init-indext[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22]): orig_sources= new_sources= 2024-09-12T00:54:43.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.751+0000 7f67df6389c0 20 handle_bi_update(): bucket=:abort-at-init-indext[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22]): potential sources added=[] removed=[] 2024-09-12T00:54:43.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.751+0000 7f67df6389c0 20 handle_bi_update(): bucket=:abort-at-init-indext[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22]): orig_dests= new_dests= 2024-09-12T00:54:43.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.751+0000 7f67df6389c0 20 handle_bi_update(): bucket=:abort-at-init-indext[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22]): potential dests added=[] removed=[] 2024-09-12T00:54:43.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.755+0000 7f67df6389c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22.1.0 2024-09-12T00:54:43.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.755+0000 7f67df6389c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22.1.0 2024-09-12T00:54:43.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.755+0000 7f67df6389c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22.1.1 2024-09-12T00:54:43.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.755+0000 7f67df6389c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22.1.1 2024-09-12T00:54:43.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.755+0000 7f67df6389c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22.0 2024-09-12T00:54:43.753 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.759+0000 7f67df6389c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:43.753 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.759+0000 7f67df6389c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 2024-09-12T00:54:43.757 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.763+0000 7f67df6389c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 info.flags=0x17 2024-09-12T00:54:43.757 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.763+0000 7f67df6389c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 to cache LRU end 2024-09-12T00:54:43.757 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.763+0000 7f67df6389c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:43.757 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.763+0000 7f67df6389c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22, ofs0, ns] 2024-09-12T00:54:43.757 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.763+0000 7f66affff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431595 cookie 94219931192512 notifier 6438 bl.length()=997 2024-09-12T00:54:43.757 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.763+0000 7f66affff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 info.flags=0x17 2024-09-12T00:54:43.758 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.763+0000 7f66affff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 to cache LRU end 2024-09-12T00:54:43.758 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.763+0000 7f66affff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:43.758 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.763+0000 7f67df6389c0 20 handle_bi_update(): bucket=:abort-at-init-indext[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22]): orig_sources= new_sources= 2024-09-12T00:54:43.758 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.763+0000 7f67df6389c0 20 handle_bi_update(): bucket=:abort-at-init-indext[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22]): potential sources added=[] removed=[] 2024-09-12T00:54:43.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.763+0000 7f67df6389c0 20 handle_bi_update(): bucket=:abort-at-init-indext[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22]): orig_dests= new_dests= 2024-09-12T00:54:43.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.763+0000 7f67df6389c0 20 handle_bi_update(): bucket=:abort-at-init-indext[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22]): potential dests added=[] removed=[] 2024-09-12T00:54:43.760 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.767+0000 7f67df6389c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22.0 2024-09-12T00:54:43.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.767+0000 7f67df6389c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:43.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.767+0000 7f67df6389c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 2024-09-12T00:54:43.764 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.771+0000 7f67df6389c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 info.flags=0x17 2024-09-12T00:54:43.764 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.771+0000 7f67df6389c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 to cache LRU end 2024-09-12T00:54:43.765 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.771+0000 7f67df6389c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:43.765 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.771+0000 7f67df6389c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22, ofs0, ns] 2024-09-12T00:54:43.765 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.771+0000 7f66c0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431596 cookie 94219931192512 notifier 6438 bl.length()=965 2024-09-12T00:54:43.765 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.771+0000 7f66c0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 info.flags=0x17 2024-09-12T00:54:43.765 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.771+0000 7f66c0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 to cache LRU end 2024-09-12T00:54:43.765 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.771+0000 7f66c0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:43.766 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.771+0000 7f67df6389c0 20 handle_bi_update(): bucket=:abort-at-init-indext[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22]): orig_sources= new_sources= 2024-09-12T00:54:43.766 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.771+0000 7f67df6389c0 20 handle_bi_update(): bucket=:abort-at-init-indext[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22]): potential sources added=[] removed=[] 2024-09-12T00:54:43.766 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.771+0000 7f67df6389c0 20 handle_bi_update(): bucket=:abort-at-init-indext[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22]): orig_dests= new_dests= 2024-09-12T00:54:43.766 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.771+0000 7f67df6389c0 20 handle_bi_update(): bucket=:abort-at-init-indext[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22]): potential dests added=[] removed=[] 2024-09-12T00:54:43.768 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.775+0000 7f67df6389c0 1 execute INFO: reshard of bucket "abort-at-init-indext" from 1 shards to 2 shards completed successfully 2024-09-12T00:54:43.772 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.775+0000 7f66937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:43.776 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.783+0000 7f67df6389c0 20 remove_watcher() i=0 2024-09-12T00:54:43.776 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.783+0000 7f67df6389c0 2 removed watcher, disabling cache 2024-09-12T00:54:43.778 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.783+0000 7f67df6389c0 20 remove_watcher() i=1 2024-09-12T00:54:43.781 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.787+0000 7f67df6389c0 20 remove_watcher() i=2 2024-09-12T00:54:43.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.787+0000 7f67df6389c0 20 remove_watcher() i=3 2024-09-12T00:54:43.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.791+0000 7f67df6389c0 20 remove_watcher() i=4 2024-09-12T00:54:43.786 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.791+0000 7f67df6389c0 20 remove_watcher() i=5 2024-09-12T00:54:43.788 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.791+0000 7f67df6389c0 20 remove_watcher() i=6 2024-09-12T00:54:43.789 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.795+0000 7f67df6389c0 20 remove_watcher() i=7 2024-09-12T00:54:43.806 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:54:43.833 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:43.833 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:43.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.883+0000 7f40c576e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:43.879 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.883+0000 7f40c576e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:43.879 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.883+0000 7f40c576e9c0 20 realm 2024-09-12T00:54:43.879 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.883+0000 7f40c576e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:43.879 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.883+0000 7f40c576e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:43.879 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.883+0000 7f40c576e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:43.879 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.883+0000 7f40c576e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:43.880 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.883+0000 7f40c576e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:43.880 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.883+0000 7f40c576e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:43.881 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.887+0000 7f40c576e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:43.881 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.887+0000 7f40c576e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:43.882 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.887+0000 7f40c576e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:43.882 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.887+0000 7f40c576e9c0 20 searching for the correct realm 2024-09-12T00:54:43.884 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:43.891+0000 7f40c2a73640 0 -- 172.21.15.70:0/588277766 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7f40b40e5040 msgr2=0x7f40b40e4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:44.101 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.107+0000 7f40c3274640 0 -- 172.21.15.70:0/588277766 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x55ee19389d80 msgr2=0x7f40bc027920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:44.116 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.123+0000 7f40c576e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:44.116 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.123+0000 7f40c576e9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:44.116 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.123+0000 7f40c576e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:44.117 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.123+0000 7f40c576e9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:44.117 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.123+0000 7f40c576e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:44.117 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.123+0000 7f40c576e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:44.117 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.123+0000 7f40c576e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.117 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.123+0000 7f40c576e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.117 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.123+0000 7f40c576e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.118 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.123+0000 7f40c576e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:44.118 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.123+0000 7f40c576e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.119 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.123+0000 7f40c576e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:44.119 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.123+0000 7f40c576e9c0 20 zone default found 2024-09-12T00:54:44.119 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.123+0000 7f40c576e9c0 4 Realm: () 2024-09-12T00:54:44.119 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.123+0000 7f40c576e9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:44.119 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.123+0000 7f40c576e9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:44.119 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.123+0000 7f40c576e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:44.119 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.123+0000 7f40c576e9c0 20 zonegroup default 2024-09-12T00:54:44.119 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.123+0000 7f40c576e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.120 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.123+0000 7f40c576e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.120 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.123+0000 7f40c576e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.120 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.127+0000 7f40c576e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.120 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.127+0000 7f40c576e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.121 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.127+0000 7f40c576e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.121 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.127+0000 7f40c576e9c0 20 started sync module instance, tier type = 2024-09-12T00:54:44.121 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.127+0000 7f40c576e9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:44.143 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.147+0000 7f40c576e9c0 20 add_watcher() i=0 2024-09-12T00:54:44.143 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.147+0000 7f40c576e9c0 20 add_watcher() i=1 2024-09-12T00:54:44.143 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.147+0000 7f40c576e9c0 20 add_watcher() i=2 2024-09-12T00:54:44.143 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.147+0000 7f40c576e9c0 20 add_watcher() i=3 2024-09-12T00:54:44.143 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.147+0000 7f40c576e9c0 20 add_watcher() i=4 2024-09-12T00:54:44.143 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.147+0000 7f40c576e9c0 20 add_watcher() i=5 2024-09-12T00:54:44.143 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.147+0000 7f40c576e9c0 20 add_watcher() i=6 2024-09-12T00:54:44.145 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.151+0000 7f40c576e9c0 20 add_watcher() i=7 2024-09-12T00:54:44.145 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.151+0000 7f40c576e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:44.149 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.155+0000 7f3f79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:44.150 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.155+0000 7f40c576e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:44.151 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.155+0000 7f40c576e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:44.151 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.155+0000 7f40c576e9c0 5 note: GC not initialized 2024-09-12T00:54:44.151 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.155+0000 7f3f78fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:44.151 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.155+0000 7f40c576e9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:44.152 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.155+0000 7f40c576e9c0 20 Filter name: none 2024-09-12T00:54:44.152 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.155+0000 7f3ef27fc640 20 reqs_thread_entry: start 2024-09-12T00:54:44.152 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.155+0000 7f40c576e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.152 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.159+0000 7f40c576e9c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:54:44.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.159+0000 7f40c576e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.159+0000 7f40c576e9c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:54:44.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.159+0000 7f40c576e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:44.154 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.159+0000 7f40c576e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.154 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.159+0000 7f40c576e9c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:54:44.154 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.159+0000 7f40c576e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.154 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.159+0000 7f40c576e9c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:54:44.154 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.159+0000 7f40c576e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:44.157 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.163+0000 7f3f79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:44.162 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.167+0000 7f40c576e9c0 20 remove_watcher() i=0 2024-09-12T00:54:44.162 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.167+0000 7f40c576e9c0 2 removed watcher, disabling cache 2024-09-12T00:54:44.164 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.167+0000 7f40c576e9c0 20 remove_watcher() i=1 2024-09-12T00:54:44.166 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.171+0000 7f40c576e9c0 20 remove_watcher() i=2 2024-09-12T00:54:44.168 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.175+0000 7f40c576e9c0 20 remove_watcher() i=3 2024-09-12T00:54:44.171 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.175+0000 7f40c576e9c0 20 remove_watcher() i=4 2024-09-12T00:54:44.173 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.179+0000 7f40c576e9c0 20 remove_watcher() i=5 2024-09-12T00:54:44.174 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.179+0000 7f40c576e9c0 20 remove_watcher() i=6 2024-09-12T00:54:44.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.183+0000 7f40c576e9c0 20 remove_watcher() i=7 2024-09-12T00:54:44.193 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:44.193 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:54:44.193 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: abort-at-init-indext id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:54:44.193 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:44.195 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:44.195 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:44.198 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:44.198 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:44.242 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:44.242 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:44.267 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-12T00:54:44.267 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:44.269 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:44.269 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:44.284 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:44.284 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:44.332 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:44.332 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:44.351 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:44.351 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:44.370 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:44.370 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:44.390 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:44.390 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:44.411 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:44.411 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:44.431 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:44.432 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:44.450 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:44.450 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:44.470 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:44.470 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:44.490 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:44.490 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:44.509 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:44.509 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:44.528 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:44.528 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:44.548 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:44.549 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:44.567 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:44.567 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:44.586 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:44.586 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:44.606 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:44.606 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:44.624 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:44.624 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:44.642 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:44.642 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:44.660 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:44.661 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:44.679 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:44.679 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:44.699 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:44.700 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:44.716 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:54:44.749 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:44.749 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:44.793 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.799+0000 7fb534d319c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.795 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.799+0000 7fb534d319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.795 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.799+0000 7fb534d319c0 20 realm 2024-09-12T00:54:44.795 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.799+0000 7fb534d319c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.796 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.799+0000 7fb534d319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.796 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.799+0000 7fb534d319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:44.796 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.799+0000 7fb534d319c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.796 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.799+0000 7fb534d319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:44.796 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.799+0000 7fb534d319c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.797 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.803+0000 7fb534d319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:44.797 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.803+0000 7fb534d319c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:44.798 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.803+0000 7fb534d319c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:44.798 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.803+0000 7fb534d319c0 20 searching for the correct realm 2024-09-12T00:54:44.805 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:44.807+0000 7fb533038640 0 -- 172.21.15.70:0/2714664817 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fb51c0c1020 msgr2=0x7fb51c0b93d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:45.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.023+0000 7fb533038640 0 -- 172.21.15.70:0/2714664817 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fb51c0c1020 msgr2=0x7fb51c0b93d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:45.030 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.035+0000 7fb534d319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:45.031 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.035+0000 7fb534d319c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:45.031 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.035+0000 7fb534d319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:45.031 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.035+0000 7fb534d319c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:45.031 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.035+0000 7fb534d319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:45.031 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.035+0000 7fb534d319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:45.031 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.035+0000 7fb534d319c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.031 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.035+0000 7fb534d319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.031 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.035+0000 7fb534d319c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.032 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.035+0000 7fb534d319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:45.032 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.035+0000 7fb534d319c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.039+0000 7fb534d319c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:45.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.039+0000 7fb534d319c0 20 zone default found 2024-09-12T00:54:45.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.039+0000 7fb534d319c0 4 Realm: () 2024-09-12T00:54:45.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.039+0000 7fb534d319c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:45.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.039+0000 7fb534d319c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:45.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.039+0000 7fb534d319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:45.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.039+0000 7fb534d319c0 20 zonegroup default 2024-09-12T00:54:45.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.039+0000 7fb534d319c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.034 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.039+0000 7fb534d319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.034 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.039+0000 7fb534d319c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.034 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.039+0000 7fb534d319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.034 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.039+0000 7fb534d319c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.039+0000 7fb534d319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.039+0000 7fb534d319c0 20 started sync module instance, tier type = 2024-09-12T00:54:45.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.039+0000 7fb534d319c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:45.056 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.063+0000 7fb534d319c0 20 add_watcher() i=0 2024-09-12T00:54:45.056 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.063+0000 7fb534d319c0 20 add_watcher() i=1 2024-09-12T00:54:45.056 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.063+0000 7fb534d319c0 20 add_watcher() i=2 2024-09-12T00:54:45.057 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.063+0000 7fb534d319c0 20 add_watcher() i=3 2024-09-12T00:54:45.057 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.063+0000 7fb534d319c0 20 add_watcher() i=4 2024-09-12T00:54:45.057 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.063+0000 7fb534d319c0 20 add_watcher() i=5 2024-09-12T00:54:45.057 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.063+0000 7fb534d319c0 20 add_watcher() i=6 2024-09-12T00:54:45.058 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.063+0000 7fb534d319c0 20 add_watcher() i=7 2024-09-12T00:54:45.058 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.063+0000 7fb534d319c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:45.061 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.067+0000 7fb3e97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:45.062 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.067+0000 7fb534d319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:45.062 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.067+0000 7fb534d319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:45.062 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.067+0000 7fb534d319c0 5 note: GC not initialized 2024-09-12T00:54:45.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.067+0000 7fb363fff640 20 reqs_thread_entry: start 2024-09-12T00:54:45.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.067+0000 7fb534d319c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:45.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.067+0000 7fb534d319c0 20 Filter name: none 2024-09-12T00:54:45.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.067+0000 7fb361ffb640 20 reqs_thread_entry: start 2024-09-12T00:54:45.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.067+0000 7fb534d319c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.064 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.067+0000 7fb534d319c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:54:45.064 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.067+0000 7fb534d319c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.066 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.071+0000 7fb534d319c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:54:45.066 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.071+0000 7fb534d319c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:45.066 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.071+0000 7fb534d319c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.066 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.071+0000 7fb534d319c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:54:45.066 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.071+0000 7fb534d319c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.067 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.071+0000 7fb534d319c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:54:45.067 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.071+0000 7fb534d319c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:45.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.075+0000 7fb3e97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:45.073 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.079+0000 7fb534d319c0 20 remove_watcher() i=0 2024-09-12T00:54:45.073 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.079+0000 7fb534d319c0 2 removed watcher, disabling cache 2024-09-12T00:54:45.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.079+0000 7fb534d319c0 20 remove_watcher() i=1 2024-09-12T00:54:45.078 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.083+0000 7fb534d319c0 20 remove_watcher() i=2 2024-09-12T00:54:45.080 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.087+0000 7fb534d319c0 20 remove_watcher() i=3 2024-09-12T00:54:45.082 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.087+0000 7fb534d319c0 20 remove_watcher() i=4 2024-09-12T00:54:45.084 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.087+0000 7fb534d319c0 20 remove_watcher() i=5 2024-09-12T00:54:45.085 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.091+0000 7fb534d319c0 20 remove_watcher() i=6 2024-09-12T00:54:45.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.091+0000 7fb534d319c0 20 remove_watcher() i=7 2024-09-12T00:54:45.102 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:45.102 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:54:45.102 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-set-target-layout id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:54:45.102 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:45.103 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-12T00:54:45.136 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:45.136 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:45.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.183+0000 7f75dc81e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.180 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.187+0000 7f75dc81e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.180 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.187+0000 7f75dc81e9c0 20 realm 2024-09-12T00:54:45.181 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.187+0000 7f75dc81e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.181 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.187+0000 7f75dc81e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.181 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.187+0000 7f75dc81e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:45.181 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.187+0000 7f75dc81e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.181 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.187+0000 7f75dc81e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.182 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.187+0000 7f75dc81e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.182 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.187+0000 7f75dc81e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:45.183 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.187+0000 7f75dc81e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.183 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.187+0000 7f75dc81e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:45.183 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.187+0000 7f75dc81e9c0 20 searching for the correct realm 2024-09-12T00:54:45.189 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.195+0000 7f75dab25640 0 -- 172.21.15.70:0/1412720103 >> [v2:172.21.15.70:6808/276433067,v1:172.21.15.70:6809/276433067] conn(0x55e1ac7b8720 msgr2=0x55e1ac7babe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:45.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.203+0000 7f75da324640 0 -- 172.21.15.70:0/1412720103 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f75d40074b0 msgr2=0x7f75d4007930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:45.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.207+0000 7f75dc81e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:45.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.207+0000 7f75dc81e9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:45.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.207+0000 7f75dc81e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:45.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.207+0000 7f75dc81e9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:45.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.207+0000 7f75dc81e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:45.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.207+0000 7f75dc81e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:45.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.207+0000 7f75dc81e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.207+0000 7f75dc81e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.207+0000 7f75dc81e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.204 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.207+0000 7f75dc81e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:45.204 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.207+0000 7f75dc81e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.204 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.207+0000 7f75dc81e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:45.204 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.207+0000 7f75dc81e9c0 20 zone default found 2024-09-12T00:54:45.204 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.207+0000 7f75dc81e9c0 4 Realm: () 2024-09-12T00:54:45.205 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.207+0000 7f75dc81e9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:45.205 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.207+0000 7f75dc81e9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:45.205 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.207+0000 7f75dc81e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:45.205 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.207+0000 7f75dc81e9c0 20 zonegroup default 2024-09-12T00:54:45.205 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.207+0000 7f75dc81e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.205 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.211+0000 7f75dc81e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.205 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.211+0000 7f75dc81e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.206 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.211+0000 7f75dc81e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.206 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.211+0000 7f75dc81e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.206 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.211+0000 7f75dc81e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.206 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.211+0000 7f75dc81e9c0 20 started sync module instance, tier type = 2024-09-12T00:54:45.206 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.211+0000 7f75dc81e9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:45.220 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.223+0000 7f75dc81e9c0 20 add_watcher() i=0 2024-09-12T00:54:45.220 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.223+0000 7f75dc81e9c0 20 add_watcher() i=1 2024-09-12T00:54:45.220 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.223+0000 7f75dc81e9c0 20 add_watcher() i=2 2024-09-12T00:54:45.220 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.223+0000 7f75dc81e9c0 20 add_watcher() i=3 2024-09-12T00:54:45.220 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.223+0000 7f75dc81e9c0 20 add_watcher() i=4 2024-09-12T00:54:45.220 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.223+0000 7f75dc81e9c0 20 add_watcher() i=5 2024-09-12T00:54:45.220 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.223+0000 7f75dc81e9c0 20 add_watcher() i=6 2024-09-12T00:54:45.221 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.227+0000 7f75dc81e9c0 20 add_watcher() i=7 2024-09-12T00:54:45.221 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.227+0000 7f75dc81e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:45.225 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.227+0000 7f7490fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:45.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.227+0000 7f75dc81e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:45.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.227+0000 7f75dc81e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:45.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.227+0000 7f75dc81e9c0 5 note: GC not initialized 2024-09-12T00:54:45.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.231+0000 7f740b7fe640 20 reqs_thread_entry: start 2024-09-12T00:54:45.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.231+0000 7f75dc81e9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:45.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.231+0000 7f75dc81e9c0 20 Filter name: none 2024-09-12T00:54:45.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.231+0000 7f74097fa640 20 reqs_thread_entry: start 2024-09-12T00:54:45.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.231+0000 7f75dc81e9c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:54:45.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.231+0000 7f75dc81e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.231+0000 7f75dc81e9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:54:45.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.231+0000 7f75dc81e9c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:54:45.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.231+0000 7f75dc81e9c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:54:45.227 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.231+0000 7f75dc81e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23 : miss 2024-09-12T00:54:45.227 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.231+0000 7f75dc81e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.227 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.231+0000 7f75dc81e9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:54:45.227 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.231+0000 7f75dc81e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23 info.flags=0x17 2024-09-12T00:54:45.227 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.231+0000 7f75dc81e9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23 to cache LRU end 2024-09-12T00:54:45.227 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.231+0000 7f75dc81e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:45.228 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.231+0000 7f75dc81e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:45.228 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.231+0000 7f75dc81e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23 2024-09-12T00:54:45.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.235+0000 7f75dc81e9c0 -1 Injecting error=-5 at location=set_target_layout 2024-09-12T00:54:45.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.235+0000 7f75dc81e9c0 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-12T00:54:45.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.239+0000 7f7490fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:45.240 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.247+0000 7f75dc81e9c0 20 remove_watcher() i=0 2024-09-12T00:54:45.240 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.247+0000 7f75dc81e9c0 2 removed watcher, disabling cache 2024-09-12T00:54:45.242 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.247+0000 7f75dc81e9c0 20 remove_watcher() i=1 2024-09-12T00:54:45.244 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.251+0000 7f75dc81e9c0 20 remove_watcher() i=2 2024-09-12T00:54:45.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.251+0000 7f75dc81e9c0 20 remove_watcher() i=3 2024-09-12T00:54:45.248 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.251+0000 7f75dc81e9c0 20 remove_watcher() i=4 2024-09-12T00:54:45.249 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.255+0000 7f75dc81e9c0 20 remove_watcher() i=5 2024-09-12T00:54:45.250 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.255+0000 7f75dc81e9c0 20 remove_watcher() i=6 2024-09-12T00:54:45.251 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.255+0000 7f75dc81e9c0 20 remove_watcher() i=7 2024-09-12T00:54:45.265 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:54:45.291 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:45.292 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:45.334 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.339+0000 7fecf8ad29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.336 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.343+0000 7fecf8ad29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.336 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.343+0000 7fecf8ad29c0 20 realm 2024-09-12T00:54:45.336 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.343+0000 7fecf8ad29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.337 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.343+0000 7fecf8ad29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.337 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.343+0000 7fecf8ad29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:45.337 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.343+0000 7fecf8ad29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.337 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.343+0000 7fecf8ad29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.337 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.343+0000 7fecf8ad29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.338 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.343+0000 7fecf8ad29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:45.338 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.343+0000 7fecf8ad29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.339 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.343+0000 7fecf8ad29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:45.339 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.343+0000 7fecf8ad29c0 20 searching for the correct realm 2024-09-12T00:54:45.344 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.351+0000 7fecf65d8640 0 -- 172.21.15.70:0/168691083 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7fecf0087060 msgr2=0x7fecf007f6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:45.351 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.355+0000 7fecf65d8640 0 -- 172.21.15.70:0/168691083 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7fecf0015070 msgr2=0x7fecf0075a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:45.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.363+0000 7fecf8ad29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:45.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.363+0000 7fecf8ad29c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:45.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.363+0000 7fecf8ad29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:45.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.363+0000 7fecf8ad29c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:45.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.363+0000 7fecf8ad29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:45.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.363+0000 7fecf8ad29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:45.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.363+0000 7fecf8ad29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.363+0000 7fecf8ad29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.363+0000 7fecf8ad29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.359 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.363+0000 7fecf8ad29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:45.359 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.363+0000 7fecf8ad29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.359 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.363+0000 7fecf8ad29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:45.359 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.363+0000 7fecf8ad29c0 20 zone default found 2024-09-12T00:54:45.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.363+0000 7fecf8ad29c0 4 Realm: () 2024-09-12T00:54:45.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.363+0000 7fecf8ad29c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:45.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.363+0000 7fecf8ad29c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:45.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.363+0000 7fecf8ad29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:45.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.363+0000 7fecf8ad29c0 20 zonegroup default 2024-09-12T00:54:45.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.363+0000 7fecf8ad29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.363+0000 7fecf8ad29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.363+0000 7fecf8ad29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.363+0000 7fecf8ad29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.363+0000 7fecf8ad29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.367+0000 7fecf8ad29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.367+0000 7fecf8ad29c0 20 started sync module instance, tier type = 2024-09-12T00:54:45.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.367+0000 7fecf8ad29c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:45.375 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.379+0000 7fecf8ad29c0 20 add_watcher() i=0 2024-09-12T00:54:45.375 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.379+0000 7fecf8ad29c0 20 add_watcher() i=1 2024-09-12T00:54:45.375 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.379+0000 7fecf8ad29c0 20 add_watcher() i=2 2024-09-12T00:54:45.375 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.379+0000 7fecf8ad29c0 20 add_watcher() i=3 2024-09-12T00:54:45.375 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.379+0000 7fecf8ad29c0 20 add_watcher() i=4 2024-09-12T00:54:45.375 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.379+0000 7fecf8ad29c0 20 add_watcher() i=5 2024-09-12T00:54:45.375 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.379+0000 7fecf8ad29c0 20 add_watcher() i=6 2024-09-12T00:54:45.376 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.383+0000 7fecf8ad29c0 20 add_watcher() i=7 2024-09-12T00:54:45.376 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.383+0000 7fecf8ad29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:45.379 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.383+0000 7febacfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:45.379 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.383+0000 7fecf8ad29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:45.379 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.383+0000 7fecf8ad29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:45.379 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.383+0000 7fecf8ad29c0 5 note: GC not initialized 2024-09-12T00:54:45.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.383+0000 7feb277fe640 20 reqs_thread_entry: start 2024-09-12T00:54:45.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.383+0000 7fecf8ad29c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:45.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.383+0000 7fecf8ad29c0 20 Filter name: none 2024-09-12T00:54:45.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.383+0000 7feb257fa640 20 reqs_thread_entry: start 2024-09-12T00:54:45.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.383+0000 7fecf8ad29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.383+0000 7fecf8ad29c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:54:45.381 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.383+0000 7fecf8ad29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.381 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.387+0000 7fecf8ad29c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:54:45.381 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.387+0000 7fecf8ad29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:45.381 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.387+0000 7fecf8ad29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.382 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.387+0000 7fecf8ad29c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:54:45.382 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.387+0000 7fecf8ad29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.382 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.387+0000 7fecf8ad29c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:54:45.382 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.387+0000 7fecf8ad29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:45.383 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.387+0000 7febacfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:45.388 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.391+0000 7fecf8ad29c0 20 remove_watcher() i=0 2024-09-12T00:54:45.388 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.391+0000 7fecf8ad29c0 2 removed watcher, disabling cache 2024-09-12T00:54:45.390 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.395+0000 7fecf8ad29c0 20 remove_watcher() i=1 2024-09-12T00:54:45.392 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.395+0000 7fecf8ad29c0 20 remove_watcher() i=2 2024-09-12T00:54:45.394 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.399+0000 7fecf8ad29c0 20 remove_watcher() i=3 2024-09-12T00:54:45.395 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.399+0000 7fecf8ad29c0 20 remove_watcher() i=4 2024-09-12T00:54:45.397 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.403+0000 7fecf8ad29c0 20 remove_watcher() i=5 2024-09-12T00:54:45.398 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.403+0000 7fecf8ad29c0 20 remove_watcher() i=6 2024-09-12T00:54:45.399 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.403+0000 7fecf8ad29c0 20 remove_watcher() i=7 2024-09-12T00:54:45.412 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:45.412 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:54:45.412 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-set-target-layout id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:54:45.412 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:45.416 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:45.417 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:45.422 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:45.423 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:45.465 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:54:45.498 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:45.498 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:45.543 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.547+0000 7fa48c6349c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.551+0000 7fa48c6349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.551+0000 7fa48c6349c0 20 realm 2024-09-12T00:54:45.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.551+0000 7fa48c6349c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.551+0000 7fa48c6349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.551+0000 7fa48c6349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:45.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.551+0000 7fa48c6349c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.551+0000 7fa48c6349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.551+0000 7fa48c6349c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.551+0000 7fa48c6349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:45.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.551+0000 7fa48c6349c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.555+0000 7fa48c6349c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:45.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.555+0000 7fa48c6349c0 20 searching for the correct realm 2024-09-12T00:54:45.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.555+0000 7fa48a13a640 0 -- 172.21.15.70:0/2712625360 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7fa484028070 msgr2=0x7fa4840603a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:45.557 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.563+0000 7fa48a13a640 0 -- 172.21.15.70:0/2712625360 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7fa48401f040 msgr2=0x7fa484086130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:45.782 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.787+0000 7fa48c6349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:45.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.787+0000 7fa48c6349c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:45.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.787+0000 7fa48c6349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:45.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.787+0000 7fa48c6349c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:45.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.787+0000 7fa48c6349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:45.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.787+0000 7fa48c6349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:45.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.787+0000 7fa48c6349c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.787+0000 7fa48c6349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.784 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.787+0000 7fa48c6349c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.784 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.787+0000 7fa48c6349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:45.784 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.787+0000 7fa48c6349c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.791+0000 7fa48c6349c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:45.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.791+0000 7fa48c6349c0 20 zone default found 2024-09-12T00:54:45.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.791+0000 7fa48c6349c0 4 Realm: () 2024-09-12T00:54:45.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.791+0000 7fa48c6349c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:45.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.791+0000 7fa48c6349c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:45.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.791+0000 7fa48c6349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:45.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.791+0000 7fa48c6349c0 20 zonegroup default 2024-09-12T00:54:45.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.791+0000 7fa48c6349c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.791+0000 7fa48c6349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.786 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.791+0000 7fa48c6349c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.786 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.791+0000 7fa48c6349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.786 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.791+0000 7fa48c6349c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.787 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.791+0000 7fa48c6349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.787 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.791+0000 7fa48c6349c0 20 started sync module instance, tier type = 2024-09-12T00:54:45.787 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.791+0000 7fa48c6349c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:45.810 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.815+0000 7fa48c6349c0 20 add_watcher() i=0 2024-09-12T00:54:45.810 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.815+0000 7fa48c6349c0 20 add_watcher() i=1 2024-09-12T00:54:45.811 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.815+0000 7fa48c6349c0 20 add_watcher() i=2 2024-09-12T00:54:45.811 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.815+0000 7fa48c6349c0 20 add_watcher() i=3 2024-09-12T00:54:45.811 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.815+0000 7fa48c6349c0 20 add_watcher() i=4 2024-09-12T00:54:45.811 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.815+0000 7fa48c6349c0 20 add_watcher() i=5 2024-09-12T00:54:45.811 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.815+0000 7fa48c6349c0 20 add_watcher() i=6 2024-09-12T00:54:45.812 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.819+0000 7fa48c6349c0 20 add_watcher() i=7 2024-09-12T00:54:45.812 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.819+0000 7fa48c6349c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:45.816 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.823+0000 7fa340fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:45.817 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.823+0000 7fa48c6349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:45.817 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.823+0000 7fa48c6349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:45.817 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.823+0000 7fa48c6349c0 5 note: GC not initialized 2024-09-12T00:54:45.818 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.823+0000 7fa2bb7fe640 20 reqs_thread_entry: start 2024-09-12T00:54:45.818 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.823+0000 7fa48c6349c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:45.818 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.823+0000 7fa48c6349c0 20 Filter name: none 2024-09-12T00:54:45.819 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.823+0000 7fa2b97fa640 20 reqs_thread_entry: start 2024-09-12T00:54:45.819 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.823+0000 7fa48c6349c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:54:45.819 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.823+0000 7fa48c6349c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.820 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.823+0000 7fa48c6349c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:54:45.820 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.823+0000 7fa48c6349c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:54:45.820 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.823+0000 7fa48c6349c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:54:45.820 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.823+0000 7fa48c6349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23 : miss 2024-09-12T00:54:45.820 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.823+0000 7fa48c6349c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.821 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.827+0000 7fa48c6349c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:54:45.824 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.827+0000 7fa48c6349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23 info.flags=0x17 2024-09-12T00:54:45.824 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.827+0000 7fa48c6349c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23 to cache LRU end 2024-09-12T00:54:45.824 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.827+0000 7fa48c6349c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:45.824 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.827+0000 7fa48c6349c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:45.825 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.827+0000 7fa48c6349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23 2024-09-12T00:54:45.829 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.835+0000 7fa48c6349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23 info.flags=0x17 2024-09-12T00:54:45.829 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.835+0000 7fa48c6349c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23 to cache LRU end 2024-09-12T00:54:45.830 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.835+0000 7fa48c6349c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:45.830 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.835+0000 7fa48c6349c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23, ofs0, ns] 2024-09-12T00:54:45.830 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.835+0000 7fa36dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431593 cookie 94861003299536 notifier 6534 bl.length()=1009 2024-09-12T00:54:45.830 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.835+0000 7fa36dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23 info.flags=0x17 2024-09-12T00:54:45.830 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.835+0000 7fa36dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23 to cache LRU end 2024-09-12T00:54:45.830 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.835+0000 7fa36dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:45.831 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.835+0000 7fa48c6349c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23]): orig_sources= new_sources= 2024-09-12T00:54:45.831 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.835+0000 7fa48c6349c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23]): potential sources added=[] removed=[] 2024-09-12T00:54:45.832 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.835+0000 7fa48c6349c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23]): orig_dests= new_dests= 2024-09-12T00:54:45.832 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.835+0000 7fa48c6349c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23]): potential dests added=[] removed=[] 2024-09-12T00:54:45.835 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.839+0000 7fa48c6349c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23.1.0 2024-09-12T00:54:45.835 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.839+0000 7fa48c6349c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23.1.0 2024-09-12T00:54:45.835 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.839+0000 7fa48c6349c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23.1.1 2024-09-12T00:54:45.835 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.839+0000 7fa48c6349c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23.1.1 2024-09-12T00:54:45.835 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.839+0000 7fa48c6349c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23.0 2024-09-12T00:54:45.838 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.843+0000 7fa48c6349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:45.839 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.843+0000 7fa48c6349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23 2024-09-12T00:54:45.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.847+0000 7fa48c6349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23 info.flags=0x17 2024-09-12T00:54:45.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.847+0000 7fa48c6349c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23 to cache LRU end 2024-09-12T00:54:45.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.847+0000 7fa48c6349c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:45.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.847+0000 7fa48c6349c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23, ofs0, ns] 2024-09-12T00:54:45.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.847+0000 7fa36dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431594 cookie 94861003299536 notifier 6534 bl.length()=1009 2024-09-12T00:54:45.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.847+0000 7fa36dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23 info.flags=0x17 2024-09-12T00:54:45.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.847+0000 7fa36dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23 to cache LRU end 2024-09-12T00:54:45.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.847+0000 7fa36dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:45.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.847+0000 7fa48c6349c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23]): orig_sources= new_sources= 2024-09-12T00:54:45.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.847+0000 7fa48c6349c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23]): potential sources added=[] removed=[] 2024-09-12T00:54:45.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.847+0000 7fa48c6349c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23]): orig_dests= new_dests= 2024-09-12T00:54:45.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.847+0000 7fa48c6349c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23]): potential dests added=[] removed=[] 2024-09-12T00:54:45.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.851+0000 7fa48c6349c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23.0 2024-09-12T00:54:45.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.851+0000 7fa48c6349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:45.846 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.851+0000 7fa48c6349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23 2024-09-12T00:54:45.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.855+0000 7fa48c6349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23 info.flags=0x17 2024-09-12T00:54:45.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.855+0000 7fa48c6349c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23 to cache LRU end 2024-09-12T00:54:45.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.855+0000 7fa48c6349c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:45.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.855+0000 7fa48c6349c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23, ofs0, ns] 2024-09-12T00:54:45.850 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.855+0000 7fa36dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431595 cookie 94861003299536 notifier 6534 bl.length()=977 2024-09-12T00:54:45.850 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.855+0000 7fa36dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23 info.flags=0x17 2024-09-12T00:54:45.851 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.855+0000 7fa36dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23 to cache LRU end 2024-09-12T00:54:45.851 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.855+0000 7fa36dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:45.851 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.855+0000 7fa48c6349c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23]): orig_sources= new_sources= 2024-09-12T00:54:45.851 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.855+0000 7fa48c6349c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23]): potential sources added=[] removed=[] 2024-09-12T00:54:45.851 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.855+0000 7fa48c6349c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23]): orig_dests= new_dests= 2024-09-12T00:54:45.851 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.855+0000 7fa48c6349c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23]): potential dests added=[] removed=[] 2024-09-12T00:54:45.852 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.859+0000 7fa48c6349c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:54:45.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.859+0000 7fa340fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:45.860 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.867+0000 7fa48c6349c0 20 remove_watcher() i=0 2024-09-12T00:54:45.861 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.867+0000 7fa48c6349c0 2 removed watcher, disabling cache 2024-09-12T00:54:45.863 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.867+0000 7fa48c6349c0 20 remove_watcher() i=1 2024-09-12T00:54:45.865 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.871+0000 7fa48c6349c0 20 remove_watcher() i=2 2024-09-12T00:54:45.867 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.871+0000 7fa48c6349c0 20 remove_watcher() i=3 2024-09-12T00:54:45.870 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.875+0000 7fa48c6349c0 20 remove_watcher() i=4 2024-09-12T00:54:45.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.875+0000 7fa48c6349c0 20 remove_watcher() i=5 2024-09-12T00:54:45.872 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.879+0000 7fa48c6349c0 20 remove_watcher() i=6 2024-09-12T00:54:45.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.879+0000 7fa48c6349c0 20 remove_watcher() i=7 2024-09-12T00:54:45.889 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:54:45.921 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:45.921 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:45.963 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.967+0000 7f7b917609c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.971+0000 7f7b917609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.971+0000 7f7b917609c0 20 realm 2024-09-12T00:54:45.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.971+0000 7f7b917609c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.971+0000 7f7b917609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.971+0000 7f7b917609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:45.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.971+0000 7f7b917609c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.971+0000 7f7b917609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.971+0000 7f7b917609c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.971+0000 7f7b917609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:45.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.971+0000 7f7b917609c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.971+0000 7f7b917609c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:45.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.971+0000 7f7b917609c0 20 searching for the correct realm 2024-09-12T00:54:45.971 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:45.975+0000 7f7b8fa67640 0 -- 172.21.15.70:0/2624665471 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f7b780d5040 msgr2=0x7f7b780d6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:46.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.191+0000 7f7b8fa67640 0 -- 172.21.15.70:0/2624665471 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f7b780d5040 msgr2=0x7f7b780d6940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:46.197 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.203+0000 7f7b917609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:46.198 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.203+0000 7f7b917609c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:46.198 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.203+0000 7f7b917609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:46.198 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.203+0000 7f7b917609c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:46.198 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.203+0000 7f7b917609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:46.198 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.203+0000 7f7b917609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:46.198 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.203+0000 7f7b917609c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.198 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.203+0000 7f7b917609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:46.198 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.203+0000 7f7b917609c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.199 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.203+0000 7f7b917609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:46.199 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.203+0000 7f7b917609c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.203+0000 7f7b917609c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:46.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.203+0000 7f7b917609c0 20 zone default found 2024-09-12T00:54:46.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.203+0000 7f7b917609c0 4 Realm: () 2024-09-12T00:54:46.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.203+0000 7f7b917609c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:46.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.203+0000 7f7b917609c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:46.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.203+0000 7f7b917609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:46.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.203+0000 7f7b917609c0 20 zonegroup default 2024-09-12T00:54:46.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.203+0000 7f7b917609c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.203+0000 7f7b917609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:46.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.207+0000 7f7b917609c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.207+0000 7f7b917609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:46.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.207+0000 7f7b917609c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.207+0000 7f7b917609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:46.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.207+0000 7f7b917609c0 20 started sync module instance, tier type = 2024-09-12T00:54:46.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.207+0000 7f7b917609c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:46.225 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.231+0000 7f7b917609c0 20 add_watcher() i=0 2024-09-12T00:54:46.225 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.231+0000 7f7b917609c0 20 add_watcher() i=1 2024-09-12T00:54:46.225 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.231+0000 7f7b917609c0 20 add_watcher() i=2 2024-09-12T00:54:46.225 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.231+0000 7f7b917609c0 20 add_watcher() i=3 2024-09-12T00:54:46.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.231+0000 7f7b917609c0 20 add_watcher() i=4 2024-09-12T00:54:46.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.231+0000 7f7b917609c0 20 add_watcher() i=5 2024-09-12T00:54:46.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.231+0000 7f7b917609c0 20 add_watcher() i=6 2024-09-12T00:54:46.227 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.231+0000 7f7b917609c0 20 add_watcher() i=7 2024-09-12T00:54:46.227 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.231+0000 7f7b917609c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:46.232 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.235+0000 7f7a45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:46.233 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.239+0000 7f7b917609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:46.233 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.239+0000 7f7b917609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:46.233 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.239+0000 7f7b917609c0 5 note: GC not initialized 2024-09-12T00:54:46.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.239+0000 7f7a44fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:46.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.239+0000 7f7b917609c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:46.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.239+0000 7f7b917609c0 20 Filter name: none 2024-09-12T00:54:46.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.239+0000 7f79be7fc640 20 reqs_thread_entry: start 2024-09-12T00:54:46.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.239+0000 7f7b917609c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.239+0000 7f7b917609c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:54:46.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.239+0000 7f7b917609c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.243+0000 7f7b917609c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:54:46.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.243+0000 7f7b917609c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:46.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.243+0000 7f7b917609c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.243+0000 7f7b917609c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:54:46.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.243+0000 7f7b917609c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.243+0000 7f7b917609c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:54:46.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.243+0000 7f7b917609c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:46.241 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.247+0000 7f7a45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:46.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.251+0000 7f7b917609c0 20 remove_watcher() i=0 2024-09-12T00:54:46.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.251+0000 7f7b917609c0 2 removed watcher, disabling cache 2024-09-12T00:54:46.248 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.255+0000 7f7b917609c0 20 remove_watcher() i=1 2024-09-12T00:54:46.250 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.255+0000 7f7b917609c0 20 remove_watcher() i=2 2024-09-12T00:54:46.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.259+0000 7f7b917609c0 20 remove_watcher() i=3 2024-09-12T00:54:46.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.259+0000 7f7b917609c0 20 remove_watcher() i=4 2024-09-12T00:54:46.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.263+0000 7f7b917609c0 20 remove_watcher() i=5 2024-09-12T00:54:46.258 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.263+0000 7f7b917609c0 20 remove_watcher() i=6 2024-09-12T00:54:46.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.263+0000 7f7b917609c0 20 remove_watcher() i=7 2024-09-12T00:54:46.275 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:46.275 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:54:46.275 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-set-target-layout id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:54:46.276 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:46.277 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:46.277 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:46.280 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:46.280 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:46.330 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:46.330 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:46.355 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-12T00:54:46.355 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:46.356 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:46.356 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:46.373 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:46.374 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:46.419 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:46.419 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:46.437 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:46.438 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:46.454 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:46.455 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:46.472 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:46.472 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:46.491 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:46.491 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:46.509 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:46.509 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:46.527 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:46.527 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:46.544 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:46.544 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:46.562 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:46.562 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:46.579 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:46.579 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:46.597 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:46.598 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:46.615 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:46.615 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:46.634 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:46.634 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:46.652 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:46.652 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:46.670 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:46.670 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:46.688 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:46.688 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:46.705 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:46.705 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:46.722 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:46.722 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:46.740 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:46.740 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:46.757 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:46.757 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:46.773 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:54:46.807 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:46.808 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:46.852 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.855+0000 7f690d4b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.859+0000 7f690d4b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:46.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.859+0000 7f690d4b19c0 20 realm 2024-09-12T00:54:46.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.859+0000 7f690d4b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.859+0000 7f690d4b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:46.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.859+0000 7f690d4b19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:46.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.859+0000 7f690d4b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.859+0000 7f690d4b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:46.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.859+0000 7f690d4b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.859+0000 7f690d4b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:46.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.859+0000 7f690d4b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.856 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.863+0000 7f690d4b19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:46.856 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.863+0000 7f690d4b19c0 20 searching for the correct realm 2024-09-12T00:54:46.860 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:46.867+0000 7f690b7b8640 0 -- 172.21.15.70:0/2056419039 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f69000a1040 msgr2=0x7f6900009b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:47.079 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.083+0000 7f690b7b8640 0 -- 172.21.15.70:0/2056419039 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f69000a1040 msgr2=0x7f6900009b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:47.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.095+0000 7f690d4b19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:47.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.095+0000 7f690d4b19c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:47.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.095+0000 7f690d4b19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:47.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.095+0000 7f690d4b19c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:47.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.095+0000 7f690d4b19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:47.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.095+0000 7f690d4b19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:47.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.095+0000 7f690d4b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.095+0000 7f690d4b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.092 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.095+0000 7f690d4b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.092 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.099+0000 7f690d4b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:47.092 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.099+0000 7f690d4b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.093 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.099+0000 7f690d4b19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:47.093 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.099+0000 7f690d4b19c0 20 zone default found 2024-09-12T00:54:47.094 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.099+0000 7f690d4b19c0 4 Realm: () 2024-09-12T00:54:47.094 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.099+0000 7f690d4b19c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:47.094 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.099+0000 7f690d4b19c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:47.094 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.099+0000 7f690d4b19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:47.094 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.099+0000 7f690d4b19c0 20 zonegroup default 2024-09-12T00:54:47.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.099+0000 7f690d4b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.099+0000 7f690d4b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.099+0000 7f690d4b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.096 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.099+0000 7f690d4b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.096 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.099+0000 7f690d4b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.096 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.099+0000 7f690d4b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.096 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.099+0000 7f690d4b19c0 20 started sync module instance, tier type = 2024-09-12T00:54:47.096 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.099+0000 7f690d4b19c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:47.117 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.123+0000 7f690d4b19c0 20 add_watcher() i=0 2024-09-12T00:54:47.117 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.123+0000 7f690d4b19c0 20 add_watcher() i=1 2024-09-12T00:54:47.117 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.123+0000 7f690d4b19c0 20 add_watcher() i=2 2024-09-12T00:54:47.118 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.123+0000 7f690d4b19c0 20 add_watcher() i=3 2024-09-12T00:54:47.118 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.123+0000 7f690d4b19c0 20 add_watcher() i=4 2024-09-12T00:54:47.118 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.123+0000 7f690d4b19c0 20 add_watcher() i=5 2024-09-12T00:54:47.118 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.123+0000 7f690d4b19c0 20 add_watcher() i=6 2024-09-12T00:54:47.119 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.123+0000 7f690d4b19c0 20 add_watcher() i=7 2024-09-12T00:54:47.119 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.123+0000 7f690d4b19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:47.123 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.127+0000 7f67c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:47.125 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.131+0000 7f690d4b19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:47.125 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.131+0000 7f690d4b19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:47.125 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.131+0000 7f690d4b19c0 5 note: GC not initialized 2024-09-12T00:54:47.126 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.131+0000 7f673bfff640 20 reqs_thread_entry: start 2024-09-12T00:54:47.126 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.131+0000 7f690d4b19c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:47.126 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.131+0000 7f690d4b19c0 20 Filter name: none 2024-09-12T00:54:47.126 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.131+0000 7f6739ffb640 20 reqs_thread_entry: start 2024-09-12T00:54:47.126 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.131+0000 7f690d4b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.127 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.131+0000 7f690d4b19c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:54:47.127 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.131+0000 7f690d4b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.128 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.131+0000 7f690d4b19c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:54:47.128 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.131+0000 7f690d4b19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:47.128 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.131+0000 7f690d4b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.129 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.135+0000 7f690d4b19c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:54:47.129 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.135+0000 7f690d4b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.135+0000 7f690d4b19c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:54:47.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.135+0000 7f690d4b19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:47.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.139+0000 7f67c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:47.137 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.143+0000 7f690d4b19c0 20 remove_watcher() i=0 2024-09-12T00:54:47.137 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.143+0000 7f690d4b19c0 2 removed watcher, disabling cache 2024-09-12T00:54:47.139 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.143+0000 7f690d4b19c0 20 remove_watcher() i=1 2024-09-12T00:54:47.141 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.147+0000 7f690d4b19c0 20 remove_watcher() i=2 2024-09-12T00:54:47.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.147+0000 7f690d4b19c0 20 remove_watcher() i=3 2024-09-12T00:54:47.146 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.151+0000 7f690d4b19c0 20 remove_watcher() i=4 2024-09-12T00:54:47.148 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.151+0000 7f690d4b19c0 20 remove_watcher() i=5 2024-09-12T00:54:47.149 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.155+0000 7f690d4b19c0 20 remove_watcher() i=6 2024-09-12T00:54:47.151 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.155+0000 7f690d4b19c0 20 remove_watcher() i=7 2024-09-12T00:54:47.167 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:47.167 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:54:47.167 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-set-target-layout id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:54:47.167 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:47.167 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-12T00:54:47.202 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:47.202 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:47.245 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.251+0000 7f3ec155c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.251+0000 7f3ec155c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.251+0000 7f3ec155c9c0 20 realm 2024-09-12T00:54:47.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.251+0000 7f3ec155c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.251+0000 7f3ec155c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.251+0000 7f3ec155c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:47.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.251+0000 7f3ec155c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.251+0000 7f3ec155c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.248 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.251+0000 7f3ec155c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.248 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.255+0000 7f3ec155c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:47.249 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.255+0000 7f3ec155c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.249 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.255+0000 7f3ec155c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:47.250 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.255+0000 7f3ec155c9c0 20 searching for the correct realm 2024-09-12T00:54:47.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.259+0000 7f3ebf863640 0 -- 172.21.15.70:0/1538857845 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f3eb40d2070 msgr2=0x7f3eb40b9960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:47.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.267+0000 7f3ebe861640 0 -- 172.21.15.70:0/1538857845 >> [v2:172.21.15.70:6824/2477739226,v1:172.21.15.70:6825/2477739226] conn(0x56541d7d6040 msgr2=0x56541d7d8430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:47.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.275+0000 7f3ec155c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:47.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.275+0000 7f3ec155c9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:47.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.275+0000 7f3ec155c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:47.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.275+0000 7f3ec155c9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:47.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.275+0000 7f3ec155c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:47.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.275+0000 7f3ec155c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:47.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.275+0000 7f3ec155c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.275+0000 7f3ec155c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.275+0000 7f3ec155c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.275+0000 7f3ec155c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:47.271 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.275+0000 7f3ec155c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.272 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.275+0000 7f3ec155c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:47.272 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.275+0000 7f3ec155c9c0 20 zone default found 2024-09-12T00:54:47.272 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.275+0000 7f3ec155c9c0 4 Realm: () 2024-09-12T00:54:47.272 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.275+0000 7f3ec155c9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:47.272 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.275+0000 7f3ec155c9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:47.272 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.275+0000 7f3ec155c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:47.272 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.275+0000 7f3ec155c9c0 20 zonegroup default 2024-09-12T00:54:47.272 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.275+0000 7f3ec155c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.272 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.275+0000 7f3ec155c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.272 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.275+0000 7f3ec155c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.273 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.275+0000 7f3ec155c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.273 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.275+0000 7f3ec155c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.273 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.275+0000 7f3ec155c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.273 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.275+0000 7f3ec155c9c0 20 started sync module instance, tier type = 2024-09-12T00:54:47.273 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.275+0000 7f3ec155c9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:47.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.291+0000 7f3ec155c9c0 20 add_watcher() i=0 2024-09-12T00:54:47.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.291+0000 7f3ec155c9c0 20 add_watcher() i=1 2024-09-12T00:54:47.288 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.291+0000 7f3ec155c9c0 20 add_watcher() i=2 2024-09-12T00:54:47.288 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.291+0000 7f3ec155c9c0 20 add_watcher() i=3 2024-09-12T00:54:47.288 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.291+0000 7f3ec155c9c0 20 add_watcher() i=4 2024-09-12T00:54:47.288 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.291+0000 7f3ec155c9c0 20 add_watcher() i=5 2024-09-12T00:54:47.288 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.291+0000 7f3ec155c9c0 20 add_watcher() i=6 2024-09-12T00:54:47.288 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.295+0000 7f3ec155c9c0 20 add_watcher() i=7 2024-09-12T00:54:47.288 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.295+0000 7f3ec155c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:47.291 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.295+0000 7f3d75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:47.292 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.295+0000 7f3ec155c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:47.292 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.295+0000 7f3ec155c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:47.292 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.295+0000 7f3ec155c9c0 5 note: GC not initialized 2024-09-12T00:54:47.292 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.295+0000 7f3d74fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:47.292 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.295+0000 7f3ec155c9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:47.292 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.295+0000 7f3ec155c9c0 20 Filter name: none 2024-09-12T00:54:47.292 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.299+0000 7f3cee7fc640 20 reqs_thread_entry: start 2024-09-12T00:54:47.293 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.299+0000 7f3ec155c9c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:54:47.293 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.299+0000 7f3ec155c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.299+0000 7f3ec155c9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:54:47.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.299+0000 7f3ec155c9c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:54:47.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.299+0000 7f3ec155c9c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:54:47.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.299+0000 7f3ec155c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24 : miss 2024-09-12T00:54:47.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.299+0000 7f3ec155c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.299+0000 7f3ec155c9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:54:47.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.299+0000 7f3ec155c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24 info.flags=0x17 2024-09-12T00:54:47.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.299+0000 7f3ec155c9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24 to cache LRU end 2024-09-12T00:54:47.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.299+0000 7f3ec155c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:47.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.299+0000 7f3ec155c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:47.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.299+0000 7f3ec155c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24 2024-09-12T00:54:47.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.303+0000 7f3ec155c9c0 -1 Injecting error=-125 at location=set_target_layout 2024-09-12T00:54:47.301 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.307+0000 7f3ec155c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24 info.flags=0x17 2024-09-12T00:54:47.301 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.307+0000 7f3ec155c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24 to cache LRU end 2024-09-12T00:54:47.301 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.307+0000 7f3ec155c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:47.301 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.307+0000 7f3ec155c9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24, ofs0, ns] 2024-09-12T00:54:47.302 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.307+0000 7f3da2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431598 cookie 94919272001024 notifier 6260 bl.length()=1009 2024-09-12T00:54:47.302 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.307+0000 7f3da2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24 info.flags=0x17 2024-09-12T00:54:47.302 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.307+0000 7f3da2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24 to cache LRU end 2024-09-12T00:54:47.302 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.307+0000 7f3da2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:47.303 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.307+0000 7f3ec155c9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24]): orig_sources= new_sources= 2024-09-12T00:54:47.303 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.307+0000 7f3ec155c9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24]): potential sources added=[] removed=[] 2024-09-12T00:54:47.303 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.307+0000 7f3ec155c9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24]): orig_dests= new_dests= 2024-09-12T00:54:47.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.307+0000 7f3ec155c9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24]): potential dests added=[] removed=[] 2024-09-12T00:54:47.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.315+0000 7f3ec155c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24.1.0 2024-09-12T00:54:47.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.315+0000 7f3ec155c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24.1.0 2024-09-12T00:54:47.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.315+0000 7f3ec155c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24.1.1 2024-09-12T00:54:47.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.315+0000 7f3ec155c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24.1.1 2024-09-12T00:54:47.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.315+0000 7f3ec155c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24.0 2024-09-12T00:54:47.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.319+0000 7f3ec155c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:47.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.319+0000 7f3ec155c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24 2024-09-12T00:54:47.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.323+0000 7f3ec155c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24 info.flags=0x17 2024-09-12T00:54:47.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.323+0000 7f3ec155c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24 to cache LRU end 2024-09-12T00:54:47.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.323+0000 7f3ec155c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:47.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.323+0000 7f3ec155c9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24, ofs0, ns] 2024-09-12T00:54:47.319 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.323+0000 7f3da2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431599 cookie 94919272001024 notifier 6260 bl.length()=1009 2024-09-12T00:54:47.319 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.323+0000 7f3da2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24 info.flags=0x17 2024-09-12T00:54:47.319 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.323+0000 7f3da2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24 to cache LRU end 2024-09-12T00:54:47.319 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.323+0000 7f3da2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:47.320 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.323+0000 7f3ec155c9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24]): orig_sources= new_sources= 2024-09-12T00:54:47.320 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.323+0000 7f3ec155c9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24]): potential sources added=[] removed=[] 2024-09-12T00:54:47.320 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.323+0000 7f3ec155c9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24]): orig_dests= new_dests= 2024-09-12T00:54:47.320 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.323+0000 7f3ec155c9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24]): potential dests added=[] removed=[] 2024-09-12T00:54:47.322 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.327+0000 7f3ec155c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24.0 2024-09-12T00:54:47.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.327+0000 7f3ec155c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:47.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.327+0000 7f3ec155c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24 2024-09-12T00:54:47.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.331+0000 7f3ec155c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24 info.flags=0x17 2024-09-12T00:54:47.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.331+0000 7f3ec155c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24 to cache LRU end 2024-09-12T00:54:47.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.331+0000 7f3ec155c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:47.327 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.331+0000 7f3ec155c9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24, ofs0, ns] 2024-09-12T00:54:47.327 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.331+0000 7f3da27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431600 cookie 94919272001024 notifier 6260 bl.length()=977 2024-09-12T00:54:47.327 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.331+0000 7f3da27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24 info.flags=0x17 2024-09-12T00:54:47.327 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.331+0000 7f3da27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24 to cache LRU end 2024-09-12T00:54:47.327 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.331+0000 7f3da27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:47.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.335+0000 7f3ec155c9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24]): orig_sources= new_sources= 2024-09-12T00:54:47.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.335+0000 7f3ec155c9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24]): potential sources added=[] removed=[] 2024-09-12T00:54:47.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.335+0000 7f3ec155c9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24]): orig_dests= new_dests= 2024-09-12T00:54:47.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.335+0000 7f3ec155c9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24]): potential dests added=[] removed=[] 2024-09-12T00:54:47.330 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.335+0000 7f3ec155c9c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:54:47.333 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.339+0000 7f3d75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:47.338 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.343+0000 7f3ec155c9c0 20 remove_watcher() i=0 2024-09-12T00:54:47.338 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.343+0000 7f3ec155c9c0 2 removed watcher, disabling cache 2024-09-12T00:54:47.339 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.343+0000 7f3ec155c9c0 20 remove_watcher() i=1 2024-09-12T00:54:47.341 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.347+0000 7f3ec155c9c0 20 remove_watcher() i=2 2024-09-12T00:54:47.343 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.347+0000 7f3ec155c9c0 20 remove_watcher() i=3 2024-09-12T00:54:47.345 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.351+0000 7f3ec155c9c0 20 remove_watcher() i=4 2024-09-12T00:54:47.346 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.351+0000 7f3ec155c9c0 20 remove_watcher() i=5 2024-09-12T00:54:47.347 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.351+0000 7f3ec155c9c0 20 remove_watcher() i=6 2024-09-12T00:54:47.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.355+0000 7f3ec155c9c0 20 remove_watcher() i=7 2024-09-12T00:54:47.363 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:54:47.390 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:47.390 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:47.431 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.435+0000 7f0f799a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.433 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.439+0000 7f0f799a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.433 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.439+0000 7f0f799a39c0 20 realm 2024-09-12T00:54:47.433 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.439+0000 7f0f799a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.433 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.439+0000 7f0f799a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.439+0000 7f0f799a39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:47.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.439+0000 7f0f799a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.439+0000 7f0f799a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.439+0000 7f0f799a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.439+0000 7f0f799a39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:47.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.439+0000 7f0f799a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.439+0000 7f0f799a39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:47.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.439+0000 7f0f799a39c0 20 searching for the correct realm 2024-09-12T00:54:47.440 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.443+0000 7f0f77caa640 0 -- 172.21.15.70:0/2242384328 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f0f6c0b9ba0 msgr2=0x7f0f6c0e1910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:47.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.659+0000 7f0f77caa640 0 -- 172.21.15.70:0/2242384328 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f0f6c0b9ba0 msgr2=0x7f0f6c0e1910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:47.666 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.671+0000 7f0f799a39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:47.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.671+0000 7f0f799a39c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:47.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.671+0000 7f0f799a39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:47.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.671+0000 7f0f799a39c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:47.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.671+0000 7f0f799a39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:47.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.671+0000 7f0f799a39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:47.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.671+0000 7f0f799a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.671+0000 7f0f799a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.671+0000 7f0f799a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.668 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.675+0000 7f0f799a39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:47.668 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.675+0000 7f0f799a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.675+0000 7f0f799a39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:47.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.675+0000 7f0f799a39c0 20 zone default found 2024-09-12T00:54:47.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.675+0000 7f0f799a39c0 4 Realm: () 2024-09-12T00:54:47.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.675+0000 7f0f799a39c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:47.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.675+0000 7f0f799a39c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:47.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.675+0000 7f0f799a39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:47.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.675+0000 7f0f799a39c0 20 zonegroup default 2024-09-12T00:54:47.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.675+0000 7f0f799a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.670 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.675+0000 7f0f799a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.670 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.675+0000 7f0f799a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.671 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.675+0000 7f0f799a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.671 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.675+0000 7f0f799a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.671 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.675+0000 7f0f799a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.671 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.675+0000 7f0f799a39c0 20 started sync module instance, tier type = 2024-09-12T00:54:47.671 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.675+0000 7f0f799a39c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:47.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.699+0000 7f0f799a39c0 20 add_watcher() i=0 2024-09-12T00:54:47.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.699+0000 7f0f799a39c0 20 add_watcher() i=1 2024-09-12T00:54:47.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.699+0000 7f0f799a39c0 20 add_watcher() i=2 2024-09-12T00:54:47.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.699+0000 7f0f799a39c0 20 add_watcher() i=3 2024-09-12T00:54:47.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.699+0000 7f0f799a39c0 20 add_watcher() i=4 2024-09-12T00:54:47.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.699+0000 7f0f799a39c0 20 add_watcher() i=5 2024-09-12T00:54:47.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.699+0000 7f0f799a39c0 20 add_watcher() i=6 2024-09-12T00:54:47.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.703+0000 7f0f799a39c0 20 add_watcher() i=7 2024-09-12T00:54:47.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.703+0000 7f0f799a39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:47.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.707+0000 7f0e2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:47.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.707+0000 7f0f799a39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:47.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.707+0000 7f0f799a39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:47.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.707+0000 7f0f799a39c0 5 note: GC not initialized 2024-09-12T00:54:47.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.707+0000 7f0e2cfe1640 20 reqs_thread_entry: start 2024-09-12T00:54:47.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.707+0000 7f0f799a39c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:47.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.707+0000 7f0f799a39c0 20 Filter name: none 2024-09-12T00:54:47.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.707+0000 7f0da67fc640 20 reqs_thread_entry: start 2024-09-12T00:54:47.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.707+0000 7f0f799a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.711+0000 7f0f799a39c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:54:47.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.711+0000 7f0f799a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.711+0000 7f0f799a39c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:54:47.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.711+0000 7f0f799a39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:47.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.711+0000 7f0f799a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.711+0000 7f0f799a39c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:54:47.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.711+0000 7f0f799a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.711+0000 7f0f799a39c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:54:47.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.711+0000 7f0f799a39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:47.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.715+0000 7f0e2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:47.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.719+0000 7f0f799a39c0 20 remove_watcher() i=0 2024-09-12T00:54:47.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.719+0000 7f0f799a39c0 2 removed watcher, disabling cache 2024-09-12T00:54:47.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.723+0000 7f0f799a39c0 20 remove_watcher() i=1 2024-09-12T00:54:47.719 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.723+0000 7f0f799a39c0 20 remove_watcher() i=2 2024-09-12T00:54:47.721 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.727+0000 7f0f799a39c0 20 remove_watcher() i=3 2024-09-12T00:54:47.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.727+0000 7f0f799a39c0 20 remove_watcher() i=4 2024-09-12T00:54:47.725 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.731+0000 7f0f799a39c0 20 remove_watcher() i=5 2024-09-12T00:54:47.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.731+0000 7f0f799a39c0 20 remove_watcher() i=6 2024-09-12T00:54:47.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:47.731+0000 7f0f799a39c0 20 remove_watcher() i=7 2024-09-12T00:54:47.744 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:47.744 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:54:47.745 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-set-target-layout id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:54:47.745 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:47.746 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:47.746 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:47.749 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:47.749 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:47.797 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:47.797 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:47.830 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-12T00:54:47.830 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:47.833 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:47.834 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:47.855 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:47.855 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:47.904 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:47.904 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:47.923 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:47.923 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:47.942 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:47.942 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:47.961 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:47.962 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:47.981 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:47.981 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:48.001 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:48.001 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:48.022 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:48.022 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:48.041 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:48.041 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:48.059 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:48.060 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:48.078 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:48.078 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:48.097 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:48.097 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:48.115 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:48.116 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:48.133 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:48.134 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:48.152 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:48.152 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:48.171 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:48.171 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:48.190 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:48.190 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:48.209 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:48.209 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:48.226 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:48.227 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:48.245 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:48.245 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:48.264 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:48.264 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:48.281 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:54:48.315 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:48.315 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:48.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.367+0000 7f1e26a229c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.362 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.367+0000 7f1e26a229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.362 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.367+0000 7f1e26a229c0 20 realm 2024-09-12T00:54:48.362 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.367+0000 7f1e26a229c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.362 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.367+0000 7f1e26a229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.362 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.367+0000 7f1e26a229c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:48.363 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.367+0000 7f1e26a229c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.363 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.367+0000 7f1e26a229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.363 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.367+0000 7f1e26a229c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.364 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.371+0000 7f1e26a229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:48.364 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.371+0000 7f1e26a229c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.365 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.371+0000 7f1e26a229c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:48.365 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.371+0000 7f1e26a229c0 20 searching for the correct realm 2024-09-12T00:54:48.369 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.375+0000 7f1e24d29640 0 -- 172.21.15.70:0/58679274 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f1e0c021060 msgr2=0x7f1e0c06e3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:48.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.383+0000 7f1e24d29640 0 -- 172.21.15.70:0/58679274 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f1cec080800 msgr2=0x7f1cec082c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:48.385 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.391+0000 7f1e26a229c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:48.385 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.391+0000 7f1e26a229c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:48.385 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.391+0000 7f1e26a229c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:48.385 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.391+0000 7f1e26a229c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:48.386 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.391+0000 7f1e26a229c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:48.386 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.391+0000 7f1e26a229c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:48.386 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.391+0000 7f1e26a229c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.387 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.391+0000 7f1e26a229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.387 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.391+0000 7f1e26a229c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.387 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.391+0000 7f1e26a229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:48.387 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.391+0000 7f1e26a229c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.387 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.391+0000 7f1e26a229c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:48.387 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.391+0000 7f1e26a229c0 20 zone default found 2024-09-12T00:54:48.387 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.391+0000 7f1e26a229c0 4 Realm: () 2024-09-12T00:54:48.387 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.391+0000 7f1e26a229c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:48.387 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.391+0000 7f1e26a229c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:48.388 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.391+0000 7f1e26a229c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:48.388 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.391+0000 7f1e26a229c0 20 zonegroup default 2024-09-12T00:54:48.388 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.391+0000 7f1e26a229c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.388 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.391+0000 7f1e26a229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.388 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.391+0000 7f1e26a229c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.388 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.391+0000 7f1e26a229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.389 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.391+0000 7f1e26a229c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.389 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.391+0000 7f1e26a229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.389 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.395+0000 7f1e26a229c0 20 started sync module instance, tier type = 2024-09-12T00:54:48.389 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.395+0000 7f1e26a229c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:48.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.407+0000 7f1e26a229c0 20 add_watcher() i=0 2024-09-12T00:54:48.404 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.407+0000 7f1e26a229c0 20 add_watcher() i=1 2024-09-12T00:54:48.404 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.407+0000 7f1e26a229c0 20 add_watcher() i=2 2024-09-12T00:54:48.404 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.407+0000 7f1e26a229c0 20 add_watcher() i=3 2024-09-12T00:54:48.404 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.407+0000 7f1e26a229c0 20 add_watcher() i=4 2024-09-12T00:54:48.404 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.407+0000 7f1e26a229c0 20 add_watcher() i=5 2024-09-12T00:54:48.404 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.407+0000 7f1e26a229c0 20 add_watcher() i=6 2024-09-12T00:54:48.404 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.411+0000 7f1e26a229c0 20 add_watcher() i=7 2024-09-12T00:54:48.404 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.411+0000 7f1e26a229c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:48.407 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.411+0000 7f1cdafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:48.408 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.411+0000 7f1e26a229c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:48.408 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.411+0000 7f1e26a229c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:48.408 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.411+0000 7f1e26a229c0 5 note: GC not initialized 2024-09-12T00:54:48.408 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.411+0000 7f1cd9fdb640 20 reqs_thread_entry: start 2024-09-12T00:54:48.408 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.411+0000 7f1e26a229c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:48.408 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.411+0000 7f1e26a229c0 20 Filter name: none 2024-09-12T00:54:48.409 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.411+0000 7f1c4b7fe640 20 reqs_thread_entry: start 2024-09-12T00:54:48.409 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.415+0000 7f1e26a229c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.409 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.415+0000 7f1e26a229c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:54:48.409 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.415+0000 7f1e26a229c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.410 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.415+0000 7f1e26a229c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:54:48.410 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.415+0000 7f1e26a229c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:48.410 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.415+0000 7f1e26a229c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.411 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.415+0000 7f1e26a229c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:54:48.411 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.415+0000 7f1e26a229c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.411 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.415+0000 7f1e26a229c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:54:48.411 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.415+0000 7f1e26a229c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:48.413 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.419+0000 7f1cdafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:48.418 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.423+0000 7f1e26a229c0 20 remove_watcher() i=0 2024-09-12T00:54:48.418 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.423+0000 7f1e26a229c0 2 removed watcher, disabling cache 2024-09-12T00:54:48.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.423+0000 7f1e26a229c0 20 remove_watcher() i=1 2024-09-12T00:54:48.422 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.427+0000 7f1e26a229c0 20 remove_watcher() i=2 2024-09-12T00:54:48.424 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.427+0000 7f1e26a229c0 20 remove_watcher() i=3 2024-09-12T00:54:48.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.431+0000 7f1e26a229c0 20 remove_watcher() i=4 2024-09-12T00:54:48.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.431+0000 7f1e26a229c0 20 remove_watcher() i=5 2024-09-12T00:54:48.428 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.435+0000 7f1e26a229c0 20 remove_watcher() i=6 2024-09-12T00:54:48.429 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.435+0000 7f1e26a229c0 20 remove_watcher() i=7 2024-09-12T00:54:48.443 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.443 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:54:48.443 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: abort-at-set-target-layout id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:54:48.443 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.443 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-12T00:54:48.476 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:48.476 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:48.519 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.523+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.520 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.520 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 realm 2024-09-12T00:54:48.520 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.521 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.521 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.527+0000 7fa54b52f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:48.521 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.521 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.521 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.522 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:48.522 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.523 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:48.523 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 searching for the correct realm 2024-09-12T00:54:48.529 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.535+0000 7fa549836640 0 -- 172.21.15.70:0/629985701 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fa540079fe0 msgr2=0x7fa540067410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:48.536 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.543+0000 7fa549035640 0 -- 172.21.15.70:0/629985701 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7fa544020440 msgr2=0x7fa5440208c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:48.543 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.547+0000 7fa54b52f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:48.544 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.547+0000 7fa54b52f9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:48.544 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.547+0000 7fa54b52f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:48.544 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.547+0000 7fa54b52f9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:48.544 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.547+0000 7fa54b52f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:48.544 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.547+0000 7fa54b52f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:48.544 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.547+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.547+0000 7fa54b52f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.547+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:48.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:48.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 zone default found 2024-09-12T00:54:48.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.551+0000 7fa54b52f9c0 4 Realm: () 2024-09-12T00:54:48.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.551+0000 7fa54b52f9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:48.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.551+0000 7fa54b52f9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:48.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.551+0000 7fa54b52f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:48.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 zonegroup default 2024-09-12T00:54:48.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 started sync module instance, tier type = 2024-09-12T00:54:48.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:48.561 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.567+0000 7fa54b52f9c0 20 add_watcher() i=0 2024-09-12T00:54:48.561 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.567+0000 7fa54b52f9c0 20 add_watcher() i=1 2024-09-12T00:54:48.561 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.567+0000 7fa54b52f9c0 20 add_watcher() i=2 2024-09-12T00:54:48.561 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.567+0000 7fa54b52f9c0 20 add_watcher() i=3 2024-09-12T00:54:48.561 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.567+0000 7fa54b52f9c0 20 add_watcher() i=4 2024-09-12T00:54:48.561 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.567+0000 7fa54b52f9c0 20 add_watcher() i=5 2024-09-12T00:54:48.561 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.567+0000 7fa54b52f9c0 20 add_watcher() i=6 2024-09-12T00:54:48.562 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.567+0000 7fa54b52f9c0 20 add_watcher() i=7 2024-09-12T00:54:48.562 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.567+0000 7fa54b52f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:48.565 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.571+0000 7fa3ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:48.565 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.571+0000 7fa54b52f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:48.565 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.571+0000 7fa54b52f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:48.565 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 note: GC not initialized 2024-09-12T00:54:48.566 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.571+0000 7fa3fe7e4640 20 reqs_thread_entry: start 2024-09-12T00:54:48.566 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.571+0000 7fa54b52f9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:48.566 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.571+0000 7fa54b52f9c0 20 Filter name: none 2024-09-12T00:54:48.566 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.571+0000 7fa36ffff640 20 reqs_thread_entry: start 2024-09-12T00:54:48.566 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.571+0000 7fa54b52f9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:54:48.566 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.571+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.571+0000 7fa54b52f9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:54:48.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.571+0000 7fa54b52f9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:54:48.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.571+0000 7fa54b52f9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:54:48.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.571+0000 7fa54b52f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 : miss 2024-09-12T00:54:48.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.571+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.571+0000 7fa54b52f9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:54:48.568 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.571+0000 7fa54b52f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 info.flags=0x17 2024-09-12T00:54:48.568 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.571+0000 7fa54b52f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 to cache LRU end 2024-09-12T00:54:48.568 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.571+0000 7fa54b52f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:48.568 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.571+0000 7fa54b52f9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:48.568 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.571+0000 7fa54b52f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 2024-09-12T00:54:48.572 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa54b52f9c0 time 2024-09-12T00:54:48.582534+0000 2024-09-12T00:54:48.572 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:48.573 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:48.573 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa54ee092eb] 2024-09-12T00:54:48.573 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa54ee0949f] 2024-09-12T00:54:48.573 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5574c8bf8cc1] 2024-09-12T00:54:48.573 INFO:tasks.workunit.client.0.smithi070.stderr: 4: radosgw-admin(+0x1422078) [0x5574c9656078] 2024-09-12T00:54:48.574 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5574c8c0dced] 2024-09-12T00:54:48.574 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:54:48.574 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa54dc6fd90] 2024-09-12T00:54:48.574 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:54:48.574 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:54:48.574 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.579+0000 7fa54b52f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa54b52f9c0 time 2024-09-12T00:54:48.582534+0000 2024-09-12T00:54:48.574 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:48.574 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.574 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:48.574 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa54ee092eb] 2024-09-12T00:54:48.575 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa54ee0949f] 2024-09-12T00:54:48.575 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5574c8bf8cc1] 2024-09-12T00:54:48.575 INFO:tasks.workunit.client.0.smithi070.stderr: 4: radosgw-admin(+0x1422078) [0x5574c9656078] 2024-09-12T00:54:48.575 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5574c8c0dced] 2024-09-12T00:54:48.575 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:54:48.575 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa54dc6fd90] 2024-09-12T00:54:48.575 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:54:48.575 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:54:48.575 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.575 INFO:tasks.workunit.client.0.smithi070.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:54:48.575 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7fa54b52f9c0 thread_name:radosgw-admin 2024-09-12T00:54:48.592 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:48.592 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa54dc88520] 2024-09-12T00:54:48.592 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:54:48.592 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:54:48.592 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:54:48.592 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa54ee09345] 2024-09-12T00:54:48.592 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa54ee0949f] 2024-09-12T00:54:48.592 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5574c8bf8cc1] 2024-09-12T00:54:48.592 INFO:tasks.workunit.client.0.smithi070.stderr: 8: radosgw-admin(+0x1422078) [0x5574c9656078] 2024-09-12T00:54:48.592 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5574c8c0dced] 2024-09-12T00:54:48.592 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:54:48.593 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa54dc6fd90] 2024-09-12T00:54:48.593 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:54:48.593 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:54:48.593 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.579+0000 7fa54b52f9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:54:48.593 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7fa54b52f9c0 thread_name:radosgw-admin 2024-09-12T00:54:48.593 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.593 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:48.593 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa54dc88520] 2024-09-12T00:54:48.593 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:54:48.593 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:54:48.593 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:54:48.593 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa54ee09345] 2024-09-12T00:54:48.593 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa54ee0949f] 2024-09-12T00:54:48.594 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5574c8bf8cc1] 2024-09-12T00:54:48.594 INFO:tasks.workunit.client.0.smithi070.stderr: 8: radosgw-admin(+0x1422078) [0x5574c9656078] 2024-09-12T00:54:48.594 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5574c8c0dced] 2024-09-12T00:54:48.594 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:54:48.594 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa54dc6fd90] 2024-09-12T00:54:48.594 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:54:48.594 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:54:48.594 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:54:48.594 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.594 INFO:tasks.workunit.client.0.smithi070.stderr:--- begin dump of recent events --- 2024-09-12T00:54:48.594 INFO:tasks.workunit.client.0.smithi070.stderr: -499> 2024-09-12T00:54:48.503+0000 7fa549836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:48.594 INFO:tasks.workunit.client.0.smithi070.stderr: -498> 2024-09-12T00:54:48.503+0000 7fa549035640 10 monclient(hunting): get_auth_request con 0x5574c9e96230 auth_method 0 2024-09-12T00:54:48.595 INFO:tasks.workunit.client.0.smithi070.stderr: -497> 2024-09-12T00:54:48.503+0000 7fa549035640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:48.595 INFO:tasks.workunit.client.0.smithi070.stderr: -496> 2024-09-12T00:54:48.503+0000 7fa549035640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:48.595 INFO:tasks.workunit.client.0.smithi070.stderr: -495> 2024-09-12T00:54:48.503+0000 7fa549035640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:48.595 INFO:tasks.workunit.client.0.smithi070.stderr: -494> 2024-09-12T00:54:48.503+0000 7fa549836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:48.595 INFO:tasks.workunit.client.0.smithi070.stderr: -493> 2024-09-12T00:54:48.503+0000 7fa549836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:48.595 INFO:tasks.workunit.client.0.smithi070.stderr: -492> 2024-09-12T00:54:48.503+0000 7fa549836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:48.595 INFO:tasks.workunit.client.0.smithi070.stderr: -491> 2024-09-12T00:54:48.503+0000 7fa549035640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:48.595 INFO:tasks.workunit.client.0.smithi070.stderr: -490> 2024-09-12T00:54:48.503+0000 7fa549035640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:48.595 INFO:tasks.workunit.client.0.smithi070.stderr: -489> 2024-09-12T00:54:48.503+0000 7fa549035640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:48.595 INFO:tasks.workunit.client.0.smithi070.stderr: -488> 2024-09-12T00:54:48.503+0000 7fa549035640 10 monclient(hunting): handle_auth_done global_id 6296 payload 274 2024-09-12T00:54:48.595 INFO:tasks.workunit.client.0.smithi070.stderr: -487> 2024-09-12T00:54:48.503+0000 7fa549035640 10 monclient: _finish_hunting 0 2024-09-12T00:54:48.595 INFO:tasks.workunit.client.0.smithi070.stderr: -486> 2024-09-12T00:54:48.503+0000 7fa549035640 1 monclient: found mon.noname-c 2024-09-12T00:54:48.595 INFO:tasks.workunit.client.0.smithi070.stderr: -485> 2024-09-12T00:54:48.503+0000 7fa549035640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:54:48.596 INFO:tasks.workunit.client.0.smithi070.stderr: -484> 2024-09-12T00:54:48.503+0000 7fa437606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:48.596 INFO:tasks.workunit.client.0.smithi070.stderr: -483> 2024-09-12T00:54:48.503+0000 7fa437606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:48.596 INFO:tasks.workunit.client.0.smithi070.stderr: -482> 2024-09-12T00:54:48.503+0000 7fa437606640 10 monclient: dump: 2024-09-12T00:54:48.596 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:48.596 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:48.596 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.596 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.596 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:48.596 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.596 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:48.596 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:48.596 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:48.596 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.596 INFO:tasks.workunit.client.0.smithi070.stderr: -481> 2024-09-12T00:54:48.503+0000 7fa437606640 10 monclient: _finish_auth 0 2024-09-12T00:54:48.597 INFO:tasks.workunit.client.0.smithi070.stderr: -480> 2024-09-12T00:54:48.503+0000 7fa437606640 10 monclient: _check_auth_tickets 2024-09-12T00:54:48.597 INFO:tasks.workunit.client.0.smithi070.stderr: -479> 2024-09-12T00:54:48.503+0000 7fa437606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:48.597 INFO:tasks.workunit.client.0.smithi070.stderr: -478> 2024-09-12T00:54:48.503+0000 7fa437606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:48.597 INFO:tasks.workunit.client.0.smithi070.stderr: -477> 2024-09-12T00:54:48.503+0000 7fa437606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:48.597 INFO:tasks.workunit.client.0.smithi070.stderr: -476> 2024-09-12T00:54:48.503+0000 7fa437606640 10 monclient: dump: 2024-09-12T00:54:48.597 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:48.597 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:48.597 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.597 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.597 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:48.597 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.597 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:48.597 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:48.598 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:48.598 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.598 INFO:tasks.workunit.client.0.smithi070.stderr: -475> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 monclient: authenticate success, global_id 6296 2024-09-12T00:54:48.598 INFO:tasks.workunit.client.0.smithi070.stderr: -474> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:54:48.598 INFO:tasks.workunit.client.0.smithi070.stderr: -473> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 4 set_mon_vals no callback set 2024-09-12T00:54:48.598 INFO:tasks.workunit.client.0.smithi070.stderr: -472> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient: shutdown 2024-09-12T00:54:48.598 INFO:tasks.workunit.client.0.smithi070.stderr: -471> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) unregister_commands rotate-key 2024-09-12T00:54:48.598 INFO:tasks.workunit.client.0.smithi070.stderr: -470> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient: build_initial_monmap 2024-09-12T00:54:48.598 INFO:tasks.workunit.client.0.smithi070.stderr: -469> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 1 build_initial for_mkfs: 0 2024-09-12T00:54:48.598 INFO:tasks.workunit.client.0.smithi070.stderr: -468> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient: monmap: 2024-09-12T00:54:48.598 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:54:48.598 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:48.598 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:54:48.598 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:54:48.599 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:48.599 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.599 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:54:48.599 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:54:48.599 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:54:48.599 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.599 INFO:tasks.workunit.client.0.smithi070.stderr: -467> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding auth protocol: cephx 2024-09-12T00:54:48.599 INFO:tasks.workunit.client.0.smithi070.stderr: -466> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding auth protocol: cephx 2024-09-12T00:54:48.599 INFO:tasks.workunit.client.0.smithi070.stderr: -465> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding auth protocol: cephx 2024-09-12T00:54:48.599 INFO:tasks.workunit.client.0.smithi070.stderr: -464> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding con mode: secure 2024-09-12T00:54:48.599 INFO:tasks.workunit.client.0.smithi070.stderr: -463> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding con mode: crc 2024-09-12T00:54:48.599 INFO:tasks.workunit.client.0.smithi070.stderr: -462> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding con mode: secure 2024-09-12T00:54:48.599 INFO:tasks.workunit.client.0.smithi070.stderr: -461> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding con mode: crc 2024-09-12T00:54:48.600 INFO:tasks.workunit.client.0.smithi070.stderr: -460> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding con mode: secure 2024-09-12T00:54:48.600 INFO:tasks.workunit.client.0.smithi070.stderr: -459> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding con mode: crc 2024-09-12T00:54:48.600 INFO:tasks.workunit.client.0.smithi070.stderr: -458> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding con mode: crc 2024-09-12T00:54:48.600 INFO:tasks.workunit.client.0.smithi070.stderr: -457> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding con mode: secure 2024-09-12T00:54:48.600 INFO:tasks.workunit.client.0.smithi070.stderr: -456> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding con mode: crc 2024-09-12T00:54:48.600 INFO:tasks.workunit.client.0.smithi070.stderr: -455> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding con mode: secure 2024-09-12T00:54:48.600 INFO:tasks.workunit.client.0.smithi070.stderr: -454> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding con mode: crc 2024-09-12T00:54:48.600 INFO:tasks.workunit.client.0.smithi070.stderr: -453> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding con mode: secure 2024-09-12T00:54:48.600 INFO:tasks.workunit.client.0.smithi070.stderr: -452> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:48.600 INFO:tasks.workunit.client.0.smithi070.stderr: -451> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 1 librados: starting msgr at 2024-09-12T00:54:48.600 INFO:tasks.workunit.client.0.smithi070.stderr: -450> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 1 librados: starting objecter 2024-09-12T00:54:48.600 INFO:tasks.workunit.client.0.smithi070.stderr: -449> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command objecter_requests hook 0x5574c9d44bd0 2024-09-12T00:54:48.601 INFO:tasks.workunit.client.0.smithi070.stderr: -448> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 1 librados: setting wanted keys 2024-09-12T00:54:48.601 INFO:tasks.workunit.client.0.smithi070.stderr: -447> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 1 librados: calling monclient init 2024-09-12T00:54:48.601 INFO:tasks.workunit.client.0.smithi070.stderr: -446> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient: init 2024-09-12T00:54:48.601 INFO:tasks.workunit.client.0.smithi070.stderr: -445> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding auth protocol: cephx 2024-09-12T00:54:48.601 INFO:tasks.workunit.client.0.smithi070.stderr: -444> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding auth protocol: cephx 2024-09-12T00:54:48.601 INFO:tasks.workunit.client.0.smithi070.stderr: -443> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding auth protocol: cephx 2024-09-12T00:54:48.601 INFO:tasks.workunit.client.0.smithi070.stderr: -442> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding con mode: secure 2024-09-12T00:54:48.601 INFO:tasks.workunit.client.0.smithi070.stderr: -441> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding con mode: crc 2024-09-12T00:54:48.601 INFO:tasks.workunit.client.0.smithi070.stderr: -440> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding con mode: secure 2024-09-12T00:54:48.601 INFO:tasks.workunit.client.0.smithi070.stderr: -439> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding con mode: crc 2024-09-12T00:54:48.601 INFO:tasks.workunit.client.0.smithi070.stderr: -438> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding con mode: secure 2024-09-12T00:54:48.601 INFO:tasks.workunit.client.0.smithi070.stderr: -437> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding con mode: crc 2024-09-12T00:54:48.602 INFO:tasks.workunit.client.0.smithi070.stderr: -436> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding con mode: crc 2024-09-12T00:54:48.602 INFO:tasks.workunit.client.0.smithi070.stderr: -435> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding con mode: secure 2024-09-12T00:54:48.602 INFO:tasks.workunit.client.0.smithi070.stderr: -434> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding con mode: crc 2024-09-12T00:54:48.602 INFO:tasks.workunit.client.0.smithi070.stderr: -433> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding con mode: secure 2024-09-12T00:54:48.602 INFO:tasks.workunit.client.0.smithi070.stderr: -432> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding con mode: crc 2024-09-12T00:54:48.602 INFO:tasks.workunit.client.0.smithi070.stderr: -431> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding con mode: secure 2024-09-12T00:54:48.602 INFO:tasks.workunit.client.0.smithi070.stderr: -430> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:48.602 INFO:tasks.workunit.client.0.smithi070.stderr: -429> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:48.602 INFO:tasks.workunit.client.0.smithi070.stderr: -428> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command rotate-key hook 0x5574c9fd7e18 2024-09-12T00:54:48.602 INFO:tasks.workunit.client.0.smithi070.stderr: -427> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:54:48.602 INFO:tasks.workunit.client.0.smithi070.stderr: -426> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:54:48.602 INFO:tasks.workunit.client.0.smithi070.stderr: -425> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient(hunting): picked mon.noname-c con 0x5574c9e96230 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:54:48.602 INFO:tasks.workunit.client.0.smithi070.stderr: -424> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient(hunting): picked mon.noname-a con 0x5574c9f23970 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:54:48.602 INFO:tasks.workunit.client.0.smithi070.stderr: -423> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient(hunting): picked mon.noname-b con 0x5574ca006460 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:54:48.603 INFO:tasks.workunit.client.0.smithi070.stderr: -422> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:48.603 INFO:tasks.workunit.client.0.smithi070.stderr: -421> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:48.603 INFO:tasks.workunit.client.0.smithi070.stderr: -420> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:48.603 INFO:tasks.workunit.client.0.smithi070.stderr: -419> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:54:48.603 INFO:tasks.workunit.client.0.smithi070.stderr: -418> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient(hunting): authenticate will time out at 2138.955937s 2024-09-12T00:54:48.603 INFO:tasks.workunit.client.0.smithi070.stderr: -417> 2024-09-12T00:54:48.507+0000 7fa549035640 10 monclient(hunting): get_auth_request con 0x5574c9e96230 auth_method 0 2024-09-12T00:54:48.603 INFO:tasks.workunit.client.0.smithi070.stderr: -416> 2024-09-12T00:54:48.507+0000 7fa549035640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:48.603 INFO:tasks.workunit.client.0.smithi070.stderr: -415> 2024-09-12T00:54:48.507+0000 7fa549035640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:48.603 INFO:tasks.workunit.client.0.smithi070.stderr: -414> 2024-09-12T00:54:48.507+0000 7fa549035640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:48.603 INFO:tasks.workunit.client.0.smithi070.stderr: -413> 2024-09-12T00:54:48.507+0000 7fa548834640 10 monclient(hunting): get_auth_request con 0x5574c9f23970 auth_method 0 2024-09-12T00:54:48.603 INFO:tasks.workunit.client.0.smithi070.stderr: -412> 2024-09-12T00:54:48.507+0000 7fa548834640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:48.603 INFO:tasks.workunit.client.0.smithi070.stderr: -411> 2024-09-12T00:54:48.507+0000 7fa548834640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:48.604 INFO:tasks.workunit.client.0.smithi070.stderr: -410> 2024-09-12T00:54:48.507+0000 7fa548834640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:48.604 INFO:tasks.workunit.client.0.smithi070.stderr: -409> 2024-09-12T00:54:48.507+0000 7fa549035640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:48.604 INFO:tasks.workunit.client.0.smithi070.stderr: -408> 2024-09-12T00:54:48.507+0000 7fa549035640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:48.604 INFO:tasks.workunit.client.0.smithi070.stderr: -407> 2024-09-12T00:54:48.507+0000 7fa549035640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:48.604 INFO:tasks.workunit.client.0.smithi070.stderr: -406> 2024-09-12T00:54:48.507+0000 7fa548834640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:48.604 INFO:tasks.workunit.client.0.smithi070.stderr: -405> 2024-09-12T00:54:48.507+0000 7fa548834640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:48.604 INFO:tasks.workunit.client.0.smithi070.stderr: -404> 2024-09-12T00:54:48.507+0000 7fa548834640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:48.604 INFO:tasks.workunit.client.0.smithi070.stderr: -403> 2024-09-12T00:54:48.507+0000 7fa549035640 10 monclient(hunting): handle_auth_done global_id 6299 payload 824 2024-09-12T00:54:48.604 INFO:tasks.workunit.client.0.smithi070.stderr: -402> 2024-09-12T00:54:48.507+0000 7fa549035640 10 monclient: _finish_hunting 0 2024-09-12T00:54:48.604 INFO:tasks.workunit.client.0.smithi070.stderr: -401> 2024-09-12T00:54:48.507+0000 7fa549035640 1 monclient: found mon.noname-c 2024-09-12T00:54:48.605 INFO:tasks.workunit.client.0.smithi070.stderr: -400> 2024-09-12T00:54:48.507+0000 7fa549035640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:54:48.605 INFO:tasks.workunit.client.0.smithi070.stderr: -399> 2024-09-12T00:54:48.507+0000 7fa435e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:48.605 INFO:tasks.workunit.client.0.smithi070.stderr: -398> 2024-09-12T00:54:48.507+0000 7fa435e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:48.605 INFO:tasks.workunit.client.0.smithi070.stderr: -397> 2024-09-12T00:54:48.507+0000 7fa435e03640 10 monclient: dump: 2024-09-12T00:54:48.605 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:48.605 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:48.605 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.605 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.605 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:48.605 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.605 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:48.605 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:48.605 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:48.605 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.606 INFO:tasks.workunit.client.0.smithi070.stderr: -396> 2024-09-12T00:54:48.507+0000 7fa435e03640 10 monclient: _finish_auth 0 2024-09-12T00:54:48.606 INFO:tasks.workunit.client.0.smithi070.stderr: -395> 2024-09-12T00:54:48.507+0000 7fa435e03640 10 monclient: _check_auth_tickets 2024-09-12T00:54:48.606 INFO:tasks.workunit.client.0.smithi070.stderr: -394> 2024-09-12T00:54:48.507+0000 7fa435e03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:48.606 INFO:tasks.workunit.client.0.smithi070.stderr: -393> 2024-09-12T00:54:48.507+0000 7fa435e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:48.606 INFO:tasks.workunit.client.0.smithi070.stderr: -392> 2024-09-12T00:54:48.507+0000 7fa435e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:48.606 INFO:tasks.workunit.client.0.smithi070.stderr: -391> 2024-09-12T00:54:48.507+0000 7fa435e03640 10 monclient: dump: 2024-09-12T00:54:48.606 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:48.606 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:48.606 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.606 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.606 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:48.606 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.606 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:48.606 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:48.607 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:48.607 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.607 INFO:tasks.workunit.client.0.smithi070.stderr: -390> 2024-09-12T00:54:48.507+0000 7fa54b52f9c0 5 monclient: authenticate success, global_id 6299 2024-09-12T00:54:48.607 INFO:tasks.workunit.client.0.smithi070.stderr: -389> 2024-09-12T00:54:48.507+0000 7fa437606640 4 set_mon_vals no callback set 2024-09-12T00:54:48.607 INFO:tasks.workunit.client.0.smithi070.stderr: -388> 2024-09-12T00:54:48.507+0000 7fa54b52f9c0 10 monclient: _renew_subs 2024-09-12T00:54:48.607 INFO:tasks.workunit.client.0.smithi070.stderr: -387> 2024-09-12T00:54:48.507+0000 7fa54b52f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:54:48.607 INFO:tasks.workunit.client.0.smithi070.stderr: -386> 2024-09-12T00:54:48.507+0000 7fa54b52f9c0 10 monclient: _renew_subs 2024-09-12T00:54:48.607 INFO:tasks.workunit.client.0.smithi070.stderr: -385> 2024-09-12T00:54:48.507+0000 7fa54b52f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:54:48.607 INFO:tasks.workunit.client.0.smithi070.stderr: -384> 2024-09-12T00:54:48.507+0000 7fa54b52f9c0 1 librados: init done 2024-09-12T00:54:48.607 INFO:tasks.workunit.client.0.smithi070.stderr: -383> 2024-09-12T00:54:48.507+0000 7fa435e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:48.607 INFO:tasks.workunit.client.0.smithi070.stderr: -382> 2024-09-12T00:54:48.507+0000 7fa435e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:54:48.607 INFO:tasks.workunit.client.0.smithi070.stderr: -381> 2024-09-12T00:54:48.507+0000 7fa435e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:54:48.608 INFO:tasks.workunit.client.0.smithi070.stderr: -380> 2024-09-12T00:54:48.507+0000 7fa549836640 10 monclient: get_auth_request con 0x5574ca015c90 auth_method 0 2024-09-12T00:54:48.608 INFO:tasks.workunit.client.0.smithi070.stderr: -379> 2024-09-12T00:54:48.507+0000 7fa548834640 10 monclient: get_auth_request con 0x7fa430070b10 auth_method 0 2024-09-12T00:54:48.608 INFO:tasks.workunit.client.0.smithi070.stderr: -378> 2024-09-12T00:54:48.511+0000 7fa549035640 10 monclient: get_auth_request con 0x5574ca022890 auth_method 0 2024-09-12T00:54:48.608 INFO:tasks.workunit.client.0.smithi070.stderr: -377> 2024-09-12T00:54:48.511+0000 7fa548834640 10 monclient: get_auth_request con 0x5574ca026a80 auth_method 0 2024-09-12T00:54:48.608 INFO:tasks.workunit.client.0.smithi070.stderr: -376> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 10 monclient: build_initial_monmap 2024-09-12T00:54:48.608 INFO:tasks.workunit.client.0.smithi070.stderr: -375> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 1 build_initial for_mkfs: 0 2024-09-12T00:54:48.608 INFO:tasks.workunit.client.0.smithi070.stderr: -374> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 10 monclient: monmap: 2024-09-12T00:54:48.608 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:54:48.608 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:48.608 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:54:48.609 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:54:48.609 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:48.609 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.609 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:54:48.609 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:54:48.609 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:54:48.609 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.609 INFO:tasks.workunit.client.0.smithi070.stderr: -373> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding auth protocol: cephx 2024-09-12T00:54:48.609 INFO:tasks.workunit.client.0.smithi070.stderr: -372> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding auth protocol: cephx 2024-09-12T00:54:48.609 INFO:tasks.workunit.client.0.smithi070.stderr: -371> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding auth protocol: cephx 2024-09-12T00:54:48.610 INFO:tasks.workunit.client.0.smithi070.stderr: -370> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding con mode: secure 2024-09-12T00:54:48.610 INFO:tasks.workunit.client.0.smithi070.stderr: -369> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding con mode: crc 2024-09-12T00:54:48.610 INFO:tasks.workunit.client.0.smithi070.stderr: -368> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding con mode: secure 2024-09-12T00:54:48.610 INFO:tasks.workunit.client.0.smithi070.stderr: -367> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding con mode: crc 2024-09-12T00:54:48.610 INFO:tasks.workunit.client.0.smithi070.stderr: -366> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding con mode: secure 2024-09-12T00:54:48.610 INFO:tasks.workunit.client.0.smithi070.stderr: -365> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding con mode: crc 2024-09-12T00:54:48.610 INFO:tasks.workunit.client.0.smithi070.stderr: -364> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding con mode: crc 2024-09-12T00:54:48.610 INFO:tasks.workunit.client.0.smithi070.stderr: -363> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding con mode: secure 2024-09-12T00:54:48.610 INFO:tasks.workunit.client.0.smithi070.stderr: -362> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding con mode: crc 2024-09-12T00:54:48.610 INFO:tasks.workunit.client.0.smithi070.stderr: -361> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding con mode: secure 2024-09-12T00:54:48.610 INFO:tasks.workunit.client.0.smithi070.stderr: -360> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding con mode: crc 2024-09-12T00:54:48.610 INFO:tasks.workunit.client.0.smithi070.stderr: -359> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding con mode: secure 2024-09-12T00:54:48.610 INFO:tasks.workunit.client.0.smithi070.stderr: -358> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:48.611 INFO:tasks.workunit.client.0.smithi070.stderr: -357> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5574ca02ea30 EEXIST 2024-09-12T00:54:48.611 INFO:tasks.workunit.client.0.smithi070.stderr: -356> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 10 monclient: init 2024-09-12T00:54:48.611 INFO:tasks.workunit.client.0.smithi070.stderr: -355> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding auth protocol: cephx 2024-09-12T00:54:48.611 INFO:tasks.workunit.client.0.smithi070.stderr: -354> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding auth protocol: cephx 2024-09-12T00:54:48.611 INFO:tasks.workunit.client.0.smithi070.stderr: -353> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding auth protocol: cephx 2024-09-12T00:54:48.611 INFO:tasks.workunit.client.0.smithi070.stderr: -352> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding con mode: secure 2024-09-12T00:54:48.611 INFO:tasks.workunit.client.0.smithi070.stderr: -351> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding con mode: crc 2024-09-12T00:54:48.611 INFO:tasks.workunit.client.0.smithi070.stderr: -350> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding con mode: secure 2024-09-12T00:54:48.611 INFO:tasks.workunit.client.0.smithi070.stderr: -349> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding con mode: crc 2024-09-12T00:54:48.611 INFO:tasks.workunit.client.0.smithi070.stderr: -348> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding con mode: secure 2024-09-12T00:54:48.611 INFO:tasks.workunit.client.0.smithi070.stderr: -347> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding con mode: crc 2024-09-12T00:54:48.611 INFO:tasks.workunit.client.0.smithi070.stderr: -346> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding con mode: crc 2024-09-12T00:54:48.611 INFO:tasks.workunit.client.0.smithi070.stderr: -345> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding con mode: secure 2024-09-12T00:54:48.611 INFO:tasks.workunit.client.0.smithi070.stderr: -344> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding con mode: crc 2024-09-12T00:54:48.611 INFO:tasks.workunit.client.0.smithi070.stderr: -343> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding con mode: secure 2024-09-12T00:54:48.612 INFO:tasks.workunit.client.0.smithi070.stderr: -342> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding con mode: crc 2024-09-12T00:54:48.612 INFO:tasks.workunit.client.0.smithi070.stderr: -341> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding con mode: secure 2024-09-12T00:54:48.612 INFO:tasks.workunit.client.0.smithi070.stderr: -340> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:48.612 INFO:tasks.workunit.client.0.smithi070.stderr: -339> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:48.612 INFO:tasks.workunit.client.0.smithi070.stderr: -338> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command rotate-key cmddesc rotate-key hook 0x5574ca029e50 EEXIST 2024-09-12T00:54:48.612 INFO:tasks.workunit.client.0.smithi070.stderr: -337> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:54:48.612 INFO:tasks.workunit.client.0.smithi070.stderr: -336> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:54:48.612 INFO:tasks.workunit.client.0.smithi070.stderr: -335> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient(hunting): picked mon.noname-b con 0x5574ca053230 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:54:48.612 INFO:tasks.workunit.client.0.smithi070.stderr: -334> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient(hunting): picked mon.noname-a con 0x5574ca06af00 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:54:48.612 INFO:tasks.workunit.client.0.smithi070.stderr: -333> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient(hunting): picked mon.noname-c con 0x5574ca051a40 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:54:48.613 INFO:tasks.workunit.client.0.smithi070.stderr: -332> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:48.613 INFO:tasks.workunit.client.0.smithi070.stderr: -331> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:48.613 INFO:tasks.workunit.client.0.smithi070.stderr: -330> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:48.613 INFO:tasks.workunit.client.0.smithi070.stderr: -329> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:54:48.613 INFO:tasks.workunit.client.0.smithi070.stderr: -328> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient(hunting): authenticate will time out at 2138.964527s 2024-09-12T00:54:48.613 INFO:tasks.workunit.client.0.smithi070.stderr: -327> 2024-09-12T00:54:48.515+0000 7fa548834640 10 monclient(hunting): get_auth_request con 0x5574ca06af00 auth_method 0 2024-09-12T00:54:48.613 INFO:tasks.workunit.client.0.smithi070.stderr: -326> 2024-09-12T00:54:48.515+0000 7fa548834640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:48.613 INFO:tasks.workunit.client.0.smithi070.stderr: -325> 2024-09-12T00:54:48.515+0000 7fa548834640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:48.613 INFO:tasks.workunit.client.0.smithi070.stderr: -324> 2024-09-12T00:54:48.515+0000 7fa548834640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:48.613 INFO:tasks.workunit.client.0.smithi070.stderr: -323> 2024-09-12T00:54:48.515+0000 7fa549836640 10 monclient(hunting): get_auth_request con 0x5574ca051a40 auth_method 0 2024-09-12T00:54:48.613 INFO:tasks.workunit.client.0.smithi070.stderr: -322> 2024-09-12T00:54:48.515+0000 7fa549836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:48.613 INFO:tasks.workunit.client.0.smithi070.stderr: -321> 2024-09-12T00:54:48.515+0000 7fa549836640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:48.613 INFO:tasks.workunit.client.0.smithi070.stderr: -320> 2024-09-12T00:54:48.515+0000 7fa549836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:48.614 INFO:tasks.workunit.client.0.smithi070.stderr: -319> 2024-09-12T00:54:48.515+0000 7fa548834640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:48.614 INFO:tasks.workunit.client.0.smithi070.stderr: -318> 2024-09-12T00:54:48.515+0000 7fa548834640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:48.614 INFO:tasks.workunit.client.0.smithi070.stderr: -317> 2024-09-12T00:54:48.515+0000 7fa548834640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:48.614 INFO:tasks.workunit.client.0.smithi070.stderr: -316> 2024-09-12T00:54:48.515+0000 7fa549836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:48.614 INFO:tasks.workunit.client.0.smithi070.stderr: -315> 2024-09-12T00:54:48.515+0000 7fa549836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:48.614 INFO:tasks.workunit.client.0.smithi070.stderr: -314> 2024-09-12T00:54:48.515+0000 7fa549836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:48.614 INFO:tasks.workunit.client.0.smithi070.stderr: -313> 2024-09-12T00:54:48.515+0000 7fa549035640 10 monclient(hunting): get_auth_request con 0x5574ca053230 auth_method 0 2024-09-12T00:54:48.614 INFO:tasks.workunit.client.0.smithi070.stderr: -312> 2024-09-12T00:54:48.515+0000 7fa549035640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:48.614 INFO:tasks.workunit.client.0.smithi070.stderr: -311> 2024-09-12T00:54:48.515+0000 7fa549035640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:48.614 INFO:tasks.workunit.client.0.smithi070.stderr: -310> 2024-09-12T00:54:48.515+0000 7fa549035640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:48.615 INFO:tasks.workunit.client.0.smithi070.stderr: -309> 2024-09-12T00:54:48.515+0000 7fa548834640 10 monclient(hunting): handle_auth_done global_id 6648 payload 824 2024-09-12T00:54:48.615 INFO:tasks.workunit.client.0.smithi070.stderr: -308> 2024-09-12T00:54:48.515+0000 7fa548834640 10 monclient: _finish_hunting 0 2024-09-12T00:54:48.615 INFO:tasks.workunit.client.0.smithi070.stderr: -307> 2024-09-12T00:54:48.515+0000 7fa548834640 1 monclient: found mon.noname-a 2024-09-12T00:54:48.615 INFO:tasks.workunit.client.0.smithi070.stderr: -306> 2024-09-12T00:54:48.515+0000 7fa548834640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:54:48.615 INFO:tasks.workunit.client.0.smithi070.stderr: -305> 2024-09-12T00:54:48.515+0000 7fa42effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:48.615 INFO:tasks.workunit.client.0.smithi070.stderr: -304> 2024-09-12T00:54:48.515+0000 7fa42effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:48.615 INFO:tasks.workunit.client.0.smithi070.stderr: -303> 2024-09-12T00:54:48.515+0000 7fa42effd640 10 monclient: dump: 2024-09-12T00:54:48.615 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:48.615 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:48.615 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.615 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.615 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:48.615 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.616 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:48.616 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:48.616 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:48.616 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.616 INFO:tasks.workunit.client.0.smithi070.stderr: -302> 2024-09-12T00:54:48.515+0000 7fa42effd640 10 monclient: _finish_auth 0 2024-09-12T00:54:48.616 INFO:tasks.workunit.client.0.smithi070.stderr: -301> 2024-09-12T00:54:48.515+0000 7fa42effd640 10 monclient: _check_auth_tickets 2024-09-12T00:54:48.616 INFO:tasks.workunit.client.0.smithi070.stderr: -300> 2024-09-12T00:54:48.515+0000 7fa42effd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:48.616 INFO:tasks.workunit.client.0.smithi070.stderr: -299> 2024-09-12T00:54:48.515+0000 7fa42effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:48.616 INFO:tasks.workunit.client.0.smithi070.stderr: -298> 2024-09-12T00:54:48.515+0000 7fa42effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:48.616 INFO:tasks.workunit.client.0.smithi070.stderr: -297> 2024-09-12T00:54:48.515+0000 7fa42effd640 10 monclient: dump: 2024-09-12T00:54:48.616 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:48.616 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:48.616 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.617 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.617 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:48.617 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.617 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:48.617 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:48.617 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:48.617 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.617 INFO:tasks.workunit.client.0.smithi070.stderr: -296> 2024-09-12T00:54:48.515+0000 7fa54a037640 4 set_mon_vals no callback set 2024-09-12T00:54:48.617 INFO:tasks.workunit.client.0.smithi070.stderr: -295> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 5 monclient: authenticate success, global_id 6648 2024-09-12T00:54:48.617 INFO:tasks.workunit.client.0.smithi070.stderr: -294> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient: _renew_subs 2024-09-12T00:54:48.618 INFO:tasks.workunit.client.0.smithi070.stderr: -293> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:54:48.618 INFO:tasks.workunit.client.0.smithi070.stderr: -292> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient: _renew_subs 2024-09-12T00:54:48.618 INFO:tasks.workunit.client.0.smithi070.stderr: -291> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:54:48.618 INFO:tasks.workunit.client.0.smithi070.stderr: -290> 2024-09-12T00:54:48.515+0000 7fa42effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:48.618 INFO:tasks.workunit.client.0.smithi070.stderr: -289> 2024-09-12T00:54:48.515+0000 7fa42effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:54:48.618 INFO:tasks.workunit.client.0.smithi070.stderr: -288> 2024-09-12T00:54:48.515+0000 7fa42effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:54:48.618 INFO:tasks.workunit.client.0.smithi070.stderr: -287> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient: get_monmap_and_config 2024-09-12T00:54:48.618 INFO:tasks.workunit.client.0.smithi070.stderr: -286> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient: build_initial_monmap 2024-09-12T00:54:48.618 INFO:tasks.workunit.client.0.smithi070.stderr: -285> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 1 build_initial for_mkfs: 0 2024-09-12T00:54:48.618 INFO:tasks.workunit.client.0.smithi070.stderr: -284> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient: monmap: 2024-09-12T00:54:48.618 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:54:48.618 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:48.618 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:54:48.619 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:54:48.619 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:48.619 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.619 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:54:48.619 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:54:48.619 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:54:48.619 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.619 INFO:tasks.workunit.client.0.smithi070.stderr: -283> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding auth protocol: cephx 2024-09-12T00:54:48.619 INFO:tasks.workunit.client.0.smithi070.stderr: -282> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding auth protocol: cephx 2024-09-12T00:54:48.619 INFO:tasks.workunit.client.0.smithi070.stderr: -281> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding auth protocol: cephx 2024-09-12T00:54:48.619 INFO:tasks.workunit.client.0.smithi070.stderr: -280> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding con mode: secure 2024-09-12T00:54:48.619 INFO:tasks.workunit.client.0.smithi070.stderr: -279> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding con mode: crc 2024-09-12T00:54:48.619 INFO:tasks.workunit.client.0.smithi070.stderr: -278> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding con mode: secure 2024-09-12T00:54:48.620 INFO:tasks.workunit.client.0.smithi070.stderr: -277> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding con mode: crc 2024-09-12T00:54:48.620 INFO:tasks.workunit.client.0.smithi070.stderr: -276> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding con mode: secure 2024-09-12T00:54:48.620 INFO:tasks.workunit.client.0.smithi070.stderr: -275> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding con mode: crc 2024-09-12T00:54:48.620 INFO:tasks.workunit.client.0.smithi070.stderr: -274> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding con mode: crc 2024-09-12T00:54:48.620 INFO:tasks.workunit.client.0.smithi070.stderr: -273> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding con mode: secure 2024-09-12T00:54:48.620 INFO:tasks.workunit.client.0.smithi070.stderr: -272> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding con mode: crc 2024-09-12T00:54:48.620 INFO:tasks.workunit.client.0.smithi070.stderr: -271> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding con mode: secure 2024-09-12T00:54:48.620 INFO:tasks.workunit.client.0.smithi070.stderr: -270> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding con mode: crc 2024-09-12T00:54:48.620 INFO:tasks.workunit.client.0.smithi070.stderr: -269> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding con mode: secure 2024-09-12T00:54:48.620 INFO:tasks.workunit.client.0.smithi070.stderr: -268> 2024-09-12T00:54:48.519+0000 7fa549035640 10 monclient: get_auth_request con 0x7fa4240709f0 auth_method 0 2024-09-12T00:54:48.620 INFO:tasks.workunit.client.0.smithi070.stderr: -267> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:48.620 INFO:tasks.workunit.client.0.smithi070.stderr: -266> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient: init 2024-09-12T00:54:48.620 INFO:tasks.workunit.client.0.smithi070.stderr: -265> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding auth protocol: cephx 2024-09-12T00:54:48.621 INFO:tasks.workunit.client.0.smithi070.stderr: -264> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding auth protocol: cephx 2024-09-12T00:54:48.621 INFO:tasks.workunit.client.0.smithi070.stderr: -263> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding auth protocol: cephx 2024-09-12T00:54:48.621 INFO:tasks.workunit.client.0.smithi070.stderr: -262> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding con mode: secure 2024-09-12T00:54:48.621 INFO:tasks.workunit.client.0.smithi070.stderr: -261> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding con mode: crc 2024-09-12T00:54:48.621 INFO:tasks.workunit.client.0.smithi070.stderr: -260> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding con mode: secure 2024-09-12T00:54:48.621 INFO:tasks.workunit.client.0.smithi070.stderr: -259> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding con mode: crc 2024-09-12T00:54:48.621 INFO:tasks.workunit.client.0.smithi070.stderr: -258> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding con mode: secure 2024-09-12T00:54:48.621 INFO:tasks.workunit.client.0.smithi070.stderr: -257> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding con mode: crc 2024-09-12T00:54:48.621 INFO:tasks.workunit.client.0.smithi070.stderr: -256> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding con mode: crc 2024-09-12T00:54:48.621 INFO:tasks.workunit.client.0.smithi070.stderr: -255> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding con mode: secure 2024-09-12T00:54:48.621 INFO:tasks.workunit.client.0.smithi070.stderr: -254> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding con mode: crc 2024-09-12T00:54:48.621 INFO:tasks.workunit.client.0.smithi070.stderr: -253> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding con mode: secure 2024-09-12T00:54:48.621 INFO:tasks.workunit.client.0.smithi070.stderr: -252> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding con mode: crc 2024-09-12T00:54:48.621 INFO:tasks.workunit.client.0.smithi070.stderr: -251> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding con mode: secure 2024-09-12T00:54:48.622 INFO:tasks.workunit.client.0.smithi070.stderr: -250> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:48.622 INFO:tasks.workunit.client.0.smithi070.stderr: -249> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:48.622 INFO:tasks.workunit.client.0.smithi070.stderr: -248> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffead8348d8 EEXIST 2024-09-12T00:54:48.622 INFO:tasks.workunit.client.0.smithi070.stderr: -247> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:54:48.622 INFO:tasks.workunit.client.0.smithi070.stderr: -246> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:54:48.622 INFO:tasks.workunit.client.0.smithi070.stderr: -245> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): picked mon.noname-b con 0x5574ca076c00 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:54:48.622 INFO:tasks.workunit.client.0.smithi070.stderr: -244> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): picked mon.noname-a con 0x5574ca0a2460 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:54:48.622 INFO:tasks.workunit.client.0.smithi070.stderr: -243> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): picked mon.noname-c con 0x5574ca097be0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:54:48.622 INFO:tasks.workunit.client.0.smithi070.stderr: -242> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:48.622 INFO:tasks.workunit.client.0.smithi070.stderr: -241> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:48.622 INFO:tasks.workunit.client.0.smithi070.stderr: -240> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:48.622 INFO:tasks.workunit.client.0.smithi070.stderr: -239> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:54:48.623 INFO:tasks.workunit.client.0.smithi070.stderr: -238> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): authenticate will time out at 2138.969296s 2024-09-12T00:54:48.623 INFO:tasks.workunit.client.0.smithi070.stderr: -237> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient(hunting): get_auth_request con 0x5574ca0a2460 auth_method 0 2024-09-12T00:54:48.623 INFO:tasks.workunit.client.0.smithi070.stderr: -236> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:48.623 INFO:tasks.workunit.client.0.smithi070.stderr: -235> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:48.623 INFO:tasks.workunit.client.0.smithi070.stderr: -234> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:48.623 INFO:tasks.workunit.client.0.smithi070.stderr: -233> 2024-09-12T00:54:48.519+0000 7fa549836640 10 monclient(hunting): get_auth_request con 0x5574ca097be0 auth_method 0 2024-09-12T00:54:48.623 INFO:tasks.workunit.client.0.smithi070.stderr: -232> 2024-09-12T00:54:48.519+0000 7fa549836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:48.623 INFO:tasks.workunit.client.0.smithi070.stderr: -231> 2024-09-12T00:54:48.519+0000 7fa549836640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:48.623 INFO:tasks.workunit.client.0.smithi070.stderr: -230> 2024-09-12T00:54:48.519+0000 7fa549836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:48.623 INFO:tasks.workunit.client.0.smithi070.stderr: -229> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:48.623 INFO:tasks.workunit.client.0.smithi070.stderr: -228> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:48.623 INFO:tasks.workunit.client.0.smithi070.stderr: -227> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:48.623 INFO:tasks.workunit.client.0.smithi070.stderr: -226> 2024-09-12T00:54:48.519+0000 7fa549836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:48.624 INFO:tasks.workunit.client.0.smithi070.stderr: -225> 2024-09-12T00:54:48.519+0000 7fa549836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:48.624 INFO:tasks.workunit.client.0.smithi070.stderr: -224> 2024-09-12T00:54:48.519+0000 7fa549836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:48.624 INFO:tasks.workunit.client.0.smithi070.stderr: -223> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient(hunting): handle_auth_done global_id 6651 payload 274 2024-09-12T00:54:48.624 INFO:tasks.workunit.client.0.smithi070.stderr: -222> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient: _finish_hunting 0 2024-09-12T00:54:48.624 INFO:tasks.workunit.client.0.smithi070.stderr: -221> 2024-09-12T00:54:48.519+0000 7fa548834640 1 monclient: found mon.noname-a 2024-09-12T00:54:48.624 INFO:tasks.workunit.client.0.smithi070.stderr: -220> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:54:48.624 INFO:tasks.workunit.client.0.smithi070.stderr: -219> 2024-09-12T00:54:48.519+0000 7fa42cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:48.624 INFO:tasks.workunit.client.0.smithi070.stderr: -218> 2024-09-12T00:54:48.519+0000 7fa42cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:48.624 INFO:tasks.workunit.client.0.smithi070.stderr: -217> 2024-09-12T00:54:48.519+0000 7fa42cff9640 10 monclient: dump: 2024-09-12T00:54:48.624 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:48.624 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:48.625 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.625 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.625 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:48.625 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.625 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:48.625 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:48.625 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:48.625 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.625 INFO:tasks.workunit.client.0.smithi070.stderr: -216> 2024-09-12T00:54:48.519+0000 7fa42cff9640 10 monclient: _finish_auth 0 2024-09-12T00:54:48.625 INFO:tasks.workunit.client.0.smithi070.stderr: -215> 2024-09-12T00:54:48.519+0000 7fa42cff9640 10 monclient: _check_auth_tickets 2024-09-12T00:54:48.625 INFO:tasks.workunit.client.0.smithi070.stderr: -214> 2024-09-12T00:54:48.519+0000 7fa42cff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:48.625 INFO:tasks.workunit.client.0.smithi070.stderr: -213> 2024-09-12T00:54:48.519+0000 7fa42cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:48.626 INFO:tasks.workunit.client.0.smithi070.stderr: -212> 2024-09-12T00:54:48.519+0000 7fa42cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:48.626 INFO:tasks.workunit.client.0.smithi070.stderr: -211> 2024-09-12T00:54:48.519+0000 7fa42cff9640 10 monclient: dump: 2024-09-12T00:54:48.626 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:48.626 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:48.626 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.626 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.626 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:48.626 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.626 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:48.626 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:48.626 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:48.627 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.627 INFO:tasks.workunit.client.0.smithi070.stderr: -210> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 monclient: authenticate success, global_id 6651 2024-09-12T00:54:48.627 INFO:tasks.workunit.client.0.smithi070.stderr: -209> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:54:48.627 INFO:tasks.workunit.client.0.smithi070.stderr: -208> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 4 set_mon_vals no callback set 2024-09-12T00:54:48.627 INFO:tasks.workunit.client.0.smithi070.stderr: -207> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient: shutdown 2024-09-12T00:54:48.627 INFO:tasks.workunit.client.0.smithi070.stderr: -206> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient: build_initial_monmap 2024-09-12T00:54:48.627 INFO:tasks.workunit.client.0.smithi070.stderr: -205> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 1 build_initial for_mkfs: 0 2024-09-12T00:54:48.627 INFO:tasks.workunit.client.0.smithi070.stderr: -204> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient: monmap: 2024-09-12T00:54:48.627 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:54:48.627 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:48.627 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:54:48.628 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:54:48.628 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:48.628 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.628 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:54:48.628 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:54:48.628 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:54:48.628 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.628 INFO:tasks.workunit.client.0.smithi070.stderr: -203> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding auth protocol: cephx 2024-09-12T00:54:48.628 INFO:tasks.workunit.client.0.smithi070.stderr: -202> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding auth protocol: cephx 2024-09-12T00:54:48.628 INFO:tasks.workunit.client.0.smithi070.stderr: -201> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding auth protocol: cephx 2024-09-12T00:54:48.629 INFO:tasks.workunit.client.0.smithi070.stderr: -200> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding con mode: secure 2024-09-12T00:54:48.629 INFO:tasks.workunit.client.0.smithi070.stderr: -199> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding con mode: crc 2024-09-12T00:54:48.629 INFO:tasks.workunit.client.0.smithi070.stderr: -198> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding con mode: secure 2024-09-12T00:54:48.629 INFO:tasks.workunit.client.0.smithi070.stderr: -197> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding con mode: crc 2024-09-12T00:54:48.629 INFO:tasks.workunit.client.0.smithi070.stderr: -196> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding con mode: secure 2024-09-12T00:54:48.629 INFO:tasks.workunit.client.0.smithi070.stderr: -195> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding con mode: crc 2024-09-12T00:54:48.629 INFO:tasks.workunit.client.0.smithi070.stderr: -194> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding con mode: crc 2024-09-12T00:54:48.629 INFO:tasks.workunit.client.0.smithi070.stderr: -193> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding con mode: secure 2024-09-12T00:54:48.629 INFO:tasks.workunit.client.0.smithi070.stderr: -192> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding con mode: crc 2024-09-12T00:54:48.629 INFO:tasks.workunit.client.0.smithi070.stderr: -191> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding con mode: secure 2024-09-12T00:54:48.629 INFO:tasks.workunit.client.0.smithi070.stderr: -190> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding con mode: crc 2024-09-12T00:54:48.629 INFO:tasks.workunit.client.0.smithi070.stderr: -189> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding con mode: secure 2024-09-12T00:54:48.630 INFO:tasks.workunit.client.0.smithi070.stderr: -188> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:48.630 INFO:tasks.workunit.client.0.smithi070.stderr: -187> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 1 librados: starting msgr at 2024-09-12T00:54:48.630 INFO:tasks.workunit.client.0.smithi070.stderr: -186> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 1 librados: starting objecter 2024-09-12T00:54:48.630 INFO:tasks.workunit.client.0.smithi070.stderr: -185> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5574ca059210 EEXIST 2024-09-12T00:54:48.630 INFO:tasks.workunit.client.0.smithi070.stderr: -184> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 1 librados: setting wanted keys 2024-09-12T00:54:48.630 INFO:tasks.workunit.client.0.smithi070.stderr: -183> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 1 librados: calling monclient init 2024-09-12T00:54:48.630 INFO:tasks.workunit.client.0.smithi070.stderr: -182> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient: init 2024-09-12T00:54:48.630 INFO:tasks.workunit.client.0.smithi070.stderr: -181> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding auth protocol: cephx 2024-09-12T00:54:48.630 INFO:tasks.workunit.client.0.smithi070.stderr: -180> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding auth protocol: cephx 2024-09-12T00:54:48.630 INFO:tasks.workunit.client.0.smithi070.stderr: -179> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding auth protocol: cephx 2024-09-12T00:54:48.630 INFO:tasks.workunit.client.0.smithi070.stderr: -178> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding con mode: secure 2024-09-12T00:54:48.630 INFO:tasks.workunit.client.0.smithi070.stderr: -177> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding con mode: crc 2024-09-12T00:54:48.631 INFO:tasks.workunit.client.0.smithi070.stderr: -176> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding con mode: secure 2024-09-12T00:54:48.631 INFO:tasks.workunit.client.0.smithi070.stderr: -175> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding con mode: crc 2024-09-12T00:54:48.631 INFO:tasks.workunit.client.0.smithi070.stderr: -174> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding con mode: secure 2024-09-12T00:54:48.631 INFO:tasks.workunit.client.0.smithi070.stderr: -173> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding con mode: crc 2024-09-12T00:54:48.631 INFO:tasks.workunit.client.0.smithi070.stderr: -172> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding con mode: crc 2024-09-12T00:54:48.631 INFO:tasks.workunit.client.0.smithi070.stderr: -171> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding con mode: secure 2024-09-12T00:54:48.631 INFO:tasks.workunit.client.0.smithi070.stderr: -170> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding con mode: crc 2024-09-12T00:54:48.631 INFO:tasks.workunit.client.0.smithi070.stderr: -169> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding con mode: secure 2024-09-12T00:54:48.631 INFO:tasks.workunit.client.0.smithi070.stderr: -168> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding con mode: crc 2024-09-12T00:54:48.631 INFO:tasks.workunit.client.0.smithi070.stderr: -167> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding con mode: secure 2024-09-12T00:54:48.631 INFO:tasks.workunit.client.0.smithi070.stderr: -166> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:48.632 INFO:tasks.workunit.client.0.smithi070.stderr: -165> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:48.632 INFO:tasks.workunit.client.0.smithi070.stderr: -164> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command rotate-key cmddesc rotate-key hook 0x5574ca071f58 EEXIST 2024-09-12T00:54:48.632 INFO:tasks.workunit.client.0.smithi070.stderr: -163> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:54:48.632 INFO:tasks.workunit.client.0.smithi070.stderr: -162> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:54:48.632 INFO:tasks.workunit.client.0.smithi070.stderr: -161> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): picked mon.noname-b con 0x5574ca076c00 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:54:48.632 INFO:tasks.workunit.client.0.smithi070.stderr: -160> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): picked mon.noname-c con 0x5574ca097be0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:54:48.632 INFO:tasks.workunit.client.0.smithi070.stderr: -159> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): picked mon.noname-a con 0x5574ca0a2460 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:54:48.632 INFO:tasks.workunit.client.0.smithi070.stderr: -158> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:48.632 INFO:tasks.workunit.client.0.smithi070.stderr: -157> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:48.632 INFO:tasks.workunit.client.0.smithi070.stderr: -156> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:48.632 INFO:tasks.workunit.client.0.smithi070.stderr: -155> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:54:48.633 INFO:tasks.workunit.client.0.smithi070.stderr: -154> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): authenticate will time out at 2138.971822s 2024-09-12T00:54:48.633 INFO:tasks.workunit.client.0.smithi070.stderr: -153> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient(hunting): get_auth_request con 0x5574ca097be0 auth_method 0 2024-09-12T00:54:48.633 INFO:tasks.workunit.client.0.smithi070.stderr: -152> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:48.633 INFO:tasks.workunit.client.0.smithi070.stderr: -151> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:48.633 INFO:tasks.workunit.client.0.smithi070.stderr: -150> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:48.633 INFO:tasks.workunit.client.0.smithi070.stderr: -149> 2024-09-12T00:54:48.519+0000 7fa549836640 10 monclient(hunting): get_auth_request con 0x5574ca0a2460 auth_method 0 2024-09-12T00:54:48.633 INFO:tasks.workunit.client.0.smithi070.stderr: -148> 2024-09-12T00:54:48.519+0000 7fa549836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:48.633 INFO:tasks.workunit.client.0.smithi070.stderr: -147> 2024-09-12T00:54:48.519+0000 7fa549836640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:48.633 INFO:tasks.workunit.client.0.smithi070.stderr: -146> 2024-09-12T00:54:48.519+0000 7fa549836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:48.633 INFO:tasks.workunit.client.0.smithi070.stderr: -145> 2024-09-12T00:54:48.523+0000 7fa548834640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:48.633 INFO:tasks.workunit.client.0.smithi070.stderr: -144> 2024-09-12T00:54:48.523+0000 7fa548834640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:48.633 INFO:tasks.workunit.client.0.smithi070.stderr: -143> 2024-09-12T00:54:48.523+0000 7fa548834640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:48.634 INFO:tasks.workunit.client.0.smithi070.stderr: -142> 2024-09-12T00:54:48.523+0000 7fa549836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:48.634 INFO:tasks.workunit.client.0.smithi070.stderr: -141> 2024-09-12T00:54:48.523+0000 7fa549836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:48.634 INFO:tasks.workunit.client.0.smithi070.stderr: -140> 2024-09-12T00:54:48.523+0000 7fa549836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:48.634 INFO:tasks.workunit.client.0.smithi070.stderr: -139> 2024-09-12T00:54:48.523+0000 7fa549035640 10 monclient(hunting): get_auth_request con 0x5574ca076c00 auth_method 0 2024-09-12T00:54:48.634 INFO:tasks.workunit.client.0.smithi070.stderr: -138> 2024-09-12T00:54:48.523+0000 7fa549035640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:48.634 INFO:tasks.workunit.client.0.smithi070.stderr: -137> 2024-09-12T00:54:48.523+0000 7fa549035640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:48.634 INFO:tasks.workunit.client.0.smithi070.stderr: -136> 2024-09-12T00:54:48.523+0000 7fa549035640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:48.634 INFO:tasks.workunit.client.0.smithi070.stderr: -135> 2024-09-12T00:54:48.523+0000 7fa548834640 10 monclient(hunting): handle_auth_done global_id 6308 payload 824 2024-09-12T00:54:48.634 INFO:tasks.workunit.client.0.smithi070.stderr: -134> 2024-09-12T00:54:48.523+0000 7fa548834640 10 monclient: _finish_hunting 0 2024-09-12T00:54:48.634 INFO:tasks.workunit.client.0.smithi070.stderr: -133> 2024-09-12T00:54:48.523+0000 7fa548834640 1 monclient: found mon.noname-c 2024-09-12T00:54:48.635 INFO:tasks.workunit.client.0.smithi070.stderr: -132> 2024-09-12T00:54:48.523+0000 7fa548834640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:54:48.635 INFO:tasks.workunit.client.0.smithi070.stderr: -131> 2024-09-12T00:54:48.523+0000 7fa41affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:48.635 INFO:tasks.workunit.client.0.smithi070.stderr: -130> 2024-09-12T00:54:48.523+0000 7fa41affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:48.635 INFO:tasks.workunit.client.0.smithi070.stderr: -129> 2024-09-12T00:54:48.523+0000 7fa41affd640 10 monclient: dump: 2024-09-12T00:54:48.635 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:48.635 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:48.635 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.635 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.635 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:48.635 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.636 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:48.636 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:48.636 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:48.636 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.636 INFO:tasks.workunit.client.0.smithi070.stderr: -128> 2024-09-12T00:54:48.523+0000 7fa41affd640 10 monclient: _finish_auth 0 2024-09-12T00:54:48.636 INFO:tasks.workunit.client.0.smithi070.stderr: -127> 2024-09-12T00:54:48.523+0000 7fa41affd640 10 monclient: _check_auth_tickets 2024-09-12T00:54:48.636 INFO:tasks.workunit.client.0.smithi070.stderr: -126> 2024-09-12T00:54:48.523+0000 7fa54b52f9c0 5 monclient: authenticate success, global_id 6308 2024-09-12T00:54:48.636 INFO:tasks.workunit.client.0.smithi070.stderr: -125> 2024-09-12T00:54:48.523+0000 7fa54b52f9c0 10 monclient: _renew_subs 2024-09-12T00:54:48.636 INFO:tasks.workunit.client.0.smithi070.stderr: -124> 2024-09-12T00:54:48.523+0000 7fa54b52f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:54:48.636 INFO:tasks.workunit.client.0.smithi070.stderr: -123> 2024-09-12T00:54:48.523+0000 7fa41affd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:48.636 INFO:tasks.workunit.client.0.smithi070.stderr: -122> 2024-09-12T00:54:48.523+0000 7fa41affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:48.636 INFO:tasks.workunit.client.0.smithi070.stderr: -121> 2024-09-12T00:54:48.523+0000 7fa41affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:48.636 INFO:tasks.workunit.client.0.smithi070.stderr: -120> 2024-09-12T00:54:48.523+0000 7fa41affd640 10 monclient: dump: 2024-09-12T00:54:48.637 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:48.637 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:48.637 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.637 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.637 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:48.637 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.637 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:48.637 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:48.637 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:48.637 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.637 INFO:tasks.workunit.client.0.smithi070.stderr: -119> 2024-09-12T00:54:48.523+0000 7fa42cff9640 4 set_mon_vals no callback set 2024-09-12T00:54:48.637 INFO:tasks.workunit.client.0.smithi070.stderr: -118> 2024-09-12T00:54:48.523+0000 7fa54b52f9c0 10 monclient: _renew_subs 2024-09-12T00:54:48.637 INFO:tasks.workunit.client.0.smithi070.stderr: -117> 2024-09-12T00:54:48.523+0000 7fa54b52f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:54:48.637 INFO:tasks.workunit.client.0.smithi070.stderr: -116> 2024-09-12T00:54:48.523+0000 7fa54b52f9c0 1 librados: init done 2024-09-12T00:54:48.638 INFO:tasks.workunit.client.0.smithi070.stderr: -115> 2024-09-12T00:54:48.523+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command cr dump hook 0x5574ca0a0638 2024-09-12T00:54:48.638 INFO:tasks.workunit.client.0.smithi070.stderr: -114> 2024-09-12T00:54:48.523+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.638 INFO:tasks.workunit.client.0.smithi070.stderr: -113> 2024-09-12T00:54:48.523+0000 7fa41affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:48.638 INFO:tasks.workunit.client.0.smithi070.stderr: -112> 2024-09-12T00:54:48.523+0000 7fa41affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:54:48.638 INFO:tasks.workunit.client.0.smithi070.stderr: -111> 2024-09-12T00:54:48.523+0000 7fa41affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:54:48.638 INFO:tasks.workunit.client.0.smithi070.stderr: -110> 2024-09-12T00:54:48.523+0000 7fa549836640 10 monclient: get_auth_request con 0x5574ca0c0cf0 auth_method 0 2024-09-12T00:54:48.638 INFO:tasks.workunit.client.0.smithi070.stderr: -109> 2024-09-12T00:54:48.523+0000 7fa549035640 10 monclient: get_auth_request con 0x7fa414070ae0 auth_method 0 2024-09-12T00:54:48.638 INFO:tasks.workunit.client.0.smithi070.stderr: -108> 2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.638 INFO:tasks.workunit.client.0.smithi070.stderr: -107> 2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 realm 2024-09-12T00:54:48.638 INFO:tasks.workunit.client.0.smithi070.stderr: -106> 2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.638 INFO:tasks.workunit.client.0.smithi070.stderr: -105> 2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.638 INFO:tasks.workunit.client.0.smithi070.stderr: -104> 2024-09-12T00:54:48.527+0000 7fa54b52f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:48.638 INFO:tasks.workunit.client.0.smithi070.stderr: -103> 2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.639 INFO:tasks.workunit.client.0.smithi070.stderr: -102> 2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.639 INFO:tasks.workunit.client.0.smithi070.stderr: -101> 2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.639 INFO:tasks.workunit.client.0.smithi070.stderr: -100> 2024-09-12T00:54:48.527+0000 7fa549035640 10 monclient: get_auth_request con 0x5574ca0c50c0 auth_method 0 2024-09-12T00:54:48.639 INFO:tasks.workunit.client.0.smithi070.stderr: -99> 2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:48.639 INFO:tasks.workunit.client.0.smithi070.stderr: -98> 2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.639 INFO:tasks.workunit.client.0.smithi070.stderr: -97> 2024-09-12T00:54:48.527+0000 7fa548834640 10 monclient: get_auth_request con 0x5574ca0c8820 auth_method 0 2024-09-12T00:54:48.639 INFO:tasks.workunit.client.0.smithi070.stderr: -96> 2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:48.639 INFO:tasks.workunit.client.0.smithi070.stderr: -95> 2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 searching for the correct realm 2024-09-12T00:54:48.639 INFO:tasks.workunit.client.0.smithi070.stderr: -94> 2024-09-12T00:54:48.527+0000 7fa549836640 10 monclient: get_auth_request con 0x5574ca0cd580 auth_method 0 2024-09-12T00:54:48.639 INFO:tasks.workunit.client.0.smithi070.stderr: -93> 2024-09-12T00:54:48.531+0000 7fa549035640 10 monclient: get_auth_request con 0x7fa544011040 auth_method 0 2024-09-12T00:54:48.639 INFO:tasks.workunit.client.0.smithi070.stderr: -92> 2024-09-12T00:54:48.531+0000 7fa548834640 10 monclient: get_auth_request con 0x7fa53c102040 auth_method 0 2024-09-12T00:54:48.639 INFO:tasks.workunit.client.0.smithi070.stderr: -91> 2024-09-12T00:54:48.531+0000 7fa549836640 10 monclient: get_auth_request con 0x7fa540079fe0 auth_method 0 2024-09-12T00:54:48.639 INFO:tasks.workunit.client.0.smithi070.stderr: -90> 2024-09-12T00:54:48.535+0000 7fa549836640 0 -- 172.21.15.70:0/629985701 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fa540079fe0 msgr2=0x7fa540067410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:48.639 INFO:tasks.workunit.client.0.smithi070.stderr: -89> 2024-09-12T00:54:48.535+0000 7fa41affd640 1 client.6308.objecter ms_handle_reset 0x7fa540079fe0 session 0x7fa540063830 osd.4 2024-09-12T00:54:48.640 INFO:tasks.workunit.client.0.smithi070.stderr: -88> 2024-09-12T00:54:48.535+0000 7fa41affd640 10 monclient: _renew_subs 2024-09-12T00:54:48.640 INFO:tasks.workunit.client.0.smithi070.stderr: -87> 2024-09-12T00:54:48.535+0000 7fa41affd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:54:48.640 INFO:tasks.workunit.client.0.smithi070.stderr: -86> 2024-09-12T00:54:48.535+0000 7fa549836640 10 monclient: get_auth_request con 0x7fa414080800 auth_method 0 2024-09-12T00:54:48.640 INFO:tasks.workunit.client.0.smithi070.stderr: -85> 2024-09-12T00:54:48.535+0000 7fa549035640 10 monclient: get_auth_request con 0x7fa544020440 auth_method 0 2024-09-12T00:54:48.640 INFO:tasks.workunit.client.0.smithi070.stderr: -84> 2024-09-12T00:54:48.543+0000 7fa549035640 0 -- 172.21.15.70:0/629985701 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7fa544020440 msgr2=0x7fa5440208c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:48.640 INFO:tasks.workunit.client.0.smithi070.stderr: -83> 2024-09-12T00:54:48.543+0000 7fa41affd640 1 client.6308.objecter ms_handle_reset 0x7fa544020440 session 0x7fa544011980 osd.6 2024-09-12T00:54:48.640 INFO:tasks.workunit.client.0.smithi070.stderr: -82> 2024-09-12T00:54:48.543+0000 7fa549035640 10 monclient: get_auth_request con 0x7fa4140835a0 auth_method 0 2024-09-12T00:54:48.640 INFO:tasks.workunit.client.0.smithi070.stderr: -81> 2024-09-12T00:54:48.547+0000 7fa54b52f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:48.640 INFO:tasks.workunit.client.0.smithi070.stderr: -80> 2024-09-12T00:54:48.547+0000 7fa54b52f9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:48.640 INFO:tasks.workunit.client.0.smithi070.stderr: -79> 2024-09-12T00:54:48.547+0000 7fa54b52f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:48.640 INFO:tasks.workunit.client.0.smithi070.stderr: -78> 2024-09-12T00:54:48.547+0000 7fa54b52f9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:48.640 INFO:tasks.workunit.client.0.smithi070.stderr: -77> 2024-09-12T00:54:48.547+0000 7fa54b52f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:48.640 INFO:tasks.workunit.client.0.smithi070.stderr: -76> 2024-09-12T00:54:48.547+0000 7fa54b52f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:48.640 INFO:tasks.workunit.client.0.smithi070.stderr: -75> 2024-09-12T00:54:48.547+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.641 INFO:tasks.workunit.client.0.smithi070.stderr: -74> 2024-09-12T00:54:48.547+0000 7fa54b52f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.641 INFO:tasks.workunit.client.0.smithi070.stderr: -73> 2024-09-12T00:54:48.547+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.641 INFO:tasks.workunit.client.0.smithi070.stderr: -72> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:48.641 INFO:tasks.workunit.client.0.smithi070.stderr: -71> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.641 INFO:tasks.workunit.client.0.smithi070.stderr: -70> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:48.641 INFO:tasks.workunit.client.0.smithi070.stderr: -69> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 zone default found 2024-09-12T00:54:48.641 INFO:tasks.workunit.client.0.smithi070.stderr: -68> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 4 Realm: () 2024-09-12T00:54:48.641 INFO:tasks.workunit.client.0.smithi070.stderr: -67> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:48.641 INFO:tasks.workunit.client.0.smithi070.stderr: -66> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:48.641 INFO:tasks.workunit.client.0.smithi070.stderr: -65> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:48.641 INFO:tasks.workunit.client.0.smithi070.stderr: -64> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 zonegroup default 2024-09-12T00:54:48.641 INFO:tasks.workunit.client.0.smithi070.stderr: -63> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.641 INFO:tasks.workunit.client.0.smithi070.stderr: -62> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.642 INFO:tasks.workunit.client.0.smithi070.stderr: -61> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.642 INFO:tasks.workunit.client.0.smithi070.stderr: -60> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.642 INFO:tasks.workunit.client.0.smithi070.stderr: -59> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.642 INFO:tasks.workunit.client.0.smithi070.stderr: -58> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.642 INFO:tasks.workunit.client.0.smithi070.stderr: -57> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 started sync module instance, tier type = 2024-09-12T00:54:48.642 INFO:tasks.workunit.client.0.smithi070.stderr: -56> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:48.642 INFO:tasks.workunit.client.0.smithi070.stderr: -55> 2024-09-12T00:54:48.567+0000 7fa54b52f9c0 20 add_watcher() i=0 2024-09-12T00:54:48.642 INFO:tasks.workunit.client.0.smithi070.stderr: -54> 2024-09-12T00:54:48.567+0000 7fa54b52f9c0 20 add_watcher() i=1 2024-09-12T00:54:48.642 INFO:tasks.workunit.client.0.smithi070.stderr: -53> 2024-09-12T00:54:48.567+0000 7fa54b52f9c0 20 add_watcher() i=2 2024-09-12T00:54:48.642 INFO:tasks.workunit.client.0.smithi070.stderr: -52> 2024-09-12T00:54:48.567+0000 7fa54b52f9c0 20 add_watcher() i=3 2024-09-12T00:54:48.642 INFO:tasks.workunit.client.0.smithi070.stderr: -51> 2024-09-12T00:54:48.567+0000 7fa54b52f9c0 20 add_watcher() i=4 2024-09-12T00:54:48.642 INFO:tasks.workunit.client.0.smithi070.stderr: -50> 2024-09-12T00:54:48.567+0000 7fa54b52f9c0 20 add_watcher() i=5 2024-09-12T00:54:48.642 INFO:tasks.workunit.client.0.smithi070.stderr: -49> 2024-09-12T00:54:48.567+0000 7fa54b52f9c0 20 add_watcher() i=6 2024-09-12T00:54:48.643 INFO:tasks.workunit.client.0.smithi070.stderr: -48> 2024-09-12T00:54:48.567+0000 7fa54b52f9c0 20 add_watcher() i=7 2024-09-12T00:54:48.643 INFO:tasks.workunit.client.0.smithi070.stderr: -47> 2024-09-12T00:54:48.567+0000 7fa54b52f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:48.643 INFO:tasks.workunit.client.0.smithi070.stderr: -46> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding auth protocol: cephx 2024-09-12T00:54:48.643 INFO:tasks.workunit.client.0.smithi070.stderr: -45> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding auth protocol: cephx 2024-09-12T00:54:48.643 INFO:tasks.workunit.client.0.smithi070.stderr: -44> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding auth protocol: cephx 2024-09-12T00:54:48.643 INFO:tasks.workunit.client.0.smithi070.stderr: -43> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding con mode: secure 2024-09-12T00:54:48.643 INFO:tasks.workunit.client.0.smithi070.stderr: -42> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding con mode: crc 2024-09-12T00:54:48.643 INFO:tasks.workunit.client.0.smithi070.stderr: -41> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding con mode: secure 2024-09-12T00:54:48.643 INFO:tasks.workunit.client.0.smithi070.stderr: -40> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding con mode: crc 2024-09-12T00:54:48.643 INFO:tasks.workunit.client.0.smithi070.stderr: -39> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding con mode: secure 2024-09-12T00:54:48.643 INFO:tasks.workunit.client.0.smithi070.stderr: -38> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding con mode: crc 2024-09-12T00:54:48.643 INFO:tasks.workunit.client.0.smithi070.stderr: -37> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding con mode: crc 2024-09-12T00:54:48.643 INFO:tasks.workunit.client.0.smithi070.stderr: -36> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding con mode: secure 2024-09-12T00:54:48.643 INFO:tasks.workunit.client.0.smithi070.stderr: -35> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding con mode: crc 2024-09-12T00:54:48.644 INFO:tasks.workunit.client.0.smithi070.stderr: -34> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding con mode: secure 2024-09-12T00:54:48.644 INFO:tasks.workunit.client.0.smithi070.stderr: -33> 2024-09-12T00:54:48.571+0000 7fa3ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:48.644 INFO:tasks.workunit.client.0.smithi070.stderr: -32> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding con mode: crc 2024-09-12T00:54:48.644 INFO:tasks.workunit.client.0.smithi070.stderr: -31> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding con mode: secure 2024-09-12T00:54:48.644 INFO:tasks.workunit.client.0.smithi070.stderr: -30> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:48.644 INFO:tasks.workunit.client.0.smithi070.stderr: -29> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:48.644 INFO:tasks.workunit.client.0.smithi070.stderr: -28> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:48.644 INFO:tasks.workunit.client.0.smithi070.stderr: -27> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command cache list hook 0x5574ca09fc30 2024-09-12T00:54:48.644 INFO:tasks.workunit.client.0.smithi070.stderr: -26> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command cache inspect hook 0x5574ca09fc30 2024-09-12T00:54:48.644 INFO:tasks.workunit.client.0.smithi070.stderr: -25> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command cache erase hook 0x5574ca09fc30 2024-09-12T00:54:48.644 INFO:tasks.workunit.client.0.smithi070.stderr: -24> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command cache zap hook 0x5574ca09fc30 2024-09-12T00:54:48.644 INFO:tasks.workunit.client.0.smithi070.stderr: -23> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 note: GC not initialized 2024-09-12T00:54:48.645 INFO:tasks.workunit.client.0.smithi070.stderr: -22> 2024-09-12T00:54:48.571+0000 7fa3fe7e4640 20 reqs_thread_entry: start 2024-09-12T00:54:48.645 INFO:tasks.workunit.client.0.smithi070.stderr: -21> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command sync trace show hook 0x7fa540001290 2024-09-12T00:54:48.645 INFO:tasks.workunit.client.0.smithi070.stderr: -20> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command sync trace history hook 0x7fa540001290 2024-09-12T00:54:48.645 INFO:tasks.workunit.client.0.smithi070.stderr: -19> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command sync trace active hook 0x7fa540001290 2024-09-12T00:54:48.645 INFO:tasks.workunit.client.0.smithi070.stderr: -18> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command sync trace active_short hook 0x7fa540001290 2024-09-12T00:54:48.645 INFO:tasks.workunit.client.0.smithi070.stderr: -17> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:48.645 INFO:tasks.workunit.client.0.smithi070.stderr: -16> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 20 Filter name: none 2024-09-12T00:54:48.645 INFO:tasks.workunit.client.0.smithi070.stderr: -15> 2024-09-12T00:54:48.571+0000 7fa36ffff640 20 reqs_thread_entry: start 2024-09-12T00:54:48.645 INFO:tasks.workunit.client.0.smithi070.stderr: -14> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:54:48.645 INFO:tasks.workunit.client.0.smithi070.stderr: -13> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.645 INFO:tasks.workunit.client.0.smithi070.stderr: -12> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:54:48.646 INFO:tasks.workunit.client.0.smithi070.stderr: -11> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:54:48.646 INFO:tasks.workunit.client.0.smithi070.stderr: -10> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:54:48.646 INFO:tasks.workunit.client.0.smithi070.stderr: -9> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 : miss 2024-09-12T00:54:48.646 INFO:tasks.workunit.client.0.smithi070.stderr: -8> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.646 INFO:tasks.workunit.client.0.smithi070.stderr: -7> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:54:48.646 INFO:tasks.workunit.client.0.smithi070.stderr: -6> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 info.flags=0x17 2024-09-12T00:54:48.646 INFO:tasks.workunit.client.0.smithi070.stderr: -5> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 to cache LRU end 2024-09-12T00:54:48.646 INFO:tasks.workunit.client.0.smithi070.stderr: -4> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:48.646 INFO:tasks.workunit.client.0.smithi070.stderr: -3> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:48.646 INFO:tasks.workunit.client.0.smithi070.stderr: -2> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 2024-09-12T00:54:48.646 INFO:tasks.workunit.client.0.smithi070.stderr: -1> 2024-09-12T00:54:48.579+0000 7fa54b52f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa54b52f9c0 time 2024-09-12T00:54:48.582534+0000 2024-09-12T00:54:48.646 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:48.647 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.647 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:48.647 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa54ee092eb] 2024-09-12T00:54:48.647 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa54ee0949f] 2024-09-12T00:54:48.647 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5574c8bf8cc1] 2024-09-12T00:54:48.647 INFO:tasks.workunit.client.0.smithi070.stderr: 4: radosgw-admin(+0x1422078) [0x5574c9656078] 2024-09-12T00:54:48.647 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5574c8c0dced] 2024-09-12T00:54:48.647 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:54:48.647 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa54dc6fd90] 2024-09-12T00:54:48.647 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:54:48.647 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:54:48.647 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.647 INFO:tasks.workunit.client.0.smithi070.stderr: 0> 2024-09-12T00:54:48.579+0000 7fa54b52f9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:54:48.647 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7fa54b52f9c0 thread_name:radosgw-admin 2024-09-12T00:54:48.648 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.648 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:48.648 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa54dc88520] 2024-09-12T00:54:48.648 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:54:48.648 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:54:48.648 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:54:48.648 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa54ee09345] 2024-09-12T00:54:48.648 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa54ee0949f] 2024-09-12T00:54:48.648 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5574c8bf8cc1] 2024-09-12T00:54:48.648 INFO:tasks.workunit.client.0.smithi070.stderr: 8: radosgw-admin(+0x1422078) [0x5574c9656078] 2024-09-12T00:54:48.648 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5574c8c0dced] 2024-09-12T00:54:48.648 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:54:48.648 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa54dc6fd90] 2024-09-12T00:54:48.648 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:54:48.648 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:54:48.649 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:54:48.649 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.649 INFO:tasks.workunit.client.0.smithi070.stderr:--- logging levels --- 2024-09-12T00:54:48.649 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 none 2024-09-12T00:54:48.649 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 lockdep 2024-09-12T00:54:48.649 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 context 2024-09-12T00:54:48.649 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 crush 2024-09-12T00:54:48.649 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds 2024-09-12T00:54:48.649 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_balancer 2024-09-12T00:54:48.649 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_locker 2024-09-12T00:54:48.649 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log 2024-09-12T00:54:48.649 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log_expire 2024-09-12T00:54:48.649 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_migrator 2024-09-12T00:54:48.650 INFO:tasks.workunit.client.0.smithi070.stderr: 3/ 5 mds_quiesce 2024-09-12T00:54:48.650 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 buffer 2024-09-12T00:54:48.650 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 timer 2024-09-12T00:54:48.650 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 filer 2024-09-12T00:54:48.650 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 striper 2024-09-12T00:54:48.650 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 objecter 2024-09-12T00:54:48.650 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rados 2024-09-12T00:54:48.650 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd 2024-09-12T00:54:48.650 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_mirror 2024-09-12T00:54:48.650 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_replay 2024-09-12T00:54:48.650 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_pwl 2024-09-12T00:54:48.650 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 journaler 2024-09-12T00:54:48.650 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objectcacher 2024-09-12T00:54:48.650 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:54:48.651 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 client 2024-09-12T00:54:48.651 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 osd 2024-09-12T00:54:48.651 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 optracker 2024-09-12T00:54:48.651 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objclass 2024-09-12T00:54:48.651 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 filestore 2024-09-12T00:54:48.651 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 journal 2024-09-12T00:54:48.651 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 ms 2024-09-12T00:54:48.651 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mon 2024-09-12T00:54:48.651 INFO:tasks.workunit.client.0.smithi070.stderr: 0/10 monc 2024-09-12T00:54:48.651 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 paxos 2024-09-12T00:54:48.651 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 tp 2024-09-12T00:54:48.651 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 auth 2024-09-12T00:54:48.651 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 crypto 2024-09-12T00:54:48.651 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 finisher 2024-09-12T00:54:48.652 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 reserver 2024-09-12T00:54:48.652 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 heartbeatmap 2024-09-12T00:54:48.652 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 perfcounter 2024-09-12T00:54:48.652 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw 2024-09-12T00:54:48.652 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_sync 2024-09-12T00:54:48.652 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_datacache 2024-09-12T00:54:48.652 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_access 2024-09-12T00:54:48.652 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:54:48.652 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_flight 2024-09-12T00:54:48.652 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:54:48.653 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw_notification 2024-09-12T00:54:48.653 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 javaclient 2024-09-12T00:54:48.653 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 asok 2024-09-12T00:54:48.653 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 throttle 2024-09-12T00:54:48.654 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 refs 2024-09-12T00:54:48.654 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 compressor 2024-09-12T00:54:48.654 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluestore 2024-09-12T00:54:48.654 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluefs 2024-09-12T00:54:48.654 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 bdev 2024-09-12T00:54:48.654 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 kstore 2024-09-12T00:54:48.654 INFO:tasks.workunit.client.0.smithi070.stderr: 4/ 5 rocksdb 2024-09-12T00:54:48.654 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 fuse 2024-09-12T00:54:48.654 INFO:tasks.workunit.client.0.smithi070.stderr: 2/ 5 mgr 2024-09-12T00:54:48.654 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mgrc 2024-09-12T00:54:48.654 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 dpdk 2024-09-12T00:54:48.655 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 eventtrace 2024-09-12T00:54:48.655 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 prioritycache 2024-09-12T00:54:48.655 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 test 2024-09-12T00:54:48.655 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:54:48.655 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephsqlite 2024-09-12T00:54:48.655 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:54:48.655 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore 2024-09-12T00:54:48.655 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_onode 2024-09-12T00:54:48.655 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_odata 2024-09-12T00:54:48.655 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_omap 2024-09-12T00:54:48.655 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_tm 2024-09-12T00:54:48.655 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_t 2024-09-12T00:54:48.655 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:54:48.655 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_epm 2024-09-12T00:54:48.656 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_lba 2024-09-12T00:54:48.656 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:54:48.656 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cache 2024-09-12T00:54:48.656 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_journal 2024-09-12T00:54:48.656 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_device 2024-09-12T00:54:48.656 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_backref 2024-09-12T00:54:48.656 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 alienstore 2024-09-12T00:54:48.656 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mclock 2024-09-12T00:54:48.656 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cyanstore 2024-09-12T00:54:48.657 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 ceph_exporter 2024-09-12T00:54:48.657 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 memstore 2024-09-12T00:54:48.657 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 trace 2024-09-12T00:54:48.657 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 ceph_dedup 2024-09-12T00:54:48.657 INFO:tasks.workunit.client.0.smithi070.stderr: -2/-2 (syslog threshold) 2024-09-12T00:54:48.657 INFO:tasks.workunit.client.0.smithi070.stderr: 99/99 (stderr threshold) 2024-09-12T00:54:48.657 INFO:tasks.workunit.client.0.smithi070.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:54:48.657 INFO:tasks.workunit.client.0.smithi070.stderr: 7fa36ffff640 / http_manager 2024-09-12T00:54:48.657 INFO:tasks.workunit.client.0.smithi070.stderr: 7fa3fe7e4640 / http_manager 2024-09-12T00:54:48.657 INFO:tasks.workunit.client.0.smithi070.stderr: 7fa3ff7e6640 / rgw_dt_lg_renew 2024-09-12T00:54:48.658 INFO:tasks.workunit.client.0.smithi070.stderr: 7fa41affd640 / ms_dispatch 2024-09-12T00:54:48.658 INFO:tasks.workunit.client.0.smithi070.stderr: 7fa42cff9640 / io_context_pool 2024-09-12T00:54:48.658 INFO:tasks.workunit.client.0.smithi070.stderr: 7fa42effd640 / ms_dispatch 2024-09-12T00:54:48.658 INFO:tasks.workunit.client.0.smithi070.stderr: 7fa435e03640 / ms_dispatch 2024-09-12T00:54:48.658 INFO:tasks.workunit.client.0.smithi070.stderr: 7fa437606640 / io_context_pool 2024-09-12T00:54:48.658 INFO:tasks.workunit.client.0.smithi070.stderr: 7fa548834640 / msgr-worker-2 2024-09-12T00:54:48.658 INFO:tasks.workunit.client.0.smithi070.stderr: 7fa549035640 / msgr-worker-1 2024-09-12T00:54:48.658 INFO:tasks.workunit.client.0.smithi070.stderr: 7fa549836640 / msgr-worker-0 2024-09-12T00:54:48.658 INFO:tasks.workunit.client.0.smithi070.stderr: 7fa54a037640 / io_context_pool 2024-09-12T00:54:48.658 INFO:tasks.workunit.client.0.smithi070.stderr: 7fa54b52f9c0 / radosgw-admin 2024-09-12T00:54:48.658 INFO:tasks.workunit.client.0.smithi070.stderr: max_recent 500 2024-09-12T00:54:48.658 INFO:tasks.workunit.client.0.smithi070.stderr: max_new 1000 2024-09-12T00:54:48.659 INFO:tasks.workunit.client.0.smithi070.stderr: log_file /var/log/ceph/ceph-client.admin.91391.log 2024-09-12T00:54:48.659 INFO:tasks.workunit.client.0.smithi070.stderr:--- end dump of recent events --- 2024-09-12T00:54:48.659 INFO:tasks.workunit.client.0.smithi070.stderr:--- begin dump of recent events --- 2024-09-12T00:54:48.659 INFO:tasks.workunit.client.0.smithi070.stderr: -499> 2024-09-12T00:54:48.503+0000 7fa549836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:48.659 INFO:tasks.workunit.client.0.smithi070.stderr: -498> 2024-09-12T00:54:48.503+0000 7fa549035640 10 monclient(hunting): get_auth_request con 0x5574c9e96230 auth_method 0 2024-09-12T00:54:48.659 INFO:tasks.workunit.client.0.smithi070.stderr: -497> 2024-09-12T00:54:48.503+0000 7fa549035640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:48.659 INFO:tasks.workunit.client.0.smithi070.stderr: -496> 2024-09-12T00:54:48.503+0000 7fa549035640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:48.659 INFO:tasks.workunit.client.0.smithi070.stderr: -495> 2024-09-12T00:54:48.503+0000 7fa549035640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:48.659 INFO:tasks.workunit.client.0.smithi070.stderr: -494> 2024-09-12T00:54:48.503+0000 7fa549836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:48.659 INFO:tasks.workunit.client.0.smithi070.stderr: -493> 2024-09-12T00:54:48.503+0000 7fa549836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:48.659 INFO:tasks.workunit.client.0.smithi070.stderr: -492> 2024-09-12T00:54:48.503+0000 7fa549836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:48.659 INFO:tasks.workunit.client.0.smithi070.stderr: -491> 2024-09-12T00:54:48.503+0000 7fa549035640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:48.660 INFO:tasks.workunit.client.0.smithi070.stderr: -490> 2024-09-12T00:54:48.503+0000 7fa549035640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:48.660 INFO:tasks.workunit.client.0.smithi070.stderr: -489> 2024-09-12T00:54:48.503+0000 7fa549035640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:48.660 INFO:tasks.workunit.client.0.smithi070.stderr: -488> 2024-09-12T00:54:48.503+0000 7fa549035640 10 monclient(hunting): handle_auth_done global_id 6296 payload 274 2024-09-12T00:54:48.660 INFO:tasks.workunit.client.0.smithi070.stderr: -487> 2024-09-12T00:54:48.503+0000 7fa549035640 10 monclient: _finish_hunting 0 2024-09-12T00:54:48.660 INFO:tasks.workunit.client.0.smithi070.stderr: -486> 2024-09-12T00:54:48.503+0000 7fa549035640 1 monclient: found mon.noname-c 2024-09-12T00:54:48.660 INFO:tasks.workunit.client.0.smithi070.stderr: -485> 2024-09-12T00:54:48.503+0000 7fa549035640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:54:48.660 INFO:tasks.workunit.client.0.smithi070.stderr: -484> 2024-09-12T00:54:48.503+0000 7fa437606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:48.660 INFO:tasks.workunit.client.0.smithi070.stderr: -483> 2024-09-12T00:54:48.503+0000 7fa437606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:48.660 INFO:tasks.workunit.client.0.smithi070.stderr: -482> 2024-09-12T00:54:48.503+0000 7fa437606640 10 monclient: dump: 2024-09-12T00:54:48.660 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:48.660 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:48.660 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.660 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.661 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:48.661 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.661 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:48.661 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:48.661 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:48.661 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.661 INFO:tasks.workunit.client.0.smithi070.stderr: -481> 2024-09-12T00:54:48.503+0000 7fa437606640 10 monclient: _finish_auth 0 2024-09-12T00:54:48.661 INFO:tasks.workunit.client.0.smithi070.stderr: -480> 2024-09-12T00:54:48.503+0000 7fa437606640 10 monclient: _check_auth_tickets 2024-09-12T00:54:48.661 INFO:tasks.workunit.client.0.smithi070.stderr: -479> 2024-09-12T00:54:48.503+0000 7fa437606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:48.661 INFO:tasks.workunit.client.0.smithi070.stderr: -478> 2024-09-12T00:54:48.503+0000 7fa437606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:48.661 INFO:tasks.workunit.client.0.smithi070.stderr: -477> 2024-09-12T00:54:48.503+0000 7fa437606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:48.661 INFO:tasks.workunit.client.0.smithi070.stderr: -476> 2024-09-12T00:54:48.503+0000 7fa437606640 10 monclient: dump: 2024-09-12T00:54:48.661 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:48.662 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:48.662 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.662 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.662 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:48.662 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.662 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:48.662 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:48.662 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:48.662 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.662 INFO:tasks.workunit.client.0.smithi070.stderr: -475> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 monclient: authenticate success, global_id 6296 2024-09-12T00:54:48.662 INFO:tasks.workunit.client.0.smithi070.stderr: -474> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:54:48.662 INFO:tasks.workunit.client.0.smithi070.stderr: -473> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 4 set_mon_vals no callback set 2024-09-12T00:54:48.662 INFO:tasks.workunit.client.0.smithi070.stderr: -472> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient: shutdown 2024-09-12T00:54:48.662 INFO:tasks.workunit.client.0.smithi070.stderr: -471> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) unregister_commands rotate-key 2024-09-12T00:54:48.663 INFO:tasks.workunit.client.0.smithi070.stderr: -470> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient: build_initial_monmap 2024-09-12T00:54:48.663 INFO:tasks.workunit.client.0.smithi070.stderr: -469> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 1 build_initial for_mkfs: 0 2024-09-12T00:54:48.663 INFO:tasks.workunit.client.0.smithi070.stderr: -468> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient: monmap: 2024-09-12T00:54:48.663 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:54:48.663 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:48.663 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:54:48.663 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:54:48.663 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:48.663 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.663 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:54:48.663 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:54:48.663 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:54:48.663 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.664 INFO:tasks.workunit.client.0.smithi070.stderr: -467> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding auth protocol: cephx 2024-09-12T00:54:48.664 INFO:tasks.workunit.client.0.smithi070.stderr: -466> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding auth protocol: cephx 2024-09-12T00:54:48.664 INFO:tasks.workunit.client.0.smithi070.stderr: -465> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding auth protocol: cephx 2024-09-12T00:54:48.664 INFO:tasks.workunit.client.0.smithi070.stderr: -464> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding con mode: secure 2024-09-12T00:54:48.664 INFO:tasks.workunit.client.0.smithi070.stderr: -463> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding con mode: crc 2024-09-12T00:54:48.664 INFO:tasks.workunit.client.0.smithi070.stderr: -462> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding con mode: secure 2024-09-12T00:54:48.664 INFO:tasks.workunit.client.0.smithi070.stderr: -461> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding con mode: crc 2024-09-12T00:54:48.664 INFO:tasks.workunit.client.0.smithi070.stderr: -460> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding con mode: secure 2024-09-12T00:54:48.664 INFO:tasks.workunit.client.0.smithi070.stderr: -459> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding con mode: crc 2024-09-12T00:54:48.664 INFO:tasks.workunit.client.0.smithi070.stderr: -458> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding con mode: crc 2024-09-12T00:54:48.664 INFO:tasks.workunit.client.0.smithi070.stderr: -457> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding con mode: secure 2024-09-12T00:54:48.664 INFO:tasks.workunit.client.0.smithi070.stderr: -456> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding con mode: crc 2024-09-12T00:54:48.664 INFO:tasks.workunit.client.0.smithi070.stderr: -455> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding con mode: secure 2024-09-12T00:54:48.664 INFO:tasks.workunit.client.0.smithi070.stderr: -454> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding con mode: crc 2024-09-12T00:54:48.665 INFO:tasks.workunit.client.0.smithi070.stderr: -453> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fdd020) adding con mode: secure 2024-09-12T00:54:48.665 INFO:tasks.workunit.client.0.smithi070.stderr: -452> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:48.665 INFO:tasks.workunit.client.0.smithi070.stderr: -451> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 1 librados: starting msgr at 2024-09-12T00:54:48.665 INFO:tasks.workunit.client.0.smithi070.stderr: -450> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 1 librados: starting objecter 2024-09-12T00:54:48.665 INFO:tasks.workunit.client.0.smithi070.stderr: -449> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command objecter_requests hook 0x5574c9d44bd0 2024-09-12T00:54:48.665 INFO:tasks.workunit.client.0.smithi070.stderr: -448> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 1 librados: setting wanted keys 2024-09-12T00:54:48.665 INFO:tasks.workunit.client.0.smithi070.stderr: -447> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 1 librados: calling monclient init 2024-09-12T00:54:48.665 INFO:tasks.workunit.client.0.smithi070.stderr: -446> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient: init 2024-09-12T00:54:48.665 INFO:tasks.workunit.client.0.smithi070.stderr: -445> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding auth protocol: cephx 2024-09-12T00:54:48.665 INFO:tasks.workunit.client.0.smithi070.stderr: -444> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding auth protocol: cephx 2024-09-12T00:54:48.665 INFO:tasks.workunit.client.0.smithi070.stderr: -443> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding auth protocol: cephx 2024-09-12T00:54:48.665 INFO:tasks.workunit.client.0.smithi070.stderr: -442> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding con mode: secure 2024-09-12T00:54:48.665 INFO:tasks.workunit.client.0.smithi070.stderr: -441> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding con mode: crc 2024-09-12T00:54:48.666 INFO:tasks.workunit.client.0.smithi070.stderr: -440> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding con mode: secure 2024-09-12T00:54:48.666 INFO:tasks.workunit.client.0.smithi070.stderr: -439> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding con mode: crc 2024-09-12T00:54:48.666 INFO:tasks.workunit.client.0.smithi070.stderr: -438> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding con mode: secure 2024-09-12T00:54:48.666 INFO:tasks.workunit.client.0.smithi070.stderr: -437> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding con mode: crc 2024-09-12T00:54:48.666 INFO:tasks.workunit.client.0.smithi070.stderr: -436> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding con mode: crc 2024-09-12T00:54:48.666 INFO:tasks.workunit.client.0.smithi070.stderr: -435> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding con mode: secure 2024-09-12T00:54:48.666 INFO:tasks.workunit.client.0.smithi070.stderr: -434> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding con mode: crc 2024-09-12T00:54:48.666 INFO:tasks.workunit.client.0.smithi070.stderr: -433> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding con mode: secure 2024-09-12T00:54:48.666 INFO:tasks.workunit.client.0.smithi070.stderr: -432> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding con mode: crc 2024-09-12T00:54:48.666 INFO:tasks.workunit.client.0.smithi070.stderr: -431> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 AuthRegistry(0x5574c9fd7cd0) adding con mode: secure 2024-09-12T00:54:48.666 INFO:tasks.workunit.client.0.smithi070.stderr: -430> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:48.667 INFO:tasks.workunit.client.0.smithi070.stderr: -429> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:48.667 INFO:tasks.workunit.client.0.smithi070.stderr: -428> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command rotate-key hook 0x5574c9fd7e18 2024-09-12T00:54:48.667 INFO:tasks.workunit.client.0.smithi070.stderr: -427> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:54:48.667 INFO:tasks.workunit.client.0.smithi070.stderr: -426> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:54:48.667 INFO:tasks.workunit.client.0.smithi070.stderr: -425> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient(hunting): picked mon.noname-c con 0x5574c9e96230 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:54:48.667 INFO:tasks.workunit.client.0.smithi070.stderr: -424> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient(hunting): picked mon.noname-a con 0x5574c9f23970 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:54:48.667 INFO:tasks.workunit.client.0.smithi070.stderr: -423> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient(hunting): picked mon.noname-b con 0x5574ca006460 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:54:48.667 INFO:tasks.workunit.client.0.smithi070.stderr: -422> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:48.667 INFO:tasks.workunit.client.0.smithi070.stderr: -421> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:48.667 INFO:tasks.workunit.client.0.smithi070.stderr: -420> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:48.667 INFO:tasks.workunit.client.0.smithi070.stderr: -419> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:54:48.668 INFO:tasks.workunit.client.0.smithi070.stderr: -418> 2024-09-12T00:54:48.503+0000 7fa54b52f9c0 10 monclient(hunting): authenticate will time out at 2138.955937s 2024-09-12T00:54:48.668 INFO:tasks.workunit.client.0.smithi070.stderr: -417> 2024-09-12T00:54:48.507+0000 7fa549035640 10 monclient(hunting): get_auth_request con 0x5574c9e96230 auth_method 0 2024-09-12T00:54:48.668 INFO:tasks.workunit.client.0.smithi070.stderr: -416> 2024-09-12T00:54:48.507+0000 7fa549035640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:48.668 INFO:tasks.workunit.client.0.smithi070.stderr: -415> 2024-09-12T00:54:48.507+0000 7fa549035640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:48.668 INFO:tasks.workunit.client.0.smithi070.stderr: -414> 2024-09-12T00:54:48.507+0000 7fa549035640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:48.668 INFO:tasks.workunit.client.0.smithi070.stderr: -413> 2024-09-12T00:54:48.507+0000 7fa548834640 10 monclient(hunting): get_auth_request con 0x5574c9f23970 auth_method 0 2024-09-12T00:54:48.668 INFO:tasks.workunit.client.0.smithi070.stderr: -412> 2024-09-12T00:54:48.507+0000 7fa548834640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:48.668 INFO:tasks.workunit.client.0.smithi070.stderr: -411> 2024-09-12T00:54:48.507+0000 7fa548834640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:48.668 INFO:tasks.workunit.client.0.smithi070.stderr: -410> 2024-09-12T00:54:48.507+0000 7fa548834640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:48.668 INFO:tasks.workunit.client.0.smithi070.stderr: -409> 2024-09-12T00:54:48.507+0000 7fa549035640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:48.668 INFO:tasks.workunit.client.0.smithi070.stderr: -408> 2024-09-12T00:54:48.507+0000 7fa549035640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:48.669 INFO:tasks.workunit.client.0.smithi070.stderr: -407> 2024-09-12T00:54:48.507+0000 7fa549035640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:48.669 INFO:tasks.workunit.client.0.smithi070.stderr: -406> 2024-09-12T00:54:48.507+0000 7fa548834640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:48.669 INFO:tasks.workunit.client.0.smithi070.stderr: -405> 2024-09-12T00:54:48.507+0000 7fa548834640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:48.669 INFO:tasks.workunit.client.0.smithi070.stderr: -404> 2024-09-12T00:54:48.507+0000 7fa548834640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:48.669 INFO:tasks.workunit.client.0.smithi070.stderr: -403> 2024-09-12T00:54:48.507+0000 7fa549035640 10 monclient(hunting): handle_auth_done global_id 6299 payload 824 2024-09-12T00:54:48.669 INFO:tasks.workunit.client.0.smithi070.stderr: -402> 2024-09-12T00:54:48.507+0000 7fa549035640 10 monclient: _finish_hunting 0 2024-09-12T00:54:48.669 INFO:tasks.workunit.client.0.smithi070.stderr: -401> 2024-09-12T00:54:48.507+0000 7fa549035640 1 monclient: found mon.noname-c 2024-09-12T00:54:48.669 INFO:tasks.workunit.client.0.smithi070.stderr: -400> 2024-09-12T00:54:48.507+0000 7fa549035640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:54:48.669 INFO:tasks.workunit.client.0.smithi070.stderr: -399> 2024-09-12T00:54:48.507+0000 7fa435e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:48.669 INFO:tasks.workunit.client.0.smithi070.stderr: -398> 2024-09-12T00:54:48.507+0000 7fa435e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:48.669 INFO:tasks.workunit.client.0.smithi070.stderr: -397> 2024-09-12T00:54:48.507+0000 7fa435e03640 10 monclient: dump: 2024-09-12T00:54:48.669 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:48.669 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:48.670 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.670 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.670 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:48.670 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.670 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:48.670 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:48.670 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:48.670 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.670 INFO:tasks.workunit.client.0.smithi070.stderr: -396> 2024-09-12T00:54:48.507+0000 7fa435e03640 10 monclient: _finish_auth 0 2024-09-12T00:54:48.670 INFO:tasks.workunit.client.0.smithi070.stderr: -395> 2024-09-12T00:54:48.507+0000 7fa435e03640 10 monclient: _check_auth_tickets 2024-09-12T00:54:48.670 INFO:tasks.workunit.client.0.smithi070.stderr: -394> 2024-09-12T00:54:48.507+0000 7fa435e03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:48.670 INFO:tasks.workunit.client.0.smithi070.stderr: -393> 2024-09-12T00:54:48.507+0000 7fa435e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:48.670 INFO:tasks.workunit.client.0.smithi070.stderr: -392> 2024-09-12T00:54:48.507+0000 7fa435e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:48.670 INFO:tasks.workunit.client.0.smithi070.stderr: -391> 2024-09-12T00:54:48.507+0000 7fa435e03640 10 monclient: dump: 2024-09-12T00:54:48.671 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:48.671 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:48.671 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.671 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.671 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:48.671 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.671 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:48.671 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:48.671 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:48.671 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.671 INFO:tasks.workunit.client.0.smithi070.stderr: -390> 2024-09-12T00:54:48.507+0000 7fa54b52f9c0 5 monclient: authenticate success, global_id 6299 2024-09-12T00:54:48.671 INFO:tasks.workunit.client.0.smithi070.stderr: -389> 2024-09-12T00:54:48.507+0000 7fa437606640 4 set_mon_vals no callback set 2024-09-12T00:54:48.671 INFO:tasks.workunit.client.0.smithi070.stderr: -388> 2024-09-12T00:54:48.507+0000 7fa54b52f9c0 10 monclient: _renew_subs 2024-09-12T00:54:48.671 INFO:tasks.workunit.client.0.smithi070.stderr: -387> 2024-09-12T00:54:48.507+0000 7fa54b52f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:54:48.672 INFO:tasks.workunit.client.0.smithi070.stderr: -386> 2024-09-12T00:54:48.507+0000 7fa54b52f9c0 10 monclient: _renew_subs 2024-09-12T00:54:48.672 INFO:tasks.workunit.client.0.smithi070.stderr: -385> 2024-09-12T00:54:48.507+0000 7fa54b52f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:54:48.672 INFO:tasks.workunit.client.0.smithi070.stderr: -384> 2024-09-12T00:54:48.507+0000 7fa54b52f9c0 1 librados: init done 2024-09-12T00:54:48.672 INFO:tasks.workunit.client.0.smithi070.stderr: -383> 2024-09-12T00:54:48.507+0000 7fa435e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:48.672 INFO:tasks.workunit.client.0.smithi070.stderr: -382> 2024-09-12T00:54:48.507+0000 7fa435e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:54:48.672 INFO:tasks.workunit.client.0.smithi070.stderr: -381> 2024-09-12T00:54:48.507+0000 7fa435e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:54:48.673 INFO:tasks.workunit.client.0.smithi070.stderr: -380> 2024-09-12T00:54:48.507+0000 7fa549836640 10 monclient: get_auth_request con 0x5574ca015c90 auth_method 0 2024-09-12T00:54:48.673 INFO:tasks.workunit.client.0.smithi070.stderr: -379> 2024-09-12T00:54:48.507+0000 7fa548834640 10 monclient: get_auth_request con 0x7fa430070b10 auth_method 0 2024-09-12T00:54:48.673 INFO:tasks.workunit.client.0.smithi070.stderr: -378> 2024-09-12T00:54:48.511+0000 7fa549035640 10 monclient: get_auth_request con 0x5574ca022890 auth_method 0 2024-09-12T00:54:48.673 INFO:tasks.workunit.client.0.smithi070.stderr: -377> 2024-09-12T00:54:48.511+0000 7fa548834640 10 monclient: get_auth_request con 0x5574ca026a80 auth_method 0 2024-09-12T00:54:48.673 INFO:tasks.workunit.client.0.smithi070.stderr: -376> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 10 monclient: build_initial_monmap 2024-09-12T00:54:48.673 INFO:tasks.workunit.client.0.smithi070.stderr: -375> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 1 build_initial for_mkfs: 0 2024-09-12T00:54:48.673 INFO:tasks.workunit.client.0.smithi070.stderr: -374> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 10 monclient: monmap: 2024-09-12T00:54:48.673 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:54:48.674 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:48.674 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:54:48.674 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:54:48.674 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:48.674 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.674 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:54:48.674 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:54:48.674 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:54:48.674 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.674 INFO:tasks.workunit.client.0.smithi070.stderr: -373> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding auth protocol: cephx 2024-09-12T00:54:48.674 INFO:tasks.workunit.client.0.smithi070.stderr: -372> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding auth protocol: cephx 2024-09-12T00:54:48.674 INFO:tasks.workunit.client.0.smithi070.stderr: -371> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding auth protocol: cephx 2024-09-12T00:54:48.674 INFO:tasks.workunit.client.0.smithi070.stderr: -370> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding con mode: secure 2024-09-12T00:54:48.674 INFO:tasks.workunit.client.0.smithi070.stderr: -369> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding con mode: crc 2024-09-12T00:54:48.675 INFO:tasks.workunit.client.0.smithi070.stderr: -368> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding con mode: secure 2024-09-12T00:54:48.675 INFO:tasks.workunit.client.0.smithi070.stderr: -367> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding con mode: crc 2024-09-12T00:54:48.675 INFO:tasks.workunit.client.0.smithi070.stderr: -366> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding con mode: secure 2024-09-12T00:54:48.675 INFO:tasks.workunit.client.0.smithi070.stderr: -365> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding con mode: crc 2024-09-12T00:54:48.675 INFO:tasks.workunit.client.0.smithi070.stderr: -364> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding con mode: crc 2024-09-12T00:54:48.675 INFO:tasks.workunit.client.0.smithi070.stderr: -363> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding con mode: secure 2024-09-12T00:54:48.675 INFO:tasks.workunit.client.0.smithi070.stderr: -362> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding con mode: crc 2024-09-12T00:54:48.675 INFO:tasks.workunit.client.0.smithi070.stderr: -361> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding con mode: secure 2024-09-12T00:54:48.675 INFO:tasks.workunit.client.0.smithi070.stderr: -360> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding con mode: crc 2024-09-12T00:54:48.675 INFO:tasks.workunit.client.0.smithi070.stderr: -359> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca02b650) adding con mode: secure 2024-09-12T00:54:48.675 INFO:tasks.workunit.client.0.smithi070.stderr: -358> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:48.675 INFO:tasks.workunit.client.0.smithi070.stderr: -357> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5574ca02ea30 EEXIST 2024-09-12T00:54:48.675 INFO:tasks.workunit.client.0.smithi070.stderr: -356> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 10 monclient: init 2024-09-12T00:54:48.676 INFO:tasks.workunit.client.0.smithi070.stderr: -355> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding auth protocol: cephx 2024-09-12T00:54:48.676 INFO:tasks.workunit.client.0.smithi070.stderr: -354> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding auth protocol: cephx 2024-09-12T00:54:48.676 INFO:tasks.workunit.client.0.smithi070.stderr: -353> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding auth protocol: cephx 2024-09-12T00:54:48.676 INFO:tasks.workunit.client.0.smithi070.stderr: -352> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding con mode: secure 2024-09-12T00:54:48.676 INFO:tasks.workunit.client.0.smithi070.stderr: -351> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding con mode: crc 2024-09-12T00:54:48.676 INFO:tasks.workunit.client.0.smithi070.stderr: -350> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding con mode: secure 2024-09-12T00:54:48.676 INFO:tasks.workunit.client.0.smithi070.stderr: -349> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding con mode: crc 2024-09-12T00:54:48.676 INFO:tasks.workunit.client.0.smithi070.stderr: -348> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding con mode: secure 2024-09-12T00:54:48.676 INFO:tasks.workunit.client.0.smithi070.stderr: -347> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding con mode: crc 2024-09-12T00:54:48.676 INFO:tasks.workunit.client.0.smithi070.stderr: -346> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding con mode: crc 2024-09-12T00:54:48.676 INFO:tasks.workunit.client.0.smithi070.stderr: -345> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding con mode: secure 2024-09-12T00:54:48.676 INFO:tasks.workunit.client.0.smithi070.stderr: -344> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding con mode: crc 2024-09-12T00:54:48.677 INFO:tasks.workunit.client.0.smithi070.stderr: -343> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding con mode: secure 2024-09-12T00:54:48.677 INFO:tasks.workunit.client.0.smithi070.stderr: -342> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding con mode: crc 2024-09-12T00:54:48.677 INFO:tasks.workunit.client.0.smithi070.stderr: -341> 2024-09-12T00:54:48.511+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca029d08) adding con mode: secure 2024-09-12T00:54:48.677 INFO:tasks.workunit.client.0.smithi070.stderr: -340> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:48.677 INFO:tasks.workunit.client.0.smithi070.stderr: -339> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:48.677 INFO:tasks.workunit.client.0.smithi070.stderr: -338> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command rotate-key cmddesc rotate-key hook 0x5574ca029e50 EEXIST 2024-09-12T00:54:48.678 INFO:tasks.workunit.client.0.smithi070.stderr: -337> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:54:48.678 INFO:tasks.workunit.client.0.smithi070.stderr: -336> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:54:48.678 INFO:tasks.workunit.client.0.smithi070.stderr: -335> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient(hunting): picked mon.noname-b con 0x5574ca053230 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:54:48.678 INFO:tasks.workunit.client.0.smithi070.stderr: -334> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient(hunting): picked mon.noname-a con 0x5574ca06af00 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:54:48.678 INFO:tasks.workunit.client.0.smithi070.stderr: -333> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient(hunting): picked mon.noname-c con 0x5574ca051a40 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:54:48.678 INFO:tasks.workunit.client.0.smithi070.stderr: -332> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:48.679 INFO:tasks.workunit.client.0.smithi070.stderr: -331> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:48.679 INFO:tasks.workunit.client.0.smithi070.stderr: -330> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:48.679 INFO:tasks.workunit.client.0.smithi070.stderr: -329> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:54:48.679 INFO:tasks.workunit.client.0.smithi070.stderr: -328> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient(hunting): authenticate will time out at 2138.964527s 2024-09-12T00:54:48.679 INFO:tasks.workunit.client.0.smithi070.stderr: -327> 2024-09-12T00:54:48.515+0000 7fa548834640 10 monclient(hunting): get_auth_request con 0x5574ca06af00 auth_method 0 2024-09-12T00:54:48.679 INFO:tasks.workunit.client.0.smithi070.stderr: -326> 2024-09-12T00:54:48.515+0000 7fa548834640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:48.679 INFO:tasks.workunit.client.0.smithi070.stderr: -325> 2024-09-12T00:54:48.515+0000 7fa548834640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:48.679 INFO:tasks.workunit.client.0.smithi070.stderr: -324> 2024-09-12T00:54:48.515+0000 7fa548834640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:48.680 INFO:tasks.workunit.client.0.smithi070.stderr: -323> 2024-09-12T00:54:48.515+0000 7fa549836640 10 monclient(hunting): get_auth_request con 0x5574ca051a40 auth_method 0 2024-09-12T00:54:48.680 INFO:tasks.workunit.client.0.smithi070.stderr: -322> 2024-09-12T00:54:48.515+0000 7fa549836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:48.680 INFO:tasks.workunit.client.0.smithi070.stderr: -321> 2024-09-12T00:54:48.515+0000 7fa549836640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:48.680 INFO:tasks.workunit.client.0.smithi070.stderr: -320> 2024-09-12T00:54:48.515+0000 7fa549836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:48.680 INFO:tasks.workunit.client.0.smithi070.stderr: -319> 2024-09-12T00:54:48.515+0000 7fa548834640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:48.680 INFO:tasks.workunit.client.0.smithi070.stderr: -318> 2024-09-12T00:54:48.515+0000 7fa548834640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:48.680 INFO:tasks.workunit.client.0.smithi070.stderr: -317> 2024-09-12T00:54:48.515+0000 7fa548834640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:48.680 INFO:tasks.workunit.client.0.smithi070.stderr: -316> 2024-09-12T00:54:48.515+0000 7fa549836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:48.680 INFO:tasks.workunit.client.0.smithi070.stderr: -315> 2024-09-12T00:54:48.515+0000 7fa549836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:48.680 INFO:tasks.workunit.client.0.smithi070.stderr: -314> 2024-09-12T00:54:48.515+0000 7fa549836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:48.680 INFO:tasks.workunit.client.0.smithi070.stderr: -313> 2024-09-12T00:54:48.515+0000 7fa549035640 10 monclient(hunting): get_auth_request con 0x5574ca053230 auth_method 0 2024-09-12T00:54:48.681 INFO:tasks.workunit.client.0.smithi070.stderr: -312> 2024-09-12T00:54:48.515+0000 7fa549035640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:48.681 INFO:tasks.workunit.client.0.smithi070.stderr: -311> 2024-09-12T00:54:48.515+0000 7fa549035640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:48.681 INFO:tasks.workunit.client.0.smithi070.stderr: -310> 2024-09-12T00:54:48.515+0000 7fa549035640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:48.681 INFO:tasks.workunit.client.0.smithi070.stderr: -309> 2024-09-12T00:54:48.515+0000 7fa548834640 10 monclient(hunting): handle_auth_done global_id 6648 payload 824 2024-09-12T00:54:48.681 INFO:tasks.workunit.client.0.smithi070.stderr: -308> 2024-09-12T00:54:48.515+0000 7fa548834640 10 monclient: _finish_hunting 0 2024-09-12T00:54:48.681 INFO:tasks.workunit.client.0.smithi070.stderr: -307> 2024-09-12T00:54:48.515+0000 7fa548834640 1 monclient: found mon.noname-a 2024-09-12T00:54:48.681 INFO:tasks.workunit.client.0.smithi070.stderr: -306> 2024-09-12T00:54:48.515+0000 7fa548834640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:54:48.681 INFO:tasks.workunit.client.0.smithi070.stderr: -305> 2024-09-12T00:54:48.515+0000 7fa42effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:48.681 INFO:tasks.workunit.client.0.smithi070.stderr: -304> 2024-09-12T00:54:48.515+0000 7fa42effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:48.681 INFO:tasks.workunit.client.0.smithi070.stderr: -303> 2024-09-12T00:54:48.515+0000 7fa42effd640 10 monclient: dump: 2024-09-12T00:54:48.681 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:48.681 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:48.682 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.682 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.682 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:48.682 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.682 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:48.682 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:48.682 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:48.682 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.682 INFO:tasks.workunit.client.0.smithi070.stderr: -302> 2024-09-12T00:54:48.515+0000 7fa42effd640 10 monclient: _finish_auth 0 2024-09-12T00:54:48.682 INFO:tasks.workunit.client.0.smithi070.stderr: -301> 2024-09-12T00:54:48.515+0000 7fa42effd640 10 monclient: _check_auth_tickets 2024-09-12T00:54:48.682 INFO:tasks.workunit.client.0.smithi070.stderr: -300> 2024-09-12T00:54:48.515+0000 7fa42effd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:48.683 INFO:tasks.workunit.client.0.smithi070.stderr: -299> 2024-09-12T00:54:48.515+0000 7fa42effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:48.683 INFO:tasks.workunit.client.0.smithi070.stderr: -298> 2024-09-12T00:54:48.515+0000 7fa42effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:48.683 INFO:tasks.workunit.client.0.smithi070.stderr: -297> 2024-09-12T00:54:48.515+0000 7fa42effd640 10 monclient: dump: 2024-09-12T00:54:48.683 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:48.683 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:48.683 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.683 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.683 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:48.683 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.683 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:48.683 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:48.683 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:48.683 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.684 INFO:tasks.workunit.client.0.smithi070.stderr: -296> 2024-09-12T00:54:48.515+0000 7fa54a037640 4 set_mon_vals no callback set 2024-09-12T00:54:48.684 INFO:tasks.workunit.client.0.smithi070.stderr: -295> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 5 monclient: authenticate success, global_id 6648 2024-09-12T00:54:48.684 INFO:tasks.workunit.client.0.smithi070.stderr: -294> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient: _renew_subs 2024-09-12T00:54:48.684 INFO:tasks.workunit.client.0.smithi070.stderr: -293> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:54:48.684 INFO:tasks.workunit.client.0.smithi070.stderr: -292> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient: _renew_subs 2024-09-12T00:54:48.684 INFO:tasks.workunit.client.0.smithi070.stderr: -291> 2024-09-12T00:54:48.515+0000 7fa54b52f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:54:48.684 INFO:tasks.workunit.client.0.smithi070.stderr: -290> 2024-09-12T00:54:48.515+0000 7fa42effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:48.684 INFO:tasks.workunit.client.0.smithi070.stderr: -289> 2024-09-12T00:54:48.515+0000 7fa42effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:54:48.684 INFO:tasks.workunit.client.0.smithi070.stderr: -288> 2024-09-12T00:54:48.515+0000 7fa42effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:54:48.684 INFO:tasks.workunit.client.0.smithi070.stderr: -287> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient: get_monmap_and_config 2024-09-12T00:54:48.684 INFO:tasks.workunit.client.0.smithi070.stderr: -286> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient: build_initial_monmap 2024-09-12T00:54:48.684 INFO:tasks.workunit.client.0.smithi070.stderr: -285> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 1 build_initial for_mkfs: 0 2024-09-12T00:54:48.684 INFO:tasks.workunit.client.0.smithi070.stderr: -284> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient: monmap: 2024-09-12T00:54:48.684 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:54:48.685 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:48.685 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:54:48.685 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:54:48.685 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:48.685 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.685 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:54:48.685 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:54:48.685 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:54:48.685 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.685 INFO:tasks.workunit.client.0.smithi070.stderr: -283> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding auth protocol: cephx 2024-09-12T00:54:48.685 INFO:tasks.workunit.client.0.smithi070.stderr: -282> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding auth protocol: cephx 2024-09-12T00:54:48.686 INFO:tasks.workunit.client.0.smithi070.stderr: -281> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding auth protocol: cephx 2024-09-12T00:54:48.686 INFO:tasks.workunit.client.0.smithi070.stderr: -280> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding con mode: secure 2024-09-12T00:54:48.686 INFO:tasks.workunit.client.0.smithi070.stderr: -279> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding con mode: crc 2024-09-12T00:54:48.686 INFO:tasks.workunit.client.0.smithi070.stderr: -278> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding con mode: secure 2024-09-12T00:54:48.686 INFO:tasks.workunit.client.0.smithi070.stderr: -277> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding con mode: crc 2024-09-12T00:54:48.686 INFO:tasks.workunit.client.0.smithi070.stderr: -276> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding con mode: secure 2024-09-12T00:54:48.686 INFO:tasks.workunit.client.0.smithi070.stderr: -275> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding con mode: crc 2024-09-12T00:54:48.687 INFO:tasks.workunit.client.0.smithi070.stderr: -274> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding con mode: crc 2024-09-12T00:54:48.687 INFO:tasks.workunit.client.0.smithi070.stderr: -273> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding con mode: secure 2024-09-12T00:54:48.687 INFO:tasks.workunit.client.0.smithi070.stderr: -272> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding con mode: crc 2024-09-12T00:54:48.687 INFO:tasks.workunit.client.0.smithi070.stderr: -271> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding con mode: secure 2024-09-12T00:54:48.687 INFO:tasks.workunit.client.0.smithi070.stderr: -270> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding con mode: crc 2024-09-12T00:54:48.687 INFO:tasks.workunit.client.0.smithi070.stderr: -269> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca072cb0) adding con mode: secure 2024-09-12T00:54:48.687 INFO:tasks.workunit.client.0.smithi070.stderr: -268> 2024-09-12T00:54:48.519+0000 7fa549035640 10 monclient: get_auth_request con 0x7fa4240709f0 auth_method 0 2024-09-12T00:54:48.687 INFO:tasks.workunit.client.0.smithi070.stderr: -267> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:48.687 INFO:tasks.workunit.client.0.smithi070.stderr: -266> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient: init 2024-09-12T00:54:48.687 INFO:tasks.workunit.client.0.smithi070.stderr: -265> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding auth protocol: cephx 2024-09-12T00:54:48.688 INFO:tasks.workunit.client.0.smithi070.stderr: -264> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding auth protocol: cephx 2024-09-12T00:54:48.688 INFO:tasks.workunit.client.0.smithi070.stderr: -263> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding auth protocol: cephx 2024-09-12T00:54:48.688 INFO:tasks.workunit.client.0.smithi070.stderr: -262> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding con mode: secure 2024-09-12T00:54:48.688 INFO:tasks.workunit.client.0.smithi070.stderr: -261> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding con mode: crc 2024-09-12T00:54:48.688 INFO:tasks.workunit.client.0.smithi070.stderr: -260> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding con mode: secure 2024-09-12T00:54:48.688 INFO:tasks.workunit.client.0.smithi070.stderr: -259> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding con mode: crc 2024-09-12T00:54:48.688 INFO:tasks.workunit.client.0.smithi070.stderr: -258> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding con mode: secure 2024-09-12T00:54:48.688 INFO:tasks.workunit.client.0.smithi070.stderr: -257> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding con mode: crc 2024-09-12T00:54:48.689 INFO:tasks.workunit.client.0.smithi070.stderr: -256> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding con mode: crc 2024-09-12T00:54:48.689 INFO:tasks.workunit.client.0.smithi070.stderr: -255> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding con mode: secure 2024-09-12T00:54:48.689 INFO:tasks.workunit.client.0.smithi070.stderr: -254> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding con mode: crc 2024-09-12T00:54:48.689 INFO:tasks.workunit.client.0.smithi070.stderr: -253> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding con mode: secure 2024-09-12T00:54:48.689 INFO:tasks.workunit.client.0.smithi070.stderr: -252> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding con mode: crc 2024-09-12T00:54:48.689 INFO:tasks.workunit.client.0.smithi070.stderr: -251> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834790) adding con mode: secure 2024-09-12T00:54:48.689 INFO:tasks.workunit.client.0.smithi070.stderr: -250> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:48.689 INFO:tasks.workunit.client.0.smithi070.stderr: -249> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:48.689 INFO:tasks.workunit.client.0.smithi070.stderr: -248> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffead8348d8 EEXIST 2024-09-12T00:54:48.689 INFO:tasks.workunit.client.0.smithi070.stderr: -247> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:54:48.689 INFO:tasks.workunit.client.0.smithi070.stderr: -246> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:54:48.689 INFO:tasks.workunit.client.0.smithi070.stderr: -245> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): picked mon.noname-b con 0x5574ca076c00 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:54:48.690 INFO:tasks.workunit.client.0.smithi070.stderr: -244> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): picked mon.noname-a con 0x5574ca0a2460 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:54:48.690 INFO:tasks.workunit.client.0.smithi070.stderr: -243> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): picked mon.noname-c con 0x5574ca097be0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:54:48.690 INFO:tasks.workunit.client.0.smithi070.stderr: -242> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:48.690 INFO:tasks.workunit.client.0.smithi070.stderr: -241> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:48.690 INFO:tasks.workunit.client.0.smithi070.stderr: -240> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:48.690 INFO:tasks.workunit.client.0.smithi070.stderr: -239> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:54:48.690 INFO:tasks.workunit.client.0.smithi070.stderr: -238> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): authenticate will time out at 2138.969296s 2024-09-12T00:54:48.690 INFO:tasks.workunit.client.0.smithi070.stderr: -237> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient(hunting): get_auth_request con 0x5574ca0a2460 auth_method 0 2024-09-12T00:54:48.690 INFO:tasks.workunit.client.0.smithi070.stderr: -236> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:48.690 INFO:tasks.workunit.client.0.smithi070.stderr: -235> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:48.690 INFO:tasks.workunit.client.0.smithi070.stderr: -234> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:48.690 INFO:tasks.workunit.client.0.smithi070.stderr: -233> 2024-09-12T00:54:48.519+0000 7fa549836640 10 monclient(hunting): get_auth_request con 0x5574ca097be0 auth_method 0 2024-09-12T00:54:48.690 INFO:tasks.workunit.client.0.smithi070.stderr: -232> 2024-09-12T00:54:48.519+0000 7fa549836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:48.691 INFO:tasks.workunit.client.0.smithi070.stderr: -231> 2024-09-12T00:54:48.519+0000 7fa549836640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:48.691 INFO:tasks.workunit.client.0.smithi070.stderr: -230> 2024-09-12T00:54:48.519+0000 7fa549836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:48.691 INFO:tasks.workunit.client.0.smithi070.stderr: -229> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:48.691 INFO:tasks.workunit.client.0.smithi070.stderr: -228> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:48.691 INFO:tasks.workunit.client.0.smithi070.stderr: -227> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:48.691 INFO:tasks.workunit.client.0.smithi070.stderr: -226> 2024-09-12T00:54:48.519+0000 7fa549836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:48.691 INFO:tasks.workunit.client.0.smithi070.stderr: -225> 2024-09-12T00:54:48.519+0000 7fa549836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:48.691 INFO:tasks.workunit.client.0.smithi070.stderr: -224> 2024-09-12T00:54:48.519+0000 7fa549836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:48.691 INFO:tasks.workunit.client.0.smithi070.stderr: -223> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient(hunting): handle_auth_done global_id 6651 payload 274 2024-09-12T00:54:48.691 INFO:tasks.workunit.client.0.smithi070.stderr: -222> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient: _finish_hunting 0 2024-09-12T00:54:48.691 INFO:tasks.workunit.client.0.smithi070.stderr: -221> 2024-09-12T00:54:48.519+0000 7fa548834640 1 monclient: found mon.noname-a 2024-09-12T00:54:48.691 INFO:tasks.workunit.client.0.smithi070.stderr: -220> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:54:48.691 INFO:tasks.workunit.client.0.smithi070.stderr: -219> 2024-09-12T00:54:48.519+0000 7fa42cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:48.692 INFO:tasks.workunit.client.0.smithi070.stderr: -218> 2024-09-12T00:54:48.519+0000 7fa42cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:48.692 INFO:tasks.workunit.client.0.smithi070.stderr: -217> 2024-09-12T00:54:48.519+0000 7fa42cff9640 10 monclient: dump: 2024-09-12T00:54:48.692 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:48.692 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:48.692 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.692 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.692 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:48.692 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.692 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:48.692 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:48.692 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:48.692 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.692 INFO:tasks.workunit.client.0.smithi070.stderr: -216> 2024-09-12T00:54:48.519+0000 7fa42cff9640 10 monclient: _finish_auth 0 2024-09-12T00:54:48.693 INFO:tasks.workunit.client.0.smithi070.stderr: -215> 2024-09-12T00:54:48.519+0000 7fa42cff9640 10 monclient: _check_auth_tickets 2024-09-12T00:54:48.693 INFO:tasks.workunit.client.0.smithi070.stderr: -214> 2024-09-12T00:54:48.519+0000 7fa42cff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:48.693 INFO:tasks.workunit.client.0.smithi070.stderr: -213> 2024-09-12T00:54:48.519+0000 7fa42cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:48.693 INFO:tasks.workunit.client.0.smithi070.stderr: -212> 2024-09-12T00:54:48.519+0000 7fa42cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:48.693 INFO:tasks.workunit.client.0.smithi070.stderr: -211> 2024-09-12T00:54:48.519+0000 7fa42cff9640 10 monclient: dump: 2024-09-12T00:54:48.693 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:48.693 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:48.693 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.693 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.693 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:48.693 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.693 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:48.693 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:48.693 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:48.694 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.694 INFO:tasks.workunit.client.0.smithi070.stderr: -210> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 monclient: authenticate success, global_id 6651 2024-09-12T00:54:48.694 INFO:tasks.workunit.client.0.smithi070.stderr: -209> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:54:48.694 INFO:tasks.workunit.client.0.smithi070.stderr: -208> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 4 set_mon_vals no callback set 2024-09-12T00:54:48.694 INFO:tasks.workunit.client.0.smithi070.stderr: -207> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient: shutdown 2024-09-12T00:54:48.694 INFO:tasks.workunit.client.0.smithi070.stderr: -206> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient: build_initial_monmap 2024-09-12T00:54:48.694 INFO:tasks.workunit.client.0.smithi070.stderr: -205> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 1 build_initial for_mkfs: 0 2024-09-12T00:54:48.694 INFO:tasks.workunit.client.0.smithi070.stderr: -204> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient: monmap: 2024-09-12T00:54:48.694 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:54:48.694 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:48.694 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:54:48.694 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:54:48.694 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:48.695 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.695 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:54:48.695 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:54:48.695 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:54:48.695 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.695 INFO:tasks.workunit.client.0.smithi070.stderr: -203> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding auth protocol: cephx 2024-09-12T00:54:48.695 INFO:tasks.workunit.client.0.smithi070.stderr: -202> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding auth protocol: cephx 2024-09-12T00:54:48.695 INFO:tasks.workunit.client.0.smithi070.stderr: -201> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding auth protocol: cephx 2024-09-12T00:54:48.695 INFO:tasks.workunit.client.0.smithi070.stderr: -200> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding con mode: secure 2024-09-12T00:54:48.695 INFO:tasks.workunit.client.0.smithi070.stderr: -199> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding con mode: crc 2024-09-12T00:54:48.695 INFO:tasks.workunit.client.0.smithi070.stderr: -198> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding con mode: secure 2024-09-12T00:54:48.695 INFO:tasks.workunit.client.0.smithi070.stderr: -197> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding con mode: crc 2024-09-12T00:54:48.695 INFO:tasks.workunit.client.0.smithi070.stderr: -196> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding con mode: secure 2024-09-12T00:54:48.696 INFO:tasks.workunit.client.0.smithi070.stderr: -195> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding con mode: crc 2024-09-12T00:54:48.696 INFO:tasks.workunit.client.0.smithi070.stderr: -194> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding con mode: crc 2024-09-12T00:54:48.696 INFO:tasks.workunit.client.0.smithi070.stderr: -193> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding con mode: secure 2024-09-12T00:54:48.696 INFO:tasks.workunit.client.0.smithi070.stderr: -192> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding con mode: crc 2024-09-12T00:54:48.696 INFO:tasks.workunit.client.0.smithi070.stderr: -191> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding con mode: secure 2024-09-12T00:54:48.696 INFO:tasks.workunit.client.0.smithi070.stderr: -190> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding con mode: crc 2024-09-12T00:54:48.696 INFO:tasks.workunit.client.0.smithi070.stderr: -189> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca0a3260) adding con mode: secure 2024-09-12T00:54:48.696 INFO:tasks.workunit.client.0.smithi070.stderr: -188> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:48.696 INFO:tasks.workunit.client.0.smithi070.stderr: -187> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 1 librados: starting msgr at 2024-09-12T00:54:48.696 INFO:tasks.workunit.client.0.smithi070.stderr: -186> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 1 librados: starting objecter 2024-09-12T00:54:48.696 INFO:tasks.workunit.client.0.smithi070.stderr: -185> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5574ca059210 EEXIST 2024-09-12T00:54:48.696 INFO:tasks.workunit.client.0.smithi070.stderr: -184> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 1 librados: setting wanted keys 2024-09-12T00:54:48.696 INFO:tasks.workunit.client.0.smithi070.stderr: -183> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 1 librados: calling monclient init 2024-09-12T00:54:48.697 INFO:tasks.workunit.client.0.smithi070.stderr: -182> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient: init 2024-09-12T00:54:48.697 INFO:tasks.workunit.client.0.smithi070.stderr: -181> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding auth protocol: cephx 2024-09-12T00:54:48.697 INFO:tasks.workunit.client.0.smithi070.stderr: -180> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding auth protocol: cephx 2024-09-12T00:54:48.697 INFO:tasks.workunit.client.0.smithi070.stderr: -179> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding auth protocol: cephx 2024-09-12T00:54:48.697 INFO:tasks.workunit.client.0.smithi070.stderr: -178> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding con mode: secure 2024-09-12T00:54:48.697 INFO:tasks.workunit.client.0.smithi070.stderr: -177> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding con mode: crc 2024-09-12T00:54:48.697 INFO:tasks.workunit.client.0.smithi070.stderr: -176> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding con mode: secure 2024-09-12T00:54:48.697 INFO:tasks.workunit.client.0.smithi070.stderr: -175> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding con mode: crc 2024-09-12T00:54:48.697 INFO:tasks.workunit.client.0.smithi070.stderr: -174> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding con mode: secure 2024-09-12T00:54:48.697 INFO:tasks.workunit.client.0.smithi070.stderr: -173> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding con mode: crc 2024-09-12T00:54:48.697 INFO:tasks.workunit.client.0.smithi070.stderr: -172> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding con mode: crc 2024-09-12T00:54:48.697 INFO:tasks.workunit.client.0.smithi070.stderr: -171> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding con mode: secure 2024-09-12T00:54:48.697 INFO:tasks.workunit.client.0.smithi070.stderr: -170> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding con mode: crc 2024-09-12T00:54:48.698 INFO:tasks.workunit.client.0.smithi070.stderr: -169> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding con mode: secure 2024-09-12T00:54:48.698 INFO:tasks.workunit.client.0.smithi070.stderr: -168> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding con mode: crc 2024-09-12T00:54:48.698 INFO:tasks.workunit.client.0.smithi070.stderr: -167> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 AuthRegistry(0x5574ca071e10) adding con mode: secure 2024-09-12T00:54:48.698 INFO:tasks.workunit.client.0.smithi070.stderr: -166> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:48.698 INFO:tasks.workunit.client.0.smithi070.stderr: -165> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:48.698 INFO:tasks.workunit.client.0.smithi070.stderr: -164> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command rotate-key cmddesc rotate-key hook 0x5574ca071f58 EEXIST 2024-09-12T00:54:48.698 INFO:tasks.workunit.client.0.smithi070.stderr: -163> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:54:48.698 INFO:tasks.workunit.client.0.smithi070.stderr: -162> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:54:48.698 INFO:tasks.workunit.client.0.smithi070.stderr: -161> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): picked mon.noname-b con 0x5574ca076c00 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:54:48.698 INFO:tasks.workunit.client.0.smithi070.stderr: -160> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): picked mon.noname-c con 0x5574ca097be0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:54:48.699 INFO:tasks.workunit.client.0.smithi070.stderr: -159> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): picked mon.noname-a con 0x5574ca0a2460 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:54:48.699 INFO:tasks.workunit.client.0.smithi070.stderr: -158> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:48.699 INFO:tasks.workunit.client.0.smithi070.stderr: -157> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:48.699 INFO:tasks.workunit.client.0.smithi070.stderr: -156> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:48.699 INFO:tasks.workunit.client.0.smithi070.stderr: -155> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:54:48.699 INFO:tasks.workunit.client.0.smithi070.stderr: -154> 2024-09-12T00:54:48.519+0000 7fa54b52f9c0 10 monclient(hunting): authenticate will time out at 2138.971822s 2024-09-12T00:54:48.699 INFO:tasks.workunit.client.0.smithi070.stderr: -153> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient(hunting): get_auth_request con 0x5574ca097be0 auth_method 0 2024-09-12T00:54:48.699 INFO:tasks.workunit.client.0.smithi070.stderr: -152> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:48.699 INFO:tasks.workunit.client.0.smithi070.stderr: -151> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:48.699 INFO:tasks.workunit.client.0.smithi070.stderr: -150> 2024-09-12T00:54:48.519+0000 7fa548834640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:48.699 INFO:tasks.workunit.client.0.smithi070.stderr: -149> 2024-09-12T00:54:48.519+0000 7fa549836640 10 monclient(hunting): get_auth_request con 0x5574ca0a2460 auth_method 0 2024-09-12T00:54:48.699 INFO:tasks.workunit.client.0.smithi070.stderr: -148> 2024-09-12T00:54:48.519+0000 7fa549836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:48.699 INFO:tasks.workunit.client.0.smithi070.stderr: -147> 2024-09-12T00:54:48.519+0000 7fa549836640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:48.700 INFO:tasks.workunit.client.0.smithi070.stderr: -146> 2024-09-12T00:54:48.519+0000 7fa549836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:48.700 INFO:tasks.workunit.client.0.smithi070.stderr: -145> 2024-09-12T00:54:48.523+0000 7fa548834640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:48.700 INFO:tasks.workunit.client.0.smithi070.stderr: -144> 2024-09-12T00:54:48.523+0000 7fa548834640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:48.700 INFO:tasks.workunit.client.0.smithi070.stderr: -143> 2024-09-12T00:54:48.523+0000 7fa548834640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:48.700 INFO:tasks.workunit.client.0.smithi070.stderr: -142> 2024-09-12T00:54:48.523+0000 7fa549836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:48.700 INFO:tasks.workunit.client.0.smithi070.stderr: -141> 2024-09-12T00:54:48.523+0000 7fa549836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:48.700 INFO:tasks.workunit.client.0.smithi070.stderr: -140> 2024-09-12T00:54:48.523+0000 7fa549836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:48.700 INFO:tasks.workunit.client.0.smithi070.stderr: -139> 2024-09-12T00:54:48.523+0000 7fa549035640 10 monclient(hunting): get_auth_request con 0x5574ca076c00 auth_method 0 2024-09-12T00:54:48.700 INFO:tasks.workunit.client.0.smithi070.stderr: -138> 2024-09-12T00:54:48.523+0000 7fa549035640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:48.700 INFO:tasks.workunit.client.0.smithi070.stderr: -137> 2024-09-12T00:54:48.523+0000 7fa549035640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:48.700 INFO:tasks.workunit.client.0.smithi070.stderr: -136> 2024-09-12T00:54:48.523+0000 7fa549035640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:48.700 INFO:tasks.workunit.client.0.smithi070.stderr: -135> 2024-09-12T00:54:48.523+0000 7fa548834640 10 monclient(hunting): handle_auth_done global_id 6308 payload 824 2024-09-12T00:54:48.701 INFO:tasks.workunit.client.0.smithi070.stderr: -134> 2024-09-12T00:54:48.523+0000 7fa548834640 10 monclient: _finish_hunting 0 2024-09-12T00:54:48.701 INFO:tasks.workunit.client.0.smithi070.stderr: -133> 2024-09-12T00:54:48.523+0000 7fa548834640 1 monclient: found mon.noname-c 2024-09-12T00:54:48.701 INFO:tasks.workunit.client.0.smithi070.stderr: -132> 2024-09-12T00:54:48.523+0000 7fa548834640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:54:48.701 INFO:tasks.workunit.client.0.smithi070.stderr: -131> 2024-09-12T00:54:48.523+0000 7fa41affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:48.701 INFO:tasks.workunit.client.0.smithi070.stderr: -130> 2024-09-12T00:54:48.523+0000 7fa41affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:48.701 INFO:tasks.workunit.client.0.smithi070.stderr: -129> 2024-09-12T00:54:48.523+0000 7fa41affd640 10 monclient: dump: 2024-09-12T00:54:48.701 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:48.701 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:48.701 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.701 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.701 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:48.701 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.701 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:48.702 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:48.702 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:48.702 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.702 INFO:tasks.workunit.client.0.smithi070.stderr: -128> 2024-09-12T00:54:48.523+0000 7fa41affd640 10 monclient: _finish_auth 0 2024-09-12T00:54:48.702 INFO:tasks.workunit.client.0.smithi070.stderr: -127> 2024-09-12T00:54:48.523+0000 7fa41affd640 10 monclient: _check_auth_tickets 2024-09-12T00:54:48.702 INFO:tasks.workunit.client.0.smithi070.stderr: -126> 2024-09-12T00:54:48.523+0000 7fa54b52f9c0 5 monclient: authenticate success, global_id 6308 2024-09-12T00:54:48.702 INFO:tasks.workunit.client.0.smithi070.stderr: -125> 2024-09-12T00:54:48.523+0000 7fa54b52f9c0 10 monclient: _renew_subs 2024-09-12T00:54:48.702 INFO:tasks.workunit.client.0.smithi070.stderr: -124> 2024-09-12T00:54:48.523+0000 7fa54b52f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:54:48.702 INFO:tasks.workunit.client.0.smithi070.stderr: -123> 2024-09-12T00:54:48.523+0000 7fa41affd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:48.702 INFO:tasks.workunit.client.0.smithi070.stderr: -122> 2024-09-12T00:54:48.523+0000 7fa41affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:48.702 INFO:tasks.workunit.client.0.smithi070.stderr: -121> 2024-09-12T00:54:48.523+0000 7fa41affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:48.702 INFO:tasks.workunit.client.0.smithi070.stderr: -120> 2024-09-12T00:54:48.523+0000 7fa41affd640 10 monclient: dump: 2024-09-12T00:54:48.702 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:54:48.703 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:54:48.703 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.703 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:54:48.703 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:48.703 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:54:48.703 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:54:48.703 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:54:48.703 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:54:48.703 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.703 INFO:tasks.workunit.client.0.smithi070.stderr: -119> 2024-09-12T00:54:48.523+0000 7fa42cff9640 4 set_mon_vals no callback set 2024-09-12T00:54:48.703 INFO:tasks.workunit.client.0.smithi070.stderr: -118> 2024-09-12T00:54:48.523+0000 7fa54b52f9c0 10 monclient: _renew_subs 2024-09-12T00:54:48.703 INFO:tasks.workunit.client.0.smithi070.stderr: -117> 2024-09-12T00:54:48.523+0000 7fa54b52f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:54:48.703 INFO:tasks.workunit.client.0.smithi070.stderr: -116> 2024-09-12T00:54:48.523+0000 7fa54b52f9c0 1 librados: init done 2024-09-12T00:54:48.704 INFO:tasks.workunit.client.0.smithi070.stderr: -115> 2024-09-12T00:54:48.523+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command cr dump hook 0x5574ca0a0638 2024-09-12T00:54:48.704 INFO:tasks.workunit.client.0.smithi070.stderr: -114> 2024-09-12T00:54:48.523+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.704 INFO:tasks.workunit.client.0.smithi070.stderr: -113> 2024-09-12T00:54:48.523+0000 7fa41affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:48.704 INFO:tasks.workunit.client.0.smithi070.stderr: -112> 2024-09-12T00:54:48.523+0000 7fa41affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:54:48.704 INFO:tasks.workunit.client.0.smithi070.stderr: -111> 2024-09-12T00:54:48.523+0000 7fa41affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:54:48.704 INFO:tasks.workunit.client.0.smithi070.stderr: -110> 2024-09-12T00:54:48.523+0000 7fa549836640 10 monclient: get_auth_request con 0x5574ca0c0cf0 auth_method 0 2024-09-12T00:54:48.704 INFO:tasks.workunit.client.0.smithi070.stderr: -109> 2024-09-12T00:54:48.523+0000 7fa549035640 10 monclient: get_auth_request con 0x7fa414070ae0 auth_method 0 2024-09-12T00:54:48.704 INFO:tasks.workunit.client.0.smithi070.stderr: -108> 2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.704 INFO:tasks.workunit.client.0.smithi070.stderr: -107> 2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 realm 2024-09-12T00:54:48.704 INFO:tasks.workunit.client.0.smithi070.stderr: -106> 2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.704 INFO:tasks.workunit.client.0.smithi070.stderr: -105> 2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.704 INFO:tasks.workunit.client.0.smithi070.stderr: -104> 2024-09-12T00:54:48.527+0000 7fa54b52f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:48.704 INFO:tasks.workunit.client.0.smithi070.stderr: -103> 2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.705 INFO:tasks.workunit.client.0.smithi070.stderr: -102> 2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.705 INFO:tasks.workunit.client.0.smithi070.stderr: -101> 2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.705 INFO:tasks.workunit.client.0.smithi070.stderr: -100> 2024-09-12T00:54:48.527+0000 7fa549035640 10 monclient: get_auth_request con 0x5574ca0c50c0 auth_method 0 2024-09-12T00:54:48.705 INFO:tasks.workunit.client.0.smithi070.stderr: -99> 2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:48.705 INFO:tasks.workunit.client.0.smithi070.stderr: -98> 2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.705 INFO:tasks.workunit.client.0.smithi070.stderr: -97> 2024-09-12T00:54:48.527+0000 7fa548834640 10 monclient: get_auth_request con 0x5574ca0c8820 auth_method 0 2024-09-12T00:54:48.705 INFO:tasks.workunit.client.0.smithi070.stderr: -96> 2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:48.705 INFO:tasks.workunit.client.0.smithi070.stderr: -95> 2024-09-12T00:54:48.527+0000 7fa54b52f9c0 20 searching for the correct realm 2024-09-12T00:54:48.705 INFO:tasks.workunit.client.0.smithi070.stderr: -94> 2024-09-12T00:54:48.527+0000 7fa549836640 10 monclient: get_auth_request con 0x5574ca0cd580 auth_method 0 2024-09-12T00:54:48.705 INFO:tasks.workunit.client.0.smithi070.stderr: -93> 2024-09-12T00:54:48.531+0000 7fa549035640 10 monclient: get_auth_request con 0x7fa544011040 auth_method 0 2024-09-12T00:54:48.705 INFO:tasks.workunit.client.0.smithi070.stderr: -92> 2024-09-12T00:54:48.531+0000 7fa548834640 10 monclient: get_auth_request con 0x7fa53c102040 auth_method 0 2024-09-12T00:54:48.705 INFO:tasks.workunit.client.0.smithi070.stderr: -91> 2024-09-12T00:54:48.531+0000 7fa549836640 10 monclient: get_auth_request con 0x7fa540079fe0 auth_method 0 2024-09-12T00:54:48.705 INFO:tasks.workunit.client.0.smithi070.stderr: -90> 2024-09-12T00:54:48.535+0000 7fa549836640 0 -- 172.21.15.70:0/629985701 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fa540079fe0 msgr2=0x7fa540067410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:48.706 INFO:tasks.workunit.client.0.smithi070.stderr: -89> 2024-09-12T00:54:48.535+0000 7fa41affd640 1 client.6308.objecter ms_handle_reset 0x7fa540079fe0 session 0x7fa540063830 osd.4 2024-09-12T00:54:48.706 INFO:tasks.workunit.client.0.smithi070.stderr: -88> 2024-09-12T00:54:48.535+0000 7fa41affd640 10 monclient: _renew_subs 2024-09-12T00:54:48.706 INFO:tasks.workunit.client.0.smithi070.stderr: -87> 2024-09-12T00:54:48.535+0000 7fa41affd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:54:48.706 INFO:tasks.workunit.client.0.smithi070.stderr: -86> 2024-09-12T00:54:48.535+0000 7fa549836640 10 monclient: get_auth_request con 0x7fa414080800 auth_method 0 2024-09-12T00:54:48.706 INFO:tasks.workunit.client.0.smithi070.stderr: -85> 2024-09-12T00:54:48.535+0000 7fa549035640 10 monclient: get_auth_request con 0x7fa544020440 auth_method 0 2024-09-12T00:54:48.706 INFO:tasks.workunit.client.0.smithi070.stderr: -84> 2024-09-12T00:54:48.543+0000 7fa549035640 0 -- 172.21.15.70:0/629985701 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7fa544020440 msgr2=0x7fa5440208c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:48.706 INFO:tasks.workunit.client.0.smithi070.stderr: -83> 2024-09-12T00:54:48.543+0000 7fa41affd640 1 client.6308.objecter ms_handle_reset 0x7fa544020440 session 0x7fa544011980 osd.6 2024-09-12T00:54:48.706 INFO:tasks.workunit.client.0.smithi070.stderr: -82> 2024-09-12T00:54:48.543+0000 7fa549035640 10 monclient: get_auth_request con 0x7fa4140835a0 auth_method 0 2024-09-12T00:54:48.706 INFO:tasks.workunit.client.0.smithi070.stderr: -81> 2024-09-12T00:54:48.547+0000 7fa54b52f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:48.706 INFO:tasks.workunit.client.0.smithi070.stderr: -80> 2024-09-12T00:54:48.547+0000 7fa54b52f9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:48.707 INFO:tasks.workunit.client.0.smithi070.stderr: -79> 2024-09-12T00:54:48.547+0000 7fa54b52f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:48.707 INFO:tasks.workunit.client.0.smithi070.stderr: -78> 2024-09-12T00:54:48.547+0000 7fa54b52f9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:48.707 INFO:tasks.workunit.client.0.smithi070.stderr: -77> 2024-09-12T00:54:48.547+0000 7fa54b52f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:48.707 INFO:tasks.workunit.client.0.smithi070.stderr: -76> 2024-09-12T00:54:48.547+0000 7fa54b52f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:48.707 INFO:tasks.workunit.client.0.smithi070.stderr: -75> 2024-09-12T00:54:48.547+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.707 INFO:tasks.workunit.client.0.smithi070.stderr: -74> 2024-09-12T00:54:48.547+0000 7fa54b52f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.707 INFO:tasks.workunit.client.0.smithi070.stderr: -73> 2024-09-12T00:54:48.547+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.707 INFO:tasks.workunit.client.0.smithi070.stderr: -72> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:48.707 INFO:tasks.workunit.client.0.smithi070.stderr: -71> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.707 INFO:tasks.workunit.client.0.smithi070.stderr: -70> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:48.707 INFO:tasks.workunit.client.0.smithi070.stderr: -69> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 zone default found 2024-09-12T00:54:48.707 INFO:tasks.workunit.client.0.smithi070.stderr: -68> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 4 Realm: () 2024-09-12T00:54:48.707 INFO:tasks.workunit.client.0.smithi070.stderr: -67> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:48.707 INFO:tasks.workunit.client.0.smithi070.stderr: -66> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:48.708 INFO:tasks.workunit.client.0.smithi070.stderr: -65> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:48.708 INFO:tasks.workunit.client.0.smithi070.stderr: -64> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 zonegroup default 2024-09-12T00:54:48.708 INFO:tasks.workunit.client.0.smithi070.stderr: -63> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.708 INFO:tasks.workunit.client.0.smithi070.stderr: -62> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.708 INFO:tasks.workunit.client.0.smithi070.stderr: -61> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.708 INFO:tasks.workunit.client.0.smithi070.stderr: -60> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.708 INFO:tasks.workunit.client.0.smithi070.stderr: -59> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.708 INFO:tasks.workunit.client.0.smithi070.stderr: -58> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.708 INFO:tasks.workunit.client.0.smithi070.stderr: -57> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 started sync module instance, tier type = 2024-09-12T00:54:48.709 INFO:tasks.workunit.client.0.smithi070.stderr: -56> 2024-09-12T00:54:48.551+0000 7fa54b52f9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:48.709 INFO:tasks.workunit.client.0.smithi070.stderr: -55> 2024-09-12T00:54:48.567+0000 7fa54b52f9c0 20 add_watcher() i=0 2024-09-12T00:54:48.709 INFO:tasks.workunit.client.0.smithi070.stderr: -54> 2024-09-12T00:54:48.567+0000 7fa54b52f9c0 20 add_watcher() i=1 2024-09-12T00:54:48.709 INFO:tasks.workunit.client.0.smithi070.stderr: -53> 2024-09-12T00:54:48.567+0000 7fa54b52f9c0 20 add_watcher() i=2 2024-09-12T00:54:48.709 INFO:tasks.workunit.client.0.smithi070.stderr: -52> 2024-09-12T00:54:48.567+0000 7fa54b52f9c0 20 add_watcher() i=3 2024-09-12T00:54:48.709 INFO:tasks.workunit.client.0.smithi070.stderr: -51> 2024-09-12T00:54:48.567+0000 7fa54b52f9c0 20 add_watcher() i=4 2024-09-12T00:54:48.709 INFO:tasks.workunit.client.0.smithi070.stderr: -50> 2024-09-12T00:54:48.567+0000 7fa54b52f9c0 20 add_watcher() i=5 2024-09-12T00:54:48.709 INFO:tasks.workunit.client.0.smithi070.stderr: -49> 2024-09-12T00:54:48.567+0000 7fa54b52f9c0 20 add_watcher() i=6 2024-09-12T00:54:48.709 INFO:tasks.workunit.client.0.smithi070.stderr: -48> 2024-09-12T00:54:48.567+0000 7fa54b52f9c0 20 add_watcher() i=7 2024-09-12T00:54:48.709 INFO:tasks.workunit.client.0.smithi070.stderr: -47> 2024-09-12T00:54:48.567+0000 7fa54b52f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:48.709 INFO:tasks.workunit.client.0.smithi070.stderr: -46> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding auth protocol: cephx 2024-09-12T00:54:48.709 INFO:tasks.workunit.client.0.smithi070.stderr: -45> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding auth protocol: cephx 2024-09-12T00:54:48.709 INFO:tasks.workunit.client.0.smithi070.stderr: -44> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding auth protocol: cephx 2024-09-12T00:54:48.710 INFO:tasks.workunit.client.0.smithi070.stderr: -43> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding con mode: secure 2024-09-12T00:54:48.710 INFO:tasks.workunit.client.0.smithi070.stderr: -42> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding con mode: crc 2024-09-12T00:54:48.710 INFO:tasks.workunit.client.0.smithi070.stderr: -41> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding con mode: secure 2024-09-12T00:54:48.710 INFO:tasks.workunit.client.0.smithi070.stderr: -40> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding con mode: crc 2024-09-12T00:54:48.710 INFO:tasks.workunit.client.0.smithi070.stderr: -39> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding con mode: secure 2024-09-12T00:54:48.710 INFO:tasks.workunit.client.0.smithi070.stderr: -38> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding con mode: crc 2024-09-12T00:54:48.710 INFO:tasks.workunit.client.0.smithi070.stderr: -37> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding con mode: crc 2024-09-12T00:54:48.710 INFO:tasks.workunit.client.0.smithi070.stderr: -36> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding con mode: secure 2024-09-12T00:54:48.710 INFO:tasks.workunit.client.0.smithi070.stderr: -35> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding con mode: crc 2024-09-12T00:54:48.710 INFO:tasks.workunit.client.0.smithi070.stderr: -34> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding con mode: secure 2024-09-12T00:54:48.710 INFO:tasks.workunit.client.0.smithi070.stderr: -33> 2024-09-12T00:54:48.571+0000 7fa3ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:48.710 INFO:tasks.workunit.client.0.smithi070.stderr: -32> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding con mode: crc 2024-09-12T00:54:48.710 INFO:tasks.workunit.client.0.smithi070.stderr: -31> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 AuthRegistry(0x7ffead834c70) adding con mode: secure 2024-09-12T00:54:48.711 INFO:tasks.workunit.client.0.smithi070.stderr: -30> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:48.711 INFO:tasks.workunit.client.0.smithi070.stderr: -29> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:48.711 INFO:tasks.workunit.client.0.smithi070.stderr: -28> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:48.711 INFO:tasks.workunit.client.0.smithi070.stderr: -27> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command cache list hook 0x5574ca09fc30 2024-09-12T00:54:48.711 INFO:tasks.workunit.client.0.smithi070.stderr: -26> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command cache inspect hook 0x5574ca09fc30 2024-09-12T00:54:48.711 INFO:tasks.workunit.client.0.smithi070.stderr: -25> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command cache erase hook 0x5574ca09fc30 2024-09-12T00:54:48.711 INFO:tasks.workunit.client.0.smithi070.stderr: -24> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command cache zap hook 0x5574ca09fc30 2024-09-12T00:54:48.711 INFO:tasks.workunit.client.0.smithi070.stderr: -23> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 note: GC not initialized 2024-09-12T00:54:48.711 INFO:tasks.workunit.client.0.smithi070.stderr: -22> 2024-09-12T00:54:48.571+0000 7fa3fe7e4640 20 reqs_thread_entry: start 2024-09-12T00:54:48.711 INFO:tasks.workunit.client.0.smithi070.stderr: -21> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command sync trace show hook 0x7fa540001290 2024-09-12T00:54:48.711 INFO:tasks.workunit.client.0.smithi070.stderr: -20> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command sync trace history hook 0x7fa540001290 2024-09-12T00:54:48.711 INFO:tasks.workunit.client.0.smithi070.stderr: -19> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command sync trace active hook 0x7fa540001290 2024-09-12T00:54:48.711 INFO:tasks.workunit.client.0.smithi070.stderr: -18> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 5 asok(0x5574c9dcc2b0) register_command sync trace active_short hook 0x7fa540001290 2024-09-12T00:54:48.712 INFO:tasks.workunit.client.0.smithi070.stderr: -17> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:48.712 INFO:tasks.workunit.client.0.smithi070.stderr: -16> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 20 Filter name: none 2024-09-12T00:54:48.712 INFO:tasks.workunit.client.0.smithi070.stderr: -15> 2024-09-12T00:54:48.571+0000 7fa36ffff640 20 reqs_thread_entry: start 2024-09-12T00:54:48.712 INFO:tasks.workunit.client.0.smithi070.stderr: -14> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:54:48.712 INFO:tasks.workunit.client.0.smithi070.stderr: -13> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.712 INFO:tasks.workunit.client.0.smithi070.stderr: -12> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:54:48.712 INFO:tasks.workunit.client.0.smithi070.stderr: -11> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:54:48.712 INFO:tasks.workunit.client.0.smithi070.stderr: -10> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:54:48.712 INFO:tasks.workunit.client.0.smithi070.stderr: -9> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 : miss 2024-09-12T00:54:48.712 INFO:tasks.workunit.client.0.smithi070.stderr: -8> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.712 INFO:tasks.workunit.client.0.smithi070.stderr: -7> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:54:48.712 INFO:tasks.workunit.client.0.smithi070.stderr: -6> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 info.flags=0x17 2024-09-12T00:54:48.713 INFO:tasks.workunit.client.0.smithi070.stderr: -5> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 to cache LRU end 2024-09-12T00:54:48.713 INFO:tasks.workunit.client.0.smithi070.stderr: -4> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:48.713 INFO:tasks.workunit.client.0.smithi070.stderr: -3> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:48.713 INFO:tasks.workunit.client.0.smithi070.stderr: -2> 2024-09-12T00:54:48.571+0000 7fa54b52f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 2024-09-12T00:54:48.713 INFO:tasks.workunit.client.0.smithi070.stderr: -1> 2024-09-12T00:54:48.579+0000 7fa54b52f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa54b52f9c0 time 2024-09-12T00:54:48.582534+0000 2024-09-12T00:54:48.713 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:48.713 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.713 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:48.713 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa54ee092eb] 2024-09-12T00:54:48.713 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa54ee0949f] 2024-09-12T00:54:48.714 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5574c8bf8cc1] 2024-09-12T00:54:48.714 INFO:tasks.workunit.client.0.smithi070.stderr: 4: radosgw-admin(+0x1422078) [0x5574c9656078] 2024-09-12T00:54:48.714 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5574c8c0dced] 2024-09-12T00:54:48.714 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:54:48.714 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa54dc6fd90] 2024-09-12T00:54:48.714 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:54:48.714 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:54:48.714 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.714 INFO:tasks.workunit.client.0.smithi070.stderr: 0> 2024-09-12T00:54:48.579+0000 7fa54b52f9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:54:48.714 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7fa54b52f9c0 thread_name:radosgw-admin 2024-09-12T00:54:48.714 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.714 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:48.714 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa54dc88520] 2024-09-12T00:54:48.715 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:54:48.715 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:54:48.715 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:54:48.715 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa54ee09345] 2024-09-12T00:54:48.715 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa54ee0949f] 2024-09-12T00:54:48.715 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5574c8bf8cc1] 2024-09-12T00:54:48.715 INFO:tasks.workunit.client.0.smithi070.stderr: 8: radosgw-admin(+0x1422078) [0x5574c9656078] 2024-09-12T00:54:48.715 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5574c8c0dced] 2024-09-12T00:54:48.715 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:54:48.715 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa54dc6fd90] 2024-09-12T00:54:48.715 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:54:48.715 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:54:48.715 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:54:48.716 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:48.716 INFO:tasks.workunit.client.0.smithi070.stderr:--- logging levels --- 2024-09-12T00:54:48.716 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 none 2024-09-12T00:54:48.716 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 lockdep 2024-09-12T00:54:48.716 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 context 2024-09-12T00:54:48.716 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 crush 2024-09-12T00:54:48.716 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds 2024-09-12T00:54:48.716 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_balancer 2024-09-12T00:54:48.716 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_locker 2024-09-12T00:54:48.716 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log 2024-09-12T00:54:48.716 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log_expire 2024-09-12T00:54:48.716 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_migrator 2024-09-12T00:54:48.717 INFO:tasks.workunit.client.0.smithi070.stderr: 3/ 5 mds_quiesce 2024-09-12T00:54:48.717 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 buffer 2024-09-12T00:54:48.717 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 timer 2024-09-12T00:54:48.717 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 filer 2024-09-12T00:54:48.717 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 striper 2024-09-12T00:54:48.717 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 objecter 2024-09-12T00:54:48.717 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rados 2024-09-12T00:54:48.718 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd 2024-09-12T00:54:48.718 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_mirror 2024-09-12T00:54:48.718 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_replay 2024-09-12T00:54:48.718 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_pwl 2024-09-12T00:54:48.718 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 journaler 2024-09-12T00:54:48.718 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objectcacher 2024-09-12T00:54:48.718 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:54:48.718 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 client 2024-09-12T00:54:48.718 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 osd 2024-09-12T00:54:48.718 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 optracker 2024-09-12T00:54:48.718 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objclass 2024-09-12T00:54:48.718 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 filestore 2024-09-12T00:54:48.719 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 journal 2024-09-12T00:54:48.719 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 ms 2024-09-12T00:54:48.719 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mon 2024-09-12T00:54:48.719 INFO:tasks.workunit.client.0.smithi070.stderr: 0/10 monc 2024-09-12T00:54:48.719 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 paxos 2024-09-12T00:54:48.719 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 tp 2024-09-12T00:54:48.719 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 auth 2024-09-12T00:54:48.719 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 crypto 2024-09-12T00:54:48.719 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 finisher 2024-09-12T00:54:48.719 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 reserver 2024-09-12T00:54:48.719 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 heartbeatmap 2024-09-12T00:54:48.719 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 perfcounter 2024-09-12T00:54:48.720 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw 2024-09-12T00:54:48.720 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_sync 2024-09-12T00:54:48.720 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_datacache 2024-09-12T00:54:48.720 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_access 2024-09-12T00:54:48.720 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:54:48.720 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_flight 2024-09-12T00:54:48.720 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:54:48.720 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw_notification 2024-09-12T00:54:48.720 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 javaclient 2024-09-12T00:54:48.720 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 asok 2024-09-12T00:54:48.720 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 throttle 2024-09-12T00:54:48.720 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 refs 2024-09-12T00:54:48.720 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 compressor 2024-09-12T00:54:48.720 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluestore 2024-09-12T00:54:48.721 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluefs 2024-09-12T00:54:48.721 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 bdev 2024-09-12T00:54:48.721 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 kstore 2024-09-12T00:54:48.721 INFO:tasks.workunit.client.0.smithi070.stderr: 4/ 5 rocksdb 2024-09-12T00:54:48.721 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 fuse 2024-09-12T00:54:48.721 INFO:tasks.workunit.client.0.smithi070.stderr: 2/ 5 mgr 2024-09-12T00:54:48.721 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mgrc 2024-09-12T00:54:48.721 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 dpdk 2024-09-12T00:54:48.721 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 eventtrace 2024-09-12T00:54:48.721 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 prioritycache 2024-09-12T00:54:48.721 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 test 2024-09-12T00:54:48.721 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:54:48.721 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephsqlite 2024-09-12T00:54:48.721 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:54:48.722 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore 2024-09-12T00:54:48.722 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_onode 2024-09-12T00:54:48.722 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_odata 2024-09-12T00:54:48.722 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_omap 2024-09-12T00:54:48.722 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_tm 2024-09-12T00:54:48.722 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_t 2024-09-12T00:54:48.722 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:54:48.722 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_epm 2024-09-12T00:54:48.722 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_lba 2024-09-12T00:54:48.722 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:54:48.722 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cache 2024-09-12T00:54:48.722 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_journal 2024-09-12T00:54:48.722 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_device 2024-09-12T00:54:48.722 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_backref 2024-09-12T00:54:48.722 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 alienstore 2024-09-12T00:54:48.723 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mclock 2024-09-12T00:54:48.723 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cyanstore 2024-09-12T00:54:48.723 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 ceph_exporter 2024-09-12T00:54:48.723 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 memstore 2024-09-12T00:54:48.723 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 trace 2024-09-12T00:54:48.724 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 ceph_dedup 2024-09-12T00:54:48.724 INFO:tasks.workunit.client.0.smithi070.stderr: -2/-2 (syslog threshold) 2024-09-12T00:54:48.724 INFO:tasks.workunit.client.0.smithi070.stderr: 99/99 (stderr threshold) 2024-09-12T00:54:48.724 INFO:tasks.workunit.client.0.smithi070.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:54:48.724 INFO:tasks.workunit.client.0.smithi070.stderr: 7fa36ffff640 / http_manager 2024-09-12T00:54:48.724 INFO:tasks.workunit.client.0.smithi070.stderr: 7fa3fe7e4640 / http_manager 2024-09-12T00:54:48.725 INFO:tasks.workunit.client.0.smithi070.stderr: 7fa3ff7e6640 / rgw_dt_lg_renew 2024-09-12T00:54:48.725 INFO:tasks.workunit.client.0.smithi070.stderr: 7fa41affd640 / ms_dispatch 2024-09-12T00:54:48.725 INFO:tasks.workunit.client.0.smithi070.stderr: 7fa42cff9640 / io_context_pool 2024-09-12T00:54:48.725 INFO:tasks.workunit.client.0.smithi070.stderr: 7fa42effd640 / ms_dispatch 2024-09-12T00:54:48.725 INFO:tasks.workunit.client.0.smithi070.stderr: 7fa435e03640 / ms_dispatch 2024-09-12T00:54:48.726 INFO:tasks.workunit.client.0.smithi070.stderr: 7fa437606640 / io_context_pool 2024-09-12T00:54:48.726 INFO:tasks.workunit.client.0.smithi070.stderr: 7fa548834640 / msgr-worker-2 2024-09-12T00:54:48.726 INFO:tasks.workunit.client.0.smithi070.stderr: 7fa549035640 / msgr-worker-1 2024-09-12T00:54:48.726 INFO:tasks.workunit.client.0.smithi070.stderr: 7fa549836640 / msgr-worker-0 2024-09-12T00:54:48.726 INFO:tasks.workunit.client.0.smithi070.stderr: 7fa54a037640 / io_context_pool 2024-09-12T00:54:48.727 INFO:tasks.workunit.client.0.smithi070.stderr: 7fa54b52f9c0 / radosgw-admin 2024-09-12T00:54:48.727 INFO:tasks.workunit.client.0.smithi070.stderr: max_recent 500 2024-09-12T00:54:48.727 INFO:tasks.workunit.client.0.smithi070.stderr: max_new 1000 2024-09-12T00:54:48.727 INFO:tasks.workunit.client.0.smithi070.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:54:48.585014Z_0bb9fe22-e4fb-4b2a-9df2-aee1f9b6bedf/log 2024-09-12T00:54:48.727 INFO:tasks.workunit.client.0.smithi070.stderr:--- end dump of recent events --- 2024-09-12T00:54:48.728 INFO:tasks.workunit.client.0.smithi070.stderr:Aborted 2024-09-12T00:54:48.728 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:54:48.729 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:48.729 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:48.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.859+0000 7fe51d2c8640 0 --2- 172.21.15.70:0/794815426 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x555939c46e50 0x555939e5ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:54:48.857 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.863+0000 7fe51f7c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.860 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.867+0000 7fe51f7c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.860 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.867+0000 7fe51f7c29c0 20 realm 2024-09-12T00:54:48.860 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.867+0000 7fe51f7c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.861 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.867+0000 7fe51f7c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.861 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.867+0000 7fe51f7c29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:48.861 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.867+0000 7fe51f7c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.861 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.867+0000 7fe51f7c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.861 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.867+0000 7fe51f7c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.863 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.867+0000 7fe51f7c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:48.863 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.867+0000 7fe51f7c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.864 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.871+0000 7fe51f7c29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:48.864 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.871+0000 7fe51f7c29c0 20 searching for the correct realm 2024-09-12T00:54:48.869 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:48.875+0000 7fe51dac9640 0 -- 172.21.15.70:0/794815426 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fe514039ba0 msgr2=0x7fe51402f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:49.086 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.091+0000 7fe51dac9640 0 -- 172.21.15.70:0/794815426 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fe514039ba0 msgr2=0x7fe51402f920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:49.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.103+0000 7fe51f7c29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:49.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.103+0000 7fe51f7c29c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:49.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.103+0000 7fe51f7c29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:49.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.103+0000 7fe51f7c29c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:49.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.103+0000 7fe51f7c29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:49.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.103+0000 7fe51f7c29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:49.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.103+0000 7fe51f7c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.103+0000 7fe51f7c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:49.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.103+0000 7fe51f7c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.099 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.103+0000 7fe51f7c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:49.099 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.103+0000 7fe51f7c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.100 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.103+0000 7fe51f7c29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:49.100 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.103+0000 7fe51f7c29c0 20 zone default found 2024-09-12T00:54:49.100 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.103+0000 7fe51f7c29c0 4 Realm: () 2024-09-12T00:54:49.100 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.103+0000 7fe51f7c29c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:49.100 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.103+0000 7fe51f7c29c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:49.100 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.103+0000 7fe51f7c29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:49.100 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.103+0000 7fe51f7c29c0 20 zonegroup default 2024-09-12T00:54:49.101 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.103+0000 7fe51f7c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.101 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.107+0000 7fe51f7c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:49.101 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.107+0000 7fe51f7c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.101 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.107+0000 7fe51f7c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:49.101 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.107+0000 7fe51f7c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.102 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.107+0000 7fe51f7c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:49.102 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.107+0000 7fe51f7c29c0 20 started sync module instance, tier type = 2024-09-12T00:54:49.102 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.107+0000 7fe51f7c29c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:49.124 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.127+0000 7fe51f7c29c0 20 add_watcher() i=0 2024-09-12T00:54:49.124 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.127+0000 7fe51f7c29c0 20 add_watcher() i=1 2024-09-12T00:54:49.124 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.127+0000 7fe51f7c29c0 20 add_watcher() i=2 2024-09-12T00:54:49.124 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.127+0000 7fe51f7c29c0 20 add_watcher() i=3 2024-09-12T00:54:49.124 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.127+0000 7fe51f7c29c0 20 add_watcher() i=4 2024-09-12T00:54:49.124 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.127+0000 7fe51f7c29c0 20 add_watcher() i=5 2024-09-12T00:54:49.124 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.127+0000 7fe51f7c29c0 20 add_watcher() i=6 2024-09-12T00:54:49.126 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.131+0000 7fe51f7c29c0 20 add_watcher() i=7 2024-09-12T00:54:49.126 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.131+0000 7fe51f7c29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:49.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.135+0000 7fe3d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:49.131 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.135+0000 7fe51f7c29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:49.131 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.135+0000 7fe51f7c29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:49.131 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.135+0000 7fe51f7c29c0 5 note: GC not initialized 2024-09-12T00:54:49.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.135+0000 7fe3d27e4640 20 reqs_thread_entry: start 2024-09-12T00:54:49.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.135+0000 7fe51f7c29c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:49.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.139+0000 7fe51f7c29c0 20 Filter name: none 2024-09-12T00:54:49.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.139+0000 7fe343fff640 20 reqs_thread_entry: start 2024-09-12T00:54:49.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.139+0000 7fe51f7c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.139+0000 7fe51f7c29c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:54:49.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.139+0000 7fe51f7c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.134 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.139+0000 7fe51f7c29c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:54:49.134 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.139+0000 7fe51f7c29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:49.134 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.139+0000 7fe51f7c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.135 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.139+0000 7fe51f7c29c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:54:49.135 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.139+0000 7fe51f7c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.135 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.139+0000 7fe51f7c29c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:54:49.136 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.139+0000 7fe51f7c29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:49.138 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.143+0000 7fe3d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:49.142 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.147+0000 7fe51f7c29c0 20 remove_watcher() i=0 2024-09-12T00:54:49.142 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.147+0000 7fe51f7c29c0 2 removed watcher, disabling cache 2024-09-12T00:54:49.145 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.151+0000 7fe51f7c29c0 20 remove_watcher() i=1 2024-09-12T00:54:49.147 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.151+0000 7fe51f7c29c0 20 remove_watcher() i=2 2024-09-12T00:54:49.149 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.155+0000 7fe51f7c29c0 20 remove_watcher() i=3 2024-09-12T00:54:49.151 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.155+0000 7fe51f7c29c0 20 remove_watcher() i=4 2024-09-12T00:54:49.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.159+0000 7fe51f7c29c0 20 remove_watcher() i=5 2024-09-12T00:54:49.154 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.159+0000 7fe51f7c29c0 20 remove_watcher() i=6 2024-09-12T00:54:49.156 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.159+0000 7fe51f7c29c0 20 remove_watcher() i=7 2024-09-12T00:54:49.170 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:49.170 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:54:49.170 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: abort-at-set-target-layout id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:54:49.170 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:54:49.171 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:49.171 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:49.185 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:54:49.185 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:54:49.233 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:54:49.269 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:49.269 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:49.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.319+0000 7f708a3429c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.319+0000 7f708a3429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:49.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.319+0000 7f708a3429c0 20 realm 2024-09-12T00:54:49.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.319+0000 7f708a3429c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.319+0000 7f708a3429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:49.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.319+0000 7f708a3429c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:49.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.319+0000 7f708a3429c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.323+0000 7f708a3429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:49.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.323+0000 7f708a3429c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.323+0000 7f708a3429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:49.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.323+0000 7f708a3429c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.319 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.323+0000 7f708a3429c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:49.319 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.323+0000 7f708a3429c0 20 searching for the correct realm 2024-09-12T00:54:49.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.327+0000 7f7088649640 0 -- 172.21.15.70:0/815270743 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f707c05ce20 msgr2=0x7f707c05b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:49.535 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.539+0000 7f7087647640 0 -- 172.21.15.70:0/815270743 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7f6f500808b0 msgr2=0x7f6f50082d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:49.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.555+0000 7f708a3429c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:49.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.555+0000 7f708a3429c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:54:49.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.555+0000 7f708a3429c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:49.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.555+0000 7f708a3429c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:54:49.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.555+0000 7f708a3429c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:49.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.555+0000 7f708a3429c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:49.551 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.555+0000 7f708a3429c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.551 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.555+0000 7f708a3429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:49.551 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.555+0000 7f708a3429c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.551 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.555+0000 7f708a3429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:49.551 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.555+0000 7f708a3429c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.552 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.555+0000 7f708a3429c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:49.552 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.555+0000 7f708a3429c0 20 zone default found 2024-09-12T00:54:49.552 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.555+0000 7f708a3429c0 4 Realm: () 2024-09-12T00:54:49.552 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.555+0000 7f708a3429c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:54:49.552 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.555+0000 7f708a3429c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:54:49.552 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.555+0000 7f708a3429c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:49.552 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.555+0000 7f708a3429c0 20 zonegroup default 2024-09-12T00:54:49.552 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.555+0000 7f708a3429c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.553 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.559+0000 7f708a3429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:49.553 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.559+0000 7f708a3429c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.553 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.559+0000 7f708a3429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:49.553 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.559+0000 7f708a3429c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.554 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.559+0000 7f708a3429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:49.554 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.559+0000 7f708a3429c0 20 started sync module instance, tier type = 2024-09-12T00:54:49.554 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.559+0000 7f708a3429c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:54:49.576 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.579+0000 7f708a3429c0 20 add_watcher() i=0 2024-09-12T00:54:49.577 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.579+0000 7f708a3429c0 20 add_watcher() i=1 2024-09-12T00:54:49.577 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.579+0000 7f708a3429c0 20 add_watcher() i=2 2024-09-12T00:54:49.577 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.579+0000 7f708a3429c0 20 add_watcher() i=3 2024-09-12T00:54:49.577 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.579+0000 7f708a3429c0 20 add_watcher() i=4 2024-09-12T00:54:49.577 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.579+0000 7f708a3429c0 20 add_watcher() i=5 2024-09-12T00:54:49.577 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.583+0000 7f708a3429c0 20 add_watcher() i=6 2024-09-12T00:54:49.578 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.583+0000 7f708a3429c0 20 add_watcher() i=7 2024-09-12T00:54:49.579 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.583+0000 7f708a3429c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:49.582 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.587+0000 7f6f3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:49.583 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.587+0000 7f708a3429c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:49.583 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.587+0000 7f708a3429c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:49.584 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.587+0000 7f708a3429c0 5 note: GC not initialized 2024-09-12T00:54:49.584 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.587+0000 7f6f3cfe1640 20 reqs_thread_entry: start 2024-09-12T00:54:49.584 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.591+0000 7f708a3429c0 20 init_complete bucket index max shards: 1 2024-09-12T00:54:49.584 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.591+0000 7f708a3429c0 20 Filter name: none 2024-09-12T00:54:49.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.591+0000 7f6eb67fc640 20 reqs_thread_entry: start 2024-09-12T00:54:49.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.591+0000 7f708a3429c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:54:49.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.591+0000 7f708a3429c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.591+0000 7f708a3429c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:54:49.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.591+0000 7f708a3429c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:54:49.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.591+0000 7f708a3429c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:54:49.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.591+0000 7f708a3429c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 : miss 2024-09-12T00:54:49.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.591+0000 7f708a3429c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.591+0000 7f708a3429c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:54:49.587 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.591+0000 7f708a3429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 info.flags=0x17 2024-09-12T00:54:49.587 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.591+0000 7f708a3429c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 to cache LRU end 2024-09-12T00:54:49.587 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.591+0000 7f708a3429c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:49.587 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.591+0000 7f708a3429c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:54:49.587 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.591+0000 7f708a3429c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 2024-09-12T00:54:49.588 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.595+0000 7f708a3429c0 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 to be held by another RGW process; skipping for now 2024-09-12T00:54:49.590 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.595+0000 7f6f3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:49.595 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.599+0000 7f708a3429c0 20 remove_watcher() i=0 2024-09-12T00:54:49.595 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.599+0000 7f708a3429c0 2 removed watcher, disabling cache 2024-09-12T00:54:49.598 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.603+0000 7f708a3429c0 20 remove_watcher() i=1 2024-09-12T00:54:49.600 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.603+0000 7f708a3429c0 20 remove_watcher() i=2 2024-09-12T00:54:49.602 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.607+0000 7f708a3429c0 20 remove_watcher() i=3 2024-09-12T00:54:49.604 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.607+0000 7f708a3429c0 20 remove_watcher() i=4 2024-09-12T00:54:49.605 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.611+0000 7f708a3429c0 20 remove_watcher() i=5 2024-09-12T00:54:49.607 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.611+0000 7f708a3429c0 20 remove_watcher() i=6 2024-09-12T00:54:49.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:54:49.615+0000 7f708a3429c0 20 remove_watcher() i=7 2024-09-12T00:54:49.633 INFO:tasks.workunit.client.0.smithi070.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:55:19.645 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:55:19.682 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:19.683 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:19.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.734+0000 7f455334b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:19.729 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.738+0000 7f455334b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:19.729 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.738+0000 7f455334b9c0 20 realm 2024-09-12T00:55:19.730 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.738+0000 7f455334b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:19.730 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.738+0000 7f455334b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:19.730 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.738+0000 7f455334b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:19.730 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.738+0000 7f455334b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:19.730 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.738+0000 7f455334b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:19.730 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.738+0000 7f455334b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:19.731 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.738+0000 7f455334b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:19.731 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.738+0000 7f455334b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:19.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.742+0000 7f455334b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:19.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.742+0000 7f455334b9c0 20 searching for the correct realm 2024-09-12T00:55:19.736 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.746+0000 7f4551652640 0 -- 172.21.15.70:0/842350413 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f4538078bc0 msgr2=0x7f453805cc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:19.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.962+0000 7f4551652640 0 -- 172.21.15.70:0/842350413 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f4538078bc0 msgr2=0x7f453805cc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:19.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.974+0000 7f455334b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:19.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.974+0000 7f455334b9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:19.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.974+0000 7f455334b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:19.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.974+0000 7f455334b9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:19.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.974+0000 7f455334b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:19.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.974+0000 7f455334b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:19.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.974+0000 7f455334b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:19.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.974+0000 7f455334b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:19.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.974+0000 7f455334b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:19.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.974+0000 7f455334b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:19.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.974+0000 7f455334b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:19.970 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.978+0000 7f455334b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:19.970 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.978+0000 7f455334b9c0 20 zone default found 2024-09-12T00:55:19.970 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.978+0000 7f455334b9c0 4 Realm: () 2024-09-12T00:55:19.970 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.978+0000 7f455334b9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:19.970 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.978+0000 7f455334b9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:19.971 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.978+0000 7f455334b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:19.971 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.978+0000 7f455334b9c0 20 zonegroup default 2024-09-12T00:55:19.971 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.978+0000 7f455334b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:19.971 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.978+0000 7f455334b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:19.971 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.978+0000 7f455334b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:19.972 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.978+0000 7f455334b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:19.972 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.978+0000 7f455334b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:19.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.978+0000 7f455334b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:19.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.978+0000 7f455334b9c0 20 started sync module instance, tier type = 2024-09-12T00:55:19.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:19.978+0000 7f455334b9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:19.994 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.002+0000 7f455334b9c0 20 add_watcher() i=0 2024-09-12T00:55:19.994 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.002+0000 7f455334b9c0 20 add_watcher() i=1 2024-09-12T00:55:19.994 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.002+0000 7f455334b9c0 20 add_watcher() i=2 2024-09-12T00:55:19.995 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.002+0000 7f455334b9c0 20 add_watcher() i=3 2024-09-12T00:55:19.995 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.002+0000 7f455334b9c0 20 add_watcher() i=4 2024-09-12T00:55:19.995 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.002+0000 7f455334b9c0 20 add_watcher() i=5 2024-09-12T00:55:19.995 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.002+0000 7f455334b9c0 20 add_watcher() i=6 2024-09-12T00:55:19.996 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.006+0000 7f455334b9c0 20 add_watcher() i=7 2024-09-12T00:55:19.996 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.006+0000 7f455334b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:20.002 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.010+0000 7f4406fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:20.003 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.010+0000 7f455334b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:20.003 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.010+0000 7f455334b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:20.003 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.010+0000 7f455334b9c0 5 note: GC not initialized 2024-09-12T00:55:20.004 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.010+0000 7f4405fe3640 20 reqs_thread_entry: start 2024-09-12T00:55:20.004 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.010+0000 7f455334b9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:20.004 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.010+0000 7f455334b9c0 20 Filter name: none 2024-09-12T00:55:20.004 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.010+0000 7f43777fe640 20 reqs_thread_entry: start 2024-09-12T00:55:20.004 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.010+0000 7f455334b9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:55:20.004 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.010+0000 7f455334b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.005 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.014+0000 7f455334b9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:55:20.005 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.014+0000 7f455334b9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:55:20.005 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.014+0000 7f455334b9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:55:20.005 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.014+0000 7f455334b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 : miss 2024-09-12T00:55:20.005 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.014+0000 7f455334b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.006 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.014+0000 7f455334b9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:55:20.006 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.014+0000 7f455334b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 info.flags=0x17 2024-09-12T00:55:20.006 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.014+0000 7f455334b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 to cache LRU end 2024-09-12T00:55:20.006 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.014+0000 7f455334b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:20.006 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.014+0000 7f455334b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:20.006 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.014+0000 7f455334b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 2024-09-12T00:55:20.012 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.022+0000 7f455334b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 info.flags=0x17 2024-09-12T00:55:20.012 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.022+0000 7f455334b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 to cache LRU end 2024-09-12T00:55:20.012 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.022+0000 7f455334b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:20.012 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.022+0000 7f455334b9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25, ofs0, ns] 2024-09-12T00:55:20.013 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.022+0000 7f44277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431588 cookie 94368478291072 notifier 6711 bl.length()=1009 2024-09-12T00:55:20.013 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.022+0000 7f44277fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 info.flags=0x17 2024-09-12T00:55:20.013 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.022+0000 7f44277fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 to cache LRU end 2024-09-12T00:55:20.013 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.022+0000 7f44277fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:20.013 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.022+0000 7f455334b9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25]): orig_sources= new_sources= 2024-09-12T00:55:20.013 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.022+0000 7f455334b9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25]): potential sources added=[] removed=[] 2024-09-12T00:55:20.014 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.022+0000 7f455334b9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25]): orig_dests= new_dests= 2024-09-12T00:55:20.014 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.022+0000 7f455334b9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25]): potential dests added=[] removed=[] 2024-09-12T00:55:20.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.026+0000 7f455334b9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25.1.0 2024-09-12T00:55:20.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.026+0000 7f455334b9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25.1.0 2024-09-12T00:55:20.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.026+0000 7f455334b9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25.1.1 2024-09-12T00:55:20.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.026+0000 7f455334b9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25.1.1 2024-09-12T00:55:20.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.026+0000 7f455334b9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25.0 2024-09-12T00:55:20.024 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.034+0000 7f455334b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 : hit (requested=0x17, cached=0x17) 2024-09-12T00:55:20.024 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.034+0000 7f455334b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 2024-09-12T00:55:20.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.034+0000 7f455334b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 info.flags=0x17 2024-09-12T00:55:20.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.034+0000 7f455334b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 to cache LRU end 2024-09-12T00:55:20.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.034+0000 7f455334b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:20.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.034+0000 7f455334b9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25, ofs0, ns] 2024-09-12T00:55:20.028 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.034+0000 7f44277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431589 cookie 94368478291072 notifier 6711 bl.length()=1009 2024-09-12T00:55:20.028 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.034+0000 7f44277fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 info.flags=0x17 2024-09-12T00:55:20.028 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.034+0000 7f44277fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 to cache LRU end 2024-09-12T00:55:20.028 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.034+0000 7f44277fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:20.028 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.034+0000 7f455334b9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25]): orig_sources= new_sources= 2024-09-12T00:55:20.028 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.034+0000 7f455334b9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25]): potential sources added=[] removed=[] 2024-09-12T00:55:20.028 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.034+0000 7f455334b9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25]): orig_dests= new_dests= 2024-09-12T00:55:20.028 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.034+0000 7f455334b9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25]): potential dests added=[] removed=[] 2024-09-12T00:55:20.030 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.038+0000 7f455334b9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25.0 2024-09-12T00:55:20.031 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.038+0000 7f455334b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 : hit (requested=0x17, cached=0x17) 2024-09-12T00:55:20.031 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.038+0000 7f455334b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 2024-09-12T00:55:20.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.042+0000 7f455334b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 info.flags=0x17 2024-09-12T00:55:20.034 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.042+0000 7f455334b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 to cache LRU end 2024-09-12T00:55:20.034 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.042+0000 7f455334b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:20.034 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.042+0000 7f455334b9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25, ofs0, ns] 2024-09-12T00:55:20.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.042+0000 7f44277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431590 cookie 94368478291072 notifier 6711 bl.length()=977 2024-09-12T00:55:20.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.042+0000 7f44277fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 info.flags=0x17 2024-09-12T00:55:20.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.042+0000 7f44277fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 to cache LRU end 2024-09-12T00:55:20.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.042+0000 7f44277fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:20.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.042+0000 7f455334b9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25]): orig_sources= new_sources= 2024-09-12T00:55:20.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.042+0000 7f455334b9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25]): potential sources added=[] removed=[] 2024-09-12T00:55:20.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.042+0000 7f455334b9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25]): orig_dests= new_dests= 2024-09-12T00:55:20.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.042+0000 7f455334b9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25]): potential dests added=[] removed=[] 2024-09-12T00:55:20.037 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.046+0000 7f455334b9c0 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:55:20.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.050+0000 7f4406fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:20.045 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.054+0000 7f455334b9c0 20 remove_watcher() i=0 2024-09-12T00:55:20.045 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.054+0000 7f455334b9c0 2 removed watcher, disabling cache 2024-09-12T00:55:20.047 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.054+0000 7f455334b9c0 20 remove_watcher() i=1 2024-09-12T00:55:20.049 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.058+0000 7f455334b9c0 20 remove_watcher() i=2 2024-09-12T00:55:20.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.058+0000 7f455334b9c0 20 remove_watcher() i=3 2024-09-12T00:55:20.053 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.062+0000 7f455334b9c0 20 remove_watcher() i=4 2024-09-12T00:55:20.055 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.062+0000 7f455334b9c0 20 remove_watcher() i=5 2024-09-12T00:55:20.056 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.066+0000 7f455334b9c0 20 remove_watcher() i=6 2024-09-12T00:55:20.058 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.066+0000 7f455334b9c0 20 remove_watcher() i=7 2024-09-12T00:55:20.072 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:55:20.102 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:20.102 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:20.145 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.154+0000 7fa6595879c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.146 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.154+0000 7fa6595879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:20.147 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.154+0000 7fa6595879c0 20 realm 2024-09-12T00:55:20.147 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.154+0000 7fa6595879c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.147 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.154+0000 7fa6595879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:20.147 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.154+0000 7fa6595879c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:20.147 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.154+0000 7fa6595879c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.147 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.154+0000 7fa6595879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:20.147 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.154+0000 7fa6595879c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.148 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.158+0000 7fa6595879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:20.148 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.158+0000 7fa6595879c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.149 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.158+0000 7fa6595879c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:20.149 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.158+0000 7fa6595879c0 20 searching for the correct realm 2024-09-12T00:55:20.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.162+0000 7fa65788e640 0 -- 172.21.15.70:0/3599184556 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fa640008040 msgr2=0x7fa64003e420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:20.163 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.170+0000 7fa65788e640 0 -- 172.21.15.70:0/3599184556 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fa520080880 msgr2=0x7fa520082cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:20.171 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.178+0000 7fa6595879c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:20.171 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.178+0000 7fa6595879c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:20.171 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.178+0000 7fa6595879c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:20.172 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.178+0000 7fa6595879c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:20.172 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.178+0000 7fa6595879c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:20.172 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.178+0000 7fa6595879c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:20.172 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.178+0000 7fa6595879c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.172 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.178+0000 7fa6595879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:20.173 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.178+0000 7fa6595879c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.173 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.178+0000 7fa6595879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:20.173 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.178+0000 7fa6595879c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.175 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.178+0000 7fa6595879c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:20.175 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.178+0000 7fa6595879c0 20 zone default found 2024-09-12T00:55:20.175 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.178+0000 7fa6595879c0 4 Realm: () 2024-09-12T00:55:20.175 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.178+0000 7fa6595879c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:20.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.178+0000 7fa6595879c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:20.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.178+0000 7fa6595879c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:20.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.178+0000 7fa6595879c0 20 zonegroup default 2024-09-12T00:55:20.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.178+0000 7fa6595879c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.178+0000 7fa6595879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:20.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.178+0000 7fa6595879c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.182+0000 7fa6595879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:20.177 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.182+0000 7fa6595879c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.177 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.182+0000 7fa6595879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:20.177 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.182+0000 7fa6595879c0 20 started sync module instance, tier type = 2024-09-12T00:55:20.177 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.182+0000 7fa6595879c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:20.188 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.194+0000 7fa6595879c0 20 add_watcher() i=0 2024-09-12T00:55:20.188 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.194+0000 7fa6595879c0 20 add_watcher() i=1 2024-09-12T00:55:20.188 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.194+0000 7fa6595879c0 20 add_watcher() i=2 2024-09-12T00:55:20.188 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.194+0000 7fa6595879c0 20 add_watcher() i=3 2024-09-12T00:55:20.188 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.194+0000 7fa6595879c0 20 add_watcher() i=4 2024-09-12T00:55:20.188 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.194+0000 7fa6595879c0 20 add_watcher() i=5 2024-09-12T00:55:20.189 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.194+0000 7fa6595879c0 20 add_watcher() i=6 2024-09-12T00:55:20.189 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.198+0000 7fa6595879c0 20 add_watcher() i=7 2024-09-12T00:55:20.189 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.198+0000 7fa6595879c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:20.191 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.198+0000 7fa50e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:20.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.202+0000 7fa6595879c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:20.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.202+0000 7fa6595879c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:20.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.202+0000 7fa6595879c0 5 note: GC not initialized 2024-09-12T00:55:20.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.202+0000 7fa50d7e2640 20 reqs_thread_entry: start 2024-09-12T00:55:20.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.202+0000 7fa6595879c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:20.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.202+0000 7fa6595879c0 20 Filter name: none 2024-09-12T00:55:20.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.202+0000 7fa5067fc640 20 reqs_thread_entry: start 2024-09-12T00:55:20.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.202+0000 7fa6595879c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.194 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.202+0000 7fa6595879c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:55:20.194 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.202+0000 7fa6595879c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.194 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.202+0000 7fa6595879c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:55:20.194 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.202+0000 7fa6595879c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:20.194 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.202+0000 7fa6595879c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.195 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.202+0000 7fa6595879c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:55:20.195 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.202+0000 7fa6595879c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.202+0000 7fa6595879c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:55:20.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.202+0000 7fa6595879c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:20.197 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.206+0000 7fa50e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:20.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.210+0000 7fa6595879c0 20 remove_watcher() i=0 2024-09-12T00:55:20.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.210+0000 7fa6595879c0 2 removed watcher, disabling cache 2024-09-12T00:55:20.206 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.214+0000 7fa6595879c0 20 remove_watcher() i=1 2024-09-12T00:55:20.208 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.218+0000 7fa6595879c0 20 remove_watcher() i=2 2024-09-12T00:55:20.210 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.218+0000 7fa6595879c0 20 remove_watcher() i=3 2024-09-12T00:55:20.212 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.218+0000 7fa6595879c0 20 remove_watcher() i=4 2024-09-12T00:55:20.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.222+0000 7fa6595879c0 20 remove_watcher() i=5 2024-09-12T00:55:20.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.222+0000 7fa6595879c0 20 remove_watcher() i=6 2024-09-12T00:55:20.215 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.222+0000 7fa6595879c0 20 remove_watcher() i=7 2024-09-12T00:55:20.228 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:20.228 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:55:20.228 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: abort-at-set-target-layout id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:55:20.228 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:20.229 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:20.229 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:20.232 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:20.233 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:20.282 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:20.282 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:20.305 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-12T00:55:20.305 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:20.306 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:20.306 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:20.326 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:20.326 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:20.372 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:20.372 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:20.386 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:20.386 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:20.403 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:20.404 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:20.422 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:20.422 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:20.442 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:20.442 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:20.461 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:20.461 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:20.479 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:20.479 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:20.498 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:20.499 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:20.517 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:20.517 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:20.536 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:20.536 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:20.555 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:20.555 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:20.574 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:20.575 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:20.594 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:20.594 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:20.613 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:20.613 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:20.633 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:20.633 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:20.704 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:20.704 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:20.722 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:20.722 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:20.741 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:20.741 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:20.759 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:20.759 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:20.778 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:20.778 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:20.794 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:55:20.827 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:20.827 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:20.870 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.878+0000 7fafb935f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.872 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.878+0000 7fafb935f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:20.872 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.878+0000 7fafb935f9c0 20 realm 2024-09-12T00:55:20.872 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.878+0000 7fafb935f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.872 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.878+0000 7fafb935f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:20.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.878+0000 7fafb935f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:20.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.878+0000 7fafb935f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.882+0000 7fafb935f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:20.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.882+0000 7fafb935f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.874 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.882+0000 7fafb935f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:20.874 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.882+0000 7fafb935f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.882+0000 7fafb935f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:20.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.882+0000 7fafb935f9c0 20 searching for the correct realm 2024-09-12T00:55:20.881 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.890+0000 7fafb7666640 0 -- 172.21.15.70:0/2110261061 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fafa000e070 msgr2=0x7fafa005b550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:20.890 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.898+0000 7fafb6e65640 0 -- 172.21.15.70:0/2110261061 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7fafb002e040 msgr2=0x7fafb003ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:55:20.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.906+0000 7fafb935f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:20.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.906+0000 7fafb935f9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:20.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.906+0000 7fafb935f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:20.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.906+0000 7fafb935f9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:20.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.906+0000 7fafb935f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:20.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.906+0000 7fafb935f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:20.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.906+0000 7fafb935f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.906+0000 7fafb935f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:20.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.906+0000 7fafb935f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.906+0000 7fafb935f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:20.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.906+0000 7fafb935f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.910+0000 7fafb935f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:20.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.910+0000 7fafb935f9c0 20 zone default found 2024-09-12T00:55:20.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.910+0000 7fafb935f9c0 4 Realm: () 2024-09-12T00:55:20.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.910+0000 7fafb935f9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:20.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.910+0000 7fafb935f9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:20.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.910+0000 7fafb935f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:20.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.910+0000 7fafb935f9c0 20 zonegroup default 2024-09-12T00:55:20.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.910+0000 7fafb935f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.910+0000 7fafb935f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:20.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.910+0000 7fafb935f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.910+0000 7fafb935f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:20.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.910+0000 7fafb935f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.910+0000 7fafb935f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:20.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.910+0000 7fafb935f9c0 20 started sync module instance, tier type = 2024-09-12T00:55:20.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.910+0000 7fafb935f9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:20.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.926+0000 7fafb935f9c0 20 add_watcher() i=0 2024-09-12T00:55:20.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.926+0000 7fafb935f9c0 20 add_watcher() i=1 2024-09-12T00:55:20.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.926+0000 7fafb935f9c0 20 add_watcher() i=2 2024-09-12T00:55:20.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.926+0000 7fafb935f9c0 20 add_watcher() i=3 2024-09-12T00:55:20.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.926+0000 7fafb935f9c0 20 add_watcher() i=4 2024-09-12T00:55:20.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.926+0000 7fafb935f9c0 20 add_watcher() i=5 2024-09-12T00:55:20.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.926+0000 7fafb935f9c0 20 add_watcher() i=6 2024-09-12T00:55:20.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.926+0000 7fafb935f9c0 20 add_watcher() i=7 2024-09-12T00:55:20.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.926+0000 7fafb935f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:20.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.930+0000 7fae6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:20.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.930+0000 7fafb935f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:20.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.930+0000 7fafb935f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:20.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.930+0000 7fafb935f9c0 5 note: GC not initialized 2024-09-12T00:55:20.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.930+0000 7fade7fff640 20 reqs_thread_entry: start 2024-09-12T00:55:20.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.930+0000 7fafb935f9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:20.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.930+0000 7fafb935f9c0 20 Filter name: none 2024-09-12T00:55:20.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.930+0000 7fade5ffb640 20 reqs_thread_entry: start 2024-09-12T00:55:20.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.930+0000 7fafb935f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.930+0000 7fafb935f9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:55:20.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.930+0000 7fafb935f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.930+0000 7fafb935f9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:55:20.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.930+0000 7fafb935f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:20.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.930+0000 7fafb935f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.924 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.934+0000 7fafb935f9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:55:20.924 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.934+0000 7fafb935f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:20.925 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.934+0000 7fafb935f9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:55:20.925 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.934+0000 7fafb935f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:20.927 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.934+0000 7fae6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:20.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.938+0000 7fafb935f9c0 20 remove_watcher() i=0 2024-09-12T00:55:20.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.938+0000 7fafb935f9c0 2 removed watcher, disabling cache 2024-09-12T00:55:20.934 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.942+0000 7fafb935f9c0 20 remove_watcher() i=1 2024-09-12T00:55:20.936 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.942+0000 7fafb935f9c0 20 remove_watcher() i=2 2024-09-12T00:55:20.938 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.946+0000 7fafb935f9c0 20 remove_watcher() i=3 2024-09-12T00:55:20.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.950+0000 7fafb935f9c0 20 remove_watcher() i=4 2024-09-12T00:55:20.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.950+0000 7fafb935f9c0 20 remove_watcher() i=5 2024-09-12T00:55:20.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.950+0000 7fafb935f9c0 20 remove_watcher() i=6 2024-09-12T00:55:20.944 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:20.954+0000 7fafb935f9c0 20 remove_watcher() i=7 2024-09-12T00:55:20.957 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:20.958 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:55:20.958 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-trim-reshard-log-entries id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:55:20.958 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:20.958 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-12T00:55:20.991 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:20.991 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:21.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.042+0000 7f5e87bb69c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.042+0000 7f5e87bb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.042+0000 7f5e87bb69c0 20 realm 2024-09-12T00:55:21.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.042+0000 7f5e87bb69c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.042+0000 7f5e87bb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.042+0000 7f5e87bb69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:21.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.042+0000 7f5e87bb69c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.042+0000 7f5e87bb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.042+0000 7f5e87bb69c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.037 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.046+0000 7f5e87bb69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:21.037 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.046+0000 7f5e87bb69c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.038 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.046+0000 7f5e87bb69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:21.038 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.046+0000 7f5e87bb69c0 20 searching for the correct realm 2024-09-12T00:55:21.042 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.050+0000 7f5e85ebd640 0 -- 172.21.15.70:0/3824928074 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f5e7c03d040 msgr2=0x7f5e7c01a420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:21.049 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.058+0000 7f5e85ebd640 0 -- 172.21.15.70:0/3824928074 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f5d50080880 msgr2=0x7f5d50082cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:21.057 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.066+0000 7f5e87bb69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:21.057 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.066+0000 7f5e87bb69c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:21.057 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.066+0000 7f5e87bb69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:21.057 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.066+0000 7f5e87bb69c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:21.057 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.066+0000 7f5e87bb69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:21.058 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.066+0000 7f5e87bb69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:21.058 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.066+0000 7f5e87bb69c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.058 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.066+0000 7f5e87bb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.058 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.066+0000 7f5e87bb69c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.059 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.066+0000 7f5e87bb69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:21.059 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.066+0000 7f5e87bb69c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.059 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.066+0000 7f5e87bb69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:21.059 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.066+0000 7f5e87bb69c0 20 zone default found 2024-09-12T00:55:21.059 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.066+0000 7f5e87bb69c0 4 Realm: () 2024-09-12T00:55:21.059 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.066+0000 7f5e87bb69c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:21.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.066+0000 7f5e87bb69c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:21.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.066+0000 7f5e87bb69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:21.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.066+0000 7f5e87bb69c0 20 zonegroup default 2024-09-12T00:55:21.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.066+0000 7f5e87bb69c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.066+0000 7f5e87bb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.066+0000 7f5e87bb69c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.066+0000 7f5e87bb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.066+0000 7f5e87bb69c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.066+0000 7f5e87bb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.061 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.066+0000 7f5e87bb69c0 20 started sync module instance, tier type = 2024-09-12T00:55:21.061 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.066+0000 7f5e87bb69c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:21.074 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.082+0000 7f5e87bb69c0 20 add_watcher() i=0 2024-09-12T00:55:21.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.082+0000 7f5e87bb69c0 20 add_watcher() i=1 2024-09-12T00:55:21.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.082+0000 7f5e87bb69c0 20 add_watcher() i=2 2024-09-12T00:55:21.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.082+0000 7f5e87bb69c0 20 add_watcher() i=3 2024-09-12T00:55:21.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.082+0000 7f5e87bb69c0 20 add_watcher() i=4 2024-09-12T00:55:21.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.082+0000 7f5e87bb69c0 20 add_watcher() i=5 2024-09-12T00:55:21.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.082+0000 7f5e87bb69c0 20 add_watcher() i=6 2024-09-12T00:55:21.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.082+0000 7f5e87bb69c0 20 add_watcher() i=7 2024-09-12T00:55:21.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.082+0000 7f5e87bb69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:21.079 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.086+0000 7f5d3b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:21.079 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.086+0000 7f5e87bb69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:21.079 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.086+0000 7f5e87bb69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:21.079 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.086+0000 7f5e87bb69c0 5 note: GC not initialized 2024-09-12T00:55:21.079 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.086+0000 7f5d3a7e4640 20 reqs_thread_entry: start 2024-09-12T00:55:21.079 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.086+0000 7f5e87bb69c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:21.079 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.086+0000 7f5e87bb69c0 20 Filter name: none 2024-09-12T00:55:21.080 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.086+0000 7f5cabfff640 20 reqs_thread_entry: start 2024-09-12T00:55:21.080 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.086+0000 7f5e87bb69c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:55:21.080 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.086+0000 7f5e87bb69c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.086+0000 7f5e87bb69c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:55:21.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.086+0000 7f5e87bb69c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:55:21.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.086+0000 7f5e87bb69c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:55:21.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.086+0000 7f5e87bb69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 : miss 2024-09-12T00:55:21.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.086+0000 7f5e87bb69c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.090+0000 7f5e87bb69c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:55:21.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.090+0000 7f5e87bb69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 info.flags=0x17 2024-09-12T00:55:21.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.090+0000 7f5e87bb69c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 to cache LRU end 2024-09-12T00:55:21.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.090+0000 7f5e87bb69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:21.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.090+0000 7f5e87bb69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:21.082 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.090+0000 7f5e87bb69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 2024-09-12T00:55:21.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.098+0000 7f5e87bb69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 info.flags=0x17 2024-09-12T00:55:21.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.098+0000 7f5e87bb69c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 to cache LRU end 2024-09-12T00:55:21.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.098+0000 7f5e87bb69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:21.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.098+0000 7f5e87bb69c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26, ofs0, ns] 2024-09-12T00:55:21.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.098+0000 7f5d68ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431593 cookie 94407622060640 notifier 6774 bl.length()=1023 2024-09-12T00:55:21.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.098+0000 7f5d68ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 info.flags=0x17 2024-09-12T00:55:21.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.098+0000 7f5d68ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 to cache LRU end 2024-09-12T00:55:21.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.098+0000 7f5d68ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:21.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.098+0000 7f5e87bb69c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26]): orig_sources= new_sources= 2024-09-12T00:55:21.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.098+0000 7f5e87bb69c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26]): potential sources added=[] removed=[] 2024-09-12T00:55:21.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.098+0000 7f5e87bb69c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26]): orig_dests= new_dests= 2024-09-12T00:55:21.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.098+0000 7f5e87bb69c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26]): potential dests added=[] removed=[] 2024-09-12T00:55:21.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.098+0000 7f5e87bb69c0 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-12T00:55:21.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.098+0000 7f5e87bb69c0 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-12T00:55:21.093 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.102+0000 7f5d3b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:21.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.106+0000 7f5e87bb69c0 20 remove_watcher() i=0 2024-09-12T00:55:21.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.106+0000 7f5e87bb69c0 2 removed watcher, disabling cache 2024-09-12T00:55:21.099 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.106+0000 7f5e87bb69c0 20 remove_watcher() i=1 2024-09-12T00:55:21.101 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.110+0000 7f5e87bb69c0 20 remove_watcher() i=2 2024-09-12T00:55:21.103 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.110+0000 7f5e87bb69c0 20 remove_watcher() i=3 2024-09-12T00:55:21.105 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.114+0000 7f5e87bb69c0 20 remove_watcher() i=4 2024-09-12T00:55:21.106 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.114+0000 7f5e87bb69c0 20 remove_watcher() i=5 2024-09-12T00:55:21.107 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.114+0000 7f5e87bb69c0 20 remove_watcher() i=6 2024-09-12T00:55:21.108 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.118+0000 7f5e87bb69c0 20 remove_watcher() i=7 2024-09-12T00:55:21.122 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:55:21.148 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:21.149 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:21.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.202+0000 7ff6eb9469c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.194 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.202+0000 7ff6eb9469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.195 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.202+0000 7ff6eb9469c0 20 realm 2024-09-12T00:55:21.195 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.202+0000 7ff6eb9469c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.195 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.202+0000 7ff6eb9469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.195 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.202+0000 7ff6eb9469c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:21.195 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.202+0000 7ff6eb9469c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.195 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.202+0000 7ff6eb9469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.195 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.202+0000 7ff6eb9469c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.206+0000 7ff6eb9469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:21.197 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.206+0000 7ff6eb9469c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.197 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.206+0000 7ff6eb9469c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:21.198 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.206+0000 7ff6eb9469c0 20 searching for the correct realm 2024-09-12T00:55:21.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.210+0000 7ff6e9c4d640 0 -- 172.21.15.70:0/3192790193 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7ff6dc018070 msgr2=0x7ff6dc069b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:55:21.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.426+0000 7ff6e9c4d640 0 -- 172.21.15.70:0/3192790193 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7ff6dc018070 msgr2=0x7ff6dc069b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:21.431 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.438+0000 7ff6eb9469c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:21.431 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.438+0000 7ff6eb9469c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:21.431 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.438+0000 7ff6eb9469c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:21.431 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.438+0000 7ff6eb9469c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:21.431 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.438+0000 7ff6eb9469c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:21.431 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.438+0000 7ff6eb9469c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:21.431 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.438+0000 7ff6eb9469c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.432 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.438+0000 7ff6eb9469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.432 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.438+0000 7ff6eb9469c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.432 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.442+0000 7ff6eb9469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:21.432 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.442+0000 7ff6eb9469c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.442+0000 7ff6eb9469c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:21.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.442+0000 7ff6eb9469c0 20 zone default found 2024-09-12T00:55:21.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.442+0000 7ff6eb9469c0 4 Realm: () 2024-09-12T00:55:21.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.442+0000 7ff6eb9469c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:21.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.442+0000 7ff6eb9469c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:21.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.442+0000 7ff6eb9469c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:21.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.442+0000 7ff6eb9469c0 20 zonegroup default 2024-09-12T00:55:21.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.442+0000 7ff6eb9469c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.442+0000 7ff6eb9469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.442+0000 7ff6eb9469c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.442+0000 7ff6eb9469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.442+0000 7ff6eb9469c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.442+0000 7ff6eb9469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.442+0000 7ff6eb9469c0 20 started sync module instance, tier type = 2024-09-12T00:55:21.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.442+0000 7ff6eb9469c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:21.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.466+0000 7ff6eb9469c0 20 add_watcher() i=0 2024-09-12T00:55:21.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.466+0000 7ff6eb9469c0 20 add_watcher() i=1 2024-09-12T00:55:21.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.466+0000 7ff6eb9469c0 20 add_watcher() i=2 2024-09-12T00:55:21.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.466+0000 7ff6eb9469c0 20 add_watcher() i=3 2024-09-12T00:55:21.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.466+0000 7ff6eb9469c0 20 add_watcher() i=4 2024-09-12T00:55:21.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.466+0000 7ff6eb9469c0 20 add_watcher() i=5 2024-09-12T00:55:21.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.466+0000 7ff6eb9469c0 20 add_watcher() i=6 2024-09-12T00:55:21.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.470+0000 7ff6eb9469c0 20 add_watcher() i=7 2024-09-12T00:55:21.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.470+0000 7ff6eb9469c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:21.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.474+0000 7ff59f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:21.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.474+0000 7ff6eb9469c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:21.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.474+0000 7ff6eb9469c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:21.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.474+0000 7ff6eb9469c0 5 note: GC not initialized 2024-09-12T00:55:21.468 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.474+0000 7ff59e7e4640 20 reqs_thread_entry: start 2024-09-12T00:55:21.468 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.474+0000 7ff6eb9469c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:21.468 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.478+0000 7ff6eb9469c0 20 Filter name: none 2024-09-12T00:55:21.468 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.478+0000 7ff50ffff640 20 reqs_thread_entry: start 2024-09-12T00:55:21.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.478+0000 7ff6eb9469c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.478+0000 7ff6eb9469c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:55:21.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.478+0000 7ff6eb9469c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.478+0000 7ff6eb9469c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:55:21.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.478+0000 7ff6eb9469c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:21.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.478+0000 7ff6eb9469c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.482+0000 7ff6eb9469c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:55:21.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.482+0000 7ff6eb9469c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.473 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.482+0000 7ff6eb9469c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:55:21.473 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.482+0000 7ff6eb9469c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:21.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.482+0000 7ff59f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:21.480 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.490+0000 7ff6eb9469c0 20 remove_watcher() i=0 2024-09-12T00:55:21.480 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.490+0000 7ff6eb9469c0 2 removed watcher, disabling cache 2024-09-12T00:55:21.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.490+0000 7ff6eb9469c0 20 remove_watcher() i=1 2024-09-12T00:55:21.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.494+0000 7ff6eb9469c0 20 remove_watcher() i=2 2024-09-12T00:55:21.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.494+0000 7ff6eb9469c0 20 remove_watcher() i=3 2024-09-12T00:55:21.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.498+0000 7ff6eb9469c0 20 remove_watcher() i=4 2024-09-12T00:55:21.490 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.498+0000 7ff6eb9469c0 20 remove_watcher() i=5 2024-09-12T00:55:21.492 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.498+0000 7ff6eb9469c0 20 remove_watcher() i=6 2024-09-12T00:55:21.493 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.502+0000 7ff6eb9469c0 20 remove_watcher() i=7 2024-09-12T00:55:21.507 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:21.507 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:55:21.508 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-trim-reshard-log-entries id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:55:21.508 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:21.509 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:21.509 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:21.518 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:21.518 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:21.561 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:55:21.597 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:21.597 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:21.641 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.650+0000 7f1d634b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.642 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.650+0000 7f1d634b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.643 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.650+0000 7f1d634b09c0 20 realm 2024-09-12T00:55:21.643 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.650+0000 7f1d634b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.643 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.650+0000 7f1d634b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.643 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.650+0000 7f1d634b09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:21.643 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.650+0000 7f1d634b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.643 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.650+0000 7f1d634b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.643 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.650+0000 7f1d634b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.645 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.654+0000 7f1d634b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:21.645 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.654+0000 7f1d634b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.646 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.654+0000 7f1d634b09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:21.646 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.654+0000 7f1d634b09c0 20 searching for the correct realm 2024-09-12T00:55:21.652 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.662+0000 7f1d617b7640 0 -- 172.21.15.70:0/319965311 >> [v2:172.21.15.70:6808/276433067,v1:172.21.15.70:6809/276433067] conn(0x56372a223e10 msgr2=0x56372a2262d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:21.660 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.670+0000 7f1d60fb6640 0 -- 172.21.15.70:0/319965311 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f1d580abc30 msgr2=0x7f1d580c4440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:21.666 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.674+0000 7f1d634b09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:21.666 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.674+0000 7f1d634b09c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:21.666 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.674+0000 7f1d634b09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:21.666 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.674+0000 7f1d634b09c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:21.666 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.674+0000 7f1d634b09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:21.666 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.674+0000 7f1d634b09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:21.666 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.674+0000 7f1d634b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.666 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.674+0000 7f1d634b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.666 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.674+0000 7f1d634b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.674+0000 7f1d634b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:21.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.674+0000 7f1d634b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.668 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.674+0000 7f1d634b09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:21.668 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.674+0000 7f1d634b09c0 20 zone default found 2024-09-12T00:55:21.668 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.674+0000 7f1d634b09c0 4 Realm: () 2024-09-12T00:55:21.668 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.674+0000 7f1d634b09c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:21.668 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.674+0000 7f1d634b09c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:21.668 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.674+0000 7f1d634b09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:21.668 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.674+0000 7f1d634b09c0 20 zonegroup default 2024-09-12T00:55:21.668 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.674+0000 7f1d634b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.668 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.674+0000 7f1d634b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.674+0000 7f1d634b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.678+0000 7f1d634b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.678+0000 7f1d634b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.678+0000 7f1d634b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.678+0000 7f1d634b09c0 20 started sync module instance, tier type = 2024-09-12T00:55:21.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.678+0000 7f1d634b09c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:21.684 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.690+0000 7f1d634b09c0 20 add_watcher() i=0 2024-09-12T00:55:21.684 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.690+0000 7f1d634b09c0 20 add_watcher() i=1 2024-09-12T00:55:21.684 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.690+0000 7f1d634b09c0 20 add_watcher() i=2 2024-09-12T00:55:21.684 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.690+0000 7f1d634b09c0 20 add_watcher() i=3 2024-09-12T00:55:21.684 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.690+0000 7f1d634b09c0 20 add_watcher() i=4 2024-09-12T00:55:21.685 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.690+0000 7f1d634b09c0 20 add_watcher() i=5 2024-09-12T00:55:21.685 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.690+0000 7f1d634b09c0 20 add_watcher() i=6 2024-09-12T00:55:21.685 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.694+0000 7f1d634b09c0 20 add_watcher() i=7 2024-09-12T00:55:21.685 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.694+0000 7f1d634b09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:21.687 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.694+0000 7f1c177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:21.688 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.694+0000 7f1d634b09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:21.688 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.694+0000 7f1d634b09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:21.688 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.694+0000 7f1d634b09c0 5 note: GC not initialized 2024-09-12T00:55:21.688 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.698+0000 7f1c167e4640 20 reqs_thread_entry: start 2024-09-12T00:55:21.689 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.698+0000 7f1d634b09c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:21.689 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.698+0000 7f1d634b09c0 20 Filter name: none 2024-09-12T00:55:21.689 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.698+0000 7f1c0f7fe640 20 reqs_thread_entry: start 2024-09-12T00:55:21.689 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.698+0000 7f1d634b09c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:55:21.689 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.698+0000 7f1d634b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.689 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.698+0000 7f1d634b09c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:55:21.689 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.698+0000 7f1d634b09c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:55:21.689 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.698+0000 7f1d634b09c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:55:21.689 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.698+0000 7f1d634b09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 : miss 2024-09-12T00:55:21.689 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.698+0000 7f1d634b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.690 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.698+0000 7f1d634b09c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:55:21.690 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.698+0000 7f1d634b09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 info.flags=0x17 2024-09-12T00:55:21.690 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.698+0000 7f1d634b09c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 to cache LRU end 2024-09-12T00:55:21.690 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.698+0000 7f1d634b09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:21.691 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.698+0000 7f1d634b09c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:21.691 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.698+0000 7f1d634b09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 2024-09-12T00:55:21.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.702+0000 7f1d634b09c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:55:21.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.710+0000 7f1d634b09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 info.flags=0x17 2024-09-12T00:55:21.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.710+0000 7f1d634b09c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 to cache LRU end 2024-09-12T00:55:21.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.710+0000 7f1d634b09c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:21.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.710+0000 7f1d634b09c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26, ofs0, ns] 2024-09-12T00:55:21.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.710+0000 7f1c377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431594 cookie 94794930102496 notifier 6813 bl.length()=1023 2024-09-12T00:55:21.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.710+0000 7f1c377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 info.flags=0x17 2024-09-12T00:55:21.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.710+0000 7f1c377fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 to cache LRU end 2024-09-12T00:55:21.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.710+0000 7f1c377fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:21.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.710+0000 7f1d634b09c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26]): orig_sources= new_sources= 2024-09-12T00:55:21.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.710+0000 7f1d634b09c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26]): potential sources added=[] removed=[] 2024-09-12T00:55:21.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.710+0000 7f1d634b09c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26]): orig_dests= new_dests= 2024-09-12T00:55:21.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.710+0000 7f1d634b09c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26]): potential dests added=[] removed=[] 2024-09-12T00:55:21.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.714+0000 7f1d634b09c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26.2.0 2024-09-12T00:55:21.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.714+0000 7f1d634b09c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26.2.0 2024-09-12T00:55:21.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.714+0000 7f1d634b09c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26.2.1 2024-09-12T00:55:21.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.714+0000 7f1d634b09c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26.2.1 2024-09-12T00:55:21.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.714+0000 7f1d634b09c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26.0 2024-09-12T00:55:21.711 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.718+0000 7f1d634b09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 : hit (requested=0x17, cached=0x17) 2024-09-12T00:55:21.711 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.718+0000 7f1d634b09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 2024-09-12T00:55:21.714 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.722+0000 7f1d634b09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 info.flags=0x17 2024-09-12T00:55:21.714 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.722+0000 7f1d634b09c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 to cache LRU end 2024-09-12T00:55:21.714 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.722+0000 7f1d634b09c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:21.714 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.722+0000 7f1d634b09c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26, ofs0, ns] 2024-09-12T00:55:21.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.722+0000 7f1c37fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431595 cookie 94794930102496 notifier 6813 bl.length()=1023 2024-09-12T00:55:21.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.722+0000 7f1c37fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 info.flags=0x17 2024-09-12T00:55:21.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.722+0000 7f1c37fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 to cache LRU end 2024-09-12T00:55:21.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.722+0000 7f1c37fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:21.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.722+0000 7f1d634b09c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26]): orig_sources= new_sources= 2024-09-12T00:55:21.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.722+0000 7f1d634b09c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26]): potential sources added=[] removed=[] 2024-09-12T00:55:21.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.722+0000 7f1d634b09c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26]): orig_dests= new_dests= 2024-09-12T00:55:21.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.722+0000 7f1d634b09c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26]): potential dests added=[] removed=[] 2024-09-12T00:55:21.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.726+0000 7f1d634b09c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26.0 2024-09-12T00:55:21.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.726+0000 7f1d634b09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 : hit (requested=0x17, cached=0x17) 2024-09-12T00:55:21.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.726+0000 7f1d634b09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 2024-09-12T00:55:21.721 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.730+0000 7f1d634b09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 info.flags=0x17 2024-09-12T00:55:21.721 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.730+0000 7f1d634b09c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 to cache LRU end 2024-09-12T00:55:21.721 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.730+0000 7f1d634b09c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:21.721 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.730+0000 7f1d634b09c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26, ofs0, ns] 2024-09-12T00:55:21.721 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.730+0000 7f1c377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431596 cookie 94794930102496 notifier 6813 bl.length()=991 2024-09-12T00:55:21.721 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.730+0000 7f1c377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 info.flags=0x17 2024-09-12T00:55:21.721 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.730+0000 7f1c377fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 to cache LRU end 2024-09-12T00:55:21.722 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.730+0000 7f1c377fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:21.722 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.730+0000 7f1d634b09c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26]): orig_sources= new_sources= 2024-09-12T00:55:21.722 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.730+0000 7f1d634b09c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26]): potential sources added=[] removed=[] 2024-09-12T00:55:21.722 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.730+0000 7f1d634b09c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26]): orig_dests= new_dests= 2024-09-12T00:55:21.722 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.730+0000 7f1d634b09c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26]): potential dests added=[] removed=[] 2024-09-12T00:55:21.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.730+0000 7f1d634b09c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T00:55:21.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.734+0000 7f1c177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:21.731 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.738+0000 7f1d634b09c0 20 remove_watcher() i=0 2024-09-12T00:55:21.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.738+0000 7f1d634b09c0 2 removed watcher, disabling cache 2024-09-12T00:55:21.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.742+0000 7f1d634b09c0 20 remove_watcher() i=1 2024-09-12T00:55:21.735 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.742+0000 7f1d634b09c0 20 remove_watcher() i=2 2024-09-12T00:55:21.737 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.746+0000 7f1d634b09c0 20 remove_watcher() i=3 2024-09-12T00:55:21.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.746+0000 7f1d634b09c0 20 remove_watcher() i=4 2024-09-12T00:55:21.741 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.750+0000 7f1d634b09c0 20 remove_watcher() i=5 2024-09-12T00:55:21.742 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.750+0000 7f1d634b09c0 20 remove_watcher() i=6 2024-09-12T00:55:21.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.750+0000 7f1d634b09c0 20 remove_watcher() i=7 2024-09-12T00:55:21.758 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:55:21.785 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:21.785 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:21.829 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.838+0000 7f1e5b03f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.831 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.838+0000 7f1e5b03f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.831 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.838+0000 7f1e5b03f9c0 20 realm 2024-09-12T00:55:21.831 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.838+0000 7f1e5b03f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.831 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.838+0000 7f1e5b03f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.831 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.838+0000 7f1e5b03f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:21.831 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.838+0000 7f1e5b03f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.831 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.838+0000 7f1e5b03f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.831 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.838+0000 7f1e5b03f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.833 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.842+0000 7f1e5b03f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:21.833 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.842+0000 7f1e5b03f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.834 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.842+0000 7f1e5b03f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:21.834 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.842+0000 7f1e5b03f9c0 20 searching for the correct realm 2024-09-12T00:55:21.840 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.846+0000 7f1e59346640 0 -- 172.21.15.70:0/1336764636 >> [v2:172.21.15.70:6816/1979013808,v1:172.21.15.70:6817/1979013808] conn(0x55ce3d8d7830 msgr2=0x55ce3d8d9ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:21.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.854+0000 7f1e59346640 0 -- 172.21.15.70:0/1336764636 >> [v2:172.21.15.70:6816/1979013808,v1:172.21.15.70:6817/1979013808] conn(0x7f1d24080880 msgr2=0x7f1d24082cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:21.852 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.862+0000 7f1e5b03f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:21.853 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.862+0000 7f1e5b03f9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:21.853 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.862+0000 7f1e5b03f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:21.853 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.862+0000 7f1e5b03f9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:21.853 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.862+0000 7f1e5b03f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:21.853 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.862+0000 7f1e5b03f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:21.853 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.862+0000 7f1e5b03f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.853 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.862+0000 7f1e5b03f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.853 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.862+0000 7f1e5b03f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.862+0000 7f1e5b03f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:21.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.862+0000 7f1e5b03f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.862+0000 7f1e5b03f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:21.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.862+0000 7f1e5b03f9c0 20 zone default found 2024-09-12T00:55:21.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.862+0000 7f1e5b03f9c0 4 Realm: () 2024-09-12T00:55:21.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.862+0000 7f1e5b03f9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:21.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.862+0000 7f1e5b03f9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:21.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.862+0000 7f1e5b03f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:21.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.862+0000 7f1e5b03f9c0 20 zonegroup default 2024-09-12T00:55:21.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.862+0000 7f1e5b03f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.862+0000 7f1e5b03f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.862+0000 7f1e5b03f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.862+0000 7f1e5b03f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.856 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.862+0000 7f1e5b03f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.856 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.862+0000 7f1e5b03f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:21.856 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.862+0000 7f1e5b03f9c0 20 started sync module instance, tier type = 2024-09-12T00:55:21.856 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.862+0000 7f1e5b03f9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:21.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.878+0000 7f1e5b03f9c0 20 add_watcher() i=0 2024-09-12T00:55:21.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.878+0000 7f1e5b03f9c0 20 add_watcher() i=1 2024-09-12T00:55:21.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.878+0000 7f1e5b03f9c0 20 add_watcher() i=2 2024-09-12T00:55:21.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.878+0000 7f1e5b03f9c0 20 add_watcher() i=3 2024-09-12T00:55:21.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.878+0000 7f1e5b03f9c0 20 add_watcher() i=4 2024-09-12T00:55:21.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.878+0000 7f1e5b03f9c0 20 add_watcher() i=5 2024-09-12T00:55:21.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.878+0000 7f1e5b03f9c0 20 add_watcher() i=6 2024-09-12T00:55:21.872 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.878+0000 7f1e5b03f9c0 20 add_watcher() i=7 2024-09-12T00:55:21.872 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.878+0000 7f1e5b03f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:21.874 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.882+0000 7f1d0efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:21.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.882+0000 7f1e5b03f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:21.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.882+0000 7f1e5b03f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:21.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.882+0000 7f1e5b03f9c0 5 note: GC not initialized 2024-09-12T00:55:21.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.882+0000 7f1d0dfe3640 20 reqs_thread_entry: start 2024-09-12T00:55:21.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.882+0000 7f1e5b03f9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:21.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.882+0000 7f1e5b03f9c0 20 Filter name: none 2024-09-12T00:55:21.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.882+0000 7f1c7f7fe640 20 reqs_thread_entry: start 2024-09-12T00:55:21.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.882+0000 7f1e5b03f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.886+0000 7f1e5b03f9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:55:21.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.886+0000 7f1e5b03f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.886+0000 7f1e5b03f9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:55:21.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.886+0000 7f1e5b03f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:21.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.886+0000 7f1e5b03f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.886+0000 7f1e5b03f9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:55:21.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.886+0000 7f1e5b03f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:21.879 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.886+0000 7f1e5b03f9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:55:21.879 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.886+0000 7f1e5b03f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:21.881 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.890+0000 7f1d0efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:21.889 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.898+0000 7f1e5b03f9c0 20 remove_watcher() i=0 2024-09-12T00:55:21.889 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.898+0000 7f1e5b03f9c0 2 removed watcher, disabling cache 2024-09-12T00:55:21.891 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.898+0000 7f1e5b03f9c0 20 remove_watcher() i=1 2024-09-12T00:55:21.893 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.902+0000 7f1e5b03f9c0 20 remove_watcher() i=2 2024-09-12T00:55:21.895 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.902+0000 7f1e5b03f9c0 20 remove_watcher() i=3 2024-09-12T00:55:21.897 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.906+0000 7f1e5b03f9c0 20 remove_watcher() i=4 2024-09-12T00:55:21.898 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.906+0000 7f1e5b03f9c0 20 remove_watcher() i=5 2024-09-12T00:55:21.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.906+0000 7f1e5b03f9c0 20 remove_watcher() i=6 2024-09-12T00:55:21.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:21.910+0000 7f1e5b03f9c0 20 remove_watcher() i=7 2024-09-12T00:55:21.914 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:21.914 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:55:21.914 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-trim-reshard-log-entries id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:55:21.914 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:21.915 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:21.916 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:21.919 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:21.919 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:21.966 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:21.966 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:21.990 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-12T00:55:21.990 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:21.990 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:21.991 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:22.004 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:22.004 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:22.053 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:22.053 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:22.068 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:22.068 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:22.083 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:22.083 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:22.099 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:22.099 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:22.115 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:22.115 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:22.131 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:22.131 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:22.148 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:22.149 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:22.164 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:22.165 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:22.184 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:22.184 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:22.201 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:22.201 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:22.218 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:22.218 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:22.235 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:22.236 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:22.252 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:22.252 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:22.268 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:22.269 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:22.286 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:22.287 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:22.305 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:22.305 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:22.323 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:22.323 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:22.340 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:22.340 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:22.357 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:22.358 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:22.376 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:22.376 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:22.392 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:55:22.425 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:22.425 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:22.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.478+0000 7facac9f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.478+0000 7facac9f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:22.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.478+0000 7facac9f29c0 20 realm 2024-09-12T00:55:22.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.478+0000 7facac9f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.478+0000 7facac9f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:22.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.478+0000 7facac9f29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:22.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.478+0000 7facac9f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.478+0000 7facac9f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:22.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.478+0000 7facac9f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.473 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.482+0000 7facac9f29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:22.473 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.482+0000 7facac9f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.474 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.482+0000 7facac9f29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:22.474 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.482+0000 7facac9f29c0 20 searching for the correct realm 2024-09-12T00:55:22.478 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.486+0000 7facaacf9640 0 -- 172.21.15.70:0/1865036235 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7faca0033040 msgr2=0x7faca0033a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:55:22.694 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.702+0000 7facaacf9640 0 -- 172.21.15.70:0/1865036235 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7faca0033040 msgr2=0x7faca0033a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:22.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.714+0000 7facac9f29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:22.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.714+0000 7facac9f29c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:22.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.714+0000 7facac9f29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:22.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.714+0000 7facac9f29c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:22.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.714+0000 7facac9f29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:22.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.714+0000 7facac9f29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:22.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.714+0000 7facac9f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.714+0000 7facac9f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:22.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.714+0000 7facac9f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.708 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.718+0000 7facac9f29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:22.708 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.718+0000 7facac9f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.718+0000 7facac9f29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:22.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.718+0000 7facac9f29c0 20 zone default found 2024-09-12T00:55:22.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.718+0000 7facac9f29c0 4 Realm: () 2024-09-12T00:55:22.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.718+0000 7facac9f29c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:22.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.718+0000 7facac9f29c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:22.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.718+0000 7facac9f29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:22.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.718+0000 7facac9f29c0 20 zonegroup default 2024-09-12T00:55:22.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.718+0000 7facac9f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.718+0000 7facac9f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:22.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.718+0000 7facac9f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.718+0000 7facac9f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:22.711 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.718+0000 7facac9f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.711 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.718+0000 7facac9f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:22.711 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.718+0000 7facac9f29c0 20 started sync module instance, tier type = 2024-09-12T00:55:22.712 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.718+0000 7facac9f29c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:22.736 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.742+0000 7facac9f29c0 20 add_watcher() i=0 2024-09-12T00:55:22.736 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.742+0000 7facac9f29c0 20 add_watcher() i=1 2024-09-12T00:55:22.736 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.742+0000 7facac9f29c0 20 add_watcher() i=2 2024-09-12T00:55:22.736 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.742+0000 7facac9f29c0 20 add_watcher() i=3 2024-09-12T00:55:22.736 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.742+0000 7facac9f29c0 20 add_watcher() i=4 2024-09-12T00:55:22.736 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.742+0000 7facac9f29c0 20 add_watcher() i=5 2024-09-12T00:55:22.736 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.742+0000 7facac9f29c0 20 add_watcher() i=6 2024-09-12T00:55:22.738 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.746+0000 7facac9f29c0 20 add_watcher() i=7 2024-09-12T00:55:22.738 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.746+0000 7facac9f29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:22.742 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.750+0000 7fab60fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:22.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.750+0000 7facac9f29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:22.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.750+0000 7facac9f29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:22.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.750+0000 7facac9f29c0 5 note: GC not initialized 2024-09-12T00:55:22.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.750+0000 7faadb7fe640 20 reqs_thread_entry: start 2024-09-12T00:55:22.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.750+0000 7facac9f29c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:22.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.750+0000 7facac9f29c0 20 Filter name: none 2024-09-12T00:55:22.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.750+0000 7faad97fa640 20 reqs_thread_entry: start 2024-09-12T00:55:22.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.750+0000 7facac9f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.754+0000 7facac9f29c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:55:22.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.754+0000 7facac9f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.754+0000 7facac9f29c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:55:22.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.754+0000 7facac9f29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:22.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.754+0000 7facac9f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.754+0000 7facac9f29c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:55:22.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.754+0000 7facac9f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.754+0000 7facac9f29c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:55:22.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.754+0000 7facac9f29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:22.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.758+0000 7fab60fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:22.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.762+0000 7facac9f29c0 20 remove_watcher() i=0 2024-09-12T00:55:22.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.762+0000 7facac9f29c0 2 removed watcher, disabling cache 2024-09-12T00:55:22.756 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.766+0000 7facac9f29c0 20 remove_watcher() i=1 2024-09-12T00:55:22.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.766+0000 7facac9f29c0 20 remove_watcher() i=2 2024-09-12T00:55:22.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.770+0000 7facac9f29c0 20 remove_watcher() i=3 2024-09-12T00:55:22.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.770+0000 7facac9f29c0 20 remove_watcher() i=4 2024-09-12T00:55:22.765 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.774+0000 7facac9f29c0 20 remove_watcher() i=5 2024-09-12T00:55:22.766 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.774+0000 7facac9f29c0 20 remove_watcher() i=6 2024-09-12T00:55:22.768 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.778+0000 7facac9f29c0 20 remove_watcher() i=7 2024-09-12T00:55:22.786 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:22.786 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:55:22.786 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-trim-reshard-log-entries id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:55:22.786 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:22.786 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-12T00:55:22.821 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:22.821 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:22.864 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.870+0000 7f9c861239c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.865 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.874+0000 7f9c861239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:22.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.874+0000 7f9c861239c0 20 realm 2024-09-12T00:55:22.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.874+0000 7f9c861239c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.874+0000 7f9c861239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:22.869 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.874+0000 7f9c861239c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:22.869 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.874+0000 7f9c861239c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.869 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.874+0000 7f9c861239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:22.869 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.874+0000 7f9c861239c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.869 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.874+0000 7f9c861239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:22.870 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.874+0000 7f9c861239c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.870 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.878+0000 7f9c861239c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:22.870 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.878+0000 7f9c861239c0 20 searching for the correct realm 2024-09-12T00:55:22.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.882+0000 7f9c83c29640 0 -- 172.21.15.70:0/3505124499 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f9c7c060020 msgr2=0x7f9c7c05ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:22.881 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.890+0000 7f9c83c29640 0 -- 172.21.15.70:0/3505124499 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f9c7c068bc0 msgr2=0x7f9c7c067920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:22.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.894+0000 7f9c861239c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:22.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.894+0000 7f9c861239c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:22.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.894+0000 7f9c861239c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:22.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.894+0000 7f9c861239c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:22.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.894+0000 7f9c861239c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:22.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.894+0000 7f9c861239c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:22.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.894+0000 7f9c861239c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.894+0000 7f9c861239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:22.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.894+0000 7f9c861239c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.889 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.898+0000 7f9c861239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:22.889 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.898+0000 7f9c861239c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.889 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.898+0000 7f9c861239c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:22.890 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.898+0000 7f9c861239c0 20 zone default found 2024-09-12T00:55:22.890 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.898+0000 7f9c861239c0 4 Realm: () 2024-09-12T00:55:22.890 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.898+0000 7f9c861239c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:22.890 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.898+0000 7f9c861239c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:22.890 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.898+0000 7f9c861239c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:22.890 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.898+0000 7f9c861239c0 20 zonegroup default 2024-09-12T00:55:22.890 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.898+0000 7f9c861239c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.890 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.898+0000 7f9c861239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:22.890 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.898+0000 7f9c861239c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.891 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.898+0000 7f9c861239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:22.891 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.898+0000 7f9c861239c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.891 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.898+0000 7f9c861239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:22.892 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.898+0000 7f9c861239c0 20 started sync module instance, tier type = 2024-09-12T00:55:22.892 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.898+0000 7f9c861239c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:22.906 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.914+0000 7f9c861239c0 20 add_watcher() i=0 2024-09-12T00:55:22.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.914+0000 7f9c861239c0 20 add_watcher() i=1 2024-09-12T00:55:22.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.914+0000 7f9c861239c0 20 add_watcher() i=2 2024-09-12T00:55:22.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.914+0000 7f9c861239c0 20 add_watcher() i=3 2024-09-12T00:55:22.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.914+0000 7f9c861239c0 20 add_watcher() i=4 2024-09-12T00:55:22.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.914+0000 7f9c861239c0 20 add_watcher() i=5 2024-09-12T00:55:22.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.914+0000 7f9c861239c0 20 add_watcher() i=6 2024-09-12T00:55:22.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.914+0000 7f9c861239c0 20 add_watcher() i=7 2024-09-12T00:55:22.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.914+0000 7f9c861239c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:22.910 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.918+0000 7f9b39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:22.911 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.918+0000 7f9c861239c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:22.911 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.918+0000 7f9c861239c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:22.912 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.918+0000 7f9c861239c0 5 note: GC not initialized 2024-09-12T00:55:22.912 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.918+0000 7f9b38fe1640 20 reqs_thread_entry: start 2024-09-12T00:55:22.912 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.918+0000 7f9c861239c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:22.912 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.918+0000 7f9c861239c0 20 Filter name: none 2024-09-12T00:55:22.912 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.918+0000 7f9ab27fc640 20 reqs_thread_entry: start 2024-09-12T00:55:22.912 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.918+0000 7f9c861239c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:55:22.912 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.918+0000 7f9c861239c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.922+0000 7f9c861239c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:55:22.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.922+0000 7f9c861239c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:55:22.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.922+0000 7f9c861239c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:55:22.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.922+0000 7f9c861239c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27 : miss 2024-09-12T00:55:22.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.922+0000 7f9c861239c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:22.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.922+0000 7f9c861239c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:55:22.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.922+0000 7f9c861239c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27 info.flags=0x17 2024-09-12T00:55:22.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.922+0000 7f9c861239c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27 to cache LRU end 2024-09-12T00:55:22.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.922+0000 7f9c861239c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:22.914 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.922+0000 7f9c861239c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:22.914 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.922+0000 7f9c861239c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27 2024-09-12T00:55:22.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.926+0000 7f9c861239c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27 info.flags=0x17 2024-09-12T00:55:22.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.926+0000 7f9c861239c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27 to cache LRU end 2024-09-12T00:55:22.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.926+0000 7f9c861239c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:22.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.926+0000 7f9c861239c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27, ofs0, ns] 2024-09-12T00:55:22.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.926+0000 7f9b62ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431599 cookie 93946564547728 notifier 6873 bl.length()=1023 2024-09-12T00:55:22.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.926+0000 7f9b62ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27 info.flags=0x17 2024-09-12T00:55:22.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.926+0000 7f9b62ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27 to cache LRU end 2024-09-12T00:55:22.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.926+0000 7f9b62ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:22.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.926+0000 7f9c861239c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27]): orig_sources= new_sources= 2024-09-12T00:55:22.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.926+0000 7f9c861239c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27]): potential sources added=[] removed=[] 2024-09-12T00:55:22.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.926+0000 7f9c861239c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27]): orig_dests= new_dests= 2024-09-12T00:55:22.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.926+0000 7f9c861239c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27]): potential dests added=[] removed=[] 2024-09-12T00:55:22.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.926+0000 7f9c861239c0 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-12T00:55:22.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.926+0000 7f9c861239c0 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-12T00:55:22.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.930+0000 7f9c861239c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27.1.0 2024-09-12T00:55:22.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.930+0000 7f9c861239c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27.1.0 2024-09-12T00:55:22.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.930+0000 7f9c861239c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27.1.1 2024-09-12T00:55:22.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.930+0000 7f9c861239c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27.1.1 2024-09-12T00:55:22.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.930+0000 7f9c861239c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27.0 2024-09-12T00:55:22.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.938+0000 7f9c861239c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27 : hit (requested=0x17, cached=0x17) 2024-09-12T00:55:22.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.938+0000 7f9c861239c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27 2024-09-12T00:55:22.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.938+0000 7f9c861239c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27 info.flags=0x17 2024-09-12T00:55:22.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.938+0000 7f9c861239c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27 to cache LRU end 2024-09-12T00:55:22.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.938+0000 7f9c861239c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:22.930 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.938+0000 7f9c861239c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27, ofs0, ns] 2024-09-12T00:55:22.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.938+0000 7f9b62ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431600 cookie 93946564547728 notifier 6873 bl.length()=991 2024-09-12T00:55:22.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.938+0000 7f9b62ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27 info.flags=0x17 2024-09-12T00:55:22.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.938+0000 7f9b62ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27 to cache LRU end 2024-09-12T00:55:22.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.938+0000 7f9b62ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:22.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.938+0000 7f9c861239c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27]): orig_sources= new_sources= 2024-09-12T00:55:22.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.938+0000 7f9c861239c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27]): potential sources added=[] removed=[] 2024-09-12T00:55:22.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.938+0000 7f9c861239c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27]): orig_dests= new_dests= 2024-09-12T00:55:22.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.938+0000 7f9c861239c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27]): potential dests added=[] removed=[] 2024-09-12T00:55:22.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.942+0000 7f9c861239c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T00:55:22.935 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.942+0000 7f9b39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:22.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.946+0000 7f9c861239c0 20 remove_watcher() i=0 2024-09-12T00:55:22.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.946+0000 7f9c861239c0 2 removed watcher, disabling cache 2024-09-12T00:55:22.942 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.950+0000 7f9c861239c0 20 remove_watcher() i=1 2024-09-12T00:55:22.944 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.950+0000 7f9c861239c0 20 remove_watcher() i=2 2024-09-12T00:55:22.945 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.954+0000 7f9c861239c0 20 remove_watcher() i=3 2024-09-12T00:55:22.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.954+0000 7f9c861239c0 20 remove_watcher() i=4 2024-09-12T00:55:22.949 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.958+0000 7f9c861239c0 20 remove_watcher() i=5 2024-09-12T00:55:22.950 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.958+0000 7f9c861239c0 20 remove_watcher() i=6 2024-09-12T00:55:22.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:22.958+0000 7f9c861239c0 20 remove_watcher() i=7 2024-09-12T00:55:22.965 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:55:22.991 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:22.991 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:23.032 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.042+0000 7fa725e2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.042+0000 7fa725e2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:23.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.042+0000 7fa725e2e9c0 20 realm 2024-09-12T00:55:23.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.042+0000 7fa725e2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.042+0000 7fa725e2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:23.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.042+0000 7fa725e2e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:23.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.042+0000 7fa725e2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.042+0000 7fa725e2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:23.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.042+0000 7fa725e2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.037 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.046+0000 7fa725e2e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:23.037 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.046+0000 7fa725e2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.038 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.046+0000 7fa725e2e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:23.038 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.046+0000 7fa725e2e9c0 20 searching for the correct realm 2024-09-12T00:55:23.044 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.050+0000 7fa723934640 0 -- 172.21.15.70:0/2635198438 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7fa71c0b0070 msgr2=0x7fa71c0fc3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:23.050 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.058+0000 7fa723934640 0 -- 172.21.15.70:0/2635198438 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7fa71c131be0 msgr2=0x7fa71c104100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:23.056 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.066+0000 7fa725e2e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:23.057 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.066+0000 7fa725e2e9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:23.057 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.066+0000 7fa725e2e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:23.057 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.066+0000 7fa725e2e9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:23.057 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.066+0000 7fa725e2e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:23.057 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.066+0000 7fa725e2e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:23.057 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.066+0000 7fa725e2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.057 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.066+0000 7fa725e2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:23.057 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.066+0000 7fa725e2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.058 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.066+0000 7fa725e2e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:23.058 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.066+0000 7fa725e2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.058 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.066+0000 7fa725e2e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:23.058 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.066+0000 7fa725e2e9c0 20 zone default found 2024-09-12T00:55:23.059 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.066+0000 7fa725e2e9c0 4 Realm: () 2024-09-12T00:55:23.059 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.066+0000 7fa725e2e9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:23.059 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.066+0000 7fa725e2e9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:23.059 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.066+0000 7fa725e2e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:23.059 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.066+0000 7fa725e2e9c0 20 zonegroup default 2024-09-12T00:55:23.059 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.066+0000 7fa725e2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.059 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.066+0000 7fa725e2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:23.059 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.066+0000 7fa725e2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.066+0000 7fa725e2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:23.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.066+0000 7fa725e2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.066+0000 7fa725e2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:23.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.066+0000 7fa725e2e9c0 20 started sync module instance, tier type = 2024-09-12T00:55:23.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.066+0000 7fa725e2e9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:23.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.082+0000 7fa725e2e9c0 20 add_watcher() i=0 2024-09-12T00:55:23.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.082+0000 7fa725e2e9c0 20 add_watcher() i=1 2024-09-12T00:55:23.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.082+0000 7fa725e2e9c0 20 add_watcher() i=2 2024-09-12T00:55:23.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.082+0000 7fa725e2e9c0 20 add_watcher() i=3 2024-09-12T00:55:23.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.082+0000 7fa725e2e9c0 20 add_watcher() i=4 2024-09-12T00:55:23.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.082+0000 7fa725e2e9c0 20 add_watcher() i=5 2024-09-12T00:55:23.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.082+0000 7fa725e2e9c0 20 add_watcher() i=6 2024-09-12T00:55:23.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.082+0000 7fa725e2e9c0 20 add_watcher() i=7 2024-09-12T00:55:23.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.082+0000 7fa725e2e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:23.078 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.086+0000 7fa5d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:23.080 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.086+0000 7fa725e2e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:23.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.086+0000 7fa725e2e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:23.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.086+0000 7fa725e2e9c0 5 note: GC not initialized 2024-09-12T00:55:23.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.086+0000 7fa5d8fe1640 20 reqs_thread_entry: start 2024-09-12T00:55:23.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.086+0000 7fa725e2e9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:23.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.086+0000 7fa725e2e9c0 20 Filter name: none 2024-09-12T00:55:23.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.086+0000 7fa5527fc640 20 reqs_thread_entry: start 2024-09-12T00:55:23.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.086+0000 7fa725e2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.090+0000 7fa725e2e9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:55:23.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.090+0000 7fa725e2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.090+0000 7fa725e2e9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:55:23.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.090+0000 7fa725e2e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:23.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.090+0000 7fa725e2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.082 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.090+0000 7fa725e2e9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:55:23.082 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.090+0000 7fa725e2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.082 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.090+0000 7fa725e2e9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:55:23.082 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.090+0000 7fa725e2e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:23.084 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.090+0000 7fa5d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:23.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.098+0000 7fa725e2e9c0 20 remove_watcher() i=0 2024-09-12T00:55:23.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.098+0000 7fa725e2e9c0 2 removed watcher, disabling cache 2024-09-12T00:55:23.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.098+0000 7fa725e2e9c0 20 remove_watcher() i=1 2024-09-12T00:55:23.093 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.102+0000 7fa725e2e9c0 20 remove_watcher() i=2 2024-09-12T00:55:23.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.102+0000 7fa725e2e9c0 20 remove_watcher() i=3 2024-09-12T00:55:23.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.106+0000 7fa725e2e9c0 20 remove_watcher() i=4 2024-09-12T00:55:23.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.106+0000 7fa725e2e9c0 20 remove_watcher() i=5 2024-09-12T00:55:23.100 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.106+0000 7fa725e2e9c0 20 remove_watcher() i=6 2024-09-12T00:55:23.101 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.110+0000 7fa725e2e9c0 20 remove_watcher() i=7 2024-09-12T00:55:23.114 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:23.114 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:55:23.114 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-trim-reshard-log-entries id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:55:23.114 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:23.115 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:23.115 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:23.118 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:23.118 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:23.169 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:23.169 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:23.189 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-12T00:55:23.189 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:23.190 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:23.190 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:23.205 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:23.205 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:23.252 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:23.252 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:23.274 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:23.274 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:23.294 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:23.294 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:23.312 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:23.312 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:23.330 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:23.330 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:23.350 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:23.350 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:23.367 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:23.367 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:23.385 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:23.385 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:23.404 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:23.404 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:23.423 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:23.423 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:23.443 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:23.443 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:23.461 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:23.461 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:23.479 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:23.479 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:23.498 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:23.498 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:23.516 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:23.516 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:23.534 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:23.534 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:23.553 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:23.553 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:23.574 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:23.574 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:23.593 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:23.593 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:23.612 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:23.612 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:23.629 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:55:23.662 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:23.662 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:23.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.714+0000 7f684d81a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.718+0000 7f684d81a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:23.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.718+0000 7f684d81a9c0 20 realm 2024-09-12T00:55:23.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.718+0000 7f684d81a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.718+0000 7f684d81a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:23.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.718+0000 7f684d81a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:23.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.718+0000 7f684d81a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.718+0000 7f684d81a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:23.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.718+0000 7f684d81a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.718+0000 7f684d81a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:23.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.718+0000 7f684d81a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.711 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.718+0000 7f684d81a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:23.711 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.718+0000 7f684d81a9c0 20 searching for the correct realm 2024-09-12T00:55:23.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.722+0000 7f684bb21640 0 -- 172.21.15.70:0/776488511 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f684012bbc0 msgr2=0x7f684013ba90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:23.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.734+0000 7f684bb21640 0 -- 172.21.15.70:0/776488511 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f6714080780 msgr2=0x7f6714082bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:23.731 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.738+0000 7f684d81a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:23.731 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.738+0000 7f684d81a9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:23.731 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.738+0000 7f684d81a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:23.731 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.738+0000 7f684d81a9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:23.731 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.738+0000 7f684d81a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:23.731 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.738+0000 7f684d81a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:23.731 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.738+0000 7f684d81a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.731 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.738+0000 7f684d81a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:23.731 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.738+0000 7f684d81a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.738+0000 7f684d81a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:23.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.738+0000 7f684d81a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.738+0000 7f684d81a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:23.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.738+0000 7f684d81a9c0 20 zone default found 2024-09-12T00:55:23.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.738+0000 7f684d81a9c0 4 Realm: () 2024-09-12T00:55:23.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.738+0000 7f684d81a9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:23.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.738+0000 7f684d81a9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:23.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.738+0000 7f684d81a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:23.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.738+0000 7f684d81a9c0 20 zonegroup default 2024-09-12T00:55:23.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.738+0000 7f684d81a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.742+0000 7f684d81a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:23.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.742+0000 7f684d81a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.742+0000 7f684d81a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:23.734 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.742+0000 7f684d81a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.734 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.742+0000 7f684d81a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:23.734 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.742+0000 7f684d81a9c0 20 started sync module instance, tier type = 2024-09-12T00:55:23.734 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.742+0000 7f684d81a9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:23.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.758+0000 7f684d81a9c0 20 add_watcher() i=0 2024-09-12T00:55:23.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.758+0000 7f684d81a9c0 20 add_watcher() i=1 2024-09-12T00:55:23.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.758+0000 7f684d81a9c0 20 add_watcher() i=2 2024-09-12T00:55:23.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.758+0000 7f684d81a9c0 20 add_watcher() i=3 2024-09-12T00:55:23.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.758+0000 7f684d81a9c0 20 add_watcher() i=4 2024-09-12T00:55:23.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.758+0000 7f684d81a9c0 20 add_watcher() i=5 2024-09-12T00:55:23.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.758+0000 7f684d81a9c0 20 add_watcher() i=6 2024-09-12T00:55:23.750 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.758+0000 7f684d81a9c0 20 add_watcher() i=7 2024-09-12T00:55:23.750 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.758+0000 7f684d81a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:23.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.762+0000 7f6701fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:23.753 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.762+0000 7f684d81a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:23.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.762+0000 7f684d81a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:23.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.762+0000 7f684d81a9c0 5 note: GC not initialized 2024-09-12T00:55:23.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.762+0000 7f6700fe1640 20 reqs_thread_entry: start 2024-09-12T00:55:23.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.762+0000 7f684d81a9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:23.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.762+0000 7f684d81a9c0 20 Filter name: none 2024-09-12T00:55:23.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.762+0000 7f667a7fc640 20 reqs_thread_entry: start 2024-09-12T00:55:23.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.762+0000 7f684d81a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.755 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.762+0000 7f684d81a9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:55:23.755 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.762+0000 7f684d81a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.756 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.766+0000 7f684d81a9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:55:23.756 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.766+0000 7f684d81a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:23.756 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.766+0000 7f684d81a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.757 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.766+0000 7f684d81a9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:55:23.758 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.766+0000 7f684d81a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.766+0000 7f684d81a9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:55:23.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.766+0000 7f684d81a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:23.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.770+0000 7f6701fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:23.765 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.774+0000 7f684d81a9c0 20 remove_watcher() i=0 2024-09-12T00:55:23.766 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.774+0000 7f684d81a9c0 2 removed watcher, disabling cache 2024-09-12T00:55:23.768 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.774+0000 7f684d81a9c0 20 remove_watcher() i=1 2024-09-12T00:55:23.770 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.778+0000 7f684d81a9c0 20 remove_watcher() i=2 2024-09-12T00:55:23.772 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.778+0000 7f684d81a9c0 20 remove_watcher() i=3 2024-09-12T00:55:23.774 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.782+0000 7f684d81a9c0 20 remove_watcher() i=4 2024-09-12T00:55:23.776 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.786+0000 7f684d81a9c0 20 remove_watcher() i=5 2024-09-12T00:55:23.778 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.786+0000 7f684d81a9c0 20 remove_watcher() i=6 2024-09-12T00:55:23.780 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.790+0000 7f684d81a9c0 20 remove_watcher() i=7 2024-09-12T00:55:23.793 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:23.793 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:55:23.793 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: abort-at-trim-reshard-log-entries id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:55:23.794 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:23.794 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-12T00:55:23.826 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:23.826 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:23.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.878+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.870 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.878+0000 7f352a4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:23.870 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.878+0000 7f352a4b79c0 20 realm 2024-09-12T00:55:23.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.878+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.878+0000 7f352a4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:23.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.878+0000 7f352a4b79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:23.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.878+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.878+0000 7f352a4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:23.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.878+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.874 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.882+0000 7f352a4b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:23.874 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.882+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:23.874 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.882+0000 7f352a4b79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:23.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.882+0000 7f352a4b79c0 20 searching for the correct realm 2024-09-12T00:55:23.882 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.890+0000 7f3527fbd640 0 -- 172.21.15.70:0/4160814060 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f3520008050 msgr2=0x7f3520060720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:23.889 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:23.898+0000 7f3527fbd640 0 -- 172.21.15.70:0/4160814060 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f352007a040 msgr2=0x7f3520068460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:24.104 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:24.105 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:24.105 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:24.105 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:24.105 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:24.105 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:24.105 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.105 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.105 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.106 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:24.106 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.107 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:24.107 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 zone default found 2024-09-12T00:55:24.107 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.114+0000 7f352a4b79c0 4 Realm: () 2024-09-12T00:55:24.107 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.114+0000 7f352a4b79c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:24.107 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.114+0000 7f352a4b79c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:24.107 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.114+0000 7f352a4b79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:24.108 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 zonegroup default 2024-09-12T00:55:24.108 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.108 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.108 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.109 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.118+0000 7f352a4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.109 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.118+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.110 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.118+0000 7f352a4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.110 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.118+0000 7f352a4b79c0 20 started sync module instance, tier type = 2024-09-12T00:55:24.110 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.118+0000 7f352a4b79c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:24.137 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.146+0000 7f352a4b79c0 20 add_watcher() i=0 2024-09-12T00:55:24.137 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.146+0000 7f352a4b79c0 20 add_watcher() i=1 2024-09-12T00:55:24.137 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.146+0000 7f352a4b79c0 20 add_watcher() i=2 2024-09-12T00:55:24.137 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.146+0000 7f352a4b79c0 20 add_watcher() i=3 2024-09-12T00:55:24.137 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.146+0000 7f352a4b79c0 20 add_watcher() i=4 2024-09-12T00:55:24.137 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.146+0000 7f352a4b79c0 20 add_watcher() i=5 2024-09-12T00:55:24.137 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.146+0000 7f352a4b79c0 20 add_watcher() i=6 2024-09-12T00:55:24.139 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.146+0000 7f352a4b79c0 20 add_watcher() i=7 2024-09-12T00:55:24.139 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.146+0000 7f352a4b79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:24.143 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.150+0000 7f33ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:24.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.154+0000 7f352a4b79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:24.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.154+0000 7f352a4b79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:24.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.154+0000 7f352a4b79c0 5 note: GC not initialized 2024-09-12T00:55:24.145 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.154+0000 7f33dcfe1640 20 reqs_thread_entry: start 2024-09-12T00:55:24.145 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.154+0000 7f352a4b79c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:24.145 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.154+0000 7f352a4b79c0 20 Filter name: none 2024-09-12T00:55:24.146 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.154+0000 7f33567fc640 20 reqs_thread_entry: start 2024-09-12T00:55:24.146 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.154+0000 7f352a4b79c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:55:24.146 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.154+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.147 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.154+0000 7f352a4b79c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:55:24.147 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.154+0000 7f352a4b79c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:55:24.147 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.154+0000 7f352a4b79c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:55:24.147 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.154+0000 7f352a4b79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 : miss 2024-09-12T00:55:24.147 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.154+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.148 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.158+0000 7f352a4b79c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:55:24.148 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.158+0000 7f352a4b79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 info.flags=0x17 2024-09-12T00:55:24.148 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.158+0000 7f352a4b79c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 to cache LRU end 2024-09-12T00:55:24.148 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.158+0000 7f352a4b79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:24.148 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.158+0000 7f352a4b79c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:24.148 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.158+0000 7f352a4b79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 2024-09-12T00:55:24.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.162+0000 7f352a4b79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 info.flags=0x17 2024-09-12T00:55:24.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.162+0000 7f352a4b79c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 to cache LRU end 2024-09-12T00:55:24.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.162+0000 7f352a4b79c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:24.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.162+0000 7f352a4b79c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28, ofs0, ns] 2024-09-12T00:55:24.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.162+0000 7f3406ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431603 cookie 94739683491056 notifier 6542 bl.length()=1023 2024-09-12T00:55:24.156 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.162+0000 7f3406ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 info.flags=0x17 2024-09-12T00:55:24.156 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.162+0000 7f3406ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 to cache LRU end 2024-09-12T00:55:24.156 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.162+0000 7f3406ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:24.156 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.162+0000 7f352a4b79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28]): orig_sources= new_sources= 2024-09-12T00:55:24.156 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.162+0000 7f352a4b79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28]): potential sources added=[] removed=[] 2024-09-12T00:55:24.156 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.162+0000 7f352a4b79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28]): orig_dests= new_dests= 2024-09-12T00:55:24.156 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.162+0000 7f352a4b79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28]): potential dests added=[] removed=[] 2024-09-12T00:55:24.156 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f352a4b79c0 time 2024-09-12T00:55:24.166765+0000 2024-09-12T00:55:24.156 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:55:24.157 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:24.157 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f352dd912eb] 2024-09-12T00:55:24.157 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f352dd9149f] 2024-09-12T00:55:24.157 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562a4aa30cc1] 2024-09-12T00:55:24.157 INFO:tasks.workunit.client.0.smithi070.stderr: 4: radosgw-admin(+0x1422a3e) [0x562a4b48ea3e] 2024-09-12T00:55:24.157 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562a4aa45ced] 2024-09-12T00:55:24.157 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:55:24.157 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f352cbf7d90] 2024-09-12T00:55:24.158 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:55:24.158 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:55:24.158 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.166+0000 7f352a4b79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f352a4b79c0 time 2024-09-12T00:55:24.166765+0000 2024-09-12T00:55:24.158 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:55:24.158 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.158 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:24.158 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f352dd912eb] 2024-09-12T00:55:24.158 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f352dd9149f] 2024-09-12T00:55:24.158 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562a4aa30cc1] 2024-09-12T00:55:24.158 INFO:tasks.workunit.client.0.smithi070.stderr: 4: radosgw-admin(+0x1422a3e) [0x562a4b48ea3e] 2024-09-12T00:55:24.158 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562a4aa45ced] 2024-09-12T00:55:24.158 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:55:24.158 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f352cbf7d90] 2024-09-12T00:55:24.159 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:55:24.159 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:55:24.159 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.159 INFO:tasks.workunit.client.0.smithi070.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:55:24.159 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f352a4b79c0 thread_name:radosgw-admin 2024-09-12T00:55:24.170 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:24.170 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f352cc10520] 2024-09-12T00:55:24.170 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:55:24.170 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:55:24.170 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:55:24.171 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f352dd91345] 2024-09-12T00:55:24.171 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f352dd9149f] 2024-09-12T00:55:24.171 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562a4aa30cc1] 2024-09-12T00:55:24.171 INFO:tasks.workunit.client.0.smithi070.stderr: 8: radosgw-admin(+0x1422a3e) [0x562a4b48ea3e] 2024-09-12T00:55:24.171 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562a4aa45ced] 2024-09-12T00:55:24.171 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:55:24.171 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f352cbf7d90] 2024-09-12T00:55:24.171 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:55:24.171 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:55:24.171 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.166+0000 7f352a4b79c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:55:24.171 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f352a4b79c0 thread_name:radosgw-admin 2024-09-12T00:55:24.171 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.171 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:24.172 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f352cc10520] 2024-09-12T00:55:24.172 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:55:24.172 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:55:24.172 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:55:24.172 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f352dd91345] 2024-09-12T00:55:24.172 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f352dd9149f] 2024-09-12T00:55:24.172 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562a4aa30cc1] 2024-09-12T00:55:24.172 INFO:tasks.workunit.client.0.smithi070.stderr: 8: radosgw-admin(+0x1422a3e) [0x562a4b48ea3e] 2024-09-12T00:55:24.172 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562a4aa45ced] 2024-09-12T00:55:24.172 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:55:24.172 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f352cbf7d90] 2024-09-12T00:55:24.172 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:55:24.172 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:55:24.173 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:55:24.173 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.173 INFO:tasks.workunit.client.0.smithi070.stderr:--- begin dump of recent events --- 2024-09-12T00:55:24.173 INFO:tasks.workunit.client.0.smithi070.stderr: -499> 2024-09-12T00:55:23.854+0000 7f35287be640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:24.173 INFO:tasks.workunit.client.0.smithi070.stderr: -498> 2024-09-12T00:55:23.854+0000 7f35287be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:24.173 INFO:tasks.workunit.client.0.smithi070.stderr: -497> 2024-09-12T00:55:23.854+0000 7f35287be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:24.173 INFO:tasks.workunit.client.0.smithi070.stderr: -496> 2024-09-12T00:55:23.854+0000 7f35287be640 10 monclient(hunting): handle_auth_done global_id 6921 payload 274 2024-09-12T00:55:24.173 INFO:tasks.workunit.client.0.smithi070.stderr: -495> 2024-09-12T00:55:23.854+0000 7f35287be640 10 monclient: _finish_hunting 0 2024-09-12T00:55:24.173 INFO:tasks.workunit.client.0.smithi070.stderr: -494> 2024-09-12T00:55:23.854+0000 7f35287be640 1 monclient: found mon.noname-a 2024-09-12T00:55:24.173 INFO:tasks.workunit.client.0.smithi070.stderr: -493> 2024-09-12T00:55:23.854+0000 7f35287be640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:55:24.173 INFO:tasks.workunit.client.0.smithi070.stderr: -492> 2024-09-12T00:55:23.854+0000 7f3415e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:24.174 INFO:tasks.workunit.client.0.smithi070.stderr: -491> 2024-09-12T00:55:23.854+0000 7f3415e0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:55:24.174 INFO:tasks.workunit.client.0.smithi070.stderr: -490> 2024-09-12T00:55:23.854+0000 7f3415e0b640 10 monclient: dump: 2024-09-12T00:55:24.174 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:24.174 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:24.174 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.174 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.174 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:24.174 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.174 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:24.174 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:24.174 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:24.174 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.174 INFO:tasks.workunit.client.0.smithi070.stderr: -489> 2024-09-12T00:55:23.854+0000 7f3415e0b640 10 monclient: _finish_auth 0 2024-09-12T00:55:24.174 INFO:tasks.workunit.client.0.smithi070.stderr: -488> 2024-09-12T00:55:23.854+0000 7f3415e0b640 10 monclient: _check_auth_tickets 2024-09-12T00:55:24.175 INFO:tasks.workunit.client.0.smithi070.stderr: -487> 2024-09-12T00:55:23.854+0000 7f3415e0b640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:24.175 INFO:tasks.workunit.client.0.smithi070.stderr: -486> 2024-09-12T00:55:23.854+0000 7f352a4b79c0 5 monclient: authenticate success, global_id 6921 2024-09-12T00:55:24.175 INFO:tasks.workunit.client.0.smithi070.stderr: -485> 2024-09-12T00:55:23.854+0000 7f352a4b79c0 10 monclient: get_monmap_and_config success 2024-09-12T00:55:24.175 INFO:tasks.workunit.client.0.smithi070.stderr: -484> 2024-09-12T00:55:23.854+0000 7f352a4b79c0 4 set_mon_vals no callback set 2024-09-12T00:55:24.175 INFO:tasks.workunit.client.0.smithi070.stderr: -483> 2024-09-12T00:55:23.854+0000 7f3415e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:24.175 INFO:tasks.workunit.client.0.smithi070.stderr: -482> 2024-09-12T00:55:23.854+0000 7f3415e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:24.175 INFO:tasks.workunit.client.0.smithi070.stderr: -481> 2024-09-12T00:55:23.854+0000 7f3415e0b640 10 monclient: dump: 2024-09-12T00:55:24.175 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:24.175 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:24.175 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.175 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.175 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:24.175 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.175 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:24.175 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:24.176 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:24.176 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.176 INFO:tasks.workunit.client.0.smithi070.stderr: -480> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient: shutdown 2024-09-12T00:55:24.176 INFO:tasks.workunit.client.0.smithi070.stderr: -479> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) unregister_commands rotate-key 2024-09-12T00:55:24.176 INFO:tasks.workunit.client.0.smithi070.stderr: -478> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient: build_initial_monmap 2024-09-12T00:55:24.176 INFO:tasks.workunit.client.0.smithi070.stderr: -477> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 1 build_initial for_mkfs: 0 2024-09-12T00:55:24.176 INFO:tasks.workunit.client.0.smithi070.stderr: -476> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient: monmap: 2024-09-12T00:55:24.176 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:55:24.176 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:24.176 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:55:24.176 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:55:24.176 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:24.176 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.177 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:55:24.177 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:55:24.177 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:55:24.177 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.177 INFO:tasks.workunit.client.0.smithi070.stderr: -475> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding auth protocol: cephx 2024-09-12T00:55:24.177 INFO:tasks.workunit.client.0.smithi070.stderr: -474> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding auth protocol: cephx 2024-09-12T00:55:24.177 INFO:tasks.workunit.client.0.smithi070.stderr: -473> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding auth protocol: cephx 2024-09-12T00:55:24.177 INFO:tasks.workunit.client.0.smithi070.stderr: -472> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding con mode: secure 2024-09-12T00:55:24.177 INFO:tasks.workunit.client.0.smithi070.stderr: -471> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding con mode: crc 2024-09-12T00:55:24.177 INFO:tasks.workunit.client.0.smithi070.stderr: -470> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding con mode: secure 2024-09-12T00:55:24.177 INFO:tasks.workunit.client.0.smithi070.stderr: -469> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding con mode: crc 2024-09-12T00:55:24.177 INFO:tasks.workunit.client.0.smithi070.stderr: -468> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding con mode: secure 2024-09-12T00:55:24.177 INFO:tasks.workunit.client.0.smithi070.stderr: -467> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding con mode: crc 2024-09-12T00:55:24.177 INFO:tasks.workunit.client.0.smithi070.stderr: -466> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding con mode: crc 2024-09-12T00:55:24.178 INFO:tasks.workunit.client.0.smithi070.stderr: -465> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding con mode: secure 2024-09-12T00:55:24.178 INFO:tasks.workunit.client.0.smithi070.stderr: -464> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding con mode: crc 2024-09-12T00:55:24.178 INFO:tasks.workunit.client.0.smithi070.stderr: -463> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding con mode: secure 2024-09-12T00:55:24.178 INFO:tasks.workunit.client.0.smithi070.stderr: -462> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding con mode: crc 2024-09-12T00:55:24.178 INFO:tasks.workunit.client.0.smithi070.stderr: -461> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding con mode: secure 2024-09-12T00:55:24.178 INFO:tasks.workunit.client.0.smithi070.stderr: -460> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:24.178 INFO:tasks.workunit.client.0.smithi070.stderr: -459> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 1 librados: starting msgr at 2024-09-12T00:55:24.178 INFO:tasks.workunit.client.0.smithi070.stderr: -458> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 1 librados: starting objecter 2024-09-12T00:55:24.178 INFO:tasks.workunit.client.0.smithi070.stderr: -457> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command objecter_requests hook 0x562a4d1eacc0 2024-09-12T00:55:24.178 INFO:tasks.workunit.client.0.smithi070.stderr: -456> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 1 librados: setting wanted keys 2024-09-12T00:55:24.178 INFO:tasks.workunit.client.0.smithi070.stderr: -455> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 1 librados: calling monclient init 2024-09-12T00:55:24.178 INFO:tasks.workunit.client.0.smithi070.stderr: -454> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient: init 2024-09-12T00:55:24.178 INFO:tasks.workunit.client.0.smithi070.stderr: -453> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding auth protocol: cephx 2024-09-12T00:55:24.178 INFO:tasks.workunit.client.0.smithi070.stderr: -452> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding auth protocol: cephx 2024-09-12T00:55:24.179 INFO:tasks.workunit.client.0.smithi070.stderr: -451> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding auth protocol: cephx 2024-09-12T00:55:24.179 INFO:tasks.workunit.client.0.smithi070.stderr: -450> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding con mode: secure 2024-09-12T00:55:24.179 INFO:tasks.workunit.client.0.smithi070.stderr: -449> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding con mode: crc 2024-09-12T00:55:24.179 INFO:tasks.workunit.client.0.smithi070.stderr: -448> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding con mode: secure 2024-09-12T00:55:24.179 INFO:tasks.workunit.client.0.smithi070.stderr: -447> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding con mode: crc 2024-09-12T00:55:24.179 INFO:tasks.workunit.client.0.smithi070.stderr: -446> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding con mode: secure 2024-09-12T00:55:24.179 INFO:tasks.workunit.client.0.smithi070.stderr: -445> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding con mode: crc 2024-09-12T00:55:24.179 INFO:tasks.workunit.client.0.smithi070.stderr: -444> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding con mode: crc 2024-09-12T00:55:24.179 INFO:tasks.workunit.client.0.smithi070.stderr: -443> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding con mode: secure 2024-09-12T00:55:24.179 INFO:tasks.workunit.client.0.smithi070.stderr: -442> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding con mode: crc 2024-09-12T00:55:24.179 INFO:tasks.workunit.client.0.smithi070.stderr: -441> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding con mode: secure 2024-09-12T00:55:24.179 INFO:tasks.workunit.client.0.smithi070.stderr: -440> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding con mode: crc 2024-09-12T00:55:24.179 INFO:tasks.workunit.client.0.smithi070.stderr: -439> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding con mode: secure 2024-09-12T00:55:24.179 INFO:tasks.workunit.client.0.smithi070.stderr: -438> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:24.180 INFO:tasks.workunit.client.0.smithi070.stderr: -437> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:24.180 INFO:tasks.workunit.client.0.smithi070.stderr: -436> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command rotate-key hook 0x562a4d1e5e18 2024-09-12T00:55:24.180 INFO:tasks.workunit.client.0.smithi070.stderr: -435> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient: _reopen_session rank -1 2024-09-12T00:55:24.180 INFO:tasks.workunit.client.0.smithi070.stderr: -434> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:55:24.180 INFO:tasks.workunit.client.0.smithi070.stderr: -433> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient(hunting): picked mon.noname-b con 0x562a4d0a4230 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:55:24.180 INFO:tasks.workunit.client.0.smithi070.stderr: -432> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient(hunting): picked mon.noname-a con 0x562a4d131970 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:55:24.180 INFO:tasks.workunit.client.0.smithi070.stderr: -431> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient(hunting): picked mon.noname-c con 0x562a4d20ee90 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:55:24.180 INFO:tasks.workunit.client.0.smithi070.stderr: -430> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:24.180 INFO:tasks.workunit.client.0.smithi070.stderr: -429> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:24.180 INFO:tasks.workunit.client.0.smithi070.stderr: -428> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:24.180 INFO:tasks.workunit.client.0.smithi070.stderr: -427> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient(hunting): _renew_subs 2024-09-12T00:55:24.180 INFO:tasks.workunit.client.0.smithi070.stderr: -426> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient(hunting): authenticate will time out at 2174.305956s 2024-09-12T00:55:24.180 INFO:tasks.workunit.client.0.smithi070.stderr: -425> 2024-09-12T00:55:23.858+0000 7f35277bc640 10 monclient(hunting): get_auth_request con 0x562a4d131970 auth_method 0 2024-09-12T00:55:24.181 INFO:tasks.workunit.client.0.smithi070.stderr: -424> 2024-09-12T00:55:23.858+0000 7f35277bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:24.181 INFO:tasks.workunit.client.0.smithi070.stderr: -423> 2024-09-12T00:55:23.858+0000 7f35277bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:24.181 INFO:tasks.workunit.client.0.smithi070.stderr: -422> 2024-09-12T00:55:23.858+0000 7f35277bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:24.181 INFO:tasks.workunit.client.0.smithi070.stderr: -421> 2024-09-12T00:55:23.858+0000 7f35287be640 10 monclient(hunting): get_auth_request con 0x562a4d20ee90 auth_method 0 2024-09-12T00:55:24.181 INFO:tasks.workunit.client.0.smithi070.stderr: -420> 2024-09-12T00:55:23.858+0000 7f35287be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:24.181 INFO:tasks.workunit.client.0.smithi070.stderr: -419> 2024-09-12T00:55:23.858+0000 7f35287be640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:24.181 INFO:tasks.workunit.client.0.smithi070.stderr: -418> 2024-09-12T00:55:23.858+0000 7f35287be640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:24.181 INFO:tasks.workunit.client.0.smithi070.stderr: -417> 2024-09-12T00:55:23.858+0000 7f35277bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:24.181 INFO:tasks.workunit.client.0.smithi070.stderr: -416> 2024-09-12T00:55:23.858+0000 7f35277bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:24.181 INFO:tasks.workunit.client.0.smithi070.stderr: -415> 2024-09-12T00:55:23.858+0000 7f35277bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:24.181 INFO:tasks.workunit.client.0.smithi070.stderr: -414> 2024-09-12T00:55:23.858+0000 7f35287be640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:24.181 INFO:tasks.workunit.client.0.smithi070.stderr: -413> 2024-09-12T00:55:23.858+0000 7f35287be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:24.182 INFO:tasks.workunit.client.0.smithi070.stderr: -412> 2024-09-12T00:55:23.858+0000 7f35287be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:24.182 INFO:tasks.workunit.client.0.smithi070.stderr: -411> 2024-09-12T00:55:23.858+0000 7f35277bc640 10 monclient(hunting): handle_auth_done global_id 6924 payload 824 2024-09-12T00:55:24.182 INFO:tasks.workunit.client.0.smithi070.stderr: -410> 2024-09-12T00:55:23.858+0000 7f35277bc640 10 monclient: _finish_hunting 0 2024-09-12T00:55:24.182 INFO:tasks.workunit.client.0.smithi070.stderr: -409> 2024-09-12T00:55:23.858+0000 7f35277bc640 1 monclient: found mon.noname-a 2024-09-12T00:55:24.182 INFO:tasks.workunit.client.0.smithi070.stderr: -408> 2024-09-12T00:55:23.858+0000 7f35277bc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:55:24.182 INFO:tasks.workunit.client.0.smithi070.stderr: -407> 2024-09-12T00:55:23.858+0000 7f340ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:24.182 INFO:tasks.workunit.client.0.smithi070.stderr: -406> 2024-09-12T00:55:23.858+0000 7f340ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:55:24.182 INFO:tasks.workunit.client.0.smithi070.stderr: -405> 2024-09-12T00:55:23.858+0000 7f340ffff640 10 monclient: dump: 2024-09-12T00:55:24.182 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:24.182 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:24.182 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.182 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.182 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:24.182 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.183 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:24.183 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:24.183 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:24.183 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.183 INFO:tasks.workunit.client.0.smithi070.stderr: -404> 2024-09-12T00:55:23.858+0000 7f340ffff640 10 monclient: _finish_auth 0 2024-09-12T00:55:24.183 INFO:tasks.workunit.client.0.smithi070.stderr: -403> 2024-09-12T00:55:23.858+0000 7f340ffff640 10 monclient: _check_auth_tickets 2024-09-12T00:55:24.183 INFO:tasks.workunit.client.0.smithi070.stderr: -402> 2024-09-12T00:55:23.858+0000 7f340ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:24.183 INFO:tasks.workunit.client.0.smithi070.stderr: -401> 2024-09-12T00:55:23.858+0000 7f340ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:24.183 INFO:tasks.workunit.client.0.smithi070.stderr: -400> 2024-09-12T00:55:23.858+0000 7f340ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:24.183 INFO:tasks.workunit.client.0.smithi070.stderr: -399> 2024-09-12T00:55:23.858+0000 7f340ffff640 10 monclient: dump: 2024-09-12T00:55:24.183 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:24.183 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:24.183 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.183 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.184 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:24.184 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.184 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:24.184 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:24.184 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:24.184 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.184 INFO:tasks.workunit.client.0.smithi070.stderr: -398> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 monclient: authenticate success, global_id 6924 2024-09-12T00:55:24.184 INFO:tasks.workunit.client.0.smithi070.stderr: -397> 2024-09-12T00:55:23.858+0000 7f3415e0b640 4 set_mon_vals no callback set 2024-09-12T00:55:24.184 INFO:tasks.workunit.client.0.smithi070.stderr: -396> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient: _renew_subs 2024-09-12T00:55:24.184 INFO:tasks.workunit.client.0.smithi070.stderr: -395> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:55:24.184 INFO:tasks.workunit.client.0.smithi070.stderr: -394> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient: _renew_subs 2024-09-12T00:55:24.185 INFO:tasks.workunit.client.0.smithi070.stderr: -393> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:55:24.185 INFO:tasks.workunit.client.0.smithi070.stderr: -392> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 1 librados: init done 2024-09-12T00:55:24.185 INFO:tasks.workunit.client.0.smithi070.stderr: -391> 2024-09-12T00:55:23.862+0000 7f340ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:24.185 INFO:tasks.workunit.client.0.smithi070.stderr: -390> 2024-09-12T00:55:23.862+0000 7f340ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:55:24.185 INFO:tasks.workunit.client.0.smithi070.stderr: -389> 2024-09-12T00:55:23.862+0000 7f340ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:55:24.185 INFO:tasks.workunit.client.0.smithi070.stderr: -388> 2024-09-12T00:55:23.862+0000 7f3527fbd640 10 monclient: get_auth_request con 0x7f3410070ae0 auth_method 0 2024-09-12T00:55:24.185 INFO:tasks.workunit.client.0.smithi070.stderr: -387> 2024-09-12T00:55:23.862+0000 7f35287be640 10 monclient: get_auth_request con 0x562a4d20e150 auth_method 0 2024-09-12T00:55:24.185 INFO:tasks.workunit.client.0.smithi070.stderr: -386> 2024-09-12T00:55:23.862+0000 7f3527fbd640 10 monclient: get_auth_request con 0x562a4d230c10 auth_method 0 2024-09-12T00:55:24.185 INFO:tasks.workunit.client.0.smithi070.stderr: -385> 2024-09-12T00:55:23.862+0000 7f35277bc640 10 monclient: get_auth_request con 0x562a4d234fc0 auth_method 0 2024-09-12T00:55:24.185 INFO:tasks.workunit.client.0.smithi070.stderr: -384> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient: build_initial_monmap 2024-09-12T00:55:24.185 INFO:tasks.workunit.client.0.smithi070.stderr: -383> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 1 build_initial for_mkfs: 0 2024-09-12T00:55:24.185 INFO:tasks.workunit.client.0.smithi070.stderr: -382> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient: monmap: 2024-09-12T00:55:24.185 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:55:24.186 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:24.186 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:55:24.186 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:55:24.186 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:24.186 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.186 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:55:24.186 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:55:24.186 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:55:24.186 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.186 INFO:tasks.workunit.client.0.smithi070.stderr: -381> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding auth protocol: cephx 2024-09-12T00:55:24.186 INFO:tasks.workunit.client.0.smithi070.stderr: -380> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding auth protocol: cephx 2024-09-12T00:55:24.186 INFO:tasks.workunit.client.0.smithi070.stderr: -379> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding auth protocol: cephx 2024-09-12T00:55:24.186 INFO:tasks.workunit.client.0.smithi070.stderr: -378> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding con mode: secure 2024-09-12T00:55:24.186 INFO:tasks.workunit.client.0.smithi070.stderr: -377> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding con mode: crc 2024-09-12T00:55:24.187 INFO:tasks.workunit.client.0.smithi070.stderr: -376> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding con mode: secure 2024-09-12T00:55:24.187 INFO:tasks.workunit.client.0.smithi070.stderr: -375> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding con mode: crc 2024-09-12T00:55:24.187 INFO:tasks.workunit.client.0.smithi070.stderr: -374> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding con mode: secure 2024-09-12T00:55:24.187 INFO:tasks.workunit.client.0.smithi070.stderr: -373> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding con mode: crc 2024-09-12T00:55:24.187 INFO:tasks.workunit.client.0.smithi070.stderr: -372> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding con mode: crc 2024-09-12T00:55:24.187 INFO:tasks.workunit.client.0.smithi070.stderr: -371> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding con mode: secure 2024-09-12T00:55:24.187 INFO:tasks.workunit.client.0.smithi070.stderr: -370> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding con mode: crc 2024-09-12T00:55:24.187 INFO:tasks.workunit.client.0.smithi070.stderr: -369> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding con mode: secure 2024-09-12T00:55:24.187 INFO:tasks.workunit.client.0.smithi070.stderr: -368> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding con mode: crc 2024-09-12T00:55:24.187 INFO:tasks.workunit.client.0.smithi070.stderr: -367> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding con mode: secure 2024-09-12T00:55:24.187 INFO:tasks.workunit.client.0.smithi070.stderr: -366> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:24.187 INFO:tasks.workunit.client.0.smithi070.stderr: -365> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command objecter_requests cmddesc objecter_requests hook 0x562a4d23d890 EEXIST 2024-09-12T00:55:24.187 INFO:tasks.workunit.client.0.smithi070.stderr: -364> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient: init 2024-09-12T00:55:24.188 INFO:tasks.workunit.client.0.smithi070.stderr: -363> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding auth protocol: cephx 2024-09-12T00:55:24.188 INFO:tasks.workunit.client.0.smithi070.stderr: -362> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding auth protocol: cephx 2024-09-12T00:55:24.188 INFO:tasks.workunit.client.0.smithi070.stderr: -361> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding auth protocol: cephx 2024-09-12T00:55:24.188 INFO:tasks.workunit.client.0.smithi070.stderr: -360> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding con mode: secure 2024-09-12T00:55:24.188 INFO:tasks.workunit.client.0.smithi070.stderr: -359> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding con mode: crc 2024-09-12T00:55:24.188 INFO:tasks.workunit.client.0.smithi070.stderr: -358> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding con mode: secure 2024-09-12T00:55:24.188 INFO:tasks.workunit.client.0.smithi070.stderr: -357> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding con mode: crc 2024-09-12T00:55:24.188 INFO:tasks.workunit.client.0.smithi070.stderr: -356> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding con mode: secure 2024-09-12T00:55:24.188 INFO:tasks.workunit.client.0.smithi070.stderr: -355> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding con mode: crc 2024-09-12T00:55:24.188 INFO:tasks.workunit.client.0.smithi070.stderr: -354> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding con mode: crc 2024-09-12T00:55:24.188 INFO:tasks.workunit.client.0.smithi070.stderr: -353> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding con mode: secure 2024-09-12T00:55:24.188 INFO:tasks.workunit.client.0.smithi070.stderr: -352> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding con mode: crc 2024-09-12T00:55:24.188 INFO:tasks.workunit.client.0.smithi070.stderr: -351> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding con mode: secure 2024-09-12T00:55:24.189 INFO:tasks.workunit.client.0.smithi070.stderr: -350> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding con mode: crc 2024-09-12T00:55:24.189 INFO:tasks.workunit.client.0.smithi070.stderr: -349> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding con mode: secure 2024-09-12T00:55:24.189 INFO:tasks.workunit.client.0.smithi070.stderr: -348> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:24.189 INFO:tasks.workunit.client.0.smithi070.stderr: -347> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:24.189 INFO:tasks.workunit.client.0.smithi070.stderr: -346> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command rotate-key cmddesc rotate-key hook 0x562a4d2386a0 EEXIST 2024-09-12T00:55:24.189 INFO:tasks.workunit.client.0.smithi070.stderr: -345> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient: _reopen_session rank -1 2024-09-12T00:55:24.189 INFO:tasks.workunit.client.0.smithi070.stderr: -344> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:55:24.189 INFO:tasks.workunit.client.0.smithi070.stderr: -343> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient(hunting): picked mon.noname-c con 0x562a4d261a40 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:55:24.189 INFO:tasks.workunit.client.0.smithi070.stderr: -342> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient(hunting): picked mon.noname-b con 0x562a4d261370 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:55:24.189 INFO:tasks.workunit.client.0.smithi070.stderr: -341> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient(hunting): picked mon.noname-a con 0x562a4d25fd50 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:55:24.189 INFO:tasks.workunit.client.0.smithi070.stderr: -340> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:24.189 INFO:tasks.workunit.client.0.smithi070.stderr: -339> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:24.189 INFO:tasks.workunit.client.0.smithi070.stderr: -338> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:24.190 INFO:tasks.workunit.client.0.smithi070.stderr: -337> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient(hunting): _renew_subs 2024-09-12T00:55:24.190 INFO:tasks.workunit.client.0.smithi070.stderr: -336> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient(hunting): authenticate will time out at 2174.314714s 2024-09-12T00:55:24.190 INFO:tasks.workunit.client.0.smithi070.stderr: -335> 2024-09-12T00:55:23.866+0000 7f3527fbd640 10 monclient(hunting): get_auth_request con 0x562a4d261a40 auth_method 0 2024-09-12T00:55:24.190 INFO:tasks.workunit.client.0.smithi070.stderr: -334> 2024-09-12T00:55:23.866+0000 7f3527fbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:24.190 INFO:tasks.workunit.client.0.smithi070.stderr: -333> 2024-09-12T00:55:23.866+0000 7f3527fbd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:24.190 INFO:tasks.workunit.client.0.smithi070.stderr: -332> 2024-09-12T00:55:23.866+0000 7f3527fbd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:24.190 INFO:tasks.workunit.client.0.smithi070.stderr: -331> 2024-09-12T00:55:23.866+0000 7f35287be640 10 monclient(hunting): get_auth_request con 0x562a4d25fd50 auth_method 0 2024-09-12T00:55:24.190 INFO:tasks.workunit.client.0.smithi070.stderr: -330> 2024-09-12T00:55:23.866+0000 7f35287be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:24.190 INFO:tasks.workunit.client.0.smithi070.stderr: -329> 2024-09-12T00:55:23.866+0000 7f35287be640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:24.190 INFO:tasks.workunit.client.0.smithi070.stderr: -328> 2024-09-12T00:55:23.866+0000 7f35287be640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:24.190 INFO:tasks.workunit.client.0.smithi070.stderr: -327> 2024-09-12T00:55:23.866+0000 7f3527fbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:24.190 INFO:tasks.workunit.client.0.smithi070.stderr: -326> 2024-09-12T00:55:23.866+0000 7f3527fbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:24.190 INFO:tasks.workunit.client.0.smithi070.stderr: -325> 2024-09-12T00:55:23.866+0000 7f3527fbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:24.190 INFO:tasks.workunit.client.0.smithi070.stderr: -324> 2024-09-12T00:55:23.866+0000 7f35287be640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:24.191 INFO:tasks.workunit.client.0.smithi070.stderr: -323> 2024-09-12T00:55:23.866+0000 7f35287be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:24.191 INFO:tasks.workunit.client.0.smithi070.stderr: -322> 2024-09-12T00:55:23.866+0000 7f35287be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:24.191 INFO:tasks.workunit.client.0.smithi070.stderr: -321> 2024-09-12T00:55:23.866+0000 7f35277bc640 10 monclient(hunting): get_auth_request con 0x562a4d261370 auth_method 0 2024-09-12T00:55:24.191 INFO:tasks.workunit.client.0.smithi070.stderr: -320> 2024-09-12T00:55:23.866+0000 7f35277bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:24.191 INFO:tasks.workunit.client.0.smithi070.stderr: -319> 2024-09-12T00:55:23.866+0000 7f35277bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:24.191 INFO:tasks.workunit.client.0.smithi070.stderr: -318> 2024-09-12T00:55:23.866+0000 7f35277bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:24.191 INFO:tasks.workunit.client.0.smithi070.stderr: -317> 2024-09-12T00:55:23.866+0000 7f35287be640 10 monclient(hunting): handle_auth_done global_id 6927 payload 824 2024-09-12T00:55:24.191 INFO:tasks.workunit.client.0.smithi070.stderr: -316> 2024-09-12T00:55:23.866+0000 7f35287be640 10 monclient: _finish_hunting 0 2024-09-12T00:55:24.191 INFO:tasks.workunit.client.0.smithi070.stderr: -315> 2024-09-12T00:55:23.866+0000 7f35287be640 1 monclient: found mon.noname-a 2024-09-12T00:55:24.191 INFO:tasks.workunit.client.0.smithi070.stderr: -314> 2024-09-12T00:55:23.866+0000 7f35287be640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:55:24.191 INFO:tasks.workunit.client.0.smithi070.stderr: -313> 2024-09-12T00:55:23.866+0000 7f340d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:24.191 INFO:tasks.workunit.client.0.smithi070.stderr: -312> 2024-09-12T00:55:23.866+0000 7f340d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:55:24.191 INFO:tasks.workunit.client.0.smithi070.stderr: -311> 2024-09-12T00:55:23.866+0000 7f340d7fa640 10 monclient: dump: 2024-09-12T00:55:24.192 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:24.192 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:24.192 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.192 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.192 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:24.192 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.192 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:24.192 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:24.192 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:24.192 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.192 INFO:tasks.workunit.client.0.smithi070.stderr: -310> 2024-09-12T00:55:23.866+0000 7f340d7fa640 10 monclient: _finish_auth 0 2024-09-12T00:55:24.192 INFO:tasks.workunit.client.0.smithi070.stderr: -309> 2024-09-12T00:55:23.866+0000 7f340d7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:55:24.192 INFO:tasks.workunit.client.0.smithi070.stderr: -308> 2024-09-12T00:55:23.866+0000 7f340d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:24.192 INFO:tasks.workunit.client.0.smithi070.stderr: -307> 2024-09-12T00:55:23.866+0000 7f340d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:24.193 INFO:tasks.workunit.client.0.smithi070.stderr: -306> 2024-09-12T00:55:23.866+0000 7f340d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:24.193 INFO:tasks.workunit.client.0.smithi070.stderr: -305> 2024-09-12T00:55:23.866+0000 7f340d7fa640 10 monclient: dump: 2024-09-12T00:55:24.193 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:24.193 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:24.193 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.193 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.193 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:24.193 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.193 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:24.193 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:24.193 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:24.193 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.193 INFO:tasks.workunit.client.0.smithi070.stderr: -304> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 monclient: authenticate success, global_id 6927 2024-09-12T00:55:24.194 INFO:tasks.workunit.client.0.smithi070.stderr: -303> 2024-09-12T00:55:23.866+0000 7f3528fbf640 4 set_mon_vals no callback set 2024-09-12T00:55:24.194 INFO:tasks.workunit.client.0.smithi070.stderr: -302> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient: _renew_subs 2024-09-12T00:55:24.194 INFO:tasks.workunit.client.0.smithi070.stderr: -301> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:55:24.194 INFO:tasks.workunit.client.0.smithi070.stderr: -300> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient: _renew_subs 2024-09-12T00:55:24.194 INFO:tasks.workunit.client.0.smithi070.stderr: -299> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:55:24.194 INFO:tasks.workunit.client.0.smithi070.stderr: -298> 2024-09-12T00:55:23.870+0000 7f340d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:24.194 INFO:tasks.workunit.client.0.smithi070.stderr: -297> 2024-09-12T00:55:23.870+0000 7f340d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:55:24.194 INFO:tasks.workunit.client.0.smithi070.stderr: -296> 2024-09-12T00:55:23.870+0000 7f340d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:55:24.194 INFO:tasks.workunit.client.0.smithi070.stderr: -295> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient: get_monmap_and_config 2024-09-12T00:55:24.194 INFO:tasks.workunit.client.0.smithi070.stderr: -294> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient: build_initial_monmap 2024-09-12T00:55:24.194 INFO:tasks.workunit.client.0.smithi070.stderr: -293> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 1 build_initial for_mkfs: 0 2024-09-12T00:55:24.194 INFO:tasks.workunit.client.0.smithi070.stderr: -292> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient: monmap: 2024-09-12T00:55:24.194 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:55:24.194 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:24.195 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:55:24.195 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:55:24.195 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:24.195 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.195 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:55:24.195 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:55:24.195 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:55:24.195 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.195 INFO:tasks.workunit.client.0.smithi070.stderr: -291> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding auth protocol: cephx 2024-09-12T00:55:24.195 INFO:tasks.workunit.client.0.smithi070.stderr: -290> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding auth protocol: cephx 2024-09-12T00:55:24.195 INFO:tasks.workunit.client.0.smithi070.stderr: -289> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding auth protocol: cephx 2024-09-12T00:55:24.195 INFO:tasks.workunit.client.0.smithi070.stderr: -288> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding con mode: secure 2024-09-12T00:55:24.195 INFO:tasks.workunit.client.0.smithi070.stderr: -287> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding con mode: crc 2024-09-12T00:55:24.196 INFO:tasks.workunit.client.0.smithi070.stderr: -286> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding con mode: secure 2024-09-12T00:55:24.196 INFO:tasks.workunit.client.0.smithi070.stderr: -285> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding con mode: crc 2024-09-12T00:55:24.196 INFO:tasks.workunit.client.0.smithi070.stderr: -284> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding con mode: secure 2024-09-12T00:55:24.196 INFO:tasks.workunit.client.0.smithi070.stderr: -283> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding con mode: crc 2024-09-12T00:55:24.196 INFO:tasks.workunit.client.0.smithi070.stderr: -282> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding con mode: crc 2024-09-12T00:55:24.196 INFO:tasks.workunit.client.0.smithi070.stderr: -281> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding con mode: secure 2024-09-12T00:55:24.196 INFO:tasks.workunit.client.0.smithi070.stderr: -280> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding con mode: crc 2024-09-12T00:55:24.196 INFO:tasks.workunit.client.0.smithi070.stderr: -279> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding con mode: secure 2024-09-12T00:55:24.196 INFO:tasks.workunit.client.0.smithi070.stderr: -278> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding con mode: crc 2024-09-12T00:55:24.196 INFO:tasks.workunit.client.0.smithi070.stderr: -277> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding con mode: secure 2024-09-12T00:55:24.196 INFO:tasks.workunit.client.0.smithi070.stderr: -276> 2024-09-12T00:55:23.870+0000 7f3527fbd640 10 monclient: get_auth_request con 0x7f3400070a20 auth_method 0 2024-09-12T00:55:24.196 INFO:tasks.workunit.client.0.smithi070.stderr: -275> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:24.196 INFO:tasks.workunit.client.0.smithi070.stderr: -274> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient: init 2024-09-12T00:55:24.196 INFO:tasks.workunit.client.0.smithi070.stderr: -273> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding auth protocol: cephx 2024-09-12T00:55:24.197 INFO:tasks.workunit.client.0.smithi070.stderr: -272> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding auth protocol: cephx 2024-09-12T00:55:24.197 INFO:tasks.workunit.client.0.smithi070.stderr: -271> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding auth protocol: cephx 2024-09-12T00:55:24.197 INFO:tasks.workunit.client.0.smithi070.stderr: -270> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding con mode: secure 2024-09-12T00:55:24.197 INFO:tasks.workunit.client.0.smithi070.stderr: -269> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding con mode: crc 2024-09-12T00:55:24.197 INFO:tasks.workunit.client.0.smithi070.stderr: -268> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding con mode: secure 2024-09-12T00:55:24.197 INFO:tasks.workunit.client.0.smithi070.stderr: -267> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding con mode: crc 2024-09-12T00:55:24.197 INFO:tasks.workunit.client.0.smithi070.stderr: -266> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding con mode: secure 2024-09-12T00:55:24.197 INFO:tasks.workunit.client.0.smithi070.stderr: -265> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding con mode: crc 2024-09-12T00:55:24.197 INFO:tasks.workunit.client.0.smithi070.stderr: -264> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding con mode: crc 2024-09-12T00:55:24.197 INFO:tasks.workunit.client.0.smithi070.stderr: -263> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding con mode: secure 2024-09-12T00:55:24.197 INFO:tasks.workunit.client.0.smithi070.stderr: -262> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding con mode: crc 2024-09-12T00:55:24.197 INFO:tasks.workunit.client.0.smithi070.stderr: -261> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding con mode: secure 2024-09-12T00:55:24.197 INFO:tasks.workunit.client.0.smithi070.stderr: -260> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding con mode: crc 2024-09-12T00:55:24.198 INFO:tasks.workunit.client.0.smithi070.stderr: -259> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding con mode: secure 2024-09-12T00:55:24.198 INFO:tasks.workunit.client.0.smithi070.stderr: -258> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:24.198 INFO:tasks.workunit.client.0.smithi070.stderr: -257> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:24.198 INFO:tasks.workunit.client.0.smithi070.stderr: -256> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc395755b8 EEXIST 2024-09-12T00:55:24.198 INFO:tasks.workunit.client.0.smithi070.stderr: -255> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient: _reopen_session rank -1 2024-09-12T00:55:24.198 INFO:tasks.workunit.client.0.smithi070.stderr: -254> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:55:24.198 INFO:tasks.workunit.client.0.smithi070.stderr: -253> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient(hunting): picked mon.noname-c con 0x562a4d2b5760 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:55:24.198 INFO:tasks.workunit.client.0.smithi070.stderr: -252> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient(hunting): picked mon.noname-a con 0x562a4d2afd10 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:55:24.198 INFO:tasks.workunit.client.0.smithi070.stderr: -251> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient(hunting): picked mon.noname-b con 0x562a4d286850 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:55:24.198 INFO:tasks.workunit.client.0.smithi070.stderr: -250> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:24.198 INFO:tasks.workunit.client.0.smithi070.stderr: -249> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:24.198 INFO:tasks.workunit.client.0.smithi070.stderr: -248> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:24.198 INFO:tasks.workunit.client.0.smithi070.stderr: -247> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient(hunting): _renew_subs 2024-09-12T00:55:24.199 INFO:tasks.workunit.client.0.smithi070.stderr: -246> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient(hunting): authenticate will time out at 2174.318886s 2024-09-12T00:55:24.199 INFO:tasks.workunit.client.0.smithi070.stderr: -245> 2024-09-12T00:55:23.870+0000 7f35277bc640 10 monclient(hunting): get_auth_request con 0x562a4d2afd10 auth_method 0 2024-09-12T00:55:24.199 INFO:tasks.workunit.client.0.smithi070.stderr: -244> 2024-09-12T00:55:23.870+0000 7f35277bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:24.199 INFO:tasks.workunit.client.0.smithi070.stderr: -243> 2024-09-12T00:55:23.870+0000 7f35277bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:24.199 INFO:tasks.workunit.client.0.smithi070.stderr: -242> 2024-09-12T00:55:23.870+0000 7f35277bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:24.199 INFO:tasks.workunit.client.0.smithi070.stderr: -241> 2024-09-12T00:55:23.870+0000 7f3527fbd640 10 monclient(hunting): get_auth_request con 0x562a4d2b5760 auth_method 0 2024-09-12T00:55:24.199 INFO:tasks.workunit.client.0.smithi070.stderr: -240> 2024-09-12T00:55:23.870+0000 7f3527fbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:24.199 INFO:tasks.workunit.client.0.smithi070.stderr: -239> 2024-09-12T00:55:23.870+0000 7f3527fbd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:24.199 INFO:tasks.workunit.client.0.smithi070.stderr: -238> 2024-09-12T00:55:23.870+0000 7f3527fbd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:24.199 INFO:tasks.workunit.client.0.smithi070.stderr: -237> 2024-09-12T00:55:23.870+0000 7f35277bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:24.199 INFO:tasks.workunit.client.0.smithi070.stderr: -236> 2024-09-12T00:55:23.870+0000 7f35277bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:24.199 INFO:tasks.workunit.client.0.smithi070.stderr: -235> 2024-09-12T00:55:23.870+0000 7f35277bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:24.199 INFO:tasks.workunit.client.0.smithi070.stderr: -234> 2024-09-12T00:55:23.870+0000 7f3527fbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:24.199 INFO:tasks.workunit.client.0.smithi070.stderr: -233> 2024-09-12T00:55:23.870+0000 7f3527fbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:24.200 INFO:tasks.workunit.client.0.smithi070.stderr: -232> 2024-09-12T00:55:23.870+0000 7f3527fbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:24.200 INFO:tasks.workunit.client.0.smithi070.stderr: -231> 2024-09-12T00:55:23.870+0000 7f35277bc640 10 monclient(hunting): handle_auth_done global_id 6930 payload 274 2024-09-12T00:55:24.200 INFO:tasks.workunit.client.0.smithi070.stderr: -230> 2024-09-12T00:55:23.870+0000 7f35277bc640 10 monclient: _finish_hunting 0 2024-09-12T00:55:24.200 INFO:tasks.workunit.client.0.smithi070.stderr: -229> 2024-09-12T00:55:23.870+0000 7f35277bc640 1 monclient: found mon.noname-a 2024-09-12T00:55:24.200 INFO:tasks.workunit.client.0.smithi070.stderr: -228> 2024-09-12T00:55:23.870+0000 7f35277bc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:55:24.200 INFO:tasks.workunit.client.0.smithi070.stderr: -227> 2024-09-12T00:55:23.870+0000 7f3406ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:24.200 INFO:tasks.workunit.client.0.smithi070.stderr: -226> 2024-09-12T00:55:23.870+0000 7f3406ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:55:24.200 INFO:tasks.workunit.client.0.smithi070.stderr: -225> 2024-09-12T00:55:23.870+0000 7f3406ffd640 10 monclient: dump: 2024-09-12T00:55:24.200 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:24.200 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:24.200 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.200 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.200 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:24.200 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.201 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:24.201 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:24.201 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:24.201 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.201 INFO:tasks.workunit.client.0.smithi070.stderr: -224> 2024-09-12T00:55:23.870+0000 7f3406ffd640 10 monclient: _finish_auth 0 2024-09-12T00:55:24.201 INFO:tasks.workunit.client.0.smithi070.stderr: -223> 2024-09-12T00:55:23.870+0000 7f3406ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:55:24.201 INFO:tasks.workunit.client.0.smithi070.stderr: -222> 2024-09-12T00:55:23.870+0000 7f3406ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:24.201 INFO:tasks.workunit.client.0.smithi070.stderr: -221> 2024-09-12T00:55:23.870+0000 7f3406ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:24.201 INFO:tasks.workunit.client.0.smithi070.stderr: -220> 2024-09-12T00:55:23.870+0000 7f3406ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:24.201 INFO:tasks.workunit.client.0.smithi070.stderr: -219> 2024-09-12T00:55:23.870+0000 7f3406ffd640 10 monclient: dump: 2024-09-12T00:55:24.201 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:24.201 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:24.201 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.201 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.202 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:24.202 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.202 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:24.202 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:24.202 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:24.202 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.202 INFO:tasks.workunit.client.0.smithi070.stderr: -218> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 monclient: authenticate success, global_id 6930 2024-09-12T00:55:24.202 INFO:tasks.workunit.client.0.smithi070.stderr: -217> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient: get_monmap_and_config success 2024-09-12T00:55:24.202 INFO:tasks.workunit.client.0.smithi070.stderr: -216> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 4 set_mon_vals no callback set 2024-09-12T00:55:24.202 INFO:tasks.workunit.client.0.smithi070.stderr: -215> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient: shutdown 2024-09-12T00:55:24.202 INFO:tasks.workunit.client.0.smithi070.stderr: -214> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient: build_initial_monmap 2024-09-12T00:55:24.202 INFO:tasks.workunit.client.0.smithi070.stderr: -213> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 1 build_initial for_mkfs: 0 2024-09-12T00:55:24.202 INFO:tasks.workunit.client.0.smithi070.stderr: -212> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient: monmap: 2024-09-12T00:55:24.202 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:55:24.203 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:24.203 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:55:24.203 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:55:24.203 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:24.203 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.203 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:55:24.203 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:55:24.203 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:55:24.203 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.203 INFO:tasks.workunit.client.0.smithi070.stderr: -211> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding auth protocol: cephx 2024-09-12T00:55:24.203 INFO:tasks.workunit.client.0.smithi070.stderr: -210> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding auth protocol: cephx 2024-09-12T00:55:24.203 INFO:tasks.workunit.client.0.smithi070.stderr: -209> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding auth protocol: cephx 2024-09-12T00:55:24.203 INFO:tasks.workunit.client.0.smithi070.stderr: -208> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding con mode: secure 2024-09-12T00:55:24.204 INFO:tasks.workunit.client.0.smithi070.stderr: -207> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding con mode: crc 2024-09-12T00:55:24.204 INFO:tasks.workunit.client.0.smithi070.stderr: -206> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding con mode: secure 2024-09-12T00:55:24.204 INFO:tasks.workunit.client.0.smithi070.stderr: -205> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding con mode: crc 2024-09-12T00:55:24.204 INFO:tasks.workunit.client.0.smithi070.stderr: -204> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding con mode: secure 2024-09-12T00:55:24.204 INFO:tasks.workunit.client.0.smithi070.stderr: -203> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding con mode: crc 2024-09-12T00:55:24.204 INFO:tasks.workunit.client.0.smithi070.stderr: -202> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding con mode: crc 2024-09-12T00:55:24.204 INFO:tasks.workunit.client.0.smithi070.stderr: -201> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding con mode: secure 2024-09-12T00:55:24.204 INFO:tasks.workunit.client.0.smithi070.stderr: -200> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding con mode: crc 2024-09-12T00:55:24.204 INFO:tasks.workunit.client.0.smithi070.stderr: -199> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding con mode: secure 2024-09-12T00:55:24.204 INFO:tasks.workunit.client.0.smithi070.stderr: -198> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding con mode: crc 2024-09-12T00:55:24.204 INFO:tasks.workunit.client.0.smithi070.stderr: -197> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding con mode: secure 2024-09-12T00:55:24.204 INFO:tasks.workunit.client.0.smithi070.stderr: -196> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:24.204 INFO:tasks.workunit.client.0.smithi070.stderr: -195> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 1 librados: starting msgr at 2024-09-12T00:55:24.205 INFO:tasks.workunit.client.0.smithi070.stderr: -194> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 1 librados: starting objecter 2024-09-12T00:55:24.205 INFO:tasks.workunit.client.0.smithi070.stderr: -193> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command objecter_requests cmddesc objecter_requests hook 0x562a4d263340 EEXIST 2024-09-12T00:55:24.205 INFO:tasks.workunit.client.0.smithi070.stderr: -192> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 1 librados: setting wanted keys 2024-09-12T00:55:24.205 INFO:tasks.workunit.client.0.smithi070.stderr: -191> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 1 librados: calling monclient init 2024-09-12T00:55:24.205 INFO:tasks.workunit.client.0.smithi070.stderr: -190> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient: init 2024-09-12T00:55:24.205 INFO:tasks.workunit.client.0.smithi070.stderr: -189> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding auth protocol: cephx 2024-09-12T00:55:24.205 INFO:tasks.workunit.client.0.smithi070.stderr: -188> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding auth protocol: cephx 2024-09-12T00:55:24.205 INFO:tasks.workunit.client.0.smithi070.stderr: -187> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding auth protocol: cephx 2024-09-12T00:55:24.205 INFO:tasks.workunit.client.0.smithi070.stderr: -186> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding con mode: secure 2024-09-12T00:55:24.205 INFO:tasks.workunit.client.0.smithi070.stderr: -185> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding con mode: crc 2024-09-12T00:55:24.205 INFO:tasks.workunit.client.0.smithi070.stderr: -184> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding con mode: secure 2024-09-12T00:55:24.205 INFO:tasks.workunit.client.0.smithi070.stderr: -183> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding con mode: crc 2024-09-12T00:55:24.205 INFO:tasks.workunit.client.0.smithi070.stderr: -182> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding con mode: secure 2024-09-12T00:55:24.206 INFO:tasks.workunit.client.0.smithi070.stderr: -181> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding con mode: crc 2024-09-12T00:55:24.206 INFO:tasks.workunit.client.0.smithi070.stderr: -180> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding con mode: crc 2024-09-12T00:55:24.206 INFO:tasks.workunit.client.0.smithi070.stderr: -179> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding con mode: secure 2024-09-12T00:55:24.206 INFO:tasks.workunit.client.0.smithi070.stderr: -178> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding con mode: crc 2024-09-12T00:55:24.206 INFO:tasks.workunit.client.0.smithi070.stderr: -177> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding con mode: secure 2024-09-12T00:55:24.206 INFO:tasks.workunit.client.0.smithi070.stderr: -176> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding con mode: crc 2024-09-12T00:55:24.206 INFO:tasks.workunit.client.0.smithi070.stderr: -175> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding con mode: secure 2024-09-12T00:55:24.206 INFO:tasks.workunit.client.0.smithi070.stderr: -174> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:24.206 INFO:tasks.workunit.client.0.smithi070.stderr: -173> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:24.206 INFO:tasks.workunit.client.0.smithi070.stderr: -172> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command rotate-key cmddesc rotate-key hook 0x562a4d2639a8 EEXIST 2024-09-12T00:55:24.207 INFO:tasks.workunit.client.0.smithi070.stderr: -171> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient: _reopen_session rank -1 2024-09-12T00:55:24.207 INFO:tasks.workunit.client.0.smithi070.stderr: -170> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:55:24.207 INFO:tasks.workunit.client.0.smithi070.stderr: -169> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient(hunting): picked mon.noname-c con 0x562a4d286850 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:55:24.207 INFO:tasks.workunit.client.0.smithi070.stderr: -168> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient(hunting): picked mon.noname-b con 0x562a4d2afd10 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:55:24.207 INFO:tasks.workunit.client.0.smithi070.stderr: -167> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient(hunting): picked mon.noname-a con 0x562a4d2b5760 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:55:24.207 INFO:tasks.workunit.client.0.smithi070.stderr: -166> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:24.207 INFO:tasks.workunit.client.0.smithi070.stderr: -165> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:24.207 INFO:tasks.workunit.client.0.smithi070.stderr: -164> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:24.207 INFO:tasks.workunit.client.0.smithi070.stderr: -163> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient(hunting): _renew_subs 2024-09-12T00:55:24.207 INFO:tasks.workunit.client.0.smithi070.stderr: -162> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient(hunting): authenticate will time out at 2174.321392s 2024-09-12T00:55:24.207 INFO:tasks.workunit.client.0.smithi070.stderr: -161> 2024-09-12T00:55:23.874+0000 7f3527fbd640 10 monclient(hunting): get_auth_request con 0x562a4d286850 auth_method 0 2024-09-12T00:55:24.207 INFO:tasks.workunit.client.0.smithi070.stderr: -160> 2024-09-12T00:55:23.874+0000 7f3527fbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:24.207 INFO:tasks.workunit.client.0.smithi070.stderr: -159> 2024-09-12T00:55:23.874+0000 7f3527fbd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:24.208 INFO:tasks.workunit.client.0.smithi070.stderr: -158> 2024-09-12T00:55:23.874+0000 7f3527fbd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:24.208 INFO:tasks.workunit.client.0.smithi070.stderr: -157> 2024-09-12T00:55:23.874+0000 7f35287be640 10 monclient(hunting): get_auth_request con 0x562a4d2b5760 auth_method 0 2024-09-12T00:55:24.208 INFO:tasks.workunit.client.0.smithi070.stderr: -156> 2024-09-12T00:55:23.874+0000 7f35287be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:24.208 INFO:tasks.workunit.client.0.smithi070.stderr: -155> 2024-09-12T00:55:23.874+0000 7f35287be640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:24.208 INFO:tasks.workunit.client.0.smithi070.stderr: -154> 2024-09-12T00:55:23.874+0000 7f35287be640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:24.208 INFO:tasks.workunit.client.0.smithi070.stderr: -153> 2024-09-12T00:55:23.874+0000 7f3527fbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:24.208 INFO:tasks.workunit.client.0.smithi070.stderr: -152> 2024-09-12T00:55:23.874+0000 7f3527fbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:24.208 INFO:tasks.workunit.client.0.smithi070.stderr: -151> 2024-09-12T00:55:23.874+0000 7f3527fbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:24.208 INFO:tasks.workunit.client.0.smithi070.stderr: -150> 2024-09-12T00:55:23.874+0000 7f35287be640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:24.208 INFO:tasks.workunit.client.0.smithi070.stderr: -149> 2024-09-12T00:55:23.874+0000 7f35287be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:24.208 INFO:tasks.workunit.client.0.smithi070.stderr: -148> 2024-09-12T00:55:23.874+0000 7f35287be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:24.208 INFO:tasks.workunit.client.0.smithi070.stderr: -147> 2024-09-12T00:55:23.874+0000 7f3527fbd640 10 monclient(hunting): handle_auth_done global_id 6542 payload 824 2024-09-12T00:55:24.208 INFO:tasks.workunit.client.0.smithi070.stderr: -146> 2024-09-12T00:55:23.874+0000 7f3527fbd640 10 monclient: _finish_hunting 0 2024-09-12T00:55:24.208 INFO:tasks.workunit.client.0.smithi070.stderr: -145> 2024-09-12T00:55:23.874+0000 7f3527fbd640 1 monclient: found mon.noname-c 2024-09-12T00:55:24.209 INFO:tasks.workunit.client.0.smithi070.stderr: -144> 2024-09-12T00:55:23.874+0000 7f3527fbd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:55:24.209 INFO:tasks.workunit.client.0.smithi070.stderr: -143> 2024-09-12T00:55:23.874+0000 7f34057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:24.209 INFO:tasks.workunit.client.0.smithi070.stderr: -142> 2024-09-12T00:55:23.874+0000 7f34057fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:55:24.209 INFO:tasks.workunit.client.0.smithi070.stderr: -141> 2024-09-12T00:55:23.874+0000 7f34057fa640 10 monclient: dump: 2024-09-12T00:55:24.209 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:24.209 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:24.209 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.209 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.209 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:24.209 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.209 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:24.209 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:24.209 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:24.210 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.210 INFO:tasks.workunit.client.0.smithi070.stderr: -140> 2024-09-12T00:55:23.874+0000 7f34057fa640 10 monclient: _finish_auth 0 2024-09-12T00:55:24.210 INFO:tasks.workunit.client.0.smithi070.stderr: -139> 2024-09-12T00:55:23.874+0000 7f34057fa640 10 monclient: _check_auth_tickets 2024-09-12T00:55:24.210 INFO:tasks.workunit.client.0.smithi070.stderr: -138> 2024-09-12T00:55:23.874+0000 7f34057fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:24.210 INFO:tasks.workunit.client.0.smithi070.stderr: -137> 2024-09-12T00:55:23.874+0000 7f34057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:24.210 INFO:tasks.workunit.client.0.smithi070.stderr: -136> 2024-09-12T00:55:23.874+0000 7f34057fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:55:24.210 INFO:tasks.workunit.client.0.smithi070.stderr: -135> 2024-09-12T00:55:23.874+0000 7f34057fa640 10 monclient: dump: 2024-09-12T00:55:24.210 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:24.210 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:24.210 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.210 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.210 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:24.210 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.210 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:24.211 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:24.211 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:24.211 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.211 INFO:tasks.workunit.client.0.smithi070.stderr: -134> 2024-09-12T00:55:23.874+0000 7f3406ffd640 4 set_mon_vals no callback set 2024-09-12T00:55:24.211 INFO:tasks.workunit.client.0.smithi070.stderr: -133> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 monclient: authenticate success, global_id 6542 2024-09-12T00:55:24.211 INFO:tasks.workunit.client.0.smithi070.stderr: -132> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient: _renew_subs 2024-09-12T00:55:24.211 INFO:tasks.workunit.client.0.smithi070.stderr: -131> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:55:24.211 INFO:tasks.workunit.client.0.smithi070.stderr: -130> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient: _renew_subs 2024-09-12T00:55:24.211 INFO:tasks.workunit.client.0.smithi070.stderr: -129> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:55:24.211 INFO:tasks.workunit.client.0.smithi070.stderr: -128> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 1 librados: init done 2024-09-12T00:55:24.211 INFO:tasks.workunit.client.0.smithi070.stderr: -127> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command cr dump hook 0x562a4d2ab9b8 2024-09-12T00:55:24.211 INFO:tasks.workunit.client.0.smithi070.stderr: -126> 2024-09-12T00:55:23.878+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.211 INFO:tasks.workunit.client.0.smithi070.stderr: -125> 2024-09-12T00:55:23.878+0000 7f34057fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:24.212 INFO:tasks.workunit.client.0.smithi070.stderr: -124> 2024-09-12T00:55:23.878+0000 7f34057fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:55:24.212 INFO:tasks.workunit.client.0.smithi070.stderr: -123> 2024-09-12T00:55:23.878+0000 7f34057fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:55:24.212 INFO:tasks.workunit.client.0.smithi070.stderr: -122> 2024-09-12T00:55:23.878+0000 7f35287be640 10 monclient: get_auth_request con 0x562a4d2cf3a0 auth_method 0 2024-09-12T00:55:24.212 INFO:tasks.workunit.client.0.smithi070.stderr: -121> 2024-09-12T00:55:23.878+0000 7f352a4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.212 INFO:tasks.workunit.client.0.smithi070.stderr: -120> 2024-09-12T00:55:23.878+0000 7f352a4b79c0 20 realm 2024-09-12T00:55:24.212 INFO:tasks.workunit.client.0.smithi070.stderr: -119> 2024-09-12T00:55:23.878+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.212 INFO:tasks.workunit.client.0.smithi070.stderr: -118> 2024-09-12T00:55:23.878+0000 7f35277bc640 10 monclient: get_auth_request con 0x7f33f0070ae0 auth_method 0 2024-09-12T00:55:24.212 INFO:tasks.workunit.client.0.smithi070.stderr: -117> 2024-09-12T00:55:23.878+0000 7f352a4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.212 INFO:tasks.workunit.client.0.smithi070.stderr: -116> 2024-09-12T00:55:23.878+0000 7f352a4b79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:24.212 INFO:tasks.workunit.client.0.smithi070.stderr: -115> 2024-09-12T00:55:23.878+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.212 INFO:tasks.workunit.client.0.smithi070.stderr: -114> 2024-09-12T00:55:23.878+0000 7f352a4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.212 INFO:tasks.workunit.client.0.smithi070.stderr: -113> 2024-09-12T00:55:23.878+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.212 INFO:tasks.workunit.client.0.smithi070.stderr: -112> 2024-09-12T00:55:23.878+0000 7f3527fbd640 10 monclient: get_auth_request con 0x562a4d2d3620 auth_method 0 2024-09-12T00:55:24.212 INFO:tasks.workunit.client.0.smithi070.stderr: -111> 2024-09-12T00:55:23.882+0000 7f352a4b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:24.213 INFO:tasks.workunit.client.0.smithi070.stderr: -110> 2024-09-12T00:55:23.882+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.213 INFO:tasks.workunit.client.0.smithi070.stderr: -109> 2024-09-12T00:55:23.882+0000 7f35277bc640 10 monclient: get_auth_request con 0x562a4d2d6e60 auth_method 0 2024-09-12T00:55:24.213 INFO:tasks.workunit.client.0.smithi070.stderr: -108> 2024-09-12T00:55:23.882+0000 7f352a4b79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:24.213 INFO:tasks.workunit.client.0.smithi070.stderr: -107> 2024-09-12T00:55:23.882+0000 7f352a4b79c0 20 searching for the correct realm 2024-09-12T00:55:24.213 INFO:tasks.workunit.client.0.smithi070.stderr: -106> 2024-09-12T00:55:23.882+0000 7f35287be640 10 monclient: get_auth_request con 0x562a4d2dbc00 auth_method 0 2024-09-12T00:55:24.213 INFO:tasks.workunit.client.0.smithi070.stderr: -105> 2024-09-12T00:55:23.882+0000 7f3527fbd640 10 monclient: get_auth_request con 0x7f3520008050 auth_method 0 2024-09-12T00:55:24.213 INFO:tasks.workunit.client.0.smithi070.stderr: -104> 2024-09-12T00:55:23.886+0000 7f35277bc640 10 monclient: get_auth_request con 0x7f351810bac0 auth_method 0 2024-09-12T00:55:24.213 INFO:tasks.workunit.client.0.smithi070.stderr: -103> 2024-09-12T00:55:23.886+0000 7f35287be640 10 monclient: get_auth_request con 0x7f351c08f140 auth_method 0 2024-09-12T00:55:24.213 INFO:tasks.workunit.client.0.smithi070.stderr: -102> 2024-09-12T00:55:23.890+0000 7f3527fbd640 0 -- 172.21.15.70:0/4160814060 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f3520008050 msgr2=0x7f3520060720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:24.213 INFO:tasks.workunit.client.0.smithi070.stderr: -101> 2024-09-12T00:55:23.890+0000 7f34057fa640 1 client.6542.objecter ms_handle_reset 0x7f3520008050 session 0x7f35200660d0 osd.7 2024-09-12T00:55:24.213 INFO:tasks.workunit.client.0.smithi070.stderr: -100> 2024-09-12T00:55:23.890+0000 7f34057fa640 10 monclient: _renew_subs 2024-09-12T00:55:24.213 INFO:tasks.workunit.client.0.smithi070.stderr: -99> 2024-09-12T00:55:23.890+0000 7f34057fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:55:24.214 INFO:tasks.workunit.client.0.smithi070.stderr: -98> 2024-09-12T00:55:23.890+0000 7f3527fbd640 10 monclient: get_auth_request con 0x7f33f0080800 auth_method 0 2024-09-12T00:55:24.214 INFO:tasks.workunit.client.0.smithi070.stderr: -97> 2024-09-12T00:55:23.894+0000 7f3527fbd640 10 monclient: get_auth_request con 0x7f352007a040 auth_method 0 2024-09-12T00:55:24.214 INFO:tasks.workunit.client.0.smithi070.stderr: -96> 2024-09-12T00:55:23.898+0000 7f3527fbd640 0 -- 172.21.15.70:0/4160814060 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f352007a040 msgr2=0x7f3520068460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:24.214 INFO:tasks.workunit.client.0.smithi070.stderr: -95> 2024-09-12T00:55:23.898+0000 7f34057fa640 1 client.6542.objecter ms_handle_reset 0x7f352007a040 session 0x7f3520061560 osd.6 2024-09-12T00:55:24.214 INFO:tasks.workunit.client.0.smithi070.stderr: -94> 2024-09-12T00:55:23.898+0000 7f3527fbd640 10 monclient: get_auth_request con 0x7f3520008050 auth_method 0 2024-09-12T00:55:24.214 INFO:tasks.workunit.client.0.smithi070.stderr: -93> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:24.214 INFO:tasks.workunit.client.0.smithi070.stderr: -92> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:24.214 INFO:tasks.workunit.client.0.smithi070.stderr: -91> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:24.214 INFO:tasks.workunit.client.0.smithi070.stderr: -90> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:24.214 INFO:tasks.workunit.client.0.smithi070.stderr: -89> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:24.214 INFO:tasks.workunit.client.0.smithi070.stderr: -88> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:24.214 INFO:tasks.workunit.client.0.smithi070.stderr: -87> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.214 INFO:tasks.workunit.client.0.smithi070.stderr: -86> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.215 INFO:tasks.workunit.client.0.smithi070.stderr: -85> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.215 INFO:tasks.workunit.client.0.smithi070.stderr: -84> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:24.215 INFO:tasks.workunit.client.0.smithi070.stderr: -83> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.215 INFO:tasks.workunit.client.0.smithi070.stderr: -82> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:24.215 INFO:tasks.workunit.client.0.smithi070.stderr: -81> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 zone default found 2024-09-12T00:55:24.215 INFO:tasks.workunit.client.0.smithi070.stderr: -80> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 4 Realm: () 2024-09-12T00:55:24.215 INFO:tasks.workunit.client.0.smithi070.stderr: -79> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:24.215 INFO:tasks.workunit.client.0.smithi070.stderr: -78> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:24.215 INFO:tasks.workunit.client.0.smithi070.stderr: -77> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:24.215 INFO:tasks.workunit.client.0.smithi070.stderr: -76> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 zonegroup default 2024-09-12T00:55:24.215 INFO:tasks.workunit.client.0.smithi070.stderr: -75> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.215 INFO:tasks.workunit.client.0.smithi070.stderr: -74> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.215 INFO:tasks.workunit.client.0.smithi070.stderr: -73> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.216 INFO:tasks.workunit.client.0.smithi070.stderr: -72> 2024-09-12T00:55:24.118+0000 7f352a4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.216 INFO:tasks.workunit.client.0.smithi070.stderr: -71> 2024-09-12T00:55:24.118+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.216 INFO:tasks.workunit.client.0.smithi070.stderr: -70> 2024-09-12T00:55:24.118+0000 7f352a4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.216 INFO:tasks.workunit.client.0.smithi070.stderr: -69> 2024-09-12T00:55:24.118+0000 7f352a4b79c0 20 started sync module instance, tier type = 2024-09-12T00:55:24.216 INFO:tasks.workunit.client.0.smithi070.stderr: -68> 2024-09-12T00:55:24.118+0000 7f352a4b79c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:24.216 INFO:tasks.workunit.client.0.smithi070.stderr: -67> 2024-09-12T00:55:24.146+0000 7f352a4b79c0 20 add_watcher() i=0 2024-09-12T00:55:24.216 INFO:tasks.workunit.client.0.smithi070.stderr: -66> 2024-09-12T00:55:24.146+0000 7f352a4b79c0 20 add_watcher() i=1 2024-09-12T00:55:24.216 INFO:tasks.workunit.client.0.smithi070.stderr: -65> 2024-09-12T00:55:24.146+0000 7f352a4b79c0 20 add_watcher() i=2 2024-09-12T00:55:24.216 INFO:tasks.workunit.client.0.smithi070.stderr: -64> 2024-09-12T00:55:24.146+0000 7f352a4b79c0 20 add_watcher() i=3 2024-09-12T00:55:24.216 INFO:tasks.workunit.client.0.smithi070.stderr: -63> 2024-09-12T00:55:24.146+0000 7f352a4b79c0 20 add_watcher() i=4 2024-09-12T00:55:24.216 INFO:tasks.workunit.client.0.smithi070.stderr: -62> 2024-09-12T00:55:24.146+0000 7f352a4b79c0 20 add_watcher() i=5 2024-09-12T00:55:24.216 INFO:tasks.workunit.client.0.smithi070.stderr: -61> 2024-09-12T00:55:24.146+0000 7f352a4b79c0 20 add_watcher() i=6 2024-09-12T00:55:24.216 INFO:tasks.workunit.client.0.smithi070.stderr: -60> 2024-09-12T00:55:24.146+0000 7f352a4b79c0 20 add_watcher() i=7 2024-09-12T00:55:24.217 INFO:tasks.workunit.client.0.smithi070.stderr: -59> 2024-09-12T00:55:24.146+0000 7f352a4b79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:24.217 INFO:tasks.workunit.client.0.smithi070.stderr: -58> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding auth protocol: cephx 2024-09-12T00:55:24.217 INFO:tasks.workunit.client.0.smithi070.stderr: -57> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding auth protocol: cephx 2024-09-12T00:55:24.217 INFO:tasks.workunit.client.0.smithi070.stderr: -56> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding auth protocol: cephx 2024-09-12T00:55:24.217 INFO:tasks.workunit.client.0.smithi070.stderr: -55> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding con mode: secure 2024-09-12T00:55:24.217 INFO:tasks.workunit.client.0.smithi070.stderr: -54> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding con mode: crc 2024-09-12T00:55:24.217 INFO:tasks.workunit.client.0.smithi070.stderr: -53> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding con mode: secure 2024-09-12T00:55:24.217 INFO:tasks.workunit.client.0.smithi070.stderr: -52> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding con mode: crc 2024-09-12T00:55:24.217 INFO:tasks.workunit.client.0.smithi070.stderr: -51> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding con mode: secure 2024-09-12T00:55:24.217 INFO:tasks.workunit.client.0.smithi070.stderr: -50> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding con mode: crc 2024-09-12T00:55:24.217 INFO:tasks.workunit.client.0.smithi070.stderr: -49> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding con mode: crc 2024-09-12T00:55:24.217 INFO:tasks.workunit.client.0.smithi070.stderr: -48> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding con mode: secure 2024-09-12T00:55:24.217 INFO:tasks.workunit.client.0.smithi070.stderr: -47> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding con mode: crc 2024-09-12T00:55:24.218 INFO:tasks.workunit.client.0.smithi070.stderr: -46> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding con mode: secure 2024-09-12T00:55:24.218 INFO:tasks.workunit.client.0.smithi070.stderr: -45> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding con mode: crc 2024-09-12T00:55:24.218 INFO:tasks.workunit.client.0.smithi070.stderr: -44> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding con mode: secure 2024-09-12T00:55:24.218 INFO:tasks.workunit.client.0.smithi070.stderr: -43> 2024-09-12T00:55:24.150+0000 7f33ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:24.218 INFO:tasks.workunit.client.0.smithi070.stderr: -42> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:24.218 INFO:tasks.workunit.client.0.smithi070.stderr: -41> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:24.218 INFO:tasks.workunit.client.0.smithi070.stderr: -40> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:24.218 INFO:tasks.workunit.client.0.smithi070.stderr: -39> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command cache list hook 0x562a4d2a64f0 2024-09-12T00:55:24.218 INFO:tasks.workunit.client.0.smithi070.stderr: -38> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command cache inspect hook 0x562a4d2a64f0 2024-09-12T00:55:24.218 INFO:tasks.workunit.client.0.smithi070.stderr: -37> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command cache erase hook 0x562a4d2a64f0 2024-09-12T00:55:24.218 INFO:tasks.workunit.client.0.smithi070.stderr: -36> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command cache zap hook 0x562a4d2a64f0 2024-09-12T00:55:24.218 INFO:tasks.workunit.client.0.smithi070.stderr: -35> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 5 note: GC not initialized 2024-09-12T00:55:24.218 INFO:tasks.workunit.client.0.smithi070.stderr: -34> 2024-09-12T00:55:24.154+0000 7f33dcfe1640 20 reqs_thread_entry: start 2024-09-12T00:55:24.218 INFO:tasks.workunit.client.0.smithi070.stderr: -33> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command sync trace show hook 0x7f351c0650b0 2024-09-12T00:55:24.219 INFO:tasks.workunit.client.0.smithi070.stderr: -32> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command sync trace history hook 0x7f351c0650b0 2024-09-12T00:55:24.219 INFO:tasks.workunit.client.0.smithi070.stderr: -31> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command sync trace active hook 0x7f351c0650b0 2024-09-12T00:55:24.219 INFO:tasks.workunit.client.0.smithi070.stderr: -30> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command sync trace active_short hook 0x7f351c0650b0 2024-09-12T00:55:24.219 INFO:tasks.workunit.client.0.smithi070.stderr: -29> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:24.219 INFO:tasks.workunit.client.0.smithi070.stderr: -28> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 20 Filter name: none 2024-09-12T00:55:24.219 INFO:tasks.workunit.client.0.smithi070.stderr: -27> 2024-09-12T00:55:24.154+0000 7f33567fc640 20 reqs_thread_entry: start 2024-09-12T00:55:24.219 INFO:tasks.workunit.client.0.smithi070.stderr: -26> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:55:24.219 INFO:tasks.workunit.client.0.smithi070.stderr: -25> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.219 INFO:tasks.workunit.client.0.smithi070.stderr: -24> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:55:24.219 INFO:tasks.workunit.client.0.smithi070.stderr: -23> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:55:24.219 INFO:tasks.workunit.client.0.smithi070.stderr: -22> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:55:24.219 INFO:tasks.workunit.client.0.smithi070.stderr: -21> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 : miss 2024-09-12T00:55:24.219 INFO:tasks.workunit.client.0.smithi070.stderr: -20> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.220 INFO:tasks.workunit.client.0.smithi070.stderr: -19> 2024-09-12T00:55:24.158+0000 7f352a4b79c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:55:24.220 INFO:tasks.workunit.client.0.smithi070.stderr: -18> 2024-09-12T00:55:24.158+0000 7f352a4b79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 info.flags=0x17 2024-09-12T00:55:24.220 INFO:tasks.workunit.client.0.smithi070.stderr: -17> 2024-09-12T00:55:24.158+0000 7f352a4b79c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 to cache LRU end 2024-09-12T00:55:24.220 INFO:tasks.workunit.client.0.smithi070.stderr: -16> 2024-09-12T00:55:24.158+0000 7f352a4b79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:24.220 INFO:tasks.workunit.client.0.smithi070.stderr: -15> 2024-09-12T00:55:24.158+0000 7f352a4b79c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:24.220 INFO:tasks.workunit.client.0.smithi070.stderr: -14> 2024-09-12T00:55:24.158+0000 7f352a4b79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 2024-09-12T00:55:24.220 INFO:tasks.workunit.client.0.smithi070.stderr: -13> 2024-09-12T00:55:24.162+0000 7f352a4b79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 info.flags=0x17 2024-09-12T00:55:24.220 INFO:tasks.workunit.client.0.smithi070.stderr: -12> 2024-09-12T00:55:24.162+0000 7f352a4b79c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 to cache LRU end 2024-09-12T00:55:24.220 INFO:tasks.workunit.client.0.smithi070.stderr: -11> 2024-09-12T00:55:24.162+0000 7f352a4b79c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:24.220 INFO:tasks.workunit.client.0.smithi070.stderr: -10> 2024-09-12T00:55:24.162+0000 7f352a4b79c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28, ofs0, ns] 2024-09-12T00:55:24.220 INFO:tasks.workunit.client.0.smithi070.stderr: -9> 2024-09-12T00:55:24.162+0000 7f3406ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431603 cookie 94739683491056 notifier 6542 bl.length()=1023 2024-09-12T00:55:24.220 INFO:tasks.workunit.client.0.smithi070.stderr: -8> 2024-09-12T00:55:24.162+0000 7f3406ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 info.flags=0x17 2024-09-12T00:55:24.221 INFO:tasks.workunit.client.0.smithi070.stderr: -7> 2024-09-12T00:55:24.162+0000 7f3406ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 to cache LRU end 2024-09-12T00:55:24.221 INFO:tasks.workunit.client.0.smithi070.stderr: -6> 2024-09-12T00:55:24.162+0000 7f3406ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:24.221 INFO:tasks.workunit.client.0.smithi070.stderr: -5> 2024-09-12T00:55:24.162+0000 7f352a4b79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28]): orig_sources= new_sources= 2024-09-12T00:55:24.221 INFO:tasks.workunit.client.0.smithi070.stderr: -4> 2024-09-12T00:55:24.162+0000 7f352a4b79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28]): potential sources added=[] removed=[] 2024-09-12T00:55:24.221 INFO:tasks.workunit.client.0.smithi070.stderr: -3> 2024-09-12T00:55:24.162+0000 7f352a4b79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28]): orig_dests= new_dests= 2024-09-12T00:55:24.221 INFO:tasks.workunit.client.0.smithi070.stderr: -2> 2024-09-12T00:55:24.162+0000 7f352a4b79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28]): potential dests added=[] removed=[] 2024-09-12T00:55:24.221 INFO:tasks.workunit.client.0.smithi070.stderr: -1> 2024-09-12T00:55:24.166+0000 7f352a4b79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f352a4b79c0 time 2024-09-12T00:55:24.166765+0000 2024-09-12T00:55:24.221 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:55:24.221 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.221 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:24.221 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f352dd912eb] 2024-09-12T00:55:24.221 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f352dd9149f] 2024-09-12T00:55:24.222 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562a4aa30cc1] 2024-09-12T00:55:24.222 INFO:tasks.workunit.client.0.smithi070.stderr: 4: radosgw-admin(+0x1422a3e) [0x562a4b48ea3e] 2024-09-12T00:55:24.222 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562a4aa45ced] 2024-09-12T00:55:24.222 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:55:24.222 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f352cbf7d90] 2024-09-12T00:55:24.222 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:55:24.222 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:55:24.222 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.222 INFO:tasks.workunit.client.0.smithi070.stderr: 0> 2024-09-12T00:55:24.166+0000 7f352a4b79c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:55:24.222 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f352a4b79c0 thread_name:radosgw-admin 2024-09-12T00:55:24.222 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.222 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:24.222 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f352cc10520] 2024-09-12T00:55:24.223 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:55:24.223 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:55:24.223 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:55:24.223 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f352dd91345] 2024-09-12T00:55:24.223 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f352dd9149f] 2024-09-12T00:55:24.223 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562a4aa30cc1] 2024-09-12T00:55:24.223 INFO:tasks.workunit.client.0.smithi070.stderr: 8: radosgw-admin(+0x1422a3e) [0x562a4b48ea3e] 2024-09-12T00:55:24.223 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562a4aa45ced] 2024-09-12T00:55:24.223 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:55:24.223 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f352cbf7d90] 2024-09-12T00:55:24.223 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:55:24.223 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:55:24.223 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:55:24.223 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.223 INFO:tasks.workunit.client.0.smithi070.stderr:--- logging levels --- 2024-09-12T00:55:24.224 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 none 2024-09-12T00:55:24.224 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 lockdep 2024-09-12T00:55:24.224 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 context 2024-09-12T00:55:24.224 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 crush 2024-09-12T00:55:24.224 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds 2024-09-12T00:55:24.224 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_balancer 2024-09-12T00:55:24.224 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_locker 2024-09-12T00:55:24.224 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log 2024-09-12T00:55:24.224 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log_expire 2024-09-12T00:55:24.224 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_migrator 2024-09-12T00:55:24.224 INFO:tasks.workunit.client.0.smithi070.stderr: 3/ 5 mds_quiesce 2024-09-12T00:55:24.224 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 buffer 2024-09-12T00:55:24.224 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 timer 2024-09-12T00:55:24.224 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 filer 2024-09-12T00:55:24.224 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 striper 2024-09-12T00:55:24.224 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 objecter 2024-09-12T00:55:24.225 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rados 2024-09-12T00:55:24.225 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd 2024-09-12T00:55:24.225 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_mirror 2024-09-12T00:55:24.225 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_replay 2024-09-12T00:55:24.225 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_pwl 2024-09-12T00:55:24.225 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 journaler 2024-09-12T00:55:24.225 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objectcacher 2024-09-12T00:55:24.225 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:55:24.225 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 client 2024-09-12T00:55:24.225 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 osd 2024-09-12T00:55:24.225 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 optracker 2024-09-12T00:55:24.225 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objclass 2024-09-12T00:55:24.225 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 filestore 2024-09-12T00:55:24.225 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 journal 2024-09-12T00:55:24.225 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 ms 2024-09-12T00:55:24.226 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mon 2024-09-12T00:55:24.226 INFO:tasks.workunit.client.0.smithi070.stderr: 0/10 monc 2024-09-12T00:55:24.226 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 paxos 2024-09-12T00:55:24.226 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 tp 2024-09-12T00:55:24.226 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 auth 2024-09-12T00:55:24.226 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 crypto 2024-09-12T00:55:24.226 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 finisher 2024-09-12T00:55:24.226 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 reserver 2024-09-12T00:55:24.226 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 heartbeatmap 2024-09-12T00:55:24.226 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 perfcounter 2024-09-12T00:55:24.226 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw 2024-09-12T00:55:24.226 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_sync 2024-09-12T00:55:24.226 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_datacache 2024-09-12T00:55:24.226 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_access 2024-09-12T00:55:24.227 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:55:24.227 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_flight 2024-09-12T00:55:24.227 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:55:24.227 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw_notification 2024-09-12T00:55:24.227 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 javaclient 2024-09-12T00:55:24.227 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 asok 2024-09-12T00:55:24.227 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 throttle 2024-09-12T00:55:24.227 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 refs 2024-09-12T00:55:24.227 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 compressor 2024-09-12T00:55:24.227 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluestore 2024-09-12T00:55:24.227 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluefs 2024-09-12T00:55:24.227 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 bdev 2024-09-12T00:55:24.227 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 kstore 2024-09-12T00:55:24.227 INFO:tasks.workunit.client.0.smithi070.stderr: 4/ 5 rocksdb 2024-09-12T00:55:24.227 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 fuse 2024-09-12T00:55:24.227 INFO:tasks.workunit.client.0.smithi070.stderr: 2/ 5 mgr 2024-09-12T00:55:24.228 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mgrc 2024-09-12T00:55:24.228 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 dpdk 2024-09-12T00:55:24.228 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 eventtrace 2024-09-12T00:55:24.228 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 prioritycache 2024-09-12T00:55:24.228 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 test 2024-09-12T00:55:24.228 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:55:24.228 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephsqlite 2024-09-12T00:55:24.228 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:55:24.228 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore 2024-09-12T00:55:24.228 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_onode 2024-09-12T00:55:24.228 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_odata 2024-09-12T00:55:24.228 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_omap 2024-09-12T00:55:24.228 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_tm 2024-09-12T00:55:24.228 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_t 2024-09-12T00:55:24.228 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:55:24.229 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_epm 2024-09-12T00:55:24.229 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_lba 2024-09-12T00:55:24.229 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:55:24.229 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cache 2024-09-12T00:55:24.229 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_journal 2024-09-12T00:55:24.229 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_device 2024-09-12T00:55:24.229 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_backref 2024-09-12T00:55:24.229 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 alienstore 2024-09-12T00:55:24.229 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mclock 2024-09-12T00:55:24.229 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cyanstore 2024-09-12T00:55:24.229 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 ceph_exporter 2024-09-12T00:55:24.229 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 memstore 2024-09-12T00:55:24.229 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 trace 2024-09-12T00:55:24.229 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 ceph_dedup 2024-09-12T00:55:24.230 INFO:tasks.workunit.client.0.smithi070.stderr: -2/-2 (syslog threshold) 2024-09-12T00:55:24.230 INFO:tasks.workunit.client.0.smithi070.stderr: 99/99 (stderr threshold) 2024-09-12T00:55:24.230 INFO:tasks.workunit.client.0.smithi070.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:55:24.230 INFO:tasks.workunit.client.0.smithi070.stderr: 7f33567fc640 / http_manager 2024-09-12T00:55:24.230 INFO:tasks.workunit.client.0.smithi070.stderr: 7f33dcfe1640 / http_manager 2024-09-12T00:55:24.230 INFO:tasks.workunit.client.0.smithi070.stderr: 7f33ddfe3640 / rgw_dt_lg_renew 2024-09-12T00:55:24.230 INFO:tasks.workunit.client.0.smithi070.stderr: 7f34057fa640 / ms_dispatch 2024-09-12T00:55:24.230 INFO:tasks.workunit.client.0.smithi070.stderr: 7f3406ffd640 / io_context_pool 2024-09-12T00:55:24.230 INFO:tasks.workunit.client.0.smithi070.stderr: 7f340d7fa640 / ms_dispatch 2024-09-12T00:55:24.230 INFO:tasks.workunit.client.0.smithi070.stderr: 7f340ffff640 / ms_dispatch 2024-09-12T00:55:24.230 INFO:tasks.workunit.client.0.smithi070.stderr: 7f3415e0b640 / io_context_pool 2024-09-12T00:55:24.230 INFO:tasks.workunit.client.0.smithi070.stderr: 7f35277bc640 / msgr-worker-2 2024-09-12T00:55:24.230 INFO:tasks.workunit.client.0.smithi070.stderr: 7f3527fbd640 / msgr-worker-1 2024-09-12T00:55:24.230 INFO:tasks.workunit.client.0.smithi070.stderr: 7f35287be640 / msgr-worker-0 2024-09-12T00:55:24.231 INFO:tasks.workunit.client.0.smithi070.stderr: 7f3528fbf640 / io_context_pool 2024-09-12T00:55:24.231 INFO:tasks.workunit.client.0.smithi070.stderr: 7f352a4b79c0 / radosgw-admin 2024-09-12T00:55:24.231 INFO:tasks.workunit.client.0.smithi070.stderr: max_recent 500 2024-09-12T00:55:24.231 INFO:tasks.workunit.client.0.smithi070.stderr: max_new 1000 2024-09-12T00:55:24.231 INFO:tasks.workunit.client.0.smithi070.stderr: log_file /var/log/ceph/ceph-client.admin.99654.log 2024-09-12T00:55:24.231 INFO:tasks.workunit.client.0.smithi070.stderr:--- end dump of recent events --- 2024-09-12T00:55:24.231 INFO:tasks.workunit.client.0.smithi070.stderr:--- begin dump of recent events --- 2024-09-12T00:55:24.231 INFO:tasks.workunit.client.0.smithi070.stderr: -499> 2024-09-12T00:55:23.854+0000 7f35287be640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:24.231 INFO:tasks.workunit.client.0.smithi070.stderr: -498> 2024-09-12T00:55:23.854+0000 7f35287be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:24.231 INFO:tasks.workunit.client.0.smithi070.stderr: -497> 2024-09-12T00:55:23.854+0000 7f35287be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:24.231 INFO:tasks.workunit.client.0.smithi070.stderr: -496> 2024-09-12T00:55:23.854+0000 7f35287be640 10 monclient(hunting): handle_auth_done global_id 6921 payload 274 2024-09-12T00:55:24.231 INFO:tasks.workunit.client.0.smithi070.stderr: -495> 2024-09-12T00:55:23.854+0000 7f35287be640 10 monclient: _finish_hunting 0 2024-09-12T00:55:24.231 INFO:tasks.workunit.client.0.smithi070.stderr: -494> 2024-09-12T00:55:23.854+0000 7f35287be640 1 monclient: found mon.noname-a 2024-09-12T00:55:24.231 INFO:tasks.workunit.client.0.smithi070.stderr: -493> 2024-09-12T00:55:23.854+0000 7f35287be640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:55:24.232 INFO:tasks.workunit.client.0.smithi070.stderr: -492> 2024-09-12T00:55:23.854+0000 7f3415e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:24.232 INFO:tasks.workunit.client.0.smithi070.stderr: -491> 2024-09-12T00:55:23.854+0000 7f3415e0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:55:24.232 INFO:tasks.workunit.client.0.smithi070.stderr: -490> 2024-09-12T00:55:23.854+0000 7f3415e0b640 10 monclient: dump: 2024-09-12T00:55:24.232 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:24.232 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:24.232 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.232 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.232 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:24.232 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.232 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:24.232 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:24.232 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:24.233 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.233 INFO:tasks.workunit.client.0.smithi070.stderr: -489> 2024-09-12T00:55:23.854+0000 7f3415e0b640 10 monclient: _finish_auth 0 2024-09-12T00:55:24.233 INFO:tasks.workunit.client.0.smithi070.stderr: -488> 2024-09-12T00:55:23.854+0000 7f3415e0b640 10 monclient: _check_auth_tickets 2024-09-12T00:55:24.233 INFO:tasks.workunit.client.0.smithi070.stderr: -487> 2024-09-12T00:55:23.854+0000 7f3415e0b640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:24.233 INFO:tasks.workunit.client.0.smithi070.stderr: -486> 2024-09-12T00:55:23.854+0000 7f352a4b79c0 5 monclient: authenticate success, global_id 6921 2024-09-12T00:55:24.233 INFO:tasks.workunit.client.0.smithi070.stderr: -485> 2024-09-12T00:55:23.854+0000 7f352a4b79c0 10 monclient: get_monmap_and_config success 2024-09-12T00:55:24.233 INFO:tasks.workunit.client.0.smithi070.stderr: -484> 2024-09-12T00:55:23.854+0000 7f352a4b79c0 4 set_mon_vals no callback set 2024-09-12T00:55:24.233 INFO:tasks.workunit.client.0.smithi070.stderr: -483> 2024-09-12T00:55:23.854+0000 7f3415e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:24.233 INFO:tasks.workunit.client.0.smithi070.stderr: -482> 2024-09-12T00:55:23.854+0000 7f3415e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:24.233 INFO:tasks.workunit.client.0.smithi070.stderr: -481> 2024-09-12T00:55:23.854+0000 7f3415e0b640 10 monclient: dump: 2024-09-12T00:55:24.233 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:24.233 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:24.233 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.233 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.234 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:24.234 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.234 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:24.234 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:24.234 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:24.234 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.234 INFO:tasks.workunit.client.0.smithi070.stderr: -480> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient: shutdown 2024-09-12T00:55:24.234 INFO:tasks.workunit.client.0.smithi070.stderr: -479> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) unregister_commands rotate-key 2024-09-12T00:55:24.234 INFO:tasks.workunit.client.0.smithi070.stderr: -478> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient: build_initial_monmap 2024-09-12T00:55:24.234 INFO:tasks.workunit.client.0.smithi070.stderr: -477> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 1 build_initial for_mkfs: 0 2024-09-12T00:55:24.234 INFO:tasks.workunit.client.0.smithi070.stderr: -476> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient: monmap: 2024-09-12T00:55:24.234 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:55:24.234 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:24.235 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:55:24.235 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:55:24.235 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:24.235 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.235 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:55:24.235 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:55:24.235 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:55:24.235 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.235 INFO:tasks.workunit.client.0.smithi070.stderr: -475> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding auth protocol: cephx 2024-09-12T00:55:24.235 INFO:tasks.workunit.client.0.smithi070.stderr: -474> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding auth protocol: cephx 2024-09-12T00:55:24.235 INFO:tasks.workunit.client.0.smithi070.stderr: -473> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding auth protocol: cephx 2024-09-12T00:55:24.235 INFO:tasks.workunit.client.0.smithi070.stderr: -472> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding con mode: secure 2024-09-12T00:55:24.235 INFO:tasks.workunit.client.0.smithi070.stderr: -471> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding con mode: crc 2024-09-12T00:55:24.235 INFO:tasks.workunit.client.0.smithi070.stderr: -470> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding con mode: secure 2024-09-12T00:55:24.235 INFO:tasks.workunit.client.0.smithi070.stderr: -469> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding con mode: crc 2024-09-12T00:55:24.236 INFO:tasks.workunit.client.0.smithi070.stderr: -468> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding con mode: secure 2024-09-12T00:55:24.236 INFO:tasks.workunit.client.0.smithi070.stderr: -467> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding con mode: crc 2024-09-12T00:55:24.236 INFO:tasks.workunit.client.0.smithi070.stderr: -466> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding con mode: crc 2024-09-12T00:55:24.236 INFO:tasks.workunit.client.0.smithi070.stderr: -465> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding con mode: secure 2024-09-12T00:55:24.236 INFO:tasks.workunit.client.0.smithi070.stderr: -464> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding con mode: crc 2024-09-12T00:55:24.236 INFO:tasks.workunit.client.0.smithi070.stderr: -463> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding con mode: secure 2024-09-12T00:55:24.236 INFO:tasks.workunit.client.0.smithi070.stderr: -462> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding con mode: crc 2024-09-12T00:55:24.236 INFO:tasks.workunit.client.0.smithi070.stderr: -461> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1eb020) adding con mode: secure 2024-09-12T00:55:24.236 INFO:tasks.workunit.client.0.smithi070.stderr: -460> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:24.236 INFO:tasks.workunit.client.0.smithi070.stderr: -459> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 1 librados: starting msgr at 2024-09-12T00:55:24.236 INFO:tasks.workunit.client.0.smithi070.stderr: -458> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 1 librados: starting objecter 2024-09-12T00:55:24.236 INFO:tasks.workunit.client.0.smithi070.stderr: -457> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command objecter_requests hook 0x562a4d1eacc0 2024-09-12T00:55:24.236 INFO:tasks.workunit.client.0.smithi070.stderr: -456> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 1 librados: setting wanted keys 2024-09-12T00:55:24.237 INFO:tasks.workunit.client.0.smithi070.stderr: -455> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 1 librados: calling monclient init 2024-09-12T00:55:24.237 INFO:tasks.workunit.client.0.smithi070.stderr: -454> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient: init 2024-09-12T00:55:24.237 INFO:tasks.workunit.client.0.smithi070.stderr: -453> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding auth protocol: cephx 2024-09-12T00:55:24.237 INFO:tasks.workunit.client.0.smithi070.stderr: -452> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding auth protocol: cephx 2024-09-12T00:55:24.237 INFO:tasks.workunit.client.0.smithi070.stderr: -451> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding auth protocol: cephx 2024-09-12T00:55:24.237 INFO:tasks.workunit.client.0.smithi070.stderr: -450> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding con mode: secure 2024-09-12T00:55:24.237 INFO:tasks.workunit.client.0.smithi070.stderr: -449> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding con mode: crc 2024-09-12T00:55:24.237 INFO:tasks.workunit.client.0.smithi070.stderr: -448> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding con mode: secure 2024-09-12T00:55:24.237 INFO:tasks.workunit.client.0.smithi070.stderr: -447> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding con mode: crc 2024-09-12T00:55:24.237 INFO:tasks.workunit.client.0.smithi070.stderr: -446> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding con mode: secure 2024-09-12T00:55:24.237 INFO:tasks.workunit.client.0.smithi070.stderr: -445> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding con mode: crc 2024-09-12T00:55:24.237 INFO:tasks.workunit.client.0.smithi070.stderr: -444> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding con mode: crc 2024-09-12T00:55:24.237 INFO:tasks.workunit.client.0.smithi070.stderr: -443> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding con mode: secure 2024-09-12T00:55:24.237 INFO:tasks.workunit.client.0.smithi070.stderr: -442> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding con mode: crc 2024-09-12T00:55:24.238 INFO:tasks.workunit.client.0.smithi070.stderr: -441> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding con mode: secure 2024-09-12T00:55:24.238 INFO:tasks.workunit.client.0.smithi070.stderr: -440> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding con mode: crc 2024-09-12T00:55:24.238 INFO:tasks.workunit.client.0.smithi070.stderr: -439> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d1e5cd0) adding con mode: secure 2024-09-12T00:55:24.238 INFO:tasks.workunit.client.0.smithi070.stderr: -438> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:24.238 INFO:tasks.workunit.client.0.smithi070.stderr: -437> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:24.238 INFO:tasks.workunit.client.0.smithi070.stderr: -436> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command rotate-key hook 0x562a4d1e5e18 2024-09-12T00:55:24.238 INFO:tasks.workunit.client.0.smithi070.stderr: -435> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient: _reopen_session rank -1 2024-09-12T00:55:24.238 INFO:tasks.workunit.client.0.smithi070.stderr: -434> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:55:24.238 INFO:tasks.workunit.client.0.smithi070.stderr: -433> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient(hunting): picked mon.noname-b con 0x562a4d0a4230 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:55:24.238 INFO:tasks.workunit.client.0.smithi070.stderr: -432> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient(hunting): picked mon.noname-a con 0x562a4d131970 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:55:24.238 INFO:tasks.workunit.client.0.smithi070.stderr: -431> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient(hunting): picked mon.noname-c con 0x562a4d20ee90 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:55:24.238 INFO:tasks.workunit.client.0.smithi070.stderr: -430> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:24.238 INFO:tasks.workunit.client.0.smithi070.stderr: -429> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:24.238 INFO:tasks.workunit.client.0.smithi070.stderr: -428> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:24.239 INFO:tasks.workunit.client.0.smithi070.stderr: -427> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient(hunting): _renew_subs 2024-09-12T00:55:24.239 INFO:tasks.workunit.client.0.smithi070.stderr: -426> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient(hunting): authenticate will time out at 2174.305956s 2024-09-12T00:55:24.239 INFO:tasks.workunit.client.0.smithi070.stderr: -425> 2024-09-12T00:55:23.858+0000 7f35277bc640 10 monclient(hunting): get_auth_request con 0x562a4d131970 auth_method 0 2024-09-12T00:55:24.239 INFO:tasks.workunit.client.0.smithi070.stderr: -424> 2024-09-12T00:55:23.858+0000 7f35277bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:24.239 INFO:tasks.workunit.client.0.smithi070.stderr: -423> 2024-09-12T00:55:23.858+0000 7f35277bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:24.239 INFO:tasks.workunit.client.0.smithi070.stderr: -422> 2024-09-12T00:55:23.858+0000 7f35277bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:24.239 INFO:tasks.workunit.client.0.smithi070.stderr: -421> 2024-09-12T00:55:23.858+0000 7f35287be640 10 monclient(hunting): get_auth_request con 0x562a4d20ee90 auth_method 0 2024-09-12T00:55:24.239 INFO:tasks.workunit.client.0.smithi070.stderr: -420> 2024-09-12T00:55:23.858+0000 7f35287be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:24.239 INFO:tasks.workunit.client.0.smithi070.stderr: -419> 2024-09-12T00:55:23.858+0000 7f35287be640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:24.239 INFO:tasks.workunit.client.0.smithi070.stderr: -418> 2024-09-12T00:55:23.858+0000 7f35287be640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:24.239 INFO:tasks.workunit.client.0.smithi070.stderr: -417> 2024-09-12T00:55:23.858+0000 7f35277bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:24.239 INFO:tasks.workunit.client.0.smithi070.stderr: -416> 2024-09-12T00:55:23.858+0000 7f35277bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:24.239 INFO:tasks.workunit.client.0.smithi070.stderr: -415> 2024-09-12T00:55:23.858+0000 7f35277bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:24.240 INFO:tasks.workunit.client.0.smithi070.stderr: -414> 2024-09-12T00:55:23.858+0000 7f35287be640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:24.240 INFO:tasks.workunit.client.0.smithi070.stderr: -413> 2024-09-12T00:55:23.858+0000 7f35287be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:24.240 INFO:tasks.workunit.client.0.smithi070.stderr: -412> 2024-09-12T00:55:23.858+0000 7f35287be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:24.240 INFO:tasks.workunit.client.0.smithi070.stderr: -411> 2024-09-12T00:55:23.858+0000 7f35277bc640 10 monclient(hunting): handle_auth_done global_id 6924 payload 824 2024-09-12T00:55:24.240 INFO:tasks.workunit.client.0.smithi070.stderr: -410> 2024-09-12T00:55:23.858+0000 7f35277bc640 10 monclient: _finish_hunting 0 2024-09-12T00:55:24.240 INFO:tasks.workunit.client.0.smithi070.stderr: -409> 2024-09-12T00:55:23.858+0000 7f35277bc640 1 monclient: found mon.noname-a 2024-09-12T00:55:24.240 INFO:tasks.workunit.client.0.smithi070.stderr: -408> 2024-09-12T00:55:23.858+0000 7f35277bc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:55:24.240 INFO:tasks.workunit.client.0.smithi070.stderr: -407> 2024-09-12T00:55:23.858+0000 7f340ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:24.240 INFO:tasks.workunit.client.0.smithi070.stderr: -406> 2024-09-12T00:55:23.858+0000 7f340ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:55:24.240 INFO:tasks.workunit.client.0.smithi070.stderr: -405> 2024-09-12T00:55:23.858+0000 7f340ffff640 10 monclient: dump: 2024-09-12T00:55:24.240 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:24.240 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:24.240 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.240 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.241 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:24.241 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.241 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:24.241 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:24.241 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:24.241 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.241 INFO:tasks.workunit.client.0.smithi070.stderr: -404> 2024-09-12T00:55:23.858+0000 7f340ffff640 10 monclient: _finish_auth 0 2024-09-12T00:55:24.241 INFO:tasks.workunit.client.0.smithi070.stderr: -403> 2024-09-12T00:55:23.858+0000 7f340ffff640 10 monclient: _check_auth_tickets 2024-09-12T00:55:24.241 INFO:tasks.workunit.client.0.smithi070.stderr: -402> 2024-09-12T00:55:23.858+0000 7f340ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:24.241 INFO:tasks.workunit.client.0.smithi070.stderr: -401> 2024-09-12T00:55:23.858+0000 7f340ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:24.241 INFO:tasks.workunit.client.0.smithi070.stderr: -400> 2024-09-12T00:55:23.858+0000 7f340ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:24.241 INFO:tasks.workunit.client.0.smithi070.stderr: -399> 2024-09-12T00:55:23.858+0000 7f340ffff640 10 monclient: dump: 2024-09-12T00:55:24.241 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:24.241 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:24.242 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.242 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.242 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:24.242 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.242 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:24.242 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:24.242 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:24.242 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.242 INFO:tasks.workunit.client.0.smithi070.stderr: -398> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 5 monclient: authenticate success, global_id 6924 2024-09-12T00:55:24.242 INFO:tasks.workunit.client.0.smithi070.stderr: -397> 2024-09-12T00:55:23.858+0000 7f3415e0b640 4 set_mon_vals no callback set 2024-09-12T00:55:24.242 INFO:tasks.workunit.client.0.smithi070.stderr: -396> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient: _renew_subs 2024-09-12T00:55:24.242 INFO:tasks.workunit.client.0.smithi070.stderr: -395> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:55:24.242 INFO:tasks.workunit.client.0.smithi070.stderr: -394> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient: _renew_subs 2024-09-12T00:55:24.243 INFO:tasks.workunit.client.0.smithi070.stderr: -393> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:55:24.243 INFO:tasks.workunit.client.0.smithi070.stderr: -392> 2024-09-12T00:55:23.858+0000 7f352a4b79c0 1 librados: init done 2024-09-12T00:55:24.243 INFO:tasks.workunit.client.0.smithi070.stderr: -391> 2024-09-12T00:55:23.862+0000 7f340ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:24.243 INFO:tasks.workunit.client.0.smithi070.stderr: -390> 2024-09-12T00:55:23.862+0000 7f340ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:55:24.243 INFO:tasks.workunit.client.0.smithi070.stderr: -389> 2024-09-12T00:55:23.862+0000 7f340ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:55:24.243 INFO:tasks.workunit.client.0.smithi070.stderr: -388> 2024-09-12T00:55:23.862+0000 7f3527fbd640 10 monclient: get_auth_request con 0x7f3410070ae0 auth_method 0 2024-09-12T00:55:24.243 INFO:tasks.workunit.client.0.smithi070.stderr: -387> 2024-09-12T00:55:23.862+0000 7f35287be640 10 monclient: get_auth_request con 0x562a4d20e150 auth_method 0 2024-09-12T00:55:24.243 INFO:tasks.workunit.client.0.smithi070.stderr: -386> 2024-09-12T00:55:23.862+0000 7f3527fbd640 10 monclient: get_auth_request con 0x562a4d230c10 auth_method 0 2024-09-12T00:55:24.243 INFO:tasks.workunit.client.0.smithi070.stderr: -385> 2024-09-12T00:55:23.862+0000 7f35277bc640 10 monclient: get_auth_request con 0x562a4d234fc0 auth_method 0 2024-09-12T00:55:24.243 INFO:tasks.workunit.client.0.smithi070.stderr: -384> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient: build_initial_monmap 2024-09-12T00:55:24.243 INFO:tasks.workunit.client.0.smithi070.stderr: -383> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 1 build_initial for_mkfs: 0 2024-09-12T00:55:24.243 INFO:tasks.workunit.client.0.smithi070.stderr: -382> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient: monmap: 2024-09-12T00:55:24.243 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:55:24.243 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:24.244 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:55:24.244 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:55:24.244 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:24.244 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.244 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:55:24.244 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:55:24.244 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:55:24.244 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.244 INFO:tasks.workunit.client.0.smithi070.stderr: -381> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding auth protocol: cephx 2024-09-12T00:55:24.244 INFO:tasks.workunit.client.0.smithi070.stderr: -380> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding auth protocol: cephx 2024-09-12T00:55:24.244 INFO:tasks.workunit.client.0.smithi070.stderr: -379> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding auth protocol: cephx 2024-09-12T00:55:24.244 INFO:tasks.workunit.client.0.smithi070.stderr: -378> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding con mode: secure 2024-09-12T00:55:24.244 INFO:tasks.workunit.client.0.smithi070.stderr: -377> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding con mode: crc 2024-09-12T00:55:24.245 INFO:tasks.workunit.client.0.smithi070.stderr: -376> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding con mode: secure 2024-09-12T00:55:24.245 INFO:tasks.workunit.client.0.smithi070.stderr: -375> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding con mode: crc 2024-09-12T00:55:24.245 INFO:tasks.workunit.client.0.smithi070.stderr: -374> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding con mode: secure 2024-09-12T00:55:24.245 INFO:tasks.workunit.client.0.smithi070.stderr: -373> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding con mode: crc 2024-09-12T00:55:24.245 INFO:tasks.workunit.client.0.smithi070.stderr: -372> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding con mode: crc 2024-09-12T00:55:24.245 INFO:tasks.workunit.client.0.smithi070.stderr: -371> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding con mode: secure 2024-09-12T00:55:24.245 INFO:tasks.workunit.client.0.smithi070.stderr: -370> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding con mode: crc 2024-09-12T00:55:24.245 INFO:tasks.workunit.client.0.smithi070.stderr: -369> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding con mode: secure 2024-09-12T00:55:24.245 INFO:tasks.workunit.client.0.smithi070.stderr: -368> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding con mode: crc 2024-09-12T00:55:24.245 INFO:tasks.workunit.client.0.smithi070.stderr: -367> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d239e80) adding con mode: secure 2024-09-12T00:55:24.245 INFO:tasks.workunit.client.0.smithi070.stderr: -366> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:24.245 INFO:tasks.workunit.client.0.smithi070.stderr: -365> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command objecter_requests cmddesc objecter_requests hook 0x562a4d23d890 EEXIST 2024-09-12T00:55:24.245 INFO:tasks.workunit.client.0.smithi070.stderr: -364> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient: init 2024-09-12T00:55:24.245 INFO:tasks.workunit.client.0.smithi070.stderr: -363> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding auth protocol: cephx 2024-09-12T00:55:24.246 INFO:tasks.workunit.client.0.smithi070.stderr: -362> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding auth protocol: cephx 2024-09-12T00:55:24.246 INFO:tasks.workunit.client.0.smithi070.stderr: -361> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding auth protocol: cephx 2024-09-12T00:55:24.246 INFO:tasks.workunit.client.0.smithi070.stderr: -360> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding con mode: secure 2024-09-12T00:55:24.246 INFO:tasks.workunit.client.0.smithi070.stderr: -359> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding con mode: crc 2024-09-12T00:55:24.246 INFO:tasks.workunit.client.0.smithi070.stderr: -358> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding con mode: secure 2024-09-12T00:55:24.246 INFO:tasks.workunit.client.0.smithi070.stderr: -357> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding con mode: crc 2024-09-12T00:55:24.246 INFO:tasks.workunit.client.0.smithi070.stderr: -356> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding con mode: secure 2024-09-12T00:55:24.246 INFO:tasks.workunit.client.0.smithi070.stderr: -355> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding con mode: crc 2024-09-12T00:55:24.246 INFO:tasks.workunit.client.0.smithi070.stderr: -354> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding con mode: crc 2024-09-12T00:55:24.246 INFO:tasks.workunit.client.0.smithi070.stderr: -353> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding con mode: secure 2024-09-12T00:55:24.246 INFO:tasks.workunit.client.0.smithi070.stderr: -352> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding con mode: crc 2024-09-12T00:55:24.246 INFO:tasks.workunit.client.0.smithi070.stderr: -351> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding con mode: secure 2024-09-12T00:55:24.246 INFO:tasks.workunit.client.0.smithi070.stderr: -350> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding con mode: crc 2024-09-12T00:55:24.246 INFO:tasks.workunit.client.0.smithi070.stderr: -349> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d238558) adding con mode: secure 2024-09-12T00:55:24.247 INFO:tasks.workunit.client.0.smithi070.stderr: -348> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:24.247 INFO:tasks.workunit.client.0.smithi070.stderr: -347> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:24.247 INFO:tasks.workunit.client.0.smithi070.stderr: -346> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command rotate-key cmddesc rotate-key hook 0x562a4d2386a0 EEXIST 2024-09-12T00:55:24.247 INFO:tasks.workunit.client.0.smithi070.stderr: -345> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient: _reopen_session rank -1 2024-09-12T00:55:24.247 INFO:tasks.workunit.client.0.smithi070.stderr: -344> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:55:24.247 INFO:tasks.workunit.client.0.smithi070.stderr: -343> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient(hunting): picked mon.noname-c con 0x562a4d261a40 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:55:24.247 INFO:tasks.workunit.client.0.smithi070.stderr: -342> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient(hunting): picked mon.noname-b con 0x562a4d261370 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:55:24.247 INFO:tasks.workunit.client.0.smithi070.stderr: -341> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient(hunting): picked mon.noname-a con 0x562a4d25fd50 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:55:24.247 INFO:tasks.workunit.client.0.smithi070.stderr: -340> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:24.247 INFO:tasks.workunit.client.0.smithi070.stderr: -339> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:24.247 INFO:tasks.workunit.client.0.smithi070.stderr: -338> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:24.247 INFO:tasks.workunit.client.0.smithi070.stderr: -337> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient(hunting): _renew_subs 2024-09-12T00:55:24.247 INFO:tasks.workunit.client.0.smithi070.stderr: -336> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient(hunting): authenticate will time out at 2174.314714s 2024-09-12T00:55:24.248 INFO:tasks.workunit.client.0.smithi070.stderr: -335> 2024-09-12T00:55:23.866+0000 7f3527fbd640 10 monclient(hunting): get_auth_request con 0x562a4d261a40 auth_method 0 2024-09-12T00:55:24.248 INFO:tasks.workunit.client.0.smithi070.stderr: -334> 2024-09-12T00:55:23.866+0000 7f3527fbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:24.248 INFO:tasks.workunit.client.0.smithi070.stderr: -333> 2024-09-12T00:55:23.866+0000 7f3527fbd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:24.248 INFO:tasks.workunit.client.0.smithi070.stderr: -332> 2024-09-12T00:55:23.866+0000 7f3527fbd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:24.248 INFO:tasks.workunit.client.0.smithi070.stderr: -331> 2024-09-12T00:55:23.866+0000 7f35287be640 10 monclient(hunting): get_auth_request con 0x562a4d25fd50 auth_method 0 2024-09-12T00:55:24.248 INFO:tasks.workunit.client.0.smithi070.stderr: -330> 2024-09-12T00:55:23.866+0000 7f35287be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:24.248 INFO:tasks.workunit.client.0.smithi070.stderr: -329> 2024-09-12T00:55:23.866+0000 7f35287be640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:24.248 INFO:tasks.workunit.client.0.smithi070.stderr: -328> 2024-09-12T00:55:23.866+0000 7f35287be640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:24.248 INFO:tasks.workunit.client.0.smithi070.stderr: -327> 2024-09-12T00:55:23.866+0000 7f3527fbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:24.248 INFO:tasks.workunit.client.0.smithi070.stderr: -326> 2024-09-12T00:55:23.866+0000 7f3527fbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:24.248 INFO:tasks.workunit.client.0.smithi070.stderr: -325> 2024-09-12T00:55:23.866+0000 7f3527fbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:24.248 INFO:tasks.workunit.client.0.smithi070.stderr: -324> 2024-09-12T00:55:23.866+0000 7f35287be640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:24.248 INFO:tasks.workunit.client.0.smithi070.stderr: -323> 2024-09-12T00:55:23.866+0000 7f35287be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:24.248 INFO:tasks.workunit.client.0.smithi070.stderr: -322> 2024-09-12T00:55:23.866+0000 7f35287be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:24.249 INFO:tasks.workunit.client.0.smithi070.stderr: -321> 2024-09-12T00:55:23.866+0000 7f35277bc640 10 monclient(hunting): get_auth_request con 0x562a4d261370 auth_method 0 2024-09-12T00:55:24.249 INFO:tasks.workunit.client.0.smithi070.stderr: -320> 2024-09-12T00:55:23.866+0000 7f35277bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:24.249 INFO:tasks.workunit.client.0.smithi070.stderr: -319> 2024-09-12T00:55:23.866+0000 7f35277bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:24.249 INFO:tasks.workunit.client.0.smithi070.stderr: -318> 2024-09-12T00:55:23.866+0000 7f35277bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:24.249 INFO:tasks.workunit.client.0.smithi070.stderr: -317> 2024-09-12T00:55:23.866+0000 7f35287be640 10 monclient(hunting): handle_auth_done global_id 6927 payload 824 2024-09-12T00:55:24.249 INFO:tasks.workunit.client.0.smithi070.stderr: -316> 2024-09-12T00:55:23.866+0000 7f35287be640 10 monclient: _finish_hunting 0 2024-09-12T00:55:24.249 INFO:tasks.workunit.client.0.smithi070.stderr: -315> 2024-09-12T00:55:23.866+0000 7f35287be640 1 monclient: found mon.noname-a 2024-09-12T00:55:24.249 INFO:tasks.workunit.client.0.smithi070.stderr: -314> 2024-09-12T00:55:23.866+0000 7f35287be640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:55:24.249 INFO:tasks.workunit.client.0.smithi070.stderr: -313> 2024-09-12T00:55:23.866+0000 7f340d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:24.249 INFO:tasks.workunit.client.0.smithi070.stderr: -312> 2024-09-12T00:55:23.866+0000 7f340d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:55:24.249 INFO:tasks.workunit.client.0.smithi070.stderr: -311> 2024-09-12T00:55:23.866+0000 7f340d7fa640 10 monclient: dump: 2024-09-12T00:55:24.249 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:24.249 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:24.250 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.250 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.250 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:24.250 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.250 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:24.250 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:24.250 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:24.250 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.250 INFO:tasks.workunit.client.0.smithi070.stderr: -310> 2024-09-12T00:55:23.866+0000 7f340d7fa640 10 monclient: _finish_auth 0 2024-09-12T00:55:24.250 INFO:tasks.workunit.client.0.smithi070.stderr: -309> 2024-09-12T00:55:23.866+0000 7f340d7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:55:24.250 INFO:tasks.workunit.client.0.smithi070.stderr: -308> 2024-09-12T00:55:23.866+0000 7f340d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:24.250 INFO:tasks.workunit.client.0.smithi070.stderr: -307> 2024-09-12T00:55:23.866+0000 7f340d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:24.250 INFO:tasks.workunit.client.0.smithi070.stderr: -306> 2024-09-12T00:55:23.866+0000 7f340d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:24.250 INFO:tasks.workunit.client.0.smithi070.stderr: -305> 2024-09-12T00:55:23.866+0000 7f340d7fa640 10 monclient: dump: 2024-09-12T00:55:24.251 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:24.251 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:24.251 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.251 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.251 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:24.251 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.251 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:24.251 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:24.251 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:24.251 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.251 INFO:tasks.workunit.client.0.smithi070.stderr: -304> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 5 monclient: authenticate success, global_id 6927 2024-09-12T00:55:24.251 INFO:tasks.workunit.client.0.smithi070.stderr: -303> 2024-09-12T00:55:23.866+0000 7f3528fbf640 4 set_mon_vals no callback set 2024-09-12T00:55:24.251 INFO:tasks.workunit.client.0.smithi070.stderr: -302> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient: _renew_subs 2024-09-12T00:55:24.252 INFO:tasks.workunit.client.0.smithi070.stderr: -301> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:55:24.252 INFO:tasks.workunit.client.0.smithi070.stderr: -300> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient: _renew_subs 2024-09-12T00:55:24.252 INFO:tasks.workunit.client.0.smithi070.stderr: -299> 2024-09-12T00:55:23.866+0000 7f352a4b79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:55:24.252 INFO:tasks.workunit.client.0.smithi070.stderr: -298> 2024-09-12T00:55:23.870+0000 7f340d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:24.252 INFO:tasks.workunit.client.0.smithi070.stderr: -297> 2024-09-12T00:55:23.870+0000 7f340d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:55:24.252 INFO:tasks.workunit.client.0.smithi070.stderr: -296> 2024-09-12T00:55:23.870+0000 7f340d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:55:24.252 INFO:tasks.workunit.client.0.smithi070.stderr: -295> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient: get_monmap_and_config 2024-09-12T00:55:24.252 INFO:tasks.workunit.client.0.smithi070.stderr: -294> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient: build_initial_monmap 2024-09-12T00:55:24.252 INFO:tasks.workunit.client.0.smithi070.stderr: -293> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 1 build_initial for_mkfs: 0 2024-09-12T00:55:24.252 INFO:tasks.workunit.client.0.smithi070.stderr: -292> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient: monmap: 2024-09-12T00:55:24.252 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:55:24.252 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:24.252 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:55:24.252 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:55:24.253 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:24.253 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.253 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:55:24.253 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:55:24.253 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:55:24.253 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.253 INFO:tasks.workunit.client.0.smithi070.stderr: -291> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding auth protocol: cephx 2024-09-12T00:55:24.253 INFO:tasks.workunit.client.0.smithi070.stderr: -290> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding auth protocol: cephx 2024-09-12T00:55:24.253 INFO:tasks.workunit.client.0.smithi070.stderr: -289> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding auth protocol: cephx 2024-09-12T00:55:24.253 INFO:tasks.workunit.client.0.smithi070.stderr: -288> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding con mode: secure 2024-09-12T00:55:24.253 INFO:tasks.workunit.client.0.smithi070.stderr: -287> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding con mode: crc 2024-09-12T00:55:24.253 INFO:tasks.workunit.client.0.smithi070.stderr: -286> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding con mode: secure 2024-09-12T00:55:24.253 INFO:tasks.workunit.client.0.smithi070.stderr: -285> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding con mode: crc 2024-09-12T00:55:24.254 INFO:tasks.workunit.client.0.smithi070.stderr: -284> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding con mode: secure 2024-09-12T00:55:24.254 INFO:tasks.workunit.client.0.smithi070.stderr: -283> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding con mode: crc 2024-09-12T00:55:24.254 INFO:tasks.workunit.client.0.smithi070.stderr: -282> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding con mode: crc 2024-09-12T00:55:24.254 INFO:tasks.workunit.client.0.smithi070.stderr: -281> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding con mode: secure 2024-09-12T00:55:24.254 INFO:tasks.workunit.client.0.smithi070.stderr: -280> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding con mode: crc 2024-09-12T00:55:24.254 INFO:tasks.workunit.client.0.smithi070.stderr: -279> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding con mode: secure 2024-09-12T00:55:24.254 INFO:tasks.workunit.client.0.smithi070.stderr: -278> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding con mode: crc 2024-09-12T00:55:24.254 INFO:tasks.workunit.client.0.smithi070.stderr: -277> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2812f0) adding con mode: secure 2024-09-12T00:55:24.254 INFO:tasks.workunit.client.0.smithi070.stderr: -276> 2024-09-12T00:55:23.870+0000 7f3527fbd640 10 monclient: get_auth_request con 0x7f3400070a20 auth_method 0 2024-09-12T00:55:24.254 INFO:tasks.workunit.client.0.smithi070.stderr: -275> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:24.254 INFO:tasks.workunit.client.0.smithi070.stderr: -274> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient: init 2024-09-12T00:55:24.254 INFO:tasks.workunit.client.0.smithi070.stderr: -273> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding auth protocol: cephx 2024-09-12T00:55:24.254 INFO:tasks.workunit.client.0.smithi070.stderr: -272> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding auth protocol: cephx 2024-09-12T00:55:24.254 INFO:tasks.workunit.client.0.smithi070.stderr: -271> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding auth protocol: cephx 2024-09-12T00:55:24.255 INFO:tasks.workunit.client.0.smithi070.stderr: -270> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding con mode: secure 2024-09-12T00:55:24.255 INFO:tasks.workunit.client.0.smithi070.stderr: -269> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding con mode: crc 2024-09-12T00:55:24.255 INFO:tasks.workunit.client.0.smithi070.stderr: -268> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding con mode: secure 2024-09-12T00:55:24.255 INFO:tasks.workunit.client.0.smithi070.stderr: -267> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding con mode: crc 2024-09-12T00:55:24.255 INFO:tasks.workunit.client.0.smithi070.stderr: -266> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding con mode: secure 2024-09-12T00:55:24.255 INFO:tasks.workunit.client.0.smithi070.stderr: -265> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding con mode: crc 2024-09-12T00:55:24.255 INFO:tasks.workunit.client.0.smithi070.stderr: -264> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding con mode: crc 2024-09-12T00:55:24.255 INFO:tasks.workunit.client.0.smithi070.stderr: -263> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding con mode: secure 2024-09-12T00:55:24.255 INFO:tasks.workunit.client.0.smithi070.stderr: -262> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding con mode: crc 2024-09-12T00:55:24.255 INFO:tasks.workunit.client.0.smithi070.stderr: -261> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding con mode: secure 2024-09-12T00:55:24.255 INFO:tasks.workunit.client.0.smithi070.stderr: -260> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding con mode: crc 2024-09-12T00:55:24.255 INFO:tasks.workunit.client.0.smithi070.stderr: -259> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575470) adding con mode: secure 2024-09-12T00:55:24.255 INFO:tasks.workunit.client.0.smithi070.stderr: -258> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:24.255 INFO:tasks.workunit.client.0.smithi070.stderr: -257> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:24.256 INFO:tasks.workunit.client.0.smithi070.stderr: -256> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc395755b8 EEXIST 2024-09-12T00:55:24.256 INFO:tasks.workunit.client.0.smithi070.stderr: -255> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient: _reopen_session rank -1 2024-09-12T00:55:24.256 INFO:tasks.workunit.client.0.smithi070.stderr: -254> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:55:24.256 INFO:tasks.workunit.client.0.smithi070.stderr: -253> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient(hunting): picked mon.noname-c con 0x562a4d2b5760 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:55:24.256 INFO:tasks.workunit.client.0.smithi070.stderr: -252> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient(hunting): picked mon.noname-a con 0x562a4d2afd10 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:55:24.256 INFO:tasks.workunit.client.0.smithi070.stderr: -251> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient(hunting): picked mon.noname-b con 0x562a4d286850 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:55:24.256 INFO:tasks.workunit.client.0.smithi070.stderr: -250> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:24.256 INFO:tasks.workunit.client.0.smithi070.stderr: -249> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:24.256 INFO:tasks.workunit.client.0.smithi070.stderr: -248> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:24.256 INFO:tasks.workunit.client.0.smithi070.stderr: -247> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient(hunting): _renew_subs 2024-09-12T00:55:24.256 INFO:tasks.workunit.client.0.smithi070.stderr: -246> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient(hunting): authenticate will time out at 2174.318886s 2024-09-12T00:55:24.256 INFO:tasks.workunit.client.0.smithi070.stderr: -245> 2024-09-12T00:55:23.870+0000 7f35277bc640 10 monclient(hunting): get_auth_request con 0x562a4d2afd10 auth_method 0 2024-09-12T00:55:24.256 INFO:tasks.workunit.client.0.smithi070.stderr: -244> 2024-09-12T00:55:23.870+0000 7f35277bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:24.256 INFO:tasks.workunit.client.0.smithi070.stderr: -243> 2024-09-12T00:55:23.870+0000 7f35277bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:24.257 INFO:tasks.workunit.client.0.smithi070.stderr: -242> 2024-09-12T00:55:23.870+0000 7f35277bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:24.257 INFO:tasks.workunit.client.0.smithi070.stderr: -241> 2024-09-12T00:55:23.870+0000 7f3527fbd640 10 monclient(hunting): get_auth_request con 0x562a4d2b5760 auth_method 0 2024-09-12T00:55:24.257 INFO:tasks.workunit.client.0.smithi070.stderr: -240> 2024-09-12T00:55:23.870+0000 7f3527fbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:24.257 INFO:tasks.workunit.client.0.smithi070.stderr: -239> 2024-09-12T00:55:23.870+0000 7f3527fbd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:24.257 INFO:tasks.workunit.client.0.smithi070.stderr: -238> 2024-09-12T00:55:23.870+0000 7f3527fbd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:24.257 INFO:tasks.workunit.client.0.smithi070.stderr: -237> 2024-09-12T00:55:23.870+0000 7f35277bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:24.257 INFO:tasks.workunit.client.0.smithi070.stderr: -236> 2024-09-12T00:55:23.870+0000 7f35277bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:24.257 INFO:tasks.workunit.client.0.smithi070.stderr: -235> 2024-09-12T00:55:23.870+0000 7f35277bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:24.257 INFO:tasks.workunit.client.0.smithi070.stderr: -234> 2024-09-12T00:55:23.870+0000 7f3527fbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:24.257 INFO:tasks.workunit.client.0.smithi070.stderr: -233> 2024-09-12T00:55:23.870+0000 7f3527fbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:24.257 INFO:tasks.workunit.client.0.smithi070.stderr: -232> 2024-09-12T00:55:23.870+0000 7f3527fbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:24.257 INFO:tasks.workunit.client.0.smithi070.stderr: -231> 2024-09-12T00:55:23.870+0000 7f35277bc640 10 monclient(hunting): handle_auth_done global_id 6930 payload 274 2024-09-12T00:55:24.257 INFO:tasks.workunit.client.0.smithi070.stderr: -230> 2024-09-12T00:55:23.870+0000 7f35277bc640 10 monclient: _finish_hunting 0 2024-09-12T00:55:24.258 INFO:tasks.workunit.client.0.smithi070.stderr: -229> 2024-09-12T00:55:23.870+0000 7f35277bc640 1 monclient: found mon.noname-a 2024-09-12T00:55:24.258 INFO:tasks.workunit.client.0.smithi070.stderr: -228> 2024-09-12T00:55:23.870+0000 7f35277bc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:55:24.258 INFO:tasks.workunit.client.0.smithi070.stderr: -227> 2024-09-12T00:55:23.870+0000 7f3406ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:24.258 INFO:tasks.workunit.client.0.smithi070.stderr: -226> 2024-09-12T00:55:23.870+0000 7f3406ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:55:24.258 INFO:tasks.workunit.client.0.smithi070.stderr: -225> 2024-09-12T00:55:23.870+0000 7f3406ffd640 10 monclient: dump: 2024-09-12T00:55:24.258 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:24.258 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:24.258 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.258 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.258 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:24.258 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.258 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:24.258 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:24.259 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:24.259 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.259 INFO:tasks.workunit.client.0.smithi070.stderr: -224> 2024-09-12T00:55:23.870+0000 7f3406ffd640 10 monclient: _finish_auth 0 2024-09-12T00:55:24.259 INFO:tasks.workunit.client.0.smithi070.stderr: -223> 2024-09-12T00:55:23.870+0000 7f3406ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:55:24.259 INFO:tasks.workunit.client.0.smithi070.stderr: -222> 2024-09-12T00:55:23.870+0000 7f3406ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:24.259 INFO:tasks.workunit.client.0.smithi070.stderr: -221> 2024-09-12T00:55:23.870+0000 7f3406ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:24.259 INFO:tasks.workunit.client.0.smithi070.stderr: -220> 2024-09-12T00:55:23.870+0000 7f3406ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:24.259 INFO:tasks.workunit.client.0.smithi070.stderr: -219> 2024-09-12T00:55:23.870+0000 7f3406ffd640 10 monclient: dump: 2024-09-12T00:55:24.259 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:24.259 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:24.259 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.259 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.259 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:24.260 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.260 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:24.260 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:24.260 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:24.260 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.260 INFO:tasks.workunit.client.0.smithi070.stderr: -218> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 5 monclient: authenticate success, global_id 6930 2024-09-12T00:55:24.260 INFO:tasks.workunit.client.0.smithi070.stderr: -217> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 10 monclient: get_monmap_and_config success 2024-09-12T00:55:24.260 INFO:tasks.workunit.client.0.smithi070.stderr: -216> 2024-09-12T00:55:23.870+0000 7f352a4b79c0 4 set_mon_vals no callback set 2024-09-12T00:55:24.260 INFO:tasks.workunit.client.0.smithi070.stderr: -215> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient: shutdown 2024-09-12T00:55:24.260 INFO:tasks.workunit.client.0.smithi070.stderr: -214> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient: build_initial_monmap 2024-09-12T00:55:24.260 INFO:tasks.workunit.client.0.smithi070.stderr: -213> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 1 build_initial for_mkfs: 0 2024-09-12T00:55:24.260 INFO:tasks.workunit.client.0.smithi070.stderr: -212> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient: monmap: 2024-09-12T00:55:24.260 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:55:24.260 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:24.261 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:55:24.261 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:55:24.261 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:24.261 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.261 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:55:24.261 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:55:24.261 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:55:24.261 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.261 INFO:tasks.workunit.client.0.smithi070.stderr: -211> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding auth protocol: cephx 2024-09-12T00:55:24.261 INFO:tasks.workunit.client.0.smithi070.stderr: -210> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding auth protocol: cephx 2024-09-12T00:55:24.261 INFO:tasks.workunit.client.0.smithi070.stderr: -209> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding auth protocol: cephx 2024-09-12T00:55:24.261 INFO:tasks.workunit.client.0.smithi070.stderr: -208> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding con mode: secure 2024-09-12T00:55:24.261 INFO:tasks.workunit.client.0.smithi070.stderr: -207> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding con mode: crc 2024-09-12T00:55:24.261 INFO:tasks.workunit.client.0.smithi070.stderr: -206> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding con mode: secure 2024-09-12T00:55:24.262 INFO:tasks.workunit.client.0.smithi070.stderr: -205> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding con mode: crc 2024-09-12T00:55:24.262 INFO:tasks.workunit.client.0.smithi070.stderr: -204> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding con mode: secure 2024-09-12T00:55:24.262 INFO:tasks.workunit.client.0.smithi070.stderr: -203> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding con mode: crc 2024-09-12T00:55:24.262 INFO:tasks.workunit.client.0.smithi070.stderr: -202> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding con mode: crc 2024-09-12T00:55:24.262 INFO:tasks.workunit.client.0.smithi070.stderr: -201> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding con mode: secure 2024-09-12T00:55:24.262 INFO:tasks.workunit.client.0.smithi070.stderr: -200> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding con mode: crc 2024-09-12T00:55:24.262 INFO:tasks.workunit.client.0.smithi070.stderr: -199> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding con mode: secure 2024-09-12T00:55:24.262 INFO:tasks.workunit.client.0.smithi070.stderr: -198> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding con mode: crc 2024-09-12T00:55:24.262 INFO:tasks.workunit.client.0.smithi070.stderr: -197> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d2a7cd0) adding con mode: secure 2024-09-12T00:55:24.262 INFO:tasks.workunit.client.0.smithi070.stderr: -196> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:24.262 INFO:tasks.workunit.client.0.smithi070.stderr: -195> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 1 librados: starting msgr at 2024-09-12T00:55:24.262 INFO:tasks.workunit.client.0.smithi070.stderr: -194> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 1 librados: starting objecter 2024-09-12T00:55:24.262 INFO:tasks.workunit.client.0.smithi070.stderr: -193> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command objecter_requests cmddesc objecter_requests hook 0x562a4d263340 EEXIST 2024-09-12T00:55:24.262 INFO:tasks.workunit.client.0.smithi070.stderr: -192> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 1 librados: setting wanted keys 2024-09-12T00:55:24.262 INFO:tasks.workunit.client.0.smithi070.stderr: -191> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 1 librados: calling monclient init 2024-09-12T00:55:24.263 INFO:tasks.workunit.client.0.smithi070.stderr: -190> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient: init 2024-09-12T00:55:24.263 INFO:tasks.workunit.client.0.smithi070.stderr: -189> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding auth protocol: cephx 2024-09-12T00:55:24.263 INFO:tasks.workunit.client.0.smithi070.stderr: -188> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding auth protocol: cephx 2024-09-12T00:55:24.263 INFO:tasks.workunit.client.0.smithi070.stderr: -187> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding auth protocol: cephx 2024-09-12T00:55:24.263 INFO:tasks.workunit.client.0.smithi070.stderr: -186> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding con mode: secure 2024-09-12T00:55:24.263 INFO:tasks.workunit.client.0.smithi070.stderr: -185> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding con mode: crc 2024-09-12T00:55:24.263 INFO:tasks.workunit.client.0.smithi070.stderr: -184> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding con mode: secure 2024-09-12T00:55:24.263 INFO:tasks.workunit.client.0.smithi070.stderr: -183> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding con mode: crc 2024-09-12T00:55:24.263 INFO:tasks.workunit.client.0.smithi070.stderr: -182> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding con mode: secure 2024-09-12T00:55:24.263 INFO:tasks.workunit.client.0.smithi070.stderr: -181> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding con mode: crc 2024-09-12T00:55:24.263 INFO:tasks.workunit.client.0.smithi070.stderr: -180> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding con mode: crc 2024-09-12T00:55:24.263 INFO:tasks.workunit.client.0.smithi070.stderr: -179> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding con mode: secure 2024-09-12T00:55:24.263 INFO:tasks.workunit.client.0.smithi070.stderr: -178> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding con mode: crc 2024-09-12T00:55:24.263 INFO:tasks.workunit.client.0.smithi070.stderr: -177> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding con mode: secure 2024-09-12T00:55:24.264 INFO:tasks.workunit.client.0.smithi070.stderr: -176> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding con mode: crc 2024-09-12T00:55:24.264 INFO:tasks.workunit.client.0.smithi070.stderr: -175> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 AuthRegistry(0x562a4d263860) adding con mode: secure 2024-09-12T00:55:24.264 INFO:tasks.workunit.client.0.smithi070.stderr: -174> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:24.264 INFO:tasks.workunit.client.0.smithi070.stderr: -173> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:24.264 INFO:tasks.workunit.client.0.smithi070.stderr: -172> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command rotate-key cmddesc rotate-key hook 0x562a4d2639a8 EEXIST 2024-09-12T00:55:24.264 INFO:tasks.workunit.client.0.smithi070.stderr: -171> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient: _reopen_session rank -1 2024-09-12T00:55:24.264 INFO:tasks.workunit.client.0.smithi070.stderr: -170> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:55:24.264 INFO:tasks.workunit.client.0.smithi070.stderr: -169> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient(hunting): picked mon.noname-c con 0x562a4d286850 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:55:24.264 INFO:tasks.workunit.client.0.smithi070.stderr: -168> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient(hunting): picked mon.noname-b con 0x562a4d2afd10 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:55:24.264 INFO:tasks.workunit.client.0.smithi070.stderr: -167> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient(hunting): picked mon.noname-a con 0x562a4d2b5760 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:55:24.264 INFO:tasks.workunit.client.0.smithi070.stderr: -166> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:24.264 INFO:tasks.workunit.client.0.smithi070.stderr: -165> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:24.264 INFO:tasks.workunit.client.0.smithi070.stderr: -164> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:24.264 INFO:tasks.workunit.client.0.smithi070.stderr: -163> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient(hunting): _renew_subs 2024-09-12T00:55:24.265 INFO:tasks.workunit.client.0.smithi070.stderr: -162> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient(hunting): authenticate will time out at 2174.321392s 2024-09-12T00:55:24.265 INFO:tasks.workunit.client.0.smithi070.stderr: -161> 2024-09-12T00:55:23.874+0000 7f3527fbd640 10 monclient(hunting): get_auth_request con 0x562a4d286850 auth_method 0 2024-09-12T00:55:24.265 INFO:tasks.workunit.client.0.smithi070.stderr: -160> 2024-09-12T00:55:23.874+0000 7f3527fbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:24.265 INFO:tasks.workunit.client.0.smithi070.stderr: -159> 2024-09-12T00:55:23.874+0000 7f3527fbd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:24.265 INFO:tasks.workunit.client.0.smithi070.stderr: -158> 2024-09-12T00:55:23.874+0000 7f3527fbd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:24.265 INFO:tasks.workunit.client.0.smithi070.stderr: -157> 2024-09-12T00:55:23.874+0000 7f35287be640 10 monclient(hunting): get_auth_request con 0x562a4d2b5760 auth_method 0 2024-09-12T00:55:24.265 INFO:tasks.workunit.client.0.smithi070.stderr: -156> 2024-09-12T00:55:23.874+0000 7f35287be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:24.265 INFO:tasks.workunit.client.0.smithi070.stderr: -155> 2024-09-12T00:55:23.874+0000 7f35287be640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:24.265 INFO:tasks.workunit.client.0.smithi070.stderr: -154> 2024-09-12T00:55:23.874+0000 7f35287be640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:24.265 INFO:tasks.workunit.client.0.smithi070.stderr: -153> 2024-09-12T00:55:23.874+0000 7f3527fbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:24.265 INFO:tasks.workunit.client.0.smithi070.stderr: -152> 2024-09-12T00:55:23.874+0000 7f3527fbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:24.265 INFO:tasks.workunit.client.0.smithi070.stderr: -151> 2024-09-12T00:55:23.874+0000 7f3527fbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:24.265 INFO:tasks.workunit.client.0.smithi070.stderr: -150> 2024-09-12T00:55:23.874+0000 7f35287be640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:24.265 INFO:tasks.workunit.client.0.smithi070.stderr: -149> 2024-09-12T00:55:23.874+0000 7f35287be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:24.266 INFO:tasks.workunit.client.0.smithi070.stderr: -148> 2024-09-12T00:55:23.874+0000 7f35287be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:24.266 INFO:tasks.workunit.client.0.smithi070.stderr: -147> 2024-09-12T00:55:23.874+0000 7f3527fbd640 10 monclient(hunting): handle_auth_done global_id 6542 payload 824 2024-09-12T00:55:24.266 INFO:tasks.workunit.client.0.smithi070.stderr: -146> 2024-09-12T00:55:23.874+0000 7f3527fbd640 10 monclient: _finish_hunting 0 2024-09-12T00:55:24.266 INFO:tasks.workunit.client.0.smithi070.stderr: -145> 2024-09-12T00:55:23.874+0000 7f3527fbd640 1 monclient: found mon.noname-c 2024-09-12T00:55:24.266 INFO:tasks.workunit.client.0.smithi070.stderr: -144> 2024-09-12T00:55:23.874+0000 7f3527fbd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:55:24.266 INFO:tasks.workunit.client.0.smithi070.stderr: -143> 2024-09-12T00:55:23.874+0000 7f34057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:24.266 INFO:tasks.workunit.client.0.smithi070.stderr: -142> 2024-09-12T00:55:23.874+0000 7f34057fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:55:24.266 INFO:tasks.workunit.client.0.smithi070.stderr: -141> 2024-09-12T00:55:23.874+0000 7f34057fa640 10 monclient: dump: 2024-09-12T00:55:24.266 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:24.266 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:24.266 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.266 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.266 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:24.266 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.267 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:24.267 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:24.267 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:24.267 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.267 INFO:tasks.workunit.client.0.smithi070.stderr: -140> 2024-09-12T00:55:23.874+0000 7f34057fa640 10 monclient: _finish_auth 0 2024-09-12T00:55:24.267 INFO:tasks.workunit.client.0.smithi070.stderr: -139> 2024-09-12T00:55:23.874+0000 7f34057fa640 10 monclient: _check_auth_tickets 2024-09-12T00:55:24.267 INFO:tasks.workunit.client.0.smithi070.stderr: -138> 2024-09-12T00:55:23.874+0000 7f34057fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:24.267 INFO:tasks.workunit.client.0.smithi070.stderr: -137> 2024-09-12T00:55:23.874+0000 7f34057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:24.267 INFO:tasks.workunit.client.0.smithi070.stderr: -136> 2024-09-12T00:55:23.874+0000 7f34057fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:55:24.267 INFO:tasks.workunit.client.0.smithi070.stderr: -135> 2024-09-12T00:55:23.874+0000 7f34057fa640 10 monclient: dump: 2024-09-12T00:55:24.267 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:24.267 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:24.267 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.267 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:24.267 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:24.268 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:24.268 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:24.268 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:24.268 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:24.268 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.268 INFO:tasks.workunit.client.0.smithi070.stderr: -134> 2024-09-12T00:55:23.874+0000 7f3406ffd640 4 set_mon_vals no callback set 2024-09-12T00:55:24.268 INFO:tasks.workunit.client.0.smithi070.stderr: -133> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 monclient: authenticate success, global_id 6542 2024-09-12T00:55:24.268 INFO:tasks.workunit.client.0.smithi070.stderr: -132> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient: _renew_subs 2024-09-12T00:55:24.268 INFO:tasks.workunit.client.0.smithi070.stderr: -131> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:55:24.268 INFO:tasks.workunit.client.0.smithi070.stderr: -130> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient: _renew_subs 2024-09-12T00:55:24.268 INFO:tasks.workunit.client.0.smithi070.stderr: -129> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:55:24.268 INFO:tasks.workunit.client.0.smithi070.stderr: -128> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 1 librados: init done 2024-09-12T00:55:24.268 INFO:tasks.workunit.client.0.smithi070.stderr: -127> 2024-09-12T00:55:23.874+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command cr dump hook 0x562a4d2ab9b8 2024-09-12T00:55:24.268 INFO:tasks.workunit.client.0.smithi070.stderr: -126> 2024-09-12T00:55:23.878+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.269 INFO:tasks.workunit.client.0.smithi070.stderr: -125> 2024-09-12T00:55:23.878+0000 7f34057fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:24.269 INFO:tasks.workunit.client.0.smithi070.stderr: -124> 2024-09-12T00:55:23.878+0000 7f34057fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:55:24.269 INFO:tasks.workunit.client.0.smithi070.stderr: -123> 2024-09-12T00:55:23.878+0000 7f34057fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:55:24.269 INFO:tasks.workunit.client.0.smithi070.stderr: -122> 2024-09-12T00:55:23.878+0000 7f35287be640 10 monclient: get_auth_request con 0x562a4d2cf3a0 auth_method 0 2024-09-12T00:55:24.269 INFO:tasks.workunit.client.0.smithi070.stderr: -121> 2024-09-12T00:55:23.878+0000 7f352a4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.269 INFO:tasks.workunit.client.0.smithi070.stderr: -120> 2024-09-12T00:55:23.878+0000 7f352a4b79c0 20 realm 2024-09-12T00:55:24.269 INFO:tasks.workunit.client.0.smithi070.stderr: -119> 2024-09-12T00:55:23.878+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.269 INFO:tasks.workunit.client.0.smithi070.stderr: -118> 2024-09-12T00:55:23.878+0000 7f35277bc640 10 monclient: get_auth_request con 0x7f33f0070ae0 auth_method 0 2024-09-12T00:55:24.269 INFO:tasks.workunit.client.0.smithi070.stderr: -117> 2024-09-12T00:55:23.878+0000 7f352a4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.269 INFO:tasks.workunit.client.0.smithi070.stderr: -116> 2024-09-12T00:55:23.878+0000 7f352a4b79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:24.269 INFO:tasks.workunit.client.0.smithi070.stderr: -115> 2024-09-12T00:55:23.878+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.269 INFO:tasks.workunit.client.0.smithi070.stderr: -114> 2024-09-12T00:55:23.878+0000 7f352a4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.270 INFO:tasks.workunit.client.0.smithi070.stderr: -113> 2024-09-12T00:55:23.878+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.270 INFO:tasks.workunit.client.0.smithi070.stderr: -112> 2024-09-12T00:55:23.878+0000 7f3527fbd640 10 monclient: get_auth_request con 0x562a4d2d3620 auth_method 0 2024-09-12T00:55:24.270 INFO:tasks.workunit.client.0.smithi070.stderr: -111> 2024-09-12T00:55:23.882+0000 7f352a4b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:24.270 INFO:tasks.workunit.client.0.smithi070.stderr: -110> 2024-09-12T00:55:23.882+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.270 INFO:tasks.workunit.client.0.smithi070.stderr: -109> 2024-09-12T00:55:23.882+0000 7f35277bc640 10 monclient: get_auth_request con 0x562a4d2d6e60 auth_method 0 2024-09-12T00:55:24.270 INFO:tasks.workunit.client.0.smithi070.stderr: -108> 2024-09-12T00:55:23.882+0000 7f352a4b79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:24.270 INFO:tasks.workunit.client.0.smithi070.stderr: -107> 2024-09-12T00:55:23.882+0000 7f352a4b79c0 20 searching for the correct realm 2024-09-12T00:55:24.270 INFO:tasks.workunit.client.0.smithi070.stderr: -106> 2024-09-12T00:55:23.882+0000 7f35287be640 10 monclient: get_auth_request con 0x562a4d2dbc00 auth_method 0 2024-09-12T00:55:24.270 INFO:tasks.workunit.client.0.smithi070.stderr: -105> 2024-09-12T00:55:23.882+0000 7f3527fbd640 10 monclient: get_auth_request con 0x7f3520008050 auth_method 0 2024-09-12T00:55:24.270 INFO:tasks.workunit.client.0.smithi070.stderr: -104> 2024-09-12T00:55:23.886+0000 7f35277bc640 10 monclient: get_auth_request con 0x7f351810bac0 auth_method 0 2024-09-12T00:55:24.270 INFO:tasks.workunit.client.0.smithi070.stderr: -103> 2024-09-12T00:55:23.886+0000 7f35287be640 10 monclient: get_auth_request con 0x7f351c08f140 auth_method 0 2024-09-12T00:55:24.270 INFO:tasks.workunit.client.0.smithi070.stderr: -102> 2024-09-12T00:55:23.890+0000 7f3527fbd640 0 -- 172.21.15.70:0/4160814060 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f3520008050 msgr2=0x7f3520060720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:24.271 INFO:tasks.workunit.client.0.smithi070.stderr: -101> 2024-09-12T00:55:23.890+0000 7f34057fa640 1 client.6542.objecter ms_handle_reset 0x7f3520008050 session 0x7f35200660d0 osd.7 2024-09-12T00:55:24.271 INFO:tasks.workunit.client.0.smithi070.stderr: -100> 2024-09-12T00:55:23.890+0000 7f34057fa640 10 monclient: _renew_subs 2024-09-12T00:55:24.271 INFO:tasks.workunit.client.0.smithi070.stderr: -99> 2024-09-12T00:55:23.890+0000 7f34057fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:55:24.271 INFO:tasks.workunit.client.0.smithi070.stderr: -98> 2024-09-12T00:55:23.890+0000 7f3527fbd640 10 monclient: get_auth_request con 0x7f33f0080800 auth_method 0 2024-09-12T00:55:24.271 INFO:tasks.workunit.client.0.smithi070.stderr: -97> 2024-09-12T00:55:23.894+0000 7f3527fbd640 10 monclient: get_auth_request con 0x7f352007a040 auth_method 0 2024-09-12T00:55:24.271 INFO:tasks.workunit.client.0.smithi070.stderr: -96> 2024-09-12T00:55:23.898+0000 7f3527fbd640 0 -- 172.21.15.70:0/4160814060 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f352007a040 msgr2=0x7f3520068460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:24.271 INFO:tasks.workunit.client.0.smithi070.stderr: -95> 2024-09-12T00:55:23.898+0000 7f34057fa640 1 client.6542.objecter ms_handle_reset 0x7f352007a040 session 0x7f3520061560 osd.6 2024-09-12T00:55:24.271 INFO:tasks.workunit.client.0.smithi070.stderr: -94> 2024-09-12T00:55:23.898+0000 7f3527fbd640 10 monclient: get_auth_request con 0x7f3520008050 auth_method 0 2024-09-12T00:55:24.271 INFO:tasks.workunit.client.0.smithi070.stderr: -93> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:24.271 INFO:tasks.workunit.client.0.smithi070.stderr: -92> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:24.271 INFO:tasks.workunit.client.0.smithi070.stderr: -91> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:24.271 INFO:tasks.workunit.client.0.smithi070.stderr: -90> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:24.271 INFO:tasks.workunit.client.0.smithi070.stderr: -89> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:24.272 INFO:tasks.workunit.client.0.smithi070.stderr: -88> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:24.272 INFO:tasks.workunit.client.0.smithi070.stderr: -87> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.272 INFO:tasks.workunit.client.0.smithi070.stderr: -86> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.272 INFO:tasks.workunit.client.0.smithi070.stderr: -85> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.272 INFO:tasks.workunit.client.0.smithi070.stderr: -84> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:24.272 INFO:tasks.workunit.client.0.smithi070.stderr: -83> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.272 INFO:tasks.workunit.client.0.smithi070.stderr: -82> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:24.272 INFO:tasks.workunit.client.0.smithi070.stderr: -81> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 zone default found 2024-09-12T00:55:24.272 INFO:tasks.workunit.client.0.smithi070.stderr: -80> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 4 Realm: () 2024-09-12T00:55:24.272 INFO:tasks.workunit.client.0.smithi070.stderr: -79> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:24.272 INFO:tasks.workunit.client.0.smithi070.stderr: -78> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:24.273 INFO:tasks.workunit.client.0.smithi070.stderr: -77> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:24.273 INFO:tasks.workunit.client.0.smithi070.stderr: -76> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 zonegroup default 2024-09-12T00:55:24.273 INFO:tasks.workunit.client.0.smithi070.stderr: -75> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.273 INFO:tasks.workunit.client.0.smithi070.stderr: -74> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.273 INFO:tasks.workunit.client.0.smithi070.stderr: -73> 2024-09-12T00:55:24.114+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.273 INFO:tasks.workunit.client.0.smithi070.stderr: -72> 2024-09-12T00:55:24.118+0000 7f352a4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.273 INFO:tasks.workunit.client.0.smithi070.stderr: -71> 2024-09-12T00:55:24.118+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.273 INFO:tasks.workunit.client.0.smithi070.stderr: -70> 2024-09-12T00:55:24.118+0000 7f352a4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.273 INFO:tasks.workunit.client.0.smithi070.stderr: -69> 2024-09-12T00:55:24.118+0000 7f352a4b79c0 20 started sync module instance, tier type = 2024-09-12T00:55:24.273 INFO:tasks.workunit.client.0.smithi070.stderr: -68> 2024-09-12T00:55:24.118+0000 7f352a4b79c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:24.274 INFO:tasks.workunit.client.0.smithi070.stderr: -67> 2024-09-12T00:55:24.146+0000 7f352a4b79c0 20 add_watcher() i=0 2024-09-12T00:55:24.274 INFO:tasks.workunit.client.0.smithi070.stderr: -66> 2024-09-12T00:55:24.146+0000 7f352a4b79c0 20 add_watcher() i=1 2024-09-12T00:55:24.274 INFO:tasks.workunit.client.0.smithi070.stderr: -65> 2024-09-12T00:55:24.146+0000 7f352a4b79c0 20 add_watcher() i=2 2024-09-12T00:55:24.274 INFO:tasks.workunit.client.0.smithi070.stderr: -64> 2024-09-12T00:55:24.146+0000 7f352a4b79c0 20 add_watcher() i=3 2024-09-12T00:55:24.274 INFO:tasks.workunit.client.0.smithi070.stderr: -63> 2024-09-12T00:55:24.146+0000 7f352a4b79c0 20 add_watcher() i=4 2024-09-12T00:55:24.274 INFO:tasks.workunit.client.0.smithi070.stderr: -62> 2024-09-12T00:55:24.146+0000 7f352a4b79c0 20 add_watcher() i=5 2024-09-12T00:55:24.274 INFO:tasks.workunit.client.0.smithi070.stderr: -61> 2024-09-12T00:55:24.146+0000 7f352a4b79c0 20 add_watcher() i=6 2024-09-12T00:55:24.274 INFO:tasks.workunit.client.0.smithi070.stderr: -60> 2024-09-12T00:55:24.146+0000 7f352a4b79c0 20 add_watcher() i=7 2024-09-12T00:55:24.274 INFO:tasks.workunit.client.0.smithi070.stderr: -59> 2024-09-12T00:55:24.146+0000 7f352a4b79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:24.274 INFO:tasks.workunit.client.0.smithi070.stderr: -58> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding auth protocol: cephx 2024-09-12T00:55:24.274 INFO:tasks.workunit.client.0.smithi070.stderr: -57> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding auth protocol: cephx 2024-09-12T00:55:24.274 INFO:tasks.workunit.client.0.smithi070.stderr: -56> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding auth protocol: cephx 2024-09-12T00:55:24.274 INFO:tasks.workunit.client.0.smithi070.stderr: -55> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding con mode: secure 2024-09-12T00:55:24.275 INFO:tasks.workunit.client.0.smithi070.stderr: -54> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding con mode: crc 2024-09-12T00:55:24.275 INFO:tasks.workunit.client.0.smithi070.stderr: -53> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding con mode: secure 2024-09-12T00:55:24.275 INFO:tasks.workunit.client.0.smithi070.stderr: -52> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding con mode: crc 2024-09-12T00:55:24.275 INFO:tasks.workunit.client.0.smithi070.stderr: -51> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding con mode: secure 2024-09-12T00:55:24.275 INFO:tasks.workunit.client.0.smithi070.stderr: -50> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding con mode: crc 2024-09-12T00:55:24.275 INFO:tasks.workunit.client.0.smithi070.stderr: -49> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding con mode: crc 2024-09-12T00:55:24.275 INFO:tasks.workunit.client.0.smithi070.stderr: -48> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding con mode: secure 2024-09-12T00:55:24.275 INFO:tasks.workunit.client.0.smithi070.stderr: -47> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding con mode: crc 2024-09-12T00:55:24.275 INFO:tasks.workunit.client.0.smithi070.stderr: -46> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding con mode: secure 2024-09-12T00:55:24.275 INFO:tasks.workunit.client.0.smithi070.stderr: -45> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding con mode: crc 2024-09-12T00:55:24.275 INFO:tasks.workunit.client.0.smithi070.stderr: -44> 2024-09-12T00:55:24.150+0000 7f352a4b79c0 5 AuthRegistry(0x7ffc39575950) adding con mode: secure 2024-09-12T00:55:24.275 INFO:tasks.workunit.client.0.smithi070.stderr: -43> 2024-09-12T00:55:24.150+0000 7f33ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:24.275 INFO:tasks.workunit.client.0.smithi070.stderr: -42> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:24.276 INFO:tasks.workunit.client.0.smithi070.stderr: -41> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:24.276 INFO:tasks.workunit.client.0.smithi070.stderr: -40> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:24.276 INFO:tasks.workunit.client.0.smithi070.stderr: -39> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command cache list hook 0x562a4d2a64f0 2024-09-12T00:55:24.276 INFO:tasks.workunit.client.0.smithi070.stderr: -38> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command cache inspect hook 0x562a4d2a64f0 2024-09-12T00:55:24.276 INFO:tasks.workunit.client.0.smithi070.stderr: -37> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command cache erase hook 0x562a4d2a64f0 2024-09-12T00:55:24.276 INFO:tasks.workunit.client.0.smithi070.stderr: -36> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command cache zap hook 0x562a4d2a64f0 2024-09-12T00:55:24.276 INFO:tasks.workunit.client.0.smithi070.stderr: -35> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 5 note: GC not initialized 2024-09-12T00:55:24.276 INFO:tasks.workunit.client.0.smithi070.stderr: -34> 2024-09-12T00:55:24.154+0000 7f33dcfe1640 20 reqs_thread_entry: start 2024-09-12T00:55:24.276 INFO:tasks.workunit.client.0.smithi070.stderr: -33> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command sync trace show hook 0x7f351c0650b0 2024-09-12T00:55:24.276 INFO:tasks.workunit.client.0.smithi070.stderr: -32> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command sync trace history hook 0x7f351c0650b0 2024-09-12T00:55:24.276 INFO:tasks.workunit.client.0.smithi070.stderr: -31> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command sync trace active hook 0x7f351c0650b0 2024-09-12T00:55:24.276 INFO:tasks.workunit.client.0.smithi070.stderr: -30> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 5 asok(0x562a4cfda2b0) register_command sync trace active_short hook 0x7f351c0650b0 2024-09-12T00:55:24.276 INFO:tasks.workunit.client.0.smithi070.stderr: -29> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:24.277 INFO:tasks.workunit.client.0.smithi070.stderr: -28> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 20 Filter name: none 2024-09-12T00:55:24.277 INFO:tasks.workunit.client.0.smithi070.stderr: -27> 2024-09-12T00:55:24.154+0000 7f33567fc640 20 reqs_thread_entry: start 2024-09-12T00:55:24.277 INFO:tasks.workunit.client.0.smithi070.stderr: -26> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:55:24.277 INFO:tasks.workunit.client.0.smithi070.stderr: -25> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.277 INFO:tasks.workunit.client.0.smithi070.stderr: -24> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:55:24.277 INFO:tasks.workunit.client.0.smithi070.stderr: -23> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:55:24.277 INFO:tasks.workunit.client.0.smithi070.stderr: -22> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:55:24.277 INFO:tasks.workunit.client.0.smithi070.stderr: -21> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 : miss 2024-09-12T00:55:24.277 INFO:tasks.workunit.client.0.smithi070.stderr: -20> 2024-09-12T00:55:24.154+0000 7f352a4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.277 INFO:tasks.workunit.client.0.smithi070.stderr: -19> 2024-09-12T00:55:24.158+0000 7f352a4b79c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:55:24.277 INFO:tasks.workunit.client.0.smithi070.stderr: -18> 2024-09-12T00:55:24.158+0000 7f352a4b79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 info.flags=0x17 2024-09-12T00:55:24.277 INFO:tasks.workunit.client.0.smithi070.stderr: -17> 2024-09-12T00:55:24.158+0000 7f352a4b79c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 to cache LRU end 2024-09-12T00:55:24.277 INFO:tasks.workunit.client.0.smithi070.stderr: -16> 2024-09-12T00:55:24.158+0000 7f352a4b79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:24.278 INFO:tasks.workunit.client.0.smithi070.stderr: -15> 2024-09-12T00:55:24.158+0000 7f352a4b79c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:24.278 INFO:tasks.workunit.client.0.smithi070.stderr: -14> 2024-09-12T00:55:24.158+0000 7f352a4b79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 2024-09-12T00:55:24.278 INFO:tasks.workunit.client.0.smithi070.stderr: -13> 2024-09-12T00:55:24.162+0000 7f352a4b79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 info.flags=0x17 2024-09-12T00:55:24.278 INFO:tasks.workunit.client.0.smithi070.stderr: -12> 2024-09-12T00:55:24.162+0000 7f352a4b79c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 to cache LRU end 2024-09-12T00:55:24.278 INFO:tasks.workunit.client.0.smithi070.stderr: -11> 2024-09-12T00:55:24.162+0000 7f352a4b79c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:24.278 INFO:tasks.workunit.client.0.smithi070.stderr: -10> 2024-09-12T00:55:24.162+0000 7f352a4b79c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28, ofs0, ns] 2024-09-12T00:55:24.278 INFO:tasks.workunit.client.0.smithi070.stderr: -9> 2024-09-12T00:55:24.162+0000 7f3406ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431603 cookie 94739683491056 notifier 6542 bl.length()=1023 2024-09-12T00:55:24.278 INFO:tasks.workunit.client.0.smithi070.stderr: -8> 2024-09-12T00:55:24.162+0000 7f3406ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 info.flags=0x17 2024-09-12T00:55:24.278 INFO:tasks.workunit.client.0.smithi070.stderr: -7> 2024-09-12T00:55:24.162+0000 7f3406ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 to cache LRU end 2024-09-12T00:55:24.278 INFO:tasks.workunit.client.0.smithi070.stderr: -6> 2024-09-12T00:55:24.162+0000 7f3406ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:24.278 INFO:tasks.workunit.client.0.smithi070.stderr: -5> 2024-09-12T00:55:24.162+0000 7f352a4b79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28]): orig_sources= new_sources= 2024-09-12T00:55:24.278 INFO:tasks.workunit.client.0.smithi070.stderr: -4> 2024-09-12T00:55:24.162+0000 7f352a4b79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28]): potential sources added=[] removed=[] 2024-09-12T00:55:24.279 INFO:tasks.workunit.client.0.smithi070.stderr: -3> 2024-09-12T00:55:24.162+0000 7f352a4b79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28]): orig_dests= new_dests= 2024-09-12T00:55:24.279 INFO:tasks.workunit.client.0.smithi070.stderr: -2> 2024-09-12T00:55:24.162+0000 7f352a4b79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28]): potential dests added=[] removed=[] 2024-09-12T00:55:24.279 INFO:tasks.workunit.client.0.smithi070.stderr: -1> 2024-09-12T00:55:24.166+0000 7f352a4b79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f352a4b79c0 time 2024-09-12T00:55:24.166765+0000 2024-09-12T00:55:24.279 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:55:24.279 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.279 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:24.279 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f352dd912eb] 2024-09-12T00:55:24.279 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f352dd9149f] 2024-09-12T00:55:24.279 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562a4aa30cc1] 2024-09-12T00:55:24.279 INFO:tasks.workunit.client.0.smithi070.stderr: 4: radosgw-admin(+0x1422a3e) [0x562a4b48ea3e] 2024-09-12T00:55:24.279 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562a4aa45ced] 2024-09-12T00:55:24.279 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:55:24.279 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f352cbf7d90] 2024-09-12T00:55:24.280 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:55:24.280 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:55:24.280 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.280 INFO:tasks.workunit.client.0.smithi070.stderr: 0> 2024-09-12T00:55:24.166+0000 7f352a4b79c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:55:24.280 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f352a4b79c0 thread_name:radosgw-admin 2024-09-12T00:55:24.280 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.280 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:24.280 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f352cc10520] 2024-09-12T00:55:24.280 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:55:24.280 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:55:24.280 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:55:24.280 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f352dd91345] 2024-09-12T00:55:24.280 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f352dd9149f] 2024-09-12T00:55:24.280 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562a4aa30cc1] 2024-09-12T00:55:24.281 INFO:tasks.workunit.client.0.smithi070.stderr: 8: radosgw-admin(+0x1422a3e) [0x562a4b48ea3e] 2024-09-12T00:55:24.281 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562a4aa45ced] 2024-09-12T00:55:24.281 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:55:24.281 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f352cbf7d90] 2024-09-12T00:55:24.281 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:55:24.281 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:55:24.281 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:55:24.281 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.281 INFO:tasks.workunit.client.0.smithi070.stderr:--- logging levels --- 2024-09-12T00:55:24.281 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 none 2024-09-12T00:55:24.281 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 lockdep 2024-09-12T00:55:24.281 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 context 2024-09-12T00:55:24.281 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 crush 2024-09-12T00:55:24.282 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds 2024-09-12T00:55:24.282 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_balancer 2024-09-12T00:55:24.282 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_locker 2024-09-12T00:55:24.282 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log 2024-09-12T00:55:24.282 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log_expire 2024-09-12T00:55:24.282 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_migrator 2024-09-12T00:55:24.282 INFO:tasks.workunit.client.0.smithi070.stderr: 3/ 5 mds_quiesce 2024-09-12T00:55:24.282 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 buffer 2024-09-12T00:55:24.282 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 timer 2024-09-12T00:55:24.282 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 filer 2024-09-12T00:55:24.282 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 striper 2024-09-12T00:55:24.282 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 objecter 2024-09-12T00:55:24.282 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rados 2024-09-12T00:55:24.282 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd 2024-09-12T00:55:24.283 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_mirror 2024-09-12T00:55:24.283 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_replay 2024-09-12T00:55:24.283 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_pwl 2024-09-12T00:55:24.283 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 journaler 2024-09-12T00:55:24.283 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objectcacher 2024-09-12T00:55:24.283 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:55:24.283 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 client 2024-09-12T00:55:24.283 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 osd 2024-09-12T00:55:24.283 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 optracker 2024-09-12T00:55:24.283 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objclass 2024-09-12T00:55:24.283 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 filestore 2024-09-12T00:55:24.283 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 journal 2024-09-12T00:55:24.283 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 ms 2024-09-12T00:55:24.283 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mon 2024-09-12T00:55:24.284 INFO:tasks.workunit.client.0.smithi070.stderr: 0/10 monc 2024-09-12T00:55:24.284 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 paxos 2024-09-12T00:55:24.284 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 tp 2024-09-12T00:55:24.284 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 auth 2024-09-12T00:55:24.284 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 crypto 2024-09-12T00:55:24.284 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 finisher 2024-09-12T00:55:24.284 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 reserver 2024-09-12T00:55:24.284 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 heartbeatmap 2024-09-12T00:55:24.284 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 perfcounter 2024-09-12T00:55:24.284 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw 2024-09-12T00:55:24.284 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_sync 2024-09-12T00:55:24.284 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_datacache 2024-09-12T00:55:24.284 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_access 2024-09-12T00:55:24.285 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:55:24.285 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_flight 2024-09-12T00:55:24.285 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:55:24.285 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw_notification 2024-09-12T00:55:24.285 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 javaclient 2024-09-12T00:55:24.285 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 asok 2024-09-12T00:55:24.285 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 throttle 2024-09-12T00:55:24.285 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 refs 2024-09-12T00:55:24.285 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 compressor 2024-09-12T00:55:24.285 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluestore 2024-09-12T00:55:24.285 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluefs 2024-09-12T00:55:24.285 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 bdev 2024-09-12T00:55:24.285 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 kstore 2024-09-12T00:55:24.286 INFO:tasks.workunit.client.0.smithi070.stderr: 4/ 5 rocksdb 2024-09-12T00:55:24.286 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 fuse 2024-09-12T00:55:24.286 INFO:tasks.workunit.client.0.smithi070.stderr: 2/ 5 mgr 2024-09-12T00:55:24.286 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mgrc 2024-09-12T00:55:24.286 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 dpdk 2024-09-12T00:55:24.286 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 eventtrace 2024-09-12T00:55:24.286 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 prioritycache 2024-09-12T00:55:24.286 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 test 2024-09-12T00:55:24.286 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:55:24.286 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephsqlite 2024-09-12T00:55:24.286 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:55:24.286 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore 2024-09-12T00:55:24.286 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_onode 2024-09-12T00:55:24.286 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_odata 2024-09-12T00:55:24.287 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_omap 2024-09-12T00:55:24.287 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_tm 2024-09-12T00:55:24.287 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_t 2024-09-12T00:55:24.287 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:55:24.287 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_epm 2024-09-12T00:55:24.287 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_lba 2024-09-12T00:55:24.287 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:55:24.287 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cache 2024-09-12T00:55:24.287 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_journal 2024-09-12T00:55:24.287 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_device 2024-09-12T00:55:24.287 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_backref 2024-09-12T00:55:24.287 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 alienstore 2024-09-12T00:55:24.287 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mclock 2024-09-12T00:55:24.287 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cyanstore 2024-09-12T00:55:24.288 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 ceph_exporter 2024-09-12T00:55:24.288 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 memstore 2024-09-12T00:55:24.288 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 trace 2024-09-12T00:55:24.288 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 ceph_dedup 2024-09-12T00:55:24.288 INFO:tasks.workunit.client.0.smithi070.stderr: -2/-2 (syslog threshold) 2024-09-12T00:55:24.288 INFO:tasks.workunit.client.0.smithi070.stderr: 99/99 (stderr threshold) 2024-09-12T00:55:24.288 INFO:tasks.workunit.client.0.smithi070.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:55:24.288 INFO:tasks.workunit.client.0.smithi070.stderr: 7f33567fc640 / http_manager 2024-09-12T00:55:24.288 INFO:tasks.workunit.client.0.smithi070.stderr: 7f33dcfe1640 / http_manager 2024-09-12T00:55:24.288 INFO:tasks.workunit.client.0.smithi070.stderr: 7f33ddfe3640 / rgw_dt_lg_renew 2024-09-12T00:55:24.288 INFO:tasks.workunit.client.0.smithi070.stderr: 7f34057fa640 / ms_dispatch 2024-09-12T00:55:24.288 INFO:tasks.workunit.client.0.smithi070.stderr: 7f3406ffd640 / io_context_pool 2024-09-12T00:55:24.288 INFO:tasks.workunit.client.0.smithi070.stderr: 7f340d7fa640 / ms_dispatch 2024-09-12T00:55:24.288 INFO:tasks.workunit.client.0.smithi070.stderr: 7f340ffff640 / ms_dispatch 2024-09-12T00:55:24.289 INFO:tasks.workunit.client.0.smithi070.stderr: 7f3415e0b640 / io_context_pool 2024-09-12T00:55:24.289 INFO:tasks.workunit.client.0.smithi070.stderr: 7f35277bc640 / msgr-worker-2 2024-09-12T00:55:24.289 INFO:tasks.workunit.client.0.smithi070.stderr: 7f3527fbd640 / msgr-worker-1 2024-09-12T00:55:24.289 INFO:tasks.workunit.client.0.smithi070.stderr: 7f35287be640 / msgr-worker-0 2024-09-12T00:55:24.289 INFO:tasks.workunit.client.0.smithi070.stderr: 7f3528fbf640 / io_context_pool 2024-09-12T00:55:24.289 INFO:tasks.workunit.client.0.smithi070.stderr: 7f352a4b79c0 / radosgw-admin 2024-09-12T00:55:24.289 INFO:tasks.workunit.client.0.smithi070.stderr: max_recent 500 2024-09-12T00:55:24.289 INFO:tasks.workunit.client.0.smithi070.stderr: max_new 1000 2024-09-12T00:55:24.289 INFO:tasks.workunit.client.0.smithi070.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:55:24.169229Z_79424ec6-b403-4e0d-b784-f58326eab150/log 2024-09-12T00:55:24.289 INFO:tasks.workunit.client.0.smithi070.stderr:--- end dump of recent events --- 2024-09-12T00:55:24.289 INFO:tasks.workunit.client.0.smithi070.stderr:Aborted 2024-09-12T00:55:24.293 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:55:24.294 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:24.294 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:24.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.246+0000 7fe04e7a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.250+0000 7fe04e7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.250+0000 7fe04e7a79c0 20 realm 2024-09-12T00:55:24.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.250+0000 7fe04e7a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.250+0000 7fe04e7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.250+0000 7fe04e7a79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:24.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.250+0000 7fe04e7a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.250+0000 7fe04e7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.250+0000 7fe04e7a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.250+0000 7fe04e7a79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:24.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.250+0000 7fe04e7a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.250+0000 7fe04e7a79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:24.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.250+0000 7fe04e7a79c0 20 searching for the correct realm 2024-09-12T00:55:24.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.258+0000 7fe04caae640 0 -- 172.21.15.70:0/4077920548 >> [v2:172.21.15.70:6808/276433067,v1:172.21.15.70:6809/276433067] conn(0x5591b345b560 msgr2=0x5591b345da20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:24.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.266+0000 7fe04c2ad640 0 -- 172.21.15.70:0/4077920548 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7fe044018040 msgr2=0x7fe04405fa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:24.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.270+0000 7fe04e7a79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:24.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.270+0000 7fe04e7a79c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:24.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.270+0000 7fe04e7a79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:24.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.270+0000 7fe04e7a79c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:24.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.270+0000 7fe04e7a79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:24.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.270+0000 7fe04e7a79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:24.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.270+0000 7fe04e7a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.270+0000 7fe04e7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.270+0000 7fe04e7a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.270+0000 7fe04e7a79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:24.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.270+0000 7fe04e7a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.270+0000 7fe04e7a79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:24.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.270+0000 7fe04e7a79c0 20 zone default found 2024-09-12T00:55:24.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.270+0000 7fe04e7a79c0 4 Realm: () 2024-09-12T00:55:24.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.270+0000 7fe04e7a79c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:24.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.270+0000 7fe04e7a79c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:24.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.270+0000 7fe04e7a79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:24.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.270+0000 7fe04e7a79c0 20 zonegroup default 2024-09-12T00:55:24.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.270+0000 7fe04e7a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.270+0000 7fe04e7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.270+0000 7fe04e7a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.274+0000 7fe04e7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.274+0000 7fe04e7a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.274+0000 7fe04e7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.274+0000 7fe04e7a79c0 20 started sync module instance, tier type = 2024-09-12T00:55:24.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.274+0000 7fe04e7a79c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:24.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.290+0000 7fe04e7a79c0 20 add_watcher() i=0 2024-09-12T00:55:24.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.290+0000 7fe04e7a79c0 20 add_watcher() i=1 2024-09-12T00:55:24.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.290+0000 7fe04e7a79c0 20 add_watcher() i=2 2024-09-12T00:55:24.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.290+0000 7fe04e7a79c0 20 add_watcher() i=3 2024-09-12T00:55:24.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.290+0000 7fe04e7a79c0 20 add_watcher() i=4 2024-09-12T00:55:24.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.290+0000 7fe04e7a79c0 20 add_watcher() i=5 2024-09-12T00:55:24.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.290+0000 7fe04e7a79c0 20 add_watcher() i=6 2024-09-12T00:55:24.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.294+0000 7fe04e7a79c0 20 add_watcher() i=7 2024-09-12T00:55:24.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.294+0000 7fe04e7a79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:24.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.294+0000 7fdf02fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:24.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.294+0000 7fe04e7a79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:24.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.294+0000 7fe04e7a79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:24.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.294+0000 7fe04e7a79c0 5 note: GC not initialized 2024-09-12T00:55:24.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.294+0000 7fdf01fdb640 20 reqs_thread_entry: start 2024-09-12T00:55:24.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.294+0000 7fe04e7a79c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:24.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.294+0000 7fe04e7a79c0 20 Filter name: none 2024-09-12T00:55:24.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.294+0000 7fde737fe640 20 reqs_thread_entry: start 2024-09-12T00:55:24.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.294+0000 7fe04e7a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.298+0000 7fe04e7a79c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:55:24.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.298+0000 7fe04e7a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.298+0000 7fe04e7a79c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:55:24.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.298+0000 7fe04e7a79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:24.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.298+0000 7fe04e7a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.298+0000 7fe04e7a79c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:55:24.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.298+0000 7fe04e7a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.298+0000 7fe04e7a79c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:55:24.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.298+0000 7fe04e7a79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:24.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.302+0000 7fdf02fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:24.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.306+0000 7fe04e7a79c0 20 remove_watcher() i=0 2024-09-12T00:55:24.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.306+0000 7fe04e7a79c0 2 removed watcher, disabling cache 2024-09-12T00:55:24.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.306+0000 7fe04e7a79c0 20 remove_watcher() i=1 2024-09-12T00:55:24.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.310+0000 7fe04e7a79c0 20 remove_watcher() i=2 2024-09-12T00:55:24.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.310+0000 7fe04e7a79c0 20 remove_watcher() i=3 2024-09-12T00:55:24.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.314+0000 7fe04e7a79c0 20 remove_watcher() i=4 2024-09-12T00:55:24.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.314+0000 7fe04e7a79c0 20 remove_watcher() i=5 2024-09-12T00:55:24.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.314+0000 7fe04e7a79c0 20 remove_watcher() i=6 2024-09-12T00:55:24.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.318+0000 7fe04e7a79c0 20 remove_watcher() i=7 2024-09-12T00:55:24.323 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.323 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:55:24.323 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: abort-at-trim-reshard-log-entries id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:55:24.323 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:24.324 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:24.324 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:24.337 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:24.337 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:24.381 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:55:24.417 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:24.418 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:24.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.470+0000 7f13b2d7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.470+0000 7f13b2d7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.470+0000 7f13b2d7b9c0 20 realm 2024-09-12T00:55:24.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.470+0000 7f13b2d7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.470+0000 7f13b2d7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.470+0000 7f13b2d7b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:24.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.470+0000 7f13b2d7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.470+0000 7f13b2d7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.470+0000 7f13b2d7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.474+0000 7f13b2d7b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:24.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.474+0000 7f13b2d7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.474+0000 7f13b2d7b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:24.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.474+0000 7f13b2d7b9c0 20 searching for the correct realm 2024-09-12T00:55:24.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.478+0000 7f13b1082640 0 -- 172.21.15.70:0/2781487449 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f13a40cb410 msgr2=0x7f13a40cb850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:24.478 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.486+0000 7f13b0881640 0 -- 172.21.15.70:0/2781487449 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f13a8086be0 msgr2=0x7f13a80190c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:55:24.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.494+0000 7f13b2d7b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:24.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.494+0000 7f13b2d7b9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:24.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.494+0000 7f13b2d7b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:24.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.494+0000 7f13b2d7b9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:24.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.494+0000 7f13b2d7b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:24.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.494+0000 7f13b2d7b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:24.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.494+0000 7f13b2d7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.494+0000 7f13b2d7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.494+0000 7f13b2d7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.494+0000 7f13b2d7b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:24.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.494+0000 7f13b2d7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.494+0000 7f13b2d7b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:24.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.494+0000 7f13b2d7b9c0 20 zone default found 2024-09-12T00:55:24.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.494+0000 7f13b2d7b9c0 4 Realm: () 2024-09-12T00:55:24.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.494+0000 7f13b2d7b9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:24.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.494+0000 7f13b2d7b9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:24.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.494+0000 7f13b2d7b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:24.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.494+0000 7f13b2d7b9c0 20 zonegroup default 2024-09-12T00:55:24.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.494+0000 7f13b2d7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.498+0000 7f13b2d7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.498+0000 7f13b2d7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.498+0000 7f13b2d7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.498+0000 7f13b2d7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.498+0000 7f13b2d7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:24.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.498+0000 7f13b2d7b9c0 20 started sync module instance, tier type = 2024-09-12T00:55:24.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.498+0000 7f13b2d7b9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:24.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.514+0000 7f13b2d7b9c0 20 add_watcher() i=0 2024-09-12T00:55:24.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.514+0000 7f13b2d7b9c0 20 add_watcher() i=1 2024-09-12T00:55:24.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.514+0000 7f13b2d7b9c0 20 add_watcher() i=2 2024-09-12T00:55:24.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.514+0000 7f13b2d7b9c0 20 add_watcher() i=3 2024-09-12T00:55:24.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.514+0000 7f13b2d7b9c0 20 add_watcher() i=4 2024-09-12T00:55:24.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.514+0000 7f13b2d7b9c0 20 add_watcher() i=5 2024-09-12T00:55:24.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.514+0000 7f13b2d7b9c0 20 add_watcher() i=6 2024-09-12T00:55:24.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.514+0000 7f13b2d7b9c0 20 add_watcher() i=7 2024-09-12T00:55:24.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.514+0000 7f13b2d7b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:24.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.518+0000 7f12677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:24.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.518+0000 7f13b2d7b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:24.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.518+0000 7f13b2d7b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:24.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.518+0000 7f13b2d7b9c0 5 note: GC not initialized 2024-09-12T00:55:24.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.518+0000 7f12667e4640 20 reqs_thread_entry: start 2024-09-12T00:55:24.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.518+0000 7f13b2d7b9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:24.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.518+0000 7f13b2d7b9c0 20 Filter name: none 2024-09-12T00:55:24.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.518+0000 7f125f7fe640 20 reqs_thread_entry: start 2024-09-12T00:55:24.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.518+0000 7f13b2d7b9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:55:24.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.518+0000 7f13b2d7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.518+0000 7f13b2d7b9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:55:24.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.518+0000 7f13b2d7b9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:55:24.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.518+0000 7f13b2d7b9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:55:24.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.518+0000 7f13b2d7b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 : miss 2024-09-12T00:55:24.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.518+0000 7f13b2d7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:24.512 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.518+0000 7f13b2d7b9c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:55:24.512 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.518+0000 7f13b2d7b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 info.flags=0x17 2024-09-12T00:55:24.512 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.518+0000 7f13b2d7b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 to cache LRU end 2024-09-12T00:55:24.512 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.518+0000 7f13b2d7b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:24.512 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.518+0000 7f13b2d7b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:24.512 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.518+0000 7f13b2d7b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 2024-09-12T00:55:24.512 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.522+0000 7f13b2d7b9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 to be held by another RGW process; skipping for now 2024-09-12T00:55:24.513 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.522+0000 7f12677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:24.519 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.526+0000 7f13b2d7b9c0 20 remove_watcher() i=0 2024-09-12T00:55:24.519 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.526+0000 7f13b2d7b9c0 2 removed watcher, disabling cache 2024-09-12T00:55:24.521 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.530+0000 7f13b2d7b9c0 20 remove_watcher() i=1 2024-09-12T00:55:24.523 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.530+0000 7f13b2d7b9c0 20 remove_watcher() i=2 2024-09-12T00:55:24.525 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.534+0000 7f13b2d7b9c0 20 remove_watcher() i=3 2024-09-12T00:55:24.527 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.534+0000 7f13b2d7b9c0 20 remove_watcher() i=4 2024-09-12T00:55:24.528 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.538+0000 7f13b2d7b9c0 20 remove_watcher() i=5 2024-09-12T00:55:24.529 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.538+0000 7f13b2d7b9c0 20 remove_watcher() i=6 2024-09-12T00:55:24.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:24.538+0000 7f13b2d7b9c0 20 remove_watcher() i=7 2024-09-12T00:55:24.544 INFO:tasks.workunit.client.0.smithi070.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:55:54.555 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:55:54.592 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:54.592 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:54.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.645+0000 7f87221099c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:54.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.645+0000 7f87221099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:54.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.645+0000 7f87221099c0 20 realm 2024-09-12T00:55:54.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.645+0000 7f87221099c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:54.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.645+0000 7f87221099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:54.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.645+0000 7f87221099c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:54.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.645+0000 7f87221099c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:54.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.645+0000 7f87221099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:54.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.645+0000 7f87221099c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:54.640 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.649+0000 7f87221099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:54.640 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.649+0000 7f87221099c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:54.641 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.649+0000 7f87221099c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:54.641 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.649+0000 7f87221099c0 20 searching for the correct realm 2024-09-12T00:55:54.645 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.653+0000 7f8720410640 0 -- 172.21.15.70:0/34248480 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f8714102180 msgr2=0x7f87140fca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:55:54.862 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.869+0000 7f8720410640 0 -- 172.21.15.70:0/34248480 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f8714102180 msgr2=0x7f87140fca30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:54.874 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.881+0000 7f87221099c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:54.874 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.881+0000 7f87221099c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:54.874 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.881+0000 7f87221099c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:54.874 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.881+0000 7f87221099c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:54.874 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.881+0000 7f87221099c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:54.874 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.881+0000 7f87221099c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:54.874 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.881+0000 7f87221099c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:54.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.881+0000 7f87221099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:54.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.881+0000 7f87221099c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:54.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.881+0000 7f87221099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:54.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.881+0000 7f87221099c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:54.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.885+0000 7f87221099c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:54.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.885+0000 7f87221099c0 20 zone default found 2024-09-12T00:55:54.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.885+0000 7f87221099c0 4 Realm: () 2024-09-12T00:55:54.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.885+0000 7f87221099c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:54.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.885+0000 7f87221099c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:54.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.885+0000 7f87221099c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:54.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.885+0000 7f87221099c0 20 zonegroup default 2024-09-12T00:55:54.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.885+0000 7f87221099c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:54.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.885+0000 7f87221099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:54.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.885+0000 7f87221099c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:54.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.885+0000 7f87221099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:54.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.885+0000 7f87221099c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:54.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.885+0000 7f87221099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:54.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.885+0000 7f87221099c0 20 started sync module instance, tier type = 2024-09-12T00:55:54.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.885+0000 7f87221099c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:54.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.905+0000 7f87221099c0 20 add_watcher() i=0 2024-09-12T00:55:54.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.905+0000 7f87221099c0 20 add_watcher() i=1 2024-09-12T00:55:54.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.905+0000 7f87221099c0 20 add_watcher() i=2 2024-09-12T00:55:54.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.905+0000 7f87221099c0 20 add_watcher() i=3 2024-09-12T00:55:54.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.905+0000 7f87221099c0 20 add_watcher() i=4 2024-09-12T00:55:54.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.905+0000 7f87221099c0 20 add_watcher() i=5 2024-09-12T00:55:54.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.905+0000 7f87221099c0 20 add_watcher() i=6 2024-09-12T00:55:54.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.909+0000 7f87221099c0 20 add_watcher() i=7 2024-09-12T00:55:54.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.909+0000 7f87221099c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:54.905 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.913+0000 7f85d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:54.905 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.913+0000 7f87221099c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:54.905 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.913+0000 7f87221099c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:54.906 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.913+0000 7f87221099c0 5 note: GC not initialized 2024-09-12T00:55:54.906 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.913+0000 7f85d4fe1640 20 reqs_thread_entry: start 2024-09-12T00:55:54.906 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.913+0000 7f87221099c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:54.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.913+0000 7f87221099c0 20 Filter name: none 2024-09-12T00:55:54.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.913+0000 7f854e7fc640 20 reqs_thread_entry: start 2024-09-12T00:55:54.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.913+0000 7f87221099c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:55:54.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.913+0000 7f87221099c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:54.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.913+0000 7f87221099c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:55:54.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.913+0000 7f87221099c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:55:54.908 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.913+0000 7f87221099c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:55:54.908 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.913+0000 7f87221099c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 : miss 2024-09-12T00:55:54.908 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.913+0000 7f87221099c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:54.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.917+0000 7f87221099c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:55:54.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.917+0000 7f87221099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 info.flags=0x17 2024-09-12T00:55:54.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.917+0000 7f87221099c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 to cache LRU end 2024-09-12T00:55:54.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.917+0000 7f87221099c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:54.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.917+0000 7f87221099c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:54.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.917+0000 7f87221099c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 2024-09-12T00:55:54.910 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.917+0000 7f87221099c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:55:54.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.925+0000 7f87221099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 info.flags=0x17 2024-09-12T00:55:54.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.925+0000 7f87221099c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 to cache LRU end 2024-09-12T00:55:54.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.925+0000 7f87221099c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:54.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.925+0000 7f87221099c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28, ofs0, ns] 2024-09-12T00:55:54.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.925+0000 7f85feffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431604 cookie 94356409890464 notifier 6596 bl.length()=1023 2024-09-12T00:55:54.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.925+0000 7f85feffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 info.flags=0x17 2024-09-12T00:55:54.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.925+0000 7f85feffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 to cache LRU end 2024-09-12T00:55:54.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.925+0000 7f85feffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:54.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.925+0000 7f87221099c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28]): orig_sources= new_sources= 2024-09-12T00:55:54.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.925+0000 7f87221099c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28]): potential sources added=[] removed=[] 2024-09-12T00:55:54.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.925+0000 7f87221099c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28]): orig_dests= new_dests= 2024-09-12T00:55:54.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.925+0000 7f87221099c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28]): potential dests added=[] removed=[] 2024-09-12T00:55:54.924 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.933+0000 7f87221099c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28.2.0 2024-09-12T00:55:54.924 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.933+0000 7f87221099c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28.2.0 2024-09-12T00:55:54.925 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.933+0000 7f87221099c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28.2.1 2024-09-12T00:55:54.925 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.933+0000 7f87221099c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28.2.1 2024-09-12T00:55:54.925 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.933+0000 7f87221099c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28.0 2024-09-12T00:55:54.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.937+0000 7f87221099c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:55:54.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.937+0000 7f87221099c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 2024-09-12T00:55:54.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.937+0000 7f87221099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 info.flags=0x17 2024-09-12T00:55:54.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.937+0000 7f87221099c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 to cache LRU end 2024-09-12T00:55:54.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.937+0000 7f87221099c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:54.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.937+0000 7f87221099c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28, ofs0, ns] 2024-09-12T00:55:54.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.941+0000 7f85feffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431605 cookie 94356409890464 notifier 6596 bl.length()=1023 2024-09-12T00:55:54.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.941+0000 7f85feffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 info.flags=0x17 2024-09-12T00:55:54.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.941+0000 7f85feffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 to cache LRU end 2024-09-12T00:55:54.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.941+0000 7f85feffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:54.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.941+0000 7f87221099c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28]): orig_sources= new_sources= 2024-09-12T00:55:54.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.941+0000 7f87221099c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28]): potential sources added=[] removed=[] 2024-09-12T00:55:54.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.941+0000 7f87221099c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28]): orig_dests= new_dests= 2024-09-12T00:55:54.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.941+0000 7f87221099c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28]): potential dests added=[] removed=[] 2024-09-12T00:55:54.935 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.941+0000 7f87221099c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28.0 2024-09-12T00:55:54.937 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.945+0000 7f87221099c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:55:54.937 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.945+0000 7f87221099c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 2024-09-12T00:55:54.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.945+0000 7f87221099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 info.flags=0x17 2024-09-12T00:55:54.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.945+0000 7f87221099c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 to cache LRU end 2024-09-12T00:55:54.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.945+0000 7f87221099c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:54.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.945+0000 7f87221099c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28, ofs0, ns] 2024-09-12T00:55:54.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.945+0000 7f85feffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431606 cookie 94356409890464 notifier 6596 bl.length()=991 2024-09-12T00:55:54.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.945+0000 7f85feffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 info.flags=0x17 2024-09-12T00:55:54.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.945+0000 7f85feffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 to cache LRU end 2024-09-12T00:55:54.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.945+0000 7f85feffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:54.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.949+0000 7f87221099c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28]): orig_sources= new_sources= 2024-09-12T00:55:54.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.949+0000 7f87221099c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28]): potential sources added=[] removed=[] 2024-09-12T00:55:54.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.949+0000 7f87221099c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28]): orig_dests= new_dests= 2024-09-12T00:55:54.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.949+0000 7f87221099c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28]): potential dests added=[] removed=[] 2024-09-12T00:55:54.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.949+0000 7f87221099c0 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T00:55:54.946 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.953+0000 7f85d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:54.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.957+0000 7f87221099c0 20 remove_watcher() i=0 2024-09-12T00:55:54.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.957+0000 7f87221099c0 2 removed watcher, disabling cache 2024-09-12T00:55:54.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.961+0000 7f87221099c0 20 remove_watcher() i=1 2024-09-12T00:55:54.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.961+0000 7f87221099c0 20 remove_watcher() i=2 2024-09-12T00:55:54.957 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.965+0000 7f87221099c0 20 remove_watcher() i=3 2024-09-12T00:55:54.960 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.965+0000 7f87221099c0 20 remove_watcher() i=4 2024-09-12T00:55:54.961 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.969+0000 7f87221099c0 20 remove_watcher() i=5 2024-09-12T00:55:54.962 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.969+0000 7f87221099c0 20 remove_watcher() i=6 2024-09-12T00:55:54.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:54.973+0000 7f87221099c0 20 remove_watcher() i=7 2024-09-12T00:55:54.981 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:55:55.013 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:55.013 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:55.058 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.065+0000 7f367e53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:55.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.065+0000 7f367e53e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:55.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.065+0000 7f367e53e9c0 20 realm 2024-09-12T00:55:55.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.065+0000 7f367e53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:55.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.065+0000 7f367e53e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:55.061 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.065+0000 7f367e53e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:55.061 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.065+0000 7f367e53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:55.061 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.065+0000 7f367e53e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:55.061 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.065+0000 7f367e53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:55.062 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.069+0000 7f367e53e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:55.062 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.069+0000 7f367e53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:55.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.069+0000 7f367e53e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:55.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.069+0000 7f367e53e9c0 20 searching for the correct realm 2024-09-12T00:55:55.067 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.073+0000 7f367c845640 0 -- 172.21.15.70:0/319585311 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f366401e060 msgr2=0x7f366405b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:55:55.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.289+0000 7f367c845640 0 -- 172.21.15.70:0/319585311 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f366401e060 msgr2=0x7f366405b580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:55.293 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.301+0000 7f367e53e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:55.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.301+0000 7f367e53e9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:55.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.301+0000 7f367e53e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:55.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.301+0000 7f367e53e9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:55.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.301+0000 7f367e53e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:55.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.301+0000 7f367e53e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:55.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.301+0000 7f367e53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:55.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.301+0000 7f367e53e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:55.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.301+0000 7f367e53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:55.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.301+0000 7f367e53e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:55.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.301+0000 7f367e53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:55.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.305+0000 7f367e53e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:55.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.305+0000 7f367e53e9c0 20 zone default found 2024-09-12T00:55:55.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.305+0000 7f367e53e9c0 4 Realm: () 2024-09-12T00:55:55.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.305+0000 7f367e53e9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:55.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.305+0000 7f367e53e9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:55.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.305+0000 7f367e53e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:55.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.305+0000 7f367e53e9c0 20 zonegroup default 2024-09-12T00:55:55.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.305+0000 7f367e53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:55.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.305+0000 7f367e53e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:55.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.305+0000 7f367e53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:55.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.305+0000 7f367e53e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:55.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.305+0000 7f367e53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:55.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.305+0000 7f367e53e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:55.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.305+0000 7f367e53e9c0 20 started sync module instance, tier type = 2024-09-12T00:55:55.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.305+0000 7f367e53e9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:55.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.329+0000 7f367e53e9c0 20 add_watcher() i=0 2024-09-12T00:55:55.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.329+0000 7f367e53e9c0 20 add_watcher() i=1 2024-09-12T00:55:55.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.329+0000 7f367e53e9c0 20 add_watcher() i=2 2024-09-12T00:55:55.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.329+0000 7f367e53e9c0 20 add_watcher() i=3 2024-09-12T00:55:55.322 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.329+0000 7f367e53e9c0 20 add_watcher() i=4 2024-09-12T00:55:55.322 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.329+0000 7f367e53e9c0 20 add_watcher() i=5 2024-09-12T00:55:55.322 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.329+0000 7f367e53e9c0 20 add_watcher() i=6 2024-09-12T00:55:55.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.329+0000 7f367e53e9c0 20 add_watcher() i=7 2024-09-12T00:55:55.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.329+0000 7f367e53e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:55.327 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.333+0000 7f3532fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:55.327 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.333+0000 7f367e53e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:55.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.333+0000 7f367e53e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:55.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.333+0000 7f367e53e9c0 5 note: GC not initialized 2024-09-12T00:55:55.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.337+0000 7f3531fdb640 20 reqs_thread_entry: start 2024-09-12T00:55:55.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.337+0000 7f367e53e9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:55.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.337+0000 7f367e53e9c0 20 Filter name: none 2024-09-12T00:55:55.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.337+0000 7f34a37fe640 20 reqs_thread_entry: start 2024-09-12T00:55:55.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.337+0000 7f367e53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:55.330 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.337+0000 7f367e53e9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:55:55.330 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.337+0000 7f367e53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:55.332 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.337+0000 7f367e53e9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:55:55.332 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.337+0000 7f367e53e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:55.332 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.337+0000 7f367e53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:55.333 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.341+0000 7f367e53e9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:55:55.333 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.341+0000 7f367e53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:55.334 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.341+0000 7f367e53e9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:55:55.334 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.341+0000 7f367e53e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:55.336 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.345+0000 7f3532fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:55.341 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.349+0000 7f367e53e9c0 20 remove_watcher() i=0 2024-09-12T00:55:55.342 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.349+0000 7f367e53e9c0 2 removed watcher, disabling cache 2024-09-12T00:55:55.344 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.349+0000 7f367e53e9c0 20 remove_watcher() i=1 2024-09-12T00:55:55.346 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.353+0000 7f367e53e9c0 20 remove_watcher() i=2 2024-09-12T00:55:55.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.357+0000 7f367e53e9c0 20 remove_watcher() i=3 2024-09-12T00:55:55.350 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.357+0000 7f367e53e9c0 20 remove_watcher() i=4 2024-09-12T00:55:55.352 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.361+0000 7f367e53e9c0 20 remove_watcher() i=5 2024-09-12T00:55:55.353 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.361+0000 7f367e53e9c0 20 remove_watcher() i=6 2024-09-12T00:55:55.354 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.361+0000 7f367e53e9c0 20 remove_watcher() i=7 2024-09-12T00:55:55.369 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:55.369 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:55:55.369 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: abort-at-trim-reshard-log-entries id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:55:55.369 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:55.371 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:55.371 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:55.375 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:55.375 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:55.422 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:55.422 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:55.443 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-12T00:55:55.443 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:55.444 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:55.444 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:55.459 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:55.459 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:55.507 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:55.508 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:55.527 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:55.527 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:55.546 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:55.546 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:55.564 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:55.564 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:55.583 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:55.583 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:55.601 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:55.602 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:55.621 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:55.621 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:55.640 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:55.640 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:55.659 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:55.659 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:55.677 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:55.677 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:55.698 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:55.698 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:55.717 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:55.718 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:55.737 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:55.737 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:55.756 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:55.756 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:55.774 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:55.774 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:55.793 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:55.793 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:55.813 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:55.813 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:55.831 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:55.832 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:55.851 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:55.851 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:55.870 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:55.870 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:55.886 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:55:55.918 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:55.918 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:55.963 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.969+0000 7fa2148829c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:55.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.973+0000 7fa2148829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:55.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.973+0000 7fa2148829c0 20 realm 2024-09-12T00:55:55.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.973+0000 7fa2148829c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:55.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.973+0000 7fa2148829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:55.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.973+0000 7fa2148829c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:55.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.973+0000 7fa2148829c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:55.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.973+0000 7fa2148829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:55.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.973+0000 7fa2148829c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:55.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.973+0000 7fa2148829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:55.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.973+0000 7fa2148829c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:55.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.977+0000 7fa2148829c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:55.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.977+0000 7fa2148829c0 20 searching for the correct realm 2024-09-12T00:55:55.971 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:55.977+0000 7fa211b87640 0 -- 172.21.15.70:0/2131829027 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7fa204010040 msgr2=0x7fa2040669b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:55:56.183 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.189+0000 7fa212388640 0 -- 172.21.15.70:0/2131829027 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x55a0247af350 msgr2=0x7fa20c0f9e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:56.198 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.205+0000 7fa2148829c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:56.199 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.205+0000 7fa2148829c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:56.199 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.205+0000 7fa2148829c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:56.199 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.205+0000 7fa2148829c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:56.199 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.205+0000 7fa2148829c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:56.199 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.205+0000 7fa2148829c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:56.199 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.205+0000 7fa2148829c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.199 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.205+0000 7fa2148829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:56.199 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.205+0000 7fa2148829c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.205+0000 7fa2148829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:56.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.205+0000 7fa2148829c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.209+0000 7fa2148829c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:56.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.209+0000 7fa2148829c0 20 zone default found 2024-09-12T00:55:56.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.209+0000 7fa2148829c0 4 Realm: () 2024-09-12T00:55:56.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.209+0000 7fa2148829c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:56.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.209+0000 7fa2148829c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:56.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.209+0000 7fa2148829c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:56.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.209+0000 7fa2148829c0 20 zonegroup default 2024-09-12T00:55:56.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.209+0000 7fa2148829c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.209+0000 7fa2148829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:56.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.209+0000 7fa2148829c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.209+0000 7fa2148829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:56.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.209+0000 7fa2148829c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.209+0000 7fa2148829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:56.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.209+0000 7fa2148829c0 20 started sync module instance, tier type = 2024-09-12T00:55:56.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.209+0000 7fa2148829c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:56.224 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.229+0000 7fa2148829c0 20 add_watcher() i=0 2024-09-12T00:55:56.224 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.229+0000 7fa2148829c0 20 add_watcher() i=1 2024-09-12T00:55:56.224 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.229+0000 7fa2148829c0 20 add_watcher() i=2 2024-09-12T00:55:56.224 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.229+0000 7fa2148829c0 20 add_watcher() i=3 2024-09-12T00:55:56.224 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.229+0000 7fa2148829c0 20 add_watcher() i=4 2024-09-12T00:55:56.224 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.229+0000 7fa2148829c0 20 add_watcher() i=5 2024-09-12T00:55:56.224 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.229+0000 7fa2148829c0 20 add_watcher() i=6 2024-09-12T00:55:56.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.233+0000 7fa2148829c0 20 add_watcher() i=7 2024-09-12T00:55:56.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.233+0000 7fa2148829c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:56.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.237+0000 7fa0c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:56.230 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.237+0000 7fa2148829c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:56.230 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.237+0000 7fa2148829c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:56.230 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.237+0000 7fa2148829c0 5 note: GC not initialized 2024-09-12T00:55:56.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.237+0000 7fa0437fe640 20 reqs_thread_entry: start 2024-09-12T00:55:56.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.237+0000 7fa2148829c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:56.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.237+0000 7fa2148829c0 20 Filter name: none 2024-09-12T00:55:56.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.237+0000 7fa0417fa640 20 reqs_thread_entry: start 2024-09-12T00:55:56.232 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.237+0000 7fa2148829c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.232 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.241+0000 7fa2148829c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:55:56.232 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.241+0000 7fa2148829c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.233 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.241+0000 7fa2148829c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:55:56.233 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.241+0000 7fa2148829c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:56.233 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.241+0000 7fa2148829c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.241+0000 7fa2148829c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:55:56.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.241+0000 7fa2148829c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.241+0000 7fa2148829c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:55:56.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.241+0000 7fa2148829c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:56.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.245+0000 7fa0c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:56.241 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.249+0000 7fa2148829c0 20 remove_watcher() i=0 2024-09-12T00:55:56.241 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.249+0000 7fa2148829c0 2 removed watcher, disabling cache 2024-09-12T00:55:56.243 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.249+0000 7fa2148829c0 20 remove_watcher() i=1 2024-09-12T00:55:56.245 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.253+0000 7fa2148829c0 20 remove_watcher() i=2 2024-09-12T00:55:56.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.253+0000 7fa2148829c0 20 remove_watcher() i=3 2024-09-12T00:55:56.249 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.257+0000 7fa2148829c0 20 remove_watcher() i=4 2024-09-12T00:55:56.250 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.257+0000 7fa2148829c0 20 remove_watcher() i=5 2024-09-12T00:55:56.252 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.261+0000 7fa2148829c0 20 remove_watcher() i=6 2024-09-12T00:55:56.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.261+0000 7fa2148829c0 20 remove_watcher() i=7 2024-09-12T00:55:56.269 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:56.269 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:55:56.269 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-block-writes id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:55:56.269 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:56.270 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-12T00:55:56.302 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:56.303 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:56.346 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.353+0000 7f49068b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.347 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.353+0000 7f49068b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:56.347 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.353+0000 7f49068b39c0 20 realm 2024-09-12T00:55:56.347 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.353+0000 7f49068b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.353+0000 7f49068b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:56.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.353+0000 7f49068b39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:56.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.353+0000 7f49068b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.357+0000 7f49068b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:56.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.357+0000 7f49068b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.357+0000 7f49068b39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:56.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.357+0000 7f49068b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.350 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.357+0000 7f49068b39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:56.350 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.357+0000 7f49068b39c0 20 searching for the correct realm 2024-09-12T00:55:56.355 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.361+0000 7f4904bba640 0 -- 172.21.15.70:0/935015076 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f48f802a040 msgr2=0x7f48f800a4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:56.570 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.577+0000 7f4904bba640 0 -- 172.21.15.70:0/935015076 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f48f802a040 msgr2=0x7f48f800a4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:56.581 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.589+0000 7f49068b39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:56.581 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.589+0000 7f49068b39c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:56.581 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.589+0000 7f49068b39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:56.581 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.589+0000 7f49068b39c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:56.581 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.589+0000 7f49068b39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:56.581 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.589+0000 7f49068b39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:56.581 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.589+0000 7f49068b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.582 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.589+0000 7f49068b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:56.582 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.589+0000 7f49068b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.583 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.589+0000 7f49068b39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:56.583 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.589+0000 7f49068b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.584 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.589+0000 7f49068b39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:56.584 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.589+0000 7f49068b39c0 20 zone default found 2024-09-12T00:55:56.584 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.589+0000 7f49068b39c0 4 Realm: () 2024-09-12T00:55:56.584 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.589+0000 7f49068b39c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:56.584 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.589+0000 7f49068b39c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:56.584 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.589+0000 7f49068b39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:56.584 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.589+0000 7f49068b39c0 20 zonegroup default 2024-09-12T00:55:56.584 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.589+0000 7f49068b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.593+0000 7f49068b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:56.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.593+0000 7f49068b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.593+0000 7f49068b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:56.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.593+0000 7f49068b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.593+0000 7f49068b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:56.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.593+0000 7f49068b39c0 20 started sync module instance, tier type = 2024-09-12T00:55:56.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.593+0000 7f49068b39c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:56.607 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.613+0000 7f49068b39c0 20 add_watcher() i=0 2024-09-12T00:55:56.607 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.613+0000 7f49068b39c0 20 add_watcher() i=1 2024-09-12T00:55:56.607 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.613+0000 7f49068b39c0 20 add_watcher() i=2 2024-09-12T00:55:56.607 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.613+0000 7f49068b39c0 20 add_watcher() i=3 2024-09-12T00:55:56.607 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.613+0000 7f49068b39c0 20 add_watcher() i=4 2024-09-12T00:55:56.607 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.613+0000 7f49068b39c0 20 add_watcher() i=5 2024-09-12T00:55:56.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.613+0000 7f49068b39c0 20 add_watcher() i=6 2024-09-12T00:55:56.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.617+0000 7f49068b39c0 20 add_watcher() i=7 2024-09-12T00:55:56.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.617+0000 7f49068b39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:56.612 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.621+0000 7f47bafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:56.613 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.621+0000 7f49068b39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:56.613 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.621+0000 7f49068b39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:56.613 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.621+0000 7f49068b39c0 5 note: GC not initialized 2024-09-12T00:55:56.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.621+0000 7f47b9fdb640 20 reqs_thread_entry: start 2024-09-12T00:55:56.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.621+0000 7f49068b39c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:56.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.621+0000 7f49068b39c0 20 Filter name: none 2024-09-12T00:55:56.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.621+0000 7f472b7fe640 20 reqs_thread_entry: start 2024-09-12T00:55:56.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.621+0000 7f49068b39c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T00:55:56.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.621+0000 7f49068b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.616 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.625+0000 7f49068b39c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:55:56.616 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.625+0000 7f49068b39c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T00:55:56.616 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.625+0000 7f49068b39c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T00:55:56.616 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.625+0000 7f49068b39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 : miss 2024-09-12T00:55:56.616 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.625+0000 7f49068b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.617 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.625+0000 7f49068b39c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:55:56.617 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.625+0000 7f49068b39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 info.flags=0x17 2024-09-12T00:55:56.617 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.625+0000 7f49068b39c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 to cache LRU end 2024-09-12T00:55:56.617 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.625+0000 7f49068b39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:56.618 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.625+0000 7f49068b39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:56.618 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.625+0000 7f49068b39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 2024-09-12T00:55:56.624 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.633+0000 7f49068b39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 info.flags=0x17 2024-09-12T00:55:56.624 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.633+0000 7f49068b39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 to cache LRU end 2024-09-12T00:55:56.624 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.633+0000 7f49068b39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:56.624 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.633+0000 7f49068b39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29, ofs0, ns] 2024-09-12T00:55:56.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.633+0000 7f47db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431609 cookie 94473976890960 notifier 7044 bl.length()=999 2024-09-12T00:55:56.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.633+0000 7f47db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 info.flags=0x17 2024-09-12T00:55:56.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.633+0000 7f47db7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 to cache LRU end 2024-09-12T00:55:56.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.633+0000 7f47db7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:56.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.633+0000 7f49068b39c0 20 handle_bi_update(): bucket=:error-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29]): orig_sources= new_sources= 2024-09-12T00:55:56.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.633+0000 7f49068b39c0 20 handle_bi_update(): bucket=:error-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29]): potential sources added=[] removed=[] 2024-09-12T00:55:56.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.633+0000 7f49068b39c0 20 handle_bi_update(): bucket=:error-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29]): orig_dests= new_dests= 2024-09-12T00:55:56.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.633+0000 7f49068b39c0 20 handle_bi_update(): bucket=:error-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29]): potential dests added=[] removed=[] 2024-09-12T00:55:56.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.637+0000 7f49068b39c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29.1.0 2024-09-12T00:55:56.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.637+0000 7f49068b39c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29.1.0 2024-09-12T00:55:56.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.637+0000 7f49068b39c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29.1.1 2024-09-12T00:55:56.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.637+0000 7f49068b39c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29.1.1 2024-09-12T00:55:56.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.637+0000 7f49068b39c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29.0 2024-09-12T00:55:56.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.641+0000 7f49068b39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:55:56.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.641+0000 7f49068b39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 2024-09-12T00:55:56.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.645+0000 7f49068b39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 info.flags=0x17 2024-09-12T00:55:56.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.645+0000 7f49068b39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 to cache LRU end 2024-09-12T00:55:56.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.645+0000 7f49068b39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:56.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.645+0000 7f49068b39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29, ofs0, ns] 2024-09-12T00:55:56.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.645+0000 7f47db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431610 cookie 94473976890960 notifier 7044 bl.length()=999 2024-09-12T00:55:56.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.645+0000 7f47db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 info.flags=0x17 2024-09-12T00:55:56.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.645+0000 7f47db7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 to cache LRU end 2024-09-12T00:55:56.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.645+0000 7f47db7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:56.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.645+0000 7f49068b39c0 20 handle_bi_update(): bucket=:error-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29]): orig_sources= new_sources= 2024-09-12T00:55:56.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.645+0000 7f49068b39c0 20 handle_bi_update(): bucket=:error-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29]): potential sources added=[] removed=[] 2024-09-12T00:55:56.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.645+0000 7f49068b39c0 20 handle_bi_update(): bucket=:error-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29]): orig_dests= new_dests= 2024-09-12T00:55:56.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.645+0000 7f49068b39c0 20 handle_bi_update(): bucket=:error-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29]): potential dests added=[] removed=[] 2024-09-12T00:55:56.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.645+0000 7f49068b39c0 -1 Injecting error=-5 at location=block_writes 2024-09-12T00:55:56.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.645+0000 7f49068b39c0 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-12T00:55:56.642 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.649+0000 7f49068b39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:55:56.642 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.649+0000 7f49068b39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 2024-09-12T00:55:56.645 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.653+0000 7f49068b39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 info.flags=0x17 2024-09-12T00:55:56.645 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.653+0000 7f49068b39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 to cache LRU end 2024-09-12T00:55:56.645 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.653+0000 7f49068b39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:56.645 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.653+0000 7f49068b39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29, ofs0, ns] 2024-09-12T00:55:56.646 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.653+0000 7f47db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431611 cookie 94473976890960 notifier 7044 bl.length()=967 2024-09-12T00:55:56.646 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.653+0000 7f47db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 info.flags=0x17 2024-09-12T00:55:56.646 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.653+0000 7f47db7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 to cache LRU end 2024-09-12T00:55:56.646 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.653+0000 7f47db7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:56.646 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.653+0000 7f49068b39c0 20 handle_bi_update(): bucket=:error-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29]): orig_sources= new_sources= 2024-09-12T00:55:56.646 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.653+0000 7f49068b39c0 20 handle_bi_update(): bucket=:error-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29]): potential sources added=[] removed=[] 2024-09-12T00:55:56.646 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.653+0000 7f49068b39c0 20 handle_bi_update(): bucket=:error-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29]): orig_dests= new_dests= 2024-09-12T00:55:56.647 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.653+0000 7f49068b39c0 20 handle_bi_update(): bucket=:error-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29]): potential dests added=[] removed=[] 2024-09-12T00:55:56.648 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.657+0000 7f49068b39c0 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-12T00:55:56.651 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.657+0000 7f47bafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:56.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.665+0000 7f49068b39c0 20 remove_watcher() i=0 2024-09-12T00:55:56.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.665+0000 7f49068b39c0 2 removed watcher, disabling cache 2024-09-12T00:55:56.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.665+0000 7f49068b39c0 20 remove_watcher() i=1 2024-09-12T00:55:56.661 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.669+0000 7f49068b39c0 20 remove_watcher() i=2 2024-09-12T00:55:56.663 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.669+0000 7f49068b39c0 20 remove_watcher() i=3 2024-09-12T00:55:56.665 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.673+0000 7f49068b39c0 20 remove_watcher() i=4 2024-09-12T00:55:56.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.673+0000 7f49068b39c0 20 remove_watcher() i=5 2024-09-12T00:55:56.668 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.677+0000 7f49068b39c0 20 remove_watcher() i=6 2024-09-12T00:55:56.670 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.677+0000 7f49068b39c0 20 remove_watcher() i=7 2024-09-12T00:55:56.694 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:55:56.725 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:56.726 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:56.770 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.777+0000 7f13a82749c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.772 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.781+0000 7f13a82749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:56.772 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.781+0000 7f13a82749c0 20 realm 2024-09-12T00:55:56.772 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.781+0000 7f13a82749c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.772 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.781+0000 7f13a82749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:56.772 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.781+0000 7f13a82749c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:56.773 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.781+0000 7f13a82749c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.773 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.781+0000 7f13a82749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:56.773 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.781+0000 7f13a82749c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.774 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.781+0000 7f13a82749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:56.774 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.781+0000 7f13a82749c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.775 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.781+0000 7f13a82749c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:56.775 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.781+0000 7f13a82749c0 20 searching for the correct realm 2024-09-12T00:55:56.780 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.785+0000 7f13a657b640 0 -- 172.21.15.70:0/430075221 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f1390086710 msgr2=0x7f13900646e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:56.787 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.793+0000 7f13a657b640 0 -- 172.21.15.70:0/430075221 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f12700808b0 msgr2=0x7f1270082d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:56.794 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.801+0000 7f13a82749c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:56.794 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.801+0000 7f13a82749c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:56.794 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.801+0000 7f13a82749c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:56.794 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.801+0000 7f13a82749c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:56.794 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.801+0000 7f13a82749c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:56.794 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.801+0000 7f13a82749c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:56.794 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.801+0000 7f13a82749c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.794 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.801+0000 7f13a82749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:56.794 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.801+0000 7f13a82749c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.795 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.801+0000 7f13a82749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:56.795 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.801+0000 7f13a82749c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.795 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.801+0000 7f13a82749c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:56.795 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.801+0000 7f13a82749c0 20 zone default found 2024-09-12T00:55:56.796 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.801+0000 7f13a82749c0 4 Realm: () 2024-09-12T00:55:56.796 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.801+0000 7f13a82749c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:56.796 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.801+0000 7f13a82749c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:56.796 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.801+0000 7f13a82749c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:56.796 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.801+0000 7f13a82749c0 20 zonegroup default 2024-09-12T00:55:56.796 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.801+0000 7f13a82749c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.796 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.801+0000 7f13a82749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:56.796 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.801+0000 7f13a82749c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.797 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.805+0000 7f13a82749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:56.797 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.805+0000 7f13a82749c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.797 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.805+0000 7f13a82749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:56.797 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.805+0000 7f13a82749c0 20 started sync module instance, tier type = 2024-09-12T00:55:56.797 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.805+0000 7f13a82749c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:56.811 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.817+0000 7f13a82749c0 20 add_watcher() i=0 2024-09-12T00:55:56.812 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.817+0000 7f13a82749c0 20 add_watcher() i=1 2024-09-12T00:55:56.812 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.817+0000 7f13a82749c0 20 add_watcher() i=2 2024-09-12T00:55:56.812 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.817+0000 7f13a82749c0 20 add_watcher() i=3 2024-09-12T00:55:56.812 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.817+0000 7f13a82749c0 20 add_watcher() i=4 2024-09-12T00:55:56.812 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.817+0000 7f13a82749c0 20 add_watcher() i=5 2024-09-12T00:55:56.812 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.817+0000 7f13a82749c0 20 add_watcher() i=6 2024-09-12T00:55:56.813 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.821+0000 7f13a82749c0 20 add_watcher() i=7 2024-09-12T00:55:56.813 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.821+0000 7f13a82749c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:56.814 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.821+0000 7f12577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:56.815 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.821+0000 7f13a82749c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:56.816 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.821+0000 7f13a82749c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:56.816 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.821+0000 7f13a82749c0 5 note: GC not initialized 2024-09-12T00:55:56.816 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.821+0000 7f12567fc640 20 reqs_thread_entry: start 2024-09-12T00:55:56.816 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.821+0000 7f13a82749c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:56.816 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.821+0000 7f13a82749c0 20 Filter name: none 2024-09-12T00:55:56.816 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.821+0000 7f11c7fff640 20 reqs_thread_entry: start 2024-09-12T00:55:56.816 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.821+0000 7f13a82749c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.816 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.825+0000 7f13a82749c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:55:56.817 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.825+0000 7f13a82749c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.817 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.825+0000 7f13a82749c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:55:56.817 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.825+0000 7f13a82749c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:56.817 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.825+0000 7f13a82749c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.818 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.825+0000 7f13a82749c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:55:56.818 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.825+0000 7f13a82749c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:56.818 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.825+0000 7f13a82749c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:55:56.818 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.825+0000 7f13a82749c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:56.819 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.825+0000 7f12577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:56.825 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.833+0000 7f13a82749c0 20 remove_watcher() i=0 2024-09-12T00:55:56.825 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.833+0000 7f13a82749c0 2 removed watcher, disabling cache 2024-09-12T00:55:56.828 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.833+0000 7f13a82749c0 20 remove_watcher() i=1 2024-09-12T00:55:56.829 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.837+0000 7f13a82749c0 20 remove_watcher() i=2 2024-09-12T00:55:56.831 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.837+0000 7f13a82749c0 20 remove_watcher() i=3 2024-09-12T00:55:56.833 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.841+0000 7f13a82749c0 20 remove_watcher() i=4 2024-09-12T00:55:56.834 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.841+0000 7f13a82749c0 20 remove_watcher() i=5 2024-09-12T00:55:56.835 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.841+0000 7f13a82749c0 20 remove_watcher() i=6 2024-09-12T00:55:56.837 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:56.845+0000 7f13a82749c0 20 remove_watcher() i=7 2024-09-12T00:55:56.850 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:56.850 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:55:56.850 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-block-writes id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:55:56.850 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:56.851 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:56.851 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:56.862 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:56.862 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:56.905 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:55:56.941 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:56.941 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:57.185 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.193+0000 7fbf91746640 0 --2- 172.21.15.70:0/2547085258 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x56268c6734c0 0x56268c643150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:55:57.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.201+0000 7fbf93c409c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.195 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.201+0000 7fbf93c409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:57.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.201+0000 7fbf93c409c0 20 realm 2024-09-12T00:55:57.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.201+0000 7fbf93c409c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.205+0000 7fbf93c409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:57.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.205+0000 7fbf93c409c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:57.197 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.205+0000 7fbf93c409c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.197 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.205+0000 7fbf93c409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:57.197 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.205+0000 7fbf93c409c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.198 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.205+0000 7fbf93c409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:57.198 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.205+0000 7fbf93c409c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.199 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.205+0000 7fbf93c409c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:57.199 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.205+0000 7fbf93c409c0 20 searching for the correct realm 2024-09-12T00:55:57.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.209+0000 7fbf90f45640 0 -- 172.21.15.70:0/346429640 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7fbf840ce040 msgr2=0x7fbf840e0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:57.416 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.425+0000 7fbf91746640 0 -- 172.21.15.70:0/346429640 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7fbf8c026040 msgr2=0x7fbf8c017410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:57.433 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.441+0000 7fbf93c409c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:57.433 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.441+0000 7fbf93c409c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:57.433 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.441+0000 7fbf93c409c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:57.433 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.441+0000 7fbf93c409c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:57.433 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.441+0000 7fbf93c409c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:57.433 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.441+0000 7fbf93c409c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:57.433 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.441+0000 7fbf93c409c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.441+0000 7fbf93c409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:57.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.441+0000 7fbf93c409c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.441+0000 7fbf93c409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:57.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.441+0000 7fbf93c409c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.441+0000 7fbf93c409c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:57.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.441+0000 7fbf93c409c0 20 zone default found 2024-09-12T00:55:57.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.441+0000 7fbf93c409c0 4 Realm: () 2024-09-12T00:55:57.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.441+0000 7fbf93c409c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:57.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.441+0000 7fbf93c409c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:57.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.441+0000 7fbf93c409c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:57.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.441+0000 7fbf93c409c0 20 zonegroup default 2024-09-12T00:55:57.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.441+0000 7fbf93c409c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.441+0000 7fbf93c409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:57.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.441+0000 7fbf93c409c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.445+0000 7fbf93c409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:57.437 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.445+0000 7fbf93c409c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.437 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.445+0000 7fbf93c409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:57.437 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.445+0000 7fbf93c409c0 20 started sync module instance, tier type = 2024-09-12T00:55:57.437 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.445+0000 7fbf93c409c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:57.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.469+0000 7fbf93c409c0 20 add_watcher() i=0 2024-09-12T00:55:57.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.469+0000 7fbf93c409c0 20 add_watcher() i=1 2024-09-12T00:55:57.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.469+0000 7fbf93c409c0 20 add_watcher() i=2 2024-09-12T00:55:57.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.469+0000 7fbf93c409c0 20 add_watcher() i=3 2024-09-12T00:55:57.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.469+0000 7fbf93c409c0 20 add_watcher() i=4 2024-09-12T00:55:57.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.469+0000 7fbf93c409c0 20 add_watcher() i=5 2024-09-12T00:55:57.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.469+0000 7fbf93c409c0 20 add_watcher() i=6 2024-09-12T00:55:57.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.469+0000 7fbf93c409c0 20 add_watcher() i=7 2024-09-12T00:55:57.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.469+0000 7fbf93c409c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:57.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.473+0000 7fbe477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:57.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.473+0000 7fbf93c409c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:57.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.473+0000 7fbf93c409c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:57.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.473+0000 7fbf93c409c0 5 note: GC not initialized 2024-09-12T00:55:57.468 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.473+0000 7fbe467e4640 20 reqs_thread_entry: start 2024-09-12T00:55:57.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.473+0000 7fbf93c409c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:57.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.477+0000 7fbf93c409c0 20 Filter name: none 2024-09-12T00:55:57.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.477+0000 7fbdb7fff640 20 reqs_thread_entry: start 2024-09-12T00:55:57.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.477+0000 7fbf93c409c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T00:55:57.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.477+0000 7fbf93c409c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.477+0000 7fbf93c409c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:55:57.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.477+0000 7fbf93c409c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T00:55:57.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.477+0000 7fbf93c409c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T00:55:57.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.477+0000 7fbf93c409c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 : miss 2024-09-12T00:55:57.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.477+0000 7fbf93c409c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.477+0000 7fbf93c409c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:55:57.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.477+0000 7fbf93c409c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 info.flags=0x17 2024-09-12T00:55:57.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.477+0000 7fbf93c409c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 to cache LRU end 2024-09-12T00:55:57.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.477+0000 7fbf93c409c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:57.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.477+0000 7fbf93c409c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:57.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.477+0000 7fbf93c409c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 2024-09-12T00:55:57.478 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.485+0000 7fbf93c409c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 info.flags=0x17 2024-09-12T00:55:57.478 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.485+0000 7fbf93c409c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 to cache LRU end 2024-09-12T00:55:57.478 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.485+0000 7fbf93c409c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:57.479 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.485+0000 7fbf93c409c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29, ofs0, ns] 2024-09-12T00:55:57.479 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.485+0000 7fbe74ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431612 cookie 94723564510192 notifier 7083 bl.length()=999 2024-09-12T00:55:57.479 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.485+0000 7fbe74ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 info.flags=0x17 2024-09-12T00:55:57.479 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.485+0000 7fbe74ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 to cache LRU end 2024-09-12T00:55:57.479 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.485+0000 7fbe74ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:57.480 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.485+0000 7fbf93c409c0 20 handle_bi_update(): bucket=:error-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29]): orig_sources= new_sources= 2024-09-12T00:55:57.480 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.485+0000 7fbf93c409c0 20 handle_bi_update(): bucket=:error-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29]): potential sources added=[] removed=[] 2024-09-12T00:55:57.480 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.485+0000 7fbf93c409c0 20 handle_bi_update(): bucket=:error-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29]): orig_dests= new_dests= 2024-09-12T00:55:57.480 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.485+0000 7fbf93c409c0 20 handle_bi_update(): bucket=:error-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29]): potential dests added=[] removed=[] 2024-09-12T00:55:57.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.489+0000 7fbf93c409c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29.1.0 2024-09-12T00:55:57.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.489+0000 7fbf93c409c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29.1.0 2024-09-12T00:55:57.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.489+0000 7fbf93c409c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29.1.1 2024-09-12T00:55:57.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.489+0000 7fbf93c409c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29.1.1 2024-09-12T00:55:57.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.489+0000 7fbf93c409c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29.0 2024-09-12T00:55:57.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.497+0000 7fbf93c409c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:55:57.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.497+0000 7fbf93c409c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 2024-09-12T00:55:57.490 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.497+0000 7fbf93c409c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 info.flags=0x17 2024-09-12T00:55:57.490 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.497+0000 7fbf93c409c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 to cache LRU end 2024-09-12T00:55:57.490 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.497+0000 7fbf93c409c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:57.491 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.497+0000 7fbf93c409c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29, ofs0, ns] 2024-09-12T00:55:57.491 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.497+0000 7fbe74ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431613 cookie 94723564510192 notifier 7083 bl.length()=999 2024-09-12T00:55:57.491 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.497+0000 7fbe74ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 info.flags=0x17 2024-09-12T00:55:57.491 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.497+0000 7fbe74ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 to cache LRU end 2024-09-12T00:55:57.491 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.497+0000 7fbe74ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:57.491 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.497+0000 7fbf93c409c0 20 handle_bi_update(): bucket=:error-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29]): orig_sources= new_sources= 2024-09-12T00:55:57.492 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.497+0000 7fbf93c409c0 20 handle_bi_update(): bucket=:error-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29]): potential sources added=[] removed=[] 2024-09-12T00:55:57.492 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.497+0000 7fbf93c409c0 20 handle_bi_update(): bucket=:error-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29]): orig_dests= new_dests= 2024-09-12T00:55:57.492 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.497+0000 7fbf93c409c0 20 handle_bi_update(): bucket=:error-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29]): potential dests added=[] removed=[] 2024-09-12T00:55:57.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.501+0000 7fbf93c409c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29.0 2024-09-12T00:55:57.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.501+0000 7fbf93c409c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:55:57.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.501+0000 7fbf93c409c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 2024-09-12T00:55:57.496 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.505+0000 7fbf93c409c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 info.flags=0x17 2024-09-12T00:55:57.497 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.505+0000 7fbf93c409c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 to cache LRU end 2024-09-12T00:55:57.497 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.505+0000 7fbf93c409c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:57.497 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.505+0000 7fbf93c409c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29, ofs0, ns] 2024-09-12T00:55:57.497 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.505+0000 7fbe63fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431614 cookie 94723564510192 notifier 7083 bl.length()=967 2024-09-12T00:55:57.497 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.505+0000 7fbe63fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 info.flags=0x17 2024-09-12T00:55:57.497 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.505+0000 7fbe63fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 to cache LRU end 2024-09-12T00:55:57.497 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.505+0000 7fbe63fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:57.498 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.505+0000 7fbf93c409c0 20 handle_bi_update(): bucket=:error-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29]): orig_sources= new_sources= 2024-09-12T00:55:57.498 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.505+0000 7fbf93c409c0 20 handle_bi_update(): bucket=:error-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29]): potential sources added=[] removed=[] 2024-09-12T00:55:57.498 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.505+0000 7fbf93c409c0 20 handle_bi_update(): bucket=:error-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29]): orig_dests= new_dests= 2024-09-12T00:55:57.498 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.505+0000 7fbf93c409c0 20 handle_bi_update(): bucket=:error-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29]): potential dests added=[] removed=[] 2024-09-12T00:55:57.500 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.509+0000 7fbf93c409c0 1 execute INFO: reshard of bucket "error-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:55:57.504 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.509+0000 7fbe477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:57.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.517+0000 7fbf93c409c0 20 remove_watcher() i=0 2024-09-12T00:55:57.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.517+0000 7fbf93c409c0 2 removed watcher, disabling cache 2024-09-12T00:55:57.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.517+0000 7fbf93c409c0 20 remove_watcher() i=1 2024-09-12T00:55:57.513 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.521+0000 7fbf93c409c0 20 remove_watcher() i=2 2024-09-12T00:55:57.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.521+0000 7fbf93c409c0 20 remove_watcher() i=3 2024-09-12T00:55:57.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.525+0000 7fbf93c409c0 20 remove_watcher() i=4 2024-09-12T00:55:57.519 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.525+0000 7fbf93c409c0 20 remove_watcher() i=5 2024-09-12T00:55:57.520 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.529+0000 7fbf93c409c0 20 remove_watcher() i=6 2024-09-12T00:55:57.521 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.529+0000 7fbf93c409c0 20 remove_watcher() i=7 2024-09-12T00:55:57.537 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:55:57.568 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:57.568 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:57.610 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.617+0000 7ff9943ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.612 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.621+0000 7ff9943ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:57.613 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.621+0000 7ff9943ad9c0 20 realm 2024-09-12T00:55:57.613 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.621+0000 7ff9943ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.613 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.621+0000 7ff9943ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:57.613 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.621+0000 7ff9943ad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:57.613 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.621+0000 7ff9943ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.613 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.621+0000 7ff9943ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:57.613 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.621+0000 7ff9943ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.621+0000 7ff9943ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:57.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.621+0000 7ff9943ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.621+0000 7ff9943ad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:57.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.621+0000 7ff9943ad9c0 20 searching for the correct realm 2024-09-12T00:55:57.621 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.629+0000 7ff991eb3640 0 -- 172.21.15.70:0/3113302193 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7ff98c01c910 msgr2=0x7ff98c00e3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:57.628 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.637+0000 7ff991eb3640 0 -- 172.21.15.70:0/3113302193 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7ff98c02a3a0 msgr2=0x7ff98c02a820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:57.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.641+0000 7ff9943ad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:57.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.641+0000 7ff9943ad9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:57.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.641+0000 7ff9943ad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:57.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.641+0000 7ff9943ad9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:57.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.641+0000 7ff9943ad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:57.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.641+0000 7ff9943ad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:57.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.641+0000 7ff9943ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.641+0000 7ff9943ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:57.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.641+0000 7ff9943ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.636 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.641+0000 7ff9943ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:57.636 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.641+0000 7ff9943ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.636 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.641+0000 7ff9943ad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:57.636 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.641+0000 7ff9943ad9c0 20 zone default found 2024-09-12T00:55:57.636 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.641+0000 7ff9943ad9c0 4 Realm: () 2024-09-12T00:55:57.636 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.641+0000 7ff9943ad9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:57.636 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.641+0000 7ff9943ad9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:57.636 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.641+0000 7ff9943ad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:57.636 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.641+0000 7ff9943ad9c0 20 zonegroup default 2024-09-12T00:55:57.636 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.641+0000 7ff9943ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.636 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.641+0000 7ff9943ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:57.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.641+0000 7ff9943ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.645+0000 7ff9943ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:57.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.645+0000 7ff9943ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.645+0000 7ff9943ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:57.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.645+0000 7ff9943ad9c0 20 started sync module instance, tier type = 2024-09-12T00:55:57.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.645+0000 7ff9943ad9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:57.651 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.657+0000 7ff9943ad9c0 20 add_watcher() i=0 2024-09-12T00:55:57.651 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.657+0000 7ff9943ad9c0 20 add_watcher() i=1 2024-09-12T00:55:57.651 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.657+0000 7ff9943ad9c0 20 add_watcher() i=2 2024-09-12T00:55:57.651 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.657+0000 7ff9943ad9c0 20 add_watcher() i=3 2024-09-12T00:55:57.652 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.657+0000 7ff9943ad9c0 20 add_watcher() i=4 2024-09-12T00:55:57.652 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.657+0000 7ff9943ad9c0 20 add_watcher() i=5 2024-09-12T00:55:57.652 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.657+0000 7ff9943ad9c0 20 add_watcher() i=6 2024-09-12T00:55:57.652 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.661+0000 7ff9943ad9c0 20 add_watcher() i=7 2024-09-12T00:55:57.652 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.661+0000 7ff9943ad9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:57.654 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.661+0000 7ff8437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:57.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.661+0000 7ff9943ad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:57.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.661+0000 7ff9943ad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:57.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.661+0000 7ff9943ad9c0 5 note: GC not initialized 2024-09-12T00:55:57.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.661+0000 7ff8427fc640 20 reqs_thread_entry: start 2024-09-12T00:55:57.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.661+0000 7ff9943ad9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:57.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.661+0000 7ff9943ad9c0 20 Filter name: none 2024-09-12T00:55:57.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.661+0000 7ff7b3fff640 20 reqs_thread_entry: start 2024-09-12T00:55:57.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.661+0000 7ff9943ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.665+0000 7ff9943ad9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:55:57.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.665+0000 7ff9943ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.665+0000 7ff9943ad9c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:55:57.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.665+0000 7ff9943ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:57.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.665+0000 7ff9943ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.665+0000 7ff9943ad9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:55:57.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.665+0000 7ff9943ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:57.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.665+0000 7ff9943ad9c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:55:57.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.665+0000 7ff9943ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:57.660 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.669+0000 7ff8437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:57.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.673+0000 7ff9943ad9c0 20 remove_watcher() i=0 2024-09-12T00:55:57.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.673+0000 7ff9943ad9c0 2 removed watcher, disabling cache 2024-09-12T00:55:57.666 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.673+0000 7ff9943ad9c0 20 remove_watcher() i=1 2024-09-12T00:55:57.668 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.677+0000 7ff9943ad9c0 20 remove_watcher() i=2 2024-09-12T00:55:57.670 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.677+0000 7ff9943ad9c0 20 remove_watcher() i=3 2024-09-12T00:55:57.672 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.681+0000 7ff9943ad9c0 20 remove_watcher() i=4 2024-09-12T00:55:57.673 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.681+0000 7ff9943ad9c0 20 remove_watcher() i=5 2024-09-12T00:55:57.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.681+0000 7ff9943ad9c0 20 remove_watcher() i=6 2024-09-12T00:55:57.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:57.681+0000 7ff9943ad9c0 20 remove_watcher() i=7 2024-09-12T00:55:57.689 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:57.689 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:55:57.689 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-block-writes id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:55:57.689 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:57.690 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:57.690 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:57.693 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:57.693 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:57.742 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:57.742 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:57.766 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: reshard bucket with abort at block_writes 2024-09-12T00:55:57.767 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:57.768 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:57.768 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:57.781 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:57.782 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:57.828 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:57.828 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:57.847 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:57.847 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:57.866 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:57.866 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:57.887 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:57.888 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:57.906 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:57.906 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:57.925 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:57.925 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:57.944 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:57.944 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:57.963 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:57.963 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:57.983 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:57.983 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:58.002 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:58.002 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:58.020 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:58.021 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:58.038 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:58.038 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:58.056 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:58.057 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:58.075 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:58.075 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:58.094 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:58.094 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:58.113 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:58.114 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:58.132 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:58.132 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:58.151 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:58.151 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:58.173 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:58.173 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:58.192 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:58.192 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:58.208 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:55:58.241 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:58.241 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:58.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.293+0000 7f300a16f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.293+0000 7f300a16f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.293+0000 7f300a16f9c0 20 realm 2024-09-12T00:55:58.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.293+0000 7f300a16f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.293+0000 7f300a16f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.293+0000 7f300a16f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:58.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.293+0000 7f300a16f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.288 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.293+0000 7f300a16f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.288 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.293+0000 7f300a16f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.297+0000 7f300a16f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:58.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.297+0000 7f300a16f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.290 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.297+0000 7f300a16f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:58.290 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.297+0000 7f300a16f9c0 20 searching for the correct realm 2024-09-12T00:55:58.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.301+0000 7f3008476640 0 -- 172.21.15.70:0/3344470674 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f2ff0008050 msgr2=0x7f2ff0064570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:58.302 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.309+0000 7f3008476640 0 -- 172.21.15.70:0/3344470674 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f2ed00808b0 msgr2=0x7f2ed0082d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:58.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.317+0000 7f300a16f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:58.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.317+0000 7f300a16f9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:58.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.317+0000 7f300a16f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:58.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.317+0000 7f300a16f9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:58.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.317+0000 7f300a16f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:58.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.317+0000 7f300a16f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:58.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.317+0000 7f300a16f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.317+0000 7f300a16f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.317+0000 7f300a16f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.311 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.317+0000 7f300a16f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:58.311 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.317+0000 7f300a16f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.311 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.317+0000 7f300a16f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:58.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.317+0000 7f300a16f9c0 20 zone default found 2024-09-12T00:55:58.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.317+0000 7f300a16f9c0 4 Realm: () 2024-09-12T00:55:58.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.317+0000 7f300a16f9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:58.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.317+0000 7f300a16f9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:58.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.317+0000 7f300a16f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:58.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.317+0000 7f300a16f9c0 20 zonegroup default 2024-09-12T00:55:58.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.317+0000 7f300a16f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.317+0000 7f300a16f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.317+0000 7f300a16f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.321+0000 7f300a16f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.321+0000 7f300a16f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.321+0000 7f300a16f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.321+0000 7f300a16f9c0 20 started sync module instance, tier type = 2024-09-12T00:55:58.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.321+0000 7f300a16f9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:58.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.337+0000 7f300a16f9c0 20 add_watcher() i=0 2024-09-12T00:55:58.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.337+0000 7f300a16f9c0 20 add_watcher() i=1 2024-09-12T00:55:58.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.337+0000 7f300a16f9c0 20 add_watcher() i=2 2024-09-12T00:55:58.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.337+0000 7f300a16f9c0 20 add_watcher() i=3 2024-09-12T00:55:58.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.337+0000 7f300a16f9c0 20 add_watcher() i=4 2024-09-12T00:55:58.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.337+0000 7f300a16f9c0 20 add_watcher() i=5 2024-09-12T00:55:58.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.337+0000 7f300a16f9c0 20 add_watcher() i=6 2024-09-12T00:55:58.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.337+0000 7f300a16f9c0 20 add_watcher() i=7 2024-09-12T00:55:58.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.337+0000 7f300a16f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:58.332 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.341+0000 7f2ebdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:58.333 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.341+0000 7f300a16f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:58.333 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.341+0000 7f300a16f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:58.333 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.341+0000 7f300a16f9c0 5 note: GC not initialized 2024-09-12T00:55:58.333 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.341+0000 7f2ebcfe1640 20 reqs_thread_entry: start 2024-09-12T00:55:58.333 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.341+0000 7f300a16f9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:58.333 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.341+0000 7f300a16f9c0 20 Filter name: none 2024-09-12T00:55:58.333 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.341+0000 7f2e367fc640 20 reqs_thread_entry: start 2024-09-12T00:55:58.334 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.341+0000 7f300a16f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.334 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.341+0000 7f300a16f9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:55:58.334 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.341+0000 7f300a16f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.335 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.341+0000 7f300a16f9c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:55:58.335 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.341+0000 7f300a16f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:58.335 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.341+0000 7f300a16f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.335 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.341+0000 7f300a16f9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:55:58.335 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.341+0000 7f300a16f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.335 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.341+0000 7f300a16f9c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:55:58.335 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.341+0000 7f300a16f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:58.336 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.345+0000 7f2ebdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:58.341 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.349+0000 7f300a16f9c0 20 remove_watcher() i=0 2024-09-12T00:55:58.341 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.349+0000 7f300a16f9c0 2 removed watcher, disabling cache 2024-09-12T00:55:58.343 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.349+0000 7f300a16f9c0 20 remove_watcher() i=1 2024-09-12T00:55:58.345 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.353+0000 7f300a16f9c0 20 remove_watcher() i=2 2024-09-12T00:55:58.347 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.353+0000 7f300a16f9c0 20 remove_watcher() i=3 2024-09-12T00:55:58.350 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.357+0000 7f300a16f9c0 20 remove_watcher() i=4 2024-09-12T00:55:58.350 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.357+0000 7f300a16f9c0 20 remove_watcher() i=5 2024-09-12T00:55:58.352 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.361+0000 7f300a16f9c0 20 remove_watcher() i=6 2024-09-12T00:55:58.353 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.361+0000 7f300a16f9c0 20 remove_watcher() i=7 2024-09-12T00:55:58.367 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.368 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:55:58.368 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: abort-at-block-writes id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:55:58.368 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.368 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-12T00:55:58.400 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:58.401 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:58.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.449+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.443 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.449+0000 7f30b2f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.443 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.449+0000 7f30b2f799c0 20 realm 2024-09-12T00:55:58.443 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.449+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.443 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.449+0000 7f30b2f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.444 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.449+0000 7f30b2f799c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:58.444 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.449+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.444 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.449+0000 7f30b2f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.444 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.449+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.445 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.453+0000 7f30b2f799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:58.445 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.453+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.446 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.453+0000 7f30b2f799c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:58.446 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.453+0000 7f30b2f799c0 20 searching for the correct realm 2024-09-12T00:55:58.451 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.457+0000 7f30b1280640 0 -- 172.21.15.70:0/233166351 >> [v2:172.21.15.70:6808/276433067,v1:172.21.15.70:6809/276433067] conn(0x563a58c558e0 msgr2=0x563a58c57da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:58.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.465+0000 7f30b0a7f640 0 -- 172.21.15.70:0/233166351 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f30a80c8040 msgr2=0x7f30a80c8930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:58.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:58.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:58.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:58.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:58.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:58.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:58.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:58.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:58.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 zone default found 2024-09-12T00:55:58.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.473+0000 7f30b2f799c0 4 Realm: () 2024-09-12T00:55:58.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.473+0000 7f30b2f799c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:58.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.473+0000 7f30b2f799c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:58.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.473+0000 7f30b2f799c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:58.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 zonegroup default 2024-09-12T00:55:58.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 started sync module instance, tier type = 2024-09-12T00:55:58.468 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:58.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.489+0000 7f30b2f799c0 20 add_watcher() i=0 2024-09-12T00:55:58.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.489+0000 7f30b2f799c0 20 add_watcher() i=1 2024-09-12T00:55:58.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.489+0000 7f30b2f799c0 20 add_watcher() i=2 2024-09-12T00:55:58.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.489+0000 7f30b2f799c0 20 add_watcher() i=3 2024-09-12T00:55:58.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.489+0000 7f30b2f799c0 20 add_watcher() i=4 2024-09-12T00:55:58.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.489+0000 7f30b2f799c0 20 add_watcher() i=5 2024-09-12T00:55:58.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.489+0000 7f30b2f799c0 20 add_watcher() i=6 2024-09-12T00:55:58.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.489+0000 7f30b2f799c0 20 add_watcher() i=7 2024-09-12T00:55:58.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.489+0000 7f30b2f799c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:58.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.493+0000 7f2f66fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:58.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.493+0000 7f30b2f799c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:58.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.493+0000 7f30b2f799c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:58.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 note: GC not initialized 2024-09-12T00:55:58.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.493+0000 7f2f65fe3640 20 reqs_thread_entry: start 2024-09-12T00:55:58.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.493+0000 7f30b2f799c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:58.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.493+0000 7f30b2f799c0 20 Filter name: none 2024-09-12T00:55:58.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.493+0000 7f2ed77fe640 20 reqs_thread_entry: start 2024-09-12T00:55:58.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.493+0000 7f30b2f799c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:55:58.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.493+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.493+0000 7f30b2f799c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:55:58.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.493+0000 7f30b2f799c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:55:58.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.493+0000 7f30b2f799c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:55:58.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.493+0000 7f30b2f799c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 : miss 2024-09-12T00:55:58.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.493+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.497+0000 7f30b2f799c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:55:58.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.497+0000 7f30b2f799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 info.flags=0x17 2024-09-12T00:55:58.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.497+0000 7f30b2f799c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 to cache LRU end 2024-09-12T00:55:58.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.497+0000 7f30b2f799c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:58.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.497+0000 7f30b2f799c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:58.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.497+0000 7f30b2f799c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 2024-09-12T00:55:58.493 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.501+0000 7f30b2f799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 info.flags=0x17 2024-09-12T00:55:58.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.501+0000 7f30b2f799c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 to cache LRU end 2024-09-12T00:55:58.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.501+0000 7f30b2f799c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:58.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.501+0000 7f30b2f799c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30, ofs0, ns] 2024-09-12T00:55:58.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.501+0000 7f2f87fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431617 cookie 94808597446064 notifier 6731 bl.length()=999 2024-09-12T00:55:58.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.501+0000 7f2f87fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 info.flags=0x17 2024-09-12T00:55:58.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.501+0000 7f2f87fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 to cache LRU end 2024-09-12T00:55:58.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.501+0000 7f2f87fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:58.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.501+0000 7f30b2f799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): orig_sources= new_sources= 2024-09-12T00:55:58.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.501+0000 7f30b2f799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): potential sources added=[] removed=[] 2024-09-12T00:55:58.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.501+0000 7f30b2f799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): orig_dests= new_dests= 2024-09-12T00:55:58.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.501+0000 7f30b2f799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): potential dests added=[] removed=[] 2024-09-12T00:55:58.499 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.505+0000 7f30b2f799c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30.1.0 2024-09-12T00:55:58.499 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.505+0000 7f30b2f799c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30.1.0 2024-09-12T00:55:58.499 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.505+0000 7f30b2f799c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30.1.1 2024-09-12T00:55:58.499 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.505+0000 7f30b2f799c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30.1.1 2024-09-12T00:55:58.500 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.505+0000 7f30b2f799c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30.0 2024-09-12T00:55:58.503 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.509+0000 7f30b2f799c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:55:58.504 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.509+0000 7f30b2f799c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 2024-09-12T00:55:58.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.513+0000 7f30b2f799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 info.flags=0x17 2024-09-12T00:55:58.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.513+0000 7f30b2f799c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 to cache LRU end 2024-09-12T00:55:58.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.513+0000 7f30b2f799c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:58.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.513+0000 7f30b2f799c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30, ofs0, ns] 2024-09-12T00:55:58.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.513+0000 7f2f87fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431618 cookie 94808597446064 notifier 6731 bl.length()=999 2024-09-12T00:55:58.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.513+0000 7f2f87fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 info.flags=0x17 2024-09-12T00:55:58.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.513+0000 7f2f87fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 to cache LRU end 2024-09-12T00:55:58.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.513+0000 7f2f87fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:58.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.513+0000 7f30b2f799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): orig_sources= new_sources= 2024-09-12T00:55:58.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.513+0000 7f30b2f799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): potential sources added=[] removed=[] 2024-09-12T00:55:58.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.513+0000 7f30b2f799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): orig_dests= new_dests= 2024-09-12T00:55:58.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.513+0000 7f30b2f799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): potential dests added=[] removed=[] 2024-09-12T00:55:58.508 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f30b2f799c0 time 2024-09-12T00:55:58.516539+0000 2024-09-12T00:55:58.509 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:55:58.509 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:58.509 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f30b68532eb] 2024-09-12T00:55:58.509 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f30b685349f] 2024-09-12T00:55:58.509 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a5717ecc1] 2024-09-12T00:55:58.509 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x563a57193086] 2024-09-12T00:55:58.510 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563a571946a4] 2024-09-12T00:55:58.510 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:55:58.510 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f30b56b9d90] 2024-09-12T00:55:58.510 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:55:58.510 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:55:58.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.513+0000 7f30b2f799c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f30b2f799c0 time 2024-09-12T00:55:58.516539+0000 2024-09-12T00:55:58.511 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:55:58.511 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.511 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:58.511 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f30b68532eb] 2024-09-12T00:55:58.511 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f30b685349f] 2024-09-12T00:55:58.512 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a5717ecc1] 2024-09-12T00:55:58.512 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x563a57193086] 2024-09-12T00:55:58.512 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563a571946a4] 2024-09-12T00:55:58.512 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:55:58.513 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f30b56b9d90] 2024-09-12T00:55:58.513 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:55:58.513 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:55:58.513 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.513 INFO:tasks.workunit.client.0.smithi070.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:55:58.513 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f30b2f799c0 thread_name:radosgw-admin 2024-09-12T00:55:58.551 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:58.552 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f30b56d2520] 2024-09-12T00:55:58.552 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:55:58.552 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:55:58.552 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:55:58.552 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f30b6853345] 2024-09-12T00:55:58.552 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f30b685349f] 2024-09-12T00:55:58.552 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a5717ecc1] 2024-09-12T00:55:58.552 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x563a57193086] 2024-09-12T00:55:58.552 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563a571946a4] 2024-09-12T00:55:58.552 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:55:58.552 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f30b56b9d90] 2024-09-12T00:55:58.553 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:55:58.553 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:55:58.553 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.517+0000 7f30b2f799c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:55:58.553 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f30b2f799c0 thread_name:radosgw-admin 2024-09-12T00:55:58.553 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.553 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:58.553 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f30b56d2520] 2024-09-12T00:55:58.553 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:55:58.553 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:55:58.553 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:55:58.553 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f30b6853345] 2024-09-12T00:55:58.553 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f30b685349f] 2024-09-12T00:55:58.553 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a5717ecc1] 2024-09-12T00:55:58.553 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x563a57193086] 2024-09-12T00:55:58.554 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563a571946a4] 2024-09-12T00:55:58.554 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:55:58.554 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f30b56b9d90] 2024-09-12T00:55:58.554 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:55:58.554 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:55:58.554 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:55:58.554 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.554 INFO:tasks.workunit.client.0.smithi070.stderr:--- begin dump of recent events --- 2024-09-12T00:55:58.554 INFO:tasks.workunit.client.0.smithi070.stderr: -499> 2024-09-12T00:55:58.429+0000 7f2f9ee0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:58.554 INFO:tasks.workunit.client.0.smithi070.stderr: -498> 2024-09-12T00:55:58.429+0000 7f2f9ee0d640 10 monclient: dump: 2024-09-12T00:55:58.554 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:58.554 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:58.554 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.554 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.555 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:58.555 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:58.555 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:58.555 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:58.555 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:58.555 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.555 INFO:tasks.workunit.client.0.smithi070.stderr: -497> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient: shutdown 2024-09-12T00:55:58.555 INFO:tasks.workunit.client.0.smithi070.stderr: -496> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 asok(0x563a589532b0) unregister_commands rotate-key 2024-09-12T00:55:58.555 INFO:tasks.workunit.client.0.smithi070.stderr: -495> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient: build_initial_monmap 2024-09-12T00:55:58.555 INFO:tasks.workunit.client.0.smithi070.stderr: -494> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 1 build_initial for_mkfs: 0 2024-09-12T00:55:58.555 INFO:tasks.workunit.client.0.smithi070.stderr: -493> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient: monmap: 2024-09-12T00:55:58.555 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:55:58.555 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:58.555 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:55:58.556 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:55:58.556 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:58.556 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:58.556 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:55:58.556 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:55:58.556 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:55:58.556 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.556 INFO:tasks.workunit.client.0.smithi070.stderr: -492> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding auth protocol: cephx 2024-09-12T00:55:58.556 INFO:tasks.workunit.client.0.smithi070.stderr: -491> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding auth protocol: cephx 2024-09-12T00:55:58.556 INFO:tasks.workunit.client.0.smithi070.stderr: -490> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding auth protocol: cephx 2024-09-12T00:55:58.556 INFO:tasks.workunit.client.0.smithi070.stderr: -489> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding con mode: secure 2024-09-12T00:55:58.556 INFO:tasks.workunit.client.0.smithi070.stderr: -488> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding con mode: crc 2024-09-12T00:55:58.556 INFO:tasks.workunit.client.0.smithi070.stderr: -487> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding con mode: secure 2024-09-12T00:55:58.557 INFO:tasks.workunit.client.0.smithi070.stderr: -486> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding con mode: crc 2024-09-12T00:55:58.557 INFO:tasks.workunit.client.0.smithi070.stderr: -485> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding con mode: secure 2024-09-12T00:55:58.557 INFO:tasks.workunit.client.0.smithi070.stderr: -484> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding con mode: crc 2024-09-12T00:55:58.557 INFO:tasks.workunit.client.0.smithi070.stderr: -483> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding con mode: crc 2024-09-12T00:55:58.557 INFO:tasks.workunit.client.0.smithi070.stderr: -482> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding con mode: secure 2024-09-12T00:55:58.557 INFO:tasks.workunit.client.0.smithi070.stderr: -481> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding con mode: crc 2024-09-12T00:55:58.557 INFO:tasks.workunit.client.0.smithi070.stderr: -480> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding con mode: secure 2024-09-12T00:55:58.557 INFO:tasks.workunit.client.0.smithi070.stderr: -479> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding con mode: crc 2024-09-12T00:55:58.557 INFO:tasks.workunit.client.0.smithi070.stderr: -478> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding con mode: secure 2024-09-12T00:55:58.557 INFO:tasks.workunit.client.0.smithi070.stderr: -477> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:58.557 INFO:tasks.workunit.client.0.smithi070.stderr: -476> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 1 librados: starting msgr at 2024-09-12T00:55:58.558 INFO:tasks.workunit.client.0.smithi070.stderr: -475> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 1 librados: starting objecter 2024-09-12T00:55:58.558 INFO:tasks.workunit.client.0.smithi070.stderr: -474> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command objecter_requests hook 0x563a58b64a60 2024-09-12T00:55:58.558 INFO:tasks.workunit.client.0.smithi070.stderr: -473> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 1 librados: setting wanted keys 2024-09-12T00:55:58.558 INFO:tasks.workunit.client.0.smithi070.stderr: -472> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 1 librados: calling monclient init 2024-09-12T00:55:58.558 INFO:tasks.workunit.client.0.smithi070.stderr: -471> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient: init 2024-09-12T00:55:58.558 INFO:tasks.workunit.client.0.smithi070.stderr: -470> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding auth protocol: cephx 2024-09-12T00:55:58.558 INFO:tasks.workunit.client.0.smithi070.stderr: -469> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding auth protocol: cephx 2024-09-12T00:55:58.558 INFO:tasks.workunit.client.0.smithi070.stderr: -468> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding auth protocol: cephx 2024-09-12T00:55:58.558 INFO:tasks.workunit.client.0.smithi070.stderr: -467> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding con mode: secure 2024-09-12T00:55:58.558 INFO:tasks.workunit.client.0.smithi070.stderr: -466> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding con mode: crc 2024-09-12T00:55:58.558 INFO:tasks.workunit.client.0.smithi070.stderr: -465> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding con mode: secure 2024-09-12T00:55:58.558 INFO:tasks.workunit.client.0.smithi070.stderr: -464> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding con mode: crc 2024-09-12T00:55:58.558 INFO:tasks.workunit.client.0.smithi070.stderr: -463> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding con mode: secure 2024-09-12T00:55:58.558 INFO:tasks.workunit.client.0.smithi070.stderr: -462> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding con mode: crc 2024-09-12T00:55:58.559 INFO:tasks.workunit.client.0.smithi070.stderr: -461> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding con mode: crc 2024-09-12T00:55:58.559 INFO:tasks.workunit.client.0.smithi070.stderr: -460> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding con mode: secure 2024-09-12T00:55:58.559 INFO:tasks.workunit.client.0.smithi070.stderr: -459> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding con mode: crc 2024-09-12T00:55:58.559 INFO:tasks.workunit.client.0.smithi070.stderr: -458> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding con mode: secure 2024-09-12T00:55:58.559 INFO:tasks.workunit.client.0.smithi070.stderr: -457> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding con mode: crc 2024-09-12T00:55:58.559 INFO:tasks.workunit.client.0.smithi070.stderr: -456> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding con mode: secure 2024-09-12T00:55:58.559 INFO:tasks.workunit.client.0.smithi070.stderr: -455> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:58.559 INFO:tasks.workunit.client.0.smithi070.stderr: -454> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:58.559 INFO:tasks.workunit.client.0.smithi070.stderr: -453> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command rotate-key hook 0x563a58b60e28 2024-09-12T00:55:58.559 INFO:tasks.workunit.client.0.smithi070.stderr: -452> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient: _reopen_session rank -1 2024-09-12T00:55:58.559 INFO:tasks.workunit.client.0.smithi070.stderr: -451> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:55:58.559 INFO:tasks.workunit.client.0.smithi070.stderr: -450> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient(hunting): picked mon.noname-b con 0x563a58a0eea0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:55:58.559 INFO:tasks.workunit.client.0.smithi070.stderr: -449> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient(hunting): picked mon.noname-c con 0x563a58a18850 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:55:58.560 INFO:tasks.workunit.client.0.smithi070.stderr: -448> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient(hunting): picked mon.noname-a con 0x563a58a1d4a0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:55:58.560 INFO:tasks.workunit.client.0.smithi070.stderr: -447> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:58.560 INFO:tasks.workunit.client.0.smithi070.stderr: -446> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:58.560 INFO:tasks.workunit.client.0.smithi070.stderr: -445> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:58.560 INFO:tasks.workunit.client.0.smithi070.stderr: -444> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient(hunting): _renew_subs 2024-09-12T00:55:58.560 INFO:tasks.workunit.client.0.smithi070.stderr: -443> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient(hunting): authenticate will time out at 2208.879785s 2024-09-12T00:55:58.560 INFO:tasks.workunit.client.0.smithi070.stderr: -442> 2024-09-12T00:55:58.429+0000 7f30b027e640 10 monclient(hunting): get_auth_request con 0x563a58a18850 auth_method 0 2024-09-12T00:55:58.560 INFO:tasks.workunit.client.0.smithi070.stderr: -441> 2024-09-12T00:55:58.429+0000 7f30b027e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:58.560 INFO:tasks.workunit.client.0.smithi070.stderr: -440> 2024-09-12T00:55:58.429+0000 7f30b027e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:58.560 INFO:tasks.workunit.client.0.smithi070.stderr: -439> 2024-09-12T00:55:58.429+0000 7f30b027e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:58.560 INFO:tasks.workunit.client.0.smithi070.stderr: -438> 2024-09-12T00:55:58.429+0000 7f30b1280640 10 monclient(hunting): get_auth_request con 0x563a58a1d4a0 auth_method 0 2024-09-12T00:55:58.560 INFO:tasks.workunit.client.0.smithi070.stderr: -437> 2024-09-12T00:55:58.429+0000 7f30b1280640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:58.560 INFO:tasks.workunit.client.0.smithi070.stderr: -436> 2024-09-12T00:55:58.429+0000 7f30b1280640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:58.560 INFO:tasks.workunit.client.0.smithi070.stderr: -435> 2024-09-12T00:55:58.429+0000 7f30b1280640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:58.561 INFO:tasks.workunit.client.0.smithi070.stderr: -434> 2024-09-12T00:55:58.429+0000 7f30b027e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:58.561 INFO:tasks.workunit.client.0.smithi070.stderr: -433> 2024-09-12T00:55:58.429+0000 7f30b027e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:58.561 INFO:tasks.workunit.client.0.smithi070.stderr: -432> 2024-09-12T00:55:58.429+0000 7f30b027e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:58.561 INFO:tasks.workunit.client.0.smithi070.stderr: -431> 2024-09-12T00:55:58.429+0000 7f30b1280640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:58.561 INFO:tasks.workunit.client.0.smithi070.stderr: -430> 2024-09-12T00:55:58.429+0000 7f30b1280640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:58.561 INFO:tasks.workunit.client.0.smithi070.stderr: -429> 2024-09-12T00:55:58.433+0000 7f30b1280640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:58.561 INFO:tasks.workunit.client.0.smithi070.stderr: -428> 2024-09-12T00:55:58.433+0000 7f30b027e640 10 monclient(hunting): handle_auth_done global_id 6722 payload 824 2024-09-12T00:55:58.561 INFO:tasks.workunit.client.0.smithi070.stderr: -427> 2024-09-12T00:55:58.433+0000 7f30b027e640 10 monclient: _finish_hunting 0 2024-09-12T00:55:58.561 INFO:tasks.workunit.client.0.smithi070.stderr: -426> 2024-09-12T00:55:58.433+0000 7f30b027e640 1 monclient: found mon.noname-c 2024-09-12T00:55:58.561 INFO:tasks.workunit.client.0.smithi070.stderr: -425> 2024-09-12T00:55:58.433+0000 7f30b027e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:55:58.561 INFO:tasks.workunit.client.0.smithi070.stderr: -424> 2024-09-12T00:55:58.433+0000 7f30b0a7f640 10 monclient: get_auth_request con 0x563a58a0eea0 auth_method 0 2024-09-12T00:55:58.561 INFO:tasks.workunit.client.0.smithi070.stderr: -423> 2024-09-12T00:55:58.433+0000 7f2f9d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:58.561 INFO:tasks.workunit.client.0.smithi070.stderr: -422> 2024-09-12T00:55:58.433+0000 7f2f9d60a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:55:58.561 INFO:tasks.workunit.client.0.smithi070.stderr: -421> 2024-09-12T00:55:58.433+0000 7f2f9d60a640 10 monclient: dump: 2024-09-12T00:55:58.562 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:58.562 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:58.562 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.562 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.562 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:58.562 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:58.562 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:58.562 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:58.562 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:58.562 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.562 INFO:tasks.workunit.client.0.smithi070.stderr: -420> 2024-09-12T00:55:58.433+0000 7f2f9d60a640 10 monclient: _finish_auth 0 2024-09-12T00:55:58.562 INFO:tasks.workunit.client.0.smithi070.stderr: -419> 2024-09-12T00:55:58.433+0000 7f2f9d60a640 10 monclient: _check_auth_tickets 2024-09-12T00:55:58.562 INFO:tasks.workunit.client.0.smithi070.stderr: -418> 2024-09-12T00:55:58.433+0000 7f2f9d60a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:58.562 INFO:tasks.workunit.client.0.smithi070.stderr: -417> 2024-09-12T00:55:58.433+0000 7f2f9d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:58.563 INFO:tasks.workunit.client.0.smithi070.stderr: -416> 2024-09-12T00:55:58.433+0000 7f2f9d60a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:55:58.563 INFO:tasks.workunit.client.0.smithi070.stderr: -415> 2024-09-12T00:55:58.433+0000 7f2f9d60a640 10 monclient: dump: 2024-09-12T00:55:58.563 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:58.563 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:58.563 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.563 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.563 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:58.563 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:58.563 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:58.563 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:58.563 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:58.563 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.563 INFO:tasks.workunit.client.0.smithi070.stderr: -414> 2024-09-12T00:55:58.433+0000 7f2f9ee0d640 4 set_mon_vals no callback set 2024-09-12T00:55:58.563 INFO:tasks.workunit.client.0.smithi070.stderr: -413> 2024-09-12T00:55:58.433+0000 7f30b2f799c0 5 monclient: authenticate success, global_id 6722 2024-09-12T00:55:58.564 INFO:tasks.workunit.client.0.smithi070.stderr: -412> 2024-09-12T00:55:58.433+0000 7f30b2f799c0 10 monclient: _renew_subs 2024-09-12T00:55:58.564 INFO:tasks.workunit.client.0.smithi070.stderr: -411> 2024-09-12T00:55:58.433+0000 7f30b2f799c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:55:58.564 INFO:tasks.workunit.client.0.smithi070.stderr: -410> 2024-09-12T00:55:58.433+0000 7f30b2f799c0 10 monclient: _renew_subs 2024-09-12T00:55:58.564 INFO:tasks.workunit.client.0.smithi070.stderr: -409> 2024-09-12T00:55:58.433+0000 7f30b2f799c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:55:58.564 INFO:tasks.workunit.client.0.smithi070.stderr: -408> 2024-09-12T00:55:58.433+0000 7f30b2f799c0 1 librados: init done 2024-09-12T00:55:58.564 INFO:tasks.workunit.client.0.smithi070.stderr: -407> 2024-09-12T00:55:58.433+0000 7f2f9d60a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:58.564 INFO:tasks.workunit.client.0.smithi070.stderr: -406> 2024-09-12T00:55:58.433+0000 7f2f9d60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:55:58.564 INFO:tasks.workunit.client.0.smithi070.stderr: -405> 2024-09-12T00:55:58.433+0000 7f2f9d60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:55:58.564 INFO:tasks.workunit.client.0.smithi070.stderr: -404> 2024-09-12T00:55:58.433+0000 7f30b1280640 10 monclient: get_auth_request con 0x563a58b9e7c0 auth_method 0 2024-09-12T00:55:58.564 INFO:tasks.workunit.client.0.smithi070.stderr: -403> 2024-09-12T00:55:58.433+0000 7f30b0a7f640 10 monclient: get_auth_request con 0x7f2f98070ae0 auth_method 0 2024-09-12T00:55:58.564 INFO:tasks.workunit.client.0.smithi070.stderr: -402> 2024-09-12T00:55:58.437+0000 7f30b0a7f640 10 monclient: get_auth_request con 0x563a58bab1e0 auth_method 0 2024-09-12T00:55:58.564 INFO:tasks.workunit.client.0.smithi070.stderr: -401> 2024-09-12T00:55:58.437+0000 7f30b027e640 10 monclient: get_auth_request con 0x563a58baf880 auth_method 0 2024-09-12T00:55:58.564 INFO:tasks.workunit.client.0.smithi070.stderr: -400> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 10 monclient: build_initial_monmap 2024-09-12T00:55:58.564 INFO:tasks.workunit.client.0.smithi070.stderr: -399> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 1 build_initial for_mkfs: 0 2024-09-12T00:55:58.565 INFO:tasks.workunit.client.0.smithi070.stderr: -398> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 10 monclient: monmap: 2024-09-12T00:55:58.565 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:55:58.565 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:58.565 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:55:58.565 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:55:58.565 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:58.565 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:58.565 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:55:58.565 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:55:58.565 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:55:58.565 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.565 INFO:tasks.workunit.client.0.smithi070.stderr: -397> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding auth protocol: cephx 2024-09-12T00:55:58.565 INFO:tasks.workunit.client.0.smithi070.stderr: -396> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding auth protocol: cephx 2024-09-12T00:55:58.565 INFO:tasks.workunit.client.0.smithi070.stderr: -395> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding auth protocol: cephx 2024-09-12T00:55:58.566 INFO:tasks.workunit.client.0.smithi070.stderr: -394> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding con mode: secure 2024-09-12T00:55:58.566 INFO:tasks.workunit.client.0.smithi070.stderr: -393> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding con mode: crc 2024-09-12T00:55:58.566 INFO:tasks.workunit.client.0.smithi070.stderr: -392> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding con mode: secure 2024-09-12T00:55:58.566 INFO:tasks.workunit.client.0.smithi070.stderr: -391> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding con mode: crc 2024-09-12T00:55:58.566 INFO:tasks.workunit.client.0.smithi070.stderr: -390> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding con mode: secure 2024-09-12T00:55:58.566 INFO:tasks.workunit.client.0.smithi070.stderr: -389> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding con mode: crc 2024-09-12T00:55:58.566 INFO:tasks.workunit.client.0.smithi070.stderr: -388> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding con mode: crc 2024-09-12T00:55:58.566 INFO:tasks.workunit.client.0.smithi070.stderr: -387> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding con mode: secure 2024-09-12T00:55:58.566 INFO:tasks.workunit.client.0.smithi070.stderr: -386> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding con mode: crc 2024-09-12T00:55:58.566 INFO:tasks.workunit.client.0.smithi070.stderr: -385> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding con mode: secure 2024-09-12T00:55:58.566 INFO:tasks.workunit.client.0.smithi070.stderr: -384> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding con mode: crc 2024-09-12T00:55:58.566 INFO:tasks.workunit.client.0.smithi070.stderr: -383> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding con mode: secure 2024-09-12T00:55:58.566 INFO:tasks.workunit.client.0.smithi070.stderr: -382> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:58.566 INFO:tasks.workunit.client.0.smithi070.stderr: -381> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command objecter_requests cmddesc objecter_requests hook 0x563a58bb8030 EEXIST 2024-09-12T00:55:58.567 INFO:tasks.workunit.client.0.smithi070.stderr: -380> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient: init 2024-09-12T00:55:58.567 INFO:tasks.workunit.client.0.smithi070.stderr: -379> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding auth protocol: cephx 2024-09-12T00:55:58.567 INFO:tasks.workunit.client.0.smithi070.stderr: -378> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding auth protocol: cephx 2024-09-12T00:55:58.567 INFO:tasks.workunit.client.0.smithi070.stderr: -377> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding auth protocol: cephx 2024-09-12T00:55:58.567 INFO:tasks.workunit.client.0.smithi070.stderr: -376> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding con mode: secure 2024-09-12T00:55:58.567 INFO:tasks.workunit.client.0.smithi070.stderr: -375> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding con mode: crc 2024-09-12T00:55:58.567 INFO:tasks.workunit.client.0.smithi070.stderr: -374> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding con mode: secure 2024-09-12T00:55:58.567 INFO:tasks.workunit.client.0.smithi070.stderr: -373> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding con mode: crc 2024-09-12T00:55:58.567 INFO:tasks.workunit.client.0.smithi070.stderr: -372> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding con mode: secure 2024-09-12T00:55:58.567 INFO:tasks.workunit.client.0.smithi070.stderr: -371> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding con mode: crc 2024-09-12T00:55:58.567 INFO:tasks.workunit.client.0.smithi070.stderr: -370> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding con mode: crc 2024-09-12T00:55:58.567 INFO:tasks.workunit.client.0.smithi070.stderr: -369> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding con mode: secure 2024-09-12T00:55:58.567 INFO:tasks.workunit.client.0.smithi070.stderr: -368> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding con mode: crc 2024-09-12T00:55:58.567 INFO:tasks.workunit.client.0.smithi070.stderr: -367> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding con mode: secure 2024-09-12T00:55:58.568 INFO:tasks.workunit.client.0.smithi070.stderr: -366> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding con mode: crc 2024-09-12T00:55:58.568 INFO:tasks.workunit.client.0.smithi070.stderr: -365> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding con mode: secure 2024-09-12T00:55:58.568 INFO:tasks.workunit.client.0.smithi070.stderr: -364> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:58.568 INFO:tasks.workunit.client.0.smithi070.stderr: -363> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:58.568 INFO:tasks.workunit.client.0.smithi070.stderr: -362> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command rotate-key cmddesc rotate-key hook 0x563a58bb2e20 EEXIST 2024-09-12T00:55:58.568 INFO:tasks.workunit.client.0.smithi070.stderr: -361> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient: _reopen_session rank -1 2024-09-12T00:55:58.568 INFO:tasks.workunit.client.0.smithi070.stderr: -360> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:55:58.568 INFO:tasks.workunit.client.0.smithi070.stderr: -359> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient(hunting): picked mon.noname-b con 0x563a58bdc1e0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:55:58.568 INFO:tasks.workunit.client.0.smithi070.stderr: -358> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient(hunting): picked mon.noname-c con 0x563a58bdbb10 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:55:58.568 INFO:tasks.workunit.client.0.smithi070.stderr: -357> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient(hunting): picked mon.noname-a con 0x563a58bda4f0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:55:58.568 INFO:tasks.workunit.client.0.smithi070.stderr: -356> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:58.568 INFO:tasks.workunit.client.0.smithi070.stderr: -355> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:58.568 INFO:tasks.workunit.client.0.smithi070.stderr: -354> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:58.568 INFO:tasks.workunit.client.0.smithi070.stderr: -353> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient(hunting): _renew_subs 2024-09-12T00:55:58.569 INFO:tasks.workunit.client.0.smithi070.stderr: -352> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient(hunting): authenticate will time out at 2208.888592s 2024-09-12T00:55:58.569 INFO:tasks.workunit.client.0.smithi070.stderr: -351> 2024-09-12T00:55:58.441+0000 7f30b027e640 10 monclient(hunting): get_auth_request con 0x563a58bdbb10 auth_method 0 2024-09-12T00:55:58.569 INFO:tasks.workunit.client.0.smithi070.stderr: -350> 2024-09-12T00:55:58.441+0000 7f30b027e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:58.569 INFO:tasks.workunit.client.0.smithi070.stderr: -349> 2024-09-12T00:55:58.441+0000 7f30b027e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:58.569 INFO:tasks.workunit.client.0.smithi070.stderr: -348> 2024-09-12T00:55:58.441+0000 7f30b027e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:58.569 INFO:tasks.workunit.client.0.smithi070.stderr: -347> 2024-09-12T00:55:58.441+0000 7f30b1280640 10 monclient(hunting): get_auth_request con 0x563a58bda4f0 auth_method 0 2024-09-12T00:55:58.569 INFO:tasks.workunit.client.0.smithi070.stderr: -346> 2024-09-12T00:55:58.441+0000 7f30b1280640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:58.569 INFO:tasks.workunit.client.0.smithi070.stderr: -345> 2024-09-12T00:55:58.441+0000 7f30b1280640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:58.569 INFO:tasks.workunit.client.0.smithi070.stderr: -344> 2024-09-12T00:55:58.441+0000 7f30b1280640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:58.569 INFO:tasks.workunit.client.0.smithi070.stderr: -343> 2024-09-12T00:55:58.441+0000 7f30b027e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:58.569 INFO:tasks.workunit.client.0.smithi070.stderr: -342> 2024-09-12T00:55:58.441+0000 7f30b027e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:58.569 INFO:tasks.workunit.client.0.smithi070.stderr: -341> 2024-09-12T00:55:58.441+0000 7f30b027e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:58.569 INFO:tasks.workunit.client.0.smithi070.stderr: -340> 2024-09-12T00:55:58.441+0000 7f30b1280640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:58.569 INFO:tasks.workunit.client.0.smithi070.stderr: -339> 2024-09-12T00:55:58.441+0000 7f30b1280640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:58.570 INFO:tasks.workunit.client.0.smithi070.stderr: -338> 2024-09-12T00:55:58.441+0000 7f30b1280640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:58.570 INFO:tasks.workunit.client.0.smithi070.stderr: -337> 2024-09-12T00:55:58.441+0000 7f30b027e640 10 monclient(hunting): handle_auth_done global_id 6725 payload 824 2024-09-12T00:55:58.570 INFO:tasks.workunit.client.0.smithi070.stderr: -336> 2024-09-12T00:55:58.441+0000 7f30b027e640 10 monclient: _finish_hunting 0 2024-09-12T00:55:58.570 INFO:tasks.workunit.client.0.smithi070.stderr: -335> 2024-09-12T00:55:58.441+0000 7f30b027e640 1 monclient: found mon.noname-c 2024-09-12T00:55:58.570 INFO:tasks.workunit.client.0.smithi070.stderr: -334> 2024-09-12T00:55:58.441+0000 7f30b027e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:55:58.570 INFO:tasks.workunit.client.0.smithi070.stderr: -333> 2024-09-12T00:55:58.441+0000 7f30b0a7f640 10 monclient: get_auth_request con 0x563a58bdc1e0 auth_method 0 2024-09-12T00:55:58.570 INFO:tasks.workunit.client.0.smithi070.stderr: -332> 2024-09-12T00:55:58.441+0000 7f2f967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:58.570 INFO:tasks.workunit.client.0.smithi070.stderr: -331> 2024-09-12T00:55:58.441+0000 7f2f967fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:55:58.570 INFO:tasks.workunit.client.0.smithi070.stderr: -330> 2024-09-12T00:55:58.441+0000 7f2f967fc640 10 monclient: dump: 2024-09-12T00:55:58.570 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:58.570 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:58.570 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.570 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.570 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:58.571 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:58.571 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:58.571 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:58.571 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:58.571 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.571 INFO:tasks.workunit.client.0.smithi070.stderr: -329> 2024-09-12T00:55:58.441+0000 7f2f967fc640 10 monclient: _finish_auth 0 2024-09-12T00:55:58.571 INFO:tasks.workunit.client.0.smithi070.stderr: -328> 2024-09-12T00:55:58.441+0000 7f2f967fc640 10 monclient: _check_auth_tickets 2024-09-12T00:55:58.571 INFO:tasks.workunit.client.0.smithi070.stderr: -327> 2024-09-12T00:55:58.441+0000 7f2f967fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:58.571 INFO:tasks.workunit.client.0.smithi070.stderr: -326> 2024-09-12T00:55:58.441+0000 7f2f967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:58.571 INFO:tasks.workunit.client.0.smithi070.stderr: -325> 2024-09-12T00:55:58.441+0000 7f2f967fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:55:58.571 INFO:tasks.workunit.client.0.smithi070.stderr: -324> 2024-09-12T00:55:58.441+0000 7f2f967fc640 10 monclient: dump: 2024-09-12T00:55:58.571 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:58.571 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:58.571 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.572 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.572 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:58.572 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:58.572 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:58.572 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:58.572 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:58.572 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.572 INFO:tasks.workunit.client.0.smithi070.stderr: -323> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 monclient: authenticate success, global_id 6725 2024-09-12T00:55:58.572 INFO:tasks.workunit.client.0.smithi070.stderr: -322> 2024-09-12T00:55:58.441+0000 7f30b1a81640 4 set_mon_vals no callback set 2024-09-12T00:55:58.572 INFO:tasks.workunit.client.0.smithi070.stderr: -321> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient: _renew_subs 2024-09-12T00:55:58.572 INFO:tasks.workunit.client.0.smithi070.stderr: -320> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:55:58.573 INFO:tasks.workunit.client.0.smithi070.stderr: -319> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient: _renew_subs 2024-09-12T00:55:58.573 INFO:tasks.workunit.client.0.smithi070.stderr: -318> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:55:58.573 INFO:tasks.workunit.client.0.smithi070.stderr: -317> 2024-09-12T00:55:58.441+0000 7f2f967fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:58.573 INFO:tasks.workunit.client.0.smithi070.stderr: -316> 2024-09-12T00:55:58.441+0000 7f2f967fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:55:58.573 INFO:tasks.workunit.client.0.smithi070.stderr: -315> 2024-09-12T00:55:58.441+0000 7f2f967fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:55:58.573 INFO:tasks.workunit.client.0.smithi070.stderr: -314> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient: get_monmap_and_config 2024-09-12T00:55:58.573 INFO:tasks.workunit.client.0.smithi070.stderr: -313> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient: build_initial_monmap 2024-09-12T00:55:58.573 INFO:tasks.workunit.client.0.smithi070.stderr: -312> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 1 build_initial for_mkfs: 0 2024-09-12T00:55:58.573 INFO:tasks.workunit.client.0.smithi070.stderr: -311> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient: monmap: 2024-09-12T00:55:58.573 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:55:58.573 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:58.573 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:55:58.573 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:55:58.573 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:58.574 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:58.574 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:55:58.574 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:55:58.574 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:55:58.574 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.574 INFO:tasks.workunit.client.0.smithi070.stderr: -310> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding auth protocol: cephx 2024-09-12T00:55:58.574 INFO:tasks.workunit.client.0.smithi070.stderr: -309> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding auth protocol: cephx 2024-09-12T00:55:58.574 INFO:tasks.workunit.client.0.smithi070.stderr: -308> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding auth protocol: cephx 2024-09-12T00:55:58.574 INFO:tasks.workunit.client.0.smithi070.stderr: -307> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding con mode: secure 2024-09-12T00:55:58.574 INFO:tasks.workunit.client.0.smithi070.stderr: -306> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding con mode: crc 2024-09-12T00:55:58.574 INFO:tasks.workunit.client.0.smithi070.stderr: -305> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding con mode: secure 2024-09-12T00:55:58.574 INFO:tasks.workunit.client.0.smithi070.stderr: -304> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding con mode: crc 2024-09-12T00:55:58.574 INFO:tasks.workunit.client.0.smithi070.stderr: -303> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding con mode: secure 2024-09-12T00:55:58.574 INFO:tasks.workunit.client.0.smithi070.stderr: -302> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding con mode: crc 2024-09-12T00:55:58.575 INFO:tasks.workunit.client.0.smithi070.stderr: -301> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding con mode: crc 2024-09-12T00:55:58.575 INFO:tasks.workunit.client.0.smithi070.stderr: -300> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding con mode: secure 2024-09-12T00:55:58.575 INFO:tasks.workunit.client.0.smithi070.stderr: -299> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding con mode: crc 2024-09-12T00:55:58.575 INFO:tasks.workunit.client.0.smithi070.stderr: -298> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding con mode: secure 2024-09-12T00:55:58.575 INFO:tasks.workunit.client.0.smithi070.stderr: -297> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding con mode: crc 2024-09-12T00:55:58.575 INFO:tasks.workunit.client.0.smithi070.stderr: -296> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding con mode: secure 2024-09-12T00:55:58.575 INFO:tasks.workunit.client.0.smithi070.stderr: -295> 2024-09-12T00:55:58.441+0000 7f30b0a7f640 10 monclient: get_auth_request con 0x7f2f88070a20 auth_method 0 2024-09-12T00:55:58.575 INFO:tasks.workunit.client.0.smithi070.stderr: -294> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:58.575 INFO:tasks.workunit.client.0.smithi070.stderr: -293> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient: init 2024-09-12T00:55:58.575 INFO:tasks.workunit.client.0.smithi070.stderr: -292> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding auth protocol: cephx 2024-09-12T00:55:58.575 INFO:tasks.workunit.client.0.smithi070.stderr: -291> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding auth protocol: cephx 2024-09-12T00:55:58.575 INFO:tasks.workunit.client.0.smithi070.stderr: -290> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding auth protocol: cephx 2024-09-12T00:55:58.575 INFO:tasks.workunit.client.0.smithi070.stderr: -289> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding con mode: secure 2024-09-12T00:55:58.575 INFO:tasks.workunit.client.0.smithi070.stderr: -288> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding con mode: crc 2024-09-12T00:55:58.576 INFO:tasks.workunit.client.0.smithi070.stderr: -287> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding con mode: secure 2024-09-12T00:55:58.576 INFO:tasks.workunit.client.0.smithi070.stderr: -286> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding con mode: crc 2024-09-12T00:55:58.576 INFO:tasks.workunit.client.0.smithi070.stderr: -285> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding con mode: secure 2024-09-12T00:55:58.576 INFO:tasks.workunit.client.0.smithi070.stderr: -284> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding con mode: crc 2024-09-12T00:55:58.576 INFO:tasks.workunit.client.0.smithi070.stderr: -283> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding con mode: crc 2024-09-12T00:55:58.576 INFO:tasks.workunit.client.0.smithi070.stderr: -282> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding con mode: secure 2024-09-12T00:55:58.576 INFO:tasks.workunit.client.0.smithi070.stderr: -281> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding con mode: crc 2024-09-12T00:55:58.576 INFO:tasks.workunit.client.0.smithi070.stderr: -280> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding con mode: secure 2024-09-12T00:55:58.576 INFO:tasks.workunit.client.0.smithi070.stderr: -279> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding con mode: crc 2024-09-12T00:55:58.576 INFO:tasks.workunit.client.0.smithi070.stderr: -278> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding con mode: secure 2024-09-12T00:55:58.576 INFO:tasks.workunit.client.0.smithi070.stderr: -277> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:58.576 INFO:tasks.workunit.client.0.smithi070.stderr: -276> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:58.576 INFO:tasks.workunit.client.0.smithi070.stderr: -275> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command rotate-key cmddesc rotate-key hook 0x7ffec8b48358 EEXIST 2024-09-12T00:55:58.576 INFO:tasks.workunit.client.0.smithi070.stderr: -274> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient: _reopen_session rank -1 2024-09-12T00:55:58.577 INFO:tasks.workunit.client.0.smithi070.stderr: -273> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:55:58.577 INFO:tasks.workunit.client.0.smithi070.stderr: -272> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): picked mon.noname-c con 0x563a58c29ea0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:55:58.577 INFO:tasks.workunit.client.0.smithi070.stderr: -271> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): picked mon.noname-b con 0x563a58c00d60 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:55:58.577 INFO:tasks.workunit.client.0.smithi070.stderr: -270> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): picked mon.noname-a con 0x563a58bffb30 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:55:58.577 INFO:tasks.workunit.client.0.smithi070.stderr: -269> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:58.577 INFO:tasks.workunit.client.0.smithi070.stderr: -268> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:58.577 INFO:tasks.workunit.client.0.smithi070.stderr: -267> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:58.577 INFO:tasks.workunit.client.0.smithi070.stderr: -266> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): _renew_subs 2024-09-12T00:55:58.577 INFO:tasks.workunit.client.0.smithi070.stderr: -265> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): authenticate will time out at 2208.892525s 2024-09-12T00:55:58.577 INFO:tasks.workunit.client.0.smithi070.stderr: -264> 2024-09-12T00:55:58.445+0000 7f30b0a7f640 10 monclient(hunting): get_auth_request con 0x563a58c29ea0 auth_method 0 2024-09-12T00:55:58.577 INFO:tasks.workunit.client.0.smithi070.stderr: -263> 2024-09-12T00:55:58.445+0000 7f30b0a7f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:58.577 INFO:tasks.workunit.client.0.smithi070.stderr: -262> 2024-09-12T00:55:58.445+0000 7f30b0a7f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:58.577 INFO:tasks.workunit.client.0.smithi070.stderr: -261> 2024-09-12T00:55:58.445+0000 7f30b0a7f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:58.577 INFO:tasks.workunit.client.0.smithi070.stderr: -260> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): get_auth_request con 0x563a58bffb30 auth_method 0 2024-09-12T00:55:58.578 INFO:tasks.workunit.client.0.smithi070.stderr: -259> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:58.578 INFO:tasks.workunit.client.0.smithi070.stderr: -258> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:58.578 INFO:tasks.workunit.client.0.smithi070.stderr: -257> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:58.578 INFO:tasks.workunit.client.0.smithi070.stderr: -256> 2024-09-12T00:55:58.445+0000 7f30b0a7f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:58.578 INFO:tasks.workunit.client.0.smithi070.stderr: -255> 2024-09-12T00:55:58.445+0000 7f30b0a7f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:58.578 INFO:tasks.workunit.client.0.smithi070.stderr: -254> 2024-09-12T00:55:58.445+0000 7f30b0a7f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:58.578 INFO:tasks.workunit.client.0.smithi070.stderr: -253> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:58.578 INFO:tasks.workunit.client.0.smithi070.stderr: -252> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:58.578 INFO:tasks.workunit.client.0.smithi070.stderr: -251> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:58.578 INFO:tasks.workunit.client.0.smithi070.stderr: -250> 2024-09-12T00:55:58.445+0000 7f30b0a7f640 10 monclient(hunting): handle_auth_done global_id 6728 payload 274 2024-09-12T00:55:58.578 INFO:tasks.workunit.client.0.smithi070.stderr: -249> 2024-09-12T00:55:58.445+0000 7f30b0a7f640 10 monclient: _finish_hunting 0 2024-09-12T00:55:58.578 INFO:tasks.workunit.client.0.smithi070.stderr: -248> 2024-09-12T00:55:58.445+0000 7f30b0a7f640 1 monclient: found mon.noname-c 2024-09-12T00:55:58.578 INFO:tasks.workunit.client.0.smithi070.stderr: -247> 2024-09-12T00:55:58.445+0000 7f30b0a7f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:55:58.579 INFO:tasks.workunit.client.0.smithi070.stderr: -246> 2024-09-12T00:55:58.445+0000 7f2f87fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:58.579 INFO:tasks.workunit.client.0.smithi070.stderr: -245> 2024-09-12T00:55:58.445+0000 7f2f87fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:55:58.579 INFO:tasks.workunit.client.0.smithi070.stderr: -244> 2024-09-12T00:55:58.445+0000 7f2f87fff640 10 monclient: dump: 2024-09-12T00:55:58.579 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:58.579 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:58.579 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.579 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.579 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:58.579 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:58.579 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:58.579 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:58.580 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:58.580 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.580 INFO:tasks.workunit.client.0.smithi070.stderr: -243> 2024-09-12T00:55:58.445+0000 7f2f87fff640 10 monclient: _finish_auth 0 2024-09-12T00:55:58.580 INFO:tasks.workunit.client.0.smithi070.stderr: -242> 2024-09-12T00:55:58.445+0000 7f2f87fff640 10 monclient: _check_auth_tickets 2024-09-12T00:55:58.580 INFO:tasks.workunit.client.0.smithi070.stderr: -241> 2024-09-12T00:55:58.445+0000 7f2f87fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:58.580 INFO:tasks.workunit.client.0.smithi070.stderr: -240> 2024-09-12T00:55:58.445+0000 7f2f87fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:58.580 INFO:tasks.workunit.client.0.smithi070.stderr: -239> 2024-09-12T00:55:58.445+0000 7f2f87fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:55:58.580 INFO:tasks.workunit.client.0.smithi070.stderr: -238> 2024-09-12T00:55:58.445+0000 7f2f87fff640 10 monclient: dump: 2024-09-12T00:55:58.580 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:58.580 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:58.580 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.580 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.580 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:58.581 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:58.581 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:58.581 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:58.581 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:58.581 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.581 INFO:tasks.workunit.client.0.smithi070.stderr: -237> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 monclient: authenticate success, global_id 6728 2024-09-12T00:55:58.581 INFO:tasks.workunit.client.0.smithi070.stderr: -236> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient: get_monmap_and_config success 2024-09-12T00:55:58.581 INFO:tasks.workunit.client.0.smithi070.stderr: -235> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 4 set_mon_vals no callback set 2024-09-12T00:55:58.581 INFO:tasks.workunit.client.0.smithi070.stderr: -234> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient: shutdown 2024-09-12T00:55:58.581 INFO:tasks.workunit.client.0.smithi070.stderr: -233> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient: build_initial_monmap 2024-09-12T00:55:58.581 INFO:tasks.workunit.client.0.smithi070.stderr: -232> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 1 build_initial for_mkfs: 0 2024-09-12T00:55:58.581 INFO:tasks.workunit.client.0.smithi070.stderr: -231> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient: monmap: 2024-09-12T00:55:58.581 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:55:58.581 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:58.582 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:55:58.582 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:55:58.582 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:58.582 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:58.582 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:55:58.582 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:55:58.582 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:55:58.582 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.582 INFO:tasks.workunit.client.0.smithi070.stderr: -230> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding auth protocol: cephx 2024-09-12T00:55:58.582 INFO:tasks.workunit.client.0.smithi070.stderr: -229> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding auth protocol: cephx 2024-09-12T00:55:58.582 INFO:tasks.workunit.client.0.smithi070.stderr: -228> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding auth protocol: cephx 2024-09-12T00:55:58.582 INFO:tasks.workunit.client.0.smithi070.stderr: -227> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding con mode: secure 2024-09-12T00:55:58.582 INFO:tasks.workunit.client.0.smithi070.stderr: -226> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding con mode: crc 2024-09-12T00:55:58.583 INFO:tasks.workunit.client.0.smithi070.stderr: -225> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding con mode: secure 2024-09-12T00:55:58.583 INFO:tasks.workunit.client.0.smithi070.stderr: -224> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding con mode: crc 2024-09-12T00:55:58.583 INFO:tasks.workunit.client.0.smithi070.stderr: -223> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding con mode: secure 2024-09-12T00:55:58.583 INFO:tasks.workunit.client.0.smithi070.stderr: -222> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding con mode: crc 2024-09-12T00:55:58.583 INFO:tasks.workunit.client.0.smithi070.stderr: -221> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding con mode: crc 2024-09-12T00:55:58.583 INFO:tasks.workunit.client.0.smithi070.stderr: -220> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding con mode: secure 2024-09-12T00:55:58.583 INFO:tasks.workunit.client.0.smithi070.stderr: -219> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding con mode: crc 2024-09-12T00:55:58.583 INFO:tasks.workunit.client.0.smithi070.stderr: -218> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding con mode: secure 2024-09-12T00:55:58.583 INFO:tasks.workunit.client.0.smithi070.stderr: -217> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding con mode: crc 2024-09-12T00:55:58.583 INFO:tasks.workunit.client.0.smithi070.stderr: -216> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding con mode: secure 2024-09-12T00:55:58.583 INFO:tasks.workunit.client.0.smithi070.stderr: -215> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:58.583 INFO:tasks.workunit.client.0.smithi070.stderr: -214> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 1 librados: starting msgr at 2024-09-12T00:55:58.583 INFO:tasks.workunit.client.0.smithi070.stderr: -213> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 1 librados: starting objecter 2024-09-12T00:55:58.583 INFO:tasks.workunit.client.0.smithi070.stderr: -212> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command objecter_requests cmddesc objecter_requests hook 0x563a58c22c00 EEXIST 2024-09-12T00:55:58.584 INFO:tasks.workunit.client.0.smithi070.stderr: -211> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 1 librados: setting wanted keys 2024-09-12T00:55:58.584 INFO:tasks.workunit.client.0.smithi070.stderr: -210> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 1 librados: calling monclient init 2024-09-12T00:55:58.584 INFO:tasks.workunit.client.0.smithi070.stderr: -209> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient: init 2024-09-12T00:55:58.584 INFO:tasks.workunit.client.0.smithi070.stderr: -208> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding auth protocol: cephx 2024-09-12T00:55:58.584 INFO:tasks.workunit.client.0.smithi070.stderr: -207> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding auth protocol: cephx 2024-09-12T00:55:58.584 INFO:tasks.workunit.client.0.smithi070.stderr: -206> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding auth protocol: cephx 2024-09-12T00:55:58.584 INFO:tasks.workunit.client.0.smithi070.stderr: -205> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding con mode: secure 2024-09-12T00:55:58.584 INFO:tasks.workunit.client.0.smithi070.stderr: -204> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding con mode: crc 2024-09-12T00:55:58.584 INFO:tasks.workunit.client.0.smithi070.stderr: -203> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding con mode: secure 2024-09-12T00:55:58.584 INFO:tasks.workunit.client.0.smithi070.stderr: -202> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding con mode: crc 2024-09-12T00:55:58.584 INFO:tasks.workunit.client.0.smithi070.stderr: -201> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding con mode: secure 2024-09-12T00:55:58.584 INFO:tasks.workunit.client.0.smithi070.stderr: -200> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding con mode: crc 2024-09-12T00:55:58.584 INFO:tasks.workunit.client.0.smithi070.stderr: -199> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding con mode: crc 2024-09-12T00:55:58.585 INFO:tasks.workunit.client.0.smithi070.stderr: -198> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding con mode: secure 2024-09-12T00:55:58.585 INFO:tasks.workunit.client.0.smithi070.stderr: -197> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding con mode: crc 2024-09-12T00:55:58.585 INFO:tasks.workunit.client.0.smithi070.stderr: -196> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding con mode: secure 2024-09-12T00:55:58.585 INFO:tasks.workunit.client.0.smithi070.stderr: -195> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding con mode: crc 2024-09-12T00:55:58.585 INFO:tasks.workunit.client.0.smithi070.stderr: -194> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding con mode: secure 2024-09-12T00:55:58.585 INFO:tasks.workunit.client.0.smithi070.stderr: -193> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:58.585 INFO:tasks.workunit.client.0.smithi070.stderr: -192> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:58.585 INFO:tasks.workunit.client.0.smithi070.stderr: -191> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command rotate-key cmddesc rotate-key hook 0x563a58bde148 EEXIST 2024-09-12T00:55:58.585 INFO:tasks.workunit.client.0.smithi070.stderr: -190> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient: _reopen_session rank -1 2024-09-12T00:55:58.585 INFO:tasks.workunit.client.0.smithi070.stderr: -189> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:55:58.585 INFO:tasks.workunit.client.0.smithi070.stderr: -188> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): picked mon.noname-b con 0x563a58bffb30 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:55:58.585 INFO:tasks.workunit.client.0.smithi070.stderr: -187> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): picked mon.noname-c con 0x563a58c00d60 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:55:58.585 INFO:tasks.workunit.client.0.smithi070.stderr: -186> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): picked mon.noname-a con 0x563a58c29ea0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:55:58.585 INFO:tasks.workunit.client.0.smithi070.stderr: -185> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:58.586 INFO:tasks.workunit.client.0.smithi070.stderr: -184> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:58.586 INFO:tasks.workunit.client.0.smithi070.stderr: -183> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:58.586 INFO:tasks.workunit.client.0.smithi070.stderr: -182> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): _renew_subs 2024-09-12T00:55:58.586 INFO:tasks.workunit.client.0.smithi070.stderr: -181> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): authenticate will time out at 2208.895022s 2024-09-12T00:55:58.586 INFO:tasks.workunit.client.0.smithi070.stderr: -180> 2024-09-12T00:55:58.445+0000 7f30b027e640 10 monclient(hunting): get_auth_request con 0x563a58c00d60 auth_method 0 2024-09-12T00:55:58.586 INFO:tasks.workunit.client.0.smithi070.stderr: -179> 2024-09-12T00:55:58.445+0000 7f30b027e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:58.586 INFO:tasks.workunit.client.0.smithi070.stderr: -178> 2024-09-12T00:55:58.445+0000 7f30b027e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:58.586 INFO:tasks.workunit.client.0.smithi070.stderr: -177> 2024-09-12T00:55:58.445+0000 7f30b027e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:58.586 INFO:tasks.workunit.client.0.smithi070.stderr: -176> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): get_auth_request con 0x563a58c29ea0 auth_method 0 2024-09-12T00:55:58.586 INFO:tasks.workunit.client.0.smithi070.stderr: -175> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:58.586 INFO:tasks.workunit.client.0.smithi070.stderr: -174> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:58.586 INFO:tasks.workunit.client.0.smithi070.stderr: -173> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:58.586 INFO:tasks.workunit.client.0.smithi070.stderr: -172> 2024-09-12T00:55:58.445+0000 7f30b027e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:58.587 INFO:tasks.workunit.client.0.smithi070.stderr: -171> 2024-09-12T00:55:58.445+0000 7f30b027e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:58.587 INFO:tasks.workunit.client.0.smithi070.stderr: -170> 2024-09-12T00:55:58.445+0000 7f30b027e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:58.587 INFO:tasks.workunit.client.0.smithi070.stderr: -169> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:58.587 INFO:tasks.workunit.client.0.smithi070.stderr: -168> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:58.587 INFO:tasks.workunit.client.0.smithi070.stderr: -167> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:58.587 INFO:tasks.workunit.client.0.smithi070.stderr: -166> 2024-09-12T00:55:58.445+0000 7f30b027e640 10 monclient(hunting): handle_auth_done global_id 6731 payload 824 2024-09-12T00:55:58.587 INFO:tasks.workunit.client.0.smithi070.stderr: -165> 2024-09-12T00:55:58.445+0000 7f30b027e640 10 monclient: _finish_hunting 0 2024-09-12T00:55:58.587 INFO:tasks.workunit.client.0.smithi070.stderr: -164> 2024-09-12T00:55:58.445+0000 7f30b027e640 1 monclient: found mon.noname-c 2024-09-12T00:55:58.587 INFO:tasks.workunit.client.0.smithi070.stderr: -163> 2024-09-12T00:55:58.445+0000 7f30b027e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:55:58.587 INFO:tasks.workunit.client.0.smithi070.stderr: -162> 2024-09-12T00:55:58.445+0000 7f2f867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:58.587 INFO:tasks.workunit.client.0.smithi070.stderr: -161> 2024-09-12T00:55:58.445+0000 7f2f867fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:55:58.587 INFO:tasks.workunit.client.0.smithi070.stderr: -160> 2024-09-12T00:55:58.445+0000 7f2f867fc640 10 monclient: dump: 2024-09-12T00:55:58.587 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:58.587 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:58.588 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.588 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.588 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:58.588 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:58.588 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:58.588 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:58.588 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:58.588 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.588 INFO:tasks.workunit.client.0.smithi070.stderr: -159> 2024-09-12T00:55:58.445+0000 7f2f867fc640 10 monclient: _finish_auth 0 2024-09-12T00:55:58.588 INFO:tasks.workunit.client.0.smithi070.stderr: -158> 2024-09-12T00:55:58.445+0000 7f2f867fc640 10 monclient: _check_auth_tickets 2024-09-12T00:55:58.588 INFO:tasks.workunit.client.0.smithi070.stderr: -157> 2024-09-12T00:55:58.445+0000 7f2f867fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:58.588 INFO:tasks.workunit.client.0.smithi070.stderr: -156> 2024-09-12T00:55:58.445+0000 7f2f867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:58.588 INFO:tasks.workunit.client.0.smithi070.stderr: -155> 2024-09-12T00:55:58.445+0000 7f2f867fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:55:58.588 INFO:tasks.workunit.client.0.smithi070.stderr: -154> 2024-09-12T00:55:58.445+0000 7f2f867fc640 10 monclient: dump: 2024-09-12T00:55:58.589 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:58.589 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:58.589 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.589 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.589 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:58.589 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:58.589 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:58.589 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:58.589 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:58.589 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.589 INFO:tasks.workunit.client.0.smithi070.stderr: -153> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 monclient: authenticate success, global_id 6731 2024-09-12T00:55:58.589 INFO:tasks.workunit.client.0.smithi070.stderr: -152> 2024-09-12T00:55:58.445+0000 7f2f87fff640 4 set_mon_vals no callback set 2024-09-12T00:55:58.589 INFO:tasks.workunit.client.0.smithi070.stderr: -151> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient: _renew_subs 2024-09-12T00:55:58.589 INFO:tasks.workunit.client.0.smithi070.stderr: -150> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:55:58.590 INFO:tasks.workunit.client.0.smithi070.stderr: -149> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient: _renew_subs 2024-09-12T00:55:58.590 INFO:tasks.workunit.client.0.smithi070.stderr: -148> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:55:58.590 INFO:tasks.workunit.client.0.smithi070.stderr: -147> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 1 librados: init done 2024-09-12T00:55:58.590 INFO:tasks.workunit.client.0.smithi070.stderr: -146> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command cr dump hook 0x563a58c24a48 2024-09-12T00:55:58.590 INFO:tasks.workunit.client.0.smithi070.stderr: -145> 2024-09-12T00:55:58.449+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.590 INFO:tasks.workunit.client.0.smithi070.stderr: -144> 2024-09-12T00:55:58.449+0000 7f2f867fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:58.590 INFO:tasks.workunit.client.0.smithi070.stderr: -143> 2024-09-12T00:55:58.449+0000 7f2f867fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:55:58.590 INFO:tasks.workunit.client.0.smithi070.stderr: -142> 2024-09-12T00:55:58.449+0000 7f2f867fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:55:58.590 INFO:tasks.workunit.client.0.smithi070.stderr: -141> 2024-09-12T00:55:58.449+0000 7f30b1280640 10 monclient: get_auth_request con 0x563a58c49090 auth_method 0 2024-09-12T00:55:58.590 INFO:tasks.workunit.client.0.smithi070.stderr: -140> 2024-09-12T00:55:58.449+0000 7f30b0a7f640 10 monclient: get_auth_request con 0x7f2f7c070b10 auth_method 0 2024-09-12T00:55:58.590 INFO:tasks.workunit.client.0.smithi070.stderr: -139> 2024-09-12T00:55:58.449+0000 7f30b2f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.590 INFO:tasks.workunit.client.0.smithi070.stderr: -138> 2024-09-12T00:55:58.449+0000 7f30b2f799c0 20 realm 2024-09-12T00:55:58.590 INFO:tasks.workunit.client.0.smithi070.stderr: -137> 2024-09-12T00:55:58.449+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.590 INFO:tasks.workunit.client.0.smithi070.stderr: -136> 2024-09-12T00:55:58.449+0000 7f30b2f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.591 INFO:tasks.workunit.client.0.smithi070.stderr: -135> 2024-09-12T00:55:58.449+0000 7f30b2f799c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:58.591 INFO:tasks.workunit.client.0.smithi070.stderr: -134> 2024-09-12T00:55:58.449+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.591 INFO:tasks.workunit.client.0.smithi070.stderr: -133> 2024-09-12T00:55:58.449+0000 7f30b2f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.591 INFO:tasks.workunit.client.0.smithi070.stderr: -132> 2024-09-12T00:55:58.449+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.591 INFO:tasks.workunit.client.0.smithi070.stderr: -131> 2024-09-12T00:55:58.453+0000 7f30b0a7f640 10 monclient: get_auth_request con 0x563a58c4d300 auth_method 0 2024-09-12T00:55:58.591 INFO:tasks.workunit.client.0.smithi070.stderr: -130> 2024-09-12T00:55:58.453+0000 7f30b2f799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:58.591 INFO:tasks.workunit.client.0.smithi070.stderr: -129> 2024-09-12T00:55:58.453+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.591 INFO:tasks.workunit.client.0.smithi070.stderr: -128> 2024-09-12T00:55:58.453+0000 7f30b027e640 10 monclient: get_auth_request con 0x563a58c50b40 auth_method 0 2024-09-12T00:55:58.591 INFO:tasks.workunit.client.0.smithi070.stderr: -127> 2024-09-12T00:55:58.453+0000 7f30b2f799c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:58.591 INFO:tasks.workunit.client.0.smithi070.stderr: -126> 2024-09-12T00:55:58.453+0000 7f30b2f799c0 20 searching for the correct realm 2024-09-12T00:55:58.591 INFO:tasks.workunit.client.0.smithi070.stderr: -125> 2024-09-12T00:55:58.453+0000 7f30b1280640 10 monclient: get_auth_request con 0x563a58c558e0 auth_method 0 2024-09-12T00:55:58.591 INFO:tasks.workunit.client.0.smithi070.stderr: -124> 2024-09-12T00:55:58.453+0000 7f30b0a7f640 10 monclient: get_auth_request con 0x7f30a80c8040 auth_method 0 2024-09-12T00:55:58.591 INFO:tasks.workunit.client.0.smithi070.stderr: -123> 2024-09-12T00:55:58.457+0000 7f30b027e640 10 monclient: get_auth_request con 0x7f30a0008040 auth_method 0 2024-09-12T00:55:58.591 INFO:tasks.workunit.client.0.smithi070.stderr: -122> 2024-09-12T00:55:58.457+0000 7f30b1280640 10 monclient: get_auth_request con 0x7f30a4028070 auth_method 0 2024-09-12T00:55:58.592 INFO:tasks.workunit.client.0.smithi070.stderr: -121> 2024-09-12T00:55:58.457+0000 7f30b1280640 0 -- 172.21.15.70:0/233166351 >> [v2:172.21.15.70:6808/276433067,v1:172.21.15.70:6809/276433067] conn(0x563a58c558e0 msgr2=0x563a58c57da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:58.592 INFO:tasks.workunit.client.0.smithi070.stderr: -120> 2024-09-12T00:55:58.457+0000 7f2f867fc640 1 client.6731.objecter ms_handle_reset 0x563a58c558e0 session 0x563a58c55260 osd.3 2024-09-12T00:55:58.592 INFO:tasks.workunit.client.0.smithi070.stderr: -119> 2024-09-12T00:55:58.457+0000 7f2f867fc640 10 monclient: _renew_subs 2024-09-12T00:55:58.592 INFO:tasks.workunit.client.0.smithi070.stderr: -118> 2024-09-12T00:55:58.457+0000 7f2f867fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:55:58.592 INFO:tasks.workunit.client.0.smithi070.stderr: -117> 2024-09-12T00:55:58.457+0000 7f30b1280640 10 monclient: get_auth_request con 0x7f2f7c0808b0 auth_method 0 2024-09-12T00:55:58.592 INFO:tasks.workunit.client.0.smithi070.stderr: -116> 2024-09-12T00:55:58.461+0000 7f30b0a7f640 10 monclient: get_auth_request con 0x7f30a80d83c0 auth_method 0 2024-09-12T00:55:58.592 INFO:tasks.workunit.client.0.smithi070.stderr: -115> 2024-09-12T00:55:58.465+0000 7f30b0a7f640 0 -- 172.21.15.70:0/233166351 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f30a80c8040 msgr2=0x7f30a80c8930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:58.592 INFO:tasks.workunit.client.0.smithi070.stderr: -114> 2024-09-12T00:55:58.465+0000 7f2f867fc640 1 client.6731.objecter ms_handle_reset 0x7f30a80c8040 session 0x7f30a80bf040 osd.7 2024-09-12T00:55:58.592 INFO:tasks.workunit.client.0.smithi070.stderr: -113> 2024-09-12T00:55:58.465+0000 7f30b0a7f640 10 monclient: get_auth_request con 0x563a58c558e0 auth_method 0 2024-09-12T00:55:58.592 INFO:tasks.workunit.client.0.smithi070.stderr: -112> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:58.592 INFO:tasks.workunit.client.0.smithi070.stderr: -111> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:58.592 INFO:tasks.workunit.client.0.smithi070.stderr: -110> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:58.592 INFO:tasks.workunit.client.0.smithi070.stderr: -109> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:58.593 INFO:tasks.workunit.client.0.smithi070.stderr: -108> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:58.593 INFO:tasks.workunit.client.0.smithi070.stderr: -107> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:58.593 INFO:tasks.workunit.client.0.smithi070.stderr: -106> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.593 INFO:tasks.workunit.client.0.smithi070.stderr: -105> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.593 INFO:tasks.workunit.client.0.smithi070.stderr: -104> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.593 INFO:tasks.workunit.client.0.smithi070.stderr: -103> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:58.593 INFO:tasks.workunit.client.0.smithi070.stderr: -102> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.593 INFO:tasks.workunit.client.0.smithi070.stderr: -101> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:58.593 INFO:tasks.workunit.client.0.smithi070.stderr: -100> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 zone default found 2024-09-12T00:55:58.593 INFO:tasks.workunit.client.0.smithi070.stderr: -99> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 4 Realm: () 2024-09-12T00:55:58.593 INFO:tasks.workunit.client.0.smithi070.stderr: -98> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:58.593 INFO:tasks.workunit.client.0.smithi070.stderr: -97> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:58.593 INFO:tasks.workunit.client.0.smithi070.stderr: -96> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:58.593 INFO:tasks.workunit.client.0.smithi070.stderr: -95> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 zonegroup default 2024-09-12T00:55:58.594 INFO:tasks.workunit.client.0.smithi070.stderr: -94> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.594 INFO:tasks.workunit.client.0.smithi070.stderr: -93> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.594 INFO:tasks.workunit.client.0.smithi070.stderr: -92> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.594 INFO:tasks.workunit.client.0.smithi070.stderr: -91> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.594 INFO:tasks.workunit.client.0.smithi070.stderr: -90> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.594 INFO:tasks.workunit.client.0.smithi070.stderr: -89> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.594 INFO:tasks.workunit.client.0.smithi070.stderr: -88> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 started sync module instance, tier type = 2024-09-12T00:55:58.594 INFO:tasks.workunit.client.0.smithi070.stderr: -87> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:58.594 INFO:tasks.workunit.client.0.smithi070.stderr: -86> 2024-09-12T00:55:58.489+0000 7f30b2f799c0 20 add_watcher() i=0 2024-09-12T00:55:58.594 INFO:tasks.workunit.client.0.smithi070.stderr: -85> 2024-09-12T00:55:58.489+0000 7f30b2f799c0 20 add_watcher() i=1 2024-09-12T00:55:58.594 INFO:tasks.workunit.client.0.smithi070.stderr: -84> 2024-09-12T00:55:58.489+0000 7f30b2f799c0 20 add_watcher() i=2 2024-09-12T00:55:58.594 INFO:tasks.workunit.client.0.smithi070.stderr: -83> 2024-09-12T00:55:58.489+0000 7f30b2f799c0 20 add_watcher() i=3 2024-09-12T00:55:58.594 INFO:tasks.workunit.client.0.smithi070.stderr: -82> 2024-09-12T00:55:58.489+0000 7f30b2f799c0 20 add_watcher() i=4 2024-09-12T00:55:58.594 INFO:tasks.workunit.client.0.smithi070.stderr: -81> 2024-09-12T00:55:58.489+0000 7f30b2f799c0 20 add_watcher() i=5 2024-09-12T00:55:58.594 INFO:tasks.workunit.client.0.smithi070.stderr: -80> 2024-09-12T00:55:58.489+0000 7f30b2f799c0 20 add_watcher() i=6 2024-09-12T00:55:58.595 INFO:tasks.workunit.client.0.smithi070.stderr: -79> 2024-09-12T00:55:58.489+0000 7f30b2f799c0 20 add_watcher() i=7 2024-09-12T00:55:58.595 INFO:tasks.workunit.client.0.smithi070.stderr: -78> 2024-09-12T00:55:58.489+0000 7f30b2f799c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:58.595 INFO:tasks.workunit.client.0.smithi070.stderr: -77> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding auth protocol: cephx 2024-09-12T00:55:58.595 INFO:tasks.workunit.client.0.smithi070.stderr: -76> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding auth protocol: cephx 2024-09-12T00:55:58.595 INFO:tasks.workunit.client.0.smithi070.stderr: -75> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding auth protocol: cephx 2024-09-12T00:55:58.595 INFO:tasks.workunit.client.0.smithi070.stderr: -74> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding con mode: secure 2024-09-12T00:55:58.595 INFO:tasks.workunit.client.0.smithi070.stderr: -73> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding con mode: crc 2024-09-12T00:55:58.595 INFO:tasks.workunit.client.0.smithi070.stderr: -72> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding con mode: secure 2024-09-12T00:55:58.595 INFO:tasks.workunit.client.0.smithi070.stderr: -71> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding con mode: crc 2024-09-12T00:55:58.595 INFO:tasks.workunit.client.0.smithi070.stderr: -70> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding con mode: secure 2024-09-12T00:55:58.595 INFO:tasks.workunit.client.0.smithi070.stderr: -69> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding con mode: crc 2024-09-12T00:55:58.595 INFO:tasks.workunit.client.0.smithi070.stderr: -68> 2024-09-12T00:55:58.493+0000 7f2f66fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:58.595 INFO:tasks.workunit.client.0.smithi070.stderr: -67> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding con mode: crc 2024-09-12T00:55:58.595 INFO:tasks.workunit.client.0.smithi070.stderr: -66> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding con mode: secure 2024-09-12T00:55:58.596 INFO:tasks.workunit.client.0.smithi070.stderr: -65> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding con mode: crc 2024-09-12T00:55:58.596 INFO:tasks.workunit.client.0.smithi070.stderr: -64> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding con mode: secure 2024-09-12T00:55:58.596 INFO:tasks.workunit.client.0.smithi070.stderr: -63> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding con mode: crc 2024-09-12T00:55:58.596 INFO:tasks.workunit.client.0.smithi070.stderr: -62> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding con mode: secure 2024-09-12T00:55:58.596 INFO:tasks.workunit.client.0.smithi070.stderr: -61> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:58.596 INFO:tasks.workunit.client.0.smithi070.stderr: -60> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:58.596 INFO:tasks.workunit.client.0.smithi070.stderr: -59> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:58.596 INFO:tasks.workunit.client.0.smithi070.stderr: -58> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command cache list hook 0x563a58bfe690 2024-09-12T00:55:58.596 INFO:tasks.workunit.client.0.smithi070.stderr: -57> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command cache inspect hook 0x563a58bfe690 2024-09-12T00:55:58.596 INFO:tasks.workunit.client.0.smithi070.stderr: -56> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command cache erase hook 0x563a58bfe690 2024-09-12T00:55:58.596 INFO:tasks.workunit.client.0.smithi070.stderr: -55> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command cache zap hook 0x563a58bfe690 2024-09-12T00:55:58.596 INFO:tasks.workunit.client.0.smithi070.stderr: -54> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 note: GC not initialized 2024-09-12T00:55:58.596 INFO:tasks.workunit.client.0.smithi070.stderr: -53> 2024-09-12T00:55:58.493+0000 7f2f65fe3640 20 reqs_thread_entry: start 2024-09-12T00:55:58.596 INFO:tasks.workunit.client.0.smithi070.stderr: -52> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command sync trace show hook 0x7f30a000d470 2024-09-12T00:55:58.597 INFO:tasks.workunit.client.0.smithi070.stderr: -51> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command sync trace history hook 0x7f30a000d470 2024-09-12T00:55:58.597 INFO:tasks.workunit.client.0.smithi070.stderr: -50> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command sync trace active hook 0x7f30a000d470 2024-09-12T00:55:58.597 INFO:tasks.workunit.client.0.smithi070.stderr: -49> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command sync trace active_short hook 0x7f30a000d470 2024-09-12T00:55:58.597 INFO:tasks.workunit.client.0.smithi070.stderr: -48> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:58.597 INFO:tasks.workunit.client.0.smithi070.stderr: -47> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 20 Filter name: none 2024-09-12T00:55:58.597 INFO:tasks.workunit.client.0.smithi070.stderr: -46> 2024-09-12T00:55:58.493+0000 7f2ed77fe640 20 reqs_thread_entry: start 2024-09-12T00:55:58.597 INFO:tasks.workunit.client.0.smithi070.stderr: -45> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:55:58.597 INFO:tasks.workunit.client.0.smithi070.stderr: -44> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.597 INFO:tasks.workunit.client.0.smithi070.stderr: -43> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:55:58.597 INFO:tasks.workunit.client.0.smithi070.stderr: -42> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:55:58.597 INFO:tasks.workunit.client.0.smithi070.stderr: -41> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:55:58.597 INFO:tasks.workunit.client.0.smithi070.stderr: -40> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 : miss 2024-09-12T00:55:58.597 INFO:tasks.workunit.client.0.smithi070.stderr: -39> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.597 INFO:tasks.workunit.client.0.smithi070.stderr: -38> 2024-09-12T00:55:58.497+0000 7f30b2f799c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:55:58.598 INFO:tasks.workunit.client.0.smithi070.stderr: -37> 2024-09-12T00:55:58.497+0000 7f30b2f799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 info.flags=0x17 2024-09-12T00:55:58.598 INFO:tasks.workunit.client.0.smithi070.stderr: -36> 2024-09-12T00:55:58.497+0000 7f30b2f799c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 to cache LRU end 2024-09-12T00:55:58.598 INFO:tasks.workunit.client.0.smithi070.stderr: -35> 2024-09-12T00:55:58.497+0000 7f30b2f799c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:58.598 INFO:tasks.workunit.client.0.smithi070.stderr: -34> 2024-09-12T00:55:58.497+0000 7f30b2f799c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:58.598 INFO:tasks.workunit.client.0.smithi070.stderr: -33> 2024-09-12T00:55:58.497+0000 7f30b2f799c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 2024-09-12T00:55:58.598 INFO:tasks.workunit.client.0.smithi070.stderr: -32> 2024-09-12T00:55:58.501+0000 7f30b2f799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 info.flags=0x17 2024-09-12T00:55:58.598 INFO:tasks.workunit.client.0.smithi070.stderr: -31> 2024-09-12T00:55:58.501+0000 7f30b2f799c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 to cache LRU end 2024-09-12T00:55:58.598 INFO:tasks.workunit.client.0.smithi070.stderr: -30> 2024-09-12T00:55:58.501+0000 7f30b2f799c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:58.598 INFO:tasks.workunit.client.0.smithi070.stderr: -29> 2024-09-12T00:55:58.501+0000 7f30b2f799c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30, ofs0, ns] 2024-09-12T00:55:58.598 INFO:tasks.workunit.client.0.smithi070.stderr: -28> 2024-09-12T00:55:58.501+0000 7f2f87fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431617 cookie 94808597446064 notifier 6731 bl.length()=999 2024-09-12T00:55:58.598 INFO:tasks.workunit.client.0.smithi070.stderr: -27> 2024-09-12T00:55:58.501+0000 7f2f87fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 info.flags=0x17 2024-09-12T00:55:58.598 INFO:tasks.workunit.client.0.smithi070.stderr: -26> 2024-09-12T00:55:58.501+0000 7f2f87fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 to cache LRU end 2024-09-12T00:55:58.598 INFO:tasks.workunit.client.0.smithi070.stderr: -25> 2024-09-12T00:55:58.501+0000 7f2f87fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:58.598 INFO:tasks.workunit.client.0.smithi070.stderr: -24> 2024-09-12T00:55:58.501+0000 7f30b2f799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): orig_sources= new_sources= 2024-09-12T00:55:58.599 INFO:tasks.workunit.client.0.smithi070.stderr: -23> 2024-09-12T00:55:58.501+0000 7f30b2f799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): potential sources added=[] removed=[] 2024-09-12T00:55:58.599 INFO:tasks.workunit.client.0.smithi070.stderr: -22> 2024-09-12T00:55:58.501+0000 7f30b2f799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): orig_dests= new_dests= 2024-09-12T00:55:58.599 INFO:tasks.workunit.client.0.smithi070.stderr: -21> 2024-09-12T00:55:58.501+0000 7f30b2f799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): potential dests added=[] removed=[] 2024-09-12T00:55:58.599 INFO:tasks.workunit.client.0.smithi070.stderr: -20> 2024-09-12T00:55:58.505+0000 7f30b2f799c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30.1.0 2024-09-12T00:55:58.599 INFO:tasks.workunit.client.0.smithi070.stderr: -19> 2024-09-12T00:55:58.505+0000 7f30b2f799c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30.1.0 2024-09-12T00:55:58.599 INFO:tasks.workunit.client.0.smithi070.stderr: -18> 2024-09-12T00:55:58.505+0000 7f30b2f799c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30.1.1 2024-09-12T00:55:58.599 INFO:tasks.workunit.client.0.smithi070.stderr: -17> 2024-09-12T00:55:58.505+0000 7f30b2f799c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30.1.1 2024-09-12T00:55:58.599 INFO:tasks.workunit.client.0.smithi070.stderr: -16> 2024-09-12T00:55:58.505+0000 7f30b2f799c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30.0 2024-09-12T00:55:58.599 INFO:tasks.workunit.client.0.smithi070.stderr: -15> 2024-09-12T00:55:58.509+0000 7f30b2f799c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:55:58.599 INFO:tasks.workunit.client.0.smithi070.stderr: -14> 2024-09-12T00:55:58.509+0000 7f30b2f799c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 2024-09-12T00:55:58.599 INFO:tasks.workunit.client.0.smithi070.stderr: -13> 2024-09-12T00:55:58.513+0000 7f30b2f799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 info.flags=0x17 2024-09-12T00:55:58.599 INFO:tasks.workunit.client.0.smithi070.stderr: -12> 2024-09-12T00:55:58.513+0000 7f30b2f799c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 to cache LRU end 2024-09-12T00:55:58.599 INFO:tasks.workunit.client.0.smithi070.stderr: -11> 2024-09-12T00:55:58.513+0000 7f30b2f799c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:58.599 INFO:tasks.workunit.client.0.smithi070.stderr: -10> 2024-09-12T00:55:58.513+0000 7f30b2f799c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30, ofs0, ns] 2024-09-12T00:55:58.600 INFO:tasks.workunit.client.0.smithi070.stderr: -9> 2024-09-12T00:55:58.513+0000 7f2f87fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431618 cookie 94808597446064 notifier 6731 bl.length()=999 2024-09-12T00:55:58.600 INFO:tasks.workunit.client.0.smithi070.stderr: -8> 2024-09-12T00:55:58.513+0000 7f2f87fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 info.flags=0x17 2024-09-12T00:55:58.600 INFO:tasks.workunit.client.0.smithi070.stderr: -7> 2024-09-12T00:55:58.513+0000 7f2f87fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 to cache LRU end 2024-09-12T00:55:58.600 INFO:tasks.workunit.client.0.smithi070.stderr: -6> 2024-09-12T00:55:58.513+0000 7f2f87fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:58.600 INFO:tasks.workunit.client.0.smithi070.stderr: -5> 2024-09-12T00:55:58.513+0000 7f30b2f799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): orig_sources= new_sources= 2024-09-12T00:55:58.600 INFO:tasks.workunit.client.0.smithi070.stderr: -4> 2024-09-12T00:55:58.513+0000 7f30b2f799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): potential sources added=[] removed=[] 2024-09-12T00:55:58.600 INFO:tasks.workunit.client.0.smithi070.stderr: -3> 2024-09-12T00:55:58.513+0000 7f30b2f799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): orig_dests= new_dests= 2024-09-12T00:55:58.600 INFO:tasks.workunit.client.0.smithi070.stderr: -2> 2024-09-12T00:55:58.513+0000 7f30b2f799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): potential dests added=[] removed=[] 2024-09-12T00:55:58.600 INFO:tasks.workunit.client.0.smithi070.stderr: -1> 2024-09-12T00:55:58.513+0000 7f30b2f799c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f30b2f799c0 time 2024-09-12T00:55:58.516539+0000 2024-09-12T00:55:58.600 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:55:58.600 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.600 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:58.600 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f30b68532eb] 2024-09-12T00:55:58.600 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f30b685349f] 2024-09-12T00:55:58.601 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a5717ecc1] 2024-09-12T00:55:58.601 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x563a57193086] 2024-09-12T00:55:58.601 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563a571946a4] 2024-09-12T00:55:58.601 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:55:58.601 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f30b56b9d90] 2024-09-12T00:55:58.601 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:55:58.601 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:55:58.601 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.601 INFO:tasks.workunit.client.0.smithi070.stderr: 0> 2024-09-12T00:55:58.517+0000 7f30b2f799c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:55:58.601 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f30b2f799c0 thread_name:radosgw-admin 2024-09-12T00:55:58.601 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.601 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:58.601 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f30b56d2520] 2024-09-12T00:55:58.601 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:55:58.602 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:55:58.602 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:55:58.602 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f30b6853345] 2024-09-12T00:55:58.602 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f30b685349f] 2024-09-12T00:55:58.602 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a5717ecc1] 2024-09-12T00:55:58.602 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x563a57193086] 2024-09-12T00:55:58.602 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563a571946a4] 2024-09-12T00:55:58.602 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:55:58.602 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f30b56b9d90] 2024-09-12T00:55:58.602 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:55:58.602 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:55:58.602 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:55:58.602 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.603 INFO:tasks.workunit.client.0.smithi070.stderr:--- logging levels --- 2024-09-12T00:55:58.603 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 none 2024-09-12T00:55:58.603 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 lockdep 2024-09-12T00:55:58.603 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 context 2024-09-12T00:55:58.603 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 crush 2024-09-12T00:55:58.603 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds 2024-09-12T00:55:58.603 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_balancer 2024-09-12T00:55:58.603 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_locker 2024-09-12T00:55:58.603 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log 2024-09-12T00:55:58.603 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log_expire 2024-09-12T00:55:58.603 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_migrator 2024-09-12T00:55:58.603 INFO:tasks.workunit.client.0.smithi070.stderr: 3/ 5 mds_quiesce 2024-09-12T00:55:58.603 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 buffer 2024-09-12T00:55:58.604 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 timer 2024-09-12T00:55:58.604 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 filer 2024-09-12T00:55:58.604 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 striper 2024-09-12T00:55:58.604 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 objecter 2024-09-12T00:55:58.604 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rados 2024-09-12T00:55:58.604 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd 2024-09-12T00:55:58.604 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_mirror 2024-09-12T00:55:58.604 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_replay 2024-09-12T00:55:58.604 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_pwl 2024-09-12T00:55:58.604 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 journaler 2024-09-12T00:55:58.604 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objectcacher 2024-09-12T00:55:58.604 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:55:58.604 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 client 2024-09-12T00:55:58.604 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 osd 2024-09-12T00:55:58.605 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 optracker 2024-09-12T00:55:58.605 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objclass 2024-09-12T00:55:58.605 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 filestore 2024-09-12T00:55:58.605 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 journal 2024-09-12T00:55:58.605 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 ms 2024-09-12T00:55:58.605 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mon 2024-09-12T00:55:58.605 INFO:tasks.workunit.client.0.smithi070.stderr: 0/10 monc 2024-09-12T00:55:58.605 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 paxos 2024-09-12T00:55:58.605 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 tp 2024-09-12T00:55:58.605 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 auth 2024-09-12T00:55:58.605 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 crypto 2024-09-12T00:55:58.605 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 finisher 2024-09-12T00:55:58.605 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 reserver 2024-09-12T00:55:58.605 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 heartbeatmap 2024-09-12T00:55:58.605 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 perfcounter 2024-09-12T00:55:58.606 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw 2024-09-12T00:55:58.606 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_sync 2024-09-12T00:55:58.606 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_datacache 2024-09-12T00:55:58.606 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_access 2024-09-12T00:55:58.606 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:55:58.606 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_flight 2024-09-12T00:55:58.606 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:55:58.606 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw_notification 2024-09-12T00:55:58.606 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 javaclient 2024-09-12T00:55:58.606 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 asok 2024-09-12T00:55:58.606 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 throttle 2024-09-12T00:55:58.606 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 refs 2024-09-12T00:55:58.606 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 compressor 2024-09-12T00:55:58.606 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluestore 2024-09-12T00:55:58.607 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluefs 2024-09-12T00:55:58.607 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 bdev 2024-09-12T00:55:58.607 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 kstore 2024-09-12T00:55:58.607 INFO:tasks.workunit.client.0.smithi070.stderr: 4/ 5 rocksdb 2024-09-12T00:55:58.607 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 fuse 2024-09-12T00:55:58.607 INFO:tasks.workunit.client.0.smithi070.stderr: 2/ 5 mgr 2024-09-12T00:55:58.607 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mgrc 2024-09-12T00:55:58.607 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 dpdk 2024-09-12T00:55:58.607 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 eventtrace 2024-09-12T00:55:58.607 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 prioritycache 2024-09-12T00:55:58.607 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 test 2024-09-12T00:55:58.607 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:55:58.607 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephsqlite 2024-09-12T00:55:58.607 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:55:58.608 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore 2024-09-12T00:55:58.608 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_onode 2024-09-12T00:55:58.608 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_odata 2024-09-12T00:55:58.608 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_omap 2024-09-12T00:55:58.608 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_tm 2024-09-12T00:55:58.608 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_t 2024-09-12T00:55:58.608 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:55:58.608 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_epm 2024-09-12T00:55:58.608 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_lba 2024-09-12T00:55:58.608 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:55:58.608 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cache 2024-09-12T00:55:58.608 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_journal 2024-09-12T00:55:58.608 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_device 2024-09-12T00:55:58.608 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_backref 2024-09-12T00:55:58.609 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 alienstore 2024-09-12T00:55:58.609 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mclock 2024-09-12T00:55:58.609 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cyanstore 2024-09-12T00:55:58.609 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 ceph_exporter 2024-09-12T00:55:58.609 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 memstore 2024-09-12T00:55:58.609 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 trace 2024-09-12T00:55:58.609 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 ceph_dedup 2024-09-12T00:55:58.609 INFO:tasks.workunit.client.0.smithi070.stderr: -2/-2 (syslog threshold) 2024-09-12T00:55:58.609 INFO:tasks.workunit.client.0.smithi070.stderr: 99/99 (stderr threshold) 2024-09-12T00:55:58.609 INFO:tasks.workunit.client.0.smithi070.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:55:58.609 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2ed77fe640 / http_manager 2024-09-12T00:55:58.609 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2f65fe3640 / http_manager 2024-09-12T00:55:58.609 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2f66fe5640 / rgw_dt_lg_renew 2024-09-12T00:55:58.609 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2f867fc640 / ms_dispatch 2024-09-12T00:55:58.609 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2f87fff640 / io_context_pool 2024-09-12T00:55:58.610 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2f967fc640 / ms_dispatch 2024-09-12T00:55:58.610 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2f9d60a640 / ms_dispatch 2024-09-12T00:55:58.610 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2f9ee0d640 / io_context_pool 2024-09-12T00:55:58.610 INFO:tasks.workunit.client.0.smithi070.stderr: 7f30b027e640 / msgr-worker-2 2024-09-12T00:55:58.610 INFO:tasks.workunit.client.0.smithi070.stderr: 7f30b0a7f640 / msgr-worker-1 2024-09-12T00:55:58.610 INFO:tasks.workunit.client.0.smithi070.stderr: 7f30b1280640 / msgr-worker-0 2024-09-12T00:55:58.610 INFO:tasks.workunit.client.0.smithi070.stderr: 7f30b1a81640 / io_context_pool 2024-09-12T00:55:58.610 INFO:tasks.workunit.client.0.smithi070.stderr: 7f30b2f799c0 / radosgw-admin 2024-09-12T00:55:58.610 INFO:tasks.workunit.client.0.smithi070.stderr: max_recent 500 2024-09-12T00:55:58.610 INFO:tasks.workunit.client.0.smithi070.stderr: max_new 1000 2024-09-12T00:55:58.610 INFO:tasks.workunit.client.0.smithi070.stderr: log_file /var/log/ceph/ceph-client.admin.106146.log 2024-09-12T00:55:58.610 INFO:tasks.workunit.client.0.smithi070.stderr:--- end dump of recent events --- 2024-09-12T00:55:58.610 INFO:tasks.workunit.client.0.smithi070.stderr:--- begin dump of recent events --- 2024-09-12T00:55:58.611 INFO:tasks.workunit.client.0.smithi070.stderr: -499> 2024-09-12T00:55:58.429+0000 7f2f9ee0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:58.611 INFO:tasks.workunit.client.0.smithi070.stderr: -498> 2024-09-12T00:55:58.429+0000 7f2f9ee0d640 10 monclient: dump: 2024-09-12T00:55:58.611 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:58.611 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:58.611 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.611 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.611 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:58.611 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:58.611 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:58.611 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:58.611 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:58.611 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.611 INFO:tasks.workunit.client.0.smithi070.stderr: -497> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient: shutdown 2024-09-12T00:55:58.611 INFO:tasks.workunit.client.0.smithi070.stderr: -496> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 asok(0x563a589532b0) unregister_commands rotate-key 2024-09-12T00:55:58.611 INFO:tasks.workunit.client.0.smithi070.stderr: -495> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient: build_initial_monmap 2024-09-12T00:55:58.612 INFO:tasks.workunit.client.0.smithi070.stderr: -494> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 1 build_initial for_mkfs: 0 2024-09-12T00:55:58.612 INFO:tasks.workunit.client.0.smithi070.stderr: -493> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient: monmap: 2024-09-12T00:55:58.612 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:55:58.612 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:58.612 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:55:58.612 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:55:58.612 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:58.612 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:58.612 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:55:58.612 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:55:58.612 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:55:58.612 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.612 INFO:tasks.workunit.client.0.smithi070.stderr: -492> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding auth protocol: cephx 2024-09-12T00:55:58.612 INFO:tasks.workunit.client.0.smithi070.stderr: -491> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding auth protocol: cephx 2024-09-12T00:55:58.613 INFO:tasks.workunit.client.0.smithi070.stderr: -490> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding auth protocol: cephx 2024-09-12T00:55:58.613 INFO:tasks.workunit.client.0.smithi070.stderr: -489> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding con mode: secure 2024-09-12T00:55:58.613 INFO:tasks.workunit.client.0.smithi070.stderr: -488> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding con mode: crc 2024-09-12T00:55:58.613 INFO:tasks.workunit.client.0.smithi070.stderr: -487> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding con mode: secure 2024-09-12T00:55:58.613 INFO:tasks.workunit.client.0.smithi070.stderr: -486> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding con mode: crc 2024-09-12T00:55:58.613 INFO:tasks.workunit.client.0.smithi070.stderr: -485> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding con mode: secure 2024-09-12T00:55:58.613 INFO:tasks.workunit.client.0.smithi070.stderr: -484> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding con mode: crc 2024-09-12T00:55:58.613 INFO:tasks.workunit.client.0.smithi070.stderr: -483> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding con mode: crc 2024-09-12T00:55:58.613 INFO:tasks.workunit.client.0.smithi070.stderr: -482> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding con mode: secure 2024-09-12T00:55:58.613 INFO:tasks.workunit.client.0.smithi070.stderr: -481> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding con mode: crc 2024-09-12T00:55:58.613 INFO:tasks.workunit.client.0.smithi070.stderr: -480> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding con mode: secure 2024-09-12T00:55:58.613 INFO:tasks.workunit.client.0.smithi070.stderr: -479> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding con mode: crc 2024-09-12T00:55:58.613 INFO:tasks.workunit.client.0.smithi070.stderr: -478> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b66230) adding con mode: secure 2024-09-12T00:55:58.613 INFO:tasks.workunit.client.0.smithi070.stderr: -477> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:58.614 INFO:tasks.workunit.client.0.smithi070.stderr: -476> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 1 librados: starting msgr at 2024-09-12T00:55:58.614 INFO:tasks.workunit.client.0.smithi070.stderr: -475> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 1 librados: starting objecter 2024-09-12T00:55:58.614 INFO:tasks.workunit.client.0.smithi070.stderr: -474> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command objecter_requests hook 0x563a58b64a60 2024-09-12T00:55:58.614 INFO:tasks.workunit.client.0.smithi070.stderr: -473> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 1 librados: setting wanted keys 2024-09-12T00:55:58.614 INFO:tasks.workunit.client.0.smithi070.stderr: -472> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 1 librados: calling monclient init 2024-09-12T00:55:58.614 INFO:tasks.workunit.client.0.smithi070.stderr: -471> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient: init 2024-09-12T00:55:58.614 INFO:tasks.workunit.client.0.smithi070.stderr: -470> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding auth protocol: cephx 2024-09-12T00:55:58.614 INFO:tasks.workunit.client.0.smithi070.stderr: -469> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding auth protocol: cephx 2024-09-12T00:55:58.614 INFO:tasks.workunit.client.0.smithi070.stderr: -468> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding auth protocol: cephx 2024-09-12T00:55:58.614 INFO:tasks.workunit.client.0.smithi070.stderr: -467> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding con mode: secure 2024-09-12T00:55:58.614 INFO:tasks.workunit.client.0.smithi070.stderr: -466> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding con mode: crc 2024-09-12T00:55:58.614 INFO:tasks.workunit.client.0.smithi070.stderr: -465> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding con mode: secure 2024-09-12T00:55:58.614 INFO:tasks.workunit.client.0.smithi070.stderr: -464> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding con mode: crc 2024-09-12T00:55:58.614 INFO:tasks.workunit.client.0.smithi070.stderr: -463> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding con mode: secure 2024-09-12T00:55:58.615 INFO:tasks.workunit.client.0.smithi070.stderr: -462> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding con mode: crc 2024-09-12T00:55:58.615 INFO:tasks.workunit.client.0.smithi070.stderr: -461> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding con mode: crc 2024-09-12T00:55:58.615 INFO:tasks.workunit.client.0.smithi070.stderr: -460> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding con mode: secure 2024-09-12T00:55:58.615 INFO:tasks.workunit.client.0.smithi070.stderr: -459> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding con mode: crc 2024-09-12T00:55:58.615 INFO:tasks.workunit.client.0.smithi070.stderr: -458> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding con mode: secure 2024-09-12T00:55:58.615 INFO:tasks.workunit.client.0.smithi070.stderr: -457> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding con mode: crc 2024-09-12T00:55:58.615 INFO:tasks.workunit.client.0.smithi070.stderr: -456> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 AuthRegistry(0x563a58b60ce0) adding con mode: secure 2024-09-12T00:55:58.615 INFO:tasks.workunit.client.0.smithi070.stderr: -455> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:58.615 INFO:tasks.workunit.client.0.smithi070.stderr: -454> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:58.615 INFO:tasks.workunit.client.0.smithi070.stderr: -453> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command rotate-key hook 0x563a58b60e28 2024-09-12T00:55:58.615 INFO:tasks.workunit.client.0.smithi070.stderr: -452> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient: _reopen_session rank -1 2024-09-12T00:55:58.615 INFO:tasks.workunit.client.0.smithi070.stderr: -451> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:55:58.615 INFO:tasks.workunit.client.0.smithi070.stderr: -450> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient(hunting): picked mon.noname-b con 0x563a58a0eea0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:55:58.616 INFO:tasks.workunit.client.0.smithi070.stderr: -449> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient(hunting): picked mon.noname-c con 0x563a58a18850 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:55:58.616 INFO:tasks.workunit.client.0.smithi070.stderr: -448> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient(hunting): picked mon.noname-a con 0x563a58a1d4a0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:55:58.616 INFO:tasks.workunit.client.0.smithi070.stderr: -447> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:58.616 INFO:tasks.workunit.client.0.smithi070.stderr: -446> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:58.616 INFO:tasks.workunit.client.0.smithi070.stderr: -445> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:58.616 INFO:tasks.workunit.client.0.smithi070.stderr: -444> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient(hunting): _renew_subs 2024-09-12T00:55:58.616 INFO:tasks.workunit.client.0.smithi070.stderr: -443> 2024-09-12T00:55:58.429+0000 7f30b2f799c0 10 monclient(hunting): authenticate will time out at 2208.879785s 2024-09-12T00:55:58.616 INFO:tasks.workunit.client.0.smithi070.stderr: -442> 2024-09-12T00:55:58.429+0000 7f30b027e640 10 monclient(hunting): get_auth_request con 0x563a58a18850 auth_method 0 2024-09-12T00:55:58.616 INFO:tasks.workunit.client.0.smithi070.stderr: -441> 2024-09-12T00:55:58.429+0000 7f30b027e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:58.616 INFO:tasks.workunit.client.0.smithi070.stderr: -440> 2024-09-12T00:55:58.429+0000 7f30b027e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:58.616 INFO:tasks.workunit.client.0.smithi070.stderr: -439> 2024-09-12T00:55:58.429+0000 7f30b027e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:58.616 INFO:tasks.workunit.client.0.smithi070.stderr: -438> 2024-09-12T00:55:58.429+0000 7f30b1280640 10 monclient(hunting): get_auth_request con 0x563a58a1d4a0 auth_method 0 2024-09-12T00:55:58.616 INFO:tasks.workunit.client.0.smithi070.stderr: -437> 2024-09-12T00:55:58.429+0000 7f30b1280640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:58.616 INFO:tasks.workunit.client.0.smithi070.stderr: -436> 2024-09-12T00:55:58.429+0000 7f30b1280640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:58.617 INFO:tasks.workunit.client.0.smithi070.stderr: -435> 2024-09-12T00:55:58.429+0000 7f30b1280640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:58.617 INFO:tasks.workunit.client.0.smithi070.stderr: -434> 2024-09-12T00:55:58.429+0000 7f30b027e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:58.617 INFO:tasks.workunit.client.0.smithi070.stderr: -433> 2024-09-12T00:55:58.429+0000 7f30b027e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:58.617 INFO:tasks.workunit.client.0.smithi070.stderr: -432> 2024-09-12T00:55:58.429+0000 7f30b027e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:58.617 INFO:tasks.workunit.client.0.smithi070.stderr: -431> 2024-09-12T00:55:58.429+0000 7f30b1280640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:58.617 INFO:tasks.workunit.client.0.smithi070.stderr: -430> 2024-09-12T00:55:58.429+0000 7f30b1280640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:58.617 INFO:tasks.workunit.client.0.smithi070.stderr: -429> 2024-09-12T00:55:58.433+0000 7f30b1280640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:58.617 INFO:tasks.workunit.client.0.smithi070.stderr: -428> 2024-09-12T00:55:58.433+0000 7f30b027e640 10 monclient(hunting): handle_auth_done global_id 6722 payload 824 2024-09-12T00:55:58.617 INFO:tasks.workunit.client.0.smithi070.stderr: -427> 2024-09-12T00:55:58.433+0000 7f30b027e640 10 monclient: _finish_hunting 0 2024-09-12T00:55:58.617 INFO:tasks.workunit.client.0.smithi070.stderr: -426> 2024-09-12T00:55:58.433+0000 7f30b027e640 1 monclient: found mon.noname-c 2024-09-12T00:55:58.617 INFO:tasks.workunit.client.0.smithi070.stderr: -425> 2024-09-12T00:55:58.433+0000 7f30b027e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:55:58.617 INFO:tasks.workunit.client.0.smithi070.stderr: -424> 2024-09-12T00:55:58.433+0000 7f30b0a7f640 10 monclient: get_auth_request con 0x563a58a0eea0 auth_method 0 2024-09-12T00:55:58.617 INFO:tasks.workunit.client.0.smithi070.stderr: -423> 2024-09-12T00:55:58.433+0000 7f2f9d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:58.617 INFO:tasks.workunit.client.0.smithi070.stderr: -422> 2024-09-12T00:55:58.433+0000 7f2f9d60a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:55:58.618 INFO:tasks.workunit.client.0.smithi070.stderr: -421> 2024-09-12T00:55:58.433+0000 7f2f9d60a640 10 monclient: dump: 2024-09-12T00:55:58.618 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:58.618 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:58.618 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.618 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.618 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:58.618 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:58.618 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:58.618 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:58.618 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:58.618 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.618 INFO:tasks.workunit.client.0.smithi070.stderr: -420> 2024-09-12T00:55:58.433+0000 7f2f9d60a640 10 monclient: _finish_auth 0 2024-09-12T00:55:58.618 INFO:tasks.workunit.client.0.smithi070.stderr: -419> 2024-09-12T00:55:58.433+0000 7f2f9d60a640 10 monclient: _check_auth_tickets 2024-09-12T00:55:58.618 INFO:tasks.workunit.client.0.smithi070.stderr: -418> 2024-09-12T00:55:58.433+0000 7f2f9d60a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:58.619 INFO:tasks.workunit.client.0.smithi070.stderr: -417> 2024-09-12T00:55:58.433+0000 7f2f9d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:58.619 INFO:tasks.workunit.client.0.smithi070.stderr: -416> 2024-09-12T00:55:58.433+0000 7f2f9d60a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:55:58.619 INFO:tasks.workunit.client.0.smithi070.stderr: -415> 2024-09-12T00:55:58.433+0000 7f2f9d60a640 10 monclient: dump: 2024-09-12T00:55:58.619 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:58.619 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:58.619 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.619 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.619 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:58.619 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:58.619 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:58.619 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:58.619 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:58.619 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.619 INFO:tasks.workunit.client.0.smithi070.stderr: -414> 2024-09-12T00:55:58.433+0000 7f2f9ee0d640 4 set_mon_vals no callback set 2024-09-12T00:55:58.619 INFO:tasks.workunit.client.0.smithi070.stderr: -413> 2024-09-12T00:55:58.433+0000 7f30b2f799c0 5 monclient: authenticate success, global_id 6722 2024-09-12T00:55:58.620 INFO:tasks.workunit.client.0.smithi070.stderr: -412> 2024-09-12T00:55:58.433+0000 7f30b2f799c0 10 monclient: _renew_subs 2024-09-12T00:55:58.620 INFO:tasks.workunit.client.0.smithi070.stderr: -411> 2024-09-12T00:55:58.433+0000 7f30b2f799c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:55:58.620 INFO:tasks.workunit.client.0.smithi070.stderr: -410> 2024-09-12T00:55:58.433+0000 7f30b2f799c0 10 monclient: _renew_subs 2024-09-12T00:55:58.620 INFO:tasks.workunit.client.0.smithi070.stderr: -409> 2024-09-12T00:55:58.433+0000 7f30b2f799c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:55:58.620 INFO:tasks.workunit.client.0.smithi070.stderr: -408> 2024-09-12T00:55:58.433+0000 7f30b2f799c0 1 librados: init done 2024-09-12T00:55:58.620 INFO:tasks.workunit.client.0.smithi070.stderr: -407> 2024-09-12T00:55:58.433+0000 7f2f9d60a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:58.620 INFO:tasks.workunit.client.0.smithi070.stderr: -406> 2024-09-12T00:55:58.433+0000 7f2f9d60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:55:58.620 INFO:tasks.workunit.client.0.smithi070.stderr: -405> 2024-09-12T00:55:58.433+0000 7f2f9d60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:55:58.620 INFO:tasks.workunit.client.0.smithi070.stderr: -404> 2024-09-12T00:55:58.433+0000 7f30b1280640 10 monclient: get_auth_request con 0x563a58b9e7c0 auth_method 0 2024-09-12T00:55:58.620 INFO:tasks.workunit.client.0.smithi070.stderr: -403> 2024-09-12T00:55:58.433+0000 7f30b0a7f640 10 monclient: get_auth_request con 0x7f2f98070ae0 auth_method 0 2024-09-12T00:55:58.620 INFO:tasks.workunit.client.0.smithi070.stderr: -402> 2024-09-12T00:55:58.437+0000 7f30b0a7f640 10 monclient: get_auth_request con 0x563a58bab1e0 auth_method 0 2024-09-12T00:55:58.620 INFO:tasks.workunit.client.0.smithi070.stderr: -401> 2024-09-12T00:55:58.437+0000 7f30b027e640 10 monclient: get_auth_request con 0x563a58baf880 auth_method 0 2024-09-12T00:55:58.620 INFO:tasks.workunit.client.0.smithi070.stderr: -400> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 10 monclient: build_initial_monmap 2024-09-12T00:55:58.620 INFO:tasks.workunit.client.0.smithi070.stderr: -399> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 1 build_initial for_mkfs: 0 2024-09-12T00:55:58.621 INFO:tasks.workunit.client.0.smithi070.stderr: -398> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 10 monclient: monmap: 2024-09-12T00:55:58.621 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:55:58.621 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:58.621 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:55:58.621 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:55:58.621 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:58.621 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:58.621 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:55:58.621 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:55:58.621 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:55:58.621 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.621 INFO:tasks.workunit.client.0.smithi070.stderr: -397> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding auth protocol: cephx 2024-09-12T00:55:58.621 INFO:tasks.workunit.client.0.smithi070.stderr: -396> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding auth protocol: cephx 2024-09-12T00:55:58.621 INFO:tasks.workunit.client.0.smithi070.stderr: -395> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding auth protocol: cephx 2024-09-12T00:55:58.622 INFO:tasks.workunit.client.0.smithi070.stderr: -394> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding con mode: secure 2024-09-12T00:55:58.622 INFO:tasks.workunit.client.0.smithi070.stderr: -393> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding con mode: crc 2024-09-12T00:55:58.622 INFO:tasks.workunit.client.0.smithi070.stderr: -392> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding con mode: secure 2024-09-12T00:55:58.622 INFO:tasks.workunit.client.0.smithi070.stderr: -391> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding con mode: crc 2024-09-12T00:55:58.622 INFO:tasks.workunit.client.0.smithi070.stderr: -390> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding con mode: secure 2024-09-12T00:55:58.622 INFO:tasks.workunit.client.0.smithi070.stderr: -389> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding con mode: crc 2024-09-12T00:55:58.622 INFO:tasks.workunit.client.0.smithi070.stderr: -388> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding con mode: crc 2024-09-12T00:55:58.622 INFO:tasks.workunit.client.0.smithi070.stderr: -387> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding con mode: secure 2024-09-12T00:55:58.622 INFO:tasks.workunit.client.0.smithi070.stderr: -386> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding con mode: crc 2024-09-12T00:55:58.622 INFO:tasks.workunit.client.0.smithi070.stderr: -385> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding con mode: secure 2024-09-12T00:55:58.622 INFO:tasks.workunit.client.0.smithi070.stderr: -384> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding con mode: crc 2024-09-12T00:55:58.622 INFO:tasks.workunit.client.0.smithi070.stderr: -383> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb46b0) adding con mode: secure 2024-09-12T00:55:58.622 INFO:tasks.workunit.client.0.smithi070.stderr: -382> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:58.622 INFO:tasks.workunit.client.0.smithi070.stderr: -381> 2024-09-12T00:55:58.437+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command objecter_requests cmddesc objecter_requests hook 0x563a58bb8030 EEXIST 2024-09-12T00:55:58.623 INFO:tasks.workunit.client.0.smithi070.stderr: -380> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient: init 2024-09-12T00:55:58.623 INFO:tasks.workunit.client.0.smithi070.stderr: -379> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding auth protocol: cephx 2024-09-12T00:55:58.623 INFO:tasks.workunit.client.0.smithi070.stderr: -378> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding auth protocol: cephx 2024-09-12T00:55:58.623 INFO:tasks.workunit.client.0.smithi070.stderr: -377> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding auth protocol: cephx 2024-09-12T00:55:58.623 INFO:tasks.workunit.client.0.smithi070.stderr: -376> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding con mode: secure 2024-09-12T00:55:58.623 INFO:tasks.workunit.client.0.smithi070.stderr: -375> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding con mode: crc 2024-09-12T00:55:58.623 INFO:tasks.workunit.client.0.smithi070.stderr: -374> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding con mode: secure 2024-09-12T00:55:58.623 INFO:tasks.workunit.client.0.smithi070.stderr: -373> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding con mode: crc 2024-09-12T00:55:58.623 INFO:tasks.workunit.client.0.smithi070.stderr: -372> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding con mode: secure 2024-09-12T00:55:58.623 INFO:tasks.workunit.client.0.smithi070.stderr: -371> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding con mode: crc 2024-09-12T00:55:58.623 INFO:tasks.workunit.client.0.smithi070.stderr: -370> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding con mode: crc 2024-09-12T00:55:58.623 INFO:tasks.workunit.client.0.smithi070.stderr: -369> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding con mode: secure 2024-09-12T00:55:58.623 INFO:tasks.workunit.client.0.smithi070.stderr: -368> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding con mode: crc 2024-09-12T00:55:58.623 INFO:tasks.workunit.client.0.smithi070.stderr: -367> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding con mode: secure 2024-09-12T00:55:58.624 INFO:tasks.workunit.client.0.smithi070.stderr: -366> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding con mode: crc 2024-09-12T00:55:58.624 INFO:tasks.workunit.client.0.smithi070.stderr: -365> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bb2cd8) adding con mode: secure 2024-09-12T00:55:58.624 INFO:tasks.workunit.client.0.smithi070.stderr: -364> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:58.624 INFO:tasks.workunit.client.0.smithi070.stderr: -363> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:58.624 INFO:tasks.workunit.client.0.smithi070.stderr: -362> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command rotate-key cmddesc rotate-key hook 0x563a58bb2e20 EEXIST 2024-09-12T00:55:58.624 INFO:tasks.workunit.client.0.smithi070.stderr: -361> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient: _reopen_session rank -1 2024-09-12T00:55:58.624 INFO:tasks.workunit.client.0.smithi070.stderr: -360> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:55:58.625 INFO:tasks.workunit.client.0.smithi070.stderr: -359> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient(hunting): picked mon.noname-b con 0x563a58bdc1e0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:55:58.625 INFO:tasks.workunit.client.0.smithi070.stderr: -358> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient(hunting): picked mon.noname-c con 0x563a58bdbb10 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:55:58.625 INFO:tasks.workunit.client.0.smithi070.stderr: -357> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient(hunting): picked mon.noname-a con 0x563a58bda4f0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:55:58.625 INFO:tasks.workunit.client.0.smithi070.stderr: -356> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:58.625 INFO:tasks.workunit.client.0.smithi070.stderr: -355> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:58.625 INFO:tasks.workunit.client.0.smithi070.stderr: -354> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:58.625 INFO:tasks.workunit.client.0.smithi070.stderr: -353> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient(hunting): _renew_subs 2024-09-12T00:55:58.625 INFO:tasks.workunit.client.0.smithi070.stderr: -352> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient(hunting): authenticate will time out at 2208.888592s 2024-09-12T00:55:58.625 INFO:tasks.workunit.client.0.smithi070.stderr: -351> 2024-09-12T00:55:58.441+0000 7f30b027e640 10 monclient(hunting): get_auth_request con 0x563a58bdbb10 auth_method 0 2024-09-12T00:55:58.625 INFO:tasks.workunit.client.0.smithi070.stderr: -350> 2024-09-12T00:55:58.441+0000 7f30b027e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:58.625 INFO:tasks.workunit.client.0.smithi070.stderr: -349> 2024-09-12T00:55:58.441+0000 7f30b027e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:58.625 INFO:tasks.workunit.client.0.smithi070.stderr: -348> 2024-09-12T00:55:58.441+0000 7f30b027e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:58.625 INFO:tasks.workunit.client.0.smithi070.stderr: -347> 2024-09-12T00:55:58.441+0000 7f30b1280640 10 monclient(hunting): get_auth_request con 0x563a58bda4f0 auth_method 0 2024-09-12T00:55:58.626 INFO:tasks.workunit.client.0.smithi070.stderr: -346> 2024-09-12T00:55:58.441+0000 7f30b1280640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:58.626 INFO:tasks.workunit.client.0.smithi070.stderr: -345> 2024-09-12T00:55:58.441+0000 7f30b1280640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:58.626 INFO:tasks.workunit.client.0.smithi070.stderr: -344> 2024-09-12T00:55:58.441+0000 7f30b1280640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:58.626 INFO:tasks.workunit.client.0.smithi070.stderr: -343> 2024-09-12T00:55:58.441+0000 7f30b027e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:58.626 INFO:tasks.workunit.client.0.smithi070.stderr: -342> 2024-09-12T00:55:58.441+0000 7f30b027e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:58.626 INFO:tasks.workunit.client.0.smithi070.stderr: -341> 2024-09-12T00:55:58.441+0000 7f30b027e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:58.626 INFO:tasks.workunit.client.0.smithi070.stderr: -340> 2024-09-12T00:55:58.441+0000 7f30b1280640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:58.626 INFO:tasks.workunit.client.0.smithi070.stderr: -339> 2024-09-12T00:55:58.441+0000 7f30b1280640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:58.626 INFO:tasks.workunit.client.0.smithi070.stderr: -338> 2024-09-12T00:55:58.441+0000 7f30b1280640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:58.626 INFO:tasks.workunit.client.0.smithi070.stderr: -337> 2024-09-12T00:55:58.441+0000 7f30b027e640 10 monclient(hunting): handle_auth_done global_id 6725 payload 824 2024-09-12T00:55:58.626 INFO:tasks.workunit.client.0.smithi070.stderr: -336> 2024-09-12T00:55:58.441+0000 7f30b027e640 10 monclient: _finish_hunting 0 2024-09-12T00:55:58.626 INFO:tasks.workunit.client.0.smithi070.stderr: -335> 2024-09-12T00:55:58.441+0000 7f30b027e640 1 monclient: found mon.noname-c 2024-09-12T00:55:58.626 INFO:tasks.workunit.client.0.smithi070.stderr: -334> 2024-09-12T00:55:58.441+0000 7f30b027e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:55:58.626 INFO:tasks.workunit.client.0.smithi070.stderr: -333> 2024-09-12T00:55:58.441+0000 7f30b0a7f640 10 monclient: get_auth_request con 0x563a58bdc1e0 auth_method 0 2024-09-12T00:55:58.627 INFO:tasks.workunit.client.0.smithi070.stderr: -332> 2024-09-12T00:55:58.441+0000 7f2f967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:58.627 INFO:tasks.workunit.client.0.smithi070.stderr: -331> 2024-09-12T00:55:58.441+0000 7f2f967fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:55:58.627 INFO:tasks.workunit.client.0.smithi070.stderr: -330> 2024-09-12T00:55:58.441+0000 7f2f967fc640 10 monclient: dump: 2024-09-12T00:55:58.627 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:58.627 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:58.627 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.627 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.627 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:58.627 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:58.627 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:58.627 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:58.627 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:58.627 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.627 INFO:tasks.workunit.client.0.smithi070.stderr: -329> 2024-09-12T00:55:58.441+0000 7f2f967fc640 10 monclient: _finish_auth 0 2024-09-12T00:55:58.627 INFO:tasks.workunit.client.0.smithi070.stderr: -328> 2024-09-12T00:55:58.441+0000 7f2f967fc640 10 monclient: _check_auth_tickets 2024-09-12T00:55:58.628 INFO:tasks.workunit.client.0.smithi070.stderr: -327> 2024-09-12T00:55:58.441+0000 7f2f967fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:58.628 INFO:tasks.workunit.client.0.smithi070.stderr: -326> 2024-09-12T00:55:58.441+0000 7f2f967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:58.628 INFO:tasks.workunit.client.0.smithi070.stderr: -325> 2024-09-12T00:55:58.441+0000 7f2f967fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:55:58.628 INFO:tasks.workunit.client.0.smithi070.stderr: -324> 2024-09-12T00:55:58.441+0000 7f2f967fc640 10 monclient: dump: 2024-09-12T00:55:58.628 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:58.628 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:58.628 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.628 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.628 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:58.628 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:58.628 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:58.628 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:58.628 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:58.628 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.629 INFO:tasks.workunit.client.0.smithi070.stderr: -323> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 monclient: authenticate success, global_id 6725 2024-09-12T00:55:58.629 INFO:tasks.workunit.client.0.smithi070.stderr: -322> 2024-09-12T00:55:58.441+0000 7f30b1a81640 4 set_mon_vals no callback set 2024-09-12T00:55:58.629 INFO:tasks.workunit.client.0.smithi070.stderr: -321> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient: _renew_subs 2024-09-12T00:55:58.629 INFO:tasks.workunit.client.0.smithi070.stderr: -320> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:55:58.629 INFO:tasks.workunit.client.0.smithi070.stderr: -319> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient: _renew_subs 2024-09-12T00:55:58.629 INFO:tasks.workunit.client.0.smithi070.stderr: -318> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:55:58.629 INFO:tasks.workunit.client.0.smithi070.stderr: -317> 2024-09-12T00:55:58.441+0000 7f2f967fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:58.629 INFO:tasks.workunit.client.0.smithi070.stderr: -316> 2024-09-12T00:55:58.441+0000 7f2f967fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:55:58.629 INFO:tasks.workunit.client.0.smithi070.stderr: -315> 2024-09-12T00:55:58.441+0000 7f2f967fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:55:58.629 INFO:tasks.workunit.client.0.smithi070.stderr: -314> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient: get_monmap_and_config 2024-09-12T00:55:58.629 INFO:tasks.workunit.client.0.smithi070.stderr: -313> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient: build_initial_monmap 2024-09-12T00:55:58.629 INFO:tasks.workunit.client.0.smithi070.stderr: -312> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 1 build_initial for_mkfs: 0 2024-09-12T00:55:58.629 INFO:tasks.workunit.client.0.smithi070.stderr: -311> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient: monmap: 2024-09-12T00:55:58.629 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:55:58.630 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:58.630 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:55:58.630 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:55:58.630 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:58.630 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:58.630 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:55:58.630 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:55:58.630 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:55:58.630 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.630 INFO:tasks.workunit.client.0.smithi070.stderr: -310> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding auth protocol: cephx 2024-09-12T00:55:58.630 INFO:tasks.workunit.client.0.smithi070.stderr: -309> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding auth protocol: cephx 2024-09-12T00:55:58.630 INFO:tasks.workunit.client.0.smithi070.stderr: -308> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding auth protocol: cephx 2024-09-12T00:55:58.630 INFO:tasks.workunit.client.0.smithi070.stderr: -307> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding con mode: secure 2024-09-12T00:55:58.631 INFO:tasks.workunit.client.0.smithi070.stderr: -306> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding con mode: crc 2024-09-12T00:55:58.631 INFO:tasks.workunit.client.0.smithi070.stderr: -305> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding con mode: secure 2024-09-12T00:55:58.631 INFO:tasks.workunit.client.0.smithi070.stderr: -304> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding con mode: crc 2024-09-12T00:55:58.631 INFO:tasks.workunit.client.0.smithi070.stderr: -303> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding con mode: secure 2024-09-12T00:55:58.631 INFO:tasks.workunit.client.0.smithi070.stderr: -302> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding con mode: crc 2024-09-12T00:55:58.631 INFO:tasks.workunit.client.0.smithi070.stderr: -301> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding con mode: crc 2024-09-12T00:55:58.631 INFO:tasks.workunit.client.0.smithi070.stderr: -300> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding con mode: secure 2024-09-12T00:55:58.631 INFO:tasks.workunit.client.0.smithi070.stderr: -299> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding con mode: crc 2024-09-12T00:55:58.631 INFO:tasks.workunit.client.0.smithi070.stderr: -298> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding con mode: secure 2024-09-12T00:55:58.631 INFO:tasks.workunit.client.0.smithi070.stderr: -297> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding con mode: crc 2024-09-12T00:55:58.631 INFO:tasks.workunit.client.0.smithi070.stderr: -296> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bfb6f0) adding con mode: secure 2024-09-12T00:55:58.631 INFO:tasks.workunit.client.0.smithi070.stderr: -295> 2024-09-12T00:55:58.441+0000 7f30b0a7f640 10 monclient: get_auth_request con 0x7f2f88070a20 auth_method 0 2024-09-12T00:55:58.631 INFO:tasks.workunit.client.0.smithi070.stderr: -294> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:58.631 INFO:tasks.workunit.client.0.smithi070.stderr: -293> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 10 monclient: init 2024-09-12T00:55:58.632 INFO:tasks.workunit.client.0.smithi070.stderr: -292> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding auth protocol: cephx 2024-09-12T00:55:58.632 INFO:tasks.workunit.client.0.smithi070.stderr: -291> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding auth protocol: cephx 2024-09-12T00:55:58.632 INFO:tasks.workunit.client.0.smithi070.stderr: -290> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding auth protocol: cephx 2024-09-12T00:55:58.632 INFO:tasks.workunit.client.0.smithi070.stderr: -289> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding con mode: secure 2024-09-12T00:55:58.632 INFO:tasks.workunit.client.0.smithi070.stderr: -288> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding con mode: crc 2024-09-12T00:55:58.632 INFO:tasks.workunit.client.0.smithi070.stderr: -287> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding con mode: secure 2024-09-12T00:55:58.632 INFO:tasks.workunit.client.0.smithi070.stderr: -286> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding con mode: crc 2024-09-12T00:55:58.632 INFO:tasks.workunit.client.0.smithi070.stderr: -285> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding con mode: secure 2024-09-12T00:55:58.632 INFO:tasks.workunit.client.0.smithi070.stderr: -284> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding con mode: crc 2024-09-12T00:55:58.632 INFO:tasks.workunit.client.0.smithi070.stderr: -283> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding con mode: crc 2024-09-12T00:55:58.632 INFO:tasks.workunit.client.0.smithi070.stderr: -282> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding con mode: secure 2024-09-12T00:55:58.632 INFO:tasks.workunit.client.0.smithi070.stderr: -281> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding con mode: crc 2024-09-12T00:55:58.632 INFO:tasks.workunit.client.0.smithi070.stderr: -280> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding con mode: secure 2024-09-12T00:55:58.632 INFO:tasks.workunit.client.0.smithi070.stderr: -279> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding con mode: crc 2024-09-12T00:55:58.633 INFO:tasks.workunit.client.0.smithi070.stderr: -278> 2024-09-12T00:55:58.441+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b48210) adding con mode: secure 2024-09-12T00:55:58.633 INFO:tasks.workunit.client.0.smithi070.stderr: -277> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:58.633 INFO:tasks.workunit.client.0.smithi070.stderr: -276> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:58.633 INFO:tasks.workunit.client.0.smithi070.stderr: -275> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command rotate-key cmddesc rotate-key hook 0x7ffec8b48358 EEXIST 2024-09-12T00:55:58.633 INFO:tasks.workunit.client.0.smithi070.stderr: -274> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient: _reopen_session rank -1 2024-09-12T00:55:58.633 INFO:tasks.workunit.client.0.smithi070.stderr: -273> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:55:58.633 INFO:tasks.workunit.client.0.smithi070.stderr: -272> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): picked mon.noname-c con 0x563a58c29ea0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:55:58.633 INFO:tasks.workunit.client.0.smithi070.stderr: -271> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): picked mon.noname-b con 0x563a58c00d60 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:55:58.633 INFO:tasks.workunit.client.0.smithi070.stderr: -270> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): picked mon.noname-a con 0x563a58bffb30 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:55:58.633 INFO:tasks.workunit.client.0.smithi070.stderr: -269> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:58.633 INFO:tasks.workunit.client.0.smithi070.stderr: -268> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:58.633 INFO:tasks.workunit.client.0.smithi070.stderr: -267> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:58.633 INFO:tasks.workunit.client.0.smithi070.stderr: -266> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): _renew_subs 2024-09-12T00:55:58.633 INFO:tasks.workunit.client.0.smithi070.stderr: -265> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): authenticate will time out at 2208.892525s 2024-09-12T00:55:58.634 INFO:tasks.workunit.client.0.smithi070.stderr: -264> 2024-09-12T00:55:58.445+0000 7f30b0a7f640 10 monclient(hunting): get_auth_request con 0x563a58c29ea0 auth_method 0 2024-09-12T00:55:58.634 INFO:tasks.workunit.client.0.smithi070.stderr: -263> 2024-09-12T00:55:58.445+0000 7f30b0a7f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:58.634 INFO:tasks.workunit.client.0.smithi070.stderr: -262> 2024-09-12T00:55:58.445+0000 7f30b0a7f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:58.634 INFO:tasks.workunit.client.0.smithi070.stderr: -261> 2024-09-12T00:55:58.445+0000 7f30b0a7f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:58.634 INFO:tasks.workunit.client.0.smithi070.stderr: -260> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): get_auth_request con 0x563a58bffb30 auth_method 0 2024-09-12T00:55:58.634 INFO:tasks.workunit.client.0.smithi070.stderr: -259> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:58.634 INFO:tasks.workunit.client.0.smithi070.stderr: -258> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:58.634 INFO:tasks.workunit.client.0.smithi070.stderr: -257> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:58.634 INFO:tasks.workunit.client.0.smithi070.stderr: -256> 2024-09-12T00:55:58.445+0000 7f30b0a7f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:58.634 INFO:tasks.workunit.client.0.smithi070.stderr: -255> 2024-09-12T00:55:58.445+0000 7f30b0a7f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:58.634 INFO:tasks.workunit.client.0.smithi070.stderr: -254> 2024-09-12T00:55:58.445+0000 7f30b0a7f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:58.634 INFO:tasks.workunit.client.0.smithi070.stderr: -253> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:58.634 INFO:tasks.workunit.client.0.smithi070.stderr: -252> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:58.635 INFO:tasks.workunit.client.0.smithi070.stderr: -251> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:58.635 INFO:tasks.workunit.client.0.smithi070.stderr: -250> 2024-09-12T00:55:58.445+0000 7f30b0a7f640 10 monclient(hunting): handle_auth_done global_id 6728 payload 274 2024-09-12T00:55:58.635 INFO:tasks.workunit.client.0.smithi070.stderr: -249> 2024-09-12T00:55:58.445+0000 7f30b0a7f640 10 monclient: _finish_hunting 0 2024-09-12T00:55:58.635 INFO:tasks.workunit.client.0.smithi070.stderr: -248> 2024-09-12T00:55:58.445+0000 7f30b0a7f640 1 monclient: found mon.noname-c 2024-09-12T00:55:58.635 INFO:tasks.workunit.client.0.smithi070.stderr: -247> 2024-09-12T00:55:58.445+0000 7f30b0a7f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:55:58.635 INFO:tasks.workunit.client.0.smithi070.stderr: -246> 2024-09-12T00:55:58.445+0000 7f2f87fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:58.635 INFO:tasks.workunit.client.0.smithi070.stderr: -245> 2024-09-12T00:55:58.445+0000 7f2f87fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:55:58.635 INFO:tasks.workunit.client.0.smithi070.stderr: -244> 2024-09-12T00:55:58.445+0000 7f2f87fff640 10 monclient: dump: 2024-09-12T00:55:58.635 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:58.635 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:58.635 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.635 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.635 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:58.635 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:58.636 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:58.636 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:58.636 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:58.636 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.636 INFO:tasks.workunit.client.0.smithi070.stderr: -243> 2024-09-12T00:55:58.445+0000 7f2f87fff640 10 monclient: _finish_auth 0 2024-09-12T00:55:58.636 INFO:tasks.workunit.client.0.smithi070.stderr: -242> 2024-09-12T00:55:58.445+0000 7f2f87fff640 10 monclient: _check_auth_tickets 2024-09-12T00:55:58.636 INFO:tasks.workunit.client.0.smithi070.stderr: -241> 2024-09-12T00:55:58.445+0000 7f2f87fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:58.636 INFO:tasks.workunit.client.0.smithi070.stderr: -240> 2024-09-12T00:55:58.445+0000 7f2f87fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:58.636 INFO:tasks.workunit.client.0.smithi070.stderr: -239> 2024-09-12T00:55:58.445+0000 7f2f87fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:55:58.636 INFO:tasks.workunit.client.0.smithi070.stderr: -238> 2024-09-12T00:55:58.445+0000 7f2f87fff640 10 monclient: dump: 2024-09-12T00:55:58.636 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:58.636 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:58.636 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.636 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.637 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:58.637 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:58.637 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:58.637 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:58.637 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:58.637 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.637 INFO:tasks.workunit.client.0.smithi070.stderr: -237> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 monclient: authenticate success, global_id 6728 2024-09-12T00:55:58.637 INFO:tasks.workunit.client.0.smithi070.stderr: -236> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient: get_monmap_and_config success 2024-09-12T00:55:58.637 INFO:tasks.workunit.client.0.smithi070.stderr: -235> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 4 set_mon_vals no callback set 2024-09-12T00:55:58.637 INFO:tasks.workunit.client.0.smithi070.stderr: -234> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient: shutdown 2024-09-12T00:55:58.637 INFO:tasks.workunit.client.0.smithi070.stderr: -233> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient: build_initial_monmap 2024-09-12T00:55:58.637 INFO:tasks.workunit.client.0.smithi070.stderr: -232> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 1 build_initial for_mkfs: 0 2024-09-12T00:55:58.637 INFO:tasks.workunit.client.0.smithi070.stderr: -231> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient: monmap: 2024-09-12T00:55:58.637 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:55:58.637 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:58.638 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:55:58.638 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:55:58.638 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:58.638 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:58.638 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:55:58.638 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:55:58.638 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:55:58.638 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.638 INFO:tasks.workunit.client.0.smithi070.stderr: -230> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding auth protocol: cephx 2024-09-12T00:55:58.638 INFO:tasks.workunit.client.0.smithi070.stderr: -229> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding auth protocol: cephx 2024-09-12T00:55:58.638 INFO:tasks.workunit.client.0.smithi070.stderr: -228> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding auth protocol: cephx 2024-09-12T00:55:58.638 INFO:tasks.workunit.client.0.smithi070.stderr: -227> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding con mode: secure 2024-09-12T00:55:58.638 INFO:tasks.workunit.client.0.smithi070.stderr: -226> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding con mode: crc 2024-09-12T00:55:58.638 INFO:tasks.workunit.client.0.smithi070.stderr: -225> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding con mode: secure 2024-09-12T00:55:58.639 INFO:tasks.workunit.client.0.smithi070.stderr: -224> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding con mode: crc 2024-09-12T00:55:58.639 INFO:tasks.workunit.client.0.smithi070.stderr: -223> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding con mode: secure 2024-09-12T00:55:58.639 INFO:tasks.workunit.client.0.smithi070.stderr: -222> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding con mode: crc 2024-09-12T00:55:58.639 INFO:tasks.workunit.client.0.smithi070.stderr: -221> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding con mode: crc 2024-09-12T00:55:58.639 INFO:tasks.workunit.client.0.smithi070.stderr: -220> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding con mode: secure 2024-09-12T00:55:58.639 INFO:tasks.workunit.client.0.smithi070.stderr: -219> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding con mode: crc 2024-09-12T00:55:58.639 INFO:tasks.workunit.client.0.smithi070.stderr: -218> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding con mode: secure 2024-09-12T00:55:58.639 INFO:tasks.workunit.client.0.smithi070.stderr: -217> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding con mode: crc 2024-09-12T00:55:58.639 INFO:tasks.workunit.client.0.smithi070.stderr: -216> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58c2b040) adding con mode: secure 2024-09-12T00:55:58.639 INFO:tasks.workunit.client.0.smithi070.stderr: -215> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:58.639 INFO:tasks.workunit.client.0.smithi070.stderr: -214> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 1 librados: starting msgr at 2024-09-12T00:55:58.639 INFO:tasks.workunit.client.0.smithi070.stderr: -213> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 1 librados: starting objecter 2024-09-12T00:55:58.639 INFO:tasks.workunit.client.0.smithi070.stderr: -212> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command objecter_requests cmddesc objecter_requests hook 0x563a58c22c00 EEXIST 2024-09-12T00:55:58.639 INFO:tasks.workunit.client.0.smithi070.stderr: -211> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 1 librados: setting wanted keys 2024-09-12T00:55:58.640 INFO:tasks.workunit.client.0.smithi070.stderr: -210> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 1 librados: calling monclient init 2024-09-12T00:55:58.640 INFO:tasks.workunit.client.0.smithi070.stderr: -209> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient: init 2024-09-12T00:55:58.640 INFO:tasks.workunit.client.0.smithi070.stderr: -208> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding auth protocol: cephx 2024-09-12T00:55:58.640 INFO:tasks.workunit.client.0.smithi070.stderr: -207> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding auth protocol: cephx 2024-09-12T00:55:58.640 INFO:tasks.workunit.client.0.smithi070.stderr: -206> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding auth protocol: cephx 2024-09-12T00:55:58.640 INFO:tasks.workunit.client.0.smithi070.stderr: -205> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding con mode: secure 2024-09-12T00:55:58.640 INFO:tasks.workunit.client.0.smithi070.stderr: -204> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding con mode: crc 2024-09-12T00:55:58.640 INFO:tasks.workunit.client.0.smithi070.stderr: -203> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding con mode: secure 2024-09-12T00:55:58.640 INFO:tasks.workunit.client.0.smithi070.stderr: -202> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding con mode: crc 2024-09-12T00:55:58.640 INFO:tasks.workunit.client.0.smithi070.stderr: -201> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding con mode: secure 2024-09-12T00:55:58.640 INFO:tasks.workunit.client.0.smithi070.stderr: -200> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding con mode: crc 2024-09-12T00:55:58.640 INFO:tasks.workunit.client.0.smithi070.stderr: -199> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding con mode: crc 2024-09-12T00:55:58.640 INFO:tasks.workunit.client.0.smithi070.stderr: -198> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding con mode: secure 2024-09-12T00:55:58.641 INFO:tasks.workunit.client.0.smithi070.stderr: -197> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding con mode: crc 2024-09-12T00:55:58.641 INFO:tasks.workunit.client.0.smithi070.stderr: -196> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding con mode: secure 2024-09-12T00:55:58.641 INFO:tasks.workunit.client.0.smithi070.stderr: -195> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding con mode: crc 2024-09-12T00:55:58.641 INFO:tasks.workunit.client.0.smithi070.stderr: -194> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 AuthRegistry(0x563a58bde000) adding con mode: secure 2024-09-12T00:55:58.641 INFO:tasks.workunit.client.0.smithi070.stderr: -193> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:58.641 INFO:tasks.workunit.client.0.smithi070.stderr: -192> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:58.641 INFO:tasks.workunit.client.0.smithi070.stderr: -191> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command rotate-key cmddesc rotate-key hook 0x563a58bde148 EEXIST 2024-09-12T00:55:58.641 INFO:tasks.workunit.client.0.smithi070.stderr: -190> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient: _reopen_session rank -1 2024-09-12T00:55:58.641 INFO:tasks.workunit.client.0.smithi070.stderr: -189> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:55:58.641 INFO:tasks.workunit.client.0.smithi070.stderr: -188> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): picked mon.noname-b con 0x563a58bffb30 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:55:58.641 INFO:tasks.workunit.client.0.smithi070.stderr: -187> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): picked mon.noname-c con 0x563a58c00d60 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:55:58.641 INFO:tasks.workunit.client.0.smithi070.stderr: -186> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): picked mon.noname-a con 0x563a58c29ea0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:55:58.641 INFO:tasks.workunit.client.0.smithi070.stderr: -185> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:58.642 INFO:tasks.workunit.client.0.smithi070.stderr: -184> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:58.642 INFO:tasks.workunit.client.0.smithi070.stderr: -183> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:58.642 INFO:tasks.workunit.client.0.smithi070.stderr: -182> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): _renew_subs 2024-09-12T00:55:58.642 INFO:tasks.workunit.client.0.smithi070.stderr: -181> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient(hunting): authenticate will time out at 2208.895022s 2024-09-12T00:55:58.642 INFO:tasks.workunit.client.0.smithi070.stderr: -180> 2024-09-12T00:55:58.445+0000 7f30b027e640 10 monclient(hunting): get_auth_request con 0x563a58c00d60 auth_method 0 2024-09-12T00:55:58.642 INFO:tasks.workunit.client.0.smithi070.stderr: -179> 2024-09-12T00:55:58.445+0000 7f30b027e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:58.642 INFO:tasks.workunit.client.0.smithi070.stderr: -178> 2024-09-12T00:55:58.445+0000 7f30b027e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:58.642 INFO:tasks.workunit.client.0.smithi070.stderr: -177> 2024-09-12T00:55:58.445+0000 7f30b027e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:58.642 INFO:tasks.workunit.client.0.smithi070.stderr: -176> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): get_auth_request con 0x563a58c29ea0 auth_method 0 2024-09-12T00:55:58.642 INFO:tasks.workunit.client.0.smithi070.stderr: -175> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:58.642 INFO:tasks.workunit.client.0.smithi070.stderr: -174> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:58.642 INFO:tasks.workunit.client.0.smithi070.stderr: -173> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:58.642 INFO:tasks.workunit.client.0.smithi070.stderr: -172> 2024-09-12T00:55:58.445+0000 7f30b027e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:58.643 INFO:tasks.workunit.client.0.smithi070.stderr: -171> 2024-09-12T00:55:58.445+0000 7f30b027e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:58.643 INFO:tasks.workunit.client.0.smithi070.stderr: -170> 2024-09-12T00:55:58.445+0000 7f30b027e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:58.643 INFO:tasks.workunit.client.0.smithi070.stderr: -169> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:58.643 INFO:tasks.workunit.client.0.smithi070.stderr: -168> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:58.643 INFO:tasks.workunit.client.0.smithi070.stderr: -167> 2024-09-12T00:55:58.445+0000 7f30b1280640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:58.643 INFO:tasks.workunit.client.0.smithi070.stderr: -166> 2024-09-12T00:55:58.445+0000 7f30b027e640 10 monclient(hunting): handle_auth_done global_id 6731 payload 824 2024-09-12T00:55:58.643 INFO:tasks.workunit.client.0.smithi070.stderr: -165> 2024-09-12T00:55:58.445+0000 7f30b027e640 10 monclient: _finish_hunting 0 2024-09-12T00:55:58.643 INFO:tasks.workunit.client.0.smithi070.stderr: -164> 2024-09-12T00:55:58.445+0000 7f30b027e640 1 monclient: found mon.noname-c 2024-09-12T00:55:58.643 INFO:tasks.workunit.client.0.smithi070.stderr: -163> 2024-09-12T00:55:58.445+0000 7f30b027e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:55:58.643 INFO:tasks.workunit.client.0.smithi070.stderr: -162> 2024-09-12T00:55:58.445+0000 7f2f867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:58.643 INFO:tasks.workunit.client.0.smithi070.stderr: -161> 2024-09-12T00:55:58.445+0000 7f2f867fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:55:58.643 INFO:tasks.workunit.client.0.smithi070.stderr: -160> 2024-09-12T00:55:58.445+0000 7f2f867fc640 10 monclient: dump: 2024-09-12T00:55:58.643 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:58.643 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:58.644 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.644 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.644 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:58.644 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:58.644 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:58.644 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:58.644 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:58.644 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.644 INFO:tasks.workunit.client.0.smithi070.stderr: -159> 2024-09-12T00:55:58.445+0000 7f2f867fc640 10 monclient: _finish_auth 0 2024-09-12T00:55:58.644 INFO:tasks.workunit.client.0.smithi070.stderr: -158> 2024-09-12T00:55:58.445+0000 7f2f867fc640 10 monclient: _check_auth_tickets 2024-09-12T00:55:58.644 INFO:tasks.workunit.client.0.smithi070.stderr: -157> 2024-09-12T00:55:58.445+0000 7f2f867fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:58.644 INFO:tasks.workunit.client.0.smithi070.stderr: -156> 2024-09-12T00:55:58.445+0000 7f2f867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:58.644 INFO:tasks.workunit.client.0.smithi070.stderr: -155> 2024-09-12T00:55:58.445+0000 7f2f867fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:55:58.645 INFO:tasks.workunit.client.0.smithi070.stderr: -154> 2024-09-12T00:55:58.445+0000 7f2f867fc640 10 monclient: dump: 2024-09-12T00:55:58.645 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:55:58.645 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:55:58.645 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.645 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:55:58.645 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:58.645 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:55:58.645 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:55:58.645 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:55:58.645 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:55:58.645 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.645 INFO:tasks.workunit.client.0.smithi070.stderr: -153> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 monclient: authenticate success, global_id 6731 2024-09-12T00:55:58.645 INFO:tasks.workunit.client.0.smithi070.stderr: -152> 2024-09-12T00:55:58.445+0000 7f2f87fff640 4 set_mon_vals no callback set 2024-09-12T00:55:58.645 INFO:tasks.workunit.client.0.smithi070.stderr: -151> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient: _renew_subs 2024-09-12T00:55:58.645 INFO:tasks.workunit.client.0.smithi070.stderr: -150> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:55:58.646 INFO:tasks.workunit.client.0.smithi070.stderr: -149> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient: _renew_subs 2024-09-12T00:55:58.646 INFO:tasks.workunit.client.0.smithi070.stderr: -148> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:55:58.646 INFO:tasks.workunit.client.0.smithi070.stderr: -147> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 1 librados: init done 2024-09-12T00:55:58.646 INFO:tasks.workunit.client.0.smithi070.stderr: -146> 2024-09-12T00:55:58.445+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command cr dump hook 0x563a58c24a48 2024-09-12T00:55:58.646 INFO:tasks.workunit.client.0.smithi070.stderr: -145> 2024-09-12T00:55:58.449+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.646 INFO:tasks.workunit.client.0.smithi070.stderr: -144> 2024-09-12T00:55:58.449+0000 7f2f867fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:58.646 INFO:tasks.workunit.client.0.smithi070.stderr: -143> 2024-09-12T00:55:58.449+0000 7f2f867fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:55:58.646 INFO:tasks.workunit.client.0.smithi070.stderr: -142> 2024-09-12T00:55:58.449+0000 7f2f867fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:55:58.646 INFO:tasks.workunit.client.0.smithi070.stderr: -141> 2024-09-12T00:55:58.449+0000 7f30b1280640 10 monclient: get_auth_request con 0x563a58c49090 auth_method 0 2024-09-12T00:55:58.646 INFO:tasks.workunit.client.0.smithi070.stderr: -140> 2024-09-12T00:55:58.449+0000 7f30b0a7f640 10 monclient: get_auth_request con 0x7f2f7c070b10 auth_method 0 2024-09-12T00:55:58.646 INFO:tasks.workunit.client.0.smithi070.stderr: -139> 2024-09-12T00:55:58.449+0000 7f30b2f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.646 INFO:tasks.workunit.client.0.smithi070.stderr: -138> 2024-09-12T00:55:58.449+0000 7f30b2f799c0 20 realm 2024-09-12T00:55:58.646 INFO:tasks.workunit.client.0.smithi070.stderr: -137> 2024-09-12T00:55:58.449+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.647 INFO:tasks.workunit.client.0.smithi070.stderr: -136> 2024-09-12T00:55:58.449+0000 7f30b2f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.647 INFO:tasks.workunit.client.0.smithi070.stderr: -135> 2024-09-12T00:55:58.449+0000 7f30b2f799c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:58.647 INFO:tasks.workunit.client.0.smithi070.stderr: -134> 2024-09-12T00:55:58.449+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.647 INFO:tasks.workunit.client.0.smithi070.stderr: -133> 2024-09-12T00:55:58.449+0000 7f30b2f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.647 INFO:tasks.workunit.client.0.smithi070.stderr: -132> 2024-09-12T00:55:58.449+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.647 INFO:tasks.workunit.client.0.smithi070.stderr: -131> 2024-09-12T00:55:58.453+0000 7f30b0a7f640 10 monclient: get_auth_request con 0x563a58c4d300 auth_method 0 2024-09-12T00:55:58.647 INFO:tasks.workunit.client.0.smithi070.stderr: -130> 2024-09-12T00:55:58.453+0000 7f30b2f799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:58.647 INFO:tasks.workunit.client.0.smithi070.stderr: -129> 2024-09-12T00:55:58.453+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.647 INFO:tasks.workunit.client.0.smithi070.stderr: -128> 2024-09-12T00:55:58.453+0000 7f30b027e640 10 monclient: get_auth_request con 0x563a58c50b40 auth_method 0 2024-09-12T00:55:58.647 INFO:tasks.workunit.client.0.smithi070.stderr: -127> 2024-09-12T00:55:58.453+0000 7f30b2f799c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:58.647 INFO:tasks.workunit.client.0.smithi070.stderr: -126> 2024-09-12T00:55:58.453+0000 7f30b2f799c0 20 searching for the correct realm 2024-09-12T00:55:58.647 INFO:tasks.workunit.client.0.smithi070.stderr: -125> 2024-09-12T00:55:58.453+0000 7f30b1280640 10 monclient: get_auth_request con 0x563a58c558e0 auth_method 0 2024-09-12T00:55:58.647 INFO:tasks.workunit.client.0.smithi070.stderr: -124> 2024-09-12T00:55:58.453+0000 7f30b0a7f640 10 monclient: get_auth_request con 0x7f30a80c8040 auth_method 0 2024-09-12T00:55:58.647 INFO:tasks.workunit.client.0.smithi070.stderr: -123> 2024-09-12T00:55:58.457+0000 7f30b027e640 10 monclient: get_auth_request con 0x7f30a0008040 auth_method 0 2024-09-12T00:55:58.648 INFO:tasks.workunit.client.0.smithi070.stderr: -122> 2024-09-12T00:55:58.457+0000 7f30b1280640 10 monclient: get_auth_request con 0x7f30a4028070 auth_method 0 2024-09-12T00:55:58.648 INFO:tasks.workunit.client.0.smithi070.stderr: -121> 2024-09-12T00:55:58.457+0000 7f30b1280640 0 -- 172.21.15.70:0/233166351 >> [v2:172.21.15.70:6808/276433067,v1:172.21.15.70:6809/276433067] conn(0x563a58c558e0 msgr2=0x563a58c57da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:58.648 INFO:tasks.workunit.client.0.smithi070.stderr: -120> 2024-09-12T00:55:58.457+0000 7f2f867fc640 1 client.6731.objecter ms_handle_reset 0x563a58c558e0 session 0x563a58c55260 osd.3 2024-09-12T00:55:58.648 INFO:tasks.workunit.client.0.smithi070.stderr: -119> 2024-09-12T00:55:58.457+0000 7f2f867fc640 10 monclient: _renew_subs 2024-09-12T00:55:58.648 INFO:tasks.workunit.client.0.smithi070.stderr: -118> 2024-09-12T00:55:58.457+0000 7f2f867fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:55:58.648 INFO:tasks.workunit.client.0.smithi070.stderr: -117> 2024-09-12T00:55:58.457+0000 7f30b1280640 10 monclient: get_auth_request con 0x7f2f7c0808b0 auth_method 0 2024-09-12T00:55:58.648 INFO:tasks.workunit.client.0.smithi070.stderr: -116> 2024-09-12T00:55:58.461+0000 7f30b0a7f640 10 monclient: get_auth_request con 0x7f30a80d83c0 auth_method 0 2024-09-12T00:55:58.648 INFO:tasks.workunit.client.0.smithi070.stderr: -115> 2024-09-12T00:55:58.465+0000 7f30b0a7f640 0 -- 172.21.15.70:0/233166351 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f30a80c8040 msgr2=0x7f30a80c8930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:58.648 INFO:tasks.workunit.client.0.smithi070.stderr: -114> 2024-09-12T00:55:58.465+0000 7f2f867fc640 1 client.6731.objecter ms_handle_reset 0x7f30a80c8040 session 0x7f30a80bf040 osd.7 2024-09-12T00:55:58.648 INFO:tasks.workunit.client.0.smithi070.stderr: -113> 2024-09-12T00:55:58.465+0000 7f30b0a7f640 10 monclient: get_auth_request con 0x563a58c558e0 auth_method 0 2024-09-12T00:55:58.648 INFO:tasks.workunit.client.0.smithi070.stderr: -112> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:58.648 INFO:tasks.workunit.client.0.smithi070.stderr: -111> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:58.648 INFO:tasks.workunit.client.0.smithi070.stderr: -110> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:58.649 INFO:tasks.workunit.client.0.smithi070.stderr: -109> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:58.649 INFO:tasks.workunit.client.0.smithi070.stderr: -108> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:58.649 INFO:tasks.workunit.client.0.smithi070.stderr: -107> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:58.649 INFO:tasks.workunit.client.0.smithi070.stderr: -106> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.649 INFO:tasks.workunit.client.0.smithi070.stderr: -105> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.649 INFO:tasks.workunit.client.0.smithi070.stderr: -104> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.649 INFO:tasks.workunit.client.0.smithi070.stderr: -103> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:58.649 INFO:tasks.workunit.client.0.smithi070.stderr: -102> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.649 INFO:tasks.workunit.client.0.smithi070.stderr: -101> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:58.649 INFO:tasks.workunit.client.0.smithi070.stderr: -100> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 zone default found 2024-09-12T00:55:58.649 INFO:tasks.workunit.client.0.smithi070.stderr: -99> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 4 Realm: () 2024-09-12T00:55:58.649 INFO:tasks.workunit.client.0.smithi070.stderr: -98> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:58.649 INFO:tasks.workunit.client.0.smithi070.stderr: -97> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:58.649 INFO:tasks.workunit.client.0.smithi070.stderr: -96> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:58.650 INFO:tasks.workunit.client.0.smithi070.stderr: -95> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 zonegroup default 2024-09-12T00:55:58.650 INFO:tasks.workunit.client.0.smithi070.stderr: -94> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.650 INFO:tasks.workunit.client.0.smithi070.stderr: -93> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.650 INFO:tasks.workunit.client.0.smithi070.stderr: -92> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.650 INFO:tasks.workunit.client.0.smithi070.stderr: -91> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.650 INFO:tasks.workunit.client.0.smithi070.stderr: -90> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.650 INFO:tasks.workunit.client.0.smithi070.stderr: -89> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.650 INFO:tasks.workunit.client.0.smithi070.stderr: -88> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 started sync module instance, tier type = 2024-09-12T00:55:58.650 INFO:tasks.workunit.client.0.smithi070.stderr: -87> 2024-09-12T00:55:58.473+0000 7f30b2f799c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:58.650 INFO:tasks.workunit.client.0.smithi070.stderr: -86> 2024-09-12T00:55:58.489+0000 7f30b2f799c0 20 add_watcher() i=0 2024-09-12T00:55:58.650 INFO:tasks.workunit.client.0.smithi070.stderr: -85> 2024-09-12T00:55:58.489+0000 7f30b2f799c0 20 add_watcher() i=1 2024-09-12T00:55:58.650 INFO:tasks.workunit.client.0.smithi070.stderr: -84> 2024-09-12T00:55:58.489+0000 7f30b2f799c0 20 add_watcher() i=2 2024-09-12T00:55:58.650 INFO:tasks.workunit.client.0.smithi070.stderr: -83> 2024-09-12T00:55:58.489+0000 7f30b2f799c0 20 add_watcher() i=3 2024-09-12T00:55:58.650 INFO:tasks.workunit.client.0.smithi070.stderr: -82> 2024-09-12T00:55:58.489+0000 7f30b2f799c0 20 add_watcher() i=4 2024-09-12T00:55:58.651 INFO:tasks.workunit.client.0.smithi070.stderr: -81> 2024-09-12T00:55:58.489+0000 7f30b2f799c0 20 add_watcher() i=5 2024-09-12T00:55:58.651 INFO:tasks.workunit.client.0.smithi070.stderr: -80> 2024-09-12T00:55:58.489+0000 7f30b2f799c0 20 add_watcher() i=6 2024-09-12T00:55:58.651 INFO:tasks.workunit.client.0.smithi070.stderr: -79> 2024-09-12T00:55:58.489+0000 7f30b2f799c0 20 add_watcher() i=7 2024-09-12T00:55:58.651 INFO:tasks.workunit.client.0.smithi070.stderr: -78> 2024-09-12T00:55:58.489+0000 7f30b2f799c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:58.651 INFO:tasks.workunit.client.0.smithi070.stderr: -77> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding auth protocol: cephx 2024-09-12T00:55:58.651 INFO:tasks.workunit.client.0.smithi070.stderr: -76> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding auth protocol: cephx 2024-09-12T00:55:58.651 INFO:tasks.workunit.client.0.smithi070.stderr: -75> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding auth protocol: cephx 2024-09-12T00:55:58.651 INFO:tasks.workunit.client.0.smithi070.stderr: -74> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding con mode: secure 2024-09-12T00:55:58.651 INFO:tasks.workunit.client.0.smithi070.stderr: -73> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding con mode: crc 2024-09-12T00:55:58.651 INFO:tasks.workunit.client.0.smithi070.stderr: -72> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding con mode: secure 2024-09-12T00:55:58.651 INFO:tasks.workunit.client.0.smithi070.stderr: -71> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding con mode: crc 2024-09-12T00:55:58.651 INFO:tasks.workunit.client.0.smithi070.stderr: -70> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding con mode: secure 2024-09-12T00:55:58.651 INFO:tasks.workunit.client.0.smithi070.stderr: -69> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding con mode: crc 2024-09-12T00:55:58.651 INFO:tasks.workunit.client.0.smithi070.stderr: -68> 2024-09-12T00:55:58.493+0000 7f2f66fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:58.652 INFO:tasks.workunit.client.0.smithi070.stderr: -67> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding con mode: crc 2024-09-12T00:55:58.652 INFO:tasks.workunit.client.0.smithi070.stderr: -66> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding con mode: secure 2024-09-12T00:55:58.652 INFO:tasks.workunit.client.0.smithi070.stderr: -65> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding con mode: crc 2024-09-12T00:55:58.652 INFO:tasks.workunit.client.0.smithi070.stderr: -64> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding con mode: secure 2024-09-12T00:55:58.652 INFO:tasks.workunit.client.0.smithi070.stderr: -63> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding con mode: crc 2024-09-12T00:55:58.652 INFO:tasks.workunit.client.0.smithi070.stderr: -62> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 AuthRegistry(0x7ffec8b486f0) adding con mode: secure 2024-09-12T00:55:58.652 INFO:tasks.workunit.client.0.smithi070.stderr: -61> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:58.652 INFO:tasks.workunit.client.0.smithi070.stderr: -60> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:58.652 INFO:tasks.workunit.client.0.smithi070.stderr: -59> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:58.652 INFO:tasks.workunit.client.0.smithi070.stderr: -58> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command cache list hook 0x563a58bfe690 2024-09-12T00:55:58.652 INFO:tasks.workunit.client.0.smithi070.stderr: -57> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command cache inspect hook 0x563a58bfe690 2024-09-12T00:55:58.652 INFO:tasks.workunit.client.0.smithi070.stderr: -56> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command cache erase hook 0x563a58bfe690 2024-09-12T00:55:58.652 INFO:tasks.workunit.client.0.smithi070.stderr: -55> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command cache zap hook 0x563a58bfe690 2024-09-12T00:55:58.652 INFO:tasks.workunit.client.0.smithi070.stderr: -54> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 note: GC not initialized 2024-09-12T00:55:58.653 INFO:tasks.workunit.client.0.smithi070.stderr: -53> 2024-09-12T00:55:58.493+0000 7f2f65fe3640 20 reqs_thread_entry: start 2024-09-12T00:55:58.653 INFO:tasks.workunit.client.0.smithi070.stderr: -52> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command sync trace show hook 0x7f30a000d470 2024-09-12T00:55:58.653 INFO:tasks.workunit.client.0.smithi070.stderr: -51> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command sync trace history hook 0x7f30a000d470 2024-09-12T00:55:58.653 INFO:tasks.workunit.client.0.smithi070.stderr: -50> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command sync trace active hook 0x7f30a000d470 2024-09-12T00:55:58.653 INFO:tasks.workunit.client.0.smithi070.stderr: -49> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 5 asok(0x563a589532b0) register_command sync trace active_short hook 0x7f30a000d470 2024-09-12T00:55:58.653 INFO:tasks.workunit.client.0.smithi070.stderr: -48> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:58.653 INFO:tasks.workunit.client.0.smithi070.stderr: -47> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 20 Filter name: none 2024-09-12T00:55:58.653 INFO:tasks.workunit.client.0.smithi070.stderr: -46> 2024-09-12T00:55:58.493+0000 7f2ed77fe640 20 reqs_thread_entry: start 2024-09-12T00:55:58.653 INFO:tasks.workunit.client.0.smithi070.stderr: -45> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:55:58.653 INFO:tasks.workunit.client.0.smithi070.stderr: -44> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.653 INFO:tasks.workunit.client.0.smithi070.stderr: -43> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:55:58.653 INFO:tasks.workunit.client.0.smithi070.stderr: -42> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:55:58.653 INFO:tasks.workunit.client.0.smithi070.stderr: -41> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:55:58.653 INFO:tasks.workunit.client.0.smithi070.stderr: -40> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 : miss 2024-09-12T00:55:58.654 INFO:tasks.workunit.client.0.smithi070.stderr: -39> 2024-09-12T00:55:58.493+0000 7f30b2f799c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.654 INFO:tasks.workunit.client.0.smithi070.stderr: -38> 2024-09-12T00:55:58.497+0000 7f30b2f799c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:55:58.654 INFO:tasks.workunit.client.0.smithi070.stderr: -37> 2024-09-12T00:55:58.497+0000 7f30b2f799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 info.flags=0x17 2024-09-12T00:55:58.654 INFO:tasks.workunit.client.0.smithi070.stderr: -36> 2024-09-12T00:55:58.497+0000 7f30b2f799c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 to cache LRU end 2024-09-12T00:55:58.654 INFO:tasks.workunit.client.0.smithi070.stderr: -35> 2024-09-12T00:55:58.497+0000 7f30b2f799c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:58.654 INFO:tasks.workunit.client.0.smithi070.stderr: -34> 2024-09-12T00:55:58.497+0000 7f30b2f799c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:58.654 INFO:tasks.workunit.client.0.smithi070.stderr: -33> 2024-09-12T00:55:58.497+0000 7f30b2f799c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 2024-09-12T00:55:58.654 INFO:tasks.workunit.client.0.smithi070.stderr: -32> 2024-09-12T00:55:58.501+0000 7f30b2f799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 info.flags=0x17 2024-09-12T00:55:58.654 INFO:tasks.workunit.client.0.smithi070.stderr: -31> 2024-09-12T00:55:58.501+0000 7f30b2f799c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 to cache LRU end 2024-09-12T00:55:58.654 INFO:tasks.workunit.client.0.smithi070.stderr: -30> 2024-09-12T00:55:58.501+0000 7f30b2f799c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:58.654 INFO:tasks.workunit.client.0.smithi070.stderr: -29> 2024-09-12T00:55:58.501+0000 7f30b2f799c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30, ofs0, ns] 2024-09-12T00:55:58.654 INFO:tasks.workunit.client.0.smithi070.stderr: -28> 2024-09-12T00:55:58.501+0000 7f2f87fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431617 cookie 94808597446064 notifier 6731 bl.length()=999 2024-09-12T00:55:58.654 INFO:tasks.workunit.client.0.smithi070.stderr: -27> 2024-09-12T00:55:58.501+0000 7f2f87fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 info.flags=0x17 2024-09-12T00:55:58.655 INFO:tasks.workunit.client.0.smithi070.stderr: -26> 2024-09-12T00:55:58.501+0000 7f2f87fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 to cache LRU end 2024-09-12T00:55:58.655 INFO:tasks.workunit.client.0.smithi070.stderr: -25> 2024-09-12T00:55:58.501+0000 7f2f87fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:58.655 INFO:tasks.workunit.client.0.smithi070.stderr: -24> 2024-09-12T00:55:58.501+0000 7f30b2f799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): orig_sources= new_sources= 2024-09-12T00:55:58.655 INFO:tasks.workunit.client.0.smithi070.stderr: -23> 2024-09-12T00:55:58.501+0000 7f30b2f799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): potential sources added=[] removed=[] 2024-09-12T00:55:58.655 INFO:tasks.workunit.client.0.smithi070.stderr: -22> 2024-09-12T00:55:58.501+0000 7f30b2f799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): orig_dests= new_dests= 2024-09-12T00:55:58.655 INFO:tasks.workunit.client.0.smithi070.stderr: -21> 2024-09-12T00:55:58.501+0000 7f30b2f799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): potential dests added=[] removed=[] 2024-09-12T00:55:58.655 INFO:tasks.workunit.client.0.smithi070.stderr: -20> 2024-09-12T00:55:58.505+0000 7f30b2f799c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30.1.0 2024-09-12T00:55:58.655 INFO:tasks.workunit.client.0.smithi070.stderr: -19> 2024-09-12T00:55:58.505+0000 7f30b2f799c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30.1.0 2024-09-12T00:55:58.655 INFO:tasks.workunit.client.0.smithi070.stderr: -18> 2024-09-12T00:55:58.505+0000 7f30b2f799c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30.1.1 2024-09-12T00:55:58.655 INFO:tasks.workunit.client.0.smithi070.stderr: -17> 2024-09-12T00:55:58.505+0000 7f30b2f799c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30.1.1 2024-09-12T00:55:58.655 INFO:tasks.workunit.client.0.smithi070.stderr: -16> 2024-09-12T00:55:58.505+0000 7f30b2f799c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30.0 2024-09-12T00:55:58.655 INFO:tasks.workunit.client.0.smithi070.stderr: -15> 2024-09-12T00:55:58.509+0000 7f30b2f799c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:55:58.655 INFO:tasks.workunit.client.0.smithi070.stderr: -14> 2024-09-12T00:55:58.509+0000 7f30b2f799c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 2024-09-12T00:55:58.655 INFO:tasks.workunit.client.0.smithi070.stderr: -13> 2024-09-12T00:55:58.513+0000 7f30b2f799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 info.flags=0x17 2024-09-12T00:55:58.656 INFO:tasks.workunit.client.0.smithi070.stderr: -12> 2024-09-12T00:55:58.513+0000 7f30b2f799c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 to cache LRU end 2024-09-12T00:55:58.656 INFO:tasks.workunit.client.0.smithi070.stderr: -11> 2024-09-12T00:55:58.513+0000 7f30b2f799c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:58.656 INFO:tasks.workunit.client.0.smithi070.stderr: -10> 2024-09-12T00:55:58.513+0000 7f30b2f799c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30, ofs0, ns] 2024-09-12T00:55:58.656 INFO:tasks.workunit.client.0.smithi070.stderr: -9> 2024-09-12T00:55:58.513+0000 7f2f87fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431618 cookie 94808597446064 notifier 6731 bl.length()=999 2024-09-12T00:55:58.656 INFO:tasks.workunit.client.0.smithi070.stderr: -8> 2024-09-12T00:55:58.513+0000 7f2f87fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 info.flags=0x17 2024-09-12T00:55:58.656 INFO:tasks.workunit.client.0.smithi070.stderr: -7> 2024-09-12T00:55:58.513+0000 7f2f87fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 to cache LRU end 2024-09-12T00:55:58.656 INFO:tasks.workunit.client.0.smithi070.stderr: -6> 2024-09-12T00:55:58.513+0000 7f2f87fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:58.656 INFO:tasks.workunit.client.0.smithi070.stderr: -5> 2024-09-12T00:55:58.513+0000 7f30b2f799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): orig_sources= new_sources= 2024-09-12T00:55:58.656 INFO:tasks.workunit.client.0.smithi070.stderr: -4> 2024-09-12T00:55:58.513+0000 7f30b2f799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): potential sources added=[] removed=[] 2024-09-12T00:55:58.656 INFO:tasks.workunit.client.0.smithi070.stderr: -3> 2024-09-12T00:55:58.513+0000 7f30b2f799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): orig_dests= new_dests= 2024-09-12T00:55:58.656 INFO:tasks.workunit.client.0.smithi070.stderr: -2> 2024-09-12T00:55:58.513+0000 7f30b2f799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): potential dests added=[] removed=[] 2024-09-12T00:55:58.656 INFO:tasks.workunit.client.0.smithi070.stderr: -1> 2024-09-12T00:55:58.513+0000 7f30b2f799c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f30b2f799c0 time 2024-09-12T00:55:58.516539+0000 2024-09-12T00:55:58.656 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:55:58.656 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.657 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:58.657 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f30b68532eb] 2024-09-12T00:55:58.657 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f30b685349f] 2024-09-12T00:55:58.657 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a5717ecc1] 2024-09-12T00:55:58.657 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x563a57193086] 2024-09-12T00:55:58.657 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563a571946a4] 2024-09-12T00:55:58.657 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:55:58.657 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f30b56b9d90] 2024-09-12T00:55:58.657 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:55:58.657 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:55:58.657 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.657 INFO:tasks.workunit.client.0.smithi070.stderr: 0> 2024-09-12T00:55:58.517+0000 7f30b2f799c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:55:58.657 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f30b2f799c0 thread_name:radosgw-admin 2024-09-12T00:55:58.658 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.658 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:58.658 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f30b56d2520] 2024-09-12T00:55:58.658 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:55:58.658 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:55:58.658 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:55:58.658 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f30b6853345] 2024-09-12T00:55:58.658 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f30b685349f] 2024-09-12T00:55:58.658 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a5717ecc1] 2024-09-12T00:55:58.658 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x563a57193086] 2024-09-12T00:55:58.658 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563a571946a4] 2024-09-12T00:55:58.658 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:55:58.658 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f30b56b9d90] 2024-09-12T00:55:58.659 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:55:58.659 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:55:58.659 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:55:58.659 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.659 INFO:tasks.workunit.client.0.smithi070.stderr:--- logging levels --- 2024-09-12T00:55:58.659 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 none 2024-09-12T00:55:58.659 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 lockdep 2024-09-12T00:55:58.659 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 context 2024-09-12T00:55:58.659 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 crush 2024-09-12T00:55:58.659 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds 2024-09-12T00:55:58.659 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_balancer 2024-09-12T00:55:58.659 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_locker 2024-09-12T00:55:58.659 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log 2024-09-12T00:55:58.659 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log_expire 2024-09-12T00:55:58.660 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_migrator 2024-09-12T00:55:58.660 INFO:tasks.workunit.client.0.smithi070.stderr: 3/ 5 mds_quiesce 2024-09-12T00:55:58.660 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 buffer 2024-09-12T00:55:58.660 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 timer 2024-09-12T00:55:58.660 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 filer 2024-09-12T00:55:58.660 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 striper 2024-09-12T00:55:58.660 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 objecter 2024-09-12T00:55:58.660 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rados 2024-09-12T00:55:58.660 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd 2024-09-12T00:55:58.660 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_mirror 2024-09-12T00:55:58.660 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_replay 2024-09-12T00:55:58.660 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_pwl 2024-09-12T00:55:58.660 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 journaler 2024-09-12T00:55:58.660 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objectcacher 2024-09-12T00:55:58.661 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:55:58.661 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 client 2024-09-12T00:55:58.661 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 osd 2024-09-12T00:55:58.661 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 optracker 2024-09-12T00:55:58.661 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objclass 2024-09-12T00:55:58.661 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 filestore 2024-09-12T00:55:58.661 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 journal 2024-09-12T00:55:58.661 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 ms 2024-09-12T00:55:58.661 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mon 2024-09-12T00:55:58.661 INFO:tasks.workunit.client.0.smithi070.stderr: 0/10 monc 2024-09-12T00:55:58.661 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 paxos 2024-09-12T00:55:58.661 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 tp 2024-09-12T00:55:58.661 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 auth 2024-09-12T00:55:58.661 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 crypto 2024-09-12T00:55:58.662 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 finisher 2024-09-12T00:55:58.662 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 reserver 2024-09-12T00:55:58.662 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 heartbeatmap 2024-09-12T00:55:58.662 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 perfcounter 2024-09-12T00:55:58.662 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw 2024-09-12T00:55:58.662 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_sync 2024-09-12T00:55:58.662 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_datacache 2024-09-12T00:55:58.662 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_access 2024-09-12T00:55:58.662 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:55:58.662 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_flight 2024-09-12T00:55:58.662 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:55:58.662 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw_notification 2024-09-12T00:55:58.662 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 javaclient 2024-09-12T00:55:58.662 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 asok 2024-09-12T00:55:58.663 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 throttle 2024-09-12T00:55:58.663 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 refs 2024-09-12T00:55:58.663 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 compressor 2024-09-12T00:55:58.663 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluestore 2024-09-12T00:55:58.663 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluefs 2024-09-12T00:55:58.663 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 bdev 2024-09-12T00:55:58.663 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 kstore 2024-09-12T00:55:58.663 INFO:tasks.workunit.client.0.smithi070.stderr: 4/ 5 rocksdb 2024-09-12T00:55:58.663 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 fuse 2024-09-12T00:55:58.663 INFO:tasks.workunit.client.0.smithi070.stderr: 2/ 5 mgr 2024-09-12T00:55:58.663 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mgrc 2024-09-12T00:55:58.663 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 dpdk 2024-09-12T00:55:58.663 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 eventtrace 2024-09-12T00:55:58.663 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 prioritycache 2024-09-12T00:55:58.664 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 test 2024-09-12T00:55:58.664 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:55:58.664 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephsqlite 2024-09-12T00:55:58.664 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:55:58.664 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore 2024-09-12T00:55:58.664 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_onode 2024-09-12T00:55:58.664 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_odata 2024-09-12T00:55:58.664 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_omap 2024-09-12T00:55:58.664 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_tm 2024-09-12T00:55:58.664 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_t 2024-09-12T00:55:58.664 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:55:58.664 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_epm 2024-09-12T00:55:58.664 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_lba 2024-09-12T00:55:58.664 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:55:58.664 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cache 2024-09-12T00:55:58.665 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_journal 2024-09-12T00:55:58.665 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_device 2024-09-12T00:55:58.665 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_backref 2024-09-12T00:55:58.665 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 alienstore 2024-09-12T00:55:58.665 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mclock 2024-09-12T00:55:58.665 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cyanstore 2024-09-12T00:55:58.665 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 ceph_exporter 2024-09-12T00:55:58.665 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 memstore 2024-09-12T00:55:58.665 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 trace 2024-09-12T00:55:58.665 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 ceph_dedup 2024-09-12T00:55:58.665 INFO:tasks.workunit.client.0.smithi070.stderr: -2/-2 (syslog threshold) 2024-09-12T00:55:58.665 INFO:tasks.workunit.client.0.smithi070.stderr: 99/99 (stderr threshold) 2024-09-12T00:55:58.665 INFO:tasks.workunit.client.0.smithi070.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:55:58.666 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2ed77fe640 / http_manager 2024-09-12T00:55:58.666 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2f65fe3640 / http_manager 2024-09-12T00:55:58.666 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2f66fe5640 / rgw_dt_lg_renew 2024-09-12T00:55:58.666 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2f867fc640 / ms_dispatch 2024-09-12T00:55:58.666 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2f87fff640 / io_context_pool 2024-09-12T00:55:58.666 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2f967fc640 / ms_dispatch 2024-09-12T00:55:58.666 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2f9d60a640 / ms_dispatch 2024-09-12T00:55:58.666 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2f9ee0d640 / io_context_pool 2024-09-12T00:55:58.667 INFO:tasks.workunit.client.0.smithi070.stderr: 7f30b027e640 / msgr-worker-2 2024-09-12T00:55:58.667 INFO:tasks.workunit.client.0.smithi070.stderr: 7f30b0a7f640 / msgr-worker-1 2024-09-12T00:55:58.668 INFO:tasks.workunit.client.0.smithi070.stderr: 7f30b1280640 / msgr-worker-0 2024-09-12T00:55:58.668 INFO:tasks.workunit.client.0.smithi070.stderr: 7f30b1a81640 / io_context_pool 2024-09-12T00:55:58.668 INFO:tasks.workunit.client.0.smithi070.stderr: 7f30b2f799c0 / radosgw-admin 2024-09-12T00:55:58.668 INFO:tasks.workunit.client.0.smithi070.stderr: max_recent 500 2024-09-12T00:55:58.668 INFO:tasks.workunit.client.0.smithi070.stderr: max_new 1000 2024-09-12T00:55:58.668 INFO:tasks.workunit.client.0.smithi070.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:55:58.518885Z_4fc26eaf-85bb-4c87-9af6-29e94d4c48ea/log 2024-09-12T00:55:58.668 INFO:tasks.workunit.client.0.smithi070.stderr:--- end dump of recent events --- 2024-09-12T00:55:58.668 INFO:tasks.workunit.client.0.smithi070.stderr:Aborted 2024-09-12T00:55:58.668 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:55:58.668 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:58.668 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:58.673 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.593+0000 7f67dec039c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.673 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.593+0000 7f67dec039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.673 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.593+0000 7f67dec039c0 20 realm 2024-09-12T00:55:58.673 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.593+0000 7f67dec039c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.673 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.593+0000 7f67dec039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.593+0000 7f67dec039c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:58.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.593+0000 7f67dec039c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.593+0000 7f67dec039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.593+0000 7f67dec039c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.597+0000 7f67dec039c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:58.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.597+0000 7f67dec039c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.597+0000 7f67dec039c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:58.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.597+0000 7f67dec039c0 20 searching for the correct realm 2024-09-12T00:55:58.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.601+0000 7f67dcf0a640 0 -- 172.21.15.70:0/1123022556 >> [v2:172.21.15.70:6808/276433067,v1:172.21.15.70:6809/276433067] conn(0x56266270ecf0 msgr2=0x5626627111b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:58.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.609+0000 7f67dcf0a640 0 -- 172.21.15.70:0/1123022556 >> [v2:172.21.15.70:6816/1979013808,v1:172.21.15.70:6817/1979013808] conn(0x5626627024e0 msgr2=0x562662704950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:58.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.617+0000 7f67dec039c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:58.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.617+0000 7f67dec039c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:58.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.617+0000 7f67dec039c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:58.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.617+0000 7f67dec039c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:58.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.617+0000 7f67dec039c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:58.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.617+0000 7f67dec039c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:58.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.617+0000 7f67dec039c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.617+0000 7f67dec039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.617+0000 7f67dec039c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.617+0000 7f67dec039c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:58.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.617+0000 7f67dec039c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.617+0000 7f67dec039c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:58.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.617+0000 7f67dec039c0 20 zone default found 2024-09-12T00:55:58.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.617+0000 7f67dec039c0 4 Realm: () 2024-09-12T00:55:58.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.617+0000 7f67dec039c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:58.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.617+0000 7f67dec039c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:58.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.617+0000 7f67dec039c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:58.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.617+0000 7f67dec039c0 20 zonegroup default 2024-09-12T00:55:58.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.617+0000 7f67dec039c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.617+0000 7f67dec039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.617+0000 7f67dec039c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.617+0000 7f67dec039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.617+0000 7f67dec039c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.617+0000 7f67dec039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.617+0000 7f67dec039c0 20 started sync module instance, tier type = 2024-09-12T00:55:58.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.617+0000 7f67dec039c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:58.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.633+0000 7f67dec039c0 20 add_watcher() i=0 2024-09-12T00:55:58.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.633+0000 7f67dec039c0 20 add_watcher() i=1 2024-09-12T00:55:58.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.633+0000 7f67dec039c0 20 add_watcher() i=2 2024-09-12T00:55:58.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.633+0000 7f67dec039c0 20 add_watcher() i=3 2024-09-12T00:55:58.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.633+0000 7f67dec039c0 20 add_watcher() i=4 2024-09-12T00:55:58.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.633+0000 7f67dec039c0 20 add_watcher() i=5 2024-09-12T00:55:58.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.633+0000 7f67dec039c0 20 add_watcher() i=6 2024-09-12T00:55:58.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.633+0000 7f67dec039c0 20 add_watcher() i=7 2024-09-12T00:55:58.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.633+0000 7f67dec039c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:58.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.637+0000 7f66927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:58.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.637+0000 7f67dec039c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:58.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.637+0000 7f67dec039c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:58.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.637+0000 7f67dec039c0 5 note: GC not initialized 2024-09-12T00:55:58.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.637+0000 7f66917e2640 20 reqs_thread_entry: start 2024-09-12T00:55:58.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.637+0000 7f67dec039c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:58.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.637+0000 7f67dec039c0 20 Filter name: none 2024-09-12T00:55:58.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.637+0000 7f6602ffd640 20 reqs_thread_entry: start 2024-09-12T00:55:58.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.637+0000 7f67dec039c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.637+0000 7f67dec039c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:55:58.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.637+0000 7f67dec039c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.637+0000 7f67dec039c0 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T00:55:58.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.637+0000 7f67dec039c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:58.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.637+0000 7f67dec039c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.641+0000 7f67dec039c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:55:58.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.641+0000 7f67dec039c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.641+0000 7f67dec039c0 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T00:55:58.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.641+0000 7f67dec039c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:58.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.641+0000 7f66927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:58.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.645+0000 7f67dec039c0 20 remove_watcher() i=0 2024-09-12T00:55:58.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.645+0000 7f67dec039c0 2 removed watcher, disabling cache 2024-09-12T00:55:58.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.649+0000 7f67dec039c0 20 remove_watcher() i=1 2024-09-12T00:55:58.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.649+0000 7f67dec039c0 20 remove_watcher() i=2 2024-09-12T00:55:58.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.653+0000 7f67dec039c0 20 remove_watcher() i=3 2024-09-12T00:55:58.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.653+0000 7f67dec039c0 20 remove_watcher() i=4 2024-09-12T00:55:58.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.657+0000 7f67dec039c0 20 remove_watcher() i=5 2024-09-12T00:55:58.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.657+0000 7f67dec039c0 20 remove_watcher() i=6 2024-09-12T00:55:58.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.657+0000 7f67dec039c0 20 remove_watcher() i=7 2024-09-12T00:55:58.679 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.679 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:55:58.679 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: abort-at-block-writes id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:55:58.679 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:55:58.679 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:58.679 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:58.679 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:55:58.680 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:55:58.721 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:55:58.753 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:58.753 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:58.796 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.805+0000 7fe8086939c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.798 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.805+0000 7fe8086939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.798 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.805+0000 7fe8086939c0 20 realm 2024-09-12T00:55:58.798 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.805+0000 7fe8086939c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.798 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.805+0000 7fe8086939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.798 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.805+0000 7fe8086939c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:58.798 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.805+0000 7fe8086939c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.799 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.805+0000 7fe8086939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:58.799 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.805+0000 7fe8086939c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.800 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.809+0000 7fe8086939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:58.800 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.809+0000 7fe8086939c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:58.801 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.809+0000 7fe8086939c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:58.801 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.809+0000 7fe8086939c0 20 searching for the correct realm 2024-09-12T00:55:58.803 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:58.809+0000 7fe806199640 0 -- 172.21.15.70:0/1998604745 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x5624db9394d0 msgr2=0x7fe8000c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:59.013 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.021+0000 7fe80699a640 0 -- 172.21.15.70:0/1998604745 >> [v2:172.21.15.70:6816/1979013808,v1:172.21.15.70:6817/1979013808] conn(0x5624dbb708f0 msgr2=0x5624dbb72d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:59.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.041+0000 7fe8086939c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:59.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.041+0000 7fe8086939c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:55:59.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.041+0000 7fe8086939c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:59.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.041+0000 7fe8086939c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:55:59.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.041+0000 7fe8086939c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:59.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.041+0000 7fe8086939c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:59.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.041+0000 7fe8086939c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:59.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.041+0000 7fe8086939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:59.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.041+0000 7fe8086939c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:59.037 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.041+0000 7fe8086939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:59.037 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.041+0000 7fe8086939c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:59.038 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.045+0000 7fe8086939c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:59.038 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.045+0000 7fe8086939c0 20 zone default found 2024-09-12T00:55:59.038 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.045+0000 7fe8086939c0 4 Realm: () 2024-09-12T00:55:59.038 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.045+0000 7fe8086939c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:55:59.038 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.045+0000 7fe8086939c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:55:59.038 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.045+0000 7fe8086939c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:59.038 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.045+0000 7fe8086939c0 20 zonegroup default 2024-09-12T00:55:59.038 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.045+0000 7fe8086939c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:59.039 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.045+0000 7fe8086939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:59.039 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.045+0000 7fe8086939c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:59.039 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.045+0000 7fe8086939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:59.039 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.045+0000 7fe8086939c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:59.039 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.045+0000 7fe8086939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:59.039 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.045+0000 7fe8086939c0 20 started sync module instance, tier type = 2024-09-12T00:55:59.039 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.045+0000 7fe8086939c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:55:59.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.069+0000 7fe8086939c0 20 add_watcher() i=0 2024-09-12T00:55:59.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.069+0000 7fe8086939c0 20 add_watcher() i=1 2024-09-12T00:55:59.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.069+0000 7fe8086939c0 20 add_watcher() i=2 2024-09-12T00:55:59.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.069+0000 7fe8086939c0 20 add_watcher() i=3 2024-09-12T00:55:59.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.069+0000 7fe8086939c0 20 add_watcher() i=4 2024-09-12T00:55:59.060 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.069+0000 7fe8086939c0 20 add_watcher() i=5 2024-09-12T00:55:59.061 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.069+0000 7fe8086939c0 20 add_watcher() i=6 2024-09-12T00:55:59.061 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.069+0000 7fe8086939c0 20 add_watcher() i=7 2024-09-12T00:55:59.061 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.069+0000 7fe8086939c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:59.064 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.073+0000 7fe6bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:59.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.073+0000 7fe8086939c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:59.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.073+0000 7fe8086939c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:59.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.073+0000 7fe8086939c0 5 note: GC not initialized 2024-09-12T00:55:59.066 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.073+0000 7fe6377fe640 20 reqs_thread_entry: start 2024-09-12T00:55:59.066 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.073+0000 7fe8086939c0 20 init_complete bucket index max shards: 1 2024-09-12T00:55:59.066 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.073+0000 7fe8086939c0 20 Filter name: none 2024-09-12T00:55:59.066 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.073+0000 7fe6357fa640 20 reqs_thread_entry: start 2024-09-12T00:55:59.067 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.073+0000 7fe8086939c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:55:59.067 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.073+0000 7fe8086939c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:59.067 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.073+0000 7fe8086939c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:55:59.067 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.073+0000 7fe8086939c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:55:59.067 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.073+0000 7fe8086939c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:55:59.067 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.073+0000 7fe8086939c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 : miss 2024-09-12T00:55:59.067 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.073+0000 7fe8086939c0 20 rados->read ofs=0 len=0 2024-09-12T00:55:59.068 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.073+0000 7fe8086939c0 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T00:55:59.068 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.073+0000 7fe8086939c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 info.flags=0x17 2024-09-12T00:55:59.068 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.073+0000 7fe8086939c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 to cache LRU end 2024-09-12T00:55:59.068 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.073+0000 7fe8086939c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:59.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.073+0000 7fe8086939c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:55:59.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.073+0000 7fe8086939c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 2024-09-12T00:55:59.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.077+0000 7fe8086939c0 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 to be held by another RGW process; skipping for now 2024-09-12T00:55:59.070 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.077+0000 7fe6bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:59.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.081+0000 7fe8086939c0 20 remove_watcher() i=0 2024-09-12T00:55:59.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.081+0000 7fe8086939c0 2 removed watcher, disabling cache 2024-09-12T00:55:59.077 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.085+0000 7fe8086939c0 20 remove_watcher() i=1 2024-09-12T00:55:59.080 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.085+0000 7fe8086939c0 20 remove_watcher() i=2 2024-09-12T00:55:59.081 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.089+0000 7fe8086939c0 20 remove_watcher() i=3 2024-09-12T00:55:59.083 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.089+0000 7fe8086939c0 20 remove_watcher() i=4 2024-09-12T00:55:59.084 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.093+0000 7fe8086939c0 20 remove_watcher() i=5 2024-09-12T00:55:59.086 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.093+0000 7fe8086939c0 20 remove_watcher() i=6 2024-09-12T00:55:59.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:55:59.093+0000 7fe8086939c0 20 remove_watcher() i=7 2024-09-12T00:55:59.102 INFO:tasks.workunit.client.0.smithi070.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:56:29.129 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:56:29.166 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:29.166 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:29.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.216+0000 7f14d1eba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.216+0000 7f14d1eba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:29.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.216+0000 7f14d1eba9c0 20 realm 2024-09-12T00:56:29.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.216+0000 7f14d1eba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.220+0000 7f14d1eba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:29.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.220+0000 7f14d1eba9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:29.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.220+0000 7f14d1eba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.220+0000 7f14d1eba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:29.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.220+0000 7f14d1eba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.215 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.220+0000 7f14d1eba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:29.215 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.220+0000 7f14d1eba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.215 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.220+0000 7f14d1eba9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:29.215 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.220+0000 7f14d1eba9c0 20 searching for the correct realm 2024-09-12T00:56:29.218 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.224+0000 7f14d01c1640 0 -- 172.21.15.70:0/3930981232 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f14c4032030 msgr2=0x7f14c403f950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:56:29.228 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.236+0000 7f14d01c1640 0 -- 172.21.15.70:0/3930981232 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f1398080880 msgr2=0x7f1398082cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:29.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.240+0000 7f14d1eba9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:29.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.240+0000 7f14d1eba9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:56:29.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.240+0000 7f14d1eba9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:29.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.240+0000 7f14d1eba9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:56:29.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.240+0000 7f14d1eba9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:29.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.240+0000 7f14d1eba9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:29.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.240+0000 7f14d1eba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.240+0000 7f14d1eba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:29.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.240+0000 7f14d1eba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.244+0000 7f14d1eba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:29.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.244+0000 7f14d1eba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.244+0000 7f14d1eba9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:29.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.244+0000 7f14d1eba9c0 20 zone default found 2024-09-12T00:56:29.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.244+0000 7f14d1eba9c0 4 Realm: () 2024-09-12T00:56:29.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.244+0000 7f14d1eba9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:56:29.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.244+0000 7f14d1eba9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:56:29.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.244+0000 7f14d1eba9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:29.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.244+0000 7f14d1eba9c0 20 zonegroup default 2024-09-12T00:56:29.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.244+0000 7f14d1eba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.244+0000 7f14d1eba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:29.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.244+0000 7f14d1eba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.244+0000 7f14d1eba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:29.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.244+0000 7f14d1eba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.244+0000 7f14d1eba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:29.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.244+0000 7f14d1eba9c0 20 started sync module instance, tier type = 2024-09-12T00:56:29.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.244+0000 7f14d1eba9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:56:29.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.260+0000 7f14d1eba9c0 20 add_watcher() i=0 2024-09-12T00:56:29.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.260+0000 7f14d1eba9c0 20 add_watcher() i=1 2024-09-12T00:56:29.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.260+0000 7f14d1eba9c0 20 add_watcher() i=2 2024-09-12T00:56:29.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.260+0000 7f14d1eba9c0 20 add_watcher() i=3 2024-09-12T00:56:29.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.260+0000 7f14d1eba9c0 20 add_watcher() i=4 2024-09-12T00:56:29.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.260+0000 7f14d1eba9c0 20 add_watcher() i=5 2024-09-12T00:56:29.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.260+0000 7f14d1eba9c0 20 add_watcher() i=6 2024-09-12T00:56:29.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.264+0000 7f14d1eba9c0 20 add_watcher() i=7 2024-09-12T00:56:29.257 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.264+0000 7f14d1eba9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:29.258 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.264+0000 7f1385fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:29.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.264+0000 7f14d1eba9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:29.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.264+0000 7f14d1eba9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:29.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.264+0000 7f14d1eba9c0 5 note: GC not initialized 2024-09-12T00:56:29.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.264+0000 7f1384fe1640 20 reqs_thread_entry: start 2024-09-12T00:56:29.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.264+0000 7f14d1eba9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:56:29.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.264+0000 7f14d1eba9c0 20 Filter name: none 2024-09-12T00:56:29.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.264+0000 7f12fe7fc640 20 reqs_thread_entry: start 2024-09-12T00:56:29.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.264+0000 7f14d1eba9c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:56:29.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.264+0000 7f14d1eba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.268+0000 7f14d1eba9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:56:29.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.268+0000 7f14d1eba9c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:56:29.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.268+0000 7f14d1eba9c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:56:29.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.268+0000 7f14d1eba9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 : miss 2024-09-12T00:56:29.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.268+0000 7f14d1eba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.268+0000 7f14d1eba9c0 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T00:56:29.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.268+0000 7f14d1eba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 info.flags=0x17 2024-09-12T00:56:29.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.268+0000 7f14d1eba9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 to cache LRU end 2024-09-12T00:56:29.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.268+0000 7f14d1eba9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:29.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.268+0000 7f14d1eba9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:29.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.268+0000 7f14d1eba9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 2024-09-12T00:56:29.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.268+0000 7f14d1eba9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:56:29.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.276+0000 7f14d1eba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 info.flags=0x17 2024-09-12T00:56:29.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.276+0000 7f14d1eba9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 to cache LRU end 2024-09-12T00:56:29.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.276+0000 7f14d1eba9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:29.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.276+0000 7f14d1eba9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30, ofs0, ns] 2024-09-12T00:56:29.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.276+0000 7f13aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431619 cookie 94710868227968 notifier 6782 bl.length()=999 2024-09-12T00:56:29.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.276+0000 7f13aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 info.flags=0x17 2024-09-12T00:56:29.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.276+0000 7f13aeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 to cache LRU end 2024-09-12T00:56:29.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.276+0000 7f13aeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:29.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.276+0000 7f14d1eba9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): orig_sources= new_sources= 2024-09-12T00:56:29.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.276+0000 7f14d1eba9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): potential sources added=[] removed=[] 2024-09-12T00:56:29.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.276+0000 7f14d1eba9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): orig_dests= new_dests= 2024-09-12T00:56:29.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.276+0000 7f14d1eba9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): potential dests added=[] removed=[] 2024-09-12T00:56:29.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.284+0000 7f14d1eba9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30.2.0 2024-09-12T00:56:29.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.284+0000 7f14d1eba9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30.2.0 2024-09-12T00:56:29.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.284+0000 7f14d1eba9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30.2.1 2024-09-12T00:56:29.277 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.284+0000 7f14d1eba9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30.2.1 2024-09-12T00:56:29.277 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.284+0000 7f14d1eba9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30.0 2024-09-12T00:56:29.280 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.288+0000 7f14d1eba9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:56:29.281 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.288+0000 7f14d1eba9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 2024-09-12T00:56:29.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.288+0000 7f14d1eba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 info.flags=0x17 2024-09-12T00:56:29.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.288+0000 7f14d1eba9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 to cache LRU end 2024-09-12T00:56:29.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.288+0000 7f14d1eba9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:29.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.288+0000 7f14d1eba9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30, ofs0, ns] 2024-09-12T00:56:29.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.288+0000 7f13ae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431620 cookie 94710868227968 notifier 6782 bl.length()=999 2024-09-12T00:56:29.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.288+0000 7f13ae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 info.flags=0x17 2024-09-12T00:56:29.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.288+0000 7f13ae7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 to cache LRU end 2024-09-12T00:56:29.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.288+0000 7f13ae7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:29.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.288+0000 7f14d1eba9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): orig_sources= new_sources= 2024-09-12T00:56:29.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.288+0000 7f14d1eba9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): potential sources added=[] removed=[] 2024-09-12T00:56:29.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.288+0000 7f14d1eba9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): orig_dests= new_dests= 2024-09-12T00:56:29.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.288+0000 7f14d1eba9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): potential dests added=[] removed=[] 2024-09-12T00:56:29.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.292+0000 7f14d1eba9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30.0 2024-09-12T00:56:29.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.292+0000 7f14d1eba9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:56:29.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.292+0000 7f14d1eba9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 2024-09-12T00:56:29.288 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.296+0000 7f14d1eba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 info.flags=0x17 2024-09-12T00:56:29.288 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.296+0000 7f14d1eba9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 to cache LRU end 2024-09-12T00:56:29.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.296+0000 7f14d1eba9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:29.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.296+0000 7f14d1eba9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30, ofs0, ns] 2024-09-12T00:56:29.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.296+0000 7f13aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431621 cookie 94710868227968 notifier 6782 bl.length()=967 2024-09-12T00:56:29.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.296+0000 7f13aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 info.flags=0x17 2024-09-12T00:56:29.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.296+0000 7f13aeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 to cache LRU end 2024-09-12T00:56:29.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.296+0000 7f13aeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:29.290 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.296+0000 7f14d1eba9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): orig_sources= new_sources= 2024-09-12T00:56:29.290 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.296+0000 7f14d1eba9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): potential sources added=[] removed=[] 2024-09-12T00:56:29.290 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.296+0000 7f14d1eba9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): orig_dests= new_dests= 2024-09-12T00:56:29.290 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.296+0000 7f14d1eba9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30]): potential dests added=[] removed=[] 2024-09-12T00:56:29.292 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.300+0000 7f14d1eba9c0 1 execute INFO: reshard of bucket "abort-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:56:29.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.300+0000 7f1385fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:29.300 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.308+0000 7f14d1eba9c0 20 remove_watcher() i=0 2024-09-12T00:56:29.300 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.308+0000 7f14d1eba9c0 2 removed watcher, disabling cache 2024-09-12T00:56:29.301 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.308+0000 7f14d1eba9c0 20 remove_watcher() i=1 2024-09-12T00:56:29.303 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.312+0000 7f14d1eba9c0 20 remove_watcher() i=2 2024-09-12T00:56:29.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.312+0000 7f14d1eba9c0 20 remove_watcher() i=3 2024-09-12T00:56:29.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.312+0000 7f14d1eba9c0 20 remove_watcher() i=4 2024-09-12T00:56:29.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.316+0000 7f14d1eba9c0 20 remove_watcher() i=5 2024-09-12T00:56:29.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.316+0000 7f14d1eba9c0 20 remove_watcher() i=6 2024-09-12T00:56:29.311 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.316+0000 7f14d1eba9c0 20 remove_watcher() i=7 2024-09-12T00:56:29.325 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:56:29.354 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:29.354 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:29.397 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.404+0000 7fd0a58899c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.398 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.404+0000 7fd0a58899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:29.399 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.404+0000 7fd0a58899c0 20 realm 2024-09-12T00:56:29.399 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.404+0000 7fd0a58899c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.399 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.404+0000 7fd0a58899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:29.399 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.404+0000 7fd0a58899c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:29.399 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.404+0000 7fd0a58899c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.399 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.404+0000 7fd0a58899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:29.399 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.404+0000 7fd0a58899c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.408+0000 7fd0a58899c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:29.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.408+0000 7fd0a58899c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.402 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.408+0000 7fd0a58899c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:29.402 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.408+0000 7fd0a58899c0 20 searching for the correct realm 2024-09-12T00:56:29.407 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.412+0000 7fd0a3b90640 0 -- 172.21.15.70:0/1742559950 >> [v2:172.21.15.70:6808/276433067,v1:172.21.15.70:6809/276433067] conn(0x5556f228dd30 msgr2=0x5556f22901f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:56:29.621 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.628+0000 7fd0a3b90640 0 -- 172.21.15.70:0/1742559950 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fd08c03f030 msgr2=0x7fd08c01aaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:29.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.640+0000 7fd0a58899c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:29.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.640+0000 7fd0a58899c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:56:29.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.640+0000 7fd0a58899c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:29.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.640+0000 7fd0a58899c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:56:29.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.640+0000 7fd0a58899c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:29.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.640+0000 7fd0a58899c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:29.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.640+0000 7fd0a58899c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.640+0000 7fd0a58899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:29.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.640+0000 7fd0a58899c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.640+0000 7fd0a58899c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:29.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.640+0000 7fd0a58899c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.640+0000 7fd0a58899c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:29.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.640+0000 7fd0a58899c0 20 zone default found 2024-09-12T00:56:29.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.640+0000 7fd0a58899c0 4 Realm: () 2024-09-12T00:56:29.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.640+0000 7fd0a58899c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:56:29.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.640+0000 7fd0a58899c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:56:29.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.640+0000 7fd0a58899c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:29.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.640+0000 7fd0a58899c0 20 zonegroup default 2024-09-12T00:56:29.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.640+0000 7fd0a58899c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.640+0000 7fd0a58899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:29.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.640+0000 7fd0a58899c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.636 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.644+0000 7fd0a58899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:29.636 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.644+0000 7fd0a58899c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.636 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.644+0000 7fd0a58899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:29.636 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.644+0000 7fd0a58899c0 20 started sync module instance, tier type = 2024-09-12T00:56:29.636 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.644+0000 7fd0a58899c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:56:29.660 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.668+0000 7fd0a58899c0 20 add_watcher() i=0 2024-09-12T00:56:29.660 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.668+0000 7fd0a58899c0 20 add_watcher() i=1 2024-09-12T00:56:29.660 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.668+0000 7fd0a58899c0 20 add_watcher() i=2 2024-09-12T00:56:29.660 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.668+0000 7fd0a58899c0 20 add_watcher() i=3 2024-09-12T00:56:29.660 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.668+0000 7fd0a58899c0 20 add_watcher() i=4 2024-09-12T00:56:29.661 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.668+0000 7fd0a58899c0 20 add_watcher() i=5 2024-09-12T00:56:29.661 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.668+0000 7fd0a58899c0 20 add_watcher() i=6 2024-09-12T00:56:29.662 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.668+0000 7fd0a58899c0 20 add_watcher() i=7 2024-09-12T00:56:29.662 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.668+0000 7fd0a58899c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:29.666 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.672+0000 7fcf59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:29.668 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.672+0000 7fd0a58899c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:29.668 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.672+0000 7fd0a58899c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:29.668 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.676+0000 7fd0a58899c0 5 note: GC not initialized 2024-09-12T00:56:29.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.676+0000 7fcf58fe1640 20 reqs_thread_entry: start 2024-09-12T00:56:29.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.676+0000 7fd0a58899c0 20 init_complete bucket index max shards: 1 2024-09-12T00:56:29.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.676+0000 7fd0a58899c0 20 Filter name: none 2024-09-12T00:56:29.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.676+0000 7fced27fc640 20 reqs_thread_entry: start 2024-09-12T00:56:29.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.676+0000 7fd0a58899c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.670 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.676+0000 7fd0a58899c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:56:29.670 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.676+0000 7fd0a58899c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.671 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.676+0000 7fd0a58899c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:56:29.672 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.676+0000 7fd0a58899c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:56:29.672 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.676+0000 7fd0a58899c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.672 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.676+0000 7fd0a58899c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:56:29.672 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.676+0000 7fd0a58899c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:29.672 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.676+0000 7fd0a58899c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:56:29.672 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.676+0000 7fd0a58899c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:56:29.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.680+0000 7fcf59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:29.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.684+0000 7fd0a58899c0 20 remove_watcher() i=0 2024-09-12T00:56:29.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.684+0000 7fd0a58899c0 2 removed watcher, disabling cache 2024-09-12T00:56:29.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.688+0000 7fd0a58899c0 20 remove_watcher() i=1 2024-09-12T00:56:29.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.688+0000 7fd0a58899c0 20 remove_watcher() i=2 2024-09-12T00:56:29.686 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.692+0000 7fd0a58899c0 20 remove_watcher() i=3 2024-09-12T00:56:29.688 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.696+0000 7fd0a58899c0 20 remove_watcher() i=4 2024-09-12T00:56:29.690 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.696+0000 7fd0a58899c0 20 remove_watcher() i=5 2024-09-12T00:56:29.692 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.700+0000 7fd0a58899c0 20 remove_watcher() i=6 2024-09-12T00:56:29.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:29.700+0000 7fd0a58899c0 20 remove_watcher() i=7 2024-09-12T00:56:29.716 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:29.716 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:56:29.717 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: abort-at-block-writes id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:56:29.717 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:29.717 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:29.717 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:29.721 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:29.721 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:29.767 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:29.767 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:29.792 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-12T00:56:29.792 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:29.794 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:29.795 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:29.813 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:29.813 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:29.859 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:29.860 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:29.879 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:29.879 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:29.898 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:29.898 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:29.917 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:29.917 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:29.936 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:29.936 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:29.955 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:29.955 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:29.973 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:29.973 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:29.993 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:29.994 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:30.013 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:30.013 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:30.033 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:30.033 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:30.050 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:30.051 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:30.072 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:30.072 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:30.091 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:30.091 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:30.109 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:30.110 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:30.128 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:30.128 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:30.148 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:30.148 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:30.167 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:30.168 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:30.186 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:30.186 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:30.206 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:30.206 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:30.225 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:30.225 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:30.242 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:56:30.274 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:30.274 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:30.319 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.324+0000 7f0c8044f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.328+0000 7f0c8044f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:30.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.328+0000 7f0c8044f9c0 20 realm 2024-09-12T00:56:30.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.328+0000 7f0c8044f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.328+0000 7f0c8044f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:30.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.328+0000 7f0c8044f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:30.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.328+0000 7f0c8044f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.328+0000 7f0c8044f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:30.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.328+0000 7f0c8044f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.322 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.328+0000 7f0c8044f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:30.322 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.328+0000 7f0c8044f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.328+0000 7f0c8044f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:30.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.328+0000 7f0c8044f9c0 20 searching for the correct realm 2024-09-12T00:56:30.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.336+0000 7f0c7e756640 0 -- 172.21.15.70:0/124867439 >> [v2:172.21.15.70:6808/276433067,v1:172.21.15.70:6809/276433067] conn(0x55ba9a03ce00 msgr2=0x55ba9a03f290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:30.336 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.344+0000 7f0c7d754640 0 -- 172.21.15.70:0/124867439 >> [v2:172.21.15.70:6816/1979013808,v1:172.21.15.70:6817/1979013808] conn(0x55ba9a0305f0 msgr2=0x55ba9a032ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:56:30.344 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.348+0000 7f0c8044f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:30.345 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.348+0000 7f0c8044f9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:56:30.345 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.348+0000 7f0c8044f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:30.345 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.348+0000 7f0c8044f9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:56:30.345 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.348+0000 7f0c8044f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:30.345 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.348+0000 7f0c8044f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:30.346 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.348+0000 7f0c8044f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.346 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.348+0000 7f0c8044f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:30.346 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.348+0000 7f0c8044f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.346 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.348+0000 7f0c8044f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:30.347 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.348+0000 7f0c8044f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.347 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.352+0000 7f0c8044f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:30.347 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.352+0000 7f0c8044f9c0 20 zone default found 2024-09-12T00:56:30.347 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.352+0000 7f0c8044f9c0 4 Realm: () 2024-09-12T00:56:30.347 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.352+0000 7f0c8044f9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:56:30.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.352+0000 7f0c8044f9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:56:30.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.352+0000 7f0c8044f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:30.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.352+0000 7f0c8044f9c0 20 zonegroup default 2024-09-12T00:56:30.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.352+0000 7f0c8044f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.352+0000 7f0c8044f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:30.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.352+0000 7f0c8044f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.352+0000 7f0c8044f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:30.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.352+0000 7f0c8044f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.350 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.352+0000 7f0c8044f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:30.350 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.352+0000 7f0c8044f9c0 20 started sync module instance, tier type = 2024-09-12T00:56:30.350 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.352+0000 7f0c8044f9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:56:30.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.368+0000 7f0c8044f9c0 20 add_watcher() i=0 2024-09-12T00:56:30.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.368+0000 7f0c8044f9c0 20 add_watcher() i=1 2024-09-12T00:56:30.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.368+0000 7f0c8044f9c0 20 add_watcher() i=2 2024-09-12T00:56:30.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.368+0000 7f0c8044f9c0 20 add_watcher() i=3 2024-09-12T00:56:30.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.368+0000 7f0c8044f9c0 20 add_watcher() i=4 2024-09-12T00:56:30.362 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.368+0000 7f0c8044f9c0 20 add_watcher() i=5 2024-09-12T00:56:30.362 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.368+0000 7f0c8044f9c0 20 add_watcher() i=6 2024-09-12T00:56:30.362 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.368+0000 7f0c8044f9c0 20 add_watcher() i=7 2024-09-12T00:56:30.362 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.368+0000 7f0c8044f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:30.364 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.372+0000 7f0b2f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:30.366 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.372+0000 7f0c8044f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:30.366 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.372+0000 7f0c8044f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:30.366 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.372+0000 7f0c8044f9c0 5 note: GC not initialized 2024-09-12T00:56:30.366 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.372+0000 7f0b2e7fc640 20 reqs_thread_entry: start 2024-09-12T00:56:30.366 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.372+0000 7f0c8044f9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:56:30.367 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.372+0000 7f0c8044f9c0 20 Filter name: none 2024-09-12T00:56:30.367 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.372+0000 7f0a9ffff640 20 reqs_thread_entry: start 2024-09-12T00:56:30.367 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.372+0000 7f0c8044f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.367 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.372+0000 7f0c8044f9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:56:30.367 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.372+0000 7f0c8044f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.368 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.376+0000 7f0c8044f9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:56:30.368 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.376+0000 7f0c8044f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:56:30.369 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.376+0000 7f0c8044f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.369 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.376+0000 7f0c8044f9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:56:30.369 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.376+0000 7f0c8044f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.370 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.376+0000 7f0c8044f9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:56:30.370 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.376+0000 7f0c8044f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:56:30.372 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.380+0000 7f0b2f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:30.376 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.384+0000 7f0c8044f9c0 20 remove_watcher() i=0 2024-09-12T00:56:30.376 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.384+0000 7f0c8044f9c0 2 removed watcher, disabling cache 2024-09-12T00:56:30.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.384+0000 7f0c8044f9c0 20 remove_watcher() i=1 2024-09-12T00:56:30.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.388+0000 7f0c8044f9c0 20 remove_watcher() i=2 2024-09-12T00:56:30.382 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.388+0000 7f0c8044f9c0 20 remove_watcher() i=3 2024-09-12T00:56:30.384 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.392+0000 7f0c8044f9c0 20 remove_watcher() i=4 2024-09-12T00:56:30.385 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.392+0000 7f0c8044f9c0 20 remove_watcher() i=5 2024-09-12T00:56:30.386 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.392+0000 7f0c8044f9c0 20 remove_watcher() i=6 2024-09-12T00:56:30.388 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.396+0000 7f0c8044f9c0 20 remove_watcher() i=7 2024-09-12T00:56:30.401 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:30.401 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:56:30.401 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-commit-target-layout id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:56:30.402 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:30.402 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-12T00:56:30.434 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:30.435 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:30.476 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.484+0000 7fd6988b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.478 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.484+0000 7fd6988b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:30.478 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.484+0000 7fd6988b49c0 20 realm 2024-09-12T00:56:30.478 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.484+0000 7fd6988b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.478 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.484+0000 7fd6988b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:30.478 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.484+0000 7fd6988b49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:30.478 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.484+0000 7fd6988b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.478 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.484+0000 7fd6988b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:30.478 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.484+0000 7fd6988b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.480 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.488+0000 7fd6988b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:30.480 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.488+0000 7fd6988b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.481 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.488+0000 7fd6988b49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:30.481 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.488+0000 7fd6988b49c0 20 searching for the correct realm 2024-09-12T00:56:30.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.492+0000 7fd696bbb640 0 -- 172.21.15.70:0/338032221 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fd68c0d7040 msgr2=0x7fd68c0d8430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:30.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.708+0000 7fd696bbb640 0 -- 172.21.15.70:0/338032221 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fd68c0d7040 msgr2=0x7fd68c0d8430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:30.712 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.720+0000 7fd6988b49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:30.712 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.720+0000 7fd6988b49c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:56:30.713 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.720+0000 7fd6988b49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:30.713 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.720+0000 7fd6988b49c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:56:30.713 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.720+0000 7fd6988b49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:30.713 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.720+0000 7fd6988b49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:30.713 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.720+0000 7fd6988b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.713 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.720+0000 7fd6988b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:30.713 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.720+0000 7fd6988b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.714 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.720+0000 7fd6988b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:30.714 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.720+0000 7fd6988b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.720+0000 7fd6988b49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:30.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.720+0000 7fd6988b49c0 20 zone default found 2024-09-12T00:56:30.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.720+0000 7fd6988b49c0 4 Realm: () 2024-09-12T00:56:30.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.720+0000 7fd6988b49c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:56:30.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.720+0000 7fd6988b49c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:56:30.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.720+0000 7fd6988b49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:30.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.720+0000 7fd6988b49c0 20 zonegroup default 2024-09-12T00:56:30.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.720+0000 7fd6988b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.724+0000 7fd6988b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:30.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.724+0000 7fd6988b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.724+0000 7fd6988b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:30.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.724+0000 7fd6988b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.724+0000 7fd6988b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:30.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.724+0000 7fd6988b49c0 20 started sync module instance, tier type = 2024-09-12T00:56:30.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.724+0000 7fd6988b49c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:56:30.738 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.744+0000 7fd6988b49c0 20 add_watcher() i=0 2024-09-12T00:56:30.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.744+0000 7fd6988b49c0 20 add_watcher() i=1 2024-09-12T00:56:30.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.744+0000 7fd6988b49c0 20 add_watcher() i=2 2024-09-12T00:56:30.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.744+0000 7fd6988b49c0 20 add_watcher() i=3 2024-09-12T00:56:30.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.744+0000 7fd6988b49c0 20 add_watcher() i=4 2024-09-12T00:56:30.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.744+0000 7fd6988b49c0 20 add_watcher() i=5 2024-09-12T00:56:30.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.744+0000 7fd6988b49c0 20 add_watcher() i=6 2024-09-12T00:56:30.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.748+0000 7fd6988b49c0 20 add_watcher() i=7 2024-09-12T00:56:30.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.748+0000 7fd6988b49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:30.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.748+0000 7fd54cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:30.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.748+0000 7fd6988b49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:30.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.748+0000 7fd6988b49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:30.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.752+0000 7fd6988b49c0 5 note: GC not initialized 2024-09-12T00:56:30.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.752+0000 7fd4c77fe640 20 reqs_thread_entry: start 2024-09-12T00:56:30.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.752+0000 7fd6988b49c0 20 init_complete bucket index max shards: 1 2024-09-12T00:56:30.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.752+0000 7fd6988b49c0 20 Filter name: none 2024-09-12T00:56:30.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.752+0000 7fd4c57fa640 20 reqs_thread_entry: start 2024-09-12T00:56:30.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.752+0000 7fd6988b49c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:56:30.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.752+0000 7fd6988b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.752+0000 7fd6988b49c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:56:30.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.752+0000 7fd6988b49c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:56:30.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.752+0000 7fd6988b49c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:56:30.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.752+0000 7fd6988b49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 : miss 2024-09-12T00:56:30.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.752+0000 7fd6988b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.752+0000 7fd6988b49c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:56:30.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.752+0000 7fd6988b49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 info.flags=0x17 2024-09-12T00:56:30.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.752+0000 7fd6988b49c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 to cache LRU end 2024-09-12T00:56:30.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.752+0000 7fd6988b49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:30.750 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.752+0000 7fd6988b49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:30.750 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.752+0000 7fd6988b49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 2024-09-12T00:56:30.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.760+0000 7fd6988b49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 info.flags=0x17 2024-09-12T00:56:30.755 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.760+0000 7fd6988b49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 to cache LRU end 2024-09-12T00:56:30.755 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.760+0000 7fd6988b49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:30.755 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.760+0000 7fd6988b49c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31, ofs0, ns] 2024-09-12T00:56:30.756 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.760+0000 7fd579ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431614 cookie 94006944864096 notifier 7245 bl.length()=1015 2024-09-12T00:56:30.757 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.760+0000 7fd579ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 info.flags=0x17 2024-09-12T00:56:30.757 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.760+0000 7fd579ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 to cache LRU end 2024-09-12T00:56:30.757 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.760+0000 7fd579ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:30.757 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.764+0000 7fd6988b49c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31]): orig_sources= new_sources= 2024-09-12T00:56:30.757 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.764+0000 7fd6988b49c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31]): potential sources added=[] removed=[] 2024-09-12T00:56:30.758 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.764+0000 7fd6988b49c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31]): orig_dests= new_dests= 2024-09-12T00:56:30.758 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.764+0000 7fd6988b49c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31]): potential dests added=[] removed=[] 2024-09-12T00:56:30.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.764+0000 7fd6988b49c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31.1.0 2024-09-12T00:56:30.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.764+0000 7fd6988b49c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31.1.0 2024-09-12T00:56:30.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.764+0000 7fd6988b49c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31.1.1 2024-09-12T00:56:30.760 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.764+0000 7fd6988b49c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31.1.1 2024-09-12T00:56:30.760 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.764+0000 7fd6988b49c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31.0 2024-09-12T00:56:30.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.768+0000 7fd6988b49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:56:30.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.768+0000 7fd6988b49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 2024-09-12T00:56:30.765 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.772+0000 7fd6988b49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 info.flags=0x17 2024-09-12T00:56:30.765 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.772+0000 7fd6988b49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 to cache LRU end 2024-09-12T00:56:30.765 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.772+0000 7fd6988b49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:30.765 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.772+0000 7fd6988b49c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31, ofs0, ns] 2024-09-12T00:56:30.766 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.772+0000 7fd5797fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431615 cookie 94006944864096 notifier 7245 bl.length()=1015 2024-09-12T00:56:30.766 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.772+0000 7fd5797fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 info.flags=0x17 2024-09-12T00:56:30.766 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.772+0000 7fd5797fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 to cache LRU end 2024-09-12T00:56:30.766 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.772+0000 7fd5797fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:30.767 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.772+0000 7fd6988b49c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31]): orig_sources= new_sources= 2024-09-12T00:56:30.767 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.772+0000 7fd6988b49c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31]): potential sources added=[] removed=[] 2024-09-12T00:56:30.767 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.772+0000 7fd6988b49c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31]): orig_dests= new_dests= 2024-09-12T00:56:30.767 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.772+0000 7fd6988b49c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31]): potential dests added=[] removed=[] 2024-09-12T00:56:30.769 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.776+0000 7fd6988b49c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31.0 2024-09-12T00:56:30.769 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.776+0000 7fd6988b49c0 -1 Injecting error=-5 at location=commit_target_layout 2024-09-12T00:56:30.769 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.776+0000 7fd6988b49c0 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-12T00:56:30.774 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.780+0000 7fd54cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:30.779 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.784+0000 7fd6988b49c0 20 remove_watcher() i=0 2024-09-12T00:56:30.779 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.784+0000 7fd6988b49c0 2 removed watcher, disabling cache 2024-09-12T00:56:30.781 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.788+0000 7fd6988b49c0 20 remove_watcher() i=1 2024-09-12T00:56:30.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.788+0000 7fd6988b49c0 20 remove_watcher() i=2 2024-09-12T00:56:30.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.792+0000 7fd6988b49c0 20 remove_watcher() i=3 2024-09-12T00:56:30.787 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.792+0000 7fd6988b49c0 20 remove_watcher() i=4 2024-09-12T00:56:30.789 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.796+0000 7fd6988b49c0 20 remove_watcher() i=5 2024-09-12T00:56:30.790 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.796+0000 7fd6988b49c0 20 remove_watcher() i=6 2024-09-12T00:56:30.791 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.796+0000 7fd6988b49c0 20 remove_watcher() i=7 2024-09-12T00:56:30.806 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:56:30.833 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:30.833 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:30.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.884+0000 7f3c3c8219c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.884+0000 7f3c3c8219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:30.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.884+0000 7f3c3c8219c0 20 realm 2024-09-12T00:56:30.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.884+0000 7f3c3c8219c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.884+0000 7f3c3c8219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:30.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.884+0000 7f3c3c8219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:30.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.884+0000 7f3c3c8219c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.879 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.884+0000 7f3c3c8219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:30.879 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.884+0000 7f3c3c8219c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.880 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.888+0000 7f3c3c8219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:30.880 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.888+0000 7f3c3c8219c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.881 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.888+0000 7f3c3c8219c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:30.881 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.888+0000 7f3c3c8219c0 20 searching for the correct realm 2024-09-12T00:56:30.886 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.892+0000 7f3c3a327640 0 -- 172.21.15.70:0/885244894 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f3c2c076070 msgr2=0x7f3c2c011ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:30.893 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.900+0000 7f3c3a327640 0 -- 172.21.15.70:0/885244894 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f3c2c02d060 msgr2=0x7f3c2c011ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:30.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.908+0000 7f3c3c8219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:30.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.908+0000 7f3c3c8219c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:56:30.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.908+0000 7f3c3c8219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:30.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.908+0000 7f3c3c8219c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:56:30.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.908+0000 7f3c3c8219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:30.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.908+0000 7f3c3c8219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:30.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.908+0000 7f3c3c8219c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.908+0000 7f3c3c8219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:30.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.908+0000 7f3c3c8219c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.908+0000 7f3c3c8219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:30.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.908+0000 7f3c3c8219c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.908+0000 7f3c3c8219c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:30.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.908+0000 7f3c3c8219c0 20 zone default found 2024-09-12T00:56:30.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.908+0000 7f3c3c8219c0 4 Realm: () 2024-09-12T00:56:30.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.908+0000 7f3c3c8219c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:56:30.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.908+0000 7f3c3c8219c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:56:30.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.908+0000 7f3c3c8219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:30.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.908+0000 7f3c3c8219c0 20 zonegroup default 2024-09-12T00:56:30.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.908+0000 7f3c3c8219c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.908+0000 7f3c3c8219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:30.903 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.908+0000 7f3c3c8219c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.903 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.908+0000 7f3c3c8219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:30.903 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.908+0000 7f3c3c8219c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.903 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.908+0000 7f3c3c8219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:30.903 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.908+0000 7f3c3c8219c0 20 started sync module instance, tier type = 2024-09-12T00:56:30.904 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.908+0000 7f3c3c8219c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:56:30.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.924+0000 7f3c3c8219c0 20 add_watcher() i=0 2024-09-12T00:56:30.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.924+0000 7f3c3c8219c0 20 add_watcher() i=1 2024-09-12T00:56:30.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.924+0000 7f3c3c8219c0 20 add_watcher() i=2 2024-09-12T00:56:30.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.924+0000 7f3c3c8219c0 20 add_watcher() i=3 2024-09-12T00:56:30.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.924+0000 7f3c3c8219c0 20 add_watcher() i=4 2024-09-12T00:56:30.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.924+0000 7f3c3c8219c0 20 add_watcher() i=5 2024-09-12T00:56:30.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.924+0000 7f3c3c8219c0 20 add_watcher() i=6 2024-09-12T00:56:30.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.924+0000 7f3c3c8219c0 20 add_watcher() i=7 2024-09-12T00:56:30.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.924+0000 7f3c3c8219c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:30.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.928+0000 7f3af0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:30.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.928+0000 7f3c3c8219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:30.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.928+0000 7f3c3c8219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:30.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.928+0000 7f3c3c8219c0 5 note: GC not initialized 2024-09-12T00:56:30.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.928+0000 7f3a6b7fe640 20 reqs_thread_entry: start 2024-09-12T00:56:30.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.928+0000 7f3c3c8219c0 20 init_complete bucket index max shards: 1 2024-09-12T00:56:30.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.928+0000 7f3c3c8219c0 20 Filter name: none 2024-09-12T00:56:30.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.928+0000 7f3a697fa640 20 reqs_thread_entry: start 2024-09-12T00:56:30.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.928+0000 7f3c3c8219c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.924 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.932+0000 7f3c3c8219c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:56:30.924 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.932+0000 7f3c3c8219c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.925 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.932+0000 7f3c3c8219c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:56:30.925 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.932+0000 7f3c3c8219c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:56:30.925 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.932+0000 7f3c3c8219c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.926 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.932+0000 7f3c3c8219c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:56:30.926 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.932+0000 7f3c3c8219c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:30.927 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.932+0000 7f3c3c8219c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:56:30.927 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.932+0000 7f3c3c8219c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:56:30.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.936+0000 7f3af0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:30.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.940+0000 7f3c3c8219c0 20 remove_watcher() i=0 2024-09-12T00:56:30.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.940+0000 7f3c3c8219c0 2 removed watcher, disabling cache 2024-09-12T00:56:30.935 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.940+0000 7f3c3c8219c0 20 remove_watcher() i=1 2024-09-12T00:56:30.937 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.944+0000 7f3c3c8219c0 20 remove_watcher() i=2 2024-09-12T00:56:30.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.944+0000 7f3c3c8219c0 20 remove_watcher() i=3 2024-09-12T00:56:30.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.948+0000 7f3c3c8219c0 20 remove_watcher() i=4 2024-09-12T00:56:30.942 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.948+0000 7f3c3c8219c0 20 remove_watcher() i=5 2024-09-12T00:56:30.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.948+0000 7f3c3c8219c0 20 remove_watcher() i=6 2024-09-12T00:56:30.944 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:30.952+0000 7f3c3c8219c0 20 remove_watcher() i=7 2024-09-12T00:56:30.958 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:30.958 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:56:30.958 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-commit-target-layout id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:56:30.958 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:30.959 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:30.959 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:30.968 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:30.968 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:31.012 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:56:31.043 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:31.044 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:31.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.092+0000 7f78ba9039c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.096+0000 7f78ba9039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:31.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.096+0000 7f78ba9039c0 20 realm 2024-09-12T00:56:31.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.096+0000 7f78ba9039c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.096+0000 7f78ba9039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:31.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.096+0000 7f78ba9039c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:31.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.096+0000 7f78ba9039c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.096+0000 7f78ba9039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:31.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.096+0000 7f78ba9039c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.096+0000 7f78ba9039c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:31.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.096+0000 7f78ba9039c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.092 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.100+0000 7f78ba9039c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:31.092 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.100+0000 7f78ba9039c0 20 searching for the correct realm 2024-09-12T00:56:31.096 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.104+0000 7f78b8c0a640 0 -- 172.21.15.70:0/3382219892 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f78ac01f060 msgr2=0x7f78ac0633d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:31.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.320+0000 7f78b8c0a640 0 -- 172.21.15.70:0/3382219892 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f78ac01f060 msgr2=0x7f78ac0633d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:31.325 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.332+0000 7f78ba9039c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:31.325 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.332+0000 7f78ba9039c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:56:31.325 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.332+0000 7f78ba9039c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:31.325 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.332+0000 7f78ba9039c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:56:31.325 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.332+0000 7f78ba9039c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:31.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.332+0000 7f78ba9039c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:31.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.332+0000 7f78ba9039c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.332+0000 7f78ba9039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:31.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.332+0000 7f78ba9039c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.327 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.332+0000 7f78ba9039c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:31.327 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.332+0000 7f78ba9039c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.336+0000 7f78ba9039c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:31.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.336+0000 7f78ba9039c0 20 zone default found 2024-09-12T00:56:31.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.336+0000 7f78ba9039c0 4 Realm: () 2024-09-12T00:56:31.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.336+0000 7f78ba9039c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:56:31.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.336+0000 7f78ba9039c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:56:31.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.336+0000 7f78ba9039c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:31.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.336+0000 7f78ba9039c0 20 zonegroup default 2024-09-12T00:56:31.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.336+0000 7f78ba9039c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.336+0000 7f78ba9039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:31.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.336+0000 7f78ba9039c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.336+0000 7f78ba9039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:31.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.336+0000 7f78ba9039c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.330 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.336+0000 7f78ba9039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:31.330 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.336+0000 7f78ba9039c0 20 started sync module instance, tier type = 2024-09-12T00:56:31.330 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.336+0000 7f78ba9039c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:56:31.352 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.356+0000 7f78ba9039c0 20 add_watcher() i=0 2024-09-12T00:56:31.352 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.356+0000 7f78ba9039c0 20 add_watcher() i=1 2024-09-12T00:56:31.352 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.356+0000 7f78ba9039c0 20 add_watcher() i=2 2024-09-12T00:56:31.352 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.356+0000 7f78ba9039c0 20 add_watcher() i=3 2024-09-12T00:56:31.352 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.356+0000 7f78ba9039c0 20 add_watcher() i=4 2024-09-12T00:56:31.352 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.356+0000 7f78ba9039c0 20 add_watcher() i=5 2024-09-12T00:56:31.352 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.356+0000 7f78ba9039c0 20 add_watcher() i=6 2024-09-12T00:56:31.353 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.360+0000 7f78ba9039c0 20 add_watcher() i=7 2024-09-12T00:56:31.353 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.360+0000 7f78ba9039c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:31.357 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.364+0000 7f776efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:31.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.364+0000 7f78ba9039c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:31.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.364+0000 7f78ba9039c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:31.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.364+0000 7f78ba9039c0 5 note: GC not initialized 2024-09-12T00:56:31.359 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.364+0000 7f776dfdb640 20 reqs_thread_entry: start 2024-09-12T00:56:31.359 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.364+0000 7f78ba9039c0 20 init_complete bucket index max shards: 1 2024-09-12T00:56:31.359 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.368+0000 7f78ba9039c0 20 Filter name: none 2024-09-12T00:56:31.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.368+0000 7f76df7fe640 20 reqs_thread_entry: start 2024-09-12T00:56:31.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.368+0000 7f78ba9039c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:56:31.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.368+0000 7f78ba9039c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.368+0000 7f78ba9039c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:56:31.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.368+0000 7f78ba9039c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:56:31.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.368+0000 7f78ba9039c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:56:31.362 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.368+0000 7f78ba9039c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 : miss 2024-09-12T00:56:31.362 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.368+0000 7f78ba9039c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.362 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.368+0000 7f78ba9039c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:56:31.362 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.368+0000 7f78ba9039c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 info.flags=0x17 2024-09-12T00:56:31.362 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.368+0000 7f78ba9039c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 to cache LRU end 2024-09-12T00:56:31.363 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.368+0000 7f78ba9039c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:31.363 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.368+0000 7f78ba9039c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:31.363 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.368+0000 7f78ba9039c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 2024-09-12T00:56:31.365 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.372+0000 7f78ba9039c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:56:31.373 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.380+0000 7f78ba9039c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 info.flags=0x17 2024-09-12T00:56:31.373 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.380+0000 7f78ba9039c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 to cache LRU end 2024-09-12T00:56:31.373 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.380+0000 7f78ba9039c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:31.373 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.380+0000 7f78ba9039c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31, ofs0, ns] 2024-09-12T00:56:31.374 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.380+0000 7f778f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431616 cookie 94807468530080 notifier 6866 bl.length()=1015 2024-09-12T00:56:31.374 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.380+0000 7f778f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 info.flags=0x17 2024-09-12T00:56:31.374 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.380+0000 7f778f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 to cache LRU end 2024-09-12T00:56:31.374 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.380+0000 7f778f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:31.375 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.380+0000 7f78ba9039c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31]): orig_sources= new_sources= 2024-09-12T00:56:31.375 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.380+0000 7f78ba9039c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31]): potential sources added=[] removed=[] 2024-09-12T00:56:31.375 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.380+0000 7f78ba9039c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31]): orig_dests= new_dests= 2024-09-12T00:56:31.375 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.380+0000 7f78ba9039c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31]): potential dests added=[] removed=[] 2024-09-12T00:56:31.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.384+0000 7f78ba9039c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31.2.0 2024-09-12T00:56:31.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.384+0000 7f78ba9039c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31.2.0 2024-09-12T00:56:31.379 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.384+0000 7f78ba9039c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31.2.1 2024-09-12T00:56:31.379 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.384+0000 7f78ba9039c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31.2.1 2024-09-12T00:56:31.379 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.384+0000 7f78ba9039c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31.0 2024-09-12T00:56:31.382 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.388+0000 7f78ba9039c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:56:31.382 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.388+0000 7f78ba9039c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 2024-09-12T00:56:31.385 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.392+0000 7f78ba9039c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 info.flags=0x17 2024-09-12T00:56:31.385 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.392+0000 7f78ba9039c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 to cache LRU end 2024-09-12T00:56:31.385 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.392+0000 7f78ba9039c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:31.385 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.392+0000 7f78ba9039c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31, ofs0, ns] 2024-09-12T00:56:31.386 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.392+0000 7f778f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431617 cookie 94807468530080 notifier 6866 bl.length()=1015 2024-09-12T00:56:31.386 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.392+0000 7f778f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 info.flags=0x17 2024-09-12T00:56:31.386 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.392+0000 7f778f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 to cache LRU end 2024-09-12T00:56:31.386 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.392+0000 7f778f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:31.387 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.392+0000 7f78ba9039c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31]): orig_sources= new_sources= 2024-09-12T00:56:31.387 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.392+0000 7f78ba9039c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31]): potential sources added=[] removed=[] 2024-09-12T00:56:31.387 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.392+0000 7f78ba9039c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31]): orig_dests= new_dests= 2024-09-12T00:56:31.387 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.392+0000 7f78ba9039c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31]): potential dests added=[] removed=[] 2024-09-12T00:56:31.389 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.396+0000 7f78ba9039c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31.0 2024-09-12T00:56:31.389 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.396+0000 7f78ba9039c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:56:31.389 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.396+0000 7f78ba9039c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 2024-09-12T00:56:31.391 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.396+0000 7f78ba9039c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 info.flags=0x17 2024-09-12T00:56:31.391 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.396+0000 7f78ba9039c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 to cache LRU end 2024-09-12T00:56:31.391 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.396+0000 7f78ba9039c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:31.392 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.396+0000 7f78ba9039c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31, ofs0, ns] 2024-09-12T00:56:31.392 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.400+0000 7f778effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431618 cookie 94807468530080 notifier 6866 bl.length()=983 2024-09-12T00:56:31.392 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.400+0000 7f778effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 info.flags=0x17 2024-09-12T00:56:31.392 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.400+0000 7f778effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 to cache LRU end 2024-09-12T00:56:31.392 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.400+0000 7f778effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:31.393 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.400+0000 7f78ba9039c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31]): orig_sources= new_sources= 2024-09-12T00:56:31.393 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.400+0000 7f78ba9039c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31]): potential sources added=[] removed=[] 2024-09-12T00:56:31.393 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.400+0000 7f78ba9039c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31]): orig_dests= new_dests= 2024-09-12T00:56:31.393 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.400+0000 7f78ba9039c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31]): potential dests added=[] removed=[] 2024-09-12T00:56:31.394 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.400+0000 7f78ba9039c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:56:31.398 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.404+0000 7f776efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:31.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.408+0000 7f78ba9039c0 20 remove_watcher() i=0 2024-09-12T00:56:31.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.408+0000 7f78ba9039c0 2 removed watcher, disabling cache 2024-09-12T00:56:31.405 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.412+0000 7f78ba9039c0 20 remove_watcher() i=1 2024-09-12T00:56:31.407 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.412+0000 7f78ba9039c0 20 remove_watcher() i=2 2024-09-12T00:56:31.409 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.416+0000 7f78ba9039c0 20 remove_watcher() i=3 2024-09-12T00:56:31.411 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.416+0000 7f78ba9039c0 20 remove_watcher() i=4 2024-09-12T00:56:31.412 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.420+0000 7f78ba9039c0 20 remove_watcher() i=5 2024-09-12T00:56:31.414 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.420+0000 7f78ba9039c0 20 remove_watcher() i=6 2024-09-12T00:56:31.415 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.420+0000 7f78ba9039c0 20 remove_watcher() i=7 2024-09-12T00:56:31.430 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:56:31.456 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:31.457 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:31.500 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.504+0000 7fc8559d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.508+0000 7fc8559d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:31.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.508+0000 7fc8559d29c0 20 realm 2024-09-12T00:56:31.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.508+0000 7fc8559d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.508+0000 7fc8559d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:31.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.508+0000 7fc8559d29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:31.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.508+0000 7fc8559d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.508+0000 7fc8559d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:31.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.508+0000 7fc8559d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.503 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.508+0000 7fc8559d29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:31.503 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.512+0000 7fc8559d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.504 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.512+0000 7fc8559d29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:31.504 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.512+0000 7fc8559d29c0 20 searching for the correct realm 2024-09-12T00:56:31.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.516+0000 7fc8534d8640 0 -- 172.21.15.70:0/1802012870 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7fc84c027070 msgr2=0x7fc84c0607c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:31.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.524+0000 7fc8534d8640 0 -- 172.21.15.70:0/1802012870 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7fc84c07b040 msgr2=0x7fc84c06a040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:31.523 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.528+0000 7fc8559d29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:31.523 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.528+0000 7fc8559d29c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:56:31.524 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.528+0000 7fc8559d29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:31.524 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.528+0000 7fc8559d29c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:56:31.524 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.528+0000 7fc8559d29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:31.524 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.528+0000 7fc8559d29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:31.524 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.528+0000 7fc8559d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.525 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.528+0000 7fc8559d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:31.525 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.528+0000 7fc8559d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.527 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.532+0000 7fc8559d29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:31.527 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.532+0000 7fc8559d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.527 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.532+0000 7fc8559d29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:31.528 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.532+0000 7fc8559d29c0 20 zone default found 2024-09-12T00:56:31.528 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.532+0000 7fc8559d29c0 4 Realm: () 2024-09-12T00:56:31.528 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.532+0000 7fc8559d29c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:56:31.528 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.532+0000 7fc8559d29c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:56:31.528 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.532+0000 7fc8559d29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:31.529 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.532+0000 7fc8559d29c0 20 zonegroup default 2024-09-12T00:56:31.529 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.532+0000 7fc8559d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.529 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.532+0000 7fc8559d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:31.529 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.532+0000 7fc8559d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.529 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.532+0000 7fc8559d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:31.530 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.532+0000 7fc8559d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.530 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.532+0000 7fc8559d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:31.530 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.532+0000 7fc8559d29c0 20 started sync module instance, tier type = 2024-09-12T00:56:31.530 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.532+0000 7fc8559d29c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:56:31.540 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.548+0000 7fc8559d29c0 20 add_watcher() i=0 2024-09-12T00:56:31.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.548+0000 7fc8559d29c0 20 add_watcher() i=1 2024-09-12T00:56:31.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.548+0000 7fc8559d29c0 20 add_watcher() i=2 2024-09-12T00:56:31.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.548+0000 7fc8559d29c0 20 add_watcher() i=3 2024-09-12T00:56:31.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.548+0000 7fc8559d29c0 20 add_watcher() i=4 2024-09-12T00:56:31.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.548+0000 7fc8559d29c0 20 add_watcher() i=5 2024-09-12T00:56:31.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.548+0000 7fc8559d29c0 20 add_watcher() i=6 2024-09-12T00:56:31.542 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.548+0000 7fc8559d29c0 20 add_watcher() i=7 2024-09-12T00:56:31.542 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.548+0000 7fc8559d29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:31.544 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.552+0000 7fc709fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:31.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.552+0000 7fc8559d29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:31.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.552+0000 7fc8559d29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:31.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.552+0000 7fc8559d29c0 5 note: GC not initialized 2024-09-12T00:56:31.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.552+0000 7fc708fe1640 20 reqs_thread_entry: start 2024-09-12T00:56:31.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.552+0000 7fc8559d29c0 20 init_complete bucket index max shards: 1 2024-09-12T00:56:31.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.552+0000 7fc8559d29c0 20 Filter name: none 2024-09-12T00:56:31.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.552+0000 7fc6827fc640 20 reqs_thread_entry: start 2024-09-12T00:56:31.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.552+0000 7fc8559d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.552+0000 7fc8559d29c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:56:31.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.552+0000 7fc8559d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.552+0000 7fc8559d29c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:56:31.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.552+0000 7fc8559d29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:56:31.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.552+0000 7fc8559d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.556+0000 7fc8559d29c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:56:31.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.556+0000 7fc8559d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:31.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.556+0000 7fc8559d29c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:56:31.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.556+0000 7fc8559d29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:56:31.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.556+0000 7fc709fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:31.555 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.560+0000 7fc8559d29c0 20 remove_watcher() i=0 2024-09-12T00:56:31.555 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.560+0000 7fc8559d29c0 2 removed watcher, disabling cache 2024-09-12T00:56:31.557 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.564+0000 7fc8559d29c0 20 remove_watcher() i=1 2024-09-12T00:56:31.559 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.564+0000 7fc8559d29c0 20 remove_watcher() i=2 2024-09-12T00:56:31.561 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.568+0000 7fc8559d29c0 20 remove_watcher() i=3 2024-09-12T00:56:31.563 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.568+0000 7fc8559d29c0 20 remove_watcher() i=4 2024-09-12T00:56:31.564 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.572+0000 7fc8559d29c0 20 remove_watcher() i=5 2024-09-12T00:56:31.565 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.572+0000 7fc8559d29c0 20 remove_watcher() i=6 2024-09-12T00:56:31.566 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:31.572+0000 7fc8559d29c0 20 remove_watcher() i=7 2024-09-12T00:56:31.580 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:31.580 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:56:31.580 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-commit-target-layout id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:56:31.580 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:31.581 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:31.581 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:31.584 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:31.584 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:31.633 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:31.634 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:31.656 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-12T00:56:31.657 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:31.657 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:31.657 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:31.675 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:31.675 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:31.723 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:31.723 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:31.740 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:31.740 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:31.757 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:31.757 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:31.774 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:31.775 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:31.793 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:31.793 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:31.813 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:31.814 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:31.831 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:31.831 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:31.850 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:31.850 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:31.867 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:31.867 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:31.885 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:31.885 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:31.904 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:31.904 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:31.922 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:31.922 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:31.939 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:31.939 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:31.958 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:31.958 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:31.977 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:31.977 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:31.997 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:31.997 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:32.016 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:32.016 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:32.035 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:32.035 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:32.053 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:32.053 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:32.070 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:32.070 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:32.088 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:56:32.120 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:32.121 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:32.164 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.172+0000 7ff9ac2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.166 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.172+0000 7ff9ac2fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:32.167 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.172+0000 7ff9ac2fe9c0 20 realm 2024-09-12T00:56:32.167 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.172+0000 7ff9ac2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.167 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.172+0000 7ff9ac2fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:32.167 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.172+0000 7ff9ac2fe9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:32.167 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.172+0000 7ff9ac2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.167 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.172+0000 7ff9ac2fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:32.167 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.172+0000 7ff9ac2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.168 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.176+0000 7ff9ac2fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:32.168 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.176+0000 7ff9ac2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.169 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.176+0000 7ff9ac2fe9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:32.169 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.176+0000 7ff9ac2fe9c0 20 searching for the correct realm 2024-09-12T00:56:32.173 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.180+0000 7ff9aa605640 0 -- 172.21.15.70:0/3697567017 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7ff9a0008070 msgr2=0x7ff9a008f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:32.389 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.396+0000 7ff9aa605640 0 -- 172.21.15.70:0/3697567017 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7ff9a0008070 msgr2=0x7ff9a008f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:32.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.408+0000 7ff9ac2fe9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:32.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.408+0000 7ff9ac2fe9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:56:32.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.408+0000 7ff9ac2fe9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:32.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.408+0000 7ff9ac2fe9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:56:32.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.408+0000 7ff9ac2fe9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:32.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.408+0000 7ff9ac2fe9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:32.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.408+0000 7ff9ac2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.408+0000 7ff9ac2fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:32.402 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.408+0000 7ff9ac2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.402 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.408+0000 7ff9ac2fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:32.402 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.408+0000 7ff9ac2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.408+0000 7ff9ac2fe9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:32.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.408+0000 7ff9ac2fe9c0 20 zone default found 2024-09-12T00:56:32.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.408+0000 7ff9ac2fe9c0 4 Realm: () 2024-09-12T00:56:32.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.408+0000 7ff9ac2fe9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:56:32.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.408+0000 7ff9ac2fe9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:56:32.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.408+0000 7ff9ac2fe9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:32.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.408+0000 7ff9ac2fe9c0 20 zonegroup default 2024-09-12T00:56:32.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.408+0000 7ff9ac2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.404 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.412+0000 7ff9ac2fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:32.404 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.412+0000 7ff9ac2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.404 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.412+0000 7ff9ac2fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:32.405 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.412+0000 7ff9ac2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.405 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.412+0000 7ff9ac2fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:32.405 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.412+0000 7ff9ac2fe9c0 20 started sync module instance, tier type = 2024-09-12T00:56:32.405 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.412+0000 7ff9ac2fe9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:56:32.428 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.436+0000 7ff9ac2fe9c0 20 add_watcher() i=0 2024-09-12T00:56:32.429 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.436+0000 7ff9ac2fe9c0 20 add_watcher() i=1 2024-09-12T00:56:32.429 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.436+0000 7ff9ac2fe9c0 20 add_watcher() i=2 2024-09-12T00:56:32.429 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.436+0000 7ff9ac2fe9c0 20 add_watcher() i=3 2024-09-12T00:56:32.429 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.436+0000 7ff9ac2fe9c0 20 add_watcher() i=4 2024-09-12T00:56:32.429 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.436+0000 7ff9ac2fe9c0 20 add_watcher() i=5 2024-09-12T00:56:32.429 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.436+0000 7ff9ac2fe9c0 20 add_watcher() i=6 2024-09-12T00:56:32.431 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.436+0000 7ff9ac2fe9c0 20 add_watcher() i=7 2024-09-12T00:56:32.431 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.436+0000 7ff9ac2fe9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:32.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.440+0000 7ff85b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:32.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.444+0000 7ff9ac2fe9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:32.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.444+0000 7ff9ac2fe9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:32.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.444+0000 7ff9ac2fe9c0 5 note: GC not initialized 2024-09-12T00:56:32.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.444+0000 7ff85a7fc640 20 reqs_thread_entry: start 2024-09-12T00:56:32.437 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.444+0000 7ff9ac2fe9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:56:32.437 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.444+0000 7ff9ac2fe9c0 20 Filter name: none 2024-09-12T00:56:32.437 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.444+0000 7ff7cbfff640 20 reqs_thread_entry: start 2024-09-12T00:56:32.437 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.444+0000 7ff9ac2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.439 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.444+0000 7ff9ac2fe9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:56:32.439 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.444+0000 7ff9ac2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.439 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.444+0000 7ff9ac2fe9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:56:32.440 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.444+0000 7ff9ac2fe9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:56:32.440 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.444+0000 7ff9ac2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.440 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.448+0000 7ff9ac2fe9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:56:32.440 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.448+0000 7ff9ac2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.448+0000 7ff9ac2fe9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:56:32.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.448+0000 7ff9ac2fe9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:56:32.443 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.448+0000 7ff85b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:32.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.456+0000 7ff9ac2fe9c0 20 remove_watcher() i=0 2024-09-12T00:56:32.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.456+0000 7ff9ac2fe9c0 2 removed watcher, disabling cache 2024-09-12T00:56:32.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.456+0000 7ff9ac2fe9c0 20 remove_watcher() i=1 2024-09-12T00:56:32.453 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.460+0000 7ff9ac2fe9c0 20 remove_watcher() i=2 2024-09-12T00:56:32.455 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.460+0000 7ff9ac2fe9c0 20 remove_watcher() i=3 2024-09-12T00:56:32.457 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.464+0000 7ff9ac2fe9c0 20 remove_watcher() i=4 2024-09-12T00:56:32.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.464+0000 7ff9ac2fe9c0 20 remove_watcher() i=5 2024-09-12T00:56:32.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.468+0000 7ff9ac2fe9c0 20 remove_watcher() i=6 2024-09-12T00:56:32.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.468+0000 7ff9ac2fe9c0 20 remove_watcher() i=7 2024-09-12T00:56:32.476 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:32.477 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:56:32.477 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-commit-target-layout id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:56:32.477 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:32.477 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-12T00:56:32.512 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:32.512 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:32.554 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.560+0000 7f8e19d8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.556 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.564+0000 7f8e19d8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:32.556 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.564+0000 7f8e19d8e9c0 20 realm 2024-09-12T00:56:32.556 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.564+0000 7f8e19d8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.556 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.564+0000 7f8e19d8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:32.556 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.564+0000 7f8e19d8e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:32.556 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.564+0000 7f8e19d8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.556 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.564+0000 7f8e19d8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:32.556 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.564+0000 7f8e19d8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.558 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.564+0000 7f8e19d8e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:32.559 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.564+0000 7f8e19d8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.559 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.564+0000 7f8e19d8e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:32.559 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.564+0000 7f8e19d8e9c0 20 searching for the correct realm 2024-09-12T00:56:32.564 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.572+0000 7f8e18095640 0 -- 172.21.15.70:0/261296444 >> [v2:172.21.15.70:6808/276433067,v1:172.21.15.70:6809/276433067] conn(0x561ca483f000 msgr2=0x561ca48414c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:56:32.572 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.580+0000 7f8e17894640 0 -- 172.21.15.70:0/261296444 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f8e100bf040 msgr2=0x7f8e100b6420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:32.578 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.584+0000 7f8e19d8e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:32.578 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.584+0000 7f8e19d8e9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:56:32.578 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.584+0000 7f8e19d8e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:32.578 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.584+0000 7f8e19d8e9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:56:32.578 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.584+0000 7f8e19d8e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:32.579 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.584+0000 7f8e19d8e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:32.579 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.584+0000 7f8e19d8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.579 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.584+0000 7f8e19d8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:32.579 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.584+0000 7f8e19d8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.580 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.584+0000 7f8e19d8e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:32.580 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.584+0000 7f8e19d8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.580 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.584+0000 7f8e19d8e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:32.580 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.584+0000 7f8e19d8e9c0 20 zone default found 2024-09-12T00:56:32.580 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.584+0000 7f8e19d8e9c0 4 Realm: () 2024-09-12T00:56:32.580 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.584+0000 7f8e19d8e9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:56:32.580 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.584+0000 7f8e19d8e9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:56:32.580 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.584+0000 7f8e19d8e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:32.581 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.584+0000 7f8e19d8e9c0 20 zonegroup default 2024-09-12T00:56:32.581 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.584+0000 7f8e19d8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.581 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.584+0000 7f8e19d8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:32.581 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.584+0000 7f8e19d8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.581 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.588+0000 7f8e19d8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:32.581 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.588+0000 7f8e19d8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.581 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.588+0000 7f8e19d8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:32.581 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.588+0000 7f8e19d8e9c0 20 started sync module instance, tier type = 2024-09-12T00:56:32.582 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.588+0000 7f8e19d8e9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:56:32.596 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.604+0000 7f8e19d8e9c0 20 add_watcher() i=0 2024-09-12T00:56:32.596 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.604+0000 7f8e19d8e9c0 20 add_watcher() i=1 2024-09-12T00:56:32.596 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.604+0000 7f8e19d8e9c0 20 add_watcher() i=2 2024-09-12T00:56:32.596 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.604+0000 7f8e19d8e9c0 20 add_watcher() i=3 2024-09-12T00:56:32.596 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.604+0000 7f8e19d8e9c0 20 add_watcher() i=4 2024-09-12T00:56:32.596 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.604+0000 7f8e19d8e9c0 20 add_watcher() i=5 2024-09-12T00:56:32.596 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.604+0000 7f8e19d8e9c0 20 add_watcher() i=6 2024-09-12T00:56:32.597 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.604+0000 7f8e19d8e9c0 20 add_watcher() i=7 2024-09-12T00:56:32.597 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.604+0000 7f8e19d8e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:32.599 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.604+0000 7f8ccdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:32.600 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.608+0000 7f8e19d8e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:32.600 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.608+0000 7f8e19d8e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:32.600 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.608+0000 7f8e19d8e9c0 5 note: GC not initialized 2024-09-12T00:56:32.600 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.608+0000 7f8cccfe1640 20 reqs_thread_entry: start 2024-09-12T00:56:32.600 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.608+0000 7f8e19d8e9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:56:32.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.608+0000 7f8e19d8e9c0 20 Filter name: none 2024-09-12T00:56:32.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.608+0000 7f8c467fc640 20 reqs_thread_entry: start 2024-09-12T00:56:32.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.608+0000 7f8e19d8e9c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:56:32.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.608+0000 7f8e19d8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.608+0000 7f8e19d8e9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:56:32.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.608+0000 7f8e19d8e9c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:56:32.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.608+0000 7f8e19d8e9c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:56:32.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.608+0000 7f8e19d8e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32 : miss 2024-09-12T00:56:32.602 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.608+0000 7f8e19d8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.602 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.608+0000 7f8e19d8e9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:56:32.602 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.608+0000 7f8e19d8e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32 info.flags=0x17 2024-09-12T00:56:32.602 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.608+0000 7f8e19d8e9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32 to cache LRU end 2024-09-12T00:56:32.602 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.608+0000 7f8e19d8e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:32.602 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.608+0000 7f8e19d8e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:32.602 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.608+0000 7f8e19d8e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32 2024-09-12T00:56:32.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.616+0000 7f8e19d8e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32 info.flags=0x17 2024-09-12T00:56:32.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.616+0000 7f8e19d8e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32 to cache LRU end 2024-09-12T00:56:32.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.616+0000 7f8e19d8e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:32.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.616+0000 7f8e19d8e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32, ofs0, ns] 2024-09-12T00:56:32.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.616+0000 7f8cf6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431621 cookie 94681019198128 notifier 6917 bl.length()=1015 2024-09-12T00:56:32.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.616+0000 7f8cf6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32 info.flags=0x17 2024-09-12T00:56:32.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.616+0000 7f8cf6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32 to cache LRU end 2024-09-12T00:56:32.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.616+0000 7f8cf6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:32.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.616+0000 7f8e19d8e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32]): orig_sources= new_sources= 2024-09-12T00:56:32.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.616+0000 7f8e19d8e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32]): potential sources added=[] removed=[] 2024-09-12T00:56:32.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.616+0000 7f8e19d8e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32]): orig_dests= new_dests= 2024-09-12T00:56:32.610 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.616+0000 7f8e19d8e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32]): potential dests added=[] removed=[] 2024-09-12T00:56:32.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.620+0000 7f8e19d8e9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32.1.0 2024-09-12T00:56:32.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.620+0000 7f8e19d8e9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32.1.0 2024-09-12T00:56:32.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.620+0000 7f8e19d8e9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32.1.1 2024-09-12T00:56:32.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.620+0000 7f8e19d8e9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32.1.1 2024-09-12T00:56:32.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.620+0000 7f8e19d8e9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32.0 2024-09-12T00:56:32.619 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.624+0000 7f8e19d8e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:56:32.620 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.624+0000 7f8e19d8e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32 2024-09-12T00:56:32.621 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.628+0000 7f8e19d8e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32 info.flags=0x17 2024-09-12T00:56:32.621 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.628+0000 7f8e19d8e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32 to cache LRU end 2024-09-12T00:56:32.621 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.628+0000 7f8e19d8e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:32.621 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.628+0000 7f8e19d8e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32, ofs0, ns] 2024-09-12T00:56:32.622 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.628+0000 7f8cf67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431622 cookie 94681019198128 notifier 6917 bl.length()=1015 2024-09-12T00:56:32.622 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.628+0000 7f8cf67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32 info.flags=0x17 2024-09-12T00:56:32.622 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.628+0000 7f8cf67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32 to cache LRU end 2024-09-12T00:56:32.622 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.628+0000 7f8cf67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:32.622 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.628+0000 7f8e19d8e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32]): orig_sources= new_sources= 2024-09-12T00:56:32.622 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.628+0000 7f8e19d8e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32]): potential sources added=[] removed=[] 2024-09-12T00:56:32.622 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.628+0000 7f8e19d8e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32]): orig_dests= new_dests= 2024-09-12T00:56:32.623 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.628+0000 7f8e19d8e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32]): potential dests added=[] removed=[] 2024-09-12T00:56:32.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.632+0000 7f8e19d8e9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32.0 2024-09-12T00:56:32.626 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.632+0000 7f8e19d8e9c0 -1 Injecting error=-125 at location=commit_target_layout 2024-09-12T00:56:32.626 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.632+0000 7f8e19d8e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:56:32.626 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.632+0000 7f8e19d8e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32 2024-09-12T00:56:32.627 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.632+0000 7f8e19d8e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32 info.flags=0x17 2024-09-12T00:56:32.627 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.632+0000 7f8e19d8e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32 to cache LRU end 2024-09-12T00:56:32.627 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.632+0000 7f8e19d8e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:32.627 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.632+0000 7f8e19d8e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32, ofs0, ns] 2024-09-12T00:56:32.628 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.636+0000 7f8cf6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431623 cookie 94681019198128 notifier 6917 bl.length()=983 2024-09-12T00:56:32.628 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.636+0000 7f8cf6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32 info.flags=0x17 2024-09-12T00:56:32.628 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.636+0000 7f8cf6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32 to cache LRU end 2024-09-12T00:56:32.628 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.636+0000 7f8cf6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:32.629 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.636+0000 7f8e19d8e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32]): orig_sources= new_sources= 2024-09-12T00:56:32.629 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.636+0000 7f8e19d8e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32]): potential sources added=[] removed=[] 2024-09-12T00:56:32.629 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.636+0000 7f8e19d8e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32]): orig_dests= new_dests= 2024-09-12T00:56:32.629 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.636+0000 7f8e19d8e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32]): potential dests added=[] removed=[] 2024-09-12T00:56:32.631 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.636+0000 7f8e19d8e9c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:56:32.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.640+0000 7f8ccdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:32.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.644+0000 7f8e19d8e9c0 20 remove_watcher() i=0 2024-09-12T00:56:32.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.644+0000 7f8e19d8e9c0 2 removed watcher, disabling cache 2024-09-12T00:56:32.641 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.648+0000 7f8e19d8e9c0 20 remove_watcher() i=1 2024-09-12T00:56:32.643 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.648+0000 7f8e19d8e9c0 20 remove_watcher() i=2 2024-09-12T00:56:32.645 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.652+0000 7f8e19d8e9c0 20 remove_watcher() i=3 2024-09-12T00:56:32.647 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.652+0000 7f8e19d8e9c0 20 remove_watcher() i=4 2024-09-12T00:56:32.648 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.656+0000 7f8e19d8e9c0 20 remove_watcher() i=5 2024-09-12T00:56:32.649 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.656+0000 7f8e19d8e9c0 20 remove_watcher() i=6 2024-09-12T00:56:32.651 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.656+0000 7f8e19d8e9c0 20 remove_watcher() i=7 2024-09-12T00:56:32.665 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:56:32.691 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:32.692 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:32.734 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.740+0000 7fa3661459c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.736 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.744+0000 7fa3661459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:32.736 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.744+0000 7fa3661459c0 20 realm 2024-09-12T00:56:32.737 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.744+0000 7fa3661459c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.737 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.744+0000 7fa3661459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:32.737 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.744+0000 7fa3661459c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:32.737 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.744+0000 7fa3661459c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.737 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.744+0000 7fa3661459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:32.737 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.744+0000 7fa3661459c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.738 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.744+0000 7fa3661459c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:32.738 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.744+0000 7fa3661459c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.744+0000 7fa3661459c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:32.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.744+0000 7fa3661459c0 20 searching for the correct realm 2024-09-12T00:56:32.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.752+0000 7fa363c4b640 0 -- 172.21.15.70:0/2928100860 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7fa35c01d400 msgr2=0x7fa35c01d820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:32.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.760+0000 7fa363c4b640 0 -- 172.21.15.70:0/2928100860 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7fa22c080890 msgr2=0x7fa22c082ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:32.758 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.764+0000 7fa3661459c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:32.758 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.764+0000 7fa3661459c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:56:32.758 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.764+0000 7fa3661459c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:32.758 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.764+0000 7fa3661459c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:56:32.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.764+0000 7fa3661459c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:32.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.764+0000 7fa3661459c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:32.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.764+0000 7fa3661459c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.764+0000 7fa3661459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:32.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.764+0000 7fa3661459c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.764+0000 7fa3661459c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:32.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.764+0000 7fa3661459c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.764+0000 7fa3661459c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:32.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.764+0000 7fa3661459c0 20 zone default found 2024-09-12T00:56:32.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.764+0000 7fa3661459c0 4 Realm: () 2024-09-12T00:56:32.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.764+0000 7fa3661459c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:56:32.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.764+0000 7fa3661459c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:56:32.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.764+0000 7fa3661459c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:32.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.764+0000 7fa3661459c0 20 zonegroup default 2024-09-12T00:56:32.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.764+0000 7fa3661459c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.768+0000 7fa3661459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:32.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.768+0000 7fa3661459c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.768+0000 7fa3661459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:32.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.768+0000 7fa3661459c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.768+0000 7fa3661459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:32.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.768+0000 7fa3661459c0 20 started sync module instance, tier type = 2024-09-12T00:56:32.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.768+0000 7fa3661459c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:56:32.776 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.784+0000 7fa3661459c0 20 add_watcher() i=0 2024-09-12T00:56:32.776 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.784+0000 7fa3661459c0 20 add_watcher() i=1 2024-09-12T00:56:32.776 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.784+0000 7fa3661459c0 20 add_watcher() i=2 2024-09-12T00:56:32.776 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.784+0000 7fa3661459c0 20 add_watcher() i=3 2024-09-12T00:56:32.776 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.784+0000 7fa3661459c0 20 add_watcher() i=4 2024-09-12T00:56:32.776 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.784+0000 7fa3661459c0 20 add_watcher() i=5 2024-09-12T00:56:32.776 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.784+0000 7fa3661459c0 20 add_watcher() i=6 2024-09-12T00:56:32.777 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.784+0000 7fa3661459c0 20 add_watcher() i=7 2024-09-12T00:56:32.777 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.784+0000 7fa3661459c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:32.779 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.788+0000 7fa219fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:32.781 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.788+0000 7fa3661459c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:32.781 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.788+0000 7fa3661459c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:32.781 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.788+0000 7fa3661459c0 5 note: GC not initialized 2024-09-12T00:56:32.782 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.788+0000 7fa218fe1640 20 reqs_thread_entry: start 2024-09-12T00:56:32.782 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.788+0000 7fa3661459c0 20 init_complete bucket index max shards: 1 2024-09-12T00:56:32.782 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.788+0000 7fa3661459c0 20 Filter name: none 2024-09-12T00:56:32.782 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.788+0000 7fa1927fc640 20 reqs_thread_entry: start 2024-09-12T00:56:32.782 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.788+0000 7fa3661459c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.782 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.788+0000 7fa3661459c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:56:32.782 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.788+0000 7fa3661459c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.788+0000 7fa3661459c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:56:32.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.788+0000 7fa3661459c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:56:32.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.788+0000 7fa3661459c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.788+0000 7fa3661459c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:56:32.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.788+0000 7fa3661459c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:32.784 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.788+0000 7fa3661459c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:56:32.784 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.788+0000 7fa3661459c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:56:32.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.792+0000 7fa219fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:32.790 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.796+0000 7fa3661459c0 20 remove_watcher() i=0 2024-09-12T00:56:32.790 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.796+0000 7fa3661459c0 2 removed watcher, disabling cache 2024-09-12T00:56:32.792 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.800+0000 7fa3661459c0 20 remove_watcher() i=1 2024-09-12T00:56:32.794 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.800+0000 7fa3661459c0 20 remove_watcher() i=2 2024-09-12T00:56:32.796 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.804+0000 7fa3661459c0 20 remove_watcher() i=3 2024-09-12T00:56:32.799 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.804+0000 7fa3661459c0 20 remove_watcher() i=4 2024-09-12T00:56:32.800 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.808+0000 7fa3661459c0 20 remove_watcher() i=5 2024-09-12T00:56:32.801 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.808+0000 7fa3661459c0 20 remove_watcher() i=6 2024-09-12T00:56:32.802 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:32.808+0000 7fa3661459c0 20 remove_watcher() i=7 2024-09-12T00:56:32.815 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:32.816 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:56:32.816 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-commit-target-layout id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:56:32.816 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:32.817 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:32.817 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:32.820 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:32.820 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:32.870 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:32.870 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:32.895 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-12T00:56:32.896 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:32.897 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:32.897 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:32.918 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:32.918 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:32.964 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:32.964 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:32.983 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:32.983 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:33.002 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:33.002 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:33.020 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:33.021 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:33.039 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:33.039 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:33.058 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:33.058 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:33.075 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:33.075 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:33.094 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:33.094 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:33.115 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:33.115 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:33.133 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:33.133 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:33.152 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:33.152 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:33.171 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:33.171 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:33.190 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:33.190 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:33.210 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:33.210 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:33.227 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:33.228 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:33.245 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:33.245 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:33.263 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:33.263 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:33.281 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:33.282 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:33.300 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:33.300 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:33.320 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:33.320 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:56:33.336 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:56:33.370 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:33.370 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:33.414 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.420+0000 7f56e40279c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.416 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.424+0000 7f56e40279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:33.416 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.424+0000 7f56e40279c0 20 realm 2024-09-12T00:56:33.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.424+0000 7f56e40279c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.424+0000 7f56e40279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:33.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.424+0000 7f56e40279c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:33.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.424+0000 7f56e40279c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.424+0000 7f56e40279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:33.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.424+0000 7f56e40279c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.418 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.424+0000 7f56e40279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:33.418 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.424+0000 7f56e40279c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.424+0000 7f56e40279c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:33.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.424+0000 7f56e40279c0 20 searching for the correct realm 2024-09-12T00:56:33.424 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.428+0000 7f56e232e640 0 -- 172.21.15.70:0/3068981174 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f56d813e040 msgr2=0x7f56d80f5120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:56:33.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.644+0000 7f56e232e640 0 -- 172.21.15.70:0/3068981174 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f56d813e040 msgr2=0x7f56d80f5120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:33.650 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.656+0000 7f56e40279c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:33.650 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.656+0000 7f56e40279c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:56:33.650 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.656+0000 7f56e40279c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:33.650 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.656+0000 7f56e40279c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:56:33.651 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.656+0000 7f56e40279c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:33.651 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.656+0000 7f56e40279c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:33.651 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.656+0000 7f56e40279c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.651 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.656+0000 7f56e40279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:33.651 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.656+0000 7f56e40279c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.652 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.660+0000 7f56e40279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:33.652 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.660+0000 7f56e40279c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.660+0000 7f56e40279c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:33.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.660+0000 7f56e40279c0 20 zone default found 2024-09-12T00:56:33.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.660+0000 7f56e40279c0 4 Realm: () 2024-09-12T00:56:33.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.660+0000 7f56e40279c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:56:33.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.660+0000 7f56e40279c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:56:33.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.660+0000 7f56e40279c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:33.654 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.660+0000 7f56e40279c0 20 zonegroup default 2024-09-12T00:56:33.654 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.660+0000 7f56e40279c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.654 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.660+0000 7f56e40279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:33.654 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.660+0000 7f56e40279c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.654 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.660+0000 7f56e40279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:33.654 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.660+0000 7f56e40279c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.660+0000 7f56e40279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:33.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.660+0000 7f56e40279c0 20 started sync module instance, tier type = 2024-09-12T00:56:33.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.660+0000 7f56e40279c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:56:33.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.680+0000 7f56e40279c0 20 add_watcher() i=0 2024-09-12T00:56:33.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.680+0000 7f56e40279c0 20 add_watcher() i=1 2024-09-12T00:56:33.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.680+0000 7f56e40279c0 20 add_watcher() i=2 2024-09-12T00:56:33.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.680+0000 7f56e40279c0 20 add_watcher() i=3 2024-09-12T00:56:33.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.680+0000 7f56e40279c0 20 add_watcher() i=4 2024-09-12T00:56:33.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.680+0000 7f56e40279c0 20 add_watcher() i=5 2024-09-12T00:56:33.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.684+0000 7f56e40279c0 20 add_watcher() i=6 2024-09-12T00:56:33.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.684+0000 7f56e40279c0 20 add_watcher() i=7 2024-09-12T00:56:33.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.684+0000 7f56e40279c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:33.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.688+0000 7f55937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:33.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.688+0000 7f56e40279c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:33.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.688+0000 7f56e40279c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:33.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.688+0000 7f56e40279c0 5 note: GC not initialized 2024-09-12T00:56:33.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.688+0000 7f55927fc640 20 reqs_thread_entry: start 2024-09-12T00:56:33.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.688+0000 7f56e40279c0 20 init_complete bucket index max shards: 1 2024-09-12T00:56:33.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.688+0000 7f56e40279c0 20 Filter name: none 2024-09-12T00:56:33.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.688+0000 7f5503fff640 20 reqs_thread_entry: start 2024-09-12T00:56:33.684 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.688+0000 7f56e40279c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.684 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.692+0000 7f56e40279c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:56:33.684 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.692+0000 7f56e40279c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.685 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.692+0000 7f56e40279c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:56:33.686 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.692+0000 7f56e40279c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:56:33.686 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.692+0000 7f56e40279c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.686 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.692+0000 7f56e40279c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:56:33.686 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.692+0000 7f56e40279c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.687 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.692+0000 7f56e40279c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:56:33.687 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.692+0000 7f56e40279c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:56:33.689 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.696+0000 7f55937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:33.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.700+0000 7f56e40279c0 20 remove_watcher() i=0 2024-09-12T00:56:33.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.700+0000 7f56e40279c0 2 removed watcher, disabling cache 2024-09-12T00:56:33.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.704+0000 7f56e40279c0 20 remove_watcher() i=1 2024-09-12T00:56:33.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.704+0000 7f56e40279c0 20 remove_watcher() i=2 2024-09-12T00:56:33.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.708+0000 7f56e40279c0 20 remove_watcher() i=3 2024-09-12T00:56:33.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.712+0000 7f56e40279c0 20 remove_watcher() i=4 2024-09-12T00:56:33.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.712+0000 7f56e40279c0 20 remove_watcher() i=5 2024-09-12T00:56:33.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.712+0000 7f56e40279c0 20 remove_watcher() i=6 2024-09-12T00:56:33.708 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.716+0000 7f56e40279c0 20 remove_watcher() i=7 2024-09-12T00:56:33.731 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.731 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:56:33.731 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: abort-at-commit-target-layout id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:56:33.731 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.731 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-12T00:56:33.765 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:33.765 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:33.809 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.816+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.811 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.816+0000 7f58f8b969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:33.811 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.816+0000 7f58f8b969c0 20 realm 2024-09-12T00:56:33.811 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.816+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.811 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.816+0000 7f58f8b969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:33.812 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.816+0000 7f58f8b969c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:33.812 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.816+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.812 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.820+0000 7f58f8b969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:33.812 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.820+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.813 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.820+0000 7f58f8b969c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:33.813 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.820+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.814 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.820+0000 7f58f8b969c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:33.814 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.820+0000 7f58f8b969c0 20 searching for the correct realm 2024-09-12T00:56:33.819 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.824+0000 7f58f6e9d640 0 -- 172.21.15.70:0/2816844602 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f58ec0e3040 msgr2=0x7f58ec0e3420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:33.822 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.828+0000 7f58f669c640 0 -- 172.21.15.70:0/2816844602 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f58f00a6a10 msgr2=0x7f58f00a8e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:56:33.836 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.840+0000 7f58f8b969c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:33.836 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.840+0000 7f58f8b969c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:56:33.836 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.840+0000 7f58f8b969c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:33.836 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.840+0000 7f58f8b969c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:56:33.836 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.840+0000 7f58f8b969c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:33.836 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.840+0000 7f58f8b969c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:33.836 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.840+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.837 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:33.837 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.838 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:33.838 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.838 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:33.838 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 zone default found 2024-09-12T00:56:33.838 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.844+0000 7f58f8b969c0 4 Realm: () 2024-09-12T00:56:33.838 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.844+0000 7f58f8b969c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:56:33.838 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.844+0000 7f58f8b969c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:56:33.839 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.844+0000 7f58f8b969c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:33.839 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 zonegroup default 2024-09-12T00:56:33.839 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.839 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:33.839 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.839 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:33.839 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.839 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:33.839 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 started sync module instance, tier type = 2024-09-12T00:56:33.840 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:56:33.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.860+0000 7f58f8b969c0 20 add_watcher() i=0 2024-09-12T00:56:33.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.860+0000 7f58f8b969c0 20 add_watcher() i=1 2024-09-12T00:56:33.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.860+0000 7f58f8b969c0 20 add_watcher() i=2 2024-09-12T00:56:33.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.860+0000 7f58f8b969c0 20 add_watcher() i=3 2024-09-12T00:56:33.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.860+0000 7f58f8b969c0 20 add_watcher() i=4 2024-09-12T00:56:33.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.860+0000 7f58f8b969c0 20 add_watcher() i=5 2024-09-12T00:56:33.854 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.860+0000 7f58f8b969c0 20 add_watcher() i=6 2024-09-12T00:56:33.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.860+0000 7f58f8b969c0 20 add_watcher() i=7 2024-09-12T00:56:33.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.860+0000 7f58f8b969c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:33.857 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.864+0000 7f57ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:33.858 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.864+0000 7f58f8b969c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:33.858 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.864+0000 7f58f8b969c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:33.858 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 note: GC not initialized 2024-09-12T00:56:33.858 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.864+0000 7f57a77fe640 20 reqs_thread_entry: start 2024-09-12T00:56:33.858 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.864+0000 7f58f8b969c0 20 init_complete bucket index max shards: 1 2024-09-12T00:56:33.858 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.864+0000 7f58f8b969c0 20 Filter name: none 2024-09-12T00:56:33.858 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.864+0000 7f57a57fa640 20 reqs_thread_entry: start 2024-09-12T00:56:33.858 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.864+0000 7f58f8b969c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:56:33.858 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.864+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.859 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.864+0000 7f58f8b969c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:56:33.859 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.864+0000 7f58f8b969c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:56:33.859 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.864+0000 7f58f8b969c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:56:33.859 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.864+0000 7f58f8b969c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 : miss 2024-09-12T00:56:33.859 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.864+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.860 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.864+0000 7f58f8b969c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:56:33.860 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.864+0000 7f58f8b969c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 info.flags=0x17 2024-09-12T00:56:33.860 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.864+0000 7f58f8b969c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 to cache LRU end 2024-09-12T00:56:33.860 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.864+0000 7f58f8b969c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:33.860 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.864+0000 7f58f8b969c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:33.860 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.864+0000 7f58f8b969c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 2024-09-12T00:56:33.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.876+0000 7f58f8b969c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 info.flags=0x17 2024-09-12T00:56:33.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.876+0000 7f58f8b969c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 to cache LRU end 2024-09-12T00:56:33.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.876+0000 7f58f8b969c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:33.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.876+0000 7f58f8b969c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33, ofs0, ns] 2024-09-12T00:56:33.869 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.876+0000 7f57d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431611 cookie 94769229095424 notifier 7398 bl.length()=1015 2024-09-12T00:56:33.869 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.876+0000 7f57d97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 info.flags=0x17 2024-09-12T00:56:33.869 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.876+0000 7f57d97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 to cache LRU end 2024-09-12T00:56:33.869 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.876+0000 7f57d97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:33.870 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.876+0000 7f58f8b969c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): orig_sources= new_sources= 2024-09-12T00:56:33.870 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.876+0000 7f58f8b969c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): potential sources added=[] removed=[] 2024-09-12T00:56:33.870 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.876+0000 7f58f8b969c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): orig_dests= new_dests= 2024-09-12T00:56:33.870 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.876+0000 7f58f8b969c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): potential dests added=[] removed=[] 2024-09-12T00:56:33.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.884+0000 7f58f8b969c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33.1.0 2024-09-12T00:56:33.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.884+0000 7f58f8b969c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33.1.0 2024-09-12T00:56:33.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.884+0000 7f58f8b969c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33.1.1 2024-09-12T00:56:33.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.884+0000 7f58f8b969c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33.1.1 2024-09-12T00:56:33.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.884+0000 7f58f8b969c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33.0 2024-09-12T00:56:33.880 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.888+0000 7f58f8b969c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:56:33.880 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.888+0000 7f58f8b969c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 2024-09-12T00:56:33.883 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.888+0000 7f58f8b969c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 info.flags=0x17 2024-09-12T00:56:33.883 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.888+0000 7f58f8b969c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 to cache LRU end 2024-09-12T00:56:33.883 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.888+0000 7f58f8b969c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:33.883 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.888+0000 7f58f8b969c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33, ofs0, ns] 2024-09-12T00:56:33.884 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.892+0000 7f57d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431612 cookie 94769229095424 notifier 7398 bl.length()=1015 2024-09-12T00:56:33.884 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.892+0000 7f57d97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 info.flags=0x17 2024-09-12T00:56:33.884 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.892+0000 7f57d97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 to cache LRU end 2024-09-12T00:56:33.884 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.892+0000 7f57d97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:33.885 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.892+0000 7f58f8b969c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): orig_sources= new_sources= 2024-09-12T00:56:33.885 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.892+0000 7f58f8b969c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): potential sources added=[] removed=[] 2024-09-12T00:56:33.885 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.892+0000 7f58f8b969c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): orig_dests= new_dests= 2024-09-12T00:56:33.885 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.892+0000 7f58f8b969c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): potential dests added=[] removed=[] 2024-09-12T00:56:33.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.896+0000 7f58f8b969c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33.0 2024-09-12T00:56:33.889 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f58f8b969c0 time 2024-09-12T00:56:33.900273+0000 2024-09-12T00:56:33.889 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:56:33.890 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:56:33.890 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f58fc4702eb] 2024-09-12T00:56:33.890 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f58fc47049f] 2024-09-12T00:56:33.890 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56312bf47cc1] 2024-09-12T00:56:33.890 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x56312bf5cfc7] 2024-09-12T00:56:33.890 INFO:tasks.workunit.client.0.smithi070.stderr: 5: main() 2024-09-12T00:56:33.890 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f58fb2d6d90] 2024-09-12T00:56:33.891 INFO:tasks.workunit.client.0.smithi070.stderr: 7: __libc_start_main() 2024-09-12T00:56:33.891 INFO:tasks.workunit.client.0.smithi070.stderr: 8: _start() 2024-09-12T00:56:33.891 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.896+0000 7f58f8b969c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f58f8b969c0 time 2024-09-12T00:56:33.900273+0000 2024-09-12T00:56:33.891 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:56:33.891 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.891 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:56:33.891 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f58fc4702eb] 2024-09-12T00:56:33.891 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f58fc47049f] 2024-09-12T00:56:33.891 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56312bf47cc1] 2024-09-12T00:56:33.891 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x56312bf5cfc7] 2024-09-12T00:56:33.891 INFO:tasks.workunit.client.0.smithi070.stderr: 5: main() 2024-09-12T00:56:33.891 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f58fb2d6d90] 2024-09-12T00:56:33.892 INFO:tasks.workunit.client.0.smithi070.stderr: 7: __libc_start_main() 2024-09-12T00:56:33.892 INFO:tasks.workunit.client.0.smithi070.stderr: 8: _start() 2024-09-12T00:56:33.892 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.892 INFO:tasks.workunit.client.0.smithi070.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:56:33.892 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f58f8b969c0 thread_name:radosgw-admin 2024-09-12T00:56:33.912 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:56:33.912 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f58fb2ef520] 2024-09-12T00:56:33.912 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:56:33.912 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:56:33.912 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:56:33.912 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f58fc470345] 2024-09-12T00:56:33.912 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f58fc47049f] 2024-09-12T00:56:33.913 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56312bf47cc1] 2024-09-12T00:56:33.913 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x56312bf5cfc7] 2024-09-12T00:56:33.913 INFO:tasks.workunit.client.0.smithi070.stderr: 9: main() 2024-09-12T00:56:33.913 INFO:tasks.workunit.client.0.smithi070.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f58fb2d6d90] 2024-09-12T00:56:33.913 INFO:tasks.workunit.client.0.smithi070.stderr: 11: __libc_start_main() 2024-09-12T00:56:33.913 INFO:tasks.workunit.client.0.smithi070.stderr: 12: _start() 2024-09-12T00:56:33.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.896+0000 7f58f8b969c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:56:33.913 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f58f8b969c0 thread_name:radosgw-admin 2024-09-12T00:56:33.913 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.913 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:56:33.913 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f58fb2ef520] 2024-09-12T00:56:33.913 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:56:33.913 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:56:33.913 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:56:33.914 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f58fc470345] 2024-09-12T00:56:33.914 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f58fc47049f] 2024-09-12T00:56:33.914 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56312bf47cc1] 2024-09-12T00:56:33.914 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x56312bf5cfc7] 2024-09-12T00:56:33.914 INFO:tasks.workunit.client.0.smithi070.stderr: 9: main() 2024-09-12T00:56:33.914 INFO:tasks.workunit.client.0.smithi070.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f58fb2d6d90] 2024-09-12T00:56:33.914 INFO:tasks.workunit.client.0.smithi070.stderr: 11: __libc_start_main() 2024-09-12T00:56:33.914 INFO:tasks.workunit.client.0.smithi070.stderr: 12: _start() 2024-09-12T00:56:33.914 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:56:33.914 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.914 INFO:tasks.workunit.client.0.smithi070.stderr:--- begin dump of recent events --- 2024-09-12T00:56:33.914 INFO:tasks.workunit.client.0.smithi070.stderr: -499> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 5 AuthRegistry(0x56312e2e7ba0) adding con mode: crc 2024-09-12T00:56:33.914 INFO:tasks.workunit.client.0.smithi070.stderr: -498> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 5 AuthRegistry(0x56312e2e7ba0) adding con mode: secure 2024-09-12T00:56:33.914 INFO:tasks.workunit.client.0.smithi070.stderr: -497> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:33.914 INFO:tasks.workunit.client.0.smithi070.stderr: -496> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:33.915 INFO:tasks.workunit.client.0.smithi070.stderr: -495> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command rotate-key hook 0x56312e2e7ce8 2024-09-12T00:56:33.915 INFO:tasks.workunit.client.0.smithi070.stderr: -494> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient: _reopen_session rank -1 2024-09-12T00:56:33.915 INFO:tasks.workunit.client.0.smithi070.stderr: -493> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:56:33.915 INFO:tasks.workunit.client.0.smithi070.stderr: -492> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient(hunting): picked mon.noname-b con 0x56312e1a3480 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:56:33.915 INFO:tasks.workunit.client.0.smithi070.stderr: -491> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient(hunting): picked mon.noname-a con 0x56312e1a4330 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:56:33.915 INFO:tasks.workunit.client.0.smithi070.stderr: -490> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient(hunting): picked mon.noname-c con 0x56312e2ee450 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:56:33.915 INFO:tasks.workunit.client.0.smithi070.stderr: -489> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:33.915 INFO:tasks.workunit.client.0.smithi070.stderr: -488> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:33.915 INFO:tasks.workunit.client.0.smithi070.stderr: -487> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:33.915 INFO:tasks.workunit.client.0.smithi070.stderr: -486> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient(hunting): _renew_subs 2024-09-12T00:56:33.915 INFO:tasks.workunit.client.0.smithi070.stderr: -485> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient(hunting): authenticate will time out at 2244.246351s 2024-09-12T00:56:33.915 INFO:tasks.workunit.client.0.smithi070.stderr: -484> 2024-09-12T00:56:33.796+0000 7f58f6e9d640 10 monclient(hunting): get_auth_request con 0x56312e2ee450 auth_method 0 2024-09-12T00:56:33.915 INFO:tasks.workunit.client.0.smithi070.stderr: -483> 2024-09-12T00:56:33.796+0000 7f58f6e9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:33.915 INFO:tasks.workunit.client.0.smithi070.stderr: -482> 2024-09-12T00:56:33.796+0000 7f58f6e9d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:33.915 INFO:tasks.workunit.client.0.smithi070.stderr: -481> 2024-09-12T00:56:33.796+0000 7f58f6e9d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:33.916 INFO:tasks.workunit.client.0.smithi070.stderr: -480> 2024-09-12T00:56:33.796+0000 7f58f5e9b640 10 monclient(hunting): get_auth_request con 0x56312e1a4330 auth_method 0 2024-09-12T00:56:33.916 INFO:tasks.workunit.client.0.smithi070.stderr: -479> 2024-09-12T00:56:33.796+0000 7f58f5e9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:33.916 INFO:tasks.workunit.client.0.smithi070.stderr: -478> 2024-09-12T00:56:33.796+0000 7f58f5e9b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:33.916 INFO:tasks.workunit.client.0.smithi070.stderr: -477> 2024-09-12T00:56:33.796+0000 7f58f5e9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:33.916 INFO:tasks.workunit.client.0.smithi070.stderr: -476> 2024-09-12T00:56:33.796+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:33.916 INFO:tasks.workunit.client.0.smithi070.stderr: -475> 2024-09-12T00:56:33.796+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:33.916 INFO:tasks.workunit.client.0.smithi070.stderr: -474> 2024-09-12T00:56:33.796+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:33.916 INFO:tasks.workunit.client.0.smithi070.stderr: -473> 2024-09-12T00:56:33.796+0000 7f58f5e9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:33.916 INFO:tasks.workunit.client.0.smithi070.stderr: -472> 2024-09-12T00:56:33.796+0000 7f58f5e9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:33.916 INFO:tasks.workunit.client.0.smithi070.stderr: -471> 2024-09-12T00:56:33.796+0000 7f58f5e9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:33.916 INFO:tasks.workunit.client.0.smithi070.stderr: -470> 2024-09-12T00:56:33.796+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_done global_id 6959 payload 824 2024-09-12T00:56:33.916 INFO:tasks.workunit.client.0.smithi070.stderr: -469> 2024-09-12T00:56:33.796+0000 7f58f6e9d640 10 monclient: _finish_hunting 0 2024-09-12T00:56:33.916 INFO:tasks.workunit.client.0.smithi070.stderr: -468> 2024-09-12T00:56:33.796+0000 7f58f6e9d640 1 monclient: found mon.noname-c 2024-09-12T00:56:33.916 INFO:tasks.workunit.client.0.smithi070.stderr: -467> 2024-09-12T00:56:33.796+0000 7f58f6e9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:56:33.916 INFO:tasks.workunit.client.0.smithi070.stderr: -466> 2024-09-12T00:56:33.796+0000 7f58f669c640 10 monclient: get_auth_request con 0x56312e1a3480 auth_method 0 2024-09-12T00:56:33.917 INFO:tasks.workunit.client.0.smithi070.stderr: -465> 2024-09-12T00:56:33.796+0000 7f57e2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:33.917 INFO:tasks.workunit.client.0.smithi070.stderr: -464> 2024-09-12T00:56:33.796+0000 7f57e2e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:56:33.917 INFO:tasks.workunit.client.0.smithi070.stderr: -463> 2024-09-12T00:56:33.796+0000 7f57e2e05640 10 monclient: dump: 2024-09-12T00:56:33.917 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:56:33.917 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:56:33.917 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.917 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.917 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:33.917 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:56:33.917 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:56:33.917 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:56:33.917 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:56:33.917 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.917 INFO:tasks.workunit.client.0.smithi070.stderr: -462> 2024-09-12T00:56:33.796+0000 7f57e2e05640 10 monclient: _finish_auth 0 2024-09-12T00:56:33.918 INFO:tasks.workunit.client.0.smithi070.stderr: -461> 2024-09-12T00:56:33.796+0000 7f57e2e05640 10 monclient: _check_auth_tickets 2024-09-12T00:56:33.918 INFO:tasks.workunit.client.0.smithi070.stderr: -460> 2024-09-12T00:56:33.796+0000 7f57e2e05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:56:33.918 INFO:tasks.workunit.client.0.smithi070.stderr: -459> 2024-09-12T00:56:33.796+0000 7f57e2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:33.918 INFO:tasks.workunit.client.0.smithi070.stderr: -458> 2024-09-12T00:56:33.796+0000 7f57e2e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:56:33.918 INFO:tasks.workunit.client.0.smithi070.stderr: -457> 2024-09-12T00:56:33.796+0000 7f57e2e05640 10 monclient: dump: 2024-09-12T00:56:33.918 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:56:33.918 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:56:33.918 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.918 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.920 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:33.920 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:56:33.920 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:56:33.920 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:56:33.920 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:56:33.920 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.920 INFO:tasks.workunit.client.0.smithi070.stderr: -456> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 5 monclient: authenticate success, global_id 6959 2024-09-12T00:56:33.921 INFO:tasks.workunit.client.0.smithi070.stderr: -455> 2024-09-12T00:56:33.796+0000 7f57e4608640 4 set_mon_vals no callback set 2024-09-12T00:56:33.921 INFO:tasks.workunit.client.0.smithi070.stderr: -454> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient: _renew_subs 2024-09-12T00:56:33.921 INFO:tasks.workunit.client.0.smithi070.stderr: -453> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:56:33.921 INFO:tasks.workunit.client.0.smithi070.stderr: -452> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient: _renew_subs 2024-09-12T00:56:33.921 INFO:tasks.workunit.client.0.smithi070.stderr: -451> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:56:33.921 INFO:tasks.workunit.client.0.smithi070.stderr: -450> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 1 librados: init done 2024-09-12T00:56:33.921 INFO:tasks.workunit.client.0.smithi070.stderr: -449> 2024-09-12T00:56:33.800+0000 7f57e2e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:56:33.921 INFO:tasks.workunit.client.0.smithi070.stderr: -448> 2024-09-12T00:56:33.800+0000 7f57e2e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:56:33.921 INFO:tasks.workunit.client.0.smithi070.stderr: -447> 2024-09-12T00:56:33.800+0000 7f57e2e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:56:33.921 INFO:tasks.workunit.client.0.smithi070.stderr: -446> 2024-09-12T00:56:33.800+0000 7f58f669c640 10 monclient: get_auth_request con 0x7f57dc070ae0 auth_method 0 2024-09-12T00:56:33.921 INFO:tasks.workunit.client.0.smithi070.stderr: -445> 2024-09-12T00:56:33.800+0000 7f58f5e9b640 10 monclient: get_auth_request con 0x56312e310050 auth_method 0 2024-09-12T00:56:33.921 INFO:tasks.workunit.client.0.smithi070.stderr: -444> 2024-09-12T00:56:33.800+0000 7f58f669c640 10 monclient: get_auth_request con 0x56312e332fc0 auth_method 0 2024-09-12T00:56:33.922 INFO:tasks.workunit.client.0.smithi070.stderr: -443> 2024-09-12T00:56:33.804+0000 7f58f5e9b640 10 monclient: get_auth_request con 0x56312e3371b0 auth_method 0 2024-09-12T00:56:33.922 INFO:tasks.workunit.client.0.smithi070.stderr: -442> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 10 monclient: build_initial_monmap 2024-09-12T00:56:33.922 INFO:tasks.workunit.client.0.smithi070.stderr: -441> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 1 build_initial for_mkfs: 0 2024-09-12T00:56:33.922 INFO:tasks.workunit.client.0.smithi070.stderr: -440> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 10 monclient: monmap: 2024-09-12T00:56:33.922 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:56:33.922 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:56:33.922 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:56:33.922 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:56:33.922 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:56:33.922 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:56:33.922 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:56:33.922 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:56:33.923 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:56:33.923 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.923 INFO:tasks.workunit.client.0.smithi070.stderr: -439> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding auth protocol: cephx 2024-09-12T00:56:33.923 INFO:tasks.workunit.client.0.smithi070.stderr: -438> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding auth protocol: cephx 2024-09-12T00:56:33.923 INFO:tasks.workunit.client.0.smithi070.stderr: -437> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding auth protocol: cephx 2024-09-12T00:56:33.923 INFO:tasks.workunit.client.0.smithi070.stderr: -436> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding con mode: secure 2024-09-12T00:56:33.923 INFO:tasks.workunit.client.0.smithi070.stderr: -435> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding con mode: crc 2024-09-12T00:56:33.923 INFO:tasks.workunit.client.0.smithi070.stderr: -434> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding con mode: secure 2024-09-12T00:56:33.923 INFO:tasks.workunit.client.0.smithi070.stderr: -433> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding con mode: crc 2024-09-12T00:56:33.923 INFO:tasks.workunit.client.0.smithi070.stderr: -432> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding con mode: secure 2024-09-12T00:56:33.923 INFO:tasks.workunit.client.0.smithi070.stderr: -431> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding con mode: crc 2024-09-12T00:56:33.923 INFO:tasks.workunit.client.0.smithi070.stderr: -430> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding con mode: crc 2024-09-12T00:56:33.923 INFO:tasks.workunit.client.0.smithi070.stderr: -429> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding con mode: secure 2024-09-12T00:56:33.923 INFO:tasks.workunit.client.0.smithi070.stderr: -428> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding con mode: crc 2024-09-12T00:56:33.924 INFO:tasks.workunit.client.0.smithi070.stderr: -427> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding con mode: secure 2024-09-12T00:56:33.924 INFO:tasks.workunit.client.0.smithi070.stderr: -426> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding con mode: crc 2024-09-12T00:56:33.924 INFO:tasks.workunit.client.0.smithi070.stderr: -425> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding con mode: secure 2024-09-12T00:56:33.924 INFO:tasks.workunit.client.0.smithi070.stderr: -424> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:33.924 INFO:tasks.workunit.client.0.smithi070.stderr: -423> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command objecter_requests cmddesc objecter_requests hook 0x56312e33fa20 EEXIST 2024-09-12T00:56:33.924 INFO:tasks.workunit.client.0.smithi070.stderr: -422> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 10 monclient: init 2024-09-12T00:56:33.924 INFO:tasks.workunit.client.0.smithi070.stderr: -421> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding auth protocol: cephx 2024-09-12T00:56:33.924 INFO:tasks.workunit.client.0.smithi070.stderr: -420> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding auth protocol: cephx 2024-09-12T00:56:33.924 INFO:tasks.workunit.client.0.smithi070.stderr: -419> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding auth protocol: cephx 2024-09-12T00:56:33.924 INFO:tasks.workunit.client.0.smithi070.stderr: -418> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding con mode: secure 2024-09-12T00:56:33.924 INFO:tasks.workunit.client.0.smithi070.stderr: -417> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding con mode: crc 2024-09-12T00:56:33.924 INFO:tasks.workunit.client.0.smithi070.stderr: -416> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding con mode: secure 2024-09-12T00:56:33.925 INFO:tasks.workunit.client.0.smithi070.stderr: -415> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding con mode: crc 2024-09-12T00:56:33.925 INFO:tasks.workunit.client.0.smithi070.stderr: -414> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding con mode: secure 2024-09-12T00:56:33.925 INFO:tasks.workunit.client.0.smithi070.stderr: -413> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding con mode: crc 2024-09-12T00:56:33.925 INFO:tasks.workunit.client.0.smithi070.stderr: -412> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding con mode: crc 2024-09-12T00:56:33.925 INFO:tasks.workunit.client.0.smithi070.stderr: -411> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding con mode: secure 2024-09-12T00:56:33.925 INFO:tasks.workunit.client.0.smithi070.stderr: -410> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding con mode: crc 2024-09-12T00:56:33.925 INFO:tasks.workunit.client.0.smithi070.stderr: -409> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding con mode: secure 2024-09-12T00:56:33.925 INFO:tasks.workunit.client.0.smithi070.stderr: -408> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding con mode: crc 2024-09-12T00:56:33.925 INFO:tasks.workunit.client.0.smithi070.stderr: -407> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding con mode: secure 2024-09-12T00:56:33.925 INFO:tasks.workunit.client.0.smithi070.stderr: -406> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:33.925 INFO:tasks.workunit.client.0.smithi070.stderr: -405> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:33.925 INFO:tasks.workunit.client.0.smithi070.stderr: -404> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command rotate-key cmddesc rotate-key hook 0x56312e33a840 EEXIST 2024-09-12T00:56:33.925 INFO:tasks.workunit.client.0.smithi070.stderr: -403> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 10 monclient: _reopen_session rank -1 2024-09-12T00:56:33.925 INFO:tasks.workunit.client.0.smithi070.stderr: -402> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:56:33.926 INFO:tasks.workunit.client.0.smithi070.stderr: -401> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 10 monclient(hunting): picked mon.noname-a con 0x56312e363bd0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:56:33.926 INFO:tasks.workunit.client.0.smithi070.stderr: -400> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 10 monclient(hunting): picked mon.noname-c con 0x56312e363500 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:56:33.926 INFO:tasks.workunit.client.0.smithi070.stderr: -399> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 10 monclient(hunting): picked mon.noname-b con 0x56312e361ee0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:56:33.926 INFO:tasks.workunit.client.0.smithi070.stderr: -398> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:33.926 INFO:tasks.workunit.client.0.smithi070.stderr: -397> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:33.926 INFO:tasks.workunit.client.0.smithi070.stderr: -396> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:33.926 INFO:tasks.workunit.client.0.smithi070.stderr: -395> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 10 monclient(hunting): _renew_subs 2024-09-12T00:56:33.926 INFO:tasks.workunit.client.0.smithi070.stderr: -394> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 10 monclient(hunting): authenticate will time out at 2244.255744s 2024-09-12T00:56:33.926 INFO:tasks.workunit.client.0.smithi070.stderr: -393> 2024-09-12T00:56:33.804+0000 7f58f669c640 10 monclient(hunting): get_auth_request con 0x56312e363bd0 auth_method 0 2024-09-12T00:56:33.926 INFO:tasks.workunit.client.0.smithi070.stderr: -392> 2024-09-12T00:56:33.804+0000 7f58f669c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:33.926 INFO:tasks.workunit.client.0.smithi070.stderr: -391> 2024-09-12T00:56:33.804+0000 7f58f669c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:33.926 INFO:tasks.workunit.client.0.smithi070.stderr: -390> 2024-09-12T00:56:33.804+0000 7f58f669c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:33.926 INFO:tasks.workunit.client.0.smithi070.stderr: -389> 2024-09-12T00:56:33.804+0000 7f58f5e9b640 10 monclient(hunting): get_auth_request con 0x56312e363500 auth_method 0 2024-09-12T00:56:33.927 INFO:tasks.workunit.client.0.smithi070.stderr: -388> 2024-09-12T00:56:33.804+0000 7f58f5e9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:33.927 INFO:tasks.workunit.client.0.smithi070.stderr: -387> 2024-09-12T00:56:33.804+0000 7f58f5e9b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:33.927 INFO:tasks.workunit.client.0.smithi070.stderr: -386> 2024-09-12T00:56:33.804+0000 7f58f5e9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:33.927 INFO:tasks.workunit.client.0.smithi070.stderr: -385> 2024-09-12T00:56:33.808+0000 7f58f669c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:33.927 INFO:tasks.workunit.client.0.smithi070.stderr: -384> 2024-09-12T00:56:33.808+0000 7f58f669c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:33.927 INFO:tasks.workunit.client.0.smithi070.stderr: -383> 2024-09-12T00:56:33.808+0000 7f58f669c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:33.927 INFO:tasks.workunit.client.0.smithi070.stderr: -382> 2024-09-12T00:56:33.808+0000 7f58f5e9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:33.927 INFO:tasks.workunit.client.0.smithi070.stderr: -381> 2024-09-12T00:56:33.808+0000 7f58f5e9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:33.927 INFO:tasks.workunit.client.0.smithi070.stderr: -380> 2024-09-12T00:56:33.808+0000 7f58f5e9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:33.927 INFO:tasks.workunit.client.0.smithi070.stderr: -379> 2024-09-12T00:56:33.808+0000 7f58f6e9d640 10 monclient(hunting): get_auth_request con 0x56312e361ee0 auth_method 0 2024-09-12T00:56:33.927 INFO:tasks.workunit.client.0.smithi070.stderr: -378> 2024-09-12T00:56:33.808+0000 7f58f6e9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:33.927 INFO:tasks.workunit.client.0.smithi070.stderr: -377> 2024-09-12T00:56:33.808+0000 7f58f6e9d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:33.927 INFO:tasks.workunit.client.0.smithi070.stderr: -376> 2024-09-12T00:56:33.808+0000 7f58f6e9d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:33.928 INFO:tasks.workunit.client.0.smithi070.stderr: -375> 2024-09-12T00:56:33.808+0000 7f58f669c640 10 monclient(hunting): handle_auth_done global_id 7392 payload 824 2024-09-12T00:56:33.928 INFO:tasks.workunit.client.0.smithi070.stderr: -374> 2024-09-12T00:56:33.808+0000 7f58f669c640 10 monclient: _finish_hunting 0 2024-09-12T00:56:33.928 INFO:tasks.workunit.client.0.smithi070.stderr: -373> 2024-09-12T00:56:33.808+0000 7f58f669c640 1 monclient: found mon.noname-a 2024-09-12T00:56:33.928 INFO:tasks.workunit.client.0.smithi070.stderr: -372> 2024-09-12T00:56:33.808+0000 7f58f669c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:56:33.928 INFO:tasks.workunit.client.0.smithi070.stderr: -371> 2024-09-12T00:56:33.808+0000 7f57dbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:33.928 INFO:tasks.workunit.client.0.smithi070.stderr: -370> 2024-09-12T00:56:33.808+0000 7f57dbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:56:33.928 INFO:tasks.workunit.client.0.smithi070.stderr: -369> 2024-09-12T00:56:33.808+0000 7f57dbfff640 10 monclient: dump: 2024-09-12T00:56:33.928 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:56:33.928 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:56:33.928 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.928 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.928 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:33.929 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:56:33.929 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:56:33.929 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:56:33.929 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:56:33.929 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.929 INFO:tasks.workunit.client.0.smithi070.stderr: -368> 2024-09-12T00:56:33.808+0000 7f57dbfff640 10 monclient: _finish_auth 0 2024-09-12T00:56:33.929 INFO:tasks.workunit.client.0.smithi070.stderr: -367> 2024-09-12T00:56:33.808+0000 7f57dbfff640 10 monclient: _check_auth_tickets 2024-09-12T00:56:33.929 INFO:tasks.workunit.client.0.smithi070.stderr: -366> 2024-09-12T00:56:33.808+0000 7f57dbfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:56:33.929 INFO:tasks.workunit.client.0.smithi070.stderr: -365> 2024-09-12T00:56:33.808+0000 7f57dbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:33.929 INFO:tasks.workunit.client.0.smithi070.stderr: -364> 2024-09-12T00:56:33.808+0000 7f57dbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:56:33.929 INFO:tasks.workunit.client.0.smithi070.stderr: -363> 2024-09-12T00:56:33.808+0000 7f57dbfff640 10 monclient: dump: 2024-09-12T00:56:33.929 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:56:33.929 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:56:33.929 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.930 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.930 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:33.930 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:56:33.930 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:56:33.930 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:56:33.930 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:56:33.930 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.930 INFO:tasks.workunit.client.0.smithi070.stderr: -362> 2024-09-12T00:56:33.808+0000 7f58f769e640 4 set_mon_vals no callback set 2024-09-12T00:56:33.930 INFO:tasks.workunit.client.0.smithi070.stderr: -361> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 monclient: authenticate success, global_id 7392 2024-09-12T00:56:33.930 INFO:tasks.workunit.client.0.smithi070.stderr: -360> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 10 monclient: _renew_subs 2024-09-12T00:56:33.930 INFO:tasks.workunit.client.0.smithi070.stderr: -359> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:56:33.930 INFO:tasks.workunit.client.0.smithi070.stderr: -358> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 10 monclient: _renew_subs 2024-09-12T00:56:33.931 INFO:tasks.workunit.client.0.smithi070.stderr: -357> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:56:33.931 INFO:tasks.workunit.client.0.smithi070.stderr: -356> 2024-09-12T00:56:33.808+0000 7f57dbfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:56:33.931 INFO:tasks.workunit.client.0.smithi070.stderr: -355> 2024-09-12T00:56:33.808+0000 7f57dbfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:56:33.931 INFO:tasks.workunit.client.0.smithi070.stderr: -354> 2024-09-12T00:56:33.808+0000 7f57dbfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:56:33.931 INFO:tasks.workunit.client.0.smithi070.stderr: -353> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 10 monclient: get_monmap_and_config 2024-09-12T00:56:33.931 INFO:tasks.workunit.client.0.smithi070.stderr: -352> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 10 monclient: build_initial_monmap 2024-09-12T00:56:33.931 INFO:tasks.workunit.client.0.smithi070.stderr: -351> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 1 build_initial for_mkfs: 0 2024-09-12T00:56:33.931 INFO:tasks.workunit.client.0.smithi070.stderr: -350> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 10 monclient: monmap: 2024-09-12T00:56:33.931 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:56:33.931 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:56:33.931 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:56:33.931 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:56:33.932 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:56:33.932 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:56:33.932 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:56:33.932 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:56:33.932 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:56:33.932 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.932 INFO:tasks.workunit.client.0.smithi070.stderr: -349> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding auth protocol: cephx 2024-09-12T00:56:33.932 INFO:tasks.workunit.client.0.smithi070.stderr: -348> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding auth protocol: cephx 2024-09-12T00:56:33.932 INFO:tasks.workunit.client.0.smithi070.stderr: -347> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding auth protocol: cephx 2024-09-12T00:56:33.932 INFO:tasks.workunit.client.0.smithi070.stderr: -346> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding con mode: secure 2024-09-12T00:56:33.932 INFO:tasks.workunit.client.0.smithi070.stderr: -345> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding con mode: crc 2024-09-12T00:56:33.932 INFO:tasks.workunit.client.0.smithi070.stderr: -344> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding con mode: secure 2024-09-12T00:56:33.932 INFO:tasks.workunit.client.0.smithi070.stderr: -343> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding con mode: crc 2024-09-12T00:56:33.933 INFO:tasks.workunit.client.0.smithi070.stderr: -342> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding con mode: secure 2024-09-12T00:56:33.933 INFO:tasks.workunit.client.0.smithi070.stderr: -341> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding con mode: crc 2024-09-12T00:56:33.933 INFO:tasks.workunit.client.0.smithi070.stderr: -340> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding con mode: crc 2024-09-12T00:56:33.933 INFO:tasks.workunit.client.0.smithi070.stderr: -339> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding con mode: secure 2024-09-12T00:56:33.933 INFO:tasks.workunit.client.0.smithi070.stderr: -338> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding con mode: crc 2024-09-12T00:56:33.933 INFO:tasks.workunit.client.0.smithi070.stderr: -337> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding con mode: secure 2024-09-12T00:56:33.933 INFO:tasks.workunit.client.0.smithi070.stderr: -336> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding con mode: crc 2024-09-12T00:56:33.933 INFO:tasks.workunit.client.0.smithi070.stderr: -335> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding con mode: secure 2024-09-12T00:56:33.933 INFO:tasks.workunit.client.0.smithi070.stderr: -334> 2024-09-12T00:56:33.808+0000 7f58f5e9b640 10 monclient: get_auth_request con 0x7f57d0070a20 auth_method 0 2024-09-12T00:56:33.933 INFO:tasks.workunit.client.0.smithi070.stderr: -333> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:33.933 INFO:tasks.workunit.client.0.smithi070.stderr: -332> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient: init 2024-09-12T00:56:33.933 INFO:tasks.workunit.client.0.smithi070.stderr: -331> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding auth protocol: cephx 2024-09-12T00:56:33.934 INFO:tasks.workunit.client.0.smithi070.stderr: -330> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding auth protocol: cephx 2024-09-12T00:56:33.934 INFO:tasks.workunit.client.0.smithi070.stderr: -329> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding auth protocol: cephx 2024-09-12T00:56:33.934 INFO:tasks.workunit.client.0.smithi070.stderr: -328> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding con mode: secure 2024-09-12T00:56:33.934 INFO:tasks.workunit.client.0.smithi070.stderr: -327> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding con mode: crc 2024-09-12T00:56:33.934 INFO:tasks.workunit.client.0.smithi070.stderr: -326> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding con mode: secure 2024-09-12T00:56:33.934 INFO:tasks.workunit.client.0.smithi070.stderr: -325> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding con mode: crc 2024-09-12T00:56:33.934 INFO:tasks.workunit.client.0.smithi070.stderr: -324> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding con mode: secure 2024-09-12T00:56:33.934 INFO:tasks.workunit.client.0.smithi070.stderr: -323> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding con mode: crc 2024-09-12T00:56:33.934 INFO:tasks.workunit.client.0.smithi070.stderr: -322> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding con mode: crc 2024-09-12T00:56:33.934 INFO:tasks.workunit.client.0.smithi070.stderr: -321> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding con mode: secure 2024-09-12T00:56:33.934 INFO:tasks.workunit.client.0.smithi070.stderr: -320> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding con mode: crc 2024-09-12T00:56:33.935 INFO:tasks.workunit.client.0.smithi070.stderr: -319> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding con mode: secure 2024-09-12T00:56:33.935 INFO:tasks.workunit.client.0.smithi070.stderr: -318> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding con mode: crc 2024-09-12T00:56:33.935 INFO:tasks.workunit.client.0.smithi070.stderr: -317> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding con mode: secure 2024-09-12T00:56:33.935 INFO:tasks.workunit.client.0.smithi070.stderr: -316> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:33.935 INFO:tasks.workunit.client.0.smithi070.stderr: -315> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:33.935 INFO:tasks.workunit.client.0.smithi070.stderr: -314> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffddf9d3758 EEXIST 2024-09-12T00:56:33.935 INFO:tasks.workunit.client.0.smithi070.stderr: -313> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient: _reopen_session rank -1 2024-09-12T00:56:33.935 INFO:tasks.workunit.client.0.smithi070.stderr: -312> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:56:33.935 INFO:tasks.workunit.client.0.smithi070.stderr: -311> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): picked mon.noname-a con 0x56312e3b1b90 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:56:33.935 INFO:tasks.workunit.client.0.smithi070.stderr: -310> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): picked mon.noname-b con 0x56312e3b1f70 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:56:33.935 INFO:tasks.workunit.client.0.smithi070.stderr: -309> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): picked mon.noname-c con 0x56312e3b33f0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:56:33.935 INFO:tasks.workunit.client.0.smithi070.stderr: -308> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:33.936 INFO:tasks.workunit.client.0.smithi070.stderr: -307> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:33.936 INFO:tasks.workunit.client.0.smithi070.stderr: -306> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:33.936 INFO:tasks.workunit.client.0.smithi070.stderr: -305> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): _renew_subs 2024-09-12T00:56:33.936 INFO:tasks.workunit.client.0.smithi070.stderr: -304> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): authenticate will time out at 2244.260784s 2024-09-12T00:56:33.936 INFO:tasks.workunit.client.0.smithi070.stderr: -303> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): get_auth_request con 0x56312e3b1b90 auth_method 0 2024-09-12T00:56:33.936 INFO:tasks.workunit.client.0.smithi070.stderr: -302> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:33.936 INFO:tasks.workunit.client.0.smithi070.stderr: -301> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:33.936 INFO:tasks.workunit.client.0.smithi070.stderr: -300> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:33.936 INFO:tasks.workunit.client.0.smithi070.stderr: -299> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): get_auth_request con 0x56312e3b33f0 auth_method 0 2024-09-12T00:56:33.936 INFO:tasks.workunit.client.0.smithi070.stderr: -298> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:33.936 INFO:tasks.workunit.client.0.smithi070.stderr: -297> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:33.936 INFO:tasks.workunit.client.0.smithi070.stderr: -296> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:33.937 INFO:tasks.workunit.client.0.smithi070.stderr: -295> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:33.937 INFO:tasks.workunit.client.0.smithi070.stderr: -294> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:33.937 INFO:tasks.workunit.client.0.smithi070.stderr: -293> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:33.937 INFO:tasks.workunit.client.0.smithi070.stderr: -292> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:33.937 INFO:tasks.workunit.client.0.smithi070.stderr: -291> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:33.937 INFO:tasks.workunit.client.0.smithi070.stderr: -290> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:33.937 INFO:tasks.workunit.client.0.smithi070.stderr: -289> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): handle_auth_done global_id 7395 payload 274 2024-09-12T00:56:33.937 INFO:tasks.workunit.client.0.smithi070.stderr: -288> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient: _finish_hunting 0 2024-09-12T00:56:33.937 INFO:tasks.workunit.client.0.smithi070.stderr: -287> 2024-09-12T00:56:33.812+0000 7f58f669c640 1 monclient: found mon.noname-a 2024-09-12T00:56:33.937 INFO:tasks.workunit.client.0.smithi070.stderr: -286> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:56:33.937 INFO:tasks.workunit.client.0.smithi070.stderr: -285> 2024-09-12T00:56:33.812+0000 7f57d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:33.937 INFO:tasks.workunit.client.0.smithi070.stderr: -284> 2024-09-12T00:56:33.812+0000 7f57d9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:56:33.937 INFO:tasks.workunit.client.0.smithi070.stderr: -283> 2024-09-12T00:56:33.812+0000 7f57d9ffb640 10 monclient: dump: 2024-09-12T00:56:33.938 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:56:33.938 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:56:33.938 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.938 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.938 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:33.938 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:56:33.938 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:56:33.938 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:56:33.938 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:56:33.938 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.938 INFO:tasks.workunit.client.0.smithi070.stderr: -282> 2024-09-12T00:56:33.812+0000 7f57d9ffb640 10 monclient: _finish_auth 0 2024-09-12T00:56:33.938 INFO:tasks.workunit.client.0.smithi070.stderr: -281> 2024-09-12T00:56:33.812+0000 7f57d9ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:56:33.938 INFO:tasks.workunit.client.0.smithi070.stderr: -280> 2024-09-12T00:56:33.812+0000 7f57d9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:56:33.939 INFO:tasks.workunit.client.0.smithi070.stderr: -279> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 monclient: authenticate success, global_id 7395 2024-09-12T00:56:33.939 INFO:tasks.workunit.client.0.smithi070.stderr: -278> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient: get_monmap_and_config success 2024-09-12T00:56:33.939 INFO:tasks.workunit.client.0.smithi070.stderr: -277> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 4 set_mon_vals no callback set 2024-09-12T00:56:33.939 INFO:tasks.workunit.client.0.smithi070.stderr: -276> 2024-09-12T00:56:33.812+0000 7f57d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:33.939 INFO:tasks.workunit.client.0.smithi070.stderr: -275> 2024-09-12T00:56:33.812+0000 7f57d9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:56:33.939 INFO:tasks.workunit.client.0.smithi070.stderr: -274> 2024-09-12T00:56:33.812+0000 7f57d9ffb640 10 monclient: dump: 2024-09-12T00:56:33.939 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:56:33.939 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:56:33.939 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.939 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.939 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:33.939 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:56:33.939 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:56:33.940 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:56:33.940 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:56:33.940 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.940 INFO:tasks.workunit.client.0.smithi070.stderr: -273> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient: shutdown 2024-09-12T00:56:33.940 INFO:tasks.workunit.client.0.smithi070.stderr: -272> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient: build_initial_monmap 2024-09-12T00:56:33.940 INFO:tasks.workunit.client.0.smithi070.stderr: -271> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 1 build_initial for_mkfs: 0 2024-09-12T00:56:33.940 INFO:tasks.workunit.client.0.smithi070.stderr: -270> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient: monmap: 2024-09-12T00:56:33.940 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:56:33.940 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:56:33.940 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:56:33.940 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:56:33.940 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:56:33.941 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:56:33.941 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:56:33.941 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:56:33.941 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:56:33.941 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.941 INFO:tasks.workunit.client.0.smithi070.stderr: -269> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding auth protocol: cephx 2024-09-12T00:56:33.941 INFO:tasks.workunit.client.0.smithi070.stderr: -268> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding auth protocol: cephx 2024-09-12T00:56:33.941 INFO:tasks.workunit.client.0.smithi070.stderr: -267> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding auth protocol: cephx 2024-09-12T00:56:33.941 INFO:tasks.workunit.client.0.smithi070.stderr: -266> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding con mode: secure 2024-09-12T00:56:33.941 INFO:tasks.workunit.client.0.smithi070.stderr: -265> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding con mode: crc 2024-09-12T00:56:33.941 INFO:tasks.workunit.client.0.smithi070.stderr: -264> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding con mode: secure 2024-09-12T00:56:33.941 INFO:tasks.workunit.client.0.smithi070.stderr: -263> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding con mode: crc 2024-09-12T00:56:33.942 INFO:tasks.workunit.client.0.smithi070.stderr: -262> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding con mode: secure 2024-09-12T00:56:33.942 INFO:tasks.workunit.client.0.smithi070.stderr: -261> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding con mode: crc 2024-09-12T00:56:33.942 INFO:tasks.workunit.client.0.smithi070.stderr: -260> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding con mode: crc 2024-09-12T00:56:33.942 INFO:tasks.workunit.client.0.smithi070.stderr: -259> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding con mode: secure 2024-09-12T00:56:33.942 INFO:tasks.workunit.client.0.smithi070.stderr: -258> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding con mode: crc 2024-09-12T00:56:33.942 INFO:tasks.workunit.client.0.smithi070.stderr: -257> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding con mode: secure 2024-09-12T00:56:33.942 INFO:tasks.workunit.client.0.smithi070.stderr: -256> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding con mode: crc 2024-09-12T00:56:33.942 INFO:tasks.workunit.client.0.smithi070.stderr: -255> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding con mode: secure 2024-09-12T00:56:33.942 INFO:tasks.workunit.client.0.smithi070.stderr: -254> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:33.942 INFO:tasks.workunit.client.0.smithi070.stderr: -253> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 1 librados: starting msgr at 2024-09-12T00:56:33.942 INFO:tasks.workunit.client.0.smithi070.stderr: -252> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 1 librados: starting objecter 2024-09-12T00:56:33.942 INFO:tasks.workunit.client.0.smithi070.stderr: -251> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command objecter_requests cmddesc objecter_requests hook 0x56312e339cb0 EEXIST 2024-09-12T00:56:33.942 INFO:tasks.workunit.client.0.smithi070.stderr: -250> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 1 librados: setting wanted keys 2024-09-12T00:56:33.943 INFO:tasks.workunit.client.0.smithi070.stderr: -249> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 1 librados: calling monclient init 2024-09-12T00:56:33.943 INFO:tasks.workunit.client.0.smithi070.stderr: -248> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient: init 2024-09-12T00:56:33.943 INFO:tasks.workunit.client.0.smithi070.stderr: -247> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding auth protocol: cephx 2024-09-12T00:56:33.943 INFO:tasks.workunit.client.0.smithi070.stderr: -246> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding auth protocol: cephx 2024-09-12T00:56:33.943 INFO:tasks.workunit.client.0.smithi070.stderr: -245> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding auth protocol: cephx 2024-09-12T00:56:33.943 INFO:tasks.workunit.client.0.smithi070.stderr: -244> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding con mode: secure 2024-09-12T00:56:33.943 INFO:tasks.workunit.client.0.smithi070.stderr: -243> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding con mode: crc 2024-09-12T00:56:33.943 INFO:tasks.workunit.client.0.smithi070.stderr: -242> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding con mode: secure 2024-09-12T00:56:33.943 INFO:tasks.workunit.client.0.smithi070.stderr: -241> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding con mode: crc 2024-09-12T00:56:33.943 INFO:tasks.workunit.client.0.smithi070.stderr: -240> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding con mode: secure 2024-09-12T00:56:33.943 INFO:tasks.workunit.client.0.smithi070.stderr: -239> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding con mode: crc 2024-09-12T00:56:33.943 INFO:tasks.workunit.client.0.smithi070.stderr: -238> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding con mode: crc 2024-09-12T00:56:33.944 INFO:tasks.workunit.client.0.smithi070.stderr: -237> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding con mode: secure 2024-09-12T00:56:33.944 INFO:tasks.workunit.client.0.smithi070.stderr: -236> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding con mode: crc 2024-09-12T00:56:33.944 INFO:tasks.workunit.client.0.smithi070.stderr: -235> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding con mode: secure 2024-09-12T00:56:33.944 INFO:tasks.workunit.client.0.smithi070.stderr: -234> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding con mode: crc 2024-09-12T00:56:33.944 INFO:tasks.workunit.client.0.smithi070.stderr: -233> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding con mode: secure 2024-09-12T00:56:33.944 INFO:tasks.workunit.client.0.smithi070.stderr: -232> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:33.944 INFO:tasks.workunit.client.0.smithi070.stderr: -231> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:33.944 INFO:tasks.workunit.client.0.smithi070.stderr: -230> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command rotate-key cmddesc rotate-key hook 0x56312e365b38 EEXIST 2024-09-12T00:56:33.944 INFO:tasks.workunit.client.0.smithi070.stderr: -229> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient: _reopen_session rank -1 2024-09-12T00:56:33.944 INFO:tasks.workunit.client.0.smithi070.stderr: -228> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:56:33.944 INFO:tasks.workunit.client.0.smithi070.stderr: -227> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): picked mon.noname-c con 0x56312e3b1b90 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:56:33.944 INFO:tasks.workunit.client.0.smithi070.stderr: -226> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): picked mon.noname-b con 0x56312e3b33f0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:56:33.944 INFO:tasks.workunit.client.0.smithi070.stderr: -225> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): picked mon.noname-a con 0x56312e3abcd0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:56:33.944 INFO:tasks.workunit.client.0.smithi070.stderr: -224> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:33.945 INFO:tasks.workunit.client.0.smithi070.stderr: -223> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:33.945 INFO:tasks.workunit.client.0.smithi070.stderr: -222> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:33.945 INFO:tasks.workunit.client.0.smithi070.stderr: -221> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): _renew_subs 2024-09-12T00:56:33.945 INFO:tasks.workunit.client.0.smithi070.stderr: -220> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): authenticate will time out at 2244.263299s 2024-09-12T00:56:33.945 INFO:tasks.workunit.client.0.smithi070.stderr: -219> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): get_auth_request con 0x56312e3b1b90 auth_method 0 2024-09-12T00:56:33.945 INFO:tasks.workunit.client.0.smithi070.stderr: -218> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:33.945 INFO:tasks.workunit.client.0.smithi070.stderr: -217> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:33.945 INFO:tasks.workunit.client.0.smithi070.stderr: -216> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:33.945 INFO:tasks.workunit.client.0.smithi070.stderr: -215> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): get_auth_request con 0x56312e3abcd0 auth_method 0 2024-09-12T00:56:33.945 INFO:tasks.workunit.client.0.smithi070.stderr: -214> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:33.945 INFO:tasks.workunit.client.0.smithi070.stderr: -213> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:33.945 INFO:tasks.workunit.client.0.smithi070.stderr: -212> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:33.945 INFO:tasks.workunit.client.0.smithi070.stderr: -211> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:33.946 INFO:tasks.workunit.client.0.smithi070.stderr: -210> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:33.946 INFO:tasks.workunit.client.0.smithi070.stderr: -209> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:33.946 INFO:tasks.workunit.client.0.smithi070.stderr: -208> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:33.946 INFO:tasks.workunit.client.0.smithi070.stderr: -207> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:33.946 INFO:tasks.workunit.client.0.smithi070.stderr: -206> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:33.946 INFO:tasks.workunit.client.0.smithi070.stderr: -205> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_done global_id 7398 payload 824 2024-09-12T00:56:33.946 INFO:tasks.workunit.client.0.smithi070.stderr: -204> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient: _finish_hunting 0 2024-09-12T00:56:33.946 INFO:tasks.workunit.client.0.smithi070.stderr: -203> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 1 monclient: found mon.noname-a 2024-09-12T00:56:33.946 INFO:tasks.workunit.client.0.smithi070.stderr: -202> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:56:33.946 INFO:tasks.workunit.client.0.smithi070.stderr: -201> 2024-09-12T00:56:33.812+0000 7f57c7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:33.946 INFO:tasks.workunit.client.0.smithi070.stderr: -200> 2024-09-12T00:56:33.812+0000 7f57c7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:56:33.946 INFO:tasks.workunit.client.0.smithi070.stderr: -199> 2024-09-12T00:56:33.812+0000 7f57c7fff640 10 monclient: dump: 2024-09-12T00:56:33.946 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:56:33.947 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:56:33.947 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.947 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.947 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:33.947 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:56:33.947 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:56:33.947 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:56:33.947 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:56:33.947 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.947 INFO:tasks.workunit.client.0.smithi070.stderr: -198> 2024-09-12T00:56:33.816+0000 7f57c7fff640 10 monclient: _finish_auth 0 2024-09-12T00:56:33.947 INFO:tasks.workunit.client.0.smithi070.stderr: -197> 2024-09-12T00:56:33.816+0000 7f57c7fff640 10 monclient: _check_auth_tickets 2024-09-12T00:56:33.947 INFO:tasks.workunit.client.0.smithi070.stderr: -196> 2024-09-12T00:56:33.816+0000 7f57c7fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:56:33.947 INFO:tasks.workunit.client.0.smithi070.stderr: -195> 2024-09-12T00:56:33.816+0000 7f57c7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:33.947 INFO:tasks.workunit.client.0.smithi070.stderr: -194> 2024-09-12T00:56:33.816+0000 7f57c7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:56:33.948 INFO:tasks.workunit.client.0.smithi070.stderr: -193> 2024-09-12T00:56:33.816+0000 7f57c7fff640 10 monclient: dump: 2024-09-12T00:56:33.948 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:56:33.948 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:56:33.948 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.948 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.948 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:33.948 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:56:33.948 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:56:33.948 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:56:33.948 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:56:33.948 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.948 INFO:tasks.workunit.client.0.smithi070.stderr: -192> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 5 monclient: authenticate success, global_id 7398 2024-09-12T00:56:33.948 INFO:tasks.workunit.client.0.smithi070.stderr: -191> 2024-09-12T00:56:33.816+0000 7f57d9ffb640 4 set_mon_vals no callback set 2024-09-12T00:56:33.948 INFO:tasks.workunit.client.0.smithi070.stderr: -190> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 10 monclient: _renew_subs 2024-09-12T00:56:33.949 INFO:tasks.workunit.client.0.smithi070.stderr: -189> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:56:33.949 INFO:tasks.workunit.client.0.smithi070.stderr: -188> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 10 monclient: _renew_subs 2024-09-12T00:56:33.949 INFO:tasks.workunit.client.0.smithi070.stderr: -187> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:56:33.949 INFO:tasks.workunit.client.0.smithi070.stderr: -186> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 1 librados: init done 2024-09-12T00:56:33.949 INFO:tasks.workunit.client.0.smithi070.stderr: -185> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command cr dump hook 0x56312e3ab918 2024-09-12T00:56:33.949 INFO:tasks.workunit.client.0.smithi070.stderr: -184> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.949 INFO:tasks.workunit.client.0.smithi070.stderr: -183> 2024-09-12T00:56:33.816+0000 7f57c7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:56:33.949 INFO:tasks.workunit.client.0.smithi070.stderr: -182> 2024-09-12T00:56:33.816+0000 7f57c7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:56:33.949 INFO:tasks.workunit.client.0.smithi070.stderr: -181> 2024-09-12T00:56:33.816+0000 7f57c7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:56:33.949 INFO:tasks.workunit.client.0.smithi070.stderr: -180> 2024-09-12T00:56:33.816+0000 7f58f5e9b640 10 monclient: get_auth_request con 0x56312e3d1d90 auth_method 0 2024-09-12T00:56:33.949 INFO:tasks.workunit.client.0.smithi070.stderr: -179> 2024-09-12T00:56:33.816+0000 7f58f669c640 10 monclient: get_auth_request con 0x7f57c0070ae0 auth_method 0 2024-09-12T00:56:33.949 INFO:tasks.workunit.client.0.smithi070.stderr: -178> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:33.950 INFO:tasks.workunit.client.0.smithi070.stderr: -177> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 20 realm 2024-09-12T00:56:33.950 INFO:tasks.workunit.client.0.smithi070.stderr: -176> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.950 INFO:tasks.workunit.client.0.smithi070.stderr: -175> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:33.950 INFO:tasks.workunit.client.0.smithi070.stderr: -174> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:33.950 INFO:tasks.workunit.client.0.smithi070.stderr: -173> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.950 INFO:tasks.workunit.client.0.smithi070.stderr: -172> 2024-09-12T00:56:33.820+0000 7f58f8b969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:33.950 INFO:tasks.workunit.client.0.smithi070.stderr: -171> 2024-09-12T00:56:33.820+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.950 INFO:tasks.workunit.client.0.smithi070.stderr: -170> 2024-09-12T00:56:33.820+0000 7f58f669c640 10 monclient: get_auth_request con 0x56312e3d6050 auth_method 0 2024-09-12T00:56:33.950 INFO:tasks.workunit.client.0.smithi070.stderr: -169> 2024-09-12T00:56:33.820+0000 7f58f8b969c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:33.950 INFO:tasks.workunit.client.0.smithi070.stderr: -168> 2024-09-12T00:56:33.820+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.950 INFO:tasks.workunit.client.0.smithi070.stderr: -167> 2024-09-12T00:56:33.820+0000 7f58f5e9b640 10 monclient: get_auth_request con 0x56312e3d9750 auth_method 0 2024-09-12T00:56:33.950 INFO:tasks.workunit.client.0.smithi070.stderr: -166> 2024-09-12T00:56:33.820+0000 7f58f8b969c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:33.950 INFO:tasks.workunit.client.0.smithi070.stderr: -165> 2024-09-12T00:56:33.820+0000 7f58f8b969c0 20 searching for the correct realm 2024-09-12T00:56:33.950 INFO:tasks.workunit.client.0.smithi070.stderr: -164> 2024-09-12T00:56:33.820+0000 7f58f6e9d640 10 monclient: get_auth_request con 0x56312e3de450 auth_method 0 2024-09-12T00:56:33.951 INFO:tasks.workunit.client.0.smithi070.stderr: -163> 2024-09-12T00:56:33.820+0000 7f58f669c640 10 monclient: get_auth_request con 0x7f58f0057be0 auth_method 0 2024-09-12T00:56:33.951 INFO:tasks.workunit.client.0.smithi070.stderr: -162> 2024-09-12T00:56:33.824+0000 7f58f5e9b640 10 monclient: get_auth_request con 0x7f58e8061eb0 auth_method 0 2024-09-12T00:56:33.951 INFO:tasks.workunit.client.0.smithi070.stderr: -161> 2024-09-12T00:56:33.824+0000 7f58f6e9d640 10 monclient: get_auth_request con 0x7f58ec0e3040 auth_method 0 2024-09-12T00:56:33.951 INFO:tasks.workunit.client.0.smithi070.stderr: -160> 2024-09-12T00:56:33.824+0000 7f58f6e9d640 0 -- 172.21.15.70:0/2816844602 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f58ec0e3040 msgr2=0x7f58ec0e3420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:33.951 INFO:tasks.workunit.client.0.smithi070.stderr: -159> 2024-09-12T00:56:33.824+0000 7f57c7fff640 1 client.7398.objecter ms_handle_reset 0x7f58ec0e3040 session 0x7f58ec0da070 osd.4 2024-09-12T00:56:33.951 INFO:tasks.workunit.client.0.smithi070.stderr: -158> 2024-09-12T00:56:33.824+0000 7f57c7fff640 10 monclient: _renew_subs 2024-09-12T00:56:33.951 INFO:tasks.workunit.client.0.smithi070.stderr: -157> 2024-09-12T00:56:33.824+0000 7f57c7fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:56:33.951 INFO:tasks.workunit.client.0.smithi070.stderr: -156> 2024-09-12T00:56:33.824+0000 7f57c7fff640 10 monclient: ms_handle_reset current mon [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:56:33.951 INFO:tasks.workunit.client.0.smithi070.stderr: -155> 2024-09-12T00:56:33.824+0000 7f57c7fff640 10 monclient: _reopen_session rank -1 2024-09-12T00:56:33.951 INFO:tasks.workunit.client.0.smithi070.stderr: -154> 2024-09-12T00:56:33.824+0000 7f57c7fff640 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:56:33.951 INFO:tasks.workunit.client.0.smithi070.stderr: -153> 2024-09-12T00:56:33.824+0000 7f57c7fff640 10 monclient(hunting): picked mon.a con 0x7f58ec0e3040 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:56:33.951 INFO:tasks.workunit.client.0.smithi070.stderr: -152> 2024-09-12T00:56:33.824+0000 7f57c7fff640 10 monclient(hunting): picked mon.b con 0x56312e3b33f0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:56:33.951 INFO:tasks.workunit.client.0.smithi070.stderr: -151> 2024-09-12T00:56:33.824+0000 7f57c7fff640 10 monclient(hunting): picked mon.c con 0x56312e3b1b90 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:56:33.951 INFO:tasks.workunit.client.0.smithi070.stderr: -150> 2024-09-12T00:56:33.824+0000 7f57c7fff640 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:33.952 INFO:tasks.workunit.client.0.smithi070.stderr: -149> 2024-09-12T00:56:33.824+0000 7f57c7fff640 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:33.952 INFO:tasks.workunit.client.0.smithi070.stderr: -148> 2024-09-12T00:56:33.824+0000 7f57c7fff640 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:33.952 INFO:tasks.workunit.client.0.smithi070.stderr: -147> 2024-09-12T00:56:33.824+0000 7f57c7fff640 10 monclient(hunting): _renew_subs 2024-09-12T00:56:33.952 INFO:tasks.workunit.client.0.smithi070.stderr: -146> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 10 monclient(hunting): get_auth_request con 0x7f58ec0e3040 auth_method 0 2024-09-12T00:56:33.952 INFO:tasks.workunit.client.0.smithi070.stderr: -145> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:33.952 INFO:tasks.workunit.client.0.smithi070.stderr: -144> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:33.952 INFO:tasks.workunit.client.0.smithi070.stderr: -143> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T00:56:33.952 INFO:tasks.workunit.client.0.smithi070.stderr: -142> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 10 monclient(hunting): get_auth_request con 0x7f57c00808e0 auth_method 0 2024-09-12T00:56:33.952 INFO:tasks.workunit.client.0.smithi070.stderr: -141> 2024-09-12T00:56:33.828+0000 7f58f5e9b640 10 monclient(hunting): get_auth_request con 0x56312e3b1b90 auth_method 0 2024-09-12T00:56:33.952 INFO:tasks.workunit.client.0.smithi070.stderr: -140> 2024-09-12T00:56:33.828+0000 7f58f5e9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:33.952 INFO:tasks.workunit.client.0.smithi070.stderr: -139> 2024-09-12T00:56:33.828+0000 7f58f5e9b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:33.952 INFO:tasks.workunit.client.0.smithi070.stderr: -138> 2024-09-12T00:56:33.828+0000 7f58f5e9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T00:56:33.952 INFO:tasks.workunit.client.0.smithi070.stderr: -137> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:33.953 INFO:tasks.workunit.client.0.smithi070.stderr: -136> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:33.953 INFO:tasks.workunit.client.0.smithi070.stderr: -135> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T00:56:33.953 INFO:tasks.workunit.client.0.smithi070.stderr: -134> 2024-09-12T00:56:33.828+0000 7f58f5e9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:33.953 INFO:tasks.workunit.client.0.smithi070.stderr: -133> 2024-09-12T00:56:33.828+0000 7f58f5e9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:33.953 INFO:tasks.workunit.client.0.smithi070.stderr: -132> 2024-09-12T00:56:33.828+0000 7f58f5e9b640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T00:56:33.953 INFO:tasks.workunit.client.0.smithi070.stderr: -131> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_done global_id 7398 payload 293 2024-09-12T00:56:33.953 INFO:tasks.workunit.client.0.smithi070.stderr: -130> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 10 monclient: _finish_hunting 0 2024-09-12T00:56:33.953 INFO:tasks.workunit.client.0.smithi070.stderr: -129> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 1 monclient: found mon.a 2024-09-12T00:56:33.953 INFO:tasks.workunit.client.0.smithi070.stderr: -128> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:56:33.953 INFO:tasks.workunit.client.0.smithi070.stderr: -127> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 10 monclient: _finish_auth 0 2024-09-12T00:56:33.953 INFO:tasks.workunit.client.0.smithi070.stderr: -126> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 10 monclient: _check_auth_tickets 2024-09-12T00:56:33.953 INFO:tasks.workunit.client.0.smithi070.stderr: -125> 2024-09-12T00:56:33.828+0000 7f58f669c640 10 monclient: get_auth_request con 0x56312e3b33f0 auth_method 0 2024-09-12T00:56:33.953 INFO:tasks.workunit.client.0.smithi070.stderr: -124> 2024-09-12T00:56:33.828+0000 7f57c7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:33.953 INFO:tasks.workunit.client.0.smithi070.stderr: -123> 2024-09-12T00:56:33.828+0000 7f57c7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:56:33.953 INFO:tasks.workunit.client.0.smithi070.stderr: -122> 2024-09-12T00:56:33.828+0000 7f57c7fff640 10 monclient: dump: 2024-09-12T00:56:33.954 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:56:33.954 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:56:33.954 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.954 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.954 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:33.954 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:56:33.954 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:56:33.954 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:56:33.954 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:56:33.954 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.954 INFO:tasks.workunit.client.0.smithi070.stderr: -121> 2024-09-12T00:56:33.828+0000 7f57c7fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:56:33.954 INFO:tasks.workunit.client.0.smithi070.stderr: -120> 2024-09-12T00:56:33.828+0000 7f57d97fa640 4 set_mon_vals no callback set 2024-09-12T00:56:33.954 INFO:tasks.workunit.client.0.smithi070.stderr: -119> 2024-09-12T00:56:33.828+0000 7f57c7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:56:33.954 INFO:tasks.workunit.client.0.smithi070.stderr: -118> 2024-09-12T00:56:33.828+0000 7f57c7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:56:33.955 INFO:tasks.workunit.client.0.smithi070.stderr: -117> 2024-09-12T00:56:33.828+0000 7f58f669c640 10 monclient: get_auth_request con 0x7f58f00a6a10 auth_method 0 2024-09-12T00:56:33.955 INFO:tasks.workunit.client.0.smithi070.stderr: -116> 2024-09-12T00:56:33.828+0000 7f58f669c640 0 -- 172.21.15.70:0/2816844602 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f58f00a6a10 msgr2=0x7f58f00a8e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:56:33.955 INFO:tasks.workunit.client.0.smithi070.stderr: -115> 2024-09-12T00:56:33.828+0000 7f57c7fff640 1 client.7398.objecter ms_handle_reset 0x7f58f00a6a10 session 0x7f58f000fe90 osd.6 2024-09-12T00:56:33.955 INFO:tasks.workunit.client.0.smithi070.stderr: -114> 2024-09-12T00:56:33.828+0000 7f58f669c640 10 monclient: get_auth_request con 0x56312e3abcd0 auth_method 0 2024-09-12T00:56:33.955 INFO:tasks.workunit.client.0.smithi070.stderr: -113> 2024-09-12T00:56:33.840+0000 7f58f8b969c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:33.955 INFO:tasks.workunit.client.0.smithi070.stderr: -112> 2024-09-12T00:56:33.840+0000 7f58f8b969c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:56:33.955 INFO:tasks.workunit.client.0.smithi070.stderr: -111> 2024-09-12T00:56:33.840+0000 7f58f8b969c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:33.955 INFO:tasks.workunit.client.0.smithi070.stderr: -110> 2024-09-12T00:56:33.840+0000 7f58f8b969c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:56:33.955 INFO:tasks.workunit.client.0.smithi070.stderr: -109> 2024-09-12T00:56:33.840+0000 7f58f8b969c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:33.955 INFO:tasks.workunit.client.0.smithi070.stderr: -108> 2024-09-12T00:56:33.840+0000 7f58f8b969c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:33.955 INFO:tasks.workunit.client.0.smithi070.stderr: -107> 2024-09-12T00:56:33.840+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.955 INFO:tasks.workunit.client.0.smithi070.stderr: -106> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:33.955 INFO:tasks.workunit.client.0.smithi070.stderr: -105> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.956 INFO:tasks.workunit.client.0.smithi070.stderr: -104> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:33.956 INFO:tasks.workunit.client.0.smithi070.stderr: -103> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.956 INFO:tasks.workunit.client.0.smithi070.stderr: -102> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:33.956 INFO:tasks.workunit.client.0.smithi070.stderr: -101> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 zone default found 2024-09-12T00:56:33.956 INFO:tasks.workunit.client.0.smithi070.stderr: -100> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 4 Realm: () 2024-09-12T00:56:33.956 INFO:tasks.workunit.client.0.smithi070.stderr: -99> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:56:33.956 INFO:tasks.workunit.client.0.smithi070.stderr: -98> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:56:33.956 INFO:tasks.workunit.client.0.smithi070.stderr: -97> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:33.956 INFO:tasks.workunit.client.0.smithi070.stderr: -96> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 zonegroup default 2024-09-12T00:56:33.956 INFO:tasks.workunit.client.0.smithi070.stderr: -95> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.956 INFO:tasks.workunit.client.0.smithi070.stderr: -94> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:33.956 INFO:tasks.workunit.client.0.smithi070.stderr: -93> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.956 INFO:tasks.workunit.client.0.smithi070.stderr: -92> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:33.956 INFO:tasks.workunit.client.0.smithi070.stderr: -91> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.957 INFO:tasks.workunit.client.0.smithi070.stderr: -90> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:33.957 INFO:tasks.workunit.client.0.smithi070.stderr: -89> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 started sync module instance, tier type = 2024-09-12T00:56:33.957 INFO:tasks.workunit.client.0.smithi070.stderr: -88> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:56:33.957 INFO:tasks.workunit.client.0.smithi070.stderr: -87> 2024-09-12T00:56:33.860+0000 7f58f8b969c0 20 add_watcher() i=0 2024-09-12T00:56:33.957 INFO:tasks.workunit.client.0.smithi070.stderr: -86> 2024-09-12T00:56:33.860+0000 7f58f8b969c0 20 add_watcher() i=1 2024-09-12T00:56:33.957 INFO:tasks.workunit.client.0.smithi070.stderr: -85> 2024-09-12T00:56:33.860+0000 7f58f8b969c0 20 add_watcher() i=2 2024-09-12T00:56:33.957 INFO:tasks.workunit.client.0.smithi070.stderr: -84> 2024-09-12T00:56:33.860+0000 7f58f8b969c0 20 add_watcher() i=3 2024-09-12T00:56:33.957 INFO:tasks.workunit.client.0.smithi070.stderr: -83> 2024-09-12T00:56:33.860+0000 7f58f8b969c0 20 add_watcher() i=4 2024-09-12T00:56:33.957 INFO:tasks.workunit.client.0.smithi070.stderr: -82> 2024-09-12T00:56:33.860+0000 7f58f8b969c0 20 add_watcher() i=5 2024-09-12T00:56:33.957 INFO:tasks.workunit.client.0.smithi070.stderr: -81> 2024-09-12T00:56:33.860+0000 7f58f8b969c0 20 add_watcher() i=6 2024-09-12T00:56:33.957 INFO:tasks.workunit.client.0.smithi070.stderr: -80> 2024-09-12T00:56:33.860+0000 7f58f8b969c0 20 add_watcher() i=7 2024-09-12T00:56:33.957 INFO:tasks.workunit.client.0.smithi070.stderr: -79> 2024-09-12T00:56:33.860+0000 7f58f8b969c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:33.957 INFO:tasks.workunit.client.0.smithi070.stderr: -78> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding auth protocol: cephx 2024-09-12T00:56:33.957 INFO:tasks.workunit.client.0.smithi070.stderr: -77> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding auth protocol: cephx 2024-09-12T00:56:33.957 INFO:tasks.workunit.client.0.smithi070.stderr: -76> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding auth protocol: cephx 2024-09-12T00:56:33.958 INFO:tasks.workunit.client.0.smithi070.stderr: -75> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding con mode: secure 2024-09-12T00:56:33.958 INFO:tasks.workunit.client.0.smithi070.stderr: -74> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding con mode: crc 2024-09-12T00:56:33.958 INFO:tasks.workunit.client.0.smithi070.stderr: -73> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding con mode: secure 2024-09-12T00:56:33.958 INFO:tasks.workunit.client.0.smithi070.stderr: -72> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding con mode: crc 2024-09-12T00:56:33.958 INFO:tasks.workunit.client.0.smithi070.stderr: -71> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding con mode: secure 2024-09-12T00:56:33.958 INFO:tasks.workunit.client.0.smithi070.stderr: -70> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding con mode: crc 2024-09-12T00:56:33.958 INFO:tasks.workunit.client.0.smithi070.stderr: -69> 2024-09-12T00:56:33.864+0000 7f57ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:33.958 INFO:tasks.workunit.client.0.smithi070.stderr: -68> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding con mode: crc 2024-09-12T00:56:33.958 INFO:tasks.workunit.client.0.smithi070.stderr: -67> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding con mode: secure 2024-09-12T00:56:33.958 INFO:tasks.workunit.client.0.smithi070.stderr: -66> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding con mode: crc 2024-09-12T00:56:33.958 INFO:tasks.workunit.client.0.smithi070.stderr: -65> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding con mode: secure 2024-09-12T00:56:33.958 INFO:tasks.workunit.client.0.smithi070.stderr: -64> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding con mode: crc 2024-09-12T00:56:33.958 INFO:tasks.workunit.client.0.smithi070.stderr: -63> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding con mode: secure 2024-09-12T00:56:33.959 INFO:tasks.workunit.client.0.smithi070.stderr: -62> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:33.959 INFO:tasks.workunit.client.0.smithi070.stderr: -61> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:33.959 INFO:tasks.workunit.client.0.smithi070.stderr: -60> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:33.959 INFO:tasks.workunit.client.0.smithi070.stderr: -59> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command cache list hook 0x56312e3b0570 2024-09-12T00:56:33.959 INFO:tasks.workunit.client.0.smithi070.stderr: -58> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command cache inspect hook 0x56312e3b0570 2024-09-12T00:56:33.959 INFO:tasks.workunit.client.0.smithi070.stderr: -57> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command cache erase hook 0x56312e3b0570 2024-09-12T00:56:33.959 INFO:tasks.workunit.client.0.smithi070.stderr: -56> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command cache zap hook 0x56312e3b0570 2024-09-12T00:56:33.959 INFO:tasks.workunit.client.0.smithi070.stderr: -55> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 note: GC not initialized 2024-09-12T00:56:33.959 INFO:tasks.workunit.client.0.smithi070.stderr: -54> 2024-09-12T00:56:33.864+0000 7f57a77fe640 20 reqs_thread_entry: start 2024-09-12T00:56:33.959 INFO:tasks.workunit.client.0.smithi070.stderr: -53> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command sync trace show hook 0x7f58f00045f0 2024-09-12T00:56:33.959 INFO:tasks.workunit.client.0.smithi070.stderr: -52> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command sync trace history hook 0x7f58f00045f0 2024-09-12T00:56:33.959 INFO:tasks.workunit.client.0.smithi070.stderr: -51> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command sync trace active hook 0x7f58f00045f0 2024-09-12T00:56:33.959 INFO:tasks.workunit.client.0.smithi070.stderr: -50> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command sync trace active_short hook 0x7f58f00045f0 2024-09-12T00:56:33.960 INFO:tasks.workunit.client.0.smithi070.stderr: -49> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 20 init_complete bucket index max shards: 1 2024-09-12T00:56:33.960 INFO:tasks.workunit.client.0.smithi070.stderr: -48> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 20 Filter name: none 2024-09-12T00:56:33.960 INFO:tasks.workunit.client.0.smithi070.stderr: -47> 2024-09-12T00:56:33.864+0000 7f57a57fa640 20 reqs_thread_entry: start 2024-09-12T00:56:33.960 INFO:tasks.workunit.client.0.smithi070.stderr: -46> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:56:33.960 INFO:tasks.workunit.client.0.smithi070.stderr: -45> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.960 INFO:tasks.workunit.client.0.smithi070.stderr: -44> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:56:33.960 INFO:tasks.workunit.client.0.smithi070.stderr: -43> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:56:33.960 INFO:tasks.workunit.client.0.smithi070.stderr: -42> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:56:33.960 INFO:tasks.workunit.client.0.smithi070.stderr: -41> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 : miss 2024-09-12T00:56:33.960 INFO:tasks.workunit.client.0.smithi070.stderr: -40> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:33.960 INFO:tasks.workunit.client.0.smithi070.stderr: -39> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:56:33.960 INFO:tasks.workunit.client.0.smithi070.stderr: -38> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 info.flags=0x17 2024-09-12T00:56:33.960 INFO:tasks.workunit.client.0.smithi070.stderr: -37> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 to cache LRU end 2024-09-12T00:56:33.961 INFO:tasks.workunit.client.0.smithi070.stderr: -36> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:33.961 INFO:tasks.workunit.client.0.smithi070.stderr: -35> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:33.961 INFO:tasks.workunit.client.0.smithi070.stderr: -34> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 2024-09-12T00:56:33.961 INFO:tasks.workunit.client.0.smithi070.stderr: -33> 2024-09-12T00:56:33.876+0000 7f58f8b969c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 info.flags=0x17 2024-09-12T00:56:33.961 INFO:tasks.workunit.client.0.smithi070.stderr: -32> 2024-09-12T00:56:33.876+0000 7f58f8b969c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 to cache LRU end 2024-09-12T00:56:33.961 INFO:tasks.workunit.client.0.smithi070.stderr: -31> 2024-09-12T00:56:33.876+0000 7f58f8b969c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:33.961 INFO:tasks.workunit.client.0.smithi070.stderr: -30> 2024-09-12T00:56:33.876+0000 7f58f8b969c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33, ofs0, ns] 2024-09-12T00:56:33.961 INFO:tasks.workunit.client.0.smithi070.stderr: -29> 2024-09-12T00:56:33.876+0000 7f57d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431611 cookie 94769229095424 notifier 7398 bl.length()=1015 2024-09-12T00:56:33.961 INFO:tasks.workunit.client.0.smithi070.stderr: -28> 2024-09-12T00:56:33.876+0000 7f57d97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 info.flags=0x17 2024-09-12T00:56:33.961 INFO:tasks.workunit.client.0.smithi070.stderr: -27> 2024-09-12T00:56:33.876+0000 7f57d97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 to cache LRU end 2024-09-12T00:56:33.961 INFO:tasks.workunit.client.0.smithi070.stderr: -26> 2024-09-12T00:56:33.876+0000 7f57d97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:33.961 INFO:tasks.workunit.client.0.smithi070.stderr: -25> 2024-09-12T00:56:33.876+0000 7f58f8b969c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): orig_sources= new_sources= 2024-09-12T00:56:33.961 INFO:tasks.workunit.client.0.smithi070.stderr: -24> 2024-09-12T00:56:33.876+0000 7f58f8b969c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): potential sources added=[] removed=[] 2024-09-12T00:56:33.962 INFO:tasks.workunit.client.0.smithi070.stderr: -23> 2024-09-12T00:56:33.876+0000 7f58f8b969c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): orig_dests= new_dests= 2024-09-12T00:56:33.962 INFO:tasks.workunit.client.0.smithi070.stderr: -22> 2024-09-12T00:56:33.876+0000 7f58f8b969c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): potential dests added=[] removed=[] 2024-09-12T00:56:33.962 INFO:tasks.workunit.client.0.smithi070.stderr: -21> 2024-09-12T00:56:33.884+0000 7f58f8b969c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33.1.0 2024-09-12T00:56:33.962 INFO:tasks.workunit.client.0.smithi070.stderr: -20> 2024-09-12T00:56:33.884+0000 7f58f8b969c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33.1.0 2024-09-12T00:56:33.962 INFO:tasks.workunit.client.0.smithi070.stderr: -19> 2024-09-12T00:56:33.884+0000 7f58f8b969c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33.1.1 2024-09-12T00:56:33.962 INFO:tasks.workunit.client.0.smithi070.stderr: -18> 2024-09-12T00:56:33.884+0000 7f58f8b969c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33.1.1 2024-09-12T00:56:33.962 INFO:tasks.workunit.client.0.smithi070.stderr: -17> 2024-09-12T00:56:33.884+0000 7f58f8b969c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33.0 2024-09-12T00:56:33.962 INFO:tasks.workunit.client.0.smithi070.stderr: -16> 2024-09-12T00:56:33.888+0000 7f58f8b969c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:56:33.962 INFO:tasks.workunit.client.0.smithi070.stderr: -15> 2024-09-12T00:56:33.888+0000 7f58f8b969c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 2024-09-12T00:56:33.962 INFO:tasks.workunit.client.0.smithi070.stderr: -14> 2024-09-12T00:56:33.888+0000 7f58f8b969c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 info.flags=0x17 2024-09-12T00:56:33.962 INFO:tasks.workunit.client.0.smithi070.stderr: -13> 2024-09-12T00:56:33.888+0000 7f58f8b969c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 to cache LRU end 2024-09-12T00:56:33.962 INFO:tasks.workunit.client.0.smithi070.stderr: -12> 2024-09-12T00:56:33.888+0000 7f58f8b969c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:33.962 INFO:tasks.workunit.client.0.smithi070.stderr: -11> 2024-09-12T00:56:33.888+0000 7f58f8b969c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33, ofs0, ns] 2024-09-12T00:56:33.962 INFO:tasks.workunit.client.0.smithi070.stderr: -10> 2024-09-12T00:56:33.892+0000 7f57d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431612 cookie 94769229095424 notifier 7398 bl.length()=1015 2024-09-12T00:56:33.963 INFO:tasks.workunit.client.0.smithi070.stderr: -9> 2024-09-12T00:56:33.892+0000 7f57d97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 info.flags=0x17 2024-09-12T00:56:33.963 INFO:tasks.workunit.client.0.smithi070.stderr: -8> 2024-09-12T00:56:33.892+0000 7f57d97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 to cache LRU end 2024-09-12T00:56:33.963 INFO:tasks.workunit.client.0.smithi070.stderr: -7> 2024-09-12T00:56:33.892+0000 7f57d97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:33.963 INFO:tasks.workunit.client.0.smithi070.stderr: -6> 2024-09-12T00:56:33.892+0000 7f58f8b969c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): orig_sources= new_sources= 2024-09-12T00:56:33.963 INFO:tasks.workunit.client.0.smithi070.stderr: -5> 2024-09-12T00:56:33.892+0000 7f58f8b969c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): potential sources added=[] removed=[] 2024-09-12T00:56:33.963 INFO:tasks.workunit.client.0.smithi070.stderr: -4> 2024-09-12T00:56:33.892+0000 7f58f8b969c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): orig_dests= new_dests= 2024-09-12T00:56:33.963 INFO:tasks.workunit.client.0.smithi070.stderr: -3> 2024-09-12T00:56:33.892+0000 7f58f8b969c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): potential dests added=[] removed=[] 2024-09-12T00:56:33.963 INFO:tasks.workunit.client.0.smithi070.stderr: -2> 2024-09-12T00:56:33.896+0000 7f58f8b969c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33.0 2024-09-12T00:56:33.963 INFO:tasks.workunit.client.0.smithi070.stderr: -1> 2024-09-12T00:56:33.896+0000 7f58f8b969c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f58f8b969c0 time 2024-09-12T00:56:33.900273+0000 2024-09-12T00:56:33.963 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:56:33.963 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.963 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:56:33.963 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f58fc4702eb] 2024-09-12T00:56:33.963 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f58fc47049f] 2024-09-12T00:56:33.964 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56312bf47cc1] 2024-09-12T00:56:33.964 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x56312bf5cfc7] 2024-09-12T00:56:33.964 INFO:tasks.workunit.client.0.smithi070.stderr: 5: main() 2024-09-12T00:56:33.964 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f58fb2d6d90] 2024-09-12T00:56:33.964 INFO:tasks.workunit.client.0.smithi070.stderr: 7: __libc_start_main() 2024-09-12T00:56:33.964 INFO:tasks.workunit.client.0.smithi070.stderr: 8: _start() 2024-09-12T00:56:33.964 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.964 INFO:tasks.workunit.client.0.smithi070.stderr: 0> 2024-09-12T00:56:33.896+0000 7f58f8b969c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:56:33.964 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f58f8b969c0 thread_name:radosgw-admin 2024-09-12T00:56:33.965 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.965 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:56:33.965 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f58fb2ef520] 2024-09-12T00:56:33.965 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:56:33.965 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:56:33.965 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:56:33.965 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f58fc470345] 2024-09-12T00:56:33.965 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f58fc47049f] 2024-09-12T00:56:33.965 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56312bf47cc1] 2024-09-12T00:56:33.965 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x56312bf5cfc7] 2024-09-12T00:56:33.965 INFO:tasks.workunit.client.0.smithi070.stderr: 9: main() 2024-09-12T00:56:33.965 INFO:tasks.workunit.client.0.smithi070.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f58fb2d6d90] 2024-09-12T00:56:33.965 INFO:tasks.workunit.client.0.smithi070.stderr: 11: __libc_start_main() 2024-09-12T00:56:33.966 INFO:tasks.workunit.client.0.smithi070.stderr: 12: _start() 2024-09-12T00:56:33.966 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:56:33.966 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.966 INFO:tasks.workunit.client.0.smithi070.stderr:--- logging levels --- 2024-09-12T00:56:33.966 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 none 2024-09-12T00:56:33.966 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 lockdep 2024-09-12T00:56:33.966 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 context 2024-09-12T00:56:33.966 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 crush 2024-09-12T00:56:33.966 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds 2024-09-12T00:56:33.966 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_balancer 2024-09-12T00:56:33.966 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_locker 2024-09-12T00:56:33.966 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log 2024-09-12T00:56:33.966 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log_expire 2024-09-12T00:56:33.966 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_migrator 2024-09-12T00:56:33.966 INFO:tasks.workunit.client.0.smithi070.stderr: 3/ 5 mds_quiesce 2024-09-12T00:56:33.967 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 buffer 2024-09-12T00:56:33.967 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 timer 2024-09-12T00:56:33.967 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 filer 2024-09-12T00:56:33.967 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 striper 2024-09-12T00:56:33.967 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 objecter 2024-09-12T00:56:33.967 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rados 2024-09-12T00:56:33.967 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd 2024-09-12T00:56:33.967 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_mirror 2024-09-12T00:56:33.967 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_replay 2024-09-12T00:56:33.967 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_pwl 2024-09-12T00:56:33.967 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 journaler 2024-09-12T00:56:33.967 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objectcacher 2024-09-12T00:56:33.967 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:56:33.967 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 client 2024-09-12T00:56:33.968 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 osd 2024-09-12T00:56:33.968 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 optracker 2024-09-12T00:56:33.968 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objclass 2024-09-12T00:56:33.968 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 filestore 2024-09-12T00:56:33.968 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 journal 2024-09-12T00:56:33.968 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 ms 2024-09-12T00:56:33.968 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mon 2024-09-12T00:56:33.968 INFO:tasks.workunit.client.0.smithi070.stderr: 0/10 monc 2024-09-12T00:56:33.968 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 paxos 2024-09-12T00:56:33.968 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 tp 2024-09-12T00:56:33.968 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 auth 2024-09-12T00:56:33.968 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 crypto 2024-09-12T00:56:33.968 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 finisher 2024-09-12T00:56:33.968 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 reserver 2024-09-12T00:56:33.969 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 heartbeatmap 2024-09-12T00:56:33.969 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 perfcounter 2024-09-12T00:56:33.969 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw 2024-09-12T00:56:33.969 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_sync 2024-09-12T00:56:33.969 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_datacache 2024-09-12T00:56:33.969 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_access 2024-09-12T00:56:33.969 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:56:33.969 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_flight 2024-09-12T00:56:33.969 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:56:33.969 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw_notification 2024-09-12T00:56:33.969 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 javaclient 2024-09-12T00:56:33.969 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 asok 2024-09-12T00:56:33.969 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 throttle 2024-09-12T00:56:33.969 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 refs 2024-09-12T00:56:33.970 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 compressor 2024-09-12T00:56:33.970 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluestore 2024-09-12T00:56:33.970 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluefs 2024-09-12T00:56:33.970 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 bdev 2024-09-12T00:56:33.970 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 kstore 2024-09-12T00:56:33.970 INFO:tasks.workunit.client.0.smithi070.stderr: 4/ 5 rocksdb 2024-09-12T00:56:33.970 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 fuse 2024-09-12T00:56:33.970 INFO:tasks.workunit.client.0.smithi070.stderr: 2/ 5 mgr 2024-09-12T00:56:33.970 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mgrc 2024-09-12T00:56:33.970 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 dpdk 2024-09-12T00:56:33.970 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 eventtrace 2024-09-12T00:56:33.970 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 prioritycache 2024-09-12T00:56:33.970 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 test 2024-09-12T00:56:33.970 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:56:33.971 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephsqlite 2024-09-12T00:56:33.971 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:56:33.971 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore 2024-09-12T00:56:33.971 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_onode 2024-09-12T00:56:33.971 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_odata 2024-09-12T00:56:33.971 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_omap 2024-09-12T00:56:33.971 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_tm 2024-09-12T00:56:33.971 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_t 2024-09-12T00:56:33.971 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:56:33.971 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_epm 2024-09-12T00:56:33.971 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_lba 2024-09-12T00:56:33.971 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:56:33.971 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cache 2024-09-12T00:56:33.972 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_journal 2024-09-12T00:56:33.972 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_device 2024-09-12T00:56:33.972 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_backref 2024-09-12T00:56:33.972 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 alienstore 2024-09-12T00:56:33.972 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mclock 2024-09-12T00:56:33.972 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cyanstore 2024-09-12T00:56:33.972 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 ceph_exporter 2024-09-12T00:56:33.972 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 memstore 2024-09-12T00:56:33.972 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 trace 2024-09-12T00:56:33.972 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 ceph_dedup 2024-09-12T00:56:33.972 INFO:tasks.workunit.client.0.smithi070.stderr: -2/-2 (syslog threshold) 2024-09-12T00:56:33.972 INFO:tasks.workunit.client.0.smithi070.stderr: 99/99 (stderr threshold) 2024-09-12T00:56:33.972 INFO:tasks.workunit.client.0.smithi070.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:56:33.972 INFO:tasks.workunit.client.0.smithi070.stderr: 7f57a57fa640 / http_manager 2024-09-12T00:56:33.973 INFO:tasks.workunit.client.0.smithi070.stderr: 7f57a77fe640 / http_manager 2024-09-12T00:56:33.973 INFO:tasks.workunit.client.0.smithi070.stderr: 7f57ad7e2640 / rgw_dt_lg_renew 2024-09-12T00:56:33.973 INFO:tasks.workunit.client.0.smithi070.stderr: 7f57c7fff640 / ms_dispatch 2024-09-12T00:56:33.973 INFO:tasks.workunit.client.0.smithi070.stderr: 7f57d97fa640 / io_context_pool 2024-09-12T00:56:33.973 INFO:tasks.workunit.client.0.smithi070.stderr: 7f57d9ffb640 / io_context_pool 2024-09-12T00:56:33.973 INFO:tasks.workunit.client.0.smithi070.stderr: 7f57dbfff640 / ms_dispatch 2024-09-12T00:56:33.973 INFO:tasks.workunit.client.0.smithi070.stderr: 7f57e2e05640 / ms_dispatch 2024-09-12T00:56:33.973 INFO:tasks.workunit.client.0.smithi070.stderr: 7f57e4608640 / io_context_pool 2024-09-12T00:56:33.973 INFO:tasks.workunit.client.0.smithi070.stderr: 7f58f5e9b640 / msgr-worker-2 2024-09-12T00:56:33.973 INFO:tasks.workunit.client.0.smithi070.stderr: 7f58f669c640 / msgr-worker-1 2024-09-12T00:56:33.973 INFO:tasks.workunit.client.0.smithi070.stderr: 7f58f6e9d640 / msgr-worker-0 2024-09-12T00:56:33.973 INFO:tasks.workunit.client.0.smithi070.stderr: 7f58f769e640 / io_context_pool 2024-09-12T00:56:33.973 INFO:tasks.workunit.client.0.smithi070.stderr: 7f58f8b969c0 / radosgw-admin 2024-09-12T00:56:33.974 INFO:tasks.workunit.client.0.smithi070.stderr: max_recent 500 2024-09-12T00:56:33.974 INFO:tasks.workunit.client.0.smithi070.stderr: max_new 1000 2024-09-12T00:56:33.974 INFO:tasks.workunit.client.0.smithi070.stderr: log_file /var/log/ceph/ceph-client.admin.114407.log 2024-09-12T00:56:33.974 INFO:tasks.workunit.client.0.smithi070.stderr:--- end dump of recent events --- 2024-09-12T00:56:33.974 INFO:tasks.workunit.client.0.smithi070.stderr:--- begin dump of recent events --- 2024-09-12T00:56:33.974 INFO:tasks.workunit.client.0.smithi070.stderr: -499> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 5 AuthRegistry(0x56312e2e7ba0) adding con mode: crc 2024-09-12T00:56:33.974 INFO:tasks.workunit.client.0.smithi070.stderr: -498> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 5 AuthRegistry(0x56312e2e7ba0) adding con mode: secure 2024-09-12T00:56:33.974 INFO:tasks.workunit.client.0.smithi070.stderr: -497> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:33.974 INFO:tasks.workunit.client.0.smithi070.stderr: -496> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:33.974 INFO:tasks.workunit.client.0.smithi070.stderr: -495> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command rotate-key hook 0x56312e2e7ce8 2024-09-12T00:56:33.974 INFO:tasks.workunit.client.0.smithi070.stderr: -494> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient: _reopen_session rank -1 2024-09-12T00:56:33.974 INFO:tasks.workunit.client.0.smithi070.stderr: -493> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:56:33.974 INFO:tasks.workunit.client.0.smithi070.stderr: -492> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient(hunting): picked mon.noname-b con 0x56312e1a3480 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:56:33.974 INFO:tasks.workunit.client.0.smithi070.stderr: -491> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient(hunting): picked mon.noname-a con 0x56312e1a4330 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:56:33.975 INFO:tasks.workunit.client.0.smithi070.stderr: -490> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient(hunting): picked mon.noname-c con 0x56312e2ee450 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:56:33.975 INFO:tasks.workunit.client.0.smithi070.stderr: -489> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:33.975 INFO:tasks.workunit.client.0.smithi070.stderr: -488> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:33.975 INFO:tasks.workunit.client.0.smithi070.stderr: -487> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:33.975 INFO:tasks.workunit.client.0.smithi070.stderr: -486> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient(hunting): _renew_subs 2024-09-12T00:56:33.975 INFO:tasks.workunit.client.0.smithi070.stderr: -485> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient(hunting): authenticate will time out at 2244.246351s 2024-09-12T00:56:33.975 INFO:tasks.workunit.client.0.smithi070.stderr: -484> 2024-09-12T00:56:33.796+0000 7f58f6e9d640 10 monclient(hunting): get_auth_request con 0x56312e2ee450 auth_method 0 2024-09-12T00:56:33.975 INFO:tasks.workunit.client.0.smithi070.stderr: -483> 2024-09-12T00:56:33.796+0000 7f58f6e9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:33.975 INFO:tasks.workunit.client.0.smithi070.stderr: -482> 2024-09-12T00:56:33.796+0000 7f58f6e9d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:33.975 INFO:tasks.workunit.client.0.smithi070.stderr: -481> 2024-09-12T00:56:33.796+0000 7f58f6e9d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:33.975 INFO:tasks.workunit.client.0.smithi070.stderr: -480> 2024-09-12T00:56:33.796+0000 7f58f5e9b640 10 monclient(hunting): get_auth_request con 0x56312e1a4330 auth_method 0 2024-09-12T00:56:33.975 INFO:tasks.workunit.client.0.smithi070.stderr: -479> 2024-09-12T00:56:33.796+0000 7f58f5e9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:33.975 INFO:tasks.workunit.client.0.smithi070.stderr: -478> 2024-09-12T00:56:33.796+0000 7f58f5e9b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:33.976 INFO:tasks.workunit.client.0.smithi070.stderr: -477> 2024-09-12T00:56:33.796+0000 7f58f5e9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:33.976 INFO:tasks.workunit.client.0.smithi070.stderr: -476> 2024-09-12T00:56:33.796+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:33.976 INFO:tasks.workunit.client.0.smithi070.stderr: -475> 2024-09-12T00:56:33.796+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:33.976 INFO:tasks.workunit.client.0.smithi070.stderr: -474> 2024-09-12T00:56:33.796+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:33.976 INFO:tasks.workunit.client.0.smithi070.stderr: -473> 2024-09-12T00:56:33.796+0000 7f58f5e9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:33.976 INFO:tasks.workunit.client.0.smithi070.stderr: -472> 2024-09-12T00:56:33.796+0000 7f58f5e9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:33.976 INFO:tasks.workunit.client.0.smithi070.stderr: -471> 2024-09-12T00:56:33.796+0000 7f58f5e9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:33.976 INFO:tasks.workunit.client.0.smithi070.stderr: -470> 2024-09-12T00:56:33.796+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_done global_id 6959 payload 824 2024-09-12T00:56:33.976 INFO:tasks.workunit.client.0.smithi070.stderr: -469> 2024-09-12T00:56:33.796+0000 7f58f6e9d640 10 monclient: _finish_hunting 0 2024-09-12T00:56:33.976 INFO:tasks.workunit.client.0.smithi070.stderr: -468> 2024-09-12T00:56:33.796+0000 7f58f6e9d640 1 monclient: found mon.noname-c 2024-09-12T00:56:33.976 INFO:tasks.workunit.client.0.smithi070.stderr: -467> 2024-09-12T00:56:33.796+0000 7f58f6e9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:56:33.976 INFO:tasks.workunit.client.0.smithi070.stderr: -466> 2024-09-12T00:56:33.796+0000 7f58f669c640 10 monclient: get_auth_request con 0x56312e1a3480 auth_method 0 2024-09-12T00:56:33.976 INFO:tasks.workunit.client.0.smithi070.stderr: -465> 2024-09-12T00:56:33.796+0000 7f57e2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:33.977 INFO:tasks.workunit.client.0.smithi070.stderr: -464> 2024-09-12T00:56:33.796+0000 7f57e2e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:56:33.977 INFO:tasks.workunit.client.0.smithi070.stderr: -463> 2024-09-12T00:56:33.796+0000 7f57e2e05640 10 monclient: dump: 2024-09-12T00:56:33.977 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:56:33.977 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:56:33.977 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.977 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.977 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:33.977 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:56:33.977 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:56:33.977 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:56:33.977 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:56:33.977 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.977 INFO:tasks.workunit.client.0.smithi070.stderr: -462> 2024-09-12T00:56:33.796+0000 7f57e2e05640 10 monclient: _finish_auth 0 2024-09-12T00:56:33.978 INFO:tasks.workunit.client.0.smithi070.stderr: -461> 2024-09-12T00:56:33.796+0000 7f57e2e05640 10 monclient: _check_auth_tickets 2024-09-12T00:56:33.978 INFO:tasks.workunit.client.0.smithi070.stderr: -460> 2024-09-12T00:56:33.796+0000 7f57e2e05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:56:33.978 INFO:tasks.workunit.client.0.smithi070.stderr: -459> 2024-09-12T00:56:33.796+0000 7f57e2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:33.978 INFO:tasks.workunit.client.0.smithi070.stderr: -458> 2024-09-12T00:56:33.796+0000 7f57e2e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:56:33.978 INFO:tasks.workunit.client.0.smithi070.stderr: -457> 2024-09-12T00:56:33.796+0000 7f57e2e05640 10 monclient: dump: 2024-09-12T00:56:33.978 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:56:33.978 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:56:33.978 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.978 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.978 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:33.978 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:56:33.978 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:56:33.978 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:56:33.978 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:56:33.978 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.979 INFO:tasks.workunit.client.0.smithi070.stderr: -456> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 5 monclient: authenticate success, global_id 6959 2024-09-12T00:56:33.979 INFO:tasks.workunit.client.0.smithi070.stderr: -455> 2024-09-12T00:56:33.796+0000 7f57e4608640 4 set_mon_vals no callback set 2024-09-12T00:56:33.979 INFO:tasks.workunit.client.0.smithi070.stderr: -454> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient: _renew_subs 2024-09-12T00:56:33.979 INFO:tasks.workunit.client.0.smithi070.stderr: -453> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:56:33.979 INFO:tasks.workunit.client.0.smithi070.stderr: -452> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient: _renew_subs 2024-09-12T00:56:33.979 INFO:tasks.workunit.client.0.smithi070.stderr: -451> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:56:33.979 INFO:tasks.workunit.client.0.smithi070.stderr: -450> 2024-09-12T00:56:33.796+0000 7f58f8b969c0 1 librados: init done 2024-09-12T00:56:33.979 INFO:tasks.workunit.client.0.smithi070.stderr: -449> 2024-09-12T00:56:33.800+0000 7f57e2e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:56:33.979 INFO:tasks.workunit.client.0.smithi070.stderr: -448> 2024-09-12T00:56:33.800+0000 7f57e2e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:56:33.979 INFO:tasks.workunit.client.0.smithi070.stderr: -447> 2024-09-12T00:56:33.800+0000 7f57e2e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:56:33.979 INFO:tasks.workunit.client.0.smithi070.stderr: -446> 2024-09-12T00:56:33.800+0000 7f58f669c640 10 monclient: get_auth_request con 0x7f57dc070ae0 auth_method 0 2024-09-12T00:56:33.979 INFO:tasks.workunit.client.0.smithi070.stderr: -445> 2024-09-12T00:56:33.800+0000 7f58f5e9b640 10 monclient: get_auth_request con 0x56312e310050 auth_method 0 2024-09-12T00:56:33.979 INFO:tasks.workunit.client.0.smithi070.stderr: -444> 2024-09-12T00:56:33.800+0000 7f58f669c640 10 monclient: get_auth_request con 0x56312e332fc0 auth_method 0 2024-09-12T00:56:33.980 INFO:tasks.workunit.client.0.smithi070.stderr: -443> 2024-09-12T00:56:33.804+0000 7f58f5e9b640 10 monclient: get_auth_request con 0x56312e3371b0 auth_method 0 2024-09-12T00:56:33.980 INFO:tasks.workunit.client.0.smithi070.stderr: -442> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 10 monclient: build_initial_monmap 2024-09-12T00:56:33.980 INFO:tasks.workunit.client.0.smithi070.stderr: -441> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 1 build_initial for_mkfs: 0 2024-09-12T00:56:33.980 INFO:tasks.workunit.client.0.smithi070.stderr: -440> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 10 monclient: monmap: 2024-09-12T00:56:33.980 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:56:33.980 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:56:33.980 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:56:33.980 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:56:33.980 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:56:33.980 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:56:33.980 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:56:33.980 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:56:33.980 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:56:33.981 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.981 INFO:tasks.workunit.client.0.smithi070.stderr: -439> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding auth protocol: cephx 2024-09-12T00:56:33.981 INFO:tasks.workunit.client.0.smithi070.stderr: -438> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding auth protocol: cephx 2024-09-12T00:56:33.981 INFO:tasks.workunit.client.0.smithi070.stderr: -437> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding auth protocol: cephx 2024-09-12T00:56:33.981 INFO:tasks.workunit.client.0.smithi070.stderr: -436> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding con mode: secure 2024-09-12T00:56:33.981 INFO:tasks.workunit.client.0.smithi070.stderr: -435> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding con mode: crc 2024-09-12T00:56:33.981 INFO:tasks.workunit.client.0.smithi070.stderr: -434> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding con mode: secure 2024-09-12T00:56:33.981 INFO:tasks.workunit.client.0.smithi070.stderr: -433> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding con mode: crc 2024-09-12T00:56:33.981 INFO:tasks.workunit.client.0.smithi070.stderr: -432> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding con mode: secure 2024-09-12T00:56:33.981 INFO:tasks.workunit.client.0.smithi070.stderr: -431> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding con mode: crc 2024-09-12T00:56:33.981 INFO:tasks.workunit.client.0.smithi070.stderr: -430> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding con mode: crc 2024-09-12T00:56:33.981 INFO:tasks.workunit.client.0.smithi070.stderr: -429> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding con mode: secure 2024-09-12T00:56:33.981 INFO:tasks.workunit.client.0.smithi070.stderr: -428> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding con mode: crc 2024-09-12T00:56:33.982 INFO:tasks.workunit.client.0.smithi070.stderr: -427> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding con mode: secure 2024-09-12T00:56:33.982 INFO:tasks.workunit.client.0.smithi070.stderr: -426> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding con mode: crc 2024-09-12T00:56:33.982 INFO:tasks.workunit.client.0.smithi070.stderr: -425> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33c070) adding con mode: secure 2024-09-12T00:56:33.982 INFO:tasks.workunit.client.0.smithi070.stderr: -424> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:33.982 INFO:tasks.workunit.client.0.smithi070.stderr: -423> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command objecter_requests cmddesc objecter_requests hook 0x56312e33fa20 EEXIST 2024-09-12T00:56:33.982 INFO:tasks.workunit.client.0.smithi070.stderr: -422> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 10 monclient: init 2024-09-12T00:56:33.982 INFO:tasks.workunit.client.0.smithi070.stderr: -421> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding auth protocol: cephx 2024-09-12T00:56:33.982 INFO:tasks.workunit.client.0.smithi070.stderr: -420> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding auth protocol: cephx 2024-09-12T00:56:33.982 INFO:tasks.workunit.client.0.smithi070.stderr: -419> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding auth protocol: cephx 2024-09-12T00:56:33.982 INFO:tasks.workunit.client.0.smithi070.stderr: -418> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding con mode: secure 2024-09-12T00:56:33.982 INFO:tasks.workunit.client.0.smithi070.stderr: -417> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding con mode: crc 2024-09-12T00:56:33.982 INFO:tasks.workunit.client.0.smithi070.stderr: -416> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding con mode: secure 2024-09-12T00:56:33.982 INFO:tasks.workunit.client.0.smithi070.stderr: -415> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding con mode: crc 2024-09-12T00:56:33.983 INFO:tasks.workunit.client.0.smithi070.stderr: -414> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding con mode: secure 2024-09-12T00:56:33.983 INFO:tasks.workunit.client.0.smithi070.stderr: -413> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding con mode: crc 2024-09-12T00:56:33.983 INFO:tasks.workunit.client.0.smithi070.stderr: -412> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding con mode: crc 2024-09-12T00:56:33.983 INFO:tasks.workunit.client.0.smithi070.stderr: -411> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding con mode: secure 2024-09-12T00:56:33.983 INFO:tasks.workunit.client.0.smithi070.stderr: -410> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding con mode: crc 2024-09-12T00:56:33.983 INFO:tasks.workunit.client.0.smithi070.stderr: -409> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding con mode: secure 2024-09-12T00:56:33.983 INFO:tasks.workunit.client.0.smithi070.stderr: -408> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding con mode: crc 2024-09-12T00:56:33.983 INFO:tasks.workunit.client.0.smithi070.stderr: -407> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 AuthRegistry(0x56312e33a6f8) adding con mode: secure 2024-09-12T00:56:33.983 INFO:tasks.workunit.client.0.smithi070.stderr: -406> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:33.983 INFO:tasks.workunit.client.0.smithi070.stderr: -405> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:33.983 INFO:tasks.workunit.client.0.smithi070.stderr: -404> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command rotate-key cmddesc rotate-key hook 0x56312e33a840 EEXIST 2024-09-12T00:56:33.983 INFO:tasks.workunit.client.0.smithi070.stderr: -403> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 10 monclient: _reopen_session rank -1 2024-09-12T00:56:33.983 INFO:tasks.workunit.client.0.smithi070.stderr: -402> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:56:33.983 INFO:tasks.workunit.client.0.smithi070.stderr: -401> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 10 monclient(hunting): picked mon.noname-a con 0x56312e363bd0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:56:33.984 INFO:tasks.workunit.client.0.smithi070.stderr: -400> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 10 monclient(hunting): picked mon.noname-c con 0x56312e363500 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:56:33.984 INFO:tasks.workunit.client.0.smithi070.stderr: -399> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 10 monclient(hunting): picked mon.noname-b con 0x56312e361ee0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:56:33.984 INFO:tasks.workunit.client.0.smithi070.stderr: -398> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:33.984 INFO:tasks.workunit.client.0.smithi070.stderr: -397> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:33.984 INFO:tasks.workunit.client.0.smithi070.stderr: -396> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:33.984 INFO:tasks.workunit.client.0.smithi070.stderr: -395> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 10 monclient(hunting): _renew_subs 2024-09-12T00:56:33.984 INFO:tasks.workunit.client.0.smithi070.stderr: -394> 2024-09-12T00:56:33.804+0000 7f58f8b969c0 10 monclient(hunting): authenticate will time out at 2244.255744s 2024-09-12T00:56:33.984 INFO:tasks.workunit.client.0.smithi070.stderr: -393> 2024-09-12T00:56:33.804+0000 7f58f669c640 10 monclient(hunting): get_auth_request con 0x56312e363bd0 auth_method 0 2024-09-12T00:56:33.984 INFO:tasks.workunit.client.0.smithi070.stderr: -392> 2024-09-12T00:56:33.804+0000 7f58f669c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:33.984 INFO:tasks.workunit.client.0.smithi070.stderr: -391> 2024-09-12T00:56:33.804+0000 7f58f669c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:33.984 INFO:tasks.workunit.client.0.smithi070.stderr: -390> 2024-09-12T00:56:33.804+0000 7f58f669c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:33.984 INFO:tasks.workunit.client.0.smithi070.stderr: -389> 2024-09-12T00:56:33.804+0000 7f58f5e9b640 10 monclient(hunting): get_auth_request con 0x56312e363500 auth_method 0 2024-09-12T00:56:33.984 INFO:tasks.workunit.client.0.smithi070.stderr: -388> 2024-09-12T00:56:33.804+0000 7f58f5e9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:33.984 INFO:tasks.workunit.client.0.smithi070.stderr: -387> 2024-09-12T00:56:33.804+0000 7f58f5e9b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:33.985 INFO:tasks.workunit.client.0.smithi070.stderr: -386> 2024-09-12T00:56:33.804+0000 7f58f5e9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:33.985 INFO:tasks.workunit.client.0.smithi070.stderr: -385> 2024-09-12T00:56:33.808+0000 7f58f669c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:33.985 INFO:tasks.workunit.client.0.smithi070.stderr: -384> 2024-09-12T00:56:33.808+0000 7f58f669c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:33.985 INFO:tasks.workunit.client.0.smithi070.stderr: -383> 2024-09-12T00:56:33.808+0000 7f58f669c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:33.985 INFO:tasks.workunit.client.0.smithi070.stderr: -382> 2024-09-12T00:56:33.808+0000 7f58f5e9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:33.985 INFO:tasks.workunit.client.0.smithi070.stderr: -381> 2024-09-12T00:56:33.808+0000 7f58f5e9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:33.985 INFO:tasks.workunit.client.0.smithi070.stderr: -380> 2024-09-12T00:56:33.808+0000 7f58f5e9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:33.985 INFO:tasks.workunit.client.0.smithi070.stderr: -379> 2024-09-12T00:56:33.808+0000 7f58f6e9d640 10 monclient(hunting): get_auth_request con 0x56312e361ee0 auth_method 0 2024-09-12T00:56:33.985 INFO:tasks.workunit.client.0.smithi070.stderr: -378> 2024-09-12T00:56:33.808+0000 7f58f6e9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:33.985 INFO:tasks.workunit.client.0.smithi070.stderr: -377> 2024-09-12T00:56:33.808+0000 7f58f6e9d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:33.985 INFO:tasks.workunit.client.0.smithi070.stderr: -376> 2024-09-12T00:56:33.808+0000 7f58f6e9d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:33.985 INFO:tasks.workunit.client.0.smithi070.stderr: -375> 2024-09-12T00:56:33.808+0000 7f58f669c640 10 monclient(hunting): handle_auth_done global_id 7392 payload 824 2024-09-12T00:56:33.985 INFO:tasks.workunit.client.0.smithi070.stderr: -374> 2024-09-12T00:56:33.808+0000 7f58f669c640 10 monclient: _finish_hunting 0 2024-09-12T00:56:33.986 INFO:tasks.workunit.client.0.smithi070.stderr: -373> 2024-09-12T00:56:33.808+0000 7f58f669c640 1 monclient: found mon.noname-a 2024-09-12T00:56:33.986 INFO:tasks.workunit.client.0.smithi070.stderr: -372> 2024-09-12T00:56:33.808+0000 7f58f669c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:56:33.986 INFO:tasks.workunit.client.0.smithi070.stderr: -371> 2024-09-12T00:56:33.808+0000 7f57dbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:33.986 INFO:tasks.workunit.client.0.smithi070.stderr: -370> 2024-09-12T00:56:33.808+0000 7f57dbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:56:33.986 INFO:tasks.workunit.client.0.smithi070.stderr: -369> 2024-09-12T00:56:33.808+0000 7f57dbfff640 10 monclient: dump: 2024-09-12T00:56:33.986 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:56:33.986 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:56:33.986 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.986 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.986 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:33.986 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:56:33.986 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:56:33.986 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:56:33.986 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:56:33.987 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.987 INFO:tasks.workunit.client.0.smithi070.stderr: -368> 2024-09-12T00:56:33.808+0000 7f57dbfff640 10 monclient: _finish_auth 0 2024-09-12T00:56:33.987 INFO:tasks.workunit.client.0.smithi070.stderr: -367> 2024-09-12T00:56:33.808+0000 7f57dbfff640 10 monclient: _check_auth_tickets 2024-09-12T00:56:33.987 INFO:tasks.workunit.client.0.smithi070.stderr: -366> 2024-09-12T00:56:33.808+0000 7f57dbfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:56:33.987 INFO:tasks.workunit.client.0.smithi070.stderr: -365> 2024-09-12T00:56:33.808+0000 7f57dbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:33.987 INFO:tasks.workunit.client.0.smithi070.stderr: -364> 2024-09-12T00:56:33.808+0000 7f57dbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:56:33.987 INFO:tasks.workunit.client.0.smithi070.stderr: -363> 2024-09-12T00:56:33.808+0000 7f57dbfff640 10 monclient: dump: 2024-09-12T00:56:33.987 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:56:33.987 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:56:33.987 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.988 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.988 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:33.988 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:56:33.988 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:56:33.988 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:56:33.988 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:56:33.988 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.988 INFO:tasks.workunit.client.0.smithi070.stderr: -362> 2024-09-12T00:56:33.808+0000 7f58f769e640 4 set_mon_vals no callback set 2024-09-12T00:56:33.988 INFO:tasks.workunit.client.0.smithi070.stderr: -361> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 monclient: authenticate success, global_id 7392 2024-09-12T00:56:33.988 INFO:tasks.workunit.client.0.smithi070.stderr: -360> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 10 monclient: _renew_subs 2024-09-12T00:56:33.988 INFO:tasks.workunit.client.0.smithi070.stderr: -359> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:56:33.988 INFO:tasks.workunit.client.0.smithi070.stderr: -358> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 10 monclient: _renew_subs 2024-09-12T00:56:33.988 INFO:tasks.workunit.client.0.smithi070.stderr: -357> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:56:33.989 INFO:tasks.workunit.client.0.smithi070.stderr: -356> 2024-09-12T00:56:33.808+0000 7f57dbfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:56:33.989 INFO:tasks.workunit.client.0.smithi070.stderr: -355> 2024-09-12T00:56:33.808+0000 7f57dbfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:56:33.989 INFO:tasks.workunit.client.0.smithi070.stderr: -354> 2024-09-12T00:56:33.808+0000 7f57dbfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:56:33.989 INFO:tasks.workunit.client.0.smithi070.stderr: -353> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 10 monclient: get_monmap_and_config 2024-09-12T00:56:33.989 INFO:tasks.workunit.client.0.smithi070.stderr: -352> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 10 monclient: build_initial_monmap 2024-09-12T00:56:33.989 INFO:tasks.workunit.client.0.smithi070.stderr: -351> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 1 build_initial for_mkfs: 0 2024-09-12T00:56:33.989 INFO:tasks.workunit.client.0.smithi070.stderr: -350> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 10 monclient: monmap: 2024-09-12T00:56:33.989 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:56:33.989 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:56:33.989 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:56:33.989 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:56:33.989 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:56:33.989 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:56:33.990 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:56:33.990 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:56:33.990 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:56:33.990 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.990 INFO:tasks.workunit.client.0.smithi070.stderr: -349> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding auth protocol: cephx 2024-09-12T00:56:33.990 INFO:tasks.workunit.client.0.smithi070.stderr: -348> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding auth protocol: cephx 2024-09-12T00:56:33.990 INFO:tasks.workunit.client.0.smithi070.stderr: -347> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding auth protocol: cephx 2024-09-12T00:56:33.990 INFO:tasks.workunit.client.0.smithi070.stderr: -346> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding con mode: secure 2024-09-12T00:56:33.990 INFO:tasks.workunit.client.0.smithi070.stderr: -345> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding con mode: crc 2024-09-12T00:56:33.990 INFO:tasks.workunit.client.0.smithi070.stderr: -344> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding con mode: secure 2024-09-12T00:56:33.990 INFO:tasks.workunit.client.0.smithi070.stderr: -343> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding con mode: crc 2024-09-12T00:56:33.990 INFO:tasks.workunit.client.0.smithi070.stderr: -342> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding con mode: secure 2024-09-12T00:56:33.990 INFO:tasks.workunit.client.0.smithi070.stderr: -341> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding con mode: crc 2024-09-12T00:56:33.991 INFO:tasks.workunit.client.0.smithi070.stderr: -340> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding con mode: crc 2024-09-12T00:56:33.991 INFO:tasks.workunit.client.0.smithi070.stderr: -339> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding con mode: secure 2024-09-12T00:56:33.991 INFO:tasks.workunit.client.0.smithi070.stderr: -338> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding con mode: crc 2024-09-12T00:56:33.991 INFO:tasks.workunit.client.0.smithi070.stderr: -337> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding con mode: secure 2024-09-12T00:56:33.991 INFO:tasks.workunit.client.0.smithi070.stderr: -336> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding con mode: crc 2024-09-12T00:56:33.991 INFO:tasks.workunit.client.0.smithi070.stderr: -335> 2024-09-12T00:56:33.808+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835f0) adding con mode: secure 2024-09-12T00:56:33.991 INFO:tasks.workunit.client.0.smithi070.stderr: -334> 2024-09-12T00:56:33.808+0000 7f58f5e9b640 10 monclient: get_auth_request con 0x7f57d0070a20 auth_method 0 2024-09-12T00:56:33.991 INFO:tasks.workunit.client.0.smithi070.stderr: -333> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:33.991 INFO:tasks.workunit.client.0.smithi070.stderr: -332> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient: init 2024-09-12T00:56:33.992 INFO:tasks.workunit.client.0.smithi070.stderr: -331> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding auth protocol: cephx 2024-09-12T00:56:33.992 INFO:tasks.workunit.client.0.smithi070.stderr: -330> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding auth protocol: cephx 2024-09-12T00:56:33.992 INFO:tasks.workunit.client.0.smithi070.stderr: -329> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding auth protocol: cephx 2024-09-12T00:56:33.992 INFO:tasks.workunit.client.0.smithi070.stderr: -328> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding con mode: secure 2024-09-12T00:56:33.992 INFO:tasks.workunit.client.0.smithi070.stderr: -327> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding con mode: crc 2024-09-12T00:56:33.992 INFO:tasks.workunit.client.0.smithi070.stderr: -326> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding con mode: secure 2024-09-12T00:56:33.992 INFO:tasks.workunit.client.0.smithi070.stderr: -325> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding con mode: crc 2024-09-12T00:56:33.992 INFO:tasks.workunit.client.0.smithi070.stderr: -324> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding con mode: secure 2024-09-12T00:56:33.992 INFO:tasks.workunit.client.0.smithi070.stderr: -323> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding con mode: crc 2024-09-12T00:56:33.992 INFO:tasks.workunit.client.0.smithi070.stderr: -322> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding con mode: crc 2024-09-12T00:56:33.992 INFO:tasks.workunit.client.0.smithi070.stderr: -321> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding con mode: secure 2024-09-12T00:56:33.992 INFO:tasks.workunit.client.0.smithi070.stderr: -320> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding con mode: crc 2024-09-12T00:56:33.992 INFO:tasks.workunit.client.0.smithi070.stderr: -319> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding con mode: secure 2024-09-12T00:56:33.993 INFO:tasks.workunit.client.0.smithi070.stderr: -318> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding con mode: crc 2024-09-12T00:56:33.993 INFO:tasks.workunit.client.0.smithi070.stderr: -317> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3610) adding con mode: secure 2024-09-12T00:56:33.993 INFO:tasks.workunit.client.0.smithi070.stderr: -316> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:33.993 INFO:tasks.workunit.client.0.smithi070.stderr: -315> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:33.993 INFO:tasks.workunit.client.0.smithi070.stderr: -314> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffddf9d3758 EEXIST 2024-09-12T00:56:33.993 INFO:tasks.workunit.client.0.smithi070.stderr: -313> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient: _reopen_session rank -1 2024-09-12T00:56:33.993 INFO:tasks.workunit.client.0.smithi070.stderr: -312> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:56:33.993 INFO:tasks.workunit.client.0.smithi070.stderr: -311> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): picked mon.noname-a con 0x56312e3b1b90 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:56:33.993 INFO:tasks.workunit.client.0.smithi070.stderr: -310> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): picked mon.noname-b con 0x56312e3b1f70 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:56:33.993 INFO:tasks.workunit.client.0.smithi070.stderr: -309> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): picked mon.noname-c con 0x56312e3b33f0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:56:33.993 INFO:tasks.workunit.client.0.smithi070.stderr: -308> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:33.993 INFO:tasks.workunit.client.0.smithi070.stderr: -307> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:33.993 INFO:tasks.workunit.client.0.smithi070.stderr: -306> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:33.994 INFO:tasks.workunit.client.0.smithi070.stderr: -305> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): _renew_subs 2024-09-12T00:56:33.994 INFO:tasks.workunit.client.0.smithi070.stderr: -304> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): authenticate will time out at 2244.260784s 2024-09-12T00:56:33.994 INFO:tasks.workunit.client.0.smithi070.stderr: -303> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): get_auth_request con 0x56312e3b1b90 auth_method 0 2024-09-12T00:56:33.994 INFO:tasks.workunit.client.0.smithi070.stderr: -302> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:33.994 INFO:tasks.workunit.client.0.smithi070.stderr: -301> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:33.994 INFO:tasks.workunit.client.0.smithi070.stderr: -300> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:33.994 INFO:tasks.workunit.client.0.smithi070.stderr: -299> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): get_auth_request con 0x56312e3b33f0 auth_method 0 2024-09-12T00:56:33.994 INFO:tasks.workunit.client.0.smithi070.stderr: -298> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:33.994 INFO:tasks.workunit.client.0.smithi070.stderr: -297> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:33.994 INFO:tasks.workunit.client.0.smithi070.stderr: -296> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:33.994 INFO:tasks.workunit.client.0.smithi070.stderr: -295> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:33.994 INFO:tasks.workunit.client.0.smithi070.stderr: -294> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:33.994 INFO:tasks.workunit.client.0.smithi070.stderr: -293> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:33.995 INFO:tasks.workunit.client.0.smithi070.stderr: -292> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:33.995 INFO:tasks.workunit.client.0.smithi070.stderr: -291> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:33.995 INFO:tasks.workunit.client.0.smithi070.stderr: -290> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:33.995 INFO:tasks.workunit.client.0.smithi070.stderr: -289> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): handle_auth_done global_id 7395 payload 274 2024-09-12T00:56:33.995 INFO:tasks.workunit.client.0.smithi070.stderr: -288> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient: _finish_hunting 0 2024-09-12T00:56:33.995 INFO:tasks.workunit.client.0.smithi070.stderr: -287> 2024-09-12T00:56:33.812+0000 7f58f669c640 1 monclient: found mon.noname-a 2024-09-12T00:56:33.995 INFO:tasks.workunit.client.0.smithi070.stderr: -286> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:56:33.995 INFO:tasks.workunit.client.0.smithi070.stderr: -285> 2024-09-12T00:56:33.812+0000 7f57d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:33.995 INFO:tasks.workunit.client.0.smithi070.stderr: -284> 2024-09-12T00:56:33.812+0000 7f57d9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:56:33.995 INFO:tasks.workunit.client.0.smithi070.stderr: -283> 2024-09-12T00:56:33.812+0000 7f57d9ffb640 10 monclient: dump: 2024-09-12T00:56:33.995 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:56:33.995 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:56:33.995 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.995 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.995 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:33.996 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:56:33.996 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:56:33.996 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:56:33.996 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:56:33.996 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.996 INFO:tasks.workunit.client.0.smithi070.stderr: -282> 2024-09-12T00:56:33.812+0000 7f57d9ffb640 10 monclient: _finish_auth 0 2024-09-12T00:56:33.996 INFO:tasks.workunit.client.0.smithi070.stderr: -281> 2024-09-12T00:56:33.812+0000 7f57d9ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:56:33.996 INFO:tasks.workunit.client.0.smithi070.stderr: -280> 2024-09-12T00:56:33.812+0000 7f57d9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:56:33.996 INFO:tasks.workunit.client.0.smithi070.stderr: -279> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 monclient: authenticate success, global_id 7395 2024-09-12T00:56:33.996 INFO:tasks.workunit.client.0.smithi070.stderr: -278> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient: get_monmap_and_config success 2024-09-12T00:56:33.996 INFO:tasks.workunit.client.0.smithi070.stderr: -277> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 4 set_mon_vals no callback set 2024-09-12T00:56:33.996 INFO:tasks.workunit.client.0.smithi070.stderr: -276> 2024-09-12T00:56:33.812+0000 7f57d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:33.996 INFO:tasks.workunit.client.0.smithi070.stderr: -275> 2024-09-12T00:56:33.812+0000 7f57d9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:56:33.997 INFO:tasks.workunit.client.0.smithi070.stderr: -274> 2024-09-12T00:56:33.812+0000 7f57d9ffb640 10 monclient: dump: 2024-09-12T00:56:33.997 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:56:33.997 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:56:33.997 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.997 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:33.997 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:33.997 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:56:33.997 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:56:33.997 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:56:33.997 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:56:33.997 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.997 INFO:tasks.workunit.client.0.smithi070.stderr: -273> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient: shutdown 2024-09-12T00:56:33.997 INFO:tasks.workunit.client.0.smithi070.stderr: -272> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient: build_initial_monmap 2024-09-12T00:56:33.997 INFO:tasks.workunit.client.0.smithi070.stderr: -271> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 1 build_initial for_mkfs: 0 2024-09-12T00:56:33.998 INFO:tasks.workunit.client.0.smithi070.stderr: -270> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient: monmap: 2024-09-12T00:56:33.998 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:56:33.998 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:56:33.998 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:56:33.998 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:56:33.998 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:56:33.998 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:56:33.998 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:56:33.998 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:56:33.998 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:56:33.998 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:33.998 INFO:tasks.workunit.client.0.smithi070.stderr: -269> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding auth protocol: cephx 2024-09-12T00:56:33.998 INFO:tasks.workunit.client.0.smithi070.stderr: -268> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding auth protocol: cephx 2024-09-12T00:56:33.998 INFO:tasks.workunit.client.0.smithi070.stderr: -267> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding auth protocol: cephx 2024-09-12T00:56:33.999 INFO:tasks.workunit.client.0.smithi070.stderr: -266> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding con mode: secure 2024-09-12T00:56:33.999 INFO:tasks.workunit.client.0.smithi070.stderr: -265> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding con mode: crc 2024-09-12T00:56:33.999 INFO:tasks.workunit.client.0.smithi070.stderr: -264> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding con mode: secure 2024-09-12T00:56:33.999 INFO:tasks.workunit.client.0.smithi070.stderr: -263> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding con mode: crc 2024-09-12T00:56:33.999 INFO:tasks.workunit.client.0.smithi070.stderr: -262> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding con mode: secure 2024-09-12T00:56:33.999 INFO:tasks.workunit.client.0.smithi070.stderr: -261> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding con mode: crc 2024-09-12T00:56:33.999 INFO:tasks.workunit.client.0.smithi070.stderr: -260> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding con mode: crc 2024-09-12T00:56:33.999 INFO:tasks.workunit.client.0.smithi070.stderr: -259> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding con mode: secure 2024-09-12T00:56:33.999 INFO:tasks.workunit.client.0.smithi070.stderr: -258> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding con mode: crc 2024-09-12T00:56:33.999 INFO:tasks.workunit.client.0.smithi070.stderr: -257> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding con mode: secure 2024-09-12T00:56:33.999 INFO:tasks.workunit.client.0.smithi070.stderr: -256> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding con mode: crc 2024-09-12T00:56:33.999 INFO:tasks.workunit.client.0.smithi070.stderr: -255> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3835a0) adding con mode: secure 2024-09-12T00:56:33.999 INFO:tasks.workunit.client.0.smithi070.stderr: -254> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:33.999 INFO:tasks.workunit.client.0.smithi070.stderr: -253> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 1 librados: starting msgr at 2024-09-12T00:56:34.000 INFO:tasks.workunit.client.0.smithi070.stderr: -252> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 1 librados: starting objecter 2024-09-12T00:56:34.000 INFO:tasks.workunit.client.0.smithi070.stderr: -251> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command objecter_requests cmddesc objecter_requests hook 0x56312e339cb0 EEXIST 2024-09-12T00:56:34.000 INFO:tasks.workunit.client.0.smithi070.stderr: -250> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 1 librados: setting wanted keys 2024-09-12T00:56:34.000 INFO:tasks.workunit.client.0.smithi070.stderr: -249> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 1 librados: calling monclient init 2024-09-12T00:56:34.000 INFO:tasks.workunit.client.0.smithi070.stderr: -248> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient: init 2024-09-12T00:56:34.000 INFO:tasks.workunit.client.0.smithi070.stderr: -247> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding auth protocol: cephx 2024-09-12T00:56:34.000 INFO:tasks.workunit.client.0.smithi070.stderr: -246> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding auth protocol: cephx 2024-09-12T00:56:34.000 INFO:tasks.workunit.client.0.smithi070.stderr: -245> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding auth protocol: cephx 2024-09-12T00:56:34.000 INFO:tasks.workunit.client.0.smithi070.stderr: -244> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding con mode: secure 2024-09-12T00:56:34.000 INFO:tasks.workunit.client.0.smithi070.stderr: -243> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding con mode: crc 2024-09-12T00:56:34.000 INFO:tasks.workunit.client.0.smithi070.stderr: -242> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding con mode: secure 2024-09-12T00:56:34.000 INFO:tasks.workunit.client.0.smithi070.stderr: -241> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding con mode: crc 2024-09-12T00:56:34.000 INFO:tasks.workunit.client.0.smithi070.stderr: -240> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding con mode: secure 2024-09-12T00:56:34.001 INFO:tasks.workunit.client.0.smithi070.stderr: -239> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding con mode: crc 2024-09-12T00:56:34.001 INFO:tasks.workunit.client.0.smithi070.stderr: -238> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding con mode: crc 2024-09-12T00:56:34.001 INFO:tasks.workunit.client.0.smithi070.stderr: -237> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding con mode: secure 2024-09-12T00:56:34.001 INFO:tasks.workunit.client.0.smithi070.stderr: -236> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding con mode: crc 2024-09-12T00:56:34.001 INFO:tasks.workunit.client.0.smithi070.stderr: -235> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding con mode: secure 2024-09-12T00:56:34.001 INFO:tasks.workunit.client.0.smithi070.stderr: -234> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding con mode: crc 2024-09-12T00:56:34.001 INFO:tasks.workunit.client.0.smithi070.stderr: -233> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 AuthRegistry(0x56312e3659f0) adding con mode: secure 2024-09-12T00:56:34.001 INFO:tasks.workunit.client.0.smithi070.stderr: -232> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:34.001 INFO:tasks.workunit.client.0.smithi070.stderr: -231> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:34.001 INFO:tasks.workunit.client.0.smithi070.stderr: -230> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command rotate-key cmddesc rotate-key hook 0x56312e365b38 EEXIST 2024-09-12T00:56:34.001 INFO:tasks.workunit.client.0.smithi070.stderr: -229> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient: _reopen_session rank -1 2024-09-12T00:56:34.001 INFO:tasks.workunit.client.0.smithi070.stderr: -228> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:56:34.001 INFO:tasks.workunit.client.0.smithi070.stderr: -227> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): picked mon.noname-c con 0x56312e3b1b90 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:56:34.001 INFO:tasks.workunit.client.0.smithi070.stderr: -226> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): picked mon.noname-b con 0x56312e3b33f0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:56:34.002 INFO:tasks.workunit.client.0.smithi070.stderr: -225> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): picked mon.noname-a con 0x56312e3abcd0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:56:34.002 INFO:tasks.workunit.client.0.smithi070.stderr: -224> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:34.002 INFO:tasks.workunit.client.0.smithi070.stderr: -223> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:34.002 INFO:tasks.workunit.client.0.smithi070.stderr: -222> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:34.002 INFO:tasks.workunit.client.0.smithi070.stderr: -221> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): _renew_subs 2024-09-12T00:56:34.002 INFO:tasks.workunit.client.0.smithi070.stderr: -220> 2024-09-12T00:56:33.812+0000 7f58f8b969c0 10 monclient(hunting): authenticate will time out at 2244.263299s 2024-09-12T00:56:34.002 INFO:tasks.workunit.client.0.smithi070.stderr: -219> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): get_auth_request con 0x56312e3b1b90 auth_method 0 2024-09-12T00:56:34.002 INFO:tasks.workunit.client.0.smithi070.stderr: -218> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:34.002 INFO:tasks.workunit.client.0.smithi070.stderr: -217> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:34.002 INFO:tasks.workunit.client.0.smithi070.stderr: -216> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:34.002 INFO:tasks.workunit.client.0.smithi070.stderr: -215> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): get_auth_request con 0x56312e3abcd0 auth_method 0 2024-09-12T00:56:34.003 INFO:tasks.workunit.client.0.smithi070.stderr: -214> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:34.003 INFO:tasks.workunit.client.0.smithi070.stderr: -213> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:34.003 INFO:tasks.workunit.client.0.smithi070.stderr: -212> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:34.003 INFO:tasks.workunit.client.0.smithi070.stderr: -211> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:34.003 INFO:tasks.workunit.client.0.smithi070.stderr: -210> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:34.003 INFO:tasks.workunit.client.0.smithi070.stderr: -209> 2024-09-12T00:56:33.812+0000 7f58f669c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:34.003 INFO:tasks.workunit.client.0.smithi070.stderr: -208> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:34.003 INFO:tasks.workunit.client.0.smithi070.stderr: -207> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:34.003 INFO:tasks.workunit.client.0.smithi070.stderr: -206> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:34.003 INFO:tasks.workunit.client.0.smithi070.stderr: -205> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_done global_id 7398 payload 824 2024-09-12T00:56:34.003 INFO:tasks.workunit.client.0.smithi070.stderr: -204> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient: _finish_hunting 0 2024-09-12T00:56:34.003 INFO:tasks.workunit.client.0.smithi070.stderr: -203> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 1 monclient: found mon.noname-a 2024-09-12T00:56:34.003 INFO:tasks.workunit.client.0.smithi070.stderr: -202> 2024-09-12T00:56:33.812+0000 7f58f6e9d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:56:34.004 INFO:tasks.workunit.client.0.smithi070.stderr: -201> 2024-09-12T00:56:33.812+0000 7f57c7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:34.004 INFO:tasks.workunit.client.0.smithi070.stderr: -200> 2024-09-12T00:56:33.812+0000 7f57c7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:56:34.004 INFO:tasks.workunit.client.0.smithi070.stderr: -199> 2024-09-12T00:56:33.812+0000 7f57c7fff640 10 monclient: dump: 2024-09-12T00:56:34.004 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:56:34.004 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:56:34.004 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:34.004 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:34.004 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:34.004 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:56:34.004 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:56:34.004 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:56:34.004 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:56:34.005 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:34.005 INFO:tasks.workunit.client.0.smithi070.stderr: -198> 2024-09-12T00:56:33.816+0000 7f57c7fff640 10 monclient: _finish_auth 0 2024-09-12T00:56:34.005 INFO:tasks.workunit.client.0.smithi070.stderr: -197> 2024-09-12T00:56:33.816+0000 7f57c7fff640 10 monclient: _check_auth_tickets 2024-09-12T00:56:34.005 INFO:tasks.workunit.client.0.smithi070.stderr: -196> 2024-09-12T00:56:33.816+0000 7f57c7fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:56:34.005 INFO:tasks.workunit.client.0.smithi070.stderr: -195> 2024-09-12T00:56:33.816+0000 7f57c7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:34.005 INFO:tasks.workunit.client.0.smithi070.stderr: -194> 2024-09-12T00:56:33.816+0000 7f57c7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:56:34.005 INFO:tasks.workunit.client.0.smithi070.stderr: -193> 2024-09-12T00:56:33.816+0000 7f57c7fff640 10 monclient: dump: 2024-09-12T00:56:34.005 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:56:34.005 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:56:34.005 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:34.005 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:34.005 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:34.005 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:56:34.005 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:56:34.006 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:56:34.006 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:56:34.006 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:34.006 INFO:tasks.workunit.client.0.smithi070.stderr: -192> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 5 monclient: authenticate success, global_id 7398 2024-09-12T00:56:34.006 INFO:tasks.workunit.client.0.smithi070.stderr: -191> 2024-09-12T00:56:33.816+0000 7f57d9ffb640 4 set_mon_vals no callback set 2024-09-12T00:56:34.006 INFO:tasks.workunit.client.0.smithi070.stderr: -190> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 10 monclient: _renew_subs 2024-09-12T00:56:34.006 INFO:tasks.workunit.client.0.smithi070.stderr: -189> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:56:34.006 INFO:tasks.workunit.client.0.smithi070.stderr: -188> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 10 monclient: _renew_subs 2024-09-12T00:56:34.006 INFO:tasks.workunit.client.0.smithi070.stderr: -187> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:56:34.006 INFO:tasks.workunit.client.0.smithi070.stderr: -186> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 1 librados: init done 2024-09-12T00:56:34.006 INFO:tasks.workunit.client.0.smithi070.stderr: -185> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command cr dump hook 0x56312e3ab918 2024-09-12T00:56:34.006 INFO:tasks.workunit.client.0.smithi070.stderr: -184> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.006 INFO:tasks.workunit.client.0.smithi070.stderr: -183> 2024-09-12T00:56:33.816+0000 7f57c7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:56:34.006 INFO:tasks.workunit.client.0.smithi070.stderr: -182> 2024-09-12T00:56:33.816+0000 7f57c7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:56:34.007 INFO:tasks.workunit.client.0.smithi070.stderr: -181> 2024-09-12T00:56:33.816+0000 7f57c7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:56:34.007 INFO:tasks.workunit.client.0.smithi070.stderr: -180> 2024-09-12T00:56:33.816+0000 7f58f5e9b640 10 monclient: get_auth_request con 0x56312e3d1d90 auth_method 0 2024-09-12T00:56:34.007 INFO:tasks.workunit.client.0.smithi070.stderr: -179> 2024-09-12T00:56:33.816+0000 7f58f669c640 10 monclient: get_auth_request con 0x7f57c0070ae0 auth_method 0 2024-09-12T00:56:34.007 INFO:tasks.workunit.client.0.smithi070.stderr: -178> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:34.007 INFO:tasks.workunit.client.0.smithi070.stderr: -177> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 20 realm 2024-09-12T00:56:34.007 INFO:tasks.workunit.client.0.smithi070.stderr: -176> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.007 INFO:tasks.workunit.client.0.smithi070.stderr: -175> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:34.007 INFO:tasks.workunit.client.0.smithi070.stderr: -174> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:34.007 INFO:tasks.workunit.client.0.smithi070.stderr: -173> 2024-09-12T00:56:33.816+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.007 INFO:tasks.workunit.client.0.smithi070.stderr: -172> 2024-09-12T00:56:33.820+0000 7f58f8b969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:34.007 INFO:tasks.workunit.client.0.smithi070.stderr: -171> 2024-09-12T00:56:33.820+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.007 INFO:tasks.workunit.client.0.smithi070.stderr: -170> 2024-09-12T00:56:33.820+0000 7f58f669c640 10 monclient: get_auth_request con 0x56312e3d6050 auth_method 0 2024-09-12T00:56:34.007 INFO:tasks.workunit.client.0.smithi070.stderr: -169> 2024-09-12T00:56:33.820+0000 7f58f8b969c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:34.008 INFO:tasks.workunit.client.0.smithi070.stderr: -168> 2024-09-12T00:56:33.820+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.008 INFO:tasks.workunit.client.0.smithi070.stderr: -167> 2024-09-12T00:56:33.820+0000 7f58f5e9b640 10 monclient: get_auth_request con 0x56312e3d9750 auth_method 0 2024-09-12T00:56:34.008 INFO:tasks.workunit.client.0.smithi070.stderr: -166> 2024-09-12T00:56:33.820+0000 7f58f8b969c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:34.008 INFO:tasks.workunit.client.0.smithi070.stderr: -165> 2024-09-12T00:56:33.820+0000 7f58f8b969c0 20 searching for the correct realm 2024-09-12T00:56:34.008 INFO:tasks.workunit.client.0.smithi070.stderr: -164> 2024-09-12T00:56:33.820+0000 7f58f6e9d640 10 monclient: get_auth_request con 0x56312e3de450 auth_method 0 2024-09-12T00:56:34.008 INFO:tasks.workunit.client.0.smithi070.stderr: -163> 2024-09-12T00:56:33.820+0000 7f58f669c640 10 monclient: get_auth_request con 0x7f58f0057be0 auth_method 0 2024-09-12T00:56:34.008 INFO:tasks.workunit.client.0.smithi070.stderr: -162> 2024-09-12T00:56:33.824+0000 7f58f5e9b640 10 monclient: get_auth_request con 0x7f58e8061eb0 auth_method 0 2024-09-12T00:56:34.008 INFO:tasks.workunit.client.0.smithi070.stderr: -161> 2024-09-12T00:56:33.824+0000 7f58f6e9d640 10 monclient: get_auth_request con 0x7f58ec0e3040 auth_method 0 2024-09-12T00:56:34.008 INFO:tasks.workunit.client.0.smithi070.stderr: -160> 2024-09-12T00:56:33.824+0000 7f58f6e9d640 0 -- 172.21.15.70:0/2816844602 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f58ec0e3040 msgr2=0x7f58ec0e3420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:34.008 INFO:tasks.workunit.client.0.smithi070.stderr: -159> 2024-09-12T00:56:33.824+0000 7f57c7fff640 1 client.7398.objecter ms_handle_reset 0x7f58ec0e3040 session 0x7f58ec0da070 osd.4 2024-09-12T00:56:34.008 INFO:tasks.workunit.client.0.smithi070.stderr: -158> 2024-09-12T00:56:33.824+0000 7f57c7fff640 10 monclient: _renew_subs 2024-09-12T00:56:34.008 INFO:tasks.workunit.client.0.smithi070.stderr: -157> 2024-09-12T00:56:33.824+0000 7f57c7fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:56:34.008 INFO:tasks.workunit.client.0.smithi070.stderr: -156> 2024-09-12T00:56:33.824+0000 7f57c7fff640 10 monclient: ms_handle_reset current mon [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:56:34.008 INFO:tasks.workunit.client.0.smithi070.stderr: -155> 2024-09-12T00:56:33.824+0000 7f57c7fff640 10 monclient: _reopen_session rank -1 2024-09-12T00:56:34.009 INFO:tasks.workunit.client.0.smithi070.stderr: -154> 2024-09-12T00:56:33.824+0000 7f57c7fff640 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:56:34.009 INFO:tasks.workunit.client.0.smithi070.stderr: -153> 2024-09-12T00:56:33.824+0000 7f57c7fff640 10 monclient(hunting): picked mon.a con 0x7f58ec0e3040 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:56:34.009 INFO:tasks.workunit.client.0.smithi070.stderr: -152> 2024-09-12T00:56:33.824+0000 7f57c7fff640 10 monclient(hunting): picked mon.b con 0x56312e3b33f0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:56:34.009 INFO:tasks.workunit.client.0.smithi070.stderr: -151> 2024-09-12T00:56:33.824+0000 7f57c7fff640 10 monclient(hunting): picked mon.c con 0x56312e3b1b90 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:56:34.009 INFO:tasks.workunit.client.0.smithi070.stderr: -150> 2024-09-12T00:56:33.824+0000 7f57c7fff640 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:34.009 INFO:tasks.workunit.client.0.smithi070.stderr: -149> 2024-09-12T00:56:33.824+0000 7f57c7fff640 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:34.009 INFO:tasks.workunit.client.0.smithi070.stderr: -148> 2024-09-12T00:56:33.824+0000 7f57c7fff640 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:34.009 INFO:tasks.workunit.client.0.smithi070.stderr: -147> 2024-09-12T00:56:33.824+0000 7f57c7fff640 10 monclient(hunting): _renew_subs 2024-09-12T00:56:34.009 INFO:tasks.workunit.client.0.smithi070.stderr: -146> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 10 monclient(hunting): get_auth_request con 0x7f58ec0e3040 auth_method 0 2024-09-12T00:56:34.009 INFO:tasks.workunit.client.0.smithi070.stderr: -145> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:34.009 INFO:tasks.workunit.client.0.smithi070.stderr: -144> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:34.009 INFO:tasks.workunit.client.0.smithi070.stderr: -143> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T00:56:34.009 INFO:tasks.workunit.client.0.smithi070.stderr: -142> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 10 monclient(hunting): get_auth_request con 0x7f57c00808e0 auth_method 0 2024-09-12T00:56:34.010 INFO:tasks.workunit.client.0.smithi070.stderr: -141> 2024-09-12T00:56:33.828+0000 7f58f5e9b640 10 monclient(hunting): get_auth_request con 0x56312e3b1b90 auth_method 0 2024-09-12T00:56:34.010 INFO:tasks.workunit.client.0.smithi070.stderr: -140> 2024-09-12T00:56:33.828+0000 7f58f5e9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:34.010 INFO:tasks.workunit.client.0.smithi070.stderr: -139> 2024-09-12T00:56:33.828+0000 7f58f5e9b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:34.010 INFO:tasks.workunit.client.0.smithi070.stderr: -138> 2024-09-12T00:56:33.828+0000 7f58f5e9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T00:56:34.010 INFO:tasks.workunit.client.0.smithi070.stderr: -137> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:34.010 INFO:tasks.workunit.client.0.smithi070.stderr: -136> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:34.010 INFO:tasks.workunit.client.0.smithi070.stderr: -135> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T00:56:34.010 INFO:tasks.workunit.client.0.smithi070.stderr: -134> 2024-09-12T00:56:33.828+0000 7f58f5e9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:34.010 INFO:tasks.workunit.client.0.smithi070.stderr: -133> 2024-09-12T00:56:33.828+0000 7f58f5e9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:34.010 INFO:tasks.workunit.client.0.smithi070.stderr: -132> 2024-09-12T00:56:33.828+0000 7f58f5e9b640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T00:56:34.010 INFO:tasks.workunit.client.0.smithi070.stderr: -131> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 10 monclient(hunting): handle_auth_done global_id 7398 payload 293 2024-09-12T00:56:34.010 INFO:tasks.workunit.client.0.smithi070.stderr: -130> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 10 monclient: _finish_hunting 0 2024-09-12T00:56:34.010 INFO:tasks.workunit.client.0.smithi070.stderr: -129> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 1 monclient: found mon.a 2024-09-12T00:56:34.010 INFO:tasks.workunit.client.0.smithi070.stderr: -128> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:56:34.011 INFO:tasks.workunit.client.0.smithi070.stderr: -127> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 10 monclient: _finish_auth 0 2024-09-12T00:56:34.011 INFO:tasks.workunit.client.0.smithi070.stderr: -126> 2024-09-12T00:56:33.828+0000 7f58f6e9d640 10 monclient: _check_auth_tickets 2024-09-12T00:56:34.011 INFO:tasks.workunit.client.0.smithi070.stderr: -125> 2024-09-12T00:56:33.828+0000 7f58f669c640 10 monclient: get_auth_request con 0x56312e3b33f0 auth_method 0 2024-09-12T00:56:34.011 INFO:tasks.workunit.client.0.smithi070.stderr: -124> 2024-09-12T00:56:33.828+0000 7f57c7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:34.011 INFO:tasks.workunit.client.0.smithi070.stderr: -123> 2024-09-12T00:56:33.828+0000 7f57c7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:56:34.011 INFO:tasks.workunit.client.0.smithi070.stderr: -122> 2024-09-12T00:56:33.828+0000 7f57c7fff640 10 monclient: dump: 2024-09-12T00:56:34.011 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:56:34.011 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:56:34.011 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:34.011 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:56:34.011 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:34.011 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:56:34.011 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:56:34.011 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:56:34.012 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:56:34.012 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:34.012 INFO:tasks.workunit.client.0.smithi070.stderr: -121> 2024-09-12T00:56:33.828+0000 7f57c7fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:56:34.012 INFO:tasks.workunit.client.0.smithi070.stderr: -120> 2024-09-12T00:56:33.828+0000 7f57d97fa640 4 set_mon_vals no callback set 2024-09-12T00:56:34.012 INFO:tasks.workunit.client.0.smithi070.stderr: -119> 2024-09-12T00:56:33.828+0000 7f57c7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:56:34.012 INFO:tasks.workunit.client.0.smithi070.stderr: -118> 2024-09-12T00:56:33.828+0000 7f57c7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:56:34.012 INFO:tasks.workunit.client.0.smithi070.stderr: -117> 2024-09-12T00:56:33.828+0000 7f58f669c640 10 monclient: get_auth_request con 0x7f58f00a6a10 auth_method 0 2024-09-12T00:56:34.012 INFO:tasks.workunit.client.0.smithi070.stderr: -116> 2024-09-12T00:56:33.828+0000 7f58f669c640 0 -- 172.21.15.70:0/2816844602 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f58f00a6a10 msgr2=0x7f58f00a8e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:56:34.012 INFO:tasks.workunit.client.0.smithi070.stderr: -115> 2024-09-12T00:56:33.828+0000 7f57c7fff640 1 client.7398.objecter ms_handle_reset 0x7f58f00a6a10 session 0x7f58f000fe90 osd.6 2024-09-12T00:56:34.012 INFO:tasks.workunit.client.0.smithi070.stderr: -114> 2024-09-12T00:56:33.828+0000 7f58f669c640 10 monclient: get_auth_request con 0x56312e3abcd0 auth_method 0 2024-09-12T00:56:34.012 INFO:tasks.workunit.client.0.smithi070.stderr: -113> 2024-09-12T00:56:33.840+0000 7f58f8b969c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:34.012 INFO:tasks.workunit.client.0.smithi070.stderr: -112> 2024-09-12T00:56:33.840+0000 7f58f8b969c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:56:34.012 INFO:tasks.workunit.client.0.smithi070.stderr: -111> 2024-09-12T00:56:33.840+0000 7f58f8b969c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:34.013 INFO:tasks.workunit.client.0.smithi070.stderr: -110> 2024-09-12T00:56:33.840+0000 7f58f8b969c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:56:34.013 INFO:tasks.workunit.client.0.smithi070.stderr: -109> 2024-09-12T00:56:33.840+0000 7f58f8b969c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:34.013 INFO:tasks.workunit.client.0.smithi070.stderr: -108> 2024-09-12T00:56:33.840+0000 7f58f8b969c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:34.013 INFO:tasks.workunit.client.0.smithi070.stderr: -107> 2024-09-12T00:56:33.840+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.013 INFO:tasks.workunit.client.0.smithi070.stderr: -106> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:34.013 INFO:tasks.workunit.client.0.smithi070.stderr: -105> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.013 INFO:tasks.workunit.client.0.smithi070.stderr: -104> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:34.013 INFO:tasks.workunit.client.0.smithi070.stderr: -103> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.013 INFO:tasks.workunit.client.0.smithi070.stderr: -102> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:34.013 INFO:tasks.workunit.client.0.smithi070.stderr: -101> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 zone default found 2024-09-12T00:56:34.013 INFO:tasks.workunit.client.0.smithi070.stderr: -100> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 4 Realm: () 2024-09-12T00:56:34.014 INFO:tasks.workunit.client.0.smithi070.stderr: -99> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:56:34.014 INFO:tasks.workunit.client.0.smithi070.stderr: -98> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:56:34.014 INFO:tasks.workunit.client.0.smithi070.stderr: -97> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:34.014 INFO:tasks.workunit.client.0.smithi070.stderr: -96> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 zonegroup default 2024-09-12T00:56:34.014 INFO:tasks.workunit.client.0.smithi070.stderr: -95> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.014 INFO:tasks.workunit.client.0.smithi070.stderr: -94> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:34.014 INFO:tasks.workunit.client.0.smithi070.stderr: -93> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.014 INFO:tasks.workunit.client.0.smithi070.stderr: -92> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:34.014 INFO:tasks.workunit.client.0.smithi070.stderr: -91> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.014 INFO:tasks.workunit.client.0.smithi070.stderr: -90> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:34.014 INFO:tasks.workunit.client.0.smithi070.stderr: -89> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 started sync module instance, tier type = 2024-09-12T00:56:34.014 INFO:tasks.workunit.client.0.smithi070.stderr: -88> 2024-09-12T00:56:33.844+0000 7f58f8b969c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:56:34.014 INFO:tasks.workunit.client.0.smithi070.stderr: -87> 2024-09-12T00:56:33.860+0000 7f58f8b969c0 20 add_watcher() i=0 2024-09-12T00:56:34.014 INFO:tasks.workunit.client.0.smithi070.stderr: -86> 2024-09-12T00:56:33.860+0000 7f58f8b969c0 20 add_watcher() i=1 2024-09-12T00:56:34.015 INFO:tasks.workunit.client.0.smithi070.stderr: -85> 2024-09-12T00:56:33.860+0000 7f58f8b969c0 20 add_watcher() i=2 2024-09-12T00:56:34.015 INFO:tasks.workunit.client.0.smithi070.stderr: -84> 2024-09-12T00:56:33.860+0000 7f58f8b969c0 20 add_watcher() i=3 2024-09-12T00:56:34.015 INFO:tasks.workunit.client.0.smithi070.stderr: -83> 2024-09-12T00:56:33.860+0000 7f58f8b969c0 20 add_watcher() i=4 2024-09-12T00:56:34.015 INFO:tasks.workunit.client.0.smithi070.stderr: -82> 2024-09-12T00:56:33.860+0000 7f58f8b969c0 20 add_watcher() i=5 2024-09-12T00:56:34.015 INFO:tasks.workunit.client.0.smithi070.stderr: -81> 2024-09-12T00:56:33.860+0000 7f58f8b969c0 20 add_watcher() i=6 2024-09-12T00:56:34.015 INFO:tasks.workunit.client.0.smithi070.stderr: -80> 2024-09-12T00:56:33.860+0000 7f58f8b969c0 20 add_watcher() i=7 2024-09-12T00:56:34.015 INFO:tasks.workunit.client.0.smithi070.stderr: -79> 2024-09-12T00:56:33.860+0000 7f58f8b969c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:34.015 INFO:tasks.workunit.client.0.smithi070.stderr: -78> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding auth protocol: cephx 2024-09-12T00:56:34.015 INFO:tasks.workunit.client.0.smithi070.stderr: -77> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding auth protocol: cephx 2024-09-12T00:56:34.015 INFO:tasks.workunit.client.0.smithi070.stderr: -76> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding auth protocol: cephx 2024-09-12T00:56:34.015 INFO:tasks.workunit.client.0.smithi070.stderr: -75> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding con mode: secure 2024-09-12T00:56:34.015 INFO:tasks.workunit.client.0.smithi070.stderr: -74> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding con mode: crc 2024-09-12T00:56:34.015 INFO:tasks.workunit.client.0.smithi070.stderr: -73> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding con mode: secure 2024-09-12T00:56:34.015 INFO:tasks.workunit.client.0.smithi070.stderr: -72> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding con mode: crc 2024-09-12T00:56:34.016 INFO:tasks.workunit.client.0.smithi070.stderr: -71> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding con mode: secure 2024-09-12T00:56:34.016 INFO:tasks.workunit.client.0.smithi070.stderr: -70> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding con mode: crc 2024-09-12T00:56:34.016 INFO:tasks.workunit.client.0.smithi070.stderr: -69> 2024-09-12T00:56:33.864+0000 7f57ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:34.016 INFO:tasks.workunit.client.0.smithi070.stderr: -68> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding con mode: crc 2024-09-12T00:56:34.016 INFO:tasks.workunit.client.0.smithi070.stderr: -67> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding con mode: secure 2024-09-12T00:56:34.016 INFO:tasks.workunit.client.0.smithi070.stderr: -66> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding con mode: crc 2024-09-12T00:56:34.016 INFO:tasks.workunit.client.0.smithi070.stderr: -65> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding con mode: secure 2024-09-12T00:56:34.016 INFO:tasks.workunit.client.0.smithi070.stderr: -64> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding con mode: crc 2024-09-12T00:56:34.016 INFO:tasks.workunit.client.0.smithi070.stderr: -63> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 AuthRegistry(0x7ffddf9d3af0) adding con mode: secure 2024-09-12T00:56:34.016 INFO:tasks.workunit.client.0.smithi070.stderr: -62> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:34.016 INFO:tasks.workunit.client.0.smithi070.stderr: -61> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:34.016 INFO:tasks.workunit.client.0.smithi070.stderr: -60> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:34.016 INFO:tasks.workunit.client.0.smithi070.stderr: -59> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command cache list hook 0x56312e3b0570 2024-09-12T00:56:34.016 INFO:tasks.workunit.client.0.smithi070.stderr: -58> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command cache inspect hook 0x56312e3b0570 2024-09-12T00:56:34.017 INFO:tasks.workunit.client.0.smithi070.stderr: -57> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command cache erase hook 0x56312e3b0570 2024-09-12T00:56:34.017 INFO:tasks.workunit.client.0.smithi070.stderr: -56> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command cache zap hook 0x56312e3b0570 2024-09-12T00:56:34.017 INFO:tasks.workunit.client.0.smithi070.stderr: -55> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 note: GC not initialized 2024-09-12T00:56:34.017 INFO:tasks.workunit.client.0.smithi070.stderr: -54> 2024-09-12T00:56:33.864+0000 7f57a77fe640 20 reqs_thread_entry: start 2024-09-12T00:56:34.017 INFO:tasks.workunit.client.0.smithi070.stderr: -53> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command sync trace show hook 0x7f58f00045f0 2024-09-12T00:56:34.017 INFO:tasks.workunit.client.0.smithi070.stderr: -52> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command sync trace history hook 0x7f58f00045f0 2024-09-12T00:56:34.017 INFO:tasks.workunit.client.0.smithi070.stderr: -51> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command sync trace active hook 0x7f58f00045f0 2024-09-12T00:56:34.017 INFO:tasks.workunit.client.0.smithi070.stderr: -50> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 5 asok(0x56312e0da2b0) register_command sync trace active_short hook 0x7f58f00045f0 2024-09-12T00:56:34.017 INFO:tasks.workunit.client.0.smithi070.stderr: -49> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 20 init_complete bucket index max shards: 1 2024-09-12T00:56:34.017 INFO:tasks.workunit.client.0.smithi070.stderr: -48> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 20 Filter name: none 2024-09-12T00:56:34.017 INFO:tasks.workunit.client.0.smithi070.stderr: -47> 2024-09-12T00:56:33.864+0000 7f57a57fa640 20 reqs_thread_entry: start 2024-09-12T00:56:34.017 INFO:tasks.workunit.client.0.smithi070.stderr: -46> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:56:34.017 INFO:tasks.workunit.client.0.smithi070.stderr: -45> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.018 INFO:tasks.workunit.client.0.smithi070.stderr: -44> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:56:34.018 INFO:tasks.workunit.client.0.smithi070.stderr: -43> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:56:34.018 INFO:tasks.workunit.client.0.smithi070.stderr: -42> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:56:34.018 INFO:tasks.workunit.client.0.smithi070.stderr: -41> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 : miss 2024-09-12T00:56:34.018 INFO:tasks.workunit.client.0.smithi070.stderr: -40> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.018 INFO:tasks.workunit.client.0.smithi070.stderr: -39> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:56:34.018 INFO:tasks.workunit.client.0.smithi070.stderr: -38> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 info.flags=0x17 2024-09-12T00:56:34.018 INFO:tasks.workunit.client.0.smithi070.stderr: -37> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 to cache LRU end 2024-09-12T00:56:34.018 INFO:tasks.workunit.client.0.smithi070.stderr: -36> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:34.018 INFO:tasks.workunit.client.0.smithi070.stderr: -35> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:34.018 INFO:tasks.workunit.client.0.smithi070.stderr: -34> 2024-09-12T00:56:33.864+0000 7f58f8b969c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 2024-09-12T00:56:34.018 INFO:tasks.workunit.client.0.smithi070.stderr: -33> 2024-09-12T00:56:33.876+0000 7f58f8b969c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 info.flags=0x17 2024-09-12T00:56:34.018 INFO:tasks.workunit.client.0.smithi070.stderr: -32> 2024-09-12T00:56:33.876+0000 7f58f8b969c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 to cache LRU end 2024-09-12T00:56:34.018 INFO:tasks.workunit.client.0.smithi070.stderr: -31> 2024-09-12T00:56:33.876+0000 7f58f8b969c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:34.018 INFO:tasks.workunit.client.0.smithi070.stderr: -30> 2024-09-12T00:56:33.876+0000 7f58f8b969c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33, ofs0, ns] 2024-09-12T00:56:34.019 INFO:tasks.workunit.client.0.smithi070.stderr: -29> 2024-09-12T00:56:33.876+0000 7f57d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431611 cookie 94769229095424 notifier 7398 bl.length()=1015 2024-09-12T00:56:34.019 INFO:tasks.workunit.client.0.smithi070.stderr: -28> 2024-09-12T00:56:33.876+0000 7f57d97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 info.flags=0x17 2024-09-12T00:56:34.019 INFO:tasks.workunit.client.0.smithi070.stderr: -27> 2024-09-12T00:56:33.876+0000 7f57d97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 to cache LRU end 2024-09-12T00:56:34.019 INFO:tasks.workunit.client.0.smithi070.stderr: -26> 2024-09-12T00:56:33.876+0000 7f57d97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:34.019 INFO:tasks.workunit.client.0.smithi070.stderr: -25> 2024-09-12T00:56:33.876+0000 7f58f8b969c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): orig_sources= new_sources= 2024-09-12T00:56:34.019 INFO:tasks.workunit.client.0.smithi070.stderr: -24> 2024-09-12T00:56:33.876+0000 7f58f8b969c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): potential sources added=[] removed=[] 2024-09-12T00:56:34.019 INFO:tasks.workunit.client.0.smithi070.stderr: -23> 2024-09-12T00:56:33.876+0000 7f58f8b969c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): orig_dests= new_dests= 2024-09-12T00:56:34.019 INFO:tasks.workunit.client.0.smithi070.stderr: -22> 2024-09-12T00:56:33.876+0000 7f58f8b969c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): potential dests added=[] removed=[] 2024-09-12T00:56:34.019 INFO:tasks.workunit.client.0.smithi070.stderr: -21> 2024-09-12T00:56:33.884+0000 7f58f8b969c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33.1.0 2024-09-12T00:56:34.019 INFO:tasks.workunit.client.0.smithi070.stderr: -20> 2024-09-12T00:56:33.884+0000 7f58f8b969c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33.1.0 2024-09-12T00:56:34.019 INFO:tasks.workunit.client.0.smithi070.stderr: -19> 2024-09-12T00:56:33.884+0000 7f58f8b969c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33.1.1 2024-09-12T00:56:34.019 INFO:tasks.workunit.client.0.smithi070.stderr: -18> 2024-09-12T00:56:33.884+0000 7f58f8b969c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33.1.1 2024-09-12T00:56:34.019 INFO:tasks.workunit.client.0.smithi070.stderr: -17> 2024-09-12T00:56:33.884+0000 7f58f8b969c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33.0 2024-09-12T00:56:34.020 INFO:tasks.workunit.client.0.smithi070.stderr: -16> 2024-09-12T00:56:33.888+0000 7f58f8b969c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:56:34.020 INFO:tasks.workunit.client.0.smithi070.stderr: -15> 2024-09-12T00:56:33.888+0000 7f58f8b969c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 2024-09-12T00:56:34.020 INFO:tasks.workunit.client.0.smithi070.stderr: -14> 2024-09-12T00:56:33.888+0000 7f58f8b969c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 info.flags=0x17 2024-09-12T00:56:34.020 INFO:tasks.workunit.client.0.smithi070.stderr: -13> 2024-09-12T00:56:33.888+0000 7f58f8b969c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 to cache LRU end 2024-09-12T00:56:34.020 INFO:tasks.workunit.client.0.smithi070.stderr: -12> 2024-09-12T00:56:33.888+0000 7f58f8b969c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:34.020 INFO:tasks.workunit.client.0.smithi070.stderr: -11> 2024-09-12T00:56:33.888+0000 7f58f8b969c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33, ofs0, ns] 2024-09-12T00:56:34.020 INFO:tasks.workunit.client.0.smithi070.stderr: -10> 2024-09-12T00:56:33.892+0000 7f57d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431612 cookie 94769229095424 notifier 7398 bl.length()=1015 2024-09-12T00:56:34.020 INFO:tasks.workunit.client.0.smithi070.stderr: -9> 2024-09-12T00:56:33.892+0000 7f57d97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 info.flags=0x17 2024-09-12T00:56:34.020 INFO:tasks.workunit.client.0.smithi070.stderr: -8> 2024-09-12T00:56:33.892+0000 7f57d97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 to cache LRU end 2024-09-12T00:56:34.020 INFO:tasks.workunit.client.0.smithi070.stderr: -7> 2024-09-12T00:56:33.892+0000 7f57d97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:56:34.020 INFO:tasks.workunit.client.0.smithi070.stderr: -6> 2024-09-12T00:56:33.892+0000 7f58f8b969c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): orig_sources= new_sources= 2024-09-12T00:56:34.020 INFO:tasks.workunit.client.0.smithi070.stderr: -5> 2024-09-12T00:56:33.892+0000 7f58f8b969c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): potential sources added=[] removed=[] 2024-09-12T00:56:34.020 INFO:tasks.workunit.client.0.smithi070.stderr: -4> 2024-09-12T00:56:33.892+0000 7f58f8b969c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): orig_dests= new_dests= 2024-09-12T00:56:34.021 INFO:tasks.workunit.client.0.smithi070.stderr: -3> 2024-09-12T00:56:33.892+0000 7f58f8b969c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): potential dests added=[] removed=[] 2024-09-12T00:56:34.021 INFO:tasks.workunit.client.0.smithi070.stderr: -2> 2024-09-12T00:56:33.896+0000 7f58f8b969c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33.0 2024-09-12T00:56:34.021 INFO:tasks.workunit.client.0.smithi070.stderr: -1> 2024-09-12T00:56:33.896+0000 7f58f8b969c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f58f8b969c0 time 2024-09-12T00:56:33.900273+0000 2024-09-12T00:56:34.021 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:56:34.021 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:34.021 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:56:34.021 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f58fc4702eb] 2024-09-12T00:56:34.021 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f58fc47049f] 2024-09-12T00:56:34.021 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56312bf47cc1] 2024-09-12T00:56:34.021 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x56312bf5cfc7] 2024-09-12T00:56:34.021 INFO:tasks.workunit.client.0.smithi070.stderr: 5: main() 2024-09-12T00:56:34.021 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f58fb2d6d90] 2024-09-12T00:56:34.021 INFO:tasks.workunit.client.0.smithi070.stderr: 7: __libc_start_main() 2024-09-12T00:56:34.021 INFO:tasks.workunit.client.0.smithi070.stderr: 8: _start() 2024-09-12T00:56:34.022 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:34.022 INFO:tasks.workunit.client.0.smithi070.stderr: 0> 2024-09-12T00:56:33.896+0000 7f58f8b969c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:56:34.022 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f58f8b969c0 thread_name:radosgw-admin 2024-09-12T00:56:34.022 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:34.022 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:56:34.022 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f58fb2ef520] 2024-09-12T00:56:34.022 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:56:34.022 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:56:34.022 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:56:34.022 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f58fc470345] 2024-09-12T00:56:34.022 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f58fc47049f] 2024-09-12T00:56:34.022 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56312bf47cc1] 2024-09-12T00:56:34.022 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x56312bf5cfc7] 2024-09-12T00:56:34.022 INFO:tasks.workunit.client.0.smithi070.stderr: 9: main() 2024-09-12T00:56:34.023 INFO:tasks.workunit.client.0.smithi070.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f58fb2d6d90] 2024-09-12T00:56:34.023 INFO:tasks.workunit.client.0.smithi070.stderr: 11: __libc_start_main() 2024-09-12T00:56:34.023 INFO:tasks.workunit.client.0.smithi070.stderr: 12: _start() 2024-09-12T00:56:34.023 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:56:34.023 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:34.023 INFO:tasks.workunit.client.0.smithi070.stderr:--- logging levels --- 2024-09-12T00:56:34.023 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 none 2024-09-12T00:56:34.023 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 lockdep 2024-09-12T00:56:34.023 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 context 2024-09-12T00:56:34.023 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 crush 2024-09-12T00:56:34.023 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds 2024-09-12T00:56:34.023 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_balancer 2024-09-12T00:56:34.023 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_locker 2024-09-12T00:56:34.024 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log 2024-09-12T00:56:34.024 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log_expire 2024-09-12T00:56:34.024 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_migrator 2024-09-12T00:56:34.024 INFO:tasks.workunit.client.0.smithi070.stderr: 3/ 5 mds_quiesce 2024-09-12T00:56:34.024 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 buffer 2024-09-12T00:56:34.024 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 timer 2024-09-12T00:56:34.024 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 filer 2024-09-12T00:56:34.024 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 striper 2024-09-12T00:56:34.024 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 objecter 2024-09-12T00:56:34.024 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rados 2024-09-12T00:56:34.024 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd 2024-09-12T00:56:34.024 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_mirror 2024-09-12T00:56:34.024 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_replay 2024-09-12T00:56:34.025 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_pwl 2024-09-12T00:56:34.025 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 journaler 2024-09-12T00:56:34.025 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objectcacher 2024-09-12T00:56:34.025 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:56:34.025 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 client 2024-09-12T00:56:34.025 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 osd 2024-09-12T00:56:34.025 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 optracker 2024-09-12T00:56:34.025 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objclass 2024-09-12T00:56:34.025 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 filestore 2024-09-12T00:56:34.025 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 journal 2024-09-12T00:56:34.025 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 ms 2024-09-12T00:56:34.025 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mon 2024-09-12T00:56:34.025 INFO:tasks.workunit.client.0.smithi070.stderr: 0/10 monc 2024-09-12T00:56:34.026 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 paxos 2024-09-12T00:56:34.026 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 tp 2024-09-12T00:56:34.026 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 auth 2024-09-12T00:56:34.026 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 crypto 2024-09-12T00:56:34.026 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 finisher 2024-09-12T00:56:34.026 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 reserver 2024-09-12T00:56:34.026 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 heartbeatmap 2024-09-12T00:56:34.026 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 perfcounter 2024-09-12T00:56:34.026 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw 2024-09-12T00:56:34.026 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_sync 2024-09-12T00:56:34.026 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_datacache 2024-09-12T00:56:34.026 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_access 2024-09-12T00:56:34.026 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:56:34.026 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_flight 2024-09-12T00:56:34.027 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:56:34.027 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw_notification 2024-09-12T00:56:34.027 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 javaclient 2024-09-12T00:56:34.027 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 asok 2024-09-12T00:56:34.027 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 throttle 2024-09-12T00:56:34.027 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 refs 2024-09-12T00:56:34.027 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 compressor 2024-09-12T00:56:34.027 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluestore 2024-09-12T00:56:34.027 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluefs 2024-09-12T00:56:34.027 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 bdev 2024-09-12T00:56:34.027 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 kstore 2024-09-12T00:56:34.027 INFO:tasks.workunit.client.0.smithi070.stderr: 4/ 5 rocksdb 2024-09-12T00:56:34.027 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 fuse 2024-09-12T00:56:34.027 INFO:tasks.workunit.client.0.smithi070.stderr: 2/ 5 mgr 2024-09-12T00:56:34.028 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mgrc 2024-09-12T00:56:34.028 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 dpdk 2024-09-12T00:56:34.028 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 eventtrace 2024-09-12T00:56:34.028 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 prioritycache 2024-09-12T00:56:34.028 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 test 2024-09-12T00:56:34.028 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:56:34.028 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephsqlite 2024-09-12T00:56:34.028 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:56:34.028 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore 2024-09-12T00:56:34.028 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_onode 2024-09-12T00:56:34.028 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_odata 2024-09-12T00:56:34.028 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_omap 2024-09-12T00:56:34.028 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_tm 2024-09-12T00:56:34.029 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_t 2024-09-12T00:56:34.029 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:56:34.029 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_epm 2024-09-12T00:56:34.029 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_lba 2024-09-12T00:56:34.029 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:56:34.029 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cache 2024-09-12T00:56:34.029 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_journal 2024-09-12T00:56:34.029 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_device 2024-09-12T00:56:34.029 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_backref 2024-09-12T00:56:34.029 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 alienstore 2024-09-12T00:56:34.029 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mclock 2024-09-12T00:56:34.029 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cyanstore 2024-09-12T00:56:34.029 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 ceph_exporter 2024-09-12T00:56:34.029 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 memstore 2024-09-12T00:56:34.029 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 trace 2024-09-12T00:56:34.030 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 ceph_dedup 2024-09-12T00:56:34.030 INFO:tasks.workunit.client.0.smithi070.stderr: -2/-2 (syslog threshold) 2024-09-12T00:56:34.030 INFO:tasks.workunit.client.0.smithi070.stderr: 99/99 (stderr threshold) 2024-09-12T00:56:34.030 INFO:tasks.workunit.client.0.smithi070.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:56:34.030 INFO:tasks.workunit.client.0.smithi070.stderr: 7f57a57fa640 / http_manager 2024-09-12T00:56:34.030 INFO:tasks.workunit.client.0.smithi070.stderr: 7f57a77fe640 / http_manager 2024-09-12T00:56:34.030 INFO:tasks.workunit.client.0.smithi070.stderr: 7f57ad7e2640 / rgw_dt_lg_renew 2024-09-12T00:56:34.030 INFO:tasks.workunit.client.0.smithi070.stderr: 7f57c7fff640 / ms_dispatch 2024-09-12T00:56:34.030 INFO:tasks.workunit.client.0.smithi070.stderr: 7f57d97fa640 / io_context_pool 2024-09-12T00:56:34.030 INFO:tasks.workunit.client.0.smithi070.stderr: 7f57d9ffb640 / io_context_pool 2024-09-12T00:56:34.030 INFO:tasks.workunit.client.0.smithi070.stderr: 7f57dbfff640 / ms_dispatch 2024-09-12T00:56:34.030 INFO:tasks.workunit.client.0.smithi070.stderr: 7f57e2e05640 / ms_dispatch 2024-09-12T00:56:34.030 INFO:tasks.workunit.client.0.smithi070.stderr: 7f57e4608640 / io_context_pool 2024-09-12T00:56:34.030 INFO:tasks.workunit.client.0.smithi070.stderr: 7f58f5e9b640 / msgr-worker-2 2024-09-12T00:56:34.031 INFO:tasks.workunit.client.0.smithi070.stderr: 7f58f669c640 / msgr-worker-1 2024-09-12T00:56:34.031 INFO:tasks.workunit.client.0.smithi070.stderr: 7f58f6e9d640 / msgr-worker-0 2024-09-12T00:56:34.031 INFO:tasks.workunit.client.0.smithi070.stderr: 7f58f769e640 / io_context_pool 2024-09-12T00:56:34.031 INFO:tasks.workunit.client.0.smithi070.stderr: 7f58f8b969c0 / radosgw-admin 2024-09-12T00:56:34.031 INFO:tasks.workunit.client.0.smithi070.stderr: max_recent 500 2024-09-12T00:56:34.031 INFO:tasks.workunit.client.0.smithi070.stderr: max_new 1000 2024-09-12T00:56:34.031 INFO:tasks.workunit.client.0.smithi070.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:56:33.902367Z_7f9ba7fc-06ae-46d7-aff9-713d0ab7c420/log 2024-09-12T00:56:34.031 INFO:tasks.workunit.client.0.smithi070.stderr:--- end dump of recent events --- 2024-09-12T00:56:34.031 INFO:tasks.workunit.client.0.smithi070.stderr:Aborted 2024-09-12T00:56:34.031 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:56:34.033 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:34.033 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:34.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.980+0000 7f47f65cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.980+0000 7f47f65cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:34.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.980+0000 7f47f65cf9c0 20 realm 2024-09-12T00:56:34.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.980+0000 7f47f65cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.980+0000 7f47f65cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:34.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.980+0000 7f47f65cf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:34.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.980+0000 7f47f65cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.980+0000 7f47f65cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:34.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.980+0000 7f47f65cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.984+0000 7f47f65cf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:34.034 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.984+0000 7f47f65cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.034 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.984+0000 7f47f65cf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:34.034 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.984+0000 7f47f65cf9c0 20 searching for the correct realm 2024-09-12T00:56:34.034 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:33.988+0000 7f47f48d6640 0 -- 172.21.15.70:0/677265484 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f47e8137050 msgr2=0x7f47e81263b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:34.198 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.204+0000 7f47f48d6640 0 -- 172.21.15.70:0/677265484 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f47e8137050 msgr2=0x7f47e81263b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:34.210 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.216+0000 7f47f65cf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:34.210 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.216+0000 7f47f65cf9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:56:34.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.216+0000 7f47f65cf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:34.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.216+0000 7f47f65cf9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:56:34.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.216+0000 7f47f65cf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:34.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.216+0000 7f47f65cf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:34.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.216+0000 7f47f65cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.216+0000 7f47f65cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:34.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.216+0000 7f47f65cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.216+0000 7f47f65cf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:34.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.216+0000 7f47f65cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.212 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.220+0000 7f47f65cf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:34.212 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.220+0000 7f47f65cf9c0 20 zone default found 2024-09-12T00:56:34.212 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.220+0000 7f47f65cf9c0 4 Realm: () 2024-09-12T00:56:34.212 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.220+0000 7f47f65cf9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:56:34.212 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.220+0000 7f47f65cf9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:56:34.212 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.220+0000 7f47f65cf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:34.212 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.220+0000 7f47f65cf9c0 20 zonegroup default 2024-09-12T00:56:34.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.220+0000 7f47f65cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.220+0000 7f47f65cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:34.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.220+0000 7f47f65cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.220+0000 7f47f65cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:34.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.220+0000 7f47f65cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.220+0000 7f47f65cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:34.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.220+0000 7f47f65cf9c0 20 started sync module instance, tier type = 2024-09-12T00:56:34.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.220+0000 7f47f65cf9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:56:34.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.244+0000 7f47f65cf9c0 20 add_watcher() i=0 2024-09-12T00:56:34.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.244+0000 7f47f65cf9c0 20 add_watcher() i=1 2024-09-12T00:56:34.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.244+0000 7f47f65cf9c0 20 add_watcher() i=2 2024-09-12T00:56:34.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.244+0000 7f47f65cf9c0 20 add_watcher() i=3 2024-09-12T00:56:34.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.244+0000 7f47f65cf9c0 20 add_watcher() i=4 2024-09-12T00:56:34.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.244+0000 7f47f65cf9c0 20 add_watcher() i=5 2024-09-12T00:56:34.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.244+0000 7f47f65cf9c0 20 add_watcher() i=6 2024-09-12T00:56:34.240 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.248+0000 7f47f65cf9c0 20 add_watcher() i=7 2024-09-12T00:56:34.240 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.248+0000 7f47f65cf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:34.243 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.248+0000 7f46aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:34.244 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.252+0000 7f47f65cf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:34.244 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.252+0000 7f47f65cf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:34.244 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.252+0000 7f47f65cf9c0 5 note: GC not initialized 2024-09-12T00:56:34.245 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.252+0000 7f46a9fdb640 20 reqs_thread_entry: start 2024-09-12T00:56:34.245 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.252+0000 7f47f65cf9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:56:34.245 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.252+0000 7f47f65cf9c0 20 Filter name: none 2024-09-12T00:56:34.245 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.252+0000 7f461b7fe640 20 reqs_thread_entry: start 2024-09-12T00:56:34.245 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.252+0000 7f47f65cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.252+0000 7f47f65cf9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:56:34.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.252+0000 7f47f65cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.252+0000 7f47f65cf9c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:56:34.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.252+0000 7f47f65cf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:56:34.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.252+0000 7f47f65cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.252+0000 7f47f65cf9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:56:34.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.252+0000 7f47f65cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:56:34.248 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.256+0000 7f47f65cf9c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:56:34.248 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.256+0000 7f47f65cf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:56:34.251 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.256+0000 7f46aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:34.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.264+0000 7f47f65cf9c0 20 remove_watcher() i=0 2024-09-12T00:56:34.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.264+0000 7f47f65cf9c0 2 removed watcher, disabling cache 2024-09-12T00:56:34.258 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.264+0000 7f47f65cf9c0 20 remove_watcher() i=1 2024-09-12T00:56:34.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.268+0000 7f47f65cf9c0 20 remove_watcher() i=2 2024-09-12T00:56:34.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.268+0000 7f47f65cf9c0 20 remove_watcher() i=3 2024-09-12T00:56:34.266 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.272+0000 7f47f65cf9c0 20 remove_watcher() i=4 2024-09-12T00:56:34.267 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.272+0000 7f47f65cf9c0 20 remove_watcher() i=5 2024-09-12T00:56:34.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.276+0000 7f47f65cf9c0 20 remove_watcher() i=6 2024-09-12T00:56:34.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:56:34.276+0000 7f47f65cf9c0 20 remove_watcher() i=7 2024-09-12T00:56:34.285 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:34.285 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:56:34.285 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: abort-at-commit-target-layout id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:56:34.285 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:56:34.286 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:56:34.286 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:04.358 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:04.358 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:04.401 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:57:04.437 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:04.438 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:04.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.487+0000 7fbe141ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.491+0000 7fbe141ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:04.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.491+0000 7fbe141ad9c0 20 realm 2024-09-12T00:57:04.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.491+0000 7fbe141ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.491+0000 7fbe141ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:04.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.491+0000 7fbe141ad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:04.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.491+0000 7fbe141ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.491+0000 7fbe141ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:04.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.491+0000 7fbe141ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.491+0000 7fbe141ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:04.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.491+0000 7fbe141ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.495+0000 7fbe141ad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:04.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.495+0000 7fbe141ad9c0 20 searching for the correct realm 2024-09-12T00:57:04.491 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.499+0000 7fbe124b4640 0 -- 172.21.15.70:0/3578326873 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fbe0401a040 msgr2=0x7fbe0405d6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:04.501 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.507+0000 7fbe124b4640 0 -- 172.21.15.70:0/3578326873 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fbcdc080880 msgr2=0x7fbcdc082cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:04.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.511+0000 7fbe141ad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:04.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.511+0000 7fbe141ad9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:57:04.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.511+0000 7fbe141ad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:04.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.511+0000 7fbe141ad9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:57:04.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.511+0000 7fbe141ad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:04.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.511+0000 7fbe141ad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:04.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.515+0000 7fbe141ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.515+0000 7fbe141ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:04.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.515+0000 7fbe141ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.515+0000 7fbe141ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:04.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.515+0000 7fbe141ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.515+0000 7fbe141ad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:04.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.515+0000 7fbe141ad9c0 20 zone default found 2024-09-12T00:57:04.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.515+0000 7fbe141ad9c0 4 Realm: () 2024-09-12T00:57:04.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.515+0000 7fbe141ad9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:57:04.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.515+0000 7fbe141ad9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:57:04.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.515+0000 7fbe141ad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:04.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.515+0000 7fbe141ad9c0 20 zonegroup default 2024-09-12T00:57:04.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.515+0000 7fbe141ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.515+0000 7fbe141ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:04.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.515+0000 7fbe141ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.515+0000 7fbe141ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:04.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.515+0000 7fbe141ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.515+0000 7fbe141ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:04.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.515+0000 7fbe141ad9c0 20 started sync module instance, tier type = 2024-09-12T00:57:04.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.515+0000 7fbe141ad9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:57:04.525 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.531+0000 7fbe141ad9c0 20 add_watcher() i=0 2024-09-12T00:57:04.526 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.531+0000 7fbe141ad9c0 20 add_watcher() i=1 2024-09-12T00:57:04.526 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.531+0000 7fbe141ad9c0 20 add_watcher() i=2 2024-09-12T00:57:04.526 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.531+0000 7fbe141ad9c0 20 add_watcher() i=3 2024-09-12T00:57:04.526 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.531+0000 7fbe141ad9c0 20 add_watcher() i=4 2024-09-12T00:57:04.526 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.531+0000 7fbe141ad9c0 20 add_watcher() i=5 2024-09-12T00:57:04.526 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.531+0000 7fbe141ad9c0 20 add_watcher() i=6 2024-09-12T00:57:04.526 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.531+0000 7fbe141ad9c0 20 add_watcher() i=7 2024-09-12T00:57:04.527 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.531+0000 7fbe141ad9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:04.529 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.535+0000 7fbcc3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:04.530 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.535+0000 7fbe141ad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:04.530 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.535+0000 7fbe141ad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:04.530 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.535+0000 7fbe141ad9c0 5 note: GC not initialized 2024-09-12T00:57:04.530 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.535+0000 7fbcc2ffd640 20 reqs_thread_entry: start 2024-09-12T00:57:04.530 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.535+0000 7fbe141ad9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:57:04.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.535+0000 7fbe141ad9c0 20 Filter name: none 2024-09-12T00:57:04.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.535+0000 7fbcc0ff9640 20 reqs_thread_entry: start 2024-09-12T00:57:04.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.535+0000 7fbe141ad9c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:57:04.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.535+0000 7fbe141ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.535+0000 7fbe141ad9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:57:04.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.535+0000 7fbe141ad9c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:57:04.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.535+0000 7fbe141ad9c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:57:04.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.535+0000 7fbe141ad9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 : miss 2024-09-12T00:57:04.532 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.535+0000 7fbe141ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.532 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.539+0000 7fbe141ad9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:57:04.532 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.539+0000 7fbe141ad9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 info.flags=0x17 2024-09-12T00:57:04.532 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.539+0000 7fbe141ad9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 to cache LRU end 2024-09-12T00:57:04.532 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.539+0000 7fbe141ad9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:57:04.533 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.539+0000 7fbe141ad9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:04.533 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.539+0000 7fbe141ad9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 2024-09-12T00:57:04.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.547+0000 7fbe141ad9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 info.flags=0x17 2024-09-12T00:57:04.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.547+0000 7fbe141ad9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 to cache LRU end 2024-09-12T00:57:04.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.547+0000 7fbe141ad9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:04.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.547+0000 7fbe141ad9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33, ofs0, ns] 2024-09-12T00:57:04.542 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.547+0000 7fbcf57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431614 cookie 94453905094320 notifier 7434 bl.length()=1015 2024-09-12T00:57:04.542 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.547+0000 7fbcf57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 info.flags=0x17 2024-09-12T00:57:04.542 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.547+0000 7fbcf57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 to cache LRU end 2024-09-12T00:57:04.542 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.547+0000 7fbcf57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:04.543 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.547+0000 7fbe141ad9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): orig_sources= new_sources= 2024-09-12T00:57:04.543 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.547+0000 7fbe141ad9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): potential sources added=[] removed=[] 2024-09-12T00:57:04.543 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.547+0000 7fbe141ad9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): orig_dests= new_dests= 2024-09-12T00:57:04.543 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.547+0000 7fbe141ad9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): potential dests added=[] removed=[] 2024-09-12T00:57:04.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.555+0000 7fbe141ad9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33.1.0 2024-09-12T00:57:04.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.555+0000 7fbe141ad9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33.1.0 2024-09-12T00:57:04.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.555+0000 7fbe141ad9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33.1.1 2024-09-12T00:57:04.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.555+0000 7fbe141ad9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33.1.1 2024-09-12T00:57:04.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.555+0000 7fbe141ad9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33.0 2024-09-12T00:57:04.553 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.559+0000 7fbe141ad9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:57:04.553 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.559+0000 7fbe141ad9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 2024-09-12T00:57:04.557 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.563+0000 7fbe141ad9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 info.flags=0x17 2024-09-12T00:57:04.557 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.563+0000 7fbe141ad9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 to cache LRU end 2024-09-12T00:57:04.557 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.563+0000 7fbe141ad9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:04.557 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.563+0000 7fbe141ad9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33, ofs0, ns] 2024-09-12T00:57:04.558 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.563+0000 7fbcf4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431615 cookie 94453905094320 notifier 7434 bl.length()=1015 2024-09-12T00:57:04.558 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.563+0000 7fbcf4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 info.flags=0x17 2024-09-12T00:57:04.558 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.563+0000 7fbcf4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 to cache LRU end 2024-09-12T00:57:04.558 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.563+0000 7fbcf4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:04.559 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.563+0000 7fbe141ad9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): orig_sources= new_sources= 2024-09-12T00:57:04.559 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.563+0000 7fbe141ad9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): potential sources added=[] removed=[] 2024-09-12T00:57:04.559 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.563+0000 7fbe141ad9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): orig_dests= new_dests= 2024-09-12T00:57:04.559 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.563+0000 7fbe141ad9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): potential dests added=[] removed=[] 2024-09-12T00:57:04.562 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.567+0000 7fbe141ad9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33.0 2024-09-12T00:57:04.563 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.567+0000 7fbe141ad9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:57:04.563 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.567+0000 7fbe141ad9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 2024-09-12T00:57:04.566 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.571+0000 7fbe141ad9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 info.flags=0x17 2024-09-12T00:57:04.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.571+0000 7fbe141ad9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 to cache LRU end 2024-09-12T00:57:04.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.571+0000 7fbe141ad9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:04.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.571+0000 7fbe141ad9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33, ofs0, ns] 2024-09-12T00:57:04.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.575+0000 7fbcf4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431616 cookie 94453905094320 notifier 7434 bl.length()=983 2024-09-12T00:57:04.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.575+0000 7fbcf4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 info.flags=0x17 2024-09-12T00:57:04.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.575+0000 7fbcf4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 to cache LRU end 2024-09-12T00:57:04.568 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.575+0000 7fbcf4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:04.569 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.575+0000 7fbe141ad9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): orig_sources= new_sources= 2024-09-12T00:57:04.569 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.575+0000 7fbe141ad9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): potential sources added=[] removed=[] 2024-09-12T00:57:04.569 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.575+0000 7fbe141ad9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): orig_dests= new_dests= 2024-09-12T00:57:04.569 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.575+0000 7fbe141ad9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33]): potential dests added=[] removed=[] 2024-09-12T00:57:04.572 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.579+0000 7fbe141ad9c0 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:57:04.576 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.583+0000 7fbcc3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:04.581 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.587+0000 7fbe141ad9c0 20 remove_watcher() i=0 2024-09-12T00:57:04.581 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.587+0000 7fbe141ad9c0 2 removed watcher, disabling cache 2024-09-12T00:57:04.582 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.587+0000 7fbe141ad9c0 20 remove_watcher() i=1 2024-09-12T00:57:04.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.591+0000 7fbe141ad9c0 20 remove_watcher() i=2 2024-09-12T00:57:04.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.591+0000 7fbe141ad9c0 20 remove_watcher() i=3 2024-09-12T00:57:04.589 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.595+0000 7fbe141ad9c0 20 remove_watcher() i=4 2024-09-12T00:57:04.590 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.595+0000 7fbe141ad9c0 20 remove_watcher() i=5 2024-09-12T00:57:04.591 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.599+0000 7fbe141ad9c0 20 remove_watcher() i=6 2024-09-12T00:57:04.593 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.599+0000 7fbe141ad9c0 20 remove_watcher() i=7 2024-09-12T00:57:04.607 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:57:04.635 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:04.635 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:04.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.683+0000 7f26d38e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.683+0000 7f26d38e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:04.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.683+0000 7f26d38e19c0 20 realm 2024-09-12T00:57:04.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.683+0000 7f26d38e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.683+0000 7f26d38e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:04.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.683+0000 7f26d38e19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:04.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.683+0000 7f26d38e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.683+0000 7f26d38e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:04.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.683+0000 7f26d38e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.687+0000 7f26d38e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:04.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.687+0000 7f26d38e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.687+0000 7f26d38e19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:04.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.687+0000 7f26d38e19c0 20 searching for the correct realm 2024-09-12T00:57:04.684 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.691+0000 7f26d1be8640 0 -- 172.21.15.70:0/1400729161 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f26c8071960 msgr2=0x7f26c801a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:04.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.907+0000 7f26d1be8640 0 -- 172.21.15.70:0/1400729161 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f26c8071960 msgr2=0x7f26c801a3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:04.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.919+0000 7f26d38e19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:04.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.919+0000 7f26d38e19c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:57:04.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.919+0000 7f26d38e19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:04.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.919+0000 7f26d38e19c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:57:04.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.919+0000 7f26d38e19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:04.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.919+0000 7f26d38e19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:04.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.919+0000 7f26d38e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.914 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.919+0000 7f26d38e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:04.914 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.919+0000 7f26d38e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.914 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.919+0000 7f26d38e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:04.914 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.919+0000 7f26d38e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.915 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.919+0000 7f26d38e19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:04.915 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.919+0000 7f26d38e19c0 20 zone default found 2024-09-12T00:57:04.915 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.919+0000 7f26d38e19c0 4 Realm: () 2024-09-12T00:57:04.915 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.919+0000 7f26d38e19c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:57:04.915 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.919+0000 7f26d38e19c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:57:04.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.919+0000 7f26d38e19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:04.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.919+0000 7f26d38e19c0 20 zonegroup default 2024-09-12T00:57:04.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.919+0000 7f26d38e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.923+0000 7f26d38e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:04.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.923+0000 7f26d38e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.923+0000 7f26d38e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:04.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.923+0000 7f26d38e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.923+0000 7f26d38e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:04.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.923+0000 7f26d38e19c0 20 started sync module instance, tier type = 2024-09-12T00:57:04.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.923+0000 7f26d38e19c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:57:04.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.947+0000 7f26d38e19c0 20 add_watcher() i=0 2024-09-12T00:57:04.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.947+0000 7f26d38e19c0 20 add_watcher() i=1 2024-09-12T00:57:04.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.947+0000 7f26d38e19c0 20 add_watcher() i=2 2024-09-12T00:57:04.942 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.947+0000 7f26d38e19c0 20 add_watcher() i=3 2024-09-12T00:57:04.942 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.947+0000 7f26d38e19c0 20 add_watcher() i=4 2024-09-12T00:57:04.942 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.947+0000 7f26d38e19c0 20 add_watcher() i=5 2024-09-12T00:57:04.942 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.947+0000 7f26d38e19c0 20 add_watcher() i=6 2024-09-12T00:57:04.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.951+0000 7f26d38e19c0 20 add_watcher() i=7 2024-09-12T00:57:04.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.951+0000 7f26d38e19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:04.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.951+0000 7f25877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:04.948 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.955+0000 7f26d38e19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:04.948 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.955+0000 7f26d38e19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:04.948 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.955+0000 7f26d38e19c0 5 note: GC not initialized 2024-09-12T00:57:04.949 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.955+0000 7f25867e4640 20 reqs_thread_entry: start 2024-09-12T00:57:04.949 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.955+0000 7f26d38e19c0 20 init_complete bucket index max shards: 1 2024-09-12T00:57:04.949 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.955+0000 7f26d38e19c0 20 Filter name: none 2024-09-12T00:57:04.949 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.955+0000 7f24f7fff640 20 reqs_thread_entry: start 2024-09-12T00:57:04.949 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.955+0000 7f26d38e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.950 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.955+0000 7f26d38e19c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:57:04.950 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.955+0000 7f26d38e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.955+0000 7f26d38e19c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:57:04.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.959+0000 7f26d38e19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:04.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.959+0000 7f26d38e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.959+0000 7f26d38e19c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:57:04.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.959+0000 7f26d38e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:04.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.959+0000 7f26d38e19c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:57:04.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.959+0000 7f26d38e19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:04.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.959+0000 7f25877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:04.960 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.967+0000 7f26d38e19c0 20 remove_watcher() i=0 2024-09-12T00:57:04.960 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.967+0000 7f26d38e19c0 2 removed watcher, disabling cache 2024-09-12T00:57:04.962 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.967+0000 7f26d38e19c0 20 remove_watcher() i=1 2024-09-12T00:57:04.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.971+0000 7f26d38e19c0 20 remove_watcher() i=2 2024-09-12T00:57:04.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.971+0000 7f26d38e19c0 20 remove_watcher() i=3 2024-09-12T00:57:04.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.975+0000 7f26d38e19c0 20 remove_watcher() i=4 2024-09-12T00:57:04.970 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.975+0000 7f26d38e19c0 20 remove_watcher() i=5 2024-09-12T00:57:04.972 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.979+0000 7f26d38e19c0 20 remove_watcher() i=6 2024-09-12T00:57:04.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:04.979+0000 7f26d38e19c0 20 remove_watcher() i=7 2024-09-12T00:57:04.989 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:04.989 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:57:04.990 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: abort-at-commit-target-layout id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:57:04.990 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:04.990 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:04.991 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:04.995 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:04.995 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:05.041 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:05.042 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:05.063 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-12T00:57:05.063 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:05.064 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:05.065 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:05.079 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:05.079 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:05.125 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:05.125 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:05.145 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:05.145 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:05.165 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:05.165 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:05.185 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:05.185 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:05.205 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:05.205 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:05.224 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:05.225 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:05.245 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:05.246 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:05.265 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:05.265 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:05.341 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:05.341 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:05.358 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:05.358 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:05.376 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:05.376 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:05.392 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:05.393 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:05.411 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:05.411 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:05.429 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:05.430 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:05.448 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:05.449 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:05.467 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:05.467 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:05.486 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:05.486 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:05.505 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:05.505 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:05.524 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:05.524 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:05.543 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:05.543 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:05.560 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:57:05.593 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:05.593 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:05.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.643+0000 7fdea9a609c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:05.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.643+0000 7fdea9a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:05.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.643+0000 7fdea9a609c0 20 realm 2024-09-12T00:57:05.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.643+0000 7fdea9a609c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:05.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.643+0000 7fdea9a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:05.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.643+0000 7fdea9a609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:05.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.643+0000 7fdea9a609c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:05.640 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.643+0000 7fdea9a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:05.640 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.643+0000 7fdea9a609c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:05.641 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.647+0000 7fdea9a609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:05.641 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.647+0000 7fdea9a609c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:05.641 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.647+0000 7fdea9a609c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:05.642 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.647+0000 7fdea9a609c0 20 searching for the correct realm 2024-09-12T00:57:05.645 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.651+0000 7fdea7d67640 0 -- 172.21.15.70:0/3705097447 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fde90008ba0 msgr2=0x7fde90030aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:05.861 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.867+0000 7fdea7d67640 0 -- 172.21.15.70:0/3705097447 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fde90008ba0 msgr2=0x7fde90030aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:05.872 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.879+0000 7fdea9a609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:05.872 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.879+0000 7fdea9a609c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:57:05.872 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.879+0000 7fdea9a609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:05.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.879+0000 7fdea9a609c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:57:05.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.879+0000 7fdea9a609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:05.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.879+0000 7fdea9a609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:05.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.879+0000 7fdea9a609c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:05.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.879+0000 7fdea9a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:05.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.879+0000 7fdea9a609c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:05.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.879+0000 7fdea9a609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:05.874 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.879+0000 7fdea9a609c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:05.874 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.879+0000 7fdea9a609c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:05.874 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.879+0000 7fdea9a609c0 20 zone default found 2024-09-12T00:57:05.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.879+0000 7fdea9a609c0 4 Realm: () 2024-09-12T00:57:05.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.879+0000 7fdea9a609c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:57:05.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.879+0000 7fdea9a609c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:57:05.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.879+0000 7fdea9a609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:05.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.879+0000 7fdea9a609c0 20 zonegroup default 2024-09-12T00:57:05.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.879+0000 7fdea9a609c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:05.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.879+0000 7fdea9a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:05.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.879+0000 7fdea9a609c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:05.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.883+0000 7fdea9a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:05.876 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.883+0000 7fdea9a609c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:05.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.883+0000 7fdea9a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:05.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.883+0000 7fdea9a609c0 20 started sync module instance, tier type = 2024-09-12T00:57:05.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.883+0000 7fdea9a609c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:57:05.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.907+0000 7fdea9a609c0 20 add_watcher() i=0 2024-09-12T00:57:05.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.907+0000 7fdea9a609c0 20 add_watcher() i=1 2024-09-12T00:57:05.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.907+0000 7fdea9a609c0 20 add_watcher() i=2 2024-09-12T00:57:05.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.907+0000 7fdea9a609c0 20 add_watcher() i=3 2024-09-12T00:57:05.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.907+0000 7fdea9a609c0 20 add_watcher() i=4 2024-09-12T00:57:05.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.907+0000 7fdea9a609c0 20 add_watcher() i=5 2024-09-12T00:57:05.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.907+0000 7fdea9a609c0 20 add_watcher() i=6 2024-09-12T00:57:05.903 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.907+0000 7fdea9a609c0 20 add_watcher() i=7 2024-09-12T00:57:05.903 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.907+0000 7fdea9a609c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:05.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.911+0000 7fdd5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:05.908 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.915+0000 7fdea9a609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:05.908 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.915+0000 7fdea9a609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:05.908 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.915+0000 7fdea9a609c0 5 note: GC not initialized 2024-09-12T00:57:05.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.915+0000 7fdd5cfe1640 20 reqs_thread_entry: start 2024-09-12T00:57:05.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.915+0000 7fdea9a609c0 20 init_complete bucket index max shards: 1 2024-09-12T00:57:05.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.915+0000 7fdea9a609c0 20 Filter name: none 2024-09-12T00:57:05.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.915+0000 7fdcd67fc640 20 reqs_thread_entry: start 2024-09-12T00:57:05.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.915+0000 7fdea9a609c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:05.910 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.915+0000 7fdea9a609c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:57:05.910 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.915+0000 7fdea9a609c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:05.911 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.919+0000 7fdea9a609c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:57:05.911 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.919+0000 7fdea9a609c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:05.911 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.919+0000 7fdea9a609c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:05.912 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.919+0000 7fdea9a609c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:57:05.912 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.919+0000 7fdea9a609c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:05.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.919+0000 7fdea9a609c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:57:05.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.919+0000 7fdea9a609c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:05.915 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.919+0000 7fdd5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:05.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.927+0000 7fdea9a609c0 20 remove_watcher() i=0 2024-09-12T00:57:05.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.927+0000 7fdea9a609c0 2 removed watcher, disabling cache 2024-09-12T00:57:05.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.927+0000 7fdea9a609c0 20 remove_watcher() i=1 2024-09-12T00:57:05.924 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.931+0000 7fdea9a609c0 20 remove_watcher() i=2 2024-09-12T00:57:05.927 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.931+0000 7fdea9a609c0 20 remove_watcher() i=3 2024-09-12T00:57:05.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.935+0000 7fdea9a609c0 20 remove_watcher() i=4 2024-09-12T00:57:05.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.935+0000 7fdea9a609c0 20 remove_watcher() i=5 2024-09-12T00:57:05.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.939+0000 7fdea9a609c0 20 remove_watcher() i=6 2024-09-12T00:57:05.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:05.939+0000 7fdea9a609c0 20 remove_watcher() i=7 2024-09-12T00:57:05.949 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:05.949 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:57:05.950 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-do-reshard id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:57:05.950 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:05.950 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-12T00:57:05.985 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:05.985 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:06.028 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.035+0000 7f8fc9eb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.030 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.035+0000 7f8fc9eb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:06.030 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.035+0000 7f8fc9eb49c0 20 realm 2024-09-12T00:57:06.030 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.035+0000 7f8fc9eb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.030 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.035+0000 7f8fc9eb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:06.030 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.035+0000 7f8fc9eb49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:06.030 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.035+0000 7f8fc9eb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.031 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.035+0000 7f8fc9eb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:06.031 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.035+0000 7f8fc9eb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.032 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.039+0000 7f8fc9eb49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:06.032 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.039+0000 7f8fc9eb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.032 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.039+0000 7f8fc9eb49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:06.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.039+0000 7f8fc9eb49c0 20 searching for the correct realm 2024-09-12T00:57:06.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.043+0000 7f8fc81bb640 0 -- 172.21.15.70:0/3311731786 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f8fb001a040 msgr2=0x7f8fb005d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:06.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.259+0000 7f8fc81bb640 0 -- 172.21.15.70:0/3311731786 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f8fb001a040 msgr2=0x7f8fb005d570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:06.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.271+0000 7f8fc9eb49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:06.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.271+0000 7f8fc9eb49c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:57:06.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.271+0000 7f8fc9eb49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:06.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.271+0000 7f8fc9eb49c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:57:06.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.271+0000 7f8fc9eb49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:06.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.271+0000 7f8fc9eb49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:06.266 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.271+0000 7f8fc9eb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.266 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.271+0000 7f8fc9eb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:06.266 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.271+0000 7f8fc9eb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.266 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.271+0000 7f8fc9eb49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:06.266 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.271+0000 7f8fc9eb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.271+0000 7f8fc9eb49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:06.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.275+0000 7f8fc9eb49c0 20 zone default found 2024-09-12T00:57:06.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.275+0000 7f8fc9eb49c0 4 Realm: () 2024-09-12T00:57:06.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.275+0000 7f8fc9eb49c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:57:06.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.275+0000 7f8fc9eb49c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:57:06.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.275+0000 7f8fc9eb49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:06.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.275+0000 7f8fc9eb49c0 20 zonegroup default 2024-09-12T00:57:06.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.275+0000 7f8fc9eb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.275+0000 7f8fc9eb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:06.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.275+0000 7f8fc9eb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.275+0000 7f8fc9eb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:06.271 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.275+0000 7f8fc9eb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.271 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.275+0000 7f8fc9eb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:06.271 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.275+0000 7f8fc9eb49c0 20 started sync module instance, tier type = 2024-09-12T00:57:06.271 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.275+0000 7f8fc9eb49c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:57:06.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.299+0000 7f8fc9eb49c0 20 add_watcher() i=0 2024-09-12T00:57:06.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.299+0000 7f8fc9eb49c0 20 add_watcher() i=1 2024-09-12T00:57:06.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.299+0000 7f8fc9eb49c0 20 add_watcher() i=2 2024-09-12T00:57:06.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.299+0000 7f8fc9eb49c0 20 add_watcher() i=3 2024-09-12T00:57:06.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.299+0000 7f8fc9eb49c0 20 add_watcher() i=4 2024-09-12T00:57:06.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.299+0000 7f8fc9eb49c0 20 add_watcher() i=5 2024-09-12T00:57:06.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.299+0000 7f8fc9eb49c0 20 add_watcher() i=6 2024-09-12T00:57:06.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.303+0000 7f8fc9eb49c0 20 add_watcher() i=7 2024-09-12T00:57:06.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.303+0000 7f8fc9eb49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:06.301 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.307+0000 7f8e7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:06.302 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.307+0000 7f8fc9eb49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:06.302 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.307+0000 7f8fc9eb49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:06.302 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.307+0000 7f8fc9eb49c0 5 note: GC not initialized 2024-09-12T00:57:06.303 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.307+0000 7f8e7cfe1640 20 reqs_thread_entry: start 2024-09-12T00:57:06.303 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.307+0000 7f8fc9eb49c0 20 init_complete bucket index max shards: 1 2024-09-12T00:57:06.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.307+0000 7f8fc9eb49c0 20 Filter name: none 2024-09-12T00:57:06.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.307+0000 7f8df67fc640 20 reqs_thread_entry: start 2024-09-12T00:57:06.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.311+0000 7f8fc9eb49c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T00:57:06.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.311+0000 7f8fc9eb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.311+0000 7f8fc9eb49c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:57:06.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.311+0000 7f8fc9eb49c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T00:57:06.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.311+0000 7f8fc9eb49c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T00:57:06.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.311+0000 7f8fc9eb49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 : miss 2024-09-12T00:57:06.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.311+0000 7f8fc9eb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.311+0000 7f8fc9eb49c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:57:06.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.311+0000 7f8fc9eb49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 info.flags=0x17 2024-09-12T00:57:06.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.311+0000 7f8fc9eb49c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 to cache LRU end 2024-09-12T00:57:06.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.311+0000 7f8fc9eb49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:57:06.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.311+0000 7f8fc9eb49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:06.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.311+0000 7f8fc9eb49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 2024-09-12T00:57:06.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.319+0000 7f8fc9eb49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 info.flags=0x17 2024-09-12T00:57:06.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.319+0000 7f8fc9eb49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 to cache LRU end 2024-09-12T00:57:06.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.319+0000 7f8fc9eb49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:06.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.319+0000 7f8fc9eb49c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34, ofs0, ns] 2024-09-12T00:57:06.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.319+0000 7f8ea6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431624 cookie 93952692387888 notifier 7052 bl.length()=995 2024-09-12T00:57:06.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.319+0000 7f8ea6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 info.flags=0x17 2024-09-12T00:57:06.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.319+0000 7f8ea6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 to cache LRU end 2024-09-12T00:57:06.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.319+0000 7f8ea6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:06.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.319+0000 7f8fc9eb49c0 20 handle_bi_update(): bucket=:error-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34]): orig_sources= new_sources= 2024-09-12T00:57:06.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.319+0000 7f8fc9eb49c0 20 handle_bi_update(): bucket=:error-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34]): potential sources added=[] removed=[] 2024-09-12T00:57:06.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.319+0000 7f8fc9eb49c0 20 handle_bi_update(): bucket=:error-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34]): orig_dests= new_dests= 2024-09-12T00:57:06.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.319+0000 7f8fc9eb49c0 20 handle_bi_update(): bucket=:error-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34]): potential dests added=[] removed=[] 2024-09-12T00:57:06.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.323+0000 7f8fc9eb49c0 -1 Injecting error=-5 at location=do_reshard 2024-09-12T00:57:06.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.327+0000 7f8fc9eb49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:57:06.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.327+0000 7f8fc9eb49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 2024-09-12T00:57:06.327 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.331+0000 7f8fc9eb49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 info.flags=0x17 2024-09-12T00:57:06.327 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.331+0000 7f8fc9eb49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 to cache LRU end 2024-09-12T00:57:06.327 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.331+0000 7f8fc9eb49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:06.327 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.331+0000 7f8fc9eb49c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34, ofs0, ns] 2024-09-12T00:57:06.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.335+0000 7f8ea6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431625 cookie 93952692387888 notifier 7052 bl.length()=963 2024-09-12T00:57:06.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.335+0000 7f8ea6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 info.flags=0x17 2024-09-12T00:57:06.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.335+0000 7f8ea6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 to cache LRU end 2024-09-12T00:57:06.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.335+0000 7f8ea6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:06.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.335+0000 7f8fc9eb49c0 20 handle_bi_update(): bucket=:error-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34]): orig_sources= new_sources= 2024-09-12T00:57:06.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.335+0000 7f8fc9eb49c0 20 handle_bi_update(): bucket=:error-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34]): potential sources added=[] removed=[] 2024-09-12T00:57:06.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.335+0000 7f8fc9eb49c0 20 handle_bi_update(): bucket=:error-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34]): orig_dests= new_dests= 2024-09-12T00:57:06.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.335+0000 7f8fc9eb49c0 20 handle_bi_update(): bucket=:error-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34]): potential dests added=[] removed=[] 2024-09-12T00:57:06.329 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.335+0000 7f8fc9eb49c0 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-12T00:57:06.331 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.339+0000 7f8e7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:06.336 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.343+0000 7f8fc9eb49c0 20 remove_watcher() i=0 2024-09-12T00:57:06.336 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.343+0000 7f8fc9eb49c0 2 removed watcher, disabling cache 2024-09-12T00:57:06.338 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.343+0000 7f8fc9eb49c0 20 remove_watcher() i=1 2024-09-12T00:57:06.341 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.347+0000 7f8fc9eb49c0 20 remove_watcher() i=2 2024-09-12T00:57:06.343 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.351+0000 7f8fc9eb49c0 20 remove_watcher() i=3 2024-09-12T00:57:06.346 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.351+0000 7f8fc9eb49c0 20 remove_watcher() i=4 2024-09-12T00:57:06.347 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.355+0000 7f8fc9eb49c0 20 remove_watcher() i=5 2024-09-12T00:57:06.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.355+0000 7f8fc9eb49c0 20 remove_watcher() i=6 2024-09-12T00:57:06.351 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.355+0000 7f8fc9eb49c0 20 remove_watcher() i=7 2024-09-12T00:57:06.366 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:57:06.394 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:06.395 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:06.438 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.443+0000 7fbe4d4ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.447+0000 7fbe4d4ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:06.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.447+0000 7fbe4d4ef9c0 20 realm 2024-09-12T00:57:06.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.447+0000 7fbe4d4ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.447+0000 7fbe4d4ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:06.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.447+0000 7fbe4d4ef9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:06.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.447+0000 7fbe4d4ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.442 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.447+0000 7fbe4d4ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:06.442 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.447+0000 7fbe4d4ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.443 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.447+0000 7fbe4d4ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:06.443 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.447+0000 7fbe4d4ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.444 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.447+0000 7fbe4d4ef9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:06.444 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.447+0000 7fbe4d4ef9c0 20 searching for the correct realm 2024-09-12T00:57:06.445 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.451+0000 7fbe4a7f4640 0 -- 172.21.15.70:0/3824880788 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7fbe3c041040 msgr2=0x7fbe3c041930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:06.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.667+0000 7fbe4aff5640 0 -- 172.21.15.70:0/3824880788 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7fbe440861d0 msgr2=0x7fbe440603e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:06.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.679+0000 7fbe4d4ef9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:06.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.679+0000 7fbe4d4ef9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:57:06.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.679+0000 7fbe4d4ef9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:06.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.679+0000 7fbe4d4ef9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:57:06.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.679+0000 7fbe4d4ef9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:06.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.679+0000 7fbe4d4ef9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:06.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.679+0000 7fbe4d4ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.679+0000 7fbe4d4ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:06.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.679+0000 7fbe4d4ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.683+0000 7fbe4d4ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:06.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.683+0000 7fbe4d4ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.683+0000 7fbe4d4ef9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:06.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.683+0000 7fbe4d4ef9c0 20 zone default found 2024-09-12T00:57:06.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.683+0000 7fbe4d4ef9c0 4 Realm: () 2024-09-12T00:57:06.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.683+0000 7fbe4d4ef9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:57:06.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.683+0000 7fbe4d4ef9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:57:06.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.683+0000 7fbe4d4ef9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:06.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.683+0000 7fbe4d4ef9c0 20 zonegroup default 2024-09-12T00:57:06.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.683+0000 7fbe4d4ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.683+0000 7fbe4d4ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:06.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.683+0000 7fbe4d4ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.683+0000 7fbe4d4ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:06.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.683+0000 7fbe4d4ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.683+0000 7fbe4d4ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:06.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.683+0000 7fbe4d4ef9c0 20 started sync module instance, tier type = 2024-09-12T00:57:06.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.683+0000 7fbe4d4ef9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:57:06.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.711+0000 7fbe4d4ef9c0 20 add_watcher() i=0 2024-09-12T00:57:06.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.711+0000 7fbe4d4ef9c0 20 add_watcher() i=1 2024-09-12T00:57:06.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.711+0000 7fbe4d4ef9c0 20 add_watcher() i=2 2024-09-12T00:57:06.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.711+0000 7fbe4d4ef9c0 20 add_watcher() i=3 2024-09-12T00:57:06.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.711+0000 7fbe4d4ef9c0 20 add_watcher() i=4 2024-09-12T00:57:06.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.711+0000 7fbe4d4ef9c0 20 add_watcher() i=5 2024-09-12T00:57:06.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.711+0000 7fbe4d4ef9c0 20 add_watcher() i=6 2024-09-12T00:57:06.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.711+0000 7fbe4d4ef9c0 20 add_watcher() i=7 2024-09-12T00:57:06.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.711+0000 7fbe4d4ef9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:06.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.715+0000 7fbd01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:06.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.715+0000 7fbe4d4ef9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:06.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.715+0000 7fbe4d4ef9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:06.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.715+0000 7fbe4d4ef9c0 5 note: GC not initialized 2024-09-12T00:57:06.711 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.715+0000 7fbd00fe1640 20 reqs_thread_entry: start 2024-09-12T00:57:06.711 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.715+0000 7fbe4d4ef9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:57:06.711 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.719+0000 7fbe4d4ef9c0 20 Filter name: none 2024-09-12T00:57:06.712 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.719+0000 7fbcf9ffb640 20 reqs_thread_entry: start 2024-09-12T00:57:06.712 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.719+0000 7fbe4d4ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.712 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.719+0000 7fbe4d4ef9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:57:06.712 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.719+0000 7fbe4d4ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.714 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.719+0000 7fbe4d4ef9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:57:06.714 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.719+0000 7fbe4d4ef9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:06.714 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.719+0000 7fbe4d4ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.714 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.719+0000 7fbe4d4ef9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:57:06.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.719+0000 7fbe4d4ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.723+0000 7fbe4d4ef9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:57:06.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.723+0000 7fbe4d4ef9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:06.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.723+0000 7fbd01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:06.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.727+0000 7fbe4d4ef9c0 20 remove_watcher() i=0 2024-09-12T00:57:06.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.727+0000 7fbe4d4ef9c0 2 removed watcher, disabling cache 2024-09-12T00:57:06.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.731+0000 7fbe4d4ef9c0 20 remove_watcher() i=1 2024-09-12T00:57:06.728 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.735+0000 7fbe4d4ef9c0 20 remove_watcher() i=2 2024-09-12T00:57:06.731 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.735+0000 7fbe4d4ef9c0 20 remove_watcher() i=3 2024-09-12T00:57:06.734 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.739+0000 7fbe4d4ef9c0 20 remove_watcher() i=4 2024-09-12T00:57:06.735 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.739+0000 7fbe4d4ef9c0 20 remove_watcher() i=5 2024-09-12T00:57:06.738 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.743+0000 7fbe4d4ef9c0 20 remove_watcher() i=6 2024-09-12T00:57:06.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.743+0000 7fbe4d4ef9c0 20 remove_watcher() i=7 2024-09-12T00:57:06.757 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:06.757 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:57:06.757 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-do-reshard id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:57:06.757 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:06.758 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:06.758 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:06.769 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:06.769 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:06.812 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:57:06.848 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:06.848 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:06.892 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.899+0000 7f622f2179c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.894 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.899+0000 7f622f2179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:06.894 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.899+0000 7f622f2179c0 20 realm 2024-09-12T00:57:06.894 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.899+0000 7f622f2179c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.894 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.899+0000 7f622f2179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:06.894 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.899+0000 7f622f2179c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:06.895 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.899+0000 7f622f2179c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.895 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.899+0000 7f622f2179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:06.895 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.899+0000 7f622f2179c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.895 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.903+0000 7f622f2179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:06.895 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.903+0000 7f622f2179c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.896 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.903+0000 7f622f2179c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:06.897 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.903+0000 7f622f2179c0 20 searching for the correct realm 2024-09-12T00:57:06.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.907+0000 7f622d51e640 0 -- 172.21.15.70:0/4080764121 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f6220008050 msgr2=0x7f622005da80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:06.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.915+0000 7f622c51c640 0 -- 172.21.15.70:0/4080764121 >> [v2:172.21.15.70:6824/2477739226,v1:172.21.15.70:6825/2477739226] conn(0x556b2f638150 msgr2=0x556b2f63a560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:06.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.923+0000 7f622f2179c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:06.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.923+0000 7f622f2179c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:57:06.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.923+0000 7f622f2179c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:06.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.923+0000 7f622f2179c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:57:06.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.923+0000 7f622f2179c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:06.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.923+0000 7f622f2179c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:06.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.923+0000 7f622f2179c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.923+0000 7f622f2179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:06.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.923+0000 7f622f2179c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.923+0000 7f622f2179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:06.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.923+0000 7f622f2179c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.923+0000 7f622f2179c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:06.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.923+0000 7f622f2179c0 20 zone default found 2024-09-12T00:57:06.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.923+0000 7f622f2179c0 4 Realm: () 2024-09-12T00:57:06.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.923+0000 7f622f2179c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:57:06.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.923+0000 7f622f2179c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:57:06.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.923+0000 7f622f2179c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:06.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.923+0000 7f622f2179c0 20 zonegroup default 2024-09-12T00:57:06.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.923+0000 7f622f2179c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.923+0000 7f622f2179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:06.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.923+0000 7f622f2179c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.927+0000 7f622f2179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:06.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.927+0000 7f622f2179c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.927+0000 7f622f2179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:06.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.927+0000 7f622f2179c0 20 started sync module instance, tier type = 2024-09-12T00:57:06.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.927+0000 7f622f2179c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:57:06.937 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.943+0000 7f622f2179c0 20 add_watcher() i=0 2024-09-12T00:57:06.937 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.943+0000 7f622f2179c0 20 add_watcher() i=1 2024-09-12T00:57:06.937 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.943+0000 7f622f2179c0 20 add_watcher() i=2 2024-09-12T00:57:06.937 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.943+0000 7f622f2179c0 20 add_watcher() i=3 2024-09-12T00:57:06.937 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.943+0000 7f622f2179c0 20 add_watcher() i=4 2024-09-12T00:57:06.937 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.943+0000 7f622f2179c0 20 add_watcher() i=5 2024-09-12T00:57:06.937 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.943+0000 7f622f2179c0 20 add_watcher() i=6 2024-09-12T00:57:06.938 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.943+0000 7f622f2179c0 20 add_watcher() i=7 2024-09-12T00:57:06.938 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.943+0000 7f622f2179c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:06.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.947+0000 7f60e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:06.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.947+0000 7f622f2179c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:06.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.947+0000 7f622f2179c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:06.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.947+0000 7f622f2179c0 5 note: GC not initialized 2024-09-12T00:57:06.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.947+0000 7f60e27e4640 20 reqs_thread_entry: start 2024-09-12T00:57:06.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.947+0000 7f622f2179c0 20 init_complete bucket index max shards: 1 2024-09-12T00:57:06.942 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.947+0000 7f622f2179c0 20 Filter name: none 2024-09-12T00:57:06.942 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.947+0000 7f60e07e0640 20 reqs_thread_entry: start 2024-09-12T00:57:06.942 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.947+0000 7f622f2179c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T00:57:06.942 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.947+0000 7f622f2179c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.942 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.947+0000 7f622f2179c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:57:06.942 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.947+0000 7f622f2179c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T00:57:06.942 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.947+0000 7f622f2179c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T00:57:06.942 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.947+0000 7f622f2179c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 : miss 2024-09-12T00:57:06.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.947+0000 7f622f2179c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:06.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.947+0000 7f622f2179c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:57:06.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.947+0000 7f622f2179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 info.flags=0x17 2024-09-12T00:57:06.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.947+0000 7f622f2179c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 to cache LRU end 2024-09-12T00:57:06.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.947+0000 7f622f2179c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:57:06.944 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.947+0000 7f622f2179c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:06.944 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.947+0000 7f622f2179c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 2024-09-12T00:57:06.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.959+0000 7f622f2179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 info.flags=0x17 2024-09-12T00:57:06.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.959+0000 7f622f2179c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 to cache LRU end 2024-09-12T00:57:06.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.959+0000 7f622f2179c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:06.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.959+0000 7f622f2179c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34, ofs0, ns] 2024-09-12T00:57:06.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.959+0000 7f6103fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431626 cookie 93918844957344 notifier 7088 bl.length()=995 2024-09-12T00:57:06.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.959+0000 7f6103fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 info.flags=0x17 2024-09-12T00:57:06.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.959+0000 7f6103fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 to cache LRU end 2024-09-12T00:57:06.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.959+0000 7f6103fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:06.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.959+0000 7f622f2179c0 20 handle_bi_update(): bucket=:error-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34]): orig_sources= new_sources= 2024-09-12T00:57:06.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.959+0000 7f622f2179c0 20 handle_bi_update(): bucket=:error-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34]): potential sources added=[] removed=[] 2024-09-12T00:57:06.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.959+0000 7f622f2179c0 20 handle_bi_update(): bucket=:error-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34]): orig_dests= new_dests= 2024-09-12T00:57:06.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.959+0000 7f622f2179c0 20 handle_bi_update(): bucket=:error-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34]): potential dests added=[] removed=[] 2024-09-12T00:57:06.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.959+0000 7f622f2179c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34.1.0 2024-09-12T00:57:06.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.959+0000 7f622f2179c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34.1.0 2024-09-12T00:57:06.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.959+0000 7f622f2179c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34.1.1 2024-09-12T00:57:06.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.959+0000 7f622f2179c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34.1.1 2024-09-12T00:57:06.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.959+0000 7f622f2179c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34.0 2024-09-12T00:57:06.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.963+0000 7f622f2179c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:57:06.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.963+0000 7f622f2179c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 2024-09-12T00:57:06.962 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.967+0000 7f622f2179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 info.flags=0x17 2024-09-12T00:57:06.962 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.967+0000 7f622f2179c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 to cache LRU end 2024-09-12T00:57:06.962 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.967+0000 7f622f2179c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:06.962 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.967+0000 7f622f2179c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34, ofs0, ns] 2024-09-12T00:57:06.962 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.967+0000 7f61037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431627 cookie 93918844957344 notifier 7088 bl.length()=995 2024-09-12T00:57:06.962 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.967+0000 7f61037fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 info.flags=0x17 2024-09-12T00:57:06.962 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.967+0000 7f61037fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 to cache LRU end 2024-09-12T00:57:06.962 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.967+0000 7f61037fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:06.963 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.967+0000 7f622f2179c0 20 handle_bi_update(): bucket=:error-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34]): orig_sources= new_sources= 2024-09-12T00:57:06.963 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.967+0000 7f622f2179c0 20 handle_bi_update(): bucket=:error-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34]): potential sources added=[] removed=[] 2024-09-12T00:57:06.963 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.967+0000 7f622f2179c0 20 handle_bi_update(): bucket=:error-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34]): orig_dests= new_dests= 2024-09-12T00:57:06.963 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.967+0000 7f622f2179c0 20 handle_bi_update(): bucket=:error-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34]): potential dests added=[] removed=[] 2024-09-12T00:57:06.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.971+0000 7f622f2179c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34.0 2024-09-12T00:57:06.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.971+0000 7f622f2179c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:57:06.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.971+0000 7f622f2179c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 2024-09-12T00:57:06.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.975+0000 7f622f2179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 info.flags=0x17 2024-09-12T00:57:06.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.975+0000 7f622f2179c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 to cache LRU end 2024-09-12T00:57:06.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.975+0000 7f622f2179c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:06.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.975+0000 7f622f2179c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34, ofs0, ns] 2024-09-12T00:57:06.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.975+0000 7f6103fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431628 cookie 93918844957344 notifier 7088 bl.length()=963 2024-09-12T00:57:06.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.975+0000 7f6103fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 info.flags=0x17 2024-09-12T00:57:06.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.975+0000 7f6103fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 to cache LRU end 2024-09-12T00:57:06.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.975+0000 7f6103fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:06.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.975+0000 7f622f2179c0 20 handle_bi_update(): bucket=:error-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34]): orig_sources= new_sources= 2024-09-12T00:57:06.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.975+0000 7f622f2179c0 20 handle_bi_update(): bucket=:error-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34]): potential sources added=[] removed=[] 2024-09-12T00:57:06.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.975+0000 7f622f2179c0 20 handle_bi_update(): bucket=:error-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34]): orig_dests= new_dests= 2024-09-12T00:57:06.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.975+0000 7f622f2179c0 20 handle_bi_update(): bucket=:error-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34]): potential dests added=[] removed=[] 2024-09-12T00:57:06.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.975+0000 7f622f2179c0 1 execute INFO: reshard of bucket "error-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-12T00:57:06.972 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.979+0000 7f60e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:06.977 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.983+0000 7f622f2179c0 20 remove_watcher() i=0 2024-09-12T00:57:06.978 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.983+0000 7f622f2179c0 2 removed watcher, disabling cache 2024-09-12T00:57:06.980 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.987+0000 7f622f2179c0 20 remove_watcher() i=1 2024-09-12T00:57:06.982 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.987+0000 7f622f2179c0 20 remove_watcher() i=2 2024-09-12T00:57:06.984 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.991+0000 7f622f2179c0 20 remove_watcher() i=3 2024-09-12T00:57:06.986 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.991+0000 7f622f2179c0 20 remove_watcher() i=4 2024-09-12T00:57:06.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.995+0000 7f622f2179c0 20 remove_watcher() i=5 2024-09-12T00:57:06.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.995+0000 7f622f2179c0 20 remove_watcher() i=6 2024-09-12T00:57:06.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:06.995+0000 7f622f2179c0 20 remove_watcher() i=7 2024-09-12T00:57:07.005 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:57:07.031 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:07.032 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:07.074 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.079+0000 7f1fdc2c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:07.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.083+0000 7f1fdc2c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:07.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.083+0000 7f1fdc2c49c0 20 realm 2024-09-12T00:57:07.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.083+0000 7f1fdc2c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:07.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.083+0000 7f1fdc2c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:07.077 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.083+0000 7f1fdc2c49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:07.077 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.083+0000 7f1fdc2c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:07.077 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.083+0000 7f1fdc2c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:07.077 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.083+0000 7f1fdc2c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:07.078 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.083+0000 7f1fdc2c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:07.078 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.083+0000 7f1fdc2c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:07.079 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.087+0000 7f1fdc2c49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:07.079 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.087+0000 7f1fdc2c49c0 20 searching for the correct realm 2024-09-12T00:57:07.084 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.091+0000 7f1fda5cb640 0 -- 172.21.15.70:0/1287599300 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f1fd0093100 msgr2=0x7f1fd0002390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:07.301 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.307+0000 7f1fda5cb640 0 -- 172.21.15.70:0/1287599300 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f1fd0093100 msgr2=0x7f1fd0002390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:07.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.319+0000 7f1fdc2c49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:07.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.319+0000 7f1fdc2c49c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:57:07.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.319+0000 7f1fdc2c49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:07.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.319+0000 7f1fdc2c49c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:57:07.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.319+0000 7f1fdc2c49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:07.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.319+0000 7f1fdc2c49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:07.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.319+0000 7f1fdc2c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:07.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.319+0000 7f1fdc2c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:07.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.319+0000 7f1fdc2c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:07.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.319+0000 7f1fdc2c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:07.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.319+0000 7f1fdc2c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:07.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.323+0000 7f1fdc2c49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:07.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.323+0000 7f1fdc2c49c0 20 zone default found 2024-09-12T00:57:07.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.323+0000 7f1fdc2c49c0 4 Realm: () 2024-09-12T00:57:07.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.323+0000 7f1fdc2c49c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:57:07.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.323+0000 7f1fdc2c49c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:57:07.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.323+0000 7f1fdc2c49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:07.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.323+0000 7f1fdc2c49c0 20 zonegroup default 2024-09-12T00:57:07.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.323+0000 7f1fdc2c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:07.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.323+0000 7f1fdc2c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:07.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.323+0000 7f1fdc2c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:07.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.323+0000 7f1fdc2c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:07.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.323+0000 7f1fdc2c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:07.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.323+0000 7f1fdc2c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:07.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.323+0000 7f1fdc2c49c0 20 started sync module instance, tier type = 2024-09-12T00:57:07.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.323+0000 7f1fdc2c49c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:57:07.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.355+0000 7f1fdc2c49c0 20 add_watcher() i=0 2024-09-12T00:57:07.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.355+0000 7f1fdc2c49c0 20 add_watcher() i=1 2024-09-12T00:57:07.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.355+0000 7f1fdc2c49c0 20 add_watcher() i=2 2024-09-12T00:57:07.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.355+0000 7f1fdc2c49c0 20 add_watcher() i=3 2024-09-12T00:57:07.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.355+0000 7f1fdc2c49c0 20 add_watcher() i=4 2024-09-12T00:57:07.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.355+0000 7f1fdc2c49c0 20 add_watcher() i=5 2024-09-12T00:57:07.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.355+0000 7f1fdc2c49c0 20 add_watcher() i=6 2024-09-12T00:57:07.350 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.355+0000 7f1fdc2c49c0 20 add_watcher() i=7 2024-09-12T00:57:07.351 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.355+0000 7f1fdc2c49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:07.354 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.359+0000 7f1e8b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:07.355 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.363+0000 7f1fdc2c49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:07.356 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.363+0000 7f1fdc2c49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:07.356 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.363+0000 7f1fdc2c49c0 5 note: GC not initialized 2024-09-12T00:57:07.356 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.363+0000 7f1e8a7fc640 20 reqs_thread_entry: start 2024-09-12T00:57:07.356 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.363+0000 7f1fdc2c49c0 20 init_complete bucket index max shards: 1 2024-09-12T00:57:07.356 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.363+0000 7f1fdc2c49c0 20 Filter name: none 2024-09-12T00:57:07.357 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.363+0000 7f1dfbfff640 20 reqs_thread_entry: start 2024-09-12T00:57:07.357 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.363+0000 7f1fdc2c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:07.357 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.363+0000 7f1fdc2c49c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:57:07.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.363+0000 7f1fdc2c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:07.359 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.363+0000 7f1fdc2c49c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:57:07.359 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.363+0000 7f1fdc2c49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:07.359 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.363+0000 7f1fdc2c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:07.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.367+0000 7f1fdc2c49c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:57:07.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.367+0000 7f1fdc2c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:07.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.367+0000 7f1fdc2c49c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:57:07.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.367+0000 7f1fdc2c49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:07.362 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.367+0000 7f1e8b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:07.368 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.375+0000 7f1fdc2c49c0 20 remove_watcher() i=0 2024-09-12T00:57:07.368 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.375+0000 7f1fdc2c49c0 2 removed watcher, disabling cache 2024-09-12T00:57:07.370 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.375+0000 7f1fdc2c49c0 20 remove_watcher() i=1 2024-09-12T00:57:07.372 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.379+0000 7f1fdc2c49c0 20 remove_watcher() i=2 2024-09-12T00:57:07.375 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.379+0000 7f1fdc2c49c0 20 remove_watcher() i=3 2024-09-12T00:57:07.377 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.383+0000 7f1fdc2c49c0 20 remove_watcher() i=4 2024-09-12T00:57:07.379 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.383+0000 7f1fdc2c49c0 20 remove_watcher() i=5 2024-09-12T00:57:07.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.387+0000 7f1fdc2c49c0 20 remove_watcher() i=6 2024-09-12T00:57:07.382 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:07.387+0000 7f1fdc2c49c0 20 remove_watcher() i=7 2024-09-12T00:57:07.405 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:07.406 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:57:07.406 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-do-reshard id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:57:07.406 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:07.407 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:07.407 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:07.411 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:07.411 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:07.461 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:07.462 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:07.485 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-12T00:57:07.485 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:07.488 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:07.488 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:07.513 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:07.514 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:07.559 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:07.559 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:07.579 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:07.579 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:07.598 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:07.598 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:07.617 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:07.617 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:07.634 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:07.634 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:07.653 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:07.653 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:07.672 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:07.672 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:07.691 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:07.691 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:07.708 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:07.709 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:07.727 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:07.727 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:07.745 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:07.746 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:07.764 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:07.764 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:07.783 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:07.784 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:07.803 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:07.803 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:07.820 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:07.821 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:07.839 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:07.839 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:07.859 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:07.860 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:07.878 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:07.878 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:07.896 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:07.897 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:07.915 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:07.915 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:07.932 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:57:07.965 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:07.965 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:08.009 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.015+0000 7f8ab9cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.011 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.015+0000 7f8ab9cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.011 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.015+0000 7f8ab9cd09c0 20 realm 2024-09-12T00:57:08.011 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.015+0000 7f8ab9cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.011 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.019+0000 7f8ab9cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.011 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.019+0000 7f8ab9cd09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:08.011 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.019+0000 7f8ab9cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.012 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.019+0000 7f8ab9cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.012 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.019+0000 7f8ab9cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.013 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.019+0000 7f8ab9cd09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:08.013 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.019+0000 7f8ab9cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.014 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.019+0000 7f8ab9cd09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:08.014 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.019+0000 7f8ab9cd09c0 20 searching for the correct realm 2024-09-12T00:57:08.018 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.023+0000 7f8ab7fd7640 0 -- 172.21.15.70:0/502642310 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f8aa0035040 msgr2=0x7f8aa0041410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:08.233 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.239+0000 7f8ab7fd7640 0 -- 172.21.15.70:0/502642310 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f8aa0035040 msgr2=0x7f8aa0041410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:08.245 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.251+0000 7f8ab9cd09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:08.245 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.251+0000 7f8ab9cd09c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:57:08.245 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.251+0000 7f8ab9cd09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:08.245 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.251+0000 7f8ab9cd09c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:57:08.245 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.251+0000 7f8ab9cd09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:08.245 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.251+0000 7f8ab9cd09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:08.245 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.251+0000 7f8ab9cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.251+0000 7f8ab9cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.251+0000 7f8ab9cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.251+0000 7f8ab9cd09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:08.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.251+0000 7f8ab9cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.255+0000 7f8ab9cd09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:08.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.255+0000 7f8ab9cd09c0 20 zone default found 2024-09-12T00:57:08.247 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.255+0000 7f8ab9cd09c0 4 Realm: () 2024-09-12T00:57:08.248 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.255+0000 7f8ab9cd09c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:57:08.248 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.255+0000 7f8ab9cd09c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:57:08.248 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.255+0000 7f8ab9cd09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:08.248 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.255+0000 7f8ab9cd09c0 20 zonegroup default 2024-09-12T00:57:08.248 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.255+0000 7f8ab9cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.248 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.255+0000 7f8ab9cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.249 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.255+0000 7f8ab9cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.249 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.255+0000 7f8ab9cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.249 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.255+0000 7f8ab9cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.250 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.255+0000 7f8ab9cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.250 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.255+0000 7f8ab9cd09c0 20 started sync module instance, tier type = 2024-09-12T00:57:08.250 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.255+0000 7f8ab9cd09c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:57:08.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.283+0000 7f8ab9cd09c0 20 add_watcher() i=0 2024-09-12T00:57:08.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.283+0000 7f8ab9cd09c0 20 add_watcher() i=1 2024-09-12T00:57:08.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.283+0000 7f8ab9cd09c0 20 add_watcher() i=2 2024-09-12T00:57:08.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.283+0000 7f8ab9cd09c0 20 add_watcher() i=3 2024-09-12T00:57:08.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.283+0000 7f8ab9cd09c0 20 add_watcher() i=4 2024-09-12T00:57:08.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.283+0000 7f8ab9cd09c0 20 add_watcher() i=5 2024-09-12T00:57:08.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.283+0000 7f8ab9cd09c0 20 add_watcher() i=6 2024-09-12T00:57:08.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.283+0000 7f8ab9cd09c0 20 add_watcher() i=7 2024-09-12T00:57:08.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.283+0000 7f8ab9cd09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:08.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.291+0000 7f896dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:08.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.291+0000 7f8ab9cd09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:08.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.291+0000 7f8ab9cd09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:08.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.291+0000 7f8ab9cd09c0 5 note: GC not initialized 2024-09-12T00:57:08.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.291+0000 7f896cfe1640 20 reqs_thread_entry: start 2024-09-12T00:57:08.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.291+0000 7f8ab9cd09c0 20 init_complete bucket index max shards: 1 2024-09-12T00:57:08.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.291+0000 7f8ab9cd09c0 20 Filter name: none 2024-09-12T00:57:08.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.291+0000 7f88e67fc640 20 reqs_thread_entry: start 2024-09-12T00:57:08.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.291+0000 7f8ab9cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.288 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.295+0000 7f8ab9cd09c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:57:08.288 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.295+0000 7f8ab9cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.295+0000 7f8ab9cd09c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:57:08.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.295+0000 7f8ab9cd09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:08.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.295+0000 7f8ab9cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.290 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.295+0000 7f8ab9cd09c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:57:08.290 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.295+0000 7f8ab9cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.291 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.295+0000 7f8ab9cd09c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:57:08.291 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.295+0000 7f8ab9cd09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:08.293 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.299+0000 7f896dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:08.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.303+0000 7f8ab9cd09c0 20 remove_watcher() i=0 2024-09-12T00:57:08.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.303+0000 7f8ab9cd09c0 2 removed watcher, disabling cache 2024-09-12T00:57:08.300 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.307+0000 7f8ab9cd09c0 20 remove_watcher() i=1 2024-09-12T00:57:08.302 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.307+0000 7f8ab9cd09c0 20 remove_watcher() i=2 2024-09-12T00:57:08.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.311+0000 7f8ab9cd09c0 20 remove_watcher() i=3 2024-09-12T00:57:08.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.311+0000 7f8ab9cd09c0 20 remove_watcher() i=4 2024-09-12T00:57:08.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.315+0000 7f8ab9cd09c0 20 remove_watcher() i=5 2024-09-12T00:57:08.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.315+0000 7f8ab9cd09c0 20 remove_watcher() i=6 2024-09-12T00:57:08.311 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.319+0000 7f8ab9cd09c0 20 remove_watcher() i=7 2024-09-12T00:57:08.326 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.326 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:57:08.326 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: abort-at-do-reshard id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:57:08.326 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.327 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:57:08.359 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:08.359 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:08.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.407+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.405 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.411+0000 7f2128c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.406 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.411+0000 7f2128c869c0 20 realm 2024-09-12T00:57:08.406 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.411+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.406 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.411+0000 7f2128c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.406 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.411+0000 7f2128c869c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:08.406 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.411+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.406 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.411+0000 7f2128c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.406 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.411+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.407 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.411+0000 7f2128c869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:08.407 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.411+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.408 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.415+0000 7f2128c869c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:08.408 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.415+0000 7f2128c869c0 20 searching for the correct realm 2024-09-12T00:57:08.412 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.419+0000 7f2126f8d640 0 -- 172.21.15.70:0/1003195127 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f21100c0020 msgr2=0x7f21100eda20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:08.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.635+0000 7f2126f8d640 0 -- 172.21.15.70:0/1003195127 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f21100c0020 msgr2=0x7f21100eda20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:08.642 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.647+0000 7f2128c869c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:08.642 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.647+0000 7f2128c869c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:57:08.642 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.647+0000 7f2128c869c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:08.642 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.647+0000 7f2128c869c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:57:08.642 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.647+0000 7f2128c869c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:08.642 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.647+0000 7f2128c869c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:08.642 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.647+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.642 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.647+0000 7f2128c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.643 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.647+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.643 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.647+0000 7f2128c869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:08.643 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.647+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.644 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.651+0000 7f2128c869c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:08.644 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.651+0000 7f2128c869c0 20 zone default found 2024-09-12T00:57:08.644 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.651+0000 7f2128c869c0 4 Realm: () 2024-09-12T00:57:08.644 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.651+0000 7f2128c869c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:57:08.644 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.651+0000 7f2128c869c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:57:08.644 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.651+0000 7f2128c869c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:08.644 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.651+0000 7f2128c869c0 20 zonegroup default 2024-09-12T00:57:08.644 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.651+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.645 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.651+0000 7f2128c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.645 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.651+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.645 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.651+0000 7f2128c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.646 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.651+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.646 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.651+0000 7f2128c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.646 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.651+0000 7f2128c869c0 20 started sync module instance, tier type = 2024-09-12T00:57:08.647 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.651+0000 7f2128c869c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:57:08.670 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.675+0000 7f2128c869c0 20 add_watcher() i=0 2024-09-12T00:57:08.670 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.675+0000 7f2128c869c0 20 add_watcher() i=1 2024-09-12T00:57:08.671 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.675+0000 7f2128c869c0 20 add_watcher() i=2 2024-09-12T00:57:08.671 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.675+0000 7f2128c869c0 20 add_watcher() i=3 2024-09-12T00:57:08.671 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.675+0000 7f2128c869c0 20 add_watcher() i=4 2024-09-12T00:57:08.671 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.675+0000 7f2128c869c0 20 add_watcher() i=5 2024-09-12T00:57:08.671 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.675+0000 7f2128c869c0 20 add_watcher() i=6 2024-09-12T00:57:08.672 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.679+0000 7f2128c869c0 20 add_watcher() i=7 2024-09-12T00:57:08.672 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.679+0000 7f2128c869c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:08.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.683+0000 7f1fdcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:08.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.683+0000 7f2128c869c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:08.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.683+0000 7f2128c869c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:08.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.683+0000 7f2128c869c0 5 note: GC not initialized 2024-09-12T00:57:08.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.683+0000 7f1f577fe640 20 reqs_thread_entry: start 2024-09-12T00:57:08.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.683+0000 7f2128c869c0 20 init_complete bucket index max shards: 1 2024-09-12T00:57:08.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.683+0000 7f2128c869c0 20 Filter name: none 2024-09-12T00:57:08.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.683+0000 7f1f557fa640 20 reqs_thread_entry: start 2024-09-12T00:57:08.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.683+0000 7f2128c869c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:57:08.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.683+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.687+0000 7f2128c869c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:57:08.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.687+0000 7f2128c869c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:57:08.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.687+0000 7f2128c869c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:57:08.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.687+0000 7f2128c869c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 : miss 2024-09-12T00:57:08.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.687+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.687+0000 7f2128c869c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:57:08.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.687+0000 7f2128c869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 info.flags=0x17 2024-09-12T00:57:08.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.687+0000 7f2128c869c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 to cache LRU end 2024-09-12T00:57:08.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.687+0000 7f2128c869c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:57:08.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.687+0000 7f2128c869c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:08.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.687+0000 7f2128c869c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 2024-09-12T00:57:08.689 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.695+0000 7f2128c869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 info.flags=0x17 2024-09-12T00:57:08.689 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.695+0000 7f2128c869c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 to cache LRU end 2024-09-12T00:57:08.689 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.695+0000 7f2128c869c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:08.689 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.695+0000 7f2128c869c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35, ofs0, ns] 2024-09-12T00:57:08.689 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.695+0000 7f2009ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431621 cookie 94689585903424 notifier 7593 bl.length()=995 2024-09-12T00:57:08.689 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.695+0000 7f2009ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 info.flags=0x17 2024-09-12T00:57:08.690 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.695+0000 7f2009ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 to cache LRU end 2024-09-12T00:57:08.690 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.695+0000 7f2009ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:08.690 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.695+0000 7f2128c869c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35]): orig_sources= new_sources= 2024-09-12T00:57:08.691 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.695+0000 7f2128c869c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35]): potential sources added=[] removed=[] 2024-09-12T00:57:08.691 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.695+0000 7f2128c869c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35]): orig_dests= new_dests= 2024-09-12T00:57:08.691 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.695+0000 7f2128c869c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35]): potential dests added=[] removed=[] 2024-09-12T00:57:08.695 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2128c869c0 time 2024-09-12T00:57:08.707018+0000 2024-09-12T00:57:08.695 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:57:08.697 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:57:08.697 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f212c5602eb] 2024-09-12T00:57:08.697 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f212c56049f] 2024-09-12T00:57:08.697 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561ea1e7bcc1] 2024-09-12T00:57:08.697 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561ea1e90d5a] 2024-09-12T00:57:08.697 INFO:tasks.workunit.client.0.smithi070.stderr: 5: main() 2024-09-12T00:57:08.697 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f212b3c6d90] 2024-09-12T00:57:08.697 INFO:tasks.workunit.client.0.smithi070.stderr: 7: __libc_start_main() 2024-09-12T00:57:08.697 INFO:tasks.workunit.client.0.smithi070.stderr: 8: _start() 2024-09-12T00:57:08.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.703+0000 7f2128c869c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2128c869c0 time 2024-09-12T00:57:08.707018+0000 2024-09-12T00:57:08.697 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:57:08.697 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.698 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:57:08.698 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f212c5602eb] 2024-09-12T00:57:08.698 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f212c56049f] 2024-09-12T00:57:08.698 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561ea1e7bcc1] 2024-09-12T00:57:08.698 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561ea1e90d5a] 2024-09-12T00:57:08.698 INFO:tasks.workunit.client.0.smithi070.stderr: 5: main() 2024-09-12T00:57:08.698 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f212b3c6d90] 2024-09-12T00:57:08.698 INFO:tasks.workunit.client.0.smithi070.stderr: 7: __libc_start_main() 2024-09-12T00:57:08.698 INFO:tasks.workunit.client.0.smithi070.stderr: 8: _start() 2024-09-12T00:57:08.698 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.698 INFO:tasks.workunit.client.0.smithi070.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:57:08.698 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f2128c869c0 thread_name:radosgw-admin 2024-09-12T00:57:08.714 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:57:08.714 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f212b3df520] 2024-09-12T00:57:08.714 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:57:08.714 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:57:08.714 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:57:08.714 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f212c560345] 2024-09-12T00:57:08.714 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f212c56049f] 2024-09-12T00:57:08.715 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561ea1e7bcc1] 2024-09-12T00:57:08.715 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561ea1e90d5a] 2024-09-12T00:57:08.715 INFO:tasks.workunit.client.0.smithi070.stderr: 9: main() 2024-09-12T00:57:08.715 INFO:tasks.workunit.client.0.smithi070.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f212b3c6d90] 2024-09-12T00:57:08.715 INFO:tasks.workunit.client.0.smithi070.stderr: 11: __libc_start_main() 2024-09-12T00:57:08.715 INFO:tasks.workunit.client.0.smithi070.stderr: 12: _start() 2024-09-12T00:57:08.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.703+0000 7f2128c869c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:57:08.715 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f2128c869c0 thread_name:radosgw-admin 2024-09-12T00:57:08.715 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.715 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:57:08.715 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f212b3df520] 2024-09-12T00:57:08.715 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:57:08.715 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:57:08.716 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:57:08.716 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f212c560345] 2024-09-12T00:57:08.716 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f212c56049f] 2024-09-12T00:57:08.716 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561ea1e7bcc1] 2024-09-12T00:57:08.716 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561ea1e90d5a] 2024-09-12T00:57:08.716 INFO:tasks.workunit.client.0.smithi070.stderr: 9: main() 2024-09-12T00:57:08.716 INFO:tasks.workunit.client.0.smithi070.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f212b3c6d90] 2024-09-12T00:57:08.716 INFO:tasks.workunit.client.0.smithi070.stderr: 11: __libc_start_main() 2024-09-12T00:57:08.716 INFO:tasks.workunit.client.0.smithi070.stderr: 12: _start() 2024-09-12T00:57:08.716 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:57:08.716 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.716 INFO:tasks.workunit.client.0.smithi070.stderr:--- begin dump of recent events --- 2024-09-12T00:57:08.716 INFO:tasks.workunit.client.0.smithi070.stderr: -499> 2024-09-12T00:57:08.387+0000 7f2126f8d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:08.717 INFO:tasks.workunit.client.0.smithi070.stderr: -498> 2024-09-12T00:57:08.387+0000 7f2126f8d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:08.717 INFO:tasks.workunit.client.0.smithi070.stderr: -497> 2024-09-12T00:57:08.387+0000 7f212678c640 10 monclient(hunting): get_auth_request con 0x561ea2fcf4e0 auth_method 0 2024-09-12T00:57:08.717 INFO:tasks.workunit.client.0.smithi070.stderr: -496> 2024-09-12T00:57:08.387+0000 7f212678c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:08.717 INFO:tasks.workunit.client.0.smithi070.stderr: -495> 2024-09-12T00:57:08.387+0000 7f212678c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:08.717 INFO:tasks.workunit.client.0.smithi070.stderr: -494> 2024-09-12T00:57:08.387+0000 7f212678c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:08.717 INFO:tasks.workunit.client.0.smithi070.stderr: -493> 2024-09-12T00:57:08.387+0000 7f2126f8d640 10 monclient(hunting): handle_auth_done global_id 7127 payload 274 2024-09-12T00:57:08.717 INFO:tasks.workunit.client.0.smithi070.stderr: -492> 2024-09-12T00:57:08.387+0000 7f2126f8d640 10 monclient: _finish_hunting 0 2024-09-12T00:57:08.717 INFO:tasks.workunit.client.0.smithi070.stderr: -491> 2024-09-12T00:57:08.387+0000 7f2126f8d640 1 monclient: found mon.noname-c 2024-09-12T00:57:08.718 INFO:tasks.workunit.client.0.smithi070.stderr: -490> 2024-09-12T00:57:08.387+0000 7f2126f8d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:57:08.718 INFO:tasks.workunit.client.0.smithi070.stderr: -489> 2024-09-12T00:57:08.387+0000 7f2014608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:08.718 INFO:tasks.workunit.client.0.smithi070.stderr: -488> 2024-09-12T00:57:08.387+0000 7f2014608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:57:08.718 INFO:tasks.workunit.client.0.smithi070.stderr: -487> 2024-09-12T00:57:08.387+0000 7f2014608640 10 monclient: dump: 2024-09-12T00:57:08.718 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:08.718 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:08.718 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.719 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.719 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:08.719 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.719 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:08.719 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:08.719 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:08.719 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.720 INFO:tasks.workunit.client.0.smithi070.stderr: -486> 2024-09-12T00:57:08.387+0000 7f2014608640 10 monclient: _finish_auth 0 2024-09-12T00:57:08.720 INFO:tasks.workunit.client.0.smithi070.stderr: -485> 2024-09-12T00:57:08.387+0000 7f2014608640 10 monclient: _check_auth_tickets 2024-09-12T00:57:08.720 INFO:tasks.workunit.client.0.smithi070.stderr: -484> 2024-09-12T00:57:08.387+0000 7f2128c869c0 5 monclient: authenticate success, global_id 7127 2024-09-12T00:57:08.720 INFO:tasks.workunit.client.0.smithi070.stderr: -483> 2024-09-12T00:57:08.387+0000 7f2014608640 10 monclient: handle_config config(0 keys) 2024-09-12T00:57:08.720 INFO:tasks.workunit.client.0.smithi070.stderr: -482> 2024-09-12T00:57:08.387+0000 7f2014608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:08.720 INFO:tasks.workunit.client.0.smithi070.stderr: -481> 2024-09-12T00:57:08.387+0000 7f2014608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:57:08.720 INFO:tasks.workunit.client.0.smithi070.stderr: -480> 2024-09-12T00:57:08.387+0000 7f2014608640 10 monclient: dump: 2024-09-12T00:57:08.720 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:08.720 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:08.720 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.720 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.721 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:08.721 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.721 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:08.721 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:08.721 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:08.721 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.721 INFO:tasks.workunit.client.0.smithi070.stderr: -479> 2024-09-12T00:57:08.387+0000 7f2128c869c0 10 monclient: get_monmap_and_config success 2024-09-12T00:57:08.721 INFO:tasks.workunit.client.0.smithi070.stderr: -478> 2024-09-12T00:57:08.387+0000 7f2128c869c0 4 set_mon_vals no callback set 2024-09-12T00:57:08.721 INFO:tasks.workunit.client.0.smithi070.stderr: -477> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient: shutdown 2024-09-12T00:57:08.721 INFO:tasks.workunit.client.0.smithi070.stderr: -476> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 asok(0x561ea2f112b0) unregister_commands rotate-key 2024-09-12T00:57:08.721 INFO:tasks.workunit.client.0.smithi070.stderr: -475> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient: build_initial_monmap 2024-09-12T00:57:08.721 INFO:tasks.workunit.client.0.smithi070.stderr: -474> 2024-09-12T00:57:08.391+0000 7f2128c869c0 1 build_initial for_mkfs: 0 2024-09-12T00:57:08.721 INFO:tasks.workunit.client.0.smithi070.stderr: -473> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient: monmap: 2024-09-12T00:57:08.721 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:57:08.722 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:57:08.722 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:57:08.722 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:57:08.722 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:57:08.722 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.722 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:57:08.722 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:57:08.722 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:57:08.722 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.722 INFO:tasks.workunit.client.0.smithi070.stderr: -472> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding auth protocol: cephx 2024-09-12T00:57:08.722 INFO:tasks.workunit.client.0.smithi070.stderr: -471> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding auth protocol: cephx 2024-09-12T00:57:08.722 INFO:tasks.workunit.client.0.smithi070.stderr: -470> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding auth protocol: cephx 2024-09-12T00:57:08.722 INFO:tasks.workunit.client.0.smithi070.stderr: -469> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding con mode: secure 2024-09-12T00:57:08.722 INFO:tasks.workunit.client.0.smithi070.stderr: -468> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding con mode: crc 2024-09-12T00:57:08.723 INFO:tasks.workunit.client.0.smithi070.stderr: -467> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding con mode: secure 2024-09-12T00:57:08.723 INFO:tasks.workunit.client.0.smithi070.stderr: -466> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding con mode: crc 2024-09-12T00:57:08.723 INFO:tasks.workunit.client.0.smithi070.stderr: -465> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding con mode: secure 2024-09-12T00:57:08.723 INFO:tasks.workunit.client.0.smithi070.stderr: -464> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding con mode: crc 2024-09-12T00:57:08.723 INFO:tasks.workunit.client.0.smithi070.stderr: -463> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding con mode: crc 2024-09-12T00:57:08.723 INFO:tasks.workunit.client.0.smithi070.stderr: -462> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding con mode: secure 2024-09-12T00:57:08.723 INFO:tasks.workunit.client.0.smithi070.stderr: -461> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding con mode: crc 2024-09-12T00:57:08.723 INFO:tasks.workunit.client.0.smithi070.stderr: -460> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding con mode: secure 2024-09-12T00:57:08.723 INFO:tasks.workunit.client.0.smithi070.stderr: -459> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding con mode: crc 2024-09-12T00:57:08.723 INFO:tasks.workunit.client.0.smithi070.stderr: -458> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding con mode: secure 2024-09-12T00:57:08.723 INFO:tasks.workunit.client.0.smithi070.stderr: -457> 2024-09-12T00:57:08.391+0000 7f2128c869c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:08.723 INFO:tasks.workunit.client.0.smithi070.stderr: -456> 2024-09-12T00:57:08.391+0000 7f2128c869c0 1 librados: starting msgr at 2024-09-12T00:57:08.723 INFO:tasks.workunit.client.0.smithi070.stderr: -455> 2024-09-12T00:57:08.391+0000 7f2128c869c0 1 librados: starting objecter 2024-09-12T00:57:08.723 INFO:tasks.workunit.client.0.smithi070.stderr: -454> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command objecter_requests hook 0x561ea31267b0 2024-09-12T00:57:08.724 INFO:tasks.workunit.client.0.smithi070.stderr: -453> 2024-09-12T00:57:08.391+0000 7f2128c869c0 1 librados: setting wanted keys 2024-09-12T00:57:08.724 INFO:tasks.workunit.client.0.smithi070.stderr: -452> 2024-09-12T00:57:08.391+0000 7f2128c869c0 1 librados: calling monclient init 2024-09-12T00:57:08.724 INFO:tasks.workunit.client.0.smithi070.stderr: -451> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient: init 2024-09-12T00:57:08.724 INFO:tasks.workunit.client.0.smithi070.stderr: -450> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding auth protocol: cephx 2024-09-12T00:57:08.724 INFO:tasks.workunit.client.0.smithi070.stderr: -449> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding auth protocol: cephx 2024-09-12T00:57:08.724 INFO:tasks.workunit.client.0.smithi070.stderr: -448> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding auth protocol: cephx 2024-09-12T00:57:08.724 INFO:tasks.workunit.client.0.smithi070.stderr: -447> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding con mode: secure 2024-09-12T00:57:08.724 INFO:tasks.workunit.client.0.smithi070.stderr: -446> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding con mode: crc 2024-09-12T00:57:08.724 INFO:tasks.workunit.client.0.smithi070.stderr: -445> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding con mode: secure 2024-09-12T00:57:08.724 INFO:tasks.workunit.client.0.smithi070.stderr: -444> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding con mode: crc 2024-09-12T00:57:08.724 INFO:tasks.workunit.client.0.smithi070.stderr: -443> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding con mode: secure 2024-09-12T00:57:08.724 INFO:tasks.workunit.client.0.smithi070.stderr: -442> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding con mode: crc 2024-09-12T00:57:08.724 INFO:tasks.workunit.client.0.smithi070.stderr: -441> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding con mode: crc 2024-09-12T00:57:08.725 INFO:tasks.workunit.client.0.smithi070.stderr: -440> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding con mode: secure 2024-09-12T00:57:08.725 INFO:tasks.workunit.client.0.smithi070.stderr: -439> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding con mode: crc 2024-09-12T00:57:08.725 INFO:tasks.workunit.client.0.smithi070.stderr: -438> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding con mode: secure 2024-09-12T00:57:08.725 INFO:tasks.workunit.client.0.smithi070.stderr: -437> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding con mode: crc 2024-09-12T00:57:08.725 INFO:tasks.workunit.client.0.smithi070.stderr: -436> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding con mode: secure 2024-09-12T00:57:08.725 INFO:tasks.workunit.client.0.smithi070.stderr: -435> 2024-09-12T00:57:08.391+0000 7f2128c869c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:08.725 INFO:tasks.workunit.client.0.smithi070.stderr: -434> 2024-09-12T00:57:08.391+0000 7f2128c869c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:08.725 INFO:tasks.workunit.client.0.smithi070.stderr: -433> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command rotate-key hook 0x561ea311f248 2024-09-12T00:57:08.725 INFO:tasks.workunit.client.0.smithi070.stderr: -432> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient: _reopen_session rank -1 2024-09-12T00:57:08.725 INFO:tasks.workunit.client.0.smithi070.stderr: -431> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:57:08.725 INFO:tasks.workunit.client.0.smithi070.stderr: -430> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient(hunting): picked mon.noname-c con 0x561ea2fcf4e0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:57:08.725 INFO:tasks.workunit.client.0.smithi070.stderr: -429> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient(hunting): picked mon.noname-a con 0x561ea2fdb330 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:57:08.725 INFO:tasks.workunit.client.0.smithi070.stderr: -428> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient(hunting): picked mon.noname-b con 0x561ea3123270 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:57:08.725 INFO:tasks.workunit.client.0.smithi070.stderr: -427> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:08.726 INFO:tasks.workunit.client.0.smithi070.stderr: -426> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:08.726 INFO:tasks.workunit.client.0.smithi070.stderr: -425> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:08.726 INFO:tasks.workunit.client.0.smithi070.stderr: -424> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient(hunting): _renew_subs 2024-09-12T00:57:08.726 INFO:tasks.workunit.client.0.smithi070.stderr: -423> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient(hunting): authenticate will time out at 2278.841535s 2024-09-12T00:57:08.726 INFO:tasks.workunit.client.0.smithi070.stderr: -422> 2024-09-12T00:57:08.391+0000 7f2125f8b640 10 monclient(hunting): get_auth_request con 0x561ea2fdb330 auth_method 0 2024-09-12T00:57:08.726 INFO:tasks.workunit.client.0.smithi070.stderr: -421> 2024-09-12T00:57:08.391+0000 7f2125f8b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:08.726 INFO:tasks.workunit.client.0.smithi070.stderr: -420> 2024-09-12T00:57:08.391+0000 7f2125f8b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:08.726 INFO:tasks.workunit.client.0.smithi070.stderr: -419> 2024-09-12T00:57:08.391+0000 7f2125f8b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:08.726 INFO:tasks.workunit.client.0.smithi070.stderr: -418> 2024-09-12T00:57:08.391+0000 7f212678c640 10 monclient(hunting): get_auth_request con 0x561ea2fcf4e0 auth_method 0 2024-09-12T00:57:08.726 INFO:tasks.workunit.client.0.smithi070.stderr: -417> 2024-09-12T00:57:08.391+0000 7f212678c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:08.726 INFO:tasks.workunit.client.0.smithi070.stderr: -416> 2024-09-12T00:57:08.391+0000 7f212678c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:08.726 INFO:tasks.workunit.client.0.smithi070.stderr: -415> 2024-09-12T00:57:08.391+0000 7f212678c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:08.726 INFO:tasks.workunit.client.0.smithi070.stderr: -414> 2024-09-12T00:57:08.391+0000 7f2125f8b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:08.726 INFO:tasks.workunit.client.0.smithi070.stderr: -413> 2024-09-12T00:57:08.391+0000 7f2125f8b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:08.727 INFO:tasks.workunit.client.0.smithi070.stderr: -412> 2024-09-12T00:57:08.391+0000 7f2125f8b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:08.727 INFO:tasks.workunit.client.0.smithi070.stderr: -411> 2024-09-12T00:57:08.391+0000 7f212678c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:08.727 INFO:tasks.workunit.client.0.smithi070.stderr: -410> 2024-09-12T00:57:08.391+0000 7f212678c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:08.727 INFO:tasks.workunit.client.0.smithi070.stderr: -409> 2024-09-12T00:57:08.391+0000 7f212678c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:08.727 INFO:tasks.workunit.client.0.smithi070.stderr: -408> 2024-09-12T00:57:08.391+0000 7f2125f8b640 10 monclient(hunting): handle_auth_done global_id 7584 payload 824 2024-09-12T00:57:08.727 INFO:tasks.workunit.client.0.smithi070.stderr: -407> 2024-09-12T00:57:08.391+0000 7f2125f8b640 10 monclient: _finish_hunting 0 2024-09-12T00:57:08.727 INFO:tasks.workunit.client.0.smithi070.stderr: -406> 2024-09-12T00:57:08.391+0000 7f2125f8b640 1 monclient: found mon.noname-a 2024-09-12T00:57:08.727 INFO:tasks.workunit.client.0.smithi070.stderr: -405> 2024-09-12T00:57:08.391+0000 7f2125f8b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:57:08.727 INFO:tasks.workunit.client.0.smithi070.stderr: -404> 2024-09-12T00:57:08.391+0000 7f2126f8d640 10 monclient: get_auth_request con 0x561ea3123270 auth_method 0 2024-09-12T00:57:08.727 INFO:tasks.workunit.client.0.smithi070.stderr: -403> 2024-09-12T00:57:08.391+0000 7f2012e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:08.727 INFO:tasks.workunit.client.0.smithi070.stderr: -402> 2024-09-12T00:57:08.391+0000 7f2012e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:57:08.727 INFO:tasks.workunit.client.0.smithi070.stderr: -401> 2024-09-12T00:57:08.391+0000 7f2012e05640 10 monclient: dump: 2024-09-12T00:57:08.727 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:08.728 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:08.728 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.728 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.728 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:08.728 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.728 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:08.728 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:08.728 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:08.728 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.728 INFO:tasks.workunit.client.0.smithi070.stderr: -400> 2024-09-12T00:57:08.391+0000 7f2012e05640 10 monclient: _finish_auth 0 2024-09-12T00:57:08.728 INFO:tasks.workunit.client.0.smithi070.stderr: -399> 2024-09-12T00:57:08.391+0000 7f2012e05640 10 monclient: _check_auth_tickets 2024-09-12T00:57:08.728 INFO:tasks.workunit.client.0.smithi070.stderr: -398> 2024-09-12T00:57:08.391+0000 7f2012e05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:57:08.728 INFO:tasks.workunit.client.0.smithi070.stderr: -397> 2024-09-12T00:57:08.391+0000 7f2012e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:08.728 INFO:tasks.workunit.client.0.smithi070.stderr: -396> 2024-09-12T00:57:08.391+0000 7f2012e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:57:08.729 INFO:tasks.workunit.client.0.smithi070.stderr: -395> 2024-09-12T00:57:08.391+0000 7f2012e05640 10 monclient: dump: 2024-09-12T00:57:08.729 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:08.729 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:08.729 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.729 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.729 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:08.729 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.729 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:08.729 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:08.729 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:08.729 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.729 INFO:tasks.workunit.client.0.smithi070.stderr: -394> 2024-09-12T00:57:08.391+0000 7f2014608640 4 set_mon_vals no callback set 2024-09-12T00:57:08.729 INFO:tasks.workunit.client.0.smithi070.stderr: -393> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 monclient: authenticate success, global_id 7584 2024-09-12T00:57:08.729 INFO:tasks.workunit.client.0.smithi070.stderr: -392> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient: _renew_subs 2024-09-12T00:57:08.730 INFO:tasks.workunit.client.0.smithi070.stderr: -391> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:57:08.730 INFO:tasks.workunit.client.0.smithi070.stderr: -390> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient: _renew_subs 2024-09-12T00:57:08.730 INFO:tasks.workunit.client.0.smithi070.stderr: -389> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:57:08.730 INFO:tasks.workunit.client.0.smithi070.stderr: -388> 2024-09-12T00:57:08.391+0000 7f2128c869c0 1 librados: init done 2024-09-12T00:57:08.730 INFO:tasks.workunit.client.0.smithi070.stderr: -387> 2024-09-12T00:57:08.395+0000 7f2012e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:57:08.730 INFO:tasks.workunit.client.0.smithi070.stderr: -386> 2024-09-12T00:57:08.395+0000 7f2012e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:57:08.730 INFO:tasks.workunit.client.0.smithi070.stderr: -385> 2024-09-12T00:57:08.395+0000 7f2012e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:57:08.730 INFO:tasks.workunit.client.0.smithi070.stderr: -384> 2024-09-12T00:57:08.395+0000 7f212678c640 10 monclient: get_auth_request con 0x7f200c070ae0 auth_method 0 2024-09-12T00:57:08.730 INFO:tasks.workunit.client.0.smithi070.stderr: -383> 2024-09-12T00:57:08.395+0000 7f2126f8d640 10 monclient: get_auth_request con 0x561ea3166dd0 auth_method 0 2024-09-12T00:57:08.730 INFO:tasks.workunit.client.0.smithi070.stderr: -382> 2024-09-12T00:57:08.395+0000 7f212678c640 10 monclient: get_auth_request con 0x561ea3169fb0 auth_method 0 2024-09-12T00:57:08.730 INFO:tasks.workunit.client.0.smithi070.stderr: -381> 2024-09-12T00:57:08.395+0000 7f2125f8b640 10 monclient: get_auth_request con 0x561ea316e1a0 auth_method 0 2024-09-12T00:57:08.730 INFO:tasks.workunit.client.0.smithi070.stderr: -380> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient: build_initial_monmap 2024-09-12T00:57:08.730 INFO:tasks.workunit.client.0.smithi070.stderr: -379> 2024-09-12T00:57:08.399+0000 7f2128c869c0 1 build_initial for_mkfs: 0 2024-09-12T00:57:08.730 INFO:tasks.workunit.client.0.smithi070.stderr: -378> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient: monmap: 2024-09-12T00:57:08.731 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:57:08.731 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:57:08.731 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:57:08.731 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:57:08.731 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:57:08.731 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.731 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:57:08.731 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:57:08.731 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:57:08.731 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.731 INFO:tasks.workunit.client.0.smithi070.stderr: -377> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding auth protocol: cephx 2024-09-12T00:57:08.731 INFO:tasks.workunit.client.0.smithi070.stderr: -376> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding auth protocol: cephx 2024-09-12T00:57:08.731 INFO:tasks.workunit.client.0.smithi070.stderr: -375> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding auth protocol: cephx 2024-09-12T00:57:08.732 INFO:tasks.workunit.client.0.smithi070.stderr: -374> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding con mode: secure 2024-09-12T00:57:08.732 INFO:tasks.workunit.client.0.smithi070.stderr: -373> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding con mode: crc 2024-09-12T00:57:08.732 INFO:tasks.workunit.client.0.smithi070.stderr: -372> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding con mode: secure 2024-09-12T00:57:08.732 INFO:tasks.workunit.client.0.smithi070.stderr: -371> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding con mode: crc 2024-09-12T00:57:08.732 INFO:tasks.workunit.client.0.smithi070.stderr: -370> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding con mode: secure 2024-09-12T00:57:08.732 INFO:tasks.workunit.client.0.smithi070.stderr: -369> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding con mode: crc 2024-09-12T00:57:08.732 INFO:tasks.workunit.client.0.smithi070.stderr: -368> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding con mode: crc 2024-09-12T00:57:08.732 INFO:tasks.workunit.client.0.smithi070.stderr: -367> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding con mode: secure 2024-09-12T00:57:08.732 INFO:tasks.workunit.client.0.smithi070.stderr: -366> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding con mode: crc 2024-09-12T00:57:08.732 INFO:tasks.workunit.client.0.smithi070.stderr: -365> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding con mode: secure 2024-09-12T00:57:08.732 INFO:tasks.workunit.client.0.smithi070.stderr: -364> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding con mode: crc 2024-09-12T00:57:08.732 INFO:tasks.workunit.client.0.smithi070.stderr: -363> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding con mode: secure 2024-09-12T00:57:08.732 INFO:tasks.workunit.client.0.smithi070.stderr: -362> 2024-09-12T00:57:08.399+0000 7f2128c869c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:08.732 INFO:tasks.workunit.client.0.smithi070.stderr: -361> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command objecter_requests cmddesc objecter_requests hook 0x561ea3176820 EEXIST 2024-09-12T00:57:08.733 INFO:tasks.workunit.client.0.smithi070.stderr: -360> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient: init 2024-09-12T00:57:08.733 INFO:tasks.workunit.client.0.smithi070.stderr: -359> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding auth protocol: cephx 2024-09-12T00:57:08.733 INFO:tasks.workunit.client.0.smithi070.stderr: -358> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding auth protocol: cephx 2024-09-12T00:57:08.733 INFO:tasks.workunit.client.0.smithi070.stderr: -357> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding auth protocol: cephx 2024-09-12T00:57:08.733 INFO:tasks.workunit.client.0.smithi070.stderr: -356> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding con mode: secure 2024-09-12T00:57:08.733 INFO:tasks.workunit.client.0.smithi070.stderr: -355> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding con mode: crc 2024-09-12T00:57:08.733 INFO:tasks.workunit.client.0.smithi070.stderr: -354> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding con mode: secure 2024-09-12T00:57:08.733 INFO:tasks.workunit.client.0.smithi070.stderr: -353> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding con mode: crc 2024-09-12T00:57:08.733 INFO:tasks.workunit.client.0.smithi070.stderr: -352> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding con mode: secure 2024-09-12T00:57:08.733 INFO:tasks.workunit.client.0.smithi070.stderr: -351> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding con mode: crc 2024-09-12T00:57:08.733 INFO:tasks.workunit.client.0.smithi070.stderr: -350> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding con mode: crc 2024-09-12T00:57:08.733 INFO:tasks.workunit.client.0.smithi070.stderr: -349> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding con mode: secure 2024-09-12T00:57:08.733 INFO:tasks.workunit.client.0.smithi070.stderr: -348> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding con mode: crc 2024-09-12T00:57:08.734 INFO:tasks.workunit.client.0.smithi070.stderr: -347> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding con mode: secure 2024-09-12T00:57:08.734 INFO:tasks.workunit.client.0.smithi070.stderr: -346> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding con mode: crc 2024-09-12T00:57:08.734 INFO:tasks.workunit.client.0.smithi070.stderr: -345> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding con mode: secure 2024-09-12T00:57:08.734 INFO:tasks.workunit.client.0.smithi070.stderr: -344> 2024-09-12T00:57:08.399+0000 7f2128c869c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:08.734 INFO:tasks.workunit.client.0.smithi070.stderr: -343> 2024-09-12T00:57:08.399+0000 7f2128c869c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:08.734 INFO:tasks.workunit.client.0.smithi070.stderr: -342> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command rotate-key cmddesc rotate-key hook 0x561ea3171620 EEXIST 2024-09-12T00:57:08.734 INFO:tasks.workunit.client.0.smithi070.stderr: -341> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient: _reopen_session rank -1 2024-09-12T00:57:08.734 INFO:tasks.workunit.client.0.smithi070.stderr: -340> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:57:08.734 INFO:tasks.workunit.client.0.smithi070.stderr: -339> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient(hunting): picked mon.noname-a con 0x561ea319a9d0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:57:08.734 INFO:tasks.workunit.client.0.smithi070.stderr: -338> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient(hunting): picked mon.noname-c con 0x561ea319a300 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:57:08.734 INFO:tasks.workunit.client.0.smithi070.stderr: -337> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient(hunting): picked mon.noname-b con 0x561ea3198ce0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:57:08.734 INFO:tasks.workunit.client.0.smithi070.stderr: -336> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:08.734 INFO:tasks.workunit.client.0.smithi070.stderr: -335> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:08.734 INFO:tasks.workunit.client.0.smithi070.stderr: -334> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:08.735 INFO:tasks.workunit.client.0.smithi070.stderr: -333> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient(hunting): _renew_subs 2024-09-12T00:57:08.735 INFO:tasks.workunit.client.0.smithi070.stderr: -332> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient(hunting): authenticate will time out at 2278.850621s 2024-09-12T00:57:08.735 INFO:tasks.workunit.client.0.smithi070.stderr: -331> 2024-09-12T00:57:08.399+0000 7f2125f8b640 10 monclient(hunting): get_auth_request con 0x561ea319a300 auth_method 0 2024-09-12T00:57:08.735 INFO:tasks.workunit.client.0.smithi070.stderr: -330> 2024-09-12T00:57:08.399+0000 7f2125f8b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:08.735 INFO:tasks.workunit.client.0.smithi070.stderr: -329> 2024-09-12T00:57:08.399+0000 7f2125f8b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:08.735 INFO:tasks.workunit.client.0.smithi070.stderr: -328> 2024-09-12T00:57:08.399+0000 7f2125f8b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:08.735 INFO:tasks.workunit.client.0.smithi070.stderr: -327> 2024-09-12T00:57:08.399+0000 7f212678c640 10 monclient(hunting): get_auth_request con 0x561ea319a9d0 auth_method 0 2024-09-12T00:57:08.735 INFO:tasks.workunit.client.0.smithi070.stderr: -326> 2024-09-12T00:57:08.399+0000 7f212678c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:08.735 INFO:tasks.workunit.client.0.smithi070.stderr: -325> 2024-09-12T00:57:08.399+0000 7f212678c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:08.735 INFO:tasks.workunit.client.0.smithi070.stderr: -324> 2024-09-12T00:57:08.399+0000 7f212678c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:08.735 INFO:tasks.workunit.client.0.smithi070.stderr: -323> 2024-09-12T00:57:08.399+0000 7f2125f8b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:08.735 INFO:tasks.workunit.client.0.smithi070.stderr: -322> 2024-09-12T00:57:08.399+0000 7f2125f8b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:08.735 INFO:tasks.workunit.client.0.smithi070.stderr: -321> 2024-09-12T00:57:08.399+0000 7f2125f8b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:08.735 INFO:tasks.workunit.client.0.smithi070.stderr: -320> 2024-09-12T00:57:08.399+0000 7f212678c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:08.736 INFO:tasks.workunit.client.0.smithi070.stderr: -319> 2024-09-12T00:57:08.399+0000 7f212678c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:08.736 INFO:tasks.workunit.client.0.smithi070.stderr: -318> 2024-09-12T00:57:08.399+0000 7f212678c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:08.736 INFO:tasks.workunit.client.0.smithi070.stderr: -317> 2024-09-12T00:57:08.399+0000 7f2125f8b640 10 monclient(hunting): handle_auth_done global_id 7133 payload 824 2024-09-12T00:57:08.736 INFO:tasks.workunit.client.0.smithi070.stderr: -316> 2024-09-12T00:57:08.399+0000 7f2125f8b640 10 monclient: _finish_hunting 0 2024-09-12T00:57:08.736 INFO:tasks.workunit.client.0.smithi070.stderr: -315> 2024-09-12T00:57:08.399+0000 7f2125f8b640 1 monclient: found mon.noname-c 2024-09-12T00:57:08.736 INFO:tasks.workunit.client.0.smithi070.stderr: -314> 2024-09-12T00:57:08.399+0000 7f2125f8b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:57:08.736 INFO:tasks.workunit.client.0.smithi070.stderr: -313> 2024-09-12T00:57:08.399+0000 7f2126f8d640 10 monclient: get_auth_request con 0x561ea3198ce0 auth_method 0 2024-09-12T00:57:08.736 INFO:tasks.workunit.client.0.smithi070.stderr: -312> 2024-09-12T00:57:08.399+0000 7f200bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:08.736 INFO:tasks.workunit.client.0.smithi070.stderr: -311> 2024-09-12T00:57:08.399+0000 7f200bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:57:08.736 INFO:tasks.workunit.client.0.smithi070.stderr: -310> 2024-09-12T00:57:08.399+0000 7f200bfff640 10 monclient: dump: 2024-09-12T00:57:08.736 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:08.736 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:08.736 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.737 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.737 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:08.737 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.737 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:08.737 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:08.737 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:08.737 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.737 INFO:tasks.workunit.client.0.smithi070.stderr: -309> 2024-09-12T00:57:08.399+0000 7f200bfff640 10 monclient: _finish_auth 0 2024-09-12T00:57:08.737 INFO:tasks.workunit.client.0.smithi070.stderr: -308> 2024-09-12T00:57:08.399+0000 7f200bfff640 10 monclient: _check_auth_tickets 2024-09-12T00:57:08.737 INFO:tasks.workunit.client.0.smithi070.stderr: -307> 2024-09-12T00:57:08.399+0000 7f200bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:57:08.737 INFO:tasks.workunit.client.0.smithi070.stderr: -306> 2024-09-12T00:57:08.399+0000 7f200bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:08.737 INFO:tasks.workunit.client.0.smithi070.stderr: -305> 2024-09-12T00:57:08.399+0000 7f200bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:57:08.737 INFO:tasks.workunit.client.0.smithi070.stderr: -304> 2024-09-12T00:57:08.399+0000 7f200bfff640 10 monclient: dump: 2024-09-12T00:57:08.737 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:08.738 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:08.738 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.738 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.738 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:08.738 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.738 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:08.738 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:08.738 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:08.738 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.738 INFO:tasks.workunit.client.0.smithi070.stderr: -303> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 monclient: authenticate success, global_id 7133 2024-09-12T00:57:08.738 INFO:tasks.workunit.client.0.smithi070.stderr: -302> 2024-09-12T00:57:08.399+0000 7f212778e640 4 set_mon_vals no callback set 2024-09-12T00:57:08.738 INFO:tasks.workunit.client.0.smithi070.stderr: -301> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient: _renew_subs 2024-09-12T00:57:08.738 INFO:tasks.workunit.client.0.smithi070.stderr: -300> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:57:08.738 INFO:tasks.workunit.client.0.smithi070.stderr: -299> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient: _renew_subs 2024-09-12T00:57:08.739 INFO:tasks.workunit.client.0.smithi070.stderr: -298> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:57:08.739 INFO:tasks.workunit.client.0.smithi070.stderr: -297> 2024-09-12T00:57:08.403+0000 7f200bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:57:08.739 INFO:tasks.workunit.client.0.smithi070.stderr: -296> 2024-09-12T00:57:08.403+0000 7f200bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:57:08.739 INFO:tasks.workunit.client.0.smithi070.stderr: -295> 2024-09-12T00:57:08.403+0000 7f200bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:57:08.739 INFO:tasks.workunit.client.0.smithi070.stderr: -294> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient: get_monmap_and_config 2024-09-12T00:57:08.739 INFO:tasks.workunit.client.0.smithi070.stderr: -293> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient: build_initial_monmap 2024-09-12T00:57:08.739 INFO:tasks.workunit.client.0.smithi070.stderr: -292> 2024-09-12T00:57:08.403+0000 7f2128c869c0 1 build_initial for_mkfs: 0 2024-09-12T00:57:08.739 INFO:tasks.workunit.client.0.smithi070.stderr: -291> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient: monmap: 2024-09-12T00:57:08.739 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:57:08.739 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:57:08.739 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:57:08.739 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:57:08.739 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:57:08.740 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.740 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:57:08.740 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:57:08.740 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:57:08.740 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.740 INFO:tasks.workunit.client.0.smithi070.stderr: -290> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding auth protocol: cephx 2024-09-12T00:57:08.740 INFO:tasks.workunit.client.0.smithi070.stderr: -289> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding auth protocol: cephx 2024-09-12T00:57:08.740 INFO:tasks.workunit.client.0.smithi070.stderr: -288> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding auth protocol: cephx 2024-09-12T00:57:08.740 INFO:tasks.workunit.client.0.smithi070.stderr: -287> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding con mode: secure 2024-09-12T00:57:08.740 INFO:tasks.workunit.client.0.smithi070.stderr: -286> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding con mode: crc 2024-09-12T00:57:08.740 INFO:tasks.workunit.client.0.smithi070.stderr: -285> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding con mode: secure 2024-09-12T00:57:08.740 INFO:tasks.workunit.client.0.smithi070.stderr: -284> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding con mode: crc 2024-09-12T00:57:08.740 INFO:tasks.workunit.client.0.smithi070.stderr: -283> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding con mode: secure 2024-09-12T00:57:08.740 INFO:tasks.workunit.client.0.smithi070.stderr: -282> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding con mode: crc 2024-09-12T00:57:08.741 INFO:tasks.workunit.client.0.smithi070.stderr: -281> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding con mode: crc 2024-09-12T00:57:08.741 INFO:tasks.workunit.client.0.smithi070.stderr: -280> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding con mode: secure 2024-09-12T00:57:08.741 INFO:tasks.workunit.client.0.smithi070.stderr: -279> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding con mode: crc 2024-09-12T00:57:08.741 INFO:tasks.workunit.client.0.smithi070.stderr: -278> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding con mode: secure 2024-09-12T00:57:08.741 INFO:tasks.workunit.client.0.smithi070.stderr: -277> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding con mode: crc 2024-09-12T00:57:08.741 INFO:tasks.workunit.client.0.smithi070.stderr: -276> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding con mode: secure 2024-09-12T00:57:08.741 INFO:tasks.workunit.client.0.smithi070.stderr: -275> 2024-09-12T00:57:08.403+0000 7f212678c640 10 monclient: get_auth_request con 0x7f2000070a20 auth_method 0 2024-09-12T00:57:08.741 INFO:tasks.workunit.client.0.smithi070.stderr: -274> 2024-09-12T00:57:08.403+0000 7f2128c869c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:08.741 INFO:tasks.workunit.client.0.smithi070.stderr: -273> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient: init 2024-09-12T00:57:08.741 INFO:tasks.workunit.client.0.smithi070.stderr: -272> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding auth protocol: cephx 2024-09-12T00:57:08.741 INFO:tasks.workunit.client.0.smithi070.stderr: -271> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding auth protocol: cephx 2024-09-12T00:57:08.741 INFO:tasks.workunit.client.0.smithi070.stderr: -270> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding auth protocol: cephx 2024-09-12T00:57:08.741 INFO:tasks.workunit.client.0.smithi070.stderr: -269> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding con mode: secure 2024-09-12T00:57:08.741 INFO:tasks.workunit.client.0.smithi070.stderr: -268> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding con mode: crc 2024-09-12T00:57:08.742 INFO:tasks.workunit.client.0.smithi070.stderr: -267> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding con mode: secure 2024-09-12T00:57:08.742 INFO:tasks.workunit.client.0.smithi070.stderr: -266> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding con mode: crc 2024-09-12T00:57:08.742 INFO:tasks.workunit.client.0.smithi070.stderr: -265> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding con mode: secure 2024-09-12T00:57:08.742 INFO:tasks.workunit.client.0.smithi070.stderr: -264> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding con mode: crc 2024-09-12T00:57:08.742 INFO:tasks.workunit.client.0.smithi070.stderr: -263> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding con mode: crc 2024-09-12T00:57:08.742 INFO:tasks.workunit.client.0.smithi070.stderr: -262> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding con mode: secure 2024-09-12T00:57:08.742 INFO:tasks.workunit.client.0.smithi070.stderr: -261> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding con mode: crc 2024-09-12T00:57:08.742 INFO:tasks.workunit.client.0.smithi070.stderr: -260> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding con mode: secure 2024-09-12T00:57:08.742 INFO:tasks.workunit.client.0.smithi070.stderr: -259> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding con mode: crc 2024-09-12T00:57:08.742 INFO:tasks.workunit.client.0.smithi070.stderr: -258> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding con mode: secure 2024-09-12T00:57:08.744 INFO:tasks.workunit.client.0.smithi070.stderr: -257> 2024-09-12T00:57:08.403+0000 7f2128c869c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:08.744 INFO:tasks.workunit.client.0.smithi070.stderr: -256> 2024-09-12T00:57:08.403+0000 7f2128c869c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:08.744 INFO:tasks.workunit.client.0.smithi070.stderr: -255> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc60325d88 EEXIST 2024-09-12T00:57:08.744 INFO:tasks.workunit.client.0.smithi070.stderr: -254> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient: _reopen_session rank -1 2024-09-12T00:57:08.744 INFO:tasks.workunit.client.0.smithi070.stderr: -253> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:57:08.744 INFO:tasks.workunit.client.0.smithi070.stderr: -252> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient(hunting): picked mon.noname-a con 0x561ea31ee520 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:57:08.744 INFO:tasks.workunit.client.0.smithi070.stderr: -251> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient(hunting): picked mon.noname-b con 0x561ea31bdf40 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:57:08.744 INFO:tasks.workunit.client.0.smithi070.stderr: -250> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient(hunting): picked mon.noname-c con 0x561ea31e9cf0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:57:08.744 INFO:tasks.workunit.client.0.smithi070.stderr: -249> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:08.744 INFO:tasks.workunit.client.0.smithi070.stderr: -248> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:08.744 INFO:tasks.workunit.client.0.smithi070.stderr: -247> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:08.745 INFO:tasks.workunit.client.0.smithi070.stderr: -246> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient(hunting): _renew_subs 2024-09-12T00:57:08.745 INFO:tasks.workunit.client.0.smithi070.stderr: -245> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient(hunting): authenticate will time out at 2278.854732s 2024-09-12T00:57:08.745 INFO:tasks.workunit.client.0.smithi070.stderr: -244> 2024-09-12T00:57:08.403+0000 7f212678c640 10 monclient(hunting): get_auth_request con 0x561ea31ee520 auth_method 0 2024-09-12T00:57:08.745 INFO:tasks.workunit.client.0.smithi070.stderr: -243> 2024-09-12T00:57:08.403+0000 7f212678c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:08.745 INFO:tasks.workunit.client.0.smithi070.stderr: -242> 2024-09-12T00:57:08.403+0000 7f212678c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:08.745 INFO:tasks.workunit.client.0.smithi070.stderr: -241> 2024-09-12T00:57:08.403+0000 7f212678c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:08.745 INFO:tasks.workunit.client.0.smithi070.stderr: -240> 2024-09-12T00:57:08.403+0000 7f2126f8d640 10 monclient(hunting): get_auth_request con 0x561ea31e9cf0 auth_method 0 2024-09-12T00:57:08.745 INFO:tasks.workunit.client.0.smithi070.stderr: -239> 2024-09-12T00:57:08.403+0000 7f2126f8d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:08.745 INFO:tasks.workunit.client.0.smithi070.stderr: -238> 2024-09-12T00:57:08.403+0000 7f2126f8d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:08.745 INFO:tasks.workunit.client.0.smithi070.stderr: -237> 2024-09-12T00:57:08.403+0000 7f2126f8d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:08.745 INFO:tasks.workunit.client.0.smithi070.stderr: -236> 2024-09-12T00:57:08.403+0000 7f212678c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:08.745 INFO:tasks.workunit.client.0.smithi070.stderr: -235> 2024-09-12T00:57:08.403+0000 7f212678c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:08.745 INFO:tasks.workunit.client.0.smithi070.stderr: -234> 2024-09-12T00:57:08.403+0000 7f212678c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:08.745 INFO:tasks.workunit.client.0.smithi070.stderr: -233> 2024-09-12T00:57:08.403+0000 7f2126f8d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:08.746 INFO:tasks.workunit.client.0.smithi070.stderr: -232> 2024-09-12T00:57:08.403+0000 7f2126f8d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:08.746 INFO:tasks.workunit.client.0.smithi070.stderr: -231> 2024-09-12T00:57:08.403+0000 7f2126f8d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:08.746 INFO:tasks.workunit.client.0.smithi070.stderr: -230> 2024-09-12T00:57:08.403+0000 7f212678c640 10 monclient(hunting): handle_auth_done global_id 7590 payload 274 2024-09-12T00:57:08.746 INFO:tasks.workunit.client.0.smithi070.stderr: -229> 2024-09-12T00:57:08.403+0000 7f212678c640 10 monclient: _finish_hunting 0 2024-09-12T00:57:08.746 INFO:tasks.workunit.client.0.smithi070.stderr: -228> 2024-09-12T00:57:08.403+0000 7f212678c640 1 monclient: found mon.noname-a 2024-09-12T00:57:08.746 INFO:tasks.workunit.client.0.smithi070.stderr: -227> 2024-09-12T00:57:08.403+0000 7f212678c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:57:08.746 INFO:tasks.workunit.client.0.smithi070.stderr: -226> 2024-09-12T00:57:08.403+0000 7f2009ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:08.746 INFO:tasks.workunit.client.0.smithi070.stderr: -225> 2024-09-12T00:57:08.403+0000 7f2009ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:57:08.746 INFO:tasks.workunit.client.0.smithi070.stderr: -224> 2024-09-12T00:57:08.403+0000 7f2009ffb640 10 monclient: dump: 2024-09-12T00:57:08.746 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:08.746 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:08.746 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.746 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.746 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:08.747 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.747 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:08.747 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:08.747 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:08.747 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.747 INFO:tasks.workunit.client.0.smithi070.stderr: -223> 2024-09-12T00:57:08.403+0000 7f2009ffb640 10 monclient: _finish_auth 0 2024-09-12T00:57:08.747 INFO:tasks.workunit.client.0.smithi070.stderr: -222> 2024-09-12T00:57:08.403+0000 7f2009ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:57:08.747 INFO:tasks.workunit.client.0.smithi070.stderr: -221> 2024-09-12T00:57:08.403+0000 7f2009ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:57:08.747 INFO:tasks.workunit.client.0.smithi070.stderr: -220> 2024-09-12T00:57:08.403+0000 7f2009ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:08.747 INFO:tasks.workunit.client.0.smithi070.stderr: -219> 2024-09-12T00:57:08.403+0000 7f2009ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:57:08.747 INFO:tasks.workunit.client.0.smithi070.stderr: -218> 2024-09-12T00:57:08.403+0000 7f2009ffb640 10 monclient: dump: 2024-09-12T00:57:08.747 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:08.747 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:08.748 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.748 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.748 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:08.748 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.748 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:08.748 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:08.748 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:08.748 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.748 INFO:tasks.workunit.client.0.smithi070.stderr: -217> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 monclient: authenticate success, global_id 7590 2024-09-12T00:57:08.748 INFO:tasks.workunit.client.0.smithi070.stderr: -216> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient: get_monmap_and_config success 2024-09-12T00:57:08.748 INFO:tasks.workunit.client.0.smithi070.stderr: -215> 2024-09-12T00:57:08.403+0000 7f2128c869c0 4 set_mon_vals no callback set 2024-09-12T00:57:08.748 INFO:tasks.workunit.client.0.smithi070.stderr: -214> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient: shutdown 2024-09-12T00:57:08.748 INFO:tasks.workunit.client.0.smithi070.stderr: -213> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient: build_initial_monmap 2024-09-12T00:57:08.749 INFO:tasks.workunit.client.0.smithi070.stderr: -212> 2024-09-12T00:57:08.407+0000 7f2128c869c0 1 build_initial for_mkfs: 0 2024-09-12T00:57:08.749 INFO:tasks.workunit.client.0.smithi070.stderr: -211> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient: monmap: 2024-09-12T00:57:08.749 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:57:08.749 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:57:08.749 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:57:08.749 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:57:08.749 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:57:08.749 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.749 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:57:08.749 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:57:08.749 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:57:08.749 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.749 INFO:tasks.workunit.client.0.smithi070.stderr: -210> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding auth protocol: cephx 2024-09-12T00:57:08.749 INFO:tasks.workunit.client.0.smithi070.stderr: -209> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding auth protocol: cephx 2024-09-12T00:57:08.750 INFO:tasks.workunit.client.0.smithi070.stderr: -208> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding auth protocol: cephx 2024-09-12T00:57:08.750 INFO:tasks.workunit.client.0.smithi070.stderr: -207> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding con mode: secure 2024-09-12T00:57:08.750 INFO:tasks.workunit.client.0.smithi070.stderr: -206> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding con mode: crc 2024-09-12T00:57:08.750 INFO:tasks.workunit.client.0.smithi070.stderr: -205> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding con mode: secure 2024-09-12T00:57:08.750 INFO:tasks.workunit.client.0.smithi070.stderr: -204> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding con mode: crc 2024-09-12T00:57:08.750 INFO:tasks.workunit.client.0.smithi070.stderr: -203> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding con mode: secure 2024-09-12T00:57:08.750 INFO:tasks.workunit.client.0.smithi070.stderr: -202> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding con mode: crc 2024-09-12T00:57:08.750 INFO:tasks.workunit.client.0.smithi070.stderr: -201> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding con mode: crc 2024-09-12T00:57:08.750 INFO:tasks.workunit.client.0.smithi070.stderr: -200> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding con mode: secure 2024-09-12T00:57:08.750 INFO:tasks.workunit.client.0.smithi070.stderr: -199> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding con mode: crc 2024-09-12T00:57:08.750 INFO:tasks.workunit.client.0.smithi070.stderr: -198> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding con mode: secure 2024-09-12T00:57:08.750 INFO:tasks.workunit.client.0.smithi070.stderr: -197> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding con mode: crc 2024-09-12T00:57:08.750 INFO:tasks.workunit.client.0.smithi070.stderr: -196> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding con mode: secure 2024-09-12T00:57:08.751 INFO:tasks.workunit.client.0.smithi070.stderr: -195> 2024-09-12T00:57:08.407+0000 7f2128c869c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:08.751 INFO:tasks.workunit.client.0.smithi070.stderr: -194> 2024-09-12T00:57:08.407+0000 7f2128c869c0 1 librados: starting msgr at 2024-09-12T00:57:08.751 INFO:tasks.workunit.client.0.smithi070.stderr: -193> 2024-09-12T00:57:08.407+0000 7f2128c869c0 1 librados: starting objecter 2024-09-12T00:57:08.751 INFO:tasks.workunit.client.0.smithi070.stderr: -192> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command objecter_requests cmddesc objecter_requests hook 0x561ea31bdf20 EEXIST 2024-09-12T00:57:08.751 INFO:tasks.workunit.client.0.smithi070.stderr: -191> 2024-09-12T00:57:08.407+0000 7f2128c869c0 1 librados: setting wanted keys 2024-09-12T00:57:08.751 INFO:tasks.workunit.client.0.smithi070.stderr: -190> 2024-09-12T00:57:08.407+0000 7f2128c869c0 1 librados: calling monclient init 2024-09-12T00:57:08.751 INFO:tasks.workunit.client.0.smithi070.stderr: -189> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient: init 2024-09-12T00:57:08.752 INFO:tasks.workunit.client.0.smithi070.stderr: -188> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding auth protocol: cephx 2024-09-12T00:57:08.752 INFO:tasks.workunit.client.0.smithi070.stderr: -187> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding auth protocol: cephx 2024-09-12T00:57:08.752 INFO:tasks.workunit.client.0.smithi070.stderr: -186> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding auth protocol: cephx 2024-09-12T00:57:08.752 INFO:tasks.workunit.client.0.smithi070.stderr: -185> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding con mode: secure 2024-09-12T00:57:08.752 INFO:tasks.workunit.client.0.smithi070.stderr: -184> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding con mode: crc 2024-09-12T00:57:08.752 INFO:tasks.workunit.client.0.smithi070.stderr: -183> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding con mode: secure 2024-09-12T00:57:08.752 INFO:tasks.workunit.client.0.smithi070.stderr: -182> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding con mode: crc 2024-09-12T00:57:08.752 INFO:tasks.workunit.client.0.smithi070.stderr: -181> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding con mode: secure 2024-09-12T00:57:08.753 INFO:tasks.workunit.client.0.smithi070.stderr: -180> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding con mode: crc 2024-09-12T00:57:08.753 INFO:tasks.workunit.client.0.smithi070.stderr: -179> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding con mode: crc 2024-09-12T00:57:08.753 INFO:tasks.workunit.client.0.smithi070.stderr: -178> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding con mode: secure 2024-09-12T00:57:08.753 INFO:tasks.workunit.client.0.smithi070.stderr: -177> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding con mode: crc 2024-09-12T00:57:08.753 INFO:tasks.workunit.client.0.smithi070.stderr: -176> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding con mode: secure 2024-09-12T00:57:08.753 INFO:tasks.workunit.client.0.smithi070.stderr: -175> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding con mode: crc 2024-09-12T00:57:08.753 INFO:tasks.workunit.client.0.smithi070.stderr: -174> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding con mode: secure 2024-09-12T00:57:08.753 INFO:tasks.workunit.client.0.smithi070.stderr: -173> 2024-09-12T00:57:08.407+0000 7f2128c869c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:08.753 INFO:tasks.workunit.client.0.smithi070.stderr: -172> 2024-09-12T00:57:08.407+0000 7f2128c869c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:08.753 INFO:tasks.workunit.client.0.smithi070.stderr: -171> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command rotate-key cmddesc rotate-key hook 0x561ea319c938 EEXIST 2024-09-12T00:57:08.754 INFO:tasks.workunit.client.0.smithi070.stderr: -170> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient: _reopen_session rank -1 2024-09-12T00:57:08.754 INFO:tasks.workunit.client.0.smithi070.stderr: -169> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:57:08.754 INFO:tasks.workunit.client.0.smithi070.stderr: -168> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient(hunting): picked mon.noname-c con 0x561ea31bdf40 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:57:08.754 INFO:tasks.workunit.client.0.smithi070.stderr: -167> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient(hunting): picked mon.noname-a con 0x561ea31e9cf0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:57:08.754 INFO:tasks.workunit.client.0.smithi070.stderr: -166> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient(hunting): picked mon.noname-b con 0x561ea31ee520 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:57:08.754 INFO:tasks.workunit.client.0.smithi070.stderr: -165> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:08.754 INFO:tasks.workunit.client.0.smithi070.stderr: -164> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:08.754 INFO:tasks.workunit.client.0.smithi070.stderr: -163> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:08.754 INFO:tasks.workunit.client.0.smithi070.stderr: -162> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient(hunting): _renew_subs 2024-09-12T00:57:08.754 INFO:tasks.workunit.client.0.smithi070.stderr: -161> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient(hunting): authenticate will time out at 2278.857333s 2024-09-12T00:57:08.754 INFO:tasks.workunit.client.0.smithi070.stderr: -160> 2024-09-12T00:57:08.407+0000 7f212678c640 10 monclient(hunting): get_auth_request con 0x561ea31bdf40 auth_method 0 2024-09-12T00:57:08.754 INFO:tasks.workunit.client.0.smithi070.stderr: -159> 2024-09-12T00:57:08.407+0000 7f212678c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:08.754 INFO:tasks.workunit.client.0.smithi070.stderr: -158> 2024-09-12T00:57:08.407+0000 7f212678c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:08.755 INFO:tasks.workunit.client.0.smithi070.stderr: -157> 2024-09-12T00:57:08.407+0000 7f212678c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:08.755 INFO:tasks.workunit.client.0.smithi070.stderr: -156> 2024-09-12T00:57:08.407+0000 7f2125f8b640 10 monclient(hunting): get_auth_request con 0x561ea31e9cf0 auth_method 0 2024-09-12T00:57:08.755 INFO:tasks.workunit.client.0.smithi070.stderr: -155> 2024-09-12T00:57:08.407+0000 7f2125f8b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:08.755 INFO:tasks.workunit.client.0.smithi070.stderr: -154> 2024-09-12T00:57:08.407+0000 7f2125f8b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:08.755 INFO:tasks.workunit.client.0.smithi070.stderr: -153> 2024-09-12T00:57:08.407+0000 7f2125f8b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:08.755 INFO:tasks.workunit.client.0.smithi070.stderr: -152> 2024-09-12T00:57:08.407+0000 7f212678c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:08.755 INFO:tasks.workunit.client.0.smithi070.stderr: -151> 2024-09-12T00:57:08.407+0000 7f212678c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:08.755 INFO:tasks.workunit.client.0.smithi070.stderr: -150> 2024-09-12T00:57:08.407+0000 7f212678c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:08.755 INFO:tasks.workunit.client.0.smithi070.stderr: -149> 2024-09-12T00:57:08.407+0000 7f2125f8b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:08.755 INFO:tasks.workunit.client.0.smithi070.stderr: -148> 2024-09-12T00:57:08.407+0000 7f2125f8b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:08.755 INFO:tasks.workunit.client.0.smithi070.stderr: -147> 2024-09-12T00:57:08.407+0000 7f2125f8b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:08.755 INFO:tasks.workunit.client.0.smithi070.stderr: -146> 2024-09-12T00:57:08.407+0000 7f2125f8b640 10 monclient(hunting): handle_auth_done global_id 7593 payload 824 2024-09-12T00:57:08.755 INFO:tasks.workunit.client.0.smithi070.stderr: -145> 2024-09-12T00:57:08.407+0000 7f2125f8b640 10 monclient: _finish_hunting 0 2024-09-12T00:57:08.755 INFO:tasks.workunit.client.0.smithi070.stderr: -144> 2024-09-12T00:57:08.407+0000 7f2125f8b640 1 monclient: found mon.noname-a 2024-09-12T00:57:08.756 INFO:tasks.workunit.client.0.smithi070.stderr: -143> 2024-09-12T00:57:08.407+0000 7f2125f8b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:57:08.756 INFO:tasks.workunit.client.0.smithi070.stderr: -142> 2024-09-12T00:57:08.407+0000 7f1ff7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:08.756 INFO:tasks.workunit.client.0.smithi070.stderr: -141> 2024-09-12T00:57:08.407+0000 7f1ff7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:57:08.756 INFO:tasks.workunit.client.0.smithi070.stderr: -140> 2024-09-12T00:57:08.407+0000 7f1ff7fff640 10 monclient: dump: 2024-09-12T00:57:08.756 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:08.756 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:08.756 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.756 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.756 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:08.756 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.756 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:08.756 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:08.756 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:08.757 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.757 INFO:tasks.workunit.client.0.smithi070.stderr: -139> 2024-09-12T00:57:08.407+0000 7f1ff7fff640 10 monclient: _finish_auth 0 2024-09-12T00:57:08.757 INFO:tasks.workunit.client.0.smithi070.stderr: -138> 2024-09-12T00:57:08.407+0000 7f1ff7fff640 10 monclient: _check_auth_tickets 2024-09-12T00:57:08.757 INFO:tasks.workunit.client.0.smithi070.stderr: -137> 2024-09-12T00:57:08.407+0000 7f1ff7fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:57:08.757 INFO:tasks.workunit.client.0.smithi070.stderr: -136> 2024-09-12T00:57:08.407+0000 7f1ff7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:08.757 INFO:tasks.workunit.client.0.smithi070.stderr: -135> 2024-09-12T00:57:08.407+0000 7f1ff7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:57:08.757 INFO:tasks.workunit.client.0.smithi070.stderr: -134> 2024-09-12T00:57:08.407+0000 7f1ff7fff640 10 monclient: dump: 2024-09-12T00:57:08.757 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:08.757 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:08.757 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.757 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.757 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:08.757 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.758 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:08.758 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:08.758 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:08.758 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.758 INFO:tasks.workunit.client.0.smithi070.stderr: -133> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 monclient: authenticate success, global_id 7593 2024-09-12T00:57:08.758 INFO:tasks.workunit.client.0.smithi070.stderr: -132> 2024-09-12T00:57:08.407+0000 7f2009ffb640 4 set_mon_vals no callback set 2024-09-12T00:57:08.758 INFO:tasks.workunit.client.0.smithi070.stderr: -131> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient: _renew_subs 2024-09-12T00:57:08.758 INFO:tasks.workunit.client.0.smithi070.stderr: -130> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:57:08.758 INFO:tasks.workunit.client.0.smithi070.stderr: -129> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient: _renew_subs 2024-09-12T00:57:08.758 INFO:tasks.workunit.client.0.smithi070.stderr: -128> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:57:08.758 INFO:tasks.workunit.client.0.smithi070.stderr: -127> 2024-09-12T00:57:08.407+0000 7f2128c869c0 1 librados: init done 2024-09-12T00:57:08.758 INFO:tasks.workunit.client.0.smithi070.stderr: -126> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command cr dump hook 0x561ea31de318 2024-09-12T00:57:08.758 INFO:tasks.workunit.client.0.smithi070.stderr: -125> 2024-09-12T00:57:08.407+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.759 INFO:tasks.workunit.client.0.smithi070.stderr: -124> 2024-09-12T00:57:08.411+0000 7f1ff7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:57:08.759 INFO:tasks.workunit.client.0.smithi070.stderr: -123> 2024-09-12T00:57:08.411+0000 7f1ff7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:57:08.759 INFO:tasks.workunit.client.0.smithi070.stderr: -122> 2024-09-12T00:57:08.411+0000 7f1ff7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:57:08.759 INFO:tasks.workunit.client.0.smithi070.stderr: -121> 2024-09-12T00:57:08.411+0000 7f2126f8d640 10 monclient: get_auth_request con 0x561ea3207eb0 auth_method 0 2024-09-12T00:57:08.759 INFO:tasks.workunit.client.0.smithi070.stderr: -120> 2024-09-12T00:57:08.411+0000 7f212678c640 10 monclient: get_auth_request con 0x7f1ff0070ae0 auth_method 0 2024-09-12T00:57:08.759 INFO:tasks.workunit.client.0.smithi070.stderr: -119> 2024-09-12T00:57:08.411+0000 7f2128c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.759 INFO:tasks.workunit.client.0.smithi070.stderr: -118> 2024-09-12T00:57:08.411+0000 7f2128c869c0 20 realm 2024-09-12T00:57:08.759 INFO:tasks.workunit.client.0.smithi070.stderr: -117> 2024-09-12T00:57:08.411+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.759 INFO:tasks.workunit.client.0.smithi070.stderr: -116> 2024-09-12T00:57:08.411+0000 7f2128c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.759 INFO:tasks.workunit.client.0.smithi070.stderr: -115> 2024-09-12T00:57:08.411+0000 7f2128c869c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:08.759 INFO:tasks.workunit.client.0.smithi070.stderr: -114> 2024-09-12T00:57:08.411+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.759 INFO:tasks.workunit.client.0.smithi070.stderr: -113> 2024-09-12T00:57:08.411+0000 7f2128c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.759 INFO:tasks.workunit.client.0.smithi070.stderr: -112> 2024-09-12T00:57:08.411+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.759 INFO:tasks.workunit.client.0.smithi070.stderr: -111> 2024-09-12T00:57:08.411+0000 7f212678c640 10 monclient: get_auth_request con 0x561ea320c210 auth_method 0 2024-09-12T00:57:08.760 INFO:tasks.workunit.client.0.smithi070.stderr: -110> 2024-09-12T00:57:08.411+0000 7f2128c869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:08.760 INFO:tasks.workunit.client.0.smithi070.stderr: -109> 2024-09-12T00:57:08.411+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.760 INFO:tasks.workunit.client.0.smithi070.stderr: -108> 2024-09-12T00:57:08.411+0000 7f2125f8b640 10 monclient: get_auth_request con 0x561ea320f9a0 auth_method 0 2024-09-12T00:57:08.760 INFO:tasks.workunit.client.0.smithi070.stderr: -107> 2024-09-12T00:57:08.415+0000 7f2128c869c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:08.760 INFO:tasks.workunit.client.0.smithi070.stderr: -106> 2024-09-12T00:57:08.415+0000 7f2128c869c0 20 searching for the correct realm 2024-09-12T00:57:08.760 INFO:tasks.workunit.client.0.smithi070.stderr: -105> 2024-09-12T00:57:08.415+0000 7f2126f8d640 10 monclient: get_auth_request con 0x561ea32146b0 auth_method 0 2024-09-12T00:57:08.760 INFO:tasks.workunit.client.0.smithi070.stderr: -104> 2024-09-12T00:57:08.415+0000 7f212678c640 10 monclient: get_auth_request con 0x7f2120007be0 auth_method 0 2024-09-12T00:57:08.760 INFO:tasks.workunit.client.0.smithi070.stderr: -103> 2024-09-12T00:57:08.415+0000 7f2125f8b640 10 monclient: get_auth_request con 0x7f2118026040 auth_method 0 2024-09-12T00:57:08.760 INFO:tasks.workunit.client.0.smithi070.stderr: -102> 2024-09-12T00:57:08.419+0000 7f2126f8d640 10 monclient: get_auth_request con 0x7f21100c0020 auth_method 0 2024-09-12T00:57:08.760 INFO:tasks.workunit.client.0.smithi070.stderr: -101> 2024-09-12T00:57:08.419+0000 7f2126f8d640 0 -- 172.21.15.70:0/1003195127 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f21100c0020 msgr2=0x7f21100eda20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:08.760 INFO:tasks.workunit.client.0.smithi070.stderr: -100> 2024-09-12T00:57:08.623+0000 7f2126f8d640 10 monclient: get_auth_request con 0x7f21100c0020 auth_method 0 2024-09-12T00:57:08.760 INFO:tasks.workunit.client.0.smithi070.stderr: -99> 2024-09-12T00:57:08.627+0000 7f212678c640 10 monclient: get_auth_request con 0x7f2120037440 auth_method 0 2024-09-12T00:57:08.760 INFO:tasks.workunit.client.0.smithi070.stderr: -98> 2024-09-12T00:57:08.635+0000 7f2126f8d640 0 -- 172.21.15.70:0/1003195127 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f21100c0020 msgr2=0x7f21100eda20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:08.761 INFO:tasks.workunit.client.0.smithi070.stderr: -97> 2024-09-12T00:57:08.635+0000 7f1ff7fff640 1 client.7593.objecter ms_handle_reset 0x7f21100c0020 session 0x7f21100a6070 osd.4 2024-09-12T00:57:08.761 INFO:tasks.workunit.client.0.smithi070.stderr: -96> 2024-09-12T00:57:08.635+0000 7f1ff7fff640 10 monclient: _renew_subs 2024-09-12T00:57:08.761 INFO:tasks.workunit.client.0.smithi070.stderr: -95> 2024-09-12T00:57:08.635+0000 7f1ff7fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:57:08.761 INFO:tasks.workunit.client.0.smithi070.stderr: -94> 2024-09-12T00:57:08.635+0000 7f2126f8d640 10 monclient: get_auth_request con 0x7f1ff0080880 auth_method 0 2024-09-12T00:57:08.761 INFO:tasks.workunit.client.0.smithi070.stderr: -93> 2024-09-12T00:57:08.647+0000 7f2128c869c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:08.761 INFO:tasks.workunit.client.0.smithi070.stderr: -92> 2024-09-12T00:57:08.647+0000 7f2128c869c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:57:08.761 INFO:tasks.workunit.client.0.smithi070.stderr: -91> 2024-09-12T00:57:08.647+0000 7f2128c869c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:08.761 INFO:tasks.workunit.client.0.smithi070.stderr: -90> 2024-09-12T00:57:08.647+0000 7f2128c869c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:57:08.761 INFO:tasks.workunit.client.0.smithi070.stderr: -89> 2024-09-12T00:57:08.647+0000 7f2128c869c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:08.761 INFO:tasks.workunit.client.0.smithi070.stderr: -88> 2024-09-12T00:57:08.647+0000 7f2128c869c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:08.761 INFO:tasks.workunit.client.0.smithi070.stderr: -87> 2024-09-12T00:57:08.647+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.761 INFO:tasks.workunit.client.0.smithi070.stderr: -86> 2024-09-12T00:57:08.647+0000 7f2128c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.761 INFO:tasks.workunit.client.0.smithi070.stderr: -85> 2024-09-12T00:57:08.647+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.761 INFO:tasks.workunit.client.0.smithi070.stderr: -84> 2024-09-12T00:57:08.647+0000 7f2128c869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:08.762 INFO:tasks.workunit.client.0.smithi070.stderr: -83> 2024-09-12T00:57:08.647+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.762 INFO:tasks.workunit.client.0.smithi070.stderr: -82> 2024-09-12T00:57:08.651+0000 7f2128c869c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:08.762 INFO:tasks.workunit.client.0.smithi070.stderr: -81> 2024-09-12T00:57:08.651+0000 7f2128c869c0 20 zone default found 2024-09-12T00:57:08.762 INFO:tasks.workunit.client.0.smithi070.stderr: -80> 2024-09-12T00:57:08.651+0000 7f2128c869c0 4 Realm: () 2024-09-12T00:57:08.762 INFO:tasks.workunit.client.0.smithi070.stderr: -79> 2024-09-12T00:57:08.651+0000 7f2128c869c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:57:08.762 INFO:tasks.workunit.client.0.smithi070.stderr: -78> 2024-09-12T00:57:08.651+0000 7f2128c869c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:57:08.762 INFO:tasks.workunit.client.0.smithi070.stderr: -77> 2024-09-12T00:57:08.651+0000 7f2128c869c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:08.762 INFO:tasks.workunit.client.0.smithi070.stderr: -76> 2024-09-12T00:57:08.651+0000 7f2128c869c0 20 zonegroup default 2024-09-12T00:57:08.762 INFO:tasks.workunit.client.0.smithi070.stderr: -75> 2024-09-12T00:57:08.651+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.762 INFO:tasks.workunit.client.0.smithi070.stderr: -74> 2024-09-12T00:57:08.651+0000 7f2128c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.762 INFO:tasks.workunit.client.0.smithi070.stderr: -73> 2024-09-12T00:57:08.651+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.762 INFO:tasks.workunit.client.0.smithi070.stderr: -72> 2024-09-12T00:57:08.651+0000 7f2128c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.762 INFO:tasks.workunit.client.0.smithi070.stderr: -71> 2024-09-12T00:57:08.651+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.763 INFO:tasks.workunit.client.0.smithi070.stderr: -70> 2024-09-12T00:57:08.651+0000 7f2128c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.763 INFO:tasks.workunit.client.0.smithi070.stderr: -69> 2024-09-12T00:57:08.651+0000 7f2128c869c0 20 started sync module instance, tier type = 2024-09-12T00:57:08.763 INFO:tasks.workunit.client.0.smithi070.stderr: -68> 2024-09-12T00:57:08.651+0000 7f2128c869c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:57:08.763 INFO:tasks.workunit.client.0.smithi070.stderr: -67> 2024-09-12T00:57:08.675+0000 7f2128c869c0 20 add_watcher() i=0 2024-09-12T00:57:08.763 INFO:tasks.workunit.client.0.smithi070.stderr: -66> 2024-09-12T00:57:08.675+0000 7f2128c869c0 20 add_watcher() i=1 2024-09-12T00:57:08.763 INFO:tasks.workunit.client.0.smithi070.stderr: -65> 2024-09-12T00:57:08.675+0000 7f2128c869c0 20 add_watcher() i=2 2024-09-12T00:57:08.763 INFO:tasks.workunit.client.0.smithi070.stderr: -64> 2024-09-12T00:57:08.675+0000 7f2128c869c0 20 add_watcher() i=3 2024-09-12T00:57:08.763 INFO:tasks.workunit.client.0.smithi070.stderr: -63> 2024-09-12T00:57:08.675+0000 7f2128c869c0 20 add_watcher() i=4 2024-09-12T00:57:08.763 INFO:tasks.workunit.client.0.smithi070.stderr: -62> 2024-09-12T00:57:08.675+0000 7f2128c869c0 20 add_watcher() i=5 2024-09-12T00:57:08.763 INFO:tasks.workunit.client.0.smithi070.stderr: -61> 2024-09-12T00:57:08.675+0000 7f2128c869c0 20 add_watcher() i=6 2024-09-12T00:57:08.763 INFO:tasks.workunit.client.0.smithi070.stderr: -60> 2024-09-12T00:57:08.679+0000 7f2128c869c0 20 add_watcher() i=7 2024-09-12T00:57:08.763 INFO:tasks.workunit.client.0.smithi070.stderr: -59> 2024-09-12T00:57:08.679+0000 7f2128c869c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:08.763 INFO:tasks.workunit.client.0.smithi070.stderr: -58> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding auth protocol: cephx 2024-09-12T00:57:08.764 INFO:tasks.workunit.client.0.smithi070.stderr: -57> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding auth protocol: cephx 2024-09-12T00:57:08.764 INFO:tasks.workunit.client.0.smithi070.stderr: -56> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding auth protocol: cephx 2024-09-12T00:57:08.764 INFO:tasks.workunit.client.0.smithi070.stderr: -55> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding con mode: secure 2024-09-12T00:57:08.764 INFO:tasks.workunit.client.0.smithi070.stderr: -54> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding con mode: crc 2024-09-12T00:57:08.764 INFO:tasks.workunit.client.0.smithi070.stderr: -53> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding con mode: secure 2024-09-12T00:57:08.764 INFO:tasks.workunit.client.0.smithi070.stderr: -52> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding con mode: crc 2024-09-12T00:57:08.764 INFO:tasks.workunit.client.0.smithi070.stderr: -51> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding con mode: secure 2024-09-12T00:57:08.764 INFO:tasks.workunit.client.0.smithi070.stderr: -50> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding con mode: crc 2024-09-12T00:57:08.764 INFO:tasks.workunit.client.0.smithi070.stderr: -49> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding con mode: crc 2024-09-12T00:57:08.764 INFO:tasks.workunit.client.0.smithi070.stderr: -48> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding con mode: secure 2024-09-12T00:57:08.764 INFO:tasks.workunit.client.0.smithi070.stderr: -47> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding con mode: crc 2024-09-12T00:57:08.764 INFO:tasks.workunit.client.0.smithi070.stderr: -46> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding con mode: secure 2024-09-12T00:57:08.764 INFO:tasks.workunit.client.0.smithi070.stderr: -45> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding con mode: crc 2024-09-12T00:57:08.765 INFO:tasks.workunit.client.0.smithi070.stderr: -44> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding con mode: secure 2024-09-12T00:57:08.765 INFO:tasks.workunit.client.0.smithi070.stderr: -43> 2024-09-12T00:57:08.683+0000 7f1fdcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:08.765 INFO:tasks.workunit.client.0.smithi070.stderr: -42> 2024-09-12T00:57:08.683+0000 7f2128c869c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:08.765 INFO:tasks.workunit.client.0.smithi070.stderr: -41> 2024-09-12T00:57:08.683+0000 7f2128c869c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:08.765 INFO:tasks.workunit.client.0.smithi070.stderr: -40> 2024-09-12T00:57:08.683+0000 7f2128c869c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:08.765 INFO:tasks.workunit.client.0.smithi070.stderr: -39> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command cache list hook 0x561ea31daa50 2024-09-12T00:57:08.765 INFO:tasks.workunit.client.0.smithi070.stderr: -38> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command cache inspect hook 0x561ea31daa50 2024-09-12T00:57:08.765 INFO:tasks.workunit.client.0.smithi070.stderr: -37> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command cache erase hook 0x561ea31daa50 2024-09-12T00:57:08.765 INFO:tasks.workunit.client.0.smithi070.stderr: -36> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command cache zap hook 0x561ea31daa50 2024-09-12T00:57:08.765 INFO:tasks.workunit.client.0.smithi070.stderr: -35> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 note: GC not initialized 2024-09-12T00:57:08.765 INFO:tasks.workunit.client.0.smithi070.stderr: -34> 2024-09-12T00:57:08.683+0000 7f1f577fe640 20 reqs_thread_entry: start 2024-09-12T00:57:08.765 INFO:tasks.workunit.client.0.smithi070.stderr: -33> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command sync trace show hook 0x7f211800c3a0 2024-09-12T00:57:08.765 INFO:tasks.workunit.client.0.smithi070.stderr: -32> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command sync trace history hook 0x7f211800c3a0 2024-09-12T00:57:08.765 INFO:tasks.workunit.client.0.smithi070.stderr: -31> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command sync trace active hook 0x7f211800c3a0 2024-09-12T00:57:08.766 INFO:tasks.workunit.client.0.smithi070.stderr: -30> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command sync trace active_short hook 0x7f211800c3a0 2024-09-12T00:57:08.766 INFO:tasks.workunit.client.0.smithi070.stderr: -29> 2024-09-12T00:57:08.683+0000 7f2128c869c0 20 init_complete bucket index max shards: 1 2024-09-12T00:57:08.766 INFO:tasks.workunit.client.0.smithi070.stderr: -28> 2024-09-12T00:57:08.683+0000 7f2128c869c0 20 Filter name: none 2024-09-12T00:57:08.766 INFO:tasks.workunit.client.0.smithi070.stderr: -27> 2024-09-12T00:57:08.683+0000 7f1f557fa640 20 reqs_thread_entry: start 2024-09-12T00:57:08.766 INFO:tasks.workunit.client.0.smithi070.stderr: -26> 2024-09-12T00:57:08.683+0000 7f2128c869c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:57:08.766 INFO:tasks.workunit.client.0.smithi070.stderr: -25> 2024-09-12T00:57:08.683+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.766 INFO:tasks.workunit.client.0.smithi070.stderr: -24> 2024-09-12T00:57:08.687+0000 7f2128c869c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:57:08.766 INFO:tasks.workunit.client.0.smithi070.stderr: -23> 2024-09-12T00:57:08.687+0000 7f2128c869c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:57:08.766 INFO:tasks.workunit.client.0.smithi070.stderr: -22> 2024-09-12T00:57:08.687+0000 7f2128c869c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:57:08.766 INFO:tasks.workunit.client.0.smithi070.stderr: -21> 2024-09-12T00:57:08.687+0000 7f2128c869c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 : miss 2024-09-12T00:57:08.766 INFO:tasks.workunit.client.0.smithi070.stderr: -20> 2024-09-12T00:57:08.687+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.766 INFO:tasks.workunit.client.0.smithi070.stderr: -19> 2024-09-12T00:57:08.687+0000 7f2128c869c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:57:08.766 INFO:tasks.workunit.client.0.smithi070.stderr: -18> 2024-09-12T00:57:08.687+0000 7f2128c869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 info.flags=0x17 2024-09-12T00:57:08.766 INFO:tasks.workunit.client.0.smithi070.stderr: -17> 2024-09-12T00:57:08.687+0000 7f2128c869c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 to cache LRU end 2024-09-12T00:57:08.767 INFO:tasks.workunit.client.0.smithi070.stderr: -16> 2024-09-12T00:57:08.687+0000 7f2128c869c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:57:08.767 INFO:tasks.workunit.client.0.smithi070.stderr: -15> 2024-09-12T00:57:08.687+0000 7f2128c869c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:08.767 INFO:tasks.workunit.client.0.smithi070.stderr: -14> 2024-09-12T00:57:08.687+0000 7f2128c869c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 2024-09-12T00:57:08.767 INFO:tasks.workunit.client.0.smithi070.stderr: -13> 2024-09-12T00:57:08.695+0000 7f2128c869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 info.flags=0x17 2024-09-12T00:57:08.767 INFO:tasks.workunit.client.0.smithi070.stderr: -12> 2024-09-12T00:57:08.695+0000 7f2128c869c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 to cache LRU end 2024-09-12T00:57:08.767 INFO:tasks.workunit.client.0.smithi070.stderr: -11> 2024-09-12T00:57:08.695+0000 7f2128c869c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:08.767 INFO:tasks.workunit.client.0.smithi070.stderr: -10> 2024-09-12T00:57:08.695+0000 7f2128c869c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35, ofs0, ns] 2024-09-12T00:57:08.767 INFO:tasks.workunit.client.0.smithi070.stderr: -9> 2024-09-12T00:57:08.695+0000 7f2009ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431621 cookie 94689585903424 notifier 7593 bl.length()=995 2024-09-12T00:57:08.767 INFO:tasks.workunit.client.0.smithi070.stderr: -8> 2024-09-12T00:57:08.695+0000 7f2009ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 info.flags=0x17 2024-09-12T00:57:08.767 INFO:tasks.workunit.client.0.smithi070.stderr: -7> 2024-09-12T00:57:08.695+0000 7f2009ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 to cache LRU end 2024-09-12T00:57:08.767 INFO:tasks.workunit.client.0.smithi070.stderr: -6> 2024-09-12T00:57:08.695+0000 7f2009ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:08.767 INFO:tasks.workunit.client.0.smithi070.stderr: -5> 2024-09-12T00:57:08.695+0000 7f2128c869c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35]): orig_sources= new_sources= 2024-09-12T00:57:08.767 INFO:tasks.workunit.client.0.smithi070.stderr: -4> 2024-09-12T00:57:08.695+0000 7f2128c869c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35]): potential sources added=[] removed=[] 2024-09-12T00:57:08.768 INFO:tasks.workunit.client.0.smithi070.stderr: -3> 2024-09-12T00:57:08.695+0000 7f2128c869c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35]): orig_dests= new_dests= 2024-09-12T00:57:08.768 INFO:tasks.workunit.client.0.smithi070.stderr: -2> 2024-09-12T00:57:08.695+0000 7f2128c869c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35]): potential dests added=[] removed=[] 2024-09-12T00:57:08.768 INFO:tasks.workunit.client.0.smithi070.stderr: -1> 2024-09-12T00:57:08.703+0000 7f2128c869c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2128c869c0 time 2024-09-12T00:57:08.707018+0000 2024-09-12T00:57:08.768 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:57:08.768 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.768 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:57:08.768 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f212c5602eb] 2024-09-12T00:57:08.768 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f212c56049f] 2024-09-12T00:57:08.768 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561ea1e7bcc1] 2024-09-12T00:57:08.768 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561ea1e90d5a] 2024-09-12T00:57:08.768 INFO:tasks.workunit.client.0.smithi070.stderr: 5: main() 2024-09-12T00:57:08.768 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f212b3c6d90] 2024-09-12T00:57:08.768 INFO:tasks.workunit.client.0.smithi070.stderr: 7: __libc_start_main() 2024-09-12T00:57:08.769 INFO:tasks.workunit.client.0.smithi070.stderr: 8: _start() 2024-09-12T00:57:08.769 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.769 INFO:tasks.workunit.client.0.smithi070.stderr: 0> 2024-09-12T00:57:08.703+0000 7f2128c869c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:57:08.769 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f2128c869c0 thread_name:radosgw-admin 2024-09-12T00:57:08.769 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.769 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:57:08.769 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f212b3df520] 2024-09-12T00:57:08.769 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:57:08.769 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:57:08.769 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:57:08.769 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f212c560345] 2024-09-12T00:57:08.769 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f212c56049f] 2024-09-12T00:57:08.769 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561ea1e7bcc1] 2024-09-12T00:57:08.769 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561ea1e90d5a] 2024-09-12T00:57:08.770 INFO:tasks.workunit.client.0.smithi070.stderr: 9: main() 2024-09-12T00:57:08.770 INFO:tasks.workunit.client.0.smithi070.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f212b3c6d90] 2024-09-12T00:57:08.770 INFO:tasks.workunit.client.0.smithi070.stderr: 11: __libc_start_main() 2024-09-12T00:57:08.770 INFO:tasks.workunit.client.0.smithi070.stderr: 12: _start() 2024-09-12T00:57:08.770 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:57:08.770 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.770 INFO:tasks.workunit.client.0.smithi070.stderr:--- logging levels --- 2024-09-12T00:57:08.770 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 none 2024-09-12T00:57:08.770 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 lockdep 2024-09-12T00:57:08.770 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 context 2024-09-12T00:57:08.770 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 crush 2024-09-12T00:57:08.770 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds 2024-09-12T00:57:08.770 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_balancer 2024-09-12T00:57:08.770 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_locker 2024-09-12T00:57:08.771 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log 2024-09-12T00:57:08.771 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log_expire 2024-09-12T00:57:08.771 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_migrator 2024-09-12T00:57:08.771 INFO:tasks.workunit.client.0.smithi070.stderr: 3/ 5 mds_quiesce 2024-09-12T00:57:08.771 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 buffer 2024-09-12T00:57:08.771 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 timer 2024-09-12T00:57:08.771 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 filer 2024-09-12T00:57:08.771 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 striper 2024-09-12T00:57:08.771 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 objecter 2024-09-12T00:57:08.771 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rados 2024-09-12T00:57:08.771 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd 2024-09-12T00:57:08.771 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_mirror 2024-09-12T00:57:08.771 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_replay 2024-09-12T00:57:08.771 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_pwl 2024-09-12T00:57:08.771 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 journaler 2024-09-12T00:57:08.772 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objectcacher 2024-09-12T00:57:08.772 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:57:08.772 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 client 2024-09-12T00:57:08.772 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 osd 2024-09-12T00:57:08.772 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 optracker 2024-09-12T00:57:08.772 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objclass 2024-09-12T00:57:08.772 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 filestore 2024-09-12T00:57:08.772 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 journal 2024-09-12T00:57:08.772 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 ms 2024-09-12T00:57:08.772 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mon 2024-09-12T00:57:08.772 INFO:tasks.workunit.client.0.smithi070.stderr: 0/10 monc 2024-09-12T00:57:08.772 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 paxos 2024-09-12T00:57:08.772 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 tp 2024-09-12T00:57:08.773 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 auth 2024-09-12T00:57:08.773 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 crypto 2024-09-12T00:57:08.773 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 finisher 2024-09-12T00:57:08.773 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 reserver 2024-09-12T00:57:08.773 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 heartbeatmap 2024-09-12T00:57:08.773 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 perfcounter 2024-09-12T00:57:08.773 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw 2024-09-12T00:57:08.773 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_sync 2024-09-12T00:57:08.773 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_datacache 2024-09-12T00:57:08.773 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_access 2024-09-12T00:57:08.773 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:57:08.773 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_flight 2024-09-12T00:57:08.773 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:57:08.773 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw_notification 2024-09-12T00:57:08.773 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 javaclient 2024-09-12T00:57:08.774 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 asok 2024-09-12T00:57:08.774 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 throttle 2024-09-12T00:57:08.774 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 refs 2024-09-12T00:57:08.774 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 compressor 2024-09-12T00:57:08.774 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluestore 2024-09-12T00:57:08.774 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluefs 2024-09-12T00:57:08.774 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 bdev 2024-09-12T00:57:08.774 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 kstore 2024-09-12T00:57:08.774 INFO:tasks.workunit.client.0.smithi070.stderr: 4/ 5 rocksdb 2024-09-12T00:57:08.774 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 fuse 2024-09-12T00:57:08.774 INFO:tasks.workunit.client.0.smithi070.stderr: 2/ 5 mgr 2024-09-12T00:57:08.774 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mgrc 2024-09-12T00:57:08.774 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 dpdk 2024-09-12T00:57:08.774 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 eventtrace 2024-09-12T00:57:08.775 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 prioritycache 2024-09-12T00:57:08.775 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 test 2024-09-12T00:57:08.775 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:57:08.775 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephsqlite 2024-09-12T00:57:08.775 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:57:08.775 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore 2024-09-12T00:57:08.775 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_onode 2024-09-12T00:57:08.775 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_odata 2024-09-12T00:57:08.775 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_omap 2024-09-12T00:57:08.775 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_tm 2024-09-12T00:57:08.775 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_t 2024-09-12T00:57:08.775 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:57:08.775 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_epm 2024-09-12T00:57:08.775 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_lba 2024-09-12T00:57:08.776 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:57:08.776 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cache 2024-09-12T00:57:08.776 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_journal 2024-09-12T00:57:08.776 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_device 2024-09-12T00:57:08.776 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_backref 2024-09-12T00:57:08.776 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 alienstore 2024-09-12T00:57:08.776 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mclock 2024-09-12T00:57:08.776 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cyanstore 2024-09-12T00:57:08.776 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 ceph_exporter 2024-09-12T00:57:08.776 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 memstore 2024-09-12T00:57:08.776 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 trace 2024-09-12T00:57:08.776 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 ceph_dedup 2024-09-12T00:57:08.776 INFO:tasks.workunit.client.0.smithi070.stderr: -2/-2 (syslog threshold) 2024-09-12T00:57:08.776 INFO:tasks.workunit.client.0.smithi070.stderr: 99/99 (stderr threshold) 2024-09-12T00:57:08.777 INFO:tasks.workunit.client.0.smithi070.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:57:08.777 INFO:tasks.workunit.client.0.smithi070.stderr: 7f1f557fa640 / http_manager 2024-09-12T00:57:08.777 INFO:tasks.workunit.client.0.smithi070.stderr: 7f1f577fe640 / http_manager 2024-09-12T00:57:08.777 INFO:tasks.workunit.client.0.smithi070.stderr: 7f1fdcfe1640 / rgw_dt_lg_renew 2024-09-12T00:57:08.777 INFO:tasks.workunit.client.0.smithi070.stderr: 7f1ff7fff640 / ms_dispatch 2024-09-12T00:57:08.777 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2009ffb640 / io_context_pool 2024-09-12T00:57:08.777 INFO:tasks.workunit.client.0.smithi070.stderr: 7f200bfff640 / ms_dispatch 2024-09-12T00:57:08.777 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2012e05640 / ms_dispatch 2024-09-12T00:57:08.777 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2014608640 / io_context_pool 2024-09-12T00:57:08.777 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2125f8b640 / msgr-worker-2 2024-09-12T00:57:08.777 INFO:tasks.workunit.client.0.smithi070.stderr: 7f212678c640 / msgr-worker-1 2024-09-12T00:57:08.777 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2126f8d640 / msgr-worker-0 2024-09-12T00:57:08.777 INFO:tasks.workunit.client.0.smithi070.stderr: 7f212778e640 / io_context_pool 2024-09-12T00:57:08.778 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2128c869c0 / radosgw-admin 2024-09-12T00:57:08.778 INFO:tasks.workunit.client.0.smithi070.stderr: max_recent 500 2024-09-12T00:57:08.778 INFO:tasks.workunit.client.0.smithi070.stderr: max_new 1000 2024-09-12T00:57:08.778 INFO:tasks.workunit.client.0.smithi070.stderr: log_file /var/log/ceph/ceph-client.admin.120307.log 2024-09-12T00:57:08.778 INFO:tasks.workunit.client.0.smithi070.stderr:--- end dump of recent events --- 2024-09-12T00:57:08.778 INFO:tasks.workunit.client.0.smithi070.stderr:--- begin dump of recent events --- 2024-09-12T00:57:08.778 INFO:tasks.workunit.client.0.smithi070.stderr: -499> 2024-09-12T00:57:08.387+0000 7f2126f8d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:08.778 INFO:tasks.workunit.client.0.smithi070.stderr: -498> 2024-09-12T00:57:08.387+0000 7f2126f8d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:08.778 INFO:tasks.workunit.client.0.smithi070.stderr: -497> 2024-09-12T00:57:08.387+0000 7f212678c640 10 monclient(hunting): get_auth_request con 0x561ea2fcf4e0 auth_method 0 2024-09-12T00:57:08.778 INFO:tasks.workunit.client.0.smithi070.stderr: -496> 2024-09-12T00:57:08.387+0000 7f212678c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:08.778 INFO:tasks.workunit.client.0.smithi070.stderr: -495> 2024-09-12T00:57:08.387+0000 7f212678c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:08.778 INFO:tasks.workunit.client.0.smithi070.stderr: -494> 2024-09-12T00:57:08.387+0000 7f212678c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:08.778 INFO:tasks.workunit.client.0.smithi070.stderr: -493> 2024-09-12T00:57:08.387+0000 7f2126f8d640 10 monclient(hunting): handle_auth_done global_id 7127 payload 274 2024-09-12T00:57:08.778 INFO:tasks.workunit.client.0.smithi070.stderr: -492> 2024-09-12T00:57:08.387+0000 7f2126f8d640 10 monclient: _finish_hunting 0 2024-09-12T00:57:08.779 INFO:tasks.workunit.client.0.smithi070.stderr: -491> 2024-09-12T00:57:08.387+0000 7f2126f8d640 1 monclient: found mon.noname-c 2024-09-12T00:57:08.779 INFO:tasks.workunit.client.0.smithi070.stderr: -490> 2024-09-12T00:57:08.387+0000 7f2126f8d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:57:08.779 INFO:tasks.workunit.client.0.smithi070.stderr: -489> 2024-09-12T00:57:08.387+0000 7f2014608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:08.779 INFO:tasks.workunit.client.0.smithi070.stderr: -488> 2024-09-12T00:57:08.387+0000 7f2014608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:57:08.779 INFO:tasks.workunit.client.0.smithi070.stderr: -487> 2024-09-12T00:57:08.387+0000 7f2014608640 10 monclient: dump: 2024-09-12T00:57:08.779 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:08.779 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:08.779 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.779 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.779 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:08.779 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.779 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:08.779 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:08.780 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:08.780 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.780 INFO:tasks.workunit.client.0.smithi070.stderr: -486> 2024-09-12T00:57:08.387+0000 7f2014608640 10 monclient: _finish_auth 0 2024-09-12T00:57:08.780 INFO:tasks.workunit.client.0.smithi070.stderr: -485> 2024-09-12T00:57:08.387+0000 7f2014608640 10 monclient: _check_auth_tickets 2024-09-12T00:57:08.780 INFO:tasks.workunit.client.0.smithi070.stderr: -484> 2024-09-12T00:57:08.387+0000 7f2128c869c0 5 monclient: authenticate success, global_id 7127 2024-09-12T00:57:08.780 INFO:tasks.workunit.client.0.smithi070.stderr: -483> 2024-09-12T00:57:08.387+0000 7f2014608640 10 monclient: handle_config config(0 keys) 2024-09-12T00:57:08.780 INFO:tasks.workunit.client.0.smithi070.stderr: -482> 2024-09-12T00:57:08.387+0000 7f2014608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:08.780 INFO:tasks.workunit.client.0.smithi070.stderr: -481> 2024-09-12T00:57:08.387+0000 7f2014608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:57:08.780 INFO:tasks.workunit.client.0.smithi070.stderr: -480> 2024-09-12T00:57:08.387+0000 7f2014608640 10 monclient: dump: 2024-09-12T00:57:08.780 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:08.780 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:08.780 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.780 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.780 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:08.781 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.781 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:08.781 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:08.781 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:08.781 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.781 INFO:tasks.workunit.client.0.smithi070.stderr: -479> 2024-09-12T00:57:08.387+0000 7f2128c869c0 10 monclient: get_monmap_and_config success 2024-09-12T00:57:08.781 INFO:tasks.workunit.client.0.smithi070.stderr: -478> 2024-09-12T00:57:08.387+0000 7f2128c869c0 4 set_mon_vals no callback set 2024-09-12T00:57:08.781 INFO:tasks.workunit.client.0.smithi070.stderr: -477> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient: shutdown 2024-09-12T00:57:08.781 INFO:tasks.workunit.client.0.smithi070.stderr: -476> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 asok(0x561ea2f112b0) unregister_commands rotate-key 2024-09-12T00:57:08.781 INFO:tasks.workunit.client.0.smithi070.stderr: -475> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient: build_initial_monmap 2024-09-12T00:57:08.781 INFO:tasks.workunit.client.0.smithi070.stderr: -474> 2024-09-12T00:57:08.391+0000 7f2128c869c0 1 build_initial for_mkfs: 0 2024-09-12T00:57:08.781 INFO:tasks.workunit.client.0.smithi070.stderr: -473> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient: monmap: 2024-09-12T00:57:08.781 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:57:08.782 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:57:08.782 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:57:08.782 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:57:08.782 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:57:08.782 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.782 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:57:08.782 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:57:08.782 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:57:08.782 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.782 INFO:tasks.workunit.client.0.smithi070.stderr: -472> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding auth protocol: cephx 2024-09-12T00:57:08.782 INFO:tasks.workunit.client.0.smithi070.stderr: -471> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding auth protocol: cephx 2024-09-12T00:57:08.782 INFO:tasks.workunit.client.0.smithi070.stderr: -470> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding auth protocol: cephx 2024-09-12T00:57:08.782 INFO:tasks.workunit.client.0.smithi070.stderr: -469> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding con mode: secure 2024-09-12T00:57:08.782 INFO:tasks.workunit.client.0.smithi070.stderr: -468> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding con mode: crc 2024-09-12T00:57:08.783 INFO:tasks.workunit.client.0.smithi070.stderr: -467> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding con mode: secure 2024-09-12T00:57:08.783 INFO:tasks.workunit.client.0.smithi070.stderr: -466> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding con mode: crc 2024-09-12T00:57:08.783 INFO:tasks.workunit.client.0.smithi070.stderr: -465> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding con mode: secure 2024-09-12T00:57:08.783 INFO:tasks.workunit.client.0.smithi070.stderr: -464> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding con mode: crc 2024-09-12T00:57:08.783 INFO:tasks.workunit.client.0.smithi070.stderr: -463> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding con mode: crc 2024-09-12T00:57:08.783 INFO:tasks.workunit.client.0.smithi070.stderr: -462> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding con mode: secure 2024-09-12T00:57:08.783 INFO:tasks.workunit.client.0.smithi070.stderr: -461> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding con mode: crc 2024-09-12T00:57:08.783 INFO:tasks.workunit.client.0.smithi070.stderr: -460> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding con mode: secure 2024-09-12T00:57:08.783 INFO:tasks.workunit.client.0.smithi070.stderr: -459> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding con mode: crc 2024-09-12T00:57:08.783 INFO:tasks.workunit.client.0.smithi070.stderr: -458> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea3124cc0) adding con mode: secure 2024-09-12T00:57:08.783 INFO:tasks.workunit.client.0.smithi070.stderr: -457> 2024-09-12T00:57:08.391+0000 7f2128c869c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:08.783 INFO:tasks.workunit.client.0.smithi070.stderr: -456> 2024-09-12T00:57:08.391+0000 7f2128c869c0 1 librados: starting msgr at 2024-09-12T00:57:08.783 INFO:tasks.workunit.client.0.smithi070.stderr: -455> 2024-09-12T00:57:08.391+0000 7f2128c869c0 1 librados: starting objecter 2024-09-12T00:57:08.784 INFO:tasks.workunit.client.0.smithi070.stderr: -454> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command objecter_requests hook 0x561ea31267b0 2024-09-12T00:57:08.784 INFO:tasks.workunit.client.0.smithi070.stderr: -453> 2024-09-12T00:57:08.391+0000 7f2128c869c0 1 librados: setting wanted keys 2024-09-12T00:57:08.784 INFO:tasks.workunit.client.0.smithi070.stderr: -452> 2024-09-12T00:57:08.391+0000 7f2128c869c0 1 librados: calling monclient init 2024-09-12T00:57:08.784 INFO:tasks.workunit.client.0.smithi070.stderr: -451> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient: init 2024-09-12T00:57:08.784 INFO:tasks.workunit.client.0.smithi070.stderr: -450> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding auth protocol: cephx 2024-09-12T00:57:08.784 INFO:tasks.workunit.client.0.smithi070.stderr: -449> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding auth protocol: cephx 2024-09-12T00:57:08.784 INFO:tasks.workunit.client.0.smithi070.stderr: -448> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding auth protocol: cephx 2024-09-12T00:57:08.784 INFO:tasks.workunit.client.0.smithi070.stderr: -447> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding con mode: secure 2024-09-12T00:57:08.784 INFO:tasks.workunit.client.0.smithi070.stderr: -446> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding con mode: crc 2024-09-12T00:57:08.784 INFO:tasks.workunit.client.0.smithi070.stderr: -445> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding con mode: secure 2024-09-12T00:57:08.784 INFO:tasks.workunit.client.0.smithi070.stderr: -444> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding con mode: crc 2024-09-12T00:57:08.784 INFO:tasks.workunit.client.0.smithi070.stderr: -443> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding con mode: secure 2024-09-12T00:57:08.784 INFO:tasks.workunit.client.0.smithi070.stderr: -442> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding con mode: crc 2024-09-12T00:57:08.785 INFO:tasks.workunit.client.0.smithi070.stderr: -441> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding con mode: crc 2024-09-12T00:57:08.785 INFO:tasks.workunit.client.0.smithi070.stderr: -440> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding con mode: secure 2024-09-12T00:57:08.785 INFO:tasks.workunit.client.0.smithi070.stderr: -439> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding con mode: crc 2024-09-12T00:57:08.785 INFO:tasks.workunit.client.0.smithi070.stderr: -438> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding con mode: secure 2024-09-12T00:57:08.785 INFO:tasks.workunit.client.0.smithi070.stderr: -437> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding con mode: crc 2024-09-12T00:57:08.785 INFO:tasks.workunit.client.0.smithi070.stderr: -436> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 AuthRegistry(0x561ea311f100) adding con mode: secure 2024-09-12T00:57:08.785 INFO:tasks.workunit.client.0.smithi070.stderr: -435> 2024-09-12T00:57:08.391+0000 7f2128c869c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:08.785 INFO:tasks.workunit.client.0.smithi070.stderr: -434> 2024-09-12T00:57:08.391+0000 7f2128c869c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:08.785 INFO:tasks.workunit.client.0.smithi070.stderr: -433> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command rotate-key hook 0x561ea311f248 2024-09-12T00:57:08.785 INFO:tasks.workunit.client.0.smithi070.stderr: -432> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient: _reopen_session rank -1 2024-09-12T00:57:08.785 INFO:tasks.workunit.client.0.smithi070.stderr: -431> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:57:08.785 INFO:tasks.workunit.client.0.smithi070.stderr: -430> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient(hunting): picked mon.noname-c con 0x561ea2fcf4e0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:57:08.785 INFO:tasks.workunit.client.0.smithi070.stderr: -429> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient(hunting): picked mon.noname-a con 0x561ea2fdb330 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:57:08.785 INFO:tasks.workunit.client.0.smithi070.stderr: -428> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient(hunting): picked mon.noname-b con 0x561ea3123270 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:57:08.786 INFO:tasks.workunit.client.0.smithi070.stderr: -427> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:08.786 INFO:tasks.workunit.client.0.smithi070.stderr: -426> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:08.786 INFO:tasks.workunit.client.0.smithi070.stderr: -425> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:08.786 INFO:tasks.workunit.client.0.smithi070.stderr: -424> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient(hunting): _renew_subs 2024-09-12T00:57:08.786 INFO:tasks.workunit.client.0.smithi070.stderr: -423> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient(hunting): authenticate will time out at 2278.841535s 2024-09-12T00:57:08.786 INFO:tasks.workunit.client.0.smithi070.stderr: -422> 2024-09-12T00:57:08.391+0000 7f2125f8b640 10 monclient(hunting): get_auth_request con 0x561ea2fdb330 auth_method 0 2024-09-12T00:57:08.786 INFO:tasks.workunit.client.0.smithi070.stderr: -421> 2024-09-12T00:57:08.391+0000 7f2125f8b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:08.786 INFO:tasks.workunit.client.0.smithi070.stderr: -420> 2024-09-12T00:57:08.391+0000 7f2125f8b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:08.786 INFO:tasks.workunit.client.0.smithi070.stderr: -419> 2024-09-12T00:57:08.391+0000 7f2125f8b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:08.786 INFO:tasks.workunit.client.0.smithi070.stderr: -418> 2024-09-12T00:57:08.391+0000 7f212678c640 10 monclient(hunting): get_auth_request con 0x561ea2fcf4e0 auth_method 0 2024-09-12T00:57:08.786 INFO:tasks.workunit.client.0.smithi070.stderr: -417> 2024-09-12T00:57:08.391+0000 7f212678c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:08.786 INFO:tasks.workunit.client.0.smithi070.stderr: -416> 2024-09-12T00:57:08.391+0000 7f212678c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:08.786 INFO:tasks.workunit.client.0.smithi070.stderr: -415> 2024-09-12T00:57:08.391+0000 7f212678c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:08.787 INFO:tasks.workunit.client.0.smithi070.stderr: -414> 2024-09-12T00:57:08.391+0000 7f2125f8b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:08.787 INFO:tasks.workunit.client.0.smithi070.stderr: -413> 2024-09-12T00:57:08.391+0000 7f2125f8b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:08.787 INFO:tasks.workunit.client.0.smithi070.stderr: -412> 2024-09-12T00:57:08.391+0000 7f2125f8b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:08.787 INFO:tasks.workunit.client.0.smithi070.stderr: -411> 2024-09-12T00:57:08.391+0000 7f212678c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:08.787 INFO:tasks.workunit.client.0.smithi070.stderr: -410> 2024-09-12T00:57:08.391+0000 7f212678c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:08.787 INFO:tasks.workunit.client.0.smithi070.stderr: -409> 2024-09-12T00:57:08.391+0000 7f212678c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:08.787 INFO:tasks.workunit.client.0.smithi070.stderr: -408> 2024-09-12T00:57:08.391+0000 7f2125f8b640 10 monclient(hunting): handle_auth_done global_id 7584 payload 824 2024-09-12T00:57:08.787 INFO:tasks.workunit.client.0.smithi070.stderr: -407> 2024-09-12T00:57:08.391+0000 7f2125f8b640 10 monclient: _finish_hunting 0 2024-09-12T00:57:08.787 INFO:tasks.workunit.client.0.smithi070.stderr: -406> 2024-09-12T00:57:08.391+0000 7f2125f8b640 1 monclient: found mon.noname-a 2024-09-12T00:57:08.787 INFO:tasks.workunit.client.0.smithi070.stderr: -405> 2024-09-12T00:57:08.391+0000 7f2125f8b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:57:08.787 INFO:tasks.workunit.client.0.smithi070.stderr: -404> 2024-09-12T00:57:08.391+0000 7f2126f8d640 10 monclient: get_auth_request con 0x561ea3123270 auth_method 0 2024-09-12T00:57:08.787 INFO:tasks.workunit.client.0.smithi070.stderr: -403> 2024-09-12T00:57:08.391+0000 7f2012e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:08.787 INFO:tasks.workunit.client.0.smithi070.stderr: -402> 2024-09-12T00:57:08.391+0000 7f2012e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:57:08.787 INFO:tasks.workunit.client.0.smithi070.stderr: -401> 2024-09-12T00:57:08.391+0000 7f2012e05640 10 monclient: dump: 2024-09-12T00:57:08.788 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:08.788 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:08.788 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.788 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.788 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:08.788 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.788 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:08.788 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:08.788 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:08.788 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.788 INFO:tasks.workunit.client.0.smithi070.stderr: -400> 2024-09-12T00:57:08.391+0000 7f2012e05640 10 monclient: _finish_auth 0 2024-09-12T00:57:08.788 INFO:tasks.workunit.client.0.smithi070.stderr: -399> 2024-09-12T00:57:08.391+0000 7f2012e05640 10 monclient: _check_auth_tickets 2024-09-12T00:57:08.788 INFO:tasks.workunit.client.0.smithi070.stderr: -398> 2024-09-12T00:57:08.391+0000 7f2012e05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:57:08.788 INFO:tasks.workunit.client.0.smithi070.stderr: -397> 2024-09-12T00:57:08.391+0000 7f2012e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:08.789 INFO:tasks.workunit.client.0.smithi070.stderr: -396> 2024-09-12T00:57:08.391+0000 7f2012e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:57:08.789 INFO:tasks.workunit.client.0.smithi070.stderr: -395> 2024-09-12T00:57:08.391+0000 7f2012e05640 10 monclient: dump: 2024-09-12T00:57:08.789 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:08.789 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:08.789 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.789 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.789 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:08.789 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.789 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:08.789 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:08.789 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:08.789 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.789 INFO:tasks.workunit.client.0.smithi070.stderr: -394> 2024-09-12T00:57:08.391+0000 7f2014608640 4 set_mon_vals no callback set 2024-09-12T00:57:08.789 INFO:tasks.workunit.client.0.smithi070.stderr: -393> 2024-09-12T00:57:08.391+0000 7f2128c869c0 5 monclient: authenticate success, global_id 7584 2024-09-12T00:57:08.790 INFO:tasks.workunit.client.0.smithi070.stderr: -392> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient: _renew_subs 2024-09-12T00:57:08.790 INFO:tasks.workunit.client.0.smithi070.stderr: -391> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:57:08.790 INFO:tasks.workunit.client.0.smithi070.stderr: -390> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient: _renew_subs 2024-09-12T00:57:08.790 INFO:tasks.workunit.client.0.smithi070.stderr: -389> 2024-09-12T00:57:08.391+0000 7f2128c869c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:57:08.790 INFO:tasks.workunit.client.0.smithi070.stderr: -388> 2024-09-12T00:57:08.391+0000 7f2128c869c0 1 librados: init done 2024-09-12T00:57:08.790 INFO:tasks.workunit.client.0.smithi070.stderr: -387> 2024-09-12T00:57:08.395+0000 7f2012e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:57:08.790 INFO:tasks.workunit.client.0.smithi070.stderr: -386> 2024-09-12T00:57:08.395+0000 7f2012e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:57:08.790 INFO:tasks.workunit.client.0.smithi070.stderr: -385> 2024-09-12T00:57:08.395+0000 7f2012e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:57:08.790 INFO:tasks.workunit.client.0.smithi070.stderr: -384> 2024-09-12T00:57:08.395+0000 7f212678c640 10 monclient: get_auth_request con 0x7f200c070ae0 auth_method 0 2024-09-12T00:57:08.790 INFO:tasks.workunit.client.0.smithi070.stderr: -383> 2024-09-12T00:57:08.395+0000 7f2126f8d640 10 monclient: get_auth_request con 0x561ea3166dd0 auth_method 0 2024-09-12T00:57:08.790 INFO:tasks.workunit.client.0.smithi070.stderr: -382> 2024-09-12T00:57:08.395+0000 7f212678c640 10 monclient: get_auth_request con 0x561ea3169fb0 auth_method 0 2024-09-12T00:57:08.790 INFO:tasks.workunit.client.0.smithi070.stderr: -381> 2024-09-12T00:57:08.395+0000 7f2125f8b640 10 monclient: get_auth_request con 0x561ea316e1a0 auth_method 0 2024-09-12T00:57:08.790 INFO:tasks.workunit.client.0.smithi070.stderr: -380> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient: build_initial_monmap 2024-09-12T00:57:08.790 INFO:tasks.workunit.client.0.smithi070.stderr: -379> 2024-09-12T00:57:08.399+0000 7f2128c869c0 1 build_initial for_mkfs: 0 2024-09-12T00:57:08.791 INFO:tasks.workunit.client.0.smithi070.stderr: -378> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient: monmap: 2024-09-12T00:57:08.791 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:57:08.791 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:57:08.791 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:57:08.791 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:57:08.791 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:57:08.791 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.791 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:57:08.791 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:57:08.791 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:57:08.791 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.791 INFO:tasks.workunit.client.0.smithi070.stderr: -377> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding auth protocol: cephx 2024-09-12T00:57:08.791 INFO:tasks.workunit.client.0.smithi070.stderr: -376> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding auth protocol: cephx 2024-09-12T00:57:08.791 INFO:tasks.workunit.client.0.smithi070.stderr: -375> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding auth protocol: cephx 2024-09-12T00:57:08.792 INFO:tasks.workunit.client.0.smithi070.stderr: -374> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding con mode: secure 2024-09-12T00:57:08.792 INFO:tasks.workunit.client.0.smithi070.stderr: -373> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding con mode: crc 2024-09-12T00:57:08.792 INFO:tasks.workunit.client.0.smithi070.stderr: -372> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding con mode: secure 2024-09-12T00:57:08.792 INFO:tasks.workunit.client.0.smithi070.stderr: -371> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding con mode: crc 2024-09-12T00:57:08.792 INFO:tasks.workunit.client.0.smithi070.stderr: -370> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding con mode: secure 2024-09-12T00:57:08.792 INFO:tasks.workunit.client.0.smithi070.stderr: -369> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding con mode: crc 2024-09-12T00:57:08.792 INFO:tasks.workunit.client.0.smithi070.stderr: -368> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding con mode: crc 2024-09-12T00:57:08.792 INFO:tasks.workunit.client.0.smithi070.stderr: -367> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding con mode: secure 2024-09-12T00:57:08.792 INFO:tasks.workunit.client.0.smithi070.stderr: -366> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding con mode: crc 2024-09-12T00:57:08.793 INFO:tasks.workunit.client.0.smithi070.stderr: -365> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding con mode: secure 2024-09-12T00:57:08.793 INFO:tasks.workunit.client.0.smithi070.stderr: -364> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding con mode: crc 2024-09-12T00:57:08.793 INFO:tasks.workunit.client.0.smithi070.stderr: -363> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea3172e50) adding con mode: secure 2024-09-12T00:57:08.793 INFO:tasks.workunit.client.0.smithi070.stderr: -362> 2024-09-12T00:57:08.399+0000 7f2128c869c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:08.793 INFO:tasks.workunit.client.0.smithi070.stderr: -361> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command objecter_requests cmddesc objecter_requests hook 0x561ea3176820 EEXIST 2024-09-12T00:57:08.793 INFO:tasks.workunit.client.0.smithi070.stderr: -360> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient: init 2024-09-12T00:57:08.793 INFO:tasks.workunit.client.0.smithi070.stderr: -359> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding auth protocol: cephx 2024-09-12T00:57:08.793 INFO:tasks.workunit.client.0.smithi070.stderr: -358> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding auth protocol: cephx 2024-09-12T00:57:08.793 INFO:tasks.workunit.client.0.smithi070.stderr: -357> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding auth protocol: cephx 2024-09-12T00:57:08.793 INFO:tasks.workunit.client.0.smithi070.stderr: -356> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding con mode: secure 2024-09-12T00:57:08.793 INFO:tasks.workunit.client.0.smithi070.stderr: -355> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding con mode: crc 2024-09-12T00:57:08.793 INFO:tasks.workunit.client.0.smithi070.stderr: -354> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding con mode: secure 2024-09-12T00:57:08.793 INFO:tasks.workunit.client.0.smithi070.stderr: -353> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding con mode: crc 2024-09-12T00:57:08.793 INFO:tasks.workunit.client.0.smithi070.stderr: -352> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding con mode: secure 2024-09-12T00:57:08.794 INFO:tasks.workunit.client.0.smithi070.stderr: -351> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding con mode: crc 2024-09-12T00:57:08.794 INFO:tasks.workunit.client.0.smithi070.stderr: -350> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding con mode: crc 2024-09-12T00:57:08.794 INFO:tasks.workunit.client.0.smithi070.stderr: -349> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding con mode: secure 2024-09-12T00:57:08.794 INFO:tasks.workunit.client.0.smithi070.stderr: -348> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding con mode: crc 2024-09-12T00:57:08.794 INFO:tasks.workunit.client.0.smithi070.stderr: -347> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding con mode: secure 2024-09-12T00:57:08.794 INFO:tasks.workunit.client.0.smithi070.stderr: -346> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding con mode: crc 2024-09-12T00:57:08.794 INFO:tasks.workunit.client.0.smithi070.stderr: -345> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 AuthRegistry(0x561ea31714d8) adding con mode: secure 2024-09-12T00:57:08.794 INFO:tasks.workunit.client.0.smithi070.stderr: -344> 2024-09-12T00:57:08.399+0000 7f2128c869c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:08.794 INFO:tasks.workunit.client.0.smithi070.stderr: -343> 2024-09-12T00:57:08.399+0000 7f2128c869c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:08.794 INFO:tasks.workunit.client.0.smithi070.stderr: -342> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command rotate-key cmddesc rotate-key hook 0x561ea3171620 EEXIST 2024-09-12T00:57:08.794 INFO:tasks.workunit.client.0.smithi070.stderr: -341> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient: _reopen_session rank -1 2024-09-12T00:57:08.794 INFO:tasks.workunit.client.0.smithi070.stderr: -340> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:57:08.794 INFO:tasks.workunit.client.0.smithi070.stderr: -339> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient(hunting): picked mon.noname-a con 0x561ea319a9d0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:57:08.795 INFO:tasks.workunit.client.0.smithi070.stderr: -338> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient(hunting): picked mon.noname-c con 0x561ea319a300 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:57:08.795 INFO:tasks.workunit.client.0.smithi070.stderr: -337> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient(hunting): picked mon.noname-b con 0x561ea3198ce0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:57:08.795 INFO:tasks.workunit.client.0.smithi070.stderr: -336> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:08.795 INFO:tasks.workunit.client.0.smithi070.stderr: -335> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:08.795 INFO:tasks.workunit.client.0.smithi070.stderr: -334> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:08.795 INFO:tasks.workunit.client.0.smithi070.stderr: -333> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient(hunting): _renew_subs 2024-09-12T00:57:08.795 INFO:tasks.workunit.client.0.smithi070.stderr: -332> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient(hunting): authenticate will time out at 2278.850621s 2024-09-12T00:57:08.795 INFO:tasks.workunit.client.0.smithi070.stderr: -331> 2024-09-12T00:57:08.399+0000 7f2125f8b640 10 monclient(hunting): get_auth_request con 0x561ea319a300 auth_method 0 2024-09-12T00:57:08.795 INFO:tasks.workunit.client.0.smithi070.stderr: -330> 2024-09-12T00:57:08.399+0000 7f2125f8b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:08.795 INFO:tasks.workunit.client.0.smithi070.stderr: -329> 2024-09-12T00:57:08.399+0000 7f2125f8b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:08.796 INFO:tasks.workunit.client.0.smithi070.stderr: -328> 2024-09-12T00:57:08.399+0000 7f2125f8b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:08.796 INFO:tasks.workunit.client.0.smithi070.stderr: -327> 2024-09-12T00:57:08.399+0000 7f212678c640 10 monclient(hunting): get_auth_request con 0x561ea319a9d0 auth_method 0 2024-09-12T00:57:08.796 INFO:tasks.workunit.client.0.smithi070.stderr: -326> 2024-09-12T00:57:08.399+0000 7f212678c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:08.796 INFO:tasks.workunit.client.0.smithi070.stderr: -325> 2024-09-12T00:57:08.399+0000 7f212678c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:08.796 INFO:tasks.workunit.client.0.smithi070.stderr: -324> 2024-09-12T00:57:08.399+0000 7f212678c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:08.796 INFO:tasks.workunit.client.0.smithi070.stderr: -323> 2024-09-12T00:57:08.399+0000 7f2125f8b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:08.796 INFO:tasks.workunit.client.0.smithi070.stderr: -322> 2024-09-12T00:57:08.399+0000 7f2125f8b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:08.796 INFO:tasks.workunit.client.0.smithi070.stderr: -321> 2024-09-12T00:57:08.399+0000 7f2125f8b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:08.796 INFO:tasks.workunit.client.0.smithi070.stderr: -320> 2024-09-12T00:57:08.399+0000 7f212678c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:08.796 INFO:tasks.workunit.client.0.smithi070.stderr: -319> 2024-09-12T00:57:08.399+0000 7f212678c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:08.796 INFO:tasks.workunit.client.0.smithi070.stderr: -318> 2024-09-12T00:57:08.399+0000 7f212678c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:08.796 INFO:tasks.workunit.client.0.smithi070.stderr: -317> 2024-09-12T00:57:08.399+0000 7f2125f8b640 10 monclient(hunting): handle_auth_done global_id 7133 payload 824 2024-09-12T00:57:08.796 INFO:tasks.workunit.client.0.smithi070.stderr: -316> 2024-09-12T00:57:08.399+0000 7f2125f8b640 10 monclient: _finish_hunting 0 2024-09-12T00:57:08.796 INFO:tasks.workunit.client.0.smithi070.stderr: -315> 2024-09-12T00:57:08.399+0000 7f2125f8b640 1 monclient: found mon.noname-c 2024-09-12T00:57:08.797 INFO:tasks.workunit.client.0.smithi070.stderr: -314> 2024-09-12T00:57:08.399+0000 7f2125f8b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:57:08.797 INFO:tasks.workunit.client.0.smithi070.stderr: -313> 2024-09-12T00:57:08.399+0000 7f2126f8d640 10 monclient: get_auth_request con 0x561ea3198ce0 auth_method 0 2024-09-12T00:57:08.797 INFO:tasks.workunit.client.0.smithi070.stderr: -312> 2024-09-12T00:57:08.399+0000 7f200bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:08.797 INFO:tasks.workunit.client.0.smithi070.stderr: -311> 2024-09-12T00:57:08.399+0000 7f200bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:57:08.797 INFO:tasks.workunit.client.0.smithi070.stderr: -310> 2024-09-12T00:57:08.399+0000 7f200bfff640 10 monclient: dump: 2024-09-12T00:57:08.797 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:08.797 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:08.797 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.797 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.797 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:08.797 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.797 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:08.797 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:08.798 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:08.798 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.798 INFO:tasks.workunit.client.0.smithi070.stderr: -309> 2024-09-12T00:57:08.399+0000 7f200bfff640 10 monclient: _finish_auth 0 2024-09-12T00:57:08.798 INFO:tasks.workunit.client.0.smithi070.stderr: -308> 2024-09-12T00:57:08.399+0000 7f200bfff640 10 monclient: _check_auth_tickets 2024-09-12T00:57:08.798 INFO:tasks.workunit.client.0.smithi070.stderr: -307> 2024-09-12T00:57:08.399+0000 7f200bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:57:08.798 INFO:tasks.workunit.client.0.smithi070.stderr: -306> 2024-09-12T00:57:08.399+0000 7f200bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:08.798 INFO:tasks.workunit.client.0.smithi070.stderr: -305> 2024-09-12T00:57:08.399+0000 7f200bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:57:08.798 INFO:tasks.workunit.client.0.smithi070.stderr: -304> 2024-09-12T00:57:08.399+0000 7f200bfff640 10 monclient: dump: 2024-09-12T00:57:08.798 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:08.798 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:08.798 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.798 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.798 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:08.798 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.799 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:08.799 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:08.799 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:08.799 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.799 INFO:tasks.workunit.client.0.smithi070.stderr: -303> 2024-09-12T00:57:08.399+0000 7f2128c869c0 5 monclient: authenticate success, global_id 7133 2024-09-12T00:57:08.799 INFO:tasks.workunit.client.0.smithi070.stderr: -302> 2024-09-12T00:57:08.399+0000 7f212778e640 4 set_mon_vals no callback set 2024-09-12T00:57:08.799 INFO:tasks.workunit.client.0.smithi070.stderr: -301> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient: _renew_subs 2024-09-12T00:57:08.799 INFO:tasks.workunit.client.0.smithi070.stderr: -300> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:57:08.799 INFO:tasks.workunit.client.0.smithi070.stderr: -299> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient: _renew_subs 2024-09-12T00:57:08.799 INFO:tasks.workunit.client.0.smithi070.stderr: -298> 2024-09-12T00:57:08.399+0000 7f2128c869c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:57:08.799 INFO:tasks.workunit.client.0.smithi070.stderr: -297> 2024-09-12T00:57:08.403+0000 7f200bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:57:08.799 INFO:tasks.workunit.client.0.smithi070.stderr: -296> 2024-09-12T00:57:08.403+0000 7f200bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:57:08.799 INFO:tasks.workunit.client.0.smithi070.stderr: -295> 2024-09-12T00:57:08.403+0000 7f200bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:57:08.799 INFO:tasks.workunit.client.0.smithi070.stderr: -294> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient: get_monmap_and_config 2024-09-12T00:57:08.800 INFO:tasks.workunit.client.0.smithi070.stderr: -293> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient: build_initial_monmap 2024-09-12T00:57:08.800 INFO:tasks.workunit.client.0.smithi070.stderr: -292> 2024-09-12T00:57:08.403+0000 7f2128c869c0 1 build_initial for_mkfs: 0 2024-09-12T00:57:08.800 INFO:tasks.workunit.client.0.smithi070.stderr: -291> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient: monmap: 2024-09-12T00:57:08.800 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:57:08.800 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:57:08.800 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:57:08.800 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:57:08.800 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:57:08.800 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.800 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:57:08.800 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:57:08.800 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:57:08.801 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.801 INFO:tasks.workunit.client.0.smithi070.stderr: -290> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding auth protocol: cephx 2024-09-12T00:57:08.801 INFO:tasks.workunit.client.0.smithi070.stderr: -289> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding auth protocol: cephx 2024-09-12T00:57:08.801 INFO:tasks.workunit.client.0.smithi070.stderr: -288> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding auth protocol: cephx 2024-09-12T00:57:08.801 INFO:tasks.workunit.client.0.smithi070.stderr: -287> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding con mode: secure 2024-09-12T00:57:08.801 INFO:tasks.workunit.client.0.smithi070.stderr: -286> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding con mode: crc 2024-09-12T00:57:08.801 INFO:tasks.workunit.client.0.smithi070.stderr: -285> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding con mode: secure 2024-09-12T00:57:08.801 INFO:tasks.workunit.client.0.smithi070.stderr: -284> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding con mode: crc 2024-09-12T00:57:08.801 INFO:tasks.workunit.client.0.smithi070.stderr: -283> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding con mode: secure 2024-09-12T00:57:08.801 INFO:tasks.workunit.client.0.smithi070.stderr: -282> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding con mode: crc 2024-09-12T00:57:08.801 INFO:tasks.workunit.client.0.smithi070.stderr: -281> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding con mode: crc 2024-09-12T00:57:08.801 INFO:tasks.workunit.client.0.smithi070.stderr: -280> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding con mode: secure 2024-09-12T00:57:08.801 INFO:tasks.workunit.client.0.smithi070.stderr: -279> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding con mode: crc 2024-09-12T00:57:08.801 INFO:tasks.workunit.client.0.smithi070.stderr: -278> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding con mode: secure 2024-09-12T00:57:08.802 INFO:tasks.workunit.client.0.smithi070.stderr: -277> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding con mode: crc 2024-09-12T00:57:08.802 INFO:tasks.workunit.client.0.smithi070.stderr: -276> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x561ea31ba040) adding con mode: secure 2024-09-12T00:57:08.802 INFO:tasks.workunit.client.0.smithi070.stderr: -275> 2024-09-12T00:57:08.403+0000 7f212678c640 10 monclient: get_auth_request con 0x7f2000070a20 auth_method 0 2024-09-12T00:57:08.802 INFO:tasks.workunit.client.0.smithi070.stderr: -274> 2024-09-12T00:57:08.403+0000 7f2128c869c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:08.802 INFO:tasks.workunit.client.0.smithi070.stderr: -273> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient: init 2024-09-12T00:57:08.802 INFO:tasks.workunit.client.0.smithi070.stderr: -272> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding auth protocol: cephx 2024-09-12T00:57:08.802 INFO:tasks.workunit.client.0.smithi070.stderr: -271> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding auth protocol: cephx 2024-09-12T00:57:08.802 INFO:tasks.workunit.client.0.smithi070.stderr: -270> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding auth protocol: cephx 2024-09-12T00:57:08.802 INFO:tasks.workunit.client.0.smithi070.stderr: -269> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding con mode: secure 2024-09-12T00:57:08.802 INFO:tasks.workunit.client.0.smithi070.stderr: -268> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding con mode: crc 2024-09-12T00:57:08.802 INFO:tasks.workunit.client.0.smithi070.stderr: -267> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding con mode: secure 2024-09-12T00:57:08.802 INFO:tasks.workunit.client.0.smithi070.stderr: -266> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding con mode: crc 2024-09-12T00:57:08.802 INFO:tasks.workunit.client.0.smithi070.stderr: -265> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding con mode: secure 2024-09-12T00:57:08.802 INFO:tasks.workunit.client.0.smithi070.stderr: -264> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding con mode: crc 2024-09-12T00:57:08.803 INFO:tasks.workunit.client.0.smithi070.stderr: -263> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding con mode: crc 2024-09-12T00:57:08.803 INFO:tasks.workunit.client.0.smithi070.stderr: -262> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding con mode: secure 2024-09-12T00:57:08.803 INFO:tasks.workunit.client.0.smithi070.stderr: -261> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding con mode: crc 2024-09-12T00:57:08.803 INFO:tasks.workunit.client.0.smithi070.stderr: -260> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding con mode: secure 2024-09-12T00:57:08.803 INFO:tasks.workunit.client.0.smithi070.stderr: -259> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding con mode: crc 2024-09-12T00:57:08.803 INFO:tasks.workunit.client.0.smithi070.stderr: -258> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60325c40) adding con mode: secure 2024-09-12T00:57:08.803 INFO:tasks.workunit.client.0.smithi070.stderr: -257> 2024-09-12T00:57:08.403+0000 7f2128c869c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:08.803 INFO:tasks.workunit.client.0.smithi070.stderr: -256> 2024-09-12T00:57:08.403+0000 7f2128c869c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:08.803 INFO:tasks.workunit.client.0.smithi070.stderr: -255> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc60325d88 EEXIST 2024-09-12T00:57:08.803 INFO:tasks.workunit.client.0.smithi070.stderr: -254> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient: _reopen_session rank -1 2024-09-12T00:57:08.803 INFO:tasks.workunit.client.0.smithi070.stderr: -253> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:57:08.803 INFO:tasks.workunit.client.0.smithi070.stderr: -252> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient(hunting): picked mon.noname-a con 0x561ea31ee520 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:57:08.803 INFO:tasks.workunit.client.0.smithi070.stderr: -251> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient(hunting): picked mon.noname-b con 0x561ea31bdf40 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:57:08.804 INFO:tasks.workunit.client.0.smithi070.stderr: -250> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient(hunting): picked mon.noname-c con 0x561ea31e9cf0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:57:08.804 INFO:tasks.workunit.client.0.smithi070.stderr: -249> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:08.804 INFO:tasks.workunit.client.0.smithi070.stderr: -248> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:08.804 INFO:tasks.workunit.client.0.smithi070.stderr: -247> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:08.804 INFO:tasks.workunit.client.0.smithi070.stderr: -246> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient(hunting): _renew_subs 2024-09-12T00:57:08.804 INFO:tasks.workunit.client.0.smithi070.stderr: -245> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient(hunting): authenticate will time out at 2278.854732s 2024-09-12T00:57:08.804 INFO:tasks.workunit.client.0.smithi070.stderr: -244> 2024-09-12T00:57:08.403+0000 7f212678c640 10 monclient(hunting): get_auth_request con 0x561ea31ee520 auth_method 0 2024-09-12T00:57:08.804 INFO:tasks.workunit.client.0.smithi070.stderr: -243> 2024-09-12T00:57:08.403+0000 7f212678c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:08.804 INFO:tasks.workunit.client.0.smithi070.stderr: -242> 2024-09-12T00:57:08.403+0000 7f212678c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:08.804 INFO:tasks.workunit.client.0.smithi070.stderr: -241> 2024-09-12T00:57:08.403+0000 7f212678c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:08.804 INFO:tasks.workunit.client.0.smithi070.stderr: -240> 2024-09-12T00:57:08.403+0000 7f2126f8d640 10 monclient(hunting): get_auth_request con 0x561ea31e9cf0 auth_method 0 2024-09-12T00:57:08.804 INFO:tasks.workunit.client.0.smithi070.stderr: -239> 2024-09-12T00:57:08.403+0000 7f2126f8d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:08.804 INFO:tasks.workunit.client.0.smithi070.stderr: -238> 2024-09-12T00:57:08.403+0000 7f2126f8d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:08.804 INFO:tasks.workunit.client.0.smithi070.stderr: -237> 2024-09-12T00:57:08.403+0000 7f2126f8d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:08.805 INFO:tasks.workunit.client.0.smithi070.stderr: -236> 2024-09-12T00:57:08.403+0000 7f212678c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:08.805 INFO:tasks.workunit.client.0.smithi070.stderr: -235> 2024-09-12T00:57:08.403+0000 7f212678c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:08.805 INFO:tasks.workunit.client.0.smithi070.stderr: -234> 2024-09-12T00:57:08.403+0000 7f212678c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:08.805 INFO:tasks.workunit.client.0.smithi070.stderr: -233> 2024-09-12T00:57:08.403+0000 7f2126f8d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:08.805 INFO:tasks.workunit.client.0.smithi070.stderr: -232> 2024-09-12T00:57:08.403+0000 7f2126f8d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:08.805 INFO:tasks.workunit.client.0.smithi070.stderr: -231> 2024-09-12T00:57:08.403+0000 7f2126f8d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:08.805 INFO:tasks.workunit.client.0.smithi070.stderr: -230> 2024-09-12T00:57:08.403+0000 7f212678c640 10 monclient(hunting): handle_auth_done global_id 7590 payload 274 2024-09-12T00:57:08.805 INFO:tasks.workunit.client.0.smithi070.stderr: -229> 2024-09-12T00:57:08.403+0000 7f212678c640 10 monclient: _finish_hunting 0 2024-09-12T00:57:08.805 INFO:tasks.workunit.client.0.smithi070.stderr: -228> 2024-09-12T00:57:08.403+0000 7f212678c640 1 monclient: found mon.noname-a 2024-09-12T00:57:08.805 INFO:tasks.workunit.client.0.smithi070.stderr: -227> 2024-09-12T00:57:08.403+0000 7f212678c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:57:08.805 INFO:tasks.workunit.client.0.smithi070.stderr: -226> 2024-09-12T00:57:08.403+0000 7f2009ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:08.805 INFO:tasks.workunit.client.0.smithi070.stderr: -225> 2024-09-12T00:57:08.403+0000 7f2009ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:57:08.805 INFO:tasks.workunit.client.0.smithi070.stderr: -224> 2024-09-12T00:57:08.403+0000 7f2009ffb640 10 monclient: dump: 2024-09-12T00:57:08.806 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:08.806 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:08.806 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.806 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.806 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:08.806 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.806 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:08.806 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:08.806 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:08.806 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.806 INFO:tasks.workunit.client.0.smithi070.stderr: -223> 2024-09-12T00:57:08.403+0000 7f2009ffb640 10 monclient: _finish_auth 0 2024-09-12T00:57:08.806 INFO:tasks.workunit.client.0.smithi070.stderr: -222> 2024-09-12T00:57:08.403+0000 7f2009ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:57:08.806 INFO:tasks.workunit.client.0.smithi070.stderr: -221> 2024-09-12T00:57:08.403+0000 7f2009ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:57:08.806 INFO:tasks.workunit.client.0.smithi070.stderr: -220> 2024-09-12T00:57:08.403+0000 7f2009ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:08.807 INFO:tasks.workunit.client.0.smithi070.stderr: -219> 2024-09-12T00:57:08.403+0000 7f2009ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:57:08.807 INFO:tasks.workunit.client.0.smithi070.stderr: -218> 2024-09-12T00:57:08.403+0000 7f2009ffb640 10 monclient: dump: 2024-09-12T00:57:08.807 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:08.807 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:08.807 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.807 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.807 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:08.807 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.807 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:08.807 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:08.807 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:08.807 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.807 INFO:tasks.workunit.client.0.smithi070.stderr: -217> 2024-09-12T00:57:08.403+0000 7f2128c869c0 5 monclient: authenticate success, global_id 7590 2024-09-12T00:57:08.807 INFO:tasks.workunit.client.0.smithi070.stderr: -216> 2024-09-12T00:57:08.403+0000 7f2128c869c0 10 monclient: get_monmap_and_config success 2024-09-12T00:57:08.808 INFO:tasks.workunit.client.0.smithi070.stderr: -215> 2024-09-12T00:57:08.403+0000 7f2128c869c0 4 set_mon_vals no callback set 2024-09-12T00:57:08.808 INFO:tasks.workunit.client.0.smithi070.stderr: -214> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient: shutdown 2024-09-12T00:57:08.808 INFO:tasks.workunit.client.0.smithi070.stderr: -213> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient: build_initial_monmap 2024-09-12T00:57:08.808 INFO:tasks.workunit.client.0.smithi070.stderr: -212> 2024-09-12T00:57:08.407+0000 7f2128c869c0 1 build_initial for_mkfs: 0 2024-09-12T00:57:08.808 INFO:tasks.workunit.client.0.smithi070.stderr: -211> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient: monmap: 2024-09-12T00:57:08.808 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:57:08.808 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:57:08.808 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:57:08.808 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:57:08.808 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:57:08.808 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.808 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:57:08.808 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:57:08.809 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:57:08.809 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.809 INFO:tasks.workunit.client.0.smithi070.stderr: -210> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding auth protocol: cephx 2024-09-12T00:57:08.809 INFO:tasks.workunit.client.0.smithi070.stderr: -209> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding auth protocol: cephx 2024-09-12T00:57:08.809 INFO:tasks.workunit.client.0.smithi070.stderr: -208> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding auth protocol: cephx 2024-09-12T00:57:08.809 INFO:tasks.workunit.client.0.smithi070.stderr: -207> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding con mode: secure 2024-09-12T00:57:08.809 INFO:tasks.workunit.client.0.smithi070.stderr: -206> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding con mode: crc 2024-09-12T00:57:08.809 INFO:tasks.workunit.client.0.smithi070.stderr: -205> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding con mode: secure 2024-09-12T00:57:08.809 INFO:tasks.workunit.client.0.smithi070.stderr: -204> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding con mode: crc 2024-09-12T00:57:08.809 INFO:tasks.workunit.client.0.smithi070.stderr: -203> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding con mode: secure 2024-09-12T00:57:08.809 INFO:tasks.workunit.client.0.smithi070.stderr: -202> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding con mode: crc 2024-09-12T00:57:08.809 INFO:tasks.workunit.client.0.smithi070.stderr: -201> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding con mode: crc 2024-09-12T00:57:08.809 INFO:tasks.workunit.client.0.smithi070.stderr: -200> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding con mode: secure 2024-09-12T00:57:08.809 INFO:tasks.workunit.client.0.smithi070.stderr: -199> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding con mode: crc 2024-09-12T00:57:08.810 INFO:tasks.workunit.client.0.smithi070.stderr: -198> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding con mode: secure 2024-09-12T00:57:08.810 INFO:tasks.workunit.client.0.smithi070.stderr: -197> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding con mode: crc 2024-09-12T00:57:08.810 INFO:tasks.workunit.client.0.smithi070.stderr: -196> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea31e8680) adding con mode: secure 2024-09-12T00:57:08.810 INFO:tasks.workunit.client.0.smithi070.stderr: -195> 2024-09-12T00:57:08.407+0000 7f2128c869c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:08.810 INFO:tasks.workunit.client.0.smithi070.stderr: -194> 2024-09-12T00:57:08.407+0000 7f2128c869c0 1 librados: starting msgr at 2024-09-12T00:57:08.810 INFO:tasks.workunit.client.0.smithi070.stderr: -193> 2024-09-12T00:57:08.407+0000 7f2128c869c0 1 librados: starting objecter 2024-09-12T00:57:08.810 INFO:tasks.workunit.client.0.smithi070.stderr: -192> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command objecter_requests cmddesc objecter_requests hook 0x561ea31bdf20 EEXIST 2024-09-12T00:57:08.810 INFO:tasks.workunit.client.0.smithi070.stderr: -191> 2024-09-12T00:57:08.407+0000 7f2128c869c0 1 librados: setting wanted keys 2024-09-12T00:57:08.810 INFO:tasks.workunit.client.0.smithi070.stderr: -190> 2024-09-12T00:57:08.407+0000 7f2128c869c0 1 librados: calling monclient init 2024-09-12T00:57:08.810 INFO:tasks.workunit.client.0.smithi070.stderr: -189> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient: init 2024-09-12T00:57:08.810 INFO:tasks.workunit.client.0.smithi070.stderr: -188> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding auth protocol: cephx 2024-09-12T00:57:08.810 INFO:tasks.workunit.client.0.smithi070.stderr: -187> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding auth protocol: cephx 2024-09-12T00:57:08.810 INFO:tasks.workunit.client.0.smithi070.stderr: -186> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding auth protocol: cephx 2024-09-12T00:57:08.810 INFO:tasks.workunit.client.0.smithi070.stderr: -185> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding con mode: secure 2024-09-12T00:57:08.811 INFO:tasks.workunit.client.0.smithi070.stderr: -184> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding con mode: crc 2024-09-12T00:57:08.811 INFO:tasks.workunit.client.0.smithi070.stderr: -183> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding con mode: secure 2024-09-12T00:57:08.811 INFO:tasks.workunit.client.0.smithi070.stderr: -182> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding con mode: crc 2024-09-12T00:57:08.811 INFO:tasks.workunit.client.0.smithi070.stderr: -181> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding con mode: secure 2024-09-12T00:57:08.811 INFO:tasks.workunit.client.0.smithi070.stderr: -180> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding con mode: crc 2024-09-12T00:57:08.811 INFO:tasks.workunit.client.0.smithi070.stderr: -179> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding con mode: crc 2024-09-12T00:57:08.811 INFO:tasks.workunit.client.0.smithi070.stderr: -178> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding con mode: secure 2024-09-12T00:57:08.811 INFO:tasks.workunit.client.0.smithi070.stderr: -177> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding con mode: crc 2024-09-12T00:57:08.811 INFO:tasks.workunit.client.0.smithi070.stderr: -176> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding con mode: secure 2024-09-12T00:57:08.811 INFO:tasks.workunit.client.0.smithi070.stderr: -175> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding con mode: crc 2024-09-12T00:57:08.811 INFO:tasks.workunit.client.0.smithi070.stderr: -174> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 AuthRegistry(0x561ea319c7f0) adding con mode: secure 2024-09-12T00:57:08.811 INFO:tasks.workunit.client.0.smithi070.stderr: -173> 2024-09-12T00:57:08.407+0000 7f2128c869c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:08.811 INFO:tasks.workunit.client.0.smithi070.stderr: -172> 2024-09-12T00:57:08.407+0000 7f2128c869c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:08.811 INFO:tasks.workunit.client.0.smithi070.stderr: -171> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command rotate-key cmddesc rotate-key hook 0x561ea319c938 EEXIST 2024-09-12T00:57:08.812 INFO:tasks.workunit.client.0.smithi070.stderr: -170> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient: _reopen_session rank -1 2024-09-12T00:57:08.812 INFO:tasks.workunit.client.0.smithi070.stderr: -169> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:57:08.812 INFO:tasks.workunit.client.0.smithi070.stderr: -168> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient(hunting): picked mon.noname-c con 0x561ea31bdf40 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:57:08.812 INFO:tasks.workunit.client.0.smithi070.stderr: -167> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient(hunting): picked mon.noname-a con 0x561ea31e9cf0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:57:08.812 INFO:tasks.workunit.client.0.smithi070.stderr: -166> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient(hunting): picked mon.noname-b con 0x561ea31ee520 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:57:08.812 INFO:tasks.workunit.client.0.smithi070.stderr: -165> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:08.812 INFO:tasks.workunit.client.0.smithi070.stderr: -164> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:08.812 INFO:tasks.workunit.client.0.smithi070.stderr: -163> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:08.812 INFO:tasks.workunit.client.0.smithi070.stderr: -162> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient(hunting): _renew_subs 2024-09-12T00:57:08.812 INFO:tasks.workunit.client.0.smithi070.stderr: -161> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient(hunting): authenticate will time out at 2278.857333s 2024-09-12T00:57:08.812 INFO:tasks.workunit.client.0.smithi070.stderr: -160> 2024-09-12T00:57:08.407+0000 7f212678c640 10 monclient(hunting): get_auth_request con 0x561ea31bdf40 auth_method 0 2024-09-12T00:57:08.812 INFO:tasks.workunit.client.0.smithi070.stderr: -159> 2024-09-12T00:57:08.407+0000 7f212678c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:08.812 INFO:tasks.workunit.client.0.smithi070.stderr: -158> 2024-09-12T00:57:08.407+0000 7f212678c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:08.813 INFO:tasks.workunit.client.0.smithi070.stderr: -157> 2024-09-12T00:57:08.407+0000 7f212678c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:08.813 INFO:tasks.workunit.client.0.smithi070.stderr: -156> 2024-09-12T00:57:08.407+0000 7f2125f8b640 10 monclient(hunting): get_auth_request con 0x561ea31e9cf0 auth_method 0 2024-09-12T00:57:08.813 INFO:tasks.workunit.client.0.smithi070.stderr: -155> 2024-09-12T00:57:08.407+0000 7f2125f8b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:08.813 INFO:tasks.workunit.client.0.smithi070.stderr: -154> 2024-09-12T00:57:08.407+0000 7f2125f8b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:08.813 INFO:tasks.workunit.client.0.smithi070.stderr: -153> 2024-09-12T00:57:08.407+0000 7f2125f8b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:08.813 INFO:tasks.workunit.client.0.smithi070.stderr: -152> 2024-09-12T00:57:08.407+0000 7f212678c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:08.813 INFO:tasks.workunit.client.0.smithi070.stderr: -151> 2024-09-12T00:57:08.407+0000 7f212678c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:08.813 INFO:tasks.workunit.client.0.smithi070.stderr: -150> 2024-09-12T00:57:08.407+0000 7f212678c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:08.813 INFO:tasks.workunit.client.0.smithi070.stderr: -149> 2024-09-12T00:57:08.407+0000 7f2125f8b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:08.813 INFO:tasks.workunit.client.0.smithi070.stderr: -148> 2024-09-12T00:57:08.407+0000 7f2125f8b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:08.813 INFO:tasks.workunit.client.0.smithi070.stderr: -147> 2024-09-12T00:57:08.407+0000 7f2125f8b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:08.813 INFO:tasks.workunit.client.0.smithi070.stderr: -146> 2024-09-12T00:57:08.407+0000 7f2125f8b640 10 monclient(hunting): handle_auth_done global_id 7593 payload 824 2024-09-12T00:57:08.813 INFO:tasks.workunit.client.0.smithi070.stderr: -145> 2024-09-12T00:57:08.407+0000 7f2125f8b640 10 monclient: _finish_hunting 0 2024-09-12T00:57:08.814 INFO:tasks.workunit.client.0.smithi070.stderr: -144> 2024-09-12T00:57:08.407+0000 7f2125f8b640 1 monclient: found mon.noname-a 2024-09-12T00:57:08.814 INFO:tasks.workunit.client.0.smithi070.stderr: -143> 2024-09-12T00:57:08.407+0000 7f2125f8b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:57:08.814 INFO:tasks.workunit.client.0.smithi070.stderr: -142> 2024-09-12T00:57:08.407+0000 7f1ff7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:08.814 INFO:tasks.workunit.client.0.smithi070.stderr: -141> 2024-09-12T00:57:08.407+0000 7f1ff7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:57:08.814 INFO:tasks.workunit.client.0.smithi070.stderr: -140> 2024-09-12T00:57:08.407+0000 7f1ff7fff640 10 monclient: dump: 2024-09-12T00:57:08.814 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:08.814 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:08.814 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.814 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.814 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:08.814 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.814 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:08.814 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:08.814 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:08.815 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.815 INFO:tasks.workunit.client.0.smithi070.stderr: -139> 2024-09-12T00:57:08.407+0000 7f1ff7fff640 10 monclient: _finish_auth 0 2024-09-12T00:57:08.815 INFO:tasks.workunit.client.0.smithi070.stderr: -138> 2024-09-12T00:57:08.407+0000 7f1ff7fff640 10 monclient: _check_auth_tickets 2024-09-12T00:57:08.815 INFO:tasks.workunit.client.0.smithi070.stderr: -137> 2024-09-12T00:57:08.407+0000 7f1ff7fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:57:08.815 INFO:tasks.workunit.client.0.smithi070.stderr: -136> 2024-09-12T00:57:08.407+0000 7f1ff7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:08.815 INFO:tasks.workunit.client.0.smithi070.stderr: -135> 2024-09-12T00:57:08.407+0000 7f1ff7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:57:08.815 INFO:tasks.workunit.client.0.smithi070.stderr: -134> 2024-09-12T00:57:08.407+0000 7f1ff7fff640 10 monclient: dump: 2024-09-12T00:57:08.815 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:08.815 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:08.815 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.815 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:08.815 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:08.815 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:08.815 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:08.816 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:08.816 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:08.816 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.816 INFO:tasks.workunit.client.0.smithi070.stderr: -133> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 monclient: authenticate success, global_id 7593 2024-09-12T00:57:08.816 INFO:tasks.workunit.client.0.smithi070.stderr: -132> 2024-09-12T00:57:08.407+0000 7f2009ffb640 4 set_mon_vals no callback set 2024-09-12T00:57:08.816 INFO:tasks.workunit.client.0.smithi070.stderr: -131> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient: _renew_subs 2024-09-12T00:57:08.816 INFO:tasks.workunit.client.0.smithi070.stderr: -130> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:57:08.816 INFO:tasks.workunit.client.0.smithi070.stderr: -129> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient: _renew_subs 2024-09-12T00:57:08.816 INFO:tasks.workunit.client.0.smithi070.stderr: -128> 2024-09-12T00:57:08.407+0000 7f2128c869c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:57:08.816 INFO:tasks.workunit.client.0.smithi070.stderr: -127> 2024-09-12T00:57:08.407+0000 7f2128c869c0 1 librados: init done 2024-09-12T00:57:08.816 INFO:tasks.workunit.client.0.smithi070.stderr: -126> 2024-09-12T00:57:08.407+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command cr dump hook 0x561ea31de318 2024-09-12T00:57:08.816 INFO:tasks.workunit.client.0.smithi070.stderr: -125> 2024-09-12T00:57:08.407+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.816 INFO:tasks.workunit.client.0.smithi070.stderr: -124> 2024-09-12T00:57:08.411+0000 7f1ff7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:57:08.817 INFO:tasks.workunit.client.0.smithi070.stderr: -123> 2024-09-12T00:57:08.411+0000 7f1ff7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:57:08.817 INFO:tasks.workunit.client.0.smithi070.stderr: -122> 2024-09-12T00:57:08.411+0000 7f1ff7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:57:08.817 INFO:tasks.workunit.client.0.smithi070.stderr: -121> 2024-09-12T00:57:08.411+0000 7f2126f8d640 10 monclient: get_auth_request con 0x561ea3207eb0 auth_method 0 2024-09-12T00:57:08.817 INFO:tasks.workunit.client.0.smithi070.stderr: -120> 2024-09-12T00:57:08.411+0000 7f212678c640 10 monclient: get_auth_request con 0x7f1ff0070ae0 auth_method 0 2024-09-12T00:57:08.817 INFO:tasks.workunit.client.0.smithi070.stderr: -119> 2024-09-12T00:57:08.411+0000 7f2128c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.817 INFO:tasks.workunit.client.0.smithi070.stderr: -118> 2024-09-12T00:57:08.411+0000 7f2128c869c0 20 realm 2024-09-12T00:57:08.817 INFO:tasks.workunit.client.0.smithi070.stderr: -117> 2024-09-12T00:57:08.411+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.817 INFO:tasks.workunit.client.0.smithi070.stderr: -116> 2024-09-12T00:57:08.411+0000 7f2128c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.817 INFO:tasks.workunit.client.0.smithi070.stderr: -115> 2024-09-12T00:57:08.411+0000 7f2128c869c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:08.817 INFO:tasks.workunit.client.0.smithi070.stderr: -114> 2024-09-12T00:57:08.411+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.817 INFO:tasks.workunit.client.0.smithi070.stderr: -113> 2024-09-12T00:57:08.411+0000 7f2128c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.817 INFO:tasks.workunit.client.0.smithi070.stderr: -112> 2024-09-12T00:57:08.411+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.817 INFO:tasks.workunit.client.0.smithi070.stderr: -111> 2024-09-12T00:57:08.411+0000 7f212678c640 10 monclient: get_auth_request con 0x561ea320c210 auth_method 0 2024-09-12T00:57:08.817 INFO:tasks.workunit.client.0.smithi070.stderr: -110> 2024-09-12T00:57:08.411+0000 7f2128c869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:08.818 INFO:tasks.workunit.client.0.smithi070.stderr: -109> 2024-09-12T00:57:08.411+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.818 INFO:tasks.workunit.client.0.smithi070.stderr: -108> 2024-09-12T00:57:08.411+0000 7f2125f8b640 10 monclient: get_auth_request con 0x561ea320f9a0 auth_method 0 2024-09-12T00:57:08.818 INFO:tasks.workunit.client.0.smithi070.stderr: -107> 2024-09-12T00:57:08.415+0000 7f2128c869c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:08.818 INFO:tasks.workunit.client.0.smithi070.stderr: -106> 2024-09-12T00:57:08.415+0000 7f2128c869c0 20 searching for the correct realm 2024-09-12T00:57:08.818 INFO:tasks.workunit.client.0.smithi070.stderr: -105> 2024-09-12T00:57:08.415+0000 7f2126f8d640 10 monclient: get_auth_request con 0x561ea32146b0 auth_method 0 2024-09-12T00:57:08.818 INFO:tasks.workunit.client.0.smithi070.stderr: -104> 2024-09-12T00:57:08.415+0000 7f212678c640 10 monclient: get_auth_request con 0x7f2120007be0 auth_method 0 2024-09-12T00:57:08.818 INFO:tasks.workunit.client.0.smithi070.stderr: -103> 2024-09-12T00:57:08.415+0000 7f2125f8b640 10 monclient: get_auth_request con 0x7f2118026040 auth_method 0 2024-09-12T00:57:08.818 INFO:tasks.workunit.client.0.smithi070.stderr: -102> 2024-09-12T00:57:08.419+0000 7f2126f8d640 10 monclient: get_auth_request con 0x7f21100c0020 auth_method 0 2024-09-12T00:57:08.818 INFO:tasks.workunit.client.0.smithi070.stderr: -101> 2024-09-12T00:57:08.419+0000 7f2126f8d640 0 -- 172.21.15.70:0/1003195127 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f21100c0020 msgr2=0x7f21100eda20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:08.818 INFO:tasks.workunit.client.0.smithi070.stderr: -100> 2024-09-12T00:57:08.623+0000 7f2126f8d640 10 monclient: get_auth_request con 0x7f21100c0020 auth_method 0 2024-09-12T00:57:08.818 INFO:tasks.workunit.client.0.smithi070.stderr: -99> 2024-09-12T00:57:08.627+0000 7f212678c640 10 monclient: get_auth_request con 0x7f2120037440 auth_method 0 2024-09-12T00:57:08.818 INFO:tasks.workunit.client.0.smithi070.stderr: -98> 2024-09-12T00:57:08.635+0000 7f2126f8d640 0 -- 172.21.15.70:0/1003195127 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f21100c0020 msgr2=0x7f21100eda20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:08.818 INFO:tasks.workunit.client.0.smithi070.stderr: -97> 2024-09-12T00:57:08.635+0000 7f1ff7fff640 1 client.7593.objecter ms_handle_reset 0x7f21100c0020 session 0x7f21100a6070 osd.4 2024-09-12T00:57:08.819 INFO:tasks.workunit.client.0.smithi070.stderr: -96> 2024-09-12T00:57:08.635+0000 7f1ff7fff640 10 monclient: _renew_subs 2024-09-12T00:57:08.819 INFO:tasks.workunit.client.0.smithi070.stderr: -95> 2024-09-12T00:57:08.635+0000 7f1ff7fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:57:08.819 INFO:tasks.workunit.client.0.smithi070.stderr: -94> 2024-09-12T00:57:08.635+0000 7f2126f8d640 10 monclient: get_auth_request con 0x7f1ff0080880 auth_method 0 2024-09-12T00:57:08.819 INFO:tasks.workunit.client.0.smithi070.stderr: -93> 2024-09-12T00:57:08.647+0000 7f2128c869c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:08.819 INFO:tasks.workunit.client.0.smithi070.stderr: -92> 2024-09-12T00:57:08.647+0000 7f2128c869c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:57:08.819 INFO:tasks.workunit.client.0.smithi070.stderr: -91> 2024-09-12T00:57:08.647+0000 7f2128c869c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:08.819 INFO:tasks.workunit.client.0.smithi070.stderr: -90> 2024-09-12T00:57:08.647+0000 7f2128c869c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:57:08.819 INFO:tasks.workunit.client.0.smithi070.stderr: -89> 2024-09-12T00:57:08.647+0000 7f2128c869c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:08.819 INFO:tasks.workunit.client.0.smithi070.stderr: -88> 2024-09-12T00:57:08.647+0000 7f2128c869c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:08.819 INFO:tasks.workunit.client.0.smithi070.stderr: -87> 2024-09-12T00:57:08.647+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.819 INFO:tasks.workunit.client.0.smithi070.stderr: -86> 2024-09-12T00:57:08.647+0000 7f2128c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.819 INFO:tasks.workunit.client.0.smithi070.stderr: -85> 2024-09-12T00:57:08.647+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.819 INFO:tasks.workunit.client.0.smithi070.stderr: -84> 2024-09-12T00:57:08.647+0000 7f2128c869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:08.820 INFO:tasks.workunit.client.0.smithi070.stderr: -83> 2024-09-12T00:57:08.647+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.820 INFO:tasks.workunit.client.0.smithi070.stderr: -82> 2024-09-12T00:57:08.651+0000 7f2128c869c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:08.820 INFO:tasks.workunit.client.0.smithi070.stderr: -81> 2024-09-12T00:57:08.651+0000 7f2128c869c0 20 zone default found 2024-09-12T00:57:08.820 INFO:tasks.workunit.client.0.smithi070.stderr: -80> 2024-09-12T00:57:08.651+0000 7f2128c869c0 4 Realm: () 2024-09-12T00:57:08.820 INFO:tasks.workunit.client.0.smithi070.stderr: -79> 2024-09-12T00:57:08.651+0000 7f2128c869c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:57:08.820 INFO:tasks.workunit.client.0.smithi070.stderr: -78> 2024-09-12T00:57:08.651+0000 7f2128c869c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:57:08.820 INFO:tasks.workunit.client.0.smithi070.stderr: -77> 2024-09-12T00:57:08.651+0000 7f2128c869c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:08.820 INFO:tasks.workunit.client.0.smithi070.stderr: -76> 2024-09-12T00:57:08.651+0000 7f2128c869c0 20 zonegroup default 2024-09-12T00:57:08.820 INFO:tasks.workunit.client.0.smithi070.stderr: -75> 2024-09-12T00:57:08.651+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.820 INFO:tasks.workunit.client.0.smithi070.stderr: -74> 2024-09-12T00:57:08.651+0000 7f2128c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.820 INFO:tasks.workunit.client.0.smithi070.stderr: -73> 2024-09-12T00:57:08.651+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.820 INFO:tasks.workunit.client.0.smithi070.stderr: -72> 2024-09-12T00:57:08.651+0000 7f2128c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.820 INFO:tasks.workunit.client.0.smithi070.stderr: -71> 2024-09-12T00:57:08.651+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.820 INFO:tasks.workunit.client.0.smithi070.stderr: -70> 2024-09-12T00:57:08.651+0000 7f2128c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.821 INFO:tasks.workunit.client.0.smithi070.stderr: -69> 2024-09-12T00:57:08.651+0000 7f2128c869c0 20 started sync module instance, tier type = 2024-09-12T00:57:08.821 INFO:tasks.workunit.client.0.smithi070.stderr: -68> 2024-09-12T00:57:08.651+0000 7f2128c869c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:57:08.821 INFO:tasks.workunit.client.0.smithi070.stderr: -67> 2024-09-12T00:57:08.675+0000 7f2128c869c0 20 add_watcher() i=0 2024-09-12T00:57:08.821 INFO:tasks.workunit.client.0.smithi070.stderr: -66> 2024-09-12T00:57:08.675+0000 7f2128c869c0 20 add_watcher() i=1 2024-09-12T00:57:08.821 INFO:tasks.workunit.client.0.smithi070.stderr: -65> 2024-09-12T00:57:08.675+0000 7f2128c869c0 20 add_watcher() i=2 2024-09-12T00:57:08.821 INFO:tasks.workunit.client.0.smithi070.stderr: -64> 2024-09-12T00:57:08.675+0000 7f2128c869c0 20 add_watcher() i=3 2024-09-12T00:57:08.821 INFO:tasks.workunit.client.0.smithi070.stderr: -63> 2024-09-12T00:57:08.675+0000 7f2128c869c0 20 add_watcher() i=4 2024-09-12T00:57:08.821 INFO:tasks.workunit.client.0.smithi070.stderr: -62> 2024-09-12T00:57:08.675+0000 7f2128c869c0 20 add_watcher() i=5 2024-09-12T00:57:08.821 INFO:tasks.workunit.client.0.smithi070.stderr: -61> 2024-09-12T00:57:08.675+0000 7f2128c869c0 20 add_watcher() i=6 2024-09-12T00:57:08.821 INFO:tasks.workunit.client.0.smithi070.stderr: -60> 2024-09-12T00:57:08.679+0000 7f2128c869c0 20 add_watcher() i=7 2024-09-12T00:57:08.821 INFO:tasks.workunit.client.0.smithi070.stderr: -59> 2024-09-12T00:57:08.679+0000 7f2128c869c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:08.821 INFO:tasks.workunit.client.0.smithi070.stderr: -58> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding auth protocol: cephx 2024-09-12T00:57:08.821 INFO:tasks.workunit.client.0.smithi070.stderr: -57> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding auth protocol: cephx 2024-09-12T00:57:08.821 INFO:tasks.workunit.client.0.smithi070.stderr: -56> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding auth protocol: cephx 2024-09-12T00:57:08.822 INFO:tasks.workunit.client.0.smithi070.stderr: -55> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding con mode: secure 2024-09-12T00:57:08.822 INFO:tasks.workunit.client.0.smithi070.stderr: -54> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding con mode: crc 2024-09-12T00:57:08.822 INFO:tasks.workunit.client.0.smithi070.stderr: -53> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding con mode: secure 2024-09-12T00:57:08.822 INFO:tasks.workunit.client.0.smithi070.stderr: -52> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding con mode: crc 2024-09-12T00:57:08.822 INFO:tasks.workunit.client.0.smithi070.stderr: -51> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding con mode: secure 2024-09-12T00:57:08.822 INFO:tasks.workunit.client.0.smithi070.stderr: -50> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding con mode: crc 2024-09-12T00:57:08.822 INFO:tasks.workunit.client.0.smithi070.stderr: -49> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding con mode: crc 2024-09-12T00:57:08.822 INFO:tasks.workunit.client.0.smithi070.stderr: -48> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding con mode: secure 2024-09-12T00:57:08.822 INFO:tasks.workunit.client.0.smithi070.stderr: -47> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding con mode: crc 2024-09-12T00:57:08.822 INFO:tasks.workunit.client.0.smithi070.stderr: -46> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding con mode: secure 2024-09-12T00:57:08.822 INFO:tasks.workunit.client.0.smithi070.stderr: -45> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding con mode: crc 2024-09-12T00:57:08.822 INFO:tasks.workunit.client.0.smithi070.stderr: -44> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 AuthRegistry(0x7ffc60326120) adding con mode: secure 2024-09-12T00:57:08.822 INFO:tasks.workunit.client.0.smithi070.stderr: -43> 2024-09-12T00:57:08.683+0000 7f1fdcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:08.823 INFO:tasks.workunit.client.0.smithi070.stderr: -42> 2024-09-12T00:57:08.683+0000 7f2128c869c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:08.823 INFO:tasks.workunit.client.0.smithi070.stderr: -41> 2024-09-12T00:57:08.683+0000 7f2128c869c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:08.823 INFO:tasks.workunit.client.0.smithi070.stderr: -40> 2024-09-12T00:57:08.683+0000 7f2128c869c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:08.823 INFO:tasks.workunit.client.0.smithi070.stderr: -39> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command cache list hook 0x561ea31daa50 2024-09-12T00:57:08.823 INFO:tasks.workunit.client.0.smithi070.stderr: -38> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command cache inspect hook 0x561ea31daa50 2024-09-12T00:57:08.823 INFO:tasks.workunit.client.0.smithi070.stderr: -37> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command cache erase hook 0x561ea31daa50 2024-09-12T00:57:08.823 INFO:tasks.workunit.client.0.smithi070.stderr: -36> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command cache zap hook 0x561ea31daa50 2024-09-12T00:57:08.823 INFO:tasks.workunit.client.0.smithi070.stderr: -35> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 note: GC not initialized 2024-09-12T00:57:08.823 INFO:tasks.workunit.client.0.smithi070.stderr: -34> 2024-09-12T00:57:08.683+0000 7f1f577fe640 20 reqs_thread_entry: start 2024-09-12T00:57:08.823 INFO:tasks.workunit.client.0.smithi070.stderr: -33> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command sync trace show hook 0x7f211800c3a0 2024-09-12T00:57:08.823 INFO:tasks.workunit.client.0.smithi070.stderr: -32> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command sync trace history hook 0x7f211800c3a0 2024-09-12T00:57:08.823 INFO:tasks.workunit.client.0.smithi070.stderr: -31> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command sync trace active hook 0x7f211800c3a0 2024-09-12T00:57:08.823 INFO:tasks.workunit.client.0.smithi070.stderr: -30> 2024-09-12T00:57:08.683+0000 7f2128c869c0 5 asok(0x561ea2f112b0) register_command sync trace active_short hook 0x7f211800c3a0 2024-09-12T00:57:08.823 INFO:tasks.workunit.client.0.smithi070.stderr: -29> 2024-09-12T00:57:08.683+0000 7f2128c869c0 20 init_complete bucket index max shards: 1 2024-09-12T00:57:08.823 INFO:tasks.workunit.client.0.smithi070.stderr: -28> 2024-09-12T00:57:08.683+0000 7f2128c869c0 20 Filter name: none 2024-09-12T00:57:08.824 INFO:tasks.workunit.client.0.smithi070.stderr: -27> 2024-09-12T00:57:08.683+0000 7f1f557fa640 20 reqs_thread_entry: start 2024-09-12T00:57:08.824 INFO:tasks.workunit.client.0.smithi070.stderr: -26> 2024-09-12T00:57:08.683+0000 7f2128c869c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:57:08.824 INFO:tasks.workunit.client.0.smithi070.stderr: -25> 2024-09-12T00:57:08.683+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.824 INFO:tasks.workunit.client.0.smithi070.stderr: -24> 2024-09-12T00:57:08.687+0000 7f2128c869c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:57:08.824 INFO:tasks.workunit.client.0.smithi070.stderr: -23> 2024-09-12T00:57:08.687+0000 7f2128c869c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:57:08.824 INFO:tasks.workunit.client.0.smithi070.stderr: -22> 2024-09-12T00:57:08.687+0000 7f2128c869c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:57:08.824 INFO:tasks.workunit.client.0.smithi070.stderr: -21> 2024-09-12T00:57:08.687+0000 7f2128c869c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 : miss 2024-09-12T00:57:08.824 INFO:tasks.workunit.client.0.smithi070.stderr: -20> 2024-09-12T00:57:08.687+0000 7f2128c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.824 INFO:tasks.workunit.client.0.smithi070.stderr: -19> 2024-09-12T00:57:08.687+0000 7f2128c869c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:57:08.824 INFO:tasks.workunit.client.0.smithi070.stderr: -18> 2024-09-12T00:57:08.687+0000 7f2128c869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 info.flags=0x17 2024-09-12T00:57:08.824 INFO:tasks.workunit.client.0.smithi070.stderr: -17> 2024-09-12T00:57:08.687+0000 7f2128c869c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 to cache LRU end 2024-09-12T00:57:08.824 INFO:tasks.workunit.client.0.smithi070.stderr: -16> 2024-09-12T00:57:08.687+0000 7f2128c869c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:57:08.824 INFO:tasks.workunit.client.0.smithi070.stderr: -15> 2024-09-12T00:57:08.687+0000 7f2128c869c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:08.825 INFO:tasks.workunit.client.0.smithi070.stderr: -14> 2024-09-12T00:57:08.687+0000 7f2128c869c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 2024-09-12T00:57:08.825 INFO:tasks.workunit.client.0.smithi070.stderr: -13> 2024-09-12T00:57:08.695+0000 7f2128c869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 info.flags=0x17 2024-09-12T00:57:08.825 INFO:tasks.workunit.client.0.smithi070.stderr: -12> 2024-09-12T00:57:08.695+0000 7f2128c869c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 to cache LRU end 2024-09-12T00:57:08.825 INFO:tasks.workunit.client.0.smithi070.stderr: -11> 2024-09-12T00:57:08.695+0000 7f2128c869c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:08.825 INFO:tasks.workunit.client.0.smithi070.stderr: -10> 2024-09-12T00:57:08.695+0000 7f2128c869c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35, ofs0, ns] 2024-09-12T00:57:08.825 INFO:tasks.workunit.client.0.smithi070.stderr: -9> 2024-09-12T00:57:08.695+0000 7f2009ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431621 cookie 94689585903424 notifier 7593 bl.length()=995 2024-09-12T00:57:08.825 INFO:tasks.workunit.client.0.smithi070.stderr: -8> 2024-09-12T00:57:08.695+0000 7f2009ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 info.flags=0x17 2024-09-12T00:57:08.825 INFO:tasks.workunit.client.0.smithi070.stderr: -7> 2024-09-12T00:57:08.695+0000 7f2009ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 to cache LRU end 2024-09-12T00:57:08.825 INFO:tasks.workunit.client.0.smithi070.stderr: -6> 2024-09-12T00:57:08.695+0000 7f2009ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:08.825 INFO:tasks.workunit.client.0.smithi070.stderr: -5> 2024-09-12T00:57:08.695+0000 7f2128c869c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35]): orig_sources= new_sources= 2024-09-12T00:57:08.825 INFO:tasks.workunit.client.0.smithi070.stderr: -4> 2024-09-12T00:57:08.695+0000 7f2128c869c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35]): potential sources added=[] removed=[] 2024-09-12T00:57:08.825 INFO:tasks.workunit.client.0.smithi070.stderr: -3> 2024-09-12T00:57:08.695+0000 7f2128c869c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35]): orig_dests= new_dests= 2024-09-12T00:57:08.825 INFO:tasks.workunit.client.0.smithi070.stderr: -2> 2024-09-12T00:57:08.695+0000 7f2128c869c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35]): potential dests added=[] removed=[] 2024-09-12T00:57:08.825 INFO:tasks.workunit.client.0.smithi070.stderr: -1> 2024-09-12T00:57:08.703+0000 7f2128c869c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2128c869c0 time 2024-09-12T00:57:08.707018+0000 2024-09-12T00:57:08.826 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:57:08.826 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.826 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:57:08.826 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f212c5602eb] 2024-09-12T00:57:08.826 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f212c56049f] 2024-09-12T00:57:08.826 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561ea1e7bcc1] 2024-09-12T00:57:08.826 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561ea1e90d5a] 2024-09-12T00:57:08.826 INFO:tasks.workunit.client.0.smithi070.stderr: 5: main() 2024-09-12T00:57:08.826 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f212b3c6d90] 2024-09-12T00:57:08.826 INFO:tasks.workunit.client.0.smithi070.stderr: 7: __libc_start_main() 2024-09-12T00:57:08.826 INFO:tasks.workunit.client.0.smithi070.stderr: 8: _start() 2024-09-12T00:57:08.826 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.826 INFO:tasks.workunit.client.0.smithi070.stderr: 0> 2024-09-12T00:57:08.703+0000 7f2128c869c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:57:08.827 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f2128c869c0 thread_name:radosgw-admin 2024-09-12T00:57:08.827 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.827 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:57:08.827 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f212b3df520] 2024-09-12T00:57:08.827 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:57:08.827 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:57:08.827 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:57:08.827 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f212c560345] 2024-09-12T00:57:08.827 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f212c56049f] 2024-09-12T00:57:08.827 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561ea1e7bcc1] 2024-09-12T00:57:08.827 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561ea1e90d5a] 2024-09-12T00:57:08.827 INFO:tasks.workunit.client.0.smithi070.stderr: 9: main() 2024-09-12T00:57:08.827 INFO:tasks.workunit.client.0.smithi070.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f212b3c6d90] 2024-09-12T00:57:08.827 INFO:tasks.workunit.client.0.smithi070.stderr: 11: __libc_start_main() 2024-09-12T00:57:08.828 INFO:tasks.workunit.client.0.smithi070.stderr: 12: _start() 2024-09-12T00:57:08.828 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:57:08.828 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.828 INFO:tasks.workunit.client.0.smithi070.stderr:--- logging levels --- 2024-09-12T00:57:08.828 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 none 2024-09-12T00:57:08.828 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 lockdep 2024-09-12T00:57:08.828 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 context 2024-09-12T00:57:08.828 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 crush 2024-09-12T00:57:08.828 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds 2024-09-12T00:57:08.828 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_balancer 2024-09-12T00:57:08.828 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_locker 2024-09-12T00:57:08.828 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log 2024-09-12T00:57:08.828 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log_expire 2024-09-12T00:57:08.828 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_migrator 2024-09-12T00:57:08.829 INFO:tasks.workunit.client.0.smithi070.stderr: 3/ 5 mds_quiesce 2024-09-12T00:57:08.829 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 buffer 2024-09-12T00:57:08.829 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 timer 2024-09-12T00:57:08.829 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 filer 2024-09-12T00:57:08.829 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 striper 2024-09-12T00:57:08.829 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 objecter 2024-09-12T00:57:08.829 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rados 2024-09-12T00:57:08.829 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd 2024-09-12T00:57:08.829 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_mirror 2024-09-12T00:57:08.829 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_replay 2024-09-12T00:57:08.829 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_pwl 2024-09-12T00:57:08.829 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 journaler 2024-09-12T00:57:08.829 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objectcacher 2024-09-12T00:57:08.829 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:57:08.830 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 client 2024-09-12T00:57:08.830 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 osd 2024-09-12T00:57:08.830 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 optracker 2024-09-12T00:57:08.830 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objclass 2024-09-12T00:57:08.830 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 filestore 2024-09-12T00:57:08.830 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 journal 2024-09-12T00:57:08.830 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 ms 2024-09-12T00:57:08.830 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mon 2024-09-12T00:57:08.830 INFO:tasks.workunit.client.0.smithi070.stderr: 0/10 monc 2024-09-12T00:57:08.830 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 paxos 2024-09-12T00:57:08.830 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 tp 2024-09-12T00:57:08.830 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 auth 2024-09-12T00:57:08.830 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 crypto 2024-09-12T00:57:08.830 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 finisher 2024-09-12T00:57:08.830 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 reserver 2024-09-12T00:57:08.831 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 heartbeatmap 2024-09-12T00:57:08.831 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 perfcounter 2024-09-12T00:57:08.831 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw 2024-09-12T00:57:08.831 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_sync 2024-09-12T00:57:08.831 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_datacache 2024-09-12T00:57:08.831 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_access 2024-09-12T00:57:08.831 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:57:08.831 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_flight 2024-09-12T00:57:08.831 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:57:08.831 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw_notification 2024-09-12T00:57:08.831 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 javaclient 2024-09-12T00:57:08.831 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 asok 2024-09-12T00:57:08.831 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 throttle 2024-09-12T00:57:08.831 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 refs 2024-09-12T00:57:08.832 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 compressor 2024-09-12T00:57:08.832 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluestore 2024-09-12T00:57:08.832 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluefs 2024-09-12T00:57:08.832 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 bdev 2024-09-12T00:57:08.832 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 kstore 2024-09-12T00:57:08.832 INFO:tasks.workunit.client.0.smithi070.stderr: 4/ 5 rocksdb 2024-09-12T00:57:08.832 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 fuse 2024-09-12T00:57:08.832 INFO:tasks.workunit.client.0.smithi070.stderr: 2/ 5 mgr 2024-09-12T00:57:08.832 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mgrc 2024-09-12T00:57:08.832 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 dpdk 2024-09-12T00:57:08.832 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 eventtrace 2024-09-12T00:57:08.832 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 prioritycache 2024-09-12T00:57:08.832 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 test 2024-09-12T00:57:08.832 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:57:08.833 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephsqlite 2024-09-12T00:57:08.833 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:57:08.833 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore 2024-09-12T00:57:08.833 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_onode 2024-09-12T00:57:08.833 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_odata 2024-09-12T00:57:08.833 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_omap 2024-09-12T00:57:08.833 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_tm 2024-09-12T00:57:08.833 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_t 2024-09-12T00:57:08.833 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:57:08.833 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_epm 2024-09-12T00:57:08.833 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_lba 2024-09-12T00:57:08.833 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:57:08.833 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cache 2024-09-12T00:57:08.833 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_journal 2024-09-12T00:57:08.834 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_device 2024-09-12T00:57:08.834 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_backref 2024-09-12T00:57:08.834 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 alienstore 2024-09-12T00:57:08.834 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mclock 2024-09-12T00:57:08.834 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cyanstore 2024-09-12T00:57:08.834 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 ceph_exporter 2024-09-12T00:57:08.834 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 memstore 2024-09-12T00:57:08.834 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 trace 2024-09-12T00:57:08.834 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 ceph_dedup 2024-09-12T00:57:08.834 INFO:tasks.workunit.client.0.smithi070.stderr: -2/-2 (syslog threshold) 2024-09-12T00:57:08.834 INFO:tasks.workunit.client.0.smithi070.stderr: 99/99 (stderr threshold) 2024-09-12T00:57:08.834 INFO:tasks.workunit.client.0.smithi070.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:57:08.834 INFO:tasks.workunit.client.0.smithi070.stderr: 7f1f557fa640 / http_manager 2024-09-12T00:57:08.834 INFO:tasks.workunit.client.0.smithi070.stderr: 7f1f577fe640 / http_manager 2024-09-12T00:57:08.835 INFO:tasks.workunit.client.0.smithi070.stderr: 7f1fdcfe1640 / rgw_dt_lg_renew 2024-09-12T00:57:08.835 INFO:tasks.workunit.client.0.smithi070.stderr: 7f1ff7fff640 / ms_dispatch 2024-09-12T00:57:08.835 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2009ffb640 / io_context_pool 2024-09-12T00:57:08.835 INFO:tasks.workunit.client.0.smithi070.stderr: 7f200bfff640 / ms_dispatch 2024-09-12T00:57:08.835 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2012e05640 / ms_dispatch 2024-09-12T00:57:08.835 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2014608640 / io_context_pool 2024-09-12T00:57:08.835 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2125f8b640 / msgr-worker-2 2024-09-12T00:57:08.835 INFO:tasks.workunit.client.0.smithi070.stderr: 7f212678c640 / msgr-worker-1 2024-09-12T00:57:08.835 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2126f8d640 / msgr-worker-0 2024-09-12T00:57:08.835 INFO:tasks.workunit.client.0.smithi070.stderr: 7f212778e640 / io_context_pool 2024-09-12T00:57:08.835 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2128c869c0 / radosgw-admin 2024-09-12T00:57:08.835 INFO:tasks.workunit.client.0.smithi070.stderr: max_recent 500 2024-09-12T00:57:08.835 INFO:tasks.workunit.client.0.smithi070.stderr: max_new 1000 2024-09-12T00:57:08.835 INFO:tasks.workunit.client.0.smithi070.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:57:08.709299Z_affef679-9d03-4633-8bb9-a9d6b933aef0/log 2024-09-12T00:57:08.835 INFO:tasks.workunit.client.0.smithi070.stderr:--- end dump of recent events --- 2024-09-12T00:57:08.836 INFO:tasks.workunit.client.0.smithi070.stderr:Aborted 2024-09-12T00:57:08.836 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:57:08.840 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:08.840 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:08.840 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.787+0000 7f8ed73709c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.840 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.787+0000 7f8ed73709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.840 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.787+0000 7f8ed73709c0 20 realm 2024-09-12T00:57:08.840 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.787+0000 7f8ed73709c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.840 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.787+0000 7f8ed73709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.840 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.787+0000 7f8ed73709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:08.840 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.787+0000 7f8ed73709c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.787+0000 7f8ed73709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.787+0000 7f8ed73709c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.791+0000 7f8ed73709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:08.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.791+0000 7f8ed73709c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.791+0000 7f8ed73709c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:08.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.791+0000 7f8ed73709c0 20 searching for the correct realm 2024-09-12T00:57:08.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.795+0000 7f8ed5677640 0 -- 172.21.15.70:0/2381956961 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f8ec8018070 msgr2=0x7f8ec8078cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:08.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.803+0000 7f8ed5677640 0 -- 172.21.15.70:0/2381956961 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f8da00808e0 msgr2=0x7f8da0082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:08.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.811+0000 7f8ed73709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:08.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.811+0000 7f8ed73709c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:57:08.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.811+0000 7f8ed73709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:08.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.811+0000 7f8ed73709c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:57:08.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.811+0000 7f8ed73709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:08.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.811+0000 7f8ed73709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:08.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.811+0000 7f8ed73709c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.811+0000 7f8ed73709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.811+0000 7f8ed73709c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.811+0000 7f8ed73709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:08.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.811+0000 7f8ed73709c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.811+0000 7f8ed73709c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:08.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.811+0000 7f8ed73709c0 20 zone default found 2024-09-12T00:57:08.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.811+0000 7f8ed73709c0 4 Realm: () 2024-09-12T00:57:08.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.811+0000 7f8ed73709c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:57:08.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.811+0000 7f8ed73709c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:57:08.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.811+0000 7f8ed73709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:08.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.811+0000 7f8ed73709c0 20 zonegroup default 2024-09-12T00:57:08.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.811+0000 7f8ed73709c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.811+0000 7f8ed73709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.811+0000 7f8ed73709c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.815+0000 7f8ed73709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.815+0000 7f8ed73709c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.815+0000 7f8ed73709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:08.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.815+0000 7f8ed73709c0 20 started sync module instance, tier type = 2024-09-12T00:57:08.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.815+0000 7f8ed73709c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:57:08.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.827+0000 7f8ed73709c0 20 add_watcher() i=0 2024-09-12T00:57:08.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.827+0000 7f8ed73709c0 20 add_watcher() i=1 2024-09-12T00:57:08.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.827+0000 7f8ed73709c0 20 add_watcher() i=2 2024-09-12T00:57:08.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.827+0000 7f8ed73709c0 20 add_watcher() i=3 2024-09-12T00:57:08.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.827+0000 7f8ed73709c0 20 add_watcher() i=4 2024-09-12T00:57:08.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.827+0000 7f8ed73709c0 20 add_watcher() i=5 2024-09-12T00:57:08.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.827+0000 7f8ed73709c0 20 add_watcher() i=6 2024-09-12T00:57:08.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.831+0000 7f8ed73709c0 20 add_watcher() i=7 2024-09-12T00:57:08.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.831+0000 7f8ed73709c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:08.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.831+0000 7f8d8afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:08.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.831+0000 7f8ed73709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:08.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.831+0000 7f8ed73709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:08.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.831+0000 7f8ed73709c0 5 note: GC not initialized 2024-09-12T00:57:08.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.831+0000 7f8d89fe3640 20 reqs_thread_entry: start 2024-09-12T00:57:08.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.835+0000 7f8ed73709c0 20 init_complete bucket index max shards: 1 2024-09-12T00:57:08.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.835+0000 7f8ed73709c0 20 Filter name: none 2024-09-12T00:57:08.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.835+0000 7f8cfb7fe640 20 reqs_thread_entry: start 2024-09-12T00:57:08.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.835+0000 7f8ed73709c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.835+0000 7f8ed73709c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:57:08.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.835+0000 7f8ed73709c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.835+0000 7f8ed73709c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:57:08.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.835+0000 7f8ed73709c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:08.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.835+0000 7f8ed73709c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.835+0000 7f8ed73709c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:57:08.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.835+0000 7f8ed73709c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:08.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.835+0000 7f8ed73709c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:57:08.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.835+0000 7f8ed73709c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:08.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.839+0000 7f8d8afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:08.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.843+0000 7f8ed73709c0 20 remove_watcher() i=0 2024-09-12T00:57:08.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.843+0000 7f8ed73709c0 2 removed watcher, disabling cache 2024-09-12T00:57:08.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.843+0000 7f8ed73709c0 20 remove_watcher() i=1 2024-09-12T00:57:08.846 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.847+0000 7f8ed73709c0 20 remove_watcher() i=2 2024-09-12T00:57:08.846 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.847+0000 7f8ed73709c0 20 remove_watcher() i=3 2024-09-12T00:57:08.846 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.851+0000 7f8ed73709c0 20 remove_watcher() i=4 2024-09-12T00:57:08.846 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.851+0000 7f8ed73709c0 20 remove_watcher() i=5 2024-09-12T00:57:08.847 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.855+0000 7f8ed73709c0 20 remove_watcher() i=6 2024-09-12T00:57:08.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:08.855+0000 7f8ed73709c0 20 remove_watcher() i=7 2024-09-12T00:57:08.862 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.862 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:57:08.862 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: abort-at-do-reshard id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:57:08.862 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:08.863 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:08.863 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:08.875 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:08.876 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:08.920 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:57:08.958 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:08.958 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:09.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.207+0000 7f7bf439c640 0 --2- 172.21.15.70:0/3429676114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595a3b7b840 0x5595a3b76ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:57:09.209 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.215+0000 7f7bf68969c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:09.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.215+0000 7f7bf68969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:09.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.215+0000 7f7bf68969c0 20 realm 2024-09-12T00:57:09.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.215+0000 7f7bf68969c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:09.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.215+0000 7f7bf68969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:09.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.215+0000 7f7bf68969c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:09.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.215+0000 7f7bf68969c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:09.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.219+0000 7f7bf68969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:09.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.219+0000 7f7bf68969c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:09.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.219+0000 7f7bf68969c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:09.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.219+0000 7f7bf68969c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:09.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.219+0000 7f7bf68969c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:09.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.219+0000 7f7bf68969c0 20 searching for the correct realm 2024-09-12T00:57:09.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.223+0000 7f7bf3b9b640 0 -- 172.21.15.70:0/3982169676 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7f7be4018070 msgr2=0x7f7be40793d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:09.431 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.435+0000 7f7bf439c640 0 -- 172.21.15.70:0/3982169676 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f7bec0c0410 msgr2=0x7f7bec0c0850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:09.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.451+0000 7f7bf68969c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:09.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.451+0000 7f7bf68969c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:57:09.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.451+0000 7f7bf68969c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:09.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.451+0000 7f7bf68969c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:57:09.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.451+0000 7f7bf68969c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:09.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.451+0000 7f7bf68969c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:09.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.451+0000 7f7bf68969c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:09.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.455+0000 7f7bf68969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:09.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.455+0000 7f7bf68969c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:09.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.455+0000 7f7bf68969c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:09.449 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.455+0000 7f7bf68969c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:09.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.455+0000 7f7bf68969c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:09.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.455+0000 7f7bf68969c0 20 zone default found 2024-09-12T00:57:09.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.455+0000 7f7bf68969c0 4 Realm: () 2024-09-12T00:57:09.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.455+0000 7f7bf68969c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:57:09.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.455+0000 7f7bf68969c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:57:09.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.455+0000 7f7bf68969c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:09.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.455+0000 7f7bf68969c0 20 zonegroup default 2024-09-12T00:57:09.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.455+0000 7f7bf68969c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:09.451 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.455+0000 7f7bf68969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:09.451 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.455+0000 7f7bf68969c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:09.451 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.459+0000 7f7bf68969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:09.452 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.459+0000 7f7bf68969c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:09.452 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.459+0000 7f7bf68969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:09.452 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.459+0000 7f7bf68969c0 20 started sync module instance, tier type = 2024-09-12T00:57:09.453 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.459+0000 7f7bf68969c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:57:09.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.479+0000 7f7bf68969c0 20 add_watcher() i=0 2024-09-12T00:57:09.476 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.479+0000 7f7bf68969c0 20 add_watcher() i=1 2024-09-12T00:57:09.476 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.479+0000 7f7bf68969c0 20 add_watcher() i=2 2024-09-12T00:57:09.476 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.479+0000 7f7bf68969c0 20 add_watcher() i=3 2024-09-12T00:57:09.476 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.479+0000 7f7bf68969c0 20 add_watcher() i=4 2024-09-12T00:57:09.476 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.479+0000 7f7bf68969c0 20 add_watcher() i=5 2024-09-12T00:57:09.476 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.483+0000 7f7bf68969c0 20 add_watcher() i=6 2024-09-12T00:57:09.477 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.483+0000 7f7bf68969c0 20 add_watcher() i=7 2024-09-12T00:57:09.477 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.483+0000 7f7bf68969c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:09.481 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.487+0000 7f7aaafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:09.482 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.487+0000 7f7bf68969c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:09.482 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.487+0000 7f7bf68969c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:09.482 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.487+0000 7f7bf68969c0 5 note: GC not initialized 2024-09-12T00:57:09.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.487+0000 7f7aa9fdb640 20 reqs_thread_entry: start 2024-09-12T00:57:09.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.487+0000 7f7bf68969c0 20 init_complete bucket index max shards: 1 2024-09-12T00:57:09.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.487+0000 7f7bf68969c0 20 Filter name: none 2024-09-12T00:57:09.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.487+0000 7f7a1b7fe640 20 reqs_thread_entry: start 2024-09-12T00:57:09.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.487+0000 7f7bf68969c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:57:09.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.487+0000 7f7bf68969c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:09.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.491+0000 7f7bf68969c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:57:09.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.491+0000 7f7bf68969c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:57:09.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.491+0000 7f7bf68969c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:57:09.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.491+0000 7f7bf68969c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 : miss 2024-09-12T00:57:09.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.491+0000 7f7bf68969c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:09.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.491+0000 7f7bf68969c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:57:09.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.491+0000 7f7bf68969c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 info.flags=0x17 2024-09-12T00:57:09.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.491+0000 7f7bf68969c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 to cache LRU end 2024-09-12T00:57:09.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.491+0000 7f7bf68969c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:57:09.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.491+0000 7f7bf68969c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:09.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.491+0000 7f7bf68969c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 2024-09-12T00:57:09.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.491+0000 7f7bf68969c0 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 to be held by another RGW process; skipping for now 2024-09-12T00:57:09.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.495+0000 7f7aaafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:09.493 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.499+0000 7f7bf68969c0 20 remove_watcher() i=0 2024-09-12T00:57:09.493 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.499+0000 7f7bf68969c0 2 removed watcher, disabling cache 2024-09-12T00:57:09.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.499+0000 7f7bf68969c0 20 remove_watcher() i=1 2024-09-12T00:57:09.497 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.503+0000 7f7bf68969c0 20 remove_watcher() i=2 2024-09-12T00:57:09.499 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.503+0000 7f7bf68969c0 20 remove_watcher() i=3 2024-09-12T00:57:09.501 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.507+0000 7f7bf68969c0 20 remove_watcher() i=4 2024-09-12T00:57:09.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.507+0000 7f7bf68969c0 20 remove_watcher() i=5 2024-09-12T00:57:09.503 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.511+0000 7f7bf68969c0 20 remove_watcher() i=6 2024-09-12T00:57:09.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:09.511+0000 7f7bf68969c0 20 remove_watcher() i=7 2024-09-12T00:57:09.520 INFO:tasks.workunit.client.0.smithi070.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:57:39.551 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:57:39.588 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:39.588 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:39.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.639+0000 7f887c54c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:39.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.639+0000 7f887c54c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:39.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.639+0000 7f887c54c9c0 20 realm 2024-09-12T00:57:39.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.639+0000 7f887c54c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:39.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.639+0000 7f887c54c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:39.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.639+0000 7f887c54c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:39.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.639+0000 7f887c54c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:39.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.639+0000 7f887c54c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:39.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.639+0000 7f887c54c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:39.636 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.643+0000 7f887c54c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:39.636 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.643+0000 7f887c54c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:39.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.643+0000 7f887c54c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:39.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.643+0000 7f887c54c9c0 20 searching for the correct realm 2024-09-12T00:57:39.643 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.651+0000 7f887a853640 0 -- 172.21.15.70:0/1578748897 >> [v2:172.21.15.70:6808/276433067,v1:172.21.15.70:6809/276433067] conn(0x561bef59e4a0 msgr2=0x561bef5a0960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:39.651 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.659+0000 7f887a853640 0 -- 172.21.15.70:0/1578748897 >> [v2:172.21.15.70:6816/1979013808,v1:172.21.15.70:6817/1979013808] conn(0x561bef591da0 msgr2=0x561bef594190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:39.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.663+0000 7f887c54c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:39.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.663+0000 7f887c54c9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:57:39.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.663+0000 7f887c54c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:39.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.663+0000 7f887c54c9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:57:39.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.663+0000 7f887c54c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:39.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.663+0000 7f887c54c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:39.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.663+0000 7f887c54c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:39.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.663+0000 7f887c54c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:39.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.663+0000 7f887c54c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:39.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.663+0000 7f887c54c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:39.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.663+0000 7f887c54c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:39.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.663+0000 7f887c54c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:39.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.663+0000 7f887c54c9c0 20 zone default found 2024-09-12T00:57:39.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.663+0000 7f887c54c9c0 4 Realm: () 2024-09-12T00:57:39.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.663+0000 7f887c54c9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:57:39.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.663+0000 7f887c54c9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:57:39.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.663+0000 7f887c54c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:39.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.663+0000 7f887c54c9c0 20 zonegroup default 2024-09-12T00:57:39.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.663+0000 7f887c54c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:39.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.663+0000 7f887c54c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:39.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.663+0000 7f887c54c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:39.660 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.667+0000 7f887c54c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:39.660 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.667+0000 7f887c54c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:39.660 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.667+0000 7f887c54c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:39.660 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.667+0000 7f887c54c9c0 20 started sync module instance, tier type = 2024-09-12T00:57:39.660 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.667+0000 7f887c54c9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:57:39.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.679+0000 7f887c54c9c0 20 add_watcher() i=0 2024-09-12T00:57:39.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.679+0000 7f887c54c9c0 20 add_watcher() i=1 2024-09-12T00:57:39.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.679+0000 7f887c54c9c0 20 add_watcher() i=2 2024-09-12T00:57:39.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.679+0000 7f887c54c9c0 20 add_watcher() i=3 2024-09-12T00:57:39.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.679+0000 7f887c54c9c0 20 add_watcher() i=4 2024-09-12T00:57:39.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.679+0000 7f887c54c9c0 20 add_watcher() i=5 2024-09-12T00:57:39.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.679+0000 7f887c54c9c0 20 add_watcher() i=6 2024-09-12T00:57:39.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.683+0000 7f887c54c9c0 20 add_watcher() i=7 2024-09-12T00:57:39.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.683+0000 7f887c54c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:39.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.683+0000 7f8730fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:39.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.687+0000 7f887c54c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:39.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.687+0000 7f887c54c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:39.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.687+0000 7f887c54c9c0 5 note: GC not initialized 2024-09-12T00:57:39.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.687+0000 7f86ab7fe640 20 reqs_thread_entry: start 2024-09-12T00:57:39.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.687+0000 7f887c54c9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:57:39.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.687+0000 7f887c54c9c0 20 Filter name: none 2024-09-12T00:57:39.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.687+0000 7f86a97fa640 20 reqs_thread_entry: start 2024-09-12T00:57:39.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.687+0000 7f887c54c9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:57:39.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.687+0000 7f887c54c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:39.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.687+0000 7f887c54c9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:57:39.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.687+0000 7f887c54c9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:57:39.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.687+0000 7f887c54c9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:57:39.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.687+0000 7f887c54c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 : miss 2024-09-12T00:57:39.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.687+0000 7f887c54c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:39.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.687+0000 7f887c54c9c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:57:39.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.687+0000 7f887c54c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 info.flags=0x17 2024-09-12T00:57:39.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.687+0000 7f887c54c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 to cache LRU end 2024-09-12T00:57:39.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.687+0000 7f887c54c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:57:39.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.687+0000 7f887c54c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:39.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.687+0000 7f887c54c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 2024-09-12T00:57:39.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.687+0000 7f887c54c9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:57:39.692 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.699+0000 7f887c54c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 info.flags=0x17 2024-09-12T00:57:39.692 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.699+0000 7f887c54c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 to cache LRU end 2024-09-12T00:57:39.692 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.699+0000 7f887c54c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:39.692 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.699+0000 7f887c54c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35, ofs0, ns] 2024-09-12T00:57:39.692 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.699+0000 7f875dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431622 cookie 94677979758448 notifier 7650 bl.length()=995 2024-09-12T00:57:39.692 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.699+0000 7f875dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 info.flags=0x17 2024-09-12T00:57:39.692 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.699+0000 7f875dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 to cache LRU end 2024-09-12T00:57:39.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.699+0000 7f875dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:39.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.699+0000 7f887c54c9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35]): orig_sources= new_sources= 2024-09-12T00:57:39.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.699+0000 7f887c54c9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35]): potential sources added=[] removed=[] 2024-09-12T00:57:39.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.699+0000 7f887c54c9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35]): orig_dests= new_dests= 2024-09-12T00:57:39.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.699+0000 7f887c54c9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35]): potential dests added=[] removed=[] 2024-09-12T00:57:39.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.707+0000 7f887c54c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35.2.0 2024-09-12T00:57:39.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.707+0000 7f887c54c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35.2.0 2024-09-12T00:57:39.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.707+0000 7f887c54c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35.2.1 2024-09-12T00:57:39.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.707+0000 7f887c54c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35.2.1 2024-09-12T00:57:39.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.707+0000 7f887c54c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35.0 2024-09-12T00:57:39.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.711+0000 7f887c54c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:57:39.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.711+0000 7f887c54c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 2024-09-12T00:57:39.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.715+0000 7f887c54c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 info.flags=0x17 2024-09-12T00:57:39.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.715+0000 7f887c54c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 to cache LRU end 2024-09-12T00:57:39.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.715+0000 7f887c54c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:39.709 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.715+0000 7f887c54c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35, ofs0, ns] 2024-09-12T00:57:39.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.715+0000 7f875d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431623 cookie 94677979758448 notifier 7650 bl.length()=995 2024-09-12T00:57:39.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.715+0000 7f875d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 info.flags=0x17 2024-09-12T00:57:39.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.715+0000 7f875d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 to cache LRU end 2024-09-12T00:57:39.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.715+0000 7f875d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:39.711 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.715+0000 7f887c54c9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35]): orig_sources= new_sources= 2024-09-12T00:57:39.711 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.715+0000 7f887c54c9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35]): potential sources added=[] removed=[] 2024-09-12T00:57:39.711 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.715+0000 7f887c54c9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35]): orig_dests= new_dests= 2024-09-12T00:57:39.711 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.715+0000 7f887c54c9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35]): potential dests added=[] removed=[] 2024-09-12T00:57:39.713 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.719+0000 7f887c54c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35.0 2024-09-12T00:57:39.714 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.719+0000 7f887c54c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:57:39.714 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.719+0000 7f887c54c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 2024-09-12T00:57:39.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.723+0000 7f887c54c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 info.flags=0x17 2024-09-12T00:57:39.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.723+0000 7f887c54c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 to cache LRU end 2024-09-12T00:57:39.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.723+0000 7f887c54c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:39.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.723+0000 7f887c54c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35, ofs0, ns] 2024-09-12T00:57:39.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.723+0000 7f875dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431624 cookie 94677979758448 notifier 7650 bl.length()=963 2024-09-12T00:57:39.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.723+0000 7f875dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 info.flags=0x17 2024-09-12T00:57:39.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.723+0000 7f875dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 to cache LRU end 2024-09-12T00:57:39.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.723+0000 7f875dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:39.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.723+0000 7f887c54c9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35]): orig_sources= new_sources= 2024-09-12T00:57:39.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.723+0000 7f887c54c9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35]): potential sources added=[] removed=[] 2024-09-12T00:57:39.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.723+0000 7f887c54c9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35]): orig_dests= new_dests= 2024-09-12T00:57:39.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.723+0000 7f887c54c9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35]): potential dests added=[] removed=[] 2024-09-12T00:57:39.720 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.727+0000 7f887c54c9c0 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-12T00:57:39.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.731+0000 7f8730fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:39.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.735+0000 7f887c54c9c0 20 remove_watcher() i=0 2024-09-12T00:57:39.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.735+0000 7f887c54c9c0 2 removed watcher, disabling cache 2024-09-12T00:57:39.730 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.735+0000 7f887c54c9c0 20 remove_watcher() i=1 2024-09-12T00:57:39.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.739+0000 7f887c54c9c0 20 remove_watcher() i=2 2024-09-12T00:57:39.734 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.739+0000 7f887c54c9c0 20 remove_watcher() i=3 2024-09-12T00:57:39.737 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.743+0000 7f887c54c9c0 20 remove_watcher() i=4 2024-09-12T00:57:39.738 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.743+0000 7f887c54c9c0 20 remove_watcher() i=5 2024-09-12T00:57:39.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.747+0000 7f887c54c9c0 20 remove_watcher() i=6 2024-09-12T00:57:39.741 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.747+0000 7f887c54c9c0 20 remove_watcher() i=7 2024-09-12T00:57:39.755 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:57:39.782 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:39.782 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:39.825 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.831+0000 7f69b46d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:39.828 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.835+0000 7f69b46d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:39.828 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.835+0000 7f69b46d79c0 20 realm 2024-09-12T00:57:39.828 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.835+0000 7f69b46d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:39.828 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.835+0000 7f69b46d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:39.828 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.835+0000 7f69b46d79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:39.828 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.835+0000 7f69b46d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:39.828 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.835+0000 7f69b46d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:39.828 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.835+0000 7f69b46d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:39.830 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.835+0000 7f69b46d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:39.830 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.835+0000 7f69b46d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:39.830 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.835+0000 7f69b46d79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:39.831 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.835+0000 7f69b46d79c0 20 searching for the correct realm 2024-09-12T00:57:39.833 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:39.839+0000 7f69b19dc640 0 -- 172.21.15.70:0/1611964640 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7f69a0002350 msgr2=0x7f69a409b0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:57:40.046 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.051+0000 7f69b21dd640 0 -- 172.21.15.70:0/1611964640 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f69ac069c20 msgr2=0x7f69ac067ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:40.061 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.067+0000 7f69b46d79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:40.061 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.067+0000 7f69b46d79c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:57:40.061 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.067+0000 7f69b46d79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:40.061 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.067+0000 7f69b46d79c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:57:40.061 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.067+0000 7f69b46d79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:40.062 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.067+0000 7f69b46d79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:40.062 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.067+0000 7f69b46d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:40.062 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.067+0000 7f69b46d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:40.062 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.067+0000 7f69b46d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:40.062 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.067+0000 7f69b46d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:40.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.067+0000 7f69b46d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:40.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.071+0000 7f69b46d79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:40.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.071+0000 7f69b46d79c0 20 zone default found 2024-09-12T00:57:40.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.071+0000 7f69b46d79c0 4 Realm: () 2024-09-12T00:57:40.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.071+0000 7f69b46d79c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:57:40.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.071+0000 7f69b46d79c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:57:40.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.071+0000 7f69b46d79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:40.064 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.071+0000 7f69b46d79c0 20 zonegroup default 2024-09-12T00:57:40.064 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.071+0000 7f69b46d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:40.064 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.071+0000 7f69b46d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:40.064 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.071+0000 7f69b46d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:40.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.071+0000 7f69b46d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:40.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.071+0000 7f69b46d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:40.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.071+0000 7f69b46d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:40.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.071+0000 7f69b46d79c0 20 started sync module instance, tier type = 2024-09-12T00:57:40.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.071+0000 7f69b46d79c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:57:40.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.095+0000 7f69b46d79c0 20 add_watcher() i=0 2024-09-12T00:57:40.088 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.095+0000 7f69b46d79c0 20 add_watcher() i=1 2024-09-12T00:57:40.088 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.095+0000 7f69b46d79c0 20 add_watcher() i=2 2024-09-12T00:57:40.088 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.095+0000 7f69b46d79c0 20 add_watcher() i=3 2024-09-12T00:57:40.088 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.095+0000 7f69b46d79c0 20 add_watcher() i=4 2024-09-12T00:57:40.088 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.095+0000 7f69b46d79c0 20 add_watcher() i=5 2024-09-12T00:57:40.088 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.095+0000 7f69b46d79c0 20 add_watcher() i=6 2024-09-12T00:57:40.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.095+0000 7f69b46d79c0 20 add_watcher() i=7 2024-09-12T00:57:40.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.095+0000 7f69b46d79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:40.093 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.099+0000 7f6868fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:40.094 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.099+0000 7f69b46d79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:40.094 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.099+0000 7f69b46d79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:40.094 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.099+0000 7f69b46d79c0 5 note: GC not initialized 2024-09-12T00:57:40.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.099+0000 7f67e37fe640 20 reqs_thread_entry: start 2024-09-12T00:57:40.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.103+0000 7f69b46d79c0 20 init_complete bucket index max shards: 1 2024-09-12T00:57:40.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.103+0000 7f69b46d79c0 20 Filter name: none 2024-09-12T00:57:40.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.103+0000 7f67e17fa640 20 reqs_thread_entry: start 2024-09-12T00:57:40.096 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.103+0000 7f69b46d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:40.096 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.103+0000 7f69b46d79c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:57:40.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.103+0000 7f69b46d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:40.100 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.103+0000 7f69b46d79c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:57:40.100 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.103+0000 7f69b46d79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:40.100 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.103+0000 7f69b46d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:40.100 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.103+0000 7f69b46d79c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:57:40.101 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.103+0000 7f69b46d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:40.101 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.103+0000 7f69b46d79c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:57:40.101 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.103+0000 7f69b46d79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:40.101 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.107+0000 7f6868fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:40.106 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.111+0000 7f69b46d79c0 20 remove_watcher() i=0 2024-09-12T00:57:40.106 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.111+0000 7f69b46d79c0 2 removed watcher, disabling cache 2024-09-12T00:57:40.108 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.115+0000 7f69b46d79c0 20 remove_watcher() i=1 2024-09-12T00:57:40.111 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.115+0000 7f69b46d79c0 20 remove_watcher() i=2 2024-09-12T00:57:40.113 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.119+0000 7f69b46d79c0 20 remove_watcher() i=3 2024-09-12T00:57:40.115 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.123+0000 7f69b46d79c0 20 remove_watcher() i=4 2024-09-12T00:57:40.116 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.123+0000 7f69b46d79c0 20 remove_watcher() i=5 2024-09-12T00:57:40.118 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.123+0000 7f69b46d79c0 20 remove_watcher() i=6 2024-09-12T00:57:40.119 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.127+0000 7f69b46d79c0 20 remove_watcher() i=7 2024-09-12T00:57:40.142 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:40.142 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:57:40.142 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: abort-at-do-reshard id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:57:40.142 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:40.145 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:40.145 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:40.151 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:40.151 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:40.201 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:40.201 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:40.233 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-12T00:57:40.233 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:40.234 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:40.234 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:40.254 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:40.254 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:40.297 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:40.297 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:40.315 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:40.316 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:40.333 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:40.333 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:40.352 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:40.352 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:40.370 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:40.370 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:40.388 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:40.388 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:40.406 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:40.406 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:40.424 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:40.424 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:40.444 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:40.444 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:40.466 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:40.466 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:40.485 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:40.485 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:40.502 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:40.503 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:40.522 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:40.523 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:40.540 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:40.541 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:40.559 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:40.559 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:40.579 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:40.579 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:40.597 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:40.597 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:40.616 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:40.616 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:40.636 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:40.636 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:40.655 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:40.655 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:40.671 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:57:40.704 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:40.705 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:40.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.755+0000 7f48595d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:40.751 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.759+0000 7f48595d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:40.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.759+0000 7f48595d79c0 20 realm 2024-09-12T00:57:40.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.759+0000 7f48595d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:40.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.759+0000 7f48595d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:40.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.759+0000 7f48595d79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:40.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.759+0000 7f48595d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:40.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.759+0000 7f48595d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:40.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.759+0000 7f48595d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:40.753 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.759+0000 7f48595d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:40.753 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.759+0000 7f48595d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:40.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.759+0000 7f48595d79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:40.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.759+0000 7f48595d79c0 20 searching for the correct realm 2024-09-12T00:57:40.756 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.763+0000 7f48570dd640 0 -- 172.21.15.70:0/3357627918 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f4850017030 msgr2=0x7f485005b460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:40.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.767+0000 7f48570dd640 0 -- 172.21.15.70:0/3357627918 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f4840003be0 msgr2=0x7f4850081190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:40.986 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.991+0000 7f48595d79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:40.986 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.991+0000 7f48595d79c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:57:40.986 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.991+0000 7f48595d79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:40.986 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.991+0000 7f48595d79c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:57:40.986 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.991+0000 7f48595d79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:40.986 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.991+0000 7f48595d79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:40.986 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.991+0000 7f48595d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:40.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.991+0000 7f48595d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:40.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.991+0000 7f48595d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:40.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.995+0000 7f48595d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:40.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.995+0000 7f48595d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:40.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.995+0000 7f48595d79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:40.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.995+0000 7f48595d79c0 20 zone default found 2024-09-12T00:57:40.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.995+0000 7f48595d79c0 4 Realm: () 2024-09-12T00:57:40.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.995+0000 7f48595d79c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:57:40.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.995+0000 7f48595d79c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:57:40.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.995+0000 7f48595d79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:40.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.995+0000 7f48595d79c0 20 zonegroup default 2024-09-12T00:57:40.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.995+0000 7f48595d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:40.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.995+0000 7f48595d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:40.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.995+0000 7f48595d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:40.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.995+0000 7f48595d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:40.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.995+0000 7f48595d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:40.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.995+0000 7f48595d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:40.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.995+0000 7f48595d79c0 20 started sync module instance, tier type = 2024-09-12T00:57:40.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:40.995+0000 7f48595d79c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:57:41.014 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.019+0000 7f48595d79c0 20 add_watcher() i=0 2024-09-12T00:57:41.014 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.019+0000 7f48595d79c0 20 add_watcher() i=1 2024-09-12T00:57:41.014 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.019+0000 7f48595d79c0 20 add_watcher() i=2 2024-09-12T00:57:41.014 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.019+0000 7f48595d79c0 20 add_watcher() i=3 2024-09-12T00:57:41.014 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.019+0000 7f48595d79c0 20 add_watcher() i=4 2024-09-12T00:57:41.014 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.019+0000 7f48595d79c0 20 add_watcher() i=5 2024-09-12T00:57:41.014 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.019+0000 7f48595d79c0 20 add_watcher() i=6 2024-09-12T00:57:41.016 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.023+0000 7f48595d79c0 20 add_watcher() i=7 2024-09-12T00:57:41.016 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.023+0000 7f48595d79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:41.020 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.027+0000 7f470dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:41.021 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.027+0000 7f48595d79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:41.021 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.027+0000 7f48595d79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:41.021 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.027+0000 7f48595d79c0 5 note: GC not initialized 2024-09-12T00:57:41.022 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.027+0000 7f470cfe1640 20 reqs_thread_entry: start 2024-09-12T00:57:41.022 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.027+0000 7f48595d79c0 20 init_complete bucket index max shards: 1 2024-09-12T00:57:41.022 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.027+0000 7f48595d79c0 20 Filter name: none 2024-09-12T00:57:41.022 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.027+0000 7f46867fc640 20 reqs_thread_entry: start 2024-09-12T00:57:41.022 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.027+0000 7f48595d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.024 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.031+0000 7f48595d79c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:57:41.024 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.031+0000 7f48595d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.025 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.031+0000 7f48595d79c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:57:41.025 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.031+0000 7f48595d79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:41.025 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.031+0000 7f48595d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.025 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.031+0000 7f48595d79c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:57:41.025 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.031+0000 7f48595d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.026 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.031+0000 7f48595d79c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:57:41.026 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.031+0000 7f48595d79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:41.029 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.035+0000 7f470dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:41.034 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.039+0000 7f48595d79c0 20 remove_watcher() i=0 2024-09-12T00:57:41.034 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.039+0000 7f48595d79c0 2 removed watcher, disabling cache 2024-09-12T00:57:41.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.043+0000 7f48595d79c0 20 remove_watcher() i=1 2024-09-12T00:57:41.039 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.047+0000 7f48595d79c0 20 remove_watcher() i=2 2024-09-12T00:57:41.041 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.047+0000 7f48595d79c0 20 remove_watcher() i=3 2024-09-12T00:57:41.044 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.051+0000 7f48595d79c0 20 remove_watcher() i=4 2024-09-12T00:57:41.045 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.051+0000 7f48595d79c0 20 remove_watcher() i=5 2024-09-12T00:57:41.046 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.051+0000 7f48595d79c0 20 remove_watcher() i=6 2024-09-12T00:57:41.048 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.055+0000 7f48595d79c0 20 remove_watcher() i=7 2024-09-12T00:57:41.063 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:41.063 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:57:41.063 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-logrecord-writes id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:57:41.063 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:41.064 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-12T00:57:41.101 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:41.101 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:41.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.151+0000 7f13bde039c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.146 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.151+0000 7f13bde039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:41.146 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.151+0000 7f13bde039c0 20 realm 2024-09-12T00:57:41.146 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.151+0000 7f13bde039c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.146 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.151+0000 7f13bde039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:41.146 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.151+0000 7f13bde039c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:41.146 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.151+0000 7f13bde039c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.146 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.151+0000 7f13bde039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:41.146 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.151+0000 7f13bde039c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.147 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.155+0000 7f13bde039c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:41.148 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.155+0000 7f13bde039c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.148 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.155+0000 7f13bde039c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:41.148 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.155+0000 7f13bde039c0 20 searching for the correct realm 2024-09-12T00:57:41.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.159+0000 7f13bc10a640 0 -- 172.21.15.70:0/199446785 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f13a40c0020 msgr2=0x7f13a40f76f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:41.364 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.371+0000 7f13b3fff640 0 -- 172.21.15.70:0/199446785 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7f13a40c0020 msgr2=0x7f1284085600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:41.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.590+0000 7f13bde039c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:41.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.590+0000 7f13bde039c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:57:41.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.590+0000 7f13bde039c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:41.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.590+0000 7f13bde039c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:57:41.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.590+0000 7f13bde039c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:41.587 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.590+0000 7f13bde039c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:41.587 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.590+0000 7f13bde039c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.587 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.590+0000 7f13bde039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:41.587 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.590+0000 7f13bde039c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.587 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.594+0000 7f13bde039c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:41.587 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.594+0000 7f13bde039c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.588 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.594+0000 7f13bde039c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:41.588 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.594+0000 7f13bde039c0 20 zone default found 2024-09-12T00:57:41.588 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.594+0000 7f13bde039c0 4 Realm: () 2024-09-12T00:57:41.589 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.594+0000 7f13bde039c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:57:41.589 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.594+0000 7f13bde039c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:57:41.589 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.594+0000 7f13bde039c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:41.589 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.594+0000 7f13bde039c0 20 zonegroup default 2024-09-12T00:57:41.589 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.594+0000 7f13bde039c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.589 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.594+0000 7f13bde039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:41.589 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.594+0000 7f13bde039c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.590 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.594+0000 7f13bde039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:41.590 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.594+0000 7f13bde039c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.590 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.594+0000 7f13bde039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:41.590 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.594+0000 7f13bde039c0 20 started sync module instance, tier type = 2024-09-12T00:57:41.590 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.594+0000 7f13bde039c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:57:41.612 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.618+0000 7f13bde039c0 20 add_watcher() i=0 2024-09-12T00:57:41.612 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.618+0000 7f13bde039c0 20 add_watcher() i=1 2024-09-12T00:57:41.612 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.618+0000 7f13bde039c0 20 add_watcher() i=2 2024-09-12T00:57:41.612 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.618+0000 7f13bde039c0 20 add_watcher() i=3 2024-09-12T00:57:41.612 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.618+0000 7f13bde039c0 20 add_watcher() i=4 2024-09-12T00:57:41.612 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.618+0000 7f13bde039c0 20 add_watcher() i=5 2024-09-12T00:57:41.612 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.618+0000 7f13bde039c0 20 add_watcher() i=6 2024-09-12T00:57:41.613 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.618+0000 7f13bde039c0 20 add_watcher() i=7 2024-09-12T00:57:41.613 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.618+0000 7f13bde039c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:41.617 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.622+0000 7f1271fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:41.617 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.622+0000 7f13bde039c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:41.617 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.622+0000 7f13bde039c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:41.617 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.622+0000 7f13bde039c0 5 note: GC not initialized 2024-09-12T00:57:41.618 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.622+0000 7f1270fe1640 20 reqs_thread_entry: start 2024-09-12T00:57:41.618 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.622+0000 7f13bde039c0 20 init_complete bucket index max shards: 1 2024-09-12T00:57:41.618 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.622+0000 7f13bde039c0 20 Filter name: none 2024-09-12T00:57:41.619 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.622+0000 7f11ea7fc640 20 reqs_thread_entry: start 2024-09-12T00:57:41.619 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.622+0000 7f13bde039c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T00:57:41.619 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.622+0000 7f13bde039c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.619 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.626+0000 7f13bde039c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:57:41.619 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.626+0000 7f13bde039c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T00:57:41.619 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.626+0000 7f13bde039c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T00:57:41.620 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.626+0000 7f13bde039c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 : miss 2024-09-12T00:57:41.620 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.626+0000 7f13bde039c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.620 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.626+0000 7f13bde039c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:57:41.620 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.626+0000 7f13bde039c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 info.flags=0x17 2024-09-12T00:57:41.620 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.626+0000 7f13bde039c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 to cache LRU end 2024-09-12T00:57:41.620 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.626+0000 7f13bde039c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:57:41.620 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.626+0000 7f13bde039c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:41.621 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.626+0000 7f13bde039c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 2024-09-12T00:57:41.629 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.634+0000 7f13bde039c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 info.flags=0x17 2024-09-12T00:57:41.629 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.634+0000 7f13bde039c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 to cache LRU end 2024-09-12T00:57:41.629 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.634+0000 7f13bde039c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:41.629 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.634+0000 7f13bde039c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36, ofs0, ns] 2024-09-12T00:57:41.629 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.634+0000 7f129affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431627 cookie 94530534768208 notifier 7707 bl.length()=1007 2024-09-12T00:57:41.629 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.634+0000 7f129affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 info.flags=0x17 2024-09-12T00:57:41.629 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.634+0000 7f129affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 to cache LRU end 2024-09-12T00:57:41.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.634+0000 7f129affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:41.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.634+0000 7f13bde039c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36]): orig_sources= new_sources= 2024-09-12T00:57:41.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.634+0000 7f13bde039c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36]): potential sources added=[] removed=[] 2024-09-12T00:57:41.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.634+0000 7f13bde039c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36]): orig_dests= new_dests= 2024-09-12T00:57:41.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.634+0000 7f13bde039c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36]): potential dests added=[] removed=[] 2024-09-12T00:57:41.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.638+0000 7f13bde039c0 -1 Injecting error=-5 at location=logrecord_writes 2024-09-12T00:57:41.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.638+0000 7f13bde039c0 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-12T00:57:41.640 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.646+0000 7f13bde039c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:57:41.640 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.646+0000 7f13bde039c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 2024-09-12T00:57:41.643 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.650+0000 7f13bde039c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 info.flags=0x17 2024-09-12T00:57:41.643 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.650+0000 7f13bde039c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 to cache LRU end 2024-09-12T00:57:41.643 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.650+0000 7f13bde039c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:41.643 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.650+0000 7f13bde039c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36, ofs0, ns] 2024-09-12T00:57:41.644 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.650+0000 7f129affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431628 cookie 94530534768208 notifier 7707 bl.length()=975 2024-09-12T00:57:41.644 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.650+0000 7f129affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 info.flags=0x17 2024-09-12T00:57:41.644 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.650+0000 7f129affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 to cache LRU end 2024-09-12T00:57:41.644 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.650+0000 7f129affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:41.645 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.650+0000 7f13bde039c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36]): orig_sources= new_sources= 2024-09-12T00:57:41.645 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.650+0000 7f13bde039c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36]): potential sources added=[] removed=[] 2024-09-12T00:57:41.645 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.650+0000 7f13bde039c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36]): orig_dests= new_dests= 2024-09-12T00:57:41.645 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.650+0000 7f13bde039c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36]): potential dests added=[] removed=[] 2024-09-12T00:57:41.648 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.654+0000 7f1271fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:41.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.658+0000 7f13bde039c0 20 remove_watcher() i=0 2024-09-12T00:57:41.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.658+0000 7f13bde039c0 2 removed watcher, disabling cache 2024-09-12T00:57:41.654 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.658+0000 7f13bde039c0 20 remove_watcher() i=1 2024-09-12T00:57:41.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.662+0000 7f13bde039c0 20 remove_watcher() i=2 2024-09-12T00:57:41.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.662+0000 7f13bde039c0 20 remove_watcher() i=3 2024-09-12T00:57:41.661 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.666+0000 7f13bde039c0 20 remove_watcher() i=4 2024-09-12T00:57:41.662 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.666+0000 7f13bde039c0 20 remove_watcher() i=5 2024-09-12T00:57:41.663 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.670+0000 7f13bde039c0 20 remove_watcher() i=6 2024-09-12T00:57:41.665 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.670+0000 7f13bde039c0 20 remove_watcher() i=7 2024-09-12T00:57:41.679 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:57:41.710 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:41.710 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:41.751 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.758+0000 7f82841c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.758+0000 7f82841c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:41.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.758+0000 7f82841c99c0 20 realm 2024-09-12T00:57:41.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.758+0000 7f82841c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.758+0000 7f82841c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:41.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.758+0000 7f82841c99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:41.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.758+0000 7f82841c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.758+0000 7f82841c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:41.754 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.758+0000 7f82841c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.755 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.762+0000 7f82841c99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:41.755 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.762+0000 7f82841c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.756 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.762+0000 7f82841c99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:41.756 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.762+0000 7f82841c99c0 20 searching for the correct realm 2024-09-12T00:57:41.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.766+0000 7f8281ccf640 0 -- 172.21.15.70:0/1254249959 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f827c0c5400 msgr2=0x7f827c0c5880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:41.769 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.774+0000 7f8281ccf640 0 -- 172.21.15.70:0/1254249959 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f814c0808b0 msgr2=0x7f814c082d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:41.775 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.778+0000 7f82841c99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:41.775 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.778+0000 7f82841c99c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:57:41.775 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.778+0000 7f82841c99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:41.775 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.778+0000 7f82841c99c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:57:41.775 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.778+0000 7f82841c99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:41.775 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.778+0000 7f82841c99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:41.775 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.778+0000 7f82841c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.776 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.778+0000 7f82841c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:41.776 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.778+0000 7f82841c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.777 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.782+0000 7f82841c99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:41.777 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.782+0000 7f82841c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.777 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.782+0000 7f82841c99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:41.777 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.782+0000 7f82841c99c0 20 zone default found 2024-09-12T00:57:41.777 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.782+0000 7f82841c99c0 4 Realm: () 2024-09-12T00:57:41.777 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.782+0000 7f82841c99c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:57:41.777 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.782+0000 7f82841c99c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:57:41.777 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.782+0000 7f82841c99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:41.778 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.782+0000 7f82841c99c0 20 zonegroup default 2024-09-12T00:57:41.778 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.782+0000 7f82841c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.778 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.782+0000 7f82841c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:41.778 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.782+0000 7f82841c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.778 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.782+0000 7f82841c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:41.778 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.782+0000 7f82841c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.778 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.782+0000 7f82841c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:41.778 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.782+0000 7f82841c99c0 20 started sync module instance, tier type = 2024-09-12T00:57:41.778 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.782+0000 7f82841c99c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:57:41.792 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.798+0000 7f82841c99c0 20 add_watcher() i=0 2024-09-12T00:57:41.792 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.798+0000 7f82841c99c0 20 add_watcher() i=1 2024-09-12T00:57:41.792 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.798+0000 7f82841c99c0 20 add_watcher() i=2 2024-09-12T00:57:41.792 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.798+0000 7f82841c99c0 20 add_watcher() i=3 2024-09-12T00:57:41.793 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.798+0000 7f82841c99c0 20 add_watcher() i=4 2024-09-12T00:57:41.793 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.798+0000 7f82841c99c0 20 add_watcher() i=5 2024-09-12T00:57:41.793 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.798+0000 7f82841c99c0 20 add_watcher() i=6 2024-09-12T00:57:41.793 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.798+0000 7f82841c99c0 20 add_watcher() i=7 2024-09-12T00:57:41.793 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.798+0000 7f82841c99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:41.796 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.802+0000 7f81337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:41.797 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.802+0000 7f82841c99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:41.797 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.802+0000 7f82841c99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:41.797 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.802+0000 7f82841c99c0 5 note: GC not initialized 2024-09-12T00:57:41.797 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.802+0000 7f81327fc640 20 reqs_thread_entry: start 2024-09-12T00:57:41.797 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.802+0000 7f82841c99c0 20 init_complete bucket index max shards: 1 2024-09-12T00:57:41.798 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.802+0000 7f82841c99c0 20 Filter name: none 2024-09-12T00:57:41.798 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.802+0000 7f80a3fff640 20 reqs_thread_entry: start 2024-09-12T00:57:41.798 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.802+0000 7f82841c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.798 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.802+0000 7f82841c99c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:57:41.798 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.802+0000 7f82841c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.799 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.802+0000 7f82841c99c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:57:41.799 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.802+0000 7f82841c99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:41.799 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.802+0000 7f82841c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.800 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.806+0000 7f82841c99c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:57:41.800 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.806+0000 7f82841c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.800 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.806+0000 7f82841c99c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:57:41.801 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.806+0000 7f82841c99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:41.802 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.806+0000 7f81337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:41.807 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.814+0000 7f82841c99c0 20 remove_watcher() i=0 2024-09-12T00:57:41.807 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.814+0000 7f82841c99c0 2 removed watcher, disabling cache 2024-09-12T00:57:41.809 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.814+0000 7f82841c99c0 20 remove_watcher() i=1 2024-09-12T00:57:41.812 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.818+0000 7f82841c99c0 20 remove_watcher() i=2 2024-09-12T00:57:41.814 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.818+0000 7f82841c99c0 20 remove_watcher() i=3 2024-09-12T00:57:41.816 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.822+0000 7f82841c99c0 20 remove_watcher() i=4 2024-09-12T00:57:41.817 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.822+0000 7f82841c99c0 20 remove_watcher() i=5 2024-09-12T00:57:41.818 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.822+0000 7f82841c99c0 20 remove_watcher() i=6 2024-09-12T00:57:41.819 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.826+0000 7f82841c99c0 20 remove_watcher() i=7 2024-09-12T00:57:41.833 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:41.833 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:57:41.833 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-logrecord-writes id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:57:41.833 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:41.834 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:41.834 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:41.846 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:41.846 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:41.888 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:57:41.920 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:41.920 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:41.962 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.966+0000 7f9b529c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.970+0000 7f9b529c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:41.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.970+0000 7f9b529c99c0 20 realm 2024-09-12T00:57:41.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.970+0000 7f9b529c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.970+0000 7f9b529c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:41.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.970+0000 7f9b529c99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:41.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.970+0000 7f9b529c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.970+0000 7f9b529c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:41.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.970+0000 7f9b529c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.970+0000 7f9b529c99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:41.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.970+0000 7f9b529c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.974+0000 7f9b529c99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:41.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.974+0000 7f9b529c99c0 20 searching for the correct realm 2024-09-12T00:57:41.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.978+0000 7f9b50cd0640 0 -- 172.21.15.70:0/3823115612 >> [v2:172.21.15.70:6816/1979013808,v1:172.21.15.70:6817/1979013808] conn(0x55a644c19e50 msgr2=0x55a644c1c2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:41.980 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.986+0000 7f9b4fcce640 0 -- 172.21.15.70:0/3823115612 >> [v2:172.21.15.70:6824/2477739226,v1:172.21.15.70:6825/2477739226] conn(0x55a644c21940 msgr2=0x55a644c23d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:57:41.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.990+0000 7f9b529c99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:41.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.990+0000 7f9b529c99c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:57:41.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.990+0000 7f9b529c99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:41.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.990+0000 7f9b529c99c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:57:41.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.990+0000 7f9b529c99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:41.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.990+0000 7f9b529c99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:41.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.994+0000 7f9b529c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.994+0000 7f9b529c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:41.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.994+0000 7f9b529c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.994+0000 7f9b529c99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:41.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.994+0000 7f9b529c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.994+0000 7f9b529c99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:41.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.994+0000 7f9b529c99c0 20 zone default found 2024-09-12T00:57:41.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.994+0000 7f9b529c99c0 4 Realm: () 2024-09-12T00:57:41.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.994+0000 7f9b529c99c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:57:41.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.994+0000 7f9b529c99c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:57:41.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.994+0000 7f9b529c99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:41.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.994+0000 7f9b529c99c0 20 zonegroup default 2024-09-12T00:57:41.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.994+0000 7f9b529c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.994+0000 7f9b529c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:41.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.994+0000 7f9b529c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.994+0000 7f9b529c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:41.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.994+0000 7f9b529c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:41.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.994+0000 7f9b529c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:41.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.994+0000 7f9b529c99c0 20 started sync module instance, tier type = 2024-09-12T00:57:41.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:41.994+0000 7f9b529c99c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:57:42.005 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.010+0000 7f9b529c99c0 20 add_watcher() i=0 2024-09-12T00:57:42.005 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.010+0000 7f9b529c99c0 20 add_watcher() i=1 2024-09-12T00:57:42.005 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.010+0000 7f9b529c99c0 20 add_watcher() i=2 2024-09-12T00:57:42.005 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.010+0000 7f9b529c99c0 20 add_watcher() i=3 2024-09-12T00:57:42.005 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.010+0000 7f9b529c99c0 20 add_watcher() i=4 2024-09-12T00:57:42.005 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.010+0000 7f9b529c99c0 20 add_watcher() i=5 2024-09-12T00:57:42.005 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.010+0000 7f9b529c99c0 20 add_watcher() i=6 2024-09-12T00:57:42.006 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.010+0000 7f9b529c99c0 20 add_watcher() i=7 2024-09-12T00:57:42.006 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.010+0000 7f9b529c99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:42.008 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.014+0000 7f9a06fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:42.010 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.014+0000 7f9b529c99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:42.010 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.014+0000 7f9b529c99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:42.010 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.014+0000 7f9b529c99c0 5 note: GC not initialized 2024-09-12T00:57:42.010 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.014+0000 7f9a05fdb640 20 reqs_thread_entry: start 2024-09-12T00:57:42.010 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.014+0000 7f9b529c99c0 20 init_complete bucket index max shards: 1 2024-09-12T00:57:42.010 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.014+0000 7f9b529c99c0 20 Filter name: none 2024-09-12T00:57:42.010 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.014+0000 7f99777fe640 20 reqs_thread_entry: start 2024-09-12T00:57:42.010 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.014+0000 7f9b529c99c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T00:57:42.010 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.014+0000 7f9b529c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:42.011 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.014+0000 7f9b529c99c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:57:42.011 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.014+0000 7f9b529c99c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T00:57:42.011 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.014+0000 7f9b529c99c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T00:57:42.011 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.014+0000 7f9b529c99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 : miss 2024-09-12T00:57:42.011 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.014+0000 7f9b529c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:42.012 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.018+0000 7f9b529c99c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:57:42.012 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.018+0000 7f9b529c99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 info.flags=0x17 2024-09-12T00:57:42.012 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.018+0000 7f9b529c99c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 to cache LRU end 2024-09-12T00:57:42.012 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.018+0000 7f9b529c99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:57:42.012 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.018+0000 7f9b529c99c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:42.012 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.018+0000 7f9b529c99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 2024-09-12T00:57:42.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.026+0000 7f9b529c99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 info.flags=0x17 2024-09-12T00:57:42.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.026+0000 7f9b529c99c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 to cache LRU end 2024-09-12T00:57:42.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.026+0000 7f9b529c99c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:42.019 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.026+0000 7f9b529c99c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36, ofs0, ns] 2024-09-12T00:57:42.020 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.026+0000 7f9a277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431629 cookie 94172606508992 notifier 7265 bl.length()=1007 2024-09-12T00:57:42.020 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.026+0000 7f9a277fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 info.flags=0x17 2024-09-12T00:57:42.020 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.026+0000 7f9a277fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 to cache LRU end 2024-09-12T00:57:42.020 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.026+0000 7f9a277fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:42.021 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.026+0000 7f9b529c99c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36]): orig_sources= new_sources= 2024-09-12T00:57:42.021 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.026+0000 7f9b529c99c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36]): potential sources added=[] removed=[] 2024-09-12T00:57:42.021 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.026+0000 7f9b529c99c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36]): orig_dests= new_dests= 2024-09-12T00:57:42.021 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.026+0000 7f9b529c99c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36]): potential dests added=[] removed=[] 2024-09-12T00:57:42.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.034+0000 7f9b529c99c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36.1.0 2024-09-12T00:57:42.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.034+0000 7f9b529c99c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36.1.0 2024-09-12T00:57:42.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.034+0000 7f9b529c99c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36.1.1 2024-09-12T00:57:42.028 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.034+0000 7f9b529c99c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36.1.1 2024-09-12T00:57:42.028 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.034+0000 7f9b529c99c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36.0 2024-09-12T00:57:42.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.038+0000 7f9b529c99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:57:42.033 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.038+0000 7f9b529c99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 2024-09-12T00:57:42.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.042+0000 7f9b529c99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 info.flags=0x17 2024-09-12T00:57:42.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.042+0000 7f9b529c99c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 to cache LRU end 2024-09-12T00:57:42.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.042+0000 7f9b529c99c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:42.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.042+0000 7f9b529c99c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36, ofs0, ns] 2024-09-12T00:57:42.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.042+0000 7f9a26ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431630 cookie 94172606508992 notifier 7265 bl.length()=1007 2024-09-12T00:57:42.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.042+0000 7f9a26ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 info.flags=0x17 2024-09-12T00:57:42.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.042+0000 7f9a26ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 to cache LRU end 2024-09-12T00:57:42.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.042+0000 7f9a26ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:42.037 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.042+0000 7f9b529c99c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36]): orig_sources= new_sources= 2024-09-12T00:57:42.037 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.042+0000 7f9b529c99c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36]): potential sources added=[] removed=[] 2024-09-12T00:57:42.037 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.042+0000 7f9b529c99c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36]): orig_dests= new_dests= 2024-09-12T00:57:42.037 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.042+0000 7f9b529c99c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36]): potential dests added=[] removed=[] 2024-09-12T00:57:42.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.046+0000 7f9b529c99c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36.0 2024-09-12T00:57:42.041 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.046+0000 7f9b529c99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:57:42.041 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.046+0000 7f9b529c99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 2024-09-12T00:57:42.043 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.050+0000 7f9b529c99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 info.flags=0x17 2024-09-12T00:57:42.043 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.050+0000 7f9b529c99c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 to cache LRU end 2024-09-12T00:57:42.044 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.050+0000 7f9b529c99c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:42.044 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.050+0000 7f9b529c99c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36, ofs0, ns] 2024-09-12T00:57:42.044 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.050+0000 7f9a26ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431631 cookie 94172606508992 notifier 7265 bl.length()=975 2024-09-12T00:57:42.044 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.050+0000 7f9a26ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 info.flags=0x17 2024-09-12T00:57:42.044 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.050+0000 7f9a26ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 to cache LRU end 2024-09-12T00:57:42.044 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.050+0000 7f9a26ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:42.045 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.050+0000 7f9b529c99c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36]): orig_sources= new_sources= 2024-09-12T00:57:42.045 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.050+0000 7f9b529c99c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36]): potential sources added=[] removed=[] 2024-09-12T00:57:42.045 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.050+0000 7f9b529c99c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36]): orig_dests= new_dests= 2024-09-12T00:57:42.045 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.050+0000 7f9b529c99c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36]): potential dests added=[] removed=[] 2024-09-12T00:57:42.047 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.054+0000 7f9b529c99c0 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:57:42.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.058+0000 7f9a06fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:42.056 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.062+0000 7f9b529c99c0 20 remove_watcher() i=0 2024-09-12T00:57:42.056 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.062+0000 7f9b529c99c0 2 removed watcher, disabling cache 2024-09-12T00:57:42.058 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.062+0000 7f9b529c99c0 20 remove_watcher() i=1 2024-09-12T00:57:42.061 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.066+0000 7f9b529c99c0 20 remove_watcher() i=2 2024-09-12T00:57:42.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.070+0000 7f9b529c99c0 20 remove_watcher() i=3 2024-09-12T00:57:42.065 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.070+0000 7f9b529c99c0 20 remove_watcher() i=4 2024-09-12T00:57:42.066 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.070+0000 7f9b529c99c0 20 remove_watcher() i=5 2024-09-12T00:57:42.068 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.074+0000 7f9b529c99c0 20 remove_watcher() i=6 2024-09-12T00:57:42.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.074+0000 7f9b529c99c0 20 remove_watcher() i=7 2024-09-12T00:57:42.084 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:57:42.111 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:42.111 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:42.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.158+0000 7f0497efe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:42.154 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.158+0000 7f0497efe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:42.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.158+0000 7f0497efe9c0 20 realm 2024-09-12T00:57:42.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.158+0000 7f0497efe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:42.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.158+0000 7f0497efe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:42.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.158+0000 7f0497efe9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:42.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.158+0000 7f0497efe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:42.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.158+0000 7f0497efe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:42.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.158+0000 7f0497efe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:42.156 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.162+0000 7f0497efe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:42.156 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.162+0000 7f0497efe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:42.157 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.162+0000 7f0497efe9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:42.157 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.162+0000 7f0497efe9c0 20 searching for the correct realm 2024-09-12T00:57:42.162 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.166+0000 7f0495a04640 0 -- 172.21.15.70:0/1138745680 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f04900b4930 msgr2=0x7f04900b13f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:57:42.172 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.178+0000 7f0495a04640 0 -- 172.21.15.70:0/1138745680 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f04900c43c0 msgr2=0x7f04900c4820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:42.178 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.182+0000 7f0497efe9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:42.178 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.182+0000 7f0497efe9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:57:42.178 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.182+0000 7f0497efe9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:42.178 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.182+0000 7f0497efe9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:57:42.178 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.182+0000 7f0497efe9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:42.178 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.182+0000 7f0497efe9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:42.178 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.182+0000 7f0497efe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:42.178 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.182+0000 7f0497efe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:42.178 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.182+0000 7f0497efe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:42.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.182+0000 7f0497efe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:42.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.182+0000 7f0497efe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:42.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.186+0000 7f0497efe9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:42.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.186+0000 7f0497efe9c0 20 zone default found 2024-09-12T00:57:42.180 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.186+0000 7f0497efe9c0 4 Realm: () 2024-09-12T00:57:42.180 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.186+0000 7f0497efe9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:57:42.180 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.186+0000 7f0497efe9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:57:42.180 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.186+0000 7f0497efe9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:42.180 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.186+0000 7f0497efe9c0 20 zonegroup default 2024-09-12T00:57:42.180 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.186+0000 7f0497efe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:42.180 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.186+0000 7f0497efe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:42.180 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.186+0000 7f0497efe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:42.181 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.186+0000 7f0497efe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:42.181 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.186+0000 7f0497efe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:42.181 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.186+0000 7f0497efe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:42.181 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.186+0000 7f0497efe9c0 20 started sync module instance, tier type = 2024-09-12T00:57:42.181 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.186+0000 7f0497efe9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:57:42.195 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.202+0000 7f0497efe9c0 20 add_watcher() i=0 2024-09-12T00:57:42.195 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.202+0000 7f0497efe9c0 20 add_watcher() i=1 2024-09-12T00:57:42.195 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.202+0000 7f0497efe9c0 20 add_watcher() i=2 2024-09-12T00:57:42.195 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.202+0000 7f0497efe9c0 20 add_watcher() i=3 2024-09-12T00:57:42.195 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.202+0000 7f0497efe9c0 20 add_watcher() i=4 2024-09-12T00:57:42.195 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.202+0000 7f0497efe9c0 20 add_watcher() i=5 2024-09-12T00:57:42.195 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.202+0000 7f0497efe9c0 20 add_watcher() i=6 2024-09-12T00:57:42.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.202+0000 7f0497efe9c0 20 add_watcher() i=7 2024-09-12T00:57:42.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.202+0000 7f0497efe9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:42.199 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.202+0000 7f03477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:42.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.206+0000 7f0497efe9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:42.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.206+0000 7f0497efe9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:42.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.206+0000 7f0497efe9c0 5 note: GC not initialized 2024-09-12T00:57:42.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.206+0000 7f03467fc640 20 reqs_thread_entry: start 2024-09-12T00:57:42.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.206+0000 7f0497efe9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:57:42.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.206+0000 7f0497efe9c0 20 Filter name: none 2024-09-12T00:57:42.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.206+0000 7f02b7fff640 20 reqs_thread_entry: start 2024-09-12T00:57:42.200 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.206+0000 7f0497efe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:42.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.206+0000 7f0497efe9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:57:42.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.206+0000 7f0497efe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:42.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.206+0000 7f0497efe9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:57:42.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.206+0000 7f0497efe9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:42.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.206+0000 7f0497efe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:42.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.206+0000 7f0497efe9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:57:42.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.206+0000 7f0497efe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:42.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.206+0000 7f0497efe9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:57:42.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.206+0000 7f0497efe9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:42.205 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.210+0000 7f03477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:42.209 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.214+0000 7f0497efe9c0 20 remove_watcher() i=0 2024-09-12T00:57:42.209 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.214+0000 7f0497efe9c0 2 removed watcher, disabling cache 2024-09-12T00:57:42.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.218+0000 7f0497efe9c0 20 remove_watcher() i=1 2024-09-12T00:57:42.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.218+0000 7f0497efe9c0 20 remove_watcher() i=2 2024-09-12T00:57:42.215 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.222+0000 7f0497efe9c0 20 remove_watcher() i=3 2024-09-12T00:57:42.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.222+0000 7f0497efe9c0 20 remove_watcher() i=4 2024-09-12T00:57:42.218 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.222+0000 7f0497efe9c0 20 remove_watcher() i=5 2024-09-12T00:57:42.219 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.226+0000 7f0497efe9c0 20 remove_watcher() i=6 2024-09-12T00:57:42.220 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.226+0000 7f0497efe9c0 20 remove_watcher() i=7 2024-09-12T00:57:42.234 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:42.234 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:57:42.234 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-logrecord-writes id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:57:42.234 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:42.235 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:42.235 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:42.238 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:42.238 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:42.292 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:42.292 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:42.320 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-12T00:57:42.320 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:42.323 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:42.323 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:42.345 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:42.345 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:42.391 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:42.391 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:42.411 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:42.411 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:42.429 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:42.430 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:42.454 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:42.454 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:42.474 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:42.474 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:42.494 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:42.494 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:42.513 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:42.513 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:42.532 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:42.532 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:42.552 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:42.552 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:42.570 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:42.571 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:42.590 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:42.590 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:42.609 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:42.610 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:42.628 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:42.628 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:42.647 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:42.647 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:42.667 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:42.668 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:42.687 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:42.687 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:42.705 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:42.705 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:42.724 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:42.724 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:42.744 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:42.744 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:42.764 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:42.764 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:42.781 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:57:42.813 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:42.813 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:42.856 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.862+0000 7f040f2499c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:42.858 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.862+0000 7f040f2499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:42.859 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.862+0000 7f040f2499c0 20 realm 2024-09-12T00:57:42.859 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.862+0000 7f040f2499c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:42.859 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.862+0000 7f040f2499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:42.859 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.862+0000 7f040f2499c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:42.859 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.862+0000 7f040f2499c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:42.859 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.862+0000 7f040f2499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:42.859 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.862+0000 7f040f2499c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:42.860 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.866+0000 7f040f2499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:42.861 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.866+0000 7f040f2499c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:42.861 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.866+0000 7f040f2499c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:42.861 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.866+0000 7f040f2499c0 20 searching for the correct realm 2024-09-12T00:57:42.864 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:42.870+0000 7f040c54e640 0 -- 172.21.15.70:0/2413804345 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7f03fc04e040 msgr2=0x7f03fc04e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:43.079 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.086+0000 7f040cd4f640 0 -- 172.21.15.70:0/2413804345 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f0404015030 msgr2=0x7f040405e750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:43.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.098+0000 7f040f2499c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:43.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.098+0000 7f040f2499c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:57:43.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.098+0000 7f040f2499c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:43.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.098+0000 7f040f2499c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:57:43.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.098+0000 7f040f2499c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:43.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.098+0000 7f040f2499c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:43.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.102+0000 7f040f2499c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.096 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.102+0000 7f040f2499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.096 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.102+0000 7f040f2499c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.102+0000 7f040f2499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:43.097 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.102+0000 7f040f2499c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.102+0000 7f040f2499c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:43.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.102+0000 7f040f2499c0 20 zone default found 2024-09-12T00:57:43.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.102+0000 7f040f2499c0 4 Realm: () 2024-09-12T00:57:43.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.102+0000 7f040f2499c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:57:43.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.102+0000 7f040f2499c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:57:43.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.102+0000 7f040f2499c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:43.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.102+0000 7f040f2499c0 20 zonegroup default 2024-09-12T00:57:43.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.102+0000 7f040f2499c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.099 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.102+0000 7f040f2499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.099 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.102+0000 7f040f2499c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.099 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.106+0000 7f040f2499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.099 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.106+0000 7f040f2499c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.100 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.106+0000 7f040f2499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.100 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.106+0000 7f040f2499c0 20 started sync module instance, tier type = 2024-09-12T00:57:43.100 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.106+0000 7f040f2499c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:57:43.123 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.126+0000 7f040f2499c0 20 add_watcher() i=0 2024-09-12T00:57:43.123 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.126+0000 7f040f2499c0 20 add_watcher() i=1 2024-09-12T00:57:43.123 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.126+0000 7f040f2499c0 20 add_watcher() i=2 2024-09-12T00:57:43.123 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.126+0000 7f040f2499c0 20 add_watcher() i=3 2024-09-12T00:57:43.123 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.126+0000 7f040f2499c0 20 add_watcher() i=4 2024-09-12T00:57:43.123 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.126+0000 7f040f2499c0 20 add_watcher() i=5 2024-09-12T00:57:43.123 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.126+0000 7f040f2499c0 20 add_watcher() i=6 2024-09-12T00:57:43.125 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.130+0000 7f040f2499c0 20 add_watcher() i=7 2024-09-12T00:57:43.125 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.130+0000 7f040f2499c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:43.129 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.134+0000 7f02c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:43.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.134+0000 7f040f2499c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:43.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.134+0000 7f040f2499c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:43.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.134+0000 7f040f2499c0 5 note: GC not initialized 2024-09-12T00:57:43.131 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.134+0000 7f02c1fe3640 20 reqs_thread_entry: start 2024-09-12T00:57:43.131 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.134+0000 7f040f2499c0 20 init_complete bucket index max shards: 1 2024-09-12T00:57:43.131 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.134+0000 7f040f2499c0 20 Filter name: none 2024-09-12T00:57:43.131 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.134+0000 7f02337fe640 20 reqs_thread_entry: start 2024-09-12T00:57:43.131 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.134+0000 7f040f2499c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.138+0000 7f040f2499c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:57:43.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.138+0000 7f040f2499c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.138+0000 7f040f2499c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:57:43.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.138+0000 7f040f2499c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:43.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.138+0000 7f040f2499c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.134 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.138+0000 7f040f2499c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:57:43.134 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.138+0000 7f040f2499c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.135 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.142+0000 7f040f2499c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:57:43.135 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.142+0000 7f040f2499c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:43.137 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.142+0000 7f02c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:43.142 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.146+0000 7f040f2499c0 20 remove_watcher() i=0 2024-09-12T00:57:43.143 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.146+0000 7f040f2499c0 2 removed watcher, disabling cache 2024-09-12T00:57:43.145 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.150+0000 7f040f2499c0 20 remove_watcher() i=1 2024-09-12T00:57:43.148 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.154+0000 7f040f2499c0 20 remove_watcher() i=2 2024-09-12T00:57:43.150 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.154+0000 7f040f2499c0 20 remove_watcher() i=3 2024-09-12T00:57:43.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.158+0000 7f040f2499c0 20 remove_watcher() i=4 2024-09-12T00:57:43.154 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.158+0000 7f040f2499c0 20 remove_watcher() i=5 2024-09-12T00:57:43.156 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.162+0000 7f040f2499c0 20 remove_watcher() i=6 2024-09-12T00:57:43.157 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.162+0000 7f040f2499c0 20 remove_watcher() i=7 2024-09-12T00:57:43.173 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.173 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:57:43.173 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: abort-at-logrecord-writes id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:57:43.173 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.173 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T00:57:43.208 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:43.208 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:43.251 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 realm 2024-09-12T00:57:43.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.258+0000 7f749e9b19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:43.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:43.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.262+0000 7f749e9b19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:43.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.262+0000 7f749e9b19c0 20 searching for the correct realm 2024-09-12T00:57:43.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.266+0000 7f749ccb8640 0 -- 172.21.15.70:0/197211755 >> [v2:172.21.15.70:6808/276433067,v1:172.21.15.70:6809/276433067] conn(0x5555cc316ce0 msgr2=0x5555cc3191a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:57:43.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.274+0000 7f749c4b7640 0 -- 172.21.15.70:0/197211755 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f74940c6410 msgr2=0x7f74940c6890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:43.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:43.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:57:43.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:43.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:57:43.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:43.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:43.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.277 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:43.277 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:43.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 zone default found 2024-09-12T00:57:43.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.282+0000 7f749e9b19c0 4 Realm: () 2024-09-12T00:57:43.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.282+0000 7f749e9b19c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:57:43.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.282+0000 7f749e9b19c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:57:43.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.282+0000 7f749e9b19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:43.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 zonegroup default 2024-09-12T00:57:43.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.279 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 started sync module instance, tier type = 2024-09-12T00:57:43.279 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:57:43.293 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.298+0000 7f749e9b19c0 20 add_watcher() i=0 2024-09-12T00:57:43.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.298+0000 7f749e9b19c0 20 add_watcher() i=1 2024-09-12T00:57:43.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.298+0000 7f749e9b19c0 20 add_watcher() i=2 2024-09-12T00:57:43.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.298+0000 7f749e9b19c0 20 add_watcher() i=3 2024-09-12T00:57:43.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.298+0000 7f749e9b19c0 20 add_watcher() i=4 2024-09-12T00:57:43.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.298+0000 7f749e9b19c0 20 add_watcher() i=5 2024-09-12T00:57:43.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.298+0000 7f749e9b19c0 20 add_watcher() i=6 2024-09-12T00:57:43.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.298+0000 7f749e9b19c0 20 add_watcher() i=7 2024-09-12T00:57:43.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.298+0000 7f749e9b19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:43.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.302+0000 7f7352fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:43.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.302+0000 7f749e9b19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:43.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.302+0000 7f749e9b19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:43.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 note: GC not initialized 2024-09-12T00:57:43.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.302+0000 7f7351fdb640 20 reqs_thread_entry: start 2024-09-12T00:57:43.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.302+0000 7f749e9b19c0 20 init_complete bucket index max shards: 1 2024-09-12T00:57:43.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.302+0000 7f749e9b19c0 20 Filter name: none 2024-09-12T00:57:43.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.302+0000 7f72c37fe640 20 reqs_thread_entry: start 2024-09-12T00:57:43.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.302+0000 7f749e9b19c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:57:43.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.302+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.306+0000 7f749e9b19c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:57:43.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.306+0000 7f749e9b19c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:57:43.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.306+0000 7f749e9b19c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:57:43.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.306+0000 7f749e9b19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 : miss 2024-09-12T00:57:43.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.306+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.300 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.306+0000 7f749e9b19c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:57:43.300 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.306+0000 7f749e9b19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 info.flags=0x17 2024-09-12T00:57:43.300 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.306+0000 7f749e9b19c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 to cache LRU end 2024-09-12T00:57:43.300 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.306+0000 7f749e9b19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:57:43.300 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.306+0000 7f749e9b19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:43.300 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.306+0000 7f749e9b19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 2024-09-12T00:57:43.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.314+0000 7f749e9b19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 info.flags=0x17 2024-09-12T00:57:43.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.314+0000 7f749e9b19c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 to cache LRU end 2024-09-12T00:57:43.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.314+0000 7f749e9b19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:43.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.314+0000 7f749e9b19c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37, ofs0, ns] 2024-09-12T00:57:43.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.314+0000 7f73737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431564 cookie 93826986402448 notifier 7316 bl.length()=1007 2024-09-12T00:57:43.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.314+0000 7f73737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 info.flags=0x17 2024-09-12T00:57:43.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.314+0000 7f73737fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 to cache LRU end 2024-09-12T00:57:43.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.314+0000 7f73737fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:43.311 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.314+0000 7f749e9b19c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37]): orig_sources= new_sources= 2024-09-12T00:57:43.311 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.314+0000 7f749e9b19c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37]): potential sources added=[] removed=[] 2024-09-12T00:57:43.311 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.314+0000 7f749e9b19c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37]): orig_dests= new_dests= 2024-09-12T00:57:43.311 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.314+0000 7f749e9b19c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37]): potential dests added=[] removed=[] 2024-09-12T00:57:43.312 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f749e9b19c0 time 2024-09-12T00:57:43.322310+0000 2024-09-12T00:57:43.312 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:57:43.313 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:57:43.313 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f74a228b2eb] 2024-09-12T00:57:43.313 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f74a228b49f] 2024-09-12T00:57:43.313 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5555caf11cc1] 2024-09-12T00:57:43.313 INFO:tasks.workunit.client.0.smithi070.stderr: 4: radosgw-admin(+0x1422aac) [0x5555cb96faac] 2024-09-12T00:57:43.313 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5555caf26ced] 2024-09-12T00:57:43.314 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:57:43.314 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f74a10f1d90] 2024-09-12T00:57:43.314 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:57:43.314 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:57:43.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.318+0000 7f749e9b19c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f749e9b19c0 time 2024-09-12T00:57:43.322310+0000 2024-09-12T00:57:43.314 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:57:43.315 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.315 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:57:43.315 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f74a228b2eb] 2024-09-12T00:57:43.315 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f74a228b49f] 2024-09-12T00:57:43.315 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5555caf11cc1] 2024-09-12T00:57:43.315 INFO:tasks.workunit.client.0.smithi070.stderr: 4: radosgw-admin(+0x1422aac) [0x5555cb96faac] 2024-09-12T00:57:43.315 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5555caf26ced] 2024-09-12T00:57:43.315 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:57:43.315 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f74a10f1d90] 2024-09-12T00:57:43.315 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:57:43.315 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:57:43.316 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.316 INFO:tasks.workunit.client.0.smithi070.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:57:43.316 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f749e9b19c0 thread_name:radosgw-admin 2024-09-12T00:57:43.337 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:57:43.337 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f74a110a520] 2024-09-12T00:57:43.337 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:57:43.337 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:57:43.337 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:57:43.337 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f74a228b345] 2024-09-12T00:57:43.337 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f74a228b49f] 2024-09-12T00:57:43.338 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5555caf11cc1] 2024-09-12T00:57:43.338 INFO:tasks.workunit.client.0.smithi070.stderr: 8: radosgw-admin(+0x1422aac) [0x5555cb96faac] 2024-09-12T00:57:43.338 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5555caf26ced] 2024-09-12T00:57:43.338 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:57:43.338 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f74a10f1d90] 2024-09-12T00:57:43.338 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:57:43.338 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:57:43.338 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.318+0000 7f749e9b19c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:57:43.338 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f749e9b19c0 thread_name:radosgw-admin 2024-09-12T00:57:43.338 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.338 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:57:43.338 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f74a110a520] 2024-09-12T00:57:43.338 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:57:43.339 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:57:43.339 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:57:43.339 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f74a228b345] 2024-09-12T00:57:43.339 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f74a228b49f] 2024-09-12T00:57:43.339 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5555caf11cc1] 2024-09-12T00:57:43.339 INFO:tasks.workunit.client.0.smithi070.stderr: 8: radosgw-admin(+0x1422aac) [0x5555cb96faac] 2024-09-12T00:57:43.339 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5555caf26ced] 2024-09-12T00:57:43.339 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:57:43.339 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f74a10f1d90] 2024-09-12T00:57:43.339 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:57:43.339 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:57:43.339 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:57:43.340 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.340 INFO:tasks.workunit.client.0.smithi070.stderr:--- begin dump of recent events --- 2024-09-12T00:57:43.340 INFO:tasks.workunit.client.0.smithi070.stderr: -499> 2024-09-12T00:57:43.234+0000 7f749c4b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:43.340 INFO:tasks.workunit.client.0.smithi070.stderr: -498> 2024-09-12T00:57:43.234+0000 7f749c4b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:43.340 INFO:tasks.workunit.client.0.smithi070.stderr: -497> 2024-09-12T00:57:43.234+0000 7f749c4b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:43.340 INFO:tasks.workunit.client.0.smithi070.stderr: -496> 2024-09-12T00:57:43.234+0000 7f749bcb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:43.340 INFO:tasks.workunit.client.0.smithi070.stderr: -495> 2024-09-12T00:57:43.234+0000 7f749bcb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:43.340 INFO:tasks.workunit.client.0.smithi070.stderr: -494> 2024-09-12T00:57:43.234+0000 7f749bcb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:43.340 INFO:tasks.workunit.client.0.smithi070.stderr: -493> 2024-09-12T00:57:43.234+0000 7f749c4b7640 10 monclient(hunting): handle_auth_done global_id 7791 payload 274 2024-09-12T00:57:43.340 INFO:tasks.workunit.client.0.smithi070.stderr: -492> 2024-09-12T00:57:43.234+0000 7f749c4b7640 10 monclient: _finish_hunting 0 2024-09-12T00:57:43.340 INFO:tasks.workunit.client.0.smithi070.stderr: -491> 2024-09-12T00:57:43.234+0000 7f749c4b7640 1 monclient: found mon.noname-a 2024-09-12T00:57:43.340 INFO:tasks.workunit.client.0.smithi070.stderr: -490> 2024-09-12T00:57:43.234+0000 7f749c4b7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:57:43.340 INFO:tasks.workunit.client.0.smithi070.stderr: -489> 2024-09-12T00:57:43.234+0000 7f749ccb8640 10 monclient: get_auth_request con 0x5555cc2271c0 auth_method 0 2024-09-12T00:57:43.340 INFO:tasks.workunit.client.0.smithi070.stderr: -488> 2024-09-12T00:57:43.234+0000 7f738a60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:43.341 INFO:tasks.workunit.client.0.smithi070.stderr: -487> 2024-09-12T00:57:43.234+0000 7f738a60c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:57:43.341 INFO:tasks.workunit.client.0.smithi070.stderr: -486> 2024-09-12T00:57:43.234+0000 7f738a60c640 10 monclient: dump: 2024-09-12T00:57:43.341 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:43.341 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:43.341 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.341 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.341 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:43.341 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.341 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:43.341 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:43.341 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:43.341 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.341 INFO:tasks.workunit.client.0.smithi070.stderr: -485> 2024-09-12T00:57:43.234+0000 7f738a60c640 10 monclient: _finish_auth 0 2024-09-12T00:57:43.342 INFO:tasks.workunit.client.0.smithi070.stderr: -484> 2024-09-12T00:57:43.234+0000 7f738a60c640 10 monclient: _check_auth_tickets 2024-09-12T00:57:43.342 INFO:tasks.workunit.client.0.smithi070.stderr: -483> 2024-09-12T00:57:43.234+0000 7f738a60c640 10 monclient: handle_config config(0 keys) 2024-09-12T00:57:43.342 INFO:tasks.workunit.client.0.smithi070.stderr: -482> 2024-09-12T00:57:43.234+0000 7f738a60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:43.342 INFO:tasks.workunit.client.0.smithi070.stderr: -481> 2024-09-12T00:57:43.234+0000 7f738a60c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:57:43.342 INFO:tasks.workunit.client.0.smithi070.stderr: -480> 2024-09-12T00:57:43.234+0000 7f738a60c640 10 monclient: dump: 2024-09-12T00:57:43.342 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:43.342 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:43.342 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.342 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.342 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:43.342 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.343 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:43.343 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:43.343 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:43.343 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.343 INFO:tasks.workunit.client.0.smithi070.stderr: -479> 2024-09-12T00:57:43.234+0000 7f749e9b19c0 5 monclient: authenticate success, global_id 7791 2024-09-12T00:57:43.343 INFO:tasks.workunit.client.0.smithi070.stderr: -478> 2024-09-12T00:57:43.234+0000 7f749e9b19c0 10 monclient: get_monmap_and_config success 2024-09-12T00:57:43.343 INFO:tasks.workunit.client.0.smithi070.stderr: -477> 2024-09-12T00:57:43.234+0000 7f749e9b19c0 4 set_mon_vals no callback set 2024-09-12T00:57:43.343 INFO:tasks.workunit.client.0.smithi070.stderr: -476> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient: shutdown 2024-09-12T00:57:43.343 INFO:tasks.workunit.client.0.smithi070.stderr: -475> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) unregister_commands rotate-key 2024-09-12T00:57:43.343 INFO:tasks.workunit.client.0.smithi070.stderr: -474> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient: build_initial_monmap 2024-09-12T00:57:43.343 INFO:tasks.workunit.client.0.smithi070.stderr: -473> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 1 build_initial for_mkfs: 0 2024-09-12T00:57:43.343 INFO:tasks.workunit.client.0.smithi070.stderr: -472> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient: monmap: 2024-09-12T00:57:43.343 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:57:43.343 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:57:43.344 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:57:43.344 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:57:43.344 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:57:43.344 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.344 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:57:43.344 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:57:43.344 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:57:43.344 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.344 INFO:tasks.workunit.client.0.smithi070.stderr: -471> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding auth protocol: cephx 2024-09-12T00:57:43.344 INFO:tasks.workunit.client.0.smithi070.stderr: -470> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding auth protocol: cephx 2024-09-12T00:57:43.344 INFO:tasks.workunit.client.0.smithi070.stderr: -469> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding auth protocol: cephx 2024-09-12T00:57:43.344 INFO:tasks.workunit.client.0.smithi070.stderr: -468> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding con mode: secure 2024-09-12T00:57:43.344 INFO:tasks.workunit.client.0.smithi070.stderr: -467> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding con mode: crc 2024-09-12T00:57:43.344 INFO:tasks.workunit.client.0.smithi070.stderr: -466> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding con mode: secure 2024-09-12T00:57:43.345 INFO:tasks.workunit.client.0.smithi070.stderr: -465> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding con mode: crc 2024-09-12T00:57:43.345 INFO:tasks.workunit.client.0.smithi070.stderr: -464> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding con mode: secure 2024-09-12T00:57:43.345 INFO:tasks.workunit.client.0.smithi070.stderr: -463> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding con mode: crc 2024-09-12T00:57:43.345 INFO:tasks.workunit.client.0.smithi070.stderr: -462> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding con mode: crc 2024-09-12T00:57:43.345 INFO:tasks.workunit.client.0.smithi070.stderr: -461> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding con mode: secure 2024-09-12T00:57:43.345 INFO:tasks.workunit.client.0.smithi070.stderr: -460> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding con mode: crc 2024-09-12T00:57:43.345 INFO:tasks.workunit.client.0.smithi070.stderr: -459> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding con mode: secure 2024-09-12T00:57:43.345 INFO:tasks.workunit.client.0.smithi070.stderr: -458> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding con mode: crc 2024-09-12T00:57:43.345 INFO:tasks.workunit.client.0.smithi070.stderr: -457> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding con mode: secure 2024-09-12T00:57:43.345 INFO:tasks.workunit.client.0.smithi070.stderr: -456> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:43.345 INFO:tasks.workunit.client.0.smithi070.stderr: -455> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 1 librados: starting msgr at 2024-09-12T00:57:43.345 INFO:tasks.workunit.client.0.smithi070.stderr: -454> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 1 librados: starting objecter 2024-09-12T00:57:43.345 INFO:tasks.workunit.client.0.smithi070.stderr: -453> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command objecter_requests hook 0x5555cc0da430 2024-09-12T00:57:43.346 INFO:tasks.workunit.client.0.smithi070.stderr: -452> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 1 librados: setting wanted keys 2024-09-12T00:57:43.346 INFO:tasks.workunit.client.0.smithi070.stderr: -451> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 1 librados: calling monclient init 2024-09-12T00:57:43.346 INFO:tasks.workunit.client.0.smithi070.stderr: -450> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient: init 2024-09-12T00:57:43.346 INFO:tasks.workunit.client.0.smithi070.stderr: -449> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding auth protocol: cephx 2024-09-12T00:57:43.346 INFO:tasks.workunit.client.0.smithi070.stderr: -448> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding auth protocol: cephx 2024-09-12T00:57:43.346 INFO:tasks.workunit.client.0.smithi070.stderr: -447> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding auth protocol: cephx 2024-09-12T00:57:43.346 INFO:tasks.workunit.client.0.smithi070.stderr: -446> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding con mode: secure 2024-09-12T00:57:43.346 INFO:tasks.workunit.client.0.smithi070.stderr: -445> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding con mode: crc 2024-09-12T00:57:43.346 INFO:tasks.workunit.client.0.smithi070.stderr: -444> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding con mode: secure 2024-09-12T00:57:43.346 INFO:tasks.workunit.client.0.smithi070.stderr: -443> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding con mode: crc 2024-09-12T00:57:43.346 INFO:tasks.workunit.client.0.smithi070.stderr: -442> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding con mode: secure 2024-09-12T00:57:43.346 INFO:tasks.workunit.client.0.smithi070.stderr: -441> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding con mode: crc 2024-09-12T00:57:43.346 INFO:tasks.workunit.client.0.smithi070.stderr: -440> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding con mode: crc 2024-09-12T00:57:43.346 INFO:tasks.workunit.client.0.smithi070.stderr: -439> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding con mode: secure 2024-09-12T00:57:43.347 INFO:tasks.workunit.client.0.smithi070.stderr: -438> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding con mode: crc 2024-09-12T00:57:43.347 INFO:tasks.workunit.client.0.smithi070.stderr: -437> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding con mode: secure 2024-09-12T00:57:43.347 INFO:tasks.workunit.client.0.smithi070.stderr: -436> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding con mode: crc 2024-09-12T00:57:43.347 INFO:tasks.workunit.client.0.smithi070.stderr: -435> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding con mode: secure 2024-09-12T00:57:43.347 INFO:tasks.workunit.client.0.smithi070.stderr: -434> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:43.347 INFO:tasks.workunit.client.0.smithi070.stderr: -433> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:43.347 INFO:tasks.workunit.client.0.smithi070.stderr: -432> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command rotate-key hook 0x5555cc220dc8 2024-09-12T00:57:43.347 INFO:tasks.workunit.client.0.smithi070.stderr: -431> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient: _reopen_session rank -1 2024-09-12T00:57:43.347 INFO:tasks.workunit.client.0.smithi070.stderr: -430> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:57:43.347 INFO:tasks.workunit.client.0.smithi070.stderr: -429> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient(hunting): picked mon.noname-b con 0x5555cc0d14f0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:57:43.347 INFO:tasks.workunit.client.0.smithi070.stderr: -428> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient(hunting): picked mon.noname-a con 0x5555cc0e02e0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:57:43.347 INFO:tasks.workunit.client.0.smithi070.stderr: -427> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient(hunting): picked mon.noname-c con 0x5555cc2271c0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:57:43.347 INFO:tasks.workunit.client.0.smithi070.stderr: -426> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:43.347 INFO:tasks.workunit.client.0.smithi070.stderr: -425> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:43.348 INFO:tasks.workunit.client.0.smithi070.stderr: -424> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:43.348 INFO:tasks.workunit.client.0.smithi070.stderr: -423> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient(hunting): _renew_subs 2024-09-12T00:57:43.348 INFO:tasks.workunit.client.0.smithi070.stderr: -422> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient(hunting): authenticate will time out at 2313.689906s 2024-09-12T00:57:43.348 INFO:tasks.workunit.client.0.smithi070.stderr: -421> 2024-09-12T00:57:43.238+0000 7f749bcb6640 10 monclient(hunting): get_auth_request con 0x5555cc0e02e0 auth_method 0 2024-09-12T00:57:43.348 INFO:tasks.workunit.client.0.smithi070.stderr: -420> 2024-09-12T00:57:43.238+0000 7f749bcb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:43.348 INFO:tasks.workunit.client.0.smithi070.stderr: -419> 2024-09-12T00:57:43.238+0000 7f749bcb6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:43.348 INFO:tasks.workunit.client.0.smithi070.stderr: -418> 2024-09-12T00:57:43.238+0000 7f749bcb6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:43.348 INFO:tasks.workunit.client.0.smithi070.stderr: -417> 2024-09-12T00:57:43.238+0000 7f749ccb8640 10 monclient(hunting): get_auth_request con 0x5555cc2271c0 auth_method 0 2024-09-12T00:57:43.348 INFO:tasks.workunit.client.0.smithi070.stderr: -416> 2024-09-12T00:57:43.238+0000 7f749ccb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:43.348 INFO:tasks.workunit.client.0.smithi070.stderr: -415> 2024-09-12T00:57:43.238+0000 7f749ccb8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:43.348 INFO:tasks.workunit.client.0.smithi070.stderr: -414> 2024-09-12T00:57:43.238+0000 7f749ccb8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:43.348 INFO:tasks.workunit.client.0.smithi070.stderr: -413> 2024-09-12T00:57:43.238+0000 7f749bcb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:43.348 INFO:tasks.workunit.client.0.smithi070.stderr: -412> 2024-09-12T00:57:43.238+0000 7f749bcb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:43.349 INFO:tasks.workunit.client.0.smithi070.stderr: -411> 2024-09-12T00:57:43.238+0000 7f749bcb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:43.349 INFO:tasks.workunit.client.0.smithi070.stderr: -410> 2024-09-12T00:57:43.238+0000 7f749ccb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:43.349 INFO:tasks.workunit.client.0.smithi070.stderr: -409> 2024-09-12T00:57:43.238+0000 7f749ccb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:43.349 INFO:tasks.workunit.client.0.smithi070.stderr: -408> 2024-09-12T00:57:43.238+0000 7f749ccb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:43.349 INFO:tasks.workunit.client.0.smithi070.stderr: -407> 2024-09-12T00:57:43.238+0000 7f749bcb6640 10 monclient(hunting): handle_auth_done global_id 7794 payload 824 2024-09-12T00:57:43.349 INFO:tasks.workunit.client.0.smithi070.stderr: -406> 2024-09-12T00:57:43.238+0000 7f749bcb6640 10 monclient: _finish_hunting 0 2024-09-12T00:57:43.349 INFO:tasks.workunit.client.0.smithi070.stderr: -405> 2024-09-12T00:57:43.238+0000 7f749bcb6640 1 monclient: found mon.noname-a 2024-09-12T00:57:43.349 INFO:tasks.workunit.client.0.smithi070.stderr: -404> 2024-09-12T00:57:43.238+0000 7f749bcb6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:57:43.349 INFO:tasks.workunit.client.0.smithi070.stderr: -403> 2024-09-12T00:57:43.238+0000 7f7388e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:43.349 INFO:tasks.workunit.client.0.smithi070.stderr: -402> 2024-09-12T00:57:43.238+0000 7f7388e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:57:43.349 INFO:tasks.workunit.client.0.smithi070.stderr: -401> 2024-09-12T00:57:43.238+0000 7f7388e09640 10 monclient: dump: 2024-09-12T00:57:43.349 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:43.349 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:43.349 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.350 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.350 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:43.350 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.350 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:43.350 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:43.350 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:43.350 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.350 INFO:tasks.workunit.client.0.smithi070.stderr: -400> 2024-09-12T00:57:43.238+0000 7f7388e09640 10 monclient: _finish_auth 0 2024-09-12T00:57:43.350 INFO:tasks.workunit.client.0.smithi070.stderr: -399> 2024-09-12T00:57:43.238+0000 7f7388e09640 10 monclient: _check_auth_tickets 2024-09-12T00:57:43.350 INFO:tasks.workunit.client.0.smithi070.stderr: -398> 2024-09-12T00:57:43.238+0000 7f7388e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:57:43.350 INFO:tasks.workunit.client.0.smithi070.stderr: -397> 2024-09-12T00:57:43.238+0000 7f7388e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:43.350 INFO:tasks.workunit.client.0.smithi070.stderr: -396> 2024-09-12T00:57:43.238+0000 7f7388e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:57:43.350 INFO:tasks.workunit.client.0.smithi070.stderr: -395> 2024-09-12T00:57:43.238+0000 7f7388e09640 10 monclient: dump: 2024-09-12T00:57:43.350 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:43.351 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:43.351 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.351 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.351 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:43.351 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.351 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:43.351 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:43.351 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:43.351 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.351 INFO:tasks.workunit.client.0.smithi070.stderr: -394> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 monclient: authenticate success, global_id 7794 2024-09-12T00:57:43.352 INFO:tasks.workunit.client.0.smithi070.stderr: -393> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient: _renew_subs 2024-09-12T00:57:43.352 INFO:tasks.workunit.client.0.smithi070.stderr: -392> 2024-09-12T00:57:43.238+0000 7f738a60c640 4 set_mon_vals no callback set 2024-09-12T00:57:43.352 INFO:tasks.workunit.client.0.smithi070.stderr: -391> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:57:43.352 INFO:tasks.workunit.client.0.smithi070.stderr: -390> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient: _renew_subs 2024-09-12T00:57:43.352 INFO:tasks.workunit.client.0.smithi070.stderr: -389> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:57:43.352 INFO:tasks.workunit.client.0.smithi070.stderr: -388> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 1 librados: init done 2024-09-12T00:57:43.352 INFO:tasks.workunit.client.0.smithi070.stderr: -387> 2024-09-12T00:57:43.242+0000 7f7388e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:57:43.352 INFO:tasks.workunit.client.0.smithi070.stderr: -386> 2024-09-12T00:57:43.242+0000 7f7388e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:57:43.352 INFO:tasks.workunit.client.0.smithi070.stderr: -385> 2024-09-12T00:57:43.242+0000 7f7388e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:57:43.353 INFO:tasks.workunit.client.0.smithi070.stderr: -384> 2024-09-12T00:57:43.242+0000 7f749c4b7640 10 monclient: get_auth_request con 0x7f7384070ae0 auth_method 0 2024-09-12T00:57:43.353 INFO:tasks.workunit.client.0.smithi070.stderr: -383> 2024-09-12T00:57:43.242+0000 7f749ccb8640 10 monclient: get_auth_request con 0x5555cc262410 auth_method 0 2024-09-12T00:57:43.353 INFO:tasks.workunit.client.0.smithi070.stderr: -382> 2024-09-12T00:57:43.242+0000 7f749c4b7640 10 monclient: get_auth_request con 0x5555cc26b9a0 auth_method 0 2024-09-12T00:57:43.353 INFO:tasks.workunit.client.0.smithi070.stderr: -381> 2024-09-12T00:57:43.242+0000 7f749bcb6640 10 monclient: get_auth_request con 0x5555cc26fd00 auth_method 0 2024-09-12T00:57:43.353 INFO:tasks.workunit.client.0.smithi070.stderr: -380> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 10 monclient: build_initial_monmap 2024-09-12T00:57:43.353 INFO:tasks.workunit.client.0.smithi070.stderr: -379> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 1 build_initial for_mkfs: 0 2024-09-12T00:57:43.353 INFO:tasks.workunit.client.0.smithi070.stderr: -378> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 10 monclient: monmap: 2024-09-12T00:57:43.353 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:57:43.354 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:57:43.354 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:57:43.354 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:57:43.354 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:57:43.354 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.354 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:57:43.354 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:57:43.354 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:57:43.355 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.355 INFO:tasks.workunit.client.0.smithi070.stderr: -377> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding auth protocol: cephx 2024-09-12T00:57:43.355 INFO:tasks.workunit.client.0.smithi070.stderr: -376> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding auth protocol: cephx 2024-09-12T00:57:43.355 INFO:tasks.workunit.client.0.smithi070.stderr: -375> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding auth protocol: cephx 2024-09-12T00:57:43.355 INFO:tasks.workunit.client.0.smithi070.stderr: -374> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding con mode: secure 2024-09-12T00:57:43.355 INFO:tasks.workunit.client.0.smithi070.stderr: -373> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding con mode: crc 2024-09-12T00:57:43.355 INFO:tasks.workunit.client.0.smithi070.stderr: -372> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding con mode: secure 2024-09-12T00:57:43.355 INFO:tasks.workunit.client.0.smithi070.stderr: -371> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding con mode: crc 2024-09-12T00:57:43.355 INFO:tasks.workunit.client.0.smithi070.stderr: -370> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding con mode: secure 2024-09-12T00:57:43.356 INFO:tasks.workunit.client.0.smithi070.stderr: -369> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding con mode: crc 2024-09-12T00:57:43.356 INFO:tasks.workunit.client.0.smithi070.stderr: -368> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding con mode: crc 2024-09-12T00:57:43.356 INFO:tasks.workunit.client.0.smithi070.stderr: -367> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding con mode: secure 2024-09-12T00:57:43.356 INFO:tasks.workunit.client.0.smithi070.stderr: -366> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding con mode: crc 2024-09-12T00:57:43.356 INFO:tasks.workunit.client.0.smithi070.stderr: -365> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding con mode: secure 2024-09-12T00:57:43.356 INFO:tasks.workunit.client.0.smithi070.stderr: -364> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding con mode: crc 2024-09-12T00:57:43.356 INFO:tasks.workunit.client.0.smithi070.stderr: -363> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding con mode: secure 2024-09-12T00:57:43.356 INFO:tasks.workunit.client.0.smithi070.stderr: -362> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:43.357 INFO:tasks.workunit.client.0.smithi070.stderr: -361> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command objecter_requests cmddesc objecter_requests hook 0x5555cc2784e0 EEXIST 2024-09-12T00:57:43.357 INFO:tasks.workunit.client.0.smithi070.stderr: -360> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 10 monclient: init 2024-09-12T00:57:43.357 INFO:tasks.workunit.client.0.smithi070.stderr: -359> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding auth protocol: cephx 2024-09-12T00:57:43.357 INFO:tasks.workunit.client.0.smithi070.stderr: -358> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding auth protocol: cephx 2024-09-12T00:57:43.357 INFO:tasks.workunit.client.0.smithi070.stderr: -357> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding auth protocol: cephx 2024-09-12T00:57:43.357 INFO:tasks.workunit.client.0.smithi070.stderr: -356> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding con mode: secure 2024-09-12T00:57:43.357 INFO:tasks.workunit.client.0.smithi070.stderr: -355> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding con mode: crc 2024-09-12T00:57:43.357 INFO:tasks.workunit.client.0.smithi070.stderr: -354> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding con mode: secure 2024-09-12T00:57:43.358 INFO:tasks.workunit.client.0.smithi070.stderr: -353> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding con mode: crc 2024-09-12T00:57:43.358 INFO:tasks.workunit.client.0.smithi070.stderr: -352> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding con mode: secure 2024-09-12T00:57:43.358 INFO:tasks.workunit.client.0.smithi070.stderr: -351> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding con mode: crc 2024-09-12T00:57:43.358 INFO:tasks.workunit.client.0.smithi070.stderr: -350> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding con mode: crc 2024-09-12T00:57:43.358 INFO:tasks.workunit.client.0.smithi070.stderr: -349> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding con mode: secure 2024-09-12T00:57:43.358 INFO:tasks.workunit.client.0.smithi070.stderr: -348> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding con mode: crc 2024-09-12T00:57:43.358 INFO:tasks.workunit.client.0.smithi070.stderr: -347> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding con mode: secure 2024-09-12T00:57:43.358 INFO:tasks.workunit.client.0.smithi070.stderr: -346> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding con mode: crc 2024-09-12T00:57:43.359 INFO:tasks.workunit.client.0.smithi070.stderr: -345> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding con mode: secure 2024-09-12T00:57:43.359 INFO:tasks.workunit.client.0.smithi070.stderr: -344> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:43.359 INFO:tasks.workunit.client.0.smithi070.stderr: -343> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:43.359 INFO:tasks.workunit.client.0.smithi070.stderr: -342> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command rotate-key cmddesc rotate-key hook 0x5555cc273330 EEXIST 2024-09-12T00:57:43.359 INFO:tasks.workunit.client.0.smithi070.stderr: -341> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 10 monclient: _reopen_session rank -1 2024-09-12T00:57:43.359 INFO:tasks.workunit.client.0.smithi070.stderr: -340> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:57:43.359 INFO:tasks.workunit.client.0.smithi070.stderr: -339> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 10 monclient(hunting): picked mon.noname-c con 0x5555cc29c690 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:57:43.359 INFO:tasks.workunit.client.0.smithi070.stderr: -338> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 10 monclient(hunting): picked mon.noname-b con 0x5555cc29bfc0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:57:43.359 INFO:tasks.workunit.client.0.smithi070.stderr: -337> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 10 monclient(hunting): picked mon.noname-a con 0x5555cc29a9a0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:57:43.360 INFO:tasks.workunit.client.0.smithi070.stderr: -336> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:43.360 INFO:tasks.workunit.client.0.smithi070.stderr: -335> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:43.360 INFO:tasks.workunit.client.0.smithi070.stderr: -334> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:43.360 INFO:tasks.workunit.client.0.smithi070.stderr: -333> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 10 monclient(hunting): _renew_subs 2024-09-12T00:57:43.360 INFO:tasks.workunit.client.0.smithi070.stderr: -332> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 10 monclient(hunting): authenticate will time out at 2313.698703s 2024-09-12T00:57:43.360 INFO:tasks.workunit.client.0.smithi070.stderr: -331> 2024-09-12T00:57:43.246+0000 7f749c4b7640 10 monclient(hunting): get_auth_request con 0x5555cc29c690 auth_method 0 2024-09-12T00:57:43.360 INFO:tasks.workunit.client.0.smithi070.stderr: -330> 2024-09-12T00:57:43.246+0000 7f749c4b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:43.360 INFO:tasks.workunit.client.0.smithi070.stderr: -329> 2024-09-12T00:57:43.246+0000 7f749c4b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:43.361 INFO:tasks.workunit.client.0.smithi070.stderr: -328> 2024-09-12T00:57:43.246+0000 7f749c4b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:43.361 INFO:tasks.workunit.client.0.smithi070.stderr: -327> 2024-09-12T00:57:43.246+0000 7f749ccb8640 10 monclient(hunting): get_auth_request con 0x5555cc29a9a0 auth_method 0 2024-09-12T00:57:43.361 INFO:tasks.workunit.client.0.smithi070.stderr: -326> 2024-09-12T00:57:43.246+0000 7f749ccb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:43.361 INFO:tasks.workunit.client.0.smithi070.stderr: -325> 2024-09-12T00:57:43.246+0000 7f749ccb8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:43.361 INFO:tasks.workunit.client.0.smithi070.stderr: -324> 2024-09-12T00:57:43.246+0000 7f749ccb8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:43.361 INFO:tasks.workunit.client.0.smithi070.stderr: -323> 2024-09-12T00:57:43.246+0000 7f749c4b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:43.361 INFO:tasks.workunit.client.0.smithi070.stderr: -322> 2024-09-12T00:57:43.246+0000 7f749c4b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:43.361 INFO:tasks.workunit.client.0.smithi070.stderr: -321> 2024-09-12T00:57:43.246+0000 7f749c4b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:43.362 INFO:tasks.workunit.client.0.smithi070.stderr: -320> 2024-09-12T00:57:43.246+0000 7f749ccb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:43.362 INFO:tasks.workunit.client.0.smithi070.stderr: -319> 2024-09-12T00:57:43.246+0000 7f749ccb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:43.362 INFO:tasks.workunit.client.0.smithi070.stderr: -318> 2024-09-12T00:57:43.246+0000 7f749ccb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:43.362 INFO:tasks.workunit.client.0.smithi070.stderr: -317> 2024-09-12T00:57:43.246+0000 7f749c4b7640 10 monclient(hunting): handle_auth_done global_id 7310 payload 824 2024-09-12T00:57:43.362 INFO:tasks.workunit.client.0.smithi070.stderr: -316> 2024-09-12T00:57:43.246+0000 7f749c4b7640 10 monclient: _finish_hunting 0 2024-09-12T00:57:43.362 INFO:tasks.workunit.client.0.smithi070.stderr: -315> 2024-09-12T00:57:43.246+0000 7f749c4b7640 1 monclient: found mon.noname-c 2024-09-12T00:57:43.362 INFO:tasks.workunit.client.0.smithi070.stderr: -314> 2024-09-12T00:57:43.246+0000 7f749c4b7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:57:43.362 INFO:tasks.workunit.client.0.smithi070.stderr: -313> 2024-09-12T00:57:43.246+0000 7f7381ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:43.362 INFO:tasks.workunit.client.0.smithi070.stderr: -312> 2024-09-12T00:57:43.246+0000 7f7381ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:57:43.363 INFO:tasks.workunit.client.0.smithi070.stderr: -311> 2024-09-12T00:57:43.246+0000 7f7381ffb640 10 monclient: dump: 2024-09-12T00:57:43.363 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:43.363 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:43.363 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.363 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.363 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:43.363 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.363 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:43.363 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:43.364 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:43.364 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.364 INFO:tasks.workunit.client.0.smithi070.stderr: -310> 2024-09-12T00:57:43.246+0000 7f7381ffb640 10 monclient: _finish_auth 0 2024-09-12T00:57:43.364 INFO:tasks.workunit.client.0.smithi070.stderr: -309> 2024-09-12T00:57:43.246+0000 7f7381ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:57:43.364 INFO:tasks.workunit.client.0.smithi070.stderr: -308> 2024-09-12T00:57:43.246+0000 7f7381ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:57:43.364 INFO:tasks.workunit.client.0.smithi070.stderr: -307> 2024-09-12T00:57:43.246+0000 7f7381ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:43.364 INFO:tasks.workunit.client.0.smithi070.stderr: -306> 2024-09-12T00:57:43.246+0000 7f7381ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:57:43.364 INFO:tasks.workunit.client.0.smithi070.stderr: -305> 2024-09-12T00:57:43.246+0000 7f7381ffb640 10 monclient: dump: 2024-09-12T00:57:43.365 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:43.365 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:43.365 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.365 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.365 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:43.365 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.365 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:43.365 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:43.365 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:43.365 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.365 INFO:tasks.workunit.client.0.smithi070.stderr: -304> 2024-09-12T00:57:43.246+0000 7f749d4b9640 4 set_mon_vals no callback set 2024-09-12T00:57:43.365 INFO:tasks.workunit.client.0.smithi070.stderr: -303> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 monclient: authenticate success, global_id 7310 2024-09-12T00:57:43.365 INFO:tasks.workunit.client.0.smithi070.stderr: -302> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient: _renew_subs 2024-09-12T00:57:43.366 INFO:tasks.workunit.client.0.smithi070.stderr: -301> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:57:43.366 INFO:tasks.workunit.client.0.smithi070.stderr: -300> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient: _renew_subs 2024-09-12T00:57:43.366 INFO:tasks.workunit.client.0.smithi070.stderr: -299> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:57:43.366 INFO:tasks.workunit.client.0.smithi070.stderr: -298> 2024-09-12T00:57:43.250+0000 7f7381ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:57:43.366 INFO:tasks.workunit.client.0.smithi070.stderr: -297> 2024-09-12T00:57:43.250+0000 7f7381ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:57:43.366 INFO:tasks.workunit.client.0.smithi070.stderr: -296> 2024-09-12T00:57:43.250+0000 7f7381ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:57:43.366 INFO:tasks.workunit.client.0.smithi070.stderr: -295> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient: get_monmap_and_config 2024-09-12T00:57:43.366 INFO:tasks.workunit.client.0.smithi070.stderr: -294> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient: build_initial_monmap 2024-09-12T00:57:43.366 INFO:tasks.workunit.client.0.smithi070.stderr: -293> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 1 build_initial for_mkfs: 0 2024-09-12T00:57:43.366 INFO:tasks.workunit.client.0.smithi070.stderr: -292> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient: monmap: 2024-09-12T00:57:43.366 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:57:43.366 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:57:43.366 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:57:43.367 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:57:43.367 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:57:43.367 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.367 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:57:43.367 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:57:43.367 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:57:43.367 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.367 INFO:tasks.workunit.client.0.smithi070.stderr: -291> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding auth protocol: cephx 2024-09-12T00:57:43.367 INFO:tasks.workunit.client.0.smithi070.stderr: -290> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding auth protocol: cephx 2024-09-12T00:57:43.367 INFO:tasks.workunit.client.0.smithi070.stderr: -289> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding auth protocol: cephx 2024-09-12T00:57:43.367 INFO:tasks.workunit.client.0.smithi070.stderr: -288> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding con mode: secure 2024-09-12T00:57:43.367 INFO:tasks.workunit.client.0.smithi070.stderr: -287> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding con mode: crc 2024-09-12T00:57:43.368 INFO:tasks.workunit.client.0.smithi070.stderr: -286> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding con mode: secure 2024-09-12T00:57:43.368 INFO:tasks.workunit.client.0.smithi070.stderr: -285> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding con mode: crc 2024-09-12T00:57:43.368 INFO:tasks.workunit.client.0.smithi070.stderr: -284> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding con mode: secure 2024-09-12T00:57:43.368 INFO:tasks.workunit.client.0.smithi070.stderr: -283> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding con mode: crc 2024-09-12T00:57:43.368 INFO:tasks.workunit.client.0.smithi070.stderr: -282> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding con mode: crc 2024-09-12T00:57:43.368 INFO:tasks.workunit.client.0.smithi070.stderr: -281> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding con mode: secure 2024-09-12T00:57:43.368 INFO:tasks.workunit.client.0.smithi070.stderr: -280> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding con mode: crc 2024-09-12T00:57:43.368 INFO:tasks.workunit.client.0.smithi070.stderr: -279> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding con mode: secure 2024-09-12T00:57:43.368 INFO:tasks.workunit.client.0.smithi070.stderr: -278> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding con mode: crc 2024-09-12T00:57:43.368 INFO:tasks.workunit.client.0.smithi070.stderr: -277> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding con mode: secure 2024-09-12T00:57:43.368 INFO:tasks.workunit.client.0.smithi070.stderr: -276> 2024-09-12T00:57:43.250+0000 7f749bcb6640 10 monclient: get_auth_request con 0x7f7374070a20 auth_method 0 2024-09-12T00:57:43.368 INFO:tasks.workunit.client.0.smithi070.stderr: -275> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:43.368 INFO:tasks.workunit.client.0.smithi070.stderr: -274> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient: init 2024-09-12T00:57:43.368 INFO:tasks.workunit.client.0.smithi070.stderr: -273> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding auth protocol: cephx 2024-09-12T00:57:43.369 INFO:tasks.workunit.client.0.smithi070.stderr: -272> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding auth protocol: cephx 2024-09-12T00:57:43.369 INFO:tasks.workunit.client.0.smithi070.stderr: -271> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding auth protocol: cephx 2024-09-12T00:57:43.369 INFO:tasks.workunit.client.0.smithi070.stderr: -270> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding con mode: secure 2024-09-12T00:57:43.369 INFO:tasks.workunit.client.0.smithi070.stderr: -269> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding con mode: crc 2024-09-12T00:57:43.369 INFO:tasks.workunit.client.0.smithi070.stderr: -268> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding con mode: secure 2024-09-12T00:57:43.369 INFO:tasks.workunit.client.0.smithi070.stderr: -267> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding con mode: crc 2024-09-12T00:57:43.369 INFO:tasks.workunit.client.0.smithi070.stderr: -266> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding con mode: secure 2024-09-12T00:57:43.369 INFO:tasks.workunit.client.0.smithi070.stderr: -265> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding con mode: crc 2024-09-12T00:57:43.369 INFO:tasks.workunit.client.0.smithi070.stderr: -264> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding con mode: crc 2024-09-12T00:57:43.369 INFO:tasks.workunit.client.0.smithi070.stderr: -263> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding con mode: secure 2024-09-12T00:57:43.369 INFO:tasks.workunit.client.0.smithi070.stderr: -262> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding con mode: crc 2024-09-12T00:57:43.369 INFO:tasks.workunit.client.0.smithi070.stderr: -261> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding con mode: secure 2024-09-12T00:57:43.369 INFO:tasks.workunit.client.0.smithi070.stderr: -260> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding con mode: crc 2024-09-12T00:57:43.369 INFO:tasks.workunit.client.0.smithi070.stderr: -259> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding con mode: secure 2024-09-12T00:57:43.370 INFO:tasks.workunit.client.0.smithi070.stderr: -258> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:43.370 INFO:tasks.workunit.client.0.smithi070.stderr: -257> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:43.370 INFO:tasks.workunit.client.0.smithi070.stderr: -256> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command rotate-key cmddesc rotate-key hook 0x7ffdbc2ce198 EEXIST 2024-09-12T00:57:43.370 INFO:tasks.workunit.client.0.smithi070.stderr: -255> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient: _reopen_session rank -1 2024-09-12T00:57:43.370 INFO:tasks.workunit.client.0.smithi070.stderr: -254> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:57:43.370 INFO:tasks.workunit.client.0.smithi070.stderr: -253> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient(hunting): picked mon.noname-a con 0x5555cc2f0440 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:57:43.370 INFO:tasks.workunit.client.0.smithi070.stderr: -252> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient(hunting): picked mon.noname-b con 0x5555cc2eb830 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:57:43.370 INFO:tasks.workunit.client.0.smithi070.stderr: -251> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient(hunting): picked mon.noname-c con 0x5555cc2e1f30 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:57:43.370 INFO:tasks.workunit.client.0.smithi070.stderr: -250> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:43.370 INFO:tasks.workunit.client.0.smithi070.stderr: -249> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:43.370 INFO:tasks.workunit.client.0.smithi070.stderr: -248> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:43.370 INFO:tasks.workunit.client.0.smithi070.stderr: -247> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient(hunting): _renew_subs 2024-09-12T00:57:43.370 INFO:tasks.workunit.client.0.smithi070.stderr: -246> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient(hunting): authenticate will time out at 2313.703376s 2024-09-12T00:57:43.371 INFO:tasks.workunit.client.0.smithi070.stderr: -245> 2024-09-12T00:57:43.250+0000 7f749ccb8640 10 monclient(hunting): get_auth_request con 0x5555cc2e1f30 auth_method 0 2024-09-12T00:57:43.371 INFO:tasks.workunit.client.0.smithi070.stderr: -244> 2024-09-12T00:57:43.250+0000 7f749ccb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:43.371 INFO:tasks.workunit.client.0.smithi070.stderr: -243> 2024-09-12T00:57:43.250+0000 7f749ccb8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:43.371 INFO:tasks.workunit.client.0.smithi070.stderr: -242> 2024-09-12T00:57:43.250+0000 7f749ccb8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:43.371 INFO:tasks.workunit.client.0.smithi070.stderr: -241> 2024-09-12T00:57:43.250+0000 7f749c4b7640 10 monclient(hunting): get_auth_request con 0x5555cc2f0440 auth_method 0 2024-09-12T00:57:43.371 INFO:tasks.workunit.client.0.smithi070.stderr: -240> 2024-09-12T00:57:43.250+0000 7f749c4b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:43.371 INFO:tasks.workunit.client.0.smithi070.stderr: -239> 2024-09-12T00:57:43.250+0000 7f749c4b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:43.371 INFO:tasks.workunit.client.0.smithi070.stderr: -238> 2024-09-12T00:57:43.250+0000 7f749c4b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:43.371 INFO:tasks.workunit.client.0.smithi070.stderr: -237> 2024-09-12T00:57:43.250+0000 7f749c4b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:43.371 INFO:tasks.workunit.client.0.smithi070.stderr: -236> 2024-09-12T00:57:43.250+0000 7f749c4b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:43.371 INFO:tasks.workunit.client.0.smithi070.stderr: -235> 2024-09-12T00:57:43.250+0000 7f749c4b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:43.371 INFO:tasks.workunit.client.0.smithi070.stderr: -234> 2024-09-12T00:57:43.250+0000 7f749ccb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:43.371 INFO:tasks.workunit.client.0.smithi070.stderr: -233> 2024-09-12T00:57:43.250+0000 7f749ccb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:43.371 INFO:tasks.workunit.client.0.smithi070.stderr: -232> 2024-09-12T00:57:43.250+0000 7f749ccb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:43.372 INFO:tasks.workunit.client.0.smithi070.stderr: -231> 2024-09-12T00:57:43.250+0000 7f749c4b7640 10 monclient(hunting): handle_auth_done global_id 7800 payload 274 2024-09-12T00:57:43.372 INFO:tasks.workunit.client.0.smithi070.stderr: -230> 2024-09-12T00:57:43.250+0000 7f749c4b7640 10 monclient: _finish_hunting 0 2024-09-12T00:57:43.372 INFO:tasks.workunit.client.0.smithi070.stderr: -229> 2024-09-12T00:57:43.250+0000 7f749c4b7640 1 monclient: found mon.noname-a 2024-09-12T00:57:43.372 INFO:tasks.workunit.client.0.smithi070.stderr: -228> 2024-09-12T00:57:43.250+0000 7f749c4b7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:57:43.372 INFO:tasks.workunit.client.0.smithi070.stderr: -227> 2024-09-12T00:57:43.254+0000 7f73737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:43.372 INFO:tasks.workunit.client.0.smithi070.stderr: -226> 2024-09-12T00:57:43.254+0000 7f73737fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:57:43.372 INFO:tasks.workunit.client.0.smithi070.stderr: -225> 2024-09-12T00:57:43.254+0000 7f73737fe640 10 monclient: dump: 2024-09-12T00:57:43.372 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:43.372 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:43.372 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.372 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.372 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:43.372 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.373 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:43.373 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:43.373 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:43.373 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.373 INFO:tasks.workunit.client.0.smithi070.stderr: -224> 2024-09-12T00:57:43.254+0000 7f73737fe640 10 monclient: _finish_auth 0 2024-09-12T00:57:43.373 INFO:tasks.workunit.client.0.smithi070.stderr: -223> 2024-09-12T00:57:43.254+0000 7f73737fe640 10 monclient: _check_auth_tickets 2024-09-12T00:57:43.373 INFO:tasks.workunit.client.0.smithi070.stderr: -222> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 monclient: authenticate success, global_id 7800 2024-09-12T00:57:43.373 INFO:tasks.workunit.client.0.smithi070.stderr: -221> 2024-09-12T00:57:43.254+0000 7f73737fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:57:43.373 INFO:tasks.workunit.client.0.smithi070.stderr: -220> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient: get_monmap_and_config success 2024-09-12T00:57:43.373 INFO:tasks.workunit.client.0.smithi070.stderr: -219> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 4 set_mon_vals no callback set 2024-09-12T00:57:43.373 INFO:tasks.workunit.client.0.smithi070.stderr: -218> 2024-09-12T00:57:43.254+0000 7f73737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:43.373 INFO:tasks.workunit.client.0.smithi070.stderr: -217> 2024-09-12T00:57:43.254+0000 7f73737fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:57:43.373 INFO:tasks.workunit.client.0.smithi070.stderr: -216> 2024-09-12T00:57:43.254+0000 7f73737fe640 10 monclient: dump: 2024-09-12T00:57:43.373 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:43.374 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:43.374 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.374 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.374 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:43.374 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.374 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:43.374 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:43.374 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:43.374 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.374 INFO:tasks.workunit.client.0.smithi070.stderr: -215> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient: shutdown 2024-09-12T00:57:43.374 INFO:tasks.workunit.client.0.smithi070.stderr: -214> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient: build_initial_monmap 2024-09-12T00:57:43.374 INFO:tasks.workunit.client.0.smithi070.stderr: -213> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 1 build_initial for_mkfs: 0 2024-09-12T00:57:43.374 INFO:tasks.workunit.client.0.smithi070.stderr: -212> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient: monmap: 2024-09-12T00:57:43.375 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:57:43.375 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:57:43.375 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:57:43.375 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:57:43.375 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:57:43.375 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.375 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:57:43.375 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:57:43.375 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:57:43.375 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.375 INFO:tasks.workunit.client.0.smithi070.stderr: -211> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding auth protocol: cephx 2024-09-12T00:57:43.375 INFO:tasks.workunit.client.0.smithi070.stderr: -210> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding auth protocol: cephx 2024-09-12T00:57:43.375 INFO:tasks.workunit.client.0.smithi070.stderr: -209> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding auth protocol: cephx 2024-09-12T00:57:43.375 INFO:tasks.workunit.client.0.smithi070.stderr: -208> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding con mode: secure 2024-09-12T00:57:43.376 INFO:tasks.workunit.client.0.smithi070.stderr: -207> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding con mode: crc 2024-09-12T00:57:43.376 INFO:tasks.workunit.client.0.smithi070.stderr: -206> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding con mode: secure 2024-09-12T00:57:43.376 INFO:tasks.workunit.client.0.smithi070.stderr: -205> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding con mode: crc 2024-09-12T00:57:43.376 INFO:tasks.workunit.client.0.smithi070.stderr: -204> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding con mode: secure 2024-09-12T00:57:43.376 INFO:tasks.workunit.client.0.smithi070.stderr: -203> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding con mode: crc 2024-09-12T00:57:43.376 INFO:tasks.workunit.client.0.smithi070.stderr: -202> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding con mode: crc 2024-09-12T00:57:43.376 INFO:tasks.workunit.client.0.smithi070.stderr: -201> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding con mode: secure 2024-09-12T00:57:43.376 INFO:tasks.workunit.client.0.smithi070.stderr: -200> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding con mode: crc 2024-09-12T00:57:43.376 INFO:tasks.workunit.client.0.smithi070.stderr: -199> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding con mode: secure 2024-09-12T00:57:43.376 INFO:tasks.workunit.client.0.smithi070.stderr: -198> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding con mode: crc 2024-09-12T00:57:43.376 INFO:tasks.workunit.client.0.smithi070.stderr: -197> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding con mode: secure 2024-09-12T00:57:43.376 INFO:tasks.workunit.client.0.smithi070.stderr: -196> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:43.376 INFO:tasks.workunit.client.0.smithi070.stderr: -195> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 1 librados: starting msgr at 2024-09-12T00:57:43.377 INFO:tasks.workunit.client.0.smithi070.stderr: -194> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 1 librados: starting objecter 2024-09-12T00:57:43.377 INFO:tasks.workunit.client.0.smithi070.stderr: -193> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command objecter_requests cmddesc objecter_requests hook 0x5555cc2a12a0 EEXIST 2024-09-12T00:57:43.377 INFO:tasks.workunit.client.0.smithi070.stderr: -192> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 1 librados: setting wanted keys 2024-09-12T00:57:43.377 INFO:tasks.workunit.client.0.smithi070.stderr: -191> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 1 librados: calling monclient init 2024-09-12T00:57:43.377 INFO:tasks.workunit.client.0.smithi070.stderr: -190> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient: init 2024-09-12T00:57:43.377 INFO:tasks.workunit.client.0.smithi070.stderr: -189> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding auth protocol: cephx 2024-09-12T00:57:43.377 INFO:tasks.workunit.client.0.smithi070.stderr: -188> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding auth protocol: cephx 2024-09-12T00:57:43.377 INFO:tasks.workunit.client.0.smithi070.stderr: -187> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding auth protocol: cephx 2024-09-12T00:57:43.377 INFO:tasks.workunit.client.0.smithi070.stderr: -186> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding con mode: secure 2024-09-12T00:57:43.377 INFO:tasks.workunit.client.0.smithi070.stderr: -185> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding con mode: crc 2024-09-12T00:57:43.377 INFO:tasks.workunit.client.0.smithi070.stderr: -184> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding con mode: secure 2024-09-12T00:57:43.378 INFO:tasks.workunit.client.0.smithi070.stderr: -183> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding con mode: crc 2024-09-12T00:57:43.378 INFO:tasks.workunit.client.0.smithi070.stderr: -182> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding con mode: secure 2024-09-12T00:57:43.378 INFO:tasks.workunit.client.0.smithi070.stderr: -181> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding con mode: crc 2024-09-12T00:57:43.378 INFO:tasks.workunit.client.0.smithi070.stderr: -180> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding con mode: crc 2024-09-12T00:57:43.378 INFO:tasks.workunit.client.0.smithi070.stderr: -179> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding con mode: secure 2024-09-12T00:57:43.378 INFO:tasks.workunit.client.0.smithi070.stderr: -178> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding con mode: crc 2024-09-12T00:57:43.378 INFO:tasks.workunit.client.0.smithi070.stderr: -177> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding con mode: secure 2024-09-12T00:57:43.378 INFO:tasks.workunit.client.0.smithi070.stderr: -176> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding con mode: crc 2024-09-12T00:57:43.378 INFO:tasks.workunit.client.0.smithi070.stderr: -175> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding con mode: secure 2024-09-12T00:57:43.378 INFO:tasks.workunit.client.0.smithi070.stderr: -174> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:43.379 INFO:tasks.workunit.client.0.smithi070.stderr: -173> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:43.379 INFO:tasks.workunit.client.0.smithi070.stderr: -172> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command rotate-key cmddesc rotate-key hook 0x5555cc29e5f8 EEXIST 2024-09-12T00:57:43.379 INFO:tasks.workunit.client.0.smithi070.stderr: -171> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient: _reopen_session rank -1 2024-09-12T00:57:43.379 INFO:tasks.workunit.client.0.smithi070.stderr: -170> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:57:43.379 INFO:tasks.workunit.client.0.smithi070.stderr: -169> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient(hunting): picked mon.noname-a con 0x5555cc2e1f30 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:57:43.379 INFO:tasks.workunit.client.0.smithi070.stderr: -168> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient(hunting): picked mon.noname-c con 0x5555cc2eb830 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:57:43.379 INFO:tasks.workunit.client.0.smithi070.stderr: -167> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient(hunting): picked mon.noname-b con 0x5555cc2f0440 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:57:43.379 INFO:tasks.workunit.client.0.smithi070.stderr: -166> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:43.379 INFO:tasks.workunit.client.0.smithi070.stderr: -165> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:43.379 INFO:tasks.workunit.client.0.smithi070.stderr: -164> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:43.379 INFO:tasks.workunit.client.0.smithi070.stderr: -163> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient(hunting): _renew_subs 2024-09-12T00:57:43.379 INFO:tasks.workunit.client.0.smithi070.stderr: -162> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient(hunting): authenticate will time out at 2313.705936s 2024-09-12T00:57:43.379 INFO:tasks.workunit.client.0.smithi070.stderr: -161> 2024-09-12T00:57:43.254+0000 7f749c4b7640 10 monclient(hunting): get_auth_request con 0x5555cc2e1f30 auth_method 0 2024-09-12T00:57:43.379 INFO:tasks.workunit.client.0.smithi070.stderr: -160> 2024-09-12T00:57:43.254+0000 7f749c4b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:43.380 INFO:tasks.workunit.client.0.smithi070.stderr: -159> 2024-09-12T00:57:43.254+0000 7f749c4b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:43.380 INFO:tasks.workunit.client.0.smithi070.stderr: -158> 2024-09-12T00:57:43.254+0000 7f749c4b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:43.380 INFO:tasks.workunit.client.0.smithi070.stderr: -157> 2024-09-12T00:57:43.254+0000 7f749bcb6640 10 monclient(hunting): get_auth_request con 0x5555cc2eb830 auth_method 0 2024-09-12T00:57:43.380 INFO:tasks.workunit.client.0.smithi070.stderr: -156> 2024-09-12T00:57:43.254+0000 7f749bcb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:43.380 INFO:tasks.workunit.client.0.smithi070.stderr: -155> 2024-09-12T00:57:43.254+0000 7f749bcb6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:43.380 INFO:tasks.workunit.client.0.smithi070.stderr: -154> 2024-09-12T00:57:43.254+0000 7f749bcb6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:43.380 INFO:tasks.workunit.client.0.smithi070.stderr: -153> 2024-09-12T00:57:43.254+0000 7f749c4b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:43.380 INFO:tasks.workunit.client.0.smithi070.stderr: -152> 2024-09-12T00:57:43.254+0000 7f749c4b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:43.380 INFO:tasks.workunit.client.0.smithi070.stderr: -151> 2024-09-12T00:57:43.254+0000 7f749c4b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:43.380 INFO:tasks.workunit.client.0.smithi070.stderr: -150> 2024-09-12T00:57:43.254+0000 7f749bcb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:43.380 INFO:tasks.workunit.client.0.smithi070.stderr: -149> 2024-09-12T00:57:43.254+0000 7f749bcb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:43.380 INFO:tasks.workunit.client.0.smithi070.stderr: -148> 2024-09-12T00:57:43.254+0000 7f749bcb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:43.380 INFO:tasks.workunit.client.0.smithi070.stderr: -147> 2024-09-12T00:57:43.254+0000 7f749bcb6640 10 monclient(hunting): handle_auth_done global_id 7316 payload 824 2024-09-12T00:57:43.381 INFO:tasks.workunit.client.0.smithi070.stderr: -146> 2024-09-12T00:57:43.254+0000 7f749bcb6640 10 monclient: _finish_hunting 0 2024-09-12T00:57:43.381 INFO:tasks.workunit.client.0.smithi070.stderr: -145> 2024-09-12T00:57:43.254+0000 7f749bcb6640 1 monclient: found mon.noname-c 2024-09-12T00:57:43.381 INFO:tasks.workunit.client.0.smithi070.stderr: -144> 2024-09-12T00:57:43.254+0000 7f749bcb6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:57:43.381 INFO:tasks.workunit.client.0.smithi070.stderr: -143> 2024-09-12T00:57:43.254+0000 7f7371ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:43.381 INFO:tasks.workunit.client.0.smithi070.stderr: -142> 2024-09-12T00:57:43.254+0000 7f7371ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:57:43.381 INFO:tasks.workunit.client.0.smithi070.stderr: -141> 2024-09-12T00:57:43.254+0000 7f7371ffb640 10 monclient: dump: 2024-09-12T00:57:43.381 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:43.381 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:43.381 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.381 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.381 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:43.381 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.381 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:43.381 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:43.382 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:43.382 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.382 INFO:tasks.workunit.client.0.smithi070.stderr: -140> 2024-09-12T00:57:43.254+0000 7f7371ffb640 10 monclient: _finish_auth 0 2024-09-12T00:57:43.382 INFO:tasks.workunit.client.0.smithi070.stderr: -139> 2024-09-12T00:57:43.254+0000 7f7371ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:57:43.382 INFO:tasks.workunit.client.0.smithi070.stderr: -138> 2024-09-12T00:57:43.254+0000 7f7371ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:57:43.382 INFO:tasks.workunit.client.0.smithi070.stderr: -137> 2024-09-12T00:57:43.254+0000 7f7371ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:43.382 INFO:tasks.workunit.client.0.smithi070.stderr: -136> 2024-09-12T00:57:43.254+0000 7f7371ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:57:43.382 INFO:tasks.workunit.client.0.smithi070.stderr: -135> 2024-09-12T00:57:43.254+0000 7f7371ffb640 10 monclient: dump: 2024-09-12T00:57:43.382 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:43.382 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:43.382 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.382 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.382 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:43.383 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.383 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:43.383 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:43.383 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:43.383 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.383 INFO:tasks.workunit.client.0.smithi070.stderr: -134> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 monclient: authenticate success, global_id 7316 2024-09-12T00:57:43.383 INFO:tasks.workunit.client.0.smithi070.stderr: -133> 2024-09-12T00:57:43.254+0000 7f73737fe640 4 set_mon_vals no callback set 2024-09-12T00:57:43.383 INFO:tasks.workunit.client.0.smithi070.stderr: -132> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient: _renew_subs 2024-09-12T00:57:43.383 INFO:tasks.workunit.client.0.smithi070.stderr: -131> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:57:43.383 INFO:tasks.workunit.client.0.smithi070.stderr: -130> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient: _renew_subs 2024-09-12T00:57:43.383 INFO:tasks.workunit.client.0.smithi070.stderr: -129> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:57:43.383 INFO:tasks.workunit.client.0.smithi070.stderr: -128> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 1 librados: init done 2024-09-12T00:57:43.383 INFO:tasks.workunit.client.0.smithi070.stderr: -127> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command cr dump hook 0x5555cc2e1af8 2024-09-12T00:57:43.383 INFO:tasks.workunit.client.0.smithi070.stderr: -126> 2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.384 INFO:tasks.workunit.client.0.smithi070.stderr: -125> 2024-09-12T00:57:43.258+0000 7f7371ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:57:43.384 INFO:tasks.workunit.client.0.smithi070.stderr: -124> 2024-09-12T00:57:43.258+0000 7f7371ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:57:43.384 INFO:tasks.workunit.client.0.smithi070.stderr: -123> 2024-09-12T00:57:43.258+0000 7f7371ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:57:43.384 INFO:tasks.workunit.client.0.smithi070.stderr: -122> 2024-09-12T00:57:43.258+0000 7f749c4b7640 10 monclient: get_auth_request con 0x7f7364070ae0 auth_method 0 2024-09-12T00:57:43.384 INFO:tasks.workunit.client.0.smithi070.stderr: -121> 2024-09-12T00:57:43.258+0000 7f749ccb8640 10 monclient: get_auth_request con 0x5555cc30a540 auth_method 0 2024-09-12T00:57:43.384 INFO:tasks.workunit.client.0.smithi070.stderr: -120> 2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.384 INFO:tasks.workunit.client.0.smithi070.stderr: -119> 2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 realm 2024-09-12T00:57:43.384 INFO:tasks.workunit.client.0.smithi070.stderr: -118> 2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.384 INFO:tasks.workunit.client.0.smithi070.stderr: -117> 2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.384 INFO:tasks.workunit.client.0.smithi070.stderr: -116> 2024-09-12T00:57:43.258+0000 7f749e9b19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:43.384 INFO:tasks.workunit.client.0.smithi070.stderr: -115> 2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.384 INFO:tasks.workunit.client.0.smithi070.stderr: -114> 2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.384 INFO:tasks.workunit.client.0.smithi070.stderr: -113> 2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.384 INFO:tasks.workunit.client.0.smithi070.stderr: -112> 2024-09-12T00:57:43.258+0000 7f749c4b7640 10 monclient: get_auth_request con 0x5555cc30e850 auth_method 0 2024-09-12T00:57:43.385 INFO:tasks.workunit.client.0.smithi070.stderr: -111> 2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:43.385 INFO:tasks.workunit.client.0.smithi070.stderr: -110> 2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.385 INFO:tasks.workunit.client.0.smithi070.stderr: -109> 2024-09-12T00:57:43.258+0000 7f749bcb6640 10 monclient: get_auth_request con 0x5555cc311f90 auth_method 0 2024-09-12T00:57:43.385 INFO:tasks.workunit.client.0.smithi070.stderr: -108> 2024-09-12T00:57:43.262+0000 7f749e9b19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:43.385 INFO:tasks.workunit.client.0.smithi070.stderr: -107> 2024-09-12T00:57:43.262+0000 7f749e9b19c0 20 searching for the correct realm 2024-09-12T00:57:43.385 INFO:tasks.workunit.client.0.smithi070.stderr: -106> 2024-09-12T00:57:43.262+0000 7f749ccb8640 10 monclient: get_auth_request con 0x5555cc316ce0 auth_method 0 2024-09-12T00:57:43.385 INFO:tasks.workunit.client.0.smithi070.stderr: -105> 2024-09-12T00:57:43.262+0000 7f749c4b7640 10 monclient: get_auth_request con 0x7f74940c6410 auth_method 0 2024-09-12T00:57:43.385 INFO:tasks.workunit.client.0.smithi070.stderr: -104> 2024-09-12T00:57:43.262+0000 7f749bcb6640 10 monclient: get_auth_request con 0x7f748c03d060 auth_method 0 2024-09-12T00:57:43.385 INFO:tasks.workunit.client.0.smithi070.stderr: -103> 2024-09-12T00:57:43.266+0000 7f749ccb8640 10 monclient: get_auth_request con 0x7f7490062be0 auth_method 0 2024-09-12T00:57:43.385 INFO:tasks.workunit.client.0.smithi070.stderr: -102> 2024-09-12T00:57:43.266+0000 7f749ccb8640 0 -- 172.21.15.70:0/197211755 >> [v2:172.21.15.70:6808/276433067,v1:172.21.15.70:6809/276433067] conn(0x5555cc316ce0 msgr2=0x5555cc3191a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:57:43.385 INFO:tasks.workunit.client.0.smithi070.stderr: -101> 2024-09-12T00:57:43.266+0000 7f7371ffb640 1 client.7316.objecter ms_handle_reset 0x5555cc316ce0 session 0x5555cc316610 osd.3 2024-09-12T00:57:43.385 INFO:tasks.workunit.client.0.smithi070.stderr: -100> 2024-09-12T00:57:43.266+0000 7f7371ffb640 10 monclient: _renew_subs 2024-09-12T00:57:43.385 INFO:tasks.workunit.client.0.smithi070.stderr: -99> 2024-09-12T00:57:43.266+0000 7f7371ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:57:43.386 INFO:tasks.workunit.client.0.smithi070.stderr: -98> 2024-09-12T00:57:43.266+0000 7f749ccb8640 10 monclient: get_auth_request con 0x7f7364080880 auth_method 0 2024-09-12T00:57:43.386 INFO:tasks.workunit.client.0.smithi070.stderr: -97> 2024-09-12T00:57:43.270+0000 7f749c4b7640 10 monclient: get_auth_request con 0x7f74940d7430 auth_method 0 2024-09-12T00:57:43.386 INFO:tasks.workunit.client.0.smithi070.stderr: -96> 2024-09-12T00:57:43.274+0000 7f749c4b7640 0 -- 172.21.15.70:0/197211755 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f74940c6410 msgr2=0x7f74940c6890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:43.386 INFO:tasks.workunit.client.0.smithi070.stderr: -95> 2024-09-12T00:57:43.274+0000 7f7371ffb640 1 client.7316.objecter ms_handle_reset 0x7f74940c6410 session 0x7f74940a6070 osd.7 2024-09-12T00:57:43.386 INFO:tasks.workunit.client.0.smithi070.stderr: -94> 2024-09-12T00:57:43.274+0000 7f749c4b7640 10 monclient: get_auth_request con 0x5555cc316ce0 auth_method 0 2024-09-12T00:57:43.386 INFO:tasks.workunit.client.0.smithi070.stderr: -93> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:43.386 INFO:tasks.workunit.client.0.smithi070.stderr: -92> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:57:43.386 INFO:tasks.workunit.client.0.smithi070.stderr: -91> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:43.386 INFO:tasks.workunit.client.0.smithi070.stderr: -90> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:57:43.386 INFO:tasks.workunit.client.0.smithi070.stderr: -89> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:43.386 INFO:tasks.workunit.client.0.smithi070.stderr: -88> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:43.386 INFO:tasks.workunit.client.0.smithi070.stderr: -87> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.386 INFO:tasks.workunit.client.0.smithi070.stderr: -86> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.387 INFO:tasks.workunit.client.0.smithi070.stderr: -85> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.387 INFO:tasks.workunit.client.0.smithi070.stderr: -84> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:43.387 INFO:tasks.workunit.client.0.smithi070.stderr: -83> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.387 INFO:tasks.workunit.client.0.smithi070.stderr: -82> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:43.387 INFO:tasks.workunit.client.0.smithi070.stderr: -81> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 zone default found 2024-09-12T00:57:43.387 INFO:tasks.workunit.client.0.smithi070.stderr: -80> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 4 Realm: () 2024-09-12T00:57:43.387 INFO:tasks.workunit.client.0.smithi070.stderr: -79> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:57:43.387 INFO:tasks.workunit.client.0.smithi070.stderr: -78> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:57:43.387 INFO:tasks.workunit.client.0.smithi070.stderr: -77> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:43.387 INFO:tasks.workunit.client.0.smithi070.stderr: -76> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 zonegroup default 2024-09-12T00:57:43.387 INFO:tasks.workunit.client.0.smithi070.stderr: -75> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.388 INFO:tasks.workunit.client.0.smithi070.stderr: -74> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.388 INFO:tasks.workunit.client.0.smithi070.stderr: -73> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.388 INFO:tasks.workunit.client.0.smithi070.stderr: -72> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.388 INFO:tasks.workunit.client.0.smithi070.stderr: -71> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.388 INFO:tasks.workunit.client.0.smithi070.stderr: -70> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.388 INFO:tasks.workunit.client.0.smithi070.stderr: -69> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 started sync module instance, tier type = 2024-09-12T00:57:43.388 INFO:tasks.workunit.client.0.smithi070.stderr: -68> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:57:43.388 INFO:tasks.workunit.client.0.smithi070.stderr: -67> 2024-09-12T00:57:43.298+0000 7f749e9b19c0 20 add_watcher() i=0 2024-09-12T00:57:43.388 INFO:tasks.workunit.client.0.smithi070.stderr: -66> 2024-09-12T00:57:43.298+0000 7f749e9b19c0 20 add_watcher() i=1 2024-09-12T00:57:43.388 INFO:tasks.workunit.client.0.smithi070.stderr: -65> 2024-09-12T00:57:43.298+0000 7f749e9b19c0 20 add_watcher() i=2 2024-09-12T00:57:43.388 INFO:tasks.workunit.client.0.smithi070.stderr: -64> 2024-09-12T00:57:43.298+0000 7f749e9b19c0 20 add_watcher() i=3 2024-09-12T00:57:43.388 INFO:tasks.workunit.client.0.smithi070.stderr: -63> 2024-09-12T00:57:43.298+0000 7f749e9b19c0 20 add_watcher() i=4 2024-09-12T00:57:43.388 INFO:tasks.workunit.client.0.smithi070.stderr: -62> 2024-09-12T00:57:43.298+0000 7f749e9b19c0 20 add_watcher() i=5 2024-09-12T00:57:43.389 INFO:tasks.workunit.client.0.smithi070.stderr: -61> 2024-09-12T00:57:43.298+0000 7f749e9b19c0 20 add_watcher() i=6 2024-09-12T00:57:43.389 INFO:tasks.workunit.client.0.smithi070.stderr: -60> 2024-09-12T00:57:43.298+0000 7f749e9b19c0 20 add_watcher() i=7 2024-09-12T00:57:43.389 INFO:tasks.workunit.client.0.smithi070.stderr: -59> 2024-09-12T00:57:43.298+0000 7f749e9b19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:43.389 INFO:tasks.workunit.client.0.smithi070.stderr: -58> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding auth protocol: cephx 2024-09-12T00:57:43.389 INFO:tasks.workunit.client.0.smithi070.stderr: -57> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding auth protocol: cephx 2024-09-12T00:57:43.389 INFO:tasks.workunit.client.0.smithi070.stderr: -56> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding auth protocol: cephx 2024-09-12T00:57:43.389 INFO:tasks.workunit.client.0.smithi070.stderr: -55> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding con mode: secure 2024-09-12T00:57:43.389 INFO:tasks.workunit.client.0.smithi070.stderr: -54> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding con mode: crc 2024-09-12T00:57:43.389 INFO:tasks.workunit.client.0.smithi070.stderr: -53> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding con mode: secure 2024-09-12T00:57:43.389 INFO:tasks.workunit.client.0.smithi070.stderr: -52> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding con mode: crc 2024-09-12T00:57:43.389 INFO:tasks.workunit.client.0.smithi070.stderr: -51> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding con mode: secure 2024-09-12T00:57:43.389 INFO:tasks.workunit.client.0.smithi070.stderr: -50> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding con mode: crc 2024-09-12T00:57:43.389 INFO:tasks.workunit.client.0.smithi070.stderr: -49> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding con mode: crc 2024-09-12T00:57:43.389 INFO:tasks.workunit.client.0.smithi070.stderr: -48> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding con mode: secure 2024-09-12T00:57:43.390 INFO:tasks.workunit.client.0.smithi070.stderr: -47> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding con mode: crc 2024-09-12T00:57:43.390 INFO:tasks.workunit.client.0.smithi070.stderr: -46> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding con mode: secure 2024-09-12T00:57:43.390 INFO:tasks.workunit.client.0.smithi070.stderr: -45> 2024-09-12T00:57:43.302+0000 7f7352fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:43.390 INFO:tasks.workunit.client.0.smithi070.stderr: -44> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding con mode: crc 2024-09-12T00:57:43.390 INFO:tasks.workunit.client.0.smithi070.stderr: -43> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding con mode: secure 2024-09-12T00:57:43.390 INFO:tasks.workunit.client.0.smithi070.stderr: -42> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:43.390 INFO:tasks.workunit.client.0.smithi070.stderr: -41> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:43.390 INFO:tasks.workunit.client.0.smithi070.stderr: -40> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:43.390 INFO:tasks.workunit.client.0.smithi070.stderr: -39> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command cache list hook 0x5555cc2e1830 2024-09-12T00:57:43.390 INFO:tasks.workunit.client.0.smithi070.stderr: -38> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command cache inspect hook 0x5555cc2e1830 2024-09-12T00:57:43.390 INFO:tasks.workunit.client.0.smithi070.stderr: -37> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command cache erase hook 0x5555cc2e1830 2024-09-12T00:57:43.390 INFO:tasks.workunit.client.0.smithi070.stderr: -36> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command cache zap hook 0x5555cc2e1830 2024-09-12T00:57:43.390 INFO:tasks.workunit.client.0.smithi070.stderr: -35> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 note: GC not initialized 2024-09-12T00:57:43.390 INFO:tasks.workunit.client.0.smithi070.stderr: -34> 2024-09-12T00:57:43.302+0000 7f7351fdb640 20 reqs_thread_entry: start 2024-09-12T00:57:43.391 INFO:tasks.workunit.client.0.smithi070.stderr: -33> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command sync trace show hook 0x7f7494004680 2024-09-12T00:57:43.391 INFO:tasks.workunit.client.0.smithi070.stderr: -32> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command sync trace history hook 0x7f7494004680 2024-09-12T00:57:43.391 INFO:tasks.workunit.client.0.smithi070.stderr: -31> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command sync trace active hook 0x7f7494004680 2024-09-12T00:57:43.391 INFO:tasks.workunit.client.0.smithi070.stderr: -30> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command sync trace active_short hook 0x7f7494004680 2024-09-12T00:57:43.391 INFO:tasks.workunit.client.0.smithi070.stderr: -29> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 20 init_complete bucket index max shards: 1 2024-09-12T00:57:43.391 INFO:tasks.workunit.client.0.smithi070.stderr: -28> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 20 Filter name: none 2024-09-12T00:57:43.391 INFO:tasks.workunit.client.0.smithi070.stderr: -27> 2024-09-12T00:57:43.302+0000 7f72c37fe640 20 reqs_thread_entry: start 2024-09-12T00:57:43.391 INFO:tasks.workunit.client.0.smithi070.stderr: -26> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:57:43.391 INFO:tasks.workunit.client.0.smithi070.stderr: -25> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.391 INFO:tasks.workunit.client.0.smithi070.stderr: -24> 2024-09-12T00:57:43.306+0000 7f749e9b19c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:57:43.391 INFO:tasks.workunit.client.0.smithi070.stderr: -23> 2024-09-12T00:57:43.306+0000 7f749e9b19c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:57:43.391 INFO:tasks.workunit.client.0.smithi070.stderr: -22> 2024-09-12T00:57:43.306+0000 7f749e9b19c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:57:43.391 INFO:tasks.workunit.client.0.smithi070.stderr: -21> 2024-09-12T00:57:43.306+0000 7f749e9b19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 : miss 2024-09-12T00:57:43.392 INFO:tasks.workunit.client.0.smithi070.stderr: -20> 2024-09-12T00:57:43.306+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.392 INFO:tasks.workunit.client.0.smithi070.stderr: -19> 2024-09-12T00:57:43.306+0000 7f749e9b19c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:57:43.392 INFO:tasks.workunit.client.0.smithi070.stderr: -18> 2024-09-12T00:57:43.306+0000 7f749e9b19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 info.flags=0x17 2024-09-12T00:57:43.392 INFO:tasks.workunit.client.0.smithi070.stderr: -17> 2024-09-12T00:57:43.306+0000 7f749e9b19c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 to cache LRU end 2024-09-12T00:57:43.392 INFO:tasks.workunit.client.0.smithi070.stderr: -16> 2024-09-12T00:57:43.306+0000 7f749e9b19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:57:43.392 INFO:tasks.workunit.client.0.smithi070.stderr: -15> 2024-09-12T00:57:43.306+0000 7f749e9b19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:43.392 INFO:tasks.workunit.client.0.smithi070.stderr: -14> 2024-09-12T00:57:43.306+0000 7f749e9b19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 2024-09-12T00:57:43.392 INFO:tasks.workunit.client.0.smithi070.stderr: -13> 2024-09-12T00:57:43.314+0000 7f749e9b19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 info.flags=0x17 2024-09-12T00:57:43.392 INFO:tasks.workunit.client.0.smithi070.stderr: -12> 2024-09-12T00:57:43.314+0000 7f749e9b19c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 to cache LRU end 2024-09-12T00:57:43.392 INFO:tasks.workunit.client.0.smithi070.stderr: -11> 2024-09-12T00:57:43.314+0000 7f749e9b19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:43.392 INFO:tasks.workunit.client.0.smithi070.stderr: -10> 2024-09-12T00:57:43.314+0000 7f749e9b19c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37, ofs0, ns] 2024-09-12T00:57:43.392 INFO:tasks.workunit.client.0.smithi070.stderr: -9> 2024-09-12T00:57:43.314+0000 7f73737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431564 cookie 93826986402448 notifier 7316 bl.length()=1007 2024-09-12T00:57:43.392 INFO:tasks.workunit.client.0.smithi070.stderr: -8> 2024-09-12T00:57:43.314+0000 7f73737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 info.flags=0x17 2024-09-12T00:57:43.393 INFO:tasks.workunit.client.0.smithi070.stderr: -7> 2024-09-12T00:57:43.314+0000 7f73737fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 to cache LRU end 2024-09-12T00:57:43.393 INFO:tasks.workunit.client.0.smithi070.stderr: -6> 2024-09-12T00:57:43.314+0000 7f73737fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:43.393 INFO:tasks.workunit.client.0.smithi070.stderr: -5> 2024-09-12T00:57:43.314+0000 7f749e9b19c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37]): orig_sources= new_sources= 2024-09-12T00:57:43.393 INFO:tasks.workunit.client.0.smithi070.stderr: -4> 2024-09-12T00:57:43.314+0000 7f749e9b19c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37]): potential sources added=[] removed=[] 2024-09-12T00:57:43.393 INFO:tasks.workunit.client.0.smithi070.stderr: -3> 2024-09-12T00:57:43.314+0000 7f749e9b19c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37]): orig_dests= new_dests= 2024-09-12T00:57:43.393 INFO:tasks.workunit.client.0.smithi070.stderr: -2> 2024-09-12T00:57:43.314+0000 7f749e9b19c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37]): potential dests added=[] removed=[] 2024-09-12T00:57:43.393 INFO:tasks.workunit.client.0.smithi070.stderr: -1> 2024-09-12T00:57:43.318+0000 7f749e9b19c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f749e9b19c0 time 2024-09-12T00:57:43.322310+0000 2024-09-12T00:57:43.393 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:57:43.393 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.393 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:57:43.393 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f74a228b2eb] 2024-09-12T00:57:43.393 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f74a228b49f] 2024-09-12T00:57:43.393 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5555caf11cc1] 2024-09-12T00:57:43.394 INFO:tasks.workunit.client.0.smithi070.stderr: 4: radosgw-admin(+0x1422aac) [0x5555cb96faac] 2024-09-12T00:57:43.394 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5555caf26ced] 2024-09-12T00:57:43.394 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:57:43.394 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f74a10f1d90] 2024-09-12T00:57:43.394 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:57:43.394 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:57:43.394 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.394 INFO:tasks.workunit.client.0.smithi070.stderr: 0> 2024-09-12T00:57:43.318+0000 7f749e9b19c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:57:43.394 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f749e9b19c0 thread_name:radosgw-admin 2024-09-12T00:57:43.394 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.394 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:57:43.394 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f74a110a520] 2024-09-12T00:57:43.394 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:57:43.395 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:57:43.395 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:57:43.395 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f74a228b345] 2024-09-12T00:57:43.395 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f74a228b49f] 2024-09-12T00:57:43.395 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5555caf11cc1] 2024-09-12T00:57:43.395 INFO:tasks.workunit.client.0.smithi070.stderr: 8: radosgw-admin(+0x1422aac) [0x5555cb96faac] 2024-09-12T00:57:43.395 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5555caf26ced] 2024-09-12T00:57:43.395 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:57:43.395 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f74a10f1d90] 2024-09-12T00:57:43.395 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:57:43.396 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:57:43.396 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:57:43.396 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.396 INFO:tasks.workunit.client.0.smithi070.stderr:--- logging levels --- 2024-09-12T00:57:43.396 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 none 2024-09-12T00:57:43.396 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 lockdep 2024-09-12T00:57:43.396 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 context 2024-09-12T00:57:43.396 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 crush 2024-09-12T00:57:43.396 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds 2024-09-12T00:57:43.396 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_balancer 2024-09-12T00:57:43.396 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_locker 2024-09-12T00:57:43.396 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log 2024-09-12T00:57:43.396 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log_expire 2024-09-12T00:57:43.397 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_migrator 2024-09-12T00:57:43.397 INFO:tasks.workunit.client.0.smithi070.stderr: 3/ 5 mds_quiesce 2024-09-12T00:57:43.397 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 buffer 2024-09-12T00:57:43.397 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 timer 2024-09-12T00:57:43.397 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 filer 2024-09-12T00:57:43.397 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 striper 2024-09-12T00:57:43.397 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 objecter 2024-09-12T00:57:43.397 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rados 2024-09-12T00:57:43.397 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd 2024-09-12T00:57:43.397 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_mirror 2024-09-12T00:57:43.397 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_replay 2024-09-12T00:57:43.397 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_pwl 2024-09-12T00:57:43.397 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 journaler 2024-09-12T00:57:43.397 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objectcacher 2024-09-12T00:57:43.397 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:57:43.398 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 client 2024-09-12T00:57:43.398 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 osd 2024-09-12T00:57:43.398 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 optracker 2024-09-12T00:57:43.398 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objclass 2024-09-12T00:57:43.398 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 filestore 2024-09-12T00:57:43.398 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 journal 2024-09-12T00:57:43.398 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 ms 2024-09-12T00:57:43.398 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mon 2024-09-12T00:57:43.398 INFO:tasks.workunit.client.0.smithi070.stderr: 0/10 monc 2024-09-12T00:57:43.398 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 paxos 2024-09-12T00:57:43.398 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 tp 2024-09-12T00:57:43.398 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 auth 2024-09-12T00:57:43.398 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 crypto 2024-09-12T00:57:43.398 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 finisher 2024-09-12T00:57:43.399 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 reserver 2024-09-12T00:57:43.399 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 heartbeatmap 2024-09-12T00:57:43.399 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 perfcounter 2024-09-12T00:57:43.399 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw 2024-09-12T00:57:43.399 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_sync 2024-09-12T00:57:43.399 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_datacache 2024-09-12T00:57:43.399 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_access 2024-09-12T00:57:43.399 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:57:43.399 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_flight 2024-09-12T00:57:43.399 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:57:43.399 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw_notification 2024-09-12T00:57:43.399 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 javaclient 2024-09-12T00:57:43.399 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 asok 2024-09-12T00:57:43.399 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 throttle 2024-09-12T00:57:43.400 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 refs 2024-09-12T00:57:43.400 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 compressor 2024-09-12T00:57:43.400 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluestore 2024-09-12T00:57:43.400 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluefs 2024-09-12T00:57:43.400 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 bdev 2024-09-12T00:57:43.400 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 kstore 2024-09-12T00:57:43.400 INFO:tasks.workunit.client.0.smithi070.stderr: 4/ 5 rocksdb 2024-09-12T00:57:43.400 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 fuse 2024-09-12T00:57:43.400 INFO:tasks.workunit.client.0.smithi070.stderr: 2/ 5 mgr 2024-09-12T00:57:43.400 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mgrc 2024-09-12T00:57:43.400 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 dpdk 2024-09-12T00:57:43.400 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 eventtrace 2024-09-12T00:57:43.400 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 prioritycache 2024-09-12T00:57:43.400 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 test 2024-09-12T00:57:43.401 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:57:43.401 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephsqlite 2024-09-12T00:57:43.401 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:57:43.401 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore 2024-09-12T00:57:43.401 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_onode 2024-09-12T00:57:43.401 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_odata 2024-09-12T00:57:43.401 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_omap 2024-09-12T00:57:43.401 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_tm 2024-09-12T00:57:43.401 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_t 2024-09-12T00:57:43.401 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:57:43.401 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_epm 2024-09-12T00:57:43.401 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_lba 2024-09-12T00:57:43.401 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:57:43.401 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cache 2024-09-12T00:57:43.402 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_journal 2024-09-12T00:57:43.402 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_device 2024-09-12T00:57:43.402 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_backref 2024-09-12T00:57:43.402 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 alienstore 2024-09-12T00:57:43.402 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mclock 2024-09-12T00:57:43.402 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cyanstore 2024-09-12T00:57:43.402 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 ceph_exporter 2024-09-12T00:57:43.402 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 memstore 2024-09-12T00:57:43.402 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 trace 2024-09-12T00:57:43.402 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 ceph_dedup 2024-09-12T00:57:43.402 INFO:tasks.workunit.client.0.smithi070.stderr: -2/-2 (syslog threshold) 2024-09-12T00:57:43.402 INFO:tasks.workunit.client.0.smithi070.stderr: 99/99 (stderr threshold) 2024-09-12T00:57:43.402 INFO:tasks.workunit.client.0.smithi070.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:57:43.402 INFO:tasks.workunit.client.0.smithi070.stderr: 7f72c37fe640 / http_manager 2024-09-12T00:57:43.403 INFO:tasks.workunit.client.0.smithi070.stderr: 7f7351fdb640 / http_manager 2024-09-12T00:57:43.403 INFO:tasks.workunit.client.0.smithi070.stderr: 7f7352fdd640 / rgw_dt_lg_renew 2024-09-12T00:57:43.403 INFO:tasks.workunit.client.0.smithi070.stderr: 7f7371ffb640 / ms_dispatch 2024-09-12T00:57:43.403 INFO:tasks.workunit.client.0.smithi070.stderr: 7f73737fe640 / io_context_pool 2024-09-12T00:57:43.403 INFO:tasks.workunit.client.0.smithi070.stderr: 7f7381ffb640 / ms_dispatch 2024-09-12T00:57:43.403 INFO:tasks.workunit.client.0.smithi070.stderr: 7f7388e09640 / ms_dispatch 2024-09-12T00:57:43.403 INFO:tasks.workunit.client.0.smithi070.stderr: 7f738a60c640 / io_context_pool 2024-09-12T00:57:43.403 INFO:tasks.workunit.client.0.smithi070.stderr: 7f749bcb6640 / msgr-worker-2 2024-09-12T00:57:43.403 INFO:tasks.workunit.client.0.smithi070.stderr: 7f749c4b7640 / msgr-worker-1 2024-09-12T00:57:43.403 INFO:tasks.workunit.client.0.smithi070.stderr: 7f749ccb8640 / msgr-worker-0 2024-09-12T00:57:43.403 INFO:tasks.workunit.client.0.smithi070.stderr: 7f749d4b9640 / io_context_pool 2024-09-12T00:57:43.403 INFO:tasks.workunit.client.0.smithi070.stderr: 7f749e9b19c0 / radosgw-admin 2024-09-12T00:57:43.404 INFO:tasks.workunit.client.0.smithi070.stderr: max_recent 500 2024-09-12T00:57:43.404 INFO:tasks.workunit.client.0.smithi070.stderr: max_new 1000 2024-09-12T00:57:43.404 INFO:tasks.workunit.client.0.smithi070.stderr: log_file /var/log/ceph/ceph-client.admin.126799.log 2024-09-12T00:57:43.404 INFO:tasks.workunit.client.0.smithi070.stderr:--- end dump of recent events --- 2024-09-12T00:57:43.404 INFO:tasks.workunit.client.0.smithi070.stderr:--- begin dump of recent events --- 2024-09-12T00:57:43.404 INFO:tasks.workunit.client.0.smithi070.stderr: -499> 2024-09-12T00:57:43.234+0000 7f749c4b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:43.404 INFO:tasks.workunit.client.0.smithi070.stderr: -498> 2024-09-12T00:57:43.234+0000 7f749c4b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:43.404 INFO:tasks.workunit.client.0.smithi070.stderr: -497> 2024-09-12T00:57:43.234+0000 7f749c4b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:43.404 INFO:tasks.workunit.client.0.smithi070.stderr: -496> 2024-09-12T00:57:43.234+0000 7f749bcb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:43.404 INFO:tasks.workunit.client.0.smithi070.stderr: -495> 2024-09-12T00:57:43.234+0000 7f749bcb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:43.404 INFO:tasks.workunit.client.0.smithi070.stderr: -494> 2024-09-12T00:57:43.234+0000 7f749bcb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:43.404 INFO:tasks.workunit.client.0.smithi070.stderr: -493> 2024-09-12T00:57:43.234+0000 7f749c4b7640 10 monclient(hunting): handle_auth_done global_id 7791 payload 274 2024-09-12T00:57:43.404 INFO:tasks.workunit.client.0.smithi070.stderr: -492> 2024-09-12T00:57:43.234+0000 7f749c4b7640 10 monclient: _finish_hunting 0 2024-09-12T00:57:43.405 INFO:tasks.workunit.client.0.smithi070.stderr: -491> 2024-09-12T00:57:43.234+0000 7f749c4b7640 1 monclient: found mon.noname-a 2024-09-12T00:57:43.405 INFO:tasks.workunit.client.0.smithi070.stderr: -490> 2024-09-12T00:57:43.234+0000 7f749c4b7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:57:43.405 INFO:tasks.workunit.client.0.smithi070.stderr: -489> 2024-09-12T00:57:43.234+0000 7f749ccb8640 10 monclient: get_auth_request con 0x5555cc2271c0 auth_method 0 2024-09-12T00:57:43.405 INFO:tasks.workunit.client.0.smithi070.stderr: -488> 2024-09-12T00:57:43.234+0000 7f738a60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:43.405 INFO:tasks.workunit.client.0.smithi070.stderr: -487> 2024-09-12T00:57:43.234+0000 7f738a60c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:57:43.405 INFO:tasks.workunit.client.0.smithi070.stderr: -486> 2024-09-12T00:57:43.234+0000 7f738a60c640 10 monclient: dump: 2024-09-12T00:57:43.405 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:43.405 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:43.405 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.405 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.405 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:43.405 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.405 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:43.406 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:43.406 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:43.406 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.406 INFO:tasks.workunit.client.0.smithi070.stderr: -485> 2024-09-12T00:57:43.234+0000 7f738a60c640 10 monclient: _finish_auth 0 2024-09-12T00:57:43.406 INFO:tasks.workunit.client.0.smithi070.stderr: -484> 2024-09-12T00:57:43.234+0000 7f738a60c640 10 monclient: _check_auth_tickets 2024-09-12T00:57:43.406 INFO:tasks.workunit.client.0.smithi070.stderr: -483> 2024-09-12T00:57:43.234+0000 7f738a60c640 10 monclient: handle_config config(0 keys) 2024-09-12T00:57:43.406 INFO:tasks.workunit.client.0.smithi070.stderr: -482> 2024-09-12T00:57:43.234+0000 7f738a60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:43.406 INFO:tasks.workunit.client.0.smithi070.stderr: -481> 2024-09-12T00:57:43.234+0000 7f738a60c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:57:43.406 INFO:tasks.workunit.client.0.smithi070.stderr: -480> 2024-09-12T00:57:43.234+0000 7f738a60c640 10 monclient: dump: 2024-09-12T00:57:43.406 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:43.406 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:43.406 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.406 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.406 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:43.407 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.407 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:43.407 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:43.407 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:43.407 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.407 INFO:tasks.workunit.client.0.smithi070.stderr: -479> 2024-09-12T00:57:43.234+0000 7f749e9b19c0 5 monclient: authenticate success, global_id 7791 2024-09-12T00:57:43.407 INFO:tasks.workunit.client.0.smithi070.stderr: -478> 2024-09-12T00:57:43.234+0000 7f749e9b19c0 10 monclient: get_monmap_and_config success 2024-09-12T00:57:43.407 INFO:tasks.workunit.client.0.smithi070.stderr: -477> 2024-09-12T00:57:43.234+0000 7f749e9b19c0 4 set_mon_vals no callback set 2024-09-12T00:57:43.407 INFO:tasks.workunit.client.0.smithi070.stderr: -476> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient: shutdown 2024-09-12T00:57:43.407 INFO:tasks.workunit.client.0.smithi070.stderr: -475> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) unregister_commands rotate-key 2024-09-12T00:57:43.407 INFO:tasks.workunit.client.0.smithi070.stderr: -474> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient: build_initial_monmap 2024-09-12T00:57:43.407 INFO:tasks.workunit.client.0.smithi070.stderr: -473> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 1 build_initial for_mkfs: 0 2024-09-12T00:57:43.407 INFO:tasks.workunit.client.0.smithi070.stderr: -472> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient: monmap: 2024-09-12T00:57:43.407 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:57:43.408 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:57:43.408 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:57:43.408 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:57:43.408 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:57:43.408 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.408 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:57:43.408 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:57:43.408 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:57:43.408 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.408 INFO:tasks.workunit.client.0.smithi070.stderr: -471> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding auth protocol: cephx 2024-09-12T00:57:43.408 INFO:tasks.workunit.client.0.smithi070.stderr: -470> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding auth protocol: cephx 2024-09-12T00:57:43.408 INFO:tasks.workunit.client.0.smithi070.stderr: -469> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding auth protocol: cephx 2024-09-12T00:57:43.408 INFO:tasks.workunit.client.0.smithi070.stderr: -468> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding con mode: secure 2024-09-12T00:57:43.409 INFO:tasks.workunit.client.0.smithi070.stderr: -467> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding con mode: crc 2024-09-12T00:57:43.409 INFO:tasks.workunit.client.0.smithi070.stderr: -466> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding con mode: secure 2024-09-12T00:57:43.409 INFO:tasks.workunit.client.0.smithi070.stderr: -465> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding con mode: crc 2024-09-12T00:57:43.409 INFO:tasks.workunit.client.0.smithi070.stderr: -464> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding con mode: secure 2024-09-12T00:57:43.409 INFO:tasks.workunit.client.0.smithi070.stderr: -463> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding con mode: crc 2024-09-12T00:57:43.409 INFO:tasks.workunit.client.0.smithi070.stderr: -462> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding con mode: crc 2024-09-12T00:57:43.409 INFO:tasks.workunit.client.0.smithi070.stderr: -461> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding con mode: secure 2024-09-12T00:57:43.409 INFO:tasks.workunit.client.0.smithi070.stderr: -460> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding con mode: crc 2024-09-12T00:57:43.409 INFO:tasks.workunit.client.0.smithi070.stderr: -459> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding con mode: secure 2024-09-12T00:57:43.409 INFO:tasks.workunit.client.0.smithi070.stderr: -458> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding con mode: crc 2024-09-12T00:57:43.409 INFO:tasks.workunit.client.0.smithi070.stderr: -457> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2261d0) adding con mode: secure 2024-09-12T00:57:43.409 INFO:tasks.workunit.client.0.smithi070.stderr: -456> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:43.410 INFO:tasks.workunit.client.0.smithi070.stderr: -455> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 1 librados: starting msgr at 2024-09-12T00:57:43.410 INFO:tasks.workunit.client.0.smithi070.stderr: -454> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 1 librados: starting objecter 2024-09-12T00:57:43.410 INFO:tasks.workunit.client.0.smithi070.stderr: -453> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command objecter_requests hook 0x5555cc0da430 2024-09-12T00:57:43.410 INFO:tasks.workunit.client.0.smithi070.stderr: -452> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 1 librados: setting wanted keys 2024-09-12T00:57:43.410 INFO:tasks.workunit.client.0.smithi070.stderr: -451> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 1 librados: calling monclient init 2024-09-12T00:57:43.410 INFO:tasks.workunit.client.0.smithi070.stderr: -450> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient: init 2024-09-12T00:57:43.410 INFO:tasks.workunit.client.0.smithi070.stderr: -449> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding auth protocol: cephx 2024-09-12T00:57:43.410 INFO:tasks.workunit.client.0.smithi070.stderr: -448> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding auth protocol: cephx 2024-09-12T00:57:43.410 INFO:tasks.workunit.client.0.smithi070.stderr: -447> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding auth protocol: cephx 2024-09-12T00:57:43.410 INFO:tasks.workunit.client.0.smithi070.stderr: -446> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding con mode: secure 2024-09-12T00:57:43.410 INFO:tasks.workunit.client.0.smithi070.stderr: -445> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding con mode: crc 2024-09-12T00:57:43.410 INFO:tasks.workunit.client.0.smithi070.stderr: -444> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding con mode: secure 2024-09-12T00:57:43.410 INFO:tasks.workunit.client.0.smithi070.stderr: -443> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding con mode: crc 2024-09-12T00:57:43.410 INFO:tasks.workunit.client.0.smithi070.stderr: -442> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding con mode: secure 2024-09-12T00:57:43.411 INFO:tasks.workunit.client.0.smithi070.stderr: -441> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding con mode: crc 2024-09-12T00:57:43.411 INFO:tasks.workunit.client.0.smithi070.stderr: -440> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding con mode: crc 2024-09-12T00:57:43.411 INFO:tasks.workunit.client.0.smithi070.stderr: -439> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding con mode: secure 2024-09-12T00:57:43.411 INFO:tasks.workunit.client.0.smithi070.stderr: -438> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding con mode: crc 2024-09-12T00:57:43.411 INFO:tasks.workunit.client.0.smithi070.stderr: -437> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding con mode: secure 2024-09-12T00:57:43.411 INFO:tasks.workunit.client.0.smithi070.stderr: -436> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding con mode: crc 2024-09-12T00:57:43.411 INFO:tasks.workunit.client.0.smithi070.stderr: -435> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc220c80) adding con mode: secure 2024-09-12T00:57:43.411 INFO:tasks.workunit.client.0.smithi070.stderr: -434> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:43.411 INFO:tasks.workunit.client.0.smithi070.stderr: -433> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:43.411 INFO:tasks.workunit.client.0.smithi070.stderr: -432> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command rotate-key hook 0x5555cc220dc8 2024-09-12T00:57:43.411 INFO:tasks.workunit.client.0.smithi070.stderr: -431> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient: _reopen_session rank -1 2024-09-12T00:57:43.411 INFO:tasks.workunit.client.0.smithi070.stderr: -430> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:57:43.411 INFO:tasks.workunit.client.0.smithi070.stderr: -429> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient(hunting): picked mon.noname-b con 0x5555cc0d14f0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:57:43.412 INFO:tasks.workunit.client.0.smithi070.stderr: -428> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient(hunting): picked mon.noname-a con 0x5555cc0e02e0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:57:43.412 INFO:tasks.workunit.client.0.smithi070.stderr: -427> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient(hunting): picked mon.noname-c con 0x5555cc2271c0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:57:43.412 INFO:tasks.workunit.client.0.smithi070.stderr: -426> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:43.412 INFO:tasks.workunit.client.0.smithi070.stderr: -425> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:43.412 INFO:tasks.workunit.client.0.smithi070.stderr: -424> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:43.412 INFO:tasks.workunit.client.0.smithi070.stderr: -423> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient(hunting): _renew_subs 2024-09-12T00:57:43.412 INFO:tasks.workunit.client.0.smithi070.stderr: -422> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient(hunting): authenticate will time out at 2313.689906s 2024-09-12T00:57:43.412 INFO:tasks.workunit.client.0.smithi070.stderr: -421> 2024-09-12T00:57:43.238+0000 7f749bcb6640 10 monclient(hunting): get_auth_request con 0x5555cc0e02e0 auth_method 0 2024-09-12T00:57:43.412 INFO:tasks.workunit.client.0.smithi070.stderr: -420> 2024-09-12T00:57:43.238+0000 7f749bcb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:43.412 INFO:tasks.workunit.client.0.smithi070.stderr: -419> 2024-09-12T00:57:43.238+0000 7f749bcb6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:43.412 INFO:tasks.workunit.client.0.smithi070.stderr: -418> 2024-09-12T00:57:43.238+0000 7f749bcb6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:43.412 INFO:tasks.workunit.client.0.smithi070.stderr: -417> 2024-09-12T00:57:43.238+0000 7f749ccb8640 10 monclient(hunting): get_auth_request con 0x5555cc2271c0 auth_method 0 2024-09-12T00:57:43.413 INFO:tasks.workunit.client.0.smithi070.stderr: -416> 2024-09-12T00:57:43.238+0000 7f749ccb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:43.413 INFO:tasks.workunit.client.0.smithi070.stderr: -415> 2024-09-12T00:57:43.238+0000 7f749ccb8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:43.413 INFO:tasks.workunit.client.0.smithi070.stderr: -414> 2024-09-12T00:57:43.238+0000 7f749ccb8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:43.413 INFO:tasks.workunit.client.0.smithi070.stderr: -413> 2024-09-12T00:57:43.238+0000 7f749bcb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:43.413 INFO:tasks.workunit.client.0.smithi070.stderr: -412> 2024-09-12T00:57:43.238+0000 7f749bcb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:43.413 INFO:tasks.workunit.client.0.smithi070.stderr: -411> 2024-09-12T00:57:43.238+0000 7f749bcb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:43.413 INFO:tasks.workunit.client.0.smithi070.stderr: -410> 2024-09-12T00:57:43.238+0000 7f749ccb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:43.413 INFO:tasks.workunit.client.0.smithi070.stderr: -409> 2024-09-12T00:57:43.238+0000 7f749ccb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:43.413 INFO:tasks.workunit.client.0.smithi070.stderr: -408> 2024-09-12T00:57:43.238+0000 7f749ccb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:43.413 INFO:tasks.workunit.client.0.smithi070.stderr: -407> 2024-09-12T00:57:43.238+0000 7f749bcb6640 10 monclient(hunting): handle_auth_done global_id 7794 payload 824 2024-09-12T00:57:43.413 INFO:tasks.workunit.client.0.smithi070.stderr: -406> 2024-09-12T00:57:43.238+0000 7f749bcb6640 10 monclient: _finish_hunting 0 2024-09-12T00:57:43.414 INFO:tasks.workunit.client.0.smithi070.stderr: -405> 2024-09-12T00:57:43.238+0000 7f749bcb6640 1 monclient: found mon.noname-a 2024-09-12T00:57:43.414 INFO:tasks.workunit.client.0.smithi070.stderr: -404> 2024-09-12T00:57:43.238+0000 7f749bcb6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:57:43.414 INFO:tasks.workunit.client.0.smithi070.stderr: -403> 2024-09-12T00:57:43.238+0000 7f7388e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:43.414 INFO:tasks.workunit.client.0.smithi070.stderr: -402> 2024-09-12T00:57:43.238+0000 7f7388e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:57:43.414 INFO:tasks.workunit.client.0.smithi070.stderr: -401> 2024-09-12T00:57:43.238+0000 7f7388e09640 10 monclient: dump: 2024-09-12T00:57:43.414 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:43.414 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:43.414 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.414 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.414 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:43.414 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.414 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:43.414 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:43.414 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:43.415 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.415 INFO:tasks.workunit.client.0.smithi070.stderr: -400> 2024-09-12T00:57:43.238+0000 7f7388e09640 10 monclient: _finish_auth 0 2024-09-12T00:57:43.415 INFO:tasks.workunit.client.0.smithi070.stderr: -399> 2024-09-12T00:57:43.238+0000 7f7388e09640 10 monclient: _check_auth_tickets 2024-09-12T00:57:43.415 INFO:tasks.workunit.client.0.smithi070.stderr: -398> 2024-09-12T00:57:43.238+0000 7f7388e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:57:43.415 INFO:tasks.workunit.client.0.smithi070.stderr: -397> 2024-09-12T00:57:43.238+0000 7f7388e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:43.415 INFO:tasks.workunit.client.0.smithi070.stderr: -396> 2024-09-12T00:57:43.238+0000 7f7388e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:57:43.415 INFO:tasks.workunit.client.0.smithi070.stderr: -395> 2024-09-12T00:57:43.238+0000 7f7388e09640 10 monclient: dump: 2024-09-12T00:57:43.415 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:43.415 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:43.415 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.415 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.415 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:43.415 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.415 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:43.416 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:43.416 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:43.416 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.416 INFO:tasks.workunit.client.0.smithi070.stderr: -394> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 5 monclient: authenticate success, global_id 7794 2024-09-12T00:57:43.416 INFO:tasks.workunit.client.0.smithi070.stderr: -393> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient: _renew_subs 2024-09-12T00:57:43.416 INFO:tasks.workunit.client.0.smithi070.stderr: -392> 2024-09-12T00:57:43.238+0000 7f738a60c640 4 set_mon_vals no callback set 2024-09-12T00:57:43.416 INFO:tasks.workunit.client.0.smithi070.stderr: -391> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:57:43.416 INFO:tasks.workunit.client.0.smithi070.stderr: -390> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient: _renew_subs 2024-09-12T00:57:43.416 INFO:tasks.workunit.client.0.smithi070.stderr: -389> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:57:43.416 INFO:tasks.workunit.client.0.smithi070.stderr: -388> 2024-09-12T00:57:43.238+0000 7f749e9b19c0 1 librados: init done 2024-09-12T00:57:43.416 INFO:tasks.workunit.client.0.smithi070.stderr: -387> 2024-09-12T00:57:43.242+0000 7f7388e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:57:43.416 INFO:tasks.workunit.client.0.smithi070.stderr: -386> 2024-09-12T00:57:43.242+0000 7f7388e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:57:43.416 INFO:tasks.workunit.client.0.smithi070.stderr: -385> 2024-09-12T00:57:43.242+0000 7f7388e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:57:43.417 INFO:tasks.workunit.client.0.smithi070.stderr: -384> 2024-09-12T00:57:43.242+0000 7f749c4b7640 10 monclient: get_auth_request con 0x7f7384070ae0 auth_method 0 2024-09-12T00:57:43.417 INFO:tasks.workunit.client.0.smithi070.stderr: -383> 2024-09-12T00:57:43.242+0000 7f749ccb8640 10 monclient: get_auth_request con 0x5555cc262410 auth_method 0 2024-09-12T00:57:43.417 INFO:tasks.workunit.client.0.smithi070.stderr: -382> 2024-09-12T00:57:43.242+0000 7f749c4b7640 10 monclient: get_auth_request con 0x5555cc26b9a0 auth_method 0 2024-09-12T00:57:43.417 INFO:tasks.workunit.client.0.smithi070.stderr: -381> 2024-09-12T00:57:43.242+0000 7f749bcb6640 10 monclient: get_auth_request con 0x5555cc26fd00 auth_method 0 2024-09-12T00:57:43.417 INFO:tasks.workunit.client.0.smithi070.stderr: -380> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 10 monclient: build_initial_monmap 2024-09-12T00:57:43.417 INFO:tasks.workunit.client.0.smithi070.stderr: -379> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 1 build_initial for_mkfs: 0 2024-09-12T00:57:43.417 INFO:tasks.workunit.client.0.smithi070.stderr: -378> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 10 monclient: monmap: 2024-09-12T00:57:43.417 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:57:43.417 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:57:43.418 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:57:43.418 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:57:43.418 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:57:43.418 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.418 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:57:43.418 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:57:43.418 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:57:43.418 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.418 INFO:tasks.workunit.client.0.smithi070.stderr: -377> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding auth protocol: cephx 2024-09-12T00:57:43.418 INFO:tasks.workunit.client.0.smithi070.stderr: -376> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding auth protocol: cephx 2024-09-12T00:57:43.418 INFO:tasks.workunit.client.0.smithi070.stderr: -375> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding auth protocol: cephx 2024-09-12T00:57:43.418 INFO:tasks.workunit.client.0.smithi070.stderr: -374> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding con mode: secure 2024-09-12T00:57:43.419 INFO:tasks.workunit.client.0.smithi070.stderr: -373> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding con mode: crc 2024-09-12T00:57:43.419 INFO:tasks.workunit.client.0.smithi070.stderr: -372> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding con mode: secure 2024-09-12T00:57:43.419 INFO:tasks.workunit.client.0.smithi070.stderr: -371> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding con mode: crc 2024-09-12T00:57:43.419 INFO:tasks.workunit.client.0.smithi070.stderr: -370> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding con mode: secure 2024-09-12T00:57:43.419 INFO:tasks.workunit.client.0.smithi070.stderr: -369> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding con mode: crc 2024-09-12T00:57:43.419 INFO:tasks.workunit.client.0.smithi070.stderr: -368> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding con mode: crc 2024-09-12T00:57:43.419 INFO:tasks.workunit.client.0.smithi070.stderr: -367> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding con mode: secure 2024-09-12T00:57:43.419 INFO:tasks.workunit.client.0.smithi070.stderr: -366> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding con mode: crc 2024-09-12T00:57:43.419 INFO:tasks.workunit.client.0.smithi070.stderr: -365> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding con mode: secure 2024-09-12T00:57:43.419 INFO:tasks.workunit.client.0.smithi070.stderr: -364> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding con mode: crc 2024-09-12T00:57:43.419 INFO:tasks.workunit.client.0.smithi070.stderr: -363> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc274b10) adding con mode: secure 2024-09-12T00:57:43.419 INFO:tasks.workunit.client.0.smithi070.stderr: -362> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:43.419 INFO:tasks.workunit.client.0.smithi070.stderr: -361> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command objecter_requests cmddesc objecter_requests hook 0x5555cc2784e0 EEXIST 2024-09-12T00:57:43.420 INFO:tasks.workunit.client.0.smithi070.stderr: -360> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 10 monclient: init 2024-09-12T00:57:43.420 INFO:tasks.workunit.client.0.smithi070.stderr: -359> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding auth protocol: cephx 2024-09-12T00:57:43.420 INFO:tasks.workunit.client.0.smithi070.stderr: -358> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding auth protocol: cephx 2024-09-12T00:57:43.420 INFO:tasks.workunit.client.0.smithi070.stderr: -357> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding auth protocol: cephx 2024-09-12T00:57:43.420 INFO:tasks.workunit.client.0.smithi070.stderr: -356> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding con mode: secure 2024-09-12T00:57:43.420 INFO:tasks.workunit.client.0.smithi070.stderr: -355> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding con mode: crc 2024-09-12T00:57:43.420 INFO:tasks.workunit.client.0.smithi070.stderr: -354> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding con mode: secure 2024-09-12T00:57:43.420 INFO:tasks.workunit.client.0.smithi070.stderr: -353> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding con mode: crc 2024-09-12T00:57:43.420 INFO:tasks.workunit.client.0.smithi070.stderr: -352> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding con mode: secure 2024-09-12T00:57:43.420 INFO:tasks.workunit.client.0.smithi070.stderr: -351> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding con mode: crc 2024-09-12T00:57:43.420 INFO:tasks.workunit.client.0.smithi070.stderr: -350> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding con mode: crc 2024-09-12T00:57:43.420 INFO:tasks.workunit.client.0.smithi070.stderr: -349> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding con mode: secure 2024-09-12T00:57:43.420 INFO:tasks.workunit.client.0.smithi070.stderr: -348> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding con mode: crc 2024-09-12T00:57:43.421 INFO:tasks.workunit.client.0.smithi070.stderr: -347> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding con mode: secure 2024-09-12T00:57:43.421 INFO:tasks.workunit.client.0.smithi070.stderr: -346> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding con mode: crc 2024-09-12T00:57:43.421 INFO:tasks.workunit.client.0.smithi070.stderr: -345> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2731e8) adding con mode: secure 2024-09-12T00:57:43.421 INFO:tasks.workunit.client.0.smithi070.stderr: -344> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:43.421 INFO:tasks.workunit.client.0.smithi070.stderr: -343> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:43.421 INFO:tasks.workunit.client.0.smithi070.stderr: -342> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command rotate-key cmddesc rotate-key hook 0x5555cc273330 EEXIST 2024-09-12T00:57:43.421 INFO:tasks.workunit.client.0.smithi070.stderr: -341> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 10 monclient: _reopen_session rank -1 2024-09-12T00:57:43.421 INFO:tasks.workunit.client.0.smithi070.stderr: -340> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:57:43.421 INFO:tasks.workunit.client.0.smithi070.stderr: -339> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 10 monclient(hunting): picked mon.noname-c con 0x5555cc29c690 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:57:43.421 INFO:tasks.workunit.client.0.smithi070.stderr: -338> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 10 monclient(hunting): picked mon.noname-b con 0x5555cc29bfc0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:57:43.421 INFO:tasks.workunit.client.0.smithi070.stderr: -337> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 10 monclient(hunting): picked mon.noname-a con 0x5555cc29a9a0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:57:43.421 INFO:tasks.workunit.client.0.smithi070.stderr: -336> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:43.421 INFO:tasks.workunit.client.0.smithi070.stderr: -335> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:43.422 INFO:tasks.workunit.client.0.smithi070.stderr: -334> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:43.422 INFO:tasks.workunit.client.0.smithi070.stderr: -333> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 10 monclient(hunting): _renew_subs 2024-09-12T00:57:43.422 INFO:tasks.workunit.client.0.smithi070.stderr: -332> 2024-09-12T00:57:43.246+0000 7f749e9b19c0 10 monclient(hunting): authenticate will time out at 2313.698703s 2024-09-12T00:57:43.422 INFO:tasks.workunit.client.0.smithi070.stderr: -331> 2024-09-12T00:57:43.246+0000 7f749c4b7640 10 monclient(hunting): get_auth_request con 0x5555cc29c690 auth_method 0 2024-09-12T00:57:43.422 INFO:tasks.workunit.client.0.smithi070.stderr: -330> 2024-09-12T00:57:43.246+0000 7f749c4b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:43.422 INFO:tasks.workunit.client.0.smithi070.stderr: -329> 2024-09-12T00:57:43.246+0000 7f749c4b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:43.422 INFO:tasks.workunit.client.0.smithi070.stderr: -328> 2024-09-12T00:57:43.246+0000 7f749c4b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:43.422 INFO:tasks.workunit.client.0.smithi070.stderr: -327> 2024-09-12T00:57:43.246+0000 7f749ccb8640 10 monclient(hunting): get_auth_request con 0x5555cc29a9a0 auth_method 0 2024-09-12T00:57:43.422 INFO:tasks.workunit.client.0.smithi070.stderr: -326> 2024-09-12T00:57:43.246+0000 7f749ccb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:43.422 INFO:tasks.workunit.client.0.smithi070.stderr: -325> 2024-09-12T00:57:43.246+0000 7f749ccb8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:43.422 INFO:tasks.workunit.client.0.smithi070.stderr: -324> 2024-09-12T00:57:43.246+0000 7f749ccb8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:43.422 INFO:tasks.workunit.client.0.smithi070.stderr: -323> 2024-09-12T00:57:43.246+0000 7f749c4b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:43.423 INFO:tasks.workunit.client.0.smithi070.stderr: -322> 2024-09-12T00:57:43.246+0000 7f749c4b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:43.423 INFO:tasks.workunit.client.0.smithi070.stderr: -321> 2024-09-12T00:57:43.246+0000 7f749c4b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:43.423 INFO:tasks.workunit.client.0.smithi070.stderr: -320> 2024-09-12T00:57:43.246+0000 7f749ccb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:43.423 INFO:tasks.workunit.client.0.smithi070.stderr: -319> 2024-09-12T00:57:43.246+0000 7f749ccb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:43.423 INFO:tasks.workunit.client.0.smithi070.stderr: -318> 2024-09-12T00:57:43.246+0000 7f749ccb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:43.423 INFO:tasks.workunit.client.0.smithi070.stderr: -317> 2024-09-12T00:57:43.246+0000 7f749c4b7640 10 monclient(hunting): handle_auth_done global_id 7310 payload 824 2024-09-12T00:57:43.423 INFO:tasks.workunit.client.0.smithi070.stderr: -316> 2024-09-12T00:57:43.246+0000 7f749c4b7640 10 monclient: _finish_hunting 0 2024-09-12T00:57:43.423 INFO:tasks.workunit.client.0.smithi070.stderr: -315> 2024-09-12T00:57:43.246+0000 7f749c4b7640 1 monclient: found mon.noname-c 2024-09-12T00:57:43.423 INFO:tasks.workunit.client.0.smithi070.stderr: -314> 2024-09-12T00:57:43.246+0000 7f749c4b7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:57:43.423 INFO:tasks.workunit.client.0.smithi070.stderr: -313> 2024-09-12T00:57:43.246+0000 7f7381ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:43.423 INFO:tasks.workunit.client.0.smithi070.stderr: -312> 2024-09-12T00:57:43.246+0000 7f7381ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:57:43.423 INFO:tasks.workunit.client.0.smithi070.stderr: -311> 2024-09-12T00:57:43.246+0000 7f7381ffb640 10 monclient: dump: 2024-09-12T00:57:43.423 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:43.423 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:43.424 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.424 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.424 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:43.424 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.424 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:43.424 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:43.424 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:43.424 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.424 INFO:tasks.workunit.client.0.smithi070.stderr: -310> 2024-09-12T00:57:43.246+0000 7f7381ffb640 10 monclient: _finish_auth 0 2024-09-12T00:57:43.424 INFO:tasks.workunit.client.0.smithi070.stderr: -309> 2024-09-12T00:57:43.246+0000 7f7381ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:57:43.424 INFO:tasks.workunit.client.0.smithi070.stderr: -308> 2024-09-12T00:57:43.246+0000 7f7381ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:57:43.425 INFO:tasks.workunit.client.0.smithi070.stderr: -307> 2024-09-12T00:57:43.246+0000 7f7381ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:43.425 INFO:tasks.workunit.client.0.smithi070.stderr: -306> 2024-09-12T00:57:43.246+0000 7f7381ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:57:43.425 INFO:tasks.workunit.client.0.smithi070.stderr: -305> 2024-09-12T00:57:43.246+0000 7f7381ffb640 10 monclient: dump: 2024-09-12T00:57:43.425 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:43.425 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:43.425 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.425 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.425 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:43.425 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.425 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:43.425 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:43.425 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:43.425 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.425 INFO:tasks.workunit.client.0.smithi070.stderr: -304> 2024-09-12T00:57:43.246+0000 7f749d4b9640 4 set_mon_vals no callback set 2024-09-12T00:57:43.426 INFO:tasks.workunit.client.0.smithi070.stderr: -303> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 monclient: authenticate success, global_id 7310 2024-09-12T00:57:43.426 INFO:tasks.workunit.client.0.smithi070.stderr: -302> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient: _renew_subs 2024-09-12T00:57:43.426 INFO:tasks.workunit.client.0.smithi070.stderr: -301> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:57:43.426 INFO:tasks.workunit.client.0.smithi070.stderr: -300> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient: _renew_subs 2024-09-12T00:57:43.426 INFO:tasks.workunit.client.0.smithi070.stderr: -299> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:57:43.426 INFO:tasks.workunit.client.0.smithi070.stderr: -298> 2024-09-12T00:57:43.250+0000 7f7381ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:57:43.426 INFO:tasks.workunit.client.0.smithi070.stderr: -297> 2024-09-12T00:57:43.250+0000 7f7381ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:57:43.426 INFO:tasks.workunit.client.0.smithi070.stderr: -296> 2024-09-12T00:57:43.250+0000 7f7381ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:57:43.426 INFO:tasks.workunit.client.0.smithi070.stderr: -295> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient: get_monmap_and_config 2024-09-12T00:57:43.426 INFO:tasks.workunit.client.0.smithi070.stderr: -294> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient: build_initial_monmap 2024-09-12T00:57:43.426 INFO:tasks.workunit.client.0.smithi070.stderr: -293> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 1 build_initial for_mkfs: 0 2024-09-12T00:57:43.426 INFO:tasks.workunit.client.0.smithi070.stderr: -292> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient: monmap: 2024-09-12T00:57:43.426 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:57:43.426 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:57:43.427 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:57:43.427 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:57:43.427 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:57:43.427 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.427 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:57:43.427 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:57:43.427 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:57:43.427 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.427 INFO:tasks.workunit.client.0.smithi070.stderr: -291> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding auth protocol: cephx 2024-09-12T00:57:43.427 INFO:tasks.workunit.client.0.smithi070.stderr: -290> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding auth protocol: cephx 2024-09-12T00:57:43.427 INFO:tasks.workunit.client.0.smithi070.stderr: -289> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding auth protocol: cephx 2024-09-12T00:57:43.427 INFO:tasks.workunit.client.0.smithi070.stderr: -288> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding con mode: secure 2024-09-12T00:57:43.427 INFO:tasks.workunit.client.0.smithi070.stderr: -287> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding con mode: crc 2024-09-12T00:57:43.427 INFO:tasks.workunit.client.0.smithi070.stderr: -286> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding con mode: secure 2024-09-12T00:57:43.428 INFO:tasks.workunit.client.0.smithi070.stderr: -285> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding con mode: crc 2024-09-12T00:57:43.428 INFO:tasks.workunit.client.0.smithi070.stderr: -284> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding con mode: secure 2024-09-12T00:57:43.428 INFO:tasks.workunit.client.0.smithi070.stderr: -283> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding con mode: crc 2024-09-12T00:57:43.428 INFO:tasks.workunit.client.0.smithi070.stderr: -282> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding con mode: crc 2024-09-12T00:57:43.428 INFO:tasks.workunit.client.0.smithi070.stderr: -281> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding con mode: secure 2024-09-12T00:57:43.428 INFO:tasks.workunit.client.0.smithi070.stderr: -280> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding con mode: crc 2024-09-12T00:57:43.428 INFO:tasks.workunit.client.0.smithi070.stderr: -279> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding con mode: secure 2024-09-12T00:57:43.429 INFO:tasks.workunit.client.0.smithi070.stderr: -278> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding con mode: crc 2024-09-12T00:57:43.429 INFO:tasks.workunit.client.0.smithi070.stderr: -277> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2bbee0) adding con mode: secure 2024-09-12T00:57:43.429 INFO:tasks.workunit.client.0.smithi070.stderr: -276> 2024-09-12T00:57:43.250+0000 7f749bcb6640 10 monclient: get_auth_request con 0x7f7374070a20 auth_method 0 2024-09-12T00:57:43.429 INFO:tasks.workunit.client.0.smithi070.stderr: -275> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:43.429 INFO:tasks.workunit.client.0.smithi070.stderr: -274> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient: init 2024-09-12T00:57:43.429 INFO:tasks.workunit.client.0.smithi070.stderr: -273> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding auth protocol: cephx 2024-09-12T00:57:43.429 INFO:tasks.workunit.client.0.smithi070.stderr: -272> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding auth protocol: cephx 2024-09-12T00:57:43.429 INFO:tasks.workunit.client.0.smithi070.stderr: -271> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding auth protocol: cephx 2024-09-12T00:57:43.429 INFO:tasks.workunit.client.0.smithi070.stderr: -270> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding con mode: secure 2024-09-12T00:57:43.429 INFO:tasks.workunit.client.0.smithi070.stderr: -269> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding con mode: crc 2024-09-12T00:57:43.429 INFO:tasks.workunit.client.0.smithi070.stderr: -268> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding con mode: secure 2024-09-12T00:57:43.430 INFO:tasks.workunit.client.0.smithi070.stderr: -267> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding con mode: crc 2024-09-12T00:57:43.430 INFO:tasks.workunit.client.0.smithi070.stderr: -266> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding con mode: secure 2024-09-12T00:57:43.430 INFO:tasks.workunit.client.0.smithi070.stderr: -265> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding con mode: crc 2024-09-12T00:57:43.430 INFO:tasks.workunit.client.0.smithi070.stderr: -264> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding con mode: crc 2024-09-12T00:57:43.430 INFO:tasks.workunit.client.0.smithi070.stderr: -263> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding con mode: secure 2024-09-12T00:57:43.430 INFO:tasks.workunit.client.0.smithi070.stderr: -262> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding con mode: crc 2024-09-12T00:57:43.430 INFO:tasks.workunit.client.0.smithi070.stderr: -261> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding con mode: secure 2024-09-12T00:57:43.430 INFO:tasks.workunit.client.0.smithi070.stderr: -260> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding con mode: crc 2024-09-12T00:57:43.430 INFO:tasks.workunit.client.0.smithi070.stderr: -259> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce050) adding con mode: secure 2024-09-12T00:57:43.430 INFO:tasks.workunit.client.0.smithi070.stderr: -258> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:43.430 INFO:tasks.workunit.client.0.smithi070.stderr: -257> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:43.430 INFO:tasks.workunit.client.0.smithi070.stderr: -256> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command rotate-key cmddesc rotate-key hook 0x7ffdbc2ce198 EEXIST 2024-09-12T00:57:43.431 INFO:tasks.workunit.client.0.smithi070.stderr: -255> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient: _reopen_session rank -1 2024-09-12T00:57:43.431 INFO:tasks.workunit.client.0.smithi070.stderr: -254> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:57:43.431 INFO:tasks.workunit.client.0.smithi070.stderr: -253> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient(hunting): picked mon.noname-a con 0x5555cc2f0440 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:57:43.431 INFO:tasks.workunit.client.0.smithi070.stderr: -252> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient(hunting): picked mon.noname-b con 0x5555cc2eb830 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:57:43.431 INFO:tasks.workunit.client.0.smithi070.stderr: -251> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient(hunting): picked mon.noname-c con 0x5555cc2e1f30 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:57:43.431 INFO:tasks.workunit.client.0.smithi070.stderr: -250> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:43.431 INFO:tasks.workunit.client.0.smithi070.stderr: -249> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:43.431 INFO:tasks.workunit.client.0.smithi070.stderr: -248> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:43.431 INFO:tasks.workunit.client.0.smithi070.stderr: -247> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient(hunting): _renew_subs 2024-09-12T00:57:43.431 INFO:tasks.workunit.client.0.smithi070.stderr: -246> 2024-09-12T00:57:43.250+0000 7f749e9b19c0 10 monclient(hunting): authenticate will time out at 2313.703376s 2024-09-12T00:57:43.431 INFO:tasks.workunit.client.0.smithi070.stderr: -245> 2024-09-12T00:57:43.250+0000 7f749ccb8640 10 monclient(hunting): get_auth_request con 0x5555cc2e1f30 auth_method 0 2024-09-12T00:57:43.431 INFO:tasks.workunit.client.0.smithi070.stderr: -244> 2024-09-12T00:57:43.250+0000 7f749ccb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:43.431 INFO:tasks.workunit.client.0.smithi070.stderr: -243> 2024-09-12T00:57:43.250+0000 7f749ccb8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:43.432 INFO:tasks.workunit.client.0.smithi070.stderr: -242> 2024-09-12T00:57:43.250+0000 7f749ccb8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:43.432 INFO:tasks.workunit.client.0.smithi070.stderr: -241> 2024-09-12T00:57:43.250+0000 7f749c4b7640 10 monclient(hunting): get_auth_request con 0x5555cc2f0440 auth_method 0 2024-09-12T00:57:43.432 INFO:tasks.workunit.client.0.smithi070.stderr: -240> 2024-09-12T00:57:43.250+0000 7f749c4b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:43.432 INFO:tasks.workunit.client.0.smithi070.stderr: -239> 2024-09-12T00:57:43.250+0000 7f749c4b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:43.432 INFO:tasks.workunit.client.0.smithi070.stderr: -238> 2024-09-12T00:57:43.250+0000 7f749c4b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:43.432 INFO:tasks.workunit.client.0.smithi070.stderr: -237> 2024-09-12T00:57:43.250+0000 7f749c4b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:43.432 INFO:tasks.workunit.client.0.smithi070.stderr: -236> 2024-09-12T00:57:43.250+0000 7f749c4b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:43.432 INFO:tasks.workunit.client.0.smithi070.stderr: -235> 2024-09-12T00:57:43.250+0000 7f749c4b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:43.432 INFO:tasks.workunit.client.0.smithi070.stderr: -234> 2024-09-12T00:57:43.250+0000 7f749ccb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:43.432 INFO:tasks.workunit.client.0.smithi070.stderr: -233> 2024-09-12T00:57:43.250+0000 7f749ccb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:43.432 INFO:tasks.workunit.client.0.smithi070.stderr: -232> 2024-09-12T00:57:43.250+0000 7f749ccb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:43.432 INFO:tasks.workunit.client.0.smithi070.stderr: -231> 2024-09-12T00:57:43.250+0000 7f749c4b7640 10 monclient(hunting): handle_auth_done global_id 7800 payload 274 2024-09-12T00:57:43.432 INFO:tasks.workunit.client.0.smithi070.stderr: -230> 2024-09-12T00:57:43.250+0000 7f749c4b7640 10 monclient: _finish_hunting 0 2024-09-12T00:57:43.433 INFO:tasks.workunit.client.0.smithi070.stderr: -229> 2024-09-12T00:57:43.250+0000 7f749c4b7640 1 monclient: found mon.noname-a 2024-09-12T00:57:43.433 INFO:tasks.workunit.client.0.smithi070.stderr: -228> 2024-09-12T00:57:43.250+0000 7f749c4b7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:57:43.433 INFO:tasks.workunit.client.0.smithi070.stderr: -227> 2024-09-12T00:57:43.254+0000 7f73737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:43.433 INFO:tasks.workunit.client.0.smithi070.stderr: -226> 2024-09-12T00:57:43.254+0000 7f73737fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:57:43.433 INFO:tasks.workunit.client.0.smithi070.stderr: -225> 2024-09-12T00:57:43.254+0000 7f73737fe640 10 monclient: dump: 2024-09-12T00:57:43.433 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:43.433 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:43.433 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.433 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.433 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:43.433 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.433 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:43.433 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:43.434 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:43.434 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.434 INFO:tasks.workunit.client.0.smithi070.stderr: -224> 2024-09-12T00:57:43.254+0000 7f73737fe640 10 monclient: _finish_auth 0 2024-09-12T00:57:43.434 INFO:tasks.workunit.client.0.smithi070.stderr: -223> 2024-09-12T00:57:43.254+0000 7f73737fe640 10 monclient: _check_auth_tickets 2024-09-12T00:57:43.434 INFO:tasks.workunit.client.0.smithi070.stderr: -222> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 monclient: authenticate success, global_id 7800 2024-09-12T00:57:43.434 INFO:tasks.workunit.client.0.smithi070.stderr: -221> 2024-09-12T00:57:43.254+0000 7f73737fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:57:43.434 INFO:tasks.workunit.client.0.smithi070.stderr: -220> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient: get_monmap_and_config success 2024-09-12T00:57:43.434 INFO:tasks.workunit.client.0.smithi070.stderr: -219> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 4 set_mon_vals no callback set 2024-09-12T00:57:43.434 INFO:tasks.workunit.client.0.smithi070.stderr: -218> 2024-09-12T00:57:43.254+0000 7f73737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:43.434 INFO:tasks.workunit.client.0.smithi070.stderr: -217> 2024-09-12T00:57:43.254+0000 7f73737fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:57:43.434 INFO:tasks.workunit.client.0.smithi070.stderr: -216> 2024-09-12T00:57:43.254+0000 7f73737fe640 10 monclient: dump: 2024-09-12T00:57:43.434 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:43.434 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:43.434 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.435 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.435 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:43.435 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.435 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:43.435 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:43.435 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:43.435 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.435 INFO:tasks.workunit.client.0.smithi070.stderr: -215> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient: shutdown 2024-09-12T00:57:43.435 INFO:tasks.workunit.client.0.smithi070.stderr: -214> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient: build_initial_monmap 2024-09-12T00:57:43.435 INFO:tasks.workunit.client.0.smithi070.stderr: -213> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 1 build_initial for_mkfs: 0 2024-09-12T00:57:43.435 INFO:tasks.workunit.client.0.smithi070.stderr: -212> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient: monmap: 2024-09-12T00:57:43.435 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:57:43.435 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:57:43.435 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:57:43.436 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:57:43.436 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:57:43.436 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.436 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:57:43.436 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:57:43.436 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:57:43.436 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.436 INFO:tasks.workunit.client.0.smithi070.stderr: -211> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding auth protocol: cephx 2024-09-12T00:57:43.436 INFO:tasks.workunit.client.0.smithi070.stderr: -210> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding auth protocol: cephx 2024-09-12T00:57:43.436 INFO:tasks.workunit.client.0.smithi070.stderr: -209> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding auth protocol: cephx 2024-09-12T00:57:43.436 INFO:tasks.workunit.client.0.smithi070.stderr: -208> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding con mode: secure 2024-09-12T00:57:43.436 INFO:tasks.workunit.client.0.smithi070.stderr: -207> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding con mode: crc 2024-09-12T00:57:43.436 INFO:tasks.workunit.client.0.smithi070.stderr: -206> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding con mode: secure 2024-09-12T00:57:43.436 INFO:tasks.workunit.client.0.smithi070.stderr: -205> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding con mode: crc 2024-09-12T00:57:43.437 INFO:tasks.workunit.client.0.smithi070.stderr: -204> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding con mode: secure 2024-09-12T00:57:43.437 INFO:tasks.workunit.client.0.smithi070.stderr: -203> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding con mode: crc 2024-09-12T00:57:43.437 INFO:tasks.workunit.client.0.smithi070.stderr: -202> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding con mode: crc 2024-09-12T00:57:43.437 INFO:tasks.workunit.client.0.smithi070.stderr: -201> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding con mode: secure 2024-09-12T00:57:43.437 INFO:tasks.workunit.client.0.smithi070.stderr: -200> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding con mode: crc 2024-09-12T00:57:43.437 INFO:tasks.workunit.client.0.smithi070.stderr: -199> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding con mode: secure 2024-09-12T00:57:43.437 INFO:tasks.workunit.client.0.smithi070.stderr: -198> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding con mode: crc 2024-09-12T00:57:43.437 INFO:tasks.workunit.client.0.smithi070.stderr: -197> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc2e2480) adding con mode: secure 2024-09-12T00:57:43.437 INFO:tasks.workunit.client.0.smithi070.stderr: -196> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:43.437 INFO:tasks.workunit.client.0.smithi070.stderr: -195> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 1 librados: starting msgr at 2024-09-12T00:57:43.437 INFO:tasks.workunit.client.0.smithi070.stderr: -194> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 1 librados: starting objecter 2024-09-12T00:57:43.437 INFO:tasks.workunit.client.0.smithi070.stderr: -193> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command objecter_requests cmddesc objecter_requests hook 0x5555cc2a12a0 EEXIST 2024-09-12T00:57:43.437 INFO:tasks.workunit.client.0.smithi070.stderr: -192> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 1 librados: setting wanted keys 2024-09-12T00:57:43.438 INFO:tasks.workunit.client.0.smithi070.stderr: -191> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 1 librados: calling monclient init 2024-09-12T00:57:43.438 INFO:tasks.workunit.client.0.smithi070.stderr: -190> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient: init 2024-09-12T00:57:43.438 INFO:tasks.workunit.client.0.smithi070.stderr: -189> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding auth protocol: cephx 2024-09-12T00:57:43.438 INFO:tasks.workunit.client.0.smithi070.stderr: -188> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding auth protocol: cephx 2024-09-12T00:57:43.438 INFO:tasks.workunit.client.0.smithi070.stderr: -187> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding auth protocol: cephx 2024-09-12T00:57:43.438 INFO:tasks.workunit.client.0.smithi070.stderr: -186> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding con mode: secure 2024-09-12T00:57:43.438 INFO:tasks.workunit.client.0.smithi070.stderr: -185> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding con mode: crc 2024-09-12T00:57:43.438 INFO:tasks.workunit.client.0.smithi070.stderr: -184> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding con mode: secure 2024-09-12T00:57:43.438 INFO:tasks.workunit.client.0.smithi070.stderr: -183> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding con mode: crc 2024-09-12T00:57:43.438 INFO:tasks.workunit.client.0.smithi070.stderr: -182> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding con mode: secure 2024-09-12T00:57:43.438 INFO:tasks.workunit.client.0.smithi070.stderr: -181> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding con mode: crc 2024-09-12T00:57:43.438 INFO:tasks.workunit.client.0.smithi070.stderr: -180> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding con mode: crc 2024-09-12T00:57:43.438 INFO:tasks.workunit.client.0.smithi070.stderr: -179> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding con mode: secure 2024-09-12T00:57:43.438 INFO:tasks.workunit.client.0.smithi070.stderr: -178> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding con mode: crc 2024-09-12T00:57:43.439 INFO:tasks.workunit.client.0.smithi070.stderr: -177> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding con mode: secure 2024-09-12T00:57:43.439 INFO:tasks.workunit.client.0.smithi070.stderr: -176> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding con mode: crc 2024-09-12T00:57:43.439 INFO:tasks.workunit.client.0.smithi070.stderr: -175> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 AuthRegistry(0x5555cc29e4b0) adding con mode: secure 2024-09-12T00:57:43.439 INFO:tasks.workunit.client.0.smithi070.stderr: -174> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:43.439 INFO:tasks.workunit.client.0.smithi070.stderr: -173> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:43.439 INFO:tasks.workunit.client.0.smithi070.stderr: -172> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command rotate-key cmddesc rotate-key hook 0x5555cc29e5f8 EEXIST 2024-09-12T00:57:43.439 INFO:tasks.workunit.client.0.smithi070.stderr: -171> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient: _reopen_session rank -1 2024-09-12T00:57:43.439 INFO:tasks.workunit.client.0.smithi070.stderr: -170> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:57:43.439 INFO:tasks.workunit.client.0.smithi070.stderr: -169> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient(hunting): picked mon.noname-a con 0x5555cc2e1f30 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:57:43.439 INFO:tasks.workunit.client.0.smithi070.stderr: -168> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient(hunting): picked mon.noname-c con 0x5555cc2eb830 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:57:43.439 INFO:tasks.workunit.client.0.smithi070.stderr: -167> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient(hunting): picked mon.noname-b con 0x5555cc2f0440 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:57:43.439 INFO:tasks.workunit.client.0.smithi070.stderr: -166> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:43.439 INFO:tasks.workunit.client.0.smithi070.stderr: -165> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:43.440 INFO:tasks.workunit.client.0.smithi070.stderr: -164> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:57:43.440 INFO:tasks.workunit.client.0.smithi070.stderr: -163> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient(hunting): _renew_subs 2024-09-12T00:57:43.440 INFO:tasks.workunit.client.0.smithi070.stderr: -162> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient(hunting): authenticate will time out at 2313.705936s 2024-09-12T00:57:43.440 INFO:tasks.workunit.client.0.smithi070.stderr: -161> 2024-09-12T00:57:43.254+0000 7f749c4b7640 10 monclient(hunting): get_auth_request con 0x5555cc2e1f30 auth_method 0 2024-09-12T00:57:43.440 INFO:tasks.workunit.client.0.smithi070.stderr: -160> 2024-09-12T00:57:43.254+0000 7f749c4b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:43.440 INFO:tasks.workunit.client.0.smithi070.stderr: -159> 2024-09-12T00:57:43.254+0000 7f749c4b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:43.440 INFO:tasks.workunit.client.0.smithi070.stderr: -158> 2024-09-12T00:57:43.254+0000 7f749c4b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:43.440 INFO:tasks.workunit.client.0.smithi070.stderr: -157> 2024-09-12T00:57:43.254+0000 7f749bcb6640 10 monclient(hunting): get_auth_request con 0x5555cc2eb830 auth_method 0 2024-09-12T00:57:43.440 INFO:tasks.workunit.client.0.smithi070.stderr: -156> 2024-09-12T00:57:43.254+0000 7f749bcb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:57:43.440 INFO:tasks.workunit.client.0.smithi070.stderr: -155> 2024-09-12T00:57:43.254+0000 7f749bcb6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:57:43.440 INFO:tasks.workunit.client.0.smithi070.stderr: -154> 2024-09-12T00:57:43.254+0000 7f749bcb6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:57:43.440 INFO:tasks.workunit.client.0.smithi070.stderr: -153> 2024-09-12T00:57:43.254+0000 7f749c4b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:43.440 INFO:tasks.workunit.client.0.smithi070.stderr: -152> 2024-09-12T00:57:43.254+0000 7f749c4b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:43.441 INFO:tasks.workunit.client.0.smithi070.stderr: -151> 2024-09-12T00:57:43.254+0000 7f749c4b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:43.441 INFO:tasks.workunit.client.0.smithi070.stderr: -150> 2024-09-12T00:57:43.254+0000 7f749bcb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:57:43.441 INFO:tasks.workunit.client.0.smithi070.stderr: -149> 2024-09-12T00:57:43.254+0000 7f749bcb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:57:43.441 INFO:tasks.workunit.client.0.smithi070.stderr: -148> 2024-09-12T00:57:43.254+0000 7f749bcb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:57:43.441 INFO:tasks.workunit.client.0.smithi070.stderr: -147> 2024-09-12T00:57:43.254+0000 7f749bcb6640 10 monclient(hunting): handle_auth_done global_id 7316 payload 824 2024-09-12T00:57:43.441 INFO:tasks.workunit.client.0.smithi070.stderr: -146> 2024-09-12T00:57:43.254+0000 7f749bcb6640 10 monclient: _finish_hunting 0 2024-09-12T00:57:43.441 INFO:tasks.workunit.client.0.smithi070.stderr: -145> 2024-09-12T00:57:43.254+0000 7f749bcb6640 1 monclient: found mon.noname-c 2024-09-12T00:57:43.441 INFO:tasks.workunit.client.0.smithi070.stderr: -144> 2024-09-12T00:57:43.254+0000 7f749bcb6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:57:43.441 INFO:tasks.workunit.client.0.smithi070.stderr: -143> 2024-09-12T00:57:43.254+0000 7f7371ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:43.441 INFO:tasks.workunit.client.0.smithi070.stderr: -142> 2024-09-12T00:57:43.254+0000 7f7371ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:57:43.441 INFO:tasks.workunit.client.0.smithi070.stderr: -141> 2024-09-12T00:57:43.254+0000 7f7371ffb640 10 monclient: dump: 2024-09-12T00:57:43.441 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:43.441 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:43.441 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.442 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.442 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:43.442 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.442 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:43.442 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:43.442 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:43.442 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.442 INFO:tasks.workunit.client.0.smithi070.stderr: -140> 2024-09-12T00:57:43.254+0000 7f7371ffb640 10 monclient: _finish_auth 0 2024-09-12T00:57:43.442 INFO:tasks.workunit.client.0.smithi070.stderr: -139> 2024-09-12T00:57:43.254+0000 7f7371ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:57:43.442 INFO:tasks.workunit.client.0.smithi070.stderr: -138> 2024-09-12T00:57:43.254+0000 7f7371ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:57:43.442 INFO:tasks.workunit.client.0.smithi070.stderr: -137> 2024-09-12T00:57:43.254+0000 7f7371ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:57:43.442 INFO:tasks.workunit.client.0.smithi070.stderr: -136> 2024-09-12T00:57:43.254+0000 7f7371ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:57:43.443 INFO:tasks.workunit.client.0.smithi070.stderr: -135> 2024-09-12T00:57:43.254+0000 7f7371ffb640 10 monclient: dump: 2024-09-12T00:57:43.443 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:57:43.443 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:57:43.443 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.443 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:57:43.443 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:57:43.443 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:57:43.443 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:57:43.443 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:57:43.443 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:57:43.443 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.443 INFO:tasks.workunit.client.0.smithi070.stderr: -134> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 monclient: authenticate success, global_id 7316 2024-09-12T00:57:43.444 INFO:tasks.workunit.client.0.smithi070.stderr: -133> 2024-09-12T00:57:43.254+0000 7f73737fe640 4 set_mon_vals no callback set 2024-09-12T00:57:43.444 INFO:tasks.workunit.client.0.smithi070.stderr: -132> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient: _renew_subs 2024-09-12T00:57:43.444 INFO:tasks.workunit.client.0.smithi070.stderr: -131> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:57:43.444 INFO:tasks.workunit.client.0.smithi070.stderr: -130> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient: _renew_subs 2024-09-12T00:57:43.444 INFO:tasks.workunit.client.0.smithi070.stderr: -129> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:57:43.444 INFO:tasks.workunit.client.0.smithi070.stderr: -128> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 1 librados: init done 2024-09-12T00:57:43.444 INFO:tasks.workunit.client.0.smithi070.stderr: -127> 2024-09-12T00:57:43.254+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command cr dump hook 0x5555cc2e1af8 2024-09-12T00:57:43.444 INFO:tasks.workunit.client.0.smithi070.stderr: -126> 2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.444 INFO:tasks.workunit.client.0.smithi070.stderr: -125> 2024-09-12T00:57:43.258+0000 7f7371ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:57:43.444 INFO:tasks.workunit.client.0.smithi070.stderr: -124> 2024-09-12T00:57:43.258+0000 7f7371ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:57:43.444 INFO:tasks.workunit.client.0.smithi070.stderr: -123> 2024-09-12T00:57:43.258+0000 7f7371ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:57:43.444 INFO:tasks.workunit.client.0.smithi070.stderr: -122> 2024-09-12T00:57:43.258+0000 7f749c4b7640 10 monclient: get_auth_request con 0x7f7364070ae0 auth_method 0 2024-09-12T00:57:43.444 INFO:tasks.workunit.client.0.smithi070.stderr: -121> 2024-09-12T00:57:43.258+0000 7f749ccb8640 10 monclient: get_auth_request con 0x5555cc30a540 auth_method 0 2024-09-12T00:57:43.445 INFO:tasks.workunit.client.0.smithi070.stderr: -120> 2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.445 INFO:tasks.workunit.client.0.smithi070.stderr: -119> 2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 realm 2024-09-12T00:57:43.445 INFO:tasks.workunit.client.0.smithi070.stderr: -118> 2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.445 INFO:tasks.workunit.client.0.smithi070.stderr: -117> 2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.445 INFO:tasks.workunit.client.0.smithi070.stderr: -116> 2024-09-12T00:57:43.258+0000 7f749e9b19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:43.445 INFO:tasks.workunit.client.0.smithi070.stderr: -115> 2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.445 INFO:tasks.workunit.client.0.smithi070.stderr: -114> 2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.445 INFO:tasks.workunit.client.0.smithi070.stderr: -113> 2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.445 INFO:tasks.workunit.client.0.smithi070.stderr: -112> 2024-09-12T00:57:43.258+0000 7f749c4b7640 10 monclient: get_auth_request con 0x5555cc30e850 auth_method 0 2024-09-12T00:57:43.445 INFO:tasks.workunit.client.0.smithi070.stderr: -111> 2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:43.445 INFO:tasks.workunit.client.0.smithi070.stderr: -110> 2024-09-12T00:57:43.258+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.445 INFO:tasks.workunit.client.0.smithi070.stderr: -109> 2024-09-12T00:57:43.258+0000 7f749bcb6640 10 monclient: get_auth_request con 0x5555cc311f90 auth_method 0 2024-09-12T00:57:43.445 INFO:tasks.workunit.client.0.smithi070.stderr: -108> 2024-09-12T00:57:43.262+0000 7f749e9b19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:43.445 INFO:tasks.workunit.client.0.smithi070.stderr: -107> 2024-09-12T00:57:43.262+0000 7f749e9b19c0 20 searching for the correct realm 2024-09-12T00:57:43.446 INFO:tasks.workunit.client.0.smithi070.stderr: -106> 2024-09-12T00:57:43.262+0000 7f749ccb8640 10 monclient: get_auth_request con 0x5555cc316ce0 auth_method 0 2024-09-12T00:57:43.446 INFO:tasks.workunit.client.0.smithi070.stderr: -105> 2024-09-12T00:57:43.262+0000 7f749c4b7640 10 monclient: get_auth_request con 0x7f74940c6410 auth_method 0 2024-09-12T00:57:43.446 INFO:tasks.workunit.client.0.smithi070.stderr: -104> 2024-09-12T00:57:43.262+0000 7f749bcb6640 10 monclient: get_auth_request con 0x7f748c03d060 auth_method 0 2024-09-12T00:57:43.446 INFO:tasks.workunit.client.0.smithi070.stderr: -103> 2024-09-12T00:57:43.266+0000 7f749ccb8640 10 monclient: get_auth_request con 0x7f7490062be0 auth_method 0 2024-09-12T00:57:43.446 INFO:tasks.workunit.client.0.smithi070.stderr: -102> 2024-09-12T00:57:43.266+0000 7f749ccb8640 0 -- 172.21.15.70:0/197211755 >> [v2:172.21.15.70:6808/276433067,v1:172.21.15.70:6809/276433067] conn(0x5555cc316ce0 msgr2=0x5555cc3191a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:57:43.446 INFO:tasks.workunit.client.0.smithi070.stderr: -101> 2024-09-12T00:57:43.266+0000 7f7371ffb640 1 client.7316.objecter ms_handle_reset 0x5555cc316ce0 session 0x5555cc316610 osd.3 2024-09-12T00:57:43.446 INFO:tasks.workunit.client.0.smithi070.stderr: -100> 2024-09-12T00:57:43.266+0000 7f7371ffb640 10 monclient: _renew_subs 2024-09-12T00:57:43.446 INFO:tasks.workunit.client.0.smithi070.stderr: -99> 2024-09-12T00:57:43.266+0000 7f7371ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:57:43.446 INFO:tasks.workunit.client.0.smithi070.stderr: -98> 2024-09-12T00:57:43.266+0000 7f749ccb8640 10 monclient: get_auth_request con 0x7f7364080880 auth_method 0 2024-09-12T00:57:43.446 INFO:tasks.workunit.client.0.smithi070.stderr: -97> 2024-09-12T00:57:43.270+0000 7f749c4b7640 10 monclient: get_auth_request con 0x7f74940d7430 auth_method 0 2024-09-12T00:57:43.446 INFO:tasks.workunit.client.0.smithi070.stderr: -96> 2024-09-12T00:57:43.274+0000 7f749c4b7640 0 -- 172.21.15.70:0/197211755 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f74940c6410 msgr2=0x7f74940c6890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:43.446 INFO:tasks.workunit.client.0.smithi070.stderr: -95> 2024-09-12T00:57:43.274+0000 7f7371ffb640 1 client.7316.objecter ms_handle_reset 0x7f74940c6410 session 0x7f74940a6070 osd.7 2024-09-12T00:57:43.446 INFO:tasks.workunit.client.0.smithi070.stderr: -94> 2024-09-12T00:57:43.274+0000 7f749c4b7640 10 monclient: get_auth_request con 0x5555cc316ce0 auth_method 0 2024-09-12T00:57:43.446 INFO:tasks.workunit.client.0.smithi070.stderr: -93> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:43.447 INFO:tasks.workunit.client.0.smithi070.stderr: -92> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:57:43.447 INFO:tasks.workunit.client.0.smithi070.stderr: -91> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:43.447 INFO:tasks.workunit.client.0.smithi070.stderr: -90> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:57:43.447 INFO:tasks.workunit.client.0.smithi070.stderr: -89> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:43.447 INFO:tasks.workunit.client.0.smithi070.stderr: -88> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:43.447 INFO:tasks.workunit.client.0.smithi070.stderr: -87> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.447 INFO:tasks.workunit.client.0.smithi070.stderr: -86> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.447 INFO:tasks.workunit.client.0.smithi070.stderr: -85> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.447 INFO:tasks.workunit.client.0.smithi070.stderr: -84> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:43.447 INFO:tasks.workunit.client.0.smithi070.stderr: -83> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.447 INFO:tasks.workunit.client.0.smithi070.stderr: -82> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:43.447 INFO:tasks.workunit.client.0.smithi070.stderr: -81> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 zone default found 2024-09-12T00:57:43.447 INFO:tasks.workunit.client.0.smithi070.stderr: -80> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 4 Realm: () 2024-09-12T00:57:43.448 INFO:tasks.workunit.client.0.smithi070.stderr: -79> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:57:43.448 INFO:tasks.workunit.client.0.smithi070.stderr: -78> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:57:43.448 INFO:tasks.workunit.client.0.smithi070.stderr: -77> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:43.448 INFO:tasks.workunit.client.0.smithi070.stderr: -76> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 zonegroup default 2024-09-12T00:57:43.448 INFO:tasks.workunit.client.0.smithi070.stderr: -75> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.448 INFO:tasks.workunit.client.0.smithi070.stderr: -74> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.448 INFO:tasks.workunit.client.0.smithi070.stderr: -73> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.448 INFO:tasks.workunit.client.0.smithi070.stderr: -72> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.448 INFO:tasks.workunit.client.0.smithi070.stderr: -71> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.448 INFO:tasks.workunit.client.0.smithi070.stderr: -70> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.448 INFO:tasks.workunit.client.0.smithi070.stderr: -69> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 started sync module instance, tier type = 2024-09-12T00:57:43.448 INFO:tasks.workunit.client.0.smithi070.stderr: -68> 2024-09-12T00:57:43.282+0000 7f749e9b19c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:57:43.448 INFO:tasks.workunit.client.0.smithi070.stderr: -67> 2024-09-12T00:57:43.298+0000 7f749e9b19c0 20 add_watcher() i=0 2024-09-12T00:57:43.448 INFO:tasks.workunit.client.0.smithi070.stderr: -66> 2024-09-12T00:57:43.298+0000 7f749e9b19c0 20 add_watcher() i=1 2024-09-12T00:57:43.449 INFO:tasks.workunit.client.0.smithi070.stderr: -65> 2024-09-12T00:57:43.298+0000 7f749e9b19c0 20 add_watcher() i=2 2024-09-12T00:57:43.449 INFO:tasks.workunit.client.0.smithi070.stderr: -64> 2024-09-12T00:57:43.298+0000 7f749e9b19c0 20 add_watcher() i=3 2024-09-12T00:57:43.449 INFO:tasks.workunit.client.0.smithi070.stderr: -63> 2024-09-12T00:57:43.298+0000 7f749e9b19c0 20 add_watcher() i=4 2024-09-12T00:57:43.449 INFO:tasks.workunit.client.0.smithi070.stderr: -62> 2024-09-12T00:57:43.298+0000 7f749e9b19c0 20 add_watcher() i=5 2024-09-12T00:57:43.449 INFO:tasks.workunit.client.0.smithi070.stderr: -61> 2024-09-12T00:57:43.298+0000 7f749e9b19c0 20 add_watcher() i=6 2024-09-12T00:57:43.449 INFO:tasks.workunit.client.0.smithi070.stderr: -60> 2024-09-12T00:57:43.298+0000 7f749e9b19c0 20 add_watcher() i=7 2024-09-12T00:57:43.449 INFO:tasks.workunit.client.0.smithi070.stderr: -59> 2024-09-12T00:57:43.298+0000 7f749e9b19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:43.449 INFO:tasks.workunit.client.0.smithi070.stderr: -58> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding auth protocol: cephx 2024-09-12T00:57:43.449 INFO:tasks.workunit.client.0.smithi070.stderr: -57> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding auth protocol: cephx 2024-09-12T00:57:43.449 INFO:tasks.workunit.client.0.smithi070.stderr: -56> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding auth protocol: cephx 2024-09-12T00:57:43.449 INFO:tasks.workunit.client.0.smithi070.stderr: -55> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding con mode: secure 2024-09-12T00:57:43.449 INFO:tasks.workunit.client.0.smithi070.stderr: -54> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding con mode: crc 2024-09-12T00:57:43.449 INFO:tasks.workunit.client.0.smithi070.stderr: -53> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding con mode: secure 2024-09-12T00:57:43.449 INFO:tasks.workunit.client.0.smithi070.stderr: -52> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding con mode: crc 2024-09-12T00:57:43.450 INFO:tasks.workunit.client.0.smithi070.stderr: -51> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding con mode: secure 2024-09-12T00:57:43.450 INFO:tasks.workunit.client.0.smithi070.stderr: -50> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding con mode: crc 2024-09-12T00:57:43.450 INFO:tasks.workunit.client.0.smithi070.stderr: -49> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding con mode: crc 2024-09-12T00:57:43.450 INFO:tasks.workunit.client.0.smithi070.stderr: -48> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding con mode: secure 2024-09-12T00:57:43.450 INFO:tasks.workunit.client.0.smithi070.stderr: -47> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding con mode: crc 2024-09-12T00:57:43.450 INFO:tasks.workunit.client.0.smithi070.stderr: -46> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding con mode: secure 2024-09-12T00:57:43.450 INFO:tasks.workunit.client.0.smithi070.stderr: -45> 2024-09-12T00:57:43.302+0000 7f7352fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:43.450 INFO:tasks.workunit.client.0.smithi070.stderr: -44> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding con mode: crc 2024-09-12T00:57:43.450 INFO:tasks.workunit.client.0.smithi070.stderr: -43> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 AuthRegistry(0x7ffdbc2ce530) adding con mode: secure 2024-09-12T00:57:43.450 INFO:tasks.workunit.client.0.smithi070.stderr: -42> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:57:43.450 INFO:tasks.workunit.client.0.smithi070.stderr: -41> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:43.450 INFO:tasks.workunit.client.0.smithi070.stderr: -40> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:43.450 INFO:tasks.workunit.client.0.smithi070.stderr: -39> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command cache list hook 0x5555cc2e1830 2024-09-12T00:57:43.450 INFO:tasks.workunit.client.0.smithi070.stderr: -38> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command cache inspect hook 0x5555cc2e1830 2024-09-12T00:57:43.451 INFO:tasks.workunit.client.0.smithi070.stderr: -37> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command cache erase hook 0x5555cc2e1830 2024-09-12T00:57:43.451 INFO:tasks.workunit.client.0.smithi070.stderr: -36> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command cache zap hook 0x5555cc2e1830 2024-09-12T00:57:43.451 INFO:tasks.workunit.client.0.smithi070.stderr: -35> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 note: GC not initialized 2024-09-12T00:57:43.451 INFO:tasks.workunit.client.0.smithi070.stderr: -34> 2024-09-12T00:57:43.302+0000 7f7351fdb640 20 reqs_thread_entry: start 2024-09-12T00:57:43.451 INFO:tasks.workunit.client.0.smithi070.stderr: -33> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command sync trace show hook 0x7f7494004680 2024-09-12T00:57:43.451 INFO:tasks.workunit.client.0.smithi070.stderr: -32> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command sync trace history hook 0x7f7494004680 2024-09-12T00:57:43.451 INFO:tasks.workunit.client.0.smithi070.stderr: -31> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command sync trace active hook 0x7f7494004680 2024-09-12T00:57:43.451 INFO:tasks.workunit.client.0.smithi070.stderr: -30> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 5 asok(0x5555cc0152b0) register_command sync trace active_short hook 0x7f7494004680 2024-09-12T00:57:43.451 INFO:tasks.workunit.client.0.smithi070.stderr: -29> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 20 init_complete bucket index max shards: 1 2024-09-12T00:57:43.451 INFO:tasks.workunit.client.0.smithi070.stderr: -28> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 20 Filter name: none 2024-09-12T00:57:43.451 INFO:tasks.workunit.client.0.smithi070.stderr: -27> 2024-09-12T00:57:43.302+0000 7f72c37fe640 20 reqs_thread_entry: start 2024-09-12T00:57:43.451 INFO:tasks.workunit.client.0.smithi070.stderr: -26> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:57:43.451 INFO:tasks.workunit.client.0.smithi070.stderr: -25> 2024-09-12T00:57:43.302+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.451 INFO:tasks.workunit.client.0.smithi070.stderr: -24> 2024-09-12T00:57:43.306+0000 7f749e9b19c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:57:43.452 INFO:tasks.workunit.client.0.smithi070.stderr: -23> 2024-09-12T00:57:43.306+0000 7f749e9b19c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:57:43.452 INFO:tasks.workunit.client.0.smithi070.stderr: -22> 2024-09-12T00:57:43.306+0000 7f749e9b19c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:57:43.452 INFO:tasks.workunit.client.0.smithi070.stderr: -21> 2024-09-12T00:57:43.306+0000 7f749e9b19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 : miss 2024-09-12T00:57:43.452 INFO:tasks.workunit.client.0.smithi070.stderr: -20> 2024-09-12T00:57:43.306+0000 7f749e9b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.452 INFO:tasks.workunit.client.0.smithi070.stderr: -19> 2024-09-12T00:57:43.306+0000 7f749e9b19c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:57:43.452 INFO:tasks.workunit.client.0.smithi070.stderr: -18> 2024-09-12T00:57:43.306+0000 7f749e9b19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 info.flags=0x17 2024-09-12T00:57:43.452 INFO:tasks.workunit.client.0.smithi070.stderr: -17> 2024-09-12T00:57:43.306+0000 7f749e9b19c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 to cache LRU end 2024-09-12T00:57:43.452 INFO:tasks.workunit.client.0.smithi070.stderr: -16> 2024-09-12T00:57:43.306+0000 7f749e9b19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:57:43.452 INFO:tasks.workunit.client.0.smithi070.stderr: -15> 2024-09-12T00:57:43.306+0000 7f749e9b19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:43.452 INFO:tasks.workunit.client.0.smithi070.stderr: -14> 2024-09-12T00:57:43.306+0000 7f749e9b19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 2024-09-12T00:57:43.452 INFO:tasks.workunit.client.0.smithi070.stderr: -13> 2024-09-12T00:57:43.314+0000 7f749e9b19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 info.flags=0x17 2024-09-12T00:57:43.452 INFO:tasks.workunit.client.0.smithi070.stderr: -12> 2024-09-12T00:57:43.314+0000 7f749e9b19c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 to cache LRU end 2024-09-12T00:57:43.452 INFO:tasks.workunit.client.0.smithi070.stderr: -11> 2024-09-12T00:57:43.314+0000 7f749e9b19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:43.453 INFO:tasks.workunit.client.0.smithi070.stderr: -10> 2024-09-12T00:57:43.314+0000 7f749e9b19c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37, ofs0, ns] 2024-09-12T00:57:43.453 INFO:tasks.workunit.client.0.smithi070.stderr: -9> 2024-09-12T00:57:43.314+0000 7f73737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431564 cookie 93826986402448 notifier 7316 bl.length()=1007 2024-09-12T00:57:43.453 INFO:tasks.workunit.client.0.smithi070.stderr: -8> 2024-09-12T00:57:43.314+0000 7f73737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 info.flags=0x17 2024-09-12T00:57:43.453 INFO:tasks.workunit.client.0.smithi070.stderr: -7> 2024-09-12T00:57:43.314+0000 7f73737fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 to cache LRU end 2024-09-12T00:57:43.453 INFO:tasks.workunit.client.0.smithi070.stderr: -6> 2024-09-12T00:57:43.314+0000 7f73737fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:43.453 INFO:tasks.workunit.client.0.smithi070.stderr: -5> 2024-09-12T00:57:43.314+0000 7f749e9b19c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37]): orig_sources= new_sources= 2024-09-12T00:57:43.453 INFO:tasks.workunit.client.0.smithi070.stderr: -4> 2024-09-12T00:57:43.314+0000 7f749e9b19c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37]): potential sources added=[] removed=[] 2024-09-12T00:57:43.453 INFO:tasks.workunit.client.0.smithi070.stderr: -3> 2024-09-12T00:57:43.314+0000 7f749e9b19c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37]): orig_dests= new_dests= 2024-09-12T00:57:43.453 INFO:tasks.workunit.client.0.smithi070.stderr: -2> 2024-09-12T00:57:43.314+0000 7f749e9b19c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37]): potential dests added=[] removed=[] 2024-09-12T00:57:43.453 INFO:tasks.workunit.client.0.smithi070.stderr: -1> 2024-09-12T00:57:43.318+0000 7f749e9b19c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f749e9b19c0 time 2024-09-12T00:57:43.322310+0000 2024-09-12T00:57:43.453 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:57:43.453 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.453 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:57:43.453 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f74a228b2eb] 2024-09-12T00:57:43.454 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f74a228b49f] 2024-09-12T00:57:43.454 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5555caf11cc1] 2024-09-12T00:57:43.454 INFO:tasks.workunit.client.0.smithi070.stderr: 4: radosgw-admin(+0x1422aac) [0x5555cb96faac] 2024-09-12T00:57:43.454 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5555caf26ced] 2024-09-12T00:57:43.454 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:57:43.454 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f74a10f1d90] 2024-09-12T00:57:43.454 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:57:43.454 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:57:43.454 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.454 INFO:tasks.workunit.client.0.smithi070.stderr: 0> 2024-09-12T00:57:43.318+0000 7f749e9b19c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:57:43.454 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f749e9b19c0 thread_name:radosgw-admin 2024-09-12T00:57:43.454 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.454 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:57:43.455 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f74a110a520] 2024-09-12T00:57:43.455 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:57:43.455 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:57:43.455 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:57:43.455 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f74a228b345] 2024-09-12T00:57:43.455 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f74a228b49f] 2024-09-12T00:57:43.455 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5555caf11cc1] 2024-09-12T00:57:43.455 INFO:tasks.workunit.client.0.smithi070.stderr: 8: radosgw-admin(+0x1422aac) [0x5555cb96faac] 2024-09-12T00:57:43.455 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5555caf26ced] 2024-09-12T00:57:43.455 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:57:43.455 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f74a10f1d90] 2024-09-12T00:57:43.455 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:57:43.455 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:57:43.455 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:57:43.456 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.456 INFO:tasks.workunit.client.0.smithi070.stderr:--- logging levels --- 2024-09-12T00:57:43.456 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 none 2024-09-12T00:57:43.456 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 lockdep 2024-09-12T00:57:43.456 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 context 2024-09-12T00:57:43.456 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 crush 2024-09-12T00:57:43.456 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds 2024-09-12T00:57:43.456 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_balancer 2024-09-12T00:57:43.456 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_locker 2024-09-12T00:57:43.456 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log 2024-09-12T00:57:43.456 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log_expire 2024-09-12T00:57:43.456 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_migrator 2024-09-12T00:57:43.456 INFO:tasks.workunit.client.0.smithi070.stderr: 3/ 5 mds_quiesce 2024-09-12T00:57:43.456 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 buffer 2024-09-12T00:57:43.457 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 timer 2024-09-12T00:57:43.457 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 filer 2024-09-12T00:57:43.457 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 striper 2024-09-12T00:57:43.457 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 objecter 2024-09-12T00:57:43.457 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rados 2024-09-12T00:57:43.457 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd 2024-09-12T00:57:43.457 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_mirror 2024-09-12T00:57:43.457 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_replay 2024-09-12T00:57:43.457 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_pwl 2024-09-12T00:57:43.457 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 journaler 2024-09-12T00:57:43.457 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objectcacher 2024-09-12T00:57:43.457 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:57:43.457 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 client 2024-09-12T00:57:43.457 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 osd 2024-09-12T00:57:43.458 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 optracker 2024-09-12T00:57:43.458 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objclass 2024-09-12T00:57:43.458 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 filestore 2024-09-12T00:57:43.458 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 journal 2024-09-12T00:57:43.458 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 ms 2024-09-12T00:57:43.458 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mon 2024-09-12T00:57:43.458 INFO:tasks.workunit.client.0.smithi070.stderr: 0/10 monc 2024-09-12T00:57:43.458 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 paxos 2024-09-12T00:57:43.458 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 tp 2024-09-12T00:57:43.458 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 auth 2024-09-12T00:57:43.458 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 crypto 2024-09-12T00:57:43.458 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 finisher 2024-09-12T00:57:43.458 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 reserver 2024-09-12T00:57:43.458 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 heartbeatmap 2024-09-12T00:57:43.459 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 perfcounter 2024-09-12T00:57:43.459 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw 2024-09-12T00:57:43.459 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_sync 2024-09-12T00:57:43.459 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_datacache 2024-09-12T00:57:43.459 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_access 2024-09-12T00:57:43.459 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:57:43.459 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_flight 2024-09-12T00:57:43.459 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:57:43.459 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw_notification 2024-09-12T00:57:43.459 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 javaclient 2024-09-12T00:57:43.459 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 asok 2024-09-12T00:57:43.459 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 throttle 2024-09-12T00:57:43.459 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 refs 2024-09-12T00:57:43.459 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 compressor 2024-09-12T00:57:43.460 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluestore 2024-09-12T00:57:43.460 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluefs 2024-09-12T00:57:43.460 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 bdev 2024-09-12T00:57:43.460 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 kstore 2024-09-12T00:57:43.460 INFO:tasks.workunit.client.0.smithi070.stderr: 4/ 5 rocksdb 2024-09-12T00:57:43.460 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 fuse 2024-09-12T00:57:43.460 INFO:tasks.workunit.client.0.smithi070.stderr: 2/ 5 mgr 2024-09-12T00:57:43.460 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mgrc 2024-09-12T00:57:43.460 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 dpdk 2024-09-12T00:57:43.460 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 eventtrace 2024-09-12T00:57:43.460 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 prioritycache 2024-09-12T00:57:43.460 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 test 2024-09-12T00:57:43.460 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:57:43.460 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephsqlite 2024-09-12T00:57:43.461 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:57:43.461 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore 2024-09-12T00:57:43.461 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_onode 2024-09-12T00:57:43.461 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_odata 2024-09-12T00:57:43.461 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_omap 2024-09-12T00:57:43.461 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_tm 2024-09-12T00:57:43.461 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_t 2024-09-12T00:57:43.461 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:57:43.461 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_epm 2024-09-12T00:57:43.461 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_lba 2024-09-12T00:57:43.461 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:57:43.461 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cache 2024-09-12T00:57:43.461 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_journal 2024-09-12T00:57:43.461 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_device 2024-09-12T00:57:43.462 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_backref 2024-09-12T00:57:43.462 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 alienstore 2024-09-12T00:57:43.462 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mclock 2024-09-12T00:57:43.462 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cyanstore 2024-09-12T00:57:43.462 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 ceph_exporter 2024-09-12T00:57:43.462 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 memstore 2024-09-12T00:57:43.462 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 trace 2024-09-12T00:57:43.462 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 ceph_dedup 2024-09-12T00:57:43.462 INFO:tasks.workunit.client.0.smithi070.stderr: -2/-2 (syslog threshold) 2024-09-12T00:57:43.462 INFO:tasks.workunit.client.0.smithi070.stderr: 99/99 (stderr threshold) 2024-09-12T00:57:43.462 INFO:tasks.workunit.client.0.smithi070.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:57:43.462 INFO:tasks.workunit.client.0.smithi070.stderr: 7f72c37fe640 / http_manager 2024-09-12T00:57:43.462 INFO:tasks.workunit.client.0.smithi070.stderr: 7f7351fdb640 / http_manager 2024-09-12T00:57:43.462 INFO:tasks.workunit.client.0.smithi070.stderr: 7f7352fdd640 / rgw_dt_lg_renew 2024-09-12T00:57:43.462 INFO:tasks.workunit.client.0.smithi070.stderr: 7f7371ffb640 / ms_dispatch 2024-09-12T00:57:43.463 INFO:tasks.workunit.client.0.smithi070.stderr: 7f73737fe640 / io_context_pool 2024-09-12T00:57:43.463 INFO:tasks.workunit.client.0.smithi070.stderr: 7f7381ffb640 / ms_dispatch 2024-09-12T00:57:43.463 INFO:tasks.workunit.client.0.smithi070.stderr: 7f7388e09640 / ms_dispatch 2024-09-12T00:57:43.463 INFO:tasks.workunit.client.0.smithi070.stderr: 7f738a60c640 / io_context_pool 2024-09-12T00:57:43.463 INFO:tasks.workunit.client.0.smithi070.stderr: 7f749bcb6640 / msgr-worker-2 2024-09-12T00:57:43.463 INFO:tasks.workunit.client.0.smithi070.stderr: 7f749c4b7640 / msgr-worker-1 2024-09-12T00:57:43.463 INFO:tasks.workunit.client.0.smithi070.stderr: 7f749ccb8640 / msgr-worker-0 2024-09-12T00:57:43.463 INFO:tasks.workunit.client.0.smithi070.stderr: 7f749d4b9640 / io_context_pool 2024-09-12T00:57:43.463 INFO:tasks.workunit.client.0.smithi070.stderr: 7f749e9b19c0 / radosgw-admin 2024-09-12T00:57:43.463 INFO:tasks.workunit.client.0.smithi070.stderr: max_recent 500 2024-09-12T00:57:43.463 INFO:tasks.workunit.client.0.smithi070.stderr: max_new 1000 2024-09-12T00:57:43.463 INFO:tasks.workunit.client.0.smithi070.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:57:43.324781Z_219c9c3a-ceb9-4546-8e55-ff48926fb968/log 2024-09-12T00:57:43.463 INFO:tasks.workunit.client.0.smithi070.stderr:--- end dump of recent events --- 2024-09-12T00:57:43.463 INFO:tasks.workunit.client.0.smithi070.stderr:Aborted 2024-09-12T00:57:43.464 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:57:43.468 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:43.468 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:43.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.394+0000 7f2e52bb89c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.398+0000 7f2e52bb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.398+0000 7f2e52bb89c0 20 realm 2024-09-12T00:57:43.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.398+0000 7f2e52bb89c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.398+0000 7f2e52bb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.398+0000 7f2e52bb89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:43.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.398+0000 7f2e52bb89c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.398+0000 7f2e52bb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.398+0000 7f2e52bb89c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.398+0000 7f2e52bb89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:43.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.398+0000 7f2e52bb89c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.402+0000 7f2e52bb89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:43.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.402+0000 7f2e52bb89c0 20 searching for the correct realm 2024-09-12T00:57:43.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.406+0000 7f2e506be640 0 -- 172.21.15.70:0/2603357532 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f2e48017020 msgr2=0x7f2e48018410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:43.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.414+0000 7f2e506be640 0 -- 172.21.15.70:0/2603357532 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f2e48040040 msgr2=0x7f2e48018410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:43.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.418+0000 7f2e52bb89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:43.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.418+0000 7f2e52bb89c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:57:43.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.418+0000 7f2e52bb89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:43.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.418+0000 7f2e52bb89c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:57:43.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.418+0000 7f2e52bb89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:43.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.418+0000 7f2e52bb89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:43.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.418+0000 7f2e52bb89c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.418+0000 7f2e52bb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.418+0000 7f2e52bb89c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.418+0000 7f2e52bb89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:43.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.418+0000 7f2e52bb89c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.418+0000 7f2e52bb89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:43.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.418+0000 7f2e52bb89c0 20 zone default found 2024-09-12T00:57:43.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.418+0000 7f2e52bb89c0 4 Realm: () 2024-09-12T00:57:43.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.418+0000 7f2e52bb89c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:57:43.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.418+0000 7f2e52bb89c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:57:43.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.418+0000 7f2e52bb89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:43.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.418+0000 7f2e52bb89c0 20 zonegroup default 2024-09-12T00:57:43.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.418+0000 7f2e52bb89c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.418+0000 7f2e52bb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.418+0000 7f2e52bb89c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.422+0000 7f2e52bb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.422+0000 7f2e52bb89c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.422+0000 7f2e52bb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.422+0000 7f2e52bb89c0 20 started sync module instance, tier type = 2024-09-12T00:57:43.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.422+0000 7f2e52bb89c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:57:43.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.434+0000 7f2e52bb89c0 20 add_watcher() i=0 2024-09-12T00:57:43.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.434+0000 7f2e52bb89c0 20 add_watcher() i=1 2024-09-12T00:57:43.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.434+0000 7f2e52bb89c0 20 add_watcher() i=2 2024-09-12T00:57:43.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.434+0000 7f2e52bb89c0 20 add_watcher() i=3 2024-09-12T00:57:43.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.434+0000 7f2e52bb89c0 20 add_watcher() i=4 2024-09-12T00:57:43.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.434+0000 7f2e52bb89c0 20 add_watcher() i=5 2024-09-12T00:57:43.473 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.434+0000 7f2e52bb89c0 20 add_watcher() i=6 2024-09-12T00:57:43.473 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.434+0000 7f2e52bb89c0 20 add_watcher() i=7 2024-09-12T00:57:43.473 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.434+0000 7f2e52bb89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:43.473 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.438+0000 7f2d06fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:43.473 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.438+0000 7f2e52bb89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:43.473 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.438+0000 7f2e52bb89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:43.474 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.438+0000 7f2e52bb89c0 5 note: GC not initialized 2024-09-12T00:57:43.474 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.438+0000 7f2d05fe3640 20 reqs_thread_entry: start 2024-09-12T00:57:43.474 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.438+0000 7f2e52bb89c0 20 init_complete bucket index max shards: 1 2024-09-12T00:57:43.474 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.438+0000 7f2e52bb89c0 20 Filter name: none 2024-09-12T00:57:43.474 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.438+0000 7f2cfeffd640 20 reqs_thread_entry: start 2024-09-12T00:57:43.474 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.438+0000 7f2e52bb89c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.474 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.442+0000 7f2e52bb89c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:57:43.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.442+0000 7f2e52bb89c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.442+0000 7f2e52bb89c0 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T00:57:43.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.442+0000 7f2e52bb89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:43.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.442+0000 7f2e52bb89c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.442+0000 7f2e52bb89c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:57:43.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.442+0000 7f2e52bb89c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.442+0000 7f2e52bb89c0 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T00:57:43.476 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.442+0000 7f2e52bb89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:43.476 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.446+0000 7f2d06fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:43.476 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.450+0000 7f2e52bb89c0 20 remove_watcher() i=0 2024-09-12T00:57:43.476 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.450+0000 7f2e52bb89c0 2 removed watcher, disabling cache 2024-09-12T00:57:43.476 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.454+0000 7f2e52bb89c0 20 remove_watcher() i=1 2024-09-12T00:57:43.476 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.454+0000 7f2e52bb89c0 20 remove_watcher() i=2 2024-09-12T00:57:43.476 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.458+0000 7f2e52bb89c0 20 remove_watcher() i=3 2024-09-12T00:57:43.476 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.458+0000 7f2e52bb89c0 20 remove_watcher() i=4 2024-09-12T00:57:43.477 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.458+0000 7f2e52bb89c0 20 remove_watcher() i=5 2024-09-12T00:57:43.477 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.462+0000 7f2e52bb89c0 20 remove_watcher() i=6 2024-09-12T00:57:43.477 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.462+0000 7f2e52bb89c0 20 remove_watcher() i=7 2024-09-12T00:57:43.478 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.478 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:57:43.478 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: abort-at-logrecord-writes id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:57:43.478 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:57:43.478 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:43.478 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:43.480 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:57:43.480 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:57:43.528 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:57:43.563 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:43.563 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:43.606 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.610+0000 7fb3693f59c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.614+0000 7fb3693f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.614+0000 7fb3693f59c0 20 realm 2024-09-12T00:57:43.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.614+0000 7fb3693f59c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.614+0000 7fb3693f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.614+0000 7fb3693f59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:43.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.614+0000 7fb3693f59c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.614+0000 7fb3693f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.614+0000 7fb3693f59c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.614+0000 7fb3693f59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:43.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.614+0000 7fb3693f59c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.610 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.614+0000 7fb3693f59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:43.610 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.614+0000 7fb3693f59c0 20 searching for the correct realm 2024-09-12T00:57:43.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.618+0000 7fb3676fc640 0 -- 172.21.15.70:0/327778554 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fb350018070 msgr2=0x7fb35005bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:43.622 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.626+0000 7fb3666fa640 0 -- 172.21.15.70:0/327778554 >> [v2:172.21.15.70:6824/2477739226,v1:172.21.15.70:6825/2477739226] conn(0x55c1186072a0 msgr2=0x55c118609690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:43.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.634+0000 7fb3693f59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:43.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.634+0000 7fb3693f59c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:57:43.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.634+0000 7fb3693f59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:43.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.634+0000 7fb3693f59c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:57:43.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.634+0000 7fb3693f59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:43.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.634+0000 7fb3693f59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:43.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.634+0000 7fb3693f59c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.634+0000 7fb3693f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.630 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.634+0000 7fb3693f59c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.631 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.634+0000 7fb3693f59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:43.631 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.634+0000 7fb3693f59c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.631 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.638+0000 7fb3693f59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:43.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.638+0000 7fb3693f59c0 20 zone default found 2024-09-12T00:57:43.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.638+0000 7fb3693f59c0 4 Realm: () 2024-09-12T00:57:43.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.638+0000 7fb3693f59c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:57:43.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.638+0000 7fb3693f59c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:57:43.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.638+0000 7fb3693f59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:43.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.638+0000 7fb3693f59c0 20 zonegroup default 2024-09-12T00:57:43.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.638+0000 7fb3693f59c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.638+0000 7fb3693f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.638+0000 7fb3693f59c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.638+0000 7fb3693f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.638+0000 7fb3693f59c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.638+0000 7fb3693f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:43.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.638+0000 7fb3693f59c0 20 started sync module instance, tier type = 2024-09-12T00:57:43.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.638+0000 7fb3693f59c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:57:43.647 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.654+0000 7fb3693f59c0 20 add_watcher() i=0 2024-09-12T00:57:43.647 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.654+0000 7fb3693f59c0 20 add_watcher() i=1 2024-09-12T00:57:43.647 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.654+0000 7fb3693f59c0 20 add_watcher() i=2 2024-09-12T00:57:43.647 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.654+0000 7fb3693f59c0 20 add_watcher() i=3 2024-09-12T00:57:43.648 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.654+0000 7fb3693f59c0 20 add_watcher() i=4 2024-09-12T00:57:43.648 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.654+0000 7fb3693f59c0 20 add_watcher() i=5 2024-09-12T00:57:43.648 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.654+0000 7fb3693f59c0 20 add_watcher() i=6 2024-09-12T00:57:43.648 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.654+0000 7fb3693f59c0 20 add_watcher() i=7 2024-09-12T00:57:43.648 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.654+0000 7fb3693f59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:43.651 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.658+0000 7fb21d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:43.652 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.658+0000 7fb3693f59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:43.652 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.658+0000 7fb3693f59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:43.652 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.658+0000 7fb3693f59c0 5 note: GC not initialized 2024-09-12T00:57:43.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.658+0000 7fb197fff640 20 reqs_thread_entry: start 2024-09-12T00:57:43.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.658+0000 7fb3693f59c0 20 init_complete bucket index max shards: 1 2024-09-12T00:57:43.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.658+0000 7fb3693f59c0 20 Filter name: none 2024-09-12T00:57:43.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.658+0000 7fb195ffb640 20 reqs_thread_entry: start 2024-09-12T00:57:43.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.658+0000 7fb3693f59c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:57:43.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.658+0000 7fb3693f59c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.658+0000 7fb3693f59c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:57:43.654 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.658+0000 7fb3693f59c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:57:43.654 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.658+0000 7fb3693f59c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:57:43.654 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.658+0000 7fb3693f59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 : miss 2024-09-12T00:57:43.654 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.658+0000 7fb3693f59c0 20 rados->read ofs=0 len=0 2024-09-12T00:57:43.654 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.658+0000 7fb3693f59c0 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T00:57:43.654 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.658+0000 7fb3693f59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 info.flags=0x17 2024-09-12T00:57:43.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.658+0000 7fb3693f59c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 to cache LRU end 2024-09-12T00:57:43.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.658+0000 7fb3693f59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:57:43.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.658+0000 7fb3693f59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:57:43.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.658+0000 7fb3693f59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 2024-09-12T00:57:43.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.662+0000 7fb3693f59c0 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 to be held by another RGW process; skipping for now 2024-09-12T00:57:43.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.662+0000 7fb21d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:43.662 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.666+0000 7fb3693f59c0 20 remove_watcher() i=0 2024-09-12T00:57:43.662 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.666+0000 7fb3693f59c0 2 removed watcher, disabling cache 2024-09-12T00:57:43.665 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.670+0000 7fb3693f59c0 20 remove_watcher() i=1 2024-09-12T00:57:43.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.670+0000 7fb3693f59c0 20 remove_watcher() i=2 2024-09-12T00:57:43.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.674+0000 7fb3693f59c0 20 remove_watcher() i=3 2024-09-12T00:57:43.671 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.678+0000 7fb3693f59c0 20 remove_watcher() i=4 2024-09-12T00:57:43.672 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.678+0000 7fb3693f59c0 20 remove_watcher() i=5 2024-09-12T00:57:43.673 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.678+0000 7fb3693f59c0 20 remove_watcher() i=6 2024-09-12T00:57:43.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:57:43.682+0000 7fb3693f59c0 20 remove_watcher() i=7 2024-09-12T00:57:43.688 INFO:tasks.workunit.client.0.smithi070.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:58:13.719 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:58:13.757 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:13.757 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:13.801 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:13.810+0000 7f062c9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:13.802 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:13.810+0000 7f062c9d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:13.802 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:13.810+0000 7f062c9d39c0 20 realm 2024-09-12T00:58:13.802 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:13.810+0000 7f062c9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:13.803 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:13.814+0000 7f062c9d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:13.803 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:13.814+0000 7f062c9d39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:13.803 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:13.814+0000 7f062c9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:13.803 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:13.814+0000 7f062c9d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:13.803 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:13.814+0000 7f062c9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:13.804 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:13.814+0000 7f062c9d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:13.804 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:13.814+0000 7f062c9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:13.805 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:13.814+0000 7f062c9d39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:13.806 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:13.814+0000 7f062c9d39c0 20 searching for the correct realm 2024-09-12T00:58:13.809 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:13.818+0000 7f062acda640 0 -- 172.21.15.70:0/636062812 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f0620036b50 msgr2=0x7f062002a460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:14.025 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.034+0000 7f062acda640 0 -- 172.21.15.70:0/636062812 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f0620036b50 msgr2=0x7f062002a460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:14.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.046+0000 7f062c9d39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:14.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.046+0000 7f062c9d39c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:58:14.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.046+0000 7f062c9d39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:14.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.046+0000 7f062c9d39c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:58:14.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.046+0000 7f062c9d39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:14.037 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.046+0000 7f062c9d39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:14.037 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.046+0000 7f062c9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.037 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.046+0000 7f062c9d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:14.037 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.046+0000 7f062c9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.037 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.046+0000 7f062c9d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:14.037 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.046+0000 7f062c9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.038 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.046+0000 7f062c9d39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:14.038 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.046+0000 7f062c9d39c0 20 zone default found 2024-09-12T00:58:14.038 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.046+0000 7f062c9d39c0 4 Realm: () 2024-09-12T00:58:14.038 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.046+0000 7f062c9d39c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:58:14.038 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.046+0000 7f062c9d39c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:58:14.039 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.046+0000 7f062c9d39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:14.039 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.046+0000 7f062c9d39c0 20 zonegroup default 2024-09-12T00:58:14.039 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.046+0000 7f062c9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.039 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.050+0000 7f062c9d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:14.039 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.050+0000 7f062c9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.039 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.050+0000 7f062c9d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:14.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.050+0000 7f062c9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.050+0000 7f062c9d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:14.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.050+0000 7f062c9d39c0 20 started sync module instance, tier type = 2024-09-12T00:58:14.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.050+0000 7f062c9d39c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:58:14.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.074+0000 7f062c9d39c0 20 add_watcher() i=0 2024-09-12T00:58:14.064 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.074+0000 7f062c9d39c0 20 add_watcher() i=1 2024-09-12T00:58:14.064 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.074+0000 7f062c9d39c0 20 add_watcher() i=2 2024-09-12T00:58:14.064 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.074+0000 7f062c9d39c0 20 add_watcher() i=3 2024-09-12T00:58:14.064 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.074+0000 7f062c9d39c0 20 add_watcher() i=4 2024-09-12T00:58:14.064 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.074+0000 7f062c9d39c0 20 add_watcher() i=5 2024-09-12T00:58:14.064 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.074+0000 7f062c9d39c0 20 add_watcher() i=6 2024-09-12T00:58:14.066 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.074+0000 7f062c9d39c0 20 add_watcher() i=7 2024-09-12T00:58:14.066 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.074+0000 7f062c9d39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:14.070 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.078+0000 7f04e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:14.071 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.082+0000 7f062c9d39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:14.071 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.082+0000 7f062c9d39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:14.072 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.082+0000 7f062c9d39c0 5 note: GC not initialized 2024-09-12T00:58:14.072 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.082+0000 7f045b7fe640 20 reqs_thread_entry: start 2024-09-12T00:58:14.072 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.082+0000 7f062c9d39c0 20 init_complete bucket index max shards: 1 2024-09-12T00:58:14.073 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.082+0000 7f062c9d39c0 20 Filter name: none 2024-09-12T00:58:14.073 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.082+0000 7f04597fa640 20 reqs_thread_entry: start 2024-09-12T00:58:14.073 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.082+0000 7f062c9d39c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:58:14.073 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.082+0000 7f062c9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.074 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.082+0000 7f062c9d39c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:58:14.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.082+0000 7f062c9d39c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:58:14.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.082+0000 7f062c9d39c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:58:14.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.082+0000 7f062c9d39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 : miss 2024-09-12T00:58:14.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.082+0000 7f062c9d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.086+0000 7f062c9d39c0 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T00:58:14.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.086+0000 7f062c9d39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 info.flags=0x17 2024-09-12T00:58:14.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.086+0000 7f062c9d39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 to cache LRU end 2024-09-12T00:58:14.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.086+0000 7f062c9d39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:58:14.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.086+0000 7f062c9d39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:14.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.086+0000 7f062c9d39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 2024-09-12T00:58:14.078 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.086+0000 7f062c9d39c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:58:14.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.098+0000 7f062c9d39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 info.flags=0x17 2024-09-12T00:58:14.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.098+0000 7f062c9d39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 to cache LRU end 2024-09-12T00:58:14.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.098+0000 7f062c9d39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:14.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.098+0000 7f062c9d39c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37, ofs0, ns] 2024-09-12T00:58:14.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.098+0000 7f050dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431565 cookie 94248564728752 notifier 7364 bl.length()=1007 2024-09-12T00:58:14.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.098+0000 7f050dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 info.flags=0x17 2024-09-12T00:58:14.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.098+0000 7f050dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 to cache LRU end 2024-09-12T00:58:14.088 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.098+0000 7f050dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:14.088 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.098+0000 7f062c9d39c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37]): orig_sources= new_sources= 2024-09-12T00:58:14.088 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.098+0000 7f062c9d39c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37]): potential sources added=[] removed=[] 2024-09-12T00:58:14.088 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.098+0000 7f062c9d39c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37]): orig_dests= new_dests= 2024-09-12T00:58:14.088 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.098+0000 7f062c9d39c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37]): potential dests added=[] removed=[] 2024-09-12T00:58:14.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.102+0000 7f062c9d39c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37.2.0 2024-09-12T00:58:14.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.102+0000 7f062c9d39c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37.2.0 2024-09-12T00:58:14.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.102+0000 7f062c9d39c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37.2.1 2024-09-12T00:58:14.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.102+0000 7f062c9d39c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37.2.1 2024-09-12T00:58:14.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.102+0000 7f062c9d39c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37.0 2024-09-12T00:58:14.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.106+0000 7f062c9d39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:58:14.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.106+0000 7f062c9d39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 2024-09-12T00:58:14.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.106+0000 7f062c9d39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 info.flags=0x17 2024-09-12T00:58:14.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.106+0000 7f062c9d39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 to cache LRU end 2024-09-12T00:58:14.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.106+0000 7f062c9d39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:14.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.106+0000 7f062c9d39c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37, ofs0, ns] 2024-09-12T00:58:14.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.106+0000 7f050d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431566 cookie 94248564728752 notifier 7364 bl.length()=1007 2024-09-12T00:58:14.099 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.106+0000 7f050d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 info.flags=0x17 2024-09-12T00:58:14.099 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.106+0000 7f050d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 to cache LRU end 2024-09-12T00:58:14.099 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.106+0000 7f050d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:14.099 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.110+0000 7f062c9d39c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37]): orig_sources= new_sources= 2024-09-12T00:58:14.099 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.110+0000 7f062c9d39c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37]): potential sources added=[] removed=[] 2024-09-12T00:58:14.099 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.110+0000 7f062c9d39c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37]): orig_dests= new_dests= 2024-09-12T00:58:14.099 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.110+0000 7f062c9d39c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37]): potential dests added=[] removed=[] 2024-09-12T00:58:14.100 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.110+0000 7f062c9d39c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37.0 2024-09-12T00:58:14.101 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.110+0000 7f062c9d39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:58:14.101 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.110+0000 7f062c9d39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 2024-09-12T00:58:14.104 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.114+0000 7f062c9d39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 info.flags=0x17 2024-09-12T00:58:14.104 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.114+0000 7f062c9d39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 to cache LRU end 2024-09-12T00:58:14.104 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.114+0000 7f062c9d39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:14.104 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.114+0000 7f062c9d39c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37, ofs0, ns] 2024-09-12T00:58:14.105 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.114+0000 7f050d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431567 cookie 94248564728752 notifier 7364 bl.length()=975 2024-09-12T00:58:14.105 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.114+0000 7f050d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 info.flags=0x17 2024-09-12T00:58:14.105 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.114+0000 7f050d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 to cache LRU end 2024-09-12T00:58:14.105 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.114+0000 7f050d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:14.105 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.114+0000 7f062c9d39c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37]): orig_sources= new_sources= 2024-09-12T00:58:14.105 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.114+0000 7f062c9d39c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37]): potential sources added=[] removed=[] 2024-09-12T00:58:14.105 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.114+0000 7f062c9d39c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37]): orig_dests= new_dests= 2024-09-12T00:58:14.105 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.114+0000 7f062c9d39c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37]): potential dests added=[] removed=[] 2024-09-12T00:58:14.107 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.118+0000 7f062c9d39c0 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:58:14.110 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.122+0000 7f04e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:14.115 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.126+0000 7f062c9d39c0 20 remove_watcher() i=0 2024-09-12T00:58:14.116 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.126+0000 7f062c9d39c0 2 removed watcher, disabling cache 2024-09-12T00:58:14.118 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.126+0000 7f062c9d39c0 20 remove_watcher() i=1 2024-09-12T00:58:14.121 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.130+0000 7f062c9d39c0 20 remove_watcher() i=2 2024-09-12T00:58:14.123 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.134+0000 7f062c9d39c0 20 remove_watcher() i=3 2024-09-12T00:58:14.125 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.134+0000 7f062c9d39c0 20 remove_watcher() i=4 2024-09-12T00:58:14.128 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.138+0000 7f062c9d39c0 20 remove_watcher() i=5 2024-09-12T00:58:14.128 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.138+0000 7f062c9d39c0 20 remove_watcher() i=6 2024-09-12T00:58:14.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.138+0000 7f062c9d39c0 20 remove_watcher() i=7 2024-09-12T00:58:14.144 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:58:14.171 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:14.171 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:14.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.222+0000 7f1229d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.212 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.222+0000 7f1229d339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:14.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.222+0000 7f1229d339c0 20 realm 2024-09-12T00:58:14.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.222+0000 7f1229d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.222+0000 7f1229d339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:14.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.222+0000 7f1229d339c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:14.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.222+0000 7f1229d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.222+0000 7f1229d339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:14.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.222+0000 7f1229d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.222+0000 7f1229d339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:14.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.222+0000 7f1229d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.215 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.226+0000 7f1229d339c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:14.215 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.226+0000 7f1229d339c0 20 searching for the correct realm 2024-09-12T00:58:14.221 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.230+0000 7f122803a640 0 -- 172.21.15.70:0/1590465049 >> [v2:172.21.15.70:6808/276433067,v1:172.21.15.70:6809/276433067] conn(0x55e5d25440f0 msgr2=0x55e5d25465b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:14.228 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.238+0000 7f1227839640 0 -- 172.21.15.70:0/1590465049 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f1220008050 msgr2=0x7f1220025920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:14.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.242+0000 7f1229d339c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:14.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.242+0000 7f1229d339c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:58:14.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.242+0000 7f1229d339c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:14.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.242+0000 7f1229d339c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:58:14.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.242+0000 7f1229d339c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:14.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.242+0000 7f1229d339c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:14.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.242+0000 7f1229d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.242+0000 7f1229d339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:14.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.242+0000 7f1229d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.242+0000 7f1229d339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:14.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.242+0000 7f1229d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.246+0000 7f1229d339c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:14.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.246+0000 7f1229d339c0 20 zone default found 2024-09-12T00:58:14.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.246+0000 7f1229d339c0 4 Realm: () 2024-09-12T00:58:14.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.246+0000 7f1229d339c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:58:14.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.246+0000 7f1229d339c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:58:14.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.246+0000 7f1229d339c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:14.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.246+0000 7f1229d339c0 20 zonegroup default 2024-09-12T00:58:14.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.246+0000 7f1229d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.246+0000 7f1229d339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:14.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.246+0000 7f1229d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.246+0000 7f1229d339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:14.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.246+0000 7f1229d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.246+0000 7f1229d339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:14.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.246+0000 7f1229d339c0 20 started sync module instance, tier type = 2024-09-12T00:58:14.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.246+0000 7f1229d339c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:58:14.251 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.262+0000 7f1229d339c0 20 add_watcher() i=0 2024-09-12T00:58:14.251 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.262+0000 7f1229d339c0 20 add_watcher() i=1 2024-09-12T00:58:14.251 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.262+0000 7f1229d339c0 20 add_watcher() i=2 2024-09-12T00:58:14.251 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.262+0000 7f1229d339c0 20 add_watcher() i=3 2024-09-12T00:58:14.251 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.262+0000 7f1229d339c0 20 add_watcher() i=4 2024-09-12T00:58:14.251 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.262+0000 7f1229d339c0 20 add_watcher() i=5 2024-09-12T00:58:14.251 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.262+0000 7f1229d339c0 20 add_watcher() i=6 2024-09-12T00:58:14.252 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.262+0000 7f1229d339c0 20 add_watcher() i=7 2024-09-12T00:58:14.252 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.262+0000 7f1229d339c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:14.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.262+0000 7f10ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:14.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.266+0000 7f1229d339c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:14.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.266+0000 7f1229d339c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:14.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.266+0000 7f1229d339c0 5 note: GC not initialized 2024-09-12T00:58:14.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.266+0000 7f10dcfe1640 20 reqs_thread_entry: start 2024-09-12T00:58:14.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.266+0000 7f1229d339c0 20 init_complete bucket index max shards: 1 2024-09-12T00:58:14.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.266+0000 7f1229d339c0 20 Filter name: none 2024-09-12T00:58:14.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.266+0000 7f10567fc640 20 reqs_thread_entry: start 2024-09-12T00:58:14.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.266+0000 7f1229d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.266+0000 7f1229d339c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:58:14.256 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.266+0000 7f1229d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.258 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.266+0000 7f1229d339c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:58:14.258 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.266+0000 7f1229d339c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:58:14.258 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.266+0000 7f1229d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.266+0000 7f1229d339c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:58:14.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.266+0000 7f1229d339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.270+0000 7f1229d339c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:58:14.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.270+0000 7f1229d339c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:58:14.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.270+0000 7f10ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:14.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.274+0000 7f1229d339c0 20 remove_watcher() i=0 2024-09-12T00:58:14.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.274+0000 7f1229d339c0 2 removed watcher, disabling cache 2024-09-12T00:58:14.267 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.278+0000 7f1229d339c0 20 remove_watcher() i=1 2024-09-12T00:58:14.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.278+0000 7f1229d339c0 20 remove_watcher() i=2 2024-09-12T00:58:14.271 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.282+0000 7f1229d339c0 20 remove_watcher() i=3 2024-09-12T00:58:14.273 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.282+0000 7f1229d339c0 20 remove_watcher() i=4 2024-09-12T00:58:14.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.286+0000 7f1229d339c0 20 remove_watcher() i=5 2024-09-12T00:58:14.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.286+0000 7f1229d339c0 20 remove_watcher() i=6 2024-09-12T00:58:14.277 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.286+0000 7f1229d339c0 20 remove_watcher() i=7 2024-09-12T00:58:14.289 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:14.289 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:58:14.290 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: abort-at-logrecord-writes id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:58:14.290 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:14.291 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:14.291 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:14.294 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:14.294 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:14.341 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:14.341 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:14.363 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-12T00:58:14.363 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:14.364 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:14.365 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:14.383 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:14.383 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:14.430 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:14.431 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:14.450 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:14.450 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:14.468 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:14.468 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:14.486 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:14.487 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:14.505 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:14.505 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:14.526 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:14.526 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:14.544 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:14.544 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:14.563 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:14.563 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:14.581 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:14.581 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:14.600 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:14.600 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:14.618 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:14.618 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:14.638 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:14.639 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:14.657 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:14.657 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:14.674 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:14.675 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:14.693 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:14.693 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:14.713 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:14.713 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:14.731 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:14.732 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:14.750 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:14.750 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:14.769 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:14.769 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:14.788 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:14.789 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:14.805 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:58:14.837 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:14.837 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:14.881 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.890+0000 7f7b144a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.883 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.894+0000 7f7b144a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:14.883 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.894+0000 7f7b144a69c0 20 realm 2024-09-12T00:58:14.883 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.894+0000 7f7b144a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.883 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.894+0000 7f7b144a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:14.883 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.894+0000 7f7b144a69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:14.883 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.894+0000 7f7b144a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.884 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.894+0000 7f7b144a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:14.884 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.894+0000 7f7b144a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.885 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.894+0000 7f7b144a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:14.885 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.894+0000 7f7b144a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:14.886 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.894+0000 7f7b144a69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:14.886 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.894+0000 7f7b144a69c0 20 searching for the correct realm 2024-09-12T00:58:14.890 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:14.898+0000 7f7b127ad640 0 -- 172.21.15.70:0/3578902101 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f7b0803c090 msgr2=0x7f7b08064740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:58:15.104 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.114+0000 7f7b127ad640 0 -- 172.21.15.70:0/3578902101 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f7b0803c090 msgr2=0x7f7b08064740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:15.115 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.126+0000 7f7b144a69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:15.115 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.126+0000 7f7b144a69c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:58:15.116 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.126+0000 7f7b144a69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:15.116 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.126+0000 7f7b144a69c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:58:15.116 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.126+0000 7f7b144a69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:15.116 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.126+0000 7f7b144a69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:15.116 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.126+0000 7f7b144a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.116 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.126+0000 7f7b144a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:15.116 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.126+0000 7f7b144a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.117 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.126+0000 7f7b144a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:15.117 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.126+0000 7f7b144a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.117 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.126+0000 7f7b144a69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:15.118 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.126+0000 7f7b144a69c0 20 zone default found 2024-09-12T00:58:15.118 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.126+0000 7f7b144a69c0 4 Realm: () 2024-09-12T00:58:15.118 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.126+0000 7f7b144a69c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:58:15.118 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.126+0000 7f7b144a69c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:58:15.118 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.126+0000 7f7b144a69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:15.118 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.126+0000 7f7b144a69c0 20 zonegroup default 2024-09-12T00:58:15.118 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.126+0000 7f7b144a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.118 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.126+0000 7f7b144a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:15.118 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.126+0000 7f7b144a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.119 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.130+0000 7f7b144a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:15.119 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.130+0000 7f7b144a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.119 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.130+0000 7f7b144a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:15.119 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.130+0000 7f7b144a69c0 20 started sync module instance, tier type = 2024-09-12T00:58:15.119 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.130+0000 7f7b144a69c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:58:15.143 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.154+0000 7f7b144a69c0 20 add_watcher() i=0 2024-09-12T00:58:15.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.154+0000 7f7b144a69c0 20 add_watcher() i=1 2024-09-12T00:58:15.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.154+0000 7f7b144a69c0 20 add_watcher() i=2 2024-09-12T00:58:15.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.154+0000 7f7b144a69c0 20 add_watcher() i=3 2024-09-12T00:58:15.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.154+0000 7f7b144a69c0 20 add_watcher() i=4 2024-09-12T00:58:15.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.154+0000 7f7b144a69c0 20 add_watcher() i=5 2024-09-12T00:58:15.144 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.154+0000 7f7b144a69c0 20 add_watcher() i=6 2024-09-12T00:58:15.145 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.154+0000 7f7b144a69c0 20 add_watcher() i=7 2024-09-12T00:58:15.146 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.154+0000 7f7b144a69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:15.149 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.158+0000 7f79c7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:15.150 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.158+0000 7f7b144a69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:15.151 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.158+0000 7f7b144a69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:15.151 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.162+0000 7f7b144a69c0 5 note: GC not initialized 2024-09-12T00:58:15.151 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.162+0000 7f79c6fe5640 20 reqs_thread_entry: start 2024-09-12T00:58:15.151 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.162+0000 7f7b144a69c0 20 init_complete bucket index max shards: 1 2024-09-12T00:58:15.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.162+0000 7f7b144a69c0 20 Filter name: none 2024-09-12T00:58:15.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.162+0000 7f79c4fe1640 20 reqs_thread_entry: start 2024-09-12T00:58:15.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.162+0000 7f7b144a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.162+0000 7f7b144a69c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:58:15.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.162+0000 7f7b144a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.166+0000 7f7b144a69c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:58:15.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.166+0000 7f7b144a69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:58:15.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.166+0000 7f7b144a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.156 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.166+0000 7f7b144a69c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:58:15.156 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.166+0000 7f7b144a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.157 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.166+0000 7f7b144a69c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:58:15.157 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.166+0000 7f7b144a69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:58:15.160 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.170+0000 7f79c7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:15.164 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.174+0000 7f7b144a69c0 20 remove_watcher() i=0 2024-09-12T00:58:15.165 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.174+0000 7f7b144a69c0 2 removed watcher, disabling cache 2024-09-12T00:58:15.167 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.178+0000 7f7b144a69c0 20 remove_watcher() i=1 2024-09-12T00:58:15.169 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.178+0000 7f7b144a69c0 20 remove_watcher() i=2 2024-09-12T00:58:15.172 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.182+0000 7f7b144a69c0 20 remove_watcher() i=3 2024-09-12T00:58:15.174 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.182+0000 7f7b144a69c0 20 remove_watcher() i=4 2024-09-12T00:58:15.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.186+0000 7f7b144a69c0 20 remove_watcher() i=5 2024-09-12T00:58:15.177 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.186+0000 7f7b144a69c0 20 remove_watcher() i=6 2024-09-12T00:58:15.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.190+0000 7f7b144a69c0 20 remove_watcher() i=7 2024-09-12T00:58:15.195 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:15.195 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:58:15.195 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-change-reshard-state id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:58:15.195 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:15.195 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-12T00:58:15.228 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:15.229 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:15.272 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.282+0000 7f9ce6edd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.273 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.282+0000 7f9ce6edd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:15.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.282+0000 7f9ce6edd9c0 20 realm 2024-09-12T00:58:15.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.282+0000 7f9ce6edd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.282+0000 7f9ce6edd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:15.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.282+0000 7f9ce6edd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:15.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.282+0000 7f9ce6edd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.282+0000 7f9ce6edd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:15.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.282+0000 7f9ce6edd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.286+0000 7f9ce6edd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:15.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.286+0000 7f9ce6edd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.286+0000 7f9ce6edd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:15.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.286+0000 7f9ce6edd9c0 20 searching for the correct realm 2024-09-12T00:58:15.281 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.290+0000 7f9ce51e4640 0 -- 172.21.15.70:0/498919882 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f9cd8083040 msgr2=0x7f9cd8062cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:15.497 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.506+0000 7f9ce51e4640 0 -- 172.21.15.70:0/498919882 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f9cd8083040 msgr2=0x7f9cd8062cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:15.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.518+0000 7f9ce6edd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:15.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.518+0000 7f9ce6edd9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:58:15.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.518+0000 7f9ce6edd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:15.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.518+0000 7f9ce6edd9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:58:15.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.518+0000 7f9ce6edd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:15.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.518+0000 7f9ce6edd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:15.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.518+0000 7f9ce6edd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.518+0000 7f9ce6edd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:15.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.518+0000 7f9ce6edd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.518+0000 7f9ce6edd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:15.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.518+0000 7f9ce6edd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.522+0000 7f9ce6edd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:15.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.522+0000 7f9ce6edd9c0 20 zone default found 2024-09-12T00:58:15.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.522+0000 7f9ce6edd9c0 4 Realm: () 2024-09-12T00:58:15.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.522+0000 7f9ce6edd9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:58:15.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.522+0000 7f9ce6edd9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:58:15.512 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.522+0000 7f9ce6edd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:15.512 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.522+0000 7f9ce6edd9c0 20 zonegroup default 2024-09-12T00:58:15.512 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.522+0000 7f9ce6edd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.512 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.522+0000 7f9ce6edd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:15.512 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.522+0000 7f9ce6edd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.513 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.522+0000 7f9ce6edd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:15.513 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.522+0000 7f9ce6edd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.513 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.522+0000 7f9ce6edd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:15.513 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.522+0000 7f9ce6edd9c0 20 started sync module instance, tier type = 2024-09-12T00:58:15.513 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.522+0000 7f9ce6edd9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:58:15.537 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.546+0000 7f9ce6edd9c0 20 add_watcher() i=0 2024-09-12T00:58:15.538 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.546+0000 7f9ce6edd9c0 20 add_watcher() i=1 2024-09-12T00:58:15.538 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.546+0000 7f9ce6edd9c0 20 add_watcher() i=2 2024-09-12T00:58:15.538 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.546+0000 7f9ce6edd9c0 20 add_watcher() i=3 2024-09-12T00:58:15.538 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.546+0000 7f9ce6edd9c0 20 add_watcher() i=4 2024-09-12T00:58:15.538 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.546+0000 7f9ce6edd9c0 20 add_watcher() i=5 2024-09-12T00:58:15.538 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.546+0000 7f9ce6edd9c0 20 add_watcher() i=6 2024-09-12T00:58:15.540 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.550+0000 7f9ce6edd9c0 20 add_watcher() i=7 2024-09-12T00:58:15.540 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.550+0000 7f9ce6edd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:15.544 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.554+0000 7f9b9b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:15.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.554+0000 7f9ce6edd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:15.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.554+0000 7f9ce6edd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:15.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.554+0000 7f9ce6edd9c0 5 note: GC not initialized 2024-09-12T00:58:15.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.554+0000 7f9b9a7e4640 20 reqs_thread_entry: start 2024-09-12T00:58:15.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.554+0000 7f9ce6edd9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:58:15.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.554+0000 7f9ce6edd9c0 20 Filter name: none 2024-09-12T00:58:15.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.554+0000 7f9b937fe640 20 reqs_thread_entry: start 2024-09-12T00:58:15.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.554+0000 7f9ce6edd9c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:58:15.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.554+0000 7f9ce6edd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.558+0000 7f9ce6edd9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:58:15.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.558+0000 7f9ce6edd9c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:58:15.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.558+0000 7f9ce6edd9c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:58:15.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.558+0000 7f9ce6edd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 : miss 2024-09-12T00:58:15.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.558+0000 7f9ce6edd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.558+0000 7f9ce6edd9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:58:15.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.558+0000 7f9ce6edd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 info.flags=0x17 2024-09-12T00:58:15.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.558+0000 7f9ce6edd9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 to cache LRU end 2024-09-12T00:58:15.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.558+0000 7f9ce6edd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:58:15.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.558+0000 7f9ce6edd9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:15.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.558+0000 7f9ce6edd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 2024-09-12T00:58:15.557 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.566+0000 7f9ce6edd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 info.flags=0x17 2024-09-12T00:58:15.557 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.566+0000 7f9ce6edd9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 to cache LRU end 2024-09-12T00:58:15.558 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.566+0000 7f9ce6edd9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:15.558 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.566+0000 7f9ce6edd9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38, ofs0, ns] 2024-09-12T00:58:15.558 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.566+0000 7f9bbbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431634 cookie 94690511871712 notifier 7418 bl.length()=1015 2024-09-12T00:58:15.558 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.566+0000 7f9bbbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 info.flags=0x17 2024-09-12T00:58:15.558 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.566+0000 7f9bbbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 to cache LRU end 2024-09-12T00:58:15.558 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.566+0000 7f9bbbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:15.559 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.570+0000 7f9ce6edd9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38]): orig_sources= new_sources= 2024-09-12T00:58:15.559 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.570+0000 7f9ce6edd9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38]): potential sources added=[] removed=[] 2024-09-12T00:58:15.559 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.570+0000 7f9ce6edd9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38]): orig_dests= new_dests= 2024-09-12T00:58:15.560 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.570+0000 7f9ce6edd9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38]): potential dests added=[] removed=[] 2024-09-12T00:58:15.565 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.574+0000 7f9ce6edd9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38.1.0 2024-09-12T00:58:15.565 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.574+0000 7f9ce6edd9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38.1.0 2024-09-12T00:58:15.566 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.574+0000 7f9ce6edd9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38.1.1 2024-09-12T00:58:15.566 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.574+0000 7f9ce6edd9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38.1.1 2024-09-12T00:58:15.566 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.574+0000 7f9ce6edd9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38.0 2024-09-12T00:58:15.571 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.582+0000 7f9ce6edd9c0 -1 Injecting error=-5 at location=change_reshard_state 2024-09-12T00:58:15.571 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.582+0000 7f9ce6edd9c0 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-12T00:58:15.582 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.590+0000 7f9ce6edd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:58:15.582 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.590+0000 7f9ce6edd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 2024-09-12T00:58:15.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.594+0000 7f9ce6edd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 info.flags=0x17 2024-09-12T00:58:15.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.594+0000 7f9ce6edd9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 to cache LRU end 2024-09-12T00:58:15.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.594+0000 7f9ce6edd9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:15.585 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.594+0000 7f9ce6edd9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38, ofs0, ns] 2024-09-12T00:58:15.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.594+0000 7f9bbb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431635 cookie 94690511871712 notifier 7418 bl.length()=983 2024-09-12T00:58:15.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.594+0000 7f9bbb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 info.flags=0x17 2024-09-12T00:58:15.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.594+0000 7f9bbb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 to cache LRU end 2024-09-12T00:58:15.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.594+0000 7f9bbb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:15.587 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.598+0000 7f9ce6edd9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38]): orig_sources= new_sources= 2024-09-12T00:58:15.587 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.598+0000 7f9ce6edd9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38]): potential sources added=[] removed=[] 2024-09-12T00:58:15.587 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.598+0000 7f9ce6edd9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38]): orig_dests= new_dests= 2024-09-12T00:58:15.587 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.598+0000 7f9ce6edd9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38]): potential dests added=[] removed=[] 2024-09-12T00:58:15.587 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.598+0000 7f9ce6edd9c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-12T00:58:15.590 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.598+0000 7f9b9b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:15.595 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.606+0000 7f9ce6edd9c0 20 remove_watcher() i=0 2024-09-12T00:58:15.595 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.606+0000 7f9ce6edd9c0 2 removed watcher, disabling cache 2024-09-12T00:58:15.600 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.606+0000 7f9ce6edd9c0 20 remove_watcher() i=1 2024-09-12T00:58:15.600 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.610+0000 7f9ce6edd9c0 20 remove_watcher() i=2 2024-09-12T00:58:15.602 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.610+0000 7f9ce6edd9c0 20 remove_watcher() i=3 2024-09-12T00:58:15.605 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.614+0000 7f9ce6edd9c0 20 remove_watcher() i=4 2024-09-12T00:58:15.606 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.618+0000 7f9ce6edd9c0 20 remove_watcher() i=5 2024-09-12T00:58:15.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.618+0000 7f9ce6edd9c0 20 remove_watcher() i=6 2024-09-12T00:58:15.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.618+0000 7f9ce6edd9c0 20 remove_watcher() i=7 2024-09-12T00:58:15.626 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:58:15.657 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:15.658 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:15.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.710+0000 7f2d20f049c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.714+0000 7f2d20f049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:15.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.714+0000 7f2d20f049c0 20 realm 2024-09-12T00:58:15.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.714+0000 7f2d20f049c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.714+0000 7f2d20f049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:15.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.714+0000 7f2d20f049c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:15.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.714+0000 7f2d20f049c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.714+0000 7f2d20f049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:15.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.714+0000 7f2d20f049c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.714+0000 7f2d20f049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:15.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.714+0000 7f2d20f049c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.714+0000 7f2d20f049c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:15.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.714+0000 7f2d20f049c0 20 searching for the correct realm 2024-09-12T00:58:15.710 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.718+0000 7f2d1f20b640 0 -- 172.21.15.70:0/299810787 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f2d10036040 msgr2=0x7f2d1004e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:15.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.930+0000 7f2d1e209640 0 -- 172.21.15.70:0/299810787 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7f2d08028020 msgr2=0x7f2d080087a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:15.938 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.946+0000 7f2d20f049c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:15.938 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.946+0000 7f2d20f049c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:58:15.938 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.946+0000 7f2d20f049c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:15.938 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.946+0000 7f2d20f049c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:58:15.938 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.946+0000 7f2d20f049c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:15.938 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.946+0000 7f2d20f049c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:15.938 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.946+0000 7f2d20f049c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.938 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.946+0000 7f2d20f049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:15.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.946+0000 7f2d20f049c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.950+0000 7f2d20f049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:15.939 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.950+0000 7f2d20f049c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.950+0000 7f2d20f049c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:15.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.950+0000 7f2d20f049c0 20 zone default found 2024-09-12T00:58:15.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.950+0000 7f2d20f049c0 4 Realm: () 2024-09-12T00:58:15.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.950+0000 7f2d20f049c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:58:15.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.950+0000 7f2d20f049c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:58:15.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.950+0000 7f2d20f049c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:15.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.950+0000 7f2d20f049c0 20 zonegroup default 2024-09-12T00:58:15.940 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.950+0000 7f2d20f049c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.950+0000 7f2d20f049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:15.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.950+0000 7f2d20f049c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.950+0000 7f2d20f049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:15.941 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.950+0000 7f2d20f049c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.942 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.950+0000 7f2d20f049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:15.942 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.950+0000 7f2d20f049c0 20 started sync module instance, tier type = 2024-09-12T00:58:15.942 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.950+0000 7f2d20f049c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:58:15.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.974+0000 7f2d20f049c0 20 add_watcher() i=0 2024-09-12T00:58:15.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.974+0000 7f2d20f049c0 20 add_watcher() i=1 2024-09-12T00:58:15.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.974+0000 7f2d20f049c0 20 add_watcher() i=2 2024-09-12T00:58:15.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.974+0000 7f2d20f049c0 20 add_watcher() i=3 2024-09-12T00:58:15.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.974+0000 7f2d20f049c0 20 add_watcher() i=4 2024-09-12T00:58:15.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.974+0000 7f2d20f049c0 20 add_watcher() i=5 2024-09-12T00:58:15.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.974+0000 7f2d20f049c0 20 add_watcher() i=6 2024-09-12T00:58:15.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.978+0000 7f2d20f049c0 20 add_watcher() i=7 2024-09-12T00:58:15.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.978+0000 7f2d20f049c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:15.972 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.982+0000 7f2bd57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:15.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.982+0000 7f2d20f049c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:15.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.982+0000 7f2d20f049c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:15.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.982+0000 7f2d20f049c0 5 note: GC not initialized 2024-09-12T00:58:15.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.982+0000 7f2b4ffff640 20 reqs_thread_entry: start 2024-09-12T00:58:15.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.982+0000 7f2d20f049c0 20 init_complete bucket index max shards: 1 2024-09-12T00:58:15.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.982+0000 7f2d20f049c0 20 Filter name: none 2024-09-12T00:58:15.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.986+0000 7f2b4dffb640 20 reqs_thread_entry: start 2024-09-12T00:58:15.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.986+0000 7f2d20f049c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.976 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.986+0000 7f2d20f049c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:58:15.976 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.986+0000 7f2d20f049c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.977 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.986+0000 7f2d20f049c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:58:15.977 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.986+0000 7f2d20f049c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:58:15.977 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.986+0000 7f2d20f049c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.978 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.986+0000 7f2d20f049c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:58:15.978 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.986+0000 7f2d20f049c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:15.979 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.990+0000 7f2d20f049c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:58:15.979 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.990+0000 7f2d20f049c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:58:15.981 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.990+0000 7f2bd57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:15.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.998+0000 7f2d20f049c0 20 remove_watcher() i=0 2024-09-12T00:58:15.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.998+0000 7f2d20f049c0 2 removed watcher, disabling cache 2024-09-12T00:58:15.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:15.998+0000 7f2d20f049c0 20 remove_watcher() i=1 2024-09-12T00:58:15.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.002+0000 7f2d20f049c0 20 remove_watcher() i=2 2024-09-12T00:58:15.994 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.002+0000 7f2d20f049c0 20 remove_watcher() i=3 2024-09-12T00:58:15.996 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.006+0000 7f2d20f049c0 20 remove_watcher() i=4 2024-09-12T00:58:15.998 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.006+0000 7f2d20f049c0 20 remove_watcher() i=5 2024-09-12T00:58:15.999 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.010+0000 7f2d20f049c0 20 remove_watcher() i=6 2024-09-12T00:58:16.000 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.010+0000 7f2d20f049c0 20 remove_watcher() i=7 2024-09-12T00:58:16.020 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:16.020 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:58:16.020 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-change-reshard-state id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:58:16.020 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:16.021 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:16.021 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:16.036 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:16.036 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:16.080 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:58:16.115 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:16.115 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:16.159 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.166+0000 7fee6656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.160 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.170+0000 7fee6656b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:16.160 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.170+0000 7fee6656b9c0 20 realm 2024-09-12T00:58:16.160 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.170+0000 7fee6656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.161 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.170+0000 7fee6656b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:16.161 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.170+0000 7fee6656b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:16.161 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.170+0000 7fee6656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.161 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.170+0000 7fee6656b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:16.161 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.170+0000 7fee6656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.162 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.170+0000 7fee6656b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:16.162 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.170+0000 7fee6656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.163 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.174+0000 7fee6656b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:16.163 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.174+0000 7fee6656b9c0 20 searching for the correct realm 2024-09-12T00:58:16.167 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.178+0000 7fee64872640 0 -- 172.21.15.70:0/2148655765 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fee58001210 msgr2=0x7fee581072c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:16.176 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.186+0000 7fee64872640 0 -- 172.21.15.70:0/2148655765 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fed2c080830 msgr2=0x7fed2c082c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:16.183 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.194+0000 7fee6656b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:16.183 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.194+0000 7fee6656b9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:58:16.183 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.194+0000 7fee6656b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:16.183 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.194+0000 7fee6656b9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:58:16.183 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.194+0000 7fee6656b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:16.184 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.194+0000 7fee6656b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:16.184 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.194+0000 7fee6656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.184 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.194+0000 7fee6656b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:16.184 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.194+0000 7fee6656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.185 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.194+0000 7fee6656b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:16.185 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.194+0000 7fee6656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.185 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.194+0000 7fee6656b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:16.185 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.194+0000 7fee6656b9c0 20 zone default found 2024-09-12T00:58:16.185 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.194+0000 7fee6656b9c0 4 Realm: () 2024-09-12T00:58:16.185 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.194+0000 7fee6656b9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:58:16.185 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.194+0000 7fee6656b9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:58:16.185 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.194+0000 7fee6656b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:16.185 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.194+0000 7fee6656b9c0 20 zonegroup default 2024-09-12T00:58:16.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.194+0000 7fee6656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.194+0000 7fee6656b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:16.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.194+0000 7fee6656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.194+0000 7fee6656b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:16.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.194+0000 7fee6656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.194+0000 7fee6656b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:16.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.194+0000 7fee6656b9c0 20 started sync module instance, tier type = 2024-09-12T00:58:16.187 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.194+0000 7fee6656b9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:58:16.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.210+0000 7fee6656b9c0 20 add_watcher() i=0 2024-09-12T00:58:16.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.210+0000 7fee6656b9c0 20 add_watcher() i=1 2024-09-12T00:58:16.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.210+0000 7fee6656b9c0 20 add_watcher() i=2 2024-09-12T00:58:16.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.210+0000 7fee6656b9c0 20 add_watcher() i=3 2024-09-12T00:58:16.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.210+0000 7fee6656b9c0 20 add_watcher() i=4 2024-09-12T00:58:16.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.210+0000 7fee6656b9c0 20 add_watcher() i=5 2024-09-12T00:58:16.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.210+0000 7fee6656b9c0 20 add_watcher() i=6 2024-09-12T00:58:16.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.214+0000 7fee6656b9c0 20 add_watcher() i=7 2024-09-12T00:58:16.203 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.214+0000 7fee6656b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:16.209 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.214+0000 7fed1afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:16.210 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.214+0000 7fee6656b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:16.210 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.214+0000 7fee6656b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:16.210 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.214+0000 7fee6656b9c0 5 note: GC not initialized 2024-09-12T00:58:16.210 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.214+0000 7fed19fdb640 20 reqs_thread_entry: start 2024-09-12T00:58:16.210 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.214+0000 7fee6656b9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:58:16.210 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.218+0000 7fee6656b9c0 20 Filter name: none 2024-09-12T00:58:16.210 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.218+0000 7fec8b7fe640 20 reqs_thread_entry: start 2024-09-12T00:58:16.210 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.218+0000 7fee6656b9c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:58:16.210 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.218+0000 7fee6656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.210 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.218+0000 7fee6656b9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:58:16.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.218+0000 7fee6656b9c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:58:16.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.218+0000 7fee6656b9c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:58:16.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.218+0000 7fee6656b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 : miss 2024-09-12T00:58:16.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.218+0000 7fee6656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.218+0000 7fee6656b9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:58:16.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.218+0000 7fee6656b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 info.flags=0x17 2024-09-12T00:58:16.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.218+0000 7fee6656b9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 to cache LRU end 2024-09-12T00:58:16.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.218+0000 7fee6656b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:58:16.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.218+0000 7fee6656b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:16.211 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.218+0000 7fee6656b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 2024-09-12T00:58:16.216 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.226+0000 7fee6656b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 info.flags=0x17 2024-09-12T00:58:16.216 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.226+0000 7fee6656b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 to cache LRU end 2024-09-12T00:58:16.216 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.226+0000 7fee6656b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:16.216 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.226+0000 7fee6656b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38, ofs0, ns] 2024-09-12T00:58:16.216 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.226+0000 7fed3affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431636 cookie 94183269852160 notifier 7451 bl.length()=1015 2024-09-12T00:58:16.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.226+0000 7fed3affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 info.flags=0x17 2024-09-12T00:58:16.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.226+0000 7fed3affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 to cache LRU end 2024-09-12T00:58:16.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.226+0000 7fed3affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:16.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.226+0000 7fee6656b9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38]): orig_sources= new_sources= 2024-09-12T00:58:16.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.226+0000 7fee6656b9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38]): potential sources added=[] removed=[] 2024-09-12T00:58:16.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.226+0000 7fee6656b9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38]): orig_dests= new_dests= 2024-09-12T00:58:16.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.226+0000 7fee6656b9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38]): potential dests added=[] removed=[] 2024-09-12T00:58:16.224 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.234+0000 7fee6656b9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38.1.0 2024-09-12T00:58:16.224 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.234+0000 7fee6656b9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38.1.0 2024-09-12T00:58:16.224 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.234+0000 7fee6656b9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38.1.1 2024-09-12T00:58:16.224 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.234+0000 7fee6656b9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38.1.1 2024-09-12T00:58:16.224 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.234+0000 7fee6656b9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38.0 2024-09-12T00:58:16.228 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.238+0000 7fee6656b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:58:16.228 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.238+0000 7fee6656b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 2024-09-12T00:58:16.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.242+0000 7fee6656b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 info.flags=0x17 2024-09-12T00:58:16.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.242+0000 7fee6656b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 to cache LRU end 2024-09-12T00:58:16.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.242+0000 7fee6656b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:16.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.242+0000 7fee6656b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38, ofs0, ns] 2024-09-12T00:58:16.232 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.242+0000 7fed3b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431637 cookie 94183269852160 notifier 7451 bl.length()=1015 2024-09-12T00:58:16.232 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.242+0000 7fed3b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 info.flags=0x17 2024-09-12T00:58:16.232 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.242+0000 7fed3b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 to cache LRU end 2024-09-12T00:58:16.232 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.242+0000 7fed3b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:16.233 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.242+0000 7fee6656b9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38]): orig_sources= new_sources= 2024-09-12T00:58:16.233 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.242+0000 7fee6656b9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38]): potential sources added=[] removed=[] 2024-09-12T00:58:16.233 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.242+0000 7fee6656b9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38]): orig_dests= new_dests= 2024-09-12T00:58:16.233 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.242+0000 7fee6656b9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38]): potential dests added=[] removed=[] 2024-09-12T00:58:16.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.246+0000 7fee6656b9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38.0 2024-09-12T00:58:16.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.246+0000 7fee6656b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:58:16.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.246+0000 7fee6656b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 2024-09-12T00:58:16.241 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.250+0000 7fee6656b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 info.flags=0x17 2024-09-12T00:58:16.241 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.250+0000 7fee6656b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 to cache LRU end 2024-09-12T00:58:16.241 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.250+0000 7fee6656b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:16.241 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.250+0000 7fee6656b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38, ofs0, ns] 2024-09-12T00:58:16.242 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.250+0000 7fed3affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431638 cookie 94183269852160 notifier 7451 bl.length()=983 2024-09-12T00:58:16.242 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.250+0000 7fed3affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 info.flags=0x17 2024-09-12T00:58:16.242 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.250+0000 7fed3affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 to cache LRU end 2024-09-12T00:58:16.242 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.250+0000 7fed3affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:16.243 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.254+0000 7fee6656b9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38]): orig_sources= new_sources= 2024-09-12T00:58:16.243 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.254+0000 7fee6656b9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38]): potential sources added=[] removed=[] 2024-09-12T00:58:16.243 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.254+0000 7fee6656b9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38]): orig_dests= new_dests= 2024-09-12T00:58:16.243 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.254+0000 7fee6656b9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38]): potential dests added=[] removed=[] 2024-09-12T00:58:16.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.254+0000 7fee6656b9c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T00:58:16.248 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.258+0000 7fed1afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:16.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.262+0000 7fee6656b9c0 20 remove_watcher() i=0 2024-09-12T00:58:16.253 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.262+0000 7fee6656b9c0 2 removed watcher, disabling cache 2024-09-12T00:58:16.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.266+0000 7fee6656b9c0 20 remove_watcher() i=1 2024-09-12T00:58:16.258 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.266+0000 7fee6656b9c0 20 remove_watcher() i=2 2024-09-12T00:58:16.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.270+0000 7fee6656b9c0 20 remove_watcher() i=3 2024-09-12T00:58:16.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.270+0000 7fee6656b9c0 20 remove_watcher() i=4 2024-09-12T00:58:16.264 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.274+0000 7fee6656b9c0 20 remove_watcher() i=5 2024-09-12T00:58:16.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.274+0000 7fee6656b9c0 20 remove_watcher() i=6 2024-09-12T00:58:16.267 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.278+0000 7fee6656b9c0 20 remove_watcher() i=7 2024-09-12T00:58:16.284 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:58:16.311 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:16.312 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:16.355 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.366+0000 7f692a4339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.366+0000 7f692a4339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:16.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.366+0000 7f692a4339c0 20 realm 2024-09-12T00:58:16.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.366+0000 7f692a4339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.366+0000 7f692a4339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:16.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.366+0000 7f692a4339c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:16.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.366+0000 7f692a4339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.366+0000 7f692a4339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:16.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.366+0000 7f692a4339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.370+0000 7f692a4339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:16.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.370+0000 7f692a4339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.370+0000 7f692a4339c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:16.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.370+0000 7f692a4339c0 20 searching for the correct realm 2024-09-12T00:58:16.365 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.374+0000 7f692873a640 0 -- 172.21.15.70:0/2381602643 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f691c0eab70 msgr2=0x7f691c0e2410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:58:16.374 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.382+0000 7f692873a640 0 -- 172.21.15.70:0/2381602643 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f67f0080880 msgr2=0x7f67f0082cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:16.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.390+0000 7f692a4339c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:16.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.390+0000 7f692a4339c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:58:16.381 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.390+0000 7f692a4339c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:16.381 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.390+0000 7f692a4339c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:58:16.381 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.390+0000 7f692a4339c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:16.381 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.390+0000 7f692a4339c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:16.381 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.390+0000 7f692a4339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.381 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.390+0000 7f692a4339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:16.381 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.390+0000 7f692a4339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.382 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.390+0000 7f692a4339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:16.382 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.390+0000 7f692a4339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.382 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.390+0000 7f692a4339c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:16.382 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.390+0000 7f692a4339c0 20 zone default found 2024-09-12T00:58:16.382 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.390+0000 7f692a4339c0 4 Realm: () 2024-09-12T00:58:16.382 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.390+0000 7f692a4339c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:58:16.382 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.390+0000 7f692a4339c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:58:16.382 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.390+0000 7f692a4339c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:16.383 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.390+0000 7f692a4339c0 20 zonegroup default 2024-09-12T00:58:16.383 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.390+0000 7f692a4339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.383 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.390+0000 7f692a4339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:16.383 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.390+0000 7f692a4339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.383 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.394+0000 7f692a4339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:16.383 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.394+0000 7f692a4339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.384 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.394+0000 7f692a4339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:16.384 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.394+0000 7f692a4339c0 20 started sync module instance, tier type = 2024-09-12T00:58:16.384 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.394+0000 7f692a4339c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:58:16.398 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.406+0000 7f692a4339c0 20 add_watcher() i=0 2024-09-12T00:58:16.398 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.406+0000 7f692a4339c0 20 add_watcher() i=1 2024-09-12T00:58:16.399 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.406+0000 7f692a4339c0 20 add_watcher() i=2 2024-09-12T00:58:16.399 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.406+0000 7f692a4339c0 20 add_watcher() i=3 2024-09-12T00:58:16.399 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.406+0000 7f692a4339c0 20 add_watcher() i=4 2024-09-12T00:58:16.399 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.406+0000 7f692a4339c0 20 add_watcher() i=5 2024-09-12T00:58:16.399 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.406+0000 7f692a4339c0 20 add_watcher() i=6 2024-09-12T00:58:16.399 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.410+0000 7f692a4339c0 20 add_watcher() i=7 2024-09-12T00:58:16.399 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.410+0000 7f692a4339c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:16.402 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.410+0000 7f67ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:16.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.414+0000 7f692a4339c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:16.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.414+0000 7f692a4339c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:16.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.414+0000 7f692a4339c0 5 note: GC not initialized 2024-09-12T00:58:16.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.414+0000 7f67dcfe1640 20 reqs_thread_entry: start 2024-09-12T00:58:16.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.414+0000 7f692a4339c0 20 init_complete bucket index max shards: 1 2024-09-12T00:58:16.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.414+0000 7f692a4339c0 20 Filter name: none 2024-09-12T00:58:16.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.414+0000 7f67567fc640 20 reqs_thread_entry: start 2024-09-12T00:58:16.404 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.414+0000 7f692a4339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.404 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.414+0000 7f692a4339c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:58:16.404 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.414+0000 7f692a4339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.406 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.414+0000 7f692a4339c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:58:16.406 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.414+0000 7f692a4339c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:58:16.406 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.414+0000 7f692a4339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.406 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.414+0000 7f692a4339c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:58:16.406 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.414+0000 7f692a4339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:16.407 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.418+0000 7f692a4339c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:58:16.407 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.418+0000 7f692a4339c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:58:16.409 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.418+0000 7f67ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:16.414 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.422+0000 7f692a4339c0 20 remove_watcher() i=0 2024-09-12T00:58:16.414 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.422+0000 7f692a4339c0 2 removed watcher, disabling cache 2024-09-12T00:58:16.416 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.426+0000 7f692a4339c0 20 remove_watcher() i=1 2024-09-12T00:58:16.418 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.426+0000 7f692a4339c0 20 remove_watcher() i=2 2024-09-12T00:58:16.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.430+0000 7f692a4339c0 20 remove_watcher() i=3 2024-09-12T00:58:16.422 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.430+0000 7f692a4339c0 20 remove_watcher() i=4 2024-09-12T00:58:16.423 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.434+0000 7f692a4339c0 20 remove_watcher() i=5 2024-09-12T00:58:16.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.434+0000 7f692a4339c0 20 remove_watcher() i=6 2024-09-12T00:58:16.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:16.434+0000 7f692a4339c0 20 remove_watcher() i=7 2024-09-12T00:58:16.439 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:16.440 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:58:16.440 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-change-reshard-state id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:58:16.440 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:16.441 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:16.441 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:16.444 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:16.444 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:16.488 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:16.489 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:16.510 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-12T00:58:16.511 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:16.511 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:16.511 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:16.530 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:16.530 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:16.578 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:16.578 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:16.596 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:16.597 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:16.615 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:16.615 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:16.634 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:16.634 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:16.654 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:16.655 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:16.672 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:16.673 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:16.691 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:16.691 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:16.709 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:16.709 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:16.728 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:16.728 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:16.745 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:16.745 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:16.763 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:16.764 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:16.783 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:16.783 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:16.802 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:16.802 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:16.820 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:16.821 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:16.838 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:16.838 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:16.857 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:16.857 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:16.876 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:16.876 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:16.893 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:16.893 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:16.910 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:16.911 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:16.931 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:16.931 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:16.948 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:58:16.981 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:16.981 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:17.025 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.034+0000 7fdc2f81c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.038+0000 7fdc2f81c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.038+0000 7fdc2f81c9c0 20 realm 2024-09-12T00:58:17.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.038+0000 7fdc2f81c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.038+0000 7fdc2f81c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.038+0000 7fdc2f81c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:17.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.038+0000 7fdc2f81c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.038+0000 7fdc2f81c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.038+0000 7fdc2f81c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.028 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.038+0000 7fdc2f81c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:17.029 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.038+0000 7fdc2f81c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.029 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.038+0000 7fdc2f81c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:17.029 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.038+0000 7fdc2f81c9c0 20 searching for the correct realm 2024-09-12T00:58:17.036 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.046+0000 7fdc2d322640 0 -- 172.21.15.70:0/2234501484 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7fdc280b7430 msgr2=0x7fdc280b7890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:17.042 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.050+0000 7fdc2d322640 0 -- 172.21.15.70:0/2234501484 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7fdaf8080880 msgr2=0x7fdaf8082cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:58:17.049 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.058+0000 7fdc2f81c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:17.049 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.058+0000 7fdc2f81c9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:58:17.050 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.058+0000 7fdc2f81c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:17.050 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.058+0000 7fdc2f81c9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:58:17.050 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.058+0000 7fdc2f81c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:17.050 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.058+0000 7fdc2f81c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:17.050 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.058+0000 7fdc2f81c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.050 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.058+0000 7fdc2f81c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.050 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.058+0000 7fdc2f81c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.058+0000 7fdc2f81c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:17.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.058+0000 7fdc2f81c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.058+0000 7fdc2f81c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:17.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.058+0000 7fdc2f81c9c0 20 zone default found 2024-09-12T00:58:17.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.058+0000 7fdc2f81c9c0 4 Realm: () 2024-09-12T00:58:17.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.058+0000 7fdc2f81c9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:58:17.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.058+0000 7fdc2f81c9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:58:17.051 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.058+0000 7fdc2f81c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:17.052 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.058+0000 7fdc2f81c9c0 20 zonegroup default 2024-09-12T00:58:17.052 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.058+0000 7fdc2f81c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.052 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.062+0000 7fdc2f81c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.052 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.062+0000 7fdc2f81c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.052 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.062+0000 7fdc2f81c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.052 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.062+0000 7fdc2f81c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.053 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.062+0000 7fdc2f81c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.053 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.062+0000 7fdc2f81c9c0 20 started sync module instance, tier type = 2024-09-12T00:58:17.053 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.062+0000 7fdc2f81c9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:58:17.068 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.078+0000 7fdc2f81c9c0 20 add_watcher() i=0 2024-09-12T00:58:17.068 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.078+0000 7fdc2f81c9c0 20 add_watcher() i=1 2024-09-12T00:58:17.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.078+0000 7fdc2f81c9c0 20 add_watcher() i=2 2024-09-12T00:58:17.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.078+0000 7fdc2f81c9c0 20 add_watcher() i=3 2024-09-12T00:58:17.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.078+0000 7fdc2f81c9c0 20 add_watcher() i=4 2024-09-12T00:58:17.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.078+0000 7fdc2f81c9c0 20 add_watcher() i=5 2024-09-12T00:58:17.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.078+0000 7fdc2f81c9c0 20 add_watcher() i=6 2024-09-12T00:58:17.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.078+0000 7fdc2f81c9c0 20 add_watcher() i=7 2024-09-12T00:58:17.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.078+0000 7fdc2f81c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:17.071 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.082+0000 7fdae37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:17.072 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.082+0000 7fdc2f81c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:17.073 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.082+0000 7fdc2f81c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:17.073 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.082+0000 7fdc2f81c9c0 5 note: GC not initialized 2024-09-12T00:58:17.073 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.082+0000 7fdae27e4640 20 reqs_thread_entry: start 2024-09-12T00:58:17.073 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.082+0000 7fdc2f81c9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:58:17.073 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.082+0000 7fdc2f81c9c0 20 Filter name: none 2024-09-12T00:58:17.073 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.082+0000 7fda53fff640 20 reqs_thread_entry: start 2024-09-12T00:58:17.073 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.082+0000 7fdc2f81c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.074 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.082+0000 7fdc2f81c9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:58:17.074 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.082+0000 7fdc2f81c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.086+0000 7fdc2f81c9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:58:17.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.086+0000 7fdc2f81c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:58:17.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.086+0000 7fdc2f81c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.086+0000 7fdc2f81c9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:58:17.076 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.086+0000 7fdc2f81c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.077 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.086+0000 7fdc2f81c9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:58:17.077 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.086+0000 7fdc2f81c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:58:17.078 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.086+0000 7fdae37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:17.083 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.094+0000 7fdc2f81c9c0 20 remove_watcher() i=0 2024-09-12T00:58:17.083 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.094+0000 7fdc2f81c9c0 2 removed watcher, disabling cache 2024-09-12T00:58:17.086 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.094+0000 7fdc2f81c9c0 20 remove_watcher() i=1 2024-09-12T00:58:17.088 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.098+0000 7fdc2f81c9c0 20 remove_watcher() i=2 2024-09-12T00:58:17.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.098+0000 7fdc2f81c9c0 20 remove_watcher() i=3 2024-09-12T00:58:17.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.102+0000 7fdc2f81c9c0 20 remove_watcher() i=4 2024-09-12T00:58:17.093 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.102+0000 7fdc2f81c9c0 20 remove_watcher() i=5 2024-09-12T00:58:17.094 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.102+0000 7fdc2f81c9c0 20 remove_watcher() i=6 2024-09-12T00:58:17.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.106+0000 7fdc2f81c9c0 20 remove_watcher() i=7 2024-09-12T00:58:17.109 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:17.109 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:58:17.109 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-change-reshard-state id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:58:17.109 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:17.109 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-12T00:58:17.144 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:17.144 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:17.186 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.194+0000 7fd6ded2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.188 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.198+0000 7fd6ded2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.188 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.198+0000 7fd6ded2a9c0 20 realm 2024-09-12T00:58:17.189 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.198+0000 7fd6ded2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.189 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.198+0000 7fd6ded2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.189 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.198+0000 7fd6ded2a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:17.189 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.198+0000 7fd6ded2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.189 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.198+0000 7fd6ded2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.189 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.198+0000 7fd6ded2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.190 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.198+0000 7fd6ded2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:17.190 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.198+0000 7fd6ded2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.191 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.202+0000 7fd6ded2a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:17.191 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.202+0000 7fd6ded2a9c0 20 searching for the correct realm 2024-09-12T00:58:17.195 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.206+0000 7fd6dd031640 0 -- 172.21.15.70:0/144612474 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fd6d009d040 msgr2=0x7fd6d0067970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:17.412 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.422+0000 7fd6dd031640 0 -- 172.21.15.70:0/144612474 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fd6d009d040 msgr2=0x7fd6d0067970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:17.424 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.434+0000 7fd6ded2a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:17.424 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.434+0000 7fd6ded2a9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:58:17.424 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.434+0000 7fd6ded2a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:17.424 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.434+0000 7fd6ded2a9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:58:17.424 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.434+0000 7fd6ded2a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:17.424 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.434+0000 7fd6ded2a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:17.424 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.434+0000 7fd6ded2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.424 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.434+0000 7fd6ded2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.434+0000 7fd6ded2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.434+0000 7fd6ded2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:17.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.434+0000 7fd6ded2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.434+0000 7fd6ded2a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:17.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.434+0000 7fd6ded2a9c0 20 zone default found 2024-09-12T00:58:17.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.434+0000 7fd6ded2a9c0 4 Realm: () 2024-09-12T00:58:17.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.434+0000 7fd6ded2a9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:58:17.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.434+0000 7fd6ded2a9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:58:17.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.434+0000 7fd6ded2a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:17.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.434+0000 7fd6ded2a9c0 20 zonegroup default 2024-09-12T00:58:17.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.434+0000 7fd6ded2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.438+0000 7fd6ded2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.438+0000 7fd6ded2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.428 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.438+0000 7fd6ded2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.428 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.438+0000 7fd6ded2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.429 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.438+0000 7fd6ded2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.429 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.438+0000 7fd6ded2a9c0 20 started sync module instance, tier type = 2024-09-12T00:58:17.429 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.438+0000 7fd6ded2a9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:58:17.452 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.462+0000 7fd6ded2a9c0 20 add_watcher() i=0 2024-09-12T00:58:17.452 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.462+0000 7fd6ded2a9c0 20 add_watcher() i=1 2024-09-12T00:58:17.453 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.462+0000 7fd6ded2a9c0 20 add_watcher() i=2 2024-09-12T00:58:17.453 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.462+0000 7fd6ded2a9c0 20 add_watcher() i=3 2024-09-12T00:58:17.453 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.462+0000 7fd6ded2a9c0 20 add_watcher() i=4 2024-09-12T00:58:17.453 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.462+0000 7fd6ded2a9c0 20 add_watcher() i=5 2024-09-12T00:58:17.453 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.462+0000 7fd6ded2a9c0 20 add_watcher() i=6 2024-09-12T00:58:17.454 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.462+0000 7fd6ded2a9c0 20 add_watcher() i=7 2024-09-12T00:58:17.454 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.462+0000 7fd6ded2a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:17.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.466+0000 7fd5937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:17.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.470+0000 7fd6ded2a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:17.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.470+0000 7fd6ded2a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:17.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.470+0000 7fd6ded2a9c0 5 note: GC not initialized 2024-09-12T00:58:17.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.470+0000 7fd5927e4640 20 reqs_thread_entry: start 2024-09-12T00:58:17.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.470+0000 7fd6ded2a9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:58:17.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.470+0000 7fd6ded2a9c0 20 Filter name: none 2024-09-12T00:58:17.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.470+0000 7fd58b7fe640 20 reqs_thread_entry: start 2024-09-12T00:58:17.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.470+0000 7fd6ded2a9c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:58:17.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.470+0000 7fd6ded2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.470+0000 7fd6ded2a9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:58:17.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.470+0000 7fd6ded2a9c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:58:17.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.470+0000 7fd6ded2a9c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:58:17.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.470+0000 7fd6ded2a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39 : miss 2024-09-12T00:58:17.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.470+0000 7fd6ded2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.474+0000 7fd6ded2a9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:58:17.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.474+0000 7fd6ded2a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39 info.flags=0x17 2024-09-12T00:58:17.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.474+0000 7fd6ded2a9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39 to cache LRU end 2024-09-12T00:58:17.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.474+0000 7fd6ded2a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:58:17.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.474+0000 7fd6ded2a9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:17.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.474+0000 7fd6ded2a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39 2024-09-12T00:58:17.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.482+0000 7fd6ded2a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39 info.flags=0x17 2024-09-12T00:58:17.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.482+0000 7fd6ded2a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39 to cache LRU end 2024-09-12T00:58:17.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.482+0000 7fd6ded2a9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:17.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.482+0000 7fd6ded2a9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39, ofs0, ns] 2024-09-12T00:58:17.473 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.482+0000 7fd5b3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431641 cookie 94802822396928 notifier 8010 bl.length()=1015 2024-09-12T00:58:17.473 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.482+0000 7fd5b3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39 info.flags=0x17 2024-09-12T00:58:17.473 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.482+0000 7fd5b3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39 to cache LRU end 2024-09-12T00:58:17.473 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.482+0000 7fd5b3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:17.474 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.482+0000 7fd6ded2a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39]): orig_sources= new_sources= 2024-09-12T00:58:17.474 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.482+0000 7fd6ded2a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39]): potential sources added=[] removed=[] 2024-09-12T00:58:17.474 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.482+0000 7fd6ded2a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39]): orig_dests= new_dests= 2024-09-12T00:58:17.474 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.482+0000 7fd6ded2a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39]): potential dests added=[] removed=[] 2024-09-12T00:58:17.478 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.486+0000 7fd6ded2a9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39.1.0 2024-09-12T00:58:17.478 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.486+0000 7fd6ded2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39.1.0 2024-09-12T00:58:17.479 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.486+0000 7fd6ded2a9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39.1.1 2024-09-12T00:58:17.479 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.486+0000 7fd6ded2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39.1.1 2024-09-12T00:58:17.479 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.486+0000 7fd6ded2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39.0 2024-09-12T00:58:17.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.494+0000 7fd6ded2a9c0 -1 Injecting error=-125 at location=change_reshard_state 2024-09-12T00:58:17.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.494+0000 7fd6ded2a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39 : hit (requested=0x17, cached=0x17) 2024-09-12T00:58:17.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.494+0000 7fd6ded2a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39 2024-09-12T00:58:17.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.494+0000 7fd6ded2a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39 info.flags=0x17 2024-09-12T00:58:17.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.494+0000 7fd6ded2a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39 to cache LRU end 2024-09-12T00:58:17.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.494+0000 7fd6ded2a9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:17.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.494+0000 7fd6ded2a9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39, ofs0, ns] 2024-09-12T00:58:17.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.498+0000 7fd5b3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431642 cookie 94802822396928 notifier 8010 bl.length()=1015 2024-09-12T00:58:17.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.498+0000 7fd5b3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39 info.flags=0x17 2024-09-12T00:58:17.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.498+0000 7fd5b3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39 to cache LRU end 2024-09-12T00:58:17.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.498+0000 7fd5b3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:17.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.498+0000 7fd6ded2a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39]): orig_sources= new_sources= 2024-09-12T00:58:17.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.498+0000 7fd6ded2a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39]): potential sources added=[] removed=[] 2024-09-12T00:58:17.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.498+0000 7fd6ded2a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39]): orig_dests= new_dests= 2024-09-12T00:58:17.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.498+0000 7fd6ded2a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39]): potential dests added=[] removed=[] 2024-09-12T00:58:17.490 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.502+0000 7fd6ded2a9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39.0 2024-09-12T00:58:17.491 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.502+0000 7fd6ded2a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39 : hit (requested=0x17, cached=0x17) 2024-09-12T00:58:17.491 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.502+0000 7fd6ded2a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39 2024-09-12T00:58:17.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.502+0000 7fd6ded2a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39 info.flags=0x17 2024-09-12T00:58:17.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.502+0000 7fd6ded2a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39 to cache LRU end 2024-09-12T00:58:17.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.502+0000 7fd6ded2a9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:17.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.502+0000 7fd6ded2a9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39, ofs0, ns] 2024-09-12T00:58:17.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.506+0000 7fd5b37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431643 cookie 94802822396928 notifier 8010 bl.length()=983 2024-09-12T00:58:17.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.506+0000 7fd5b37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39 info.flags=0x17 2024-09-12T00:58:17.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.506+0000 7fd5b37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39 to cache LRU end 2024-09-12T00:58:17.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.506+0000 7fd5b37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:17.496 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.506+0000 7fd6ded2a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39]): orig_sources= new_sources= 2024-09-12T00:58:17.497 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.506+0000 7fd6ded2a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39]): potential sources added=[] removed=[] 2024-09-12T00:58:17.497 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.506+0000 7fd6ded2a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39]): orig_dests= new_dests= 2024-09-12T00:58:17.497 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.506+0000 7fd6ded2a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39]): potential dests added=[] removed=[] 2024-09-12T00:58:17.498 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.510+0000 7fd6ded2a9c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T00:58:17.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.510+0000 7fd5937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:17.507 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.518+0000 7fd6ded2a9c0 20 remove_watcher() i=0 2024-09-12T00:58:17.507 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.518+0000 7fd6ded2a9c0 2 removed watcher, disabling cache 2024-09-12T00:58:17.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.518+0000 7fd6ded2a9c0 20 remove_watcher() i=1 2024-09-12T00:58:17.512 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.522+0000 7fd6ded2a9c0 20 remove_watcher() i=2 2024-09-12T00:58:17.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.526+0000 7fd6ded2a9c0 20 remove_watcher() i=3 2024-09-12T00:58:17.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.526+0000 7fd6ded2a9c0 20 remove_watcher() i=4 2024-09-12T00:58:17.518 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.526+0000 7fd6ded2a9c0 20 remove_watcher() i=5 2024-09-12T00:58:17.520 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.530+0000 7fd6ded2a9c0 20 remove_watcher() i=6 2024-09-12T00:58:17.521 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.530+0000 7fd6ded2a9c0 20 remove_watcher() i=7 2024-09-12T00:58:17.537 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:58:17.567 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:17.567 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:17.612 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.622+0000 7f443e3bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.613 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.622+0000 7f443e3bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.613 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.622+0000 7f443e3bb9c0 20 realm 2024-09-12T00:58:17.613 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.622+0000 7f443e3bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.622+0000 7f443e3bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.622+0000 7f443e3bb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:17.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.622+0000 7f443e3bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.622+0000 7f443e3bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.622+0000 7f443e3bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.626+0000 7f443e3bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:17.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.626+0000 7f443e3bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.616 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.626+0000 7f443e3bb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:17.616 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.626+0000 7f443e3bb9c0 20 searching for the correct realm 2024-09-12T00:58:17.620 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.630+0000 7f443c6c2640 0 -- 172.21.15.70:0/2027691588 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f44300ce040 msgr2=0x7f4430135040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:58:17.629 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.638+0000 7f443c6c2640 0 -- 172.21.15.70:0/2027691588 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f4304080880 msgr2=0x7f4304082cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:17.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.646+0000 7f443e3bb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:17.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.646+0000 7f443e3bb9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:58:17.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.646+0000 7f443e3bb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:17.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.646+0000 7f443e3bb9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:58:17.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.646+0000 7f443e3bb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:17.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.646+0000 7f443e3bb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:17.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.646+0000 7f443e3bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.646+0000 7f443e3bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.637 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.646+0000 7f443e3bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.646+0000 7f443e3bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:17.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.646+0000 7f443e3bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.646+0000 7f443e3bb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:17.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.646+0000 7f443e3bb9c0 20 zone default found 2024-09-12T00:58:17.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.646+0000 7f443e3bb9c0 4 Realm: () 2024-09-12T00:58:17.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.646+0000 7f443e3bb9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:58:17.638 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.646+0000 7f443e3bb9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:58:17.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.646+0000 7f443e3bb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:17.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.646+0000 7f443e3bb9c0 20 zonegroup default 2024-09-12T00:58:17.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.646+0000 7f443e3bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.646+0000 7f443e3bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.646+0000 7f443e3bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.650+0000 7f443e3bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.650+0000 7f443e3bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.640 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.650+0000 7f443e3bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.640 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.650+0000 7f443e3bb9c0 20 started sync module instance, tier type = 2024-09-12T00:58:17.640 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.650+0000 7f443e3bb9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:58:17.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.666+0000 7f443e3bb9c0 20 add_watcher() i=0 2024-09-12T00:58:17.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.666+0000 7f443e3bb9c0 20 add_watcher() i=1 2024-09-12T00:58:17.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.666+0000 7f443e3bb9c0 20 add_watcher() i=2 2024-09-12T00:58:17.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.666+0000 7f443e3bb9c0 20 add_watcher() i=3 2024-09-12T00:58:17.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.666+0000 7f443e3bb9c0 20 add_watcher() i=4 2024-09-12T00:58:17.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.666+0000 7f443e3bb9c0 20 add_watcher() i=5 2024-09-12T00:58:17.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.666+0000 7f443e3bb9c0 20 add_watcher() i=6 2024-09-12T00:58:17.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.666+0000 7f443e3bb9c0 20 add_watcher() i=7 2024-09-12T00:58:17.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.666+0000 7f443e3bb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:17.658 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.666+0000 7f42f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:17.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.670+0000 7f443e3bb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:17.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.670+0000 7f443e3bb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:17.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.670+0000 7f443e3bb9c0 5 note: GC not initialized 2024-09-12T00:58:17.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.670+0000 7f42f0fe1640 20 reqs_thread_entry: start 2024-09-12T00:58:17.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.670+0000 7f443e3bb9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:58:17.660 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.670+0000 7f443e3bb9c0 20 Filter name: none 2024-09-12T00:58:17.660 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.670+0000 7f426a7fc640 20 reqs_thread_entry: start 2024-09-12T00:58:17.660 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.670+0000 7f443e3bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.660 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.670+0000 7f443e3bb9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:58:17.660 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.670+0000 7f443e3bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.662 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.670+0000 7f443e3bb9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:58:17.662 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.670+0000 7f443e3bb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:58:17.662 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.670+0000 7f443e3bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.662 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.674+0000 7f443e3bb9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:58:17.663 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.674+0000 7f443e3bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.674+0000 7f443e3bb9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:58:17.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.674+0000 7f443e3bb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:58:17.666 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.674+0000 7f42f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:17.671 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.682+0000 7f443e3bb9c0 20 remove_watcher() i=0 2024-09-12T00:58:17.672 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.682+0000 7f443e3bb9c0 2 removed watcher, disabling cache 2024-09-12T00:58:17.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.682+0000 7f443e3bb9c0 20 remove_watcher() i=1 2024-09-12T00:58:17.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.686+0000 7f443e3bb9c0 20 remove_watcher() i=2 2024-09-12T00:58:17.678 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.686+0000 7f443e3bb9c0 20 remove_watcher() i=3 2024-09-12T00:58:17.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.690+0000 7f443e3bb9c0 20 remove_watcher() i=4 2024-09-12T00:58:17.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.690+0000 7f443e3bb9c0 20 remove_watcher() i=5 2024-09-12T00:58:17.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.690+0000 7f443e3bb9c0 20 remove_watcher() i=6 2024-09-12T00:58:17.684 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:17.694+0000 7f443e3bb9c0 20 remove_watcher() i=7 2024-09-12T00:58:17.697 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:17.698 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:58:17.698 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: error-at-change-reshard-state id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:58:17.698 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:17.699 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:17.699 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:17.702 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:17.702 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:17.756 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:17.756 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:17.778 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-12T00:58:17.778 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:17.779 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:17.779 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:17.792 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:17.793 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:17.838 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:17.839 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:17.858 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:17.858 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:17.877 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:17.877 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:17.896 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:17.896 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:17.915 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:17.915 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:17.933 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:17.933 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:17.952 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:17.952 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:17.973 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:17.973 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:17.994 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:17.994 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:18.012 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:18.012 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:18.032 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:18.032 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:18.051 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:18.052 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:18.073 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:18.073 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:18.092 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:18.093 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:18.113 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:18.113 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:18.132 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:18.133 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:18.151 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:18.151 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:18.170 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:18.170 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:18.189 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:18.189 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:18.208 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:18.208 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:18.225 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:58:18.257 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:18.257 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:18.302 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.310+0000 7f43199c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.314+0000 7f43199c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.314+0000 7f43199c99c0 20 realm 2024-09-12T00:58:18.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.314+0000 7f43199c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.314+0000 7f43199c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.314+0000 7f43199c99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:18.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.314+0000 7f43199c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.314+0000 7f43199c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.314+0000 7f43199c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.314+0000 7f43199c99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:18.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.314+0000 7f43199c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.318+0000 7f43199c99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:18.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.318+0000 7f43199c99c0 20 searching for the correct realm 2024-09-12T00:58:18.311 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.322+0000 7f4317cd0640 0 -- 172.21.15.70:0/2942680342 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f430c008040 msgr2=0x7f430c063940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:18.529 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.538+0000 7f4317cd0640 0 -- 172.21.15.70:0/2942680342 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f430c008040 msgr2=0x7f430c063940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:18.540 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.550+0000 7f43199c99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:18.540 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.550+0000 7f43199c99c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:58:18.540 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.550+0000 7f43199c99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:18.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.550+0000 7f43199c99c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:58:18.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.550+0000 7f43199c99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:18.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.550+0000 7f43199c99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:18.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.550+0000 7f43199c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.550+0000 7f43199c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.550+0000 7f43199c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.542 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.550+0000 7f43199c99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:18.542 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.550+0000 7f43199c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.543 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.554+0000 7f43199c99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:18.543 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.554+0000 7f43199c99c0 20 zone default found 2024-09-12T00:58:18.543 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.554+0000 7f43199c99c0 4 Realm: () 2024-09-12T00:58:18.543 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.554+0000 7f43199c99c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:58:18.543 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.554+0000 7f43199c99c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:58:18.543 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.554+0000 7f43199c99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:18.543 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.554+0000 7f43199c99c0 20 zonegroup default 2024-09-12T00:58:18.544 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.554+0000 7f43199c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.544 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.554+0000 7f43199c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.544 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.554+0000 7f43199c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.554+0000 7f43199c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.554+0000 7f43199c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.554+0000 7f43199c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.554+0000 7f43199c99c0 20 started sync module instance, tier type = 2024-09-12T00:58:18.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.554+0000 7f43199c99c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:58:18.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.578+0000 7f43199c99c0 20 add_watcher() i=0 2024-09-12T00:58:18.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.578+0000 7f43199c99c0 20 add_watcher() i=1 2024-09-12T00:58:18.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.578+0000 7f43199c99c0 20 add_watcher() i=2 2024-09-12T00:58:18.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.578+0000 7f43199c99c0 20 add_watcher() i=3 2024-09-12T00:58:18.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.578+0000 7f43199c99c0 20 add_watcher() i=4 2024-09-12T00:58:18.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.578+0000 7f43199c99c0 20 add_watcher() i=5 2024-09-12T00:58:18.568 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.578+0000 7f43199c99c0 20 add_watcher() i=6 2024-09-12T00:58:18.569 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.578+0000 7f43199c99c0 20 add_watcher() i=7 2024-09-12T00:58:18.569 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.578+0000 7f43199c99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:18.572 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.582+0000 7f41cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:18.573 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.582+0000 7f43199c99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:18.573 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.582+0000 7f43199c99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:18.573 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.582+0000 7f43199c99c0 5 note: GC not initialized 2024-09-12T00:58:18.574 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.582+0000 7f41ccfe1640 20 reqs_thread_entry: start 2024-09-12T00:58:18.574 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.582+0000 7f43199c99c0 20 init_complete bucket index max shards: 1 2024-09-12T00:58:18.574 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.582+0000 7f43199c99c0 20 Filter name: none 2024-09-12T00:58:18.575 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.582+0000 7f41467fc640 20 reqs_thread_entry: start 2024-09-12T00:58:18.575 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.582+0000 7f43199c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.575 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.586+0000 7f43199c99c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:58:18.575 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.586+0000 7f43199c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.576 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.586+0000 7f43199c99c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:58:18.576 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.586+0000 7f43199c99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:58:18.576 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.586+0000 7f43199c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.577 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.586+0000 7f43199c99c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:58:18.577 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.586+0000 7f43199c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.577 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.586+0000 7f43199c99c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:58:18.577 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.586+0000 7f43199c99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:58:18.579 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.590+0000 7f41cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:18.584 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.594+0000 7f43199c99c0 20 remove_watcher() i=0 2024-09-12T00:58:18.584 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.594+0000 7f43199c99c0 2 removed watcher, disabling cache 2024-09-12T00:58:18.586 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.594+0000 7f43199c99c0 20 remove_watcher() i=1 2024-09-12T00:58:18.589 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.598+0000 7f43199c99c0 20 remove_watcher() i=2 2024-09-12T00:58:18.591 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.602+0000 7f43199c99c0 20 remove_watcher() i=3 2024-09-12T00:58:18.593 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.602+0000 7f43199c99c0 20 remove_watcher() i=4 2024-09-12T00:58:18.595 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.606+0000 7f43199c99c0 20 remove_watcher() i=5 2024-09-12T00:58:18.596 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.606+0000 7f43199c99c0 20 remove_watcher() i=6 2024-09-12T00:58:18.597 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.606+0000 7f43199c99c0 20 remove_watcher() i=7 2024-09-12T00:58:18.612 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.613 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:58:18.613 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: abort-at-change-reshard-state id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:58:18.613 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.613 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T00:58:18.646 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:18.647 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:18.691 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.702+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.702+0000 7f2c56b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.702+0000 7f2c56b829c0 20 realm 2024-09-12T00:58:18.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.702+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.702+0000 7f2c56b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.702+0000 7f2c56b829c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:18.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.702+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.702+0000 7f2c56b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.702+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.694 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.706+0000 7f2c56b829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:18.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.706+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.706+0000 7f2c56b829c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:18.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.706+0000 7f2c56b829c0 20 searching for the correct realm 2024-09-12T00:58:18.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.710+0000 7f2c54e89640 0 -- 172.21.15.70:0/618171556 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f2c480d3030 msgr2=0x7f2c480fcbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:18.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.718+0000 7f2c54688640 0 -- 172.21.15.70:0/618171556 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f2c4c087be0 msgr2=0x7f2c4c088080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:58:18.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.722+0000 7f2c56b829c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:18.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.722+0000 7f2c56b829c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:58:18.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.722+0000 7f2c56b829c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:18.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.722+0000 7f2c56b829c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:58:18.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.722+0000 7f2c56b829c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:18.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.722+0000 7f2c56b829c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:18.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:18.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:18.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 zone default found 2024-09-12T00:58:18.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.726+0000 7f2c56b829c0 4 Realm: () 2024-09-12T00:58:18.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.726+0000 7f2c56b829c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:58:18.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.726+0000 7f2c56b829c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:58:18.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.726+0000 7f2c56b829c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:18.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 zonegroup default 2024-09-12T00:58:18.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 started sync module instance, tier type = 2024-09-12T00:58:18.718 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:58:18.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.742+0000 7f2c56b829c0 20 add_watcher() i=0 2024-09-12T00:58:18.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.742+0000 7f2c56b829c0 20 add_watcher() i=1 2024-09-12T00:58:18.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.742+0000 7f2c56b829c0 20 add_watcher() i=2 2024-09-12T00:58:18.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.742+0000 7f2c56b829c0 20 add_watcher() i=3 2024-09-12T00:58:18.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.742+0000 7f2c56b829c0 20 add_watcher() i=4 2024-09-12T00:58:18.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.742+0000 7f2c56b829c0 20 add_watcher() i=5 2024-09-12T00:58:18.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.742+0000 7f2c56b829c0 20 add_watcher() i=6 2024-09-12T00:58:18.734 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.742+0000 7f2c56b829c0 20 add_watcher() i=7 2024-09-12T00:58:18.734 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.742+0000 7f2c56b829c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:18.736 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.746+0000 7f2b0afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:18.737 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.746+0000 7f2c56b829c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:18.738 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.746+0000 7f2c56b829c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:18.738 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 note: GC not initialized 2024-09-12T00:58:18.738 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.746+0000 7f2b09fdb640 20 reqs_thread_entry: start 2024-09-12T00:58:18.738 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.746+0000 7f2c56b829c0 20 init_complete bucket index max shards: 1 2024-09-12T00:58:18.738 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.746+0000 7f2c56b829c0 20 Filter name: none 2024-09-12T00:58:18.738 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.746+0000 7f2a7b7fe640 20 reqs_thread_entry: start 2024-09-12T00:58:18.738 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.746+0000 7f2c56b829c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:58:18.738 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.746+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.746+0000 7f2c56b829c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:58:18.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.746+0000 7f2c56b829c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:58:18.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.746+0000 7f2c56b829c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:58:18.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.746+0000 7f2c56b829c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 : miss 2024-09-12T00:58:18.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.746+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.746+0000 7f2c56b829c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:58:18.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.746+0000 7f2c56b829c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 info.flags=0x17 2024-09-12T00:58:18.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.746+0000 7f2c56b829c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 to cache LRU end 2024-09-12T00:58:18.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.746+0000 7f2c56b829c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:58:18.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.746+0000 7f2c56b829c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:18.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.746+0000 7f2c56b829c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 2024-09-12T00:58:18.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.754+0000 7f2c56b829c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 info.flags=0x17 2024-09-12T00:58:18.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.754+0000 7f2c56b829c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 to cache LRU end 2024-09-12T00:58:18.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.754+0000 7f2c56b829c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:18.746 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.754+0000 7f2c56b829c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40, ofs0, ns] 2024-09-12T00:58:18.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.754+0000 7f2b2b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431570 cookie 94578887030208 notifier 8058 bl.length()=1015 2024-09-12T00:58:18.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.754+0000 7f2b2b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 info.flags=0x17 2024-09-12T00:58:18.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.754+0000 7f2b2b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 to cache LRU end 2024-09-12T00:58:18.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.754+0000 7f2b2b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:18.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.758+0000 7f2c56b829c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40]): orig_sources= new_sources= 2024-09-12T00:58:18.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.758+0000 7f2c56b829c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40]): potential sources added=[] removed=[] 2024-09-12T00:58:18.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.758+0000 7f2c56b829c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40]): orig_dests= new_dests= 2024-09-12T00:58:18.747 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.758+0000 7f2c56b829c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40]): potential dests added=[] removed=[] 2024-09-12T00:58:18.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.758+0000 7f2c56b829c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40.1.0 2024-09-12T00:58:18.750 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.758+0000 7f2c56b829c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40.1.0 2024-09-12T00:58:18.750 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.758+0000 7f2c56b829c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40.1.1 2024-09-12T00:58:18.750 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.758+0000 7f2c56b829c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40.1.1 2024-09-12T00:58:18.750 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.758+0000 7f2c56b829c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40.0 2024-09-12T00:58:18.752 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2c56b829c0 time 2024-09-12T00:58:18.764947+0000 2024-09-12T00:58:18.753 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:58:18.754 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:58:18.754 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2c5a45c2eb] 2024-09-12T00:58:18.754 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2c5a45c49f] 2024-09-12T00:58:18.754 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604da38dcc1] 2024-09-12T00:58:18.754 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x5604da3a201c] 2024-09-12T00:58:18.754 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5604da3a36a4] 2024-09-12T00:58:18.754 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:58:18.754 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2c592c2d90] 2024-09-12T00:58:18.754 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:58:18.754 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:58:18.755 INFO:tasks.workunit.client.0.smithi070.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:58:18.755 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f2c56b829c0 thread_name:radosgw-admin 2024-09-12T00:58:18.755 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.762+0000 7f2c56b829c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2c56b829c0 time 2024-09-12T00:58:18.764947+0000 2024-09-12T00:58:18.755 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:58:18.755 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.755 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:58:18.755 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2c5a45c2eb] 2024-09-12T00:58:18.756 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2c5a45c49f] 2024-09-12T00:58:18.756 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604da38dcc1] 2024-09-12T00:58:18.756 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x5604da3a201c] 2024-09-12T00:58:18.756 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5604da3a36a4] 2024-09-12T00:58:18.756 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:58:18.756 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2c592c2d90] 2024-09-12T00:58:18.756 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:58:18.756 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:58:18.756 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.777 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:58:18.777 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2c592db520] 2024-09-12T00:58:18.777 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:58:18.777 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:58:18.777 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:58:18.778 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2c5a45c345] 2024-09-12T00:58:18.778 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2c5a45c49f] 2024-09-12T00:58:18.778 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604da38dcc1] 2024-09-12T00:58:18.778 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x5604da3a201c] 2024-09-12T00:58:18.778 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5604da3a36a4] 2024-09-12T00:58:18.778 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:58:18.778 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2c592c2d90] 2024-09-12T00:58:18.778 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:58:18.778 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:58:18.778 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.766+0000 7f2c56b829c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:58:18.778 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f2c56b829c0 thread_name:radosgw-admin 2024-09-12T00:58:18.778 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.778 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:58:18.779 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2c592db520] 2024-09-12T00:58:18.779 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:58:18.779 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:58:18.779 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:58:18.779 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2c5a45c345] 2024-09-12T00:58:18.779 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2c5a45c49f] 2024-09-12T00:58:18.779 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604da38dcc1] 2024-09-12T00:58:18.779 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x5604da3a201c] 2024-09-12T00:58:18.779 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5604da3a36a4] 2024-09-12T00:58:18.779 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:58:18.779 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2c592c2d90] 2024-09-12T00:58:18.779 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:58:18.779 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:58:18.779 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:58:18.780 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.780 INFO:tasks.workunit.client.0.smithi070.stderr:--- begin dump of recent events --- 2024-09-12T00:58:18.780 INFO:tasks.workunit.client.0.smithi070.stderr: -499> 2024-09-12T00:58:18.678+0000 7f2b4260c640 10 monclient: _finish_auth 0 2024-09-12T00:58:18.780 INFO:tasks.workunit.client.0.smithi070.stderr: -498> 2024-09-12T00:58:18.678+0000 7f2b4260c640 10 monclient: _check_auth_tickets 2024-09-12T00:58:18.780 INFO:tasks.workunit.client.0.smithi070.stderr: -497> 2024-09-12T00:58:18.678+0000 7f2b4260c640 10 monclient: handle_config config(0 keys) 2024-09-12T00:58:18.780 INFO:tasks.workunit.client.0.smithi070.stderr: -496> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 monclient: authenticate success, global_id 7547 2024-09-12T00:58:18.780 INFO:tasks.workunit.client.0.smithi070.stderr: -495> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 10 monclient: get_monmap_and_config success 2024-09-12T00:58:18.780 INFO:tasks.workunit.client.0.smithi070.stderr: -494> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 4 set_mon_vals no callback set 2024-09-12T00:58:18.780 INFO:tasks.workunit.client.0.smithi070.stderr: -493> 2024-09-12T00:58:18.678+0000 7f2b4260c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:18.780 INFO:tasks.workunit.client.0.smithi070.stderr: -492> 2024-09-12T00:58:18.678+0000 7f2b4260c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:58:18.780 INFO:tasks.workunit.client.0.smithi070.stderr: -491> 2024-09-12T00:58:18.678+0000 7f2b4260c640 10 monclient: dump: 2024-09-12T00:58:18.780 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:18.781 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:18.781 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.781 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.781 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:18.781 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:18.781 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:18.781 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:18.781 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:18.781 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.781 INFO:tasks.workunit.client.0.smithi070.stderr: -490> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 10 monclient: shutdown 2024-09-12T00:58:18.781 INFO:tasks.workunit.client.0.smithi070.stderr: -489> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) unregister_commands rotate-key 2024-09-12T00:58:18.781 INFO:tasks.workunit.client.0.smithi070.stderr: -488> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 10 monclient: build_initial_monmap 2024-09-12T00:58:18.781 INFO:tasks.workunit.client.0.smithi070.stderr: -487> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 1 build_initial for_mkfs: 0 2024-09-12T00:58:18.781 INFO:tasks.workunit.client.0.smithi070.stderr: -486> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 10 monclient: monmap: 2024-09-12T00:58:18.782 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:58:18.782 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:58:18.782 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:58:18.782 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:58:18.782 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:58:18.782 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:18.782 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:58:18.782 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:58:18.782 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:58:18.782 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.782 INFO:tasks.workunit.client.0.smithi070.stderr: -485> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding auth protocol: cephx 2024-09-12T00:58:18.782 INFO:tasks.workunit.client.0.smithi070.stderr: -484> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding auth protocol: cephx 2024-09-12T00:58:18.782 INFO:tasks.workunit.client.0.smithi070.stderr: -483> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding auth protocol: cephx 2024-09-12T00:58:18.782 INFO:tasks.workunit.client.0.smithi070.stderr: -482> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding con mode: secure 2024-09-12T00:58:18.782 INFO:tasks.workunit.client.0.smithi070.stderr: -481> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding con mode: crc 2024-09-12T00:58:18.783 INFO:tasks.workunit.client.0.smithi070.stderr: -480> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding con mode: secure 2024-09-12T00:58:18.783 INFO:tasks.workunit.client.0.smithi070.stderr: -479> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding con mode: crc 2024-09-12T00:58:18.783 INFO:tasks.workunit.client.0.smithi070.stderr: -478> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding con mode: secure 2024-09-12T00:58:18.783 INFO:tasks.workunit.client.0.smithi070.stderr: -477> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding con mode: crc 2024-09-12T00:58:18.783 INFO:tasks.workunit.client.0.smithi070.stderr: -476> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding con mode: crc 2024-09-12T00:58:18.783 INFO:tasks.workunit.client.0.smithi070.stderr: -475> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding con mode: secure 2024-09-12T00:58:18.783 INFO:tasks.workunit.client.0.smithi070.stderr: -474> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding con mode: crc 2024-09-12T00:58:18.783 INFO:tasks.workunit.client.0.smithi070.stderr: -473> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding con mode: secure 2024-09-12T00:58:18.783 INFO:tasks.workunit.client.0.smithi070.stderr: -472> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding con mode: crc 2024-09-12T00:58:18.783 INFO:tasks.workunit.client.0.smithi070.stderr: -471> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding con mode: secure 2024-09-12T00:58:18.783 INFO:tasks.workunit.client.0.smithi070.stderr: -470> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:18.783 INFO:tasks.workunit.client.0.smithi070.stderr: -469> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 1 librados: starting msgr at 2024-09-12T00:58:18.783 INFO:tasks.workunit.client.0.smithi070.stderr: -468> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 1 librados: starting objecter 2024-09-12T00:58:18.783 INFO:tasks.workunit.client.0.smithi070.stderr: -467> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command objecter_requests hook 0x5604dce75e10 2024-09-12T00:58:18.784 INFO:tasks.workunit.client.0.smithi070.stderr: -466> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 1 librados: setting wanted keys 2024-09-12T00:58:18.784 INFO:tasks.workunit.client.0.smithi070.stderr: -465> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 1 librados: calling monclient init 2024-09-12T00:58:18.784 INFO:tasks.workunit.client.0.smithi070.stderr: -464> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 10 monclient: init 2024-09-12T00:58:18.784 INFO:tasks.workunit.client.0.smithi070.stderr: -463> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding auth protocol: cephx 2024-09-12T00:58:18.784 INFO:tasks.workunit.client.0.smithi070.stderr: -462> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding auth protocol: cephx 2024-09-12T00:58:18.784 INFO:tasks.workunit.client.0.smithi070.stderr: -461> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding auth protocol: cephx 2024-09-12T00:58:18.784 INFO:tasks.workunit.client.0.smithi070.stderr: -460> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding con mode: secure 2024-09-12T00:58:18.784 INFO:tasks.workunit.client.0.smithi070.stderr: -459> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding con mode: crc 2024-09-12T00:58:18.784 INFO:tasks.workunit.client.0.smithi070.stderr: -458> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding con mode: secure 2024-09-12T00:58:18.784 INFO:tasks.workunit.client.0.smithi070.stderr: -457> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding con mode: crc 2024-09-12T00:58:18.784 INFO:tasks.workunit.client.0.smithi070.stderr: -456> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding con mode: secure 2024-09-12T00:58:18.784 INFO:tasks.workunit.client.0.smithi070.stderr: -455> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding con mode: crc 2024-09-12T00:58:18.784 INFO:tasks.workunit.client.0.smithi070.stderr: -454> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding con mode: crc 2024-09-12T00:58:18.785 INFO:tasks.workunit.client.0.smithi070.stderr: -453> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding con mode: secure 2024-09-12T00:58:18.785 INFO:tasks.workunit.client.0.smithi070.stderr: -452> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding con mode: crc 2024-09-12T00:58:18.785 INFO:tasks.workunit.client.0.smithi070.stderr: -451> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding con mode: secure 2024-09-12T00:58:18.785 INFO:tasks.workunit.client.0.smithi070.stderr: -450> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding con mode: crc 2024-09-12T00:58:18.785 INFO:tasks.workunit.client.0.smithi070.stderr: -449> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding con mode: secure 2024-09-12T00:58:18.785 INFO:tasks.workunit.client.0.smithi070.stderr: -448> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:18.785 INFO:tasks.workunit.client.0.smithi070.stderr: -447> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:18.785 INFO:tasks.workunit.client.0.smithi070.stderr: -446> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command rotate-key hook 0x5604dce70b58 2024-09-12T00:58:18.785 INFO:tasks.workunit.client.0.smithi070.stderr: -445> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient: _reopen_session rank -1 2024-09-12T00:58:18.785 INFO:tasks.workunit.client.0.smithi070.stderr: -444> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:58:18.785 INFO:tasks.workunit.client.0.smithi070.stderr: -443> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient(hunting): picked mon.noname-c con 0x5604dcd1eea0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:58:18.785 INFO:tasks.workunit.client.0.smithi070.stderr: -442> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient(hunting): picked mon.noname-b con 0x5604dcd28850 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:58:18.785 INFO:tasks.workunit.client.0.smithi070.stderr: -441> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient(hunting): picked mon.noname-a con 0x5604dcd2d4a0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:58:18.785 INFO:tasks.workunit.client.0.smithi070.stderr: -440> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:18.786 INFO:tasks.workunit.client.0.smithi070.stderr: -439> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:18.786 INFO:tasks.workunit.client.0.smithi070.stderr: -438> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:18.786 INFO:tasks.workunit.client.0.smithi070.stderr: -437> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient(hunting): _renew_subs 2024-09-12T00:58:18.786 INFO:tasks.workunit.client.0.smithi070.stderr: -436> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient(hunting): authenticate will time out at 2349.128448s 2024-09-12T00:58:18.786 INFO:tasks.workunit.client.0.smithi070.stderr: -435> 2024-09-12T00:58:18.682+0000 7f2c54688640 10 monclient(hunting): get_auth_request con 0x5604dcd1eea0 auth_method 0 2024-09-12T00:58:18.786 INFO:tasks.workunit.client.0.smithi070.stderr: -434> 2024-09-12T00:58:18.682+0000 7f2c54688640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:18.786 INFO:tasks.workunit.client.0.smithi070.stderr: -433> 2024-09-12T00:58:18.682+0000 7f2c54688640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:18.786 INFO:tasks.workunit.client.0.smithi070.stderr: -432> 2024-09-12T00:58:18.682+0000 7f2c54688640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:18.786 INFO:tasks.workunit.client.0.smithi070.stderr: -431> 2024-09-12T00:58:18.682+0000 7f2c54e89640 10 monclient(hunting): get_auth_request con 0x5604dcd2d4a0 auth_method 0 2024-09-12T00:58:18.786 INFO:tasks.workunit.client.0.smithi070.stderr: -430> 2024-09-12T00:58:18.682+0000 7f2c54e89640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:18.786 INFO:tasks.workunit.client.0.smithi070.stderr: -429> 2024-09-12T00:58:18.682+0000 7f2c54e89640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:18.786 INFO:tasks.workunit.client.0.smithi070.stderr: -428> 2024-09-12T00:58:18.682+0000 7f2c54e89640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:18.786 INFO:tasks.workunit.client.0.smithi070.stderr: -427> 2024-09-12T00:58:18.682+0000 7f2c54688640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:18.787 INFO:tasks.workunit.client.0.smithi070.stderr: -426> 2024-09-12T00:58:18.682+0000 7f2c54688640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:18.787 INFO:tasks.workunit.client.0.smithi070.stderr: -425> 2024-09-12T00:58:18.682+0000 7f2c54688640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:18.787 INFO:tasks.workunit.client.0.smithi070.stderr: -424> 2024-09-12T00:58:18.682+0000 7f2c54e89640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:18.787 INFO:tasks.workunit.client.0.smithi070.stderr: -423> 2024-09-12T00:58:18.682+0000 7f2c54e89640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:18.787 INFO:tasks.workunit.client.0.smithi070.stderr: -422> 2024-09-12T00:58:18.682+0000 7f2c54e89640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:18.787 INFO:tasks.workunit.client.0.smithi070.stderr: -421> 2024-09-12T00:58:18.682+0000 7f2c54e89640 10 monclient(hunting): handle_auth_done global_id 8049 payload 824 2024-09-12T00:58:18.787 INFO:tasks.workunit.client.0.smithi070.stderr: -420> 2024-09-12T00:58:18.682+0000 7f2c54e89640 10 monclient: _finish_hunting 0 2024-09-12T00:58:18.787 INFO:tasks.workunit.client.0.smithi070.stderr: -419> 2024-09-12T00:58:18.682+0000 7f2c54e89640 1 monclient: found mon.noname-a 2024-09-12T00:58:18.787 INFO:tasks.workunit.client.0.smithi070.stderr: -418> 2024-09-12T00:58:18.682+0000 7f2c54e89640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:58:18.787 INFO:tasks.workunit.client.0.smithi070.stderr: -417> 2024-09-12T00:58:18.682+0000 7f2c53e87640 10 monclient: get_auth_request con 0x5604dcd28850 auth_method 0 2024-09-12T00:58:18.787 INFO:tasks.workunit.client.0.smithi070.stderr: -416> 2024-09-12T00:58:18.682+0000 7f2b40e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:18.787 INFO:tasks.workunit.client.0.smithi070.stderr: -415> 2024-09-12T00:58:18.682+0000 7f2b40e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:58:18.787 INFO:tasks.workunit.client.0.smithi070.stderr: -414> 2024-09-12T00:58:18.682+0000 7f2b40e09640 10 monclient: dump: 2024-09-12T00:58:18.788 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:18.788 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:18.788 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.788 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.788 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:18.788 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:18.788 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:18.788 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:18.788 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:18.788 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.788 INFO:tasks.workunit.client.0.smithi070.stderr: -413> 2024-09-12T00:58:18.682+0000 7f2b40e09640 10 monclient: _finish_auth 0 2024-09-12T00:58:18.788 INFO:tasks.workunit.client.0.smithi070.stderr: -412> 2024-09-12T00:58:18.682+0000 7f2b40e09640 10 monclient: _check_auth_tickets 2024-09-12T00:58:18.788 INFO:tasks.workunit.client.0.smithi070.stderr: -411> 2024-09-12T00:58:18.682+0000 7f2b40e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:58:18.789 INFO:tasks.workunit.client.0.smithi070.stderr: -410> 2024-09-12T00:58:18.682+0000 7f2b40e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:18.789 INFO:tasks.workunit.client.0.smithi070.stderr: -409> 2024-09-12T00:58:18.682+0000 7f2b40e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:58:18.789 INFO:tasks.workunit.client.0.smithi070.stderr: -408> 2024-09-12T00:58:18.682+0000 7f2b40e09640 10 monclient: dump: 2024-09-12T00:58:18.789 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:18.789 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:18.789 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.789 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.789 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:18.789 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:18.789 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:18.789 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:18.789 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:18.789 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.789 INFO:tasks.workunit.client.0.smithi070.stderr: -407> 2024-09-12T00:58:18.682+0000 7f2b4260c640 4 set_mon_vals no callback set 2024-09-12T00:58:18.790 INFO:tasks.workunit.client.0.smithi070.stderr: -406> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 5 monclient: authenticate success, global_id 8049 2024-09-12T00:58:18.790 INFO:tasks.workunit.client.0.smithi070.stderr: -405> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient: _renew_subs 2024-09-12T00:58:18.790 INFO:tasks.workunit.client.0.smithi070.stderr: -404> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:58:18.790 INFO:tasks.workunit.client.0.smithi070.stderr: -403> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient: _renew_subs 2024-09-12T00:58:18.790 INFO:tasks.workunit.client.0.smithi070.stderr: -402> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:58:18.790 INFO:tasks.workunit.client.0.smithi070.stderr: -401> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 1 librados: init done 2024-09-12T00:58:18.790 INFO:tasks.workunit.client.0.smithi070.stderr: -400> 2024-09-12T00:58:18.686+0000 7f2b40e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:58:18.790 INFO:tasks.workunit.client.0.smithi070.stderr: -399> 2024-09-12T00:58:18.686+0000 7f2b40e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:58:18.790 INFO:tasks.workunit.client.0.smithi070.stderr: -398> 2024-09-12T00:58:18.686+0000 7f2b40e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:58:18.790 INFO:tasks.workunit.client.0.smithi070.stderr: -397> 2024-09-12T00:58:18.686+0000 7f2c54688640 10 monclient: get_auth_request con 0x7f2b3c070b30 auth_method 0 2024-09-12T00:58:18.790 INFO:tasks.workunit.client.0.smithi070.stderr: -396> 2024-09-12T00:58:18.686+0000 7f2c53e87640 10 monclient: get_auth_request con 0x5604dce98be0 auth_method 0 2024-09-12T00:58:18.790 INFO:tasks.workunit.client.0.smithi070.stderr: -395> 2024-09-12T00:58:18.686+0000 7f2c54688640 10 monclient: get_auth_request con 0x5604dcebb250 auth_method 0 2024-09-12T00:58:18.790 INFO:tasks.workunit.client.0.smithi070.stderr: -394> 2024-09-12T00:58:18.686+0000 7f2c53e87640 10 monclient: get_auth_request con 0x5604dcebf8f0 auth_method 0 2024-09-12T00:58:18.790 INFO:tasks.workunit.client.0.smithi070.stderr: -393> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient: build_initial_monmap 2024-09-12T00:58:18.791 INFO:tasks.workunit.client.0.smithi070.stderr: -392> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 1 build_initial for_mkfs: 0 2024-09-12T00:58:18.791 INFO:tasks.workunit.client.0.smithi070.stderr: -391> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient: monmap: 2024-09-12T00:58:18.791 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:58:18.791 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:58:18.791 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:58:18.791 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:58:18.791 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:58:18.791 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:18.791 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:58:18.791 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:58:18.791 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:58:18.791 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.792 INFO:tasks.workunit.client.0.smithi070.stderr: -390> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding auth protocol: cephx 2024-09-12T00:58:18.792 INFO:tasks.workunit.client.0.smithi070.stderr: -389> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding auth protocol: cephx 2024-09-12T00:58:18.792 INFO:tasks.workunit.client.0.smithi070.stderr: -388> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding auth protocol: cephx 2024-09-12T00:58:18.792 INFO:tasks.workunit.client.0.smithi070.stderr: -387> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding con mode: secure 2024-09-12T00:58:18.792 INFO:tasks.workunit.client.0.smithi070.stderr: -386> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding con mode: crc 2024-09-12T00:58:18.792 INFO:tasks.workunit.client.0.smithi070.stderr: -385> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding con mode: secure 2024-09-12T00:58:18.792 INFO:tasks.workunit.client.0.smithi070.stderr: -384> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding con mode: crc 2024-09-12T00:58:18.792 INFO:tasks.workunit.client.0.smithi070.stderr: -383> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding con mode: secure 2024-09-12T00:58:18.792 INFO:tasks.workunit.client.0.smithi070.stderr: -382> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding con mode: crc 2024-09-12T00:58:18.792 INFO:tasks.workunit.client.0.smithi070.stderr: -381> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding con mode: crc 2024-09-12T00:58:18.792 INFO:tasks.workunit.client.0.smithi070.stderr: -380> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding con mode: secure 2024-09-12T00:58:18.792 INFO:tasks.workunit.client.0.smithi070.stderr: -379> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding con mode: crc 2024-09-12T00:58:18.792 INFO:tasks.workunit.client.0.smithi070.stderr: -378> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding con mode: secure 2024-09-12T00:58:18.793 INFO:tasks.workunit.client.0.smithi070.stderr: -377> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding con mode: crc 2024-09-12T00:58:18.793 INFO:tasks.workunit.client.0.smithi070.stderr: -376> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding con mode: secure 2024-09-12T00:58:18.793 INFO:tasks.workunit.client.0.smithi070.stderr: -375> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:18.793 INFO:tasks.workunit.client.0.smithi070.stderr: -374> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command objecter_requests cmddesc objecter_requests hook 0x5604dcec7ef0 EEXIST 2024-09-12T00:58:18.793 INFO:tasks.workunit.client.0.smithi070.stderr: -373> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient: init 2024-09-12T00:58:18.793 INFO:tasks.workunit.client.0.smithi070.stderr: -372> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding auth protocol: cephx 2024-09-12T00:58:18.793 INFO:tasks.workunit.client.0.smithi070.stderr: -371> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding auth protocol: cephx 2024-09-12T00:58:18.793 INFO:tasks.workunit.client.0.smithi070.stderr: -370> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding auth protocol: cephx 2024-09-12T00:58:18.793 INFO:tasks.workunit.client.0.smithi070.stderr: -369> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding con mode: secure 2024-09-12T00:58:18.793 INFO:tasks.workunit.client.0.smithi070.stderr: -368> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding con mode: crc 2024-09-12T00:58:18.793 INFO:tasks.workunit.client.0.smithi070.stderr: -367> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding con mode: secure 2024-09-12T00:58:18.793 INFO:tasks.workunit.client.0.smithi070.stderr: -366> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding con mode: crc 2024-09-12T00:58:18.793 INFO:tasks.workunit.client.0.smithi070.stderr: -365> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding con mode: secure 2024-09-12T00:58:18.793 INFO:tasks.workunit.client.0.smithi070.stderr: -364> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding con mode: crc 2024-09-12T00:58:18.794 INFO:tasks.workunit.client.0.smithi070.stderr: -363> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding con mode: crc 2024-09-12T00:58:18.794 INFO:tasks.workunit.client.0.smithi070.stderr: -362> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding con mode: secure 2024-09-12T00:58:18.794 INFO:tasks.workunit.client.0.smithi070.stderr: -361> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding con mode: crc 2024-09-12T00:58:18.794 INFO:tasks.workunit.client.0.smithi070.stderr: -360> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding con mode: secure 2024-09-12T00:58:18.794 INFO:tasks.workunit.client.0.smithi070.stderr: -359> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding con mode: crc 2024-09-12T00:58:18.794 INFO:tasks.workunit.client.0.smithi070.stderr: -358> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding con mode: secure 2024-09-12T00:58:18.794 INFO:tasks.workunit.client.0.smithi070.stderr: -357> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:18.794 INFO:tasks.workunit.client.0.smithi070.stderr: -356> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:18.794 INFO:tasks.workunit.client.0.smithi070.stderr: -355> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command rotate-key cmddesc rotate-key hook 0x5604dcec2dd0 EEXIST 2024-09-12T00:58:18.794 INFO:tasks.workunit.client.0.smithi070.stderr: -354> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient: _reopen_session rank -1 2024-09-12T00:58:18.794 INFO:tasks.workunit.client.0.smithi070.stderr: -353> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:58:18.794 INFO:tasks.workunit.client.0.smithi070.stderr: -352> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient(hunting): picked mon.noname-a con 0x5604dceec0a0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:58:18.794 INFO:tasks.workunit.client.0.smithi070.stderr: -351> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient(hunting): picked mon.noname-c con 0x5604dceeb9d0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:58:18.795 INFO:tasks.workunit.client.0.smithi070.stderr: -350> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient(hunting): picked mon.noname-b con 0x5604dceea3b0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:58:18.795 INFO:tasks.workunit.client.0.smithi070.stderr: -349> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:18.795 INFO:tasks.workunit.client.0.smithi070.stderr: -348> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:18.795 INFO:tasks.workunit.client.0.smithi070.stderr: -347> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:18.795 INFO:tasks.workunit.client.0.smithi070.stderr: -346> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient(hunting): _renew_subs 2024-09-12T00:58:18.795 INFO:tasks.workunit.client.0.smithi070.stderr: -345> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient(hunting): authenticate will time out at 2349.138046s 2024-09-12T00:58:18.795 INFO:tasks.workunit.client.0.smithi070.stderr: -344> 2024-09-12T00:58:18.690+0000 7f2c53e87640 10 monclient(hunting): get_auth_request con 0x5604dceeb9d0 auth_method 0 2024-09-12T00:58:18.795 INFO:tasks.workunit.client.0.smithi070.stderr: -343> 2024-09-12T00:58:18.690+0000 7f2c53e87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:18.795 INFO:tasks.workunit.client.0.smithi070.stderr: -342> 2024-09-12T00:58:18.690+0000 7f2c53e87640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:18.795 INFO:tasks.workunit.client.0.smithi070.stderr: -341> 2024-09-12T00:58:18.690+0000 7f2c53e87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:18.795 INFO:tasks.workunit.client.0.smithi070.stderr: -340> 2024-09-12T00:58:18.690+0000 7f2c54688640 10 monclient(hunting): get_auth_request con 0x5604dceec0a0 auth_method 0 2024-09-12T00:58:18.795 INFO:tasks.workunit.client.0.smithi070.stderr: -339> 2024-09-12T00:58:18.690+0000 7f2c54688640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:18.795 INFO:tasks.workunit.client.0.smithi070.stderr: -338> 2024-09-12T00:58:18.690+0000 7f2c54688640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:18.795 INFO:tasks.workunit.client.0.smithi070.stderr: -337> 2024-09-12T00:58:18.690+0000 7f2c54688640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:18.796 INFO:tasks.workunit.client.0.smithi070.stderr: -336> 2024-09-12T00:58:18.690+0000 7f2c53e87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:18.796 INFO:tasks.workunit.client.0.smithi070.stderr: -335> 2024-09-12T00:58:18.690+0000 7f2c53e87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:18.796 INFO:tasks.workunit.client.0.smithi070.stderr: -334> 2024-09-12T00:58:18.690+0000 7f2c53e87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:18.796 INFO:tasks.workunit.client.0.smithi070.stderr: -333> 2024-09-12T00:58:18.690+0000 7f2c54688640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:18.796 INFO:tasks.workunit.client.0.smithi070.stderr: -332> 2024-09-12T00:58:18.690+0000 7f2c54688640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:18.796 INFO:tasks.workunit.client.0.smithi070.stderr: -331> 2024-09-12T00:58:18.690+0000 7f2c54688640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:18.796 INFO:tasks.workunit.client.0.smithi070.stderr: -330> 2024-09-12T00:58:18.690+0000 7f2c54e89640 10 monclient(hunting): get_auth_request con 0x5604dceea3b0 auth_method 0 2024-09-12T00:58:18.796 INFO:tasks.workunit.client.0.smithi070.stderr: -329> 2024-09-12T00:58:18.690+0000 7f2c54e89640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:18.796 INFO:tasks.workunit.client.0.smithi070.stderr: -328> 2024-09-12T00:58:18.690+0000 7f2c54e89640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:18.796 INFO:tasks.workunit.client.0.smithi070.stderr: -327> 2024-09-12T00:58:18.690+0000 7f2c54e89640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:18.796 INFO:tasks.workunit.client.0.smithi070.stderr: -326> 2024-09-12T00:58:18.690+0000 7f2c53e87640 10 monclient(hunting): handle_auth_done global_id 7553 payload 824 2024-09-12T00:58:18.797 INFO:tasks.workunit.client.0.smithi070.stderr: -325> 2024-09-12T00:58:18.690+0000 7f2c53e87640 10 monclient: _finish_hunting 0 2024-09-12T00:58:18.797 INFO:tasks.workunit.client.0.smithi070.stderr: -324> 2024-09-12T00:58:18.690+0000 7f2c53e87640 1 monclient: found mon.noname-c 2024-09-12T00:58:18.797 INFO:tasks.workunit.client.0.smithi070.stderr: -323> 2024-09-12T00:58:18.690+0000 7f2c53e87640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:58:18.797 INFO:tasks.workunit.client.0.smithi070.stderr: -322> 2024-09-12T00:58:18.690+0000 7f2b39ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:18.797 INFO:tasks.workunit.client.0.smithi070.stderr: -321> 2024-09-12T00:58:18.690+0000 7f2b39ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:58:18.797 INFO:tasks.workunit.client.0.smithi070.stderr: -320> 2024-09-12T00:58:18.690+0000 7f2b39ffb640 10 monclient: dump: 2024-09-12T00:58:18.797 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:18.797 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:18.797 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.797 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.797 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:18.797 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:18.797 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:18.798 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:18.798 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:18.798 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.798 INFO:tasks.workunit.client.0.smithi070.stderr: -319> 2024-09-12T00:58:18.690+0000 7f2b39ffb640 10 monclient: _finish_auth 0 2024-09-12T00:58:18.798 INFO:tasks.workunit.client.0.smithi070.stderr: -318> 2024-09-12T00:58:18.690+0000 7f2b39ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:58:18.798 INFO:tasks.workunit.client.0.smithi070.stderr: -317> 2024-09-12T00:58:18.690+0000 7f2b39ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:58:18.798 INFO:tasks.workunit.client.0.smithi070.stderr: -316> 2024-09-12T00:58:18.690+0000 7f2b39ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:18.798 INFO:tasks.workunit.client.0.smithi070.stderr: -315> 2024-09-12T00:58:18.690+0000 7f2b39ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:58:18.798 INFO:tasks.workunit.client.0.smithi070.stderr: -314> 2024-09-12T00:58:18.690+0000 7f2b39ffb640 10 monclient: dump: 2024-09-12T00:58:18.798 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:18.798 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:18.798 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.798 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.799 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:18.799 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:18.799 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:18.799 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:18.799 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:18.799 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.799 INFO:tasks.workunit.client.0.smithi070.stderr: -313> 2024-09-12T00:58:18.690+0000 7f2c53686640 4 set_mon_vals no callback set 2024-09-12T00:58:18.799 INFO:tasks.workunit.client.0.smithi070.stderr: -312> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 monclient: authenticate success, global_id 7553 2024-09-12T00:58:18.799 INFO:tasks.workunit.client.0.smithi070.stderr: -311> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient: _renew_subs 2024-09-12T00:58:18.799 INFO:tasks.workunit.client.0.smithi070.stderr: -310> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:58:18.800 INFO:tasks.workunit.client.0.smithi070.stderr: -309> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient: _renew_subs 2024-09-12T00:58:18.800 INFO:tasks.workunit.client.0.smithi070.stderr: -308> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:58:18.800 INFO:tasks.workunit.client.0.smithi070.stderr: -307> 2024-09-12T00:58:18.694+0000 7f2b39ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:58:18.800 INFO:tasks.workunit.client.0.smithi070.stderr: -306> 2024-09-12T00:58:18.694+0000 7f2b39ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:58:18.800 INFO:tasks.workunit.client.0.smithi070.stderr: -305> 2024-09-12T00:58:18.694+0000 7f2b39ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:58:18.800 INFO:tasks.workunit.client.0.smithi070.stderr: -304> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient: get_monmap_and_config 2024-09-12T00:58:18.800 INFO:tasks.workunit.client.0.smithi070.stderr: -303> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient: build_initial_monmap 2024-09-12T00:58:18.800 INFO:tasks.workunit.client.0.smithi070.stderr: -302> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 1 build_initial for_mkfs: 0 2024-09-12T00:58:18.800 INFO:tasks.workunit.client.0.smithi070.stderr: -301> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient: monmap: 2024-09-12T00:58:18.801 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:58:18.801 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:58:18.801 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:58:18.801 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:58:18.801 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:58:18.801 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:18.802 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:58:18.802 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:58:18.802 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:58:18.802 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.802 INFO:tasks.workunit.client.0.smithi070.stderr: -300> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding auth protocol: cephx 2024-09-12T00:58:18.802 INFO:tasks.workunit.client.0.smithi070.stderr: -299> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding auth protocol: cephx 2024-09-12T00:58:18.802 INFO:tasks.workunit.client.0.smithi070.stderr: -298> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding auth protocol: cephx 2024-09-12T00:58:18.802 INFO:tasks.workunit.client.0.smithi070.stderr: -297> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding con mode: secure 2024-09-12T00:58:18.802 INFO:tasks.workunit.client.0.smithi070.stderr: -296> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding con mode: crc 2024-09-12T00:58:18.802 INFO:tasks.workunit.client.0.smithi070.stderr: -295> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding con mode: secure 2024-09-12T00:58:18.802 INFO:tasks.workunit.client.0.smithi070.stderr: -294> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding con mode: crc 2024-09-12T00:58:18.802 INFO:tasks.workunit.client.0.smithi070.stderr: -293> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding con mode: secure 2024-09-12T00:58:18.802 INFO:tasks.workunit.client.0.smithi070.stderr: -292> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding con mode: crc 2024-09-12T00:58:18.803 INFO:tasks.workunit.client.0.smithi070.stderr: -291> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding con mode: crc 2024-09-12T00:58:18.803 INFO:tasks.workunit.client.0.smithi070.stderr: -290> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding con mode: secure 2024-09-12T00:58:18.803 INFO:tasks.workunit.client.0.smithi070.stderr: -289> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding con mode: crc 2024-09-12T00:58:18.803 INFO:tasks.workunit.client.0.smithi070.stderr: -288> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding con mode: secure 2024-09-12T00:58:18.803 INFO:tasks.workunit.client.0.smithi070.stderr: -287> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding con mode: crc 2024-09-12T00:58:18.803 INFO:tasks.workunit.client.0.smithi070.stderr: -286> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding con mode: secure 2024-09-12T00:58:18.803 INFO:tasks.workunit.client.0.smithi070.stderr: -285> 2024-09-12T00:58:18.694+0000 7f2c54688640 10 monclient: get_auth_request con 0x7f2b2c070a20 auth_method 0 2024-09-12T00:58:18.803 INFO:tasks.workunit.client.0.smithi070.stderr: -284> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:18.803 INFO:tasks.workunit.client.0.smithi070.stderr: -283> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient: init 2024-09-12T00:58:18.803 INFO:tasks.workunit.client.0.smithi070.stderr: -282> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding auth protocol: cephx 2024-09-12T00:58:18.803 INFO:tasks.workunit.client.0.smithi070.stderr: -281> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding auth protocol: cephx 2024-09-12T00:58:18.803 INFO:tasks.workunit.client.0.smithi070.stderr: -280> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding auth protocol: cephx 2024-09-12T00:58:18.803 INFO:tasks.workunit.client.0.smithi070.stderr: -279> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding con mode: secure 2024-09-12T00:58:18.803 INFO:tasks.workunit.client.0.smithi070.stderr: -278> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding con mode: crc 2024-09-12T00:58:18.804 INFO:tasks.workunit.client.0.smithi070.stderr: -277> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding con mode: secure 2024-09-12T00:58:18.804 INFO:tasks.workunit.client.0.smithi070.stderr: -276> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding con mode: crc 2024-09-12T00:58:18.804 INFO:tasks.workunit.client.0.smithi070.stderr: -275> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding con mode: secure 2024-09-12T00:58:18.804 INFO:tasks.workunit.client.0.smithi070.stderr: -274> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding con mode: crc 2024-09-12T00:58:18.804 INFO:tasks.workunit.client.0.smithi070.stderr: -273> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding con mode: crc 2024-09-12T00:58:18.804 INFO:tasks.workunit.client.0.smithi070.stderr: -272> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding con mode: secure 2024-09-12T00:58:18.804 INFO:tasks.workunit.client.0.smithi070.stderr: -271> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding con mode: crc 2024-09-12T00:58:18.804 INFO:tasks.workunit.client.0.smithi070.stderr: -270> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding con mode: secure 2024-09-12T00:58:18.804 INFO:tasks.workunit.client.0.smithi070.stderr: -269> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding con mode: crc 2024-09-12T00:58:18.804 INFO:tasks.workunit.client.0.smithi070.stderr: -268> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding con mode: secure 2024-09-12T00:58:18.804 INFO:tasks.workunit.client.0.smithi070.stderr: -267> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:18.804 INFO:tasks.workunit.client.0.smithi070.stderr: -266> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:18.804 INFO:tasks.workunit.client.0.smithi070.stderr: -265> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd759b85f8 EEXIST 2024-09-12T00:58:18.804 INFO:tasks.workunit.client.0.smithi070.stderr: -264> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient: _reopen_session rank -1 2024-09-12T00:58:18.804 INFO:tasks.workunit.client.0.smithi070.stderr: -263> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:58:18.805 INFO:tasks.workunit.client.0.smithi070.stderr: -262> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient(hunting): picked mon.noname-b con 0x5604dcf3ff90 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:58:18.805 INFO:tasks.workunit.client.0.smithi070.stderr: -261> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient(hunting): picked mon.noname-a con 0x5604dcf3b380 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:58:18.805 INFO:tasks.workunit.client.0.smithi070.stderr: -260> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient(hunting): picked mon.noname-c con 0x5604dcf31bb0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:58:18.805 INFO:tasks.workunit.client.0.smithi070.stderr: -259> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:18.805 INFO:tasks.workunit.client.0.smithi070.stderr: -258> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:18.805 INFO:tasks.workunit.client.0.smithi070.stderr: -257> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:18.805 INFO:tasks.workunit.client.0.smithi070.stderr: -256> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient(hunting): _renew_subs 2024-09-12T00:58:18.805 INFO:tasks.workunit.client.0.smithi070.stderr: -255> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient(hunting): authenticate will time out at 2349.143162s 2024-09-12T00:58:18.805 INFO:tasks.workunit.client.0.smithi070.stderr: -254> 2024-09-12T00:58:18.694+0000 7f2c53e87640 10 monclient(hunting): get_auth_request con 0x5604dcf3b380 auth_method 0 2024-09-12T00:58:18.805 INFO:tasks.workunit.client.0.smithi070.stderr: -253> 2024-09-12T00:58:18.694+0000 7f2c53e87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:18.805 INFO:tasks.workunit.client.0.smithi070.stderr: -252> 2024-09-12T00:58:18.694+0000 7f2c53e87640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:18.805 INFO:tasks.workunit.client.0.smithi070.stderr: -251> 2024-09-12T00:58:18.694+0000 7f2c53e87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:18.806 INFO:tasks.workunit.client.0.smithi070.stderr: -250> 2024-09-12T00:58:18.694+0000 7f2c54e89640 10 monclient(hunting): get_auth_request con 0x5604dcf31bb0 auth_method 0 2024-09-12T00:58:18.806 INFO:tasks.workunit.client.0.smithi070.stderr: -249> 2024-09-12T00:58:18.694+0000 7f2c54e89640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:18.806 INFO:tasks.workunit.client.0.smithi070.stderr: -248> 2024-09-12T00:58:18.694+0000 7f2c54e89640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:18.806 INFO:tasks.workunit.client.0.smithi070.stderr: -247> 2024-09-12T00:58:18.694+0000 7f2c54e89640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:18.806 INFO:tasks.workunit.client.0.smithi070.stderr: -246> 2024-09-12T00:58:18.694+0000 7f2c53e87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:18.806 INFO:tasks.workunit.client.0.smithi070.stderr: -245> 2024-09-12T00:58:18.694+0000 7f2c53e87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:18.806 INFO:tasks.workunit.client.0.smithi070.stderr: -244> 2024-09-12T00:58:18.694+0000 7f2c53e87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:18.806 INFO:tasks.workunit.client.0.smithi070.stderr: -243> 2024-09-12T00:58:18.694+0000 7f2c54688640 10 monclient(hunting): get_auth_request con 0x5604dcf3ff90 auth_method 0 2024-09-12T00:58:18.806 INFO:tasks.workunit.client.0.smithi070.stderr: -242> 2024-09-12T00:58:18.694+0000 7f2c54688640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:18.806 INFO:tasks.workunit.client.0.smithi070.stderr: -241> 2024-09-12T00:58:18.694+0000 7f2c54688640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:18.806 INFO:tasks.workunit.client.0.smithi070.stderr: -240> 2024-09-12T00:58:18.694+0000 7f2c54688640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:18.806 INFO:tasks.workunit.client.0.smithi070.stderr: -239> 2024-09-12T00:58:18.694+0000 7f2c54e89640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:18.806 INFO:tasks.workunit.client.0.smithi070.stderr: -238> 2024-09-12T00:58:18.694+0000 7f2c54e89640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:18.806 INFO:tasks.workunit.client.0.smithi070.stderr: -237> 2024-09-12T00:58:18.694+0000 7f2c54e89640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:18.807 INFO:tasks.workunit.client.0.smithi070.stderr: -236> 2024-09-12T00:58:18.694+0000 7f2c53e87640 10 monclient(hunting): handle_auth_done global_id 8055 payload 274 2024-09-12T00:58:18.807 INFO:tasks.workunit.client.0.smithi070.stderr: -235> 2024-09-12T00:58:18.694+0000 7f2c53e87640 10 monclient: _finish_hunting 0 2024-09-12T00:58:18.807 INFO:tasks.workunit.client.0.smithi070.stderr: -234> 2024-09-12T00:58:18.694+0000 7f2c53e87640 1 monclient: found mon.noname-a 2024-09-12T00:58:18.807 INFO:tasks.workunit.client.0.smithi070.stderr: -233> 2024-09-12T00:58:18.694+0000 7f2c53e87640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:58:18.807 INFO:tasks.workunit.client.0.smithi070.stderr: -232> 2024-09-12T00:58:18.694+0000 7f2b2b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:18.807 INFO:tasks.workunit.client.0.smithi070.stderr: -231> 2024-09-12T00:58:18.694+0000 7f2b2b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:58:18.807 INFO:tasks.workunit.client.0.smithi070.stderr: -230> 2024-09-12T00:58:18.694+0000 7f2b2b7fe640 10 monclient: dump: 2024-09-12T00:58:18.807 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:18.807 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:18.807 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.807 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.807 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:18.808 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:18.808 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:18.808 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:18.808 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:18.808 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.808 INFO:tasks.workunit.client.0.smithi070.stderr: -229> 2024-09-12T00:58:18.694+0000 7f2b2b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:58:18.808 INFO:tasks.workunit.client.0.smithi070.stderr: -228> 2024-09-12T00:58:18.694+0000 7f2b2b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:58:18.808 INFO:tasks.workunit.client.0.smithi070.stderr: -227> 2024-09-12T00:58:18.694+0000 7f2b2b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:58:18.808 INFO:tasks.workunit.client.0.smithi070.stderr: -226> 2024-09-12T00:58:18.694+0000 7f2b2b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:18.808 INFO:tasks.workunit.client.0.smithi070.stderr: -225> 2024-09-12T00:58:18.694+0000 7f2b2b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:58:18.808 INFO:tasks.workunit.client.0.smithi070.stderr: -224> 2024-09-12T00:58:18.694+0000 7f2b2b7fe640 10 monclient: dump: 2024-09-12T00:58:18.808 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:18.808 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:18.809 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.809 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.809 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:18.809 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:18.809 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:18.809 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:18.809 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:18.809 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.809 INFO:tasks.workunit.client.0.smithi070.stderr: -223> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 monclient: authenticate success, global_id 8055 2024-09-12T00:58:18.809 INFO:tasks.workunit.client.0.smithi070.stderr: -222> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient: get_monmap_and_config success 2024-09-12T00:58:18.809 INFO:tasks.workunit.client.0.smithi070.stderr: -221> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 4 set_mon_vals no callback set 2024-09-12T00:58:18.809 INFO:tasks.workunit.client.0.smithi070.stderr: -220> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient: shutdown 2024-09-12T00:58:18.809 INFO:tasks.workunit.client.0.smithi070.stderr: -219> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient: build_initial_monmap 2024-09-12T00:58:18.809 INFO:tasks.workunit.client.0.smithi070.stderr: -218> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 1 build_initial for_mkfs: 0 2024-09-12T00:58:18.809 INFO:tasks.workunit.client.0.smithi070.stderr: -217> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient: monmap: 2024-09-12T00:58:18.810 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:58:18.810 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:58:18.810 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:58:18.810 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:58:18.810 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:58:18.810 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:18.810 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:58:18.810 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:58:18.810 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:58:18.810 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.810 INFO:tasks.workunit.client.0.smithi070.stderr: -216> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding auth protocol: cephx 2024-09-12T00:58:18.810 INFO:tasks.workunit.client.0.smithi070.stderr: -215> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding auth protocol: cephx 2024-09-12T00:58:18.810 INFO:tasks.workunit.client.0.smithi070.stderr: -214> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding auth protocol: cephx 2024-09-12T00:58:18.810 INFO:tasks.workunit.client.0.smithi070.stderr: -213> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding con mode: secure 2024-09-12T00:58:18.811 INFO:tasks.workunit.client.0.smithi070.stderr: -212> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding con mode: crc 2024-09-12T00:58:18.811 INFO:tasks.workunit.client.0.smithi070.stderr: -211> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding con mode: secure 2024-09-12T00:58:18.811 INFO:tasks.workunit.client.0.smithi070.stderr: -210> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding con mode: crc 2024-09-12T00:58:18.811 INFO:tasks.workunit.client.0.smithi070.stderr: -209> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding con mode: secure 2024-09-12T00:58:18.811 INFO:tasks.workunit.client.0.smithi070.stderr: -208> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding con mode: crc 2024-09-12T00:58:18.811 INFO:tasks.workunit.client.0.smithi070.stderr: -207> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding con mode: crc 2024-09-12T00:58:18.811 INFO:tasks.workunit.client.0.smithi070.stderr: -206> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding con mode: secure 2024-09-12T00:58:18.811 INFO:tasks.workunit.client.0.smithi070.stderr: -205> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding con mode: crc 2024-09-12T00:58:18.811 INFO:tasks.workunit.client.0.smithi070.stderr: -204> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding con mode: secure 2024-09-12T00:58:18.811 INFO:tasks.workunit.client.0.smithi070.stderr: -203> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding con mode: crc 2024-09-12T00:58:18.811 INFO:tasks.workunit.client.0.smithi070.stderr: -202> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding con mode: secure 2024-09-12T00:58:18.811 INFO:tasks.workunit.client.0.smithi070.stderr: -201> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:18.811 INFO:tasks.workunit.client.0.smithi070.stderr: -200> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 1 librados: starting msgr at 2024-09-12T00:58:18.811 INFO:tasks.workunit.client.0.smithi070.stderr: -199> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 1 librados: starting objecter 2024-09-12T00:58:18.811 INFO:tasks.workunit.client.0.smithi070.stderr: -198> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command objecter_requests cmddesc objecter_requests hook 0x5604dcf39ed0 EEXIST 2024-09-12T00:58:18.812 INFO:tasks.workunit.client.0.smithi070.stderr: -197> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 1 librados: setting wanted keys 2024-09-12T00:58:18.812 INFO:tasks.workunit.client.0.smithi070.stderr: -196> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 1 librados: calling monclient init 2024-09-12T00:58:18.812 INFO:tasks.workunit.client.0.smithi070.stderr: -195> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient: init 2024-09-12T00:58:18.812 INFO:tasks.workunit.client.0.smithi070.stderr: -194> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding auth protocol: cephx 2024-09-12T00:58:18.812 INFO:tasks.workunit.client.0.smithi070.stderr: -193> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding auth protocol: cephx 2024-09-12T00:58:18.812 INFO:tasks.workunit.client.0.smithi070.stderr: -192> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding auth protocol: cephx 2024-09-12T00:58:18.812 INFO:tasks.workunit.client.0.smithi070.stderr: -191> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding con mode: secure 2024-09-12T00:58:18.812 INFO:tasks.workunit.client.0.smithi070.stderr: -190> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding con mode: crc 2024-09-12T00:58:18.812 INFO:tasks.workunit.client.0.smithi070.stderr: -189> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding con mode: secure 2024-09-12T00:58:18.812 INFO:tasks.workunit.client.0.smithi070.stderr: -188> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding con mode: crc 2024-09-12T00:58:18.812 INFO:tasks.workunit.client.0.smithi070.stderr: -187> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding con mode: secure 2024-09-12T00:58:18.812 INFO:tasks.workunit.client.0.smithi070.stderr: -186> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding con mode: crc 2024-09-12T00:58:18.812 INFO:tasks.workunit.client.0.smithi070.stderr: -185> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding con mode: crc 2024-09-12T00:58:18.813 INFO:tasks.workunit.client.0.smithi070.stderr: -184> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding con mode: secure 2024-09-12T00:58:18.813 INFO:tasks.workunit.client.0.smithi070.stderr: -183> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding con mode: crc 2024-09-12T00:58:18.813 INFO:tasks.workunit.client.0.smithi070.stderr: -182> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding con mode: secure 2024-09-12T00:58:18.813 INFO:tasks.workunit.client.0.smithi070.stderr: -181> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding con mode: crc 2024-09-12T00:58:18.813 INFO:tasks.workunit.client.0.smithi070.stderr: -180> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding con mode: secure 2024-09-12T00:58:18.813 INFO:tasks.workunit.client.0.smithi070.stderr: -179> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:18.813 INFO:tasks.workunit.client.0.smithi070.stderr: -178> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:18.813 INFO:tasks.workunit.client.0.smithi070.stderr: -177> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command rotate-key cmddesc rotate-key hook 0x5604dceee008 EEXIST 2024-09-12T00:58:18.813 INFO:tasks.workunit.client.0.smithi070.stderr: -176> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient: _reopen_session rank -1 2024-09-12T00:58:18.813 INFO:tasks.workunit.client.0.smithi070.stderr: -175> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:58:18.813 INFO:tasks.workunit.client.0.smithi070.stderr: -174> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient(hunting): picked mon.noname-c con 0x5604dcf31bb0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:58:18.813 INFO:tasks.workunit.client.0.smithi070.stderr: -173> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient(hunting): picked mon.noname-b con 0x5604dcf3b380 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:58:18.813 INFO:tasks.workunit.client.0.smithi070.stderr: -172> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient(hunting): picked mon.noname-a con 0x5604dcf3ff90 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:58:18.814 INFO:tasks.workunit.client.0.smithi070.stderr: -171> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:18.814 INFO:tasks.workunit.client.0.smithi070.stderr: -170> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:18.814 INFO:tasks.workunit.client.0.smithi070.stderr: -169> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:18.814 INFO:tasks.workunit.client.0.smithi070.stderr: -168> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient(hunting): _renew_subs 2024-09-12T00:58:18.814 INFO:tasks.workunit.client.0.smithi070.stderr: -167> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient(hunting): authenticate will time out at 2349.145908s 2024-09-12T00:58:18.814 INFO:tasks.workunit.client.0.smithi070.stderr: -166> 2024-09-12T00:58:18.698+0000 7f2c54688640 10 monclient(hunting): get_auth_request con 0x5604dcf31bb0 auth_method 0 2024-09-12T00:58:18.814 INFO:tasks.workunit.client.0.smithi070.stderr: -165> 2024-09-12T00:58:18.698+0000 7f2c54688640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:18.814 INFO:tasks.workunit.client.0.smithi070.stderr: -164> 2024-09-12T00:58:18.698+0000 7f2c54688640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:18.814 INFO:tasks.workunit.client.0.smithi070.stderr: -163> 2024-09-12T00:58:18.698+0000 7f2c54688640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:18.814 INFO:tasks.workunit.client.0.smithi070.stderr: -162> 2024-09-12T00:58:18.698+0000 7f2c54e89640 10 monclient(hunting): get_auth_request con 0x5604dcf3ff90 auth_method 0 2024-09-12T00:58:18.814 INFO:tasks.workunit.client.0.smithi070.stderr: -161> 2024-09-12T00:58:18.698+0000 7f2c54e89640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:18.814 INFO:tasks.workunit.client.0.smithi070.stderr: -160> 2024-09-12T00:58:18.698+0000 7f2c54e89640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:18.814 INFO:tasks.workunit.client.0.smithi070.stderr: -159> 2024-09-12T00:58:18.698+0000 7f2c54e89640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:18.814 INFO:tasks.workunit.client.0.smithi070.stderr: -158> 2024-09-12T00:58:18.698+0000 7f2c54e89640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:18.814 INFO:tasks.workunit.client.0.smithi070.stderr: -157> 2024-09-12T00:58:18.698+0000 7f2c54e89640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:18.815 INFO:tasks.workunit.client.0.smithi070.stderr: -156> 2024-09-12T00:58:18.698+0000 7f2c54e89640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:18.815 INFO:tasks.workunit.client.0.smithi070.stderr: -155> 2024-09-12T00:58:18.698+0000 7f2c54688640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:18.815 INFO:tasks.workunit.client.0.smithi070.stderr: -154> 2024-09-12T00:58:18.698+0000 7f2c54688640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:18.815 INFO:tasks.workunit.client.0.smithi070.stderr: -153> 2024-09-12T00:58:18.698+0000 7f2c54688640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:18.815 INFO:tasks.workunit.client.0.smithi070.stderr: -152> 2024-09-12T00:58:18.698+0000 7f2c54e89640 10 monclient(hunting): handle_auth_done global_id 8058 payload 824 2024-09-12T00:58:18.815 INFO:tasks.workunit.client.0.smithi070.stderr: -151> 2024-09-12T00:58:18.698+0000 7f2c54e89640 10 monclient: _finish_hunting 0 2024-09-12T00:58:18.815 INFO:tasks.workunit.client.0.smithi070.stderr: -150> 2024-09-12T00:58:18.698+0000 7f2c54e89640 1 monclient: found mon.noname-a 2024-09-12T00:58:18.815 INFO:tasks.workunit.client.0.smithi070.stderr: -149> 2024-09-12T00:58:18.698+0000 7f2c54e89640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:58:18.815 INFO:tasks.workunit.client.0.smithi070.stderr: -148> 2024-09-12T00:58:18.698+0000 7f2b29ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:18.815 INFO:tasks.workunit.client.0.smithi070.stderr: -147> 2024-09-12T00:58:18.698+0000 7f2b29ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:58:18.815 INFO:tasks.workunit.client.0.smithi070.stderr: -146> 2024-09-12T00:58:18.698+0000 7f2b29ffb640 10 monclient: dump: 2024-09-12T00:58:18.815 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:18.815 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:18.815 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.816 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.816 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:18.816 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:18.816 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:18.816 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:18.816 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:18.816 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.816 INFO:tasks.workunit.client.0.smithi070.stderr: -145> 2024-09-12T00:58:18.698+0000 7f2b29ffb640 10 monclient: _finish_auth 0 2024-09-12T00:58:18.816 INFO:tasks.workunit.client.0.smithi070.stderr: -144> 2024-09-12T00:58:18.698+0000 7f2b29ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:58:18.816 INFO:tasks.workunit.client.0.smithi070.stderr: -143> 2024-09-12T00:58:18.698+0000 7f2b29ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:58:18.816 INFO:tasks.workunit.client.0.smithi070.stderr: -142> 2024-09-12T00:58:18.698+0000 7f2b29ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:18.816 INFO:tasks.workunit.client.0.smithi070.stderr: -141> 2024-09-12T00:58:18.698+0000 7f2b29ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:58:18.816 INFO:tasks.workunit.client.0.smithi070.stderr: -140> 2024-09-12T00:58:18.698+0000 7f2b29ffb640 10 monclient: dump: 2024-09-12T00:58:18.817 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:18.817 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:18.817 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.817 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.817 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:18.817 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:18.817 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:18.817 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:18.817 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:18.817 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.817 INFO:tasks.workunit.client.0.smithi070.stderr: -139> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 monclient: authenticate success, global_id 8058 2024-09-12T00:58:18.817 INFO:tasks.workunit.client.0.smithi070.stderr: -138> 2024-09-12T00:58:18.698+0000 7f2b2b7fe640 4 set_mon_vals no callback set 2024-09-12T00:58:18.817 INFO:tasks.workunit.client.0.smithi070.stderr: -137> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient: _renew_subs 2024-09-12T00:58:18.818 INFO:tasks.workunit.client.0.smithi070.stderr: -136> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:58:18.818 INFO:tasks.workunit.client.0.smithi070.stderr: -135> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient: _renew_subs 2024-09-12T00:58:18.818 INFO:tasks.workunit.client.0.smithi070.stderr: -134> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:58:18.818 INFO:tasks.workunit.client.0.smithi070.stderr: -133> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 1 librados: init done 2024-09-12T00:58:18.818 INFO:tasks.workunit.client.0.smithi070.stderr: -132> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command cr dump hook 0x5604dcf364b8 2024-09-12T00:58:18.818 INFO:tasks.workunit.client.0.smithi070.stderr: -131> 2024-09-12T00:58:18.702+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.818 INFO:tasks.workunit.client.0.smithi070.stderr: -130> 2024-09-12T00:58:18.702+0000 7f2b29ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:58:18.818 INFO:tasks.workunit.client.0.smithi070.stderr: -129> 2024-09-12T00:58:18.702+0000 7f2b29ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:58:18.818 INFO:tasks.workunit.client.0.smithi070.stderr: -128> 2024-09-12T00:58:18.702+0000 7f2b29ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:58:18.818 INFO:tasks.workunit.client.0.smithi070.stderr: -127> 2024-09-12T00:58:18.702+0000 7f2c53e87640 10 monclient: get_auth_request con 0x5604dcf59a10 auth_method 0 2024-09-12T00:58:18.818 INFO:tasks.workunit.client.0.smithi070.stderr: -126> 2024-09-12T00:58:18.702+0000 7f2c54688640 10 monclient: get_auth_request con 0x7f2b1c070b10 auth_method 0 2024-09-12T00:58:18.818 INFO:tasks.workunit.client.0.smithi070.stderr: -125> 2024-09-12T00:58:18.702+0000 7f2c56b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.818 INFO:tasks.workunit.client.0.smithi070.stderr: -124> 2024-09-12T00:58:18.702+0000 7f2c56b829c0 20 realm 2024-09-12T00:58:18.818 INFO:tasks.workunit.client.0.smithi070.stderr: -123> 2024-09-12T00:58:18.702+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.819 INFO:tasks.workunit.client.0.smithi070.stderr: -122> 2024-09-12T00:58:18.702+0000 7f2c56b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.819 INFO:tasks.workunit.client.0.smithi070.stderr: -121> 2024-09-12T00:58:18.702+0000 7f2c56b829c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:18.819 INFO:tasks.workunit.client.0.smithi070.stderr: -120> 2024-09-12T00:58:18.702+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.819 INFO:tasks.workunit.client.0.smithi070.stderr: -119> 2024-09-12T00:58:18.702+0000 7f2c56b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.819 INFO:tasks.workunit.client.0.smithi070.stderr: -118> 2024-09-12T00:58:18.702+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.819 INFO:tasks.workunit.client.0.smithi070.stderr: -117> 2024-09-12T00:58:18.702+0000 7f2c54688640 10 monclient: get_auth_request con 0x5604dcf5db30 auth_method 0 2024-09-12T00:58:18.819 INFO:tasks.workunit.client.0.smithi070.stderr: -116> 2024-09-12T00:58:18.706+0000 7f2c56b829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:18.819 INFO:tasks.workunit.client.0.smithi070.stderr: -115> 2024-09-12T00:58:18.706+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.819 INFO:tasks.workunit.client.0.smithi070.stderr: -114> 2024-09-12T00:58:18.706+0000 7f2c53e87640 10 monclient: get_auth_request con 0x5604dcf61470 auth_method 0 2024-09-12T00:58:18.819 INFO:tasks.workunit.client.0.smithi070.stderr: -113> 2024-09-12T00:58:18.706+0000 7f2c56b829c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:18.819 INFO:tasks.workunit.client.0.smithi070.stderr: -112> 2024-09-12T00:58:18.706+0000 7f2c56b829c0 20 searching for the correct realm 2024-09-12T00:58:18.819 INFO:tasks.workunit.client.0.smithi070.stderr: -111> 2024-09-12T00:58:18.706+0000 7f2c54e89640 10 monclient: get_auth_request con 0x5604dcf65f20 auth_method 0 2024-09-12T00:58:18.819 INFO:tasks.workunit.client.0.smithi070.stderr: -110> 2024-09-12T00:58:18.706+0000 7f2c54688640 10 monclient: get_auth_request con 0x7f2c4c01e060 auth_method 0 2024-09-12T00:58:18.819 INFO:tasks.workunit.client.0.smithi070.stderr: -109> 2024-09-12T00:58:18.706+0000 7f2c53e87640 10 monclient: get_auth_request con 0x7f2c4405e040 auth_method 0 2024-09-12T00:58:18.820 INFO:tasks.workunit.client.0.smithi070.stderr: -108> 2024-09-12T00:58:18.710+0000 7f2c54e89640 10 monclient: get_auth_request con 0x7f2c480d3030 auth_method 0 2024-09-12T00:58:18.820 INFO:tasks.workunit.client.0.smithi070.stderr: -107> 2024-09-12T00:58:18.710+0000 7f2c54e89640 0 -- 172.21.15.70:0/618171556 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f2c480d3030 msgr2=0x7f2c480fcbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:18.820 INFO:tasks.workunit.client.0.smithi070.stderr: -106> 2024-09-12T00:58:18.710+0000 7f2b29ffb640 1 client.8058.objecter ms_handle_reset 0x7f2c480d3030 session 0x7f2c480a6070 osd.4 2024-09-12T00:58:18.820 INFO:tasks.workunit.client.0.smithi070.stderr: -105> 2024-09-12T00:58:18.710+0000 7f2b29ffb640 10 monclient: _renew_subs 2024-09-12T00:58:18.820 INFO:tasks.workunit.client.0.smithi070.stderr: -104> 2024-09-12T00:58:18.710+0000 7f2b29ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:58:18.820 INFO:tasks.workunit.client.0.smithi070.stderr: -103> 2024-09-12T00:58:18.710+0000 7f2c54e89640 10 monclient: get_auth_request con 0x7f2b1c080910 auth_method 0 2024-09-12T00:58:18.820 INFO:tasks.workunit.client.0.smithi070.stderr: -102> 2024-09-12T00:58:18.710+0000 7f2c54688640 10 monclient: get_auth_request con 0x7f2c4c087be0 auth_method 0 2024-09-12T00:58:18.820 INFO:tasks.workunit.client.0.smithi070.stderr: -101> 2024-09-12T00:58:18.718+0000 7f2c54688640 0 -- 172.21.15.70:0/618171556 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f2c4c087be0 msgr2=0x7f2c4c088080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:58:18.820 INFO:tasks.workunit.client.0.smithi070.stderr: -100> 2024-09-12T00:58:18.718+0000 7f2b29ffb640 1 client.8058.objecter ms_handle_reset 0x7f2c4c087be0 session 0x7f2c4c079800 osd.6 2024-09-12T00:58:18.820 INFO:tasks.workunit.client.0.smithi070.stderr: -99> 2024-09-12T00:58:18.718+0000 7f2c54688640 10 monclient: get_auth_request con 0x7f2c480d3030 auth_method 0 2024-09-12T00:58:18.820 INFO:tasks.workunit.client.0.smithi070.stderr: -98> 2024-09-12T00:58:18.722+0000 7f2c56b829c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:18.820 INFO:tasks.workunit.client.0.smithi070.stderr: -97> 2024-09-12T00:58:18.722+0000 7f2c56b829c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:58:18.820 INFO:tasks.workunit.client.0.smithi070.stderr: -96> 2024-09-12T00:58:18.722+0000 7f2c56b829c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:18.821 INFO:tasks.workunit.client.0.smithi070.stderr: -95> 2024-09-12T00:58:18.722+0000 7f2c56b829c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:58:18.821 INFO:tasks.workunit.client.0.smithi070.stderr: -94> 2024-09-12T00:58:18.722+0000 7f2c56b829c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:18.821 INFO:tasks.workunit.client.0.smithi070.stderr: -93> 2024-09-12T00:58:18.722+0000 7f2c56b829c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:18.821 INFO:tasks.workunit.client.0.smithi070.stderr: -92> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.821 INFO:tasks.workunit.client.0.smithi070.stderr: -91> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.821 INFO:tasks.workunit.client.0.smithi070.stderr: -90> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.821 INFO:tasks.workunit.client.0.smithi070.stderr: -89> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:18.821 INFO:tasks.workunit.client.0.smithi070.stderr: -88> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.821 INFO:tasks.workunit.client.0.smithi070.stderr: -87> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:18.821 INFO:tasks.workunit.client.0.smithi070.stderr: -86> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 zone default found 2024-09-12T00:58:18.821 INFO:tasks.workunit.client.0.smithi070.stderr: -85> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 4 Realm: () 2024-09-12T00:58:18.821 INFO:tasks.workunit.client.0.smithi070.stderr: -84> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:58:18.821 INFO:tasks.workunit.client.0.smithi070.stderr: -83> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:58:18.821 INFO:tasks.workunit.client.0.smithi070.stderr: -82> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:18.822 INFO:tasks.workunit.client.0.smithi070.stderr: -81> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 zonegroup default 2024-09-12T00:58:18.822 INFO:tasks.workunit.client.0.smithi070.stderr: -80> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.822 INFO:tasks.workunit.client.0.smithi070.stderr: -79> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.822 INFO:tasks.workunit.client.0.smithi070.stderr: -78> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.822 INFO:tasks.workunit.client.0.smithi070.stderr: -77> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.822 INFO:tasks.workunit.client.0.smithi070.stderr: -76> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.822 INFO:tasks.workunit.client.0.smithi070.stderr: -75> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.822 INFO:tasks.workunit.client.0.smithi070.stderr: -74> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 started sync module instance, tier type = 2024-09-12T00:58:18.822 INFO:tasks.workunit.client.0.smithi070.stderr: -73> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:58:18.822 INFO:tasks.workunit.client.0.smithi070.stderr: -72> 2024-09-12T00:58:18.742+0000 7f2c56b829c0 20 add_watcher() i=0 2024-09-12T00:58:18.822 INFO:tasks.workunit.client.0.smithi070.stderr: -71> 2024-09-12T00:58:18.742+0000 7f2c56b829c0 20 add_watcher() i=1 2024-09-12T00:58:18.822 INFO:tasks.workunit.client.0.smithi070.stderr: -70> 2024-09-12T00:58:18.742+0000 7f2c56b829c0 20 add_watcher() i=2 2024-09-12T00:58:18.822 INFO:tasks.workunit.client.0.smithi070.stderr: -69> 2024-09-12T00:58:18.742+0000 7f2c56b829c0 20 add_watcher() i=3 2024-09-12T00:58:18.822 INFO:tasks.workunit.client.0.smithi070.stderr: -68> 2024-09-12T00:58:18.742+0000 7f2c56b829c0 20 add_watcher() i=4 2024-09-12T00:58:18.823 INFO:tasks.workunit.client.0.smithi070.stderr: -67> 2024-09-12T00:58:18.742+0000 7f2c56b829c0 20 add_watcher() i=5 2024-09-12T00:58:18.823 INFO:tasks.workunit.client.0.smithi070.stderr: -66> 2024-09-12T00:58:18.742+0000 7f2c56b829c0 20 add_watcher() i=6 2024-09-12T00:58:18.823 INFO:tasks.workunit.client.0.smithi070.stderr: -65> 2024-09-12T00:58:18.742+0000 7f2c56b829c0 20 add_watcher() i=7 2024-09-12T00:58:18.823 INFO:tasks.workunit.client.0.smithi070.stderr: -64> 2024-09-12T00:58:18.742+0000 7f2c56b829c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:18.823 INFO:tasks.workunit.client.0.smithi070.stderr: -63> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding auth protocol: cephx 2024-09-12T00:58:18.823 INFO:tasks.workunit.client.0.smithi070.stderr: -62> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding auth protocol: cephx 2024-09-12T00:58:18.823 INFO:tasks.workunit.client.0.smithi070.stderr: -61> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding auth protocol: cephx 2024-09-12T00:58:18.823 INFO:tasks.workunit.client.0.smithi070.stderr: -60> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding con mode: secure 2024-09-12T00:58:18.823 INFO:tasks.workunit.client.0.smithi070.stderr: -59> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding con mode: crc 2024-09-12T00:58:18.823 INFO:tasks.workunit.client.0.smithi070.stderr: -58> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding con mode: secure 2024-09-12T00:58:18.823 INFO:tasks.workunit.client.0.smithi070.stderr: -57> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding con mode: crc 2024-09-12T00:58:18.823 INFO:tasks.workunit.client.0.smithi070.stderr: -56> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding con mode: secure 2024-09-12T00:58:18.823 INFO:tasks.workunit.client.0.smithi070.stderr: -55> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding con mode: crc 2024-09-12T00:58:18.823 INFO:tasks.workunit.client.0.smithi070.stderr: -54> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding con mode: crc 2024-09-12T00:58:18.824 INFO:tasks.workunit.client.0.smithi070.stderr: -53> 2024-09-12T00:58:18.746+0000 7f2b0afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:18.824 INFO:tasks.workunit.client.0.smithi070.stderr: -52> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding con mode: secure 2024-09-12T00:58:18.824 INFO:tasks.workunit.client.0.smithi070.stderr: -51> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding con mode: crc 2024-09-12T00:58:18.824 INFO:tasks.workunit.client.0.smithi070.stderr: -50> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding con mode: secure 2024-09-12T00:58:18.824 INFO:tasks.workunit.client.0.smithi070.stderr: -49> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding con mode: crc 2024-09-12T00:58:18.824 INFO:tasks.workunit.client.0.smithi070.stderr: -48> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding con mode: secure 2024-09-12T00:58:18.824 INFO:tasks.workunit.client.0.smithi070.stderr: -47> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:18.824 INFO:tasks.workunit.client.0.smithi070.stderr: -46> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:18.825 INFO:tasks.workunit.client.0.smithi070.stderr: -45> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:18.825 INFO:tasks.workunit.client.0.smithi070.stderr: -44> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command cache list hook 0x5604dcf31000 2024-09-12T00:58:18.825 INFO:tasks.workunit.client.0.smithi070.stderr: -43> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command cache inspect hook 0x5604dcf31000 2024-09-12T00:58:18.825 INFO:tasks.workunit.client.0.smithi070.stderr: -42> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command cache erase hook 0x5604dcf31000 2024-09-12T00:58:18.825 INFO:tasks.workunit.client.0.smithi070.stderr: -41> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command cache zap hook 0x5604dcf31000 2024-09-12T00:58:18.825 INFO:tasks.workunit.client.0.smithi070.stderr: -40> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 note: GC not initialized 2024-09-12T00:58:18.825 INFO:tasks.workunit.client.0.smithi070.stderr: -39> 2024-09-12T00:58:18.746+0000 7f2b09fdb640 20 reqs_thread_entry: start 2024-09-12T00:58:18.825 INFO:tasks.workunit.client.0.smithi070.stderr: -38> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command sync trace show hook 0x7f2c480d7020 2024-09-12T00:58:18.825 INFO:tasks.workunit.client.0.smithi070.stderr: -37> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command sync trace history hook 0x7f2c480d7020 2024-09-12T00:58:18.825 INFO:tasks.workunit.client.0.smithi070.stderr: -36> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command sync trace active hook 0x7f2c480d7020 2024-09-12T00:58:18.826 INFO:tasks.workunit.client.0.smithi070.stderr: -35> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command sync trace active_short hook 0x7f2c480d7020 2024-09-12T00:58:18.826 INFO:tasks.workunit.client.0.smithi070.stderr: -34> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 20 init_complete bucket index max shards: 1 2024-09-12T00:58:18.826 INFO:tasks.workunit.client.0.smithi070.stderr: -33> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 20 Filter name: none 2024-09-12T00:58:18.826 INFO:tasks.workunit.client.0.smithi070.stderr: -32> 2024-09-12T00:58:18.746+0000 7f2a7b7fe640 20 reqs_thread_entry: start 2024-09-12T00:58:18.826 INFO:tasks.workunit.client.0.smithi070.stderr: -31> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:58:18.826 INFO:tasks.workunit.client.0.smithi070.stderr: -30> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.826 INFO:tasks.workunit.client.0.smithi070.stderr: -29> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:58:18.827 INFO:tasks.workunit.client.0.smithi070.stderr: -28> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:58:18.827 INFO:tasks.workunit.client.0.smithi070.stderr: -27> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:58:18.827 INFO:tasks.workunit.client.0.smithi070.stderr: -26> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 : miss 2024-09-12T00:58:18.827 INFO:tasks.workunit.client.0.smithi070.stderr: -25> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.827 INFO:tasks.workunit.client.0.smithi070.stderr: -24> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:58:18.827 INFO:tasks.workunit.client.0.smithi070.stderr: -23> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 info.flags=0x17 2024-09-12T00:58:18.827 INFO:tasks.workunit.client.0.smithi070.stderr: -22> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 to cache LRU end 2024-09-12T00:58:18.827 INFO:tasks.workunit.client.0.smithi070.stderr: -21> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:58:18.827 INFO:tasks.workunit.client.0.smithi070.stderr: -20> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:18.827 INFO:tasks.workunit.client.0.smithi070.stderr: -19> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 2024-09-12T00:58:18.827 INFO:tasks.workunit.client.0.smithi070.stderr: -18> 2024-09-12T00:58:18.754+0000 7f2c56b829c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 info.flags=0x17 2024-09-12T00:58:18.827 INFO:tasks.workunit.client.0.smithi070.stderr: -17> 2024-09-12T00:58:18.754+0000 7f2c56b829c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 to cache LRU end 2024-09-12T00:58:18.828 INFO:tasks.workunit.client.0.smithi070.stderr: -16> 2024-09-12T00:58:18.754+0000 7f2c56b829c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:18.828 INFO:tasks.workunit.client.0.smithi070.stderr: -15> 2024-09-12T00:58:18.754+0000 7f2c56b829c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40, ofs0, ns] 2024-09-12T00:58:18.828 INFO:tasks.workunit.client.0.smithi070.stderr: -14> 2024-09-12T00:58:18.754+0000 7f2b2b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431570 cookie 94578887030208 notifier 8058 bl.length()=1015 2024-09-12T00:58:18.828 INFO:tasks.workunit.client.0.smithi070.stderr: -13> 2024-09-12T00:58:18.754+0000 7f2b2b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 info.flags=0x17 2024-09-12T00:58:18.828 INFO:tasks.workunit.client.0.smithi070.stderr: -12> 2024-09-12T00:58:18.754+0000 7f2b2b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 to cache LRU end 2024-09-12T00:58:18.828 INFO:tasks.workunit.client.0.smithi070.stderr: -11> 2024-09-12T00:58:18.754+0000 7f2b2b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:18.828 INFO:tasks.workunit.client.0.smithi070.stderr: -10> 2024-09-12T00:58:18.758+0000 7f2c56b829c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40]): orig_sources= new_sources= 2024-09-12T00:58:18.828 INFO:tasks.workunit.client.0.smithi070.stderr: -9> 2024-09-12T00:58:18.758+0000 7f2c56b829c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40]): potential sources added=[] removed=[] 2024-09-12T00:58:18.828 INFO:tasks.workunit.client.0.smithi070.stderr: -8> 2024-09-12T00:58:18.758+0000 7f2c56b829c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40]): orig_dests= new_dests= 2024-09-12T00:58:18.828 INFO:tasks.workunit.client.0.smithi070.stderr: -7> 2024-09-12T00:58:18.758+0000 7f2c56b829c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40]): potential dests added=[] removed=[] 2024-09-12T00:58:18.828 INFO:tasks.workunit.client.0.smithi070.stderr: -6> 2024-09-12T00:58:18.758+0000 7f2c56b829c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40.1.0 2024-09-12T00:58:18.828 INFO:tasks.workunit.client.0.smithi070.stderr: -5> 2024-09-12T00:58:18.758+0000 7f2c56b829c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40.1.0 2024-09-12T00:58:18.828 INFO:tasks.workunit.client.0.smithi070.stderr: -4> 2024-09-12T00:58:18.758+0000 7f2c56b829c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40.1.1 2024-09-12T00:58:18.829 INFO:tasks.workunit.client.0.smithi070.stderr: -3> 2024-09-12T00:58:18.758+0000 7f2c56b829c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40.1.1 2024-09-12T00:58:18.829 INFO:tasks.workunit.client.0.smithi070.stderr: -2> 2024-09-12T00:58:18.758+0000 7f2c56b829c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40.0 2024-09-12T00:58:18.829 INFO:tasks.workunit.client.0.smithi070.stderr: -1> 2024-09-12T00:58:18.762+0000 7f2c56b829c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2c56b829c0 time 2024-09-12T00:58:18.764947+0000 2024-09-12T00:58:18.829 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:58:18.829 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.829 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:58:18.829 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2c5a45c2eb] 2024-09-12T00:58:18.829 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2c5a45c49f] 2024-09-12T00:58:18.829 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604da38dcc1] 2024-09-12T00:58:18.829 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x5604da3a201c] 2024-09-12T00:58:18.829 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5604da3a36a4] 2024-09-12T00:58:18.829 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:58:18.829 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2c592c2d90] 2024-09-12T00:58:18.829 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:58:18.830 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:58:18.830 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.830 INFO:tasks.workunit.client.0.smithi070.stderr: 0> 2024-09-12T00:58:18.766+0000 7f2c56b829c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:58:18.830 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f2c56b829c0 thread_name:radosgw-admin 2024-09-12T00:58:18.830 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.830 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:58:18.830 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2c592db520] 2024-09-12T00:58:18.830 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:58:18.830 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:58:18.830 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:58:18.830 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2c5a45c345] 2024-09-12T00:58:18.830 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2c5a45c49f] 2024-09-12T00:58:18.830 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604da38dcc1] 2024-09-12T00:58:18.830 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x5604da3a201c] 2024-09-12T00:58:18.831 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5604da3a36a4] 2024-09-12T00:58:18.831 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:58:18.831 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2c592c2d90] 2024-09-12T00:58:18.831 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:58:18.831 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:58:18.831 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:58:18.831 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.831 INFO:tasks.workunit.client.0.smithi070.stderr:--- logging levels --- 2024-09-12T00:58:18.831 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 none 2024-09-12T00:58:18.831 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 lockdep 2024-09-12T00:58:18.831 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 context 2024-09-12T00:58:18.831 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 crush 2024-09-12T00:58:18.831 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds 2024-09-12T00:58:18.831 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_balancer 2024-09-12T00:58:18.832 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_locker 2024-09-12T00:58:18.832 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log 2024-09-12T00:58:18.832 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log_expire 2024-09-12T00:58:18.832 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_migrator 2024-09-12T00:58:18.832 INFO:tasks.workunit.client.0.smithi070.stderr: 3/ 5 mds_quiesce 2024-09-12T00:58:18.832 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 buffer 2024-09-12T00:58:18.832 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 timer 2024-09-12T00:58:18.832 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 filer 2024-09-12T00:58:18.832 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 striper 2024-09-12T00:58:18.832 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 objecter 2024-09-12T00:58:18.832 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rados 2024-09-12T00:58:18.832 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd 2024-09-12T00:58:18.832 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_mirror 2024-09-12T00:58:18.833 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_replay 2024-09-12T00:58:18.833 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_pwl 2024-09-12T00:58:18.833 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 journaler 2024-09-12T00:58:18.833 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objectcacher 2024-09-12T00:58:18.833 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:58:18.833 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 client 2024-09-12T00:58:18.833 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 osd 2024-09-12T00:58:18.833 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 optracker 2024-09-12T00:58:18.833 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objclass 2024-09-12T00:58:18.833 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 filestore 2024-09-12T00:58:18.833 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 journal 2024-09-12T00:58:18.833 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 ms 2024-09-12T00:58:18.833 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mon 2024-09-12T00:58:18.833 INFO:tasks.workunit.client.0.smithi070.stderr: 0/10 monc 2024-09-12T00:58:18.833 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 paxos 2024-09-12T00:58:18.834 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 tp 2024-09-12T00:58:18.834 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 auth 2024-09-12T00:58:18.834 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 crypto 2024-09-12T00:58:18.834 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 finisher 2024-09-12T00:58:18.834 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 reserver 2024-09-12T00:58:18.834 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 heartbeatmap 2024-09-12T00:58:18.834 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 perfcounter 2024-09-12T00:58:18.834 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw 2024-09-12T00:58:18.834 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_sync 2024-09-12T00:58:18.834 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_datacache 2024-09-12T00:58:18.834 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_access 2024-09-12T00:58:18.834 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:58:18.835 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_flight 2024-09-12T00:58:18.835 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:58:18.835 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw_notification 2024-09-12T00:58:18.835 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 javaclient 2024-09-12T00:58:18.835 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 asok 2024-09-12T00:58:18.835 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 throttle 2024-09-12T00:58:18.835 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 refs 2024-09-12T00:58:18.835 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 compressor 2024-09-12T00:58:18.835 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluestore 2024-09-12T00:58:18.835 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluefs 2024-09-12T00:58:18.835 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 bdev 2024-09-12T00:58:18.835 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 kstore 2024-09-12T00:58:18.835 INFO:tasks.workunit.client.0.smithi070.stderr: 4/ 5 rocksdb 2024-09-12T00:58:18.835 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 fuse 2024-09-12T00:58:18.836 INFO:tasks.workunit.client.0.smithi070.stderr: 2/ 5 mgr 2024-09-12T00:58:18.836 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mgrc 2024-09-12T00:58:18.836 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 dpdk 2024-09-12T00:58:18.836 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 eventtrace 2024-09-12T00:58:18.836 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 prioritycache 2024-09-12T00:58:18.836 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 test 2024-09-12T00:58:18.836 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:58:18.836 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephsqlite 2024-09-12T00:58:18.836 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:58:18.836 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore 2024-09-12T00:58:18.836 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_onode 2024-09-12T00:58:18.836 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_odata 2024-09-12T00:58:18.836 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_omap 2024-09-12T00:58:18.837 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_tm 2024-09-12T00:58:18.837 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_t 2024-09-12T00:58:18.837 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:58:18.837 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_epm 2024-09-12T00:58:18.837 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_lba 2024-09-12T00:58:18.837 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:58:18.837 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cache 2024-09-12T00:58:18.837 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_journal 2024-09-12T00:58:18.837 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_device 2024-09-12T00:58:18.837 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_backref 2024-09-12T00:58:18.837 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 alienstore 2024-09-12T00:58:18.837 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mclock 2024-09-12T00:58:18.837 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cyanstore 2024-09-12T00:58:18.838 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 ceph_exporter 2024-09-12T00:58:18.838 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 memstore 2024-09-12T00:58:18.838 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 trace 2024-09-12T00:58:18.838 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 ceph_dedup 2024-09-12T00:58:18.838 INFO:tasks.workunit.client.0.smithi070.stderr: -2/-2 (syslog threshold) 2024-09-12T00:58:18.838 INFO:tasks.workunit.client.0.smithi070.stderr: 99/99 (stderr threshold) 2024-09-12T00:58:18.838 INFO:tasks.workunit.client.0.smithi070.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:58:18.838 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2a7b7fe640 / http_manager 2024-09-12T00:58:18.838 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2b09fdb640 / http_manager 2024-09-12T00:58:18.838 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2b0afdd640 / rgw_dt_lg_renew 2024-09-12T00:58:18.838 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2b29ffb640 / ms_dispatch 2024-09-12T00:58:18.838 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2b2b7fe640 / io_context_pool 2024-09-12T00:58:18.838 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2b39ffb640 / ms_dispatch 2024-09-12T00:58:18.838 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2b40e09640 / ms_dispatch 2024-09-12T00:58:18.839 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2b4260c640 / io_context_pool 2024-09-12T00:58:18.839 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2c53686640 / io_context_pool 2024-09-12T00:58:18.839 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2c53e87640 / msgr-worker-2 2024-09-12T00:58:18.839 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2c54688640 / msgr-worker-1 2024-09-12T00:58:18.839 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2c54e89640 / msgr-worker-0 2024-09-12T00:58:18.839 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2c56b829c0 / radosgw-admin 2024-09-12T00:58:18.839 INFO:tasks.workunit.client.0.smithi070.stderr: max_recent 500 2024-09-12T00:58:18.839 INFO:tasks.workunit.client.0.smithi070.stderr: max_new 1000 2024-09-12T00:58:18.839 INFO:tasks.workunit.client.0.smithi070.stderr: log_file /var/log/ceph/ceph-client.admin.135059.log 2024-09-12T00:58:18.839 INFO:tasks.workunit.client.0.smithi070.stderr:--- end dump of recent events --- 2024-09-12T00:58:18.839 INFO:tasks.workunit.client.0.smithi070.stderr:--- begin dump of recent events --- 2024-09-12T00:58:18.839 INFO:tasks.workunit.client.0.smithi070.stderr: -499> 2024-09-12T00:58:18.678+0000 7f2b4260c640 10 monclient: _finish_auth 0 2024-09-12T00:58:18.839 INFO:tasks.workunit.client.0.smithi070.stderr: -498> 2024-09-12T00:58:18.678+0000 7f2b4260c640 10 monclient: _check_auth_tickets 2024-09-12T00:58:18.839 INFO:tasks.workunit.client.0.smithi070.stderr: -497> 2024-09-12T00:58:18.678+0000 7f2b4260c640 10 monclient: handle_config config(0 keys) 2024-09-12T00:58:18.839 INFO:tasks.workunit.client.0.smithi070.stderr: -496> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 monclient: authenticate success, global_id 7547 2024-09-12T00:58:18.840 INFO:tasks.workunit.client.0.smithi070.stderr: -495> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 10 monclient: get_monmap_and_config success 2024-09-12T00:58:18.840 INFO:tasks.workunit.client.0.smithi070.stderr: -494> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 4 set_mon_vals no callback set 2024-09-12T00:58:18.840 INFO:tasks.workunit.client.0.smithi070.stderr: -493> 2024-09-12T00:58:18.678+0000 7f2b4260c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:18.840 INFO:tasks.workunit.client.0.smithi070.stderr: -492> 2024-09-12T00:58:18.678+0000 7f2b4260c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:58:18.840 INFO:tasks.workunit.client.0.smithi070.stderr: -491> 2024-09-12T00:58:18.678+0000 7f2b4260c640 10 monclient: dump: 2024-09-12T00:58:18.840 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:18.840 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:18.840 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.840 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.840 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:18.840 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:18.840 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:18.840 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:18.840 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:18.841 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.841 INFO:tasks.workunit.client.0.smithi070.stderr: -490> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 10 monclient: shutdown 2024-09-12T00:58:18.841 INFO:tasks.workunit.client.0.smithi070.stderr: -489> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) unregister_commands rotate-key 2024-09-12T00:58:18.841 INFO:tasks.workunit.client.0.smithi070.stderr: -488> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 10 monclient: build_initial_monmap 2024-09-12T00:58:18.841 INFO:tasks.workunit.client.0.smithi070.stderr: -487> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 1 build_initial for_mkfs: 0 2024-09-12T00:58:18.841 INFO:tasks.workunit.client.0.smithi070.stderr: -486> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 10 monclient: monmap: 2024-09-12T00:58:18.841 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:58:18.841 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:58:18.841 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:58:18.841 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:58:18.841 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:58:18.841 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:18.841 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:58:18.842 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:58:18.842 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:58:18.842 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.842 INFO:tasks.workunit.client.0.smithi070.stderr: -485> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding auth protocol: cephx 2024-09-12T00:58:18.842 INFO:tasks.workunit.client.0.smithi070.stderr: -484> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding auth protocol: cephx 2024-09-12T00:58:18.842 INFO:tasks.workunit.client.0.smithi070.stderr: -483> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding auth protocol: cephx 2024-09-12T00:58:18.842 INFO:tasks.workunit.client.0.smithi070.stderr: -482> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding con mode: secure 2024-09-12T00:58:18.842 INFO:tasks.workunit.client.0.smithi070.stderr: -481> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding con mode: crc 2024-09-12T00:58:18.842 INFO:tasks.workunit.client.0.smithi070.stderr: -480> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding con mode: secure 2024-09-12T00:58:18.842 INFO:tasks.workunit.client.0.smithi070.stderr: -479> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding con mode: crc 2024-09-12T00:58:18.842 INFO:tasks.workunit.client.0.smithi070.stderr: -478> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding con mode: secure 2024-09-12T00:58:18.842 INFO:tasks.workunit.client.0.smithi070.stderr: -477> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding con mode: crc 2024-09-12T00:58:18.843 INFO:tasks.workunit.client.0.smithi070.stderr: -476> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding con mode: crc 2024-09-12T00:58:18.843 INFO:tasks.workunit.client.0.smithi070.stderr: -475> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding con mode: secure 2024-09-12T00:58:18.843 INFO:tasks.workunit.client.0.smithi070.stderr: -474> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding con mode: crc 2024-09-12T00:58:18.843 INFO:tasks.workunit.client.0.smithi070.stderr: -473> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding con mode: secure 2024-09-12T00:58:18.843 INFO:tasks.workunit.client.0.smithi070.stderr: -472> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding con mode: crc 2024-09-12T00:58:18.843 INFO:tasks.workunit.client.0.smithi070.stderr: -471> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce75f60) adding con mode: secure 2024-09-12T00:58:18.843 INFO:tasks.workunit.client.0.smithi070.stderr: -470> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:18.843 INFO:tasks.workunit.client.0.smithi070.stderr: -469> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 1 librados: starting msgr at 2024-09-12T00:58:18.843 INFO:tasks.workunit.client.0.smithi070.stderr: -468> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 1 librados: starting objecter 2024-09-12T00:58:18.843 INFO:tasks.workunit.client.0.smithi070.stderr: -467> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command objecter_requests hook 0x5604dce75e10 2024-09-12T00:58:18.843 INFO:tasks.workunit.client.0.smithi070.stderr: -466> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 1 librados: setting wanted keys 2024-09-12T00:58:18.843 INFO:tasks.workunit.client.0.smithi070.stderr: -465> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 1 librados: calling monclient init 2024-09-12T00:58:18.843 INFO:tasks.workunit.client.0.smithi070.stderr: -464> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 10 monclient: init 2024-09-12T00:58:18.843 INFO:tasks.workunit.client.0.smithi070.stderr: -463> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding auth protocol: cephx 2024-09-12T00:58:18.844 INFO:tasks.workunit.client.0.smithi070.stderr: -462> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding auth protocol: cephx 2024-09-12T00:58:18.844 INFO:tasks.workunit.client.0.smithi070.stderr: -461> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding auth protocol: cephx 2024-09-12T00:58:18.844 INFO:tasks.workunit.client.0.smithi070.stderr: -460> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding con mode: secure 2024-09-12T00:58:18.844 INFO:tasks.workunit.client.0.smithi070.stderr: -459> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding con mode: crc 2024-09-12T00:58:18.844 INFO:tasks.workunit.client.0.smithi070.stderr: -458> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding con mode: secure 2024-09-12T00:58:18.844 INFO:tasks.workunit.client.0.smithi070.stderr: -457> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding con mode: crc 2024-09-12T00:58:18.844 INFO:tasks.workunit.client.0.smithi070.stderr: -456> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding con mode: secure 2024-09-12T00:58:18.844 INFO:tasks.workunit.client.0.smithi070.stderr: -455> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding con mode: crc 2024-09-12T00:58:18.844 INFO:tasks.workunit.client.0.smithi070.stderr: -454> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding con mode: crc 2024-09-12T00:58:18.844 INFO:tasks.workunit.client.0.smithi070.stderr: -453> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding con mode: secure 2024-09-12T00:58:18.844 INFO:tasks.workunit.client.0.smithi070.stderr: -452> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding con mode: crc 2024-09-12T00:58:18.844 INFO:tasks.workunit.client.0.smithi070.stderr: -451> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding con mode: secure 2024-09-12T00:58:18.844 INFO:tasks.workunit.client.0.smithi070.stderr: -450> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding con mode: crc 2024-09-12T00:58:18.845 INFO:tasks.workunit.client.0.smithi070.stderr: -449> 2024-09-12T00:58:18.678+0000 7f2c56b829c0 5 AuthRegistry(0x5604dce70a10) adding con mode: secure 2024-09-12T00:58:18.845 INFO:tasks.workunit.client.0.smithi070.stderr: -448> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:18.845 INFO:tasks.workunit.client.0.smithi070.stderr: -447> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:18.845 INFO:tasks.workunit.client.0.smithi070.stderr: -446> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command rotate-key hook 0x5604dce70b58 2024-09-12T00:58:18.845 INFO:tasks.workunit.client.0.smithi070.stderr: -445> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient: _reopen_session rank -1 2024-09-12T00:58:18.845 INFO:tasks.workunit.client.0.smithi070.stderr: -444> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:58:18.845 INFO:tasks.workunit.client.0.smithi070.stderr: -443> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient(hunting): picked mon.noname-c con 0x5604dcd1eea0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:58:18.845 INFO:tasks.workunit.client.0.smithi070.stderr: -442> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient(hunting): picked mon.noname-b con 0x5604dcd28850 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:58:18.845 INFO:tasks.workunit.client.0.smithi070.stderr: -441> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient(hunting): picked mon.noname-a con 0x5604dcd2d4a0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:58:18.845 INFO:tasks.workunit.client.0.smithi070.stderr: -440> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:18.845 INFO:tasks.workunit.client.0.smithi070.stderr: -439> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:18.845 INFO:tasks.workunit.client.0.smithi070.stderr: -438> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:18.845 INFO:tasks.workunit.client.0.smithi070.stderr: -437> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient(hunting): _renew_subs 2024-09-12T00:58:18.845 INFO:tasks.workunit.client.0.smithi070.stderr: -436> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient(hunting): authenticate will time out at 2349.128448s 2024-09-12T00:58:18.846 INFO:tasks.workunit.client.0.smithi070.stderr: -435> 2024-09-12T00:58:18.682+0000 7f2c54688640 10 monclient(hunting): get_auth_request con 0x5604dcd1eea0 auth_method 0 2024-09-12T00:58:18.846 INFO:tasks.workunit.client.0.smithi070.stderr: -434> 2024-09-12T00:58:18.682+0000 7f2c54688640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:18.846 INFO:tasks.workunit.client.0.smithi070.stderr: -433> 2024-09-12T00:58:18.682+0000 7f2c54688640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:18.846 INFO:tasks.workunit.client.0.smithi070.stderr: -432> 2024-09-12T00:58:18.682+0000 7f2c54688640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:18.846 INFO:tasks.workunit.client.0.smithi070.stderr: -431> 2024-09-12T00:58:18.682+0000 7f2c54e89640 10 monclient(hunting): get_auth_request con 0x5604dcd2d4a0 auth_method 0 2024-09-12T00:58:18.846 INFO:tasks.workunit.client.0.smithi070.stderr: -430> 2024-09-12T00:58:18.682+0000 7f2c54e89640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:18.846 INFO:tasks.workunit.client.0.smithi070.stderr: -429> 2024-09-12T00:58:18.682+0000 7f2c54e89640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:18.846 INFO:tasks.workunit.client.0.smithi070.stderr: -428> 2024-09-12T00:58:18.682+0000 7f2c54e89640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:18.846 INFO:tasks.workunit.client.0.smithi070.stderr: -427> 2024-09-12T00:58:18.682+0000 7f2c54688640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:18.846 INFO:tasks.workunit.client.0.smithi070.stderr: -426> 2024-09-12T00:58:18.682+0000 7f2c54688640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:18.846 INFO:tasks.workunit.client.0.smithi070.stderr: -425> 2024-09-12T00:58:18.682+0000 7f2c54688640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:18.846 INFO:tasks.workunit.client.0.smithi070.stderr: -424> 2024-09-12T00:58:18.682+0000 7f2c54e89640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:18.846 INFO:tasks.workunit.client.0.smithi070.stderr: -423> 2024-09-12T00:58:18.682+0000 7f2c54e89640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:18.846 INFO:tasks.workunit.client.0.smithi070.stderr: -422> 2024-09-12T00:58:18.682+0000 7f2c54e89640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:18.846 INFO:tasks.workunit.client.0.smithi070.stderr: -421> 2024-09-12T00:58:18.682+0000 7f2c54e89640 10 monclient(hunting): handle_auth_done global_id 8049 payload 824 2024-09-12T00:58:18.847 INFO:tasks.workunit.client.0.smithi070.stderr: -420> 2024-09-12T00:58:18.682+0000 7f2c54e89640 10 monclient: _finish_hunting 0 2024-09-12T00:58:18.847 INFO:tasks.workunit.client.0.smithi070.stderr: -419> 2024-09-12T00:58:18.682+0000 7f2c54e89640 1 monclient: found mon.noname-a 2024-09-12T00:58:18.847 INFO:tasks.workunit.client.0.smithi070.stderr: -418> 2024-09-12T00:58:18.682+0000 7f2c54e89640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:58:18.847 INFO:tasks.workunit.client.0.smithi070.stderr: -417> 2024-09-12T00:58:18.682+0000 7f2c53e87640 10 monclient: get_auth_request con 0x5604dcd28850 auth_method 0 2024-09-12T00:58:18.847 INFO:tasks.workunit.client.0.smithi070.stderr: -416> 2024-09-12T00:58:18.682+0000 7f2b40e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:18.847 INFO:tasks.workunit.client.0.smithi070.stderr: -415> 2024-09-12T00:58:18.682+0000 7f2b40e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:58:18.847 INFO:tasks.workunit.client.0.smithi070.stderr: -414> 2024-09-12T00:58:18.682+0000 7f2b40e09640 10 monclient: dump: 2024-09-12T00:58:18.847 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:18.847 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:18.847 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.847 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.847 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:18.847 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:18.847 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:18.847 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:18.848 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:18.848 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.848 INFO:tasks.workunit.client.0.smithi070.stderr: -413> 2024-09-12T00:58:18.682+0000 7f2b40e09640 10 monclient: _finish_auth 0 2024-09-12T00:58:18.848 INFO:tasks.workunit.client.0.smithi070.stderr: -412> 2024-09-12T00:58:18.682+0000 7f2b40e09640 10 monclient: _check_auth_tickets 2024-09-12T00:58:18.848 INFO:tasks.workunit.client.0.smithi070.stderr: -411> 2024-09-12T00:58:18.682+0000 7f2b40e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:58:18.848 INFO:tasks.workunit.client.0.smithi070.stderr: -410> 2024-09-12T00:58:18.682+0000 7f2b40e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:18.848 INFO:tasks.workunit.client.0.smithi070.stderr: -409> 2024-09-12T00:58:18.682+0000 7f2b40e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:58:18.848 INFO:tasks.workunit.client.0.smithi070.stderr: -408> 2024-09-12T00:58:18.682+0000 7f2b40e09640 10 monclient: dump: 2024-09-12T00:58:18.848 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:18.848 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:18.848 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.848 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.848 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:18.848 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:18.848 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:18.849 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:18.849 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:18.849 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.849 INFO:tasks.workunit.client.0.smithi070.stderr: -407> 2024-09-12T00:58:18.682+0000 7f2b4260c640 4 set_mon_vals no callback set 2024-09-12T00:58:18.849 INFO:tasks.workunit.client.0.smithi070.stderr: -406> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 5 monclient: authenticate success, global_id 8049 2024-09-12T00:58:18.849 INFO:tasks.workunit.client.0.smithi070.stderr: -405> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient: _renew_subs 2024-09-12T00:58:18.849 INFO:tasks.workunit.client.0.smithi070.stderr: -404> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:58:18.849 INFO:tasks.workunit.client.0.smithi070.stderr: -403> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient: _renew_subs 2024-09-12T00:58:18.849 INFO:tasks.workunit.client.0.smithi070.stderr: -402> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:58:18.849 INFO:tasks.workunit.client.0.smithi070.stderr: -401> 2024-09-12T00:58:18.682+0000 7f2c56b829c0 1 librados: init done 2024-09-12T00:58:18.849 INFO:tasks.workunit.client.0.smithi070.stderr: -400> 2024-09-12T00:58:18.686+0000 7f2b40e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:58:18.849 INFO:tasks.workunit.client.0.smithi070.stderr: -399> 2024-09-12T00:58:18.686+0000 7f2b40e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:58:18.849 INFO:tasks.workunit.client.0.smithi070.stderr: -398> 2024-09-12T00:58:18.686+0000 7f2b40e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:58:18.850 INFO:tasks.workunit.client.0.smithi070.stderr: -397> 2024-09-12T00:58:18.686+0000 7f2c54688640 10 monclient: get_auth_request con 0x7f2b3c070b30 auth_method 0 2024-09-12T00:58:18.850 INFO:tasks.workunit.client.0.smithi070.stderr: -396> 2024-09-12T00:58:18.686+0000 7f2c53e87640 10 monclient: get_auth_request con 0x5604dce98be0 auth_method 0 2024-09-12T00:58:18.850 INFO:tasks.workunit.client.0.smithi070.stderr: -395> 2024-09-12T00:58:18.686+0000 7f2c54688640 10 monclient: get_auth_request con 0x5604dcebb250 auth_method 0 2024-09-12T00:58:18.850 INFO:tasks.workunit.client.0.smithi070.stderr: -394> 2024-09-12T00:58:18.686+0000 7f2c53e87640 10 monclient: get_auth_request con 0x5604dcebf8f0 auth_method 0 2024-09-12T00:58:18.850 INFO:tasks.workunit.client.0.smithi070.stderr: -393> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient: build_initial_monmap 2024-09-12T00:58:18.850 INFO:tasks.workunit.client.0.smithi070.stderr: -392> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 1 build_initial for_mkfs: 0 2024-09-12T00:58:18.850 INFO:tasks.workunit.client.0.smithi070.stderr: -391> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient: monmap: 2024-09-12T00:58:18.850 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:58:18.850 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:58:18.850 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:58:18.850 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:58:18.850 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:58:18.850 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:18.850 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:58:18.851 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:58:18.851 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:58:18.851 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.851 INFO:tasks.workunit.client.0.smithi070.stderr: -390> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding auth protocol: cephx 2024-09-12T00:58:18.851 INFO:tasks.workunit.client.0.smithi070.stderr: -389> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding auth protocol: cephx 2024-09-12T00:58:18.851 INFO:tasks.workunit.client.0.smithi070.stderr: -388> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding auth protocol: cephx 2024-09-12T00:58:18.851 INFO:tasks.workunit.client.0.smithi070.stderr: -387> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding con mode: secure 2024-09-12T00:58:18.851 INFO:tasks.workunit.client.0.smithi070.stderr: -386> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding con mode: crc 2024-09-12T00:58:18.851 INFO:tasks.workunit.client.0.smithi070.stderr: -385> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding con mode: secure 2024-09-12T00:58:18.851 INFO:tasks.workunit.client.0.smithi070.stderr: -384> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding con mode: crc 2024-09-12T00:58:18.851 INFO:tasks.workunit.client.0.smithi070.stderr: -383> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding con mode: secure 2024-09-12T00:58:18.851 INFO:tasks.workunit.client.0.smithi070.stderr: -382> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding con mode: crc 2024-09-12T00:58:18.851 INFO:tasks.workunit.client.0.smithi070.stderr: -381> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding con mode: crc 2024-09-12T00:58:18.852 INFO:tasks.workunit.client.0.smithi070.stderr: -380> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding con mode: secure 2024-09-12T00:58:18.852 INFO:tasks.workunit.client.0.smithi070.stderr: -379> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding con mode: crc 2024-09-12T00:58:18.852 INFO:tasks.workunit.client.0.smithi070.stderr: -378> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding con mode: secure 2024-09-12T00:58:18.852 INFO:tasks.workunit.client.0.smithi070.stderr: -377> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding con mode: crc 2024-09-12T00:58:18.852 INFO:tasks.workunit.client.0.smithi070.stderr: -376> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec4560) adding con mode: secure 2024-09-12T00:58:18.852 INFO:tasks.workunit.client.0.smithi070.stderr: -375> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:18.852 INFO:tasks.workunit.client.0.smithi070.stderr: -374> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command objecter_requests cmddesc objecter_requests hook 0x5604dcec7ef0 EEXIST 2024-09-12T00:58:18.852 INFO:tasks.workunit.client.0.smithi070.stderr: -373> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient: init 2024-09-12T00:58:18.852 INFO:tasks.workunit.client.0.smithi070.stderr: -372> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding auth protocol: cephx 2024-09-12T00:58:18.852 INFO:tasks.workunit.client.0.smithi070.stderr: -371> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding auth protocol: cephx 2024-09-12T00:58:18.852 INFO:tasks.workunit.client.0.smithi070.stderr: -370> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding auth protocol: cephx 2024-09-12T00:58:18.852 INFO:tasks.workunit.client.0.smithi070.stderr: -369> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding con mode: secure 2024-09-12T00:58:18.852 INFO:tasks.workunit.client.0.smithi070.stderr: -368> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding con mode: crc 2024-09-12T00:58:18.852 INFO:tasks.workunit.client.0.smithi070.stderr: -367> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding con mode: secure 2024-09-12T00:58:18.853 INFO:tasks.workunit.client.0.smithi070.stderr: -366> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding con mode: crc 2024-09-12T00:58:18.853 INFO:tasks.workunit.client.0.smithi070.stderr: -365> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding con mode: secure 2024-09-12T00:58:18.853 INFO:tasks.workunit.client.0.smithi070.stderr: -364> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding con mode: crc 2024-09-12T00:58:18.853 INFO:tasks.workunit.client.0.smithi070.stderr: -363> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding con mode: crc 2024-09-12T00:58:18.853 INFO:tasks.workunit.client.0.smithi070.stderr: -362> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding con mode: secure 2024-09-12T00:58:18.853 INFO:tasks.workunit.client.0.smithi070.stderr: -361> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding con mode: crc 2024-09-12T00:58:18.853 INFO:tasks.workunit.client.0.smithi070.stderr: -360> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding con mode: secure 2024-09-12T00:58:18.853 INFO:tasks.workunit.client.0.smithi070.stderr: -359> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding con mode: crc 2024-09-12T00:58:18.853 INFO:tasks.workunit.client.0.smithi070.stderr: -358> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcec2c88) adding con mode: secure 2024-09-12T00:58:18.853 INFO:tasks.workunit.client.0.smithi070.stderr: -357> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:18.853 INFO:tasks.workunit.client.0.smithi070.stderr: -356> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:18.853 INFO:tasks.workunit.client.0.smithi070.stderr: -355> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command rotate-key cmddesc rotate-key hook 0x5604dcec2dd0 EEXIST 2024-09-12T00:58:18.854 INFO:tasks.workunit.client.0.smithi070.stderr: -354> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient: _reopen_session rank -1 2024-09-12T00:58:18.854 INFO:tasks.workunit.client.0.smithi070.stderr: -353> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:58:18.854 INFO:tasks.workunit.client.0.smithi070.stderr: -352> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient(hunting): picked mon.noname-a con 0x5604dceec0a0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:58:18.854 INFO:tasks.workunit.client.0.smithi070.stderr: -351> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient(hunting): picked mon.noname-c con 0x5604dceeb9d0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:58:18.854 INFO:tasks.workunit.client.0.smithi070.stderr: -350> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient(hunting): picked mon.noname-b con 0x5604dceea3b0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:58:18.854 INFO:tasks.workunit.client.0.smithi070.stderr: -349> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:18.854 INFO:tasks.workunit.client.0.smithi070.stderr: -348> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:18.854 INFO:tasks.workunit.client.0.smithi070.stderr: -347> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:18.854 INFO:tasks.workunit.client.0.smithi070.stderr: -346> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient(hunting): _renew_subs 2024-09-12T00:58:18.854 INFO:tasks.workunit.client.0.smithi070.stderr: -345> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient(hunting): authenticate will time out at 2349.138046s 2024-09-12T00:58:18.854 INFO:tasks.workunit.client.0.smithi070.stderr: -344> 2024-09-12T00:58:18.690+0000 7f2c53e87640 10 monclient(hunting): get_auth_request con 0x5604dceeb9d0 auth_method 0 2024-09-12T00:58:18.854 INFO:tasks.workunit.client.0.smithi070.stderr: -343> 2024-09-12T00:58:18.690+0000 7f2c53e87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:18.854 INFO:tasks.workunit.client.0.smithi070.stderr: -342> 2024-09-12T00:58:18.690+0000 7f2c53e87640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:18.855 INFO:tasks.workunit.client.0.smithi070.stderr: -341> 2024-09-12T00:58:18.690+0000 7f2c53e87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:18.855 INFO:tasks.workunit.client.0.smithi070.stderr: -340> 2024-09-12T00:58:18.690+0000 7f2c54688640 10 monclient(hunting): get_auth_request con 0x5604dceec0a0 auth_method 0 2024-09-12T00:58:18.855 INFO:tasks.workunit.client.0.smithi070.stderr: -339> 2024-09-12T00:58:18.690+0000 7f2c54688640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:18.855 INFO:tasks.workunit.client.0.smithi070.stderr: -338> 2024-09-12T00:58:18.690+0000 7f2c54688640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:18.855 INFO:tasks.workunit.client.0.smithi070.stderr: -337> 2024-09-12T00:58:18.690+0000 7f2c54688640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:18.855 INFO:tasks.workunit.client.0.smithi070.stderr: -336> 2024-09-12T00:58:18.690+0000 7f2c53e87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:18.855 INFO:tasks.workunit.client.0.smithi070.stderr: -335> 2024-09-12T00:58:18.690+0000 7f2c53e87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:18.855 INFO:tasks.workunit.client.0.smithi070.stderr: -334> 2024-09-12T00:58:18.690+0000 7f2c53e87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:18.855 INFO:tasks.workunit.client.0.smithi070.stderr: -333> 2024-09-12T00:58:18.690+0000 7f2c54688640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:18.855 INFO:tasks.workunit.client.0.smithi070.stderr: -332> 2024-09-12T00:58:18.690+0000 7f2c54688640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:18.855 INFO:tasks.workunit.client.0.smithi070.stderr: -331> 2024-09-12T00:58:18.690+0000 7f2c54688640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:18.855 INFO:tasks.workunit.client.0.smithi070.stderr: -330> 2024-09-12T00:58:18.690+0000 7f2c54e89640 10 monclient(hunting): get_auth_request con 0x5604dceea3b0 auth_method 0 2024-09-12T00:58:18.855 INFO:tasks.workunit.client.0.smithi070.stderr: -329> 2024-09-12T00:58:18.690+0000 7f2c54e89640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:18.855 INFO:tasks.workunit.client.0.smithi070.stderr: -328> 2024-09-12T00:58:18.690+0000 7f2c54e89640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:18.855 INFO:tasks.workunit.client.0.smithi070.stderr: -327> 2024-09-12T00:58:18.690+0000 7f2c54e89640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:18.856 INFO:tasks.workunit.client.0.smithi070.stderr: -326> 2024-09-12T00:58:18.690+0000 7f2c53e87640 10 monclient(hunting): handle_auth_done global_id 7553 payload 824 2024-09-12T00:58:18.856 INFO:tasks.workunit.client.0.smithi070.stderr: -325> 2024-09-12T00:58:18.690+0000 7f2c53e87640 10 monclient: _finish_hunting 0 2024-09-12T00:58:18.856 INFO:tasks.workunit.client.0.smithi070.stderr: -324> 2024-09-12T00:58:18.690+0000 7f2c53e87640 1 monclient: found mon.noname-c 2024-09-12T00:58:18.856 INFO:tasks.workunit.client.0.smithi070.stderr: -323> 2024-09-12T00:58:18.690+0000 7f2c53e87640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:58:18.856 INFO:tasks.workunit.client.0.smithi070.stderr: -322> 2024-09-12T00:58:18.690+0000 7f2b39ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:18.856 INFO:tasks.workunit.client.0.smithi070.stderr: -321> 2024-09-12T00:58:18.690+0000 7f2b39ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:58:18.856 INFO:tasks.workunit.client.0.smithi070.stderr: -320> 2024-09-12T00:58:18.690+0000 7f2b39ffb640 10 monclient: dump: 2024-09-12T00:58:18.856 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:18.856 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:18.856 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.856 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.856 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:18.858 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:18.858 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:18.858 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:18.858 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:18.859 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.859 INFO:tasks.workunit.client.0.smithi070.stderr: -319> 2024-09-12T00:58:18.690+0000 7f2b39ffb640 10 monclient: _finish_auth 0 2024-09-12T00:58:18.859 INFO:tasks.workunit.client.0.smithi070.stderr: -318> 2024-09-12T00:58:18.690+0000 7f2b39ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:58:18.859 INFO:tasks.workunit.client.0.smithi070.stderr: -317> 2024-09-12T00:58:18.690+0000 7f2b39ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:58:18.859 INFO:tasks.workunit.client.0.smithi070.stderr: -316> 2024-09-12T00:58:18.690+0000 7f2b39ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:18.859 INFO:tasks.workunit.client.0.smithi070.stderr: -315> 2024-09-12T00:58:18.690+0000 7f2b39ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:58:18.860 INFO:tasks.workunit.client.0.smithi070.stderr: -314> 2024-09-12T00:58:18.690+0000 7f2b39ffb640 10 monclient: dump: 2024-09-12T00:58:18.860 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:18.860 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:18.860 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.860 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.861 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:18.861 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:18.861 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:18.861 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:18.861 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:18.861 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.862 INFO:tasks.workunit.client.0.smithi070.stderr: -313> 2024-09-12T00:58:18.690+0000 7f2c53686640 4 set_mon_vals no callback set 2024-09-12T00:58:18.862 INFO:tasks.workunit.client.0.smithi070.stderr: -312> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 5 monclient: authenticate success, global_id 7553 2024-09-12T00:58:18.862 INFO:tasks.workunit.client.0.smithi070.stderr: -311> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient: _renew_subs 2024-09-12T00:58:18.862 INFO:tasks.workunit.client.0.smithi070.stderr: -310> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:58:18.862 INFO:tasks.workunit.client.0.smithi070.stderr: -309> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient: _renew_subs 2024-09-12T00:58:18.862 INFO:tasks.workunit.client.0.smithi070.stderr: -308> 2024-09-12T00:58:18.690+0000 7f2c56b829c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:58:18.862 INFO:tasks.workunit.client.0.smithi070.stderr: -307> 2024-09-12T00:58:18.694+0000 7f2b39ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:58:18.862 INFO:tasks.workunit.client.0.smithi070.stderr: -306> 2024-09-12T00:58:18.694+0000 7f2b39ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:58:18.862 INFO:tasks.workunit.client.0.smithi070.stderr: -305> 2024-09-12T00:58:18.694+0000 7f2b39ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:58:18.863 INFO:tasks.workunit.client.0.smithi070.stderr: -304> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient: get_monmap_and_config 2024-09-12T00:58:18.863 INFO:tasks.workunit.client.0.smithi070.stderr: -303> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient: build_initial_monmap 2024-09-12T00:58:18.863 INFO:tasks.workunit.client.0.smithi070.stderr: -302> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 1 build_initial for_mkfs: 0 2024-09-12T00:58:18.863 INFO:tasks.workunit.client.0.smithi070.stderr: -301> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient: monmap: 2024-09-12T00:58:18.863 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:58:18.863 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:58:18.863 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:58:18.863 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:58:18.864 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:58:18.864 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:18.864 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:58:18.864 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:58:18.864 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:58:18.864 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.864 INFO:tasks.workunit.client.0.smithi070.stderr: -300> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding auth protocol: cephx 2024-09-12T00:58:18.864 INFO:tasks.workunit.client.0.smithi070.stderr: -299> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding auth protocol: cephx 2024-09-12T00:58:18.864 INFO:tasks.workunit.client.0.smithi070.stderr: -298> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding auth protocol: cephx 2024-09-12T00:58:18.864 INFO:tasks.workunit.client.0.smithi070.stderr: -297> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding con mode: secure 2024-09-12T00:58:18.865 INFO:tasks.workunit.client.0.smithi070.stderr: -296> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding con mode: crc 2024-09-12T00:58:18.865 INFO:tasks.workunit.client.0.smithi070.stderr: -295> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding con mode: secure 2024-09-12T00:58:18.865 INFO:tasks.workunit.client.0.smithi070.stderr: -294> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding con mode: crc 2024-09-12T00:58:18.865 INFO:tasks.workunit.client.0.smithi070.stderr: -293> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding con mode: secure 2024-09-12T00:58:18.865 INFO:tasks.workunit.client.0.smithi070.stderr: -292> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding con mode: crc 2024-09-12T00:58:18.865 INFO:tasks.workunit.client.0.smithi070.stderr: -291> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding con mode: crc 2024-09-12T00:58:18.865 INFO:tasks.workunit.client.0.smithi070.stderr: -290> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding con mode: secure 2024-09-12T00:58:18.865 INFO:tasks.workunit.client.0.smithi070.stderr: -289> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding con mode: crc 2024-09-12T00:58:18.865 INFO:tasks.workunit.client.0.smithi070.stderr: -288> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding con mode: secure 2024-09-12T00:58:18.865 INFO:tasks.workunit.client.0.smithi070.stderr: -287> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding con mode: crc 2024-09-12T00:58:18.865 INFO:tasks.workunit.client.0.smithi070.stderr: -286> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf0ba50) adding con mode: secure 2024-09-12T00:58:18.865 INFO:tasks.workunit.client.0.smithi070.stderr: -285> 2024-09-12T00:58:18.694+0000 7f2c54688640 10 monclient: get_auth_request con 0x7f2b2c070a20 auth_method 0 2024-09-12T00:58:18.865 INFO:tasks.workunit.client.0.smithi070.stderr: -284> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:18.866 INFO:tasks.workunit.client.0.smithi070.stderr: -283> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient: init 2024-09-12T00:58:18.866 INFO:tasks.workunit.client.0.smithi070.stderr: -282> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding auth protocol: cephx 2024-09-12T00:58:18.866 INFO:tasks.workunit.client.0.smithi070.stderr: -281> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding auth protocol: cephx 2024-09-12T00:58:18.866 INFO:tasks.workunit.client.0.smithi070.stderr: -280> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding auth protocol: cephx 2024-09-12T00:58:18.866 INFO:tasks.workunit.client.0.smithi070.stderr: -279> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding con mode: secure 2024-09-12T00:58:18.866 INFO:tasks.workunit.client.0.smithi070.stderr: -278> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding con mode: crc 2024-09-12T00:58:18.866 INFO:tasks.workunit.client.0.smithi070.stderr: -277> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding con mode: secure 2024-09-12T00:58:18.866 INFO:tasks.workunit.client.0.smithi070.stderr: -276> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding con mode: crc 2024-09-12T00:58:18.866 INFO:tasks.workunit.client.0.smithi070.stderr: -275> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding con mode: secure 2024-09-12T00:58:18.866 INFO:tasks.workunit.client.0.smithi070.stderr: -274> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding con mode: crc 2024-09-12T00:58:18.866 INFO:tasks.workunit.client.0.smithi070.stderr: -273> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding con mode: crc 2024-09-12T00:58:18.867 INFO:tasks.workunit.client.0.smithi070.stderr: -272> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding con mode: secure 2024-09-12T00:58:18.867 INFO:tasks.workunit.client.0.smithi070.stderr: -271> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding con mode: crc 2024-09-12T00:58:18.867 INFO:tasks.workunit.client.0.smithi070.stderr: -270> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding con mode: secure 2024-09-12T00:58:18.867 INFO:tasks.workunit.client.0.smithi070.stderr: -269> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding con mode: crc 2024-09-12T00:58:18.867 INFO:tasks.workunit.client.0.smithi070.stderr: -268> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b84b0) adding con mode: secure 2024-09-12T00:58:18.867 INFO:tasks.workunit.client.0.smithi070.stderr: -267> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:18.867 INFO:tasks.workunit.client.0.smithi070.stderr: -266> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:18.868 INFO:tasks.workunit.client.0.smithi070.stderr: -265> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd759b85f8 EEXIST 2024-09-12T00:58:18.868 INFO:tasks.workunit.client.0.smithi070.stderr: -264> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient: _reopen_session rank -1 2024-09-12T00:58:18.868 INFO:tasks.workunit.client.0.smithi070.stderr: -263> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:58:18.868 INFO:tasks.workunit.client.0.smithi070.stderr: -262> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient(hunting): picked mon.noname-b con 0x5604dcf3ff90 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:58:18.868 INFO:tasks.workunit.client.0.smithi070.stderr: -261> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient(hunting): picked mon.noname-a con 0x5604dcf3b380 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:58:18.868 INFO:tasks.workunit.client.0.smithi070.stderr: -260> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient(hunting): picked mon.noname-c con 0x5604dcf31bb0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:58:18.869 INFO:tasks.workunit.client.0.smithi070.stderr: -259> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:18.869 INFO:tasks.workunit.client.0.smithi070.stderr: -258> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:18.869 INFO:tasks.workunit.client.0.smithi070.stderr: -257> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:18.869 INFO:tasks.workunit.client.0.smithi070.stderr: -256> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient(hunting): _renew_subs 2024-09-12T00:58:18.869 INFO:tasks.workunit.client.0.smithi070.stderr: -255> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient(hunting): authenticate will time out at 2349.143162s 2024-09-12T00:58:18.869 INFO:tasks.workunit.client.0.smithi070.stderr: -254> 2024-09-12T00:58:18.694+0000 7f2c53e87640 10 monclient(hunting): get_auth_request con 0x5604dcf3b380 auth_method 0 2024-09-12T00:58:18.870 INFO:tasks.workunit.client.0.smithi070.stderr: -253> 2024-09-12T00:58:18.694+0000 7f2c53e87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:18.870 INFO:tasks.workunit.client.0.smithi070.stderr: -252> 2024-09-12T00:58:18.694+0000 7f2c53e87640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:18.870 INFO:tasks.workunit.client.0.smithi070.stderr: -251> 2024-09-12T00:58:18.694+0000 7f2c53e87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:18.870 INFO:tasks.workunit.client.0.smithi070.stderr: -250> 2024-09-12T00:58:18.694+0000 7f2c54e89640 10 monclient(hunting): get_auth_request con 0x5604dcf31bb0 auth_method 0 2024-09-12T00:58:18.870 INFO:tasks.workunit.client.0.smithi070.stderr: -249> 2024-09-12T00:58:18.694+0000 7f2c54e89640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:18.870 INFO:tasks.workunit.client.0.smithi070.stderr: -248> 2024-09-12T00:58:18.694+0000 7f2c54e89640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:18.870 INFO:tasks.workunit.client.0.smithi070.stderr: -247> 2024-09-12T00:58:18.694+0000 7f2c54e89640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:18.870 INFO:tasks.workunit.client.0.smithi070.stderr: -246> 2024-09-12T00:58:18.694+0000 7f2c53e87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:18.870 INFO:tasks.workunit.client.0.smithi070.stderr: -245> 2024-09-12T00:58:18.694+0000 7f2c53e87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:18.871 INFO:tasks.workunit.client.0.smithi070.stderr: -244> 2024-09-12T00:58:18.694+0000 7f2c53e87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:18.871 INFO:tasks.workunit.client.0.smithi070.stderr: -243> 2024-09-12T00:58:18.694+0000 7f2c54688640 10 monclient(hunting): get_auth_request con 0x5604dcf3ff90 auth_method 0 2024-09-12T00:58:18.871 INFO:tasks.workunit.client.0.smithi070.stderr: -242> 2024-09-12T00:58:18.694+0000 7f2c54688640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:18.871 INFO:tasks.workunit.client.0.smithi070.stderr: -241> 2024-09-12T00:58:18.694+0000 7f2c54688640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:18.871 INFO:tasks.workunit.client.0.smithi070.stderr: -240> 2024-09-12T00:58:18.694+0000 7f2c54688640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:18.872 INFO:tasks.workunit.client.0.smithi070.stderr: -239> 2024-09-12T00:58:18.694+0000 7f2c54e89640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:18.872 INFO:tasks.workunit.client.0.smithi070.stderr: -238> 2024-09-12T00:58:18.694+0000 7f2c54e89640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:18.872 INFO:tasks.workunit.client.0.smithi070.stderr: -237> 2024-09-12T00:58:18.694+0000 7f2c54e89640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:18.872 INFO:tasks.workunit.client.0.smithi070.stderr: -236> 2024-09-12T00:58:18.694+0000 7f2c53e87640 10 monclient(hunting): handle_auth_done global_id 8055 payload 274 2024-09-12T00:58:18.872 INFO:tasks.workunit.client.0.smithi070.stderr: -235> 2024-09-12T00:58:18.694+0000 7f2c53e87640 10 monclient: _finish_hunting 0 2024-09-12T00:58:18.872 INFO:tasks.workunit.client.0.smithi070.stderr: -234> 2024-09-12T00:58:18.694+0000 7f2c53e87640 1 monclient: found mon.noname-a 2024-09-12T00:58:18.872 INFO:tasks.workunit.client.0.smithi070.stderr: -233> 2024-09-12T00:58:18.694+0000 7f2c53e87640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:58:18.872 INFO:tasks.workunit.client.0.smithi070.stderr: -232> 2024-09-12T00:58:18.694+0000 7f2b2b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:18.872 INFO:tasks.workunit.client.0.smithi070.stderr: -231> 2024-09-12T00:58:18.694+0000 7f2b2b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:58:18.872 INFO:tasks.workunit.client.0.smithi070.stderr: -230> 2024-09-12T00:58:18.694+0000 7f2b2b7fe640 10 monclient: dump: 2024-09-12T00:58:18.872 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:18.872 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:18.873 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.873 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.873 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:18.873 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:18.873 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:18.873 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:18.873 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:18.873 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.876 INFO:tasks.workunit.client.0.smithi070.stderr: -229> 2024-09-12T00:58:18.694+0000 7f2b2b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:58:18.876 INFO:tasks.workunit.client.0.smithi070.stderr: -228> 2024-09-12T00:58:18.694+0000 7f2b2b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:58:18.876 INFO:tasks.workunit.client.0.smithi070.stderr: -227> 2024-09-12T00:58:18.694+0000 7f2b2b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:58:18.876 INFO:tasks.workunit.client.0.smithi070.stderr: -226> 2024-09-12T00:58:18.694+0000 7f2b2b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:18.876 INFO:tasks.workunit.client.0.smithi070.stderr: -225> 2024-09-12T00:58:18.694+0000 7f2b2b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:58:18.876 INFO:tasks.workunit.client.0.smithi070.stderr: -224> 2024-09-12T00:58:18.694+0000 7f2b2b7fe640 10 monclient: dump: 2024-09-12T00:58:18.876 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:18.876 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:18.877 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.877 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.877 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:18.877 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:18.877 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:18.877 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:18.877 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:18.877 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.878 INFO:tasks.workunit.client.0.smithi070.stderr: -223> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 5 monclient: authenticate success, global_id 8055 2024-09-12T00:58:18.878 INFO:tasks.workunit.client.0.smithi070.stderr: -222> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 10 monclient: get_monmap_and_config success 2024-09-12T00:58:18.878 INFO:tasks.workunit.client.0.smithi070.stderr: -221> 2024-09-12T00:58:18.694+0000 7f2c56b829c0 4 set_mon_vals no callback set 2024-09-12T00:58:18.878 INFO:tasks.workunit.client.0.smithi070.stderr: -220> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient: shutdown 2024-09-12T00:58:18.878 INFO:tasks.workunit.client.0.smithi070.stderr: -219> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient: build_initial_monmap 2024-09-12T00:58:18.878 INFO:tasks.workunit.client.0.smithi070.stderr: -218> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 1 build_initial for_mkfs: 0 2024-09-12T00:58:18.878 INFO:tasks.workunit.client.0.smithi070.stderr: -217> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient: monmap: 2024-09-12T00:58:18.879 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:58:18.879 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:58:18.879 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:58:18.879 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:58:18.879 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:58:18.879 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:18.879 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:58:18.880 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:58:18.880 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:58:18.880 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.880 INFO:tasks.workunit.client.0.smithi070.stderr: -216> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding auth protocol: cephx 2024-09-12T00:58:18.880 INFO:tasks.workunit.client.0.smithi070.stderr: -215> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding auth protocol: cephx 2024-09-12T00:58:18.880 INFO:tasks.workunit.client.0.smithi070.stderr: -214> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding auth protocol: cephx 2024-09-12T00:58:18.880 INFO:tasks.workunit.client.0.smithi070.stderr: -213> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding con mode: secure 2024-09-12T00:58:18.880 INFO:tasks.workunit.client.0.smithi070.stderr: -212> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding con mode: crc 2024-09-12T00:58:18.881 INFO:tasks.workunit.client.0.smithi070.stderr: -211> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding con mode: secure 2024-09-12T00:58:18.881 INFO:tasks.workunit.client.0.smithi070.stderr: -210> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding con mode: crc 2024-09-12T00:58:18.881 INFO:tasks.workunit.client.0.smithi070.stderr: -209> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding con mode: secure 2024-09-12T00:58:18.881 INFO:tasks.workunit.client.0.smithi070.stderr: -208> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding con mode: crc 2024-09-12T00:58:18.881 INFO:tasks.workunit.client.0.smithi070.stderr: -207> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding con mode: crc 2024-09-12T00:58:18.881 INFO:tasks.workunit.client.0.smithi070.stderr: -206> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding con mode: secure 2024-09-12T00:58:18.881 INFO:tasks.workunit.client.0.smithi070.stderr: -205> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding con mode: crc 2024-09-12T00:58:18.881 INFO:tasks.workunit.client.0.smithi070.stderr: -204> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding con mode: secure 2024-09-12T00:58:18.881 INFO:tasks.workunit.client.0.smithi070.stderr: -203> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding con mode: crc 2024-09-12T00:58:18.881 INFO:tasks.workunit.client.0.smithi070.stderr: -202> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dcf32100) adding con mode: secure 2024-09-12T00:58:18.881 INFO:tasks.workunit.client.0.smithi070.stderr: -201> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:18.881 INFO:tasks.workunit.client.0.smithi070.stderr: -200> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 1 librados: starting msgr at 2024-09-12T00:58:18.881 INFO:tasks.workunit.client.0.smithi070.stderr: -199> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 1 librados: starting objecter 2024-09-12T00:58:18.882 INFO:tasks.workunit.client.0.smithi070.stderr: -198> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command objecter_requests cmddesc objecter_requests hook 0x5604dcf39ed0 EEXIST 2024-09-12T00:58:18.882 INFO:tasks.workunit.client.0.smithi070.stderr: -197> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 1 librados: setting wanted keys 2024-09-12T00:58:18.882 INFO:tasks.workunit.client.0.smithi070.stderr: -196> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 1 librados: calling monclient init 2024-09-12T00:58:18.882 INFO:tasks.workunit.client.0.smithi070.stderr: -195> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient: init 2024-09-12T00:58:18.882 INFO:tasks.workunit.client.0.smithi070.stderr: -194> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding auth protocol: cephx 2024-09-12T00:58:18.882 INFO:tasks.workunit.client.0.smithi070.stderr: -193> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding auth protocol: cephx 2024-09-12T00:58:18.882 INFO:tasks.workunit.client.0.smithi070.stderr: -192> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding auth protocol: cephx 2024-09-12T00:58:18.882 INFO:tasks.workunit.client.0.smithi070.stderr: -191> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding con mode: secure 2024-09-12T00:58:18.882 INFO:tasks.workunit.client.0.smithi070.stderr: -190> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding con mode: crc 2024-09-12T00:58:18.882 INFO:tasks.workunit.client.0.smithi070.stderr: -189> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding con mode: secure 2024-09-12T00:58:18.882 INFO:tasks.workunit.client.0.smithi070.stderr: -188> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding con mode: crc 2024-09-12T00:58:18.882 INFO:tasks.workunit.client.0.smithi070.stderr: -187> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding con mode: secure 2024-09-12T00:58:18.882 INFO:tasks.workunit.client.0.smithi070.stderr: -186> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding con mode: crc 2024-09-12T00:58:18.883 INFO:tasks.workunit.client.0.smithi070.stderr: -185> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding con mode: crc 2024-09-12T00:58:18.883 INFO:tasks.workunit.client.0.smithi070.stderr: -184> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding con mode: secure 2024-09-12T00:58:18.883 INFO:tasks.workunit.client.0.smithi070.stderr: -183> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding con mode: crc 2024-09-12T00:58:18.883 INFO:tasks.workunit.client.0.smithi070.stderr: -182> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding con mode: secure 2024-09-12T00:58:18.883 INFO:tasks.workunit.client.0.smithi070.stderr: -181> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding con mode: crc 2024-09-12T00:58:18.883 INFO:tasks.workunit.client.0.smithi070.stderr: -180> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 AuthRegistry(0x5604dceedec0) adding con mode: secure 2024-09-12T00:58:18.883 INFO:tasks.workunit.client.0.smithi070.stderr: -179> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:18.883 INFO:tasks.workunit.client.0.smithi070.stderr: -178> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:18.883 INFO:tasks.workunit.client.0.smithi070.stderr: -177> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command rotate-key cmddesc rotate-key hook 0x5604dceee008 EEXIST 2024-09-12T00:58:18.883 INFO:tasks.workunit.client.0.smithi070.stderr: -176> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient: _reopen_session rank -1 2024-09-12T00:58:18.883 INFO:tasks.workunit.client.0.smithi070.stderr: -175> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:58:18.883 INFO:tasks.workunit.client.0.smithi070.stderr: -174> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient(hunting): picked mon.noname-c con 0x5604dcf31bb0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:58:18.883 INFO:tasks.workunit.client.0.smithi070.stderr: -173> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient(hunting): picked mon.noname-b con 0x5604dcf3b380 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:58:18.884 INFO:tasks.workunit.client.0.smithi070.stderr: -172> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient(hunting): picked mon.noname-a con 0x5604dcf3ff90 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:58:18.884 INFO:tasks.workunit.client.0.smithi070.stderr: -171> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:18.884 INFO:tasks.workunit.client.0.smithi070.stderr: -170> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:18.884 INFO:tasks.workunit.client.0.smithi070.stderr: -169> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:18.884 INFO:tasks.workunit.client.0.smithi070.stderr: -168> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient(hunting): _renew_subs 2024-09-12T00:58:18.884 INFO:tasks.workunit.client.0.smithi070.stderr: -167> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient(hunting): authenticate will time out at 2349.145908s 2024-09-12T00:58:18.884 INFO:tasks.workunit.client.0.smithi070.stderr: -166> 2024-09-12T00:58:18.698+0000 7f2c54688640 10 monclient(hunting): get_auth_request con 0x5604dcf31bb0 auth_method 0 2024-09-12T00:58:18.884 INFO:tasks.workunit.client.0.smithi070.stderr: -165> 2024-09-12T00:58:18.698+0000 7f2c54688640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:18.884 INFO:tasks.workunit.client.0.smithi070.stderr: -164> 2024-09-12T00:58:18.698+0000 7f2c54688640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:18.884 INFO:tasks.workunit.client.0.smithi070.stderr: -163> 2024-09-12T00:58:18.698+0000 7f2c54688640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:18.884 INFO:tasks.workunit.client.0.smithi070.stderr: -162> 2024-09-12T00:58:18.698+0000 7f2c54e89640 10 monclient(hunting): get_auth_request con 0x5604dcf3ff90 auth_method 0 2024-09-12T00:58:18.884 INFO:tasks.workunit.client.0.smithi070.stderr: -161> 2024-09-12T00:58:18.698+0000 7f2c54e89640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:18.885 INFO:tasks.workunit.client.0.smithi070.stderr: -160> 2024-09-12T00:58:18.698+0000 7f2c54e89640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:18.885 INFO:tasks.workunit.client.0.smithi070.stderr: -159> 2024-09-12T00:58:18.698+0000 7f2c54e89640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:18.885 INFO:tasks.workunit.client.0.smithi070.stderr: -158> 2024-09-12T00:58:18.698+0000 7f2c54e89640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:18.885 INFO:tasks.workunit.client.0.smithi070.stderr: -157> 2024-09-12T00:58:18.698+0000 7f2c54e89640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:18.885 INFO:tasks.workunit.client.0.smithi070.stderr: -156> 2024-09-12T00:58:18.698+0000 7f2c54e89640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:18.885 INFO:tasks.workunit.client.0.smithi070.stderr: -155> 2024-09-12T00:58:18.698+0000 7f2c54688640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:18.885 INFO:tasks.workunit.client.0.smithi070.stderr: -154> 2024-09-12T00:58:18.698+0000 7f2c54688640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:18.885 INFO:tasks.workunit.client.0.smithi070.stderr: -153> 2024-09-12T00:58:18.698+0000 7f2c54688640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:18.885 INFO:tasks.workunit.client.0.smithi070.stderr: -152> 2024-09-12T00:58:18.698+0000 7f2c54e89640 10 monclient(hunting): handle_auth_done global_id 8058 payload 824 2024-09-12T00:58:18.885 INFO:tasks.workunit.client.0.smithi070.stderr: -151> 2024-09-12T00:58:18.698+0000 7f2c54e89640 10 monclient: _finish_hunting 0 2024-09-12T00:58:18.886 INFO:tasks.workunit.client.0.smithi070.stderr: -150> 2024-09-12T00:58:18.698+0000 7f2c54e89640 1 monclient: found mon.noname-a 2024-09-12T00:58:18.886 INFO:tasks.workunit.client.0.smithi070.stderr: -149> 2024-09-12T00:58:18.698+0000 7f2c54e89640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:58:18.886 INFO:tasks.workunit.client.0.smithi070.stderr: -148> 2024-09-12T00:58:18.698+0000 7f2b29ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:18.886 INFO:tasks.workunit.client.0.smithi070.stderr: -147> 2024-09-12T00:58:18.698+0000 7f2b29ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:58:18.886 INFO:tasks.workunit.client.0.smithi070.stderr: -146> 2024-09-12T00:58:18.698+0000 7f2b29ffb640 10 monclient: dump: 2024-09-12T00:58:18.886 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:18.886 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:18.886 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.886 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.886 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:18.886 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:18.886 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:18.886 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:18.886 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:18.887 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.887 INFO:tasks.workunit.client.0.smithi070.stderr: -145> 2024-09-12T00:58:18.698+0000 7f2b29ffb640 10 monclient: _finish_auth 0 2024-09-12T00:58:18.887 INFO:tasks.workunit.client.0.smithi070.stderr: -144> 2024-09-12T00:58:18.698+0000 7f2b29ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:58:18.887 INFO:tasks.workunit.client.0.smithi070.stderr: -143> 2024-09-12T00:58:18.698+0000 7f2b29ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:58:18.887 INFO:tasks.workunit.client.0.smithi070.stderr: -142> 2024-09-12T00:58:18.698+0000 7f2b29ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:18.887 INFO:tasks.workunit.client.0.smithi070.stderr: -141> 2024-09-12T00:58:18.698+0000 7f2b29ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:58:18.887 INFO:tasks.workunit.client.0.smithi070.stderr: -140> 2024-09-12T00:58:18.698+0000 7f2b29ffb640 10 monclient: dump: 2024-09-12T00:58:18.887 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:18.887 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:18.887 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.887 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:18.887 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:18.887 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:18.887 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:18.887 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:18.888 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:18.888 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.888 INFO:tasks.workunit.client.0.smithi070.stderr: -139> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 monclient: authenticate success, global_id 8058 2024-09-12T00:58:18.888 INFO:tasks.workunit.client.0.smithi070.stderr: -138> 2024-09-12T00:58:18.698+0000 7f2b2b7fe640 4 set_mon_vals no callback set 2024-09-12T00:58:18.888 INFO:tasks.workunit.client.0.smithi070.stderr: -137> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient: _renew_subs 2024-09-12T00:58:18.888 INFO:tasks.workunit.client.0.smithi070.stderr: -136> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:58:18.888 INFO:tasks.workunit.client.0.smithi070.stderr: -135> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient: _renew_subs 2024-09-12T00:58:18.888 INFO:tasks.workunit.client.0.smithi070.stderr: -134> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:58:18.888 INFO:tasks.workunit.client.0.smithi070.stderr: -133> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 1 librados: init done 2024-09-12T00:58:18.888 INFO:tasks.workunit.client.0.smithi070.stderr: -132> 2024-09-12T00:58:18.698+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command cr dump hook 0x5604dcf364b8 2024-09-12T00:58:18.888 INFO:tasks.workunit.client.0.smithi070.stderr: -131> 2024-09-12T00:58:18.702+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.888 INFO:tasks.workunit.client.0.smithi070.stderr: -130> 2024-09-12T00:58:18.702+0000 7f2b29ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:58:18.888 INFO:tasks.workunit.client.0.smithi070.stderr: -129> 2024-09-12T00:58:18.702+0000 7f2b29ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:58:18.889 INFO:tasks.workunit.client.0.smithi070.stderr: -128> 2024-09-12T00:58:18.702+0000 7f2b29ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:58:18.889 INFO:tasks.workunit.client.0.smithi070.stderr: -127> 2024-09-12T00:58:18.702+0000 7f2c53e87640 10 monclient: get_auth_request con 0x5604dcf59a10 auth_method 0 2024-09-12T00:58:18.889 INFO:tasks.workunit.client.0.smithi070.stderr: -126> 2024-09-12T00:58:18.702+0000 7f2c54688640 10 monclient: get_auth_request con 0x7f2b1c070b10 auth_method 0 2024-09-12T00:58:18.889 INFO:tasks.workunit.client.0.smithi070.stderr: -125> 2024-09-12T00:58:18.702+0000 7f2c56b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.889 INFO:tasks.workunit.client.0.smithi070.stderr: -124> 2024-09-12T00:58:18.702+0000 7f2c56b829c0 20 realm 2024-09-12T00:58:18.889 INFO:tasks.workunit.client.0.smithi070.stderr: -123> 2024-09-12T00:58:18.702+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.889 INFO:tasks.workunit.client.0.smithi070.stderr: -122> 2024-09-12T00:58:18.702+0000 7f2c56b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.889 INFO:tasks.workunit.client.0.smithi070.stderr: -121> 2024-09-12T00:58:18.702+0000 7f2c56b829c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:18.889 INFO:tasks.workunit.client.0.smithi070.stderr: -120> 2024-09-12T00:58:18.702+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.889 INFO:tasks.workunit.client.0.smithi070.stderr: -119> 2024-09-12T00:58:18.702+0000 7f2c56b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.889 INFO:tasks.workunit.client.0.smithi070.stderr: -118> 2024-09-12T00:58:18.702+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.889 INFO:tasks.workunit.client.0.smithi070.stderr: -117> 2024-09-12T00:58:18.702+0000 7f2c54688640 10 monclient: get_auth_request con 0x5604dcf5db30 auth_method 0 2024-09-12T00:58:18.889 INFO:tasks.workunit.client.0.smithi070.stderr: -116> 2024-09-12T00:58:18.706+0000 7f2c56b829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:18.889 INFO:tasks.workunit.client.0.smithi070.stderr: -115> 2024-09-12T00:58:18.706+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.890 INFO:tasks.workunit.client.0.smithi070.stderr: -114> 2024-09-12T00:58:18.706+0000 7f2c53e87640 10 monclient: get_auth_request con 0x5604dcf61470 auth_method 0 2024-09-12T00:58:18.890 INFO:tasks.workunit.client.0.smithi070.stderr: -113> 2024-09-12T00:58:18.706+0000 7f2c56b829c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:18.890 INFO:tasks.workunit.client.0.smithi070.stderr: -112> 2024-09-12T00:58:18.706+0000 7f2c56b829c0 20 searching for the correct realm 2024-09-12T00:58:18.890 INFO:tasks.workunit.client.0.smithi070.stderr: -111> 2024-09-12T00:58:18.706+0000 7f2c54e89640 10 monclient: get_auth_request con 0x5604dcf65f20 auth_method 0 2024-09-12T00:58:18.890 INFO:tasks.workunit.client.0.smithi070.stderr: -110> 2024-09-12T00:58:18.706+0000 7f2c54688640 10 monclient: get_auth_request con 0x7f2c4c01e060 auth_method 0 2024-09-12T00:58:18.890 INFO:tasks.workunit.client.0.smithi070.stderr: -109> 2024-09-12T00:58:18.706+0000 7f2c53e87640 10 monclient: get_auth_request con 0x7f2c4405e040 auth_method 0 2024-09-12T00:58:18.890 INFO:tasks.workunit.client.0.smithi070.stderr: -108> 2024-09-12T00:58:18.710+0000 7f2c54e89640 10 monclient: get_auth_request con 0x7f2c480d3030 auth_method 0 2024-09-12T00:58:18.890 INFO:tasks.workunit.client.0.smithi070.stderr: -107> 2024-09-12T00:58:18.710+0000 7f2c54e89640 0 -- 172.21.15.70:0/618171556 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f2c480d3030 msgr2=0x7f2c480fcbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:18.890 INFO:tasks.workunit.client.0.smithi070.stderr: -106> 2024-09-12T00:58:18.710+0000 7f2b29ffb640 1 client.8058.objecter ms_handle_reset 0x7f2c480d3030 session 0x7f2c480a6070 osd.4 2024-09-12T00:58:18.890 INFO:tasks.workunit.client.0.smithi070.stderr: -105> 2024-09-12T00:58:18.710+0000 7f2b29ffb640 10 monclient: _renew_subs 2024-09-12T00:58:18.890 INFO:tasks.workunit.client.0.smithi070.stderr: -104> 2024-09-12T00:58:18.710+0000 7f2b29ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:58:18.890 INFO:tasks.workunit.client.0.smithi070.stderr: -103> 2024-09-12T00:58:18.710+0000 7f2c54e89640 10 monclient: get_auth_request con 0x7f2b1c080910 auth_method 0 2024-09-12T00:58:18.890 INFO:tasks.workunit.client.0.smithi070.stderr: -102> 2024-09-12T00:58:18.710+0000 7f2c54688640 10 monclient: get_auth_request con 0x7f2c4c087be0 auth_method 0 2024-09-12T00:58:18.891 INFO:tasks.workunit.client.0.smithi070.stderr: -101> 2024-09-12T00:58:18.718+0000 7f2c54688640 0 -- 172.21.15.70:0/618171556 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f2c4c087be0 msgr2=0x7f2c4c088080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:58:18.891 INFO:tasks.workunit.client.0.smithi070.stderr: -100> 2024-09-12T00:58:18.718+0000 7f2b29ffb640 1 client.8058.objecter ms_handle_reset 0x7f2c4c087be0 session 0x7f2c4c079800 osd.6 2024-09-12T00:58:18.891 INFO:tasks.workunit.client.0.smithi070.stderr: -99> 2024-09-12T00:58:18.718+0000 7f2c54688640 10 monclient: get_auth_request con 0x7f2c480d3030 auth_method 0 2024-09-12T00:58:18.891 INFO:tasks.workunit.client.0.smithi070.stderr: -98> 2024-09-12T00:58:18.722+0000 7f2c56b829c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:18.891 INFO:tasks.workunit.client.0.smithi070.stderr: -97> 2024-09-12T00:58:18.722+0000 7f2c56b829c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:58:18.891 INFO:tasks.workunit.client.0.smithi070.stderr: -96> 2024-09-12T00:58:18.722+0000 7f2c56b829c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:18.891 INFO:tasks.workunit.client.0.smithi070.stderr: -95> 2024-09-12T00:58:18.722+0000 7f2c56b829c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:58:18.891 INFO:tasks.workunit.client.0.smithi070.stderr: -94> 2024-09-12T00:58:18.722+0000 7f2c56b829c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:18.891 INFO:tasks.workunit.client.0.smithi070.stderr: -93> 2024-09-12T00:58:18.722+0000 7f2c56b829c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:18.891 INFO:tasks.workunit.client.0.smithi070.stderr: -92> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.891 INFO:tasks.workunit.client.0.smithi070.stderr: -91> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.891 INFO:tasks.workunit.client.0.smithi070.stderr: -90> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.891 INFO:tasks.workunit.client.0.smithi070.stderr: -89> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:18.892 INFO:tasks.workunit.client.0.smithi070.stderr: -88> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.892 INFO:tasks.workunit.client.0.smithi070.stderr: -87> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:18.892 INFO:tasks.workunit.client.0.smithi070.stderr: -86> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 zone default found 2024-09-12T00:58:18.892 INFO:tasks.workunit.client.0.smithi070.stderr: -85> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 4 Realm: () 2024-09-12T00:58:18.892 INFO:tasks.workunit.client.0.smithi070.stderr: -84> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:58:18.892 INFO:tasks.workunit.client.0.smithi070.stderr: -83> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:58:18.892 INFO:tasks.workunit.client.0.smithi070.stderr: -82> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:18.892 INFO:tasks.workunit.client.0.smithi070.stderr: -81> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 zonegroup default 2024-09-12T00:58:18.892 INFO:tasks.workunit.client.0.smithi070.stderr: -80> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.892 INFO:tasks.workunit.client.0.smithi070.stderr: -79> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.892 INFO:tasks.workunit.client.0.smithi070.stderr: -78> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.892 INFO:tasks.workunit.client.0.smithi070.stderr: -77> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.892 INFO:tasks.workunit.client.0.smithi070.stderr: -76> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.893 INFO:tasks.workunit.client.0.smithi070.stderr: -75> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.893 INFO:tasks.workunit.client.0.smithi070.stderr: -74> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 started sync module instance, tier type = 2024-09-12T00:58:18.893 INFO:tasks.workunit.client.0.smithi070.stderr: -73> 2024-09-12T00:58:18.726+0000 7f2c56b829c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:58:18.893 INFO:tasks.workunit.client.0.smithi070.stderr: -72> 2024-09-12T00:58:18.742+0000 7f2c56b829c0 20 add_watcher() i=0 2024-09-12T00:58:18.893 INFO:tasks.workunit.client.0.smithi070.stderr: -71> 2024-09-12T00:58:18.742+0000 7f2c56b829c0 20 add_watcher() i=1 2024-09-12T00:58:18.893 INFO:tasks.workunit.client.0.smithi070.stderr: -70> 2024-09-12T00:58:18.742+0000 7f2c56b829c0 20 add_watcher() i=2 2024-09-12T00:58:18.893 INFO:tasks.workunit.client.0.smithi070.stderr: -69> 2024-09-12T00:58:18.742+0000 7f2c56b829c0 20 add_watcher() i=3 2024-09-12T00:58:18.893 INFO:tasks.workunit.client.0.smithi070.stderr: -68> 2024-09-12T00:58:18.742+0000 7f2c56b829c0 20 add_watcher() i=4 2024-09-12T00:58:18.893 INFO:tasks.workunit.client.0.smithi070.stderr: -67> 2024-09-12T00:58:18.742+0000 7f2c56b829c0 20 add_watcher() i=5 2024-09-12T00:58:18.893 INFO:tasks.workunit.client.0.smithi070.stderr: -66> 2024-09-12T00:58:18.742+0000 7f2c56b829c0 20 add_watcher() i=6 2024-09-12T00:58:18.893 INFO:tasks.workunit.client.0.smithi070.stderr: -65> 2024-09-12T00:58:18.742+0000 7f2c56b829c0 20 add_watcher() i=7 2024-09-12T00:58:18.893 INFO:tasks.workunit.client.0.smithi070.stderr: -64> 2024-09-12T00:58:18.742+0000 7f2c56b829c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:18.893 INFO:tasks.workunit.client.0.smithi070.stderr: -63> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding auth protocol: cephx 2024-09-12T00:58:18.893 INFO:tasks.workunit.client.0.smithi070.stderr: -62> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding auth protocol: cephx 2024-09-12T00:58:18.894 INFO:tasks.workunit.client.0.smithi070.stderr: -61> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding auth protocol: cephx 2024-09-12T00:58:18.894 INFO:tasks.workunit.client.0.smithi070.stderr: -60> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding con mode: secure 2024-09-12T00:58:18.894 INFO:tasks.workunit.client.0.smithi070.stderr: -59> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding con mode: crc 2024-09-12T00:58:18.894 INFO:tasks.workunit.client.0.smithi070.stderr: -58> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding con mode: secure 2024-09-12T00:58:18.894 INFO:tasks.workunit.client.0.smithi070.stderr: -57> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding con mode: crc 2024-09-12T00:58:18.894 INFO:tasks.workunit.client.0.smithi070.stderr: -56> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding con mode: secure 2024-09-12T00:58:18.894 INFO:tasks.workunit.client.0.smithi070.stderr: -55> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding con mode: crc 2024-09-12T00:58:18.894 INFO:tasks.workunit.client.0.smithi070.stderr: -54> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding con mode: crc 2024-09-12T00:58:18.894 INFO:tasks.workunit.client.0.smithi070.stderr: -53> 2024-09-12T00:58:18.746+0000 7f2b0afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:18.894 INFO:tasks.workunit.client.0.smithi070.stderr: -52> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding con mode: secure 2024-09-12T00:58:18.894 INFO:tasks.workunit.client.0.smithi070.stderr: -51> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding con mode: crc 2024-09-12T00:58:18.894 INFO:tasks.workunit.client.0.smithi070.stderr: -50> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding con mode: secure 2024-09-12T00:58:18.894 INFO:tasks.workunit.client.0.smithi070.stderr: -49> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding con mode: crc 2024-09-12T00:58:18.895 INFO:tasks.workunit.client.0.smithi070.stderr: -48> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 AuthRegistry(0x7ffd759b8990) adding con mode: secure 2024-09-12T00:58:18.895 INFO:tasks.workunit.client.0.smithi070.stderr: -47> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:18.895 INFO:tasks.workunit.client.0.smithi070.stderr: -46> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:18.895 INFO:tasks.workunit.client.0.smithi070.stderr: -45> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:18.895 INFO:tasks.workunit.client.0.smithi070.stderr: -44> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command cache list hook 0x5604dcf31000 2024-09-12T00:58:18.895 INFO:tasks.workunit.client.0.smithi070.stderr: -43> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command cache inspect hook 0x5604dcf31000 2024-09-12T00:58:18.895 INFO:tasks.workunit.client.0.smithi070.stderr: -42> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command cache erase hook 0x5604dcf31000 2024-09-12T00:58:18.895 INFO:tasks.workunit.client.0.smithi070.stderr: -41> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command cache zap hook 0x5604dcf31000 2024-09-12T00:58:18.895 INFO:tasks.workunit.client.0.smithi070.stderr: -40> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 note: GC not initialized 2024-09-12T00:58:18.895 INFO:tasks.workunit.client.0.smithi070.stderr: -39> 2024-09-12T00:58:18.746+0000 7f2b09fdb640 20 reqs_thread_entry: start 2024-09-12T00:58:18.895 INFO:tasks.workunit.client.0.smithi070.stderr: -38> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command sync trace show hook 0x7f2c480d7020 2024-09-12T00:58:18.895 INFO:tasks.workunit.client.0.smithi070.stderr: -37> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command sync trace history hook 0x7f2c480d7020 2024-09-12T00:58:18.895 INFO:tasks.workunit.client.0.smithi070.stderr: -36> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command sync trace active hook 0x7f2c480d7020 2024-09-12T00:58:18.895 INFO:tasks.workunit.client.0.smithi070.stderr: -35> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 5 asok(0x5604dcc632b0) register_command sync trace active_short hook 0x7f2c480d7020 2024-09-12T00:58:18.896 INFO:tasks.workunit.client.0.smithi070.stderr: -34> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 20 init_complete bucket index max shards: 1 2024-09-12T00:58:18.896 INFO:tasks.workunit.client.0.smithi070.stderr: -33> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 20 Filter name: none 2024-09-12T00:58:18.896 INFO:tasks.workunit.client.0.smithi070.stderr: -32> 2024-09-12T00:58:18.746+0000 7f2a7b7fe640 20 reqs_thread_entry: start 2024-09-12T00:58:18.896 INFO:tasks.workunit.client.0.smithi070.stderr: -31> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:58:18.896 INFO:tasks.workunit.client.0.smithi070.stderr: -30> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.896 INFO:tasks.workunit.client.0.smithi070.stderr: -29> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:58:18.896 INFO:tasks.workunit.client.0.smithi070.stderr: -28> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:58:18.896 INFO:tasks.workunit.client.0.smithi070.stderr: -27> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:58:18.896 INFO:tasks.workunit.client.0.smithi070.stderr: -26> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 : miss 2024-09-12T00:58:18.896 INFO:tasks.workunit.client.0.smithi070.stderr: -25> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.896 INFO:tasks.workunit.client.0.smithi070.stderr: -24> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:58:18.896 INFO:tasks.workunit.client.0.smithi070.stderr: -23> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 info.flags=0x17 2024-09-12T00:58:18.897 INFO:tasks.workunit.client.0.smithi070.stderr: -22> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 to cache LRU end 2024-09-12T00:58:18.897 INFO:tasks.workunit.client.0.smithi070.stderr: -21> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:58:18.897 INFO:tasks.workunit.client.0.smithi070.stderr: -20> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:18.897 INFO:tasks.workunit.client.0.smithi070.stderr: -19> 2024-09-12T00:58:18.746+0000 7f2c56b829c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 2024-09-12T00:58:18.897 INFO:tasks.workunit.client.0.smithi070.stderr: -18> 2024-09-12T00:58:18.754+0000 7f2c56b829c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 info.flags=0x17 2024-09-12T00:58:18.897 INFO:tasks.workunit.client.0.smithi070.stderr: -17> 2024-09-12T00:58:18.754+0000 7f2c56b829c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 to cache LRU end 2024-09-12T00:58:18.897 INFO:tasks.workunit.client.0.smithi070.stderr: -16> 2024-09-12T00:58:18.754+0000 7f2c56b829c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:18.897 INFO:tasks.workunit.client.0.smithi070.stderr: -15> 2024-09-12T00:58:18.754+0000 7f2c56b829c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40, ofs0, ns] 2024-09-12T00:58:18.897 INFO:tasks.workunit.client.0.smithi070.stderr: -14> 2024-09-12T00:58:18.754+0000 7f2b2b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431570 cookie 94578887030208 notifier 8058 bl.length()=1015 2024-09-12T00:58:18.897 INFO:tasks.workunit.client.0.smithi070.stderr: -13> 2024-09-12T00:58:18.754+0000 7f2b2b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 info.flags=0x17 2024-09-12T00:58:18.897 INFO:tasks.workunit.client.0.smithi070.stderr: -12> 2024-09-12T00:58:18.754+0000 7f2b2b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 to cache LRU end 2024-09-12T00:58:18.898 INFO:tasks.workunit.client.0.smithi070.stderr: -11> 2024-09-12T00:58:18.754+0000 7f2b2b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:18.898 INFO:tasks.workunit.client.0.smithi070.stderr: -10> 2024-09-12T00:58:18.758+0000 7f2c56b829c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40]): orig_sources= new_sources= 2024-09-12T00:58:18.898 INFO:tasks.workunit.client.0.smithi070.stderr: -9> 2024-09-12T00:58:18.758+0000 7f2c56b829c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40]): potential sources added=[] removed=[] 2024-09-12T00:58:18.898 INFO:tasks.workunit.client.0.smithi070.stderr: -8> 2024-09-12T00:58:18.758+0000 7f2c56b829c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40]): orig_dests= new_dests= 2024-09-12T00:58:18.898 INFO:tasks.workunit.client.0.smithi070.stderr: -7> 2024-09-12T00:58:18.758+0000 7f2c56b829c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40]): potential dests added=[] removed=[] 2024-09-12T00:58:18.898 INFO:tasks.workunit.client.0.smithi070.stderr: -6> 2024-09-12T00:58:18.758+0000 7f2c56b829c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40.1.0 2024-09-12T00:58:18.898 INFO:tasks.workunit.client.0.smithi070.stderr: -5> 2024-09-12T00:58:18.758+0000 7f2c56b829c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40.1.0 2024-09-12T00:58:18.898 INFO:tasks.workunit.client.0.smithi070.stderr: -4> 2024-09-12T00:58:18.758+0000 7f2c56b829c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40.1.1 2024-09-12T00:58:18.899 INFO:tasks.workunit.client.0.smithi070.stderr: -3> 2024-09-12T00:58:18.758+0000 7f2c56b829c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40.1.1 2024-09-12T00:58:18.899 INFO:tasks.workunit.client.0.smithi070.stderr: -2> 2024-09-12T00:58:18.758+0000 7f2c56b829c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40.0 2024-09-12T00:58:18.899 INFO:tasks.workunit.client.0.smithi070.stderr: -1> 2024-09-12T00:58:18.762+0000 7f2c56b829c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2c56b829c0 time 2024-09-12T00:58:18.764947+0000 2024-09-12T00:58:18.899 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:58:18.899 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.899 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:58:18.899 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2c5a45c2eb] 2024-09-12T00:58:18.899 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2c5a45c49f] 2024-09-12T00:58:18.899 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604da38dcc1] 2024-09-12T00:58:18.899 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x5604da3a201c] 2024-09-12T00:58:18.899 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5604da3a36a4] 2024-09-12T00:58:18.899 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:58:18.899 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2c592c2d90] 2024-09-12T00:58:18.900 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:58:18.900 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:58:18.900 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.900 INFO:tasks.workunit.client.0.smithi070.stderr: 0> 2024-09-12T00:58:18.766+0000 7f2c56b829c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:58:18.900 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f2c56b829c0 thread_name:radosgw-admin 2024-09-12T00:58:18.900 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.900 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:58:18.900 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2c592db520] 2024-09-12T00:58:18.900 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:58:18.900 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:58:18.900 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:58:18.900 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2c5a45c345] 2024-09-12T00:58:18.900 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2c5a45c49f] 2024-09-12T00:58:18.901 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604da38dcc1] 2024-09-12T00:58:18.901 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x5604da3a201c] 2024-09-12T00:58:18.901 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5604da3a36a4] 2024-09-12T00:58:18.901 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:58:18.901 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2c592c2d90] 2024-09-12T00:58:18.901 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:58:18.901 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:58:18.901 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:58:18.901 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.901 INFO:tasks.workunit.client.0.smithi070.stderr:--- logging levels --- 2024-09-12T00:58:18.901 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 none 2024-09-12T00:58:18.901 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 lockdep 2024-09-12T00:58:18.901 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 context 2024-09-12T00:58:18.902 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 crush 2024-09-12T00:58:18.902 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds 2024-09-12T00:58:18.902 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_balancer 2024-09-12T00:58:18.902 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_locker 2024-09-12T00:58:18.902 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log 2024-09-12T00:58:18.902 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log_expire 2024-09-12T00:58:18.902 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_migrator 2024-09-12T00:58:18.902 INFO:tasks.workunit.client.0.smithi070.stderr: 3/ 5 mds_quiesce 2024-09-12T00:58:18.902 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 buffer 2024-09-12T00:58:18.902 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 timer 2024-09-12T00:58:18.902 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 filer 2024-09-12T00:58:18.902 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 striper 2024-09-12T00:58:18.902 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 objecter 2024-09-12T00:58:18.903 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rados 2024-09-12T00:58:18.903 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd 2024-09-12T00:58:18.903 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_mirror 2024-09-12T00:58:18.903 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_replay 2024-09-12T00:58:18.903 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_pwl 2024-09-12T00:58:18.903 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 journaler 2024-09-12T00:58:18.903 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objectcacher 2024-09-12T00:58:18.903 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:58:18.903 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 client 2024-09-12T00:58:18.903 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 osd 2024-09-12T00:58:18.903 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 optracker 2024-09-12T00:58:18.903 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objclass 2024-09-12T00:58:18.903 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 filestore 2024-09-12T00:58:18.903 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 journal 2024-09-12T00:58:18.904 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 ms 2024-09-12T00:58:18.904 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mon 2024-09-12T00:58:18.904 INFO:tasks.workunit.client.0.smithi070.stderr: 0/10 monc 2024-09-12T00:58:18.904 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 paxos 2024-09-12T00:58:18.904 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 tp 2024-09-12T00:58:18.904 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 auth 2024-09-12T00:58:18.904 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 crypto 2024-09-12T00:58:18.904 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 finisher 2024-09-12T00:58:18.904 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 reserver 2024-09-12T00:58:18.904 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 heartbeatmap 2024-09-12T00:58:18.904 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 perfcounter 2024-09-12T00:58:18.904 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw 2024-09-12T00:58:18.905 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_sync 2024-09-12T00:58:18.905 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_datacache 2024-09-12T00:58:18.905 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_access 2024-09-12T00:58:18.905 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:58:18.905 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_flight 2024-09-12T00:58:18.905 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:58:18.905 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw_notification 2024-09-12T00:58:18.905 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 javaclient 2024-09-12T00:58:18.905 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 asok 2024-09-12T00:58:18.905 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 throttle 2024-09-12T00:58:18.905 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 refs 2024-09-12T00:58:18.905 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 compressor 2024-09-12T00:58:18.906 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluestore 2024-09-12T00:58:18.906 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluefs 2024-09-12T00:58:18.906 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 bdev 2024-09-12T00:58:18.906 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 kstore 2024-09-12T00:58:18.906 INFO:tasks.workunit.client.0.smithi070.stderr: 4/ 5 rocksdb 2024-09-12T00:58:18.906 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 fuse 2024-09-12T00:58:18.906 INFO:tasks.workunit.client.0.smithi070.stderr: 2/ 5 mgr 2024-09-12T00:58:18.906 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mgrc 2024-09-12T00:58:18.906 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 dpdk 2024-09-12T00:58:18.906 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 eventtrace 2024-09-12T00:58:18.906 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 prioritycache 2024-09-12T00:58:18.906 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 test 2024-09-12T00:58:18.906 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:58:18.906 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephsqlite 2024-09-12T00:58:18.907 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:58:18.907 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore 2024-09-12T00:58:18.907 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_onode 2024-09-12T00:58:18.907 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_odata 2024-09-12T00:58:18.907 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_omap 2024-09-12T00:58:18.907 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_tm 2024-09-12T00:58:18.907 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_t 2024-09-12T00:58:18.907 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:58:18.907 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_epm 2024-09-12T00:58:18.907 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_lba 2024-09-12T00:58:18.907 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:58:18.907 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cache 2024-09-12T00:58:18.908 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_journal 2024-09-12T00:58:18.908 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_device 2024-09-12T00:58:18.908 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_backref 2024-09-12T00:58:18.908 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 alienstore 2024-09-12T00:58:18.908 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mclock 2024-09-12T00:58:18.908 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cyanstore 2024-09-12T00:58:18.908 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 ceph_exporter 2024-09-12T00:58:18.908 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 memstore 2024-09-12T00:58:18.908 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 trace 2024-09-12T00:58:18.908 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 ceph_dedup 2024-09-12T00:58:18.908 INFO:tasks.workunit.client.0.smithi070.stderr: -2/-2 (syslog threshold) 2024-09-12T00:58:18.908 INFO:tasks.workunit.client.0.smithi070.stderr: 99/99 (stderr threshold) 2024-09-12T00:58:18.908 INFO:tasks.workunit.client.0.smithi070.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:58:18.909 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2a7b7fe640 / http_manager 2024-09-12T00:58:18.909 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2b09fdb640 / http_manager 2024-09-12T00:58:18.909 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2b0afdd640 / rgw_dt_lg_renew 2024-09-12T00:58:18.909 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2b29ffb640 / ms_dispatch 2024-09-12T00:58:18.909 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2b2b7fe640 / io_context_pool 2024-09-12T00:58:18.909 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2b39ffb640 / ms_dispatch 2024-09-12T00:58:18.909 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2b40e09640 / ms_dispatch 2024-09-12T00:58:18.909 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2b4260c640 / io_context_pool 2024-09-12T00:58:18.909 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2c53686640 / io_context_pool 2024-09-12T00:58:18.909 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2c53e87640 / msgr-worker-2 2024-09-12T00:58:18.909 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2c54688640 / msgr-worker-1 2024-09-12T00:58:18.909 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2c54e89640 / msgr-worker-0 2024-09-12T00:58:18.909 INFO:tasks.workunit.client.0.smithi070.stderr: 7f2c56b829c0 / radosgw-admin 2024-09-12T00:58:18.910 INFO:tasks.workunit.client.0.smithi070.stderr: max_recent 500 2024-09-12T00:58:18.910 INFO:tasks.workunit.client.0.smithi070.stderr: max_new 1000 2024-09-12T00:58:18.910 INFO:tasks.workunit.client.0.smithi070.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:58:18.767302Z_fb002a98-4723-4815-b195-a0ca332e6ffe/log 2024-09-12T00:58:18.910 INFO:tasks.workunit.client.0.smithi070.stderr:--- end dump of recent events --- 2024-09-12T00:58:18.910 INFO:tasks.workunit.client.0.smithi070.stderr:Aborted 2024-09-12T00:58:18.910 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:58:18.916 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:18.916 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:18.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.842+0000 7facb31339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.846+0000 7facb31339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.846+0000 7facb31339c0 20 realm 2024-09-12T00:58:18.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.846+0000 7facb31339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.846+0000 7facb31339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.846+0000 7facb31339c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:18.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.846+0000 7facb31339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.846+0000 7facb31339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.846+0000 7facb31339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.846+0000 7facb31339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:18.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.846+0000 7facb31339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.846+0000 7facb31339c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:18.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.846+0000 7facb31339c0 20 searching for the correct realm 2024-09-12T00:58:18.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.850+0000 7facb143a640 0 -- 172.21.15.70:0/3454181990 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7faca40c0070 msgr2=0x7faca40f6dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:18.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.858+0000 7facb143a640 0 -- 172.21.15.70:0/3454181990 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fab7c080a80 msgr2=0x7fab7c082ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:18.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.866+0000 7facb31339c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:18.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.866+0000 7facb31339c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:58:18.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.866+0000 7facb31339c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:18.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.866+0000 7facb31339c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:58:18.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.866+0000 7facb31339c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:18.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.866+0000 7facb31339c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:18.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.866+0000 7facb31339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.866+0000 7facb31339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.866+0000 7facb31339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.866+0000 7facb31339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:18.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.866+0000 7facb31339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.866+0000 7facb31339c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:18.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.866+0000 7facb31339c0 20 zone default found 2024-09-12T00:58:18.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.866+0000 7facb31339c0 4 Realm: () 2024-09-12T00:58:18.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.866+0000 7facb31339c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:58:18.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.866+0000 7facb31339c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:58:18.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.866+0000 7facb31339c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:18.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.866+0000 7facb31339c0 20 zonegroup default 2024-09-12T00:58:18.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.866+0000 7facb31339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.866+0000 7facb31339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.866+0000 7facb31339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.866+0000 7facb31339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.866+0000 7facb31339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.870+0000 7facb31339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.870+0000 7facb31339c0 20 started sync module instance, tier type = 2024-09-12T00:58:18.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.870+0000 7facb31339c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:58:18.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.882+0000 7facb31339c0 20 add_watcher() i=0 2024-09-12T00:58:18.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.882+0000 7facb31339c0 20 add_watcher() i=1 2024-09-12T00:58:18.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.882+0000 7facb31339c0 20 add_watcher() i=2 2024-09-12T00:58:18.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.882+0000 7facb31339c0 20 add_watcher() i=3 2024-09-12T00:58:18.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.882+0000 7facb31339c0 20 add_watcher() i=4 2024-09-12T00:58:18.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.882+0000 7facb31339c0 20 add_watcher() i=5 2024-09-12T00:58:18.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.882+0000 7facb31339c0 20 add_watcher() i=6 2024-09-12T00:58:18.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.886+0000 7facb31339c0 20 add_watcher() i=7 2024-09-12T00:58:18.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.886+0000 7facb31339c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:18.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.886+0000 7fab66fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:18.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.886+0000 7facb31339c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:18.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.886+0000 7facb31339c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:18.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.886+0000 7facb31339c0 5 note: GC not initialized 2024-09-12T00:58:18.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.886+0000 7fab65fe3640 20 reqs_thread_entry: start 2024-09-12T00:58:18.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.886+0000 7facb31339c0 20 init_complete bucket index max shards: 1 2024-09-12T00:58:18.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.886+0000 7facb31339c0 20 Filter name: none 2024-09-12T00:58:18.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.886+0000 7faad77fe640 20 reqs_thread_entry: start 2024-09-12T00:58:18.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.886+0000 7facb31339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.890+0000 7facb31339c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:58:18.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.890+0000 7facb31339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.890+0000 7facb31339c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:58:18.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.890+0000 7facb31339c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:58:18.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.890+0000 7facb31339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.890+0000 7facb31339c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:58:18.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.890+0000 7facb31339c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.890+0000 7facb31339c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:58:18.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.890+0000 7facb31339c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:58:18.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.890+0000 7fab66fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:18.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.894+0000 7facb31339c0 20 remove_watcher() i=0 2024-09-12T00:58:18.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.894+0000 7facb31339c0 2 removed watcher, disabling cache 2024-09-12T00:58:18.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.898+0000 7facb31339c0 20 remove_watcher() i=1 2024-09-12T00:58:18.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.898+0000 7facb31339c0 20 remove_watcher() i=2 2024-09-12T00:58:18.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.902+0000 7facb31339c0 20 remove_watcher() i=3 2024-09-12T00:58:18.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.902+0000 7facb31339c0 20 remove_watcher() i=4 2024-09-12T00:58:18.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.906+0000 7facb31339c0 20 remove_watcher() i=5 2024-09-12T00:58:18.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.906+0000 7facb31339c0 20 remove_watcher() i=6 2024-09-12T00:58:18.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:18.906+0000 7facb31339c0 20 remove_watcher() i=7 2024-09-12T00:58:18.923 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.923 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:58:18.923 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: abort-at-change-reshard-state id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:58:18.923 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:18.923 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:18.923 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:18.924 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:18.924 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:18.964 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:58:18.994 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:18.994 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:19.039 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.050+0000 7efc581cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:19.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.050+0000 7efc581cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:19.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.050+0000 7efc581cd9c0 20 realm 2024-09-12T00:58:19.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.050+0000 7efc581cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:19.041 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.050+0000 7efc581cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:19.041 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.050+0000 7efc581cd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:19.041 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.050+0000 7efc581cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:19.041 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.050+0000 7efc581cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:19.041 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.050+0000 7efc581cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:19.042 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.054+0000 7efc581cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:19.043 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.054+0000 7efc581cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:19.043 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.054+0000 7efc581cd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:19.043 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.054+0000 7efc581cd9c0 20 searching for the correct realm 2024-09-12T00:58:19.044 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.054+0000 7efc55cd3640 0 -- 172.21.15.70:0/2007559744 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7efc50021040 msgr2=0x7efc50016970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:19.257 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.266+0000 7efc55cd3640 0 -- 172.21.15.70:0/2007559744 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7efc50015070 msgr2=0x7efc50032420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:19.480 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.490+0000 7efc581cd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:19.481 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.490+0000 7efc581cd9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:58:19.481 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.490+0000 7efc581cd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:19.481 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.490+0000 7efc581cd9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:58:19.481 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.490+0000 7efc581cd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:19.481 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.490+0000 7efc581cd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:19.481 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.490+0000 7efc581cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:19.481 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.490+0000 7efc581cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:19.481 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.490+0000 7efc581cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:19.482 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.490+0000 7efc581cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:19.482 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.490+0000 7efc581cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:19.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.494+0000 7efc581cd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:19.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.494+0000 7efc581cd9c0 20 zone default found 2024-09-12T00:58:19.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.494+0000 7efc581cd9c0 4 Realm: () 2024-09-12T00:58:19.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.494+0000 7efc581cd9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:58:19.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.494+0000 7efc581cd9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:58:19.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.494+0000 7efc581cd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:19.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.494+0000 7efc581cd9c0 20 zonegroup default 2024-09-12T00:58:19.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.494+0000 7efc581cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:19.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.494+0000 7efc581cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:19.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.494+0000 7efc581cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:19.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.494+0000 7efc581cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:19.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.494+0000 7efc581cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:19.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.494+0000 7efc581cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:19.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.494+0000 7efc581cd9c0 20 started sync module instance, tier type = 2024-09-12T00:58:19.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.494+0000 7efc581cd9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:58:19.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.518+0000 7efc581cd9c0 20 add_watcher() i=0 2024-09-12T00:58:19.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.518+0000 7efc581cd9c0 20 add_watcher() i=1 2024-09-12T00:58:19.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.518+0000 7efc581cd9c0 20 add_watcher() i=2 2024-09-12T00:58:19.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.518+0000 7efc581cd9c0 20 add_watcher() i=3 2024-09-12T00:58:19.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.518+0000 7efc581cd9c0 20 add_watcher() i=4 2024-09-12T00:58:19.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.518+0000 7efc581cd9c0 20 add_watcher() i=5 2024-09-12T00:58:19.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.518+0000 7efc581cd9c0 20 add_watcher() i=6 2024-09-12T00:58:19.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.522+0000 7efc581cd9c0 20 add_watcher() i=7 2024-09-12T00:58:19.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.522+0000 7efc581cd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:19.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.526+0000 7efb077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:19.516 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.526+0000 7efc581cd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:19.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.526+0000 7efc581cd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:19.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.526+0000 7efc581cd9c0 5 note: GC not initialized 2024-09-12T00:58:19.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.526+0000 7efb067fc640 20 reqs_thread_entry: start 2024-09-12T00:58:19.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.526+0000 7efc581cd9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:58:19.518 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.526+0000 7efc581cd9c0 20 Filter name: none 2024-09-12T00:58:19.518 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.526+0000 7efa77fff640 20 reqs_thread_entry: start 2024-09-12T00:58:19.518 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.526+0000 7efc581cd9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:58:19.518 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.526+0000 7efc581cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:19.519 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.530+0000 7efc581cd9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:58:19.519 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.530+0000 7efc581cd9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:58:19.519 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.530+0000 7efc581cd9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:58:19.519 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.530+0000 7efc581cd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 : miss 2024-09-12T00:58:19.519 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.530+0000 7efc581cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:19.520 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.530+0000 7efc581cd9c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:58:19.520 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.530+0000 7efc581cd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 info.flags=0x17 2024-09-12T00:58:19.520 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.530+0000 7efc581cd9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 to cache LRU end 2024-09-12T00:58:19.520 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.530+0000 7efc581cd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:58:19.520 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.530+0000 7efc581cd9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:19.520 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.530+0000 7efc581cd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 2024-09-12T00:58:19.522 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.530+0000 7efc581cd9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 to be held by another RGW process; skipping for now 2024-09-12T00:58:19.523 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.534+0000 7efb077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:19.529 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.538+0000 7efc581cd9c0 20 remove_watcher() i=0 2024-09-12T00:58:19.529 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.538+0000 7efc581cd9c0 2 removed watcher, disabling cache 2024-09-12T00:58:19.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.542+0000 7efc581cd9c0 20 remove_watcher() i=1 2024-09-12T00:58:19.533 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.542+0000 7efc581cd9c0 20 remove_watcher() i=2 2024-09-12T00:58:19.535 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.546+0000 7efc581cd9c0 20 remove_watcher() i=3 2024-09-12T00:58:19.537 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.546+0000 7efc581cd9c0 20 remove_watcher() i=4 2024-09-12T00:58:19.539 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.550+0000 7efc581cd9c0 20 remove_watcher() i=5 2024-09-12T00:58:19.540 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.550+0000 7efc581cd9c0 20 remove_watcher() i=6 2024-09-12T00:58:19.542 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:19.550+0000 7efc581cd9c0 20 remove_watcher() i=7 2024-09-12T00:58:19.556 INFO:tasks.workunit.client.0.smithi070.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:58:49.576 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:58:49.612 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:49.612 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:49.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.665+0000 7fe8ae3369c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.669+0000 7fe8ae3369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:49.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.669+0000 7fe8ae3369c0 20 realm 2024-09-12T00:58:49.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.669+0000 7fe8ae3369c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.669+0000 7fe8ae3369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:49.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.669+0000 7fe8ae3369c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:49.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.669+0000 7fe8ae3369c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.669+0000 7fe8ae3369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:49.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.669+0000 7fe8ae3369c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.661 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.669+0000 7fe8ae3369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:49.661 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.669+0000 7fe8ae3369c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.661 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.669+0000 7fe8ae3369c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:49.661 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.669+0000 7fe8ae3369c0 20 searching for the correct realm 2024-09-12T00:58:49.666 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.677+0000 7fe8ac63d640 0 -- 172.21.15.70:0/4146722706 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fe8a001a040 msgr2=0x7fe8a0026410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:49.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.685+0000 7fe8ac63d640 0 -- 172.21.15.70:0/4146722706 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fe774080800 msgr2=0x7fe774082c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:49.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.689+0000 7fe8ae3369c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:49.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.689+0000 7fe8ae3369c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:58:49.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.689+0000 7fe8ae3369c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:49.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.689+0000 7fe8ae3369c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:58:49.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.689+0000 7fe8ae3369c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:49.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.689+0000 7fe8ae3369c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:49.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.689+0000 7fe8ae3369c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.689+0000 7fe8ae3369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:49.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.689+0000 7fe8ae3369c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.684 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.689+0000 7fe8ae3369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:49.684 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.689+0000 7fe8ae3369c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.684 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.693+0000 7fe8ae3369c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:49.685 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.693+0000 7fe8ae3369c0 20 zone default found 2024-09-12T00:58:49.685 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.693+0000 7fe8ae3369c0 4 Realm: () 2024-09-12T00:58:49.685 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.693+0000 7fe8ae3369c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:58:49.685 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.693+0000 7fe8ae3369c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:58:49.685 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.693+0000 7fe8ae3369c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:49.685 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.693+0000 7fe8ae3369c0 20 zonegroup default 2024-09-12T00:58:49.685 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.693+0000 7fe8ae3369c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.685 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.693+0000 7fe8ae3369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:49.685 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.693+0000 7fe8ae3369c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.685 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.693+0000 7fe8ae3369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:49.685 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.693+0000 7fe8ae3369c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.685 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.693+0000 7fe8ae3369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:49.686 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.693+0000 7fe8ae3369c0 20 started sync module instance, tier type = 2024-09-12T00:58:49.686 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.693+0000 7fe8ae3369c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:58:49.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.709+0000 7fe8ae3369c0 20 add_watcher() i=0 2024-09-12T00:58:49.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.709+0000 7fe8ae3369c0 20 add_watcher() i=1 2024-09-12T00:58:49.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.709+0000 7fe8ae3369c0 20 add_watcher() i=2 2024-09-12T00:58:49.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.709+0000 7fe8ae3369c0 20 add_watcher() i=3 2024-09-12T00:58:49.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.709+0000 7fe8ae3369c0 20 add_watcher() i=4 2024-09-12T00:58:49.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.709+0000 7fe8ae3369c0 20 add_watcher() i=5 2024-09-12T00:58:49.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.709+0000 7fe8ae3369c0 20 add_watcher() i=6 2024-09-12T00:58:49.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.709+0000 7fe8ae3369c0 20 add_watcher() i=7 2024-09-12T00:58:49.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.709+0000 7fe8ae3369c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:49.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.713+0000 7fe7627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:49.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.713+0000 7fe8ae3369c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:49.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.713+0000 7fe8ae3369c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:49.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.713+0000 7fe8ae3369c0 5 note: GC not initialized 2024-09-12T00:58:49.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.713+0000 7fe7617e2640 20 reqs_thread_entry: start 2024-09-12T00:58:49.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.713+0000 7fe8ae3369c0 20 init_complete bucket index max shards: 1 2024-09-12T00:58:49.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.713+0000 7fe8ae3369c0 20 Filter name: none 2024-09-12T00:58:49.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.713+0000 7fe75a7fc640 20 reqs_thread_entry: start 2024-09-12T00:58:49.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.713+0000 7fe8ae3369c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:58:49.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.713+0000 7fe8ae3369c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.713+0000 7fe8ae3369c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:58:49.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.713+0000 7fe8ae3369c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:58:49.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.713+0000 7fe8ae3369c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:58:49.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.713+0000 7fe8ae3369c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 : miss 2024-09-12T00:58:49.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.713+0000 7fe8ae3369c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.713+0000 7fe8ae3369c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:58:49.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.713+0000 7fe8ae3369c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 info.flags=0x17 2024-09-12T00:58:49.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.713+0000 7fe8ae3369c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 to cache LRU end 2024-09-12T00:58:49.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.713+0000 7fe8ae3369c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:58:49.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.713+0000 7fe8ae3369c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:49.707 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.713+0000 7fe8ae3369c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 2024-09-12T00:58:49.708 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.717+0000 7fe8ae3369c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:58:49.715 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.725+0000 7fe8ae3369c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 info.flags=0x17 2024-09-12T00:58:49.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.725+0000 7fe8ae3369c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 to cache LRU end 2024-09-12T00:58:49.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.725+0000 7fe8ae3369c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:49.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.725+0000 7fe8ae3369c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40, ofs0, ns] 2024-09-12T00:58:49.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.725+0000 7fe78affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431571 cookie 94906313569312 notifier 8115 bl.length()=1015 2024-09-12T00:58:49.716 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.725+0000 7fe78affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 info.flags=0x17 2024-09-12T00:58:49.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.725+0000 7fe78affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 to cache LRU end 2024-09-12T00:58:49.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.725+0000 7fe78affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:49.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.725+0000 7fe8ae3369c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40]): orig_sources= new_sources= 2024-09-12T00:58:49.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.725+0000 7fe8ae3369c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40]): potential sources added=[] removed=[] 2024-09-12T00:58:49.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.725+0000 7fe8ae3369c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40]): orig_dests= new_dests= 2024-09-12T00:58:49.717 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.725+0000 7fe8ae3369c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40]): potential dests added=[] removed=[] 2024-09-12T00:58:49.720 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.729+0000 7fe8ae3369c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40.2.0 2024-09-12T00:58:49.720 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.729+0000 7fe8ae3369c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40.2.0 2024-09-12T00:58:49.720 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.729+0000 7fe8ae3369c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40.2.1 2024-09-12T00:58:49.720 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.729+0000 7fe8ae3369c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40.2.1 2024-09-12T00:58:49.720 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.729+0000 7fe8ae3369c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40.0 2024-09-12T00:58:49.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.733+0000 7fe8ae3369c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 : hit (requested=0x17, cached=0x17) 2024-09-12T00:58:49.725 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.733+0000 7fe8ae3369c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 2024-09-12T00:58:49.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.737+0000 7fe8ae3369c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 info.flags=0x17 2024-09-12T00:58:49.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.737+0000 7fe8ae3369c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 to cache LRU end 2024-09-12T00:58:49.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.737+0000 7fe8ae3369c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:49.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.737+0000 7fe8ae3369c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40, ofs0, ns] 2024-09-12T00:58:49.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.737+0000 7fe78a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431572 cookie 94906313569312 notifier 8115 bl.length()=1015 2024-09-12T00:58:49.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.737+0000 7fe78a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 info.flags=0x17 2024-09-12T00:58:49.728 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.737+0000 7fe78a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 to cache LRU end 2024-09-12T00:58:49.728 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.737+0000 7fe78a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:49.728 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.737+0000 7fe8ae3369c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40]): orig_sources= new_sources= 2024-09-12T00:58:49.728 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.737+0000 7fe8ae3369c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40]): potential sources added=[] removed=[] 2024-09-12T00:58:49.728 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.737+0000 7fe8ae3369c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40]): orig_dests= new_dests= 2024-09-12T00:58:49.728 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.737+0000 7fe8ae3369c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40]): potential dests added=[] removed=[] 2024-09-12T00:58:49.729 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.737+0000 7fe8ae3369c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40.0 2024-09-12T00:58:49.729 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.737+0000 7fe8ae3369c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 : hit (requested=0x17, cached=0x17) 2024-09-12T00:58:49.729 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.737+0000 7fe8ae3369c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 2024-09-12T00:58:49.731 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.741+0000 7fe8ae3369c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 info.flags=0x17 2024-09-12T00:58:49.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.741+0000 7fe8ae3369c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 to cache LRU end 2024-09-12T00:58:49.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.741+0000 7fe8ae3369c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:49.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.741+0000 7fe8ae3369c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40, ofs0, ns] 2024-09-12T00:58:49.732 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.741+0000 7fe78affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431573 cookie 94906313569312 notifier 8115 bl.length()=983 2024-09-12T00:58:49.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.741+0000 7fe78affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 info.flags=0x17 2024-09-12T00:58:49.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.741+0000 7fe78affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 to cache LRU end 2024-09-12T00:58:49.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.741+0000 7fe78affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:58:49.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.741+0000 7fe8ae3369c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40]): orig_sources= new_sources= 2024-09-12T00:58:49.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.741+0000 7fe8ae3369c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40]): potential sources added=[] removed=[] 2024-09-12T00:58:49.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.741+0000 7fe8ae3369c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40]): orig_dests= new_dests= 2024-09-12T00:58:49.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.741+0000 7fe8ae3369c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40]): potential dests added=[] removed=[] 2024-09-12T00:58:49.734 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.741+0000 7fe8ae3369c0 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T00:58:49.737 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.745+0000 7fe7627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:49.742 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.749+0000 7fe8ae3369c0 20 remove_watcher() i=0 2024-09-12T00:58:49.742 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.749+0000 7fe8ae3369c0 2 removed watcher, disabling cache 2024-09-12T00:58:49.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.753+0000 7fe8ae3369c0 20 remove_watcher() i=1 2024-09-12T00:58:49.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.753+0000 7fe8ae3369c0 20 remove_watcher() i=2 2024-09-12T00:58:49.748 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.757+0000 7fe8ae3369c0 20 remove_watcher() i=3 2024-09-12T00:58:49.749 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.757+0000 7fe8ae3369c0 20 remove_watcher() i=4 2024-09-12T00:58:49.751 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.761+0000 7fe8ae3369c0 20 remove_watcher() i=5 2024-09-12T00:58:49.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.761+0000 7fe8ae3369c0 20 remove_watcher() i=6 2024-09-12T00:58:49.753 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.761+0000 7fe8ae3369c0 20 remove_watcher() i=7 2024-09-12T00:58:49.768 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:58:49.797 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:49.797 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:49.839 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.849+0000 7fd47f10d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.849+0000 7fd47f10d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:49.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.849+0000 7fd47f10d9c0 20 realm 2024-09-12T00:58:49.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.849+0000 7fd47f10d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.849+0000 7fd47f10d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:49.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.849+0000 7fd47f10d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:49.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.849+0000 7fd47f10d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.849+0000 7fd47f10d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:49.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.849+0000 7fd47f10d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.842 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.853+0000 7fd47f10d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:49.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.853+0000 7fd47f10d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.843 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.853+0000 7fd47f10d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:49.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.853+0000 7fd47f10d9c0 20 searching for the correct realm 2024-09-12T00:58:49.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.857+0000 7fd47d414640 0 -- 172.21.15.70:0/282470449 >> [v2:172.21.15.70:6808/276433067,v1:172.21.15.70:6809/276433067] conn(0x558a1b814de0 msgr2=0x558a1b8172a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:49.856 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.865+0000 7fd47cc13640 0 -- 172.21.15.70:0/282470449 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7fd47408ebe0 msgr2=0x7fd47408a5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:49.862 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.869+0000 7fd47f10d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:49.863 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.869+0000 7fd47f10d9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:58:49.863 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.869+0000 7fd47f10d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:49.863 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.869+0000 7fd47f10d9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:58:49.863 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.869+0000 7fd47f10d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:49.864 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.869+0000 7fd47f10d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:49.864 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.869+0000 7fd47f10d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.864 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.873+0000 7fd47f10d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:49.864 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.873+0000 7fd47f10d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.866 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.873+0000 7fd47f10d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:49.866 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.873+0000 7fd47f10d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.866 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.873+0000 7fd47f10d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:49.867 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.873+0000 7fd47f10d9c0 20 zone default found 2024-09-12T00:58:49.867 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.873+0000 7fd47f10d9c0 4 Realm: () 2024-09-12T00:58:49.867 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.873+0000 7fd47f10d9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:58:49.867 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.873+0000 7fd47f10d9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:58:49.867 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.873+0000 7fd47f10d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:49.867 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.873+0000 7fd47f10d9c0 20 zonegroup default 2024-09-12T00:58:49.867 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.873+0000 7fd47f10d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.873+0000 7fd47f10d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:49.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.873+0000 7fd47f10d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.873+0000 7fd47f10d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:49.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.873+0000 7fd47f10d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.873+0000 7fd47f10d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:49.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.873+0000 7fd47f10d9c0 20 started sync module instance, tier type = 2024-09-12T00:58:49.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.873+0000 7fd47f10d9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:58:49.881 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.889+0000 7fd47f10d9c0 20 add_watcher() i=0 2024-09-12T00:58:49.881 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.889+0000 7fd47f10d9c0 20 add_watcher() i=1 2024-09-12T00:58:49.882 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.889+0000 7fd47f10d9c0 20 add_watcher() i=2 2024-09-12T00:58:49.882 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.889+0000 7fd47f10d9c0 20 add_watcher() i=3 2024-09-12T00:58:49.882 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.889+0000 7fd47f10d9c0 20 add_watcher() i=4 2024-09-12T00:58:49.882 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.889+0000 7fd47f10d9c0 20 add_watcher() i=5 2024-09-12T00:58:49.882 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.889+0000 7fd47f10d9c0 20 add_watcher() i=6 2024-09-12T00:58:49.883 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.889+0000 7fd47f10d9c0 20 add_watcher() i=7 2024-09-12T00:58:49.883 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.893+0000 7fd47f10d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:49.885 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.893+0000 7fd332fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:49.887 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.893+0000 7fd47f10d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:49.887 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.893+0000 7fd47f10d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:49.887 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.893+0000 7fd47f10d9c0 5 note: GC not initialized 2024-09-12T00:58:49.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.893+0000 7fd331fe3640 20 reqs_thread_entry: start 2024-09-12T00:58:49.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.893+0000 7fd47f10d9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:58:49.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.893+0000 7fd47f10d9c0 20 Filter name: none 2024-09-12T00:58:49.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.893+0000 7fd2a37fe640 20 reqs_thread_entry: start 2024-09-12T00:58:49.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.893+0000 7fd47f10d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.893+0000 7fd47f10d9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:58:49.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.893+0000 7fd47f10d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.897+0000 7fd47f10d9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:58:49.889 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.897+0000 7fd47f10d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:58:49.889 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.897+0000 7fd47f10d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.889 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.897+0000 7fd47f10d9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:58:49.889 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.897+0000 7fd47f10d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:49.890 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.897+0000 7fd47f10d9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:58:49.890 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.897+0000 7fd47f10d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:58:49.890 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.897+0000 7fd332fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:49.894 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.901+0000 7fd47f10d9c0 20 remove_watcher() i=0 2024-09-12T00:58:49.894 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.901+0000 7fd47f10d9c0 2 removed watcher, disabling cache 2024-09-12T00:58:49.896 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.905+0000 7fd47f10d9c0 20 remove_watcher() i=1 2024-09-12T00:58:49.897 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.905+0000 7fd47f10d9c0 20 remove_watcher() i=2 2024-09-12T00:58:49.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.909+0000 7fd47f10d9c0 20 remove_watcher() i=3 2024-09-12T00:58:49.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.909+0000 7fd47f10d9c0 20 remove_watcher() i=4 2024-09-12T00:58:49.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.913+0000 7fd47f10d9c0 20 remove_watcher() i=5 2024-09-12T00:58:49.904 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.913+0000 7fd47f10d9c0 20 remove_watcher() i=6 2024-09-12T00:58:49.905 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:49.913+0000 7fd47f10d9c0 20 remove_watcher() i=7 2024-09-12T00:58:49.918 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:49.918 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:58:49.918 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: abort-at-change-reshard-state id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:58:49.918 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:49.919 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:49.919 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:49.923 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:49.923 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:49.974 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:49.974 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:49.996 INFO:tasks.workunit.client.0.smithi070.stderr: test: logrecord could be stopped after reshard failed 2024-09-12T00:58:49.996 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:58:50.023 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:50.023 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:50.066 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.077+0000 7f030bb819c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.068 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.077+0000 7f030bb819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.077+0000 7f030bb819c0 20 realm 2024-09-12T00:58:50.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.077+0000 7f030bb819c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.077+0000 7f030bb819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.077+0000 7f030bb819c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:50.070 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.077+0000 7f030bb819c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.070 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.077+0000 7f030bb819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.070 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.077+0000 7f030bb819c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.070 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.081+0000 7f030bb819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:50.070 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.081+0000 7f030bb819c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.071 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.081+0000 7f030bb819c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:50.071 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.081+0000 7f030bb819c0 20 searching for the correct realm 2024-09-12T00:58:50.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.085+0000 7f0309e88640 0 -- 172.21.15.70:0/4195123178 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f02fc028020 msgr2=0x7f02fc086a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:50.293 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.301+0000 7f0309e88640 0 -- 172.21.15.70:0/4195123178 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f02fc028020 msgr2=0x7f02fc086a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:50.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.313+0000 7f030bb819c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:50.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.313+0000 7f030bb819c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:58:50.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.313+0000 7f030bb819c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:50.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.313+0000 7f030bb819c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:58:50.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.313+0000 7f030bb819c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:50.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.313+0000 7f030bb819c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:50.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.313+0000 7f030bb819c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.313+0000 7f030bb819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.313+0000 7f030bb819c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.317+0000 7f030bb819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:50.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.317+0000 7f030bb819c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.317+0000 7f030bb819c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:50.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.317+0000 7f030bb819c0 20 zone default found 2024-09-12T00:58:50.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.317+0000 7f030bb819c0 4 Realm: () 2024-09-12T00:58:50.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.317+0000 7f030bb819c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:58:50.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.317+0000 7f030bb819c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:58:50.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.317+0000 7f030bb819c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:50.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.317+0000 7f030bb819c0 20 zonegroup default 2024-09-12T00:58:50.308 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.317+0000 7f030bb819c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.308 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.317+0000 7f030bb819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.308 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.317+0000 7f030bb819c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.317+0000 7f030bb819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.317+0000 7f030bb819c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.317+0000 7f030bb819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.317+0000 7f030bb819c0 20 started sync module instance, tier type = 2024-09-12T00:58:50.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.317+0000 7f030bb819c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:58:50.334 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.341+0000 7f030bb819c0 20 add_watcher() i=0 2024-09-12T00:58:50.334 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.341+0000 7f030bb819c0 20 add_watcher() i=1 2024-09-12T00:58:50.334 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.341+0000 7f030bb819c0 20 add_watcher() i=2 2024-09-12T00:58:50.335 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.341+0000 7f030bb819c0 20 add_watcher() i=3 2024-09-12T00:58:50.335 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.341+0000 7f030bb819c0 20 add_watcher() i=4 2024-09-12T00:58:50.335 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.341+0000 7f030bb819c0 20 add_watcher() i=5 2024-09-12T00:58:50.335 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.341+0000 7f030bb819c0 20 add_watcher() i=6 2024-09-12T00:58:50.336 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.345+0000 7f030bb819c0 20 add_watcher() i=7 2024-09-12T00:58:50.336 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.345+0000 7f030bb819c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:50.341 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.349+0000 7f01bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:50.342 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.349+0000 7f030bb819c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:50.342 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.349+0000 7f030bb819c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:50.342 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.349+0000 7f030bb819c0 5 note: GC not initialized 2024-09-12T00:58:50.343 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.353+0000 7f01be7e4640 20 reqs_thread_entry: start 2024-09-12T00:58:50.343 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.353+0000 7f030bb819c0 20 init_complete bucket index max shards: 1 2024-09-12T00:58:50.343 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.353+0000 7f030bb819c0 20 Filter name: none 2024-09-12T00:58:50.343 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.353+0000 7f012ffff640 20 reqs_thread_entry: start 2024-09-12T00:58:50.343 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.353+0000 7f030bb819c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.344 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.353+0000 7f030bb819c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:58:50.344 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.353+0000 7f030bb819c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.345 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.353+0000 7f030bb819c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:58:50.346 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.353+0000 7f030bb819c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:58:50.346 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.353+0000 7f030bb819c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.347 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.357+0000 7f030bb819c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:58:50.347 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.357+0000 7f030bb819c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.357+0000 7f030bb819c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:58:50.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.357+0000 7f030bb819c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:58:50.350 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.361+0000 7f01bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:50.356 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.365+0000 7f030bb819c0 20 remove_watcher() i=0 2024-09-12T00:58:50.356 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.365+0000 7f030bb819c0 2 removed watcher, disabling cache 2024-09-12T00:58:50.360 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.369+0000 7f030bb819c0 20 remove_watcher() i=1 2024-09-12T00:58:50.362 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.373+0000 7f030bb819c0 20 remove_watcher() i=2 2024-09-12T00:58:50.365 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.373+0000 7f030bb819c0 20 remove_watcher() i=3 2024-09-12T00:58:50.367 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.377+0000 7f030bb819c0 20 remove_watcher() i=4 2024-09-12T00:58:50.368 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.377+0000 7f030bb819c0 20 remove_watcher() i=5 2024-09-12T00:58:50.370 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.377+0000 7f030bb819c0 20 remove_watcher() i=6 2024-09-12T00:58:50.371 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.381+0000 7f030bb819c0 20 remove_watcher() i=7 2024-09-12T00:58:50.387 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:50.387 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:58:50.387 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: a-bucket id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-12T00:58:50.387 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:50.387 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:58:50.417 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:50.417 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:50.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.469+0000 7f37bcf099c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.469+0000 7f37bcf099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.469+0000 7f37bcf099c0 20 realm 2024-09-12T00:58:50.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.469+0000 7f37bcf099c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.469+0000 7f37bcf099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.469+0000 7f37bcf099c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:50.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.469+0000 7f37bcf099c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.469+0000 7f37bcf099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.469+0000 7f37bcf099c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.473+0000 7f37bcf099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:50.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.473+0000 7f37bcf099c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.473+0000 7f37bcf099c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:50.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.473+0000 7f37bcf099c0 20 searching for the correct realm 2024-09-12T00:58:50.468 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.477+0000 7f37baa0f640 0 -- 172.21.15.70:0/437143525 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f37b4029040 msgr2=0x7f37b4010950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:50.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.485+0000 7f37baa0f640 0 -- 172.21.15.70:0/437143525 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f37b4049040 msgr2=0x7f37b401d940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:50.482 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.489+0000 7f37bcf099c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:50.482 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.489+0000 7f37bcf099c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:58:50.482 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.489+0000 7f37bcf099c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:50.482 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.489+0000 7f37bcf099c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:58:50.482 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.489+0000 7f37bcf099c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:50.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.489+0000 7f37bcf099c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:50.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.489+0000 7f37bcf099c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.493+0000 7f37bcf099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.493+0000 7f37bcf099c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.493+0000 7f37bcf099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:50.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.493+0000 7f37bcf099c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.493+0000 7f37bcf099c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:50.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.493+0000 7f37bcf099c0 20 zone default found 2024-09-12T00:58:50.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.493+0000 7f37bcf099c0 4 Realm: () 2024-09-12T00:58:50.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.493+0000 7f37bcf099c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:58:50.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.493+0000 7f37bcf099c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:58:50.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.493+0000 7f37bcf099c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:50.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.493+0000 7f37bcf099c0 20 zonegroup default 2024-09-12T00:58:50.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.493+0000 7f37bcf099c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.493+0000 7f37bcf099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.493+0000 7f37bcf099c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.493+0000 7f37bcf099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.493+0000 7f37bcf099c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.493+0000 7f37bcf099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.493+0000 7f37bcf099c0 20 started sync module instance, tier type = 2024-09-12T00:58:50.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.493+0000 7f37bcf099c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:58:50.501 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.509+0000 7f37bcf099c0 20 add_watcher() i=0 2024-09-12T00:58:50.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.509+0000 7f37bcf099c0 20 add_watcher() i=1 2024-09-12T00:58:50.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.509+0000 7f37bcf099c0 20 add_watcher() i=2 2024-09-12T00:58:50.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.509+0000 7f37bcf099c0 20 add_watcher() i=3 2024-09-12T00:58:50.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.509+0000 7f37bcf099c0 20 add_watcher() i=4 2024-09-12T00:58:50.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.509+0000 7f37bcf099c0 20 add_watcher() i=5 2024-09-12T00:58:50.503 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.513+0000 7f37bcf099c0 20 add_watcher() i=6 2024-09-12T00:58:50.503 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.513+0000 7f37bcf099c0 20 add_watcher() i=7 2024-09-12T00:58:50.503 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.513+0000 7f37bcf099c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:50.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.513+0000 7f36717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:50.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.513+0000 7f37bcf099c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:50.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.513+0000 7f37bcf099c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:50.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.513+0000 7f37bcf099c0 5 note: GC not initialized 2024-09-12T00:58:50.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.513+0000 7f35ebfff640 20 reqs_thread_entry: start 2024-09-12T00:58:50.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.513+0000 7f37bcf099c0 20 init_complete bucket index max shards: 1 2024-09-12T00:58:50.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.513+0000 7f37bcf099c0 20 Filter name: none 2024-09-12T00:58:50.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.517+0000 7f35e9ffb640 20 reqs_thread_entry: start 2024-09-12T00:58:50.507 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.517+0000 7f37bcf099c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.507 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.517+0000 7f37bcf099c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:58:50.507 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.517+0000 7f37bcf099c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.517+0000 7f37bcf099c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:58:50.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.517+0000 7f37bcf099c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:58:50.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.517+0000 7f37bcf099c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.517+0000 7f37bcf099c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:58:50.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.517+0000 7f37bcf099c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.517+0000 7f37bcf099c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:58:50.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.517+0000 7f37bcf099c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:58:50.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.521+0000 7f36717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:50.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.525+0000 7f37bcf099c0 20 remove_watcher() i=0 2024-09-12T00:58:50.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.525+0000 7f37bcf099c0 2 removed watcher, disabling cache 2024-09-12T00:58:50.518 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.529+0000 7f37bcf099c0 20 remove_watcher() i=1 2024-09-12T00:58:50.520 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.529+0000 7f37bcf099c0 20 remove_watcher() i=2 2024-09-12T00:58:50.522 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.533+0000 7f37bcf099c0 20 remove_watcher() i=3 2024-09-12T00:58:50.524 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.533+0000 7f37bcf099c0 20 remove_watcher() i=4 2024-09-12T00:58:50.526 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.533+0000 7f37bcf099c0 20 remove_watcher() i=5 2024-09-12T00:58:50.527 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.537+0000 7f37bcf099c0 20 remove_watcher() i=6 2024-09-12T00:58:50.528 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.537+0000 7f37bcf099c0 20 remove_watcher() i=7 2024-09-12T00:58:50.542 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T00:58:50.575 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:50.575 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:50.616 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.625+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.618 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.625+0000 7feec38b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.618 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.625+0000 7feec38b09c0 20 realm 2024-09-12T00:58:50.618 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.625+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.618 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.625+0000 7feec38b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.618 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.625+0000 7feec38b09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:50.618 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.625+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.618 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.625+0000 7feec38b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.618 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.625+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.620 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.629+0000 7feec38b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:50.620 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.629+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.621 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.629+0000 7feec38b09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:50.621 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.629+0000 7feec38b09c0 20 searching for the correct realm 2024-09-12T00:58:50.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.633+0000 7feec1bb7640 0 -- 172.21.15.70:0/792736637 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7feeb80e2c50 msgr2=0x7feeb80dc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:58:50.841 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.849+0000 7feec1bb7640 0 -- 172.21.15.70:0/792736637 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7feeb80e2c50 msgr2=0x7feeb80dc9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:50.852 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.861+0000 7feec38b09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:50.852 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.861+0000 7feec38b09c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:58:50.852 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.861+0000 7feec38b09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:50.852 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.861+0000 7feec38b09c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:58:50.852 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.861+0000 7feec38b09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:50.853 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.861+0000 7feec38b09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:50.853 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.861+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.853 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.861+0000 7feec38b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.853 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.861+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.853 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.861+0000 7feec38b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:50.853 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.861+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.865+0000 7feec38b09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:50.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.865+0000 7feec38b09c0 20 zone default found 2024-09-12T00:58:50.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.865+0000 7feec38b09c0 4 Realm: () 2024-09-12T00:58:50.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.865+0000 7feec38b09c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:58:50.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.865+0000 7feec38b09c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:58:50.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.865+0000 7feec38b09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:50.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.865+0000 7feec38b09c0 20 zonegroup default 2024-09-12T00:58:50.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.865+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.865+0000 7feec38b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.865+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.856 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.865+0000 7feec38b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.856 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.865+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.856 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.865+0000 7feec38b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.857 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.865+0000 7feec38b09c0 20 started sync module instance, tier type = 2024-09-12T00:58:50.857 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.865+0000 7feec38b09c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:58:50.879 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.889+0000 7feec38b09c0 20 add_watcher() i=0 2024-09-12T00:58:50.880 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.889+0000 7feec38b09c0 20 add_watcher() i=1 2024-09-12T00:58:50.880 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.889+0000 7feec38b09c0 20 add_watcher() i=2 2024-09-12T00:58:50.880 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.889+0000 7feec38b09c0 20 add_watcher() i=3 2024-09-12T00:58:50.880 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.889+0000 7feec38b09c0 20 add_watcher() i=4 2024-09-12T00:58:50.880 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.889+0000 7feec38b09c0 20 add_watcher() i=5 2024-09-12T00:58:50.880 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.889+0000 7feec38b09c0 20 add_watcher() i=6 2024-09-12T00:58:50.882 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.889+0000 7feec38b09c0 20 add_watcher() i=7 2024-09-12T00:58:50.882 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.889+0000 7feec38b09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:50.886 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.893+0000 7fed777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:50.887 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.897+0000 7feec38b09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:50.887 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.897+0000 7feec38b09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:50.887 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.897+0000 7feec38b09c0 5 note: GC not initialized 2024-09-12T00:58:50.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.897+0000 7fed767e4640 20 reqs_thread_entry: start 2024-09-12T00:58:50.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.897+0000 7feec38b09c0 20 init_complete bucket index max shards: 1 2024-09-12T00:58:50.888 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.897+0000 7feec38b09c0 20 Filter name: none 2024-09-12T00:58:50.889 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.897+0000 7fece7fff640 20 reqs_thread_entry: start 2024-09-12T00:58:50.889 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.897+0000 7feec38b09c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:58:50.889 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.897+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.889 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.897+0000 7feec38b09c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:58:50.890 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.897+0000 7feec38b09c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:58:50.890 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.897+0000 7feec38b09c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:58:50.890 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.897+0000 7feec38b09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : miss 2024-09-12T00:58:50.890 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.897+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.891 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.901+0000 7feec38b09c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:58:50.891 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.901+0000 7feec38b09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:58:50.891 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.901+0000 7feec38b09c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:58:50.891 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.901+0000 7feec38b09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:58:50.891 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.901+0000 7feec38b09c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:58:50.891 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.901+0000 7feec38b09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T00:58:50.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.909+0000 7feec38b09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:58:50.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.909+0000 7feec38b09c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:58:50.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.909+0000 7feec38b09c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:58:50.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.909+0000 7feec38b09c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18, ofs0, ns] 2024-09-12T00:58:50.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.909+0000 7feda4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431645 cookie 94649651458576 notifier 7673 bl.length()=911 2024-09-12T00:58:50.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.909+0000 7feda4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:58:50.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.909+0000 7feda4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:58:50.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.909+0000 7feda4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:58:50.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.909+0000 7feec38b09c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_sources= new_sources= 2024-09-12T00:58:50.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.909+0000 7feec38b09c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential sources added=[] removed=[] 2024-09-12T00:58:50.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.909+0000 7feec38b09c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_dests= new_dests= 2024-09-12T00:58:50.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.909+0000 7feec38b09c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential dests added=[] removed=[] 2024-09-12T00:58:50.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.917+0000 7feec38b09c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.0 2024-09-12T00:58:50.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.917+0000 7feec38b09c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.0 2024-09-12T00:58:50.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.917+0000 7feec38b09c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.1 2024-09-12T00:58:50.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.917+0000 7feec38b09c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.1 2024-09-12T00:58:50.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.917+0000 7feec38b09c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.2 2024-09-12T00:58:50.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.917+0000 7feec38b09c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.2 2024-09-12T00:58:50.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.917+0000 7feec38b09c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.3 2024-09-12T00:58:50.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.917+0000 7feec38b09c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.3 2024-09-12T00:58:50.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.917+0000 7feec38b09c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.0 2024-09-12T00:58:50.908 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.917+0000 7feec38b09c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.0 2024-09-12T00:58:50.908 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.917+0000 7feec38b09c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.1 2024-09-12T00:58:50.908 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.917+0000 7feec38b09c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.1 2024-09-12T00:58:50.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.917+0000 7feec38b09c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.2 2024-09-12T00:58:50.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.917+0000 7feec38b09c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.2 2024-09-12T00:58:50.912 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7feec38b09c0 time 2024-09-12T00:58:50.925071+0000 2024-09-12T00:58:50.912 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:58:50.914 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:58:50.914 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7feec718a2eb] 2024-09-12T00:58:50.914 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7feec718a49f] 2024-09-12T00:58:50.914 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561553e65cc1] 2024-09-12T00:58:50.914 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x561553e7a01c] 2024-09-12T00:58:50.914 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561553e7b6a4] 2024-09-12T00:58:50.914 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:58:50.914 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7feec5ff0d90] 2024-09-12T00:58:50.914 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:58:50.914 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:58:50.914 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.921+0000 7feec38b09c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7feec38b09c0 time 2024-09-12T00:58:50.925071+0000 2024-09-12T00:58:50.914 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:58:50.915 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:50.915 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:58:50.915 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7feec718a2eb] 2024-09-12T00:58:50.915 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7feec718a49f] 2024-09-12T00:58:50.915 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561553e65cc1] 2024-09-12T00:58:50.915 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x561553e7a01c] 2024-09-12T00:58:50.915 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561553e7b6a4] 2024-09-12T00:58:50.915 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:58:50.915 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7feec5ff0d90] 2024-09-12T00:58:50.915 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:58:50.915 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:58:50.915 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:50.915 INFO:tasks.workunit.client.0.smithi070.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:58:50.915 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7feec38b09c0 thread_name:radosgw-admin 2024-09-12T00:58:50.931 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:58:50.931 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7feec6009520] 2024-09-12T00:58:50.931 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:58:50.931 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:58:50.931 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:58:50.931 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7feec718a345] 2024-09-12T00:58:50.931 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7feec718a49f] 2024-09-12T00:58:50.931 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561553e65cc1] 2024-09-12T00:58:50.931 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x561553e7a01c] 2024-09-12T00:58:50.931 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561553e7b6a4] 2024-09-12T00:58:50.932 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:58:50.932 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7feec5ff0d90] 2024-09-12T00:58:50.932 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:58:50.932 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:58:50.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:50.925+0000 7feec38b09c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:58:50.932 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7feec38b09c0 thread_name:radosgw-admin 2024-09-12T00:58:50.932 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:50.932 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:58:50.932 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7feec6009520] 2024-09-12T00:58:50.932 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:58:50.932 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:58:50.932 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:58:50.932 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7feec718a345] 2024-09-12T00:58:50.933 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7feec718a49f] 2024-09-12T00:58:50.933 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561553e65cc1] 2024-09-12T00:58:50.933 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x561553e7a01c] 2024-09-12T00:58:50.933 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561553e7b6a4] 2024-09-12T00:58:50.933 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:58:50.933 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7feec5ff0d90] 2024-09-12T00:58:50.933 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:58:50.933 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:58:50.933 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:58:50.933 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:50.933 INFO:tasks.workunit.client.0.smithi070.stderr:--- begin dump of recent events --- 2024-09-12T00:58:50.933 INFO:tasks.workunit.client.0.smithi070.stderr: -499> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 monclient: authenticate success, global_id 7661 2024-09-12T00:58:50.933 INFO:tasks.workunit.client.0.smithi070.stderr: -498> 2024-09-12T00:58:50.605+0000 7feec38b09c0 10 monclient: get_monmap_and_config success 2024-09-12T00:58:50.933 INFO:tasks.workunit.client.0.smithi070.stderr: -497> 2024-09-12T00:58:50.605+0000 7feec38b09c0 4 set_mon_vals no callback set 2024-09-12T00:58:50.934 INFO:tasks.workunit.client.0.smithi070.stderr: -496> 2024-09-12T00:58:50.605+0000 7feec38b09c0 10 monclient: shutdown 2024-09-12T00:58:50.934 INFO:tasks.workunit.client.0.smithi070.stderr: -495> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 asok(0x561556aa42b0) unregister_commands rotate-key 2024-09-12T00:58:50.934 INFO:tasks.workunit.client.0.smithi070.stderr: -494> 2024-09-12T00:58:50.605+0000 7feec38b09c0 10 monclient: build_initial_monmap 2024-09-12T00:58:50.934 INFO:tasks.workunit.client.0.smithi070.stderr: -493> 2024-09-12T00:58:50.605+0000 7feec38b09c0 1 build_initial for_mkfs: 0 2024-09-12T00:58:50.934 INFO:tasks.workunit.client.0.smithi070.stderr: -492> 2024-09-12T00:58:50.605+0000 7feec38b09c0 10 monclient: monmap: 2024-09-12T00:58:50.934 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:58:50.934 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:58:50.934 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:58:50.934 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:58:50.934 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:58:50.934 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:50.934 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:58:50.934 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:58:50.934 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:58:50.935 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:50.935 INFO:tasks.workunit.client.0.smithi070.stderr: -491> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding auth protocol: cephx 2024-09-12T00:58:50.935 INFO:tasks.workunit.client.0.smithi070.stderr: -490> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding auth protocol: cephx 2024-09-12T00:58:50.935 INFO:tasks.workunit.client.0.smithi070.stderr: -489> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding auth protocol: cephx 2024-09-12T00:58:50.935 INFO:tasks.workunit.client.0.smithi070.stderr: -488> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding con mode: secure 2024-09-12T00:58:50.935 INFO:tasks.workunit.client.0.smithi070.stderr: -487> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding con mode: crc 2024-09-12T00:58:50.935 INFO:tasks.workunit.client.0.smithi070.stderr: -486> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding con mode: secure 2024-09-12T00:58:50.935 INFO:tasks.workunit.client.0.smithi070.stderr: -485> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding con mode: crc 2024-09-12T00:58:50.935 INFO:tasks.workunit.client.0.smithi070.stderr: -484> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding con mode: secure 2024-09-12T00:58:50.935 INFO:tasks.workunit.client.0.smithi070.stderr: -483> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding con mode: crc 2024-09-12T00:58:50.935 INFO:tasks.workunit.client.0.smithi070.stderr: -482> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding con mode: crc 2024-09-12T00:58:50.935 INFO:tasks.workunit.client.0.smithi070.stderr: -481> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding con mode: secure 2024-09-12T00:58:50.935 INFO:tasks.workunit.client.0.smithi070.stderr: -480> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding con mode: crc 2024-09-12T00:58:50.935 INFO:tasks.workunit.client.0.smithi070.stderr: -479> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding con mode: secure 2024-09-12T00:58:50.936 INFO:tasks.workunit.client.0.smithi070.stderr: -478> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding con mode: crc 2024-09-12T00:58:50.936 INFO:tasks.workunit.client.0.smithi070.stderr: -477> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding con mode: secure 2024-09-12T00:58:50.936 INFO:tasks.workunit.client.0.smithi070.stderr: -476> 2024-09-12T00:58:50.605+0000 7feec38b09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:50.936 INFO:tasks.workunit.client.0.smithi070.stderr: -475> 2024-09-12T00:58:50.605+0000 7feec38b09c0 1 librados: starting msgr at 2024-09-12T00:58:50.936 INFO:tasks.workunit.client.0.smithi070.stderr: -474> 2024-09-12T00:58:50.605+0000 7feec38b09c0 1 librados: starting objecter 2024-09-12T00:58:50.936 INFO:tasks.workunit.client.0.smithi070.stderr: -473> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command objecter_requests hook 0x561556cb64c0 2024-09-12T00:58:50.936 INFO:tasks.workunit.client.0.smithi070.stderr: -472> 2024-09-12T00:58:50.605+0000 7feec38b09c0 1 librados: setting wanted keys 2024-09-12T00:58:50.936 INFO:tasks.workunit.client.0.smithi070.stderr: -471> 2024-09-12T00:58:50.605+0000 7feec38b09c0 1 librados: calling monclient init 2024-09-12T00:58:50.936 INFO:tasks.workunit.client.0.smithi070.stderr: -470> 2024-09-12T00:58:50.605+0000 7feec38b09c0 10 monclient: init 2024-09-12T00:58:50.936 INFO:tasks.workunit.client.0.smithi070.stderr: -469> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding auth protocol: cephx 2024-09-12T00:58:50.936 INFO:tasks.workunit.client.0.smithi070.stderr: -468> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding auth protocol: cephx 2024-09-12T00:58:50.936 INFO:tasks.workunit.client.0.smithi070.stderr: -467> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding auth protocol: cephx 2024-09-12T00:58:50.936 INFO:tasks.workunit.client.0.smithi070.stderr: -466> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding con mode: secure 2024-09-12T00:58:50.936 INFO:tasks.workunit.client.0.smithi070.stderr: -465> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding con mode: crc 2024-09-12T00:58:50.937 INFO:tasks.workunit.client.0.smithi070.stderr: -464> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding con mode: secure 2024-09-12T00:58:50.937 INFO:tasks.workunit.client.0.smithi070.stderr: -463> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding con mode: crc 2024-09-12T00:58:50.937 INFO:tasks.workunit.client.0.smithi070.stderr: -462> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding con mode: secure 2024-09-12T00:58:50.937 INFO:tasks.workunit.client.0.smithi070.stderr: -461> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding con mode: crc 2024-09-12T00:58:50.937 INFO:tasks.workunit.client.0.smithi070.stderr: -460> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding con mode: crc 2024-09-12T00:58:50.937 INFO:tasks.workunit.client.0.smithi070.stderr: -459> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding con mode: secure 2024-09-12T00:58:50.937 INFO:tasks.workunit.client.0.smithi070.stderr: -458> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding con mode: crc 2024-09-12T00:58:50.937 INFO:tasks.workunit.client.0.smithi070.stderr: -457> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding con mode: secure 2024-09-12T00:58:50.937 INFO:tasks.workunit.client.0.smithi070.stderr: -456> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding con mode: crc 2024-09-12T00:58:50.937 INFO:tasks.workunit.client.0.smithi070.stderr: -455> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding con mode: secure 2024-09-12T00:58:50.937 INFO:tasks.workunit.client.0.smithi070.stderr: -454> 2024-09-12T00:58:50.605+0000 7feec38b09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:50.937 INFO:tasks.workunit.client.0.smithi070.stderr: -453> 2024-09-12T00:58:50.609+0000 7feec38b09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:50.937 INFO:tasks.workunit.client.0.smithi070.stderr: -452> 2024-09-12T00:58:50.609+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command rotate-key hook 0x561556caecb8 2024-09-12T00:58:50.938 INFO:tasks.workunit.client.0.smithi070.stderr: -451> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient: _reopen_session rank -1 2024-09-12T00:58:50.938 INFO:tasks.workunit.client.0.smithi070.stderr: -450> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:58:50.938 INFO:tasks.workunit.client.0.smithi070.stderr: -449> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient(hunting): picked mon.noname-c con 0x561556b6e230 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:58:50.938 INFO:tasks.workunit.client.0.smithi070.stderr: -448> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient(hunting): picked mon.noname-a con 0x561556bfa920 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:58:50.938 INFO:tasks.workunit.client.0.smithi070.stderr: -447> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient(hunting): picked mon.noname-b con 0x561556cb2a80 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:58:50.938 INFO:tasks.workunit.client.0.smithi070.stderr: -446> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:50.938 INFO:tasks.workunit.client.0.smithi070.stderr: -445> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:50.938 INFO:tasks.workunit.client.0.smithi070.stderr: -444> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:50.938 INFO:tasks.workunit.client.0.smithi070.stderr: -443> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient(hunting): _renew_subs 2024-09-12T00:58:50.938 INFO:tasks.workunit.client.0.smithi070.stderr: -442> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient(hunting): authenticate will time out at 2381.056252s 2024-09-12T00:58:50.938 INFO:tasks.workunit.client.0.smithi070.stderr: -441> 2024-09-12T00:58:50.609+0000 7feec13b6640 10 monclient(hunting): get_auth_request con 0x561556b6e230 auth_method 0 2024-09-12T00:58:50.938 INFO:tasks.workunit.client.0.smithi070.stderr: -440> 2024-09-12T00:58:50.609+0000 7feec13b6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:50.938 INFO:tasks.workunit.client.0.smithi070.stderr: -439> 2024-09-12T00:58:50.609+0000 7feec13b6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:50.938 INFO:tasks.workunit.client.0.smithi070.stderr: -438> 2024-09-12T00:58:50.609+0000 7feec13b6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:50.939 INFO:tasks.workunit.client.0.smithi070.stderr: -437> 2024-09-12T00:58:50.609+0000 7feec0bb5640 10 monclient(hunting): get_auth_request con 0x561556bfa920 auth_method 0 2024-09-12T00:58:50.939 INFO:tasks.workunit.client.0.smithi070.stderr: -436> 2024-09-12T00:58:50.609+0000 7feec0bb5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:50.939 INFO:tasks.workunit.client.0.smithi070.stderr: -435> 2024-09-12T00:58:50.609+0000 7feec0bb5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:50.939 INFO:tasks.workunit.client.0.smithi070.stderr: -434> 2024-09-12T00:58:50.609+0000 7feec0bb5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:50.939 INFO:tasks.workunit.client.0.smithi070.stderr: -433> 2024-09-12T00:58:50.609+0000 7feec13b6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:50.939 INFO:tasks.workunit.client.0.smithi070.stderr: -432> 2024-09-12T00:58:50.609+0000 7feec13b6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:50.939 INFO:tasks.workunit.client.0.smithi070.stderr: -431> 2024-09-12T00:58:50.609+0000 7feec13b6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:50.939 INFO:tasks.workunit.client.0.smithi070.stderr: -430> 2024-09-12T00:58:50.609+0000 7feec0bb5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:50.939 INFO:tasks.workunit.client.0.smithi070.stderr: -429> 2024-09-12T00:58:50.609+0000 7feec0bb5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:50.939 INFO:tasks.workunit.client.0.smithi070.stderr: -428> 2024-09-12T00:58:50.609+0000 7feec0bb5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:50.939 INFO:tasks.workunit.client.0.smithi070.stderr: -427> 2024-09-12T00:58:50.609+0000 7feec13b6640 10 monclient(hunting): handle_auth_done global_id 7664 payload 824 2024-09-12T00:58:50.939 INFO:tasks.workunit.client.0.smithi070.stderr: -426> 2024-09-12T00:58:50.609+0000 7feec13b6640 10 monclient: _finish_hunting 0 2024-09-12T00:58:50.939 INFO:tasks.workunit.client.0.smithi070.stderr: -425> 2024-09-12T00:58:50.609+0000 7feec13b6640 1 monclient: found mon.noname-c 2024-09-12T00:58:50.939 INFO:tasks.workunit.client.0.smithi070.stderr: -424> 2024-09-12T00:58:50.609+0000 7feec13b6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:58:50.940 INFO:tasks.workunit.client.0.smithi070.stderr: -423> 2024-09-12T00:58:50.609+0000 7fedade03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:50.940 INFO:tasks.workunit.client.0.smithi070.stderr: -422> 2024-09-12T00:58:50.609+0000 7fedade03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:58:50.940 INFO:tasks.workunit.client.0.smithi070.stderr: -421> 2024-09-12T00:58:50.609+0000 7fedade03640 10 monclient: dump: 2024-09-12T00:58:50.940 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:50.940 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:50.940 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:50.940 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:50.940 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:50.940 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:50.940 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:50.940 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:50.940 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:50.940 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:50.941 INFO:tasks.workunit.client.0.smithi070.stderr: -420> 2024-09-12T00:58:50.609+0000 7fedade03640 10 monclient: _finish_auth 0 2024-09-12T00:58:50.941 INFO:tasks.workunit.client.0.smithi070.stderr: -419> 2024-09-12T00:58:50.609+0000 7fedade03640 10 monclient: _check_auth_tickets 2024-09-12T00:58:50.941 INFO:tasks.workunit.client.0.smithi070.stderr: -418> 2024-09-12T00:58:50.609+0000 7fedade03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:58:50.941 INFO:tasks.workunit.client.0.smithi070.stderr: -417> 2024-09-12T00:58:50.609+0000 7fedade03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:50.941 INFO:tasks.workunit.client.0.smithi070.stderr: -416> 2024-09-12T00:58:50.609+0000 7fedade03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:58:50.941 INFO:tasks.workunit.client.0.smithi070.stderr: -415> 2024-09-12T00:58:50.609+0000 7fedade03640 10 monclient: dump: 2024-09-12T00:58:50.941 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:50.941 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:50.941 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:50.941 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:50.941 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:50.941 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:50.941 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:50.941 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:50.942 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:50.942 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:50.942 INFO:tasks.workunit.client.0.smithi070.stderr: -414> 2024-09-12T00:58:50.609+0000 7fedaf606640 4 set_mon_vals no callback set 2024-09-12T00:58:50.942 INFO:tasks.workunit.client.0.smithi070.stderr: -413> 2024-09-12T00:58:50.609+0000 7feec38b09c0 5 monclient: authenticate success, global_id 7664 2024-09-12T00:58:50.942 INFO:tasks.workunit.client.0.smithi070.stderr: -412> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient: _renew_subs 2024-09-12T00:58:50.942 INFO:tasks.workunit.client.0.smithi070.stderr: -411> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:58:50.942 INFO:tasks.workunit.client.0.smithi070.stderr: -410> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient: _renew_subs 2024-09-12T00:58:50.942 INFO:tasks.workunit.client.0.smithi070.stderr: -409> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:58:50.942 INFO:tasks.workunit.client.0.smithi070.stderr: -408> 2024-09-12T00:58:50.609+0000 7feec38b09c0 1 librados: init done 2024-09-12T00:58:50.942 INFO:tasks.workunit.client.0.smithi070.stderr: -407> 2024-09-12T00:58:50.609+0000 7fedade03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:58:50.942 INFO:tasks.workunit.client.0.smithi070.stderr: -406> 2024-09-12T00:58:50.609+0000 7fedade03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:58:50.942 INFO:tasks.workunit.client.0.smithi070.stderr: -405> 2024-09-12T00:58:50.609+0000 7fedade03640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:58:50.943 INFO:tasks.workunit.client.0.smithi070.stderr: -404> 2024-09-12T00:58:50.609+0000 7feec0bb5640 10 monclient: get_auth_request con 0x7feda8070ae0 auth_method 0 2024-09-12T00:58:50.943 INFO:tasks.workunit.client.0.smithi070.stderr: -403> 2024-09-12T00:58:50.613+0000 7feec1bb7640 10 monclient: get_auth_request con 0x561556cb9de0 auth_method 0 2024-09-12T00:58:50.943 INFO:tasks.workunit.client.0.smithi070.stderr: -402> 2024-09-12T00:58:50.613+0000 7feec13b6640 10 monclient: get_auth_request con 0x561556cfa590 auth_method 0 2024-09-12T00:58:50.943 INFO:tasks.workunit.client.0.smithi070.stderr: -401> 2024-09-12T00:58:50.613+0000 7feec0bb5640 10 monclient: get_auth_request con 0x561556cfea10 auth_method 0 2024-09-12T00:58:50.943 INFO:tasks.workunit.client.0.smithi070.stderr: -400> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient: build_initial_monmap 2024-09-12T00:58:50.943 INFO:tasks.workunit.client.0.smithi070.stderr: -399> 2024-09-12T00:58:50.617+0000 7feec38b09c0 1 build_initial for_mkfs: 0 2024-09-12T00:58:50.943 INFO:tasks.workunit.client.0.smithi070.stderr: -398> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient: monmap: 2024-09-12T00:58:50.943 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:58:50.943 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:58:50.943 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:58:50.943 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:58:50.943 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:58:50.943 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:50.943 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:58:50.943 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:58:50.944 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:58:50.944 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:50.944 INFO:tasks.workunit.client.0.smithi070.stderr: -397> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding auth protocol: cephx 2024-09-12T00:58:50.944 INFO:tasks.workunit.client.0.smithi070.stderr: -396> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding auth protocol: cephx 2024-09-12T00:58:50.944 INFO:tasks.workunit.client.0.smithi070.stderr: -395> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding auth protocol: cephx 2024-09-12T00:58:50.944 INFO:tasks.workunit.client.0.smithi070.stderr: -394> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding con mode: secure 2024-09-12T00:58:50.944 INFO:tasks.workunit.client.0.smithi070.stderr: -393> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding con mode: crc 2024-09-12T00:58:50.944 INFO:tasks.workunit.client.0.smithi070.stderr: -392> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding con mode: secure 2024-09-12T00:58:50.944 INFO:tasks.workunit.client.0.smithi070.stderr: -391> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding con mode: crc 2024-09-12T00:58:50.944 INFO:tasks.workunit.client.0.smithi070.stderr: -390> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding con mode: secure 2024-09-12T00:58:50.944 INFO:tasks.workunit.client.0.smithi070.stderr: -389> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding con mode: crc 2024-09-12T00:58:50.944 INFO:tasks.workunit.client.0.smithi070.stderr: -388> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding con mode: crc 2024-09-12T00:58:50.945 INFO:tasks.workunit.client.0.smithi070.stderr: -387> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding con mode: secure 2024-09-12T00:58:50.945 INFO:tasks.workunit.client.0.smithi070.stderr: -386> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding con mode: crc 2024-09-12T00:58:50.945 INFO:tasks.workunit.client.0.smithi070.stderr: -385> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding con mode: secure 2024-09-12T00:58:50.945 INFO:tasks.workunit.client.0.smithi070.stderr: -384> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding con mode: crc 2024-09-12T00:58:50.945 INFO:tasks.workunit.client.0.smithi070.stderr: -383> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding con mode: secure 2024-09-12T00:58:50.945 INFO:tasks.workunit.client.0.smithi070.stderr: -382> 2024-09-12T00:58:50.617+0000 7feec38b09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:50.945 INFO:tasks.workunit.client.0.smithi070.stderr: -381> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command objecter_requests cmddesc objecter_requests hook 0x561556d07250 EEXIST 2024-09-12T00:58:50.945 INFO:tasks.workunit.client.0.smithi070.stderr: -380> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient: init 2024-09-12T00:58:50.945 INFO:tasks.workunit.client.0.smithi070.stderr: -379> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding auth protocol: cephx 2024-09-12T00:58:50.945 INFO:tasks.workunit.client.0.smithi070.stderr: -378> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding auth protocol: cephx 2024-09-12T00:58:50.945 INFO:tasks.workunit.client.0.smithi070.stderr: -377> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding auth protocol: cephx 2024-09-12T00:58:50.945 INFO:tasks.workunit.client.0.smithi070.stderr: -376> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding con mode: secure 2024-09-12T00:58:50.945 INFO:tasks.workunit.client.0.smithi070.stderr: -375> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding con mode: crc 2024-09-12T00:58:50.946 INFO:tasks.workunit.client.0.smithi070.stderr: -374> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding con mode: secure 2024-09-12T00:58:50.946 INFO:tasks.workunit.client.0.smithi070.stderr: -373> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding con mode: crc 2024-09-12T00:58:50.946 INFO:tasks.workunit.client.0.smithi070.stderr: -372> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding con mode: secure 2024-09-12T00:58:50.946 INFO:tasks.workunit.client.0.smithi070.stderr: -371> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding con mode: crc 2024-09-12T00:58:50.946 INFO:tasks.workunit.client.0.smithi070.stderr: -370> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding con mode: crc 2024-09-12T00:58:50.946 INFO:tasks.workunit.client.0.smithi070.stderr: -369> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding con mode: secure 2024-09-12T00:58:50.946 INFO:tasks.workunit.client.0.smithi070.stderr: -368> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding con mode: crc 2024-09-12T00:58:50.946 INFO:tasks.workunit.client.0.smithi070.stderr: -367> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding con mode: secure 2024-09-12T00:58:50.946 INFO:tasks.workunit.client.0.smithi070.stderr: -366> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding con mode: crc 2024-09-12T00:58:50.946 INFO:tasks.workunit.client.0.smithi070.stderr: -365> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding con mode: secure 2024-09-12T00:58:50.946 INFO:tasks.workunit.client.0.smithi070.stderr: -364> 2024-09-12T00:58:50.617+0000 7feec38b09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:50.946 INFO:tasks.workunit.client.0.smithi070.stderr: -363> 2024-09-12T00:58:50.617+0000 7feec38b09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:50.946 INFO:tasks.workunit.client.0.smithi070.stderr: -362> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command rotate-key cmddesc rotate-key hook 0x561556d02090 EEXIST 2024-09-12T00:58:50.946 INFO:tasks.workunit.client.0.smithi070.stderr: -361> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient: _reopen_session rank -1 2024-09-12T00:58:50.947 INFO:tasks.workunit.client.0.smithi070.stderr: -360> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:58:50.947 INFO:tasks.workunit.client.0.smithi070.stderr: -359> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient(hunting): picked mon.noname-a con 0x561556d2b400 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:58:50.947 INFO:tasks.workunit.client.0.smithi070.stderr: -358> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient(hunting): picked mon.noname-b con 0x561556d2ad30 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:58:50.947 INFO:tasks.workunit.client.0.smithi070.stderr: -357> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient(hunting): picked mon.noname-c con 0x561556d29710 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:58:50.947 INFO:tasks.workunit.client.0.smithi070.stderr: -356> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:50.947 INFO:tasks.workunit.client.0.smithi070.stderr: -355> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:50.947 INFO:tasks.workunit.client.0.smithi070.stderr: -354> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:50.947 INFO:tasks.workunit.client.0.smithi070.stderr: -353> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient(hunting): _renew_subs 2024-09-12T00:58:50.947 INFO:tasks.workunit.client.0.smithi070.stderr: -352> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient(hunting): authenticate will time out at 2381.065142s 2024-09-12T00:58:50.947 INFO:tasks.workunit.client.0.smithi070.stderr: -351> 2024-09-12T00:58:50.617+0000 7feec13b6640 10 monclient(hunting): get_auth_request con 0x561556d2b400 auth_method 0 2024-09-12T00:58:50.947 INFO:tasks.workunit.client.0.smithi070.stderr: -350> 2024-09-12T00:58:50.617+0000 7feec13b6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:50.947 INFO:tasks.workunit.client.0.smithi070.stderr: -349> 2024-09-12T00:58:50.617+0000 7feec13b6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:50.947 INFO:tasks.workunit.client.0.smithi070.stderr: -348> 2024-09-12T00:58:50.617+0000 7feec13b6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:50.947 INFO:tasks.workunit.client.0.smithi070.stderr: -347> 2024-09-12T00:58:50.617+0000 7feec1bb7640 10 monclient(hunting): get_auth_request con 0x561556d29710 auth_method 0 2024-09-12T00:58:50.948 INFO:tasks.workunit.client.0.smithi070.stderr: -346> 2024-09-12T00:58:50.617+0000 7feec1bb7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:50.948 INFO:tasks.workunit.client.0.smithi070.stderr: -345> 2024-09-12T00:58:50.617+0000 7feec1bb7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:50.948 INFO:tasks.workunit.client.0.smithi070.stderr: -344> 2024-09-12T00:58:50.617+0000 7feec1bb7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:50.948 INFO:tasks.workunit.client.0.smithi070.stderr: -343> 2024-09-12T00:58:50.617+0000 7feec13b6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:50.948 INFO:tasks.workunit.client.0.smithi070.stderr: -342> 2024-09-12T00:58:50.617+0000 7feec13b6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:50.948 INFO:tasks.workunit.client.0.smithi070.stderr: -341> 2024-09-12T00:58:50.617+0000 7feec13b6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:50.948 INFO:tasks.workunit.client.0.smithi070.stderr: -340> 2024-09-12T00:58:50.617+0000 7feec1bb7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:50.948 INFO:tasks.workunit.client.0.smithi070.stderr: -339> 2024-09-12T00:58:50.617+0000 7feec1bb7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:50.948 INFO:tasks.workunit.client.0.smithi070.stderr: -338> 2024-09-12T00:58:50.617+0000 7feec1bb7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:50.948 INFO:tasks.workunit.client.0.smithi070.stderr: -337> 2024-09-12T00:58:50.617+0000 7feec1bb7640 10 monclient(hunting): handle_auth_done global_id 7667 payload 824 2024-09-12T00:58:50.948 INFO:tasks.workunit.client.0.smithi070.stderr: -336> 2024-09-12T00:58:50.617+0000 7feec1bb7640 10 monclient: _finish_hunting 0 2024-09-12T00:58:50.948 INFO:tasks.workunit.client.0.smithi070.stderr: -335> 2024-09-12T00:58:50.617+0000 7feec1bb7640 1 monclient: found mon.noname-c 2024-09-12T00:58:50.948 INFO:tasks.workunit.client.0.smithi070.stderr: -334> 2024-09-12T00:58:50.617+0000 7feec1bb7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:58:50.948 INFO:tasks.workunit.client.0.smithi070.stderr: -333> 2024-09-12T00:58:50.617+0000 7feec0bb5640 10 monclient: get_auth_request con 0x561556d2ad30 auth_method 0 2024-09-12T00:58:50.949 INFO:tasks.workunit.client.0.smithi070.stderr: -332> 2024-09-12T00:58:50.617+0000 7feda6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:50.949 INFO:tasks.workunit.client.0.smithi070.stderr: -331> 2024-09-12T00:58:50.617+0000 7feda6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:58:50.949 INFO:tasks.workunit.client.0.smithi070.stderr: -330> 2024-09-12T00:58:50.617+0000 7feda6ffd640 10 monclient: dump: 2024-09-12T00:58:50.949 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:50.949 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:50.949 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:50.949 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:50.949 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:50.949 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:50.949 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:50.949 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:50.949 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:50.949 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:50.950 INFO:tasks.workunit.client.0.smithi070.stderr: -329> 2024-09-12T00:58:50.617+0000 7feda6ffd640 10 monclient: _finish_auth 0 2024-09-12T00:58:50.950 INFO:tasks.workunit.client.0.smithi070.stderr: -328> 2024-09-12T00:58:50.617+0000 7feda6ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:58:50.950 INFO:tasks.workunit.client.0.smithi070.stderr: -327> 2024-09-12T00:58:50.617+0000 7feda6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:58:50.950 INFO:tasks.workunit.client.0.smithi070.stderr: -326> 2024-09-12T00:58:50.617+0000 7feda6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:50.950 INFO:tasks.workunit.client.0.smithi070.stderr: -325> 2024-09-12T00:58:50.617+0000 7feda6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:58:50.950 INFO:tasks.workunit.client.0.smithi070.stderr: -324> 2024-09-12T00:58:50.617+0000 7feda6ffd640 10 monclient: dump: 2024-09-12T00:58:50.950 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:50.950 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:50.950 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:50.950 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:50.950 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:50.950 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:50.950 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:50.951 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:50.951 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:50.951 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:50.951 INFO:tasks.workunit.client.0.smithi070.stderr: -323> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 monclient: authenticate success, global_id 7667 2024-09-12T00:58:50.951 INFO:tasks.workunit.client.0.smithi070.stderr: -322> 2024-09-12T00:58:50.617+0000 7feec23b8640 4 set_mon_vals no callback set 2024-09-12T00:58:50.951 INFO:tasks.workunit.client.0.smithi070.stderr: -321> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient: _renew_subs 2024-09-12T00:58:50.951 INFO:tasks.workunit.client.0.smithi070.stderr: -320> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:58:50.951 INFO:tasks.workunit.client.0.smithi070.stderr: -319> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient: _renew_subs 2024-09-12T00:58:50.951 INFO:tasks.workunit.client.0.smithi070.stderr: -318> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:58:50.951 INFO:tasks.workunit.client.0.smithi070.stderr: -317> 2024-09-12T00:58:50.617+0000 7feda6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:58:50.951 INFO:tasks.workunit.client.0.smithi070.stderr: -316> 2024-09-12T00:58:50.617+0000 7feda6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:58:50.951 INFO:tasks.workunit.client.0.smithi070.stderr: -315> 2024-09-12T00:58:50.617+0000 7feda6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:58:50.951 INFO:tasks.workunit.client.0.smithi070.stderr: -314> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient: get_monmap_and_config 2024-09-12T00:58:50.951 INFO:tasks.workunit.client.0.smithi070.stderr: -313> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient: build_initial_monmap 2024-09-12T00:58:50.952 INFO:tasks.workunit.client.0.smithi070.stderr: -312> 2024-09-12T00:58:50.621+0000 7feec38b09c0 1 build_initial for_mkfs: 0 2024-09-12T00:58:50.952 INFO:tasks.workunit.client.0.smithi070.stderr: -311> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient: monmap: 2024-09-12T00:58:50.952 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:58:50.952 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:58:50.952 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:58:50.952 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:58:50.952 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:58:50.952 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:50.952 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:58:50.952 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:58:50.952 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:58:50.952 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:50.952 INFO:tasks.workunit.client.0.smithi070.stderr: -310> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding auth protocol: cephx 2024-09-12T00:58:50.952 INFO:tasks.workunit.client.0.smithi070.stderr: -309> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding auth protocol: cephx 2024-09-12T00:58:50.953 INFO:tasks.workunit.client.0.smithi070.stderr: -308> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding auth protocol: cephx 2024-09-12T00:58:50.953 INFO:tasks.workunit.client.0.smithi070.stderr: -307> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding con mode: secure 2024-09-12T00:58:50.953 INFO:tasks.workunit.client.0.smithi070.stderr: -306> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding con mode: crc 2024-09-12T00:58:50.953 INFO:tasks.workunit.client.0.smithi070.stderr: -305> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding con mode: secure 2024-09-12T00:58:50.953 INFO:tasks.workunit.client.0.smithi070.stderr: -304> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding con mode: crc 2024-09-12T00:58:50.953 INFO:tasks.workunit.client.0.smithi070.stderr: -303> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding con mode: secure 2024-09-12T00:58:50.953 INFO:tasks.workunit.client.0.smithi070.stderr: -302> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding con mode: crc 2024-09-12T00:58:50.953 INFO:tasks.workunit.client.0.smithi070.stderr: -301> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding con mode: crc 2024-09-12T00:58:50.953 INFO:tasks.workunit.client.0.smithi070.stderr: -300> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding con mode: secure 2024-09-12T00:58:50.953 INFO:tasks.workunit.client.0.smithi070.stderr: -299> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding con mode: crc 2024-09-12T00:58:50.953 INFO:tasks.workunit.client.0.smithi070.stderr: -298> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding con mode: secure 2024-09-12T00:58:50.953 INFO:tasks.workunit.client.0.smithi070.stderr: -297> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding con mode: crc 2024-09-12T00:58:50.953 INFO:tasks.workunit.client.0.smithi070.stderr: -296> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding con mode: secure 2024-09-12T00:58:50.953 INFO:tasks.workunit.client.0.smithi070.stderr: -295> 2024-09-12T00:58:50.621+0000 7feec13b6640 10 monclient: get_auth_request con 0x7fed9c070a20 auth_method 0 2024-09-12T00:58:50.954 INFO:tasks.workunit.client.0.smithi070.stderr: -294> 2024-09-12T00:58:50.621+0000 7feec38b09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:50.954 INFO:tasks.workunit.client.0.smithi070.stderr: -293> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient: init 2024-09-12T00:58:50.954 INFO:tasks.workunit.client.0.smithi070.stderr: -292> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding auth protocol: cephx 2024-09-12T00:58:50.954 INFO:tasks.workunit.client.0.smithi070.stderr: -291> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding auth protocol: cephx 2024-09-12T00:58:50.954 INFO:tasks.workunit.client.0.smithi070.stderr: -290> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding auth protocol: cephx 2024-09-12T00:58:50.954 INFO:tasks.workunit.client.0.smithi070.stderr: -289> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding con mode: secure 2024-09-12T00:58:50.954 INFO:tasks.workunit.client.0.smithi070.stderr: -288> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding con mode: crc 2024-09-12T00:58:50.954 INFO:tasks.workunit.client.0.smithi070.stderr: -287> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding con mode: secure 2024-09-12T00:58:50.954 INFO:tasks.workunit.client.0.smithi070.stderr: -286> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding con mode: crc 2024-09-12T00:58:50.954 INFO:tasks.workunit.client.0.smithi070.stderr: -285> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding con mode: secure 2024-09-12T00:58:50.954 INFO:tasks.workunit.client.0.smithi070.stderr: -284> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding con mode: crc 2024-09-12T00:58:50.954 INFO:tasks.workunit.client.0.smithi070.stderr: -283> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding con mode: crc 2024-09-12T00:58:50.954 INFO:tasks.workunit.client.0.smithi070.stderr: -282> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding con mode: secure 2024-09-12T00:58:50.955 INFO:tasks.workunit.client.0.smithi070.stderr: -281> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding con mode: crc 2024-09-12T00:58:50.955 INFO:tasks.workunit.client.0.smithi070.stderr: -280> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding con mode: secure 2024-09-12T00:58:50.955 INFO:tasks.workunit.client.0.smithi070.stderr: -279> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding con mode: crc 2024-09-12T00:58:50.955 INFO:tasks.workunit.client.0.smithi070.stderr: -278> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding con mode: secure 2024-09-12T00:58:50.955 INFO:tasks.workunit.client.0.smithi070.stderr: -277> 2024-09-12T00:58:50.621+0000 7feec38b09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:50.955 INFO:tasks.workunit.client.0.smithi070.stderr: -276> 2024-09-12T00:58:50.621+0000 7feec38b09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:50.955 INFO:tasks.workunit.client.0.smithi070.stderr: -275> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command rotate-key cmddesc rotate-key hook 0x7ffef98881d8 EEXIST 2024-09-12T00:58:50.955 INFO:tasks.workunit.client.0.smithi070.stderr: -274> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient: _reopen_session rank -1 2024-09-12T00:58:50.955 INFO:tasks.workunit.client.0.smithi070.stderr: -273> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:58:50.955 INFO:tasks.workunit.client.0.smithi070.stderr: -272> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): picked mon.noname-b con 0x561556d7f2a0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:58:50.955 INFO:tasks.workunit.client.0.smithi070.stderr: -271> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): picked mon.noname-a con 0x561556d7a690 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:58:50.955 INFO:tasks.workunit.client.0.smithi070.stderr: -270> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): picked mon.noname-c con 0x561556d70ea0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:58:50.955 INFO:tasks.workunit.client.0.smithi070.stderr: -269> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:50.955 INFO:tasks.workunit.client.0.smithi070.stderr: -268> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:50.956 INFO:tasks.workunit.client.0.smithi070.stderr: -267> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:50.956 INFO:tasks.workunit.client.0.smithi070.stderr: -266> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): _renew_subs 2024-09-12T00:58:50.956 INFO:tasks.workunit.client.0.smithi070.stderr: -265> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): authenticate will time out at 2381.069164s 2024-09-12T00:58:50.956 INFO:tasks.workunit.client.0.smithi070.stderr: -264> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): get_auth_request con 0x561556d70ea0 auth_method 0 2024-09-12T00:58:50.956 INFO:tasks.workunit.client.0.smithi070.stderr: -263> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:50.956 INFO:tasks.workunit.client.0.smithi070.stderr: -262> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:50.956 INFO:tasks.workunit.client.0.smithi070.stderr: -261> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:50.956 INFO:tasks.workunit.client.0.smithi070.stderr: -260> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): get_auth_request con 0x561556d7a690 auth_method 0 2024-09-12T00:58:50.956 INFO:tasks.workunit.client.0.smithi070.stderr: -259> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:50.956 INFO:tasks.workunit.client.0.smithi070.stderr: -258> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:50.956 INFO:tasks.workunit.client.0.smithi070.stderr: -257> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:50.956 INFO:tasks.workunit.client.0.smithi070.stderr: -256> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:50.956 INFO:tasks.workunit.client.0.smithi070.stderr: -255> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:50.956 INFO:tasks.workunit.client.0.smithi070.stderr: -254> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:50.956 INFO:tasks.workunit.client.0.smithi070.stderr: -253> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:50.957 INFO:tasks.workunit.client.0.smithi070.stderr: -252> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:50.957 INFO:tasks.workunit.client.0.smithi070.stderr: -251> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:50.957 INFO:tasks.workunit.client.0.smithi070.stderr: -250> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): handle_auth_done global_id 7670 payload 274 2024-09-12T00:58:50.957 INFO:tasks.workunit.client.0.smithi070.stderr: -249> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient: _finish_hunting 0 2024-09-12T00:58:50.957 INFO:tasks.workunit.client.0.smithi070.stderr: -248> 2024-09-12T00:58:50.621+0000 7feec1bb7640 1 monclient: found mon.noname-c 2024-09-12T00:58:50.957 INFO:tasks.workunit.client.0.smithi070.stderr: -247> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:58:50.957 INFO:tasks.workunit.client.0.smithi070.stderr: -246> 2024-09-12T00:58:50.621+0000 7feda4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:50.957 INFO:tasks.workunit.client.0.smithi070.stderr: -245> 2024-09-12T00:58:50.621+0000 7feda4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:58:50.957 INFO:tasks.workunit.client.0.smithi070.stderr: -244> 2024-09-12T00:58:50.621+0000 7feda4ff9640 10 monclient: dump: 2024-09-12T00:58:50.957 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:50.957 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:50.957 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:50.957 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:50.958 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:50.958 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:50.958 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:50.958 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:50.958 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:50.958 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:50.958 INFO:tasks.workunit.client.0.smithi070.stderr: -243> 2024-09-12T00:58:50.621+0000 7feda4ff9640 10 monclient: _finish_auth 0 2024-09-12T00:58:50.958 INFO:tasks.workunit.client.0.smithi070.stderr: -242> 2024-09-12T00:58:50.621+0000 7feda4ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:58:50.958 INFO:tasks.workunit.client.0.smithi070.stderr: -241> 2024-09-12T00:58:50.621+0000 7feda4ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:58:50.958 INFO:tasks.workunit.client.0.smithi070.stderr: -240> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 monclient: authenticate success, global_id 7670 2024-09-12T00:58:50.958 INFO:tasks.workunit.client.0.smithi070.stderr: -239> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient: get_monmap_and_config success 2024-09-12T00:58:50.958 INFO:tasks.workunit.client.0.smithi070.stderr: -238> 2024-09-12T00:58:50.621+0000 7feec38b09c0 4 set_mon_vals no callback set 2024-09-12T00:58:50.958 INFO:tasks.workunit.client.0.smithi070.stderr: -237> 2024-09-12T00:58:50.621+0000 7feda4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:50.958 INFO:tasks.workunit.client.0.smithi070.stderr: -236> 2024-09-12T00:58:50.621+0000 7feda4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:58:50.958 INFO:tasks.workunit.client.0.smithi070.stderr: -235> 2024-09-12T00:58:50.621+0000 7feda4ff9640 10 monclient: dump: 2024-09-12T00:58:50.959 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:50.959 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:50.959 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:50.959 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:50.959 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:50.959 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:50.959 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:50.959 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:50.959 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:50.959 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:50.959 INFO:tasks.workunit.client.0.smithi070.stderr: -234> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient: shutdown 2024-09-12T00:58:50.959 INFO:tasks.workunit.client.0.smithi070.stderr: -233> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient: build_initial_monmap 2024-09-12T00:58:50.959 INFO:tasks.workunit.client.0.smithi070.stderr: -232> 2024-09-12T00:58:50.621+0000 7feec38b09c0 1 build_initial for_mkfs: 0 2024-09-12T00:58:50.959 INFO:tasks.workunit.client.0.smithi070.stderr: -231> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient: monmap: 2024-09-12T00:58:50.960 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:58:50.960 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:58:50.960 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:58:50.960 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:58:50.960 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:58:50.960 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:50.960 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:58:50.960 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:58:50.960 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:58:50.960 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:50.960 INFO:tasks.workunit.client.0.smithi070.stderr: -230> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding auth protocol: cephx 2024-09-12T00:58:50.960 INFO:tasks.workunit.client.0.smithi070.stderr: -229> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding auth protocol: cephx 2024-09-12T00:58:50.960 INFO:tasks.workunit.client.0.smithi070.stderr: -228> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding auth protocol: cephx 2024-09-12T00:58:50.960 INFO:tasks.workunit.client.0.smithi070.stderr: -227> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding con mode: secure 2024-09-12T00:58:50.961 INFO:tasks.workunit.client.0.smithi070.stderr: -226> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding con mode: crc 2024-09-12T00:58:50.961 INFO:tasks.workunit.client.0.smithi070.stderr: -225> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding con mode: secure 2024-09-12T00:58:50.961 INFO:tasks.workunit.client.0.smithi070.stderr: -224> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding con mode: crc 2024-09-12T00:58:50.961 INFO:tasks.workunit.client.0.smithi070.stderr: -223> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding con mode: secure 2024-09-12T00:58:50.961 INFO:tasks.workunit.client.0.smithi070.stderr: -222> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding con mode: crc 2024-09-12T00:58:50.961 INFO:tasks.workunit.client.0.smithi070.stderr: -221> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding con mode: crc 2024-09-12T00:58:50.961 INFO:tasks.workunit.client.0.smithi070.stderr: -220> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding con mode: secure 2024-09-12T00:58:50.961 INFO:tasks.workunit.client.0.smithi070.stderr: -219> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding con mode: crc 2024-09-12T00:58:50.961 INFO:tasks.workunit.client.0.smithi070.stderr: -218> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding con mode: secure 2024-09-12T00:58:50.961 INFO:tasks.workunit.client.0.smithi070.stderr: -217> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding con mode: crc 2024-09-12T00:58:50.961 INFO:tasks.workunit.client.0.smithi070.stderr: -216> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding con mode: secure 2024-09-12T00:58:50.961 INFO:tasks.workunit.client.0.smithi070.stderr: -215> 2024-09-12T00:58:50.621+0000 7feec38b09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:50.961 INFO:tasks.workunit.client.0.smithi070.stderr: -214> 2024-09-12T00:58:50.621+0000 7feec38b09c0 1 librados: starting msgr at 2024-09-12T00:58:50.961 INFO:tasks.workunit.client.0.smithi070.stderr: -213> 2024-09-12T00:58:50.621+0000 7feec38b09c0 1 librados: starting objecter 2024-09-12T00:58:50.962 INFO:tasks.workunit.client.0.smithi070.stderr: -212> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command objecter_requests cmddesc objecter_requests hook 0x561556d30010 EEXIST 2024-09-12T00:58:50.962 INFO:tasks.workunit.client.0.smithi070.stderr: -211> 2024-09-12T00:58:50.621+0000 7feec38b09c0 1 librados: setting wanted keys 2024-09-12T00:58:50.962 INFO:tasks.workunit.client.0.smithi070.stderr: -210> 2024-09-12T00:58:50.621+0000 7feec38b09c0 1 librados: calling monclient init 2024-09-12T00:58:50.962 INFO:tasks.workunit.client.0.smithi070.stderr: -209> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient: init 2024-09-12T00:58:50.962 INFO:tasks.workunit.client.0.smithi070.stderr: -208> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding auth protocol: cephx 2024-09-12T00:58:50.962 INFO:tasks.workunit.client.0.smithi070.stderr: -207> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding auth protocol: cephx 2024-09-12T00:58:50.962 INFO:tasks.workunit.client.0.smithi070.stderr: -206> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding auth protocol: cephx 2024-09-12T00:58:50.962 INFO:tasks.workunit.client.0.smithi070.stderr: -205> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding con mode: secure 2024-09-12T00:58:50.962 INFO:tasks.workunit.client.0.smithi070.stderr: -204> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding con mode: crc 2024-09-12T00:58:50.962 INFO:tasks.workunit.client.0.smithi070.stderr: -203> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding con mode: secure 2024-09-12T00:58:50.962 INFO:tasks.workunit.client.0.smithi070.stderr: -202> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding con mode: crc 2024-09-12T00:58:50.962 INFO:tasks.workunit.client.0.smithi070.stderr: -201> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding con mode: secure 2024-09-12T00:58:50.962 INFO:tasks.workunit.client.0.smithi070.stderr: -200> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding con mode: crc 2024-09-12T00:58:50.962 INFO:tasks.workunit.client.0.smithi070.stderr: -199> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding con mode: crc 2024-09-12T00:58:50.963 INFO:tasks.workunit.client.0.smithi070.stderr: -198> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding con mode: secure 2024-09-12T00:58:50.963 INFO:tasks.workunit.client.0.smithi070.stderr: -197> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding con mode: crc 2024-09-12T00:58:50.963 INFO:tasks.workunit.client.0.smithi070.stderr: -196> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding con mode: secure 2024-09-12T00:58:50.963 INFO:tasks.workunit.client.0.smithi070.stderr: -195> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding con mode: crc 2024-09-12T00:58:50.963 INFO:tasks.workunit.client.0.smithi070.stderr: -194> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding con mode: secure 2024-09-12T00:58:50.963 INFO:tasks.workunit.client.0.smithi070.stderr: -193> 2024-09-12T00:58:50.621+0000 7feec38b09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:50.963 INFO:tasks.workunit.client.0.smithi070.stderr: -192> 2024-09-12T00:58:50.621+0000 7feec38b09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:50.963 INFO:tasks.workunit.client.0.smithi070.stderr: -191> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command rotate-key cmddesc rotate-key hook 0x561556d2d368 EEXIST 2024-09-12T00:58:50.963 INFO:tasks.workunit.client.0.smithi070.stderr: -190> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient: _reopen_session rank -1 2024-09-12T00:58:50.963 INFO:tasks.workunit.client.0.smithi070.stderr: -189> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:58:50.963 INFO:tasks.workunit.client.0.smithi070.stderr: -188> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): picked mon.noname-b con 0x561556d70ea0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:58:50.963 INFO:tasks.workunit.client.0.smithi070.stderr: -187> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): picked mon.noname-a con 0x561556d7a690 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:58:50.963 INFO:tasks.workunit.client.0.smithi070.stderr: -186> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): picked mon.noname-c con 0x561556d7f2a0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:58:50.964 INFO:tasks.workunit.client.0.smithi070.stderr: -185> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:50.964 INFO:tasks.workunit.client.0.smithi070.stderr: -184> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:50.964 INFO:tasks.workunit.client.0.smithi070.stderr: -183> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:50.964 INFO:tasks.workunit.client.0.smithi070.stderr: -182> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): _renew_subs 2024-09-12T00:58:50.964 INFO:tasks.workunit.client.0.smithi070.stderr: -181> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): authenticate will time out at 2381.071649s 2024-09-12T00:58:50.964 INFO:tasks.workunit.client.0.smithi070.stderr: -180> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): get_auth_request con 0x561556d7a690 auth_method 0 2024-09-12T00:58:50.964 INFO:tasks.workunit.client.0.smithi070.stderr: -179> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:50.964 INFO:tasks.workunit.client.0.smithi070.stderr: -178> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:50.964 INFO:tasks.workunit.client.0.smithi070.stderr: -177> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:50.964 INFO:tasks.workunit.client.0.smithi070.stderr: -176> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): get_auth_request con 0x561556d7f2a0 auth_method 0 2024-09-12T00:58:50.964 INFO:tasks.workunit.client.0.smithi070.stderr: -175> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:50.964 INFO:tasks.workunit.client.0.smithi070.stderr: -174> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:50.964 INFO:tasks.workunit.client.0.smithi070.stderr: -173> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:50.965 INFO:tasks.workunit.client.0.smithi070.stderr: -172> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:50.965 INFO:tasks.workunit.client.0.smithi070.stderr: -171> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:50.965 INFO:tasks.workunit.client.0.smithi070.stderr: -170> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:50.965 INFO:tasks.workunit.client.0.smithi070.stderr: -169> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:50.965 INFO:tasks.workunit.client.0.smithi070.stderr: -168> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:50.965 INFO:tasks.workunit.client.0.smithi070.stderr: -167> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:50.965 INFO:tasks.workunit.client.0.smithi070.stderr: -166> 2024-09-12T00:58:50.621+0000 7feec13b6640 10 monclient(hunting): get_auth_request con 0x561556d70ea0 auth_method 0 2024-09-12T00:58:50.965 INFO:tasks.workunit.client.0.smithi070.stderr: -165> 2024-09-12T00:58:50.621+0000 7feec13b6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:50.965 INFO:tasks.workunit.client.0.smithi070.stderr: -164> 2024-09-12T00:58:50.621+0000 7feec13b6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:50.965 INFO:tasks.workunit.client.0.smithi070.stderr: -163> 2024-09-12T00:58:50.621+0000 7feec13b6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:50.965 INFO:tasks.workunit.client.0.smithi070.stderr: -162> 2024-09-12T00:58:50.625+0000 7feec1bb7640 10 monclient(hunting): handle_auth_done global_id 7673 payload 824 2024-09-12T00:58:50.965 INFO:tasks.workunit.client.0.smithi070.stderr: -161> 2024-09-12T00:58:50.625+0000 7feec1bb7640 10 monclient: _finish_hunting 0 2024-09-12T00:58:50.965 INFO:tasks.workunit.client.0.smithi070.stderr: -160> 2024-09-12T00:58:50.625+0000 7feec1bb7640 1 monclient: found mon.noname-c 2024-09-12T00:58:50.966 INFO:tasks.workunit.client.0.smithi070.stderr: -159> 2024-09-12T00:58:50.625+0000 7feec1bb7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:58:50.966 INFO:tasks.workunit.client.0.smithi070.stderr: -158> 2024-09-12T00:58:50.625+0000 7fed92ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:50.966 INFO:tasks.workunit.client.0.smithi070.stderr: -157> 2024-09-12T00:58:50.625+0000 7fed92ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:58:50.966 INFO:tasks.workunit.client.0.smithi070.stderr: -156> 2024-09-12T00:58:50.625+0000 7fed92ffd640 10 monclient: dump: 2024-09-12T00:58:50.966 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:50.966 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:50.966 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:50.966 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:50.966 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:50.966 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:50.966 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:50.966 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:50.966 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:50.967 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:50.967 INFO:tasks.workunit.client.0.smithi070.stderr: -155> 2024-09-12T00:58:50.625+0000 7fed92ffd640 10 monclient: _finish_auth 0 2024-09-12T00:58:50.967 INFO:tasks.workunit.client.0.smithi070.stderr: -154> 2024-09-12T00:58:50.625+0000 7fed92ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:58:50.967 INFO:tasks.workunit.client.0.smithi070.stderr: -153> 2024-09-12T00:58:50.625+0000 7fed92ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:58:50.967 INFO:tasks.workunit.client.0.smithi070.stderr: -152> 2024-09-12T00:58:50.625+0000 7fed92ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:50.967 INFO:tasks.workunit.client.0.smithi070.stderr: -151> 2024-09-12T00:58:50.625+0000 7fed92ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:58:50.967 INFO:tasks.workunit.client.0.smithi070.stderr: -150> 2024-09-12T00:58:50.625+0000 7fed92ffd640 10 monclient: dump: 2024-09-12T00:58:50.967 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:50.967 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:50.967 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:50.967 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:50.967 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:50.967 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:50.967 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:50.968 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:50.968 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:50.968 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:50.968 INFO:tasks.workunit.client.0.smithi070.stderr: -149> 2024-09-12T00:58:50.625+0000 7feec38b09c0 5 monclient: authenticate success, global_id 7673 2024-09-12T00:58:50.968 INFO:tasks.workunit.client.0.smithi070.stderr: -148> 2024-09-12T00:58:50.625+0000 7feec38b09c0 10 monclient: _renew_subs 2024-09-12T00:58:50.968 INFO:tasks.workunit.client.0.smithi070.stderr: -147> 2024-09-12T00:58:50.625+0000 7feda4ff9640 4 set_mon_vals no callback set 2024-09-12T00:58:50.968 INFO:tasks.workunit.client.0.smithi070.stderr: -146> 2024-09-12T00:58:50.625+0000 7feec38b09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:58:50.968 INFO:tasks.workunit.client.0.smithi070.stderr: -145> 2024-09-12T00:58:50.625+0000 7feec38b09c0 10 monclient: _renew_subs 2024-09-12T00:58:50.968 INFO:tasks.workunit.client.0.smithi070.stderr: -144> 2024-09-12T00:58:50.625+0000 7feec38b09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:58:50.968 INFO:tasks.workunit.client.0.smithi070.stderr: -143> 2024-09-12T00:58:50.625+0000 7feec38b09c0 1 librados: init done 2024-09-12T00:58:50.968 INFO:tasks.workunit.client.0.smithi070.stderr: -142> 2024-09-12T00:58:50.625+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command cr dump hook 0x561556d71838 2024-09-12T00:58:50.968 INFO:tasks.workunit.client.0.smithi070.stderr: -141> 2024-09-12T00:58:50.625+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.969 INFO:tasks.workunit.client.0.smithi070.stderr: -140> 2024-09-12T00:58:50.625+0000 7fed92ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:58:50.969 INFO:tasks.workunit.client.0.smithi070.stderr: -139> 2024-09-12T00:58:50.625+0000 7fed92ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:58:50.969 INFO:tasks.workunit.client.0.smithi070.stderr: -138> 2024-09-12T00:58:50.625+0000 7fed92ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:58:50.969 INFO:tasks.workunit.client.0.smithi070.stderr: -137> 2024-09-12T00:58:50.625+0000 7feec13b6640 10 monclient: get_auth_request con 0x7fed8c070ae0 auth_method 0 2024-09-12T00:58:50.969 INFO:tasks.workunit.client.0.smithi070.stderr: -136> 2024-09-12T00:58:50.625+0000 7feec0bb5640 10 monclient: get_auth_request con 0x561556d98c40 auth_method 0 2024-09-12T00:58:50.969 INFO:tasks.workunit.client.0.smithi070.stderr: -135> 2024-09-12T00:58:50.625+0000 7feec38b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.969 INFO:tasks.workunit.client.0.smithi070.stderr: -134> 2024-09-12T00:58:50.625+0000 7feec38b09c0 20 realm 2024-09-12T00:58:50.969 INFO:tasks.workunit.client.0.smithi070.stderr: -133> 2024-09-12T00:58:50.625+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.969 INFO:tasks.workunit.client.0.smithi070.stderr: -132> 2024-09-12T00:58:50.625+0000 7feec38b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.969 INFO:tasks.workunit.client.0.smithi070.stderr: -131> 2024-09-12T00:58:50.625+0000 7feec38b09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:50.969 INFO:tasks.workunit.client.0.smithi070.stderr: -130> 2024-09-12T00:58:50.625+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.969 INFO:tasks.workunit.client.0.smithi070.stderr: -129> 2024-09-12T00:58:50.625+0000 7feec38b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.969 INFO:tasks.workunit.client.0.smithi070.stderr: -128> 2024-09-12T00:58:50.625+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.970 INFO:tasks.workunit.client.0.smithi070.stderr: -127> 2024-09-12T00:58:50.629+0000 7feec13b6640 10 monclient: get_auth_request con 0x561556d9ce70 auth_method 0 2024-09-12T00:58:50.970 INFO:tasks.workunit.client.0.smithi070.stderr: -126> 2024-09-12T00:58:50.629+0000 7feec38b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:50.970 INFO:tasks.workunit.client.0.smithi070.stderr: -125> 2024-09-12T00:58:50.629+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.970 INFO:tasks.workunit.client.0.smithi070.stderr: -124> 2024-09-12T00:58:50.629+0000 7feec0bb5640 10 monclient: get_auth_request con 0x561556da06f0 auth_method 0 2024-09-12T00:58:50.970 INFO:tasks.workunit.client.0.smithi070.stderr: -123> 2024-09-12T00:58:50.629+0000 7fed92ffd640 1 client.7673.objecter ms_handle_reset 0x561556da06f0 session 0x561556d9c1c0 osd.0 2024-09-12T00:58:50.970 INFO:tasks.workunit.client.0.smithi070.stderr: -122> 2024-09-12T00:58:50.629+0000 7fed92ffd640 10 monclient: _renew_subs 2024-09-12T00:58:50.970 INFO:tasks.workunit.client.0.smithi070.stderr: -121> 2024-09-12T00:58:50.629+0000 7fed92ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:58:50.970 INFO:tasks.workunit.client.0.smithi070.stderr: -120> 2024-09-12T00:58:50.629+0000 7feec0bb5640 10 monclient: get_auth_request con 0x7fed8c080880 auth_method 0 2024-09-12T00:58:50.970 INFO:tasks.workunit.client.0.smithi070.stderr: -119> 2024-09-12T00:58:50.629+0000 7feec38b09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:50.970 INFO:tasks.workunit.client.0.smithi070.stderr: -118> 2024-09-12T00:58:50.629+0000 7feec38b09c0 20 searching for the correct realm 2024-09-12T00:58:50.970 INFO:tasks.workunit.client.0.smithi070.stderr: -117> 2024-09-12T00:58:50.629+0000 7feec1bb7640 10 monclient: get_auth_request con 0x561556da27c0 auth_method 0 2024-09-12T00:58:50.970 INFO:tasks.workunit.client.0.smithi070.stderr: -116> 2024-09-12T00:58:50.633+0000 7feec13b6640 10 monclient: get_auth_request con 0x7feebc026060 auth_method 0 2024-09-12T00:58:50.970 INFO:tasks.workunit.client.0.smithi070.stderr: -115> 2024-09-12T00:58:50.633+0000 7feec0bb5640 10 monclient: get_auth_request con 0x7feeb401a040 auth_method 0 2024-09-12T00:58:50.970 INFO:tasks.workunit.client.0.smithi070.stderr: -114> 2024-09-12T00:58:50.633+0000 7feec1bb7640 10 monclient: get_auth_request con 0x7feeb80e2c50 auth_method 0 2024-09-12T00:58:50.971 INFO:tasks.workunit.client.0.smithi070.stderr: -113> 2024-09-12T00:58:50.633+0000 7feec1bb7640 0 -- 172.21.15.70:0/792736637 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7feeb80e2c50 msgr2=0x7feeb80dc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:58:50.971 INFO:tasks.workunit.client.0.smithi070.stderr: -112> 2024-09-12T00:58:50.837+0000 7feec1bb7640 10 monclient: get_auth_request con 0x7feeb80e2c50 auth_method 0 2024-09-12T00:58:50.971 INFO:tasks.workunit.client.0.smithi070.stderr: -111> 2024-09-12T00:58:50.841+0000 7feec13b6640 10 monclient: get_auth_request con 0x7feebc0695c0 auth_method 0 2024-09-12T00:58:50.971 INFO:tasks.workunit.client.0.smithi070.stderr: -110> 2024-09-12T00:58:50.849+0000 7feec1bb7640 0 -- 172.21.15.70:0/792736637 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7feeb80e2c50 msgr2=0x7feeb80dc9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:50.971 INFO:tasks.workunit.client.0.smithi070.stderr: -109> 2024-09-12T00:58:50.849+0000 7fed92ffd640 1 client.7673.objecter ms_handle_reset 0x7feeb80e2c50 session 0x7feeb80e3040 osd.4 2024-09-12T00:58:50.971 INFO:tasks.workunit.client.0.smithi070.stderr: -108> 2024-09-12T00:58:50.849+0000 7feec1bb7640 10 monclient: get_auth_request con 0x561556da06f0 auth_method 0 2024-09-12T00:58:50.971 INFO:tasks.workunit.client.0.smithi070.stderr: -107> 2024-09-12T00:58:50.861+0000 7feec38b09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:50.971 INFO:tasks.workunit.client.0.smithi070.stderr: -106> 2024-09-12T00:58:50.861+0000 7feec38b09c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:58:50.971 INFO:tasks.workunit.client.0.smithi070.stderr: -105> 2024-09-12T00:58:50.861+0000 7feec38b09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:50.971 INFO:tasks.workunit.client.0.smithi070.stderr: -104> 2024-09-12T00:58:50.861+0000 7feec38b09c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:58:50.971 INFO:tasks.workunit.client.0.smithi070.stderr: -103> 2024-09-12T00:58:50.861+0000 7feec38b09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:50.971 INFO:tasks.workunit.client.0.smithi070.stderr: -102> 2024-09-12T00:58:50.861+0000 7feec38b09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:50.971 INFO:tasks.workunit.client.0.smithi070.stderr: -101> 2024-09-12T00:58:50.861+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.971 INFO:tasks.workunit.client.0.smithi070.stderr: -100> 2024-09-12T00:58:50.861+0000 7feec38b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.972 INFO:tasks.workunit.client.0.smithi070.stderr: -99> 2024-09-12T00:58:50.861+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.972 INFO:tasks.workunit.client.0.smithi070.stderr: -98> 2024-09-12T00:58:50.861+0000 7feec38b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:50.972 INFO:tasks.workunit.client.0.smithi070.stderr: -97> 2024-09-12T00:58:50.861+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.972 INFO:tasks.workunit.client.0.smithi070.stderr: -96> 2024-09-12T00:58:50.865+0000 7feec38b09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:50.972 INFO:tasks.workunit.client.0.smithi070.stderr: -95> 2024-09-12T00:58:50.865+0000 7feec38b09c0 20 zone default found 2024-09-12T00:58:50.972 INFO:tasks.workunit.client.0.smithi070.stderr: -94> 2024-09-12T00:58:50.865+0000 7feec38b09c0 4 Realm: () 2024-09-12T00:58:50.972 INFO:tasks.workunit.client.0.smithi070.stderr: -93> 2024-09-12T00:58:50.865+0000 7feec38b09c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:58:50.972 INFO:tasks.workunit.client.0.smithi070.stderr: -92> 2024-09-12T00:58:50.865+0000 7feec38b09c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:58:50.972 INFO:tasks.workunit.client.0.smithi070.stderr: -91> 2024-09-12T00:58:50.865+0000 7feec38b09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:50.972 INFO:tasks.workunit.client.0.smithi070.stderr: -90> 2024-09-12T00:58:50.865+0000 7feec38b09c0 20 zonegroup default 2024-09-12T00:58:50.972 INFO:tasks.workunit.client.0.smithi070.stderr: -89> 2024-09-12T00:58:50.865+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.972 INFO:tasks.workunit.client.0.smithi070.stderr: -88> 2024-09-12T00:58:50.865+0000 7feec38b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.972 INFO:tasks.workunit.client.0.smithi070.stderr: -87> 2024-09-12T00:58:50.865+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.973 INFO:tasks.workunit.client.0.smithi070.stderr: -86> 2024-09-12T00:58:50.865+0000 7feec38b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.973 INFO:tasks.workunit.client.0.smithi070.stderr: -85> 2024-09-12T00:58:50.865+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.973 INFO:tasks.workunit.client.0.smithi070.stderr: -84> 2024-09-12T00:58:50.865+0000 7feec38b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:50.973 INFO:tasks.workunit.client.0.smithi070.stderr: -83> 2024-09-12T00:58:50.865+0000 7feec38b09c0 20 started sync module instance, tier type = 2024-09-12T00:58:50.973 INFO:tasks.workunit.client.0.smithi070.stderr: -82> 2024-09-12T00:58:50.865+0000 7feec38b09c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:58:50.973 INFO:tasks.workunit.client.0.smithi070.stderr: -81> 2024-09-12T00:58:50.889+0000 7feec38b09c0 20 add_watcher() i=0 2024-09-12T00:58:50.973 INFO:tasks.workunit.client.0.smithi070.stderr: -80> 2024-09-12T00:58:50.889+0000 7feec38b09c0 20 add_watcher() i=1 2024-09-12T00:58:50.973 INFO:tasks.workunit.client.0.smithi070.stderr: -79> 2024-09-12T00:58:50.889+0000 7feec38b09c0 20 add_watcher() i=2 2024-09-12T00:58:50.973 INFO:tasks.workunit.client.0.smithi070.stderr: -78> 2024-09-12T00:58:50.889+0000 7feec38b09c0 20 add_watcher() i=3 2024-09-12T00:58:50.973 INFO:tasks.workunit.client.0.smithi070.stderr: -77> 2024-09-12T00:58:50.889+0000 7feec38b09c0 20 add_watcher() i=4 2024-09-12T00:58:50.973 INFO:tasks.workunit.client.0.smithi070.stderr: -76> 2024-09-12T00:58:50.889+0000 7feec38b09c0 20 add_watcher() i=5 2024-09-12T00:58:50.973 INFO:tasks.workunit.client.0.smithi070.stderr: -75> 2024-09-12T00:58:50.889+0000 7feec38b09c0 20 add_watcher() i=6 2024-09-12T00:58:50.973 INFO:tasks.workunit.client.0.smithi070.stderr: -74> 2024-09-12T00:58:50.889+0000 7feec38b09c0 20 add_watcher() i=7 2024-09-12T00:58:50.973 INFO:tasks.workunit.client.0.smithi070.stderr: -73> 2024-09-12T00:58:50.889+0000 7feec38b09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:50.974 INFO:tasks.workunit.client.0.smithi070.stderr: -72> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding auth protocol: cephx 2024-09-12T00:58:50.974 INFO:tasks.workunit.client.0.smithi070.stderr: -71> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding auth protocol: cephx 2024-09-12T00:58:50.974 INFO:tasks.workunit.client.0.smithi070.stderr: -70> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding auth protocol: cephx 2024-09-12T00:58:50.974 INFO:tasks.workunit.client.0.smithi070.stderr: -69> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding con mode: secure 2024-09-12T00:58:50.974 INFO:tasks.workunit.client.0.smithi070.stderr: -68> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding con mode: crc 2024-09-12T00:58:50.974 INFO:tasks.workunit.client.0.smithi070.stderr: -67> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding con mode: secure 2024-09-12T00:58:50.974 INFO:tasks.workunit.client.0.smithi070.stderr: -66> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding con mode: crc 2024-09-12T00:58:50.974 INFO:tasks.workunit.client.0.smithi070.stderr: -65> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding con mode: secure 2024-09-12T00:58:50.974 INFO:tasks.workunit.client.0.smithi070.stderr: -64> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding con mode: crc 2024-09-12T00:58:50.974 INFO:tasks.workunit.client.0.smithi070.stderr: -63> 2024-09-12T00:58:50.893+0000 7fed777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:50.974 INFO:tasks.workunit.client.0.smithi070.stderr: -62> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding con mode: crc 2024-09-12T00:58:50.974 INFO:tasks.workunit.client.0.smithi070.stderr: -61> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding con mode: secure 2024-09-12T00:58:50.974 INFO:tasks.workunit.client.0.smithi070.stderr: -60> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding con mode: crc 2024-09-12T00:58:50.974 INFO:tasks.workunit.client.0.smithi070.stderr: -59> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding con mode: secure 2024-09-12T00:58:50.975 INFO:tasks.workunit.client.0.smithi070.stderr: -58> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding con mode: crc 2024-09-12T00:58:50.975 INFO:tasks.workunit.client.0.smithi070.stderr: -57> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding con mode: secure 2024-09-12T00:58:50.975 INFO:tasks.workunit.client.0.smithi070.stderr: -56> 2024-09-12T00:58:50.897+0000 7feec38b09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:50.975 INFO:tasks.workunit.client.0.smithi070.stderr: -55> 2024-09-12T00:58:50.897+0000 7feec38b09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:50.975 INFO:tasks.workunit.client.0.smithi070.stderr: -54> 2024-09-12T00:58:50.897+0000 7feec38b09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:50.975 INFO:tasks.workunit.client.0.smithi070.stderr: -53> 2024-09-12T00:58:50.897+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command cache list hook 0x561556d75000 2024-09-12T00:58:50.975 INFO:tasks.workunit.client.0.smithi070.stderr: -52> 2024-09-12T00:58:50.897+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command cache inspect hook 0x561556d75000 2024-09-12T00:58:50.975 INFO:tasks.workunit.client.0.smithi070.stderr: -51> 2024-09-12T00:58:50.897+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command cache erase hook 0x561556d75000 2024-09-12T00:58:50.975 INFO:tasks.workunit.client.0.smithi070.stderr: -50> 2024-09-12T00:58:50.897+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command cache zap hook 0x561556d75000 2024-09-12T00:58:50.975 INFO:tasks.workunit.client.0.smithi070.stderr: -49> 2024-09-12T00:58:50.897+0000 7feec38b09c0 5 note: GC not initialized 2024-09-12T00:58:50.975 INFO:tasks.workunit.client.0.smithi070.stderr: -48> 2024-09-12T00:58:50.897+0000 7fed767e4640 20 reqs_thread_entry: start 2024-09-12T00:58:50.975 INFO:tasks.workunit.client.0.smithi070.stderr: -47> 2024-09-12T00:58:50.897+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command sync trace show hook 0x7feeb4062040 2024-09-12T00:58:50.975 INFO:tasks.workunit.client.0.smithi070.stderr: -46> 2024-09-12T00:58:50.897+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command sync trace history hook 0x7feeb4062040 2024-09-12T00:58:50.975 INFO:tasks.workunit.client.0.smithi070.stderr: -45> 2024-09-12T00:58:50.897+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command sync trace active hook 0x7feeb4062040 2024-09-12T00:58:50.976 INFO:tasks.workunit.client.0.smithi070.stderr: -44> 2024-09-12T00:58:50.897+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command sync trace active_short hook 0x7feeb4062040 2024-09-12T00:58:50.976 INFO:tasks.workunit.client.0.smithi070.stderr: -43> 2024-09-12T00:58:50.897+0000 7feec38b09c0 20 init_complete bucket index max shards: 1 2024-09-12T00:58:50.976 INFO:tasks.workunit.client.0.smithi070.stderr: -42> 2024-09-12T00:58:50.897+0000 7feec38b09c0 20 Filter name: none 2024-09-12T00:58:50.976 INFO:tasks.workunit.client.0.smithi070.stderr: -41> 2024-09-12T00:58:50.897+0000 7fece7fff640 20 reqs_thread_entry: start 2024-09-12T00:58:50.976 INFO:tasks.workunit.client.0.smithi070.stderr: -40> 2024-09-12T00:58:50.897+0000 7feec38b09c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:58:50.976 INFO:tasks.workunit.client.0.smithi070.stderr: -39> 2024-09-12T00:58:50.897+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.976 INFO:tasks.workunit.client.0.smithi070.stderr: -38> 2024-09-12T00:58:50.897+0000 7feec38b09c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:58:50.976 INFO:tasks.workunit.client.0.smithi070.stderr: -37> 2024-09-12T00:58:50.897+0000 7feec38b09c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:58:50.976 INFO:tasks.workunit.client.0.smithi070.stderr: -36> 2024-09-12T00:58:50.897+0000 7feec38b09c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:58:50.976 INFO:tasks.workunit.client.0.smithi070.stderr: -35> 2024-09-12T00:58:50.897+0000 7feec38b09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : miss 2024-09-12T00:58:50.976 INFO:tasks.workunit.client.0.smithi070.stderr: -34> 2024-09-12T00:58:50.897+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:50.976 INFO:tasks.workunit.client.0.smithi070.stderr: -33> 2024-09-12T00:58:50.901+0000 7feec38b09c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:58:50.976 INFO:tasks.workunit.client.0.smithi070.stderr: -32> 2024-09-12T00:58:50.901+0000 7feec38b09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:58:50.976 INFO:tasks.workunit.client.0.smithi070.stderr: -31> 2024-09-12T00:58:50.901+0000 7feec38b09c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:58:50.977 INFO:tasks.workunit.client.0.smithi070.stderr: -30> 2024-09-12T00:58:50.901+0000 7feec38b09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:58:50.977 INFO:tasks.workunit.client.0.smithi070.stderr: -29> 2024-09-12T00:58:50.901+0000 7feec38b09c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:58:50.977 INFO:tasks.workunit.client.0.smithi070.stderr: -28> 2024-09-12T00:58:50.901+0000 7feec38b09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T00:58:50.977 INFO:tasks.workunit.client.0.smithi070.stderr: -27> 2024-09-12T00:58:50.909+0000 7feec38b09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:58:50.977 INFO:tasks.workunit.client.0.smithi070.stderr: -26> 2024-09-12T00:58:50.909+0000 7feec38b09c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:58:50.977 INFO:tasks.workunit.client.0.smithi070.stderr: -25> 2024-09-12T00:58:50.909+0000 7feec38b09c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:58:50.977 INFO:tasks.workunit.client.0.smithi070.stderr: -24> 2024-09-12T00:58:50.909+0000 7feec38b09c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18, ofs0, ns] 2024-09-12T00:58:50.977 INFO:tasks.workunit.client.0.smithi070.stderr: -23> 2024-09-12T00:58:50.909+0000 7feda4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431645 cookie 94649651458576 notifier 7673 bl.length()=911 2024-09-12T00:58:50.977 INFO:tasks.workunit.client.0.smithi070.stderr: -22> 2024-09-12T00:58:50.909+0000 7feda4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:58:50.977 INFO:tasks.workunit.client.0.smithi070.stderr: -21> 2024-09-12T00:58:50.909+0000 7feda4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:58:50.977 INFO:tasks.workunit.client.0.smithi070.stderr: -20> 2024-09-12T00:58:50.909+0000 7feda4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:58:50.977 INFO:tasks.workunit.client.0.smithi070.stderr: -19> 2024-09-12T00:58:50.909+0000 7feec38b09c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_sources= new_sources= 2024-09-12T00:58:50.977 INFO:tasks.workunit.client.0.smithi070.stderr: -18> 2024-09-12T00:58:50.909+0000 7feec38b09c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential sources added=[] removed=[] 2024-09-12T00:58:50.978 INFO:tasks.workunit.client.0.smithi070.stderr: -17> 2024-09-12T00:58:50.909+0000 7feec38b09c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_dests= new_dests= 2024-09-12T00:58:50.978 INFO:tasks.workunit.client.0.smithi070.stderr: -16> 2024-09-12T00:58:50.909+0000 7feec38b09c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential dests added=[] removed=[] 2024-09-12T00:58:50.978 INFO:tasks.workunit.client.0.smithi070.stderr: -15> 2024-09-12T00:58:50.917+0000 7feec38b09c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.0 2024-09-12T00:58:50.978 INFO:tasks.workunit.client.0.smithi070.stderr: -14> 2024-09-12T00:58:50.917+0000 7feec38b09c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.0 2024-09-12T00:58:50.978 INFO:tasks.workunit.client.0.smithi070.stderr: -13> 2024-09-12T00:58:50.917+0000 7feec38b09c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.1 2024-09-12T00:58:50.978 INFO:tasks.workunit.client.0.smithi070.stderr: -12> 2024-09-12T00:58:50.917+0000 7feec38b09c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.1 2024-09-12T00:58:50.978 INFO:tasks.workunit.client.0.smithi070.stderr: -11> 2024-09-12T00:58:50.917+0000 7feec38b09c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.2 2024-09-12T00:58:50.978 INFO:tasks.workunit.client.0.smithi070.stderr: -10> 2024-09-12T00:58:50.917+0000 7feec38b09c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.2 2024-09-12T00:58:50.978 INFO:tasks.workunit.client.0.smithi070.stderr: -9> 2024-09-12T00:58:50.917+0000 7feec38b09c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.3 2024-09-12T00:58:50.978 INFO:tasks.workunit.client.0.smithi070.stderr: -8> 2024-09-12T00:58:50.917+0000 7feec38b09c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.3 2024-09-12T00:58:50.978 INFO:tasks.workunit.client.0.smithi070.stderr: -7> 2024-09-12T00:58:50.917+0000 7feec38b09c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.0 2024-09-12T00:58:50.978 INFO:tasks.workunit.client.0.smithi070.stderr: -6> 2024-09-12T00:58:50.917+0000 7feec38b09c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.0 2024-09-12T00:58:50.978 INFO:tasks.workunit.client.0.smithi070.stderr: -5> 2024-09-12T00:58:50.917+0000 7feec38b09c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.1 2024-09-12T00:58:50.978 INFO:tasks.workunit.client.0.smithi070.stderr: -4> 2024-09-12T00:58:50.917+0000 7feec38b09c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.1 2024-09-12T00:58:50.979 INFO:tasks.workunit.client.0.smithi070.stderr: -3> 2024-09-12T00:58:50.917+0000 7feec38b09c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.2 2024-09-12T00:58:50.979 INFO:tasks.workunit.client.0.smithi070.stderr: -2> 2024-09-12T00:58:50.917+0000 7feec38b09c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.2 2024-09-12T00:58:50.979 INFO:tasks.workunit.client.0.smithi070.stderr: -1> 2024-09-12T00:58:50.921+0000 7feec38b09c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7feec38b09c0 time 2024-09-12T00:58:50.925071+0000 2024-09-12T00:58:50.979 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:58:50.979 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:50.979 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:58:50.979 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7feec718a2eb] 2024-09-12T00:58:50.979 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7feec718a49f] 2024-09-12T00:58:50.979 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561553e65cc1] 2024-09-12T00:58:50.979 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x561553e7a01c] 2024-09-12T00:58:50.979 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561553e7b6a4] 2024-09-12T00:58:50.979 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:58:50.979 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7feec5ff0d90] 2024-09-12T00:58:50.980 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:58:50.980 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:58:50.980 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:50.980 INFO:tasks.workunit.client.0.smithi070.stderr: 0> 2024-09-12T00:58:50.925+0000 7feec38b09c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:58:50.980 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7feec38b09c0 thread_name:radosgw-admin 2024-09-12T00:58:50.980 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:50.980 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:58:50.980 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7feec6009520] 2024-09-12T00:58:50.980 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:58:50.980 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:58:50.980 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:58:50.980 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7feec718a345] 2024-09-12T00:58:50.980 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7feec718a49f] 2024-09-12T00:58:50.980 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561553e65cc1] 2024-09-12T00:58:50.981 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x561553e7a01c] 2024-09-12T00:58:50.981 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561553e7b6a4] 2024-09-12T00:58:50.981 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:58:50.981 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7feec5ff0d90] 2024-09-12T00:58:50.981 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:58:50.981 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:58:50.981 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:58:50.981 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:50.981 INFO:tasks.workunit.client.0.smithi070.stderr:--- logging levels --- 2024-09-12T00:58:50.981 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 none 2024-09-12T00:58:50.981 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 lockdep 2024-09-12T00:58:50.981 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 context 2024-09-12T00:58:50.981 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 crush 2024-09-12T00:58:50.981 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds 2024-09-12T00:58:50.982 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_balancer 2024-09-12T00:58:50.982 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_locker 2024-09-12T00:58:50.982 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log 2024-09-12T00:58:50.982 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log_expire 2024-09-12T00:58:50.982 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_migrator 2024-09-12T00:58:50.982 INFO:tasks.workunit.client.0.smithi070.stderr: 3/ 5 mds_quiesce 2024-09-12T00:58:50.982 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 buffer 2024-09-12T00:58:50.982 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 timer 2024-09-12T00:58:50.982 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 filer 2024-09-12T00:58:50.982 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 striper 2024-09-12T00:58:50.982 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 objecter 2024-09-12T00:58:50.982 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rados 2024-09-12T00:58:50.982 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd 2024-09-12T00:58:50.983 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_mirror 2024-09-12T00:58:50.983 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_replay 2024-09-12T00:58:50.983 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_pwl 2024-09-12T00:58:50.983 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 journaler 2024-09-12T00:58:50.983 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objectcacher 2024-09-12T00:58:50.983 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:58:50.983 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 client 2024-09-12T00:58:50.983 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 osd 2024-09-12T00:58:50.983 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 optracker 2024-09-12T00:58:50.984 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objclass 2024-09-12T00:58:50.984 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 filestore 2024-09-12T00:58:50.984 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 journal 2024-09-12T00:58:50.984 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 ms 2024-09-12T00:58:50.984 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mon 2024-09-12T00:58:50.984 INFO:tasks.workunit.client.0.smithi070.stderr: 0/10 monc 2024-09-12T00:58:50.984 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 paxos 2024-09-12T00:58:50.984 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 tp 2024-09-12T00:58:50.984 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 auth 2024-09-12T00:58:50.984 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 crypto 2024-09-12T00:58:50.984 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 finisher 2024-09-12T00:58:50.984 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 reserver 2024-09-12T00:58:50.984 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 heartbeatmap 2024-09-12T00:58:50.985 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 perfcounter 2024-09-12T00:58:50.985 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw 2024-09-12T00:58:50.985 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_sync 2024-09-12T00:58:50.985 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_datacache 2024-09-12T00:58:50.985 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_access 2024-09-12T00:58:50.985 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:58:50.985 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_flight 2024-09-12T00:58:50.985 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:58:50.985 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw_notification 2024-09-12T00:58:50.985 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 javaclient 2024-09-12T00:58:50.985 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 asok 2024-09-12T00:58:50.985 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 throttle 2024-09-12T00:58:50.985 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 refs 2024-09-12T00:58:50.985 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 compressor 2024-09-12T00:58:50.986 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluestore 2024-09-12T00:58:50.986 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluefs 2024-09-12T00:58:50.986 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 bdev 2024-09-12T00:58:50.986 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 kstore 2024-09-12T00:58:50.986 INFO:tasks.workunit.client.0.smithi070.stderr: 4/ 5 rocksdb 2024-09-12T00:58:50.986 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 fuse 2024-09-12T00:58:50.986 INFO:tasks.workunit.client.0.smithi070.stderr: 2/ 5 mgr 2024-09-12T00:58:50.986 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mgrc 2024-09-12T00:58:50.986 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 dpdk 2024-09-12T00:58:50.986 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 eventtrace 2024-09-12T00:58:50.986 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 prioritycache 2024-09-12T00:58:50.986 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 test 2024-09-12T00:58:50.987 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:58:50.987 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephsqlite 2024-09-12T00:58:50.987 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:58:50.987 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore 2024-09-12T00:58:50.987 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_onode 2024-09-12T00:58:50.987 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_odata 2024-09-12T00:58:50.987 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_omap 2024-09-12T00:58:50.987 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_tm 2024-09-12T00:58:50.987 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_t 2024-09-12T00:58:50.987 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:58:50.987 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_epm 2024-09-12T00:58:50.987 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_lba 2024-09-12T00:58:50.987 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:58:50.987 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cache 2024-09-12T00:58:50.988 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_journal 2024-09-12T00:58:50.988 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_device 2024-09-12T00:58:50.988 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_backref 2024-09-12T00:58:50.988 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 alienstore 2024-09-12T00:58:50.988 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mclock 2024-09-12T00:58:50.988 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cyanstore 2024-09-12T00:58:50.988 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 ceph_exporter 2024-09-12T00:58:50.988 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 memstore 2024-09-12T00:58:50.988 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 trace 2024-09-12T00:58:50.988 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 ceph_dedup 2024-09-12T00:58:50.988 INFO:tasks.workunit.client.0.smithi070.stderr: -2/-2 (syslog threshold) 2024-09-12T00:58:50.988 INFO:tasks.workunit.client.0.smithi070.stderr: 99/99 (stderr threshold) 2024-09-12T00:58:50.988 INFO:tasks.workunit.client.0.smithi070.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:58:50.988 INFO:tasks.workunit.client.0.smithi070.stderr: 7fece7fff640 / http_manager 2024-09-12T00:58:50.989 INFO:tasks.workunit.client.0.smithi070.stderr: 7fed767e4640 / http_manager 2024-09-12T00:58:50.989 INFO:tasks.workunit.client.0.smithi070.stderr: 7fed777e6640 / rgw_dt_lg_renew 2024-09-12T00:58:50.989 INFO:tasks.workunit.client.0.smithi070.stderr: 7fed92ffd640 / ms_dispatch 2024-09-12T00:58:50.989 INFO:tasks.workunit.client.0.smithi070.stderr: 7feda4ff9640 / io_context_pool 2024-09-12T00:58:50.989 INFO:tasks.workunit.client.0.smithi070.stderr: 7feda6ffd640 / ms_dispatch 2024-09-12T00:58:50.989 INFO:tasks.workunit.client.0.smithi070.stderr: 7fedade03640 / ms_dispatch 2024-09-12T00:58:50.989 INFO:tasks.workunit.client.0.smithi070.stderr: 7fedaf606640 / io_context_pool 2024-09-12T00:58:50.989 INFO:tasks.workunit.client.0.smithi070.stderr: 7feec0bb5640 / msgr-worker-2 2024-09-12T00:58:50.989 INFO:tasks.workunit.client.0.smithi070.stderr: 7feec13b6640 / msgr-worker-1 2024-09-12T00:58:50.989 INFO:tasks.workunit.client.0.smithi070.stderr: 7feec1bb7640 / msgr-worker-0 2024-09-12T00:58:50.989 INFO:tasks.workunit.client.0.smithi070.stderr: 7feec23b8640 / io_context_pool 2024-09-12T00:58:50.989 INFO:tasks.workunit.client.0.smithi070.stderr: 7feec38b09c0 / radosgw-admin 2024-09-12T00:58:50.989 INFO:tasks.workunit.client.0.smithi070.stderr: max_recent 500 2024-09-12T00:58:50.990 INFO:tasks.workunit.client.0.smithi070.stderr: max_new 1000 2024-09-12T00:58:50.990 INFO:tasks.workunit.client.0.smithi070.stderr: log_file /var/log/ceph/ceph-client.admin.139189.log 2024-09-12T00:58:50.990 INFO:tasks.workunit.client.0.smithi070.stderr:--- end dump of recent events --- 2024-09-12T00:58:50.990 INFO:tasks.workunit.client.0.smithi070.stderr:--- begin dump of recent events --- 2024-09-12T00:58:50.990 INFO:tasks.workunit.client.0.smithi070.stderr: -499> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 monclient: authenticate success, global_id 7661 2024-09-12T00:58:50.990 INFO:tasks.workunit.client.0.smithi070.stderr: -498> 2024-09-12T00:58:50.605+0000 7feec38b09c0 10 monclient: get_monmap_and_config success 2024-09-12T00:58:50.990 INFO:tasks.workunit.client.0.smithi070.stderr: -497> 2024-09-12T00:58:50.605+0000 7feec38b09c0 4 set_mon_vals no callback set 2024-09-12T00:58:50.990 INFO:tasks.workunit.client.0.smithi070.stderr: -496> 2024-09-12T00:58:50.605+0000 7feec38b09c0 10 monclient: shutdown 2024-09-12T00:58:50.990 INFO:tasks.workunit.client.0.smithi070.stderr: -495> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 asok(0x561556aa42b0) unregister_commands rotate-key 2024-09-12T00:58:50.990 INFO:tasks.workunit.client.0.smithi070.stderr: -494> 2024-09-12T00:58:50.605+0000 7feec38b09c0 10 monclient: build_initial_monmap 2024-09-12T00:58:50.990 INFO:tasks.workunit.client.0.smithi070.stderr: -493> 2024-09-12T00:58:50.605+0000 7feec38b09c0 1 build_initial for_mkfs: 0 2024-09-12T00:58:50.990 INFO:tasks.workunit.client.0.smithi070.stderr: -492> 2024-09-12T00:58:50.605+0000 7feec38b09c0 10 monclient: monmap: 2024-09-12T00:58:50.990 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:58:50.991 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:58:50.991 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:58:50.991 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:58:50.991 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:58:50.991 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:50.991 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:58:50.991 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:58:50.991 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:58:50.991 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:50.991 INFO:tasks.workunit.client.0.smithi070.stderr: -491> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding auth protocol: cephx 2024-09-12T00:58:50.991 INFO:tasks.workunit.client.0.smithi070.stderr: -490> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding auth protocol: cephx 2024-09-12T00:58:50.991 INFO:tasks.workunit.client.0.smithi070.stderr: -489> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding auth protocol: cephx 2024-09-12T00:58:50.991 INFO:tasks.workunit.client.0.smithi070.stderr: -488> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding con mode: secure 2024-09-12T00:58:50.992 INFO:tasks.workunit.client.0.smithi070.stderr: -487> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding con mode: crc 2024-09-12T00:58:50.992 INFO:tasks.workunit.client.0.smithi070.stderr: -486> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding con mode: secure 2024-09-12T00:58:50.992 INFO:tasks.workunit.client.0.smithi070.stderr: -485> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding con mode: crc 2024-09-12T00:58:50.992 INFO:tasks.workunit.client.0.smithi070.stderr: -484> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding con mode: secure 2024-09-12T00:58:50.992 INFO:tasks.workunit.client.0.smithi070.stderr: -483> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding con mode: crc 2024-09-12T00:58:50.992 INFO:tasks.workunit.client.0.smithi070.stderr: -482> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding con mode: crc 2024-09-12T00:58:50.992 INFO:tasks.workunit.client.0.smithi070.stderr: -481> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding con mode: secure 2024-09-12T00:58:50.992 INFO:tasks.workunit.client.0.smithi070.stderr: -480> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding con mode: crc 2024-09-12T00:58:50.992 INFO:tasks.workunit.client.0.smithi070.stderr: -479> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding con mode: secure 2024-09-12T00:58:50.992 INFO:tasks.workunit.client.0.smithi070.stderr: -478> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding con mode: crc 2024-09-12T00:58:50.992 INFO:tasks.workunit.client.0.smithi070.stderr: -477> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556cb40c0) adding con mode: secure 2024-09-12T00:58:50.992 INFO:tasks.workunit.client.0.smithi070.stderr: -476> 2024-09-12T00:58:50.605+0000 7feec38b09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:50.993 INFO:tasks.workunit.client.0.smithi070.stderr: -475> 2024-09-12T00:58:50.605+0000 7feec38b09c0 1 librados: starting msgr at 2024-09-12T00:58:50.993 INFO:tasks.workunit.client.0.smithi070.stderr: -474> 2024-09-12T00:58:50.605+0000 7feec38b09c0 1 librados: starting objecter 2024-09-12T00:58:50.993 INFO:tasks.workunit.client.0.smithi070.stderr: -473> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command objecter_requests hook 0x561556cb64c0 2024-09-12T00:58:50.993 INFO:tasks.workunit.client.0.smithi070.stderr: -472> 2024-09-12T00:58:50.605+0000 7feec38b09c0 1 librados: setting wanted keys 2024-09-12T00:58:50.993 INFO:tasks.workunit.client.0.smithi070.stderr: -471> 2024-09-12T00:58:50.605+0000 7feec38b09c0 1 librados: calling monclient init 2024-09-12T00:58:50.993 INFO:tasks.workunit.client.0.smithi070.stderr: -470> 2024-09-12T00:58:50.605+0000 7feec38b09c0 10 monclient: init 2024-09-12T00:58:50.993 INFO:tasks.workunit.client.0.smithi070.stderr: -469> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding auth protocol: cephx 2024-09-12T00:58:50.993 INFO:tasks.workunit.client.0.smithi070.stderr: -468> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding auth protocol: cephx 2024-09-12T00:58:50.993 INFO:tasks.workunit.client.0.smithi070.stderr: -467> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding auth protocol: cephx 2024-09-12T00:58:50.993 INFO:tasks.workunit.client.0.smithi070.stderr: -466> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding con mode: secure 2024-09-12T00:58:50.993 INFO:tasks.workunit.client.0.smithi070.stderr: -465> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding con mode: crc 2024-09-12T00:58:50.993 INFO:tasks.workunit.client.0.smithi070.stderr: -464> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding con mode: secure 2024-09-12T00:58:50.993 INFO:tasks.workunit.client.0.smithi070.stderr: -463> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding con mode: crc 2024-09-12T00:58:50.993 INFO:tasks.workunit.client.0.smithi070.stderr: -462> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding con mode: secure 2024-09-12T00:58:50.994 INFO:tasks.workunit.client.0.smithi070.stderr: -461> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding con mode: crc 2024-09-12T00:58:50.994 INFO:tasks.workunit.client.0.smithi070.stderr: -460> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding con mode: crc 2024-09-12T00:58:50.994 INFO:tasks.workunit.client.0.smithi070.stderr: -459> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding con mode: secure 2024-09-12T00:58:50.994 INFO:tasks.workunit.client.0.smithi070.stderr: -458> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding con mode: crc 2024-09-12T00:58:50.994 INFO:tasks.workunit.client.0.smithi070.stderr: -457> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding con mode: secure 2024-09-12T00:58:50.994 INFO:tasks.workunit.client.0.smithi070.stderr: -456> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding con mode: crc 2024-09-12T00:58:50.994 INFO:tasks.workunit.client.0.smithi070.stderr: -455> 2024-09-12T00:58:50.605+0000 7feec38b09c0 5 AuthRegistry(0x561556caeb70) adding con mode: secure 2024-09-12T00:58:50.994 INFO:tasks.workunit.client.0.smithi070.stderr: -454> 2024-09-12T00:58:50.605+0000 7feec38b09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:50.994 INFO:tasks.workunit.client.0.smithi070.stderr: -453> 2024-09-12T00:58:50.609+0000 7feec38b09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:50.994 INFO:tasks.workunit.client.0.smithi070.stderr: -452> 2024-09-12T00:58:50.609+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command rotate-key hook 0x561556caecb8 2024-09-12T00:58:50.994 INFO:tasks.workunit.client.0.smithi070.stderr: -451> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient: _reopen_session rank -1 2024-09-12T00:58:50.994 INFO:tasks.workunit.client.0.smithi070.stderr: -450> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:58:50.994 INFO:tasks.workunit.client.0.smithi070.stderr: -449> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient(hunting): picked mon.noname-c con 0x561556b6e230 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:58:50.995 INFO:tasks.workunit.client.0.smithi070.stderr: -448> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient(hunting): picked mon.noname-a con 0x561556bfa920 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:58:50.995 INFO:tasks.workunit.client.0.smithi070.stderr: -447> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient(hunting): picked mon.noname-b con 0x561556cb2a80 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:58:50.995 INFO:tasks.workunit.client.0.smithi070.stderr: -446> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:50.995 INFO:tasks.workunit.client.0.smithi070.stderr: -445> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:50.995 INFO:tasks.workunit.client.0.smithi070.stderr: -444> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:50.995 INFO:tasks.workunit.client.0.smithi070.stderr: -443> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient(hunting): _renew_subs 2024-09-12T00:58:50.995 INFO:tasks.workunit.client.0.smithi070.stderr: -442> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient(hunting): authenticate will time out at 2381.056252s 2024-09-12T00:58:50.995 INFO:tasks.workunit.client.0.smithi070.stderr: -441> 2024-09-12T00:58:50.609+0000 7feec13b6640 10 monclient(hunting): get_auth_request con 0x561556b6e230 auth_method 0 2024-09-12T00:58:50.995 INFO:tasks.workunit.client.0.smithi070.stderr: -440> 2024-09-12T00:58:50.609+0000 7feec13b6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:50.995 INFO:tasks.workunit.client.0.smithi070.stderr: -439> 2024-09-12T00:58:50.609+0000 7feec13b6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:50.995 INFO:tasks.workunit.client.0.smithi070.stderr: -438> 2024-09-12T00:58:50.609+0000 7feec13b6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:50.995 INFO:tasks.workunit.client.0.smithi070.stderr: -437> 2024-09-12T00:58:50.609+0000 7feec0bb5640 10 monclient(hunting): get_auth_request con 0x561556bfa920 auth_method 0 2024-09-12T00:58:50.995 INFO:tasks.workunit.client.0.smithi070.stderr: -436> 2024-09-12T00:58:50.609+0000 7feec0bb5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:50.995 INFO:tasks.workunit.client.0.smithi070.stderr: -435> 2024-09-12T00:58:50.609+0000 7feec0bb5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:50.996 INFO:tasks.workunit.client.0.smithi070.stderr: -434> 2024-09-12T00:58:50.609+0000 7feec0bb5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:50.996 INFO:tasks.workunit.client.0.smithi070.stderr: -433> 2024-09-12T00:58:50.609+0000 7feec13b6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:50.996 INFO:tasks.workunit.client.0.smithi070.stderr: -432> 2024-09-12T00:58:50.609+0000 7feec13b6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:50.996 INFO:tasks.workunit.client.0.smithi070.stderr: -431> 2024-09-12T00:58:50.609+0000 7feec13b6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:50.996 INFO:tasks.workunit.client.0.smithi070.stderr: -430> 2024-09-12T00:58:50.609+0000 7feec0bb5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:50.996 INFO:tasks.workunit.client.0.smithi070.stderr: -429> 2024-09-12T00:58:50.609+0000 7feec0bb5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:50.996 INFO:tasks.workunit.client.0.smithi070.stderr: -428> 2024-09-12T00:58:50.609+0000 7feec0bb5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:50.996 INFO:tasks.workunit.client.0.smithi070.stderr: -427> 2024-09-12T00:58:50.609+0000 7feec13b6640 10 monclient(hunting): handle_auth_done global_id 7664 payload 824 2024-09-12T00:58:50.996 INFO:tasks.workunit.client.0.smithi070.stderr: -426> 2024-09-12T00:58:50.609+0000 7feec13b6640 10 monclient: _finish_hunting 0 2024-09-12T00:58:50.996 INFO:tasks.workunit.client.0.smithi070.stderr: -425> 2024-09-12T00:58:50.609+0000 7feec13b6640 1 monclient: found mon.noname-c 2024-09-12T00:58:50.996 INFO:tasks.workunit.client.0.smithi070.stderr: -424> 2024-09-12T00:58:50.609+0000 7feec13b6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:58:50.996 INFO:tasks.workunit.client.0.smithi070.stderr: -423> 2024-09-12T00:58:50.609+0000 7fedade03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:50.996 INFO:tasks.workunit.client.0.smithi070.stderr: -422> 2024-09-12T00:58:50.609+0000 7fedade03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:58:50.997 INFO:tasks.workunit.client.0.smithi070.stderr: -421> 2024-09-12T00:58:50.609+0000 7fedade03640 10 monclient: dump: 2024-09-12T00:58:50.997 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:50.997 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:50.997 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:50.997 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:50.997 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:50.997 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:50.997 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:50.997 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:50.997 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:50.997 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:50.997 INFO:tasks.workunit.client.0.smithi070.stderr: -420> 2024-09-12T00:58:50.609+0000 7fedade03640 10 monclient: _finish_auth 0 2024-09-12T00:58:50.997 INFO:tasks.workunit.client.0.smithi070.stderr: -419> 2024-09-12T00:58:50.609+0000 7fedade03640 10 monclient: _check_auth_tickets 2024-09-12T00:58:50.997 INFO:tasks.workunit.client.0.smithi070.stderr: -418> 2024-09-12T00:58:50.609+0000 7fedade03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:58:50.998 INFO:tasks.workunit.client.0.smithi070.stderr: -417> 2024-09-12T00:58:50.609+0000 7fedade03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:50.998 INFO:tasks.workunit.client.0.smithi070.stderr: -416> 2024-09-12T00:58:50.609+0000 7fedade03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:58:50.998 INFO:tasks.workunit.client.0.smithi070.stderr: -415> 2024-09-12T00:58:50.609+0000 7fedade03640 10 monclient: dump: 2024-09-12T00:58:50.998 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:50.998 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:50.998 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:50.998 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:50.998 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:50.998 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:50.998 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:50.998 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:50.998 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:50.998 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:50.998 INFO:tasks.workunit.client.0.smithi070.stderr: -414> 2024-09-12T00:58:50.609+0000 7fedaf606640 4 set_mon_vals no callback set 2024-09-12T00:58:50.999 INFO:tasks.workunit.client.0.smithi070.stderr: -413> 2024-09-12T00:58:50.609+0000 7feec38b09c0 5 monclient: authenticate success, global_id 7664 2024-09-12T00:58:50.999 INFO:tasks.workunit.client.0.smithi070.stderr: -412> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient: _renew_subs 2024-09-12T00:58:50.999 INFO:tasks.workunit.client.0.smithi070.stderr: -411> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:58:50.999 INFO:tasks.workunit.client.0.smithi070.stderr: -410> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient: _renew_subs 2024-09-12T00:58:50.999 INFO:tasks.workunit.client.0.smithi070.stderr: -409> 2024-09-12T00:58:50.609+0000 7feec38b09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:58:50.999 INFO:tasks.workunit.client.0.smithi070.stderr: -408> 2024-09-12T00:58:50.609+0000 7feec38b09c0 1 librados: init done 2024-09-12T00:58:50.999 INFO:tasks.workunit.client.0.smithi070.stderr: -407> 2024-09-12T00:58:50.609+0000 7fedade03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:58:50.999 INFO:tasks.workunit.client.0.smithi070.stderr: -406> 2024-09-12T00:58:50.609+0000 7fedade03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:58:50.999 INFO:tasks.workunit.client.0.smithi070.stderr: -405> 2024-09-12T00:58:50.609+0000 7fedade03640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:58:50.999 INFO:tasks.workunit.client.0.smithi070.stderr: -404> 2024-09-12T00:58:50.609+0000 7feec0bb5640 10 monclient: get_auth_request con 0x7feda8070ae0 auth_method 0 2024-09-12T00:58:50.999 INFO:tasks.workunit.client.0.smithi070.stderr: -403> 2024-09-12T00:58:50.613+0000 7feec1bb7640 10 monclient: get_auth_request con 0x561556cb9de0 auth_method 0 2024-09-12T00:58:50.999 INFO:tasks.workunit.client.0.smithi070.stderr: -402> 2024-09-12T00:58:50.613+0000 7feec13b6640 10 monclient: get_auth_request con 0x561556cfa590 auth_method 0 2024-09-12T00:58:50.999 INFO:tasks.workunit.client.0.smithi070.stderr: -401> 2024-09-12T00:58:50.613+0000 7feec0bb5640 10 monclient: get_auth_request con 0x561556cfea10 auth_method 0 2024-09-12T00:58:50.999 INFO:tasks.workunit.client.0.smithi070.stderr: -400> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient: build_initial_monmap 2024-09-12T00:58:51.000 INFO:tasks.workunit.client.0.smithi070.stderr: -399> 2024-09-12T00:58:50.617+0000 7feec38b09c0 1 build_initial for_mkfs: 0 2024-09-12T00:58:51.000 INFO:tasks.workunit.client.0.smithi070.stderr: -398> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient: monmap: 2024-09-12T00:58:51.000 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:58:51.000 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:58:51.000 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:58:51.000 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:58:51.000 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:58:51.000 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:51.000 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:58:51.000 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:58:51.000 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:58:51.000 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:51.000 INFO:tasks.workunit.client.0.smithi070.stderr: -397> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding auth protocol: cephx 2024-09-12T00:58:51.000 INFO:tasks.workunit.client.0.smithi070.stderr: -396> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding auth protocol: cephx 2024-09-12T00:58:51.001 INFO:tasks.workunit.client.0.smithi070.stderr: -395> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding auth protocol: cephx 2024-09-12T00:58:51.001 INFO:tasks.workunit.client.0.smithi070.stderr: -394> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding con mode: secure 2024-09-12T00:58:51.001 INFO:tasks.workunit.client.0.smithi070.stderr: -393> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding con mode: crc 2024-09-12T00:58:51.001 INFO:tasks.workunit.client.0.smithi070.stderr: -392> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding con mode: secure 2024-09-12T00:58:51.001 INFO:tasks.workunit.client.0.smithi070.stderr: -391> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding con mode: crc 2024-09-12T00:58:51.001 INFO:tasks.workunit.client.0.smithi070.stderr: -390> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding con mode: secure 2024-09-12T00:58:51.001 INFO:tasks.workunit.client.0.smithi070.stderr: -389> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding con mode: crc 2024-09-12T00:58:51.001 INFO:tasks.workunit.client.0.smithi070.stderr: -388> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding con mode: crc 2024-09-12T00:58:51.001 INFO:tasks.workunit.client.0.smithi070.stderr: -387> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding con mode: secure 2024-09-12T00:58:51.001 INFO:tasks.workunit.client.0.smithi070.stderr: -386> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding con mode: crc 2024-09-12T00:58:51.001 INFO:tasks.workunit.client.0.smithi070.stderr: -385> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding con mode: secure 2024-09-12T00:58:51.001 INFO:tasks.workunit.client.0.smithi070.stderr: -384> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding con mode: crc 2024-09-12T00:58:51.001 INFO:tasks.workunit.client.0.smithi070.stderr: -383> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d03930) adding con mode: secure 2024-09-12T00:58:51.001 INFO:tasks.workunit.client.0.smithi070.stderr: -382> 2024-09-12T00:58:50.617+0000 7feec38b09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:51.002 INFO:tasks.workunit.client.0.smithi070.stderr: -381> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command objecter_requests cmddesc objecter_requests hook 0x561556d07250 EEXIST 2024-09-12T00:58:51.002 INFO:tasks.workunit.client.0.smithi070.stderr: -380> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient: init 2024-09-12T00:58:51.002 INFO:tasks.workunit.client.0.smithi070.stderr: -379> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding auth protocol: cephx 2024-09-12T00:58:51.002 INFO:tasks.workunit.client.0.smithi070.stderr: -378> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding auth protocol: cephx 2024-09-12T00:58:51.002 INFO:tasks.workunit.client.0.smithi070.stderr: -377> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding auth protocol: cephx 2024-09-12T00:58:51.002 INFO:tasks.workunit.client.0.smithi070.stderr: -376> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding con mode: secure 2024-09-12T00:58:51.002 INFO:tasks.workunit.client.0.smithi070.stderr: -375> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding con mode: crc 2024-09-12T00:58:51.002 INFO:tasks.workunit.client.0.smithi070.stderr: -374> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding con mode: secure 2024-09-12T00:58:51.002 INFO:tasks.workunit.client.0.smithi070.stderr: -373> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding con mode: crc 2024-09-12T00:58:51.002 INFO:tasks.workunit.client.0.smithi070.stderr: -372> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding con mode: secure 2024-09-12T00:58:51.002 INFO:tasks.workunit.client.0.smithi070.stderr: -371> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding con mode: crc 2024-09-12T00:58:51.002 INFO:tasks.workunit.client.0.smithi070.stderr: -370> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding con mode: crc 2024-09-12T00:58:51.002 INFO:tasks.workunit.client.0.smithi070.stderr: -369> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding con mode: secure 2024-09-12T00:58:51.002 INFO:tasks.workunit.client.0.smithi070.stderr: -368> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding con mode: crc 2024-09-12T00:58:51.003 INFO:tasks.workunit.client.0.smithi070.stderr: -367> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding con mode: secure 2024-09-12T00:58:51.003 INFO:tasks.workunit.client.0.smithi070.stderr: -366> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding con mode: crc 2024-09-12T00:58:51.003 INFO:tasks.workunit.client.0.smithi070.stderr: -365> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 AuthRegistry(0x561556d01f48) adding con mode: secure 2024-09-12T00:58:51.003 INFO:tasks.workunit.client.0.smithi070.stderr: -364> 2024-09-12T00:58:50.617+0000 7feec38b09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:51.003 INFO:tasks.workunit.client.0.smithi070.stderr: -363> 2024-09-12T00:58:50.617+0000 7feec38b09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:51.003 INFO:tasks.workunit.client.0.smithi070.stderr: -362> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command rotate-key cmddesc rotate-key hook 0x561556d02090 EEXIST 2024-09-12T00:58:51.003 INFO:tasks.workunit.client.0.smithi070.stderr: -361> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient: _reopen_session rank -1 2024-09-12T00:58:51.003 INFO:tasks.workunit.client.0.smithi070.stderr: -360> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:58:51.003 INFO:tasks.workunit.client.0.smithi070.stderr: -359> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient(hunting): picked mon.noname-a con 0x561556d2b400 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:58:51.003 INFO:tasks.workunit.client.0.smithi070.stderr: -358> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient(hunting): picked mon.noname-b con 0x561556d2ad30 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:58:51.003 INFO:tasks.workunit.client.0.smithi070.stderr: -357> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient(hunting): picked mon.noname-c con 0x561556d29710 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:58:51.003 INFO:tasks.workunit.client.0.smithi070.stderr: -356> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:51.003 INFO:tasks.workunit.client.0.smithi070.stderr: -355> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:51.003 INFO:tasks.workunit.client.0.smithi070.stderr: -354> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:51.003 INFO:tasks.workunit.client.0.smithi070.stderr: -353> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient(hunting): _renew_subs 2024-09-12T00:58:51.004 INFO:tasks.workunit.client.0.smithi070.stderr: -352> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient(hunting): authenticate will time out at 2381.065142s 2024-09-12T00:58:51.004 INFO:tasks.workunit.client.0.smithi070.stderr: -351> 2024-09-12T00:58:50.617+0000 7feec13b6640 10 monclient(hunting): get_auth_request con 0x561556d2b400 auth_method 0 2024-09-12T00:58:51.004 INFO:tasks.workunit.client.0.smithi070.stderr: -350> 2024-09-12T00:58:50.617+0000 7feec13b6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:51.004 INFO:tasks.workunit.client.0.smithi070.stderr: -349> 2024-09-12T00:58:50.617+0000 7feec13b6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:51.004 INFO:tasks.workunit.client.0.smithi070.stderr: -348> 2024-09-12T00:58:50.617+0000 7feec13b6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:51.004 INFO:tasks.workunit.client.0.smithi070.stderr: -347> 2024-09-12T00:58:50.617+0000 7feec1bb7640 10 monclient(hunting): get_auth_request con 0x561556d29710 auth_method 0 2024-09-12T00:58:51.004 INFO:tasks.workunit.client.0.smithi070.stderr: -346> 2024-09-12T00:58:50.617+0000 7feec1bb7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:51.004 INFO:tasks.workunit.client.0.smithi070.stderr: -345> 2024-09-12T00:58:50.617+0000 7feec1bb7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:51.004 INFO:tasks.workunit.client.0.smithi070.stderr: -344> 2024-09-12T00:58:50.617+0000 7feec1bb7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:51.004 INFO:tasks.workunit.client.0.smithi070.stderr: -343> 2024-09-12T00:58:50.617+0000 7feec13b6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:51.004 INFO:tasks.workunit.client.0.smithi070.stderr: -342> 2024-09-12T00:58:50.617+0000 7feec13b6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:51.004 INFO:tasks.workunit.client.0.smithi070.stderr: -341> 2024-09-12T00:58:50.617+0000 7feec13b6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:51.004 INFO:tasks.workunit.client.0.smithi070.stderr: -340> 2024-09-12T00:58:50.617+0000 7feec1bb7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:51.005 INFO:tasks.workunit.client.0.smithi070.stderr: -339> 2024-09-12T00:58:50.617+0000 7feec1bb7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:51.005 INFO:tasks.workunit.client.0.smithi070.stderr: -338> 2024-09-12T00:58:50.617+0000 7feec1bb7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:51.005 INFO:tasks.workunit.client.0.smithi070.stderr: -337> 2024-09-12T00:58:50.617+0000 7feec1bb7640 10 monclient(hunting): handle_auth_done global_id 7667 payload 824 2024-09-12T00:58:51.005 INFO:tasks.workunit.client.0.smithi070.stderr: -336> 2024-09-12T00:58:50.617+0000 7feec1bb7640 10 monclient: _finish_hunting 0 2024-09-12T00:58:51.005 INFO:tasks.workunit.client.0.smithi070.stderr: -335> 2024-09-12T00:58:50.617+0000 7feec1bb7640 1 monclient: found mon.noname-c 2024-09-12T00:58:51.005 INFO:tasks.workunit.client.0.smithi070.stderr: -334> 2024-09-12T00:58:50.617+0000 7feec1bb7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:58:51.005 INFO:tasks.workunit.client.0.smithi070.stderr: -333> 2024-09-12T00:58:50.617+0000 7feec0bb5640 10 monclient: get_auth_request con 0x561556d2ad30 auth_method 0 2024-09-12T00:58:51.005 INFO:tasks.workunit.client.0.smithi070.stderr: -332> 2024-09-12T00:58:50.617+0000 7feda6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:51.005 INFO:tasks.workunit.client.0.smithi070.stderr: -331> 2024-09-12T00:58:50.617+0000 7feda6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:58:51.005 INFO:tasks.workunit.client.0.smithi070.stderr: -330> 2024-09-12T00:58:50.617+0000 7feda6ffd640 10 monclient: dump: 2024-09-12T00:58:51.005 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:51.005 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:51.005 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:51.005 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:51.005 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:51.006 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:51.006 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:51.006 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:51.006 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:51.006 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:51.006 INFO:tasks.workunit.client.0.smithi070.stderr: -329> 2024-09-12T00:58:50.617+0000 7feda6ffd640 10 monclient: _finish_auth 0 2024-09-12T00:58:51.006 INFO:tasks.workunit.client.0.smithi070.stderr: -328> 2024-09-12T00:58:50.617+0000 7feda6ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:58:51.006 INFO:tasks.workunit.client.0.smithi070.stderr: -327> 2024-09-12T00:58:50.617+0000 7feda6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:58:51.006 INFO:tasks.workunit.client.0.smithi070.stderr: -326> 2024-09-12T00:58:50.617+0000 7feda6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:51.006 INFO:tasks.workunit.client.0.smithi070.stderr: -325> 2024-09-12T00:58:50.617+0000 7feda6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:58:51.006 INFO:tasks.workunit.client.0.smithi070.stderr: -324> 2024-09-12T00:58:50.617+0000 7feda6ffd640 10 monclient: dump: 2024-09-12T00:58:51.006 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:51.006 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:51.006 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:51.007 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:51.007 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:51.007 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:51.007 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:51.007 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:51.007 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:51.007 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:51.007 INFO:tasks.workunit.client.0.smithi070.stderr: -323> 2024-09-12T00:58:50.617+0000 7feec38b09c0 5 monclient: authenticate success, global_id 7667 2024-09-12T00:58:51.007 INFO:tasks.workunit.client.0.smithi070.stderr: -322> 2024-09-12T00:58:50.617+0000 7feec23b8640 4 set_mon_vals no callback set 2024-09-12T00:58:51.007 INFO:tasks.workunit.client.0.smithi070.stderr: -321> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient: _renew_subs 2024-09-12T00:58:51.007 INFO:tasks.workunit.client.0.smithi070.stderr: -320> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:58:51.007 INFO:tasks.workunit.client.0.smithi070.stderr: -319> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient: _renew_subs 2024-09-12T00:58:51.007 INFO:tasks.workunit.client.0.smithi070.stderr: -318> 2024-09-12T00:58:50.617+0000 7feec38b09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:58:51.007 INFO:tasks.workunit.client.0.smithi070.stderr: -317> 2024-09-12T00:58:50.617+0000 7feda6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:58:51.008 INFO:tasks.workunit.client.0.smithi070.stderr: -316> 2024-09-12T00:58:50.617+0000 7feda6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:58:51.008 INFO:tasks.workunit.client.0.smithi070.stderr: -315> 2024-09-12T00:58:50.617+0000 7feda6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:58:51.008 INFO:tasks.workunit.client.0.smithi070.stderr: -314> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient: get_monmap_and_config 2024-09-12T00:58:51.008 INFO:tasks.workunit.client.0.smithi070.stderr: -313> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient: build_initial_monmap 2024-09-12T00:58:51.008 INFO:tasks.workunit.client.0.smithi070.stderr: -312> 2024-09-12T00:58:50.621+0000 7feec38b09c0 1 build_initial for_mkfs: 0 2024-09-12T00:58:51.008 INFO:tasks.workunit.client.0.smithi070.stderr: -311> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient: monmap: 2024-09-12T00:58:51.008 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:58:51.008 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:58:51.008 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:58:51.008 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:58:51.008 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:58:51.008 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:51.008 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:58:51.008 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:58:51.009 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:58:51.009 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:51.009 INFO:tasks.workunit.client.0.smithi070.stderr: -310> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding auth protocol: cephx 2024-09-12T00:58:51.009 INFO:tasks.workunit.client.0.smithi070.stderr: -309> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding auth protocol: cephx 2024-09-12T00:58:51.009 INFO:tasks.workunit.client.0.smithi070.stderr: -308> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding auth protocol: cephx 2024-09-12T00:58:51.009 INFO:tasks.workunit.client.0.smithi070.stderr: -307> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding con mode: secure 2024-09-12T00:58:51.009 INFO:tasks.workunit.client.0.smithi070.stderr: -306> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding con mode: crc 2024-09-12T00:58:51.009 INFO:tasks.workunit.client.0.smithi070.stderr: -305> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding con mode: secure 2024-09-12T00:58:51.009 INFO:tasks.workunit.client.0.smithi070.stderr: -304> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding con mode: crc 2024-09-12T00:58:51.009 INFO:tasks.workunit.client.0.smithi070.stderr: -303> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding con mode: secure 2024-09-12T00:58:51.009 INFO:tasks.workunit.client.0.smithi070.stderr: -302> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding con mode: crc 2024-09-12T00:58:51.009 INFO:tasks.workunit.client.0.smithi070.stderr: -301> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding con mode: crc 2024-09-12T00:58:51.009 INFO:tasks.workunit.client.0.smithi070.stderr: -300> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding con mode: secure 2024-09-12T00:58:51.009 INFO:tasks.workunit.client.0.smithi070.stderr: -299> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding con mode: crc 2024-09-12T00:58:51.010 INFO:tasks.workunit.client.0.smithi070.stderr: -298> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding con mode: secure 2024-09-12T00:58:51.010 INFO:tasks.workunit.client.0.smithi070.stderr: -297> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding con mode: crc 2024-09-12T00:58:51.010 INFO:tasks.workunit.client.0.smithi070.stderr: -296> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d4ae00) adding con mode: secure 2024-09-12T00:58:51.010 INFO:tasks.workunit.client.0.smithi070.stderr: -295> 2024-09-12T00:58:50.621+0000 7feec13b6640 10 monclient: get_auth_request con 0x7fed9c070a20 auth_method 0 2024-09-12T00:58:51.010 INFO:tasks.workunit.client.0.smithi070.stderr: -294> 2024-09-12T00:58:50.621+0000 7feec38b09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:51.010 INFO:tasks.workunit.client.0.smithi070.stderr: -293> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient: init 2024-09-12T00:58:51.010 INFO:tasks.workunit.client.0.smithi070.stderr: -292> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding auth protocol: cephx 2024-09-12T00:58:51.010 INFO:tasks.workunit.client.0.smithi070.stderr: -291> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding auth protocol: cephx 2024-09-12T00:58:51.010 INFO:tasks.workunit.client.0.smithi070.stderr: -290> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding auth protocol: cephx 2024-09-12T00:58:51.010 INFO:tasks.workunit.client.0.smithi070.stderr: -289> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding con mode: secure 2024-09-12T00:58:51.010 INFO:tasks.workunit.client.0.smithi070.stderr: -288> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding con mode: crc 2024-09-12T00:58:51.010 INFO:tasks.workunit.client.0.smithi070.stderr: -287> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding con mode: secure 2024-09-12T00:58:51.010 INFO:tasks.workunit.client.0.smithi070.stderr: -286> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding con mode: crc 2024-09-12T00:58:51.011 INFO:tasks.workunit.client.0.smithi070.stderr: -285> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding con mode: secure 2024-09-12T00:58:51.011 INFO:tasks.workunit.client.0.smithi070.stderr: -284> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding con mode: crc 2024-09-12T00:58:51.011 INFO:tasks.workunit.client.0.smithi070.stderr: -283> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding con mode: crc 2024-09-12T00:58:51.011 INFO:tasks.workunit.client.0.smithi070.stderr: -282> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding con mode: secure 2024-09-12T00:58:51.011 INFO:tasks.workunit.client.0.smithi070.stderr: -281> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding con mode: crc 2024-09-12T00:58:51.011 INFO:tasks.workunit.client.0.smithi070.stderr: -280> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding con mode: secure 2024-09-12T00:58:51.011 INFO:tasks.workunit.client.0.smithi070.stderr: -279> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding con mode: crc 2024-09-12T00:58:51.011 INFO:tasks.workunit.client.0.smithi070.stderr: -278> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888090) adding con mode: secure 2024-09-12T00:58:51.011 INFO:tasks.workunit.client.0.smithi070.stderr: -277> 2024-09-12T00:58:50.621+0000 7feec38b09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:51.011 INFO:tasks.workunit.client.0.smithi070.stderr: -276> 2024-09-12T00:58:50.621+0000 7feec38b09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:51.011 INFO:tasks.workunit.client.0.smithi070.stderr: -275> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command rotate-key cmddesc rotate-key hook 0x7ffef98881d8 EEXIST 2024-09-12T00:58:51.011 INFO:tasks.workunit.client.0.smithi070.stderr: -274> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient: _reopen_session rank -1 2024-09-12T00:58:51.011 INFO:tasks.workunit.client.0.smithi070.stderr: -273> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:58:51.011 INFO:tasks.workunit.client.0.smithi070.stderr: -272> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): picked mon.noname-b con 0x561556d7f2a0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:58:51.012 INFO:tasks.workunit.client.0.smithi070.stderr: -271> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): picked mon.noname-a con 0x561556d7a690 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:58:51.012 INFO:tasks.workunit.client.0.smithi070.stderr: -270> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): picked mon.noname-c con 0x561556d70ea0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:58:51.012 INFO:tasks.workunit.client.0.smithi070.stderr: -269> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:51.012 INFO:tasks.workunit.client.0.smithi070.stderr: -268> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:51.012 INFO:tasks.workunit.client.0.smithi070.stderr: -267> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:51.012 INFO:tasks.workunit.client.0.smithi070.stderr: -266> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): _renew_subs 2024-09-12T00:58:51.012 INFO:tasks.workunit.client.0.smithi070.stderr: -265> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): authenticate will time out at 2381.069164s 2024-09-12T00:58:51.012 INFO:tasks.workunit.client.0.smithi070.stderr: -264> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): get_auth_request con 0x561556d70ea0 auth_method 0 2024-09-12T00:58:51.012 INFO:tasks.workunit.client.0.smithi070.stderr: -263> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:51.012 INFO:tasks.workunit.client.0.smithi070.stderr: -262> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:51.012 INFO:tasks.workunit.client.0.smithi070.stderr: -261> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:51.012 INFO:tasks.workunit.client.0.smithi070.stderr: -260> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): get_auth_request con 0x561556d7a690 auth_method 0 2024-09-12T00:58:51.012 INFO:tasks.workunit.client.0.smithi070.stderr: -259> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:51.013 INFO:tasks.workunit.client.0.smithi070.stderr: -258> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:51.013 INFO:tasks.workunit.client.0.smithi070.stderr: -257> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:51.013 INFO:tasks.workunit.client.0.smithi070.stderr: -256> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:51.013 INFO:tasks.workunit.client.0.smithi070.stderr: -255> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:51.013 INFO:tasks.workunit.client.0.smithi070.stderr: -254> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:51.013 INFO:tasks.workunit.client.0.smithi070.stderr: -253> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:51.013 INFO:tasks.workunit.client.0.smithi070.stderr: -252> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:51.013 INFO:tasks.workunit.client.0.smithi070.stderr: -251> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:51.013 INFO:tasks.workunit.client.0.smithi070.stderr: -250> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): handle_auth_done global_id 7670 payload 274 2024-09-12T00:58:51.013 INFO:tasks.workunit.client.0.smithi070.stderr: -249> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient: _finish_hunting 0 2024-09-12T00:58:51.013 INFO:tasks.workunit.client.0.smithi070.stderr: -248> 2024-09-12T00:58:50.621+0000 7feec1bb7640 1 monclient: found mon.noname-c 2024-09-12T00:58:51.013 INFO:tasks.workunit.client.0.smithi070.stderr: -247> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:58:51.013 INFO:tasks.workunit.client.0.smithi070.stderr: -246> 2024-09-12T00:58:50.621+0000 7feda4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:51.013 INFO:tasks.workunit.client.0.smithi070.stderr: -245> 2024-09-12T00:58:50.621+0000 7feda4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:58:51.014 INFO:tasks.workunit.client.0.smithi070.stderr: -244> 2024-09-12T00:58:50.621+0000 7feda4ff9640 10 monclient: dump: 2024-09-12T00:58:51.014 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:51.014 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:51.014 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:51.014 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:51.014 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:51.014 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:51.014 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:51.014 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:51.014 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:51.014 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:51.014 INFO:tasks.workunit.client.0.smithi070.stderr: -243> 2024-09-12T00:58:50.621+0000 7feda4ff9640 10 monclient: _finish_auth 0 2024-09-12T00:58:51.014 INFO:tasks.workunit.client.0.smithi070.stderr: -242> 2024-09-12T00:58:50.621+0000 7feda4ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:58:51.014 INFO:tasks.workunit.client.0.smithi070.stderr: -241> 2024-09-12T00:58:50.621+0000 7feda4ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:58:51.015 INFO:tasks.workunit.client.0.smithi070.stderr: -240> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 monclient: authenticate success, global_id 7670 2024-09-12T00:58:51.015 INFO:tasks.workunit.client.0.smithi070.stderr: -239> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient: get_monmap_and_config success 2024-09-12T00:58:51.015 INFO:tasks.workunit.client.0.smithi070.stderr: -238> 2024-09-12T00:58:50.621+0000 7feec38b09c0 4 set_mon_vals no callback set 2024-09-12T00:58:51.015 INFO:tasks.workunit.client.0.smithi070.stderr: -237> 2024-09-12T00:58:50.621+0000 7feda4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:51.015 INFO:tasks.workunit.client.0.smithi070.stderr: -236> 2024-09-12T00:58:50.621+0000 7feda4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:58:51.015 INFO:tasks.workunit.client.0.smithi070.stderr: -235> 2024-09-12T00:58:50.621+0000 7feda4ff9640 10 monclient: dump: 2024-09-12T00:58:51.015 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:51.015 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:51.015 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:51.015 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:51.015 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:51.015 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:51.015 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:51.015 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:51.016 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:51.016 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:51.016 INFO:tasks.workunit.client.0.smithi070.stderr: -234> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient: shutdown 2024-09-12T00:58:51.016 INFO:tasks.workunit.client.0.smithi070.stderr: -233> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient: build_initial_monmap 2024-09-12T00:58:51.016 INFO:tasks.workunit.client.0.smithi070.stderr: -232> 2024-09-12T00:58:50.621+0000 7feec38b09c0 1 build_initial for_mkfs: 0 2024-09-12T00:58:51.016 INFO:tasks.workunit.client.0.smithi070.stderr: -231> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient: monmap: 2024-09-12T00:58:51.016 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:58:51.016 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:58:51.016 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:58:51.016 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:58:51.016 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:58:51.016 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:51.016 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:58:51.017 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:58:51.017 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:58:51.017 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:51.017 INFO:tasks.workunit.client.0.smithi070.stderr: -230> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding auth protocol: cephx 2024-09-12T00:58:51.017 INFO:tasks.workunit.client.0.smithi070.stderr: -229> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding auth protocol: cephx 2024-09-12T00:58:51.017 INFO:tasks.workunit.client.0.smithi070.stderr: -228> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding auth protocol: cephx 2024-09-12T00:58:51.017 INFO:tasks.workunit.client.0.smithi070.stderr: -227> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding con mode: secure 2024-09-12T00:58:51.017 INFO:tasks.workunit.client.0.smithi070.stderr: -226> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding con mode: crc 2024-09-12T00:58:51.017 INFO:tasks.workunit.client.0.smithi070.stderr: -225> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding con mode: secure 2024-09-12T00:58:51.017 INFO:tasks.workunit.client.0.smithi070.stderr: -224> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding con mode: crc 2024-09-12T00:58:51.017 INFO:tasks.workunit.client.0.smithi070.stderr: -223> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding con mode: secure 2024-09-12T00:58:51.017 INFO:tasks.workunit.client.0.smithi070.stderr: -222> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding con mode: crc 2024-09-12T00:58:51.017 INFO:tasks.workunit.client.0.smithi070.stderr: -221> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding con mode: crc 2024-09-12T00:58:51.018 INFO:tasks.workunit.client.0.smithi070.stderr: -220> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding con mode: secure 2024-09-12T00:58:51.018 INFO:tasks.workunit.client.0.smithi070.stderr: -219> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding con mode: crc 2024-09-12T00:58:51.018 INFO:tasks.workunit.client.0.smithi070.stderr: -218> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding con mode: secure 2024-09-12T00:58:51.018 INFO:tasks.workunit.client.0.smithi070.stderr: -217> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding con mode: crc 2024-09-12T00:58:51.018 INFO:tasks.workunit.client.0.smithi070.stderr: -216> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d7b430) adding con mode: secure 2024-09-12T00:58:51.018 INFO:tasks.workunit.client.0.smithi070.stderr: -215> 2024-09-12T00:58:50.621+0000 7feec38b09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:51.018 INFO:tasks.workunit.client.0.smithi070.stderr: -214> 2024-09-12T00:58:50.621+0000 7feec38b09c0 1 librados: starting msgr at 2024-09-12T00:58:51.018 INFO:tasks.workunit.client.0.smithi070.stderr: -213> 2024-09-12T00:58:50.621+0000 7feec38b09c0 1 librados: starting objecter 2024-09-12T00:58:51.018 INFO:tasks.workunit.client.0.smithi070.stderr: -212> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command objecter_requests cmddesc objecter_requests hook 0x561556d30010 EEXIST 2024-09-12T00:58:51.018 INFO:tasks.workunit.client.0.smithi070.stderr: -211> 2024-09-12T00:58:50.621+0000 7feec38b09c0 1 librados: setting wanted keys 2024-09-12T00:58:51.018 INFO:tasks.workunit.client.0.smithi070.stderr: -210> 2024-09-12T00:58:50.621+0000 7feec38b09c0 1 librados: calling monclient init 2024-09-12T00:58:51.018 INFO:tasks.workunit.client.0.smithi070.stderr: -209> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient: init 2024-09-12T00:58:51.018 INFO:tasks.workunit.client.0.smithi070.stderr: -208> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding auth protocol: cephx 2024-09-12T00:58:51.018 INFO:tasks.workunit.client.0.smithi070.stderr: -207> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding auth protocol: cephx 2024-09-12T00:58:51.019 INFO:tasks.workunit.client.0.smithi070.stderr: -206> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding auth protocol: cephx 2024-09-12T00:58:51.019 INFO:tasks.workunit.client.0.smithi070.stderr: -205> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding con mode: secure 2024-09-12T00:58:51.019 INFO:tasks.workunit.client.0.smithi070.stderr: -204> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding con mode: crc 2024-09-12T00:58:51.019 INFO:tasks.workunit.client.0.smithi070.stderr: -203> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding con mode: secure 2024-09-12T00:58:51.019 INFO:tasks.workunit.client.0.smithi070.stderr: -202> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding con mode: crc 2024-09-12T00:58:51.019 INFO:tasks.workunit.client.0.smithi070.stderr: -201> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding con mode: secure 2024-09-12T00:58:51.019 INFO:tasks.workunit.client.0.smithi070.stderr: -200> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding con mode: crc 2024-09-12T00:58:51.019 INFO:tasks.workunit.client.0.smithi070.stderr: -199> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding con mode: crc 2024-09-12T00:58:51.019 INFO:tasks.workunit.client.0.smithi070.stderr: -198> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding con mode: secure 2024-09-12T00:58:51.019 INFO:tasks.workunit.client.0.smithi070.stderr: -197> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding con mode: crc 2024-09-12T00:58:51.019 INFO:tasks.workunit.client.0.smithi070.stderr: -196> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding con mode: secure 2024-09-12T00:58:51.019 INFO:tasks.workunit.client.0.smithi070.stderr: -195> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding con mode: crc 2024-09-12T00:58:51.019 INFO:tasks.workunit.client.0.smithi070.stderr: -194> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 AuthRegistry(0x561556d2d220) adding con mode: secure 2024-09-12T00:58:51.019 INFO:tasks.workunit.client.0.smithi070.stderr: -193> 2024-09-12T00:58:50.621+0000 7feec38b09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:51.020 INFO:tasks.workunit.client.0.smithi070.stderr: -192> 2024-09-12T00:58:50.621+0000 7feec38b09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:51.020 INFO:tasks.workunit.client.0.smithi070.stderr: -191> 2024-09-12T00:58:50.621+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command rotate-key cmddesc rotate-key hook 0x561556d2d368 EEXIST 2024-09-12T00:58:51.020 INFO:tasks.workunit.client.0.smithi070.stderr: -190> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient: _reopen_session rank -1 2024-09-12T00:58:51.020 INFO:tasks.workunit.client.0.smithi070.stderr: -189> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:58:51.020 INFO:tasks.workunit.client.0.smithi070.stderr: -188> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): picked mon.noname-b con 0x561556d70ea0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:58:51.020 INFO:tasks.workunit.client.0.smithi070.stderr: -187> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): picked mon.noname-a con 0x561556d7a690 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:58:51.020 INFO:tasks.workunit.client.0.smithi070.stderr: -186> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): picked mon.noname-c con 0x561556d7f2a0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:58:51.020 INFO:tasks.workunit.client.0.smithi070.stderr: -185> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:51.020 INFO:tasks.workunit.client.0.smithi070.stderr: -184> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:51.020 INFO:tasks.workunit.client.0.smithi070.stderr: -183> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:58:51.020 INFO:tasks.workunit.client.0.smithi070.stderr: -182> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): _renew_subs 2024-09-12T00:58:51.020 INFO:tasks.workunit.client.0.smithi070.stderr: -181> 2024-09-12T00:58:50.621+0000 7feec38b09c0 10 monclient(hunting): authenticate will time out at 2381.071649s 2024-09-12T00:58:51.020 INFO:tasks.workunit.client.0.smithi070.stderr: -180> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): get_auth_request con 0x561556d7a690 auth_method 0 2024-09-12T00:58:51.020 INFO:tasks.workunit.client.0.smithi070.stderr: -179> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:51.021 INFO:tasks.workunit.client.0.smithi070.stderr: -178> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:51.021 INFO:tasks.workunit.client.0.smithi070.stderr: -177> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:51.021 INFO:tasks.workunit.client.0.smithi070.stderr: -176> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): get_auth_request con 0x561556d7f2a0 auth_method 0 2024-09-12T00:58:51.021 INFO:tasks.workunit.client.0.smithi070.stderr: -175> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:51.021 INFO:tasks.workunit.client.0.smithi070.stderr: -174> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:51.021 INFO:tasks.workunit.client.0.smithi070.stderr: -173> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:51.021 INFO:tasks.workunit.client.0.smithi070.stderr: -172> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:51.021 INFO:tasks.workunit.client.0.smithi070.stderr: -171> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:51.021 INFO:tasks.workunit.client.0.smithi070.stderr: -170> 2024-09-12T00:58:50.621+0000 7feec1bb7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:51.021 INFO:tasks.workunit.client.0.smithi070.stderr: -169> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:58:51.021 INFO:tasks.workunit.client.0.smithi070.stderr: -168> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:58:51.021 INFO:tasks.workunit.client.0.smithi070.stderr: -167> 2024-09-12T00:58:50.621+0000 7feec0bb5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:58:51.021 INFO:tasks.workunit.client.0.smithi070.stderr: -166> 2024-09-12T00:58:50.621+0000 7feec13b6640 10 monclient(hunting): get_auth_request con 0x561556d70ea0 auth_method 0 2024-09-12T00:58:51.021 INFO:tasks.workunit.client.0.smithi070.stderr: -165> 2024-09-12T00:58:50.621+0000 7feec13b6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:58:51.022 INFO:tasks.workunit.client.0.smithi070.stderr: -164> 2024-09-12T00:58:50.621+0000 7feec13b6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:58:51.022 INFO:tasks.workunit.client.0.smithi070.stderr: -163> 2024-09-12T00:58:50.621+0000 7feec13b6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:58:51.022 INFO:tasks.workunit.client.0.smithi070.stderr: -162> 2024-09-12T00:58:50.625+0000 7feec1bb7640 10 monclient(hunting): handle_auth_done global_id 7673 payload 824 2024-09-12T00:58:51.022 INFO:tasks.workunit.client.0.smithi070.stderr: -161> 2024-09-12T00:58:50.625+0000 7feec1bb7640 10 monclient: _finish_hunting 0 2024-09-12T00:58:51.022 INFO:tasks.workunit.client.0.smithi070.stderr: -160> 2024-09-12T00:58:50.625+0000 7feec1bb7640 1 monclient: found mon.noname-c 2024-09-12T00:58:51.022 INFO:tasks.workunit.client.0.smithi070.stderr: -159> 2024-09-12T00:58:50.625+0000 7feec1bb7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:58:51.022 INFO:tasks.workunit.client.0.smithi070.stderr: -158> 2024-09-12T00:58:50.625+0000 7fed92ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:51.022 INFO:tasks.workunit.client.0.smithi070.stderr: -157> 2024-09-12T00:58:50.625+0000 7fed92ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:58:51.022 INFO:tasks.workunit.client.0.smithi070.stderr: -156> 2024-09-12T00:58:50.625+0000 7fed92ffd640 10 monclient: dump: 2024-09-12T00:58:51.022 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:51.022 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:51.022 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:51.022 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:51.022 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:51.023 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:51.023 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:51.023 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:51.023 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:51.023 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:51.023 INFO:tasks.workunit.client.0.smithi070.stderr: -155> 2024-09-12T00:58:50.625+0000 7fed92ffd640 10 monclient: _finish_auth 0 2024-09-12T00:58:51.023 INFO:tasks.workunit.client.0.smithi070.stderr: -154> 2024-09-12T00:58:50.625+0000 7fed92ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:58:51.023 INFO:tasks.workunit.client.0.smithi070.stderr: -153> 2024-09-12T00:58:50.625+0000 7fed92ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:58:51.023 INFO:tasks.workunit.client.0.smithi070.stderr: -152> 2024-09-12T00:58:50.625+0000 7fed92ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:58:51.023 INFO:tasks.workunit.client.0.smithi070.stderr: -151> 2024-09-12T00:58:50.625+0000 7fed92ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:58:51.023 INFO:tasks.workunit.client.0.smithi070.stderr: -150> 2024-09-12T00:58:50.625+0000 7fed92ffd640 10 monclient: dump: 2024-09-12T00:58:51.023 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:58:51.023 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:58:51.023 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:51.024 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:58:51.024 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:58:51.024 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:58:51.024 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:58:51.024 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:58:51.024 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:58:51.024 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:51.024 INFO:tasks.workunit.client.0.smithi070.stderr: -149> 2024-09-12T00:58:50.625+0000 7feec38b09c0 5 monclient: authenticate success, global_id 7673 2024-09-12T00:58:51.024 INFO:tasks.workunit.client.0.smithi070.stderr: -148> 2024-09-12T00:58:50.625+0000 7feec38b09c0 10 monclient: _renew_subs 2024-09-12T00:58:51.024 INFO:tasks.workunit.client.0.smithi070.stderr: -147> 2024-09-12T00:58:50.625+0000 7feda4ff9640 4 set_mon_vals no callback set 2024-09-12T00:58:51.024 INFO:tasks.workunit.client.0.smithi070.stderr: -146> 2024-09-12T00:58:50.625+0000 7feec38b09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:58:51.024 INFO:tasks.workunit.client.0.smithi070.stderr: -145> 2024-09-12T00:58:50.625+0000 7feec38b09c0 10 monclient: _renew_subs 2024-09-12T00:58:51.024 INFO:tasks.workunit.client.0.smithi070.stderr: -144> 2024-09-12T00:58:50.625+0000 7feec38b09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:58:51.024 INFO:tasks.workunit.client.0.smithi070.stderr: -143> 2024-09-12T00:58:50.625+0000 7feec38b09c0 1 librados: init done 2024-09-12T00:58:51.025 INFO:tasks.workunit.client.0.smithi070.stderr: -142> 2024-09-12T00:58:50.625+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command cr dump hook 0x561556d71838 2024-09-12T00:58:51.025 INFO:tasks.workunit.client.0.smithi070.stderr: -141> 2024-09-12T00:58:50.625+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.025 INFO:tasks.workunit.client.0.smithi070.stderr: -140> 2024-09-12T00:58:50.625+0000 7fed92ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:58:51.025 INFO:tasks.workunit.client.0.smithi070.stderr: -139> 2024-09-12T00:58:50.625+0000 7fed92ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:58:51.025 INFO:tasks.workunit.client.0.smithi070.stderr: -138> 2024-09-12T00:58:50.625+0000 7fed92ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:58:51.025 INFO:tasks.workunit.client.0.smithi070.stderr: -137> 2024-09-12T00:58:50.625+0000 7feec13b6640 10 monclient: get_auth_request con 0x7fed8c070ae0 auth_method 0 2024-09-12T00:58:51.025 INFO:tasks.workunit.client.0.smithi070.stderr: -136> 2024-09-12T00:58:50.625+0000 7feec0bb5640 10 monclient: get_auth_request con 0x561556d98c40 auth_method 0 2024-09-12T00:58:51.025 INFO:tasks.workunit.client.0.smithi070.stderr: -135> 2024-09-12T00:58:50.625+0000 7feec38b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:51.025 INFO:tasks.workunit.client.0.smithi070.stderr: -134> 2024-09-12T00:58:50.625+0000 7feec38b09c0 20 realm 2024-09-12T00:58:51.025 INFO:tasks.workunit.client.0.smithi070.stderr: -133> 2024-09-12T00:58:50.625+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.025 INFO:tasks.workunit.client.0.smithi070.stderr: -132> 2024-09-12T00:58:50.625+0000 7feec38b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:51.025 INFO:tasks.workunit.client.0.smithi070.stderr: -131> 2024-09-12T00:58:50.625+0000 7feec38b09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:51.025 INFO:tasks.workunit.client.0.smithi070.stderr: -130> 2024-09-12T00:58:50.625+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.025 INFO:tasks.workunit.client.0.smithi070.stderr: -129> 2024-09-12T00:58:50.625+0000 7feec38b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:51.026 INFO:tasks.workunit.client.0.smithi070.stderr: -128> 2024-09-12T00:58:50.625+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.026 INFO:tasks.workunit.client.0.smithi070.stderr: -127> 2024-09-12T00:58:50.629+0000 7feec13b6640 10 monclient: get_auth_request con 0x561556d9ce70 auth_method 0 2024-09-12T00:58:51.026 INFO:tasks.workunit.client.0.smithi070.stderr: -126> 2024-09-12T00:58:50.629+0000 7feec38b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:51.026 INFO:tasks.workunit.client.0.smithi070.stderr: -125> 2024-09-12T00:58:50.629+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.026 INFO:tasks.workunit.client.0.smithi070.stderr: -124> 2024-09-12T00:58:50.629+0000 7feec0bb5640 10 monclient: get_auth_request con 0x561556da06f0 auth_method 0 2024-09-12T00:58:51.026 INFO:tasks.workunit.client.0.smithi070.stderr: -123> 2024-09-12T00:58:50.629+0000 7fed92ffd640 1 client.7673.objecter ms_handle_reset 0x561556da06f0 session 0x561556d9c1c0 osd.0 2024-09-12T00:58:51.026 INFO:tasks.workunit.client.0.smithi070.stderr: -122> 2024-09-12T00:58:50.629+0000 7fed92ffd640 10 monclient: _renew_subs 2024-09-12T00:58:51.026 INFO:tasks.workunit.client.0.smithi070.stderr: -121> 2024-09-12T00:58:50.629+0000 7fed92ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:58:51.026 INFO:tasks.workunit.client.0.smithi070.stderr: -120> 2024-09-12T00:58:50.629+0000 7feec0bb5640 10 monclient: get_auth_request con 0x7fed8c080880 auth_method 0 2024-09-12T00:58:51.026 INFO:tasks.workunit.client.0.smithi070.stderr: -119> 2024-09-12T00:58:50.629+0000 7feec38b09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:51.026 INFO:tasks.workunit.client.0.smithi070.stderr: -118> 2024-09-12T00:58:50.629+0000 7feec38b09c0 20 searching for the correct realm 2024-09-12T00:58:51.026 INFO:tasks.workunit.client.0.smithi070.stderr: -117> 2024-09-12T00:58:50.629+0000 7feec1bb7640 10 monclient: get_auth_request con 0x561556da27c0 auth_method 0 2024-09-12T00:58:51.026 INFO:tasks.workunit.client.0.smithi070.stderr: -116> 2024-09-12T00:58:50.633+0000 7feec13b6640 10 monclient: get_auth_request con 0x7feebc026060 auth_method 0 2024-09-12T00:58:51.026 INFO:tasks.workunit.client.0.smithi070.stderr: -115> 2024-09-12T00:58:50.633+0000 7feec0bb5640 10 monclient: get_auth_request con 0x7feeb401a040 auth_method 0 2024-09-12T00:58:51.027 INFO:tasks.workunit.client.0.smithi070.stderr: -114> 2024-09-12T00:58:50.633+0000 7feec1bb7640 10 monclient: get_auth_request con 0x7feeb80e2c50 auth_method 0 2024-09-12T00:58:51.027 INFO:tasks.workunit.client.0.smithi070.stderr: -113> 2024-09-12T00:58:50.633+0000 7feec1bb7640 0 -- 172.21.15.70:0/792736637 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7feeb80e2c50 msgr2=0x7feeb80dc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:58:51.027 INFO:tasks.workunit.client.0.smithi070.stderr: -112> 2024-09-12T00:58:50.837+0000 7feec1bb7640 10 monclient: get_auth_request con 0x7feeb80e2c50 auth_method 0 2024-09-12T00:58:51.027 INFO:tasks.workunit.client.0.smithi070.stderr: -111> 2024-09-12T00:58:50.841+0000 7feec13b6640 10 monclient: get_auth_request con 0x7feebc0695c0 auth_method 0 2024-09-12T00:58:51.027 INFO:tasks.workunit.client.0.smithi070.stderr: -110> 2024-09-12T00:58:50.849+0000 7feec1bb7640 0 -- 172.21.15.70:0/792736637 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7feeb80e2c50 msgr2=0x7feeb80dc9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:51.027 INFO:tasks.workunit.client.0.smithi070.stderr: -109> 2024-09-12T00:58:50.849+0000 7fed92ffd640 1 client.7673.objecter ms_handle_reset 0x7feeb80e2c50 session 0x7feeb80e3040 osd.4 2024-09-12T00:58:51.027 INFO:tasks.workunit.client.0.smithi070.stderr: -108> 2024-09-12T00:58:50.849+0000 7feec1bb7640 10 monclient: get_auth_request con 0x561556da06f0 auth_method 0 2024-09-12T00:58:51.027 INFO:tasks.workunit.client.0.smithi070.stderr: -107> 2024-09-12T00:58:50.861+0000 7feec38b09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:51.027 INFO:tasks.workunit.client.0.smithi070.stderr: -106> 2024-09-12T00:58:50.861+0000 7feec38b09c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:58:51.027 INFO:tasks.workunit.client.0.smithi070.stderr: -105> 2024-09-12T00:58:50.861+0000 7feec38b09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:51.027 INFO:tasks.workunit.client.0.smithi070.stderr: -104> 2024-09-12T00:58:50.861+0000 7feec38b09c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:58:51.027 INFO:tasks.workunit.client.0.smithi070.stderr: -103> 2024-09-12T00:58:50.861+0000 7feec38b09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:51.027 INFO:tasks.workunit.client.0.smithi070.stderr: -102> 2024-09-12T00:58:50.861+0000 7feec38b09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:51.027 INFO:tasks.workunit.client.0.smithi070.stderr: -101> 2024-09-12T00:58:50.861+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.028 INFO:tasks.workunit.client.0.smithi070.stderr: -100> 2024-09-12T00:58:50.861+0000 7feec38b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:51.028 INFO:tasks.workunit.client.0.smithi070.stderr: -99> 2024-09-12T00:58:50.861+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.028 INFO:tasks.workunit.client.0.smithi070.stderr: -98> 2024-09-12T00:58:50.861+0000 7feec38b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:51.028 INFO:tasks.workunit.client.0.smithi070.stderr: -97> 2024-09-12T00:58:50.861+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.028 INFO:tasks.workunit.client.0.smithi070.stderr: -96> 2024-09-12T00:58:50.865+0000 7feec38b09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:51.028 INFO:tasks.workunit.client.0.smithi070.stderr: -95> 2024-09-12T00:58:50.865+0000 7feec38b09c0 20 zone default found 2024-09-12T00:58:51.028 INFO:tasks.workunit.client.0.smithi070.stderr: -94> 2024-09-12T00:58:50.865+0000 7feec38b09c0 4 Realm: () 2024-09-12T00:58:51.028 INFO:tasks.workunit.client.0.smithi070.stderr: -93> 2024-09-12T00:58:50.865+0000 7feec38b09c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:58:51.028 INFO:tasks.workunit.client.0.smithi070.stderr: -92> 2024-09-12T00:58:50.865+0000 7feec38b09c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:58:51.028 INFO:tasks.workunit.client.0.smithi070.stderr: -91> 2024-09-12T00:58:50.865+0000 7feec38b09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:51.028 INFO:tasks.workunit.client.0.smithi070.stderr: -90> 2024-09-12T00:58:50.865+0000 7feec38b09c0 20 zonegroup default 2024-09-12T00:58:51.028 INFO:tasks.workunit.client.0.smithi070.stderr: -89> 2024-09-12T00:58:50.865+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.028 INFO:tasks.workunit.client.0.smithi070.stderr: -88> 2024-09-12T00:58:50.865+0000 7feec38b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:51.029 INFO:tasks.workunit.client.0.smithi070.stderr: -87> 2024-09-12T00:58:50.865+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.029 INFO:tasks.workunit.client.0.smithi070.stderr: -86> 2024-09-12T00:58:50.865+0000 7feec38b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:51.029 INFO:tasks.workunit.client.0.smithi070.stderr: -85> 2024-09-12T00:58:50.865+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.029 INFO:tasks.workunit.client.0.smithi070.stderr: -84> 2024-09-12T00:58:50.865+0000 7feec38b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:51.029 INFO:tasks.workunit.client.0.smithi070.stderr: -83> 2024-09-12T00:58:50.865+0000 7feec38b09c0 20 started sync module instance, tier type = 2024-09-12T00:58:51.029 INFO:tasks.workunit.client.0.smithi070.stderr: -82> 2024-09-12T00:58:50.865+0000 7feec38b09c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:58:51.029 INFO:tasks.workunit.client.0.smithi070.stderr: -81> 2024-09-12T00:58:50.889+0000 7feec38b09c0 20 add_watcher() i=0 2024-09-12T00:58:51.029 INFO:tasks.workunit.client.0.smithi070.stderr: -80> 2024-09-12T00:58:50.889+0000 7feec38b09c0 20 add_watcher() i=1 2024-09-12T00:58:51.029 INFO:tasks.workunit.client.0.smithi070.stderr: -79> 2024-09-12T00:58:50.889+0000 7feec38b09c0 20 add_watcher() i=2 2024-09-12T00:58:51.029 INFO:tasks.workunit.client.0.smithi070.stderr: -78> 2024-09-12T00:58:50.889+0000 7feec38b09c0 20 add_watcher() i=3 2024-09-12T00:58:51.029 INFO:tasks.workunit.client.0.smithi070.stderr: -77> 2024-09-12T00:58:50.889+0000 7feec38b09c0 20 add_watcher() i=4 2024-09-12T00:58:51.029 INFO:tasks.workunit.client.0.smithi070.stderr: -76> 2024-09-12T00:58:50.889+0000 7feec38b09c0 20 add_watcher() i=5 2024-09-12T00:58:51.029 INFO:tasks.workunit.client.0.smithi070.stderr: -75> 2024-09-12T00:58:50.889+0000 7feec38b09c0 20 add_watcher() i=6 2024-09-12T00:58:51.029 INFO:tasks.workunit.client.0.smithi070.stderr: -74> 2024-09-12T00:58:50.889+0000 7feec38b09c0 20 add_watcher() i=7 2024-09-12T00:58:51.030 INFO:tasks.workunit.client.0.smithi070.stderr: -73> 2024-09-12T00:58:50.889+0000 7feec38b09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:51.030 INFO:tasks.workunit.client.0.smithi070.stderr: -72> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding auth protocol: cephx 2024-09-12T00:58:51.030 INFO:tasks.workunit.client.0.smithi070.stderr: -71> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding auth protocol: cephx 2024-09-12T00:58:51.030 INFO:tasks.workunit.client.0.smithi070.stderr: -70> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding auth protocol: cephx 2024-09-12T00:58:51.030 INFO:tasks.workunit.client.0.smithi070.stderr: -69> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding con mode: secure 2024-09-12T00:58:51.030 INFO:tasks.workunit.client.0.smithi070.stderr: -68> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding con mode: crc 2024-09-12T00:58:51.030 INFO:tasks.workunit.client.0.smithi070.stderr: -67> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding con mode: secure 2024-09-12T00:58:51.030 INFO:tasks.workunit.client.0.smithi070.stderr: -66> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding con mode: crc 2024-09-12T00:58:51.030 INFO:tasks.workunit.client.0.smithi070.stderr: -65> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding con mode: secure 2024-09-12T00:58:51.030 INFO:tasks.workunit.client.0.smithi070.stderr: -64> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding con mode: crc 2024-09-12T00:58:51.030 INFO:tasks.workunit.client.0.smithi070.stderr: -63> 2024-09-12T00:58:50.893+0000 7fed777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:51.030 INFO:tasks.workunit.client.0.smithi070.stderr: -62> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding con mode: crc 2024-09-12T00:58:51.030 INFO:tasks.workunit.client.0.smithi070.stderr: -61> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding con mode: secure 2024-09-12T00:58:51.030 INFO:tasks.workunit.client.0.smithi070.stderr: -60> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding con mode: crc 2024-09-12T00:58:51.031 INFO:tasks.workunit.client.0.smithi070.stderr: -59> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding con mode: secure 2024-09-12T00:58:51.031 INFO:tasks.workunit.client.0.smithi070.stderr: -58> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding con mode: crc 2024-09-12T00:58:51.031 INFO:tasks.workunit.client.0.smithi070.stderr: -57> 2024-09-12T00:58:50.893+0000 7feec38b09c0 5 AuthRegistry(0x7ffef9888570) adding con mode: secure 2024-09-12T00:58:51.031 INFO:tasks.workunit.client.0.smithi070.stderr: -56> 2024-09-12T00:58:50.897+0000 7feec38b09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:58:51.031 INFO:tasks.workunit.client.0.smithi070.stderr: -55> 2024-09-12T00:58:50.897+0000 7feec38b09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:51.031 INFO:tasks.workunit.client.0.smithi070.stderr: -54> 2024-09-12T00:58:50.897+0000 7feec38b09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:51.031 INFO:tasks.workunit.client.0.smithi070.stderr: -53> 2024-09-12T00:58:50.897+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command cache list hook 0x561556d75000 2024-09-12T00:58:51.031 INFO:tasks.workunit.client.0.smithi070.stderr: -52> 2024-09-12T00:58:50.897+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command cache inspect hook 0x561556d75000 2024-09-12T00:58:51.031 INFO:tasks.workunit.client.0.smithi070.stderr: -51> 2024-09-12T00:58:50.897+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command cache erase hook 0x561556d75000 2024-09-12T00:58:51.031 INFO:tasks.workunit.client.0.smithi070.stderr: -50> 2024-09-12T00:58:50.897+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command cache zap hook 0x561556d75000 2024-09-12T00:58:51.031 INFO:tasks.workunit.client.0.smithi070.stderr: -49> 2024-09-12T00:58:50.897+0000 7feec38b09c0 5 note: GC not initialized 2024-09-12T00:58:51.031 INFO:tasks.workunit.client.0.smithi070.stderr: -48> 2024-09-12T00:58:50.897+0000 7fed767e4640 20 reqs_thread_entry: start 2024-09-12T00:58:51.031 INFO:tasks.workunit.client.0.smithi070.stderr: -47> 2024-09-12T00:58:50.897+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command sync trace show hook 0x7feeb4062040 2024-09-12T00:58:51.031 INFO:tasks.workunit.client.0.smithi070.stderr: -46> 2024-09-12T00:58:50.897+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command sync trace history hook 0x7feeb4062040 2024-09-12T00:58:51.032 INFO:tasks.workunit.client.0.smithi070.stderr: -45> 2024-09-12T00:58:50.897+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command sync trace active hook 0x7feeb4062040 2024-09-12T00:58:51.032 INFO:tasks.workunit.client.0.smithi070.stderr: -44> 2024-09-12T00:58:50.897+0000 7feec38b09c0 5 asok(0x561556aa42b0) register_command sync trace active_short hook 0x7feeb4062040 2024-09-12T00:58:51.032 INFO:tasks.workunit.client.0.smithi070.stderr: -43> 2024-09-12T00:58:50.897+0000 7feec38b09c0 20 init_complete bucket index max shards: 1 2024-09-12T00:58:51.032 INFO:tasks.workunit.client.0.smithi070.stderr: -42> 2024-09-12T00:58:50.897+0000 7feec38b09c0 20 Filter name: none 2024-09-12T00:58:51.032 INFO:tasks.workunit.client.0.smithi070.stderr: -41> 2024-09-12T00:58:50.897+0000 7fece7fff640 20 reqs_thread_entry: start 2024-09-12T00:58:51.032 INFO:tasks.workunit.client.0.smithi070.stderr: -40> 2024-09-12T00:58:50.897+0000 7feec38b09c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:58:51.032 INFO:tasks.workunit.client.0.smithi070.stderr: -39> 2024-09-12T00:58:50.897+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.032 INFO:tasks.workunit.client.0.smithi070.stderr: -38> 2024-09-12T00:58:50.897+0000 7feec38b09c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:58:51.032 INFO:tasks.workunit.client.0.smithi070.stderr: -37> 2024-09-12T00:58:50.897+0000 7feec38b09c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:58:51.032 INFO:tasks.workunit.client.0.smithi070.stderr: -36> 2024-09-12T00:58:50.897+0000 7feec38b09c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:58:51.032 INFO:tasks.workunit.client.0.smithi070.stderr: -35> 2024-09-12T00:58:50.897+0000 7feec38b09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : miss 2024-09-12T00:58:51.032 INFO:tasks.workunit.client.0.smithi070.stderr: -34> 2024-09-12T00:58:50.897+0000 7feec38b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.032 INFO:tasks.workunit.client.0.smithi070.stderr: -33> 2024-09-12T00:58:50.901+0000 7feec38b09c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:58:51.032 INFO:tasks.workunit.client.0.smithi070.stderr: -32> 2024-09-12T00:58:50.901+0000 7feec38b09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:58:51.033 INFO:tasks.workunit.client.0.smithi070.stderr: -31> 2024-09-12T00:58:50.901+0000 7feec38b09c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:58:51.033 INFO:tasks.workunit.client.0.smithi070.stderr: -30> 2024-09-12T00:58:50.901+0000 7feec38b09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:58:51.033 INFO:tasks.workunit.client.0.smithi070.stderr: -29> 2024-09-12T00:58:50.901+0000 7feec38b09c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:58:51.033 INFO:tasks.workunit.client.0.smithi070.stderr: -28> 2024-09-12T00:58:50.901+0000 7feec38b09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T00:58:51.033 INFO:tasks.workunit.client.0.smithi070.stderr: -27> 2024-09-12T00:58:50.909+0000 7feec38b09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:58:51.033 INFO:tasks.workunit.client.0.smithi070.stderr: -26> 2024-09-12T00:58:50.909+0000 7feec38b09c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:58:51.033 INFO:tasks.workunit.client.0.smithi070.stderr: -25> 2024-09-12T00:58:50.909+0000 7feec38b09c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:58:51.033 INFO:tasks.workunit.client.0.smithi070.stderr: -24> 2024-09-12T00:58:50.909+0000 7feec38b09c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18, ofs0, ns] 2024-09-12T00:58:51.033 INFO:tasks.workunit.client.0.smithi070.stderr: -23> 2024-09-12T00:58:50.909+0000 7feda4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431645 cookie 94649651458576 notifier 7673 bl.length()=911 2024-09-12T00:58:51.033 INFO:tasks.workunit.client.0.smithi070.stderr: -22> 2024-09-12T00:58:50.909+0000 7feda4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:58:51.033 INFO:tasks.workunit.client.0.smithi070.stderr: -21> 2024-09-12T00:58:50.909+0000 7feda4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:58:51.033 INFO:tasks.workunit.client.0.smithi070.stderr: -20> 2024-09-12T00:58:50.909+0000 7feda4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:58:51.033 INFO:tasks.workunit.client.0.smithi070.stderr: -19> 2024-09-12T00:58:50.909+0000 7feec38b09c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_sources= new_sources= 2024-09-12T00:58:51.034 INFO:tasks.workunit.client.0.smithi070.stderr: -18> 2024-09-12T00:58:50.909+0000 7feec38b09c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential sources added=[] removed=[] 2024-09-12T00:58:51.034 INFO:tasks.workunit.client.0.smithi070.stderr: -17> 2024-09-12T00:58:50.909+0000 7feec38b09c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_dests= new_dests= 2024-09-12T00:58:51.034 INFO:tasks.workunit.client.0.smithi070.stderr: -16> 2024-09-12T00:58:50.909+0000 7feec38b09c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential dests added=[] removed=[] 2024-09-12T00:58:51.034 INFO:tasks.workunit.client.0.smithi070.stderr: -15> 2024-09-12T00:58:50.917+0000 7feec38b09c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.0 2024-09-12T00:58:51.034 INFO:tasks.workunit.client.0.smithi070.stderr: -14> 2024-09-12T00:58:50.917+0000 7feec38b09c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.0 2024-09-12T00:58:51.034 INFO:tasks.workunit.client.0.smithi070.stderr: -13> 2024-09-12T00:58:50.917+0000 7feec38b09c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.1 2024-09-12T00:58:51.034 INFO:tasks.workunit.client.0.smithi070.stderr: -12> 2024-09-12T00:58:50.917+0000 7feec38b09c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.1 2024-09-12T00:58:51.034 INFO:tasks.workunit.client.0.smithi070.stderr: -11> 2024-09-12T00:58:50.917+0000 7feec38b09c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.2 2024-09-12T00:58:51.034 INFO:tasks.workunit.client.0.smithi070.stderr: -10> 2024-09-12T00:58:50.917+0000 7feec38b09c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.2 2024-09-12T00:58:51.034 INFO:tasks.workunit.client.0.smithi070.stderr: -9> 2024-09-12T00:58:50.917+0000 7feec38b09c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.3 2024-09-12T00:58:51.034 INFO:tasks.workunit.client.0.smithi070.stderr: -8> 2024-09-12T00:58:50.917+0000 7feec38b09c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.3 2024-09-12T00:58:51.034 INFO:tasks.workunit.client.0.smithi070.stderr: -7> 2024-09-12T00:58:50.917+0000 7feec38b09c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.0 2024-09-12T00:58:51.034 INFO:tasks.workunit.client.0.smithi070.stderr: -6> 2024-09-12T00:58:50.917+0000 7feec38b09c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.0 2024-09-12T00:58:51.034 INFO:tasks.workunit.client.0.smithi070.stderr: -5> 2024-09-12T00:58:50.917+0000 7feec38b09c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.1 2024-09-12T00:58:51.035 INFO:tasks.workunit.client.0.smithi070.stderr: -4> 2024-09-12T00:58:50.917+0000 7feec38b09c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.1 2024-09-12T00:58:51.035 INFO:tasks.workunit.client.0.smithi070.stderr: -3> 2024-09-12T00:58:50.917+0000 7feec38b09c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.2 2024-09-12T00:58:51.035 INFO:tasks.workunit.client.0.smithi070.stderr: -2> 2024-09-12T00:58:50.917+0000 7feec38b09c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.2 2024-09-12T00:58:51.035 INFO:tasks.workunit.client.0.smithi070.stderr: -1> 2024-09-12T00:58:50.921+0000 7feec38b09c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7feec38b09c0 time 2024-09-12T00:58:50.925071+0000 2024-09-12T00:58:51.035 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:58:51.035 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:51.035 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:58:51.035 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7feec718a2eb] 2024-09-12T00:58:51.035 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7feec718a49f] 2024-09-12T00:58:51.035 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561553e65cc1] 2024-09-12T00:58:51.035 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x561553e7a01c] 2024-09-12T00:58:51.035 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561553e7b6a4] 2024-09-12T00:58:51.035 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:58:51.035 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7feec5ff0d90] 2024-09-12T00:58:51.036 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:58:51.036 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:58:51.036 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:51.036 INFO:tasks.workunit.client.0.smithi070.stderr: 0> 2024-09-12T00:58:50.925+0000 7feec38b09c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:58:51.036 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7feec38b09c0 thread_name:radosgw-admin 2024-09-12T00:58:51.036 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:51.036 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:58:51.036 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7feec6009520] 2024-09-12T00:58:51.036 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:58:51.036 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:58:51.036 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:58:51.036 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7feec718a345] 2024-09-12T00:58:51.036 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7feec718a49f] 2024-09-12T00:58:51.036 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561553e65cc1] 2024-09-12T00:58:51.037 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x561553e7a01c] 2024-09-12T00:58:51.037 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561553e7b6a4] 2024-09-12T00:58:51.037 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:58:51.037 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7feec5ff0d90] 2024-09-12T00:58:51.037 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:58:51.037 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:58:51.037 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:58:51.037 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:58:51.037 INFO:tasks.workunit.client.0.smithi070.stderr:--- logging levels --- 2024-09-12T00:58:51.037 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 none 2024-09-12T00:58:51.037 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 lockdep 2024-09-12T00:58:51.037 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 context 2024-09-12T00:58:51.037 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 crush 2024-09-12T00:58:51.037 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds 2024-09-12T00:58:51.038 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_balancer 2024-09-12T00:58:51.038 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_locker 2024-09-12T00:58:51.038 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log 2024-09-12T00:58:51.038 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log_expire 2024-09-12T00:58:51.038 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_migrator 2024-09-12T00:58:51.038 INFO:tasks.workunit.client.0.smithi070.stderr: 3/ 5 mds_quiesce 2024-09-12T00:58:51.038 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 buffer 2024-09-12T00:58:51.038 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 timer 2024-09-12T00:58:51.038 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 filer 2024-09-12T00:58:51.038 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 striper 2024-09-12T00:58:51.038 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 objecter 2024-09-12T00:58:51.038 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rados 2024-09-12T00:58:51.038 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd 2024-09-12T00:58:51.038 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_mirror 2024-09-12T00:58:51.038 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_replay 2024-09-12T00:58:51.039 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_pwl 2024-09-12T00:58:51.039 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 journaler 2024-09-12T00:58:51.039 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objectcacher 2024-09-12T00:58:51.039 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:58:51.039 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 client 2024-09-12T00:58:51.039 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 osd 2024-09-12T00:58:51.039 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 optracker 2024-09-12T00:58:51.039 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objclass 2024-09-12T00:58:51.039 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 filestore 2024-09-12T00:58:51.039 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 journal 2024-09-12T00:58:51.039 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 ms 2024-09-12T00:58:51.039 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mon 2024-09-12T00:58:51.039 INFO:tasks.workunit.client.0.smithi070.stderr: 0/10 monc 2024-09-12T00:58:51.039 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 paxos 2024-09-12T00:58:51.040 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 tp 2024-09-12T00:58:51.040 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 auth 2024-09-12T00:58:51.040 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 crypto 2024-09-12T00:58:51.040 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 finisher 2024-09-12T00:58:51.040 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 reserver 2024-09-12T00:58:51.040 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 heartbeatmap 2024-09-12T00:58:51.040 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 perfcounter 2024-09-12T00:58:51.040 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw 2024-09-12T00:58:51.040 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_sync 2024-09-12T00:58:51.040 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_datacache 2024-09-12T00:58:51.040 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_access 2024-09-12T00:58:51.040 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:58:51.040 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_flight 2024-09-12T00:58:51.040 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:58:51.041 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw_notification 2024-09-12T00:58:51.041 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 javaclient 2024-09-12T00:58:51.041 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 asok 2024-09-12T00:58:51.041 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 throttle 2024-09-12T00:58:51.041 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 refs 2024-09-12T00:58:51.041 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 compressor 2024-09-12T00:58:51.041 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluestore 2024-09-12T00:58:51.041 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluefs 2024-09-12T00:58:51.041 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 bdev 2024-09-12T00:58:51.041 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 kstore 2024-09-12T00:58:51.041 INFO:tasks.workunit.client.0.smithi070.stderr: 4/ 5 rocksdb 2024-09-12T00:58:51.041 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 fuse 2024-09-12T00:58:51.041 INFO:tasks.workunit.client.0.smithi070.stderr: 2/ 5 mgr 2024-09-12T00:58:51.041 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mgrc 2024-09-12T00:58:51.041 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 dpdk 2024-09-12T00:58:51.042 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 eventtrace 2024-09-12T00:58:51.042 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 prioritycache 2024-09-12T00:58:51.042 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 test 2024-09-12T00:58:51.042 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:58:51.042 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephsqlite 2024-09-12T00:58:51.042 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:58:51.042 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore 2024-09-12T00:58:51.042 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_onode 2024-09-12T00:58:51.042 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_odata 2024-09-12T00:58:51.042 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_omap 2024-09-12T00:58:51.042 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_tm 2024-09-12T00:58:51.042 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_t 2024-09-12T00:58:51.042 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:58:51.043 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_epm 2024-09-12T00:58:51.043 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_lba 2024-09-12T00:58:51.043 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:58:51.043 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cache 2024-09-12T00:58:51.043 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_journal 2024-09-12T00:58:51.043 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_device 2024-09-12T00:58:51.043 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_backref 2024-09-12T00:58:51.043 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 alienstore 2024-09-12T00:58:51.043 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mclock 2024-09-12T00:58:51.043 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cyanstore 2024-09-12T00:58:51.043 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 ceph_exporter 2024-09-12T00:58:51.043 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 memstore 2024-09-12T00:58:51.043 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 trace 2024-09-12T00:58:51.044 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 ceph_dedup 2024-09-12T00:58:51.044 INFO:tasks.workunit.client.0.smithi070.stderr: -2/-2 (syslog threshold) 2024-09-12T00:58:51.044 INFO:tasks.workunit.client.0.smithi070.stderr: 99/99 (stderr threshold) 2024-09-12T00:58:51.044 INFO:tasks.workunit.client.0.smithi070.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:58:51.044 INFO:tasks.workunit.client.0.smithi070.stderr: 7fece7fff640 / http_manager 2024-09-12T00:58:51.044 INFO:tasks.workunit.client.0.smithi070.stderr: 7fed767e4640 / http_manager 2024-09-12T00:58:51.044 INFO:tasks.workunit.client.0.smithi070.stderr: 7fed777e6640 / rgw_dt_lg_renew 2024-09-12T00:58:51.044 INFO:tasks.workunit.client.0.smithi070.stderr: 7fed92ffd640 / ms_dispatch 2024-09-12T00:58:51.044 INFO:tasks.workunit.client.0.smithi070.stderr: 7feda4ff9640 / io_context_pool 2024-09-12T00:58:51.044 INFO:tasks.workunit.client.0.smithi070.stderr: 7feda6ffd640 / ms_dispatch 2024-09-12T00:58:51.044 INFO:tasks.workunit.client.0.smithi070.stderr: 7fedade03640 / ms_dispatch 2024-09-12T00:58:51.044 INFO:tasks.workunit.client.0.smithi070.stderr: 7fedaf606640 / io_context_pool 2024-09-12T00:58:51.044 INFO:tasks.workunit.client.0.smithi070.stderr: 7feec0bb5640 / msgr-worker-2 2024-09-12T00:58:51.045 INFO:tasks.workunit.client.0.smithi070.stderr: 7feec13b6640 / msgr-worker-1 2024-09-12T00:58:51.045 INFO:tasks.workunit.client.0.smithi070.stderr: 7feec1bb7640 / msgr-worker-0 2024-09-12T00:58:51.045 INFO:tasks.workunit.client.0.smithi070.stderr: 7feec23b8640 / io_context_pool 2024-09-12T00:58:51.045 INFO:tasks.workunit.client.0.smithi070.stderr: 7feec38b09c0 / radosgw-admin 2024-09-12T00:58:51.045 INFO:tasks.workunit.client.0.smithi070.stderr: max_recent 500 2024-09-12T00:58:51.045 INFO:tasks.workunit.client.0.smithi070.stderr: max_new 1000 2024-09-12T00:58:51.045 INFO:tasks.workunit.client.0.smithi070.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:58:50.927535Z_e053cad0-46a7-43f5-9cd8-92beaa948dca/log 2024-09-12T00:58:51.045 INFO:tasks.workunit.client.0.smithi070.stderr:--- end dump of recent events --- 2024-09-12T00:58:51.045 INFO:tasks.workunit.client.0.smithi070.stderr:Aborted 2024-09-12T00:58:51.045 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:58:51.047 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:51.047 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:51.047 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.009+0000 7efeef7089c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.047 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.013+0000 7efeef7089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:51.047 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.013+0000 7efeef7089c0 20 realm 2024-09-12T00:58:51.047 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.013+0000 7efeef7089c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.047 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.013+0000 7efeef7089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:51.047 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.013+0000 7efeef7089c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:51.047 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.013+0000 7efeef7089c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.047 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.013+0000 7efeef7089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:51.047 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.013+0000 7efeef7089c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.047 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.013+0000 7efeef7089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:51.047 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.013+0000 7efeef7089c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.048 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.017+0000 7efeef7089c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:51.048 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.017+0000 7efeef7089c0 20 searching for the correct realm 2024-09-12T00:58:51.048 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.017+0000 7efeeda0f640 0 -- 172.21.15.70:0/1169842620 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7efee4019050 msgr2=0x7efee405d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:58:51.225 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.233+0000 7efeeda0f640 0 -- 172.21.15.70:0/1169842620 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7efee4019050 msgr2=0x7efee405d720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:51.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.245+0000 7efeef7089c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:51.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.245+0000 7efeef7089c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:58:51.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.245+0000 7efeef7089c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:51.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.245+0000 7efeef7089c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:58:51.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.245+0000 7efeef7089c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:51.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.245+0000 7efeef7089c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:51.236 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.245+0000 7efeef7089c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.245+0000 7efeef7089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:51.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.245+0000 7efeef7089c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.245+0000 7efeef7089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:51.237 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.245+0000 7efeef7089c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.249+0000 7efeef7089c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:51.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.249+0000 7efeef7089c0 20 zone default found 2024-09-12T00:58:51.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.249+0000 7efeef7089c0 4 Realm: () 2024-09-12T00:58:51.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.249+0000 7efeef7089c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:58:51.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.249+0000 7efeef7089c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:58:51.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.249+0000 7efeef7089c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:51.239 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.249+0000 7efeef7089c0 20 zonegroup default 2024-09-12T00:58:51.239 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.249+0000 7efeef7089c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.239 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.249+0000 7efeef7089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:51.239 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.249+0000 7efeef7089c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.239 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.249+0000 7efeef7089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:51.240 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.249+0000 7efeef7089c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.240 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.249+0000 7efeef7089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:51.240 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.249+0000 7efeef7089c0 20 started sync module instance, tier type = 2024-09-12T00:58:51.240 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.249+0000 7efeef7089c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:58:51.273 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.281+0000 7efeef7089c0 20 add_watcher() i=0 2024-09-12T00:58:51.273 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.281+0000 7efeef7089c0 20 add_watcher() i=1 2024-09-12T00:58:51.273 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.281+0000 7efeef7089c0 20 add_watcher() i=2 2024-09-12T00:58:51.273 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.281+0000 7efeef7089c0 20 add_watcher() i=3 2024-09-12T00:58:51.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.281+0000 7efeef7089c0 20 add_watcher() i=4 2024-09-12T00:58:51.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.281+0000 7efeef7089c0 20 add_watcher() i=5 2024-09-12T00:58:51.274 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.281+0000 7efeef7089c0 20 add_watcher() i=6 2024-09-12T00:58:51.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.285+0000 7efeef7089c0 20 add_watcher() i=7 2024-09-12T00:58:51.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.285+0000 7efeef7089c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:51.279 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.289+0000 7efda3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:51.281 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.289+0000 7efeef7089c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:51.281 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.289+0000 7efeef7089c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:51.281 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.289+0000 7efeef7089c0 5 note: GC not initialized 2024-09-12T00:58:51.281 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.289+0000 7efda2fe5640 20 reqs_thread_entry: start 2024-09-12T00:58:51.281 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.289+0000 7efeef7089c0 20 init_complete bucket index max shards: 1 2024-09-12T00:58:51.282 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.289+0000 7efeef7089c0 20 Filter name: none 2024-09-12T00:58:51.282 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.289+0000 7efda0fe1640 20 reqs_thread_entry: start 2024-09-12T00:58:51.282 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.289+0000 7efeef7089c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.293+0000 7efeef7089c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:58:51.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.293+0000 7efeef7089c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.293+0000 7efeef7089c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:58:51.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.293+0000 7efeef7089c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:58:51.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.293+0000 7efeef7089c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.293+0000 7efeef7089c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:58:51.286 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.293+0000 7efeef7089c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.297+0000 7efeef7089c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:58:51.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.297+0000 7efeef7089c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:58:51.290 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.297+0000 7efda3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:51.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.305+0000 7efeef7089c0 20 remove_watcher() i=0 2024-09-12T00:58:51.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.305+0000 7efeef7089c0 2 removed watcher, disabling cache 2024-09-12T00:58:51.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.305+0000 7efeef7089c0 20 remove_watcher() i=1 2024-09-12T00:58:51.300 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.309+0000 7efeef7089c0 20 remove_watcher() i=2 2024-09-12T00:58:51.302 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.309+0000 7efeef7089c0 20 remove_watcher() i=3 2024-09-12T00:58:51.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.313+0000 7efeef7089c0 20 remove_watcher() i=4 2024-09-12T00:58:51.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.313+0000 7efeef7089c0 20 remove_watcher() i=5 2024-09-12T00:58:51.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.317+0000 7efeef7089c0 20 remove_watcher() i=6 2024-09-12T00:58:51.308 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.317+0000 7efeef7089c0 20 remove_watcher() i=7 2024-09-12T00:58:51.333 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:58:51.333 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:58:51.346 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:58:51.379 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:51.379 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:51.423 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.433+0000 7fc4545c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.424 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.433+0000 7fc4545c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:51.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.433+0000 7fc4545c29c0 20 realm 2024-09-12T00:58:51.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.433+0000 7fc4545c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.433+0000 7fc4545c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:51.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.433+0000 7fc4545c29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:51.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.433+0000 7fc4545c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.433+0000 7fc4545c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:51.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.433+0000 7fc4545c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.437+0000 7fc4545c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:51.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.437+0000 7fc4545c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.428 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.437+0000 7fc4545c29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:51.428 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.437+0000 7fc4545c29c0 20 searching for the correct realm 2024-09-12T00:58:51.433 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.441+0000 7fc4528c9640 0 -- 172.21.15.70:0/1742642990 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fc43c089040 msgr2=0x7fc43c0159b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:51.440 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.449+0000 7fc4528c9640 0 -- 172.21.15.70:0/1742642990 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fc31c080900 msgr2=0x7fc31c082d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:51.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.457+0000 7fc4545c29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:51.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.457+0000 7fc4545c29c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:58:51.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.457+0000 7fc4545c29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:51.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.457+0000 7fc4545c29c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:58:51.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.457+0000 7fc4545c29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:51.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.457+0000 7fc4545c29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:51.449 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.457+0000 7fc4545c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.449 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.457+0000 7fc4545c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:51.449 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.457+0000 7fc4545c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.451 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.457+0000 7fc4545c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:51.452 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.457+0000 7fc4545c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.452 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.457+0000 7fc4545c29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:51.452 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.457+0000 7fc4545c29c0 20 zone default found 2024-09-12T00:58:51.452 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.457+0000 7fc4545c29c0 4 Realm: () 2024-09-12T00:58:51.452 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.457+0000 7fc4545c29c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:58:51.453 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.457+0000 7fc4545c29c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:58:51.453 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.457+0000 7fc4545c29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:51.453 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.457+0000 7fc4545c29c0 20 zonegroup default 2024-09-12T00:58:51.453 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.457+0000 7fc4545c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.453 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.457+0000 7fc4545c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:51.453 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.457+0000 7fc4545c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.454 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.457+0000 7fc4545c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:51.454 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.457+0000 7fc4545c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.454 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.457+0000 7fc4545c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:51.454 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.457+0000 7fc4545c29c0 20 started sync module instance, tier type = 2024-09-12T00:58:51.454 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.457+0000 7fc4545c29c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:58:51.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.473+0000 7fc4545c29c0 20 add_watcher() i=0 2024-09-12T00:58:51.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.473+0000 7fc4545c29c0 20 add_watcher() i=1 2024-09-12T00:58:51.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.473+0000 7fc4545c29c0 20 add_watcher() i=2 2024-09-12T00:58:51.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.473+0000 7fc4545c29c0 20 add_watcher() i=3 2024-09-12T00:58:51.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.473+0000 7fc4545c29c0 20 add_watcher() i=4 2024-09-12T00:58:51.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.473+0000 7fc4545c29c0 20 add_watcher() i=5 2024-09-12T00:58:51.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.473+0000 7fc4545c29c0 20 add_watcher() i=6 2024-09-12T00:58:51.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.473+0000 7fc4545c29c0 20 add_watcher() i=7 2024-09-12T00:58:51.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.473+0000 7fc4545c29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:51.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.477+0000 7fc308fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:51.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.477+0000 7fc4545c29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:51.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.477+0000 7fc4545c29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:51.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.477+0000 7fc4545c29c0 5 note: GC not initialized 2024-09-12T00:58:51.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.477+0000 7fc2837fe640 20 reqs_thread_entry: start 2024-09-12T00:58:51.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.477+0000 7fc4545c29c0 20 init_complete bucket index max shards: 1 2024-09-12T00:58:51.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.477+0000 7fc4545c29c0 20 Filter name: none 2024-09-12T00:58:51.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.477+0000 7fc2817fa640 20 reqs_thread_entry: start 2024-09-12T00:58:51.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.477+0000 7fc4545c29c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:58:51.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.477+0000 7fc4545c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.473 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.481+0000 7fc4545c29c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:58:51.474 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.481+0000 7fc4545c29c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:58:51.474 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.481+0000 7fc4545c29c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:58:51.474 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.481+0000 7fc4545c29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : miss 2024-09-12T00:58:51.474 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.481+0000 7fc4545c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:58:51.474 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.481+0000 7fc4545c29c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:58:51.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.481+0000 7fc4545c29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:58:51.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.481+0000 7fc4545c29c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:58:51.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.481+0000 7fc4545c29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:58:51.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.481+0000 7fc4545c29c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:58:51.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.481+0000 7fc4545c29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T00:58:51.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.481+0000 7fc4545c29c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.0 2024-09-12T00:58:51.476 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.481+0000 7fc4545c29c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.0 2024-09-12T00:58:51.476 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.481+0000 7fc4545c29c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.1 2024-09-12T00:58:51.476 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.481+0000 7fc4545c29c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.1 2024-09-12T00:58:51.476 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.481+0000 7fc4545c29c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.2 2024-09-12T00:58:51.476 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.481+0000 7fc4545c29c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.2 2024-09-12T00:58:51.477 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.485+0000 7fc308fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:51.479 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.489+0000 7fc4545c29c0 20 remove_watcher() i=0 2024-09-12T00:58:51.479 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.489+0000 7fc4545c29c0 2 removed watcher, disabling cache 2024-09-12T00:58:51.481 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.489+0000 7fc4545c29c0 20 remove_watcher() i=1 2024-09-12T00:58:51.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.493+0000 7fc4545c29c0 20 remove_watcher() i=2 2024-09-12T00:58:51.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.493+0000 7fc4545c29c0 20 remove_watcher() i=3 2024-09-12T00:58:51.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.497+0000 7fc4545c29c0 20 remove_watcher() i=4 2024-09-12T00:58:51.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.497+0000 7fc4545c29c0 20 remove_watcher() i=5 2024-09-12T00:58:51.490 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.497+0000 7fc4545c29c0 20 remove_watcher() i=6 2024-09-12T00:58:51.491 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:58:51.501+0000 7fc4545c29c0 20 remove_watcher() i=7 2024-09-12T00:59:21.536 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:59:21.568 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:59:21.569 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:59:21.612 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.621+0000 7ff53ffda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:21.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.621+0000 7ff53ffda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:21.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.621+0000 7ff53ffda9c0 20 realm 2024-09-12T00:59:21.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.621+0000 7ff53ffda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:21.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.621+0000 7ff53ffda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:21.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.621+0000 7ff53ffda9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:59:21.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.625+0000 7ff53ffda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:21.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.625+0000 7ff53ffda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:21.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.625+0000 7ff53ffda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:21.616 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.625+0000 7ff53ffda9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:59:21.616 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.625+0000 7ff53ffda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:21.616 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.625+0000 7ff53ffda9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:59:21.616 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.625+0000 7ff53ffda9c0 20 searching for the correct realm 2024-09-12T00:59:21.623 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.633+0000 7ff53dae0640 0 -- 172.21.15.70:0/197545301 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7ff538029410 msgr2=0x7ff538029870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:59:21.838 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.849+0000 7ff53d2df640 0 -- 172.21.15.70:0/197545301 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7ff5300d9040 msgr2=0x7ff5300d9930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:59:21.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.853+0000 7ff53ffda9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:59:21.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.853+0000 7ff53ffda9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:59:21.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.853+0000 7ff53ffda9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:59:21.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.853+0000 7ff53ffda9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:59:21.846 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.853+0000 7ff53ffda9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:59:21.846 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.853+0000 7ff53ffda9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:59:21.846 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.853+0000 7ff53ffda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:21.846 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.857+0000 7ff53ffda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:21.846 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.857+0000 7ff53ffda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:21.847 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.857+0000 7ff53ffda9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:59:21.847 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.857+0000 7ff53ffda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:21.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.857+0000 7ff53ffda9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:59:21.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.857+0000 7ff53ffda9c0 20 zone default found 2024-09-12T00:59:21.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.857+0000 7ff53ffda9c0 4 Realm: () 2024-09-12T00:59:21.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.857+0000 7ff53ffda9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:59:21.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.857+0000 7ff53ffda9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:59:21.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.857+0000 7ff53ffda9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:59:21.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.857+0000 7ff53ffda9c0 20 zonegroup default 2024-09-12T00:59:21.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.857+0000 7ff53ffda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:21.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.857+0000 7ff53ffda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:21.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.857+0000 7ff53ffda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:21.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.857+0000 7ff53ffda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:21.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.857+0000 7ff53ffda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:21.850 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.861+0000 7ff53ffda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:21.850 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.861+0000 7ff53ffda9c0 20 started sync module instance, tier type = 2024-09-12T00:59:21.850 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.861+0000 7ff53ffda9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:59:21.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.881+0000 7ff53ffda9c0 20 add_watcher() i=0 2024-09-12T00:59:21.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.881+0000 7ff53ffda9c0 20 add_watcher() i=1 2024-09-12T00:59:21.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.881+0000 7ff53ffda9c0 20 add_watcher() i=2 2024-09-12T00:59:21.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.881+0000 7ff53ffda9c0 20 add_watcher() i=3 2024-09-12T00:59:21.872 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.881+0000 7ff53ffda9c0 20 add_watcher() i=4 2024-09-12T00:59:21.872 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.881+0000 7ff53ffda9c0 20 add_watcher() i=5 2024-09-12T00:59:21.872 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.881+0000 7ff53ffda9c0 20 add_watcher() i=6 2024-09-12T00:59:21.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.881+0000 7ff53ffda9c0 20 add_watcher() i=7 2024-09-12T00:59:21.873 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.881+0000 7ff53ffda9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:59:21.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.885+0000 7ff3ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:59:21.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.885+0000 7ff53ffda9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:59:21.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.885+0000 7ff53ffda9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:59:21.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.885+0000 7ff53ffda9c0 5 note: GC not initialized 2024-09-12T00:59:21.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.885+0000 7ff3ee7fc640 20 reqs_thread_entry: start 2024-09-12T00:59:21.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.885+0000 7ff53ffda9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:59:21.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.885+0000 7ff53ffda9c0 20 Filter name: none 2024-09-12T00:59:21.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.889+0000 7ff53ffda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:21.878 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.889+0000 7ff35ffff640 20 reqs_thread_entry: start 2024-09-12T00:59:21.879 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.889+0000 7ff53ffda9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:59:21.879 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.889+0000 7ff53ffda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:21.880 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.889+0000 7ff53ffda9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:59:21.880 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.889+0000 7ff53ffda9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:59:21.880 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.889+0000 7ff53ffda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:21.881 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.889+0000 7ff53ffda9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:59:21.881 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.889+0000 7ff53ffda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:21.882 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.893+0000 7ff53ffda9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:59:21.882 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.893+0000 7ff53ffda9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:59:21.884 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.893+0000 7ff3ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:59:21.890 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.897+0000 7ff53ffda9c0 20 remove_watcher() i=0 2024-09-12T00:59:21.890 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.897+0000 7ff53ffda9c0 2 removed watcher, disabling cache 2024-09-12T00:59:21.892 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.901+0000 7ff53ffda9c0 20 remove_watcher() i=1 2024-09-12T00:59:21.894 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.905+0000 7ff53ffda9c0 20 remove_watcher() i=2 2024-09-12T00:59:21.896 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.905+0000 7ff53ffda9c0 20 remove_watcher() i=3 2024-09-12T00:59:21.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.909+0000 7ff53ffda9c0 20 remove_watcher() i=4 2024-09-12T00:59:21.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.909+0000 7ff53ffda9c0 20 remove_watcher() i=5 2024-09-12T00:59:21.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.913+0000 7ff53ffda9c0 20 remove_watcher() i=6 2024-09-12T00:59:21.903 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:21.913+0000 7ff53ffda9c0 20 remove_watcher() i=7 2024-09-12T00:59:21.922 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:59:21.923 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:59:21.952 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:59:21.984 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:59:21.984 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:59:22.028 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.037+0000 7f9bbf6da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.029 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.037+0000 7f9bbf6da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.029 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.037+0000 7f9bbf6da9c0 20 realm 2024-09-12T00:59:22.029 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.037+0000 7f9bbf6da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.030 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.037+0000 7f9bbf6da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.030 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.037+0000 7f9bbf6da9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:59:22.030 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.037+0000 7f9bbf6da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.030 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.037+0000 7f9bbf6da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.030 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.037+0000 7f9bbf6da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.031 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.041+0000 7f9bbf6da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:59:22.031 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.041+0000 7f9bbf6da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.032 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.041+0000 7f9bbf6da9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:59:22.032 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.041+0000 7f9bbf6da9c0 20 searching for the correct realm 2024-09-12T00:59:22.035 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.045+0000 7f9bbc9df640 0 -- 172.21.15.70:0/3442194283 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7f9bb0033060 msgr2=0x7f9bb0085970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:59:22.250 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.261+0000 7f9bbd1e0640 0 -- 172.21.15.70:0/3442194283 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f9bb80b8040 msgr2=0x7f9bb80f64e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:59:22.266 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.277+0000 7f9bbf6da9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:59:22.266 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.277+0000 7f9bbf6da9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:59:22.266 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.277+0000 7f9bbf6da9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:59:22.267 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.277+0000 7f9bbf6da9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:59:22.267 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.277+0000 7f9bbf6da9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:59:22.267 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.277+0000 7f9bbf6da9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:59:22.267 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.277+0000 7f9bbf6da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.267 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.277+0000 7f9bbf6da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.267 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.277+0000 7f9bbf6da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.277+0000 7f9bbf6da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:59:22.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.277+0000 7f9bbf6da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.268 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.277+0000 7f9bbf6da9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:59:22.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.277+0000 7f9bbf6da9c0 20 zone default found 2024-09-12T00:59:22.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.277+0000 7f9bbf6da9c0 4 Realm: () 2024-09-12T00:59:22.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.277+0000 7f9bbf6da9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:59:22.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.277+0000 7f9bbf6da9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:59:22.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.277+0000 7f9bbf6da9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:59:22.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.277+0000 7f9bbf6da9c0 20 zonegroup default 2024-09-12T00:59:22.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.277+0000 7f9bbf6da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.277+0000 7f9bbf6da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.277+0000 7f9bbf6da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.281+0000 7f9bbf6da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.281+0000 7f9bbf6da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.271 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.281+0000 7f9bbf6da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.271 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.281+0000 7f9bbf6da9c0 20 started sync module instance, tier type = 2024-09-12T00:59:22.271 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.281+0000 7f9bbf6da9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:59:22.293 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.301+0000 7f9bbf6da9c0 20 add_watcher() i=0 2024-09-12T00:59:22.293 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.301+0000 7f9bbf6da9c0 20 add_watcher() i=1 2024-09-12T00:59:22.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.301+0000 7f9bbf6da9c0 20 add_watcher() i=2 2024-09-12T00:59:22.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.301+0000 7f9bbf6da9c0 20 add_watcher() i=3 2024-09-12T00:59:22.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.301+0000 7f9bbf6da9c0 20 add_watcher() i=4 2024-09-12T00:59:22.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.301+0000 7f9bbf6da9c0 20 add_watcher() i=5 2024-09-12T00:59:22.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.301+0000 7f9bbf6da9c0 20 add_watcher() i=6 2024-09-12T00:59:22.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.305+0000 7f9bbf6da9c0 20 add_watcher() i=7 2024-09-12T00:59:22.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.305+0000 7f9bbf6da9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:59:22.300 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.309+0000 7f9a737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:59:22.301 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.309+0000 7f9bbf6da9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:59:22.301 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.309+0000 7f9bbf6da9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:59:22.302 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.309+0000 7f9bbf6da9c0 5 note: GC not initialized 2024-09-12T00:59:22.302 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.313+0000 7f9a727e4640 20 reqs_thread_entry: start 2024-09-12T00:59:22.302 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.313+0000 7f9bbf6da9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:59:22.303 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.313+0000 7f9bbf6da9c0 20 Filter name: none 2024-09-12T00:59:22.303 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.313+0000 7f99e3fff640 20 reqs_thread_entry: start 2024-09-12T00:59:22.303 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.313+0000 7f9bbf6da9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:59:22.303 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.313+0000 7f9bbf6da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.313+0000 7f9bbf6da9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:59:22.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.313+0000 7f9bbf6da9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:59:22.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.313+0000 7f9bbf6da9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:59:22.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.313+0000 7f9bbf6da9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : miss 2024-09-12T00:59:22.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.313+0000 7f9bbf6da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.313+0000 7f9bbf6da9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:59:22.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.313+0000 7f9bbf6da9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:59:22.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.313+0000 7f9bbf6da9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:59:22.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.313+0000 7f9bbf6da9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:59:22.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.313+0000 7f9bbf6da9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:59:22.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.313+0000 7f9bbf6da9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T00:59:22.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.313+0000 7f9bbf6da9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.0 2024-09-12T00:59:22.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.313+0000 7f9bbf6da9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.0 2024-09-12T00:59:22.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.317+0000 7f9bbf6da9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.1 2024-09-12T00:59:22.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.317+0000 7f9bbf6da9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.1 2024-09-12T00:59:22.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.317+0000 7f9bbf6da9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.2 2024-09-12T00:59:22.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.317+0000 7f9bbf6da9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.2 2024-09-12T00:59:22.309 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.317+0000 7f9a737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:59:22.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.325+0000 7f9bbf6da9c0 20 remove_watcher() i=0 2024-09-12T00:59:22.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.325+0000 7f9bbf6da9c0 2 removed watcher, disabling cache 2024-09-12T00:59:22.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.325+0000 7f9bbf6da9c0 20 remove_watcher() i=1 2024-09-12T00:59:22.319 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.329+0000 7f9bbf6da9c0 20 remove_watcher() i=2 2024-09-12T00:59:22.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.329+0000 7f9bbf6da9c0 20 remove_watcher() i=3 2024-09-12T00:59:22.324 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.333+0000 7f9bbf6da9c0 20 remove_watcher() i=4 2024-09-12T00:59:22.325 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.333+0000 7f9bbf6da9c0 20 remove_watcher() i=5 2024-09-12T00:59:22.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.337+0000 7f9bbf6da9c0 20 remove_watcher() i=6 2024-09-12T00:59:22.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.337+0000 7f9bbf6da9c0 20 remove_watcher() i=7 2024-09-12T00:59:22.348 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:59:22.380 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:59:22.380 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:59:22.423 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.433+0000 7f882ab4e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.433+0000 7f882ab4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.433+0000 7f882ab4e9c0 20 realm 2024-09-12T00:59:22.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.433+0000 7f882ab4e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.433+0000 7f882ab4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.433+0000 7f882ab4e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:59:22.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.433+0000 7f882ab4e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.433+0000 7f882ab4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.433+0000 7f882ab4e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.437+0000 7f882ab4e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:59:22.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.437+0000 7f882ab4e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.437+0000 7f882ab4e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:59:22.428 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.437+0000 7f882ab4e9c0 20 searching for the correct realm 2024-09-12T00:59:22.432 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.441+0000 7f8828e55640 0 -- 172.21.15.70:0/759444797 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f881c0df070 msgr2=0x7f881c0d67e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:59:22.440 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.449+0000 7f8828654640 0 -- 172.21.15.70:0/759444797 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f8820039440 msgr2=0x7f88200398c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:59:22.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.457+0000 7f882ab4e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:59:22.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.457+0000 7f882ab4e9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:59:22.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.457+0000 7f882ab4e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:59:22.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.457+0000 7f882ab4e9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:59:22.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.457+0000 7f882ab4e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:59:22.449 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.457+0000 7f882ab4e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:59:22.449 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.457+0000 7f882ab4e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.449 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.457+0000 7f882ab4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.449 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.457+0000 7f882ab4e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.457+0000 7f882ab4e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:59:22.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.457+0000 7f882ab4e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.457+0000 7f882ab4e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:59:22.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.457+0000 7f882ab4e9c0 20 zone default found 2024-09-12T00:59:22.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.457+0000 7f882ab4e9c0 4 Realm: () 2024-09-12T00:59:22.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.457+0000 7f882ab4e9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:59:22.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.457+0000 7f882ab4e9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:59:22.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.457+0000 7f882ab4e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:59:22.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.457+0000 7f882ab4e9c0 20 zonegroup default 2024-09-12T00:59:22.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.457+0000 7f882ab4e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.450 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.457+0000 7f882ab4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.451 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.457+0000 7f882ab4e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.451 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.461+0000 7f882ab4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.451 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.461+0000 7f882ab4e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.451 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.461+0000 7f882ab4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.451 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.461+0000 7f882ab4e9c0 20 started sync module instance, tier type = 2024-09-12T00:59:22.451 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.461+0000 7f882ab4e9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:59:22.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.473+0000 7f882ab4e9c0 20 add_watcher() i=0 2024-09-12T00:59:22.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.473+0000 7f882ab4e9c0 20 add_watcher() i=1 2024-09-12T00:59:22.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.473+0000 7f882ab4e9c0 20 add_watcher() i=2 2024-09-12T00:59:22.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.473+0000 7f882ab4e9c0 20 add_watcher() i=3 2024-09-12T00:59:22.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.473+0000 7f882ab4e9c0 20 add_watcher() i=4 2024-09-12T00:59:22.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.473+0000 7f882ab4e9c0 20 add_watcher() i=5 2024-09-12T00:59:22.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.473+0000 7f882ab4e9c0 20 add_watcher() i=6 2024-09-12T00:59:22.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.477+0000 7f882ab4e9c0 20 add_watcher() i=7 2024-09-12T00:59:22.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.477+0000 7f882ab4e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:59:22.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.477+0000 7f86de7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:59:22.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.477+0000 7f882ab4e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:59:22.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.477+0000 7f882ab4e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:59:22.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.477+0000 7f882ab4e9c0 5 note: GC not initialized 2024-09-12T00:59:22.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.477+0000 7f86dd7e2640 20 reqs_thread_entry: start 2024-09-12T00:59:22.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.477+0000 7f882ab4e9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:59:22.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.477+0000 7f882ab4e9c0 20 Filter name: none 2024-09-12T00:59:22.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.477+0000 7f864effd640 20 reqs_thread_entry: start 2024-09-12T00:59:22.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.481+0000 7f882ab4e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.481+0000 7f882ab4e9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:59:22.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.481+0000 7f882ab4e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.481+0000 7f882ab4e9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:59:22.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.481+0000 7f882ab4e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:59:22.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.481+0000 7f882ab4e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.481+0000 7f882ab4e9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:59:22.472 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.481+0000 7f882ab4e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.473 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.481+0000 7f882ab4e9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:59:22.473 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.481+0000 7f882ab4e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:59:22.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.485+0000 7f86de7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:59:22.480 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.489+0000 7f882ab4e9c0 20 remove_watcher() i=0 2024-09-12T00:59:22.480 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.489+0000 7f882ab4e9c0 2 removed watcher, disabling cache 2024-09-12T00:59:22.482 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.493+0000 7f882ab4e9c0 20 remove_watcher() i=1 2024-09-12T00:59:22.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.493+0000 7f882ab4e9c0 20 remove_watcher() i=2 2024-09-12T00:59:22.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.497+0000 7f882ab4e9c0 20 remove_watcher() i=3 2024-09-12T00:59:22.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.497+0000 7f882ab4e9c0 20 remove_watcher() i=4 2024-09-12T00:59:22.490 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.501+0000 7f882ab4e9c0 20 remove_watcher() i=5 2024-09-12T00:59:22.491 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.501+0000 7f882ab4e9c0 20 remove_watcher() i=6 2024-09-12T00:59:22.492 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.501+0000 7f882ab4e9c0 20 remove_watcher() i=7 2024-09-12T00:59:22.505 INFO:tasks.workunit.client.0.smithi070.stderr: test: duplicated entries should be purged before reshard 2024-09-12T00:59:22.506 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:59:22.532 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:59:22.532 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:59:22.575 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.585+0000 7fa246fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.577 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.585+0000 7fa246fd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.577 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.585+0000 7fa246fd29c0 20 realm 2024-09-12T00:59:22.577 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.585+0000 7fa246fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.577 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.585+0000 7fa246fd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.577 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.585+0000 7fa246fd29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:59:22.577 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.585+0000 7fa246fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.577 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.585+0000 7fa246fd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.577 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.585+0000 7fa246fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.579 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.589+0000 7fa246fd29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:59:22.579 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.589+0000 7fa246fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.579 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.589+0000 7fa246fd29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:59:22.580 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.589+0000 7fa246fd29c0 20 searching for the correct realm 2024-09-12T00:59:22.584 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.593+0000 7fa244ad8640 0 -- 172.21.15.70:0/3812385915 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7fa23c0253f0 msgr2=0x7fa23c025830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:59:22.593 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.601+0000 7fa244ad8640 0 -- 172.21.15.70:0/3812385915 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7fa23c037040 msgr2=0x7fa23c037420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:59:22.599 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.609+0000 7fa246fd29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:59:22.599 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.609+0000 7fa246fd29c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:59:22.599 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.609+0000 7fa246fd29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:59:22.599 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.609+0000 7fa246fd29c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:59:22.599 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.609+0000 7fa246fd29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:59:22.599 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.609+0000 7fa246fd29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:59:22.600 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.609+0000 7fa246fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.600 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.609+0000 7fa246fd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.600 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.609+0000 7fa246fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.609+0000 7fa246fd29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:59:22.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.609+0000 7fa246fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.609+0000 7fa246fd29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:59:22.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.609+0000 7fa246fd29c0 20 zone default found 2024-09-12T00:59:22.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.609+0000 7fa246fd29c0 4 Realm: () 2024-09-12T00:59:22.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.609+0000 7fa246fd29c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:59:22.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.609+0000 7fa246fd29c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:59:22.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.609+0000 7fa246fd29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:59:22.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.609+0000 7fa246fd29c0 20 zonegroup default 2024-09-12T00:59:22.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.609+0000 7fa246fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.609+0000 7fa246fd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.602 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.609+0000 7fa246fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.602 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.609+0000 7fa246fd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.602 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.609+0000 7fa246fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.602 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.613+0000 7fa246fd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.602 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.613+0000 7fa246fd29c0 20 started sync module instance, tier type = 2024-09-12T00:59:22.602 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.613+0000 7fa246fd29c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:59:22.617 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.625+0000 7fa246fd29c0 20 add_watcher() i=0 2024-09-12T00:59:22.617 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.625+0000 7fa246fd29c0 20 add_watcher() i=1 2024-09-12T00:59:22.617 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.625+0000 7fa246fd29c0 20 add_watcher() i=2 2024-09-12T00:59:22.617 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.625+0000 7fa246fd29c0 20 add_watcher() i=3 2024-09-12T00:59:22.617 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.625+0000 7fa246fd29c0 20 add_watcher() i=4 2024-09-12T00:59:22.617 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.625+0000 7fa246fd29c0 20 add_watcher() i=5 2024-09-12T00:59:22.617 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.625+0000 7fa246fd29c0 20 add_watcher() i=6 2024-09-12T00:59:22.618 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.629+0000 7fa246fd29c0 20 add_watcher() i=7 2024-09-12T00:59:22.618 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.629+0000 7fa246fd29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:59:22.621 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.629+0000 7fa0fafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:59:22.621 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.629+0000 7fa246fd29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:59:22.621 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.629+0000 7fa246fd29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:59:22.621 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.629+0000 7fa246fd29c0 5 note: GC not initialized 2024-09-12T00:59:22.622 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.629+0000 7fa0f9fe3640 20 reqs_thread_entry: start 2024-09-12T00:59:22.622 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.629+0000 7fa246fd29c0 20 init_complete bucket index max shards: 1 2024-09-12T00:59:22.622 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.629+0000 7fa246fd29c0 20 Filter name: none 2024-09-12T00:59:22.622 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.629+0000 7fa06b7fe640 20 reqs_thread_entry: start 2024-09-12T00:59:22.622 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.629+0000 7fa246fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.622 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.633+0000 7fa246fd29c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:59:22.622 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.633+0000 7fa246fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.623 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.633+0000 7fa246fd29c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:59:22.623 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.633+0000 7fa246fd29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:59:22.623 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.633+0000 7fa246fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.624 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.633+0000 7fa246fd29c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:59:22.624 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.633+0000 7fa246fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.633+0000 7fa246fd29c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:59:22.626 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.633+0000 7fa246fd29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:59:22.627 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.637+0000 7fa0fafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:59:22.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.641+0000 7fa246fd29c0 20 remove_watcher() i=0 2024-09-12T00:59:22.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.641+0000 7fa246fd29c0 2 removed watcher, disabling cache 2024-09-12T00:59:22.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.645+0000 7fa246fd29c0 20 remove_watcher() i=1 2024-09-12T00:59:22.636 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.645+0000 7fa246fd29c0 20 remove_watcher() i=2 2024-09-12T00:59:22.639 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.649+0000 7fa246fd29c0 20 remove_watcher() i=3 2024-09-12T00:59:22.641 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.649+0000 7fa246fd29c0 20 remove_watcher() i=4 2024-09-12T00:59:22.642 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.653+0000 7fa246fd29c0 20 remove_watcher() i=5 2024-09-12T00:59:22.643 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.653+0000 7fa246fd29c0 20 remove_watcher() i=6 2024-09-12T00:59:22.644 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.653+0000 7fa246fd29c0 20 remove_watcher() i=7 2024-09-12T00:59:22.658 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.658 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T00:59:22.658 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: a-bucket id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 num_objects: 10 size_kb: 1 num_shards: 3 2024-09-12T00:59:22.658 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.659 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:59:22.690 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:59:22.691 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:59:22.733 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.741+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.734 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.745+0000 7fc3f51899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.734 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.745+0000 7fc3f51899c0 20 realm 2024-09-12T00:59:22.735 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.745+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.735 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.745+0000 7fc3f51899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.735 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.745+0000 7fc3f51899c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:59:22.735 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.745+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.735 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.745+0000 7fc3f51899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.735 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.745+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.749+0000 7fc3f51899c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:59:22.739 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.749+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.749+0000 7fc3f51899c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:59:22.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.749+0000 7fc3f51899c0 20 searching for the correct realm 2024-09-12T00:59:22.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.753+0000 7fc3f2c8f640 0 -- 172.21.15.70:0/1138414970 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7fc3ec00e040 msgr2=0x7fc3ec01c8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:59:22.752 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.761+0000 7fc3f2c8f640 0 -- 172.21.15.70:0/1138414970 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7fc3ec029900 msgr2=0x7fc3ec028380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:59:22.758 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:59:22.758 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:59:22.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:59:22.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:59:22.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:59:22.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:59:22.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.760 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:59:22.760 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.760 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:59:22.760 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 zone default found 2024-09-12T00:59:22.760 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.769+0000 7fc3f51899c0 4 Realm: () 2024-09-12T00:59:22.760 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.769+0000 7fc3f51899c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:59:22.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.769+0000 7fc3f51899c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:59:22.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.769+0000 7fc3f51899c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:59:22.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 zonegroup default 2024-09-12T00:59:22.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 started sync module instance, tier type = 2024-09-12T00:59:22.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:59:22.776 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.785+0000 7fc3f51899c0 20 add_watcher() i=0 2024-09-12T00:59:22.776 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.785+0000 7fc3f51899c0 20 add_watcher() i=1 2024-09-12T00:59:22.776 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.785+0000 7fc3f51899c0 20 add_watcher() i=2 2024-09-12T00:59:22.777 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.785+0000 7fc3f51899c0 20 add_watcher() i=3 2024-09-12T00:59:22.777 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.785+0000 7fc3f51899c0 20 add_watcher() i=4 2024-09-12T00:59:22.777 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.785+0000 7fc3f51899c0 20 add_watcher() i=5 2024-09-12T00:59:22.777 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.785+0000 7fc3f51899c0 20 add_watcher() i=6 2024-09-12T00:59:22.777 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.785+0000 7fc3f51899c0 20 add_watcher() i=7 2024-09-12T00:59:22.781 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.785+0000 7fc3f51899c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:59:22.782 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.789+0000 7fc2a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:59:22.782 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.789+0000 7fc3f51899c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:59:22.782 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.789+0000 7fc3f51899c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:59:22.782 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 note: GC not initialized 2024-09-12T00:59:22.782 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.789+0000 7fc2a8fe1640 20 reqs_thread_entry: start 2024-09-12T00:59:22.782 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.789+0000 7fc3f51899c0 20 init_complete bucket index max shards: 1 2024-09-12T00:59:22.782 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.789+0000 7fc3f51899c0 20 Filter name: none 2024-09-12T00:59:22.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.789+0000 7fc2a1ffb640 20 reqs_thread_entry: start 2024-09-12T00:59:22.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.789+0000 7fc3f51899c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:59:22.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.789+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.789+0000 7fc3f51899c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:59:22.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.789+0000 7fc3f51899c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:59:22.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.789+0000 7fc3f51899c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:59:22.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.789+0000 7fc3f51899c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : miss 2024-09-12T00:59:22.783 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.789+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.784 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.793+0000 7fc3f51899c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:59:22.784 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.793+0000 7fc3f51899c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:59:22.784 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.793+0000 7fc3f51899c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:59:22.784 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.793+0000 7fc3f51899c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:59:22.784 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.793+0000 7fc3f51899c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:59:22.784 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.793+0000 7fc3f51899c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T00:59:22.790 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.801+0000 7fc3f51899c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:59:22.791 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.801+0000 7fc3f51899c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:59:22.791 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.801+0000 7fc3f51899c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:59:22.791 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.801+0000 7fc3f51899c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18, ofs0, ns] 2024-09-12T00:59:22.791 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.801+0000 7fc2d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431647 cookie 94002641468272 notifier 7790 bl.length()=911 2024-09-12T00:59:22.791 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.801+0000 7fc2d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:59:22.791 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.801+0000 7fc2d67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:59:22.792 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.801+0000 7fc2d67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:59:22.792 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.801+0000 7fc3f51899c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_sources= new_sources= 2024-09-12T00:59:22.792 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.801+0000 7fc3f51899c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential sources added=[] removed=[] 2024-09-12T00:59:22.793 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.801+0000 7fc3f51899c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_dests= new_dests= 2024-09-12T00:59:22.793 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.801+0000 7fc3f51899c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential dests added=[] removed=[] 2024-09-12T00:59:22.797 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc3f51899c0 time 2024-09-12T00:59:22.810711+0000 2024-09-12T00:59:22.798 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:59:22.799 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:59:22.799 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc3f8a632eb] 2024-09-12T00:59:22.799 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc3f8a6349f] 2024-09-12T00:59:22.799 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557eafa64cc1] 2024-09-12T00:59:22.799 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x557eafa79d5a] 2024-09-12T00:59:22.799 INFO:tasks.workunit.client.0.smithi070.stderr: 5: main() 2024-09-12T00:59:22.799 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc3f78c9d90] 2024-09-12T00:59:22.799 INFO:tasks.workunit.client.0.smithi070.stderr: 7: __libc_start_main() 2024-09-12T00:59:22.799 INFO:tasks.workunit.client.0.smithi070.stderr: 8: _start() 2024-09-12T00:59:22.799 INFO:tasks.workunit.client.0.smithi070.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:59:22.799 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7fc3f51899c0 thread_name:radosgw-admin 2024-09-12T00:59:22.800 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.809+0000 7fc3f51899c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc3f51899c0 time 2024-09-12T00:59:22.810711+0000 2024-09-12T00:59:22.800 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:59:22.800 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.800 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:59:22.800 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc3f8a632eb] 2024-09-12T00:59:22.800 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc3f8a6349f] 2024-09-12T00:59:22.800 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557eafa64cc1] 2024-09-12T00:59:22.800 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x557eafa79d5a] 2024-09-12T00:59:22.800 INFO:tasks.workunit.client.0.smithi070.stderr: 5: main() 2024-09-12T00:59:22.800 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc3f78c9d90] 2024-09-12T00:59:22.800 INFO:tasks.workunit.client.0.smithi070.stderr: 7: __libc_start_main() 2024-09-12T00:59:22.800 INFO:tasks.workunit.client.0.smithi070.stderr: 8: _start() 2024-09-12T00:59:22.800 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.822 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:59:22.822 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc3f78e2520] 2024-09-12T00:59:22.822 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:59:22.822 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:59:22.822 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:59:22.822 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc3f8a63345] 2024-09-12T00:59:22.823 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc3f8a6349f] 2024-09-12T00:59:22.823 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557eafa64cc1] 2024-09-12T00:59:22.823 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x557eafa79d5a] 2024-09-12T00:59:22.823 INFO:tasks.workunit.client.0.smithi070.stderr: 9: main() 2024-09-12T00:59:22.823 INFO:tasks.workunit.client.0.smithi070.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc3f78c9d90] 2024-09-12T00:59:22.823 INFO:tasks.workunit.client.0.smithi070.stderr: 11: __libc_start_main() 2024-09-12T00:59:22.823 INFO:tasks.workunit.client.0.smithi070.stderr: 12: _start() 2024-09-12T00:59:22.823 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.809+0000 7fc3f51899c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:59:22.823 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7fc3f51899c0 thread_name:radosgw-admin 2024-09-12T00:59:22.823 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.823 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:59:22.824 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc3f78e2520] 2024-09-12T00:59:22.824 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:59:22.824 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:59:22.824 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:59:22.824 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc3f8a63345] 2024-09-12T00:59:22.824 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc3f8a6349f] 2024-09-12T00:59:22.824 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557eafa64cc1] 2024-09-12T00:59:22.824 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x557eafa79d5a] 2024-09-12T00:59:22.824 INFO:tasks.workunit.client.0.smithi070.stderr: 9: main() 2024-09-12T00:59:22.824 INFO:tasks.workunit.client.0.smithi070.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc3f78c9d90] 2024-09-12T00:59:22.824 INFO:tasks.workunit.client.0.smithi070.stderr: 11: __libc_start_main() 2024-09-12T00:59:22.824 INFO:tasks.workunit.client.0.smithi070.stderr: 12: _start() 2024-09-12T00:59:22.825 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:59:22.825 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.825 INFO:tasks.workunit.client.0.smithi070.stderr:--- begin dump of recent events --- 2024-09-12T00:59:22.825 INFO:tasks.workunit.client.0.smithi070.stderr: -499> 2024-09-12T00:59:22.721+0000 7fc3f2c8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:22.825 INFO:tasks.workunit.client.0.smithi070.stderr: -498> 2024-09-12T00:59:22.721+0000 7fc3f2c8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:22.825 INFO:tasks.workunit.client.0.smithi070.stderr: -497> 2024-09-12T00:59:22.721+0000 7fc3f248e640 10 monclient(hunting): handle_auth_done global_id 8304 payload 274 2024-09-12T00:59:22.825 INFO:tasks.workunit.client.0.smithi070.stderr: -496> 2024-09-12T00:59:22.721+0000 7fc3f248e640 10 monclient: _finish_hunting 0 2024-09-12T00:59:22.825 INFO:tasks.workunit.client.0.smithi070.stderr: -495> 2024-09-12T00:59:22.721+0000 7fc3f248e640 1 monclient: found mon.noname-a 2024-09-12T00:59:22.825 INFO:tasks.workunit.client.0.smithi070.stderr: -494> 2024-09-12T00:59:22.721+0000 7fc3f248e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:59:22.825 INFO:tasks.workunit.client.0.smithi070.stderr: -493> 2024-09-12T00:59:22.721+0000 7fc2e0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:22.825 INFO:tasks.workunit.client.0.smithi070.stderr: -492> 2024-09-12T00:59:22.721+0000 7fc2e0e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:59:22.825 INFO:tasks.workunit.client.0.smithi070.stderr: -491> 2024-09-12T00:59:22.721+0000 7fc2e0e09640 10 monclient: dump: 2024-09-12T00:59:22.825 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:22.826 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:22.826 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.826 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.826 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:22.826 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.826 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:22.826 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:22.826 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:22.826 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.826 INFO:tasks.workunit.client.0.smithi070.stderr: -490> 2024-09-12T00:59:22.721+0000 7fc2e0e09640 10 monclient: _finish_auth 0 2024-09-12T00:59:22.826 INFO:tasks.workunit.client.0.smithi070.stderr: -489> 2024-09-12T00:59:22.721+0000 7fc2e0e09640 10 monclient: _check_auth_tickets 2024-09-12T00:59:22.826 INFO:tasks.workunit.client.0.smithi070.stderr: -488> 2024-09-12T00:59:22.721+0000 7fc2e0e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:59:22.826 INFO:tasks.workunit.client.0.smithi070.stderr: -487> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 monclient: authenticate success, global_id 8304 2024-09-12T00:59:22.827 INFO:tasks.workunit.client.0.smithi070.stderr: -486> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 10 monclient: get_monmap_and_config success 2024-09-12T00:59:22.827 INFO:tasks.workunit.client.0.smithi070.stderr: -485> 2024-09-12T00:59:22.721+0000 7fc2e0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:22.827 INFO:tasks.workunit.client.0.smithi070.stderr: -484> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 4 set_mon_vals no callback set 2024-09-12T00:59:22.827 INFO:tasks.workunit.client.0.smithi070.stderr: -483> 2024-09-12T00:59:22.721+0000 7fc2e0e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:59:22.827 INFO:tasks.workunit.client.0.smithi070.stderr: -482> 2024-09-12T00:59:22.721+0000 7fc2e0e09640 10 monclient: dump: 2024-09-12T00:59:22.827 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:22.827 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:22.827 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.827 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.827 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:22.827 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.827 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:22.827 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:22.827 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:22.827 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.828 INFO:tasks.workunit.client.0.smithi070.stderr: -481> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 10 monclient: shutdown 2024-09-12T00:59:22.828 INFO:tasks.workunit.client.0.smithi070.stderr: -480> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) unregister_commands rotate-key 2024-09-12T00:59:22.828 INFO:tasks.workunit.client.0.smithi070.stderr: -479> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 10 monclient: build_initial_monmap 2024-09-12T00:59:22.828 INFO:tasks.workunit.client.0.smithi070.stderr: -478> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 1 build_initial for_mkfs: 0 2024-09-12T00:59:22.828 INFO:tasks.workunit.client.0.smithi070.stderr: -477> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 10 monclient: monmap: 2024-09-12T00:59:22.828 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:59:22.828 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:59:22.828 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:59:22.828 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:59:22.828 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:59:22.828 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.828 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:59:22.828 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:59:22.829 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:59:22.829 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.829 INFO:tasks.workunit.client.0.smithi070.stderr: -476> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding auth protocol: cephx 2024-09-12T00:59:22.829 INFO:tasks.workunit.client.0.smithi070.stderr: -475> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding auth protocol: cephx 2024-09-12T00:59:22.829 INFO:tasks.workunit.client.0.smithi070.stderr: -474> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding auth protocol: cephx 2024-09-12T00:59:22.829 INFO:tasks.workunit.client.0.smithi070.stderr: -473> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding con mode: secure 2024-09-12T00:59:22.829 INFO:tasks.workunit.client.0.smithi070.stderr: -472> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding con mode: crc 2024-09-12T00:59:22.829 INFO:tasks.workunit.client.0.smithi070.stderr: -471> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding con mode: secure 2024-09-12T00:59:22.829 INFO:tasks.workunit.client.0.smithi070.stderr: -470> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding con mode: crc 2024-09-12T00:59:22.829 INFO:tasks.workunit.client.0.smithi070.stderr: -469> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding con mode: secure 2024-09-12T00:59:22.829 INFO:tasks.workunit.client.0.smithi070.stderr: -468> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding con mode: crc 2024-09-12T00:59:22.829 INFO:tasks.workunit.client.0.smithi070.stderr: -467> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding con mode: crc 2024-09-12T00:59:22.829 INFO:tasks.workunit.client.0.smithi070.stderr: -466> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding con mode: secure 2024-09-12T00:59:22.829 INFO:tasks.workunit.client.0.smithi070.stderr: -465> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding con mode: crc 2024-09-12T00:59:22.830 INFO:tasks.workunit.client.0.smithi070.stderr: -464> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding con mode: secure 2024-09-12T00:59:22.830 INFO:tasks.workunit.client.0.smithi070.stderr: -463> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding con mode: crc 2024-09-12T00:59:22.830 INFO:tasks.workunit.client.0.smithi070.stderr: -462> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding con mode: secure 2024-09-12T00:59:22.830 INFO:tasks.workunit.client.0.smithi070.stderr: -461> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:22.830 INFO:tasks.workunit.client.0.smithi070.stderr: -460> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 1 librados: starting msgr at 2024-09-12T00:59:22.830 INFO:tasks.workunit.client.0.smithi070.stderr: -459> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 1 librados: starting objecter 2024-09-12T00:59:22.830 INFO:tasks.workunit.client.0.smithi070.stderr: -458> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command objecter_requests hook 0x557eb1fdfa40 2024-09-12T00:59:22.830 INFO:tasks.workunit.client.0.smithi070.stderr: -457> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 1 librados: setting wanted keys 2024-09-12T00:59:22.830 INFO:tasks.workunit.client.0.smithi070.stderr: -456> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 1 librados: calling monclient init 2024-09-12T00:59:22.830 INFO:tasks.workunit.client.0.smithi070.stderr: -455> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 10 monclient: init 2024-09-12T00:59:22.830 INFO:tasks.workunit.client.0.smithi070.stderr: -454> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding auth protocol: cephx 2024-09-12T00:59:22.830 INFO:tasks.workunit.client.0.smithi070.stderr: -453> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding auth protocol: cephx 2024-09-12T00:59:22.830 INFO:tasks.workunit.client.0.smithi070.stderr: -452> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding auth protocol: cephx 2024-09-12T00:59:22.831 INFO:tasks.workunit.client.0.smithi070.stderr: -451> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding con mode: secure 2024-09-12T00:59:22.831 INFO:tasks.workunit.client.0.smithi070.stderr: -450> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding con mode: crc 2024-09-12T00:59:22.831 INFO:tasks.workunit.client.0.smithi070.stderr: -449> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding con mode: secure 2024-09-12T00:59:22.831 INFO:tasks.workunit.client.0.smithi070.stderr: -448> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding con mode: crc 2024-09-12T00:59:22.831 INFO:tasks.workunit.client.0.smithi070.stderr: -447> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding con mode: secure 2024-09-12T00:59:22.831 INFO:tasks.workunit.client.0.smithi070.stderr: -446> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding con mode: crc 2024-09-12T00:59:22.831 INFO:tasks.workunit.client.0.smithi070.stderr: -445> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding con mode: crc 2024-09-12T00:59:22.831 INFO:tasks.workunit.client.0.smithi070.stderr: -444> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding con mode: secure 2024-09-12T00:59:22.831 INFO:tasks.workunit.client.0.smithi070.stderr: -443> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding con mode: crc 2024-09-12T00:59:22.831 INFO:tasks.workunit.client.0.smithi070.stderr: -442> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding con mode: secure 2024-09-12T00:59:22.831 INFO:tasks.workunit.client.0.smithi070.stderr: -441> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding con mode: crc 2024-09-12T00:59:22.831 INFO:tasks.workunit.client.0.smithi070.stderr: -440> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding con mode: secure 2024-09-12T00:59:22.831 INFO:tasks.workunit.client.0.smithi070.stderr: -439> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:22.831 INFO:tasks.workunit.client.0.smithi070.stderr: -438> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:22.832 INFO:tasks.workunit.client.0.smithi070.stderr: -437> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command rotate-key hook 0x557eb1fddda8 2024-09-12T00:59:22.832 INFO:tasks.workunit.client.0.smithi070.stderr: -436> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient: _reopen_session rank -1 2024-09-12T00:59:22.832 INFO:tasks.workunit.client.0.smithi070.stderr: -435> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:59:22.832 INFO:tasks.workunit.client.0.smithi070.stderr: -434> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient(hunting): picked mon.noname-c con 0x557eb1f23900 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:59:22.832 INFO:tasks.workunit.client.0.smithi070.stderr: -433> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient(hunting): picked mon.noname-b con 0x557eb1f23ce0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:59:22.832 INFO:tasks.workunit.client.0.smithi070.stderr: -432> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient(hunting): picked mon.noname-a con 0x557eb1f29aa0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:59:22.832 INFO:tasks.workunit.client.0.smithi070.stderr: -431> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:22.832 INFO:tasks.workunit.client.0.smithi070.stderr: -430> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:22.832 INFO:tasks.workunit.client.0.smithi070.stderr: -429> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:22.832 INFO:tasks.workunit.client.0.smithi070.stderr: -428> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient(hunting): _renew_subs 2024-09-12T00:59:22.832 INFO:tasks.workunit.client.0.smithi070.stderr: -427> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient(hunting): authenticate will time out at 2413.172390s 2024-09-12T00:59:22.832 INFO:tasks.workunit.client.0.smithi070.stderr: -426> 2024-09-12T00:59:22.725+0000 7fc3f2c8f640 10 monclient(hunting): get_auth_request con 0x557eb1f23900 auth_method 0 2024-09-12T00:59:22.832 INFO:tasks.workunit.client.0.smithi070.stderr: -425> 2024-09-12T00:59:22.725+0000 7fc3f2c8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:22.833 INFO:tasks.workunit.client.0.smithi070.stderr: -424> 2024-09-12T00:59:22.725+0000 7fc3f2c8f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:22.833 INFO:tasks.workunit.client.0.smithi070.stderr: -423> 2024-09-12T00:59:22.725+0000 7fc3f2c8f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:22.833 INFO:tasks.workunit.client.0.smithi070.stderr: -422> 2024-09-12T00:59:22.725+0000 7fc3f3490640 10 monclient(hunting): get_auth_request con 0x557eb1f29aa0 auth_method 0 2024-09-12T00:59:22.833 INFO:tasks.workunit.client.0.smithi070.stderr: -421> 2024-09-12T00:59:22.725+0000 7fc3f3490640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:22.833 INFO:tasks.workunit.client.0.smithi070.stderr: -420> 2024-09-12T00:59:22.725+0000 7fc3f3490640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:22.833 INFO:tasks.workunit.client.0.smithi070.stderr: -419> 2024-09-12T00:59:22.725+0000 7fc3f3490640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:22.833 INFO:tasks.workunit.client.0.smithi070.stderr: -418> 2024-09-12T00:59:22.725+0000 7fc3f2c8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:22.833 INFO:tasks.workunit.client.0.smithi070.stderr: -417> 2024-09-12T00:59:22.725+0000 7fc3f2c8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:22.833 INFO:tasks.workunit.client.0.smithi070.stderr: -416> 2024-09-12T00:59:22.725+0000 7fc3f2c8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:22.833 INFO:tasks.workunit.client.0.smithi070.stderr: -415> 2024-09-12T00:59:22.725+0000 7fc3f3490640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:22.833 INFO:tasks.workunit.client.0.smithi070.stderr: -414> 2024-09-12T00:59:22.725+0000 7fc3f3490640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:22.833 INFO:tasks.workunit.client.0.smithi070.stderr: -413> 2024-09-12T00:59:22.725+0000 7fc3f3490640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:22.833 INFO:tasks.workunit.client.0.smithi070.stderr: -412> 2024-09-12T00:59:22.725+0000 7fc3f248e640 10 monclient(hunting): get_auth_request con 0x557eb1f23ce0 auth_method 0 2024-09-12T00:59:22.834 INFO:tasks.workunit.client.0.smithi070.stderr: -411> 2024-09-12T00:59:22.725+0000 7fc3f248e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:22.834 INFO:tasks.workunit.client.0.smithi070.stderr: -410> 2024-09-12T00:59:22.725+0000 7fc3f248e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:22.834 INFO:tasks.workunit.client.0.smithi070.stderr: -409> 2024-09-12T00:59:22.725+0000 7fc3f248e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:22.834 INFO:tasks.workunit.client.0.smithi070.stderr: -408> 2024-09-12T00:59:22.725+0000 7fc3f2c8f640 10 monclient(hunting): handle_auth_done global_id 7781 payload 824 2024-09-12T00:59:22.834 INFO:tasks.workunit.client.0.smithi070.stderr: -407> 2024-09-12T00:59:22.725+0000 7fc3f2c8f640 10 monclient: _finish_hunting 0 2024-09-12T00:59:22.834 INFO:tasks.workunit.client.0.smithi070.stderr: -406> 2024-09-12T00:59:22.725+0000 7fc3f2c8f640 1 monclient: found mon.noname-c 2024-09-12T00:59:22.834 INFO:tasks.workunit.client.0.smithi070.stderr: -405> 2024-09-12T00:59:22.725+0000 7fc3f2c8f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:59:22.834 INFO:tasks.workunit.client.0.smithi070.stderr: -404> 2024-09-12T00:59:22.725+0000 7fc2df606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:22.834 INFO:tasks.workunit.client.0.smithi070.stderr: -403> 2024-09-12T00:59:22.725+0000 7fc2df606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:59:22.834 INFO:tasks.workunit.client.0.smithi070.stderr: -402> 2024-09-12T00:59:22.725+0000 7fc2df606640 10 monclient: dump: 2024-09-12T00:59:22.834 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:22.834 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:22.834 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.835 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.835 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:22.835 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.835 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:22.835 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:22.835 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:22.835 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.835 INFO:tasks.workunit.client.0.smithi070.stderr: -401> 2024-09-12T00:59:22.725+0000 7fc2df606640 10 monclient: _finish_auth 0 2024-09-12T00:59:22.835 INFO:tasks.workunit.client.0.smithi070.stderr: -400> 2024-09-12T00:59:22.725+0000 7fc2df606640 10 monclient: _check_auth_tickets 2024-09-12T00:59:22.835 INFO:tasks.workunit.client.0.smithi070.stderr: -399> 2024-09-12T00:59:22.725+0000 7fc2df606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:59:22.835 INFO:tasks.workunit.client.0.smithi070.stderr: -398> 2024-09-12T00:59:22.725+0000 7fc2df606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:22.835 INFO:tasks.workunit.client.0.smithi070.stderr: -397> 2024-09-12T00:59:22.725+0000 7fc2df606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:59:22.836 INFO:tasks.workunit.client.0.smithi070.stderr: -396> 2024-09-12T00:59:22.725+0000 7fc2df606640 10 monclient: dump: 2024-09-12T00:59:22.836 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:22.836 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:22.836 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.836 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.836 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:22.836 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.836 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:22.836 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:22.836 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:22.836 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.836 INFO:tasks.workunit.client.0.smithi070.stderr: -395> 2024-09-12T00:59:22.725+0000 7fc2e0e09640 4 set_mon_vals no callback set 2024-09-12T00:59:22.836 INFO:tasks.workunit.client.0.smithi070.stderr: -394> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 5 monclient: authenticate success, global_id 7781 2024-09-12T00:59:22.837 INFO:tasks.workunit.client.0.smithi070.stderr: -393> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient: _renew_subs 2024-09-12T00:59:22.837 INFO:tasks.workunit.client.0.smithi070.stderr: -392> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:59:22.837 INFO:tasks.workunit.client.0.smithi070.stderr: -391> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient: _renew_subs 2024-09-12T00:59:22.837 INFO:tasks.workunit.client.0.smithi070.stderr: -390> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:59:22.837 INFO:tasks.workunit.client.0.smithi070.stderr: -389> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 1 librados: init done 2024-09-12T00:59:22.837 INFO:tasks.workunit.client.0.smithi070.stderr: -388> 2024-09-12T00:59:22.725+0000 7fc2df606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:59:22.837 INFO:tasks.workunit.client.0.smithi070.stderr: -387> 2024-09-12T00:59:22.725+0000 7fc2df606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:59:22.837 INFO:tasks.workunit.client.0.smithi070.stderr: -386> 2024-09-12T00:59:22.725+0000 7fc2df606640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:59:22.837 INFO:tasks.workunit.client.0.smithi070.stderr: -385> 2024-09-12T00:59:22.725+0000 7fc3f3490640 10 monclient: get_auth_request con 0x557eb2008570 auth_method 0 2024-09-12T00:59:22.837 INFO:tasks.workunit.client.0.smithi070.stderr: -384> 2024-09-12T00:59:22.725+0000 7fc3f248e640 10 monclient: get_auth_request con 0x7fc2d8070ae0 auth_method 0 2024-09-12T00:59:22.837 INFO:tasks.workunit.client.0.smithi070.stderr: -383> 2024-09-12T00:59:22.729+0000 7fc3f2c8f640 10 monclient: get_auth_request con 0x557eb2028440 auth_method 0 2024-09-12T00:59:22.837 INFO:tasks.workunit.client.0.smithi070.stderr: -382> 2024-09-12T00:59:22.729+0000 7fc3f248e640 10 monclient: get_auth_request con 0x557eb202c7a0 auth_method 0 2024-09-12T00:59:22.837 INFO:tasks.workunit.client.0.smithi070.stderr: -381> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient: build_initial_monmap 2024-09-12T00:59:22.838 INFO:tasks.workunit.client.0.smithi070.stderr: -380> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 1 build_initial for_mkfs: 0 2024-09-12T00:59:22.838 INFO:tasks.workunit.client.0.smithi070.stderr: -379> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient: monmap: 2024-09-12T00:59:22.838 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:59:22.838 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:59:22.838 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:59:22.838 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:59:22.838 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:59:22.838 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.838 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:59:22.838 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:59:22.838 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:59:22.838 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.838 INFO:tasks.workunit.client.0.smithi070.stderr: -378> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding auth protocol: cephx 2024-09-12T00:59:22.838 INFO:tasks.workunit.client.0.smithi070.stderr: -377> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding auth protocol: cephx 2024-09-12T00:59:22.839 INFO:tasks.workunit.client.0.smithi070.stderr: -376> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding auth protocol: cephx 2024-09-12T00:59:22.839 INFO:tasks.workunit.client.0.smithi070.stderr: -375> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding con mode: secure 2024-09-12T00:59:22.839 INFO:tasks.workunit.client.0.smithi070.stderr: -374> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding con mode: crc 2024-09-12T00:59:22.839 INFO:tasks.workunit.client.0.smithi070.stderr: -373> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding con mode: secure 2024-09-12T00:59:22.839 INFO:tasks.workunit.client.0.smithi070.stderr: -372> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding con mode: crc 2024-09-12T00:59:22.839 INFO:tasks.workunit.client.0.smithi070.stderr: -371> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding con mode: secure 2024-09-12T00:59:22.839 INFO:tasks.workunit.client.0.smithi070.stderr: -370> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding con mode: crc 2024-09-12T00:59:22.839 INFO:tasks.workunit.client.0.smithi070.stderr: -369> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding con mode: crc 2024-09-12T00:59:22.839 INFO:tasks.workunit.client.0.smithi070.stderr: -368> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding con mode: secure 2024-09-12T00:59:22.839 INFO:tasks.workunit.client.0.smithi070.stderr: -367> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding con mode: crc 2024-09-12T00:59:22.839 INFO:tasks.workunit.client.0.smithi070.stderr: -366> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding con mode: secure 2024-09-12T00:59:22.839 INFO:tasks.workunit.client.0.smithi070.stderr: -365> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding con mode: crc 2024-09-12T00:59:22.839 INFO:tasks.workunit.client.0.smithi070.stderr: -364> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding con mode: secure 2024-09-12T00:59:22.840 INFO:tasks.workunit.client.0.smithi070.stderr: -363> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:22.840 INFO:tasks.workunit.client.0.smithi070.stderr: -362> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command objecter_requests cmddesc objecter_requests hook 0x557eb2034fc0 EEXIST 2024-09-12T00:59:22.840 INFO:tasks.workunit.client.0.smithi070.stderr: -361> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient: init 2024-09-12T00:59:22.840 INFO:tasks.workunit.client.0.smithi070.stderr: -360> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding auth protocol: cephx 2024-09-12T00:59:22.840 INFO:tasks.workunit.client.0.smithi070.stderr: -359> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding auth protocol: cephx 2024-09-12T00:59:22.840 INFO:tasks.workunit.client.0.smithi070.stderr: -358> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding auth protocol: cephx 2024-09-12T00:59:22.840 INFO:tasks.workunit.client.0.smithi070.stderr: -357> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding con mode: secure 2024-09-12T00:59:22.840 INFO:tasks.workunit.client.0.smithi070.stderr: -356> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding con mode: crc 2024-09-12T00:59:22.840 INFO:tasks.workunit.client.0.smithi070.stderr: -355> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding con mode: secure 2024-09-12T00:59:22.840 INFO:tasks.workunit.client.0.smithi070.stderr: -354> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding con mode: crc 2024-09-12T00:59:22.840 INFO:tasks.workunit.client.0.smithi070.stderr: -353> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding con mode: secure 2024-09-12T00:59:22.840 INFO:tasks.workunit.client.0.smithi070.stderr: -352> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding con mode: crc 2024-09-12T00:59:22.840 INFO:tasks.workunit.client.0.smithi070.stderr: -351> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding con mode: crc 2024-09-12T00:59:22.841 INFO:tasks.workunit.client.0.smithi070.stderr: -350> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding con mode: secure 2024-09-12T00:59:22.841 INFO:tasks.workunit.client.0.smithi070.stderr: -349> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding con mode: crc 2024-09-12T00:59:22.841 INFO:tasks.workunit.client.0.smithi070.stderr: -348> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding con mode: secure 2024-09-12T00:59:22.842 INFO:tasks.workunit.client.0.smithi070.stderr: -347> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding con mode: crc 2024-09-12T00:59:22.842 INFO:tasks.workunit.client.0.smithi070.stderr: -346> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding con mode: secure 2024-09-12T00:59:22.842 INFO:tasks.workunit.client.0.smithi070.stderr: -345> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:22.842 INFO:tasks.workunit.client.0.smithi070.stderr: -344> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:22.842 INFO:tasks.workunit.client.0.smithi070.stderr: -343> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command rotate-key cmddesc rotate-key hook 0x557eb202fdf0 EEXIST 2024-09-12T00:59:22.842 INFO:tasks.workunit.client.0.smithi070.stderr: -342> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient: _reopen_session rank -1 2024-09-12T00:59:22.842 INFO:tasks.workunit.client.0.smithi070.stderr: -341> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:59:22.842 INFO:tasks.workunit.client.0.smithi070.stderr: -340> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient(hunting): picked mon.noname-c con 0x557eb2059170 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:59:22.842 INFO:tasks.workunit.client.0.smithi070.stderr: -339> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient(hunting): picked mon.noname-b con 0x557eb2058aa0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:59:22.842 INFO:tasks.workunit.client.0.smithi070.stderr: -338> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient(hunting): picked mon.noname-a con 0x557eb2057480 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:59:22.842 INFO:tasks.workunit.client.0.smithi070.stderr: -337> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:22.842 INFO:tasks.workunit.client.0.smithi070.stderr: -336> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:22.842 INFO:tasks.workunit.client.0.smithi070.stderr: -335> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:22.843 INFO:tasks.workunit.client.0.smithi070.stderr: -334> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient(hunting): _renew_subs 2024-09-12T00:59:22.843 INFO:tasks.workunit.client.0.smithi070.stderr: -333> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient(hunting): authenticate will time out at 2413.181628s 2024-09-12T00:59:22.843 INFO:tasks.workunit.client.0.smithi070.stderr: -332> 2024-09-12T00:59:22.733+0000 7fc3f3490640 10 monclient(hunting): get_auth_request con 0x557eb2057480 auth_method 0 2024-09-12T00:59:22.843 INFO:tasks.workunit.client.0.smithi070.stderr: -331> 2024-09-12T00:59:22.733+0000 7fc3f3490640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:22.843 INFO:tasks.workunit.client.0.smithi070.stderr: -330> 2024-09-12T00:59:22.733+0000 7fc3f3490640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:22.843 INFO:tasks.workunit.client.0.smithi070.stderr: -329> 2024-09-12T00:59:22.733+0000 7fc3f3490640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:22.843 INFO:tasks.workunit.client.0.smithi070.stderr: -328> 2024-09-12T00:59:22.733+0000 7fc3f2c8f640 10 monclient(hunting): get_auth_request con 0x557eb2059170 auth_method 0 2024-09-12T00:59:22.843 INFO:tasks.workunit.client.0.smithi070.stderr: -327> 2024-09-12T00:59:22.733+0000 7fc3f2c8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:22.843 INFO:tasks.workunit.client.0.smithi070.stderr: -326> 2024-09-12T00:59:22.733+0000 7fc3f2c8f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:22.843 INFO:tasks.workunit.client.0.smithi070.stderr: -325> 2024-09-12T00:59:22.733+0000 7fc3f2c8f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:22.843 INFO:tasks.workunit.client.0.smithi070.stderr: -324> 2024-09-12T00:59:22.733+0000 7fc3f3490640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:22.843 INFO:tasks.workunit.client.0.smithi070.stderr: -323> 2024-09-12T00:59:22.733+0000 7fc3f3490640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:22.843 INFO:tasks.workunit.client.0.smithi070.stderr: -322> 2024-09-12T00:59:22.733+0000 7fc3f3490640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:22.843 INFO:tasks.workunit.client.0.smithi070.stderr: -321> 2024-09-12T00:59:22.733+0000 7fc3f2c8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:22.844 INFO:tasks.workunit.client.0.smithi070.stderr: -320> 2024-09-12T00:59:22.733+0000 7fc3f2c8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:22.844 INFO:tasks.workunit.client.0.smithi070.stderr: -319> 2024-09-12T00:59:22.733+0000 7fc3f2c8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:22.844 INFO:tasks.workunit.client.0.smithi070.stderr: -318> 2024-09-12T00:59:22.733+0000 7fc3f2c8f640 10 monclient(hunting): handle_auth_done global_id 7784 payload 824 2024-09-12T00:59:22.844 INFO:tasks.workunit.client.0.smithi070.stderr: -317> 2024-09-12T00:59:22.733+0000 7fc3f2c8f640 10 monclient: _finish_hunting 0 2024-09-12T00:59:22.844 INFO:tasks.workunit.client.0.smithi070.stderr: -316> 2024-09-12T00:59:22.733+0000 7fc3f2c8f640 1 monclient: found mon.noname-c 2024-09-12T00:59:22.844 INFO:tasks.workunit.client.0.smithi070.stderr: -315> 2024-09-12T00:59:22.733+0000 7fc3f2c8f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:59:22.844 INFO:tasks.workunit.client.0.smithi070.stderr: -314> 2024-09-12T00:59:22.733+0000 7fc3f248e640 10 monclient: get_auth_request con 0x557eb2058aa0 auth_method 0 2024-09-12T00:59:22.844 INFO:tasks.workunit.client.0.smithi070.stderr: -313> 2024-09-12T00:59:22.733+0000 7fc2dce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:22.844 INFO:tasks.workunit.client.0.smithi070.stderr: -312> 2024-09-12T00:59:22.733+0000 7fc2dce01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:59:22.844 INFO:tasks.workunit.client.0.smithi070.stderr: -311> 2024-09-12T00:59:22.733+0000 7fc2dce01640 10 monclient: dump: 2024-09-12T00:59:22.844 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:22.844 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:22.845 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.845 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.845 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:22.845 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.845 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:22.845 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:22.845 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:22.845 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.845 INFO:tasks.workunit.client.0.smithi070.stderr: -310> 2024-09-12T00:59:22.733+0000 7fc2dce01640 10 monclient: _finish_auth 0 2024-09-12T00:59:22.845 INFO:tasks.workunit.client.0.smithi070.stderr: -309> 2024-09-12T00:59:22.733+0000 7fc2dce01640 10 monclient: _check_auth_tickets 2024-09-12T00:59:22.845 INFO:tasks.workunit.client.0.smithi070.stderr: -308> 2024-09-12T00:59:22.733+0000 7fc2dce01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:59:22.845 INFO:tasks.workunit.client.0.smithi070.stderr: -307> 2024-09-12T00:59:22.733+0000 7fc2dce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:22.845 INFO:tasks.workunit.client.0.smithi070.stderr: -306> 2024-09-12T00:59:22.733+0000 7fc2dce01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:59:22.846 INFO:tasks.workunit.client.0.smithi070.stderr: -305> 2024-09-12T00:59:22.733+0000 7fc2dce01640 10 monclient: dump: 2024-09-12T00:59:22.846 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:22.846 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:22.846 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.846 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.846 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:22.846 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.846 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:22.846 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:22.846 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:22.846 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.846 INFO:tasks.workunit.client.0.smithi070.stderr: -304> 2024-09-12T00:59:22.733+0000 7fc3f1c8d640 4 set_mon_vals no callback set 2024-09-12T00:59:22.846 INFO:tasks.workunit.client.0.smithi070.stderr: -303> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 monclient: authenticate success, global_id 7784 2024-09-12T00:59:22.846 INFO:tasks.workunit.client.0.smithi070.stderr: -302> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient: _renew_subs 2024-09-12T00:59:22.847 INFO:tasks.workunit.client.0.smithi070.stderr: -301> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:59:22.847 INFO:tasks.workunit.client.0.smithi070.stderr: -300> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient: _renew_subs 2024-09-12T00:59:22.847 INFO:tasks.workunit.client.0.smithi070.stderr: -299> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:59:22.847 INFO:tasks.workunit.client.0.smithi070.stderr: -298> 2024-09-12T00:59:22.737+0000 7fc2dce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:59:22.847 INFO:tasks.workunit.client.0.smithi070.stderr: -297> 2024-09-12T00:59:22.737+0000 7fc2dce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:59:22.847 INFO:tasks.workunit.client.0.smithi070.stderr: -296> 2024-09-12T00:59:22.737+0000 7fc2dce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:59:22.847 INFO:tasks.workunit.client.0.smithi070.stderr: -295> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient: get_monmap_and_config 2024-09-12T00:59:22.847 INFO:tasks.workunit.client.0.smithi070.stderr: -294> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient: build_initial_monmap 2024-09-12T00:59:22.847 INFO:tasks.workunit.client.0.smithi070.stderr: -293> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 1 build_initial for_mkfs: 0 2024-09-12T00:59:22.847 INFO:tasks.workunit.client.0.smithi070.stderr: -292> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient: monmap: 2024-09-12T00:59:22.847 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:59:22.847 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:59:22.848 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:59:22.848 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:59:22.848 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:59:22.848 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.848 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:59:22.848 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:59:22.848 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:59:22.848 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.848 INFO:tasks.workunit.client.0.smithi070.stderr: -291> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding auth protocol: cephx 2024-09-12T00:59:22.848 INFO:tasks.workunit.client.0.smithi070.stderr: -290> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding auth protocol: cephx 2024-09-12T00:59:22.848 INFO:tasks.workunit.client.0.smithi070.stderr: -289> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding auth protocol: cephx 2024-09-12T00:59:22.848 INFO:tasks.workunit.client.0.smithi070.stderr: -288> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding con mode: secure 2024-09-12T00:59:22.848 INFO:tasks.workunit.client.0.smithi070.stderr: -287> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding con mode: crc 2024-09-12T00:59:22.849 INFO:tasks.workunit.client.0.smithi070.stderr: -286> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding con mode: secure 2024-09-12T00:59:22.849 INFO:tasks.workunit.client.0.smithi070.stderr: -285> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding con mode: crc 2024-09-12T00:59:22.849 INFO:tasks.workunit.client.0.smithi070.stderr: -284> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding con mode: secure 2024-09-12T00:59:22.849 INFO:tasks.workunit.client.0.smithi070.stderr: -283> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding con mode: crc 2024-09-12T00:59:22.849 INFO:tasks.workunit.client.0.smithi070.stderr: -282> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding con mode: crc 2024-09-12T00:59:22.849 INFO:tasks.workunit.client.0.smithi070.stderr: -281> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding con mode: secure 2024-09-12T00:59:22.849 INFO:tasks.workunit.client.0.smithi070.stderr: -280> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding con mode: crc 2024-09-12T00:59:22.849 INFO:tasks.workunit.client.0.smithi070.stderr: -279> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding con mode: secure 2024-09-12T00:59:22.849 INFO:tasks.workunit.client.0.smithi070.stderr: -278> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding con mode: crc 2024-09-12T00:59:22.849 INFO:tasks.workunit.client.0.smithi070.stderr: -277> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding con mode: secure 2024-09-12T00:59:22.849 INFO:tasks.workunit.client.0.smithi070.stderr: -276> 2024-09-12T00:59:22.737+0000 7fc3f248e640 10 monclient: get_auth_request con 0x7fc2cc070a20 auth_method 0 2024-09-12T00:59:22.849 INFO:tasks.workunit.client.0.smithi070.stderr: -275> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:22.850 INFO:tasks.workunit.client.0.smithi070.stderr: -274> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient: init 2024-09-12T00:59:22.850 INFO:tasks.workunit.client.0.smithi070.stderr: -273> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding auth protocol: cephx 2024-09-12T00:59:22.850 INFO:tasks.workunit.client.0.smithi070.stderr: -272> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding auth protocol: cephx 2024-09-12T00:59:22.850 INFO:tasks.workunit.client.0.smithi070.stderr: -271> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding auth protocol: cephx 2024-09-12T00:59:22.850 INFO:tasks.workunit.client.0.smithi070.stderr: -270> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding con mode: secure 2024-09-12T00:59:22.850 INFO:tasks.workunit.client.0.smithi070.stderr: -269> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding con mode: crc 2024-09-12T00:59:22.850 INFO:tasks.workunit.client.0.smithi070.stderr: -268> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding con mode: secure 2024-09-12T00:59:22.850 INFO:tasks.workunit.client.0.smithi070.stderr: -267> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding con mode: crc 2024-09-12T00:59:22.850 INFO:tasks.workunit.client.0.smithi070.stderr: -266> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding con mode: secure 2024-09-12T00:59:22.850 INFO:tasks.workunit.client.0.smithi070.stderr: -265> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding con mode: crc 2024-09-12T00:59:22.850 INFO:tasks.workunit.client.0.smithi070.stderr: -264> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding con mode: crc 2024-09-12T00:59:22.850 INFO:tasks.workunit.client.0.smithi070.stderr: -263> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding con mode: secure 2024-09-12T00:59:22.850 INFO:tasks.workunit.client.0.smithi070.stderr: -262> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding con mode: crc 2024-09-12T00:59:22.850 INFO:tasks.workunit.client.0.smithi070.stderr: -261> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding con mode: secure 2024-09-12T00:59:22.851 INFO:tasks.workunit.client.0.smithi070.stderr: -260> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding con mode: crc 2024-09-12T00:59:22.851 INFO:tasks.workunit.client.0.smithi070.stderr: -259> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding con mode: secure 2024-09-12T00:59:22.851 INFO:tasks.workunit.client.0.smithi070.stderr: -258> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:22.851 INFO:tasks.workunit.client.0.smithi070.stderr: -257> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:22.851 INFO:tasks.workunit.client.0.smithi070.stderr: -256> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd9f7c4fe8 EEXIST 2024-09-12T00:59:22.851 INFO:tasks.workunit.client.0.smithi070.stderr: -255> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient: _reopen_session rank -1 2024-09-12T00:59:22.851 INFO:tasks.workunit.client.0.smithi070.stderr: -254> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:59:22.851 INFO:tasks.workunit.client.0.smithi070.stderr: -253> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient(hunting): picked mon.noname-c con 0x557eb20ac970 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:59:22.851 INFO:tasks.workunit.client.0.smithi070.stderr: -252> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient(hunting): picked mon.noname-a con 0x557eb20acd50 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:59:22.851 INFO:tasks.workunit.client.0.smithi070.stderr: -251> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient(hunting): picked mon.noname-b con 0x557eb20b20e0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:59:22.851 INFO:tasks.workunit.client.0.smithi070.stderr: -250> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:22.851 INFO:tasks.workunit.client.0.smithi070.stderr: -249> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:22.851 INFO:tasks.workunit.client.0.smithi070.stderr: -248> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:22.852 INFO:tasks.workunit.client.0.smithi070.stderr: -247> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient(hunting): _renew_subs 2024-09-12T00:59:22.852 INFO:tasks.workunit.client.0.smithi070.stderr: -246> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient(hunting): authenticate will time out at 2413.185983s 2024-09-12T00:59:22.852 INFO:tasks.workunit.client.0.smithi070.stderr: -245> 2024-09-12T00:59:22.737+0000 7fc3f248e640 10 monclient(hunting): get_auth_request con 0x557eb20acd50 auth_method 0 2024-09-12T00:59:22.852 INFO:tasks.workunit.client.0.smithi070.stderr: -244> 2024-09-12T00:59:22.737+0000 7fc3f248e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:22.852 INFO:tasks.workunit.client.0.smithi070.stderr: -243> 2024-09-12T00:59:22.737+0000 7fc3f248e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:22.852 INFO:tasks.workunit.client.0.smithi070.stderr: -242> 2024-09-12T00:59:22.737+0000 7fc3f248e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:22.852 INFO:tasks.workunit.client.0.smithi070.stderr: -241> 2024-09-12T00:59:22.737+0000 7fc3f2c8f640 10 monclient(hunting): get_auth_request con 0x557eb20ac970 auth_method 0 2024-09-12T00:59:22.852 INFO:tasks.workunit.client.0.smithi070.stderr: -240> 2024-09-12T00:59:22.737+0000 7fc3f2c8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:22.852 INFO:tasks.workunit.client.0.smithi070.stderr: -239> 2024-09-12T00:59:22.737+0000 7fc3f2c8f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:22.852 INFO:tasks.workunit.client.0.smithi070.stderr: -238> 2024-09-12T00:59:22.737+0000 7fc3f2c8f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:22.852 INFO:tasks.workunit.client.0.smithi070.stderr: -237> 2024-09-12T00:59:22.737+0000 7fc3f248e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:22.852 INFO:tasks.workunit.client.0.smithi070.stderr: -236> 2024-09-12T00:59:22.737+0000 7fc3f248e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:22.853 INFO:tasks.workunit.client.0.smithi070.stderr: -235> 2024-09-12T00:59:22.737+0000 7fc3f248e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:22.853 INFO:tasks.workunit.client.0.smithi070.stderr: -234> 2024-09-12T00:59:22.737+0000 7fc3f2c8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:22.853 INFO:tasks.workunit.client.0.smithi070.stderr: -233> 2024-09-12T00:59:22.737+0000 7fc3f2c8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:22.853 INFO:tasks.workunit.client.0.smithi070.stderr: -232> 2024-09-12T00:59:22.737+0000 7fc3f2c8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:22.853 INFO:tasks.workunit.client.0.smithi070.stderr: -231> 2024-09-12T00:59:22.737+0000 7fc3f248e640 10 monclient(hunting): handle_auth_done global_id 8313 payload 274 2024-09-12T00:59:22.853 INFO:tasks.workunit.client.0.smithi070.stderr: -230> 2024-09-12T00:59:22.737+0000 7fc3f248e640 10 monclient: _finish_hunting 0 2024-09-12T00:59:22.853 INFO:tasks.workunit.client.0.smithi070.stderr: -229> 2024-09-12T00:59:22.737+0000 7fc3f248e640 1 monclient: found mon.noname-a 2024-09-12T00:59:22.853 INFO:tasks.workunit.client.0.smithi070.stderr: -228> 2024-09-12T00:59:22.737+0000 7fc3f248e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:59:22.853 INFO:tasks.workunit.client.0.smithi070.stderr: -227> 2024-09-12T00:59:22.737+0000 7fc2d67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:22.853 INFO:tasks.workunit.client.0.smithi070.stderr: -226> 2024-09-12T00:59:22.737+0000 7fc2d67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:59:22.853 INFO:tasks.workunit.client.0.smithi070.stderr: -225> 2024-09-12T00:59:22.737+0000 7fc2d67fc640 10 monclient: dump: 2024-09-12T00:59:22.853 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:22.853 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:22.854 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.854 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.854 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:22.854 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.854 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:22.854 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:22.854 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:22.854 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.854 INFO:tasks.workunit.client.0.smithi070.stderr: -224> 2024-09-12T00:59:22.737+0000 7fc2d67fc640 10 monclient: _finish_auth 0 2024-09-12T00:59:22.854 INFO:tasks.workunit.client.0.smithi070.stderr: -223> 2024-09-12T00:59:22.737+0000 7fc2d67fc640 10 monclient: _check_auth_tickets 2024-09-12T00:59:22.854 INFO:tasks.workunit.client.0.smithi070.stderr: -222> 2024-09-12T00:59:22.737+0000 7fc2d67fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:59:22.854 INFO:tasks.workunit.client.0.smithi070.stderr: -221> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 monclient: authenticate success, global_id 8313 2024-09-12T00:59:22.854 INFO:tasks.workunit.client.0.smithi070.stderr: -220> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient: get_monmap_and_config success 2024-09-12T00:59:22.855 INFO:tasks.workunit.client.0.smithi070.stderr: -219> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 4 set_mon_vals no callback set 2024-09-12T00:59:22.855 INFO:tasks.workunit.client.0.smithi070.stderr: -218> 2024-09-12T00:59:22.737+0000 7fc2d67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:22.855 INFO:tasks.workunit.client.0.smithi070.stderr: -217> 2024-09-12T00:59:22.737+0000 7fc2d67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:59:22.855 INFO:tasks.workunit.client.0.smithi070.stderr: -216> 2024-09-12T00:59:22.737+0000 7fc2d67fc640 10 monclient: dump: 2024-09-12T00:59:22.855 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:22.855 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:22.855 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.855 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.855 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:22.855 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.855 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:22.855 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:22.856 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:22.856 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.856 INFO:tasks.workunit.client.0.smithi070.stderr: -215> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient: shutdown 2024-09-12T00:59:22.856 INFO:tasks.workunit.client.0.smithi070.stderr: -214> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient: build_initial_monmap 2024-09-12T00:59:22.856 INFO:tasks.workunit.client.0.smithi070.stderr: -213> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 1 build_initial for_mkfs: 0 2024-09-12T00:59:22.856 INFO:tasks.workunit.client.0.smithi070.stderr: -212> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient: monmap: 2024-09-12T00:59:22.856 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:59:22.856 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:59:22.856 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:59:22.856 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:59:22.856 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:59:22.856 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.856 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:59:22.857 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:59:22.857 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:59:22.857 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.857 INFO:tasks.workunit.client.0.smithi070.stderr: -211> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding auth protocol: cephx 2024-09-12T00:59:22.857 INFO:tasks.workunit.client.0.smithi070.stderr: -210> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding auth protocol: cephx 2024-09-12T00:59:22.857 INFO:tasks.workunit.client.0.smithi070.stderr: -209> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding auth protocol: cephx 2024-09-12T00:59:22.857 INFO:tasks.workunit.client.0.smithi070.stderr: -208> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding con mode: secure 2024-09-12T00:59:22.857 INFO:tasks.workunit.client.0.smithi070.stderr: -207> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding con mode: crc 2024-09-12T00:59:22.857 INFO:tasks.workunit.client.0.smithi070.stderr: -206> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding con mode: secure 2024-09-12T00:59:22.857 INFO:tasks.workunit.client.0.smithi070.stderr: -205> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding con mode: crc 2024-09-12T00:59:22.857 INFO:tasks.workunit.client.0.smithi070.stderr: -204> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding con mode: secure 2024-09-12T00:59:22.857 INFO:tasks.workunit.client.0.smithi070.stderr: -203> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding con mode: crc 2024-09-12T00:59:22.858 INFO:tasks.workunit.client.0.smithi070.stderr: -202> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding con mode: crc 2024-09-12T00:59:22.858 INFO:tasks.workunit.client.0.smithi070.stderr: -201> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding con mode: secure 2024-09-12T00:59:22.858 INFO:tasks.workunit.client.0.smithi070.stderr: -200> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding con mode: crc 2024-09-12T00:59:22.858 INFO:tasks.workunit.client.0.smithi070.stderr: -199> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding con mode: secure 2024-09-12T00:59:22.858 INFO:tasks.workunit.client.0.smithi070.stderr: -198> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding con mode: crc 2024-09-12T00:59:22.858 INFO:tasks.workunit.client.0.smithi070.stderr: -197> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding con mode: secure 2024-09-12T00:59:22.858 INFO:tasks.workunit.client.0.smithi070.stderr: -196> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:22.858 INFO:tasks.workunit.client.0.smithi070.stderr: -195> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 1 librados: starting msgr at 2024-09-12T00:59:22.858 INFO:tasks.workunit.client.0.smithi070.stderr: -194> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 1 librados: starting objecter 2024-09-12T00:59:22.858 INFO:tasks.workunit.client.0.smithi070.stderr: -193> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command objecter_requests cmddesc objecter_requests hook 0x557eb207ce20 EEXIST 2024-09-12T00:59:22.858 INFO:tasks.workunit.client.0.smithi070.stderr: -192> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 1 librados: setting wanted keys 2024-09-12T00:59:22.858 INFO:tasks.workunit.client.0.smithi070.stderr: -191> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 1 librados: calling monclient init 2024-09-12T00:59:22.858 INFO:tasks.workunit.client.0.smithi070.stderr: -190> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient: init 2024-09-12T00:59:22.858 INFO:tasks.workunit.client.0.smithi070.stderr: -189> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding auth protocol: cephx 2024-09-12T00:59:22.859 INFO:tasks.workunit.client.0.smithi070.stderr: -188> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding auth protocol: cephx 2024-09-12T00:59:22.859 INFO:tasks.workunit.client.0.smithi070.stderr: -187> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding auth protocol: cephx 2024-09-12T00:59:22.859 INFO:tasks.workunit.client.0.smithi070.stderr: -186> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding con mode: secure 2024-09-12T00:59:22.859 INFO:tasks.workunit.client.0.smithi070.stderr: -185> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding con mode: crc 2024-09-12T00:59:22.859 INFO:tasks.workunit.client.0.smithi070.stderr: -184> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding con mode: secure 2024-09-12T00:59:22.859 INFO:tasks.workunit.client.0.smithi070.stderr: -183> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding con mode: crc 2024-09-12T00:59:22.859 INFO:tasks.workunit.client.0.smithi070.stderr: -182> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding con mode: secure 2024-09-12T00:59:22.859 INFO:tasks.workunit.client.0.smithi070.stderr: -181> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding con mode: crc 2024-09-12T00:59:22.860 INFO:tasks.workunit.client.0.smithi070.stderr: -180> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding con mode: crc 2024-09-12T00:59:22.860 INFO:tasks.workunit.client.0.smithi070.stderr: -179> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding con mode: secure 2024-09-12T00:59:22.860 INFO:tasks.workunit.client.0.smithi070.stderr: -178> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding con mode: crc 2024-09-12T00:59:22.860 INFO:tasks.workunit.client.0.smithi070.stderr: -177> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding con mode: secure 2024-09-12T00:59:22.860 INFO:tasks.workunit.client.0.smithi070.stderr: -176> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding con mode: crc 2024-09-12T00:59:22.860 INFO:tasks.workunit.client.0.smithi070.stderr: -175> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding con mode: secure 2024-09-12T00:59:22.860 INFO:tasks.workunit.client.0.smithi070.stderr: -174> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:22.860 INFO:tasks.workunit.client.0.smithi070.stderr: -173> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:22.860 INFO:tasks.workunit.client.0.smithi070.stderr: -172> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command rotate-key cmddesc rotate-key hook 0x557eb205b0d8 EEXIST 2024-09-12T00:59:22.861 INFO:tasks.workunit.client.0.smithi070.stderr: -171> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient: _reopen_session rank -1 2024-09-12T00:59:22.861 INFO:tasks.workunit.client.0.smithi070.stderr: -170> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:59:22.861 INFO:tasks.workunit.client.0.smithi070.stderr: -169> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient(hunting): picked mon.noname-b con 0x557eb20ac970 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:59:22.861 INFO:tasks.workunit.client.0.smithi070.stderr: -168> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient(hunting): picked mon.noname-c con 0x557eb20b20e0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:59:22.861 INFO:tasks.workunit.client.0.smithi070.stderr: -167> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient(hunting): picked mon.noname-a con 0x557eb20b6a90 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:59:22.861 INFO:tasks.workunit.client.0.smithi070.stderr: -166> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:22.861 INFO:tasks.workunit.client.0.smithi070.stderr: -165> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:22.861 INFO:tasks.workunit.client.0.smithi070.stderr: -164> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:22.861 INFO:tasks.workunit.client.0.smithi070.stderr: -163> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient(hunting): _renew_subs 2024-09-12T00:59:22.861 INFO:tasks.workunit.client.0.smithi070.stderr: -162> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient(hunting): authenticate will time out at 2413.188572s 2024-09-12T00:59:22.861 INFO:tasks.workunit.client.0.smithi070.stderr: -161> 2024-09-12T00:59:22.741+0000 7fc3f248e640 10 monclient(hunting): get_auth_request con 0x557eb20b20e0 auth_method 0 2024-09-12T00:59:22.861 INFO:tasks.workunit.client.0.smithi070.stderr: -160> 2024-09-12T00:59:22.741+0000 7fc3f248e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:22.861 INFO:tasks.workunit.client.0.smithi070.stderr: -159> 2024-09-12T00:59:22.741+0000 7fc3f248e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:22.862 INFO:tasks.workunit.client.0.smithi070.stderr: -158> 2024-09-12T00:59:22.741+0000 7fc3f248e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:22.862 INFO:tasks.workunit.client.0.smithi070.stderr: -157> 2024-09-12T00:59:22.741+0000 7fc3f3490640 10 monclient(hunting): get_auth_request con 0x557eb20b6a90 auth_method 0 2024-09-12T00:59:22.862 INFO:tasks.workunit.client.0.smithi070.stderr: -156> 2024-09-12T00:59:22.741+0000 7fc3f3490640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:22.862 INFO:tasks.workunit.client.0.smithi070.stderr: -155> 2024-09-12T00:59:22.741+0000 7fc3f3490640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:22.862 INFO:tasks.workunit.client.0.smithi070.stderr: -154> 2024-09-12T00:59:22.741+0000 7fc3f3490640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:22.862 INFO:tasks.workunit.client.0.smithi070.stderr: -153> 2024-09-12T00:59:22.741+0000 7fc3f248e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:22.862 INFO:tasks.workunit.client.0.smithi070.stderr: -152> 2024-09-12T00:59:22.741+0000 7fc3f248e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:22.862 INFO:tasks.workunit.client.0.smithi070.stderr: -151> 2024-09-12T00:59:22.741+0000 7fc3f248e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:22.862 INFO:tasks.workunit.client.0.smithi070.stderr: -150> 2024-09-12T00:59:22.741+0000 7fc3f3490640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:22.863 INFO:tasks.workunit.client.0.smithi070.stderr: -149> 2024-09-12T00:59:22.741+0000 7fc3f3490640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:22.863 INFO:tasks.workunit.client.0.smithi070.stderr: -148> 2024-09-12T00:59:22.741+0000 7fc3f3490640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:22.863 INFO:tasks.workunit.client.0.smithi070.stderr: -147> 2024-09-12T00:59:22.741+0000 7fc3f248e640 10 monclient(hunting): handle_auth_done global_id 7790 payload 824 2024-09-12T00:59:22.863 INFO:tasks.workunit.client.0.smithi070.stderr: -146> 2024-09-12T00:59:22.741+0000 7fc3f248e640 10 monclient: _finish_hunting 0 2024-09-12T00:59:22.863 INFO:tasks.workunit.client.0.smithi070.stderr: -145> 2024-09-12T00:59:22.741+0000 7fc3f248e640 1 monclient: found mon.noname-c 2024-09-12T00:59:22.863 INFO:tasks.workunit.client.0.smithi070.stderr: -144> 2024-09-12T00:59:22.741+0000 7fc3f248e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:59:22.863 INFO:tasks.workunit.client.0.smithi070.stderr: -143> 2024-09-12T00:59:22.741+0000 7fc2d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:22.863 INFO:tasks.workunit.client.0.smithi070.stderr: -142> 2024-09-12T00:59:22.741+0000 7fc2d4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:59:22.863 INFO:tasks.workunit.client.0.smithi070.stderr: -141> 2024-09-12T00:59:22.741+0000 7fc2d4ff9640 10 monclient: dump: 2024-09-12T00:59:22.863 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:22.863 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:22.864 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.864 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.864 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:22.864 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.864 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:22.864 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:22.864 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:22.864 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.864 INFO:tasks.workunit.client.0.smithi070.stderr: -140> 2024-09-12T00:59:22.741+0000 7fc2d4ff9640 10 monclient: _finish_auth 0 2024-09-12T00:59:22.864 INFO:tasks.workunit.client.0.smithi070.stderr: -139> 2024-09-12T00:59:22.741+0000 7fc2d4ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:59:22.864 INFO:tasks.workunit.client.0.smithi070.stderr: -138> 2024-09-12T00:59:22.741+0000 7fc2d4ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:59:22.864 INFO:tasks.workunit.client.0.smithi070.stderr: -137> 2024-09-12T00:59:22.741+0000 7fc2d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:22.864 INFO:tasks.workunit.client.0.smithi070.stderr: -136> 2024-09-12T00:59:22.741+0000 7fc2d4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:59:22.865 INFO:tasks.workunit.client.0.smithi070.stderr: -135> 2024-09-12T00:59:22.741+0000 7fc2d4ff9640 10 monclient: dump: 2024-09-12T00:59:22.865 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:22.865 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:22.865 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.865 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.865 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:22.865 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.865 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:22.865 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:22.865 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:22.865 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.865 INFO:tasks.workunit.client.0.smithi070.stderr: -134> 2024-09-12T00:59:22.741+0000 7fc2d67fc640 4 set_mon_vals no callback set 2024-09-12T00:59:22.865 INFO:tasks.workunit.client.0.smithi070.stderr: -133> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 monclient: authenticate success, global_id 7790 2024-09-12T00:59:22.865 INFO:tasks.workunit.client.0.smithi070.stderr: -132> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient: _renew_subs 2024-09-12T00:59:22.866 INFO:tasks.workunit.client.0.smithi070.stderr: -131> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:59:22.866 INFO:tasks.workunit.client.0.smithi070.stderr: -130> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient: _renew_subs 2024-09-12T00:59:22.866 INFO:tasks.workunit.client.0.smithi070.stderr: -129> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:59:22.866 INFO:tasks.workunit.client.0.smithi070.stderr: -128> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 1 librados: init done 2024-09-12T00:59:22.866 INFO:tasks.workunit.client.0.smithi070.stderr: -127> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command cr dump hook 0x557eb20a04a8 2024-09-12T00:59:22.866 INFO:tasks.workunit.client.0.smithi070.stderr: -126> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.866 INFO:tasks.workunit.client.0.smithi070.stderr: -125> 2024-09-12T00:59:22.741+0000 7fc2d4ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:59:22.866 INFO:tasks.workunit.client.0.smithi070.stderr: -124> 2024-09-12T00:59:22.741+0000 7fc2d4ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:59:22.866 INFO:tasks.workunit.client.0.smithi070.stderr: -123> 2024-09-12T00:59:22.741+0000 7fc2d4ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:59:22.866 INFO:tasks.workunit.client.0.smithi070.stderr: -122> 2024-09-12T00:59:22.741+0000 7fc3f2c8f640 10 monclient: get_auth_request con 0x7fc2bc070b10 auth_method 0 2024-09-12T00:59:22.866 INFO:tasks.workunit.client.0.smithi070.stderr: -121> 2024-09-12T00:59:22.741+0000 7fc3f3490640 10 monclient: get_auth_request con 0x557eb20c6950 auth_method 0 2024-09-12T00:59:22.866 INFO:tasks.workunit.client.0.smithi070.stderr: -120> 2024-09-12T00:59:22.745+0000 7fc3f51899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.866 INFO:tasks.workunit.client.0.smithi070.stderr: -119> 2024-09-12T00:59:22.745+0000 7fc3f51899c0 20 realm 2024-09-12T00:59:22.867 INFO:tasks.workunit.client.0.smithi070.stderr: -118> 2024-09-12T00:59:22.745+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.867 INFO:tasks.workunit.client.0.smithi070.stderr: -117> 2024-09-12T00:59:22.745+0000 7fc3f51899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.867 INFO:tasks.workunit.client.0.smithi070.stderr: -116> 2024-09-12T00:59:22.745+0000 7fc3f51899c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:59:22.867 INFO:tasks.workunit.client.0.smithi070.stderr: -115> 2024-09-12T00:59:22.745+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.867 INFO:tasks.workunit.client.0.smithi070.stderr: -114> 2024-09-12T00:59:22.745+0000 7fc3f51899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.867 INFO:tasks.workunit.client.0.smithi070.stderr: -113> 2024-09-12T00:59:22.745+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.867 INFO:tasks.workunit.client.0.smithi070.stderr: -112> 2024-09-12T00:59:22.745+0000 7fc3f2c8f640 10 monclient: get_auth_request con 0x557eb20cacd0 auth_method 0 2024-09-12T00:59:22.867 INFO:tasks.workunit.client.0.smithi070.stderr: -111> 2024-09-12T00:59:22.749+0000 7fc3f51899c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:59:22.867 INFO:tasks.workunit.client.0.smithi070.stderr: -110> 2024-09-12T00:59:22.749+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.867 INFO:tasks.workunit.client.0.smithi070.stderr: -109> 2024-09-12T00:59:22.749+0000 7fc3f248e640 10 monclient: get_auth_request con 0x557eb20ce430 auth_method 0 2024-09-12T00:59:22.867 INFO:tasks.workunit.client.0.smithi070.stderr: -108> 2024-09-12T00:59:22.749+0000 7fc3f51899c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:59:22.867 INFO:tasks.workunit.client.0.smithi070.stderr: -107> 2024-09-12T00:59:22.749+0000 7fc3f51899c0 20 searching for the correct realm 2024-09-12T00:59:22.867 INFO:tasks.workunit.client.0.smithi070.stderr: -106> 2024-09-12T00:59:22.749+0000 7fc3f3490640 10 monclient: get_auth_request con 0x557eb20d3180 auth_method 0 2024-09-12T00:59:22.868 INFO:tasks.workunit.client.0.smithi070.stderr: -105> 2024-09-12T00:59:22.749+0000 7fc3f2c8f640 10 monclient: get_auth_request con 0x7fc3ec00e040 auth_method 0 2024-09-12T00:59:22.868 INFO:tasks.workunit.client.0.smithi070.stderr: -104> 2024-09-12T00:59:22.753+0000 7fc3f248e640 10 monclient: get_auth_request con 0x7fc3e412dbd0 auth_method 0 2024-09-12T00:59:22.868 INFO:tasks.workunit.client.0.smithi070.stderr: -103> 2024-09-12T00:59:22.753+0000 7fc3f3490640 10 monclient: get_auth_request con 0x7fc3e801a040 auth_method 0 2024-09-12T00:59:22.868 INFO:tasks.workunit.client.0.smithi070.stderr: -102> 2024-09-12T00:59:22.753+0000 7fc3f2c8f640 0 -- 172.21.15.70:0/1138414970 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7fc3ec00e040 msgr2=0x7fc3ec01c8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:59:22.868 INFO:tasks.workunit.client.0.smithi070.stderr: -101> 2024-09-12T00:59:22.753+0000 7fc2d4ff9640 1 client.7790.objecter ms_handle_reset 0x7fc3ec00e040 session 0x7fc3ec015040 osd.7 2024-09-12T00:59:22.868 INFO:tasks.workunit.client.0.smithi070.stderr: -100> 2024-09-12T00:59:22.753+0000 7fc2d4ff9640 10 monclient: _renew_subs 2024-09-12T00:59:22.868 INFO:tasks.workunit.client.0.smithi070.stderr: -99> 2024-09-12T00:59:22.753+0000 7fc2d4ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:59:22.868 INFO:tasks.workunit.client.0.smithi070.stderr: -98> 2024-09-12T00:59:22.757+0000 7fc3f2c8f640 10 monclient: get_auth_request con 0x7fc2bc0808b0 auth_method 0 2024-09-12T00:59:22.868 INFO:tasks.workunit.client.0.smithi070.stderr: -97> 2024-09-12T00:59:22.757+0000 7fc3f2c8f640 10 monclient: get_auth_request con 0x7fc3ec029900 auth_method 0 2024-09-12T00:59:22.868 INFO:tasks.workunit.client.0.smithi070.stderr: -96> 2024-09-12T00:59:22.761+0000 7fc3f2c8f640 0 -- 172.21.15.70:0/1138414970 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7fc3ec029900 msgr2=0x7fc3ec028380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:59:22.868 INFO:tasks.workunit.client.0.smithi070.stderr: -95> 2024-09-12T00:59:22.761+0000 7fc2d4ff9640 1 client.7790.objecter ms_handle_reset 0x7fc3ec029900 session 0x7fc3ec01d770 osd.6 2024-09-12T00:59:22.868 INFO:tasks.workunit.client.0.smithi070.stderr: -94> 2024-09-12T00:59:22.761+0000 7fc3f2c8f640 10 monclient: get_auth_request con 0x7fc3ec00e040 auth_method 0 2024-09-12T00:59:22.868 INFO:tasks.workunit.client.0.smithi070.stderr: -93> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:59:22.869 INFO:tasks.workunit.client.0.smithi070.stderr: -92> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:59:22.869 INFO:tasks.workunit.client.0.smithi070.stderr: -91> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:59:22.869 INFO:tasks.workunit.client.0.smithi070.stderr: -90> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:59:22.869 INFO:tasks.workunit.client.0.smithi070.stderr: -89> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:59:22.869 INFO:tasks.workunit.client.0.smithi070.stderr: -88> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:59:22.869 INFO:tasks.workunit.client.0.smithi070.stderr: -87> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.869 INFO:tasks.workunit.client.0.smithi070.stderr: -86> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.869 INFO:tasks.workunit.client.0.smithi070.stderr: -85> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.869 INFO:tasks.workunit.client.0.smithi070.stderr: -84> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:59:22.869 INFO:tasks.workunit.client.0.smithi070.stderr: -83> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.869 INFO:tasks.workunit.client.0.smithi070.stderr: -82> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:59:22.869 INFO:tasks.workunit.client.0.smithi070.stderr: -81> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 zone default found 2024-09-12T00:59:22.870 INFO:tasks.workunit.client.0.smithi070.stderr: -80> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 4 Realm: () 2024-09-12T00:59:22.870 INFO:tasks.workunit.client.0.smithi070.stderr: -79> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:59:22.870 INFO:tasks.workunit.client.0.smithi070.stderr: -78> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:59:22.870 INFO:tasks.workunit.client.0.smithi070.stderr: -77> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:59:22.870 INFO:tasks.workunit.client.0.smithi070.stderr: -76> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 zonegroup default 2024-09-12T00:59:22.870 INFO:tasks.workunit.client.0.smithi070.stderr: -75> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.870 INFO:tasks.workunit.client.0.smithi070.stderr: -74> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.870 INFO:tasks.workunit.client.0.smithi070.stderr: -73> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.870 INFO:tasks.workunit.client.0.smithi070.stderr: -72> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.870 INFO:tasks.workunit.client.0.smithi070.stderr: -71> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.870 INFO:tasks.workunit.client.0.smithi070.stderr: -70> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.870 INFO:tasks.workunit.client.0.smithi070.stderr: -69> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 started sync module instance, tier type = 2024-09-12T00:59:22.870 INFO:tasks.workunit.client.0.smithi070.stderr: -68> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:59:22.871 INFO:tasks.workunit.client.0.smithi070.stderr: -67> 2024-09-12T00:59:22.785+0000 7fc3f51899c0 20 add_watcher() i=0 2024-09-12T00:59:22.871 INFO:tasks.workunit.client.0.smithi070.stderr: -66> 2024-09-12T00:59:22.785+0000 7fc3f51899c0 20 add_watcher() i=1 2024-09-12T00:59:22.871 INFO:tasks.workunit.client.0.smithi070.stderr: -65> 2024-09-12T00:59:22.785+0000 7fc3f51899c0 20 add_watcher() i=2 2024-09-12T00:59:22.871 INFO:tasks.workunit.client.0.smithi070.stderr: -64> 2024-09-12T00:59:22.785+0000 7fc3f51899c0 20 add_watcher() i=3 2024-09-12T00:59:22.871 INFO:tasks.workunit.client.0.smithi070.stderr: -63> 2024-09-12T00:59:22.785+0000 7fc3f51899c0 20 add_watcher() i=4 2024-09-12T00:59:22.871 INFO:tasks.workunit.client.0.smithi070.stderr: -62> 2024-09-12T00:59:22.785+0000 7fc3f51899c0 20 add_watcher() i=5 2024-09-12T00:59:22.871 INFO:tasks.workunit.client.0.smithi070.stderr: -61> 2024-09-12T00:59:22.785+0000 7fc3f51899c0 20 add_watcher() i=6 2024-09-12T00:59:22.871 INFO:tasks.workunit.client.0.smithi070.stderr: -60> 2024-09-12T00:59:22.785+0000 7fc3f51899c0 20 add_watcher() i=7 2024-09-12T00:59:22.871 INFO:tasks.workunit.client.0.smithi070.stderr: -59> 2024-09-12T00:59:22.785+0000 7fc3f51899c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:59:22.871 INFO:tasks.workunit.client.0.smithi070.stderr: -58> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding auth protocol: cephx 2024-09-12T00:59:22.871 INFO:tasks.workunit.client.0.smithi070.stderr: -57> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding auth protocol: cephx 2024-09-12T00:59:22.871 INFO:tasks.workunit.client.0.smithi070.stderr: -56> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding auth protocol: cephx 2024-09-12T00:59:22.872 INFO:tasks.workunit.client.0.smithi070.stderr: -55> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding con mode: secure 2024-09-12T00:59:22.872 INFO:tasks.workunit.client.0.smithi070.stderr: -54> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding con mode: crc 2024-09-12T00:59:22.872 INFO:tasks.workunit.client.0.smithi070.stderr: -53> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding con mode: secure 2024-09-12T00:59:22.872 INFO:tasks.workunit.client.0.smithi070.stderr: -52> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding con mode: crc 2024-09-12T00:59:22.872 INFO:tasks.workunit.client.0.smithi070.stderr: -51> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding con mode: secure 2024-09-12T00:59:22.872 INFO:tasks.workunit.client.0.smithi070.stderr: -50> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding con mode: crc 2024-09-12T00:59:22.872 INFO:tasks.workunit.client.0.smithi070.stderr: -49> 2024-09-12T00:59:22.789+0000 7fc2a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:59:22.872 INFO:tasks.workunit.client.0.smithi070.stderr: -48> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding con mode: crc 2024-09-12T00:59:22.872 INFO:tasks.workunit.client.0.smithi070.stderr: -47> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding con mode: secure 2024-09-12T00:59:22.872 INFO:tasks.workunit.client.0.smithi070.stderr: -46> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding con mode: crc 2024-09-12T00:59:22.872 INFO:tasks.workunit.client.0.smithi070.stderr: -45> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding con mode: secure 2024-09-12T00:59:22.872 INFO:tasks.workunit.client.0.smithi070.stderr: -44> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding con mode: crc 2024-09-12T00:59:22.873 INFO:tasks.workunit.client.0.smithi070.stderr: -43> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding con mode: secure 2024-09-12T00:59:22.873 INFO:tasks.workunit.client.0.smithi070.stderr: -42> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:22.873 INFO:tasks.workunit.client.0.smithi070.stderr: -41> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:59:22.873 INFO:tasks.workunit.client.0.smithi070.stderr: -40> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:59:22.873 INFO:tasks.workunit.client.0.smithi070.stderr: -39> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command cache list hook 0x557eb20b6ed0 2024-09-12T00:59:22.873 INFO:tasks.workunit.client.0.smithi070.stderr: -38> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command cache inspect hook 0x557eb20b6ed0 2024-09-12T00:59:22.873 INFO:tasks.workunit.client.0.smithi070.stderr: -37> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command cache erase hook 0x557eb20b6ed0 2024-09-12T00:59:22.873 INFO:tasks.workunit.client.0.smithi070.stderr: -36> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command cache zap hook 0x557eb20b6ed0 2024-09-12T00:59:22.873 INFO:tasks.workunit.client.0.smithi070.stderr: -35> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 note: GC not initialized 2024-09-12T00:59:22.873 INFO:tasks.workunit.client.0.smithi070.stderr: -34> 2024-09-12T00:59:22.789+0000 7fc2a8fe1640 20 reqs_thread_entry: start 2024-09-12T00:59:22.873 INFO:tasks.workunit.client.0.smithi070.stderr: -33> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command sync trace show hook 0x7fc3e4004300 2024-09-12T00:59:22.873 INFO:tasks.workunit.client.0.smithi070.stderr: -32> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command sync trace history hook 0x7fc3e4004300 2024-09-12T00:59:22.874 INFO:tasks.workunit.client.0.smithi070.stderr: -31> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command sync trace active hook 0x7fc3e4004300 2024-09-12T00:59:22.874 INFO:tasks.workunit.client.0.smithi070.stderr: -30> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command sync trace active_short hook 0x7fc3e4004300 2024-09-12T00:59:22.874 INFO:tasks.workunit.client.0.smithi070.stderr: -29> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 20 init_complete bucket index max shards: 1 2024-09-12T00:59:22.874 INFO:tasks.workunit.client.0.smithi070.stderr: -28> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 20 Filter name: none 2024-09-12T00:59:22.874 INFO:tasks.workunit.client.0.smithi070.stderr: -27> 2024-09-12T00:59:22.789+0000 7fc2a1ffb640 20 reqs_thread_entry: start 2024-09-12T00:59:22.874 INFO:tasks.workunit.client.0.smithi070.stderr: -26> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:59:22.874 INFO:tasks.workunit.client.0.smithi070.stderr: -25> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.874 INFO:tasks.workunit.client.0.smithi070.stderr: -24> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:59:22.874 INFO:tasks.workunit.client.0.smithi070.stderr: -23> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:59:22.874 INFO:tasks.workunit.client.0.smithi070.stderr: -22> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:59:22.874 INFO:tasks.workunit.client.0.smithi070.stderr: -21> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : miss 2024-09-12T00:59:22.874 INFO:tasks.workunit.client.0.smithi070.stderr: -20> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.874 INFO:tasks.workunit.client.0.smithi070.stderr: -19> 2024-09-12T00:59:22.793+0000 7fc3f51899c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:59:22.875 INFO:tasks.workunit.client.0.smithi070.stderr: -18> 2024-09-12T00:59:22.793+0000 7fc3f51899c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:59:22.875 INFO:tasks.workunit.client.0.smithi070.stderr: -17> 2024-09-12T00:59:22.793+0000 7fc3f51899c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:59:22.875 INFO:tasks.workunit.client.0.smithi070.stderr: -16> 2024-09-12T00:59:22.793+0000 7fc3f51899c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:59:22.875 INFO:tasks.workunit.client.0.smithi070.stderr: -15> 2024-09-12T00:59:22.793+0000 7fc3f51899c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:59:22.875 INFO:tasks.workunit.client.0.smithi070.stderr: -14> 2024-09-12T00:59:22.793+0000 7fc3f51899c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T00:59:22.875 INFO:tasks.workunit.client.0.smithi070.stderr: -13> 2024-09-12T00:59:22.801+0000 7fc3f51899c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:59:22.875 INFO:tasks.workunit.client.0.smithi070.stderr: -12> 2024-09-12T00:59:22.801+0000 7fc3f51899c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:59:22.875 INFO:tasks.workunit.client.0.smithi070.stderr: -11> 2024-09-12T00:59:22.801+0000 7fc3f51899c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:59:22.875 INFO:tasks.workunit.client.0.smithi070.stderr: -10> 2024-09-12T00:59:22.801+0000 7fc3f51899c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18, ofs0, ns] 2024-09-12T00:59:22.875 INFO:tasks.workunit.client.0.smithi070.stderr: -9> 2024-09-12T00:59:22.801+0000 7fc2d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431647 cookie 94002641468272 notifier 7790 bl.length()=911 2024-09-12T00:59:22.875 INFO:tasks.workunit.client.0.smithi070.stderr: -8> 2024-09-12T00:59:22.801+0000 7fc2d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:59:22.875 INFO:tasks.workunit.client.0.smithi070.stderr: -7> 2024-09-12T00:59:22.801+0000 7fc2d67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:59:22.875 INFO:tasks.workunit.client.0.smithi070.stderr: -6> 2024-09-12T00:59:22.801+0000 7fc2d67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:59:22.876 INFO:tasks.workunit.client.0.smithi070.stderr: -5> 2024-09-12T00:59:22.801+0000 7fc3f51899c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_sources= new_sources= 2024-09-12T00:59:22.876 INFO:tasks.workunit.client.0.smithi070.stderr: -4> 2024-09-12T00:59:22.801+0000 7fc3f51899c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential sources added=[] removed=[] 2024-09-12T00:59:22.876 INFO:tasks.workunit.client.0.smithi070.stderr: -3> 2024-09-12T00:59:22.801+0000 7fc3f51899c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_dests= new_dests= 2024-09-12T00:59:22.876 INFO:tasks.workunit.client.0.smithi070.stderr: -2> 2024-09-12T00:59:22.801+0000 7fc3f51899c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential dests added=[] removed=[] 2024-09-12T00:59:22.876 INFO:tasks.workunit.client.0.smithi070.stderr: -1> 2024-09-12T00:59:22.809+0000 7fc3f51899c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc3f51899c0 time 2024-09-12T00:59:22.810711+0000 2024-09-12T00:59:22.876 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:59:22.876 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.876 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:59:22.876 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc3f8a632eb] 2024-09-12T00:59:22.876 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc3f8a6349f] 2024-09-12T00:59:22.876 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557eafa64cc1] 2024-09-12T00:59:22.876 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x557eafa79d5a] 2024-09-12T00:59:22.877 INFO:tasks.workunit.client.0.smithi070.stderr: 5: main() 2024-09-12T00:59:22.877 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc3f78c9d90] 2024-09-12T00:59:22.877 INFO:tasks.workunit.client.0.smithi070.stderr: 7: __libc_start_main() 2024-09-12T00:59:22.877 INFO:tasks.workunit.client.0.smithi070.stderr: 8: _start() 2024-09-12T00:59:22.877 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.877 INFO:tasks.workunit.client.0.smithi070.stderr: 0> 2024-09-12T00:59:22.809+0000 7fc3f51899c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:59:22.877 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7fc3f51899c0 thread_name:radosgw-admin 2024-09-12T00:59:22.877 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.877 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:59:22.877 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc3f78e2520] 2024-09-12T00:59:22.877 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:59:22.877 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:59:22.877 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:59:22.878 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc3f8a63345] 2024-09-12T00:59:22.878 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc3f8a6349f] 2024-09-12T00:59:22.878 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557eafa64cc1] 2024-09-12T00:59:22.878 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x557eafa79d5a] 2024-09-12T00:59:22.878 INFO:tasks.workunit.client.0.smithi070.stderr: 9: main() 2024-09-12T00:59:22.878 INFO:tasks.workunit.client.0.smithi070.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc3f78c9d90] 2024-09-12T00:59:22.878 INFO:tasks.workunit.client.0.smithi070.stderr: 11: __libc_start_main() 2024-09-12T00:59:22.878 INFO:tasks.workunit.client.0.smithi070.stderr: 12: _start() 2024-09-12T00:59:22.878 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:59:22.878 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.878 INFO:tasks.workunit.client.0.smithi070.stderr:--- logging levels --- 2024-09-12T00:59:22.878 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 none 2024-09-12T00:59:22.878 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 lockdep 2024-09-12T00:59:22.878 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 context 2024-09-12T00:59:22.879 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 crush 2024-09-12T00:59:22.879 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds 2024-09-12T00:59:22.879 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_balancer 2024-09-12T00:59:22.879 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_locker 2024-09-12T00:59:22.879 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log 2024-09-12T00:59:22.879 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log_expire 2024-09-12T00:59:22.879 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_migrator 2024-09-12T00:59:22.879 INFO:tasks.workunit.client.0.smithi070.stderr: 3/ 5 mds_quiesce 2024-09-12T00:59:22.879 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 buffer 2024-09-12T00:59:22.879 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 timer 2024-09-12T00:59:22.879 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 filer 2024-09-12T00:59:22.879 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 striper 2024-09-12T00:59:22.879 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 objecter 2024-09-12T00:59:22.880 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rados 2024-09-12T00:59:22.880 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd 2024-09-12T00:59:22.880 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_mirror 2024-09-12T00:59:22.880 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_replay 2024-09-12T00:59:22.880 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_pwl 2024-09-12T00:59:22.880 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 journaler 2024-09-12T00:59:22.880 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objectcacher 2024-09-12T00:59:22.880 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:59:22.880 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 client 2024-09-12T00:59:22.880 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 osd 2024-09-12T00:59:22.880 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 optracker 2024-09-12T00:59:22.880 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objclass 2024-09-12T00:59:22.880 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 filestore 2024-09-12T00:59:22.880 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 journal 2024-09-12T00:59:22.881 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 ms 2024-09-12T00:59:22.881 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mon 2024-09-12T00:59:22.881 INFO:tasks.workunit.client.0.smithi070.stderr: 0/10 monc 2024-09-12T00:59:22.881 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 paxos 2024-09-12T00:59:22.881 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 tp 2024-09-12T00:59:22.881 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 auth 2024-09-12T00:59:22.881 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 crypto 2024-09-12T00:59:22.881 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 finisher 2024-09-12T00:59:22.881 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 reserver 2024-09-12T00:59:22.881 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 heartbeatmap 2024-09-12T00:59:22.881 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 perfcounter 2024-09-12T00:59:22.881 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw 2024-09-12T00:59:22.881 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_sync 2024-09-12T00:59:22.882 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_datacache 2024-09-12T00:59:22.882 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_access 2024-09-12T00:59:22.882 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:59:22.882 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_flight 2024-09-12T00:59:22.882 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:59:22.882 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw_notification 2024-09-12T00:59:22.882 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 javaclient 2024-09-12T00:59:22.882 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 asok 2024-09-12T00:59:22.882 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 throttle 2024-09-12T00:59:22.882 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 refs 2024-09-12T00:59:22.882 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 compressor 2024-09-12T00:59:22.882 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluestore 2024-09-12T00:59:22.882 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluefs 2024-09-12T00:59:22.882 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 bdev 2024-09-12T00:59:22.883 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 kstore 2024-09-12T00:59:22.883 INFO:tasks.workunit.client.0.smithi070.stderr: 4/ 5 rocksdb 2024-09-12T00:59:22.883 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 fuse 2024-09-12T00:59:22.883 INFO:tasks.workunit.client.0.smithi070.stderr: 2/ 5 mgr 2024-09-12T00:59:22.883 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mgrc 2024-09-12T00:59:22.883 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 dpdk 2024-09-12T00:59:22.883 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 eventtrace 2024-09-12T00:59:22.883 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 prioritycache 2024-09-12T00:59:22.883 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 test 2024-09-12T00:59:22.883 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:59:22.883 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephsqlite 2024-09-12T00:59:22.883 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:59:22.883 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore 2024-09-12T00:59:22.884 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_onode 2024-09-12T00:59:22.884 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_odata 2024-09-12T00:59:22.884 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_omap 2024-09-12T00:59:22.884 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_tm 2024-09-12T00:59:22.884 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_t 2024-09-12T00:59:22.884 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:59:22.884 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_epm 2024-09-12T00:59:22.884 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_lba 2024-09-12T00:59:22.884 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:59:22.884 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cache 2024-09-12T00:59:22.884 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_journal 2024-09-12T00:59:22.884 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_device 2024-09-12T00:59:22.884 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_backref 2024-09-12T00:59:22.884 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 alienstore 2024-09-12T00:59:22.885 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mclock 2024-09-12T00:59:22.885 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cyanstore 2024-09-12T00:59:22.885 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 ceph_exporter 2024-09-12T00:59:22.885 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 memstore 2024-09-12T00:59:22.885 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 trace 2024-09-12T00:59:22.885 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 ceph_dedup 2024-09-12T00:59:22.885 INFO:tasks.workunit.client.0.smithi070.stderr: -2/-2 (syslog threshold) 2024-09-12T00:59:22.885 INFO:tasks.workunit.client.0.smithi070.stderr: 99/99 (stderr threshold) 2024-09-12T00:59:22.885 INFO:tasks.workunit.client.0.smithi070.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:59:22.885 INFO:tasks.workunit.client.0.smithi070.stderr: 7fc2a1ffb640 / http_manager 2024-09-12T00:59:22.885 INFO:tasks.workunit.client.0.smithi070.stderr: 7fc2a8fe1640 / http_manager 2024-09-12T00:59:22.885 INFO:tasks.workunit.client.0.smithi070.stderr: 7fc2a9fe3640 / rgw_dt_lg_renew 2024-09-12T00:59:22.885 INFO:tasks.workunit.client.0.smithi070.stderr: 7fc2d4ff9640 / ms_dispatch 2024-09-12T00:59:22.885 INFO:tasks.workunit.client.0.smithi070.stderr: 7fc2d67fc640 / io_context_pool 2024-09-12T00:59:22.886 INFO:tasks.workunit.client.0.smithi070.stderr: 7fc2dce01640 / ms_dispatch 2024-09-12T00:59:22.886 INFO:tasks.workunit.client.0.smithi070.stderr: 7fc2df606640 / ms_dispatch 2024-09-12T00:59:22.886 INFO:tasks.workunit.client.0.smithi070.stderr: 7fc2e0e09640 / io_context_pool 2024-09-12T00:59:22.886 INFO:tasks.workunit.client.0.smithi070.stderr: 7fc3f1c8d640 / io_context_pool 2024-09-12T00:59:22.886 INFO:tasks.workunit.client.0.smithi070.stderr: 7fc3f248e640 / msgr-worker-2 2024-09-12T00:59:22.886 INFO:tasks.workunit.client.0.smithi070.stderr: 7fc3f2c8f640 / msgr-worker-1 2024-09-12T00:59:22.886 INFO:tasks.workunit.client.0.smithi070.stderr: 7fc3f3490640 / msgr-worker-0 2024-09-12T00:59:22.886 INFO:tasks.workunit.client.0.smithi070.stderr: 7fc3f51899c0 / radosgw-admin 2024-09-12T00:59:22.886 INFO:tasks.workunit.client.0.smithi070.stderr: max_recent 500 2024-09-12T00:59:22.886 INFO:tasks.workunit.client.0.smithi070.stderr: max_new 1000 2024-09-12T00:59:22.886 INFO:tasks.workunit.client.0.smithi070.stderr: log_file /var/log/ceph/ceph-client.admin.143319.log 2024-09-12T00:59:22.886 INFO:tasks.workunit.client.0.smithi070.stderr:--- end dump of recent events --- 2024-09-12T00:59:22.886 INFO:tasks.workunit.client.0.smithi070.stderr:--- begin dump of recent events --- 2024-09-12T00:59:22.887 INFO:tasks.workunit.client.0.smithi070.stderr: -499> 2024-09-12T00:59:22.721+0000 7fc3f2c8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:22.887 INFO:tasks.workunit.client.0.smithi070.stderr: -498> 2024-09-12T00:59:22.721+0000 7fc3f2c8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:22.887 INFO:tasks.workunit.client.0.smithi070.stderr: -497> 2024-09-12T00:59:22.721+0000 7fc3f248e640 10 monclient(hunting): handle_auth_done global_id 8304 payload 274 2024-09-12T00:59:22.887 INFO:tasks.workunit.client.0.smithi070.stderr: -496> 2024-09-12T00:59:22.721+0000 7fc3f248e640 10 monclient: _finish_hunting 0 2024-09-12T00:59:22.887 INFO:tasks.workunit.client.0.smithi070.stderr: -495> 2024-09-12T00:59:22.721+0000 7fc3f248e640 1 monclient: found mon.noname-a 2024-09-12T00:59:22.887 INFO:tasks.workunit.client.0.smithi070.stderr: -494> 2024-09-12T00:59:22.721+0000 7fc3f248e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:59:22.887 INFO:tasks.workunit.client.0.smithi070.stderr: -493> 2024-09-12T00:59:22.721+0000 7fc2e0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:22.887 INFO:tasks.workunit.client.0.smithi070.stderr: -492> 2024-09-12T00:59:22.721+0000 7fc2e0e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:59:22.887 INFO:tasks.workunit.client.0.smithi070.stderr: -491> 2024-09-12T00:59:22.721+0000 7fc2e0e09640 10 monclient: dump: 2024-09-12T00:59:22.887 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:22.887 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:22.887 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.887 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.887 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:22.888 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.888 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:22.888 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:22.888 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:22.888 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.888 INFO:tasks.workunit.client.0.smithi070.stderr: -490> 2024-09-12T00:59:22.721+0000 7fc2e0e09640 10 monclient: _finish_auth 0 2024-09-12T00:59:22.888 INFO:tasks.workunit.client.0.smithi070.stderr: -489> 2024-09-12T00:59:22.721+0000 7fc2e0e09640 10 monclient: _check_auth_tickets 2024-09-12T00:59:22.888 INFO:tasks.workunit.client.0.smithi070.stderr: -488> 2024-09-12T00:59:22.721+0000 7fc2e0e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:59:22.888 INFO:tasks.workunit.client.0.smithi070.stderr: -487> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 monclient: authenticate success, global_id 8304 2024-09-12T00:59:22.888 INFO:tasks.workunit.client.0.smithi070.stderr: -486> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 10 monclient: get_monmap_and_config success 2024-09-12T00:59:22.888 INFO:tasks.workunit.client.0.smithi070.stderr: -485> 2024-09-12T00:59:22.721+0000 7fc2e0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:22.888 INFO:tasks.workunit.client.0.smithi070.stderr: -484> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 4 set_mon_vals no callback set 2024-09-12T00:59:22.888 INFO:tasks.workunit.client.0.smithi070.stderr: -483> 2024-09-12T00:59:22.721+0000 7fc2e0e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:59:22.889 INFO:tasks.workunit.client.0.smithi070.stderr: -482> 2024-09-12T00:59:22.721+0000 7fc2e0e09640 10 monclient: dump: 2024-09-12T00:59:22.889 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:22.889 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:22.889 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.889 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.889 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:22.889 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.889 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:22.889 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:22.889 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:22.889 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.889 INFO:tasks.workunit.client.0.smithi070.stderr: -481> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 10 monclient: shutdown 2024-09-12T00:59:22.889 INFO:tasks.workunit.client.0.smithi070.stderr: -480> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) unregister_commands rotate-key 2024-09-12T00:59:22.890 INFO:tasks.workunit.client.0.smithi070.stderr: -479> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 10 monclient: build_initial_monmap 2024-09-12T00:59:22.890 INFO:tasks.workunit.client.0.smithi070.stderr: -478> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 1 build_initial for_mkfs: 0 2024-09-12T00:59:22.890 INFO:tasks.workunit.client.0.smithi070.stderr: -477> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 10 monclient: monmap: 2024-09-12T00:59:22.890 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:59:22.890 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:59:22.890 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:59:22.890 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:59:22.890 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:59:22.890 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.890 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:59:22.890 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:59:22.890 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:59:22.890 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.891 INFO:tasks.workunit.client.0.smithi070.stderr: -476> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding auth protocol: cephx 2024-09-12T00:59:22.891 INFO:tasks.workunit.client.0.smithi070.stderr: -475> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding auth protocol: cephx 2024-09-12T00:59:22.891 INFO:tasks.workunit.client.0.smithi070.stderr: -474> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding auth protocol: cephx 2024-09-12T00:59:22.891 INFO:tasks.workunit.client.0.smithi070.stderr: -473> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding con mode: secure 2024-09-12T00:59:22.891 INFO:tasks.workunit.client.0.smithi070.stderr: -472> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding con mode: crc 2024-09-12T00:59:22.891 INFO:tasks.workunit.client.0.smithi070.stderr: -471> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding con mode: secure 2024-09-12T00:59:22.891 INFO:tasks.workunit.client.0.smithi070.stderr: -470> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding con mode: crc 2024-09-12T00:59:22.891 INFO:tasks.workunit.client.0.smithi070.stderr: -469> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding con mode: secure 2024-09-12T00:59:22.891 INFO:tasks.workunit.client.0.smithi070.stderr: -468> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding con mode: crc 2024-09-12T00:59:22.891 INFO:tasks.workunit.client.0.smithi070.stderr: -467> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding con mode: crc 2024-09-12T00:59:22.891 INFO:tasks.workunit.client.0.smithi070.stderr: -466> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding con mode: secure 2024-09-12T00:59:22.891 INFO:tasks.workunit.client.0.smithi070.stderr: -465> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding con mode: crc 2024-09-12T00:59:22.891 INFO:tasks.workunit.client.0.smithi070.stderr: -464> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding con mode: secure 2024-09-12T00:59:22.892 INFO:tasks.workunit.client.0.smithi070.stderr: -463> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding con mode: crc 2024-09-12T00:59:22.892 INFO:tasks.workunit.client.0.smithi070.stderr: -462> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fe2fb0) adding con mode: secure 2024-09-12T00:59:22.892 INFO:tasks.workunit.client.0.smithi070.stderr: -461> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:22.892 INFO:tasks.workunit.client.0.smithi070.stderr: -460> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 1 librados: starting msgr at 2024-09-12T00:59:22.892 INFO:tasks.workunit.client.0.smithi070.stderr: -459> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 1 librados: starting objecter 2024-09-12T00:59:22.892 INFO:tasks.workunit.client.0.smithi070.stderr: -458> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command objecter_requests hook 0x557eb1fdfa40 2024-09-12T00:59:22.892 INFO:tasks.workunit.client.0.smithi070.stderr: -457> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 1 librados: setting wanted keys 2024-09-12T00:59:22.892 INFO:tasks.workunit.client.0.smithi070.stderr: -456> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 1 librados: calling monclient init 2024-09-12T00:59:22.892 INFO:tasks.workunit.client.0.smithi070.stderr: -455> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 10 monclient: init 2024-09-12T00:59:22.892 INFO:tasks.workunit.client.0.smithi070.stderr: -454> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding auth protocol: cephx 2024-09-12T00:59:22.892 INFO:tasks.workunit.client.0.smithi070.stderr: -453> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding auth protocol: cephx 2024-09-12T00:59:22.892 INFO:tasks.workunit.client.0.smithi070.stderr: -452> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding auth protocol: cephx 2024-09-12T00:59:22.892 INFO:tasks.workunit.client.0.smithi070.stderr: -451> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding con mode: secure 2024-09-12T00:59:22.892 INFO:tasks.workunit.client.0.smithi070.stderr: -450> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding con mode: crc 2024-09-12T00:59:22.893 INFO:tasks.workunit.client.0.smithi070.stderr: -449> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding con mode: secure 2024-09-12T00:59:22.893 INFO:tasks.workunit.client.0.smithi070.stderr: -448> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding con mode: crc 2024-09-12T00:59:22.893 INFO:tasks.workunit.client.0.smithi070.stderr: -447> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding con mode: secure 2024-09-12T00:59:22.893 INFO:tasks.workunit.client.0.smithi070.stderr: -446> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding con mode: crc 2024-09-12T00:59:22.893 INFO:tasks.workunit.client.0.smithi070.stderr: -445> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding con mode: crc 2024-09-12T00:59:22.893 INFO:tasks.workunit.client.0.smithi070.stderr: -444> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding con mode: secure 2024-09-12T00:59:22.893 INFO:tasks.workunit.client.0.smithi070.stderr: -443> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding con mode: crc 2024-09-12T00:59:22.893 INFO:tasks.workunit.client.0.smithi070.stderr: -442> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding con mode: secure 2024-09-12T00:59:22.893 INFO:tasks.workunit.client.0.smithi070.stderr: -441> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding con mode: crc 2024-09-12T00:59:22.893 INFO:tasks.workunit.client.0.smithi070.stderr: -440> 2024-09-12T00:59:22.721+0000 7fc3f51899c0 5 AuthRegistry(0x557eb1fddc60) adding con mode: secure 2024-09-12T00:59:22.893 INFO:tasks.workunit.client.0.smithi070.stderr: -439> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:22.893 INFO:tasks.workunit.client.0.smithi070.stderr: -438> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:22.893 INFO:tasks.workunit.client.0.smithi070.stderr: -437> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command rotate-key hook 0x557eb1fddda8 2024-09-12T00:59:22.893 INFO:tasks.workunit.client.0.smithi070.stderr: -436> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient: _reopen_session rank -1 2024-09-12T00:59:22.894 INFO:tasks.workunit.client.0.smithi070.stderr: -435> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:59:22.894 INFO:tasks.workunit.client.0.smithi070.stderr: -434> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient(hunting): picked mon.noname-c con 0x557eb1f23900 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:59:22.894 INFO:tasks.workunit.client.0.smithi070.stderr: -433> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient(hunting): picked mon.noname-b con 0x557eb1f23ce0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:59:22.894 INFO:tasks.workunit.client.0.smithi070.stderr: -432> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient(hunting): picked mon.noname-a con 0x557eb1f29aa0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:59:22.894 INFO:tasks.workunit.client.0.smithi070.stderr: -431> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:22.894 INFO:tasks.workunit.client.0.smithi070.stderr: -430> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:22.894 INFO:tasks.workunit.client.0.smithi070.stderr: -429> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:22.894 INFO:tasks.workunit.client.0.smithi070.stderr: -428> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient(hunting): _renew_subs 2024-09-12T00:59:22.894 INFO:tasks.workunit.client.0.smithi070.stderr: -427> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient(hunting): authenticate will time out at 2413.172390s 2024-09-12T00:59:22.894 INFO:tasks.workunit.client.0.smithi070.stderr: -426> 2024-09-12T00:59:22.725+0000 7fc3f2c8f640 10 monclient(hunting): get_auth_request con 0x557eb1f23900 auth_method 0 2024-09-12T00:59:22.894 INFO:tasks.workunit.client.0.smithi070.stderr: -425> 2024-09-12T00:59:22.725+0000 7fc3f2c8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:22.894 INFO:tasks.workunit.client.0.smithi070.stderr: -424> 2024-09-12T00:59:22.725+0000 7fc3f2c8f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:22.894 INFO:tasks.workunit.client.0.smithi070.stderr: -423> 2024-09-12T00:59:22.725+0000 7fc3f2c8f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:22.895 INFO:tasks.workunit.client.0.smithi070.stderr: -422> 2024-09-12T00:59:22.725+0000 7fc3f3490640 10 monclient(hunting): get_auth_request con 0x557eb1f29aa0 auth_method 0 2024-09-12T00:59:22.895 INFO:tasks.workunit.client.0.smithi070.stderr: -421> 2024-09-12T00:59:22.725+0000 7fc3f3490640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:22.895 INFO:tasks.workunit.client.0.smithi070.stderr: -420> 2024-09-12T00:59:22.725+0000 7fc3f3490640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:22.895 INFO:tasks.workunit.client.0.smithi070.stderr: -419> 2024-09-12T00:59:22.725+0000 7fc3f3490640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:22.895 INFO:tasks.workunit.client.0.smithi070.stderr: -418> 2024-09-12T00:59:22.725+0000 7fc3f2c8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:22.895 INFO:tasks.workunit.client.0.smithi070.stderr: -417> 2024-09-12T00:59:22.725+0000 7fc3f2c8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:22.895 INFO:tasks.workunit.client.0.smithi070.stderr: -416> 2024-09-12T00:59:22.725+0000 7fc3f2c8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:22.895 INFO:tasks.workunit.client.0.smithi070.stderr: -415> 2024-09-12T00:59:22.725+0000 7fc3f3490640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:22.895 INFO:tasks.workunit.client.0.smithi070.stderr: -414> 2024-09-12T00:59:22.725+0000 7fc3f3490640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:22.895 INFO:tasks.workunit.client.0.smithi070.stderr: -413> 2024-09-12T00:59:22.725+0000 7fc3f3490640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:22.895 INFO:tasks.workunit.client.0.smithi070.stderr: -412> 2024-09-12T00:59:22.725+0000 7fc3f248e640 10 monclient(hunting): get_auth_request con 0x557eb1f23ce0 auth_method 0 2024-09-12T00:59:22.895 INFO:tasks.workunit.client.0.smithi070.stderr: -411> 2024-09-12T00:59:22.725+0000 7fc3f248e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:22.895 INFO:tasks.workunit.client.0.smithi070.stderr: -410> 2024-09-12T00:59:22.725+0000 7fc3f248e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:22.896 INFO:tasks.workunit.client.0.smithi070.stderr: -409> 2024-09-12T00:59:22.725+0000 7fc3f248e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:22.896 INFO:tasks.workunit.client.0.smithi070.stderr: -408> 2024-09-12T00:59:22.725+0000 7fc3f2c8f640 10 monclient(hunting): handle_auth_done global_id 7781 payload 824 2024-09-12T00:59:22.896 INFO:tasks.workunit.client.0.smithi070.stderr: -407> 2024-09-12T00:59:22.725+0000 7fc3f2c8f640 10 monclient: _finish_hunting 0 2024-09-12T00:59:22.896 INFO:tasks.workunit.client.0.smithi070.stderr: -406> 2024-09-12T00:59:22.725+0000 7fc3f2c8f640 1 monclient: found mon.noname-c 2024-09-12T00:59:22.896 INFO:tasks.workunit.client.0.smithi070.stderr: -405> 2024-09-12T00:59:22.725+0000 7fc3f2c8f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:59:22.896 INFO:tasks.workunit.client.0.smithi070.stderr: -404> 2024-09-12T00:59:22.725+0000 7fc2df606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:22.896 INFO:tasks.workunit.client.0.smithi070.stderr: -403> 2024-09-12T00:59:22.725+0000 7fc2df606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:59:22.896 INFO:tasks.workunit.client.0.smithi070.stderr: -402> 2024-09-12T00:59:22.725+0000 7fc2df606640 10 monclient: dump: 2024-09-12T00:59:22.896 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:22.896 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:22.896 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.896 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.897 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:22.897 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.897 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:22.897 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:22.897 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:22.897 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.897 INFO:tasks.workunit.client.0.smithi070.stderr: -401> 2024-09-12T00:59:22.725+0000 7fc2df606640 10 monclient: _finish_auth 0 2024-09-12T00:59:22.897 INFO:tasks.workunit.client.0.smithi070.stderr: -400> 2024-09-12T00:59:22.725+0000 7fc2df606640 10 monclient: _check_auth_tickets 2024-09-12T00:59:22.897 INFO:tasks.workunit.client.0.smithi070.stderr: -399> 2024-09-12T00:59:22.725+0000 7fc2df606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:59:22.897 INFO:tasks.workunit.client.0.smithi070.stderr: -398> 2024-09-12T00:59:22.725+0000 7fc2df606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:22.897 INFO:tasks.workunit.client.0.smithi070.stderr: -397> 2024-09-12T00:59:22.725+0000 7fc2df606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:59:22.897 INFO:tasks.workunit.client.0.smithi070.stderr: -396> 2024-09-12T00:59:22.725+0000 7fc2df606640 10 monclient: dump: 2024-09-12T00:59:22.897 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:22.897 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:22.898 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.898 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.898 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:22.898 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.898 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:22.898 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:22.898 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:22.898 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.898 INFO:tasks.workunit.client.0.smithi070.stderr: -395> 2024-09-12T00:59:22.725+0000 7fc2e0e09640 4 set_mon_vals no callback set 2024-09-12T00:59:22.898 INFO:tasks.workunit.client.0.smithi070.stderr: -394> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 5 monclient: authenticate success, global_id 7781 2024-09-12T00:59:22.898 INFO:tasks.workunit.client.0.smithi070.stderr: -393> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient: _renew_subs 2024-09-12T00:59:22.898 INFO:tasks.workunit.client.0.smithi070.stderr: -392> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:59:22.898 INFO:tasks.workunit.client.0.smithi070.stderr: -391> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient: _renew_subs 2024-09-12T00:59:22.899 INFO:tasks.workunit.client.0.smithi070.stderr: -390> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:59:22.899 INFO:tasks.workunit.client.0.smithi070.stderr: -389> 2024-09-12T00:59:22.725+0000 7fc3f51899c0 1 librados: init done 2024-09-12T00:59:22.899 INFO:tasks.workunit.client.0.smithi070.stderr: -388> 2024-09-12T00:59:22.725+0000 7fc2df606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:59:22.899 INFO:tasks.workunit.client.0.smithi070.stderr: -387> 2024-09-12T00:59:22.725+0000 7fc2df606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:59:22.899 INFO:tasks.workunit.client.0.smithi070.stderr: -386> 2024-09-12T00:59:22.725+0000 7fc2df606640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:59:22.899 INFO:tasks.workunit.client.0.smithi070.stderr: -385> 2024-09-12T00:59:22.725+0000 7fc3f3490640 10 monclient: get_auth_request con 0x557eb2008570 auth_method 0 2024-09-12T00:59:22.899 INFO:tasks.workunit.client.0.smithi070.stderr: -384> 2024-09-12T00:59:22.725+0000 7fc3f248e640 10 monclient: get_auth_request con 0x7fc2d8070ae0 auth_method 0 2024-09-12T00:59:22.899 INFO:tasks.workunit.client.0.smithi070.stderr: -383> 2024-09-12T00:59:22.729+0000 7fc3f2c8f640 10 monclient: get_auth_request con 0x557eb2028440 auth_method 0 2024-09-12T00:59:22.899 INFO:tasks.workunit.client.0.smithi070.stderr: -382> 2024-09-12T00:59:22.729+0000 7fc3f248e640 10 monclient: get_auth_request con 0x557eb202c7a0 auth_method 0 2024-09-12T00:59:22.899 INFO:tasks.workunit.client.0.smithi070.stderr: -381> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient: build_initial_monmap 2024-09-12T00:59:22.899 INFO:tasks.workunit.client.0.smithi070.stderr: -380> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 1 build_initial for_mkfs: 0 2024-09-12T00:59:22.899 INFO:tasks.workunit.client.0.smithi070.stderr: -379> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient: monmap: 2024-09-12T00:59:22.899 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:59:22.899 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:59:22.899 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:59:22.900 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:59:22.900 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:59:22.900 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.900 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:59:22.900 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:59:22.900 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:59:22.900 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.900 INFO:tasks.workunit.client.0.smithi070.stderr: -378> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding auth protocol: cephx 2024-09-12T00:59:22.900 INFO:tasks.workunit.client.0.smithi070.stderr: -377> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding auth protocol: cephx 2024-09-12T00:59:22.900 INFO:tasks.workunit.client.0.smithi070.stderr: -376> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding auth protocol: cephx 2024-09-12T00:59:22.900 INFO:tasks.workunit.client.0.smithi070.stderr: -375> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding con mode: secure 2024-09-12T00:59:22.900 INFO:tasks.workunit.client.0.smithi070.stderr: -374> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding con mode: crc 2024-09-12T00:59:22.900 INFO:tasks.workunit.client.0.smithi070.stderr: -373> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding con mode: secure 2024-09-12T00:59:22.901 INFO:tasks.workunit.client.0.smithi070.stderr: -372> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding con mode: crc 2024-09-12T00:59:22.901 INFO:tasks.workunit.client.0.smithi070.stderr: -371> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding con mode: secure 2024-09-12T00:59:22.901 INFO:tasks.workunit.client.0.smithi070.stderr: -370> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding con mode: crc 2024-09-12T00:59:22.901 INFO:tasks.workunit.client.0.smithi070.stderr: -369> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding con mode: crc 2024-09-12T00:59:22.901 INFO:tasks.workunit.client.0.smithi070.stderr: -368> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding con mode: secure 2024-09-12T00:59:22.901 INFO:tasks.workunit.client.0.smithi070.stderr: -367> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding con mode: crc 2024-09-12T00:59:22.901 INFO:tasks.workunit.client.0.smithi070.stderr: -366> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding con mode: secure 2024-09-12T00:59:22.901 INFO:tasks.workunit.client.0.smithi070.stderr: -365> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding con mode: crc 2024-09-12T00:59:22.901 INFO:tasks.workunit.client.0.smithi070.stderr: -364> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20315d0) adding con mode: secure 2024-09-12T00:59:22.901 INFO:tasks.workunit.client.0.smithi070.stderr: -363> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:22.901 INFO:tasks.workunit.client.0.smithi070.stderr: -362> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command objecter_requests cmddesc objecter_requests hook 0x557eb2034fc0 EEXIST 2024-09-12T00:59:22.901 INFO:tasks.workunit.client.0.smithi070.stderr: -361> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient: init 2024-09-12T00:59:22.902 INFO:tasks.workunit.client.0.smithi070.stderr: -360> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding auth protocol: cephx 2024-09-12T00:59:22.902 INFO:tasks.workunit.client.0.smithi070.stderr: -359> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding auth protocol: cephx 2024-09-12T00:59:22.902 INFO:tasks.workunit.client.0.smithi070.stderr: -358> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding auth protocol: cephx 2024-09-12T00:59:22.902 INFO:tasks.workunit.client.0.smithi070.stderr: -357> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding con mode: secure 2024-09-12T00:59:22.902 INFO:tasks.workunit.client.0.smithi070.stderr: -356> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding con mode: crc 2024-09-12T00:59:22.902 INFO:tasks.workunit.client.0.smithi070.stderr: -355> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding con mode: secure 2024-09-12T00:59:22.902 INFO:tasks.workunit.client.0.smithi070.stderr: -354> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding con mode: crc 2024-09-12T00:59:22.902 INFO:tasks.workunit.client.0.smithi070.stderr: -353> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding con mode: secure 2024-09-12T00:59:22.902 INFO:tasks.workunit.client.0.smithi070.stderr: -352> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding con mode: crc 2024-09-12T00:59:22.902 INFO:tasks.workunit.client.0.smithi070.stderr: -351> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding con mode: crc 2024-09-12T00:59:22.902 INFO:tasks.workunit.client.0.smithi070.stderr: -350> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding con mode: secure 2024-09-12T00:59:22.902 INFO:tasks.workunit.client.0.smithi070.stderr: -349> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding con mode: crc 2024-09-12T00:59:22.902 INFO:tasks.workunit.client.0.smithi070.stderr: -348> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding con mode: secure 2024-09-12T00:59:22.903 INFO:tasks.workunit.client.0.smithi070.stderr: -347> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding con mode: crc 2024-09-12T00:59:22.903 INFO:tasks.workunit.client.0.smithi070.stderr: -346> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 AuthRegistry(0x557eb202fca8) adding con mode: secure 2024-09-12T00:59:22.903 INFO:tasks.workunit.client.0.smithi070.stderr: -345> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:22.903 INFO:tasks.workunit.client.0.smithi070.stderr: -344> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:22.903 INFO:tasks.workunit.client.0.smithi070.stderr: -343> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command rotate-key cmddesc rotate-key hook 0x557eb202fdf0 EEXIST 2024-09-12T00:59:22.903 INFO:tasks.workunit.client.0.smithi070.stderr: -342> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient: _reopen_session rank -1 2024-09-12T00:59:22.903 INFO:tasks.workunit.client.0.smithi070.stderr: -341> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:59:22.903 INFO:tasks.workunit.client.0.smithi070.stderr: -340> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient(hunting): picked mon.noname-c con 0x557eb2059170 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:59:22.903 INFO:tasks.workunit.client.0.smithi070.stderr: -339> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient(hunting): picked mon.noname-b con 0x557eb2058aa0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:59:22.903 INFO:tasks.workunit.client.0.smithi070.stderr: -338> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient(hunting): picked mon.noname-a con 0x557eb2057480 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:59:22.903 INFO:tasks.workunit.client.0.smithi070.stderr: -337> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:22.903 INFO:tasks.workunit.client.0.smithi070.stderr: -336> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:22.904 INFO:tasks.workunit.client.0.smithi070.stderr: -335> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:22.904 INFO:tasks.workunit.client.0.smithi070.stderr: -334> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient(hunting): _renew_subs 2024-09-12T00:59:22.904 INFO:tasks.workunit.client.0.smithi070.stderr: -333> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient(hunting): authenticate will time out at 2413.181628s 2024-09-12T00:59:22.904 INFO:tasks.workunit.client.0.smithi070.stderr: -332> 2024-09-12T00:59:22.733+0000 7fc3f3490640 10 monclient(hunting): get_auth_request con 0x557eb2057480 auth_method 0 2024-09-12T00:59:22.904 INFO:tasks.workunit.client.0.smithi070.stderr: -331> 2024-09-12T00:59:22.733+0000 7fc3f3490640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:22.904 INFO:tasks.workunit.client.0.smithi070.stderr: -330> 2024-09-12T00:59:22.733+0000 7fc3f3490640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:22.904 INFO:tasks.workunit.client.0.smithi070.stderr: -329> 2024-09-12T00:59:22.733+0000 7fc3f3490640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:22.904 INFO:tasks.workunit.client.0.smithi070.stderr: -328> 2024-09-12T00:59:22.733+0000 7fc3f2c8f640 10 monclient(hunting): get_auth_request con 0x557eb2059170 auth_method 0 2024-09-12T00:59:22.904 INFO:tasks.workunit.client.0.smithi070.stderr: -327> 2024-09-12T00:59:22.733+0000 7fc3f2c8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:22.904 INFO:tasks.workunit.client.0.smithi070.stderr: -326> 2024-09-12T00:59:22.733+0000 7fc3f2c8f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:22.904 INFO:tasks.workunit.client.0.smithi070.stderr: -325> 2024-09-12T00:59:22.733+0000 7fc3f2c8f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:22.904 INFO:tasks.workunit.client.0.smithi070.stderr: -324> 2024-09-12T00:59:22.733+0000 7fc3f3490640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:22.905 INFO:tasks.workunit.client.0.smithi070.stderr: -323> 2024-09-12T00:59:22.733+0000 7fc3f3490640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:22.905 INFO:tasks.workunit.client.0.smithi070.stderr: -322> 2024-09-12T00:59:22.733+0000 7fc3f3490640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:22.905 INFO:tasks.workunit.client.0.smithi070.stderr: -321> 2024-09-12T00:59:22.733+0000 7fc3f2c8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:22.905 INFO:tasks.workunit.client.0.smithi070.stderr: -320> 2024-09-12T00:59:22.733+0000 7fc3f2c8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:22.905 INFO:tasks.workunit.client.0.smithi070.stderr: -319> 2024-09-12T00:59:22.733+0000 7fc3f2c8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:22.905 INFO:tasks.workunit.client.0.smithi070.stderr: -318> 2024-09-12T00:59:22.733+0000 7fc3f2c8f640 10 monclient(hunting): handle_auth_done global_id 7784 payload 824 2024-09-12T00:59:22.905 INFO:tasks.workunit.client.0.smithi070.stderr: -317> 2024-09-12T00:59:22.733+0000 7fc3f2c8f640 10 monclient: _finish_hunting 0 2024-09-12T00:59:22.905 INFO:tasks.workunit.client.0.smithi070.stderr: -316> 2024-09-12T00:59:22.733+0000 7fc3f2c8f640 1 monclient: found mon.noname-c 2024-09-12T00:59:22.905 INFO:tasks.workunit.client.0.smithi070.stderr: -315> 2024-09-12T00:59:22.733+0000 7fc3f2c8f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:59:22.905 INFO:tasks.workunit.client.0.smithi070.stderr: -314> 2024-09-12T00:59:22.733+0000 7fc3f248e640 10 monclient: get_auth_request con 0x557eb2058aa0 auth_method 0 2024-09-12T00:59:22.905 INFO:tasks.workunit.client.0.smithi070.stderr: -313> 2024-09-12T00:59:22.733+0000 7fc2dce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:22.905 INFO:tasks.workunit.client.0.smithi070.stderr: -312> 2024-09-12T00:59:22.733+0000 7fc2dce01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:59:22.905 INFO:tasks.workunit.client.0.smithi070.stderr: -311> 2024-09-12T00:59:22.733+0000 7fc2dce01640 10 monclient: dump: 2024-09-12T00:59:22.906 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:22.906 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:22.906 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.906 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.906 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:22.906 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.906 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:22.906 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:22.906 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:22.906 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.906 INFO:tasks.workunit.client.0.smithi070.stderr: -310> 2024-09-12T00:59:22.733+0000 7fc2dce01640 10 monclient: _finish_auth 0 2024-09-12T00:59:22.906 INFO:tasks.workunit.client.0.smithi070.stderr: -309> 2024-09-12T00:59:22.733+0000 7fc2dce01640 10 monclient: _check_auth_tickets 2024-09-12T00:59:22.906 INFO:tasks.workunit.client.0.smithi070.stderr: -308> 2024-09-12T00:59:22.733+0000 7fc2dce01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:59:22.907 INFO:tasks.workunit.client.0.smithi070.stderr: -307> 2024-09-12T00:59:22.733+0000 7fc2dce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:22.907 INFO:tasks.workunit.client.0.smithi070.stderr: -306> 2024-09-12T00:59:22.733+0000 7fc2dce01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:59:22.907 INFO:tasks.workunit.client.0.smithi070.stderr: -305> 2024-09-12T00:59:22.733+0000 7fc2dce01640 10 monclient: dump: 2024-09-12T00:59:22.907 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:22.907 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:22.907 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.907 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.907 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:22.907 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.907 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:22.907 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:22.907 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:22.907 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.908 INFO:tasks.workunit.client.0.smithi070.stderr: -304> 2024-09-12T00:59:22.733+0000 7fc3f1c8d640 4 set_mon_vals no callback set 2024-09-12T00:59:22.908 INFO:tasks.workunit.client.0.smithi070.stderr: -303> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 5 monclient: authenticate success, global_id 7784 2024-09-12T00:59:22.908 INFO:tasks.workunit.client.0.smithi070.stderr: -302> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient: _renew_subs 2024-09-12T00:59:22.908 INFO:tasks.workunit.client.0.smithi070.stderr: -301> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:59:22.908 INFO:tasks.workunit.client.0.smithi070.stderr: -300> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient: _renew_subs 2024-09-12T00:59:22.908 INFO:tasks.workunit.client.0.smithi070.stderr: -299> 2024-09-12T00:59:22.733+0000 7fc3f51899c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:59:22.908 INFO:tasks.workunit.client.0.smithi070.stderr: -298> 2024-09-12T00:59:22.737+0000 7fc2dce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:59:22.908 INFO:tasks.workunit.client.0.smithi070.stderr: -297> 2024-09-12T00:59:22.737+0000 7fc2dce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:59:22.908 INFO:tasks.workunit.client.0.smithi070.stderr: -296> 2024-09-12T00:59:22.737+0000 7fc2dce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:59:22.908 INFO:tasks.workunit.client.0.smithi070.stderr: -295> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient: get_monmap_and_config 2024-09-12T00:59:22.908 INFO:tasks.workunit.client.0.smithi070.stderr: -294> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient: build_initial_monmap 2024-09-12T00:59:22.908 INFO:tasks.workunit.client.0.smithi070.stderr: -293> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 1 build_initial for_mkfs: 0 2024-09-12T00:59:22.909 INFO:tasks.workunit.client.0.smithi070.stderr: -292> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient: monmap: 2024-09-12T00:59:22.909 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:59:22.909 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:59:22.909 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:59:22.909 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:59:22.909 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:59:22.909 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.909 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:59:22.909 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:59:22.909 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:59:22.909 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.909 INFO:tasks.workunit.client.0.smithi070.stderr: -291> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding auth protocol: cephx 2024-09-12T00:59:22.909 INFO:tasks.workunit.client.0.smithi070.stderr: -290> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding auth protocol: cephx 2024-09-12T00:59:22.910 INFO:tasks.workunit.client.0.smithi070.stderr: -289> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding auth protocol: cephx 2024-09-12T00:59:22.910 INFO:tasks.workunit.client.0.smithi070.stderr: -288> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding con mode: secure 2024-09-12T00:59:22.910 INFO:tasks.workunit.client.0.smithi070.stderr: -287> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding con mode: crc 2024-09-12T00:59:22.910 INFO:tasks.workunit.client.0.smithi070.stderr: -286> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding con mode: secure 2024-09-12T00:59:22.910 INFO:tasks.workunit.client.0.smithi070.stderr: -285> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding con mode: crc 2024-09-12T00:59:22.910 INFO:tasks.workunit.client.0.smithi070.stderr: -284> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding con mode: secure 2024-09-12T00:59:22.910 INFO:tasks.workunit.client.0.smithi070.stderr: -283> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding con mode: crc 2024-09-12T00:59:22.910 INFO:tasks.workunit.client.0.smithi070.stderr: -282> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding con mode: crc 2024-09-12T00:59:22.910 INFO:tasks.workunit.client.0.smithi070.stderr: -281> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding con mode: secure 2024-09-12T00:59:22.910 INFO:tasks.workunit.client.0.smithi070.stderr: -280> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding con mode: crc 2024-09-12T00:59:22.910 INFO:tasks.workunit.client.0.smithi070.stderr: -279> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding con mode: secure 2024-09-12T00:59:22.910 INFO:tasks.workunit.client.0.smithi070.stderr: -278> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding con mode: crc 2024-09-12T00:59:22.910 INFO:tasks.workunit.client.0.smithi070.stderr: -277> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb20786f0) adding con mode: secure 2024-09-12T00:59:22.911 INFO:tasks.workunit.client.0.smithi070.stderr: -276> 2024-09-12T00:59:22.737+0000 7fc3f248e640 10 monclient: get_auth_request con 0x7fc2cc070a20 auth_method 0 2024-09-12T00:59:22.911 INFO:tasks.workunit.client.0.smithi070.stderr: -275> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:22.911 INFO:tasks.workunit.client.0.smithi070.stderr: -274> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient: init 2024-09-12T00:59:22.911 INFO:tasks.workunit.client.0.smithi070.stderr: -273> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding auth protocol: cephx 2024-09-12T00:59:22.911 INFO:tasks.workunit.client.0.smithi070.stderr: -272> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding auth protocol: cephx 2024-09-12T00:59:22.911 INFO:tasks.workunit.client.0.smithi070.stderr: -271> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding auth protocol: cephx 2024-09-12T00:59:22.911 INFO:tasks.workunit.client.0.smithi070.stderr: -270> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding con mode: secure 2024-09-12T00:59:22.911 INFO:tasks.workunit.client.0.smithi070.stderr: -269> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding con mode: crc 2024-09-12T00:59:22.911 INFO:tasks.workunit.client.0.smithi070.stderr: -268> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding con mode: secure 2024-09-12T00:59:22.911 INFO:tasks.workunit.client.0.smithi070.stderr: -267> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding con mode: crc 2024-09-12T00:59:22.911 INFO:tasks.workunit.client.0.smithi070.stderr: -266> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding con mode: secure 2024-09-12T00:59:22.911 INFO:tasks.workunit.client.0.smithi070.stderr: -265> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding con mode: crc 2024-09-12T00:59:22.912 INFO:tasks.workunit.client.0.smithi070.stderr: -264> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding con mode: crc 2024-09-12T00:59:22.912 INFO:tasks.workunit.client.0.smithi070.stderr: -263> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding con mode: secure 2024-09-12T00:59:22.912 INFO:tasks.workunit.client.0.smithi070.stderr: -262> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding con mode: crc 2024-09-12T00:59:22.912 INFO:tasks.workunit.client.0.smithi070.stderr: -261> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding con mode: secure 2024-09-12T00:59:22.912 INFO:tasks.workunit.client.0.smithi070.stderr: -260> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding con mode: crc 2024-09-12T00:59:22.912 INFO:tasks.workunit.client.0.smithi070.stderr: -259> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c4ea0) adding con mode: secure 2024-09-12T00:59:22.912 INFO:tasks.workunit.client.0.smithi070.stderr: -258> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:22.912 INFO:tasks.workunit.client.0.smithi070.stderr: -257> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:22.912 INFO:tasks.workunit.client.0.smithi070.stderr: -256> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd9f7c4fe8 EEXIST 2024-09-12T00:59:22.912 INFO:tasks.workunit.client.0.smithi070.stderr: -255> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient: _reopen_session rank -1 2024-09-12T00:59:22.912 INFO:tasks.workunit.client.0.smithi070.stderr: -254> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:59:22.912 INFO:tasks.workunit.client.0.smithi070.stderr: -253> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient(hunting): picked mon.noname-c con 0x557eb20ac970 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:59:22.913 INFO:tasks.workunit.client.0.smithi070.stderr: -252> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient(hunting): picked mon.noname-a con 0x557eb20acd50 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:59:22.913 INFO:tasks.workunit.client.0.smithi070.stderr: -251> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient(hunting): picked mon.noname-b con 0x557eb20b20e0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:59:22.913 INFO:tasks.workunit.client.0.smithi070.stderr: -250> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:22.913 INFO:tasks.workunit.client.0.smithi070.stderr: -249> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:22.913 INFO:tasks.workunit.client.0.smithi070.stderr: -248> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:22.913 INFO:tasks.workunit.client.0.smithi070.stderr: -247> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient(hunting): _renew_subs 2024-09-12T00:59:22.913 INFO:tasks.workunit.client.0.smithi070.stderr: -246> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient(hunting): authenticate will time out at 2413.185983s 2024-09-12T00:59:22.913 INFO:tasks.workunit.client.0.smithi070.stderr: -245> 2024-09-12T00:59:22.737+0000 7fc3f248e640 10 monclient(hunting): get_auth_request con 0x557eb20acd50 auth_method 0 2024-09-12T00:59:22.913 INFO:tasks.workunit.client.0.smithi070.stderr: -244> 2024-09-12T00:59:22.737+0000 7fc3f248e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:22.913 INFO:tasks.workunit.client.0.smithi070.stderr: -243> 2024-09-12T00:59:22.737+0000 7fc3f248e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:22.914 INFO:tasks.workunit.client.0.smithi070.stderr: -242> 2024-09-12T00:59:22.737+0000 7fc3f248e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:22.914 INFO:tasks.workunit.client.0.smithi070.stderr: -241> 2024-09-12T00:59:22.737+0000 7fc3f2c8f640 10 monclient(hunting): get_auth_request con 0x557eb20ac970 auth_method 0 2024-09-12T00:59:22.914 INFO:tasks.workunit.client.0.smithi070.stderr: -240> 2024-09-12T00:59:22.737+0000 7fc3f2c8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:22.914 INFO:tasks.workunit.client.0.smithi070.stderr: -239> 2024-09-12T00:59:22.737+0000 7fc3f2c8f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:22.914 INFO:tasks.workunit.client.0.smithi070.stderr: -238> 2024-09-12T00:59:22.737+0000 7fc3f2c8f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:22.914 INFO:tasks.workunit.client.0.smithi070.stderr: -237> 2024-09-12T00:59:22.737+0000 7fc3f248e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:22.914 INFO:tasks.workunit.client.0.smithi070.stderr: -236> 2024-09-12T00:59:22.737+0000 7fc3f248e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:22.914 INFO:tasks.workunit.client.0.smithi070.stderr: -235> 2024-09-12T00:59:22.737+0000 7fc3f248e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:22.914 INFO:tasks.workunit.client.0.smithi070.stderr: -234> 2024-09-12T00:59:22.737+0000 7fc3f2c8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:22.914 INFO:tasks.workunit.client.0.smithi070.stderr: -233> 2024-09-12T00:59:22.737+0000 7fc3f2c8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:22.914 INFO:tasks.workunit.client.0.smithi070.stderr: -232> 2024-09-12T00:59:22.737+0000 7fc3f2c8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:22.914 INFO:tasks.workunit.client.0.smithi070.stderr: -231> 2024-09-12T00:59:22.737+0000 7fc3f248e640 10 monclient(hunting): handle_auth_done global_id 8313 payload 274 2024-09-12T00:59:22.915 INFO:tasks.workunit.client.0.smithi070.stderr: -230> 2024-09-12T00:59:22.737+0000 7fc3f248e640 10 monclient: _finish_hunting 0 2024-09-12T00:59:22.915 INFO:tasks.workunit.client.0.smithi070.stderr: -229> 2024-09-12T00:59:22.737+0000 7fc3f248e640 1 monclient: found mon.noname-a 2024-09-12T00:59:22.915 INFO:tasks.workunit.client.0.smithi070.stderr: -228> 2024-09-12T00:59:22.737+0000 7fc3f248e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:59:22.915 INFO:tasks.workunit.client.0.smithi070.stderr: -227> 2024-09-12T00:59:22.737+0000 7fc2d67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:22.915 INFO:tasks.workunit.client.0.smithi070.stderr: -226> 2024-09-12T00:59:22.737+0000 7fc2d67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:59:22.915 INFO:tasks.workunit.client.0.smithi070.stderr: -225> 2024-09-12T00:59:22.737+0000 7fc2d67fc640 10 monclient: dump: 2024-09-12T00:59:22.915 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:22.915 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:22.915 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.915 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.915 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:22.915 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.915 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:22.916 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:22.916 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:22.916 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.916 INFO:tasks.workunit.client.0.smithi070.stderr: -224> 2024-09-12T00:59:22.737+0000 7fc2d67fc640 10 monclient: _finish_auth 0 2024-09-12T00:59:22.916 INFO:tasks.workunit.client.0.smithi070.stderr: -223> 2024-09-12T00:59:22.737+0000 7fc2d67fc640 10 monclient: _check_auth_tickets 2024-09-12T00:59:22.916 INFO:tasks.workunit.client.0.smithi070.stderr: -222> 2024-09-12T00:59:22.737+0000 7fc2d67fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:59:22.916 INFO:tasks.workunit.client.0.smithi070.stderr: -221> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 monclient: authenticate success, global_id 8313 2024-09-12T00:59:22.916 INFO:tasks.workunit.client.0.smithi070.stderr: -220> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient: get_monmap_and_config success 2024-09-12T00:59:22.916 INFO:tasks.workunit.client.0.smithi070.stderr: -219> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 4 set_mon_vals no callback set 2024-09-12T00:59:22.916 INFO:tasks.workunit.client.0.smithi070.stderr: -218> 2024-09-12T00:59:22.737+0000 7fc2d67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:22.916 INFO:tasks.workunit.client.0.smithi070.stderr: -217> 2024-09-12T00:59:22.737+0000 7fc2d67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:59:22.916 INFO:tasks.workunit.client.0.smithi070.stderr: -216> 2024-09-12T00:59:22.737+0000 7fc2d67fc640 10 monclient: dump: 2024-09-12T00:59:22.916 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:22.917 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:22.917 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.917 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.917 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:22.917 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.917 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:22.917 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:22.917 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:22.917 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.917 INFO:tasks.workunit.client.0.smithi070.stderr: -215> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient: shutdown 2024-09-12T00:59:22.917 INFO:tasks.workunit.client.0.smithi070.stderr: -214> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient: build_initial_monmap 2024-09-12T00:59:22.917 INFO:tasks.workunit.client.0.smithi070.stderr: -213> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 1 build_initial for_mkfs: 0 2024-09-12T00:59:22.917 INFO:tasks.workunit.client.0.smithi070.stderr: -212> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient: monmap: 2024-09-12T00:59:22.917 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:59:22.918 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:59:22.918 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:59:22.918 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:59:22.918 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:59:22.918 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.918 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:59:22.918 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:59:22.918 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:59:22.918 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.918 INFO:tasks.workunit.client.0.smithi070.stderr: -211> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding auth protocol: cephx 2024-09-12T00:59:22.918 INFO:tasks.workunit.client.0.smithi070.stderr: -210> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding auth protocol: cephx 2024-09-12T00:59:22.918 INFO:tasks.workunit.client.0.smithi070.stderr: -209> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding auth protocol: cephx 2024-09-12T00:59:22.918 INFO:tasks.workunit.client.0.smithi070.stderr: -208> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding con mode: secure 2024-09-12T00:59:22.918 INFO:tasks.workunit.client.0.smithi070.stderr: -207> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding con mode: crc 2024-09-12T00:59:22.919 INFO:tasks.workunit.client.0.smithi070.stderr: -206> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding con mode: secure 2024-09-12T00:59:22.919 INFO:tasks.workunit.client.0.smithi070.stderr: -205> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding con mode: crc 2024-09-12T00:59:22.919 INFO:tasks.workunit.client.0.smithi070.stderr: -204> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding con mode: secure 2024-09-12T00:59:22.919 INFO:tasks.workunit.client.0.smithi070.stderr: -203> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding con mode: crc 2024-09-12T00:59:22.919 INFO:tasks.workunit.client.0.smithi070.stderr: -202> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding con mode: crc 2024-09-12T00:59:22.919 INFO:tasks.workunit.client.0.smithi070.stderr: -201> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding con mode: secure 2024-09-12T00:59:22.919 INFO:tasks.workunit.client.0.smithi070.stderr: -200> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding con mode: crc 2024-09-12T00:59:22.919 INFO:tasks.workunit.client.0.smithi070.stderr: -199> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding con mode: secure 2024-09-12T00:59:22.919 INFO:tasks.workunit.client.0.smithi070.stderr: -198> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding con mode: crc 2024-09-12T00:59:22.919 INFO:tasks.workunit.client.0.smithi070.stderr: -197> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb209e860) adding con mode: secure 2024-09-12T00:59:22.919 INFO:tasks.workunit.client.0.smithi070.stderr: -196> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:22.919 INFO:tasks.workunit.client.0.smithi070.stderr: -195> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 1 librados: starting msgr at 2024-09-12T00:59:22.919 INFO:tasks.workunit.client.0.smithi070.stderr: -194> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 1 librados: starting objecter 2024-09-12T00:59:22.919 INFO:tasks.workunit.client.0.smithi070.stderr: -193> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command objecter_requests cmddesc objecter_requests hook 0x557eb207ce20 EEXIST 2024-09-12T00:59:22.920 INFO:tasks.workunit.client.0.smithi070.stderr: -192> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 1 librados: setting wanted keys 2024-09-12T00:59:22.920 INFO:tasks.workunit.client.0.smithi070.stderr: -191> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 1 librados: calling monclient init 2024-09-12T00:59:22.920 INFO:tasks.workunit.client.0.smithi070.stderr: -190> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 10 monclient: init 2024-09-12T00:59:22.920 INFO:tasks.workunit.client.0.smithi070.stderr: -189> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding auth protocol: cephx 2024-09-12T00:59:22.920 INFO:tasks.workunit.client.0.smithi070.stderr: -188> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding auth protocol: cephx 2024-09-12T00:59:22.920 INFO:tasks.workunit.client.0.smithi070.stderr: -187> 2024-09-12T00:59:22.737+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding auth protocol: cephx 2024-09-12T00:59:22.920 INFO:tasks.workunit.client.0.smithi070.stderr: -186> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding con mode: secure 2024-09-12T00:59:22.920 INFO:tasks.workunit.client.0.smithi070.stderr: -185> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding con mode: crc 2024-09-12T00:59:22.920 INFO:tasks.workunit.client.0.smithi070.stderr: -184> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding con mode: secure 2024-09-12T00:59:22.920 INFO:tasks.workunit.client.0.smithi070.stderr: -183> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding con mode: crc 2024-09-12T00:59:22.920 INFO:tasks.workunit.client.0.smithi070.stderr: -182> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding con mode: secure 2024-09-12T00:59:22.920 INFO:tasks.workunit.client.0.smithi070.stderr: -181> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding con mode: crc 2024-09-12T00:59:22.920 INFO:tasks.workunit.client.0.smithi070.stderr: -180> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding con mode: crc 2024-09-12T00:59:22.921 INFO:tasks.workunit.client.0.smithi070.stderr: -179> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding con mode: secure 2024-09-12T00:59:22.921 INFO:tasks.workunit.client.0.smithi070.stderr: -178> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding con mode: crc 2024-09-12T00:59:22.921 INFO:tasks.workunit.client.0.smithi070.stderr: -177> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding con mode: secure 2024-09-12T00:59:22.921 INFO:tasks.workunit.client.0.smithi070.stderr: -176> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding con mode: crc 2024-09-12T00:59:22.921 INFO:tasks.workunit.client.0.smithi070.stderr: -175> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 AuthRegistry(0x557eb205af90) adding con mode: secure 2024-09-12T00:59:22.921 INFO:tasks.workunit.client.0.smithi070.stderr: -174> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:22.921 INFO:tasks.workunit.client.0.smithi070.stderr: -173> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:22.921 INFO:tasks.workunit.client.0.smithi070.stderr: -172> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command rotate-key cmddesc rotate-key hook 0x557eb205b0d8 EEXIST 2024-09-12T00:59:22.921 INFO:tasks.workunit.client.0.smithi070.stderr: -171> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient: _reopen_session rank -1 2024-09-12T00:59:22.921 INFO:tasks.workunit.client.0.smithi070.stderr: -170> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:59:22.921 INFO:tasks.workunit.client.0.smithi070.stderr: -169> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient(hunting): picked mon.noname-b con 0x557eb20ac970 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:59:22.921 INFO:tasks.workunit.client.0.smithi070.stderr: -168> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient(hunting): picked mon.noname-c con 0x557eb20b20e0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:59:22.921 INFO:tasks.workunit.client.0.smithi070.stderr: -167> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient(hunting): picked mon.noname-a con 0x557eb20b6a90 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:59:22.921 INFO:tasks.workunit.client.0.smithi070.stderr: -166> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:22.922 INFO:tasks.workunit.client.0.smithi070.stderr: -165> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:22.922 INFO:tasks.workunit.client.0.smithi070.stderr: -164> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:22.922 INFO:tasks.workunit.client.0.smithi070.stderr: -163> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient(hunting): _renew_subs 2024-09-12T00:59:22.922 INFO:tasks.workunit.client.0.smithi070.stderr: -162> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient(hunting): authenticate will time out at 2413.188572s 2024-09-12T00:59:22.922 INFO:tasks.workunit.client.0.smithi070.stderr: -161> 2024-09-12T00:59:22.741+0000 7fc3f248e640 10 monclient(hunting): get_auth_request con 0x557eb20b20e0 auth_method 0 2024-09-12T00:59:22.922 INFO:tasks.workunit.client.0.smithi070.stderr: -160> 2024-09-12T00:59:22.741+0000 7fc3f248e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:22.922 INFO:tasks.workunit.client.0.smithi070.stderr: -159> 2024-09-12T00:59:22.741+0000 7fc3f248e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:22.922 INFO:tasks.workunit.client.0.smithi070.stderr: -158> 2024-09-12T00:59:22.741+0000 7fc3f248e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:22.922 INFO:tasks.workunit.client.0.smithi070.stderr: -157> 2024-09-12T00:59:22.741+0000 7fc3f3490640 10 monclient(hunting): get_auth_request con 0x557eb20b6a90 auth_method 0 2024-09-12T00:59:22.922 INFO:tasks.workunit.client.0.smithi070.stderr: -156> 2024-09-12T00:59:22.741+0000 7fc3f3490640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:22.922 INFO:tasks.workunit.client.0.smithi070.stderr: -155> 2024-09-12T00:59:22.741+0000 7fc3f3490640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:22.922 INFO:tasks.workunit.client.0.smithi070.stderr: -154> 2024-09-12T00:59:22.741+0000 7fc3f3490640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:22.922 INFO:tasks.workunit.client.0.smithi070.stderr: -153> 2024-09-12T00:59:22.741+0000 7fc3f248e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:22.923 INFO:tasks.workunit.client.0.smithi070.stderr: -152> 2024-09-12T00:59:22.741+0000 7fc3f248e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:22.923 INFO:tasks.workunit.client.0.smithi070.stderr: -151> 2024-09-12T00:59:22.741+0000 7fc3f248e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:22.923 INFO:tasks.workunit.client.0.smithi070.stderr: -150> 2024-09-12T00:59:22.741+0000 7fc3f3490640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:22.923 INFO:tasks.workunit.client.0.smithi070.stderr: -149> 2024-09-12T00:59:22.741+0000 7fc3f3490640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:22.923 INFO:tasks.workunit.client.0.smithi070.stderr: -148> 2024-09-12T00:59:22.741+0000 7fc3f3490640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:22.923 INFO:tasks.workunit.client.0.smithi070.stderr: -147> 2024-09-12T00:59:22.741+0000 7fc3f248e640 10 monclient(hunting): handle_auth_done global_id 7790 payload 824 2024-09-12T00:59:22.923 INFO:tasks.workunit.client.0.smithi070.stderr: -146> 2024-09-12T00:59:22.741+0000 7fc3f248e640 10 monclient: _finish_hunting 0 2024-09-12T00:59:22.923 INFO:tasks.workunit.client.0.smithi070.stderr: -145> 2024-09-12T00:59:22.741+0000 7fc3f248e640 1 monclient: found mon.noname-c 2024-09-12T00:59:22.923 INFO:tasks.workunit.client.0.smithi070.stderr: -144> 2024-09-12T00:59:22.741+0000 7fc3f248e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:59:22.923 INFO:tasks.workunit.client.0.smithi070.stderr: -143> 2024-09-12T00:59:22.741+0000 7fc2d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:22.923 INFO:tasks.workunit.client.0.smithi070.stderr: -142> 2024-09-12T00:59:22.741+0000 7fc2d4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:59:22.923 INFO:tasks.workunit.client.0.smithi070.stderr: -141> 2024-09-12T00:59:22.741+0000 7fc2d4ff9640 10 monclient: dump: 2024-09-12T00:59:22.923 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:22.923 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:22.923 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.924 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.924 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:22.924 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.924 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:22.924 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:22.924 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:22.924 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.924 INFO:tasks.workunit.client.0.smithi070.stderr: -140> 2024-09-12T00:59:22.741+0000 7fc2d4ff9640 10 monclient: _finish_auth 0 2024-09-12T00:59:22.924 INFO:tasks.workunit.client.0.smithi070.stderr: -139> 2024-09-12T00:59:22.741+0000 7fc2d4ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:59:22.924 INFO:tasks.workunit.client.0.smithi070.stderr: -138> 2024-09-12T00:59:22.741+0000 7fc2d4ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:59:22.924 INFO:tasks.workunit.client.0.smithi070.stderr: -137> 2024-09-12T00:59:22.741+0000 7fc2d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:22.924 INFO:tasks.workunit.client.0.smithi070.stderr: -136> 2024-09-12T00:59:22.741+0000 7fc2d4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:59:22.924 INFO:tasks.workunit.client.0.smithi070.stderr: -135> 2024-09-12T00:59:22.741+0000 7fc2d4ff9640 10 monclient: dump: 2024-09-12T00:59:22.924 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:22.925 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:22.925 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.925 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:22.925 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:22.925 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:22.925 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:22.925 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:22.925 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:22.925 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.925 INFO:tasks.workunit.client.0.smithi070.stderr: -134> 2024-09-12T00:59:22.741+0000 7fc2d67fc640 4 set_mon_vals no callback set 2024-09-12T00:59:22.925 INFO:tasks.workunit.client.0.smithi070.stderr: -133> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 monclient: authenticate success, global_id 7790 2024-09-12T00:59:22.925 INFO:tasks.workunit.client.0.smithi070.stderr: -132> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient: _renew_subs 2024-09-12T00:59:22.925 INFO:tasks.workunit.client.0.smithi070.stderr: -131> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:59:22.926 INFO:tasks.workunit.client.0.smithi070.stderr: -130> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient: _renew_subs 2024-09-12T00:59:22.926 INFO:tasks.workunit.client.0.smithi070.stderr: -129> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:59:22.926 INFO:tasks.workunit.client.0.smithi070.stderr: -128> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 1 librados: init done 2024-09-12T00:59:22.926 INFO:tasks.workunit.client.0.smithi070.stderr: -127> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command cr dump hook 0x557eb20a04a8 2024-09-12T00:59:22.926 INFO:tasks.workunit.client.0.smithi070.stderr: -126> 2024-09-12T00:59:22.741+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.926 INFO:tasks.workunit.client.0.smithi070.stderr: -125> 2024-09-12T00:59:22.741+0000 7fc2d4ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:59:22.926 INFO:tasks.workunit.client.0.smithi070.stderr: -124> 2024-09-12T00:59:22.741+0000 7fc2d4ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:59:22.926 INFO:tasks.workunit.client.0.smithi070.stderr: -123> 2024-09-12T00:59:22.741+0000 7fc2d4ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:59:22.926 INFO:tasks.workunit.client.0.smithi070.stderr: -122> 2024-09-12T00:59:22.741+0000 7fc3f2c8f640 10 monclient: get_auth_request con 0x7fc2bc070b10 auth_method 0 2024-09-12T00:59:22.926 INFO:tasks.workunit.client.0.smithi070.stderr: -121> 2024-09-12T00:59:22.741+0000 7fc3f3490640 10 monclient: get_auth_request con 0x557eb20c6950 auth_method 0 2024-09-12T00:59:22.926 INFO:tasks.workunit.client.0.smithi070.stderr: -120> 2024-09-12T00:59:22.745+0000 7fc3f51899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.926 INFO:tasks.workunit.client.0.smithi070.stderr: -119> 2024-09-12T00:59:22.745+0000 7fc3f51899c0 20 realm 2024-09-12T00:59:22.926 INFO:tasks.workunit.client.0.smithi070.stderr: -118> 2024-09-12T00:59:22.745+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.927 INFO:tasks.workunit.client.0.smithi070.stderr: -117> 2024-09-12T00:59:22.745+0000 7fc3f51899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.927 INFO:tasks.workunit.client.0.smithi070.stderr: -116> 2024-09-12T00:59:22.745+0000 7fc3f51899c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:59:22.927 INFO:tasks.workunit.client.0.smithi070.stderr: -115> 2024-09-12T00:59:22.745+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.927 INFO:tasks.workunit.client.0.smithi070.stderr: -114> 2024-09-12T00:59:22.745+0000 7fc3f51899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.927 INFO:tasks.workunit.client.0.smithi070.stderr: -113> 2024-09-12T00:59:22.745+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.927 INFO:tasks.workunit.client.0.smithi070.stderr: -112> 2024-09-12T00:59:22.745+0000 7fc3f2c8f640 10 monclient: get_auth_request con 0x557eb20cacd0 auth_method 0 2024-09-12T00:59:22.927 INFO:tasks.workunit.client.0.smithi070.stderr: -111> 2024-09-12T00:59:22.749+0000 7fc3f51899c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:59:22.927 INFO:tasks.workunit.client.0.smithi070.stderr: -110> 2024-09-12T00:59:22.749+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.927 INFO:tasks.workunit.client.0.smithi070.stderr: -109> 2024-09-12T00:59:22.749+0000 7fc3f248e640 10 monclient: get_auth_request con 0x557eb20ce430 auth_method 0 2024-09-12T00:59:22.927 INFO:tasks.workunit.client.0.smithi070.stderr: -108> 2024-09-12T00:59:22.749+0000 7fc3f51899c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:59:22.927 INFO:tasks.workunit.client.0.smithi070.stderr: -107> 2024-09-12T00:59:22.749+0000 7fc3f51899c0 20 searching for the correct realm 2024-09-12T00:59:22.927 INFO:tasks.workunit.client.0.smithi070.stderr: -106> 2024-09-12T00:59:22.749+0000 7fc3f3490640 10 monclient: get_auth_request con 0x557eb20d3180 auth_method 0 2024-09-12T00:59:22.928 INFO:tasks.workunit.client.0.smithi070.stderr: -105> 2024-09-12T00:59:22.749+0000 7fc3f2c8f640 10 monclient: get_auth_request con 0x7fc3ec00e040 auth_method 0 2024-09-12T00:59:22.928 INFO:tasks.workunit.client.0.smithi070.stderr: -104> 2024-09-12T00:59:22.753+0000 7fc3f248e640 10 monclient: get_auth_request con 0x7fc3e412dbd0 auth_method 0 2024-09-12T00:59:22.928 INFO:tasks.workunit.client.0.smithi070.stderr: -103> 2024-09-12T00:59:22.753+0000 7fc3f3490640 10 monclient: get_auth_request con 0x7fc3e801a040 auth_method 0 2024-09-12T00:59:22.928 INFO:tasks.workunit.client.0.smithi070.stderr: -102> 2024-09-12T00:59:22.753+0000 7fc3f2c8f640 0 -- 172.21.15.70:0/1138414970 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7fc3ec00e040 msgr2=0x7fc3ec01c8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:59:22.928 INFO:tasks.workunit.client.0.smithi070.stderr: -101> 2024-09-12T00:59:22.753+0000 7fc2d4ff9640 1 client.7790.objecter ms_handle_reset 0x7fc3ec00e040 session 0x7fc3ec015040 osd.7 2024-09-12T00:59:22.928 INFO:tasks.workunit.client.0.smithi070.stderr: -100> 2024-09-12T00:59:22.753+0000 7fc2d4ff9640 10 monclient: _renew_subs 2024-09-12T00:59:22.928 INFO:tasks.workunit.client.0.smithi070.stderr: -99> 2024-09-12T00:59:22.753+0000 7fc2d4ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:59:22.928 INFO:tasks.workunit.client.0.smithi070.stderr: -98> 2024-09-12T00:59:22.757+0000 7fc3f2c8f640 10 monclient: get_auth_request con 0x7fc2bc0808b0 auth_method 0 2024-09-12T00:59:22.928 INFO:tasks.workunit.client.0.smithi070.stderr: -97> 2024-09-12T00:59:22.757+0000 7fc3f2c8f640 10 monclient: get_auth_request con 0x7fc3ec029900 auth_method 0 2024-09-12T00:59:22.928 INFO:tasks.workunit.client.0.smithi070.stderr: -96> 2024-09-12T00:59:22.761+0000 7fc3f2c8f640 0 -- 172.21.15.70:0/1138414970 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7fc3ec029900 msgr2=0x7fc3ec028380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:59:22.928 INFO:tasks.workunit.client.0.smithi070.stderr: -95> 2024-09-12T00:59:22.761+0000 7fc2d4ff9640 1 client.7790.objecter ms_handle_reset 0x7fc3ec029900 session 0x7fc3ec01d770 osd.6 2024-09-12T00:59:22.928 INFO:tasks.workunit.client.0.smithi070.stderr: -94> 2024-09-12T00:59:22.761+0000 7fc3f2c8f640 10 monclient: get_auth_request con 0x7fc3ec00e040 auth_method 0 2024-09-12T00:59:22.928 INFO:tasks.workunit.client.0.smithi070.stderr: -93> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:59:22.928 INFO:tasks.workunit.client.0.smithi070.stderr: -92> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:59:22.929 INFO:tasks.workunit.client.0.smithi070.stderr: -91> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:59:22.929 INFO:tasks.workunit.client.0.smithi070.stderr: -90> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:59:22.929 INFO:tasks.workunit.client.0.smithi070.stderr: -89> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:59:22.929 INFO:tasks.workunit.client.0.smithi070.stderr: -88> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:59:22.929 INFO:tasks.workunit.client.0.smithi070.stderr: -87> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.929 INFO:tasks.workunit.client.0.smithi070.stderr: -86> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.929 INFO:tasks.workunit.client.0.smithi070.stderr: -85> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.929 INFO:tasks.workunit.client.0.smithi070.stderr: -84> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:59:22.929 INFO:tasks.workunit.client.0.smithi070.stderr: -83> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.929 INFO:tasks.workunit.client.0.smithi070.stderr: -82> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:59:22.929 INFO:tasks.workunit.client.0.smithi070.stderr: -81> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 zone default found 2024-09-12T00:59:22.929 INFO:tasks.workunit.client.0.smithi070.stderr: -80> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 4 Realm: () 2024-09-12T00:59:22.929 INFO:tasks.workunit.client.0.smithi070.stderr: -79> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:59:22.930 INFO:tasks.workunit.client.0.smithi070.stderr: -78> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:59:22.930 INFO:tasks.workunit.client.0.smithi070.stderr: -77> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:59:22.930 INFO:tasks.workunit.client.0.smithi070.stderr: -76> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 zonegroup default 2024-09-12T00:59:22.930 INFO:tasks.workunit.client.0.smithi070.stderr: -75> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.930 INFO:tasks.workunit.client.0.smithi070.stderr: -74> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.930 INFO:tasks.workunit.client.0.smithi070.stderr: -73> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.930 INFO:tasks.workunit.client.0.smithi070.stderr: -72> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.930 INFO:tasks.workunit.client.0.smithi070.stderr: -71> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.930 INFO:tasks.workunit.client.0.smithi070.stderr: -70> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.930 INFO:tasks.workunit.client.0.smithi070.stderr: -69> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 started sync module instance, tier type = 2024-09-12T00:59:22.930 INFO:tasks.workunit.client.0.smithi070.stderr: -68> 2024-09-12T00:59:22.769+0000 7fc3f51899c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:59:22.930 INFO:tasks.workunit.client.0.smithi070.stderr: -67> 2024-09-12T00:59:22.785+0000 7fc3f51899c0 20 add_watcher() i=0 2024-09-12T00:59:22.930 INFO:tasks.workunit.client.0.smithi070.stderr: -66> 2024-09-12T00:59:22.785+0000 7fc3f51899c0 20 add_watcher() i=1 2024-09-12T00:59:22.930 INFO:tasks.workunit.client.0.smithi070.stderr: -65> 2024-09-12T00:59:22.785+0000 7fc3f51899c0 20 add_watcher() i=2 2024-09-12T00:59:22.931 INFO:tasks.workunit.client.0.smithi070.stderr: -64> 2024-09-12T00:59:22.785+0000 7fc3f51899c0 20 add_watcher() i=3 2024-09-12T00:59:22.931 INFO:tasks.workunit.client.0.smithi070.stderr: -63> 2024-09-12T00:59:22.785+0000 7fc3f51899c0 20 add_watcher() i=4 2024-09-12T00:59:22.931 INFO:tasks.workunit.client.0.smithi070.stderr: -62> 2024-09-12T00:59:22.785+0000 7fc3f51899c0 20 add_watcher() i=5 2024-09-12T00:59:22.931 INFO:tasks.workunit.client.0.smithi070.stderr: -61> 2024-09-12T00:59:22.785+0000 7fc3f51899c0 20 add_watcher() i=6 2024-09-12T00:59:22.931 INFO:tasks.workunit.client.0.smithi070.stderr: -60> 2024-09-12T00:59:22.785+0000 7fc3f51899c0 20 add_watcher() i=7 2024-09-12T00:59:22.931 INFO:tasks.workunit.client.0.smithi070.stderr: -59> 2024-09-12T00:59:22.785+0000 7fc3f51899c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:59:22.931 INFO:tasks.workunit.client.0.smithi070.stderr: -58> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding auth protocol: cephx 2024-09-12T00:59:22.931 INFO:tasks.workunit.client.0.smithi070.stderr: -57> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding auth protocol: cephx 2024-09-12T00:59:22.931 INFO:tasks.workunit.client.0.smithi070.stderr: -56> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding auth protocol: cephx 2024-09-12T00:59:22.931 INFO:tasks.workunit.client.0.smithi070.stderr: -55> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding con mode: secure 2024-09-12T00:59:22.931 INFO:tasks.workunit.client.0.smithi070.stderr: -54> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding con mode: crc 2024-09-12T00:59:22.931 INFO:tasks.workunit.client.0.smithi070.stderr: -53> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding con mode: secure 2024-09-12T00:59:22.931 INFO:tasks.workunit.client.0.smithi070.stderr: -52> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding con mode: crc 2024-09-12T00:59:22.932 INFO:tasks.workunit.client.0.smithi070.stderr: -51> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding con mode: secure 2024-09-12T00:59:22.932 INFO:tasks.workunit.client.0.smithi070.stderr: -50> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding con mode: crc 2024-09-12T00:59:22.932 INFO:tasks.workunit.client.0.smithi070.stderr: -49> 2024-09-12T00:59:22.789+0000 7fc2a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:59:22.932 INFO:tasks.workunit.client.0.smithi070.stderr: -48> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding con mode: crc 2024-09-12T00:59:22.932 INFO:tasks.workunit.client.0.smithi070.stderr: -47> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding con mode: secure 2024-09-12T00:59:22.932 INFO:tasks.workunit.client.0.smithi070.stderr: -46> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding con mode: crc 2024-09-12T00:59:22.932 INFO:tasks.workunit.client.0.smithi070.stderr: -45> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding con mode: secure 2024-09-12T00:59:22.932 INFO:tasks.workunit.client.0.smithi070.stderr: -44> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding con mode: crc 2024-09-12T00:59:22.932 INFO:tasks.workunit.client.0.smithi070.stderr: -43> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 AuthRegistry(0x7ffd9f7c5380) adding con mode: secure 2024-09-12T00:59:22.932 INFO:tasks.workunit.client.0.smithi070.stderr: -42> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:22.932 INFO:tasks.workunit.client.0.smithi070.stderr: -41> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:59:22.932 INFO:tasks.workunit.client.0.smithi070.stderr: -40> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:59:22.932 INFO:tasks.workunit.client.0.smithi070.stderr: -39> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command cache list hook 0x557eb20b6ed0 2024-09-12T00:59:22.933 INFO:tasks.workunit.client.0.smithi070.stderr: -38> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command cache inspect hook 0x557eb20b6ed0 2024-09-12T00:59:22.933 INFO:tasks.workunit.client.0.smithi070.stderr: -37> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command cache erase hook 0x557eb20b6ed0 2024-09-12T00:59:22.933 INFO:tasks.workunit.client.0.smithi070.stderr: -36> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command cache zap hook 0x557eb20b6ed0 2024-09-12T00:59:22.933 INFO:tasks.workunit.client.0.smithi070.stderr: -35> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 note: GC not initialized 2024-09-12T00:59:22.933 INFO:tasks.workunit.client.0.smithi070.stderr: -34> 2024-09-12T00:59:22.789+0000 7fc2a8fe1640 20 reqs_thread_entry: start 2024-09-12T00:59:22.933 INFO:tasks.workunit.client.0.smithi070.stderr: -33> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command sync trace show hook 0x7fc3e4004300 2024-09-12T00:59:22.933 INFO:tasks.workunit.client.0.smithi070.stderr: -32> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command sync trace history hook 0x7fc3e4004300 2024-09-12T00:59:22.933 INFO:tasks.workunit.client.0.smithi070.stderr: -31> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command sync trace active hook 0x7fc3e4004300 2024-09-12T00:59:22.933 INFO:tasks.workunit.client.0.smithi070.stderr: -30> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 5 asok(0x557eb1dd22b0) register_command sync trace active_short hook 0x7fc3e4004300 2024-09-12T00:59:22.933 INFO:tasks.workunit.client.0.smithi070.stderr: -29> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 20 init_complete bucket index max shards: 1 2024-09-12T00:59:22.933 INFO:tasks.workunit.client.0.smithi070.stderr: -28> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 20 Filter name: none 2024-09-12T00:59:22.933 INFO:tasks.workunit.client.0.smithi070.stderr: -27> 2024-09-12T00:59:22.789+0000 7fc2a1ffb640 20 reqs_thread_entry: start 2024-09-12T00:59:22.933 INFO:tasks.workunit.client.0.smithi070.stderr: -26> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:59:22.933 INFO:tasks.workunit.client.0.smithi070.stderr: -25> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.934 INFO:tasks.workunit.client.0.smithi070.stderr: -24> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:59:22.934 INFO:tasks.workunit.client.0.smithi070.stderr: -23> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:59:22.934 INFO:tasks.workunit.client.0.smithi070.stderr: -22> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:59:22.934 INFO:tasks.workunit.client.0.smithi070.stderr: -21> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : miss 2024-09-12T00:59:22.934 INFO:tasks.workunit.client.0.smithi070.stderr: -20> 2024-09-12T00:59:22.789+0000 7fc3f51899c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.934 INFO:tasks.workunit.client.0.smithi070.stderr: -19> 2024-09-12T00:59:22.793+0000 7fc3f51899c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:59:22.934 INFO:tasks.workunit.client.0.smithi070.stderr: -18> 2024-09-12T00:59:22.793+0000 7fc3f51899c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:59:22.934 INFO:tasks.workunit.client.0.smithi070.stderr: -17> 2024-09-12T00:59:22.793+0000 7fc3f51899c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:59:22.934 INFO:tasks.workunit.client.0.smithi070.stderr: -16> 2024-09-12T00:59:22.793+0000 7fc3f51899c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:59:22.934 INFO:tasks.workunit.client.0.smithi070.stderr: -15> 2024-09-12T00:59:22.793+0000 7fc3f51899c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:59:22.934 INFO:tasks.workunit.client.0.smithi070.stderr: -14> 2024-09-12T00:59:22.793+0000 7fc3f51899c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T00:59:22.934 INFO:tasks.workunit.client.0.smithi070.stderr: -13> 2024-09-12T00:59:22.801+0000 7fc3f51899c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:59:22.934 INFO:tasks.workunit.client.0.smithi070.stderr: -12> 2024-09-12T00:59:22.801+0000 7fc3f51899c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:59:22.935 INFO:tasks.workunit.client.0.smithi070.stderr: -11> 2024-09-12T00:59:22.801+0000 7fc3f51899c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:59:22.935 INFO:tasks.workunit.client.0.smithi070.stderr: -10> 2024-09-12T00:59:22.801+0000 7fc3f51899c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18, ofs0, ns] 2024-09-12T00:59:22.935 INFO:tasks.workunit.client.0.smithi070.stderr: -9> 2024-09-12T00:59:22.801+0000 7fc2d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431647 cookie 94002641468272 notifier 7790 bl.length()=911 2024-09-12T00:59:22.935 INFO:tasks.workunit.client.0.smithi070.stderr: -8> 2024-09-12T00:59:22.801+0000 7fc2d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:59:22.935 INFO:tasks.workunit.client.0.smithi070.stderr: -7> 2024-09-12T00:59:22.801+0000 7fc2d67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:59:22.935 INFO:tasks.workunit.client.0.smithi070.stderr: -6> 2024-09-12T00:59:22.801+0000 7fc2d67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:59:22.935 INFO:tasks.workunit.client.0.smithi070.stderr: -5> 2024-09-12T00:59:22.801+0000 7fc3f51899c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_sources= new_sources= 2024-09-12T00:59:22.935 INFO:tasks.workunit.client.0.smithi070.stderr: -4> 2024-09-12T00:59:22.801+0000 7fc3f51899c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential sources added=[] removed=[] 2024-09-12T00:59:22.935 INFO:tasks.workunit.client.0.smithi070.stderr: -3> 2024-09-12T00:59:22.801+0000 7fc3f51899c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_dests= new_dests= 2024-09-12T00:59:22.935 INFO:tasks.workunit.client.0.smithi070.stderr: -2> 2024-09-12T00:59:22.801+0000 7fc3f51899c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential dests added=[] removed=[] 2024-09-12T00:59:22.935 INFO:tasks.workunit.client.0.smithi070.stderr: -1> 2024-09-12T00:59:22.809+0000 7fc3f51899c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc3f51899c0 time 2024-09-12T00:59:22.810711+0000 2024-09-12T00:59:22.935 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:59:22.935 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.936 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:59:22.936 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc3f8a632eb] 2024-09-12T00:59:22.936 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc3f8a6349f] 2024-09-12T00:59:22.936 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557eafa64cc1] 2024-09-12T00:59:22.936 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x557eafa79d5a] 2024-09-12T00:59:22.936 INFO:tasks.workunit.client.0.smithi070.stderr: 5: main() 2024-09-12T00:59:22.936 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc3f78c9d90] 2024-09-12T00:59:22.936 INFO:tasks.workunit.client.0.smithi070.stderr: 7: __libc_start_main() 2024-09-12T00:59:22.936 INFO:tasks.workunit.client.0.smithi070.stderr: 8: _start() 2024-09-12T00:59:22.936 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.936 INFO:tasks.workunit.client.0.smithi070.stderr: 0> 2024-09-12T00:59:22.809+0000 7fc3f51899c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:59:22.936 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7fc3f51899c0 thread_name:radosgw-admin 2024-09-12T00:59:22.937 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.937 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:59:22.937 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc3f78e2520] 2024-09-12T00:59:22.937 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:59:22.937 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:59:22.937 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:59:22.937 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc3f8a63345] 2024-09-12T00:59:22.937 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc3f8a6349f] 2024-09-12T00:59:22.937 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557eafa64cc1] 2024-09-12T00:59:22.937 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x557eafa79d5a] 2024-09-12T00:59:22.937 INFO:tasks.workunit.client.0.smithi070.stderr: 9: main() 2024-09-12T00:59:22.937 INFO:tasks.workunit.client.0.smithi070.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc3f78c9d90] 2024-09-12T00:59:22.937 INFO:tasks.workunit.client.0.smithi070.stderr: 11: __libc_start_main() 2024-09-12T00:59:22.938 INFO:tasks.workunit.client.0.smithi070.stderr: 12: _start() 2024-09-12T00:59:22.938 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:59:22.938 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:22.938 INFO:tasks.workunit.client.0.smithi070.stderr:--- logging levels --- 2024-09-12T00:59:22.938 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 none 2024-09-12T00:59:22.938 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 lockdep 2024-09-12T00:59:22.938 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 context 2024-09-12T00:59:22.938 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 crush 2024-09-12T00:59:22.938 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds 2024-09-12T00:59:22.938 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_balancer 2024-09-12T00:59:22.938 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_locker 2024-09-12T00:59:22.938 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log 2024-09-12T00:59:22.938 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log_expire 2024-09-12T00:59:22.939 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_migrator 2024-09-12T00:59:22.939 INFO:tasks.workunit.client.0.smithi070.stderr: 3/ 5 mds_quiesce 2024-09-12T00:59:22.939 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 buffer 2024-09-12T00:59:22.939 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 timer 2024-09-12T00:59:22.939 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 filer 2024-09-12T00:59:22.939 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 striper 2024-09-12T00:59:22.939 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 objecter 2024-09-12T00:59:22.939 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rados 2024-09-12T00:59:22.939 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd 2024-09-12T00:59:22.939 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_mirror 2024-09-12T00:59:22.939 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_replay 2024-09-12T00:59:22.939 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_pwl 2024-09-12T00:59:22.939 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 journaler 2024-09-12T00:59:22.940 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objectcacher 2024-09-12T00:59:22.940 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:59:22.940 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 client 2024-09-12T00:59:22.940 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 osd 2024-09-12T00:59:22.940 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 optracker 2024-09-12T00:59:22.940 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objclass 2024-09-12T00:59:22.940 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 filestore 2024-09-12T00:59:22.940 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 journal 2024-09-12T00:59:22.940 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 ms 2024-09-12T00:59:22.940 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mon 2024-09-12T00:59:22.940 INFO:tasks.workunit.client.0.smithi070.stderr: 0/10 monc 2024-09-12T00:59:22.940 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 paxos 2024-09-12T00:59:22.940 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 tp 2024-09-12T00:59:22.941 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 auth 2024-09-12T00:59:22.941 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 crypto 2024-09-12T00:59:22.941 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 finisher 2024-09-12T00:59:22.941 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 reserver 2024-09-12T00:59:22.941 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 heartbeatmap 2024-09-12T00:59:22.941 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 perfcounter 2024-09-12T00:59:22.941 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw 2024-09-12T00:59:22.941 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_sync 2024-09-12T00:59:22.941 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_datacache 2024-09-12T00:59:22.941 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_access 2024-09-12T00:59:22.941 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:59:22.941 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_flight 2024-09-12T00:59:22.941 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:59:22.942 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw_notification 2024-09-12T00:59:22.942 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 javaclient 2024-09-12T00:59:22.942 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 asok 2024-09-12T00:59:22.942 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 throttle 2024-09-12T00:59:22.942 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 refs 2024-09-12T00:59:22.942 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 compressor 2024-09-12T00:59:22.942 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluestore 2024-09-12T00:59:22.942 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluefs 2024-09-12T00:59:22.942 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 bdev 2024-09-12T00:59:22.942 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 kstore 2024-09-12T00:59:22.942 INFO:tasks.workunit.client.0.smithi070.stderr: 4/ 5 rocksdb 2024-09-12T00:59:22.942 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 fuse 2024-09-12T00:59:22.942 INFO:tasks.workunit.client.0.smithi070.stderr: 2/ 5 mgr 2024-09-12T00:59:22.942 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mgrc 2024-09-12T00:59:22.943 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 dpdk 2024-09-12T00:59:22.943 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 eventtrace 2024-09-12T00:59:22.943 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 prioritycache 2024-09-12T00:59:22.943 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 test 2024-09-12T00:59:22.943 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:59:22.943 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephsqlite 2024-09-12T00:59:22.943 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:59:22.943 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore 2024-09-12T00:59:22.943 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_onode 2024-09-12T00:59:22.943 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_odata 2024-09-12T00:59:22.943 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_omap 2024-09-12T00:59:22.943 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_tm 2024-09-12T00:59:22.943 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_t 2024-09-12T00:59:22.943 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:59:22.944 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_epm 2024-09-12T00:59:22.944 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_lba 2024-09-12T00:59:22.944 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:59:22.944 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cache 2024-09-12T00:59:22.944 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_journal 2024-09-12T00:59:22.944 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_device 2024-09-12T00:59:22.944 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_backref 2024-09-12T00:59:22.944 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 alienstore 2024-09-12T00:59:22.944 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mclock 2024-09-12T00:59:22.944 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cyanstore 2024-09-12T00:59:22.944 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 ceph_exporter 2024-09-12T00:59:22.944 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 memstore 2024-09-12T00:59:22.945 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 trace 2024-09-12T00:59:22.945 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 ceph_dedup 2024-09-12T00:59:22.945 INFO:tasks.workunit.client.0.smithi070.stderr: -2/-2 (syslog threshold) 2024-09-12T00:59:22.945 INFO:tasks.workunit.client.0.smithi070.stderr: 99/99 (stderr threshold) 2024-09-12T00:59:22.945 INFO:tasks.workunit.client.0.smithi070.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:59:22.945 INFO:tasks.workunit.client.0.smithi070.stderr: 7fc2a1ffb640 / http_manager 2024-09-12T00:59:22.945 INFO:tasks.workunit.client.0.smithi070.stderr: 7fc2a8fe1640 / http_manager 2024-09-12T00:59:22.945 INFO:tasks.workunit.client.0.smithi070.stderr: 7fc2a9fe3640 / rgw_dt_lg_renew 2024-09-12T00:59:22.945 INFO:tasks.workunit.client.0.smithi070.stderr: 7fc2d4ff9640 / ms_dispatch 2024-09-12T00:59:22.945 INFO:tasks.workunit.client.0.smithi070.stderr: 7fc2d67fc640 / io_context_pool 2024-09-12T00:59:22.945 INFO:tasks.workunit.client.0.smithi070.stderr: 7fc2dce01640 / ms_dispatch 2024-09-12T00:59:22.945 INFO:tasks.workunit.client.0.smithi070.stderr: 7fc2df606640 / ms_dispatch 2024-09-12T00:59:22.945 INFO:tasks.workunit.client.0.smithi070.stderr: 7fc2e0e09640 / io_context_pool 2024-09-12T00:59:22.945 INFO:tasks.workunit.client.0.smithi070.stderr: 7fc3f1c8d640 / io_context_pool 2024-09-12T00:59:22.946 INFO:tasks.workunit.client.0.smithi070.stderr: 7fc3f248e640 / msgr-worker-2 2024-09-12T00:59:22.946 INFO:tasks.workunit.client.0.smithi070.stderr: 7fc3f2c8f640 / msgr-worker-1 2024-09-12T00:59:22.946 INFO:tasks.workunit.client.0.smithi070.stderr: 7fc3f3490640 / msgr-worker-0 2024-09-12T00:59:22.946 INFO:tasks.workunit.client.0.smithi070.stderr: 7fc3f51899c0 / radosgw-admin 2024-09-12T00:59:22.946 INFO:tasks.workunit.client.0.smithi070.stderr: max_recent 500 2024-09-12T00:59:22.946 INFO:tasks.workunit.client.0.smithi070.stderr: max_new 1000 2024-09-12T00:59:22.946 INFO:tasks.workunit.client.0.smithi070.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:59:22.812771Z_be354c5e-748d-4f23-a48f-da21f06c2f7a/log 2024-09-12T00:59:22.946 INFO:tasks.workunit.client.0.smithi070.stderr:--- end dump of recent events --- 2024-09-12T00:59:22.946 INFO:tasks.workunit.client.0.smithi070.stderr:Aborted 2024-09-12T00:59:22.946 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:59:22.951 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:59:22.951 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:59:22.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.885+0000 7fc8b0efc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.889+0000 7fc8b0efc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.889+0000 7fc8b0efc9c0 20 realm 2024-09-12T00:59:22.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.889+0000 7fc8b0efc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.889+0000 7fc8b0efc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.889+0000 7fc8b0efc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:59:22.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.889+0000 7fc8b0efc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.889+0000 7fc8b0efc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.889+0000 7fc8b0efc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.889+0000 7fc8b0efc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:59:22.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.889+0000 7fc8b0efc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.893+0000 7fc8b0efc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:59:22.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.893+0000 7fc8b0efc9c0 20 searching for the correct realm 2024-09-12T00:59:22.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.897+0000 7fc8af203640 0 -- 172.21.15.70:0/3356137066 >> [v2:172.21.15.70:6816/1979013808,v1:172.21.15.70:6817/1979013808] conn(0x55b2eda83090 msgr2=0x55b2eda854e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:59:22.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.905+0000 7fc8ae201640 0 -- 172.21.15.70:0/3356137066 >> [v2:172.21.15.70:6824/2477739226,v1:172.21.15.70:6825/2477739226] conn(0x55b2eda8ab40 msgr2=0x55b2eda8cf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:59:22.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.909+0000 7fc8b0efc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:59:22.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.909+0000 7fc8b0efc9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:59:22.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.909+0000 7fc8b0efc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:59:22.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.909+0000 7fc8b0efc9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:59:22.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.909+0000 7fc8b0efc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:59:22.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.909+0000 7fc8b0efc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:59:22.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.909+0000 7fc8b0efc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.909+0000 7fc8b0efc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.909+0000 7fc8b0efc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.913+0000 7fc8b0efc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:59:22.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.913+0000 7fc8b0efc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.913+0000 7fc8b0efc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:59:22.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.913+0000 7fc8b0efc9c0 20 zone default found 2024-09-12T00:59:22.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.913+0000 7fc8b0efc9c0 4 Realm: () 2024-09-12T00:59:22.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.913+0000 7fc8b0efc9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:59:22.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.913+0000 7fc8b0efc9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:59:22.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.913+0000 7fc8b0efc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:59:22.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.913+0000 7fc8b0efc9c0 20 zonegroup default 2024-09-12T00:59:22.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.913+0000 7fc8b0efc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.913+0000 7fc8b0efc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.913+0000 7fc8b0efc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.913+0000 7fc8b0efc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.913+0000 7fc8b0efc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.913+0000 7fc8b0efc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:22.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.913+0000 7fc8b0efc9c0 20 started sync module instance, tier type = 2024-09-12T00:59:22.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.913+0000 7fc8b0efc9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:59:22.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.929+0000 7fc8b0efc9c0 20 add_watcher() i=0 2024-09-12T00:59:22.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.929+0000 7fc8b0efc9c0 20 add_watcher() i=1 2024-09-12T00:59:22.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.929+0000 7fc8b0efc9c0 20 add_watcher() i=2 2024-09-12T00:59:22.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.929+0000 7fc8b0efc9c0 20 add_watcher() i=3 2024-09-12T00:59:22.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.929+0000 7fc8b0efc9c0 20 add_watcher() i=4 2024-09-12T00:59:22.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.929+0000 7fc8b0efc9c0 20 add_watcher() i=5 2024-09-12T00:59:22.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.929+0000 7fc8b0efc9c0 20 add_watcher() i=6 2024-09-12T00:59:22.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.929+0000 7fc8b0efc9c0 20 add_watcher() i=7 2024-09-12T00:59:22.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.929+0000 7fc8b0efc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:59:22.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.929+0000 7fc7657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:59:22.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.933+0000 7fc8b0efc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:59:22.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.933+0000 7fc8b0efc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:59:22.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.933+0000 7fc8b0efc9c0 5 note: GC not initialized 2024-09-12T00:59:22.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.933+0000 7fc6dffff640 20 reqs_thread_entry: start 2024-09-12T00:59:22.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.933+0000 7fc8b0efc9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:59:22.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.933+0000 7fc8b0efc9c0 20 Filter name: none 2024-09-12T00:59:22.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.933+0000 7fc6ddffb640 20 reqs_thread_entry: start 2024-09-12T00:59:22.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.933+0000 7fc8b0efc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.933+0000 7fc8b0efc9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:59:22.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.933+0000 7fc8b0efc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.933+0000 7fc8b0efc9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:59:22.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.933+0000 7fc8b0efc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:59:22.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.933+0000 7fc8b0efc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.933+0000 7fc8b0efc9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:59:22.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.933+0000 7fc8b0efc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:22.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.937+0000 7fc8b0efc9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:59:22.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.937+0000 7fc8b0efc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:59:22.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.937+0000 7fc7657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:59:22.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.941+0000 7fc8b0efc9c0 20 remove_watcher() i=0 2024-09-12T00:59:22.957 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.941+0000 7fc8b0efc9c0 2 removed watcher, disabling cache 2024-09-12T00:59:22.957 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.945+0000 7fc8b0efc9c0 20 remove_watcher() i=1 2024-09-12T00:59:22.957 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.945+0000 7fc8b0efc9c0 20 remove_watcher() i=2 2024-09-12T00:59:22.957 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.949+0000 7fc8b0efc9c0 20 remove_watcher() i=3 2024-09-12T00:59:22.957 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.949+0000 7fc8b0efc9c0 20 remove_watcher() i=4 2024-09-12T00:59:22.957 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.953+0000 7fc8b0efc9c0 20 remove_watcher() i=5 2024-09-12T00:59:22.957 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.953+0000 7fc8b0efc9c0 20 remove_watcher() i=6 2024-09-12T00:59:22.957 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:22.953+0000 7fc8b0efc9c0 20 remove_watcher() i=7 2024-09-12T00:59:22.959 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:59:22.959 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T00:59:22.969 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:59:22.996 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:59:22.996 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:59:23.038 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.045+0000 7f402004b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:23.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.049+0000 7f402004b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:23.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.049+0000 7f402004b9c0 20 realm 2024-09-12T00:59:23.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.049+0000 7f402004b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:23.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.049+0000 7f402004b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:23.040 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.049+0000 7f402004b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:59:23.041 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.049+0000 7f402004b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:23.041 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.049+0000 7f402004b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:23.041 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.049+0000 7f402004b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:23.041 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.049+0000 7f402004b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:59:23.041 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.049+0000 7f402004b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:23.042 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.053+0000 7f402004b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:59:23.042 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.053+0000 7f402004b9c0 20 searching for the correct realm 2024-09-12T00:59:23.046 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.057+0000 7f401e352640 0 -- 172.21.15.70:0/2805646664 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f40140de070 msgr2=0x7f40141350b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:59:23.264 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.273+0000 7f401e352640 0 -- 172.21.15.70:0/2805646664 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f40140de070 msgr2=0x7f40141350b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:59:23.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.285+0000 7f402004b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:59:23.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.285+0000 7f402004b9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:59:23.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.285+0000 7f402004b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:59:23.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.285+0000 7f402004b9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:59:23.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.285+0000 7f402004b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:59:23.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.285+0000 7f402004b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:59:23.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.285+0000 7f402004b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:23.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.285+0000 7f402004b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:23.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.285+0000 7f402004b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:23.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.285+0000 7f402004b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:59:23.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.285+0000 7f402004b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:23.277 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.285+0000 7f402004b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:59:23.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.285+0000 7f402004b9c0 20 zone default found 2024-09-12T00:59:23.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.285+0000 7f402004b9c0 4 Realm: () 2024-09-12T00:59:23.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.285+0000 7f402004b9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:59:23.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.285+0000 7f402004b9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:59:23.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.285+0000 7f402004b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:59:23.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.285+0000 7f402004b9c0 20 zonegroup default 2024-09-12T00:59:23.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.285+0000 7f402004b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:23.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.289+0000 7f402004b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:23.279 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.289+0000 7f402004b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:23.279 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.289+0000 7f402004b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:23.279 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.289+0000 7f402004b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:23.280 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.289+0000 7f402004b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:23.280 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.289+0000 7f402004b9c0 20 started sync module instance, tier type = 2024-09-12T00:59:23.280 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.289+0000 7f402004b9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:59:23.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.313+0000 7f402004b9c0 20 add_watcher() i=0 2024-09-12T00:59:23.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.313+0000 7f402004b9c0 20 add_watcher() i=1 2024-09-12T00:59:23.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.313+0000 7f402004b9c0 20 add_watcher() i=2 2024-09-12T00:59:23.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.313+0000 7f402004b9c0 20 add_watcher() i=3 2024-09-12T00:59:23.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.313+0000 7f402004b9c0 20 add_watcher() i=4 2024-09-12T00:59:23.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.313+0000 7f402004b9c0 20 add_watcher() i=5 2024-09-12T00:59:23.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.313+0000 7f402004b9c0 20 add_watcher() i=6 2024-09-12T00:59:23.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.317+0000 7f402004b9c0 20 add_watcher() i=7 2024-09-12T00:59:23.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.317+0000 7f402004b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:59:23.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.317+0000 7f3ecf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:59:23.311 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.321+0000 7f402004b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:59:23.311 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.321+0000 7f402004b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:59:23.311 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.321+0000 7f402004b9c0 5 note: GC not initialized 2024-09-12T00:59:23.311 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.321+0000 7f3ece7fc640 20 reqs_thread_entry: start 2024-09-12T00:59:23.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.321+0000 7f402004b9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:59:23.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.321+0000 7f402004b9c0 20 Filter name: none 2024-09-12T00:59:23.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.321+0000 7f3e3ffff640 20 reqs_thread_entry: start 2024-09-12T00:59:23.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.321+0000 7f402004b9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:59:23.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.321+0000 7f402004b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:23.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.321+0000 7f402004b9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:59:23.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.321+0000 7f402004b9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:59:23.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.321+0000 7f402004b9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:59:23.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.321+0000 7f402004b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : miss 2024-09-12T00:59:23.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.321+0000 7f402004b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:23.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.325+0000 7f402004b9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:59:23.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.325+0000 7f402004b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:59:23.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.325+0000 7f402004b9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:59:23.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.325+0000 7f402004b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:59:23.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.325+0000 7f402004b9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:59:23.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.325+0000 7f402004b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T00:59:23.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.325+0000 7f402004b9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.0 2024-09-12T00:59:23.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.325+0000 7f402004b9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.0 2024-09-12T00:59:23.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.325+0000 7f402004b9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.1 2024-09-12T00:59:23.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.325+0000 7f402004b9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.1 2024-09-12T00:59:23.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.325+0000 7f402004b9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.2 2024-09-12T00:59:23.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.325+0000 7f402004b9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.2 2024-09-12T00:59:23.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.329+0000 7f3ecf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:59:23.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.333+0000 7f402004b9c0 20 remove_watcher() i=0 2024-09-12T00:59:23.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.333+0000 7f402004b9c0 2 removed watcher, disabling cache 2024-09-12T00:59:23.325 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.333+0000 7f402004b9c0 20 remove_watcher() i=1 2024-09-12T00:59:23.328 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.337+0000 7f402004b9c0 20 remove_watcher() i=2 2024-09-12T00:59:23.330 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.341+0000 7f402004b9c0 20 remove_watcher() i=3 2024-09-12T00:59:23.332 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.341+0000 7f402004b9c0 20 remove_watcher() i=4 2024-09-12T00:59:23.334 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.345+0000 7f402004b9c0 20 remove_watcher() i=5 2024-09-12T00:59:23.336 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.345+0000 7f402004b9c0 20 remove_watcher() i=6 2024-09-12T00:59:23.337 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:23.345+0000 7f402004b9c0 20 remove_watcher() i=7 2024-09-12T00:59:53.383 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T00:59:53.421 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:59:53.421 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:59:53.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.476+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.468 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.476+0000 7fd36b1fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.468 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.476+0000 7fd36b1fc9c0 20 realm 2024-09-12T00:59:53.468 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.476+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.468 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.476+0000 7fd36b1fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.468 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.476+0000 7fd36b1fc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:59:53.468 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.476+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.468 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.476+0000 7fd36b1fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.469 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.476+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.480+0000 7fd36b1fc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:59:53.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.480+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.470 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.480+0000 7fd36b1fc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:59:53.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.480+0000 7fd36b1fc9c0 20 searching for the correct realm 2024-09-12T00:59:53.475 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.484+0000 7fd369503640 0 -- 172.21.15.70:0/3605515028 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fd35c00ec50 msgr2=0x7fd35c064ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:59:53.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.492+0000 7fd369503640 0 -- 172.21.15.70:0/3605515028 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fd234080880 msgr2=0x7fd234082cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:59:53.491 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:59:53.491 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:59:53.492 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:59:53.492 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:59:53.492 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:59:53.492 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:59:53.492 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.492 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.492 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.493 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:59:53.493 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.493 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:59:53.493 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 zone default found 2024-09-12T00:59:53.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 4 Realm: () 2024-09-12T00:59:53.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:59:53.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:59:53.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:59:53.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 zonegroup default 2024-09-12T00:59:53.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.494 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.504+0000 7fd36b1fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.504+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.504+0000 7fd36b1fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.504+0000 7fd36b1fc9c0 20 started sync module instance, tier type = 2024-09-12T00:59:53.495 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.504+0000 7fd36b1fc9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:59:53.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.520+0000 7fd36b1fc9c0 20 add_watcher() i=0 2024-09-12T00:59:53.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.520+0000 7fd36b1fc9c0 20 add_watcher() i=1 2024-09-12T00:59:53.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.520+0000 7fd36b1fc9c0 20 add_watcher() i=2 2024-09-12T00:59:53.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.520+0000 7fd36b1fc9c0 20 add_watcher() i=3 2024-09-12T00:59:53.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.520+0000 7fd36b1fc9c0 20 add_watcher() i=4 2024-09-12T00:59:53.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.520+0000 7fd36b1fc9c0 20 add_watcher() i=5 2024-09-12T00:59:53.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.520+0000 7fd36b1fc9c0 20 add_watcher() i=6 2024-09-12T00:59:53.512 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.520+0000 7fd36b1fc9c0 20 add_watcher() i=7 2024-09-12T00:59:53.512 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.520+0000 7fd36b1fc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:59:53.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.524+0000 7fd21efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:59:53.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:59:53.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:59:53.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 note: GC not initialized 2024-09-12T00:59:53.518 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.528+0000 7fd21dfe3640 20 reqs_thread_entry: start 2024-09-12T00:59:53.518 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:59:53.518 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 20 Filter name: none 2024-09-12T00:59:53.518 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.528+0000 7fd18f7fe640 20 reqs_thread_entry: start 2024-09-12T00:59:53.518 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:59:53.518 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.519 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:59:53.519 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:59:53.519 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:59:53.519 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : miss 2024-09-12T00:59:53.519 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.520 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:59:53.520 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:59:53.521 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:59:53.521 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:59:53.521 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:59:53.521 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T00:59:53.522 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.532+0000 7fd36b1fc9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:59:53.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.540+0000 7fd36b1fc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:59:53.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.540+0000 7fd36b1fc9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:59:53.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.540+0000 7fd36b1fc9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:59:53.531 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.540+0000 7fd36b1fc9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18, ofs0, ns] 2024-09-12T00:59:53.532 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.540+0000 7fd23ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431648 cookie 94426487769648 notifier 7844 bl.length()=911 2024-09-12T00:59:53.532 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.540+0000 7fd23ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:59:53.532 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.540+0000 7fd23ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:59:53.532 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.540+0000 7fd23ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:59:53.533 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.540+0000 7fd36b1fc9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_sources= new_sources= 2024-09-12T00:59:53.533 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.540+0000 7fd36b1fc9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential sources added=[] removed=[] 2024-09-12T00:59:53.533 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.540+0000 7fd36b1fc9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_dests= new_dests= 2024-09-12T00:59:53.533 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.540+0000 7fd36b1fc9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential dests added=[] removed=[] 2024-09-12T00:59:53.539 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd36b1fc9c0 time 2024-09-12T00:59:53.552386+0000 2024-09-12T00:59:53.539 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:59:53.540 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:59:53.540 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd36ead62eb] 2024-09-12T00:59:53.540 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd36ead649f] 2024-09-12T00:59:53.540 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e15f1bacc1] 2024-09-12T00:59:53.541 INFO:tasks.workunit.client.0.smithi070.stderr: 4: radosgw-admin(+0x1422aac) [0x55e15fc18aac] 2024-09-12T00:59:53.541 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e15f1cfced] 2024-09-12T00:59:53.541 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:59:53.541 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd36d93cd90] 2024-09-12T00:59:53.541 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:59:53.541 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:59:53.541 INFO:tasks.workunit.client.0.smithi070.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:59:53.541 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7fd36b1fc9c0 thread_name:radosgw-admin 2024-09-12T00:59:53.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.548+0000 7fd36b1fc9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd36b1fc9c0 time 2024-09-12T00:59:53.552386+0000 2024-09-12T00:59:53.541 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:59:53.541 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.541 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:59:53.542 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd36ead62eb] 2024-09-12T00:59:53.542 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd36ead649f] 2024-09-12T00:59:53.542 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e15f1bacc1] 2024-09-12T00:59:53.542 INFO:tasks.workunit.client.0.smithi070.stderr: 4: radosgw-admin(+0x1422aac) [0x55e15fc18aac] 2024-09-12T00:59:53.542 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e15f1cfced] 2024-09-12T00:59:53.542 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:59:53.542 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd36d93cd90] 2024-09-12T00:59:53.542 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:59:53.542 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:59:53.542 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.559 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:59:53.559 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd36d955520] 2024-09-12T00:59:53.559 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:59:53.559 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:59:53.559 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:59:53.559 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd36ead6345] 2024-09-12T00:59:53.559 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd36ead649f] 2024-09-12T00:59:53.560 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e15f1bacc1] 2024-09-12T00:59:53.560 INFO:tasks.workunit.client.0.smithi070.stderr: 8: radosgw-admin(+0x1422aac) [0x55e15fc18aac] 2024-09-12T00:59:53.560 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e15f1cfced] 2024-09-12T00:59:53.560 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:59:53.560 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd36d93cd90] 2024-09-12T00:59:53.560 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:59:53.560 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:59:53.560 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.552+0000 7fd36b1fc9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:59:53.560 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7fd36b1fc9c0 thread_name:radosgw-admin 2024-09-12T00:59:53.560 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.560 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:59:53.560 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd36d955520] 2024-09-12T00:59:53.560 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:59:53.561 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:59:53.561 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:59:53.561 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd36ead6345] 2024-09-12T00:59:53.561 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd36ead649f] 2024-09-12T00:59:53.561 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e15f1bacc1] 2024-09-12T00:59:53.561 INFO:tasks.workunit.client.0.smithi070.stderr: 8: radosgw-admin(+0x1422aac) [0x55e15fc18aac] 2024-09-12T00:59:53.561 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e15f1cfced] 2024-09-12T00:59:53.561 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:59:53.561 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd36d93cd90] 2024-09-12T00:59:53.561 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:59:53.561 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:59:53.561 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:59:53.561 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.562 INFO:tasks.workunit.client.0.smithi070.stderr:--- begin dump of recent events --- 2024-09-12T00:59:53.562 INFO:tasks.workunit.client.0.smithi070.stderr: -499> 2024-09-12T00:59:53.452+0000 7fd368d02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:53.562 INFO:tasks.workunit.client.0.smithi070.stderr: -498> 2024-09-12T00:59:53.452+0000 7fd368501640 10 monclient(hunting): handle_auth_done global_id 8361 payload 274 2024-09-12T00:59:53.562 INFO:tasks.workunit.client.0.smithi070.stderr: -497> 2024-09-12T00:59:53.452+0000 7fd368501640 10 monclient: _finish_hunting 0 2024-09-12T00:59:53.562 INFO:tasks.workunit.client.0.smithi070.stderr: -496> 2024-09-12T00:59:53.452+0000 7fd368501640 1 monclient: found mon.noname-a 2024-09-12T00:59:53.562 INFO:tasks.workunit.client.0.smithi070.stderr: -495> 2024-09-12T00:59:53.452+0000 7fd368501640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:59:53.562 INFO:tasks.workunit.client.0.smithi070.stderr: -494> 2024-09-12T00:59:53.452+0000 7fd256e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:53.562 INFO:tasks.workunit.client.0.smithi070.stderr: -493> 2024-09-12T00:59:53.452+0000 7fd256e0d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:59:53.562 INFO:tasks.workunit.client.0.smithi070.stderr: -492> 2024-09-12T00:59:53.452+0000 7fd256e0d640 10 monclient: dump: 2024-09-12T00:59:53.562 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:53.562 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:53.562 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.562 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.562 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:53.563 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.563 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:53.563 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:53.563 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:53.563 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.563 INFO:tasks.workunit.client.0.smithi070.stderr: -491> 2024-09-12T00:59:53.452+0000 7fd256e0d640 10 monclient: _finish_auth 0 2024-09-12T00:59:53.563 INFO:tasks.workunit.client.0.smithi070.stderr: -490> 2024-09-12T00:59:53.452+0000 7fd256e0d640 10 monclient: _check_auth_tickets 2024-09-12T00:59:53.563 INFO:tasks.workunit.client.0.smithi070.stderr: -489> 2024-09-12T00:59:53.452+0000 7fd256e0d640 10 monclient: handle_config config(0 keys) 2024-09-12T00:59:53.563 INFO:tasks.workunit.client.0.smithi070.stderr: -488> 2024-09-12T00:59:53.452+0000 7fd256e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:53.563 INFO:tasks.workunit.client.0.smithi070.stderr: -487> 2024-09-12T00:59:53.452+0000 7fd256e0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:59:53.563 INFO:tasks.workunit.client.0.smithi070.stderr: -486> 2024-09-12T00:59:53.452+0000 7fd256e0d640 10 monclient: dump: 2024-09-12T00:59:53.563 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:53.563 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:53.563 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.564 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.564 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:53.564 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.564 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:53.564 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:53.564 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:53.564 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.564 INFO:tasks.workunit.client.0.smithi070.stderr: -485> 2024-09-12T00:59:53.452+0000 7fd36b1fc9c0 5 monclient: authenticate success, global_id 8361 2024-09-12T00:59:53.564 INFO:tasks.workunit.client.0.smithi070.stderr: -484> 2024-09-12T00:59:53.452+0000 7fd36b1fc9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:59:53.564 INFO:tasks.workunit.client.0.smithi070.stderr: -483> 2024-09-12T00:59:53.452+0000 7fd36b1fc9c0 4 set_mon_vals no callback set 2024-09-12T00:59:53.564 INFO:tasks.workunit.client.0.smithi070.stderr: -482> 2024-09-12T00:59:53.452+0000 7fd36b1fc9c0 10 monclient: shutdown 2024-09-12T00:59:53.564 INFO:tasks.workunit.client.0.smithi070.stderr: -481> 2024-09-12T00:59:53.452+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) unregister_commands rotate-key 2024-09-12T00:59:53.564 INFO:tasks.workunit.client.0.smithi070.stderr: -480> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient: build_initial_monmap 2024-09-12T00:59:53.564 INFO:tasks.workunit.client.0.smithi070.stderr: -479> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 1 build_initial for_mkfs: 0 2024-09-12T00:59:53.564 INFO:tasks.workunit.client.0.smithi070.stderr: -478> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient: monmap: 2024-09-12T00:59:53.565 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:59:53.565 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:59:53.565 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:59:53.565 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:59:53.565 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:59:53.565 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.565 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:59:53.565 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:59:53.565 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:59:53.565 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.565 INFO:tasks.workunit.client.0.smithi070.stderr: -477> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding auth protocol: cephx 2024-09-12T00:59:53.565 INFO:tasks.workunit.client.0.smithi070.stderr: -476> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding auth protocol: cephx 2024-09-12T00:59:53.565 INFO:tasks.workunit.client.0.smithi070.stderr: -475> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding auth protocol: cephx 2024-09-12T00:59:53.565 INFO:tasks.workunit.client.0.smithi070.stderr: -474> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding con mode: secure 2024-09-12T00:59:53.566 INFO:tasks.workunit.client.0.smithi070.stderr: -473> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding con mode: crc 2024-09-12T00:59:53.566 INFO:tasks.workunit.client.0.smithi070.stderr: -472> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding con mode: secure 2024-09-12T00:59:53.566 INFO:tasks.workunit.client.0.smithi070.stderr: -471> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding con mode: crc 2024-09-12T00:59:53.566 INFO:tasks.workunit.client.0.smithi070.stderr: -470> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding con mode: secure 2024-09-12T00:59:53.566 INFO:tasks.workunit.client.0.smithi070.stderr: -469> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding con mode: crc 2024-09-12T00:59:53.566 INFO:tasks.workunit.client.0.smithi070.stderr: -468> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding con mode: crc 2024-09-12T00:59:53.566 INFO:tasks.workunit.client.0.smithi070.stderr: -467> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding con mode: secure 2024-09-12T00:59:53.566 INFO:tasks.workunit.client.0.smithi070.stderr: -466> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding con mode: crc 2024-09-12T00:59:53.566 INFO:tasks.workunit.client.0.smithi070.stderr: -465> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding con mode: secure 2024-09-12T00:59:53.566 INFO:tasks.workunit.client.0.smithi070.stderr: -464> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding con mode: crc 2024-09-12T00:59:53.566 INFO:tasks.workunit.client.0.smithi070.stderr: -463> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding con mode: secure 2024-09-12T00:59:53.566 INFO:tasks.workunit.client.0.smithi070.stderr: -462> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:53.566 INFO:tasks.workunit.client.0.smithi070.stderr: -461> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 1 librados: starting msgr at 2024-09-12T00:59:53.566 INFO:tasks.workunit.client.0.smithi070.stderr: -460> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 1 librados: starting objecter 2024-09-12T00:59:53.567 INFO:tasks.workunit.client.0.smithi070.stderr: -459> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command objecter_requests hook 0x55e1610f4750 2024-09-12T00:59:53.567 INFO:tasks.workunit.client.0.smithi070.stderr: -458> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 1 librados: setting wanted keys 2024-09-12T00:59:53.567 INFO:tasks.workunit.client.0.smithi070.stderr: -457> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 1 librados: calling monclient init 2024-09-12T00:59:53.567 INFO:tasks.workunit.client.0.smithi070.stderr: -456> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient: init 2024-09-12T00:59:53.567 INFO:tasks.workunit.client.0.smithi070.stderr: -455> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding auth protocol: cephx 2024-09-12T00:59:53.567 INFO:tasks.workunit.client.0.smithi070.stderr: -454> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding auth protocol: cephx 2024-09-12T00:59:53.567 INFO:tasks.workunit.client.0.smithi070.stderr: -453> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding auth protocol: cephx 2024-09-12T00:59:53.567 INFO:tasks.workunit.client.0.smithi070.stderr: -452> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding con mode: secure 2024-09-12T00:59:53.567 INFO:tasks.workunit.client.0.smithi070.stderr: -451> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding con mode: crc 2024-09-12T00:59:53.567 INFO:tasks.workunit.client.0.smithi070.stderr: -450> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding con mode: secure 2024-09-12T00:59:53.567 INFO:tasks.workunit.client.0.smithi070.stderr: -449> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding con mode: crc 2024-09-12T00:59:53.567 INFO:tasks.workunit.client.0.smithi070.stderr: -448> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding con mode: secure 2024-09-12T00:59:53.567 INFO:tasks.workunit.client.0.smithi070.stderr: -447> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding con mode: crc 2024-09-12T00:59:53.568 INFO:tasks.workunit.client.0.smithi070.stderr: -446> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding con mode: crc 2024-09-12T00:59:53.568 INFO:tasks.workunit.client.0.smithi070.stderr: -445> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding con mode: secure 2024-09-12T00:59:53.568 INFO:tasks.workunit.client.0.smithi070.stderr: -444> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding con mode: crc 2024-09-12T00:59:53.568 INFO:tasks.workunit.client.0.smithi070.stderr: -443> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding con mode: secure 2024-09-12T00:59:53.568 INFO:tasks.workunit.client.0.smithi070.stderr: -442> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding con mode: crc 2024-09-12T00:59:53.568 INFO:tasks.workunit.client.0.smithi070.stderr: -441> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding con mode: secure 2024-09-12T00:59:53.568 INFO:tasks.workunit.client.0.smithi070.stderr: -440> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:53.568 INFO:tasks.workunit.client.0.smithi070.stderr: -439> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:53.568 INFO:tasks.workunit.client.0.smithi070.stderr: -438> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command rotate-key hook 0x55e161332f88 2024-09-12T00:59:53.568 INFO:tasks.workunit.client.0.smithi070.stderr: -437> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:59:53.568 INFO:tasks.workunit.client.0.smithi070.stderr: -436> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:59:53.568 INFO:tasks.workunit.client.0.smithi070.stderr: -435> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient(hunting): picked mon.noname-a con 0x55e1611e34e0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:59:53.568 INFO:tasks.workunit.client.0.smithi070.stderr: -434> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient(hunting): picked mon.noname-b con 0x55e1611e38c0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:59:53.569 INFO:tasks.workunit.client.0.smithi070.stderr: -433> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient(hunting): picked mon.noname-c con 0x55e1611ef330 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:59:53.569 INFO:tasks.workunit.client.0.smithi070.stderr: -432> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:53.569 INFO:tasks.workunit.client.0.smithi070.stderr: -431> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:53.569 INFO:tasks.workunit.client.0.smithi070.stderr: -430> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:53.569 INFO:tasks.workunit.client.0.smithi070.stderr: -429> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:59:53.569 INFO:tasks.workunit.client.0.smithi070.stderr: -428> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient(hunting): authenticate will time out at 2443.905337s 2024-09-12T00:59:53.569 INFO:tasks.workunit.client.0.smithi070.stderr: -427> 2024-09-12T00:59:53.456+0000 7fd368d02640 10 monclient(hunting): get_auth_request con 0x55e1611e34e0 auth_method 0 2024-09-12T00:59:53.569 INFO:tasks.workunit.client.0.smithi070.stderr: -426> 2024-09-12T00:59:53.456+0000 7fd368d02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:53.569 INFO:tasks.workunit.client.0.smithi070.stderr: -425> 2024-09-12T00:59:53.456+0000 7fd368d02640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:53.569 INFO:tasks.workunit.client.0.smithi070.stderr: -424> 2024-09-12T00:59:53.456+0000 7fd368d02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:53.569 INFO:tasks.workunit.client.0.smithi070.stderr: -423> 2024-09-12T00:59:53.456+0000 7fd369503640 10 monclient(hunting): get_auth_request con 0x55e1611ef330 auth_method 0 2024-09-12T00:59:53.569 INFO:tasks.workunit.client.0.smithi070.stderr: -422> 2024-09-12T00:59:53.456+0000 7fd369503640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:53.569 INFO:tasks.workunit.client.0.smithi070.stderr: -421> 2024-09-12T00:59:53.456+0000 7fd369503640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:53.569 INFO:tasks.workunit.client.0.smithi070.stderr: -420> 2024-09-12T00:59:53.456+0000 7fd369503640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:53.570 INFO:tasks.workunit.client.0.smithi070.stderr: -419> 2024-09-12T00:59:53.456+0000 7fd368d02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:53.570 INFO:tasks.workunit.client.0.smithi070.stderr: -418> 2024-09-12T00:59:53.456+0000 7fd368d02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:53.570 INFO:tasks.workunit.client.0.smithi070.stderr: -417> 2024-09-12T00:59:53.456+0000 7fd368d02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:53.570 INFO:tasks.workunit.client.0.smithi070.stderr: -416> 2024-09-12T00:59:53.456+0000 7fd369503640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:53.570 INFO:tasks.workunit.client.0.smithi070.stderr: -415> 2024-09-12T00:59:53.456+0000 7fd369503640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:53.570 INFO:tasks.workunit.client.0.smithi070.stderr: -414> 2024-09-12T00:59:53.456+0000 7fd369503640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:53.570 INFO:tasks.workunit.client.0.smithi070.stderr: -413> 2024-09-12T00:59:53.456+0000 7fd368501640 10 monclient(hunting): get_auth_request con 0x55e1611e38c0 auth_method 0 2024-09-12T00:59:53.570 INFO:tasks.workunit.client.0.smithi070.stderr: -412> 2024-09-12T00:59:53.456+0000 7fd368501640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:53.570 INFO:tasks.workunit.client.0.smithi070.stderr: -411> 2024-09-12T00:59:53.456+0000 7fd368501640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:53.570 INFO:tasks.workunit.client.0.smithi070.stderr: -410> 2024-09-12T00:59:53.456+0000 7fd368501640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:53.570 INFO:tasks.workunit.client.0.smithi070.stderr: -409> 2024-09-12T00:59:53.456+0000 7fd368d02640 10 monclient(hunting): handle_auth_done global_id 8364 payload 824 2024-09-12T00:59:53.570 INFO:tasks.workunit.client.0.smithi070.stderr: -408> 2024-09-12T00:59:53.456+0000 7fd368d02640 10 monclient: _finish_hunting 0 2024-09-12T00:59:53.570 INFO:tasks.workunit.client.0.smithi070.stderr: -407> 2024-09-12T00:59:53.456+0000 7fd368d02640 1 monclient: found mon.noname-a 2024-09-12T00:59:53.570 INFO:tasks.workunit.client.0.smithi070.stderr: -406> 2024-09-12T00:59:53.456+0000 7fd368d02640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:59:53.571 INFO:tasks.workunit.client.0.smithi070.stderr: -405> 2024-09-12T00:59:53.456+0000 7fd25560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:53.571 INFO:tasks.workunit.client.0.smithi070.stderr: -404> 2024-09-12T00:59:53.456+0000 7fd25560a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:59:53.571 INFO:tasks.workunit.client.0.smithi070.stderr: -403> 2024-09-12T00:59:53.456+0000 7fd25560a640 10 monclient: dump: 2024-09-12T00:59:53.571 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:53.571 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:53.571 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.571 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.571 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:53.571 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.571 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:53.571 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:53.571 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:53.571 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.571 INFO:tasks.workunit.client.0.smithi070.stderr: -402> 2024-09-12T00:59:53.456+0000 7fd25560a640 10 monclient: _finish_auth 0 2024-09-12T00:59:53.572 INFO:tasks.workunit.client.0.smithi070.stderr: -401> 2024-09-12T00:59:53.456+0000 7fd25560a640 10 monclient: _check_auth_tickets 2024-09-12T00:59:53.572 INFO:tasks.workunit.client.0.smithi070.stderr: -400> 2024-09-12T00:59:53.456+0000 7fd25560a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:59:53.572 INFO:tasks.workunit.client.0.smithi070.stderr: -399> 2024-09-12T00:59:53.456+0000 7fd25560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:53.572 INFO:tasks.workunit.client.0.smithi070.stderr: -398> 2024-09-12T00:59:53.456+0000 7fd25560a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:59:53.572 INFO:tasks.workunit.client.0.smithi070.stderr: -397> 2024-09-12T00:59:53.456+0000 7fd25560a640 10 monclient: dump: 2024-09-12T00:59:53.572 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:53.572 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:53.572 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.572 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.572 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:53.572 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.572 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:53.572 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:53.573 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:53.573 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.573 INFO:tasks.workunit.client.0.smithi070.stderr: -396> 2024-09-12T00:59:53.456+0000 7fd256e0d640 4 set_mon_vals no callback set 2024-09-12T00:59:53.573 INFO:tasks.workunit.client.0.smithi070.stderr: -395> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 monclient: authenticate success, global_id 8364 2024-09-12T00:59:53.573 INFO:tasks.workunit.client.0.smithi070.stderr: -394> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient: _renew_subs 2024-09-12T00:59:53.573 INFO:tasks.workunit.client.0.smithi070.stderr: -393> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:59:53.573 INFO:tasks.workunit.client.0.smithi070.stderr: -392> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient: _renew_subs 2024-09-12T00:59:53.573 INFO:tasks.workunit.client.0.smithi070.stderr: -391> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:59:53.573 INFO:tasks.workunit.client.0.smithi070.stderr: -390> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 1 librados: init done 2024-09-12T00:59:53.573 INFO:tasks.workunit.client.0.smithi070.stderr: -389> 2024-09-12T00:59:53.460+0000 7fd25560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:59:53.573 INFO:tasks.workunit.client.0.smithi070.stderr: -388> 2024-09-12T00:59:53.460+0000 7fd25560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:59:53.573 INFO:tasks.workunit.client.0.smithi070.stderr: -387> 2024-09-12T00:59:53.460+0000 7fd25560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:59:53.573 INFO:tasks.workunit.client.0.smithi070.stderr: -386> 2024-09-12T00:59:53.460+0000 7fd368501640 10 monclient: get_auth_request con 0x7fd250070b10 auth_method 0 2024-09-12T00:59:53.574 INFO:tasks.workunit.client.0.smithi070.stderr: -385> 2024-09-12T00:59:53.460+0000 7fd369503640 10 monclient: get_auth_request con 0x55e16135aa90 auth_method 0 2024-09-12T00:59:53.574 INFO:tasks.workunit.client.0.smithi070.stderr: -384> 2024-09-12T00:59:53.460+0000 7fd368d02640 10 monclient: get_auth_request con 0x55e16137d860 auth_method 0 2024-09-12T00:59:53.574 INFO:tasks.workunit.client.0.smithi070.stderr: -383> 2024-09-12T00:59:53.464+0000 7fd368501640 10 monclient: get_auth_request con 0x55e161381c90 auth_method 0 2024-09-12T00:59:53.574 INFO:tasks.workunit.client.0.smithi070.stderr: -382> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient: build_initial_monmap 2024-09-12T00:59:53.574 INFO:tasks.workunit.client.0.smithi070.stderr: -381> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 1 build_initial for_mkfs: 0 2024-09-12T00:59:53.574 INFO:tasks.workunit.client.0.smithi070.stderr: -380> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient: monmap: 2024-09-12T00:59:53.574 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:59:53.574 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:59:53.574 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:59:53.574 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:59:53.574 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:59:53.574 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.574 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:59:53.574 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:59:53.575 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:59:53.575 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.575 INFO:tasks.workunit.client.0.smithi070.stderr: -379> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding auth protocol: cephx 2024-09-12T00:59:53.575 INFO:tasks.workunit.client.0.smithi070.stderr: -378> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding auth protocol: cephx 2024-09-12T00:59:53.575 INFO:tasks.workunit.client.0.smithi070.stderr: -377> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding auth protocol: cephx 2024-09-12T00:59:53.575 INFO:tasks.workunit.client.0.smithi070.stderr: -376> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding con mode: secure 2024-09-12T00:59:53.575 INFO:tasks.workunit.client.0.smithi070.stderr: -375> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding con mode: crc 2024-09-12T00:59:53.575 INFO:tasks.workunit.client.0.smithi070.stderr: -374> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding con mode: secure 2024-09-12T00:59:53.575 INFO:tasks.workunit.client.0.smithi070.stderr: -373> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding con mode: crc 2024-09-12T00:59:53.575 INFO:tasks.workunit.client.0.smithi070.stderr: -372> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding con mode: secure 2024-09-12T00:59:53.575 INFO:tasks.workunit.client.0.smithi070.stderr: -371> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding con mode: crc 2024-09-12T00:59:53.575 INFO:tasks.workunit.client.0.smithi070.stderr: -370> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding con mode: crc 2024-09-12T00:59:53.575 INFO:tasks.workunit.client.0.smithi070.stderr: -369> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding con mode: secure 2024-09-12T00:59:53.576 INFO:tasks.workunit.client.0.smithi070.stderr: -368> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding con mode: crc 2024-09-12T00:59:53.576 INFO:tasks.workunit.client.0.smithi070.stderr: -367> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding con mode: secure 2024-09-12T00:59:53.576 INFO:tasks.workunit.client.0.smithi070.stderr: -366> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding con mode: crc 2024-09-12T00:59:53.576 INFO:tasks.workunit.client.0.smithi070.stderr: -365> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding con mode: secure 2024-09-12T00:59:53.576 INFO:tasks.workunit.client.0.smithi070.stderr: -364> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:53.576 INFO:tasks.workunit.client.0.smithi070.stderr: -363> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command objecter_requests cmddesc objecter_requests hook 0x55e16138a500 EEXIST 2024-09-12T00:59:53.576 INFO:tasks.workunit.client.0.smithi070.stderr: -362> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient: init 2024-09-12T00:59:53.576 INFO:tasks.workunit.client.0.smithi070.stderr: -361> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding auth protocol: cephx 2024-09-12T00:59:53.576 INFO:tasks.workunit.client.0.smithi070.stderr: -360> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding auth protocol: cephx 2024-09-12T00:59:53.576 INFO:tasks.workunit.client.0.smithi070.stderr: -359> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding auth protocol: cephx 2024-09-12T00:59:53.576 INFO:tasks.workunit.client.0.smithi070.stderr: -358> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding con mode: secure 2024-09-12T00:59:53.576 INFO:tasks.workunit.client.0.smithi070.stderr: -357> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding con mode: crc 2024-09-12T00:59:53.576 INFO:tasks.workunit.client.0.smithi070.stderr: -356> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding con mode: secure 2024-09-12T00:59:53.576 INFO:tasks.workunit.client.0.smithi070.stderr: -355> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding con mode: crc 2024-09-12T00:59:53.577 INFO:tasks.workunit.client.0.smithi070.stderr: -354> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding con mode: secure 2024-09-12T00:59:53.577 INFO:tasks.workunit.client.0.smithi070.stderr: -353> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding con mode: crc 2024-09-12T00:59:53.577 INFO:tasks.workunit.client.0.smithi070.stderr: -352> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding con mode: crc 2024-09-12T00:59:53.577 INFO:tasks.workunit.client.0.smithi070.stderr: -351> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding con mode: secure 2024-09-12T00:59:53.577 INFO:tasks.workunit.client.0.smithi070.stderr: -350> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding con mode: crc 2024-09-12T00:59:53.577 INFO:tasks.workunit.client.0.smithi070.stderr: -349> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding con mode: secure 2024-09-12T00:59:53.577 INFO:tasks.workunit.client.0.smithi070.stderr: -348> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding con mode: crc 2024-09-12T00:59:53.577 INFO:tasks.workunit.client.0.smithi070.stderr: -347> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding con mode: secure 2024-09-12T00:59:53.577 INFO:tasks.workunit.client.0.smithi070.stderr: -346> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:53.577 INFO:tasks.workunit.client.0.smithi070.stderr: -345> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:53.577 INFO:tasks.workunit.client.0.smithi070.stderr: -344> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command rotate-key cmddesc rotate-key hook 0x55e161385370 EEXIST 2024-09-12T00:59:53.577 INFO:tasks.workunit.client.0.smithi070.stderr: -343> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:59:53.577 INFO:tasks.workunit.client.0.smithi070.stderr: -342> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:59:53.578 INFO:tasks.workunit.client.0.smithi070.stderr: -341> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient(hunting): picked mon.noname-a con 0x55e1613ae6b0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:59:53.578 INFO:tasks.workunit.client.0.smithi070.stderr: -340> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient(hunting): picked mon.noname-c con 0x55e1613adfe0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:59:53.578 INFO:tasks.workunit.client.0.smithi070.stderr: -339> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient(hunting): picked mon.noname-b con 0x55e1613ac9c0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:59:53.578 INFO:tasks.workunit.client.0.smithi070.stderr: -338> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:53.578 INFO:tasks.workunit.client.0.smithi070.stderr: -337> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:53.578 INFO:tasks.workunit.client.0.smithi070.stderr: -336> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:53.578 INFO:tasks.workunit.client.0.smithi070.stderr: -335> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:59:53.578 INFO:tasks.workunit.client.0.smithi070.stderr: -334> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient(hunting): authenticate will time out at 2443.914998s 2024-09-12T00:59:53.578 INFO:tasks.workunit.client.0.smithi070.stderr: -333> 2024-09-12T00:59:53.464+0000 7fd368501640 10 monclient(hunting): get_auth_request con 0x55e1613adfe0 auth_method 0 2024-09-12T00:59:53.578 INFO:tasks.workunit.client.0.smithi070.stderr: -332> 2024-09-12T00:59:53.464+0000 7fd368501640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:53.578 INFO:tasks.workunit.client.0.smithi070.stderr: -331> 2024-09-12T00:59:53.464+0000 7fd368501640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:53.578 INFO:tasks.workunit.client.0.smithi070.stderr: -330> 2024-09-12T00:59:53.464+0000 7fd368501640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:53.578 INFO:tasks.workunit.client.0.smithi070.stderr: -329> 2024-09-12T00:59:53.464+0000 7fd368d02640 10 monclient(hunting): get_auth_request con 0x55e1613ae6b0 auth_method 0 2024-09-12T00:59:53.578 INFO:tasks.workunit.client.0.smithi070.stderr: -328> 2024-09-12T00:59:53.464+0000 7fd368d02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:53.579 INFO:tasks.workunit.client.0.smithi070.stderr: -327> 2024-09-12T00:59:53.464+0000 7fd368d02640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:53.579 INFO:tasks.workunit.client.0.smithi070.stderr: -326> 2024-09-12T00:59:53.464+0000 7fd368d02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:53.579 INFO:tasks.workunit.client.0.smithi070.stderr: -325> 2024-09-12T00:59:53.464+0000 7fd368501640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:53.579 INFO:tasks.workunit.client.0.smithi070.stderr: -324> 2024-09-12T00:59:53.464+0000 7fd368501640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:53.579 INFO:tasks.workunit.client.0.smithi070.stderr: -323> 2024-09-12T00:59:53.464+0000 7fd368501640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:53.579 INFO:tasks.workunit.client.0.smithi070.stderr: -322> 2024-09-12T00:59:53.464+0000 7fd368d02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:53.579 INFO:tasks.workunit.client.0.smithi070.stderr: -321> 2024-09-12T00:59:53.464+0000 7fd368d02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:53.579 INFO:tasks.workunit.client.0.smithi070.stderr: -320> 2024-09-12T00:59:53.464+0000 7fd368d02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:53.579 INFO:tasks.workunit.client.0.smithi070.stderr: -319> 2024-09-12T00:59:53.464+0000 7fd368501640 10 monclient(hunting): handle_auth_done global_id 7838 payload 824 2024-09-12T00:59:53.579 INFO:tasks.workunit.client.0.smithi070.stderr: -318> 2024-09-12T00:59:53.464+0000 7fd368501640 10 monclient: _finish_hunting 0 2024-09-12T00:59:53.579 INFO:tasks.workunit.client.0.smithi070.stderr: -317> 2024-09-12T00:59:53.464+0000 7fd368501640 1 monclient: found mon.noname-c 2024-09-12T00:59:53.579 INFO:tasks.workunit.client.0.smithi070.stderr: -316> 2024-09-12T00:59:53.464+0000 7fd368501640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:59:53.579 INFO:tasks.workunit.client.0.smithi070.stderr: -315> 2024-09-12T00:59:53.464+0000 7fd369503640 10 monclient: get_auth_request con 0x55e1613ac9c0 auth_method 0 2024-09-12T00:59:53.579 INFO:tasks.workunit.client.0.smithi070.stderr: -314> 2024-09-12T00:59:53.464+0000 7fd24e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:53.580 INFO:tasks.workunit.client.0.smithi070.stderr: -313> 2024-09-12T00:59:53.464+0000 7fd24e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:59:53.580 INFO:tasks.workunit.client.0.smithi070.stderr: -312> 2024-09-12T00:59:53.464+0000 7fd24e7fc640 10 monclient: dump: 2024-09-12T00:59:53.580 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:53.580 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:53.580 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.580 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.580 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:53.580 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.580 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:53.580 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:53.580 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:53.580 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.580 INFO:tasks.workunit.client.0.smithi070.stderr: -311> 2024-09-12T00:59:53.464+0000 7fd24e7fc640 10 monclient: _finish_auth 0 2024-09-12T00:59:53.580 INFO:tasks.workunit.client.0.smithi070.stderr: -310> 2024-09-12T00:59:53.464+0000 7fd24e7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:59:53.581 INFO:tasks.workunit.client.0.smithi070.stderr: -309> 2024-09-12T00:59:53.464+0000 7fd24e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:59:53.581 INFO:tasks.workunit.client.0.smithi070.stderr: -308> 2024-09-12T00:59:53.464+0000 7fd24e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:53.581 INFO:tasks.workunit.client.0.smithi070.stderr: -307> 2024-09-12T00:59:53.464+0000 7fd24e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:59:53.581 INFO:tasks.workunit.client.0.smithi070.stderr: -306> 2024-09-12T00:59:53.464+0000 7fd24e7fc640 10 monclient: dump: 2024-09-12T00:59:53.581 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:53.581 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:53.581 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.581 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.581 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:53.581 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.581 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:53.581 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:53.581 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:53.581 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.582 INFO:tasks.workunit.client.0.smithi070.stderr: -305> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 monclient: authenticate success, global_id 7838 2024-09-12T00:59:53.582 INFO:tasks.workunit.client.0.smithi070.stderr: -304> 2024-09-12T00:59:53.464+0000 7fd369d04640 4 set_mon_vals no callback set 2024-09-12T00:59:53.582 INFO:tasks.workunit.client.0.smithi070.stderr: -303> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient: _renew_subs 2024-09-12T00:59:53.582 INFO:tasks.workunit.client.0.smithi070.stderr: -302> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:59:53.582 INFO:tasks.workunit.client.0.smithi070.stderr: -301> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient: _renew_subs 2024-09-12T00:59:53.582 INFO:tasks.workunit.client.0.smithi070.stderr: -300> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:59:53.582 INFO:tasks.workunit.client.0.smithi070.stderr: -299> 2024-09-12T00:59:53.468+0000 7fd24e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:59:53.582 INFO:tasks.workunit.client.0.smithi070.stderr: -298> 2024-09-12T00:59:53.468+0000 7fd24e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:59:53.582 INFO:tasks.workunit.client.0.smithi070.stderr: -297> 2024-09-12T00:59:53.468+0000 7fd24e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:59:53.582 INFO:tasks.workunit.client.0.smithi070.stderr: -296> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient: get_monmap_and_config 2024-09-12T00:59:53.582 INFO:tasks.workunit.client.0.smithi070.stderr: -295> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient: build_initial_monmap 2024-09-12T00:59:53.582 INFO:tasks.workunit.client.0.smithi070.stderr: -294> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 1 build_initial for_mkfs: 0 2024-09-12T00:59:53.582 INFO:tasks.workunit.client.0.smithi070.stderr: -293> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient: monmap: 2024-09-12T00:59:53.582 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:59:53.583 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:59:53.583 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:59:53.583 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:59:53.583 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:59:53.583 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.583 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:59:53.583 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:59:53.583 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:59:53.583 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.583 INFO:tasks.workunit.client.0.smithi070.stderr: -292> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding auth protocol: cephx 2024-09-12T00:59:53.583 INFO:tasks.workunit.client.0.smithi070.stderr: -291> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding auth protocol: cephx 2024-09-12T00:59:53.583 INFO:tasks.workunit.client.0.smithi070.stderr: -290> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding auth protocol: cephx 2024-09-12T00:59:53.583 INFO:tasks.workunit.client.0.smithi070.stderr: -289> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding con mode: secure 2024-09-12T00:59:53.584 INFO:tasks.workunit.client.0.smithi070.stderr: -288> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding con mode: crc 2024-09-12T00:59:53.584 INFO:tasks.workunit.client.0.smithi070.stderr: -287> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding con mode: secure 2024-09-12T00:59:53.584 INFO:tasks.workunit.client.0.smithi070.stderr: -286> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding con mode: crc 2024-09-12T00:59:53.584 INFO:tasks.workunit.client.0.smithi070.stderr: -285> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding con mode: secure 2024-09-12T00:59:53.584 INFO:tasks.workunit.client.0.smithi070.stderr: -284> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding con mode: crc 2024-09-12T00:59:53.584 INFO:tasks.workunit.client.0.smithi070.stderr: -283> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding con mode: crc 2024-09-12T00:59:53.584 INFO:tasks.workunit.client.0.smithi070.stderr: -282> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding con mode: secure 2024-09-12T00:59:53.584 INFO:tasks.workunit.client.0.smithi070.stderr: -281> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding con mode: crc 2024-09-12T00:59:53.584 INFO:tasks.workunit.client.0.smithi070.stderr: -280> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding con mode: secure 2024-09-12T00:59:53.584 INFO:tasks.workunit.client.0.smithi070.stderr: -279> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding con mode: crc 2024-09-12T00:59:53.584 INFO:tasks.workunit.client.0.smithi070.stderr: -278> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding con mode: secure 2024-09-12T00:59:53.584 INFO:tasks.workunit.client.0.smithi070.stderr: -277> 2024-09-12T00:59:53.468+0000 7fd368d02640 10 monclient: get_auth_request con 0x7fd240070a20 auth_method 0 2024-09-12T00:59:53.584 INFO:tasks.workunit.client.0.smithi070.stderr: -276> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:53.584 INFO:tasks.workunit.client.0.smithi070.stderr: -275> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient: init 2024-09-12T00:59:53.585 INFO:tasks.workunit.client.0.smithi070.stderr: -274> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding auth protocol: cephx 2024-09-12T00:59:53.585 INFO:tasks.workunit.client.0.smithi070.stderr: -273> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding auth protocol: cephx 2024-09-12T00:59:53.585 INFO:tasks.workunit.client.0.smithi070.stderr: -272> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding auth protocol: cephx 2024-09-12T00:59:53.585 INFO:tasks.workunit.client.0.smithi070.stderr: -271> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding con mode: secure 2024-09-12T00:59:53.585 INFO:tasks.workunit.client.0.smithi070.stderr: -270> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding con mode: crc 2024-09-12T00:59:53.585 INFO:tasks.workunit.client.0.smithi070.stderr: -269> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding con mode: secure 2024-09-12T00:59:53.585 INFO:tasks.workunit.client.0.smithi070.stderr: -268> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding con mode: crc 2024-09-12T00:59:53.585 INFO:tasks.workunit.client.0.smithi070.stderr: -267> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding con mode: secure 2024-09-12T00:59:53.585 INFO:tasks.workunit.client.0.smithi070.stderr: -266> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding con mode: crc 2024-09-12T00:59:53.585 INFO:tasks.workunit.client.0.smithi070.stderr: -265> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding con mode: crc 2024-09-12T00:59:53.585 INFO:tasks.workunit.client.0.smithi070.stderr: -264> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding con mode: secure 2024-09-12T00:59:53.585 INFO:tasks.workunit.client.0.smithi070.stderr: -263> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding con mode: crc 2024-09-12T00:59:53.585 INFO:tasks.workunit.client.0.smithi070.stderr: -262> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding con mode: secure 2024-09-12T00:59:53.585 INFO:tasks.workunit.client.0.smithi070.stderr: -261> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding con mode: crc 2024-09-12T00:59:53.586 INFO:tasks.workunit.client.0.smithi070.stderr: -260> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding con mode: secure 2024-09-12T00:59:53.586 INFO:tasks.workunit.client.0.smithi070.stderr: -259> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:53.586 INFO:tasks.workunit.client.0.smithi070.stderr: -258> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:53.586 INFO:tasks.workunit.client.0.smithi070.stderr: -257> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd6b770468 EEXIST 2024-09-12T00:59:53.586 INFO:tasks.workunit.client.0.smithi070.stderr: -256> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:59:53.586 INFO:tasks.workunit.client.0.smithi070.stderr: -255> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:59:53.586 INFO:tasks.workunit.client.0.smithi070.stderr: -254> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient(hunting): picked mon.noname-b con 0x55e1614025a0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:59:53.586 INFO:tasks.workunit.client.0.smithi070.stderr: -253> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient(hunting): picked mon.noname-c con 0x55e1613fd990 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:59:53.586 INFO:tasks.workunit.client.0.smithi070.stderr: -252> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient(hunting): picked mon.noname-a con 0x55e1613fe310 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:59:53.586 INFO:tasks.workunit.client.0.smithi070.stderr: -251> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:53.586 INFO:tasks.workunit.client.0.smithi070.stderr: -250> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:53.586 INFO:tasks.workunit.client.0.smithi070.stderr: -249> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:53.586 INFO:tasks.workunit.client.0.smithi070.stderr: -248> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:59:53.586 INFO:tasks.workunit.client.0.smithi070.stderr: -247> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient(hunting): authenticate will time out at 2443.919323s 2024-09-12T00:59:53.587 INFO:tasks.workunit.client.0.smithi070.stderr: -246> 2024-09-12T00:59:53.468+0000 7fd369503640 10 monclient(hunting): get_auth_request con 0x55e1613fe310 auth_method 0 2024-09-12T00:59:53.587 INFO:tasks.workunit.client.0.smithi070.stderr: -245> 2024-09-12T00:59:53.468+0000 7fd369503640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:53.587 INFO:tasks.workunit.client.0.smithi070.stderr: -244> 2024-09-12T00:59:53.468+0000 7fd369503640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:53.587 INFO:tasks.workunit.client.0.smithi070.stderr: -243> 2024-09-12T00:59:53.468+0000 7fd369503640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:53.587 INFO:tasks.workunit.client.0.smithi070.stderr: -242> 2024-09-12T00:59:53.468+0000 7fd368501640 10 monclient(hunting): get_auth_request con 0x55e1613fd990 auth_method 0 2024-09-12T00:59:53.587 INFO:tasks.workunit.client.0.smithi070.stderr: -241> 2024-09-12T00:59:53.468+0000 7fd368501640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:53.587 INFO:tasks.workunit.client.0.smithi070.stderr: -240> 2024-09-12T00:59:53.468+0000 7fd368501640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:53.587 INFO:tasks.workunit.client.0.smithi070.stderr: -239> 2024-09-12T00:59:53.468+0000 7fd368501640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:53.587 INFO:tasks.workunit.client.0.smithi070.stderr: -238> 2024-09-12T00:59:53.468+0000 7fd368501640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:53.587 INFO:tasks.workunit.client.0.smithi070.stderr: -237> 2024-09-12T00:59:53.468+0000 7fd368501640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:53.587 INFO:tasks.workunit.client.0.smithi070.stderr: -236> 2024-09-12T00:59:53.468+0000 7fd368501640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:53.587 INFO:tasks.workunit.client.0.smithi070.stderr: -235> 2024-09-12T00:59:53.468+0000 7fd369503640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:53.587 INFO:tasks.workunit.client.0.smithi070.stderr: -234> 2024-09-12T00:59:53.468+0000 7fd369503640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:53.587 INFO:tasks.workunit.client.0.smithi070.stderr: -233> 2024-09-12T00:59:53.468+0000 7fd369503640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:53.588 INFO:tasks.workunit.client.0.smithi070.stderr: -232> 2024-09-12T00:59:53.468+0000 7fd368501640 10 monclient(hunting): handle_auth_done global_id 7841 payload 274 2024-09-12T00:59:53.588 INFO:tasks.workunit.client.0.smithi070.stderr: -231> 2024-09-12T00:59:53.468+0000 7fd368501640 10 monclient: _finish_hunting 0 2024-09-12T00:59:53.588 INFO:tasks.workunit.client.0.smithi070.stderr: -230> 2024-09-12T00:59:53.468+0000 7fd368501640 1 monclient: found mon.noname-c 2024-09-12T00:59:53.588 INFO:tasks.workunit.client.0.smithi070.stderr: -229> 2024-09-12T00:59:53.468+0000 7fd368501640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:59:53.588 INFO:tasks.workunit.client.0.smithi070.stderr: -228> 2024-09-12T00:59:53.472+0000 7fd23ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:53.588 INFO:tasks.workunit.client.0.smithi070.stderr: -227> 2024-09-12T00:59:53.472+0000 7fd23ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:59:53.588 INFO:tasks.workunit.client.0.smithi070.stderr: -226> 2024-09-12T00:59:53.472+0000 7fd23ffff640 10 monclient: dump: 2024-09-12T00:59:53.588 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:53.588 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:53.588 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.588 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.588 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:53.588 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.588 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:53.589 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:53.589 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:53.589 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.589 INFO:tasks.workunit.client.0.smithi070.stderr: -225> 2024-09-12T00:59:53.472+0000 7fd23ffff640 10 monclient: _finish_auth 0 2024-09-12T00:59:53.589 INFO:tasks.workunit.client.0.smithi070.stderr: -224> 2024-09-12T00:59:53.472+0000 7fd23ffff640 10 monclient: _check_auth_tickets 2024-09-12T00:59:53.589 INFO:tasks.workunit.client.0.smithi070.stderr: -223> 2024-09-12T00:59:53.472+0000 7fd23ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:59:53.589 INFO:tasks.workunit.client.0.smithi070.stderr: -222> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 monclient: authenticate success, global_id 7841 2024-09-12T00:59:53.589 INFO:tasks.workunit.client.0.smithi070.stderr: -221> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:59:53.589 INFO:tasks.workunit.client.0.smithi070.stderr: -220> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 4 set_mon_vals no callback set 2024-09-12T00:59:53.589 INFO:tasks.workunit.client.0.smithi070.stderr: -219> 2024-09-12T00:59:53.472+0000 7fd23ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:53.589 INFO:tasks.workunit.client.0.smithi070.stderr: -218> 2024-09-12T00:59:53.472+0000 7fd23ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:59:53.589 INFO:tasks.workunit.client.0.smithi070.stderr: -217> 2024-09-12T00:59:53.472+0000 7fd23ffff640 10 monclient: dump: 2024-09-12T00:59:53.590 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:53.590 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:53.590 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.590 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.590 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:53.590 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.590 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:53.590 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:53.590 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:53.590 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.590 INFO:tasks.workunit.client.0.smithi070.stderr: -216> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient: shutdown 2024-09-12T00:59:53.590 INFO:tasks.workunit.client.0.smithi070.stderr: -215> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient: build_initial_monmap 2024-09-12T00:59:53.590 INFO:tasks.workunit.client.0.smithi070.stderr: -214> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 1 build_initial for_mkfs: 0 2024-09-12T00:59:53.591 INFO:tasks.workunit.client.0.smithi070.stderr: -213> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient: monmap: 2024-09-12T00:59:53.591 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:59:53.591 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:59:53.591 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:59:53.591 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:59:53.591 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:59:53.591 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.591 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:59:53.591 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:59:53.591 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:59:53.591 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.591 INFO:tasks.workunit.client.0.smithi070.stderr: -212> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding auth protocol: cephx 2024-09-12T00:59:53.591 INFO:tasks.workunit.client.0.smithi070.stderr: -211> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding auth protocol: cephx 2024-09-12T00:59:53.592 INFO:tasks.workunit.client.0.smithi070.stderr: -210> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding auth protocol: cephx 2024-09-12T00:59:53.592 INFO:tasks.workunit.client.0.smithi070.stderr: -209> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding con mode: secure 2024-09-12T00:59:53.592 INFO:tasks.workunit.client.0.smithi070.stderr: -208> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding con mode: crc 2024-09-12T00:59:53.592 INFO:tasks.workunit.client.0.smithi070.stderr: -207> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding con mode: secure 2024-09-12T00:59:53.592 INFO:tasks.workunit.client.0.smithi070.stderr: -206> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding con mode: crc 2024-09-12T00:59:53.592 INFO:tasks.workunit.client.0.smithi070.stderr: -205> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding con mode: secure 2024-09-12T00:59:53.592 INFO:tasks.workunit.client.0.smithi070.stderr: -204> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding con mode: crc 2024-09-12T00:59:53.592 INFO:tasks.workunit.client.0.smithi070.stderr: -203> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding con mode: crc 2024-09-12T00:59:53.592 INFO:tasks.workunit.client.0.smithi070.stderr: -202> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding con mode: secure 2024-09-12T00:59:53.592 INFO:tasks.workunit.client.0.smithi070.stderr: -201> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding con mode: crc 2024-09-12T00:59:53.592 INFO:tasks.workunit.client.0.smithi070.stderr: -200> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding con mode: secure 2024-09-12T00:59:53.592 INFO:tasks.workunit.client.0.smithi070.stderr: -199> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding con mode: crc 2024-09-12T00:59:53.592 INFO:tasks.workunit.client.0.smithi070.stderr: -198> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding con mode: secure 2024-09-12T00:59:53.593 INFO:tasks.workunit.client.0.smithi070.stderr: -197> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:53.593 INFO:tasks.workunit.client.0.smithi070.stderr: -196> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 1 librados: starting msgr at 2024-09-12T00:59:53.593 INFO:tasks.workunit.client.0.smithi070.stderr: -195> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 1 librados: starting objecter 2024-09-12T00:59:53.593 INFO:tasks.workunit.client.0.smithi070.stderr: -194> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command objecter_requests cmddesc objecter_requests hook 0x55e1613cdd90 EEXIST 2024-09-12T00:59:53.593 INFO:tasks.workunit.client.0.smithi070.stderr: -193> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 1 librados: setting wanted keys 2024-09-12T00:59:53.593 INFO:tasks.workunit.client.0.smithi070.stderr: -192> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 1 librados: calling monclient init 2024-09-12T00:59:53.593 INFO:tasks.workunit.client.0.smithi070.stderr: -191> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient: init 2024-09-12T00:59:53.593 INFO:tasks.workunit.client.0.smithi070.stderr: -190> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding auth protocol: cephx 2024-09-12T00:59:53.593 INFO:tasks.workunit.client.0.smithi070.stderr: -189> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding auth protocol: cephx 2024-09-12T00:59:53.593 INFO:tasks.workunit.client.0.smithi070.stderr: -188> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding auth protocol: cephx 2024-09-12T00:59:53.593 INFO:tasks.workunit.client.0.smithi070.stderr: -187> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding con mode: secure 2024-09-12T00:59:53.593 INFO:tasks.workunit.client.0.smithi070.stderr: -186> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding con mode: crc 2024-09-12T00:59:53.593 INFO:tasks.workunit.client.0.smithi070.stderr: -185> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding con mode: secure 2024-09-12T00:59:53.593 INFO:tasks.workunit.client.0.smithi070.stderr: -184> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding con mode: crc 2024-09-12T00:59:53.594 INFO:tasks.workunit.client.0.smithi070.stderr: -183> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding con mode: secure 2024-09-12T00:59:53.594 INFO:tasks.workunit.client.0.smithi070.stderr: -182> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding con mode: crc 2024-09-12T00:59:53.594 INFO:tasks.workunit.client.0.smithi070.stderr: -181> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding con mode: crc 2024-09-12T00:59:53.594 INFO:tasks.workunit.client.0.smithi070.stderr: -180> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding con mode: secure 2024-09-12T00:59:53.594 INFO:tasks.workunit.client.0.smithi070.stderr: -179> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding con mode: crc 2024-09-12T00:59:53.594 INFO:tasks.workunit.client.0.smithi070.stderr: -178> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding con mode: secure 2024-09-12T00:59:53.594 INFO:tasks.workunit.client.0.smithi070.stderr: -177> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding con mode: crc 2024-09-12T00:59:53.594 INFO:tasks.workunit.client.0.smithi070.stderr: -176> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding con mode: secure 2024-09-12T00:59:53.594 INFO:tasks.workunit.client.0.smithi070.stderr: -175> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:53.594 INFO:tasks.workunit.client.0.smithi070.stderr: -174> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:53.595 INFO:tasks.workunit.client.0.smithi070.stderr: -173> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command rotate-key cmddesc rotate-key hook 0x55e1613b0618 EEXIST 2024-09-12T00:59:53.595 INFO:tasks.workunit.client.0.smithi070.stderr: -172> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:59:53.595 INFO:tasks.workunit.client.0.smithi070.stderr: -171> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:59:53.595 INFO:tasks.workunit.client.0.smithi070.stderr: -170> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient(hunting): picked mon.noname-a con 0x55e1613fd990 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:59:53.595 INFO:tasks.workunit.client.0.smithi070.stderr: -169> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient(hunting): picked mon.noname-c con 0x55e1613fe310 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:59:53.595 INFO:tasks.workunit.client.0.smithi070.stderr: -168> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient(hunting): picked mon.noname-b con 0x55e1614025a0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:59:53.595 INFO:tasks.workunit.client.0.smithi070.stderr: -167> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:53.595 INFO:tasks.workunit.client.0.smithi070.stderr: -166> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:53.595 INFO:tasks.workunit.client.0.smithi070.stderr: -165> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:53.595 INFO:tasks.workunit.client.0.smithi070.stderr: -164> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:59:53.595 INFO:tasks.workunit.client.0.smithi070.stderr: -163> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient(hunting): authenticate will time out at 2443.921921s 2024-09-12T00:59:53.595 INFO:tasks.workunit.client.0.smithi070.stderr: -162> 2024-09-12T00:59:53.472+0000 7fd368501640 10 monclient(hunting): get_auth_request con 0x55e1613fe310 auth_method 0 2024-09-12T00:59:53.595 INFO:tasks.workunit.client.0.smithi070.stderr: -161> 2024-09-12T00:59:53.472+0000 7fd368501640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:53.595 INFO:tasks.workunit.client.0.smithi070.stderr: -160> 2024-09-12T00:59:53.472+0000 7fd368501640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:53.596 INFO:tasks.workunit.client.0.smithi070.stderr: -159> 2024-09-12T00:59:53.472+0000 7fd368501640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:53.596 INFO:tasks.workunit.client.0.smithi070.stderr: -158> 2024-09-12T00:59:53.472+0000 7fd368d02640 10 monclient(hunting): get_auth_request con 0x55e1613fd990 auth_method 0 2024-09-12T00:59:53.596 INFO:tasks.workunit.client.0.smithi070.stderr: -157> 2024-09-12T00:59:53.472+0000 7fd368d02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:53.596 INFO:tasks.workunit.client.0.smithi070.stderr: -156> 2024-09-12T00:59:53.472+0000 7fd368d02640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:53.596 INFO:tasks.workunit.client.0.smithi070.stderr: -155> 2024-09-12T00:59:53.472+0000 7fd368d02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:53.596 INFO:tasks.workunit.client.0.smithi070.stderr: -154> 2024-09-12T00:59:53.472+0000 7fd368501640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:53.596 INFO:tasks.workunit.client.0.smithi070.stderr: -153> 2024-09-12T00:59:53.472+0000 7fd368501640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:53.596 INFO:tasks.workunit.client.0.smithi070.stderr: -152> 2024-09-12T00:59:53.472+0000 7fd368501640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:53.596 INFO:tasks.workunit.client.0.smithi070.stderr: -151> 2024-09-12T00:59:53.472+0000 7fd368d02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:53.596 INFO:tasks.workunit.client.0.smithi070.stderr: -150> 2024-09-12T00:59:53.472+0000 7fd368d02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:53.596 INFO:tasks.workunit.client.0.smithi070.stderr: -149> 2024-09-12T00:59:53.472+0000 7fd368d02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:53.596 INFO:tasks.workunit.client.0.smithi070.stderr: -148> 2024-09-12T00:59:53.472+0000 7fd368501640 10 monclient(hunting): handle_auth_done global_id 7844 payload 824 2024-09-12T00:59:53.596 INFO:tasks.workunit.client.0.smithi070.stderr: -147> 2024-09-12T00:59:53.472+0000 7fd368501640 10 monclient: _finish_hunting 0 2024-09-12T00:59:53.597 INFO:tasks.workunit.client.0.smithi070.stderr: -146> 2024-09-12T00:59:53.472+0000 7fd368501640 1 monclient: found mon.noname-c 2024-09-12T00:59:53.597 INFO:tasks.workunit.client.0.smithi070.stderr: -145> 2024-09-12T00:59:53.472+0000 7fd368501640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:59:53.597 INFO:tasks.workunit.client.0.smithi070.stderr: -144> 2024-09-12T00:59:53.472+0000 7fd23e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:53.597 INFO:tasks.workunit.client.0.smithi070.stderr: -143> 2024-09-12T00:59:53.472+0000 7fd23e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:59:53.597 INFO:tasks.workunit.client.0.smithi070.stderr: -142> 2024-09-12T00:59:53.472+0000 7fd23e7fc640 10 monclient: dump: 2024-09-12T00:59:53.597 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:53.597 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:53.597 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.597 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.597 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:53.597 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.597 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:53.597 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:53.597 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:53.598 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.598 INFO:tasks.workunit.client.0.smithi070.stderr: -141> 2024-09-12T00:59:53.472+0000 7fd23e7fc640 10 monclient: _finish_auth 0 2024-09-12T00:59:53.598 INFO:tasks.workunit.client.0.smithi070.stderr: -140> 2024-09-12T00:59:53.472+0000 7fd23e7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:59:53.598 INFO:tasks.workunit.client.0.smithi070.stderr: -139> 2024-09-12T00:59:53.472+0000 7fd23e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:59:53.598 INFO:tasks.workunit.client.0.smithi070.stderr: -138> 2024-09-12T00:59:53.472+0000 7fd23e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:53.598 INFO:tasks.workunit.client.0.smithi070.stderr: -137> 2024-09-12T00:59:53.472+0000 7fd23e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:59:53.598 INFO:tasks.workunit.client.0.smithi070.stderr: -136> 2024-09-12T00:59:53.472+0000 7fd23e7fc640 10 monclient: dump: 2024-09-12T00:59:53.598 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:53.598 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:53.598 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.598 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.598 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:53.598 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.599 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:53.599 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:53.599 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:53.599 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.599 INFO:tasks.workunit.client.0.smithi070.stderr: -135> 2024-09-12T00:59:53.472+0000 7fd23ffff640 4 set_mon_vals no callback set 2024-09-12T00:59:53.599 INFO:tasks.workunit.client.0.smithi070.stderr: -134> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 monclient: authenticate success, global_id 7844 2024-09-12T00:59:53.599 INFO:tasks.workunit.client.0.smithi070.stderr: -133> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient: _renew_subs 2024-09-12T00:59:53.599 INFO:tasks.workunit.client.0.smithi070.stderr: -132> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:59:53.599 INFO:tasks.workunit.client.0.smithi070.stderr: -131> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient: _renew_subs 2024-09-12T00:59:53.599 INFO:tasks.workunit.client.0.smithi070.stderr: -130> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:59:53.599 INFO:tasks.workunit.client.0.smithi070.stderr: -129> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 1 librados: init done 2024-09-12T00:59:53.599 INFO:tasks.workunit.client.0.smithi070.stderr: -128> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command cr dump hook 0x55e1613f8bf8 2024-09-12T00:59:53.599 INFO:tasks.workunit.client.0.smithi070.stderr: -127> 2024-09-12T00:59:53.476+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.599 INFO:tasks.workunit.client.0.smithi070.stderr: -126> 2024-09-12T00:59:53.476+0000 7fd23e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:59:53.600 INFO:tasks.workunit.client.0.smithi070.stderr: -125> 2024-09-12T00:59:53.476+0000 7fd23e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:59:53.600 INFO:tasks.workunit.client.0.smithi070.stderr: -124> 2024-09-12T00:59:53.476+0000 7fd23e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:59:53.600 INFO:tasks.workunit.client.0.smithi070.stderr: -123> 2024-09-12T00:59:53.476+0000 7fd368d02640 10 monclient: get_auth_request con 0x7fd234070ae0 auth_method 0 2024-09-12T00:59:53.600 INFO:tasks.workunit.client.0.smithi070.stderr: -122> 2024-09-12T00:59:53.476+0000 7fd369503640 10 monclient: get_auth_request con 0x55e16141ba50 auth_method 0 2024-09-12T00:59:53.600 INFO:tasks.workunit.client.0.smithi070.stderr: -121> 2024-09-12T00:59:53.476+0000 7fd36b1fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.600 INFO:tasks.workunit.client.0.smithi070.stderr: -120> 2024-09-12T00:59:53.476+0000 7fd36b1fc9c0 20 realm 2024-09-12T00:59:53.600 INFO:tasks.workunit.client.0.smithi070.stderr: -119> 2024-09-12T00:59:53.476+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.600 INFO:tasks.workunit.client.0.smithi070.stderr: -118> 2024-09-12T00:59:53.476+0000 7fd36b1fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.600 INFO:tasks.workunit.client.0.smithi070.stderr: -117> 2024-09-12T00:59:53.476+0000 7fd36b1fc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:59:53.600 INFO:tasks.workunit.client.0.smithi070.stderr: -116> 2024-09-12T00:59:53.476+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.600 INFO:tasks.workunit.client.0.smithi070.stderr: -115> 2024-09-12T00:59:53.476+0000 7fd36b1fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.600 INFO:tasks.workunit.client.0.smithi070.stderr: -114> 2024-09-12T00:59:53.476+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.601 INFO:tasks.workunit.client.0.smithi070.stderr: -113> 2024-09-12T00:59:53.476+0000 7fd368d02640 10 monclient: get_auth_request con 0x55e16141fdb0 auth_method 0 2024-09-12T00:59:53.601 INFO:tasks.workunit.client.0.smithi070.stderr: -112> 2024-09-12T00:59:53.480+0000 7fd36b1fc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:59:53.601 INFO:tasks.workunit.client.0.smithi070.stderr: -111> 2024-09-12T00:59:53.480+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.601 INFO:tasks.workunit.client.0.smithi070.stderr: -110> 2024-09-12T00:59:53.480+0000 7fd368501640 10 monclient: get_auth_request con 0x55e1614234f0 auth_method 0 2024-09-12T00:59:53.601 INFO:tasks.workunit.client.0.smithi070.stderr: -109> 2024-09-12T00:59:53.480+0000 7fd36b1fc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:59:53.601 INFO:tasks.workunit.client.0.smithi070.stderr: -108> 2024-09-12T00:59:53.480+0000 7fd36b1fc9c0 20 searching for the correct realm 2024-09-12T00:59:53.601 INFO:tasks.workunit.client.0.smithi070.stderr: -107> 2024-09-12T00:59:53.480+0000 7fd369503640 10 monclient: get_auth_request con 0x55e161428290 auth_method 0 2024-09-12T00:59:53.601 INFO:tasks.workunit.client.0.smithi070.stderr: -106> 2024-09-12T00:59:53.480+0000 7fd368d02640 10 monclient: get_auth_request con 0x7fd3600b8450 auth_method 0 2024-09-12T00:59:53.601 INFO:tasks.workunit.client.0.smithi070.stderr: -105> 2024-09-12T00:59:53.484+0000 7fd368501640 10 monclient: get_auth_request con 0x7fd35808f050 auth_method 0 2024-09-12T00:59:53.601 INFO:tasks.workunit.client.0.smithi070.stderr: -104> 2024-09-12T00:59:53.484+0000 7fd369503640 10 monclient: get_auth_request con 0x7fd35c00ec50 auth_method 0 2024-09-12T00:59:53.601 INFO:tasks.workunit.client.0.smithi070.stderr: -103> 2024-09-12T00:59:53.484+0000 7fd369503640 0 -- 172.21.15.70:0/3605515028 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fd35c00ec50 msgr2=0x7fd35c064ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:59:53.601 INFO:tasks.workunit.client.0.smithi070.stderr: -102> 2024-09-12T00:59:53.484+0000 7fd23e7fc640 1 client.7844.objecter ms_handle_reset 0x7fd35c00ec50 session 0x7fd35c020070 osd.4 2024-09-12T00:59:53.601 INFO:tasks.workunit.client.0.smithi070.stderr: -101> 2024-09-12T00:59:53.484+0000 7fd23e7fc640 10 monclient: _renew_subs 2024-09-12T00:59:53.602 INFO:tasks.workunit.client.0.smithi070.stderr: -100> 2024-09-12T00:59:53.484+0000 7fd23e7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:59:53.602 INFO:tasks.workunit.client.0.smithi070.stderr: -99> 2024-09-12T00:59:53.484+0000 7fd369503640 10 monclient: get_auth_request con 0x7fd234080880 auth_method 0 2024-09-12T00:59:53.602 INFO:tasks.workunit.client.0.smithi070.stderr: -98> 2024-09-12T00:59:53.488+0000 7fd368d02640 10 monclient: get_auth_request con 0x7fd3600d9920 auth_method 0 2024-09-12T00:59:53.602 INFO:tasks.workunit.client.0.smithi070.stderr: -97> 2024-09-12T00:59:53.492+0000 7fd369503640 0 -- 172.21.15.70:0/3605515028 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fd234080880 msgr2=0x7fd234082cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:59:53.602 INFO:tasks.workunit.client.0.smithi070.stderr: -96> 2024-09-12T00:59:53.492+0000 7fd23e7fc640 1 client.7844.objecter ms_handle_reset 0x7fd234080880 session 0x7fd35c020070 osd.4 2024-09-12T00:59:53.602 INFO:tasks.workunit.client.0.smithi070.stderr: -95> 2024-09-12T00:59:53.492+0000 7fd369503640 10 monclient: get_auth_request con 0x7fd35c00ec50 auth_method 0 2024-09-12T00:59:53.602 INFO:tasks.workunit.client.0.smithi070.stderr: -94> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:59:53.602 INFO:tasks.workunit.client.0.smithi070.stderr: -93> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:59:53.602 INFO:tasks.workunit.client.0.smithi070.stderr: -92> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:59:53.602 INFO:tasks.workunit.client.0.smithi070.stderr: -91> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:59:53.602 INFO:tasks.workunit.client.0.smithi070.stderr: -90> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:59:53.602 INFO:tasks.workunit.client.0.smithi070.stderr: -89> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:59:53.602 INFO:tasks.workunit.client.0.smithi070.stderr: -88> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.603 INFO:tasks.workunit.client.0.smithi070.stderr: -87> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.603 INFO:tasks.workunit.client.0.smithi070.stderr: -86> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.603 INFO:tasks.workunit.client.0.smithi070.stderr: -85> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:59:53.603 INFO:tasks.workunit.client.0.smithi070.stderr: -84> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.603 INFO:tasks.workunit.client.0.smithi070.stderr: -83> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:59:53.603 INFO:tasks.workunit.client.0.smithi070.stderr: -82> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 zone default found 2024-09-12T00:59:53.603 INFO:tasks.workunit.client.0.smithi070.stderr: -81> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 4 Realm: () 2024-09-12T00:59:53.603 INFO:tasks.workunit.client.0.smithi070.stderr: -80> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:59:53.603 INFO:tasks.workunit.client.0.smithi070.stderr: -79> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:59:53.603 INFO:tasks.workunit.client.0.smithi070.stderr: -78> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:59:53.603 INFO:tasks.workunit.client.0.smithi070.stderr: -77> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 zonegroup default 2024-09-12T00:59:53.603 INFO:tasks.workunit.client.0.smithi070.stderr: -76> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.603 INFO:tasks.workunit.client.0.smithi070.stderr: -75> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.603 INFO:tasks.workunit.client.0.smithi070.stderr: -74> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.604 INFO:tasks.workunit.client.0.smithi070.stderr: -73> 2024-09-12T00:59:53.504+0000 7fd36b1fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.604 INFO:tasks.workunit.client.0.smithi070.stderr: -72> 2024-09-12T00:59:53.504+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.604 INFO:tasks.workunit.client.0.smithi070.stderr: -71> 2024-09-12T00:59:53.504+0000 7fd36b1fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.604 INFO:tasks.workunit.client.0.smithi070.stderr: -70> 2024-09-12T00:59:53.504+0000 7fd36b1fc9c0 20 started sync module instance, tier type = 2024-09-12T00:59:53.604 INFO:tasks.workunit.client.0.smithi070.stderr: -69> 2024-09-12T00:59:53.504+0000 7fd36b1fc9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:59:53.604 INFO:tasks.workunit.client.0.smithi070.stderr: -68> 2024-09-12T00:59:53.520+0000 7fd36b1fc9c0 20 add_watcher() i=0 2024-09-12T00:59:53.604 INFO:tasks.workunit.client.0.smithi070.stderr: -67> 2024-09-12T00:59:53.520+0000 7fd36b1fc9c0 20 add_watcher() i=1 2024-09-12T00:59:53.604 INFO:tasks.workunit.client.0.smithi070.stderr: -66> 2024-09-12T00:59:53.520+0000 7fd36b1fc9c0 20 add_watcher() i=2 2024-09-12T00:59:53.604 INFO:tasks.workunit.client.0.smithi070.stderr: -65> 2024-09-12T00:59:53.520+0000 7fd36b1fc9c0 20 add_watcher() i=3 2024-09-12T00:59:53.604 INFO:tasks.workunit.client.0.smithi070.stderr: -64> 2024-09-12T00:59:53.520+0000 7fd36b1fc9c0 20 add_watcher() i=4 2024-09-12T00:59:53.604 INFO:tasks.workunit.client.0.smithi070.stderr: -63> 2024-09-12T00:59:53.520+0000 7fd36b1fc9c0 20 add_watcher() i=5 2024-09-12T00:59:53.604 INFO:tasks.workunit.client.0.smithi070.stderr: -62> 2024-09-12T00:59:53.520+0000 7fd36b1fc9c0 20 add_watcher() i=6 2024-09-12T00:59:53.604 INFO:tasks.workunit.client.0.smithi070.stderr: -61> 2024-09-12T00:59:53.520+0000 7fd36b1fc9c0 20 add_watcher() i=7 2024-09-12T00:59:53.605 INFO:tasks.workunit.client.0.smithi070.stderr: -60> 2024-09-12T00:59:53.520+0000 7fd36b1fc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:59:53.605 INFO:tasks.workunit.client.0.smithi070.stderr: -59> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding auth protocol: cephx 2024-09-12T00:59:53.605 INFO:tasks.workunit.client.0.smithi070.stderr: -58> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding auth protocol: cephx 2024-09-12T00:59:53.605 INFO:tasks.workunit.client.0.smithi070.stderr: -57> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding auth protocol: cephx 2024-09-12T00:59:53.605 INFO:tasks.workunit.client.0.smithi070.stderr: -56> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding con mode: secure 2024-09-12T00:59:53.605 INFO:tasks.workunit.client.0.smithi070.stderr: -55> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding con mode: crc 2024-09-12T00:59:53.605 INFO:tasks.workunit.client.0.smithi070.stderr: -54> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding con mode: secure 2024-09-12T00:59:53.605 INFO:tasks.workunit.client.0.smithi070.stderr: -53> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding con mode: crc 2024-09-12T00:59:53.605 INFO:tasks.workunit.client.0.smithi070.stderr: -52> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding con mode: secure 2024-09-12T00:59:53.605 INFO:tasks.workunit.client.0.smithi070.stderr: -51> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding con mode: crc 2024-09-12T00:59:53.605 INFO:tasks.workunit.client.0.smithi070.stderr: -50> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding con mode: crc 2024-09-12T00:59:53.605 INFO:tasks.workunit.client.0.smithi070.stderr: -49> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding con mode: secure 2024-09-12T00:59:53.605 INFO:tasks.workunit.client.0.smithi070.stderr: -48> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding con mode: crc 2024-09-12T00:59:53.605 INFO:tasks.workunit.client.0.smithi070.stderr: -47> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding con mode: secure 2024-09-12T00:59:53.606 INFO:tasks.workunit.client.0.smithi070.stderr: -46> 2024-09-12T00:59:53.524+0000 7fd21efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:59:53.606 INFO:tasks.workunit.client.0.smithi070.stderr: -45> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding con mode: crc 2024-09-12T00:59:53.606 INFO:tasks.workunit.client.0.smithi070.stderr: -44> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding con mode: secure 2024-09-12T00:59:53.606 INFO:tasks.workunit.client.0.smithi070.stderr: -43> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:53.606 INFO:tasks.workunit.client.0.smithi070.stderr: -42> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:59:53.606 INFO:tasks.workunit.client.0.smithi070.stderr: -41> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:59:53.606 INFO:tasks.workunit.client.0.smithi070.stderr: -40> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command cache list hook 0x55e1613f7470 2024-09-12T00:59:53.606 INFO:tasks.workunit.client.0.smithi070.stderr: -39> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command cache inspect hook 0x55e1613f7470 2024-09-12T00:59:53.606 INFO:tasks.workunit.client.0.smithi070.stderr: -38> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command cache erase hook 0x55e1613f7470 2024-09-12T00:59:53.606 INFO:tasks.workunit.client.0.smithi070.stderr: -37> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command cache zap hook 0x55e1613f7470 2024-09-12T00:59:53.606 INFO:tasks.workunit.client.0.smithi070.stderr: -36> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 note: GC not initialized 2024-09-12T00:59:53.606 INFO:tasks.workunit.client.0.smithi070.stderr: -35> 2024-09-12T00:59:53.528+0000 7fd21dfe3640 20 reqs_thread_entry: start 2024-09-12T00:59:53.606 INFO:tasks.workunit.client.0.smithi070.stderr: -34> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command sync trace show hook 0x7fd358010050 2024-09-12T00:59:53.606 INFO:tasks.workunit.client.0.smithi070.stderr: -33> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command sync trace history hook 0x7fd358010050 2024-09-12T00:59:53.607 INFO:tasks.workunit.client.0.smithi070.stderr: -32> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command sync trace active hook 0x7fd358010050 2024-09-12T00:59:53.607 INFO:tasks.workunit.client.0.smithi070.stderr: -31> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command sync trace active_short hook 0x7fd358010050 2024-09-12T00:59:53.607 INFO:tasks.workunit.client.0.smithi070.stderr: -30> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:59:53.607 INFO:tasks.workunit.client.0.smithi070.stderr: -29> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 20 Filter name: none 2024-09-12T00:59:53.607 INFO:tasks.workunit.client.0.smithi070.stderr: -28> 2024-09-12T00:59:53.528+0000 7fd18f7fe640 20 reqs_thread_entry: start 2024-09-12T00:59:53.607 INFO:tasks.workunit.client.0.smithi070.stderr: -27> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:59:53.607 INFO:tasks.workunit.client.0.smithi070.stderr: -26> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.607 INFO:tasks.workunit.client.0.smithi070.stderr: -25> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:59:53.607 INFO:tasks.workunit.client.0.smithi070.stderr: -24> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:59:53.607 INFO:tasks.workunit.client.0.smithi070.stderr: -23> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:59:53.607 INFO:tasks.workunit.client.0.smithi070.stderr: -22> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : miss 2024-09-12T00:59:53.607 INFO:tasks.workunit.client.0.smithi070.stderr: -21> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.607 INFO:tasks.workunit.client.0.smithi070.stderr: -20> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:59:53.607 INFO:tasks.workunit.client.0.smithi070.stderr: -19> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:59:53.608 INFO:tasks.workunit.client.0.smithi070.stderr: -18> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:59:53.608 INFO:tasks.workunit.client.0.smithi070.stderr: -17> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:59:53.608 INFO:tasks.workunit.client.0.smithi070.stderr: -16> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:59:53.608 INFO:tasks.workunit.client.0.smithi070.stderr: -15> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T00:59:53.608 INFO:tasks.workunit.client.0.smithi070.stderr: -14> 2024-09-12T00:59:53.532+0000 7fd36b1fc9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:59:53.608 INFO:tasks.workunit.client.0.smithi070.stderr: -13> 2024-09-12T00:59:53.540+0000 7fd36b1fc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:59:53.608 INFO:tasks.workunit.client.0.smithi070.stderr: -12> 2024-09-12T00:59:53.540+0000 7fd36b1fc9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:59:53.608 INFO:tasks.workunit.client.0.smithi070.stderr: -11> 2024-09-12T00:59:53.540+0000 7fd36b1fc9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:59:53.609 INFO:tasks.workunit.client.0.smithi070.stderr: -10> 2024-09-12T00:59:53.540+0000 7fd36b1fc9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18, ofs0, ns] 2024-09-12T00:59:53.609 INFO:tasks.workunit.client.0.smithi070.stderr: -9> 2024-09-12T00:59:53.540+0000 7fd23ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431648 cookie 94426487769648 notifier 7844 bl.length()=911 2024-09-12T00:59:53.609 INFO:tasks.workunit.client.0.smithi070.stderr: -8> 2024-09-12T00:59:53.540+0000 7fd23ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:59:53.609 INFO:tasks.workunit.client.0.smithi070.stderr: -7> 2024-09-12T00:59:53.540+0000 7fd23ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:59:53.609 INFO:tasks.workunit.client.0.smithi070.stderr: -6> 2024-09-12T00:59:53.540+0000 7fd23ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:59:53.609 INFO:tasks.workunit.client.0.smithi070.stderr: -5> 2024-09-12T00:59:53.540+0000 7fd36b1fc9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_sources= new_sources= 2024-09-12T00:59:53.609 INFO:tasks.workunit.client.0.smithi070.stderr: -4> 2024-09-12T00:59:53.540+0000 7fd36b1fc9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential sources added=[] removed=[] 2024-09-12T00:59:53.609 INFO:tasks.workunit.client.0.smithi070.stderr: -3> 2024-09-12T00:59:53.540+0000 7fd36b1fc9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_dests= new_dests= 2024-09-12T00:59:53.609 INFO:tasks.workunit.client.0.smithi070.stderr: -2> 2024-09-12T00:59:53.540+0000 7fd36b1fc9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential dests added=[] removed=[] 2024-09-12T00:59:53.609 INFO:tasks.workunit.client.0.smithi070.stderr: -1> 2024-09-12T00:59:53.548+0000 7fd36b1fc9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd36b1fc9c0 time 2024-09-12T00:59:53.552386+0000 2024-09-12T00:59:53.609 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:59:53.610 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.610 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:59:53.610 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd36ead62eb] 2024-09-12T00:59:53.610 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd36ead649f] 2024-09-12T00:59:53.610 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e15f1bacc1] 2024-09-12T00:59:53.610 INFO:tasks.workunit.client.0.smithi070.stderr: 4: radosgw-admin(+0x1422aac) [0x55e15fc18aac] 2024-09-12T00:59:53.610 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e15f1cfced] 2024-09-12T00:59:53.610 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:59:53.610 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd36d93cd90] 2024-09-12T00:59:53.610 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:59:53.610 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:59:53.611 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.611 INFO:tasks.workunit.client.0.smithi070.stderr: 0> 2024-09-12T00:59:53.552+0000 7fd36b1fc9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:59:53.611 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7fd36b1fc9c0 thread_name:radosgw-admin 2024-09-12T00:59:53.611 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.611 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:59:53.611 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd36d955520] 2024-09-12T00:59:53.611 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:59:53.611 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:59:53.611 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:59:53.611 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd36ead6345] 2024-09-12T00:59:53.611 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd36ead649f] 2024-09-12T00:59:53.611 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e15f1bacc1] 2024-09-12T00:59:53.611 INFO:tasks.workunit.client.0.smithi070.stderr: 8: radosgw-admin(+0x1422aac) [0x55e15fc18aac] 2024-09-12T00:59:53.612 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e15f1cfced] 2024-09-12T00:59:53.612 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:59:53.612 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd36d93cd90] 2024-09-12T00:59:53.612 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:59:53.612 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:59:53.612 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:59:53.612 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.612 INFO:tasks.workunit.client.0.smithi070.stderr:--- logging levels --- 2024-09-12T00:59:53.612 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 none 2024-09-12T00:59:53.612 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 lockdep 2024-09-12T00:59:53.612 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 context 2024-09-12T00:59:53.612 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 crush 2024-09-12T00:59:53.612 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds 2024-09-12T00:59:53.612 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_balancer 2024-09-12T00:59:53.613 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_locker 2024-09-12T00:59:53.613 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log 2024-09-12T00:59:53.613 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log_expire 2024-09-12T00:59:53.613 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_migrator 2024-09-12T00:59:53.613 INFO:tasks.workunit.client.0.smithi070.stderr: 3/ 5 mds_quiesce 2024-09-12T00:59:53.613 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 buffer 2024-09-12T00:59:53.613 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 timer 2024-09-12T00:59:53.613 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 filer 2024-09-12T00:59:53.613 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 striper 2024-09-12T00:59:53.613 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 objecter 2024-09-12T00:59:53.613 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rados 2024-09-12T00:59:53.613 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd 2024-09-12T00:59:53.613 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_mirror 2024-09-12T00:59:53.614 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_replay 2024-09-12T00:59:53.614 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_pwl 2024-09-12T00:59:53.614 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 journaler 2024-09-12T00:59:53.614 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objectcacher 2024-09-12T00:59:53.614 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:59:53.614 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 client 2024-09-12T00:59:53.614 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 osd 2024-09-12T00:59:53.614 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 optracker 2024-09-12T00:59:53.614 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objclass 2024-09-12T00:59:53.614 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 filestore 2024-09-12T00:59:53.614 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 journal 2024-09-12T00:59:53.614 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 ms 2024-09-12T00:59:53.614 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mon 2024-09-12T00:59:53.614 INFO:tasks.workunit.client.0.smithi070.stderr: 0/10 monc 2024-09-12T00:59:53.615 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 paxos 2024-09-12T00:59:53.615 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 tp 2024-09-12T00:59:53.615 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 auth 2024-09-12T00:59:53.615 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 crypto 2024-09-12T00:59:53.615 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 finisher 2024-09-12T00:59:53.615 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 reserver 2024-09-12T00:59:53.615 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 heartbeatmap 2024-09-12T00:59:53.615 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 perfcounter 2024-09-12T00:59:53.615 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw 2024-09-12T00:59:53.615 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_sync 2024-09-12T00:59:53.616 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_datacache 2024-09-12T00:59:53.616 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_access 2024-09-12T00:59:53.616 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:59:53.616 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_flight 2024-09-12T00:59:53.616 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:59:53.616 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw_notification 2024-09-12T00:59:53.616 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 javaclient 2024-09-12T00:59:53.616 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 asok 2024-09-12T00:59:53.616 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 throttle 2024-09-12T00:59:53.616 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 refs 2024-09-12T00:59:53.616 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 compressor 2024-09-12T00:59:53.616 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluestore 2024-09-12T00:59:53.617 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluefs 2024-09-12T00:59:53.617 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 bdev 2024-09-12T00:59:53.617 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 kstore 2024-09-12T00:59:53.617 INFO:tasks.workunit.client.0.smithi070.stderr: 4/ 5 rocksdb 2024-09-12T00:59:53.617 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 fuse 2024-09-12T00:59:53.617 INFO:tasks.workunit.client.0.smithi070.stderr: 2/ 5 mgr 2024-09-12T00:59:53.617 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mgrc 2024-09-12T00:59:53.617 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 dpdk 2024-09-12T00:59:53.617 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 eventtrace 2024-09-12T00:59:53.617 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 prioritycache 2024-09-12T00:59:53.617 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 test 2024-09-12T00:59:53.617 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:59:53.618 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephsqlite 2024-09-12T00:59:53.618 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:59:53.618 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore 2024-09-12T00:59:53.618 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_onode 2024-09-12T00:59:53.618 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_odata 2024-09-12T00:59:53.618 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_omap 2024-09-12T00:59:53.618 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_tm 2024-09-12T00:59:53.618 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_t 2024-09-12T00:59:53.618 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:59:53.618 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_epm 2024-09-12T00:59:53.618 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_lba 2024-09-12T00:59:53.618 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:59:53.618 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cache 2024-09-12T00:59:53.618 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_journal 2024-09-12T00:59:53.619 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_device 2024-09-12T00:59:53.619 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_backref 2024-09-12T00:59:53.619 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 alienstore 2024-09-12T00:59:53.619 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mclock 2024-09-12T00:59:53.619 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cyanstore 2024-09-12T00:59:53.619 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 ceph_exporter 2024-09-12T00:59:53.619 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 memstore 2024-09-12T00:59:53.619 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 trace 2024-09-12T00:59:53.619 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 ceph_dedup 2024-09-12T00:59:53.619 INFO:tasks.workunit.client.0.smithi070.stderr: -2/-2 (syslog threshold) 2024-09-12T00:59:53.619 INFO:tasks.workunit.client.0.smithi070.stderr: 99/99 (stderr threshold) 2024-09-12T00:59:53.619 INFO:tasks.workunit.client.0.smithi070.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:59:53.619 INFO:tasks.workunit.client.0.smithi070.stderr: 7fd18f7fe640 / http_manager 2024-09-12T00:59:53.620 INFO:tasks.workunit.client.0.smithi070.stderr: 7fd21dfe3640 / http_manager 2024-09-12T00:59:53.620 INFO:tasks.workunit.client.0.smithi070.stderr: 7fd21efe5640 / rgw_dt_lg_renew 2024-09-12T00:59:53.620 INFO:tasks.workunit.client.0.smithi070.stderr: 7fd23e7fc640 / ms_dispatch 2024-09-12T00:59:53.620 INFO:tasks.workunit.client.0.smithi070.stderr: 7fd23ffff640 / io_context_pool 2024-09-12T00:59:53.620 INFO:tasks.workunit.client.0.smithi070.stderr: 7fd24e7fc640 / ms_dispatch 2024-09-12T00:59:53.620 INFO:tasks.workunit.client.0.smithi070.stderr: 7fd25560a640 / ms_dispatch 2024-09-12T00:59:53.620 INFO:tasks.workunit.client.0.smithi070.stderr: 7fd256e0d640 / io_context_pool 2024-09-12T00:59:53.620 INFO:tasks.workunit.client.0.smithi070.stderr: 7fd368501640 / msgr-worker-2 2024-09-12T00:59:53.620 INFO:tasks.workunit.client.0.smithi070.stderr: 7fd368d02640 / msgr-worker-1 2024-09-12T00:59:53.620 INFO:tasks.workunit.client.0.smithi070.stderr: 7fd369503640 / msgr-worker-0 2024-09-12T00:59:53.621 INFO:tasks.workunit.client.0.smithi070.stderr: 7fd369d04640 / io_context_pool 2024-09-12T00:59:53.621 INFO:tasks.workunit.client.0.smithi070.stderr: 7fd36b1fc9c0 / radosgw-admin 2024-09-12T00:59:53.621 INFO:tasks.workunit.client.0.smithi070.stderr: max_recent 500 2024-09-12T00:59:53.621 INFO:tasks.workunit.client.0.smithi070.stderr: max_new 1000 2024-09-12T00:59:53.621 INFO:tasks.workunit.client.0.smithi070.stderr: log_file /var/log/ceph/ceph-client.admin.145089.log 2024-09-12T00:59:53.621 INFO:tasks.workunit.client.0.smithi070.stderr:--- end dump of recent events --- 2024-09-12T00:59:53.622 INFO:tasks.workunit.client.0.smithi070.stderr:--- begin dump of recent events --- 2024-09-12T00:59:53.622 INFO:tasks.workunit.client.0.smithi070.stderr: -499> 2024-09-12T00:59:53.452+0000 7fd368d02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:53.622 INFO:tasks.workunit.client.0.smithi070.stderr: -498> 2024-09-12T00:59:53.452+0000 7fd368501640 10 monclient(hunting): handle_auth_done global_id 8361 payload 274 2024-09-12T00:59:53.622 INFO:tasks.workunit.client.0.smithi070.stderr: -497> 2024-09-12T00:59:53.452+0000 7fd368501640 10 monclient: _finish_hunting 0 2024-09-12T00:59:53.622 INFO:tasks.workunit.client.0.smithi070.stderr: -496> 2024-09-12T00:59:53.452+0000 7fd368501640 1 monclient: found mon.noname-a 2024-09-12T00:59:53.623 INFO:tasks.workunit.client.0.smithi070.stderr: -495> 2024-09-12T00:59:53.452+0000 7fd368501640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:59:53.623 INFO:tasks.workunit.client.0.smithi070.stderr: -494> 2024-09-12T00:59:53.452+0000 7fd256e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:53.623 INFO:tasks.workunit.client.0.smithi070.stderr: -493> 2024-09-12T00:59:53.452+0000 7fd256e0d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:59:53.623 INFO:tasks.workunit.client.0.smithi070.stderr: -492> 2024-09-12T00:59:53.452+0000 7fd256e0d640 10 monclient: dump: 2024-09-12T00:59:53.623 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:53.623 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:53.623 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.624 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.624 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:53.624 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.624 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:53.624 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:53.624 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:53.624 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.625 INFO:tasks.workunit.client.0.smithi070.stderr: -491> 2024-09-12T00:59:53.452+0000 7fd256e0d640 10 monclient: _finish_auth 0 2024-09-12T00:59:53.625 INFO:tasks.workunit.client.0.smithi070.stderr: -490> 2024-09-12T00:59:53.452+0000 7fd256e0d640 10 monclient: _check_auth_tickets 2024-09-12T00:59:53.625 INFO:tasks.workunit.client.0.smithi070.stderr: -489> 2024-09-12T00:59:53.452+0000 7fd256e0d640 10 monclient: handle_config config(0 keys) 2024-09-12T00:59:53.625 INFO:tasks.workunit.client.0.smithi070.stderr: -488> 2024-09-12T00:59:53.452+0000 7fd256e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:53.625 INFO:tasks.workunit.client.0.smithi070.stderr: -487> 2024-09-12T00:59:53.452+0000 7fd256e0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:59:53.625 INFO:tasks.workunit.client.0.smithi070.stderr: -486> 2024-09-12T00:59:53.452+0000 7fd256e0d640 10 monclient: dump: 2024-09-12T00:59:53.625 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:53.625 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:53.626 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.626 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.626 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:53.626 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.626 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:53.627 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:53.627 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:53.627 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.627 INFO:tasks.workunit.client.0.smithi070.stderr: -485> 2024-09-12T00:59:53.452+0000 7fd36b1fc9c0 5 monclient: authenticate success, global_id 8361 2024-09-12T00:59:53.627 INFO:tasks.workunit.client.0.smithi070.stderr: -484> 2024-09-12T00:59:53.452+0000 7fd36b1fc9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:59:53.627 INFO:tasks.workunit.client.0.smithi070.stderr: -483> 2024-09-12T00:59:53.452+0000 7fd36b1fc9c0 4 set_mon_vals no callback set 2024-09-12T00:59:53.627 INFO:tasks.workunit.client.0.smithi070.stderr: -482> 2024-09-12T00:59:53.452+0000 7fd36b1fc9c0 10 monclient: shutdown 2024-09-12T00:59:53.628 INFO:tasks.workunit.client.0.smithi070.stderr: -481> 2024-09-12T00:59:53.452+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) unregister_commands rotate-key 2024-09-12T00:59:53.628 INFO:tasks.workunit.client.0.smithi070.stderr: -480> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient: build_initial_monmap 2024-09-12T00:59:53.628 INFO:tasks.workunit.client.0.smithi070.stderr: -479> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 1 build_initial for_mkfs: 0 2024-09-12T00:59:53.628 INFO:tasks.workunit.client.0.smithi070.stderr: -478> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient: monmap: 2024-09-12T00:59:53.628 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:59:53.628 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:59:53.629 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:59:53.629 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:59:53.629 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:59:53.629 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.629 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:59:53.630 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:59:53.630 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:59:53.630 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.630 INFO:tasks.workunit.client.0.smithi070.stderr: -477> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding auth protocol: cephx 2024-09-12T00:59:53.630 INFO:tasks.workunit.client.0.smithi070.stderr: -476> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding auth protocol: cephx 2024-09-12T00:59:53.630 INFO:tasks.workunit.client.0.smithi070.stderr: -475> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding auth protocol: cephx 2024-09-12T00:59:53.630 INFO:tasks.workunit.client.0.smithi070.stderr: -474> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding con mode: secure 2024-09-12T00:59:53.630 INFO:tasks.workunit.client.0.smithi070.stderr: -473> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding con mode: crc 2024-09-12T00:59:53.630 INFO:tasks.workunit.client.0.smithi070.stderr: -472> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding con mode: secure 2024-09-12T00:59:53.630 INFO:tasks.workunit.client.0.smithi070.stderr: -471> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding con mode: crc 2024-09-12T00:59:53.630 INFO:tasks.workunit.client.0.smithi070.stderr: -470> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding con mode: secure 2024-09-12T00:59:53.630 INFO:tasks.workunit.client.0.smithi070.stderr: -469> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding con mode: crc 2024-09-12T00:59:53.630 INFO:tasks.workunit.client.0.smithi070.stderr: -468> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding con mode: crc 2024-09-12T00:59:53.631 INFO:tasks.workunit.client.0.smithi070.stderr: -467> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding con mode: secure 2024-09-12T00:59:53.631 INFO:tasks.workunit.client.0.smithi070.stderr: -466> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding con mode: crc 2024-09-12T00:59:53.631 INFO:tasks.workunit.client.0.smithi070.stderr: -465> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding con mode: secure 2024-09-12T00:59:53.631 INFO:tasks.workunit.client.0.smithi070.stderr: -464> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding con mode: crc 2024-09-12T00:59:53.631 INFO:tasks.workunit.client.0.smithi070.stderr: -463> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161338da0) adding con mode: secure 2024-09-12T00:59:53.631 INFO:tasks.workunit.client.0.smithi070.stderr: -462> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:53.631 INFO:tasks.workunit.client.0.smithi070.stderr: -461> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 1 librados: starting msgr at 2024-09-12T00:59:53.631 INFO:tasks.workunit.client.0.smithi070.stderr: -460> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 1 librados: starting objecter 2024-09-12T00:59:53.631 INFO:tasks.workunit.client.0.smithi070.stderr: -459> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command objecter_requests hook 0x55e1610f4750 2024-09-12T00:59:53.631 INFO:tasks.workunit.client.0.smithi070.stderr: -458> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 1 librados: setting wanted keys 2024-09-12T00:59:53.631 INFO:tasks.workunit.client.0.smithi070.stderr: -457> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 1 librados: calling monclient init 2024-09-12T00:59:53.631 INFO:tasks.workunit.client.0.smithi070.stderr: -456> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient: init 2024-09-12T00:59:53.631 INFO:tasks.workunit.client.0.smithi070.stderr: -455> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding auth protocol: cephx 2024-09-12T00:59:53.632 INFO:tasks.workunit.client.0.smithi070.stderr: -454> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding auth protocol: cephx 2024-09-12T00:59:53.632 INFO:tasks.workunit.client.0.smithi070.stderr: -453> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding auth protocol: cephx 2024-09-12T00:59:53.632 INFO:tasks.workunit.client.0.smithi070.stderr: -452> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding con mode: secure 2024-09-12T00:59:53.632 INFO:tasks.workunit.client.0.smithi070.stderr: -451> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding con mode: crc 2024-09-12T00:59:53.632 INFO:tasks.workunit.client.0.smithi070.stderr: -450> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding con mode: secure 2024-09-12T00:59:53.632 INFO:tasks.workunit.client.0.smithi070.stderr: -449> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding con mode: crc 2024-09-12T00:59:53.632 INFO:tasks.workunit.client.0.smithi070.stderr: -448> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding con mode: secure 2024-09-12T00:59:53.632 INFO:tasks.workunit.client.0.smithi070.stderr: -447> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding con mode: crc 2024-09-12T00:59:53.632 INFO:tasks.workunit.client.0.smithi070.stderr: -446> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding con mode: crc 2024-09-12T00:59:53.632 INFO:tasks.workunit.client.0.smithi070.stderr: -445> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding con mode: secure 2024-09-12T00:59:53.632 INFO:tasks.workunit.client.0.smithi070.stderr: -444> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding con mode: crc 2024-09-12T00:59:53.632 INFO:tasks.workunit.client.0.smithi070.stderr: -443> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding con mode: secure 2024-09-12T00:59:53.632 INFO:tasks.workunit.client.0.smithi070.stderr: -442> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding con mode: crc 2024-09-12T00:59:53.633 INFO:tasks.workunit.client.0.smithi070.stderr: -441> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161332e40) adding con mode: secure 2024-09-12T00:59:53.633 INFO:tasks.workunit.client.0.smithi070.stderr: -440> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:53.633 INFO:tasks.workunit.client.0.smithi070.stderr: -439> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:53.633 INFO:tasks.workunit.client.0.smithi070.stderr: -438> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command rotate-key hook 0x55e161332f88 2024-09-12T00:59:53.633 INFO:tasks.workunit.client.0.smithi070.stderr: -437> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:59:53.633 INFO:tasks.workunit.client.0.smithi070.stderr: -436> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:59:53.633 INFO:tasks.workunit.client.0.smithi070.stderr: -435> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient(hunting): picked mon.noname-a con 0x55e1611e34e0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:59:53.633 INFO:tasks.workunit.client.0.smithi070.stderr: -434> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient(hunting): picked mon.noname-b con 0x55e1611e38c0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:59:53.633 INFO:tasks.workunit.client.0.smithi070.stderr: -433> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient(hunting): picked mon.noname-c con 0x55e1611ef330 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:59:53.633 INFO:tasks.workunit.client.0.smithi070.stderr: -432> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:53.633 INFO:tasks.workunit.client.0.smithi070.stderr: -431> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:53.633 INFO:tasks.workunit.client.0.smithi070.stderr: -430> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:53.634 INFO:tasks.workunit.client.0.smithi070.stderr: -429> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:59:53.634 INFO:tasks.workunit.client.0.smithi070.stderr: -428> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient(hunting): authenticate will time out at 2443.905337s 2024-09-12T00:59:53.634 INFO:tasks.workunit.client.0.smithi070.stderr: -427> 2024-09-12T00:59:53.456+0000 7fd368d02640 10 monclient(hunting): get_auth_request con 0x55e1611e34e0 auth_method 0 2024-09-12T00:59:53.634 INFO:tasks.workunit.client.0.smithi070.stderr: -426> 2024-09-12T00:59:53.456+0000 7fd368d02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:53.634 INFO:tasks.workunit.client.0.smithi070.stderr: -425> 2024-09-12T00:59:53.456+0000 7fd368d02640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:53.634 INFO:tasks.workunit.client.0.smithi070.stderr: -424> 2024-09-12T00:59:53.456+0000 7fd368d02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:53.634 INFO:tasks.workunit.client.0.smithi070.stderr: -423> 2024-09-12T00:59:53.456+0000 7fd369503640 10 monclient(hunting): get_auth_request con 0x55e1611ef330 auth_method 0 2024-09-12T00:59:53.634 INFO:tasks.workunit.client.0.smithi070.stderr: -422> 2024-09-12T00:59:53.456+0000 7fd369503640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:53.634 INFO:tasks.workunit.client.0.smithi070.stderr: -421> 2024-09-12T00:59:53.456+0000 7fd369503640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:53.634 INFO:tasks.workunit.client.0.smithi070.stderr: -420> 2024-09-12T00:59:53.456+0000 7fd369503640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:53.634 INFO:tasks.workunit.client.0.smithi070.stderr: -419> 2024-09-12T00:59:53.456+0000 7fd368d02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:53.634 INFO:tasks.workunit.client.0.smithi070.stderr: -418> 2024-09-12T00:59:53.456+0000 7fd368d02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:53.634 INFO:tasks.workunit.client.0.smithi070.stderr: -417> 2024-09-12T00:59:53.456+0000 7fd368d02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:53.635 INFO:tasks.workunit.client.0.smithi070.stderr: -416> 2024-09-12T00:59:53.456+0000 7fd369503640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:53.635 INFO:tasks.workunit.client.0.smithi070.stderr: -415> 2024-09-12T00:59:53.456+0000 7fd369503640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:53.635 INFO:tasks.workunit.client.0.smithi070.stderr: -414> 2024-09-12T00:59:53.456+0000 7fd369503640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:53.635 INFO:tasks.workunit.client.0.smithi070.stderr: -413> 2024-09-12T00:59:53.456+0000 7fd368501640 10 monclient(hunting): get_auth_request con 0x55e1611e38c0 auth_method 0 2024-09-12T00:59:53.635 INFO:tasks.workunit.client.0.smithi070.stderr: -412> 2024-09-12T00:59:53.456+0000 7fd368501640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:53.635 INFO:tasks.workunit.client.0.smithi070.stderr: -411> 2024-09-12T00:59:53.456+0000 7fd368501640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:53.635 INFO:tasks.workunit.client.0.smithi070.stderr: -410> 2024-09-12T00:59:53.456+0000 7fd368501640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:53.635 INFO:tasks.workunit.client.0.smithi070.stderr: -409> 2024-09-12T00:59:53.456+0000 7fd368d02640 10 monclient(hunting): handle_auth_done global_id 8364 payload 824 2024-09-12T00:59:53.635 INFO:tasks.workunit.client.0.smithi070.stderr: -408> 2024-09-12T00:59:53.456+0000 7fd368d02640 10 monclient: _finish_hunting 0 2024-09-12T00:59:53.635 INFO:tasks.workunit.client.0.smithi070.stderr: -407> 2024-09-12T00:59:53.456+0000 7fd368d02640 1 monclient: found mon.noname-a 2024-09-12T00:59:53.635 INFO:tasks.workunit.client.0.smithi070.stderr: -406> 2024-09-12T00:59:53.456+0000 7fd368d02640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T00:59:53.635 INFO:tasks.workunit.client.0.smithi070.stderr: -405> 2024-09-12T00:59:53.456+0000 7fd25560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:53.635 INFO:tasks.workunit.client.0.smithi070.stderr: -404> 2024-09-12T00:59:53.456+0000 7fd25560a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:59:53.635 INFO:tasks.workunit.client.0.smithi070.stderr: -403> 2024-09-12T00:59:53.456+0000 7fd25560a640 10 monclient: dump: 2024-09-12T00:59:53.636 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:53.636 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:53.636 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.636 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.636 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:53.636 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.636 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:53.636 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:53.636 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:53.636 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.636 INFO:tasks.workunit.client.0.smithi070.stderr: -402> 2024-09-12T00:59:53.456+0000 7fd25560a640 10 monclient: _finish_auth 0 2024-09-12T00:59:53.636 INFO:tasks.workunit.client.0.smithi070.stderr: -401> 2024-09-12T00:59:53.456+0000 7fd25560a640 10 monclient: _check_auth_tickets 2024-09-12T00:59:53.637 INFO:tasks.workunit.client.0.smithi070.stderr: -400> 2024-09-12T00:59:53.456+0000 7fd25560a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:59:53.637 INFO:tasks.workunit.client.0.smithi070.stderr: -399> 2024-09-12T00:59:53.456+0000 7fd25560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:53.637 INFO:tasks.workunit.client.0.smithi070.stderr: -398> 2024-09-12T00:59:53.456+0000 7fd25560a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:59:53.637 INFO:tasks.workunit.client.0.smithi070.stderr: -397> 2024-09-12T00:59:53.456+0000 7fd25560a640 10 monclient: dump: 2024-09-12T00:59:53.637 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:53.637 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:53.637 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.637 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.637 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:53.637 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.637 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:53.637 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:53.637 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:53.637 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.638 INFO:tasks.workunit.client.0.smithi070.stderr: -396> 2024-09-12T00:59:53.456+0000 7fd256e0d640 4 set_mon_vals no callback set 2024-09-12T00:59:53.638 INFO:tasks.workunit.client.0.smithi070.stderr: -395> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 5 monclient: authenticate success, global_id 8364 2024-09-12T00:59:53.638 INFO:tasks.workunit.client.0.smithi070.stderr: -394> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient: _renew_subs 2024-09-12T00:59:53.638 INFO:tasks.workunit.client.0.smithi070.stderr: -393> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:59:53.638 INFO:tasks.workunit.client.0.smithi070.stderr: -392> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient: _renew_subs 2024-09-12T00:59:53.638 INFO:tasks.workunit.client.0.smithi070.stderr: -391> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T00:59:53.638 INFO:tasks.workunit.client.0.smithi070.stderr: -390> 2024-09-12T00:59:53.456+0000 7fd36b1fc9c0 1 librados: init done 2024-09-12T00:59:53.638 INFO:tasks.workunit.client.0.smithi070.stderr: -389> 2024-09-12T00:59:53.460+0000 7fd25560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:59:53.638 INFO:tasks.workunit.client.0.smithi070.stderr: -388> 2024-09-12T00:59:53.460+0000 7fd25560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:59:53.638 INFO:tasks.workunit.client.0.smithi070.stderr: -387> 2024-09-12T00:59:53.460+0000 7fd25560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:59:53.638 INFO:tasks.workunit.client.0.smithi070.stderr: -386> 2024-09-12T00:59:53.460+0000 7fd368501640 10 monclient: get_auth_request con 0x7fd250070b10 auth_method 0 2024-09-12T00:59:53.638 INFO:tasks.workunit.client.0.smithi070.stderr: -385> 2024-09-12T00:59:53.460+0000 7fd369503640 10 monclient: get_auth_request con 0x55e16135aa90 auth_method 0 2024-09-12T00:59:53.638 INFO:tasks.workunit.client.0.smithi070.stderr: -384> 2024-09-12T00:59:53.460+0000 7fd368d02640 10 monclient: get_auth_request con 0x55e16137d860 auth_method 0 2024-09-12T00:59:53.638 INFO:tasks.workunit.client.0.smithi070.stderr: -383> 2024-09-12T00:59:53.464+0000 7fd368501640 10 monclient: get_auth_request con 0x55e161381c90 auth_method 0 2024-09-12T00:59:53.639 INFO:tasks.workunit.client.0.smithi070.stderr: -382> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient: build_initial_monmap 2024-09-12T00:59:53.639 INFO:tasks.workunit.client.0.smithi070.stderr: -381> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 1 build_initial for_mkfs: 0 2024-09-12T00:59:53.639 INFO:tasks.workunit.client.0.smithi070.stderr: -380> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient: monmap: 2024-09-12T00:59:53.639 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:59:53.639 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:59:53.639 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:59:53.639 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:59:53.639 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:59:53.639 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.639 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:59:53.639 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:59:53.639 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:59:53.639 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.639 INFO:tasks.workunit.client.0.smithi070.stderr: -379> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding auth protocol: cephx 2024-09-12T00:59:53.640 INFO:tasks.workunit.client.0.smithi070.stderr: -378> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding auth protocol: cephx 2024-09-12T00:59:53.640 INFO:tasks.workunit.client.0.smithi070.stderr: -377> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding auth protocol: cephx 2024-09-12T00:59:53.640 INFO:tasks.workunit.client.0.smithi070.stderr: -376> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding con mode: secure 2024-09-12T00:59:53.640 INFO:tasks.workunit.client.0.smithi070.stderr: -375> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding con mode: crc 2024-09-12T00:59:53.640 INFO:tasks.workunit.client.0.smithi070.stderr: -374> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding con mode: secure 2024-09-12T00:59:53.640 INFO:tasks.workunit.client.0.smithi070.stderr: -373> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding con mode: crc 2024-09-12T00:59:53.640 INFO:tasks.workunit.client.0.smithi070.stderr: -372> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding con mode: secure 2024-09-12T00:59:53.640 INFO:tasks.workunit.client.0.smithi070.stderr: -371> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding con mode: crc 2024-09-12T00:59:53.640 INFO:tasks.workunit.client.0.smithi070.stderr: -370> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding con mode: crc 2024-09-12T00:59:53.640 INFO:tasks.workunit.client.0.smithi070.stderr: -369> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding con mode: secure 2024-09-12T00:59:53.640 INFO:tasks.workunit.client.0.smithi070.stderr: -368> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding con mode: crc 2024-09-12T00:59:53.640 INFO:tasks.workunit.client.0.smithi070.stderr: -367> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding con mode: secure 2024-09-12T00:59:53.641 INFO:tasks.workunit.client.0.smithi070.stderr: -366> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding con mode: crc 2024-09-12T00:59:53.641 INFO:tasks.workunit.client.0.smithi070.stderr: -365> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161386b50) adding con mode: secure 2024-09-12T00:59:53.641 INFO:tasks.workunit.client.0.smithi070.stderr: -364> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:53.641 INFO:tasks.workunit.client.0.smithi070.stderr: -363> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command objecter_requests cmddesc objecter_requests hook 0x55e16138a500 EEXIST 2024-09-12T00:59:53.641 INFO:tasks.workunit.client.0.smithi070.stderr: -362> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient: init 2024-09-12T00:59:53.641 INFO:tasks.workunit.client.0.smithi070.stderr: -361> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding auth protocol: cephx 2024-09-12T00:59:53.641 INFO:tasks.workunit.client.0.smithi070.stderr: -360> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding auth protocol: cephx 2024-09-12T00:59:53.641 INFO:tasks.workunit.client.0.smithi070.stderr: -359> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding auth protocol: cephx 2024-09-12T00:59:53.641 INFO:tasks.workunit.client.0.smithi070.stderr: -358> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding con mode: secure 2024-09-12T00:59:53.641 INFO:tasks.workunit.client.0.smithi070.stderr: -357> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding con mode: crc 2024-09-12T00:59:53.641 INFO:tasks.workunit.client.0.smithi070.stderr: -356> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding con mode: secure 2024-09-12T00:59:53.641 INFO:tasks.workunit.client.0.smithi070.stderr: -355> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding con mode: crc 2024-09-12T00:59:53.641 INFO:tasks.workunit.client.0.smithi070.stderr: -354> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding con mode: secure 2024-09-12T00:59:53.642 INFO:tasks.workunit.client.0.smithi070.stderr: -353> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding con mode: crc 2024-09-12T00:59:53.642 INFO:tasks.workunit.client.0.smithi070.stderr: -352> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding con mode: crc 2024-09-12T00:59:53.642 INFO:tasks.workunit.client.0.smithi070.stderr: -351> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding con mode: secure 2024-09-12T00:59:53.642 INFO:tasks.workunit.client.0.smithi070.stderr: -350> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding con mode: crc 2024-09-12T00:59:53.642 INFO:tasks.workunit.client.0.smithi070.stderr: -349> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding con mode: secure 2024-09-12T00:59:53.642 INFO:tasks.workunit.client.0.smithi070.stderr: -348> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding con mode: crc 2024-09-12T00:59:53.642 INFO:tasks.workunit.client.0.smithi070.stderr: -347> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e161385228) adding con mode: secure 2024-09-12T00:59:53.642 INFO:tasks.workunit.client.0.smithi070.stderr: -346> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:53.642 INFO:tasks.workunit.client.0.smithi070.stderr: -345> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:53.642 INFO:tasks.workunit.client.0.smithi070.stderr: -344> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command rotate-key cmddesc rotate-key hook 0x55e161385370 EEXIST 2024-09-12T00:59:53.642 INFO:tasks.workunit.client.0.smithi070.stderr: -343> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:59:53.642 INFO:tasks.workunit.client.0.smithi070.stderr: -342> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:59:53.643 INFO:tasks.workunit.client.0.smithi070.stderr: -341> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient(hunting): picked mon.noname-a con 0x55e1613ae6b0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:59:53.643 INFO:tasks.workunit.client.0.smithi070.stderr: -340> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient(hunting): picked mon.noname-c con 0x55e1613adfe0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:59:53.643 INFO:tasks.workunit.client.0.smithi070.stderr: -339> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient(hunting): picked mon.noname-b con 0x55e1613ac9c0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:59:53.643 INFO:tasks.workunit.client.0.smithi070.stderr: -338> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:53.643 INFO:tasks.workunit.client.0.smithi070.stderr: -337> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:53.643 INFO:tasks.workunit.client.0.smithi070.stderr: -336> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:53.643 INFO:tasks.workunit.client.0.smithi070.stderr: -335> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:59:53.643 INFO:tasks.workunit.client.0.smithi070.stderr: -334> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient(hunting): authenticate will time out at 2443.914998s 2024-09-12T00:59:53.643 INFO:tasks.workunit.client.0.smithi070.stderr: -333> 2024-09-12T00:59:53.464+0000 7fd368501640 10 monclient(hunting): get_auth_request con 0x55e1613adfe0 auth_method 0 2024-09-12T00:59:53.643 INFO:tasks.workunit.client.0.smithi070.stderr: -332> 2024-09-12T00:59:53.464+0000 7fd368501640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:53.643 INFO:tasks.workunit.client.0.smithi070.stderr: -331> 2024-09-12T00:59:53.464+0000 7fd368501640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:53.643 INFO:tasks.workunit.client.0.smithi070.stderr: -330> 2024-09-12T00:59:53.464+0000 7fd368501640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:53.643 INFO:tasks.workunit.client.0.smithi070.stderr: -329> 2024-09-12T00:59:53.464+0000 7fd368d02640 10 monclient(hunting): get_auth_request con 0x55e1613ae6b0 auth_method 0 2024-09-12T00:59:53.644 INFO:tasks.workunit.client.0.smithi070.stderr: -328> 2024-09-12T00:59:53.464+0000 7fd368d02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:53.644 INFO:tasks.workunit.client.0.smithi070.stderr: -327> 2024-09-12T00:59:53.464+0000 7fd368d02640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:53.644 INFO:tasks.workunit.client.0.smithi070.stderr: -326> 2024-09-12T00:59:53.464+0000 7fd368d02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:53.644 INFO:tasks.workunit.client.0.smithi070.stderr: -325> 2024-09-12T00:59:53.464+0000 7fd368501640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:53.644 INFO:tasks.workunit.client.0.smithi070.stderr: -324> 2024-09-12T00:59:53.464+0000 7fd368501640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:53.644 INFO:tasks.workunit.client.0.smithi070.stderr: -323> 2024-09-12T00:59:53.464+0000 7fd368501640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:53.644 INFO:tasks.workunit.client.0.smithi070.stderr: -322> 2024-09-12T00:59:53.464+0000 7fd368d02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:53.644 INFO:tasks.workunit.client.0.smithi070.stderr: -321> 2024-09-12T00:59:53.464+0000 7fd368d02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:53.644 INFO:tasks.workunit.client.0.smithi070.stderr: -320> 2024-09-12T00:59:53.464+0000 7fd368d02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:53.644 INFO:tasks.workunit.client.0.smithi070.stderr: -319> 2024-09-12T00:59:53.464+0000 7fd368501640 10 monclient(hunting): handle_auth_done global_id 7838 payload 824 2024-09-12T00:59:53.644 INFO:tasks.workunit.client.0.smithi070.stderr: -318> 2024-09-12T00:59:53.464+0000 7fd368501640 10 monclient: _finish_hunting 0 2024-09-12T00:59:53.644 INFO:tasks.workunit.client.0.smithi070.stderr: -317> 2024-09-12T00:59:53.464+0000 7fd368501640 1 monclient: found mon.noname-c 2024-09-12T00:59:53.645 INFO:tasks.workunit.client.0.smithi070.stderr: -316> 2024-09-12T00:59:53.464+0000 7fd368501640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:59:53.645 INFO:tasks.workunit.client.0.smithi070.stderr: -315> 2024-09-12T00:59:53.464+0000 7fd369503640 10 monclient: get_auth_request con 0x55e1613ac9c0 auth_method 0 2024-09-12T00:59:53.645 INFO:tasks.workunit.client.0.smithi070.stderr: -314> 2024-09-12T00:59:53.464+0000 7fd24e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:53.645 INFO:tasks.workunit.client.0.smithi070.stderr: -313> 2024-09-12T00:59:53.464+0000 7fd24e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:59:53.645 INFO:tasks.workunit.client.0.smithi070.stderr: -312> 2024-09-12T00:59:53.464+0000 7fd24e7fc640 10 monclient: dump: 2024-09-12T00:59:53.645 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:53.645 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:53.645 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.646 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.646 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:53.646 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.646 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:53.646 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:53.646 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:53.646 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.646 INFO:tasks.workunit.client.0.smithi070.stderr: -311> 2024-09-12T00:59:53.464+0000 7fd24e7fc640 10 monclient: _finish_auth 0 2024-09-12T00:59:53.646 INFO:tasks.workunit.client.0.smithi070.stderr: -310> 2024-09-12T00:59:53.464+0000 7fd24e7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:59:53.646 INFO:tasks.workunit.client.0.smithi070.stderr: -309> 2024-09-12T00:59:53.464+0000 7fd24e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:59:53.646 INFO:tasks.workunit.client.0.smithi070.stderr: -308> 2024-09-12T00:59:53.464+0000 7fd24e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:53.646 INFO:tasks.workunit.client.0.smithi070.stderr: -307> 2024-09-12T00:59:53.464+0000 7fd24e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:59:53.646 INFO:tasks.workunit.client.0.smithi070.stderr: -306> 2024-09-12T00:59:53.464+0000 7fd24e7fc640 10 monclient: dump: 2024-09-12T00:59:53.647 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:53.647 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:53.647 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.647 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.647 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:53.647 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.647 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:53.647 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:53.647 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:53.647 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.647 INFO:tasks.workunit.client.0.smithi070.stderr: -305> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 5 monclient: authenticate success, global_id 7838 2024-09-12T00:59:53.647 INFO:tasks.workunit.client.0.smithi070.stderr: -304> 2024-09-12T00:59:53.464+0000 7fd369d04640 4 set_mon_vals no callback set 2024-09-12T00:59:53.647 INFO:tasks.workunit.client.0.smithi070.stderr: -303> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient: _renew_subs 2024-09-12T00:59:53.647 INFO:tasks.workunit.client.0.smithi070.stderr: -302> 2024-09-12T00:59:53.464+0000 7fd36b1fc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:59:53.648 INFO:tasks.workunit.client.0.smithi070.stderr: -301> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient: _renew_subs 2024-09-12T00:59:53.648 INFO:tasks.workunit.client.0.smithi070.stderr: -300> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:59:53.648 INFO:tasks.workunit.client.0.smithi070.stderr: -299> 2024-09-12T00:59:53.468+0000 7fd24e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:59:53.648 INFO:tasks.workunit.client.0.smithi070.stderr: -298> 2024-09-12T00:59:53.468+0000 7fd24e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:59:53.648 INFO:tasks.workunit.client.0.smithi070.stderr: -297> 2024-09-12T00:59:53.468+0000 7fd24e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:59:53.648 INFO:tasks.workunit.client.0.smithi070.stderr: -296> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient: get_monmap_and_config 2024-09-12T00:59:53.648 INFO:tasks.workunit.client.0.smithi070.stderr: -295> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient: build_initial_monmap 2024-09-12T00:59:53.648 INFO:tasks.workunit.client.0.smithi070.stderr: -294> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 1 build_initial for_mkfs: 0 2024-09-12T00:59:53.648 INFO:tasks.workunit.client.0.smithi070.stderr: -293> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient: monmap: 2024-09-12T00:59:53.648 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:59:53.648 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:59:53.648 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:59:53.649 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:59:53.649 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:59:53.649 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.649 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:59:53.649 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:59:53.649 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:59:53.649 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.649 INFO:tasks.workunit.client.0.smithi070.stderr: -292> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding auth protocol: cephx 2024-09-12T00:59:53.649 INFO:tasks.workunit.client.0.smithi070.stderr: -291> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding auth protocol: cephx 2024-09-12T00:59:53.649 INFO:tasks.workunit.client.0.smithi070.stderr: -290> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding auth protocol: cephx 2024-09-12T00:59:53.649 INFO:tasks.workunit.client.0.smithi070.stderr: -289> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding con mode: secure 2024-09-12T00:59:53.649 INFO:tasks.workunit.client.0.smithi070.stderr: -288> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding con mode: crc 2024-09-12T00:59:53.649 INFO:tasks.workunit.client.0.smithi070.stderr: -287> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding con mode: secure 2024-09-12T00:59:53.650 INFO:tasks.workunit.client.0.smithi070.stderr: -286> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding con mode: crc 2024-09-12T00:59:53.650 INFO:tasks.workunit.client.0.smithi070.stderr: -285> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding con mode: secure 2024-09-12T00:59:53.650 INFO:tasks.workunit.client.0.smithi070.stderr: -284> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding con mode: crc 2024-09-12T00:59:53.650 INFO:tasks.workunit.client.0.smithi070.stderr: -283> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding con mode: crc 2024-09-12T00:59:53.650 INFO:tasks.workunit.client.0.smithi070.stderr: -282> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding con mode: secure 2024-09-12T00:59:53.650 INFO:tasks.workunit.client.0.smithi070.stderr: -281> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding con mode: crc 2024-09-12T00:59:53.650 INFO:tasks.workunit.client.0.smithi070.stderr: -280> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding con mode: secure 2024-09-12T00:59:53.650 INFO:tasks.workunit.client.0.smithi070.stderr: -279> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding con mode: crc 2024-09-12T00:59:53.650 INFO:tasks.workunit.client.0.smithi070.stderr: -278> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613ce0a0) adding con mode: secure 2024-09-12T00:59:53.650 INFO:tasks.workunit.client.0.smithi070.stderr: -277> 2024-09-12T00:59:53.468+0000 7fd368d02640 10 monclient: get_auth_request con 0x7fd240070a20 auth_method 0 2024-09-12T00:59:53.650 INFO:tasks.workunit.client.0.smithi070.stderr: -276> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:53.650 INFO:tasks.workunit.client.0.smithi070.stderr: -275> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient: init 2024-09-12T00:59:53.650 INFO:tasks.workunit.client.0.smithi070.stderr: -274> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding auth protocol: cephx 2024-09-12T00:59:53.650 INFO:tasks.workunit.client.0.smithi070.stderr: -273> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding auth protocol: cephx 2024-09-12T00:59:53.651 INFO:tasks.workunit.client.0.smithi070.stderr: -272> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding auth protocol: cephx 2024-09-12T00:59:53.651 INFO:tasks.workunit.client.0.smithi070.stderr: -271> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding con mode: secure 2024-09-12T00:59:53.651 INFO:tasks.workunit.client.0.smithi070.stderr: -270> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding con mode: crc 2024-09-12T00:59:53.651 INFO:tasks.workunit.client.0.smithi070.stderr: -269> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding con mode: secure 2024-09-12T00:59:53.651 INFO:tasks.workunit.client.0.smithi070.stderr: -268> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding con mode: crc 2024-09-12T00:59:53.651 INFO:tasks.workunit.client.0.smithi070.stderr: -267> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding con mode: secure 2024-09-12T00:59:53.651 INFO:tasks.workunit.client.0.smithi070.stderr: -266> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding con mode: crc 2024-09-12T00:59:53.651 INFO:tasks.workunit.client.0.smithi070.stderr: -265> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding con mode: crc 2024-09-12T00:59:53.651 INFO:tasks.workunit.client.0.smithi070.stderr: -264> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding con mode: secure 2024-09-12T00:59:53.651 INFO:tasks.workunit.client.0.smithi070.stderr: -263> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding con mode: crc 2024-09-12T00:59:53.651 INFO:tasks.workunit.client.0.smithi070.stderr: -262> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding con mode: secure 2024-09-12T00:59:53.651 INFO:tasks.workunit.client.0.smithi070.stderr: -261> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding con mode: crc 2024-09-12T00:59:53.652 INFO:tasks.workunit.client.0.smithi070.stderr: -260> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770320) adding con mode: secure 2024-09-12T00:59:53.652 INFO:tasks.workunit.client.0.smithi070.stderr: -259> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:53.652 INFO:tasks.workunit.client.0.smithi070.stderr: -258> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:53.652 INFO:tasks.workunit.client.0.smithi070.stderr: -257> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd6b770468 EEXIST 2024-09-12T00:59:53.652 INFO:tasks.workunit.client.0.smithi070.stderr: -256> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:59:53.652 INFO:tasks.workunit.client.0.smithi070.stderr: -255> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:59:53.652 INFO:tasks.workunit.client.0.smithi070.stderr: -254> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient(hunting): picked mon.noname-b con 0x55e1614025a0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:59:53.652 INFO:tasks.workunit.client.0.smithi070.stderr: -253> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient(hunting): picked mon.noname-c con 0x55e1613fd990 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:59:53.652 INFO:tasks.workunit.client.0.smithi070.stderr: -252> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient(hunting): picked mon.noname-a con 0x55e1613fe310 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:59:53.652 INFO:tasks.workunit.client.0.smithi070.stderr: -251> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:53.652 INFO:tasks.workunit.client.0.smithi070.stderr: -250> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:53.652 INFO:tasks.workunit.client.0.smithi070.stderr: -249> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:53.652 INFO:tasks.workunit.client.0.smithi070.stderr: -248> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:59:53.652 INFO:tasks.workunit.client.0.smithi070.stderr: -247> 2024-09-12T00:59:53.468+0000 7fd36b1fc9c0 10 monclient(hunting): authenticate will time out at 2443.919323s 2024-09-12T00:59:53.653 INFO:tasks.workunit.client.0.smithi070.stderr: -246> 2024-09-12T00:59:53.468+0000 7fd369503640 10 monclient(hunting): get_auth_request con 0x55e1613fe310 auth_method 0 2024-09-12T00:59:53.653 INFO:tasks.workunit.client.0.smithi070.stderr: -245> 2024-09-12T00:59:53.468+0000 7fd369503640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:53.653 INFO:tasks.workunit.client.0.smithi070.stderr: -244> 2024-09-12T00:59:53.468+0000 7fd369503640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:53.653 INFO:tasks.workunit.client.0.smithi070.stderr: -243> 2024-09-12T00:59:53.468+0000 7fd369503640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:53.653 INFO:tasks.workunit.client.0.smithi070.stderr: -242> 2024-09-12T00:59:53.468+0000 7fd368501640 10 monclient(hunting): get_auth_request con 0x55e1613fd990 auth_method 0 2024-09-12T00:59:53.653 INFO:tasks.workunit.client.0.smithi070.stderr: -241> 2024-09-12T00:59:53.468+0000 7fd368501640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:53.653 INFO:tasks.workunit.client.0.smithi070.stderr: -240> 2024-09-12T00:59:53.468+0000 7fd368501640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:53.653 INFO:tasks.workunit.client.0.smithi070.stderr: -239> 2024-09-12T00:59:53.468+0000 7fd368501640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:53.653 INFO:tasks.workunit.client.0.smithi070.stderr: -238> 2024-09-12T00:59:53.468+0000 7fd368501640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:53.653 INFO:tasks.workunit.client.0.smithi070.stderr: -237> 2024-09-12T00:59:53.468+0000 7fd368501640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:53.653 INFO:tasks.workunit.client.0.smithi070.stderr: -236> 2024-09-12T00:59:53.468+0000 7fd368501640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:53.653 INFO:tasks.workunit.client.0.smithi070.stderr: -235> 2024-09-12T00:59:53.468+0000 7fd369503640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:53.653 INFO:tasks.workunit.client.0.smithi070.stderr: -234> 2024-09-12T00:59:53.468+0000 7fd369503640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:53.654 INFO:tasks.workunit.client.0.smithi070.stderr: -233> 2024-09-12T00:59:53.468+0000 7fd369503640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:53.654 INFO:tasks.workunit.client.0.smithi070.stderr: -232> 2024-09-12T00:59:53.468+0000 7fd368501640 10 monclient(hunting): handle_auth_done global_id 7841 payload 274 2024-09-12T00:59:53.654 INFO:tasks.workunit.client.0.smithi070.stderr: -231> 2024-09-12T00:59:53.468+0000 7fd368501640 10 monclient: _finish_hunting 0 2024-09-12T00:59:53.654 INFO:tasks.workunit.client.0.smithi070.stderr: -230> 2024-09-12T00:59:53.468+0000 7fd368501640 1 monclient: found mon.noname-c 2024-09-12T00:59:53.654 INFO:tasks.workunit.client.0.smithi070.stderr: -229> 2024-09-12T00:59:53.468+0000 7fd368501640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:59:53.654 INFO:tasks.workunit.client.0.smithi070.stderr: -228> 2024-09-12T00:59:53.472+0000 7fd23ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:53.654 INFO:tasks.workunit.client.0.smithi070.stderr: -227> 2024-09-12T00:59:53.472+0000 7fd23ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:59:53.654 INFO:tasks.workunit.client.0.smithi070.stderr: -226> 2024-09-12T00:59:53.472+0000 7fd23ffff640 10 monclient: dump: 2024-09-12T00:59:53.654 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:53.654 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:53.654 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.654 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.654 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:53.655 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.655 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:53.655 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:53.655 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:53.655 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.655 INFO:tasks.workunit.client.0.smithi070.stderr: -225> 2024-09-12T00:59:53.472+0000 7fd23ffff640 10 monclient: _finish_auth 0 2024-09-12T00:59:53.655 INFO:tasks.workunit.client.0.smithi070.stderr: -224> 2024-09-12T00:59:53.472+0000 7fd23ffff640 10 monclient: _check_auth_tickets 2024-09-12T00:59:53.655 INFO:tasks.workunit.client.0.smithi070.stderr: -223> 2024-09-12T00:59:53.472+0000 7fd23ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:59:53.655 INFO:tasks.workunit.client.0.smithi070.stderr: -222> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 monclient: authenticate success, global_id 7841 2024-09-12T00:59:53.655 INFO:tasks.workunit.client.0.smithi070.stderr: -221> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:59:53.655 INFO:tasks.workunit.client.0.smithi070.stderr: -220> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 4 set_mon_vals no callback set 2024-09-12T00:59:53.655 INFO:tasks.workunit.client.0.smithi070.stderr: -219> 2024-09-12T00:59:53.472+0000 7fd23ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:53.655 INFO:tasks.workunit.client.0.smithi070.stderr: -218> 2024-09-12T00:59:53.472+0000 7fd23ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:59:53.656 INFO:tasks.workunit.client.0.smithi070.stderr: -217> 2024-09-12T00:59:53.472+0000 7fd23ffff640 10 monclient: dump: 2024-09-12T00:59:53.656 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:53.656 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:53.656 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.656 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.656 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:53.656 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.656 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:53.656 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:53.656 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:53.656 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.656 INFO:tasks.workunit.client.0.smithi070.stderr: -216> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient: shutdown 2024-09-12T00:59:53.657 INFO:tasks.workunit.client.0.smithi070.stderr: -215> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient: build_initial_monmap 2024-09-12T00:59:53.657 INFO:tasks.workunit.client.0.smithi070.stderr: -214> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 1 build_initial for_mkfs: 0 2024-09-12T00:59:53.657 INFO:tasks.workunit.client.0.smithi070.stderr: -213> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient: monmap: 2024-09-12T00:59:53.657 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T00:59:53.657 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:59:53.657 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T00:59:53.657 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T00:59:53.657 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T00:59:53.657 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.657 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T00:59:53.657 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T00:59:53.657 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T00:59:53.657 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.658 INFO:tasks.workunit.client.0.smithi070.stderr: -212> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding auth protocol: cephx 2024-09-12T00:59:53.658 INFO:tasks.workunit.client.0.smithi070.stderr: -211> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding auth protocol: cephx 2024-09-12T00:59:53.658 INFO:tasks.workunit.client.0.smithi070.stderr: -210> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding auth protocol: cephx 2024-09-12T00:59:53.658 INFO:tasks.workunit.client.0.smithi070.stderr: -209> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding con mode: secure 2024-09-12T00:59:53.658 INFO:tasks.workunit.client.0.smithi070.stderr: -208> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding con mode: crc 2024-09-12T00:59:53.658 INFO:tasks.workunit.client.0.smithi070.stderr: -207> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding con mode: secure 2024-09-12T00:59:53.658 INFO:tasks.workunit.client.0.smithi070.stderr: -206> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding con mode: crc 2024-09-12T00:59:53.658 INFO:tasks.workunit.client.0.smithi070.stderr: -205> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding con mode: secure 2024-09-12T00:59:53.658 INFO:tasks.workunit.client.0.smithi070.stderr: -204> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding con mode: crc 2024-09-12T00:59:53.658 INFO:tasks.workunit.client.0.smithi070.stderr: -203> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding con mode: crc 2024-09-12T00:59:53.658 INFO:tasks.workunit.client.0.smithi070.stderr: -202> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding con mode: secure 2024-09-12T00:59:53.659 INFO:tasks.workunit.client.0.smithi070.stderr: -201> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding con mode: crc 2024-09-12T00:59:53.659 INFO:tasks.workunit.client.0.smithi070.stderr: -200> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding con mode: secure 2024-09-12T00:59:53.659 INFO:tasks.workunit.client.0.smithi070.stderr: -199> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding con mode: crc 2024-09-12T00:59:53.659 INFO:tasks.workunit.client.0.smithi070.stderr: -198> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613f4860) adding con mode: secure 2024-09-12T00:59:53.659 INFO:tasks.workunit.client.0.smithi070.stderr: -197> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:53.659 INFO:tasks.workunit.client.0.smithi070.stderr: -196> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 1 librados: starting msgr at 2024-09-12T00:59:53.659 INFO:tasks.workunit.client.0.smithi070.stderr: -195> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 1 librados: starting objecter 2024-09-12T00:59:53.659 INFO:tasks.workunit.client.0.smithi070.stderr: -194> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command objecter_requests cmddesc objecter_requests hook 0x55e1613cdd90 EEXIST 2024-09-12T00:59:53.659 INFO:tasks.workunit.client.0.smithi070.stderr: -193> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 1 librados: setting wanted keys 2024-09-12T00:59:53.659 INFO:tasks.workunit.client.0.smithi070.stderr: -192> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 1 librados: calling monclient init 2024-09-12T00:59:53.659 INFO:tasks.workunit.client.0.smithi070.stderr: -191> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient: init 2024-09-12T00:59:53.659 INFO:tasks.workunit.client.0.smithi070.stderr: -190> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding auth protocol: cephx 2024-09-12T00:59:53.659 INFO:tasks.workunit.client.0.smithi070.stderr: -189> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding auth protocol: cephx 2024-09-12T00:59:53.660 INFO:tasks.workunit.client.0.smithi070.stderr: -188> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding auth protocol: cephx 2024-09-12T00:59:53.660 INFO:tasks.workunit.client.0.smithi070.stderr: -187> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding con mode: secure 2024-09-12T00:59:53.660 INFO:tasks.workunit.client.0.smithi070.stderr: -186> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding con mode: crc 2024-09-12T00:59:53.660 INFO:tasks.workunit.client.0.smithi070.stderr: -185> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding con mode: secure 2024-09-12T00:59:53.660 INFO:tasks.workunit.client.0.smithi070.stderr: -184> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding con mode: crc 2024-09-12T00:59:53.660 INFO:tasks.workunit.client.0.smithi070.stderr: -183> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding con mode: secure 2024-09-12T00:59:53.660 INFO:tasks.workunit.client.0.smithi070.stderr: -182> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding con mode: crc 2024-09-12T00:59:53.660 INFO:tasks.workunit.client.0.smithi070.stderr: -181> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding con mode: crc 2024-09-12T00:59:53.660 INFO:tasks.workunit.client.0.smithi070.stderr: -180> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding con mode: secure 2024-09-12T00:59:53.660 INFO:tasks.workunit.client.0.smithi070.stderr: -179> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding con mode: crc 2024-09-12T00:59:53.660 INFO:tasks.workunit.client.0.smithi070.stderr: -178> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding con mode: secure 2024-09-12T00:59:53.660 INFO:tasks.workunit.client.0.smithi070.stderr: -177> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding con mode: crc 2024-09-12T00:59:53.660 INFO:tasks.workunit.client.0.smithi070.stderr: -176> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 AuthRegistry(0x55e1613b04d0) adding con mode: secure 2024-09-12T00:59:53.661 INFO:tasks.workunit.client.0.smithi070.stderr: -175> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:53.661 INFO:tasks.workunit.client.0.smithi070.stderr: -174> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:53.661 INFO:tasks.workunit.client.0.smithi070.stderr: -173> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command rotate-key cmddesc rotate-key hook 0x55e1613b0618 EEXIST 2024-09-12T00:59:53.661 INFO:tasks.workunit.client.0.smithi070.stderr: -172> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:59:53.661 INFO:tasks.workunit.client.0.smithi070.stderr: -171> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:59:53.661 INFO:tasks.workunit.client.0.smithi070.stderr: -170> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient(hunting): picked mon.noname-a con 0x55e1613fd990 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T00:59:53.661 INFO:tasks.workunit.client.0.smithi070.stderr: -169> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient(hunting): picked mon.noname-c con 0x55e1613fe310 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T00:59:53.661 INFO:tasks.workunit.client.0.smithi070.stderr: -168> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient(hunting): picked mon.noname-b con 0x55e1614025a0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T00:59:53.661 INFO:tasks.workunit.client.0.smithi070.stderr: -167> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:53.661 INFO:tasks.workunit.client.0.smithi070.stderr: -166> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:53.662 INFO:tasks.workunit.client.0.smithi070.stderr: -165> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:59:53.662 INFO:tasks.workunit.client.0.smithi070.stderr: -164> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:59:53.662 INFO:tasks.workunit.client.0.smithi070.stderr: -163> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient(hunting): authenticate will time out at 2443.921921s 2024-09-12T00:59:53.662 INFO:tasks.workunit.client.0.smithi070.stderr: -162> 2024-09-12T00:59:53.472+0000 7fd368501640 10 monclient(hunting): get_auth_request con 0x55e1613fe310 auth_method 0 2024-09-12T00:59:53.662 INFO:tasks.workunit.client.0.smithi070.stderr: -161> 2024-09-12T00:59:53.472+0000 7fd368501640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:53.662 INFO:tasks.workunit.client.0.smithi070.stderr: -160> 2024-09-12T00:59:53.472+0000 7fd368501640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:53.662 INFO:tasks.workunit.client.0.smithi070.stderr: -159> 2024-09-12T00:59:53.472+0000 7fd368501640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:53.662 INFO:tasks.workunit.client.0.smithi070.stderr: -158> 2024-09-12T00:59:53.472+0000 7fd368d02640 10 monclient(hunting): get_auth_request con 0x55e1613fd990 auth_method 0 2024-09-12T00:59:53.662 INFO:tasks.workunit.client.0.smithi070.stderr: -157> 2024-09-12T00:59:53.472+0000 7fd368d02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:59:53.662 INFO:tasks.workunit.client.0.smithi070.stderr: -156> 2024-09-12T00:59:53.472+0000 7fd368d02640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:59:53.662 INFO:tasks.workunit.client.0.smithi070.stderr: -155> 2024-09-12T00:59:53.472+0000 7fd368d02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:59:53.662 INFO:tasks.workunit.client.0.smithi070.stderr: -154> 2024-09-12T00:59:53.472+0000 7fd368501640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:53.662 INFO:tasks.workunit.client.0.smithi070.stderr: -153> 2024-09-12T00:59:53.472+0000 7fd368501640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:53.663 INFO:tasks.workunit.client.0.smithi070.stderr: -152> 2024-09-12T00:59:53.472+0000 7fd368501640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:53.663 INFO:tasks.workunit.client.0.smithi070.stderr: -151> 2024-09-12T00:59:53.472+0000 7fd368d02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:59:53.663 INFO:tasks.workunit.client.0.smithi070.stderr: -150> 2024-09-12T00:59:53.472+0000 7fd368d02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:59:53.663 INFO:tasks.workunit.client.0.smithi070.stderr: -149> 2024-09-12T00:59:53.472+0000 7fd368d02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:59:53.663 INFO:tasks.workunit.client.0.smithi070.stderr: -148> 2024-09-12T00:59:53.472+0000 7fd368501640 10 monclient(hunting): handle_auth_done global_id 7844 payload 824 2024-09-12T00:59:53.663 INFO:tasks.workunit.client.0.smithi070.stderr: -147> 2024-09-12T00:59:53.472+0000 7fd368501640 10 monclient: _finish_hunting 0 2024-09-12T00:59:53.663 INFO:tasks.workunit.client.0.smithi070.stderr: -146> 2024-09-12T00:59:53.472+0000 7fd368501640 1 monclient: found mon.noname-c 2024-09-12T00:59:53.663 INFO:tasks.workunit.client.0.smithi070.stderr: -145> 2024-09-12T00:59:53.472+0000 7fd368501640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T00:59:53.663 INFO:tasks.workunit.client.0.smithi070.stderr: -144> 2024-09-12T00:59:53.472+0000 7fd23e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:53.663 INFO:tasks.workunit.client.0.smithi070.stderr: -143> 2024-09-12T00:59:53.472+0000 7fd23e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:59:53.663 INFO:tasks.workunit.client.0.smithi070.stderr: -142> 2024-09-12T00:59:53.472+0000 7fd23e7fc640 10 monclient: dump: 2024-09-12T00:59:53.663 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:53.663 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:53.664 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.664 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.664 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:53.664 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.664 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:53.664 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:53.664 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:53.664 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.664 INFO:tasks.workunit.client.0.smithi070.stderr: -141> 2024-09-12T00:59:53.472+0000 7fd23e7fc640 10 monclient: _finish_auth 0 2024-09-12T00:59:53.664 INFO:tasks.workunit.client.0.smithi070.stderr: -140> 2024-09-12T00:59:53.472+0000 7fd23e7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:59:53.664 INFO:tasks.workunit.client.0.smithi070.stderr: -139> 2024-09-12T00:59:53.472+0000 7fd23e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:59:53.664 INFO:tasks.workunit.client.0.smithi070.stderr: -138> 2024-09-12T00:59:53.472+0000 7fd23e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:59:53.665 INFO:tasks.workunit.client.0.smithi070.stderr: -137> 2024-09-12T00:59:53.472+0000 7fd23e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:59:53.665 INFO:tasks.workunit.client.0.smithi070.stderr: -136> 2024-09-12T00:59:53.472+0000 7fd23e7fc640 10 monclient: dump: 2024-09-12T00:59:53.665 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T00:59:53.665 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T00:59:53.665 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.665 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T00:59:53.665 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T00:59:53.665 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T00:59:53.665 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T00:59:53.665 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T00:59:53.665 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T00:59:53.665 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.665 INFO:tasks.workunit.client.0.smithi070.stderr: -135> 2024-09-12T00:59:53.472+0000 7fd23ffff640 4 set_mon_vals no callback set 2024-09-12T00:59:53.666 INFO:tasks.workunit.client.0.smithi070.stderr: -134> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 monclient: authenticate success, global_id 7844 2024-09-12T00:59:53.666 INFO:tasks.workunit.client.0.smithi070.stderr: -133> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient: _renew_subs 2024-09-12T00:59:53.666 INFO:tasks.workunit.client.0.smithi070.stderr: -132> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:59:53.666 INFO:tasks.workunit.client.0.smithi070.stderr: -131> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient: _renew_subs 2024-09-12T00:59:53.666 INFO:tasks.workunit.client.0.smithi070.stderr: -130> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:59:53.666 INFO:tasks.workunit.client.0.smithi070.stderr: -129> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 1 librados: init done 2024-09-12T00:59:53.666 INFO:tasks.workunit.client.0.smithi070.stderr: -128> 2024-09-12T00:59:53.472+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command cr dump hook 0x55e1613f8bf8 2024-09-12T00:59:53.666 INFO:tasks.workunit.client.0.smithi070.stderr: -127> 2024-09-12T00:59:53.476+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.666 INFO:tasks.workunit.client.0.smithi070.stderr: -126> 2024-09-12T00:59:53.476+0000 7fd23e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:59:53.666 INFO:tasks.workunit.client.0.smithi070.stderr: -125> 2024-09-12T00:59:53.476+0000 7fd23e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:59:53.666 INFO:tasks.workunit.client.0.smithi070.stderr: -124> 2024-09-12T00:59:53.476+0000 7fd23e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T00:59:53.666 INFO:tasks.workunit.client.0.smithi070.stderr: -123> 2024-09-12T00:59:53.476+0000 7fd368d02640 10 monclient: get_auth_request con 0x7fd234070ae0 auth_method 0 2024-09-12T00:59:53.666 INFO:tasks.workunit.client.0.smithi070.stderr: -122> 2024-09-12T00:59:53.476+0000 7fd369503640 10 monclient: get_auth_request con 0x55e16141ba50 auth_method 0 2024-09-12T00:59:53.666 INFO:tasks.workunit.client.0.smithi070.stderr: -121> 2024-09-12T00:59:53.476+0000 7fd36b1fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.667 INFO:tasks.workunit.client.0.smithi070.stderr: -120> 2024-09-12T00:59:53.476+0000 7fd36b1fc9c0 20 realm 2024-09-12T00:59:53.667 INFO:tasks.workunit.client.0.smithi070.stderr: -119> 2024-09-12T00:59:53.476+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.667 INFO:tasks.workunit.client.0.smithi070.stderr: -118> 2024-09-12T00:59:53.476+0000 7fd36b1fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.667 INFO:tasks.workunit.client.0.smithi070.stderr: -117> 2024-09-12T00:59:53.476+0000 7fd36b1fc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:59:53.667 INFO:tasks.workunit.client.0.smithi070.stderr: -116> 2024-09-12T00:59:53.476+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.667 INFO:tasks.workunit.client.0.smithi070.stderr: -115> 2024-09-12T00:59:53.476+0000 7fd36b1fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.667 INFO:tasks.workunit.client.0.smithi070.stderr: -114> 2024-09-12T00:59:53.476+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.667 INFO:tasks.workunit.client.0.smithi070.stderr: -113> 2024-09-12T00:59:53.476+0000 7fd368d02640 10 monclient: get_auth_request con 0x55e16141fdb0 auth_method 0 2024-09-12T00:59:53.667 INFO:tasks.workunit.client.0.smithi070.stderr: -112> 2024-09-12T00:59:53.480+0000 7fd36b1fc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:59:53.667 INFO:tasks.workunit.client.0.smithi070.stderr: -111> 2024-09-12T00:59:53.480+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.667 INFO:tasks.workunit.client.0.smithi070.stderr: -110> 2024-09-12T00:59:53.480+0000 7fd368501640 10 monclient: get_auth_request con 0x55e1614234f0 auth_method 0 2024-09-12T00:59:53.667 INFO:tasks.workunit.client.0.smithi070.stderr: -109> 2024-09-12T00:59:53.480+0000 7fd36b1fc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:59:53.667 INFO:tasks.workunit.client.0.smithi070.stderr: -108> 2024-09-12T00:59:53.480+0000 7fd36b1fc9c0 20 searching for the correct realm 2024-09-12T00:59:53.668 INFO:tasks.workunit.client.0.smithi070.stderr: -107> 2024-09-12T00:59:53.480+0000 7fd369503640 10 monclient: get_auth_request con 0x55e161428290 auth_method 0 2024-09-12T00:59:53.668 INFO:tasks.workunit.client.0.smithi070.stderr: -106> 2024-09-12T00:59:53.480+0000 7fd368d02640 10 monclient: get_auth_request con 0x7fd3600b8450 auth_method 0 2024-09-12T00:59:53.668 INFO:tasks.workunit.client.0.smithi070.stderr: -105> 2024-09-12T00:59:53.484+0000 7fd368501640 10 monclient: get_auth_request con 0x7fd35808f050 auth_method 0 2024-09-12T00:59:53.668 INFO:tasks.workunit.client.0.smithi070.stderr: -104> 2024-09-12T00:59:53.484+0000 7fd369503640 10 monclient: get_auth_request con 0x7fd35c00ec50 auth_method 0 2024-09-12T00:59:53.668 INFO:tasks.workunit.client.0.smithi070.stderr: -103> 2024-09-12T00:59:53.484+0000 7fd369503640 0 -- 172.21.15.70:0/3605515028 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fd35c00ec50 msgr2=0x7fd35c064ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:59:53.668 INFO:tasks.workunit.client.0.smithi070.stderr: -102> 2024-09-12T00:59:53.484+0000 7fd23e7fc640 1 client.7844.objecter ms_handle_reset 0x7fd35c00ec50 session 0x7fd35c020070 osd.4 2024-09-12T00:59:53.668 INFO:tasks.workunit.client.0.smithi070.stderr: -101> 2024-09-12T00:59:53.484+0000 7fd23e7fc640 10 monclient: _renew_subs 2024-09-12T00:59:53.668 INFO:tasks.workunit.client.0.smithi070.stderr: -100> 2024-09-12T00:59:53.484+0000 7fd23e7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T00:59:53.668 INFO:tasks.workunit.client.0.smithi070.stderr: -99> 2024-09-12T00:59:53.484+0000 7fd369503640 10 monclient: get_auth_request con 0x7fd234080880 auth_method 0 2024-09-12T00:59:53.668 INFO:tasks.workunit.client.0.smithi070.stderr: -98> 2024-09-12T00:59:53.488+0000 7fd368d02640 10 monclient: get_auth_request con 0x7fd3600d9920 auth_method 0 2024-09-12T00:59:53.668 INFO:tasks.workunit.client.0.smithi070.stderr: -97> 2024-09-12T00:59:53.492+0000 7fd369503640 0 -- 172.21.15.70:0/3605515028 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fd234080880 msgr2=0x7fd234082cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:59:53.669 INFO:tasks.workunit.client.0.smithi070.stderr: -96> 2024-09-12T00:59:53.492+0000 7fd23e7fc640 1 client.7844.objecter ms_handle_reset 0x7fd234080880 session 0x7fd35c020070 osd.4 2024-09-12T00:59:53.669 INFO:tasks.workunit.client.0.smithi070.stderr: -95> 2024-09-12T00:59:53.492+0000 7fd369503640 10 monclient: get_auth_request con 0x7fd35c00ec50 auth_method 0 2024-09-12T00:59:53.669 INFO:tasks.workunit.client.0.smithi070.stderr: -94> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:59:53.669 INFO:tasks.workunit.client.0.smithi070.stderr: -93> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:59:53.669 INFO:tasks.workunit.client.0.smithi070.stderr: -92> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:59:53.669 INFO:tasks.workunit.client.0.smithi070.stderr: -91> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:59:53.669 INFO:tasks.workunit.client.0.smithi070.stderr: -90> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:59:53.669 INFO:tasks.workunit.client.0.smithi070.stderr: -89> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:59:53.669 INFO:tasks.workunit.client.0.smithi070.stderr: -88> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.669 INFO:tasks.workunit.client.0.smithi070.stderr: -87> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.669 INFO:tasks.workunit.client.0.smithi070.stderr: -86> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.669 INFO:tasks.workunit.client.0.smithi070.stderr: -85> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:59:53.670 INFO:tasks.workunit.client.0.smithi070.stderr: -84> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.670 INFO:tasks.workunit.client.0.smithi070.stderr: -83> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:59:53.670 INFO:tasks.workunit.client.0.smithi070.stderr: -82> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 zone default found 2024-09-12T00:59:53.670 INFO:tasks.workunit.client.0.smithi070.stderr: -81> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 4 Realm: () 2024-09-12T00:59:53.670 INFO:tasks.workunit.client.0.smithi070.stderr: -80> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:59:53.670 INFO:tasks.workunit.client.0.smithi070.stderr: -79> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:59:53.670 INFO:tasks.workunit.client.0.smithi070.stderr: -78> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:59:53.670 INFO:tasks.workunit.client.0.smithi070.stderr: -77> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 zonegroup default 2024-09-12T00:59:53.670 INFO:tasks.workunit.client.0.smithi070.stderr: -76> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.670 INFO:tasks.workunit.client.0.smithi070.stderr: -75> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.671 INFO:tasks.workunit.client.0.smithi070.stderr: -74> 2024-09-12T00:59:53.500+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.671 INFO:tasks.workunit.client.0.smithi070.stderr: -73> 2024-09-12T00:59:53.504+0000 7fd36b1fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.671 INFO:tasks.workunit.client.0.smithi070.stderr: -72> 2024-09-12T00:59:53.504+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.671 INFO:tasks.workunit.client.0.smithi070.stderr: -71> 2024-09-12T00:59:53.504+0000 7fd36b1fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.671 INFO:tasks.workunit.client.0.smithi070.stderr: -70> 2024-09-12T00:59:53.504+0000 7fd36b1fc9c0 20 started sync module instance, tier type = 2024-09-12T00:59:53.671 INFO:tasks.workunit.client.0.smithi070.stderr: -69> 2024-09-12T00:59:53.504+0000 7fd36b1fc9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:59:53.671 INFO:tasks.workunit.client.0.smithi070.stderr: -68> 2024-09-12T00:59:53.520+0000 7fd36b1fc9c0 20 add_watcher() i=0 2024-09-12T00:59:53.671 INFO:tasks.workunit.client.0.smithi070.stderr: -67> 2024-09-12T00:59:53.520+0000 7fd36b1fc9c0 20 add_watcher() i=1 2024-09-12T00:59:53.671 INFO:tasks.workunit.client.0.smithi070.stderr: -66> 2024-09-12T00:59:53.520+0000 7fd36b1fc9c0 20 add_watcher() i=2 2024-09-12T00:59:53.671 INFO:tasks.workunit.client.0.smithi070.stderr: -65> 2024-09-12T00:59:53.520+0000 7fd36b1fc9c0 20 add_watcher() i=3 2024-09-12T00:59:53.671 INFO:tasks.workunit.client.0.smithi070.stderr: -64> 2024-09-12T00:59:53.520+0000 7fd36b1fc9c0 20 add_watcher() i=4 2024-09-12T00:59:53.671 INFO:tasks.workunit.client.0.smithi070.stderr: -63> 2024-09-12T00:59:53.520+0000 7fd36b1fc9c0 20 add_watcher() i=5 2024-09-12T00:59:53.672 INFO:tasks.workunit.client.0.smithi070.stderr: -62> 2024-09-12T00:59:53.520+0000 7fd36b1fc9c0 20 add_watcher() i=6 2024-09-12T00:59:53.672 INFO:tasks.workunit.client.0.smithi070.stderr: -61> 2024-09-12T00:59:53.520+0000 7fd36b1fc9c0 20 add_watcher() i=7 2024-09-12T00:59:53.672 INFO:tasks.workunit.client.0.smithi070.stderr: -60> 2024-09-12T00:59:53.520+0000 7fd36b1fc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:59:53.672 INFO:tasks.workunit.client.0.smithi070.stderr: -59> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding auth protocol: cephx 2024-09-12T00:59:53.672 INFO:tasks.workunit.client.0.smithi070.stderr: -58> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding auth protocol: cephx 2024-09-12T00:59:53.672 INFO:tasks.workunit.client.0.smithi070.stderr: -57> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding auth protocol: cephx 2024-09-12T00:59:53.672 INFO:tasks.workunit.client.0.smithi070.stderr: -56> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding con mode: secure 2024-09-12T00:59:53.672 INFO:tasks.workunit.client.0.smithi070.stderr: -55> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding con mode: crc 2024-09-12T00:59:53.672 INFO:tasks.workunit.client.0.smithi070.stderr: -54> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding con mode: secure 2024-09-12T00:59:53.672 INFO:tasks.workunit.client.0.smithi070.stderr: -53> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding con mode: crc 2024-09-12T00:59:53.672 INFO:tasks.workunit.client.0.smithi070.stderr: -52> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding con mode: secure 2024-09-12T00:59:53.672 INFO:tasks.workunit.client.0.smithi070.stderr: -51> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding con mode: crc 2024-09-12T00:59:53.672 INFO:tasks.workunit.client.0.smithi070.stderr: -50> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding con mode: crc 2024-09-12T00:59:53.673 INFO:tasks.workunit.client.0.smithi070.stderr: -49> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding con mode: secure 2024-09-12T00:59:53.673 INFO:tasks.workunit.client.0.smithi070.stderr: -48> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding con mode: crc 2024-09-12T00:59:53.673 INFO:tasks.workunit.client.0.smithi070.stderr: -47> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding con mode: secure 2024-09-12T00:59:53.673 INFO:tasks.workunit.client.0.smithi070.stderr: -46> 2024-09-12T00:59:53.524+0000 7fd21efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:59:53.673 INFO:tasks.workunit.client.0.smithi070.stderr: -45> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding con mode: crc 2024-09-12T00:59:53.673 INFO:tasks.workunit.client.0.smithi070.stderr: -44> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 AuthRegistry(0x7ffd6b770800) adding con mode: secure 2024-09-12T00:59:53.673 INFO:tasks.workunit.client.0.smithi070.stderr: -43> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:59:53.673 INFO:tasks.workunit.client.0.smithi070.stderr: -42> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:59:53.673 INFO:tasks.workunit.client.0.smithi070.stderr: -41> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:59:53.673 INFO:tasks.workunit.client.0.smithi070.stderr: -40> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command cache list hook 0x55e1613f7470 2024-09-12T00:59:53.673 INFO:tasks.workunit.client.0.smithi070.stderr: -39> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command cache inspect hook 0x55e1613f7470 2024-09-12T00:59:53.673 INFO:tasks.workunit.client.0.smithi070.stderr: -38> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command cache erase hook 0x55e1613f7470 2024-09-12T00:59:53.674 INFO:tasks.workunit.client.0.smithi070.stderr: -37> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command cache zap hook 0x55e1613f7470 2024-09-12T00:59:53.674 INFO:tasks.workunit.client.0.smithi070.stderr: -36> 2024-09-12T00:59:53.524+0000 7fd36b1fc9c0 5 note: GC not initialized 2024-09-12T00:59:53.674 INFO:tasks.workunit.client.0.smithi070.stderr: -35> 2024-09-12T00:59:53.528+0000 7fd21dfe3640 20 reqs_thread_entry: start 2024-09-12T00:59:53.674 INFO:tasks.workunit.client.0.smithi070.stderr: -34> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command sync trace show hook 0x7fd358010050 2024-09-12T00:59:53.674 INFO:tasks.workunit.client.0.smithi070.stderr: -33> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command sync trace history hook 0x7fd358010050 2024-09-12T00:59:53.674 INFO:tasks.workunit.client.0.smithi070.stderr: -32> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command sync trace active hook 0x7fd358010050 2024-09-12T00:59:53.674 INFO:tasks.workunit.client.0.smithi070.stderr: -31> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 5 asok(0x55e1611252b0) register_command sync trace active_short hook 0x7fd358010050 2024-09-12T00:59:53.674 INFO:tasks.workunit.client.0.smithi070.stderr: -30> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 20 init_complete bucket index max shards: 1 2024-09-12T00:59:53.674 INFO:tasks.workunit.client.0.smithi070.stderr: -29> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 20 Filter name: none 2024-09-12T00:59:53.674 INFO:tasks.workunit.client.0.smithi070.stderr: -28> 2024-09-12T00:59:53.528+0000 7fd18f7fe640 20 reqs_thread_entry: start 2024-09-12T00:59:53.674 INFO:tasks.workunit.client.0.smithi070.stderr: -27> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:59:53.674 INFO:tasks.workunit.client.0.smithi070.stderr: -26> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.674 INFO:tasks.workunit.client.0.smithi070.stderr: -25> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:59:53.674 INFO:tasks.workunit.client.0.smithi070.stderr: -24> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:59:53.675 INFO:tasks.workunit.client.0.smithi070.stderr: -23> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:59:53.675 INFO:tasks.workunit.client.0.smithi070.stderr: -22> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : miss 2024-09-12T00:59:53.675 INFO:tasks.workunit.client.0.smithi070.stderr: -21> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.675 INFO:tasks.workunit.client.0.smithi070.stderr: -20> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:59:53.675 INFO:tasks.workunit.client.0.smithi070.stderr: -19> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:59:53.675 INFO:tasks.workunit.client.0.smithi070.stderr: -18> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:59:53.675 INFO:tasks.workunit.client.0.smithi070.stderr: -17> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:59:53.675 INFO:tasks.workunit.client.0.smithi070.stderr: -16> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:59:53.675 INFO:tasks.workunit.client.0.smithi070.stderr: -15> 2024-09-12T00:59:53.528+0000 7fd36b1fc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T00:59:53.675 INFO:tasks.workunit.client.0.smithi070.stderr: -14> 2024-09-12T00:59:53.532+0000 7fd36b1fc9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:59:53.675 INFO:tasks.workunit.client.0.smithi070.stderr: -13> 2024-09-12T00:59:53.540+0000 7fd36b1fc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:59:53.675 INFO:tasks.workunit.client.0.smithi070.stderr: -12> 2024-09-12T00:59:53.540+0000 7fd36b1fc9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:59:53.675 INFO:tasks.workunit.client.0.smithi070.stderr: -11> 2024-09-12T00:59:53.540+0000 7fd36b1fc9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:59:53.676 INFO:tasks.workunit.client.0.smithi070.stderr: -10> 2024-09-12T00:59:53.540+0000 7fd36b1fc9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18, ofs0, ns] 2024-09-12T00:59:53.676 INFO:tasks.workunit.client.0.smithi070.stderr: -9> 2024-09-12T00:59:53.540+0000 7fd23ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431648 cookie 94426487769648 notifier 7844 bl.length()=911 2024-09-12T00:59:53.676 INFO:tasks.workunit.client.0.smithi070.stderr: -8> 2024-09-12T00:59:53.540+0000 7fd23ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:59:53.676 INFO:tasks.workunit.client.0.smithi070.stderr: -7> 2024-09-12T00:59:53.540+0000 7fd23ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:59:53.676 INFO:tasks.workunit.client.0.smithi070.stderr: -6> 2024-09-12T00:59:53.540+0000 7fd23ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:59:53.676 INFO:tasks.workunit.client.0.smithi070.stderr: -5> 2024-09-12T00:59:53.540+0000 7fd36b1fc9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_sources= new_sources= 2024-09-12T00:59:53.676 INFO:tasks.workunit.client.0.smithi070.stderr: -4> 2024-09-12T00:59:53.540+0000 7fd36b1fc9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential sources added=[] removed=[] 2024-09-12T00:59:53.676 INFO:tasks.workunit.client.0.smithi070.stderr: -3> 2024-09-12T00:59:53.540+0000 7fd36b1fc9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_dests= new_dests= 2024-09-12T00:59:53.676 INFO:tasks.workunit.client.0.smithi070.stderr: -2> 2024-09-12T00:59:53.540+0000 7fd36b1fc9c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential dests added=[] removed=[] 2024-09-12T00:59:53.676 INFO:tasks.workunit.client.0.smithi070.stderr: -1> 2024-09-12T00:59:53.548+0000 7fd36b1fc9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd36b1fc9c0 time 2024-09-12T00:59:53.552386+0000 2024-09-12T00:59:53.676 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:59:53.677 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.677 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:59:53.677 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd36ead62eb] 2024-09-12T00:59:53.677 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd36ead649f] 2024-09-12T00:59:53.677 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e15f1bacc1] 2024-09-12T00:59:53.677 INFO:tasks.workunit.client.0.smithi070.stderr: 4: radosgw-admin(+0x1422aac) [0x55e15fc18aac] 2024-09-12T00:59:53.677 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e15f1cfced] 2024-09-12T00:59:53.677 INFO:tasks.workunit.client.0.smithi070.stderr: 6: main() 2024-09-12T00:59:53.677 INFO:tasks.workunit.client.0.smithi070.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd36d93cd90] 2024-09-12T00:59:53.677 INFO:tasks.workunit.client.0.smithi070.stderr: 8: __libc_start_main() 2024-09-12T00:59:53.677 INFO:tasks.workunit.client.0.smithi070.stderr: 9: _start() 2024-09-12T00:59:53.677 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.678 INFO:tasks.workunit.client.0.smithi070.stderr: 0> 2024-09-12T00:59:53.552+0000 7fd36b1fc9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:59:53.678 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7fd36b1fc9c0 thread_name:radosgw-admin 2024-09-12T00:59:53.678 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.678 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:59:53.678 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd36d955520] 2024-09-12T00:59:53.678 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T00:59:53.678 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T00:59:53.678 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T00:59:53.678 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd36ead6345] 2024-09-12T00:59:53.678 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd36ead649f] 2024-09-12T00:59:53.678 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e15f1bacc1] 2024-09-12T00:59:53.678 INFO:tasks.workunit.client.0.smithi070.stderr: 8: radosgw-admin(+0x1422aac) [0x55e15fc18aac] 2024-09-12T00:59:53.678 INFO:tasks.workunit.client.0.smithi070.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e15f1cfced] 2024-09-12T00:59:53.679 INFO:tasks.workunit.client.0.smithi070.stderr: 10: main() 2024-09-12T00:59:53.679 INFO:tasks.workunit.client.0.smithi070.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd36d93cd90] 2024-09-12T00:59:53.679 INFO:tasks.workunit.client.0.smithi070.stderr: 12: __libc_start_main() 2024-09-12T00:59:53.679 INFO:tasks.workunit.client.0.smithi070.stderr: 13: _start() 2024-09-12T00:59:53.679 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:59:53.679 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T00:59:53.679 INFO:tasks.workunit.client.0.smithi070.stderr:--- logging levels --- 2024-09-12T00:59:53.679 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 none 2024-09-12T00:59:53.679 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 lockdep 2024-09-12T00:59:53.679 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 context 2024-09-12T00:59:53.679 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 crush 2024-09-12T00:59:53.679 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds 2024-09-12T00:59:53.679 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_balancer 2024-09-12T00:59:53.680 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_locker 2024-09-12T00:59:53.680 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log 2024-09-12T00:59:53.680 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log_expire 2024-09-12T00:59:53.680 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_migrator 2024-09-12T00:59:53.680 INFO:tasks.workunit.client.0.smithi070.stderr: 3/ 5 mds_quiesce 2024-09-12T00:59:53.680 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 buffer 2024-09-12T00:59:53.680 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 timer 2024-09-12T00:59:53.680 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 filer 2024-09-12T00:59:53.680 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 striper 2024-09-12T00:59:53.680 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 objecter 2024-09-12T00:59:53.680 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rados 2024-09-12T00:59:53.680 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd 2024-09-12T00:59:53.680 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_mirror 2024-09-12T00:59:53.681 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_replay 2024-09-12T00:59:53.681 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_pwl 2024-09-12T00:59:53.681 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 journaler 2024-09-12T00:59:53.681 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objectcacher 2024-09-12T00:59:53.681 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:59:53.681 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 client 2024-09-12T00:59:53.681 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 osd 2024-09-12T00:59:53.681 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 optracker 2024-09-12T00:59:53.681 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objclass 2024-09-12T00:59:53.681 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 filestore 2024-09-12T00:59:53.681 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 journal 2024-09-12T00:59:53.681 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 ms 2024-09-12T00:59:53.681 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mon 2024-09-12T00:59:53.682 INFO:tasks.workunit.client.0.smithi070.stderr: 0/10 monc 2024-09-12T00:59:53.682 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 paxos 2024-09-12T00:59:53.682 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 tp 2024-09-12T00:59:53.682 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 auth 2024-09-12T00:59:53.682 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 crypto 2024-09-12T00:59:53.682 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 finisher 2024-09-12T00:59:53.682 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 reserver 2024-09-12T00:59:53.682 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 heartbeatmap 2024-09-12T00:59:53.682 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 perfcounter 2024-09-12T00:59:53.682 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw 2024-09-12T00:59:53.682 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_sync 2024-09-12T00:59:53.682 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_datacache 2024-09-12T00:59:53.682 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_access 2024-09-12T00:59:53.683 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:59:53.683 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_flight 2024-09-12T00:59:53.683 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:59:53.683 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw_notification 2024-09-12T00:59:53.683 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 javaclient 2024-09-12T00:59:53.683 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 asok 2024-09-12T00:59:53.683 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 throttle 2024-09-12T00:59:53.683 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 refs 2024-09-12T00:59:53.683 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 compressor 2024-09-12T00:59:53.683 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluestore 2024-09-12T00:59:53.683 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluefs 2024-09-12T00:59:53.683 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 bdev 2024-09-12T00:59:53.683 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 kstore 2024-09-12T00:59:53.683 INFO:tasks.workunit.client.0.smithi070.stderr: 4/ 5 rocksdb 2024-09-12T00:59:53.684 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 fuse 2024-09-12T00:59:53.684 INFO:tasks.workunit.client.0.smithi070.stderr: 2/ 5 mgr 2024-09-12T00:59:53.684 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mgrc 2024-09-12T00:59:53.684 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 dpdk 2024-09-12T00:59:53.684 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 eventtrace 2024-09-12T00:59:53.684 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 prioritycache 2024-09-12T00:59:53.684 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 test 2024-09-12T00:59:53.684 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:59:53.684 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephsqlite 2024-09-12T00:59:53.684 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:59:53.685 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore 2024-09-12T00:59:53.685 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_onode 2024-09-12T00:59:53.685 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_odata 2024-09-12T00:59:53.685 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_omap 2024-09-12T00:59:53.685 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_tm 2024-09-12T00:59:53.685 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_t 2024-09-12T00:59:53.685 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:59:53.685 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_epm 2024-09-12T00:59:53.685 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_lba 2024-09-12T00:59:53.685 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:59:53.685 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cache 2024-09-12T00:59:53.685 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_journal 2024-09-12T00:59:53.686 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_device 2024-09-12T00:59:53.686 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_backref 2024-09-12T00:59:53.686 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 alienstore 2024-09-12T00:59:53.686 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mclock 2024-09-12T00:59:53.686 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cyanstore 2024-09-12T00:59:53.686 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 ceph_exporter 2024-09-12T00:59:53.686 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 memstore 2024-09-12T00:59:53.686 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 trace 2024-09-12T00:59:53.686 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 ceph_dedup 2024-09-12T00:59:53.686 INFO:tasks.workunit.client.0.smithi070.stderr: -2/-2 (syslog threshold) 2024-09-12T00:59:53.686 INFO:tasks.workunit.client.0.smithi070.stderr: 99/99 (stderr threshold) 2024-09-12T00:59:53.686 INFO:tasks.workunit.client.0.smithi070.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:59:53.686 INFO:tasks.workunit.client.0.smithi070.stderr: 7fd18f7fe640 / http_manager 2024-09-12T00:59:53.687 INFO:tasks.workunit.client.0.smithi070.stderr: 7fd21dfe3640 / http_manager 2024-09-12T00:59:53.687 INFO:tasks.workunit.client.0.smithi070.stderr: 7fd21efe5640 / rgw_dt_lg_renew 2024-09-12T00:59:53.687 INFO:tasks.workunit.client.0.smithi070.stderr: 7fd23e7fc640 / ms_dispatch 2024-09-12T00:59:53.687 INFO:tasks.workunit.client.0.smithi070.stderr: 7fd23ffff640 / io_context_pool 2024-09-12T00:59:53.687 INFO:tasks.workunit.client.0.smithi070.stderr: 7fd24e7fc640 / ms_dispatch 2024-09-12T00:59:53.687 INFO:tasks.workunit.client.0.smithi070.stderr: 7fd25560a640 / ms_dispatch 2024-09-12T00:59:53.687 INFO:tasks.workunit.client.0.smithi070.stderr: 7fd256e0d640 / io_context_pool 2024-09-12T00:59:53.687 INFO:tasks.workunit.client.0.smithi070.stderr: 7fd368501640 / msgr-worker-2 2024-09-12T00:59:53.687 INFO:tasks.workunit.client.0.smithi070.stderr: 7fd368d02640 / msgr-worker-1 2024-09-12T00:59:53.687 INFO:tasks.workunit.client.0.smithi070.stderr: 7fd369503640 / msgr-worker-0 2024-09-12T00:59:53.687 INFO:tasks.workunit.client.0.smithi070.stderr: 7fd369d04640 / io_context_pool 2024-09-12T00:59:53.687 INFO:tasks.workunit.client.0.smithi070.stderr: 7fd36b1fc9c0 / radosgw-admin 2024-09-12T00:59:53.687 INFO:tasks.workunit.client.0.smithi070.stderr: max_recent 500 2024-09-12T00:59:53.687 INFO:tasks.workunit.client.0.smithi070.stderr: max_new 1000 2024-09-12T00:59:53.688 INFO:tasks.workunit.client.0.smithi070.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:59:53.554999Z_4bb92aa1-54c5-4f55-bba8-1432a650f0cf/log 2024-09-12T00:59:53.688 INFO:tasks.workunit.client.0.smithi070.stderr:--- end dump of recent events --- 2024-09-12T00:59:53.688 INFO:tasks.workunit.client.0.smithi070.stderr:Aborted 2024-09-12T00:59:53.688 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:59:53.693 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:59:53.693 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:59:53.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.628+0000 7f32d85c69c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.632+0000 7f32d85c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.632+0000 7f32d85c69c0 20 realm 2024-09-12T00:59:53.693 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.632+0000 7f32d85c69c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.694 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.632+0000 7f32d85c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.694 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.632+0000 7f32d85c69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:59:53.694 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.632+0000 7f32d85c69c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.694 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.632+0000 7f32d85c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.694 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.632+0000 7f32d85c69c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.694 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.632+0000 7f32d85c69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:59:53.694 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.632+0000 7f32d85c69c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.694 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.632+0000 7f32d85c69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:59:53.694 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.632+0000 7f32d85c69c0 20 searching for the correct realm 2024-09-12T00:59:53.694 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.640+0000 7f32d60cc640 0 -- 172.21.15.70:0/4237732222 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f32d0020040 msgr2=0x7f32d0022440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:59:53.694 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.648+0000 7f32d60cc640 0 -- 172.21.15.70:0/4237732222 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f32d0030400 msgr2=0x7f32d0030880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:59:53.694 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.652+0000 7f32d85c69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:59:53.694 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.652+0000 7f32d85c69c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T00:59:53.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.652+0000 7f32d85c69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:59:53.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.652+0000 7f32d85c69c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T00:59:53.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.652+0000 7f32d85c69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:59:53.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.652+0000 7f32d85c69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:59:53.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.652+0000 7f32d85c69c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.652+0000 7f32d85c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.652+0000 7f32d85c69c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.652+0000 7f32d85c69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:59:53.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.652+0000 7f32d85c69c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.652+0000 7f32d85c69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:59:53.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.652+0000 7f32d85c69c0 20 zone default found 2024-09-12T00:59:53.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.652+0000 7f32d85c69c0 4 Realm: () 2024-09-12T00:59:53.695 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.652+0000 7f32d85c69c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T00:59:53.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.652+0000 7f32d85c69c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T00:59:53.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.652+0000 7f32d85c69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:59:53.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.652+0000 7f32d85c69c0 20 zonegroup default 2024-09-12T00:59:53.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.652+0000 7f32d85c69c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.652+0000 7f32d85c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.652+0000 7f32d85c69c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.656+0000 7f32d85c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.656+0000 7f32d85c69c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.656+0000 7f32d85c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:59:53.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.656+0000 7f32d85c69c0 20 started sync module instance, tier type = 2024-09-12T00:59:53.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.656+0000 7f32d85c69c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T00:59:53.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.668+0000 7f32d85c69c0 20 add_watcher() i=0 2024-09-12T00:59:53.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.668+0000 7f32d85c69c0 20 add_watcher() i=1 2024-09-12T00:59:53.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.668+0000 7f32d85c69c0 20 add_watcher() i=2 2024-09-12T00:59:53.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.668+0000 7f32d85c69c0 20 add_watcher() i=3 2024-09-12T00:59:53.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.668+0000 7f32d85c69c0 20 add_watcher() i=4 2024-09-12T00:59:53.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.668+0000 7f32d85c69c0 20 add_watcher() i=5 2024-09-12T00:59:53.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.668+0000 7f32d85c69c0 20 add_watcher() i=6 2024-09-12T00:59:53.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.668+0000 7f32d85c69c0 20 add_watcher() i=7 2024-09-12T00:59:53.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.668+0000 7f32d85c69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:59:53.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.672+0000 7f318cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:59:53.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.672+0000 7f32d85c69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:59:53.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.672+0000 7f32d85c69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:59:53.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.672+0000 7f32d85c69c0 5 note: GC not initialized 2024-09-12T00:59:53.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.672+0000 7f31077fe640 20 reqs_thread_entry: start 2024-09-12T00:59:53.697 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.672+0000 7f32d85c69c0 20 init_complete bucket index max shards: 1 2024-09-12T00:59:53.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.672+0000 7f32d85c69c0 20 Filter name: none 2024-09-12T00:59:53.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.672+0000 7f31057fa640 20 reqs_thread_entry: start 2024-09-12T00:59:53.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.672+0000 7f32d85c69c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:59:53.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.672+0000 7f32d85c69c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.676+0000 7f32d85c69c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:59:53.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.676+0000 7f32d85c69c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:59:53.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.676+0000 7f32d85c69c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:59:53.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.676+0000 7f32d85c69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : miss 2024-09-12T00:59:53.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.676+0000 7f32d85c69c0 20 rados->read ofs=0 len=0 2024-09-12T00:59:53.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.676+0000 7f32d85c69c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:59:53.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.676+0000 7f32d85c69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T00:59:53.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.676+0000 7f32d85c69c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T00:59:53.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.676+0000 7f32d85c69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:59:53.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.676+0000 7f32d85c69c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:59:53.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.676+0000 7f32d85c69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T00:59:53.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.676+0000 7f32d85c69c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.0 2024-09-12T00:59:53.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.676+0000 7f32d85c69c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.0 2024-09-12T00:59:53.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.676+0000 7f32d85c69c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.1 2024-09-12T00:59:53.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.676+0000 7f32d85c69c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.1 2024-09-12T00:59:53.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.676+0000 7f32d85c69c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.2 2024-09-12T00:59:53.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.676+0000 7f32d85c69c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.2 2024-09-12T00:59:53.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.680+0000 7f318cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:59:53.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.684+0000 7f32d85c69c0 20 remove_watcher() i=0 2024-09-12T00:59:53.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.684+0000 7f32d85c69c0 2 removed watcher, disabling cache 2024-09-12T00:59:53.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.684+0000 7f32d85c69c0 20 remove_watcher() i=1 2024-09-12T00:59:53.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.688+0000 7f32d85c69c0 20 remove_watcher() i=2 2024-09-12T00:59:53.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.688+0000 7f32d85c69c0 20 remove_watcher() i=3 2024-09-12T00:59:53.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.692+0000 7f32d85c69c0 20 remove_watcher() i=4 2024-09-12T00:59:53.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.692+0000 7f32d85c69c0 20 remove_watcher() i=5 2024-09-12T00:59:53.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.692+0000 7f32d85c69c0 20 remove_watcher() i=6 2024-09-12T00:59:53.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T00:59:53.696+0000 7f32d85c69c0 20 remove_watcher() i=7 2024-09-12T00:59:53.700 INFO:tasks.workunit.client.0.smithi070.stderr: test: duplicated entries can be purged manually 2024-09-12T01:00:23.726 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T01:00:23.759 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:23.759 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:23.802 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.811+0000 7f33d569c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:23.804 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.811+0000 7f33d569c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:23.804 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.811+0000 7f33d569c9c0 20 realm 2024-09-12T01:00:23.804 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.811+0000 7f33d569c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:23.805 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.811+0000 7f33d569c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:23.805 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.811+0000 7f33d569c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:23.805 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.811+0000 7f33d569c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:23.805 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.811+0000 7f33d569c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:23.805 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.811+0000 7f33d569c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:23.806 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.815+0000 7f33d569c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:23.806 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.815+0000 7f33d569c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:23.807 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.815+0000 7f33d569c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:23.808 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.815+0000 7f33d569c9c0 20 searching for the correct realm 2024-09-12T01:00:23.813 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.823+0000 7f33d31a2640 0 -- 172.21.15.70:0/678109920 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f33cc111040 msgr2=0x7f33cc0f8790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:23.820 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.827+0000 7f33d31a2640 0 -- 172.21.15.70:0/678109920 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f33cc120c20 msgr2=0x7f33cc102040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:23.826 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.835+0000 7f33d569c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:23.826 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.835+0000 7f33d569c9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:00:23.826 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.835+0000 7f33d569c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:23.826 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.835+0000 7f33d569c9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:00:23.827 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.835+0000 7f33d569c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:23.827 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.835+0000 7f33d569c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:23.827 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.835+0000 7f33d569c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:23.827 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.835+0000 7f33d569c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:23.827 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.835+0000 7f33d569c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:23.828 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.835+0000 7f33d569c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:23.828 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.835+0000 7f33d569c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:23.828 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.835+0000 7f33d569c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:23.828 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.835+0000 7f33d569c9c0 20 zone default found 2024-09-12T01:00:23.828 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.835+0000 7f33d569c9c0 4 Realm: () 2024-09-12T01:00:23.828 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.835+0000 7f33d569c9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:00:23.828 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.835+0000 7f33d569c9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:00:23.829 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.835+0000 7f33d569c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:23.829 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.835+0000 7f33d569c9c0 20 zonegroup default 2024-09-12T01:00:23.829 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.835+0000 7f33d569c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:23.829 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.835+0000 7f33d569c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:23.829 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.835+0000 7f33d569c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:23.829 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.835+0000 7f33d569c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:23.830 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.835+0000 7f33d569c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:23.830 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.835+0000 7f33d569c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:23.830 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.835+0000 7f33d569c9c0 20 started sync module instance, tier type = 2024-09-12T01:00:23.830 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.835+0000 7f33d569c9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:00:23.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.851+0000 7f33d569c9c0 20 add_watcher() i=0 2024-09-12T01:00:23.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.851+0000 7f33d569c9c0 20 add_watcher() i=1 2024-09-12T01:00:23.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.851+0000 7f33d569c9c0 20 add_watcher() i=2 2024-09-12T01:00:23.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.851+0000 7f33d569c9c0 20 add_watcher() i=3 2024-09-12T01:00:23.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.851+0000 7f33d569c9c0 20 add_watcher() i=4 2024-09-12T01:00:23.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.851+0000 7f33d569c9c0 20 add_watcher() i=5 2024-09-12T01:00:23.844 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.851+0000 7f33d569c9c0 20 add_watcher() i=6 2024-09-12T01:00:23.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.851+0000 7f33d569c9c0 20 add_watcher() i=7 2024-09-12T01:00:23.845 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.851+0000 7f33d569c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:23.847 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.855+0000 7f3289fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:23.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.855+0000 7f33d569c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:23.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.855+0000 7f33d569c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:23.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.855+0000 7f33d569c9c0 5 note: GC not initialized 2024-09-12T01:00:23.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.855+0000 7f3288fe1640 20 reqs_thread_entry: start 2024-09-12T01:00:23.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.855+0000 7f33d569c9c0 20 init_complete bucket index max shards: 1 2024-09-12T01:00:23.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.855+0000 7f33d569c9c0 20 Filter name: none 2024-09-12T01:00:23.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.855+0000 7f32027fc640 20 reqs_thread_entry: start 2024-09-12T01:00:23.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.855+0000 7f33d569c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:23.850 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.859+0000 7f33d569c9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T01:00:23.850 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.859+0000 7f33d569c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:23.851 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.859+0000 7f33d569c9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T01:00:23.851 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.859+0000 7f33d569c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:00:23.851 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.859+0000 7f33d569c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:23.852 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.859+0000 7f33d569c9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T01:00:23.852 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.859+0000 7f33d569c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:23.853 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.859+0000 7f33d569c9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T01:00:23.853 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.859+0000 7f33d569c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:00:23.855 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.863+0000 7f3289fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:23.859 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.867+0000 7f33d569c9c0 20 remove_watcher() i=0 2024-09-12T01:00:23.859 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.867+0000 7f33d569c9c0 2 removed watcher, disabling cache 2024-09-12T01:00:23.861 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.871+0000 7f33d569c9c0 20 remove_watcher() i=1 2024-09-12T01:00:23.863 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.871+0000 7f33d569c9c0 20 remove_watcher() i=2 2024-09-12T01:00:23.865 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.875+0000 7f33d569c9c0 20 remove_watcher() i=3 2024-09-12T01:00:23.867 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.875+0000 7f33d569c9c0 20 remove_watcher() i=4 2024-09-12T01:00:23.868 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.875+0000 7f33d569c9c0 20 remove_watcher() i=5 2024-09-12T01:00:23.870 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.879+0000 7f33d569c9c0 20 remove_watcher() i=6 2024-09-12T01:00:23.871 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.879+0000 7f33d569c9c0 20 remove_watcher() i=7 2024-09-12T01:00:23.885 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:23.885 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T01:00:23.885 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: a-bucket id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 num_objects: 11 size_kb: 1 num_shards: 3 2024-09-12T01:00:23.885 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:23.886 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T01:00:23.921 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:23.921 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:23.964 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.971+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:23.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.975+0000 7f22b7db09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:23.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.975+0000 7f22b7db09c0 20 realm 2024-09-12T01:00:23.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.975+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:23.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.975+0000 7f22b7db09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:23.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.975+0000 7f22b7db09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:23.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.975+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:23.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.975+0000 7f22b7db09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:23.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.975+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:23.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.975+0000 7f22b7db09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:23.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.975+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:23.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.979+0000 7f22b7db09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:23.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.979+0000 7f22b7db09c0 20 searching for the correct realm 2024-09-12T01:00:23.976 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.983+0000 7f22b60b7640 0 -- 172.21.15.70:0/2116115508 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f22ac03ba90 msgr2=0x7f22ac01a400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:23.983 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.991+0000 7f22b50b5640 0 -- 172.21.15.70:0/2116115508 >> [v2:172.21.15.70:6824/2477739226,v1:172.21.15.70:6825/2477739226] conn(0x562bde8c1360 msgr2=0x562bde8c3770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:23.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.995+0000 7f22b7db09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:23.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.995+0000 7f22b7db09c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:00:23.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.995+0000 7f22b7db09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:23.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.995+0000 7f22b7db09c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:00:23.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.995+0000 7f22b7db09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:23.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.995+0000 7f22b7db09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:23.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.995+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:23.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.995+0000 7f22b7db09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:23.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.995+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:23.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:23.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:23.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:23.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 zone default found 2024-09-12T01:00:23.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.999+0000 7f22b7db09c0 4 Realm: () 2024-09-12T01:00:23.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.999+0000 7f22b7db09c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:00:23.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.999+0000 7f22b7db09c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:00:23.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.999+0000 7f22b7db09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:23.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 zonegroup default 2024-09-12T01:00:23.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:23.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:23.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:23.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:23.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:23.992 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:23.992 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 started sync module instance, tier type = 2024-09-12T01:00:23.992 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:00:24.006 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.015+0000 7f22b7db09c0 20 add_watcher() i=0 2024-09-12T01:00:24.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.015+0000 7f22b7db09c0 20 add_watcher() i=1 2024-09-12T01:00:24.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.015+0000 7f22b7db09c0 20 add_watcher() i=2 2024-09-12T01:00:24.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.015+0000 7f22b7db09c0 20 add_watcher() i=3 2024-09-12T01:00:24.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.015+0000 7f22b7db09c0 20 add_watcher() i=4 2024-09-12T01:00:24.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.015+0000 7f22b7db09c0 20 add_watcher() i=5 2024-09-12T01:00:24.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.015+0000 7f22b7db09c0 20 add_watcher() i=6 2024-09-12T01:00:24.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.015+0000 7f22b7db09c0 20 add_watcher() i=7 2024-09-12T01:00:24.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.015+0000 7f22b7db09c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:24.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.019+0000 7f21677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:24.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.019+0000 7f22b7db09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:24.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.019+0000 7f22b7db09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:24.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 note: GC not initialized 2024-09-12T01:00:24.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.019+0000 7f21667fc640 20 reqs_thread_entry: start 2024-09-12T01:00:24.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.019+0000 7f22b7db09c0 20 init_complete bucket index max shards: 1 2024-09-12T01:00:24.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.019+0000 7f22b7db09c0 20 Filter name: none 2024-09-12T01:00:24.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.019+0000 7f20d7fff640 20 reqs_thread_entry: start 2024-09-12T01:00:24.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.019+0000 7f22b7db09c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T01:00:24.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.019+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.019+0000 7f22b7db09c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T01:00:24.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.019+0000 7f22b7db09c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T01:00:24.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.019+0000 7f22b7db09c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T01:00:24.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.019+0000 7f22b7db09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : miss 2024-09-12T01:00:24.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.019+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.023+0000 7f22b7db09c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T01:00:24.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.023+0000 7f22b7db09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T01:00:24.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.023+0000 7f22b7db09c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T01:00:24.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.023+0000 7f22b7db09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:00:24.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.023+0000 7f22b7db09c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:24.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.023+0000 7f22b7db09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T01:00:24.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.023+0000 7f22b7db09c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T01:00:24.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.031+0000 7f22b7db09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T01:00:24.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.031+0000 7f22b7db09c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T01:00:24.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.031+0000 7f22b7db09c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:24.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.031+0000 7f22b7db09c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18, ofs0, ns] 2024-09-12T01:00:24.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.031+0000 7f21997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431649 cookie 94746417312320 notifier 8427 bl.length()=911 2024-09-12T01:00:24.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.031+0000 7f21997fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T01:00:24.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.031+0000 7f21997fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T01:00:24.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.031+0000 7f21997fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:24.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.035+0000 7f22b7db09c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_sources= new_sources= 2024-09-12T01:00:24.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.035+0000 7f22b7db09c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential sources added=[] removed=[] 2024-09-12T01:00:24.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.035+0000 7f22b7db09c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_dests= new_dests= 2024-09-12T01:00:24.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.035+0000 7f22b7db09c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential dests added=[] removed=[] 2024-09-12T01:00:24.318 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f22b7db09c0 time 2024-09-12T01:00:24.044652+0000 2024-09-12T01:00:24.318 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T01:00:24.318 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T01:00:24.318 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f22bb68a2eb] 2024-09-12T01:00:24.318 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f22bb68a49f] 2024-09-12T01:00:24.318 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562bdd490cc1] 2024-09-12T01:00:24.319 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562bdd4a5d5a] 2024-09-12T01:00:24.319 INFO:tasks.workunit.client.0.smithi070.stderr: 5: main() 2024-09-12T01:00:24.319 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f22ba4f0d90] 2024-09-12T01:00:24.319 INFO:tasks.workunit.client.0.smithi070.stderr: 7: __libc_start_main() 2024-09-12T01:00:24.319 INFO:tasks.workunit.client.0.smithi070.stderr: 8: _start() 2024-09-12T01:00:24.319 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.039+0000 7f22b7db09c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f22b7db09c0 time 2024-09-12T01:00:24.044652+0000 2024-09-12T01:00:24.319 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T01:00:24.319 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.319 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T01:00:24.319 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f22bb68a2eb] 2024-09-12T01:00:24.319 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f22bb68a49f] 2024-09-12T01:00:24.319 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562bdd490cc1] 2024-09-12T01:00:24.319 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562bdd4a5d5a] 2024-09-12T01:00:24.319 INFO:tasks.workunit.client.0.smithi070.stderr: 5: main() 2024-09-12T01:00:24.320 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f22ba4f0d90] 2024-09-12T01:00:24.320 INFO:tasks.workunit.client.0.smithi070.stderr: 7: __libc_start_main() 2024-09-12T01:00:24.320 INFO:tasks.workunit.client.0.smithi070.stderr: 8: _start() 2024-09-12T01:00:24.320 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.320 INFO:tasks.workunit.client.0.smithi070.stderr:*** Caught signal (Aborted) ** 2024-09-12T01:00:24.320 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f22b7db09c0 thread_name:radosgw-admin 2024-09-12T01:00:24.320 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T01:00:24.320 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f22ba509520] 2024-09-12T01:00:24.320 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T01:00:24.320 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T01:00:24.320 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T01:00:24.320 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f22bb68a345] 2024-09-12T01:00:24.320 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f22bb68a49f] 2024-09-12T01:00:24.321 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562bdd490cc1] 2024-09-12T01:00:24.321 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562bdd4a5d5a] 2024-09-12T01:00:24.321 INFO:tasks.workunit.client.0.smithi070.stderr: 9: main() 2024-09-12T01:00:24.321 INFO:tasks.workunit.client.0.smithi070.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f22ba4f0d90] 2024-09-12T01:00:24.321 INFO:tasks.workunit.client.0.smithi070.stderr: 11: __libc_start_main() 2024-09-12T01:00:24.321 INFO:tasks.workunit.client.0.smithi070.stderr: 12: _start() 2024-09-12T01:00:24.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.039+0000 7f22b7db09c0 -1 *** Caught signal (Aborted) ** 2024-09-12T01:00:24.321 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f22b7db09c0 thread_name:radosgw-admin 2024-09-12T01:00:24.321 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.321 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T01:00:24.321 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f22ba509520] 2024-09-12T01:00:24.321 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T01:00:24.321 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T01:00:24.321 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T01:00:24.322 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f22bb68a345] 2024-09-12T01:00:24.322 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f22bb68a49f] 2024-09-12T01:00:24.322 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562bdd490cc1] 2024-09-12T01:00:24.322 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562bdd4a5d5a] 2024-09-12T01:00:24.322 INFO:tasks.workunit.client.0.smithi070.stderr: 9: main() 2024-09-12T01:00:24.322 INFO:tasks.workunit.client.0.smithi070.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f22ba4f0d90] 2024-09-12T01:00:24.322 INFO:tasks.workunit.client.0.smithi070.stderr: 11: __libc_start_main() 2024-09-12T01:00:24.322 INFO:tasks.workunit.client.0.smithi070.stderr: 12: _start() 2024-09-12T01:00:24.322 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T01:00:24.322 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.323 INFO:tasks.workunit.client.0.smithi070.stderr:--- begin dump of recent events --- 2024-09-12T01:00:24.323 INFO:tasks.workunit.client.0.smithi070.stderr: -499> 2024-09-12T01:00:23.951+0000 7f22b50b5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T01:00:24.323 INFO:tasks.workunit.client.0.smithi070.stderr: -498> 2024-09-12T01:00:23.951+0000 7f22b60b7640 10 monclient(hunting): handle_auth_done global_id 8415 payload 274 2024-09-12T01:00:24.323 INFO:tasks.workunit.client.0.smithi070.stderr: -497> 2024-09-12T01:00:23.951+0000 7f22b60b7640 10 monclient: _finish_hunting 0 2024-09-12T01:00:24.323 INFO:tasks.workunit.client.0.smithi070.stderr: -496> 2024-09-12T01:00:23.951+0000 7f22b60b7640 1 monclient: found mon.noname-a 2024-09-12T01:00:24.323 INFO:tasks.workunit.client.0.smithi070.stderr: -495> 2024-09-12T01:00:23.951+0000 7f22b60b7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T01:00:24.323 INFO:tasks.workunit.client.0.smithi070.stderr: -494> 2024-09-12T01:00:23.951+0000 7f21a3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T01:00:24.323 INFO:tasks.workunit.client.0.smithi070.stderr: -493> 2024-09-12T01:00:23.951+0000 7f21a3e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T01:00:24.323 INFO:tasks.workunit.client.0.smithi070.stderr: -492> 2024-09-12T01:00:23.951+0000 7f21a3e07640 10 monclient: dump: 2024-09-12T01:00:24.323 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T01:00:24.323 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T01:00:24.323 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.323 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.324 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T01:00:24.324 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.324 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:00:24.324 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T01:00:24.324 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T01:00:24.324 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.324 INFO:tasks.workunit.client.0.smithi070.stderr: -491> 2024-09-12T01:00:23.951+0000 7f21a3e07640 10 monclient: _finish_auth 0 2024-09-12T01:00:24.324 INFO:tasks.workunit.client.0.smithi070.stderr: -490> 2024-09-12T01:00:23.951+0000 7f21a3e07640 10 monclient: _check_auth_tickets 2024-09-12T01:00:24.324 INFO:tasks.workunit.client.0.smithi070.stderr: -489> 2024-09-12T01:00:23.951+0000 7f21a3e07640 10 monclient: handle_config config(0 keys) 2024-09-12T01:00:24.324 INFO:tasks.workunit.client.0.smithi070.stderr: -488> 2024-09-12T01:00:23.951+0000 7f21a3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T01:00:24.324 INFO:tasks.workunit.client.0.smithi070.stderr: -487> 2024-09-12T01:00:23.951+0000 7f21a3e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T01:00:24.324 INFO:tasks.workunit.client.0.smithi070.stderr: -486> 2024-09-12T01:00:23.951+0000 7f21a3e07640 10 monclient: dump: 2024-09-12T01:00:24.324 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T01:00:24.324 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T01:00:24.325 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.325 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.325 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T01:00:24.325 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.325 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:00:24.325 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T01:00:24.325 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T01:00:24.325 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.325 INFO:tasks.workunit.client.0.smithi070.stderr: -485> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 monclient: authenticate success, global_id 8415 2024-09-12T01:00:24.326 INFO:tasks.workunit.client.0.smithi070.stderr: -484> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 10 monclient: get_monmap_and_config success 2024-09-12T01:00:24.326 INFO:tasks.workunit.client.0.smithi070.stderr: -483> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 4 set_mon_vals no callback set 2024-09-12T01:00:24.326 INFO:tasks.workunit.client.0.smithi070.stderr: -482> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 10 monclient: shutdown 2024-09-12T01:00:24.326 INFO:tasks.workunit.client.0.smithi070.stderr: -481> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) unregister_commands rotate-key 2024-09-12T01:00:24.326 INFO:tasks.workunit.client.0.smithi070.stderr: -480> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 10 monclient: build_initial_monmap 2024-09-12T01:00:24.326 INFO:tasks.workunit.client.0.smithi070.stderr: -479> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 1 build_initial for_mkfs: 0 2024-09-12T01:00:24.326 INFO:tasks.workunit.client.0.smithi070.stderr: -478> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 10 monclient: monmap: 2024-09-12T01:00:24.326 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T01:00:24.326 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T01:00:24.326 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T01:00:24.326 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T01:00:24.326 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T01:00:24.326 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.327 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T01:00:24.327 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T01:00:24.327 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T01:00:24.327 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.327 INFO:tasks.workunit.client.0.smithi070.stderr: -477> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding auth protocol: cephx 2024-09-12T01:00:24.327 INFO:tasks.workunit.client.0.smithi070.stderr: -476> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding auth protocol: cephx 2024-09-12T01:00:24.327 INFO:tasks.workunit.client.0.smithi070.stderr: -475> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding auth protocol: cephx 2024-09-12T01:00:24.327 INFO:tasks.workunit.client.0.smithi070.stderr: -474> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding con mode: secure 2024-09-12T01:00:24.327 INFO:tasks.workunit.client.0.smithi070.stderr: -473> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding con mode: crc 2024-09-12T01:00:24.327 INFO:tasks.workunit.client.0.smithi070.stderr: -472> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding con mode: secure 2024-09-12T01:00:24.327 INFO:tasks.workunit.client.0.smithi070.stderr: -471> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding con mode: crc 2024-09-12T01:00:24.327 INFO:tasks.workunit.client.0.smithi070.stderr: -470> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding con mode: secure 2024-09-12T01:00:24.327 INFO:tasks.workunit.client.0.smithi070.stderr: -469> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding con mode: crc 2024-09-12T01:00:24.327 INFO:tasks.workunit.client.0.smithi070.stderr: -468> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding con mode: crc 2024-09-12T01:00:24.328 INFO:tasks.workunit.client.0.smithi070.stderr: -467> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding con mode: secure 2024-09-12T01:00:24.328 INFO:tasks.workunit.client.0.smithi070.stderr: -466> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding con mode: crc 2024-09-12T01:00:24.328 INFO:tasks.workunit.client.0.smithi070.stderr: -465> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding con mode: secure 2024-09-12T01:00:24.328 INFO:tasks.workunit.client.0.smithi070.stderr: -464> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding con mode: crc 2024-09-12T01:00:24.328 INFO:tasks.workunit.client.0.smithi070.stderr: -463> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding con mode: secure 2024-09-12T01:00:24.328 INFO:tasks.workunit.client.0.smithi070.stderr: -462> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T01:00:24.328 INFO:tasks.workunit.client.0.smithi070.stderr: -461> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 1 librados: starting msgr at 2024-09-12T01:00:24.328 INFO:tasks.workunit.client.0.smithi070.stderr: -460> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 1 librados: starting objecter 2024-09-12T01:00:24.328 INFO:tasks.workunit.client.0.smithi070.stderr: -459> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command objecter_requests hook 0x562bde5488a0 2024-09-12T01:00:24.328 INFO:tasks.workunit.client.0.smithi070.stderr: -458> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 1 librados: setting wanted keys 2024-09-12T01:00:24.328 INFO:tasks.workunit.client.0.smithi070.stderr: -457> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 1 librados: calling monclient init 2024-09-12T01:00:24.328 INFO:tasks.workunit.client.0.smithi070.stderr: -456> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient: init 2024-09-12T01:00:24.328 INFO:tasks.workunit.client.0.smithi070.stderr: -455> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding auth protocol: cephx 2024-09-12T01:00:24.329 INFO:tasks.workunit.client.0.smithi070.stderr: -454> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding auth protocol: cephx 2024-09-12T01:00:24.329 INFO:tasks.workunit.client.0.smithi070.stderr: -453> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding auth protocol: cephx 2024-09-12T01:00:24.329 INFO:tasks.workunit.client.0.smithi070.stderr: -452> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding con mode: secure 2024-09-12T01:00:24.329 INFO:tasks.workunit.client.0.smithi070.stderr: -451> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding con mode: crc 2024-09-12T01:00:24.329 INFO:tasks.workunit.client.0.smithi070.stderr: -450> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding con mode: secure 2024-09-12T01:00:24.329 INFO:tasks.workunit.client.0.smithi070.stderr: -449> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding con mode: crc 2024-09-12T01:00:24.329 INFO:tasks.workunit.client.0.smithi070.stderr: -448> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding con mode: secure 2024-09-12T01:00:24.329 INFO:tasks.workunit.client.0.smithi070.stderr: -447> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding con mode: crc 2024-09-12T01:00:24.329 INFO:tasks.workunit.client.0.smithi070.stderr: -446> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding con mode: crc 2024-09-12T01:00:24.329 INFO:tasks.workunit.client.0.smithi070.stderr: -445> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding con mode: secure 2024-09-12T01:00:24.329 INFO:tasks.workunit.client.0.smithi070.stderr: -444> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding con mode: crc 2024-09-12T01:00:24.329 INFO:tasks.workunit.client.0.smithi070.stderr: -443> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding con mode: secure 2024-09-12T01:00:24.329 INFO:tasks.workunit.client.0.smithi070.stderr: -442> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding con mode: crc 2024-09-12T01:00:24.330 INFO:tasks.workunit.client.0.smithi070.stderr: -441> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding con mode: secure 2024-09-12T01:00:24.330 INFO:tasks.workunit.client.0.smithi070.stderr: -440> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T01:00:24.330 INFO:tasks.workunit.client.0.smithi070.stderr: -439> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T01:00:24.330 INFO:tasks.workunit.client.0.smithi070.stderr: -438> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command rotate-key hook 0x562bde7d0e68 2024-09-12T01:00:24.330 INFO:tasks.workunit.client.0.smithi070.stderr: -437> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient: _reopen_session rank -1 2024-09-12T01:00:24.330 INFO:tasks.workunit.client.0.smithi070.stderr: -436> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T01:00:24.330 INFO:tasks.workunit.client.0.smithi070.stderr: -435> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient(hunting): picked mon.noname-b con 0x562bde6814f0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T01:00:24.330 INFO:tasks.workunit.client.0.smithi070.stderr: -434> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient(hunting): picked mon.noname-c con 0x562bde6902e0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T01:00:24.330 INFO:tasks.workunit.client.0.smithi070.stderr: -433> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient(hunting): picked mon.noname-a con 0x562bde7d7260 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T01:00:24.330 INFO:tasks.workunit.client.0.smithi070.stderr: -432> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient(hunting): start opening mon connection 2024-09-12T01:00:24.330 INFO:tasks.workunit.client.0.smithi070.stderr: -431> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient(hunting): start opening mon connection 2024-09-12T01:00:24.330 INFO:tasks.workunit.client.0.smithi070.stderr: -430> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient(hunting): start opening mon connection 2024-09-12T01:00:24.330 INFO:tasks.workunit.client.0.smithi070.stderr: -429> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient(hunting): _renew_subs 2024-09-12T01:00:24.330 INFO:tasks.workunit.client.0.smithi070.stderr: -428> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient(hunting): authenticate will time out at 2474.404651s 2024-09-12T01:00:24.331 INFO:tasks.workunit.client.0.smithi070.stderr: -427> 2024-09-12T01:00:23.955+0000 7f22b60b7640 10 monclient(hunting): get_auth_request con 0x562bde7d7260 auth_method 0 2024-09-12T01:00:24.331 INFO:tasks.workunit.client.0.smithi070.stderr: -426> 2024-09-12T01:00:23.955+0000 7f22b60b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T01:00:24.331 INFO:tasks.workunit.client.0.smithi070.stderr: -425> 2024-09-12T01:00:23.955+0000 7f22b60b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T01:00:24.331 INFO:tasks.workunit.client.0.smithi070.stderr: -424> 2024-09-12T01:00:23.955+0000 7f22b60b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T01:00:24.331 INFO:tasks.workunit.client.0.smithi070.stderr: -423> 2024-09-12T01:00:23.955+0000 7f22b50b5640 10 monclient(hunting): get_auth_request con 0x562bde6902e0 auth_method 0 2024-09-12T01:00:24.331 INFO:tasks.workunit.client.0.smithi070.stderr: -422> 2024-09-12T01:00:23.955+0000 7f22b50b5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T01:00:24.331 INFO:tasks.workunit.client.0.smithi070.stderr: -421> 2024-09-12T01:00:23.955+0000 7f22b50b5640 10 monclient(hunting): _init_auth method 2 2024-09-12T01:00:24.331 INFO:tasks.workunit.client.0.smithi070.stderr: -420> 2024-09-12T01:00:23.955+0000 7f22b50b5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T01:00:24.331 INFO:tasks.workunit.client.0.smithi070.stderr: -419> 2024-09-12T01:00:23.955+0000 7f22b60b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T01:00:24.331 INFO:tasks.workunit.client.0.smithi070.stderr: -418> 2024-09-12T01:00:23.955+0000 7f22b60b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T01:00:24.331 INFO:tasks.workunit.client.0.smithi070.stderr: -417> 2024-09-12T01:00:23.955+0000 7f22b60b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T01:00:24.331 INFO:tasks.workunit.client.0.smithi070.stderr: -416> 2024-09-12T01:00:23.955+0000 7f22b50b5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T01:00:24.331 INFO:tasks.workunit.client.0.smithi070.stderr: -415> 2024-09-12T01:00:23.955+0000 7f22b50b5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T01:00:24.332 INFO:tasks.workunit.client.0.smithi070.stderr: -414> 2024-09-12T01:00:23.955+0000 7f22b50b5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T01:00:24.332 INFO:tasks.workunit.client.0.smithi070.stderr: -413> 2024-09-12T01:00:23.955+0000 7f22b60b7640 10 monclient(hunting): handle_auth_done global_id 8418 payload 824 2024-09-12T01:00:24.332 INFO:tasks.workunit.client.0.smithi070.stderr: -412> 2024-09-12T01:00:23.955+0000 7f22b60b7640 10 monclient: _finish_hunting 0 2024-09-12T01:00:24.332 INFO:tasks.workunit.client.0.smithi070.stderr: -411> 2024-09-12T01:00:23.955+0000 7f22b60b7640 1 monclient: found mon.noname-a 2024-09-12T01:00:24.332 INFO:tasks.workunit.client.0.smithi070.stderr: -410> 2024-09-12T01:00:23.955+0000 7f22b60b7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T01:00:24.332 INFO:tasks.workunit.client.0.smithi070.stderr: -409> 2024-09-12T01:00:23.955+0000 7f21a2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T01:00:24.332 INFO:tasks.workunit.client.0.smithi070.stderr: -408> 2024-09-12T01:00:23.955+0000 7f21a2604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T01:00:24.332 INFO:tasks.workunit.client.0.smithi070.stderr: -407> 2024-09-12T01:00:23.955+0000 7f21a2604640 10 monclient: dump: 2024-09-12T01:00:24.332 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T01:00:24.332 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T01:00:24.332 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.332 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.332 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T01:00:24.333 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.333 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:00:24.333 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T01:00:24.333 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T01:00:24.333 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.333 INFO:tasks.workunit.client.0.smithi070.stderr: -406> 2024-09-12T01:00:23.955+0000 7f21a2604640 10 monclient: _finish_auth 0 2024-09-12T01:00:24.333 INFO:tasks.workunit.client.0.smithi070.stderr: -405> 2024-09-12T01:00:23.955+0000 7f21a2604640 10 monclient: _check_auth_tickets 2024-09-12T01:00:24.333 INFO:tasks.workunit.client.0.smithi070.stderr: -404> 2024-09-12T01:00:23.955+0000 7f21a2604640 10 monclient: handle_config config(0 keys) 2024-09-12T01:00:24.333 INFO:tasks.workunit.client.0.smithi070.stderr: -403> 2024-09-12T01:00:23.955+0000 7f21a2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T01:00:24.333 INFO:tasks.workunit.client.0.smithi070.stderr: -402> 2024-09-12T01:00:23.955+0000 7f21a2604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T01:00:24.333 INFO:tasks.workunit.client.0.smithi070.stderr: -401> 2024-09-12T01:00:23.955+0000 7f21a2604640 10 monclient: dump: 2024-09-12T01:00:24.333 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T01:00:24.333 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T01:00:24.333 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.334 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.334 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T01:00:24.334 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.334 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:00:24.334 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T01:00:24.334 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T01:00:24.334 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.334 INFO:tasks.workunit.client.0.smithi070.stderr: -400> 2024-09-12T01:00:23.955+0000 7f21a3e07640 4 set_mon_vals no callback set 2024-09-12T01:00:24.334 INFO:tasks.workunit.client.0.smithi070.stderr: -399> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 monclient: authenticate success, global_id 8418 2024-09-12T01:00:24.334 INFO:tasks.workunit.client.0.smithi070.stderr: -398> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient: _renew_subs 2024-09-12T01:00:24.334 INFO:tasks.workunit.client.0.smithi070.stderr: -397> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T01:00:24.334 INFO:tasks.workunit.client.0.smithi070.stderr: -396> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient: _renew_subs 2024-09-12T01:00:24.334 INFO:tasks.workunit.client.0.smithi070.stderr: -395> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T01:00:24.334 INFO:tasks.workunit.client.0.smithi070.stderr: -394> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 1 librados: init done 2024-09-12T01:00:24.335 INFO:tasks.workunit.client.0.smithi070.stderr: -393> 2024-09-12T01:00:23.955+0000 7f21a2604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T01:00:24.335 INFO:tasks.workunit.client.0.smithi070.stderr: -392> 2024-09-12T01:00:23.955+0000 7f21a2604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T01:00:24.335 INFO:tasks.workunit.client.0.smithi070.stderr: -391> 2024-09-12T01:00:23.955+0000 7f21a2604640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T01:00:24.335 INFO:tasks.workunit.client.0.smithi070.stderr: -390> 2024-09-12T01:00:23.955+0000 7f22b50b5640 10 monclient: get_auth_request con 0x562bde818b60 auth_method 0 2024-09-12T01:00:24.335 INFO:tasks.workunit.client.0.smithi070.stderr: -389> 2024-09-12T01:00:23.959+0000 7f22b58b6640 10 monclient: get_auth_request con 0x7f219c070b10 auth_method 0 2024-09-12T01:00:24.335 INFO:tasks.workunit.client.0.smithi070.stderr: -388> 2024-09-12T01:00:23.959+0000 7f22b58b6640 10 monclient: get_auth_request con 0x562bde81bd40 auth_method 0 2024-09-12T01:00:24.335 INFO:tasks.workunit.client.0.smithi070.stderr: -387> 2024-09-12T01:00:23.959+0000 7f22b50b5640 10 monclient: get_auth_request con 0x562bde81ff30 auth_method 0 2024-09-12T01:00:24.335 INFO:tasks.workunit.client.0.smithi070.stderr: -386> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient: build_initial_monmap 2024-09-12T01:00:24.335 INFO:tasks.workunit.client.0.smithi070.stderr: -385> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 1 build_initial for_mkfs: 0 2024-09-12T01:00:24.335 INFO:tasks.workunit.client.0.smithi070.stderr: -384> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient: monmap: 2024-09-12T01:00:24.335 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T01:00:24.335 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T01:00:24.335 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T01:00:24.336 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T01:00:24.336 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T01:00:24.336 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.336 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T01:00:24.336 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T01:00:24.336 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T01:00:24.336 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.336 INFO:tasks.workunit.client.0.smithi070.stderr: -383> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding auth protocol: cephx 2024-09-12T01:00:24.336 INFO:tasks.workunit.client.0.smithi070.stderr: -382> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding auth protocol: cephx 2024-09-12T01:00:24.336 INFO:tasks.workunit.client.0.smithi070.stderr: -381> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding auth protocol: cephx 2024-09-12T01:00:24.336 INFO:tasks.workunit.client.0.smithi070.stderr: -380> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding con mode: secure 2024-09-12T01:00:24.336 INFO:tasks.workunit.client.0.smithi070.stderr: -379> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding con mode: crc 2024-09-12T01:00:24.336 INFO:tasks.workunit.client.0.smithi070.stderr: -378> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding con mode: secure 2024-09-12T01:00:24.337 INFO:tasks.workunit.client.0.smithi070.stderr: -377> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding con mode: crc 2024-09-12T01:00:24.337 INFO:tasks.workunit.client.0.smithi070.stderr: -376> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding con mode: secure 2024-09-12T01:00:24.337 INFO:tasks.workunit.client.0.smithi070.stderr: -375> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding con mode: crc 2024-09-12T01:00:24.337 INFO:tasks.workunit.client.0.smithi070.stderr: -374> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding con mode: crc 2024-09-12T01:00:24.337 INFO:tasks.workunit.client.0.smithi070.stderr: -373> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding con mode: secure 2024-09-12T01:00:24.337 INFO:tasks.workunit.client.0.smithi070.stderr: -372> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding con mode: crc 2024-09-12T01:00:24.337 INFO:tasks.workunit.client.0.smithi070.stderr: -371> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding con mode: secure 2024-09-12T01:00:24.337 INFO:tasks.workunit.client.0.smithi070.stderr: -370> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding con mode: crc 2024-09-12T01:00:24.337 INFO:tasks.workunit.client.0.smithi070.stderr: -369> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding con mode: secure 2024-09-12T01:00:24.337 INFO:tasks.workunit.client.0.smithi070.stderr: -368> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T01:00:24.337 INFO:tasks.workunit.client.0.smithi070.stderr: -367> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command objecter_requests cmddesc objecter_requests hook 0x562bde828300 EEXIST 2024-09-12T01:00:24.337 INFO:tasks.workunit.client.0.smithi070.stderr: -366> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient: init 2024-09-12T01:00:24.337 INFO:tasks.workunit.client.0.smithi070.stderr: -365> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding auth protocol: cephx 2024-09-12T01:00:24.337 INFO:tasks.workunit.client.0.smithi070.stderr: -364> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding auth protocol: cephx 2024-09-12T01:00:24.338 INFO:tasks.workunit.client.0.smithi070.stderr: -363> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding auth protocol: cephx 2024-09-12T01:00:24.338 INFO:tasks.workunit.client.0.smithi070.stderr: -362> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding con mode: secure 2024-09-12T01:00:24.338 INFO:tasks.workunit.client.0.smithi070.stderr: -361> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding con mode: crc 2024-09-12T01:00:24.338 INFO:tasks.workunit.client.0.smithi070.stderr: -360> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding con mode: secure 2024-09-12T01:00:24.338 INFO:tasks.workunit.client.0.smithi070.stderr: -359> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding con mode: crc 2024-09-12T01:00:24.338 INFO:tasks.workunit.client.0.smithi070.stderr: -358> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding con mode: secure 2024-09-12T01:00:24.338 INFO:tasks.workunit.client.0.smithi070.stderr: -357> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding con mode: crc 2024-09-12T01:00:24.338 INFO:tasks.workunit.client.0.smithi070.stderr: -356> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding con mode: crc 2024-09-12T01:00:24.338 INFO:tasks.workunit.client.0.smithi070.stderr: -355> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding con mode: secure 2024-09-12T01:00:24.338 INFO:tasks.workunit.client.0.smithi070.stderr: -354> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding con mode: crc 2024-09-12T01:00:24.338 INFO:tasks.workunit.client.0.smithi070.stderr: -353> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding con mode: secure 2024-09-12T01:00:24.338 INFO:tasks.workunit.client.0.smithi070.stderr: -352> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding con mode: crc 2024-09-12T01:00:24.338 INFO:tasks.workunit.client.0.smithi070.stderr: -351> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding con mode: secure 2024-09-12T01:00:24.338 INFO:tasks.workunit.client.0.smithi070.stderr: -350> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T01:00:24.339 INFO:tasks.workunit.client.0.smithi070.stderr: -349> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T01:00:24.339 INFO:tasks.workunit.client.0.smithi070.stderr: -348> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command rotate-key cmddesc rotate-key hook 0x562bde823300 EEXIST 2024-09-12T01:00:24.339 INFO:tasks.workunit.client.0.smithi070.stderr: -347> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient: _reopen_session rank -1 2024-09-12T01:00:24.339 INFO:tasks.workunit.client.0.smithi070.stderr: -346> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T01:00:24.339 INFO:tasks.workunit.client.0.smithi070.stderr: -345> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient(hunting): picked mon.noname-b con 0x562bde84c4b0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T01:00:24.339 INFO:tasks.workunit.client.0.smithi070.stderr: -344> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient(hunting): picked mon.noname-a con 0x562bde84bde0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T01:00:24.339 INFO:tasks.workunit.client.0.smithi070.stderr: -343> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient(hunting): picked mon.noname-c con 0x562bde84a7c0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T01:00:24.339 INFO:tasks.workunit.client.0.smithi070.stderr: -342> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient(hunting): start opening mon connection 2024-09-12T01:00:24.339 INFO:tasks.workunit.client.0.smithi070.stderr: -341> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient(hunting): start opening mon connection 2024-09-12T01:00:24.339 INFO:tasks.workunit.client.0.smithi070.stderr: -340> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient(hunting): start opening mon connection 2024-09-12T01:00:24.339 INFO:tasks.workunit.client.0.smithi070.stderr: -339> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient(hunting): _renew_subs 2024-09-12T01:00:24.339 INFO:tasks.workunit.client.0.smithi070.stderr: -338> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient(hunting): authenticate will time out at 2474.414228s 2024-09-12T01:00:24.339 INFO:tasks.workunit.client.0.smithi070.stderr: -337> 2024-09-12T01:00:23.963+0000 7f22b60b7640 10 monclient(hunting): get_auth_request con 0x562bde84a7c0 auth_method 0 2024-09-12T01:00:24.340 INFO:tasks.workunit.client.0.smithi070.stderr: -336> 2024-09-12T01:00:23.963+0000 7f22b60b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T01:00:24.340 INFO:tasks.workunit.client.0.smithi070.stderr: -335> 2024-09-12T01:00:23.963+0000 7f22b60b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T01:00:24.340 INFO:tasks.workunit.client.0.smithi070.stderr: -334> 2024-09-12T01:00:23.963+0000 7f22b60b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T01:00:24.340 INFO:tasks.workunit.client.0.smithi070.stderr: -333> 2024-09-12T01:00:23.963+0000 7f22b60b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T01:00:24.340 INFO:tasks.workunit.client.0.smithi070.stderr: -332> 2024-09-12T01:00:23.963+0000 7f22b60b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T01:00:24.340 INFO:tasks.workunit.client.0.smithi070.stderr: -331> 2024-09-12T01:00:23.963+0000 7f22b60b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T01:00:24.340 INFO:tasks.workunit.client.0.smithi070.stderr: -330> 2024-09-12T01:00:23.963+0000 7f22b50b5640 10 monclient(hunting): get_auth_request con 0x562bde84bde0 auth_method 0 2024-09-12T01:00:24.340 INFO:tasks.workunit.client.0.smithi070.stderr: -329> 2024-09-12T01:00:23.963+0000 7f22b50b5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T01:00:24.340 INFO:tasks.workunit.client.0.smithi070.stderr: -328> 2024-09-12T01:00:23.963+0000 7f22b50b5640 10 monclient(hunting): _init_auth method 2 2024-09-12T01:00:24.340 INFO:tasks.workunit.client.0.smithi070.stderr: -327> 2024-09-12T01:00:23.963+0000 7f22b50b5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T01:00:24.340 INFO:tasks.workunit.client.0.smithi070.stderr: -326> 2024-09-12T01:00:23.963+0000 7f22b50b5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T01:00:24.340 INFO:tasks.workunit.client.0.smithi070.stderr: -325> 2024-09-12T01:00:23.963+0000 7f22b50b5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T01:00:24.340 INFO:tasks.workunit.client.0.smithi070.stderr: -324> 2024-09-12T01:00:23.963+0000 7f22b50b5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T01:00:24.340 INFO:tasks.workunit.client.0.smithi070.stderr: -323> 2024-09-12T01:00:23.963+0000 7f22b60b7640 10 monclient(hunting): handle_auth_done global_id 7889 payload 824 2024-09-12T01:00:24.341 INFO:tasks.workunit.client.0.smithi070.stderr: -322> 2024-09-12T01:00:23.963+0000 7f22b60b7640 10 monclient: _finish_hunting 0 2024-09-12T01:00:24.341 INFO:tasks.workunit.client.0.smithi070.stderr: -321> 2024-09-12T01:00:23.963+0000 7f22b60b7640 1 monclient: found mon.noname-c 2024-09-12T01:00:24.341 INFO:tasks.workunit.client.0.smithi070.stderr: -320> 2024-09-12T01:00:23.963+0000 7f22b60b7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T01:00:24.341 INFO:tasks.workunit.client.0.smithi070.stderr: -319> 2024-09-12T01:00:23.963+0000 7f22b58b6640 10 monclient: get_auth_request con 0x562bde84c4b0 auth_method 0 2024-09-12T01:00:24.341 INFO:tasks.workunit.client.0.smithi070.stderr: -318> 2024-09-12T01:00:23.963+0000 7f219b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T01:00:24.341 INFO:tasks.workunit.client.0.smithi070.stderr: -317> 2024-09-12T01:00:23.963+0000 7f219b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T01:00:24.341 INFO:tasks.workunit.client.0.smithi070.stderr: -316> 2024-09-12T01:00:23.963+0000 7f219b7fe640 10 monclient: dump: 2024-09-12T01:00:24.341 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T01:00:24.341 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T01:00:24.341 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.341 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.341 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T01:00:24.341 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.341 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:00:24.342 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T01:00:24.342 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T01:00:24.342 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.342 INFO:tasks.workunit.client.0.smithi070.stderr: -315> 2024-09-12T01:00:23.963+0000 7f219b7fe640 10 monclient: _finish_auth 0 2024-09-12T01:00:24.342 INFO:tasks.workunit.client.0.smithi070.stderr: -314> 2024-09-12T01:00:23.963+0000 7f219b7fe640 10 monclient: _check_auth_tickets 2024-09-12T01:00:24.342 INFO:tasks.workunit.client.0.smithi070.stderr: -313> 2024-09-12T01:00:23.963+0000 7f219b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T01:00:24.342 INFO:tasks.workunit.client.0.smithi070.stderr: -312> 2024-09-12T01:00:23.963+0000 7f219b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T01:00:24.342 INFO:tasks.workunit.client.0.smithi070.stderr: -311> 2024-09-12T01:00:23.963+0000 7f219b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T01:00:24.342 INFO:tasks.workunit.client.0.smithi070.stderr: -310> 2024-09-12T01:00:23.963+0000 7f219b7fe640 10 monclient: dump: 2024-09-12T01:00:24.342 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T01:00:24.342 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T01:00:24.342 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.342 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.343 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T01:00:24.343 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.343 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:00:24.343 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T01:00:24.343 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T01:00:24.343 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.343 INFO:tasks.workunit.client.0.smithi070.stderr: -309> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 monclient: authenticate success, global_id 7889 2024-09-12T01:00:24.343 INFO:tasks.workunit.client.0.smithi070.stderr: -308> 2024-09-12T01:00:23.963+0000 7f22b68b8640 4 set_mon_vals no callback set 2024-09-12T01:00:24.343 INFO:tasks.workunit.client.0.smithi070.stderr: -307> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient: _renew_subs 2024-09-12T01:00:24.343 INFO:tasks.workunit.client.0.smithi070.stderr: -306> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T01:00:24.343 INFO:tasks.workunit.client.0.smithi070.stderr: -305> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient: _renew_subs 2024-09-12T01:00:24.343 INFO:tasks.workunit.client.0.smithi070.stderr: -304> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T01:00:24.343 INFO:tasks.workunit.client.0.smithi070.stderr: -303> 2024-09-12T01:00:23.967+0000 7f219b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T01:00:24.343 INFO:tasks.workunit.client.0.smithi070.stderr: -302> 2024-09-12T01:00:23.967+0000 7f219b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T01:00:24.344 INFO:tasks.workunit.client.0.smithi070.stderr: -301> 2024-09-12T01:00:23.967+0000 7f219b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T01:00:24.344 INFO:tasks.workunit.client.0.smithi070.stderr: -300> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient: get_monmap_and_config 2024-09-12T01:00:24.344 INFO:tasks.workunit.client.0.smithi070.stderr: -299> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient: build_initial_monmap 2024-09-12T01:00:24.344 INFO:tasks.workunit.client.0.smithi070.stderr: -298> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 1 build_initial for_mkfs: 0 2024-09-12T01:00:24.344 INFO:tasks.workunit.client.0.smithi070.stderr: -297> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient: monmap: 2024-09-12T01:00:24.344 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T01:00:24.344 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T01:00:24.344 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T01:00:24.344 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T01:00:24.344 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T01:00:24.344 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.344 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T01:00:24.344 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T01:00:24.344 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T01:00:24.345 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.345 INFO:tasks.workunit.client.0.smithi070.stderr: -296> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding auth protocol: cephx 2024-09-12T01:00:24.345 INFO:tasks.workunit.client.0.smithi070.stderr: -295> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding auth protocol: cephx 2024-09-12T01:00:24.345 INFO:tasks.workunit.client.0.smithi070.stderr: -294> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding auth protocol: cephx 2024-09-12T01:00:24.345 INFO:tasks.workunit.client.0.smithi070.stderr: -293> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding con mode: secure 2024-09-12T01:00:24.345 INFO:tasks.workunit.client.0.smithi070.stderr: -292> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding con mode: crc 2024-09-12T01:00:24.345 INFO:tasks.workunit.client.0.smithi070.stderr: -291> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding con mode: secure 2024-09-12T01:00:24.345 INFO:tasks.workunit.client.0.smithi070.stderr: -290> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding con mode: crc 2024-09-12T01:00:24.345 INFO:tasks.workunit.client.0.smithi070.stderr: -289> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding con mode: secure 2024-09-12T01:00:24.345 INFO:tasks.workunit.client.0.smithi070.stderr: -288> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding con mode: crc 2024-09-12T01:00:24.345 INFO:tasks.workunit.client.0.smithi070.stderr: -287> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding con mode: crc 2024-09-12T01:00:24.345 INFO:tasks.workunit.client.0.smithi070.stderr: -286> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding con mode: secure 2024-09-12T01:00:24.345 INFO:tasks.workunit.client.0.smithi070.stderr: -285> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding con mode: crc 2024-09-12T01:00:24.346 INFO:tasks.workunit.client.0.smithi070.stderr: -284> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding con mode: secure 2024-09-12T01:00:24.346 INFO:tasks.workunit.client.0.smithi070.stderr: -283> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding con mode: crc 2024-09-12T01:00:24.346 INFO:tasks.workunit.client.0.smithi070.stderr: -282> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding con mode: secure 2024-09-12T01:00:24.346 INFO:tasks.workunit.client.0.smithi070.stderr: -281> 2024-09-12T01:00:23.967+0000 7f22b58b6640 10 monclient: get_auth_request con 0x7f2190070a20 auth_method 0 2024-09-12T01:00:24.346 INFO:tasks.workunit.client.0.smithi070.stderr: -280> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T01:00:24.346 INFO:tasks.workunit.client.0.smithi070.stderr: -279> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient: init 2024-09-12T01:00:24.346 INFO:tasks.workunit.client.0.smithi070.stderr: -278> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding auth protocol: cephx 2024-09-12T01:00:24.346 INFO:tasks.workunit.client.0.smithi070.stderr: -277> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding auth protocol: cephx 2024-09-12T01:00:24.346 INFO:tasks.workunit.client.0.smithi070.stderr: -276> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding auth protocol: cephx 2024-09-12T01:00:24.346 INFO:tasks.workunit.client.0.smithi070.stderr: -275> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding con mode: secure 2024-09-12T01:00:24.346 INFO:tasks.workunit.client.0.smithi070.stderr: -274> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding con mode: crc 2024-09-12T01:00:24.346 INFO:tasks.workunit.client.0.smithi070.stderr: -273> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding con mode: secure 2024-09-12T01:00:24.346 INFO:tasks.workunit.client.0.smithi070.stderr: -272> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding con mode: crc 2024-09-12T01:00:24.347 INFO:tasks.workunit.client.0.smithi070.stderr: -271> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding con mode: secure 2024-09-12T01:00:24.347 INFO:tasks.workunit.client.0.smithi070.stderr: -270> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding con mode: crc 2024-09-12T01:00:24.347 INFO:tasks.workunit.client.0.smithi070.stderr: -269> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding con mode: crc 2024-09-12T01:00:24.347 INFO:tasks.workunit.client.0.smithi070.stderr: -268> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding con mode: secure 2024-09-12T01:00:24.347 INFO:tasks.workunit.client.0.smithi070.stderr: -267> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding con mode: crc 2024-09-12T01:00:24.347 INFO:tasks.workunit.client.0.smithi070.stderr: -266> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding con mode: secure 2024-09-12T01:00:24.347 INFO:tasks.workunit.client.0.smithi070.stderr: -265> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding con mode: crc 2024-09-12T01:00:24.347 INFO:tasks.workunit.client.0.smithi070.stderr: -264> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding con mode: secure 2024-09-12T01:00:24.347 INFO:tasks.workunit.client.0.smithi070.stderr: -263> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T01:00:24.347 INFO:tasks.workunit.client.0.smithi070.stderr: -262> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T01:00:24.348 INFO:tasks.workunit.client.0.smithi070.stderr: -261> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command rotate-key cmddesc rotate-key hook 0x7fffe52c79f8 EEXIST 2024-09-12T01:00:24.348 INFO:tasks.workunit.client.0.smithi070.stderr: -260> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient: _reopen_session rank -1 2024-09-12T01:00:24.348 INFO:tasks.workunit.client.0.smithi070.stderr: -259> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T01:00:24.348 INFO:tasks.workunit.client.0.smithi070.stderr: -258> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient(hunting): picked mon.noname-c con 0x562bde89ffb0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T01:00:24.348 INFO:tasks.workunit.client.0.smithi070.stderr: -257> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient(hunting): picked mon.noname-a con 0x562bde89b3a0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T01:00:24.348 INFO:tasks.workunit.client.0.smithi070.stderr: -256> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient(hunting): picked mon.noname-b con 0x562bde891aa0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T01:00:24.348 INFO:tasks.workunit.client.0.smithi070.stderr: -255> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient(hunting): start opening mon connection 2024-09-12T01:00:24.348 INFO:tasks.workunit.client.0.smithi070.stderr: -254> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient(hunting): start opening mon connection 2024-09-12T01:00:24.348 INFO:tasks.workunit.client.0.smithi070.stderr: -253> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient(hunting): start opening mon connection 2024-09-12T01:00:24.348 INFO:tasks.workunit.client.0.smithi070.stderr: -252> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient(hunting): _renew_subs 2024-09-12T01:00:24.348 INFO:tasks.workunit.client.0.smithi070.stderr: -251> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient(hunting): authenticate will time out at 2474.418150s 2024-09-12T01:00:24.348 INFO:tasks.workunit.client.0.smithi070.stderr: -250> 2024-09-12T01:00:23.967+0000 7f22b50b5640 10 monclient(hunting): get_auth_request con 0x562bde89b3a0 auth_method 0 2024-09-12T01:00:24.348 INFO:tasks.workunit.client.0.smithi070.stderr: -249> 2024-09-12T01:00:23.967+0000 7f22b50b5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T01:00:24.349 INFO:tasks.workunit.client.0.smithi070.stderr: -248> 2024-09-12T01:00:23.967+0000 7f22b50b5640 10 monclient(hunting): _init_auth method 2 2024-09-12T01:00:24.349 INFO:tasks.workunit.client.0.smithi070.stderr: -247> 2024-09-12T01:00:23.967+0000 7f22b50b5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T01:00:24.349 INFO:tasks.workunit.client.0.smithi070.stderr: -246> 2024-09-12T01:00:23.967+0000 7f22b58b6640 10 monclient(hunting): get_auth_request con 0x562bde89ffb0 auth_method 0 2024-09-12T01:00:24.349 INFO:tasks.workunit.client.0.smithi070.stderr: -245> 2024-09-12T01:00:23.967+0000 7f22b58b6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T01:00:24.349 INFO:tasks.workunit.client.0.smithi070.stderr: -244> 2024-09-12T01:00:23.967+0000 7f22b58b6640 10 monclient(hunting): _init_auth method 2 2024-09-12T01:00:24.349 INFO:tasks.workunit.client.0.smithi070.stderr: -243> 2024-09-12T01:00:23.967+0000 7f22b58b6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T01:00:24.349 INFO:tasks.workunit.client.0.smithi070.stderr: -242> 2024-09-12T01:00:23.967+0000 7f22b50b5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T01:00:24.349 INFO:tasks.workunit.client.0.smithi070.stderr: -241> 2024-09-12T01:00:23.967+0000 7f22b50b5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T01:00:24.349 INFO:tasks.workunit.client.0.smithi070.stderr: -240> 2024-09-12T01:00:23.967+0000 7f22b50b5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T01:00:24.349 INFO:tasks.workunit.client.0.smithi070.stderr: -239> 2024-09-12T01:00:23.967+0000 7f22b58b6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T01:00:24.349 INFO:tasks.workunit.client.0.smithi070.stderr: -238> 2024-09-12T01:00:23.967+0000 7f22b58b6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T01:00:24.349 INFO:tasks.workunit.client.0.smithi070.stderr: -237> 2024-09-12T01:00:23.967+0000 7f22b58b6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T01:00:24.349 INFO:tasks.workunit.client.0.smithi070.stderr: -236> 2024-09-12T01:00:23.967+0000 7f22b50b5640 10 monclient(hunting): handle_auth_done global_id 8424 payload 274 2024-09-12T01:00:24.350 INFO:tasks.workunit.client.0.smithi070.stderr: -235> 2024-09-12T01:00:23.967+0000 7f22b50b5640 10 monclient: _finish_hunting 0 2024-09-12T01:00:24.350 INFO:tasks.workunit.client.0.smithi070.stderr: -234> 2024-09-12T01:00:23.967+0000 7f22b50b5640 1 monclient: found mon.noname-a 2024-09-12T01:00:24.350 INFO:tasks.workunit.client.0.smithi070.stderr: -233> 2024-09-12T01:00:23.967+0000 7f22b50b5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T01:00:24.350 INFO:tasks.workunit.client.0.smithi070.stderr: -232> 2024-09-12T01:00:23.967+0000 7f21997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T01:00:24.353 INFO:tasks.workunit.client.0.smithi070.stderr: -231> 2024-09-12T01:00:23.967+0000 7f21997fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T01:00:24.353 INFO:tasks.workunit.client.0.smithi070.stderr: -230> 2024-09-12T01:00:23.967+0000 7f21997fa640 10 monclient: dump: 2024-09-12T01:00:24.353 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T01:00:24.353 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T01:00:24.354 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.354 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.354 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T01:00:24.354 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.354 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:00:24.354 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T01:00:24.354 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T01:00:24.355 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.355 INFO:tasks.workunit.client.0.smithi070.stderr: -229> 2024-09-12T01:00:23.967+0000 7f21997fa640 10 monclient: _finish_auth 0 2024-09-12T01:00:24.355 INFO:tasks.workunit.client.0.smithi070.stderr: -228> 2024-09-12T01:00:23.967+0000 7f21997fa640 10 monclient: _check_auth_tickets 2024-09-12T01:00:24.355 INFO:tasks.workunit.client.0.smithi070.stderr: -227> 2024-09-12T01:00:23.967+0000 7f21997fa640 10 monclient: handle_config config(0 keys) 2024-09-12T01:00:24.355 INFO:tasks.workunit.client.0.smithi070.stderr: -226> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 monclient: authenticate success, global_id 8424 2024-09-12T01:00:24.355 INFO:tasks.workunit.client.0.smithi070.stderr: -225> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient: get_monmap_and_config success 2024-09-12T01:00:24.355 INFO:tasks.workunit.client.0.smithi070.stderr: -224> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 4 set_mon_vals no callback set 2024-09-12T01:00:24.355 INFO:tasks.workunit.client.0.smithi070.stderr: -223> 2024-09-12T01:00:23.967+0000 7f21997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T01:00:24.356 INFO:tasks.workunit.client.0.smithi070.stderr: -222> 2024-09-12T01:00:23.967+0000 7f21997fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T01:00:24.356 INFO:tasks.workunit.client.0.smithi070.stderr: -221> 2024-09-12T01:00:23.967+0000 7f21997fa640 10 monclient: dump: 2024-09-12T01:00:24.356 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T01:00:24.356 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T01:00:24.356 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.356 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.356 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T01:00:24.357 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.357 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:00:24.357 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T01:00:24.357 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T01:00:24.357 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.357 INFO:tasks.workunit.client.0.smithi070.stderr: -220> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient: shutdown 2024-09-12T01:00:24.357 INFO:tasks.workunit.client.0.smithi070.stderr: -219> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient: build_initial_monmap 2024-09-12T01:00:24.357 INFO:tasks.workunit.client.0.smithi070.stderr: -218> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 1 build_initial for_mkfs: 0 2024-09-12T01:00:24.358 INFO:tasks.workunit.client.0.smithi070.stderr: -217> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient: monmap: 2024-09-12T01:00:24.358 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T01:00:24.358 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T01:00:24.358 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T01:00:24.358 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T01:00:24.358 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T01:00:24.358 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.359 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T01:00:24.359 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T01:00:24.359 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T01:00:24.359 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.359 INFO:tasks.workunit.client.0.smithi070.stderr: -216> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding auth protocol: cephx 2024-09-12T01:00:24.359 INFO:tasks.workunit.client.0.smithi070.stderr: -215> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding auth protocol: cephx 2024-09-12T01:00:24.359 INFO:tasks.workunit.client.0.smithi070.stderr: -214> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding auth protocol: cephx 2024-09-12T01:00:24.359 INFO:tasks.workunit.client.0.smithi070.stderr: -213> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding con mode: secure 2024-09-12T01:00:24.359 INFO:tasks.workunit.client.0.smithi070.stderr: -212> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding con mode: crc 2024-09-12T01:00:24.359 INFO:tasks.workunit.client.0.smithi070.stderr: -211> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding con mode: secure 2024-09-12T01:00:24.359 INFO:tasks.workunit.client.0.smithi070.stderr: -210> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding con mode: crc 2024-09-12T01:00:24.360 INFO:tasks.workunit.client.0.smithi070.stderr: -209> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding con mode: secure 2024-09-12T01:00:24.360 INFO:tasks.workunit.client.0.smithi070.stderr: -208> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding con mode: crc 2024-09-12T01:00:24.360 INFO:tasks.workunit.client.0.smithi070.stderr: -207> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding con mode: crc 2024-09-12T01:00:24.360 INFO:tasks.workunit.client.0.smithi070.stderr: -206> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding con mode: secure 2024-09-12T01:00:24.360 INFO:tasks.workunit.client.0.smithi070.stderr: -205> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding con mode: crc 2024-09-12T01:00:24.360 INFO:tasks.workunit.client.0.smithi070.stderr: -204> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding con mode: secure 2024-09-12T01:00:24.360 INFO:tasks.workunit.client.0.smithi070.stderr: -203> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding con mode: crc 2024-09-12T01:00:24.360 INFO:tasks.workunit.client.0.smithi070.stderr: -202> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding con mode: secure 2024-09-12T01:00:24.360 INFO:tasks.workunit.client.0.smithi070.stderr: -201> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T01:00:24.360 INFO:tasks.workunit.client.0.smithi070.stderr: -200> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 1 librados: starting msgr at 2024-09-12T01:00:24.360 INFO:tasks.workunit.client.0.smithi070.stderr: -199> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 1 librados: starting objecter 2024-09-12T01:00:24.360 INFO:tasks.workunit.client.0.smithi070.stderr: -198> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command objecter_requests cmddesc objecter_requests hook 0x562bde899f20 EEXIST 2024-09-12T01:00:24.360 INFO:tasks.workunit.client.0.smithi070.stderr: -197> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 1 librados: setting wanted keys 2024-09-12T01:00:24.361 INFO:tasks.workunit.client.0.smithi070.stderr: -196> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 1 librados: calling monclient init 2024-09-12T01:00:24.361 INFO:tasks.workunit.client.0.smithi070.stderr: -195> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient: init 2024-09-12T01:00:24.361 INFO:tasks.workunit.client.0.smithi070.stderr: -194> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding auth protocol: cephx 2024-09-12T01:00:24.361 INFO:tasks.workunit.client.0.smithi070.stderr: -193> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding auth protocol: cephx 2024-09-12T01:00:24.361 INFO:tasks.workunit.client.0.smithi070.stderr: -192> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding auth protocol: cephx 2024-09-12T01:00:24.361 INFO:tasks.workunit.client.0.smithi070.stderr: -191> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding con mode: secure 2024-09-12T01:00:24.361 INFO:tasks.workunit.client.0.smithi070.stderr: -190> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding con mode: crc 2024-09-12T01:00:24.361 INFO:tasks.workunit.client.0.smithi070.stderr: -189> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding con mode: secure 2024-09-12T01:00:24.361 INFO:tasks.workunit.client.0.smithi070.stderr: -188> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding con mode: crc 2024-09-12T01:00:24.361 INFO:tasks.workunit.client.0.smithi070.stderr: -187> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding con mode: secure 2024-09-12T01:00:24.361 INFO:tasks.workunit.client.0.smithi070.stderr: -186> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding con mode: crc 2024-09-12T01:00:24.361 INFO:tasks.workunit.client.0.smithi070.stderr: -185> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding con mode: crc 2024-09-12T01:00:24.361 INFO:tasks.workunit.client.0.smithi070.stderr: -184> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding con mode: secure 2024-09-12T01:00:24.361 INFO:tasks.workunit.client.0.smithi070.stderr: -183> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding con mode: crc 2024-09-12T01:00:24.362 INFO:tasks.workunit.client.0.smithi070.stderr: -182> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding con mode: secure 2024-09-12T01:00:24.362 INFO:tasks.workunit.client.0.smithi070.stderr: -181> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding con mode: crc 2024-09-12T01:00:24.362 INFO:tasks.workunit.client.0.smithi070.stderr: -180> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding con mode: secure 2024-09-12T01:00:24.362 INFO:tasks.workunit.client.0.smithi070.stderr: -179> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T01:00:24.362 INFO:tasks.workunit.client.0.smithi070.stderr: -178> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T01:00:24.362 INFO:tasks.workunit.client.0.smithi070.stderr: -177> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command rotate-key cmddesc rotate-key hook 0x562bde84e418 EEXIST 2024-09-12T01:00:24.362 INFO:tasks.workunit.client.0.smithi070.stderr: -176> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient: _reopen_session rank -1 2024-09-12T01:00:24.362 INFO:tasks.workunit.client.0.smithi070.stderr: -175> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T01:00:24.362 INFO:tasks.workunit.client.0.smithi070.stderr: -174> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient(hunting): picked mon.noname-b con 0x562bde891aa0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T01:00:24.362 INFO:tasks.workunit.client.0.smithi070.stderr: -173> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient(hunting): picked mon.noname-c con 0x562bde89b3a0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T01:00:24.362 INFO:tasks.workunit.client.0.smithi070.stderr: -172> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient(hunting): picked mon.noname-a con 0x562bde89ffb0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T01:00:24.362 INFO:tasks.workunit.client.0.smithi070.stderr: -171> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient(hunting): start opening mon connection 2024-09-12T01:00:24.362 INFO:tasks.workunit.client.0.smithi070.stderr: -170> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient(hunting): start opening mon connection 2024-09-12T01:00:24.363 INFO:tasks.workunit.client.0.smithi070.stderr: -169> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient(hunting): start opening mon connection 2024-09-12T01:00:24.363 INFO:tasks.workunit.client.0.smithi070.stderr: -168> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient(hunting): _renew_subs 2024-09-12T01:00:24.363 INFO:tasks.workunit.client.0.smithi070.stderr: -167> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient(hunting): authenticate will time out at 2474.420842s 2024-09-12T01:00:24.363 INFO:tasks.workunit.client.0.smithi070.stderr: -166> 2024-09-12T01:00:23.971+0000 7f22b50b5640 10 monclient(hunting): get_auth_request con 0x562bde89b3a0 auth_method 0 2024-09-12T01:00:24.363 INFO:tasks.workunit.client.0.smithi070.stderr: -165> 2024-09-12T01:00:23.971+0000 7f22b50b5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T01:00:24.363 INFO:tasks.workunit.client.0.smithi070.stderr: -164> 2024-09-12T01:00:23.971+0000 7f22b50b5640 10 monclient(hunting): _init_auth method 2 2024-09-12T01:00:24.363 INFO:tasks.workunit.client.0.smithi070.stderr: -163> 2024-09-12T01:00:23.971+0000 7f22b50b5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T01:00:24.363 INFO:tasks.workunit.client.0.smithi070.stderr: -162> 2024-09-12T01:00:23.971+0000 7f22b60b7640 10 monclient(hunting): get_auth_request con 0x562bde89ffb0 auth_method 0 2024-09-12T01:00:24.363 INFO:tasks.workunit.client.0.smithi070.stderr: -161> 2024-09-12T01:00:23.971+0000 7f22b60b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T01:00:24.363 INFO:tasks.workunit.client.0.smithi070.stderr: -160> 2024-09-12T01:00:23.971+0000 7f22b60b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T01:00:24.363 INFO:tasks.workunit.client.0.smithi070.stderr: -159> 2024-09-12T01:00:23.971+0000 7f22b60b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T01:00:24.363 INFO:tasks.workunit.client.0.smithi070.stderr: -158> 2024-09-12T01:00:23.971+0000 7f22b50b5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T01:00:24.363 INFO:tasks.workunit.client.0.smithi070.stderr: -157> 2024-09-12T01:00:23.971+0000 7f22b50b5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T01:00:24.364 INFO:tasks.workunit.client.0.smithi070.stderr: -156> 2024-09-12T01:00:23.971+0000 7f22b50b5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T01:00:24.364 INFO:tasks.workunit.client.0.smithi070.stderr: -155> 2024-09-12T01:00:23.971+0000 7f22b60b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T01:00:24.364 INFO:tasks.workunit.client.0.smithi070.stderr: -154> 2024-09-12T01:00:23.971+0000 7f22b60b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T01:00:24.364 INFO:tasks.workunit.client.0.smithi070.stderr: -153> 2024-09-12T01:00:23.971+0000 7f22b60b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T01:00:24.364 INFO:tasks.workunit.client.0.smithi070.stderr: -152> 2024-09-12T01:00:23.971+0000 7f22b58b6640 10 monclient(hunting): get_auth_request con 0x562bde891aa0 auth_method 0 2024-09-12T01:00:24.364 INFO:tasks.workunit.client.0.smithi070.stderr: -151> 2024-09-12T01:00:23.971+0000 7f22b58b6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T01:00:24.364 INFO:tasks.workunit.client.0.smithi070.stderr: -150> 2024-09-12T01:00:23.971+0000 7f22b58b6640 10 monclient(hunting): _init_auth method 2 2024-09-12T01:00:24.364 INFO:tasks.workunit.client.0.smithi070.stderr: -149> 2024-09-12T01:00:23.971+0000 7f22b58b6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T01:00:24.364 INFO:tasks.workunit.client.0.smithi070.stderr: -148> 2024-09-12T01:00:23.971+0000 7f22b60b7640 10 monclient(hunting): handle_auth_done global_id 8427 payload 824 2024-09-12T01:00:24.364 INFO:tasks.workunit.client.0.smithi070.stderr: -147> 2024-09-12T01:00:23.971+0000 7f22b60b7640 10 monclient: _finish_hunting 0 2024-09-12T01:00:24.364 INFO:tasks.workunit.client.0.smithi070.stderr: -146> 2024-09-12T01:00:23.971+0000 7f22b60b7640 1 monclient: found mon.noname-a 2024-09-12T01:00:24.365 INFO:tasks.workunit.client.0.smithi070.stderr: -145> 2024-09-12T01:00:23.971+0000 7f22b60b7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T01:00:24.365 INFO:tasks.workunit.client.0.smithi070.stderr: -144> 2024-09-12T01:00:23.971+0000 7f21877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T01:00:24.365 INFO:tasks.workunit.client.0.smithi070.stderr: -143> 2024-09-12T01:00:23.971+0000 7f21877fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T01:00:24.365 INFO:tasks.workunit.client.0.smithi070.stderr: -142> 2024-09-12T01:00:23.971+0000 7f21877fe640 10 monclient: dump: 2024-09-12T01:00:24.365 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T01:00:24.365 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T01:00:24.365 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.365 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.365 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T01:00:24.365 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.366 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:00:24.366 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T01:00:24.366 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T01:00:24.366 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.366 INFO:tasks.workunit.client.0.smithi070.stderr: -141> 2024-09-12T01:00:23.971+0000 7f21877fe640 10 monclient: _finish_auth 0 2024-09-12T01:00:24.366 INFO:tasks.workunit.client.0.smithi070.stderr: -140> 2024-09-12T01:00:23.971+0000 7f21877fe640 10 monclient: _check_auth_tickets 2024-09-12T01:00:24.366 INFO:tasks.workunit.client.0.smithi070.stderr: -139> 2024-09-12T01:00:23.971+0000 7f21877fe640 10 monclient: handle_config config(0 keys) 2024-09-12T01:00:24.366 INFO:tasks.workunit.client.0.smithi070.stderr: -138> 2024-09-12T01:00:23.971+0000 7f21877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T01:00:24.366 INFO:tasks.workunit.client.0.smithi070.stderr: -137> 2024-09-12T01:00:23.971+0000 7f21877fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T01:00:24.366 INFO:tasks.workunit.client.0.smithi070.stderr: -136> 2024-09-12T01:00:23.971+0000 7f21877fe640 10 monclient: dump: 2024-09-12T01:00:24.366 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T01:00:24.366 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T01:00:24.366 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.367 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.367 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T01:00:24.367 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.367 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:00:24.367 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T01:00:24.367 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T01:00:24.367 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.367 INFO:tasks.workunit.client.0.smithi070.stderr: -135> 2024-09-12T01:00:23.971+0000 7f21997fa640 4 set_mon_vals no callback set 2024-09-12T01:00:24.367 INFO:tasks.workunit.client.0.smithi070.stderr: -134> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 monclient: authenticate success, global_id 8427 2024-09-12T01:00:24.367 INFO:tasks.workunit.client.0.smithi070.stderr: -133> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient: _renew_subs 2024-09-12T01:00:24.367 INFO:tasks.workunit.client.0.smithi070.stderr: -132> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T01:00:24.368 INFO:tasks.workunit.client.0.smithi070.stderr: -131> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient: _renew_subs 2024-09-12T01:00:24.368 INFO:tasks.workunit.client.0.smithi070.stderr: -130> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T01:00:24.368 INFO:tasks.workunit.client.0.smithi070.stderr: -129> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 1 librados: init done 2024-09-12T01:00:24.368 INFO:tasks.workunit.client.0.smithi070.stderr: -128> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command cr dump hook 0x562bde8aaea8 2024-09-12T01:00:24.368 INFO:tasks.workunit.client.0.smithi070.stderr: -127> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.368 INFO:tasks.workunit.client.0.smithi070.stderr: -126> 2024-09-12T01:00:23.971+0000 7f21877fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T01:00:24.368 INFO:tasks.workunit.client.0.smithi070.stderr: -125> 2024-09-12T01:00:23.971+0000 7f21877fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T01:00:24.368 INFO:tasks.workunit.client.0.smithi070.stderr: -124> 2024-09-12T01:00:23.971+0000 7f21877fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T01:00:24.368 INFO:tasks.workunit.client.0.smithi070.stderr: -123> 2024-09-12T01:00:23.975+0000 7f22b58b6640 10 monclient: get_auth_request con 0x7f2180070ae0 auth_method 0 2024-09-12T01:00:24.368 INFO:tasks.workunit.client.0.smithi070.stderr: -122> 2024-09-12T01:00:23.975+0000 7f22b50b5640 10 monclient: get_auth_request con 0x562bde8b98a0 auth_method 0 2024-09-12T01:00:24.368 INFO:tasks.workunit.client.0.smithi070.stderr: -121> 2024-09-12T01:00:23.975+0000 7f22b7db09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.369 INFO:tasks.workunit.client.0.smithi070.stderr: -120> 2024-09-12T01:00:23.975+0000 7f22b7db09c0 20 realm 2024-09-12T01:00:24.369 INFO:tasks.workunit.client.0.smithi070.stderr: -119> 2024-09-12T01:00:23.975+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.369 INFO:tasks.workunit.client.0.smithi070.stderr: -118> 2024-09-12T01:00:23.975+0000 7f22b7db09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.369 INFO:tasks.workunit.client.0.smithi070.stderr: -117> 2024-09-12T01:00:23.975+0000 7f22b7db09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:24.369 INFO:tasks.workunit.client.0.smithi070.stderr: -116> 2024-09-12T01:00:23.975+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.369 INFO:tasks.workunit.client.0.smithi070.stderr: -115> 2024-09-12T01:00:23.975+0000 7f22b7db09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.369 INFO:tasks.workunit.client.0.smithi070.stderr: -114> 2024-09-12T01:00:23.975+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.369 INFO:tasks.workunit.client.0.smithi070.stderr: -113> 2024-09-12T01:00:23.975+0000 7f22b58b6640 10 monclient: get_auth_request con 0x562bde8bdb00 auth_method 0 2024-09-12T01:00:24.369 INFO:tasks.workunit.client.0.smithi070.stderr: -112> 2024-09-12T01:00:23.975+0000 7f22b7db09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:24.369 INFO:tasks.workunit.client.0.smithi070.stderr: -111> 2024-09-12T01:00:23.975+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.369 INFO:tasks.workunit.client.0.smithi070.stderr: -110> 2024-09-12T01:00:23.975+0000 7f22b50b5640 10 monclient: get_auth_request con 0x562bde8c1360 auth_method 0 2024-09-12T01:00:24.369 INFO:tasks.workunit.client.0.smithi070.stderr: -109> 2024-09-12T01:00:23.979+0000 7f22b7db09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:24.369 INFO:tasks.workunit.client.0.smithi070.stderr: -108> 2024-09-12T01:00:23.979+0000 7f22b7db09c0 20 searching for the correct realm 2024-09-12T01:00:24.370 INFO:tasks.workunit.client.0.smithi070.stderr: -107> 2024-09-12T01:00:23.979+0000 7f22b60b7640 10 monclient: get_auth_request con 0x562bde8c60a0 auth_method 0 2024-09-12T01:00:24.370 INFO:tasks.workunit.client.0.smithi070.stderr: -106> 2024-09-12T01:00:23.979+0000 7f22b58b6640 10 monclient: get_auth_request con 0x7f22b009c040 auth_method 0 2024-09-12T01:00:24.370 INFO:tasks.workunit.client.0.smithi070.stderr: -105> 2024-09-12T01:00:23.979+0000 7f22b50b5640 10 monclient: get_auth_request con 0x7f22a80d4070 auth_method 0 2024-09-12T01:00:24.370 INFO:tasks.workunit.client.0.smithi070.stderr: -104> 2024-09-12T01:00:23.983+0000 7f22b60b7640 10 monclient: get_auth_request con 0x7f22ac03ba90 auth_method 0 2024-09-12T01:00:24.370 INFO:tasks.workunit.client.0.smithi070.stderr: -103> 2024-09-12T01:00:23.983+0000 7f22b60b7640 0 -- 172.21.15.70:0/2116115508 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f22ac03ba90 msgr2=0x7f22ac01a400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:24.370 INFO:tasks.workunit.client.0.smithi070.stderr: -102> 2024-09-12T01:00:23.983+0000 7f21877fe640 1 client.8427.objecter ms_handle_reset 0x7f22ac03ba90 session 0x7f22ac03b410 osd.4 2024-09-12T01:00:24.370 INFO:tasks.workunit.client.0.smithi070.stderr: -101> 2024-09-12T01:00:23.983+0000 7f21877fe640 10 monclient: _renew_subs 2024-09-12T01:00:24.370 INFO:tasks.workunit.client.0.smithi070.stderr: -100> 2024-09-12T01:00:23.983+0000 7f21877fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T01:00:24.370 INFO:tasks.workunit.client.0.smithi070.stderr: -99> 2024-09-12T01:00:23.983+0000 7f22b60b7640 10 monclient: get_auth_request con 0x7f2180080880 auth_method 0 2024-09-12T01:00:24.370 INFO:tasks.workunit.client.0.smithi070.stderr: -98> 2024-09-12T01:00:23.983+0000 7f22b58b6640 10 monclient: get_auth_request con 0x7f22b0027020 auth_method 0 2024-09-12T01:00:24.370 INFO:tasks.workunit.client.0.smithi070.stderr: -97> 2024-09-12T01:00:23.991+0000 7f22b50b5640 0 -- 172.21.15.70:0/2116115508 >> [v2:172.21.15.70:6824/2477739226,v1:172.21.15.70:6825/2477739226] conn(0x562bde8c1360 msgr2=0x562bde8c3770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:24.370 INFO:tasks.workunit.client.0.smithi070.stderr: -96> 2024-09-12T01:00:23.991+0000 7f21877fe640 1 client.8427.objecter ms_handle_reset 0x562bde8c1360 session 0x562bde8bce90 osd.0 2024-09-12T01:00:24.370 INFO:tasks.workunit.client.0.smithi070.stderr: -95> 2024-09-12T01:00:23.991+0000 7f22b50b5640 10 monclient: get_auth_request con 0x7f22ac03ba90 auth_method 0 2024-09-12T01:00:24.371 INFO:tasks.workunit.client.0.smithi070.stderr: -94> 2024-09-12T01:00:23.995+0000 7f22b7db09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:24.371 INFO:tasks.workunit.client.0.smithi070.stderr: -93> 2024-09-12T01:00:23.995+0000 7f22b7db09c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:00:24.371 INFO:tasks.workunit.client.0.smithi070.stderr: -92> 2024-09-12T01:00:23.995+0000 7f22b7db09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:24.371 INFO:tasks.workunit.client.0.smithi070.stderr: -91> 2024-09-12T01:00:23.995+0000 7f22b7db09c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:00:24.371 INFO:tasks.workunit.client.0.smithi070.stderr: -90> 2024-09-12T01:00:23.995+0000 7f22b7db09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:24.371 INFO:tasks.workunit.client.0.smithi070.stderr: -89> 2024-09-12T01:00:23.995+0000 7f22b7db09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:24.371 INFO:tasks.workunit.client.0.smithi070.stderr: -88> 2024-09-12T01:00:23.995+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.371 INFO:tasks.workunit.client.0.smithi070.stderr: -87> 2024-09-12T01:00:23.995+0000 7f22b7db09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.371 INFO:tasks.workunit.client.0.smithi070.stderr: -86> 2024-09-12T01:00:23.995+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.371 INFO:tasks.workunit.client.0.smithi070.stderr: -85> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:24.371 INFO:tasks.workunit.client.0.smithi070.stderr: -84> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.371 INFO:tasks.workunit.client.0.smithi070.stderr: -83> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:24.371 INFO:tasks.workunit.client.0.smithi070.stderr: -82> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 zone default found 2024-09-12T01:00:24.372 INFO:tasks.workunit.client.0.smithi070.stderr: -81> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 4 Realm: () 2024-09-12T01:00:24.372 INFO:tasks.workunit.client.0.smithi070.stderr: -80> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:00:24.372 INFO:tasks.workunit.client.0.smithi070.stderr: -79> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:00:24.372 INFO:tasks.workunit.client.0.smithi070.stderr: -78> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:24.372 INFO:tasks.workunit.client.0.smithi070.stderr: -77> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 zonegroup default 2024-09-12T01:00:24.372 INFO:tasks.workunit.client.0.smithi070.stderr: -76> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.372 INFO:tasks.workunit.client.0.smithi070.stderr: -75> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.372 INFO:tasks.workunit.client.0.smithi070.stderr: -74> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.372 INFO:tasks.workunit.client.0.smithi070.stderr: -73> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.372 INFO:tasks.workunit.client.0.smithi070.stderr: -72> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.372 INFO:tasks.workunit.client.0.smithi070.stderr: -71> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.372 INFO:tasks.workunit.client.0.smithi070.stderr: -70> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 started sync module instance, tier type = 2024-09-12T01:00:24.372 INFO:tasks.workunit.client.0.smithi070.stderr: -69> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:00:24.372 INFO:tasks.workunit.client.0.smithi070.stderr: -68> 2024-09-12T01:00:24.015+0000 7f22b7db09c0 20 add_watcher() i=0 2024-09-12T01:00:24.373 INFO:tasks.workunit.client.0.smithi070.stderr: -67> 2024-09-12T01:00:24.015+0000 7f22b7db09c0 20 add_watcher() i=1 2024-09-12T01:00:24.373 INFO:tasks.workunit.client.0.smithi070.stderr: -66> 2024-09-12T01:00:24.015+0000 7f22b7db09c0 20 add_watcher() i=2 2024-09-12T01:00:24.373 INFO:tasks.workunit.client.0.smithi070.stderr: -65> 2024-09-12T01:00:24.015+0000 7f22b7db09c0 20 add_watcher() i=3 2024-09-12T01:00:24.373 INFO:tasks.workunit.client.0.smithi070.stderr: -64> 2024-09-12T01:00:24.015+0000 7f22b7db09c0 20 add_watcher() i=4 2024-09-12T01:00:24.373 INFO:tasks.workunit.client.0.smithi070.stderr: -63> 2024-09-12T01:00:24.015+0000 7f22b7db09c0 20 add_watcher() i=5 2024-09-12T01:00:24.373 INFO:tasks.workunit.client.0.smithi070.stderr: -62> 2024-09-12T01:00:24.015+0000 7f22b7db09c0 20 add_watcher() i=6 2024-09-12T01:00:24.373 INFO:tasks.workunit.client.0.smithi070.stderr: -61> 2024-09-12T01:00:24.015+0000 7f22b7db09c0 20 add_watcher() i=7 2024-09-12T01:00:24.373 INFO:tasks.workunit.client.0.smithi070.stderr: -60> 2024-09-12T01:00:24.015+0000 7f22b7db09c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:24.373 INFO:tasks.workunit.client.0.smithi070.stderr: -59> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding auth protocol: cephx 2024-09-12T01:00:24.373 INFO:tasks.workunit.client.0.smithi070.stderr: -58> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding auth protocol: cephx 2024-09-12T01:00:24.373 INFO:tasks.workunit.client.0.smithi070.stderr: -57> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding auth protocol: cephx 2024-09-12T01:00:24.373 INFO:tasks.workunit.client.0.smithi070.stderr: -56> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding con mode: secure 2024-09-12T01:00:24.373 INFO:tasks.workunit.client.0.smithi070.stderr: -55> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding con mode: crc 2024-09-12T01:00:24.374 INFO:tasks.workunit.client.0.smithi070.stderr: -54> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding con mode: secure 2024-09-12T01:00:24.374 INFO:tasks.workunit.client.0.smithi070.stderr: -53> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding con mode: crc 2024-09-12T01:00:24.374 INFO:tasks.workunit.client.0.smithi070.stderr: -52> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding con mode: secure 2024-09-12T01:00:24.374 INFO:tasks.workunit.client.0.smithi070.stderr: -51> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding con mode: crc 2024-09-12T01:00:24.374 INFO:tasks.workunit.client.0.smithi070.stderr: -50> 2024-09-12T01:00:24.019+0000 7f21677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:24.374 INFO:tasks.workunit.client.0.smithi070.stderr: -49> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding con mode: crc 2024-09-12T01:00:24.374 INFO:tasks.workunit.client.0.smithi070.stderr: -48> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding con mode: secure 2024-09-12T01:00:24.374 INFO:tasks.workunit.client.0.smithi070.stderr: -47> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding con mode: crc 2024-09-12T01:00:24.374 INFO:tasks.workunit.client.0.smithi070.stderr: -46> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding con mode: secure 2024-09-12T01:00:24.374 INFO:tasks.workunit.client.0.smithi070.stderr: -45> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding con mode: crc 2024-09-12T01:00:24.374 INFO:tasks.workunit.client.0.smithi070.stderr: -44> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding con mode: secure 2024-09-12T01:00:24.374 INFO:tasks.workunit.client.0.smithi070.stderr: -43> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T01:00:24.374 INFO:tasks.workunit.client.0.smithi070.stderr: -42> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:24.374 INFO:tasks.workunit.client.0.smithi070.stderr: -41> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:24.375 INFO:tasks.workunit.client.0.smithi070.stderr: -40> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command cache list hook 0x562bde8966e0 2024-09-12T01:00:24.375 INFO:tasks.workunit.client.0.smithi070.stderr: -39> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command cache inspect hook 0x562bde8966e0 2024-09-12T01:00:24.375 INFO:tasks.workunit.client.0.smithi070.stderr: -38> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command cache erase hook 0x562bde8966e0 2024-09-12T01:00:24.375 INFO:tasks.workunit.client.0.smithi070.stderr: -37> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command cache zap hook 0x562bde8966e0 2024-09-12T01:00:24.375 INFO:tasks.workunit.client.0.smithi070.stderr: -36> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 note: GC not initialized 2024-09-12T01:00:24.375 INFO:tasks.workunit.client.0.smithi070.stderr: -35> 2024-09-12T01:00:24.019+0000 7f21667fc640 20 reqs_thread_entry: start 2024-09-12T01:00:24.375 INFO:tasks.workunit.client.0.smithi070.stderr: -34> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command sync trace show hook 0x7f22ac004e20 2024-09-12T01:00:24.375 INFO:tasks.workunit.client.0.smithi070.stderr: -33> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command sync trace history hook 0x7f22ac004e20 2024-09-12T01:00:24.375 INFO:tasks.workunit.client.0.smithi070.stderr: -32> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command sync trace active hook 0x7f22ac004e20 2024-09-12T01:00:24.375 INFO:tasks.workunit.client.0.smithi070.stderr: -31> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command sync trace active_short hook 0x7f22ac004e20 2024-09-12T01:00:24.375 INFO:tasks.workunit.client.0.smithi070.stderr: -30> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 20 init_complete bucket index max shards: 1 2024-09-12T01:00:24.375 INFO:tasks.workunit.client.0.smithi070.stderr: -29> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 20 Filter name: none 2024-09-12T01:00:24.375 INFO:tasks.workunit.client.0.smithi070.stderr: -28> 2024-09-12T01:00:24.019+0000 7f20d7fff640 20 reqs_thread_entry: start 2024-09-12T01:00:24.375 INFO:tasks.workunit.client.0.smithi070.stderr: -27> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T01:00:24.376 INFO:tasks.workunit.client.0.smithi070.stderr: -26> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.376 INFO:tasks.workunit.client.0.smithi070.stderr: -25> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T01:00:24.376 INFO:tasks.workunit.client.0.smithi070.stderr: -24> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T01:00:24.376 INFO:tasks.workunit.client.0.smithi070.stderr: -23> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T01:00:24.376 INFO:tasks.workunit.client.0.smithi070.stderr: -22> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : miss 2024-09-12T01:00:24.376 INFO:tasks.workunit.client.0.smithi070.stderr: -21> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.376 INFO:tasks.workunit.client.0.smithi070.stderr: -20> 2024-09-12T01:00:24.023+0000 7f22b7db09c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T01:00:24.376 INFO:tasks.workunit.client.0.smithi070.stderr: -19> 2024-09-12T01:00:24.023+0000 7f22b7db09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T01:00:24.376 INFO:tasks.workunit.client.0.smithi070.stderr: -18> 2024-09-12T01:00:24.023+0000 7f22b7db09c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T01:00:24.376 INFO:tasks.workunit.client.0.smithi070.stderr: -17> 2024-09-12T01:00:24.023+0000 7f22b7db09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:00:24.376 INFO:tasks.workunit.client.0.smithi070.stderr: -16> 2024-09-12T01:00:24.023+0000 7f22b7db09c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:24.376 INFO:tasks.workunit.client.0.smithi070.stderr: -15> 2024-09-12T01:00:24.023+0000 7f22b7db09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T01:00:24.376 INFO:tasks.workunit.client.0.smithi070.stderr: -14> 2024-09-12T01:00:24.023+0000 7f22b7db09c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T01:00:24.377 INFO:tasks.workunit.client.0.smithi070.stderr: -13> 2024-09-12T01:00:24.031+0000 7f22b7db09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T01:00:24.377 INFO:tasks.workunit.client.0.smithi070.stderr: -12> 2024-09-12T01:00:24.031+0000 7f22b7db09c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T01:00:24.377 INFO:tasks.workunit.client.0.smithi070.stderr: -11> 2024-09-12T01:00:24.031+0000 7f22b7db09c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:24.377 INFO:tasks.workunit.client.0.smithi070.stderr: -10> 2024-09-12T01:00:24.031+0000 7f22b7db09c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18, ofs0, ns] 2024-09-12T01:00:24.377 INFO:tasks.workunit.client.0.smithi070.stderr: -9> 2024-09-12T01:00:24.031+0000 7f21997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431649 cookie 94746417312320 notifier 8427 bl.length()=911 2024-09-12T01:00:24.377 INFO:tasks.workunit.client.0.smithi070.stderr: -8> 2024-09-12T01:00:24.031+0000 7f21997fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T01:00:24.377 INFO:tasks.workunit.client.0.smithi070.stderr: -7> 2024-09-12T01:00:24.031+0000 7f21997fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T01:00:24.377 INFO:tasks.workunit.client.0.smithi070.stderr: -6> 2024-09-12T01:00:24.031+0000 7f21997fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:24.377 INFO:tasks.workunit.client.0.smithi070.stderr: -5> 2024-09-12T01:00:24.035+0000 7f22b7db09c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_sources= new_sources= 2024-09-12T01:00:24.377 INFO:tasks.workunit.client.0.smithi070.stderr: -4> 2024-09-12T01:00:24.035+0000 7f22b7db09c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential sources added=[] removed=[] 2024-09-12T01:00:24.377 INFO:tasks.workunit.client.0.smithi070.stderr: -3> 2024-09-12T01:00:24.035+0000 7f22b7db09c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_dests= new_dests= 2024-09-12T01:00:24.377 INFO:tasks.workunit.client.0.smithi070.stderr: -2> 2024-09-12T01:00:24.035+0000 7f22b7db09c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential dests added=[] removed=[] 2024-09-12T01:00:24.377 INFO:tasks.workunit.client.0.smithi070.stderr: -1> 2024-09-12T01:00:24.039+0000 7f22b7db09c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f22b7db09c0 time 2024-09-12T01:00:24.044652+0000 2024-09-12T01:00:24.378 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T01:00:24.378 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.378 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T01:00:24.378 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f22bb68a2eb] 2024-09-12T01:00:24.378 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f22bb68a49f] 2024-09-12T01:00:24.378 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562bdd490cc1] 2024-09-12T01:00:24.378 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562bdd4a5d5a] 2024-09-12T01:00:24.378 INFO:tasks.workunit.client.0.smithi070.stderr: 5: main() 2024-09-12T01:00:24.378 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f22ba4f0d90] 2024-09-12T01:00:24.378 INFO:tasks.workunit.client.0.smithi070.stderr: 7: __libc_start_main() 2024-09-12T01:00:24.378 INFO:tasks.workunit.client.0.smithi070.stderr: 8: _start() 2024-09-12T01:00:24.378 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.378 INFO:tasks.workunit.client.0.smithi070.stderr: 0> 2024-09-12T01:00:24.039+0000 7f22b7db09c0 -1 *** Caught signal (Aborted) ** 2024-09-12T01:00:24.379 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f22b7db09c0 thread_name:radosgw-admin 2024-09-12T01:00:24.379 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.379 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T01:00:24.379 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f22ba509520] 2024-09-12T01:00:24.379 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T01:00:24.379 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T01:00:24.379 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T01:00:24.379 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f22bb68a345] 2024-09-12T01:00:24.379 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f22bb68a49f] 2024-09-12T01:00:24.379 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562bdd490cc1] 2024-09-12T01:00:24.379 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562bdd4a5d5a] 2024-09-12T01:00:24.379 INFO:tasks.workunit.client.0.smithi070.stderr: 9: main() 2024-09-12T01:00:24.379 INFO:tasks.workunit.client.0.smithi070.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f22ba4f0d90] 2024-09-12T01:00:24.380 INFO:tasks.workunit.client.0.smithi070.stderr: 11: __libc_start_main() 2024-09-12T01:00:24.380 INFO:tasks.workunit.client.0.smithi070.stderr: 12: _start() 2024-09-12T01:00:24.380 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T01:00:24.380 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.380 INFO:tasks.workunit.client.0.smithi070.stderr:--- logging levels --- 2024-09-12T01:00:24.380 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 none 2024-09-12T01:00:24.380 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 lockdep 2024-09-12T01:00:24.380 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 context 2024-09-12T01:00:24.380 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 crush 2024-09-12T01:00:24.380 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds 2024-09-12T01:00:24.380 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_balancer 2024-09-12T01:00:24.380 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_locker 2024-09-12T01:00:24.380 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log 2024-09-12T01:00:24.381 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log_expire 2024-09-12T01:00:24.381 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_migrator 2024-09-12T01:00:24.381 INFO:tasks.workunit.client.0.smithi070.stderr: 3/ 5 mds_quiesce 2024-09-12T01:00:24.381 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 buffer 2024-09-12T01:00:24.381 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 timer 2024-09-12T01:00:24.381 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 filer 2024-09-12T01:00:24.381 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 striper 2024-09-12T01:00:24.381 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 objecter 2024-09-12T01:00:24.381 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rados 2024-09-12T01:00:24.381 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd 2024-09-12T01:00:24.381 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_mirror 2024-09-12T01:00:24.381 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_replay 2024-09-12T01:00:24.381 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_pwl 2024-09-12T01:00:24.381 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 journaler 2024-09-12T01:00:24.381 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objectcacher 2024-09-12T01:00:24.382 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 immutable_obj_cache 2024-09-12T01:00:24.382 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 client 2024-09-12T01:00:24.382 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 osd 2024-09-12T01:00:24.382 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 optracker 2024-09-12T01:00:24.382 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objclass 2024-09-12T01:00:24.382 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 filestore 2024-09-12T01:00:24.382 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 journal 2024-09-12T01:00:24.382 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 ms 2024-09-12T01:00:24.382 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mon 2024-09-12T01:00:24.382 INFO:tasks.workunit.client.0.smithi070.stderr: 0/10 monc 2024-09-12T01:00:24.382 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 paxos 2024-09-12T01:00:24.382 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 tp 2024-09-12T01:00:24.382 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 auth 2024-09-12T01:00:24.382 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 crypto 2024-09-12T01:00:24.383 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 finisher 2024-09-12T01:00:24.383 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 reserver 2024-09-12T01:00:24.383 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 heartbeatmap 2024-09-12T01:00:24.383 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 perfcounter 2024-09-12T01:00:24.383 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw 2024-09-12T01:00:24.383 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_sync 2024-09-12T01:00:24.383 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_datacache 2024-09-12T01:00:24.383 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_access 2024-09-12T01:00:24.383 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_dbstore 2024-09-12T01:00:24.383 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_flight 2024-09-12T01:00:24.383 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_lifecycle 2024-09-12T01:00:24.383 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw_notification 2024-09-12T01:00:24.383 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 javaclient 2024-09-12T01:00:24.383 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 asok 2024-09-12T01:00:24.384 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 throttle 2024-09-12T01:00:24.384 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 refs 2024-09-12T01:00:24.384 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 compressor 2024-09-12T01:00:24.384 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluestore 2024-09-12T01:00:24.384 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluefs 2024-09-12T01:00:24.384 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 bdev 2024-09-12T01:00:24.384 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 kstore 2024-09-12T01:00:24.384 INFO:tasks.workunit.client.0.smithi070.stderr: 4/ 5 rocksdb 2024-09-12T01:00:24.384 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 fuse 2024-09-12T01:00:24.384 INFO:tasks.workunit.client.0.smithi070.stderr: 2/ 5 mgr 2024-09-12T01:00:24.384 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mgrc 2024-09-12T01:00:24.384 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 dpdk 2024-09-12T01:00:24.384 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 eventtrace 2024-09-12T01:00:24.385 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 prioritycache 2024-09-12T01:00:24.385 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 test 2024-09-12T01:00:24.385 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephfs_mirror 2024-09-12T01:00:24.385 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephsqlite 2024-09-12T01:00:24.385 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 crimson_interrupt 2024-09-12T01:00:24.385 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore 2024-09-12T01:00:24.385 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_onode 2024-09-12T01:00:24.385 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_odata 2024-09-12T01:00:24.385 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_omap 2024-09-12T01:00:24.385 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_tm 2024-09-12T01:00:24.385 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_t 2024-09-12T01:00:24.385 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cleaner 2024-09-12T01:00:24.385 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_epm 2024-09-12T01:00:24.385 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_lba 2024-09-12T01:00:24.386 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T01:00:24.386 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cache 2024-09-12T01:00:24.386 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_journal 2024-09-12T01:00:24.386 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_device 2024-09-12T01:00:24.386 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_backref 2024-09-12T01:00:24.386 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 alienstore 2024-09-12T01:00:24.386 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mclock 2024-09-12T01:00:24.386 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cyanstore 2024-09-12T01:00:24.386 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 ceph_exporter 2024-09-12T01:00:24.386 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 memstore 2024-09-12T01:00:24.386 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 trace 2024-09-12T01:00:24.386 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 ceph_dedup 2024-09-12T01:00:24.386 INFO:tasks.workunit.client.0.smithi070.stderr: -2/-2 (syslog threshold) 2024-09-12T01:00:24.386 INFO:tasks.workunit.client.0.smithi070.stderr: 99/99 (stderr threshold) 2024-09-12T01:00:24.387 INFO:tasks.workunit.client.0.smithi070.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T01:00:24.387 INFO:tasks.workunit.client.0.smithi070.stderr: 7f20d7fff640 / http_manager 2024-09-12T01:00:24.387 INFO:tasks.workunit.client.0.smithi070.stderr: 7f21667fc640 / http_manager 2024-09-12T01:00:24.387 INFO:tasks.workunit.client.0.smithi070.stderr: 7f21677fe640 / rgw_dt_lg_renew 2024-09-12T01:00:24.387 INFO:tasks.workunit.client.0.smithi070.stderr: 7f21877fe640 / ms_dispatch 2024-09-12T01:00:24.387 INFO:tasks.workunit.client.0.smithi070.stderr: 7f21997fa640 / io_context_pool 2024-09-12T01:00:24.387 INFO:tasks.workunit.client.0.smithi070.stderr: 7f219b7fe640 / ms_dispatch 2024-09-12T01:00:24.387 INFO:tasks.workunit.client.0.smithi070.stderr: 7f21a2604640 / ms_dispatch 2024-09-12T01:00:24.387 INFO:tasks.workunit.client.0.smithi070.stderr: 7f21a3e07640 / io_context_pool 2024-09-12T01:00:24.387 INFO:tasks.workunit.client.0.smithi070.stderr: 7f22b50b5640 / msgr-worker-2 2024-09-12T01:00:24.387 INFO:tasks.workunit.client.0.smithi070.stderr: 7f22b58b6640 / msgr-worker-1 2024-09-12T01:00:24.387 INFO:tasks.workunit.client.0.smithi070.stderr: 7f22b60b7640 / msgr-worker-0 2024-09-12T01:00:24.387 INFO:tasks.workunit.client.0.smithi070.stderr: 7f22b68b8640 / io_context_pool 2024-09-12T01:00:24.387 INFO:tasks.workunit.client.0.smithi070.stderr: 7f22b7db09c0 / radosgw-admin 2024-09-12T01:00:24.388 INFO:tasks.workunit.client.0.smithi070.stderr: max_recent 500 2024-09-12T01:00:24.388 INFO:tasks.workunit.client.0.smithi070.stderr: max_new 1000 2024-09-12T01:00:24.388 INFO:tasks.workunit.client.0.smithi070.stderr: log_file /var/log/ceph/ceph-client.admin.146859.log 2024-09-12T01:00:24.388 INFO:tasks.workunit.client.0.smithi070.stderr:--- end dump of recent events --- 2024-09-12T01:00:24.388 INFO:tasks.workunit.client.0.smithi070.stderr:--- begin dump of recent events --- 2024-09-12T01:00:24.388 INFO:tasks.workunit.client.0.smithi070.stderr: -499> 2024-09-12T01:00:23.951+0000 7f22b50b5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T01:00:24.388 INFO:tasks.workunit.client.0.smithi070.stderr: -498> 2024-09-12T01:00:23.951+0000 7f22b60b7640 10 monclient(hunting): handle_auth_done global_id 8415 payload 274 2024-09-12T01:00:24.388 INFO:tasks.workunit.client.0.smithi070.stderr: -497> 2024-09-12T01:00:23.951+0000 7f22b60b7640 10 monclient: _finish_hunting 0 2024-09-12T01:00:24.388 INFO:tasks.workunit.client.0.smithi070.stderr: -496> 2024-09-12T01:00:23.951+0000 7f22b60b7640 1 monclient: found mon.noname-a 2024-09-12T01:00:24.388 INFO:tasks.workunit.client.0.smithi070.stderr: -495> 2024-09-12T01:00:23.951+0000 7f22b60b7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T01:00:24.388 INFO:tasks.workunit.client.0.smithi070.stderr: -494> 2024-09-12T01:00:23.951+0000 7f21a3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T01:00:24.388 INFO:tasks.workunit.client.0.smithi070.stderr: -493> 2024-09-12T01:00:23.951+0000 7f21a3e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T01:00:24.388 INFO:tasks.workunit.client.0.smithi070.stderr: -492> 2024-09-12T01:00:23.951+0000 7f21a3e07640 10 monclient: dump: 2024-09-12T01:00:24.389 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T01:00:24.389 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T01:00:24.389 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.389 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.389 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T01:00:24.389 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.389 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:00:24.389 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T01:00:24.389 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T01:00:24.389 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.389 INFO:tasks.workunit.client.0.smithi070.stderr: -491> 2024-09-12T01:00:23.951+0000 7f21a3e07640 10 monclient: _finish_auth 0 2024-09-12T01:00:24.389 INFO:tasks.workunit.client.0.smithi070.stderr: -490> 2024-09-12T01:00:23.951+0000 7f21a3e07640 10 monclient: _check_auth_tickets 2024-09-12T01:00:24.389 INFO:tasks.workunit.client.0.smithi070.stderr: -489> 2024-09-12T01:00:23.951+0000 7f21a3e07640 10 monclient: handle_config config(0 keys) 2024-09-12T01:00:24.390 INFO:tasks.workunit.client.0.smithi070.stderr: -488> 2024-09-12T01:00:23.951+0000 7f21a3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T01:00:24.390 INFO:tasks.workunit.client.0.smithi070.stderr: -487> 2024-09-12T01:00:23.951+0000 7f21a3e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T01:00:24.390 INFO:tasks.workunit.client.0.smithi070.stderr: -486> 2024-09-12T01:00:23.951+0000 7f21a3e07640 10 monclient: dump: 2024-09-12T01:00:24.390 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T01:00:24.390 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T01:00:24.390 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.390 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.390 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T01:00:24.390 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.390 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:00:24.390 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T01:00:24.390 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T01:00:24.390 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.390 INFO:tasks.workunit.client.0.smithi070.stderr: -485> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 monclient: authenticate success, global_id 8415 2024-09-12T01:00:24.390 INFO:tasks.workunit.client.0.smithi070.stderr: -484> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 10 monclient: get_monmap_and_config success 2024-09-12T01:00:24.391 INFO:tasks.workunit.client.0.smithi070.stderr: -483> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 4 set_mon_vals no callback set 2024-09-12T01:00:24.391 INFO:tasks.workunit.client.0.smithi070.stderr: -482> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 10 monclient: shutdown 2024-09-12T01:00:24.391 INFO:tasks.workunit.client.0.smithi070.stderr: -481> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) unregister_commands rotate-key 2024-09-12T01:00:24.391 INFO:tasks.workunit.client.0.smithi070.stderr: -480> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 10 monclient: build_initial_monmap 2024-09-12T01:00:24.391 INFO:tasks.workunit.client.0.smithi070.stderr: -479> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 1 build_initial for_mkfs: 0 2024-09-12T01:00:24.391 INFO:tasks.workunit.client.0.smithi070.stderr: -478> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 10 monclient: monmap: 2024-09-12T01:00:24.391 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T01:00:24.391 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T01:00:24.391 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T01:00:24.391 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T01:00:24.391 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T01:00:24.391 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.391 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T01:00:24.392 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T01:00:24.392 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T01:00:24.392 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.392 INFO:tasks.workunit.client.0.smithi070.stderr: -477> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding auth protocol: cephx 2024-09-12T01:00:24.392 INFO:tasks.workunit.client.0.smithi070.stderr: -476> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding auth protocol: cephx 2024-09-12T01:00:24.392 INFO:tasks.workunit.client.0.smithi070.stderr: -475> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding auth protocol: cephx 2024-09-12T01:00:24.392 INFO:tasks.workunit.client.0.smithi070.stderr: -474> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding con mode: secure 2024-09-12T01:00:24.392 INFO:tasks.workunit.client.0.smithi070.stderr: -473> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding con mode: crc 2024-09-12T01:00:24.392 INFO:tasks.workunit.client.0.smithi070.stderr: -472> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding con mode: secure 2024-09-12T01:00:24.392 INFO:tasks.workunit.client.0.smithi070.stderr: -471> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding con mode: crc 2024-09-12T01:00:24.392 INFO:tasks.workunit.client.0.smithi070.stderr: -470> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding con mode: secure 2024-09-12T01:00:24.392 INFO:tasks.workunit.client.0.smithi070.stderr: -469> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding con mode: crc 2024-09-12T01:00:24.392 INFO:tasks.workunit.client.0.smithi070.stderr: -468> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding con mode: crc 2024-09-12T01:00:24.393 INFO:tasks.workunit.client.0.smithi070.stderr: -467> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding con mode: secure 2024-09-12T01:00:24.393 INFO:tasks.workunit.client.0.smithi070.stderr: -466> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding con mode: crc 2024-09-12T01:00:24.393 INFO:tasks.workunit.client.0.smithi070.stderr: -465> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding con mode: secure 2024-09-12T01:00:24.393 INFO:tasks.workunit.client.0.smithi070.stderr: -464> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding con mode: crc 2024-09-12T01:00:24.393 INFO:tasks.workunit.client.0.smithi070.stderr: -463> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d6270) adding con mode: secure 2024-09-12T01:00:24.393 INFO:tasks.workunit.client.0.smithi070.stderr: -462> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T01:00:24.393 INFO:tasks.workunit.client.0.smithi070.stderr: -461> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 1 librados: starting msgr at 2024-09-12T01:00:24.393 INFO:tasks.workunit.client.0.smithi070.stderr: -460> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 1 librados: starting objecter 2024-09-12T01:00:24.393 INFO:tasks.workunit.client.0.smithi070.stderr: -459> 2024-09-12T01:00:23.951+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command objecter_requests hook 0x562bde5488a0 2024-09-12T01:00:24.393 INFO:tasks.workunit.client.0.smithi070.stderr: -458> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 1 librados: setting wanted keys 2024-09-12T01:00:24.393 INFO:tasks.workunit.client.0.smithi070.stderr: -457> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 1 librados: calling monclient init 2024-09-12T01:00:24.393 INFO:tasks.workunit.client.0.smithi070.stderr: -456> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient: init 2024-09-12T01:00:24.393 INFO:tasks.workunit.client.0.smithi070.stderr: -455> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding auth protocol: cephx 2024-09-12T01:00:24.393 INFO:tasks.workunit.client.0.smithi070.stderr: -454> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding auth protocol: cephx 2024-09-12T01:00:24.394 INFO:tasks.workunit.client.0.smithi070.stderr: -453> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding auth protocol: cephx 2024-09-12T01:00:24.394 INFO:tasks.workunit.client.0.smithi070.stderr: -452> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding con mode: secure 2024-09-12T01:00:24.394 INFO:tasks.workunit.client.0.smithi070.stderr: -451> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding con mode: crc 2024-09-12T01:00:24.394 INFO:tasks.workunit.client.0.smithi070.stderr: -450> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding con mode: secure 2024-09-12T01:00:24.394 INFO:tasks.workunit.client.0.smithi070.stderr: -449> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding con mode: crc 2024-09-12T01:00:24.394 INFO:tasks.workunit.client.0.smithi070.stderr: -448> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding con mode: secure 2024-09-12T01:00:24.394 INFO:tasks.workunit.client.0.smithi070.stderr: -447> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding con mode: crc 2024-09-12T01:00:24.394 INFO:tasks.workunit.client.0.smithi070.stderr: -446> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding con mode: crc 2024-09-12T01:00:24.394 INFO:tasks.workunit.client.0.smithi070.stderr: -445> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding con mode: secure 2024-09-12T01:00:24.394 INFO:tasks.workunit.client.0.smithi070.stderr: -444> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding con mode: crc 2024-09-12T01:00:24.394 INFO:tasks.workunit.client.0.smithi070.stderr: -443> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding con mode: secure 2024-09-12T01:00:24.394 INFO:tasks.workunit.client.0.smithi070.stderr: -442> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding con mode: crc 2024-09-12T01:00:24.394 INFO:tasks.workunit.client.0.smithi070.stderr: -441> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 AuthRegistry(0x562bde7d0d20) adding con mode: secure 2024-09-12T01:00:24.394 INFO:tasks.workunit.client.0.smithi070.stderr: -440> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T01:00:24.395 INFO:tasks.workunit.client.0.smithi070.stderr: -439> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T01:00:24.395 INFO:tasks.workunit.client.0.smithi070.stderr: -438> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command rotate-key hook 0x562bde7d0e68 2024-09-12T01:00:24.395 INFO:tasks.workunit.client.0.smithi070.stderr: -437> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient: _reopen_session rank -1 2024-09-12T01:00:24.395 INFO:tasks.workunit.client.0.smithi070.stderr: -436> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T01:00:24.395 INFO:tasks.workunit.client.0.smithi070.stderr: -435> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient(hunting): picked mon.noname-b con 0x562bde6814f0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T01:00:24.395 INFO:tasks.workunit.client.0.smithi070.stderr: -434> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient(hunting): picked mon.noname-c con 0x562bde6902e0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T01:00:24.395 INFO:tasks.workunit.client.0.smithi070.stderr: -433> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient(hunting): picked mon.noname-a con 0x562bde7d7260 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T01:00:24.395 INFO:tasks.workunit.client.0.smithi070.stderr: -432> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient(hunting): start opening mon connection 2024-09-12T01:00:24.395 INFO:tasks.workunit.client.0.smithi070.stderr: -431> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient(hunting): start opening mon connection 2024-09-12T01:00:24.395 INFO:tasks.workunit.client.0.smithi070.stderr: -430> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient(hunting): start opening mon connection 2024-09-12T01:00:24.395 INFO:tasks.workunit.client.0.smithi070.stderr: -429> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient(hunting): _renew_subs 2024-09-12T01:00:24.395 INFO:tasks.workunit.client.0.smithi070.stderr: -428> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient(hunting): authenticate will time out at 2474.404651s 2024-09-12T01:00:24.396 INFO:tasks.workunit.client.0.smithi070.stderr: -427> 2024-09-12T01:00:23.955+0000 7f22b60b7640 10 monclient(hunting): get_auth_request con 0x562bde7d7260 auth_method 0 2024-09-12T01:00:24.396 INFO:tasks.workunit.client.0.smithi070.stderr: -426> 2024-09-12T01:00:23.955+0000 7f22b60b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T01:00:24.396 INFO:tasks.workunit.client.0.smithi070.stderr: -425> 2024-09-12T01:00:23.955+0000 7f22b60b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T01:00:24.396 INFO:tasks.workunit.client.0.smithi070.stderr: -424> 2024-09-12T01:00:23.955+0000 7f22b60b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T01:00:24.396 INFO:tasks.workunit.client.0.smithi070.stderr: -423> 2024-09-12T01:00:23.955+0000 7f22b50b5640 10 monclient(hunting): get_auth_request con 0x562bde6902e0 auth_method 0 2024-09-12T01:00:24.396 INFO:tasks.workunit.client.0.smithi070.stderr: -422> 2024-09-12T01:00:23.955+0000 7f22b50b5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T01:00:24.396 INFO:tasks.workunit.client.0.smithi070.stderr: -421> 2024-09-12T01:00:23.955+0000 7f22b50b5640 10 monclient(hunting): _init_auth method 2 2024-09-12T01:00:24.396 INFO:tasks.workunit.client.0.smithi070.stderr: -420> 2024-09-12T01:00:23.955+0000 7f22b50b5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T01:00:24.396 INFO:tasks.workunit.client.0.smithi070.stderr: -419> 2024-09-12T01:00:23.955+0000 7f22b60b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T01:00:24.396 INFO:tasks.workunit.client.0.smithi070.stderr: -418> 2024-09-12T01:00:23.955+0000 7f22b60b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T01:00:24.396 INFO:tasks.workunit.client.0.smithi070.stderr: -417> 2024-09-12T01:00:23.955+0000 7f22b60b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T01:00:24.396 INFO:tasks.workunit.client.0.smithi070.stderr: -416> 2024-09-12T01:00:23.955+0000 7f22b50b5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T01:00:24.396 INFO:tasks.workunit.client.0.smithi070.stderr: -415> 2024-09-12T01:00:23.955+0000 7f22b50b5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T01:00:24.396 INFO:tasks.workunit.client.0.smithi070.stderr: -414> 2024-09-12T01:00:23.955+0000 7f22b50b5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T01:00:24.397 INFO:tasks.workunit.client.0.smithi070.stderr: -413> 2024-09-12T01:00:23.955+0000 7f22b60b7640 10 monclient(hunting): handle_auth_done global_id 8418 payload 824 2024-09-12T01:00:24.397 INFO:tasks.workunit.client.0.smithi070.stderr: -412> 2024-09-12T01:00:23.955+0000 7f22b60b7640 10 monclient: _finish_hunting 0 2024-09-12T01:00:24.397 INFO:tasks.workunit.client.0.smithi070.stderr: -411> 2024-09-12T01:00:23.955+0000 7f22b60b7640 1 monclient: found mon.noname-a 2024-09-12T01:00:24.397 INFO:tasks.workunit.client.0.smithi070.stderr: -410> 2024-09-12T01:00:23.955+0000 7f22b60b7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T01:00:24.397 INFO:tasks.workunit.client.0.smithi070.stderr: -409> 2024-09-12T01:00:23.955+0000 7f21a2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T01:00:24.397 INFO:tasks.workunit.client.0.smithi070.stderr: -408> 2024-09-12T01:00:23.955+0000 7f21a2604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T01:00:24.397 INFO:tasks.workunit.client.0.smithi070.stderr: -407> 2024-09-12T01:00:23.955+0000 7f21a2604640 10 monclient: dump: 2024-09-12T01:00:24.397 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T01:00:24.397 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T01:00:24.397 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.397 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.397 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T01:00:24.397 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.398 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:00:24.398 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T01:00:24.398 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T01:00:24.398 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.398 INFO:tasks.workunit.client.0.smithi070.stderr: -406> 2024-09-12T01:00:23.955+0000 7f21a2604640 10 monclient: _finish_auth 0 2024-09-12T01:00:24.398 INFO:tasks.workunit.client.0.smithi070.stderr: -405> 2024-09-12T01:00:23.955+0000 7f21a2604640 10 monclient: _check_auth_tickets 2024-09-12T01:00:24.398 INFO:tasks.workunit.client.0.smithi070.stderr: -404> 2024-09-12T01:00:23.955+0000 7f21a2604640 10 monclient: handle_config config(0 keys) 2024-09-12T01:00:24.398 INFO:tasks.workunit.client.0.smithi070.stderr: -403> 2024-09-12T01:00:23.955+0000 7f21a2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T01:00:24.398 INFO:tasks.workunit.client.0.smithi070.stderr: -402> 2024-09-12T01:00:23.955+0000 7f21a2604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T01:00:24.398 INFO:tasks.workunit.client.0.smithi070.stderr: -401> 2024-09-12T01:00:23.955+0000 7f21a2604640 10 monclient: dump: 2024-09-12T01:00:24.398 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T01:00:24.398 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T01:00:24.398 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.398 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.399 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T01:00:24.399 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.399 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:00:24.399 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T01:00:24.399 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T01:00:24.399 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.399 INFO:tasks.workunit.client.0.smithi070.stderr: -400> 2024-09-12T01:00:23.955+0000 7f21a3e07640 4 set_mon_vals no callback set 2024-09-12T01:00:24.399 INFO:tasks.workunit.client.0.smithi070.stderr: -399> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 5 monclient: authenticate success, global_id 8418 2024-09-12T01:00:24.399 INFO:tasks.workunit.client.0.smithi070.stderr: -398> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient: _renew_subs 2024-09-12T01:00:24.399 INFO:tasks.workunit.client.0.smithi070.stderr: -397> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T01:00:24.399 INFO:tasks.workunit.client.0.smithi070.stderr: -396> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient: _renew_subs 2024-09-12T01:00:24.399 INFO:tasks.workunit.client.0.smithi070.stderr: -395> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T01:00:24.399 INFO:tasks.workunit.client.0.smithi070.stderr: -394> 2024-09-12T01:00:23.955+0000 7f22b7db09c0 1 librados: init done 2024-09-12T01:00:24.399 INFO:tasks.workunit.client.0.smithi070.stderr: -393> 2024-09-12T01:00:23.955+0000 7f21a2604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T01:00:24.400 INFO:tasks.workunit.client.0.smithi070.stderr: -392> 2024-09-12T01:00:23.955+0000 7f21a2604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T01:00:24.400 INFO:tasks.workunit.client.0.smithi070.stderr: -391> 2024-09-12T01:00:23.955+0000 7f21a2604640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T01:00:24.400 INFO:tasks.workunit.client.0.smithi070.stderr: -390> 2024-09-12T01:00:23.955+0000 7f22b50b5640 10 monclient: get_auth_request con 0x562bde818b60 auth_method 0 2024-09-12T01:00:24.400 INFO:tasks.workunit.client.0.smithi070.stderr: -389> 2024-09-12T01:00:23.959+0000 7f22b58b6640 10 monclient: get_auth_request con 0x7f219c070b10 auth_method 0 2024-09-12T01:00:24.400 INFO:tasks.workunit.client.0.smithi070.stderr: -388> 2024-09-12T01:00:23.959+0000 7f22b58b6640 10 monclient: get_auth_request con 0x562bde81bd40 auth_method 0 2024-09-12T01:00:24.400 INFO:tasks.workunit.client.0.smithi070.stderr: -387> 2024-09-12T01:00:23.959+0000 7f22b50b5640 10 monclient: get_auth_request con 0x562bde81ff30 auth_method 0 2024-09-12T01:00:24.400 INFO:tasks.workunit.client.0.smithi070.stderr: -386> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient: build_initial_monmap 2024-09-12T01:00:24.400 INFO:tasks.workunit.client.0.smithi070.stderr: -385> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 1 build_initial for_mkfs: 0 2024-09-12T01:00:24.400 INFO:tasks.workunit.client.0.smithi070.stderr: -384> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient: monmap: 2024-09-12T01:00:24.400 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T01:00:24.400 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T01:00:24.400 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T01:00:24.400 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T01:00:24.400 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T01:00:24.401 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.401 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T01:00:24.401 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T01:00:24.401 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T01:00:24.401 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.401 INFO:tasks.workunit.client.0.smithi070.stderr: -383> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding auth protocol: cephx 2024-09-12T01:00:24.401 INFO:tasks.workunit.client.0.smithi070.stderr: -382> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding auth protocol: cephx 2024-09-12T01:00:24.401 INFO:tasks.workunit.client.0.smithi070.stderr: -381> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding auth protocol: cephx 2024-09-12T01:00:24.401 INFO:tasks.workunit.client.0.smithi070.stderr: -380> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding con mode: secure 2024-09-12T01:00:24.401 INFO:tasks.workunit.client.0.smithi070.stderr: -379> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding con mode: crc 2024-09-12T01:00:24.401 INFO:tasks.workunit.client.0.smithi070.stderr: -378> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding con mode: secure 2024-09-12T01:00:24.401 INFO:tasks.workunit.client.0.smithi070.stderr: -377> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding con mode: crc 2024-09-12T01:00:24.401 INFO:tasks.workunit.client.0.smithi070.stderr: -376> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding con mode: secure 2024-09-12T01:00:24.401 INFO:tasks.workunit.client.0.smithi070.stderr: -375> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding con mode: crc 2024-09-12T01:00:24.402 INFO:tasks.workunit.client.0.smithi070.stderr: -374> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding con mode: crc 2024-09-12T01:00:24.402 INFO:tasks.workunit.client.0.smithi070.stderr: -373> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding con mode: secure 2024-09-12T01:00:24.402 INFO:tasks.workunit.client.0.smithi070.stderr: -372> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding con mode: crc 2024-09-12T01:00:24.402 INFO:tasks.workunit.client.0.smithi070.stderr: -371> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding con mode: secure 2024-09-12T01:00:24.402 INFO:tasks.workunit.client.0.smithi070.stderr: -370> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding con mode: crc 2024-09-12T01:00:24.402 INFO:tasks.workunit.client.0.smithi070.stderr: -369> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde824930) adding con mode: secure 2024-09-12T01:00:24.402 INFO:tasks.workunit.client.0.smithi070.stderr: -368> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T01:00:24.402 INFO:tasks.workunit.client.0.smithi070.stderr: -367> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command objecter_requests cmddesc objecter_requests hook 0x562bde828300 EEXIST 2024-09-12T01:00:24.402 INFO:tasks.workunit.client.0.smithi070.stderr: -366> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient: init 2024-09-12T01:00:24.402 INFO:tasks.workunit.client.0.smithi070.stderr: -365> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding auth protocol: cephx 2024-09-12T01:00:24.402 INFO:tasks.workunit.client.0.smithi070.stderr: -364> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding auth protocol: cephx 2024-09-12T01:00:24.402 INFO:tasks.workunit.client.0.smithi070.stderr: -363> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding auth protocol: cephx 2024-09-12T01:00:24.402 INFO:tasks.workunit.client.0.smithi070.stderr: -362> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding con mode: secure 2024-09-12T01:00:24.403 INFO:tasks.workunit.client.0.smithi070.stderr: -361> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding con mode: crc 2024-09-12T01:00:24.403 INFO:tasks.workunit.client.0.smithi070.stderr: -360> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding con mode: secure 2024-09-12T01:00:24.403 INFO:tasks.workunit.client.0.smithi070.stderr: -359> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding con mode: crc 2024-09-12T01:00:24.403 INFO:tasks.workunit.client.0.smithi070.stderr: -358> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding con mode: secure 2024-09-12T01:00:24.403 INFO:tasks.workunit.client.0.smithi070.stderr: -357> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding con mode: crc 2024-09-12T01:00:24.403 INFO:tasks.workunit.client.0.smithi070.stderr: -356> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding con mode: crc 2024-09-12T01:00:24.403 INFO:tasks.workunit.client.0.smithi070.stderr: -355> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding con mode: secure 2024-09-12T01:00:24.403 INFO:tasks.workunit.client.0.smithi070.stderr: -354> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding con mode: crc 2024-09-12T01:00:24.403 INFO:tasks.workunit.client.0.smithi070.stderr: -353> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding con mode: secure 2024-09-12T01:00:24.403 INFO:tasks.workunit.client.0.smithi070.stderr: -352> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding con mode: crc 2024-09-12T01:00:24.403 INFO:tasks.workunit.client.0.smithi070.stderr: -351> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 AuthRegistry(0x562bde8231b8) adding con mode: secure 2024-09-12T01:00:24.403 INFO:tasks.workunit.client.0.smithi070.stderr: -350> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T01:00:24.403 INFO:tasks.workunit.client.0.smithi070.stderr: -349> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T01:00:24.403 INFO:tasks.workunit.client.0.smithi070.stderr: -348> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command rotate-key cmddesc rotate-key hook 0x562bde823300 EEXIST 2024-09-12T01:00:24.404 INFO:tasks.workunit.client.0.smithi070.stderr: -347> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient: _reopen_session rank -1 2024-09-12T01:00:24.404 INFO:tasks.workunit.client.0.smithi070.stderr: -346> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T01:00:24.404 INFO:tasks.workunit.client.0.smithi070.stderr: -345> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient(hunting): picked mon.noname-b con 0x562bde84c4b0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T01:00:24.404 INFO:tasks.workunit.client.0.smithi070.stderr: -344> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient(hunting): picked mon.noname-a con 0x562bde84bde0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T01:00:24.404 INFO:tasks.workunit.client.0.smithi070.stderr: -343> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient(hunting): picked mon.noname-c con 0x562bde84a7c0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T01:00:24.404 INFO:tasks.workunit.client.0.smithi070.stderr: -342> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient(hunting): start opening mon connection 2024-09-12T01:00:24.404 INFO:tasks.workunit.client.0.smithi070.stderr: -341> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient(hunting): start opening mon connection 2024-09-12T01:00:24.404 INFO:tasks.workunit.client.0.smithi070.stderr: -340> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient(hunting): start opening mon connection 2024-09-12T01:00:24.404 INFO:tasks.workunit.client.0.smithi070.stderr: -339> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient(hunting): _renew_subs 2024-09-12T01:00:24.404 INFO:tasks.workunit.client.0.smithi070.stderr: -338> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient(hunting): authenticate will time out at 2474.414228s 2024-09-12T01:00:24.404 INFO:tasks.workunit.client.0.smithi070.stderr: -337> 2024-09-12T01:00:23.963+0000 7f22b60b7640 10 monclient(hunting): get_auth_request con 0x562bde84a7c0 auth_method 0 2024-09-12T01:00:24.405 INFO:tasks.workunit.client.0.smithi070.stderr: -336> 2024-09-12T01:00:23.963+0000 7f22b60b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T01:00:24.405 INFO:tasks.workunit.client.0.smithi070.stderr: -335> 2024-09-12T01:00:23.963+0000 7f22b60b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T01:00:24.405 INFO:tasks.workunit.client.0.smithi070.stderr: -334> 2024-09-12T01:00:23.963+0000 7f22b60b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T01:00:24.405 INFO:tasks.workunit.client.0.smithi070.stderr: -333> 2024-09-12T01:00:23.963+0000 7f22b60b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T01:00:24.405 INFO:tasks.workunit.client.0.smithi070.stderr: -332> 2024-09-12T01:00:23.963+0000 7f22b60b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T01:00:24.405 INFO:tasks.workunit.client.0.smithi070.stderr: -331> 2024-09-12T01:00:23.963+0000 7f22b60b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T01:00:24.405 INFO:tasks.workunit.client.0.smithi070.stderr: -330> 2024-09-12T01:00:23.963+0000 7f22b50b5640 10 monclient(hunting): get_auth_request con 0x562bde84bde0 auth_method 0 2024-09-12T01:00:24.406 INFO:tasks.workunit.client.0.smithi070.stderr: -329> 2024-09-12T01:00:23.963+0000 7f22b50b5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T01:00:24.406 INFO:tasks.workunit.client.0.smithi070.stderr: -328> 2024-09-12T01:00:23.963+0000 7f22b50b5640 10 monclient(hunting): _init_auth method 2 2024-09-12T01:00:24.406 INFO:tasks.workunit.client.0.smithi070.stderr: -327> 2024-09-12T01:00:23.963+0000 7f22b50b5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T01:00:24.406 INFO:tasks.workunit.client.0.smithi070.stderr: -326> 2024-09-12T01:00:23.963+0000 7f22b50b5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T01:00:24.406 INFO:tasks.workunit.client.0.smithi070.stderr: -325> 2024-09-12T01:00:23.963+0000 7f22b50b5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T01:00:24.406 INFO:tasks.workunit.client.0.smithi070.stderr: -324> 2024-09-12T01:00:23.963+0000 7f22b50b5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T01:00:24.406 INFO:tasks.workunit.client.0.smithi070.stderr: -323> 2024-09-12T01:00:23.963+0000 7f22b60b7640 10 monclient(hunting): handle_auth_done global_id 7889 payload 824 2024-09-12T01:00:24.406 INFO:tasks.workunit.client.0.smithi070.stderr: -322> 2024-09-12T01:00:23.963+0000 7f22b60b7640 10 monclient: _finish_hunting 0 2024-09-12T01:00:24.406 INFO:tasks.workunit.client.0.smithi070.stderr: -321> 2024-09-12T01:00:23.963+0000 7f22b60b7640 1 monclient: found mon.noname-c 2024-09-12T01:00:24.407 INFO:tasks.workunit.client.0.smithi070.stderr: -320> 2024-09-12T01:00:23.963+0000 7f22b60b7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.70:3301/0 2024-09-12T01:00:24.407 INFO:tasks.workunit.client.0.smithi070.stderr: -319> 2024-09-12T01:00:23.963+0000 7f22b58b6640 10 monclient: get_auth_request con 0x562bde84c4b0 auth_method 0 2024-09-12T01:00:24.407 INFO:tasks.workunit.client.0.smithi070.stderr: -318> 2024-09-12T01:00:23.963+0000 7f219b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T01:00:24.407 INFO:tasks.workunit.client.0.smithi070.stderr: -317> 2024-09-12T01:00:23.963+0000 7f219b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T01:00:24.407 INFO:tasks.workunit.client.0.smithi070.stderr: -316> 2024-09-12T01:00:23.963+0000 7f219b7fe640 10 monclient: dump: 2024-09-12T01:00:24.407 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T01:00:24.407 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T01:00:24.407 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.408 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.408 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T01:00:24.408 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.408 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:00:24.408 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T01:00:24.408 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T01:00:24.408 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.408 INFO:tasks.workunit.client.0.smithi070.stderr: -315> 2024-09-12T01:00:23.963+0000 7f219b7fe640 10 monclient: _finish_auth 0 2024-09-12T01:00:24.408 INFO:tasks.workunit.client.0.smithi070.stderr: -314> 2024-09-12T01:00:23.963+0000 7f219b7fe640 10 monclient: _check_auth_tickets 2024-09-12T01:00:24.409 INFO:tasks.workunit.client.0.smithi070.stderr: -313> 2024-09-12T01:00:23.963+0000 7f219b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T01:00:24.409 INFO:tasks.workunit.client.0.smithi070.stderr: -312> 2024-09-12T01:00:23.963+0000 7f219b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T01:00:24.409 INFO:tasks.workunit.client.0.smithi070.stderr: -311> 2024-09-12T01:00:23.963+0000 7f219b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T01:00:24.409 INFO:tasks.workunit.client.0.smithi070.stderr: -310> 2024-09-12T01:00:23.963+0000 7f219b7fe640 10 monclient: dump: 2024-09-12T01:00:24.409 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T01:00:24.409 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T01:00:24.409 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.409 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.410 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T01:00:24.410 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.410 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:00:24.410 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T01:00:24.410 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T01:00:24.410 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.410 INFO:tasks.workunit.client.0.smithi070.stderr: -309> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 5 monclient: authenticate success, global_id 7889 2024-09-12T01:00:24.411 INFO:tasks.workunit.client.0.smithi070.stderr: -308> 2024-09-12T01:00:23.963+0000 7f22b68b8640 4 set_mon_vals no callback set 2024-09-12T01:00:24.411 INFO:tasks.workunit.client.0.smithi070.stderr: -307> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient: _renew_subs 2024-09-12T01:00:24.411 INFO:tasks.workunit.client.0.smithi070.stderr: -306> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T01:00:24.411 INFO:tasks.workunit.client.0.smithi070.stderr: -305> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient: _renew_subs 2024-09-12T01:00:24.411 INFO:tasks.workunit.client.0.smithi070.stderr: -304> 2024-09-12T01:00:23.963+0000 7f22b7db09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.70:3301/0 2024-09-12T01:00:24.411 INFO:tasks.workunit.client.0.smithi070.stderr: -303> 2024-09-12T01:00:23.967+0000 7f219b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T01:00:24.411 INFO:tasks.workunit.client.0.smithi070.stderr: -302> 2024-09-12T01:00:23.967+0000 7f219b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T01:00:24.412 INFO:tasks.workunit.client.0.smithi070.stderr: -301> 2024-09-12T01:00:23.967+0000 7f219b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T01:00:24.412 INFO:tasks.workunit.client.0.smithi070.stderr: -300> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient: get_monmap_and_config 2024-09-12T01:00:24.412 INFO:tasks.workunit.client.0.smithi070.stderr: -299> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient: build_initial_monmap 2024-09-12T01:00:24.412 INFO:tasks.workunit.client.0.smithi070.stderr: -298> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 1 build_initial for_mkfs: 0 2024-09-12T01:00:24.412 INFO:tasks.workunit.client.0.smithi070.stderr: -297> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient: monmap: 2024-09-12T01:00:24.412 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T01:00:24.412 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T01:00:24.412 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T01:00:24.413 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T01:00:24.413 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T01:00:24.413 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.413 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T01:00:24.413 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T01:00:24.413 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T01:00:24.413 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.414 INFO:tasks.workunit.client.0.smithi070.stderr: -296> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding auth protocol: cephx 2024-09-12T01:00:24.414 INFO:tasks.workunit.client.0.smithi070.stderr: -295> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding auth protocol: cephx 2024-09-12T01:00:24.414 INFO:tasks.workunit.client.0.smithi070.stderr: -294> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding auth protocol: cephx 2024-09-12T01:00:24.414 INFO:tasks.workunit.client.0.smithi070.stderr: -293> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding con mode: secure 2024-09-12T01:00:24.414 INFO:tasks.workunit.client.0.smithi070.stderr: -292> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding con mode: crc 2024-09-12T01:00:24.414 INFO:tasks.workunit.client.0.smithi070.stderr: -291> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding con mode: secure 2024-09-12T01:00:24.414 INFO:tasks.workunit.client.0.smithi070.stderr: -290> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding con mode: crc 2024-09-12T01:00:24.415 INFO:tasks.workunit.client.0.smithi070.stderr: -289> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding con mode: secure 2024-09-12T01:00:24.415 INFO:tasks.workunit.client.0.smithi070.stderr: -288> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding con mode: crc 2024-09-12T01:00:24.415 INFO:tasks.workunit.client.0.smithi070.stderr: -287> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding con mode: crc 2024-09-12T01:00:24.415 INFO:tasks.workunit.client.0.smithi070.stderr: -286> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding con mode: secure 2024-09-12T01:00:24.415 INFO:tasks.workunit.client.0.smithi070.stderr: -285> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding con mode: crc 2024-09-12T01:00:24.415 INFO:tasks.workunit.client.0.smithi070.stderr: -284> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding con mode: secure 2024-09-12T01:00:24.415 INFO:tasks.workunit.client.0.smithi070.stderr: -283> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding con mode: crc 2024-09-12T01:00:24.415 INFO:tasks.workunit.client.0.smithi070.stderr: -282> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde86ba30) adding con mode: secure 2024-09-12T01:00:24.416 INFO:tasks.workunit.client.0.smithi070.stderr: -281> 2024-09-12T01:00:23.967+0000 7f22b58b6640 10 monclient: get_auth_request con 0x7f2190070a20 auth_method 0 2024-09-12T01:00:24.416 INFO:tasks.workunit.client.0.smithi070.stderr: -280> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T01:00:24.416 INFO:tasks.workunit.client.0.smithi070.stderr: -279> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient: init 2024-09-12T01:00:24.416 INFO:tasks.workunit.client.0.smithi070.stderr: -278> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding auth protocol: cephx 2024-09-12T01:00:24.416 INFO:tasks.workunit.client.0.smithi070.stderr: -277> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding auth protocol: cephx 2024-09-12T01:00:24.416 INFO:tasks.workunit.client.0.smithi070.stderr: -276> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding auth protocol: cephx 2024-09-12T01:00:24.416 INFO:tasks.workunit.client.0.smithi070.stderr: -275> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding con mode: secure 2024-09-12T01:00:24.416 INFO:tasks.workunit.client.0.smithi070.stderr: -274> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding con mode: crc 2024-09-12T01:00:24.416 INFO:tasks.workunit.client.0.smithi070.stderr: -273> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding con mode: secure 2024-09-12T01:00:24.416 INFO:tasks.workunit.client.0.smithi070.stderr: -272> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding con mode: crc 2024-09-12T01:00:24.416 INFO:tasks.workunit.client.0.smithi070.stderr: -271> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding con mode: secure 2024-09-12T01:00:24.416 INFO:tasks.workunit.client.0.smithi070.stderr: -270> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding con mode: crc 2024-09-12T01:00:24.416 INFO:tasks.workunit.client.0.smithi070.stderr: -269> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding con mode: crc 2024-09-12T01:00:24.417 INFO:tasks.workunit.client.0.smithi070.stderr: -268> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding con mode: secure 2024-09-12T01:00:24.417 INFO:tasks.workunit.client.0.smithi070.stderr: -267> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding con mode: crc 2024-09-12T01:00:24.417 INFO:tasks.workunit.client.0.smithi070.stderr: -266> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding con mode: secure 2024-09-12T01:00:24.417 INFO:tasks.workunit.client.0.smithi070.stderr: -265> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding con mode: crc 2024-09-12T01:00:24.417 INFO:tasks.workunit.client.0.smithi070.stderr: -264> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c78b0) adding con mode: secure 2024-09-12T01:00:24.417 INFO:tasks.workunit.client.0.smithi070.stderr: -263> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T01:00:24.417 INFO:tasks.workunit.client.0.smithi070.stderr: -262> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T01:00:24.417 INFO:tasks.workunit.client.0.smithi070.stderr: -261> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command rotate-key cmddesc rotate-key hook 0x7fffe52c79f8 EEXIST 2024-09-12T01:00:24.418 INFO:tasks.workunit.client.0.smithi070.stderr: -260> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient: _reopen_session rank -1 2024-09-12T01:00:24.418 INFO:tasks.workunit.client.0.smithi070.stderr: -259> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T01:00:24.418 INFO:tasks.workunit.client.0.smithi070.stderr: -258> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient(hunting): picked mon.noname-c con 0x562bde89ffb0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T01:00:24.418 INFO:tasks.workunit.client.0.smithi070.stderr: -257> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient(hunting): picked mon.noname-a con 0x562bde89b3a0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T01:00:24.418 INFO:tasks.workunit.client.0.smithi070.stderr: -256> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient(hunting): picked mon.noname-b con 0x562bde891aa0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T01:00:24.418 INFO:tasks.workunit.client.0.smithi070.stderr: -255> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient(hunting): start opening mon connection 2024-09-12T01:00:24.418 INFO:tasks.workunit.client.0.smithi070.stderr: -254> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient(hunting): start opening mon connection 2024-09-12T01:00:24.418 INFO:tasks.workunit.client.0.smithi070.stderr: -253> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient(hunting): start opening mon connection 2024-09-12T01:00:24.418 INFO:tasks.workunit.client.0.smithi070.stderr: -252> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient(hunting): _renew_subs 2024-09-12T01:00:24.418 INFO:tasks.workunit.client.0.smithi070.stderr: -251> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient(hunting): authenticate will time out at 2474.418150s 2024-09-12T01:00:24.418 INFO:tasks.workunit.client.0.smithi070.stderr: -250> 2024-09-12T01:00:23.967+0000 7f22b50b5640 10 monclient(hunting): get_auth_request con 0x562bde89b3a0 auth_method 0 2024-09-12T01:00:24.418 INFO:tasks.workunit.client.0.smithi070.stderr: -249> 2024-09-12T01:00:23.967+0000 7f22b50b5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T01:00:24.418 INFO:tasks.workunit.client.0.smithi070.stderr: -248> 2024-09-12T01:00:23.967+0000 7f22b50b5640 10 monclient(hunting): _init_auth method 2 2024-09-12T01:00:24.419 INFO:tasks.workunit.client.0.smithi070.stderr: -247> 2024-09-12T01:00:23.967+0000 7f22b50b5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T01:00:24.419 INFO:tasks.workunit.client.0.smithi070.stderr: -246> 2024-09-12T01:00:23.967+0000 7f22b58b6640 10 monclient(hunting): get_auth_request con 0x562bde89ffb0 auth_method 0 2024-09-12T01:00:24.419 INFO:tasks.workunit.client.0.smithi070.stderr: -245> 2024-09-12T01:00:23.967+0000 7f22b58b6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T01:00:24.419 INFO:tasks.workunit.client.0.smithi070.stderr: -244> 2024-09-12T01:00:23.967+0000 7f22b58b6640 10 monclient(hunting): _init_auth method 2 2024-09-12T01:00:24.419 INFO:tasks.workunit.client.0.smithi070.stderr: -243> 2024-09-12T01:00:23.967+0000 7f22b58b6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T01:00:24.419 INFO:tasks.workunit.client.0.smithi070.stderr: -242> 2024-09-12T01:00:23.967+0000 7f22b50b5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T01:00:24.419 INFO:tasks.workunit.client.0.smithi070.stderr: -241> 2024-09-12T01:00:23.967+0000 7f22b50b5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T01:00:24.419 INFO:tasks.workunit.client.0.smithi070.stderr: -240> 2024-09-12T01:00:23.967+0000 7f22b50b5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T01:00:24.419 INFO:tasks.workunit.client.0.smithi070.stderr: -239> 2024-09-12T01:00:23.967+0000 7f22b58b6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T01:00:24.419 INFO:tasks.workunit.client.0.smithi070.stderr: -238> 2024-09-12T01:00:23.967+0000 7f22b58b6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T01:00:24.419 INFO:tasks.workunit.client.0.smithi070.stderr: -237> 2024-09-12T01:00:23.967+0000 7f22b58b6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T01:00:24.419 INFO:tasks.workunit.client.0.smithi070.stderr: -236> 2024-09-12T01:00:23.967+0000 7f22b50b5640 10 monclient(hunting): handle_auth_done global_id 8424 payload 274 2024-09-12T01:00:24.419 INFO:tasks.workunit.client.0.smithi070.stderr: -235> 2024-09-12T01:00:23.967+0000 7f22b50b5640 10 monclient: _finish_hunting 0 2024-09-12T01:00:24.419 INFO:tasks.workunit.client.0.smithi070.stderr: -234> 2024-09-12T01:00:23.967+0000 7f22b50b5640 1 monclient: found mon.noname-a 2024-09-12T01:00:24.420 INFO:tasks.workunit.client.0.smithi070.stderr: -233> 2024-09-12T01:00:23.967+0000 7f22b50b5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T01:00:24.420 INFO:tasks.workunit.client.0.smithi070.stderr: -232> 2024-09-12T01:00:23.967+0000 7f21997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T01:00:24.420 INFO:tasks.workunit.client.0.smithi070.stderr: -231> 2024-09-12T01:00:23.967+0000 7f21997fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T01:00:24.420 INFO:tasks.workunit.client.0.smithi070.stderr: -230> 2024-09-12T01:00:23.967+0000 7f21997fa640 10 monclient: dump: 2024-09-12T01:00:24.420 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T01:00:24.420 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T01:00:24.420 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.420 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.420 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T01:00:24.420 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.420 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:00:24.420 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T01:00:24.420 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T01:00:24.421 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.421 INFO:tasks.workunit.client.0.smithi070.stderr: -229> 2024-09-12T01:00:23.967+0000 7f21997fa640 10 monclient: _finish_auth 0 2024-09-12T01:00:24.421 INFO:tasks.workunit.client.0.smithi070.stderr: -228> 2024-09-12T01:00:23.967+0000 7f21997fa640 10 monclient: _check_auth_tickets 2024-09-12T01:00:24.421 INFO:tasks.workunit.client.0.smithi070.stderr: -227> 2024-09-12T01:00:23.967+0000 7f21997fa640 10 monclient: handle_config config(0 keys) 2024-09-12T01:00:24.421 INFO:tasks.workunit.client.0.smithi070.stderr: -226> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 monclient: authenticate success, global_id 8424 2024-09-12T01:00:24.421 INFO:tasks.workunit.client.0.smithi070.stderr: -225> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient: get_monmap_and_config success 2024-09-12T01:00:24.421 INFO:tasks.workunit.client.0.smithi070.stderr: -224> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 4 set_mon_vals no callback set 2024-09-12T01:00:24.421 INFO:tasks.workunit.client.0.smithi070.stderr: -223> 2024-09-12T01:00:23.967+0000 7f21997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T01:00:24.421 INFO:tasks.workunit.client.0.smithi070.stderr: -222> 2024-09-12T01:00:23.967+0000 7f21997fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T01:00:24.421 INFO:tasks.workunit.client.0.smithi070.stderr: -221> 2024-09-12T01:00:23.967+0000 7f21997fa640 10 monclient: dump: 2024-09-12T01:00:24.422 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T01:00:24.422 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T01:00:24.422 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.422 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.422 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T01:00:24.422 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.422 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:00:24.422 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T01:00:24.422 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T01:00:24.423 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.423 INFO:tasks.workunit.client.0.smithi070.stderr: -220> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient: shutdown 2024-09-12T01:00:24.423 INFO:tasks.workunit.client.0.smithi070.stderr: -219> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient: build_initial_monmap 2024-09-12T01:00:24.423 INFO:tasks.workunit.client.0.smithi070.stderr: -218> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 1 build_initial for_mkfs: 0 2024-09-12T01:00:24.423 INFO:tasks.workunit.client.0.smithi070.stderr: -217> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 10 monclient: monmap: 2024-09-12T01:00:24.423 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 0 2024-09-12T01:00:24.423 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T01:00:24.423 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 0.000000 2024-09-12T01:00:24.423 INFO:tasks.workunit.client.0.smithi070.stderr:created 0.000000 2024-09-12T01:00:24.423 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 0 (unknown) 2024-09-12T01:00:24.423 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.423 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.noname-a 2024-09-12T01:00:24.423 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T01:00:24.424 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.noname-c 2024-09-12T01:00:24.424 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.424 INFO:tasks.workunit.client.0.smithi070.stderr: -216> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding auth protocol: cephx 2024-09-12T01:00:24.424 INFO:tasks.workunit.client.0.smithi070.stderr: -215> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding auth protocol: cephx 2024-09-12T01:00:24.424 INFO:tasks.workunit.client.0.smithi070.stderr: -214> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding auth protocol: cephx 2024-09-12T01:00:24.424 INFO:tasks.workunit.client.0.smithi070.stderr: -213> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding con mode: secure 2024-09-12T01:00:24.424 INFO:tasks.workunit.client.0.smithi070.stderr: -212> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding con mode: crc 2024-09-12T01:00:24.424 INFO:tasks.workunit.client.0.smithi070.stderr: -211> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding con mode: secure 2024-09-12T01:00:24.424 INFO:tasks.workunit.client.0.smithi070.stderr: -210> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding con mode: crc 2024-09-12T01:00:24.424 INFO:tasks.workunit.client.0.smithi070.stderr: -209> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding con mode: secure 2024-09-12T01:00:24.424 INFO:tasks.workunit.client.0.smithi070.stderr: -208> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding con mode: crc 2024-09-12T01:00:24.424 INFO:tasks.workunit.client.0.smithi070.stderr: -207> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding con mode: crc 2024-09-12T01:00:24.424 INFO:tasks.workunit.client.0.smithi070.stderr: -206> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding con mode: secure 2024-09-12T01:00:24.425 INFO:tasks.workunit.client.0.smithi070.stderr: -205> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding con mode: crc 2024-09-12T01:00:24.425 INFO:tasks.workunit.client.0.smithi070.stderr: -204> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding con mode: secure 2024-09-12T01:00:24.425 INFO:tasks.workunit.client.0.smithi070.stderr: -203> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding con mode: crc 2024-09-12T01:00:24.425 INFO:tasks.workunit.client.0.smithi070.stderr: -202> 2024-09-12T01:00:23.967+0000 7f22b7db09c0 5 AuthRegistry(0x562bde892580) adding con mode: secure 2024-09-12T01:00:24.425 INFO:tasks.workunit.client.0.smithi070.stderr: -201> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T01:00:24.425 INFO:tasks.workunit.client.0.smithi070.stderr: -200> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 1 librados: starting msgr at 2024-09-12T01:00:24.425 INFO:tasks.workunit.client.0.smithi070.stderr: -199> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 1 librados: starting objecter 2024-09-12T01:00:24.425 INFO:tasks.workunit.client.0.smithi070.stderr: -198> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command objecter_requests cmddesc objecter_requests hook 0x562bde899f20 EEXIST 2024-09-12T01:00:24.425 INFO:tasks.workunit.client.0.smithi070.stderr: -197> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 1 librados: setting wanted keys 2024-09-12T01:00:24.425 INFO:tasks.workunit.client.0.smithi070.stderr: -196> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 1 librados: calling monclient init 2024-09-12T01:00:24.425 INFO:tasks.workunit.client.0.smithi070.stderr: -195> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient: init 2024-09-12T01:00:24.425 INFO:tasks.workunit.client.0.smithi070.stderr: -194> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding auth protocol: cephx 2024-09-12T01:00:24.425 INFO:tasks.workunit.client.0.smithi070.stderr: -193> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding auth protocol: cephx 2024-09-12T01:00:24.426 INFO:tasks.workunit.client.0.smithi070.stderr: -192> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding auth protocol: cephx 2024-09-12T01:00:24.426 INFO:tasks.workunit.client.0.smithi070.stderr: -191> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding con mode: secure 2024-09-12T01:00:24.426 INFO:tasks.workunit.client.0.smithi070.stderr: -190> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding con mode: crc 2024-09-12T01:00:24.426 INFO:tasks.workunit.client.0.smithi070.stderr: -189> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding con mode: secure 2024-09-12T01:00:24.426 INFO:tasks.workunit.client.0.smithi070.stderr: -188> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding con mode: crc 2024-09-12T01:00:24.426 INFO:tasks.workunit.client.0.smithi070.stderr: -187> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding con mode: secure 2024-09-12T01:00:24.426 INFO:tasks.workunit.client.0.smithi070.stderr: -186> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding con mode: crc 2024-09-12T01:00:24.426 INFO:tasks.workunit.client.0.smithi070.stderr: -185> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding con mode: crc 2024-09-12T01:00:24.426 INFO:tasks.workunit.client.0.smithi070.stderr: -184> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding con mode: secure 2024-09-12T01:00:24.426 INFO:tasks.workunit.client.0.smithi070.stderr: -183> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding con mode: crc 2024-09-12T01:00:24.426 INFO:tasks.workunit.client.0.smithi070.stderr: -182> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding con mode: secure 2024-09-12T01:00:24.426 INFO:tasks.workunit.client.0.smithi070.stderr: -181> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding con mode: crc 2024-09-12T01:00:24.426 INFO:tasks.workunit.client.0.smithi070.stderr: -180> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 AuthRegistry(0x562bde84e2d0) adding con mode: secure 2024-09-12T01:00:24.427 INFO:tasks.workunit.client.0.smithi070.stderr: -179> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T01:00:24.427 INFO:tasks.workunit.client.0.smithi070.stderr: -178> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T01:00:24.427 INFO:tasks.workunit.client.0.smithi070.stderr: -177> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command rotate-key cmddesc rotate-key hook 0x562bde84e418 EEXIST 2024-09-12T01:00:24.427 INFO:tasks.workunit.client.0.smithi070.stderr: -176> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient: _reopen_session rank -1 2024-09-12T01:00:24.427 INFO:tasks.workunit.client.0.smithi070.stderr: -175> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T01:00:24.427 INFO:tasks.workunit.client.0.smithi070.stderr: -174> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient(hunting): picked mon.noname-b con 0x562bde891aa0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T01:00:24.427 INFO:tasks.workunit.client.0.smithi070.stderr: -173> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient(hunting): picked mon.noname-c con 0x562bde89b3a0 addr [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] 2024-09-12T01:00:24.427 INFO:tasks.workunit.client.0.smithi070.stderr: -172> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient(hunting): picked mon.noname-a con 0x562bde89ffb0 addr [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-09-12T01:00:24.427 INFO:tasks.workunit.client.0.smithi070.stderr: -171> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient(hunting): start opening mon connection 2024-09-12T01:00:24.427 INFO:tasks.workunit.client.0.smithi070.stderr: -170> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient(hunting): start opening mon connection 2024-09-12T01:00:24.427 INFO:tasks.workunit.client.0.smithi070.stderr: -169> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient(hunting): start opening mon connection 2024-09-12T01:00:24.427 INFO:tasks.workunit.client.0.smithi070.stderr: -168> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient(hunting): _renew_subs 2024-09-12T01:00:24.427 INFO:tasks.workunit.client.0.smithi070.stderr: -167> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient(hunting): authenticate will time out at 2474.420842s 2024-09-12T01:00:24.428 INFO:tasks.workunit.client.0.smithi070.stderr: -166> 2024-09-12T01:00:23.971+0000 7f22b50b5640 10 monclient(hunting): get_auth_request con 0x562bde89b3a0 auth_method 0 2024-09-12T01:00:24.428 INFO:tasks.workunit.client.0.smithi070.stderr: -165> 2024-09-12T01:00:23.971+0000 7f22b50b5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T01:00:24.428 INFO:tasks.workunit.client.0.smithi070.stderr: -164> 2024-09-12T01:00:23.971+0000 7f22b50b5640 10 monclient(hunting): _init_auth method 2 2024-09-12T01:00:24.428 INFO:tasks.workunit.client.0.smithi070.stderr: -163> 2024-09-12T01:00:23.971+0000 7f22b50b5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T01:00:24.428 INFO:tasks.workunit.client.0.smithi070.stderr: -162> 2024-09-12T01:00:23.971+0000 7f22b60b7640 10 monclient(hunting): get_auth_request con 0x562bde89ffb0 auth_method 0 2024-09-12T01:00:24.428 INFO:tasks.workunit.client.0.smithi070.stderr: -161> 2024-09-12T01:00:23.971+0000 7f22b60b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T01:00:24.428 INFO:tasks.workunit.client.0.smithi070.stderr: -160> 2024-09-12T01:00:23.971+0000 7f22b60b7640 10 monclient(hunting): _init_auth method 2 2024-09-12T01:00:24.428 INFO:tasks.workunit.client.0.smithi070.stderr: -159> 2024-09-12T01:00:23.971+0000 7f22b60b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T01:00:24.429 INFO:tasks.workunit.client.0.smithi070.stderr: -158> 2024-09-12T01:00:23.971+0000 7f22b50b5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T01:00:24.429 INFO:tasks.workunit.client.0.smithi070.stderr: -157> 2024-09-12T01:00:23.971+0000 7f22b50b5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T01:00:24.429 INFO:tasks.workunit.client.0.smithi070.stderr: -156> 2024-09-12T01:00:23.971+0000 7f22b50b5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T01:00:24.429 INFO:tasks.workunit.client.0.smithi070.stderr: -155> 2024-09-12T01:00:23.971+0000 7f22b60b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T01:00:24.429 INFO:tasks.workunit.client.0.smithi070.stderr: -154> 2024-09-12T01:00:23.971+0000 7f22b60b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T01:00:24.429 INFO:tasks.workunit.client.0.smithi070.stderr: -153> 2024-09-12T01:00:23.971+0000 7f22b60b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T01:00:24.429 INFO:tasks.workunit.client.0.smithi070.stderr: -152> 2024-09-12T01:00:23.971+0000 7f22b58b6640 10 monclient(hunting): get_auth_request con 0x562bde891aa0 auth_method 0 2024-09-12T01:00:24.429 INFO:tasks.workunit.client.0.smithi070.stderr: -151> 2024-09-12T01:00:23.971+0000 7f22b58b6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T01:00:24.430 INFO:tasks.workunit.client.0.smithi070.stderr: -150> 2024-09-12T01:00:23.971+0000 7f22b58b6640 10 monclient(hunting): _init_auth method 2 2024-09-12T01:00:24.430 INFO:tasks.workunit.client.0.smithi070.stderr: -149> 2024-09-12T01:00:23.971+0000 7f22b58b6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T01:00:24.430 INFO:tasks.workunit.client.0.smithi070.stderr: -148> 2024-09-12T01:00:23.971+0000 7f22b60b7640 10 monclient(hunting): handle_auth_done global_id 8427 payload 824 2024-09-12T01:00:24.430 INFO:tasks.workunit.client.0.smithi070.stderr: -147> 2024-09-12T01:00:23.971+0000 7f22b60b7640 10 monclient: _finish_hunting 0 2024-09-12T01:00:24.430 INFO:tasks.workunit.client.0.smithi070.stderr: -146> 2024-09-12T01:00:23.971+0000 7f22b60b7640 1 monclient: found mon.noname-a 2024-09-12T01:00:24.430 INFO:tasks.workunit.client.0.smithi070.stderr: -145> 2024-09-12T01:00:23.971+0000 7f22b60b7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.70:3300/0 2024-09-12T01:00:24.430 INFO:tasks.workunit.client.0.smithi070.stderr: -144> 2024-09-12T01:00:23.971+0000 7f21877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T01:00:24.430 INFO:tasks.workunit.client.0.smithi070.stderr: -143> 2024-09-12T01:00:23.971+0000 7f21877fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T01:00:24.431 INFO:tasks.workunit.client.0.smithi070.stderr: -142> 2024-09-12T01:00:23.971+0000 7f21877fe640 10 monclient: dump: 2024-09-12T01:00:24.431 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T01:00:24.431 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T01:00:24.431 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.431 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.431 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T01:00:24.431 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.431 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:00:24.432 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T01:00:24.432 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T01:00:24.432 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.432 INFO:tasks.workunit.client.0.smithi070.stderr: -141> 2024-09-12T01:00:23.971+0000 7f21877fe640 10 monclient: _finish_auth 0 2024-09-12T01:00:24.432 INFO:tasks.workunit.client.0.smithi070.stderr: -140> 2024-09-12T01:00:23.971+0000 7f21877fe640 10 monclient: _check_auth_tickets 2024-09-12T01:00:24.432 INFO:tasks.workunit.client.0.smithi070.stderr: -139> 2024-09-12T01:00:23.971+0000 7f21877fe640 10 monclient: handle_config config(0 keys) 2024-09-12T01:00:24.432 INFO:tasks.workunit.client.0.smithi070.stderr: -138> 2024-09-12T01:00:23.971+0000 7f21877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T01:00:24.432 INFO:tasks.workunit.client.0.smithi070.stderr: -137> 2024-09-12T01:00:23.971+0000 7f21877fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T01:00:24.433 INFO:tasks.workunit.client.0.smithi070.stderr: -136> 2024-09-12T01:00:23.971+0000 7f21877fe640 10 monclient: dump: 2024-09-12T01:00:24.433 INFO:tasks.workunit.client.0.smithi070.stderr:epoch 1 2024-09-12T01:00:24.433 INFO:tasks.workunit.client.0.smithi070.stderr:fsid 6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d 2024-09-12T01:00:24.433 INFO:tasks.workunit.client.0.smithi070.stderr:last_changed 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.433 INFO:tasks.workunit.client.0.smithi070.stderr:created 2024-09-12T00:34:31.989135+0000 2024-09-12T01:00:24.433 INFO:tasks.workunit.client.0.smithi070.stderr:min_mon_release 19 (squid) 2024-09-12T01:00:24.433 INFO:tasks.workunit.client.0.smithi070.stderr:election_strategy: 1 2024-09-12T01:00:24.434 INFO:tasks.workunit.client.0.smithi070.stderr:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:00:24.434 INFO:tasks.workunit.client.0.smithi070.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T01:00:24.434 INFO:tasks.workunit.client.0.smithi070.stderr:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-12T01:00:24.434 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.434 INFO:tasks.workunit.client.0.smithi070.stderr: -135> 2024-09-12T01:00:23.971+0000 7f21997fa640 4 set_mon_vals no callback set 2024-09-12T01:00:24.434 INFO:tasks.workunit.client.0.smithi070.stderr: -134> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 monclient: authenticate success, global_id 8427 2024-09-12T01:00:24.434 INFO:tasks.workunit.client.0.smithi070.stderr: -133> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient: _renew_subs 2024-09-12T01:00:24.434 INFO:tasks.workunit.client.0.smithi070.stderr: -132> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T01:00:24.435 INFO:tasks.workunit.client.0.smithi070.stderr: -131> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient: _renew_subs 2024-09-12T01:00:24.435 INFO:tasks.workunit.client.0.smithi070.stderr: -130> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T01:00:24.435 INFO:tasks.workunit.client.0.smithi070.stderr: -129> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 1 librados: init done 2024-09-12T01:00:24.435 INFO:tasks.workunit.client.0.smithi070.stderr: -128> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command cr dump hook 0x562bde8aaea8 2024-09-12T01:00:24.435 INFO:tasks.workunit.client.0.smithi070.stderr: -127> 2024-09-12T01:00:23.971+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.435 INFO:tasks.workunit.client.0.smithi070.stderr: -126> 2024-09-12T01:00:23.971+0000 7f21877fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T01:00:24.435 INFO:tasks.workunit.client.0.smithi070.stderr: -125> 2024-09-12T01:00:23.971+0000 7f21877fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T01:00:24.436 INFO:tasks.workunit.client.0.smithi070.stderr: -124> 2024-09-12T01:00:23.971+0000 7f21877fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/48809792,v1:172.21.15.187:6833/48809792] 2024-09-12T01:00:24.436 INFO:tasks.workunit.client.0.smithi070.stderr: -123> 2024-09-12T01:00:23.975+0000 7f22b58b6640 10 monclient: get_auth_request con 0x7f2180070ae0 auth_method 0 2024-09-12T01:00:24.436 INFO:tasks.workunit.client.0.smithi070.stderr: -122> 2024-09-12T01:00:23.975+0000 7f22b50b5640 10 monclient: get_auth_request con 0x562bde8b98a0 auth_method 0 2024-09-12T01:00:24.436 INFO:tasks.workunit.client.0.smithi070.stderr: -121> 2024-09-12T01:00:23.975+0000 7f22b7db09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.436 INFO:tasks.workunit.client.0.smithi070.stderr: -120> 2024-09-12T01:00:23.975+0000 7f22b7db09c0 20 realm 2024-09-12T01:00:24.436 INFO:tasks.workunit.client.0.smithi070.stderr: -119> 2024-09-12T01:00:23.975+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.436 INFO:tasks.workunit.client.0.smithi070.stderr: -118> 2024-09-12T01:00:23.975+0000 7f22b7db09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.436 INFO:tasks.workunit.client.0.smithi070.stderr: -117> 2024-09-12T01:00:23.975+0000 7f22b7db09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:24.437 INFO:tasks.workunit.client.0.smithi070.stderr: -116> 2024-09-12T01:00:23.975+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.437 INFO:tasks.workunit.client.0.smithi070.stderr: -115> 2024-09-12T01:00:23.975+0000 7f22b7db09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.437 INFO:tasks.workunit.client.0.smithi070.stderr: -114> 2024-09-12T01:00:23.975+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.437 INFO:tasks.workunit.client.0.smithi070.stderr: -113> 2024-09-12T01:00:23.975+0000 7f22b58b6640 10 monclient: get_auth_request con 0x562bde8bdb00 auth_method 0 2024-09-12T01:00:24.437 INFO:tasks.workunit.client.0.smithi070.stderr: -112> 2024-09-12T01:00:23.975+0000 7f22b7db09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:24.437 INFO:tasks.workunit.client.0.smithi070.stderr: -111> 2024-09-12T01:00:23.975+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.437 INFO:tasks.workunit.client.0.smithi070.stderr: -110> 2024-09-12T01:00:23.975+0000 7f22b50b5640 10 monclient: get_auth_request con 0x562bde8c1360 auth_method 0 2024-09-12T01:00:24.438 INFO:tasks.workunit.client.0.smithi070.stderr: -109> 2024-09-12T01:00:23.979+0000 7f22b7db09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:24.438 INFO:tasks.workunit.client.0.smithi070.stderr: -108> 2024-09-12T01:00:23.979+0000 7f22b7db09c0 20 searching for the correct realm 2024-09-12T01:00:24.438 INFO:tasks.workunit.client.0.smithi070.stderr: -107> 2024-09-12T01:00:23.979+0000 7f22b60b7640 10 monclient: get_auth_request con 0x562bde8c60a0 auth_method 0 2024-09-12T01:00:24.438 INFO:tasks.workunit.client.0.smithi070.stderr: -106> 2024-09-12T01:00:23.979+0000 7f22b58b6640 10 monclient: get_auth_request con 0x7f22b009c040 auth_method 0 2024-09-12T01:00:24.438 INFO:tasks.workunit.client.0.smithi070.stderr: -105> 2024-09-12T01:00:23.979+0000 7f22b50b5640 10 monclient: get_auth_request con 0x7f22a80d4070 auth_method 0 2024-09-12T01:00:24.438 INFO:tasks.workunit.client.0.smithi070.stderr: -104> 2024-09-12T01:00:23.983+0000 7f22b60b7640 10 monclient: get_auth_request con 0x7f22ac03ba90 auth_method 0 2024-09-12T01:00:24.438 INFO:tasks.workunit.client.0.smithi070.stderr: -103> 2024-09-12T01:00:23.983+0000 7f22b60b7640 0 -- 172.21.15.70:0/2116115508 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f22ac03ba90 msgr2=0x7f22ac01a400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:24.438 INFO:tasks.workunit.client.0.smithi070.stderr: -102> 2024-09-12T01:00:23.983+0000 7f21877fe640 1 client.8427.objecter ms_handle_reset 0x7f22ac03ba90 session 0x7f22ac03b410 osd.4 2024-09-12T01:00:24.439 INFO:tasks.workunit.client.0.smithi070.stderr: -101> 2024-09-12T01:00:23.983+0000 7f21877fe640 10 monclient: _renew_subs 2024-09-12T01:00:24.439 INFO:tasks.workunit.client.0.smithi070.stderr: -100> 2024-09-12T01:00:23.983+0000 7f21877fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.70:3300/0 2024-09-12T01:00:24.439 INFO:tasks.workunit.client.0.smithi070.stderr: -99> 2024-09-12T01:00:23.983+0000 7f22b60b7640 10 monclient: get_auth_request con 0x7f2180080880 auth_method 0 2024-09-12T01:00:24.439 INFO:tasks.workunit.client.0.smithi070.stderr: -98> 2024-09-12T01:00:23.983+0000 7f22b58b6640 10 monclient: get_auth_request con 0x7f22b0027020 auth_method 0 2024-09-12T01:00:24.439 INFO:tasks.workunit.client.0.smithi070.stderr: -97> 2024-09-12T01:00:23.991+0000 7f22b50b5640 0 -- 172.21.15.70:0/2116115508 >> [v2:172.21.15.70:6824/2477739226,v1:172.21.15.70:6825/2477739226] conn(0x562bde8c1360 msgr2=0x562bde8c3770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:24.439 INFO:tasks.workunit.client.0.smithi070.stderr: -96> 2024-09-12T01:00:23.991+0000 7f21877fe640 1 client.8427.objecter ms_handle_reset 0x562bde8c1360 session 0x562bde8bce90 osd.0 2024-09-12T01:00:24.439 INFO:tasks.workunit.client.0.smithi070.stderr: -95> 2024-09-12T01:00:23.991+0000 7f22b50b5640 10 monclient: get_auth_request con 0x7f22ac03ba90 auth_method 0 2024-09-12T01:00:24.439 INFO:tasks.workunit.client.0.smithi070.stderr: -94> 2024-09-12T01:00:23.995+0000 7f22b7db09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:24.439 INFO:tasks.workunit.client.0.smithi070.stderr: -93> 2024-09-12T01:00:23.995+0000 7f22b7db09c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:00:24.439 INFO:tasks.workunit.client.0.smithi070.stderr: -92> 2024-09-12T01:00:23.995+0000 7f22b7db09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:24.439 INFO:tasks.workunit.client.0.smithi070.stderr: -91> 2024-09-12T01:00:23.995+0000 7f22b7db09c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:00:24.439 INFO:tasks.workunit.client.0.smithi070.stderr: -90> 2024-09-12T01:00:23.995+0000 7f22b7db09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:24.439 INFO:tasks.workunit.client.0.smithi070.stderr: -89> 2024-09-12T01:00:23.995+0000 7f22b7db09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:24.440 INFO:tasks.workunit.client.0.smithi070.stderr: -88> 2024-09-12T01:00:23.995+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.440 INFO:tasks.workunit.client.0.smithi070.stderr: -87> 2024-09-12T01:00:23.995+0000 7f22b7db09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.440 INFO:tasks.workunit.client.0.smithi070.stderr: -86> 2024-09-12T01:00:23.995+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.440 INFO:tasks.workunit.client.0.smithi070.stderr: -85> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:24.440 INFO:tasks.workunit.client.0.smithi070.stderr: -84> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.440 INFO:tasks.workunit.client.0.smithi070.stderr: -83> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:24.440 INFO:tasks.workunit.client.0.smithi070.stderr: -82> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 zone default found 2024-09-12T01:00:24.440 INFO:tasks.workunit.client.0.smithi070.stderr: -81> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 4 Realm: () 2024-09-12T01:00:24.440 INFO:tasks.workunit.client.0.smithi070.stderr: -80> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:00:24.440 INFO:tasks.workunit.client.0.smithi070.stderr: -79> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:00:24.441 INFO:tasks.workunit.client.0.smithi070.stderr: -78> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:24.441 INFO:tasks.workunit.client.0.smithi070.stderr: -77> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 zonegroup default 2024-09-12T01:00:24.441 INFO:tasks.workunit.client.0.smithi070.stderr: -76> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.441 INFO:tasks.workunit.client.0.smithi070.stderr: -75> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.441 INFO:tasks.workunit.client.0.smithi070.stderr: -74> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.441 INFO:tasks.workunit.client.0.smithi070.stderr: -73> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.441 INFO:tasks.workunit.client.0.smithi070.stderr: -72> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.441 INFO:tasks.workunit.client.0.smithi070.stderr: -71> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.441 INFO:tasks.workunit.client.0.smithi070.stderr: -70> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 started sync module instance, tier type = 2024-09-12T01:00:24.441 INFO:tasks.workunit.client.0.smithi070.stderr: -69> 2024-09-12T01:00:23.999+0000 7f22b7db09c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:00:24.441 INFO:tasks.workunit.client.0.smithi070.stderr: -68> 2024-09-12T01:00:24.015+0000 7f22b7db09c0 20 add_watcher() i=0 2024-09-12T01:00:24.442 INFO:tasks.workunit.client.0.smithi070.stderr: -67> 2024-09-12T01:00:24.015+0000 7f22b7db09c0 20 add_watcher() i=1 2024-09-12T01:00:24.442 INFO:tasks.workunit.client.0.smithi070.stderr: -66> 2024-09-12T01:00:24.015+0000 7f22b7db09c0 20 add_watcher() i=2 2024-09-12T01:00:24.442 INFO:tasks.workunit.client.0.smithi070.stderr: -65> 2024-09-12T01:00:24.015+0000 7f22b7db09c0 20 add_watcher() i=3 2024-09-12T01:00:24.442 INFO:tasks.workunit.client.0.smithi070.stderr: -64> 2024-09-12T01:00:24.015+0000 7f22b7db09c0 20 add_watcher() i=4 2024-09-12T01:00:24.442 INFO:tasks.workunit.client.0.smithi070.stderr: -63> 2024-09-12T01:00:24.015+0000 7f22b7db09c0 20 add_watcher() i=5 2024-09-12T01:00:24.442 INFO:tasks.workunit.client.0.smithi070.stderr: -62> 2024-09-12T01:00:24.015+0000 7f22b7db09c0 20 add_watcher() i=6 2024-09-12T01:00:24.442 INFO:tasks.workunit.client.0.smithi070.stderr: -61> 2024-09-12T01:00:24.015+0000 7f22b7db09c0 20 add_watcher() i=7 2024-09-12T01:00:24.442 INFO:tasks.workunit.client.0.smithi070.stderr: -60> 2024-09-12T01:00:24.015+0000 7f22b7db09c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:24.442 INFO:tasks.workunit.client.0.smithi070.stderr: -59> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding auth protocol: cephx 2024-09-12T01:00:24.442 INFO:tasks.workunit.client.0.smithi070.stderr: -58> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding auth protocol: cephx 2024-09-12T01:00:24.442 INFO:tasks.workunit.client.0.smithi070.stderr: -57> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding auth protocol: cephx 2024-09-12T01:00:24.442 INFO:tasks.workunit.client.0.smithi070.stderr: -56> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding con mode: secure 2024-09-12T01:00:24.442 INFO:tasks.workunit.client.0.smithi070.stderr: -55> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding con mode: crc 2024-09-12T01:00:24.442 INFO:tasks.workunit.client.0.smithi070.stderr: -54> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding con mode: secure 2024-09-12T01:00:24.443 INFO:tasks.workunit.client.0.smithi070.stderr: -53> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding con mode: crc 2024-09-12T01:00:24.443 INFO:tasks.workunit.client.0.smithi070.stderr: -52> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding con mode: secure 2024-09-12T01:00:24.443 INFO:tasks.workunit.client.0.smithi070.stderr: -51> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding con mode: crc 2024-09-12T01:00:24.443 INFO:tasks.workunit.client.0.smithi070.stderr: -50> 2024-09-12T01:00:24.019+0000 7f21677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:24.443 INFO:tasks.workunit.client.0.smithi070.stderr: -49> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding con mode: crc 2024-09-12T01:00:24.443 INFO:tasks.workunit.client.0.smithi070.stderr: -48> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding con mode: secure 2024-09-12T01:00:24.443 INFO:tasks.workunit.client.0.smithi070.stderr: -47> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding con mode: crc 2024-09-12T01:00:24.443 INFO:tasks.workunit.client.0.smithi070.stderr: -46> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding con mode: secure 2024-09-12T01:00:24.443 INFO:tasks.workunit.client.0.smithi070.stderr: -45> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding con mode: crc 2024-09-12T01:00:24.443 INFO:tasks.workunit.client.0.smithi070.stderr: -44> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 AuthRegistry(0x7fffe52c7d90) adding con mode: secure 2024-09-12T01:00:24.443 INFO:tasks.workunit.client.0.smithi070.stderr: -43> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T01:00:24.443 INFO:tasks.workunit.client.0.smithi070.stderr: -42> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:24.443 INFO:tasks.workunit.client.0.smithi070.stderr: -41> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:24.443 INFO:tasks.workunit.client.0.smithi070.stderr: -40> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command cache list hook 0x562bde8966e0 2024-09-12T01:00:24.444 INFO:tasks.workunit.client.0.smithi070.stderr: -39> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command cache inspect hook 0x562bde8966e0 2024-09-12T01:00:24.444 INFO:tasks.workunit.client.0.smithi070.stderr: -38> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command cache erase hook 0x562bde8966e0 2024-09-12T01:00:24.444 INFO:tasks.workunit.client.0.smithi070.stderr: -37> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command cache zap hook 0x562bde8966e0 2024-09-12T01:00:24.444 INFO:tasks.workunit.client.0.smithi070.stderr: -36> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 note: GC not initialized 2024-09-12T01:00:24.444 INFO:tasks.workunit.client.0.smithi070.stderr: -35> 2024-09-12T01:00:24.019+0000 7f21667fc640 20 reqs_thread_entry: start 2024-09-12T01:00:24.444 INFO:tasks.workunit.client.0.smithi070.stderr: -34> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command sync trace show hook 0x7f22ac004e20 2024-09-12T01:00:24.444 INFO:tasks.workunit.client.0.smithi070.stderr: -33> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command sync trace history hook 0x7f22ac004e20 2024-09-12T01:00:24.444 INFO:tasks.workunit.client.0.smithi070.stderr: -32> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command sync trace active hook 0x7f22ac004e20 2024-09-12T01:00:24.444 INFO:tasks.workunit.client.0.smithi070.stderr: -31> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 5 asok(0x562bde5c52b0) register_command sync trace active_short hook 0x7f22ac004e20 2024-09-12T01:00:24.444 INFO:tasks.workunit.client.0.smithi070.stderr: -30> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 20 init_complete bucket index max shards: 1 2024-09-12T01:00:24.444 INFO:tasks.workunit.client.0.smithi070.stderr: -29> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 20 Filter name: none 2024-09-12T01:00:24.444 INFO:tasks.workunit.client.0.smithi070.stderr: -28> 2024-09-12T01:00:24.019+0000 7f20d7fff640 20 reqs_thread_entry: start 2024-09-12T01:00:24.445 INFO:tasks.workunit.client.0.smithi070.stderr: -27> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T01:00:24.445 INFO:tasks.workunit.client.0.smithi070.stderr: -26> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.445 INFO:tasks.workunit.client.0.smithi070.stderr: -25> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T01:00:24.445 INFO:tasks.workunit.client.0.smithi070.stderr: -24> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T01:00:24.445 INFO:tasks.workunit.client.0.smithi070.stderr: -23> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T01:00:24.445 INFO:tasks.workunit.client.0.smithi070.stderr: -22> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : miss 2024-09-12T01:00:24.445 INFO:tasks.workunit.client.0.smithi070.stderr: -21> 2024-09-12T01:00:24.019+0000 7f22b7db09c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.445 INFO:tasks.workunit.client.0.smithi070.stderr: -20> 2024-09-12T01:00:24.023+0000 7f22b7db09c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T01:00:24.445 INFO:tasks.workunit.client.0.smithi070.stderr: -19> 2024-09-12T01:00:24.023+0000 7f22b7db09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T01:00:24.445 INFO:tasks.workunit.client.0.smithi070.stderr: -18> 2024-09-12T01:00:24.023+0000 7f22b7db09c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T01:00:24.445 INFO:tasks.workunit.client.0.smithi070.stderr: -17> 2024-09-12T01:00:24.023+0000 7f22b7db09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:00:24.445 INFO:tasks.workunit.client.0.smithi070.stderr: -16> 2024-09-12T01:00:24.023+0000 7f22b7db09c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:24.445 INFO:tasks.workunit.client.0.smithi070.stderr: -15> 2024-09-12T01:00:24.023+0000 7f22b7db09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T01:00:24.445 INFO:tasks.workunit.client.0.smithi070.stderr: -14> 2024-09-12T01:00:24.023+0000 7f22b7db09c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T01:00:24.446 INFO:tasks.workunit.client.0.smithi070.stderr: -13> 2024-09-12T01:00:24.031+0000 7f22b7db09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T01:00:24.446 INFO:tasks.workunit.client.0.smithi070.stderr: -12> 2024-09-12T01:00:24.031+0000 7f22b7db09c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T01:00:24.446 INFO:tasks.workunit.client.0.smithi070.stderr: -11> 2024-09-12T01:00:24.031+0000 7f22b7db09c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:24.446 INFO:tasks.workunit.client.0.smithi070.stderr: -10> 2024-09-12T01:00:24.031+0000 7f22b7db09c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18, ofs0, ns] 2024-09-12T01:00:24.446 INFO:tasks.workunit.client.0.smithi070.stderr: -9> 2024-09-12T01:00:24.031+0000 7f21997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431649 cookie 94746417312320 notifier 8427 bl.length()=911 2024-09-12T01:00:24.446 INFO:tasks.workunit.client.0.smithi070.stderr: -8> 2024-09-12T01:00:24.031+0000 7f21997fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T01:00:24.446 INFO:tasks.workunit.client.0.smithi070.stderr: -7> 2024-09-12T01:00:24.031+0000 7f21997fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T01:00:24.446 INFO:tasks.workunit.client.0.smithi070.stderr: -6> 2024-09-12T01:00:24.031+0000 7f21997fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:24.446 INFO:tasks.workunit.client.0.smithi070.stderr: -5> 2024-09-12T01:00:24.035+0000 7f22b7db09c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_sources= new_sources= 2024-09-12T01:00:24.446 INFO:tasks.workunit.client.0.smithi070.stderr: -4> 2024-09-12T01:00:24.035+0000 7f22b7db09c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential sources added=[] removed=[] 2024-09-12T01:00:24.446 INFO:tasks.workunit.client.0.smithi070.stderr: -3> 2024-09-12T01:00:24.035+0000 7f22b7db09c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_dests= new_dests= 2024-09-12T01:00:24.446 INFO:tasks.workunit.client.0.smithi070.stderr: -2> 2024-09-12T01:00:24.035+0000 7f22b7db09c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential dests added=[] removed=[] 2024-09-12T01:00:24.447 INFO:tasks.workunit.client.0.smithi070.stderr: -1> 2024-09-12T01:00:24.039+0000 7f22b7db09c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f22b7db09c0 time 2024-09-12T01:00:24.044652+0000 2024-09-12T01:00:24.447 INFO:tasks.workunit.client.0.smithi070.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T01:00:24.447 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.447 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T01:00:24.447 INFO:tasks.workunit.client.0.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f22bb68a2eb] 2024-09-12T01:00:24.447 INFO:tasks.workunit.client.0.smithi070.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f22bb68a49f] 2024-09-12T01:00:24.447 INFO:tasks.workunit.client.0.smithi070.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562bdd490cc1] 2024-09-12T01:00:24.447 INFO:tasks.workunit.client.0.smithi070.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562bdd4a5d5a] 2024-09-12T01:00:24.447 INFO:tasks.workunit.client.0.smithi070.stderr: 5: main() 2024-09-12T01:00:24.447 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f22ba4f0d90] 2024-09-12T01:00:24.447 INFO:tasks.workunit.client.0.smithi070.stderr: 7: __libc_start_main() 2024-09-12T01:00:24.447 INFO:tasks.workunit.client.0.smithi070.stderr: 8: _start() 2024-09-12T01:00:24.447 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.448 INFO:tasks.workunit.client.0.smithi070.stderr: 0> 2024-09-12T01:00:24.039+0000 7f22b7db09c0 -1 *** Caught signal (Aborted) ** 2024-09-12T01:00:24.448 INFO:tasks.workunit.client.0.smithi070.stderr: in thread 7f22b7db09c0 thread_name:radosgw-admin 2024-09-12T01:00:24.448 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.448 INFO:tasks.workunit.client.0.smithi070.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T01:00:24.448 INFO:tasks.workunit.client.0.smithi070.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f22ba509520] 2024-09-12T01:00:24.448 INFO:tasks.workunit.client.0.smithi070.stderr: 2: pthread_kill() 2024-09-12T01:00:24.448 INFO:tasks.workunit.client.0.smithi070.stderr: 3: raise() 2024-09-12T01:00:24.448 INFO:tasks.workunit.client.0.smithi070.stderr: 4: abort() 2024-09-12T01:00:24.448 INFO:tasks.workunit.client.0.smithi070.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f22bb68a345] 2024-09-12T01:00:24.448 INFO:tasks.workunit.client.0.smithi070.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f22bb68a49f] 2024-09-12T01:00:24.448 INFO:tasks.workunit.client.0.smithi070.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562bdd490cc1] 2024-09-12T01:00:24.448 INFO:tasks.workunit.client.0.smithi070.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562bdd4a5d5a] 2024-09-12T01:00:24.448 INFO:tasks.workunit.client.0.smithi070.stderr: 9: main() 2024-09-12T01:00:24.449 INFO:tasks.workunit.client.0.smithi070.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f22ba4f0d90] 2024-09-12T01:00:24.449 INFO:tasks.workunit.client.0.smithi070.stderr: 11: __libc_start_main() 2024-09-12T01:00:24.449 INFO:tasks.workunit.client.0.smithi070.stderr: 12: _start() 2024-09-12T01:00:24.449 INFO:tasks.workunit.client.0.smithi070.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T01:00:24.449 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:24.449 INFO:tasks.workunit.client.0.smithi070.stderr:--- logging levels --- 2024-09-12T01:00:24.449 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 none 2024-09-12T01:00:24.449 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 lockdep 2024-09-12T01:00:24.449 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 context 2024-09-12T01:00:24.449 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 crush 2024-09-12T01:00:24.449 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds 2024-09-12T01:00:24.449 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_balancer 2024-09-12T01:00:24.449 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_locker 2024-09-12T01:00:24.449 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log 2024-09-12T01:00:24.450 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_log_expire 2024-09-12T01:00:24.450 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mds_migrator 2024-09-12T01:00:24.450 INFO:tasks.workunit.client.0.smithi070.stderr: 3/ 5 mds_quiesce 2024-09-12T01:00:24.450 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 buffer 2024-09-12T01:00:24.450 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 timer 2024-09-12T01:00:24.450 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 filer 2024-09-12T01:00:24.450 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 striper 2024-09-12T01:00:24.450 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 1 objecter 2024-09-12T01:00:24.450 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rados 2024-09-12T01:00:24.450 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd 2024-09-12T01:00:24.450 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_mirror 2024-09-12T01:00:24.450 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_replay 2024-09-12T01:00:24.450 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 rbd_pwl 2024-09-12T01:00:24.450 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 journaler 2024-09-12T01:00:24.451 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objectcacher 2024-09-12T01:00:24.451 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 immutable_obj_cache 2024-09-12T01:00:24.451 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 client 2024-09-12T01:00:24.451 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 osd 2024-09-12T01:00:24.451 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 optracker 2024-09-12T01:00:24.451 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 objclass 2024-09-12T01:00:24.451 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 filestore 2024-09-12T01:00:24.451 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 journal 2024-09-12T01:00:24.451 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 ms 2024-09-12T01:00:24.451 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mon 2024-09-12T01:00:24.451 INFO:tasks.workunit.client.0.smithi070.stderr: 0/10 monc 2024-09-12T01:00:24.451 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 paxos 2024-09-12T01:00:24.451 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 tp 2024-09-12T01:00:24.451 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 auth 2024-09-12T01:00:24.452 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 crypto 2024-09-12T01:00:24.452 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 finisher 2024-09-12T01:00:24.452 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 reserver 2024-09-12T01:00:24.452 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 heartbeatmap 2024-09-12T01:00:24.452 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 perfcounter 2024-09-12T01:00:24.452 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw 2024-09-12T01:00:24.452 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_sync 2024-09-12T01:00:24.452 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_datacache 2024-09-12T01:00:24.452 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_access 2024-09-12T01:00:24.452 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_dbstore 2024-09-12T01:00:24.452 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_flight 2024-09-12T01:00:24.452 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 rgw_lifecycle 2024-09-12T01:00:24.452 INFO:tasks.workunit.client.0.smithi070.stderr: 20/20 rgw_notification 2024-09-12T01:00:24.452 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 javaclient 2024-09-12T01:00:24.453 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 asok 2024-09-12T01:00:24.453 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 1 throttle 2024-09-12T01:00:24.453 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 0 refs 2024-09-12T01:00:24.453 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 compressor 2024-09-12T01:00:24.453 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluestore 2024-09-12T01:00:24.453 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 bluefs 2024-09-12T01:00:24.453 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 3 bdev 2024-09-12T01:00:24.453 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 kstore 2024-09-12T01:00:24.453 INFO:tasks.workunit.client.0.smithi070.stderr: 4/ 5 rocksdb 2024-09-12T01:00:24.453 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 fuse 2024-09-12T01:00:24.453 INFO:tasks.workunit.client.0.smithi070.stderr: 2/ 5 mgr 2024-09-12T01:00:24.453 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mgrc 2024-09-12T01:00:24.453 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 dpdk 2024-09-12T01:00:24.454 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 eventtrace 2024-09-12T01:00:24.454 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 prioritycache 2024-09-12T01:00:24.454 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 test 2024-09-12T01:00:24.454 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephfs_mirror 2024-09-12T01:00:24.454 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cephsqlite 2024-09-12T01:00:24.454 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 crimson_interrupt 2024-09-12T01:00:24.454 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore 2024-09-12T01:00:24.454 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_onode 2024-09-12T01:00:24.454 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_odata 2024-09-12T01:00:24.454 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_omap 2024-09-12T01:00:24.454 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_tm 2024-09-12T01:00:24.454 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_t 2024-09-12T01:00:24.454 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cleaner 2024-09-12T01:00:24.455 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_epm 2024-09-12T01:00:24.455 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_lba 2024-09-12T01:00:24.455 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T01:00:24.455 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_cache 2024-09-12T01:00:24.455 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_journal 2024-09-12T01:00:24.455 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_device 2024-09-12T01:00:24.455 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 seastore_backref 2024-09-12T01:00:24.455 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 alienstore 2024-09-12T01:00:24.455 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 mclock 2024-09-12T01:00:24.455 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 cyanstore 2024-09-12T01:00:24.455 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 ceph_exporter 2024-09-12T01:00:24.455 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 memstore 2024-09-12T01:00:24.455 INFO:tasks.workunit.client.0.smithi070.stderr: 1/ 5 trace 2024-09-12T01:00:24.455 INFO:tasks.workunit.client.0.smithi070.stderr: 0/ 5 ceph_dedup 2024-09-12T01:00:24.456 INFO:tasks.workunit.client.0.smithi070.stderr: -2/-2 (syslog threshold) 2024-09-12T01:00:24.456 INFO:tasks.workunit.client.0.smithi070.stderr: 99/99 (stderr threshold) 2024-09-12T01:00:24.456 INFO:tasks.workunit.client.0.smithi070.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T01:00:24.456 INFO:tasks.workunit.client.0.smithi070.stderr: 7f20d7fff640 / http_manager 2024-09-12T01:00:24.456 INFO:tasks.workunit.client.0.smithi070.stderr: 7f21667fc640 / http_manager 2024-09-12T01:00:24.456 INFO:tasks.workunit.client.0.smithi070.stderr: 7f21677fe640 / rgw_dt_lg_renew 2024-09-12T01:00:24.456 INFO:tasks.workunit.client.0.smithi070.stderr: 7f21877fe640 / ms_dispatch 2024-09-12T01:00:24.456 INFO:tasks.workunit.client.0.smithi070.stderr: 7f21997fa640 / io_context_pool 2024-09-12T01:00:24.456 INFO:tasks.workunit.client.0.smithi070.stderr: 7f219b7fe640 / ms_dispatch 2024-09-12T01:00:24.456 INFO:tasks.workunit.client.0.smithi070.stderr: 7f21a2604640 / ms_dispatch 2024-09-12T01:00:24.456 INFO:tasks.workunit.client.0.smithi070.stderr: 7f21a3e07640 / io_context_pool 2024-09-12T01:00:24.456 INFO:tasks.workunit.client.0.smithi070.stderr: 7f22b50b5640 / msgr-worker-2 2024-09-12T01:00:24.456 INFO:tasks.workunit.client.0.smithi070.stderr: 7f22b58b6640 / msgr-worker-1 2024-09-12T01:00:24.456 INFO:tasks.workunit.client.0.smithi070.stderr: 7f22b60b7640 / msgr-worker-0 2024-09-12T01:00:24.457 INFO:tasks.workunit.client.0.smithi070.stderr: 7f22b68b8640 / io_context_pool 2024-09-12T01:00:24.457 INFO:tasks.workunit.client.0.smithi070.stderr: 7f22b7db09c0 / radosgw-admin 2024-09-12T01:00:24.457 INFO:tasks.workunit.client.0.smithi070.stderr: max_recent 500 2024-09-12T01:00:24.457 INFO:tasks.workunit.client.0.smithi070.stderr: max_new 1000 2024-09-12T01:00:24.457 INFO:tasks.workunit.client.0.smithi070.stderr: log_file /var/lib/ceph/crash/2024-09-12T01:00:24.046640Z_ed97b707-9937-45e1-a0f8-49f85f1ef500/log 2024-09-12T01:00:24.457 INFO:tasks.workunit.client.0.smithi070.stderr:--- end dump of recent events --- 2024-09-12T01:00:24.457 INFO:tasks.workunit.client.0.smithi070.stderr:Aborted 2024-09-12T01:00:24.457 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T01:00:24.457 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:24.457 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:24.457 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.119+0000 7fa8db7199c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.457 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.119+0000 7fa8db7199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.457 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.119+0000 7fa8db7199c0 20 realm 2024-09-12T01:00:24.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.119+0000 7fa8db7199c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.119+0000 7fa8db7199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.119+0000 7fa8db7199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:24.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.119+0000 7fa8db7199c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.119+0000 7fa8db7199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.119+0000 7fa8db7199c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.123+0000 7fa8db7199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:24.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.123+0000 7fa8db7199c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.123+0000 7fa8db7199c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:24.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.123+0000 7fa8db7199c0 20 searching for the correct realm 2024-09-12T01:00:24.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.127+0000 7fa8d9a20640 0 -- 172.21.15.70:0/3385100847 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fa8cc032040 msgr2=0x7fa8cc032930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:24.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.135+0000 7fa8d9a20640 0 -- 172.21.15.70:0/3385100847 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fa7a4080880 msgr2=0x7fa7a4082cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:24.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.139+0000 7fa8db7199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:24.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.139+0000 7fa8db7199c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:00:24.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.139+0000 7fa8db7199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:24.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.139+0000 7fa8db7199c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:00:24.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.139+0000 7fa8db7199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:24.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.139+0000 7fa8db7199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:24.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.139+0000 7fa8db7199c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.139+0000 7fa8db7199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.139+0000 7fa8db7199c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.143+0000 7fa8db7199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:24.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.143+0000 7fa8db7199c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.143+0000 7fa8db7199c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:24.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.143+0000 7fa8db7199c0 20 zone default found 2024-09-12T01:00:24.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.143+0000 7fa8db7199c0 4 Realm: () 2024-09-12T01:00:24.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.143+0000 7fa8db7199c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:00:24.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.143+0000 7fa8db7199c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:00:24.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.143+0000 7fa8db7199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:24.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.143+0000 7fa8db7199c0 20 zonegroup default 2024-09-12T01:00:24.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.143+0000 7fa8db7199c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.143+0000 7fa8db7199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.143+0000 7fa8db7199c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.143+0000 7fa8db7199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.143+0000 7fa8db7199c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.143+0000 7fa8db7199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.143+0000 7fa8db7199c0 20 started sync module instance, tier type = 2024-09-12T01:00:24.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.143+0000 7fa8db7199c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:00:24.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.159+0000 7fa8db7199c0 20 add_watcher() i=0 2024-09-12T01:00:24.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.159+0000 7fa8db7199c0 20 add_watcher() i=1 2024-09-12T01:00:24.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.159+0000 7fa8db7199c0 20 add_watcher() i=2 2024-09-12T01:00:24.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.159+0000 7fa8db7199c0 20 add_watcher() i=3 2024-09-12T01:00:24.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.159+0000 7fa8db7199c0 20 add_watcher() i=4 2024-09-12T01:00:24.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.159+0000 7fa8db7199c0 20 add_watcher() i=5 2024-09-12T01:00:24.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.159+0000 7fa8db7199c0 20 add_watcher() i=6 2024-09-12T01:00:24.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.159+0000 7fa8db7199c0 20 add_watcher() i=7 2024-09-12T01:00:24.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.159+0000 7fa8db7199c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:24.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.163+0000 7fa78f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:24.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.163+0000 7fa8db7199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:24.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.163+0000 7fa8db7199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:24.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.163+0000 7fa8db7199c0 5 note: GC not initialized 2024-09-12T01:00:24.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.163+0000 7fa78e7e4640 20 reqs_thread_entry: start 2024-09-12T01:00:24.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.163+0000 7fa8db7199c0 20 init_complete bucket index max shards: 1 2024-09-12T01:00:24.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.163+0000 7fa8db7199c0 20 Filter name: none 2024-09-12T01:00:24.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.163+0000 7fa6fffff640 20 reqs_thread_entry: start 2024-09-12T01:00:24.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.163+0000 7fa8db7199c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.163+0000 7fa8db7199c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T01:00:24.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.163+0000 7fa8db7199c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.163+0000 7fa8db7199c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T01:00:24.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.167+0000 7fa8db7199c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:00:24.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.167+0000 7fa8db7199c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.167+0000 7fa8db7199c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T01:00:24.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.167+0000 7fa8db7199c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.167+0000 7fa8db7199c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T01:00:24.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.167+0000 7fa8db7199c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:00:24.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.171+0000 7fa78f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:24.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.175+0000 7fa8db7199c0 20 remove_watcher() i=0 2024-09-12T01:00:24.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.175+0000 7fa8db7199c0 2 removed watcher, disabling cache 2024-09-12T01:00:24.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.175+0000 7fa8db7199c0 20 remove_watcher() i=1 2024-09-12T01:00:24.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.179+0000 7fa8db7199c0 20 remove_watcher() i=2 2024-09-12T01:00:24.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.179+0000 7fa8db7199c0 20 remove_watcher() i=3 2024-09-12T01:00:24.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.183+0000 7fa8db7199c0 20 remove_watcher() i=4 2024-09-12T01:00:24.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.183+0000 7fa8db7199c0 20 remove_watcher() i=5 2024-09-12T01:00:24.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.183+0000 7fa8db7199c0 20 remove_watcher() i=6 2024-09-12T01:00:24.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.187+0000 7fa8db7199c0 20 remove_watcher() i=7 2024-09-12T01:00:24.463 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:00:24.463 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:00:24.463 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T01:00:24.463 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:24.463 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:24.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.283+0000 7f62741699c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.283+0000 7f62741699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.283+0000 7f62741699c0 20 realm 2024-09-12T01:00:24.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.283+0000 7f62741699c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.283+0000 7f62741699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.283+0000 7f62741699c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:24.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.283+0000 7f62741699c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.283+0000 7f62741699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.283+0000 7f62741699c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.287+0000 7f62741699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:24.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.287+0000 7f62741699c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.287+0000 7f62741699c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:24.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.287+0000 7f62741699c0 20 searching for the correct realm 2024-09-12T01:00:24.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.295+0000 7f6272470640 0 -- 172.21.15.70:0/4032053255 >> [v2:172.21.15.70:6808/276433067,v1:172.21.15.70:6809/276433067] conn(0x5650c444e400 msgr2=0x5650c44508c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:24.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.511+0000 7f6272470640 0 -- 172.21.15.70:0/4032053255 >> [v2:172.21.15.70:6816/1979013808,v1:172.21.15.70:6817/1979013808] conn(0x5650c4441b10 msgr2=0x5650c4443f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:00:24.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.523+0000 7f62741699c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:24.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.523+0000 7f62741699c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:00:24.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.523+0000 7f62741699c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:24.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.523+0000 7f62741699c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:00:24.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.523+0000 7f62741699c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:24.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.523+0000 7f62741699c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:24.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.523+0000 7f62741699c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.523+0000 7f62741699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.523+0000 7f62741699c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.523+0000 7f62741699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:24.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.523+0000 7f62741699c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.516 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.523+0000 7f62741699c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:24.516 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.523+0000 7f62741699c0 20 zone default found 2024-09-12T01:00:24.516 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.523+0000 7f62741699c0 4 Realm: () 2024-09-12T01:00:24.516 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.523+0000 7f62741699c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:00:24.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.523+0000 7f62741699c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:00:24.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.523+0000 7f62741699c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:24.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.523+0000 7f62741699c0 20 zonegroup default 2024-09-12T01:00:24.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.523+0000 7f62741699c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.523+0000 7f62741699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.523+0000 7f62741699c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.518 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.527+0000 7f62741699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.518 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.527+0000 7f62741699c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.518 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.527+0000 7f62741699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.518 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.527+0000 7f62741699c0 20 started sync module instance, tier type = 2024-09-12T01:00:24.518 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.527+0000 7f62741699c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:00:24.540 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.547+0000 7f62741699c0 20 add_watcher() i=0 2024-09-12T01:00:24.540 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.547+0000 7f62741699c0 20 add_watcher() i=1 2024-09-12T01:00:24.540 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.547+0000 7f62741699c0 20 add_watcher() i=2 2024-09-12T01:00:24.540 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.547+0000 7f62741699c0 20 add_watcher() i=3 2024-09-12T01:00:24.540 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.547+0000 7f62741699c0 20 add_watcher() i=4 2024-09-12T01:00:24.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.547+0000 7f62741699c0 20 add_watcher() i=5 2024-09-12T01:00:24.541 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.547+0000 7f62741699c0 20 add_watcher() i=6 2024-09-12T01:00:24.543 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.551+0000 7f62741699c0 20 add_watcher() i=7 2024-09-12T01:00:24.544 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.551+0000 7f62741699c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:24.545 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.551+0000 7f61237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:24.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.555+0000 7f62741699c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:24.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.555+0000 7f62741699c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:24.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.555+0000 7f62741699c0 5 note: GC not initialized 2024-09-12T01:00:24.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.555+0000 7f61227fc640 20 reqs_thread_entry: start 2024-09-12T01:00:24.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.555+0000 7f62741699c0 20 init_complete bucket index max shards: 1 2024-09-12T01:00:24.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.555+0000 7f62741699c0 20 Filter name: none 2024-09-12T01:00:24.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.555+0000 7f6093fff640 20 reqs_thread_entry: start 2024-09-12T01:00:24.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.555+0000 7f62741699c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T01:00:24.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.555+0000 7f62741699c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.547 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.555+0000 7f62741699c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T01:00:24.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.555+0000 7f62741699c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T01:00:24.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.555+0000 7f62741699c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T01:00:24.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.555+0000 7f62741699c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : miss 2024-09-12T01:00:24.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.555+0000 7f62741699c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.555+0000 7f62741699c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T01:00:24.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.555+0000 7f62741699c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T01:00:24.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.555+0000 7f62741699c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T01:00:24.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.555+0000 7f62741699c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:00:24.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.555+0000 7f62741699c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:24.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.555+0000 7f62741699c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T01:00:24.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.555+0000 7f62741699c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.0 2024-09-12T01:00:24.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.555+0000 7f62741699c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.0 2024-09-12T01:00:24.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.555+0000 7f62741699c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.1 2024-09-12T01:00:24.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.555+0000 7f62741699c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.1 2024-09-12T01:00:24.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.559+0000 7f62741699c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.2 2024-09-12T01:00:24.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.559+0000 7f62741699c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.2 2024-09-12T01:00:24.551 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.559+0000 7f61237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:24.556 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.563+0000 7f62741699c0 20 remove_watcher() i=0 2024-09-12T01:00:24.556 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.563+0000 7f62741699c0 2 removed watcher, disabling cache 2024-09-12T01:00:24.558 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.567+0000 7f62741699c0 20 remove_watcher() i=1 2024-09-12T01:00:24.560 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.567+0000 7f62741699c0 20 remove_watcher() i=2 2024-09-12T01:00:24.562 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.571+0000 7f62741699c0 20 remove_watcher() i=3 2024-09-12T01:00:24.564 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.571+0000 7f62741699c0 20 remove_watcher() i=4 2024-09-12T01:00:24.566 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.575+0000 7f62741699c0 20 remove_watcher() i=5 2024-09-12T01:00:24.567 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.575+0000 7f62741699c0 20 remove_watcher() i=6 2024-09-12T01:00:24.568 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:24.575+0000 7f62741699c0 20 remove_watcher() i=7 2024-09-12T01:00:54.602 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-12T01:00:54.636 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:54.636 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:54.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.686+0000 7f5c7b1fd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.690+0000 7f5c7b1fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:54.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.690+0000 7f5c7b1fd9c0 20 realm 2024-09-12T01:00:54.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.690+0000 7f5c7b1fd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.690+0000 7f5c7b1fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:54.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.690+0000 7f5c7b1fd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:54.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.690+0000 7f5c7b1fd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.690+0000 7f5c7b1fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:54.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.690+0000 7f5c7b1fd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.685 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.690+0000 7f5c7b1fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:54.685 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.690+0000 7f5c7b1fd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.685 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.694+0000 7f5c7b1fd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:54.685 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.694+0000 7f5c7b1fd9c0 20 searching for the correct realm 2024-09-12T01:00:54.692 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.698+0000 7f5c79504640 0 -- 172.21.15.70:0/3787174728 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f5c6c10ac20 msgr2=0x7f5c6c10c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:54.908 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.914+0000 7f5c79504640 0 -- 172.21.15.70:0/3787174728 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f5c6c10ac20 msgr2=0x7f5c6c10c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:54.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.926+0000 7f5c7b1fd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:54.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.926+0000 7f5c7b1fd9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:00:54.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.926+0000 7f5c7b1fd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:54.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.926+0000 7f5c7b1fd9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:00:54.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.926+0000 7f5c7b1fd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:54.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.926+0000 7f5c7b1fd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:54.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.926+0000 7f5c7b1fd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.926+0000 7f5c7b1fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:54.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.926+0000 7f5c7b1fd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.926+0000 7f5c7b1fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:54.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.926+0000 7f5c7b1fd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.930+0000 7f5c7b1fd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:54.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.930+0000 7f5c7b1fd9c0 20 zone default found 2024-09-12T01:00:54.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.930+0000 7f5c7b1fd9c0 4 Realm: () 2024-09-12T01:00:54.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.930+0000 7f5c7b1fd9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:00:54.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.930+0000 7f5c7b1fd9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:00:54.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.930+0000 7f5c7b1fd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:54.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.930+0000 7f5c7b1fd9c0 20 zonegroup default 2024-09-12T01:00:54.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.930+0000 7f5c7b1fd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.930+0000 7f5c7b1fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:54.922 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.930+0000 7f5c7b1fd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.930+0000 7f5c7b1fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:54.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.930+0000 7f5c7b1fd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.930+0000 7f5c7b1fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:54.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.930+0000 7f5c7b1fd9c0 20 started sync module instance, tier type = 2024-09-12T01:00:54.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.930+0000 7f5c7b1fd9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:00:54.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.954+0000 7f5c7b1fd9c0 20 add_watcher() i=0 2024-09-12T01:00:54.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.954+0000 7f5c7b1fd9c0 20 add_watcher() i=1 2024-09-12T01:00:54.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.954+0000 7f5c7b1fd9c0 20 add_watcher() i=2 2024-09-12T01:00:54.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.954+0000 7f5c7b1fd9c0 20 add_watcher() i=3 2024-09-12T01:00:54.947 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.954+0000 7f5c7b1fd9c0 20 add_watcher() i=4 2024-09-12T01:00:54.948 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.954+0000 7f5c7b1fd9c0 20 add_watcher() i=5 2024-09-12T01:00:54.948 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.954+0000 7f5c7b1fd9c0 20 add_watcher() i=6 2024-09-12T01:00:54.949 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.958+0000 7f5c7b1fd9c0 20 add_watcher() i=7 2024-09-12T01:00:54.949 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.958+0000 7f5c7b1fd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:54.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.962+0000 7f5b2efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:54.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.962+0000 7f5c7b1fd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:54.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.962+0000 7f5c7b1fd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:54.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.962+0000 7f5c7b1fd9c0 5 note: GC not initialized 2024-09-12T01:00:54.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.962+0000 7f5b2dfe3640 20 reqs_thread_entry: start 2024-09-12T01:00:54.955 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.962+0000 7f5c7b1fd9c0 20 init_complete bucket index max shards: 1 2024-09-12T01:00:54.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.962+0000 7f5c7b1fd9c0 20 Filter name: none 2024-09-12T01:00:54.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.962+0000 7f5a9f7fe640 20 reqs_thread_entry: start 2024-09-12T01:00:54.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.962+0000 7f5c7b1fd9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T01:00:54.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.962+0000 7f5c7b1fd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.957 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.966+0000 7f5c7b1fd9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T01:00:54.957 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.966+0000 7f5c7b1fd9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T01:00:54.957 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.966+0000 7f5c7b1fd9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T01:00:54.957 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.966+0000 7f5c7b1fd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : miss 2024-09-12T01:00:54.958 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.966+0000 7f5c7b1fd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:54.958 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.966+0000 7f5c7b1fd9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T01:00:54.958 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.966+0000 7f5c7b1fd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T01:00:54.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.966+0000 7f5c7b1fd9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T01:00:54.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.966+0000 7f5c7b1fd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:00:54.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.966+0000 7f5c7b1fd9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:54.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.966+0000 7f5c7b1fd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T01:00:54.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.974+0000 7f5b2efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:54.971 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.978+0000 7f5c7b1fd9c0 20 remove_watcher() i=0 2024-09-12T01:00:54.971 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.978+0000 7f5c7b1fd9c0 2 removed watcher, disabling cache 2024-09-12T01:00:54.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.982+0000 7f5c7b1fd9c0 20 remove_watcher() i=1 2024-09-12T01:00:54.976 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.982+0000 7f5c7b1fd9c0 20 remove_watcher() i=2 2024-09-12T01:00:54.978 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.986+0000 7f5c7b1fd9c0 20 remove_watcher() i=3 2024-09-12T01:00:54.980 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.986+0000 7f5c7b1fd9c0 20 remove_watcher() i=4 2024-09-12T01:00:54.982 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.990+0000 7f5c7b1fd9c0 20 remove_watcher() i=5 2024-09-12T01:00:54.983 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.990+0000 7f5c7b1fd9c0 20 remove_watcher() i=6 2024-09-12T01:00:54.985 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:54.990+0000 7f5c7b1fd9c0 20 remove_watcher() i=7 2024-09-12T01:00:55.000 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T01:00:55.201 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:55.201 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:55.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.082+0000 7f4d361fd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.201 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.086+0000 7f4d361fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.086+0000 7f4d361fd9c0 20 realm 2024-09-12T01:00:55.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.086+0000 7f4d361fd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.086+0000 7f4d361fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.086+0000 7f4d361fd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:55.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.086+0000 7f4d361fd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.086+0000 7f4d361fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.086+0000 7f4d361fd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.086+0000 7f4d361fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:55.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.086+0000 7f4d361fd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.086+0000 7f4d361fd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:55.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.086+0000 7f4d361fd9c0 20 searching for the correct realm 2024-09-12T01:00:55.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.090+0000 7f4d33502640 0 -- 172.21.15.70:0/1257553906 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7f4d24018040 msgr2=0x7f4d240988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:55.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.302+0000 7f4d33d03640 0 -- 172.21.15.70:0/1257553906 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f4d2c0b9040 msgr2=0x7f4d2c105040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:55.311 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.318+0000 7f4d361fd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:55.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.318+0000 7f4d361fd9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:00:55.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.318+0000 7f4d361fd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:55.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.318+0000 7f4d361fd9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:00:55.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.318+0000 7f4d361fd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:55.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.318+0000 7f4d361fd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:55.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.318+0000 7f4d361fd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.318+0000 7f4d361fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.318+0000 7f4d361fd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.318+0000 7f4d361fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:55.313 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.318+0000 7f4d361fd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.322+0000 7f4d361fd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:55.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.322+0000 7f4d361fd9c0 20 zone default found 2024-09-12T01:00:55.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.322+0000 7f4d361fd9c0 4 Realm: () 2024-09-12T01:00:55.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.322+0000 7f4d361fd9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:00:55.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.322+0000 7f4d361fd9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:00:55.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.322+0000 7f4d361fd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:55.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.322+0000 7f4d361fd9c0 20 zonegroup default 2024-09-12T01:00:55.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.322+0000 7f4d361fd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.322+0000 7f4d361fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.322+0000 7f4d361fd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.322+0000 7f4d361fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.315 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.322+0000 7f4d361fd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.322+0000 7f4d361fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.322+0000 7f4d361fd9c0 20 started sync module instance, tier type = 2024-09-12T01:00:55.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.322+0000 7f4d361fd9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:00:55.339 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.346+0000 7f4d361fd9c0 20 add_watcher() i=0 2024-09-12T01:00:55.340 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.346+0000 7f4d361fd9c0 20 add_watcher() i=1 2024-09-12T01:00:55.340 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.346+0000 7f4d361fd9c0 20 add_watcher() i=2 2024-09-12T01:00:55.340 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.346+0000 7f4d361fd9c0 20 add_watcher() i=3 2024-09-12T01:00:55.340 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.346+0000 7f4d361fd9c0 20 add_watcher() i=4 2024-09-12T01:00:55.340 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.346+0000 7f4d361fd9c0 20 add_watcher() i=5 2024-09-12T01:00:55.340 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.346+0000 7f4d361fd9c0 20 add_watcher() i=6 2024-09-12T01:00:55.342 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.350+0000 7f4d361fd9c0 20 add_watcher() i=7 2024-09-12T01:00:55.342 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.350+0000 7f4d361fd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:55.346 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.354+0000 7f4be9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:55.347 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.354+0000 7f4d361fd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:55.347 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.354+0000 7f4d361fd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:55.347 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.354+0000 7f4d361fd9c0 5 note: GC not initialized 2024-09-12T01:00:55.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.354+0000 7f4be8fe1640 20 reqs_thread_entry: start 2024-09-12T01:00:55.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.354+0000 7f4d361fd9c0 20 init_complete bucket index max shards: 1 2024-09-12T01:00:55.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.354+0000 7f4d361fd9c0 20 Filter name: none 2024-09-12T01:00:55.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.354+0000 7f4b627fc640 20 reqs_thread_entry: start 2024-09-12T01:00:55.348 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.354+0000 7f4d361fd9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T01:00:55.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.354+0000 7f4d361fd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.358+0000 7f4d361fd9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T01:00:55.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.358+0000 7f4d361fd9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T01:00:55.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.358+0000 7f4d361fd9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T01:00:55.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.358+0000 7f4d361fd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : miss 2024-09-12T01:00:55.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.358+0000 7f4d361fd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.351 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.358+0000 7f4d361fd9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T01:00:55.351 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.358+0000 7f4d361fd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T01:00:55.351 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.358+0000 7f4d361fd9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T01:00:55.351 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.358+0000 7f4d361fd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:00:55.351 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.358+0000 7f4d361fd9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:55.351 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.358+0000 7f4d361fd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T01:00:55.351 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.358+0000 7f4d361fd9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.0 2024-09-12T01:00:55.351 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.358+0000 7f4d361fd9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.0 2024-09-12T01:00:55.352 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.358+0000 7f4d361fd9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.1 2024-09-12T01:00:55.352 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.358+0000 7f4d361fd9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.1 2024-09-12T01:00:55.352 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.358+0000 7f4d361fd9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.2 2024-09-12T01:00:55.352 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.358+0000 7f4d361fd9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.2 2024-09-12T01:00:55.354 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.362+0000 7f4be9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:55.359 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.366+0000 7f4d361fd9c0 20 remove_watcher() i=0 2024-09-12T01:00:55.359 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.366+0000 7f4d361fd9c0 2 removed watcher, disabling cache 2024-09-12T01:00:55.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.370+0000 7f4d361fd9c0 20 remove_watcher() i=1 2024-09-12T01:00:55.364 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.370+0000 7f4d361fd9c0 20 remove_watcher() i=2 2024-09-12T01:00:55.366 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.374+0000 7f4d361fd9c0 20 remove_watcher() i=3 2024-09-12T01:00:55.368 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.374+0000 7f4d361fd9c0 20 remove_watcher() i=4 2024-09-12T01:00:55.370 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.378+0000 7f4d361fd9c0 20 remove_watcher() i=5 2024-09-12T01:00:55.371 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.378+0000 7f4d361fd9c0 20 remove_watcher() i=6 2024-09-12T01:00:55.373 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.382+0000 7f4d361fd9c0 20 remove_watcher() i=7 2024-09-12T01:00:55.388 INFO:tasks.workunit.client.0.smithi070.stderr:check reshard logrecord successfully 2024-09-12T01:00:55.388 INFO:tasks.workunit.client.0.smithi070.stderr: test: reshard versioned bucket 2024-09-12T01:00:55.388 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T01:00:55.419 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:55.420 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:55.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.470+0000 7f0b3754f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.470+0000 7f0b3754f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.470+0000 7f0b3754f9c0 20 realm 2024-09-12T01:00:55.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.470+0000 7f0b3754f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.470+0000 7f0b3754f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.470+0000 7f0b3754f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:55.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.470+0000 7f0b3754f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.470+0000 7f0b3754f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.470+0000 7f0b3754f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.474+0000 7f0b3754f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:55.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.474+0000 7f0b3754f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.474+0000 7f0b3754f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:55.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.474+0000 7f0b3754f9c0 20 searching for the correct realm 2024-09-12T01:00:55.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.478+0000 7f0b35856640 0 -- 172.21.15.70:0/1372358140 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f0b2c0cc070 msgr2=0x7f0b2c0b9450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:00:55.480 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.486+0000 7f0b35856640 0 -- 172.21.15.70:0/1372358140 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f0a00080800 msgr2=0x7f0a00082c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:55.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.494+0000 7f0b3754f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:55.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.494+0000 7f0b3754f9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:00:55.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.494+0000 7f0b3754f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:55.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.494+0000 7f0b3754f9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:00:55.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.494+0000 7f0b3754f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:55.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.494+0000 7f0b3754f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:55.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.494+0000 7f0b3754f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.494+0000 7f0b3754f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.494+0000 7f0b3754f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.494+0000 7f0b3754f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:55.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.494+0000 7f0b3754f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.494+0000 7f0b3754f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:55.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.494+0000 7f0b3754f9c0 20 zone default found 2024-09-12T01:00:55.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.494+0000 7f0b3754f9c0 4 Realm: () 2024-09-12T01:00:55.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.494+0000 7f0b3754f9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:00:55.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.494+0000 7f0b3754f9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:00:55.490 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.494+0000 7f0b3754f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:55.490 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.494+0000 7f0b3754f9c0 20 zonegroup default 2024-09-12T01:00:55.490 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.494+0000 7f0b3754f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.490 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.498+0000 7f0b3754f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.490 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.498+0000 7f0b3754f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.490 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.498+0000 7f0b3754f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.490 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.498+0000 7f0b3754f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.490 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.498+0000 7f0b3754f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.491 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.498+0000 7f0b3754f9c0 20 started sync module instance, tier type = 2024-09-12T01:00:55.491 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.498+0000 7f0b3754f9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:00:55.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.510+0000 7f0b3754f9c0 20 add_watcher() i=0 2024-09-12T01:00:55.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.510+0000 7f0b3754f9c0 20 add_watcher() i=1 2024-09-12T01:00:55.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.510+0000 7f0b3754f9c0 20 add_watcher() i=2 2024-09-12T01:00:55.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.510+0000 7f0b3754f9c0 20 add_watcher() i=3 2024-09-12T01:00:55.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.510+0000 7f0b3754f9c0 20 add_watcher() i=4 2024-09-12T01:00:55.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.510+0000 7f0b3754f9c0 20 add_watcher() i=5 2024-09-12T01:00:55.505 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.510+0000 7f0b3754f9c0 20 add_watcher() i=6 2024-09-12T01:00:55.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.514+0000 7f0b3754f9c0 20 add_watcher() i=7 2024-09-12T01:00:55.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.514+0000 7f0b3754f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:55.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.514+0000 7f09ebfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:55.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.518+0000 7f0b3754f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:55.512 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.518+0000 7f0b3754f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:55.512 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.518+0000 7f0b3754f9c0 5 note: GC not initialized 2024-09-12T01:00:55.512 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.518+0000 7f09eafe5640 20 reqs_thread_entry: start 2024-09-12T01:00:55.512 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.518+0000 7f0b3754f9c0 20 init_complete bucket index max shards: 1 2024-09-12T01:00:55.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.518+0000 7f0b3754f9c0 20 Filter name: none 2024-09-12T01:00:55.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.518+0000 7f09e8fe1640 20 reqs_thread_entry: start 2024-09-12T01:00:55.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.518+0000 7f0b3754f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.518+0000 7f0b3754f9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T01:00:55.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.518+0000 7f0b3754f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.518+0000 7f0b3754f9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T01:00:55.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.518+0000 7f0b3754f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:00:55.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.518+0000 7f0b3754f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.518+0000 7f0b3754f9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T01:00:55.514 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.518+0000 7f0b3754f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.518+0000 7f0b3754f9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T01:00:55.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.518+0000 7f0b3754f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:00:55.515 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.518+0000 7f09ebfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:55.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.522+0000 7f0b3754f9c0 20 remove_watcher() i=0 2024-09-12T01:00:55.517 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.522+0000 7f0b3754f9c0 2 removed watcher, disabling cache 2024-09-12T01:00:55.519 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.526+0000 7f0b3754f9c0 20 remove_watcher() i=1 2024-09-12T01:00:55.521 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.526+0000 7f0b3754f9c0 20 remove_watcher() i=2 2024-09-12T01:00:55.523 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.530+0000 7f0b3754f9c0 20 remove_watcher() i=3 2024-09-12T01:00:55.525 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.534+0000 7f0b3754f9c0 20 remove_watcher() i=4 2024-09-12T01:00:55.526 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.534+0000 7f0b3754f9c0 20 remove_watcher() i=5 2024-09-12T01:00:55.527 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.534+0000 7f0b3754f9c0 20 remove_watcher() i=6 2024-09-12T01:00:55.529 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.534+0000 7f0b3754f9c0 20 remove_watcher() i=7 2024-09-12T01:00:55.541 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:55.542 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T01:00:55.542 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: myver id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-12T01:00:55.542 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:55.542 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 2 2024-09-12T01:00:55.570 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:55.570 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:55.613 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.618+0000 7fbeda96c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.622+0000 7fbeda96c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.622+0000 7fbeda96c9c0 20 realm 2024-09-12T01:00:55.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.622+0000 7fbeda96c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.622+0000 7fbeda96c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.614 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.622+0000 7fbeda96c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:55.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.622+0000 7fbeda96c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.622+0000 7fbeda96c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.622+0000 7fbeda96c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.616 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.622+0000 7fbeda96c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:55.616 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.622+0000 7fbeda96c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.617 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.622+0000 7fbeda96c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:55.617 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.622+0000 7fbeda96c9c0 20 searching for the correct realm 2024-09-12T01:00:55.619 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.626+0000 7fbed7c71640 0 -- 172.21.15.70:0/1541322919 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7fbec8003000 msgr2=0x7fbec8007b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:55.832 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.838+0000 7fbed8472640 0 -- 172.21.15.70:0/1541322919 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7fbed0029020 msgr2=0x7fbed005d520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:55.847 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.854+0000 7fbeda96c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:55.847 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.854+0000 7fbeda96c9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:00:55.847 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.854+0000 7fbeda96c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:55.847 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.854+0000 7fbeda96c9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:00:55.847 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.854+0000 7fbeda96c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:55.847 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.854+0000 7fbeda96c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:55.847 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.854+0000 7fbeda96c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.854+0000 7fbeda96c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.854+0000 7fbeda96c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.854+0000 7fbeda96c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:55.848 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.854+0000 7fbeda96c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.858+0000 7fbeda96c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:55.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.858+0000 7fbeda96c9c0 20 zone default found 2024-09-12T01:00:55.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.858+0000 7fbeda96c9c0 4 Realm: () 2024-09-12T01:00:55.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.858+0000 7fbeda96c9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:00:55.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.858+0000 7fbeda96c9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:00:55.849 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.858+0000 7fbeda96c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:55.850 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.858+0000 7fbeda96c9c0 20 zonegroup default 2024-09-12T01:00:55.850 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.858+0000 7fbeda96c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.850 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.858+0000 7fbeda96c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.850 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.858+0000 7fbeda96c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.850 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.858+0000 7fbeda96c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.850 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.858+0000 7fbeda96c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.851 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.858+0000 7fbeda96c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:55.851 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.858+0000 7fbeda96c9c0 20 started sync module instance, tier type = 2024-09-12T01:00:55.851 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.858+0000 7fbeda96c9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:00:55.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.882+0000 7fbeda96c9c0 20 add_watcher() i=0 2024-09-12T01:00:55.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.882+0000 7fbeda96c9c0 20 add_watcher() i=1 2024-09-12T01:00:55.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.882+0000 7fbeda96c9c0 20 add_watcher() i=2 2024-09-12T01:00:55.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.882+0000 7fbeda96c9c0 20 add_watcher() i=3 2024-09-12T01:00:55.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.882+0000 7fbeda96c9c0 20 add_watcher() i=4 2024-09-12T01:00:55.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.882+0000 7fbeda96c9c0 20 add_watcher() i=5 2024-09-12T01:00:55.875 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.882+0000 7fbeda96c9c0 20 add_watcher() i=6 2024-09-12T01:00:55.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.882+0000 7fbeda96c9c0 20 add_watcher() i=7 2024-09-12T01:00:55.877 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.882+0000 7fbeda96c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:55.881 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.886+0000 7fbd8efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:55.882 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.890+0000 7fbeda96c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:55.882 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.890+0000 7fbeda96c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:55.882 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.890+0000 7fbeda96c9c0 5 note: GC not initialized 2024-09-12T01:00:55.882 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.890+0000 7fbd8dfdb640 20 reqs_thread_entry: start 2024-09-12T01:00:55.882 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.890+0000 7fbeda96c9c0 20 init_complete bucket index max shards: 1 2024-09-12T01:00:55.882 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.890+0000 7fbeda96c9c0 20 Filter name: none 2024-09-12T01:00:55.883 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.890+0000 7fbcff7fe640 20 reqs_thread_entry: start 2024-09-12T01:00:55.883 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.890+0000 7fbeda96c9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T01:00:55.883 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.890+0000 7fbeda96c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.884 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.890+0000 7fbeda96c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T01:00:55.884 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.890+0000 7fbeda96c9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T01:00:55.884 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.890+0000 7fbeda96c9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T01:00:55.884 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.890+0000 7fbeda96c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 : miss 2024-09-12T01:00:55.884 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.890+0000 7fbeda96c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:55.885 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.890+0000 7fbeda96c9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T01:00:55.885 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.890+0000 7fbeda96c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 info.flags=0x17 2024-09-12T01:00:55.885 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.890+0000 7fbeda96c9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 to cache LRU end 2024-09-12T01:00:55.885 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.890+0000 7fbeda96c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:00:55.885 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.890+0000 7fbeda96c9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:55.885 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.890+0000 7fbeda96c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 2024-09-12T01:00:55.891 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.898+0000 7fbeda96c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 info.flags=0x17 2024-09-12T01:00:55.891 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.898+0000 7fbeda96c9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 to cache LRU end 2024-09-12T01:00:55.892 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.898+0000 7fbeda96c9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:55.892 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.898+0000 7fbeda96c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19, ofs0, ns] 2024-09-12T01:00:55.892 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.898+0000 7fbdaf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431633 cookie 94664268182064 notifier 7994 bl.length()=905 2024-09-12T01:00:55.892 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.898+0000 7fbdaf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 info.flags=0x17 2024-09-12T01:00:55.892 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.898+0000 7fbdaf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 to cache LRU end 2024-09-12T01:00:55.892 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.898+0000 7fbdaf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:55.893 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.902+0000 7fbeda96c9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): orig_sources= new_sources= 2024-09-12T01:00:55.893 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.902+0000 7fbeda96c9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): potential sources added=[] removed=[] 2024-09-12T01:00:55.893 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.902+0000 7fbeda96c9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): orig_dests= new_dests= 2024-09-12T01:00:55.893 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.902+0000 7fbeda96c9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): potential dests added=[] removed=[] 2024-09-12T01:00:55.898 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.906+0000 7fbeda96c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.1.0 2024-09-12T01:00:55.898 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.906+0000 7fbeda96c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.1.0 2024-09-12T01:00:55.898 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.906+0000 7fbeda96c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.1.1 2024-09-12T01:00:55.898 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.906+0000 7fbeda96c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.1.1 2024-09-12T01:00:55.898 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.906+0000 7fbeda96c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.0 2024-09-12T01:00:55.898 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.906+0000 7fbeda96c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 : hit (requested=0x17, cached=0x17) 2024-09-12T01:00:55.898 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.906+0000 7fbeda96c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 2024-09-12T01:00:55.899 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.906+0000 7fbeda96c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 info.flags=0x17 2024-09-12T01:00:55.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.906+0000 7fbeda96c9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 to cache LRU end 2024-09-12T01:00:55.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.906+0000 7fbeda96c9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:55.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.906+0000 7fbeda96c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19, ofs0, ns] 2024-09-12T01:00:55.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.906+0000 7fbdaeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431634 cookie 94664268182064 notifier 7994 bl.length()=905 2024-09-12T01:00:55.900 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.906+0000 7fbdaeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 info.flags=0x17 2024-09-12T01:00:55.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.906+0000 7fbdaeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 to cache LRU end 2024-09-12T01:00:55.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.906+0000 7fbdaeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:55.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.910+0000 7fbeda96c9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): orig_sources= new_sources= 2024-09-12T01:00:55.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.910+0000 7fbeda96c9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): potential sources added=[] removed=[] 2024-09-12T01:00:55.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.910+0000 7fbeda96c9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): orig_dests= new_dests= 2024-09-12T01:00:55.901 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.910+0000 7fbeda96c9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): potential dests added=[] removed=[] 2024-09-12T01:00:55.903 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.910+0000 7fbeda96c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.0 2024-09-12T01:00:55.904 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.910+0000 7fbeda96c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 : hit (requested=0x17, cached=0x17) 2024-09-12T01:00:55.904 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.910+0000 7fbeda96c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 2024-09-12T01:00:55.905 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.914+0000 7fbeda96c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 info.flags=0x17 2024-09-12T01:00:55.905 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.914+0000 7fbeda96c9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 to cache LRU end 2024-09-12T01:00:55.905 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.914+0000 7fbeda96c9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:55.906 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.914+0000 7fbeda96c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19, ofs0, ns] 2024-09-12T01:00:55.906 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.914+0000 7fbdaf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431635 cookie 94664268182064 notifier 7994 bl.length()=873 2024-09-12T01:00:55.906 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.914+0000 7fbdaf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 info.flags=0x17 2024-09-12T01:00:55.906 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.914+0000 7fbdaf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 to cache LRU end 2024-09-12T01:00:55.906 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.914+0000 7fbdaf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:55.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.914+0000 7fbeda96c9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): orig_sources= new_sources= 2024-09-12T01:00:55.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.914+0000 7fbeda96c9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): potential sources added=[] removed=[] 2024-09-12T01:00:55.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.914+0000 7fbeda96c9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): orig_dests= new_dests= 2024-09-12T01:00:55.907 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.914+0000 7fbeda96c9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): potential dests added=[] removed=[] 2024-09-12T01:00:55.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.914+0000 7fbeda96c9c0 1 execute INFO: reshard of bucket "myver" from 1 shards to 2 shards completed successfully 2024-09-12T01:00:55.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.918+0000 7fbd8efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:55.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.926+0000 7fbeda96c9c0 20 remove_watcher() i=0 2024-09-12T01:00:55.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.926+0000 7fbeda96c9c0 2 removed watcher, disabling cache 2024-09-12T01:00:55.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.926+0000 7fbeda96c9c0 20 remove_watcher() i=1 2024-09-12T01:00:55.923 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.930+0000 7fbeda96c9c0 20 remove_watcher() i=2 2024-09-12T01:00:55.925 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.934+0000 7fbeda96c9c0 20 remove_watcher() i=3 2024-09-12T01:00:55.928 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.934+0000 7fbeda96c9c0 20 remove_watcher() i=4 2024-09-12T01:00:55.929 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.938+0000 7fbeda96c9c0 20 remove_watcher() i=5 2024-09-12T01:00:55.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.938+0000 7fbeda96c9c0 20 remove_watcher() i=6 2024-09-12T01:00:55.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:55.938+0000 7fbeda96c9c0 20 remove_watcher() i=7 2024-09-12T01:00:55.947 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T01:00:55.980 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:55.980 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:56.024 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.030+0000 7f873b7659c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.025 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.034+0000 7f873b7659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.026 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.034+0000 7f873b7659c0 20 realm 2024-09-12T01:00:56.026 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.034+0000 7f873b7659c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.026 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.034+0000 7f873b7659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.026 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.034+0000 7f873b7659c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:56.026 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.034+0000 7f873b7659c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.026 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.034+0000 7f873b7659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.026 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.034+0000 7f873b7659c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.034+0000 7f873b7659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:56.027 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.034+0000 7f873b7659c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.028 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.034+0000 7f873b7659c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:56.028 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.034+0000 7f873b7659c0 20 searching for the correct realm 2024-09-12T01:00:56.032 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.038+0000 7f8739a6c640 0 -- 172.21.15.70:0/2993288552 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f872412a220 msgr2=0x7f8724106390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:56.248 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.254+0000 7f8739a6c640 0 -- 172.21.15.70:0/2993288552 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f872412a220 msgr2=0x7f8724106390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:56.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.266+0000 7f873b7659c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:56.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.266+0000 7f873b7659c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:00:56.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.266+0000 7f873b7659c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:56.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.266+0000 7f873b7659c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:00:56.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.266+0000 7f873b7659c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:56.259 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.266+0000 7f873b7659c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:56.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.266+0000 7f873b7659c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.266+0000 7f873b7659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.266+0000 7f873b7659c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.266+0000 7f873b7659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:56.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.266+0000 7f873b7659c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.270+0000 7f873b7659c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:56.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.270+0000 7f873b7659c0 20 zone default found 2024-09-12T01:00:56.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.270+0000 7f873b7659c0 4 Realm: () 2024-09-12T01:00:56.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.270+0000 7f873b7659c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:00:56.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.270+0000 7f873b7659c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:00:56.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.270+0000 7f873b7659c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:56.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.270+0000 7f873b7659c0 20 zonegroup default 2024-09-12T01:00:56.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.270+0000 7f873b7659c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.270+0000 7f873b7659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.270+0000 7f873b7659c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.270+0000 7f873b7659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.270+0000 7f873b7659c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.264 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.270+0000 7f873b7659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.264 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.270+0000 7f873b7659c0 20 started sync module instance, tier type = 2024-09-12T01:00:56.264 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.270+0000 7f873b7659c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:00:56.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.294+0000 7f873b7659c0 20 add_watcher() i=0 2024-09-12T01:00:56.287 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.294+0000 7f873b7659c0 20 add_watcher() i=1 2024-09-12T01:00:56.288 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.294+0000 7f873b7659c0 20 add_watcher() i=2 2024-09-12T01:00:56.288 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.294+0000 7f873b7659c0 20 add_watcher() i=3 2024-09-12T01:00:56.288 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.294+0000 7f873b7659c0 20 add_watcher() i=4 2024-09-12T01:00:56.288 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.294+0000 7f873b7659c0 20 add_watcher() i=5 2024-09-12T01:00:56.288 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.294+0000 7f873b7659c0 20 add_watcher() i=6 2024-09-12T01:00:56.289 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.298+0000 7f873b7659c0 20 add_watcher() i=7 2024-09-12T01:00:56.290 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.298+0000 7f873b7659c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:56.293 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.302+0000 7f85ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:56.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.302+0000 7f873b7659c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:56.294 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.302+0000 7f873b7659c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:56.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.302+0000 7f873b7659c0 5 note: GC not initialized 2024-09-12T01:00:56.295 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.302+0000 7f85ee7e4640 20 reqs_thread_entry: start 2024-09-12T01:00:56.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.302+0000 7f873b7659c0 20 init_complete bucket index max shards: 1 2024-09-12T01:00:56.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.302+0000 7f873b7659c0 20 Filter name: none 2024-09-12T01:00:56.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.302+0000 7f855ffff640 20 reqs_thread_entry: start 2024-09-12T01:00:56.296 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.302+0000 7f873b7659c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.302+0000 7f873b7659c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T01:00:56.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.302+0000 7f873b7659c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.302+0000 7f873b7659c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T01:00:56.297 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.302+0000 7f873b7659c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:00:56.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.302+0000 7f873b7659c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.306+0000 7f873b7659c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T01:00:56.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.306+0000 7f873b7659c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.306+0000 7f873b7659c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T01:00:56.298 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.306+0000 7f873b7659c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:00:56.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.306+0000 7f85ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:56.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.310+0000 7f873b7659c0 20 remove_watcher() i=0 2024-09-12T01:00:56.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.310+0000 7f873b7659c0 2 removed watcher, disabling cache 2024-09-12T01:00:56.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.314+0000 7f873b7659c0 20 remove_watcher() i=1 2024-09-12T01:00:56.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.318+0000 7f873b7659c0 20 remove_watcher() i=2 2024-09-12T01:00:56.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.318+0000 7f873b7659c0 20 remove_watcher() i=3 2024-09-12T01:00:56.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.322+0000 7f873b7659c0 20 remove_watcher() i=4 2024-09-12T01:00:56.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.322+0000 7f873b7659c0 20 remove_watcher() i=5 2024-09-12T01:00:56.317 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.326+0000 7f873b7659c0 20 remove_watcher() i=6 2024-09-12T01:00:56.319 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.326+0000 7f873b7659c0 20 remove_watcher() i=7 2024-09-12T01:00:56.335 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:56.335 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T01:00:56.335 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: myver id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T01:00:56.336 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:56.337 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:00:56.337 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:00:56.340 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:00:56.340 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:00:56.386 INFO:tasks.workunit.client.0.smithi070.stderr: test: reshard removes olh entries with empty name 2024-09-12T01:00:56.388 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:00:56.388 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:00:56.444 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:00:56.444 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:00:56.531 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T01:00:56.562 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:56.562 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:56.606 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.614+0000 7fe03aafc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.614+0000 7fe03aafc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.614+0000 7fe03aafc9c0 20 realm 2024-09-12T01:00:56.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.614+0000 7fe03aafc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.608 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.614+0000 7fe03aafc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.614+0000 7fe03aafc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:56.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.614+0000 7fe03aafc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.614+0000 7fe03aafc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.614+0000 7fe03aafc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.610 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.618+0000 7fe03aafc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:56.610 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.618+0000 7fe03aafc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.611 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.618+0000 7fe03aafc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:56.611 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.618+0000 7fe03aafc9c0 20 searching for the correct realm 2024-09-12T01:00:56.615 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.622+0000 7fe038e03640 0 -- 172.21.15.70:0/967801459 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fe0200b9bb0 msgr2=0x7fe020117910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:56.625 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.630+0000 7fe038e03640 0 -- 172.21.15.70:0/967801459 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fdf00080880 msgr2=0x7fdf00082cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:56.631 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.638+0000 7fe03aafc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:56.631 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.638+0000 7fe03aafc9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:00:56.631 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.638+0000 7fe03aafc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:56.631 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.638+0000 7fe03aafc9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:00:56.631 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.638+0000 7fe03aafc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:56.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.638+0000 7fe03aafc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:56.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.638+0000 7fe03aafc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.638+0000 7fe03aafc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.638+0000 7fe03aafc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.638+0000 7fe03aafc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:56.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.638+0000 7fe03aafc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.638+0000 7fe03aafc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:56.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.638+0000 7fe03aafc9c0 20 zone default found 2024-09-12T01:00:56.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.638+0000 7fe03aafc9c0 4 Realm: () 2024-09-12T01:00:56.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.638+0000 7fe03aafc9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:00:56.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.638+0000 7fe03aafc9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:00:56.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.638+0000 7fe03aafc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:56.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.638+0000 7fe03aafc9c0 20 zonegroup default 2024-09-12T01:00:56.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.638+0000 7fe03aafc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.638+0000 7fe03aafc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.638+0000 7fe03aafc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.642+0000 7fe03aafc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.642+0000 7fe03aafc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.642+0000 7fe03aafc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.642+0000 7fe03aafc9c0 20 started sync module instance, tier type = 2024-09-12T01:00:56.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.642+0000 7fe03aafc9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:00:56.648 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.654+0000 7fe03aafc9c0 20 add_watcher() i=0 2024-09-12T01:00:56.648 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.654+0000 7fe03aafc9c0 20 add_watcher() i=1 2024-09-12T01:00:56.648 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.654+0000 7fe03aafc9c0 20 add_watcher() i=2 2024-09-12T01:00:56.648 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.654+0000 7fe03aafc9c0 20 add_watcher() i=3 2024-09-12T01:00:56.648 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.654+0000 7fe03aafc9c0 20 add_watcher() i=4 2024-09-12T01:00:56.648 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.654+0000 7fe03aafc9c0 20 add_watcher() i=5 2024-09-12T01:00:56.648 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.654+0000 7fe03aafc9c0 20 add_watcher() i=6 2024-09-12T01:00:56.649 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.658+0000 7fe03aafc9c0 20 add_watcher() i=7 2024-09-12T01:00:56.649 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.658+0000 7fe03aafc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:56.652 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.658+0000 7fdeef7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:56.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.658+0000 7fe03aafc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:56.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.658+0000 7fe03aafc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:56.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.658+0000 7fe03aafc9c0 5 note: GC not initialized 2024-09-12T01:00:56.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.658+0000 7fdeee7dc640 20 reqs_thread_entry: start 2024-09-12T01:00:56.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.658+0000 7fe03aafc9c0 20 init_complete bucket index max shards: 1 2024-09-12T01:00:56.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.658+0000 7fe03aafc9c0 20 Filter name: none 2024-09-12T01:00:56.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.658+0000 7fdee77fe640 20 reqs_thread_entry: start 2024-09-12T01:00:56.653 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.658+0000 7fe03aafc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.654 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.662+0000 7fe03aafc9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T01:00:56.654 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.662+0000 7fe03aafc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.662+0000 7fe03aafc9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T01:00:56.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.662+0000 7fe03aafc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:00:56.655 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.662+0000 7fe03aafc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.662+0000 7fe03aafc9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T01:00:56.656 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.662+0000 7fe03aafc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.666+0000 7fe03aafc9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T01:00:56.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.666+0000 7fe03aafc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:00:56.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.666+0000 7fdeef7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:56.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.670+0000 7fe03aafc9c0 20 remove_watcher() i=0 2024-09-12T01:00:56.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.670+0000 7fe03aafc9c0 2 removed watcher, disabling cache 2024-09-12T01:00:56.666 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.674+0000 7fe03aafc9c0 20 remove_watcher() i=1 2024-09-12T01:00:56.668 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.674+0000 7fe03aafc9c0 20 remove_watcher() i=2 2024-09-12T01:00:56.670 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.678+0000 7fe03aafc9c0 20 remove_watcher() i=3 2024-09-12T01:00:56.672 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.678+0000 7fe03aafc9c0 20 remove_watcher() i=4 2024-09-12T01:00:56.673 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.682+0000 7fe03aafc9c0 20 remove_watcher() i=5 2024-09-12T01:00:56.674 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.682+0000 7fe03aafc9c0 20 remove_watcher() i=6 2024-09-12T01:00:56.676 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.682+0000 7fe03aafc9c0 20 remove_watcher() i=7 2024-09-12T01:00:56.689 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:56.689 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T01:00:56.689 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: a-bucket id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 num_objects: 0 size_kb: 0 num_shards: 3 2024-09-12T01:00:56.690 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:56.690 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-12T01:00:56.717 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:56.717 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:56.759 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.766+0000 7ff0a07019c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.766+0000 7ff0a07019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.766+0000 7ff0a07019c0 20 realm 2024-09-12T01:00:56.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.766+0000 7ff0a07019c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.761 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.770+0000 7ff0a07019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.770+0000 7ff0a07019c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:56.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.770+0000 7ff0a07019c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.770+0000 7ff0a07019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.762 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.770+0000 7ff0a07019c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.770+0000 7ff0a07019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:56.763 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.770+0000 7ff0a07019c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.764 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.770+0000 7ff0a07019c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:56.764 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.770+0000 7ff0a07019c0 20 searching for the correct realm 2024-09-12T01:00:56.768 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.774+0000 7ff09ea08640 0 -- 172.21.15.70:0/1594475174 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7ff09402d040 msgr2=0x7ff094039920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:56.776 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.782+0000 7ff09ea08640 0 -- 172.21.15.70:0/1594475174 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fef680808b0 msgr2=0x7fef68082d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:00:56.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.790+0000 7ff0a07019c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:56.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.790+0000 7ff0a07019c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:00:56.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.790+0000 7ff0a07019c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:56.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.790+0000 7ff0a07019c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:00:56.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.790+0000 7ff0a07019c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:56.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.790+0000 7ff0a07019c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:56.785 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.790+0000 7ff0a07019c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.786 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.794+0000 7ff0a07019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.786 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.794+0000 7ff0a07019c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.786 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.794+0000 7ff0a07019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:56.786 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.794+0000 7ff0a07019c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.787 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.794+0000 7ff0a07019c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:56.787 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.794+0000 7ff0a07019c0 20 zone default found 2024-09-12T01:00:56.787 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.794+0000 7ff0a07019c0 4 Realm: () 2024-09-12T01:00:56.787 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.794+0000 7ff0a07019c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:00:56.787 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.794+0000 7ff0a07019c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:00:56.787 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.794+0000 7ff0a07019c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:56.787 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.794+0000 7ff0a07019c0 20 zonegroup default 2024-09-12T01:00:56.787 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.794+0000 7ff0a07019c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.787 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.794+0000 7ff0a07019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.787 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.794+0000 7ff0a07019c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.788 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.794+0000 7ff0a07019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.788 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.794+0000 7ff0a07019c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.788 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.794+0000 7ff0a07019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.788 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.794+0000 7ff0a07019c0 20 started sync module instance, tier type = 2024-09-12T01:00:56.788 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.794+0000 7ff0a07019c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:00:56.803 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.810+0000 7ff0a07019c0 20 add_watcher() i=0 2024-09-12T01:00:56.803 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.810+0000 7ff0a07019c0 20 add_watcher() i=1 2024-09-12T01:00:56.803 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.810+0000 7ff0a07019c0 20 add_watcher() i=2 2024-09-12T01:00:56.803 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.810+0000 7ff0a07019c0 20 add_watcher() i=3 2024-09-12T01:00:56.803 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.810+0000 7ff0a07019c0 20 add_watcher() i=4 2024-09-12T01:00:56.803 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.810+0000 7ff0a07019c0 20 add_watcher() i=5 2024-09-12T01:00:56.803 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.810+0000 7ff0a07019c0 20 add_watcher() i=6 2024-09-12T01:00:56.803 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.810+0000 7ff0a07019c0 20 add_watcher() i=7 2024-09-12T01:00:56.804 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.810+0000 7ff0a07019c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:56.806 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.814+0000 7fef54fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:56.807 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.814+0000 7ff0a07019c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:56.807 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.814+0000 7ff0a07019c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:56.807 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.814+0000 7ff0a07019c0 5 note: GC not initialized 2024-09-12T01:00:56.807 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.814+0000 7feecf7fe640 20 reqs_thread_entry: start 2024-09-12T01:00:56.807 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.814+0000 7ff0a07019c0 20 init_complete bucket index max shards: 1 2024-09-12T01:00:56.807 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.814+0000 7ff0a07019c0 20 Filter name: none 2024-09-12T01:00:56.808 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.814+0000 7feecd7fa640 20 reqs_thread_entry: start 2024-09-12T01:00:56.808 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.814+0000 7ff0a07019c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.808 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.814+0000 7ff0a07019c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T01:00:56.808 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.814+0000 7ff0a07019c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.809 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.814+0000 7ff0a07019c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T01:00:56.809 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.814+0000 7ff0a07019c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:00:56.810 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.818+0000 7fef54fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:56.815 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.822+0000 7ff0a07019c0 20 remove_watcher() i=0 2024-09-12T01:00:56.815 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.822+0000 7ff0a07019c0 2 removed watcher, disabling cache 2024-09-12T01:00:56.817 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.822+0000 7ff0a07019c0 20 remove_watcher() i=1 2024-09-12T01:00:56.819 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.826+0000 7ff0a07019c0 20 remove_watcher() i=2 2024-09-12T01:00:56.820 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.826+0000 7ff0a07019c0 20 remove_watcher() i=3 2024-09-12T01:00:56.822 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.830+0000 7ff0a07019c0 20 remove_watcher() i=4 2024-09-12T01:00:56.823 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.830+0000 7ff0a07019c0 20 remove_watcher() i=5 2024-09-12T01:00:56.825 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.830+0000 7ff0a07019c0 20 remove_watcher() i=6 2024-09-12T01:00:56.826 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.834+0000 7ff0a07019c0 20 remove_watcher() i=7 2024-09-12T01:00:56.840 INFO:tasks.workunit.client.0.smithi070.stderr:rados -p default.rgw.buckets.index setomapval .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-12T01:00:56.866 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:56.866 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:56.883 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T01:00:56.909 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:56.909 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:56.950 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.958+0000 7ffbaa6f59c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.958+0000 7ffbaa6f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.958+0000 7ffbaa6f59c0 20 realm 2024-09-12T01:00:56.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.958+0000 7ffbaa6f59c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.958+0000 7ffbaa6f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.958+0000 7ffbaa6f59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:56.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.958+0000 7ffbaa6f59c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.958+0000 7ffbaa6f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:56.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.958+0000 7ffbaa6f59c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.962+0000 7ffbaa6f59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:56.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.962+0000 7ffbaa6f59c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:56.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.962+0000 7ffbaa6f59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:56.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.962+0000 7ffbaa6f59c0 20 searching for the correct realm 2024-09-12T01:00:56.957 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:56.966+0000 7ffba79fa640 0 -- 172.21.15.70:0/3491337890 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7ffb98034060 msgr2=0x7ffb980629e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:00:57.173 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.182+0000 7ffba81fb640 0 -- 172.21.15.70:0/3491337890 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7ffba002a020 msgr2=0x7ffba008cf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:57.189 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.198+0000 7ffbaa6f59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:57.190 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.198+0000 7ffbaa6f59c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:00:57.190 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.198+0000 7ffbaa6f59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:57.190 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.198+0000 7ffbaa6f59c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:00:57.190 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.198+0000 7ffbaa6f59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:57.190 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.198+0000 7ffbaa6f59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:57.190 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.198+0000 7ffbaa6f59c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.191 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.198+0000 7ffbaa6f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:57.191 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.198+0000 7ffbaa6f59c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.191 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.198+0000 7ffbaa6f59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:57.191 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.198+0000 7ffbaa6f59c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.192 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.198+0000 7ffbaa6f59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:57.192 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.198+0000 7ffbaa6f59c0 20 zone default found 2024-09-12T01:00:57.192 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.198+0000 7ffbaa6f59c0 4 Realm: () 2024-09-12T01:00:57.192 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.198+0000 7ffbaa6f59c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:00:57.192 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.198+0000 7ffbaa6f59c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:00:57.192 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.198+0000 7ffbaa6f59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:57.192 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.198+0000 7ffbaa6f59c0 20 zonegroup default 2024-09-12T01:00:57.192 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.198+0000 7ffbaa6f59c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.198+0000 7ffbaa6f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:57.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.198+0000 7ffbaa6f59c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.198+0000 7ffbaa6f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:57.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.198+0000 7ffbaa6f59c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.202+0000 7ffbaa6f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:57.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.202+0000 7ffbaa6f59c0 20 started sync module instance, tier type = 2024-09-12T01:00:57.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.202+0000 7ffbaa6f59c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:00:57.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.222+0000 7ffbaa6f59c0 20 add_watcher() i=0 2024-09-12T01:00:57.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.222+0000 7ffbaa6f59c0 20 add_watcher() i=1 2024-09-12T01:00:57.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.222+0000 7ffbaa6f59c0 20 add_watcher() i=2 2024-09-12T01:00:57.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.222+0000 7ffbaa6f59c0 20 add_watcher() i=3 2024-09-12T01:00:57.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.222+0000 7ffbaa6f59c0 20 add_watcher() i=4 2024-09-12T01:00:57.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.222+0000 7ffbaa6f59c0 20 add_watcher() i=5 2024-09-12T01:00:57.218 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.226+0000 7ffbaa6f59c0 20 add_watcher() i=6 2024-09-12T01:00:57.219 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.226+0000 7ffbaa6f59c0 20 add_watcher() i=7 2024-09-12T01:00:57.219 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.226+0000 7ffbaa6f59c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:57.223 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.230+0000 7ffa5efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:57.224 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.230+0000 7ffbaa6f59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:57.224 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.230+0000 7ffbaa6f59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:57.224 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.230+0000 7ffbaa6f59c0 5 note: GC not initialized 2024-09-12T01:00:57.225 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.230+0000 7ffa5dfdb640 20 reqs_thread_entry: start 2024-09-12T01:00:57.225 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.234+0000 7ffbaa6f59c0 20 init_complete bucket index max shards: 1 2024-09-12T01:00:57.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.234+0000 7ffbaa6f59c0 20 Filter name: none 2024-09-12T01:00:57.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.234+0000 7ff9cf7fe640 20 reqs_thread_entry: start 2024-09-12T01:00:57.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.234+0000 7ffbaa6f59c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.227 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.234+0000 7ffbaa6f59c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T01:00:57.227 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.234+0000 7ffbaa6f59c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.228 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.234+0000 7ffbaa6f59c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T01:00:57.228 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.234+0000 7ffbaa6f59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:00:57.228 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.234+0000 7ffbaa6f59c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T01:00:57.228 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.234+0000 7ffbaa6f59c0 20 INFO: main: starting shard=0 2024-09-12T01:00:57.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.234+0000 7ffbaa6f59c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.0 2024-09-12T01:00:57.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.234+0000 7ffbaa6f59c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.0 2024-09-12T01:00:57.230 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.238+0000 7ffbaa6f59c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T01:00:57.230 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.238+0000 7ffbaa6f59c0 20 INFO: main: starting shard=1 2024-09-12T01:00:57.230 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.238+0000 7ffbaa6f59c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.1 2024-09-12T01:00:57.230 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.238+0000 7ffbaa6f59c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.1 2024-09-12T01:00:57.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.238+0000 7ffbaa6f59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:00:57.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.238+0000 7ffbaa6f59c0 20 INFO: main: starting shard=2 2024-09-12T01:00:57.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.238+0000 7ffbaa6f59c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.2 2024-09-12T01:00:57.231 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.238+0000 7ffbaa6f59c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.2 2024-09-12T01:00:57.232 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.238+0000 7ffbaa6f59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:00:57.232 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.238+0000 7ffbaa6f59c0 20 INFO: main: done 2024-09-12T01:00:57.233 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.242+0000 7ffa5efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:57.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.246+0000 7ffbaa6f59c0 20 remove_watcher() i=0 2024-09-12T01:00:57.238 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.246+0000 7ffbaa6f59c0 2 removed watcher, disabling cache 2024-09-12T01:00:57.242 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.250+0000 7ffbaa6f59c0 20 remove_watcher() i=1 2024-09-12T01:00:57.244 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.250+0000 7ffbaa6f59c0 20 remove_watcher() i=2 2024-09-12T01:00:57.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.254+0000 7ffbaa6f59c0 20 remove_watcher() i=3 2024-09-12T01:00:57.248 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.254+0000 7ffbaa6f59c0 20 remove_watcher() i=4 2024-09-12T01:00:57.250 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.258+0000 7ffbaa6f59c0 20 remove_watcher() i=5 2024-09-12T01:00:57.252 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.258+0000 7ffbaa6f59c0 20 remove_watcher() i=6 2024-09-12T01:00:57.254 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.262+0000 7ffbaa6f59c0 20 remove_watcher() i=7 2024-09-12T01:00:57.273 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-12T01:00:57.308 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:57.309 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:57.353 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.358+0000 7f6dc63a19c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.354 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.362+0000 7f6dc63a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:57.354 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.362+0000 7f6dc63a19c0 20 realm 2024-09-12T01:00:57.354 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.362+0000 7f6dc63a19c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.354 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.362+0000 7f6dc63a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:57.355 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.362+0000 7f6dc63a19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:57.355 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.362+0000 7f6dc63a19c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.355 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.362+0000 7f6dc63a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:57.355 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.362+0000 7f6dc63a19c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.356 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.362+0000 7f6dc63a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:57.356 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.362+0000 7f6dc63a19c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.357 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.362+0000 7f6dc63a19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:57.357 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.362+0000 7f6dc63a19c0 20 searching for the correct realm 2024-09-12T01:00:57.361 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.370+0000 7f6dc46a8640 0 -- 172.21.15.70:0/3049862546 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f6db808cfb0 msgr2=0x7f6db80627b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:00:57.370 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.378+0000 7f6dc46a8640 0 -- 172.21.15.70:0/3049862546 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f6c8c080880 msgr2=0x7f6c8c082cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:57.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.386+0000 7f6dc63a19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:57.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.386+0000 7f6dc63a19c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:00:57.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.386+0000 7f6dc63a19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:57.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.386+0000 7f6dc63a19c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:00:57.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.386+0000 7f6dc63a19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:57.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.386+0000 7f6dc63a19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:57.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.386+0000 7f6dc63a19c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.386+0000 7f6dc63a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:57.378 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.386+0000 7f6dc63a19c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.379 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.386+0000 7f6dc63a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:57.379 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.386+0000 7f6dc63a19c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.379 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.386+0000 7f6dc63a19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:57.379 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.386+0000 7f6dc63a19c0 20 zone default found 2024-09-12T01:00:57.379 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.386+0000 7f6dc63a19c0 4 Realm: () 2024-09-12T01:00:57.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.386+0000 7f6dc63a19c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:00:57.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.386+0000 7f6dc63a19c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:00:57.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.386+0000 7f6dc63a19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:57.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.386+0000 7f6dc63a19c0 20 zonegroup default 2024-09-12T01:00:57.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.386+0000 7f6dc63a19c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.386+0000 7f6dc63a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:57.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.386+0000 7f6dc63a19c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.381 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.386+0000 7f6dc63a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:57.381 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.386+0000 7f6dc63a19c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.381 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.386+0000 7f6dc63a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:57.381 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.386+0000 7f6dc63a19c0 20 started sync module instance, tier type = 2024-09-12T01:00:57.381 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.386+0000 7f6dc63a19c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:00:57.396 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.402+0000 7f6dc63a19c0 20 add_watcher() i=0 2024-09-12T01:00:57.396 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.402+0000 7f6dc63a19c0 20 add_watcher() i=1 2024-09-12T01:00:57.396 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.402+0000 7f6dc63a19c0 20 add_watcher() i=2 2024-09-12T01:00:57.396 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.402+0000 7f6dc63a19c0 20 add_watcher() i=3 2024-09-12T01:00:57.396 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.402+0000 7f6dc63a19c0 20 add_watcher() i=4 2024-09-12T01:00:57.396 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.402+0000 7f6dc63a19c0 20 add_watcher() i=5 2024-09-12T01:00:57.396 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.402+0000 7f6dc63a19c0 20 add_watcher() i=6 2024-09-12T01:00:57.397 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.402+0000 7f6dc63a19c0 20 add_watcher() i=7 2024-09-12T01:00:57.397 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.402+0000 7f6dc63a19c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:57.399 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.406+0000 7f6c7a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:57.400 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.406+0000 7f6dc63a19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:57.400 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.406+0000 7f6dc63a19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:57.400 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.406+0000 7f6dc63a19c0 5 note: GC not initialized 2024-09-12T01:00:57.400 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.406+0000 7f6c797e2640 20 reqs_thread_entry: start 2024-09-12T01:00:57.400 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.406+0000 7f6dc63a19c0 20 init_complete bucket index max shards: 1 2024-09-12T01:00:57.400 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.406+0000 7f6dc63a19c0 20 Filter name: none 2024-09-12T01:00:57.400 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.406+0000 7f6c727fc640 20 reqs_thread_entry: start 2024-09-12T01:00:57.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.406+0000 7f6dc63a19c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T01:00:57.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.406+0000 7f6dc63a19c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.410+0000 7f6dc63a19c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T01:00:57.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.410+0000 7f6dc63a19c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T01:00:57.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.410+0000 7f6dc63a19c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T01:00:57.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.410+0000 7f6dc63a19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : miss 2024-09-12T01:00:57.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.410+0000 7f6dc63a19c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.402 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.410+0000 7f6dc63a19c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T01:00:57.402 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.410+0000 7f6dc63a19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T01:00:57.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.410+0000 7f6dc63a19c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T01:00:57.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.410+0000 7f6dc63a19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:00:57.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.410+0000 7f6dc63a19c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:57.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.410+0000 7f6dc63a19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T01:00:57.410 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.418+0000 7f6dc63a19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T01:00:57.410 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.418+0000 7f6dc63a19c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T01:00:57.410 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.418+0000 7f6dc63a19c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:57.410 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.418+0000 7f6dc63a19c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18, ofs0, ns] 2024-09-12T01:00:57.410 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.418+0000 7f6ca27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431651 cookie 94660050651888 notifier 8634 bl.length()=911 2024-09-12T01:00:57.410 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.418+0000 7f6ca27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T01:00:57.411 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.418+0000 7f6ca27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T01:00:57.411 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.418+0000 7f6ca27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:57.411 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.418+0000 7f6dc63a19c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_sources= new_sources= 2024-09-12T01:00:57.412 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.418+0000 7f6dc63a19c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential sources added=[] removed=[] 2024-09-12T01:00:57.412 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.418+0000 7f6dc63a19c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_dests= new_dests= 2024-09-12T01:00:57.412 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.418+0000 7f6dc63a19c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential dests added=[] removed=[] 2024-09-12T01:00:57.418 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.426+0000 7f6dc63a19c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.0 2024-09-12T01:00:57.418 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.426+0000 7f6dc63a19c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.0 2024-09-12T01:00:57.418 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.426+0000 7f6dc63a19c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.0 2024-09-12T01:00:57.418 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.426+0000 7f6dc63a19c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.0 2024-09-12T01:00:57.418 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.426+0000 7f6dc63a19c0 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-12T01:00:57.418 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.426+0000 7f6dc63a19c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.1 2024-09-12T01:00:57.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.426+0000 7f6dc63a19c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.1 2024-09-12T01:00:57.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.426+0000 7f6dc63a19c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.2 2024-09-12T01:00:57.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.426+0000 7f6dc63a19c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.2 2024-09-12T01:00:57.420 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.426+0000 7f6dc63a19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : hit (requested=0x17, cached=0x17) 2024-09-12T01:00:57.421 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.426+0000 7f6dc63a19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T01:00:57.424 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.430+0000 7f6dc63a19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T01:00:57.424 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.430+0000 7f6dc63a19c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T01:00:57.424 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.430+0000 7f6dc63a19c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:57.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.430+0000 7f6dc63a19c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18, ofs0, ns] 2024-09-12T01:00:57.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.434+0000 7f6ca27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431652 cookie 94660050651888 notifier 8634 bl.length()=911 2024-09-12T01:00:57.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.434+0000 7f6ca27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T01:00:57.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.434+0000 7f6ca27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T01:00:57.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.434+0000 7f6ca27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:57.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.434+0000 7f6dc63a19c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_sources= new_sources= 2024-09-12T01:00:57.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.434+0000 7f6dc63a19c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential sources added=[] removed=[] 2024-09-12T01:00:57.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.434+0000 7f6dc63a19c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_dests= new_dests= 2024-09-12T01:00:57.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.434+0000 7f6dc63a19c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential dests added=[] removed=[] 2024-09-12T01:00:57.429 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.438+0000 7f6dc63a19c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.0 2024-09-12T01:00:57.429 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.438+0000 7f6dc63a19c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.0 2024-09-12T01:00:57.430 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.438+0000 7f6dc63a19c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.1 2024-09-12T01:00:57.430 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.438+0000 7f6dc63a19c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.1 2024-09-12T01:00:57.431 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.438+0000 7f6dc63a19c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.2 2024-09-12T01:00:57.431 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.438+0000 7f6dc63a19c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.2.2 2024-09-12T01:00:57.431 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.438+0000 7f6dc63a19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 : hit (requested=0x17, cached=0x17) 2024-09-12T01:00:57.431 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.438+0000 7f6dc63a19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 2024-09-12T01:00:57.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.442+0000 7f6dc63a19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T01:00:57.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.442+0000 7f6dc63a19c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T01:00:57.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.442+0000 7f6dc63a19c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:57.434 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.442+0000 7f6dc63a19c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18, ofs0, ns] 2024-09-12T01:00:57.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.442+0000 7f6ca27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431653 cookie 94660050651888 notifier 8634 bl.length()=879 2024-09-12T01:00:57.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.442+0000 7f6ca27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 info.flags=0x17 2024-09-12T01:00:57.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.442+0000 7f6ca27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18 to cache LRU end 2024-09-12T01:00:57.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.442+0000 7f6ca27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:57.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.442+0000 7f6dc63a19c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_sources= new_sources= 2024-09-12T01:00:57.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.442+0000 7f6dc63a19c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential sources added=[] removed=[] 2024-09-12T01:00:57.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.442+0000 7f6dc63a19c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): orig_dests= new_dests= 2024-09-12T01:00:57.436 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.442+0000 7f6dc63a19c0 20 handle_bi_update(): bucket=:a-bucket[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18]): potential dests added=[] removed=[] 2024-09-12T01:00:57.439 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.446+0000 7f6dc63a19c0 1 execute INFO: reshard of bucket "a-bucket" from 3 shards to 1 shards completed successfully 2024-09-12T01:00:57.442 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.450+0000 7f6c7a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:57.446 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.454+0000 7f6dc63a19c0 20 remove_watcher() i=0 2024-09-12T01:00:57.446 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.454+0000 7f6dc63a19c0 2 removed watcher, disabling cache 2024-09-12T01:00:57.449 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.454+0000 7f6dc63a19c0 20 remove_watcher() i=1 2024-09-12T01:00:57.451 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.458+0000 7f6dc63a19c0 20 remove_watcher() i=2 2024-09-12T01:00:57.453 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.462+0000 7f6dc63a19c0 20 remove_watcher() i=3 2024-09-12T01:00:57.455 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.462+0000 7f6dc63a19c0 20 remove_watcher() i=4 2024-09-12T01:00:57.457 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.462+0000 7f6dc63a19c0 20 remove_watcher() i=5 2024-09-12T01:00:57.458 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.466+0000 7f6dc63a19c0 20 remove_watcher() i=6 2024-09-12T01:00:57.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.466+0000 7f6dc63a19c0 20 remove_watcher() i=7 2024-09-12T01:00:57.474 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T01:00:57.503 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:57.503 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:57.546 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.554+0000 7fe76f87b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.554+0000 7fe76f87b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:57.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.554+0000 7fe76f87b9c0 20 realm 2024-09-12T01:00:57.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.554+0000 7fe76f87b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.554+0000 7fe76f87b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:57.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.554+0000 7fe76f87b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:57.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.554+0000 7fe76f87b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.554+0000 7fe76f87b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:57.548 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.554+0000 7fe76f87b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.549 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.558+0000 7fe76f87b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:57.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.558+0000 7fe76f87b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.558+0000 7fe76f87b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:57.550 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.558+0000 7fe76f87b9c0 20 searching for the correct realm 2024-09-12T01:00:57.555 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.562+0000 7fe76db82640 0 -- 172.21.15.70:0/4209241018 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fe764041040 msgr2=0x7fe764027930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:57.562 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.570+0000 7fe76db82640 0 -- 172.21.15.70:0/4209241018 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fe638080830 msgr2=0x7fe638082c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:57.569 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.574+0000 7fe76f87b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:57.569 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.574+0000 7fe76f87b9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:00:57.569 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.574+0000 7fe76f87b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:57.569 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.574+0000 7fe76f87b9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:00:57.569 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.574+0000 7fe76f87b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:57.570 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.574+0000 7fe76f87b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:57.570 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.578+0000 7fe76f87b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.570 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.578+0000 7fe76f87b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:57.570 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.578+0000 7fe76f87b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.571 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.578+0000 7fe76f87b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:57.571 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.578+0000 7fe76f87b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.571 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.578+0000 7fe76f87b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:57.571 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.578+0000 7fe76f87b9c0 20 zone default found 2024-09-12T01:00:57.571 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.578+0000 7fe76f87b9c0 4 Realm: () 2024-09-12T01:00:57.571 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.578+0000 7fe76f87b9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:00:57.571 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.578+0000 7fe76f87b9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:00:57.571 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.578+0000 7fe76f87b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:57.571 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.578+0000 7fe76f87b9c0 20 zonegroup default 2024-09-12T01:00:57.571 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.578+0000 7fe76f87b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.571 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.578+0000 7fe76f87b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:57.572 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.578+0000 7fe76f87b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.572 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.578+0000 7fe76f87b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:57.572 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.578+0000 7fe76f87b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.572 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.578+0000 7fe76f87b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:57.572 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.578+0000 7fe76f87b9c0 20 started sync module instance, tier type = 2024-09-12T01:00:57.572 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.578+0000 7fe76f87b9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:00:57.588 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.594+0000 7fe76f87b9c0 20 add_watcher() i=0 2024-09-12T01:00:57.588 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.594+0000 7fe76f87b9c0 20 add_watcher() i=1 2024-09-12T01:00:57.588 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.594+0000 7fe76f87b9c0 20 add_watcher() i=2 2024-09-12T01:00:57.588 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.594+0000 7fe76f87b9c0 20 add_watcher() i=3 2024-09-12T01:00:57.589 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.594+0000 7fe76f87b9c0 20 add_watcher() i=4 2024-09-12T01:00:57.589 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.594+0000 7fe76f87b9c0 20 add_watcher() i=5 2024-09-12T01:00:57.589 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.594+0000 7fe76f87b9c0 20 add_watcher() i=6 2024-09-12T01:00:57.589 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.598+0000 7fe76f87b9c0 20 add_watcher() i=7 2024-09-12T01:00:57.589 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.598+0000 7fe76f87b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:57.592 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.598+0000 7fe6237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:57.593 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.598+0000 7fe76f87b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:57.593 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.598+0000 7fe76f87b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:57.593 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.598+0000 7fe76f87b9c0 5 note: GC not initialized 2024-09-12T01:00:57.593 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.598+0000 7fe6227e4640 20 reqs_thread_entry: start 2024-09-12T01:00:57.593 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.598+0000 7fe76f87b9c0 20 init_complete bucket index max shards: 1 2024-09-12T01:00:57.593 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.598+0000 7fe76f87b9c0 20 Filter name: none 2024-09-12T01:00:57.593 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.598+0000 7fe593fff640 20 reqs_thread_entry: start 2024-09-12T01:00:57.593 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.598+0000 7fe76f87b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.594 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.602+0000 7fe76f87b9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T01:00:57.594 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.602+0000 7fe76f87b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.595 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.602+0000 7fe76f87b9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T01:00:57.595 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.602+0000 7fe76f87b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:00:57.595 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.602+0000 7fe76f87b9c0 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-12T01:00:57.595 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.602+0000 7fe76f87b9c0 20 INFO: main: starting shard=0 2024-09-12T01:00:57.595 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.602+0000 7fe76f87b9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.0 2024-09-12T01:00:57.596 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.602+0000 7fe76f87b9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18.3.0 2024-09-12T01:00:57.596 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.602+0000 7fe76f87b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:00:57.596 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.602+0000 7fe76f87b9c0 20 INFO: main: done 2024-09-12T01:00:57.596 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.602+0000 7fe6237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:57.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.606+0000 7fe76f87b9c0 20 remove_watcher() i=0 2024-09-12T01:00:57.601 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.606+0000 7fe76f87b9c0 2 removed watcher, disabling cache 2024-09-12T01:00:57.603 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.610+0000 7fe76f87b9c0 20 remove_watcher() i=1 2024-09-12T01:00:57.605 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.610+0000 7fe76f87b9c0 20 remove_watcher() i=2 2024-09-12T01:00:57.607 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.614+0000 7fe76f87b9c0 20 remove_watcher() i=3 2024-09-12T01:00:57.609 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.614+0000 7fe76f87b9c0 20 remove_watcher() i=4 2024-09-12T01:00:57.610 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.618+0000 7fe76f87b9c0 20 remove_watcher() i=5 2024-09-12T01:00:57.611 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.618+0000 7fe76f87b9c0 20 remove_watcher() i=6 2024-09-12T01:00:57.613 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.618+0000 7fe76f87b9c0 20 remove_watcher() i=7 2024-09-12T01:00:57.626 INFO:tasks.workunit.client.0.smithi070.stderr: test: PUT succeeds during reshard 2024-09-12T01:00:57.626 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T01:00:57.654 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:57.655 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:57.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.702+0000 7fa73de219c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.706+0000 7fa73de219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:57.698 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.706+0000 7fa73de219c0 20 realm 2024-09-12T01:00:57.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.706+0000 7fa73de219c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.706+0000 7fa73de219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:57.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.706+0000 7fa73de219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:57.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.706+0000 7fa73de219c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.706+0000 7fa73de219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:57.699 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.706+0000 7fa73de219c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.706+0000 7fa73de219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:57.700 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.706+0000 7fa73de219c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.710+0000 7fa73de219c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:57.701 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.710+0000 7fa73de219c0 20 searching for the correct realm 2024-09-12T01:00:57.704 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.710+0000 7fa73b126640 0 -- 172.21.15.70:0/2039282392 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7fa734046c20 msgr2=0x7fa73401e890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:57.916 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.926+0000 7fa73b927640 0 -- 172.21.15.70:0/2039282392 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7fa72c0bb040 msgr2=0x7fa72c007590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:57.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.938+0000 7fa73de219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:57.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.938+0000 7fa73de219c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:00:57.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.938+0000 7fa73de219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:57.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.938+0000 7fa73de219c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:00:57.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.938+0000 7fa73de219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:57.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.938+0000 7fa73de219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:57.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.938+0000 7fa73de219c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.938+0000 7fa73de219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:57.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.938+0000 7fa73de219c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.938+0000 7fa73de219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:57.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.938+0000 7fa73de219c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.942+0000 7fa73de219c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:57.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.942+0000 7fa73de219c0 20 zone default found 2024-09-12T01:00:57.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.942+0000 7fa73de219c0 4 Realm: () 2024-09-12T01:00:57.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.942+0000 7fa73de219c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:00:57.934 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.942+0000 7fa73de219c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:00:57.934 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.942+0000 7fa73de219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:57.934 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.942+0000 7fa73de219c0 20 zonegroup default 2024-09-12T01:00:57.934 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.942+0000 7fa73de219c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.934 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.942+0000 7fa73de219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:57.934 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.942+0000 7fa73de219c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.935 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.942+0000 7fa73de219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:57.935 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.942+0000 7fa73de219c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.935 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.942+0000 7fa73de219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:57.935 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.942+0000 7fa73de219c0 20 started sync module instance, tier type = 2024-09-12T01:00:57.935 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.942+0000 7fa73de219c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:00:57.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.966+0000 7fa73de219c0 20 add_watcher() i=0 2024-09-12T01:00:57.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.966+0000 7fa73de219c0 20 add_watcher() i=1 2024-09-12T01:00:57.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.966+0000 7fa73de219c0 20 add_watcher() i=2 2024-09-12T01:00:57.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.966+0000 7fa73de219c0 20 add_watcher() i=3 2024-09-12T01:00:57.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.966+0000 7fa73de219c0 20 add_watcher() i=4 2024-09-12T01:00:57.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.966+0000 7fa73de219c0 20 add_watcher() i=5 2024-09-12T01:00:57.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.966+0000 7fa73de219c0 20 add_watcher() i=6 2024-09-12T01:00:57.961 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.966+0000 7fa73de219c0 20 add_watcher() i=7 2024-09-12T01:00:57.961 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.966+0000 7fa73de219c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:57.965 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.970+0000 7fa5f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:57.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.974+0000 7fa73de219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:57.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.974+0000 7fa73de219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:57.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.974+0000 7fa73de219c0 5 note: GC not initialized 2024-09-12T01:00:57.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.974+0000 7fa5f0fe1640 20 reqs_thread_entry: start 2024-09-12T01:00:57.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.974+0000 7fa73de219c0 20 init_complete bucket index max shards: 1 2024-09-12T01:00:57.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.974+0000 7fa73de219c0 20 Filter name: none 2024-09-12T01:00:57.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.974+0000 7fa56a7fc640 20 reqs_thread_entry: start 2024-09-12T01:00:57.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.974+0000 7fa73de219c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.974+0000 7fa73de219c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T01:00:57.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.974+0000 7fa73de219c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.974+0000 7fa73de219c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T01:00:57.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.974+0000 7fa73de219c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:00:57.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.974+0000 7fa73de219c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.974+0000 7fa73de219c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T01:00:57.969 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.974+0000 7fa73de219c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:57.970 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.978+0000 7fa73de219c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T01:00:57.970 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.978+0000 7fa73de219c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:00:57.971 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.978+0000 7fa5f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:57.977 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.986+0000 7fa73de219c0 20 remove_watcher() i=0 2024-09-12T01:00:57.977 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.986+0000 7fa73de219c0 2 removed watcher, disabling cache 2024-09-12T01:00:57.980 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.986+0000 7fa73de219c0 20 remove_watcher() i=1 2024-09-12T01:00:57.982 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.990+0000 7fa73de219c0 20 remove_watcher() i=2 2024-09-12T01:00:57.985 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.994+0000 7fa73de219c0 20 remove_watcher() i=3 2024-09-12T01:00:57.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.994+0000 7fa73de219c0 20 remove_watcher() i=4 2024-09-12T01:00:57.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.998+0000 7fa73de219c0 20 remove_watcher() i=5 2024-09-12T01:00:57.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.998+0000 7fa73de219c0 20 remove_watcher() i=6 2024-09-12T01:00:57.993 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:57.998+0000 7fa73de219c0 20 remove_watcher() i=7 2024-09-12T01:00:58.009 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:58.009 INFO:tasks.workunit.client.0.smithi070.stderr:BUCKET_STATS: 2024-09-12T01:00:58.009 INFO:tasks.workunit.client.0.smithi070.stderr:bucket: myver id: 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T01:00:58.009 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:00:58.010 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 3 2024-09-12T01:00:58.044 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:58.045 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:58.087 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.094+0000 7fd27616e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:58.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.094+0000 7fd27616e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:58.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.094+0000 7fd27616e9c0 20 realm 2024-09-12T01:00:58.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.094+0000 7fd27616e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:58.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.094+0000 7fd27616e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:58.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.094+0000 7fd27616e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:58.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.094+0000 7fd27616e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:58.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.098+0000 7fd27616e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:58.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.098+0000 7fd27616e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:58.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.098+0000 7fd27616e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:58.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.098+0000 7fd27616e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:58.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.098+0000 7fd27616e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:58.092 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.098+0000 7fd27616e9c0 20 searching for the correct realm 2024-09-12T01:00:58.095 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.102+0000 7fd274475640 0 -- 172.21.15.70:0/2628926695 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fd2680cf040 msgr2=0x7fd2680e6a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:58.310 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.318+0000 7fd274475640 0 -- 172.21.15.70:0/2628926695 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fd2680cf040 msgr2=0x7fd2680e6a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:58.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.330+0000 7fd27616e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:58.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.330+0000 7fd27616e9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:00:58.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.330+0000 7fd27616e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:58.324 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.330+0000 7fd27616e9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:00:58.324 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.330+0000 7fd27616e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:58.324 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.330+0000 7fd27616e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:58.324 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.330+0000 7fd27616e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:58.324 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.330+0000 7fd27616e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:58.324 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.330+0000 7fd27616e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:58.325 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.330+0000 7fd27616e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:58.325 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.330+0000 7fd27616e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:58.325 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.334+0000 7fd27616e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:58.325 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.334+0000 7fd27616e9c0 20 zone default found 2024-09-12T01:00:58.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.334+0000 7fd27616e9c0 4 Realm: () 2024-09-12T01:00:58.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.334+0000 7fd27616e9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:00:58.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.334+0000 7fd27616e9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:00:58.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.334+0000 7fd27616e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:58.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.334+0000 7fd27616e9c0 20 zonegroup default 2024-09-12T01:00:58.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.334+0000 7fd27616e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:58.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.334+0000 7fd27616e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:58.326 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.334+0000 7fd27616e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:58.327 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.334+0000 7fd27616e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:58.327 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.334+0000 7fd27616e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:58.327 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.334+0000 7fd27616e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:58.327 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.334+0000 7fd27616e9c0 20 started sync module instance, tier type = 2024-09-12T01:00:58.327 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.334+0000 7fd27616e9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:00:58.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.354+0000 7fd27616e9c0 20 add_watcher() i=0 2024-09-12T01:00:58.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.354+0000 7fd27616e9c0 20 add_watcher() i=1 2024-09-12T01:00:58.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.354+0000 7fd27616e9c0 20 add_watcher() i=2 2024-09-12T01:00:58.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.354+0000 7fd27616e9c0 20 add_watcher() i=3 2024-09-12T01:00:58.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.354+0000 7fd27616e9c0 20 add_watcher() i=4 2024-09-12T01:00:58.349 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.354+0000 7fd27616e9c0 20 add_watcher() i=5 2024-09-12T01:00:58.350 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.358+0000 7fd27616e9c0 20 add_watcher() i=6 2024-09-12T01:00:58.351 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.358+0000 7fd27616e9c0 20 add_watcher() i=7 2024-09-12T01:00:58.351 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.358+0000 7fd27616e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:58.354 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.362+0000 7fd129fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:58.355 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.362+0000 7fd27616e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:58.355 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.362+0000 7fd27616e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:58.355 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.362+0000 7fd27616e9c0 5 note: GC not initialized 2024-09-12T01:00:58.356 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.362+0000 7fd128fe1640 20 reqs_thread_entry: start 2024-09-12T01:00:58.356 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.362+0000 7fd27616e9c0 20 init_complete bucket index max shards: 1 2024-09-12T01:00:58.356 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.362+0000 7fd27616e9c0 20 Filter name: none 2024-09-12T01:00:58.357 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.362+0000 7fd0a27fc640 20 reqs_thread_entry: start 2024-09-12T01:00:58.357 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.362+0000 7fd27616e9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T01:00:58.357 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.362+0000 7fd27616e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:58.357 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.366+0000 7fd27616e9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T01:00:58.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.366+0000 7fd27616e9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T01:00:58.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.366+0000 7fd27616e9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T01:00:58.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.366+0000 7fd27616e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 : miss 2024-09-12T01:00:58.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.366+0000 7fd27616e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:58.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.366+0000 7fd27616e9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T01:00:58.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.366+0000 7fd27616e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 info.flags=0x17 2024-09-12T01:00:58.358 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.366+0000 7fd27616e9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 to cache LRU end 2024-09-12T01:00:58.359 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.366+0000 7fd27616e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:00:58.359 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.366+0000 7fd27616e9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:58.359 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.366+0000 7fd27616e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 2024-09-12T01:00:58.365 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.374+0000 7fd27616e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 info.flags=0x17 2024-09-12T01:00:58.365 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.374+0000 7fd27616e9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 to cache LRU end 2024-09-12T01:00:58.366 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.374+0000 7fd27616e9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:58.366 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.374+0000 7fd27616e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19, ofs0, ns] 2024-09-12T01:00:58.366 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.374+0000 7fd1527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431636 cookie 93998648103952 notifier 8135 bl.length()=905 2024-09-12T01:00:58.366 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.374+0000 7fd1527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 info.flags=0x17 2024-09-12T01:00:58.366 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.374+0000 7fd1527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 to cache LRU end 2024-09-12T01:00:58.366 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.374+0000 7fd1527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:00:58.367 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.374+0000 7fd27616e9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): orig_sources= new_sources= 2024-09-12T01:00:58.367 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.374+0000 7fd27616e9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): potential sources added=[] removed=[] 2024-09-12T01:00:58.367 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.374+0000 7fd27616e9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): orig_dests= new_dests= 2024-09-12T01:00:58.367 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.374+0000 7fd27616e9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): potential dests added=[] removed=[] 2024-09-12T01:00:58.372 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:00:58.378+0000 7fd27616e9c0 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-12T01:00:59.014 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:00:59.014 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:00:59.045 INFO:tasks.workunit.client.0.smithi070.stderr:put object successful 2024-09-12T01:01:03.372 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.382+0000 7fd27616e9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.0 2024-09-12T01:01:03.373 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.382+0000 7fd27616e9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.0 2024-09-12T01:01:03.373 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.382+0000 7fd27616e9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.1 2024-09-12T01:01:03.373 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.382+0000 7fd27616e9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.1 2024-09-12T01:01:03.373 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.382+0000 7fd27616e9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.2 2024-09-12T01:01:03.373 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.382+0000 7fd27616e9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.2 2024-09-12T01:01:03.373 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.382+0000 7fd27616e9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.1.0 2024-09-12T01:01:03.373 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.382+0000 7fd27616e9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.1.0 2024-09-12T01:01:03.375 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.386+0000 7fd27616e9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.1.1 2024-09-12T01:01:03.375 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.386+0000 7fd27616e9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.1.1 2024-09-12T01:01:03.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.390+0000 7fd27616e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 : hit (requested=0x17, cached=0x17) 2024-09-12T01:01:03.380 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.390+0000 7fd27616e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 2024-09-12T01:01:03.383 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.394+0000 7fd27616e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 info.flags=0x17 2024-09-12T01:01:03.383 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.394+0000 7fd27616e9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 to cache LRU end 2024-09-12T01:01:03.383 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.394+0000 7fd27616e9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:01:03.383 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.394+0000 7fd27616e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19, ofs0, ns] 2024-09-12T01:01:03.384 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.394+0000 7fd1527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431637 cookie 93998648103952 notifier 8135 bl.length()=905 2024-09-12T01:01:03.384 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.394+0000 7fd1527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 info.flags=0x17 2024-09-12T01:01:03.384 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.394+0000 7fd1527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 to cache LRU end 2024-09-12T01:01:03.384 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.394+0000 7fd1527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:01:03.385 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.398+0000 7fd27616e9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): orig_sources= new_sources= 2024-09-12T01:01:03.385 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.398+0000 7fd27616e9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): potential sources added=[] removed=[] 2024-09-12T01:01:03.385 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.398+0000 7fd27616e9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): orig_dests= new_dests= 2024-09-12T01:01:03.385 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.398+0000 7fd27616e9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): potential dests added=[] removed=[] 2024-09-12T01:01:03.389 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.398+0000 7fd27616e9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.1.0 2024-09-12T01:01:03.389 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.398+0000 7fd27616e9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.1.0 2024-09-12T01:01:03.390 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.402+0000 7fd27616e9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.1.1 2024-09-12T01:01:03.390 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.402+0000 7fd27616e9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.1.1 2024-09-12T01:01:03.394 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.406+0000 7fd27616e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 : hit (requested=0x17, cached=0x17) 2024-09-12T01:01:03.394 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.406+0000 7fd27616e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 2024-09-12T01:01:03.397 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.410+0000 7fd27616e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 info.flags=0x17 2024-09-12T01:01:03.397 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.410+0000 7fd27616e9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 to cache LRU end 2024-09-12T01:01:03.398 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.410+0000 7fd27616e9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:01:03.398 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.410+0000 7fd27616e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19, ofs0, ns] 2024-09-12T01:01:03.398 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.410+0000 7fd1527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431638 cookie 93998648103952 notifier 8135 bl.length()=873 2024-09-12T01:01:03.398 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.410+0000 7fd1527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 info.flags=0x17 2024-09-12T01:01:03.398 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.410+0000 7fd1527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 to cache LRU end 2024-09-12T01:01:03.399 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.410+0000 7fd1527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:01:03.399 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.410+0000 7fd27616e9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): orig_sources= new_sources= 2024-09-12T01:01:03.400 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.410+0000 7fd27616e9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): potential sources added=[] removed=[] 2024-09-12T01:01:03.400 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.410+0000 7fd27616e9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): orig_dests= new_dests= 2024-09-12T01:01:03.400 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.410+0000 7fd27616e9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): potential dests added=[] removed=[] 2024-09-12T01:01:03.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.414+0000 7fd27616e9c0 1 execute INFO: reshard of bucket "myver" from 2 shards to 3 shards completed successfully 2024-09-12T01:01:03.407 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.418+0000 7fd129fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:03.413 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.422+0000 7fd27616e9c0 20 remove_watcher() i=0 2024-09-12T01:01:03.413 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.422+0000 7fd27616e9c0 2 removed watcher, disabling cache 2024-09-12T01:01:03.416 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.426+0000 7fd27616e9c0 20 remove_watcher() i=1 2024-09-12T01:01:03.419 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.430+0000 7fd27616e9c0 20 remove_watcher() i=2 2024-09-12T01:01:03.421 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.434+0000 7fd27616e9c0 20 remove_watcher() i=3 2024-09-12T01:01:03.424 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.434+0000 7fd27616e9c0 20 remove_watcher() i=4 2024-09-12T01:01:03.427 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.438+0000 7fd27616e9c0 20 remove_watcher() i=5 2024-09-12T01:01:03.429 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.438+0000 7fd27616e9c0 20 remove_watcher() i=6 2024-09-12T01:01:03.431 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:03.442+0000 7fd27616e9c0 20 remove_watcher() i=7 2024-09-12T01:01:04.050 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-12T01:01:04.051 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:01:04.058 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:01:04.058 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:01:04.068 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:01:04.068 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:01:04.117 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:01:04.117 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:01:04.153 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:01:04.153 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:01:04.162 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:01:04.162 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:01:04.196 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:01:04.196 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:01:04.205 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:01:04.205 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:01:04.239 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:01:04.239 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:01:04.246 INFO:tasks.workunit.client.0.smithi070.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T01:01:04.682 INFO:tasks.workunit.client.0.smithi070.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T01:01:06.110 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:01:06.110 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:01:06.179 INFO:tasks.workunit.client.0.smithi070.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T01:01:06.179 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-12T01:01:06.216 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:01:06.216 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:01:06.258 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.270+0000 7f32812f79c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.270+0000 7f32812f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:06.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.270+0000 7f32812f79c0 20 realm 2024-09-12T01:01:06.260 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.270+0000 7f32812f79c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.270+0000 7f32812f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:06.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.270+0000 7f32812f79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:01:06.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.270+0000 7f32812f79c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.270+0000 7f32812f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:06.261 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.270+0000 7f32812f79c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.274+0000 7f32812f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:06.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.274+0000 7f32812f79c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.274+0000 7f32812f79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:01:06.263 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.274+0000 7f32812f79c0 20 searching for the correct realm 2024-09-12T01:01:06.269 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.278+0000 7f327edfd640 0 -- 172.21.15.70:0/1438836185 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f3278084040 msgr2=0x7f3278061860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:06.276 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.286+0000 7f327edfd640 0 -- 172.21.15.70:0/1438836185 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f3148080880 msgr2=0x7f3148082cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:06.282 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.294+0000 7f32812f79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:01:06.282 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.294+0000 7f32812f79c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:01:06.282 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.294+0000 7f32812f79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:01:06.282 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.294+0000 7f32812f79c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:01:06.282 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.294+0000 7f32812f79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:01:06.282 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.294+0000 7f32812f79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:01:06.282 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.294+0000 7f32812f79c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.282 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.294+0000 7f32812f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:06.282 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.294+0000 7f32812f79c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.294+0000 7f32812f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:06.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.294+0000 7f32812f79c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.294+0000 7f32812f79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:01:06.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.294+0000 7f32812f79c0 20 zone default found 2024-09-12T01:01:06.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.294+0000 7f32812f79c0 4 Realm: () 2024-09-12T01:01:06.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.294+0000 7f32812f79c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:01:06.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.294+0000 7f32812f79c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:01:06.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.294+0000 7f32812f79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:01:06.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.294+0000 7f32812f79c0 20 zonegroup default 2024-09-12T01:01:06.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.294+0000 7f32812f79c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.294+0000 7f32812f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:06.284 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.294+0000 7f32812f79c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.294+0000 7f32812f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:06.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.294+0000 7f32812f79c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.294+0000 7f32812f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:06.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.294+0000 7f32812f79c0 20 started sync module instance, tier type = 2024-09-12T01:01:06.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.294+0000 7f32812f79c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:01:06.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.310+0000 7f32812f79c0 20 add_watcher() i=0 2024-09-12T01:01:06.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.310+0000 7f32812f79c0 20 add_watcher() i=1 2024-09-12T01:01:06.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.310+0000 7f32812f79c0 20 add_watcher() i=2 2024-09-12T01:01:06.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.310+0000 7f32812f79c0 20 add_watcher() i=3 2024-09-12T01:01:06.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.310+0000 7f32812f79c0 20 add_watcher() i=4 2024-09-12T01:01:06.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.310+0000 7f32812f79c0 20 add_watcher() i=5 2024-09-12T01:01:06.299 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.310+0000 7f32812f79c0 20 add_watcher() i=6 2024-09-12T01:01:06.300 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.310+0000 7f32812f79c0 20 add_watcher() i=7 2024-09-12T01:01:06.300 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.310+0000 7f32812f79c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:01:06.302 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.314+0000 7f31357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:06.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.314+0000 7f32812f79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:01:06.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.314+0000 7f32812f79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:01:06.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.314+0000 7f32812f79c0 5 note: GC not initialized 2024-09-12T01:01:06.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.314+0000 7f30affff640 20 reqs_thread_entry: start 2024-09-12T01:01:06.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.314+0000 7f32812f79c0 20 init_complete bucket index max shards: 1 2024-09-12T01:01:06.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.314+0000 7f32812f79c0 20 Filter name: none 2024-09-12T01:01:06.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.314+0000 7f30adffb640 20 reqs_thread_entry: start 2024-09-12T01:01:06.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.314+0000 7f32812f79c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.314+0000 7f32812f79c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T01:01:06.304 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.314+0000 7f32812f79c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.314+0000 7f32812f79c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T01:01:06.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.314+0000 7f32812f79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:01:06.305 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.314+0000 7f32812f79c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T01:01:06.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.314+0000 7f32812f79c0 20 INFO: main: starting shard=0 2024-09-12T01:01:06.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.314+0000 7f32812f79c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.0 2024-09-12T01:01:06.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.314+0000 7f32812f79c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.0 2024-09-12T01:01:06.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.314+0000 7f32812f79c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T01:01:06.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.314+0000 7f32812f79c0 20 INFO: main: starting shard=1 2024-09-12T01:01:06.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.314+0000 7f32812f79c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.1 2024-09-12T01:01:06.306 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.314+0000 7f32812f79c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.1 2024-09-12T01:01:06.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.318+0000 7f32812f79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:01:06.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.318+0000 7f32812f79c0 20 INFO: main: starting shard=2 2024-09-12T01:01:06.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.318+0000 7f32812f79c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.2 2024-09-12T01:01:06.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.318+0000 7f32812f79c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.2 2024-09-12T01:01:06.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.318+0000 7f32812f79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:01:06.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.318+0000 7f32812f79c0 20 INFO: main: done 2024-09-12T01:01:06.307 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.318+0000 7f31357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:06.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.322+0000 7f32812f79c0 20 remove_watcher() i=0 2024-09-12T01:01:06.312 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.322+0000 7f32812f79c0 2 removed watcher, disabling cache 2024-09-12T01:01:06.314 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.326+0000 7f32812f79c0 20 remove_watcher() i=1 2024-09-12T01:01:06.316 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.326+0000 7f32812f79c0 20 remove_watcher() i=2 2024-09-12T01:01:06.318 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.330+0000 7f32812f79c0 20 remove_watcher() i=3 2024-09-12T01:01:06.320 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.330+0000 7f32812f79c0 20 remove_watcher() i=4 2024-09-12T01:01:06.321 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.334+0000 7f32812f79c0 20 remove_watcher() i=5 2024-09-12T01:01:06.322 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.334+0000 7f32812f79c0 20 remove_watcher() i=6 2024-09-12T01:01:06.323 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.334+0000 7f32812f79c0 20 remove_watcher() i=7 2024-09-12T01:01:06.336 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:01:06.336 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:01:06.339 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:01:06.339 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:01:06.394 INFO:tasks.workunit.client.0.smithi070.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T01:01:06.394 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-12T01:01:06.422 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:01:06.422 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:01:06.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.474+0000 7f90707519c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.474+0000 7f90707519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:06.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.474+0000 7f90707519c0 20 realm 2024-09-12T01:01:06.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.474+0000 7f90707519c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.474+0000 7f90707519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:06.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.474+0000 7f90707519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:01:06.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.474+0000 7f90707519c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.474+0000 7f90707519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:06.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.474+0000 7f90707519c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.478+0000 7f90707519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:06.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.478+0000 7f90707519c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.478+0000 7f90707519c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:01:06.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.478+0000 7f90707519c0 20 searching for the correct realm 2024-09-12T01:01:06.471 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.482+0000 7f906e257640 0 -- 172.21.15.70:0/1330418044 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f9060016070 msgr2=0x7f906005e030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:06.478 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.490+0000 7f906e257640 0 -- 172.21.15.70:0/1330418044 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f906005f5c0 msgr2=0x7f906008b730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:06.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.494+0000 7f90707519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:01:06.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.494+0000 7f90707519c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:01:06.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.494+0000 7f90707519c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:01:06.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.494+0000 7f90707519c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:01:06.484 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.494+0000 7f90707519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:01:06.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.494+0000 7f90707519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:01:06.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.494+0000 7f90707519c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.494+0000 7f90707519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:06.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.494+0000 7f90707519c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.494+0000 7f90707519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:06.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.494+0000 7f90707519c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.498+0000 7f90707519c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:01:06.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.498+0000 7f90707519c0 20 zone default found 2024-09-12T01:01:06.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.498+0000 7f90707519c0 4 Realm: () 2024-09-12T01:01:06.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.498+0000 7f90707519c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:01:06.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.498+0000 7f90707519c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:01:06.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.498+0000 7f90707519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:01:06.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.498+0000 7f90707519c0 20 zonegroup default 2024-09-12T01:01:06.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.498+0000 7f90707519c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.498+0000 7f90707519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:06.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.498+0000 7f90707519c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.498+0000 7f90707519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:06.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.498+0000 7f90707519c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.498+0000 7f90707519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:06.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.498+0000 7f90707519c0 20 started sync module instance, tier type = 2024-09-12T01:01:06.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.498+0000 7f90707519c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:01:06.502 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.514+0000 7f90707519c0 20 add_watcher() i=0 2024-09-12T01:01:06.503 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.514+0000 7f90707519c0 20 add_watcher() i=1 2024-09-12T01:01:06.503 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.514+0000 7f90707519c0 20 add_watcher() i=2 2024-09-12T01:01:06.503 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.514+0000 7f90707519c0 20 add_watcher() i=3 2024-09-12T01:01:06.503 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.514+0000 7f90707519c0 20 add_watcher() i=4 2024-09-12T01:01:06.503 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.514+0000 7f90707519c0 20 add_watcher() i=5 2024-09-12T01:01:06.503 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.514+0000 7f90707519c0 20 add_watcher() i=6 2024-09-12T01:01:06.503 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.514+0000 7f90707519c0 20 add_watcher() i=7 2024-09-12T01:01:06.503 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.514+0000 7f90707519c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:01:06.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.518+0000 7f8f24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:06.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.518+0000 7f90707519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:01:06.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.518+0000 7f90707519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:01:06.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.518+0000 7f90707519c0 5 note: GC not initialized 2024-09-12T01:01:06.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.518+0000 7f8e9f7fe640 20 reqs_thread_entry: start 2024-09-12T01:01:06.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.518+0000 7f90707519c0 20 init_complete bucket index max shards: 1 2024-09-12T01:01:06.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.518+0000 7f90707519c0 20 Filter name: none 2024-09-12T01:01:06.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.518+0000 7f8e9d7fa640 20 reqs_thread_entry: start 2024-09-12T01:01:06.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.518+0000 7f90707519c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.518+0000 7f90707519c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T01:01:06.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.518+0000 7f90707519c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.518+0000 7f90707519c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T01:01:06.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.518+0000 7f90707519c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:01:06.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.518+0000 7f90707519c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T01:01:06.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.518+0000 7f90707519c0 20 INFO: main: starting shard=0 2024-09-12T01:01:06.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.518+0000 7f90707519c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.0 2024-09-12T01:01:06.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.518+0000 7f90707519c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.0 2024-09-12T01:01:06.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.518+0000 7f90707519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:01:06.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.518+0000 7f90707519c0 20 INFO: main: starting shard=1 2024-09-12T01:01:06.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.518+0000 7f90707519c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.1 2024-09-12T01:01:06.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.518+0000 7f90707519c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.1 2024-09-12T01:01:06.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.522+0000 7f90707519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:01:06.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.522+0000 7f90707519c0 20 INFO: main: starting shard=2 2024-09-12T01:01:06.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.522+0000 7f90707519c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.2 2024-09-12T01:01:06.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.522+0000 7f90707519c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.2 2024-09-12T01:01:06.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.522+0000 7f90707519c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T01:01:06.510 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.522+0000 7f90707519c0 20 INFO: main: done 2024-09-12T01:01:06.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.522+0000 7f8f24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:06.516 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.526+0000 7f90707519c0 20 remove_watcher() i=0 2024-09-12T01:01:06.516 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.526+0000 7f90707519c0 2 removed watcher, disabling cache 2024-09-12T01:01:06.518 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.530+0000 7f90707519c0 20 remove_watcher() i=1 2024-09-12T01:01:06.520 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.530+0000 7f90707519c0 20 remove_watcher() i=2 2024-09-12T01:01:06.522 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.534+0000 7f90707519c0 20 remove_watcher() i=3 2024-09-12T01:01:06.524 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.534+0000 7f90707519c0 20 remove_watcher() i=4 2024-09-12T01:01:06.525 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.534+0000 7f90707519c0 20 remove_watcher() i=5 2024-09-12T01:01:06.526 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.538+0000 7f90707519c0 20 remove_watcher() i=6 2024-09-12T01:01:06.527 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.538+0000 7f90707519c0 20 remove_watcher() i=7 2024-09-12T01:01:06.541 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:01:06.541 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:01:06.545 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:01:06.545 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:01:06.602 INFO:tasks.workunit.client.0.smithi070.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T01:01:06.602 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-12T01:01:06.636 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:01:06.636 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:01:06.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.690+0000 7fcd8573f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.690+0000 7fcd8573f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:06.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.690+0000 7fcd8573f9c0 20 realm 2024-09-12T01:01:06.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.690+0000 7fcd8573f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.690+0000 7fcd8573f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:06.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.690+0000 7fcd8573f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:01:06.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.690+0000 7fcd8573f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.694+0000 7fcd8573f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:06.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.694+0000 7fcd8573f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.694+0000 7fcd8573f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:06.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.694+0000 7fcd8573f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.684 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.694+0000 7fcd8573f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:01:06.684 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.694+0000 7fcd8573f9c0 20 searching for the correct realm 2024-09-12T01:01:06.688 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.698+0000 7fcd83a46640 0 -- 172.21.15.70:0/942603938 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fcd78027050 msgr2=0x7fcd7806d880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:06.696 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.706+0000 7fcd83245640 0 -- 172.21.15.70:0/942603938 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7fcd7c05fcd0 msgr2=0x7fcd7c068040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:06.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.714+0000 7fcd8573f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:01:06.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.714+0000 7fcd8573f9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:01:06.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.714+0000 7fcd8573f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:01:06.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.714+0000 7fcd8573f9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:01:06.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.714+0000 7fcd8573f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:01:06.702 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.714+0000 7fcd8573f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:01:06.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.714+0000 7fcd8573f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.714+0000 7fcd8573f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:06.703 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.714+0000 7fcd8573f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.714+0000 7fcd8573f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:06.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.714+0000 7fcd8573f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.714+0000 7fcd8573f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:01:06.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.714+0000 7fcd8573f9c0 20 zone default found 2024-09-12T01:01:06.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.714+0000 7fcd8573f9c0 4 Realm: () 2024-09-12T01:01:06.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.714+0000 7fcd8573f9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:01:06.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.714+0000 7fcd8573f9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:01:06.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.714+0000 7fcd8573f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:01:06.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.714+0000 7fcd8573f9c0 20 zonegroup default 2024-09-12T01:01:06.705 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.714+0000 7fcd8573f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.714+0000 7fcd8573f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:06.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.714+0000 7fcd8573f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.714+0000 7fcd8573f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:06.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.714+0000 7fcd8573f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.714+0000 7fcd8573f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:06.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.714+0000 7fcd8573f9c0 20 started sync module instance, tier type = 2024-09-12T01:01:06.706 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.714+0000 7fcd8573f9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:01:06.720 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.730+0000 7fcd8573f9c0 20 add_watcher() i=0 2024-09-12T01:01:06.720 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.730+0000 7fcd8573f9c0 20 add_watcher() i=1 2024-09-12T01:01:06.720 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.730+0000 7fcd8573f9c0 20 add_watcher() i=2 2024-09-12T01:01:06.720 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.730+0000 7fcd8573f9c0 20 add_watcher() i=3 2024-09-12T01:01:06.720 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.730+0000 7fcd8573f9c0 20 add_watcher() i=4 2024-09-12T01:01:06.720 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.730+0000 7fcd8573f9c0 20 add_watcher() i=5 2024-09-12T01:01:06.720 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.730+0000 7fcd8573f9c0 20 add_watcher() i=6 2024-09-12T01:01:06.721 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.730+0000 7fcd8573f9c0 20 add_watcher() i=7 2024-09-12T01:01:06.721 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.730+0000 7fcd8573f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:01:06.723 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.734+0000 7fcc39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:06.724 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.734+0000 7fcd8573f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:01:06.725 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.734+0000 7fcd8573f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:01:06.725 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.734+0000 7fcd8573f9c0 5 note: GC not initialized 2024-09-12T01:01:06.725 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.734+0000 7fcc38fe1640 20 reqs_thread_entry: start 2024-09-12T01:01:06.725 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.734+0000 7fcd8573f9c0 20 init_complete bucket index max shards: 1 2024-09-12T01:01:06.725 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.734+0000 7fcd8573f9c0 20 Filter name: none 2024-09-12T01:01:06.725 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.734+0000 7fcbb27fc640 20 reqs_thread_entry: start 2024-09-12T01:01:06.725 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.734+0000 7fcd8573f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.738+0000 7fcd8573f9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T01:01:06.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.738+0000 7fcd8573f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:06.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.738+0000 7fcd8573f9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T01:01:06.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.738+0000 7fcd8573f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:01:06.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.738+0000 7fcd8573f9c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T01:01:06.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.738+0000 7fcd8573f9c0 20 INFO: main: starting shard=0 2024-09-12T01:01:06.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.738+0000 7fcd8573f9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.0 2024-09-12T01:01:06.726 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.738+0000 7fcd8573f9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.0 2024-09-12T01:01:06.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.738+0000 7fcd8573f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:01:06.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.738+0000 7fcd8573f9c0 20 INFO: main: starting shard=1 2024-09-12T01:01:06.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.738+0000 7fcd8573f9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.1 2024-09-12T01:01:06.727 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.738+0000 7fcd8573f9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.1 2024-09-12T01:01:06.728 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.738+0000 7fcd8573f9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T01:01:06.728 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.738+0000 7fcd8573f9c0 20 INFO: main: starting shard=2 2024-09-12T01:01:06.728 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.738+0000 7fcd8573f9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.2 2024-09-12T01:01:06.728 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.738+0000 7fcd8573f9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.2 2024-09-12T01:01:06.729 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.738+0000 7fcd8573f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:01:06.729 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.738+0000 7fcd8573f9c0 20 INFO: main: done 2024-09-12T01:01:06.729 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.742+0000 7fcc39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:06.734 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.746+0000 7fcd8573f9c0 20 remove_watcher() i=0 2024-09-12T01:01:06.734 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.746+0000 7fcd8573f9c0 2 removed watcher, disabling cache 2024-09-12T01:01:06.736 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.746+0000 7fcd8573f9c0 20 remove_watcher() i=1 2024-09-12T01:01:06.738 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.750+0000 7fcd8573f9c0 20 remove_watcher() i=2 2024-09-12T01:01:06.740 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.750+0000 7fcd8573f9c0 20 remove_watcher() i=3 2024-09-12T01:01:06.742 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.754+0000 7fcd8573f9c0 20 remove_watcher() i=4 2024-09-12T01:01:06.743 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.754+0000 7fcd8573f9c0 20 remove_watcher() i=5 2024-09-12T01:01:06.744 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.754+0000 7fcd8573f9c0 20 remove_watcher() i=6 2024-09-12T01:01:06.745 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:06.758+0000 7fcd8573f9c0 20 remove_watcher() i=7 2024-09-12T01:01:06.761 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:01:06.761 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:01:06.764 INFO:tasks.workunit.client.0.smithi070.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T01:01:07.184 INFO:tasks.workunit.client.0.smithi070.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T01:01:07.613 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-12T01:01:07.640 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:01:07.640 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:01:07.680 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.690+0000 7f0ba037c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:07.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.694+0000 7f0ba037c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:07.681 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.694+0000 7f0ba037c9c0 20 realm 2024-09-12T01:01:07.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.694+0000 7f0ba037c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:07.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.694+0000 7f0ba037c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:07.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.694+0000 7f0ba037c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:01:07.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.694+0000 7f0ba037c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:07.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.694+0000 7f0ba037c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:07.682 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.694+0000 7f0ba037c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:07.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.694+0000 7f0ba037c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:07.683 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.694+0000 7f0ba037c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:07.684 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.694+0000 7f0ba037c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:01:07.684 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.694+0000 7f0ba037c9c0 20 searching for the correct realm 2024-09-12T01:01:07.686 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.698+0000 7f0b9d681640 0 -- 172.21.15.70:0/1227701409 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7f0b9402a020 msgr2=0x7f0b94088050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:07.902 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.914+0000 7f0b9de82640 0 -- 172.21.15.70:0/1227701409 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f0b98023040 msgr2=0x7f0b98018960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:07.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.926+0000 7f0ba037c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:01:07.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.926+0000 7f0ba037c9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:01:07.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.926+0000 7f0ba037c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:01:07.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.926+0000 7f0ba037c9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:01:07.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.926+0000 7f0ba037c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:01:07.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.926+0000 7f0ba037c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:01:07.917 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.926+0000 7f0ba037c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:07.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.926+0000 7f0ba037c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:07.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.926+0000 7f0ba037c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:07.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.930+0000 7f0ba037c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:07.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.930+0000 7f0ba037c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:07.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.930+0000 7f0ba037c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:01:07.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.930+0000 7f0ba037c9c0 20 zone default found 2024-09-12T01:01:07.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.930+0000 7f0ba037c9c0 4 Realm: () 2024-09-12T01:01:07.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.930+0000 7f0ba037c9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:01:07.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.930+0000 7f0ba037c9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:01:07.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.930+0000 7f0ba037c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:01:07.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.930+0000 7f0ba037c9c0 20 zonegroup default 2024-09-12T01:01:07.919 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.930+0000 7f0ba037c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:07.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.930+0000 7f0ba037c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:07.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.930+0000 7f0ba037c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:07.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.930+0000 7f0ba037c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:07.920 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.930+0000 7f0ba037c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:07.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.930+0000 7f0ba037c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:07.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.930+0000 7f0ba037c9c0 20 started sync module instance, tier type = 2024-09-12T01:01:07.921 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.934+0000 7f0ba037c9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:01:07.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.954+0000 7f0ba037c9c0 20 add_watcher() i=0 2024-09-12T01:01:07.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.954+0000 7f0ba037c9c0 20 add_watcher() i=1 2024-09-12T01:01:07.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.954+0000 7f0ba037c9c0 20 add_watcher() i=2 2024-09-12T01:01:07.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.954+0000 7f0ba037c9c0 20 add_watcher() i=3 2024-09-12T01:01:07.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.954+0000 7f0ba037c9c0 20 add_watcher() i=4 2024-09-12T01:01:07.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.954+0000 7f0ba037c9c0 20 add_watcher() i=5 2024-09-12T01:01:07.943 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.954+0000 7f0ba037c9c0 20 add_watcher() i=6 2024-09-12T01:01:07.945 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.958+0000 7f0ba037c9c0 20 add_watcher() i=7 2024-09-12T01:01:07.945 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.958+0000 7f0ba037c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:01:07.949 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.958+0000 7f0a4f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:07.950 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.962+0000 7f0ba037c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:01:07.950 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.962+0000 7f0ba037c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:01:07.950 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.962+0000 7f0ba037c9c0 5 note: GC not initialized 2024-09-12T01:01:07.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.962+0000 7f0a4e7fc640 20 reqs_thread_entry: start 2024-09-12T01:01:07.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.962+0000 7f0ba037c9c0 20 init_complete bucket index max shards: 1 2024-09-12T01:01:07.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.962+0000 7f0ba037c9c0 20 Filter name: none 2024-09-12T01:01:07.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.962+0000 7f09bffff640 20 reqs_thread_entry: start 2024-09-12T01:01:07.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.962+0000 7f0ba037c9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T01:01:07.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.962+0000 7f0ba037c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:07.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.962+0000 7f0ba037c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T01:01:07.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.962+0000 7f0ba037c9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T01:01:07.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.962+0000 7f0ba037c9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T01:01:07.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.962+0000 7f0ba037c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 : miss 2024-09-12T01:01:07.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.962+0000 7f0ba037c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:07.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.962+0000 7f0ba037c9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T01:01:07.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.962+0000 7f0ba037c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 info.flags=0x17 2024-09-12T01:01:07.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.962+0000 7f0ba037c9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 to cache LRU end 2024-09-12T01:01:07.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.962+0000 7f0ba037c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:01:07.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.962+0000 7f0ba037c9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:01:07.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.962+0000 7f0ba037c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 2024-09-12T01:01:07.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.978+0000 7f0ba037c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 info.flags=0x17 2024-09-12T01:01:07.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.978+0000 7f0ba037c9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 to cache LRU end 2024-09-12T01:01:07.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.978+0000 7f0ba037c9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:01:07.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.978+0000 7f0ba037c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19, ofs0, ns] 2024-09-12T01:01:07.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.978+0000 7f0a80ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431639 cookie 94592425867616 notifier 8222 bl.length()=905 2024-09-12T01:01:07.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.978+0000 7f0a80ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 info.flags=0x17 2024-09-12T01:01:07.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.978+0000 7f0a80ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 to cache LRU end 2024-09-12T01:01:07.967 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.978+0000 7f0a80ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:01:07.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.978+0000 7f0ba037c9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): orig_sources= new_sources= 2024-09-12T01:01:07.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.978+0000 7f0ba037c9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): potential sources added=[] removed=[] 2024-09-12T01:01:07.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.978+0000 7f0ba037c9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): orig_dests= new_dests= 2024-09-12T01:01:07.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.978+0000 7f0ba037c9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): potential dests added=[] removed=[] 2024-09-12T01:01:07.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.0 2024-09-12T01:01:07.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.0 2024-09-12T01:01:07.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.1 2024-09-12T01:01:07.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.1 2024-09-12T01:01:07.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.2 2024-09-12T01:01:07.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.2 2024-09-12T01:01:07.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.3 2024-09-12T01:01:07.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.3 2024-09-12T01:01:07.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.4 2024-09-12T01:01:07.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.4 2024-09-12T01:01:07.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.5 2024-09-12T01:01:07.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.5 2024-09-12T01:01:07.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.6 2024-09-12T01:01:07.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.6 2024-09-12T01:01:07.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.7 2024-09-12T01:01:07.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.7 2024-09-12T01:01:07.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.8 2024-09-12T01:01:07.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.8 2024-09-12T01:01:07.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.9 2024-09-12T01:01:07.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.9 2024-09-12T01:01:07.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.10 2024-09-12T01:01:07.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.10 2024-09-12T01:01:07.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.11 2024-09-12T01:01:07.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.11 2024-09-12T01:01:07.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.12 2024-09-12T01:01:07.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.12 2024-09-12T01:01:07.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.13 2024-09-12T01:01:07.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.13 2024-09-12T01:01:07.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.14 2024-09-12T01:01:07.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.14 2024-09-12T01:01:07.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.15 2024-09-12T01:01:07.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.15 2024-09-12T01:01:07.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.16 2024-09-12T01:01:07.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.16 2024-09-12T01:01:07.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.0 2024-09-12T01:01:07.976 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.982+0000 7f0ba037c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.0 2024-09-12T01:01:07.976 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.986+0000 7f0ba037c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.1 2024-09-12T01:01:07.976 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.986+0000 7f0ba037c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.1 2024-09-12T01:01:07.976 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.986+0000 7f0ba037c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.2 2024-09-12T01:01:07.976 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.986+0000 7f0ba037c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.2 2024-09-12T01:01:07.980 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.990+0000 7f0ba037c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 : hit (requested=0x17, cached=0x17) 2024-09-12T01:01:07.981 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.990+0000 7f0ba037c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 2024-09-12T01:01:07.982 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.994+0000 7f0ba037c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 info.flags=0x17 2024-09-12T01:01:07.982 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.994+0000 7f0ba037c9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 to cache LRU end 2024-09-12T01:01:07.982 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.994+0000 7f0ba037c9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:01:07.982 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.994+0000 7f0ba037c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19, ofs0, ns] 2024-09-12T01:01:07.983 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.994+0000 7f0a80ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431640 cookie 94592425867616 notifier 8222 bl.length()=905 2024-09-12T01:01:07.983 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.994+0000 7f0a80ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 info.flags=0x17 2024-09-12T01:01:07.983 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.994+0000 7f0a80ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 to cache LRU end 2024-09-12T01:01:07.983 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.994+0000 7f0a80ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:01:07.984 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.994+0000 7f0ba037c9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): orig_sources= new_sources= 2024-09-12T01:01:07.984 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.994+0000 7f0ba037c9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): potential sources added=[] removed=[] 2024-09-12T01:01:07.985 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.994+0000 7f0ba037c9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): orig_dests= new_dests= 2024-09-12T01:01:07.985 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.994+0000 7f0ba037c9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): potential dests added=[] removed=[] 2024-09-12T01:01:07.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.998+0000 7f0ba037c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.0 2024-09-12T01:01:07.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.998+0000 7f0ba037c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.0 2024-09-12T01:01:07.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.998+0000 7f0ba037c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.1 2024-09-12T01:01:07.987 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.998+0000 7f0ba037c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.1 2024-09-12T01:01:07.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.998+0000 7f0ba037c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.2 2024-09-12T01:01:07.988 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.998+0000 7f0ba037c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.2.2 2024-09-12T01:01:07.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.998+0000 7f0ba037c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 : hit (requested=0x17, cached=0x17) 2024-09-12T01:01:07.989 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:07.998+0000 7f0ba037c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 2024-09-12T01:01:07.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.002+0000 7f0ba037c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 info.flags=0x17 2024-09-12T01:01:07.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.002+0000 7f0ba037c9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 to cache LRU end 2024-09-12T01:01:07.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.002+0000 7f0ba037c9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:01:07.990 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.002+0000 7f0ba037c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19, ofs0, ns] 2024-09-12T01:01:07.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.002+0000 7f0a80ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431641 cookie 94592425867616 notifier 8222 bl.length()=873 2024-09-12T01:01:07.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.002+0000 7f0a80ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 info.flags=0x17 2024-09-12T01:01:07.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.002+0000 7f0a80ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 to cache LRU end 2024-09-12T01:01:07.991 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.002+0000 7f0a80ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:01:07.992 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.002+0000 7f0ba037c9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): orig_sources= new_sources= 2024-09-12T01:01:07.992 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.002+0000 7f0ba037c9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): potential sources added=[] removed=[] 2024-09-12T01:01:07.992 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.002+0000 7f0ba037c9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): orig_dests= new_dests= 2024-09-12T01:01:07.992 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.002+0000 7f0ba037c9c0 20 handle_bi_update(): bucket=:myver[81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19]): potential dests added=[] removed=[] 2024-09-12T01:01:07.995 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.006+0000 7f0ba037c9c0 1 execute INFO: reshard of bucket "myver" from 3 shards to 17 shards completed successfully 2024-09-12T01:01:07.998 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.010+0000 7f0a4f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:08.003 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.014+0000 7f0ba037c9c0 20 remove_watcher() i=0 2024-09-12T01:01:08.003 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.014+0000 7f0ba037c9c0 2 removed watcher, disabling cache 2024-09-12T01:01:08.005 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.018+0000 7f0ba037c9c0 20 remove_watcher() i=1 2024-09-12T01:01:08.008 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.018+0000 7f0ba037c9c0 20 remove_watcher() i=2 2024-09-12T01:01:08.010 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.022+0000 7f0ba037c9c0 20 remove_watcher() i=3 2024-09-12T01:01:08.012 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.022+0000 7f0ba037c9c0 20 remove_watcher() i=4 2024-09-12T01:01:08.013 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.022+0000 7f0ba037c9c0 20 remove_watcher() i=5 2024-09-12T01:01:08.014 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.026+0000 7f0ba037c9c0 20 remove_watcher() i=6 2024-09-12T01:01:08.015 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.026+0000 7f0ba037c9c0 20 remove_watcher() i=7 2024-09-12T01:01:08.030 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T01:01:08.067 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:01:08.067 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:01:08.107 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.118+0000 7fc7f097c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.109 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.118+0000 7fc7f097c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:08.109 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.118+0000 7fc7f097c9c0 20 realm 2024-09-12T01:01:08.109 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.118+0000 7fc7f097c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.109 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.118+0000 7fc7f097c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:08.109 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.118+0000 7fc7f097c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:01:08.109 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.118+0000 7fc7f097c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.109 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.118+0000 7fc7f097c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:08.109 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.118+0000 7fc7f097c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.111 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.122+0000 7fc7f097c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:08.111 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.122+0000 7fc7f097c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.111 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.122+0000 7fc7f097c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:01:08.111 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.122+0000 7fc7f097c9c0 20 searching for the correct realm 2024-09-12T01:01:08.117 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.130+0000 7fc7edc81640 0 -- 172.21.15.70:0/2074780061 >> [v2:172.21.15.70:6816/1979013808,v1:172.21.15.70:6817/1979013808] conn(0x5612ac43b700 msgr2=0x5612ac43db90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:08.125 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.134+0000 7fc7edc81640 0 -- 172.21.15.70:0/2074780061 >> [v2:172.21.15.70:6816/1979013808,v1:172.21.15.70:6817/1979013808] conn(0x7fc6b8080880 msgr2=0x7fc6b8082cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:08.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.142+0000 7fc7f097c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:01:08.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.142+0000 7fc7f097c9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:01:08.130 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.142+0000 7fc7f097c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:01:08.131 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.142+0000 7fc7f097c9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:01:08.131 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.142+0000 7fc7f097c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:01:08.131 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.142+0000 7fc7f097c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:01:08.131 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.142+0000 7fc7f097c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.131 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.142+0000 7fc7f097c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:08.131 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.142+0000 7fc7f097c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.142+0000 7fc7f097c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:08.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.142+0000 7fc7f097c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.142+0000 7fc7f097c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:01:08.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.142+0000 7fc7f097c9c0 20 zone default found 2024-09-12T01:01:08.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.142+0000 7fc7f097c9c0 4 Realm: () 2024-09-12T01:01:08.132 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.142+0000 7fc7f097c9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:01:08.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.142+0000 7fc7f097c9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:01:08.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.142+0000 7fc7f097c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:01:08.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.142+0000 7fc7f097c9c0 20 zonegroup default 2024-09-12T01:01:08.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.142+0000 7fc7f097c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.142+0000 7fc7f097c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:08.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.142+0000 7fc7f097c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.142+0000 7fc7f097c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:08.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.142+0000 7fc7f097c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.142+0000 7fc7f097c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:08.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.142+0000 7fc7f097c9c0 20 started sync module instance, tier type = 2024-09-12T01:01:08.133 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.142+0000 7fc7f097c9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:01:08.150 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.162+0000 7fc7f097c9c0 20 add_watcher() i=0 2024-09-12T01:01:08.150 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.162+0000 7fc7f097c9c0 20 add_watcher() i=1 2024-09-12T01:01:08.150 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.162+0000 7fc7f097c9c0 20 add_watcher() i=2 2024-09-12T01:01:08.150 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.162+0000 7fc7f097c9c0 20 add_watcher() i=3 2024-09-12T01:01:08.150 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.162+0000 7fc7f097c9c0 20 add_watcher() i=4 2024-09-12T01:01:08.150 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.162+0000 7fc7f097c9c0 20 add_watcher() i=5 2024-09-12T01:01:08.150 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.162+0000 7fc7f097c9c0 20 add_watcher() i=6 2024-09-12T01:01:08.150 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.162+0000 7fc7f097c9c0 20 add_watcher() i=7 2024-09-12T01:01:08.151 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.162+0000 7fc7f097c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:01:08.153 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.162+0000 7fc6a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:08.154 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc7f097c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:01:08.154 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc7f097c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:01:08.154 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc7f097c9c0 5 note: GC not initialized 2024-09-12T01:01:08.154 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc61f7fe640 20 reqs_thread_entry: start 2024-09-12T01:01:08.154 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc7f097c9c0 20 init_complete bucket index max shards: 1 2024-09-12T01:01:08.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc7f097c9c0 20 Filter name: none 2024-09-12T01:01:08.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc61d7fa640 20 reqs_thread_entry: start 2024-09-12T01:01:08.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc7f097c9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T01:01:08.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc7f097c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc7f097c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T01:01:08.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc7f097c9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T01:01:08.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc7f097c9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T01:01:08.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc7f097c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 : miss 2024-09-12T01:01:08.155 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc7f097c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.156 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc7f097c9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T01:01:08.156 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc7f097c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 info.flags=0x17 2024-09-12T01:01:08.156 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc7f097c9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 to cache LRU end 2024-09-12T01:01:08.156 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc7f097c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:01:08.156 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc7f097c9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T01:01:08.156 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc7f097c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19 2024-09-12T01:01:08.156 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc7f097c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.0 2024-09-12T01:01:08.156 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.0 2024-09-12T01:01:08.157 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc7f097c9c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T01:01:08.157 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc7f097c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.1 2024-09-12T01:01:08.157 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.1 2024-09-12T01:01:08.157 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc7f097c9c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T01:01:08.157 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc7f097c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.2 2024-09-12T01:01:08.157 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.166+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.2 2024-09-12T01:01:08.158 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.170+0000 7fc7f097c9c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T01:01:08.158 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.170+0000 7fc7f097c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.3 2024-09-12T01:01:08.158 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.170+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.3 2024-09-12T01:01:08.159 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.170+0000 7fc7f097c9c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T01:01:08.159 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.170+0000 7fc7f097c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.4 2024-09-12T01:01:08.159 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.170+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.4 2024-09-12T01:01:08.160 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.170+0000 7fc7f097c9c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T01:01:08.161 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.170+0000 7fc7f097c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.5 2024-09-12T01:01:08.161 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.170+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.5 2024-09-12T01:01:08.161 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.170+0000 7fc7f097c9c0 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-12T01:01:08.161 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.170+0000 7fc7f097c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.6 2024-09-12T01:01:08.161 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.170+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.6 2024-09-12T01:01:08.162 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.174+0000 7fc7f097c9c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T01:01:08.162 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.174+0000 7fc7f097c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.7 2024-09-12T01:01:08.162 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.174+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.7 2024-09-12T01:01:08.163 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.174+0000 7fc7f097c9c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T01:01:08.163 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.174+0000 7fc7f097c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.8 2024-09-12T01:01:08.163 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.174+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.8 2024-09-12T01:01:08.163 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.174+0000 7fc7f097c9c0 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-12T01:01:08.163 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.174+0000 7fc7f097c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.9 2024-09-12T01:01:08.164 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.174+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.9 2024-09-12T01:01:08.164 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.174+0000 7fc7f097c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.10 2024-09-12T01:01:08.164 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.174+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.10 2024-09-12T01:01:08.165 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.174+0000 7fc7f097c9c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T01:01:08.165 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.174+0000 7fc7f097c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.11 2024-09-12T01:01:08.165 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.174+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.11 2024-09-12T01:01:08.165 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.178+0000 7fc7f097c9c0 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-12T01:01:08.165 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.178+0000 7fc7f097c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.12 2024-09-12T01:01:08.165 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.178+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.12 2024-09-12T01:01:08.166 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.178+0000 7fc7f097c9c0 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-12T01:01:08.166 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.178+0000 7fc7f097c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.13 2024-09-12T01:01:08.166 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.178+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.13 2024-09-12T01:01:08.166 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.178+0000 7fc7f097c9c0 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-12T01:01:08.167 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.178+0000 7fc7f097c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.14 2024-09-12T01:01:08.167 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.178+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.14 2024-09-12T01:01:08.167 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.178+0000 7fc7f097c9c0 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-12T01:01:08.168 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.178+0000 7fc7f097c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.15 2024-09-12T01:01:08.168 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.178+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.15 2024-09-12T01:01:08.169 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.178+0000 7fc7f097c9c0 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-12T01:01:08.169 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.178+0000 7fc7f097c9c0 10 bucket_obj is .dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.16 2024-09-12T01:01:08.169 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.178+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.16 2024-09-12T01:01:08.170 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.182+0000 7fc7f097c9c0 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-12T01:01:08.170 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.182+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.9 2024-09-12T01:01:08.171 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.182+0000 7fc7f097c9c0 20 get_obj_state: octx=0x5612ac1ce740 obj=myver:x state=0x5612ac479e38 s->prefetch_data=0 2024-09-12T01:01:08.172 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.182+0000 7fc7f097c9c0 20 get_obj_state: setting s->obj_tag to 6qlyijw4oo005wxq0uftnzizcl6i474q 2024-09-12T01:01:08.172 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.182+0000 7fc7f097c9c0 20 get_obj_state_impl: setting s->olh_tag to v92ycdt9ucvacysoxx7zw8j9xa4oh3tr 2024-09-12T01:01:08.172 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.182+0000 7fc7f097c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=v92ycdt9ucvacysoxx7zw8j9xa4oh3tr 2024-09-12T01:01:08.174 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.186+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.9 2024-09-12T01:01:08.177 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.190+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.9 2024-09-12T01:01:08.178 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.190+0000 7fc7f097c9c0 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-12T01:01:08.178 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.190+0000 7fc7f097c9c0 20 olh_log_entry: epoch=2 op=3 key=x[NFe6ljKHQNgnXL7dic1USEA6B.hiZGz] 2024-09-12T01:01:08.178 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.190+0000 7fc7f097c9c0 20 get_obj_state: octx=0x5612ac1ce740 obj=myver:_:NFe6ljKHQNgnXL7dic1USEA6B.hiZGz_x state=0x5612ac478f98 s->prefetch_data=0 2024-09-12T01:01:08.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.190+0000 7fc7f097c9c0 10 manifest: total_size = 11 2024-09-12T01:01:08.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.190+0000 7fc7f097c9c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.558111833311435783 2024-09-12T01:01:08.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.190+0000 7fc7f097c9c0 20 get_obj_state: octx=0x5612ac1ce740 obj=myver:_:NFe6ljKHQNgnXL7dic1USEA6B.hiZGz_x state=0x5612ac478f98 s->prefetch_data=0 2024-09-12T01:01:08.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.190+0000 7fc7f097c9c0 20 prepare_atomic_modification: state is not atomic. state=0x5612ac478f98 2024-09-12T01:01:08.179 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.190+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.9 2024-09-12T01:01:08.184 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.194+0000 7fc7f097c9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T01:01:08.184 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.194+0000 7fc7f097c9c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T01:01:08.184 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.194+0000 7fc7f097c9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T01:01:08.184 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.194+0000 7fc7f097c9c0 5 delete_objs_inline: removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19__shadow:NFe6ljKHQNgnXL7dic1USEA6B.hiZGz_.YT1sWO5Ka5zJnTfCuorWu7W0fF2HHVW_0 2024-09-12T01:01:08.187 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.198+0000 7fc6d1ffb640 20 handle_completion(): completion ok for obj=x[NFe6ljKHQNgnXL7dic1USEA6B.hiZGz] 2024-09-12T01:01:08.187 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.198+0000 7fc7f097c9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T01:01:08.189 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.202+0000 7fc7f097c9c0 20 get_obj_state: octx=0x5612ac1ce740 obj=myver:x state=0x5612ac479e38 s->prefetch_data=0 2024-09-12T01:01:08.189 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.202+0000 7fc7f097c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=v92ycdt9ucvacysoxx7zw8j9xa4oh3tr 2024-09-12T01:01:08.193 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.202+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.9 2024-09-12T01:01:08.196 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.206+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.9 2024-09-12T01:01:08.197 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.206+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.9 2024-09-12T01:01:08.198 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.210+0000 7fc7f097c9c0 20 get_obj_state: octx=0x5612ac1ce740 obj=myver:y state=0x5612ac479e38 s->prefetch_data=0 2024-09-12T01:01:08.199 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.210+0000 7fc7f097c9c0 20 get_obj_state: setting s->obj_tag to aridfygoozuq8m87d52pfj0e6f5gfcxd 2024-09-12T01:01:08.199 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.210+0000 7fc7f097c9c0 20 get_obj_state_impl: setting s->olh_tag to rt6raq7m8ieik9o89kozsloq8o1z51bx 2024-09-12T01:01:08.199 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.210+0000 7fc7f097c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rt6raq7m8ieik9o89kozsloq8o1z51bx 2024-09-12T01:01:08.202 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.214+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.9 2024-09-12T01:01:08.205 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.218+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.9 2024-09-12T01:01:08.206 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.218+0000 7fc7f097c9c0 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-12T01:01:08.206 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.218+0000 7fc7f097c9c0 20 olh_log_entry: epoch=2 op=3 key=y[GnfrF895UyphcpeOuzLx6xRB9fgCsS8] 2024-09-12T01:01:08.206 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.218+0000 7fc7f097c9c0 20 get_obj_state: octx=0x5612ac1ce740 obj=myver:_:GnfrF895UyphcpeOuzLx6xRB9fgCsS8_y state=0x5612ac476db8 s->prefetch_data=0 2024-09-12T01:01:08.207 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.218+0000 7fc7f097c9c0 10 manifest: total_size = 22 2024-09-12T01:01:08.207 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.218+0000 7fc7f097c9c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5941296265145754826 2024-09-12T01:01:08.207 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.218+0000 7fc7f097c9c0 20 get_obj_state: octx=0x5612ac1ce740 obj=myver:_:GnfrF895UyphcpeOuzLx6xRB9fgCsS8_y state=0x5612ac476db8 s->prefetch_data=0 2024-09-12T01:01:08.207 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.218+0000 7fc7f097c9c0 20 prepare_atomic_modification: state is not atomic. state=0x5612ac476db8 2024-09-12T01:01:08.207 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.218+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.9 2024-09-12T01:01:08.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.222+0000 7fc7f097c9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T01:01:08.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.222+0000 7fc7f097c9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T01:01:08.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.222+0000 7fc7f097c9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T01:01:08.213 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.222+0000 7fc7f097c9c0 5 delete_objs_inline: removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19__shadow:GnfrF895UyphcpeOuzLx6xRB9fgCsS8_.g6yd3WKmNg1wZGMsBPof2fzxKDfA1BH_0 2024-09-12T01:01:08.214 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.226+0000 7fc7f097c9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T01:01:08.216 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.226+0000 7fc6d1ffb640 20 handle_completion(): completion ok for obj=y[GnfrF895UyphcpeOuzLx6xRB9fgCsS8] 2024-09-12T01:01:08.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.226+0000 7fc7f097c9c0 20 get_obj_state: octx=0x5612ac1ce740 obj=myver:y state=0x5612ac479e38 s->prefetch_data=0 2024-09-12T01:01:08.217 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.230+0000 7fc7f097c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rt6raq7m8ieik9o89kozsloq8o1z51bx 2024-09-12T01:01:08.223 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.234+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.9 2024-09-12T01:01:08.226 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.238+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.9 2024-09-12T01:01:08.227 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.238+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.9 2024-09-12T01:01:08.228 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.238+0000 7fc7f097c9c0 20 get_obj_state: octx=0x5612ac1ce740 obj=myver:z state=0x5612ac479e38 s->prefetch_data=0 2024-09-12T01:01:08.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.238+0000 7fc7f097c9c0 20 get_obj_state: setting s->obj_tag to d26xbp7f9k7106qhmckg6eas6sos1rdu 2024-09-12T01:01:08.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.238+0000 7fc7f097c9c0 20 get_obj_state_impl: setting s->olh_tag to uig5kvquub70rc524lt1rc340je3cgbv 2024-09-12T01:01:08.229 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.238+0000 7fc7f097c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=uig5kvquub70rc524lt1rc340je3cgbv 2024-09-12T01:01:08.230 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.242+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.9 2024-09-12T01:01:08.233 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.246+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.9 2024-09-12T01:01:08.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.246+0000 7fc7f097c9c0 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-12T01:01:08.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.246+0000 7fc7f097c9c0 20 olh_log_entry: epoch=2 op=3 key=z[LB7OwHJ-hfKNsVtwneA3YPaFQ1mtKQ7] 2024-09-12T01:01:08.234 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.246+0000 7fc7f097c9c0 20 get_obj_state: octx=0x5612ac1ce740 obj=myver:_:LB7OwHJ-hfKNsVtwneA3YPaFQ1mtKQ7_z state=0x5612ac476db8 s->prefetch_data=0 2024-09-12T01:01:08.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.246+0000 7fc7f097c9c0 10 manifest: total_size = 22 2024-09-12T01:01:08.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.246+0000 7fc7f097c9c0 20 get_obj_state: setting s->obj_tag to 81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5268496500114704605 2024-09-12T01:01:08.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.246+0000 7fc7f097c9c0 20 get_obj_state: octx=0x5612ac1ce740 obj=myver:_:LB7OwHJ-hfKNsVtwneA3YPaFQ1mtKQ7_z state=0x5612ac476db8 s->prefetch_data=0 2024-09-12T01:01:08.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.246+0000 7fc7f097c9c0 20 prepare_atomic_modification: state is not atomic. state=0x5612ac476db8 2024-09-12T01:01:08.235 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.246+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.9 2024-09-12T01:01:08.240 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.250+0000 7fc7f097c9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T01:01:08.241 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.250+0000 7fc7f097c9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T01:01:08.241 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.250+0000 7fc7f097c9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T01:01:08.241 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.250+0000 7fc7f097c9c0 5 delete_objs_inline: removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19__shadow:LB7OwHJ-hfKNsVtwneA3YPaFQ1mtKQ7_.9d0Pa93xfr06y5Km218_nt_e7YqDfDh_0 2024-09-12T01:01:08.244 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.254+0000 7fc6d17fa640 20 handle_completion(): completion ok for obj=z[LB7OwHJ-hfKNsVtwneA3YPaFQ1mtKQ7] 2024-09-12T01:01:08.244 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.254+0000 7fc7f097c9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T01:01:08.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.258+0000 7fc7f097c9c0 20 get_obj_state: octx=0x5612ac1ce740 obj=myver:z state=0x5612ac479e38 s->prefetch_data=0 2024-09-12T01:01:08.246 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.258+0000 7fc7f097c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=uig5kvquub70rc524lt1rc340je3cgbv 2024-09-12T01:01:08.251 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.262+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.9 2024-09-12T01:01:08.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.266+0000 7fc7f097c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19.3.9 2024-09-12T01:01:08.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.266+0000 7fc7f097c9c0 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-12T01:01:08.255 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.266+0000 7fc7f097c9c0 1 NOTICE: finished all shards (3 entries removed) 2024-09-12T01:01:08.257 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.266+0000 7fc6a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:08.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.274+0000 7fc7f097c9c0 20 remove_watcher() i=0 2024-09-12T01:01:08.262 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.274+0000 7fc7f097c9c0 2 removed watcher, disabling cache 2024-09-12T01:01:08.265 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.274+0000 7fc7f097c9c0 20 remove_watcher() i=1 2024-09-12T01:01:08.270 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.282+0000 7fc7f097c9c0 20 remove_watcher() i=2 2024-09-12T01:01:08.273 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.282+0000 7fc7f097c9c0 20 remove_watcher() i=3 2024-09-12T01:01:08.275 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.286+0000 7fc7f097c9c0 20 remove_watcher() i=4 2024-09-12T01:01:08.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.290+0000 7fc7f097c9c0 20 remove_watcher() i=5 2024-09-12T01:01:08.283 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.294+0000 7fc7f097c9c0 20 remove_watcher() i=6 2024-09-12T01:01:08.285 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.298+0000 7fc7f097c9c0 20 remove_watcher() i=7 2024-09-12T01:01:08.305 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:01:08.305 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:01:08.314 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:01:08.314 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:01:08.361 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T01:01:08.393 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:01:08.394 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:01:08.435 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.446+0000 7f136ab879c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.437 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.446+0000 7f136ab879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:08.437 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.446+0000 7f136ab879c0 20 realm 2024-09-12T01:01:08.437 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.446+0000 7f136ab879c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.437 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.446+0000 7f136ab879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:08.438 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.446+0000 7f136ab879c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:01:08.438 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.446+0000 7f136ab879c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.438 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.450+0000 7f136ab879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:08.438 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.450+0000 7f136ab879c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.440 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.450+0000 7f136ab879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:08.440 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.450+0000 7f136ab879c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.454+0000 7f136ab879c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:01:08.442 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.454+0000 7f136ab879c0 20 searching for the correct realm 2024-09-12T01:01:08.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.458+0000 7f1368e8e640 0 -- 172.21.15.70:0/2236197525 >> [v2:172.21.15.70:6816/1979013808,v1:172.21.15.70:6817/1979013808] conn(0x55ae0837f500 msgr2=0x55ae083818f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:08.455 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.466+0000 7f1367e8c640 0 -- 172.21.15.70:0/2236197525 >> [v2:172.21.15.70:6824/2477739226,v1:172.21.15.70:6825/2477739226] conn(0x55ae08386fa0 msgr2=0x55ae08389390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:08.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.474+0000 7f136ab879c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:01:08.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.474+0000 7f136ab879c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:01:08.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.474+0000 7f136ab879c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:01:08.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.474+0000 7f136ab879c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:01:08.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.474+0000 7f136ab879c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:01:08.463 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.474+0000 7f136ab879c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:01:08.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.474+0000 7f136ab879c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.474+0000 7f136ab879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:08.464 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.474+0000 7f136ab879c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.474+0000 7f136ab879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:08.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.474+0000 7f136ab879c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.474+0000 7f136ab879c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:01:08.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.474+0000 7f136ab879c0 20 zone default found 2024-09-12T01:01:08.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.474+0000 7f136ab879c0 4 Realm: () 2024-09-12T01:01:08.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.474+0000 7f136ab879c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:01:08.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.474+0000 7f136ab879c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:01:08.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.474+0000 7f136ab879c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:01:08.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.474+0000 7f136ab879c0 20 zonegroup default 2024-09-12T01:01:08.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.474+0000 7f136ab879c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.474+0000 7f136ab879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:08.465 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.474+0000 7f136ab879c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.478+0000 7f136ab879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:08.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.478+0000 7f136ab879c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.478+0000 7f136ab879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:08.466 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.478+0000 7f136ab879c0 20 started sync module instance, tier type = 2024-09-12T01:01:08.467 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.478+0000 7f136ab879c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:01:08.481 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.494+0000 7f136ab879c0 20 add_watcher() i=0 2024-09-12T01:01:08.482 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.494+0000 7f136ab879c0 20 add_watcher() i=1 2024-09-12T01:01:08.482 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.494+0000 7f136ab879c0 20 add_watcher() i=2 2024-09-12T01:01:08.482 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.494+0000 7f136ab879c0 20 add_watcher() i=3 2024-09-12T01:01:08.482 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.494+0000 7f136ab879c0 20 add_watcher() i=4 2024-09-12T01:01:08.482 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.494+0000 7f136ab879c0 20 add_watcher() i=5 2024-09-12T01:01:08.482 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.494+0000 7f136ab879c0 20 add_watcher() i=6 2024-09-12T01:01:08.482 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.494+0000 7f136ab879c0 20 add_watcher() i=7 2024-09-12T01:01:08.483 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.494+0000 7f136ab879c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:01:08.485 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.494+0000 7f121efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:08.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.498+0000 7f136ab879c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:01:08.486 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.498+0000 7f136ab879c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:01:08.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.498+0000 7f136ab879c0 5 note: GC not initialized 2024-09-12T01:01:08.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.498+0000 7f121dfdb640 20 reqs_thread_entry: start 2024-09-12T01:01:08.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.498+0000 7f136ab879c0 20 init_complete bucket index max shards: 1 2024-09-12T01:01:08.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.498+0000 7f136ab879c0 20 Filter name: none 2024-09-12T01:01:08.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.498+0000 7f118f7fe640 20 reqs_thread_entry: start 2024-09-12T01:01:08.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.498+0000 7f136ab879c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.498+0000 7f136ab879c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T01:01:08.487 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.498+0000 7f136ab879c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.498+0000 7f136ab879c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T01:01:08.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.498+0000 7f136ab879c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:01:08.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.498+0000 7f136ab879c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.498+0000 7f136ab879c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T01:01:08.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.498+0000 7f136ab879c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:08.488 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.498+0000 7f136ab879c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T01:01:08.489 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.498+0000 7f136ab879c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:01:08.490 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.502+0000 7f121efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:08.496 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.506+0000 7f136ab879c0 20 remove_watcher() i=0 2024-09-12T01:01:08.496 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.506+0000 7f136ab879c0 2 removed watcher, disabling cache 2024-09-12T01:01:08.497 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.510+0000 7f136ab879c0 20 remove_watcher() i=1 2024-09-12T01:01:08.499 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.510+0000 7f136ab879c0 20 remove_watcher() i=2 2024-09-12T01:01:08.504 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.514+0000 7f136ab879c0 20 remove_watcher() i=3 2024-09-12T01:01:08.506 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.518+0000 7f136ab879c0 20 remove_watcher() i=4 2024-09-12T01:01:08.508 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.518+0000 7f136ab879c0 20 remove_watcher() i=5 2024-09-12T01:01:08.509 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.522+0000 7f136ab879c0 20 remove_watcher() i=6 2024-09-12T01:01:08.511 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:01:08.522+0000 7f136ab879c0 20 remove_watcher() i=7 2024-09-12T01:01:08.524 INFO:tasks.workunit.client.0.smithi070.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T01:01:08.524 INFO:tasks.workunit.client.0.smithi070.stderr:Deleting bucket a-bucket 2024-09-12T01:01:08.525 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:01:08.525 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:01:08.529 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:01:08.529 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:01:08.548 INFO:tasks.workunit.client.0.smithi070.stderr:Deleting bucket myver 2024-09-12T01:01:08.549 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:01:08.549 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:01:08.595 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:01:08.596 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:01:08.690 INFO:tasks.workunit.client.0.smithi070.stderr:Completed resharding tests 2024-09-12T01:01:08.690 INFO:tasks.workunit.client.0.smithi070.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T01:01:08.690 INFO:tasks.workunit.client.0.smithi070.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T01:01:08.690 INFO:tasks.workunit.client.0.smithi070.stdout:connected to https://localhost:443 2024-09-12T01:01:08.804 INFO:tasks.workunit.client.0.smithi070.stderr:+ deactivate 2024-09-12T01:01:08.804 INFO:tasks.workunit.client.0.smithi070.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T01:01:08.804 INFO:tasks.workunit.client.0.smithi070.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T01:01:08.804 INFO:tasks.workunit.client.0.smithi070.stderr:+ export PATH 2024-09-12T01:01:08.805 INFO:tasks.workunit.client.0.smithi070.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T01:01:08.805 INFO:tasks.workunit.client.0.smithi070.stderr:+ '[' -n '' ']' 2024-09-12T01:01:08.805 INFO:tasks.workunit.client.0.smithi070.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:01:08.805 INFO:tasks.workunit.client.0.smithi070.stderr:+ hash -r 2024-09-12T01:01:08.805 INFO:tasks.workunit.client.0.smithi070.stderr:+ '[' -n '' ']' 2024-09-12T01:01:08.805 INFO:tasks.workunit.client.0.smithi070.stderr:+ unset VIRTUAL_ENV 2024-09-12T01:01:08.805 INFO:tasks.workunit.client.0.smithi070.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T01:01:08.805 INFO:tasks.workunit.client.0.smithi070.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T01:01:08.805 INFO:tasks.workunit.client.0.smithi070.stderr:+ unset -f deactivate 2024-09-12T01:01:08.805 INFO:tasks.workunit.client.0.smithi070.stderr:+ echo OK. 2024-09-12T01:01:08.806 INFO:tasks.workunit.client.0.smithi070.stdout:OK. 2024-09-12T01:01:08.806 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T01:01:08.807 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T01:01:08.862 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-12T01:01:08.863 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T01:01:09.312 DEBUG:teuthology.parallel:result is None 2024-09-12T01:01:09.313 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:01:09.323 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:01:09.323 DEBUG:teuthology.orchestra.run.smithi070:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:01:09.374 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:01:09.374 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-12T01:01:09.389 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-12T01:01:09.389 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-12T01:01:09.389 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-12T01:01:09.389 DEBUG:teuthology.orchestra.run.smithi070:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-12T01:01:09.421 INFO:teuthology.orchestra.run.smithi070.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-12T01:01:13.928 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-12T01:01:13.928 DEBUG:teuthology.orchestra.run.smithi070:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-12T01:01:14.019 INFO:teuthology.orchestra.run.smithi070.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required DEB packages. Installing via sudo. 2024-09-12T01:01:14.080 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-12T01:01:14.295 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2024-09-12T01:01:14.296 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2024-09-12T01:01:14.500 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T01:01:14.500 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T01:01:14.500 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T01:01:14.501 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T01:01:14.501 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T01:01:14.501 INFO:teuthology.orchestra.run.smithi070.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T01:01:14.501 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T01:01:14.501 INFO:teuthology.orchestra.run.smithi070.stdout:The following additional packages will be installed: 2024-09-12T01:01:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-12T01:01:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-12T01:01:14.503 INFO:teuthology.orchestra.run.smithi070.stdout:Suggested packages: 2024-09-12T01:01:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: gvfs openjdk-8-demo openjdk-8-source visualvm libnss-mdns fonts-nanum 2024-09-12T01:01:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: fonts-ipafont-gothic fonts-ipafont-mincho fonts-wqy-microhei 2024-09-12T01:01:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: fonts-wqy-zenhei fonts-indic 2024-09-12T01:01:14.540 INFO:teuthology.orchestra.run.smithi070.stdout:The following NEW packages will be installed: 2024-09-12T01:01:14.541 INFO:teuthology.orchestra.run.smithi070.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-12T01:01:14.541 INFO:teuthology.orchestra.run.smithi070.stdout: openjdk-8-jdk openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-12T01:01:14.722 INFO:teuthology.orchestra.run.smithi070.stdout:0 upgraded, 9 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T01:01:14.723 INFO:teuthology.orchestra.run.smithi070.stdout:Need to get 46.0 MB of archives. 2024-09-12T01:01:14.723 INFO:teuthology.orchestra.run.smithi070.stdout:After this operation, 155 MB of additional disk space will be used. 2024-09-12T01:01:14.723 INFO:teuthology.orchestra.run.smithi070.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-common all 2.24.33-2ubuntu2.1 [125 kB] 2024-09-12T01:01:15.086 INFO:teuthology.orchestra.run.smithi070.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-0 amd64 2.24.33-2ubuntu2.1 [2,038 kB] 2024-09-12T01:01:15.442 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail18 amd64 2.24.33-2ubuntu2.1 [15.9 kB] 2024-09-12T01:01:15.443 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail-common amd64 2.24.33-2ubuntu2.1 [132 kB] 2024-09-12T01:01:15.449 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-bin amd64 2.24.33-2ubuntu2.1 [7,936 B] 2024-09-12T01:01:15.450 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre-headless amd64 8u422-b05-1~22.04 [30.8 MB] 2024-09-12T01:01:16.531 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre amd64 8u422-b05-1~22.04 [75.5 kB] 2024-09-12T01:01:16.533 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk-headless amd64 8u422-b05-1~22.04 [8,843 kB] 2024-09-12T01:01:16.765 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk amd64 8u422-b05-1~22.04 [4,012 kB] 2024-09-12T01:01:17.186 INFO:teuthology.orchestra.run.smithi070.stderr:debconf: unable to initialize frontend: Dialog 2024-09-12T01:01:17.186 INFO:teuthology.orchestra.run.smithi070.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-09-12T01:01:17.186 INFO:teuthology.orchestra.run.smithi070.stderr:debconf: falling back to frontend: Readline 2024-09-12T01:01:17.202 INFO:teuthology.orchestra.run.smithi070.stderr:debconf: unable to initialize frontend: Readline 2024-09-12T01:01:17.203 INFO:teuthology.orchestra.run.smithi070.stderr:debconf: (This frontend requires a controlling tty.) 2024-09-12T01:01:17.203 INFO:teuthology.orchestra.run.smithi070.stderr:debconf: falling back to frontend: Teletype 2024-09-12T01:01:17.206 INFO:teuthology.orchestra.run.smithi070.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-09-12T01:01:17.240 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 46.0 MB in 2s (19.7 MB/s) 2024-09-12T01:01:17.351 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libgtk2.0-common. 2024-09-12T01:01:17.415 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 177243 files and directories currently installed.) 2024-09-12T01:01:17.420 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../0-libgtk2.0-common_2.24.33-2ubuntu2.1_all.deb ... 2024-09-12T01:01:17.467 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-12T01:01:17.887 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libgtk2.0-0:amd64. 2024-09-12T01:01:17.915 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../1-libgtk2.0-0_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T01:01:17.995 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T01:01:18.433 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libgail18:amd64. 2024-09-12T01:01:18.461 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../2-libgail18_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T01:01:18.491 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T01:01:18.727 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libgail-common:amd64. 2024-09-12T01:01:18.755 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../3-libgail-common_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T01:01:18.793 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T01:01:19.054 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libgtk2.0-bin. 2024-09-12T01:01:19.071 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../4-libgtk2.0-bin_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T01:01:19.112 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-12T01:01:19.524 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package openjdk-8-jre-headless:amd64. 2024-09-12T01:01:19.554 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../5-openjdk-8-jre-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T01:01:19.603 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T01:01:21.221 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package openjdk-8-jre:amd64. 2024-09-12T01:01:21.249 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../6-openjdk-8-jre_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T01:01:21.291 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-12T01:01:21.777 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package openjdk-8-jdk-headless:amd64. 2024-09-12T01:01:21.805 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../7-openjdk-8-jdk-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T01:01:21.846 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T01:01:22.621 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package openjdk-8-jdk:amd64. 2024-09-12T01:01:22.650 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../8-openjdk-8-jdk_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T01:01:22.691 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-12T01:01:23.042 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T01:01:24.148 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/orbd to provide /usr/bin/orbd (orbd) in auto mode 2024-09-12T01:01:24.174 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/servertool to provide /usr/bin/servertool (servertool) in auto mode 2024-09-12T01:01:24.199 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/tnameserv to provide /usr/bin/tnameserv (tnameserv) in auto mode 2024-09-12T01:01:24.573 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-12T01:01:24.741 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T01:01:25.101 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-12T01:01:25.192 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/policytool to provide /usr/bin/policytool (policytool) in auto mode 2024-09-12T01:01:25.261 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T01:01:25.352 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/clhsdb to provide /usr/bin/clhsdb (clhsdb) in auto mode 2024-09-12T01:01:25.407 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/extcheck to provide /usr/bin/extcheck (extcheck) in auto mode 2024-09-12T01:01:25.432 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/hsdb to provide /usr/bin/hsdb (hsdb) in auto mode 2024-09-12T01:01:25.459 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/idlj to provide /usr/bin/idlj (idlj) in auto mode 2024-09-12T01:01:25.585 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/javah to provide /usr/bin/javah (javah) in auto mode 2024-09-12T01:01:25.720 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jhat to provide /usr/bin/jhat (jhat) in auto mode 2024-09-12T01:01:25.847 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jsadebugd to provide /usr/bin/jsadebugd (jsadebugd) in auto mode 2024-09-12T01:01:25.940 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/native2ascii to provide /usr/bin/native2ascii (native2ascii) in auto mode 2024-09-12T01:01:25.983 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/schemagen to provide /usr/bin/schemagen (schemagen) in auto mode 2024-09-12T01:01:26.035 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsgen to provide /usr/bin/wsgen (wsgen) in auto mode 2024-09-12T01:01:26.059 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsimport to provide /usr/bin/wsimport (wsimport) in auto mode 2024-09-12T01:01:26.087 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/xjc to provide /usr/bin/xjc (xjc) in auto mode 2024-09-12T01:01:26.158 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T01:01:26.293 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-12T01:01:26.419 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-12T01:01:26.511 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/appletviewer to provide /usr/bin/appletviewer (appletviewer) in auto mode 2024-09-12T01:01:26.604 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T01:01:26.731 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T01:01:27.757 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T01:01:27.857 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-12T01:01:28.143 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T01:01:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: Gradle will be installed under /opt/gradle 2024-09-12T01:01:28.656 INFO:teuthology.orchestra.run.smithi070.stderr:--2024-09-12 01:01:28-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-12T01:01:28.659 INFO:teuthology.orchestra.run.smithi070.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4965, ... 2024-09-12T01:01:28.667 INFO:teuthology.orchestra.run.smithi070.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-09-12T01:01:28.702 INFO:teuthology.orchestra.run.smithi070.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-12T01:01:28.702 INFO:teuthology.orchestra.run.smithi070.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-12T01:01:28.702 INFO:teuthology.orchestra.run.smithi070.stderr:--2024-09-12 01:01:28-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-12T01:01:28.703 INFO:teuthology.orchestra.run.smithi070.stderr:Resolving github.com (github.com)... 140.82.112.4 2024-09-12T01:01:28.713 INFO:teuthology.orchestra.run.smithi070.stderr:Connecting to github.com (github.com)|140.82.112.4|:443... connected. 2024-09-12T01:01:28.751 INFO:teuthology.orchestra.run.smithi070.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-12T01:01:28.752 INFO:teuthology.orchestra.run.smithi070.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T010020Z&X-Amz-Expires=300&X-Amz-Signature=0f33a0b9e9b27afb2231338eab349d96ebc645fc40d50d02f6a8f0e08512787b&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-12T01:01:28.752 INFO:teuthology.orchestra.run.smithi070.stderr:--2024-09-12 01:01:28-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T010020Z&X-Amz-Expires=300&X-Amz-Signature=0f33a0b9e9b27afb2231338eab349d96ebc645fc40d50d02f6a8f0e08512787b&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-12T01:01:28.755 INFO:teuthology.orchestra.run.smithi070.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.110.133, 185.199.108.133, 185.199.109.133, ... 2024-09-12T01:01:28.767 INFO:teuthology.orchestra.run.smithi070.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.110.133|:443... connected. 2024-09-12T01:01:28.855 INFO:teuthology.orchestra.run.smithi070.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T01:01:28.855 INFO:teuthology.orchestra.run.smithi070.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-12T01:01:28.855 INFO:teuthology.orchestra.run.smithi070.stderr:Saving to: 'gradle-6.0.1-bin.zip' 2024-09-12T01:01:28.855 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-12T01:01:28.867 INFO:teuthology.orchestra.run.smithi070.stderr: 0K .......... .......... .......... .......... .......... 0% 3.97M 23s 2024-09-12T01:01:28.878 INFO:teuthology.orchestra.run.smithi070.stderr: 50K .......... .......... .......... .......... .......... 0% 4.21M 22s 2024-09-12T01:01:28.880 INFO:teuthology.orchestra.run.smithi070.stderr: 100K .......... .......... .......... .......... .......... 0% 24.1M 16s 2024-09-12T01:01:28.883 INFO:teuthology.orchestra.run.smithi070.stderr: 150K .......... .......... .......... .......... .......... 0% 18.5M 13s 2024-09-12T01:01:28.890 INFO:teuthology.orchestra.run.smithi070.stderr: 200K .......... .......... .......... .......... .......... 0% 7.20M 13s 2024-09-12T01:01:28.892 INFO:teuthology.orchestra.run.smithi070.stderr: 250K .......... .......... .......... .......... .......... 0% 36.1M 11s 2024-09-12T01:01:28.893 INFO:teuthology.orchestra.run.smithi070.stderr: 300K .......... .......... .......... .......... .......... 0% 28.7M 10s 2024-09-12T01:01:28.894 INFO:teuthology.orchestra.run.smithi070.stderr: 350K .......... .......... .......... .......... .......... 0% 43.2M 9s 2024-09-12T01:01:28.896 INFO:teuthology.orchestra.run.smithi070.stderr: 400K .......... .......... .......... .......... .......... 0% 27.2M 8s 2024-09-12T01:01:28.902 INFO:teuthology.orchestra.run.smithi070.stderr: 450K .......... .......... .......... .......... .......... 0% 8.84M 9s 2024-09-12T01:01:28.902 INFO:teuthology.orchestra.run.smithi070.stderr: 500K .......... .......... .......... .......... .......... 0% 80.9M 8s 2024-09-12T01:01:28.905 INFO:teuthology.orchestra.run.smithi070.stderr: 550K .......... .......... .......... .......... .......... 0% 50.2M 7s 2024-09-12T01:01:28.905 INFO:teuthology.orchestra.run.smithi070.stderr: 600K .......... .......... .......... .......... .......... 0% 54.3M 7s 2024-09-12T01:01:28.905 INFO:teuthology.orchestra.run.smithi070.stderr: 650K .......... .......... .......... .......... .......... 0% 86.4M 7s 2024-09-12T01:01:28.907 INFO:teuthology.orchestra.run.smithi070.stderr: 700K .......... .......... .......... .......... .......... 0% 50.8M 6s 2024-09-12T01:01:28.907 INFO:teuthology.orchestra.run.smithi070.stderr: 750K .......... .......... .......... .......... .......... 0% 127M 6s 2024-09-12T01:01:28.907 INFO:teuthology.orchestra.run.smithi070.stderr: 800K .......... .......... .......... .......... .......... 0% 64.5M 6s 2024-09-12T01:01:28.908 INFO:teuthology.orchestra.run.smithi070.stderr: 850K .......... .......... .......... .......... .......... 0% 53.5M 5s 2024-09-12T01:01:30.012 INFO:teuthology.orchestra.run.smithi070.stderr: 900K .......... .......... .......... .......... .......... 1% 9.54M 6s 2024-09-12T01:01:30.013 INFO:teuthology.orchestra.run.smithi070.stderr: 950K .......... .......... .......... .......... .......... 1% 148M 5s 2024-09-12T01:01:30.013 INFO:teuthology.orchestra.run.smithi070.stderr: 1000K .......... .......... .......... .......... .......... 1% 137M 5s 2024-09-12T01:01:30.013 INFO:teuthology.orchestra.run.smithi070.stderr: 1050K .......... .......... .......... .......... .......... 1% 147M 5s 2024-09-12T01:01:30.013 INFO:teuthology.orchestra.run.smithi070.stderr: 1100K .......... .......... .......... .......... .......... 1% 53.7M 5s 2024-09-12T01:01:30.013 INFO:teuthology.orchestra.run.smithi070.stderr: 1150K .......... .......... .......... .......... .......... 1% 135M 5s 2024-09-12T01:01:30.013 INFO:teuthology.orchestra.run.smithi070.stderr: 1200K .......... .......... .......... .......... .......... 1% 142M 4s 2024-09-12T01:01:30.013 INFO:teuthology.orchestra.run.smithi070.stderr: 1250K .......... .......... .......... .......... .......... 1% 152M 4s 2024-09-12T01:01:30.013 INFO:teuthology.orchestra.run.smithi070.stderr: 1300K .......... .......... .......... .......... .......... 1% 137M 4s 2024-09-12T01:01:30.013 INFO:teuthology.orchestra.run.smithi070.stderr: 1350K .......... .......... .......... .......... .......... 1% 127M 4s 2024-09-12T01:01:30.013 INFO:teuthology.orchestra.run.smithi070.stderr: 1400K .......... .......... .......... .......... .......... 1% 153M 4s 2024-09-12T01:01:30.013 INFO:teuthology.orchestra.run.smithi070.stderr: 1450K .......... .......... .......... .......... .......... 1% 150M 4s 2024-09-12T01:01:30.013 INFO:teuthology.orchestra.run.smithi070.stderr: 1500K .......... .......... .......... .......... .......... 1% 104M 4s 2024-09-12T01:01:30.014 INFO:teuthology.orchestra.run.smithi070.stderr: 1550K .......... .......... .......... .......... .......... 1% 140M 4s 2024-09-12T01:01:30.014 INFO:teuthology.orchestra.run.smithi070.stderr: 1600K .......... .......... .......... .......... .......... 1% 145M 4s 2024-09-12T01:01:30.014 INFO:teuthology.orchestra.run.smithi070.stderr: 1650K .......... .......... .......... .......... .......... 1% 138M 3s 2024-09-12T01:01:30.014 INFO:teuthology.orchestra.run.smithi070.stderr: 1700K .......... .......... .......... .......... .......... 1% 126M 3s 2024-09-12T01:01:30.014 INFO:teuthology.orchestra.run.smithi070.stderr: 1750K .......... .......... .......... .......... .......... 1% 145M 3s 2024-09-12T01:01:30.014 INFO:teuthology.orchestra.run.smithi070.stderr: 1800K .......... .......... .......... .......... .......... 1% 143M 3s 2024-09-12T01:01:30.014 INFO:teuthology.orchestra.run.smithi070.stderr: 1850K .......... .......... .......... .......... .......... 2% 150M 3s 2024-09-12T01:01:30.014 INFO:teuthology.orchestra.run.smithi070.stderr: 1900K .......... .......... .......... .......... .......... 2% 10.7M 3s 2024-09-12T01:01:30.014 INFO:teuthology.orchestra.run.smithi070.stderr: 1950K .......... .......... .......... .......... .......... 2% 138M 3s 2024-09-12T01:01:30.014 INFO:teuthology.orchestra.run.smithi070.stderr: 2000K .......... .......... .......... .......... .......... 2% 146M 3s 2024-09-12T01:01:30.014 INFO:teuthology.orchestra.run.smithi070.stderr: 2050K .......... .......... .......... .......... .......... 2% 151M 3s 2024-09-12T01:01:30.014 INFO:teuthology.orchestra.run.smithi070.stderr: 2100K .......... .......... .......... .......... .......... 2% 118M 3s 2024-09-12T01:01:30.014 INFO:teuthology.orchestra.run.smithi070.stderr: 2150K .......... .......... .......... .......... .......... 2% 137M 3s 2024-09-12T01:01:30.014 INFO:teuthology.orchestra.run.smithi070.stderr: 2200K .......... .......... .......... .......... .......... 2% 134M 3s 2024-09-12T01:01:30.015 INFO:teuthology.orchestra.run.smithi070.stderr: 2250K .......... .......... .......... .......... .......... 2% 146M 3s 2024-09-12T01:01:30.015 INFO:teuthology.orchestra.run.smithi070.stderr: 2300K .......... .......... .......... .......... .......... 2% 115M 3s 2024-09-12T01:01:30.015 INFO:teuthology.orchestra.run.smithi070.stderr: 2350K .......... .......... .......... .......... .......... 2% 137M 3s 2024-09-12T01:01:30.015 INFO:teuthology.orchestra.run.smithi070.stderr: 2400K .......... .......... .......... .......... .......... 2% 141M 3s 2024-09-12T01:01:30.015 INFO:teuthology.orchestra.run.smithi070.stderr: 2450K .......... .......... .......... .......... .......... 2% 134M 3s 2024-09-12T01:01:30.015 INFO:teuthology.orchestra.run.smithi070.stderr: 2500K .......... .......... .......... .......... .......... 2% 124M 3s 2024-09-12T01:01:30.015 INFO:teuthology.orchestra.run.smithi070.stderr: 2550K .......... .......... .......... .......... .......... 2% 140M 3s 2024-09-12T01:01:30.015 INFO:teuthology.orchestra.run.smithi070.stderr: 2600K .......... .......... .......... .......... .......... 2% 134M 3s 2024-09-12T01:01:30.015 INFO:teuthology.orchestra.run.smithi070.stderr: 2650K .......... .......... .......... .......... .......... 2% 120M 3s 2024-09-12T01:01:30.015 INFO:teuthology.orchestra.run.smithi070.stderr: 2700K .......... .......... .......... .......... .......... 2% 113M 2s 2024-09-12T01:01:30.015 INFO:teuthology.orchestra.run.smithi070.stderr: 2750K .......... .......... .......... .......... .......... 3% 114M 2s 2024-09-12T01:01:30.015 INFO:teuthology.orchestra.run.smithi070.stderr: 2800K .......... .......... .......... .......... .......... 3% 126M 2s 2024-09-12T01:01:30.015 INFO:teuthology.orchestra.run.smithi070.stderr: 2850K .......... .......... .......... .......... .......... 3% 137M 2s 2024-09-12T01:01:30.015 INFO:teuthology.orchestra.run.smithi070.stderr: 2900K .......... .......... .......... .......... .......... 3% 133M 2s 2024-09-12T01:01:30.016 INFO:teuthology.orchestra.run.smithi070.stderr: 2950K .......... .......... .......... .......... .......... 3% 152M 2s 2024-09-12T01:01:30.016 INFO:teuthology.orchestra.run.smithi070.stderr: 3000K .......... .......... .......... .......... .......... 3% 151M 2s 2024-09-12T01:01:30.016 INFO:teuthology.orchestra.run.smithi070.stderr: 3050K .......... .......... .......... .......... .......... 3% 150M 2s 2024-09-12T01:01:30.016 INFO:teuthology.orchestra.run.smithi070.stderr: 3100K .......... .......... .......... .......... .......... 3% 126M 2s 2024-09-12T01:01:30.016 INFO:teuthology.orchestra.run.smithi070.stderr: 3150K .......... .......... .......... .......... .......... 3% 156M 2s 2024-09-12T01:01:30.016 INFO:teuthology.orchestra.run.smithi070.stderr: 3200K .......... .......... .......... .......... .......... 3% 138M 2s 2024-09-12T01:01:30.016 INFO:teuthology.orchestra.run.smithi070.stderr: 3250K .......... .......... .......... .......... .......... 3% 150M 2s 2024-09-12T01:01:30.016 INFO:teuthology.orchestra.run.smithi070.stderr: 3300K .......... .......... .......... .......... .......... 3% 135M 2s 2024-09-12T01:01:30.016 INFO:teuthology.orchestra.run.smithi070.stderr: 3350K .......... .......... .......... .......... .......... 3% 154M 2s 2024-09-12T01:01:30.016 INFO:teuthology.orchestra.run.smithi070.stderr: 3400K .......... .......... .......... .......... .......... 3% 139M 2s 2024-09-12T01:01:30.016 INFO:teuthology.orchestra.run.smithi070.stderr: 3450K .......... .......... .......... .......... .......... 3% 154M 2s 2024-09-12T01:01:30.016 INFO:teuthology.orchestra.run.smithi070.stderr: 3500K .......... .......... .......... .......... .......... 3% 115M 2s 2024-09-12T01:01:30.016 INFO:teuthology.orchestra.run.smithi070.stderr: 3550K .......... .......... .......... .......... .......... 3% 134M 2s 2024-09-12T01:01:30.017 INFO:teuthology.orchestra.run.smithi070.stderr: 3600K .......... .......... .......... .......... .......... 3% 133M 2s 2024-09-12T01:01:30.017 INFO:teuthology.orchestra.run.smithi070.stderr: 3650K .......... .......... .......... .......... .......... 3% 131M 2s 2024-09-12T01:01:30.017 INFO:teuthology.orchestra.run.smithi070.stderr: 3700K .......... .......... .......... .......... .......... 4% 116M 2s 2024-09-12T01:01:30.017 INFO:teuthology.orchestra.run.smithi070.stderr: 3750K .......... .......... .......... .......... .......... 4% 140M 2s 2024-09-12T01:01:30.017 INFO:teuthology.orchestra.run.smithi070.stderr: 3800K .......... .......... .......... .......... .......... 4% 134M 2s 2024-09-12T01:01:30.017 INFO:teuthology.orchestra.run.smithi070.stderr: 3850K .......... .......... .......... .......... .......... 4% 135M 2s 2024-09-12T01:01:30.017 INFO:teuthology.orchestra.run.smithi070.stderr: 3900K .......... .......... .......... .......... .......... 4% 107M 2s 2024-09-12T01:01:30.017 INFO:teuthology.orchestra.run.smithi070.stderr: 3950K .......... .......... .......... .......... .......... 4% 131M 2s 2024-09-12T01:01:30.017 INFO:teuthology.orchestra.run.smithi070.stderr: 4000K .......... .......... .......... .......... .......... 4% 136M 2s 2024-09-12T01:01:30.017 INFO:teuthology.orchestra.run.smithi070.stderr: 4050K .......... .......... .......... .......... .......... 4% 137M 2s 2024-09-12T01:01:30.017 INFO:teuthology.orchestra.run.smithi070.stderr: 4100K .......... .......... .......... .......... .......... 4% 126M 2s 2024-09-12T01:01:30.017 INFO:teuthology.orchestra.run.smithi070.stderr: 4150K .......... .......... .......... .......... .......... 4% 140M 2s 2024-09-12T01:01:30.017 INFO:teuthology.orchestra.run.smithi070.stderr: 4200K .......... .......... .......... .......... .......... 4% 114M 2s 2024-09-12T01:01:30.018 INFO:teuthology.orchestra.run.smithi070.stderr: 4250K .......... .......... .......... .......... .......... 4% 150M 2s 2024-09-12T01:01:30.018 INFO:teuthology.orchestra.run.smithi070.stderr: 4300K .......... .......... .......... .......... .......... 4% 110M 2s 2024-09-12T01:01:30.018 INFO:teuthology.orchestra.run.smithi070.stderr: 4350K .......... .......... .......... .......... .......... 4% 138M 2s 2024-09-12T01:01:30.018 INFO:teuthology.orchestra.run.smithi070.stderr: 4400K .......... .......... .......... .......... .......... 4% 152M 2s 2024-09-12T01:01:30.018 INFO:teuthology.orchestra.run.smithi070.stderr: 4450K .......... .......... .......... .......... .......... 4% 137M 2s 2024-09-12T01:01:30.018 INFO:teuthology.orchestra.run.smithi070.stderr: 4500K .......... .......... .......... .......... .......... 4% 133M 2s 2024-09-12T01:01:30.018 INFO:teuthology.orchestra.run.smithi070.stderr: 4550K .......... .......... .......... .......... .......... 4% 147M 2s 2024-09-12T01:01:30.018 INFO:teuthology.orchestra.run.smithi070.stderr: 4600K .......... .......... .......... .......... .......... 5% 151M 2s 2024-09-12T01:01:30.018 INFO:teuthology.orchestra.run.smithi070.stderr: 4650K .......... .......... .......... .......... .......... 5% 153M 2s 2024-09-12T01:01:30.018 INFO:teuthology.orchestra.run.smithi070.stderr: 4700K .......... .......... .......... .......... .......... 5% 128M 2s 2024-09-12T01:01:30.018 INFO:teuthology.orchestra.run.smithi070.stderr: 4750K .......... .......... .......... .......... .......... 5% 152M 2s 2024-09-12T01:01:30.018 INFO:teuthology.orchestra.run.smithi070.stderr: 4800K .......... .......... .......... .......... .......... 5% 149M 2s 2024-09-12T01:01:30.018 INFO:teuthology.orchestra.run.smithi070.stderr: 4850K .......... .......... .......... .......... .......... 5% 145M 2s 2024-09-12T01:01:30.018 INFO:teuthology.orchestra.run.smithi070.stderr: 4900K .......... .......... .......... .......... .......... 5% 138M 2s 2024-09-12T01:01:30.019 INFO:teuthology.orchestra.run.smithi070.stderr: 4950K .......... .......... .......... .......... .......... 5% 153M 2s 2024-09-12T01:01:30.019 INFO:teuthology.orchestra.run.smithi070.stderr: 5000K .......... .......... .......... .......... .......... 5% 152M 2s 2024-09-12T01:01:30.019 INFO:teuthology.orchestra.run.smithi070.stderr: 5050K .......... .......... .......... .......... .......... 5% 150M 2s 2024-09-12T01:01:30.019 INFO:teuthology.orchestra.run.smithi070.stderr: 5100K .......... .......... .......... .......... .......... 5% 110M 2s 2024-09-12T01:01:30.019 INFO:teuthology.orchestra.run.smithi070.stderr: 5150K .......... .......... .......... .......... .......... 5% 136M 2s 2024-09-12T01:01:30.019 INFO:teuthology.orchestra.run.smithi070.stderr: 5200K .......... .......... .......... .......... .......... 5% 133M 2s 2024-09-12T01:01:30.019 INFO:teuthology.orchestra.run.smithi070.stderr: 5250K .......... .......... .......... .......... .......... 5% 142M 2s 2024-09-12T01:01:30.019 INFO:teuthology.orchestra.run.smithi070.stderr: 5300K .......... .......... .......... .......... .......... 5% 122M 2s 2024-09-12T01:01:30.019 INFO:teuthology.orchestra.run.smithi070.stderr: 5350K .......... .......... .......... .......... .......... 5% 140M 2s 2024-09-12T01:01:30.019 INFO:teuthology.orchestra.run.smithi070.stderr: 5400K .......... .......... .......... .......... .......... 5% 129M 2s 2024-09-12T01:01:30.019 INFO:teuthology.orchestra.run.smithi070.stderr: 5450K .......... .......... .......... .......... .......... 5% 135M 2s 2024-09-12T01:01:30.019 INFO:teuthology.orchestra.run.smithi070.stderr: 5500K .......... .......... .......... .......... .......... 5% 144M 2s 2024-09-12T01:01:30.019 INFO:teuthology.orchestra.run.smithi070.stderr: 5550K .......... .......... .......... .......... .......... 6% 135M 2s 2024-09-12T01:01:30.019 INFO:teuthology.orchestra.run.smithi070.stderr: 5600K .......... .......... .......... .......... .......... 6% 113M 1s 2024-09-12T01:01:30.019 INFO:teuthology.orchestra.run.smithi070.stderr: 5650K .......... .......... .......... .......... .......... 6% 139M 1s 2024-09-12T01:01:30.020 INFO:teuthology.orchestra.run.smithi070.stderr: 5700K .......... .......... .......... .......... .......... 6% 145M 1s 2024-09-12T01:01:30.020 INFO:teuthology.orchestra.run.smithi070.stderr: 5750K .......... .......... .......... .......... .......... 6% 152M 1s 2024-09-12T01:01:30.020 INFO:teuthology.orchestra.run.smithi070.stderr: 5800K .......... .......... .......... .......... .......... 6% 131M 1s 2024-09-12T01:01:30.020 INFO:teuthology.orchestra.run.smithi070.stderr: 5850K .......... .......... .......... .......... .......... 6% 149M 1s 2024-09-12T01:01:30.020 INFO:teuthology.orchestra.run.smithi070.stderr: 5900K .......... .......... .......... .......... .......... 6% 141M 1s 2024-09-12T01:01:30.020 INFO:teuthology.orchestra.run.smithi070.stderr: 5950K .......... .......... .......... .......... .......... 6% 153M 1s 2024-09-12T01:01:30.020 INFO:teuthology.orchestra.run.smithi070.stderr: 6000K .......... .......... .......... .......... .......... 6% 119M 1s 2024-09-12T01:01:30.020 INFO:teuthology.orchestra.run.smithi070.stderr: 6050K .......... .......... .......... .......... .......... 6% 148M 1s 2024-09-12T01:01:30.020 INFO:teuthology.orchestra.run.smithi070.stderr: 6100K .......... .......... .......... .......... .......... 6% 139M 1s 2024-09-12T01:01:30.020 INFO:teuthology.orchestra.run.smithi070.stderr: 6150K .......... .......... .......... .......... .......... 6% 145M 1s 2024-09-12T01:01:30.020 INFO:teuthology.orchestra.run.smithi070.stderr: 6200K .......... .......... .......... .......... .......... 6% 137M 1s 2024-09-12T01:01:30.020 INFO:teuthology.orchestra.run.smithi070.stderr: 6250K .......... .......... .......... .......... .......... 6% 153M 1s 2024-09-12T01:01:30.020 INFO:teuthology.orchestra.run.smithi070.stderr: 6300K .......... .......... .......... .......... .......... 6% 139M 1s 2024-09-12T01:01:30.020 INFO:teuthology.orchestra.run.smithi070.stderr: 6350K .......... .......... .......... .......... .......... 6% 151M 1s 2024-09-12T01:01:30.021 INFO:teuthology.orchestra.run.smithi070.stderr: 6400K .......... .......... .......... .......... .......... 6% 128M 1s 2024-09-12T01:01:30.021 INFO:teuthology.orchestra.run.smithi070.stderr: 6450K .......... .......... .......... .......... .......... 6% 153M 1s 2024-09-12T01:01:30.021 INFO:teuthology.orchestra.run.smithi070.stderr: 6500K .......... .......... .......... .......... .......... 7% 151M 1s 2024-09-12T01:01:30.021 INFO:teuthology.orchestra.run.smithi070.stderr: 6550K .......... .......... .......... .......... .......... 7% 133M 1s 2024-09-12T01:01:30.021 INFO:teuthology.orchestra.run.smithi070.stderr: 6600K .......... .......... .......... .......... .......... 7% 132M 1s 2024-09-12T01:01:30.021 INFO:teuthology.orchestra.run.smithi070.stderr: 6650K .......... .......... .......... .......... .......... 7% 161M 1s 2024-09-12T01:01:30.021 INFO:teuthology.orchestra.run.smithi070.stderr: 6700K .......... .......... .......... .......... .......... 7% 165M 1s 2024-09-12T01:01:30.021 INFO:teuthology.orchestra.run.smithi070.stderr: 6750K .......... .......... .......... .......... .......... 7% 155M 1s 2024-09-12T01:01:30.021 INFO:teuthology.orchestra.run.smithi070.stderr: 6800K .......... .......... .......... .......... .......... 7% 120M 1s 2024-09-12T01:01:30.021 INFO:teuthology.orchestra.run.smithi070.stderr: 6850K .......... .......... .......... .......... .......... 7% 144M 1s 2024-09-12T01:01:30.021 INFO:teuthology.orchestra.run.smithi070.stderr: 6900K .......... .......... .......... .......... .......... 7% 153M 1s 2024-09-12T01:01:30.021 INFO:teuthology.orchestra.run.smithi070.stderr: 6950K .......... .......... .......... .......... .......... 7% 153M 1s 2024-09-12T01:01:30.021 INFO:teuthology.orchestra.run.smithi070.stderr: 7000K .......... .......... .......... .......... .......... 7% 131M 1s 2024-09-12T01:01:30.022 INFO:teuthology.orchestra.run.smithi070.stderr: 7050K .......... .......... .......... .......... .......... 7% 163M 1s 2024-09-12T01:01:30.022 INFO:teuthology.orchestra.run.smithi070.stderr: 7100K .......... .......... .......... .......... .......... 7% 157M 1s 2024-09-12T01:01:30.022 INFO:teuthology.orchestra.run.smithi070.stderr: 7150K .......... .......... .......... .......... .......... 7% 143M 1s 2024-09-12T01:01:30.022 INFO:teuthology.orchestra.run.smithi070.stderr: 7200K .......... .......... .......... .......... .......... 7% 133M 1s 2024-09-12T01:01:30.022 INFO:teuthology.orchestra.run.smithi070.stderr: 7250K .......... .......... .......... .......... .......... 7% 169M 1s 2024-09-12T01:01:30.022 INFO:teuthology.orchestra.run.smithi070.stderr: 7300K .......... .......... .......... .......... .......... 7% 160M 1s 2024-09-12T01:01:30.022 INFO:teuthology.orchestra.run.smithi070.stderr: 7350K .......... .......... .......... .......... .......... 7% 172M 1s 2024-09-12T01:01:30.022 INFO:teuthology.orchestra.run.smithi070.stderr: 7400K .......... .......... .......... .......... .......... 8% 147M 1s 2024-09-12T01:01:30.022 INFO:teuthology.orchestra.run.smithi070.stderr: 7450K .......... .......... .......... .......... .......... 8% 167M 1s 2024-09-12T01:01:30.022 INFO:teuthology.orchestra.run.smithi070.stderr: 7500K .......... .......... .......... .......... .......... 8% 168M 1s 2024-09-12T01:01:30.022 INFO:teuthology.orchestra.run.smithi070.stderr: 7550K .......... .......... .......... .......... .......... 8% 168M 1s 2024-09-12T01:01:30.022 INFO:teuthology.orchestra.run.smithi070.stderr: 7600K .......... .......... .......... .......... .......... 8% 140M 1s 2024-09-12T01:01:30.022 INFO:teuthology.orchestra.run.smithi070.stderr: 7650K .......... .......... .......... .......... .......... 8% 175M 1s 2024-09-12T01:01:30.022 INFO:teuthology.orchestra.run.smithi070.stderr: 7700K .......... .......... .......... .......... .......... 8% 169M 1s 2024-09-12T01:01:30.023 INFO:teuthology.orchestra.run.smithi070.stderr: 7750K .......... .......... .......... .......... .......... 8% 174M 1s 2024-09-12T01:01:30.023 INFO:teuthology.orchestra.run.smithi070.stderr: 7800K .......... .......... .......... .......... .......... 8% 147M 1s 2024-09-12T01:01:30.023 INFO:teuthology.orchestra.run.smithi070.stderr: 7850K .......... .......... .......... .......... .......... 8% 176M 1s 2024-09-12T01:01:30.023 INFO:teuthology.orchestra.run.smithi070.stderr: 7900K .......... .......... .......... .......... .......... 8% 147M 1s 2024-09-12T01:01:30.023 INFO:teuthology.orchestra.run.smithi070.stderr: 7950K .......... .......... .......... .......... .......... 8% 201M 1s 2024-09-12T01:01:30.023 INFO:teuthology.orchestra.run.smithi070.stderr: 8000K .......... .......... .......... .......... .......... 8% 165M 1s 2024-09-12T01:01:30.023 INFO:teuthology.orchestra.run.smithi070.stderr: 8050K .......... .......... .......... .......... .......... 8% 160M 1s 2024-09-12T01:01:30.023 INFO:teuthology.orchestra.run.smithi070.stderr: 8100K .......... .......... .......... .......... .......... 8% 167M 1s 2024-09-12T01:01:30.023 INFO:teuthology.orchestra.run.smithi070.stderr: 8150K .......... .......... .......... .......... .......... 8% 192M 1s 2024-09-12T01:01:30.023 INFO:teuthology.orchestra.run.smithi070.stderr: 8200K .......... .......... .......... .......... .......... 8% 178M 1s 2024-09-12T01:01:30.023 INFO:teuthology.orchestra.run.smithi070.stderr: 8250K .......... .......... .......... .......... .......... 8% 197M 1s 2024-09-12T01:01:30.023 INFO:teuthology.orchestra.run.smithi070.stderr: 8300K .......... .......... .......... .......... .......... 8% 156M 1s 2024-09-12T01:01:30.023 INFO:teuthology.orchestra.run.smithi070.stderr: 8350K .......... .......... .......... .......... .......... 9% 191M 1s 2024-09-12T01:01:30.023 INFO:teuthology.orchestra.run.smithi070.stderr: 8400K .......... .......... .......... .......... .......... 9% 151M 1s 2024-09-12T01:01:30.023 INFO:teuthology.orchestra.run.smithi070.stderr: 8450K .......... .......... .......... .......... .......... 9% 188M 1s 2024-09-12T01:01:30.024 INFO:teuthology.orchestra.run.smithi070.stderr: 8500K .......... .......... .......... .......... .......... 9% 180M 1s 2024-09-12T01:01:30.024 INFO:teuthology.orchestra.run.smithi070.stderr: 8550K .......... .......... .......... .......... .......... 9% 192M 1s 2024-09-12T01:01:30.024 INFO:teuthology.orchestra.run.smithi070.stderr: 8600K .......... .......... .......... .......... .......... 9% 179M 1s 2024-09-12T01:01:30.024 INFO:teuthology.orchestra.run.smithi070.stderr: 8650K .......... .......... .......... .......... .......... 9% 203M 1s 2024-09-12T01:01:30.024 INFO:teuthology.orchestra.run.smithi070.stderr: 8700K .......... .......... .......... .......... .......... 9% 158M 1s 2024-09-12T01:01:30.024 INFO:teuthology.orchestra.run.smithi070.stderr: 8750K .......... .......... .......... .......... .......... 9% 184M 1s 2024-09-12T01:01:30.024 INFO:teuthology.orchestra.run.smithi070.stderr: 8800K .......... .......... .......... .......... .......... 9% 188M 1s 2024-09-12T01:01:30.024 INFO:teuthology.orchestra.run.smithi070.stderr: 8850K .......... .......... .......... .......... .......... 9% 185M 1s 2024-09-12T01:01:30.024 INFO:teuthology.orchestra.run.smithi070.stderr: 8900K .......... .......... .......... .......... .......... 9% 170M 1s 2024-09-12T01:01:30.024 INFO:teuthology.orchestra.run.smithi070.stderr: 8950K .......... .......... .......... .......... .......... 9% 197M 1s 2024-09-12T01:01:30.024 INFO:teuthology.orchestra.run.smithi070.stderr: 9000K .......... .......... .......... .......... .......... 9% 201M 1s 2024-09-12T01:01:30.024 INFO:teuthology.orchestra.run.smithi070.stderr: 9050K .......... .......... .......... .......... .......... 9% 206M 1s 2024-09-12T01:01:30.024 INFO:teuthology.orchestra.run.smithi070.stderr: 9100K .......... .......... .......... .......... .......... 9% 140M 1s 2024-09-12T01:01:30.025 INFO:teuthology.orchestra.run.smithi070.stderr: 9150K .......... .......... .......... .......... .......... 9% 161M 1s 2024-09-12T01:01:30.025 INFO:teuthology.orchestra.run.smithi070.stderr: 9200K .......... .......... .......... .......... .......... 9% 171M 1s 2024-09-12T01:01:30.025 INFO:teuthology.orchestra.run.smithi070.stderr: 9250K .......... .......... .......... .......... .......... 10% 158M 1s 2024-09-12T01:01:30.025 INFO:teuthology.orchestra.run.smithi070.stderr: 9300K .......... .......... .......... .......... .......... 10% 138M 1s 2024-09-12T01:01:30.025 INFO:teuthology.orchestra.run.smithi070.stderr: 9350K .......... .......... .......... .......... .......... 10% 186M 1s 2024-09-12T01:01:30.025 INFO:teuthology.orchestra.run.smithi070.stderr: 9400K .......... .......... .......... .......... .......... 10% 203M 1s 2024-09-12T01:01:30.025 INFO:teuthology.orchestra.run.smithi070.stderr: 9450K .......... .......... .......... .......... .......... 10% 194M 1s 2024-09-12T01:01:30.025 INFO:teuthology.orchestra.run.smithi070.stderr: 9500K .......... .......... .......... .......... .......... 10% 175M 1s 2024-09-12T01:01:30.025 INFO:teuthology.orchestra.run.smithi070.stderr: 9550K .......... .......... .......... .......... .......... 10% 206M 1s 2024-09-12T01:01:30.025 INFO:teuthology.orchestra.run.smithi070.stderr: 9600K .......... .......... .......... .......... .......... 10% 195M 1s 2024-09-12T01:01:30.025 INFO:teuthology.orchestra.run.smithi070.stderr: 9650K .......... .......... .......... .......... .......... 10% 206M 1s 2024-09-12T01:01:30.025 INFO:teuthology.orchestra.run.smithi070.stderr: 9700K .......... .......... .......... .......... .......... 10% 192M 1s 2024-09-12T01:01:30.025 INFO:teuthology.orchestra.run.smithi070.stderr: 9750K .......... .......... .......... .......... .......... 10% 194M 1s 2024-09-12T01:01:30.025 INFO:teuthology.orchestra.run.smithi070.stderr: 9800K .......... .......... .......... .......... .......... 10% 210M 1s 2024-09-12T01:01:30.026 INFO:teuthology.orchestra.run.smithi070.stderr: 9850K .......... .......... .......... .......... .......... 10% 171M 1s 2024-09-12T01:01:30.026 INFO:teuthology.orchestra.run.smithi070.stderr: 9900K .......... .......... .......... .......... .......... 10% 132M 1s 2024-09-12T01:01:30.026 INFO:teuthology.orchestra.run.smithi070.stderr: 9950K .......... .......... .......... .......... .......... 10% 191M 1s 2024-09-12T01:01:30.026 INFO:teuthology.orchestra.run.smithi070.stderr: 10000K .......... .......... .......... .......... .......... 10% 137M 1s 2024-09-12T01:01:30.026 INFO:teuthology.orchestra.run.smithi070.stderr: 10050K .......... .......... .......... .......... .......... 10% 200M 1s 2024-09-12T01:01:30.026 INFO:teuthology.orchestra.run.smithi070.stderr: 10100K .......... .......... .......... .......... .......... 10% 193M 1s 2024-09-12T01:01:30.026 INFO:teuthology.orchestra.run.smithi070.stderr: 10150K .......... .......... .......... .......... .......... 10% 228M 1s 2024-09-12T01:01:30.026 INFO:teuthology.orchestra.run.smithi070.stderr: 10200K .......... .......... .......... .......... .......... 11% 209M 1s 2024-09-12T01:01:30.026 INFO:teuthology.orchestra.run.smithi070.stderr: 10250K .......... .......... .......... .......... .......... 11% 196M 1s 2024-09-12T01:01:30.026 INFO:teuthology.orchestra.run.smithi070.stderr: 10300K .......... .......... .......... .......... .......... 11% 198M 1s 2024-09-12T01:01:30.026 INFO:teuthology.orchestra.run.smithi070.stderr: 10350K .......... .......... .......... .......... .......... 11% 226M 1s 2024-09-12T01:01:30.026 INFO:teuthology.orchestra.run.smithi070.stderr: 10400K .......... .......... .......... .......... .......... 11% 222M 1s 2024-09-12T01:01:30.026 INFO:teuthology.orchestra.run.smithi070.stderr: 10450K .......... .......... .......... .......... .......... 11% 206M 1s 2024-09-12T01:01:30.027 INFO:teuthology.orchestra.run.smithi070.stderr: 10500K .......... .......... .......... .......... .......... 11% 220M 1s 2024-09-12T01:01:30.027 INFO:teuthology.orchestra.run.smithi070.stderr: 10550K .......... .......... .......... .......... .......... 11% 226M 1s 2024-09-12T01:01:30.027 INFO:teuthology.orchestra.run.smithi070.stderr: 10600K .......... .......... .......... .......... .......... 11% 172M 1s 2024-09-12T01:01:30.027 INFO:teuthology.orchestra.run.smithi070.stderr: 10650K .......... .......... .......... .......... .......... 11% 160M 1s 2024-09-12T01:01:30.027 INFO:teuthology.orchestra.run.smithi070.stderr: 10700K .......... .......... .......... .......... .......... 11% 219M 1s 2024-09-12T01:01:30.027 INFO:teuthology.orchestra.run.smithi070.stderr: 10750K .......... .......... .......... .......... .......... 11% 231M 1s 2024-09-12T01:01:30.027 INFO:teuthology.orchestra.run.smithi070.stderr: 10800K .......... .......... .......... .......... .......... 11% 206M 1s 2024-09-12T01:01:30.027 INFO:teuthology.orchestra.run.smithi070.stderr: 10850K .......... .......... .......... .......... .......... 11% 196M 1s 2024-09-12T01:01:30.027 INFO:teuthology.orchestra.run.smithi070.stderr: 10900K .......... .......... .......... .......... .......... 11% 189M 1s 2024-09-12T01:01:30.027 INFO:teuthology.orchestra.run.smithi070.stderr: 10950K .......... .......... .......... .......... .......... 11% 215M 1s 2024-09-12T01:01:30.027 INFO:teuthology.orchestra.run.smithi070.stderr: 11000K .......... .......... .......... .......... .......... 11% 211M 1s 2024-09-12T01:01:30.027 INFO:teuthology.orchestra.run.smithi070.stderr: 11050K .......... .......... .......... .......... .......... 11% 188M 1s 2024-09-12T01:01:30.027 INFO:teuthology.orchestra.run.smithi070.stderr: 11100K .......... .......... .......... .......... .......... 12% 209M 1s 2024-09-12T01:01:30.027 INFO:teuthology.orchestra.run.smithi070.stderr: 11150K .......... .......... .......... .......... .......... 12% 200M 1s 2024-09-12T01:01:30.028 INFO:teuthology.orchestra.run.smithi070.stderr: 11200K .......... .......... .......... .......... .......... 12% 234M 1s 2024-09-12T01:01:30.028 INFO:teuthology.orchestra.run.smithi070.stderr: 11250K .......... .......... .......... .......... .......... 12% 220M 1s 2024-09-12T01:01:30.028 INFO:teuthology.orchestra.run.smithi070.stderr: 11300K .......... .......... .......... .......... .......... 12% 207M 1s 2024-09-12T01:01:30.028 INFO:teuthology.orchestra.run.smithi070.stderr: 11350K .......... .......... .......... .......... .......... 12% 202M 1s 2024-09-12T01:01:30.028 INFO:teuthology.orchestra.run.smithi070.stderr: 11400K .......... .......... .......... .......... .......... 12% 198M 1s 2024-09-12T01:01:30.028 INFO:teuthology.orchestra.run.smithi070.stderr: 11450K .......... .......... .......... .......... .......... 12% 239M 1s 2024-09-12T01:01:30.028 INFO:teuthology.orchestra.run.smithi070.stderr: 11500K .......... .......... .......... .......... .......... 12% 225M 1s 2024-09-12T01:01:30.028 INFO:teuthology.orchestra.run.smithi070.stderr: 11550K .......... .......... .......... .......... .......... 12% 164M 1s 2024-09-12T01:01:30.028 INFO:teuthology.orchestra.run.smithi070.stderr: 11600K .......... .......... .......... .......... .......... 12% 219M 1s 2024-09-12T01:01:30.028 INFO:teuthology.orchestra.run.smithi070.stderr: 11650K .......... .......... .......... .......... .......... 12% 166M 1s 2024-09-12T01:01:30.028 INFO:teuthology.orchestra.run.smithi070.stderr: 11700K .......... .......... .......... .......... .......... 12% 166M 1s 2024-09-12T01:01:30.028 INFO:teuthology.orchestra.run.smithi070.stderr: 11750K .......... .......... .......... .......... .......... 12% 163M 1s 2024-09-12T01:01:30.028 INFO:teuthology.orchestra.run.smithi070.stderr: 11800K .......... .......... .......... .......... .......... 12% 239M 1s 2024-09-12T01:01:30.029 INFO:teuthology.orchestra.run.smithi070.stderr: 11850K .......... .......... .......... .......... .......... 12% 229M 1s 2024-09-12T01:01:30.029 INFO:teuthology.orchestra.run.smithi070.stderr: 11900K .......... .......... .......... .......... .......... 12% 242M 1s 2024-09-12T01:01:30.029 INFO:teuthology.orchestra.run.smithi070.stderr: 11950K .......... .......... .......... .......... .......... 12% 199M 1s 2024-09-12T01:01:30.029 INFO:teuthology.orchestra.run.smithi070.stderr: 12000K .......... .......... .......... .......... .......... 12% 242M 1s 2024-09-12T01:01:30.029 INFO:teuthology.orchestra.run.smithi070.stderr: 12050K .......... .......... .......... .......... .......... 13% 253M 1s 2024-09-12T01:01:30.029 INFO:teuthology.orchestra.run.smithi070.stderr: 12100K .......... .......... .......... .......... .......... 13% 230M 1s 2024-09-12T01:01:30.029 INFO:teuthology.orchestra.run.smithi070.stderr: 12150K .......... .......... .......... .......... .......... 13% 226M 1s 2024-09-12T01:01:30.029 INFO:teuthology.orchestra.run.smithi070.stderr: 12200K .......... .......... .......... .......... .......... 13% 236M 1s 2024-09-12T01:01:30.029 INFO:teuthology.orchestra.run.smithi070.stderr: 12250K .......... .......... .......... .......... .......... 13% 244M 1s 2024-09-12T01:01:30.029 INFO:teuthology.orchestra.run.smithi070.stderr: 12300K .......... .......... .......... .......... .......... 13% 258M 1s 2024-09-12T01:01:30.029 INFO:teuthology.orchestra.run.smithi070.stderr: 12350K .......... .......... .......... .......... .......... 13% 206M 1s 2024-09-12T01:01:30.029 INFO:teuthology.orchestra.run.smithi070.stderr: 12400K .......... .......... .......... .......... .......... 13% 171M 1s 2024-09-12T01:01:30.029 INFO:teuthology.orchestra.run.smithi070.stderr: 12450K .......... .......... .......... .......... .......... 13% 258M 1s 2024-09-12T01:01:30.029 INFO:teuthology.orchestra.run.smithi070.stderr: 12500K .......... .......... .......... .......... .......... 13% 168M 1s 2024-09-12T01:01:30.030 INFO:teuthology.orchestra.run.smithi070.stderr: 12550K .......... .......... .......... .......... .......... 13% 170M 1s 2024-09-12T01:01:30.030 INFO:teuthology.orchestra.run.smithi070.stderr: 12600K .......... .......... .......... .......... .......... 13% 258M 1s 2024-09-12T01:01:30.030 INFO:teuthology.orchestra.run.smithi070.stderr: 12650K .......... .......... .......... .......... .......... 13% 237M 1s 2024-09-12T01:01:30.030 INFO:teuthology.orchestra.run.smithi070.stderr: 12700K .......... .......... .......... .......... .......... 13% 228M 1s 2024-09-12T01:01:30.030 INFO:teuthology.orchestra.run.smithi070.stderr: 12750K .......... .......... .......... .......... .......... 13% 172M 1s 2024-09-12T01:01:30.030 INFO:teuthology.orchestra.run.smithi070.stderr: 12800K .......... .......... .......... .......... .......... 13% 266M 1s 2024-09-12T01:01:30.030 INFO:teuthology.orchestra.run.smithi070.stderr: 12850K .......... .......... .......... .......... .......... 13% 271M 1s 2024-09-12T01:01:30.030 INFO:teuthology.orchestra.run.smithi070.stderr: 12900K .......... .......... .......... .......... .......... 13% 260M 1s 2024-09-12T01:01:30.030 INFO:teuthology.orchestra.run.smithi070.stderr: 12950K .......... .......... .......... .......... .......... 13% 228M 1s 2024-09-12T01:01:30.030 INFO:teuthology.orchestra.run.smithi070.stderr: 13000K .......... .......... .......... .......... .......... 14% 223M 1s 2024-09-12T01:01:30.030 INFO:teuthology.orchestra.run.smithi070.stderr: 13050K .......... .......... .......... .......... .......... 14% 262M 1s 2024-09-12T01:01:30.030 INFO:teuthology.orchestra.run.smithi070.stderr: 13100K .......... .......... .......... .......... .......... 14% 224M 1s 2024-09-12T01:01:30.030 INFO:teuthology.orchestra.run.smithi070.stderr: 13150K .......... .......... .......... .......... .......... 14% 184M 1s 2024-09-12T01:01:30.030 INFO:teuthology.orchestra.run.smithi070.stderr: 13200K .......... .......... .......... .......... .......... 14% 237M 1s 2024-09-12T01:01:30.031 INFO:teuthology.orchestra.run.smithi070.stderr: 13250K .......... .......... .......... .......... .......... 14% 254M 1s 2024-09-12T01:01:30.031 INFO:teuthology.orchestra.run.smithi070.stderr: 13300K .......... .......... .......... .......... .......... 14% 263M 1s 2024-09-12T01:01:30.031 INFO:teuthology.orchestra.run.smithi070.stderr: 13350K .......... .......... .......... .......... .......... 14% 244M 1s 2024-09-12T01:01:30.031 INFO:teuthology.orchestra.run.smithi070.stderr: 13400K .......... .......... .......... .......... .......... 14% 245M 1s 2024-09-12T01:01:30.031 INFO:teuthology.orchestra.run.smithi070.stderr: 13450K .......... .......... .......... .......... .......... 14% 185M 1s 2024-09-12T01:01:30.031 INFO:teuthology.orchestra.run.smithi070.stderr: 13500K .......... .......... .......... .......... .......... 14% 241M 1s 2024-09-12T01:01:30.031 INFO:teuthology.orchestra.run.smithi070.stderr: 13550K .......... .......... .......... .......... .......... 14% 206M 1s 2024-09-12T01:01:30.031 INFO:teuthology.orchestra.run.smithi070.stderr: 13600K .......... .......... .......... .......... .......... 14% 236M 1s 2024-09-12T01:01:30.031 INFO:teuthology.orchestra.run.smithi070.stderr: 13650K .......... .......... .......... .......... .......... 14% 259M 1s 2024-09-12T01:01:30.031 INFO:teuthology.orchestra.run.smithi070.stderr: 13700K .......... .......... .......... .......... .......... 14% 240M 1s 2024-09-12T01:01:30.031 INFO:teuthology.orchestra.run.smithi070.stderr: 13750K .......... .......... .......... .......... .......... 14% 251M 1s 2024-09-12T01:01:30.031 INFO:teuthology.orchestra.run.smithi070.stderr: 13800K .......... .......... .......... .......... .......... 14% 280M 1s 2024-09-12T01:01:30.031 INFO:teuthology.orchestra.run.smithi070.stderr: 13850K .......... .......... .......... .......... .......... 14% 263M 1s 2024-09-12T01:01:30.031 INFO:teuthology.orchestra.run.smithi070.stderr: 13900K .......... .......... .......... .......... .......... 15% 265M 1s 2024-09-12T01:01:30.031 INFO:teuthology.orchestra.run.smithi070.stderr: 13950K .......... .......... .......... .......... .......... 15% 195M 1s 2024-09-12T01:01:30.032 INFO:teuthology.orchestra.run.smithi070.stderr: 14000K .......... .......... .......... .......... .......... 15% 228M 1s 2024-09-12T01:01:30.032 INFO:teuthology.orchestra.run.smithi070.stderr: 14050K .......... .......... .......... .......... .......... 15% 245M 1s 2024-09-12T01:01:30.032 INFO:teuthology.orchestra.run.smithi070.stderr: 14100K .......... .......... .......... .......... .......... 15% 256M 1s 2024-09-12T01:01:30.032 INFO:teuthology.orchestra.run.smithi070.stderr: 14150K .......... .......... .......... .......... .......... 15% 249M 1s 2024-09-12T01:01:30.032 INFO:teuthology.orchestra.run.smithi070.stderr: 14200K .......... .......... .......... .......... .......... 15% 252M 1s 2024-09-12T01:01:30.032 INFO:teuthology.orchestra.run.smithi070.stderr: 14250K .......... .......... .......... .......... .......... 15% 261M 1s 2024-09-12T01:01:30.032 INFO:teuthology.orchestra.run.smithi070.stderr: 14300K .......... .......... .......... .......... .......... 15% 276M 1s 2024-09-12T01:01:30.032 INFO:teuthology.orchestra.run.smithi070.stderr: 14350K .......... .......... .......... .......... .......... 15% 178M 1s 2024-09-12T01:01:30.032 INFO:teuthology.orchestra.run.smithi070.stderr: 14400K .......... .......... .......... .......... .......... 15% 189M 1s 2024-09-12T01:01:30.032 INFO:teuthology.orchestra.run.smithi070.stderr: 14450K .......... .......... .......... .......... .......... 15% 230M 1s 2024-09-12T01:01:30.032 INFO:teuthology.orchestra.run.smithi070.stderr: 14500K .......... .......... .......... .......... .......... 15% 175M 1s 2024-09-12T01:01:30.032 INFO:teuthology.orchestra.run.smithi070.stderr: 14550K .......... .......... .......... .......... .......... 15% 175M 1s 2024-09-12T01:01:30.032 INFO:teuthology.orchestra.run.smithi070.stderr: 14600K .......... .......... .......... .......... .......... 15% 234M 1s 2024-09-12T01:01:30.032 INFO:teuthology.orchestra.run.smithi070.stderr: 14650K .......... .......... .......... .......... .......... 15% 219M 1s 2024-09-12T01:01:30.033 INFO:teuthology.orchestra.run.smithi070.stderr: 14700K .......... .......... .......... .......... .......... 15% 185M 1s 2024-09-12T01:01:30.033 INFO:teuthology.orchestra.run.smithi070.stderr: 14750K .......... .......... .......... .......... .......... 15% 159M 1s 2024-09-12T01:01:30.033 INFO:teuthology.orchestra.run.smithi070.stderr: 14800K .......... .......... .......... .......... .......... 15% 205M 1s 2024-09-12T01:01:30.033 INFO:teuthology.orchestra.run.smithi070.stderr: 14850K .......... .......... .......... .......... .......... 16% 160M 1s 2024-09-12T01:01:30.033 INFO:teuthology.orchestra.run.smithi070.stderr: 14900K .......... .......... .......... .......... .......... 16% 273M 1s 2024-09-12T01:01:30.033 INFO:teuthology.orchestra.run.smithi070.stderr: 14950K .......... .......... .......... .......... .......... 16% 239M 1s 2024-09-12T01:01:30.033 INFO:teuthology.orchestra.run.smithi070.stderr: 15000K .......... .......... .......... .......... .......... 16% 265M 1s 2024-09-12T01:01:30.033 INFO:teuthology.orchestra.run.smithi070.stderr: 15050K .......... .......... .......... .......... .......... 16% 193M 1s 2024-09-12T01:01:30.033 INFO:teuthology.orchestra.run.smithi070.stderr: 15100K .......... .......... .......... .......... .......... 16% 204M 1s 2024-09-12T01:01:30.033 INFO:teuthology.orchestra.run.smithi070.stderr: 15150K .......... .......... .......... .......... .......... 16% 212M 1s 2024-09-12T01:01:30.033 INFO:teuthology.orchestra.run.smithi070.stderr: 15200K .......... .......... .......... .......... .......... 16% 264M 1s 2024-09-12T01:01:30.033 INFO:teuthology.orchestra.run.smithi070.stderr: 15250K .......... .......... .......... .......... .......... 16% 191M 1s 2024-09-12T01:01:30.033 INFO:teuthology.orchestra.run.smithi070.stderr: 15300K .......... .......... .......... .......... .......... 16% 199M 1s 2024-09-12T01:01:30.033 INFO:teuthology.orchestra.run.smithi070.stderr: 15350K .......... .......... .......... .......... .......... 16% 236M 1s 2024-09-12T01:01:30.034 INFO:teuthology.orchestra.run.smithi070.stderr: 15400K .......... .......... .......... .......... .......... 16% 271M 1s 2024-09-12T01:01:30.034 INFO:teuthology.orchestra.run.smithi070.stderr: 15450K .......... .......... .......... .......... .......... 16% 317M 1s 2024-09-12T01:01:30.034 INFO:teuthology.orchestra.run.smithi070.stderr: 15500K .......... .......... .......... .......... .......... 16% 310M 1s 2024-09-12T01:01:30.034 INFO:teuthology.orchestra.run.smithi070.stderr: 15550K .......... .......... .......... .......... .......... 16% 254M 1s 2024-09-12T01:01:30.034 INFO:teuthology.orchestra.run.smithi070.stderr: 15600K .......... .......... .......... .......... .......... 16% 282M 1s 2024-09-12T01:01:30.034 INFO:teuthology.orchestra.run.smithi070.stderr: 15650K .......... .......... .......... .......... .......... 16% 280M 1s 2024-09-12T01:01:30.034 INFO:teuthology.orchestra.run.smithi070.stderr: 15700K .......... .......... .......... .......... .......... 16% 311M 1s 2024-09-12T01:01:30.034 INFO:teuthology.orchestra.run.smithi070.stderr: 15750K .......... .......... .......... .......... .......... 17% 283M 1s 2024-09-12T01:01:30.034 INFO:teuthology.orchestra.run.smithi070.stderr: 15800K .......... .......... .......... .......... .......... 17% 298M 1s 2024-09-12T01:01:30.034 INFO:teuthology.orchestra.run.smithi070.stderr: 15850K .......... .......... .......... .......... .......... 17% 276M 1s 2024-09-12T01:01:30.034 INFO:teuthology.orchestra.run.smithi070.stderr: 15900K .......... .......... .......... .......... .......... 17% 277M 1s 2024-09-12T01:01:30.034 INFO:teuthology.orchestra.run.smithi070.stderr: 15950K .......... .......... .......... .......... .......... 17% 241M 1s 2024-09-12T01:01:30.034 INFO:teuthology.orchestra.run.smithi070.stderr: 16000K .......... .......... .......... .......... .......... 17% 310M 1s 2024-09-12T01:01:30.034 INFO:teuthology.orchestra.run.smithi070.stderr: 16050K .......... .......... .......... .......... .......... 17% 321M 1s 2024-09-12T01:01:30.035 INFO:teuthology.orchestra.run.smithi070.stderr: 16100K .......... .......... .......... .......... .......... 17% 321M 1s 2024-09-12T01:01:30.035 INFO:teuthology.orchestra.run.smithi070.stderr: 16150K .......... .......... .......... .......... .......... 17% 273M 1s 2024-09-12T01:01:30.035 INFO:teuthology.orchestra.run.smithi070.stderr: 16200K .......... .......... .......... .......... .......... 17% 314M 1s 2024-09-12T01:01:30.035 INFO:teuthology.orchestra.run.smithi070.stderr: 16250K .......... .......... .......... .......... .......... 17% 281M 1s 2024-09-12T01:01:30.035 INFO:teuthology.orchestra.run.smithi070.stderr: 16300K .......... .......... .......... .......... .......... 17% 286M 1s 2024-09-12T01:01:30.035 INFO:teuthology.orchestra.run.smithi070.stderr: 16350K .......... .......... .......... .......... .......... 17% 238M 1s 2024-09-12T01:01:30.035 INFO:teuthology.orchestra.run.smithi070.stderr: 16400K .......... .......... .......... .......... .......... 17% 243M 1s 2024-09-12T01:01:30.035 INFO:teuthology.orchestra.run.smithi070.stderr: 16450K .......... .......... .......... .......... .......... 17% 308M 1s 2024-09-12T01:01:30.035 INFO:teuthology.orchestra.run.smithi070.stderr: 16500K .......... .......... .......... .......... .......... 17% 227M 1s 2024-09-12T01:01:30.035 INFO:teuthology.orchestra.run.smithi070.stderr: 16550K .......... .......... .......... .......... .......... 17% 268M 1s 2024-09-12T01:01:30.035 INFO:teuthology.orchestra.run.smithi070.stderr: 16600K .......... .......... .......... .......... .......... 17% 325M 1s 2024-09-12T01:01:30.035 INFO:teuthology.orchestra.run.smithi070.stderr: 16650K .......... .......... .......... .......... .......... 17% 314M 1s 2024-09-12T01:01:30.035 INFO:teuthology.orchestra.run.smithi070.stderr: 16700K .......... .......... .......... .......... .......... 18% 327M 1s 2024-09-12T01:01:30.035 INFO:teuthology.orchestra.run.smithi070.stderr: 16750K .......... .......... .......... .......... .......... 18% 276M 1s 2024-09-12T01:01:30.036 INFO:teuthology.orchestra.run.smithi070.stderr: 16800K .......... .......... .......... .......... .......... 18% 322M 1s 2024-09-12T01:01:30.036 INFO:teuthology.orchestra.run.smithi070.stderr: 16850K .......... .......... .......... .......... .......... 18% 290M 1s 2024-09-12T01:01:30.036 INFO:teuthology.orchestra.run.smithi070.stderr: 16900K .......... .......... .......... .......... .......... 18% 292M 1s 2024-09-12T01:01:30.036 INFO:teuthology.orchestra.run.smithi070.stderr: 16950K .......... .......... .......... .......... .......... 18% 262M 1s 2024-09-12T01:01:30.036 INFO:teuthology.orchestra.run.smithi070.stderr: 17000K .......... .......... .......... .......... .......... 18% 233M 1s 2024-09-12T01:01:30.036 INFO:teuthology.orchestra.run.smithi070.stderr: 17050K .......... .......... .......... .......... .......... 18% 217M 1s 2024-09-12T01:01:30.036 INFO:teuthology.orchestra.run.smithi070.stderr: 17100K .......... .......... .......... .......... .......... 18% 239M 1s 2024-09-12T01:01:30.036 INFO:teuthology.orchestra.run.smithi070.stderr: 17150K .......... .......... .......... .......... .......... 18% 223M 1s 2024-09-12T01:01:30.036 INFO:teuthology.orchestra.run.smithi070.stderr: 17200K .......... .......... .......... .......... .......... 18% 318M 1s 2024-09-12T01:01:30.036 INFO:teuthology.orchestra.run.smithi070.stderr: 17250K .......... .......... .......... .......... .......... 18% 309M 1s 2024-09-12T01:01:30.036 INFO:teuthology.orchestra.run.smithi070.stderr: 17300K .......... .......... .......... .......... .......... 18% 298M 1s 2024-09-12T01:01:30.036 INFO:teuthology.orchestra.run.smithi070.stderr: 17350K .......... .......... .......... .......... .......... 18% 276M 1s 2024-09-12T01:01:30.036 INFO:teuthology.orchestra.run.smithi070.stderr: 17400K .......... .......... .......... .......... .......... 18% 300M 1s 2024-09-12T01:01:30.037 INFO:teuthology.orchestra.run.smithi070.stderr: 17450K .......... .......... .......... .......... .......... 18% 320M 1s 2024-09-12T01:01:30.037 INFO:teuthology.orchestra.run.smithi070.stderr: 17500K .......... .......... .......... .......... .......... 18% 298M 1s 2024-09-12T01:01:30.037 INFO:teuthology.orchestra.run.smithi070.stderr: 17550K .......... .......... .......... .......... .......... 18% 225M 1s 2024-09-12T01:01:30.037 INFO:teuthology.orchestra.run.smithi070.stderr: 17600K .......... .......... .......... .......... .......... 18% 280M 1s 2024-09-12T01:01:30.037 INFO:teuthology.orchestra.run.smithi070.stderr: 17650K .......... .......... .......... .......... .......... 19% 264M 1s 2024-09-12T01:01:30.037 INFO:teuthology.orchestra.run.smithi070.stderr: 17700K .......... .......... .......... .......... .......... 19% 338M 1s 2024-09-12T01:01:30.037 INFO:teuthology.orchestra.run.smithi070.stderr: 17750K .......... .......... .......... .......... .......... 19% 296M 1s 2024-09-12T01:01:30.037 INFO:teuthology.orchestra.run.smithi070.stderr: 17800K .......... .......... .......... .......... .......... 19% 211M 1s 2024-09-12T01:01:30.037 INFO:teuthology.orchestra.run.smithi070.stderr: 17850K .......... .......... .......... .......... .......... 19% 305M 1s 2024-09-12T01:01:30.037 INFO:teuthology.orchestra.run.smithi070.stderr: 17900K .......... .......... .......... .......... .......... 19% 290M 1s 2024-09-12T01:01:30.037 INFO:teuthology.orchestra.run.smithi070.stderr: 17950K .......... .......... .......... .......... .......... 19% 258M 1s 2024-09-12T01:01:30.037 INFO:teuthology.orchestra.run.smithi070.stderr: 18000K .......... .......... .......... .......... .......... 19% 70.9M 1s 2024-09-12T01:01:30.037 INFO:teuthology.orchestra.run.smithi070.stderr: 18050K .......... .......... .......... .......... .......... 19% 241M 1s 2024-09-12T01:01:30.037 INFO:teuthology.orchestra.run.smithi070.stderr: 18100K .......... .......... .......... .......... .......... 19% 290M 1s 2024-09-12T01:01:30.037 INFO:teuthology.orchestra.run.smithi070.stderr: 18150K .......... .......... .......... .......... .......... 19% 274M 1s 2024-09-12T01:01:30.038 INFO:teuthology.orchestra.run.smithi070.stderr: 18200K .......... .......... .......... .......... .......... 19% 330M 1s 2024-09-12T01:01:30.038 INFO:teuthology.orchestra.run.smithi070.stderr: 18250K .......... .......... .......... .......... .......... 19% 313M 1s 2024-09-12T01:01:30.038 INFO:teuthology.orchestra.run.smithi070.stderr: 18300K .......... .......... .......... .......... .......... 19% 67.7M 1s 2024-09-12T01:01:30.038 INFO:teuthology.orchestra.run.smithi070.stderr: 18350K .......... .......... .......... .......... .......... 19% 202M 1s 2024-09-12T01:01:30.038 INFO:teuthology.orchestra.run.smithi070.stderr: 18400K .......... .......... .......... .......... .......... 19% 273M 1s 2024-09-12T01:01:30.038 INFO:teuthology.orchestra.run.smithi070.stderr: 18450K .......... .......... .......... .......... .......... 19% 283M 1s 2024-09-12T01:01:30.038 INFO:teuthology.orchestra.run.smithi070.stderr: 18500K .......... .......... .......... .......... .......... 19% 323M 1s 2024-09-12T01:01:30.038 INFO:teuthology.orchestra.run.smithi070.stderr: 18550K .......... .......... .......... .......... .......... 20% 270M 1s 2024-09-12T01:01:30.038 INFO:teuthology.orchestra.run.smithi070.stderr: 18600K .......... .......... .......... .......... .......... 20% 282M 1s 2024-09-12T01:01:30.038 INFO:teuthology.orchestra.run.smithi070.stderr: 18650K .......... .......... .......... .......... .......... 20% 287M 1s 2024-09-12T01:01:30.038 INFO:teuthology.orchestra.run.smithi070.stderr: 18700K .......... .......... .......... .......... .......... 20% 310M 1s 2024-09-12T01:01:30.038 INFO:teuthology.orchestra.run.smithi070.stderr: 18750K .......... .......... .......... .......... .......... 20% 281M 1s 2024-09-12T01:01:30.038 INFO:teuthology.orchestra.run.smithi070.stderr: 18800K .......... .......... .......... .......... .......... 20% 317M 1s 2024-09-12T01:01:30.038 INFO:teuthology.orchestra.run.smithi070.stderr: 18850K .......... .......... .......... .......... .......... 20% 315M 1s 2024-09-12T01:01:30.039 INFO:teuthology.orchestra.run.smithi070.stderr: 18900K .......... .......... .......... .......... .......... 20% 301M 1s 2024-09-12T01:01:30.039 INFO:teuthology.orchestra.run.smithi070.stderr: 18950K .......... .......... .......... .......... .......... 20% 301M 1s 2024-09-12T01:01:30.039 INFO:teuthology.orchestra.run.smithi070.stderr: 19000K .......... .......... .......... .......... .......... 20% 327M 1s 2024-09-12T01:01:30.039 INFO:teuthology.orchestra.run.smithi070.stderr: 19050K .......... .......... .......... .......... .......... 20% 81.0M 1s 2024-09-12T01:01:30.039 INFO:teuthology.orchestra.run.smithi070.stderr: 19100K .......... .......... .......... .......... .......... 20% 271M 1s 2024-09-12T01:01:30.039 INFO:teuthology.orchestra.run.smithi070.stderr: 19150K .......... .......... .......... .......... .......... 20% 277M 1s 2024-09-12T01:01:30.039 INFO:teuthology.orchestra.run.smithi070.stderr: 19200K .......... .......... .......... .......... .......... 20% 298M 1s 2024-09-12T01:01:30.039 INFO:teuthology.orchestra.run.smithi070.stderr: 19250K .......... .......... .......... .......... .......... 20% 245M 1s 2024-09-12T01:01:30.039 INFO:teuthology.orchestra.run.smithi070.stderr: 19300K .......... .......... .......... .......... .......... 20% 306M 1s 2024-09-12T01:01:30.039 INFO:teuthology.orchestra.run.smithi070.stderr: 19350K .......... .......... .......... .......... .......... 20% 276M 1s 2024-09-12T01:01:30.039 INFO:teuthology.orchestra.run.smithi070.stderr: 19400K .......... .......... .......... .......... .......... 20% 267M 1s 2024-09-12T01:01:30.039 INFO:teuthology.orchestra.run.smithi070.stderr: 19450K .......... .......... .......... .......... .......... 20% 267M 1s 2024-09-12T01:01:30.039 INFO:teuthology.orchestra.run.smithi070.stderr: 19500K .......... .......... .......... .......... .......... 21% 326M 1s 2024-09-12T01:01:30.039 INFO:teuthology.orchestra.run.smithi070.stderr: 19550K .......... .......... .......... .......... .......... 21% 335M 1s 2024-09-12T01:01:30.039 INFO:teuthology.orchestra.run.smithi070.stderr: 19600K .......... .......... .......... .......... .......... 21% 333M 1s 2024-09-12T01:01:30.040 INFO:teuthology.orchestra.run.smithi070.stderr: 19650K .......... .......... .......... .......... .......... 21% 274M 1s 2024-09-12T01:01:30.040 INFO:teuthology.orchestra.run.smithi070.stderr: 19700K .......... .......... .......... .......... .......... 21% 151M 1s 2024-09-12T01:01:30.040 INFO:teuthology.orchestra.run.smithi070.stderr: 19750K .......... .......... .......... .......... .......... 21% 284M 1s 2024-09-12T01:01:30.040 INFO:teuthology.orchestra.run.smithi070.stderr: 19800K .......... .......... .......... .......... .......... 21% 274M 1s 2024-09-12T01:01:30.040 INFO:teuthology.orchestra.run.smithi070.stderr: 19850K .......... .......... .......... .......... .......... 21% 251M 1s 2024-09-12T01:01:30.040 INFO:teuthology.orchestra.run.smithi070.stderr: 19900K .......... .......... .......... .......... .......... 21% 295M 1s 2024-09-12T01:01:30.040 INFO:teuthology.orchestra.run.smithi070.stderr: 19950K .......... .......... .......... .......... .......... 21% 332M 1s 2024-09-12T01:01:30.040 INFO:teuthology.orchestra.run.smithi070.stderr: 20000K .......... .......... .......... .......... .......... 21% 293M 1s 2024-09-12T01:01:30.040 INFO:teuthology.orchestra.run.smithi070.stderr: 20050K .......... .......... .......... .......... .......... 21% 266M 1s 2024-09-12T01:01:30.040 INFO:teuthology.orchestra.run.smithi070.stderr: 20100K .......... .......... .......... .......... .......... 21% 331M 1s 2024-09-12T01:01:30.040 INFO:teuthology.orchestra.run.smithi070.stderr: 20150K .......... .......... .......... .......... .......... 21% 292M 1s 2024-09-12T01:01:30.040 INFO:teuthology.orchestra.run.smithi070.stderr: 20200K .......... .......... .......... .......... .......... 21% 299M 1s 2024-09-12T01:01:30.040 INFO:teuthology.orchestra.run.smithi070.stderr: 20250K .......... .......... .......... .......... .......... 21% 301M 1s 2024-09-12T01:01:30.040 INFO:teuthology.orchestra.run.smithi070.stderr: 20300K .......... .......... .......... .......... .......... 21% 334M 1s 2024-09-12T01:01:30.041 INFO:teuthology.orchestra.run.smithi070.stderr: 20350K .......... .......... .......... .......... .......... 21% 343M 1s 2024-09-12T01:01:30.041 INFO:teuthology.orchestra.run.smithi070.stderr: 20400K .......... .......... .......... .......... .......... 22% 318M 1s 2024-09-12T01:01:30.041 INFO:teuthology.orchestra.run.smithi070.stderr: 20450K .......... .......... .......... .......... .......... 22% 159M 1s 2024-09-12T01:01:30.041 INFO:teuthology.orchestra.run.smithi070.stderr: 20500K .......... .......... .......... .......... .......... 22% 247M 1s 2024-09-12T01:01:30.041 INFO:teuthology.orchestra.run.smithi070.stderr: 20550K .......... .......... .......... .......... .......... 22% 329M 1s 2024-09-12T01:01:30.041 INFO:teuthology.orchestra.run.smithi070.stderr: 20600K .......... .......... .......... .......... .......... 22% 237M 1s 2024-09-12T01:01:30.041 INFO:teuthology.orchestra.run.smithi070.stderr: 20650K .......... .......... .......... .......... .......... 22% 319M 1s 2024-09-12T01:01:30.041 INFO:teuthology.orchestra.run.smithi070.stderr: 20700K .......... .......... .......... .......... .......... 22% 265M 1s 2024-09-12T01:01:30.041 INFO:teuthology.orchestra.run.smithi070.stderr: 20750K .......... .......... .......... .......... .......... 22% 289M 1s 2024-09-12T01:01:30.041 INFO:teuthology.orchestra.run.smithi070.stderr: 20800K .......... .......... .......... .......... .......... 22% 299M 1s 2024-09-12T01:01:30.041 INFO:teuthology.orchestra.run.smithi070.stderr: 20850K .......... .......... .......... .......... .......... 22% 297M 1s 2024-09-12T01:01:30.041 INFO:teuthology.orchestra.run.smithi070.stderr: 20900K .......... .......... .......... .......... .......... 22% 286M 1s 2024-09-12T01:01:30.041 INFO:teuthology.orchestra.run.smithi070.stderr: 20950K .......... .......... .......... .......... .......... 22% 337M 1s 2024-09-12T01:01:30.042 INFO:teuthology.orchestra.run.smithi070.stderr: 21000K .......... .......... .......... .......... .......... 22% 140M 1s 2024-09-12T01:01:30.042 INFO:teuthology.orchestra.run.smithi070.stderr: 21050K .......... .......... .......... .......... .......... 22% 298M 1s 2024-09-12T01:01:30.042 INFO:teuthology.orchestra.run.smithi070.stderr: 21100K .......... .......... .......... .......... .......... 22% 140M 1s 2024-09-12T01:01:30.042 INFO:teuthology.orchestra.run.smithi070.stderr: 21150K .......... .......... .......... .......... .......... 22% 298M 1s 2024-09-12T01:01:30.042 INFO:teuthology.orchestra.run.smithi070.stderr: 21200K .......... .......... .......... .......... .......... 22% 56.8M 1s 2024-09-12T01:01:30.042 INFO:teuthology.orchestra.run.smithi070.stderr: 21250K .......... .......... .......... .......... .......... 22% 273M 1s 2024-09-12T01:01:30.042 INFO:teuthology.orchestra.run.smithi070.stderr: 21300K .......... .......... .......... .......... .......... 22% 268M 1s 2024-09-12T01:01:30.042 INFO:teuthology.orchestra.run.smithi070.stderr: 21350K .......... .......... .......... .......... .......... 23% 315M 1s 2024-09-12T01:01:30.042 INFO:teuthology.orchestra.run.smithi070.stderr: 21400K .......... .......... .......... .......... .......... 23% 277M 1s 2024-09-12T01:01:30.042 INFO:teuthology.orchestra.run.smithi070.stderr: 21450K .......... .......... .......... .......... .......... 23% 314M 1s 2024-09-12T01:01:30.042 INFO:teuthology.orchestra.run.smithi070.stderr: 21500K .......... .......... .......... .......... .......... 23% 272M 1s 2024-09-12T01:01:30.042 INFO:teuthology.orchestra.run.smithi070.stderr: 21550K .......... .......... .......... .......... .......... 23% 187M 1s 2024-09-12T01:01:30.042 INFO:teuthology.orchestra.run.smithi070.stderr: 21600K .......... .......... .......... .......... .......... 23% 313M 1s 2024-09-12T01:01:30.042 INFO:teuthology.orchestra.run.smithi070.stderr: 21650K .......... .......... .......... .......... .......... 23% 281M 1s 2024-09-12T01:01:30.042 INFO:teuthology.orchestra.run.smithi070.stderr: 21700K .......... .......... .......... .......... .......... 23% 299M 1s 2024-09-12T01:01:30.043 INFO:teuthology.orchestra.run.smithi070.stderr: 21750K .......... .......... .......... .......... .......... 23% 321M 1s 2024-09-12T01:01:30.043 INFO:teuthology.orchestra.run.smithi070.stderr: 21800K .......... .......... .......... .......... .......... 23% 300M 1s 2024-09-12T01:01:30.043 INFO:teuthology.orchestra.run.smithi070.stderr: 21850K .......... .......... .......... .......... .......... 23% 328M 1s 2024-09-12T01:01:30.043 INFO:teuthology.orchestra.run.smithi070.stderr: 21900K .......... .......... .......... .......... .......... 23% 272M 1s 2024-09-12T01:01:30.043 INFO:teuthology.orchestra.run.smithi070.stderr: 21950K .......... .......... .......... .......... .......... 23% 118M 1s 2024-09-12T01:01:30.043 INFO:teuthology.orchestra.run.smithi070.stderr: 22000K .......... .......... .......... .......... .......... 23% 288M 1s 2024-09-12T01:01:30.043 INFO:teuthology.orchestra.run.smithi070.stderr: 22050K .......... .......... .......... .......... .......... 23% 339M 1s 2024-09-12T01:01:30.043 INFO:teuthology.orchestra.run.smithi070.stderr: 22100K .......... .......... .......... .......... .......... 23% 269M 1s 2024-09-12T01:01:30.043 INFO:teuthology.orchestra.run.smithi070.stderr: 22150K .......... .......... .......... .......... .......... 23% 285M 1s 2024-09-12T01:01:30.043 INFO:teuthology.orchestra.run.smithi070.stderr: 22200K .......... .......... .......... .......... .......... 23% 334M 1s 2024-09-12T01:01:30.043 INFO:teuthology.orchestra.run.smithi070.stderr: 22250K .......... .......... .......... .......... .......... 24% 313M 1s 2024-09-12T01:01:30.043 INFO:teuthology.orchestra.run.smithi070.stderr: 22300K .......... .......... .......... .......... .......... 24% 243M 1s 2024-09-12T01:01:30.043 INFO:teuthology.orchestra.run.smithi070.stderr: 22350K .......... .......... .......... .......... .......... 24% 312M 1s 2024-09-12T01:01:30.043 INFO:teuthology.orchestra.run.smithi070.stderr: 22400K .......... .......... .......... .......... .......... 24% 285M 1s 2024-09-12T01:01:30.043 INFO:teuthology.orchestra.run.smithi070.stderr: 22450K .......... .......... .......... .......... .......... 24% 337M 1s 2024-09-12T01:01:30.044 INFO:teuthology.orchestra.run.smithi070.stderr: 22500K .......... .......... .......... .......... .......... 24% 288M 1s 2024-09-12T01:01:30.044 INFO:teuthology.orchestra.run.smithi070.stderr: 22550K .......... .......... .......... .......... .......... 24% 78.4M 1s 2024-09-12T01:01:30.044 INFO:teuthology.orchestra.run.smithi070.stderr: 22600K .......... .......... .......... .......... .......... 24% 289M 1s 2024-09-12T01:01:30.044 INFO:teuthology.orchestra.run.smithi070.stderr: 22650K .......... .......... .......... .......... .......... 24% 269M 1s 2024-09-12T01:01:30.044 INFO:teuthology.orchestra.run.smithi070.stderr: 22700K .......... .......... .......... .......... .......... 24% 253M 1s 2024-09-12T01:01:30.044 INFO:teuthology.orchestra.run.smithi070.stderr: 22750K .......... .......... .......... .......... .......... 24% 300M 1s 2024-09-12T01:01:30.044 INFO:teuthology.orchestra.run.smithi070.stderr: 22800K .......... .......... .......... .......... .......... 24% 287M 1s 2024-09-12T01:01:30.044 INFO:teuthology.orchestra.run.smithi070.stderr: 22850K .......... .......... .......... .......... .......... 24% 308M 1s 2024-09-12T01:01:30.044 INFO:teuthology.orchestra.run.smithi070.stderr: 22900K .......... .......... .......... .......... .......... 24% 282M 1s 2024-09-12T01:01:30.044 INFO:teuthology.orchestra.run.smithi070.stderr: 22950K .......... .......... .......... .......... .......... 24% 342M 1s 2024-09-12T01:01:30.044 INFO:teuthology.orchestra.run.smithi070.stderr: 23000K .......... .......... .......... .......... .......... 24% 323M 1s 2024-09-12T01:01:30.044 INFO:teuthology.orchestra.run.smithi070.stderr: 23050K .......... .......... .......... .......... .......... 24% 335M 1s 2024-09-12T01:01:30.044 INFO:teuthology.orchestra.run.smithi070.stderr: 23100K .......... .......... .......... .......... .......... 24% 254M 1s 2024-09-12T01:01:30.044 INFO:teuthology.orchestra.run.smithi070.stderr: 23150K .......... .......... .......... .......... .......... 24% 311M 1s 2024-09-12T01:01:30.045 INFO:teuthology.orchestra.run.smithi070.stderr: 23200K .......... .......... .......... .......... .......... 25% 339M 1s 2024-09-12T01:01:30.045 INFO:teuthology.orchestra.run.smithi070.stderr: 23250K .......... .......... .......... .......... .......... 25% 341M 1s 2024-09-12T01:01:30.045 INFO:teuthology.orchestra.run.smithi070.stderr: 23300K .......... .......... .......... .......... .......... 25% 308M 1s 2024-09-12T01:01:30.045 INFO:teuthology.orchestra.run.smithi070.stderr: 23350K .......... .......... .......... .......... .......... 25% 337M 1s 2024-09-12T01:01:30.045 INFO:teuthology.orchestra.run.smithi070.stderr: 23400K .......... .......... .......... .......... .......... 25% 189M 1s 2024-09-12T01:01:30.045 INFO:teuthology.orchestra.run.smithi070.stderr: 23450K .......... .......... .......... .......... .......... 25% 306M 1s 2024-09-12T01:01:30.045 INFO:teuthology.orchestra.run.smithi070.stderr: 23500K .......... .......... .......... .......... .......... 25% 270M 1s 2024-09-12T01:01:30.045 INFO:teuthology.orchestra.run.smithi070.stderr: 23550K .......... .......... .......... .......... .......... 25% 295M 1s 2024-09-12T01:01:30.045 INFO:teuthology.orchestra.run.smithi070.stderr: 23600K .......... .......... .......... .......... .......... 25% 289M 1s 2024-09-12T01:01:30.045 INFO:teuthology.orchestra.run.smithi070.stderr: 23650K .......... .......... .......... .......... .......... 25% 306M 1s 2024-09-12T01:01:30.045 INFO:teuthology.orchestra.run.smithi070.stderr: 23700K .......... .......... .......... .......... .......... 25% 271M 1s 2024-09-12T01:01:30.045 INFO:teuthology.orchestra.run.smithi070.stderr: 23750K .......... .......... .......... .......... .......... 25% 341M 1s 2024-09-12T01:01:30.045 INFO:teuthology.orchestra.run.smithi070.stderr: 23800K .......... .......... .......... .......... .......... 25% 279M 1s 2024-09-12T01:01:30.045 INFO:teuthology.orchestra.run.smithi070.stderr: 23850K .......... .......... .......... .......... .......... 25% 338M 1s 2024-09-12T01:01:30.046 INFO:teuthology.orchestra.run.smithi070.stderr: 23900K .......... .......... .......... .......... .......... 25% 279M 1s 2024-09-12T01:01:30.046 INFO:teuthology.orchestra.run.smithi070.stderr: 23950K .......... .......... .......... .......... .......... 25% 237M 1s 2024-09-12T01:01:30.046 INFO:teuthology.orchestra.run.smithi070.stderr: 24000K .......... .......... .......... .......... .......... 25% 300M 1s 2024-09-12T01:01:30.046 INFO:teuthology.orchestra.run.smithi070.stderr: 24050K .......... .......... .......... .......... .......... 25% 316M 1s 2024-09-12T01:01:30.046 INFO:teuthology.orchestra.run.smithi070.stderr: 24100K .......... .......... .......... .......... .......... 25% 286M 1s 2024-09-12T01:01:30.046 INFO:teuthology.orchestra.run.smithi070.stderr: 24150K .......... .......... .......... .......... .......... 26% 152M 1s 2024-09-12T01:01:30.046 INFO:teuthology.orchestra.run.smithi070.stderr: 24200K .......... .......... .......... .......... .......... 26% 77.9M 1s 2024-09-12T01:01:30.046 INFO:teuthology.orchestra.run.smithi070.stderr: 24250K .......... .......... .......... .......... .......... 26% 202M 1s 2024-09-12T01:01:30.046 INFO:teuthology.orchestra.run.smithi070.stderr: 24300K .......... .......... .......... .......... .......... 26% 179M 1s 2024-09-12T01:01:30.046 INFO:teuthology.orchestra.run.smithi070.stderr: 24350K .......... .......... .......... .......... .......... 26% 329M 1s 2024-09-12T01:01:30.046 INFO:teuthology.orchestra.run.smithi070.stderr: 24400K .......... .......... .......... .......... .......... 26% 320M 1s 2024-09-12T01:01:30.046 INFO:teuthology.orchestra.run.smithi070.stderr: 24450K .......... .......... .......... .......... .......... 26% 125M 1s 2024-09-12T01:01:30.046 INFO:teuthology.orchestra.run.smithi070.stderr: 24500K .......... .......... .......... .......... .......... 26% 275M 1s 2024-09-12T01:01:30.046 INFO:teuthology.orchestra.run.smithi070.stderr: 24550K .......... .......... .......... .......... .......... 26% 339M 1s 2024-09-12T01:01:30.047 INFO:teuthology.orchestra.run.smithi070.stderr: 24600K .......... .......... .......... .......... .......... 26% 213M 1s 2024-09-12T01:01:30.047 INFO:teuthology.orchestra.run.smithi070.stderr: 24650K .......... .......... .......... .......... .......... 26% 298M 1s 2024-09-12T01:01:30.047 INFO:teuthology.orchestra.run.smithi070.stderr: 24700K .......... .......... .......... .......... .......... 26% 196M 1s 2024-09-12T01:01:30.047 INFO:teuthology.orchestra.run.smithi070.stderr: 24750K .......... .......... .......... .......... .......... 26% 296M 1s 2024-09-12T01:01:30.047 INFO:teuthology.orchestra.run.smithi070.stderr: 24800K .......... .......... .......... .......... .......... 26% 332M 1s 2024-09-12T01:01:30.047 INFO:teuthology.orchestra.run.smithi070.stderr: 24850K .......... .......... .......... .......... .......... 26% 340M 1s 2024-09-12T01:01:30.047 INFO:teuthology.orchestra.run.smithi070.stderr: 24900K .......... .......... .......... .......... .......... 26% 160M 1s 2024-09-12T01:01:30.047 INFO:teuthology.orchestra.run.smithi070.stderr: 24950K .......... .......... .......... .......... .......... 26% 308M 1s 2024-09-12T01:01:30.047 INFO:teuthology.orchestra.run.smithi070.stderr: 25000K .......... .......... .......... .......... .......... 26% 307M 1s 2024-09-12T01:01:30.047 INFO:teuthology.orchestra.run.smithi070.stderr: 25050K .......... .......... .......... .......... .......... 27% 314M 1s 2024-09-12T01:01:30.047 INFO:teuthology.orchestra.run.smithi070.stderr: 25100K .......... .......... .......... .......... .......... 27% 287M 0s 2024-09-12T01:01:30.047 INFO:teuthology.orchestra.run.smithi070.stderr: 25150K .......... .......... .......... .......... .......... 27% 232M 0s 2024-09-12T01:01:30.047 INFO:teuthology.orchestra.run.smithi070.stderr: 25200K .......... .......... .......... .......... .......... 27% 229M 0s 2024-09-12T01:01:30.047 INFO:teuthology.orchestra.run.smithi070.stderr: 25250K .......... .......... .......... .......... .......... 27% 312M 0s 2024-09-12T01:01:30.048 INFO:teuthology.orchestra.run.smithi070.stderr: 25300K .......... .......... .......... .......... .......... 27% 291M 0s 2024-09-12T01:01:30.048 INFO:teuthology.orchestra.run.smithi070.stderr: 25350K .......... .......... .......... .......... .......... 27% 309M 0s 2024-09-12T01:01:30.048 INFO:teuthology.orchestra.run.smithi070.stderr: 25400K .......... .......... .......... .......... .......... 27% 265M 0s 2024-09-12T01:01:30.048 INFO:teuthology.orchestra.run.smithi070.stderr: 25450K .......... .......... .......... .......... .......... 27% 329M 0s 2024-09-12T01:01:30.048 INFO:teuthology.orchestra.run.smithi070.stderr: 25500K .......... .......... .......... .......... .......... 27% 338M 0s 2024-09-12T01:01:30.048 INFO:teuthology.orchestra.run.smithi070.stderr: 25550K .......... .......... .......... .......... .......... 27% 119M 0s 2024-09-12T01:01:30.048 INFO:teuthology.orchestra.run.smithi070.stderr: 25600K .......... .......... .......... .......... .......... 27% 129M 0s 2024-09-12T01:01:30.048 INFO:teuthology.orchestra.run.smithi070.stderr: 25650K .......... .......... .......... .......... .......... 27% 258M 0s 2024-09-12T01:01:30.048 INFO:teuthology.orchestra.run.smithi070.stderr: 25700K .......... .......... .......... .......... .......... 27% 295M 0s 2024-09-12T01:01:30.048 INFO:teuthology.orchestra.run.smithi070.stderr: 25750K .......... .......... .......... .......... .......... 27% 343M 0s 2024-09-12T01:01:30.048 INFO:teuthology.orchestra.run.smithi070.stderr: 25800K .......... .......... .......... .......... .......... 27% 278M 0s 2024-09-12T01:01:30.048 INFO:teuthology.orchestra.run.smithi070.stderr: 25850K .......... .......... .......... .......... .......... 27% 298M 0s 2024-09-12T01:01:30.048 INFO:teuthology.orchestra.run.smithi070.stderr: 25900K .......... .......... .......... .......... .......... 27% 281M 0s 2024-09-12T01:01:30.048 INFO:teuthology.orchestra.run.smithi070.stderr: 25950K .......... .......... .......... .......... .......... 27% 290M 0s 2024-09-12T01:01:30.048 INFO:teuthology.orchestra.run.smithi070.stderr: 26000K .......... .......... .......... .......... .......... 28% 326M 0s 2024-09-12T01:01:30.049 INFO:teuthology.orchestra.run.smithi070.stderr: 26050K .......... .......... .......... .......... .......... 28% 319M 0s 2024-09-12T01:01:30.049 INFO:teuthology.orchestra.run.smithi070.stderr: 26100K .......... .......... .......... .......... .......... 28% 287M 0s 2024-09-12T01:01:30.049 INFO:teuthology.orchestra.run.smithi070.stderr: 26150K .......... .......... .......... .......... .......... 28% 318M 0s 2024-09-12T01:01:30.049 INFO:teuthology.orchestra.run.smithi070.stderr: 26200K .......... .......... .......... .......... .......... 28% 333M 0s 2024-09-12T01:01:30.049 INFO:teuthology.orchestra.run.smithi070.stderr: 26250K .......... .......... .......... .......... .......... 28% 109M 0s 2024-09-12T01:01:30.049 INFO:teuthology.orchestra.run.smithi070.stderr: 26300K .......... .......... .......... .......... .......... 28% 256M 0s 2024-09-12T01:01:30.049 INFO:teuthology.orchestra.run.smithi070.stderr: 26350K .......... .......... .......... .......... .......... 28% 305M 0s 2024-09-12T01:01:30.049 INFO:teuthology.orchestra.run.smithi070.stderr: 26400K .......... .......... .......... .......... .......... 28% 309M 0s 2024-09-12T01:01:30.049 INFO:teuthology.orchestra.run.smithi070.stderr: 26450K .......... .......... .......... .......... .......... 28% 314M 0s 2024-09-12T01:01:30.049 INFO:teuthology.orchestra.run.smithi070.stderr: 26500K .......... .......... .......... .......... .......... 28% 289M 0s 2024-09-12T01:01:30.049 INFO:teuthology.orchestra.run.smithi070.stderr: 26550K .......... .......... .......... .......... .......... 28% 253M 0s 2024-09-12T01:01:30.049 INFO:teuthology.orchestra.run.smithi070.stderr: 26600K .......... .......... .......... .......... .......... 28% 310M 0s 2024-09-12T01:01:30.049 INFO:teuthology.orchestra.run.smithi070.stderr: 26650K .......... .......... .......... .......... .......... 28% 297M 0s 2024-09-12T01:01:30.049 INFO:teuthology.orchestra.run.smithi070.stderr: 26700K .......... .......... .......... .......... .......... 28% 264M 0s 2024-09-12T01:01:30.049 INFO:teuthology.orchestra.run.smithi070.stderr: 26750K .......... .......... .......... .......... .......... 28% 343M 0s 2024-09-12T01:01:30.050 INFO:teuthology.orchestra.run.smithi070.stderr: 26800K .......... .......... .......... .......... .......... 28% 313M 0s 2024-09-12T01:01:30.050 INFO:teuthology.orchestra.run.smithi070.stderr: 26850K .......... .......... .......... .......... .......... 28% 307M 0s 2024-09-12T01:01:30.050 INFO:teuthology.orchestra.run.smithi070.stderr: 26900K .......... .......... .......... .......... .......... 29% 291M 0s 2024-09-12T01:01:30.050 INFO:teuthology.orchestra.run.smithi070.stderr: 26950K .......... .......... .......... .......... .......... 29% 306M 0s 2024-09-12T01:01:30.050 INFO:teuthology.orchestra.run.smithi070.stderr: 27000K .......... .......... .......... .......... .......... 29% 343M 0s 2024-09-12T01:01:30.050 INFO:teuthology.orchestra.run.smithi070.stderr: 27050K .......... .......... .......... .......... .......... 29% 321M 0s 2024-09-12T01:01:30.050 INFO:teuthology.orchestra.run.smithi070.stderr: 27100K .......... .......... .......... .......... .......... 29% 274M 0s 2024-09-12T01:01:30.050 INFO:teuthology.orchestra.run.smithi070.stderr: 27150K .......... .......... .......... .......... .......... 29% 346M 0s 2024-09-12T01:01:30.050 INFO:teuthology.orchestra.run.smithi070.stderr: 27200K .......... .......... .......... .......... .......... 29% 116M 0s 2024-09-12T01:01:30.050 INFO:teuthology.orchestra.run.smithi070.stderr: 27250K .......... .......... .......... .......... .......... 29% 163M 0s 2024-09-12T01:01:30.050 INFO:teuthology.orchestra.run.smithi070.stderr: 27300K .......... .......... .......... .......... .......... 29% 158M 0s 2024-09-12T01:01:30.050 INFO:teuthology.orchestra.run.smithi070.stderr: 27350K .......... .......... .......... .......... .......... 29% 261M 0s 2024-09-12T01:01:30.050 INFO:teuthology.orchestra.run.smithi070.stderr: 27400K .......... .......... .......... .......... .......... 29% 271M 0s 2024-09-12T01:01:30.050 INFO:teuthology.orchestra.run.smithi070.stderr: 27450K .......... .......... .......... .......... .......... 29% 225M 0s 2024-09-12T01:01:30.050 INFO:teuthology.orchestra.run.smithi070.stderr: 27500K .......... .......... .......... .......... .......... 29% 219M 0s 2024-09-12T01:01:30.051 INFO:teuthology.orchestra.run.smithi070.stderr: 27550K .......... .......... .......... .......... .......... 29% 207M 0s 2024-09-12T01:01:30.051 INFO:teuthology.orchestra.run.smithi070.stderr: 27600K .......... .......... .......... .......... .......... 29% 252M 0s 2024-09-12T01:01:30.051 INFO:teuthology.orchestra.run.smithi070.stderr: 27650K .......... .......... .......... .......... .......... 29% 282M 0s 2024-09-12T01:01:30.051 INFO:teuthology.orchestra.run.smithi070.stderr: 27700K .......... .......... .......... .......... .......... 29% 150M 0s 2024-09-12T01:01:30.051 INFO:teuthology.orchestra.run.smithi070.stderr: 27750K .......... .......... .......... .......... .......... 29% 271M 0s 2024-09-12T01:01:30.051 INFO:teuthology.orchestra.run.smithi070.stderr: 27800K .......... .......... .......... .......... .......... 29% 287M 0s 2024-09-12T01:01:30.051 INFO:teuthology.orchestra.run.smithi070.stderr: 27850K .......... .......... .......... .......... .......... 30% 90.7M 0s 2024-09-12T01:01:30.051 INFO:teuthology.orchestra.run.smithi070.stderr: 27900K .......... .......... .......... .......... .......... 30% 243M 0s 2024-09-12T01:01:30.051 INFO:teuthology.orchestra.run.smithi070.stderr: 27950K .......... .......... .......... .......... .......... 30% 268M 0s 2024-09-12T01:01:30.051 INFO:teuthology.orchestra.run.smithi070.stderr: 28000K .......... .......... .......... .......... .......... 30% 233M 0s 2024-09-12T01:01:30.051 INFO:teuthology.orchestra.run.smithi070.stderr: 28050K .......... .......... .......... .......... .......... 30% 266M 0s 2024-09-12T01:01:30.051 INFO:teuthology.orchestra.run.smithi070.stderr: 28100K .......... .......... .......... .......... .......... 30% 274M 0s 2024-09-12T01:01:30.051 INFO:teuthology.orchestra.run.smithi070.stderr: 28150K .......... .......... .......... .......... .......... 30% 272M 0s 2024-09-12T01:01:30.052 INFO:teuthology.orchestra.run.smithi070.stderr: 28200K .......... .......... .......... .......... .......... 30% 227M 0s 2024-09-12T01:01:30.052 INFO:teuthology.orchestra.run.smithi070.stderr: 28250K .......... .......... .......... .......... .......... 30% 272M 0s 2024-09-12T01:01:30.052 INFO:teuthology.orchestra.run.smithi070.stderr: 28300K .......... .......... .......... .......... .......... 30% 265M 0s 2024-09-12T01:01:30.052 INFO:teuthology.orchestra.run.smithi070.stderr: 28350K .......... .......... .......... .......... .......... 30% 291M 0s 2024-09-12T01:01:30.052 INFO:teuthology.orchestra.run.smithi070.stderr: 28400K .......... .......... .......... .......... .......... 30% 262M 0s 2024-09-12T01:01:30.052 INFO:teuthology.orchestra.run.smithi070.stderr: 28450K .......... .......... .......... .......... .......... 30% 262M 0s 2024-09-12T01:01:30.052 INFO:teuthology.orchestra.run.smithi070.stderr: 28500K .......... .......... .......... .......... .......... 30% 238M 0s 2024-09-12T01:01:30.052 INFO:teuthology.orchestra.run.smithi070.stderr: 28550K .......... .......... .......... .......... .......... 30% 284M 0s 2024-09-12T01:01:30.052 INFO:teuthology.orchestra.run.smithi070.stderr: 28600K .......... .......... .......... .......... .......... 30% 227M 0s 2024-09-12T01:01:30.052 INFO:teuthology.orchestra.run.smithi070.stderr: 28650K .......... .......... .......... .......... .......... 30% 256M 0s 2024-09-12T01:01:30.052 INFO:teuthology.orchestra.run.smithi070.stderr: 28700K .......... .......... .......... .......... .......... 30% 267M 0s 2024-09-12T01:01:30.052 INFO:teuthology.orchestra.run.smithi070.stderr: 28750K .......... .......... .......... .......... .......... 31% 288M 0s 2024-09-12T01:01:30.052 INFO:teuthology.orchestra.run.smithi070.stderr: 28800K .......... .......... .......... .......... .......... 31% 189M 0s 2024-09-12T01:01:30.052 INFO:teuthology.orchestra.run.smithi070.stderr: 28850K .......... .......... .......... .......... .......... 31% 270M 0s 2024-09-12T01:01:30.053 INFO:teuthology.orchestra.run.smithi070.stderr: 28900K .......... .......... .......... .......... .......... 31% 283M 0s 2024-09-12T01:01:30.053 INFO:teuthology.orchestra.run.smithi070.stderr: 28950K .......... .......... .......... .......... .......... 31% 279M 0s 2024-09-12T01:01:30.053 INFO:teuthology.orchestra.run.smithi070.stderr: 29000K .......... .......... .......... .......... .......... 31% 250M 0s 2024-09-12T01:01:30.053 INFO:teuthology.orchestra.run.smithi070.stderr: 29050K .......... .......... .......... .......... .......... 31% 302M 0s 2024-09-12T01:01:30.053 INFO:teuthology.orchestra.run.smithi070.stderr: 29100K .......... .......... .......... .......... .......... 31% 267M 0s 2024-09-12T01:01:30.053 INFO:teuthology.orchestra.run.smithi070.stderr: 29150K .......... .......... .......... .......... .......... 31% 253M 0s 2024-09-12T01:01:30.053 INFO:teuthology.orchestra.run.smithi070.stderr: 29200K .......... .......... .......... .......... .......... 31% 258M 0s 2024-09-12T01:01:30.053 INFO:teuthology.orchestra.run.smithi070.stderr: 29250K .......... .......... .......... .......... .......... 31% 272M 0s 2024-09-12T01:01:30.053 INFO:teuthology.orchestra.run.smithi070.stderr: 29300K .......... .......... .......... .......... .......... 31% 238M 0s 2024-09-12T01:01:30.053 INFO:teuthology.orchestra.run.smithi070.stderr: 29350K .......... .......... .......... .......... .......... 31% 285M 0s 2024-09-12T01:01:30.053 INFO:teuthology.orchestra.run.smithi070.stderr: 29400K .......... .......... .......... .......... .......... 31% 294M 0s 2024-09-12T01:01:30.053 INFO:teuthology.orchestra.run.smithi070.stderr: 29450K .......... .......... .......... .......... .......... 31% 265M 0s 2024-09-12T01:01:30.053 INFO:teuthology.orchestra.run.smithi070.stderr: 29500K .......... .......... .......... .......... .......... 31% 247M 0s 2024-09-12T01:01:30.053 INFO:teuthology.orchestra.run.smithi070.stderr: 29550K .......... .......... .......... .......... .......... 31% 297M 0s 2024-09-12T01:01:30.054 INFO:teuthology.orchestra.run.smithi070.stderr: 29600K .......... .......... .......... .......... .......... 31% 225M 0s 2024-09-12T01:01:30.054 INFO:teuthology.orchestra.run.smithi070.stderr: 29650K .......... .......... .......... .......... .......... 31% 284M 0s 2024-09-12T01:01:30.054 INFO:teuthology.orchestra.run.smithi070.stderr: 29700K .......... .......... .......... .......... .......... 32% 235M 0s 2024-09-12T01:01:30.054 INFO:teuthology.orchestra.run.smithi070.stderr: 29750K .......... .......... .......... .......... .......... 32% 275M 0s 2024-09-12T01:01:30.054 INFO:teuthology.orchestra.run.smithi070.stderr: 29800K .......... .......... .......... .......... .......... 32% 307M 0s 2024-09-12T01:01:30.054 INFO:teuthology.orchestra.run.smithi070.stderr: 29850K .......... .......... .......... .......... .......... 32% 285M 0s 2024-09-12T01:01:30.054 INFO:teuthology.orchestra.run.smithi070.stderr: 29900K .......... .......... .......... .......... .......... 32% 240M 0s 2024-09-12T01:01:30.054 INFO:teuthology.orchestra.run.smithi070.stderr: 29950K .......... .......... .......... .......... .......... 32% 302M 0s 2024-09-12T01:01:30.054 INFO:teuthology.orchestra.run.smithi070.stderr: 30000K .......... .......... .......... .......... .......... 32% 266M 0s 2024-09-12T01:01:30.054 INFO:teuthology.orchestra.run.smithi070.stderr: 30050K .......... .......... .......... .......... .......... 32% 289M 0s 2024-09-12T01:01:30.054 INFO:teuthology.orchestra.run.smithi070.stderr: 30100K .......... .......... .......... .......... .......... 32% 280M 0s 2024-09-12T01:01:30.054 INFO:teuthology.orchestra.run.smithi070.stderr: 30150K .......... .......... .......... .......... .......... 32% 290M 0s 2024-09-12T01:01:30.054 INFO:teuthology.orchestra.run.smithi070.stderr: 30200K .......... .......... .......... .......... .......... 32% 286M 0s 2024-09-12T01:01:30.054 INFO:teuthology.orchestra.run.smithi070.stderr: 30250K .......... .......... .......... .......... .......... 32% 309M 0s 2024-09-12T01:01:30.054 INFO:teuthology.orchestra.run.smithi070.stderr: 30300K .......... .......... .......... .......... .......... 32% 247M 0s 2024-09-12T01:01:30.055 INFO:teuthology.orchestra.run.smithi070.stderr: 30350K .......... .......... .......... .......... .......... 32% 292M 0s 2024-09-12T01:01:30.055 INFO:teuthology.orchestra.run.smithi070.stderr: 30400K .......... .......... .......... .......... .......... 32% 300M 0s 2024-09-12T01:01:30.055 INFO:teuthology.orchestra.run.smithi070.stderr: 30450K .......... .......... .......... .......... .......... 32% 311M 0s 2024-09-12T01:01:30.055 INFO:teuthology.orchestra.run.smithi070.stderr: 30500K .......... .......... .......... .......... .......... 32% 261M 0s 2024-09-12T01:01:30.055 INFO:teuthology.orchestra.run.smithi070.stderr: 30550K .......... .......... .......... .......... .......... 32% 195M 0s 2024-09-12T01:01:30.055 INFO:teuthology.orchestra.run.smithi070.stderr: 30600K .......... .......... .......... .......... .......... 32% 289M 0s 2024-09-12T01:01:30.055 INFO:teuthology.orchestra.run.smithi070.stderr: 30650K .......... .......... .......... .......... .......... 33% 81.1M 0s 2024-09-12T01:01:30.055 INFO:teuthology.orchestra.run.smithi070.stderr: 30700K .......... .......... .......... .......... .......... 33% 285M 0s 2024-09-12T01:01:30.055 INFO:teuthology.orchestra.run.smithi070.stderr: 30750K .......... .......... .......... .......... .......... 33% 252M 0s 2024-09-12T01:01:30.055 INFO:teuthology.orchestra.run.smithi070.stderr: 30800K .......... .......... .......... .......... .......... 33% 308M 0s 2024-09-12T01:01:30.055 INFO:teuthology.orchestra.run.smithi070.stderr: 30850K .......... .......... .......... .......... .......... 33% 273M 0s 2024-09-12T01:01:30.055 INFO:teuthology.orchestra.run.smithi070.stderr: 30900K .......... .......... .......... .......... .......... 33% 123M 0s 2024-09-12T01:01:30.055 INFO:teuthology.orchestra.run.smithi070.stderr: 30950K .......... .......... .......... .......... .......... 33% 264M 0s 2024-09-12T01:01:30.055 INFO:teuthology.orchestra.run.smithi070.stderr: 31000K .......... .......... .......... .......... .......... 33% 285M 0s 2024-09-12T01:01:30.056 INFO:teuthology.orchestra.run.smithi070.stderr: 31050K .......... .......... .......... .......... .......... 33% 236M 0s 2024-09-12T01:01:30.056 INFO:teuthology.orchestra.run.smithi070.stderr: 31100K .......... .......... .......... .......... .......... 33% 300M 0s 2024-09-12T01:01:30.056 INFO:teuthology.orchestra.run.smithi070.stderr: 31150K .......... .......... .......... .......... .......... 33% 279M 0s 2024-09-12T01:01:30.056 INFO:teuthology.orchestra.run.smithi070.stderr: 31200K .......... .......... .......... .......... .......... 33% 290M 0s 2024-09-12T01:01:30.056 INFO:teuthology.orchestra.run.smithi070.stderr: 31250K .......... .......... .......... .......... .......... 33% 212M 0s 2024-09-12T01:01:30.056 INFO:teuthology.orchestra.run.smithi070.stderr: 31300K .......... .......... .......... .......... .......... 33% 308M 0s 2024-09-12T01:01:30.056 INFO:teuthology.orchestra.run.smithi070.stderr: 31350K .......... .......... .......... .......... .......... 33% 147M 0s 2024-09-12T01:01:30.056 INFO:teuthology.orchestra.run.smithi070.stderr: 31400K .......... .......... .......... .......... .......... 33% 304M 0s 2024-09-12T01:01:30.056 INFO:teuthology.orchestra.run.smithi070.stderr: 31450K .......... .......... .......... .......... .......... 33% 233M 0s 2024-09-12T01:01:30.056 INFO:teuthology.orchestra.run.smithi070.stderr: 31500K .......... .......... .......... .......... .......... 33% 283M 0s 2024-09-12T01:01:30.056 INFO:teuthology.orchestra.run.smithi070.stderr: 31550K .......... .......... .......... .......... .......... 34% 308M 0s 2024-09-12T01:01:30.056 INFO:teuthology.orchestra.run.smithi070.stderr: 31600K .......... .......... .......... .......... .......... 34% 243M 0s 2024-09-12T01:01:30.056 INFO:teuthology.orchestra.run.smithi070.stderr: 31650K .......... .......... .......... .......... .......... 34% 249M 0s 2024-09-12T01:01:30.056 INFO:teuthology.orchestra.run.smithi070.stderr: 31700K .......... .......... .......... .......... .......... 34% 311M 0s 2024-09-12T01:01:30.056 INFO:teuthology.orchestra.run.smithi070.stderr: 31750K .......... .......... .......... .......... .......... 34% 307M 0s 2024-09-12T01:01:30.057 INFO:teuthology.orchestra.run.smithi070.stderr: 31800K .......... .......... .......... .......... .......... 34% 213M 0s 2024-09-12T01:01:30.057 INFO:teuthology.orchestra.run.smithi070.stderr: 31850K .......... .......... .......... .......... .......... 34% 230M 0s 2024-09-12T01:01:30.057 INFO:teuthology.orchestra.run.smithi070.stderr: 31900K .......... .......... .......... .......... .......... 34% 283M 0s 2024-09-12T01:01:30.057 INFO:teuthology.orchestra.run.smithi070.stderr: 31950K .......... .......... .......... .......... .......... 34% 307M 0s 2024-09-12T01:01:30.057 INFO:teuthology.orchestra.run.smithi070.stderr: 32000K .......... .......... .......... .......... .......... 34% 121M 0s 2024-09-12T01:01:30.057 INFO:teuthology.orchestra.run.smithi070.stderr: 32050K .......... .......... .......... .......... .......... 34% 204M 0s 2024-09-12T01:01:30.057 INFO:teuthology.orchestra.run.smithi070.stderr: 32100K .......... .......... .......... .......... .......... 34% 267M 0s 2024-09-12T01:01:30.057 INFO:teuthology.orchestra.run.smithi070.stderr: 32150K .......... .......... .......... .......... .......... 34% 295M 0s 2024-09-12T01:01:30.057 INFO:teuthology.orchestra.run.smithi070.stderr: 32200K .......... .......... .......... .......... .......... 34% 310M 0s 2024-09-12T01:01:30.057 INFO:teuthology.orchestra.run.smithi070.stderr: 32250K .......... .......... .......... .......... .......... 34% 238M 0s 2024-09-12T01:01:30.057 INFO:teuthology.orchestra.run.smithi070.stderr: 32300K .......... .......... .......... .......... .......... 34% 310M 0s 2024-09-12T01:01:30.057 INFO:teuthology.orchestra.run.smithi070.stderr: 32350K .......... .......... .......... .......... .......... 34% 286M 0s 2024-09-12T01:01:30.057 INFO:teuthology.orchestra.run.smithi070.stderr: 32400K .......... .......... .......... .......... .......... 34% 288M 0s 2024-09-12T01:01:30.057 INFO:teuthology.orchestra.run.smithi070.stderr: 32450K .......... .......... .......... .......... .......... 34% 282M 0s 2024-09-12T01:01:30.058 INFO:teuthology.orchestra.run.smithi070.stderr: 32500K .......... .......... .......... .......... .......... 35% 308M 0s 2024-09-12T01:01:30.058 INFO:teuthology.orchestra.run.smithi070.stderr: 32550K .......... .......... .......... .......... .......... 35% 6.89M 0s 2024-09-12T01:01:30.058 INFO:teuthology.orchestra.run.smithi070.stderr: 32600K .......... .......... .......... .......... .......... 35% 288M 0s 2024-09-12T01:01:30.058 INFO:teuthology.orchestra.run.smithi070.stderr: 32650K .......... .......... .......... .......... .......... 35% 177M 0s 2024-09-12T01:01:30.058 INFO:teuthology.orchestra.run.smithi070.stderr: 32700K .......... .......... .......... .......... .......... 35% 268M 0s 2024-09-12T01:01:30.058 INFO:teuthology.orchestra.run.smithi070.stderr: 32750K .......... .......... .......... .......... .......... 35% 288M 0s 2024-09-12T01:01:30.058 INFO:teuthology.orchestra.run.smithi070.stderr: 32800K .......... .......... .......... .......... .......... 35% 281M 0s 2024-09-12T01:01:30.058 INFO:teuthology.orchestra.run.smithi070.stderr: 32850K .......... .......... .......... .......... .......... 35% 201M 0s 2024-09-12T01:01:30.058 INFO:teuthology.orchestra.run.smithi070.stderr: 32900K .......... .......... .......... .......... .......... 35% 267M 0s 2024-09-12T01:01:30.058 INFO:teuthology.orchestra.run.smithi070.stderr: 32950K .......... .......... .......... .......... .......... 35% 293M 0s 2024-09-12T01:01:30.058 INFO:teuthology.orchestra.run.smithi070.stderr: 33000K .......... .......... .......... .......... .......... 35% 239M 0s 2024-09-12T01:01:30.058 INFO:teuthology.orchestra.run.smithi070.stderr: 33050K .......... .......... .......... .......... .......... 35% 238M 0s 2024-09-12T01:01:30.058 INFO:teuthology.orchestra.run.smithi070.stderr: 33100K .......... .......... .......... .......... .......... 35% 271M 0s 2024-09-12T01:01:30.058 INFO:teuthology.orchestra.run.smithi070.stderr: 33150K .......... .......... .......... .......... .......... 35% 254M 0s 2024-09-12T01:01:30.058 INFO:teuthology.orchestra.run.smithi070.stderr: 33200K .......... .......... .......... .......... .......... 35% 273M 0s 2024-09-12T01:01:30.059 INFO:teuthology.orchestra.run.smithi070.stderr: 33250K .......... .......... .......... .......... .......... 35% 230M 0s 2024-09-12T01:01:30.059 INFO:teuthology.orchestra.run.smithi070.stderr: 33300K .......... .......... .......... .......... .......... 35% 260M 0s 2024-09-12T01:01:30.059 INFO:teuthology.orchestra.run.smithi070.stderr: 33350K .......... .......... .......... .......... .......... 35% 302M 0s 2024-09-12T01:01:30.059 INFO:teuthology.orchestra.run.smithi070.stderr: 33400K .......... .......... .......... .......... .......... 36% 299M 0s 2024-09-12T01:01:30.059 INFO:teuthology.orchestra.run.smithi070.stderr: 33450K .......... .......... .......... .......... .......... 36% 262M 0s 2024-09-12T01:01:30.059 INFO:teuthology.orchestra.run.smithi070.stderr: 33500K .......... .......... .......... .......... .......... 36% 299M 0s 2024-09-12T01:01:30.059 INFO:teuthology.orchestra.run.smithi070.stderr: 33550K .......... .......... .......... .......... .......... 36% 309M 0s 2024-09-12T01:01:30.059 INFO:teuthology.orchestra.run.smithi070.stderr: 33600K .......... .......... .......... .......... .......... 36% 314M 0s 2024-09-12T01:01:30.059 INFO:teuthology.orchestra.run.smithi070.stderr: 33650K .......... .......... .......... .......... .......... 36% 281M 0s 2024-09-12T01:01:30.059 INFO:teuthology.orchestra.run.smithi070.stderr: 33700K .......... .......... .......... .......... .......... 36% 293M 0s 2024-09-12T01:01:30.059 INFO:teuthology.orchestra.run.smithi070.stderr: 33750K .......... .......... .......... .......... .......... 36% 227M 0s 2024-09-12T01:01:30.059 INFO:teuthology.orchestra.run.smithi070.stderr: 33800K .......... .......... .......... .......... .......... 36% 276M 0s 2024-09-12T01:01:30.060 INFO:teuthology.orchestra.run.smithi070.stderr: 33850K .......... .......... .......... .......... .......... 36% 311M 0s 2024-09-12T01:01:30.060 INFO:teuthology.orchestra.run.smithi070.stderr: 33900K .......... .......... .......... .......... .......... 36% 281M 0s 2024-09-12T01:01:30.060 INFO:teuthology.orchestra.run.smithi070.stderr: 33950K .......... .......... .......... .......... .......... 36% 248M 0s 2024-09-12T01:01:30.060 INFO:teuthology.orchestra.run.smithi070.stderr: 34000K .......... .......... .......... .......... .......... 36% 277M 0s 2024-09-12T01:01:30.060 INFO:teuthology.orchestra.run.smithi070.stderr: 34050K .......... .......... .......... .......... .......... 36% 286M 0s 2024-09-12T01:01:30.060 INFO:teuthology.orchestra.run.smithi070.stderr: 34100K .......... .......... .......... .......... .......... 36% 274M 0s 2024-09-12T01:01:30.060 INFO:teuthology.orchestra.run.smithi070.stderr: 34150K .......... .......... .......... .......... .......... 36% 245M 0s 2024-09-12T01:01:30.060 INFO:teuthology.orchestra.run.smithi070.stderr: 34200K .......... .......... .......... .......... .......... 36% 279M 0s 2024-09-12T01:01:30.060 INFO:teuthology.orchestra.run.smithi070.stderr: 34250K .......... .......... .......... .......... .......... 36% 276M 0s 2024-09-12T01:01:30.060 INFO:teuthology.orchestra.run.smithi070.stderr: 34300K .......... .......... .......... .......... .......... 36% 307M 0s 2024-09-12T01:01:30.060 INFO:teuthology.orchestra.run.smithi070.stderr: 34350K .......... .......... .......... .......... .......... 37% 226M 0s 2024-09-12T01:01:30.060 INFO:teuthology.orchestra.run.smithi070.stderr: 34400K .......... .......... .......... .......... .......... 37% 285M 0s 2024-09-12T01:01:30.060 INFO:teuthology.orchestra.run.smithi070.stderr: 34450K .......... .......... .......... .......... .......... 37% 306M 0s 2024-09-12T01:01:30.060 INFO:teuthology.orchestra.run.smithi070.stderr: 34500K .......... .......... .......... .......... .......... 37% 304M 0s 2024-09-12T01:01:30.060 INFO:teuthology.orchestra.run.smithi070.stderr: 34550K .......... .......... .......... .......... .......... 37% 273M 0s 2024-09-12T01:01:30.061 INFO:teuthology.orchestra.run.smithi070.stderr: 34600K .......... .......... .......... .......... .......... 37% 286M 0s 2024-09-12T01:01:30.061 INFO:teuthology.orchestra.run.smithi070.stderr: 34650K .......... .......... .......... .......... .......... 37% 314M 0s 2024-09-12T01:01:30.061 INFO:teuthology.orchestra.run.smithi070.stderr: 34700K .......... .......... .......... .......... .......... 37% 318M 0s 2024-09-12T01:01:30.061 INFO:teuthology.orchestra.run.smithi070.stderr: 34750K .......... .......... .......... .......... .......... 37% 144M 0s 2024-09-12T01:01:30.061 INFO:teuthology.orchestra.run.smithi070.stderr: 34800K .......... .......... .......... .......... .......... 37% 300M 0s 2024-09-12T01:01:30.061 INFO:teuthology.orchestra.run.smithi070.stderr: 34850K .......... .......... .......... .......... .......... 37% 148M 0s 2024-09-12T01:01:30.061 INFO:teuthology.orchestra.run.smithi070.stderr: 34900K .......... .......... .......... .......... .......... 37% 208M 0s 2024-09-12T01:01:30.061 INFO:teuthology.orchestra.run.smithi070.stderr: 34950K .......... .......... .......... .......... .......... 37% 168M 0s 2024-09-12T01:01:30.061 INFO:teuthology.orchestra.run.smithi070.stderr: 35000K .......... .......... .......... .......... .......... 37% 260M 0s 2024-09-12T01:01:30.061 INFO:teuthology.orchestra.run.smithi070.stderr: 35050K .......... .......... .......... .......... .......... 37% 94.7M 0s 2024-09-12T01:01:30.061 INFO:teuthology.orchestra.run.smithi070.stderr: 35100K .......... .......... .......... .......... .......... 37% 290M 0s 2024-09-12T01:01:30.061 INFO:teuthology.orchestra.run.smithi070.stderr: 35150K .......... .......... .......... .......... .......... 37% 233M 0s 2024-09-12T01:01:30.061 INFO:teuthology.orchestra.run.smithi070.stderr: 35200K .......... .......... .......... .......... .......... 37% 271M 0s 2024-09-12T01:01:30.061 INFO:teuthology.orchestra.run.smithi070.stderr: 35250K .......... .......... .......... .......... .......... 37% 73.0M 0s 2024-09-12T01:01:30.062 INFO:teuthology.orchestra.run.smithi070.stderr: 35300K .......... .......... .......... .......... .......... 38% 200M 0s 2024-09-12T01:01:30.062 INFO:teuthology.orchestra.run.smithi070.stderr: 35350K .......... .......... .......... .......... .......... 38% 181M 0s 2024-09-12T01:01:30.062 INFO:teuthology.orchestra.run.smithi070.stderr: 35400K .......... .......... .......... .......... .......... 38% 297M 0s 2024-09-12T01:01:30.062 INFO:teuthology.orchestra.run.smithi070.stderr: 35450K .......... .......... .......... .......... .......... 38% 135M 0s 2024-09-12T01:01:30.062 INFO:teuthology.orchestra.run.smithi070.stderr: 35500K .......... .......... .......... .......... .......... 38% 221M 0s 2024-09-12T01:01:30.062 INFO:teuthology.orchestra.run.smithi070.stderr: 35550K .......... .......... .......... .......... .......... 38% 247M 0s 2024-09-12T01:01:30.062 INFO:teuthology.orchestra.run.smithi070.stderr: 35600K .......... .......... .......... .......... .......... 38% 48.4M 0s 2024-09-12T01:01:30.062 INFO:teuthology.orchestra.run.smithi070.stderr: 35650K .......... .......... .......... .......... .......... 38% 35.7M 0s 2024-09-12T01:01:30.062 INFO:teuthology.orchestra.run.smithi070.stderr: 35700K .......... .......... .......... .......... .......... 38% 219M 0s 2024-09-12T01:01:30.062 INFO:teuthology.orchestra.run.smithi070.stderr: 35750K .......... .......... .......... .......... .......... 38% 201M 0s 2024-09-12T01:01:30.062 INFO:teuthology.orchestra.run.smithi070.stderr: 35800K .......... .......... .......... .......... .......... 38% 73.6M 0s 2024-09-12T01:01:30.062 INFO:teuthology.orchestra.run.smithi070.stderr: 35850K .......... .......... .......... .......... .......... 38% 149M 0s 2024-09-12T01:01:30.062 INFO:teuthology.orchestra.run.smithi070.stderr: 35900K .......... .......... .......... .......... .......... 38% 237M 0s 2024-09-12T01:01:30.062 INFO:teuthology.orchestra.run.smithi070.stderr: 35950K .......... .......... .......... .......... .......... 38% 227M 0s 2024-09-12T01:01:30.063 INFO:teuthology.orchestra.run.smithi070.stderr: 36000K .......... .......... .......... .......... .......... 38% 59.5M 0s 2024-09-12T01:01:30.063 INFO:teuthology.orchestra.run.smithi070.stderr: 36050K .......... .......... .......... .......... .......... 38% 285M 0s 2024-09-12T01:01:30.063 INFO:teuthology.orchestra.run.smithi070.stderr: 36100K .......... .......... .......... .......... .......... 38% 196M 0s 2024-09-12T01:01:30.063 INFO:teuthology.orchestra.run.smithi070.stderr: 36150K .......... .......... .......... .......... .......... 38% 255M 0s 2024-09-12T01:01:30.063 INFO:teuthology.orchestra.run.smithi070.stderr: 36200K .......... .......... .......... .......... .......... 39% 149M 0s 2024-09-12T01:01:30.063 INFO:teuthology.orchestra.run.smithi070.stderr: 36250K .......... .......... .......... .......... .......... 39% 268M 0s 2024-09-12T01:01:30.063 INFO:teuthology.orchestra.run.smithi070.stderr: 36300K .......... .......... .......... .......... .......... 39% 136M 0s 2024-09-12T01:01:30.063 INFO:teuthology.orchestra.run.smithi070.stderr: 36350K .......... .......... .......... .......... .......... 39% 188M 0s 2024-09-12T01:01:30.063 INFO:teuthology.orchestra.run.smithi070.stderr: 36400K .......... .......... .......... .......... .......... 39% 279M 0s 2024-09-12T01:01:30.063 INFO:teuthology.orchestra.run.smithi070.stderr: 36450K .......... .......... .......... .......... .......... 39% 292M 0s 2024-09-12T01:01:30.063 INFO:teuthology.orchestra.run.smithi070.stderr: 36500K .......... .......... .......... .......... .......... 39% 297M 0s 2024-09-12T01:01:30.063 INFO:teuthology.orchestra.run.smithi070.stderr: 36550K .......... .......... .......... .......... .......... 39% 277M 0s 2024-09-12T01:01:30.063 INFO:teuthology.orchestra.run.smithi070.stderr: 36600K .......... .......... .......... .......... .......... 39% 108M 0s 2024-09-12T01:01:30.063 INFO:teuthology.orchestra.run.smithi070.stderr: 36650K .......... .......... .......... .......... .......... 39% 233M 0s 2024-09-12T01:01:30.063 INFO:teuthology.orchestra.run.smithi070.stderr: 36700K .......... .......... .......... .......... .......... 39% 212M 0s 2024-09-12T01:01:30.064 INFO:teuthology.orchestra.run.smithi070.stderr: 36750K .......... .......... .......... .......... .......... 39% 196M 0s 2024-09-12T01:01:30.064 INFO:teuthology.orchestra.run.smithi070.stderr: 36800K .......... .......... .......... .......... .......... 39% 248M 0s 2024-09-12T01:01:30.064 INFO:teuthology.orchestra.run.smithi070.stderr: 36850K .......... .......... .......... .......... .......... 39% 270M 0s 2024-09-12T01:01:30.064 INFO:teuthology.orchestra.run.smithi070.stderr: 36900K .......... .......... .......... .......... .......... 39% 225M 0s 2024-09-12T01:01:30.064 INFO:teuthology.orchestra.run.smithi070.stderr: 36950K .......... .......... .......... .......... .......... 39% 181M 0s 2024-09-12T01:01:30.064 INFO:teuthology.orchestra.run.smithi070.stderr: 37000K .......... .......... .......... .......... .......... 39% 288M 0s 2024-09-12T01:01:30.064 INFO:teuthology.orchestra.run.smithi070.stderr: 37050K .......... .......... .......... .......... .......... 39% 304M 0s 2024-09-12T01:01:30.064 INFO:teuthology.orchestra.run.smithi070.stderr: 37100K .......... .......... .......... .......... .......... 39% 304M 0s 2024-09-12T01:01:30.064 INFO:teuthology.orchestra.run.smithi070.stderr: 37150K .......... .......... .......... .......... .......... 40% 259M 0s 2024-09-12T01:01:30.064 INFO:teuthology.orchestra.run.smithi070.stderr: 37200K .......... .......... .......... .......... .......... 40% 304M 0s 2024-09-12T01:01:30.064 INFO:teuthology.orchestra.run.smithi070.stderr: 37250K .......... .......... .......... .......... .......... 40% 53.9M 0s 2024-09-12T01:01:30.064 INFO:teuthology.orchestra.run.smithi070.stderr: 37300K .......... .......... .......... .......... .......... 40% 279M 0s 2024-09-12T01:01:30.064 INFO:teuthology.orchestra.run.smithi070.stderr: 37350K .......... .......... .......... .......... .......... 40% 226M 0s 2024-09-12T01:01:30.064 INFO:teuthology.orchestra.run.smithi070.stderr: 37400K .......... .......... .......... .......... .......... 40% 295M 0s 2024-09-12T01:01:30.065 INFO:teuthology.orchestra.run.smithi070.stderr: 37450K .......... .......... .......... .......... .......... 40% 66.4M 0s 2024-09-12T01:01:30.065 INFO:teuthology.orchestra.run.smithi070.stderr: 37500K .......... .......... .......... .......... .......... 40% 270M 0s 2024-09-12T01:01:30.065 INFO:teuthology.orchestra.run.smithi070.stderr: 37550K .......... .......... .......... .......... .......... 40% 211M 0s 2024-09-12T01:01:30.065 INFO:teuthology.orchestra.run.smithi070.stderr: 37600K .......... .......... .......... .......... .......... 40% 284M 0s 2024-09-12T01:01:30.065 INFO:teuthology.orchestra.run.smithi070.stderr: 37650K .......... .......... .......... .......... .......... 40% 78.2M 0s 2024-09-12T01:01:30.065 INFO:teuthology.orchestra.run.smithi070.stderr: 37700K .......... .......... .......... .......... .......... 40% 285M 0s 2024-09-12T01:01:30.065 INFO:teuthology.orchestra.run.smithi070.stderr: 37750K .......... .......... .......... .......... .......... 40% 146M 0s 2024-09-12T01:01:30.065 INFO:teuthology.orchestra.run.smithi070.stderr: 37800K .......... .......... .......... .......... .......... 40% 208M 0s 2024-09-12T01:01:30.065 INFO:teuthology.orchestra.run.smithi070.stderr: 37850K .......... .......... .......... .......... .......... 40% 275M 0s 2024-09-12T01:01:30.065 INFO:teuthology.orchestra.run.smithi070.stderr: 37900K .......... .......... .......... .......... .......... 40% 305M 0s 2024-09-12T01:01:30.065 INFO:teuthology.orchestra.run.smithi070.stderr: 37950K .......... .......... .......... .......... .......... 40% 220M 0s 2024-09-12T01:01:30.065 INFO:teuthology.orchestra.run.smithi070.stderr: 38000K .......... .......... .......... .......... .......... 40% 299M 0s 2024-09-12T01:01:30.065 INFO:teuthology.orchestra.run.smithi070.stderr: 38050K .......... .......... .......... .......... .......... 41% 263M 0s 2024-09-12T01:01:30.065 INFO:teuthology.orchestra.run.smithi070.stderr: 38100K .......... .......... .......... .......... .......... 41% 304M 0s 2024-09-12T01:01:30.066 INFO:teuthology.orchestra.run.smithi070.stderr: 38150K .......... .......... .......... .......... .......... 41% 236M 0s 2024-09-12T01:01:30.066 INFO:teuthology.orchestra.run.smithi070.stderr: 38200K .......... .......... .......... .......... .......... 41% 95.4M 0s 2024-09-12T01:01:30.066 INFO:teuthology.orchestra.run.smithi070.stderr: 38250K .......... .......... .......... .......... .......... 41% 292M 0s 2024-09-12T01:01:30.066 INFO:teuthology.orchestra.run.smithi070.stderr: 38300K .......... .......... .......... .......... .......... 41% 302M 0s 2024-09-12T01:01:30.066 INFO:teuthology.orchestra.run.smithi070.stderr: 38350K .......... .......... .......... .......... .......... 41% 54.6M 0s 2024-09-12T01:01:30.066 INFO:teuthology.orchestra.run.smithi070.stderr: 38400K .......... .......... .......... .......... .......... 41% 197M 0s 2024-09-12T01:01:30.066 INFO:teuthology.orchestra.run.smithi070.stderr: 38450K .......... .......... .......... .......... .......... 41% 291M 0s 2024-09-12T01:01:30.066 INFO:teuthology.orchestra.run.smithi070.stderr: 38500K .......... .......... .......... .......... .......... 41% 297M 0s 2024-09-12T01:01:30.066 INFO:teuthology.orchestra.run.smithi070.stderr: 38550K .......... .......... .......... .......... .......... 41% 257M 0s 2024-09-12T01:01:30.066 INFO:teuthology.orchestra.run.smithi070.stderr: 38600K .......... .......... .......... .......... .......... 41% 189M 0s 2024-09-12T01:01:30.066 INFO:teuthology.orchestra.run.smithi070.stderr: 38650K .......... .......... .......... .......... .......... 41% 278M 0s 2024-09-12T01:01:30.066 INFO:teuthology.orchestra.run.smithi070.stderr: 38700K .......... .......... .......... .......... .......... 41% 212M 0s 2024-09-12T01:01:30.066 INFO:teuthology.orchestra.run.smithi070.stderr: 38750K .......... .......... .......... .......... .......... 41% 193M 0s 2024-09-12T01:01:30.066 INFO:teuthology.orchestra.run.smithi070.stderr: 38800K .......... .......... .......... .......... .......... 41% 266M 0s 2024-09-12T01:01:30.067 INFO:teuthology.orchestra.run.smithi070.stderr: 38850K .......... .......... .......... .......... .......... 41% 183M 0s 2024-09-12T01:01:30.067 INFO:teuthology.orchestra.run.smithi070.stderr: 38900K .......... .......... .......... .......... .......... 41% 257M 0s 2024-09-12T01:01:30.067 INFO:teuthology.orchestra.run.smithi070.stderr: 38950K .......... .......... .......... .......... .......... 41% 186M 0s 2024-09-12T01:01:30.067 INFO:teuthology.orchestra.run.smithi070.stderr: 39000K .......... .......... .......... .......... .......... 42% 266M 0s 2024-09-12T01:01:30.067 INFO:teuthology.orchestra.run.smithi070.stderr: 39050K .......... .......... .......... .......... .......... 42% 272M 0s 2024-09-12T01:01:30.067 INFO:teuthology.orchestra.run.smithi070.stderr: 39100K .......... .......... .......... .......... .......... 42% 192M 0s 2024-09-12T01:01:30.067 INFO:teuthology.orchestra.run.smithi070.stderr: 39150K .......... .......... .......... .......... .......... 42% 208M 0s 2024-09-12T01:01:30.067 INFO:teuthology.orchestra.run.smithi070.stderr: 39200K .......... .......... .......... .......... .......... 42% 266M 0s 2024-09-12T01:01:30.067 INFO:teuthology.orchestra.run.smithi070.stderr: 39250K .......... .......... .......... .......... .......... 42% 264M 0s 2024-09-12T01:01:30.067 INFO:teuthology.orchestra.run.smithi070.stderr: 39300K .......... .......... .......... .......... .......... 42% 297M 0s 2024-09-12T01:01:30.067 INFO:teuthology.orchestra.run.smithi070.stderr: 39350K .......... .......... .......... .......... .......... 42% 49.1M 0s 2024-09-12T01:01:30.067 INFO:teuthology.orchestra.run.smithi070.stderr: 39400K .......... .......... .......... .......... .......... 42% 292M 0s 2024-09-12T01:01:30.067 INFO:teuthology.orchestra.run.smithi070.stderr: 39450K .......... .......... .......... .......... .......... 42% 117M 0s 2024-09-12T01:01:30.067 INFO:teuthology.orchestra.run.smithi070.stderr: 39500K .......... .......... .......... .......... .......... 42% 274M 0s 2024-09-12T01:01:30.068 INFO:teuthology.orchestra.run.smithi070.stderr: 39550K .......... .......... .......... .......... .......... 42% 169M 0s 2024-09-12T01:01:30.068 INFO:teuthology.orchestra.run.smithi070.stderr: 39600K .......... .......... .......... .......... .......... 42% 296M 0s 2024-09-12T01:01:30.068 INFO:teuthology.orchestra.run.smithi070.stderr: 39650K .......... .......... .......... .......... .......... 42% 275M 0s 2024-09-12T01:01:30.068 INFO:teuthology.orchestra.run.smithi070.stderr: 39700K .......... .......... .......... .......... .......... 42% 97.8M 0s 2024-09-12T01:01:30.068 INFO:teuthology.orchestra.run.smithi070.stderr: 39750K .......... .......... .......... .......... .......... 42% 172M 0s 2024-09-12T01:01:30.068 INFO:teuthology.orchestra.run.smithi070.stderr: 39800K .......... .......... .......... .......... .......... 42% 250M 0s 2024-09-12T01:01:30.068 INFO:teuthology.orchestra.run.smithi070.stderr: 39850K .......... .......... .......... .......... .......... 42% 263M 0s 2024-09-12T01:01:30.068 INFO:teuthology.orchestra.run.smithi070.stderr: 39900K .......... .......... .......... .......... .......... 43% 129M 0s 2024-09-12T01:01:30.068 INFO:teuthology.orchestra.run.smithi070.stderr: 39950K .......... .......... .......... .......... .......... 43% 206M 0s 2024-09-12T01:01:30.068 INFO:teuthology.orchestra.run.smithi070.stderr: 40000K .......... .......... .......... .......... .......... 43% 278M 0s 2024-09-12T01:01:30.068 INFO:teuthology.orchestra.run.smithi070.stderr: 40050K .......... .......... .......... .......... .......... 43% 295M 0s 2024-09-12T01:01:30.068 INFO:teuthology.orchestra.run.smithi070.stderr: 40100K .......... .......... .......... .......... .......... 43% 107M 0s 2024-09-12T01:01:30.068 INFO:teuthology.orchestra.run.smithi070.stderr: 40150K .......... .......... .......... .......... .......... 43% 229M 0s 2024-09-12T01:01:30.068 INFO:teuthology.orchestra.run.smithi070.stderr: 40200K .......... .......... .......... .......... .......... 43% 257M 0s 2024-09-12T01:01:30.069 INFO:teuthology.orchestra.run.smithi070.stderr: 40250K .......... .......... .......... .......... .......... 43% 291M 0s 2024-09-12T01:01:30.069 INFO:teuthology.orchestra.run.smithi070.stderr: 40300K .......... .......... .......... .......... .......... 43% 72.6M 0s 2024-09-12T01:01:30.069 INFO:teuthology.orchestra.run.smithi070.stderr: 40350K .......... .......... .......... .......... .......... 43% 178M 0s 2024-09-12T01:01:30.069 INFO:teuthology.orchestra.run.smithi070.stderr: 40400K .......... .......... .......... .......... .......... 43% 265M 0s 2024-09-12T01:01:30.069 INFO:teuthology.orchestra.run.smithi070.stderr: 40450K .......... .......... .......... .......... .......... 43% 251M 0s 2024-09-12T01:01:30.069 INFO:teuthology.orchestra.run.smithi070.stderr: 40500K .......... .......... .......... .......... .......... 43% 267M 0s 2024-09-12T01:01:30.069 INFO:teuthology.orchestra.run.smithi070.stderr: 40550K .......... .......... .......... .......... .......... 43% 225M 0s 2024-09-12T01:01:30.069 INFO:teuthology.orchestra.run.smithi070.stderr: 40600K .......... .......... .......... .......... .......... 43% 248M 0s 2024-09-12T01:01:30.069 INFO:teuthology.orchestra.run.smithi070.stderr: 40650K .......... .......... .......... .......... .......... 43% 270M 0s 2024-09-12T01:01:30.069 INFO:teuthology.orchestra.run.smithi070.stderr: 40700K .......... .......... .......... .......... .......... 43% 287M 0s 2024-09-12T01:01:30.069 INFO:teuthology.orchestra.run.smithi070.stderr: 40750K .......... .......... .......... .......... .......... 43% 255M 0s 2024-09-12T01:01:30.069 INFO:teuthology.orchestra.run.smithi070.stderr: 40800K .......... .......... .......... .......... .......... 43% 308M 0s 2024-09-12T01:01:30.069 INFO:teuthology.orchestra.run.smithi070.stderr: 40850K .......... .......... .......... .......... .......... 44% 298M 0s 2024-09-12T01:01:30.069 INFO:teuthology.orchestra.run.smithi070.stderr: 40900K .......... .......... .......... .......... .......... 44% 305M 0s 2024-09-12T01:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr: 40950K .......... .......... .......... .......... .......... 44% 57.5M 0s 2024-09-12T01:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr: 41000K .......... .......... .......... .......... .......... 44% 23.1M 0s 2024-09-12T01:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr: 41050K .......... .......... .......... .......... .......... 44% 203M 0s 2024-09-12T01:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr: 41100K .......... .......... .......... .......... .......... 44% 60.2M 0s 2024-09-12T01:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr: 41150K .......... .......... .......... .......... .......... 44% 154M 0s 2024-09-12T01:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr: 41200K .......... .......... .......... .......... .......... 44% 264M 0s 2024-09-12T01:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr: 41250K .......... .......... .......... .......... .......... 44% 285M 0s 2024-09-12T01:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr: 41300K .......... .......... .......... .......... .......... 44% 250M 0s 2024-09-12T01:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr: 41350K .......... .......... .......... .......... .......... 44% 261M 0s 2024-09-12T01:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr: 41400K .......... .......... .......... .......... .......... 44% 274M 0s 2024-09-12T01:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr: 41450K .......... .......... .......... .......... .......... 44% 242M 0s 2024-09-12T01:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr: 41500K .......... .......... .......... .......... .......... 44% 209M 0s 2024-09-12T01:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr: 41550K .......... .......... .......... .......... .......... 44% 264M 0s 2024-09-12T01:01:30.070 INFO:teuthology.orchestra.run.smithi070.stderr: 41600K .......... .......... .......... .......... .......... 44% 251M 0s 2024-09-12T01:01:30.071 INFO:teuthology.orchestra.run.smithi070.stderr: 41650K .......... .......... .......... .......... .......... 44% 253M 0s 2024-09-12T01:01:30.071 INFO:teuthology.orchestra.run.smithi070.stderr: 41700K .......... .......... .......... .......... .......... 44% 254M 0s 2024-09-12T01:01:30.071 INFO:teuthology.orchestra.run.smithi070.stderr: 41750K .......... .......... .......... .......... .......... 44% 253M 0s 2024-09-12T01:01:30.071 INFO:teuthology.orchestra.run.smithi070.stderr: 41800K .......... .......... .......... .......... .......... 45% 249M 0s 2024-09-12T01:01:30.071 INFO:teuthology.orchestra.run.smithi070.stderr: 41850K .......... .......... .......... .......... .......... 45% 250M 0s 2024-09-12T01:01:30.071 INFO:teuthology.orchestra.run.smithi070.stderr: 41900K .......... .......... .......... .......... .......... 45% 219M 0s 2024-09-12T01:01:30.071 INFO:teuthology.orchestra.run.smithi070.stderr: 41950K .......... .......... .......... .......... .......... 45% 253M 0s 2024-09-12T01:01:30.071 INFO:teuthology.orchestra.run.smithi070.stderr: 42000K .......... .......... .......... .......... .......... 45% 268M 0s 2024-09-12T01:01:30.071 INFO:teuthology.orchestra.run.smithi070.stderr: 42050K .......... .......... .......... .......... .......... 45% 284M 0s 2024-09-12T01:01:30.071 INFO:teuthology.orchestra.run.smithi070.stderr: 42100K .......... .......... .......... .......... .......... 45% 230M 0s 2024-09-12T01:01:30.071 INFO:teuthology.orchestra.run.smithi070.stderr: 42150K .......... .......... .......... .......... .......... 45% 261M 0s 2024-09-12T01:01:30.071 INFO:teuthology.orchestra.run.smithi070.stderr: 42200K .......... .......... .......... .......... .......... 45% 296M 0s 2024-09-12T01:01:30.071 INFO:teuthology.orchestra.run.smithi070.stderr: 42250K .......... .......... .......... .......... .......... 45% 271M 0s 2024-09-12T01:01:30.071 INFO:teuthology.orchestra.run.smithi070.stderr: 42300K .......... .......... .......... .......... .......... 45% 221M 0s 2024-09-12T01:01:30.072 INFO:teuthology.orchestra.run.smithi070.stderr: 42350K .......... .......... .......... .......... .......... 45% 297M 0s 2024-09-12T01:01:30.072 INFO:teuthology.orchestra.run.smithi070.stderr: 42400K .......... .......... .......... .......... .......... 45% 291M 0s 2024-09-12T01:01:30.072 INFO:teuthology.orchestra.run.smithi070.stderr: 42450K .......... .......... .......... .......... .......... 45% 289M 0s 2024-09-12T01:01:30.072 INFO:teuthology.orchestra.run.smithi070.stderr: 42500K .......... .......... .......... .......... .......... 45% 241M 0s 2024-09-12T01:01:30.072 INFO:teuthology.orchestra.run.smithi070.stderr: 42550K .......... .......... .......... .......... .......... 45% 290M 0s 2024-09-12T01:01:30.072 INFO:teuthology.orchestra.run.smithi070.stderr: 42600K .......... .......... .......... .......... .......... 45% 21.4M 0s 2024-09-12T01:01:30.072 INFO:teuthology.orchestra.run.smithi070.stderr: 42650K .......... .......... .......... .......... .......... 45% 28.6M 0s 2024-09-12T01:01:30.072 INFO:teuthology.orchestra.run.smithi070.stderr: 42700K .......... .......... .......... .......... .......... 46% 202M 0s 2024-09-12T01:01:30.072 INFO:teuthology.orchestra.run.smithi070.stderr: 42750K .......... .......... .......... .......... .......... 46% 258M 0s 2024-09-12T01:01:30.072 INFO:teuthology.orchestra.run.smithi070.stderr: 42800K .......... .......... .......... .......... .......... 46% 282M 0s 2024-09-12T01:01:30.072 INFO:teuthology.orchestra.run.smithi070.stderr: 42850K .......... .......... .......... .......... .......... 46% 272M 0s 2024-09-12T01:01:30.072 INFO:teuthology.orchestra.run.smithi070.stderr: 42900K .......... .......... .......... .......... .......... 46% 84.3M 0s 2024-09-12T01:01:30.072 INFO:teuthology.orchestra.run.smithi070.stderr: 42950K .......... .......... .......... .......... .......... 46% 244M 0s 2024-09-12T01:01:30.072 INFO:teuthology.orchestra.run.smithi070.stderr: 43000K .......... .......... .......... .......... .......... 46% 270M 0s 2024-09-12T01:01:30.073 INFO:teuthology.orchestra.run.smithi070.stderr: 43050K .......... .......... .......... .......... .......... 46% 135M 0s 2024-09-12T01:01:30.073 INFO:teuthology.orchestra.run.smithi070.stderr: 43100K .......... .......... .......... .......... .......... 46% 222M 0s 2024-09-12T01:01:30.073 INFO:teuthology.orchestra.run.smithi070.stderr: 43150K .......... .......... .......... .......... .......... 46% 10.5M 0s 2024-09-12T01:01:30.073 INFO:teuthology.orchestra.run.smithi070.stderr: 43200K .......... .......... .......... .......... .......... 46% 264M 0s 2024-09-12T01:01:30.073 INFO:teuthology.orchestra.run.smithi070.stderr: 43250K .......... .......... .......... .......... .......... 46% 103M 0s 2024-09-12T01:01:30.073 INFO:teuthology.orchestra.run.smithi070.stderr: 43300K .......... .......... .......... .......... .......... 46% 37.1M 0s 2024-09-12T01:01:30.073 INFO:teuthology.orchestra.run.smithi070.stderr: 43350K .......... .......... .......... .......... .......... 46% 184M 0s 2024-09-12T01:01:30.073 INFO:teuthology.orchestra.run.smithi070.stderr: 43400K .......... .......... .......... .......... .......... 46% 250M 0s 2024-09-12T01:01:30.073 INFO:teuthology.orchestra.run.smithi070.stderr: 43450K .......... .......... .......... .......... .......... 46% 287M 0s 2024-09-12T01:01:30.073 INFO:teuthology.orchestra.run.smithi070.stderr: 43500K .......... .......... .......... .......... .......... 46% 58.7M 0s 2024-09-12T01:01:30.073 INFO:teuthology.orchestra.run.smithi070.stderr: 43550K .......... .......... .......... .......... .......... 46% 261M 0s 2024-09-12T01:01:30.073 INFO:teuthology.orchestra.run.smithi070.stderr: 43600K .......... .......... .......... .......... .......... 46% 266M 0s 2024-09-12T01:01:30.073 INFO:teuthology.orchestra.run.smithi070.stderr: 43650K .......... .......... .......... .......... .......... 47% 252M 0s 2024-09-12T01:01:30.073 INFO:teuthology.orchestra.run.smithi070.stderr: 43700K .......... .......... .......... .......... .......... 47% 216M 0s 2024-09-12T01:01:30.074 INFO:teuthology.orchestra.run.smithi070.stderr: 43750K .......... .......... .......... .......... .......... 47% 281M 0s 2024-09-12T01:01:30.074 INFO:teuthology.orchestra.run.smithi070.stderr: 43800K .......... .......... .......... .......... .......... 47% 295M 0s 2024-09-12T01:01:30.074 INFO:teuthology.orchestra.run.smithi070.stderr: 43850K .......... .......... .......... .......... .......... 47% 145M 0s 2024-09-12T01:01:30.074 INFO:teuthology.orchestra.run.smithi070.stderr: 43900K .......... .......... .......... .......... .......... 47% 222M 0s 2024-09-12T01:01:30.074 INFO:teuthology.orchestra.run.smithi070.stderr: 43950K .......... .......... .......... .......... .......... 47% 289M 0s 2024-09-12T01:01:30.074 INFO:teuthology.orchestra.run.smithi070.stderr: 44000K .......... .......... .......... .......... .......... 47% 168M 0s 2024-09-12T01:01:30.074 INFO:teuthology.orchestra.run.smithi070.stderr: 44050K .......... .......... .......... .......... .......... 47% 95.0M 0s 2024-09-12T01:01:30.074 INFO:teuthology.orchestra.run.smithi070.stderr: 44100K .......... .......... .......... .......... .......... 47% 208M 0s 2024-09-12T01:01:30.074 INFO:teuthology.orchestra.run.smithi070.stderr: 44150K .......... .......... .......... .......... .......... 47% 264M 0s 2024-09-12T01:01:30.074 INFO:teuthology.orchestra.run.smithi070.stderr: 44200K .......... .......... .......... .......... .......... 47% 240M 0s 2024-09-12T01:01:30.074 INFO:teuthology.orchestra.run.smithi070.stderr: 44250K .......... .......... .......... .......... .......... 47% 249M 0s 2024-09-12T01:01:30.074 INFO:teuthology.orchestra.run.smithi070.stderr: 44300K .......... .......... .......... .......... .......... 47% 220M 0s 2024-09-12T01:01:30.074 INFO:teuthology.orchestra.run.smithi070.stderr: 44350K .......... .......... .......... .......... .......... 47% 281M 0s 2024-09-12T01:01:30.074 INFO:teuthology.orchestra.run.smithi070.stderr: 44400K .......... .......... .......... .......... .......... 47% 257M 0s 2024-09-12T01:01:30.074 INFO:teuthology.orchestra.run.smithi070.stderr: 44450K .......... .......... .......... .......... .......... 47% 287M 0s 2024-09-12T01:01:30.075 INFO:teuthology.orchestra.run.smithi070.stderr: 44500K .......... .......... .......... .......... .......... 47% 246M 0s 2024-09-12T01:01:30.075 INFO:teuthology.orchestra.run.smithi070.stderr: 44550K .......... .......... .......... .......... .......... 48% 264M 0s 2024-09-12T01:01:30.075 INFO:teuthology.orchestra.run.smithi070.stderr: 44600K .......... .......... .......... .......... .......... 48% 269M 0s 2024-09-12T01:01:30.075 INFO:teuthology.orchestra.run.smithi070.stderr: 44650K .......... .......... .......... .......... .......... 48% 287M 0s 2024-09-12T01:01:30.075 INFO:teuthology.orchestra.run.smithi070.stderr: 44700K .......... .......... .......... .......... .......... 48% 224M 0s 2024-09-12T01:01:30.075 INFO:teuthology.orchestra.run.smithi070.stderr: 44750K .......... .......... .......... .......... .......... 48% 282M 0s 2024-09-12T01:01:30.075 INFO:teuthology.orchestra.run.smithi070.stderr: 44800K .......... .......... .......... .......... .......... 48% 291M 0s 2024-09-12T01:01:30.075 INFO:teuthology.orchestra.run.smithi070.stderr: 44850K .......... .......... .......... .......... .......... 48% 257M 0s 2024-09-12T01:01:30.075 INFO:teuthology.orchestra.run.smithi070.stderr: 44900K .......... .......... .......... .......... .......... 48% 216M 0s 2024-09-12T01:01:30.075 INFO:teuthology.orchestra.run.smithi070.stderr: 44950K .......... .......... .......... .......... .......... 48% 235M 0s 2024-09-12T01:01:30.075 INFO:teuthology.orchestra.run.smithi070.stderr: 45000K .......... .......... .......... .......... .......... 48% 285M 0s 2024-09-12T01:01:30.075 INFO:teuthology.orchestra.run.smithi070.stderr: 45050K .......... .......... .......... .......... .......... 48% 250M 0s 2024-09-12T01:01:30.075 INFO:teuthology.orchestra.run.smithi070.stderr: 45100K .......... .......... .......... .......... .......... 48% 222M 0s 2024-09-12T01:01:30.075 INFO:teuthology.orchestra.run.smithi070.stderr: 45150K .......... .......... .......... .......... .......... 48% 217M 0s 2024-09-12T01:01:30.076 INFO:teuthology.orchestra.run.smithi070.stderr: 45200K .......... .......... .......... .......... .......... 48% 293M 0s 2024-09-12T01:01:30.076 INFO:teuthology.orchestra.run.smithi070.stderr: 45250K .......... .......... .......... .......... .......... 48% 292M 0s 2024-09-12T01:01:30.076 INFO:teuthology.orchestra.run.smithi070.stderr: 45300K .......... .......... .......... .......... .......... 48% 105M 0s 2024-09-12T01:01:30.076 INFO:teuthology.orchestra.run.smithi070.stderr: 45350K .......... .......... .......... .......... .......... 48% 261M 0s 2024-09-12T01:01:30.076 INFO:teuthology.orchestra.run.smithi070.stderr: 45400K .......... .......... .......... .......... .......... 48% 252M 0s 2024-09-12T01:01:30.076 INFO:teuthology.orchestra.run.smithi070.stderr: 45450K .......... .......... .......... .......... .......... 48% 248M 0s 2024-09-12T01:01:30.076 INFO:teuthology.orchestra.run.smithi070.stderr: 45500K .......... .......... .......... .......... .......... 49% 210M 0s 2024-09-12T01:01:30.076 INFO:teuthology.orchestra.run.smithi070.stderr: 45550K .......... .......... .......... .......... .......... 49% 289M 0s 2024-09-12T01:01:30.076 INFO:teuthology.orchestra.run.smithi070.stderr: 45600K .......... .......... .......... .......... .......... 49% 298M 0s 2024-09-12T01:01:30.076 INFO:teuthology.orchestra.run.smithi070.stderr: 45650K .......... .......... .......... .......... .......... 49% 265M 0s 2024-09-12T01:01:30.076 INFO:teuthology.orchestra.run.smithi070.stderr: 45700K .......... .......... .......... .......... .......... 49% 239M 0s 2024-09-12T01:01:30.076 INFO:teuthology.orchestra.run.smithi070.stderr: 45750K .......... .......... .......... .......... .......... 49% 268M 0s 2024-09-12T01:01:30.076 INFO:teuthology.orchestra.run.smithi070.stderr: 45800K .......... .......... .......... .......... .......... 49% 256M 0s 2024-09-12T01:01:30.076 INFO:teuthology.orchestra.run.smithi070.stderr: 45850K .......... .......... .......... .......... .......... 49% 268M 0s 2024-09-12T01:01:30.077 INFO:teuthology.orchestra.run.smithi070.stderr: 45900K .......... .......... .......... .......... .......... 49% 240M 0s 2024-09-12T01:01:30.077 INFO:teuthology.orchestra.run.smithi070.stderr: 45950K .......... .......... .......... .......... .......... 49% 273M 0s 2024-09-12T01:01:30.077 INFO:teuthology.orchestra.run.smithi070.stderr: 46000K .......... .......... .......... .......... .......... 49% 280M 0s 2024-09-12T01:01:30.077 INFO:teuthology.orchestra.run.smithi070.stderr: 46050K .......... .......... .......... .......... .......... 49% 298M 0s 2024-09-12T01:01:30.077 INFO:teuthology.orchestra.run.smithi070.stderr: 46100K .......... .......... .......... .......... .......... 49% 267M 0s 2024-09-12T01:01:30.077 INFO:teuthology.orchestra.run.smithi070.stderr: 46150K .......... .......... .......... .......... .......... 49% 227M 0s 2024-09-12T01:01:30.077 INFO:teuthology.orchestra.run.smithi070.stderr: 46200K .......... .......... .......... .......... .......... 49% 291M 0s 2024-09-12T01:01:30.077 INFO:teuthology.orchestra.run.smithi070.stderr: 46250K .......... .......... .......... .......... .......... 49% 285M 0s 2024-09-12T01:01:30.077 INFO:teuthology.orchestra.run.smithi070.stderr: 46300K .......... .......... .......... .......... .......... 49% 220M 0s 2024-09-12T01:01:30.077 INFO:teuthology.orchestra.run.smithi070.stderr: 46350K .......... .......... .......... .......... .......... 49% 284M 0s 2024-09-12T01:01:30.077 INFO:teuthology.orchestra.run.smithi070.stderr: 46400K .......... .......... .......... .......... .......... 49% 257M 0s 2024-09-12T01:01:30.077 INFO:teuthology.orchestra.run.smithi070.stderr: 46450K .......... .......... .......... .......... .......... 50% 284M 0s 2024-09-12T01:01:30.077 INFO:teuthology.orchestra.run.smithi070.stderr: 46500K .......... .......... .......... .......... .......... 50% 247M 0s 2024-09-12T01:01:30.078 INFO:teuthology.orchestra.run.smithi070.stderr: 46550K .......... .......... .......... .......... .......... 50% 33.8M 0s 2024-09-12T01:01:30.078 INFO:teuthology.orchestra.run.smithi070.stderr: 46600K .......... .......... .......... .......... .......... 50% 202M 0s 2024-09-12T01:01:30.078 INFO:teuthology.orchestra.run.smithi070.stderr: 46650K .......... .......... .......... .......... .......... 50% 288M 0s 2024-09-12T01:01:30.078 INFO:teuthology.orchestra.run.smithi070.stderr: 46700K .......... .......... .......... .......... .......... 50% 86.3M 0s 2024-09-12T01:01:30.078 INFO:teuthology.orchestra.run.smithi070.stderr: 46750K .......... .......... .......... .......... .......... 50% 261M 0s 2024-09-12T01:01:30.078 INFO:teuthology.orchestra.run.smithi070.stderr: 46800K .......... .......... .......... .......... .......... 50% 16.4M 0s 2024-09-12T01:01:30.078 INFO:teuthology.orchestra.run.smithi070.stderr: 46850K .......... .......... .......... .......... .......... 50% 59.3M 0s 2024-09-12T01:01:30.078 INFO:teuthology.orchestra.run.smithi070.stderr: 46900K .......... .......... .......... .......... .......... 50% 130M 0s 2024-09-12T01:01:30.078 INFO:teuthology.orchestra.run.smithi070.stderr: 46950K .......... .......... .......... .......... .......... 50% 242M 0s 2024-09-12T01:01:30.078 INFO:teuthology.orchestra.run.smithi070.stderr: 47000K .......... .......... .......... .......... .......... 50% 250M 0s 2024-09-12T01:01:30.078 INFO:teuthology.orchestra.run.smithi070.stderr: 47050K .......... .......... .......... .......... .......... 50% 265M 0s 2024-09-12T01:01:30.078 INFO:teuthology.orchestra.run.smithi070.stderr: 47100K .......... .......... .......... .......... .......... 50% 215M 0s 2024-09-12T01:01:30.078 INFO:teuthology.orchestra.run.smithi070.stderr: 47150K .......... .......... .......... .......... .......... 50% 280M 0s 2024-09-12T01:01:30.078 INFO:teuthology.orchestra.run.smithi070.stderr: 47200K .......... .......... .......... .......... .......... 50% 271M 0s 2024-09-12T01:01:30.079 INFO:teuthology.orchestra.run.smithi070.stderr: 47250K .......... .......... .......... .......... .......... 50% 264M 0s 2024-09-12T01:01:30.079 INFO:teuthology.orchestra.run.smithi070.stderr: 47300K .......... .......... .......... .......... .......... 50% 241M 0s 2024-09-12T01:01:30.079 INFO:teuthology.orchestra.run.smithi070.stderr: 47350K .......... .......... .......... .......... .......... 51% 260M 0s 2024-09-12T01:01:30.079 INFO:teuthology.orchestra.run.smithi070.stderr: 47400K .......... .......... .......... .......... .......... 51% 257M 0s 2024-09-12T01:01:30.079 INFO:teuthology.orchestra.run.smithi070.stderr: 47450K .......... .......... .......... .......... .......... 51% 249M 0s 2024-09-12T01:01:30.079 INFO:teuthology.orchestra.run.smithi070.stderr: 47500K .......... .......... .......... .......... .......... 51% 195M 0s 2024-09-12T01:01:30.079 INFO:teuthology.orchestra.run.smithi070.stderr: 47550K .......... .......... .......... .......... .......... 51% 251M 0s 2024-09-12T01:01:30.079 INFO:teuthology.orchestra.run.smithi070.stderr: 47600K .......... .......... .......... .......... .......... 51% 241M 0s 2024-09-12T01:01:30.079 INFO:teuthology.orchestra.run.smithi070.stderr: 47650K .......... .......... .......... .......... .......... 51% 260M 0s 2024-09-12T01:01:30.079 INFO:teuthology.orchestra.run.smithi070.stderr: 47700K .......... .......... .......... .......... .......... 51% 243M 0s 2024-09-12T01:01:30.079 INFO:teuthology.orchestra.run.smithi070.stderr: 47750K .......... .......... .......... .......... .......... 51% 263M 0s 2024-09-12T01:01:30.079 INFO:teuthology.orchestra.run.smithi070.stderr: 47800K .......... .......... .......... .......... .......... 51% 289M 0s 2024-09-12T01:01:30.079 INFO:teuthology.orchestra.run.smithi070.stderr: 47850K .......... .......... .......... .......... .......... 51% 291M 0s 2024-09-12T01:01:30.079 INFO:teuthology.orchestra.run.smithi070.stderr: 47900K .......... .......... .......... .......... .......... 51% 233M 0s 2024-09-12T01:01:30.080 INFO:teuthology.orchestra.run.smithi070.stderr: 47950K .......... .......... .......... .......... .......... 51% 270M 0s 2024-09-12T01:01:30.080 INFO:teuthology.orchestra.run.smithi070.stderr: 48000K .......... .......... .......... .......... .......... 51% 272M 0s 2024-09-12T01:01:30.080 INFO:teuthology.orchestra.run.smithi070.stderr: 48050K .......... .......... .......... .......... .......... 51% 268M 0s 2024-09-12T01:01:30.080 INFO:teuthology.orchestra.run.smithi070.stderr: 48100K .......... .......... .......... .......... .......... 51% 259M 0s 2024-09-12T01:01:30.080 INFO:teuthology.orchestra.run.smithi070.stderr: 48150K .......... .......... .......... .......... .......... 51% 286M 0s 2024-09-12T01:01:30.080 INFO:teuthology.orchestra.run.smithi070.stderr: 48200K .......... .......... .......... .......... .......... 51% 259M 0s 2024-09-12T01:01:30.080 INFO:teuthology.orchestra.run.smithi070.stderr: 48250K .......... .......... .......... .......... .......... 51% 260M 0s 2024-09-12T01:01:30.080 INFO:teuthology.orchestra.run.smithi070.stderr: 48300K .......... .......... .......... .......... .......... 52% 217M 0s 2024-09-12T01:01:30.080 INFO:teuthology.orchestra.run.smithi070.stderr: 48350K .......... .......... .......... .......... .......... 52% 270M 0s 2024-09-12T01:01:30.080 INFO:teuthology.orchestra.run.smithi070.stderr: 48400K .......... .......... .......... .......... .......... 52% 250M 0s 2024-09-12T01:01:30.080 INFO:teuthology.orchestra.run.smithi070.stderr: 48450K .......... .......... .......... .......... .......... 52% 261M 0s 2024-09-12T01:01:30.080 INFO:teuthology.orchestra.run.smithi070.stderr: 48500K .......... .......... .......... .......... .......... 52% 250M 0s 2024-09-12T01:01:30.080 INFO:teuthology.orchestra.run.smithi070.stderr: 48550K .......... .......... .......... .......... .......... 52% 274M 0s 2024-09-12T01:01:30.080 INFO:teuthology.orchestra.run.smithi070.stderr: 48600K .......... .......... .......... .......... .......... 52% 20.2M 0s 2024-09-12T01:01:30.081 INFO:teuthology.orchestra.run.smithi070.stderr: 48650K .......... .......... .......... .......... .......... 52% 150M 0s 2024-09-12T01:01:30.081 INFO:teuthology.orchestra.run.smithi070.stderr: 48700K .......... .......... .......... .......... .......... 52% 221M 0s 2024-09-12T01:01:30.081 INFO:teuthology.orchestra.run.smithi070.stderr: 48750K .......... .......... .......... .......... .......... 52% 253M 0s 2024-09-12T01:01:30.081 INFO:teuthology.orchestra.run.smithi070.stderr: 48800K .......... .......... .......... .......... .......... 52% 263M 0s 2024-09-12T01:01:30.081 INFO:teuthology.orchestra.run.smithi070.stderr: 48850K .......... .......... .......... .......... .......... 52% 275M 0s 2024-09-12T01:01:30.081 INFO:teuthology.orchestra.run.smithi070.stderr: 48900K .......... .......... .......... .......... .......... 52% 264M 0s 2024-09-12T01:01:30.081 INFO:teuthology.orchestra.run.smithi070.stderr: 48950K .......... .......... .......... .......... .......... 52% 136M 0s 2024-09-12T01:01:30.081 INFO:teuthology.orchestra.run.smithi070.stderr: 49000K .......... .......... .......... .......... .......... 52% 241M 0s 2024-09-12T01:01:30.081 INFO:teuthology.orchestra.run.smithi070.stderr: 49050K .......... .......... .......... .......... .......... 52% 257M 0s 2024-09-12T01:01:30.081 INFO:teuthology.orchestra.run.smithi070.stderr: 49100K .......... .......... .......... .......... .......... 52% 245M 0s 2024-09-12T01:01:30.081 INFO:teuthology.orchestra.run.smithi070.stderr: 49150K .......... .......... .......... .......... .......... 52% 276M 0s 2024-09-12T01:01:30.081 INFO:teuthology.orchestra.run.smithi070.stderr: 49200K .......... .......... .......... .......... .......... 53% 67.3M 0s 2024-09-12T01:01:30.081 INFO:teuthology.orchestra.run.smithi070.stderr: 49250K .......... .......... .......... .......... .......... 53% 203M 0s 2024-09-12T01:01:30.081 INFO:teuthology.orchestra.run.smithi070.stderr: 49300K .......... .......... .......... .......... .......... 53% 230M 0s 2024-09-12T01:01:30.082 INFO:teuthology.orchestra.run.smithi070.stderr: 49350K .......... .......... .......... .......... .......... 53% 260M 0s 2024-09-12T01:01:30.082 INFO:teuthology.orchestra.run.smithi070.stderr: 49400K .......... .......... .......... .......... .......... 53% 269M 0s 2024-09-12T01:01:30.082 INFO:teuthology.orchestra.run.smithi070.stderr: 49450K .......... .......... .......... .......... .......... 53% 253M 0s 2024-09-12T01:01:30.082 INFO:teuthology.orchestra.run.smithi070.stderr: 49500K .......... .......... .......... .......... .......... 53% 217M 0s 2024-09-12T01:01:30.082 INFO:teuthology.orchestra.run.smithi070.stderr: 49550K .......... .......... .......... .......... .......... 53% 286M 0s 2024-09-12T01:01:30.082 INFO:teuthology.orchestra.run.smithi070.stderr: 49600K .......... .......... .......... .......... .......... 53% 290M 0s 2024-09-12T01:01:30.082 INFO:teuthology.orchestra.run.smithi070.stderr: 49650K .......... .......... .......... .......... .......... 53% 264M 0s 2024-09-12T01:01:30.082 INFO:teuthology.orchestra.run.smithi070.stderr: 49700K .......... .......... .......... .......... .......... 53% 242M 0s 2024-09-12T01:01:30.082 INFO:teuthology.orchestra.run.smithi070.stderr: 49750K .......... .......... .......... .......... .......... 53% 287M 0s 2024-09-12T01:01:30.082 INFO:teuthology.orchestra.run.smithi070.stderr: 49800K .......... .......... .......... .......... .......... 53% 251M 0s 2024-09-12T01:01:30.082 INFO:teuthology.orchestra.run.smithi070.stderr: 49850K .......... .......... .......... .......... .......... 53% 260M 0s 2024-09-12T01:01:30.082 INFO:teuthology.orchestra.run.smithi070.stderr: 49900K .......... .......... .......... .......... .......... 53% 242M 0s 2024-09-12T01:01:30.082 INFO:teuthology.orchestra.run.smithi070.stderr: 49950K .......... .......... .......... .......... .......... 53% 293M 0s 2024-09-12T01:01:30.082 INFO:teuthology.orchestra.run.smithi070.stderr: 50000K .......... .......... .......... .......... .......... 53% 299M 0s 2024-09-12T01:01:30.083 INFO:teuthology.orchestra.run.smithi070.stderr: 50050K .......... .......... .......... .......... .......... 53% 255M 0s 2024-09-12T01:01:30.083 INFO:teuthology.orchestra.run.smithi070.stderr: 50100K .......... .......... .......... .......... .......... 53% 243M 0s 2024-09-12T01:01:30.083 INFO:teuthology.orchestra.run.smithi070.stderr: 50150K .......... .......... .......... .......... .......... 54% 257M 0s 2024-09-12T01:01:30.083 INFO:teuthology.orchestra.run.smithi070.stderr: 50200K .......... .......... .......... .......... .......... 54% 210M 0s 2024-09-12T01:01:30.083 INFO:teuthology.orchestra.run.smithi070.stderr: 50250K .......... .......... .......... .......... .......... 54% 255M 0s 2024-09-12T01:01:30.083 INFO:teuthology.orchestra.run.smithi070.stderr: 50300K .......... .......... .......... .......... .......... 54% 220M 0s 2024-09-12T01:01:30.083 INFO:teuthology.orchestra.run.smithi070.stderr: 50350K .......... .......... .......... .......... .......... 54% 285M 0s 2024-09-12T01:01:30.083 INFO:teuthology.orchestra.run.smithi070.stderr: 50400K .......... .......... .......... .......... .......... 54% 60.0M 0s 2024-09-12T01:01:30.083 INFO:teuthology.orchestra.run.smithi070.stderr: 50450K .......... .......... .......... .......... .......... 54% 162M 0s 2024-09-12T01:01:30.083 INFO:teuthology.orchestra.run.smithi070.stderr: 50500K .......... .......... .......... .......... .......... 54% 243M 0s 2024-09-12T01:01:30.083 INFO:teuthology.orchestra.run.smithi070.stderr: 50550K .......... .......... .......... .......... .......... 54% 249M 0s 2024-09-12T01:01:30.083 INFO:teuthology.orchestra.run.smithi070.stderr: 50600K .......... .......... .......... .......... .......... 54% 250M 0s 2024-09-12T01:01:30.083 INFO:teuthology.orchestra.run.smithi070.stderr: 50650K .......... .......... .......... .......... .......... 54% 238M 0s 2024-09-12T01:01:30.083 INFO:teuthology.orchestra.run.smithi070.stderr: 50700K .......... .......... .......... .......... .......... 54% 232M 0s 2024-09-12T01:01:30.084 INFO:teuthology.orchestra.run.smithi070.stderr: 50750K .......... .......... .......... .......... .......... 54% 295M 0s 2024-09-12T01:01:30.084 INFO:teuthology.orchestra.run.smithi070.stderr: 50800K .......... .......... .......... .......... .......... 54% 287M 0s 2024-09-12T01:01:30.084 INFO:teuthology.orchestra.run.smithi070.stderr: 50850K .......... .......... .......... .......... .......... 54% 288M 0s 2024-09-12T01:01:30.084 INFO:teuthology.orchestra.run.smithi070.stderr: 50900K .......... .......... .......... .......... .......... 54% 220M 0s 2024-09-12T01:01:30.084 INFO:teuthology.orchestra.run.smithi070.stderr: 50950K .......... .......... .......... .......... .......... 54% 256M 0s 2024-09-12T01:01:30.084 INFO:teuthology.orchestra.run.smithi070.stderr: 51000K .......... .......... .......... .......... .......... 54% 285M 0s 2024-09-12T01:01:30.084 INFO:teuthology.orchestra.run.smithi070.stderr: 51050K .......... .......... .......... .......... .......... 55% 270M 0s 2024-09-12T01:01:30.084 INFO:teuthology.orchestra.run.smithi070.stderr: 51100K .......... .......... .......... .......... .......... 55% 238M 0s 2024-09-12T01:01:30.084 INFO:teuthology.orchestra.run.smithi070.stderr: 51150K .......... .......... .......... .......... .......... 55% 300M 0s 2024-09-12T01:01:30.084 INFO:teuthology.orchestra.run.smithi070.stderr: 51200K .......... .......... .......... .......... .......... 55% 53.0M 0s 2024-09-12T01:01:30.084 INFO:teuthology.orchestra.run.smithi070.stderr: 51250K .......... .......... .......... .......... .......... 55% 206M 0s 2024-09-12T01:01:30.084 INFO:teuthology.orchestra.run.smithi070.stderr: 51300K .......... .......... .......... .......... .......... 55% 283M 0s 2024-09-12T01:01:30.084 INFO:teuthology.orchestra.run.smithi070.stderr: 51350K .......... .......... .......... .......... .......... 55% 293M 0s 2024-09-12T01:01:30.085 INFO:teuthology.orchestra.run.smithi070.stderr: 51400K .......... .......... .......... .......... .......... 55% 285M 0s 2024-09-12T01:01:30.085 INFO:teuthology.orchestra.run.smithi070.stderr: 51450K .......... .......... .......... .......... .......... 55% 284M 0s 2024-09-12T01:01:30.085 INFO:teuthology.orchestra.run.smithi070.stderr: 51500K .......... .......... .......... .......... .......... 55% 295M 0s 2024-09-12T01:01:30.085 INFO:teuthology.orchestra.run.smithi070.stderr: 51550K .......... .......... .......... .......... .......... 55% 277M 0s 2024-09-12T01:01:30.085 INFO:teuthology.orchestra.run.smithi070.stderr: 51600K .......... .......... .......... .......... .......... 55% 236M 0s 2024-09-12T01:01:30.085 INFO:teuthology.orchestra.run.smithi070.stderr: 51650K .......... .......... .......... .......... .......... 55% 299M 0s 2024-09-12T01:01:30.085 INFO:teuthology.orchestra.run.smithi070.stderr: 51700K .......... .......... .......... .......... .......... 55% 197M 0s 2024-09-12T01:01:30.085 INFO:teuthology.orchestra.run.smithi070.stderr: 51750K .......... .......... .......... .......... .......... 55% 287M 0s 2024-09-12T01:01:30.085 INFO:teuthology.orchestra.run.smithi070.stderr: 51800K .......... .......... .......... .......... .......... 55% 257M 0s 2024-09-12T01:01:30.085 INFO:teuthology.orchestra.run.smithi070.stderr: 51850K .......... .......... .......... .......... .......... 55% 315M 0s 2024-09-12T01:01:30.085 INFO:teuthology.orchestra.run.smithi070.stderr: 51900K .......... .......... .......... .......... .......... 55% 328M 0s 2024-09-12T01:01:30.085 INFO:teuthology.orchestra.run.smithi070.stderr: 51950K .......... .......... .......... .......... .......... 55% 193M 0s 2024-09-12T01:01:30.085 INFO:teuthology.orchestra.run.smithi070.stderr: 52000K .......... .......... .......... .......... .......... 56% 175M 0s 2024-09-12T01:01:30.086 INFO:teuthology.orchestra.run.smithi070.stderr: 52050K .......... .......... .......... .......... .......... 56% 277M 0s 2024-09-12T01:01:30.086 INFO:teuthology.orchestra.run.smithi070.stderr: 52100K .......... .......... .......... .......... .......... 56% 287M 0s 2024-09-12T01:01:30.086 INFO:teuthology.orchestra.run.smithi070.stderr: 52150K .......... .......... .......... .......... .......... 56% 296M 0s 2024-09-12T01:01:30.086 INFO:teuthology.orchestra.run.smithi070.stderr: 52200K .......... .......... .......... .......... .......... 56% 259M 0s 2024-09-12T01:01:30.086 INFO:teuthology.orchestra.run.smithi070.stderr: 52250K .......... .......... .......... .......... .......... 56% 285M 0s 2024-09-12T01:01:30.086 INFO:teuthology.orchestra.run.smithi070.stderr: 52300K .......... .......... .......... .......... .......... 56% 283M 0s 2024-09-12T01:01:30.086 INFO:teuthology.orchestra.run.smithi070.stderr: 52350K .......... .......... .......... .......... .......... 56% 216M 0s 2024-09-12T01:01:30.086 INFO:teuthology.orchestra.run.smithi070.stderr: 52400K .......... .......... .......... .......... .......... 56% 184M 0s 2024-09-12T01:01:30.086 INFO:teuthology.orchestra.run.smithi070.stderr: 52450K .......... .......... .......... .......... .......... 56% 283M 0s 2024-09-12T01:01:30.086 INFO:teuthology.orchestra.run.smithi070.stderr: 52500K .......... .......... .......... .......... .......... 56% 304M 0s 2024-09-12T01:01:30.086 INFO:teuthology.orchestra.run.smithi070.stderr: 52550K .......... .......... .......... .......... .......... 56% 298M 0s 2024-09-12T01:01:30.086 INFO:teuthology.orchestra.run.smithi070.stderr: 52600K .......... .......... .......... .......... .......... 56% 290M 0s 2024-09-12T01:01:30.086 INFO:teuthology.orchestra.run.smithi070.stderr: 52650K .......... .......... .......... .......... .......... 56% 327M 0s 2024-09-12T01:01:30.087 INFO:teuthology.orchestra.run.smithi070.stderr: 52700K .......... .......... .......... .......... .......... 56% 289M 0s 2024-09-12T01:01:30.087 INFO:teuthology.orchestra.run.smithi070.stderr: 52750K .......... .......... .......... .......... .......... 56% 304M 0s 2024-09-12T01:01:30.087 INFO:teuthology.orchestra.run.smithi070.stderr: 52800K .......... .......... .......... .......... .......... 56% 235M 0s 2024-09-12T01:01:30.087 INFO:teuthology.orchestra.run.smithi070.stderr: 52850K .......... .......... .......... .......... .......... 56% 290M 0s 2024-09-12T01:01:30.087 INFO:teuthology.orchestra.run.smithi070.stderr: 52900K .......... .......... .......... .......... .......... 56% 304M 0s 2024-09-12T01:01:30.087 INFO:teuthology.orchestra.run.smithi070.stderr: 52950K .......... .......... .......... .......... .......... 57% 313M 0s 2024-09-12T01:01:30.087 INFO:teuthology.orchestra.run.smithi070.stderr: 53000K .......... .......... .......... .......... .......... 57% 267M 0s 2024-09-12T01:01:30.087 INFO:teuthology.orchestra.run.smithi070.stderr: 53050K .......... .......... .......... .......... .......... 57% 231M 0s 2024-09-12T01:01:30.087 INFO:teuthology.orchestra.run.smithi070.stderr: 53100K .......... .......... .......... .......... .......... 57% 272M 0s 2024-09-12T01:01:30.087 INFO:teuthology.orchestra.run.smithi070.stderr: 53150K .......... .......... .......... .......... .......... 57% 291M 0s 2024-09-12T01:01:30.087 INFO:teuthology.orchestra.run.smithi070.stderr: 53200K .......... .......... .......... .......... .......... 57% 297M 0s 2024-09-12T01:01:30.087 INFO:teuthology.orchestra.run.smithi070.stderr: 53250K .......... .......... .......... .......... .......... 57% 294M 0s 2024-09-12T01:01:30.087 INFO:teuthology.orchestra.run.smithi070.stderr: 53300K .......... .......... .......... .......... .......... 57% 260M 0s 2024-09-12T01:01:30.087 INFO:teuthology.orchestra.run.smithi070.stderr: 53350K .......... .......... .......... .......... .......... 57% 229M 0s 2024-09-12T01:01:30.088 INFO:teuthology.orchestra.run.smithi070.stderr: 53400K .......... .......... .......... .......... .......... 57% 295M 0s 2024-09-12T01:01:30.088 INFO:teuthology.orchestra.run.smithi070.stderr: 53450K .......... .......... .......... .......... .......... 57% 280M 0s 2024-09-12T01:01:30.088 INFO:teuthology.orchestra.run.smithi070.stderr: 53500K .......... .......... .......... .......... .......... 57% 230M 0s 2024-09-12T01:01:30.088 INFO:teuthology.orchestra.run.smithi070.stderr: 53550K .......... .......... .......... .......... .......... 57% 294M 0s 2024-09-12T01:01:30.088 INFO:teuthology.orchestra.run.smithi070.stderr: 53600K .......... .......... .......... .......... .......... 57% 294M 0s 2024-09-12T01:01:30.088 INFO:teuthology.orchestra.run.smithi070.stderr: 53650K .......... .......... .......... .......... .......... 57% 260M 0s 2024-09-12T01:01:30.088 INFO:teuthology.orchestra.run.smithi070.stderr: 53700K .......... .......... .......... .......... .......... 57% 269M 0s 2024-09-12T01:01:30.088 INFO:teuthology.orchestra.run.smithi070.stderr: 53750K .......... .......... .......... .......... .......... 57% 273M 0s 2024-09-12T01:01:30.088 INFO:teuthology.orchestra.run.smithi070.stderr: 53800K .......... .......... .......... .......... .......... 57% 250M 0s 2024-09-12T01:01:30.088 INFO:teuthology.orchestra.run.smithi070.stderr: 53850K .......... .......... .......... .......... .......... 58% 257M 0s 2024-09-12T01:01:30.088 INFO:teuthology.orchestra.run.smithi070.stderr: 53900K .......... .......... .......... .......... .......... 58% 234M 0s 2024-09-12T01:01:30.088 INFO:teuthology.orchestra.run.smithi070.stderr: 53950K .......... .......... .......... .......... .......... 58% 287M 0s 2024-09-12T01:01:30.088 INFO:teuthology.orchestra.run.smithi070.stderr: 54000K .......... .......... .......... .......... .......... 58% 62.6M 0s 2024-09-12T01:01:30.088 INFO:teuthology.orchestra.run.smithi070.stderr: 54050K .......... .......... .......... .......... .......... 58% 177M 0s 2024-09-12T01:01:30.089 INFO:teuthology.orchestra.run.smithi070.stderr: 54100K .......... .......... .......... .......... .......... 58% 202M 0s 2024-09-12T01:01:30.089 INFO:teuthology.orchestra.run.smithi070.stderr: 54150K .......... .......... .......... .......... .......... 58% 303M 0s 2024-09-12T01:01:30.089 INFO:teuthology.orchestra.run.smithi070.stderr: 54200K .......... .......... .......... .......... .......... 58% 286M 0s 2024-09-12T01:01:30.089 INFO:teuthology.orchestra.run.smithi070.stderr: 54250K .......... .......... .......... .......... .......... 58% 289M 0s 2024-09-12T01:01:30.089 INFO:teuthology.orchestra.run.smithi070.stderr: 54300K .......... .......... .......... .......... .......... 58% 204M 0s 2024-09-12T01:01:30.089 INFO:teuthology.orchestra.run.smithi070.stderr: 54350K .......... .......... .......... .......... .......... 58% 165M 0s 2024-09-12T01:01:30.089 INFO:teuthology.orchestra.run.smithi070.stderr: 54400K .......... .......... .......... .......... .......... 58% 262M 0s 2024-09-12T01:01:30.089 INFO:teuthology.orchestra.run.smithi070.stderr: 54450K .......... .......... .......... .......... .......... 58% 266M 0s 2024-09-12T01:01:30.089 INFO:teuthology.orchestra.run.smithi070.stderr: 54500K .......... .......... .......... .......... .......... 58% 242M 0s 2024-09-12T01:01:30.089 INFO:teuthology.orchestra.run.smithi070.stderr: 54550K .......... .......... .......... .......... .......... 58% 275M 0s 2024-09-12T01:01:30.089 INFO:teuthology.orchestra.run.smithi070.stderr: 54600K .......... .......... .......... .......... .......... 58% 270M 0s 2024-09-12T01:01:30.089 INFO:teuthology.orchestra.run.smithi070.stderr: 54650K .......... .......... .......... .......... .......... 58% 284M 0s 2024-09-12T01:01:30.089 INFO:teuthology.orchestra.run.smithi070.stderr: 54700K .......... .......... .......... .......... .......... 58% 253M 0s 2024-09-12T01:01:30.089 INFO:teuthology.orchestra.run.smithi070.stderr: 54750K .......... .......... .......... .......... .......... 58% 279M 0s 2024-09-12T01:01:30.090 INFO:teuthology.orchestra.run.smithi070.stderr: 54800K .......... .......... .......... .......... .......... 59% 287M 0s 2024-09-12T01:01:30.090 INFO:teuthology.orchestra.run.smithi070.stderr: 54850K .......... .......... .......... .......... .......... 59% 257M 0s 2024-09-12T01:01:30.090 INFO:teuthology.orchestra.run.smithi070.stderr: 54900K .......... .......... .......... .......... .......... 59% 214M 0s 2024-09-12T01:01:30.090 INFO:teuthology.orchestra.run.smithi070.stderr: 54950K .......... .......... .......... .......... .......... 59% 235M 0s 2024-09-12T01:01:30.090 INFO:teuthology.orchestra.run.smithi070.stderr: 55000K .......... .......... .......... .......... .......... 59% 264M 0s 2024-09-12T01:01:30.090 INFO:teuthology.orchestra.run.smithi070.stderr: 55050K .......... .......... .......... .......... .......... 59% 270M 0s 2024-09-12T01:01:30.090 INFO:teuthology.orchestra.run.smithi070.stderr: 55100K .......... .......... .......... .......... .......... 59% 236M 0s 2024-09-12T01:01:30.090 INFO:teuthology.orchestra.run.smithi070.stderr: 55150K .......... .......... .......... .......... .......... 59% 309M 0s 2024-09-12T01:01:30.090 INFO:teuthology.orchestra.run.smithi070.stderr: 55200K .......... .......... .......... .......... .......... 59% 311M 0s 2024-09-12T01:01:30.090 INFO:teuthology.orchestra.run.smithi070.stderr: 55250K .......... .......... .......... .......... .......... 59% 303M 0s 2024-09-12T01:01:30.090 INFO:teuthology.orchestra.run.smithi070.stderr: 55300K .......... .......... .......... .......... .......... 59% 250M 0s 2024-09-12T01:01:30.090 INFO:teuthology.orchestra.run.smithi070.stderr: 55350K .......... .......... .......... .......... .......... 59% 272M 0s 2024-09-12T01:01:30.090 INFO:teuthology.orchestra.run.smithi070.stderr: 55400K .......... .......... .......... .......... .......... 59% 291M 0s 2024-09-12T01:01:30.090 INFO:teuthology.orchestra.run.smithi070.stderr: 55450K .......... .......... .......... .......... .......... 59% 306M 0s 2024-09-12T01:01:30.090 INFO:teuthology.orchestra.run.smithi070.stderr: 55500K .......... .......... .......... .......... .......... 59% 225M 0s 2024-09-12T01:01:30.090 INFO:teuthology.orchestra.run.smithi070.stderr: 55550K .......... .......... .......... .......... .......... 59% 296M 0s 2024-09-12T01:01:30.091 INFO:teuthology.orchestra.run.smithi070.stderr: 55600K .......... .......... .......... .......... .......... 59% 304M 0s 2024-09-12T01:01:30.091 INFO:teuthology.orchestra.run.smithi070.stderr: 55650K .......... .......... .......... .......... .......... 59% 279M 0s 2024-09-12T01:01:30.091 INFO:teuthology.orchestra.run.smithi070.stderr: 55700K .......... .......... .......... .......... .......... 60% 250M 0s 2024-09-12T01:01:30.091 INFO:teuthology.orchestra.run.smithi070.stderr: 55750K .......... .......... .......... .......... .......... 60% 255M 0s 2024-09-12T01:01:30.091 INFO:teuthology.orchestra.run.smithi070.stderr: 55800K .......... .......... .......... .......... .......... 60% 270M 0s 2024-09-12T01:01:30.091 INFO:teuthology.orchestra.run.smithi070.stderr: 55850K .......... .......... .......... .......... .......... 60% 299M 0s 2024-09-12T01:01:30.091 INFO:teuthology.orchestra.run.smithi070.stderr: 55900K .......... .......... .......... .......... .......... 60% 250M 0s 2024-09-12T01:01:30.091 INFO:teuthology.orchestra.run.smithi070.stderr: 55950K .......... .......... .......... .......... .......... 60% 283M 0s 2024-09-12T01:01:30.091 INFO:teuthology.orchestra.run.smithi070.stderr: 56000K .......... .......... .......... .......... .......... 60% 279M 0s 2024-09-12T01:01:30.091 INFO:teuthology.orchestra.run.smithi070.stderr: 56050K .......... .......... .......... .......... .......... 60% 273M 0s 2024-09-12T01:01:30.091 INFO:teuthology.orchestra.run.smithi070.stderr: 56100K .......... .......... .......... .......... .......... 60% 252M 0s 2024-09-12T01:01:30.091 INFO:teuthology.orchestra.run.smithi070.stderr: 56150K .......... .......... .......... .......... .......... 60% 286M 0s 2024-09-12T01:01:30.091 INFO:teuthology.orchestra.run.smithi070.stderr: 56200K .......... .......... .......... .......... .......... 60% 292M 0s 2024-09-12T01:01:30.091 INFO:teuthology.orchestra.run.smithi070.stderr: 56250K .......... .......... .......... .......... .......... 60% 307M 0s 2024-09-12T01:01:30.091 INFO:teuthology.orchestra.run.smithi070.stderr: 56300K .......... .......... .......... .......... .......... 60% 233M 0s 2024-09-12T01:01:30.092 INFO:teuthology.orchestra.run.smithi070.stderr: 56350K .......... .......... .......... .......... .......... 60% 285M 0s 2024-09-12T01:01:30.092 INFO:teuthology.orchestra.run.smithi070.stderr: 56400K .......... .......... .......... .......... .......... 60% 302M 0s 2024-09-12T01:01:30.092 INFO:teuthology.orchestra.run.smithi070.stderr: 56450K .......... .......... .......... .......... .......... 60% 310M 0s 2024-09-12T01:01:30.092 INFO:teuthology.orchestra.run.smithi070.stderr: 56500K .......... .......... .......... .......... .......... 60% 233M 0s 2024-09-12T01:01:30.092 INFO:teuthology.orchestra.run.smithi070.stderr: 56550K .......... .......... .......... .......... .......... 60% 225M 0s 2024-09-12T01:01:30.092 INFO:teuthology.orchestra.run.smithi070.stderr: 56600K .......... .......... .......... .......... .......... 60% 294M 0s 2024-09-12T01:01:30.092 INFO:teuthology.orchestra.run.smithi070.stderr: 56650K .......... .......... .......... .......... .......... 61% 316M 0s 2024-09-12T01:01:30.092 INFO:teuthology.orchestra.run.smithi070.stderr: 56700K .......... .......... .......... .......... .......... 61% 268M 0s 2024-09-12T01:01:30.092 INFO:teuthology.orchestra.run.smithi070.stderr: 56750K .......... .......... .......... .......... .......... 61% 283M 0s 2024-09-12T01:01:30.092 INFO:teuthology.orchestra.run.smithi070.stderr: 56800K .......... .......... .......... .......... .......... 61% 295M 0s 2024-09-12T01:01:30.092 INFO:teuthology.orchestra.run.smithi070.stderr: 56850K .......... .......... .......... .......... .......... 61% 304M 0s 2024-09-12T01:01:30.092 INFO:teuthology.orchestra.run.smithi070.stderr: 56900K .......... .......... .......... .......... .......... 61% 280M 0s 2024-09-12T01:01:30.092 INFO:teuthology.orchestra.run.smithi070.stderr: 56950K .......... .......... .......... .......... .......... 61% 60.5M 0s 2024-09-12T01:01:30.093 INFO:teuthology.orchestra.run.smithi070.stderr: 57000K .......... .......... .......... .......... .......... 61% 292M 0s 2024-09-12T01:01:30.093 INFO:teuthology.orchestra.run.smithi070.stderr: 57050K .......... .......... .......... .......... .......... 61% 286M 0s 2024-09-12T01:01:30.093 INFO:teuthology.orchestra.run.smithi070.stderr: 57100K .......... .......... .......... .......... .......... 61% 244M 0s 2024-09-12T01:01:30.093 INFO:teuthology.orchestra.run.smithi070.stderr: 57150K .......... .......... .......... .......... .......... 61% 164M 0s 2024-09-12T01:01:30.093 INFO:teuthology.orchestra.run.smithi070.stderr: 57200K .......... .......... .......... .......... .......... 61% 294M 0s 2024-09-12T01:01:30.093 INFO:teuthology.orchestra.run.smithi070.stderr: 57250K .......... .......... .......... .......... .......... 61% 300M 0s 2024-09-12T01:01:30.093 INFO:teuthology.orchestra.run.smithi070.stderr: 57300K .......... .......... .......... .......... .......... 61% 271M 0s 2024-09-12T01:01:30.093 INFO:teuthology.orchestra.run.smithi070.stderr: 57350K .......... .......... .......... .......... .......... 61% 307M 0s 2024-09-12T01:01:30.093 INFO:teuthology.orchestra.run.smithi070.stderr: 57400K .......... .......... .......... .......... .......... 61% 194M 0s 2024-09-12T01:01:30.093 INFO:teuthology.orchestra.run.smithi070.stderr: 57450K .......... .......... .......... .......... .......... 61% 236M 0s 2024-09-12T01:01:30.093 INFO:teuthology.orchestra.run.smithi070.stderr: 57500K .......... .......... .......... .......... .......... 61% 264M 0s 2024-09-12T01:01:30.093 INFO:teuthology.orchestra.run.smithi070.stderr: 57550K .......... .......... .......... .......... .......... 62% 306M 0s 2024-09-12T01:01:30.093 INFO:teuthology.orchestra.run.smithi070.stderr: 57600K .......... .......... .......... .......... .......... 62% 306M 0s 2024-09-12T01:01:30.093 INFO:teuthology.orchestra.run.smithi070.stderr: 57650K .......... .......... .......... .......... .......... 62% 298M 0s 2024-09-12T01:01:30.093 INFO:teuthology.orchestra.run.smithi070.stderr: 57700K .......... .......... .......... .......... .......... 62% 221M 0s 2024-09-12T01:01:30.094 INFO:teuthology.orchestra.run.smithi070.stderr: 57750K .......... .......... .......... .......... .......... 62% 274M 0s 2024-09-12T01:01:30.094 INFO:teuthology.orchestra.run.smithi070.stderr: 57800K .......... .......... .......... .......... .......... 62% 321M 0s 2024-09-12T01:01:30.094 INFO:teuthology.orchestra.run.smithi070.stderr: 57850K .......... .......... .......... .......... .......... 62% 180M 0s 2024-09-12T01:01:30.094 INFO:teuthology.orchestra.run.smithi070.stderr: 57900K .......... .......... .......... .......... .......... 62% 182M 0s 2024-09-12T01:01:30.094 INFO:teuthology.orchestra.run.smithi070.stderr: 57950K .......... .......... .......... .......... .......... 62% 287M 0s 2024-09-12T01:01:30.094 INFO:teuthology.orchestra.run.smithi070.stderr: 58000K .......... .......... .......... .......... .......... 62% 314M 0s 2024-09-12T01:01:30.094 INFO:teuthology.orchestra.run.smithi070.stderr: 58050K .......... .......... .......... .......... .......... 62% 235M 0s 2024-09-12T01:01:30.094 INFO:teuthology.orchestra.run.smithi070.stderr: 58100K .......... .......... .......... .......... .......... 62% 243M 0s 2024-09-12T01:01:30.094 INFO:teuthology.orchestra.run.smithi070.stderr: 58150K .......... .......... .......... .......... .......... 62% 126M 0s 2024-09-12T01:01:30.094 INFO:teuthology.orchestra.run.smithi070.stderr: 58200K .......... .......... .......... .......... .......... 62% 276M 0s 2024-09-12T01:01:30.094 INFO:teuthology.orchestra.run.smithi070.stderr: 58250K .......... .......... .......... .......... .......... 62% 289M 0s 2024-09-12T01:01:30.094 INFO:teuthology.orchestra.run.smithi070.stderr: 58300K .......... .......... .......... .......... .......... 62% 252M 0s 2024-09-12T01:01:30.094 INFO:teuthology.orchestra.run.smithi070.stderr: 58350K .......... .......... .......... .......... .......... 62% 308M 0s 2024-09-12T01:01:30.094 INFO:teuthology.orchestra.run.smithi070.stderr: 58400K .......... .......... .......... .......... .......... 62% 315M 0s 2024-09-12T01:01:30.094 INFO:teuthology.orchestra.run.smithi070.stderr: 58450K .......... .......... .......... .......... .......... 62% 282M 0s 2024-09-12T01:01:30.095 INFO:teuthology.orchestra.run.smithi070.stderr: 58500K .......... .......... .......... .......... .......... 63% 286M 0s 2024-09-12T01:01:30.095 INFO:teuthology.orchestra.run.smithi070.stderr: 58550K .......... .......... .......... .......... .......... 63% 302M 0s 2024-09-12T01:01:30.095 INFO:teuthology.orchestra.run.smithi070.stderr: 58600K .......... .......... .......... .......... .......... 63% 292M 0s 2024-09-12T01:01:30.095 INFO:teuthology.orchestra.run.smithi070.stderr: 58650K .......... .......... .......... .......... .......... 63% 270M 0s 2024-09-12T01:01:30.095 INFO:teuthology.orchestra.run.smithi070.stderr: 58700K .......... .......... .......... .......... .......... 63% 233M 0s 2024-09-12T01:01:30.095 INFO:teuthology.orchestra.run.smithi070.stderr: 58750K .......... .......... .......... .......... .......... 63% 307M 0s 2024-09-12T01:01:30.095 INFO:teuthology.orchestra.run.smithi070.stderr: 58800K .......... .......... .......... .......... .......... 63% 300M 0s 2024-09-12T01:01:30.095 INFO:teuthology.orchestra.run.smithi070.stderr: 58850K .......... .......... .......... .......... .......... 63% 301M 0s 2024-09-12T01:01:30.095 INFO:teuthology.orchestra.run.smithi070.stderr: 58900K .......... .......... .......... .......... .......... 63% 284M 0s 2024-09-12T01:01:30.095 INFO:teuthology.orchestra.run.smithi070.stderr: 58950K .......... .......... .......... .......... .......... 63% 285M 0s 2024-09-12T01:01:30.095 INFO:teuthology.orchestra.run.smithi070.stderr: 59000K .......... .......... .......... .......... .......... 63% 274M 0s 2024-09-12T01:01:30.095 INFO:teuthology.orchestra.run.smithi070.stderr: 59050K .......... .......... .......... .......... .......... 63% 319M 0s 2024-09-12T01:01:30.095 INFO:teuthology.orchestra.run.smithi070.stderr: 59100K .......... .......... .......... .......... .......... 63% 235M 0s 2024-09-12T01:01:30.095 INFO:teuthology.orchestra.run.smithi070.stderr: 59150K .......... .......... .......... .......... .......... 63% 272M 0s 2024-09-12T01:01:30.096 INFO:teuthology.orchestra.run.smithi070.stderr: 59200K .......... .......... .......... .......... .......... 63% 289M 0s 2024-09-12T01:01:30.096 INFO:teuthology.orchestra.run.smithi070.stderr: 59250K .......... .......... .......... .......... .......... 63% 278M 0s 2024-09-12T01:01:30.096 INFO:teuthology.orchestra.run.smithi070.stderr: 59300K .......... .......... .......... .......... .......... 63% 270M 0s 2024-09-12T01:01:30.096 INFO:teuthology.orchestra.run.smithi070.stderr: 59350K .......... .......... .......... .......... .......... 63% 317M 0s 2024-09-12T01:01:30.096 INFO:teuthology.orchestra.run.smithi070.stderr: 59400K .......... .......... .......... .......... .......... 63% 322M 0s 2024-09-12T01:01:30.096 INFO:teuthology.orchestra.run.smithi070.stderr: 59450K .......... .......... .......... .......... .......... 64% 166M 0s 2024-09-12T01:01:30.096 INFO:teuthology.orchestra.run.smithi070.stderr: 59500K .......... .......... .......... .......... .......... 64% 242M 0s 2024-09-12T01:01:30.096 INFO:teuthology.orchestra.run.smithi070.stderr: 59550K .......... .......... .......... .......... .......... 64% 314M 0s 2024-09-12T01:01:30.096 INFO:teuthology.orchestra.run.smithi070.stderr: 59600K .......... .......... .......... .......... .......... 64% 300M 0s 2024-09-12T01:01:30.096 INFO:teuthology.orchestra.run.smithi070.stderr: 59650K .......... .......... .......... .......... .......... 64% 280M 0s 2024-09-12T01:01:30.096 INFO:teuthology.orchestra.run.smithi070.stderr: 59700K .......... .......... .......... .......... .......... 64% 268M 0s 2024-09-12T01:01:30.096 INFO:teuthology.orchestra.run.smithi070.stderr: 59750K .......... .......... .......... .......... .......... 64% 287M 0s 2024-09-12T01:01:30.096 INFO:teuthology.orchestra.run.smithi070.stderr: 59800K .......... .......... .......... .......... .......... 64% 279M 0s 2024-09-12T01:01:30.096 INFO:teuthology.orchestra.run.smithi070.stderr: 59850K .......... .......... .......... .......... .......... 64% 313M 0s 2024-09-12T01:01:30.097 INFO:teuthology.orchestra.run.smithi070.stderr: 59900K .......... .......... .......... .......... .......... 64% 263M 0s 2024-09-12T01:01:30.097 INFO:teuthology.orchestra.run.smithi070.stderr: 59950K .......... .......... .......... .......... .......... 64% 75.2M 0s 2024-09-12T01:01:30.097 INFO:teuthology.orchestra.run.smithi070.stderr: 60000K .......... .......... .......... .......... .......... 64% 274M 0s 2024-09-12T01:01:30.097 INFO:teuthology.orchestra.run.smithi070.stderr: 60050K .......... .......... .......... .......... .......... 64% 308M 0s 2024-09-12T01:01:30.097 INFO:teuthology.orchestra.run.smithi070.stderr: 60100K .......... .......... .......... .......... .......... 64% 255M 0s 2024-09-12T01:01:30.097 INFO:teuthology.orchestra.run.smithi070.stderr: 60150K .......... .......... .......... .......... .......... 64% 284M 0s 2024-09-12T01:01:30.097 INFO:teuthology.orchestra.run.smithi070.stderr: 60200K .......... .......... .......... .......... .......... 64% 146M 0s 2024-09-12T01:01:30.097 INFO:teuthology.orchestra.run.smithi070.stderr: 60250K .......... .......... .......... .......... .......... 64% 281M 0s 2024-09-12T01:01:30.097 INFO:teuthology.orchestra.run.smithi070.stderr: 60300K .......... .......... .......... .......... .......... 64% 253M 0s 2024-09-12T01:01:30.097 INFO:teuthology.orchestra.run.smithi070.stderr: 60350K .......... .......... .......... .......... .......... 65% 282M 0s 2024-09-12T01:01:30.097 INFO:teuthology.orchestra.run.smithi070.stderr: 60400K .......... .......... .......... .......... .......... 65% 311M 0s 2024-09-12T01:01:30.097 INFO:teuthology.orchestra.run.smithi070.stderr: 60450K .......... .......... .......... .......... .......... 65% 249M 0s 2024-09-12T01:01:30.097 INFO:teuthology.orchestra.run.smithi070.stderr: 60500K .......... .......... .......... .......... .......... 65% 252M 0s 2024-09-12T01:01:30.098 INFO:teuthology.orchestra.run.smithi070.stderr: 60550K .......... .......... .......... .......... .......... 65% 197M 0s 2024-09-12T01:01:30.098 INFO:teuthology.orchestra.run.smithi070.stderr: 60600K .......... .......... .......... .......... .......... 65% 265M 0s 2024-09-12T01:01:30.098 INFO:teuthology.orchestra.run.smithi070.stderr: 60650K .......... .......... .......... .......... .......... 65% 289M 0s 2024-09-12T01:01:30.098 INFO:teuthology.orchestra.run.smithi070.stderr: 60700K .......... .......... .......... .......... .......... 65% 256M 0s 2024-09-12T01:01:30.098 INFO:teuthology.orchestra.run.smithi070.stderr: 60750K .......... .......... .......... .......... .......... 65% 288M 0s 2024-09-12T01:01:30.098 INFO:teuthology.orchestra.run.smithi070.stderr: 60800K .......... .......... .......... .......... .......... 65% 290M 0s 2024-09-12T01:01:30.098 INFO:teuthology.orchestra.run.smithi070.stderr: 60850K .......... .......... .......... .......... .......... 65% 312M 0s 2024-09-12T01:01:30.098 INFO:teuthology.orchestra.run.smithi070.stderr: 60900K .......... .......... .......... .......... .......... 65% 257M 0s 2024-09-12T01:01:30.098 INFO:teuthology.orchestra.run.smithi070.stderr: 60950K .......... .......... .......... .......... .......... 65% 114M 0s 2024-09-12T01:01:30.098 INFO:teuthology.orchestra.run.smithi070.stderr: 61000K .......... .......... .......... .......... .......... 65% 272M 0s 2024-09-12T01:01:30.098 INFO:teuthology.orchestra.run.smithi070.stderr: 61050K .......... .......... .......... .......... .......... 65% 311M 0s 2024-09-12T01:01:30.098 INFO:teuthology.orchestra.run.smithi070.stderr: 61100K .......... .......... .......... .......... .......... 65% 270M 0s 2024-09-12T01:01:30.098 INFO:teuthology.orchestra.run.smithi070.stderr: 61150K .......... .......... .......... .......... .......... 65% 233M 0s 2024-09-12T01:01:30.098 INFO:teuthology.orchestra.run.smithi070.stderr: 61200K .......... .......... .......... .......... .......... 65% 283M 0s 2024-09-12T01:01:30.099 INFO:teuthology.orchestra.run.smithi070.stderr: 61250K .......... .......... .......... .......... .......... 65% 310M 0s 2024-09-12T01:01:30.099 INFO:teuthology.orchestra.run.smithi070.stderr: 61300K .......... .......... .......... .......... .......... 66% 274M 0s 2024-09-12T01:01:30.099 INFO:teuthology.orchestra.run.smithi070.stderr: 61350K .......... .......... .......... .......... .......... 66% 258M 0s 2024-09-12T01:01:30.099 INFO:teuthology.orchestra.run.smithi070.stderr: 61400K .......... .......... .......... .......... .......... 66% 269M 0s 2024-09-12T01:01:30.099 INFO:teuthology.orchestra.run.smithi070.stderr: 61450K .......... .......... .......... .......... .......... 66% 360M 0s 2024-09-12T01:01:30.099 INFO:teuthology.orchestra.run.smithi070.stderr: 61500K .......... .......... .......... .......... .......... 66% 154M 0s 2024-09-12T01:01:30.099 INFO:teuthology.orchestra.run.smithi070.stderr: 61550K .......... .......... .......... .......... .......... 66% 182M 0s 2024-09-12T01:01:30.099 INFO:teuthology.orchestra.run.smithi070.stderr: 61600K .......... .......... .......... .......... .......... 66% 292M 0s 2024-09-12T01:01:30.099 INFO:teuthology.orchestra.run.smithi070.stderr: 61650K .......... .......... .......... .......... .......... 66% 326M 0s 2024-09-12T01:01:30.099 INFO:teuthology.orchestra.run.smithi070.stderr: 61700K .......... .......... .......... .......... .......... 66% 300M 0s 2024-09-12T01:01:30.099 INFO:teuthology.orchestra.run.smithi070.stderr: 61750K .......... .......... .......... .......... .......... 66% 279M 0s 2024-09-12T01:01:30.099 INFO:teuthology.orchestra.run.smithi070.stderr: 61800K .......... .......... .......... .......... .......... 66% 334M 0s 2024-09-12T01:01:30.099 INFO:teuthology.orchestra.run.smithi070.stderr: 61850K .......... .......... .......... .......... .......... 66% 296M 0s 2024-09-12T01:01:30.099 INFO:teuthology.orchestra.run.smithi070.stderr: 61900K .......... .......... .......... .......... .......... 66% 285M 0s 2024-09-12T01:01:30.100 INFO:teuthology.orchestra.run.smithi070.stderr: 61950K .......... .......... .......... .......... .......... 66% 275M 0s 2024-09-12T01:01:30.100 INFO:teuthology.orchestra.run.smithi070.stderr: 62000K .......... .......... .......... .......... .......... 66% 339M 0s 2024-09-12T01:01:30.100 INFO:teuthology.orchestra.run.smithi070.stderr: 62050K .......... .......... .......... .......... .......... 66% 223M 0s 2024-09-12T01:01:30.100 INFO:teuthology.orchestra.run.smithi070.stderr: 62100K .......... .......... .......... .......... .......... 66% 304M 0s 2024-09-12T01:01:30.100 INFO:teuthology.orchestra.run.smithi070.stderr: 62150K .......... .......... .......... .......... .......... 66% 287M 0s 2024-09-12T01:01:30.100 INFO:teuthology.orchestra.run.smithi070.stderr: 62200K .......... .......... .......... .......... .......... 67% 311M 0s 2024-09-12T01:01:30.100 INFO:teuthology.orchestra.run.smithi070.stderr: 62250K .......... .......... .......... .......... .......... 67% 308M 0s 2024-09-12T01:01:30.100 INFO:teuthology.orchestra.run.smithi070.stderr: 62300K .......... .......... .......... .......... .......... 67% 327M 0s 2024-09-12T01:01:30.100 INFO:teuthology.orchestra.run.smithi070.stderr: 62350K .......... .......... .......... .......... .......... 67% 124M 0s 2024-09-12T01:01:30.100 INFO:teuthology.orchestra.run.smithi070.stderr: 62400K .......... .......... .......... .......... .......... 67% 291M 0s 2024-09-12T01:01:30.100 INFO:teuthology.orchestra.run.smithi070.stderr: 62450K .......... .......... .......... .......... .......... 67% 335M 0s 2024-09-12T01:01:30.100 INFO:teuthology.orchestra.run.smithi070.stderr: 62500K .......... .......... .......... .......... .......... 67% 136M 0s 2024-09-12T01:01:30.100 INFO:teuthology.orchestra.run.smithi070.stderr: 62550K .......... .......... .......... .......... .......... 67% 271M 0s 2024-09-12T01:01:30.101 INFO:teuthology.orchestra.run.smithi070.stderr: 62600K .......... .......... .......... .......... .......... 67% 313M 0s 2024-09-12T01:01:30.101 INFO:teuthology.orchestra.run.smithi070.stderr: 62650K .......... .......... .......... .......... .......... 67% 296M 0s 2024-09-12T01:01:30.101 INFO:teuthology.orchestra.run.smithi070.stderr: 62700K .......... .......... .......... .......... .......... 67% 305M 0s 2024-09-12T01:01:30.101 INFO:teuthology.orchestra.run.smithi070.stderr: 62750K .......... .......... .......... .......... .......... 67% 261M 0s 2024-09-12T01:01:30.101 INFO:teuthology.orchestra.run.smithi070.stderr: 62800K .......... .......... .......... .......... .......... 67% 326M 0s 2024-09-12T01:01:30.101 INFO:teuthology.orchestra.run.smithi070.stderr: 62850K .......... .......... .......... .......... .......... 67% 113M 0s 2024-09-12T01:01:30.101 INFO:teuthology.orchestra.run.smithi070.stderr: 62900K .......... .......... .......... .......... .......... 67% 281M 0s 2024-09-12T01:01:30.101 INFO:teuthology.orchestra.run.smithi070.stderr: 62950K .......... .......... .......... .......... .......... 67% 275M 0s 2024-09-12T01:01:30.101 INFO:teuthology.orchestra.run.smithi070.stderr: 63000K .......... .......... .......... .......... .......... 67% 222M 0s 2024-09-12T01:01:30.101 INFO:teuthology.orchestra.run.smithi070.stderr: 63050K .......... .......... .......... .......... .......... 67% 284M 0s 2024-09-12T01:01:30.101 INFO:teuthology.orchestra.run.smithi070.stderr: 63100K .......... .......... .......... .......... .......... 67% 327M 0s 2024-09-12T01:01:30.101 INFO:teuthology.orchestra.run.smithi070.stderr: 63150K .......... .......... .......... .......... .......... 68% 123M 0s 2024-09-12T01:01:30.101 INFO:teuthology.orchestra.run.smithi070.stderr: 63200K .......... .......... .......... .......... .......... 68% 202M 0s 2024-09-12T01:01:30.102 INFO:teuthology.orchestra.run.smithi070.stderr: 63250K .......... .......... .......... .......... .......... 68% 74.7M 0s 2024-09-12T01:01:30.102 INFO:teuthology.orchestra.run.smithi070.stderr: 63300K .......... .......... .......... .......... .......... 68% 286M 0s 2024-09-12T01:01:30.102 INFO:teuthology.orchestra.run.smithi070.stderr: 63350K .......... .......... .......... .......... .......... 68% 268M 0s 2024-09-12T01:01:30.102 INFO:teuthology.orchestra.run.smithi070.stderr: 63400K .......... .......... .......... .......... .......... 68% 289M 0s 2024-09-12T01:01:30.102 INFO:teuthology.orchestra.run.smithi070.stderr: 63450K .......... .......... .......... .......... .......... 68% 288M 0s 2024-09-12T01:01:30.102 INFO:teuthology.orchestra.run.smithi070.stderr: 63500K .......... .......... .......... .......... .......... 68% 315M 0s 2024-09-12T01:01:30.102 INFO:teuthology.orchestra.run.smithi070.stderr: 63550K .......... .......... .......... .......... .......... 68% 257M 0s 2024-09-12T01:01:30.102 INFO:teuthology.orchestra.run.smithi070.stderr: 63600K .......... .......... .......... .......... .......... 68% 318M 0s 2024-09-12T01:01:30.102 INFO:teuthology.orchestra.run.smithi070.stderr: 63650K .......... .......... .......... .......... .......... 68% 290M 0s 2024-09-12T01:01:30.102 INFO:teuthology.orchestra.run.smithi070.stderr: 63700K .......... .......... .......... .......... .......... 68% 307M 0s 2024-09-12T01:01:30.102 INFO:teuthology.orchestra.run.smithi070.stderr: 63750K .......... .......... .......... .......... .......... 68% 277M 0s 2024-09-12T01:01:30.102 INFO:teuthology.orchestra.run.smithi070.stderr: 63800K .......... .......... .......... .......... .......... 68% 330M 0s 2024-09-12T01:01:30.102 INFO:teuthology.orchestra.run.smithi070.stderr: 63850K .......... .......... .......... .......... .......... 68% 333M 0s 2024-09-12T01:01:30.102 INFO:teuthology.orchestra.run.smithi070.stderr: 63900K .......... .......... .......... .......... .......... 68% 291M 0s 2024-09-12T01:01:30.103 INFO:teuthology.orchestra.run.smithi070.stderr: 63950K .......... .......... .......... .......... .......... 68% 235M 0s 2024-09-12T01:01:30.103 INFO:teuthology.orchestra.run.smithi070.stderr: 64000K .......... .......... .......... .......... .......... 68% 321M 0s 2024-09-12T01:01:30.103 INFO:teuthology.orchestra.run.smithi070.stderr: 64050K .......... .......... .......... .......... .......... 68% 334M 0s 2024-09-12T01:01:30.103 INFO:teuthology.orchestra.run.smithi070.stderr: 64100K .......... .......... .......... .......... .......... 69% 296M 0s 2024-09-12T01:01:30.103 INFO:teuthology.orchestra.run.smithi070.stderr: 64150K .......... .......... .......... .......... .......... 69% 221M 0s 2024-09-12T01:01:30.103 INFO:teuthology.orchestra.run.smithi070.stderr: 64200K .......... .......... .......... .......... .......... 69% 276M 0s 2024-09-12T01:01:30.103 INFO:teuthology.orchestra.run.smithi070.stderr: 64250K .......... .......... .......... .......... .......... 69% 308M 0s 2024-09-12T01:01:30.103 INFO:teuthology.orchestra.run.smithi070.stderr: 64300K .......... .......... .......... .......... .......... 69% 309M 0s 2024-09-12T01:01:30.103 INFO:teuthology.orchestra.run.smithi070.stderr: 64350K .......... .......... .......... .......... .......... 69% 281M 0s 2024-09-12T01:01:30.103 INFO:teuthology.orchestra.run.smithi070.stderr: 64400K .......... .......... .......... .......... .......... 69% 228M 0s 2024-09-12T01:01:30.103 INFO:teuthology.orchestra.run.smithi070.stderr: 64450K .......... .......... .......... .......... .......... 69% 257M 0s 2024-09-12T01:01:30.103 INFO:teuthology.orchestra.run.smithi070.stderr: 64500K .......... .......... .......... .......... .......... 69% 303M 0s 2024-09-12T01:01:30.103 INFO:teuthology.orchestra.run.smithi070.stderr: 64550K .......... .......... .......... .......... .......... 69% 265M 0s 2024-09-12T01:01:30.103 INFO:teuthology.orchestra.run.smithi070.stderr: 64600K .......... .......... .......... .......... .......... 69% 319M 0s 2024-09-12T01:01:30.104 INFO:teuthology.orchestra.run.smithi070.stderr: 64650K .......... .......... .......... .......... .......... 69% 253M 0s 2024-09-12T01:01:30.104 INFO:teuthology.orchestra.run.smithi070.stderr: 64700K .......... .......... .......... .......... .......... 69% 300M 0s 2024-09-12T01:01:30.104 INFO:teuthology.orchestra.run.smithi070.stderr: 64750K .......... .......... .......... .......... .......... 69% 262M 0s 2024-09-12T01:01:30.104 INFO:teuthology.orchestra.run.smithi070.stderr: 64800K .......... .......... .......... .......... .......... 69% 299M 0s 2024-09-12T01:01:30.104 INFO:teuthology.orchestra.run.smithi070.stderr: 64850K .......... .......... .......... .......... .......... 69% 315M 0s 2024-09-12T01:01:30.104 INFO:teuthology.orchestra.run.smithi070.stderr: 64900K .......... .......... .......... .......... .......... 69% 287M 0s 2024-09-12T01:01:30.104 INFO:teuthology.orchestra.run.smithi070.stderr: 64950K .......... .......... .......... .......... .......... 69% 194M 0s 2024-09-12T01:01:30.104 INFO:teuthology.orchestra.run.smithi070.stderr: 65000K .......... .......... .......... .......... .......... 70% 301M 0s 2024-09-12T01:01:30.104 INFO:teuthology.orchestra.run.smithi070.stderr: 65050K .......... .......... .......... .......... .......... 70% 304M 0s 2024-09-12T01:01:30.104 INFO:teuthology.orchestra.run.smithi070.stderr: 65100K .......... .......... .......... .......... .......... 70% 323M 0s 2024-09-12T01:01:30.104 INFO:teuthology.orchestra.run.smithi070.stderr: 65150K .......... .......... .......... .......... .......... 70% 249M 0s 2024-09-12T01:01:30.104 INFO:teuthology.orchestra.run.smithi070.stderr: 65200K .......... .......... .......... .......... .......... 70% 307M 0s 2024-09-12T01:01:30.104 INFO:teuthology.orchestra.run.smithi070.stderr: 65250K .......... .......... .......... .......... .......... 70% 292M 0s 2024-09-12T01:01:30.104 INFO:teuthology.orchestra.run.smithi070.stderr: 65300K .......... .......... .......... .......... .......... 70% 338M 0s 2024-09-12T01:01:30.104 INFO:teuthology.orchestra.run.smithi070.stderr: 65350K .......... .......... .......... .......... .......... 70% 164M 0s 2024-09-12T01:01:30.105 INFO:teuthology.orchestra.run.smithi070.stderr: 65400K .......... .......... .......... .......... .......... 70% 237M 0s 2024-09-12T01:01:30.105 INFO:teuthology.orchestra.run.smithi070.stderr: 65450K .......... .......... .......... .......... .......... 70% 297M 0s 2024-09-12T01:01:30.105 INFO:teuthology.orchestra.run.smithi070.stderr: 65500K .......... .......... .......... .......... .......... 70% 168M 0s 2024-09-12T01:01:30.105 INFO:teuthology.orchestra.run.smithi070.stderr: 65550K .......... .......... .......... .......... .......... 70% 105M 0s 2024-09-12T01:01:30.105 INFO:teuthology.orchestra.run.smithi070.stderr: 65600K .......... .......... .......... .......... .......... 70% 305M 0s 2024-09-12T01:01:30.105 INFO:teuthology.orchestra.run.smithi070.stderr: 65650K .......... .......... .......... .......... .......... 70% 235M 0s 2024-09-12T01:01:30.105 INFO:teuthology.orchestra.run.smithi070.stderr: 65700K .......... .......... .......... .......... .......... 70% 335M 0s 2024-09-12T01:01:30.105 INFO:teuthology.orchestra.run.smithi070.stderr: 65750K .......... .......... .......... .......... .......... 70% 307M 0s 2024-09-12T01:01:30.105 INFO:teuthology.orchestra.run.smithi070.stderr: 65800K .......... .......... .......... .......... .......... 70% 194M 0s 2024-09-12T01:01:30.105 INFO:teuthology.orchestra.run.smithi070.stderr: 65850K .......... .......... .......... .......... .......... 70% 299M 0s 2024-09-12T01:01:30.105 INFO:teuthology.orchestra.run.smithi070.stderr: 65900K .......... .......... .......... .......... .......... 70% 335M 0s 2024-09-12T01:01:30.105 INFO:teuthology.orchestra.run.smithi070.stderr: 65950K .......... .......... .......... .......... .......... 71% 134M 0s 2024-09-12T01:01:30.105 INFO:teuthology.orchestra.run.smithi070.stderr: 66000K .......... .......... .......... .......... .......... 71% 316M 0s 2024-09-12T01:01:30.106 INFO:teuthology.orchestra.run.smithi070.stderr: 66050K .......... .......... .......... .......... .......... 71% 234M 0s 2024-09-12T01:01:30.106 INFO:teuthology.orchestra.run.smithi070.stderr: 66100K .......... .......... .......... .......... .......... 71% 296M 0s 2024-09-12T01:01:30.106 INFO:teuthology.orchestra.run.smithi070.stderr: 66150K .......... .......... .......... .......... .......... 71% 302M 0s 2024-09-12T01:01:30.106 INFO:teuthology.orchestra.run.smithi070.stderr: 66200K .......... .......... .......... .......... .......... 71% 126M 0s 2024-09-12T01:01:30.106 INFO:teuthology.orchestra.run.smithi070.stderr: 66250K .......... .......... .......... .......... .......... 71% 184M 0s 2024-09-12T01:01:30.106 INFO:teuthology.orchestra.run.smithi070.stderr: 66300K .......... .......... .......... .......... .......... 71% 61.7M 0s 2024-09-12T01:01:30.106 INFO:teuthology.orchestra.run.smithi070.stderr: 66350K .......... .......... .......... .......... .......... 71% 209M 0s 2024-09-12T01:01:30.106 INFO:teuthology.orchestra.run.smithi070.stderr: 66400K .......... .......... .......... .......... .......... 71% 305M 0s 2024-09-12T01:01:30.106 INFO:teuthology.orchestra.run.smithi070.stderr: 66450K .......... .......... .......... .......... .......... 71% 330M 0s 2024-09-12T01:01:30.106 INFO:teuthology.orchestra.run.smithi070.stderr: 66500K .......... .......... .......... .......... .......... 71% 319M 0s 2024-09-12T01:01:30.106 INFO:teuthology.orchestra.run.smithi070.stderr: 66550K .......... .......... .......... .......... .......... 71% 278M 0s 2024-09-12T01:01:30.106 INFO:teuthology.orchestra.run.smithi070.stderr: 66600K .......... .......... .......... .......... .......... 71% 301M 0s 2024-09-12T01:01:30.106 INFO:teuthology.orchestra.run.smithi070.stderr: 66650K .......... .......... .......... .......... .......... 71% 335M 0s 2024-09-12T01:01:30.106 INFO:teuthology.orchestra.run.smithi070.stderr: 66700K .......... .......... .......... .......... .......... 71% 341M 0s 2024-09-12T01:01:30.106 INFO:teuthology.orchestra.run.smithi070.stderr: 66750K .......... .......... .......... .......... .......... 71% 258M 0s 2024-09-12T01:01:30.107 INFO:teuthology.orchestra.run.smithi070.stderr: 66800K .......... .......... .......... .......... .......... 71% 314M 0s 2024-09-12T01:01:30.107 INFO:teuthology.orchestra.run.smithi070.stderr: 66850K .......... .......... .......... .......... .......... 72% 313M 0s 2024-09-12T01:01:30.107 INFO:teuthology.orchestra.run.smithi070.stderr: 66900K .......... .......... .......... .......... .......... 72% 322M 0s 2024-09-12T01:01:30.107 INFO:teuthology.orchestra.run.smithi070.stderr: 66950K .......... .......... .......... .......... .......... 72% 303M 0s 2024-09-12T01:01:30.107 INFO:teuthology.orchestra.run.smithi070.stderr: 67000K .......... .......... .......... .......... .......... 72% 304M 0s 2024-09-12T01:01:30.107 INFO:teuthology.orchestra.run.smithi070.stderr: 67050K .......... .......... .......... .......... .......... 72% 315M 0s 2024-09-12T01:01:30.107 INFO:teuthology.orchestra.run.smithi070.stderr: 67100K .......... .......... .......... .......... .......... 72% 324M 0s 2024-09-12T01:01:30.107 INFO:teuthology.orchestra.run.smithi070.stderr: 67150K .......... .......... .......... .......... .......... 72% 264M 0s 2024-09-12T01:01:30.107 INFO:teuthology.orchestra.run.smithi070.stderr: 67200K .......... .......... .......... .......... .......... 72% 322M 0s 2024-09-12T01:01:30.107 INFO:teuthology.orchestra.run.smithi070.stderr: 67250K .......... .......... .......... .......... .......... 72% 258M 0s 2024-09-12T01:01:30.107 INFO:teuthology.orchestra.run.smithi070.stderr: 67300K .......... .......... .......... .......... .......... 72% 85.6M 0s 2024-09-12T01:01:30.107 INFO:teuthology.orchestra.run.smithi070.stderr: 67350K .......... .......... .......... .......... .......... 72% 224M 0s 2024-09-12T01:01:30.107 INFO:teuthology.orchestra.run.smithi070.stderr: 67400K .......... .......... .......... .......... .......... 72% 279M 0s 2024-09-12T01:01:30.107 INFO:teuthology.orchestra.run.smithi070.stderr: 67450K .......... .......... .......... .......... .......... 72% 308M 0s 2024-09-12T01:01:30.107 INFO:teuthology.orchestra.run.smithi070.stderr: 67500K .......... .......... .......... .......... .......... 72% 319M 0s 2024-09-12T01:01:30.107 INFO:teuthology.orchestra.run.smithi070.stderr: 67550K .......... .......... .......... .......... .......... 72% 264M 0s 2024-09-12T01:01:30.108 INFO:teuthology.orchestra.run.smithi070.stderr: 67600K .......... .......... .......... .......... .......... 72% 314M 0s 2024-09-12T01:01:30.108 INFO:teuthology.orchestra.run.smithi070.stderr: 67650K .......... .......... .......... .......... .......... 72% 350M 0s 2024-09-12T01:01:30.108 INFO:teuthology.orchestra.run.smithi070.stderr: 67700K .......... .......... .......... .......... .......... 72% 300M 0s 2024-09-12T01:01:30.108 INFO:teuthology.orchestra.run.smithi070.stderr: 67750K .......... .......... .......... .......... .......... 72% 269M 0s 2024-09-12T01:01:30.108 INFO:teuthology.orchestra.run.smithi070.stderr: 67800K .......... .......... .......... .......... .......... 73% 333M 0s 2024-09-12T01:01:30.108 INFO:teuthology.orchestra.run.smithi070.stderr: 67850K .......... .......... .......... .......... .......... 73% 335M 0s 2024-09-12T01:01:30.108 INFO:teuthology.orchestra.run.smithi070.stderr: 67900K .......... .......... .......... .......... .......... 73% 354M 0s 2024-09-12T01:01:30.108 INFO:teuthology.orchestra.run.smithi070.stderr: 67950K .......... .......... .......... .......... .......... 73% 256M 0s 2024-09-12T01:01:30.108 INFO:teuthology.orchestra.run.smithi070.stderr: 68000K .......... .......... .......... .......... .......... 73% 279M 0s 2024-09-12T01:01:30.108 INFO:teuthology.orchestra.run.smithi070.stderr: 68050K .......... .......... .......... .......... .......... 73% 340M 0s 2024-09-12T01:01:30.108 INFO:teuthology.orchestra.run.smithi070.stderr: 68100K .......... .......... .......... .......... .......... 73% 318M 0s 2024-09-12T01:01:30.108 INFO:teuthology.orchestra.run.smithi070.stderr: 68150K .......... .......... .......... .......... .......... 73% 281M 0s 2024-09-12T01:01:30.108 INFO:teuthology.orchestra.run.smithi070.stderr: 68200K .......... .......... .......... .......... .......... 73% 315M 0s 2024-09-12T01:01:30.108 INFO:teuthology.orchestra.run.smithi070.stderr: 68250K .......... .......... .......... .......... .......... 73% 311M 0s 2024-09-12T01:01:30.109 INFO:teuthology.orchestra.run.smithi070.stderr: 68300K .......... .......... .......... .......... .......... 73% 285M 0s 2024-09-12T01:01:30.109 INFO:teuthology.orchestra.run.smithi070.stderr: 68350K .......... .......... .......... .......... .......... 73% 273M 0s 2024-09-12T01:01:30.109 INFO:teuthology.orchestra.run.smithi070.stderr: 68400K .......... .......... .......... .......... .......... 73% 330M 0s 2024-09-12T01:01:30.109 INFO:teuthology.orchestra.run.smithi070.stderr: 68450K .......... .......... .......... .......... .......... 73% 325M 0s 2024-09-12T01:01:30.109 INFO:teuthology.orchestra.run.smithi070.stderr: 68500K .......... .......... .......... .......... .......... 73% 336M 0s 2024-09-12T01:01:30.109 INFO:teuthology.orchestra.run.smithi070.stderr: 68550K .......... .......... .......... .......... .......... 73% 230M 0s 2024-09-12T01:01:30.109 INFO:teuthology.orchestra.run.smithi070.stderr: 68600K .......... .......... .......... .......... .......... 73% 76.2M 0s 2024-09-12T01:01:30.109 INFO:teuthology.orchestra.run.smithi070.stderr: 68650K .......... .......... .......... .......... .......... 73% 310M 0s 2024-09-12T01:01:30.109 INFO:teuthology.orchestra.run.smithi070.stderr: 68700K .......... .......... .......... .......... .......... 74% 343M 0s 2024-09-12T01:01:30.109 INFO:teuthology.orchestra.run.smithi070.stderr: 68750K .......... .......... .......... .......... .......... 74% 243M 0s 2024-09-12T01:01:30.109 INFO:teuthology.orchestra.run.smithi070.stderr: 68800K .......... .......... .......... .......... .......... 74% 345M 0s 2024-09-12T01:01:30.109 INFO:teuthology.orchestra.run.smithi070.stderr: 68850K .......... .......... .......... .......... .......... 74% 234M 0s 2024-09-12T01:01:30.109 INFO:teuthology.orchestra.run.smithi070.stderr: 68900K .......... .......... .......... .......... .......... 74% 317M 0s 2024-09-12T01:01:30.109 INFO:teuthology.orchestra.run.smithi070.stderr: 68950K .......... .......... .......... .......... .......... 74% 296M 0s 2024-09-12T01:01:30.110 INFO:teuthology.orchestra.run.smithi070.stderr: 69000K .......... .......... .......... .......... .......... 74% 294M 0s 2024-09-12T01:01:30.110 INFO:teuthology.orchestra.run.smithi070.stderr: 69050K .......... .......... .......... .......... .......... 74% 269M 0s 2024-09-12T01:01:30.110 INFO:teuthology.orchestra.run.smithi070.stderr: 69100K .......... .......... .......... .......... .......... 74% 237M 0s 2024-09-12T01:01:30.110 INFO:teuthology.orchestra.run.smithi070.stderr: 69150K .......... .......... .......... .......... .......... 74% 258M 0s 2024-09-12T01:01:30.110 INFO:teuthology.orchestra.run.smithi070.stderr: 69200K .......... .......... .......... .......... .......... 74% 314M 0s 2024-09-12T01:01:30.110 INFO:teuthology.orchestra.run.smithi070.stderr: 69250K .......... .......... .......... .......... .......... 74% 103M 0s 2024-09-12T01:01:30.110 INFO:teuthology.orchestra.run.smithi070.stderr: 69300K .......... .......... .......... .......... .......... 74% 105M 0s 2024-09-12T01:01:30.110 INFO:teuthology.orchestra.run.smithi070.stderr: 69350K .......... .......... .......... .......... .......... 74% 100M 0s 2024-09-12T01:01:30.110 INFO:teuthology.orchestra.run.smithi070.stderr: 69400K .......... .......... .......... .......... .......... 74% 294M 0s 2024-09-12T01:01:30.110 INFO:teuthology.orchestra.run.smithi070.stderr: 69450K .......... .......... .......... .......... .......... 74% 285M 0s 2024-09-12T01:01:30.110 INFO:teuthology.orchestra.run.smithi070.stderr: 69500K .......... .......... .......... .......... .......... 74% 340M 0s 2024-09-12T01:01:30.110 INFO:teuthology.orchestra.run.smithi070.stderr: 69550K .......... .......... .......... .......... .......... 74% 249M 0s 2024-09-12T01:01:30.110 INFO:teuthology.orchestra.run.smithi070.stderr: 69600K .......... .......... .......... .......... .......... 74% 315M 0s 2024-09-12T01:01:30.110 INFO:teuthology.orchestra.run.smithi070.stderr: 69650K .......... .......... .......... .......... .......... 75% 323M 0s 2024-09-12T01:01:30.111 INFO:teuthology.orchestra.run.smithi070.stderr: 69700K .......... .......... .......... .......... .......... 75% 306M 0s 2024-09-12T01:01:30.111 INFO:teuthology.orchestra.run.smithi070.stderr: 69750K .......... .......... .......... .......... .......... 75% 229M 0s 2024-09-12T01:01:30.111 INFO:teuthology.orchestra.run.smithi070.stderr: 69800K .......... .......... .......... .......... .......... 75% 299M 0s 2024-09-12T01:01:30.111 INFO:teuthology.orchestra.run.smithi070.stderr: 69850K .......... .......... .......... .......... .......... 75% 300M 0s 2024-09-12T01:01:30.111 INFO:teuthology.orchestra.run.smithi070.stderr: 69900K .......... .......... .......... .......... .......... 75% 332M 0s 2024-09-12T01:01:30.111 INFO:teuthology.orchestra.run.smithi070.stderr: 69950K .......... .......... .......... .......... .......... 75% 259M 0s 2024-09-12T01:01:30.111 INFO:teuthology.orchestra.run.smithi070.stderr: 70000K .......... .......... .......... .......... .......... 75% 246M 0s 2024-09-12T01:01:30.111 INFO:teuthology.orchestra.run.smithi070.stderr: 70050K .......... .......... .......... .......... .......... 75% 155M 0s 2024-09-12T01:01:30.111 INFO:teuthology.orchestra.run.smithi070.stderr: 70100K .......... .......... .......... .......... .......... 75% 181M 0s 2024-09-12T01:01:30.111 INFO:teuthology.orchestra.run.smithi070.stderr: 70150K .......... .......... .......... .......... .......... 75% 242M 0s 2024-09-12T01:01:30.111 INFO:teuthology.orchestra.run.smithi070.stderr: 70200K .......... .......... .......... .......... .......... 75% 332M 0s 2024-09-12T01:01:30.111 INFO:teuthology.orchestra.run.smithi070.stderr: 70250K .......... .......... .......... .......... .......... 75% 247M 0s 2024-09-12T01:01:30.111 INFO:teuthology.orchestra.run.smithi070.stderr: 70300K .......... .......... .......... .......... .......... 75% 282M 0s 2024-09-12T01:01:30.111 INFO:teuthology.orchestra.run.smithi070.stderr: 70350K .......... .......... .......... .......... .......... 75% 164M 0s 2024-09-12T01:01:30.112 INFO:teuthology.orchestra.run.smithi070.stderr: 70400K .......... .......... .......... .......... .......... 75% 299M 0s 2024-09-12T01:01:30.112 INFO:teuthology.orchestra.run.smithi070.stderr: 70450K .......... .......... .......... .......... .......... 75% 297M 0s 2024-09-12T01:01:30.112 INFO:teuthology.orchestra.run.smithi070.stderr: 70500K .......... .......... .......... .......... .......... 75% 295M 0s 2024-09-12T01:01:30.112 INFO:teuthology.orchestra.run.smithi070.stderr: 70550K .......... .......... .......... .......... .......... 75% 294M 0s 2024-09-12T01:01:30.112 INFO:teuthology.orchestra.run.smithi070.stderr: 70600K .......... .......... .......... .......... .......... 76% 347M 0s 2024-09-12T01:01:30.112 INFO:teuthology.orchestra.run.smithi070.stderr: 70650K .......... .......... .......... .......... .......... 76% 292M 0s 2024-09-12T01:01:30.112 INFO:teuthology.orchestra.run.smithi070.stderr: 70700K .......... .......... .......... .......... .......... 76% 311M 0s 2024-09-12T01:01:30.112 INFO:teuthology.orchestra.run.smithi070.stderr: 70750K .......... .......... .......... .......... .......... 76% 274M 0s 2024-09-12T01:01:30.112 INFO:teuthology.orchestra.run.smithi070.stderr: 70800K .......... .......... .......... .......... .......... 76% 317M 0s 2024-09-12T01:01:30.112 INFO:teuthology.orchestra.run.smithi070.stderr: 70850K .......... .......... .......... .......... .......... 76% 300M 0s 2024-09-12T01:01:30.112 INFO:teuthology.orchestra.run.smithi070.stderr: 70900K .......... .......... .......... .......... .......... 76% 313M 0s 2024-09-12T01:01:30.112 INFO:teuthology.orchestra.run.smithi070.stderr: 70950K .......... .......... .......... .......... .......... 76% 293M 0s 2024-09-12T01:01:30.112 INFO:teuthology.orchestra.run.smithi070.stderr: 71000K .......... .......... .......... .......... .......... 76% 356M 0s 2024-09-12T01:01:30.112 INFO:teuthology.orchestra.run.smithi070.stderr: 71050K .......... .......... .......... .......... .......... 76% 356M 0s 2024-09-12T01:01:30.113 INFO:teuthology.orchestra.run.smithi070.stderr: 71100K .......... .......... .......... .......... .......... 76% 101M 0s 2024-09-12T01:01:30.113 INFO:teuthology.orchestra.run.smithi070.stderr: 71150K .......... .......... .......... .......... .......... 76% 258M 0s 2024-09-12T01:01:30.113 INFO:teuthology.orchestra.run.smithi070.stderr: 71200K .......... .......... .......... .......... .......... 76% 282M 0s 2024-09-12T01:01:30.113 INFO:teuthology.orchestra.run.smithi070.stderr: 71250K .......... .......... .......... .......... .......... 76% 290M 0s 2024-09-12T01:01:30.113 INFO:teuthology.orchestra.run.smithi070.stderr: 71300K .......... .......... .......... .......... .......... 76% 329M 0s 2024-09-12T01:01:30.113 INFO:teuthology.orchestra.run.smithi070.stderr: 71350K .......... .......... .......... .......... .......... 76% 245M 0s 2024-09-12T01:01:30.113 INFO:teuthology.orchestra.run.smithi070.stderr: 71400K .......... .......... .......... .......... .......... 76% 326M 0s 2024-09-12T01:01:30.113 INFO:teuthology.orchestra.run.smithi070.stderr: 71450K .......... .......... .......... .......... .......... 76% 348M 0s 2024-09-12T01:01:30.113 INFO:teuthology.orchestra.run.smithi070.stderr: 71500K .......... .......... .......... .......... .......... 77% 332M 0s 2024-09-12T01:01:30.113 INFO:teuthology.orchestra.run.smithi070.stderr: 71550K .......... .......... .......... .......... .......... 77% 257M 0s 2024-09-12T01:01:30.113 INFO:teuthology.orchestra.run.smithi070.stderr: 71600K .......... .......... .......... .......... .......... 77% 323M 0s 2024-09-12T01:01:30.113 INFO:teuthology.orchestra.run.smithi070.stderr: 71650K .......... .......... .......... .......... .......... 77% 127M 0s 2024-09-12T01:01:30.113 INFO:teuthology.orchestra.run.smithi070.stderr: 71700K .......... .......... .......... .......... .......... 77% 324M 0s 2024-09-12T01:01:30.113 INFO:teuthology.orchestra.run.smithi070.stderr: 71750K .......... .......... .......... .......... .......... 77% 365M 0s 2024-09-12T01:01:30.114 INFO:teuthology.orchestra.run.smithi070.stderr: 71800K .......... .......... .......... .......... .......... 77% 184M 0s 2024-09-12T01:01:30.114 INFO:teuthology.orchestra.run.smithi070.stderr: 71850K .......... .......... .......... .......... .......... 77% 294M 0s 2024-09-12T01:01:30.114 INFO:teuthology.orchestra.run.smithi070.stderr: 71900K .......... .......... .......... .......... .......... 77% 285M 0s 2024-09-12T01:01:30.114 INFO:teuthology.orchestra.run.smithi070.stderr: 71950K .......... .......... .......... .......... .......... 77% 344M 0s 2024-09-12T01:01:30.114 INFO:teuthology.orchestra.run.smithi070.stderr: 72000K .......... .......... .......... .......... .......... 77% 301M 0s 2024-09-12T01:01:30.114 INFO:teuthology.orchestra.run.smithi070.stderr: 72050K .......... .......... .......... .......... .......... 77% 311M 0s 2024-09-12T01:01:30.114 INFO:teuthology.orchestra.run.smithi070.stderr: 72100K .......... .......... .......... .......... .......... 77% 310M 0s 2024-09-12T01:01:30.114 INFO:teuthology.orchestra.run.smithi070.stderr: 72150K .......... .......... .......... .......... .......... 77% 144M 0s 2024-09-12T01:01:30.114 INFO:teuthology.orchestra.run.smithi070.stderr: 72200K .......... .......... .......... .......... .......... 77% 321M 0s 2024-09-12T01:01:30.114 INFO:teuthology.orchestra.run.smithi070.stderr: 72250K .......... .......... .......... .......... .......... 77% 335M 0s 2024-09-12T01:01:30.114 INFO:teuthology.orchestra.run.smithi070.stderr: 72300K .......... .......... .......... .......... .......... 77% 184M 0s 2024-09-12T01:01:30.114 INFO:teuthology.orchestra.run.smithi070.stderr: 72350K .......... .......... .......... .......... .......... 77% 282M 0s 2024-09-12T01:01:30.114 INFO:teuthology.orchestra.run.smithi070.stderr: 72400K .......... .......... .......... .......... .......... 77% 73.3M 0s 2024-09-12T01:01:30.114 INFO:teuthology.orchestra.run.smithi070.stderr: 72450K .......... .......... .......... .......... .......... 78% 295M 0s 2024-09-12T01:01:30.114 INFO:teuthology.orchestra.run.smithi070.stderr: 72500K .......... .......... .......... .......... .......... 78% 243M 0s 2024-09-12T01:01:30.115 INFO:teuthology.orchestra.run.smithi070.stderr: 72550K .......... .......... .......... .......... .......... 78% 353M 0s 2024-09-12T01:01:30.115 INFO:teuthology.orchestra.run.smithi070.stderr: 72600K .......... .......... .......... .......... .......... 78% 126M 0s 2024-09-12T01:01:30.115 INFO:teuthology.orchestra.run.smithi070.stderr: 72650K .......... .......... .......... .......... .......... 78% 311M 0s 2024-09-12T01:01:30.115 INFO:teuthology.orchestra.run.smithi070.stderr: 72700K .......... .......... .......... .......... .......... 78% 252M 0s 2024-09-12T01:01:30.115 INFO:teuthology.orchestra.run.smithi070.stderr: 72750K .......... .......... .......... .......... .......... 78% 335M 0s 2024-09-12T01:01:30.115 INFO:teuthology.orchestra.run.smithi070.stderr: 72800K .......... .......... .......... .......... .......... 78% 299M 0s 2024-09-12T01:01:30.115 INFO:teuthology.orchestra.run.smithi070.stderr: 72850K .......... .......... .......... .......... .......... 78% 320M 0s 2024-09-12T01:01:30.115 INFO:teuthology.orchestra.run.smithi070.stderr: 72900K .......... .......... .......... .......... .......... 78% 280M 0s 2024-09-12T01:01:30.115 INFO:teuthology.orchestra.run.smithi070.stderr: 72950K .......... .......... .......... .......... .......... 78% 348M 0s 2024-09-12T01:01:30.115 INFO:teuthology.orchestra.run.smithi070.stderr: 73000K .......... .......... .......... .......... .......... 78% 104M 0s 2024-09-12T01:01:30.115 INFO:teuthology.orchestra.run.smithi070.stderr: 73050K .......... .......... .......... .......... .......... 78% 287M 0s 2024-09-12T01:01:30.115 INFO:teuthology.orchestra.run.smithi070.stderr: 73100K .......... .......... .......... .......... .......... 78% 261M 0s 2024-09-12T01:01:30.115 INFO:teuthology.orchestra.run.smithi070.stderr: 73150K .......... .......... .......... .......... .......... 78% 330M 0s 2024-09-12T01:01:30.115 INFO:teuthology.orchestra.run.smithi070.stderr: 73200K .......... .......... .......... .......... .......... 78% 323M 0s 2024-09-12T01:01:30.115 INFO:teuthology.orchestra.run.smithi070.stderr: 73250K .......... .......... .......... .......... .......... 78% 318M 0s 2024-09-12T01:01:30.116 INFO:teuthology.orchestra.run.smithi070.stderr: 73300K .......... .......... .......... .......... .......... 78% 166M 0s 2024-09-12T01:01:30.116 INFO:teuthology.orchestra.run.smithi070.stderr: 73350K .......... .......... .......... .......... .......... 79% 303M 0s 2024-09-12T01:01:30.116 INFO:teuthology.orchestra.run.smithi070.stderr: 73400K .......... .......... .......... .......... .......... 79% 354M 0s 2024-09-12T01:01:30.116 INFO:teuthology.orchestra.run.smithi070.stderr: 73450K .......... .......... .......... .......... .......... 79% 279M 0s 2024-09-12T01:01:30.116 INFO:teuthology.orchestra.run.smithi070.stderr: 73500K .......... .......... .......... .......... .......... 79% 270M 0s 2024-09-12T01:01:30.116 INFO:teuthology.orchestra.run.smithi070.stderr: 73550K .......... .......... .......... .......... .......... 79% 294M 0s 2024-09-12T01:01:30.116 INFO:teuthology.orchestra.run.smithi070.stderr: 73600K .......... .......... .......... .......... .......... 79% 315M 0s 2024-09-12T01:01:30.116 INFO:teuthology.orchestra.run.smithi070.stderr: 73650K .......... .......... .......... .......... .......... 79% 333M 0s 2024-09-12T01:01:30.116 INFO:teuthology.orchestra.run.smithi070.stderr: 73700K .......... .......... .......... .......... .......... 79% 275M 0s 2024-09-12T01:01:30.116 INFO:teuthology.orchestra.run.smithi070.stderr: 73750K .......... .......... .......... .......... .......... 79% 350M 0s 2024-09-12T01:01:30.116 INFO:teuthology.orchestra.run.smithi070.stderr: 73800K .......... .......... .......... .......... .......... 79% 277M 0s 2024-09-12T01:01:30.116 INFO:teuthology.orchestra.run.smithi070.stderr: 73850K .......... .......... .......... .......... .......... 79% 222M 0s 2024-09-12T01:01:30.116 INFO:teuthology.orchestra.run.smithi070.stderr: 73900K .......... .......... .......... .......... .......... 79% 304M 0s 2024-09-12T01:01:30.116 INFO:teuthology.orchestra.run.smithi070.stderr: 73950K .......... .......... .......... .......... .......... 79% 317M 0s 2024-09-12T01:01:30.117 INFO:teuthology.orchestra.run.smithi070.stderr: 74000K .......... .......... .......... .......... .......... 79% 45.0M 0s 2024-09-12T01:01:30.117 INFO:teuthology.orchestra.run.smithi070.stderr: 74050K .......... .......... .......... .......... .......... 79% 303M 0s 2024-09-12T01:01:30.117 INFO:teuthology.orchestra.run.smithi070.stderr: 74100K .......... .......... .......... .......... .......... 79% 241M 0s 2024-09-12T01:01:30.117 INFO:teuthology.orchestra.run.smithi070.stderr: 74150K .......... .......... .......... .......... .......... 79% 317M 0s 2024-09-12T01:01:30.117 INFO:teuthology.orchestra.run.smithi070.stderr: 74200K .......... .......... .......... .......... .......... 79% 290M 0s 2024-09-12T01:01:30.117 INFO:teuthology.orchestra.run.smithi070.stderr: 74250K .......... .......... .......... .......... .......... 79% 301M 0s 2024-09-12T01:01:30.117 INFO:teuthology.orchestra.run.smithi070.stderr: 74300K .......... .......... .......... .......... .......... 80% 285M 0s 2024-09-12T01:01:30.117 INFO:teuthology.orchestra.run.smithi070.stderr: 74350K .......... .......... .......... .......... .......... 80% 329M 0s 2024-09-12T01:01:30.117 INFO:teuthology.orchestra.run.smithi070.stderr: 74400K .......... .......... .......... .......... .......... 80% 333M 0s 2024-09-12T01:01:30.117 INFO:teuthology.orchestra.run.smithi070.stderr: 74450K .......... .......... .......... .......... .......... 80% 333M 0s 2024-09-12T01:01:30.117 INFO:teuthology.orchestra.run.smithi070.stderr: 74500K .......... .......... .......... .......... .......... 80% 267M 0s 2024-09-12T01:01:30.117 INFO:teuthology.orchestra.run.smithi070.stderr: 74550K .......... .......... .......... .......... .......... 80% 325M 0s 2024-09-12T01:01:30.118 INFO:teuthology.orchestra.run.smithi070.stderr: 74600K .......... .......... .......... .......... .......... 80% 322M 0s 2024-09-12T01:01:30.118 INFO:teuthology.orchestra.run.smithi070.stderr: 74650K .......... .......... .......... .......... .......... 80% 338M 0s 2024-09-12T01:01:30.118 INFO:teuthology.orchestra.run.smithi070.stderr: 74700K .......... .......... .......... .......... .......... 80% 275M 0s 2024-09-12T01:01:30.118 INFO:teuthology.orchestra.run.smithi070.stderr: 74750K .......... .......... .......... .......... .......... 80% 330M 0s 2024-09-12T01:01:30.118 INFO:teuthology.orchestra.run.smithi070.stderr: 74800K .......... .......... .......... .......... .......... 80% 293M 0s 2024-09-12T01:01:30.118 INFO:teuthology.orchestra.run.smithi070.stderr: 74850K .......... .......... .......... .......... .......... 80% 348M 0s 2024-09-12T01:01:30.118 INFO:teuthology.orchestra.run.smithi070.stderr: 74900K .......... .......... .......... .......... .......... 80% 290M 0s 2024-09-12T01:01:30.118 INFO:teuthology.orchestra.run.smithi070.stderr: 74950K .......... .......... .......... .......... .......... 80% 342M 0s 2024-09-12T01:01:30.118 INFO:teuthology.orchestra.run.smithi070.stderr: 75000K .......... .......... .......... .......... .......... 80% 351M 0s 2024-09-12T01:01:30.118 INFO:teuthology.orchestra.run.smithi070.stderr: 75050K .......... .......... .......... .......... .......... 80% 345M 0s 2024-09-12T01:01:30.118 INFO:teuthology.orchestra.run.smithi070.stderr: 75100K .......... .......... .......... .......... .......... 80% 290M 0s 2024-09-12T01:01:30.118 INFO:teuthology.orchestra.run.smithi070.stderr: 75150K .......... .......... .......... .......... .......... 80% 301M 0s 2024-09-12T01:01:30.118 INFO:teuthology.orchestra.run.smithi070.stderr: 75200K .......... .......... .......... .......... .......... 81% 309M 0s 2024-09-12T01:01:30.118 INFO:teuthology.orchestra.run.smithi070.stderr: 75250K .......... .......... .......... .......... .......... 81% 321M 0s 2024-09-12T01:01:30.118 INFO:teuthology.orchestra.run.smithi070.stderr: 75300K .......... .......... .......... .......... .......... 81% 315M 0s 2024-09-12T01:01:30.119 INFO:teuthology.orchestra.run.smithi070.stderr: 75350K .......... .......... .......... .......... .......... 81% 351M 0s 2024-09-12T01:01:30.119 INFO:teuthology.orchestra.run.smithi070.stderr: 75400K .......... .......... .......... .......... .......... 81% 100M 0s 2024-09-12T01:01:30.119 INFO:teuthology.orchestra.run.smithi070.stderr: 75450K .......... .......... .......... .......... .......... 81% 178M 0s 2024-09-12T01:01:30.119 INFO:teuthology.orchestra.run.smithi070.stderr: 75500K .......... .......... .......... .......... .......... 81% 117M 0s 2024-09-12T01:01:30.119 INFO:teuthology.orchestra.run.smithi070.stderr: 75550K .......... .......... .......... .......... .......... 81% 186M 0s 2024-09-12T01:01:30.119 INFO:teuthology.orchestra.run.smithi070.stderr: 75600K .......... .......... .......... .......... .......... 81% 360M 0s 2024-09-12T01:01:30.119 INFO:teuthology.orchestra.run.smithi070.stderr: 75650K .......... .......... .......... .......... .......... 81% 218M 0s 2024-09-12T01:01:30.119 INFO:teuthology.orchestra.run.smithi070.stderr: 75700K .......... .......... .......... .......... .......... 81% 279M 0s 2024-09-12T01:01:30.119 INFO:teuthology.orchestra.run.smithi070.stderr: 75750K .......... .......... .......... .......... .......... 81% 313M 0s 2024-09-12T01:01:30.119 INFO:teuthology.orchestra.run.smithi070.stderr: 75800K .......... .......... .......... .......... .......... 81% 316M 0s 2024-09-12T01:01:30.119 INFO:teuthology.orchestra.run.smithi070.stderr: 75850K .......... .......... .......... .......... .......... 81% 338M 0s 2024-09-12T01:01:30.119 INFO:teuthology.orchestra.run.smithi070.stderr: 75900K .......... .......... .......... .......... .......... 81% 104M 0s 2024-09-12T01:01:30.119 INFO:teuthology.orchestra.run.smithi070.stderr: 75950K .......... .......... .......... .......... .......... 81% 316M 0s 2024-09-12T01:01:30.119 INFO:teuthology.orchestra.run.smithi070.stderr: 76000K .......... .......... .......... .......... .......... 81% 335M 0s 2024-09-12T01:01:30.119 INFO:teuthology.orchestra.run.smithi070.stderr: 76050K .......... .......... .......... .......... .......... 81% 344M 0s 2024-09-12T01:01:30.120 INFO:teuthology.orchestra.run.smithi070.stderr: 76100K .......... .......... .......... .......... .......... 81% 310M 0s 2024-09-12T01:01:30.120 INFO:teuthology.orchestra.run.smithi070.stderr: 76150K .......... .......... .......... .......... .......... 82% 337M 0s 2024-09-12T01:01:30.120 INFO:teuthology.orchestra.run.smithi070.stderr: 76200K .......... .......... .......... .......... .......... 82% 372M 0s 2024-09-12T01:01:30.120 INFO:teuthology.orchestra.run.smithi070.stderr: 76250K .......... .......... .......... .......... .......... 82% 167M 0s 2024-09-12T01:01:30.120 INFO:teuthology.orchestra.run.smithi070.stderr: 76300K .......... .......... .......... .......... .......... 82% 254M 0s 2024-09-12T01:01:30.120 INFO:teuthology.orchestra.run.smithi070.stderr: 76350K .......... .......... .......... .......... .......... 82% 321M 0s 2024-09-12T01:01:30.120 INFO:teuthology.orchestra.run.smithi070.stderr: 76400K .......... .......... .......... .......... .......... 82% 337M 0s 2024-09-12T01:01:30.120 INFO:teuthology.orchestra.run.smithi070.stderr: 76450K .......... .......... .......... .......... .......... 82% 319M 0s 2024-09-12T01:01:30.120 INFO:teuthology.orchestra.run.smithi070.stderr: 76500K .......... .......... .......... .......... .......... 82% 298M 0s 2024-09-12T01:01:30.120 INFO:teuthology.orchestra.run.smithi070.stderr: 76550K .......... .......... .......... .......... .......... 82% 301M 0s 2024-09-12T01:01:30.120 INFO:teuthology.orchestra.run.smithi070.stderr: 76600K .......... .......... .......... .......... .......... 82% 353M 0s 2024-09-12T01:01:30.120 INFO:teuthology.orchestra.run.smithi070.stderr: 76650K .......... .......... .......... .......... .......... 82% 332M 0s 2024-09-12T01:01:30.120 INFO:teuthology.orchestra.run.smithi070.stderr: 76700K .......... .......... .......... .......... .......... 82% 270M 0s 2024-09-12T01:01:30.120 INFO:teuthology.orchestra.run.smithi070.stderr: 76750K .......... .......... .......... .......... .......... 82% 322M 0s 2024-09-12T01:01:30.120 INFO:teuthology.orchestra.run.smithi070.stderr: 76800K .......... .......... .......... .......... .......... 82% 341M 0s 2024-09-12T01:01:30.121 INFO:teuthology.orchestra.run.smithi070.stderr: 76850K .......... .......... .......... .......... .......... 82% 336M 0s 2024-09-12T01:01:30.121 INFO:teuthology.orchestra.run.smithi070.stderr: 76900K .......... .......... .......... .......... .......... 82% 297M 0s 2024-09-12T01:01:30.121 INFO:teuthology.orchestra.run.smithi070.stderr: 76950K .......... .......... .......... .......... .......... 82% 53.3M 0s 2024-09-12T01:01:30.121 INFO:teuthology.orchestra.run.smithi070.stderr: 77000K .......... .......... .......... .......... .......... 82% 347M 0s 2024-09-12T01:01:30.121 INFO:teuthology.orchestra.run.smithi070.stderr: 77050K .......... .......... .......... .......... .......... 82% 185M 0s 2024-09-12T01:01:30.121 INFO:teuthology.orchestra.run.smithi070.stderr: 77100K .......... .......... .......... .......... .......... 83% 152M 0s 2024-09-12T01:01:30.121 INFO:teuthology.orchestra.run.smithi070.stderr: 77150K .......... .......... .......... .......... .......... 83% 352M 0s 2024-09-12T01:01:30.121 INFO:teuthology.orchestra.run.smithi070.stderr: 77200K .......... .......... .......... .......... .......... 83% 120M 0s 2024-09-12T01:01:30.121 INFO:teuthology.orchestra.run.smithi070.stderr: 77250K .......... .......... .......... .......... .......... 83% 311M 0s 2024-09-12T01:01:30.121 INFO:teuthology.orchestra.run.smithi070.stderr: 77300K .......... .......... .......... .......... .......... 83% 306M 0s 2024-09-12T01:01:30.121 INFO:teuthology.orchestra.run.smithi070.stderr: 77350K .......... .......... .......... .......... .......... 83% 336M 0s 2024-09-12T01:01:30.121 INFO:teuthology.orchestra.run.smithi070.stderr: 77400K .......... .......... .......... .......... .......... 83% 358M 0s 2024-09-12T01:01:30.121 INFO:teuthology.orchestra.run.smithi070.stderr: 77450K .......... .......... .......... .......... .......... 83% 359M 0s 2024-09-12T01:01:30.122 INFO:teuthology.orchestra.run.smithi070.stderr: 77500K .......... .......... .......... .......... .......... 83% 273M 0s 2024-09-12T01:01:30.122 INFO:teuthology.orchestra.run.smithi070.stderr: 77550K .......... .......... .......... .......... .......... 83% 336M 0s 2024-09-12T01:01:30.122 INFO:teuthology.orchestra.run.smithi070.stderr: 77600K .......... .......... .......... .......... .......... 83% 344M 0s 2024-09-12T01:01:30.122 INFO:teuthology.orchestra.run.smithi070.stderr: 77650K .......... .......... .......... .......... .......... 83% 297M 0s 2024-09-12T01:01:30.122 INFO:teuthology.orchestra.run.smithi070.stderr: 77700K .......... .......... .......... .......... .......... 83% 323M 0s 2024-09-12T01:01:30.122 INFO:teuthology.orchestra.run.smithi070.stderr: 77750K .......... .......... .......... .......... .......... 83% 337M 0s 2024-09-12T01:01:30.122 INFO:teuthology.orchestra.run.smithi070.stderr: 77800K .......... .......... .......... .......... .......... 83% 332M 0s 2024-09-12T01:01:30.122 INFO:teuthology.orchestra.run.smithi070.stderr: 77850K .......... .......... .......... .......... .......... 83% 360M 0s 2024-09-12T01:01:30.122 INFO:teuthology.orchestra.run.smithi070.stderr: 77900K .......... .......... .......... .......... .......... 83% 207M 0s 2024-09-12T01:01:30.122 INFO:teuthology.orchestra.run.smithi070.stderr: 77950K .......... .......... .......... .......... .......... 83% 321M 0s 2024-09-12T01:01:30.122 INFO:teuthology.orchestra.run.smithi070.stderr: 78000K .......... .......... .......... .......... .......... 84% 286M 0s 2024-09-12T01:01:30.122 INFO:teuthology.orchestra.run.smithi070.stderr: 78050K .......... .......... .......... .......... .......... 84% 308M 0s 2024-09-12T01:01:30.122 INFO:teuthology.orchestra.run.smithi070.stderr: 78100K .......... .......... .......... .......... .......... 84% 283M 0s 2024-09-12T01:01:30.122 INFO:teuthology.orchestra.run.smithi070.stderr: 78150K .......... .......... .......... .......... .......... 84% 292M 0s 2024-09-12T01:01:30.123 INFO:teuthology.orchestra.run.smithi070.stderr: 78200K .......... .......... .......... .......... .......... 84% 338M 0s 2024-09-12T01:01:30.123 INFO:teuthology.orchestra.run.smithi070.stderr: 78250K .......... .......... .......... .......... .......... 84% 355M 0s 2024-09-12T01:01:30.123 INFO:teuthology.orchestra.run.smithi070.stderr: 78300K .......... .......... .......... .......... .......... 84% 227M 0s 2024-09-12T01:01:30.123 INFO:teuthology.orchestra.run.smithi070.stderr: 78350K .......... .......... .......... .......... .......... 84% 281M 0s 2024-09-12T01:01:30.123 INFO:teuthology.orchestra.run.smithi070.stderr: 78400K .......... .......... .......... .......... .......... 84% 307M 0s 2024-09-12T01:01:30.123 INFO:teuthology.orchestra.run.smithi070.stderr: 78450K .......... .......... .......... .......... .......... 84% 315M 0s 2024-09-12T01:01:30.123 INFO:teuthology.orchestra.run.smithi070.stderr: 78500K .......... .......... .......... .......... .......... 84% 88.6M 0s 2024-09-12T01:01:30.123 INFO:teuthology.orchestra.run.smithi070.stderr: 78550K .......... .......... .......... .......... .......... 84% 291M 0s 2024-09-12T01:01:30.123 INFO:teuthology.orchestra.run.smithi070.stderr: 78600K .......... .......... .......... .......... .......... 84% 354M 0s 2024-09-12T01:01:30.123 INFO:teuthology.orchestra.run.smithi070.stderr: 78650K .......... .......... .......... .......... .......... 84% 306M 0s 2024-09-12T01:01:30.123 INFO:teuthology.orchestra.run.smithi070.stderr: 78700K .......... .......... .......... .......... .......... 84% 251M 0s 2024-09-12T01:01:30.123 INFO:teuthology.orchestra.run.smithi070.stderr: 78750K .......... .......... .......... .......... .......... 84% 289M 0s 2024-09-12T01:01:30.123 INFO:teuthology.orchestra.run.smithi070.stderr: 78800K .......... .......... .......... .......... .......... 84% 329M 0s 2024-09-12T01:01:30.124 INFO:teuthology.orchestra.run.smithi070.stderr: 78850K .......... .......... .......... .......... .......... 84% 80.3M 0s 2024-09-12T01:01:30.124 INFO:teuthology.orchestra.run.smithi070.stderr: 78900K .......... .......... .......... .......... .......... 84% 279M 0s 2024-09-12T01:01:30.124 INFO:teuthology.orchestra.run.smithi070.stderr: 78950K .......... .......... .......... .......... .......... 85% 338M 0s 2024-09-12T01:01:30.124 INFO:teuthology.orchestra.run.smithi070.stderr: 79000K .......... .......... .......... .......... .......... 85% 329M 0s 2024-09-12T01:01:30.124 INFO:teuthology.orchestra.run.smithi070.stderr: 79050K .......... .......... .......... .......... .......... 85% 333M 0s 2024-09-12T01:01:30.124 INFO:teuthology.orchestra.run.smithi070.stderr: 79100K .......... .......... .......... .......... .......... 85% 267M 0s 2024-09-12T01:01:30.124 INFO:teuthology.orchestra.run.smithi070.stderr: 79150K .......... .......... .......... .......... .......... 85% 207M 0s 2024-09-12T01:01:30.124 INFO:teuthology.orchestra.run.smithi070.stderr: 79200K .......... .......... .......... .......... .......... 85% 316M 0s 2024-09-12T01:01:30.124 INFO:teuthology.orchestra.run.smithi070.stderr: 79250K .......... .......... .......... .......... .......... 85% 309M 0s 2024-09-12T01:01:30.124 INFO:teuthology.orchestra.run.smithi070.stderr: 79300K .......... .......... .......... .......... .......... 85% 292M 0s 2024-09-12T01:01:30.124 INFO:teuthology.orchestra.run.smithi070.stderr: 79350K .......... .......... .......... .......... .......... 85% 350M 0s 2024-09-12T01:01:30.124 INFO:teuthology.orchestra.run.smithi070.stderr: 79400K .......... .......... .......... .......... .......... 85% 271M 0s 2024-09-12T01:01:30.124 INFO:teuthology.orchestra.run.smithi070.stderr: 79450K .......... .......... .......... .......... .......... 85% 338M 0s 2024-09-12T01:01:30.125 INFO:teuthology.orchestra.run.smithi070.stderr: 79500K .......... .......... .......... .......... .......... 85% 267M 0s 2024-09-12T01:01:30.125 INFO:teuthology.orchestra.run.smithi070.stderr: 79550K .......... .......... .......... .......... .......... 85% 325M 0s 2024-09-12T01:01:30.125 INFO:teuthology.orchestra.run.smithi070.stderr: 79600K .......... .......... .......... .......... .......... 85% 318M 0s 2024-09-12T01:01:30.125 INFO:teuthology.orchestra.run.smithi070.stderr: 79650K .......... .......... .......... .......... .......... 85% 361M 0s 2024-09-12T01:01:30.125 INFO:teuthology.orchestra.run.smithi070.stderr: 79700K .......... .......... .......... .......... .......... 85% 305M 0s 2024-09-12T01:01:30.125 INFO:teuthology.orchestra.run.smithi070.stderr: 79750K .......... .......... .......... .......... .......... 85% 315M 0s 2024-09-12T01:01:30.125 INFO:teuthology.orchestra.run.smithi070.stderr: 79800K .......... .......... .......... .......... .......... 85% 343M 0s 2024-09-12T01:01:30.125 INFO:teuthology.orchestra.run.smithi070.stderr: 79850K .......... .......... .......... .......... .......... 86% 355M 0s 2024-09-12T01:01:30.125 INFO:teuthology.orchestra.run.smithi070.stderr: 79900K .......... .......... .......... .......... .......... 86% 68.5M 0s 2024-09-12T01:01:30.125 INFO:teuthology.orchestra.run.smithi070.stderr: 79950K .......... .......... .......... .......... .......... 86% 333M 0s 2024-09-12T01:01:30.125 INFO:teuthology.orchestra.run.smithi070.stderr: 80000K .......... .......... .......... .......... .......... 86% 181M 0s 2024-09-12T01:01:30.125 INFO:teuthology.orchestra.run.smithi070.stderr: 80050K .......... .......... .......... .......... .......... 86% 316M 0s 2024-09-12T01:01:30.125 INFO:teuthology.orchestra.run.smithi070.stderr: 80100K .......... .......... .......... .......... .......... 86% 276M 0s 2024-09-12T01:01:30.125 INFO:teuthology.orchestra.run.smithi070.stderr: 80150K .......... .......... .......... .......... .......... 86% 332M 0s 2024-09-12T01:01:30.125 INFO:teuthology.orchestra.run.smithi070.stderr: 80200K .......... .......... .......... .......... .......... 86% 108M 0s 2024-09-12T01:01:30.126 INFO:teuthology.orchestra.run.smithi070.stderr: 80250K .......... .......... .......... .......... .......... 86% 144M 0s 2024-09-12T01:01:30.126 INFO:teuthology.orchestra.run.smithi070.stderr: 80300K .......... .......... .......... .......... .......... 86% 135M 0s 2024-09-12T01:01:30.126 INFO:teuthology.orchestra.run.smithi070.stderr: 80350K .......... .......... .......... .......... .......... 86% 274M 0s 2024-09-12T01:01:30.126 INFO:teuthology.orchestra.run.smithi070.stderr: 80400K .......... .......... .......... .......... .......... 86% 347M 0s 2024-09-12T01:01:30.126 INFO:teuthology.orchestra.run.smithi070.stderr: 80450K .......... .......... .......... .......... .......... 86% 320M 0s 2024-09-12T01:01:30.126 INFO:teuthology.orchestra.run.smithi070.stderr: 80500K .......... .......... .......... .......... .......... 86% 296M 0s 2024-09-12T01:01:30.126 INFO:teuthology.orchestra.run.smithi070.stderr: 80550K .......... .......... .......... .......... .......... 86% 321M 0s 2024-09-12T01:01:30.126 INFO:teuthology.orchestra.run.smithi070.stderr: 80600K .......... .......... .......... .......... .......... 86% 357M 0s 2024-09-12T01:01:30.126 INFO:teuthology.orchestra.run.smithi070.stderr: 80650K .......... .......... .......... .......... .......... 86% 374M 0s 2024-09-12T01:01:30.126 INFO:teuthology.orchestra.run.smithi070.stderr: 80700K .......... .......... .......... .......... .......... 86% 217M 0s 2024-09-12T01:01:30.126 INFO:teuthology.orchestra.run.smithi070.stderr: 80750K .......... .......... .......... .......... .......... 86% 329M 0s 2024-09-12T01:01:30.126 INFO:teuthology.orchestra.run.smithi070.stderr: 80800K .......... .......... .......... .......... .......... 87% 329M 0s 2024-09-12T01:01:30.126 INFO:teuthology.orchestra.run.smithi070.stderr: 80850K .......... .......... .......... .......... .......... 87% 339M 0s 2024-09-12T01:01:30.126 INFO:teuthology.orchestra.run.smithi070.stderr: 80900K .......... .......... .......... .......... .......... 87% 312M 0s 2024-09-12T01:01:30.127 INFO:teuthology.orchestra.run.smithi070.stderr: 80950K .......... .......... .......... .......... .......... 87% 337M 0s 2024-09-12T01:01:30.127 INFO:teuthology.orchestra.run.smithi070.stderr: 81000K .......... .......... .......... .......... .......... 87% 328M 0s 2024-09-12T01:01:30.127 INFO:teuthology.orchestra.run.smithi070.stderr: 81050K .......... .......... .......... .......... .......... 87% 252M 0s 2024-09-12T01:01:30.127 INFO:teuthology.orchestra.run.smithi070.stderr: 81100K .......... .......... .......... .......... .......... 87% 175M 0s 2024-09-12T01:01:30.127 INFO:teuthology.orchestra.run.smithi070.stderr: 81150K .......... .......... .......... .......... .......... 87% 327M 0s 2024-09-12T01:01:30.127 INFO:teuthology.orchestra.run.smithi070.stderr: 81200K .......... .......... .......... .......... .......... 87% 361M 0s 2024-09-12T01:01:30.127 INFO:teuthology.orchestra.run.smithi070.stderr: 81250K .......... .......... .......... .......... .......... 87% 272M 0s 2024-09-12T01:01:30.127 INFO:teuthology.orchestra.run.smithi070.stderr: 81300K .......... .......... .......... .......... .......... 87% 286M 0s 2024-09-12T01:01:30.127 INFO:teuthology.orchestra.run.smithi070.stderr: 81350K .......... .......... .......... .......... .......... 87% 362M 0s 2024-09-12T01:01:30.127 INFO:teuthology.orchestra.run.smithi070.stderr: 81400K .......... .......... .......... .......... .......... 87% 329M 0s 2024-09-12T01:01:30.127 INFO:teuthology.orchestra.run.smithi070.stderr: 81450K .......... .......... .......... .......... .......... 87% 369M 0s 2024-09-12T01:01:30.127 INFO:teuthology.orchestra.run.smithi070.stderr: 81500K .......... .......... .......... .......... .......... 87% 258M 0s 2024-09-12T01:01:30.127 INFO:teuthology.orchestra.run.smithi070.stderr: 81550K .......... .......... .......... .......... .......... 87% 195M 0s 2024-09-12T01:01:30.127 INFO:teuthology.orchestra.run.smithi070.stderr: 81600K .......... .......... .......... .......... .......... 87% 240M 0s 2024-09-12T01:01:30.127 INFO:teuthology.orchestra.run.smithi070.stderr: 81650K .......... .......... .......... .......... .......... 87% 198M 0s 2024-09-12T01:01:30.128 INFO:teuthology.orchestra.run.smithi070.stderr: 81700K .......... .......... .......... .......... .......... 87% 159M 0s 2024-09-12T01:01:30.128 INFO:teuthology.orchestra.run.smithi070.stderr: 81750K .......... .......... .......... .......... .......... 88% 324M 0s 2024-09-12T01:01:30.128 INFO:teuthology.orchestra.run.smithi070.stderr: 81800K .......... .......... .......... .......... .......... 88% 345M 0s 2024-09-12T01:01:30.128 INFO:teuthology.orchestra.run.smithi070.stderr: 81850K .......... .......... .......... .......... .......... 88% 163M 0s 2024-09-12T01:01:30.128 INFO:teuthology.orchestra.run.smithi070.stderr: 81900K .......... .......... .......... .......... .......... 88% 115M 0s 2024-09-12T01:01:30.128 INFO:teuthology.orchestra.run.smithi070.stderr: 81950K .......... .......... .......... .......... .......... 88% 251M 0s 2024-09-12T01:01:30.128 INFO:teuthology.orchestra.run.smithi070.stderr: 82000K .......... .......... .......... .......... .......... 88% 259M 0s 2024-09-12T01:01:30.128 INFO:teuthology.orchestra.run.smithi070.stderr: 82050K .......... .......... .......... .......... .......... 88% 329M 0s 2024-09-12T01:01:30.128 INFO:teuthology.orchestra.run.smithi070.stderr: 82100K .......... .......... .......... .......... .......... 88% 337M 0s 2024-09-12T01:01:30.128 INFO:teuthology.orchestra.run.smithi070.stderr: 82150K .......... .......... .......... .......... .......... 88% 193M 0s 2024-09-12T01:01:30.128 INFO:teuthology.orchestra.run.smithi070.stderr: 82200K .......... .......... .......... .......... .......... 88% 309M 0s 2024-09-12T01:01:30.128 INFO:teuthology.orchestra.run.smithi070.stderr: 82250K .......... .......... .......... .......... .......... 88% 351M 0s 2024-09-12T01:01:30.128 INFO:teuthology.orchestra.run.smithi070.stderr: 82300K .......... .......... .......... .......... .......... 88% 280M 0s 2024-09-12T01:01:30.128 INFO:teuthology.orchestra.run.smithi070.stderr: 82350K .......... .......... .......... .......... .......... 88% 341M 0s 2024-09-12T01:01:30.129 INFO:teuthology.orchestra.run.smithi070.stderr: 82400K .......... .......... .......... .......... .......... 88% 335M 0s 2024-09-12T01:01:30.129 INFO:teuthology.orchestra.run.smithi070.stderr: 82450K .......... .......... .......... .......... .......... 88% 294M 0s 2024-09-12T01:01:30.129 INFO:teuthology.orchestra.run.smithi070.stderr: 82500K .......... .......... .......... .......... .......... 88% 322M 0s 2024-09-12T01:01:30.129 INFO:teuthology.orchestra.run.smithi070.stderr: 82550K .......... .......... .......... .......... .......... 88% 152M 0s 2024-09-12T01:01:30.129 INFO:teuthology.orchestra.run.smithi070.stderr: 82600K .......... .......... .......... .......... .......... 88% 338M 0s 2024-09-12T01:01:30.129 INFO:teuthology.orchestra.run.smithi070.stderr: 82650K .......... .......... .......... .......... .......... 89% 330M 0s 2024-09-12T01:01:30.129 INFO:teuthology.orchestra.run.smithi070.stderr: 82700K .......... .......... .......... .......... .......... 89% 259M 0s 2024-09-12T01:01:30.129 INFO:teuthology.orchestra.run.smithi070.stderr: 82750K .......... .......... .......... .......... .......... 89% 354M 0s 2024-09-12T01:01:30.129 INFO:teuthology.orchestra.run.smithi070.stderr: 82800K .......... .......... .......... .......... .......... 89% 355M 0s 2024-09-12T01:01:30.129 INFO:teuthology.orchestra.run.smithi070.stderr: 82850K .......... .......... .......... .......... .......... 89% 97.3M 0s 2024-09-12T01:01:30.129 INFO:teuthology.orchestra.run.smithi070.stderr: 82900K .......... .......... .......... .......... .......... 89% 301M 0s 2024-09-12T01:01:30.129 INFO:teuthology.orchestra.run.smithi070.stderr: 82950K .......... .......... .......... .......... .......... 89% 332M 0s 2024-09-12T01:01:30.129 INFO:teuthology.orchestra.run.smithi070.stderr: 83000K .......... .......... .......... .......... .......... 89% 376M 0s 2024-09-12T01:01:30.129 INFO:teuthology.orchestra.run.smithi070.stderr: 83050K .......... .......... .......... .......... .......... 89% 344M 0s 2024-09-12T01:01:30.130 INFO:teuthology.orchestra.run.smithi070.stderr: 83100K .......... .......... .......... .......... .......... 89% 194M 0s 2024-09-12T01:01:30.130 INFO:teuthology.orchestra.run.smithi070.stderr: 83150K .......... .......... .......... .......... .......... 89% 148M 0s 2024-09-12T01:01:30.130 INFO:teuthology.orchestra.run.smithi070.stderr: 83200K .......... .......... .......... .......... .......... 89% 137M 0s 2024-09-12T01:01:30.130 INFO:teuthology.orchestra.run.smithi070.stderr: 83250K .......... .......... .......... .......... .......... 89% 300M 0s 2024-09-12T01:01:30.130 INFO:teuthology.orchestra.run.smithi070.stderr: 83300K .......... .......... .......... .......... .......... 89% 112M 0s 2024-09-12T01:01:30.130 INFO:teuthology.orchestra.run.smithi070.stderr: 83350K .......... .......... .......... .......... .......... 89% 320M 0s 2024-09-12T01:01:30.130 INFO:teuthology.orchestra.run.smithi070.stderr: 83400K .......... .......... .......... .......... .......... 89% 264M 0s 2024-09-12T01:01:30.130 INFO:teuthology.orchestra.run.smithi070.stderr: 83450K .......... .......... .......... .......... .......... 89% 320M 0s 2024-09-12T01:01:30.130 INFO:teuthology.orchestra.run.smithi070.stderr: 83500K .......... .......... .......... .......... .......... 89% 274M 0s 2024-09-12T01:01:30.130 INFO:teuthology.orchestra.run.smithi070.stderr: 83550K .......... .......... .......... .......... .......... 89% 362M 0s 2024-09-12T01:01:30.130 INFO:teuthology.orchestra.run.smithi070.stderr: 83600K .......... .......... .......... .......... .......... 90% 169M 0s 2024-09-12T01:01:30.130 INFO:teuthology.orchestra.run.smithi070.stderr: 83650K .......... .......... .......... .......... .......... 90% 336M 0s 2024-09-12T01:01:30.130 INFO:teuthology.orchestra.run.smithi070.stderr: 83700K .......... .......... .......... .......... .......... 90% 295M 0s 2024-09-12T01:01:30.130 INFO:teuthology.orchestra.run.smithi070.stderr: 83750K .......... .......... .......... .......... .......... 90% 355M 0s 2024-09-12T01:01:30.131 INFO:teuthology.orchestra.run.smithi070.stderr: 83800K .......... .......... .......... .......... .......... 90% 326M 0s 2024-09-12T01:01:30.131 INFO:teuthology.orchestra.run.smithi070.stderr: 83850K .......... .......... .......... .......... .......... 90% 348M 0s 2024-09-12T01:01:30.131 INFO:teuthology.orchestra.run.smithi070.stderr: 83900K .......... .......... .......... .......... .......... 90% 280M 0s 2024-09-12T01:01:30.131 INFO:teuthology.orchestra.run.smithi070.stderr: 83950K .......... .......... .......... .......... .......... 90% 352M 0s 2024-09-12T01:01:30.131 INFO:teuthology.orchestra.run.smithi070.stderr: 84000K .......... .......... .......... .......... .......... 90% 351M 0s 2024-09-12T01:01:30.131 INFO:teuthology.orchestra.run.smithi070.stderr: 84050K .......... .......... .......... .......... .......... 90% 312M 0s 2024-09-12T01:01:30.131 INFO:teuthology.orchestra.run.smithi070.stderr: 84100K .......... .......... .......... .......... .......... 90% 276M 0s 2024-09-12T01:01:30.131 INFO:teuthology.orchestra.run.smithi070.stderr: 84150K .......... .......... .......... .......... .......... 90% 207M 0s 2024-09-12T01:01:30.131 INFO:teuthology.orchestra.run.smithi070.stderr: 84200K .......... .......... .......... .......... .......... 90% 216M 0s 2024-09-12T01:01:30.131 INFO:teuthology.orchestra.run.smithi070.stderr: 84250K .......... .......... .......... .......... .......... 90% 338M 0s 2024-09-12T01:01:30.131 INFO:teuthology.orchestra.run.smithi070.stderr: 84300K .......... .......... .......... .......... .......... 90% 303M 0s 2024-09-12T01:01:30.131 INFO:teuthology.orchestra.run.smithi070.stderr: 84350K .......... .......... .......... .......... .......... 90% 280M 0s 2024-09-12T01:01:30.131 INFO:teuthology.orchestra.run.smithi070.stderr: 84400K .......... .......... .......... .......... .......... 90% 363M 0s 2024-09-12T01:01:30.131 INFO:teuthology.orchestra.run.smithi070.stderr: 84450K .......... .......... .......... .......... .......... 90% 362M 0s 2024-09-12T01:01:30.131 INFO:teuthology.orchestra.run.smithi070.stderr: 84500K .......... .......... .......... .......... .......... 91% 280M 0s 2024-09-12T01:01:30.132 INFO:teuthology.orchestra.run.smithi070.stderr: 84550K .......... .......... .......... .......... .......... 91% 331M 0s 2024-09-12T01:01:30.132 INFO:teuthology.orchestra.run.smithi070.stderr: 84600K .......... .......... .......... .......... .......... 91% 358M 0s 2024-09-12T01:01:30.132 INFO:teuthology.orchestra.run.smithi070.stderr: 84650K .......... .......... .......... .......... .......... 91% 131M 0s 2024-09-12T01:01:30.132 INFO:teuthology.orchestra.run.smithi070.stderr: 84700K .......... .......... .......... .......... .......... 91% 135M 0s 2024-09-12T01:01:30.132 INFO:teuthology.orchestra.run.smithi070.stderr: 84750K .......... .......... .......... .......... .......... 91% 215M 0s 2024-09-12T01:01:30.132 INFO:teuthology.orchestra.run.smithi070.stderr: 84800K .......... .......... .......... .......... .......... 91% 289M 0s 2024-09-12T01:01:30.132 INFO:teuthology.orchestra.run.smithi070.stderr: 84850K .......... .......... .......... .......... .......... 91% 316M 0s 2024-09-12T01:01:30.132 INFO:teuthology.orchestra.run.smithi070.stderr: 84900K .......... .......... .......... .......... .......... 91% 194M 0s 2024-09-12T01:01:30.132 INFO:teuthology.orchestra.run.smithi070.stderr: 84950K .......... .......... .......... .......... .......... 91% 236M 0s 2024-09-12T01:01:30.132 INFO:teuthology.orchestra.run.smithi070.stderr: 85000K .......... .......... .......... .......... .......... 91% 179M 0s 2024-09-12T01:01:30.132 INFO:teuthology.orchestra.run.smithi070.stderr: 85050K .......... .......... .......... .......... .......... 91% 307M 0s 2024-09-12T01:01:30.132 INFO:teuthology.orchestra.run.smithi070.stderr: 85100K .......... .......... .......... .......... .......... 91% 121M 0s 2024-09-12T01:01:30.132 INFO:teuthology.orchestra.run.smithi070.stderr: 85150K .......... .......... .......... .......... .......... 91% 194M 0s 2024-09-12T01:01:30.132 INFO:teuthology.orchestra.run.smithi070.stderr: 85200K .......... .......... .......... .......... .......... 91% 301M 0s 2024-09-12T01:01:30.133 INFO:teuthology.orchestra.run.smithi070.stderr: 85250K .......... .......... .......... .......... .......... 91% 199M 0s 2024-09-12T01:01:30.133 INFO:teuthology.orchestra.run.smithi070.stderr: 85300K .......... .......... .......... .......... .......... 91% 250M 0s 2024-09-12T01:01:30.133 INFO:teuthology.orchestra.run.smithi070.stderr: 85350K .......... .......... .......... .......... .......... 91% 240M 0s 2024-09-12T01:01:30.133 INFO:teuthology.orchestra.run.smithi070.stderr: 85400K .......... .......... .......... .......... .......... 91% 250M 0s 2024-09-12T01:01:30.133 INFO:teuthology.orchestra.run.smithi070.stderr: 85450K .......... .......... .......... .......... .......... 92% 239M 0s 2024-09-12T01:01:30.133 INFO:teuthology.orchestra.run.smithi070.stderr: 85500K .......... .......... .......... .......... .......... 92% 168M 0s 2024-09-12T01:01:30.133 INFO:teuthology.orchestra.run.smithi070.stderr: 85550K .......... .......... .......... .......... .......... 92% 316M 0s 2024-09-12T01:01:30.133 INFO:teuthology.orchestra.run.smithi070.stderr: 85600K .......... .......... .......... .......... .......... 92% 314M 0s 2024-09-12T01:01:30.133 INFO:teuthology.orchestra.run.smithi070.stderr: 85650K .......... .......... .......... .......... .......... 92% 312M 0s 2024-09-12T01:01:30.133 INFO:teuthology.orchestra.run.smithi070.stderr: 85700K .......... .......... .......... .......... .......... 92% 294M 0s 2024-09-12T01:01:30.133 INFO:teuthology.orchestra.run.smithi070.stderr: 85750K .......... .......... .......... .......... .......... 92% 232M 0s 2024-09-12T01:01:30.133 INFO:teuthology.orchestra.run.smithi070.stderr: 85800K .......... .......... .......... .......... .......... 92% 187M 0s 2024-09-12T01:01:30.133 INFO:teuthology.orchestra.run.smithi070.stderr: 85850K .......... .......... .......... .......... .......... 92% 220M 0s 2024-09-12T01:01:30.133 INFO:teuthology.orchestra.run.smithi070.stderr: 85900K .......... .......... .......... .......... .......... 92% 183M 0s 2024-09-12T01:01:30.134 INFO:teuthology.orchestra.run.smithi070.stderr: 85950K .......... .......... .......... .......... .......... 92% 308M 0s 2024-09-12T01:01:30.134 INFO:teuthology.orchestra.run.smithi070.stderr: 86000K .......... .......... .......... .......... .......... 92% 236M 0s 2024-09-12T01:01:30.134 INFO:teuthology.orchestra.run.smithi070.stderr: 86050K .......... .......... .......... .......... .......... 92% 282M 0s 2024-09-12T01:01:30.134 INFO:teuthology.orchestra.run.smithi070.stderr: 86100K .......... .......... .......... .......... .......... 92% 186M 0s 2024-09-12T01:01:30.134 INFO:teuthology.orchestra.run.smithi070.stderr: 86150K .......... .......... .......... .......... .......... 92% 314M 0s 2024-09-12T01:01:30.134 INFO:teuthology.orchestra.run.smithi070.stderr: 86200K .......... .......... .......... .......... .......... 92% 352M 0s 2024-09-12T01:01:30.134 INFO:teuthology.orchestra.run.smithi070.stderr: 86250K .......... .......... .......... .......... .......... 92% 262M 0s 2024-09-12T01:01:30.134 INFO:teuthology.orchestra.run.smithi070.stderr: 86300K .......... .......... .......... .......... .......... 92% 219M 0s 2024-09-12T01:01:30.134 INFO:teuthology.orchestra.run.smithi070.stderr: 86350K .......... .......... .......... .......... .......... 93% 240M 0s 2024-09-12T01:01:30.134 INFO:teuthology.orchestra.run.smithi070.stderr: 86400K .......... .......... .......... .......... .......... 93% 243M 0s 2024-09-12T01:01:30.134 INFO:teuthology.orchestra.run.smithi070.stderr: 86450K .......... .......... .......... .......... .......... 93% 199M 0s 2024-09-12T01:01:30.134 INFO:teuthology.orchestra.run.smithi070.stderr: 86500K .......... .......... .......... .......... .......... 93% 206M 0s 2024-09-12T01:01:30.134 INFO:teuthology.orchestra.run.smithi070.stderr: 86550K .......... .......... .......... .......... .......... 93% 256M 0s 2024-09-12T01:01:30.134 INFO:teuthology.orchestra.run.smithi070.stderr: 86600K .......... .......... .......... .......... .......... 93% 304M 0s 2024-09-12T01:01:30.135 INFO:teuthology.orchestra.run.smithi070.stderr: 86650K .......... .......... .......... .......... .......... 93% 219M 0s 2024-09-12T01:01:30.135 INFO:teuthology.orchestra.run.smithi070.stderr: 86700K .......... .......... .......... .......... .......... 93% 185M 0s 2024-09-12T01:01:30.135 INFO:teuthology.orchestra.run.smithi070.stderr: 86750K .......... .......... .......... .......... .......... 93% 303M 0s 2024-09-12T01:01:30.135 INFO:teuthology.orchestra.run.smithi070.stderr: 86800K .......... .......... .......... .......... .......... 93% 228M 0s 2024-09-12T01:01:30.135 INFO:teuthology.orchestra.run.smithi070.stderr: 86850K .......... .......... .......... .......... .......... 93% 299M 0s 2024-09-12T01:01:30.135 INFO:teuthology.orchestra.run.smithi070.stderr: 86900K .......... .......... .......... .......... .......... 93% 239M 0s 2024-09-12T01:01:30.135 INFO:teuthology.orchestra.run.smithi070.stderr: 86950K .......... .......... .......... .......... .......... 93% 284M 0s 2024-09-12T01:01:30.135 INFO:teuthology.orchestra.run.smithi070.stderr: 87000K .......... .......... .......... .......... .......... 93% 270M 0s 2024-09-12T01:01:30.135 INFO:teuthology.orchestra.run.smithi070.stderr: 87050K .......... .......... .......... .......... .......... 93% 254M 0s 2024-09-12T01:01:30.135 INFO:teuthology.orchestra.run.smithi070.stderr: 87100K .......... .......... .......... .......... .......... 93% 239M 0s 2024-09-12T01:01:30.135 INFO:teuthology.orchestra.run.smithi070.stderr: 87150K .......... .......... .......... .......... .......... 93% 259M 0s 2024-09-12T01:01:30.135 INFO:teuthology.orchestra.run.smithi070.stderr: 87200K .......... .......... .......... .......... .......... 93% 257M 0s 2024-09-12T01:01:30.135 INFO:teuthology.orchestra.run.smithi070.stderr: 87250K .......... .......... .......... .......... .......... 93% 204M 0s 2024-09-12T01:01:30.135 INFO:teuthology.orchestra.run.smithi070.stderr: 87300K .......... .......... .......... .......... .......... 94% 234M 0s 2024-09-12T01:01:30.136 INFO:teuthology.orchestra.run.smithi070.stderr: 87350K .......... .......... .......... .......... .......... 94% 223M 0s 2024-09-12T01:01:30.136 INFO:teuthology.orchestra.run.smithi070.stderr: 87400K .......... .......... .......... .......... .......... 94% 288M 0s 2024-09-12T01:01:30.136 INFO:teuthology.orchestra.run.smithi070.stderr: 87450K .......... .......... .......... .......... .......... 94% 322M 0s 2024-09-12T01:01:30.136 INFO:teuthology.orchestra.run.smithi070.stderr: 87500K .......... .......... .......... .......... .......... 94% 221M 0s 2024-09-12T01:01:30.136 INFO:teuthology.orchestra.run.smithi070.stderr: 87550K .......... .......... .......... .......... .......... 94% 301M 0s 2024-09-12T01:01:30.136 INFO:teuthology.orchestra.run.smithi070.stderr: 87600K .......... .......... .......... .......... .......... 94% 252M 0s 2024-09-12T01:01:30.136 INFO:teuthology.orchestra.run.smithi070.stderr: 87650K .......... .......... .......... .......... .......... 94% 307M 0s 2024-09-12T01:01:30.136 INFO:teuthology.orchestra.run.smithi070.stderr: 87700K .......... .......... .......... .......... .......... 94% 230M 0s 2024-09-12T01:01:30.136 INFO:teuthology.orchestra.run.smithi070.stderr: 87750K .......... .......... .......... .......... .......... 94% 285M 0s 2024-09-12T01:01:30.136 INFO:teuthology.orchestra.run.smithi070.stderr: 87800K .......... .......... .......... .......... .......... 94% 283M 0s 2024-09-12T01:01:30.136 INFO:teuthology.orchestra.run.smithi070.stderr: 87850K .......... .......... .......... .......... .......... 94% 308M 0s 2024-09-12T01:01:30.136 INFO:teuthology.orchestra.run.smithi070.stderr: 87900K .......... .......... .......... .......... .......... 94% 232M 0s 2024-09-12T01:01:30.136 INFO:teuthology.orchestra.run.smithi070.stderr: 87950K .......... .......... .......... .......... .......... 94% 315M 0s 2024-09-12T01:01:30.136 INFO:teuthology.orchestra.run.smithi070.stderr: 88000K .......... .......... .......... .......... .......... 94% 275M 0s 2024-09-12T01:01:30.136 INFO:teuthology.orchestra.run.smithi070.stderr: 88050K .......... .......... .......... .......... .......... 94% 264M 0s 2024-09-12T01:01:30.137 INFO:teuthology.orchestra.run.smithi070.stderr: 88100K .......... .......... .......... .......... .......... 94% 232M 0s 2024-09-12T01:01:30.137 INFO:teuthology.orchestra.run.smithi070.stderr: 88150K .......... .......... .......... .......... .......... 94% 333M 0s 2024-09-12T01:01:30.137 INFO:teuthology.orchestra.run.smithi070.stderr: 88200K .......... .......... .......... .......... .......... 94% 320M 0s 2024-09-12T01:01:30.137 INFO:teuthology.orchestra.run.smithi070.stderr: 88250K .......... .......... .......... .......... .......... 95% 269M 0s 2024-09-12T01:01:30.137 INFO:teuthology.orchestra.run.smithi070.stderr: 88300K .......... .......... .......... .......... .......... 95% 183M 0s 2024-09-12T01:01:30.137 INFO:teuthology.orchestra.run.smithi070.stderr: 88350K .......... .......... .......... .......... .......... 95% 285M 0s 2024-09-12T01:01:30.137 INFO:teuthology.orchestra.run.smithi070.stderr: 88400K .......... .......... .......... .......... .......... 95% 251M 0s 2024-09-12T01:01:30.137 INFO:teuthology.orchestra.run.smithi070.stderr: 88450K .......... .......... .......... .......... .......... 95% 224M 0s 2024-09-12T01:01:30.137 INFO:teuthology.orchestra.run.smithi070.stderr: 88500K .......... .......... .......... .......... .......... 95% 284M 0s 2024-09-12T01:01:30.137 INFO:teuthology.orchestra.run.smithi070.stderr: 88550K .......... .......... .......... .......... .......... 95% 352M 0s 2024-09-12T01:01:30.137 INFO:teuthology.orchestra.run.smithi070.stderr: 88600K .......... .......... .......... .......... .......... 95% 70.4M 0s 2024-09-12T01:01:30.137 INFO:teuthology.orchestra.run.smithi070.stderr: 88650K .......... .......... .......... .......... .......... 95% 237M 0s 2024-09-12T01:01:30.137 INFO:teuthology.orchestra.run.smithi070.stderr: 88700K .......... .......... .......... .......... .......... 95% 188M 0s 2024-09-12T01:01:30.137 INFO:teuthology.orchestra.run.smithi070.stderr: 88750K .......... .......... .......... .......... .......... 95% 257M 0s 2024-09-12T01:01:30.138 INFO:teuthology.orchestra.run.smithi070.stderr: 88800K .......... .......... .......... .......... .......... 95% 233M 0s 2024-09-12T01:01:30.138 INFO:teuthology.orchestra.run.smithi070.stderr: 88850K .......... .......... .......... .......... .......... 95% 290M 0s 2024-09-12T01:01:30.138 INFO:teuthology.orchestra.run.smithi070.stderr: 88900K .......... .......... .......... .......... .......... 95% 309M 0s 2024-09-12T01:01:30.138 INFO:teuthology.orchestra.run.smithi070.stderr: 88950K .......... .......... .......... .......... .......... 95% 318M 0s 2024-09-12T01:01:30.138 INFO:teuthology.orchestra.run.smithi070.stderr: 89000K .......... .......... .......... .......... .......... 95% 244M 0s 2024-09-12T01:01:30.138 INFO:teuthology.orchestra.run.smithi070.stderr: 89050K .......... .......... .......... .......... .......... 95% 261M 0s 2024-09-12T01:01:30.138 INFO:teuthology.orchestra.run.smithi070.stderr: 89100K .......... .......... .......... .......... .......... 95% 228M 0s 2024-09-12T01:01:30.138 INFO:teuthology.orchestra.run.smithi070.stderr: 89150K .......... .......... .......... .......... .......... 96% 263M 0s 2024-09-12T01:01:30.138 INFO:teuthology.orchestra.run.smithi070.stderr: 89200K .......... .......... .......... .......... .......... 96% 289M 0s 2024-09-12T01:01:30.138 INFO:teuthology.orchestra.run.smithi070.stderr: 89250K .......... .......... .......... .......... .......... 96% 255M 0s 2024-09-12T01:01:30.138 INFO:teuthology.orchestra.run.smithi070.stderr: 89300K .......... .......... .......... .......... .......... 96% 227M 0s 2024-09-12T01:01:30.138 INFO:teuthology.orchestra.run.smithi070.stderr: 89350K .......... .......... .......... .......... .......... 96% 228M 0s 2024-09-12T01:01:30.138 INFO:teuthology.orchestra.run.smithi070.stderr: 89400K .......... .......... .......... .......... .......... 96% 217M 0s 2024-09-12T01:01:30.138 INFO:teuthology.orchestra.run.smithi070.stderr: 89450K .......... .......... .......... .......... .......... 96% 244M 0s 2024-09-12T01:01:30.138 INFO:teuthology.orchestra.run.smithi070.stderr: 89500K .......... .......... .......... .......... .......... 96% 292M 0s 2024-09-12T01:01:30.139 INFO:teuthology.orchestra.run.smithi070.stderr: 89550K .......... .......... .......... .......... .......... 96% 283M 0s 2024-09-12T01:01:30.139 INFO:teuthology.orchestra.run.smithi070.stderr: 89600K .......... .......... .......... .......... .......... 96% 221M 0s 2024-09-12T01:01:30.139 INFO:teuthology.orchestra.run.smithi070.stderr: 89650K .......... .......... .......... .......... .......... 96% 283M 0s 2024-09-12T01:01:30.139 INFO:teuthology.orchestra.run.smithi070.stderr: 89700K .......... .......... .......... .......... .......... 96% 241M 0s 2024-09-12T01:01:30.139 INFO:teuthology.orchestra.run.smithi070.stderr: 89750K .......... .......... .......... .......... .......... 96% 259M 0s 2024-09-12T01:01:30.139 INFO:teuthology.orchestra.run.smithi070.stderr: 89800K .......... .......... .......... .......... .......... 96% 242M 0s 2024-09-12T01:01:30.139 INFO:teuthology.orchestra.run.smithi070.stderr: 89850K .......... .......... .......... .......... .......... 96% 210M 0s 2024-09-12T01:01:30.139 INFO:teuthology.orchestra.run.smithi070.stderr: 89900K .......... .......... .......... .......... .......... 96% 258M 0s 2024-09-12T01:01:30.139 INFO:teuthology.orchestra.run.smithi070.stderr: 89950K .......... .......... .......... .......... .......... 96% 230M 0s 2024-09-12T01:01:30.139 INFO:teuthology.orchestra.run.smithi070.stderr: 90000K .......... .......... .......... .......... .......... 96% 244M 0s 2024-09-12T01:01:30.139 INFO:teuthology.orchestra.run.smithi070.stderr: 90050K .......... .......... .......... .......... .......... 96% 229M 0s 2024-09-12T01:01:30.139 INFO:teuthology.orchestra.run.smithi070.stderr: 90100K .......... .......... .......... .......... .......... 97% 255M 0s 2024-09-12T01:01:30.139 INFO:teuthology.orchestra.run.smithi070.stderr: 90150K .......... .......... .......... .......... .......... 97% 286M 0s 2024-09-12T01:01:30.140 INFO:teuthology.orchestra.run.smithi070.stderr: 90200K .......... .......... .......... .......... .......... 97% 241M 0s 2024-09-12T01:01:30.140 INFO:teuthology.orchestra.run.smithi070.stderr: 90250K .......... .......... .......... .......... .......... 97% 353M 0s 2024-09-12T01:01:30.140 INFO:teuthology.orchestra.run.smithi070.stderr: 90300K .......... .......... .......... .......... .......... 97% 227M 0s 2024-09-12T01:01:30.140 INFO:teuthology.orchestra.run.smithi070.stderr: 90350K .......... .......... .......... .......... .......... 97% 309M 0s 2024-09-12T01:01:30.140 INFO:teuthology.orchestra.run.smithi070.stderr: 90400K .......... .......... .......... .......... .......... 97% 249M 0s 2024-09-12T01:01:30.140 INFO:teuthology.orchestra.run.smithi070.stderr: 90450K .......... .......... .......... .......... .......... 97% 212M 0s 2024-09-12T01:01:30.140 INFO:teuthology.orchestra.run.smithi070.stderr: 90500K .......... .......... .......... .......... .......... 97% 313M 0s 2024-09-12T01:01:30.140 INFO:teuthology.orchestra.run.smithi070.stderr: 90550K .......... .......... .......... .......... .......... 97% 357M 0s 2024-09-12T01:01:30.140 INFO:teuthology.orchestra.run.smithi070.stderr: 90600K .......... .......... .......... .......... .......... 97% 22.6M 0s 2024-09-12T01:01:30.140 INFO:teuthology.orchestra.run.smithi070.stderr: 90650K .......... .......... .......... .......... .......... 97% 245M 0s 2024-09-12T01:01:30.140 INFO:teuthology.orchestra.run.smithi070.stderr: 90700K .......... .......... .......... .......... .......... 97% 247M 0s 2024-09-12T01:01:30.140 INFO:teuthology.orchestra.run.smithi070.stderr: 90750K .......... .......... .......... .......... .......... 97% 232M 0s 2024-09-12T01:01:30.140 INFO:teuthology.orchestra.run.smithi070.stderr: 90800K .......... .......... .......... .......... .......... 97% 253M 0s 2024-09-12T01:01:30.140 INFO:teuthology.orchestra.run.smithi070.stderr: 90850K .......... .......... .......... .......... .......... 97% 138M 0s 2024-09-12T01:01:30.141 INFO:teuthology.orchestra.run.smithi070.stderr: 90900K .......... .......... .......... .......... .......... 97% 211M 0s 2024-09-12T01:01:30.141 INFO:teuthology.orchestra.run.smithi070.stderr: 90950K .......... .......... .......... .......... .......... 97% 320M 0s 2024-09-12T01:01:30.141 INFO:teuthology.orchestra.run.smithi070.stderr: 91000K .......... .......... .......... .......... .......... 98% 179M 0s 2024-09-12T01:01:30.141 INFO:teuthology.orchestra.run.smithi070.stderr: 91050K .......... .......... .......... .......... .......... 98% 247M 0s 2024-09-12T01:01:30.141 INFO:teuthology.orchestra.run.smithi070.stderr: 91100K .......... .......... .......... .......... .......... 98% 205M 0s 2024-09-12T01:01:30.141 INFO:teuthology.orchestra.run.smithi070.stderr: 91150K .......... .......... .......... .......... .......... 98% 353M 0s 2024-09-12T01:01:30.141 INFO:teuthology.orchestra.run.smithi070.stderr: 91200K .......... .......... .......... .......... .......... 98% 255M 0s 2024-09-12T01:01:30.141 INFO:teuthology.orchestra.run.smithi070.stderr: 91250K .......... .......... .......... .......... .......... 98% 231M 0s 2024-09-12T01:01:30.141 INFO:teuthology.orchestra.run.smithi070.stderr: 91300K .......... .......... .......... .......... .......... 98% 186M 0s 2024-09-12T01:01:30.141 INFO:teuthology.orchestra.run.smithi070.stderr: 91350K .......... .......... .......... .......... .......... 98% 223M 0s 2024-09-12T01:01:30.141 INFO:teuthology.orchestra.run.smithi070.stderr: 91400K .......... .......... .......... .......... .......... 98% 300M 0s 2024-09-12T01:01:30.141 INFO:teuthology.orchestra.run.smithi070.stderr: 91450K .......... .......... .......... .......... .......... 98% 257M 0s 2024-09-12T01:01:30.141 INFO:teuthology.orchestra.run.smithi070.stderr: 91500K .......... .......... .......... .......... .......... 98% 228M 0s 2024-09-12T01:01:30.141 INFO:teuthology.orchestra.run.smithi070.stderr: 91550K .......... .......... .......... .......... .......... 98% 252M 0s 2024-09-12T01:01:30.142 INFO:teuthology.orchestra.run.smithi070.stderr: 91600K .......... .......... .......... .......... .......... 98% 266M 0s 2024-09-12T01:01:30.142 INFO:teuthology.orchestra.run.smithi070.stderr: 91650K .......... .......... .......... .......... .......... 98% 261M 0s 2024-09-12T01:01:30.142 INFO:teuthology.orchestra.run.smithi070.stderr: 91700K .......... .......... .......... .......... .......... 98% 316M 0s 2024-09-12T01:01:30.142 INFO:teuthology.orchestra.run.smithi070.stderr: 91750K .......... .......... .......... .......... .......... 98% 358M 0s 2024-09-12T01:01:30.142 INFO:teuthology.orchestra.run.smithi070.stderr: 91800K .......... .......... .......... .......... .......... 98% 221M 0s 2024-09-12T01:01:30.142 INFO:teuthology.orchestra.run.smithi070.stderr: 91850K .......... .......... .......... .......... .......... 98% 308M 0s 2024-09-12T01:01:30.142 INFO:teuthology.orchestra.run.smithi070.stderr: 91900K .......... .......... .......... .......... .......... 98% 287M 0s 2024-09-12T01:01:30.142 INFO:teuthology.orchestra.run.smithi070.stderr: 91950K .......... .......... .......... .......... .......... 99% 339M 0s 2024-09-12T01:01:30.142 INFO:teuthology.orchestra.run.smithi070.stderr: 92000K .......... .......... .......... .......... .......... 99% 313M 0s 2024-09-12T01:01:30.142 INFO:teuthology.orchestra.run.smithi070.stderr: 92050K .......... .......... .......... .......... .......... 99% 386M 0s 2024-09-12T01:01:30.142 INFO:teuthology.orchestra.run.smithi070.stderr: 92100K .......... .......... .......... .......... .......... 99% 368M 0s 2024-09-12T01:01:30.142 INFO:teuthology.orchestra.run.smithi070.stderr: 92150K .......... .......... .......... .......... .......... 99% 15.4M 0s 2024-09-12T01:01:30.142 INFO:teuthology.orchestra.run.smithi070.stderr: 92200K .......... .......... .......... .......... .......... 99% 177M 0s 2024-09-12T01:01:30.142 INFO:teuthology.orchestra.run.smithi070.stderr: 92250K .......... .......... .......... .......... .......... 99% 105M 0s 2024-09-12T01:01:30.143 INFO:teuthology.orchestra.run.smithi070.stderr: 92300K .......... .......... .......... .......... .......... 99% 251M 0s 2024-09-12T01:01:30.143 INFO:teuthology.orchestra.run.smithi070.stderr: 92350K .......... .......... .......... .......... .......... 99% 265M 0s 2024-09-12T01:01:30.143 INFO:teuthology.orchestra.run.smithi070.stderr: 92400K .......... .......... .......... .......... .......... 99% 80.9M 0s 2024-09-12T01:01:30.143 INFO:teuthology.orchestra.run.smithi070.stderr: 92450K .......... .......... .......... .......... .......... 99% 138M 0s 2024-09-12T01:01:30.143 INFO:teuthology.orchestra.run.smithi070.stderr: 92500K .......... .......... .......... .......... .......... 99% 58.5M 0s 2024-09-12T01:01:30.143 INFO:teuthology.orchestra.run.smithi070.stderr: 92550K .......... .......... .......... .......... .......... 99% 262M 0s 2024-09-12T01:01:30.143 INFO:teuthology.orchestra.run.smithi070.stderr: 92600K .......... .......... .......... .......... .......... 99% 208M 0s 2024-09-12T01:01:30.143 INFO:teuthology.orchestra.run.smithi070.stderr: 92650K .......... .......... .......... .......... .......... 99% 106M 0s 2024-09-12T01:01:30.143 INFO:teuthology.orchestra.run.smithi070.stderr: 92700K .......... .......... .......... .......... .......... 99% 63.5M 0s 2024-09-12T01:01:30.143 INFO:teuthology.orchestra.run.smithi070.stderr: 92750K .......... .......... .......... .......... .......... 99% 202M 0s 2024-09-12T01:01:30.143 INFO:teuthology.orchestra.run.smithi070.stderr: 92800K .......... .......... .......... .......... .......... 99% 349M 0s 2024-09-12T01:01:30.143 INFO:teuthology.orchestra.run.smithi070.stderr: 92850K .......... .......... .......... .......... .......... 99% 351M 0s 2024-09-12T01:01:30.143 INFO:teuthology.orchestra.run.smithi070.stderr: 92900K 100% 134G=0.5s 2024-09-12T01:01:30.143 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-12T01:01:30.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12 01:01:29 (182 MB/s) - 'gradle-6.0.1-bin.zip' saved [95129672/95129672] 2024-09-12T01:01:30.144 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-12T01:01:30.170 INFO:teuthology.orchestra.run.smithi070.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-12T01:01:30.170 INFO:teuthology.orchestra.run.smithi070.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-12T01:01:30.170 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-12T01:01:30.170 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-12T01:01:30.170 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-12T01:01:30.170 INFO:teuthology.orchestra.run.smithi070.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-12T01:01:30.170 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-12T01:01:30.171 INFO:teuthology.orchestra.run.smithi070.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-12T01:01:30.171 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-12T01:01:30.171 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-12T01:01:30.171 INFO:teuthology.orchestra.run.smithi070.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-12T01:01:30.171 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-12T01:01:30.171 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-12T01:01:30.171 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-12T01:01:30.171 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-12T01:01:30.171 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-12T01:01:30.171 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-12T01:01:30.171 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-12T01:01:30.171 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-12T01:01:30.171 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-12T01:01:30.172 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-12T01:01:30.172 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-12T01:01:30.172 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-12T01:01:30.172 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-12T01:01:30.172 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-12T01:01:30.172 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-12T01:01:30.172 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-12T01:01:30.172 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-12T01:01:30.172 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-12T01:01:30.172 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-12T01:01:30.172 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-12T01:01:30.172 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-12T01:01:30.172 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-12T01:01:30.173 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-12T01:01:30.173 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-12T01:01:30.173 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-12T01:01:30.173 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-12T01:01:30.173 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-12T01:01:30.173 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-12T01:01:30.173 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-12T01:01:30.173 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-12T01:01:30.173 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-12T01:01:30.173 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-12T01:01:30.173 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-12T01:01:30.173 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-12T01:01:30.173 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-12T01:01:30.173 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-12T01:01:30.174 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-12T01:01:30.174 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-12T01:01:30.174 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-12T01:01:30.174 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-12T01:01:30.174 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-12T01:01:30.174 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-12T01:01:30.174 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-12T01:01:30.174 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-12T01:01:30.174 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-12T01:01:30.174 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-12T01:01:30.174 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-12T01:01:30.174 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-12T01:01:30.174 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-12T01:01:30.175 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-12T01:01:30.175 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-12T01:01:30.175 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-12T01:01:30.175 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-12T01:01:30.175 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-12T01:01:30.175 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-12T01:01:30.175 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-12T01:01:30.175 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-12T01:01:30.175 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-12T01:01:30.175 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-12T01:01:30.175 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-12T01:01:30.175 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-12T01:01:30.175 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-12T01:01:30.176 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-12T01:01:30.176 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-12T01:01:30.176 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-12T01:01:30.176 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-12T01:01:30.176 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-12T01:01:30.176 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-12T01:01:30.176 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-12T01:01:30.176 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-12T01:01:30.176 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-12T01:01:30.176 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-12T01:01:30.176 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-12T01:01:30.176 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-12T01:01:30.176 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-12T01:01:30.177 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-12T01:01:30.177 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-12T01:01:30.177 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-12T01:01:30.177 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-12T01:01:30.177 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-12T01:01:30.177 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-12T01:01:30.177 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-12T01:01:30.177 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-12T01:01:30.177 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-12T01:01:30.177 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-12T01:01:30.177 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-12T01:01:30.177 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-12T01:01:30.177 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-12T01:01:30.177 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-12T01:01:30.178 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-12T01:01:30.178 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-12T01:01:30.178 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-12T01:01:30.178 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-12T01:01:30.178 INFO:teuthology.orchestra.run.smithi070.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-12T01:01:30.178 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-12T01:01:30.178 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-12T01:01:30.178 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-12T01:01:30.178 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-12T01:01:30.178 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-12T01:01:30.178 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-12T01:01:30.178 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-12T01:01:30.178 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-12T01:01:30.179 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-12T01:01:30.179 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-12T01:01:30.179 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-12T01:01:30.179 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-12T01:01:30.179 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-12T01:01:30.179 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-12T01:01:30.179 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-12T01:01:30.179 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-12T01:01:30.179 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-12T01:01:30.179 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-12T01:01:30.179 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-12T01:01:30.179 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-12T01:01:30.179 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-12T01:01:30.179 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-12T01:01:30.180 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-12T01:01:30.180 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-12T01:01:30.180 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-12T01:01:30.180 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-12T01:01:30.180 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-12T01:01:30.180 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-12T01:01:30.180 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-12T01:01:30.180 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-12T01:01:30.180 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-12T01:01:30.180 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-12T01:01:30.180 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-12T01:01:30.180 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-12T01:01:30.180 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-12T01:01:30.181 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-12T01:01:30.181 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-12T01:01:30.181 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-12T01:01:30.181 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-12T01:01:30.181 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-12T01:01:30.181 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-12T01:01:30.181 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-12T01:01:30.181 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-12T01:01:30.181 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-12T01:01:30.181 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-12T01:01:30.181 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-12T01:01:30.181 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-12T01:01:30.181 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-12T01:01:30.181 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-12T01:01:30.182 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-12T01:01:30.182 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-12T01:01:30.182 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-12T01:01:30.182 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-12T01:01:30.182 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-12T01:01:30.182 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-12T01:01:30.182 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-12T01:01:30.182 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-12T01:01:30.182 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-12T01:01:30.182 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-12T01:01:30.182 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-12T01:01:30.182 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-12T01:01:30.182 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-12T01:01:30.183 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-12T01:01:30.183 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-12T01:01:30.183 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-12T01:01:30.183 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-12T01:01:30.183 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-12T01:01:30.183 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-12T01:01:30.183 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-12T01:01:30.183 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-12T01:01:30.183 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-12T01:01:30.183 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-12T01:01:30.183 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-12T01:01:30.183 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-12T01:01:30.183 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-12T01:01:30.183 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-12T01:01:30.184 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-12T01:01:30.184 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-12T01:01:30.184 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-12T01:01:30.184 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-12T01:01:30.184 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-12T01:01:30.184 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-12T01:01:30.184 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-12T01:01:30.184 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-12T01:01:30.184 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-12T01:01:30.184 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-12T01:01:30.184 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-12T01:01:30.184 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-12T01:01:30.184 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-12T01:01:30.185 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-12T01:01:30.185 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-12T01:01:30.185 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-12T01:01:30.185 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-12T01:01:30.185 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-12T01:01:30.185 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-12T01:01:30.185 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-12T01:01:30.185 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-12T01:01:30.185 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-12T01:01:30.185 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-12T01:01:30.185 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-12T01:01:30.185 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-12T01:01:30.185 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-12T01:01:30.185 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-12T01:01:30.186 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-12T01:01:30.186 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-12T01:01:30.186 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-12T01:01:30.186 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-12T01:01:30.186 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-12T01:01:30.186 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-12T01:01:30.186 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-12T01:01:30.186 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-12T01:01:30.186 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-12T01:01:30.186 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-12T01:01:30.186 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-12T01:01:30.186 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-12T01:01:30.186 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-12T01:01:30.187 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-12T01:01:30.187 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-12T01:01:30.187 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-12T01:01:30.187 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-12T01:01:30.187 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-12T01:01:30.187 INFO:teuthology.orchestra.run.smithi070.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-12T01:01:30.187 INFO:teuthology.orchestra.run.smithi070.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2024-09-12T01:01:30.610 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:01:30.610 INFO:teuthology.orchestra.run.smithi070.stdout:Welcome to Gradle 6.0.1! 2024-09-12T01:01:30.610 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:01:30.611 INFO:teuthology.orchestra.run.smithi070.stdout:Here are the highlights of this release: 2024-09-12T01:01:30.611 INFO:teuthology.orchestra.run.smithi070.stdout: - Substantial improvements in dependency management, including 2024-09-12T01:01:30.611 INFO:teuthology.orchestra.run.smithi070.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-12T01:01:30.611 INFO:teuthology.orchestra.run.smithi070.stdout: - Advanced control of transitive versions 2024-09-12T01:01:30.611 INFO:teuthology.orchestra.run.smithi070.stdout: - Support for optional features and dependencies 2024-09-12T01:01:30.611 INFO:teuthology.orchestra.run.smithi070.stdout: - Rules to tweak published metadata 2024-09-12T01:01:30.611 INFO:teuthology.orchestra.run.smithi070.stdout: - Support for Java 13 2024-09-12T01:01:30.611 INFO:teuthology.orchestra.run.smithi070.stdout: - Faster incremental Java and Groovy compilation 2024-09-12T01:01:30.611 INFO:teuthology.orchestra.run.smithi070.stdout: - New Zinc compiler for Scala 2024-09-12T01:01:30.611 INFO:teuthology.orchestra.run.smithi070.stdout: - VS2019 support 2024-09-12T01:01:30.611 INFO:teuthology.orchestra.run.smithi070.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-12T01:01:30.611 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:01:30.611 INFO:teuthology.orchestra.run.smithi070.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-12T01:01:30.612 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:01:30.633 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:01:30.634 INFO:teuthology.orchestra.run.smithi070.stdout:------------------------------------------------------------ 2024-09-12T01:01:30.634 INFO:teuthology.orchestra.run.smithi070.stdout:Gradle 6.0.1 2024-09-12T01:01:30.634 INFO:teuthology.orchestra.run.smithi070.stdout:------------------------------------------------------------ 2024-09-12T01:01:30.634 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:01:30.634 INFO:teuthology.orchestra.run.smithi070.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-12T01:01:30.634 INFO:teuthology.orchestra.run.smithi070.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-12T01:01:30.634 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:01:30.634 INFO:teuthology.orchestra.run.smithi070.stdout:Kotlin: 1.3.50 2024-09-12T01:01:30.634 INFO:teuthology.orchestra.run.smithi070.stdout:Groovy: 2.5.8 2024-09-12T01:01:30.635 INFO:teuthology.orchestra.run.smithi070.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-12T01:01:30.635 INFO:teuthology.orchestra.run.smithi070.stdout:JVM: 11.0.17 (Ubuntu 11.0.17+8-post-Ubuntu-1ubuntu222.04) 2024-09-12T01:01:30.635 INFO:teuthology.orchestra.run.smithi070.stdout:OS: Linux 5.15.0-119-generic amd64 2024-09-12T01:01:30.635 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:01:30.643 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-12T01:01:30.643 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T01:01:30.643 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi070.front.sepia.ceph.com 2024-09-12T01:01:30.643 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T01:01:30.643 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi187.front.sepia.ceph.com 2024-09-12T01:01:30.643 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-12T01:01:30.901 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-12T01:01:30.901 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-12T01:01:30.902 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'SAKUGCUJRBOELRGUCTMP', 'access_secret': 'Lo1Uky18+T3bzKcWIiLPGqSYI2Qomolt3tmve6t2/PDqbNxuUqzvWg==', 'region': 'mexico', 'endpoint': 'smithi070.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi070.front.sepia.ceph.com'} 2024-09-12T01:01:30.902 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-12T01:01:30.902 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'SAKUGCUJRBOELRGUCTMP', '--secret', 'Lo1Uky18+T3bzKcWIiLPGqSYI2Qomolt3tmve6t2/PDqbNxuUqzvWg==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-12T01:01:30.902 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key SAKUGCUJRBOELRGUCTMP --secret Lo1Uky18+T3bzKcWIiLPGqSYI2Qomolt3tmve6t2/PDqbNxuUqzvWg== --email tester.client.0_test@test.test --cluster ceph 2024-09-12T01:01:30.948 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:01:30.948 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:01:30.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:30.997+0000 7fc8015579c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:30.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.001+0000 7fc8015579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:30.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.001+0000 7fc8015579c0 20 realm 2024-09-12T01:01:30.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.001+0000 7fc8015579c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:30.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.001+0000 7fc8015579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:30.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.001+0000 7fc8015579c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:01:30.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.001+0000 7fc8015579c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:30.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.001+0000 7fc8015579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:30.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.001+0000 7fc8015579c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:30.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.001+0000 7fc8015579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:30.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.001+0000 7fc8015579c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:30.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.001+0000 7fc8015579c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:01:30.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.001+0000 7fc8015579c0 20 searching for the correct realm 2024-09-12T01:01:30.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.009+0000 7fc7ff85e640 0 -- 172.21.15.70:0/3717621415 >> [v2:172.21.15.70:6808/276433067,v1:172.21.15.70:6809/276433067] conn(0x562c12d4cc90 msgr2=0x562c12d4f080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:31.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.017+0000 7fc7fe85c640 0 -- 172.21.15.70:0/3717621415 >> [v2:172.21.15.70:6816/1979013808,v1:172.21.15.70:6817/1979013808] conn(0x562c12d405e0 msgr2=0x562c12d42a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:31.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.021+0000 7fc8015579c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:01:31.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.021+0000 7fc8015579c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:01:31.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.021+0000 7fc8015579c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:01:31.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.021+0000 7fc8015579c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:01:31.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.021+0000 7fc8015579c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:01:31.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.021+0000 7fc8015579c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:01:31.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.021+0000 7fc8015579c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:31.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.021+0000 7fc8015579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:31.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.021+0000 7fc8015579c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:31.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.021+0000 7fc8015579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:31.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.021+0000 7fc8015579c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:31.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.021+0000 7fc8015579c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:01:31.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.021+0000 7fc8015579c0 20 zone default found 2024-09-12T01:01:31.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.021+0000 7fc8015579c0 4 Realm: () 2024-09-12T01:01:31.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.021+0000 7fc8015579c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:01:31.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.021+0000 7fc8015579c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:01:31.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.021+0000 7fc8015579c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:01:31.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.021+0000 7fc8015579c0 20 zonegroup default 2024-09-12T01:01:31.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.021+0000 7fc8015579c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:31.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.021+0000 7fc8015579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:31.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.021+0000 7fc8015579c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:31.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.025+0000 7fc8015579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:31.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.025+0000 7fc8015579c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:31.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.025+0000 7fc8015579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:31.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.025+0000 7fc8015579c0 20 started sync module instance, tier type = 2024-09-12T01:01:31.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.025+0000 7fc8015579c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:01:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.045+0000 7fc8015579c0 20 add_watcher() i=0 2024-09-12T01:01:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.045+0000 7fc8015579c0 20 add_watcher() i=1 2024-09-12T01:01:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.045+0000 7fc8015579c0 20 add_watcher() i=2 2024-09-12T01:01:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.045+0000 7fc8015579c0 20 add_watcher() i=3 2024-09-12T01:01:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.045+0000 7fc8015579c0 20 add_watcher() i=4 2024-09-12T01:01:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.045+0000 7fc8015579c0 20 add_watcher() i=5 2024-09-12T01:01:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.045+0000 7fc8015579c0 20 add_watcher() i=6 2024-09-12T01:01:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.045+0000 7fc8015579c0 20 add_watcher() i=7 2024-09-12T01:01:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.045+0000 7fc8015579c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:01:31.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.049+0000 7fc6b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:31.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.049+0000 7fc8015579c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:01:31.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.049+0000 7fc8015579c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:01:31.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.049+0000 7fc8015579c0 5 note: GC not initialized 2024-09-12T01:01:31.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.049+0000 7fc6b4fe1640 20 reqs_thread_entry: start 2024-09-12T01:01:31.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.049+0000 7fc8015579c0 20 init_complete bucket index max shards: 1 2024-09-12T01:01:31.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.049+0000 7fc8015579c0 20 Filter name: none 2024-09-12T01:01:31.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.049+0000 7fc62e7fc640 20 reqs_thread_entry: start 2024-09-12T01:01:31.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.049+0000 7fc8015579c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T01:01:31.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.049+0000 7fc8015579c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:31.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.049+0000 7fc8015579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:31.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.049+0000 7fc8015579c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-12T01:01:31.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.049+0000 7fc8015579c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T01:01:31.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.049+0000 7fc8015579c0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-12T01:01:31.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.049+0000 7fc8015579c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:31.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.049+0000 7fc8015579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:31.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.049+0000 7fc8015579c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-12T01:01:31.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.049+0000 7fc8015579c0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T01:01:31.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.049+0000 7fc8015579c0 10 cache get: name=default.rgw.meta+users.keys+SAKUGCUJRBOELRGUCTMP : miss 2024-09-12T01:01:31.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.049+0000 7fc8015579c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:31.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.053+0000 7fc8015579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:31.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.053+0000 7fc8015579c0 10 cache put: name=default.rgw.meta+users.keys+SAKUGCUJRBOELRGUCTMP info.flags=0x0 2024-09-12T01:01:31.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.053+0000 7fc8015579c0 10 adding default.rgw.meta+users.keys+SAKUGCUJRBOELRGUCTMP to cache LRU end 2024-09-12T01:01:31.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.053+0000 7fc8015579c0 10 cache get: name=default.rgw.meta+users.keys+SAKUGCUJRBOELRGUCTMP : hit (negative entry) 2024-09-12T01:01:31.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.053+0000 7fc8015579c0 10 cache get: name=default.rgw.meta+users.keys+SAKUGCUJRBOELRGUCTMP : hit (negative entry) 2024-09-12T01:01:31.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.057+0000 7fc8015579c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T01:01:31.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.057+0000 7fc8015579c0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T01:01:31.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.057+0000 7fc8015579c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T01:01:31.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.057+0000 7fc6e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431636 cookie 94747294504592 notifier 8273 bl.length()=670 2024-09-12T01:01:31.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.057+0000 7fc6e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T01:01:31.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.057+0000 7fc6e2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T01:01:31.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.057+0000 7fc8015579c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T01:01:31.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.057+0000 7fc8015579c0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T01:01:31.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.057+0000 7fc8015579c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T01:01:31.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.057+0000 7fc6e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431629 cookie 94747294440544 notifier 8273 bl.length()=200 2024-09-12T01:01:31.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.057+0000 7fc6e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T01:01:31.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.057+0000 7fc6e2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T01:01:31.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.061+0000 7fc8015579c0 10 cache put: name=default.rgw.meta+users.keys+SAKUGCUJRBOELRGUCTMP info.flags=0x7 2024-09-12T01:01:31.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.061+0000 7fc8015579c0 10 moving default.rgw.meta+users.keys+SAKUGCUJRBOELRGUCTMP to cache LRU end 2024-09-12T01:01:31.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.061+0000 7fc8015579c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:SAKUGCUJRBOELRGUCTMP, ofs0, ns] 2024-09-12T01:01:31.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.061+0000 7fc6e27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431575 cookie 94747294497488 notifier 8273 bl.length()=189 2024-09-12T01:01:31.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.061+0000 7fc6e27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+SAKUGCUJRBOELRGUCTMP info.flags=0x7 2024-09-12T01:01:31.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.061+0000 7fc6e27fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+SAKUGCUJRBOELRGUCTMP to cache LRU end 2024-09-12T01:01:31.053 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:01:31.053 INFO:teuthology.orchestra.run.smithi070.stdout: "user_id": "tester.client.0", 2024-09-12T01:01:31.053 INFO:teuthology.orchestra.run.smithi070.stdout: "display_name": "Ms. tester.client.0", 2024-09-12T01:01:31.053 INFO:teuthology.orchestra.run.smithi070.stdout: "email": "tester.client.0_test@test.test", 2024-09-12T01:01:31.053 INFO:teuthology.orchestra.run.smithi070.stdout: "suspended": 0, 2024-09-12T01:01:31.053 INFO:teuthology.orchestra.run.smithi070.stdout: "max_buckets": 1000, 2024-09-12T01:01:31.053 INFO:teuthology.orchestra.run.smithi070.stdout: "subusers": [], 2024-09-12T01:01:31.053 INFO:teuthology.orchestra.run.smithi070.stdout: "keys": [ 2024-09-12T01:01:31.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:01:31.054 INFO:teuthology.orchestra.run.smithi070.stdout: "user": "tester.client.0", 2024-09-12T01:01:31.054 INFO:teuthology.orchestra.run.smithi070.stdout: "access_key": "SAKUGCUJRBOELRGUCTMP", 2024-09-12T01:01:31.054 INFO:teuthology.orchestra.run.smithi070.stdout: "secret_key": "Lo1Uky18+T3bzKcWIiLPGqSYI2Qomolt3tmve6t2/PDqbNxuUqzvWg==", 2024-09-12T01:01:31.054 INFO:teuthology.orchestra.run.smithi070.stdout: "active": true, 2024-09-12T01:01:31.054 INFO:teuthology.orchestra.run.smithi070.stdout: "create_date": "2024-09-12T01:01:31.055419Z" 2024-09-12T01:01:31.054 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:01:31.054 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:01:31.054 INFO:teuthology.orchestra.run.smithi070.stdout: "swift_keys": [], 2024-09-12T01:01:31.054 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": [], 2024-09-12T01:01:31.054 INFO:teuthology.orchestra.run.smithi070.stdout: "op_mask": "read, write, delete", 2024-09-12T01:01:31.054 INFO:teuthology.orchestra.run.smithi070.stdout: "default_placement": "", 2024-09-12T01:01:31.054 INFO:teuthology.orchestra.run.smithi070.stdout: "default_storage_class": "", 2024-09-12T01:01:31.054 INFO:teuthology.orchestra.run.smithi070.stdout: "placement_tags": [], 2024-09-12T01:01:31.055 INFO:teuthology.orchestra.run.smithi070.stdout: "bucket_quota": { 2024-09-12T01:01:31.055 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T01:01:31.055 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T01:01:31.055 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T01:01:31.055 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T01:01:31.055 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T01:01:31.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:01:31.055 INFO:teuthology.orchestra.run.smithi070.stdout: "user_quota": { 2024-09-12T01:01:31.055 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T01:01:31.055 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T01:01:31.055 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T01:01:31.055 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T01:01:31.055 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T01:01:31.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:01:31.056 INFO:teuthology.orchestra.run.smithi070.stdout: "temp_url_keys": [], 2024-09-12T01:01:31.056 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "rgw", 2024-09-12T01:01:31.056 INFO:teuthology.orchestra.run.smithi070.stdout: "mfa_ids": [], 2024-09-12T01:01:31.056 INFO:teuthology.orchestra.run.smithi070.stdout: "account_id": "", 2024-09-12T01:01:31.056 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2024-09-12T01:01:31.056 INFO:teuthology.orchestra.run.smithi070.stdout: "create_date": "2024-09-12T01:01:31.055385Z", 2024-09-12T01:01:31.056 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:01:31.056 INFO:teuthology.orchestra.run.smithi070.stdout: "group_ids": [] 2024-09-12T01:01:31.056 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:01:31.056 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:01:31.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.065+0000 7fc6b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:31.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.069+0000 7fc8015579c0 20 remove_watcher() i=0 2024-09-12T01:01:31.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.069+0000 7fc8015579c0 2 removed watcher, disabling cache 2024-09-12T01:01:31.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.069+0000 7fc8015579c0 20 remove_watcher() i=1 2024-09-12T01:01:31.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.073+0000 7fc8015579c0 20 remove_watcher() i=2 2024-09-12T01:01:31.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.073+0000 7fc8015579c0 20 remove_watcher() i=3 2024-09-12T01:01:31.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.077+0000 7fc8015579c0 20 remove_watcher() i=4 2024-09-12T01:01:31.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.077+0000 7fc8015579c0 20 remove_watcher() i=5 2024-09-12T01:01:31.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.077+0000 7fc8015579c0 20 remove_watcher() i=6 2024-09-12T01:01:31.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.081+0000 7fc8015579c0 20 remove_watcher() i=7 2024-09-12T01:01:31.082 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T01:01:31.082 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-12T01:01:31.132 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-12T01:01:31.133 DEBUG:teuthology.orchestra.run.smithi070:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-12T01:01:31.178 DEBUG:teuthology.orchestra.run.smithi070:> radosgw-admin gc process --include-all 2024-09-12T01:01:31.251 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:01:31.251 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:01:31.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.305+0000 7f7af38829c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:31.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.305+0000 7f7af38829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:31.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.305+0000 7f7af38829c0 20 realm 2024-09-12T01:01:31.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.305+0000 7f7af38829c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:31.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.305+0000 7f7af38829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:31.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.305+0000 7f7af38829c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:01:31.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.305+0000 7f7af38829c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:31.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.305+0000 7f7af38829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:31.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.305+0000 7f7af38829c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:31.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.305+0000 7f7af38829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:31.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.305+0000 7f7af38829c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:31.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.309+0000 7f7af38829c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:01:31.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.309+0000 7f7af38829c0 20 searching for the correct realm 2024-09-12T01:01:31.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.309+0000 7f7af0b87640 0 -- 172.21.15.70:0/1381501407 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7f7ae402b020 msgr2=0x7f7ae4018400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:31.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.317+0000 7f7af1388640 0 -- 172.21.15.70:0/1381501407 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f7aec02c040 msgr2=0x7f7aec02c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:31.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.325+0000 7f7af38829c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:01:31.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.325+0000 7f7af38829c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:01:31.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.325+0000 7f7af38829c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:01:31.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.325+0000 7f7af38829c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:01:31.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.325+0000 7f7af38829c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:01:31.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.325+0000 7f7af38829c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:01:31.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.325+0000 7f7af38829c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:31.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.325+0000 7f7af38829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:31.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.325+0000 7f7af38829c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:31.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.329+0000 7f7af38829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:31.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.329+0000 7f7af38829c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:31.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.329+0000 7f7af38829c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:01:31.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.329+0000 7f7af38829c0 20 zone default found 2024-09-12T01:01:31.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.329+0000 7f7af38829c0 4 Realm: () 2024-09-12T01:01:31.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.329+0000 7f7af38829c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:01:31.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.329+0000 7f7af38829c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:01:31.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.329+0000 7f7af38829c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:01:31.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.329+0000 7f7af38829c0 20 zonegroup default 2024-09-12T01:01:31.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.329+0000 7f7af38829c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:31.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.329+0000 7f7af38829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:31.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.329+0000 7f7af38829c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:31.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.329+0000 7f7af38829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:31.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.329+0000 7f7af38829c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:31.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.329+0000 7f7af38829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:31.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.329+0000 7f7af38829c0 20 started sync module instance, tier type = 2024-09-12T01:01:31.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.329+0000 7f7af38829c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:01:31.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.345+0000 7f7af38829c0 20 add_watcher() i=0 2024-09-12T01:01:31.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.345+0000 7f7af38829c0 20 add_watcher() i=1 2024-09-12T01:01:31.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.345+0000 7f7af38829c0 20 add_watcher() i=2 2024-09-12T01:01:31.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.345+0000 7f7af38829c0 20 add_watcher() i=3 2024-09-12T01:01:31.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.345+0000 7f7af38829c0 20 add_watcher() i=4 2024-09-12T01:01:31.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.345+0000 7f7af38829c0 20 add_watcher() i=5 2024-09-12T01:01:31.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.345+0000 7f7af38829c0 20 add_watcher() i=6 2024-09-12T01:01:31.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.345+0000 7f7af38829c0 20 add_watcher() i=7 2024-09-12T01:01:31.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.345+0000 7f7af38829c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:01:31.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.345+0000 7f79a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:31.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.349+0000 7f7af38829c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:01:31.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.349+0000 7f7af38829c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:01:31.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.425+0000 7f79a67e4640 20 reqs_thread_entry: start 2024-09-12T01:01:31.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.425+0000 7f7af38829c0 20 init_complete bucket index max shards: 1 2024-09-12T01:01:31.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.425+0000 7f7af38829c0 20 Filter name: none 2024-09-12T01:01:31.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.425+0000 7f7917fff640 20 reqs_thread_entry: start 2024-09-12T01:01:31.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.425+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:01:31.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.425+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.425+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.425+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T01:01:31.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.425+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11829806707158470828', time=2024-09-12T02:52:53.139939+0000, chain.objs.size()=1 2024-09-12T01:01:31.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.425+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5__shadow_.3pVFEeqMFHfsGTyoHjDItVp9I4KUMa2_0 2024-09-12T01:01:31.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.425+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13360118321810603596', time=2024-09-12T02:52:53.821832+0000, chain.objs.size()=1 2024-09-12T01:01:31.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.425+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9__shadow_.a5X_HnrJF-kYV-g0pSWz7x_pWpb5p5z_0 2024-09-12T01:01:31.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.429+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16072945945633524373', time=2024-09-12T02:54:11.761189+0000, chain.objs.size()=1 2024-09-12T01:01:31.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.429+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21__shadow_.ctzZ5uE7gp4wQokHUG8Cjr3PDEr8tqj_0 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.429+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1178653675918337705', time=2024-09-12T02:55:20.260024+0000, chain.objs.size()=1 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.429+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25__shadow_.JzYqd18PX7wOPqAch12LY83P5n-qH6E_0 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.429+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5098184698858217509', time=2024-09-12T02:55:57.731823+0000, chain.objs.size()=1 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.429+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29__shadow_.M8Ww2DXK8cQ-Yi3YLJ0Lt7k1rQlMWrw_0 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.429+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5126269372626694600', time=2024-09-12T02:56:31.613343+0000, chain.objs.size()=1 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.429+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31__shadow_._xu06WaQrel-KLY9D2p_j51jQCIAUVU_0 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.429+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1753938052438241738', time=2024-09-12T02:57:42.272417+0000, chain.objs.size()=1 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.429+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36__shadow_.VEkmIgjFc_SSftrtYZxTHE_yJkjLXCA_0 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.429+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11776669812798876017', time=2024-09-12T02:58:16.483221+0000, chain.objs.size()=1 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.429+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38__shadow_.NHVnBK6eIqa06sb75cyOHSkZLNcGU9p_0 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.429+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12478055061589079259', time=2024-09-12T02:58:17.745804+0000, chain.objs.size()=1 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.429+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39__shadow_.K00qGUGpyrIopNgivZ4OhyzG_mSEczB_0 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.429+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4578334501012638578', time=2024-09-12T02:58:18.929147+0000, chain.objs.size()=1 2024-09-12T01:01:31.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.429+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40__shadow_.w_J614tCKK_58A9HrlgPUWdgcarfGoP_0 2024-09-12T01:01:31.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.433+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.437+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:01:31.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.437+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.441+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.441+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T01:01:31.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.441+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14222544290276087193', time=2024-09-12T02:52:53.595958+0000, chain.objs.size()=3 2024-09-12T01:01:31.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.441+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15__multipart_foo-LUKEWARM.2~KU50ShJksbHUlXgh8dpfa-9MP-Lt4El.1 2024-09-12T01:01:31.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.441+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15__multipart_foo-LUKEWARM.2~KU50ShJksbHUlXgh8dpfa-9MP-Lt4El.2 2024-09-12T01:01:31.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.441+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15__multipart_foo-LUKEWARM.2~KU50ShJksbHUlXgh8dpfa-9MP-Lt4El.3 2024-09-12T01:01:31.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.441+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6987965815207392944', time=2024-09-12T02:52:53.659107+0000, chain.objs.size()=1 2024-09-12T01:01:31.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.441+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14__shadow_.UrgYgjlMf55QGfP6Q4k-QVoiUeHDOHT_0 2024-09-12T01:01:31.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.441+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15702312046498242149', time=2024-09-12T02:54:10.506248+0000, chain.objs.size()=1 2024-09-12T01:01:31.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.441+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20__shadow_.AJMi8ZlH5_WxrLG27ABck6Q1l2tdbAJ_0 2024-09-12T01:01:31.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.441+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11532134286243365710', time=2024-09-12T02:54:10.513524+0000, chain.objs.size()=1 2024-09-12T01:01:31.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.441+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20__shadow_.Qd-n5AOzUEWPIuhwfzKZeJ4Ud-yQQw4_0 2024-09-12T01:01:31.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.441+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3449053778229700482', time=2024-09-12T02:54:11.750433+0000, chain.objs.size()=1 2024-09-12T01:01:31.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.441+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21__shadow_.KrgkyQdRW98i-e0VRajw_ui8pjAS_1a_0 2024-09-12T01:01:31.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.441+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11752408319054590133', time=2024-09-12T02:54:44.216947+0000, chain.objs.size()=1 2024-09-12T01:01:31.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.441+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22__shadow_.d-7bMsp8NCfh2Rg6BBbbZlhPNO8SCxZ_0 2024-09-12T01:01:31.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.441+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6530475620290046418', time=2024-09-12T02:54:47.763783+0000, chain.objs.size()=1 2024-09-12T01:01:31.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.441+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24__shadow_.iuOJ6F2PfLZF_tuJEv-9Zu-TOKQQmwB_0 2024-09-12T01:01:31.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.441+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9923013760092228304', time=2024-09-12T02:54:49.185022+0000, chain.objs.size()=1 2024-09-12T01:01:31.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.441+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25__shadow_.k-1-FyPe1YWNf9d3fIC0X79CyRimZNg_0 2024-09-12T01:01:31.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.441+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11283138424869193684', time=2024-09-12T02:55:23.134575+0000, chain.objs.size()=1 2024-09-12T01:01:31.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.441+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27__shadow_.WIPEcmpLvOwiV-tnERtHj8OWygISfdv_0 2024-09-12T01:01:31.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.441+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6883881721030204702', time=2024-09-12T02:55:55.399374+0000, chain.objs.size()=1 2024-09-12T01:01:31.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.441+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28__shadow_.Cjd8nfXdWn8w67JKBx62tJ3wWZ-WNNc_0 2024-09-12T01:01:31.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.445+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15766440599802121750', time=2024-09-12T02:55:55.406987+0000, chain.objs.size()=1 2024-09-12T01:01:31.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.445+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28__shadow_.cKwqfY8zZO6HWXIVm_C-2FnfpuQ9fak_0 2024-09-12T01:01:31.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.445+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7677707778253304923', time=2024-09-12T02:55:57.709042+0000, chain.objs.size()=1 2024-09-12T01:01:31.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.445+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29__shadow_.Fat5Wzj7cvG52o15Uk2PGnP7Du8tpgT_0 2024-09-12T01:01:31.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.445+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11793658031748462371', time=2024-09-12T02:55:57.721942+0000, chain.objs.size()=1 2024-09-12T01:01:31.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.445+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29__shadow_.5tzPNWiTB2onOaOHHi2Wk_zEeW8dYKL_0 2024-09-12T01:01:31.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.445+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7212612064451174331', time=2024-09-12T02:56:29.738417+0000, chain.objs.size()=1 2024-09-12T01:01:31.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.445+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30__shadow_.X7irSCb78fuk3BjlAyOJm-a4PRdWu1m_0 2024-09-12T01:01:31.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.445+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.318249491081969484', time=2024-09-12T02:56:32.853088+0000, chain.objs.size()=1 2024-09-12T01:01:31.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.445+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32__shadow_._bdM8s96CEXjrP_lf2QtP8VIMq3RCGe_0 2024-09-12T01:01:31.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.449+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2331405644491297256', time=2024-09-12T02:57:05.015160+0000, chain.objs.size()=1 2024-09-12T01:01:31.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.449+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33__shadow_.um0zPl2mc8zfWW8-bbrnBW1xaILeOkk_0 2024-09-12T01:01:31.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.449+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8811829117382639237', time=2024-09-12T02:57:07.442604+0000, chain.objs.size()=1 2024-09-12T01:01:31.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.449+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34__shadow_.h0aIdRBvjSyExlzlfMAIxMuvvkaYV4p_0 2024-09-12T01:01:31.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.449+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17527841768222608671', time=2024-09-12T02:57:42.270126+0000, chain.objs.size()=1 2024-09-12T01:01:31.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.449+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36__shadow_.mNH6XRb-nqjH2vuZxxx_kvXYzKqnWco_0 2024-09-12T01:01:31.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.449+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2686455474290789371', time=2024-09-12T02:58:17.729424+0000, chain.objs.size()=1 2024-09-12T01:01:31.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.449+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39__shadow_.uAA3I8_Uc_7bE--NbE3ICHNxt0ZTzHP_0 2024-09-12T01:01:31.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.449+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2353649610952365611', time=2024-09-12T03:01:04.093278+0000, chain.objs.size()=1 2024-09-12T01:01:31.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.449+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19__shadow:VvYl-lxH.WsDnIEj39xWoPiLMIJU8z8_.HCaJnQ3sU-Qz3jb6oehOmMQ2CZOOFzd_0 2024-09-12T01:01:31.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.453+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.457+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:01:31.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.461+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.461+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.461+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T01:01:31.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.461+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13484450579280225212', time=2024-09-12T02:54:12.937485+0000, chain.objs.size()=1 2024-09-12T01:01:31.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.461+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22__shadow_.obmSXk4FSObl4mgqN0A4tfvBfGv5AB__0 2024-09-12T01:01:31.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.461+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14344163219578183403', time=2024-09-12T02:54:46.319605+0000, chain.objs.size()=1 2024-09-12T01:01:31.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.461+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23__shadow_.Jw-4S4sHj-IPDrYR0PS-K1o6KyPKdM4_0 2024-09-12T01:01:31.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.461+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17944683080270357364', time=2024-09-12T02:55:23.138118+0000, chain.objs.size()=1 2024-09-12T01:01:31.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.461+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27__shadow_.wIsJEBhhEcLXpwCcQROWpwhNEhN1_QR_0 2024-09-12T01:01:31.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.461+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3336856255540554626', time=2024-09-12T02:56:32.861944+0000, chain.objs.size()=1 2024-09-12T01:01:31.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.461+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32__shadow_.JIiQRN9awHpkARFhiTS_qxuTE6Mgd9d_0 2024-09-12T01:01:31.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.461+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12878181187894852824', time=2024-09-12T02:57:05.034089+0000, chain.objs.size()=1 2024-09-12T01:01:31.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.461+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33__shadow_.2FcUEYZBBpQu7SAcxYdek2KfVF2diQE_0 2024-09-12T01:01:31.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.461+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11626601332221300780', time=2024-09-12T02:57:42.270162+0000, chain.objs.size()=1 2024-09-12T01:01:31.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.461+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36__shadow_.kdnJlrHKlYMnPglLuONtXGnFbau34w3_0 2024-09-12T01:01:31.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.461+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6003683942912325041', time=2024-09-12T02:58:49.972979+0000, chain.objs.size()=1 2024-09-12T01:01:31.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.461+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40__shadow_.Rb-JviWZwfMjfpU0CE3K5W8tj-iIOCu_0 2024-09-12T01:01:31.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.465+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.469+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:01:31.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.469+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.469+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.469+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T01:01:31.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.469+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2222175213655723263', time=2024-09-12T02:52:53.243887+0000, chain.objs.size()=4 2024-09-12T01:01:31.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.469+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11__multipart_foo.2~y8qEU0pmYUk9MtxNCAsKeMhFLqh5p-e.1 2024-09-12T01:01:31.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.469+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11__multipart_foo.2~y8qEU0pmYUk9MtxNCAsKeMhFLqh5p-e.2 2024-09-12T01:01:31.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.469+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11__multipart_foo.2~y8qEU0pmYUk9MtxNCAsKeMhFLqh5p-e.3 2024-09-12T01:01:31.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.469+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11__multipart_foo.2~y8qEU0pmYUk9MtxNCAsKeMhFLqh5p-e.4 2024-09-12T01:01:31.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.473+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='_8AHn-9agfIvEAlSU9ZVj2jrHhi1gM6R', time=2024-09-12T02:52:53.341332+0000, chain.objs.size()=1 2024-09-12T01:01:31.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.473+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16__shadow_.UuN35_zHUCuDENQvZpOCU0NN2b1xO14_0 2024-09-12T01:01:31.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.473+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17966126031209906754', time=2024-09-12T02:52:53.590378+0000, chain.objs.size()=3 2024-09-12T01:01:31.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.473+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15__multipart_foo-FROZEN.2~ItzYME0v2B31XWGwh2hAB1WcQV66kDd.1 2024-09-12T01:01:31.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.473+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15__multipart_foo-FROZEN.2~ItzYME0v2B31XWGwh2hAB1WcQV66kDd.2 2024-09-12T01:01:31.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.473+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15__multipart_foo-FROZEN.2~ItzYME0v2B31XWGwh2hAB1WcQV66kDd.3 2024-09-12T01:01:31.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.473+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5832606828329333299', time=2024-09-12T02:52:53.803755+0000, chain.objs.size()=1 2024-09-12T01:01:31.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.473+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9__shadow_.ST0_NyHgLP34BzRAwhpbUfP4UKDuaYg_0 2024-09-12T01:01:31.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.473+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8739858770751584733', time=2024-09-12T02:54:11.733200+0000, chain.objs.size()=1 2024-09-12T01:01:31.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.473+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21__shadow_.jh---7Qq000sGRwk2GarqzWpeiyO59q_0 2024-09-12T01:01:31.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.473+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13344362394456027644', time=2024-09-12T02:54:11.753456+0000, chain.objs.size()=1 2024-09-12T01:01:31.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.473+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21__shadow_.rurOhhlgufs4uUT0-DhhZNYDTlV3azb_0 2024-09-12T01:01:31.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.473+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6127674659762367472', time=2024-09-12T02:54:46.309974+0000, chain.objs.size()=1 2024-09-12T01:01:31.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.473+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23__shadow_.trFf3BEDgFS9xRrgwk-95cqEhpdkQIX_0 2024-09-12T01:01:31.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.477+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11800938721862209304', time=2024-09-12T02:54:47.773993+0000, chain.objs.size()=1 2024-09-12T01:01:31.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.477+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24__shadow_.g_0wxFw4msTIqvuJQnFXPWm0tOyK-ok_0 2024-09-12T01:01:31.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.477+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13727370878402413904', time=2024-09-12T02:55:20.269821+0000, chain.objs.size()=1 2024-09-12T01:01:31.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.477+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25__shadow_.GtKr0Y5B4iYvFGxZ9N9EGSbyJ0Q1nTA_0 2024-09-12T01:01:31.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.477+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8466144642286773723', time=2024-09-12T02:55:23.171398+0000, chain.objs.size()=1 2024-09-12T01:01:31.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.477+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27__shadow_.UOkZxf2W6u4G5t2jrD8cjMLS1Oprx3I_0 2024-09-12T01:01:31.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.477+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10858727478669213749', time=2024-09-12T02:55:55.397234+0000, chain.objs.size()=1 2024-09-12T01:01:31.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.477+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28__shadow_._61L4jz0ITQ-bq9T-Msbgda0BAWHWcc_0 2024-09-12T01:01:31.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.481+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3609834527942608403', time=2024-09-12T02:57:07.442417+0000, chain.objs.size()=1 2024-09-12T01:01:31.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.481+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34__shadow_.O-BOd9pxJ4NK8tTqCn3UoI3U5YhrP2u_0 2024-09-12T01:01:31.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.481+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14289076832897222556', time=2024-09-12T02:57:07.454191+0000, chain.objs.size()=1 2024-09-12T01:01:31.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.481+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34__shadow_._XhANghvVt9vU5b_93mH5GEd8fUNPyk_0 2024-09-12T01:01:31.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.481+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1927266035261155824', time=2024-09-12T02:57:40.207489+0000, chain.objs.size()=1 2024-09-12T01:01:31.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.481+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35__shadow_.H6Diy9nCU9WU6kawwXyAmyd0_4TTT1-_0 2024-09-12T01:01:31.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.481+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16630624299535987135', time=2024-09-12T02:58:14.317288+0000, chain.objs.size()=1 2024-09-12T01:01:31.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.481+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37__shadow_.xwwU3V25NNB-Q5aSZau2xdcLMk6oqY0_0 2024-09-12T01:01:31.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.481+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14727332931416079544', time=2024-09-12T02:58:14.334079+0000, chain.objs.size()=1 2024-09-12T01:01:31.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.481+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37__shadow_.x7Ri61lFCHXwZ0Jdt-Lit4jRXVjRQjY_0 2024-09-12T01:01:31.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.481+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8049266464098748379', time=2024-09-12T02:58:16.466557+0000, chain.objs.size()=1 2024-09-12T01:01:31.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.481+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38__shadow_.6nkxGUQUeAoASZuJwIL35bXug5xQ_Gl_0 2024-09-12T01:01:31.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.481+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2500627509810319673', time=2024-09-12T02:58:17.737796+0000, chain.objs.size()=1 2024-09-12T01:01:31.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.481+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39__shadow_.pJtH30go99K9dkhiqLwCgk4Kd5RGoIL_0 2024-09-12T01:01:31.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.481+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5853925260750116390', time=2024-09-12T02:58:17.751420+0000, chain.objs.size()=1 2024-09-12T01:01:31.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.481+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39__shadow_.1xqSpQxRSQlsu9mcaa4damcIX6fLvae_0 2024-09-12T01:01:31.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.485+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.489+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:01:31.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.489+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T01:01:31.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7318172752022423514', time=2024-09-12T02:52:53.609376+0000, chain.objs.size()=3 2024-09-12T01:01:31.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15__multipart_foo-STANDARD.2~OiD9y35-lQYed-XXBC9ZrgaAJ5A2mUv.1 2024-09-12T01:01:31.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15__multipart_foo-STANDARD.2~OiD9y35-lQYed-XXBC9ZrgaAJ5A2mUv.2 2024-09-12T01:01:31.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15__multipart_foo-STANDARD.2~OiD9y35-lQYed-XXBC9ZrgaAJ5A2mUv.3 2024-09-12T01:01:31.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1688726269840778565', time=2024-09-12T02:54:44.229238+0000, chain.objs.size()=1 2024-09-12T01:01:31.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22__shadow_.ZICJaymgrHtvHKnVIyn6LpzQ0saJ_6i_0 2024-09-12T01:01:31.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2761527649101337411', time=2024-09-12T02:54:47.793906+0000, chain.objs.size()=1 2024-09-12T01:01:31.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24__shadow_.g_OMyjFk4KYtZ42Hda69s9-rFNaYGDL_0 2024-09-12T01:01:31.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2287099564055037845', time=2024-09-12T02:54:47.798057+0000, chain.objs.size()=1 2024-09-12T01:01:31.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24__shadow_.QFCALg5lZM1B4gm_GOyhy_RHv-XEx-J_0 2024-09-12T01:01:31.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8704006736021667331', time=2024-09-12T02:55:21.956220+0000, chain.objs.size()=1 2024-09-12T01:01:31.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26__shadow_.Cz-FH2hpD6LGpVELzvVrSVpHtJGw6s9_0 2024-09-12T01:01:31.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9004493355348092524', time=2024-09-12T02:56:29.744453+0000, chain.objs.size()=1 2024-09-12T01:01:31.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30__shadow_.YPcAF47ZPHPRyvPNv6ahpmCQpdt1QLn_0 2024-09-12T01:01:31.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17492107639857545975', time=2024-09-12T02:56:29.751889+0000, chain.objs.size()=1 2024-09-12T01:01:31.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30__shadow_.tvhqsxUKH_pcOauPmyceif_GbwQNvOR_0 2024-09-12T01:01:31.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5708375301515960101', time=2024-09-12T02:56:29.756682+0000, chain.objs.size()=1 2024-09-12T01:01:31.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30__shadow_.vwDwCHoaC4aiDhX0uhvjUIttaTPZ9X6_0 2024-09-12T01:01:31.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16820360150048532978', time=2024-09-12T02:56:31.607087+0000, chain.objs.size()=1 2024-09-12T01:01:31.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31__shadow_.CxdUAVblBU1cBp278tSCWsWy5JMCza2_0 2024-09-12T01:01:31.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2074632335346057178', time=2024-09-12T02:57:05.022894+0000, chain.objs.size()=1 2024-09-12T01:01:31.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33__shadow_.d7Z0CvOLQ-0tMHvTcj4_Fm9hHLz9iig_0 2024-09-12T01:01:31.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15792855353595757028', time=2024-09-12T02:57:05.023477+0000, chain.objs.size()=1 2024-09-12T01:01:31.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33__shadow_.gq1ULMzcBedppHP6bA4RD-4WW4vPLx8_0 2024-09-12T01:01:31.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10714097869409265988', time=2024-09-12T02:57:07.451848+0000, chain.objs.size()=1 2024-09-12T01:01:31.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.493+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34__shadow_.2ZexIxAg-4mOLx1isIRgfuqHF9Qae97_0 2024-09-12T01:01:31.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.497+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3888214811964514364', time=2024-09-12T02:57:42.290006+0000, chain.objs.size()=1 2024-09-12T01:01:31.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.497+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36__shadow_.WnQuBbjgWXDlJpmqoY7S1OQJVXbBSDD_0 2024-09-12T01:01:31.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.497+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4799559015376944379', time=2024-09-12T02:58:14.313447+0000, chain.objs.size()=1 2024-09-12T01:01:31.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.497+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37__shadow_.eHOqx0_vlIU0ksxn9FyjHaP9fFrA86O_0 2024-09-12T01:01:31.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.497+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6472801637298099215', time=2024-09-12T02:58:14.333497+0000, chain.objs.size()=1 2024-09-12T01:01:31.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.497+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37__shadow_.E75UC7aitY47ctQOshQSNz-DRv0M3Ip_0 2024-09-12T01:01:31.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.497+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8189418515586401361', time=2024-09-12T02:58:17.751928+0000, chain.objs.size()=1 2024-09-12T01:01:31.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.497+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39__shadow_.0kH68qw3P0XFq1VY3cQCGertNDWZJPT_0 2024-09-12T01:01:31.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.497+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9757339827516852437', time=2024-09-12T02:58:49.954419+0000, chain.objs.size()=1 2024-09-12T01:01:31.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.497+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40__shadow_.IRsKl4qFarxX7lvXB9-su-YLqOhHw7d_0 2024-09-12T01:01:31.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.497+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9513573415363614974', time=2024-09-12T03:00:56.534095+0000, chain.objs.size()=1 2024-09-12T01:01:31.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.497+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18__shadow_.rS0tTDuMzRYrGHvip_cKZYOig0Q7jIs_0 2024-09-12T01:01:31.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.501+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.505+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:01:31.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.509+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.513+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.513+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T01:01:31.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.513+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='_5c79iPDBqHR3gW-U0TkDW7c8464ydty', time=2024-09-12T02:52:53.388936+0000, chain.objs.size()=1 2024-09-12T01:01:31.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.513+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16__shadow_.Joz6JNzzm2rFFY_Q2BoVLr7pYL6xi_5_0 2024-09-12T01:01:31.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.513+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13695404232489827019', time=2024-09-12T02:52:53.518440+0000, chain.objs.size()=3 2024-09-12T01:01:31.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.513+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-STANDARD.2~Dh-pUyYeRw5CB5t7tB6fcp5s7ff99aC.1 2024-09-12T01:01:31.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.513+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-STANDARD.2~Dh-pUyYeRw5CB5t7tB6fcp5s7ff99aC.2 2024-09-12T01:01:31.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.513+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-STANDARD.2~Dh-pUyYeRw5CB5t7tB6fcp5s7ff99aC.3 2024-09-12T01:01:31.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.513+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11713127293041132845', time=2024-09-12T02:54:46.300494+0000, chain.objs.size()=1 2024-09-12T01:01:31.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.513+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23__shadow_.gACzgU_uf5mkX3BJwGuP4nHW3P7aHk4_0 2024-09-12T01:01:31.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.513+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17697557053983231439', time=2024-09-12T02:54:47.763461+0000, chain.objs.size()=1 2024-09-12T01:01:31.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.513+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24__shadow_.WL2yBPy03F0Ov20LnRi0NFOdPDEEvhB_0 2024-09-12T01:01:31.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.513+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14218622630176088700', time=2024-09-12T02:55:20.270337+0000, chain.objs.size()=1 2024-09-12T01:01:31.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.513+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25__shadow_._rwsQgZYArXn81nNGXVQex_0B2g61zT_0 2024-09-12T01:01:31.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.513+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13300386230219378523', time=2024-09-12T02:55:23.143411+0000, chain.objs.size()=1 2024-09-12T01:01:31.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.513+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27__shadow_.9yflkhwJQOrm4ec8oiTRC5OvdtEbSoV_0 2024-09-12T01:01:31.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.513+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8113195969880640316', time=2024-09-12T02:56:29.756937+0000, chain.objs.size()=1 2024-09-12T01:01:31.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.513+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30__shadow_.1tVYdsdgarYzTDVsRBaPJJiksmW4Uth_0 2024-09-12T01:01:31.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.513+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16443633096337556444', time=2024-09-12T02:56:31.612645+0000, chain.objs.size()=1 2024-09-12T01:01:31.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.513+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31__shadow_.LazcAdwVEQ7Ul9EYbstnD7a6pIiN1Xo_0 2024-09-12T01:01:31.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.513+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7653854092697576898', time=2024-09-12T02:57:07.431233+0000, chain.objs.size()=1 2024-09-12T01:01:31.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.513+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34__shadow_.fXMErzP62TUGzKhytFKom3mrI0OIrm4_0 2024-09-12T01:01:31.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.513+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4966980820046139118', time=2024-09-12T02:57:08.875428+0000, chain.objs.size()=1 2024-09-12T01:01:31.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.513+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35__shadow_.ZuTMwhbhr_iRGxx3rV4cntc5a5jZFct_0 2024-09-12T01:01:31.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.517+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13590528017737996138', time=2024-09-12T02:57:42.273881+0000, chain.objs.size()=1 2024-09-12T01:01:31.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.517+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36__shadow_.a0CTyTkLCAV_p2ZotlW1Oj-iD7U-ybP_0 2024-09-12T01:01:31.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.517+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2620030699684886907', time=2024-09-12T02:58:16.035571+0000, chain.objs.size()=1 2024-09-12T01:01:31.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.517+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38__shadow_.0LKCfgz8_nYvozKD9laqOfLv-szLm3t_0 2024-09-12T01:01:31.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.517+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7768692862701543215', time=2024-09-12T03:00:56.524746+0000, chain.objs.size()=1 2024-09-12T01:01:31.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.517+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18__shadow_.m_4YyeQMJ3BGgsnBxWXgyM8Aesmtf4o_0 2024-09-12T01:01:31.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.521+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.525+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:01:31.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.529+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.529+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.533+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T01:01:31.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.533+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7922636097674205713', time=2024-09-12T02:52:53.104595+0000, chain.objs.size()=1 2024-09-12T01:01:31.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.533+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5__shadow_.7R44TPDs7KRMrwUAzfBhku7rWIJePiN_0 2024-09-12T01:01:31.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.533+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12287527414774459180', time=2024-09-12T02:52:53.552889+0000, chain.objs.size()=3 2024-09-12T01:01:31.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.533+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-STANDARD.2~Dh-pUyYeRw5CB5t7tB6fcp5s7ff99aC.1 2024-09-12T01:01:31.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.533+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-STANDARD.2~Dh-pUyYeRw5CB5t7tB6fcp5s7ff99aC.2 2024-09-12T01:01:31.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.533+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-STANDARD.2~Dh-pUyYeRw5CB5t7tB6fcp5s7ff99aC.3 2024-09-12T01:01:31.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.533+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17928953827018908125', time=2024-09-12T02:52:53.754863+0000, chain.objs.size()=1 2024-09-12T01:01:31.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.533+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8__shadow_.NfTmJ-CCBH6lUtXdwYmiAmbWGSHtWv1_0 2024-09-12T01:01:31.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.533+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12711597887662585071', time=2024-09-12T02:52:53.812822+0000, chain.objs.size()=1 2024-09-12T01:01:31.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.533+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9__shadow_.rMqPMttmb5fZBt-S8XJDZ4RxME7uJwD_0 2024-09-12T01:01:31.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.533+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38299925398950649', time=2024-09-12T02:54:10.529689+0000, chain.objs.size()=1 2024-09-12T01:01:31.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.533+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20__shadow_.ihofHf1gCCKg90fv3acJayUbrsIiQqv_0 2024-09-12T01:01:31.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.533+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12499780844780806914', time=2024-09-12T02:54:11.769979+0000, chain.objs.size()=1 2024-09-12T01:01:31.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.533+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21__shadow_.julZLRZ44O1UOmtehv_KD1fsibC7NZz_0 2024-09-12T01:01:31.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.533+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14811361089361383348', time=2024-09-12T02:55:20.277757+0000, chain.objs.size()=1 2024-09-12T01:01:31.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.533+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25__shadow_.3dizvLoOd6ucYfHoMKcnsr1MNB1qZeu_0 2024-09-12T01:01:31.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.533+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14778482782261420773', time=2024-09-12T02:55:20.283475+0000, chain.objs.size()=1 2024-09-12T01:01:31.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.533+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25__shadow_.ZYrmwCiS5KycesbcLqvnM2zim69q28J_0 2024-09-12T01:01:31.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.533+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5605475622558699885', time=2024-09-12T02:55:23.138092+0000, chain.objs.size()=1 2024-09-12T01:01:31.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.533+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27__shadow_.HQI5kaUbQRvvqK6xW6Kd1ObIVC7sHvS_0 2024-09-12T01:01:31.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.533+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11469782016464264559', time=2024-09-12T02:55:23.154220+0000, chain.objs.size()=1 2024-09-12T01:01:31.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.533+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27__shadow_.yNwqLMNH5G-MCMipe-N72TedxSJUZ4F_0 2024-09-12T01:01:31.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.537+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13051827221977391181', time=2024-09-12T02:56:29.744261+0000, chain.objs.size()=1 2024-09-12T01:01:31.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.537+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30__shadow_._lQHy39OTnEdlmjUlRXP7vY5E61VUJ0_0 2024-09-12T01:01:31.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.537+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.419217759671694730', time=2024-09-12T02:57:05.040161+0000, chain.objs.size()=1 2024-09-12T01:01:31.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.537+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33__shadow_.4EAzIV8RPnts52a22xHpZCs_BDQfd6N_0 2024-09-12T01:01:31.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.537+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1263573119566702329', time=2024-09-12T02:57:40.173522+0000, chain.objs.size()=1 2024-09-12T01:01:31.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.537+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35__shadow_.fwZ_vGqs9XgCs0qa0ZCmO_41DGqHrDY_0 2024-09-12T01:01:31.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.537+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5775533849109197194', time=2024-09-12T02:58:49.952259+0000, chain.objs.size()=1 2024-09-12T01:01:31.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.537+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40__shadow_.3sXNo-jto6RAFOkxaI1ygwuuM3w2OIG_0 2024-09-12T01:01:31.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.537+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3182831982490797720', time=2024-09-12T03:00:56.526315+0000, chain.objs.size()=1 2024-09-12T01:01:31.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.537+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18__shadow_.b60WqABXr4Mkyzq7WSFNp6mC1v69jVy_0 2024-09-12T01:01:31.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.541+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.545+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:01:31.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.549+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.549+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.549+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T01:01:31.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.549+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8875906474275719318', time=2024-09-12T02:52:53.345177+0000, chain.objs.size()=1 2024-09-12T01:01:31.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.549+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16__shadow_.tbh4rDFjapnGCjrjU7hp0rlC-6Y7tGg_0 2024-09-12T01:01:31.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.549+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14414789447823104824', time=2024-09-12T02:54:10.526980+0000, chain.objs.size()=1 2024-09-12T01:01:31.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.549+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20__shadow_.TCxvwrCxdOO4fhXsI1BH1hT0E1mn_yF_0 2024-09-12T01:01:31.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.549+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12868016606537584607', time=2024-09-12T02:54:10.532001+0000, chain.objs.size()=1 2024-09-12T01:01:31.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.549+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20__shadow_.HVz9BmLW6IgCrhP7tgaLq6ErKlxcdyC_0 2024-09-12T01:01:31.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.549+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1907899863289822686', time=2024-09-12T02:54:47.779813+0000, chain.objs.size()=1 2024-09-12T01:01:31.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.549+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24__shadow_.kc0_eIiaXljQZUbRwPUNqVnWVREwB7c_0 2024-09-12T01:01:31.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.549+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11109196828151791678', time=2024-09-12T02:55:57.722524+0000, chain.objs.size()=1 2024-09-12T01:01:31.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.549+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29__shadow_.25dob0K8cndeAKh4ec_VCRocE8hL4ll_0 2024-09-12T01:01:31.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.549+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11248199163731869820', time=2024-09-12T02:55:57.724650+0000, chain.objs.size()=1 2024-09-12T01:01:31.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.549+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29__shadow_.Wnsr-OOcyaedi26I9fxdZcbwcpKRVG1_0 2024-09-12T01:01:31.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.549+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5614831008565223660', time=2024-09-12T02:56:29.757605+0000, chain.objs.size()=1 2024-09-12T01:01:31.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.549+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30__shadow_.--cfbMvv2o8e_F3Z5eONm4vnsXxRtVf_0 2024-09-12T01:01:31.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.549+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13205489512350773601', time=2024-09-12T02:56:31.605776+0000, chain.objs.size()=1 2024-09-12T01:01:31.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.549+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31__shadow_.F0R7H2G9zpdgTuuk2Jyi-wcX6TGNQu2_0 2024-09-12T01:01:31.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.549+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16855063690798633297', time=2024-09-12T02:57:05.025159+0000, chain.objs.size()=1 2024-09-12T01:01:31.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.549+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33__shadow_.l5YBvn3ufMd494XctHggotS58DrejqF_0 2024-09-12T01:01:31.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.549+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8548887613553375670', time=2024-09-12T02:57:06.769921+0000, chain.objs.size()=1 2024-09-12T01:01:31.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.553+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34__shadow_.0IzlFqpemIP2iiZkWhvOPFfnTeX7xgR_0 2024-09-12T01:01:31.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.553+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6104500851375105135', time=2024-09-12T02:57:07.452675+0000, chain.objs.size()=1 2024-09-12T01:01:31.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.553+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34__shadow_.E1JS6q3q9ZsEkDe3fOurepvJZon2EXV_0 2024-09-12T01:01:31.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.553+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17741991720304131937', time=2024-09-12T02:57:40.172554+0000, chain.objs.size()=1 2024-09-12T01:01:31.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.553+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35__shadow_.92A5PfxKFntPeKLgsrBQteZxyKyiFsg_0 2024-09-12T01:01:31.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.553+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.582557582594589067', time=2024-09-12T02:57:40.175945+0000, chain.objs.size()=1 2024-09-12T01:01:31.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.553+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35__shadow_.WqfTsKvGqZhFagS70STocF0XqHV-88S_0 2024-09-12T01:01:31.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.553+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6966691522510920815', time=2024-09-12T02:58:16.462183+0000, chain.objs.size()=1 2024-09-12T01:01:31.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.553+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38__shadow_.EqxFqtQOloNdK8jgcIiN-qF7T-4mWTU_0 2024-09-12T01:01:31.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.553+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5036974413985077204', time=2024-09-12T03:01:08.344355+0000, chain.objs.size()=1 2024-09-12T01:01:31.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.553+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19__shadow:pm3O2EV4oT1McgnhsOqqrbpodIgQv3z_.diLsXkzr0hfLWRGZ48QI9WygzT1QGWz_0 2024-09-12T01:01:31.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.553+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8756028581573483275', time=2024-09-12T03:01:08.346347+0000, chain.objs.size()=1 2024-09-12T01:01:31.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.553+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19__shadow:jxYn3G9wzKQn43iZDA-5zOz-E4J-qCl_.55wHIUu69f-p1tE77Q0wO29A-R_tx4A_0 2024-09-12T01:01:31.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.557+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:01:31.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T01:01:31.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1629336751816850570', time=2024-09-12T02:54:10.510327+0000, chain.objs.size()=1 2024-09-12T01:01:31.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20__shadow_.7A7tMQAPzTFk-kuaMs1-vBcjqCVo7GM_0 2024-09-12T01:01:31.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5214380515201010357', time=2024-09-12T02:54:44.223751+0000, chain.objs.size()=1 2024-09-12T01:01:31.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22__shadow_.YJXnTtpmpfUAAg__8n-94CTJbyH6_yC_0 2024-09-12T01:01:31.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.905032216393074551', time=2024-09-12T02:54:44.228642+0000, chain.objs.size()=1 2024-09-12T01:01:31.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22__shadow_.WxFHRAw_UvNxI7Iu9Fb2DVpxEyAIvUI_0 2024-09-12T01:01:31.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4084456053387229656', time=2024-09-12T02:54:44.231689+0000, chain.objs.size()=1 2024-09-12T01:01:31.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22__shadow_.wBbYEIFh0hk9-pYyLP5QGdHjvwEhv72_0 2024-09-12T01:01:31.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14000546658568664157', time=2024-09-12T02:54:44.234943+0000, chain.objs.size()=1 2024-09-12T01:01:31.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22__shadow_.d2p5etKyo0qcgwBiUdh_ihbjjh1Wx6X_0 2024-09-12T01:01:31.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8790172951860596936', time=2024-09-12T02:54:46.309607+0000, chain.objs.size()=1 2024-09-12T01:01:31.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23__shadow_.Z1ejOzlumAh2hNG0NAlkWTCckFi81ZK_0 2024-09-12T01:01:31.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17834677659471254313', time=2024-09-12T02:54:47.790722+0000, chain.objs.size()=1 2024-09-12T01:01:31.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24__shadow_.np3HaRSZKFwcjgZgNCASAi4Sryd0Dam_0 2024-09-12T01:01:31.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14081528041656070727', time=2024-09-12T02:55:20.265120+0000, chain.objs.size()=1 2024-09-12T01:01:31.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25__shadow_._5uW8mI5pG72-hUCeY7MAlHJIwvmWC1_0 2024-09-12T01:01:31.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11647670955239582485', time=2024-09-12T02:55:21.938611+0000, chain.objs.size()=1 2024-09-12T01:01:31.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26__shadow_.HfXk6ydUN8qj2CqrIHNStJDJ992ZCjN_0 2024-09-12T01:01:31.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15640514053028595269', time=2024-09-12T02:55:21.951467+0000, chain.objs.size()=1 2024-09-12T01:01:31.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26__shadow_.9cSWTDvdEF_v1pKbbwNuXMLyBKZ5Q-d_0 2024-09-12T01:01:31.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1281866975841770847', time=2024-09-12T02:56:31.618918+0000, chain.objs.size()=1 2024-09-12T01:01:31.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31__shadow_.Y6EzqLaEqsHZoYfPHuLQngVQWKbIAIq_0 2024-09-12T01:01:31.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16667714301704629024', time=2024-09-12T02:56:32.847382+0000, chain.objs.size()=1 2024-09-12T01:01:31.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.565+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32__shadow_.LrknZZmH6qyfe-LAZsZK6mPXwuedOVa_0 2024-09-12T01:01:31.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.569+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4763087495486300555', time=2024-09-12T02:57:40.197422+0000, chain.objs.size()=1 2024-09-12T01:01:31.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.569+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35__shadow_.6vvLQisIkztRtAw3i2vNVSmQbgyyAxS_0 2024-09-12T01:01:31.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.569+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1966340671448576641', time=2024-09-12T02:58:14.337702+0000, chain.objs.size()=1 2024-09-12T01:01:31.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.569+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37__shadow_.NY0d1-UK_d__krW-Kzd0iw6G0AudBty_0 2024-09-12T01:01:31.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.569+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3354147965696677105', time=2024-09-12T02:58:16.484044+0000, chain.objs.size()=1 2024-09-12T01:01:31.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.569+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38__shadow_.n2XYBjrl9gnuuV9SUtZMlo24V9J9dW3_0 2024-09-12T01:01:31.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.569+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14030414545845898335', time=2024-09-12T02:58:17.727888+0000, chain.objs.size()=1 2024-09-12T01:01:31.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.569+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39__shadow_.TiJiQuSI0xBQTwbocmt_s--9XReqe-q_0 2024-09-12T01:01:31.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.569+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14733493040760897488', time=2024-09-12T02:58:17.744901+0000, chain.objs.size()=1 2024-09-12T01:01:31.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.569+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39__shadow_.vpU9SA7fxSuWv6zworTlKMtJkRbJ5zK_0 2024-09-12T01:01:31.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.569+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6919900371730302174', time=2024-09-12T03:00:56.529850+0000, chain.objs.size()=1 2024-09-12T01:01:31.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.569+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18__shadow_.lGbcB-B0gaf6CRG9KIvh6wwDigHZCXv_0 2024-09-12T01:01:31.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.573+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.577+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:01:31.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.577+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.577+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.577+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T01:01:31.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.577+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17850917356400394834', time=2024-09-12T02:52:53.367382+0000, chain.objs.size()=1 2024-09-12T01:01:31.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.577+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16__shadow_.tbh4rDFjapnGCjrjU7hp0rlC-6Y7tGg_0 2024-09-12T01:01:31.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.577+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16867643948170622502', time=2024-09-12T02:52:53.445087+0000, chain.objs.size()=3 2024-09-12T01:01:31.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.577+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-FROZEN.2~kk6D8u9Aevg_gComp_eamoMf75fAjgg.1 2024-09-12T01:01:31.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.577+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-FROZEN.2~kk6D8u9Aevg_gComp_eamoMf75fAjgg.2 2024-09-12T01:01:31.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.577+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-FROZEN.2~kk6D8u9Aevg_gComp_eamoMf75fAjgg.3 2024-09-12T01:01:31.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.581+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13098655859525934196', time=2024-09-12T02:52:53.747442+0000, chain.objs.size()=1 2024-09-12T01:01:31.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.581+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8__shadow_.jIrpme9nyp1zLT3Ncp6IZLczF1LgfOw_0 2024-09-12T01:01:31.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.581+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13198035173202879829', time=2024-09-12T02:54:46.308314+0000, chain.objs.size()=1 2024-09-12T01:01:31.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.581+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23__shadow_.ApMTY9y6Ll-37k5-Gwl9c_rdWkfz4lv_0 2024-09-12T01:01:31.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.581+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17071109789142752820', time=2024-09-12T02:54:46.311861+0000, chain.objs.size()=1 2024-09-12T01:01:31.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.581+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23__shadow_.r60M95Emq3jDUSr2Fya6qZLRsnYiP9l_0 2024-09-12T01:01:31.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.581+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10789563275175280117', time=2024-09-12T02:54:46.312687+0000, chain.objs.size()=1 2024-09-12T01:01:31.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.581+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23__shadow_.Dzkcs-j8K1DojyjnHxTy9KLOsUt5rRo_0 2024-09-12T01:01:31.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.581+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4301602614716051270', time=2024-09-12T02:54:46.313366+0000, chain.objs.size()=1 2024-09-12T01:01:31.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.581+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23__shadow_.cJi0a8R2VJkLM4V0puC2UlhEI4QVMBq_0 2024-09-12T01:01:31.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.581+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10646729109439186084', time=2024-09-12T02:55:21.967214+0000, chain.objs.size()=1 2024-09-12T01:01:31.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.581+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26__shadow_.2m80YADeoE39QewKEIZ04QvG6x6S-Si_0 2024-09-12T01:01:31.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.581+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12807183435629027432', time=2024-09-12T02:55:23.151368+0000, chain.objs.size()=1 2024-09-12T01:01:31.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.581+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27__shadow_.FHvotV5k81kfqqET8jak1SlcJGO4kJ7_0 2024-09-12T01:01:31.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.581+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8647987578223894610', time=2024-09-12T02:56:29.753413+0000, chain.objs.size()=1 2024-09-12T01:01:31.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.581+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30__shadow_.ns99OZbwoQ87vFJb88yyS_e1leiu7-z_0 2024-09-12T01:01:31.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.585+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2970080691011896025', time=2024-09-12T02:56:29.755911+0000, chain.objs.size()=1 2024-09-12T01:01:31.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.585+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30__shadow_.9bdq20xQUBjL8oEQn2fvtGtXFhD_GuM_0 2024-09-12T01:01:31.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.585+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10854897269876023067', time=2024-09-12T02:56:31.607264+0000, chain.objs.size()=1 2024-09-12T01:01:31.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.585+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31__shadow_.57huinAOknAl330_qvBGPoMDdNk2yVA_0 2024-09-12T01:01:31.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.585+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1092803791191152712', time=2024-09-12T02:56:32.842018+0000, chain.objs.size()=1 2024-09-12T01:01:31.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.585+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32__shadow_.-o7q8F0SiodZdO9IRDYQFqDkpdXTv5S_0 2024-09-12T01:01:31.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.585+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10622082008366042261', time=2024-09-12T02:57:07.445811+0000, chain.objs.size()=1 2024-09-12T01:01:31.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.585+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34__shadow_.l3-muiBrl3pzE-kE5mGSGVm7tnUJ7mZ_0 2024-09-12T01:01:31.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.585+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11260268550073560790', time=2024-09-12T02:57:07.448645+0000, chain.objs.size()=1 2024-09-12T01:01:31.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.585+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34__shadow_.lCYru0XNxP-zffkHukzPM5d70XU3Hmg_0 2024-09-12T01:01:31.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.585+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12856324104377928296', time=2024-09-12T02:57:42.295957+0000, chain.objs.size()=1 2024-09-12T01:01:31.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.585+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36__shadow_.wL1gHuEHSsQp24u33UZ0WgPJ6T6ii9z_0 2024-09-12T01:01:31.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.585+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5672945458932617946', time=2024-09-12T02:58:14.322322+0000, chain.objs.size()=1 2024-09-12T01:01:31.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.585+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37__shadow_.pJB3_jAB6Z5dKcPjAot6kEBNBhHP3yd_0 2024-09-12T01:01:31.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.585+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8055707601795347262', time=2024-09-12T02:58:16.475496+0000, chain.objs.size()=1 2024-09-12T01:01:31.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.585+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38__shadow_.2lTvHY7YBxz-5QQBYC8Eg11mwFUnCs-_0 2024-09-12T01:01:31.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.585+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14553571810636764464', time=2024-09-12T02:58:17.727364+0000, chain.objs.size()=1 2024-09-12T01:01:31.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.585+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39__shadow_.TuWc1n1VYTQ7fx563QTQeS_z0KIlz_p_0 2024-09-12T01:01:31.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.585+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17024164986852205676', time=2024-09-12T03:00:56.526889+0000, chain.objs.size()=1 2024-09-12T01:01:31.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.585+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18__shadow_.jt9KNACEUWYwtkSTGTyQGJfq1RM8tFB_0 2024-09-12T01:01:31.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.589+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.593+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:01:31.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.593+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.593+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.597+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T01:01:31.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.597+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13247872177563701367', time=2024-09-12T02:52:53.197111+0000, chain.objs.size()=4 2024-09-12T01:01:31.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.597+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13__multipart_foo.2~JbN7136mF67L8MVHNpDjFIb2WS-t0Kx.1 2024-09-12T01:01:31.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.597+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13__multipart_foo.2~JbN7136mF67L8MVHNpDjFIb2WS-t0Kx.2 2024-09-12T01:01:31.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.597+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13__multipart_foo.2~JbN7136mF67L8MVHNpDjFIb2WS-t0Kx.3 2024-09-12T01:01:31.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.597+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13__multipart_foo.2~JbN7136mF67L8MVHNpDjFIb2WS-t0Kx.4 2024-09-12T01:01:31.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.597+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1589900646205663534', time=2024-09-12T02:54:10.526817+0000, chain.objs.size()=1 2024-09-12T01:01:31.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.597+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20__shadow_.Nj1XfXckMNcgITQQrurcZbIVisuE3z0_0 2024-09-12T01:01:31.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.597+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16811206745049632471', time=2024-09-12T02:54:10.540734+0000, chain.objs.size()=1 2024-09-12T01:01:31.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.597+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20__shadow_.x9odu0JsGc5D5hm7AOvVY38btpIJ3K4_0 2024-09-12T01:01:31.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.597+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5594861320246549414', time=2024-09-12T02:54:11.731033+0000, chain.objs.size()=1 2024-09-12T01:01:31.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.597+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21__shadow_.U5fbSf6k0eCSHsR0LT-chIoIWcuKlpI_0 2024-09-12T01:01:31.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.597+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3003038522201133643', time=2024-09-12T02:54:11.751260+0000, chain.objs.size()=1 2024-09-12T01:01:31.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.597+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21__shadow_.rSX1H5M5Wf93M78cysELEpdhhyRtlT4_0 2024-09-12T01:01:31.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.597+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4610725138677197130', time=2024-09-12T02:54:46.304325+0000, chain.objs.size()=1 2024-09-12T01:01:31.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.597+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23__shadow_.vwkBm6u2KRWDngO7LyWYSP29K9jLoDH_0 2024-09-12T01:01:31.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.597+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4263762116974064047', time=2024-09-12T02:54:47.770001+0000, chain.objs.size()=1 2024-09-12T01:01:31.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.597+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24__shadow_.1BZdP00Il3Kivx4lWYEUnvt2I6F-KnB_0 2024-09-12T01:01:31.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.597+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12330255232702694465', time=2024-09-12T02:55:21.942285+0000, chain.objs.size()=1 2024-09-12T01:01:31.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.597+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26__shadow_.vVTOFIBvR4tE0ufWruTtoHbJA4PXMeb_0 2024-09-12T01:01:31.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.597+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8010428357906238694', time=2024-09-12T02:55:21.958560+0000, chain.objs.size()=1 2024-09-12T01:01:31.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.597+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26__shadow_.ruWAWULA9INqX3SqkAP3hVlG9Sx8_Vz_0 2024-09-12T01:01:31.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.601+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14379919978303003007', time=2024-09-12T02:56:30.969585+0000, chain.objs.size()=1 2024-09-12T01:01:31.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.601+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31__shadow_.tqdhhXyQFU_zwct1kmE4ESKvU5COOXc_0 2024-09-12T01:01:31.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.601+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16864522723767020664', time=2024-09-12T02:56:31.603451+0000, chain.objs.size()=1 2024-09-12T01:01:31.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.601+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31__shadow_.Dw0a7PMs7I4UM3u0TLGHZD0uNX0OHkk_0 2024-09-12T01:01:31.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.601+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14674063398838488835', time=2024-09-12T02:56:32.840446+0000, chain.objs.size()=1 2024-09-12T01:01:31.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.601+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32__shadow_.FlJvzXNhOSEa9gehemiWSfZecA8uA5n_0 2024-09-12T01:01:31.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.601+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14404730675960673176', time=2024-09-12T02:57:05.024463+0000, chain.objs.size()=1 2024-09-12T01:01:31.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.601+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33__shadow_.22fTjiAZG7O6GMMcpz8P4-t0YYTVsMx_0 2024-09-12T01:01:31.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.601+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.895910304488317289', time=2024-09-12T02:57:07.448706+0000, chain.objs.size()=1 2024-09-12T01:01:31.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.601+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34__shadow_.gZWtvRVHKLek7-dOn-jtofcS0EhFIVF_0 2024-09-12T01:01:31.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.601+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16845635590426754136', time=2024-09-12T02:58:14.307646+0000, chain.objs.size()=1 2024-09-12T01:01:31.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.601+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37__shadow_.wr_sDc4Dk3mr86J8Y3sWCMWF8dojcNO_0 2024-09-12T01:01:31.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.601+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8666375205106260179', time=2024-09-12T02:58:16.467973+0000, chain.objs.size()=1 2024-09-12T01:01:31.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.601+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38__shadow_.XtNmn3d4AK8nTGO6a71wIHVtmHFjNJh_0 2024-09-12T01:01:31.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.601+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15933137891505952002', time=2024-09-12T02:58:17.727682+0000, chain.objs.size()=1 2024-09-12T01:01:31.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.601+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39__shadow_.5LYYsHHrNKuNIgyegW6nQOjBuZjujZR_0 2024-09-12T01:01:31.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.605+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.609+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:01:31.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.609+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.613+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.613+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T01:01:31.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.613+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13179550444940031412', time=2024-09-12T02:52:53.132227+0000, chain.objs.size()=1 2024-09-12T01:01:31.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.613+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5__shadow_.PqcYjRnk76vsa9GBChgIO60xG6oKri0_0 2024-09-12T01:01:31.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.613+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8037190132740592407', time=2024-09-12T02:52:53.384686+0000, chain.objs.size()=1 2024-09-12T01:01:31.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.613+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16__shadow_.lYx_XDrDZpRxhJ5LYaFm9mzOmj4a7fF_0 2024-09-12T01:01:31.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.613+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14529082512191924793', time=2024-09-12T02:52:53.644967+0000, chain.objs.size()=2 2024-09-12T01:01:31.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.613+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14__shadow_.TQGkmJaMDrbFbhmnespkAsbREWIql61_0 2024-09-12T01:01:31.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.613+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14__shadow_.TQGkmJaMDrbFbhmnespkAsbREWIql61_1 2024-09-12T01:01:31.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.613+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15701120525199315146', time=2024-09-12T02:54:44.230231+0000, chain.objs.size()=1 2024-09-12T01:01:31.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.613+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22__shadow_.p01cO-SJLznmFmDE5-yeFERcZMOQRDW_0 2024-09-12T01:01:31.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.613+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10737819337657103709', time=2024-09-12T02:54:44.249403+0000, chain.objs.size()=1 2024-09-12T01:01:31.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.613+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22__shadow_.3sf7JQIiRHSy132ec_ec-xK20RrRKFj_0 2024-09-12T01:01:31.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.613+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15023773700691326060', time=2024-09-12T02:54:47.782569+0000, chain.objs.size()=1 2024-09-12T01:01:31.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.613+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24__shadow_.fKo0xvBoEvFEKstnwxf8a04-ZSnXlf7_0 2024-09-12T01:01:31.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.613+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2933108442735593485', time=2024-09-12T02:55:21.947075+0000, chain.objs.size()=1 2024-09-12T01:01:31.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.613+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26__shadow_.Ah2LPZNNdVn9upKr-qw4AFcJMtaO5Iy_0 2024-09-12T01:01:31.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.613+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1127053124857907654', time=2024-09-12T02:55:57.714363+0000, chain.objs.size()=1 2024-09-12T01:01:31.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.613+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29__shadow_.TFaxBDK6HZdOnZOpgfJrl4gONFTpdIi_0 2024-09-12T01:01:31.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.613+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10876936360498874316', time=2024-09-12T02:56:29.749939+0000, chain.objs.size()=1 2024-09-12T01:01:31.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.613+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30__shadow_.NljdzjGTMxynFDPOF5MRFr95S6nJRBP_0 2024-09-12T01:01:31.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.613+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1472564300962200168', time=2024-09-12T02:56:31.603418+0000, chain.objs.size()=1 2024-09-12T01:01:31.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.613+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31__shadow_.8eLPtRzbXj1NgGFqipRbgxiPvf7116__0 2024-09-12T01:01:31.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.613+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7870849897347097459', time=2024-09-12T02:58:16.483497+0000, chain.objs.size()=1 2024-09-12T01:01:31.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.613+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38__shadow_.CighDP5piIPyyiH1qRqVtTuZGUVihKo_0 2024-09-12T01:01:31.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.621+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.621+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:01:31.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.625+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.625+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.625+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T01:01:31.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.625+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10396800820548274664', time=2024-09-12T02:54:46.301084+0000, chain.objs.size()=1 2024-09-12T01:01:31.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.625+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23__shadow_.PZzCop3xe1VfnAAdOq46fqKYL8HwLwK_0 2024-09-12T01:01:31.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.625+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14878959683419961930', time=2024-09-12T02:54:47.773003+0000, chain.objs.size()=1 2024-09-12T01:01:31.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.625+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24__shadow_.j3AFZe6bZiJSjwrX0ysPJolez4BxW2z_0 2024-09-12T01:01:31.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.625+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16709617189546317542', time=2024-09-12T02:55:20.277780+0000, chain.objs.size()=1 2024-09-12T01:01:31.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.625+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25__shadow_.VeLM2xrpJ8Zyb_Or0ShYAeT3KD6b2_p_0 2024-09-12T01:01:31.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.625+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6064045357363834923', time=2024-09-12T02:55:21.941633+0000, chain.objs.size()=1 2024-09-12T01:01:31.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.625+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26__shadow_.gpNf2vZBjLYkOgNdDqaWDjB22shPyi6_0 2024-09-12T01:01:31.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.625+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14105214671004042623', time=2024-09-12T02:55:55.401093+0000, chain.objs.size()=1 2024-09-12T01:01:31.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.625+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28__shadow_.KRx0z1dYFCgujxaikwzW2kV-94qNW7x_0 2024-09-12T01:01:31.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.625+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11692233281872412021', time=2024-09-12T02:56:31.604712+0000, chain.objs.size()=1 2024-09-12T01:01:31.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.625+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31__shadow_.hBqcp2x3l-ey_RYUjHRcpRorMusThZb_0 2024-09-12T01:01:31.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.625+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2378685293642494778', time=2024-09-12T02:56:31.618927+0000, chain.objs.size()=1 2024-09-12T01:01:31.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.625+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31__shadow_.yamFfG2S_tdErpKXv1LVaUfu-33QfRu_0 2024-09-12T01:01:31.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.625+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16758494282679585386', time=2024-09-12T02:56:32.853512+0000, chain.objs.size()=1 2024-09-12T01:01:31.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.625+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32__shadow_.XVB6p-04YYJzldMMlYXVMR5i5S01AhT_0 2024-09-12T01:01:31.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.625+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6467612906833253985', time=2024-09-12T02:57:40.175067+0000, chain.objs.size()=1 2024-09-12T01:01:31.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.625+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35__shadow_.3ha1yAALtHAwbQqPKsCQKMHiQSlS-mS_0 2024-09-12T01:01:31.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.625+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9714012884879685623', time=2024-09-12T02:57:40.194746+0000, chain.objs.size()=1 2024-09-12T01:01:31.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.625+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35__shadow_.0lby6Q4vrg5ZBANuh2XTbrMhRc9tNfh_0 2024-09-12T01:01:31.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.625+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15669112531313006199', time=2024-09-12T02:58:14.329153+0000, chain.objs.size()=1 2024-09-12T01:01:31.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.625+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37__shadow_.nlf6ywx6gIjNI9WiectSTBuEiNMJ6DR_0 2024-09-12T01:01:31.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.629+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.633+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:01:31.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.637+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.637+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.637+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T01:01:31.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.637+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10554355494147963022', time=2024-09-12T02:52:53.830535+0000, chain.objs.size()=1 2024-09-12T01:01:31.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.637+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9__shadow_.YOdGzw2N_B0E_FcjrOyEahp_Y11EDAS_0 2024-09-12T01:01:31.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.637+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16904971096666805534', time=2024-09-12T02:54:44.238125+0000, chain.objs.size()=1 2024-09-12T01:01:31.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.637+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22__shadow_.Fnbc2r_IBSN6sxmZvPMzw2vzGLCQ3ve_0 2024-09-12T01:01:31.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.637+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7125948208332254230', time=2024-09-12T02:55:21.950222+0000, chain.objs.size()=1 2024-09-12T01:01:31.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.637+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26__shadow_.A72GeShB6WHlMuPSRjZbCluMAVTE97d_0 2024-09-12T01:01:31.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.637+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8766073325962972733', time=2024-09-12T02:55:21.962568+0000, chain.objs.size()=1 2024-09-12T01:01:31.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.637+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26__shadow_.vB_dQnQHS49SO2U7yUpFswH_2dD4Kxj_0 2024-09-12T01:01:31.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.637+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4025192973747472942', time=2024-09-12T02:55:23.160910+0000, chain.objs.size()=1 2024-09-12T01:01:31.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.637+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27__shadow_.rcsOVf16s4UG4ej4sCUX4CjdgBcqSAU_0 2024-09-12T01:01:31.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.637+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.893597502335296813', time=2024-09-12T02:55:57.730532+0000, chain.objs.size()=1 2024-09-12T01:01:31.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.637+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29__shadow_.Ccl_QU59UEJlSYAP1Fs8GAmnx6LGDAF_0 2024-09-12T01:01:31.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.637+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10845079215634385901', time=2024-09-12T02:56:31.612577+0000, chain.objs.size()=1 2024-09-12T01:01:31.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.637+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31__shadow_.QbXrFufSMwIQbSw-phmurwS4BaoQdhF_0 2024-09-12T01:01:31.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.637+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13745082265982097973', time=2024-09-12T02:56:31.617131+0000, chain.objs.size()=1 2024-09-12T01:01:31.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.637+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31__shadow_.sNVkcD3SZYSQrbXT1so1HCcVJccvxId_0 2024-09-12T01:01:31.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.637+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7986672087266059655', time=2024-09-12T02:57:40.192416+0000, chain.objs.size()=1 2024-09-12T01:01:31.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.637+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35__shadow_.z64-OOdrXcAeQ_ojAIqX8M4gQkcIVlj_0 2024-09-12T01:01:31.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.637+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6107591272032192335', time=2024-09-12T02:58:49.946202+0000, chain.objs.size()=1 2024-09-12T01:01:31.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.637+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40__shadow_.B4FvFadkcR6T78bsrkq0tblUHEmsXCY_0 2024-09-12T01:01:31.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.637+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14920634506713525042', time=2024-09-12T03:00:56.534070+0000, chain.objs.size()=1 2024-09-12T01:01:31.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.637+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18__shadow_.yQ5WEQTN7OOzCicygbXBNFi77brT8Cz_0 2024-09-12T01:01:31.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.641+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.645+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:01:31.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.649+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.649+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.649+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T01:01:31.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.649+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='_wXZcbg-xk7JXVjGj3uQ-fjqua3c5SqI', time=2024-09-12T02:52:53.469686+0000, chain.objs.size()=2 2024-09-12T01:01:31.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.649+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__shadow_.mvLzeNvHR6fPnT17KnE8DUr5zSHoEEY_0 2024-09-12T01:01:31.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.649+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__shadow_.mvLzeNvHR6fPnT17KnE8DUr5zSHoEEY_1 2024-09-12T01:01:31.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.649+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='_rLLNJZRbZlC8Vr1GCYBievHOP0C1eeK', time=2024-09-12T02:52:53.537711+0000, chain.objs.size()=1 2024-09-12T01:01:31.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.649+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__shadow_.TAQ9f0sw8GkctnecDMlNp2GqPmjKsZk_0 2024-09-12T01:01:31.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.649+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15851610192893270432', time=2024-09-12T02:54:11.754117+0000, chain.objs.size()=1 2024-09-12T01:01:31.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.649+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21__shadow_.GgdE6TP8CeC-cR6olDmoOtY3xs1S6o4_0 2024-09-12T01:01:31.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.649+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17958560172363471886', time=2024-09-12T02:54:45.424229+0000, chain.objs.size()=1 2024-09-12T01:01:31.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.649+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23__shadow_.-27EhrzYWg25_lTFo3HKWXTg4yZJUP-_0 2024-09-12T01:01:31.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.649+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8973494089669618061', time=2024-09-12T02:54:46.300084+0000, chain.objs.size()=1 2024-09-12T01:01:31.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.649+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23__shadow_.JVUKErCntP1qYsWA3Ee7SFVqGSCia_W_0 2024-09-12T01:01:31.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.649+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14612754569464578072', time=2024-09-12T02:54:47.776591+0000, chain.objs.size()=1 2024-09-12T01:01:31.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.649+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24__shadow_.il7-qAG7m5K3Y3cjXinX57OVliU1hcI_0 2024-09-12T01:01:31.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.649+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8176364648464490730', time=2024-09-12T02:55:20.268274+0000, chain.objs.size()=1 2024-09-12T01:01:31.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.649+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25__shadow_.56eJyPoJJ_uEqMayPgVZSeyQhTqYfrm_0 2024-09-12T01:01:31.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.649+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.72019517948926845', time=2024-09-12T02:55:20.275966+0000, chain.objs.size()=1 2024-09-12T01:01:31.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.649+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25__shadow_.b8cjVJnYdETKQhXHsTDh4axyqrGQEby_0 2024-09-12T01:01:31.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.653+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8990016114188330392', time=2024-09-12T02:55:23.158009+0000, chain.objs.size()=1 2024-09-12T01:01:31.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.653+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27__shadow_.xyQjRtbaLiykx8fnLm1JF92KxKp-w1i_0 2024-09-12T01:01:31.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.653+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3077943630066423289', time=2024-09-12T02:55:55.400482+0000, chain.objs.size()=1 2024-09-12T01:01:31.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.653+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28__shadow_.VgG3vwVoYLR8OY7vtGvo0hSap959_rG_0 2024-09-12T01:01:31.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.653+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11527209326816677917', time=2024-09-12T02:56:29.752852+0000, chain.objs.size()=1 2024-09-12T01:01:31.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.653+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30__shadow_.929MGpOno5LAGLjeQvuc9RK2S7z5bVF_0 2024-09-12T01:01:31.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.657+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7068511229932801466', time=2024-09-12T02:57:07.439945+0000, chain.objs.size()=1 2024-09-12T01:01:31.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.657+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34__shadow_.d423YsPKY3y88sb7vfLQa1jXy3Hfb5m_0 2024-09-12T01:01:31.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.657+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3803425592743636466', time=2024-09-12T02:57:42.255229+0000, chain.objs.size()=1 2024-09-12T01:01:31.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.657+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36__shadow_.AkdqQwN6mOitxidIUpQxBgxxxwvoH26_0 2024-09-12T01:01:31.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.661+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.665+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:01:31.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.669+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.669+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.669+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T01:01:31.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.669+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12345318604046130217', time=2024-09-12T02:52:53.169432+0000, chain.objs.size()=4 2024-09-12T01:01:31.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.669+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12__multipart_foo.2~SdGAWjDWW4Jrfo-zTyW_5b_RlyUJjX2.1 2024-09-12T01:01:31.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.669+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12__multipart_foo.2~SdGAWjDWW4Jrfo-zTyW_5b_RlyUJjX2.2 2024-09-12T01:01:31.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.669+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12__multipart_foo.2~SdGAWjDWW4Jrfo-zTyW_5b_RlyUJjX2.3 2024-09-12T01:01:31.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.669+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12__multipart_foo.2~SdGAWjDWW4Jrfo-zTyW_5b_RlyUJjX2.4 2024-09-12T01:01:31.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.669+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='_Gq53fD97oDKnsQwaFEVqcS3FGfGY4lk', time=2024-09-12T02:52:53.404236+0000, chain.objs.size()=1 2024-09-12T01:01:31.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.669+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16__shadow_.LOEWlZmF_Gq9M5F-wxHvegDQNfdmcj4_0 2024-09-12T01:01:31.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.669+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.151391738144291072', time=2024-09-12T02:55:20.266043+0000, chain.objs.size()=1 2024-09-12T01:01:31.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.669+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25__shadow_.vKidmUgn7Vc3jxrU7CcwDLid3ErP4Vb_0 2024-09-12T01:01:31.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.669+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18289411778077041209', time=2024-09-12T02:55:55.400820+0000, chain.objs.size()=1 2024-09-12T01:01:31.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.669+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28__shadow_.ovUaVDrNEAmK8nCE4A5XkxiXyeKONhn_0 2024-09-12T01:01:31.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.669+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17013360248494867265', time=2024-09-12T02:55:55.402804+0000, chain.objs.size()=1 2024-09-12T01:01:31.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.669+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28__shadow_.GyTaKLdKVMdcytdXegnMJo3RUAHZoTN_0 2024-09-12T01:01:31.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.669+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16068778727446727142', time=2024-09-12T02:55:55.404470+0000, chain.objs.size()=1 2024-09-12T01:01:31.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.669+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28__shadow_.R27FGglkFuD_AdzQ1IPV1sZsGe--7Fx_0 2024-09-12T01:01:31.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.669+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6383087782923101927', time=2024-09-12T02:55:57.722478+0000, chain.objs.size()=1 2024-09-12T01:01:31.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.669+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29__shadow_.aUWeWtJpheRCv4MJAO7TNkBa9Xpxy_X_0 2024-09-12T01:01:31.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.669+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11143451940742265643', time=2024-09-12T02:55:57.732917+0000, chain.objs.size()=1 2024-09-12T01:01:31.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.669+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29__shadow_.YMyVWm5kM9oYcrUYYf1PYJF9K3dA57W_0 2024-09-12T01:01:31.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.669+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15115705489239315290', time=2024-09-12T02:56:32.876728+0000, chain.objs.size()=1 2024-09-12T01:01:31.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.669+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32__shadow_.OZ9seIC6gT3DvDbYQGRT1xwktGZkJiK_0 2024-09-12T01:01:31.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.673+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13936071191599071965', time=2024-09-12T02:57:05.021032+0000, chain.objs.size()=1 2024-09-12T01:01:31.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.673+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33__shadow_.15_5BgzvPrsTOnTNVuHbpq1Ohhl-IL7_0 2024-09-12T01:01:31.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.673+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10425743753610345888', time=2024-09-12T02:57:07.445937+0000, chain.objs.size()=1 2024-09-12T01:01:31.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.673+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34__shadow_.uUdYI8UIwh2sawBifbGi25lmu-fz8NT_0 2024-09-12T01:01:31.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.673+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2515038333076054615', time=2024-09-12T02:57:42.267494+0000, chain.objs.size()=1 2024-09-12T01:01:31.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.673+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36__shadow_.EEDlXVmYJQak_sWxGi4ZWd_bENYzrpF_0 2024-09-12T01:01:31.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.673+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9109477202822610959', time=2024-09-12T02:57:42.300051+0000, chain.objs.size()=1 2024-09-12T01:01:31.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.673+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36__shadow_.ktaQw0nHOMnk2pg6tKLMcLWdupXsBNQ_0 2024-09-12T01:01:31.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.673+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15207410939829543326', time=2024-09-12T03:00:56.530324+0000, chain.objs.size()=1 2024-09-12T01:01:31.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.673+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18__shadow_.AejNySE3snQ4Hx_1HSwlNgGJAjjb_af_0 2024-09-12T01:01:31.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.677+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.681+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:01:31.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.685+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.685+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.685+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T01:01:31.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.685+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='_yOeFoUl3cYHPCxwMgr3Xqp2xqh9vlGq', time=2024-09-12T02:52:53.328771+0000, chain.objs.size()=1 2024-09-12T01:01:31.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.685+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16__shadow_.3UYobEYtSPdgeFBU5dQaJYuwpkOkHaQ_0 2024-09-12T01:01:31.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.685+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11016226772527220143', time=2024-09-12T02:52:53.767030+0000, chain.objs.size()=1 2024-09-12T01:01:31.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.685+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8__shadow_.Pk9KwJ-NfW1utdxILT2arEEpdbxNJ9r_0 2024-09-12T01:01:31.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.685+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.772248625510183065', time=2024-09-12T02:54:11.744804+0000, chain.objs.size()=1 2024-09-12T01:01:31.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.685+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21__shadow_.LC7KyR72dKOFtkdaEHcoreg_LFGk3B-_0 2024-09-12T01:01:31.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.685+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3276542874231693801', time=2024-09-12T02:54:44.213164+0000, chain.objs.size()=1 2024-09-12T01:01:31.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.685+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22__shadow_.AgIMWiAl8V8UV0NjrzOR4025FY2f6T4_0 2024-09-12T01:01:31.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.689+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1027929271392366348', time=2024-09-12T02:54:46.323439+0000, chain.objs.size()=1 2024-09-12T01:01:31.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.689+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23__shadow_.qV4aFqEpeTLGEB8xNdfJoPeqrZ-iBhQ_0 2024-09-12T01:01:31.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.689+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5269222131927821911', time=2024-09-12T02:54:47.767219+0000, chain.objs.size()=1 2024-09-12T01:01:31.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.689+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24__shadow_.k8KhfL2sFRWyY2MO0s_Q4J5XurAX7pN_0 2024-09-12T01:01:31.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.689+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7455552457735118550', time=2024-09-12T02:54:47.784072+0000, chain.objs.size()=1 2024-09-12T01:01:31.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.689+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24__shadow_.ZhpSCnbm2UTWXPIzgjdhj_x75hHHGsS_0 2024-09-12T01:01:31.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.689+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18440098468200056980', time=2024-09-12T02:55:20.257619+0000, chain.objs.size()=1 2024-09-12T01:01:31.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.689+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25__shadow_.gbpQ0RpaY4LdPCVhelUPJcgAuQqErDb_0 2024-09-12T01:01:31.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.689+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10089932489157786004', time=2024-09-12T02:55:21.520319+0000, chain.objs.size()=1 2024-09-12T01:01:31.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.689+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26__shadow_.6ZYS3QPWeYfmgbM6L8vIWChOjvGudx3_0 2024-09-12T01:01:31.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.689+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11304479000167147658', time=2024-09-12T02:55:23.169895+0000, chain.objs.size()=1 2024-09-12T01:01:31.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.689+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27__shadow_.a39U4qzs-R48JxJtGMYm24JClm9cWuD_0 2024-09-12T01:01:31.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.689+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8245803156486303764', time=2024-09-12T02:55:57.721132+0000, chain.objs.size()=1 2024-09-12T01:01:31.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.689+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29__shadow_.sdpg6LlcZkiSnwitr0aGmR3_YELd03f_0 2024-09-12T01:01:31.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.689+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9716776393690296280', time=2024-09-12T02:55:57.732678+0000, chain.objs.size()=1 2024-09-12T01:01:31.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.689+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29__shadow_.9Eu_GpMrsaKBBX_Jo4MuaD9fhH_rFCg_0 2024-09-12T01:01:31.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.693+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7451496505841792155', time=2024-09-12T02:56:29.753291+0000, chain.objs.size()=1 2024-09-12T01:01:31.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.693+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30__shadow_.aXd4ReTDX76A0kmtUctYG_zWJrAdrzl_0 2024-09-12T01:01:31.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.693+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3472374948098064485', time=2024-09-12T02:56:29.762738+0000, chain.objs.size()=1 2024-09-12T01:01:31.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.693+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30__shadow_.Zhenju6e8ivQinBSeaFxJtXhtijKF7S_0 2024-09-12T01:01:31.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.693+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7782575052960749965', time=2024-09-12T02:56:31.607043+0000, chain.objs.size()=1 2024-09-12T01:01:31.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.693+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31__shadow_.92z5-f95aJL-OR_KLcweoKvrd8VSKlh_0 2024-09-12T01:01:31.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.693+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9409257315974986877', time=2024-09-12T02:56:32.841539+0000, chain.objs.size()=1 2024-09-12T01:01:31.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.693+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32__shadow_.dJMPA4Uf6vRg5HrwJg-uq1-WZWU69kk_0 2024-09-12T01:01:31.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.693+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9431397822306731051', time=2024-09-12T02:57:05.025870+0000, chain.objs.size()=1 2024-09-12T01:01:31.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.693+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33__shadow_.2vbMofKul6HR0KKmx9H1-Fsb0TNOCXv_0 2024-09-12T01:01:31.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.693+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17392085375282440795', time=2024-09-12T02:57:05.028162+0000, chain.objs.size()=1 2024-09-12T01:01:31.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.693+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33__shadow_.Jz433mDz1j6PzH-Wg7L0XnbmMfaesHQ_0 2024-09-12T01:01:31.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.693+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10529129313135132778', time=2024-09-12T02:57:07.430485+0000, chain.objs.size()=1 2024-09-12T01:01:31.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.693+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34__shadow_.9cP0j7VLurXXCXa9-x04A_E_RWzhEtS_0 2024-09-12T01:01:31.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.693+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6796483917976413279', time=2024-09-12T02:57:40.173204+0000, chain.objs.size()=1 2024-09-12T01:01:31.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.693+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35__shadow_.OHKVgJ7Z--NWBm2MvXtvaPh4taNuppo_0 2024-09-12T01:01:31.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.693+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5234436743492956403', time=2024-09-12T02:57:40.196424+0000, chain.objs.size()=1 2024-09-12T01:01:31.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.693+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35__shadow_.ZdYsG-t-V9apmL03yZFq-PPPPDi3CZs_0 2024-09-12T01:01:31.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.693+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10400115526152689990', time=2024-09-12T02:57:42.279625+0000, chain.objs.size()=1 2024-09-12T01:01:31.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.693+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36__shadow_.DOwcBEMMvdd_CAnJvIZJ1RJTF20KSCw_0 2024-09-12T01:01:31.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.693+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9777526602361336353', time=2024-09-12T02:58:16.458979+0000, chain.objs.size()=1 2024-09-12T01:01:31.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.693+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38__shadow_.j4L9zHwoTfL1EKViSzaIz4vqHJD9uyT_0 2024-09-12T01:01:31.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.697+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6839258461219521744', time=2024-09-12T02:58:16.477681+0000, chain.objs.size()=1 2024-09-12T01:01:31.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.697+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38__shadow_.tpIgHTwpaea3k1LHV9vvjL5GDVzHxta_0 2024-09-12T01:01:31.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.697+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15308174895226153346', time=2024-09-12T02:58:17.737600+0000, chain.objs.size()=1 2024-09-12T01:01:31.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.697+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39__shadow_.E5SsBS2hqbOVyo22XLqi3v1D3OJHteg_0 2024-09-12T01:01:31.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.697+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10493143729647027406', time=2024-09-12T02:58:17.739800+0000, chain.objs.size()=1 2024-09-12T01:01:31.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.697+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39__shadow_.VP0IE0g6Q0Bt1e9z5a8v-SohQw2qk82_0 2024-09-12T01:01:31.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.701+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.705+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:01:31.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.705+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.709+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.709+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T01:01:31.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.709+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='_GXqCTUVblKyKb9kJ-wlsL_zEcbV1Ca0', time=2024-09-12T02:52:53.358647+0000, chain.objs.size()=1 2024-09-12T01:01:31.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.709+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16__shadow_.eOZSJxihxAOygIZVINk1SNYJFHGQFGW_0 2024-09-12T01:01:31.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.709+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='_vYFNOtmyNKJ-tNgZbpaTeIxuEBIddv4', time=2024-09-12T02:52:53.376159+0000, chain.objs.size()=1 2024-09-12T01:01:31.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.709+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16__shadow_.fYcSgKuT_4-DP59vRT-h662PqxkGceX_0 2024-09-12T01:01:31.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.709+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1169328827368255590', time=2024-09-12T02:52:53.454608+0000, chain.objs.size()=3 2024-09-12T01:01:31.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.709+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-FROZEN.2~kk6D8u9Aevg_gComp_eamoMf75fAjgg.1 2024-09-12T01:01:31.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.709+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-FROZEN.2~kk6D8u9Aevg_gComp_eamoMf75fAjgg.2 2024-09-12T01:01:31.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.709+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-FROZEN.2~kk6D8u9Aevg_gComp_eamoMf75fAjgg.3 2024-09-12T01:01:31.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.709+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10842339026531194371', time=2024-09-12T02:54:44.238375+0000, chain.objs.size()=1 2024-09-12T01:01:31.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.709+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22__shadow_.Ws5NwOEH_vGyyuElxqYt5FHgy46K7GM_0 2024-09-12T01:01:31.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.709+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15778288230952018228', time=2024-09-12T02:55:23.139348+0000, chain.objs.size()=1 2024-09-12T01:01:31.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.709+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27__shadow_.9_f1J4Jvflz7hXK5IZdLEPTVX7oezm8_0 2024-09-12T01:01:31.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.709+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16952092537312113287', time=2024-09-12T02:55:23.156187+0000, chain.objs.size()=1 2024-09-12T01:01:31.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.709+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27__shadow_.qMA-9QBIdaWur2tSvQjpoF8g5rhq3Vv_0 2024-09-12T01:01:31.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.709+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11785669564140364374', time=2024-09-12T02:55:23.166454+0000, chain.objs.size()=1 2024-09-12T01:01:31.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.709+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27__shadow_.1VxwXWRHyygtdh_FZMlWshsqzpDGU5h_0 2024-09-12T01:01:31.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.709+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4723981166487211170', time=2024-09-12T02:55:55.398663+0000, chain.objs.size()=1 2024-09-12T01:01:31.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.709+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28__shadow_.wJlJ6l4rqAgkEsAt9Xd84SEl8AhlC3K_0 2024-09-12T01:01:31.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.709+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13657222329420772344', time=2024-09-12T02:55:55.411687+0000, chain.objs.size()=1 2024-09-12T01:01:31.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.709+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28__shadow_.kV0IOyLraZsMZxFXm9DoFMaPf4-XW66_0 2024-09-12T01:01:31.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.709+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.259367534790141651', time=2024-09-12T02:57:42.296917+0000, chain.objs.size()=1 2024-09-12T01:01:31.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.709+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36__shadow_.58E1KF7jH3xsRz-H9d8HLRmTm5q8DJ3_0 2024-09-12T01:01:31.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.713+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15173121879551908337', time=2024-09-12T02:57:43.486972+0000, chain.objs.size()=1 2024-09-12T01:01:31.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.713+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37__shadow_.ly8iCoSaFbwmRuf38W-tcopQcZ2TAq5_0 2024-09-12T01:01:31.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.713+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13287760061435204631', time=2024-09-12T02:58:14.323941+0000, chain.objs.size()=1 2024-09-12T01:01:31.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.713+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37__shadow_.ea7dW10xsV-xW7X3vf9JNLTHpgK223r_0 2024-09-12T01:01:31.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.717+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.737403238060161190', time=2024-09-12T02:58:49.968913+0000, chain.objs.size()=1 2024-09-12T01:01:31.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.717+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40__shadow_.KhuzSLv9eO_CbBlNv1MArvKo6LTskWP_0 2024-09-12T01:01:31.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.717+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2710656135789726318', time=2024-09-12T02:58:49.980984+0000, chain.objs.size()=1 2024-09-12T01:01:31.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.717+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40__shadow_.qaLZ_L9H36cfd_9Ef-PS5PwZglPryxt_0 2024-09-12T01:01:31.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.717+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.721+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:01:31.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.725+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.725+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.729+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T01:01:31.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.729+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15804083364292398545', time=2024-09-12T02:54:11.732637+0000, chain.objs.size()=1 2024-09-12T01:01:31.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.729+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21__shadow_.lc7Ec3kR5bQsI0evwspjVrldh8i9ZKQ_0 2024-09-12T01:01:31.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.729+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7756234239755228736', time=2024-09-12T02:54:46.295983+0000, chain.objs.size()=1 2024-09-12T01:01:31.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.729+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23__shadow_.Eq18EB8mVTAZOYF_T9VMpWQ_D_TvaV3_0 2024-09-12T01:01:31.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.729+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2303601391331989711', time=2024-09-12T02:54:46.319780+0000, chain.objs.size()=1 2024-09-12T01:01:31.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.729+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23__shadow_.RS4b0Jf_LZxZwQqUbCuNX-tdMjKvANd_0 2024-09-12T01:01:31.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.729+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10279365939394025846', time=2024-09-12T02:55:20.249249+0000, chain.objs.size()=1 2024-09-12T01:01:31.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.729+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25__shadow_.UNEnwc0t4thN29KdH25ATSiMM-wWdiQ_0 2024-09-12T01:01:31.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.729+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.690558423390705726', time=2024-09-12T02:55:21.936444+0000, chain.objs.size()=1 2024-09-12T01:01:31.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.729+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26__shadow_.Rg9nHwNleWxEASCBW8Bsm--fYJtSbsV_0 2024-09-12T01:01:31.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.729+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.808124957060242515', time=2024-09-12T02:55:21.950367+0000, chain.objs.size()=1 2024-09-12T01:01:31.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.729+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26__shadow_.9TFQiBxfpp4Czqjh_EgCWOlg6wHsy50_0 2024-09-12T01:01:31.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.729+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6134660446523906633', time=2024-09-12T02:55:23.156559+0000, chain.objs.size()=1 2024-09-12T01:01:31.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.729+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27__shadow_.9qaRuaEOsE377nQONon8gErkDU5ZE0u_0 2024-09-12T01:01:31.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.729+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10809061836254556605', time=2024-09-12T02:55:55.402629+0000, chain.objs.size()=1 2024-09-12T01:01:31.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.729+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28__shadow_.Je19db9VwoXVSyEeRZm-E5DA-fmkzCn_0 2024-09-12T01:01:31.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.729+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13818030930067055222', time=2024-09-12T02:56:31.600388+0000, chain.objs.size()=1 2024-09-12T01:01:31.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.729+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31__shadow_.YGLMBJGSsNjdRczqIvOC0zoY38lspSC_0 2024-09-12T01:01:31.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.729+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12500448996596799222', time=2024-09-12T02:56:32.868173+0000, chain.objs.size()=1 2024-09-12T01:01:31.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.729+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32__shadow_.EblfN3CASCavQtiVulsJ55D_CgGf70I_0 2024-09-12T01:01:31.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.729+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9548180316445813034', time=2024-09-12T02:57:04.354818+0000, chain.objs.size()=1 2024-09-12T01:01:31.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.729+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33__shadow_.-veGSd_jTpFatvV4S6AcnfKD4Tef8Aw_0 2024-09-12T01:01:31.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.729+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11199911847238044790', time=2024-09-12T02:57:05.018357+0000, chain.objs.size()=1 2024-09-12T01:01:31.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.729+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33__shadow_.OiP98ucd7lKOsGe8ns1X4DbRWGiN4Xv_0 2024-09-12T01:01:31.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.733+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.661561369022217996', time=2024-09-12T02:57:40.169827+0000, chain.objs.size()=1 2024-09-12T01:01:31.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.733+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35__shadow_.k9htqqxG3x9Ip02DKhAuLFvVWzBjqDL_0 2024-09-12T01:01:31.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.733+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9277906408544393841', time=2024-09-12T02:57:40.184796+0000, chain.objs.size()=1 2024-09-12T01:01:31.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.733+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35__shadow_.ZnvaZQYqdf80NwO5PDeZi-NGWgIHgRu_0 2024-09-12T01:01:31.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.733+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1516992221984177793', time=2024-09-12T02:58:14.312639+0000, chain.objs.size()=1 2024-09-12T01:01:31.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.733+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37__shadow_.wCUuxbKE5VN39KrS4NGWEKxOcjygRfG_0 2024-09-12T01:01:31.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.733+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11508405424151468310', time=2024-09-12T02:58:14.328777+0000, chain.objs.size()=1 2024-09-12T01:01:31.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.733+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37__shadow_.O5j-m4A1VXmf6JFAHrzjbPUc_dJW9c2_0 2024-09-12T01:01:31.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.733+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5557852255222480642', time=2024-09-12T02:58:16.465821+0000, chain.objs.size()=1 2024-09-12T01:01:31.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.733+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38__shadow_.PmuF3f68dWZUyFeBNVhISAdRxdUhPFB_0 2024-09-12T01:01:31.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.733+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11438130194118104280', time=2024-09-12T02:58:17.743785+0000, chain.objs.size()=1 2024-09-12T01:01:31.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.733+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39__shadow_.Oc3i2u6XLB8LPX0Gye-qdGn4vkXl42A_0 2024-09-12T01:01:31.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.737+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.741+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:01:31.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.741+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.745+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.745+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T01:01:31.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.745+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3807657173666510560', time=2024-09-12T02:52:53.074429+0000, chain.objs.size()=1 2024-09-12T01:01:31.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.745+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5__shadow_.7X2dpjtuDZaUtayGIk6Ov_OuAPkFHEG_0 2024-09-12T01:01:31.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.745+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13732457892508302789', time=2024-09-12T02:52:53.110444+0000, chain.objs.size()=1 2024-09-12T01:01:31.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.745+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5__shadow_.P4SI_oeVCyXxOm5P-xWYwBjEq1W3dPQ_0 2024-09-12T01:01:31.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.745+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13413920567645600003', time=2024-09-12T02:54:44.214988+0000, chain.objs.size()=1 2024-09-12T01:01:31.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.745+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22__shadow_.VcGOV_IvQ4aFlrclAoJVytaLJ8CNuRc_0 2024-09-12T01:01:31.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.745+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8681155278189902559', time=2024-09-12T02:54:46.301325+0000, chain.objs.size()=1 2024-09-12T01:01:31.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.745+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23__shadow_.V7q_IzEypu0VwcQly2PHrc_mFk28t1-_0 2024-09-12T01:01:31.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.745+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11769621209501586153', time=2024-09-12T02:55:20.260877+0000, chain.objs.size()=1 2024-09-12T01:01:31.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.745+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25__shadow_.yfqBgRDaHGI2MqWRD7A_guL3vLAGBGh_0 2024-09-12T01:01:31.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.745+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11275257948616375698', time=2024-09-12T02:55:56.863722+0000, chain.objs.size()=1 2024-09-12T01:01:31.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.745+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29__shadow_.mqVfL21JF3SDX39z21bNrfORo6OD2mt_0 2024-09-12T01:01:31.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.745+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13216768019373083766', time=2024-09-12T02:56:31.613000+0000, chain.objs.size()=1 2024-09-12T01:01:31.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.745+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31__shadow_.65brni9K2lKV58dS-DPUhO1FwLu0ku__0 2024-09-12T01:01:31.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.745+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2727974582326488647', time=2024-09-12T02:56:32.845903+0000, chain.objs.size()=1 2024-09-12T01:01:31.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.745+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32__shadow_.zpap811MFm0wa_sZiASD4Qj-hZ31ca7_0 2024-09-12T01:01:31.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.745+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14031866818797345857', time=2024-09-12T02:57:05.023120+0000, chain.objs.size()=1 2024-09-12T01:01:31.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.745+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33__shadow_.d6rexd5A5X5tacq6XvE2NihZZvhadbc_0 2024-09-12T01:01:31.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.749+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.753+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:01:31.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.757+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.757+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.757+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-12T01:01:31.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.757+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5320956001963874655', time=2024-09-12T02:54:10.506528+0000, chain.objs.size()=1 2024-09-12T01:01:31.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.757+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20__shadow_.PPDZ9yckqB222A8Zvqj0iWQk2g4R8aS_0 2024-09-12T01:01:31.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.757+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18007486758939696827', time=2024-09-12T02:54:11.737808+0000, chain.objs.size()=1 2024-09-12T01:01:31.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.757+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21__shadow_.kmxu3pdGdncOkiNqq9p5NLkm0Vuk-nF_0 2024-09-12T01:01:31.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.757+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6314946955737609498', time=2024-09-12T02:54:11.750075+0000, chain.objs.size()=1 2024-09-12T01:01:31.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.757+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21__shadow_._71gBkrcXjaJgrWT2Mzn-4AapunHWoq_0 2024-09-12T01:01:31.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.757+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14846086218933520870', time=2024-09-12T02:54:44.221314+0000, chain.objs.size()=1 2024-09-12T01:01:31.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.757+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22__shadow_.OjGkySIBJnxmNS8KyRq7QbF9HW2Lfme_0 2024-09-12T01:01:31.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.757+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16508249336256860498', time=2024-09-12T02:54:44.223888+0000, chain.objs.size()=1 2024-09-12T01:01:31.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.757+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22__shadow_.fpnMmS10DUCM8vDG-sLHnMcmPxwNNtl_0 2024-09-12T01:01:31.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.757+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7494707878594563515', time=2024-09-12T02:54:46.312081+0000, chain.objs.size()=1 2024-09-12T01:01:31.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.757+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23__shadow_.bKFVB-EntqJ2AVsWmUXAIwD5XnAPZ9-_0 2024-09-12T01:01:31.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.757+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.796010825399112837', time=2024-09-12T02:54:47.774597+0000, chain.objs.size()=1 2024-09-12T01:01:31.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.757+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24__shadow_.gweZDgQiDBnl2j6Blaum3Vmn9JgPq1A_0 2024-09-12T01:01:31.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.757+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10635336565847803907', time=2024-09-12T02:55:21.953009+0000, chain.objs.size()=1 2024-09-12T01:01:31.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.757+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26__shadow_.4CBy7KjQEP1Y-hnMamjkJ08SIeO10W5_0 2024-09-12T01:01:31.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.757+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11359788138480113189', time=2024-09-12T02:55:23.141441+0000, chain.objs.size()=1 2024-09-12T01:01:31.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.757+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27__shadow_.L-4TuL9gh6gfj3I3M6xKN80Mj4s5Vip_0 2024-09-12T01:01:31.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.757+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10949315105881094448', time=2024-09-12T02:55:23.168646+0000, chain.objs.size()=1 2024-09-12T01:01:31.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.757+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27__shadow_.HPoLJNa7Pw4c6qmN4y0acQBkYuoH7SM_0 2024-09-12T01:01:31.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.757+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1969212951157131748', time=2024-09-12T02:57:05.029041+0000, chain.objs.size()=1 2024-09-12T01:01:31.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.757+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33__shadow_.AeGQUKLP6my_pykG-lQOvhs_jKqdPzZ_0 2024-09-12T01:01:31.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.757+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8262451088956575485', time=2024-09-12T02:57:07.431774+0000, chain.objs.size()=1 2024-09-12T01:01:31.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.757+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34__shadow_.Tk__ofCXuQyJZJkVf8v9PjM7FwjVs4X_0 2024-09-12T01:01:31.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.761+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9885620820772167164', time=2024-09-12T02:57:07.444740+0000, chain.objs.size()=1 2024-09-12T01:01:31.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.761+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34__shadow_.-360j-RvW5D5Fpr4IxkIb83iT3OvXR6_0 2024-09-12T01:01:31.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.761+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15646398268695198591', time=2024-09-12T02:57:40.180701+0000, chain.objs.size()=1 2024-09-12T01:01:31.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.761+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35__shadow_.9vsM8gZwRstXqfBItHR6fgknG2vHXTf_0 2024-09-12T01:01:31.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.761+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15561551694032221969', time=2024-09-12T02:57:42.258554+0000, chain.objs.size()=1 2024-09-12T01:01:31.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.761+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36__shadow_.zafqljh_uTzRxWyv16189UcELcngOos_0 2024-09-12T01:01:31.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.761+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8283348089445943691', time=2024-09-12T02:58:14.311511+0000, chain.objs.size()=1 2024-09-12T01:01:31.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.761+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37__shadow_.vyhpdzezwY6BtE7e1CvHZEXAeFVyEwa_0 2024-09-12T01:01:31.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.761+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5604899733804686622', time=2024-09-12T02:58:16.465490+0000, chain.objs.size()=1 2024-09-12T01:01:31.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.761+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38__shadow_.m2OXFvCzWQGS_J1c8Iwcf1YQSlTiyBc_0 2024-09-12T01:01:31.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.761+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7357722241362528044', time=2024-09-12T02:58:16.469484+0000, chain.objs.size()=1 2024-09-12T01:01:31.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.761+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38__shadow_.JH1ezi2AjMoS4YjKu5wW2MyopU6qnV-_0 2024-09-12T01:01:31.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.761+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11101496641004521207', time=2024-09-12T02:58:16.475553+0000, chain.objs.size()=1 2024-09-12T01:01:31.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.761+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38__shadow_.sBqTbhZYlXECls99AsQ10SJc_tv5NyV_0 2024-09-12T01:01:31.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.761+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10740347134670475827', time=2024-09-12T02:58:17.722281+0000, chain.objs.size()=1 2024-09-12T01:01:31.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.761+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39__shadow_.i5TbsJq8aH4VTh-mSehZCyU5yKvJh8X_0 2024-09-12T01:01:31.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.761+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6237438652118026098', time=2024-09-12T02:58:17.751212+0000, chain.objs.size()=1 2024-09-12T01:01:31.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.761+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39__shadow_.8-8ILUpN96Ocvlnfh5rjCNh6mPwQ-Dd_0 2024-09-12T01:01:31.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.761+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9336248193309759513', time=2024-09-12T02:58:49.951070+0000, chain.objs.size()=1 2024-09-12T01:01:31.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.761+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40__shadow_.2eq0tEkVpGJThKUsjB-NOA70pLSaHwe_0 2024-09-12T01:01:31.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.761+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3115790183759704778', time=2024-09-12T03:00:56.520357+0000, chain.objs.size()=1 2024-09-12T01:01:31.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.761+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18__shadow_.U1pm60f9KKYJazoqdpM0Lfhpa4QNfAN_0 2024-09-12T01:01:31.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.765+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.773+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:01:31.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.773+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.773+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.773+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T01:01:31.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.773+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3025751644496200708', time=2024-09-12T02:52:53.413896+0000, chain.objs.size()=1 2024-09-12T01:01:31.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.773+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16__shadow_.lYx_XDrDZpRxhJ5LYaFm9mzOmj4a7fF_0 2024-09-12T01:01:31.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.773+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='_hsSv__iHHUwjgvX88Xiw2YDev5ZcFz7', time=2024-09-12T02:52:53.464587+0000, chain.objs.size()=2 2024-09-12T01:01:31.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.773+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__shadow_.1pDCtVwCS-3RqpTxGBME6sCQSCCdWSy_0 2024-09-12T01:01:31.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.773+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__shadow_.1pDCtVwCS-3RqpTxGBME6sCQSCCdWSy_1 2024-09-12T01:01:31.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.773+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4367089232274005736', time=2024-09-12T02:52:53.484669+0000, chain.objs.size()=3 2024-09-12T01:01:31.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.773+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-LUKEWARM.2~XZVlofY5U0WQ__CprNDClyfvtCdI_Gb.1 2024-09-12T01:01:31.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.773+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-LUKEWARM.2~XZVlofY5U0WQ__CprNDClyfvtCdI_Gb.2 2024-09-12T01:01:31.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.773+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-LUKEWARM.2~XZVlofY5U0WQ__CprNDClyfvtCdI_Gb.3 2024-09-12T01:01:31.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.773+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14533884258780104905', time=2024-09-12T02:52:53.653916+0000, chain.objs.size()=2 2024-09-12T01:01:31.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.773+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14__shadow_.UU_E3Qt2XI2eMKz59sgfz-r2j6V8ITX_0 2024-09-12T01:01:31.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.773+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14__shadow_.UU_E3Qt2XI2eMKz59sgfz-r2j6V8ITX_1 2024-09-12T01:01:31.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.773+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7082770029497094', time=2024-09-12T02:54:46.305808+0000, chain.objs.size()=1 2024-09-12T01:01:31.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.773+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23__shadow_.np8H8l4tO3u7QvrrLbsElKcPkgXzgdd_0 2024-09-12T01:01:31.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.773+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4914298278799903682', time=2024-09-12T02:55:20.273701+0000, chain.objs.size()=1 2024-09-12T01:01:31.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.773+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25__shadow_.N7VX3ZH3BQDQKwMGSU8lPBTyx3Doz7L_0 2024-09-12T01:01:31.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.773+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8537930744116429480', time=2024-09-12T02:55:21.972590+0000, chain.objs.size()=1 2024-09-12T01:01:31.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.773+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26__shadow_.GVPqlBbjtcD5DcbPCXnD4uB1GY5dW7m_0 2024-09-12T01:01:31.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.773+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16314163208176368733', time=2024-09-12T02:55:55.398445+0000, chain.objs.size()=1 2024-09-12T01:01:31.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.773+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28__shadow_.RSqqk1AYuGHbEJD9NzxdzzdrIDRfIC9_0 2024-09-12T01:01:31.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.777+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15974349563376782992', time=2024-09-12T02:55:57.727425+0000, chain.objs.size()=1 2024-09-12T01:01:31.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.777+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29__shadow_.Vy-IboZ-hhI_-7EyNiYu2GMT1DLfOYk_0 2024-09-12T01:01:31.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.777+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14323766590989415521', time=2024-09-12T02:55:57.738441+0000, chain.objs.size()=1 2024-09-12T01:01:31.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.777+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29__shadow_.KWh7Nap5h7X0lhbRexSswMoCiGflzNe_0 2024-09-12T01:01:31.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.781+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15039955387190729692', time=2024-09-12T02:56:29.745464+0000, chain.objs.size()=1 2024-09-12T01:01:31.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.781+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30__shadow_.KxujXMexDb7nKYbQDAer3oqCO9B_Xnh_0 2024-09-12T01:01:31.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.781+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8868556181524773396', time=2024-09-12T02:56:31.619017+0000, chain.objs.size()=1 2024-09-12T01:01:31.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.781+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31__shadow_.aSXl0K40ADragVELj6KVNwlkQ0XY-BH_0 2024-09-12T01:01:31.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.781+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16031778009756919181', time=2024-09-12T02:56:31.621610+0000, chain.objs.size()=1 2024-09-12T01:01:31.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.781+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31__shadow_.8n_Zef9sa9FI7iYRQOj8y2WP9TGBf-7_0 2024-09-12T01:01:31.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.781+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10497800829194695250', time=2024-09-12T02:56:32.850547+0000, chain.objs.size()=1 2024-09-12T01:01:31.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.781+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32__shadow_.hVpLY3EjluEBo388wUb1sAmJUw0YjZf_0 2024-09-12T01:01:31.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.781+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5098182978710354656', time=2024-09-12T02:56:32.867637+0000, chain.objs.size()=1 2024-09-12T01:01:31.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.781+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32__shadow_.hvhVVoo7pA9Yzu0DUP8eKvV3J4ppqM-_0 2024-09-12T01:01:31.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.781+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11367123815342959187', time=2024-09-12T02:57:42.284052+0000, chain.objs.size()=1 2024-09-12T01:01:31.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.781+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36__shadow_.AYYH24BJXdfGENwvvQzcdZ6tlJJ4jAJ_0 2024-09-12T01:01:31.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.781+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11764404628103365966', time=2024-09-12T02:58:16.468554+0000, chain.objs.size()=1 2024-09-12T01:01:31.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.781+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38__shadow_.l2f9AvRZ7NYmAXKCHbV1rqd04hK-0Q5_0 2024-09-12T01:01:31.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.781+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5703362509320744608', time=2024-09-12T02:58:17.743444+0000, chain.objs.size()=1 2024-09-12T01:01:31.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.781+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39__shadow_.mPXqeIH22h1M4MSPrqWxS9YtuOCaPBg_0 2024-09-12T01:01:31.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.781+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9374342534195326760', time=2024-09-12T02:58:49.947620+0000, chain.objs.size()=1 2024-09-12T01:01:31.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.781+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40__shadow_._cUDy93R-FMWeWKUnGZILb9xNS72tqh_0 2024-09-12T01:01:31.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.785+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.789+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:01:31.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.793+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.793+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.793+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:01:31.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.793+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15049077535320536784', time=2024-09-12T02:55:23.163598+0000, chain.objs.size()=1 2024-09-12T01:01:31.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.793+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27__shadow_.-BWejrYe7VGXasJtSa0B0UadIG71qvz_0 2024-09-12T01:01:31.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.793+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12167041779443990525', time=2024-09-12T02:55:55.395146+0000, chain.objs.size()=1 2024-09-12T01:01:31.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.793+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28__shadow_.SCzjJ5X4mMDO9tXteHrzfhxcvdGdV-5_0 2024-09-12T01:01:31.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.793+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2879457050217435322', time=2024-09-12T02:58:16.480767+0000, chain.objs.size()=1 2024-09-12T01:01:31.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.793+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38__shadow_.od46ayWBAvUl6GU0q_EbrHp2LhiiC89_0 2024-09-12T01:01:31.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.793+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5744832950701177998', time=2024-09-12T02:58:49.956661+0000, chain.objs.size()=1 2024-09-12T01:01:31.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.793+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40__shadow_.AxJNl8WtO776Bpxwpze16OuByTeZqWW_0 2024-09-12T01:01:31.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.793+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7784527178117654573', time=2024-09-12T03:01:08.346069+0000, chain.objs.size()=1 2024-09-12T01:01:31.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.793+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.19__shadow:0YNv-GaRIOrOCmeCBXx.Zo6gD39n6zV_.acM8wHtSj7DonjfKhCnFJeIUZvIxG23_0 2024-09-12T01:01:31.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.797+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.805+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:01:31.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.809+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.809+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.809+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T01:01:31.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.809+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13705481910946246879', time=2024-09-12T02:54:09.643824+0000, chain.objs.size()=1 2024-09-12T01:01:31.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.809+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20__shadow_.jMPPMX-WghJVolHRA8zZX0Lv3adK2Tp_0 2024-09-12T01:01:31.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.809+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16780016968163454213', time=2024-09-12T02:54:10.512352+0000, chain.objs.size()=1 2024-09-12T01:01:31.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.809+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20__shadow_.TcXLGKzMEDKKHWHZfWcgQmzu_ccowyy_0 2024-09-12T01:01:31.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.809+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15139646015418361729', time=2024-09-12T02:54:10.522040+0000, chain.objs.size()=1 2024-09-12T01:01:31.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.809+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20__shadow_.j-BI-na5FhA61mXk55jJwXeExWr2-Y5_0 2024-09-12T01:01:31.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.809+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4196618498803976210', time=2024-09-12T02:54:11.766569+0000, chain.objs.size()=1 2024-09-12T01:01:31.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.809+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21__shadow_._sHJQsUlll6mFbN_tRHDEbPpVhzttwA_0 2024-09-12T01:01:31.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.809+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2971289463181945171', time=2024-09-12T02:54:47.804313+0000, chain.objs.size()=1 2024-09-12T01:01:31.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.809+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24__shadow_.QDi1kwFL0gVS1KEwAUO8fPlQtKM9ZWW_0 2024-09-12T01:01:31.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.809+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15277134038906405632', time=2024-09-12T02:55:21.946408+0000, chain.objs.size()=1 2024-09-12T01:01:31.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.809+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26__shadow_.c0Mq2ahu2xZoKpRX-k4wDTpogjmqnRV_0 2024-09-12T01:01:31.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.809+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11150347148082180911', time=2024-09-12T02:55:23.146242+0000, chain.objs.size()=1 2024-09-12T01:01:31.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.809+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27__shadow_.RbtVxaEfLeloJKG0KeAFGECKlSO6lN9_0 2024-09-12T01:01:31.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.809+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8668871096705402076', time=2024-09-12T02:55:57.730615+0000, chain.objs.size()=1 2024-09-12T01:01:31.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.809+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29__shadow_.iTfMrdx2ZhpFpEW0RyyIcpFLna6UI3H_0 2024-09-12T01:01:31.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.809+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13557350832262470482', time=2024-09-12T02:56:29.753810+0000, chain.objs.size()=1 2024-09-12T01:01:31.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.809+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30__shadow_.nc0cMO01VtBf6bBPqTN78ECSeKWqfFa_0 2024-09-12T01:01:31.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.809+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10196698021120755796', time=2024-09-12T02:56:29.758581+0000, chain.objs.size()=1 2024-09-12T01:01:31.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.809+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30__shadow_.M7Xyne1T0VAYVkVi1GBAMusj8KiNPR6_0 2024-09-12T01:01:31.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.809+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3240252693574302203', time=2024-09-12T02:56:32.843149+0000, chain.objs.size()=1 2024-09-12T01:01:31.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.809+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32__shadow_.IlX8YSwV1m_hjEvSajli9n7XT2dN1R3_0 2024-09-12T01:01:31.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.809+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8853306179506969226', time=2024-09-12T02:57:07.454233+0000, chain.objs.size()=1 2024-09-12T01:01:31.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.809+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34__shadow_.EHDuv4dmex95xv24sp-iOpEo71a6m3s_0 2024-09-12T01:01:31.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.813+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16582230327432147054', time=2024-09-12T02:57:40.198365+0000, chain.objs.size()=1 2024-09-12T01:01:31.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.813+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35__shadow_.m5NQyWQi4gtHcqG1CbO0WwT7CG3-GS-_0 2024-09-12T01:01:31.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.813+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15111927773947197740', time=2024-09-12T02:57:40.203339+0000, chain.objs.size()=1 2024-09-12T01:01:31.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.813+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35__shadow_.aTH3JBS1IOR_IaDMXUUapR_Y4KXtHBT_0 2024-09-12T01:01:31.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.813+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16447459564184958000', time=2024-09-12T02:57:42.266914+0000, chain.objs.size()=1 2024-09-12T01:01:31.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.813+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36__shadow_.5k1AQ4NwtAFsivjFVdiDbCl-aMHlnsd_0 2024-09-12T01:01:31.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.813+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17863865791987565430', time=2024-09-12T02:57:42.275553+0000, chain.objs.size()=1 2024-09-12T01:01:31.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.813+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36__shadow_.mmQ7VUkJ05LBNLtb_x-Ygx24ueHtgDW_0 2024-09-12T01:01:31.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.813+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17071267119320957312', time=2024-09-12T02:58:14.322434+0000, chain.objs.size()=1 2024-09-12T01:01:31.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.813+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37__shadow_.nb3LtoHP_sI_-HFmc051a9LNSS2Y590_0 2024-09-12T01:01:31.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.813+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8580602450005345134', time=2024-09-12T02:58:16.478435+0000, chain.objs.size()=1 2024-09-12T01:01:31.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.813+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38__shadow_.TrkutDBG1iQfi36Nc1NqK7aNLTh4UBN_0 2024-09-12T01:01:31.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.813+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5291056288729910211', time=2024-09-12T03:00:56.526724+0000, chain.objs.size()=1 2024-09-12T01:01:31.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.813+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18__shadow_.wd1fsaTihofVYEX8fkvvwmbGuoHHjHw_0 2024-09-12T01:01:31.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.817+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.821+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:01:31.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.825+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.825+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.825+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T01:01:31.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.825+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4189985660184422570', time=2024-09-12T02:54:10.528855+0000, chain.objs.size()=1 2024-09-12T01:01:31.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.825+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20__shadow_.PS16xFQZmH6iOxqolFybWMQszptRjw5_0 2024-09-12T01:01:31.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.825+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17319258925448246970', time=2024-09-12T02:54:10.535155+0000, chain.objs.size()=1 2024-09-12T01:01:31.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.825+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20__shadow_.qm9fHxTaHF3JPu30PBvfaUGpJb3oP7x_0 2024-09-12T01:01:31.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.825+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18015398766941649406', time=2024-09-12T02:54:11.749650+0000, chain.objs.size()=1 2024-09-12T01:01:31.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.825+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21__shadow_.epg0DPAN5bSZePy8OBKaKh_YTUl9ZOH_0 2024-09-12T01:01:31.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.825+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17520612534367199265', time=2024-09-12T02:54:44.245767+0000, chain.objs.size()=1 2024-09-12T01:01:31.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.825+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22__shadow_.M9GFJxjd-oLtUCI_4IY9pTlTeKWjnrN_0 2024-09-12T01:01:31.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.825+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9777822768443827295', time=2024-09-12T02:54:47.770702+0000, chain.objs.size()=1 2024-09-12T01:01:31.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.825+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24__shadow_.7D2ZYVkodRBFutj6Os6G4LT1fx800pn_0 2024-09-12T01:01:31.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.825+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5564576150008741935', time=2024-09-12T02:55:20.281350+0000, chain.objs.size()=1 2024-09-12T01:01:31.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.825+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25__shadow_.8zACLJb59vCXK9fUOg1s8y6RCYDgY1D_0 2024-09-12T01:01:31.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.825+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4206378218343308084', time=2024-09-12T02:56:29.757898+0000, chain.objs.size()=1 2024-09-12T01:01:31.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.825+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30__shadow_.95IjXsURSKA9VDL-fR7DP-Jml-Xpqyg_0 2024-09-12T01:01:31.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.825+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1088124381261278651', time=2024-09-12T02:56:32.861900+0000, chain.objs.size()=1 2024-09-12T01:01:31.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.825+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32__shadow_.95TEiC_81EYHD7gLyr-rDM6b8YPX-oJ_0 2024-09-12T01:01:31.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.825+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15124794394062109942', time=2024-09-12T02:57:40.191559+0000, chain.objs.size()=1 2024-09-12T01:01:31.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.825+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35__shadow_.P1boOxUAnQgwFZ5UOkpExTralLYG_MT_0 2024-09-12T01:01:31.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.825+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5848221308419055147', time=2024-09-12T02:57:42.290716+0000, chain.objs.size()=1 2024-09-12T01:01:31.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.825+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36__shadow_.xZ0Jp01RROA3YythpoLDute2kAwJrxN_0 2024-09-12T01:01:31.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.825+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16389647423898867495', time=2024-09-12T02:58:17.756550+0000, chain.objs.size()=1 2024-09-12T01:01:31.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.825+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39__shadow_.hlhxPpAxr3iQbqhDOiY_0mpU4nt-Vx__0 2024-09-12T01:01:31.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.829+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.833+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:01:31.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.837+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.837+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.841+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T01:01:31.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.841+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2065410714995267126', time=2024-09-12T02:52:53.093033+0000, chain.objs.size()=1 2024-09-12T01:01:31.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.841+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5__shadow_.glbkoVXtq7kuyioLyXEhUFXg0qpiUp8_0 2024-09-12T01:01:31.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.841+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='_OAHMCuXbN0jMaVKtN9dynwsqSlNADIS', time=2024-09-12T02:52:53.488848+0000, chain.objs.size()=2 2024-09-12T01:01:31.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.841+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__shadow_.n5kP9r1pmd9OlrKJ0bH-ruFo-0iO4y-_0 2024-09-12T01:01:31.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.841+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__shadow_.n5kP9r1pmd9OlrKJ0bH-ruFo-0iO4y-_1 2024-09-12T01:01:31.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.841+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13871269240135576571', time=2024-09-12T02:54:10.512139+0000, chain.objs.size()=1 2024-09-12T01:01:31.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.841+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20__shadow_.RPoaYzRgwcKwRaX1NJN51Jijld4hKJS_0 2024-09-12T01:01:31.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.841+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9381436905022270960', time=2024-09-12T02:54:10.514913+0000, chain.objs.size()=1 2024-09-12T01:01:31.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.841+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20__shadow_.6n_Y-u410ebSYshJ7p5O3A5p18UqzkY_0 2024-09-12T01:01:31.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.841+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12132890090475333040', time=2024-09-12T02:54:11.747349+0000, chain.objs.size()=1 2024-09-12T01:01:31.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.841+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21__shadow_.56C2J7o7Py8mKdqlJHLRqizMBSG_ccN_0 2024-09-12T01:01:31.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.841+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12813094525116299596', time=2024-09-12T02:54:44.238220+0000, chain.objs.size()=1 2024-09-12T01:01:31.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.841+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22__shadow_.1Do8I7RW-poScbknyRlFKgH9U1U217y_0 2024-09-12T01:01:31.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.841+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3718073558751503169', time=2024-09-12T02:54:46.299457+0000, chain.objs.size()=1 2024-09-12T01:01:31.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.841+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23__shadow_.N3woYTlqEmSbmq2ZjhO43kc82iHRT_8_0 2024-09-12T01:01:31.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.841+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8668843020284479554', time=2024-09-12T02:54:47.777310+0000, chain.objs.size()=1 2024-09-12T01:01:31.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.841+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24__shadow_.jp5xkI-twfOK-FkdFHjSrH56fH8lgK__0 2024-09-12T01:01:31.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.841+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13781818729446129766', time=2024-09-12T02:54:47.797886+0000, chain.objs.size()=1 2024-09-12T01:01:31.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.841+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24__shadow_.z9YzV38ja5344Wl--35GGJs3th-ar6S_0 2024-09-12T01:01:31.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.841+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13008486932624908972', time=2024-09-12T02:55:23.142190+0000, chain.objs.size()=1 2024-09-12T01:01:31.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.841+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27__shadow_.a_gSQJv4kg3saSFqgnopbzcbcgwZSqN_0 2024-09-12T01:01:31.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.841+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17997824286810861799', time=2024-09-12T02:55:55.396433+0000, chain.objs.size()=1 2024-09-12T01:01:31.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.841+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28__shadow_._VGixr6voiIc28yHQfK3vgsIN2nXsip_0 2024-09-12T01:01:31.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.841+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13085967224248566634', time=2024-09-12T02:56:31.603604+0000, chain.objs.size()=1 2024-09-12T01:01:31.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.841+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31__shadow_.Q0yzCCnyKZXtxHDAtlxKZcixdRI_FGs_0 2024-09-12T01:01:31.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.845+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2417786739225570847', time=2024-09-12T02:56:32.855430+0000, chain.objs.size()=1 2024-09-12T01:01:31.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.845+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32__shadow_.bXs5BT0ts1y0Rw8kKn94cF5elEyNOvb_0 2024-09-12T01:01:31.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.845+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9256593284744747372', time=2024-09-12T02:57:05.019314+0000, chain.objs.size()=1 2024-09-12T01:01:31.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.845+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33__shadow_.C-aIfGOkteG63pgjjLuIzm2cf_oRuCs_0 2024-09-12T01:01:31.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.845+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4834321127054399820', time=2024-09-12T02:57:41.846752+0000, chain.objs.size()=1 2024-09-12T01:01:31.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.845+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36__shadow_.NYry-m34L3-3m0hAB5LKwd3uEEMpYiD_0 2024-09-12T01:01:31.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.845+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10153941637141477899', time=2024-09-12T02:58:14.316921+0000, chain.objs.size()=1 2024-09-12T01:01:31.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.845+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37__shadow_.KQN0b-Rk1CkFpXqEqfVD5c6Gd6jCMDO_0 2024-09-12T01:01:31.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.845+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4950981703297764087', time=2024-09-12T02:58:49.951213+0000, chain.objs.size()=1 2024-09-12T01:01:31.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.845+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40__shadow_.U-_JV0Ckz-ujYqs_Hc7EY2vQbC6x7GB_0 2024-09-12T01:01:31.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.849+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.853+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:01:31.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.857+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.857+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.857+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T01:01:31.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.857+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5163093847101808498', time=2024-09-12T02:52:53.065151+0000, chain.objs.size()=1 2024-09-12T01:01:31.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.857+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5__shadow_.uGHuvANgkR5yzkSsiCYNjKqGA1WO4Xo_0 2024-09-12T01:01:31.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.857+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9013878756968447880', time=2024-09-12T02:52:53.311385+0000, chain.objs.size()=1 2024-09-12T01:01:31.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.857+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16__shadow_.wc0KX0K7eP0wpAu4U0p_mQ9dvgLDX4Y_0 2024-09-12T01:01:31.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.857+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9983802995289017552', time=2024-09-12T02:54:11.736001+0000, chain.objs.size()=1 2024-09-12T01:01:31.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.857+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21__shadow_.rcF_tB3xSW9oFPBI6uuGRwFb8FblKCW_0 2024-09-12T01:01:31.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.857+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16304310899155005764', time=2024-09-12T02:54:11.756345+0000, chain.objs.size()=1 2024-09-12T01:01:31.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.857+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21__shadow_.hWTKy_RMxSSsekpn_ZRWUA0GpMPQIQA_0 2024-09-12T01:01:31.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.857+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10738933999914801036', time=2024-09-12T02:54:47.790150+0000, chain.objs.size()=1 2024-09-12T01:01:31.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.857+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24__shadow_.PXpQD5KQ3uFVzIjv-r3eFak-WTeQ6tc_0 2024-09-12T01:01:31.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.857+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16143432631446510307', time=2024-09-12T02:55:20.266578+0000, chain.objs.size()=1 2024-09-12T01:01:31.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.857+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25__shadow_.oH2jt3Wq1KGAi5MICt80JBCnyRF6A2G_0 2024-09-12T01:01:31.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.857+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15614202301946704489', time=2024-09-12T02:55:55.398135+0000, chain.objs.size()=1 2024-09-12T01:01:31.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.857+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28__shadow_.gKmFezVIBL-JXzy_FXRdQeVYo3SnfP9_0 2024-09-12T01:01:31.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.857+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12683852256970643520', time=2024-09-12T02:55:55.405879+0000, chain.objs.size()=1 2024-09-12T01:01:31.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.857+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28__shadow_.BZFphxFZW29yMP50sAILk6RkqboisEU_0 2024-09-12T01:01:31.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.857+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13477997999701195939', time=2024-09-12T02:56:31.613092+0000, chain.objs.size()=1 2024-09-12T01:01:31.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.857+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.31__shadow_.9Eq9mkI61wFpCIWZOMK8ht5tGpjftZ9_0 2024-09-12T01:01:31.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.857+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9909897707799683346', time=2024-09-12T02:57:40.176646+0000, chain.objs.size()=1 2024-09-12T01:01:31.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.857+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35__shadow_.2GG8oYLMzf-uf4AtirgWb9Rgzm3mJXY_0 2024-09-12T01:01:31.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.857+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13480406022024302435', time=2024-09-12T02:58:49.941279+0000, chain.objs.size()=1 2024-09-12T01:01:31.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.857+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40__shadow_.rldIK_sar4DxIY3pkm4lHaO0qIo34BS_0 2024-09-12T01:01:31.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.861+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.865+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:01:31.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.869+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.869+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.869+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T01:01:31.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.869+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14084974021815677490', time=2024-09-12T02:54:10.524792+0000, chain.objs.size()=1 2024-09-12T01:01:31.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.869+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20__shadow_.6ftp3bVld938zot5nnlOIdpuzUreEdS_0 2024-09-12T01:01:31.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.869+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14419443487182627143', time=2024-09-12T02:54:44.232515+0000, chain.objs.size()=1 2024-09-12T01:01:31.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.869+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22__shadow_.LGDvVtH5Ng-qqFQm0eayKcrHv8OLnHE_0 2024-09-12T01:01:31.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.869+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7462848158877031953', time=2024-09-12T02:54:46.313945+0000, chain.objs.size()=1 2024-09-12T01:01:31.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.869+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23__shadow_.mgjHYXwRp-rkgW2BraaUtIthfqKwae3_0 2024-09-12T01:01:31.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.869+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2731252988730746914', time=2024-09-12T02:54:47.798863+0000, chain.objs.size()=1 2024-09-12T01:01:31.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.869+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.24__shadow_.LQ5dykwrnhcl2bufeFIsVdsxX3T__BC_0 2024-09-12T01:01:31.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.869+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10359170560953135688', time=2024-09-12T02:55:21.939224+0000, chain.objs.size()=1 2024-09-12T01:01:31.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.869+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26__shadow_.p8EGl6iuIzx_ZgJtyTvVgDLV6u64txx_0 2024-09-12T01:01:31.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.869+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15226843624184923586', time=2024-09-12T02:55:21.941602+0000, chain.objs.size()=1 2024-09-12T01:01:31.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.869+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26__shadow_.h5xrF0KtUj9F9LVXMRjlt1-ZScQqbLI_0 2024-09-12T01:01:31.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.869+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16318022917183299082', time=2024-09-12T02:55:23.159488+0000, chain.objs.size()=1 2024-09-12T01:01:31.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.869+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.27__shadow_.cwNaUl8oxhEYAR5fLVjbEjareQ8AzGy_0 2024-09-12T01:01:31.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.869+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1368646781952666583', time=2024-09-12T02:55:57.723136+0000, chain.objs.size()=1 2024-09-12T01:01:31.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.869+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29__shadow_.N7Lt1ARd_gdLST-T_K3BE1YQ_WIunn-_0 2024-09-12T01:01:31.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.869+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13080856881845273616', time=2024-09-12T02:56:29.758141+0000, chain.objs.size()=1 2024-09-12T01:01:31.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.869+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30__shadow_.oNq0g9ZaC2LzrS9WG9RnOmpe6GI1W46_0 2024-09-12T01:01:31.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.869+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13310612524297164601', time=2024-09-12T02:56:32.855087+0000, chain.objs.size()=1 2024-09-12T01:01:31.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.869+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32__shadow_.Ki2kCiayVcKVcZMbpTdWs9fDcnxUoKn_0 2024-09-12T01:01:31.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.869+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14614013728437755957', time=2024-09-12T02:57:05.029128+0000, chain.objs.size()=1 2024-09-12T01:01:31.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.869+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33__shadow_.KNTM4msxEtHlCxSjsn_zE5zAEeO-gY5_0 2024-09-12T01:01:31.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.869+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7961092955963760243', time=2024-09-12T02:57:05.029910+0000, chain.objs.size()=1 2024-09-12T01:01:31.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.869+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33__shadow_.sl58eW54c3t3fONliTeWnIQ1rL1W2hY_0 2024-09-12T01:01:31.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.873+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17153348982573069597', time=2024-09-12T02:57:40.195474+0000, chain.objs.size()=1 2024-09-12T01:01:31.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.873+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35__shadow_.KxzKys_QCFTsrx7-7aWCaWIE0YVz2aS_0 2024-09-12T01:01:31.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.873+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8274347758279333024', time=2024-09-12T02:57:42.291265+0000, chain.objs.size()=1 2024-09-12T01:01:31.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.873+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36__shadow_.FLG27sLQU7zMRwSuLq_9Q9K9DgBSktt_0 2024-09-12T01:01:31.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.877+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16538297804699703799', time=2024-09-12T02:58:14.341386+0000, chain.objs.size()=1 2024-09-12T01:01:31.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.877+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37__shadow_.gF3HDI_wHIXT4QX9wYvLqErS1luIwUv_0 2024-09-12T01:01:31.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.877+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16419480122233678815', time=2024-09-12T02:58:16.482264+0000, chain.objs.size()=1 2024-09-12T01:01:31.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.877+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38__shadow_.pBVW-aZ42LLPi8QVkfQcRxZLWtKk-ax_0 2024-09-12T01:01:31.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.877+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18059325927365478326', time=2024-09-12T02:58:17.742982+0000, chain.objs.size()=1 2024-09-12T01:01:31.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.877+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39__shadow_.n7UavGzEUZdDD3WAz3Y4Fyvqo1Amr-r_0 2024-09-12T01:01:31.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.877+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6893445846228277336', time=2024-09-12T02:58:49.949254+0000, chain.objs.size()=1 2024-09-12T01:01:31.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.877+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40__shadow_.7OY_3V0HkFh6Sw4vMy1ZubHSBvM6Law_0 2024-09-12T01:01:31.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.877+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6198121133629370981', time=2024-09-12T02:58:49.960653+0000, chain.objs.size()=1 2024-09-12T01:01:31.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.877+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40__shadow_.hmxfPau87zTsD1Zf1pvJvazS8HYtatH_0 2024-09-12T01:01:31.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.877+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15457988626414974199', time=2024-09-12T02:58:49.979577+0000, chain.objs.size()=1 2024-09-12T01:01:31.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.877+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40__shadow_.S4UYzHo9pm1dHS_pv1laHKqEdyMF8Ub_0 2024-09-12T01:01:31.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.877+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.881+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:01:31.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.885+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.885+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.889+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T01:01:31.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.889+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9801922626271500422', time=2024-09-12T02:52:53.498285+0000, chain.objs.size()=3 2024-09-12T01:01:31.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.889+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-LUKEWARM.2~XZVlofY5U0WQ__CprNDClyfvtCdI_Gb.1 2024-09-12T01:01:31.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.889+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-LUKEWARM.2~XZVlofY5U0WQ__CprNDClyfvtCdI_Gb.2 2024-09-12T01:01:31.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.889+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__multipart_foo-LUKEWARM.2~XZVlofY5U0WQ__CprNDClyfvtCdI_Gb.3 2024-09-12T01:01:31.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.889+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6219631436625644616', time=2024-09-12T02:54:10.519600+0000, chain.objs.size()=1 2024-09-12T01:01:31.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.889+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20__shadow_.0QMIzex3qjpWfFOjx8BRZbnGH5LCBtk_0 2024-09-12T01:01:31.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.889+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6704796830662558846', time=2024-09-12T02:54:11.729984+0000, chain.objs.size()=1 2024-09-12T01:01:31.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.889+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21__shadow_.Odw5o8QNz0ELlfmYYM6DZrqwAuGEi0i_0 2024-09-12T01:01:31.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.889+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10227116441614171472', time=2024-09-12T02:54:11.737851+0000, chain.objs.size()=1 2024-09-12T01:01:31.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.889+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21__shadow_.HLzkERyTq5PO4Td0cIwn6BS3MFd2voU_0 2024-09-12T01:01:31.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.889+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4048159256280959171', time=2024-09-12T02:55:20.248765+0000, chain.objs.size()=1 2024-09-12T01:01:31.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.889+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25__shadow_.yjbXx0gFL0buGl7r7MacqtxwBg-ixUw_0 2024-09-12T01:01:31.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.889+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12174073535600209798', time=2024-09-12T02:55:20.250665+0000, chain.objs.size()=1 2024-09-12T01:01:31.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.889+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25__shadow_._ohRem5w9zNpDQ6kSLVcucbrWt3KqnZ_0 2024-09-12T01:01:31.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.889+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13774955601467981412', time=2024-09-12T02:55:55.394534+0000, chain.objs.size()=1 2024-09-12T01:01:31.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.889+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28__shadow_.Bl2k1hIY53tg-C19xJG8_996qjIJXu7_0 2024-09-12T01:01:31.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.889+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18309090952534433615', time=2024-09-12T02:55:55.399575+0000, chain.objs.size()=1 2024-09-12T01:01:31.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.889+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28__shadow_.7qFwwOO54N4UcErfteyJ6K_e9t1VlxS_0 2024-09-12T01:01:31.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.889+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4177807129279691522', time=2024-09-12T02:56:32.862586+0000, chain.objs.size()=1 2024-09-12T01:01:31.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.889+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32__shadow_.fO2gD88YkxU7lHfSD0sWAFqWCvponDn_0 2024-09-12T01:01:31.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.889+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11256344562083088051', time=2024-09-12T02:57:05.024650+0000, chain.objs.size()=1 2024-09-12T01:01:31.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.889+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33__shadow_.q8yJ-b3gyfRIxxYQYPYx2DX22j9WvSO_0 2024-09-12T01:01:31.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.893+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16504968561159602572', time=2024-09-12T02:57:05.030686+0000, chain.objs.size()=1 2024-09-12T01:01:31.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.893+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33__shadow_.It_igfmcIvMsjmhpgB9bBgRDDUWTvMC_0 2024-09-12T01:01:31.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.893+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15133881409084505954', time=2024-09-12T02:57:07.429690+0000, chain.objs.size()=1 2024-09-12T01:01:31.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.893+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34__shadow_.vqLx6wsmfBKbsDzC_at-j_kJND-yLp1_0 2024-09-12T01:01:31.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.893+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17384401912868698288', time=2024-09-12T02:57:07.432014+0000, chain.objs.size()=1 2024-09-12T01:01:31.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.893+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34__shadow_.MzOE1ZQlwB1iAvBS2pbIzJv-p3I6ezg_0 2024-09-12T01:01:31.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.893+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14538778081597724651', time=2024-09-12T02:57:07.445303+0000, chain.objs.size()=1 2024-09-12T01:01:31.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.893+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34__shadow_.A5P2IxLQgfM4e6AaJlSoros1_yZC3eq_0 2024-09-12T01:01:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.893+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.60990505381762573', time=2024-09-12T02:57:42.272582+0000, chain.objs.size()=1 2024-09-12T01:01:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.893+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36__shadow_.BsrFtjPTtn5tknOWwSPquIg7SY7v02X_0 2024-09-12T01:01:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.893+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8708141930681709426', time=2024-09-12T02:58:14.319324+0000, chain.objs.size()=1 2024-09-12T01:01:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.893+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37__shadow_.dMLRrwPAewLLS4KtV94cLeDtChfFsso_0 2024-09-12T01:01:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.893+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2023407279034868695', time=2024-09-12T02:58:49.974534+0000, chain.objs.size()=1 2024-09-12T01:01:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.893+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40__shadow_.NdWcht_djoe5bmx9HKHnV1wWTckTSZv_0 2024-09-12T01:01:31.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.897+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.901+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:01:31.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.901+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.905+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.905+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T01:01:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.905+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14720083465958919231', time=2024-09-12T02:52:53.088109+0000, chain.objs.size()=1 2024-09-12T01:01:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.905+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5__shadow_.SSLZiouLmUiT5YoHatXDtcUXH1wqd1N_0 2024-09-12T01:01:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.905+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13130071577082273037', time=2024-09-12T02:52:53.123017+0000, chain.objs.size()=1 2024-09-12T01:01:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.905+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5__shadow_.4X5DEE7cw9lnR-AmQhAf1RTVULMNZOg_0 2024-09-12T01:01:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.905+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.564683416628051245', time=2024-09-12T02:52:53.284240+0000, chain.objs.size()=4 2024-09-12T01:01:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.905+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10__multipart_foo.2~DqU3uok9KgvZP0AhGCiW7uszsaxB8ie.1 2024-09-12T01:01:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.905+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10__multipart_foo.2~DqU3uok9KgvZP0AhGCiW7uszsaxB8ie.2 2024-09-12T01:01:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.905+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10__multipart_foo.2~DqU3uok9KgvZP0AhGCiW7uszsaxB8ie.3 2024-09-12T01:01:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.905+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10__multipart_foo.2~DqU3uok9KgvZP0AhGCiW7uszsaxB8ie.4 2024-09-12T01:01:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.905+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7346104375581115748', time=2024-09-12T02:54:10.535832+0000, chain.objs.size()=1 2024-09-12T01:01:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.905+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20__shadow_.4RgTodzcf9vGZ-IF2qnxQ-R05cOLqdN_0 2024-09-12T01:01:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.905+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2236878573728200383', time=2024-09-12T02:55:21.955871+0000, chain.objs.size()=1 2024-09-12T01:01:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.905+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26__shadow_.RwNJkFm6FISV_qn2-YegMJzEtgIYeeY_0 2024-09-12T01:01:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.905+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10052640542489028548', time=2024-09-12T02:55:24.343082+0000, chain.objs.size()=1 2024-09-12T01:01:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.905+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28__shadow_.f9GBgqJBkoawo-u_5kBtpfDla9nfCFf_0 2024-09-12T01:01:31.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.905+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3906919755661332472', time=2024-09-12T02:56:32.869409+0000, chain.objs.size()=1 2024-09-12T01:01:31.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.905+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32__shadow_.tJsTOSjHfoJl_HW80EddJAm489gVBpS_0 2024-09-12T01:01:31.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.905+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12441014935118458295', time=2024-09-12T02:57:42.264785+0000, chain.objs.size()=1 2024-09-12T01:01:31.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.905+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36__shadow_.PuoPcvCb_i4JeshTwIwlrIOi2S_CHrn_0 2024-09-12T01:01:31.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.905+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12225124328692138690', time=2024-09-12T02:58:14.316189+0000, chain.objs.size()=1 2024-09-12T01:01:31.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.905+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37__shadow_.2FcWzKWYonJ4LTdjGDSlRyp6HwFPMYf_0 2024-09-12T01:01:31.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.909+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14078055164053273333', time=2024-09-12T02:58:14.325093+0000, chain.objs.size()=1 2024-09-12T01:01:31.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.909+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37__shadow_.3FnOPi9JR1d0hmIJ81RpxKoDfIukxW6_0 2024-09-12T01:01:31.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.909+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8012770546455458022', time=2024-09-12T02:58:14.346933+0000, chain.objs.size()=1 2024-09-12T01:01:31.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.909+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37__shadow_.wUcGLBeF32YWoVyVbv2hxglX2OKK2mO_0 2024-09-12T01:01:31.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.909+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.446867983361010850', time=2024-09-12T02:58:17.726107+0000, chain.objs.size()=1 2024-09-12T01:01:31.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.909+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39__shadow_.fpuK_tl_qkNgUH6gcB3dE-1neaovlhu_0 2024-09-12T01:01:31.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.909+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13947073611668126738', time=2024-09-12T02:58:49.947201+0000, chain.objs.size()=1 2024-09-12T01:01:31.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.909+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40__shadow_.IU3g_ErukdM3-tC-CZ-fVwj2r_xgLYG_0 2024-09-12T01:01:31.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.909+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17753914945617491274', time=2024-09-12T02:58:49.960121+0000, chain.objs.size()=1 2024-09-12T01:01:31.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.909+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40__shadow_.HlWEgdoYaVA0IwnxGPeOes1H7asP7J5_0 2024-09-12T01:01:31.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.909+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.345987012812200507', time=2024-09-12T02:58:49.971043+0000, chain.objs.size()=1 2024-09-12T01:01:31.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.909+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40__shadow_.e9uhp3HVLZRSKYrtan63SUu7JMenfsE_0 2024-09-12T01:01:31.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.913+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.917+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:01:31.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.917+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.921+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.921+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T01:01:31.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.921+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9294444906539097941', time=2024-09-12T02:52:53.319958+0000, chain.objs.size()=1 2024-09-12T01:01:31.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.921+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16__shadow_.wc0KX0K7eP0wpAu4U0p_mQ9dvgLDX4Y_0 2024-09-12T01:01:31.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.921+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='_5sq_OpTGfmc3jFt3fmyUc9PnefY07pK', time=2024-09-12T02:52:53.528319+0000, chain.objs.size()=1 2024-09-12T01:01:31.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.921+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__shadow_.bAwYYehVSa0WjGW3Gj5xx84RGcZOb7D_0 2024-09-12T01:01:31.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.921+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1455286193073946991', time=2024-09-12T02:52:53.758942+0000, chain.objs.size()=1 2024-09-12T01:01:31.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.921+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8__shadow_.-wuw0qrf4M4DgNvgFJ3MFEULmnPR7A8_0 2024-09-12T01:01:31.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.921+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9368557507279663408', time=2024-09-12T02:54:10.519260+0000, chain.objs.size()=1 2024-09-12T01:01:31.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.921+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20__shadow_.fpDAZSPqx1HXtX5A1oAKRX27jnADlns_0 2024-09-12T01:01:31.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.921+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.72578344811841023', time=2024-09-12T02:54:44.213750+0000, chain.objs.size()=1 2024-09-12T01:01:31.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.921+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22__shadow_.OxIzkUsapRmDB91_fuQW3lFwZ4PV4Uo_0 2024-09-12T01:01:31.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.921+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7209111271490005196', time=2024-09-12T02:55:57.711249+0000, chain.objs.size()=1 2024-09-12T01:01:31.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.921+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29__shadow_.EIMyEZN2IlBNBCZS0DceweAtR_ZEM6j_0 2024-09-12T01:01:31.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.921+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7328319229950872941', time=2024-09-12T02:55:57.714727+0000, chain.objs.size()=1 2024-09-12T01:01:31.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.921+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29__shadow_.N7Ia8KaxZAybdbTYroyam9yyJuMxpmQ_0 2024-09-12T01:01:31.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.921+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14596416656602202790', time=2024-09-12T02:56:32.837573+0000, chain.objs.size()=1 2024-09-12T01:01:31.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.921+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32__shadow_.CeMG5zdrE6Uh_Wc1_UXbvn346_x5pO5_0 2024-09-12T01:01:31.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.921+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10031105521762540883', time=2024-09-12T02:56:32.860922+0000, chain.objs.size()=1 2024-09-12T01:01:31.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.921+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.32__shadow_.yi6EOM2IJFLeRTMfYTCQikmqpEt9yEF_0 2024-09-12T01:01:31.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.921+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6107343304449868525', time=2024-09-12T02:57:05.021611+0000, chain.objs.size()=1 2024-09-12T01:01:31.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.921+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.33__shadow_.vZ2ZEgcUGkzg_jZqQDps5CPL--2m1J2_0 2024-09-12T01:01:31.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.921+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10343387392555313431', time=2024-09-12T02:57:07.432272+0000, chain.objs.size()=1 2024-09-12T01:01:31.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.921+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.34__shadow_.CC5CxYOWW8Phw_tD3lA41m0qaUITSqd_0 2024-09-12T01:01:31.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.921+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9490923369451870231', time=2024-09-12T02:57:40.166804+0000, chain.objs.size()=1 2024-09-12T01:01:31.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.921+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.35__shadow_.IfjGOc1aRSiFMZvnuKb8XonbtW9njUM_0 2024-09-12T01:01:31.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.925+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8351009762035328242', time=2024-09-12T02:58:16.468101+0000, chain.objs.size()=1 2024-09-12T01:01:31.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.925+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38__shadow_.SvGMVODg9RbbRWG5Ep6uj8O0ftzaOhB_0 2024-09-12T01:01:31.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.925+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11060513214071853675', time=2024-09-12T02:58:49.964456+0000, chain.objs.size()=1 2024-09-12T01:01:31.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.925+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40__shadow_.SaE-U3s6GdO034BaYLIo0beHKQVYWun_0 2024-09-12T01:01:31.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.925+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10997479943981566723', time=2024-09-12T03:00:56.517097+0000, chain.objs.size()=1 2024-09-12T01:01:31.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.925+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18__shadow_.q2QwhUPQYe__wasZSD12mdsoJM8aFcR_0 2024-09-12T01:01:31.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.925+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9195515872167135535', time=2024-09-12T03:00:56.519648+0000, chain.objs.size()=1 2024-09-12T01:01:31.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.925+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18__shadow_.ZZ5mpIthSYi-lGu7SfOERcCq1VDy789_0 2024-09-12T01:01:31.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.925+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15728682941890109002', time=2024-09-12T03:00:56.525578+0000, chain.objs.size()=1 2024-09-12T01:01:31.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.925+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18__shadow_.PLE-IKBgiybH5BHp3vfVjJPWUWXz3KH_0 2024-09-12T01:01:31.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.929+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.933+0000 7f7af38829c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:01:31.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.937+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:31.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.937+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:31.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.937+0000 7f7af38829c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T01:01:31.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.937+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='_b5BTzNNqnE4qStOHYbIeaBdNuoQFUpN', time=2024-09-12T02:52:53.508587+0000, chain.objs.size()=2 2024-09-12T01:01:31.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.937+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__shadow_.2C29D1r_YURNbtEByPFezCNdDAw5tj4_0 2024-09-12T01:01:31.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.937+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17__shadow_.2C29D1r_YURNbtEByPFezCNdDAw5tj4_1 2024-09-12T01:01:31.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.937+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8520486078240542076', time=2024-09-12T02:54:11.738690+0000, chain.objs.size()=1 2024-09-12T01:01:31.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.937+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.21__shadow_.uZdcQRxj3lDCZkTpTLmUyS_isGr1F4Y_0 2024-09-12T01:01:31.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.937+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7064658087982273197', time=2024-09-12T02:54:44.218171+0000, chain.objs.size()=1 2024-09-12T01:01:31.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.937+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.22__shadow_.Qs7iJxXywA3Iq8LuzsQl-rlOuq8psEs_0 2024-09-12T01:01:31.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.937+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12747705337506414093', time=2024-09-12T02:55:20.258221+0000, chain.objs.size()=1 2024-09-12T01:01:31.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.937+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.25__shadow_.5DyEa7VlBtjCWOTjH3M_NrqrJa-Fjmq_0 2024-09-12T01:01:31.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.937+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8603276081914581982', time=2024-09-12T02:55:21.951512+0000, chain.objs.size()=1 2024-09-12T01:01:31.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.937+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.26__shadow_.E8dHCrnOdpUXVjO278Zjq9tzW6MEvbq_0 2024-09-12T01:01:31.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.937+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17091046386626963595', time=2024-09-12T02:55:55.391984+0000, chain.objs.size()=1 2024-09-12T01:01:31.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.937+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.28__shadow_.qJIBdiwHxJJnOTzRg3PNmGKNsF-lCYj_0 2024-09-12T01:01:31.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.937+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10384672107359069116', time=2024-09-12T02:55:57.708802+0000, chain.objs.size()=1 2024-09-12T01:01:31.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.937+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29__shadow_.vILwwFXlbnvC4SZBwoQJSJ7Xj96is3X_0 2024-09-12T01:01:31.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.937+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16909092147888864171', time=2024-09-12T02:55:57.722835+0000, chain.objs.size()=1 2024-09-12T01:01:31.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.937+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29__shadow_.xW0NAFSmg-eQzYH0GL0XyZTIV78p97N_0 2024-09-12T01:01:31.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.937+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16221838094182893482', time=2024-09-12T02:55:58.678067+0000, chain.objs.size()=1 2024-09-12T01:01:31.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.937+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30__shadow_.4DibctT85F6qZMFCbr0fbnTJLDXm8oX_0 2024-09-12T01:01:31.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.937+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.545050832193003480', time=2024-09-12T02:56:29.747646+0000, chain.objs.size()=1 2024-09-12T01:01:31.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.937+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.30__shadow_.U6ePXlM4E6kLw3e_LxwWWQwPK-UZwGz_0 2024-09-12T01:01:31.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.937+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.184628168862314092', time=2024-09-12T02:58:16.462848+0000, chain.objs.size()=1 2024-09-12T01:01:31.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.937+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.38__shadow_.6fNQNxrXGqEOef-EKOvClXYY5P7S3iD_0 2024-09-12T01:01:31.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.941+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18150444150399301259', time=2024-09-12T02:58:17.740063+0000, chain.objs.size()=1 2024-09-12T01:01:31.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.945+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39__shadow_.hTZaAqO0WStOcDmc0i9NZ69m9GCYqhw_0 2024-09-12T01:01:31.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.945+0000 7f7af38829c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5050111030741960090', time=2024-09-12T02:58:17.756158+0000, chain.objs.size()=1 2024-09-12T01:01:31.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.945+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.39__shadow_.4UGFxUt864BI0TdNQyJFIhDfLtpSjII_0 2024-09-12T01:01:31.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.949+0000 7f7af38829c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:31.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.953+0000 7f79a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:31.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.957+0000 7f7af38829c0 20 remove_watcher() i=0 2024-09-12T01:01:31.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.957+0000 7f7af38829c0 2 removed watcher, disabling cache 2024-09-12T01:01:31.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.961+0000 7f7af38829c0 20 remove_watcher() i=1 2024-09-12T01:01:31.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.961+0000 7f7af38829c0 20 remove_watcher() i=2 2024-09-12T01:01:31.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.965+0000 7f7af38829c0 20 remove_watcher() i=3 2024-09-12T01:01:31.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.965+0000 7f7af38829c0 20 remove_watcher() i=4 2024-09-12T01:01:31.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.965+0000 7f7af38829c0 20 remove_watcher() i=5 2024-09-12T01:01:31.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.969+0000 7f7af38829c0 20 remove_watcher() i=6 2024-09-12T01:01:31.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:31.969+0000 7f7af38829c0 20 remove_watcher() i=7 2024-09-12T01:01:31.978 DEBUG:teuthology.orchestra.run.smithi070:> radosgw-admin gc process --include-all 2024-09-12T01:01:32.053 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:01:32.053 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:01:32.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.105+0000 7f3a493629c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:32.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.109+0000 7f3a493629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:32.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.109+0000 7f3a493629c0 20 realm 2024-09-12T01:01:32.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.109+0000 7f3a493629c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:32.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.109+0000 7f3a493629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:32.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.109+0000 7f3a493629c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:01:32.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.109+0000 7f3a493629c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:32.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.109+0000 7f3a493629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:32.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.109+0000 7f3a493629c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:32.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.109+0000 7f3a493629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:32.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.109+0000 7f3a493629c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:32.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.109+0000 7f3a493629c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:01:32.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.109+0000 7f3a493629c0 20 searching for the correct realm 2024-09-12T01:01:32.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.113+0000 7f3a47669640 0 -- 172.21.15.70:0/2007610096 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f3a3004d060 msgr2=0x7f3a30071700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:01:32.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.125+0000 7f3a47669640 0 -- 172.21.15.70:0/2007610096 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f3910080800 msgr2=0x7f3910082c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:32.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.129+0000 7f3a493629c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:01:32.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.129+0000 7f3a493629c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:01:32.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.129+0000 7f3a493629c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:01:32.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.129+0000 7f3a493629c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:01:32.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.129+0000 7f3a493629c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:01:32.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.129+0000 7f3a493629c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:01:32.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.129+0000 7f3a493629c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:32.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.129+0000 7f3a493629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:32.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.129+0000 7f3a493629c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:32.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.133+0000 7f3a493629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:32.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.133+0000 7f3a493629c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:32.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.133+0000 7f3a493629c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:01:32.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.133+0000 7f3a493629c0 20 zone default found 2024-09-12T01:01:32.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.133+0000 7f3a493629c0 4 Realm: () 2024-09-12T01:01:32.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.133+0000 7f3a493629c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:01:32.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.133+0000 7f3a493629c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:01:32.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.133+0000 7f3a493629c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:01:32.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.133+0000 7f3a493629c0 20 zonegroup default 2024-09-12T01:01:32.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.133+0000 7f3a493629c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:32.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.133+0000 7f3a493629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:32.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.133+0000 7f3a493629c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:32.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.133+0000 7f3a493629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:32.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.133+0000 7f3a493629c0 20 rados->read ofs=0 len=0 2024-09-12T01:01:32.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.133+0000 7f3a493629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:32.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.133+0000 7f3a493629c0 20 started sync module instance, tier type = 2024-09-12T01:01:32.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.133+0000 7f3a493629c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:01:32.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.149+0000 7f3a493629c0 20 add_watcher() i=0 2024-09-12T01:01:32.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.149+0000 7f3a493629c0 20 add_watcher() i=1 2024-09-12T01:01:32.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.149+0000 7f3a493629c0 20 add_watcher() i=2 2024-09-12T01:01:32.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.149+0000 7f3a493629c0 20 add_watcher() i=3 2024-09-12T01:01:32.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.149+0000 7f3a493629c0 20 add_watcher() i=4 2024-09-12T01:01:32.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.149+0000 7f3a493629c0 20 add_watcher() i=5 2024-09-12T01:01:32.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.149+0000 7f3a493629c0 20 add_watcher() i=6 2024-09-12T01:01:32.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.149+0000 7f3a493629c0 20 add_watcher() i=7 2024-09-12T01:01:32.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.149+0000 7f3a493629c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:01:32.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.153+0000 7f38fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:32.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.153+0000 7f3a493629c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:01:32.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.153+0000 7f3a493629c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:01:32.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.225+0000 7f3877fff640 20 reqs_thread_entry: start 2024-09-12T01:01:32.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.225+0000 7f3a493629c0 20 init_complete bucket index max shards: 1 2024-09-12T01:01:32.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.225+0000 7f3a493629c0 20 Filter name: none 2024-09-12T01:01:32.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.225+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:01:32.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.225+0000 7f3875ffb640 20 reqs_thread_entry: start 2024-09-12T01:01:32.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.225+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.225+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.225+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.229+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:01:32.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.229+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.233+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.233+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.233+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:01:32.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.237+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.237+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.237+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.241+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:01:32.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.241+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.241+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.245+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.245+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:01:32.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.249+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.249+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.249+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.253+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:01:32.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.253+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.257+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.257+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.257+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:01:32.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.265+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.265+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.265+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.265+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:01:32.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.269+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.273+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.273+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.273+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:01:32.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.277+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.277+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.277+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.277+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:01:32.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.281+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.281+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.281+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.281+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:01:32.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.289+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.289+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.289+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.293+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:01:32.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.293+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.293+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.297+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.297+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:01:32.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.297+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.301+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.301+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.301+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:01:32.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.305+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.305+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.305+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.309+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:01:32.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.313+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.313+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.313+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.317+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:01:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.317+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.321+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.321+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.321+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:01:32.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.325+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.325+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.325+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.329+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:01:32.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.333+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.333+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.333+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.337+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:01:32.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.341+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.345+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.345+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.349+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:01:32.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.353+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.353+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.353+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.357+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:01:32.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.361+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.361+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.365+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.369+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:01:32.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.369+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.373+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.373+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.373+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:01:32.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.377+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.381+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.381+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.385+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:01:32.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.385+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.389+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.389+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.393+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:01:32.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.393+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.397+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.397+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.397+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:01:32.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.401+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.405+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.405+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.409+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:01:32.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.409+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.413+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.413+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.417+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:01:32.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.417+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.421+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.421+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.425+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:01:32.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.425+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.429+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.429+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.433+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:01:32.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.437+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.437+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.437+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.441+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:01:32.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.445+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.445+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.445+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.449+0000 7f3a493629c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:01:32.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.453+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.453+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.457+0000 7f3a493629c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.461+0000 7f38fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:32.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.465+0000 7f3a493629c0 20 remove_watcher() i=0 2024-09-12T01:01:32.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.465+0000 7f3a493629c0 2 removed watcher, disabling cache 2024-09-12T01:01:32.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.469+0000 7f3a493629c0 20 remove_watcher() i=1 2024-09-12T01:01:32.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.473+0000 7f3a493629c0 20 remove_watcher() i=2 2024-09-12T01:01:32.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.473+0000 7f3a493629c0 20 remove_watcher() i=3 2024-09-12T01:01:32.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.477+0000 7f3a493629c0 20 remove_watcher() i=4 2024-09-12T01:01:32.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.477+0000 7f3a493629c0 20 remove_watcher() i=5 2024-09-12T01:01:32.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.481+0000 7f3a493629c0 20 remove_watcher() i=6 2024-09-12T01:01:32.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:01:32.485+0000 7f3a493629c0 20 remove_watcher() i=7 2024-09-12T01:01:32.500 DEBUG:teuthology.orchestra.run.smithi070:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-12T01:01:33.145 INFO:teuthology.orchestra.run.smithi070.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-12T01:01:37.748 INFO:teuthology.orchestra.run.smithi070.stdout:> Task :clean UP-TO-DATE 2024-09-12T01:01:56.844 INFO:teuthology.orchestra.run.smithi070.stdout:> Task :compileJava 2024-09-12T01:01:56.844 INFO:teuthology.orchestra.run.smithi070.stdout:> Task :processResources 2024-09-12T01:01:56.844 INFO:teuthology.orchestra.run.smithi070.stdout:> Task :classes 2024-09-12T01:01:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:01:57.644 INFO:teuthology.orchestra.run.smithi070.stdout:> Task :compileTestJava 2024-09-12T01:01:57.644 INFO:teuthology.orchestra.run.smithi070.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T01:01:57.644 INFO:teuthology.orchestra.run.smithi070.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T01:01:57.645 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:01:57.645 INFO:teuthology.orchestra.run.smithi070.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T01:01:57.645 INFO:teuthology.orchestra.run.smithi070.stdout:> Task :testClasses 2024-09-12T01:02:04.144 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:04.144 INFO:teuthology.orchestra.run.smithi070.stdout:> Task :test 2024-09-12T01:02:04.144 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:04.144 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-12T01:02:05.044 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:05.044 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-12T01:02:05.244 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:05.244 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-12T01:02:05.344 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:05.344 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-12T01:02:05.644 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:05.644 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-12T01:02:06.244 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:06.244 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-12T01:02:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:06.444 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T01:02:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:06.444 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T01:02:06.644 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:06.644 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-12T01:02:06.644 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:06.644 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-12T01:02:06.847 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:07.141 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-12T01:02:07.344 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:07.344 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-12T01:02:07.844 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:07.844 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-12T01:02:08.044 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:08.044 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-12T01:02:08.044 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12 01:02:08,018 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T01:02:14.044 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:14.044 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-12T01:02:14.444 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:14.444 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-12T01:02:14.444 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:14.444 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-12T01:02:14.744 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:14.744 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-12T01:02:14.744 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:14.744 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-12T01:02:15.144 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:15.144 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-12T01:02:15.544 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:15.544 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-12T01:02:15.844 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:15.844 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T01:02:15.844 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:15.844 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T01:02:15.944 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:15.944 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-12T01:02:18.444 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:18.444 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-12T01:02:18.644 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:18.644 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T01:02:19.244 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:19.244 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T01:02:19.544 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:19.544 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-12T01:02:19.944 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:19.944 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-12T01:02:20.244 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:20.244 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-12T01:02:28.344 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:28.344 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-12T01:02:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:28.644 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-12T01:02:30.044 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:30.044 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-12T01:02:30.344 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:30.344 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-12T01:02:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:31.145 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-12T01:02:31.344 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:31.344 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-12T01:02:31.744 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:31.744 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-12T01:02:32.044 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:32.044 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-12T01:02:32.044 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:32.044 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-12T01:02:32.244 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:32.244 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-12T01:02:32.344 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:32.344 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-12T01:02:32.544 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:32.544 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-12T01:02:32.544 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:32.544 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-12T01:02:32.844 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:32.844 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-12T01:02:32.844 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:32.844 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-12T01:02:33.144 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:33.144 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-12T01:02:33.145 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:33.145 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-12T01:02:33.444 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:33.444 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-12T01:02:33.444 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:33.445 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-12T01:02:33.744 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:33.744 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-12T01:02:33.744 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:33.745 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-12T01:02:34.044 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:34.044 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-12T01:02:34.644 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:34.644 INFO:teuthology.orchestra.run.smithi070.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-12T01:02:35.044 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:35.045 INFO:teuthology.orchestra.run.smithi070.stdout:---------------------------------------------------------------------- 2024-09-12T01:02:35.045 INFO:teuthology.orchestra.run.smithi070.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-12T01:02:35.045 INFO:teuthology.orchestra.run.smithi070.stdout:---------------------------------------------------------------------- 2024-09-12T01:02:35.045 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:35.045 INFO:teuthology.orchestra.run.smithi070.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T01:02:35.045 INFO:teuthology.orchestra.run.smithi070.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T01:02:35.045 INFO:teuthology.orchestra.run.smithi070.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T01:02:35.045 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:35.045 INFO:teuthology.orchestra.run.smithi070.stdout:BUILD SUCCESSFUL in 1m 2s 2024-09-12T01:02:35.045 INFO:teuthology.orchestra.run.smithi070.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-12T01:02:35.380 DEBUG:teuthology.orchestra.run.smithi070:> radosgw-admin gc process --include-all 2024-09-12T01:02:35.413 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:35.414 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:35.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.466+0000 7efd7f2ae9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:35.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.470+0000 7efd7f2ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:35.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.470+0000 7efd7f2ae9c0 20 realm 2024-09-12T01:02:35.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.470+0000 7efd7f2ae9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:35.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.470+0000 7efd7f2ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:35.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.470+0000 7efd7f2ae9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:35.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.470+0000 7efd7f2ae9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:35.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.470+0000 7efd7f2ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:35.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.470+0000 7efd7f2ae9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:35.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.470+0000 7efd7f2ae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:35.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.470+0000 7efd7f2ae9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:35.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.470+0000 7efd7f2ae9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:35.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.470+0000 7efd7f2ae9c0 20 searching for the correct realm 2024-09-12T01:02:35.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.474+0000 7efd7d5b5640 0 -- 172.21.15.70:0/4141670531 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7efd6412d040 msgr2=0x7efd640fcbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:35.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.690+0000 7efd7d5b5640 0 -- 172.21.15.70:0/4141670531 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7efd6412d040 msgr2=0x7efd640fcbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:35.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.702+0000 7efd7f2ae9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:35.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.702+0000 7efd7f2ae9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:02:35.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.702+0000 7efd7f2ae9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:35.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.702+0000 7efd7f2ae9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:02:35.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.702+0000 7efd7f2ae9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:35.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.702+0000 7efd7f2ae9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:35.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.702+0000 7efd7f2ae9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:35.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.702+0000 7efd7f2ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:35.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.702+0000 7efd7f2ae9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:35.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.702+0000 7efd7f2ae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:35.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.702+0000 7efd7f2ae9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:35.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.706+0000 7efd7f2ae9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:35.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.706+0000 7efd7f2ae9c0 20 zone default found 2024-09-12T01:02:35.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.706+0000 7efd7f2ae9c0 4 Realm: () 2024-09-12T01:02:35.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.706+0000 7efd7f2ae9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:02:35.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.706+0000 7efd7f2ae9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:02:35.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.706+0000 7efd7f2ae9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:35.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.706+0000 7efd7f2ae9c0 20 zonegroup default 2024-09-12T01:02:35.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.706+0000 7efd7f2ae9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:35.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.706+0000 7efd7f2ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:35.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.706+0000 7efd7f2ae9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:35.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.706+0000 7efd7f2ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:35.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.706+0000 7efd7f2ae9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:35.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.706+0000 7efd7f2ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:35.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.706+0000 7efd7f2ae9c0 20 started sync module instance, tier type = 2024-09-12T01:02:35.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.706+0000 7efd7f2ae9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:02:35.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.730+0000 7efd7f2ae9c0 20 add_watcher() i=0 2024-09-12T01:02:35.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.730+0000 7efd7f2ae9c0 20 add_watcher() i=1 2024-09-12T01:02:35.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.730+0000 7efd7f2ae9c0 20 add_watcher() i=2 2024-09-12T01:02:35.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.730+0000 7efd7f2ae9c0 20 add_watcher() i=3 2024-09-12T01:02:35.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.730+0000 7efd7f2ae9c0 20 add_watcher() i=4 2024-09-12T01:02:35.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.730+0000 7efd7f2ae9c0 20 add_watcher() i=5 2024-09-12T01:02:35.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.730+0000 7efd7f2ae9c0 20 add_watcher() i=6 2024-09-12T01:02:35.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.730+0000 7efd7f2ae9c0 20 add_watcher() i=7 2024-09-12T01:02:35.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.730+0000 7efd7f2ae9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:35.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.734+0000 7efc337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:35.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.734+0000 7efd7f2ae9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:35.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.734+0000 7efd7f2ae9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:35.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.822+0000 7efc327e4640 20 reqs_thread_entry: start 2024-09-12T01:02:35.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.822+0000 7efd7f2ae9c0 20 init_complete bucket index max shards: 1 2024-09-12T01:02:35.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.822+0000 7efd7f2ae9c0 20 Filter name: none 2024-09-12T01:02:35.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.822+0000 7efc2b7fe640 20 reqs_thread_entry: start 2024-09-12T01:02:35.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.822+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:02:35.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.826+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:35.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.830+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:35.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.830+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:35.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.830+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:02:35.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.834+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:35.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.834+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:35.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.834+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:35.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.834+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:02:35.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.838+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:35.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.842+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:35.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.842+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:02:35.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.842+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12503437198379807269', time=2024-09-12T03:02:10.041170+0000, chain.objs.size()=5 2024-09-12T01:02:35.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.842+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__multipart_key1.2~Nk5UlHtY0IxzxcCCAiGVGeCWcBGP4yg.1 2024-09-12T01:02:35.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.842+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__multipart_key1.2~Nk5UlHtY0IxzxcCCAiGVGeCWcBGP4yg.2 2024-09-12T01:02:35.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.842+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__multipart_key1.2~Nk5UlHtY0IxzxcCCAiGVGeCWcBGP4yg.3 2024-09-12T01:02:35.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.842+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__multipart_key1.2~Nk5UlHtY0IxzxcCCAiGVGeCWcBGP4yg.4 2024-09-12T01:02:35.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.842+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__multipart_key1.2~Nk5UlHtY0IxzxcCCAiGVGeCWcBGP4yg.5 2024-09-12T01:02:35.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.842+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9222870820986648708', time=2024-09-12T03:02:19.307209+0000, chain.objs.size()=1 2024-09-12T01:02:35.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.842+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.54__shadow_.SVWWS1dPvnvKbyqtVad5fQXWep95J4J_0 2024-09-12T01:02:35.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.842+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~VTwugKof8XH8so8aQglnHom2AAgju-O', time=2024-09-12T03:02:20.068375+0000, chain.objs.size()=3 2024-09-12T01:02:35.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.842+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.55__multipart_key1.2~VTwugKof8XH8so8aQglnHom2AAgju-O.7 2024-09-12T01:02:35.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.842+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.55__multipart_key1.2~VTwugKof8XH8so8aQglnHom2AAgju-O.10 2024-09-12T01:02:35.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.842+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.55__multipart_key1.2~VTwugKof8XH8so8aQglnHom2AAgju-O.13 2024-09-12T01:02:35.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.854+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:35.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.858+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:02:35.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.862+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:35.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.862+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:35.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.862+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:35.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.862+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:02:35.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.866+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:35.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.866+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:35.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.866+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:02:35.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.866+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13948449985511047075', time=2024-09-12T03:02:07.623719+0000, chain.objs.size()=5 2024-09-12T01:02:35.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.866+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.45__multipart_key1.2~heY83LibKEeRlmQ_ZyLBnSUy892-dvX.1 2024-09-12T01:02:35.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.866+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.45__multipart_key1.2~heY83LibKEeRlmQ_ZyLBnSUy892-dvX.2 2024-09-12T01:02:35.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.866+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.45__multipart_key1.2~heY83LibKEeRlmQ_ZyLBnSUy892-dvX.3 2024-09-12T01:02:35.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.866+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.45__multipart_key1.2~heY83LibKEeRlmQ_ZyLBnSUy892-dvX.4 2024-09-12T01:02:35.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.866+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.45__multipart_key1.2~heY83LibKEeRlmQ_ZyLBnSUy892-dvX.5 2024-09-12T01:02:35.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.866+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1227857317970505535', time=2024-09-12T03:02:13.930314+0000, chain.objs.size()=5 2024-09-12T01:02:35.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.866+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__multipart_key1.2~bDg4Z3EmjuRoPpwwt_fJowh8iWBO4Ud.1 2024-09-12T01:02:35.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.866+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__shadow_key1.2~bDg4Z3EmjuRoPpwwt_fJowh8iWBO4Ud.1_1 2024-09-12T01:02:35.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.866+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__multipart_key1.2~bDg4Z3EmjuRoPpwwt_fJowh8iWBO4Ud.2 2024-09-12T01:02:35.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.866+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__shadow_key1.2~bDg4Z3EmjuRoPpwwt_fJowh8iWBO4Ud.2_1 2024-09-12T01:02:35.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.866+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__multipart_key1.2~bDg4Z3EmjuRoPpwwt_fJowh8iWBO4Ud.3 2024-09-12T01:02:35.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.866+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18248824618665480308', time=2024-09-12T03:02:28.257797+0000, chain.objs.size()=11 2024-09-12T01:02:35.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.866+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~lPpRdqitcDmxcU_Wfs81dXUrFGFuSgj.1 2024-09-12T01:02:35.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.866+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__shadow_key1.2~lPpRdqitcDmxcU_Wfs81dXUrFGFuSgj.1_1 2024-09-12T01:02:35.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.874+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~lPpRdqitcDmxcU_Wfs81dXUrFGFuSgj.2 2024-09-12T01:02:35.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.878+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__shadow_key1.2~lPpRdqitcDmxcU_Wfs81dXUrFGFuSgj.2_1 2024-09-12T01:02:35.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.878+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~lPpRdqitcDmxcU_Wfs81dXUrFGFuSgj.3 2024-09-12T01:02:35.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.878+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__shadow_key1.2~lPpRdqitcDmxcU_Wfs81dXUrFGFuSgj.3_1 2024-09-12T01:02:35.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.878+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~lPpRdqitcDmxcU_Wfs81dXUrFGFuSgj.4 2024-09-12T01:02:35.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.878+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__shadow_key1.2~lPpRdqitcDmxcU_Wfs81dXUrFGFuSgj.4_1 2024-09-12T01:02:35.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.878+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~lPpRdqitcDmxcU_Wfs81dXUrFGFuSgj.5 2024-09-12T01:02:35.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.878+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__shadow_key1.2~lPpRdqitcDmxcU_Wfs81dXUrFGFuSgj.5_1 2024-09-12T01:02:35.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.878+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~lPpRdqitcDmxcU_Wfs81dXUrFGFuSgj.6 2024-09-12T01:02:35.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.886+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:35.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.890+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:02:35.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.894+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:35.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.894+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:35.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.894+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:02:35.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.894+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7115320619434784242', time=2024-09-12T03:02:32.385263+0000, chain.objs.size()=1 2024-09-12T01:02:35.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.894+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.61__shadow_.WEhKjl2fK1ywKNHC6vo4K2NNSIaz3Fo_0 2024-09-12T01:02:35.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.898+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:35.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.902+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:02:35.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.906+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:35.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.906+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:35.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.906+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:35.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.910+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:02:35.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.914+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:35.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.914+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:35.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.914+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:02:35.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.914+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3465343610704433547', time=2024-09-12T03:02:23.183253+0000, chain.objs.size()=11 2024-09-12T01:02:35.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.914+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~Myu79JG9-evn6WUmjTNz438UcuIEJHY.1 2024-09-12T01:02:35.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.914+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~Myu79JG9-evn6WUmjTNz438UcuIEJHY.2 2024-09-12T01:02:35.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.914+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~Myu79JG9-evn6WUmjTNz438UcuIEJHY.3 2024-09-12T01:02:35.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.914+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~Myu79JG9-evn6WUmjTNz438UcuIEJHY.4 2024-09-12T01:02:35.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.914+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~Myu79JG9-evn6WUmjTNz438UcuIEJHY.5 2024-09-12T01:02:35.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.914+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~Myu79JG9-evn6WUmjTNz438UcuIEJHY.6 2024-09-12T01:02:35.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.914+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~Myu79JG9-evn6WUmjTNz438UcuIEJHY.7 2024-09-12T01:02:35.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.914+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~Myu79JG9-evn6WUmjTNz438UcuIEJHY.8 2024-09-12T01:02:35.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.914+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~Myu79JG9-evn6WUmjTNz438UcuIEJHY.9 2024-09-12T01:02:35.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.914+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~Myu79JG9-evn6WUmjTNz438UcuIEJHY.10 2024-09-12T01:02:35.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.914+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~Myu79JG9-evn6WUmjTNz438UcuIEJHY.11 2024-09-12T01:02:35.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.930+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:35.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.934+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:02:35.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.938+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:35.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.938+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:35.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.938+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:35.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.942+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:02:35.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.942+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:35.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.946+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:35.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.946+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:35.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.946+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:02:35.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.950+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:35.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.950+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:35.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.950+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:02:35.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.950+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7273174807070169769', time=2024-09-12T03:02:13.160767+0000, chain.objs.size()=5 2024-09-12T01:02:35.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.950+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__multipart_key1.2~DKzA_wBvUx9oxGCRE_PJw3RYcRtHAmi.1 2024-09-12T01:02:35.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.950+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__shadow_key1.2~DKzA_wBvUx9oxGCRE_PJw3RYcRtHAmi.1_1 2024-09-12T01:02:35.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.950+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__multipart_key1.2~DKzA_wBvUx9oxGCRE_PJw3RYcRtHAmi.2 2024-09-12T01:02:35.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.950+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__shadow_key1.2~DKzA_wBvUx9oxGCRE_PJw3RYcRtHAmi.2_1 2024-09-12T01:02:35.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.950+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__multipart_key1.2~DKzA_wBvUx9oxGCRE_PJw3RYcRtHAmi.3 2024-09-12T01:02:35.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.950+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12065264354158528991', time=2024-09-12T03:02:29.427058+0000, chain.objs.size()=1 2024-09-12T01:02:35.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.950+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.57__shadow_.fSU2FvomwqUz6M1T5nyw9BFIcm-uNgx_0 2024-09-12T01:02:35.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.950+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17967514012292775556', time=2024-09-12T03:02:32.661438+0000, chain.objs.size()=1 2024-09-12T01:02:35.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.950+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.62__shadow_.HjrPMmKytixHTkmED-oR7D2ur5NoQBl_0 2024-09-12T01:02:35.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.958+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:35.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.962+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:02:35.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.966+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:35.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.970+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:35.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.970+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:35.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.974+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:02:35.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.978+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:35.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.978+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:35.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.978+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:02:35.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.978+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10575207938297915578', time=2024-09-12T03:02:19.302112+0000, chain.objs.size()=5 2024-09-12T01:02:35.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.978+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.54__multipart_file2.mpg.2~SF1pPNJoBNJRa99KMd-KEizWS0celZL.1 2024-09-12T01:02:35.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.978+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.54__multipart_file2.mpg.2~SF1pPNJoBNJRa99KMd-KEizWS0celZL.2 2024-09-12T01:02:35.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.978+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.54__multipart_file2.mpg.2~SF1pPNJoBNJRa99KMd-KEizWS0celZL.3 2024-09-12T01:02:35.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.978+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.54__multipart_file2.mpg.2~SF1pPNJoBNJRa99KMd-KEizWS0celZL.4 2024-09-12T01:02:35.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.978+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.54__multipart_file2.mpg.2~SF1pPNJoBNJRa99KMd-KEizWS0celZL.5 2024-09-12T01:02:35.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.978+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8838294285896892337', time=2024-09-12T03:02:34.748300+0000, chain.objs.size()=11 2024-09-12T01:02:35.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.978+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.67__multipart_key1.2~TIEvjASbrda0AT1Ny2WuRf4SSiwWVD3.1 2024-09-12T01:02:35.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.978+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.67__multipart_key1.2~TIEvjASbrda0AT1Ny2WuRf4SSiwWVD3.2 2024-09-12T01:02:35.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.978+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.67__multipart_key1.2~TIEvjASbrda0AT1Ny2WuRf4SSiwWVD3.3 2024-09-12T01:02:35.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.978+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.67__multipart_key1.2~TIEvjASbrda0AT1Ny2WuRf4SSiwWVD3.4 2024-09-12T01:02:35.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.978+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.67__multipart_key1.2~TIEvjASbrda0AT1Ny2WuRf4SSiwWVD3.5 2024-09-12T01:02:35.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.978+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.67__multipart_key1.2~TIEvjASbrda0AT1Ny2WuRf4SSiwWVD3.6 2024-09-12T01:02:35.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.978+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.67__multipart_key1.2~TIEvjASbrda0AT1Ny2WuRf4SSiwWVD3.7 2024-09-12T01:02:35.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.990+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.67__multipart_key1.2~TIEvjASbrda0AT1Ny2WuRf4SSiwWVD3.8 2024-09-12T01:02:35.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.990+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.67__multipart_key1.2~TIEvjASbrda0AT1Ny2WuRf4SSiwWVD3.9 2024-09-12T01:02:35.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.990+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.67__multipart_key1.2~TIEvjASbrda0AT1Ny2WuRf4SSiwWVD3.10 2024-09-12T01:02:35.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:35.990+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.67__multipart_key1.2~TIEvjASbrda0AT1Ny2WuRf4SSiwWVD3.11 2024-09-12T01:02:35.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.002+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:35.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.006+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:02:36.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.010+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.010+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.014+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:02:36.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.014+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15429784467868775835', time=2024-09-12T03:02:14.257999+0000, chain.objs.size()=5 2024-09-12T01:02:36.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.014+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__multipart_key1.2~363_ZWeKA7VO7ziDD3nfJRNLfxNFz_Q.1 2024-09-12T01:02:36.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.014+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__shadow_key1.2~363_ZWeKA7VO7ziDD3nfJRNLfxNFz_Q.1_1 2024-09-12T01:02:36.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.014+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__multipart_key1.2~363_ZWeKA7VO7ziDD3nfJRNLfxNFz_Q.2 2024-09-12T01:02:36.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.014+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__shadow_key1.2~363_ZWeKA7VO7ziDD3nfJRNLfxNFz_Q.2_1 2024-09-12T01:02:36.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.014+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__multipart_key1.2~363_ZWeKA7VO7ziDD3nfJRNLfxNFz_Q.3 2024-09-12T01:02:36.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.014+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8691508886832061548', time=2024-09-12T03:02:32.944445+0000, chain.objs.size()=1 2024-09-12T01:02:36.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.014+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.63__shadow_.j_LStaTtHbFT54Sp-5i3bBydBlRAy0w_0 2024-09-12T01:02:36.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.018+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:36.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.026+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:02:36.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.026+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.030+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.030+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:02:36.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.030+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15575191341295232381', time=2024-09-12T03:02:06.308031+0000, chain.objs.size()=5 2024-09-12T01:02:36.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.030+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.43__multipart_key1.2~1y6EuSkNOqd3EE1n4xCT1RGWMkEpm5c.1 2024-09-12T01:02:36.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.030+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.43__multipart_key1.2~1y6EuSkNOqd3EE1n4xCT1RGWMkEpm5c.2 2024-09-12T01:02:36.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.030+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.43__multipart_key1.2~1y6EuSkNOqd3EE1n4xCT1RGWMkEpm5c.3 2024-09-12T01:02:36.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.030+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.43__multipart_key1.2~1y6EuSkNOqd3EE1n4xCT1RGWMkEpm5c.4 2024-09-12T01:02:36.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.030+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.43__multipart_key1.2~1y6EuSkNOqd3EE1n4xCT1RGWMkEpm5c.5 2024-09-12T01:02:36.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.030+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3305522666991540317', time=2024-09-12T03:02:10.911883+0000, chain.objs.size()=5 2024-09-12T01:02:36.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.030+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__multipart_key1.2~afKOnlLwbXENOx042P4WYBLDvCOQ7er.1 2024-09-12T01:02:36.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.030+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__multipart_key1.2~afKOnlLwbXENOx042P4WYBLDvCOQ7er.2 2024-09-12T01:02:36.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.030+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__multipart_key1.2~afKOnlLwbXENOx042P4WYBLDvCOQ7er.3 2024-09-12T01:02:36.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.030+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__multipart_key1.2~afKOnlLwbXENOx042P4WYBLDvCOQ7er.4 2024-09-12T01:02:36.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.030+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__multipart_key1.2~afKOnlLwbXENOx042P4WYBLDvCOQ7er.5 2024-09-12T01:02:36.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.042+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:36.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.046+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:02:36.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.050+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.054+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.054+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:02:36.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.054+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17949636552060559638', time=2024-09-12T03:02:19.321520+0000, chain.objs.size()=1 2024-09-12T01:02:36.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.054+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.54__shadow_._1ecrxmIi3wOeiouOqQhMjs1U-IPqb__0 2024-09-12T01:02:36.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.058+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:36.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.062+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:02:36.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.066+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.070+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.070+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:02:36.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.070+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5591891604147423985', time=2024-09-12T03:02:30.115829+0000, chain.objs.size()=5 2024-09-12T01:02:36.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.070+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.57__multipart_key1.2~ZbHds1qIVnRFoihASI8hJkySK6guYaM.1 2024-09-12T01:02:36.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.070+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.57__multipart_key1.2~ZbHds1qIVnRFoihASI8hJkySK6guYaM.2 2024-09-12T01:02:36.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.070+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.57__multipart_key1.2~ZbHds1qIVnRFoihASI8hJkySK6guYaM.3 2024-09-12T01:02:36.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.070+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.57__multipart_key1.2~ZbHds1qIVnRFoihASI8hJkySK6guYaM.4 2024-09-12T01:02:36.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.070+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.57__multipart_key1.2~ZbHds1qIVnRFoihASI8hJkySK6guYaM.5 2024-09-12T01:02:36.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.078+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:36.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.082+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:02:36.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.086+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.086+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.086+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:02:36.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.086+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13775187293144371935', time=2024-09-12T03:02:15.641491+0000, chain.objs.size()=5 2024-09-12T01:02:36.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.086+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.52__multipart_key1.2~Zn-kXU3Qtw1AlLcyBJZkKy6hp29xEZW.1 2024-09-12T01:02:36.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.086+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.52__multipart_key1.2~Zn-kXU3Qtw1AlLcyBJZkKy6hp29xEZW.2 2024-09-12T01:02:36.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.086+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.52__multipart_key1.2~Zn-kXU3Qtw1AlLcyBJZkKy6hp29xEZW.3 2024-09-12T01:02:36.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.086+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.52__multipart_key1.2~Zn-kXU3Qtw1AlLcyBJZkKy6hp29xEZW.4 2024-09-12T01:02:36.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.086+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.52__multipart_key1.2~Zn-kXU3Qtw1AlLcyBJZkKy6hp29xEZW.5 2024-09-12T01:02:36.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.086+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10129996334921423988', time=2024-09-12T03:02:24.497671+0000, chain.objs.size()=11 2024-09-12T01:02:36.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.086+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~YiDlG-7M75ioV579hUNi_pqkZ5IQ_rw.1 2024-09-12T01:02:36.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.086+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~YiDlG-7M75ioV579hUNi_pqkZ5IQ_rw.2 2024-09-12T01:02:36.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.086+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~YiDlG-7M75ioV579hUNi_pqkZ5IQ_rw.3 2024-09-12T01:02:36.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.086+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~YiDlG-7M75ioV579hUNi_pqkZ5IQ_rw.4 2024-09-12T01:02:36.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.086+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~YiDlG-7M75ioV579hUNi_pqkZ5IQ_rw.5 2024-09-12T01:02:36.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.086+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~YiDlG-7M75ioV579hUNi_pqkZ5IQ_rw.6 2024-09-12T01:02:36.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.086+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~YiDlG-7M75ioV579hUNi_pqkZ5IQ_rw.7 2024-09-12T01:02:36.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.098+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~YiDlG-7M75ioV579hUNi_pqkZ5IQ_rw.8 2024-09-12T01:02:36.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.098+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~YiDlG-7M75ioV579hUNi_pqkZ5IQ_rw.9 2024-09-12T01:02:36.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.098+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~YiDlG-7M75ioV579hUNi_pqkZ5IQ_rw.10 2024-09-12T01:02:36.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.098+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~YiDlG-7M75ioV579hUNi_pqkZ5IQ_rw.11 2024-09-12T01:02:36.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.098+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17748591751559265096', time=2024-09-12T03:02:33.509111+0000, chain.objs.size()=1 2024-09-12T01:02:36.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.098+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.65__shadow_.HdgNaWC5XUSibtZT28cAxwjiG4BGcyD_0 2024-09-12T01:02:36.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.106+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:36.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.114+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:02:36.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.118+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.118+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.118+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:02:36.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.118+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.308795369447118128', time=2024-09-12T03:02:11.639072+0000, chain.objs.size()=5 2024-09-12T01:02:36.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.118+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__multipart_key1.2~BNZhe_WnheDCEpgC_SDg-FqZ93T7DtX.1 2024-09-12T01:02:36.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.118+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__multipart_key1.2~BNZhe_WnheDCEpgC_SDg-FqZ93T7DtX.2 2024-09-12T01:02:36.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.118+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__multipart_key1.2~BNZhe_WnheDCEpgC_SDg-FqZ93T7DtX.3 2024-09-12T01:02:36.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.118+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__multipart_key1.2~BNZhe_WnheDCEpgC_SDg-FqZ93T7DtX.4 2024-09-12T01:02:36.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.122+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48__multipart_key1.2~BNZhe_WnheDCEpgC_SDg-FqZ93T7DtX.5 2024-09-12T01:02:36.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.122+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9806782368256931058', time=2024-09-12T03:02:19.287953+0000, chain.objs.size()=1 2024-09-12T01:02:36.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.122+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.54__shadow_.IG2hCiKQrnXalWHEVMU1fT_DNyE2IDf_0 2024-09-12T01:02:36.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.122+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8582536205443374780', time=2024-09-12T03:02:33.231859+0000, chain.objs.size()=1 2024-09-12T01:02:36.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.122+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.64__shadow_.DYT6ISjrVhK5HopK9ia6vR1E1CO2mK0_0 2024-09-12T01:02:36.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.130+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:36.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.134+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:02:36.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.138+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.138+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.138+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.142+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:02:36.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.146+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.150+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.150+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:02:36.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.150+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2875112815715780948', time=2024-09-12T03:02:18.480844+0000, chain.objs.size()=5 2024-09-12T01:02:36.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.150+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.53__multipart_key1.2~LdQg7BhqT6B32kyf7_bXxpC-8QGcB6c.1 2024-09-12T01:02:36.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.150+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.53__multipart_key1.2~LdQg7BhqT6B32kyf7_bXxpC-8QGcB6c.2 2024-09-12T01:02:36.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.150+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.53__multipart_key1.2~LdQg7BhqT6B32kyf7_bXxpC-8QGcB6c.3 2024-09-12T01:02:36.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.150+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.53__multipart_key1.2~LdQg7BhqT6B32kyf7_bXxpC-8QGcB6c.4 2024-09-12T01:02:36.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.150+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.53__multipart_key1.2~LdQg7BhqT6B32kyf7_bXxpC-8QGcB6c.5 2024-09-12T01:02:36.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.150+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3534026209304242428', time=2024-09-12T03:02:31.156606+0000, chain.objs.size()=5 2024-09-12T01:02:36.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.150+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.58__multipart_key1.2~k7I-cFvNuKiIUouGPzlzUQtVgZRgGQ9.1 2024-09-12T01:02:36.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.150+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.58__multipart_key1.2~k7I-cFvNuKiIUouGPzlzUQtVgZRgGQ9.2 2024-09-12T01:02:36.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.150+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.58__multipart_key1.2~k7I-cFvNuKiIUouGPzlzUQtVgZRgGQ9.3 2024-09-12T01:02:36.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.150+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.58__multipart_key1.2~k7I-cFvNuKiIUouGPzlzUQtVgZRgGQ9.4 2024-09-12T01:02:36.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.150+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.58__multipart_key1.2~k7I-cFvNuKiIUouGPzlzUQtVgZRgGQ9.5 2024-09-12T01:02:36.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.162+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:36.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.170+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:02:36.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.174+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.174+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.174+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.178+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:02:36.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.186+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.186+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.190+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:02:36.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.190+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3738177006283409779', time=2024-09-12T03:02:14.102970+0000, chain.objs.size()=4 2024-09-12T01:02:36.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.190+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.47__shadow_.JRKq_DkeIX4LmBceVIXcXp1tbn2E42G_0 2024-09-12T01:02:36.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.190+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.47__shadow_.JRKq_DkeIX4LmBceVIXcXp1tbn2E42G_1 2024-09-12T01:02:36.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.190+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.47__shadow_.JRKq_DkeIX4LmBceVIXcXp1tbn2E42G_2 2024-09-12T01:02:36.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.190+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.47__shadow_.JRKq_DkeIX4LmBceVIXcXp1tbn2E42G_3 2024-09-12T01:02:36.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.198+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:36.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.202+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:02:36.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.206+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.210+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.210+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:02:36.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.210+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd', time=2024-09-12T03:02:31.876661+0000, chain.objs.size()=57 2024-09-12T01:02:36.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.210+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.1 2024-09-12T01:02:36.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.210+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.2 2024-09-12T01:02:36.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.210+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.3 2024-09-12T01:02:36.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.210+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.4 2024-09-12T01:02:36.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.210+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.5 2024-09-12T01:02:36.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.210+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.6 2024-09-12T01:02:36.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.210+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.7 2024-09-12T01:02:36.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.210+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.8 2024-09-12T01:02:36.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.210+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.9 2024-09-12T01:02:36.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.210+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.10 2024-09-12T01:02:36.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.210+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.11 2024-09-12T01:02:36.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.210+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.12 2024-09-12T01:02:36.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.218+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.13 2024-09-12T01:02:36.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.218+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.14 2024-09-12T01:02:36.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.218+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.15 2024-09-12T01:02:36.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.218+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.16 2024-09-12T01:02:36.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.218+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.17 2024-09-12T01:02:36.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.218+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.18 2024-09-12T01:02:36.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.218+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.19 2024-09-12T01:02:36.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.218+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.20 2024-09-12T01:02:36.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.218+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.21 2024-09-12T01:02:36.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.218+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.22 2024-09-12T01:02:36.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.218+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.23 2024-09-12T01:02:36.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.222+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.24 2024-09-12T01:02:36.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.222+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.25 2024-09-12T01:02:36.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.222+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.26 2024-09-12T01:02:36.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.222+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.27 2024-09-12T01:02:36.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.222+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.28 2024-09-12T01:02:36.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.222+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.29 2024-09-12T01:02:36.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.222+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.30 2024-09-12T01:02:36.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.222+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.31 2024-09-12T01:02:36.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.222+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.32 2024-09-12T01:02:36.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.222+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.33 2024-09-12T01:02:36.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.222+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.34 2024-09-12T01:02:36.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.230+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.35 2024-09-12T01:02:36.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.230+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.36 2024-09-12T01:02:36.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.230+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.37 2024-09-12T01:02:36.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.230+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.38 2024-09-12T01:02:36.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.230+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.39 2024-09-12T01:02:36.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.230+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.40 2024-09-12T01:02:36.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.230+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.41 2024-09-12T01:02:36.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.230+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.42 2024-09-12T01:02:36.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.230+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.43 2024-09-12T01:02:36.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.230+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.44 2024-09-12T01:02:36.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.230+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.45 2024-09-12T01:02:36.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.234+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.46 2024-09-12T01:02:36.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.234+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.47 2024-09-12T01:02:36.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.234+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.48 2024-09-12T01:02:36.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.238+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.49 2024-09-12T01:02:36.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.238+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.50 2024-09-12T01:02:36.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.238+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.51 2024-09-12T01:02:36.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.238+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.52 2024-09-12T01:02:36.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.238+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.53 2024-09-12T01:02:36.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.238+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.54 2024-09-12T01:02:36.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.238+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.55 2024-09-12T01:02:36.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.238+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.56 2024-09-12T01:02:36.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.238+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.59__multipart_key1.2~_fWdJmrUTRdT853UmwGVTzOSfMjOswd.57 2024-09-12T01:02:36.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.246+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:36.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.250+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:02:36.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.254+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.254+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.254+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.258+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:02:36.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.262+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.262+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.262+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:02:36.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.262+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9062208879588802559', time=2024-09-12T03:02:32.112265+0000, chain.objs.size()=1 2024-09-12T01:02:36.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.262+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.60__shadow_.bAIY9Ac70HXCCXZ-xi72PFHWFuWJ5kp_0 2024-09-12T01:02:36.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.266+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:36.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.270+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:02:36.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.274+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.274+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.274+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:02:36.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.274+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9548466490208696167', time=2024-09-12T03:02:19.266021+0000, chain.objs.size()=5 2024-09-12T01:02:36.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.274+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.54__multipart_file.mpg.2~mDt2FiZ2uaFJRs5Ieyp9cHiFnjzdBJx.1 2024-09-12T01:02:36.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.274+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.54__multipart_file.mpg.2~mDt2FiZ2uaFJRs5Ieyp9cHiFnjzdBJx.2 2024-09-12T01:02:36.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.274+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.54__multipart_file.mpg.2~mDt2FiZ2uaFJRs5Ieyp9cHiFnjzdBJx.3 2024-09-12T01:02:36.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.274+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.54__multipart_file.mpg.2~mDt2FiZ2uaFJRs5Ieyp9cHiFnjzdBJx.4 2024-09-12T01:02:36.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.274+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.54__multipart_file.mpg.2~mDt2FiZ2uaFJRs5Ieyp9cHiFnjzdBJx.5 2024-09-12T01:02:36.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.274+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6234581531615168718', time=2024-09-12T03:02:28.414899+0000, chain.objs.size()=11 2024-09-12T01:02:36.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.274+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~_Og9_VgYnBW9TZ3k7AIJ58xSwc1YqoF.1 2024-09-12T01:02:36.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.274+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__shadow_key1.2~_Og9_VgYnBW9TZ3k7AIJ58xSwc1YqoF.1_1 2024-09-12T01:02:36.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.274+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~_Og9_VgYnBW9TZ3k7AIJ58xSwc1YqoF.2 2024-09-12T01:02:36.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.274+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__shadow_key1.2~_Og9_VgYnBW9TZ3k7AIJ58xSwc1YqoF.2_1 2024-09-12T01:02:36.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.274+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~_Og9_VgYnBW9TZ3k7AIJ58xSwc1YqoF.3 2024-09-12T01:02:36.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.274+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__shadow_key1.2~_Og9_VgYnBW9TZ3k7AIJ58xSwc1YqoF.3_1 2024-09-12T01:02:36.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.274+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~_Og9_VgYnBW9TZ3k7AIJ58xSwc1YqoF.4 2024-09-12T01:02:36.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.282+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__shadow_key1.2~_Og9_VgYnBW9TZ3k7AIJ58xSwc1YqoF.4_1 2024-09-12T01:02:36.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.286+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~_Og9_VgYnBW9TZ3k7AIJ58xSwc1YqoF.5 2024-09-12T01:02:36.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.286+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__shadow_key1.2~_Og9_VgYnBW9TZ3k7AIJ58xSwc1YqoF.5_1 2024-09-12T01:02:36.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.290+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~_Og9_VgYnBW9TZ3k7AIJ58xSwc1YqoF.6 2024-09-12T01:02:36.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.294+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:36.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.302+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:02:36.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.306+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.306+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.306+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:02:36.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.306+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5980741671581403805', time=2024-09-12T03:02:07.458334+0000, chain.objs.size()=5 2024-09-12T01:02:36.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.306+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.45__multipart_key1.2~heY83LibKEeRlmQ_ZyLBnSUy892-dvX.1 2024-09-12T01:02:36.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.306+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.45__multipart_key1.2~heY83LibKEeRlmQ_ZyLBnSUy892-dvX.2 2024-09-12T01:02:36.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.306+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.45__multipart_key1.2~heY83LibKEeRlmQ_ZyLBnSUy892-dvX.3 2024-09-12T01:02:36.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.306+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.45__multipart_key1.2~heY83LibKEeRlmQ_ZyLBnSUy892-dvX.4 2024-09-12T01:02:36.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.306+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.45__multipart_key1.2~heY83LibKEeRlmQ_ZyLBnSUy892-dvX.5 2024-09-12T01:02:36.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.314+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:36.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.322+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:02:36.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.326+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.326+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.330+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.330+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:02:36.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.334+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.334+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.338+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.338+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:02:36.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.342+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.342+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.342+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:02:36.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.342+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~qrBZxh6Joy3plQdyh4vgtUM_emwVdBf', time=2024-09-12T03:02:04.969246+0000, chain.objs.size()=5 2024-09-12T01:02:36.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.342+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.41__multipart_key1.2~qrBZxh6Joy3plQdyh4vgtUM_emwVdBf.1 2024-09-12T01:02:36.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.342+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.41__multipart_key1.2~qrBZxh6Joy3plQdyh4vgtUM_emwVdBf.2 2024-09-12T01:02:36.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.342+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.41__multipart_key1.2~qrBZxh6Joy3plQdyh4vgtUM_emwVdBf.3 2024-09-12T01:02:36.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.342+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.41__multipart_key1.2~qrBZxh6Joy3plQdyh4vgtUM_emwVdBf.4 2024-09-12T01:02:36.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.342+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.41__multipart_key1.2~qrBZxh6Joy3plQdyh4vgtUM_emwVdBf.5 2024-09-12T01:02:36.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.346+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3069164562314003377', time=2024-09-12T03:02:25.723488+0000, chain.objs.size()=10 2024-09-12T01:02:36.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.346+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~m0SXhL4-Y-maZz_usHMPoISLwgNy1S0.1 2024-09-12T01:02:36.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.346+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~m0SXhL4-Y-maZz_usHMPoISLwgNy1S0.2 2024-09-12T01:02:36.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.346+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~m0SXhL4-Y-maZz_usHMPoISLwgNy1S0.3 2024-09-12T01:02:36.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.346+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~m0SXhL4-Y-maZz_usHMPoISLwgNy1S0.4 2024-09-12T01:02:36.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.346+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~m0SXhL4-Y-maZz_usHMPoISLwgNy1S0.5 2024-09-12T01:02:36.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.346+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~m0SXhL4-Y-maZz_usHMPoISLwgNy1S0.6 2024-09-12T01:02:36.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.346+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~m0SXhL4-Y-maZz_usHMPoISLwgNy1S0.7 2024-09-12T01:02:36.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.350+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~m0SXhL4-Y-maZz_usHMPoISLwgNy1S0.8 2024-09-12T01:02:36.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.354+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~m0SXhL4-Y-maZz_usHMPoISLwgNy1S0.9 2024-09-12T01:02:36.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.354+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~m0SXhL4-Y-maZz_usHMPoISLwgNy1S0.10 2024-09-12T01:02:36.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.358+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8354007056335271097', time=2024-09-12T03:02:27.024544+0000, chain.objs.size()=11 2024-09-12T01:02:36.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.358+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~Apj69VTA7pRo2ywJFjxJfRwRMWzWAxg.1 2024-09-12T01:02:36.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.358+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__shadow_key1.2~Apj69VTA7pRo2ywJFjxJfRwRMWzWAxg.1_1 2024-09-12T01:02:36.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.358+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~Apj69VTA7pRo2ywJFjxJfRwRMWzWAxg.2 2024-09-12T01:02:36.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.358+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__shadow_key1.2~Apj69VTA7pRo2ywJFjxJfRwRMWzWAxg.2_1 2024-09-12T01:02:36.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.358+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~Apj69VTA7pRo2ywJFjxJfRwRMWzWAxg.3 2024-09-12T01:02:36.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.358+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__shadow_key1.2~Apj69VTA7pRo2ywJFjxJfRwRMWzWAxg.3_1 2024-09-12T01:02:36.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.358+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~Apj69VTA7pRo2ywJFjxJfRwRMWzWAxg.4 2024-09-12T01:02:36.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.358+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__shadow_key1.2~Apj69VTA7pRo2ywJFjxJfRwRMWzWAxg.4_1 2024-09-12T01:02:36.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.362+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~Apj69VTA7pRo2ywJFjxJfRwRMWzWAxg.5 2024-09-12T01:02:36.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.362+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__shadow_key1.2~Apj69VTA7pRo2ywJFjxJfRwRMWzWAxg.5_1 2024-09-12T01:02:36.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.362+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56__multipart_key1.2~Apj69VTA7pRo2ywJFjxJfRwRMWzWAxg.6 2024-09-12T01:02:36.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.370+0000 7efd7f2ae9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:36.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.374+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:02:36.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.382+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.382+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.382+0000 7efd7f2ae9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.390+0000 7efc337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:36.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.394+0000 7efd7f2ae9c0 20 remove_watcher() i=0 2024-09-12T01:02:36.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.394+0000 7efd7f2ae9c0 2 removed watcher, disabling cache 2024-09-12T01:02:36.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.394+0000 7efd7f2ae9c0 20 remove_watcher() i=1 2024-09-12T01:02:36.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.398+0000 7efd7f2ae9c0 20 remove_watcher() i=2 2024-09-12T01:02:36.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.402+0000 7efd7f2ae9c0 20 remove_watcher() i=3 2024-09-12T01:02:36.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.402+0000 7efd7f2ae9c0 20 remove_watcher() i=4 2024-09-12T01:02:36.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.406+0000 7efd7f2ae9c0 20 remove_watcher() i=5 2024-09-12T01:02:36.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.406+0000 7efd7f2ae9c0 20 remove_watcher() i=6 2024-09-12T01:02:36.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.410+0000 7efd7f2ae9c0 20 remove_watcher() i=7 2024-09-12T01:02:36.418 DEBUG:teuthology.orchestra.run.smithi070:> radosgw-admin gc process --include-all 2024-09-12T01:02:36.493 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:36.493 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:36.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.546+0000 7fe4c2d139c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:36.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.550+0000 7fe4c2d139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:36.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.550+0000 7fe4c2d139c0 20 realm 2024-09-12T01:02:36.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.550+0000 7fe4c2d139c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:36.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.550+0000 7fe4c2d139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:36.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.550+0000 7fe4c2d139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:36.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.550+0000 7fe4c2d139c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:36.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.550+0000 7fe4c2d139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:36.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.550+0000 7fe4c2d139c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:36.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.550+0000 7fe4c2d139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:36.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.550+0000 7fe4c2d139c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:36.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.554+0000 7fe4c2d139c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:36.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.554+0000 7fe4c2d139c0 20 searching for the correct realm 2024-09-12T01:02:36.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.554+0000 7fe4c101a640 0 -- 172.21.15.70:0/766660347 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fe4b4099c20 msgr2=0x7fe4b4092990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:36.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.770+0000 7fe4c101a640 0 -- 172.21.15.70:0/766660347 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fe4b4099c20 msgr2=0x7fe4b4092990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:36.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.782+0000 7fe4c2d139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:36.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.782+0000 7fe4c2d139c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:02:36.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.782+0000 7fe4c2d139c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:36.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.782+0000 7fe4c2d139c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:02:36.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.782+0000 7fe4c2d139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:36.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.782+0000 7fe4c2d139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:36.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.782+0000 7fe4c2d139c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:36.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.782+0000 7fe4c2d139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:36.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.782+0000 7fe4c2d139c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:36.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.782+0000 7fe4c2d139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:36.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.782+0000 7fe4c2d139c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:36.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.782+0000 7fe4c2d139c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:36.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.782+0000 7fe4c2d139c0 20 zone default found 2024-09-12T01:02:36.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.782+0000 7fe4c2d139c0 4 Realm: () 2024-09-12T01:02:36.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.782+0000 7fe4c2d139c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:02:36.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.782+0000 7fe4c2d139c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:02:36.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.782+0000 7fe4c2d139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:36.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.782+0000 7fe4c2d139c0 20 zonegroup default 2024-09-12T01:02:36.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.782+0000 7fe4c2d139c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:36.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.786+0000 7fe4c2d139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:36.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.786+0000 7fe4c2d139c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:36.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.786+0000 7fe4c2d139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:36.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.786+0000 7fe4c2d139c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:36.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.786+0000 7fe4c2d139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:36.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.786+0000 7fe4c2d139c0 20 started sync module instance, tier type = 2024-09-12T01:02:36.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.786+0000 7fe4c2d139c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:02:36.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.810+0000 7fe4c2d139c0 20 add_watcher() i=0 2024-09-12T01:02:36.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.810+0000 7fe4c2d139c0 20 add_watcher() i=1 2024-09-12T01:02:36.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.810+0000 7fe4c2d139c0 20 add_watcher() i=2 2024-09-12T01:02:36.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.810+0000 7fe4c2d139c0 20 add_watcher() i=3 2024-09-12T01:02:36.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.810+0000 7fe4c2d139c0 20 add_watcher() i=4 2024-09-12T01:02:36.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.810+0000 7fe4c2d139c0 20 add_watcher() i=5 2024-09-12T01:02:36.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.810+0000 7fe4c2d139c0 20 add_watcher() i=6 2024-09-12T01:02:36.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.814+0000 7fe4c2d139c0 20 add_watcher() i=7 2024-09-12T01:02:36.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.814+0000 7fe4c2d139c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:36.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.818+0000 7fe376fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:36.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.818+0000 7fe4c2d139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:36.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.818+0000 7fe4c2d139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:36.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.918+0000 7fe375fe3640 20 reqs_thread_entry: start 2024-09-12T01:02:36.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.918+0000 7fe4c2d139c0 20 init_complete bucket index max shards: 1 2024-09-12T01:02:36.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.918+0000 7fe4c2d139c0 20 Filter name: none 2024-09-12T01:02:36.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.918+0000 7fe2e77fe640 20 reqs_thread_entry: start 2024-09-12T01:02:36.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.918+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:02:36.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.922+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.926+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.926+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.926+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:02:36.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.930+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.930+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.930+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.934+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:02:36.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.938+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.938+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.938+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.942+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:02:36.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.946+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.946+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.946+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.950+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:02:36.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.954+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.954+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.954+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.958+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:02:36.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.962+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.962+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.966+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.966+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:02:36.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.970+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.970+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.970+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.974+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:02:36.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.978+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.978+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.978+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.982+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:02:36.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.982+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.986+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.986+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.986+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:02:36.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.990+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.994+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.994+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:36.998+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:02:36.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.002+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.002+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:36.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.002+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:36.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.006+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:02:36.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.010+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.010+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.014+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.018+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:02:37.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.018+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.018+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.018+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.022+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:02:37.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.026+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.026+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.026+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.030+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:02:37.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.034+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.034+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.034+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.038+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:02:37.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.042+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.042+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.042+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.046+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:02:37.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.046+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.046+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.050+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.050+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:02:37.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.054+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.054+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.058+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.058+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:02:37.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.062+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.062+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.066+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.066+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:02:37.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.070+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.070+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.070+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.074+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:02:37.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.078+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.078+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.078+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.082+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:02:37.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.086+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.086+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.086+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.090+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:02:37.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.094+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.094+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.094+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.098+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:02:37.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.102+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.102+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.102+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.106+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:02:37.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.110+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.110+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.114+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.114+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:02:37.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.118+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.118+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.118+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.122+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:02:37.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.126+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.126+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.126+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.130+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:02:37.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.134+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.134+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.134+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.134+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:02:37.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.138+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.138+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.142+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.142+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:02:37.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.146+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.150+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.150+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.154+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:02:37.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.158+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.158+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.158+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.162+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:02:37.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.166+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.166+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.170+0000 7fe4c2d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.174+0000 7fe376fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:37.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.178+0000 7fe4c2d139c0 20 remove_watcher() i=0 2024-09-12T01:02:37.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.178+0000 7fe4c2d139c0 2 removed watcher, disabling cache 2024-09-12T01:02:37.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.182+0000 7fe4c2d139c0 20 remove_watcher() i=1 2024-09-12T01:02:37.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.182+0000 7fe4c2d139c0 20 remove_watcher() i=2 2024-09-12T01:02:37.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.186+0000 7fe4c2d139c0 20 remove_watcher() i=3 2024-09-12T01:02:37.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.186+0000 7fe4c2d139c0 20 remove_watcher() i=4 2024-09-12T01:02:37.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.190+0000 7fe4c2d139c0 20 remove_watcher() i=5 2024-09-12T01:02:37.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.190+0000 7fe4c2d139c0 20 remove_watcher() i=6 2024-09-12T01:02:37.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.194+0000 7fe4c2d139c0 20 remove_watcher() i=7 2024-09-12T01:02:37.202 DEBUG:teuthology.orchestra.run.smithi070:> radosgw-admin gc process --include-all 2024-09-12T01:02:37.277 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:37.277 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:37.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.334+0000 7fae44e719c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:37.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.334+0000 7fae44e719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:37.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.334+0000 7fae44e719c0 20 realm 2024-09-12T01:02:37.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.334+0000 7fae44e719c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:37.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.334+0000 7fae44e719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:37.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.334+0000 7fae44e719c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:37.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.334+0000 7fae44e719c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:37.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.334+0000 7fae44e719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:37.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.334+0000 7fae44e719c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:37.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.338+0000 7fae44e719c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:37.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.338+0000 7fae44e719c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:37.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.338+0000 7fae44e719c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:37.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.338+0000 7fae44e719c0 20 searching for the correct realm 2024-09-12T01:02:37.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.546+0000 7fae43178640 0 -- 172.21.15.70:0/3898247189 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fae2c0e3070 msgr2=0x7fae2c0e3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:37.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.962+0000 7fae43178640 0 -- 172.21.15.70:0/3898247189 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fae2c0e3070 msgr2=0x7fae2c0e3450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:37.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.974+0000 7fae44e719c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:37.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.974+0000 7fae44e719c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:02:37.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.974+0000 7fae44e719c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:37.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.974+0000 7fae44e719c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:02:37.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.974+0000 7fae44e719c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:37.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.974+0000 7fae44e719c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:37.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.974+0000 7fae44e719c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:37.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.978+0000 7fae44e719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:37.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.978+0000 7fae44e719c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:37.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.978+0000 7fae44e719c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:37.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.978+0000 7fae44e719c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:37.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.978+0000 7fae44e719c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:37.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.978+0000 7fae44e719c0 20 zone default found 2024-09-12T01:02:37.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.978+0000 7fae44e719c0 4 Realm: () 2024-09-12T01:02:37.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.978+0000 7fae44e719c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:02:37.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.978+0000 7fae44e719c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:02:37.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.978+0000 7fae44e719c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:37.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.978+0000 7fae44e719c0 20 zonegroup default 2024-09-12T01:02:37.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.978+0000 7fae44e719c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:37.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.978+0000 7fae44e719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:37.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.978+0000 7fae44e719c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:37.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.978+0000 7fae44e719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:37.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.978+0000 7fae44e719c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:37.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.982+0000 7fae44e719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:37.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.982+0000 7fae44e719c0 20 started sync module instance, tier type = 2024-09-12T01:02:37.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:37.982+0000 7fae44e719c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:02:37.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.006+0000 7fae44e719c0 20 add_watcher() i=0 2024-09-12T01:02:37.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.006+0000 7fae44e719c0 20 add_watcher() i=1 2024-09-12T01:02:37.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.006+0000 7fae44e719c0 20 add_watcher() i=2 2024-09-12T01:02:37.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.006+0000 7fae44e719c0 20 add_watcher() i=3 2024-09-12T01:02:37.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.006+0000 7fae44e719c0 20 add_watcher() i=4 2024-09-12T01:02:37.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.006+0000 7fae44e719c0 20 add_watcher() i=5 2024-09-12T01:02:37.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.006+0000 7fae44e719c0 20 add_watcher() i=6 2024-09-12T01:02:37.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.006+0000 7fae44e719c0 20 add_watcher() i=7 2024-09-12T01:02:37.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.006+0000 7fae44e719c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:38.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.010+0000 7facf97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:38.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.014+0000 7fae44e719c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:38.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.014+0000 7fae44e719c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:38.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.102+0000 7fac73fff640 20 reqs_thread_entry: start 2024-09-12T01:02:38.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.102+0000 7fae44e719c0 20 init_complete bucket index max shards: 1 2024-09-12T01:02:38.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.102+0000 7fae44e719c0 20 Filter name: none 2024-09-12T01:02:38.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.102+0000 7fac71ffb640 20 reqs_thread_entry: start 2024-09-12T01:02:38.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.102+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:02:38.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.106+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.106+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.106+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.110+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:02:38.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.110+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.110+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.110+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.114+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:02:38.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.118+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.118+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.118+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.122+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:02:38.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.126+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.126+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.126+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.130+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:02:38.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.134+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.134+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.134+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.138+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:02:38.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.138+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.142+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.142+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.142+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:02:38.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.146+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.146+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.146+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.150+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:02:38.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.154+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.154+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.154+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.158+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:02:38.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.162+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.162+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.162+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.162+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:02:38.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.166+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.166+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.166+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.170+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:02:38.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.174+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.174+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.174+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.174+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:02:38.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.182+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.182+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.182+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.186+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:02:38.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.190+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.190+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.190+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.194+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:02:38.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.198+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.198+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.198+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.202+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:02:38.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.206+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.206+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.206+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.210+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:02:38.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.214+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.214+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.214+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.218+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:02:38.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.222+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.222+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.222+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.226+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:02:38.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.230+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.230+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.230+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.234+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:02:38.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.238+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.238+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.242+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.242+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:02:38.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.246+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.250+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.250+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.254+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:02:38.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.258+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.258+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.258+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.262+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:02:38.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.266+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.266+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.266+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.270+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:02:38.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.274+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.278+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.278+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.278+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:02:38.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.282+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.286+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.286+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.290+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:02:38.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.290+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.294+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.294+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.298+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:02:38.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.302+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.302+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.302+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.306+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:02:38.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.310+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.310+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.310+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.314+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:02:38.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.318+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.318+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.318+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.322+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:02:38.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.326+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.326+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.330+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.330+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:02:38.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.334+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.334+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.338+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.338+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:02:38.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.342+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.346+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.346+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.350+0000 7fae44e719c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:02:38.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.354+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.354+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.354+0000 7fae44e719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.362+0000 7facf97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:38.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.366+0000 7fae44e719c0 20 remove_watcher() i=0 2024-09-12T01:02:38.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.366+0000 7fae44e719c0 2 removed watcher, disabling cache 2024-09-12T01:02:38.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.366+0000 7fae44e719c0 20 remove_watcher() i=1 2024-09-12T01:02:38.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.370+0000 7fae44e719c0 20 remove_watcher() i=2 2024-09-12T01:02:38.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.374+0000 7fae44e719c0 20 remove_watcher() i=3 2024-09-12T01:02:38.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.374+0000 7fae44e719c0 20 remove_watcher() i=4 2024-09-12T01:02:38.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.378+0000 7fae44e719c0 20 remove_watcher() i=5 2024-09-12T01:02:38.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.378+0000 7fae44e719c0 20 remove_watcher() i=6 2024-09-12T01:02:38.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.382+0000 7fae44e719c0 20 remove_watcher() i=7 2024-09-12T01:02:38.391 DEBUG:teuthology.orchestra.run.smithi070:> radosgw-admin gc process --include-all 2024-09-12T01:02:38.465 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:38.465 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:38.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.518+0000 7fee56ddb9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:38.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.518+0000 7fee56ddb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:38.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.518+0000 7fee56ddb9c0 20 realm 2024-09-12T01:02:38.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.518+0000 7fee56ddb9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:38.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.522+0000 7fee56ddb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:38.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.522+0000 7fee56ddb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:38.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.522+0000 7fee56ddb9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:38.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.522+0000 7fee56ddb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:38.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.522+0000 7fee56ddb9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:38.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.522+0000 7fee56ddb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:38.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.522+0000 7fee56ddb9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:38.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.522+0000 7fee56ddb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:38.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.522+0000 7fee56ddb9c0 20 searching for the correct realm 2024-09-12T01:02:38.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.526+0000 7fee550e2640 0 -- 172.21.15.70:0/1029807673 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fee48032070 msgr2=0x7fee4806de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:38.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.742+0000 7fee550e2640 0 -- 172.21.15.70:0/1029807673 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fee48032070 msgr2=0x7fee4806de20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:38.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.754+0000 7fee56ddb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:38.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.754+0000 7fee56ddb9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:02:38.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.754+0000 7fee56ddb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:38.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.754+0000 7fee56ddb9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:02:38.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.754+0000 7fee56ddb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:38.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.754+0000 7fee56ddb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:38.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.754+0000 7fee56ddb9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:38.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.754+0000 7fee56ddb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:38.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.754+0000 7fee56ddb9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:38.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.754+0000 7fee56ddb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:38.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.754+0000 7fee56ddb9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:38.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.754+0000 7fee56ddb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:38.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.754+0000 7fee56ddb9c0 20 zone default found 2024-09-12T01:02:38.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.754+0000 7fee56ddb9c0 4 Realm: () 2024-09-12T01:02:38.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.754+0000 7fee56ddb9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:02:38.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.754+0000 7fee56ddb9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:02:38.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.754+0000 7fee56ddb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:38.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.754+0000 7fee56ddb9c0 20 zonegroup default 2024-09-12T01:02:38.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.754+0000 7fee56ddb9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:38.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.758+0000 7fee56ddb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:38.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.758+0000 7fee56ddb9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:38.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.758+0000 7fee56ddb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:38.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.758+0000 7fee56ddb9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:38.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.758+0000 7fee56ddb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:38.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.758+0000 7fee56ddb9c0 20 started sync module instance, tier type = 2024-09-12T01:02:38.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.758+0000 7fee56ddb9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:02:38.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.782+0000 7fee56ddb9c0 20 add_watcher() i=0 2024-09-12T01:02:38.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.782+0000 7fee56ddb9c0 20 add_watcher() i=1 2024-09-12T01:02:38.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.782+0000 7fee56ddb9c0 20 add_watcher() i=2 2024-09-12T01:02:38.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.782+0000 7fee56ddb9c0 20 add_watcher() i=3 2024-09-12T01:02:38.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.782+0000 7fee56ddb9c0 20 add_watcher() i=4 2024-09-12T01:02:38.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.782+0000 7fee56ddb9c0 20 add_watcher() i=5 2024-09-12T01:02:38.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.782+0000 7fee56ddb9c0 20 add_watcher() i=6 2024-09-12T01:02:38.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.786+0000 7fee56ddb9c0 20 add_watcher() i=7 2024-09-12T01:02:38.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.786+0000 7fee56ddb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:38.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.790+0000 7fed0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:38.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.790+0000 7fee56ddb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:38.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.790+0000 7fee56ddb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:38.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.882+0000 7fed0a7e4640 20 reqs_thread_entry: start 2024-09-12T01:02:38.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.882+0000 7fee56ddb9c0 20 init_complete bucket index max shards: 1 2024-09-12T01:02:38.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.882+0000 7fee56ddb9c0 20 Filter name: none 2024-09-12T01:02:38.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.882+0000 7fed037fe640 20 reqs_thread_entry: start 2024-09-12T01:02:38.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.882+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:02:38.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.886+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.886+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.886+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.890+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:02:38.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.894+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.894+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.898+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.898+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:02:38.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.902+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.902+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.902+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.902+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:02:38.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.906+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.910+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.910+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.914+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:02:38.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.918+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.918+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.918+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.922+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:02:38.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.926+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.926+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.926+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.930+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:02:38.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.934+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.934+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.934+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.934+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:02:38.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.938+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.942+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.942+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.946+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:02:38.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.946+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.950+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.950+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.950+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:02:38.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.954+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.954+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.954+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.958+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:02:38.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.962+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.962+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.962+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.966+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:02:38.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.970+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.970+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.970+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.974+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:02:38.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.978+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.978+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.978+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.982+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:02:38.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.986+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.986+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.986+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.990+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:02:38.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.994+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.994+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.994+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.998+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:02:38.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:38.998+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.002+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.002+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.006+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:02:38.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.010+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.010+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.010+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.014+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:02:39.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.018+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.018+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.018+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.022+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:02:39.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.026+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.026+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.026+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.030+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:02:39.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.034+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.034+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.034+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.038+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:02:39.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.042+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.042+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.042+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.046+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:02:39.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.050+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.050+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.050+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.054+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:02:39.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.058+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.058+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.058+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.062+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:02:39.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.066+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.066+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.070+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.070+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:02:39.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.074+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.078+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.078+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.078+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:02:39.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.082+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.086+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.086+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.086+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:02:39.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.090+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.094+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.094+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.098+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:02:39.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.098+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.102+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.102+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.106+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:02:39.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.110+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.110+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.110+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.114+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:02:39.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.118+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.118+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.118+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.122+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:02:39.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.126+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.126+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.126+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.130+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:02:39.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.134+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.134+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.138+0000 7fee56ddb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.142+0000 7fed0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:39.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.146+0000 7fee56ddb9c0 20 remove_watcher() i=0 2024-09-12T01:02:39.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.146+0000 7fee56ddb9c0 2 removed watcher, disabling cache 2024-09-12T01:02:39.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.150+0000 7fee56ddb9c0 20 remove_watcher() i=1 2024-09-12T01:02:39.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.150+0000 7fee56ddb9c0 20 remove_watcher() i=2 2024-09-12T01:02:39.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.154+0000 7fee56ddb9c0 20 remove_watcher() i=3 2024-09-12T01:02:39.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.158+0000 7fee56ddb9c0 20 remove_watcher() i=4 2024-09-12T01:02:39.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.158+0000 7fee56ddb9c0 20 remove_watcher() i=5 2024-09-12T01:02:39.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.158+0000 7fee56ddb9c0 20 remove_watcher() i=6 2024-09-12T01:02:39.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:39.162+0000 7fee56ddb9c0 20 remove_watcher() i=7 2024-09-12T01:02:39.170 DEBUG:teuthology.orchestra.run.smithi070:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-12T01:02:39.872 INFO:teuthology.orchestra.run.smithi070.stdout:> Task :clean 2024-09-12T01:02:40.669 INFO:teuthology.orchestra.run.smithi070.stdout:> Task :compileJava 2024-09-12T01:02:40.770 INFO:teuthology.orchestra.run.smithi070.stdout:> Task :processResources 2024-09-12T01:02:40.770 INFO:teuthology.orchestra.run.smithi070.stdout:> Task :classes 2024-09-12T01:02:41.270 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:41.271 INFO:teuthology.orchestra.run.smithi070.stdout:> Task :compileTestJava 2024-09-12T01:02:41.271 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:41.271 INFO:teuthology.orchestra.run.smithi070.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T01:02:41.271 INFO:teuthology.orchestra.run.smithi070.stdout:> Task :testClasses 2024-09-12T01:02:41.271 INFO:teuthology.orchestra.run.smithi070.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T01:02:41.271 INFO:teuthology.orchestra.run.smithi070.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T01:02:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:43.270 INFO:teuthology.orchestra.run.smithi070.stdout:> Task :test 2024-09-12T01:02:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:43.270 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Bucket tests STANDARD_OUT 2024-09-12T01:02:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12 01:02:42,566 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T01:02:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:43.272 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-12T01:02:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:43.272 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-12T01:02:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:43.272 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-12T01:02:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:43.273 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-12T01:02:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:43.370 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-12T01:02:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:43.370 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-12T01:02:43.670 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:43.670 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-12T01:02:43.770 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:43.770 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-12T01:02:43.870 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:43.870 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-12T01:02:43.970 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:43.970 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-12T01:02:44.270 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:44.270 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-12T01:02:44.270 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:44.270 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-12T01:02:44.370 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:44.370 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-12T01:02:44.470 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:44.470 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-12T01:02:44.870 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:44.870 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-12T01:02:44.970 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:44.970 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-12T01:02:45.270 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:45.270 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-12T01:02:45.270 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:45.270 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-12T01:02:45.371 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:45.371 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------- 2024-09-12T01:02:45.371 INFO:teuthology.orchestra.run.smithi070.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-12T01:02:45.371 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------- 2024-09-12T01:02:45.371 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:45.371 INFO:teuthology.orchestra.run.smithi070.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T01:02:45.371 INFO:teuthology.orchestra.run.smithi070.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T01:02:45.371 INFO:teuthology.orchestra.run.smithi070.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T01:02:45.371 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:45.371 INFO:teuthology.orchestra.run.smithi070.stdout:BUILD SUCCESSFUL in 6s 2024-09-12T01:02:45.371 INFO:teuthology.orchestra.run.smithi070.stdout:5 actionable tasks: 5 executed 2024-09-12T01:02:45.394 DEBUG:teuthology.orchestra.run.smithi070:> radosgw-admin gc process --include-all 2024-09-12T01:02:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:45.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.474+0000 7f49f123f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:45.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.474+0000 7f49f123f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:45.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.474+0000 7f49f123f9c0 20 realm 2024-09-12T01:02:45.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.474+0000 7f49f123f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:45.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.474+0000 7f49f123f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:45.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.474+0000 7f49f123f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:45.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.474+0000 7f49f123f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:45.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.474+0000 7f49f123f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:45.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.474+0000 7f49f123f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:45.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.474+0000 7f49f123f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:45.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.474+0000 7f49f123f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:45.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.478+0000 7f49f123f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:45.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.478+0000 7f49f123f9c0 20 searching for the correct realm 2024-09-12T01:02:45.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.482+0000 7f49ef546640 0 -- 172.21.15.70:0/571080167 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f49e40fbb70 msgr2=0x7f49e40e8470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:45.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.698+0000 7f49ef546640 0 -- 172.21.15.70:0/571080167 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f49e40fbb70 msgr2=0x7f49e40e8470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:45.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.710+0000 7f49f123f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:45.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.710+0000 7f49f123f9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:02:45.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.710+0000 7f49f123f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:45.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.710+0000 7f49f123f9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:02:45.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.710+0000 7f49f123f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:45.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.710+0000 7f49f123f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:45.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.710+0000 7f49f123f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:45.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.710+0000 7f49f123f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:45.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.710+0000 7f49f123f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:45.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.710+0000 7f49f123f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:45.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.710+0000 7f49f123f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:45.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.710+0000 7f49f123f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:45.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.710+0000 7f49f123f9c0 20 zone default found 2024-09-12T01:02:45.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.710+0000 7f49f123f9c0 4 Realm: () 2024-09-12T01:02:45.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.710+0000 7f49f123f9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:02:45.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.710+0000 7f49f123f9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:02:45.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.710+0000 7f49f123f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:45.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.710+0000 7f49f123f9c0 20 zonegroup default 2024-09-12T01:02:45.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.710+0000 7f49f123f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:45.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.714+0000 7f49f123f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:45.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.714+0000 7f49f123f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:45.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.714+0000 7f49f123f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:45.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.714+0000 7f49f123f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:45.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.714+0000 7f49f123f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:45.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.714+0000 7f49f123f9c0 20 started sync module instance, tier type = 2024-09-12T01:02:45.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.714+0000 7f49f123f9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:02:45.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.734+0000 7f49f123f9c0 20 add_watcher() i=0 2024-09-12T01:02:45.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.734+0000 7f49f123f9c0 20 add_watcher() i=1 2024-09-12T01:02:45.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.734+0000 7f49f123f9c0 20 add_watcher() i=2 2024-09-12T01:02:45.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.734+0000 7f49f123f9c0 20 add_watcher() i=3 2024-09-12T01:02:45.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.734+0000 7f49f123f9c0 20 add_watcher() i=4 2024-09-12T01:02:45.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.734+0000 7f49f123f9c0 20 add_watcher() i=5 2024-09-12T01:02:45.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.734+0000 7f49f123f9c0 20 add_watcher() i=6 2024-09-12T01:02:45.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.738+0000 7f49f123f9c0 20 add_watcher() i=7 2024-09-12T01:02:45.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.738+0000 7f49f123f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:45.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.738+0000 7f48a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:45.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.742+0000 7f49f123f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:45.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.742+0000 7f49f123f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:45.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.822+0000 7f481ffff640 20 reqs_thread_entry: start 2024-09-12T01:02:45.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.822+0000 7f49f123f9c0 20 init_complete bucket index max shards: 1 2024-09-12T01:02:45.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.822+0000 7f49f123f9c0 20 Filter name: none 2024-09-12T01:02:45.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.822+0000 7f481dffb640 20 reqs_thread_entry: start 2024-09-12T01:02:45.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.822+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:02:45.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.826+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.826+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:45.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.826+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:02:45.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.826+0000 7f49f123f9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4210041096048701459', time=2024-09-12T03:02:44.045824+0000, chain.objs.size()=1 2024-09-12T01:02:45.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.826+0000 7f49f123f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.72__shadow_.ywzVd7OuU2ejPXRpDSEZJbYHc83_e7V_0 2024-09-12T01:02:45.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.830+0000 7f49f123f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:45.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.830+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:02:45.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.834+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.834+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:45.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.838+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.838+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:02:45.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.842+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.842+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:45.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.842+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.846+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:02:45.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.846+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.850+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:45.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.850+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.854+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:02:45.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.854+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.858+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:45.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.858+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.858+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:02:45.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.862+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.866+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:45.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.866+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:02:45.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.866+0000 7f49f123f9c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17819760573711176468', time=2024-09-12T03:02:44.563786+0000, chain.objs.size()=1 2024-09-12T01:02:45.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.866+0000 7f49f123f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.73__shadow_.vQ6b6VNMll8z4x166ObafLXegGp6gJW_0 2024-09-12T01:02:45.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.870+0000 7f49f123f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:45.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.874+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:02:45.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.878+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.878+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:45.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.878+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.882+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:02:45.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.886+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.886+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:45.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.886+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.890+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:02:45.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.894+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.894+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:45.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.894+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.898+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:02:45.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.902+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.906+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:45.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.906+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.910+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:02:45.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.910+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.914+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:45.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.914+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.914+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:02:45.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.918+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.922+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:45.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.922+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.926+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:02:45.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.926+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.930+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:45.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.930+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.930+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:02:45.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.934+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.934+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:45.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.934+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.938+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:02:45.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.942+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.942+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:45.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.942+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.946+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:02:45.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.950+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.954+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:45.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.954+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.958+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:02:45.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.958+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.958+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:45.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.958+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.962+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:02:45.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.966+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.966+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:45.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.966+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.970+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:02:45.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.974+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.974+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:45.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.974+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.978+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:02:45.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.982+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.982+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:45.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.982+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.982+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:02:45.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.986+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.990+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:45.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.990+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.994+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:02:45.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.994+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.998+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:45.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.998+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:45.998+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:02:45.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.002+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.002+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:45.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.002+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.006+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:02:45.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.010+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:45.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.010+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.010+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.010+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:02:46.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.014+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.014+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.014+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.018+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:02:46.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.018+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.022+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.022+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.022+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:02:46.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.026+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.030+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.030+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.034+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:02:46.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.034+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.034+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.034+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.038+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:02:46.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.042+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.042+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.046+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.046+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:02:46.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.050+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.050+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.050+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.050+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:02:46.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.054+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.054+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.054+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.058+0000 7f49f123f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:02:46.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.058+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.062+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.062+0000 7f49f123f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.066+0000 7f48a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:46.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.070+0000 7f49f123f9c0 20 remove_watcher() i=0 2024-09-12T01:02:46.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.070+0000 7f49f123f9c0 2 removed watcher, disabling cache 2024-09-12T01:02:46.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.074+0000 7f49f123f9c0 20 remove_watcher() i=1 2024-09-12T01:02:46.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.074+0000 7f49f123f9c0 20 remove_watcher() i=2 2024-09-12T01:02:46.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.078+0000 7f49f123f9c0 20 remove_watcher() i=3 2024-09-12T01:02:46.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.078+0000 7f49f123f9c0 20 remove_watcher() i=4 2024-09-12T01:02:46.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.082+0000 7f49f123f9c0 20 remove_watcher() i=5 2024-09-12T01:02:46.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.082+0000 7f49f123f9c0 20 remove_watcher() i=6 2024-09-12T01:02:46.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.086+0000 7f49f123f9c0 20 remove_watcher() i=7 2024-09-12T01:02:46.093 DEBUG:teuthology.orchestra.run.smithi070:> radosgw-admin gc process --include-all 2024-09-12T01:02:46.165 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:46.165 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:46.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.218+0000 7fb00b6659c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:46.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.222+0000 7fb00b6659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:46.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.222+0000 7fb00b6659c0 20 realm 2024-09-12T01:02:46.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.222+0000 7fb00b6659c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:46.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.222+0000 7fb00b6659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:46.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.222+0000 7fb00b6659c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:46.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.222+0000 7fb00b6659c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:46.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.222+0000 7fb00b6659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:46.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.222+0000 7fb00b6659c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:46.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.222+0000 7fb00b6659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:46.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.222+0000 7fb00b6659c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:46.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.226+0000 7fb00b6659c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:46.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.226+0000 7fb00b6659c0 20 searching for the correct realm 2024-09-12T01:02:46.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.230+0000 7fb00996c640 0 -- 172.21.15.70:0/569212763 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fb000075040 msgr2=0x7fb000075b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:46.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.238+0000 7fb00996c640 0 -- 172.21.15.70:0/569212763 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7faed4080880 msgr2=0x7faed4082cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:46.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.246+0000 7fb00b6659c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:46.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.246+0000 7fb00b6659c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:02:46.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.246+0000 7fb00b6659c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:46.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.246+0000 7fb00b6659c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:02:46.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.246+0000 7fb00b6659c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:46.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.246+0000 7fb00b6659c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:46.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.246+0000 7fb00b6659c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:46.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.246+0000 7fb00b6659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:46.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.246+0000 7fb00b6659c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:46.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.246+0000 7fb00b6659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:46.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.246+0000 7fb00b6659c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:46.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.246+0000 7fb00b6659c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:46.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.246+0000 7fb00b6659c0 20 zone default found 2024-09-12T01:02:46.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.246+0000 7fb00b6659c0 4 Realm: () 2024-09-12T01:02:46.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.246+0000 7fb00b6659c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:02:46.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.246+0000 7fb00b6659c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:02:46.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.246+0000 7fb00b6659c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:46.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.246+0000 7fb00b6659c0 20 zonegroup default 2024-09-12T01:02:46.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.246+0000 7fb00b6659c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:46.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.246+0000 7fb00b6659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:46.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.246+0000 7fb00b6659c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:46.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.246+0000 7fb00b6659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:46.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.246+0000 7fb00b6659c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:46.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.246+0000 7fb00b6659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:46.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.246+0000 7fb00b6659c0 20 started sync module instance, tier type = 2024-09-12T01:02:46.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.246+0000 7fb00b6659c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:02:46.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.262+0000 7fb00b6659c0 20 add_watcher() i=0 2024-09-12T01:02:46.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.262+0000 7fb00b6659c0 20 add_watcher() i=1 2024-09-12T01:02:46.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.262+0000 7fb00b6659c0 20 add_watcher() i=2 2024-09-12T01:02:46.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.262+0000 7fb00b6659c0 20 add_watcher() i=3 2024-09-12T01:02:46.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.262+0000 7fb00b6659c0 20 add_watcher() i=4 2024-09-12T01:02:46.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.262+0000 7fb00b6659c0 20 add_watcher() i=5 2024-09-12T01:02:46.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.262+0000 7fb00b6659c0 20 add_watcher() i=6 2024-09-12T01:02:46.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.266+0000 7fb00b6659c0 20 add_watcher() i=7 2024-09-12T01:02:46.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.266+0000 7fb00b6659c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:46.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.266+0000 7faebf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:46.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.266+0000 7fb00b6659c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:46.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.266+0000 7fb00b6659c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:46.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.338+0000 7faebe7e4640 20 reqs_thread_entry: start 2024-09-12T01:02:46.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.338+0000 7fb00b6659c0 20 init_complete bucket index max shards: 1 2024-09-12T01:02:46.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.338+0000 7fb00b6659c0 20 Filter name: none 2024-09-12T01:02:46.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.338+0000 7fae2ffff640 20 reqs_thread_entry: start 2024-09-12T01:02:46.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.338+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:02:46.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.342+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.346+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.346+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.350+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:02:46.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.350+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.354+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.354+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.354+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:02:46.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.358+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.358+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.358+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.362+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:02:46.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.362+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.366+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.366+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.366+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:02:46.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.370+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.370+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.374+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.374+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:02:46.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.378+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.378+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.382+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.382+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:02:46.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.386+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.386+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.386+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.390+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:02:46.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.390+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.394+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.394+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.394+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:02:46.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.394+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.398+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.398+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.398+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:02:46.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.402+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.402+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.402+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.406+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:02:46.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.406+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.410+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.410+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.410+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:02:46.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.414+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.414+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.414+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.418+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:02:46.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.418+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.422+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.422+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.422+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:02:46.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.426+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.430+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.430+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.430+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:02:46.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.434+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.434+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.438+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.438+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:02:46.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.442+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.442+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.442+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.446+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:02:46.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.450+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.450+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.450+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.454+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:02:46.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.454+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.458+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.458+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.462+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:02:46.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.466+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.466+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.466+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.470+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:02:46.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.474+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.474+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.474+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.478+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:02:46.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.482+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.482+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.482+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.486+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:02:46.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.490+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.490+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.490+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.494+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:02:46.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.498+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.498+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.498+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.502+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:02:46.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.506+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.506+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.506+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.510+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:02:46.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.514+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.514+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.518+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.518+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:02:46.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.522+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.526+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.526+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.530+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:02:46.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.534+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.534+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.534+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.538+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:02:46.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.542+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.542+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.542+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.546+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:02:46.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.550+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.554+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.554+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.554+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:02:46.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.558+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.562+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.562+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.566+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:02:46.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.570+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.570+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.570+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.574+0000 7fb00b6659c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:02:46.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.578+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.578+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:46.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.582+0000 7fb00b6659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:46.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.586+0000 7faebf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:46.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.590+0000 7fb00b6659c0 20 remove_watcher() i=0 2024-09-12T01:02:46.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.590+0000 7fb00b6659c0 2 removed watcher, disabling cache 2024-09-12T01:02:46.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.594+0000 7fb00b6659c0 20 remove_watcher() i=1 2024-09-12T01:02:46.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.594+0000 7fb00b6659c0 20 remove_watcher() i=2 2024-09-12T01:02:46.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.598+0000 7fb00b6659c0 20 remove_watcher() i=3 2024-09-12T01:02:46.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.602+0000 7fb00b6659c0 20 remove_watcher() i=4 2024-09-12T01:02:46.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.602+0000 7fb00b6659c0 20 remove_watcher() i=5 2024-09-12T01:02:46.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.606+0000 7fb00b6659c0 20 remove_watcher() i=6 2024-09-12T01:02:46.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.606+0000 7fb00b6659c0 20 remove_watcher() i=7 2024-09-12T01:02:46.619 DEBUG:teuthology.orchestra.run.smithi070:> radosgw-admin gc process --include-all 2024-09-12T01:02:46.693 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:46.693 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:46.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.746+0000 7fbd74a449c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:46.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.750+0000 7fbd74a449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:46.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.750+0000 7fbd74a449c0 20 realm 2024-09-12T01:02:46.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.750+0000 7fbd74a449c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:46.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.750+0000 7fbd74a449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:46.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.750+0000 7fbd74a449c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:46.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.750+0000 7fbd74a449c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:46.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.750+0000 7fbd74a449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:46.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.750+0000 7fbd74a449c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:46.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.754+0000 7fbd74a449c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:46.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.754+0000 7fbd74a449c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:46.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.754+0000 7fbd74a449c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:46.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.754+0000 7fbd74a449c0 20 searching for the correct realm 2024-09-12T01:02:46.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.758+0000 7fbd72d4b640 0 -- 172.21.15.70:0/3437344969 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fbd5c01b040 msgr2=0x7fbd5c0642f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:02:46.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.974+0000 7fbd72d4b640 0 -- 172.21.15.70:0/3437344969 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fbd5c01b040 msgr2=0x7fbd5c0642f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:46.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.986+0000 7fbd74a449c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:46.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.986+0000 7fbd74a449c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:02:46.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.986+0000 7fbd74a449c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:46.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.986+0000 7fbd74a449c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:02:46.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.986+0000 7fbd74a449c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:46.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.986+0000 7fbd74a449c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:46.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.986+0000 7fbd74a449c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:46.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.986+0000 7fbd74a449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:46.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.986+0000 7fbd74a449c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:46.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.986+0000 7fbd74a449c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:46.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.986+0000 7fbd74a449c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:46.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.990+0000 7fbd74a449c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:46.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.990+0000 7fbd74a449c0 20 zone default found 2024-09-12T01:02:46.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.990+0000 7fbd74a449c0 4 Realm: () 2024-09-12T01:02:46.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.990+0000 7fbd74a449c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:02:46.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.990+0000 7fbd74a449c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:02:46.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.990+0000 7fbd74a449c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:46.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.990+0000 7fbd74a449c0 20 zonegroup default 2024-09-12T01:02:46.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.990+0000 7fbd74a449c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:46.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.990+0000 7fbd74a449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:46.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.990+0000 7fbd74a449c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:46.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.990+0000 7fbd74a449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:46.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.990+0000 7fbd74a449c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:46.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.990+0000 7fbd74a449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:46.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.990+0000 7fbd74a449c0 20 started sync module instance, tier type = 2024-09-12T01:02:46.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:46.990+0000 7fbd74a449c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:02:47.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.010+0000 7fbd74a449c0 20 add_watcher() i=0 2024-09-12T01:02:47.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.010+0000 7fbd74a449c0 20 add_watcher() i=1 2024-09-12T01:02:47.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.010+0000 7fbd74a449c0 20 add_watcher() i=2 2024-09-12T01:02:47.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.010+0000 7fbd74a449c0 20 add_watcher() i=3 2024-09-12T01:02:47.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.010+0000 7fbd74a449c0 20 add_watcher() i=4 2024-09-12T01:02:47.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.010+0000 7fbd74a449c0 20 add_watcher() i=5 2024-09-12T01:02:47.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.014+0000 7fbd74a449c0 20 add_watcher() i=6 2024-09-12T01:02:47.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.014+0000 7fbd74a449c0 20 add_watcher() i=7 2024-09-12T01:02:47.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.014+0000 7fbd74a449c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:47.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.018+0000 7fbc28fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:47.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.018+0000 7fbd74a449c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:47.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.018+0000 7fbd74a449c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:47.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.106+0000 7fbba37fe640 20 reqs_thread_entry: start 2024-09-12T01:02:47.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.106+0000 7fbd74a449c0 20 init_complete bucket index max shards: 1 2024-09-12T01:02:47.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.106+0000 7fbd74a449c0 20 Filter name: none 2024-09-12T01:02:47.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.106+0000 7fbba17fa640 20 reqs_thread_entry: start 2024-09-12T01:02:47.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.106+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:02:47.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.110+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.110+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.110+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.110+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:02:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.114+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.114+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.114+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.118+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:02:47.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.122+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.122+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.122+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.122+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:02:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.126+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.126+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.126+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.130+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:02:47.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.134+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.134+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.134+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.138+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:02:47.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.138+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.142+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.142+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.142+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:02:47.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.146+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.146+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.146+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.150+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:02:47.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.154+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.154+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.154+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.154+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:02:47.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.158+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.158+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.158+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.162+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:02:47.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.162+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.166+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.166+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.166+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:02:47.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.170+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.170+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.174+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.174+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:02:47.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.178+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.178+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.182+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.182+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:02:47.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.186+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.186+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.190+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.190+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:02:47.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.194+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.198+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.198+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.198+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:02:47.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.202+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.202+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.206+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.206+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:02:47.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.210+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.214+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.214+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.218+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:02:47.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.222+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.222+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.222+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.226+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:02:47.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.230+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.230+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.230+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.234+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:02:47.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.238+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.238+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.238+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.242+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:02:47.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.246+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.246+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.246+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.250+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:02:47.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.254+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.254+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.254+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.258+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:02:47.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.262+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.262+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.262+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.266+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:02:47.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.270+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.270+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.274+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.274+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:02:47.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.278+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.282+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.282+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.282+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:02:47.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.286+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.290+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.290+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.294+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:02:47.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.298+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.298+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.298+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.302+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:02:47.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.306+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.306+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.306+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.310+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:02:47.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.314+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.314+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.314+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.318+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:02:47.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.322+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.322+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.322+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.326+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:02:47.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.326+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.330+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.330+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.334+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:02:47.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.338+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.338+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.338+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.342+0000 7fbd74a449c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:02:47.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.346+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.346+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.350+0000 7fbd74a449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.354+0000 7fbc28fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:47.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.358+0000 7fbd74a449c0 20 remove_watcher() i=0 2024-09-12T01:02:47.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.358+0000 7fbd74a449c0 2 removed watcher, disabling cache 2024-09-12T01:02:47.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.362+0000 7fbd74a449c0 20 remove_watcher() i=1 2024-09-12T01:02:47.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.362+0000 7fbd74a449c0 20 remove_watcher() i=2 2024-09-12T01:02:47.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.366+0000 7fbd74a449c0 20 remove_watcher() i=3 2024-09-12T01:02:47.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.366+0000 7fbd74a449c0 20 remove_watcher() i=4 2024-09-12T01:02:47.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.370+0000 7fbd74a449c0 20 remove_watcher() i=5 2024-09-12T01:02:47.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.370+0000 7fbd74a449c0 20 remove_watcher() i=6 2024-09-12T01:02:47.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.374+0000 7fbd74a449c0 20 remove_watcher() i=7 2024-09-12T01:02:47.382 DEBUG:teuthology.orchestra.run.smithi070:> radosgw-admin gc process --include-all 2024-09-12T01:02:47.458 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:47.458 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:47.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.514+0000 7fd849f389c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:47.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.514+0000 7fd849f389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:47.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.514+0000 7fd849f389c0 20 realm 2024-09-12T01:02:47.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.514+0000 7fd849f389c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:47.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.514+0000 7fd849f389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:47.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.514+0000 7fd849f389c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:47.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.514+0000 7fd849f389c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:47.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.514+0000 7fd849f389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:47.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.514+0000 7fd849f389c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:47.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.518+0000 7fd849f389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:47.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.518+0000 7fd849f389c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:47.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.518+0000 7fd849f389c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:47.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.518+0000 7fd849f389c0 20 searching for the correct realm 2024-09-12T01:02:47.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.522+0000 7fd84823f640 0 -- 172.21.15.70:0/1086037567 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fd83c0d9040 msgr2=0x7fd83c0cb420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:47.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.530+0000 7fd84823f640 0 -- 172.21.15.70:0/1086037567 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fd710080880 msgr2=0x7fd710082cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:47.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.538+0000 7fd849f389c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:47.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.538+0000 7fd849f389c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:02:47.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.538+0000 7fd849f389c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:47.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.538+0000 7fd849f389c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:02:47.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.538+0000 7fd849f389c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:47.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.538+0000 7fd849f389c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:47.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.538+0000 7fd849f389c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:47.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.538+0000 7fd849f389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:47.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.538+0000 7fd849f389c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:47.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.538+0000 7fd849f389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:47.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.538+0000 7fd849f389c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:47.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.538+0000 7fd849f389c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:47.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.538+0000 7fd849f389c0 20 zone default found 2024-09-12T01:02:47.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.538+0000 7fd849f389c0 4 Realm: () 2024-09-12T01:02:47.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.538+0000 7fd849f389c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:02:47.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.538+0000 7fd849f389c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:02:47.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.538+0000 7fd849f389c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:47.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.538+0000 7fd849f389c0 20 zonegroup default 2024-09-12T01:02:47.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.538+0000 7fd849f389c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:47.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.538+0000 7fd849f389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:47.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.538+0000 7fd849f389c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:47.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.538+0000 7fd849f389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:47.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.538+0000 7fd849f389c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:47.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.538+0000 7fd849f389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:47.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.542+0000 7fd849f389c0 20 started sync module instance, tier type = 2024-09-12T01:02:47.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.542+0000 7fd849f389c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:02:47.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.554+0000 7fd849f389c0 20 add_watcher() i=0 2024-09-12T01:02:47.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.554+0000 7fd849f389c0 20 add_watcher() i=1 2024-09-12T01:02:47.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.554+0000 7fd849f389c0 20 add_watcher() i=2 2024-09-12T01:02:47.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.554+0000 7fd849f389c0 20 add_watcher() i=3 2024-09-12T01:02:47.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.554+0000 7fd849f389c0 20 add_watcher() i=4 2024-09-12T01:02:47.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.554+0000 7fd849f389c0 20 add_watcher() i=5 2024-09-12T01:02:47.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.554+0000 7fd849f389c0 20 add_watcher() i=6 2024-09-12T01:02:47.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.558+0000 7fd849f389c0 20 add_watcher() i=7 2024-09-12T01:02:47.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.558+0000 7fd849f389c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:47.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.558+0000 7fd6fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:47.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.558+0000 7fd849f389c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:47.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.558+0000 7fd849f389c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:47.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.630+0000 7fd6fcfe1640 20 reqs_thread_entry: start 2024-09-12T01:02:47.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.634+0000 7fd849f389c0 20 init_complete bucket index max shards: 1 2024-09-12T01:02:47.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.634+0000 7fd849f389c0 20 Filter name: none 2024-09-12T01:02:47.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.634+0000 7fd6767fc640 20 reqs_thread_entry: start 2024-09-12T01:02:47.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.634+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:02:47.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.638+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.638+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.638+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.642+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:02:47.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.642+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.646+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.646+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.646+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:02:47.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.650+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.654+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.654+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.658+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:02:47.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.658+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.658+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.658+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.662+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:02:47.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.662+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.666+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.666+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.666+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:02:47.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.670+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.670+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.670+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.674+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:02:47.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.678+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.678+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.682+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.682+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:02:47.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.686+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.686+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.686+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.690+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:02:47.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.694+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.694+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.694+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.698+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:02:47.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.702+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.702+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.702+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.702+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:02:47.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.706+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.710+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.710+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.710+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:02:47.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.714+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.718+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.718+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.718+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:02:47.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.722+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.722+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.722+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.726+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:02:47.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.726+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.730+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.730+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.734+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:02:47.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.734+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.734+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.734+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.738+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:02:47.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.742+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.742+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.742+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.746+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:02:47.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.746+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.750+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.750+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.754+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:02:47.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.758+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.758+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.758+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.762+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:02:47.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.766+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.766+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.766+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.770+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:02:47.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.774+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.774+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.774+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.778+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:02:47.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.778+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.782+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.782+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.782+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:02:47.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.786+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.786+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.786+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.786+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:02:47.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.790+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.794+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.794+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.798+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:02:47.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.798+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.802+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.802+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.802+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:02:47.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.806+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.806+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.806+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.810+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:02:47.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.814+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.814+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.814+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.818+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:02:47.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.822+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.822+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.826+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.826+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:02:47.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.830+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.830+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.830+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.834+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:02:47.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.838+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.838+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.838+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.842+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:02:47.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.850+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.850+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.850+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.854+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:02:47.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.854+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:47.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.858+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:47.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:47.858+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:48.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:48.066+0000 7fd849f389c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:02:48.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:48.070+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:48.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:48.074+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:48.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:48.074+0000 7fd849f389c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:48.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:48.078+0000 7fd6fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:48.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:48.082+0000 7fd849f389c0 20 remove_watcher() i=0 2024-09-12T01:02:48.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:48.082+0000 7fd849f389c0 2 removed watcher, disabling cache 2024-09-12T01:02:48.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:48.086+0000 7fd849f389c0 20 remove_watcher() i=1 2024-09-12T01:02:48.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:48.090+0000 7fd849f389c0 20 remove_watcher() i=2 2024-09-12T01:02:48.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:48.090+0000 7fd849f389c0 20 remove_watcher() i=3 2024-09-12T01:02:48.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:48.094+0000 7fd849f389c0 20 remove_watcher() i=4 2024-09-12T01:02:48.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:48.094+0000 7fd849f389c0 20 remove_watcher() i=5 2024-09-12T01:02:48.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:48.098+0000 7fd849f389c0 20 remove_watcher() i=6 2024-09-12T01:02:48.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:02:48.098+0000 7fd849f389c0 20 remove_watcher() i=7 2024-09-12T01:02:48.109 DEBUG:teuthology.orchestra.run.smithi070:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-12T01:02:48.843 INFO:teuthology.orchestra.run.smithi070.stdout:> Task :clean 2024-09-12T01:02:49.741 INFO:teuthology.orchestra.run.smithi070.stdout:> Task :compileJava 2024-09-12T01:02:49.741 INFO:teuthology.orchestra.run.smithi070.stdout:> Task :processResources 2024-09-12T01:02:49.741 INFO:teuthology.orchestra.run.smithi070.stdout:> Task :classes 2024-09-12T01:02:50.241 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:50.241 INFO:teuthology.orchestra.run.smithi070.stdout:> Task :compileTestJava 2024-09-12T01:02:50.242 INFO:teuthology.orchestra.run.smithi070.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T01:02:50.242 INFO:teuthology.orchestra.run.smithi070.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T01:02:50.242 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:50.242 INFO:teuthology.orchestra.run.smithi070.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T01:02:50.243 INFO:teuthology.orchestra.run.smithi070.stdout:> Task :testClasses 2024-09-12T01:02:52.241 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:52.242 INFO:teuthology.orchestra.run.smithi070.stdout:> Task :test 2024-09-12T01:02:52.242 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:52.242 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests STANDARD_OUT 2024-09-12T01:02:52.242 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12 01:02:51,659 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T01:02:52.242 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:52.242 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-12T01:02:52.242 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:52.243 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-12T01:02:52.441 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:52.441 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-12T01:02:52.541 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:52.541 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-12T01:02:52.741 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:52.741 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-12T01:02:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:52.841 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-12T01:02:53.041 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:53.041 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-12T01:02:54.841 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:54.841 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-12T01:02:55.141 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:55.141 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-12T01:02:55.141 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:55.141 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-12T01:02:55.441 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:55.441 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-12T01:02:55.641 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:55.641 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-12T01:02:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:55.841 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-12T01:02:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:55.841 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-12T01:02:55.941 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:55.941 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-12T01:02:56.041 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:56.041 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-12T01:02:56.241 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:56.241 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-12T01:02:56.641 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:56.641 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-12T01:02:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:56.941 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-12T01:02:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:56.942 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-12T01:02:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:57.241 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-12T01:02:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:57.341 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-12T01:02:57.541 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:57.541 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-12T01:02:57.641 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:57.641 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-12T01:02:57.841 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:57.841 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-12T01:02:57.941 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:57.941 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-12T01:02:58.141 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:58.141 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-12T01:02:58.241 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:58.241 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-12T01:02:58.441 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:58.441 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-12T01:02:58.541 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:58.541 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-12T01:02:58.841 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:58.841 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-12T01:02:58.941 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:58.941 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-12T01:02:59.141 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:59.141 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-12T01:02:59.941 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:02:59.941 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-12T01:03:00.341 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:00.341 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-12T01:03:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:05.541 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-12T01:03:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:05.941 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-12T01:03:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:06.041 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-12T01:03:06.241 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:06.242 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-12T01:03:06.242 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:06.242 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-12T01:03:06.641 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:06.641 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-12T01:03:07.341 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:07.341 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-12T01:03:07.541 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:07.541 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-12T01:03:07.641 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:07.641 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-12T01:03:07.741 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:07.741 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-12T01:03:08.541 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:08.541 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-12T01:03:08.741 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:08.741 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T01:03:09.241 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:09.241 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T01:03:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:09.541 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-12T01:03:11.141 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:11.141 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-12T01:03:11.441 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:11.441 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-12T01:03:16.441 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:16.441 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-12T01:03:16.741 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:16.741 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-12T01:03:18.041 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:18.041 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-12T01:03:18.241 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:18.241 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-12T01:03:19.041 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:19.041 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-12T01:03:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:19.341 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-12T01:03:19.840 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:19.841 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-12T01:03:20.140 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:20.141 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-12T01:03:20.240 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:20.241 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-12T01:03:20.341 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:20.341 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-12T01:03:20.341 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:20.341 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-12T01:03:20.540 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:20.541 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-12T01:03:20.641 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:20.641 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-12T01:03:20.841 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:20.841 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-12T01:03:20.941 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:20.941 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-12T01:03:21.141 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:21.141 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-12T01:03:21.241 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:21.241 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-12T01:03:21.441 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:21.441 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-12T01:03:21.541 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:21.541 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-12T01:03:21.841 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:21.841 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-12T01:03:21.841 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:21.841 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-12T01:03:22.041 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:22.041 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-12T01:03:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:22.141 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-12T01:03:22.440 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:22.441 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-12T01:03:22.641 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:22.641 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-12T01:03:22.841 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:22.841 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-12T01:03:23.041 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:23.041 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-12T01:03:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:23.341 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-12T01:03:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:23.441 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-12T01:03:23.641 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:23.641 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-12T01:03:23.841 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:23.841 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-12T01:03:24.041 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:24.041 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-12T01:03:24.241 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:24.241 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-12T01:03:24.541 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:24.541 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-12T01:03:24.641 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:24.641 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-12T01:03:24.941 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:24.941 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-12T01:03:25.041 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:25.041 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-12T01:03:25.341 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:25.341 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-12T01:03:25.441 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:25.441 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-12T01:03:25.741 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:25.741 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-12T01:03:25.841 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:25.841 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-12T01:03:26.141 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:26.141 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-12T01:03:26.241 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:26.241 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-12T01:03:26.541 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:26.541 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-12T01:03:26.641 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:26.641 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-12T01:03:26.941 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:26.941 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-12T01:03:27.041 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:27.041 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-12T01:03:27.241 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:27.241 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-12T01:03:27.441 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:27.441 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-12T01:03:27.641 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:27.641 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-12T01:03:27.741 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:27.741 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-12T01:03:28.041 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:28.041 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-12T01:03:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:28.141 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-12T01:03:28.441 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:28.441 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-12T01:03:28.541 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:28.541 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-12T01:03:28.842 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:28.868 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-12T01:03:28.941 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:28.941 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-12T01:03:29.241 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:29.241 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-12T01:03:29.341 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:29.341 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-12T01:03:29.641 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:29.641 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-12T01:03:29.741 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:29.741 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-12T01:03:30.041 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:30.041 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-12T01:03:30.141 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:30.141 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-12T01:03:30.441 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:30.441 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-12T01:03:30.541 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:30.541 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-12T01:03:30.741 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:30.741 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-12T01:03:30.841 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:30.841 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-12T01:03:31.041 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:31.041 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-12T01:03:31.141 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:31.141 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-12T01:03:31.441 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:31.441 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-12T01:03:31.441 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:31.441 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-12T01:03:31.641 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:31.641 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-12T01:03:31.741 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:31.741 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-12T01:03:31.941 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:31.941 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-12T01:03:32.141 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:32.141 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-12T01:03:32.441 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:32.441 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-12T01:03:32.441 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:32.441 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-12T01:03:32.541 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:32.541 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-12T01:03:32.641 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:32.641 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-12T01:03:32.841 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:32.841 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-12T01:03:32.941 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:32.941 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-12T01:03:33.141 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:33.141 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-12T01:03:33.541 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:33.541 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-12T01:03:33.741 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:33.741 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-12T01:03:33.841 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:33.841 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-12T01:03:34.041 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:34.041 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-12T01:03:34.641 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:34.641 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-12T01:03:34.841 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:34.841 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-12T01:03:35.341 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:35.341 INFO:teuthology.orchestra.run.smithi070.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-12T01:03:35.620 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:35.621 INFO:teuthology.orchestra.run.smithi070.stdout:---------------------------------------------------------------------- 2024-09-12T01:03:35.621 INFO:teuthology.orchestra.run.smithi070.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-12T01:03:35.621 INFO:teuthology.orchestra.run.smithi070.stdout:---------------------------------------------------------------------- 2024-09-12T01:03:35.621 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:35.621 INFO:teuthology.orchestra.run.smithi070.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T01:03:35.621 INFO:teuthology.orchestra.run.smithi070.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T01:03:35.621 INFO:teuthology.orchestra.run.smithi070.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T01:03:35.621 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:35.621 INFO:teuthology.orchestra.run.smithi070.stdout:BUILD SUCCESSFUL in 47s 2024-09-12T01:03:35.621 INFO:teuthology.orchestra.run.smithi070.stdout:5 actionable tasks: 5 executed 2024-09-12T01:03:35.638 DEBUG:teuthology.orchestra.run.smithi070:> radosgw-admin gc process --include-all 2024-09-12T01:03:35.664 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:03:35.664 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:03:35.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.716+0000 7f71311b59c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:35.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.716+0000 7f71311b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:35.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.716+0000 7f71311b59c0 20 realm 2024-09-12T01:03:35.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.716+0000 7f71311b59c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:35.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.716+0000 7f71311b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:35.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.716+0000 7f71311b59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:03:35.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.716+0000 7f71311b59c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:35.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.716+0000 7f71311b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:35.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.716+0000 7f71311b59c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:35.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.720+0000 7f71311b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:35.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.720+0000 7f71311b59c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:35.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.720+0000 7f71311b59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:03:35.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.720+0000 7f71311b59c0 20 searching for the correct realm 2024-09-12T01:03:35.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.724+0000 7f712e4ba640 0 -- 172.21.15.70:0/958976711 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7f7120062940 msgr2=0x7f71200920b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:35.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.940+0000 7f712ecbb640 0 -- 172.21.15.70:0/958976711 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x55ae28a64500 msgr2=0x7f71280c0960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:35.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.952+0000 7f71311b59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:03:35.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.952+0000 7f71311b59c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:03:35.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.952+0000 7f71311b59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:03:35.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.952+0000 7f71311b59c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:03:35.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.952+0000 7f71311b59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:03:35.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.952+0000 7f71311b59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:03:35.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.952+0000 7f71311b59c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:35.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.956+0000 7f71311b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:35.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.956+0000 7f71311b59c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:35.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.956+0000 7f71311b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:35.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.956+0000 7f71311b59c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:35.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.956+0000 7f71311b59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:03:35.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.956+0000 7f71311b59c0 20 zone default found 2024-09-12T01:03:35.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.956+0000 7f71311b59c0 4 Realm: () 2024-09-12T01:03:35.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.956+0000 7f71311b59c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:03:35.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.956+0000 7f71311b59c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:03:35.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.956+0000 7f71311b59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:03:35.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.956+0000 7f71311b59c0 20 zonegroup default 2024-09-12T01:03:35.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.956+0000 7f71311b59c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:35.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.956+0000 7f71311b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:35.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.956+0000 7f71311b59c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:35.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.956+0000 7f71311b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:35.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.956+0000 7f71311b59c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:35.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.960+0000 7f71311b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:35.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.960+0000 7f71311b59c0 20 started sync module instance, tier type = 2024-09-12T01:03:35.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.960+0000 7f71311b59c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:03:35.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.980+0000 7f71311b59c0 20 add_watcher() i=0 2024-09-12T01:03:35.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.980+0000 7f71311b59c0 20 add_watcher() i=1 2024-09-12T01:03:35.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.980+0000 7f71311b59c0 20 add_watcher() i=2 2024-09-12T01:03:35.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.980+0000 7f71311b59c0 20 add_watcher() i=3 2024-09-12T01:03:35.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.980+0000 7f71311b59c0 20 add_watcher() i=4 2024-09-12T01:03:35.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.980+0000 7f71311b59c0 20 add_watcher() i=5 2024-09-12T01:03:35.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.980+0000 7f71311b59c0 20 add_watcher() i=6 2024-09-12T01:03:35.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.980+0000 7f71311b59c0 20 add_watcher() i=7 2024-09-12T01:03:35.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.980+0000 7f71311b59c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:03:35.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.984+0000 7f6fe57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:35.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.988+0000 7f71311b59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:03:35.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:35.988+0000 7f71311b59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:03:36.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.072+0000 7f6f5ffff640 20 reqs_thread_entry: start 2024-09-12T01:03:36.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.072+0000 7f71311b59c0 20 init_complete bucket index max shards: 1 2024-09-12T01:03:36.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.072+0000 7f71311b59c0 20 Filter name: none 2024-09-12T01:03:36.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.072+0000 7f6f5dffb640 20 reqs_thread_entry: start 2024-09-12T01:03:36.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.072+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:03:36.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.076+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.076+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.076+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:03:36.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.076+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14987997438367375504', time=2024-09-12T03:03:04.767553+0000, chain.objs.size()=5 2024-09-12T01:03:36.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.076+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__multipart_key1.2~svDaBf0N2R4Qc2-Ssvl9u9axnQi_zQd.1 2024-09-12T01:03:36.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.076+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__shadow_key1.2~svDaBf0N2R4Qc2-Ssvl9u9axnQi_zQd.1_1 2024-09-12T01:03:36.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.076+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__multipart_key1.2~svDaBf0N2R4Qc2-Ssvl9u9axnQi_zQd.2 2024-09-12T01:03:36.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.076+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__shadow_key1.2~svDaBf0N2R4Qc2-Ssvl9u9axnQi_zQd.2_1 2024-09-12T01:03:36.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.076+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__multipart_key1.2~svDaBf0N2R4Qc2-Ssvl9u9axnQi_zQd.3 2024-09-12T01:03:36.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.076+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6382595388986701304', time=2024-09-12T03:03:09.372485+0000, chain.objs.size()=1 2024-09-12T01:03:36.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.076+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.101__shadow_.EFoxdzMKGgv1s6Ijmqa_6jSUXQEx3ov_0 2024-09-12T01:03:36.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.076+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3423365083601789463', time=2024-09-12T03:03:24.267682+0000, chain.objs.size()=1 2024-09-12T01:03:36.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.076+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.118__shadow_.28H-7Cs351fSNic7f_82ZzMTVxhouIb_0 2024-09-12T01:03:36.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.076+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12271539110690848198', time=2024-09-12T03:03:25.928043+0000, chain.objs.size()=1 2024-09-12T01:03:36.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.076+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.122__shadow_.Ov_-y9Rmx2A_EpE_c_DJMGGJHpgrWcP_0 2024-09-12T01:03:36.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.076+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.699088737575636030', time=2024-09-12T03:03:34.703297+0000, chain.objs.size()=5 2024-09-12T01:03:36.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.076+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.144__multipart_key1.2~KSN2ngUQuPn0r7mufMfpx8BM5hPn56B.1 2024-09-12T01:03:36.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.076+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.144__multipart_key1.2~KSN2ngUQuPn0r7mufMfpx8BM5hPn56B.2 2024-09-12T01:03:36.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.076+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.144__multipart_key1.2~KSN2ngUQuPn0r7mufMfpx8BM5hPn56B.3 2024-09-12T01:03:36.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.076+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.144__multipart_key1.2~KSN2ngUQuPn0r7mufMfpx8BM5hPn56B.4 2024-09-12T01:03:36.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.084+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.144__multipart_key1.2~KSN2ngUQuPn0r7mufMfpx8BM5hPn56B.5 2024-09-12T01:03:36.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.092+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.100+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:03:36.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.104+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.104+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.104+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:03:36.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.104+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15452020741983221544', time=2024-09-12T03:03:07.382447+0000, chain.objs.size()=5 2024-09-12T01:03:36.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.104+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.99__multipart_key1.2~20efzNIxfHeq06EDtqQv5BrQZSR9ixz.1 2024-09-12T01:03:36.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.104+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.99__multipart_key1.2~20efzNIxfHeq06EDtqQv5BrQZSR9ixz.2 2024-09-12T01:03:36.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.104+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.99__multipart_key1.2~20efzNIxfHeq06EDtqQv5BrQZSR9ixz.3 2024-09-12T01:03:36.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.104+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.99__multipart_key1.2~20efzNIxfHeq06EDtqQv5BrQZSR9ixz.4 2024-09-12T01:03:36.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.104+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.99__multipart_key1.2~20efzNIxfHeq06EDtqQv5BrQZSR9ixz.5 2024-09-12T01:03:36.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.104+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2899775932847303245', time=2024-09-12T03:03:27.866143+0000, chain.objs.size()=1 2024-09-12T01:03:36.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.104+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.127__shadow_.1JOwmqkmEttIWRBpgobCcZW3KjTausy_0 2024-09-12T01:03:36.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.112+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.116+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:03:36.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.120+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.120+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.120+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T01:03:36.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.120+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr', time=2024-09-12T03:03:20.053368+0000, chain.objs.size()=76 2024-09-12T01:03:36.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.120+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.1 2024-09-12T01:03:36.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.120+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.2 2024-09-12T01:03:36.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.120+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.3 2024-09-12T01:03:36.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.120+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.4 2024-09-12T01:03:36.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.120+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.5 2024-09-12T01:03:36.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.120+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.6 2024-09-12T01:03:36.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.120+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.7 2024-09-12T01:03:36.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.120+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.8 2024-09-12T01:03:36.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.120+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.9 2024-09-12T01:03:36.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.120+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.10 2024-09-12T01:03:36.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.120+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.11 2024-09-12T01:03:36.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.120+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.12 2024-09-12T01:03:36.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.124+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.13 2024-09-12T01:03:36.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.124+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.14 2024-09-12T01:03:36.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.124+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.15 2024-09-12T01:03:36.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.124+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.16 2024-09-12T01:03:36.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.124+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.17 2024-09-12T01:03:36.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.124+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.18 2024-09-12T01:03:36.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.128+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.19 2024-09-12T01:03:36.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.128+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.20 2024-09-12T01:03:36.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.128+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.21 2024-09-12T01:03:36.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.128+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.22 2024-09-12T01:03:36.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.128+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.23 2024-09-12T01:03:36.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.128+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.24 2024-09-12T01:03:36.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.128+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.25 2024-09-12T01:03:36.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.132+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.26 2024-09-12T01:03:36.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.132+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.27 2024-09-12T01:03:36.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.132+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.28 2024-09-12T01:03:36.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.132+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.29 2024-09-12T01:03:36.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.132+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.30 2024-09-12T01:03:36.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.132+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.31 2024-09-12T01:03:36.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.132+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.32 2024-09-12T01:03:36.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.132+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.33 2024-09-12T01:03:36.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.132+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.34 2024-09-12T01:03:36.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.132+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.35 2024-09-12T01:03:36.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.132+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.36 2024-09-12T01:03:36.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.136+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.37 2024-09-12T01:03:36.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.136+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.38 2024-09-12T01:03:36.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.136+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.39 2024-09-12T01:03:36.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.136+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.40 2024-09-12T01:03:36.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.140+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.41 2024-09-12T01:03:36.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.140+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.42 2024-09-12T01:03:36.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.140+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.43 2024-09-12T01:03:36.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.140+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.44 2024-09-12T01:03:36.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.140+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.45 2024-09-12T01:03:36.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.140+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.46 2024-09-12T01:03:36.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.140+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.47 2024-09-12T01:03:36.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.140+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.48 2024-09-12T01:03:36.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.140+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.49 2024-09-12T01:03:36.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.144+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.50 2024-09-12T01:03:36.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.144+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.51 2024-09-12T01:03:36.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.144+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.52 2024-09-12T01:03:36.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.144+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.53 2024-09-12T01:03:36.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.144+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.54 2024-09-12T01:03:36.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.144+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.55 2024-09-12T01:03:36.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.144+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.56 2024-09-12T01:03:36.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.144+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.57 2024-09-12T01:03:36.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.148+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.58 2024-09-12T01:03:36.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.148+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.59 2024-09-12T01:03:36.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.148+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.60 2024-09-12T01:03:36.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.148+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.61 2024-09-12T01:03:36.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.148+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.62 2024-09-12T01:03:36.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.148+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.63 2024-09-12T01:03:36.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.148+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.64 2024-09-12T01:03:36.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.148+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.65 2024-09-12T01:03:36.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.148+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.66 2024-09-12T01:03:36.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.148+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.67 2024-09-12T01:03:36.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.148+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.68 2024-09-12T01:03:36.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.152+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.69 2024-09-12T01:03:36.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.152+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.70 2024-09-12T01:03:36.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.152+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.71 2024-09-12T01:03:36.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.152+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.72 2024-09-12T01:03:36.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.152+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.73 2024-09-12T01:03:36.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.152+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.74 2024-09-12T01:03:36.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.156+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.75 2024-09-12T01:03:36.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.156+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.106__multipart_key1.2~dDFI9WQKkABoe7BCAtNsx_7abDm6UFr.78 2024-09-12T01:03:36.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.156+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5769668170666520974', time=2024-09-12T03:03:20.416404+0000, chain.objs.size()=1 2024-09-12T01:03:36.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.156+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.107__shadow_.KSynIyHYP_Rzd9QM4vmMv4FjzOzT68Q_0 2024-09-12T01:03:36.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.156+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.961952952863579321', time=2024-09-12T03:03:23.903100+0000, chain.objs.size()=1 2024-09-12T01:03:36.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.156+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.117__shadow_.U1JcJgN_OL8MCXprfviGCSua5RCsyZi_0 2024-09-12T01:03:36.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.156+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9111410378435518295', time=2024-09-12T03:03:25.113704+0000, chain.objs.size()=1 2024-09-12T01:03:36.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.156+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.120__shadow_.jAvdbrEKj9VxfhDB7sHmU6CSX9vACs2_0 2024-09-12T01:03:36.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.156+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18436523296560681384', time=2024-09-12T03:03:32.033348+0000, chain.objs.size()=1 2024-09-12T01:03:36.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.156+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.139__shadow_.-NH_NmQXl-vPkPGLuLl0slXA-oGU2Xu_0 2024-09-12T01:03:36.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.156+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3201836901935910392', time=2024-09-12T03:03:33.011005+0000, chain.objs.size()=1 2024-09-12T01:03:36.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.156+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.141__shadow_.qluL64IPfJ1v4eZGOCKicViSb3G0V8S_0 2024-09-12T01:03:36.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.160+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.164+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:03:36.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.164+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.168+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.168+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:03:36.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.168+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6371490799436094603', time=2024-09-12T03:03:23.092356+0000, chain.objs.size()=1 2024-09-12T01:03:36.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.168+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.115__shadow_.x0uf7eV7FR1C2xHzwc9RfIV8Pj5Kb1B_0 2024-09-12T01:03:36.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.168+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.172+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:03:36.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.176+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.176+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.176+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:03:36.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.176+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5821454078933550814', time=2024-09-12T03:03:03.241075+0000, chain.objs.size()=5 2024-09-12T01:03:36.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.176+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__multipart_key1.2~rMERbZYobE4iRrLHpXkAIsYXjXAfZif.1 2024-09-12T01:03:36.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.176+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__multipart_key1.2~rMERbZYobE4iRrLHpXkAIsYXjXAfZif.2 2024-09-12T01:03:36.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.176+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__multipart_key1.2~rMERbZYobE4iRrLHpXkAIsYXjXAfZif.3 2024-09-12T01:03:36.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.176+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__multipart_key1.2~rMERbZYobE4iRrLHpXkAIsYXjXAfZif.4 2024-09-12T01:03:36.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.176+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__multipart_key1.2~rMERbZYobE4iRrLHpXkAIsYXjXAfZif.5 2024-09-12T01:03:36.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.176+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14205041023407821519', time=2024-09-12T03:03:09.351288+0000, chain.objs.size()=1 2024-09-12T01:03:36.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.176+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.101__shadow_.D3unDupTNTdMyrMp8-rPb8TpE86ezt1_0 2024-09-12T01:03:36.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.176+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3655089365489068626', time=2024-09-12T03:03:22.685792+0000, chain.objs.size()=1 2024-09-12T01:03:36.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.176+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.114__shadow_.4AOdXpMqHZGhRdCXEWVAaC_hRbPF8nD_0 2024-09-12T01:03:36.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.176+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10336766826900848686', time=2024-09-12T03:03:22.699526+0000, chain.objs.size()=1 2024-09-12T01:03:36.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.176+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.114__shadow_.NXNME_PNxthcFB0C-oz0l5p03gSDSJL_0 2024-09-12T01:03:36.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.184+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.188+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:03:36.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.192+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.192+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.192+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:03:36.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.192+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8511277957077582776', time=2024-09-12T03:03:00.177275+0000, chain.objs.size()=5 2024-09-12T01:03:36.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.192+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.92__multipart_key1.2~FImowxPJ0DJ2FbUNLG9z4E8pXgAy8pb.1 2024-09-12T01:03:36.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.192+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.92__multipart_key1.2~FImowxPJ0DJ2FbUNLG9z4E8pXgAy8pb.2 2024-09-12T01:03:36.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.192+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.92__multipart_key1.2~FImowxPJ0DJ2FbUNLG9z4E8pXgAy8pb.3 2024-09-12T01:03:36.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.192+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.92__multipart_key1.2~FImowxPJ0DJ2FbUNLG9z4E8pXgAy8pb.4 2024-09-12T01:03:36.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.192+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.92__multipart_key1.2~FImowxPJ0DJ2FbUNLG9z4E8pXgAy8pb.5 2024-09-12T01:03:36.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.192+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18393547841765192051', time=2024-09-12T03:03:24.713487+0000, chain.objs.size()=1 2024-09-12T01:03:36.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.192+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.119__shadow_.VfiX1abv6SW_FtE4bO3IRFMsO9GWdIf_0 2024-09-12T01:03:36.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.192+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6053433382942158698', time=2024-09-12T03:03:25.509807+0000, chain.objs.size()=1 2024-09-12T01:03:36.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.192+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.121__shadow_.FcbUY-Ii49uNwG4IqmTlaY7OYEeuIcp_0 2024-09-12T01:03:36.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.192+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6033674250600399743', time=2024-09-12T03:03:26.307831+0000, chain.objs.size()=1 2024-09-12T01:03:36.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.192+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.123__shadow_.ATy87WS1-JVpq_i7mqEYKF4fsXhUOs0_0 2024-09-12T01:03:36.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.192+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8286759791203319668', time=2024-09-12T03:03:29.436587+0000, chain.objs.size()=1 2024-09-12T01:03:36.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.192+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.131__shadow_.hwOjBqXgTO6E-PwgfYliurRFtZDtzzF_0 2024-09-12T01:03:36.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.196+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.200+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:03:36.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.204+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.204+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.208+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:03:36.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.208+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15430991865638551867', time=2024-09-12T03:03:23.881943+0000, chain.objs.size()=1 2024-09-12T01:03:36.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.208+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.117__shadow_.cVsDN71dyptUbOhWionW_ucJE14N9pr_0 2024-09-12T01:03:36.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.208+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15546221104912401715', time=2024-09-12T03:03:29.835475+0000, chain.objs.size()=1 2024-09-12T01:03:36.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.208+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.132__shadow_.jH_-lmH3QEphKLhSloaUNqLUee_1wXQ_0 2024-09-12T01:03:36.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.208+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5600140400350453260', time=2024-09-12T03:03:30.217831+0000, chain.objs.size()=1 2024-09-12T01:03:36.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.208+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.133__shadow_.Q2dRlkswOd_biP-2H6npItS7IVQnpea_0 2024-09-12T01:03:36.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.208+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16634164636570514618', time=2024-09-12T03:03:31.499958+0000, chain.objs.size()=1 2024-09-12T01:03:36.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.208+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.137__shadow_.W_PaRFknmLYXYMctHO3mRwVziCLhVtF_0 2024-09-12T01:03:36.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.208+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8249614357752984943', time=2024-09-12T03:03:32.085410+0000, chain.objs.size()=1 2024-09-12T01:03:36.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.208+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.139__shadow_.n-B2Wqje5xuVmFVI0wcWYFeZsQ5iJ2H_0 2024-09-12T01:03:36.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.212+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.212+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:03:36.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.216+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.216+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.220+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:03:36.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.220+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17335238278749969848', time=2024-09-12T03:03:05.784760+0000, chain.objs.size()=4 2024-09-12T01:03:36.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.220+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.94__shadow_.sxoBmYnrIZYj-DRWjwTPU-lOCjn1Ofs_0 2024-09-12T01:03:36.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.220+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.94__shadow_.sxoBmYnrIZYj-DRWjwTPU-lOCjn1Ofs_1 2024-09-12T01:03:36.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.220+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.94__shadow_.sxoBmYnrIZYj-DRWjwTPU-lOCjn1Ofs_2 2024-09-12T01:03:36.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.220+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.94__shadow_.sxoBmYnrIZYj-DRWjwTPU-lOCjn1Ofs_3 2024-09-12T01:03:36.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.220+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14810682908718275530', time=2024-09-12T03:03:16.362443+0000, chain.objs.size()=5 2024-09-12T01:03:36.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.220+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__multipart_key1.2~dG5sjKXSoTWnbCc12ACLy43vgrFOZ4a.1 2024-09-12T01:03:36.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.220+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__shadow_key1.2~dG5sjKXSoTWnbCc12ACLy43vgrFOZ4a.1_1 2024-09-12T01:03:36.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.220+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__multipart_key1.2~dG5sjKXSoTWnbCc12ACLy43vgrFOZ4a.2 2024-09-12T01:03:36.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.220+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__shadow_key1.2~dG5sjKXSoTWnbCc12ACLy43vgrFOZ4a.2_1 2024-09-12T01:03:36.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.220+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__multipart_key1.2~dG5sjKXSoTWnbCc12ACLy43vgrFOZ4a.3 2024-09-12T01:03:36.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.220+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7959736753592594935', time=2024-09-12T03:03:22.260893+0000, chain.objs.size()=1 2024-09-12T01:03:36.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.220+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.113__shadow_.VJhBh9OTtg8nm1j4IMFmEMLhpgSeMGw_0 2024-09-12T01:03:36.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.220+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15311811199760924493', time=2024-09-12T03:03:23.064139+0000, chain.objs.size()=1 2024-09-12T01:03:36.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.220+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.115__shadow_.VwnRPjM0c44SzMu50-9MBNgbs8Qdcir_0 2024-09-12T01:03:36.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.220+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17037909719902399996', time=2024-09-12T03:03:28.261906+0000, chain.objs.size()=1 2024-09-12T01:03:36.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.220+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.128__shadow_.r80gV7UOShHsd0Vcgz-uS14hMk_CVvH_0 2024-09-12T01:03:36.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.228+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.232+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:03:36.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.236+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.236+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.236+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:03:36.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.236+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7708319733635062218', time=2024-09-12T03:03:23.114165+0000, chain.objs.size()=1 2024-09-12T01:03:36.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.236+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.115__shadow_.9vWcZ3E7bULuratxrJ3MUH4OlfkimJg_0 2024-09-12T01:03:36.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.236+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16554856811323734049', time=2024-09-12T03:03:26.348329+0000, chain.objs.size()=1 2024-09-12T01:03:36.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.236+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.123__shadow_.hqmcycW5qjyxcNnEXwkGjsEVgM-_MpX_0 2024-09-12T01:03:36.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.240+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.244+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:03:36.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.248+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.248+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.248+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:03:36.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.248+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4236236441868520568', time=2024-09-12T03:03:15.664747+0000, chain.objs.size()=5 2024-09-12T01:03:36.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.248+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__multipart_key1.2~P5VC1PvTRmCH9ASwHT70waCwd_0QM7R.1 2024-09-12T01:03:36.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.248+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__shadow_key1.2~P5VC1PvTRmCH9ASwHT70waCwd_0QM7R.1_1 2024-09-12T01:03:36.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.248+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__multipart_key1.2~P5VC1PvTRmCH9ASwHT70waCwd_0QM7R.2 2024-09-12T01:03:36.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.248+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__shadow_key1.2~P5VC1PvTRmCH9ASwHT70waCwd_0QM7R.2_1 2024-09-12T01:03:36.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.248+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__multipart_key1.2~P5VC1PvTRmCH9ASwHT70waCwd_0QM7R.3 2024-09-12T01:03:36.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.248+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17450387497861923204', time=2024-09-12T03:03:25.915105+0000, chain.objs.size()=1 2024-09-12T01:03:36.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.248+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.122__shadow_.gDTxJI_xq6siOAqz8Xf4zxDpS0f0tnN_0 2024-09-12T01:03:36.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.248+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.272120640178591920', time=2024-09-12T03:03:30.568162+0000, chain.objs.size()=1 2024-09-12T01:03:36.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.248+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.134__shadow_.Ibfhpj-UAJ3PW4IkmNaNwig5jsm3a6-_0 2024-09-12T01:03:36.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.256+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.260+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:03:36.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.264+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.264+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.264+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:03:36.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.264+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='2~iOiZ-JtArhW3dZG-IQrtMuvq8t9M0Bt', time=2024-09-12T03:02:54.817856+0000, chain.objs.size()=5 2024-09-12T01:03:36.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.264+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.80__multipart_key1.2~iOiZ-JtArhW3dZG-IQrtMuvq8t9M0Bt.1 2024-09-12T01:03:36.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.264+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.80__multipart_key1.2~iOiZ-JtArhW3dZG-IQrtMuvq8t9M0Bt.2 2024-09-12T01:03:36.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.264+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.80__multipart_key1.2~iOiZ-JtArhW3dZG-IQrtMuvq8t9M0Bt.3 2024-09-12T01:03:36.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.264+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.80__multipart_key1.2~iOiZ-JtArhW3dZG-IQrtMuvq8t9M0Bt.4 2024-09-12T01:03:36.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.264+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.80__multipart_key1.2~iOiZ-JtArhW3dZG-IQrtMuvq8t9M0Bt.5 2024-09-12T01:03:36.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.264+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17025241092886769841', time=2024-09-12T03:03:27.860620+0000, chain.objs.size()=1 2024-09-12T01:03:36.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.264+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.127__shadow_.ruIcA5UQTMZEz7NjGsBA2ljFiVfmRu5_0 2024-09-12T01:03:36.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.272+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.276+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:03:36.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.280+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.280+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.280+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:03:36.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.280+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9793104703793384381', time=2024-09-12T03:02:57.380853+0000, chain.objs.size()=1 2024-09-12T01:03:36.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.280+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.86__shadow_.WWNt0_wYAk-n51Jqa9ltt6TbeyCEJte_0 2024-09-12T01:03:36.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.280+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17393510454435635172', time=2024-09-12T03:03:02.356623+0000, chain.objs.size()=5 2024-09-12T01:03:36.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.280+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__multipart_key1.2~88KwsB9mVDJdPFAYw5nT3TcoRkiBrVQ.1 2024-09-12T01:03:36.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.280+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__multipart_key1.2~88KwsB9mVDJdPFAYw5nT3TcoRkiBrVQ.2 2024-09-12T01:03:36.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.280+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__multipart_key1.2~88KwsB9mVDJdPFAYw5nT3TcoRkiBrVQ.3 2024-09-12T01:03:36.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.284+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__multipart_key1.2~88KwsB9mVDJdPFAYw5nT3TcoRkiBrVQ.4 2024-09-12T01:03:36.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.284+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__multipart_key1.2~88KwsB9mVDJdPFAYw5nT3TcoRkiBrVQ.5 2024-09-12T01:03:36.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.284+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3334052073071364149', time=2024-09-12T03:03:22.651567+0000, chain.objs.size()=1 2024-09-12T01:03:36.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.284+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.114__shadow_.Ok86Vdw1cCC6vF3KqiMhw_zIc-1kIjO_0 2024-09-12T01:03:36.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.284+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18036283344140897007', time=2024-09-12T03:03:25.516063+0000, chain.objs.size()=1 2024-09-12T01:03:36.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.284+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.121__shadow_.iFM7ehAdc5iO1utwGhGUyuL_li_Uxp-_0 2024-09-12T01:03:36.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.284+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12649052106617664090', time=2024-09-12T03:03:29.455441+0000, chain.objs.size()=1 2024-09-12T01:03:36.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.284+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.131__shadow_.fuzRioAy2uVAwmKoAby4jqLQK1tMIhP_0 2024-09-12T01:03:36.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.292+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.296+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:03:36.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.300+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.300+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.300+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:03:36.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.300+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='2~8Ugc-sfkTuxXtWpSlkPjNhF_s4lrMU-', time=2024-09-12T03:03:11.266057+0000, chain.objs.size()=5 2024-09-12T01:03:36.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.300+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.102__multipart_key1.2~8Ugc-sfkTuxXtWpSlkPjNhF_s4lrMU-.7 2024-09-12T01:03:36.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.300+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.102__multipart_key1.2~8Ugc-sfkTuxXtWpSlkPjNhF_s4lrMU-.8 2024-09-12T01:03:36.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.300+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.102__multipart_key1.2~8Ugc-sfkTuxXtWpSlkPjNhF_s4lrMU-.9 2024-09-12T01:03:36.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.300+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.102__multipart_key1.2~8Ugc-sfkTuxXtWpSlkPjNhF_s4lrMU-.10 2024-09-12T01:03:36.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.300+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.102__multipart_key1.2~8Ugc-sfkTuxXtWpSlkPjNhF_s4lrMU-.11 2024-09-12T01:03:36.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.300+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8699265806646299373', time=2024-09-12T03:03:19.113129+0000, chain.objs.size()=5 2024-09-12T01:03:36.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.300+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.105__multipart_key1.2~ZZMPzAp7ysa9DDwckmS6PS4lTBX6_3C.1 2024-09-12T01:03:36.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.300+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.105__multipart_key1.2~ZZMPzAp7ysa9DDwckmS6PS4lTBX6_3C.2 2024-09-12T01:03:36.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.300+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.105__multipart_key1.2~ZZMPzAp7ysa9DDwckmS6PS4lTBX6_3C.3 2024-09-12T01:03:36.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.300+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.105__multipart_key1.2~ZZMPzAp7ysa9DDwckmS6PS4lTBX6_3C.4 2024-09-12T01:03:36.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.300+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.105__multipart_key1.2~ZZMPzAp7ysa9DDwckmS6PS4lTBX6_3C.5 2024-09-12T01:03:36.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.300+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6631744006363096126', time=2024-09-12T03:03:27.074348+0000, chain.objs.size()=1 2024-09-12T01:03:36.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.300+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.125__shadow_.4ZeibUyRTnKzCQFIZyeF84mHlU1rhb-_0 2024-09-12T01:03:36.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.312+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.316+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:03:36.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.320+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.320+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.324+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:03:36.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.324+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6025276806563497455', time=2024-09-12T03:02:58.797951+0000, chain.objs.size()=1 2024-09-12T01:03:36.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.324+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.91__shadow_.51XH5sTHZ2RF940uvd9vzGcaoR1pLPi_0 2024-09-12T01:03:36.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.324+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11393277886204088442', time=2024-09-12T03:03:25.099641+0000, chain.objs.size()=1 2024-09-12T01:03:36.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.324+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.120__shadow_.OJGNfn0PsC0QHepSr7IvL2EQ4SmBVpv_0 2024-09-12T01:03:36.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.324+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5330659068293772742', time=2024-09-12T03:03:25.127303+0000, chain.objs.size()=1 2024-09-12T01:03:36.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.324+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.120__shadow_.63ZTkZyo1-SWPiKH6ia_vTyKbj9Ap3A_0 2024-09-12T01:03:36.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.324+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7764930171322594853', time=2024-09-12T03:03:29.052098+0000, chain.objs.size()=1 2024-09-12T01:03:36.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.324+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.130__shadow_.Y5TK_3DXWUJnLVHMys54WwdamxQiplk_0 2024-09-12T01:03:36.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.324+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.332+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:03:36.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.336+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.336+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.336+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:03:36.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.336+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.265092182583068455', time=2024-09-12T03:03:22.247751+0000, chain.objs.size()=1 2024-09-12T01:03:36.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.336+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.113__shadow_.8MixqNXeH7X4jcRq3zNlYlvEetVlUvy_0 2024-09-12T01:03:36.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.336+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16680434468731131179', time=2024-09-12T03:03:23.485184+0000, chain.objs.size()=1 2024-09-12T01:03:36.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.336+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.116__shadow_.bN-dzXe9CfETV6qr_neAruQP_22BiZG_0 2024-09-12T01:03:36.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.336+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15994547019888536936', time=2024-09-12T03:03:26.687238+0000, chain.objs.size()=1 2024-09-12T01:03:36.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.336+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.124__shadow_._y6oCRlex6ePknrwmWV9lQ5Oq1TY7Zt_0 2024-09-12T01:03:36.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.336+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.234803234891964149', time=2024-09-12T03:03:28.649263+0000, chain.objs.size()=1 2024-09-12T01:03:36.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.336+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.129__shadow_.tUhJl_FOVODvmzjnzuW0dnAtZTsL1Dk_0 2024-09-12T01:03:36.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.340+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.344+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:03:36.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.348+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.348+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.352+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:03:36.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.352+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10002919638445214355', time=2024-09-12T03:02:55.658658+0000, chain.objs.size()=1 2024-09-12T01:03:36.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.352+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.82__shadow_.BLXr8f98VUs9K5RUZbMbpz4ERp4Dh2d_0 2024-09-12T01:03:36.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.352+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9306931642413842643', time=2024-09-12T03:03:22.673105+0000, chain.objs.size()=1 2024-09-12T01:03:36.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.352+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.114__shadow_.e4skP9qzofTAFDLu1C6Wl3NGvDd18gR_0 2024-09-12T01:03:36.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.352+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17301640709323233565', time=2024-09-12T03:03:24.289260+0000, chain.objs.size()=1 2024-09-12T01:03:36.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.352+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.118__shadow_.zT2U8Kj2jlofcExifmFA2ycfm_CR1MG_0 2024-09-12T01:03:36.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.352+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16531350509736301016', time=2024-09-12T03:03:26.721802+0000, chain.objs.size()=1 2024-09-12T01:03:36.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.352+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.124__shadow_.XYQi33CpCxevQBdydPcgQTHWY4_CSpL_0 2024-09-12T01:03:36.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.352+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9140475613795905128', time=2024-09-12T03:03:31.800035+0000, chain.objs.size()=1 2024-09-12T01:03:36.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.352+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.138__shadow_.UQZa7-rRMT4aXHS8RfYDfRtLl5NuJQd_0 2024-09-12T01:03:36.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.352+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.360+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:03:36.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.364+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.364+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.364+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:03:36.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.364+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7951313088575178323', time=2024-09-12T03:03:18.090802+0000, chain.objs.size()=5 2024-09-12T01:03:36.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.364+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.104__multipart_key1.2~xAxrZFGW_0Rvm8VKnyb3wKIThoZiRUL.1 2024-09-12T01:03:36.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.364+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.104__multipart_key1.2~xAxrZFGW_0Rvm8VKnyb3wKIThoZiRUL.2 2024-09-12T01:03:36.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.364+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.104__multipart_key1.2~xAxrZFGW_0Rvm8VKnyb3wKIThoZiRUL.3 2024-09-12T01:03:36.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.364+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.104__multipart_key1.2~xAxrZFGW_0Rvm8VKnyb3wKIThoZiRUL.4 2024-09-12T01:03:36.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.364+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.104__multipart_key1.2~xAxrZFGW_0Rvm8VKnyb3wKIThoZiRUL.5 2024-09-12T01:03:36.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.364+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16972524116470770550', time=2024-09-12T03:03:27.067924+0000, chain.objs.size()=1 2024-09-12T01:03:36.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.364+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.125__shadow_.yTIj9Hga9Oe66BFZ6r2OhmeohSGmedM_0 2024-09-12T01:03:36.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.364+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7159260441521267244', time=2024-09-12T03:03:28.644091+0000, chain.objs.size()=1 2024-09-12T01:03:36.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.364+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.129__shadow_._EzC_aBISWKto4r11PwW9Mt7FXTjyVn_0 2024-09-12T01:03:36.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.364+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.893900538271736902', time=2024-09-12T03:03:29.816650+0000, chain.objs.size()=1 2024-09-12T01:03:36.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.364+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.132__shadow_.Xi7KK8OYbhqJojM3AbDsab6xYeOCFT9_0 2024-09-12T01:03:36.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.364+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7167980719301285828', time=2024-09-12T03:03:30.212649+0000, chain.objs.size()=1 2024-09-12T01:03:36.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.364+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.133__shadow_.3QtLc4K2GwCsPxNZdLeeal8U1aofRuU_0 2024-09-12T01:03:36.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.372+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.380+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:03:36.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.384+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.384+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.384+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T01:03:36.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.384+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4969169891813042740', time=2024-09-12T03:03:09.364861+0000, chain.objs.size()=5 2024-09-12T01:03:36.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.384+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.101__multipart_file2.mpg.2~ji42W42tKDOBhCQwHfFLBoEe6m000cX.1 2024-09-12T01:03:36.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.384+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.101__multipart_file2.mpg.2~ji42W42tKDOBhCQwHfFLBoEe6m000cX.2 2024-09-12T01:03:36.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.384+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.101__multipart_file2.mpg.2~ji42W42tKDOBhCQwHfFLBoEe6m000cX.3 2024-09-12T01:03:36.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.384+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.101__multipart_file2.mpg.2~ji42W42tKDOBhCQwHfFLBoEe6m000cX.4 2024-09-12T01:03:36.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.384+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.101__multipart_file2.mpg.2~ji42W42tKDOBhCQwHfFLBoEe6m000cX.5 2024-09-12T01:03:36.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.384+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14358499150913120423', time=2024-09-12T03:03:09.395228+0000, chain.objs.size()=1 2024-09-12T01:03:36.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.384+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.101__shadow_.J1gULWzsHFhkCofOOONiRQ38T4XFeLO_0 2024-09-12T01:03:36.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.384+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12939961647023284153', time=2024-09-12T03:03:24.700073+0000, chain.objs.size()=1 2024-09-12T01:03:36.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.384+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.119__shadow_.6cOm3xDSBy_kVXscxEp7v3s5saT-eYv_0 2024-09-12T01:03:36.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.384+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.496467418336702004', time=2024-09-12T03:03:24.726327+0000, chain.objs.size()=1 2024-09-12T01:03:36.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.384+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.119__shadow_.cK5lmN1TomPazC7IDAKZn3y5C0BQ0TJ_0 2024-09-12T01:03:36.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.384+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16056625865614927609', time=2024-09-12T03:03:25.949813+0000, chain.objs.size()=1 2024-09-12T01:03:36.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.384+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.122__shadow_.6sCM4Vzz6N1MNQ2OnAJlRJ-zBLaIo66_0 2024-09-12T01:03:36.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.384+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6679019364808405360', time=2024-09-12T03:03:27.481487+0000, chain.objs.size()=1 2024-09-12T01:03:36.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.384+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.126__shadow_.HkVhpMtpcGZ44peAnRp691DuRuIzf_v_0 2024-09-12T01:03:36.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.392+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.396+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:03:36.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.400+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.404+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.404+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:03:36.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.404+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6497625997353651370', time=2024-09-12T03:03:22.274596+0000, chain.objs.size()=1 2024-09-12T01:03:36.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.404+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.113__shadow_.R9eDAZopffq3iGpbkdmlIJ9zfwsEOZe_0 2024-09-12T01:03:36.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.404+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9732267929379067072', time=2024-09-12T03:03:23.472277+0000, chain.objs.size()=1 2024-09-12T01:03:36.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.404+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.116__shadow_.aLlOj0it8cYy-jgVUohNXcOQ2EQ_kox_0 2024-09-12T01:03:36.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.404+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6459092355185383019', time=2024-09-12T03:03:28.661376+0000, chain.objs.size()=1 2024-09-12T01:03:36.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.404+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.129__shadow_.eqEC00o6evVAlt9TjQPREpymzSD3P4e_0 2024-09-12T01:03:36.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.408+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.412+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:03:36.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.416+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.416+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.416+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:03:36.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.416+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13733845519253596846', time=2024-09-12T03:02:57.053977+0000, chain.objs.size()=1 2024-09-12T01:03:36.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.416+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.85__shadow_.ioDUN4H9U5qyPnwWoB3kfK-PdjX6Ra__0 2024-09-12T01:03:36.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.416+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8735566679708446458', time=2024-09-12T03:03:12.767068+0000, chain.objs.size()=5 2024-09-12T01:03:36.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.416+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__multipart_key1.2~706wynK9yuybV-1W_2HRC-qLo7HxxZg.1 2024-09-12T01:03:36.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.416+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__multipart_key1.2~706wynK9yuybV-1W_2HRC-qLo7HxxZg.2 2024-09-12T01:03:36.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.416+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__multipart_key1.2~706wynK9yuybV-1W_2HRC-qLo7HxxZg.3 2024-09-12T01:03:36.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.416+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__multipart_key1.2~706wynK9yuybV-1W_2HRC-qLo7HxxZg.4 2024-09-12T01:03:36.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.416+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__multipart_key1.2~706wynK9yuybV-1W_2HRC-qLo7HxxZg.5 2024-09-12T01:03:36.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.416+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8027893785816522508', time=2024-09-12T03:03:28.244131+0000, chain.objs.size()=1 2024-09-12T01:03:36.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.416+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.128__shadow_.6SHkDJ6eYPvZ6PmyYqxgkp-I3vCfn6a_0 2024-09-12T01:03:36.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.416+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11689196484301636231', time=2024-09-12T03:03:29.091782+0000, chain.objs.size()=1 2024-09-12T01:03:36.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.416+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.130__shadow_.Do-7rQtmVJ6fEMBYABqWOBRSvc6iPqj_0 2024-09-12T01:03:36.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.424+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.428+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:03:36.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.432+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.432+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.436+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:03:36.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.436+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15164369666292653190', time=2024-09-12T03:03:23.459507+0000, chain.objs.size()=1 2024-09-12T01:03:36.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.436+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.116__shadow_.p-rNDN57hrUFTd4xlS4dEIB_ArYf2w9_0 2024-09-12T01:03:36.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.436+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12941352726949306634', time=2024-09-12T03:03:24.307660+0000, chain.objs.size()=1 2024-09-12T01:03:36.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.436+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.118__shadow_.ZIP_cg6HdLqUTNn_kMiyOU_twuUGO0s_0 2024-09-12T01:03:36.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.436+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18243200418058758932', time=2024-09-12T03:03:28.248914+0000, chain.objs.size()=1 2024-09-12T01:03:36.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.436+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.128__shadow_.VYQxowdamvDck8jIS3USBsmM7LCHEby_0 2024-09-12T01:03:36.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.436+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5313891520048252115', time=2024-09-12T03:03:28.674317+0000, chain.objs.size()=1 2024-09-12T01:03:36.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.436+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.129__shadow_.tDlxMkOgVFgvSOEBI_S4wOMpMyHHVPV_0 2024-09-12T01:03:36.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.436+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4853049884383741245', time=2024-09-12T03:03:35.399278+0000, chain.objs.size()=5 2024-09-12T01:03:36.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.436+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.145__multipart_key1/data/file.mpg.2~DQbtK_WLjhec80bzdSCXcsFbfIvLGQS.1 2024-09-12T01:03:36.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.436+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.145__multipart_key1/data/file.mpg.2~DQbtK_WLjhec80bzdSCXcsFbfIvLGQS.2 2024-09-12T01:03:36.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.436+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.145__multipart_key1/data/file.mpg.2~DQbtK_WLjhec80bzdSCXcsFbfIvLGQS.3 2024-09-12T01:03:36.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.436+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.145__multipart_key1/data/file.mpg.2~DQbtK_WLjhec80bzdSCXcsFbfIvLGQS.4 2024-09-12T01:03:36.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.436+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.145__multipart_key1/data/file.mpg.2~DQbtK_WLjhec80bzdSCXcsFbfIvLGQS.5 2024-09-12T01:03:36.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.444+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.452+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:03:36.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.452+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.456+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.456+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T01:03:36.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.456+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17389661712713535100', time=2024-09-12T03:02:52.582218+0000, chain.objs.size()=1 2024-09-12T01:03:36.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.456+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.78__shadow_.hya-UJVUXzHO1wJmTVn5i6HOE9tssUl_0 2024-09-12T01:03:36.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.456+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16429663397582390397', time=2024-09-12T03:02:56.713126+0000, chain.objs.size()=2 2024-09-12T01:03:36.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.456+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.84__shadow_.2QX_yvBknSAnBdKi-TEd5rFSwLDKwzm_0 2024-09-12T01:03:36.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.456+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.84__shadow_.2QX_yvBknSAnBdKi-TEd5rFSwLDKwzm_1 2024-09-12T01:03:36.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.456+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9525526587570791396', time=2024-09-12T03:03:09.336744+0000, chain.objs.size()=5 2024-09-12T01:03:36.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.456+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.101__multipart_file.mpg.2~B9sRoExEoBof2ntGYkHk-_RohtPe8oP.1 2024-09-12T01:03:36.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.456+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.101__multipart_file.mpg.2~B9sRoExEoBof2ntGYkHk-_RohtPe8oP.2 2024-09-12T01:03:36.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.456+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.101__multipart_file.mpg.2~B9sRoExEoBof2ntGYkHk-_RohtPe8oP.3 2024-09-12T01:03:36.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.456+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.101__multipart_file.mpg.2~B9sRoExEoBof2ntGYkHk-_RohtPe8oP.4 2024-09-12T01:03:36.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.456+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.101__multipart_file.mpg.2~B9sRoExEoBof2ntGYkHk-_RohtPe8oP.5 2024-09-12T01:03:36.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.456+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8831456977316690402', time=2024-09-12T03:03:26.709363+0000, chain.objs.size()=1 2024-09-12T01:03:36.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.456+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.124__shadow_.dUBQUpq1SlpIUfnG-PqAyZjGnCPe66Z_0 2024-09-12T01:03:36.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.456+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5581843043649629546', time=2024-09-12T03:03:27.886856+0000, chain.objs.size()=1 2024-09-12T01:03:36.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.456+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.127__shadow_.8-gpNs5vcUNdwUps_OWkt47rrqYrmpS_0 2024-09-12T01:03:36.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.456+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.311091730336653630', time=2024-09-12T03:03:29.065473+0000, chain.objs.size()=1 2024-09-12T01:03:36.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.456+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.130__shadow_.PTP_7AOFP14p6TCIxjIJuUGRXtpuRYg_0 2024-09-12T01:03:36.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.464+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.468+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:03:36.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.472+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.472+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.476+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:03:36.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.476+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5891384040286566057', time=2024-09-12T03:03:25.140845+0000, chain.objs.size()=1 2024-09-12T01:03:36.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.476+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.120__shadow_.uM9rd8PdqMTbkPQK-k5um7cqOoR8q8T_0 2024-09-12T01:03:36.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.476+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7193614251085060636', time=2024-09-12T03:03:27.491367+0000, chain.objs.size()=1 2024-09-12T01:03:36.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.476+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.126__shadow_.75UrPjoVx_sJ2Cp90ufaP3sTVHn4d87_0 2024-09-12T01:03:36.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.476+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1856776624270095033', time=2024-09-12T03:03:28.282462+0000, chain.objs.size()=1 2024-09-12T01:03:36.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.476+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.128__shadow_.3jl6GewtXkvOOxgfHdDE3vAdK-aHdBz_0 2024-09-12T01:03:36.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.476+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14005123108736802780', time=2024-09-12T03:03:29.078128+0000, chain.objs.size()=1 2024-09-12T01:03:36.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.476+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.130__shadow_.toYjmtbPo4xSvxchFd3hcImba3j0Rm5_0 2024-09-12T01:03:36.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.476+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11691004082678053939', time=2024-09-12T03:03:30.199827+0000, chain.objs.size()=1 2024-09-12T01:03:36.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.476+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.133__shadow_.d6BzVhSR2JS6R0jpfKm3CkveLU0jSyW_0 2024-09-12T01:03:36.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.480+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.484+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:03:36.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.488+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.488+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.488+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:03:36.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.488+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14940292038661335308', time=2024-09-12T03:03:04.087217+0000, chain.objs.size()=5 2024-09-12T01:03:36.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.488+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__multipart_key1.2~7Xt0Rx_j_HON_eC2VpH_tGSPHCt2f7X.1 2024-09-12T01:03:36.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.488+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__multipart_key1.2~7Xt0Rx_j_HON_eC2VpH_tGSPHCt2f7X.2 2024-09-12T01:03:36.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.488+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__multipart_key1.2~7Xt0Rx_j_HON_eC2VpH_tGSPHCt2f7X.3 2024-09-12T01:03:36.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.488+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__multipart_key1.2~7Xt0Rx_j_HON_eC2VpH_tGSPHCt2f7X.4 2024-09-12T01:03:36.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.488+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__multipart_key1.2~7Xt0Rx_j_HON_eC2VpH_tGSPHCt2f7X.5 2024-09-12T01:03:36.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.488+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14313365960677337644', time=2024-09-12T03:03:23.868127+0000, chain.objs.size()=1 2024-09-12T01:03:36.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.488+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.117__shadow_.Y1gt7YzkNR3xltREESzVKgtFPH51Mm7_0 2024-09-12T01:03:36.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.488+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14074168173200604878', time=2024-09-12T03:03:24.294276+0000, chain.objs.size()=1 2024-09-12T01:03:36.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.488+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.118__shadow_.7brEWZWXaE9dxb6fpeF7_wfBCAP-Z9n_0 2024-09-12T01:03:36.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.500+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.504+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:03:36.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.508+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.508+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.508+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:03:36.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.508+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14246650032255001540', time=2024-09-12T03:03:23.505885+0000, chain.objs.size()=1 2024-09-12T01:03:36.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.508+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.116__shadow_.e5VBNmdT6reNJO99j5eaQNg62CEeh6m_0 2024-09-12T01:03:36.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.508+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14150679259214765068', time=2024-09-12T03:03:23.916230+0000, chain.objs.size()=1 2024-09-12T01:03:36.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.508+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.117__shadow_.Y85Xj1odILsiBJldvSRH3WS2_jez3Es_0 2024-09-12T01:03:36.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.508+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11360615785154749807', time=2024-09-12T03:03:27.847044+0000, chain.objs.size()=1 2024-09-12T01:03:36.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.508+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.127__shadow_.z4xpgOk6yMAl0Y-2_PeApyQixx27HIG_0 2024-09-12T01:03:36.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.512+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.516+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:03:36.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.524+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.524+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.524+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T01:03:36.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.524+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.797978354576766814', time=2024-09-12T03:03:25.538030+0000, chain.objs.size()=1 2024-09-12T01:03:36.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.524+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.121__shadow_.CV72Y87d1llLQd9wE41Mp9_vnzcE2qw_0 2024-09-12T01:03:36.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.524+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4333708418658009361', time=2024-09-12T03:03:25.910678+0000, chain.objs.size()=1 2024-09-12T01:03:36.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.524+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.122__shadow_.DCRVuPPDOJJkNoDvxUnoCAlSsC_glXW_0 2024-09-12T01:03:36.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.524+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11606665389724728170', time=2024-09-12T03:03:26.321781+0000, chain.objs.size()=1 2024-09-12T01:03:36.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.524+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.123__shadow_.YHSvDOeIvNCeARznRnrqz6WdpKTS47p_0 2024-09-12T01:03:36.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.524+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11778176166254214632', time=2024-09-12T03:03:27.096331+0000, chain.objs.size()=1 2024-09-12T01:03:36.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.524+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.125__shadow_.ejkhmmfMfOPsxmVlN3f24kkd087wg-T_0 2024-09-12T01:03:36.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.524+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15632880595162917673', time=2024-09-12T03:03:30.589112+0000, chain.objs.size()=1 2024-09-12T01:03:36.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.524+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.134__shadow_.J24a7kfkavv0m342pG36eUKqNJFktHY_0 2024-09-12T01:03:36.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.524+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8916357147148489351', time=2024-09-12T03:03:35.422585+0000, chain.objs.size()=1 2024-09-12T01:03:36.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.524+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.145__shadow_.NzfdnyQ2ga9dBCDdyHv1Bw1I3uVW5zL_0 2024-09-12T01:03:36.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.532+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.536+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:03:36.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.544+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.544+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.544+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:03:36.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.544+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9076200446341081505', time=2024-09-12T03:03:05.640511+0000, chain.objs.size()=5 2024-09-12T01:03:36.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.544+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__multipart_key1.2~4gMEkGt5BL1GEjPmcHHJXnX1GI4eRVb.1 2024-09-12T01:03:36.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.544+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__shadow_key1.2~4gMEkGt5BL1GEjPmcHHJXnX1GI4eRVb.1_1 2024-09-12T01:03:36.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.544+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__multipart_key1.2~4gMEkGt5BL1GEjPmcHHJXnX1GI4eRVb.2 2024-09-12T01:03:36.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.544+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__shadow_key1.2~4gMEkGt5BL1GEjPmcHHJXnX1GI4eRVb.2_1 2024-09-12T01:03:36.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.544+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__multipart_key1.2~4gMEkGt5BL1GEjPmcHHJXnX1GI4eRVb.3 2024-09-12T01:03:36.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.544+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10475476535479182430', time=2024-09-12T03:03:16.531894+0000, chain.objs.size()=5 2024-09-12T01:03:36.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.544+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__multipart_key1.2~zUW43jyrNZAJzJy1Yjwk8mpaYsSZuUp.1 2024-09-12T01:03:36.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.544+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__shadow_key1.2~zUW43jyrNZAJzJy1Yjwk8mpaYsSZuUp.1_1 2024-09-12T01:03:36.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.544+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__multipart_key1.2~zUW43jyrNZAJzJy1Yjwk8mpaYsSZuUp.2 2024-09-12T01:03:36.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.544+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__shadow_key1.2~zUW43jyrNZAJzJy1Yjwk8mpaYsSZuUp.2_1 2024-09-12T01:03:36.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.544+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__multipart_key1.2~zUW43jyrNZAJzJy1Yjwk8mpaYsSZuUp.3 2024-09-12T01:03:36.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.544+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3069500169389814117', time=2024-09-12T03:03:29.449718+0000, chain.objs.size()=1 2024-09-12T01:03:36.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.544+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.131__shadow_.g-3Gp7-nCkUiuSTvdnJa9Kp-i6YKnQu_0 2024-09-12T01:03:36.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.544+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3005102598704153594', time=2024-09-12T03:03:32.699739+0000, chain.objs.size()=1 2024-09-12T01:03:36.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.544+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.140__shadow_.BR70Sy4qe05tMfmJ0dCmm8aTYMv26Mi_0 2024-09-12T01:03:36.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.556+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.560+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:03:36.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.564+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.568+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.568+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:03:36.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.568+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15850001403666306911', time=2024-09-12T03:03:17.467458+0000, chain.objs.size()=1 2024-09-12T01:03:36.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.568+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.104__shadow_.HWxMM2bX34ZlNF45A3-VndHweVradim_0 2024-09-12T01:03:36.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.568+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.597584115715237251', time=2024-09-12T03:03:22.287356+0000, chain.objs.size()=1 2024-09-12T01:03:36.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.568+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.113__shadow_.pJXrMbBvJc2eqz2a_DCL2_oFCgiSWM6_0 2024-09-12T01:03:36.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.568+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.964731384654837875', time=2024-09-12T03:03:25.543533+0000, chain.objs.size()=1 2024-09-12T01:03:36.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.568+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.121__shadow_.3jMheo8apzEa39QCnFEiGQ_K5KVMU5Z_0 2024-09-12T01:03:36.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.568+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12449442680386752413', time=2024-09-12T03:03:27.450496+0000, chain.objs.size()=1 2024-09-12T01:03:36.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.568+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.126__shadow_.X2cRs4zmfVSuSD1cPfmJ3WJ0Vstb_s8_0 2024-09-12T01:03:36.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.568+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3361643201843214615', time=2024-09-12T03:03:30.595355+0000, chain.objs.size()=1 2024-09-12T01:03:36.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.568+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.134__shadow_.Kg-acLeDNNern0iOlVNrL-C65uNxmAA_0 2024-09-12T01:03:36.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.572+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.576+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:03:36.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.580+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.584+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.584+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:03:36.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.584+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5936028006296633647', time=2024-09-12T03:03:05.478941+0000, chain.objs.size()=5 2024-09-12T01:03:36.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.584+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__multipart_key1.2~xtHk6BABd6015IxhuTULAuV2zoy1IQi.1 2024-09-12T01:03:36.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.584+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__shadow_key1.2~xtHk6BABd6015IxhuTULAuV2zoy1IQi.1_1 2024-09-12T01:03:36.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.584+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__multipart_key1.2~xtHk6BABd6015IxhuTULAuV2zoy1IQi.2 2024-09-12T01:03:36.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.584+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__shadow_key1.2~xtHk6BABd6015IxhuTULAuV2zoy1IQi.2_1 2024-09-12T01:03:36.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.584+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.95__multipart_key1.2~xtHk6BABd6015IxhuTULAuV2zoy1IQi.3 2024-09-12T01:03:36.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.584+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17997504158918316283', time=2024-09-12T03:03:08.580584+0000, chain.objs.size()=5 2024-09-12T01:03:36.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.584+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.100__multipart_key1.2~6VVFFH19InzhwuZIoej7UBoxTwYO2xn.1 2024-09-12T01:03:36.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.584+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.100__multipart_key1.2~6VVFFH19InzhwuZIoej7UBoxTwYO2xn.2 2024-09-12T01:03:36.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.584+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.100__multipart_key1.2~6VVFFH19InzhwuZIoej7UBoxTwYO2xn.3 2024-09-12T01:03:36.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.584+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.100__multipart_key1.2~6VVFFH19InzhwuZIoej7UBoxTwYO2xn.4 2024-09-12T01:03:36.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.584+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.100__multipart_key1.2~6VVFFH19InzhwuZIoej7UBoxTwYO2xn.5 2024-09-12T01:03:36.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.596+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.600+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:03:36.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.604+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.604+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.604+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:03:36.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.604+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11426565189060342579', time=2024-09-12T03:03:13.503087+0000, chain.objs.size()=5 2024-09-12T01:03:36.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.604+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__multipart_key1.2~F09Z2itXqWIUFEjCMMmNZN5Unb81DJc.1 2024-09-12T01:03:36.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.604+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__multipart_key1.2~F09Z2itXqWIUFEjCMMmNZN5Unb81DJc.2 2024-09-12T01:03:36.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.604+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__multipart_key1.2~F09Z2itXqWIUFEjCMMmNZN5Unb81DJc.3 2024-09-12T01:03:36.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.604+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__multipart_key1.2~F09Z2itXqWIUFEjCMMmNZN5Unb81DJc.4 2024-09-12T01:03:36.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.604+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__multipart_key1.2~F09Z2itXqWIUFEjCMMmNZN5Unb81DJc.5 2024-09-12T01:03:36.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.604+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17443416326988483967', time=2024-09-12T03:03:26.327896+0000, chain.objs.size()=1 2024-09-12T01:03:36.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.604+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.123__shadow_.HPr4vQATAjA6lKYOZvBI_jH3ZhV_ggX_0 2024-09-12T01:03:36.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.604+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11764253847801559930', time=2024-09-12T03:03:27.462115+0000, chain.objs.size()=1 2024-09-12T01:03:36.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.604+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.126__shadow_.5L9OEE9XvNcYguspWDy_XyXW-g2guP5_0 2024-09-12T01:03:36.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.616+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.620+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:03:36.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.624+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.628+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.628+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:03:36.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.628+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5582180839028401893', time=2024-09-12T03:03:00.027354+0000, chain.objs.size()=5 2024-09-12T01:03:36.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.628+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.92__multipart_key1.2~FImowxPJ0DJ2FbUNLG9z4E8pXgAy8pb.1 2024-09-12T01:03:36.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.628+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.92__multipart_key1.2~FImowxPJ0DJ2FbUNLG9z4E8pXgAy8pb.2 2024-09-12T01:03:36.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.628+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.92__multipart_key1.2~FImowxPJ0DJ2FbUNLG9z4E8pXgAy8pb.3 2024-09-12T01:03:36.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.628+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.92__multipart_key1.2~FImowxPJ0DJ2FbUNLG9z4E8pXgAy8pb.4 2024-09-12T01:03:36.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.628+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.92__multipart_key1.2~FImowxPJ0DJ2FbUNLG9z4E8pXgAy8pb.5 2024-09-12T01:03:36.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.628+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1356915137302253441', time=2024-09-12T03:03:23.086091+0000, chain.objs.size()=1 2024-09-12T01:03:36.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.628+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.115__shadow_.MmZLSUI_vT6kmgrDvKethd1H6Epyehg_0 2024-09-12T01:03:36.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.628+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6998302888096047027', time=2024-09-12T03:03:29.830629+0000, chain.objs.size()=1 2024-09-12T01:03:36.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.628+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.132__shadow_.pZFZq9IseMAVZW2OUHlQxhp50A7l5U3_0 2024-09-12T01:03:36.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.636+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.640+0000 7f71311b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:03:36.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.644+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.648+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.648+0000 7f71311b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:03:36.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.648+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7718391394795229578', time=2024-09-12T03:03:15.037196+0000, chain.objs.size()=5 2024-09-12T01:03:36.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.648+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__multipart_key1.2~AlodwVrnxjV6uwupPSOqveCenH8Ic2F.1 2024-09-12T01:03:36.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.648+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__multipart_key1.2~AlodwVrnxjV6uwupPSOqveCenH8Ic2F.2 2024-09-12T01:03:36.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.648+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__multipart_key1.2~AlodwVrnxjV6uwupPSOqveCenH8Ic2F.3 2024-09-12T01:03:36.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.648+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__multipart_key1.2~AlodwVrnxjV6uwupPSOqveCenH8Ic2F.4 2024-09-12T01:03:36.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.648+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.103__multipart_key1.2~AlodwVrnxjV6uwupPSOqveCenH8Ic2F.5 2024-09-12T01:03:36.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.648+0000 7f71311b59c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.805389911220635920', time=2024-09-12T03:03:24.678084+0000, chain.objs.size()=1 2024-09-12T01:03:36.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.648+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.119__shadow_.ScNexsXIDUCuqyK0asVOVoJrcjpTFmF_0 2024-09-12T01:03:36.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.656+0000 7f71311b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:03:36.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.664+0000 7f6fe57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:36.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.668+0000 7f71311b59c0 20 remove_watcher() i=0 2024-09-12T01:03:36.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.668+0000 7f71311b59c0 2 removed watcher, disabling cache 2024-09-12T01:03:36.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.672+0000 7f71311b59c0 20 remove_watcher() i=1 2024-09-12T01:03:36.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.672+0000 7f71311b59c0 20 remove_watcher() i=2 2024-09-12T01:03:36.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.676+0000 7f71311b59c0 20 remove_watcher() i=3 2024-09-12T01:03:36.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.676+0000 7f71311b59c0 20 remove_watcher() i=4 2024-09-12T01:03:36.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.680+0000 7f71311b59c0 20 remove_watcher() i=5 2024-09-12T01:03:36.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.680+0000 7f71311b59c0 20 remove_watcher() i=6 2024-09-12T01:03:36.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.684+0000 7f71311b59c0 20 remove_watcher() i=7 2024-09-12T01:03:36.696 DEBUG:teuthology.orchestra.run.smithi070:> radosgw-admin gc process --include-all 2024-09-12T01:03:36.770 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:03:36.770 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:03:36.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.824+0000 7fe3767969c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:36.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.828+0000 7fe3767969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:36.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.828+0000 7fe3767969c0 20 realm 2024-09-12T01:03:36.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.828+0000 7fe3767969c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:36.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.828+0000 7fe3767969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:36.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.828+0000 7fe3767969c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:03:36.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.828+0000 7fe3767969c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:36.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.828+0000 7fe3767969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:36.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.828+0000 7fe3767969c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:36.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.828+0000 7fe3767969c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:36.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.828+0000 7fe3767969c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:36.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.828+0000 7fe3767969c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:03:36.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.828+0000 7fe3767969c0 20 searching for the correct realm 2024-09-12T01:03:36.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.836+0000 7fe37429c640 0 -- 172.21.15.70:0/1610439219 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7fe36c080520 msgr2=0x7fe36c069ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:36.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.844+0000 7fe37429c640 0 -- 172.21.15.70:0/1610439219 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7fe23c080880 msgr2=0x7fe23c082cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:03:36.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.848+0000 7fe3767969c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:03:36.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.848+0000 7fe3767969c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:03:36.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.848+0000 7fe3767969c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:03:36.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.848+0000 7fe3767969c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:03:36.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.848+0000 7fe3767969c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:03:36.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.848+0000 7fe3767969c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:03:36.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.848+0000 7fe3767969c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:36.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.848+0000 7fe3767969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:36.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.848+0000 7fe3767969c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:36.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.852+0000 7fe3767969c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:36.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.852+0000 7fe3767969c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:36.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.852+0000 7fe3767969c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:03:36.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.852+0000 7fe3767969c0 20 zone default found 2024-09-12T01:03:36.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.852+0000 7fe3767969c0 4 Realm: () 2024-09-12T01:03:36.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.852+0000 7fe3767969c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:03:36.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.852+0000 7fe3767969c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:03:36.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.852+0000 7fe3767969c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:03:36.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.852+0000 7fe3767969c0 20 zonegroup default 2024-09-12T01:03:36.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.852+0000 7fe3767969c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:36.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.852+0000 7fe3767969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:36.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.852+0000 7fe3767969c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:36.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.852+0000 7fe3767969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:36.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.852+0000 7fe3767969c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:36.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.852+0000 7fe3767969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:36.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.852+0000 7fe3767969c0 20 started sync module instance, tier type = 2024-09-12T01:03:36.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.852+0000 7fe3767969c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:03:36.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.868+0000 7fe3767969c0 20 add_watcher() i=0 2024-09-12T01:03:36.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.868+0000 7fe3767969c0 20 add_watcher() i=1 2024-09-12T01:03:36.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.868+0000 7fe3767969c0 20 add_watcher() i=2 2024-09-12T01:03:36.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.868+0000 7fe3767969c0 20 add_watcher() i=3 2024-09-12T01:03:36.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.868+0000 7fe3767969c0 20 add_watcher() i=4 2024-09-12T01:03:36.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.868+0000 7fe3767969c0 20 add_watcher() i=5 2024-09-12T01:03:36.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.868+0000 7fe3767969c0 20 add_watcher() i=6 2024-09-12T01:03:36.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.868+0000 7fe3767969c0 20 add_watcher() i=7 2024-09-12T01:03:36.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.868+0000 7fe3767969c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:03:36.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.872+0000 7fe22afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:36.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.872+0000 7fe3767969c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:03:36.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.872+0000 7fe3767969c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:03:36.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.948+0000 7fe229fdb640 20 reqs_thread_entry: start 2024-09-12T01:03:36.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.948+0000 7fe3767969c0 20 init_complete bucket index max shards: 1 2024-09-12T01:03:36.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.948+0000 7fe3767969c0 20 Filter name: none 2024-09-12T01:03:36.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.948+0000 7fe19b7fe640 20 reqs_thread_entry: start 2024-09-12T01:03:36.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.948+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:03:36.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.956+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.956+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.960+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.960+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:03:36.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.964+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.968+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.968+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.972+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:03:36.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.972+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.976+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.976+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.976+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:03:36.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.980+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.984+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.984+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.984+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:03:36.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.988+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.988+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.988+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.992+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:03:36.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.996+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:36.996+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:36.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.000+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.000+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:03:36.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.004+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:36.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.008+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:37.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.008+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.012+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:03:37.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.012+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.012+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:37.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.016+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.016+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:03:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.020+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.020+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.020+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.024+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:03:37.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.024+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.024+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:37.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.024+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.028+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:03:37.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.032+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.032+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:37.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.032+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.032+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:03:37.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.036+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.036+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:37.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.040+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.040+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:03:37.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.044+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.044+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:37.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.048+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.048+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:03:37.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.052+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.052+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:37.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.052+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.056+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:03:37.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.056+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.060+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:37.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.060+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.064+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:03:37.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.064+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.064+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:37.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.064+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.068+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:03:37.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.068+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.068+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:37.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.068+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.072+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:03:37.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.076+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.076+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:37.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.076+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.080+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:03:37.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.084+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.084+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:37.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.088+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.088+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:03:37.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.092+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.092+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:37.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.096+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.096+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:03:37.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.100+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.100+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:37.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.104+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.104+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:03:37.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.108+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.112+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:37.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.112+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.112+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:03:37.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.116+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.120+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:37.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.120+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.120+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:03:37.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.124+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.128+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:37.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.128+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.132+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:03:37.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.132+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.136+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:37.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.136+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.136+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:03:37.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.144+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.144+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:37.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.144+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.148+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:03:37.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.152+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.156+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:37.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.156+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.160+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:03:37.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.164+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.164+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:37.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.168+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.168+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:03:37.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.172+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.176+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:37.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.176+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.176+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:03:37.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.180+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.184+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:37.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.184+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.188+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:03:37.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.192+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.192+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:37.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.192+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.196+0000 7fe3767969c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:03:37.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.200+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.204+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:03:37.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.204+0000 7fe3767969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:03:37.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.208+0000 7fe22afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:37.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.212+0000 7fe3767969c0 20 remove_watcher() i=0 2024-09-12T01:03:37.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.212+0000 7fe3767969c0 2 removed watcher, disabling cache 2024-09-12T01:03:37.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.216+0000 7fe3767969c0 20 remove_watcher() i=1 2024-09-12T01:03:37.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.220+0000 7fe3767969c0 20 remove_watcher() i=2 2024-09-12T01:03:37.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.220+0000 7fe3767969c0 20 remove_watcher() i=3 2024-09-12T01:03:37.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.224+0000 7fe3767969c0 20 remove_watcher() i=4 2024-09-12T01:03:37.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.224+0000 7fe3767969c0 20 remove_watcher() i=5 2024-09-12T01:03:37.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.228+0000 7fe3767969c0 20 remove_watcher() i=6 2024-09-12T01:03:37.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:37.228+0000 7fe3767969c0 20 remove_watcher() i=7 2024-09-12T01:03:37.241 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-12T01:03:37.259 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-12T01:03:37.260 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-12T01:03:37.260 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-12T01:03:37.260 DEBUG:teuthology.orchestra.run.smithi070:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T01:03:37.288 INFO:teuthology.orchestra.run.smithi070.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-12T01:03:38.107 INFO:tasks.s3tests:Creating rgw users... 2024-09-12T01:03:38.108 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW11111111111111111 --account-name Mr.RGW11111111111111111 --email RGW11111111111111111+test@test.test 2024-09-12T01:03:38.194 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:03:38.194 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:03:38.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.244+0000 7f71ec5319c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.244+0000 7f71ec5319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:38.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.244+0000 7f71ec5319c0 20 realm 2024-09-12T01:03:38.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.244+0000 7f71ec5319c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.244+0000 7f71ec5319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:38.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.244+0000 7f71ec5319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:03:38.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.244+0000 7f71ec5319c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.244+0000 7f71ec5319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:38.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.244+0000 7f71ec5319c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.248+0000 7f71ec5319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:38.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.248+0000 7f71ec5319c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.248+0000 7f71ec5319c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:03:38.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.248+0000 7f71ec5319c0 20 searching for the correct realm 2024-09-12T01:03:38.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.252+0000 7f71ea838640 0 -- 172.21.15.70:0/1563700582 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f71dc022b80 msgr2=0x7f71dc01f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:38.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.260+0000 7f71ea838640 0 -- 172.21.15.70:0/1563700582 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f70b4080800 msgr2=0x7f70b4082c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:38.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.268+0000 7f71ec5319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:03:38.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.268+0000 7f71ec5319c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:03:38.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.268+0000 7f71ec5319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:03:38.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.268+0000 7f71ec5319c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:03:38.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.268+0000 7f71ec5319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:03:38.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.268+0000 7f71ec5319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:03:38.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.268+0000 7f71ec5319c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.268+0000 7f71ec5319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:38.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.268+0000 7f71ec5319c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.268+0000 7f71ec5319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:38.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.268+0000 7f71ec5319c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.268+0000 7f71ec5319c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:03:38.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.268+0000 7f71ec5319c0 20 zone default found 2024-09-12T01:03:38.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.268+0000 7f71ec5319c0 4 Realm: () 2024-09-12T01:03:38.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.268+0000 7f71ec5319c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:03:38.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.268+0000 7f71ec5319c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:03:38.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.268+0000 7f71ec5319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:03:38.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.268+0000 7f71ec5319c0 20 zonegroup default 2024-09-12T01:03:38.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.268+0000 7f71ec5319c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.268+0000 7f71ec5319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:38.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.268+0000 7f71ec5319c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.272+0000 7f71ec5319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:38.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.272+0000 7f71ec5319c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.272+0000 7f71ec5319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:38.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.272+0000 7f71ec5319c0 20 started sync module instance, tier type = 2024-09-12T01:03:38.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.272+0000 7f71ec5319c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:03:38.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.284+0000 7f71ec5319c0 20 add_watcher() i=0 2024-09-12T01:03:38.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.284+0000 7f71ec5319c0 20 add_watcher() i=1 2024-09-12T01:03:38.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.284+0000 7f71ec5319c0 20 add_watcher() i=2 2024-09-12T01:03:38.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.284+0000 7f71ec5319c0 20 add_watcher() i=3 2024-09-12T01:03:38.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.284+0000 7f71ec5319c0 20 add_watcher() i=4 2024-09-12T01:03:38.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.284+0000 7f71ec5319c0 20 add_watcher() i=5 2024-09-12T01:03:38.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.284+0000 7f71ec5319c0 20 add_watcher() i=6 2024-09-12T01:03:38.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.288+0000 7f71ec5319c0 20 add_watcher() i=7 2024-09-12T01:03:38.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.288+0000 7f71ec5319c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:03:38.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.288+0000 7f70a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:38.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.288+0000 7f71ec5319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:03:38.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.288+0000 7f71ec5319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:03:38.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.288+0000 7f71ec5319c0 5 note: GC not initialized 2024-09-12T01:03:38.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.288+0000 7f701b7fe640 20 reqs_thread_entry: start 2024-09-12T01:03:38.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.292+0000 7f71ec5319c0 20 init_complete bucket index max shards: 1 2024-09-12T01:03:38.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.292+0000 7f71ec5319c0 20 Filter name: none 2024-09-12T01:03:38.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.292+0000 7f70197fa640 20 reqs_thread_entry: start 2024-09-12T01:03:38.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.292+0000 7f71ec5319c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 : miss 2024-09-12T01:03:38.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.292+0000 7f71ec5319c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.292+0000 7f71ec5319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:38.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.292+0000 7f71ec5319c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x0 2024-09-12T01:03:38.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.292+0000 7f71ec5319c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T01:03:38.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.292+0000 7f71ec5319c0 20 failed to read name.$Mr.RGW11111111111111111 with: (2) No such file or directory 2024-09-12T01:03:38.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.292+0000 7f71ec5319c0 10 cache get: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test : miss 2024-09-12T01:03:38.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.292+0000 7f71ec5319c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.292+0000 7f71ec5319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:38.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.292+0000 7f71ec5319c0 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x0 2024-09-12T01:03:38.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.292+0000 7f71ec5319c0 10 adding default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T01:03:38.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.292+0000 7f71ec5319c0 20 failed to read rgw11111111111111111+test@test.test with: (2) No such file or directory 2024-09-12T01:03:38.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.292+0000 7f71ec5319c0 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T01:03:38.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.292+0000 7f71ec5319c0 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T01:03:38.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.292+0000 7f71ec5319c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW11111111111111111, ofs0, ns] 2024-09-12T01:03:38.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.292+0000 7f70cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431688 cookie 94724598376208 notifier 9069 bl.length()=384 2024-09-12T01:03:38.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.292+0000 7f70cdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T01:03:38.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.292+0000 7f70cdffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T01:03:38.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.296+0000 7f71ec5319c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T01:03:38.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.296+0000 7f71ec5319c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T01:03:38.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.296+0000 7f71ec5319c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW11111111111111111, ofs0, ns] 2024-09-12T01:03:38.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.296+0000 7f70cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431743 cookie 94724598383376 notifier 9069 bl.length()=225 2024-09-12T01:03:38.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.300+0000 7f70cdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T01:03:38.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.300+0000 7f70cdffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T01:03:38.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.300+0000 7f71ec5319c0 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T01:03:38.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.300+0000 7f71ec5319c0 10 moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T01:03:38.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.300+0000 7f71ec5319c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw11111111111111111+test@test.test, ofs0, ns] 2024-09-12T01:03:38.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.300+0000 7f70cd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431696 cookie 94724598382320 notifier 9069 bl.length()=234 2024-09-12T01:03:38.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.300+0000 7f70cd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T01:03:38.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.300+0000 7f70cd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T01:03:38.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.304+0000 7f70a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:38.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.308+0000 7f71ec5319c0 20 remove_watcher() i=0 2024-09-12T01:03:38.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.308+0000 7f71ec5319c0 2 removed watcher, disabling cache 2024-09-12T01:03:38.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.308+0000 7f71ec5319c0 20 remove_watcher() i=1 2024-09-12T01:03:38.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.312+0000 7f71ec5319c0 20 remove_watcher() i=2 2024-09-12T01:03:38.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.312+0000 7f71ec5319c0 20 remove_watcher() i=3 2024-09-12T01:03:38.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.316+0000 7f71ec5319c0 20 remove_watcher() i=4 2024-09-12T01:03:38.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.316+0000 7f71ec5319c0 20 remove_watcher() i=5 2024-09-12T01:03:38.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.320+0000 7f71ec5319c0 20 remove_watcher() i=6 2024-09-12T01:03:38.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.320+0000 7f71ec5319c0 20 remove_watcher() i=7 2024-09-12T01:03:38.324 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:03:38.324 INFO:teuthology.orchestra.run.smithi070.stdout: "id": "RGW11111111111111111", 2024-09-12T01:03:38.324 INFO:teuthology.orchestra.run.smithi070.stdout: "tenant": "", 2024-09-12T01:03:38.324 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "Mr.RGW11111111111111111", 2024-09-12T01:03:38.324 INFO:teuthology.orchestra.run.smithi070.stdout: "email": "RGW11111111111111111+test@test.test", 2024-09-12T01:03:38.324 INFO:teuthology.orchestra.run.smithi070.stdout: "quota": { 2024-09-12T01:03:38.324 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T01:03:38.324 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T01:03:38.325 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T01:03:38.325 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T01:03:38.325 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T01:03:38.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:03:38.325 INFO:teuthology.orchestra.run.smithi070.stdout: "bucket_quota": { 2024-09-12T01:03:38.325 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T01:03:38.325 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T01:03:38.325 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T01:03:38.325 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T01:03:38.325 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T01:03:38.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:03:38.325 INFO:teuthology.orchestra.run.smithi070.stdout: "max_users": 1000, 2024-09-12T01:03:38.325 INFO:teuthology.orchestra.run.smithi070.stdout: "max_roles": 1000, 2024-09-12T01:03:38.326 INFO:teuthology.orchestra.run.smithi070.stdout: "max_groups": 1000, 2024-09-12T01:03:38.326 INFO:teuthology.orchestra.run.smithi070.stdout: "max_buckets": 1000, 2024-09-12T01:03:38.326 INFO:teuthology.orchestra.run.smithi070.stdout: "max_access_keys": 4 2024-09-12T01:03:38.326 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:03:38.327 DEBUG:tasks.s3tests:Creating user RGW11111111111111111 on client.0 2024-09-12T01:03:38.327 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.RGW11111111111111111 --email foo+test@test.test --access-key JRGRSIACVOINDHJKEOKD --secret 5GfEGkgMtvEPwAUxf/PC2pEQHg8/Wve+XSfcU+iIN4pNFmkn7gWnRg== --cluster ceph --account-id RGW11111111111111111 --account-root 2024-09-12T01:03:38.419 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:03:38.419 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:03:38.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.468+0000 7f1e5e19b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.468+0000 7f1e5e19b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:38.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.468+0000 7f1e5e19b9c0 20 realm 2024-09-12T01:03:38.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.468+0000 7f1e5e19b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.468+0000 7f1e5e19b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:38.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.468+0000 7f1e5e19b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:03:38.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.468+0000 7f1e5e19b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.468+0000 7f1e5e19b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:38.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.468+0000 7f1e5e19b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.472+0000 7f1e5e19b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:38.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.472+0000 7f1e5e19b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.472+0000 7f1e5e19b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:03:38.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.472+0000 7f1e5e19b9c0 20 searching for the correct realm 2024-09-12T01:03:38.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.476+0000 7f1e5c4a2640 0 -- 172.21.15.70:0/2654554123 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f1e500648a0 msgr2=0x7f1e50063310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:38.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.484+0000 7f1e5bca1640 0 -- 172.21.15.70:0/2654554123 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f1e5412c040 msgr2=0x7f1e540f7690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:03:38.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.492+0000 7f1e5e19b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:03:38.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.492+0000 7f1e5e19b9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:03:38.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.492+0000 7f1e5e19b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:03:38.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.492+0000 7f1e5e19b9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:03:38.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.492+0000 7f1e5e19b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:03:38.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.492+0000 7f1e5e19b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:03:38.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.492+0000 7f1e5e19b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.492+0000 7f1e5e19b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:38.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.492+0000 7f1e5e19b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.492+0000 7f1e5e19b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:38.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.492+0000 7f1e5e19b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.492+0000 7f1e5e19b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:03:38.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.492+0000 7f1e5e19b9c0 20 zone default found 2024-09-12T01:03:38.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.492+0000 7f1e5e19b9c0 4 Realm: () 2024-09-12T01:03:38.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.492+0000 7f1e5e19b9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:03:38.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.492+0000 7f1e5e19b9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:03:38.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.492+0000 7f1e5e19b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:03:38.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.492+0000 7f1e5e19b9c0 20 zonegroup default 2024-09-12T01:03:38.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.492+0000 7f1e5e19b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.492+0000 7f1e5e19b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:38.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.492+0000 7f1e5e19b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.496+0000 7f1e5e19b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:38.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.496+0000 7f1e5e19b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.496+0000 7f1e5e19b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:38.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.496+0000 7f1e5e19b9c0 20 started sync module instance, tier type = 2024-09-12T01:03:38.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.496+0000 7f1e5e19b9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:03:38.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.512+0000 7f1e5e19b9c0 20 add_watcher() i=0 2024-09-12T01:03:38.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.512+0000 7f1e5e19b9c0 20 add_watcher() i=1 2024-09-12T01:03:38.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.512+0000 7f1e5e19b9c0 20 add_watcher() i=2 2024-09-12T01:03:38.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.512+0000 7f1e5e19b9c0 20 add_watcher() i=3 2024-09-12T01:03:38.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.512+0000 7f1e5e19b9c0 20 add_watcher() i=4 2024-09-12T01:03:38.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.512+0000 7f1e5e19b9c0 20 add_watcher() i=5 2024-09-12T01:03:38.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.512+0000 7f1e5e19b9c0 20 add_watcher() i=6 2024-09-12T01:03:38.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.512+0000 7f1e5e19b9c0 20 add_watcher() i=7 2024-09-12T01:03:38.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.512+0000 7f1e5e19b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:03:38.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.512+0000 7f1d11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:38.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:03:38.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:03:38.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 5 note: GC not initialized 2024-09-12T01:03:38.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1d10fe1640 20 reqs_thread_entry: start 2024-09-12T01:03:38.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 20 init_complete bucket index max shards: 1 2024-09-12T01:03:38.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 20 Filter name: none 2024-09-12T01:03:38.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1c8a7fc640 20 reqs_thread_entry: start 2024-09-12T01:03:38.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T01:03:38.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:38.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-12T01:03:38.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:03:38.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-12T01:03:38.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:38.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-12T01:03:38.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T01:03:38.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 10 cache get: name=default.rgw.meta+users.keys+JRGRSIACVOINDHJKEOKD : miss 2024-09-12T01:03:38.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:38.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 10 cache put: name=default.rgw.meta+users.keys+JRGRSIACVOINDHJKEOKD info.flags=0x0 2024-09-12T01:03:38.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 10 adding default.rgw.meta+users.keys+JRGRSIACVOINDHJKEOKD to cache LRU end 2024-09-12T01:03:38.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 10 cache get: name=default.rgw.meta+accounts+account.RGW11111111111111111 : miss 2024-09-12T01:03:38.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T01:03:38.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T01:03:38.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T01:03:38.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:03:38.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 10 cache get: name=default.rgw.meta+users.keys+JRGRSIACVOINDHJKEOKD : hit (negative entry) 2024-09-12T01:03:38.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.516+0000 7f1e5e19b9c0 10 cache get: name=default.rgw.meta+users.keys+JRGRSIACVOINDHJKEOKD : hit (negative entry) 2024-09-12T01:03:38.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.520+0000 7f1e5e19b9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T01:03:38.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.520+0000 7f1e5e19b9c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:03:38.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.520+0000 7f1e5e19b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T01:03:38.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.520+0000 7f1d3affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431744 cookie 94594239341536 notifier 8513 bl.length()=673 2024-09-12T01:03:38.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.520+0000 7f1d3affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T01:03:38.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.520+0000 7f1d3affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:03:38.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.520+0000 7f1e5e19b9c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T01:03:38.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.520+0000 7f1e5e19b9c0 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T01:03:38.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.520+0000 7f1e5e19b9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-12T01:03:38.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.524+0000 7f1d3a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431745 cookie 94594239349952 notifier 8513 bl.length()=185 2024-09-12T01:03:38.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.524+0000 7f1d3a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T01:03:38.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.524+0000 7f1d3a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T01:03:38.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.528+0000 7f1e5e19b9c0 10 cache put: name=default.rgw.meta+users.keys+JRGRSIACVOINDHJKEOKD info.flags=0x7 2024-09-12T01:03:38.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.528+0000 7f1e5e19b9c0 10 moving default.rgw.meta+users.keys+JRGRSIACVOINDHJKEOKD to cache LRU end 2024-09-12T01:03:38.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.528+0000 7f1e5e19b9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:JRGRSIACVOINDHJKEOKD, ofs0, ns] 2024-09-12T01:03:38.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.528+0000 7f1d3a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431735 cookie 94594239360704 notifier 8513 bl.length()=186 2024-09-12T01:03:38.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.528+0000 7f1d3a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+JRGRSIACVOINDHJKEOKD info.flags=0x7 2024-09-12T01:03:38.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.528+0000 7f1d3a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+JRGRSIACVOINDHJKEOKD to cache LRU end 2024-09-12T01:03:38.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.528+0000 7f1e5e19b9c0 20 linked user foo.client.0 to account RGW11111111111111111 2024-09-12T01:03:38.521 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:03:38.521 INFO:teuthology.orchestra.run.smithi070.stdout: "user_id": "foo.client.0", 2024-09-12T01:03:38.522 INFO:teuthology.orchestra.run.smithi070.stdout: "display_name": "Mr.RGW11111111111111111", 2024-09-12T01:03:38.522 INFO:teuthology.orchestra.run.smithi070.stdout: "email": "foo+test@test.test", 2024-09-12T01:03:38.522 INFO:teuthology.orchestra.run.smithi070.stdout: "suspended": 0, 2024-09-12T01:03:38.522 INFO:teuthology.orchestra.run.smithi070.stdout: "max_buckets": 1000, 2024-09-12T01:03:38.522 INFO:teuthology.orchestra.run.smithi070.stdout: "subusers": [], 2024-09-12T01:03:38.522 INFO:teuthology.orchestra.run.smithi070.stdout: "keys": [ 2024-09-12T01:03:38.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:03:38.522 INFO:teuthology.orchestra.run.smithi070.stdout: "user": "foo.client.0", 2024-09-12T01:03:38.522 INFO:teuthology.orchestra.run.smithi070.stdout: "access_key": "JRGRSIACVOINDHJKEOKD", 2024-09-12T01:03:38.522 INFO:teuthology.orchestra.run.smithi070.stdout: "secret_key": "5GfEGkgMtvEPwAUxf/PC2pEQHg8/Wve+XSfcU+iIN4pNFmkn7gWnRg==", 2024-09-12T01:03:38.522 INFO:teuthology.orchestra.run.smithi070.stdout: "active": true, 2024-09-12T01:03:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: "create_date": "2024-09-12T01:03:38.521414Z" 2024-09-12T01:03:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:03:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:03:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: "swift_keys": [], 2024-09-12T01:03:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": [], 2024-09-12T01:03:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: "op_mask": "read, write, delete", 2024-09-12T01:03:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: "default_placement": "", 2024-09-12T01:03:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: "default_storage_class": "", 2024-09-12T01:03:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: "placement_tags": [], 2024-09-12T01:03:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: "bucket_quota": { 2024-09-12T01:03:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T01:03:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T01:03:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T01:03:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T01:03:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T01:03:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:03:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: "user_quota": { 2024-09-12T01:03:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T01:03:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T01:03:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T01:03:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T01:03:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T01:03:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:03:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: "temp_url_keys": [], 2024-09-12T01:03:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "root", 2024-09-12T01:03:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: "mfa_ids": [], 2024-09-12T01:03:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: "account_id": "RGW11111111111111111", 2024-09-12T01:03:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2024-09-12T01:03:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: "create_date": "2024-09-12T01:03:38.521397Z", 2024-09-12T01:03:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:03:38.525 INFO:teuthology.orchestra.run.smithi070.stdout: "group_ids": [] 2024-09-12T01:03:38.525 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:03:38.525 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:38.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.528+0000 7f1d11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:38.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.536+0000 7f1e5e19b9c0 20 remove_watcher() i=0 2024-09-12T01:03:38.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.536+0000 7f1e5e19b9c0 2 removed watcher, disabling cache 2024-09-12T01:03:38.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.536+0000 7f1e5e19b9c0 20 remove_watcher() i=1 2024-09-12T01:03:38.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.540+0000 7f1e5e19b9c0 20 remove_watcher() i=2 2024-09-12T01:03:38.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.540+0000 7f1e5e19b9c0 20 remove_watcher() i=3 2024-09-12T01:03:38.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.544+0000 7f1e5e19b9c0 20 remove_watcher() i=4 2024-09-12T01:03:38.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.544+0000 7f1e5e19b9c0 20 remove_watcher() i=5 2024-09-12T01:03:38.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.548+0000 7f1e5e19b9c0 20 remove_watcher() i=6 2024-09-12T01:03:38.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.548+0000 7f1e5e19b9c0 20 remove_watcher() i=7 2024-09-12T01:03:38.554 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 2279960518 --totp-seed BDTWJI23NX6AZ7FK4RBK5WRCGRYHJQF35VUHODSLQFWCAW76UAODPX3QMIJ5XOIR --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:03:38.595 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:03:38.595 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:03:38.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.640+0000 7f8b4251e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.644+0000 7f8b4251e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:38.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.644+0000 7f8b4251e9c0 20 realm 2024-09-12T01:03:38.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.644+0000 7f8b4251e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.644+0000 7f8b4251e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:38.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.644+0000 7f8b4251e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:03:38.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.644+0000 7f8b4251e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.644+0000 7f8b4251e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:38.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.644+0000 7f8b4251e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.644+0000 7f8b4251e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:38.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.644+0000 7f8b4251e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:38.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.644+0000 7f8b4251e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:03:38.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.644+0000 7f8b4251e9c0 20 searching for the correct realm 2024-09-12T01:03:38.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:38.856+0000 7f8b40825640 0 -- 172.21.15.70:0/83010629 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f8b34046ac0 msgr2=0x7f8b340720c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:39.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.072+0000 7f8b40825640 0 -- 172.21.15.70:0/83010629 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f8b34046ac0 msgr2=0x7f8b340720c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:39.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.084+0000 7f8b4251e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:03:39.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.084+0000 7f8b4251e9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:03:39.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.084+0000 7f8b4251e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:03:39.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.084+0000 7f8b4251e9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:03:39.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.084+0000 7f8b4251e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:03:39.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.084+0000 7f8b4251e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:03:39.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.084+0000 7f8b4251e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:39.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.084+0000 7f8b4251e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:39.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.084+0000 7f8b4251e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:39.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.088+0000 7f8b4251e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:39.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.088+0000 7f8b4251e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:39.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.088+0000 7f8b4251e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:03:39.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.088+0000 7f8b4251e9c0 20 zone default found 2024-09-12T01:03:39.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.088+0000 7f8b4251e9c0 4 Realm: () 2024-09-12T01:03:39.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.088+0000 7f8b4251e9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:03:39.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.088+0000 7f8b4251e9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:03:39.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.088+0000 7f8b4251e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:03:39.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.088+0000 7f8b4251e9c0 20 zonegroup default 2024-09-12T01:03:39.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.088+0000 7f8b4251e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:39.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.088+0000 7f8b4251e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:39.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.088+0000 7f8b4251e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:39.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.088+0000 7f8b4251e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:39.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.088+0000 7f8b4251e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:39.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.088+0000 7f8b4251e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:39.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.088+0000 7f8b4251e9c0 20 started sync module instance, tier type = 2024-09-12T01:03:39.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.088+0000 7f8b4251e9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:03:39.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.108+0000 7f8b4251e9c0 20 add_watcher() i=0 2024-09-12T01:03:39.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.108+0000 7f8b4251e9c0 20 add_watcher() i=1 2024-09-12T01:03:39.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.108+0000 7f8b4251e9c0 20 add_watcher() i=2 2024-09-12T01:03:39.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.108+0000 7f8b4251e9c0 20 add_watcher() i=3 2024-09-12T01:03:39.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.108+0000 7f8b4251e9c0 20 add_watcher() i=4 2024-09-12T01:03:39.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.108+0000 7f8b4251e9c0 20 add_watcher() i=5 2024-09-12T01:03:39.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.108+0000 7f8b4251e9c0 20 add_watcher() i=6 2024-09-12T01:03:39.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.112+0000 7f8b4251e9c0 20 add_watcher() i=7 2024-09-12T01:03:39.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.112+0000 7f8b4251e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:03:39.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.116+0000 7f89f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:39.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.116+0000 7f8b4251e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:03:39.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.116+0000 7f8b4251e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:03:39.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.116+0000 7f8b4251e9c0 5 note: GC not initialized 2024-09-12T01:03:39.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.116+0000 7f89f5fdb640 20 reqs_thread_entry: start 2024-09-12T01:03:39.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.116+0000 7f8b4251e9c0 20 init_complete bucket index max shards: 1 2024-09-12T01:03:39.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.116+0000 7f8b4251e9c0 20 Filter name: none 2024-09-12T01:03:39.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.116+0000 7f89677fe640 20 reqs_thread_entry: start 2024-09-12T01:03:39.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.116+0000 7f8b4251e9c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T01:03:39.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.116+0000 7f8b4251e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:39.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.116+0000 7f8b4251e9c0 20 rados_obj.operate() r=0 bl.length=488 2024-09-12T01:03:39.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.116+0000 7f8b4251e9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-12T01:03:39.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.116+0000 7f8b4251e9c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:03:39.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:39.116+0000 7f8b4251e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:03:40.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.592+0000 7f8b4251e9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T01:03:40.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.592+0000 7f8b4251e9c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:03:40.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.592+0000 7f8b4251e9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T01:03:40.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.592+0000 7f8a16ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366338 cookie 94288242479856 notifier 8531 bl.length()=687 2024-09-12T01:03:40.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.592+0000 7f8a16ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T01:03:40.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.592+0000 7f8a16ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:03:40.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.596+0000 7f89f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:40.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.604+0000 7f8b4251e9c0 20 remove_watcher() i=0 2024-09-12T01:03:40.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.604+0000 7f8b4251e9c0 2 removed watcher, disabling cache 2024-09-12T01:03:40.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.604+0000 7f8b4251e9c0 20 remove_watcher() i=1 2024-09-12T01:03:40.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.608+0000 7f8b4251e9c0 20 remove_watcher() i=2 2024-09-12T01:03:40.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.608+0000 7f8b4251e9c0 20 remove_watcher() i=3 2024-09-12T01:03:40.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.612+0000 7f8b4251e9c0 20 remove_watcher() i=4 2024-09-12T01:03:40.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.612+0000 7f8b4251e9c0 20 remove_watcher() i=5 2024-09-12T01:03:40.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.616+0000 7f8b4251e9c0 20 remove_watcher() i=6 2024-09-12T01:03:40.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.616+0000 7f8b4251e9c0 20 remove_watcher() i=7 2024-09-12T01:03:40.631 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-12T01:03:40.632 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key YROHTOMLUIRPSNHPEABR --secret z0thY1KAo7LSMow+jRaljchsqPOGV/B/l43Nh4VaDAB0rmOOTUUR6Q== --cluster ceph 2024-09-12T01:03:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:03:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:03:40.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.768+0000 7fdd27d119c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:40.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.768+0000 7fdd27d119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:40.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.768+0000 7fdd27d119c0 20 realm 2024-09-12T01:03:40.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.768+0000 7fdd27d119c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:40.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.768+0000 7fdd27d119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:40.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.768+0000 7fdd27d119c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:03:40.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.768+0000 7fdd27d119c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:40.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.768+0000 7fdd27d119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:40.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.768+0000 7fdd27d119c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:40.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.972+0000 7fdd27d119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:40.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.972+0000 7fdd27d119c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:40.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.976+0000 7fdd27d119c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:03:40.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.976+0000 7fdd27d119c0 20 searching for the correct realm 2024-09-12T01:03:40.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.984+0000 7fdd25817640 0 -- 172.21.15.70:0/3250367374 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7fdd20011c20 msgr2=0x7fdd2001d910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:03:40.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:40.996+0000 7fdd25817640 0 -- 172.21.15.70:0/3250367374 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7fdd2000ea70 msgr2=0x7fdd20030440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:40.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.004+0000 7fdd27d119c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:03:40.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.004+0000 7fdd27d119c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:03:40.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.004+0000 7fdd27d119c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:03:40.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.004+0000 7fdd27d119c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:03:40.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.004+0000 7fdd27d119c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:03:40.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.004+0000 7fdd27d119c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:03:40.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.004+0000 7fdd27d119c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:40.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.008+0000 7fdd27d119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:40.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.008+0000 7fdd27d119c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.008+0000 7fdd27d119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:41.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.008+0000 7fdd27d119c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.008+0000 7fdd27d119c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:03:41.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.008+0000 7fdd27d119c0 20 zone default found 2024-09-12T01:03:41.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.008+0000 7fdd27d119c0 4 Realm: () 2024-09-12T01:03:41.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.008+0000 7fdd27d119c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:03:41.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.008+0000 7fdd27d119c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:03:41.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.008+0000 7fdd27d119c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:03:41.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.008+0000 7fdd27d119c0 20 zonegroup default 2024-09-12T01:03:41.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.008+0000 7fdd27d119c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.008+0000 7fdd27d119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.008+0000 7fdd27d119c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.012+0000 7fdd27d119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.012+0000 7fdd27d119c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.012+0000 7fdd27d119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.012+0000 7fdd27d119c0 20 started sync module instance, tier type = 2024-09-12T01:03:41.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.012+0000 7fdd27d119c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:03:41.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.036+0000 7fdd27d119c0 20 add_watcher() i=0 2024-09-12T01:03:41.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.036+0000 7fdd27d119c0 20 add_watcher() i=1 2024-09-12T01:03:41.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.036+0000 7fdd27d119c0 20 add_watcher() i=2 2024-09-12T01:03:41.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.036+0000 7fdd27d119c0 20 add_watcher() i=3 2024-09-12T01:03:41.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.036+0000 7fdd27d119c0 20 add_watcher() i=4 2024-09-12T01:03:41.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.036+0000 7fdd27d119c0 20 add_watcher() i=5 2024-09-12T01:03:41.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.036+0000 7fdd27d119c0 20 add_watcher() i=6 2024-09-12T01:03:41.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.036+0000 7fdd27d119c0 20 add_watcher() i=7 2024-09-12T01:03:41.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.036+0000 7fdd27d119c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:03:41.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.040+0000 7fdbd77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:41.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.040+0000 7fdd27d119c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:03:41.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.040+0000 7fdd27d119c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:03:41.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.044+0000 7fdd27d119c0 5 note: GC not initialized 2024-09-12T01:03:41.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.044+0000 7fdbd67fc640 20 reqs_thread_entry: start 2024-09-12T01:03:41.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.044+0000 7fdd27d119c0 20 init_complete bucket index max shards: 1 2024-09-12T01:03:41.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.044+0000 7fdd27d119c0 20 Filter name: none 2024-09-12T01:03:41.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.044+0000 7fdb47fff640 20 reqs_thread_entry: start 2024-09-12T01:03:41.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.044+0000 7fdd27d119c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T01:03:41.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.044+0000 7fdd27d119c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.044+0000 7fdd27d119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.044+0000 7fdd27d119c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-12T01:03:41.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.044+0000 7fdd27d119c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:03:41.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.044+0000 7fdd27d119c0 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-12T01:03:41.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.044+0000 7fdd27d119c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.044+0000 7fdd27d119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.044+0000 7fdd27d119c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-12T01:03:41.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.044+0000 7fdd27d119c0 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T01:03:41.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.044+0000 7fdd27d119c0 10 cache get: name=default.rgw.meta+users.keys+YROHTOMLUIRPSNHPEABR : miss 2024-09-12T01:03:41.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.044+0000 7fdd27d119c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.044+0000 7fdd27d119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.044+0000 7fdd27d119c0 10 cache put: name=default.rgw.meta+users.keys+YROHTOMLUIRPSNHPEABR info.flags=0x0 2024-09-12T01:03:41.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.044+0000 7fdd27d119c0 10 adding default.rgw.meta+users.keys+YROHTOMLUIRPSNHPEABR to cache LRU end 2024-09-12T01:03:41.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.044+0000 7fdd27d119c0 10 cache get: name=default.rgw.meta+users.keys+YROHTOMLUIRPSNHPEABR : hit (negative entry) 2024-09-12T01:03:41.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.044+0000 7fdd27d119c0 10 cache get: name=default.rgw.meta+users.keys+YROHTOMLUIRPSNHPEABR : hit (negative entry) 2024-09-12T01:03:41.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.048+0000 7fdd27d119c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T01:03:41.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.048+0000 7fdd27d119c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:03:41.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.048+0000 7fdd27d119c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T01:03:41.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.048+0000 7fdc097fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366281 cookie 94079960092528 notifier 9129 bl.length()=645 2024-09-12T01:03:41.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.048+0000 7fdc097fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T01:03:41.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.048+0000 7fdc097fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:03:41.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.052+0000 7fdd27d119c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T01:03:41.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.052+0000 7fdd27d119c0 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T01:03:41.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.052+0000 7fdd27d119c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-12T01:03:41.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.052+0000 7fdc08ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366328 cookie 94079960099792 notifier 9129 bl.length()=185 2024-09-12T01:03:41.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.052+0000 7fdc08ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T01:03:41.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.052+0000 7fdc08ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T01:03:41.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.056+0000 7fdd27d119c0 10 cache put: name=default.rgw.meta+users.keys+YROHTOMLUIRPSNHPEABR info.flags=0x7 2024-09-12T01:03:41.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.056+0000 7fdd27d119c0 10 moving default.rgw.meta+users.keys+YROHTOMLUIRPSNHPEABR to cache LRU end 2024-09-12T01:03:41.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.056+0000 7fdd27d119c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:YROHTOMLUIRPSNHPEABR, ofs0, ns] 2024-09-12T01:03:41.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.056+0000 7fdc097fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366329 cookie 94079960105344 notifier 9129 bl.length()=186 2024-09-12T01:03:41.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.056+0000 7fdc097fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+YROHTOMLUIRPSNHPEABR info.flags=0x7 2024-09-12T01:03:41.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.056+0000 7fdc097fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+YROHTOMLUIRPSNHPEABR to cache LRU end 2024-09-12T01:03:41.048 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:03:41.048 INFO:teuthology.orchestra.run.smithi070.stdout: "user_id": "bar.client.0", 2024-09-12T01:03:41.048 INFO:teuthology.orchestra.run.smithi070.stdout: "display_name": "Mr.bar.client.0", 2024-09-12T01:03:41.048 INFO:teuthology.orchestra.run.smithi070.stdout: "email": "bar+test@test.test", 2024-09-12T01:03:41.048 INFO:teuthology.orchestra.run.smithi070.stdout: "suspended": 0, 2024-09-12T01:03:41.048 INFO:teuthology.orchestra.run.smithi070.stdout: "max_buckets": 1000, 2024-09-12T01:03:41.049 INFO:teuthology.orchestra.run.smithi070.stdout: "subusers": [], 2024-09-12T01:03:41.049 INFO:teuthology.orchestra.run.smithi070.stdout: "keys": [ 2024-09-12T01:03:41.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:03:41.049 INFO:teuthology.orchestra.run.smithi070.stdout: "user": "bar.client.0", 2024-09-12T01:03:41.049 INFO:teuthology.orchestra.run.smithi070.stdout: "access_key": "YROHTOMLUIRPSNHPEABR", 2024-09-12T01:03:41.049 INFO:teuthology.orchestra.run.smithi070.stdout: "secret_key": "z0thY1KAo7LSMow+jRaljchsqPOGV/B/l43Nh4VaDAB0rmOOTUUR6Q==", 2024-09-12T01:03:41.049 INFO:teuthology.orchestra.run.smithi070.stdout: "active": true, 2024-09-12T01:03:41.049 INFO:teuthology.orchestra.run.smithi070.stdout: "create_date": "2024-09-12T01:03:41.050158Z" 2024-09-12T01:03:41.049 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:03:41.049 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:03:41.049 INFO:teuthology.orchestra.run.smithi070.stdout: "swift_keys": [], 2024-09-12T01:03:41.049 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": [], 2024-09-12T01:03:41.049 INFO:teuthology.orchestra.run.smithi070.stdout: "op_mask": "read, write, delete", 2024-09-12T01:03:41.049 INFO:teuthology.orchestra.run.smithi070.stdout: "default_placement": "", 2024-09-12T01:03:41.050 INFO:teuthology.orchestra.run.smithi070.stdout: "default_storage_class": "", 2024-09-12T01:03:41.050 INFO:teuthology.orchestra.run.smithi070.stdout: "placement_tags": [], 2024-09-12T01:03:41.050 INFO:teuthology.orchestra.run.smithi070.stdout: "bucket_quota": { 2024-09-12T01:03:41.050 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T01:03:41.050 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T01:03:41.050 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T01:03:41.050 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T01:03:41.050 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T01:03:41.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:03:41.050 INFO:teuthology.orchestra.run.smithi070.stdout: "user_quota": { 2024-09-12T01:03:41.050 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T01:03:41.050 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T01:03:41.050 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T01:03:41.050 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T01:03:41.050 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T01:03:41.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:03:41.051 INFO:teuthology.orchestra.run.smithi070.stdout: "temp_url_keys": [], 2024-09-12T01:03:41.051 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "rgw", 2024-09-12T01:03:41.051 INFO:teuthology.orchestra.run.smithi070.stdout: "mfa_ids": [], 2024-09-12T01:03:41.051 INFO:teuthology.orchestra.run.smithi070.stdout: "account_id": "", 2024-09-12T01:03:41.051 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2024-09-12T01:03:41.051 INFO:teuthology.orchestra.run.smithi070.stdout: "create_date": "2024-09-12T01:03:41.050127Z", 2024-09-12T01:03:41.051 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:03:41.051 INFO:teuthology.orchestra.run.smithi070.stdout: "group_ids": [] 2024-09-12T01:03:41.051 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:03:41.051 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:41.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.056+0000 7fdbd77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:41.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.060+0000 7fdd27d119c0 20 remove_watcher() i=0 2024-09-12T01:03:41.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.060+0000 7fdd27d119c0 2 removed watcher, disabling cache 2024-09-12T01:03:41.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.064+0000 7fdd27d119c0 20 remove_watcher() i=1 2024-09-12T01:03:41.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.064+0000 7fdd27d119c0 20 remove_watcher() i=2 2024-09-12T01:03:41.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.068+0000 7fdd27d119c0 20 remove_watcher() i=3 2024-09-12T01:03:41.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.068+0000 7fdd27d119c0 20 remove_watcher() i=4 2024-09-12T01:03:41.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.072+0000 7fdd27d119c0 20 remove_watcher() i=5 2024-09-12T01:03:41.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.072+0000 7fdd27d119c0 20 remove_watcher() i=6 2024-09-12T01:03:41.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.076+0000 7fdd27d119c0 20 remove_watcher() i=7 2024-09-12T01:03:41.081 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 9482876134 --totp-seed OM5MGTOPEVFHV5BGHUWRVE2RDOF72UZYAKPHWSYD5YNUNVWI7XDRKA7EG2MFTDXI --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:03:41.123 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:03:41.123 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:03:41.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.172+0000 7f9b12bb29c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.172+0000 7f9b12bb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.172+0000 7f9b12bb29c0 20 realm 2024-09-12T01:03:41.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.172+0000 7f9b12bb29c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.172+0000 7f9b12bb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.172+0000 7f9b12bb29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:03:41.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.172+0000 7f9b12bb29c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.172+0000 7f9b12bb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.172+0000 7f9b12bb29c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.176+0000 7f9b12bb29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:41.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.176+0000 7f9b12bb29c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.176+0000 7f9b12bb29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:03:41.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.176+0000 7f9b12bb29c0 20 searching for the correct realm 2024-09-12T01:03:41.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.180+0000 7f9b10eb9640 0 -- 172.21.15.70:0/332208599 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f9b04065f10 msgr2=0x7f9b04064980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:41.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.396+0000 7f9b10eb9640 0 -- 172.21.15.70:0/332208599 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f9b04065f10 msgr2=0x7f9b04064980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:41.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.408+0000 7f9b12bb29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:03:41.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.408+0000 7f9b12bb29c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:03:41.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.408+0000 7f9b12bb29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:03:41.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.408+0000 7f9b12bb29c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:03:41.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.408+0000 7f9b12bb29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:03:41.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.408+0000 7f9b12bb29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:03:41.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.408+0000 7f9b12bb29c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.408+0000 7f9b12bb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.408+0000 7f9b12bb29c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.412+0000 7f9b12bb29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:41.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.412+0000 7f9b12bb29c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.412+0000 7f9b12bb29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:03:41.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.412+0000 7f9b12bb29c0 20 zone default found 2024-09-12T01:03:41.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.412+0000 7f9b12bb29c0 4 Realm: () 2024-09-12T01:03:41.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.412+0000 7f9b12bb29c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:03:41.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.412+0000 7f9b12bb29c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:03:41.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.412+0000 7f9b12bb29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:03:41.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.412+0000 7f9b12bb29c0 20 zonegroup default 2024-09-12T01:03:41.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.412+0000 7f9b12bb29c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.412+0000 7f9b12bb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.412+0000 7f9b12bb29c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.412+0000 7f9b12bb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.412+0000 7f9b12bb29c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.412+0000 7f9b12bb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.412+0000 7f9b12bb29c0 20 started sync module instance, tier type = 2024-09-12T01:03:41.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.412+0000 7f9b12bb29c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:03:41.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.436+0000 7f9b12bb29c0 20 add_watcher() i=0 2024-09-12T01:03:41.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.436+0000 7f9b12bb29c0 20 add_watcher() i=1 2024-09-12T01:03:41.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.436+0000 7f9b12bb29c0 20 add_watcher() i=2 2024-09-12T01:03:41.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.436+0000 7f9b12bb29c0 20 add_watcher() i=3 2024-09-12T01:03:41.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.436+0000 7f9b12bb29c0 20 add_watcher() i=4 2024-09-12T01:03:41.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.436+0000 7f9b12bb29c0 20 add_watcher() i=5 2024-09-12T01:03:41.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.436+0000 7f9b12bb29c0 20 add_watcher() i=6 2024-09-12T01:03:41.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.440+0000 7f9b12bb29c0 20 add_watcher() i=7 2024-09-12T01:03:41.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.440+0000 7f9b12bb29c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:03:41.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.444+0000 7f99c6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:41.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.444+0000 7f9b12bb29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:03:41.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.444+0000 7f9b12bb29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:03:41.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.444+0000 7f9b12bb29c0 5 note: GC not initialized 2024-09-12T01:03:41.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.444+0000 7f99c5fdb640 20 reqs_thread_entry: start 2024-09-12T01:03:41.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.444+0000 7f9b12bb29c0 20 init_complete bucket index max shards: 1 2024-09-12T01:03:41.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.444+0000 7f9b12bb29c0 20 Filter name: none 2024-09-12T01:03:41.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.444+0000 7f99377fe640 20 reqs_thread_entry: start 2024-09-12T01:03:41.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.444+0000 7f9b12bb29c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T01:03:41.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.444+0000 7f9b12bb29c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.448+0000 7f9b12bb29c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T01:03:41.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.448+0000 7f9b12bb29c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-12T01:03:41.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.448+0000 7f9b12bb29c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:03:41.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.448+0000 7f9b12bb29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:03:41.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.452+0000 7f9b12bb29c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T01:03:41.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.452+0000 7f9b12bb29c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:03:41.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.452+0000 7f9b12bb29c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T01:03:41.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.452+0000 7f99e77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366282 cookie 94391393997536 notifier 9147 bl.length()=659 2024-09-12T01:03:41.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.452+0000 7f99e77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T01:03:41.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.452+0000 7f99e77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:03:41.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.456+0000 7f99c6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.460+0000 7f9b12bb29c0 20 remove_watcher() i=0 2024-09-12T01:03:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.460+0000 7f9b12bb29c0 2 removed watcher, disabling cache 2024-09-12T01:03:41.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.464+0000 7f9b12bb29c0 20 remove_watcher() i=1 2024-09-12T01:03:41.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.468+0000 7f9b12bb29c0 20 remove_watcher() i=2 2024-09-12T01:03:41.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.468+0000 7f9b12bb29c0 20 remove_watcher() i=3 2024-09-12T01:03:41.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.472+0000 7f9b12bb29c0 20 remove_watcher() i=4 2024-09-12T01:03:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.472+0000 7f9b12bb29c0 20 remove_watcher() i=5 2024-09-12T01:03:41.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.476+0000 7f9b12bb29c0 20 remove_watcher() i=6 2024-09-12T01:03:41.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.476+0000 7f9b12bb29c0 20 remove_watcher() i=7 2024-09-12T01:03:41.485 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW33333333333333333 --account-name Mr.RGW33333333333333333 --email RGW33333333333333333+test@test.test --tenant testx 2024-09-12T01:03:41.571 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:03:41.571 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:03:41.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.628+0000 7f1d09cb59c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.628+0000 7f1d09cb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.628+0000 7f1d09cb59c0 20 realm 2024-09-12T01:03:41.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.628+0000 7f1d09cb59c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.628+0000 7f1d09cb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.628+0000 7f1d09cb59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:03:41.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.628+0000 7f1d09cb59c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.628+0000 7f1d09cb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.628+0000 7f1d09cb59c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.632+0000 7f1d09cb59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:41.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.632+0000 7f1d09cb59c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.632+0000 7f1d09cb59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:03:41.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.632+0000 7f1d09cb59c0 20 searching for the correct realm 2024-09-12T01:03:41.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.648+0000 7f1d077bb640 0 -- 172.21.15.70:0/2665427256 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f1d000c2040 msgr2=0x7f1d000b13f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:03:41.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.660+0000 7f1d077bb640 0 -- 172.21.15.70:0/2665427256 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f1d000d2040 msgr2=0x7f1d000d3430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:41.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.664+0000 7f1d09cb59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:03:41.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.664+0000 7f1d09cb59c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:03:41.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.664+0000 7f1d09cb59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:03:41.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.664+0000 7f1d09cb59c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:03:41.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.664+0000 7f1d09cb59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:03:41.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.664+0000 7f1d09cb59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:03:41.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.664+0000 7f1d09cb59c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.668+0000 7f1d09cb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.668+0000 7f1d09cb59c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.668+0000 7f1d09cb59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:41.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.668+0000 7f1d09cb59c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.668+0000 7f1d09cb59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:03:41.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.668+0000 7f1d09cb59c0 20 zone default found 2024-09-12T01:03:41.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.668+0000 7f1d09cb59c0 4 Realm: () 2024-09-12T01:03:41.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.668+0000 7f1d09cb59c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:03:41.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.668+0000 7f1d09cb59c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:03:41.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.668+0000 7f1d09cb59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:03:41.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.668+0000 7f1d09cb59c0 20 zonegroup default 2024-09-12T01:03:41.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.668+0000 7f1d09cb59c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.668+0000 7f1d09cb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.668+0000 7f1d09cb59c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.668+0000 7f1d09cb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.668+0000 7f1d09cb59c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.668+0000 7f1d09cb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.668+0000 7f1d09cb59c0 20 started sync module instance, tier type = 2024-09-12T01:03:41.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.668+0000 7f1d09cb59c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:03:41.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.684+0000 7f1d09cb59c0 20 add_watcher() i=0 2024-09-12T01:03:41.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.684+0000 7f1d09cb59c0 20 add_watcher() i=1 2024-09-12T01:03:41.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.684+0000 7f1d09cb59c0 20 add_watcher() i=2 2024-09-12T01:03:41.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.684+0000 7f1d09cb59c0 20 add_watcher() i=3 2024-09-12T01:03:41.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.684+0000 7f1d09cb59c0 20 add_watcher() i=4 2024-09-12T01:03:41.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.684+0000 7f1d09cb59c0 20 add_watcher() i=5 2024-09-12T01:03:41.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.684+0000 7f1d09cb59c0 20 add_watcher() i=6 2024-09-12T01:03:41.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.688+0000 7f1d09cb59c0 20 add_watcher() i=7 2024-09-12T01:03:41.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.688+0000 7f1d09cb59c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:03:41.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.688+0000 7f1bbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:41.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.688+0000 7f1d09cb59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:03:41.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.688+0000 7f1d09cb59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:03:41.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.688+0000 7f1d09cb59c0 5 note: GC not initialized 2024-09-12T01:03:41.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.688+0000 7f1bbcfe1640 20 reqs_thread_entry: start 2024-09-12T01:03:41.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.692+0000 7f1d09cb59c0 20 init_complete bucket index max shards: 1 2024-09-12T01:03:41.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.692+0000 7f1d09cb59c0 20 Filter name: none 2024-09-12T01:03:41.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.692+0000 7f1b367fc640 20 reqs_thread_entry: start 2024-09-12T01:03:41.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.692+0000 7f1d09cb59c0 10 cache get: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 : miss 2024-09-12T01:03:41.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.692+0000 7f1d09cb59c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.692+0000 7f1d09cb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.692+0000 7f1d09cb59c0 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x0 2024-09-12T01:03:41.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.692+0000 7f1d09cb59c0 10 adding default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T01:03:41.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.692+0000 7f1d09cb59c0 20 failed to read name.testx$Mr.RGW33333333333333333 with: (2) No such file or directory 2024-09-12T01:03:41.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.692+0000 7f1d09cb59c0 10 cache get: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test : miss 2024-09-12T01:03:41.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.692+0000 7f1d09cb59c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.692+0000 7f1d09cb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.692+0000 7f1d09cb59c0 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x0 2024-09-12T01:03:41.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.692+0000 7f1d09cb59c0 10 adding default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T01:03:41.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.692+0000 7f1d09cb59c0 20 failed to read rgw33333333333333333+test@test.test with: (2) No such file or directory 2024-09-12T01:03:41.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.696+0000 7f1d09cb59c0 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T01:03:41.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.696+0000 7f1d09cb59c0 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T01:03:41.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.696+0000 7f1d09cb59c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW33333333333333333, ofs0, ns] 2024-09-12T01:03:41.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.696+0000 7f1beaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333579 cookie 93987942631056 notifier 9165 bl.length()=389 2024-09-12T01:03:41.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.696+0000 7f1beaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T01:03:41.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.696+0000 7f1beaffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T01:03:41.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.700+0000 7f1d09cb59c0 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T01:03:41.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.700+0000 7f1d09cb59c0 10 moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T01:03:41.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.700+0000 7f1d09cb59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.testx$Mr.RGW33333333333333333, ofs0, ns] 2024-09-12T01:03:41.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.700+0000 7f1bea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333635 cookie 93987942640256 notifier 9165 bl.length()=230 2024-09-12T01:03:41.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.700+0000 7f1bea7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T01:03:41.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.700+0000 7f1bea7fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T01:03:41.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.704+0000 7f1d09cb59c0 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T01:03:41.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.704+0000 7f1d09cb59c0 10 moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T01:03:41.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.704+0000 7f1d09cb59c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw33333333333333333+test@test.test, ofs0, ns] 2024-09-12T01:03:41.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.704+0000 7f1bea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333585 cookie 93987942637760 notifier 9165 bl.length()=234 2024-09-12T01:03:41.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.704+0000 7f1bea7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T01:03:41.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.704+0000 7f1bea7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T01:03:41.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.704+0000 7f1bbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:41.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.708+0000 7f1d09cb59c0 20 remove_watcher() i=0 2024-09-12T01:03:41.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.708+0000 7f1d09cb59c0 2 removed watcher, disabling cache 2024-09-12T01:03:41.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.712+0000 7f1d09cb59c0 20 remove_watcher() i=1 2024-09-12T01:03:41.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.716+0000 7f1d09cb59c0 20 remove_watcher() i=2 2024-09-12T01:03:41.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.716+0000 7f1d09cb59c0 20 remove_watcher() i=3 2024-09-12T01:03:41.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.720+0000 7f1d09cb59c0 20 remove_watcher() i=4 2024-09-12T01:03:41.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.720+0000 7f1d09cb59c0 20 remove_watcher() i=5 2024-09-12T01:03:41.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.720+0000 7f1d09cb59c0 20 remove_watcher() i=6 2024-09-12T01:03:41.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.724+0000 7f1d09cb59c0 20 remove_watcher() i=7 2024-09-12T01:03:41.727 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:03:41.727 INFO:teuthology.orchestra.run.smithi070.stdout: "id": "RGW33333333333333333", 2024-09-12T01:03:41.727 INFO:teuthology.orchestra.run.smithi070.stdout: "tenant": "testx", 2024-09-12T01:03:41.727 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "Mr.RGW33333333333333333", 2024-09-12T01:03:41.727 INFO:teuthology.orchestra.run.smithi070.stdout: "email": "RGW33333333333333333+test@test.test", 2024-09-12T01:03:41.727 INFO:teuthology.orchestra.run.smithi070.stdout: "quota": { 2024-09-12T01:03:41.727 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T01:03:41.727 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T01:03:41.728 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T01:03:41.728 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T01:03:41.728 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T01:03:41.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:03:41.728 INFO:teuthology.orchestra.run.smithi070.stdout: "bucket_quota": { 2024-09-12T01:03:41.728 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T01:03:41.728 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T01:03:41.728 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T01:03:41.728 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T01:03:41.728 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T01:03:41.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:03:41.728 INFO:teuthology.orchestra.run.smithi070.stdout: "max_users": 1000, 2024-09-12T01:03:41.729 INFO:teuthology.orchestra.run.smithi070.stdout: "max_roles": 1000, 2024-09-12T01:03:41.729 INFO:teuthology.orchestra.run.smithi070.stdout: "max_groups": 1000, 2024-09-12T01:03:41.729 INFO:teuthology.orchestra.run.smithi070.stdout: "max_buckets": 1000, 2024-09-12T01:03:41.729 INFO:teuthology.orchestra.run.smithi070.stdout: "max_access_keys": 4 2024-09-12T01:03:41.729 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:03:41.730 DEBUG:tasks.s3tests:Creating user RGW33333333333333333 on client.0 2024-09-12T01:03:41.730 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name Mr.RGW33333333333333333 --email 'testx$tenanteduser+test@test.test' --access-key AQWDQQIAHAIAMVQWYQVK --secret 3rbgjIEj+l63rXBp8cYNn1WvzrPS0mmYJDldPeQvch/qO5oGgh4d6g== --cluster ceph --account-id RGW33333333333333333 --account-root 2024-09-12T01:03:41.813 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:03:41.813 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:03:41.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.860+0000 7f914edd69c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.864+0000 7f914edd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.864+0000 7f914edd69c0 20 realm 2024-09-12T01:03:41.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.864+0000 7f914edd69c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.864+0000 7f914edd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.864+0000 7f914edd69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:03:41.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.864+0000 7f914edd69c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.864+0000 7f914edd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.864+0000 7f914edd69c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.864+0000 7f914edd69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:41.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.864+0000 7f914edd69c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.864+0000 7f914edd69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:03:41.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.864+0000 7f914edd69c0 20 searching for the correct realm 2024-09-12T01:03:41.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.872+0000 7f914d0dd640 0 -- 172.21.15.70:0/2681127911 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f913403b070 msgr2=0x7f913401b950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:41.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.876+0000 7f914c8dc640 0 -- 172.21.15.70:0/2681127911 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f9144089040 msgr2=0x7f9144099390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:41.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.884+0000 7f914edd69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:03:41.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.884+0000 7f914edd69c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:03:41.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.884+0000 7f914edd69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:03:41.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.884+0000 7f914edd69c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:03:41.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.884+0000 7f914edd69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:03:41.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.884+0000 7f914edd69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:03:41.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.884+0000 7f914edd69c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.884+0000 7f914edd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.884+0000 7f914edd69c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.884+0000 7f914edd69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:41.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.884+0000 7f914edd69c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.884+0000 7f914edd69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:03:41.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.884+0000 7f914edd69c0 20 zone default found 2024-09-12T01:03:41.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.884+0000 7f914edd69c0 4 Realm: () 2024-09-12T01:03:41.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.884+0000 7f914edd69c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:03:41.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.884+0000 7f914edd69c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:03:41.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.884+0000 7f914edd69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:03:41.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.884+0000 7f914edd69c0 20 zonegroup default 2024-09-12T01:03:41.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.884+0000 7f914edd69c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.884+0000 7f914edd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.884+0000 7f914edd69c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.888+0000 7f914edd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.888+0000 7f914edd69c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.888+0000 7f914edd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.888+0000 7f914edd69c0 20 started sync module instance, tier type = 2024-09-12T01:03:41.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.888+0000 7f914edd69c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:03:41.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.904+0000 7f914edd69c0 20 add_watcher() i=0 2024-09-12T01:03:41.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.904+0000 7f914edd69c0 20 add_watcher() i=1 2024-09-12T01:03:41.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.904+0000 7f914edd69c0 20 add_watcher() i=2 2024-09-12T01:03:41.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.904+0000 7f914edd69c0 20 add_watcher() i=3 2024-09-12T01:03:41.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.904+0000 7f914edd69c0 20 add_watcher() i=4 2024-09-12T01:03:41.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.904+0000 7f914edd69c0 20 add_watcher() i=5 2024-09-12T01:03:41.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.904+0000 7f914edd69c0 20 add_watcher() i=6 2024-09-12T01:03:41.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.904+0000 7f914edd69c0 20 add_watcher() i=7 2024-09-12T01:03:41.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.904+0000 7f914edd69c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:03:41.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.908+0000 7f9002fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:41.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.908+0000 7f914edd69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:03:41.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.908+0000 7f914edd69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:03:41.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.908+0000 7f914edd69c0 5 note: GC not initialized 2024-09-12T01:03:41.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.908+0000 7f9001fe3640 20 reqs_thread_entry: start 2024-09-12T01:03:41.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.908+0000 7f914edd69c0 20 init_complete bucket index max shards: 1 2024-09-12T01:03:41.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.908+0000 7f914edd69c0 20 Filter name: none 2024-09-12T01:03:41.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.908+0000 7f8f737fe640 20 reqs_thread_entry: start 2024-09-12T01:03:41.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.908+0000 7f914edd69c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T01:03:41.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.908+0000 7f914edd69c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.908+0000 7f914edd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.908+0000 7f914edd69c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-12T01:03:41.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.908+0000 7f914edd69c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:03:41.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.908+0000 7f914edd69c0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-12T01:03:41.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.908+0000 7f914edd69c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.908+0000 7f914edd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.908+0000 7f914edd69c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-12T01:03:41.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.908+0000 7f914edd69c0 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T01:03:41.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.908+0000 7f914edd69c0 10 cache get: name=default.rgw.meta+users.keys+AQWDQQIAHAIAMVQWYQVK : miss 2024-09-12T01:03:41.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.908+0000 7f914edd69c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.908+0000 7f914edd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:41.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.908+0000 7f914edd69c0 10 cache put: name=default.rgw.meta+users.keys+AQWDQQIAHAIAMVQWYQVK info.flags=0x0 2024-09-12T01:03:41.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.908+0000 7f914edd69c0 10 adding default.rgw.meta+users.keys+AQWDQQIAHAIAMVQWYQVK to cache LRU end 2024-09-12T01:03:41.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.908+0000 7f914edd69c0 10 cache get: name=default.rgw.meta+accounts+account.RGW33333333333333333 : miss 2024-09-12T01:03:41.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.908+0000 7f914edd69c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:41.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.912+0000 7f914edd69c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T01:03:41.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.912+0000 7f914edd69c0 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T01:03:41.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.912+0000 7f914edd69c0 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T01:03:41.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.912+0000 7f914edd69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:03:41.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.912+0000 7f914edd69c0 10 cache get: name=default.rgw.meta+users.keys+AQWDQQIAHAIAMVQWYQVK : hit (negative entry) 2024-09-12T01:03:41.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.912+0000 7f914edd69c0 10 cache get: name=default.rgw.meta+users.keys+AQWDQQIAHAIAMVQWYQVK : hit (negative entry) 2024-09-12T01:03:41.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.912+0000 7f914edd69c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T01:03:41.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.912+0000 7f914edd69c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:03:41.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.912+0000 7f914edd69c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T01:03:41.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.912+0000 7f9023fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333626 cookie 94637970516928 notifier 9183 bl.length()=732 2024-09-12T01:03:41.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.912+0000 7f9023fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T01:03:41.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.912+0000 7f9023fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:03:41.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.916+0000 7f914edd69c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T01:03:41.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.916+0000 7f914edd69c0 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T01:03:41.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.916+0000 7f914edd69c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-12T01:03:41.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.916+0000 7f9023fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333524 cookie 94637970520992 notifier 9183 bl.length()=215 2024-09-12T01:03:41.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.916+0000 7f9023fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T01:03:41.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.916+0000 7f9023fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T01:03:41.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.920+0000 7f914edd69c0 10 cache put: name=default.rgw.meta+users.keys+AQWDQQIAHAIAMVQWYQVK info.flags=0x7 2024-09-12T01:03:41.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.920+0000 7f914edd69c0 10 moving default.rgw.meta+users.keys+AQWDQQIAHAIAMVQWYQVK to cache LRU end 2024-09-12T01:03:41.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.920+0000 7f914edd69c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:AQWDQQIAHAIAMVQWYQVK, ofs0, ns] 2024-09-12T01:03:41.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.920+0000 7f9023fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333580 cookie 94637970504960 notifier 9183 bl.length()=201 2024-09-12T01:03:41.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.920+0000 7f9023fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+AQWDQQIAHAIAMVQWYQVK info.flags=0x7 2024-09-12T01:03:41.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.920+0000 7f9023fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+AQWDQQIAHAIAMVQWYQVK to cache LRU end 2024-09-12T01:03:41.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.924+0000 7f914edd69c0 20 linked user testx$tenanteduser.client.0 to account RGW33333333333333333 2024-09-12T01:03:41.915 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:03:41.915 INFO:teuthology.orchestra.run.smithi070.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-12T01:03:41.915 INFO:teuthology.orchestra.run.smithi070.stdout: "display_name": "Mr.RGW33333333333333333", 2024-09-12T01:03:41.915 INFO:teuthology.orchestra.run.smithi070.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-12T01:03:41.915 INFO:teuthology.orchestra.run.smithi070.stdout: "suspended": 0, 2024-09-12T01:03:41.915 INFO:teuthology.orchestra.run.smithi070.stdout: "max_buckets": 1000, 2024-09-12T01:03:41.915 INFO:teuthology.orchestra.run.smithi070.stdout: "subusers": [], 2024-09-12T01:03:41.915 INFO:teuthology.orchestra.run.smithi070.stdout: "keys": [ 2024-09-12T01:03:41.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:03:41.915 INFO:teuthology.orchestra.run.smithi070.stdout: "user": "testx$tenanteduser.client.0", 2024-09-12T01:03:41.915 INFO:teuthology.orchestra.run.smithi070.stdout: "access_key": "AQWDQQIAHAIAMVQWYQVK", 2024-09-12T01:03:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: "secret_key": "3rbgjIEj+l63rXBp8cYNn1WvzrPS0mmYJDldPeQvch/qO5oGgh4d6g==", 2024-09-12T01:03:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: "active": true, 2024-09-12T01:03:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: "create_date": "2024-09-12T01:03:41.915887Z" 2024-09-12T01:03:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:03:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:03:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: "swift_keys": [], 2024-09-12T01:03:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": [], 2024-09-12T01:03:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: "op_mask": "read, write, delete", 2024-09-12T01:03:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: "default_placement": "", 2024-09-12T01:03:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: "default_storage_class": "", 2024-09-12T01:03:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: "placement_tags": [], 2024-09-12T01:03:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: "bucket_quota": { 2024-09-12T01:03:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T01:03:41.917 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T01:03:41.917 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T01:03:41.917 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T01:03:41.917 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T01:03:41.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:03:41.917 INFO:teuthology.orchestra.run.smithi070.stdout: "user_quota": { 2024-09-12T01:03:41.917 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T01:03:41.917 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T01:03:41.917 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T01:03:41.917 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T01:03:41.917 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T01:03:41.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:03:41.917 INFO:teuthology.orchestra.run.smithi070.stdout: "temp_url_keys": [], 2024-09-12T01:03:41.917 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "root", 2024-09-12T01:03:41.918 INFO:teuthology.orchestra.run.smithi070.stdout: "mfa_ids": [], 2024-09-12T01:03:41.918 INFO:teuthology.orchestra.run.smithi070.stdout: "account_id": "RGW33333333333333333", 2024-09-12T01:03:41.918 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2024-09-12T01:03:41.918 INFO:teuthology.orchestra.run.smithi070.stdout: "create_date": "2024-09-12T01:03:41.915870Z", 2024-09-12T01:03:41.918 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:03:41.918 INFO:teuthology.orchestra.run.smithi070.stdout: "group_ids": [] 2024-09-12T01:03:41.918 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:03:41.918 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:41.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.924+0000 7f9002fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:41.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.928+0000 7f914edd69c0 20 remove_watcher() i=0 2024-09-12T01:03:41.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.928+0000 7f914edd69c0 2 removed watcher, disabling cache 2024-09-12T01:03:41.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.932+0000 7f914edd69c0 20 remove_watcher() i=1 2024-09-12T01:03:41.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.932+0000 7f914edd69c0 20 remove_watcher() i=2 2024-09-12T01:03:41.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.936+0000 7f914edd69c0 20 remove_watcher() i=3 2024-09-12T01:03:41.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.936+0000 7f914edd69c0 20 remove_watcher() i=4 2024-09-12T01:03:41.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.940+0000 7f914edd69c0 20 remove_watcher() i=5 2024-09-12T01:03:41.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.940+0000 7f914edd69c0 20 remove_watcher() i=6 2024-09-12T01:03:41.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:41.940+0000 7f914edd69c0 20 remove_watcher() i=7 2024-09-12T01:03:41.948 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 1624892802 --totp-seed GM4GK7CEAWKROZYIFDWK4OIVKAQ5DOWPYQQ2GQTRSKLN2DFXEJSEXHAFRZAMKJNB --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:03:42.034 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:03:42.034 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:03:42.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.084+0000 7faae58d89c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.084+0000 7faae58d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.084+0000 7faae58d89c0 20 realm 2024-09-12T01:03:42.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.084+0000 7faae58d89c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.084+0000 7faae58d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.084+0000 7faae58d89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:03:42.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.084+0000 7faae58d89c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.084+0000 7faae58d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.084+0000 7faae58d89c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.084+0000 7faae58d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:42.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.084+0000 7faae58d89c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.088+0000 7faae58d89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:03:42.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.088+0000 7faae58d89c0 20 searching for the correct realm 2024-09-12T01:03:42.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.088+0000 7faae2bdd640 0 -- 172.21.15.70:0/3377495909 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7faad40d8070 msgr2=0x7faad40e6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:42.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.300+0000 7faae33de640 0 -- 172.21.15.70:0/3377495909 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7faadc018040 msgr2=0x7faadc05e9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:42.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.316+0000 7faae58d89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:03:42.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.316+0000 7faae58d89c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:03:42.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.316+0000 7faae58d89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:03:42.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.316+0000 7faae58d89c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:03:42.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.316+0000 7faae58d89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:03:42.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.316+0000 7faae58d89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:03:42.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.316+0000 7faae58d89c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.320+0000 7faae58d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.320+0000 7faae58d89c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.320+0000 7faae58d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:42.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.320+0000 7faae58d89c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.320+0000 7faae58d89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:03:42.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.320+0000 7faae58d89c0 20 zone default found 2024-09-12T01:03:42.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.320+0000 7faae58d89c0 4 Realm: () 2024-09-12T01:03:42.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.320+0000 7faae58d89c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:03:42.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.320+0000 7faae58d89c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:03:42.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.320+0000 7faae58d89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:03:42.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.320+0000 7faae58d89c0 20 zonegroup default 2024-09-12T01:03:42.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.320+0000 7faae58d89c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.320+0000 7faae58d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.320+0000 7faae58d89c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.320+0000 7faae58d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.320+0000 7faae58d89c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.324+0000 7faae58d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.324+0000 7faae58d89c0 20 started sync module instance, tier type = 2024-09-12T01:03:42.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.324+0000 7faae58d89c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:03:42.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.344+0000 7faae58d89c0 20 add_watcher() i=0 2024-09-12T01:03:42.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.344+0000 7faae58d89c0 20 add_watcher() i=1 2024-09-12T01:03:42.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.344+0000 7faae58d89c0 20 add_watcher() i=2 2024-09-12T01:03:42.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.344+0000 7faae58d89c0 20 add_watcher() i=3 2024-09-12T01:03:42.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.344+0000 7faae58d89c0 20 add_watcher() i=4 2024-09-12T01:03:42.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.344+0000 7faae58d89c0 20 add_watcher() i=5 2024-09-12T01:03:42.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.344+0000 7faae58d89c0 20 add_watcher() i=6 2024-09-12T01:03:42.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.348+0000 7faae58d89c0 20 add_watcher() i=7 2024-09-12T01:03:42.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.348+0000 7faae58d89c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:03:42.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.352+0000 7fa999fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:42.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.352+0000 7faae58d89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:03:42.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.352+0000 7faae58d89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:03:42.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.352+0000 7faae58d89c0 5 note: GC not initialized 2024-09-12T01:03:42.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.352+0000 7fa998fe1640 20 reqs_thread_entry: start 2024-09-12T01:03:42.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.352+0000 7faae58d89c0 20 init_complete bucket index max shards: 1 2024-09-12T01:03:42.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.352+0000 7faae58d89c0 20 Filter name: none 2024-09-12T01:03:42.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.352+0000 7fa9127fc640 20 reqs_thread_entry: start 2024-09-12T01:03:42.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.352+0000 7faae58d89c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T01:03:42.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.352+0000 7faae58d89c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.352+0000 7faae58d89c0 20 rados_obj.operate() r=0 bl.length=532 2024-09-12T01:03:42.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.352+0000 7faae58d89c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-12T01:03:42.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.352+0000 7faae58d89c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:03:42.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.352+0000 7faae58d89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:03:42.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.360+0000 7faae58d89c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T01:03:42.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.360+0000 7faae58d89c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:03:42.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.360+0000 7faae58d89c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T01:03:42.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.360+0000 7fa9c6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333627 cookie 93863450875232 notifier 9201 bl.length()=746 2024-09-12T01:03:42.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.360+0000 7fa9c6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T01:03:42.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.360+0000 7fa9c6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:03:42.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.360+0000 7fa999fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:42.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.364+0000 7faae58d89c0 20 remove_watcher() i=0 2024-09-12T01:03:42.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.364+0000 7faae58d89c0 2 removed watcher, disabling cache 2024-09-12T01:03:42.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.368+0000 7faae58d89c0 20 remove_watcher() i=1 2024-09-12T01:03:42.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.368+0000 7faae58d89c0 20 remove_watcher() i=2 2024-09-12T01:03:42.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.372+0000 7faae58d89c0 20 remove_watcher() i=3 2024-09-12T01:03:42.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.376+0000 7faae58d89c0 20 remove_watcher() i=4 2024-09-12T01:03:42.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.376+0000 7faae58d89c0 20 remove_watcher() i=5 2024-09-12T01:03:42.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.376+0000 7faae58d89c0 20 remove_watcher() i=6 2024-09-12T01:03:42.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.380+0000 7faae58d89c0 20 remove_watcher() i=7 2024-09-12T01:03:42.387 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-12T01:03:42.387 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key URGDOYUUCLPVRSHDUEST --secret HO297wJDUJ7+SUsU6QgJ5sKGQ1BuLWqFe3pwqRJ2s3rOW/QLOOOmKA== --cluster ceph 2024-09-12T01:03:42.476 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:03:42.476 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:03:42.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.524+0000 7f95cb2c49c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.524+0000 7f95cb2c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.524+0000 7f95cb2c49c0 20 realm 2024-09-12T01:03:42.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.524+0000 7f95cb2c49c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.524+0000 7f95cb2c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.524+0000 7f95cb2c49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:03:42.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.524+0000 7f95cb2c49c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.524+0000 7f95cb2c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.524+0000 7f95cb2c49c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.528+0000 7f95cb2c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:42.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.528+0000 7f95cb2c49c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.528+0000 7f95cb2c49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:03:42.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.528+0000 7f95cb2c49c0 20 searching for the correct realm 2024-09-12T01:03:42.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.532+0000 7f95c95cb640 0 -- 172.21.15.70:0/560260321 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f95b000e070 msgr2=0x7f95b005b690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:42.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.540+0000 7f95c95cb640 0 -- 172.21.15.70:0/560260321 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f94940815e0 msgr2=0x7f9494083a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:42.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.544+0000 7f95cb2c49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:03:42.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.544+0000 7f95cb2c49c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:03:42.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.544+0000 7f95cb2c49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:03:42.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.544+0000 7f95cb2c49c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:03:42.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.544+0000 7f95cb2c49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:03:42.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.544+0000 7f95cb2c49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:03:42.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.544+0000 7f95cb2c49c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.544+0000 7f95cb2c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.544+0000 7f95cb2c49c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.544+0000 7f95cb2c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:42.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.544+0000 7f95cb2c49c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.548+0000 7f95cb2c49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:03:42.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.548+0000 7f95cb2c49c0 20 zone default found 2024-09-12T01:03:42.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.548+0000 7f95cb2c49c0 4 Realm: () 2024-09-12T01:03:42.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.548+0000 7f95cb2c49c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:03:42.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.548+0000 7f95cb2c49c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:03:42.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.548+0000 7f95cb2c49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:03:42.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.548+0000 7f95cb2c49c0 20 zonegroup default 2024-09-12T01:03:42.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.548+0000 7f95cb2c49c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.548+0000 7f95cb2c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.548+0000 7f95cb2c49c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.548+0000 7f95cb2c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.548+0000 7f95cb2c49c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.548+0000 7f95cb2c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.548+0000 7f95cb2c49c0 20 started sync module instance, tier type = 2024-09-12T01:03:42.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.548+0000 7f95cb2c49c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:03:42.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.564+0000 7f95cb2c49c0 20 add_watcher() i=0 2024-09-12T01:03:42.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.564+0000 7f95cb2c49c0 20 add_watcher() i=1 2024-09-12T01:03:42.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.564+0000 7f95cb2c49c0 20 add_watcher() i=2 2024-09-12T01:03:42.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.564+0000 7f95cb2c49c0 20 add_watcher() i=3 2024-09-12T01:03:42.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.564+0000 7f95cb2c49c0 20 add_watcher() i=4 2024-09-12T01:03:42.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.564+0000 7f95cb2c49c0 20 add_watcher() i=5 2024-09-12T01:03:42.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.564+0000 7f95cb2c49c0 20 add_watcher() i=6 2024-09-12T01:03:42.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.564+0000 7f95cb2c49c0 20 add_watcher() i=7 2024-09-12T01:03:42.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.564+0000 7f95cb2c49c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:03:42.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f947efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:42.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f95cb2c49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:03:42.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f95cb2c49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:03:42.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f95cb2c49c0 5 note: GC not initialized 2024-09-12T01:03:42.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f947dfe3640 20 reqs_thread_entry: start 2024-09-12T01:03:42.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f95cb2c49c0 20 init_complete bucket index max shards: 1 2024-09-12T01:03:42.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f95cb2c49c0 20 Filter name: none 2024-09-12T01:03:42.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f93ef7fe640 20 reqs_thread_entry: start 2024-09-12T01:03:42.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f95cb2c49c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T01:03:42.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f95cb2c49c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f95cb2c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f95cb2c49c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-12T01:03:42.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f95cb2c49c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:03:42.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f95cb2c49c0 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-12T01:03:42.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f95cb2c49c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f95cb2c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f95cb2c49c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-12T01:03:42.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f95cb2c49c0 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T01:03:42.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f95cb2c49c0 10 cache get: name=default.rgw.meta+users.keys+URGDOYUUCLPVRSHDUEST : miss 2024-09-12T01:03:42.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f95cb2c49c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f95cb2c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f95cb2c49c0 10 cache put: name=default.rgw.meta+users.keys+URGDOYUUCLPVRSHDUEST info.flags=0x0 2024-09-12T01:03:42.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f95cb2c49c0 10 adding default.rgw.meta+users.keys+URGDOYUUCLPVRSHDUEST to cache LRU end 2024-09-12T01:03:42.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f95cb2c49c0 10 cache get: name=default.rgw.meta+users.keys+URGDOYUUCLPVRSHDUEST : hit (negative entry) 2024-09-12T01:03:42.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f95cb2c49c0 10 cache get: name=default.rgw.meta+users.keys+URGDOYUUCLPVRSHDUEST : hit (negative entry) 2024-09-12T01:03:42.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f95cb2c49c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:03:42.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f95cb2c49c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:03:42.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.568+0000 7f95cb2c49c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T01:03:42.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.572+0000 7f949ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333525 cookie 94162494105600 notifier 9219 bl.length()=660 2024-09-12T01:03:42.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.572+0000 7f949ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:03:42.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.572+0000 7f949ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:03:42.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.576+0000 7f95cb2c49c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T01:03:42.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.576+0000 7f95cb2c49c0 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T01:03:42.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.576+0000 7f95cb2c49c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-12T01:03:42.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.576+0000 7f949f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333581 cookie 94162494087616 notifier 9219 bl.length()=191 2024-09-12T01:03:42.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.576+0000 7f949f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T01:03:42.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.576+0000 7f949f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T01:03:42.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.576+0000 7f95cb2c49c0 10 cache put: name=default.rgw.meta+users.keys+URGDOYUUCLPVRSHDUEST info.flags=0x7 2024-09-12T01:03:42.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.576+0000 7f95cb2c49c0 10 moving default.rgw.meta+users.keys+URGDOYUUCLPVRSHDUEST to cache LRU end 2024-09-12T01:03:42.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.576+0000 7f95cb2c49c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:URGDOYUUCLPVRSHDUEST, ofs0, ns] 2024-09-12T01:03:42.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.576+0000 7f949ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333628 cookie 94162494098496 notifier 9219 bl.length()=189 2024-09-12T01:03:42.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.576+0000 7f949ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+URGDOYUUCLPVRSHDUEST info.flags=0x7 2024-09-12T01:03:42.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.576+0000 7f949ffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+URGDOYUUCLPVRSHDUEST to cache LRU end 2024-09-12T01:03:42.570 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:03:42.571 INFO:teuthology.orchestra.run.smithi070.stdout: "user_id": "foobar.client.0", 2024-09-12T01:03:42.571 INFO:teuthology.orchestra.run.smithi070.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T01:03:42.571 INFO:teuthology.orchestra.run.smithi070.stdout: "email": "foobar+test@test.test", 2024-09-12T01:03:42.571 INFO:teuthology.orchestra.run.smithi070.stdout: "suspended": 0, 2024-09-12T01:03:42.571 INFO:teuthology.orchestra.run.smithi070.stdout: "max_buckets": 1000, 2024-09-12T01:03:42.571 INFO:teuthology.orchestra.run.smithi070.stdout: "subusers": [], 2024-09-12T01:03:42.571 INFO:teuthology.orchestra.run.smithi070.stdout: "keys": [ 2024-09-12T01:03:42.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:03:42.571 INFO:teuthology.orchestra.run.smithi070.stdout: "user": "foobar.client.0", 2024-09-12T01:03:42.571 INFO:teuthology.orchestra.run.smithi070.stdout: "access_key": "URGDOYUUCLPVRSHDUEST", 2024-09-12T01:03:42.571 INFO:teuthology.orchestra.run.smithi070.stdout: "secret_key": "HO297wJDUJ7+SUsU6QgJ5sKGQ1BuLWqFe3pwqRJ2s3rOW/QLOOOmKA==", 2024-09-12T01:03:42.571 INFO:teuthology.orchestra.run.smithi070.stdout: "active": true, 2024-09-12T01:03:42.571 INFO:teuthology.orchestra.run.smithi070.stdout: "create_date": "2024-09-12T01:03:42.573111Z" 2024-09-12T01:03:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:03:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:03:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: "swift_keys": [], 2024-09-12T01:03:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": [], 2024-09-12T01:03:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: "op_mask": "read, write, delete", 2024-09-12T01:03:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: "default_placement": "", 2024-09-12T01:03:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: "default_storage_class": "", 2024-09-12T01:03:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: "placement_tags": [], 2024-09-12T01:03:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: "bucket_quota": { 2024-09-12T01:03:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T01:03:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T01:03:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T01:03:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T01:03:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T01:03:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:03:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "user_quota": { 2024-09-12T01:03:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T01:03:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T01:03:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T01:03:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T01:03:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T01:03:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:03:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "temp_url_keys": [], 2024-09-12T01:03:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "rgw", 2024-09-12T01:03:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "mfa_ids": [], 2024-09-12T01:03:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "account_id": "", 2024-09-12T01:03:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2024-09-12T01:03:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: "create_date": "2024-09-12T01:03:42.573090Z", 2024-09-12T01:03:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:03:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: "group_ids": [] 2024-09-12T01:03:42.574 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:03:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:42.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.580+0000 7f947efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:42.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.584+0000 7f95cb2c49c0 20 remove_watcher() i=0 2024-09-12T01:03:42.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.584+0000 7f95cb2c49c0 2 removed watcher, disabling cache 2024-09-12T01:03:42.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.584+0000 7f95cb2c49c0 20 remove_watcher() i=1 2024-09-12T01:03:42.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.588+0000 7f95cb2c49c0 20 remove_watcher() i=2 2024-09-12T01:03:42.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.588+0000 7f95cb2c49c0 20 remove_watcher() i=3 2024-09-12T01:03:42.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.592+0000 7f95cb2c49c0 20 remove_watcher() i=4 2024-09-12T01:03:42.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.592+0000 7f95cb2c49c0 20 remove_watcher() i=5 2024-09-12T01:03:42.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.596+0000 7f95cb2c49c0 20 remove_watcher() i=6 2024-09-12T01:03:42.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.596+0000 7f95cb2c49c0 20 remove_watcher() i=7 2024-09-12T01:03:42.605 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 5738885568 --totp-seed FXIZ4UI5UM4MXCGPF5XVGWJL2THI6TIEIHGHMEBPYBPESLCWE7KZAD5VSTET2LYY --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:03:42.691 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:03:42.691 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:03:42.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.736+0000 7fccf333a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.740+0000 7fccf333a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.740+0000 7fccf333a9c0 20 realm 2024-09-12T01:03:42.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.740+0000 7fccf333a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.740+0000 7fccf333a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.740+0000 7fccf333a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:03:42.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.740+0000 7fccf333a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.740+0000 7fccf333a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.740+0000 7fccf333a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.740+0000 7fccf333a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:42.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.740+0000 7fccf333a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.744+0000 7fccf333a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:03:42.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.744+0000 7fccf333a9c0 20 searching for the correct realm 2024-09-12T01:03:42.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.748+0000 7fccf1641640 0 -- 172.21.15.70:0/1620435172 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fcce4027050 msgr2=0x7fcce4042040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:42.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.756+0000 7fccf1641640 0 -- 172.21.15.70:0/1620435172 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fcbbc0815e0 msgr2=0x7fcbbc083a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:42.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.760+0000 7fccf333a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:03:42.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.760+0000 7fccf333a9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:03:42.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.760+0000 7fccf333a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:03:42.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.760+0000 7fccf333a9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:03:42.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.760+0000 7fccf333a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:03:42.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.760+0000 7fccf333a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:03:42.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.760+0000 7fccf333a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.760+0000 7fccf333a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.760+0000 7fccf333a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.760+0000 7fccf333a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:42.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.760+0000 7fccf333a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.764+0000 7fccf333a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:03:42.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.764+0000 7fccf333a9c0 20 zone default found 2024-09-12T01:03:42.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.764+0000 7fccf333a9c0 4 Realm: () 2024-09-12T01:03:42.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.764+0000 7fccf333a9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:03:42.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.764+0000 7fccf333a9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:03:42.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.764+0000 7fccf333a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:03:42.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.764+0000 7fccf333a9c0 20 zonegroup default 2024-09-12T01:03:42.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.764+0000 7fccf333a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.764+0000 7fccf333a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.764+0000 7fccf333a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.764+0000 7fccf333a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.764+0000 7fccf333a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.764+0000 7fccf333a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.764+0000 7fccf333a9c0 20 started sync module instance, tier type = 2024-09-12T01:03:42.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.764+0000 7fccf333a9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:03:42.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.780+0000 7fccf333a9c0 20 add_watcher() i=0 2024-09-12T01:03:42.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.780+0000 7fccf333a9c0 20 add_watcher() i=1 2024-09-12T01:03:42.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.780+0000 7fccf333a9c0 20 add_watcher() i=2 2024-09-12T01:03:42.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.780+0000 7fccf333a9c0 20 add_watcher() i=3 2024-09-12T01:03:42.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.780+0000 7fccf333a9c0 20 add_watcher() i=4 2024-09-12T01:03:42.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.780+0000 7fccf333a9c0 20 add_watcher() i=5 2024-09-12T01:03:42.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.780+0000 7fccf333a9c0 20 add_watcher() i=6 2024-09-12T01:03:42.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.780+0000 7fccf333a9c0 20 add_watcher() i=7 2024-09-12T01:03:42.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.780+0000 7fccf333a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:03:42.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.784+0000 7fcba6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:42.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.784+0000 7fccf333a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:03:42.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.784+0000 7fccf333a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:03:42.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.784+0000 7fccf333a9c0 5 note: GC not initialized 2024-09-12T01:03:42.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.784+0000 7fcba5fe3640 20 reqs_thread_entry: start 2024-09-12T01:03:42.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.784+0000 7fccf333a9c0 20 init_complete bucket index max shards: 1 2024-09-12T01:03:42.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.784+0000 7fccf333a9c0 20 Filter name: none 2024-09-12T01:03:42.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.784+0000 7fcb177fe640 20 reqs_thread_entry: start 2024-09-12T01:03:42.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.784+0000 7fccf333a9c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T01:03:42.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.784+0000 7fccf333a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.784+0000 7fccf333a9c0 20 rados_obj.operate() r=0 bl.length=472 2024-09-12T01:03:42.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.784+0000 7fccf333a9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T01:03:42.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.784+0000 7fccf333a9c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:03:42.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.784+0000 7fccf333a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:03:42.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.788+0000 7fccf333a9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:03:42.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.788+0000 7fccf333a9c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:03:42.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.788+0000 7fccf333a9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T01:03:42.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.788+0000 7fcbc7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333526 cookie 94865906151664 notifier 9237 bl.length()=674 2024-09-12T01:03:42.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.788+0000 7fcbc7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:03:42.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.788+0000 7fcbc7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:03:42.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.788+0000 7fcba6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:42.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.796+0000 7fccf333a9c0 20 remove_watcher() i=0 2024-09-12T01:03:42.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.796+0000 7fccf333a9c0 2 removed watcher, disabling cache 2024-09-12T01:03:42.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.796+0000 7fccf333a9c0 20 remove_watcher() i=1 2024-09-12T01:03:42.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.800+0000 7fccf333a9c0 20 remove_watcher() i=2 2024-09-12T01:03:42.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.800+0000 7fccf333a9c0 20 remove_watcher() i=3 2024-09-12T01:03:42.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.804+0000 7fccf333a9c0 20 remove_watcher() i=4 2024-09-12T01:03:42.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.804+0000 7fccf333a9c0 20 remove_watcher() i=5 2024-09-12T01:03:42.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.804+0000 7fccf333a9c0 20 remove_watcher() i=6 2024-09-12T01:03:42.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.808+0000 7fccf333a9c0 20 remove_watcher() i=7 2024-09-12T01:03:42.813 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-12T01:03:42.891 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:03:42.891 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:03:42.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.940+0000 7f4e5dce09c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.940+0000 7f4e5dce09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.940+0000 7f4e5dce09c0 20 realm 2024-09-12T01:03:42.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.940+0000 7f4e5dce09c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.940+0000 7f4e5dce09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.940+0000 7f4e5dce09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:03:42.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.940+0000 7f4e5dce09c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.940+0000 7f4e5dce09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.940+0000 7f4e5dce09c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.944+0000 7f4e5dce09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:42.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.944+0000 7f4e5dce09c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.944+0000 7f4e5dce09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:03:42.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.944+0000 7f4e5dce09c0 20 searching for the correct realm 2024-09-12T01:03:42.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.948+0000 7f4e5bfe7640 0 -- 172.21.15.70:0/1746949401 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f4e4404b070 msgr2=0x7f4e4404ca80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:42.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.956+0000 7f4e5bfe7640 0 -- 172.21.15.70:0/1746949401 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f4d240815e0 msgr2=0x7f4d24083a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:42.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.960+0000 7f4e5dce09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:03:42.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.960+0000 7f4e5dce09c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:03:42.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.960+0000 7f4e5dce09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:03:42.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.960+0000 7f4e5dce09c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:03:42.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.960+0000 7f4e5dce09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:03:42.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.960+0000 7f4e5dce09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:03:42.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.960+0000 7f4e5dce09c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.964+0000 7f4e5dce09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.964+0000 7f4e5dce09c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.964+0000 7f4e5dce09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:42.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.964+0000 7f4e5dce09c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.964+0000 7f4e5dce09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:03:42.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.964+0000 7f4e5dce09c0 20 zone default found 2024-09-12T01:03:42.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.964+0000 7f4e5dce09c0 4 Realm: () 2024-09-12T01:03:42.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.964+0000 7f4e5dce09c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:03:42.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.964+0000 7f4e5dce09c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:03:42.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.964+0000 7f4e5dce09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:03:42.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.964+0000 7f4e5dce09c0 20 zonegroup default 2024-09-12T01:03:42.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.964+0000 7f4e5dce09c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.964+0000 7f4e5dce09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.964+0000 7f4e5dce09c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.964+0000 7f4e5dce09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.964+0000 7f4e5dce09c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.964+0000 7f4e5dce09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:42.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.964+0000 7f4e5dce09c0 20 started sync module instance, tier type = 2024-09-12T01:03:42.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.964+0000 7f4e5dce09c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:03:42.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.980+0000 7f4e5dce09c0 20 add_watcher() i=0 2024-09-12T01:03:42.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.980+0000 7f4e5dce09c0 20 add_watcher() i=1 2024-09-12T01:03:42.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.980+0000 7f4e5dce09c0 20 add_watcher() i=2 2024-09-12T01:03:42.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.980+0000 7f4e5dce09c0 20 add_watcher() i=3 2024-09-12T01:03:42.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.980+0000 7f4e5dce09c0 20 add_watcher() i=4 2024-09-12T01:03:42.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.980+0000 7f4e5dce09c0 20 add_watcher() i=5 2024-09-12T01:03:42.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.980+0000 7f4e5dce09c0 20 add_watcher() i=6 2024-09-12T01:03:42.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.984+0000 7f4e5dce09c0 20 add_watcher() i=7 2024-09-12T01:03:42.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.984+0000 7f4e5dce09c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:03:42.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.984+0000 7f4d11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:42.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.984+0000 7f4e5dce09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:03:42.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.984+0000 7f4e5dce09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:03:42.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.984+0000 7f4e5dce09c0 5 note: GC not initialized 2024-09-12T01:03:42.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.984+0000 7f4d10fe1640 20 reqs_thread_entry: start 2024-09-12T01:03:42.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.984+0000 7f4e5dce09c0 20 init_complete bucket index max shards: 1 2024-09-12T01:03:42.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.984+0000 7f4e5dce09c0 20 Filter name: none 2024-09-12T01:03:42.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.984+0000 7f4c8a7fc640 20 reqs_thread_entry: start 2024-09-12T01:03:42.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.984+0000 7f4e5dce09c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T01:03:42.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.984+0000 7f4e5dce09c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:42.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.988+0000 7f4e5dce09c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T01:03:42.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.988+0000 7f4e5dce09c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T01:03:42.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.988+0000 7f4e5dce09c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:03:42.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.988+0000 7f4e5dce09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:03:42.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.988+0000 7f4e5dce09c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:03:42.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.988+0000 7f4e5dce09c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:03:42.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.988+0000 7f4e5dce09c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T01:03:42.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.988+0000 7f4d3effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333527 cookie 94290974765872 notifier 8666 bl.length()=727 2024-09-12T01:03:42.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.988+0000 7f4d3effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:03:42.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.988+0000 7f4d3effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:03:42.982 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:03:42.982 INFO:teuthology.orchestra.run.smithi070.stdout: "user_id": "foobar.client.0", 2024-09-12T01:03:42.982 INFO:teuthology.orchestra.run.smithi070.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T01:03:42.982 INFO:teuthology.orchestra.run.smithi070.stdout: "email": "foobar+test@test.test", 2024-09-12T01:03:42.982 INFO:teuthology.orchestra.run.smithi070.stdout: "suspended": 0, 2024-09-12T01:03:42.982 INFO:teuthology.orchestra.run.smithi070.stdout: "max_buckets": 1000, 2024-09-12T01:03:42.983 INFO:teuthology.orchestra.run.smithi070.stdout: "subusers": [], 2024-09-12T01:03:42.983 INFO:teuthology.orchestra.run.smithi070.stdout: "keys": [ 2024-09-12T01:03:42.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:03:42.983 INFO:teuthology.orchestra.run.smithi070.stdout: "user": "foobar.client.0", 2024-09-12T01:03:42.983 INFO:teuthology.orchestra.run.smithi070.stdout: "access_key": "URGDOYUUCLPVRSHDUEST", 2024-09-12T01:03:42.983 INFO:teuthology.orchestra.run.smithi070.stdout: "secret_key": "HO297wJDUJ7+SUsU6QgJ5sKGQ1BuLWqFe3pwqRJ2s3rOW/QLOOOmKA==", 2024-09-12T01:03:42.984 INFO:teuthology.orchestra.run.smithi070.stdout: "active": true, 2024-09-12T01:03:42.984 INFO:teuthology.orchestra.run.smithi070.stdout: "create_date": "2024-09-12T01:03:42.573111Z" 2024-09-12T01:03:42.984 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:03:42.984 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:03:42.984 INFO:teuthology.orchestra.run.smithi070.stdout: "swift_keys": [], 2024-09-12T01:03:42.984 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": [ 2024-09-12T01:03:42.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:03:42.984 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "oidc-provider", 2024-09-12T01:03:42.984 INFO:teuthology.orchestra.run.smithi070.stdout: "perm": "*" 2024-09-12T01:03:42.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:03:42.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:03:42.984 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "roles", 2024-09-12T01:03:42.985 INFO:teuthology.orchestra.run.smithi070.stdout: "perm": "*" 2024-09-12T01:03:42.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:03:42.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:03:42.985 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "user-policy", 2024-09-12T01:03:42.985 INFO:teuthology.orchestra.run.smithi070.stdout: "perm": "*" 2024-09-12T01:03:42.985 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:03:42.985 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:03:42.985 INFO:teuthology.orchestra.run.smithi070.stdout: "op_mask": "read, write, delete", 2024-09-12T01:03:42.985 INFO:teuthology.orchestra.run.smithi070.stdout: "default_placement": "", 2024-09-12T01:03:42.985 INFO:teuthology.orchestra.run.smithi070.stdout: "default_storage_class": "", 2024-09-12T01:03:42.985 INFO:teuthology.orchestra.run.smithi070.stdout: "placement_tags": [], 2024-09-12T01:03:42.985 INFO:teuthology.orchestra.run.smithi070.stdout: "bucket_quota": { 2024-09-12T01:03:42.985 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T01:03:42.985 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T01:03:42.986 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T01:03:42.986 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T01:03:42.986 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T01:03:42.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:03:42.986 INFO:teuthology.orchestra.run.smithi070.stdout: "user_quota": { 2024-09-12T01:03:42.986 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T01:03:42.986 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T01:03:42.986 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T01:03:42.986 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T01:03:42.986 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T01:03:42.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:03:42.986 INFO:teuthology.orchestra.run.smithi070.stdout: "temp_url_keys": [], 2024-09-12T01:03:42.986 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "rgw", 2024-09-12T01:03:42.986 INFO:teuthology.orchestra.run.smithi070.stdout: "mfa_ids": [ 2024-09-12T01:03:42.986 INFO:teuthology.orchestra.run.smithi070.stdout: "5738885568" 2024-09-12T01:03:42.987 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:03:42.987 INFO:teuthology.orchestra.run.smithi070.stdout: "account_id": "", 2024-09-12T01:03:42.987 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2024-09-12T01:03:42.987 INFO:teuthology.orchestra.run.smithi070.stdout: "create_date": "2024-09-12T01:03:42.573090Z", 2024-09-12T01:03:42.987 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:03:42.987 INFO:teuthology.orchestra.run.smithi070.stdout: "group_ids": [] 2024-09-12T01:03:42.987 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:03:42.987 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:42.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.988+0000 7f4d11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:42.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.996+0000 7f4e5dce09c0 20 remove_watcher() i=0 2024-09-12T01:03:42.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.996+0000 7f4e5dce09c0 2 removed watcher, disabling cache 2024-09-12T01:03:42.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:42.996+0000 7f4e5dce09c0 20 remove_watcher() i=1 2024-09-12T01:03:42.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.000+0000 7f4e5dce09c0 20 remove_watcher() i=2 2024-09-12T01:03:42.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.000+0000 7f4e5dce09c0 20 remove_watcher() i=3 2024-09-12T01:03:42.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.004+0000 7f4e5dce09c0 20 remove_watcher() i=4 2024-09-12T01:03:42.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.004+0000 7f4e5dce09c0 20 remove_watcher() i=5 2024-09-12T01:03:42.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.004+0000 7f4e5dce09c0 20 remove_watcher() i=6 2024-09-12T01:03:42.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.008+0000 7f4e5dce09c0 20 remove_watcher() i=7 2024-09-12T01:03:43.013 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-12T01:03:43.092 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:03:43.092 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:03:43.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.140+0000 7f53874d39c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.140+0000 7f53874d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.140+0000 7f53874d39c0 20 realm 2024-09-12T01:03:43.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.140+0000 7f53874d39c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.140+0000 7f53874d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.140+0000 7f53874d39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:03:43.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.140+0000 7f53874d39c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.140+0000 7f53874d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.140+0000 7f53874d39c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.144+0000 7f53874d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:43.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.144+0000 7f53874d39c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.144+0000 7f53874d39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:03:43.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.144+0000 7f53874d39c0 20 searching for the correct realm 2024-09-12T01:03:43.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.148+0000 7f53857da640 0 -- 172.21.15.70:0/1222883492 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f5378119090 msgr2=0x7f5378007730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:43.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.156+0000 7f5384fd9640 0 -- 172.21.15.70:0/1222883492 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f5374060a10 msgr2=0x7f5374081a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:43.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.164+0000 7f53874d39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:03:43.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.164+0000 7f53874d39c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:03:43.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.164+0000 7f53874d39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:03:43.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.164+0000 7f53874d39c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:03:43.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.164+0000 7f53874d39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:03:43.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.164+0000 7f53874d39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:03:43.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.164+0000 7f53874d39c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.164+0000 7f53874d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.164+0000 7f53874d39c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.164+0000 7f53874d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:43.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.164+0000 7f53874d39c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.164+0000 7f53874d39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:03:43.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.164+0000 7f53874d39c0 20 zone default found 2024-09-12T01:03:43.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.164+0000 7f53874d39c0 4 Realm: () 2024-09-12T01:03:43.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.164+0000 7f53874d39c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:03:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.164+0000 7f53874d39c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:03:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.164+0000 7f53874d39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:03:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.164+0000 7f53874d39c0 20 zonegroup default 2024-09-12T01:03:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.164+0000 7f53874d39c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.164+0000 7f53874d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.164+0000 7f53874d39c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.164+0000 7f53874d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.164+0000 7f53874d39c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.164+0000 7f53874d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.164+0000 7f53874d39c0 20 started sync module instance, tier type = 2024-09-12T01:03:43.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.164+0000 7f53874d39c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:03:43.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.180+0000 7f53874d39c0 20 add_watcher() i=0 2024-09-12T01:03:43.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.180+0000 7f53874d39c0 20 add_watcher() i=1 2024-09-12T01:03:43.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.180+0000 7f53874d39c0 20 add_watcher() i=2 2024-09-12T01:03:43.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.180+0000 7f53874d39c0 20 add_watcher() i=3 2024-09-12T01:03:43.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.180+0000 7f53874d39c0 20 add_watcher() i=4 2024-09-12T01:03:43.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.180+0000 7f53874d39c0 20 add_watcher() i=5 2024-09-12T01:03:43.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.180+0000 7f53874d39c0 20 add_watcher() i=6 2024-09-12T01:03:43.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.180+0000 7f53874d39c0 20 add_watcher() i=7 2024-09-12T01:03:43.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.180+0000 7f53874d39c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:03:43.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.184+0000 7f523afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:43.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.184+0000 7f53874d39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:03:43.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.184+0000 7f53874d39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:03:43.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.184+0000 7f53874d39c0 5 note: GC not initialized 2024-09-12T01:03:43.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.184+0000 7f5239fe3640 20 reqs_thread_entry: start 2024-09-12T01:03:43.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.184+0000 7f53874d39c0 20 init_complete bucket index max shards: 1 2024-09-12T01:03:43.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.184+0000 7f53874d39c0 20 Filter name: none 2024-09-12T01:03:43.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.184+0000 7f51ab7fe640 20 reqs_thread_entry: start 2024-09-12T01:03:43.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.184+0000 7f53874d39c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-12T01:03:43.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.184+0000 7f53874d39c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.184+0000 7f53874d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.184+0000 7f53874d39c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-12T01:03:43.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.184+0000 7f53874d39c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T01:03:43.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.184+0000 7f53874d39c0 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-12T01:03:43.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.184+0000 7f53874d39c0 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-12T01:03:43.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.184+0000 7f53874d39c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.184+0000 7f53874d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.184+0000 7f53874d39c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-12T01:03:43.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.184+0000 7f53874d39c0 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T01:03:43.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.184+0000 7f53874d39c0 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-12T01:03:43.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.188+0000 7f53874d39c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T01:03:43.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.188+0000 7f53874d39c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T01:03:43.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.188+0000 7f53874d39c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-12T01:03:43.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.188+0000 7f525bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333582 cookie 94446415641024 notifier 9273 bl.length()=384 2024-09-12T01:03:43.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.188+0000 7f525bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T01:03:43.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.188+0000 7f525bfff640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T01:03:43.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.192+0000 7f53874d39c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T01:03:43.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.192+0000 7f53874d39c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T01:03:43.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.192+0000 7f53874d39c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-12T01:03:43.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.192+0000 7f525b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333636 cookie 94446415634592 notifier 9273 bl.length()=225 2024-09-12T01:03:43.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.192+0000 7f525b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T01:03:43.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.192+0000 7f525b7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T01:03:43.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.196+0000 7f53874d39c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T01:03:43.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.196+0000 7f53874d39c0 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T01:03:43.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.196+0000 7f53874d39c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-12T01:03:43.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.196+0000 7f525bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333586 cookie 94446415647408 notifier 9273 bl.length()=234 2024-09-12T01:03:43.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.196+0000 7f525bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T01:03:43.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.196+0000 7f525bfff640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T01:03:43.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.196+0000 7f523afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:43.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.204+0000 7f53874d39c0 20 remove_watcher() i=0 2024-09-12T01:03:43.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.204+0000 7f53874d39c0 2 removed watcher, disabling cache 2024-09-12T01:03:43.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.204+0000 7f53874d39c0 20 remove_watcher() i=1 2024-09-12T01:03:43.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.208+0000 7f53874d39c0 20 remove_watcher() i=2 2024-09-12T01:03:43.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.208+0000 7f53874d39c0 20 remove_watcher() i=3 2024-09-12T01:03:43.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.212+0000 7f53874d39c0 20 remove_watcher() i=4 2024-09-12T01:03:43.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.212+0000 7f53874d39c0 20 remove_watcher() i=5 2024-09-12T01:03:43.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.212+0000 7f53874d39c0 20 remove_watcher() i=6 2024-09-12T01:03:43.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.212+0000 7f53874d39c0 20 remove_watcher() i=7 2024-09-12T01:03:43.217 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:03:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: "id": "RGW88888888888888888", 2024-09-12T01:03:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: "tenant": "", 2024-09-12T01:03:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "Mr.RGW88888888888888888", 2024-09-12T01:03:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-12T01:03:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: "quota": { 2024-09-12T01:03:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T01:03:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T01:03:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T01:03:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T01:03:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T01:03:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:03:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "bucket_quota": { 2024-09-12T01:03:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T01:03:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T01:03:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T01:03:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T01:03:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T01:03:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:03:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "max_users": 1000, 2024-09-12T01:03:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "max_roles": 1000, 2024-09-12T01:03:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "max_groups": 1000, 2024-09-12T01:03:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: "max_buckets": 1000, 2024-09-12T01:03:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: "max_access_keys": 4 2024-09-12T01:03:43.219 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:03:43.220 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-12T01:03:43.220 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key FGBEYKYZGQKXYUSWCDBV --secret 4zGKgxOd5mztDpHpzJvTrpN1joxsXZa9HARne2sgNXKU9hQYDwT+PA== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-12T01:03:43.307 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:03:43.307 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:03:43.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.352+0000 7f72f704d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.352+0000 7f72f704d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.352+0000 7f72f704d9c0 20 realm 2024-09-12T01:03:43.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.352+0000 7f72f704d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.352+0000 7f72f704d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.352+0000 7f72f704d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:03:43.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.352+0000 7f72f704d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.352+0000 7f72f704d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.352+0000 7f72f704d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.356+0000 7f72f704d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:43.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.356+0000 7f72f704d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.356+0000 7f72f704d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:03:43.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.356+0000 7f72f704d9c0 20 searching for the correct realm 2024-09-12T01:03:43.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.360+0000 7f72f5354640 0 -- 172.21.15.70:0/2940256610 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f72dc046040 msgr2=0x7f72dc018510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:43.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.368+0000 7f72f4b53640 0 -- 172.21.15.70:0/2940256610 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f72ec0fc580 msgr2=0x7f72ec0c6820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:43.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.376+0000 7f72f704d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:03:43.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.376+0000 7f72f704d9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:03:43.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.376+0000 7f72f704d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:03:43.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.376+0000 7f72f704d9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:03:43.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.376+0000 7f72f704d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:03:43.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.376+0000 7f72f704d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:03:43.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.376+0000 7f72f704d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.376+0000 7f72f704d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.376+0000 7f72f704d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.376+0000 7f72f704d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:43.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.376+0000 7f72f704d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.376+0000 7f72f704d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:03:43.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.376+0000 7f72f704d9c0 20 zone default found 2024-09-12T01:03:43.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.376+0000 7f72f704d9c0 4 Realm: () 2024-09-12T01:03:43.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.376+0000 7f72f704d9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:03:43.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.376+0000 7f72f704d9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:03:43.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.376+0000 7f72f704d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:03:43.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.376+0000 7f72f704d9c0 20 zonegroup default 2024-09-12T01:03:43.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.376+0000 7f72f704d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.376+0000 7f72f704d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.376+0000 7f72f704d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.376+0000 7f72f704d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.376+0000 7f72f704d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.376+0000 7f72f704d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.376+0000 7f72f704d9c0 20 started sync module instance, tier type = 2024-09-12T01:03:43.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.376+0000 7f72f704d9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:03:43.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.392+0000 7f72f704d9c0 20 add_watcher() i=0 2024-09-12T01:03:43.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.392+0000 7f72f704d9c0 20 add_watcher() i=1 2024-09-12T01:03:43.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.392+0000 7f72f704d9c0 20 add_watcher() i=2 2024-09-12T01:03:43.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.392+0000 7f72f704d9c0 20 add_watcher() i=3 2024-09-12T01:03:43.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.392+0000 7f72f704d9c0 20 add_watcher() i=4 2024-09-12T01:03:43.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.392+0000 7f72f704d9c0 20 add_watcher() i=5 2024-09-12T01:03:43.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.392+0000 7f72f704d9c0 20 add_watcher() i=6 2024-09-12T01:03:43.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.392+0000 7f72f704d9c0 20 add_watcher() i=7 2024-09-12T01:03:43.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.392+0000 7f72f704d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:03:43.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.392+0000 7f71aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:43.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:03:43.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:03:43.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 5 note: GC not initialized 2024-09-12T01:03:43.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f71a9fe3640 20 reqs_thread_entry: start 2024-09-12T01:03:43.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 20 init_complete bucket index max shards: 1 2024-09-12T01:03:43.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 20 Filter name: none 2024-09-12T01:03:43.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f711b7fe640 20 reqs_thread_entry: start 2024-09-12T01:03:43.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T01:03:43.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-12T01:03:43.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:03:43.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-12T01:03:43.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-12T01:03:43.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T01:03:43.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 10 cache get: name=default.rgw.meta+users.keys+FGBEYKYZGQKXYUSWCDBV : miss 2024-09-12T01:03:43.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 10 cache put: name=default.rgw.meta+users.keys+FGBEYKYZGQKXYUSWCDBV info.flags=0x0 2024-09-12T01:03:43.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 10 adding default.rgw.meta+users.keys+FGBEYKYZGQKXYUSWCDBV to cache LRU end 2024-09-12T01:03:43.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-12T01:03:43.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T01:03:43.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T01:03:43.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T01:03:43.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:03:43.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 10 cache get: name=default.rgw.meta+users.keys+FGBEYKYZGQKXYUSWCDBV : hit (negative entry) 2024-09-12T01:03:43.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.396+0000 7f72f704d9c0 10 cache get: name=default.rgw.meta+users.keys+FGBEYKYZGQKXYUSWCDBV : hit (negative entry) 2024-09-12T01:03:43.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.400+0000 7f72f704d9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T01:03:43.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.400+0000 7f72f704d9c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:03:43.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.400+0000 7f72f704d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T01:03:43.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.400+0000 7f71cbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333583 cookie 93969797131296 notifier 8699 bl.length()=681 2024-09-12T01:03:43.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.400+0000 7f71cbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T01:03:43.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.400+0000 7f71cbfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:03:43.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.400+0000 7f72f704d9c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T01:03:43.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.400+0000 7f72f704d9c0 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T01:03:43.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.400+0000 7f72f704d9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-12T01:03:43.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.400+0000 7f71cb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333629 cookie 93969797141120 notifier 8699 bl.length()=189 2024-09-12T01:03:43.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.400+0000 7f71cb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T01:03:43.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.400+0000 7f71cb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T01:03:43.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.404+0000 7f72f704d9c0 10 cache put: name=default.rgw.meta+users.keys+FGBEYKYZGQKXYUSWCDBV info.flags=0x7 2024-09-12T01:03:43.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.404+0000 7f72f704d9c0 10 moving default.rgw.meta+users.keys+FGBEYKYZGQKXYUSWCDBV to cache LRU end 2024-09-12T01:03:43.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.404+0000 7f72f704d9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:FGBEYKYZGQKXYUSWCDBV, ofs0, ns] 2024-09-12T01:03:43.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.404+0000 7f71cbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333587 cookie 93969797132352 notifier 8699 bl.length()=188 2024-09-12T01:03:43.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.404+0000 7f71cbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+FGBEYKYZGQKXYUSWCDBV info.flags=0x7 2024-09-12T01:03:43.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.404+0000 7f71cbfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+FGBEYKYZGQKXYUSWCDBV to cache LRU end 2024-09-12T01:03:43.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.408+0000 7f72f704d9c0 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-12T01:03:43.400 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:03:43.400 INFO:teuthology.orchestra.run.smithi070.stdout: "user_id": "root1.client.0", 2024-09-12T01:03:43.400 INFO:teuthology.orchestra.run.smithi070.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-12T01:03:43.400 INFO:teuthology.orchestra.run.smithi070.stdout: "email": "root1+test@test.test", 2024-09-12T01:03:43.400 INFO:teuthology.orchestra.run.smithi070.stdout: "suspended": 0, 2024-09-12T01:03:43.401 INFO:teuthology.orchestra.run.smithi070.stdout: "max_buckets": 1000, 2024-09-12T01:03:43.401 INFO:teuthology.orchestra.run.smithi070.stdout: "subusers": [], 2024-09-12T01:03:43.401 INFO:teuthology.orchestra.run.smithi070.stdout: "keys": [ 2024-09-12T01:03:43.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:03:43.401 INFO:teuthology.orchestra.run.smithi070.stdout: "user": "root1.client.0", 2024-09-12T01:03:43.401 INFO:teuthology.orchestra.run.smithi070.stdout: "access_key": "FGBEYKYZGQKXYUSWCDBV", 2024-09-12T01:03:43.401 INFO:teuthology.orchestra.run.smithi070.stdout: "secret_key": "4zGKgxOd5mztDpHpzJvTrpN1joxsXZa9HARne2sgNXKU9hQYDwT+PA==", 2024-09-12T01:03:43.402 INFO:teuthology.orchestra.run.smithi070.stdout: "active": true, 2024-09-12T01:03:43.402 INFO:teuthology.orchestra.run.smithi070.stdout: "create_date": "2024-09-12T01:03:43.402167Z" 2024-09-12T01:03:43.402 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:03:43.402 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:03:43.402 INFO:teuthology.orchestra.run.smithi070.stdout: "swift_keys": [], 2024-09-12T01:03:43.402 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": [], 2024-09-12T01:03:43.402 INFO:teuthology.orchestra.run.smithi070.stdout: "op_mask": "read, write, delete", 2024-09-12T01:03:43.402 INFO:teuthology.orchestra.run.smithi070.stdout: "default_placement": "", 2024-09-12T01:03:43.402 INFO:teuthology.orchestra.run.smithi070.stdout: "default_storage_class": "", 2024-09-12T01:03:43.402 INFO:teuthology.orchestra.run.smithi070.stdout: "placement_tags": [], 2024-09-12T01:03:43.402 INFO:teuthology.orchestra.run.smithi070.stdout: "bucket_quota": { 2024-09-12T01:03:43.402 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T01:03:43.402 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T01:03:43.403 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T01:03:43.403 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T01:03:43.403 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T01:03:43.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:03:43.403 INFO:teuthology.orchestra.run.smithi070.stdout: "user_quota": { 2024-09-12T01:03:43.403 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T01:03:43.403 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T01:03:43.403 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T01:03:43.403 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T01:03:43.403 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T01:03:43.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:03:43.403 INFO:teuthology.orchestra.run.smithi070.stdout: "temp_url_keys": [], 2024-09-12T01:03:43.403 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "root", 2024-09-12T01:03:43.404 INFO:teuthology.orchestra.run.smithi070.stdout: "mfa_ids": [], 2024-09-12T01:03:43.404 INFO:teuthology.orchestra.run.smithi070.stdout: "account_id": "RGW88888888888888888", 2024-09-12T01:03:43.404 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2024-09-12T01:03:43.404 INFO:teuthology.orchestra.run.smithi070.stdout: "create_date": "2024-09-12T01:03:43.402155Z", 2024-09-12T01:03:43.404 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:03:43.404 INFO:teuthology.orchestra.run.smithi070.stdout: "group_ids": [] 2024-09-12T01:03:43.404 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:03:43.404 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:43.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.408+0000 7f71aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:43.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.412+0000 7f72f704d9c0 20 remove_watcher() i=0 2024-09-12T01:03:43.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.412+0000 7f72f704d9c0 2 removed watcher, disabling cache 2024-09-12T01:03:43.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.416+0000 7f72f704d9c0 20 remove_watcher() i=1 2024-09-12T01:03:43.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.416+0000 7f72f704d9c0 20 remove_watcher() i=2 2024-09-12T01:03:43.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.420+0000 7f72f704d9c0 20 remove_watcher() i=3 2024-09-12T01:03:43.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.420+0000 7f72f704d9c0 20 remove_watcher() i=4 2024-09-12T01:03:43.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.420+0000 7f72f704d9c0 20 remove_watcher() i=5 2024-09-12T01:03:43.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.424+0000 7f72f704d9c0 20 remove_watcher() i=6 2024-09-12T01:03:43.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.424+0000 7f72f704d9c0 20 remove_watcher() i=7 2024-09-12T01:03:43.427 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 0311357191 --totp-seed CE375CAIMBYBQQJ2PZOC3T6JPXWQJY3O6IL2WOCUQPF5DZRO35PMO4J6LIXES3CY --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:03:43.462 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:03:43.462 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:03:43.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.504+0000 7f8e721a19c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.504+0000 7f8e721a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.504+0000 7f8e721a19c0 20 realm 2024-09-12T01:03:43.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.504+0000 7f8e721a19c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.508+0000 7f8e721a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.508+0000 7f8e721a19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:03:43.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.508+0000 7f8e721a19c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.508+0000 7f8e721a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.508+0000 7f8e721a19c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.508+0000 7f8e721a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:43.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.508+0000 7f8e721a19c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.508+0000 7f8e721a19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:03:43.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.508+0000 7f8e721a19c0 20 searching for the correct realm 2024-09-12T01:03:43.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.512+0000 7f8e6fca7640 0 -- 172.21.15.70:0/2432726906 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f8e600c9040 msgr2=0x7f8e600ac550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:43.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.520+0000 7f8e6fca7640 0 -- 172.21.15.70:0/2432726906 >> [v2:172.21.15.187:6816/2182256562,v1:172.21.15.187:6817/2182256562] conn(0x7f8e600b9960 msgr2=0x7f8e600ca430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:43.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.528+0000 7f8e721a19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:03:43.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.528+0000 7f8e721a19c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:03:43.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.528+0000 7f8e721a19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:03:43.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.528+0000 7f8e721a19c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:03:43.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.528+0000 7f8e721a19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:03:43.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.528+0000 7f8e721a19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:03:43.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.528+0000 7f8e721a19c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.528+0000 7f8e721a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.528+0000 7f8e721a19c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.528+0000 7f8e721a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:43.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.528+0000 7f8e721a19c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.528+0000 7f8e721a19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:03:43.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.528+0000 7f8e721a19c0 20 zone default found 2024-09-12T01:03:43.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.528+0000 7f8e721a19c0 4 Realm: () 2024-09-12T01:03:43.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.528+0000 7f8e721a19c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:03:43.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.528+0000 7f8e721a19c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:03:43.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.528+0000 7f8e721a19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:03:43.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.528+0000 7f8e721a19c0 20 zonegroup default 2024-09-12T01:03:43.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.528+0000 7f8e721a19c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.528+0000 7f8e721a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.528+0000 7f8e721a19c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.528+0000 7f8e721a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.528+0000 7f8e721a19c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.528+0000 7f8e721a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.528+0000 7f8e721a19c0 20 started sync module instance, tier type = 2024-09-12T01:03:43.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.528+0000 7f8e721a19c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:03:43.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.544+0000 7f8e721a19c0 20 add_watcher() i=0 2024-09-12T01:03:43.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.544+0000 7f8e721a19c0 20 add_watcher() i=1 2024-09-12T01:03:43.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.544+0000 7f8e721a19c0 20 add_watcher() i=2 2024-09-12T01:03:43.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.544+0000 7f8e721a19c0 20 add_watcher() i=3 2024-09-12T01:03:43.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.544+0000 7f8e721a19c0 20 add_watcher() i=4 2024-09-12T01:03:43.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.544+0000 7f8e721a19c0 20 add_watcher() i=5 2024-09-12T01:03:43.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.544+0000 7f8e721a19c0 20 add_watcher() i=6 2024-09-12T01:03:43.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.544+0000 7f8e721a19c0 20 add_watcher() i=7 2024-09-12T01:03:43.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.544+0000 7f8e721a19c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:03:43.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.548+0000 7f8d25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:43.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.548+0000 7f8e721a19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:03:43.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.548+0000 7f8e721a19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:03:43.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.548+0000 7f8e721a19c0 5 note: GC not initialized 2024-09-12T01:03:43.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.548+0000 7f8d24fe1640 20 reqs_thread_entry: start 2024-09-12T01:03:43.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.548+0000 7f8e721a19c0 20 init_complete bucket index max shards: 1 2024-09-12T01:03:43.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.548+0000 7f8e721a19c0 20 Filter name: none 2024-09-12T01:03:43.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.548+0000 7f8c9e7fc640 20 reqs_thread_entry: start 2024-09-12T01:03:43.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.548+0000 7f8e721a19c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T01:03:43.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.548+0000 7f8e721a19c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.548+0000 7f8e721a19c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T01:03:43.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.548+0000 7f8e721a19c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-12T01:03:43.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.548+0000 7f8e721a19c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:03:43.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.548+0000 7f8e721a19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:03:43.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.552+0000 7f8e721a19c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T01:03:43.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.552+0000 7f8e721a19c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:03:43.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.552+0000 7f8e721a19c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T01:03:43.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.552+0000 7f8d4effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333584 cookie 94436613990016 notifier 9312 bl.length()=695 2024-09-12T01:03:43.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.552+0000 7f8d4effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T01:03:43.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.552+0000 7f8d4effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:03:43.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.552+0000 7f8d25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:43.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.556+0000 7f8e721a19c0 20 remove_watcher() i=0 2024-09-12T01:03:43.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.556+0000 7f8e721a19c0 2 removed watcher, disabling cache 2024-09-12T01:03:43.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.560+0000 7f8e721a19c0 20 remove_watcher() i=1 2024-09-12T01:03:43.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.560+0000 7f8e721a19c0 20 remove_watcher() i=2 2024-09-12T01:03:43.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.564+0000 7f8e721a19c0 20 remove_watcher() i=3 2024-09-12T01:03:43.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.564+0000 7f8e721a19c0 20 remove_watcher() i=4 2024-09-12T01:03:43.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.568+0000 7f8e721a19c0 20 remove_watcher() i=5 2024-09-12T01:03:43.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.568+0000 7f8e721a19c0 20 remove_watcher() i=6 2024-09-12T01:03:43.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.568+0000 7f8e721a19c0 20 remove_watcher() i=7 2024-09-12T01:03:43.572 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-12T01:03:43.650 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:03:43.650 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:03:43.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.896+0000 7f6eca9209c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.900+0000 7f6eca9209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.900+0000 7f6eca9209c0 20 realm 2024-09-12T01:03:43.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.900+0000 7f6eca9209c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.900+0000 7f6eca9209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.900+0000 7f6eca9209c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:03:43.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.900+0000 7f6eca9209c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.900+0000 7f6eca9209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:43.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.900+0000 7f6eca9209c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.900+0000 7f6eca9209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:43.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.900+0000 7f6eca9209c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:43.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.900+0000 7f6eca9209c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:03:43.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.900+0000 7f6eca9209c0 20 searching for the correct realm 2024-09-12T01:03:43.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:43.904+0000 7f6ec7c25640 0 -- 172.21.15.70:0/2010546837 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7f6ec002a060 msgr2=0x7f6ec00a0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:44.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.120+0000 7f6ec8426640 0 -- 172.21.15.70:0/2010546837 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f6eb0003cc0 msgr2=0x7f6ebc01e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:44.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.132+0000 7f6eca9209c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:03:44.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.132+0000 7f6eca9209c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:03:44.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.132+0000 7f6eca9209c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:03:44.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.132+0000 7f6eca9209c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:03:44.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.132+0000 7f6eca9209c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:03:44.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.132+0000 7f6eca9209c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:03:44.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.132+0000 7f6eca9209c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.132+0000 7f6eca9209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:44.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.132+0000 7f6eca9209c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.136+0000 7f6eca9209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:44.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.136+0000 7f6eca9209c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.136+0000 7f6eca9209c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:03:44.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.136+0000 7f6eca9209c0 20 zone default found 2024-09-12T01:03:44.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.136+0000 7f6eca9209c0 4 Realm: () 2024-09-12T01:03:44.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.136+0000 7f6eca9209c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:03:44.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.136+0000 7f6eca9209c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:03:44.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.136+0000 7f6eca9209c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:03:44.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.136+0000 7f6eca9209c0 20 zonegroup default 2024-09-12T01:03:44.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.136+0000 7f6eca9209c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.136+0000 7f6eca9209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:44.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.136+0000 7f6eca9209c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.136+0000 7f6eca9209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:44.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.136+0000 7f6eca9209c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.140+0000 7f6eca9209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:44.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.140+0000 7f6eca9209c0 20 started sync module instance, tier type = 2024-09-12T01:03:44.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.140+0000 7f6eca9209c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:03:44.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.160+0000 7f6eca9209c0 20 add_watcher() i=0 2024-09-12T01:03:44.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.160+0000 7f6eca9209c0 20 add_watcher() i=1 2024-09-12T01:03:44.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.160+0000 7f6eca9209c0 20 add_watcher() i=2 2024-09-12T01:03:44.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.160+0000 7f6eca9209c0 20 add_watcher() i=3 2024-09-12T01:03:44.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.160+0000 7f6eca9209c0 20 add_watcher() i=4 2024-09-12T01:03:44.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.160+0000 7f6eca9209c0 20 add_watcher() i=5 2024-09-12T01:03:44.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.164+0000 7f6eca9209c0 20 add_watcher() i=6 2024-09-12T01:03:44.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.164+0000 7f6eca9209c0 20 add_watcher() i=7 2024-09-12T01:03:44.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.164+0000 7f6eca9209c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:03:44.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.168+0000 7f6d7efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:44.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.168+0000 7f6eca9209c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:03:44.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.168+0000 7f6eca9209c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:03:44.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.168+0000 7f6eca9209c0 5 note: GC not initialized 2024-09-12T01:03:44.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.168+0000 7f6d7dfdb640 20 reqs_thread_entry: start 2024-09-12T01:03:44.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.168+0000 7f6eca9209c0 20 init_complete bucket index max shards: 1 2024-09-12T01:03:44.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.168+0000 7f6eca9209c0 20 Filter name: none 2024-09-12T01:03:44.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.168+0000 7f6cef7fe640 20 reqs_thread_entry: start 2024-09-12T01:03:44.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.168+0000 7f6eca9209c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-12T01:03:44.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.168+0000 7f6eca9209c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.168+0000 7f6eca9209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:44.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.168+0000 7f6eca9209c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-12T01:03:44.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.168+0000 7f6eca9209c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T01:03:44.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.168+0000 7f6eca9209c0 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-12T01:03:44.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.168+0000 7f6eca9209c0 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-12T01:03:44.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.168+0000 7f6eca9209c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.172+0000 7f6eca9209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:44.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.172+0000 7f6eca9209c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-12T01:03:44.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.172+0000 7f6eca9209c0 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T01:03:44.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.172+0000 7f6eca9209c0 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-12T01:03:44.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.176+0000 7f6eca9209c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T01:03:44.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.176+0000 7f6eca9209c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T01:03:44.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.176+0000 7f6eca9209c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-12T01:03:44.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.176+0000 7f6d9f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333585 cookie 94592950713248 notifier 9330 bl.length()=384 2024-09-12T01:03:44.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.176+0000 7f6d9f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T01:03:44.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.176+0000 7f6d9f7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T01:03:44.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.180+0000 7f6eca9209c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T01:03:44.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.180+0000 7f6eca9209c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T01:03:44.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.180+0000 7f6eca9209c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-12T01:03:44.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.180+0000 7f6d9effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333637 cookie 94592950727792 notifier 9330 bl.length()=225 2024-09-12T01:03:44.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.180+0000 7f6d9effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T01:03:44.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.180+0000 7f6d9effd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T01:03:44.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.184+0000 7f6eca9209c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T01:03:44.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.184+0000 7f6eca9209c0 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T01:03:44.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.184+0000 7f6eca9209c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-12T01:03:44.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.184+0000 7f6d9effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333588 cookie 94592950723168 notifier 9330 bl.length()=234 2024-09-12T01:03:44.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.184+0000 7f6d9effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T01:03:44.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.184+0000 7f6d9effd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T01:03:44.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.188+0000 7f6d7efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:44.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.192+0000 7f6eca9209c0 20 remove_watcher() i=0 2024-09-12T01:03:44.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.192+0000 7f6eca9209c0 2 removed watcher, disabling cache 2024-09-12T01:03:44.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.192+0000 7f6eca9209c0 20 remove_watcher() i=1 2024-09-12T01:03:44.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.196+0000 7f6eca9209c0 20 remove_watcher() i=2 2024-09-12T01:03:44.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.196+0000 7f6eca9209c0 20 remove_watcher() i=3 2024-09-12T01:03:44.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.200+0000 7f6eca9209c0 20 remove_watcher() i=4 2024-09-12T01:03:44.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.200+0000 7f6eca9209c0 20 remove_watcher() i=5 2024-09-12T01:03:44.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.204+0000 7f6eca9209c0 20 remove_watcher() i=6 2024-09-12T01:03:44.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.204+0000 7f6eca9209c0 20 remove_watcher() i=7 2024-09-12T01:03:44.209 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:03:44.209 INFO:teuthology.orchestra.run.smithi070.stdout: "id": "RGW99999999999999999", 2024-09-12T01:03:44.209 INFO:teuthology.orchestra.run.smithi070.stdout: "tenant": "", 2024-09-12T01:03:44.209 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "Mr.RGW99999999999999999", 2024-09-12T01:03:44.210 INFO:teuthology.orchestra.run.smithi070.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-12T01:03:44.210 INFO:teuthology.orchestra.run.smithi070.stdout: "quota": { 2024-09-12T01:03:44.210 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T01:03:44.210 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T01:03:44.210 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T01:03:44.210 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T01:03:44.210 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T01:03:44.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:03:44.210 INFO:teuthology.orchestra.run.smithi070.stdout: "bucket_quota": { 2024-09-12T01:03:44.210 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T01:03:44.210 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T01:03:44.210 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T01:03:44.210 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T01:03:44.210 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T01:03:44.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:03:44.211 INFO:teuthology.orchestra.run.smithi070.stdout: "max_users": 1000, 2024-09-12T01:03:44.211 INFO:teuthology.orchestra.run.smithi070.stdout: "max_roles": 1000, 2024-09-12T01:03:44.211 INFO:teuthology.orchestra.run.smithi070.stdout: "max_groups": 1000, 2024-09-12T01:03:44.211 INFO:teuthology.orchestra.run.smithi070.stdout: "max_buckets": 1000, 2024-09-12T01:03:44.211 INFO:teuthology.orchestra.run.smithi070.stdout: "max_access_keys": 4 2024-09-12T01:03:44.211 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:03:44.212 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-12T01:03:44.213 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key UIOHMBNWTPKEGDEHUFAA --secret Jo++RFzsxLdNSxp7iyXSEFHZq8yirzqBnSKO2JAFbYwNvj44SV5Eyw== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-12T01:03:44.302 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:03:44.302 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:03:44.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.548+0000 7fdccd3be640 0 --2- 172.21.15.70:0/313038856 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x556ddffd8690 0x556ddffd8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T01:03:44.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.560+0000 7fdcd00b99c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.564+0000 7fdcd00b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:44.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.564+0000 7fdcd00b99c0 20 realm 2024-09-12T01:03:44.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.564+0000 7fdcd00b99c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.564+0000 7fdcd00b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:44.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.564+0000 7fdcd00b99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:03:44.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.564+0000 7fdcd00b99c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.564+0000 7fdcd00b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:44.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.564+0000 7fdcd00b99c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.564+0000 7fdcd00b99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:44.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.564+0000 7fdcd00b99c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.564+0000 7fdcd00b99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:03:44.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.564+0000 7fdcd00b99c0 20 searching for the correct realm 2024-09-12T01:03:44.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.568+0000 7fdccd3be640 0 -- 172.21.15.70:0/2167335812 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7fdcc806db90 msgr2=0x7fdcc80669f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:44.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.780+0000 7fdccdbbf640 0 -- 172.21.15.70:0/2167335812 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7fdcc0018040 msgr2=0x7fdcc005fd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:44.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.796+0000 7fdcd00b99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:03:44.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.796+0000 7fdcd00b99c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:03:44.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.796+0000 7fdcd00b99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:03:44.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.796+0000 7fdcd00b99c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:03:44.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.796+0000 7fdcd00b99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:03:44.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.796+0000 7fdcd00b99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:03:44.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.796+0000 7fdcd00b99c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.796+0000 7fdcd00b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:44.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.796+0000 7fdcd00b99c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.800+0000 7fdcd00b99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:44.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.800+0000 7fdcd00b99c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.800+0000 7fdcd00b99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:03:44.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.800+0000 7fdcd00b99c0 20 zone default found 2024-09-12T01:03:44.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.800+0000 7fdcd00b99c0 4 Realm: () 2024-09-12T01:03:44.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.800+0000 7fdcd00b99c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:03:44.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.800+0000 7fdcd00b99c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:03:44.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.800+0000 7fdcd00b99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:03:44.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.800+0000 7fdcd00b99c0 20 zonegroup default 2024-09-12T01:03:44.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.800+0000 7fdcd00b99c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.800+0000 7fdcd00b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:44.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.800+0000 7fdcd00b99c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.800+0000 7fdcd00b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:44.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.800+0000 7fdcd00b99c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.800+0000 7fdcd00b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:44.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.800+0000 7fdcd00b99c0 20 started sync module instance, tier type = 2024-09-12T01:03:44.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.800+0000 7fdcd00b99c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:03:44.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.824+0000 7fdcd00b99c0 20 add_watcher() i=0 2024-09-12T01:03:44.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.824+0000 7fdcd00b99c0 20 add_watcher() i=1 2024-09-12T01:03:44.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.824+0000 7fdcd00b99c0 20 add_watcher() i=2 2024-09-12T01:03:44.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.824+0000 7fdcd00b99c0 20 add_watcher() i=3 2024-09-12T01:03:44.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.824+0000 7fdcd00b99c0 20 add_watcher() i=4 2024-09-12T01:03:44.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.824+0000 7fdcd00b99c0 20 add_watcher() i=5 2024-09-12T01:03:44.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.824+0000 7fdcd00b99c0 20 add_watcher() i=6 2024-09-12T01:03:44.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.828+0000 7fdcd00b99c0 20 add_watcher() i=7 2024-09-12T01:03:44.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.828+0000 7fdcd00b99c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:03:44.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.832+0000 7fdb83fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:44.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.832+0000 7fdcd00b99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:03:44.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.832+0000 7fdcd00b99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:03:44.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.832+0000 7fdcd00b99c0 5 note: GC not initialized 2024-09-12T01:03:44.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.832+0000 7fdb82fe5640 20 reqs_thread_entry: start 2024-09-12T01:03:44.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.832+0000 7fdcd00b99c0 20 init_complete bucket index max shards: 1 2024-09-12T01:03:44.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.832+0000 7fdcd00b99c0 20 Filter name: none 2024-09-12T01:03:44.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.832+0000 7fdcd00b99c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T01:03:44.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.832+0000 7fdcd00b99c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.832+0000 7fdb80fe1640 20 reqs_thread_entry: start 2024-09-12T01:03:44.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.832+0000 7fdcd00b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:44.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.832+0000 7fdcd00b99c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-12T01:03:44.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.832+0000 7fdcd00b99c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:03:44.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.832+0000 7fdcd00b99c0 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-12T01:03:44.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.832+0000 7fdcd00b99c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.832+0000 7fdcd00b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:44.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.832+0000 7fdcd00b99c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-12T01:03:44.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.832+0000 7fdcd00b99c0 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T01:03:44.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.832+0000 7fdcd00b99c0 10 cache get: name=default.rgw.meta+users.keys+UIOHMBNWTPKEGDEHUFAA : miss 2024-09-12T01:03:44.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.832+0000 7fdcd00b99c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.832+0000 7fdcd00b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:44.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.832+0000 7fdcd00b99c0 10 cache put: name=default.rgw.meta+users.keys+UIOHMBNWTPKEGDEHUFAA info.flags=0x0 2024-09-12T01:03:44.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.832+0000 7fdcd00b99c0 10 adding default.rgw.meta+users.keys+UIOHMBNWTPKEGDEHUFAA to cache LRU end 2024-09-12T01:03:44.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.832+0000 7fdcd00b99c0 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-12T01:03:44.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.832+0000 7fdcd00b99c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.836+0000 7fdcd00b99c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T01:03:44.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.836+0000 7fdcd00b99c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T01:03:44.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.836+0000 7fdcd00b99c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T01:03:44.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.836+0000 7fdcd00b99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:03:44.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.836+0000 7fdcd00b99c0 10 cache get: name=default.rgw.meta+users.keys+UIOHMBNWTPKEGDEHUFAA : hit (negative entry) 2024-09-12T01:03:44.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.836+0000 7fdcd00b99c0 10 cache get: name=default.rgw.meta+users.keys+UIOHMBNWTPKEGDEHUFAA : hit (negative entry) 2024-09-12T01:03:44.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.836+0000 7fdcd00b99c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T01:03:44.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.836+0000 7fdcd00b99c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:03:44.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.836+0000 7fdcd00b99c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T01:03:44.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.840+0000 7fdbb17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333586 cookie 93930397944848 notifier 9351 bl.length()=681 2024-09-12T01:03:44.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.840+0000 7fdbb17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T01:03:44.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.840+0000 7fdbb17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:03:44.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.844+0000 7fdcd00b99c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T01:03:44.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.844+0000 7fdcd00b99c0 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T01:03:44.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.844+0000 7fdcd00b99c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-12T01:03:44.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.844+0000 7fdbb0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333630 cookie 93930397956400 notifier 9351 bl.length()=189 2024-09-12T01:03:44.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.844+0000 7fdbb0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T01:03:44.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.844+0000 7fdbb0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T01:03:44.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.844+0000 7fdcd00b99c0 10 cache put: name=default.rgw.meta+users.keys+UIOHMBNWTPKEGDEHUFAA info.flags=0x7 2024-09-12T01:03:44.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.844+0000 7fdcd00b99c0 10 moving default.rgw.meta+users.keys+UIOHMBNWTPKEGDEHUFAA to cache LRU end 2024-09-12T01:03:44.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.844+0000 7fdcd00b99c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:UIOHMBNWTPKEGDEHUFAA, ofs0, ns] 2024-09-12T01:03:44.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.844+0000 7fdbb0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333631 cookie 93930397958528 notifier 9351 bl.length()=188 2024-09-12T01:03:44.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.844+0000 7fdbb0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+UIOHMBNWTPKEGDEHUFAA info.flags=0x7 2024-09-12T01:03:44.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.848+0000 7fdbb0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+UIOHMBNWTPKEGDEHUFAA to cache LRU end 2024-09-12T01:03:44.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.848+0000 7fdcd00b99c0 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-12T01:03:44.842 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:03:44.842 INFO:teuthology.orchestra.run.smithi070.stdout: "user_id": "root2.client.0", 2024-09-12T01:03:44.842 INFO:teuthology.orchestra.run.smithi070.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-12T01:03:44.843 INFO:teuthology.orchestra.run.smithi070.stdout: "email": "root2+test@test.test", 2024-09-12T01:03:44.843 INFO:teuthology.orchestra.run.smithi070.stdout: "suspended": 0, 2024-09-12T01:03:44.843 INFO:teuthology.orchestra.run.smithi070.stdout: "max_buckets": 1000, 2024-09-12T01:03:44.843 INFO:teuthology.orchestra.run.smithi070.stdout: "subusers": [], 2024-09-12T01:03:44.843 INFO:teuthology.orchestra.run.smithi070.stdout: "keys": [ 2024-09-12T01:03:44.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:03:44.843 INFO:teuthology.orchestra.run.smithi070.stdout: "user": "root2.client.0", 2024-09-12T01:03:44.843 INFO:teuthology.orchestra.run.smithi070.stdout: "access_key": "UIOHMBNWTPKEGDEHUFAA", 2024-09-12T01:03:44.843 INFO:teuthology.orchestra.run.smithi070.stdout: "secret_key": "Jo++RFzsxLdNSxp7iyXSEFHZq8yirzqBnSKO2JAFbYwNvj44SV5Eyw==", 2024-09-12T01:03:44.843 INFO:teuthology.orchestra.run.smithi070.stdout: "active": true, 2024-09-12T01:03:44.844 INFO:teuthology.orchestra.run.smithi070.stdout: "create_date": "2024-09-12T01:03:44.839858Z" 2024-09-12T01:03:44.844 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:03:44.844 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:03:44.844 INFO:teuthology.orchestra.run.smithi070.stdout: "swift_keys": [], 2024-09-12T01:03:44.844 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": [], 2024-09-12T01:03:44.844 INFO:teuthology.orchestra.run.smithi070.stdout: "op_mask": "read, write, delete", 2024-09-12T01:03:44.844 INFO:teuthology.orchestra.run.smithi070.stdout: "default_placement": "", 2024-09-12T01:03:44.844 INFO:teuthology.orchestra.run.smithi070.stdout: "default_storage_class": "", 2024-09-12T01:03:44.844 INFO:teuthology.orchestra.run.smithi070.stdout: "placement_tags": [], 2024-09-12T01:03:44.844 INFO:teuthology.orchestra.run.smithi070.stdout: "bucket_quota": { 2024-09-12T01:03:44.844 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T01:03:44.844 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T01:03:44.844 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T01:03:44.844 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T01:03:44.845 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T01:03:44.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:03:44.845 INFO:teuthology.orchestra.run.smithi070.stdout: "user_quota": { 2024-09-12T01:03:44.845 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": false, 2024-09-12T01:03:44.845 INFO:teuthology.orchestra.run.smithi070.stdout: "check_on_raw": false, 2024-09-12T01:03:44.845 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size": -1, 2024-09-12T01:03:44.845 INFO:teuthology.orchestra.run.smithi070.stdout: "max_size_kb": 0, 2024-09-12T01:03:44.845 INFO:teuthology.orchestra.run.smithi070.stdout: "max_objects": -1 2024-09-12T01:03:44.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:03:44.845 INFO:teuthology.orchestra.run.smithi070.stdout: "temp_url_keys": [], 2024-09-12T01:03:44.845 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "root", 2024-09-12T01:03:44.845 INFO:teuthology.orchestra.run.smithi070.stdout: "mfa_ids": [], 2024-09-12T01:03:44.845 INFO:teuthology.orchestra.run.smithi070.stdout: "account_id": "RGW99999999999999999", 2024-09-12T01:03:44.846 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2024-09-12T01:03:44.846 INFO:teuthology.orchestra.run.smithi070.stdout: "create_date": "2024-09-12T01:03:44.839825Z", 2024-09-12T01:03:44.846 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:03:44.846 INFO:teuthology.orchestra.run.smithi070.stdout: "group_ids": [] 2024-09-12T01:03:44.846 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:03:44.846 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:03:44.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.852+0000 7fdb83fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:44.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.856+0000 7fdcd00b99c0 20 remove_watcher() i=0 2024-09-12T01:03:44.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.856+0000 7fdcd00b99c0 2 removed watcher, disabling cache 2024-09-12T01:03:44.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.860+0000 7fdcd00b99c0 20 remove_watcher() i=1 2024-09-12T01:03:44.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.860+0000 7fdcd00b99c0 20 remove_watcher() i=2 2024-09-12T01:03:44.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.864+0000 7fdcd00b99c0 20 remove_watcher() i=3 2024-09-12T01:03:44.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.864+0000 7fdcd00b99c0 20 remove_watcher() i=4 2024-09-12T01:03:44.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.864+0000 7fdcd00b99c0 20 remove_watcher() i=5 2024-09-12T01:03:44.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.868+0000 7fdcd00b99c0 20 remove_watcher() i=6 2024-09-12T01:03:44.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.868+0000 7fdcd00b99c0 20 remove_watcher() i=7 2024-09-12T01:03:44.878 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 4604823300 --totp-seed 4T4UFPPPYHIVVKAD4YU3H422BSLAL5KQODTMGXT6PPSWBMPB22KLMYAVATIWAFTY --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:03:44.923 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:03:44.923 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:03:44.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.972+0000 7fd62645f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.972+0000 7fd62645f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:44.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.972+0000 7fd62645f9c0 20 realm 2024-09-12T01:03:44.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.972+0000 7fd62645f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.972+0000 7fd62645f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:44.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.972+0000 7fd62645f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:03:44.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.972+0000 7fd62645f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.972+0000 7fd62645f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:44.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.972+0000 7fd62645f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.976+0000 7fd62645f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:44.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.976+0000 7fd62645f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:44.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.976+0000 7fd62645f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:03:44.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.976+0000 7fd62645f9c0 20 searching for the correct realm 2024-09-12T01:03:44.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:44.980+0000 7fd624766640 0 -- 172.21.15.70:0/3458380149 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fd618008040 msgr2=0x7fd618081040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:03:45.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.196+0000 7fd624766640 0 -- 172.21.15.70:0/3458380149 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7fd618008040 msgr2=0x7fd618081040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:03:45.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.208+0000 7fd62645f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:03:45.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.208+0000 7fd62645f9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:03:45.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.208+0000 7fd62645f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:03:45.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.208+0000 7fd62645f9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:03:45.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.208+0000 7fd62645f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:03:45.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.208+0000 7fd62645f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:03:45.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.208+0000 7fd62645f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:45.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.208+0000 7fd62645f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:45.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.208+0000 7fd62645f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:45.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.208+0000 7fd62645f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:03:45.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.208+0000 7fd62645f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:45.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.212+0000 7fd62645f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:03:45.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.212+0000 7fd62645f9c0 20 zone default found 2024-09-12T01:03:45.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.212+0000 7fd62645f9c0 4 Realm: () 2024-09-12T01:03:45.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.212+0000 7fd62645f9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:03:45.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.212+0000 7fd62645f9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:03:45.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.212+0000 7fd62645f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:03:45.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.212+0000 7fd62645f9c0 20 zonegroup default 2024-09-12T01:03:45.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.212+0000 7fd62645f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:45.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.212+0000 7fd62645f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:45.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.212+0000 7fd62645f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:45.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.212+0000 7fd62645f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:45.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.212+0000 7fd62645f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:45.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.216+0000 7fd62645f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:03:45.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.216+0000 7fd62645f9c0 20 started sync module instance, tier type = 2024-09-12T01:03:45.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.216+0000 7fd62645f9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:03:45.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.236+0000 7fd62645f9c0 20 add_watcher() i=0 2024-09-12T01:03:45.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.236+0000 7fd62645f9c0 20 add_watcher() i=1 2024-09-12T01:03:45.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.236+0000 7fd62645f9c0 20 add_watcher() i=2 2024-09-12T01:03:45.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.236+0000 7fd62645f9c0 20 add_watcher() i=3 2024-09-12T01:03:45.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.236+0000 7fd62645f9c0 20 add_watcher() i=4 2024-09-12T01:03:45.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.236+0000 7fd62645f9c0 20 add_watcher() i=5 2024-09-12T01:03:45.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.236+0000 7fd62645f9c0 20 add_watcher() i=6 2024-09-12T01:03:45.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.240+0000 7fd62645f9c0 20 add_watcher() i=7 2024-09-12T01:03:45.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.240+0000 7fd62645f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:03:45.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.244+0000 7fd4d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:45.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.244+0000 7fd62645f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:03:45.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.244+0000 7fd62645f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:03:45.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.244+0000 7fd62645f9c0 5 note: GC not initialized 2024-09-12T01:03:45.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.244+0000 7fd4d8fe1640 20 reqs_thread_entry: start 2024-09-12T01:03:45.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.244+0000 7fd62645f9c0 20 init_complete bucket index max shards: 1 2024-09-12T01:03:45.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.244+0000 7fd62645f9c0 20 Filter name: none 2024-09-12T01:03:45.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.244+0000 7fd4527fc640 20 reqs_thread_entry: start 2024-09-12T01:03:45.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.244+0000 7fd62645f9c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T01:03:45.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.244+0000 7fd62645f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:03:45.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.244+0000 7fd62645f9c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T01:03:45.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.244+0000 7fd62645f9c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-12T01:03:45.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.244+0000 7fd62645f9c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:03:45.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.244+0000 7fd62645f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:03:45.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.252+0000 7fd62645f9c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T01:03:45.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.252+0000 7fd62645f9c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:03:45.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.252+0000 7fd62645f9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T01:03:45.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.252+0000 7fd502ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333587 cookie 94332001136000 notifier 9369 bl.length()=695 2024-09-12T01:03:45.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.252+0000 7fd502ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T01:03:45.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.252+0000 7fd502ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:03:45.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.252+0000 7fd4d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:03:45.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.260+0000 7fd62645f9c0 20 remove_watcher() i=0 2024-09-12T01:03:45.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.260+0000 7fd62645f9c0 2 removed watcher, disabling cache 2024-09-12T01:03:45.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.264+0000 7fd62645f9c0 20 remove_watcher() i=1 2024-09-12T01:03:45.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.264+0000 7fd62645f9c0 20 remove_watcher() i=2 2024-09-12T01:03:45.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.268+0000 7fd62645f9c0 20 remove_watcher() i=3 2024-09-12T01:03:45.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.268+0000 7fd62645f9c0 20 remove_watcher() i=4 2024-09-12T01:03:45.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.272+0000 7fd62645f9c0 20 remove_watcher() i=5 2024-09-12T01:03:45.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.276+0000 7fd62645f9c0 20 remove_watcher() i=6 2024-09-12T01:03:45.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:03:45.276+0000 7fd62645f9c0 20 remove_watcher() i=7 2024-09-12T01:03:45.285 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-12T01:03:45.286 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T01:03:45.286 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-12T01:03:45.292 INFO:tasks.s3tests:Configuring boto... 2024-09-12T01:03:45.293 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T01:03:45.293 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T01:03:45.339 DEBUG:teuthology.orchestra.run.smithi070:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T01:03:45.514 INFO:teuthology.orchestra.run.smithi070.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-12T01:03:45.707 INFO:teuthology.orchestra.run.smithi070.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-12T01:03:46.023 INFO:teuthology.orchestra.run.smithi070.stdout:py installdeps: -rrequirements.txt 2024-09-12T01:05:46.431 INFO:teuthology.orchestra.run.smithi070.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-12T01:05:48.243 INFO:teuthology.orchestra.run.smithi070.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.8,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.2,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=ba97ab1807a5821386288086741a176a49917d28c6c0f8adfd0a58cb9a2fb4af,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-12T01:05:48.244 INFO:teuthology.orchestra.run.smithi070.stdout:py run-test-pre: PYTHONHASHSEED='862719369' 2024-09-12T01:05:48.244 INFO:teuthology.orchestra.run.smithi070.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T01:05:48.428 INFO:teuthology.orchestra.run.smithi070.stdout:============================= test session starts ============================== 2024-09-12T01:05:48.429 INFO:teuthology.orchestra.run.smithi070.stdout:platform linux -- Python 3.10.6, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-12T01:05:48.429 INFO:teuthology.orchestra.run.smithi070.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T01:05:48.429 INFO:teuthology.orchestra.run.smithi070.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T01:05:48.429 INFO:teuthology.orchestra.run.smithi070.stdout:configfile: pytest.ini 2024-09-12T01:05:50.235 INFO:teuthology.orchestra.run.smithi070.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-12T01:05:50.235 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:05:50.602 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-12T01:05:50.813 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-12T01:05:51.028 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-12T01:05:51.242 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-12T01:05:51.456 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-12T01:05:51.612 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-12T01:05:51.837 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-12T01:05:51.995 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-12T01:05:52.097 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-12T01:05:52.193 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-12T01:05:52.402 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-12T01:05:52.615 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-12T01:05:52.830 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-12T01:05:53.046 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-12T01:05:53.145 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-12T01:05:53.241 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-12T01:05:53.297 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-12T01:05:53.353 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-12T01:05:53.410 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-12T01:05:53.465 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-12T01:05:53.522 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-12T01:05:53.577 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-12T01:05:53.633 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T01:05:53.689 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T01:05:53.749 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T01:05:53.805 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T01:05:53.861 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-12T01:05:53.917 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-12T01:05:53.973 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-12T01:05:54.029 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-12T01:05:54.085 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T01:05:54.141 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T01:05:54.198 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T01:05:54.253 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T01:05:54.309 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T01:05:54.365 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T01:05:54.421 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-12T01:05:54.481 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-12T01:05:54.537 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-12T01:05:54.593 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-12T01:05:54.649 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-12T01:05:54.705 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T01:05:54.761 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T01:05:54.817 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-12T01:05:54.873 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-12T01:05:54.929 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-12T01:05:54.985 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-12T01:05:55.041 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T01:05:55.101 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T01:05:55.157 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T01:05:55.213 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T01:05:55.269 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-12T01:05:55.325 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-12T01:05:55.821 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-12T01:05:56.779 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-12T01:05:58.486 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-12T01:06:00.094 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-12T01:06:02.725 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-12T01:06:03.594 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-12T01:06:04.673 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-12T01:06:05.115 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-12T01:06:05.298 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-12T01:06:05.609 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-12T01:06:05.915 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-12T01:06:06.326 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-12T01:06:06.578 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-12T01:06:06.847 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-12T01:06:06.849 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T01:06:06.852 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T01:06:06.854 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-12T01:06:06.861 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-12T01:06:06.863 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T01:06:06.865 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T01:06:06.867 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-12T01:06:06.869 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-12T01:06:06.872 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T01:06:06.876 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T01:06:06.876 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T01:06:06.879 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-12T01:06:06.881 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T01:06:06.883 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T01:06:06.885 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T01:06:06.887 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T01:06:06.889 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T01:06:06.891 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T01:06:06.893 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T01:06:06.895 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-12T01:06:06.897 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-12T01:06:06.898 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-12T01:06:06.900 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-12T01:06:06.902 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-12T01:06:06.903 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-12T01:06:06.905 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-12T01:06:06.907 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-12T01:06:07.009 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-12T01:06:07.018 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-12T01:06:07.840 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-12T01:06:13.317 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-12T01:06:13.796 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-12T01:06:14.401 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-12T01:06:15.049 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-12T01:06:15.665 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-12T01:06:16.337 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-12T01:06:16.917 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-12T01:06:17.653 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-12T01:06:18.265 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-12T01:06:18.897 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-12T01:06:19.453 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-12T01:06:19.957 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-12T01:06:20.433 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-12T01:06:20.785 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-12T01:06:21.329 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-12T01:06:21.961 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-12T01:06:22.669 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-12T01:06:23.217 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-12T01:06:23.777 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-12T01:06:24.305 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-12T01:06:24.841 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-12T01:06:25.369 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-12T01:06:25.821 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-12T01:06:26.309 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-12T01:06:26.701 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-12T01:06:27.173 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-12T01:06:27.569 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-12T01:06:27.993 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-12T01:06:28.397 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-12T01:06:29.033 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-12T01:06:29.457 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-12T01:06:29.873 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-12T01:06:30.389 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-12T01:06:30.941 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-12T01:06:31.413 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-12T01:06:31.933 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-12T01:06:32.469 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-12T01:06:33.097 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T01:06:33.553 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-12T01:06:34.109 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-12T01:06:34.629 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-12T01:06:35.377 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T01:06:35.985 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T01:06:36.625 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T01:06:37.314 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:06:38.049 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:06:38.829 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:06:39.597 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:06:40.382 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:06:41.093 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:06:41.721 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-12T01:06:42.477 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-12T01:06:43.089 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-12T01:06:44.330 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-12T01:06:45.230 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-12T01:06:46.294 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-12T01:06:48.314 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-12T01:06:50.958 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-12T01:06:52.530 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-12T01:06:53.942 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-12T01:06:55.026 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-12T01:06:55.770 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-12T01:06:57.050 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-12T01:06:58.014 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-12T01:06:59.250 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-12T01:07:00.130 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-12T01:07:01.698 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-12T01:07:02.890 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-12T01:07:04.567 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-12T01:07:06.206 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-12T01:07:07.362 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-12T01:07:08.418 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-12T01:07:09.339 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-12T01:07:11.338 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-12T01:07:12.843 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-12T01:07:14.531 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-12T01:07:16.111 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-12T01:07:17.603 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-12T01:07:19.083 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-12T01:07:20.275 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-12T01:07:21.179 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-12T01:07:22.199 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-12T01:07:24.067 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-12T01:07:26.403 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-12T01:07:27.471 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-12T01:07:29.019 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-12T01:07:30.555 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-12T01:07:31.975 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-12T01:07:33.543 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-12T01:07:35.227 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-12T01:07:36.759 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-12T01:07:38.256 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-12T01:07:39.279 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-12T01:07:40.151 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-12T01:07:41.047 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-12T01:07:41.943 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-12T01:07:43.344 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-12T01:07:44.800 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-12T01:07:46.240 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-12T01:07:47.656 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-12T01:07:49.116 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-12T01:07:50.556 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-12T01:07:51.944 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-12T01:07:53.408 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-12T01:07:54.808 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-12T01:07:56.268 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T01:07:57.736 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-12T01:07:59.176 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-12T01:08:00.152 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-12T01:08:01.148 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-12T01:08:02.100 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T01:08:03.060 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-12T01:08:03.875 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-12T01:08:04.647 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-12T01:08:05.351 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-12T01:08:06.043 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-12T01:08:06.675 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-12T01:08:07.355 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-12T01:08:08.007 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-12T01:08:08.751 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-12T01:08:09.439 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-12T01:08:10.619 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-12T01:08:11.779 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-12T01:08:12.411 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T01:08:13.079 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T01:08:13.767 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-12T01:08:14.451 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-12T01:08:15.596 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T01:08:16.801 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T01:08:17.455 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-12T01:08:18.175 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-12T01:08:18.840 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-12T01:08:19.519 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-12T01:08:20.191 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-12T01:08:20.872 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-12T01:08:21.555 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-12T01:08:22.300 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-12T01:08:23.008 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-12T01:08:23.672 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-12T01:08:24.351 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-12T01:08:25.036 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-12T01:08:25.700 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-12T01:08:26.352 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-12T01:08:27.079 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-12T01:08:27.768 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-12T01:08:28.492 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-12T01:08:50.336 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-12T01:08:50.972 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-12T01:08:51.628 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-12T01:08:52.292 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-12T01:08:52.940 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-12T01:08:53.600 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-12T01:08:54.288 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-12T01:08:55.000 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-12T01:08:55.660 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-12T01:08:56.320 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-12T01:08:57.012 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-12T01:08:57.704 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-12T01:08:58.353 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-12T01:08:59.044 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T01:08:59.796 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T01:09:00.496 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T01:09:01.184 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T01:09:01.852 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-12T01:09:02.564 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-12T01:09:03.276 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T01:09:04.017 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T01:09:04.696 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T01:09:05.348 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T01:09:06.064 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-12T01:09:06.792 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-12T01:09:07.472 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-12T01:09:08.160 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-12T01:09:08.888 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-12T01:09:09.552 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-12T01:09:09.988 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-12T01:09:10.588 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-12T01:09:11.960 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-12T01:09:13.392 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-12T01:09:14.072 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-12T01:09:14.776 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-12T01:09:15.436 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-12T01:09:16.128 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-12T01:09:16.844 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-12T01:09:17.576 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-12T01:09:18.344 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-12T01:09:19.013 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-12T01:09:19.716 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-12T01:09:20.408 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-12T01:09:21.120 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-12T01:09:21.804 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-12T01:09:22.696 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-12T01:09:23.808 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-12T01:09:24.436 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-12T01:09:25.024 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-12T01:09:25.600 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-12T01:09:26.184 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-12T01:09:26.580 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-12T01:09:26.980 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-12T01:09:27.440 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-12T01:09:28.053 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-12T01:09:28.629 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-12T01:09:29.029 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-12T01:09:29.600 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-12T01:09:30.141 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-12T01:09:30.705 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-12T01:09:31.252 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-12T01:09:32.340 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-12T01:09:33.185 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-12T01:09:33.993 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-12T01:09:55.689 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-12T01:10:18.173 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-12T01:10:18.789 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-12T01:10:19.429 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-12T01:10:20.025 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-12T01:10:20.605 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-12T01:10:21.361 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-12T01:10:21.913 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-12T01:10:22.485 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-12T01:10:23.109 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-12T01:10:23.765 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-12T01:10:24.441 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-12T01:10:25.037 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-12T01:10:25.645 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-12T01:10:26.309 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-12T01:10:26.829 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-12T01:10:27.429 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-12T01:10:28.014 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-12T01:10:28.705 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-12T01:10:29.393 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-12T01:10:29.993 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-12T01:10:30.597 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-12T01:10:31.261 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-12T01:10:31.945 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-12T01:10:32.505 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-12T01:10:33.041 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-12T01:10:33.593 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-12T01:10:34.157 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-12T01:10:34.713 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-12T01:10:35.249 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-12T01:10:35.849 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-12T01:10:36.397 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-12T01:10:36.953 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-12T01:10:37.557 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-12T01:10:38.113 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-12T01:10:38.817 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-12T01:10:39.349 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-12T01:10:39.909 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-12T01:10:40.457 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-12T01:10:41.013 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-12T01:10:41.549 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-12T01:10:42.165 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-12T01:10:42.685 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-12T01:10:43.393 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-12T01:10:43.917 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-12T01:10:44.581 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-12T01:10:45.205 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-12T01:10:45.837 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-12T01:10:46.497 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-12T01:10:47.193 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-12T01:10:48.869 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-12T01:10:49.537 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-12T01:10:50.165 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-12T01:10:50.837 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-12T01:10:51.617 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-12T01:10:52.489 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-12T01:10:53.128 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-12T01:10:53.813 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-12T01:10:54.622 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-12T01:10:55.253 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-12T01:10:56.025 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-12T01:10:56.621 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-12T01:10:57.157 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-12T01:10:57.713 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-12T01:10:58.361 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-12T01:10:58.889 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-12T01:10:59.365 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-12T01:11:00.113 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-12T01:11:00.709 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-12T01:11:01.337 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-12T01:11:04.273 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-12T01:11:04.857 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-12T01:11:05.425 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-12T01:11:06.018 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-12T01:11:06.693 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-12T01:11:07.269 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-12T01:11:07.837 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-12T01:11:08.481 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-12T01:11:09.133 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-12T01:11:09.749 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-12T01:11:10.345 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-12T01:11:10.945 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-12T01:11:11.613 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-12T01:11:12.250 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-12T01:11:12.861 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-12T01:11:13.549 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-12T01:11:14.285 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-12T01:11:14.949 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-12T01:11:15.346 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-12T01:11:15.741 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-12T01:11:16.141 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-12T01:11:16.657 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-12T01:11:17.125 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-12T01:11:17.585 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-12T01:11:18.065 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-12T01:11:18.633 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-12T01:11:19.065 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-12T01:11:19.497 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-12T01:11:20.010 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-12T01:11:20.409 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-12T01:11:20.801 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-12T01:11:21.197 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-12T01:11:21.626 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-12T01:11:22.151 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-12T01:11:22.669 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-12T01:11:23.281 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-12T01:11:23.829 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-12T01:11:24.358 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-12T01:11:24.897 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-12T01:11:25.446 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-12T01:11:26.045 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-12T01:11:26.581 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T01:11:27.097 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T01:11:27.746 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-12T01:11:28.349 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-12T01:11:29.125 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-12T01:11:29.726 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T01:11:30.402 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T01:11:31.114 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-12T01:11:31.805 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-12T01:11:32.441 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-12T01:11:33.125 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-12T01:11:33.669 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-12T01:11:34.454 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-12T01:11:35.113 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-12T01:11:35.774 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-12T01:11:36.473 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-12T01:11:37.205 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-12T01:11:38.214 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-12T01:11:39.121 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-12T01:11:40.085 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-12T01:11:41.037 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-12T01:11:41.934 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-12T01:11:42.529 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-12T01:11:43.153 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-12T01:11:43.793 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-12T01:11:44.514 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-12T01:11:45.134 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-12T01:11:45.821 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-12T01:11:46.829 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-12T01:11:47.849 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-12T01:11:48.793 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-12T01:11:49.825 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-12T01:11:50.802 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-12T01:11:51.774 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-12T01:11:52.758 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-12T01:11:53.738 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-12T01:11:54.766 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-12T01:11:55.637 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-12T01:11:56.505 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-12T01:11:57.370 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-12T01:11:58.421 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-12T01:11:59.418 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-12T01:11:59.814 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-12T01:12:00.209 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-12T01:12:00.637 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-12T01:12:01.321 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-12T01:12:01.957 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-12T01:12:02.449 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-12T01:12:02.937 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-12T01:12:03.742 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-12T01:12:05.318 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-12T01:12:06.086 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-12T01:12:06.786 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-12T01:12:07.713 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-12T01:12:08.442 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-12T01:12:09.157 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-12T01:12:09.834 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-12T01:12:10.514 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-12T01:12:11.434 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-12T01:12:12.157 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-12T01:12:13.094 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-12T01:12:13.886 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-12T01:12:14.878 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-12T01:12:15.829 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-12T01:12:16.365 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-12T01:12:16.897 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-12T01:12:18.691 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-12T01:12:19.490 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-12T01:12:22.658 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-12T01:12:23.266 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-12T01:12:24.030 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-12T01:12:25.358 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-12T01:12:26.078 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-12T01:12:27.317 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-12T01:12:30.474 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-12T01:12:33.858 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-12T01:12:38.098 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-12T01:12:54.821 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-12T01:12:57.258 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-12T01:13:01.484 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-12T01:13:02.445 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-12T01:13:03.745 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-12T01:13:04.918 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-12T01:13:05.818 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-12T01:13:06.490 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-12T01:13:07.734 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-12T01:13:08.494 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-12T01:13:09.190 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-12T01:13:09.829 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-12T01:13:25.150 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-12T01:13:27.630 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-12T01:13:28.346 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-12T01:13:28.970 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-12T01:13:29.618 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-12T01:13:35.061 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-12T01:13:38.825 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-12T01:13:42.434 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-12T01:13:43.089 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-12T01:13:43.769 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-12T01:13:44.482 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-12T01:13:45.162 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-12T01:13:45.870 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-12T01:13:46.521 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-12T01:13:47.161 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-12T01:13:48.066 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-12T01:13:49.070 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-12T01:13:50.189 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-12T01:13:51.157 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-12T01:13:52.357 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-12T01:13:53.926 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-12T01:13:54.769 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-12T01:13:55.825 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-12T01:13:57.053 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-12T01:13:57.982 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-12T01:13:58.734 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-12T01:13:59.789 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-12T01:14:00.493 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-12T01:14:05.674 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-12T01:14:06.294 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-12T01:14:06.965 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-12T01:14:07.658 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-12T01:14:08.296 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-12T01:14:09.257 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-12T01:14:17.602 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-12T01:14:18.622 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-12T01:14:19.473 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-12T01:14:20.453 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-12T01:14:21.598 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-12T01:14:25.273 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-12T01:14:26.241 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-12T01:14:30.677 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-12T01:14:46.385 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-12T01:14:50.669 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-12T01:14:52.314 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-12T01:14:54.085 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-12T01:14:55.005 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-12T01:14:55.958 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-12T01:14:56.757 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-12T01:14:57.685 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-12T01:14:58.649 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-12T01:14:59.557 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-12T01:15:00.085 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-12T01:15:00.697 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-12T01:15:01.289 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-12T01:15:01.849 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-12T01:15:02.449 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-12T01:15:03.093 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-12T01:15:03.665 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-12T01:15:04.249 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-12T01:15:04.909 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-12T01:15:05.425 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-12T01:15:05.985 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-12T01:15:06.545 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-12T01:15:07.145 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-12T01:15:07.761 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-12T01:15:08.405 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-12T01:15:09.049 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-12T01:15:09.701 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-12T01:15:10.345 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-12T01:15:10.981 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-12T01:15:11.593 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-12T01:15:12.277 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-12T01:15:12.917 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-12T01:15:13.445 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-12T01:15:13.989 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-12T01:15:14.545 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-12T01:15:19.717 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-12T01:15:24.901 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-12T01:15:26.713 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-12T01:15:27.357 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-12T01:16:28.917 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-12T01:17:30.497 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-12T01:17:31.085 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-12T01:17:31.749 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-12T01:17:32.292 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-12T01:17:32.857 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-12T01:17:36.512 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-12T01:17:38.089 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-12T01:17:39.701 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-12T01:17:40.372 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-12T01:17:40.969 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-12T01:17:41.636 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-12T01:17:42.292 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-12T01:17:42.952 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-12T01:17:43.621 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-12T01:17:44.317 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-12T01:17:45.053 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-12T01:17:45.788 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-12T01:17:46.489 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-12T01:17:47.137 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-12T01:17:47.769 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-12T01:17:48.788 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-12T01:17:49.804 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-12T01:17:50.693 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-12T01:17:51.472 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-12T01:17:52.328 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-12T01:17:53.169 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-12T01:17:54.033 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-12T01:17:54.964 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-12T01:17:55.821 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-12T01:17:56.848 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-12T01:17:57.756 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-12T01:17:58.388 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-12T01:17:59.269 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-12T01:18:00.001 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-12T01:18:00.920 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-12T01:18:01.780 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-12T01:18:02.809 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-12T01:18:04.053 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-12T01:18:07.720 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-12T01:18:08.636 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-12T01:18:09.532 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T01:18:10.428 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T01:18:11.656 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-12T01:18:12.648 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-12T01:18:13.321 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-12T01:18:14.216 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-12T01:18:14.788 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-12T01:18:15.340 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-12T01:18:15.893 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-12T01:18:16.453 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-12T01:18:17.208 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-12T01:18:17.780 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-12T01:18:18.688 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-12T01:18:19.264 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-12T01:18:19.816 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-12T01:18:20.356 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-12T01:18:20.936 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-12T01:18:21.477 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-12T01:18:22.064 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-12T01:18:22.680 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-12T01:18:23.200 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-12T01:18:23.728 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-12T01:18:24.272 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-12T01:18:24.924 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-12T01:18:25.531 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-12T01:18:26.216 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-12T01:18:26.820 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-12T01:18:27.388 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-12T01:18:27.992 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-12T01:18:28.672 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-12T01:18:29.312 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-12T01:18:30.065 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-12T01:18:30.685 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-12T01:18:31.304 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-12T01:18:31.932 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-12T01:18:32.692 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-12T01:18:33.404 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-12T01:18:34.077 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-12T01:18:34.656 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-12T01:18:35.237 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-12T01:18:35.924 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-12T01:18:36.605 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-12T01:18:37.228 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-12T01:18:37.864 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T01:18:38.676 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T01:18:39.229 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-12T01:18:39.848 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-12T01:18:40.436 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-12T01:18:50.853 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-12T01:18:51.552 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-12T01:19:01.349 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-12T01:19:02.005 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-12T01:19:02.728 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-12T01:19:03.272 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-12T01:19:03.840 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:19:04.444 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:19:05.060 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:19:05.700 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-12T01:19:06.309 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-12T01:19:06.948 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-12T01:19:07.484 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-12T01:19:08.157 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-12T01:19:08.752 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-12T01:19:09.444 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-12T01:19:10.132 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-12T01:19:10.720 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-12T01:19:11.260 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-12T01:19:12.077 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-12T01:19:13.968 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-12T01:19:14.540 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:19:15.148 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:19:15.776 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:19:16.553 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-12T01:19:17.305 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-12T01:19:17.953 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-12T01:19:18.961 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-12T01:19:20.265 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-12T01:19:20.965 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-12T01:19:28.310 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-12T01:19:35.457 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-12T01:19:36.045 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-12T01:19:36.889 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-12T01:19:38.745 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-12T01:19:40.561 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-12T01:19:42.092 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-12T01:19:43.276 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-12T01:19:44.364 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-12T01:19:45.317 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-12T01:19:45.921 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-12T01:19:47.236 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-12T01:19:48.610 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-12T01:19:51.284 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-12T01:19:52.712 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-12T01:19:53.860 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-12T01:19:54.605 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-12T01:19:55.284 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-12T01:19:56.340 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-12T01:19:57.316 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-12T01:19:58.348 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-12T01:19:59.181 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-12T01:20:00.196 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-12T01:20:01.104 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-12T01:20:02.236 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-12T01:20:03.144 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-12T01:20:03.505 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-12T01:20:05.124 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-12T01:20:06.756 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-12T01:20:07.633 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-12T01:20:08.700 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-12T01:20:09.476 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-12T01:20:19.932 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-12T01:20:20.264 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-12T01:20:21.180 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-12T01:20:21.928 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-12T01:20:22.516 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-12T01:20:23.300 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-12T01:20:23.344 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-12T01:20:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:20:23.345 INFO:teuthology.orchestra.run.smithi070.stdout:=============================== warnings summary =============================== 2024-09-12T01:20:23.345 INFO:teuthology.orchestra.run.smithi070.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-12T01:20:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-12T01:20:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: import imp 2024-09-12T01:20:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:20:23.345 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py:120 2024-09-12T01:20:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:20:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: if boto_type is 'S3Connection': 2024-09-12T01:20:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:20:23.345 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_headers.py:124 2024-09-12T01:20:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:20:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: elif boto_type is 'HTTPRequest': 2024-09-12T01:20:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:20:23.346 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3.py:359 2024-09-12T01:20:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence '\W' 2024-09-12T01:20:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-12T01:20:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:20:23.346 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py:176 2024-09-12T01:20:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:20:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: if k is 'BucketName': 2024-09-12T01:20:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:20:23.346 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py:253 2024-09-12T01:20:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-12T01:20:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: @pytest.mark.timeout(10) 2024-09-12T01:20:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:20:23.347 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-12T01:20:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-12T01:20:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: @pytest.mark.s3website_routing_rules 2024-09-12T01:20:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:20:23.347 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-12T01:20:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:20:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:20:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:20:23.347 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-12T01:20:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:20:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:20:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:20:23.348 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-12T01:20:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:20:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-12T01:20:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:20:23.348 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-12T01:20:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:20:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:20:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:20:23.348 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-12T01:20:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:20:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:20:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:20:23.348 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-12T01:20:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:20:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:20:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:20:23.349 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-12T01:20:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:20:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-12T01:20:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:20:23.349 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-12T01:20:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:20:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:20:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:20:23.349 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-12T01:20:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:20:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:20:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:20:23.350 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-12T01:20:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:20:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:20:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:20:23.350 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-12T01:20:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:20:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:20:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:20:23.350 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-09-12T01:20:23.350 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_iam.py: 82 warnings 2024-09-12T01:20:23.350 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py: 497 warnings 2024-09-12T01:20:23.351 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-09-12T01:20:23.351 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_sns.py: 3 warnings 2024-09-12T01:20:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi070.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:20:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: warnings.warn( 2024-09-12T01:20:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:20:23.351 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T01:20:23.351 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T01:20:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:6540: DeprecationWarning: ssl.wrap_socket() is deprecated, use SSLContext.wrap_socket() 2024-09-12T01:20:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: s = ssl.wrap_socket(s); 2024-09-12T01:20:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:20:23.351 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T01:20:23.351 INFO:teuthology.orchestra.run.smithi070.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T01:20:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: /usr/lib/python3.10/ssl.py:1434: DeprecationWarning: ssl.PROTOCOL_TLS is deprecated 2024-09-12T01:20:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: context = SSLContext(ssl_version) 2024-09-12T01:20:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:20:23.352 INFO:teuthology.orchestra.run.smithi070.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T01:20:23.352 INFO:teuthology.orchestra.run.smithi070.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 666 warnings in 874.91s (0:14:34) = 2024-09-12T01:20:23.525 INFO:teuthology.orchestra.run.smithi070.stdout:___________________________________ summary ____________________________________ 2024-09-12T01:20:23.525 INFO:teuthology.orchestra.run.smithi070.stdout: py: commands succeeded 2024-09-12T01:20:23.525 INFO:teuthology.orchestra.run.smithi070.stdout: congratulations :) 2024-09-12T01:20:23.545 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-12T01:20:23.545 DEBUG:teuthology.orchestra.run.smithi070:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T01:20:23.643 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:20:23.643 INFO:tasks.s3tests:Cleaning up boto... 2024-09-12T01:20:23.643 DEBUG:teuthology.orchestra.run.smithi070:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T01:20:23.648 INFO:tasks.s3tests:Removing s3-tests... 2024-09-12T01:20:23.649 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T01:20:23.836 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T01:20:23.848 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T01:20:23.848 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T01:20:23.849 DEBUG:teuthology.orchestra.run.smithi070:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:20:23.854 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:20:23.855 INFO:teuthology.orchestra.run.smithi070.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T01:20:23.855 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:20:23.901 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T01:20:23.902 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T01:20:23.950 INFO:tasks.workunit:timeout=3h 2024-09-12T01:20:23.950 INFO:tasks.workunit:cleanup=True 2024-09-12T01:20:23.951 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T01:20:24.000 INFO:tasks.workunit.client.0.smithi070.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T01:21:06.306 INFO:tasks.workunit.client.0.smithi070.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T01:21:06.306 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:21:06.307 INFO:tasks.workunit.client.0.smithi070.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T01:21:06.307 INFO:tasks.workunit.client.0.smithi070.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T01:21:06.307 INFO:tasks.workunit.client.0.smithi070.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T01:21:06.307 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:21:06.307 INFO:tasks.workunit.client.0.smithi070.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T01:21:06.307 INFO:tasks.workunit.client.0.smithi070.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T01:21:06.307 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:21:06.307 INFO:tasks.workunit.client.0.smithi070.stderr: git switch -c 2024-09-12T01:21:06.307 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:21:06.307 INFO:tasks.workunit.client.0.smithi070.stderr:Or undo this operation with: 2024-09-12T01:21:06.307 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:21:06.307 INFO:tasks.workunit.client.0.smithi070.stderr: git switch - 2024-09-12T01:21:06.307 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:21:06.307 INFO:tasks.workunit.client.0.smithi070.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T01:21:06.308 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:21:06.308 INFO:tasks.workunit.client.0.smithi070.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T01:21:06.313 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T01:21:06.362 INFO:tasks.workunit.client.0.smithi070.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T01:21:06.365 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:21:06.365 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T01:21:06.422 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T01:21:06.475 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T01:21:06.525 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:21:06.525 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:21:06.525 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T01:21:06.567 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:21:06.571 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T01:21:06.571 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T01:21:06.618 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-12T01:21:06.619 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-12T01:21:06.619 DEBUG:teuthology.orchestra.run.smithi070:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T01:21:06.671 INFO:tasks.workunit.client.0.smithi070.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T01:21:06.671 INFO:tasks.workunit.client.0.smithi070.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:21:06.671 INFO:tasks.workunit.client.0.smithi070.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:21:09.536 INFO:tasks.workunit.client.0.smithi070.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T01:21:09.536 INFO:tasks.workunit.client.0.smithi070.stderr:++ deactivate nondestructive 2024-09-12T01:21:09.536 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -n '' ']' 2024-09-12T01:21:09.537 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -n '' ']' 2024-09-12T01:21:09.537 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:21:09.537 INFO:tasks.workunit.client.0.smithi070.stderr:++ hash -r 2024-09-12T01:21:09.540 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -n '' ']' 2024-09-12T01:21:09.540 INFO:tasks.workunit.client.0.smithi070.stderr:++ unset VIRTUAL_ENV 2024-09-12T01:21:09.540 INFO:tasks.workunit.client.0.smithi070.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T01:21:09.540 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T01:21:09.541 INFO:tasks.workunit.client.0.smithi070.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:21:09.541 INFO:tasks.workunit.client.0.smithi070.stderr:++ export VIRTUAL_ENV 2024-09-12T01:21:09.541 INFO:tasks.workunit.client.0.smithi070.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T01:21:09.541 INFO:tasks.workunit.client.0.smithi070.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T01:21:09.541 INFO:tasks.workunit.client.0.smithi070.stderr:++ export PATH 2024-09-12T01:21:09.541 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -n '' ']' 2024-09-12T01:21:09.541 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -z '' ']' 2024-09-12T01:21:09.541 INFO:tasks.workunit.client.0.smithi070.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T01:21:09.541 INFO:tasks.workunit.client.0.smithi070.stderr:++ PS1='(rgw) ' 2024-09-12T01:21:09.541 INFO:tasks.workunit.client.0.smithi070.stderr:++ export PS1 2024-09-12T01:21:09.541 INFO:tasks.workunit.client.0.smithi070.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T01:21:09.541 INFO:tasks.workunit.client.0.smithi070.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T01:21:09.541 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:21:09.542 INFO:tasks.workunit.client.0.smithi070.stderr:++ hash -r 2024-09-12T01:21:09.542 INFO:tasks.workunit.client.0.smithi070.stderr:+ pip install pip --upgrade 2024-09-12T01:21:09.892 INFO:tasks.workunit.client.0.smithi070.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T01:21:10.104 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting pip 2024-09-12T01:21:10.110 INFO:tasks.workunit.client.0.smithi070.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T01:21:10.145 INFO:tasks.workunit.client.0.smithi070.stdout:Installing collected packages: pip 2024-09-12T01:21:10.145 INFO:tasks.workunit.client.0.smithi070.stdout: Attempting uninstall: pip 2024-09-12T01:21:10.145 INFO:tasks.workunit.client.0.smithi070.stdout: Found existing installation: pip 22.0.2 2024-09-12T01:21:10.401 INFO:tasks.workunit.client.0.smithi070.stdout: Uninstalling pip-22.0.2: 2024-09-12T01:21:10.407 INFO:tasks.workunit.client.0.smithi070.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T01:21:11.152 INFO:tasks.workunit.client.0.smithi070.stdout:Successfully installed pip-24.2 2024-09-12T01:21:11.212 INFO:tasks.workunit.client.0.smithi070.stderr:+ pip install boto3 2024-09-12T01:21:12.233 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting boto3 2024-09-12T01:21:12.234 INFO:tasks.workunit.client.0.smithi070.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T01:21:12.806 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T01:21:12.807 INFO:tasks.workunit.client.0.smithi070.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T01:21:12.878 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T01:21:12.879 INFO:tasks.workunit.client.0.smithi070.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T01:21:12.935 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T01:21:12.936 INFO:tasks.workunit.client.0.smithi070.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T01:21:12.978 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:21:12.979 INFO:tasks.workunit.client.0.smithi070.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T01:21:13.083 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:21:13.085 INFO:tasks.workunit.client.0.smithi070.stdout: Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-12T01:21:13.323 INFO:tasks.workunit.client.0.smithi070.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:21:13.324 INFO:tasks.workunit.client.0.smithi070.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T01:21:13.328 INFO:tasks.workunit.client.0.smithi070.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T01:21:13.329 INFO:tasks.workunit.client.0.smithi070.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T01:21:13.339 INFO:tasks.workunit.client.0.smithi070.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T01:21:13.340 INFO:tasks.workunit.client.0.smithi070.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T01:21:13.341 INFO:tasks.workunit.client.0.smithi070.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T01:21:13.342 INFO:tasks.workunit.client.0.smithi070.stdout:Using cached urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-12T01:21:13.343 INFO:tasks.workunit.client.0.smithi070.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T01:21:13.411 INFO:tasks.workunit.client.0.smithi070.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T01:21:14.506 INFO:tasks.workunit.client.0.smithi070.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-12T01:21:14.694 INFO:tasks.workunit.client.0.smithi070.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-12T01:21:14.830 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-12T01:21:14.868 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:21:14.868 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:21:14.909 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.909+0000 7f2162f4d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:14.910 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.913+0000 7f2162f4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:14.910 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.913+0000 7f2162f4d9c0 20 realm 2024-09-12T01:21:14.910 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.913+0000 7f2162f4d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:14.911 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.913+0000 7f2162f4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:14.911 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.913+0000 7f2162f4d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:21:14.911 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.913+0000 7f2162f4d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:14.911 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.913+0000 7f2162f4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:14.911 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.913+0000 7f2162f4d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:14.912 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.913+0000 7f2162f4d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:21:14.912 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.913+0000 7f2162f4d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:14.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.917+0000 7f2162f4d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:21:14.913 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.917+0000 7f2162f4d9c0 20 searching for the correct realm 2024-09-12T01:21:14.918 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.921+0000 7f2161254640 0 -- 172.21.15.70:0/1538160572 >> [v2:172.21.15.70:6816/1979013808,v1:172.21.15.70:6817/1979013808] conn(0x55c374ab06a0 msgr2=0x55c374ab2b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:21:14.925 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.929+0000 7f2161254640 0 -- 172.21.15.70:0/1538160572 >> [v2:172.21.15.70:6816/1979013808,v1:172.21.15.70:6817/1979013808] conn(0x7f202c0815e0 msgr2=0x7f202c083a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:21:14.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.933+0000 7f2162f4d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:21:14.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.933+0000 7f2162f4d9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:21:14.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.933+0000 7f2162f4d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:21:14.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.933+0000 7f2162f4d9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:21:14.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.933+0000 7f2162f4d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:21:14.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.933+0000 7f2162f4d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:21:14.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.933+0000 7f2162f4d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:14.931 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.933+0000 7f2162f4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:14.932 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.933+0000 7f2162f4d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:14.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.933+0000 7f2162f4d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:21:14.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.933+0000 7f2162f4d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:14.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.933+0000 7f2162f4d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:21:14.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.933+0000 7f2162f4d9c0 20 zone default found 2024-09-12T01:21:14.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.933+0000 7f2162f4d9c0 4 Realm: () 2024-09-12T01:21:14.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.933+0000 7f2162f4d9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:21:14.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.933+0000 7f2162f4d9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:21:14.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.933+0000 7f2162f4d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:21:14.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.933+0000 7f2162f4d9c0 20 zonegroup default 2024-09-12T01:21:14.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.933+0000 7f2162f4d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:14.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.933+0000 7f2162f4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:14.933 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.933+0000 7f2162f4d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:14.934 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.937+0000 7f2162f4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:14.934 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.937+0000 7f2162f4d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:14.934 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.937+0000 7f2162f4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:14.934 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.937+0000 7f2162f4d9c0 20 started sync module instance, tier type = 2024-09-12T01:21:14.934 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.937+0000 7f2162f4d9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:21:14.948 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.949+0000 7f2162f4d9c0 20 add_watcher() i=0 2024-09-12T01:21:14.948 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.949+0000 7f2162f4d9c0 20 add_watcher() i=1 2024-09-12T01:21:14.948 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.949+0000 7f2162f4d9c0 20 add_watcher() i=2 2024-09-12T01:21:14.948 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.949+0000 7f2162f4d9c0 20 add_watcher() i=3 2024-09-12T01:21:14.948 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.949+0000 7f2162f4d9c0 20 add_watcher() i=4 2024-09-12T01:21:14.948 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.949+0000 7f2162f4d9c0 20 add_watcher() i=5 2024-09-12T01:21:14.948 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.949+0000 7f2162f4d9c0 20 add_watcher() i=6 2024-09-12T01:21:14.949 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.953+0000 7f2162f4d9c0 20 add_watcher() i=7 2024-09-12T01:21:14.949 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.953+0000 7f2162f4d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:21:14.951 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.953+0000 7f2016fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:21:14.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.953+0000 7f2162f4d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:21:14.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.953+0000 7f2162f4d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:21:14.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.953+0000 7f2162f4d9c0 5 note: GC not initialized 2024-09-12T01:21:14.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.953+0000 7f2015fe3640 20 reqs_thread_entry: start 2024-09-12T01:21:14.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.953+0000 7f2162f4d9c0 20 init_complete bucket index max shards: 1 2024-09-12T01:21:14.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.953+0000 7f2162f4d9c0 20 Filter name: none 2024-09-12T01:21:14.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.953+0000 7f1f877fe640 20 reqs_thread_entry: start 2024-09-12T01:21:14.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.953+0000 7f2162f4d9c0 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-12T01:21:14.952 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.953+0000 7f2162f4d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:14.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.953+0000 7f2162f4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:14.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.953+0000 7f2162f4d9c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-12T01:21:14.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.953+0000 7f2162f4d9c0 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:21:14.953 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.953+0000 7f2162f4d9c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-12T01:21:14.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.953+0000 7f2162f4d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:14.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.957+0000 7f2162f4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:14.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.957+0000 7f2162f4d9c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-12T01:21:14.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.957+0000 7f2162f4d9c0 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:21:14.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.957+0000 7f2162f4d9c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T01:21:14.954 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.957+0000 7f2162f4d9c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T01:21:14.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.957+0000 7f2162f4d9c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T01:21:14.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.957+0000 7f2162f4d9c0 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:21:14.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.957+0000 7f2162f4d9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-12T01:21:14.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.957+0000 7f2037fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333742 cookie 94297964430512 notifier 8780 bl.length()=613 2024-09-12T01:21:14.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.957+0000 7f2037fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T01:21:14.956 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.957+0000 7f2037fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:21:14.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.961+0000 7f2162f4d9c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T01:21:14.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.961+0000 7f2162f4d9c0 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:21:14.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.961+0000 7f2162f4d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-12T01:21:14.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.961+0000 7f20377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333954 cookie 94297964424832 notifier 8780 bl.length()=191 2024-09-12T01:21:14.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.961+0000 7f20377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T01:21:14.959 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.961+0000 7f20377fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:21:14.960 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.961+0000 7f2016fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:21:14.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.969+0000 7f2162f4d9c0 20 remove_watcher() i=0 2024-09-12T01:21:14.966 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.969+0000 7f2162f4d9c0 2 removed watcher, disabling cache 2024-09-12T01:21:14.968 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.969+0000 7f2162f4d9c0 20 remove_watcher() i=1 2024-09-12T01:21:14.970 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.973+0000 7f2162f4d9c0 20 remove_watcher() i=2 2024-09-12T01:21:14.971 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.973+0000 7f2162f4d9c0 20 remove_watcher() i=3 2024-09-12T01:21:14.973 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.977+0000 7f2162f4d9c0 20 remove_watcher() i=4 2024-09-12T01:21:14.974 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.977+0000 7f2162f4d9c0 20 remove_watcher() i=5 2024-09-12T01:21:14.975 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.977+0000 7f2162f4d9c0 20 remove_watcher() i=6 2024-09-12T01:21:14.976 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:14.977+0000 7f2162f4d9c0 20 remove_watcher() i=7 2024-09-12T01:21:15.119 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:21:15.120 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:21:15.165 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:21:15.165 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:21:15.215 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:21:15.215 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:21:15.238 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:21:15.238 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:21:15.246 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-12T01:21:15.246 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:21:15.249 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:21:15.249 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:21:15.271 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:21:15.271 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:21:15.289 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:21:15.289 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:21:15.314 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T01:21:15.350 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:21:15.350 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:21:15.393 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.397+0000 7f1ad02de9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:15.395 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.397+0000 7f1ad02de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:15.395 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.397+0000 7f1ad02de9c0 20 realm 2024-09-12T01:21:15.395 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.397+0000 7f1ad02de9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:15.396 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.397+0000 7f1ad02de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:15.396 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.397+0000 7f1ad02de9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:21:15.396 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.397+0000 7f1ad02de9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:15.396 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.397+0000 7f1ad02de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:15.396 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.397+0000 7f1ad02de9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:15.397 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.401+0000 7f1ad02de9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:21:15.397 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.401+0000 7f1ad02de9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:15.398 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.401+0000 7f1ad02de9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:21:15.398 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.401+0000 7f1ad02de9c0 20 searching for the correct realm 2024-09-12T01:21:15.402 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.405+0000 7f1ace5e5640 0 -- 172.21.15.70:0/929104372 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f1ab806c770 msgr2=0x7f1ab8038a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:21:15.619 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.621+0000 7f1ace5e5640 0 -- 172.21.15.70:0/929104372 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f1ab806c770 msgr2=0x7f1ab8038a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:21:15.631 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.633+0000 7f1ad02de9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:21:15.631 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.633+0000 7f1ad02de9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:21:15.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.633+0000 7f1ad02de9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:21:15.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.633+0000 7f1ad02de9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:21:15.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.633+0000 7f1ad02de9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:21:15.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.633+0000 7f1ad02de9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:21:15.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.633+0000 7f1ad02de9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:15.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.633+0000 7f1ad02de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:15.632 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.633+0000 7f1ad02de9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:15.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.637+0000 7f1ad02de9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:21:15.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.637+0000 7f1ad02de9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:15.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.637+0000 7f1ad02de9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:21:15.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.637+0000 7f1ad02de9c0 20 zone default found 2024-09-12T01:21:15.633 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.637+0000 7f1ad02de9c0 4 Realm: () 2024-09-12T01:21:15.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.637+0000 7f1ad02de9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:21:15.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.637+0000 7f1ad02de9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:21:15.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.637+0000 7f1ad02de9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:21:15.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.637+0000 7f1ad02de9c0 20 zonegroup default 2024-09-12T01:21:15.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.637+0000 7f1ad02de9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:15.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.637+0000 7f1ad02de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:15.634 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.637+0000 7f1ad02de9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:15.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.637+0000 7f1ad02de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:15.635 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.637+0000 7f1ad02de9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:15.636 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.637+0000 7f1ad02de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:15.636 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.637+0000 7f1ad02de9c0 20 started sync module instance, tier type = 2024-09-12T01:21:15.636 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.637+0000 7f1ad02de9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:21:15.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.661+0000 7f1ad02de9c0 20 add_watcher() i=0 2024-09-12T01:21:15.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.661+0000 7f1ad02de9c0 20 add_watcher() i=1 2024-09-12T01:21:15.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.661+0000 7f1ad02de9c0 20 add_watcher() i=2 2024-09-12T01:21:15.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.661+0000 7f1ad02de9c0 20 add_watcher() i=3 2024-09-12T01:21:15.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.661+0000 7f1ad02de9c0 20 add_watcher() i=4 2024-09-12T01:21:15.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.661+0000 7f1ad02de9c0 20 add_watcher() i=5 2024-09-12T01:21:15.657 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.661+0000 7f1ad02de9c0 20 add_watcher() i=6 2024-09-12T01:21:15.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.661+0000 7f1ad02de9c0 20 add_watcher() i=7 2024-09-12T01:21:15.659 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.661+0000 7f1ad02de9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:21:15.662 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.665+0000 7f197f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:21:15.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.665+0000 7f1ad02de9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:21:15.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.665+0000 7f1ad02de9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:21:15.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.665+0000 7f1ad02de9c0 5 note: GC not initialized 2024-09-12T01:21:15.664 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.665+0000 7f197e7fc640 20 reqs_thread_entry: start 2024-09-12T01:21:15.665 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.665+0000 7f1ad02de9c0 20 init_complete bucket index max shards: 1 2024-09-12T01:21:15.665 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.665+0000 7f1ad02de9c0 20 Filter name: none 2024-09-12T01:21:15.665 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.665+0000 7f18effff640 20 reqs_thread_entry: start 2024-09-12T01:21:15.665 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.669+0000 7f1ad02de9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:15.666 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.669+0000 7f1ad02de9c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:21:15.666 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.669+0000 7f1ad02de9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:15.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.669+0000 7f1ad02de9c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:21:15.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.669+0000 7f1ad02de9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:21:15.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.669+0000 7f1ad02de9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T01:21:15.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.669+0000 7f1ad02de9c0 20 INFO: main: starting shard=0 2024-09-12T01:21:15.667 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.669+0000 7f1ad02de9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.783.0 2024-09-12T01:21:15.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.673+0000 7f1ad02de9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:21:15.669 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.673+0000 7f1ad02de9c0 20 INFO: main: done 2024-09-12T01:21:15.670 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.673+0000 7f197f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:21:15.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.677+0000 7f1ad02de9c0 20 remove_watcher() i=0 2024-09-12T01:21:15.675 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.677+0000 7f1ad02de9c0 2 removed watcher, disabling cache 2024-09-12T01:21:15.677 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.681+0000 7f1ad02de9c0 20 remove_watcher() i=1 2024-09-12T01:21:15.679 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.681+0000 7f1ad02de9c0 20 remove_watcher() i=2 2024-09-12T01:21:15.684 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.685+0000 7f1ad02de9c0 20 remove_watcher() i=3 2024-09-12T01:21:15.686 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.689+0000 7f1ad02de9c0 20 remove_watcher() i=4 2024-09-12T01:21:15.687 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.689+0000 7f1ad02de9c0 20 remove_watcher() i=5 2024-09-12T01:21:15.688 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.693+0000 7f1ad02de9c0 20 remove_watcher() i=6 2024-09-12T01:21:15.690 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.693+0000 7f1ad02de9c0 20 remove_watcher() i=7 2024-09-12T01:21:15.705 INFO:tasks.workunit.client.0.smithi070.stderr:rados -p default.rgw.buckets.data ls | grep 19468918-83ab-49b5-b35c-8f1bc854e24d 2024-09-12T01:21:15.731 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:21:15.731 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:21:15.862 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:15.865+0000 7fd33d8de640 0 -- 172.21.15.70:0/705180509 >> [v2:172.21.15.70:6808/276433067,v1:172.21.15.70:6809/276433067] conn(0x7fd328018040 msgr2=0x7fd32800a2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:21:16.095 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-12T01:21:16.095 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:21:16.095 INFO:tasks.workunit.client.0.smithi070.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T01:21:17.542 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:21:17.542 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:21:17.557 INFO:tasks.workunit.client.0.smithi070.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T01:21:17.978 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T01:21:18.007 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:21:18.007 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:21:18.045 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.049+0000 7f1e0003c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:18.047 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.049+0000 7f1e0003c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:18.047 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.049+0000 7f1e0003c9c0 20 realm 2024-09-12T01:21:18.048 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.049+0000 7f1e0003c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:18.048 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.049+0000 7f1e0003c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:18.048 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.049+0000 7f1e0003c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:21:18.048 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.049+0000 7f1e0003c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:18.048 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.049+0000 7f1e0003c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:18.048 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.049+0000 7f1e0003c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:18.049 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.053+0000 7f1e0003c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:21:18.049 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.053+0000 7f1e0003c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:18.050 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.053+0000 7f1e0003c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:21:18.050 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.053+0000 7f1e0003c9c0 20 searching for the correct realm 2024-09-12T01:21:18.055 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.057+0000 7f1dfe343640 0 -- 172.21.15.70:0/1557721929 >> [v2:172.21.15.70:6816/1979013808,v1:172.21.15.70:6817/1979013808] conn(0x560e49ea4a30 msgr2=0x560e49ea6ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:21:18.063 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.065+0000 7f1dfe343640 0 -- 172.21.15.70:0/1557721929 >> [v2:172.21.15.70:6816/1979013808,v1:172.21.15.70:6817/1979013808] conn(0x7f1cc8081560 msgr2=0x7f1cc8083990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:21:18.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.069+0000 7f1e0003c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:21:18.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.069+0000 7f1e0003c9c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:21:18.069 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.069+0000 7f1e0003c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:21:18.070 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.069+0000 7f1e0003c9c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:21:18.070 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.069+0000 7f1e0003c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:21:18.070 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.069+0000 7f1e0003c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:21:18.070 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.069+0000 7f1e0003c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:18.070 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.073+0000 7f1e0003c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:18.070 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.073+0000 7f1e0003c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:18.072 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.073+0000 7f1e0003c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:21:18.073 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.073+0000 7f1e0003c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:18.073 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.073+0000 7f1e0003c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:21:18.073 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.073+0000 7f1e0003c9c0 20 zone default found 2024-09-12T01:21:18.073 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.073+0000 7f1e0003c9c0 4 Realm: () 2024-09-12T01:21:18.073 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.073+0000 7f1e0003c9c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:21:18.074 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.073+0000 7f1e0003c9c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:21:18.074 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.073+0000 7f1e0003c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:21:18.074 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.073+0000 7f1e0003c9c0 20 zonegroup default 2024-09-12T01:21:18.074 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.073+0000 7f1e0003c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:18.074 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.073+0000 7f1e0003c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:18.074 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.073+0000 7f1e0003c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:18.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.073+0000 7f1e0003c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:18.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.073+0000 7f1e0003c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:18.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.073+0000 7f1e0003c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:18.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.073+0000 7f1e0003c9c0 20 started sync module instance, tier type = 2024-09-12T01:21:18.075 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.073+0000 7f1e0003c9c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:21:18.085 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.089+0000 7f1e0003c9c0 20 add_watcher() i=0 2024-09-12T01:21:18.085 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.089+0000 7f1e0003c9c0 20 add_watcher() i=1 2024-09-12T01:21:18.086 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.089+0000 7f1e0003c9c0 20 add_watcher() i=2 2024-09-12T01:21:18.086 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.089+0000 7f1e0003c9c0 20 add_watcher() i=3 2024-09-12T01:21:18.086 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.089+0000 7f1e0003c9c0 20 add_watcher() i=4 2024-09-12T01:21:18.086 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.089+0000 7f1e0003c9c0 20 add_watcher() i=5 2024-09-12T01:21:18.086 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.089+0000 7f1e0003c9c0 20 add_watcher() i=6 2024-09-12T01:21:18.086 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.089+0000 7f1e0003c9c0 20 add_watcher() i=7 2024-09-12T01:21:18.086 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.089+0000 7f1e0003c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:21:18.088 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.089+0000 7f1caf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:21:18.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.089+0000 7f1e0003c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:21:18.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.089+0000 7f1e0003c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:21:18.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.089+0000 7f1e0003c9c0 5 note: GC not initialized 2024-09-12T01:21:18.089 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.093+0000 7f1cae7fc640 20 reqs_thread_entry: start 2024-09-12T01:21:18.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.093+0000 7f1e0003c9c0 20 init_complete bucket index max shards: 1 2024-09-12T01:21:18.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.093+0000 7f1e0003c9c0 20 Filter name: none 2024-09-12T01:21:18.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.093+0000 7f1c1ffff640 20 reqs_thread_entry: start 2024-09-12T01:21:18.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.093+0000 7f1e0003c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:18.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.093+0000 7f1e0003c9c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:21:18.090 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.093+0000 7f1e0003c9c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:18.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.093+0000 7f1e0003c9c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:21:18.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.093+0000 7f1e0003c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:21:18.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.093+0000 7f1e0003c9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T01:21:18.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.093+0000 7f1e0003c9c0 20 INFO: main: starting shard=0 2024-09-12T01:21:18.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.093+0000 7f1e0003c9c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.783.0 2024-09-12T01:21:18.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.093+0000 7f1e0003c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:21:18.091 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.093+0000 7f1e0003c9c0 20 INFO: main: done 2024-09-12T01:21:18.092 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.093+0000 7f1caf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:21:18.096 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.097+0000 7f1e0003c9c0 20 remove_watcher() i=0 2024-09-12T01:21:18.096 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.097+0000 7f1e0003c9c0 2 removed watcher, disabling cache 2024-09-12T01:21:18.098 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.101+0000 7f1e0003c9c0 20 remove_watcher() i=1 2024-09-12T01:21:18.100 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.101+0000 7f1e0003c9c0 20 remove_watcher() i=2 2024-09-12T01:21:18.102 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.105+0000 7f1e0003c9c0 20 remove_watcher() i=3 2024-09-12T01:21:18.104 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.105+0000 7f1e0003c9c0 20 remove_watcher() i=4 2024-09-12T01:21:18.105 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.109+0000 7f1e0003c9c0 20 remove_watcher() i=5 2024-09-12T01:21:18.106 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.109+0000 7f1e0003c9c0 20 remove_watcher() i=6 2024-09-12T01:21:18.107 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.109+0000 7f1e0003c9c0 20 remove_watcher() i=7 2024-09-12T01:21:18.118 INFO:tasks.workunit.client.0.smithi070.stderr:rados -p default.rgw.buckets.data ls | grep 5e205c17-2b2b-4379-ab5f-575d7a7f9b36 2024-09-12T01:21:18.139 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:21:18.139 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:21:18.278 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:18.281+0000 7fcaf4471640 0 -- 172.21.15.70:0/2058519135 >> [v2:172.21.15.70:6808/276433067,v1:172.21.15.70:6809/276433067] conn(0x7fcadc019840 msgr2=0x7fcadc00a2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:21:18.302 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-12T01:21:18.303 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:21:18.305 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:21:18.305 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:21:18.318 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:21:18.318 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:21:18.335 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:21:18.335 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:21:18.343 INFO:tasks.workunit.client.0.smithi070.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T01:21:19.768 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:21:19.769 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:21:19.838 INFO:tasks.workunit.client.0.smithi070.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T01:21:19.838 INFO:tasks.workunit.client.0.smithi070.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T01:21:20.268 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:21:20.268 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:21:20.277 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:21:20.277 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:21:20.280 INFO:tasks.workunit.client.0.smithi070.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-12T01:21:20.280 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:21:20.282 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:21:20.282 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:21:20.340 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:21:20.340 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:21:20.396 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:21:20.396 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:21:20.415 INFO:tasks.workunit.client.0.smithi070.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-12T01:21:21.863 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:21:21.864 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:21:21.871 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:21:21.871 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:21:23.898 INFO:tasks.workunit.client.0.smithi070.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-12T01:21:24.329 INFO:tasks.workunit.client.0.smithi070.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-12T01:21:24.360 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:21:24.360 INFO:tasks.workunit.client.0.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:21:24.398 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.401+0000 7f6124b799c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:24.400 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.401+0000 7f6124b799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:24.400 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.401+0000 7f6124b799c0 20 realm 2024-09-12T01:21:24.400 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.401+0000 7f6124b799c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:24.400 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.401+0000 7f6124b799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:24.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.401+0000 7f6124b799c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:21:24.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.401+0000 7f6124b799c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:24.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.401+0000 7f6124b799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:24.401 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.401+0000 7f6124b799c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:24.402 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.405+0000 7f6124b799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:21:24.402 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.405+0000 7f6124b799c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:24.402 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.405+0000 7f6124b799c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:21:24.403 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.405+0000 7f6124b799c0 20 searching for the correct realm 2024-09-12T01:21:24.406 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.409+0000 7f6122e80640 0 -- 172.21.15.70:0/4149638401 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f61180e1070 msgr2=0x7f61180d87c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:21:24.414 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.417+0000 7f6122e80640 0 -- 172.21.15.70:0/4149638401 >> [v2:172.21.15.187:6808/3474756626,v1:172.21.15.187:6809/3474756626] conn(0x7f5fec081640 msgr2=0x7f5fec083a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:21:24.423 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.425+0000 7f6124b799c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:21:24.423 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.425+0000 7f6124b799c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:21:24.423 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.425+0000 7f6124b799c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:21:24.423 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.425+0000 7f6124b799c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:21:24.423 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.425+0000 7f6124b799c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:21:24.423 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.425+0000 7f6124b799c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:21:24.423 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.425+0000 7f6124b799c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:24.423 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.425+0000 7f6124b799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:24.423 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.425+0000 7f6124b799c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:24.424 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.425+0000 7f6124b799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:21:24.424 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.425+0000 7f6124b799c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:24.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.425+0000 7f6124b799c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:21:24.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.425+0000 7f6124b799c0 20 zone default found 2024-09-12T01:21:24.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.425+0000 7f6124b799c0 4 Realm: () 2024-09-12T01:21:24.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.425+0000 7f6124b799c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:21:24.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.425+0000 7f6124b799c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:21:24.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.425+0000 7f6124b799c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:21:24.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.425+0000 7f6124b799c0 20 zonegroup default 2024-09-12T01:21:24.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.425+0000 7f6124b799c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:24.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.425+0000 7f6124b799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:24.425 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.425+0000 7f6124b799c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:24.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.429+0000 7f6124b799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:24.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.429+0000 7f6124b799c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:24.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.429+0000 7f6124b799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:24.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.429+0000 7f6124b799c0 20 started sync module instance, tier type = 2024-09-12T01:21:24.426 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.429+0000 7f6124b799c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:21:24.440 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.441+0000 7f6124b799c0 20 add_watcher() i=0 2024-09-12T01:21:24.440 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.441+0000 7f6124b799c0 20 add_watcher() i=1 2024-09-12T01:21:24.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.441+0000 7f6124b799c0 20 add_watcher() i=2 2024-09-12T01:21:24.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.441+0000 7f6124b799c0 20 add_watcher() i=3 2024-09-12T01:21:24.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.441+0000 7f6124b799c0 20 add_watcher() i=4 2024-09-12T01:21:24.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.441+0000 7f6124b799c0 20 add_watcher() i=5 2024-09-12T01:21:24.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.441+0000 7f6124b799c0 20 add_watcher() i=6 2024-09-12T01:21:24.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.445+0000 7f6124b799c0 20 add_watcher() i=7 2024-09-12T01:21:24.441 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.445+0000 7f6124b799c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:21:24.444 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.445+0000 7f5fd8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:21:24.446 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.445+0000 7f6124b799c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:21:24.446 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.445+0000 7f6124b799c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:21:24.446 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.445+0000 7f6124b799c0 5 note: GC not initialized 2024-09-12T01:21:24.446 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.449+0000 7f5f537fe640 20 reqs_thread_entry: start 2024-09-12T01:21:24.446 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.449+0000 7f6124b799c0 20 init_complete bucket index max shards: 1 2024-09-12T01:21:24.446 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.449+0000 7f6124b799c0 20 Filter name: none 2024-09-12T01:21:24.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.449+0000 7f5f517fa640 20 reqs_thread_entry: start 2024-09-12T01:21:24.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.449+0000 7f6124b799c0 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-12T01:21:24.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.449+0000 7f6124b799c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:24.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.449+0000 7f6124b799c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:21:24.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.449+0000 7f6124b799c0 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-12T01:21:24.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.449+0000 7f6124b799c0 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-12T01:21:24.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.449+0000 7f6124b799c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.783 : miss 2024-09-12T01:21:24.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.449+0000 7f6124b799c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:24.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.449+0000 7f6124b799c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:21:24.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.449+0000 7f6124b799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.783 info.flags=0x17 2024-09-12T01:21:24.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.449+0000 7f6124b799c0 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.783 to cache LRU end 2024-09-12T01:21:24.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.449+0000 7f6124b799c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:21:24.447 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.449+0000 7f6124b799c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T01:21:24.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.449+0000 7f6124b799c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.783 2024-09-12T01:21:24.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.449+0000 7f6124b799c0 20 bucket index object: :.dir.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.783.0 2024-09-12T01:21:24.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.449+0000 7f6124b799c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T01:21:24.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.449+0000 7f6124b799c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T01:21:24.448 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.449+0000 7f5fd8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:21:24.452 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.453+0000 7f6124b799c0 20 remove_watcher() i=0 2024-09-12T01:21:24.452 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.453+0000 7f6124b799c0 2 removed watcher, disabling cache 2024-09-12T01:21:24.454 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.457+0000 7f6124b799c0 20 remove_watcher() i=1 2024-09-12T01:21:24.456 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.457+0000 7f6124b799c0 20 remove_watcher() i=2 2024-09-12T01:21:24.457 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.461+0000 7f6124b799c0 20 remove_watcher() i=3 2024-09-12T01:21:24.459 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.461+0000 7f6124b799c0 20 remove_watcher() i=4 2024-09-12T01:21:24.460 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.461+0000 7f6124b799c0 20 remove_watcher() i=5 2024-09-12T01:21:24.461 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.465+0000 7f6124b799c0 20 remove_watcher() i=6 2024-09-12T01:21:24.462 INFO:tasks.workunit.client.0.smithi070.stderr:2024-09-12T01:21:24.465+0000 7f6124b799c0 20 remove_watcher() i=7 2024-09-12T01:21:24.473 INFO:tasks.workunit.client.0.smithi070.stderr:Deleting bucket versioning-bucket 2024-09-12T01:21:24.474 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:21:24.474 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:21:24.479 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:21:24.479 INFO:tasks.workunit.client.0.smithi070.stderr: warnings.warn( 2024-09-12T01:21:24.504 INFO:tasks.workunit.client.0.smithi070.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T01:21:24.504 INFO:tasks.workunit.client.0.smithi070.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T01:21:24.504 INFO:tasks.workunit.client.0.smithi070.stdout:connected to https://localhost:443 2024-09-12T01:21:24.504 INFO:tasks.workunit.client.0.smithi070.stderr:Completed bucket versioning tests 2024-09-12T01:21:24.562 INFO:tasks.workunit.client.0.smithi070.stderr:+ deactivate 2024-09-12T01:21:24.562 INFO:tasks.workunit.client.0.smithi070.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T01:21:24.562 INFO:tasks.workunit.client.0.smithi070.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T01:21:24.562 INFO:tasks.workunit.client.0.smithi070.stderr:+ export PATH 2024-09-12T01:21:24.562 INFO:tasks.workunit.client.0.smithi070.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T01:21:24.562 INFO:tasks.workunit.client.0.smithi070.stderr:+ '[' -n '' ']' 2024-09-12T01:21:24.562 INFO:tasks.workunit.client.0.smithi070.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:21:24.562 INFO:tasks.workunit.client.0.smithi070.stderr:+ hash -r 2024-09-12T01:21:24.563 INFO:tasks.workunit.client.0.smithi070.stderr:+ '[' -n '' ']' 2024-09-12T01:21:24.563 INFO:tasks.workunit.client.0.smithi070.stderr:+ unset VIRTUAL_ENV 2024-09-12T01:21:24.563 INFO:tasks.workunit.client.0.smithi070.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T01:21:24.563 INFO:tasks.workunit.client.0.smithi070.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T01:21:24.563 INFO:tasks.workunit.client.0.smithi070.stderr:+ unset -f deactivate 2024-09-12T01:21:24.563 INFO:tasks.workunit.client.0.smithi070.stderr:+ echo OK. 2024-09-12T01:21:24.564 INFO:tasks.workunit.client.0.smithi070.stdout:OK. 2024-09-12T01:21:24.564 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T01:21:24.564 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T01:21:24.614 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-12T01:21:24.614 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T01:21:25.012 DEBUG:teuthology.parallel:result is None 2024-09-12T01:21:25.012 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:21:25.025 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:21:25.025 DEBUG:teuthology.orchestra.run.smithi070:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:21:25.077 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:21:25.077 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-12T01:21:25.088 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-12T01:21:25.097 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-12T01:21:25.097 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-12T01:21:25.097 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-12T01:21:25.168 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-12T01:21:25.169 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-12T01:21:25.198 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:21:25.198 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:21:25.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.237+0000 7f27184399c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:25.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.237+0000 7f27184399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:25.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.237+0000 7f27184399c0 20 realm 2024-09-12T01:21:25.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.237+0000 7f27184399c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:25.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.237+0000 7f27184399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:25.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.237+0000 7f27184399c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:21:25.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.237+0000 7f27184399c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:25.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.241+0000 7f27184399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:25.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.241+0000 7f27184399c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:25.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.241+0000 7f27184399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:21:25.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.241+0000 7f27184399c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:25.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.241+0000 7f27184399c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:21:25.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.241+0000 7f27184399c0 20 searching for the correct realm 2024-09-12T01:21:25.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.249+0000 7f2716740640 0 -- 172.21.15.70:0/1301094910 >> [v2:172.21.15.70:6816/1979013808,v1:172.21.15.70:6817/1979013808] conn(0x55630f589b60 msgr2=0x55630f58bff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:21:25.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.253+0000 7f271573e640 0 -- 172.21.15.70:0/1301094910 >> [v2:172.21.15.70:6824/2477739226,v1:172.21.15.70:6825/2477739226] conn(0x55630f5917f0 msgr2=0x55630f593be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:21:25.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.261+0000 7f27184399c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:21:25.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.261+0000 7f27184399c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:21:25.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.261+0000 7f27184399c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:21:25.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.261+0000 7f27184399c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:21:25.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.261+0000 7f27184399c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:21:25.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.261+0000 7f27184399c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:21:25.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.261+0000 7f27184399c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:25.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.261+0000 7f27184399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:25.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.261+0000 7f27184399c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:25.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.261+0000 7f27184399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:21:25.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.261+0000 7f27184399c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:25.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.261+0000 7f27184399c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:21:25.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.261+0000 7f27184399c0 20 zone default found 2024-09-12T01:21:25.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.261+0000 7f27184399c0 4 Realm: () 2024-09-12T01:21:25.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.261+0000 7f27184399c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:21:25.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.261+0000 7f27184399c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:21:25.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.261+0000 7f27184399c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:21:25.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.261+0000 7f27184399c0 20 zonegroup default 2024-09-12T01:21:25.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.261+0000 7f27184399c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:25.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.261+0000 7f27184399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:25.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.261+0000 7f27184399c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:25.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.261+0000 7f27184399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:25.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.261+0000 7f27184399c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:25.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.261+0000 7f27184399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:25.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.261+0000 7f27184399c0 20 started sync module instance, tier type = 2024-09-12T01:21:25.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.261+0000 7f27184399c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:21:25.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.277+0000 7f27184399c0 20 add_watcher() i=0 2024-09-12T01:21:25.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.277+0000 7f27184399c0 20 add_watcher() i=1 2024-09-12T01:21:25.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.277+0000 7f27184399c0 20 add_watcher() i=2 2024-09-12T01:21:25.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.277+0000 7f27184399c0 20 add_watcher() i=3 2024-09-12T01:21:25.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.277+0000 7f27184399c0 20 add_watcher() i=4 2024-09-12T01:21:25.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.277+0000 7f27184399c0 20 add_watcher() i=5 2024-09-12T01:21:25.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.277+0000 7f27184399c0 20 add_watcher() i=6 2024-09-12T01:21:25.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.277+0000 7f27184399c0 20 add_watcher() i=7 2024-09-12T01:21:25.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.277+0000 7f27184399c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:21:25.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.281+0000 7f25c77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:21:25.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.281+0000 7f27184399c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:21:25.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.281+0000 7f27184399c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:21:25.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.353+0000 7f25c67fc640 20 reqs_thread_entry: start 2024-09-12T01:21:25.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.353+0000 7f27184399c0 20 init_complete bucket index max shards: 1 2024-09-12T01:21:25.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.353+0000 7f27184399c0 20 Filter name: none 2024-09-12T01:21:25.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.353+0000 7f2537fff640 20 reqs_thread_entry: start 2024-09-12T01:21:25.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.353+0000 7f27184399c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T01:21:25.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.353+0000 7f27184399c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:25.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.357+0000 7f27184399c0 20 rados_obj.operate() r=0 bl.length=482 2024-09-12T01:21:25.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.357+0000 7f27184399c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-12T01:21:25.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.357+0000 7f27184399c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T01:21:25.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.357+0000 7f27184399c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:21:25.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.357+0000 7f27184399c0 10 removing key index: SAKUGCUJRBOELRGUCTMP 2024-09-12T01:21:25.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.361+0000 7f27184399c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.keys:SAKUGCUJRBOELRGUCTMP, ofs0, ns] 2024-09-12T01:21:25.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.361+0000 7f25f97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333743 cookie 93883947656240 notifier 9513 bl.length()=170 2024-09-12T01:21:25.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.361+0000 7f27184399c0 10 removing email index: tester.client.0_test@test.test 2024-09-12T01:21:25.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.361+0000 7f27184399c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T01:21:25.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.361+0000 7f25f8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333655 cookie 93883947652848 notifier 9513 bl.length()=181 2024-09-12T01:21:25.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.361+0000 7f27184399c0 10 removing user buckets index 2024-09-12T01:21:25.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.365+0000 7f27184399c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-12T01:21:25.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.365+0000 7f25f8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333744 cookie 93883947656240 notifier 9513 bl.length()=172 2024-09-12T01:21:25.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.365+0000 7f27184399c0 10 removing user index: tester.client.0 2024-09-12T01:21:25.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.369+0000 7f27184399c0 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-12T01:21:25.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.369+0000 7f27184399c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T01:21:25.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.369+0000 7f25f97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333962 cookie 93883947627264 notifier 9513 bl.length()=164 2024-09-12T01:21:25.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.373+0000 7f25c77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:21:25.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.377+0000 7f27184399c0 20 remove_watcher() i=0 2024-09-12T01:21:25.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.377+0000 7f27184399c0 2 removed watcher, disabling cache 2024-09-12T01:21:25.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.377+0000 7f27184399c0 20 remove_watcher() i=1 2024-09-12T01:21:25.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.381+0000 7f27184399c0 20 remove_watcher() i=2 2024-09-12T01:21:25.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.381+0000 7f27184399c0 20 remove_watcher() i=3 2024-09-12T01:21:25.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.385+0000 7f27184399c0 20 remove_watcher() i=4 2024-09-12T01:21:25.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.385+0000 7f27184399c0 20 remove_watcher() i=5 2024-09-12T01:21:25.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.385+0000 7f27184399c0 20 remove_watcher() i=6 2024-09-12T01:21:25.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:25.389+0000 7f27184399c0 20 remove_watcher() i=7 2024-09-12T01:21:25.397 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-12T01:21:25.407 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-12T01:21:25.418 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-12T01:21:25.482 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T01:21:25.491 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T01:21:25.491 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:21:25.526 INFO:tasks.rgw.client.0.smithi070.stdout:2024-09-12T01:21:25.529+0000 7efe11281640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 38370) UID: 0 2024-09-12T01:21:25.526 INFO:tasks.rgw.client.0.smithi070.stdout:2024-09-12T01:21:25.529+0000 7efe14ac9a40 -1 shutting down 2024-09-12T01:21:55.999 INFO:tasks.rgw.client.0:Stopped 2024-09-12T01:21:55.999 DEBUG:teuthology.orchestra.run.smithi070:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T01:21:56.006 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T01:21:56.062 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T01:21:56.116 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T01:21:56.117 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T01:21:56.117 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T01:21:56.197 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:21:56.197 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:21:56.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.240+0000 7f82c01a29c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:56.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.244+0000 7f82c01a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:56.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.244+0000 7f82c01a29c0 20 realm 2024-09-12T01:21:56.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.244+0000 7f82c01a29c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:56.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.244+0000 7f82c01a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:56.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.244+0000 7f82c01a29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:21:56.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.244+0000 7f82c01a29c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:56.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.244+0000 7f82c01a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:56.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.244+0000 7f82c01a29c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:56.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.244+0000 7f82c01a29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:21:56.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.244+0000 7f82c01a29c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:56.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.244+0000 7f82c01a29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:21:56.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.244+0000 7f82c01a29c0 20 searching for the correct realm 2024-09-12T01:21:56.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.248+0000 7f82bd4a7640 0 -- 172.21.15.70:0/2230280201 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7f82b8047060 msgr2=0x7f82b8055410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:21:56.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.460+0000 7f82bdca8640 0 -- 172.21.15.70:0/2230280201 >> [v2:172.21.15.187:6800/354474645,v1:172.21.15.187:6801/354474645] conn(0x7f82b0018030 msgr2=0x7f82b005e650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:21:56.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.476+0000 7f82c01a29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:21:56.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.476+0000 7f82c01a29c0 20 RGWRados::pool_iterate: got zonegroup_info.6b611f33-16aa-4e06-913f-6bb2ed7b5fff 2024-09-12T01:21:56.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.476+0000 7f82c01a29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:21:56.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.476+0000 7f82c01a29c0 20 RGWRados::pool_iterate: got zone_info.81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 2024-09-12T01:21:56.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.476+0000 7f82c01a29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:21:56.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.476+0000 7f82c01a29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:21:56.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.476+0000 7f82c01a29c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:56.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.476+0000 7f82c01a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:56.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.476+0000 7f82c01a29c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:56.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.476+0000 7f82c01a29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:21:56.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.476+0000 7f82c01a29c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:56.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.480+0000 7f82c01a29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:21:56.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.480+0000 7f82c01a29c0 20 zone default found 2024-09-12T01:21:56.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.480+0000 7f82c01a29c0 4 Realm: () 2024-09-12T01:21:56.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.480+0000 7f82c01a29c0 4 ZoneGroup: default (6b611f33-16aa-4e06-913f-6bb2ed7b5fff) 2024-09-12T01:21:56.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.480+0000 7f82c01a29c0 4 Zone: default (81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1) 2024-09-12T01:21:56.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.480+0000 7f82c01a29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:21:56.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.480+0000 7f82c01a29c0 20 zonegroup default 2024-09-12T01:21:56.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.480+0000 7f82c01a29c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:56.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.480+0000 7f82c01a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:56.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.480+0000 7f82c01a29c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:56.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.480+0000 7f82c01a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:56.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.480+0000 7f82c01a29c0 20 rados->read ofs=0 len=0 2024-09-12T01:21:56.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.480+0000 7f82c01a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:21:56.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.480+0000 7f82c01a29c0 20 started sync module instance, tier type = 2024-09-12T01:21:56.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.480+0000 7f82c01a29c0 20 started zone id=81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1 (name=default) with tier type = 2024-09-12T01:21:56.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.504+0000 7f82c01a29c0 20 add_watcher() i=0 2024-09-12T01:21:56.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.504+0000 7f82c01a29c0 20 add_watcher() i=1 2024-09-12T01:21:56.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.504+0000 7f82c01a29c0 20 add_watcher() i=2 2024-09-12T01:21:56.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.504+0000 7f82c01a29c0 20 add_watcher() i=3 2024-09-12T01:21:56.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.504+0000 7f82c01a29c0 20 add_watcher() i=4 2024-09-12T01:21:56.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.504+0000 7f82c01a29c0 20 add_watcher() i=5 2024-09-12T01:21:56.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.504+0000 7f82c01a29c0 20 add_watcher() i=6 2024-09-12T01:21:56.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.508+0000 7f82c01a29c0 20 add_watcher() i=7 2024-09-12T01:21:56.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.508+0000 7f82c01a29c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:21:56.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.512+0000 7f816ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:21:56.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.512+0000 7f82c01a29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:21:56.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.512+0000 7f82c01a29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:21:56.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.604+0000 7f816efe5640 20 reqs_thread_entry: start 2024-09-12T01:21:56.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.608+0000 7f82c01a29c0 20 init_complete bucket index max shards: 1 2024-09-12T01:21:56.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.608+0000 7f82c01a29c0 20 Filter name: none 2024-09-12T01:21:56.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.608+0000 7f816cfe1640 20 reqs_thread_entry: start 2024-09-12T01:21:56.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.608+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:21:56.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.608+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:56.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.608+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:56.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.612+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43778' 2024-09-12T01:21:56.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.612+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4916454094374792146', time=2024-09-12T03:05:55.774734+0000, chain.objs.size()=1 2024-09-12T01:21:56.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.612+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.158__shadow:mTuGhOTqjBtHQuJWAeu7g0vbc57NoPr_.2Wao1MkYut-BH-461smaPcG8_5FHTNX_0 2024-09-12T01:21:56.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.612+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5179163159197507546', time=2024-09-12T03:05:58.436264+0000, chain.objs.size()=3 2024-09-12T01:21:56.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.612+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.160__multipart_mymultipart-LUKEWARM.2~H5zxgwpZElnKTGdm7isBdHrZeg8MpYt.1 2024-09-12T01:21:56.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.612+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.160__multipart_mymultipart-LUKEWARM.2~H5zxgwpZElnKTGdm7isBdHrZeg8MpYt.2 2024-09-12T01:21:56.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.612+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.160__multipart_mymultipart-LUKEWARM.2~H5zxgwpZElnKTGdm7isBdHrZeg8MpYt.3 2024-09-12T01:21:56.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.612+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1106523458616059616', time=2024-09-12T03:06:21.643857+0000, chain.objs.size()=1 2024-09-12T01:21:56.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.612+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.189__shadow_.e2VdzBopmSxlxRpuA-FJsgB_1zmVhQj_0 2024-09-12T01:21:56.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.612+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~l7QW7R17wWVeVP8Okkn5QgUEuT0Grcu', time=2024-09-12T03:06:39.190529+0000, chain.objs.size()=1 2024-09-12T01:21:56.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.612+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.203__multipart_mymultipart.2~l7QW7R17wWVeVP8Okkn5QgUEuT0Grcu.1 2024-09-12T01:21:56.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.612+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.828732395030995948', time=2024-09-12T03:08:05.046350+0000, chain.objs.size()=1 2024-09-12T01:21:56.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.612+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.231__shadow_._AqUQ_SG_uQBubn7L4G6MeuqSCiQytP_0 2024-09-12T01:21:56.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.612+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17490674320745113437', time=2024-09-12T03:08:11.445392+0000, chain.objs.size()=1 2024-09-12T01:21:56.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.612+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.239__shadow_.cRP-tdamggHSuiAy0557G6KJxAr8vSt_0 2024-09-12T01:21:56.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.612+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8663509041478978410', time=2024-09-12T03:08:16.456013+0000, chain.objs.size()=1 2024-09-12T01:21:56.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.612+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.245__shadow_.bZ2OKFDvbiOS87HNEJFOoayvkukfPSX_0 2024-09-12T01:21:56.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.612+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8630451890541289995', time=2024-09-12T03:08:24.042040+0000, chain.objs.size()=1 2024-09-12T01:21:56.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.612+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.256__shadow_.GE5kvKwLrQRsBep_1K0lSGbjMDzIXlV_0 2024-09-12T01:21:56.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.612+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13557801910437655838', time=2024-09-12T03:08:47.486228+0000, chain.objs.size()=1 2024-09-12T01:21:56.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.612+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.KetCaTbn2l76puA3DdW1nBggIJM3KRz_0 2024-09-12T01:21:56.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.612+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4281148916302744913', time=2024-09-12T03:08:47.517890+0000, chain.objs.size()=1 2024-09-12T01:21:56.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.612+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.fg_HzItIY_I3FXAHMgkBnxaJ7eHyryr_0 2024-09-12T01:21:56.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.784062040535361894', time=2024-09-12T03:08:47.536835+0000, chain.objs.size()=1 2024-09-12T01:21:56.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.FUe7XyT0yVw63Rt-MQxKQXSD-iQLu-F_0 2024-09-12T01:21:56.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7546494227099203026', time=2024-09-12T03:08:47.645604+0000, chain.objs.size()=1 2024-09-12T01:21:56.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.sryRMy9DHaj2-l0qwpE3kfm2mRrl36V_0 2024-09-12T01:21:56.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2410663269767488497', time=2024-09-12T03:08:47.872583+0000, chain.objs.size()=1 2024-09-12T01:21:56.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.rhh1qpMLt0iYyHIu1WHYhvdOJ1PDTow_0 2024-09-12T01:21:56.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14615501415819173902', time=2024-09-12T03:08:47.938369+0000, chain.objs.size()=1 2024-09-12T01:21:56.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.lGxC2rl0Wnb3QKiajGU8sheFA4R02DR_0 2024-09-12T01:21:56.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13272765191061218673', time=2024-09-12T03:08:47.968661+0000, chain.objs.size()=1 2024-09-12T01:21:56.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.rVVu6DnmuYbnLRkogmnaHbnkkNg9_OW_0 2024-09-12T01:21:56.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7144400777775818972', time=2024-09-12T03:08:48.009208+0000, chain.objs.size()=1 2024-09-12T01:21:56.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.zIam4a-VYpiM77rWnjS325GZzrLkPKX_0 2024-09-12T01:21:56.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8666896407761220991', time=2024-09-12T03:08:48.013671+0000, chain.objs.size()=1 2024-09-12T01:21:56.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.q-eMaQw4KZNc67OUe8-TdW4ya-Ut_TG_0 2024-09-12T01:21:56.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3050085657183267143', time=2024-09-12T03:08:48.237964+0000, chain.objs.size()=1 2024-09-12T01:21:56.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.LEiS-OzL9zWRNJKMrH247cl-Rp1diVc_0 2024-09-12T01:21:56.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1084613228757907438', time=2024-09-12T03:08:48.487633+0000, chain.objs.size()=1 2024-09-12T01:21:56.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.hNDG9UkifFjOFAviyFCyNuqZYFjM_1C_0 2024-09-12T01:21:56.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.620+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14729842051618011921', time=2024-09-12T03:08:48.670355+0000, chain.objs.size()=1 2024-09-12T01:21:56.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.620+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.HvEByCKt-tPVwX1vo3CUfo5SSVGYSOk_0 2024-09-12T01:21:56.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.620+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11066800043123402243', time=2024-09-12T03:08:48.699682+0000, chain.objs.size()=1 2024-09-12T01:21:56.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.620+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.rghd5tMqwcq06G3aSfX2JC5WmgamaMY_0 2024-09-12T01:21:56.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17234957719262845575', time=2024-09-12T03:08:48.840592+0000, chain.objs.size()=1 2024-09-12T01:21:56.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.MjbkCfISgy_9R0TdQxhhsPaKAibxrW1_0 2024-09-12T01:21:56.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16524260090310190336', time=2024-09-12T03:08:48.907343+0000, chain.objs.size()=1 2024-09-12T01:21:56.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.HidkEiXmYwBBpZB16dECmXZ_JjmGqEB_0 2024-09-12T01:21:56.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5983120215165791970', time=2024-09-12T03:08:48.949044+0000, chain.objs.size()=1 2024-09-12T01:21:56.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.0SRwLG4Aui4Vr0gxOEx2Cud-LGqflNR_0 2024-09-12T01:21:56.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12192128091604799620', time=2024-09-12T03:08:48.976071+0000, chain.objs.size()=1 2024-09-12T01:21:56.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.WzWTzfJGsIpjgds3g_bdcoasuis3ysd_0 2024-09-12T01:21:56.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6214609919136071778', time=2024-09-12T03:08:49.000395+0000, chain.objs.size()=1 2024-09-12T01:21:56.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.KF7Jtv5704r2kCC155pDUbA9rdc4i_X_0 2024-09-12T01:21:56.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15863967020023111805', time=2024-09-12T03:08:49.190239+0000, chain.objs.size()=1 2024-09-12T01:21:56.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.11gaTCFNqtl83m4wYFScjt3KU8tfBjC_0 2024-09-12T01:21:56.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11378013474458227836', time=2024-09-12T03:08:49.202660+0000, chain.objs.size()=1 2024-09-12T01:21:56.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.shNpQnLkW2bTPtGhMNtm9HjCuVCTEWv_0 2024-09-12T01:21:56.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16458538201192607002', time=2024-09-12T03:08:49.364716+0000, chain.objs.size()=1 2024-09-12T01:21:56.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ygYPeG28pKNO7bbNow4kdpB_aVBpmwT_0 2024-09-12T01:21:56.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3597613025553829631', time=2024-09-12T03:08:49.374812+0000, chain.objs.size()=1 2024-09-12T01:21:56.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.l0zknDfy_wzPwLIUWUwUfFBlA3o6Yx6_0 2024-09-12T01:21:56.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10175067114499041681', time=2024-09-12T03:08:49.549212+0000, chain.objs.size()=1 2024-09-12T01:21:56.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.EkDSnWXL4rBVatmjo94tT06e2EyBdy__0 2024-09-12T01:21:56.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12647197512341332930', time=2024-09-12T03:08:49.606987+0000, chain.objs.size()=1 2024-09-12T01:21:56.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.UtrhL2TXBj5niYpuRI-Q2GYPzxbAH5a_0 2024-09-12T01:21:56.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.528835028353903037', time=2024-09-12T03:08:49.614171+0000, chain.objs.size()=1 2024-09-12T01:21:56.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.QblGwopLWNMPzjDh8JyXKAbaCVBFEOM_0 2024-09-12T01:21:56.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4942775837776290735', time=2024-09-12T03:08:49.733692+0000, chain.objs.size()=1 2024-09-12T01:21:56.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.PGbpXdsjTVlyWsbCJo703UGvAZ4UNEI_0 2024-09-12T01:21:56.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7162771175262050122', time=2024-09-12T03:08:49.877920+0000, chain.objs.size()=1 2024-09-12T01:21:56.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.7xJRZsICKBTGQbjXp_Jt2PXBbiDuoCE_0 2024-09-12T01:21:56.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8014496447472125445', time=2024-09-12T03:08:49.916306+0000, chain.objs.size()=1 2024-09-12T01:21:56.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ViC92kbxORrlyIEyzGWx6goZRxE7scB_0 2024-09-12T01:21:56.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.246483311614016208', time=2024-09-12T03:08:49.953670+0000, chain.objs.size()=1 2024-09-12T01:21:56.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.O3d_SNHcwF2t0bcSTLfv647pauWDkM7_0 2024-09-12T01:21:56.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16374811202268347365', time=2024-09-12T03:08:49.984242+0000, chain.objs.size()=1 2024-09-12T01:21:56.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.FtNt2UFEw3l-4f_Kygko5ifb7oeBn5E_0 2024-09-12T01:21:56.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15563512870903535972', time=2024-09-12T03:08:51.318646+0000, chain.objs.size()=1 2024-09-12T01:21:56.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.265__shadow_.ZAM67VflghUusPTm0s3TmrGdb5JiYnr_0 2024-09-12T01:21:56.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11464720433058756906', time=2024-09-12T03:09:09.236044+0000, chain.objs.size()=1 2024-09-12T01:21:56.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.291__shadow_.WtTiINnbUeNZkYEnbrlYa6FoXR2NylK_0 2024-09-12T01:21:56.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6919790505607109888', time=2024-09-12T03:09:10.270691+0000, chain.objs.size()=1 2024-09-12T01:21:56.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.292__shadow_.SmeWosw8NHiR4GnM1y_xwifT_xvcN4S_0 2024-09-12T01:21:56.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2527277429936061622', time=2024-09-12T03:09:11.652695+0000, chain.objs.size()=1 2024-09-12T01:21:56.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.293__shadow_.Uxc1awbVAGBjNfGafut_lWlt44Oplhr_0 2024-09-12T01:21:56.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1334437778344435787', time=2024-09-12T03:09:11.654019+0000, chain.objs.size()=1 2024-09-12T01:21:56.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.293__shadow_.s6favHjno7Gv6IFw84lotNZNJZecHwK_0 2024-09-12T01:21:56.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11480224125747592131', time=2024-09-12T03:09:13.021161+0000, chain.objs.size()=1 2024-09-12T01:21:56.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.294__shadow_.LRJZHV8dNJu0newnVQnhWiB0MFrU9Mv_0 2024-09-12T01:21:56.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8581885568641093946', time=2024-09-12T03:09:13.062252+0000, chain.objs.size()=1 2024-09-12T01:21:56.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.294__shadow_.rT7NSRI_GGngHCnS6qTeZ0OwkJO-5we_0 2024-09-12T01:21:56.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6404772286861122016', time=2024-09-12T03:09:16.518870+0000, chain.objs.size()=1 2024-09-12T01:21:56.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.299__shadow_.wjsrCCwPwoZ3SWd3JFPxbNRiXeyegS7_0 2024-09-12T01:21:56.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3928136738013198584', time=2024-09-12T03:09:52.913798+0000, chain.objs.size()=1 2024-09-12T01:21:56.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.eSZResOR-TprGKWySFgv2pfptPmUHRC_0 2024-09-12T01:21:56.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15534473212273544369', time=2024-09-12T03:09:52.937372+0000, chain.objs.size()=1 2024-09-12T01:21:56.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.L3NMW4QC-6x8WLWo2aY6nDzyCXYuZF6_0 2024-09-12T01:21:56.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12178338495122641677', time=2024-09-12T03:09:52.986571+0000, chain.objs.size()=1 2024-09-12T01:21:56.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.jUG9tbkMfyE7G1dMuEZjMDvEWveykCc_0 2024-09-12T01:21:56.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6068437934248186780', time=2024-09-12T03:09:53.060171+0000, chain.objs.size()=1 2024-09-12T01:21:56.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.C5sWT5Q-Tsk6pEdbMT-uTbYKGhl9mh3_0 2024-09-12T01:21:56.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6401018756719122958', time=2024-09-12T03:09:53.066999+0000, chain.objs.size()=1 2024-09-12T01:21:56.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ahRAWN3xFPXk7ioLN9mTDvyQ3iLjbzq_0 2024-09-12T01:21:56.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4036366261837587919', time=2024-09-12T03:09:53.114200+0000, chain.objs.size()=1 2024-09-12T01:21:56.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.I5_FH6J0nBfwh0ZN1gNCgq33obN_CXQ_0 2024-09-12T01:21:56.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11434548371669825743', time=2024-09-12T03:09:53.347578+0000, chain.objs.size()=1 2024-09-12T01:21:56.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Zw9bDrAlp795NsghCHXk5CIcgT1nuBb_0 2024-09-12T01:21:56.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3305585378299768823', time=2024-09-12T03:09:53.452069+0000, chain.objs.size()=1 2024-09-12T01:21:56.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.lkEEDSuD187-OYlDq9UsFxArOLHeY70_0 2024-09-12T01:21:56.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8332783416732000685', time=2024-09-12T03:09:53.488524+0000, chain.objs.size()=1 2024-09-12T01:21:56.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ZKZtJiMAZ6QabdePAtX6lyqyT4GIBGc_0 2024-09-12T01:21:56.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.636+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12279056526222064292', time=2024-09-12T03:09:53.638087+0000, chain.objs.size()=1 2024-09-12T01:21:56.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.636+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.pL48cxmYR2DjPF_XeipypeWl-HGVXMo_0 2024-09-12T01:21:56.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.636+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9298116163791242116', time=2024-09-12T03:09:53.681066+0000, chain.objs.size()=1 2024-09-12T01:21:56.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.636+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.gIayIinVojeRC6ovL5qsayVndAlTwmg_0 2024-09-12T01:21:56.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.636+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2740065800157784815', time=2024-09-12T03:09:53.798060+0000, chain.objs.size()=1 2024-09-12T01:21:56.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.636+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.c0ZJWcb_J5vvEyQJ4sDZEVeuDg5QdkX_0 2024-09-12T01:21:56.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.636+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6870601754323083160', time=2024-09-12T03:09:53.810448+0000, chain.objs.size()=1 2024-09-12T01:21:56.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.636+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.z-06RE9aQCdGMgIrqiv_A1slmCA7hC__0 2024-09-12T01:21:56.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.636+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7303382020894016089', time=2024-09-12T03:09:53.977902+0000, chain.objs.size()=1 2024-09-12T01:21:56.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.636+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.GIRlERnzyZKWS4ew_hZ8o_PzWm2T4p__0 2024-09-12T01:21:56.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.636+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14597786847791318940', time=2024-09-12T03:09:53.989788+0000, chain.objs.size()=1 2024-09-12T01:21:56.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.636+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.lwRIddMOe3hZ6gvqOnQv8SjdAgkWsjH_0 2024-09-12T01:21:56.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.636+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.939281425504803219', time=2024-09-12T03:09:54.025992+0000, chain.objs.size()=1 2024-09-12T01:21:56.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.636+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.RHdvgFAMZVvA7flRwcdkCSud8Jxa5NA_0 2024-09-12T01:21:56.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.636+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5707784938608893618', time=2024-09-12T03:09:54.110232+0000, chain.objs.size()=1 2024-09-12T01:21:56.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.636+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.qIU8-A719JXvT7e2TsDyvpBSGfqh6gs_0 2024-09-12T01:21:56.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.640+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8757430794141854108', time=2024-09-12T03:09:54.117624+0000, chain.objs.size()=1 2024-09-12T01:21:56.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.7UVj842nmWG90bMFTLtH0YoGSUKD4dy_0 2024-09-12T01:21:56.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.640+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10592821941027040197', time=2024-09-12T03:09:54.347274+0000, chain.objs.size()=1 2024-09-12T01:21:56.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.YyJ_ztMmHwoUEqn40EntD4-dtuFxef9_0 2024-09-12T01:21:56.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.640+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8124983380822816962', time=2024-09-12T03:09:54.356512+0000, chain.objs.size()=1 2024-09-12T01:21:56.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.yF1E3mDZrMLg8gxk-_lmPDJEW85y5Ne_0 2024-09-12T01:21:56.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.640+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8735467198897444880', time=2024-09-12T03:09:54.403511+0000, chain.objs.size()=1 2024-09-12T01:21:56.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.zpLh4O9fMdmtoPsUl6p3pS5qI5zFzfx_0 2024-09-12T01:21:56.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.640+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8802534204988871942', time=2024-09-12T03:09:54.487204+0000, chain.objs.size()=1 2024-09-12T01:21:56.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Ro1IXCYJbO-KG4HRJn4sQJwv7bnQCDz_0 2024-09-12T01:21:56.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.640+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4654133402861534955', time=2024-09-12T03:09:54.630427+0000, chain.objs.size()=1 2024-09-12T01:21:56.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.7vu5GSgf8PljJpNGTwTrawe1z3HRifN_0 2024-09-12T01:21:56.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.640+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8546183279117764234', time=2024-09-12T03:09:54.678396+0000, chain.objs.size()=1 2024-09-12T01:21:56.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.kozya2SQDh5Kf7OYfWLX1QYMzT0OH2b_0 2024-09-12T01:21:56.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.640+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7853849766212498314', time=2024-09-12T03:09:54.688346+0000, chain.objs.size()=1 2024-09-12T01:21:56.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.r2h-UCB-vWB3JnYRbAC_-koeNo6aOr4_0 2024-09-12T01:21:56.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.644+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1476490464370631796', time=2024-09-12T03:09:54.739768+0000, chain.objs.size()=1 2024-09-12T01:21:56.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.644+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.nSmZMUzw4aS7hRFYLCiOjviu_neehST_0 2024-09-12T01:21:56.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.644+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18111110669539762187', time=2024-09-12T03:09:54.763365+0000, chain.objs.size()=1 2024-09-12T01:21:56.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.644+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.wafYGLz5iBhbmyQ28Jd4NxwmoEwALJU_0 2024-09-12T01:21:56.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.644+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3269378430464968211', time=2024-09-12T03:09:54.945622+0000, chain.objs.size()=1 2024-09-12T01:21:56.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.644+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Op7ctgwjjHU8sx-qgVJZ9zYgFaC3vr4_0 2024-09-12T01:21:56.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.644+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10020157484994957882', time=2024-09-12T03:09:54.962244+0000, chain.objs.size()=1 2024-09-12T01:21:56.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.644+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.2HaD0NnzPAX64lRGV0D6SMLeTtMWVaW_0 2024-09-12T01:21:56.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.644+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11826646058941569622', time=2024-09-12T03:09:54.999982+0000, chain.objs.size()=1 2024-09-12T01:21:56.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.644+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.PCIod4Dgs2G32opvtV5oy-ogT3vAveH_0 2024-09-12T01:21:56.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.644+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13615511960699711176', time=2024-09-12T03:09:55.069362+0000, chain.objs.size()=1 2024-09-12T01:21:56.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.644+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.hXFBbFmlrOovC3aUcbbU_5-RCWVhdfq_0 2024-09-12T01:21:56.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.644+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9815305664410380958', time=2024-09-12T03:09:55.098277+0000, chain.objs.size()=1 2024-09-12T01:21:56.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.644+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.uizj5R6LipPXB9Qr2JHYAjcDJ-gusI6_0 2024-09-12T01:21:56.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.644+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10588789792028751660', time=2024-09-12T03:09:55.099540+0000, chain.objs.size()=1 2024-09-12T01:21:56.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.644+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.mfk9owYIYn3wwpodNi2DsnUk4lPBzUt_0 2024-09-12T01:21:56.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.644+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12719233744286285474', time=2024-09-12T03:09:55.118896+0000, chain.objs.size()=1 2024-09-12T01:21:56.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.644+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.P-9c3vckaT9WmL_Q9gNwGsTUHOI6IFQ_0 2024-09-12T01:21:56.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.644+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16007947558008592163', time=2024-09-12T03:09:55.129426+0000, chain.objs.size()=1 2024-09-12T01:21:56.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.644+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Chb27zOuHSEK6cBQ5E5dKG2mjzSqf5l_0 2024-09-12T01:21:56.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.644+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17635577055555191903', time=2024-09-12T03:09:55.265750+0000, chain.objs.size()=1 2024-09-12T01:21:56.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.644+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.KANTn4fgYIFR24aIoRw7X94y_xxHTF6_0 2024-09-12T01:21:56.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.648+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10929381742532565891', time=2024-09-12T03:09:55.335810+0000, chain.objs.size()=1 2024-09-12T01:21:56.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.648+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.PsfCaZe7sdDta9jiFS5s0PhrujROWez_0 2024-09-12T01:21:56.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.648+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1087190270104184105', time=2024-09-12T03:09:55.372141+0000, chain.objs.size()=1 2024-09-12T01:21:56.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.648+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.wbxp3vp19bIKU3eebdUogE0touv5hgZ_0 2024-09-12T01:21:56.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.648+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13600131777204429340', time=2024-09-12T03:09:55.387247+0000, chain.objs.size()=1 2024-09-12T01:21:56.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.648+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.tSGfaRFPBh9rcj2J2SJhhSWkCl5J1wG_0 2024-09-12T01:21:56.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.648+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.502991803888378238', time=2024-09-12T03:09:55.432687+0000, chain.objs.size()=1 2024-09-12T01:21:56.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.648+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.xqLX2EHU2DCslu_z_qiIUCDhseBrrh8_0 2024-09-12T01:21:56.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.648+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7486227910410270149', time=2024-09-12T03:10:15.303878+0000, chain.objs.size()=1 2024-09-12T01:21:56.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.648+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.wlGV7cYGVbwMUPyW7Au6H-5K7O3kk8J_0 2024-09-12T01:21:56.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.648+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8859260274838313168', time=2024-09-12T03:10:15.326036+0000, chain.objs.size()=1 2024-09-12T01:21:56.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.648+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.pdmxNaXWsnyHtqiNA9x2PZUB8s-ane__0 2024-09-12T01:21:56.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.652+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10157381788984855220', time=2024-09-12T03:10:15.640082+0000, chain.objs.size()=1 2024-09-12T01:21:56.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.652+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ZxRDqg_1sH797YTIooOYoLQlo3zCEsx_0 2024-09-12T01:21:56.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.652+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11978083583943019107', time=2024-09-12T03:10:15.645579+0000, chain.objs.size()=1 2024-09-12T01:21:56.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.652+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.17TOoDhc9BJSwsg8tQ_-LGbUzxJEHnU_0 2024-09-12T01:21:56.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.652+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2356802302680105258', time=2024-09-12T03:10:15.757277+0000, chain.objs.size()=1 2024-09-12T01:21:56.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.652+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.qdVyBLsqVBxOWvVutZXweUGrJ38a4ee_0 2024-09-12T01:21:56.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.652+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2874949083838726063', time=2024-09-12T03:10:15.757963+0000, chain.objs.size()=1 2024-09-12T01:21:56.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.652+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.DicAg-3EJWrHaTCRlaZZOcODG_5NlJ1_0 2024-09-12T01:21:56.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.652+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13520111714104873632', time=2024-09-12T03:10:15.919571+0000, chain.objs.size()=1 2024-09-12T01:21:56.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.652+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.yf_UFfJtYNw6pkxgXLD5bbazMKk2O9i_0 2024-09-12T01:21:56.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.652+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13305521069160355718', time=2024-09-12T03:10:16.001584+0000, chain.objs.size()=1 2024-09-12T01:21:56.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.652+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.cneLbode7qKb4kTjk7tNXOdldyWVLY3_0 2024-09-12T01:21:56.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.652+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13797694487325983118', time=2024-09-12T03:10:16.044753+0000, chain.objs.size()=1 2024-09-12T01:21:56.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.652+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.LTJNanYwmgsv5FybFRSfj_351Bj2NC1_0 2024-09-12T01:21:56.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.656+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11108950033104715206', time=2024-09-12T03:10:16.077267+0000, chain.objs.size()=1 2024-09-12T01:21:56.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.656+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.hoqebBlZ3i8Lc7VO7JrgmKyepwQf7Eq_0 2024-09-12T01:21:56.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.656+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3848461101773814087', time=2024-09-12T03:10:16.087838+0000, chain.objs.size()=1 2024-09-12T01:21:56.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.656+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.tcafVAbrt1Wy69nIA3MbAmQSorRbqC4_0 2024-09-12T01:21:56.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.656+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10762466857492835867', time=2024-09-12T03:10:16.296503+0000, chain.objs.size()=1 2024-09-12T01:21:56.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.656+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.3BdaOdSM_dqd-odcEJ0CLTFXLSU_SxQ_0 2024-09-12T01:21:56.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.656+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.252371431436426278', time=2024-09-12T03:10:16.351516+0000, chain.objs.size()=1 2024-09-12T01:21:56.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.656+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.w-5Hj9egkBbEk7b17P910BzFlKzd1Nb_0 2024-09-12T01:21:56.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.656+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10342251442125625515', time=2024-09-12T03:10:16.612254+0000, chain.objs.size()=1 2024-09-12T01:21:56.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.656+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.y7Ctb75vwcaDDDa8kScOHy2Tf17Ouu3_0 2024-09-12T01:21:56.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/43778 2024-09-12T01:21:56.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-12T01:21:56.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4577572357396819366', time=2024-09-12T03:10:16.944130+0000, chain.objs.size()=1 2024-09-12T01:21:56.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.rfU_JeLBLwnyh2k-PIxhEkTdmw-0x3__0 2024-09-12T01:21:56.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13384870412033394136', time=2024-09-12T03:10:16.983866+0000, chain.objs.size()=1 2024-09-12T01:21:56.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.fo4zedsO90pZlI79oiKxeURnUXEQpMJ_0 2024-09-12T01:21:56.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1896287772137111701', time=2024-09-12T03:10:16.987872+0000, chain.objs.size()=1 2024-09-12T01:21:56.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.M5TH28-Kg4FFCqUHJF--Tkg-TTFgYw2_0 2024-09-12T01:21:56.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5373974111630929483', time=2024-09-12T03:10:16.992110+0000, chain.objs.size()=1 2024-09-12T01:21:56.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.vNhUh6tMrHZ2MZmomgwcyMiHw2g4DA-_0 2024-09-12T01:21:56.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11815841986309371641', time=2024-09-12T03:10:16.994332+0000, chain.objs.size()=1 2024-09-12T01:21:56.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.f26znbfyjjJ7qHdzVLYsS_LX8BDl-aD_0 2024-09-12T01:21:56.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8767760591298990233', time=2024-09-12T03:10:17.131235+0000, chain.objs.size()=1 2024-09-12T01:21:56.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.YODMwtg9-D_9ypQU_RNqwvSauTAXN3V_0 2024-09-12T01:21:56.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6072842060389974871', time=2024-09-12T03:10:17.256638+0000, chain.objs.size()=1 2024-09-12T01:21:56.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.8lqlDHxMTlVpPn0hk9s8kCgqL1dNVmb_0 2024-09-12T01:21:56.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8004842638360134625', time=2024-09-12T03:10:17.439196+0000, chain.objs.size()=1 2024-09-12T01:21:56.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Jcj73kywqy-2rO2bJm5gy-DObZov8EN_0 2024-09-12T01:21:56.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11174515968591901227', time=2024-09-12T03:10:17.446815+0000, chain.objs.size()=1 2024-09-12T01:21:56.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.xuSonPHy7oVeapFTdykNzIbohrKvB4o_0 2024-09-12T01:21:56.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11985894025911047051', time=2024-09-12T03:10:17.455272+0000, chain.objs.size()=1 2024-09-12T01:21:56.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.GQccpvd1_Ps8Y-Zay-PdH_83B90jdGP_0 2024-09-12T01:21:56.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10794661205025971601', time=2024-09-12T03:10:17.591264+0000, chain.objs.size()=1 2024-09-12T01:21:56.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.8U3ZoB-qzl9WSTRAn_108xx4xFO6SNl_0 2024-09-12T01:21:56.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16723815620722233072', time=2024-09-12T03:10:17.745068+0000, chain.objs.size()=1 2024-09-12T01:21:56.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.dyBWzodv6nGXUGrN6v7_Ab63QO6anWI_0 2024-09-12T01:21:56.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.664+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12312160187724563781', time=2024-09-12T03:10:17.756680+0000, chain.objs.size()=1 2024-09-12T01:21:56.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.664+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.nE2iLsmF7kUMpAHcg9Dy5AKrJm_lBXz_0 2024-09-12T01:21:56.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5083885131148434332', time=2024-09-12T03:10:17.789484+0000, chain.objs.size()=1 2024-09-12T01:21:56.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.xV_lMcXhTk6sZ7KevesDD-NX_Tw3s5Z_0 2024-09-12T01:21:56.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7294838995653904478', time=2024-09-12T03:10:17.857231+0000, chain.objs.size()=1 2024-09-12T01:21:56.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.YweEKDuAHm5xI2-NoO3WBB1FxJ8M4hw_0 2024-09-12T01:21:56.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8435335494823420156', time=2024-09-12T03:10:17.905499+0000, chain.objs.size()=1 2024-09-12T01:21:56.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.6cFant_zTC3AsVCFcZGh-5KQo8hGHXp_0 2024-09-12T01:21:56.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8098504324423134311', time=2024-09-12T03:10:27.695415+0000, chain.objs.size()=1 2024-09-12T01:21:56.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.341__shadow_.bfnXbz-32fJyalHvl9RGvkED8eBRA1Z_0 2024-09-12T01:21:56.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10047091403465624075', time=2024-09-12T03:12:29.988533+0000, chain.objs.size()=1 2024-09-12T01:21:56.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.518__shadow_.Bf4FL-xrH7SqjcTfGN29nuTR2vz1JPx_0 2024-09-12T01:21:56.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ihDHtknMb6d7VRw9vXTKsorbmgF9Gz0', time=2024-09-12T03:13:59.139542+0000, chain.objs.size()=1 2024-09-12T01:21:56.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.562__multipart_mymultipart.2~ihDHtknMb6d7VRw9vXTKsorbmgF9Gz0.1 2024-09-12T01:21:56.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15886581638619883407', time=2024-09-12T03:14:13.017879+0000, chain.objs.size()=1 2024-09-12T01:21:56.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:OlqUuD4oUtVnQiCmuUDYNsLzGznNat7_.UhmM3WPX3tUlMHueJVLsEg71mUOdfSZ_0 2024-09-12T01:21:56.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16455726309196773449', time=2024-09-12T03:14:53.778249+0000, chain.objs.size()=1 2024-09-12T01:21:56.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.581__shadow:8QYw-jrzGAJKN0blYPZkhu3EIhFEtdX_.gyODW4f5lIAJKpw6DMEb3V8hga8I3UB_0 2024-09-12T01:21:56.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18388602199761641415', time=2024-09-12T03:14:54.411174+0000, chain.objs.size()=1 2024-09-12T01:21:56.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.583__shadow:QXoar5VKhVEDYUYLy-7eqTJzar3uaxA_.uRmOeaPEvDaMAb6MzgpUzPBEaWnb5Dr_0 2024-09-12T01:21:56.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13733471813372232627', time=2024-09-12T03:14:59.088612+0000, chain.objs.size()=1 2024-09-12T01:21:56.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.588__shadow:pnCjp2j-JCvO3SEUMn68m5orO08.jN5_.rSJGQeFsnIxFeJ699F5-Z8ASiY1zCch_0 2024-09-12T01:21:56.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11603435175378135676', time=2024-09-12T03:17:46.143119+0000, chain.objs.size()=1 2024-09-12T01:21:56.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.636__shadow_.bn8PjC7-z3LnnF4pUyjrDjPGfb1XniF_0 2024-09-12T01:21:56.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12152602452404726108', time=2024-09-12T03:17:58.074497+0000, chain.objs.size()=1 2024-09-12T01:21:56.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.652__shadow_.JJaG6-N6YIdOi25xdU5nIwDy0KZv0MM_0 2024-09-12T01:21:56.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8604664088767456220', time=2024-09-12T03:18:07.135531+0000, chain.objs.size()=6 2024-09-12T01:21:56.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.661__multipart_bar.2~1NbSMoOyhwBpFZpm0NvQOGljP7S7kYQ.1 2024-09-12T01:21:56.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.661__multipart_bar.2~1NbSMoOyhwBpFZpm0NvQOGljP7S7kYQ.2 2024-09-12T01:21:56.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.661__multipart_bar.2~1NbSMoOyhwBpFZpm0NvQOGljP7S7kYQ.3 2024-09-12T01:21:56.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.661__multipart_bar.2~1NbSMoOyhwBpFZpm0NvQOGljP7S7kYQ.4 2024-09-12T01:21:56.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.661__multipart_bar.2~1NbSMoOyhwBpFZpm0NvQOGljP7S7kYQ.5 2024-09-12T01:21:56.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.661__multipart_bar.2~1NbSMoOyhwBpFZpm0NvQOGljP7S7kYQ.6 2024-09-12T01:21:56.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12203173055805328776', time=2024-09-12T03:18:08.290509+0000, chain.objs.size()=1 2024-09-12T01:21:56.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.664__shadow_.Sl0pXlSp19jZscJMIJzaSmNuLLlOQrs_0 2024-09-12T01:21:56.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12994072574573428392', time=2024-09-12T03:18:28.194469+0000, chain.objs.size()=1 2024-09-12T01:21:56.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.697__shadow:0oxH7-7tN-JvGS2jL0q3s-G7azDprj0_.BVPty_Rtu7xLKCGhSKQeayG2DbiJAvY_0 2024-09-12T01:21:56.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18075430061181005963', time=2024-09-12T03:18:30.258575+0000, chain.objs.size()=1 2024-09-12T01:21:56.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.700__shadow:ixH.T6Wo4zCUcrEKHzXqs0nOkKAzFpO_.qmqkwxvGFxq-Px8telziT4XVBJQGtZu_0 2024-09-12T01:21:56.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.680+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:56.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.684+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:21:56.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.684+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:56.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.688+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:56.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.688+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48782' 2024-09-12T01:21:56.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.688+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_XOCBTGXmzJUgbl8iAXi-w8YtKWOP66x', time=2024-09-12T03:06:02.684463+0000, chain.objs.size()=1 2024-09-12T01:21:56.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.688+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.162__shadow_.YbEoz5rGd8zTbx8476F-rYFDXoZH6N-_0 2024-09-12T01:21:56.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.688+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9101448078735936766', time=2024-09-12T03:08:07.037398+0000, chain.objs.size()=1 2024-09-12T01:21:56.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.688+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.234__shadow_.9JWTIMyYICtjuhaH7WhLybBgNveRj_j_0 2024-09-12T01:21:56.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.688+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.860695126050257014', time=2024-09-12T03:08:07.698720+0000, chain.objs.size()=1 2024-09-12T01:21:56.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.688+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.235__shadow_.E1hsBHBVFvVZk0oNINHI_3Qm5Mn7y5e_0 2024-09-12T01:21:56.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.688+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1272554919951887253', time=2024-09-12T03:08:09.119972+0000, chain.objs.size()=1 2024-09-12T01:21:56.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.688+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.237__shadow_.lJcZQqdSJtQvfH12Njw8F_uZs6j2O2Z_0 2024-09-12T01:21:56.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.688+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17780867714847133901', time=2024-09-12T03:08:15.286978+0000, chain.objs.size()=1 2024-09-12T01:21:56.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.688+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.244__shadow_.T6bCvhaD0FaqxLR7sozp-JBoJACstQn_0 2024-09-12T01:21:56.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.688+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17097543913390457352', time=2024-09-12T03:08:21.240697+0000, chain.objs.size()=1 2024-09-12T01:21:56.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.688+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.252__shadow_.sL-JSZ-w2oTkXbBU5_OZ3M4R8Wk1v48_0 2024-09-12T01:21:56.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.688+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4948796277986629659', time=2024-09-12T03:08:22.669401+0000, chain.objs.size()=1 2024-09-12T01:21:56.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.688+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.254__shadow_.ouPn9wyNikFla1Tkmv7FKPww0qObgcX_0 2024-09-12T01:21:56.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.688+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12111490744532481815', time=2024-09-12T03:08:23.360480+0000, chain.objs.size()=1 2024-09-12T01:21:56.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.688+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.255__shadow_.yp9_d3-wMAAhg5YsUyBTeRovsI1mSgx_0 2024-09-12T01:21:56.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.688+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8511916204949767059', time=2024-09-12T03:08:47.448277+0000, chain.objs.size()=1 2024-09-12T01:21:56.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.688+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.C9C4KE_WcKHN55WFNyfCRaheUgf9Vw0_0 2024-09-12T01:21:56.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.688+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9445783448949650944', time=2024-09-12T03:08:47.520050+0000, chain.objs.size()=1 2024-09-12T01:21:56.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.688+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.JD0y8KO6AOibSv6R5WtSJE7_EGKanHk_0 2024-09-12T01:21:56.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.688+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15334754218422003373', time=2024-09-12T03:08:47.630489+0000, chain.objs.size()=1 2024-09-12T01:21:56.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.688+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.M9kqcvKq5L3kYGJAyoy-USXGQCOHmoV_0 2024-09-12T01:21:56.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.688+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12539040234727200227', time=2024-09-12T03:08:47.799899+0000, chain.objs.size()=1 2024-09-12T01:21:56.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.688+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.c5ssLBFWHnrZaOHabEYzq3lcOs7rlTE_0 2024-09-12T01:21:56.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.692+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3738971763988608702', time=2024-09-12T03:08:47.809570+0000, chain.objs.size()=1 2024-09-12T01:21:56.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.692+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.cNuSQFoKtk8SGj7Dq-Lvyzb08Vo4ANr_0 2024-09-12T01:21:56.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.692+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16983101932750224551', time=2024-09-12T03:08:47.862223+0000, chain.objs.size()=1 2024-09-12T01:21:56.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.692+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.i26Fa5Zj0nlkB1vSrxu3zPR7Ouwmm4o_0 2024-09-12T01:21:56.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.692+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11461791416388216733', time=2024-09-12T03:08:47.867202+0000, chain.objs.size()=1 2024-09-12T01:21:56.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.692+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.6X3fy8fPDwVIzgB2pgQbw1c9G9_KVZy_0 2024-09-12T01:21:56.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.692+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.169330865999532144', time=2024-09-12T03:08:47.958526+0000, chain.objs.size()=1 2024-09-12T01:21:56.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.692+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.1NCS-8B5z4U6a_2YLW2--7IVgzDe6_G_0 2024-09-12T01:21:56.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.692+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7697240465262296840', time=2024-09-12T03:08:47.963765+0000, chain.objs.size()=1 2024-09-12T01:21:56.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.692+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.rbaixVEnolmwRhcX5N6tlIolnpjrafu_0 2024-09-12T01:21:56.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.692+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16202557143619537196', time=2024-09-12T03:08:48.185881+0000, chain.objs.size()=1 2024-09-12T01:21:56.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.692+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_._u4gKxVNoArjbx-ighMoMgprD2AbDMO_0 2024-09-12T01:21:56.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.692+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16340180700156170835', time=2024-09-12T03:08:48.241907+0000, chain.objs.size()=1 2024-09-12T01:21:56.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.692+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.2Pz3I52uMTIus29VIwHtyWleisAPgjY_0 2024-09-12T01:21:56.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.692+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11107469387377299454', time=2024-09-12T03:08:48.318654+0000, chain.objs.size()=1 2024-09-12T01:21:56.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.692+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.d38APqx695emKlYxklE1lgfblu-KuFR_0 2024-09-12T01:21:56.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.692+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5288772432735512528', time=2024-09-12T03:08:48.334533+0000, chain.objs.size()=1 2024-09-12T01:21:56.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.692+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.pr-STS9C0t5FU6g8XsQnnNVxbYYg1M5_0 2024-09-12T01:21:56.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.692+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5302508401836358155', time=2024-09-12T03:08:48.498387+0000, chain.objs.size()=1 2024-09-12T01:21:56.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.692+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.imSROrcNOxDLcvDcC8aEiSLeUB9hSNy_0 2024-09-12T01:21:56.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.692+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5349735843104042794', time=2024-09-12T03:08:48.508269+0000, chain.objs.size()=1 2024-09-12T01:21:56.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.692+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.WCyPtCd6-hVoDNRYQZW-348xXhKZWMe_0 2024-09-12T01:21:56.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5473924744180924395', time=2024-09-12T03:08:48.544315+0000, chain.objs.size()=1 2024-09-12T01:21:56.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ND2jJrkcFoWNooEcxcPvTBOuBo0gT_7_0 2024-09-12T01:21:56.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4382082586512671876', time=2024-09-12T03:08:48.626890+0000, chain.objs.size()=1 2024-09-12T01:21:56.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.AjzLimucz_a77FE5Cdi36MBott8YOgz_0 2024-09-12T01:21:56.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6126160302572840526', time=2024-09-12T03:08:48.649957+0000, chain.objs.size()=1 2024-09-12T01:21:56.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.d9jC-VjDIjoJvDQcsyfYsmqBy82QPcP_0 2024-09-12T01:21:56.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5800214749691970784', time=2024-09-12T03:08:48.825972+0000, chain.objs.size()=1 2024-09-12T01:21:56.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.cKuWNDy9looXMw7s_fLfFjaexbDm2PB_0 2024-09-12T01:21:56.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16723389107804746389', time=2024-09-12T03:08:48.833750+0000, chain.objs.size()=1 2024-09-12T01:21:56.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.tg2bDHeWGOkqgLEDosh8wHFeuGfD5s__0 2024-09-12T01:21:56.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3801784258147307730', time=2024-09-12T03:08:48.859083+0000, chain.objs.size()=1 2024-09-12T01:21:56.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.qOyWC39clBDQGgR65INylx8gXEG0fFZ_0 2024-09-12T01:21:56.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10685784284977485009', time=2024-09-12T03:08:48.929031+0000, chain.objs.size()=1 2024-09-12T01:21:56.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.W41GL71lF0yMrdUMjef8ubLKyDl-ZPB_0 2024-09-12T01:21:56.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14650679966489491003', time=2024-09-12T03:08:48.963532+0000, chain.objs.size()=1 2024-09-12T01:21:56.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.x8COorn9UIqpcYcHdTgCW_eUqTTBNyi_0 2024-09-12T01:21:56.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.161542461681136080', time=2024-09-12T03:08:49.035848+0000, chain.objs.size()=1 2024-09-12T01:21:56.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.tiEEmJ7uyizwa34xjnynT41qITmBz6j_0 2024-09-12T01:21:56.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12615027083668242710', time=2024-09-12T03:08:49.180140+0000, chain.objs.size()=1 2024-09-12T01:21:56.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.bhDcLrbuyd9GAgalGsY4oxn2y5R1eYr_0 2024-09-12T01:21:56.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17425767609914536603', time=2024-09-12T03:08:49.293627+0000, chain.objs.size()=1 2024-09-12T01:21:56.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.UsT8_-r4nZVaBojYqTkmSUV6mesKTup_0 2024-09-12T01:21:56.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17524474590592107937', time=2024-09-12T03:08:49.326336+0000, chain.objs.size()=1 2024-09-12T01:21:56.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.n8lLo-P8wLyeSePP9lY4KvIZA-YUZdU_0 2024-09-12T01:21:56.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2297669425992813934', time=2024-09-12T03:08:49.367207+0000, chain.objs.size()=1 2024-09-12T01:21:56.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.UJXz998oDzUE3oCBj3oUfrmrY8INAqm_0 2024-09-12T01:21:56.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18083660107557580095', time=2024-09-12T03:08:49.559244+0000, chain.objs.size()=1 2024-09-12T01:21:56.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.cC0d_ZS7onIIFYsnv2cp4XCxrZDXoKI_0 2024-09-12T01:21:56.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16525459883780862295', time=2024-09-12T03:08:49.689890+0000, chain.objs.size()=1 2024-09-12T01:21:56.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.696+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.7xAZxtEIMYLICy2MOPwQ7agMKBYAaNY_0 2024-09-12T01:21:56.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.700+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13142858323065336357', time=2024-09-12T03:08:49.957526+0000, chain.objs.size()=1 2024-09-12T01:21:56.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.700+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.2ksI7wpzC3t5Vajm7YVBhq5dAK0UpQo_0 2024-09-12T01:21:56.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.700+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2628424907438606524', time=2024-09-12T03:08:49.981162+0000, chain.objs.size()=1 2024-09-12T01:21:56.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.700+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.slOyLS7eVuJbwOu245DSnUNUi5LeCRU_0 2024-09-12T01:21:56.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.700+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7257640639202406021', time=2024-09-12T03:08:49.987158+0000, chain.objs.size()=1 2024-09-12T01:21:56.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.700+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.1_vfByGObd0_6T3__O26lDerJ_6f7Qj_0 2024-09-12T01:21:56.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.700+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11719742902264552066', time=2024-09-12T03:08:50.025491+0000, chain.objs.size()=1 2024-09-12T01:21:56.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.700+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.V3L2TCwE9sWM7dOVzRQ-Yps5mDEd_NR_0 2024-09-12T01:21:56.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.700+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10930642557228609845', time=2024-09-12T03:08:57.357958+0000, chain.objs.size()=1 2024-09-12T01:21:56.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.700+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.274__shadow_.YkU6p8VKCeuMv4qNz22dzhANMJgxJ_O_0 2024-09-12T01:21:56.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.700+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1984612578121515046', time=2024-09-12T03:08:59.469340+0000, chain.objs.size()=1 2024-09-12T01:21:56.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.700+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.277__shadow_.f_2I0euXNykeHO6004gKKaFIvw_9C9E_0 2024-09-12T01:21:56.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.700+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14286460518062678231', time=2024-09-12T03:09:02.217988+0000, chain.objs.size()=1 2024-09-12T01:21:56.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.700+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.281__shadow_.JU1FE3QtOgft6-tsoxbLoMAJoiQ9OSr_0 2024-09-12T01:21:56.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.700+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6111273436439154103', time=2024-09-12T03:09:02.931662+0000, chain.objs.size()=1 2024-09-12T01:21:56.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.700+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.282__shadow_.R-_CriVDQUnr4XPvxp4uoQvgW_A0Fr2_0 2024-09-12T01:21:56.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.704+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3972673122840572686', time=2024-09-12T03:09:07.159251+0000, chain.objs.size()=1 2024-09-12T01:21:56.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.704+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.288__shadow_.Sw7o1W7H9KpM-uXa6l6qR8NbDZchDj0_0 2024-09-12T01:21:56.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.704+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.831453838602733241', time=2024-09-12T03:09:11.627671+0000, chain.objs.size()=1 2024-09-12T01:21:56.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.704+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.293__shadow_.Ksujk2Zy34SEaULs0kwkw1ImURS2NZq_0 2024-09-12T01:21:56.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.704+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14929763400142255007', time=2024-09-12T03:09:13.071473+0000, chain.objs.size()=1 2024-09-12T01:21:56.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.704+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.294__shadow_.cXxy3gamD3ees35I_jrRfO_RRkEHH83_0 2024-09-12T01:21:56.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.704+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6564866293846632814', time=2024-09-12T03:09:20.068013+0000, chain.objs.size()=1 2024-09-12T01:21:56.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.704+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.304__shadow_.5IKZCY65dntUOvlaCH2jIspQoMx0YOP_0 2024-09-12T01:21:56.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.704+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12841565557838809982', time=2024-09-12T03:09:32.548598+0000, chain.objs.size()=1 2024-09-12T01:21:56.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.704+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.322__shadow_.evrhQSt7sMIFXH58y2uo5hDiMU5I3PZ_0 2024-09-12T01:21:56.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.704+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10291992501170782637', time=2024-09-12T03:09:32.552328+0000, chain.objs.size()=1 2024-09-12T01:21:56.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.704+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.322__shadow_.2pB7OgaFTltkM1oGyNR25AqtqAYofb3_0 2024-09-12T01:21:56.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.704+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12344545278395452234', time=2024-09-12T03:09:52.928097+0000, chain.objs.size()=1 2024-09-12T01:21:56.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.704+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Fgqf_tTA3ADkRG9_5HUvfnWZwj_RvBw_0 2024-09-12T01:21:56.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.704+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3906098143462968784', time=2024-09-12T03:09:53.051561+0000, chain.objs.size()=1 2024-09-12T01:21:56.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.704+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.4Qf9lFz7BD1ga31xMc8Wm2e9d8AMjEi_0 2024-09-12T01:21:56.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.704+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10386157533422493246', time=2024-09-12T03:09:53.061819+0000, chain.objs.size()=1 2024-09-12T01:21:56.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.704+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.-SB5-IVgnUvNOwnaHJe4YLX59zc_I9d_0 2024-09-12T01:21:56.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.704+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13882731429320906', time=2024-09-12T03:09:53.073424+0000, chain.objs.size()=1 2024-09-12T01:21:56.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.704+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.HxzEFdnPdV1ns_fdYO8i20oF71uR4iL_0 2024-09-12T01:21:56.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.704+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10719697214845761148', time=2024-09-12T03:09:53.124687+0000, chain.objs.size()=1 2024-09-12T01:21:56.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.704+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.FzSrHGJ-uSpKRGo2f2XlGfHEpXDpU3b_0 2024-09-12T01:21:56.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.704+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.260307212268410373', time=2024-09-12T03:09:53.282093+0000, chain.objs.size()=1 2024-09-12T01:21:56.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.704+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.0FXa-74y9WmuaR8Q96kP9EyLcMdO-1r_0 2024-09-12T01:21:56.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6052660905554159650', time=2024-09-12T03:09:53.383248+0000, chain.objs.size()=1 2024-09-12T01:21:56.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Bun02IZLx04yB15cC500StCZSh1oWjk_0 2024-09-12T01:21:56.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8153504980738494139', time=2024-09-12T03:09:53.482303+0000, chain.objs.size()=1 2024-09-12T01:21:56.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Tt-F_q-nD63IEdpeakj6bBXQnHzbEru_0 2024-09-12T01:21:56.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.703888942258507694', time=2024-09-12T03:09:53.772844+0000, chain.objs.size()=1 2024-09-12T01:21:56.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.y2yHLBgkh6JNNGIiSYpCJgEgEMj6AT8_0 2024-09-12T01:21:56.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15892230279929277182', time=2024-09-12T03:09:53.839551+0000, chain.objs.size()=1 2024-09-12T01:21:56.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Cx-OCDt3MXHFKdAAuStfqQGCiRbMUKf_0 2024-09-12T01:21:56.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16771603072125598298', time=2024-09-12T03:09:54.024574+0000, chain.objs.size()=1 2024-09-12T01:21:56.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.pwWatBn0DaTGSvW-dXSYwNg-OEN0idu_0 2024-09-12T01:21:56.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2707740663404560022', time=2024-09-12T03:09:54.089121+0000, chain.objs.size()=1 2024-09-12T01:21:56.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.RM3aOkKz8sD4S6r_VR0TQJcyHyAtm9C_0 2024-09-12T01:21:56.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13663601058606723400', time=2024-09-12T03:09:54.094882+0000, chain.objs.size()=1 2024-09-12T01:21:56.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.XKxQdB044OqU387-dPnd9nlOgVOrMxS_0 2024-09-12T01:21:56.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4882101723636302264', time=2024-09-12T03:09:54.115362+0000, chain.objs.size()=1 2024-09-12T01:21:56.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.7JHSrHDXDcwlaENPXK_AWfZR24lbwRK_0 2024-09-12T01:21:56.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4633793713099777915', time=2024-09-12T03:09:54.345568+0000, chain.objs.size()=1 2024-09-12T01:21:56.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.-5If2ZQIGjpViUAbbhAGKQ5g_KVV_2c_0 2024-09-12T01:21:56.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15159266507278358651', time=2024-09-12T03:09:54.351320+0000, chain.objs.size()=1 2024-09-12T01:21:56.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.TMo-t-xZcHAqeW3WVovTU9ojRe5GO5n_0 2024-09-12T01:21:56.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18409397408729503809', time=2024-09-12T03:09:54.354901+0000, chain.objs.size()=1 2024-09-12T01:21:56.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.LDSKihi8Z5YGTpSzPPbBgggJrRRkFOb_0 2024-09-12T01:21:56.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4191053798992306105', time=2024-09-12T03:09:54.367275+0000, chain.objs.size()=1 2024-09-12T01:21:56.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.qT0t_NBUuzRgudUnsmqcX835LZTp7r9_0 2024-09-12T01:21:56.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10933408297292191169', time=2024-09-12T03:09:54.410674+0000, chain.objs.size()=1 2024-09-12T01:21:56.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.rX7dLAEMUrz8_YRpmC3LTZMYuMH1jT5_0 2024-09-12T01:21:56.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10896202912071693237', time=2024-09-12T03:09:54.477749+0000, chain.objs.size()=1 2024-09-12T01:21:56.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.96EvfXCTooOPfI0SCtTcLrW3Xbz2Wd6_0 2024-09-12T01:21:56.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.449693947927296106', time=2024-09-12T03:09:54.639052+0000, chain.objs.size()=1 2024-09-12T01:21:56.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.J3gqdyMGgaFujq_dvbSm9VjdJWE_Vy5_0 2024-09-12T01:21:56.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7783231043481660128', time=2024-09-12T03:09:54.725842+0000, chain.objs.size()=1 2024-09-12T01:21:56.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.vTCsWy8obBdat6IXG6c1q3Ab-uDpI9U_0 2024-09-12T01:21:56.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9026673788008258874', time=2024-09-12T03:09:54.768829+0000, chain.objs.size()=1 2024-09-12T01:21:56.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.QA_yD6rQXV5TglSzvqfRMtyUg_kH7qu_0 2024-09-12T01:21:56.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16147791209103690268', time=2024-09-12T03:09:54.791616+0000, chain.objs.size()=1 2024-09-12T01:21:56.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ZIRrHoaosmsW8ugZ3c2Uy1aHbajj5D0_0 2024-09-12T01:21:56.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7252483526386730310', time=2024-09-12T03:09:54.960561+0000, chain.objs.size()=1 2024-09-12T01:21:56.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.XUxsBpD0d3hgaAkrDcxrmGy5mw2UqIr_0 2024-09-12T01:21:56.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1837439439259876489', time=2024-09-12T03:09:54.984403+0000, chain.objs.size()=1 2024-09-12T01:21:56.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.3a7x_zNuqyzATcjYyWtKZMLgNRvo1m1_0 2024-09-12T01:21:56.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10552384138124501799', time=2024-09-12T03:09:54.999409+0000, chain.objs.size()=1 2024-09-12T01:21:56.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.srHJ4o9p9pZBnWtRFU79nkuLeJebAmd_0 2024-09-12T01:21:56.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17344671056377818837', time=2024-09-12T03:09:55.114317+0000, chain.objs.size()=1 2024-09-12T01:21:56.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.EyUV2PE-aILK0yIwVxJPF1fgBfRBL-3_0 2024-09-12T01:21:56.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8282699224331519776', time=2024-09-12T03:09:55.309939+0000, chain.objs.size()=1 2024-09-12T01:21:56.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.MUpRusP8KqzcXVO1kB46Gw4CKr-ZNVF_0 2024-09-12T01:21:56.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6156279664300655069', time=2024-09-12T03:09:55.338016+0000, chain.objs.size()=1 2024-09-12T01:21:56.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.HX-Qo3c-i1Gtubt6lLIHgC5QvJRJZIT_0 2024-09-12T01:21:56.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6733633348634682561', time=2024-09-12T03:09:55.386877+0000, chain.objs.size()=1 2024-09-12T01:21:56.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.elqE7SRcI0g80zwwWvkUzIbDxarz0An_0 2024-09-12T01:21:56.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8272506336770780566', time=2024-09-12T03:09:55.413208+0000, chain.objs.size()=1 2024-09-12T01:21:56.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.MvxTX88BR9zqqevtEIedZhJeZUVNDRV_0 2024-09-12T01:21:56.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11515312986061489687', time=2024-09-12T03:10:15.318414+0000, chain.objs.size()=1 2024-09-12T01:21:56.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Sj440Y7CQ5HShUc_OgIHw-3EDHYRY_m_0 2024-09-12T01:21:56.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1853782845428393739', time=2024-09-12T03:10:15.331209+0000, chain.objs.size()=1 2024-09-12T01:21:56.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.f2_2JqDFXTOGx4qFI8kecNVEHMYfQWV_0 2024-09-12T01:21:56.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3709903255837531497', time=2024-09-12T03:10:15.380724+0000, chain.objs.size()=1 2024-09-12T01:21:56.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.VIVPVNisuq6ME04ND37wwNPoAnvgiC2_0 2024-09-12T01:21:56.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14495710295020241777', time=2024-09-12T03:10:15.673286+0000, chain.objs.size()=1 2024-09-12T01:21:56.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.OhbYkKKH026yfnXz_7k6mxdyUQy_3LA_0 2024-09-12T01:21:56.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18108924752451024022', time=2024-09-12T03:10:15.755512+0000, chain.objs.size()=1 2024-09-12T01:21:56.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.lkOwxVtO44-OP-97MrkTVw0sHDSTW6o_0 2024-09-12T01:21:56.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.720+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13931957963721163607', time=2024-09-12T03:10:15.909403+0000, chain.objs.size()=1 2024-09-12T01:21:56.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.720+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.J8lE3O4A-G3qESftwT2n3hGDQBEeP3G_0 2024-09-12T01:21:56.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.720+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10595827513941229367', time=2024-09-12T03:10:15.922814+0000, chain.objs.size()=1 2024-09-12T01:21:56.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.720+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.11XdOcGDUnObz_aDLJFWXrpkAWwk67L_0 2024-09-12T01:21:56.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.720+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16889797927920191992', time=2024-09-12T03:10:15.947389+0000, chain.objs.size()=1 2024-09-12T01:21:56.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.720+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.hsK-m3K0sM2doEXKpa_WNBAUKwyzOrO_0 2024-09-12T01:21:56.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.720+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4677993470788609296', time=2024-09-12T03:10:15.958016+0000, chain.objs.size()=1 2024-09-12T01:21:56.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.720+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.usvVa6_dEpSJ1oQKbQAoYoXvsv1M_ZG_0 2024-09-12T01:21:56.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.720+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15734759167719715507', time=2024-09-12T03:10:15.979913+0000, chain.objs.size()=1 2024-09-12T01:21:56.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.720+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.5XWKojKL8_cFNtFHOcn-9iMfCIQdLDc_0 2024-09-12T01:21:56.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.720+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11557124100471319250', time=2024-09-12T03:10:16.071598+0000, chain.objs.size()=1 2024-09-12T01:21:56.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.720+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Tkg5DeXUpAkrgdPO8SmEUo7m2pVUqdl_0 2024-09-12T01:21:56.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.720+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9413186172348986567', time=2024-09-12T03:10:16.217516+0000, chain.objs.size()=1 2024-09-12T01:21:56.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.720+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.HiZepEXzvbAKTe2PwjfZmCEb0oBK0yk_0 2024-09-12T01:21:56.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.720+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.745762819516559829', time=2024-09-12T03:10:16.293585+0000, chain.objs.size()=1 2024-09-12T01:21:56.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.720+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.NuFZUM8AjJBUusl-M-zB5gURHiZp31C_0 2024-09-12T01:21:56.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.720+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18337913393641087915', time=2024-09-12T03:10:16.590774+0000, chain.objs.size()=1 2024-09-12T01:21:56.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.720+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.qz2bxSD2D4CBv4UkXS-3_ZOAq26uy9o_0 2024-09-12T01:21:56.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.720+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1105815964591785154', time=2024-09-12T03:10:16.986688+0000, chain.objs.size()=1 2024-09-12T01:21:56.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.720+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.pUll096mtAN1MQwEkbAgBjVMSeJDa5T_0 2024-09-12T01:21:56.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.720+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14468749279388859630', time=2024-09-12T03:10:16.990888+0000, chain.objs.size()=1 2024-09-12T01:21:56.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.720+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ZBqjTbtqgzeHU9UxhYdwpSxEJBsbW44_0 2024-09-12T01:21:56.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48782 2024-09-12T01:21:56.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T01:21:56.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17310545708649734656', time=2024-09-12T03:10:17.009837+0000, chain.objs.size()=1 2024-09-12T01:21:56.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.nbhuJBlJNNZGL-fkpBb3y7Pf1QGqcDJ_0 2024-09-12T01:21:56.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8166315340636538647', time=2024-09-12T03:10:17.124209+0000, chain.objs.size()=1 2024-09-12T01:21:56.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.fEnRjmimYSd8BiEex5Ix22M9Xh7O8ZC_0 2024-09-12T01:21:56.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14305521540957125528', time=2024-09-12T03:10:17.184529+0000, chain.objs.size()=1 2024-09-12T01:21:56.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.BV7U5iEyl_BT3lxoUTrGjjVHg32KdJa_0 2024-09-12T01:21:56.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5254020051382609630', time=2024-09-12T03:10:17.256893+0000, chain.objs.size()=1 2024-09-12T01:21:56.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.aP3ZkaqJzdL0To440YYvLVd_7qnCSGE_0 2024-09-12T01:21:56.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12493549895838545859', time=2024-09-12T03:10:17.258555+0000, chain.objs.size()=1 2024-09-12T01:21:56.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.js7GFZ1dXkPbU1oSMdgqoxivwadAsVh_0 2024-09-12T01:21:56.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2056289120920576908', time=2024-09-12T03:10:17.280188+0000, chain.objs.size()=1 2024-09-12T01:21:56.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.OdVNBI6-Mr2CETBrVhiUytQ5afRLuVO_0 2024-09-12T01:21:56.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7805421419068923868', time=2024-09-12T03:10:17.306998+0000, chain.objs.size()=1 2024-09-12T01:21:56.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.bO39DAAe7AUNmO3J90fXe40z5kdnEej_0 2024-09-12T01:21:56.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11030574390559639195', time=2024-09-12T03:10:17.339883+0000, chain.objs.size()=1 2024-09-12T01:21:56.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.IPa9jgryJnk1OfIMdlgwXKHvOenybT6_0 2024-09-12T01:21:56.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6884653189092990840', time=2024-09-12T03:10:17.541258+0000, chain.objs.size()=1 2024-09-12T01:21:56.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.WXUtE3El-DP_YgrNrN_502gblwsQNzP_0 2024-09-12T01:21:56.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10969367150842158050', time=2024-09-12T03:10:17.579304+0000, chain.objs.size()=1 2024-09-12T01:21:56.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.hBVm4PN2cnhHSn22mBLPEY5FZH9uAUP_0 2024-09-12T01:21:56.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17106537692533185916', time=2024-09-12T03:10:17.769887+0000, chain.objs.size()=1 2024-09-12T01:21:56.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.QI6dGcQ3Ba6H0BubbUyvCnhxl1X4TSa_0 2024-09-12T01:21:56.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.728+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.124887783624356339', time=2024-09-12T03:10:17.794939+0000, chain.objs.size()=1 2024-09-12T01:21:56.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.728+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.sAE25up1lktAPtfx5kK5ut-w6387p61_0 2024-09-12T01:21:56.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.728+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9316368609815075435', time=2024-09-12T03:10:17.844546+0000, chain.objs.size()=1 2024-09-12T01:21:56.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.728+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.C0puk4oqI8YrD2ZeoYvEeYLY2qI8QW4_0 2024-09-12T01:21:56.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.728+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.488863097757153906', time=2024-09-12T03:10:17.856057+0000, chain.objs.size()=1 2024-09-12T01:21:56.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.728+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Ffz-HMe55Vn6FTsalO5cLZBsY1Aj4U1_0 2024-09-12T01:21:56.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.728+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11205822346162675573', time=2024-09-12T03:10:17.881126+0000, chain.objs.size()=1 2024-09-12T01:21:56.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.728+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.EjKlG6qtE93ClRqpabH8JFRj4z9qDhb_0 2024-09-12T01:21:56.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.728+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13439838516536887390', time=2024-09-12T03:10:19.081568+0000, chain.objs.size()=1 2024-09-12T01:21:56.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.728+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.327__shadow_.Cn6Cy0wdUcp9xr4oKJ1pMrAuBiU1Atv_0 2024-09-12T01:21:56.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.728+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9593555076860086942', time=2024-09-12T03:10:23.251578+0000, chain.objs.size()=1 2024-09-12T01:21:56.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.728+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.334__shadow_.f4whx74gdPSbwcS2JJLe_WJcYGcrSO1_0 2024-09-12T01:21:56.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.728+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9895413800798531908', time=2024-09-12T03:11:12.542031+0000, chain.objs.size()=1 2024-09-12T01:21:56.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.728+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.409__shadow_.JQUPQwKBrzW8s54675afDld1ClbMICP_0 2024-09-12T01:21:56.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.728+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11314241522194587503', time=2024-09-12T03:11:13.202810+0000, chain.objs.size()=1 2024-09-12T01:21:56.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.728+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.410__shadow_.MjMPiqCo8bJj4RzkW9Xgo-bK9Kq19PN_0 2024-09-12T01:21:56.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.732+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8892969677498623073', time=2024-09-12T03:11:46.511512+0000, chain.objs.size()=1 2024-09-12T01:21:56.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.732+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.456__shadow_.dyK9HX0jbpl8B7WgGYl1fxUz01Wuwaj_0 2024-09-12T01:21:56.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.732+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2226295910540207155', time=2024-09-12T03:12:27.004854+0000, chain.objs.size()=1 2024-09-12T01:21:56.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.732+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.517__multipart_mymultipartcopy.2~otCSvI7jszQc-xTJkI_ZexpbutBYBfD.1 2024-09-12T01:21:56.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.732+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8856128920675074529', time=2024-09-12T03:14:15.789467+0000, chain.objs.size()=1 2024-09-12T01:21:56.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.732+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:yRLwD9IbxhifLBF8tcE8pBarGGjZUgX_.PQrgUn1ZMWgpcIh8rUUe9ha9Lia58Bo_0 2024-09-12T01:21:56.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.732+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.636891240301716654', time=2024-09-12T03:14:42.553489+0000, chain.objs.size()=1 2024-09-12T01:21:56.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.732+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:NGla6bxjfldupwQEeKgvK.7zSAhYOoV_.KzxsrB1HNCUJR-cJbbTsWVkALD_vDNq_0 2024-09-12T01:21:56.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.732+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10666281454667307957', time=2024-09-12T03:19:19.948431+0000, chain.objs.size()=3 2024-09-12T01:21:56.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.732+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.744__multipart_mymultipart3.2~1i7F6gLB8nJ8O_0sg7ylTsxQkgnvXh8.1 2024-09-12T01:21:56.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.732+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.744__multipart_mymultipart3.2~1i7F6gLB8nJ8O_0sg7ylTsxQkgnvXh8.2 2024-09-12T01:21:56.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.732+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.744__multipart_mymultipart3.2~1i7F6gLB8nJ8O_0sg7ylTsxQkgnvXh8.3 2024-09-12T01:21:56.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.736+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:56.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.736+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:21:56.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:56.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:56.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44002' 2024-09-12T01:21:56.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17109360545371314775', time=2024-09-12T03:05:58.422187+0000, chain.objs.size()=3 2024-09-12T01:21:56.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.160__multipart_mymultipart-FROZEN.2~HxoQwlg3C60zSo45tiKkm0ka8FScaK7.1 2024-09-12T01:21:56.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.160__multipart_mymultipart-FROZEN.2~HxoQwlg3C60zSo45tiKkm0ka8FScaK7.2 2024-09-12T01:21:56.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.160__multipart_mymultipart-FROZEN.2~HxoQwlg3C60zSo45tiKkm0ka8FScaK7.3 2024-09-12T01:21:56.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_5r5jhdIkok_7Qxhr_ovte8wm6W92HY8', time=2024-09-12T03:06:03.558679+0000, chain.objs.size()=1 2024-09-12T01:21:56.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.164__shadow_.VoqhMjhgmC964fncnSx-20mL5-F4xdb_0 2024-09-12T01:21:56.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11446834913257340879', time=2024-09-12T03:06:15.350785+0000, chain.objs.size()=1 2024-09-12T01:21:56.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.179__shadow_.uq64Hmt4g9TMHy6TPsVUodBUJs1eeVu_0 2024-09-12T01:21:56.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1199600086098111729', time=2024-09-12T03:06:22.319144+0000, chain.objs.size()=1 2024-09-12T01:21:56.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.190__shadow_.5pZjdOEKzze4Q9-JoPjLeiRyOE958pz_0 2024-09-12T01:21:56.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16993305809070798568', time=2024-09-12T03:08:05.046359+0000, chain.objs.size()=1 2024-09-12T01:21:56.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.231__shadow_.jW_dJ6L2rSbjgl5lXlnEEUU6pTq8bAl_0 2024-09-12T01:21:56.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13407763413261405387', time=2024-09-12T03:08:47.461378+0000, chain.objs.size()=1 2024-09-12T01:21:56.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.PPPs-WUizHD7RzIVbMwvBsTMaRgaAqZ_0 2024-09-12T01:21:56.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18080978311139206088', time=2024-09-12T03:08:47.594435+0000, chain.objs.size()=1 2024-09-12T01:21:56.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.zPtV0Z6_63G7a3_1JcHrilkw_wrfSvq_0 2024-09-12T01:21:56.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10136626693177954413', time=2024-09-12T03:08:47.602924+0000, chain.objs.size()=1 2024-09-12T01:21:56.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.RusGZVwOP-hoS0-J-pE8Bd-aDOpiZy9_0 2024-09-12T01:21:56.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4192281172811279137', time=2024-09-12T03:08:47.608172+0000, chain.objs.size()=1 2024-09-12T01:21:56.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.pB9WIQdtk9BKWEnJAofnngtgl_8x6EE_0 2024-09-12T01:21:56.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1899225958634586184', time=2024-09-12T03:08:47.677089+0000, chain.objs.size()=1 2024-09-12T01:21:56.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.gqhpWnsUH5tnZRm9M-yFkES06d7OJKb_0 2024-09-12T01:21:56.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15288155015526874778', time=2024-09-12T03:08:47.677740+0000, chain.objs.size()=1 2024-09-12T01:21:56.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.AWasImAMbUKU6kLcAp81YlWkObjWF2x_0 2024-09-12T01:21:56.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1686470116602224582', time=2024-09-12T03:08:47.825636+0000, chain.objs.size()=1 2024-09-12T01:21:56.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.UrAGFcvWSDIyd44aG7PgNih424WXCSY_0 2024-09-12T01:21:56.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11440230449561272728', time=2024-09-12T03:08:47.850531+0000, chain.objs.size()=1 2024-09-12T01:21:56.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Je_81Ijf-VEzW4JG5BUR41L29jkj0Iz_0 2024-09-12T01:21:56.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15666686680441138897', time=2024-09-12T03:08:47.882164+0000, chain.objs.size()=1 2024-09-12T01:21:56.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.4FPqOptAN7cma9p-Px46TZ4_a4UC-Eg_0 2024-09-12T01:21:56.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5451519401650798096', time=2024-09-12T03:08:47.887955+0000, chain.objs.size()=1 2024-09-12T01:21:56.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ezoaR8hOx-4z3H7uYh3N5wxiNSN_xmK_0 2024-09-12T01:21:56.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8276775211186538264', time=2024-09-12T03:08:47.930918+0000, chain.objs.size()=1 2024-09-12T01:21:56.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.MPjguYuMIWRmdD3ZUpggfEhRBXkXRZF_0 2024-09-12T01:21:56.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3285484735403453831', time=2024-09-12T03:08:47.989513+0000, chain.objs.size()=1 2024-09-12T01:21:56.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.B-5zFjzHAm74zUEey6S-dneRffa-mwb_0 2024-09-12T01:21:56.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9438907118138717546', time=2024-09-12T03:08:48.145075+0000, chain.objs.size()=1 2024-09-12T01:21:56.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.TBPJuhh_fpU298S_7IEDnt5khN_JmHe_0 2024-09-12T01:21:56.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10212371061400330501', time=2024-09-12T03:08:48.274438+0000, chain.objs.size()=1 2024-09-12T01:21:56.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.WLFNDmZMe73B4dUpsbxNqMKWDT1mlIj_0 2024-09-12T01:21:56.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6268618155362037204', time=2024-09-12T03:08:48.487497+0000, chain.objs.size()=1 2024-09-12T01:21:56.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.pCUoQWzrrrn4ymc89NTYY85gVETpOtT_0 2024-09-12T01:21:56.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11738169860617731136', time=2024-09-12T03:08:48.577797+0000, chain.objs.size()=1 2024-09-12T01:21:56.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.8vcC7kL2a0wUAzUHIbpPyLuY0ldqlFs_0 2024-09-12T01:21:56.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.748+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3743921297262980174', time=2024-09-12T03:08:48.599080+0000, chain.objs.size()=1 2024-09-12T01:21:56.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.748+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.HAb7AOK9lb2c4v_rTSlEcUcn9yR4IaE_0 2024-09-12T01:21:56.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.748+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1669657887462262031', time=2024-09-12T03:08:48.633741+0000, chain.objs.size()=1 2024-09-12T01:21:56.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.748+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.wkU__Kb36Z0Qm1uT07cZZEHaHXvWZOl_0 2024-09-12T01:21:56.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.748+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8263596797628338639', time=2024-09-12T03:08:48.844853+0000, chain.objs.size()=1 2024-09-12T01:21:56.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.748+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.s3Ohouy6slpFGlDG4y34VhNMkfhiooY_0 2024-09-12T01:21:56.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.748+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6991871506494006123', time=2024-09-12T03:08:48.907467+0000, chain.objs.size()=1 2024-09-12T01:21:56.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.748+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.6_UOU2-mLvcU-4V9WeoFlZfr--Aom9U_0 2024-09-12T01:21:56.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.748+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1914572381275246407', time=2024-09-12T03:08:49.235134+0000, chain.objs.size()=1 2024-09-12T01:21:56.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.748+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.rWb0ncVPcHp--gXSLWDUzPuDf3HKPPC_0 2024-09-12T01:21:56.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.748+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16951646570188022877', time=2024-09-12T03:08:49.299264+0000, chain.objs.size()=1 2024-09-12T01:21:56.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.748+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.rSrjc6HsbCVM1VUt-O96C8A_R1TyOnN_0 2024-09-12T01:21:56.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.748+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5977151334293829123', time=2024-09-12T03:08:49.313025+0000, chain.objs.size()=1 2024-09-12T01:21:56.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.748+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.AKixmjZBwSsGt7NT0g4pYzdf_if2nRl_0 2024-09-12T01:21:56.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.748+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4383813437517883464', time=2024-09-12T03:08:49.340688+0000, chain.objs.size()=1 2024-09-12T01:21:56.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.748+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.OvPyePFSUCJFNdsknOHz6wjuiJ1S4-4_0 2024-09-12T01:21:56.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.748+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16201642396474010545', time=2024-09-12T03:08:49.578815+0000, chain.objs.size()=1 2024-09-12T01:21:56.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.748+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.7Kok__s0yQkS7YduxQdoYKSPnkuzQhE_0 2024-09-12T01:21:56.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.748+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17373797001576011980', time=2024-09-12T03:08:49.601034+0000, chain.objs.size()=1 2024-09-12T01:21:56.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.748+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.VCpki1OqmehoU5jRdAv0IlVtry97Kdk_0 2024-09-12T01:21:56.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.748+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11006320861894533488', time=2024-09-12T03:08:49.604768+0000, chain.objs.size()=1 2024-09-12T01:21:56.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.748+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Tcf6q8PYMu0LeHtDeukuGtUxU77mheM_0 2024-09-12T01:21:56.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.748+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7439958430439711074', time=2024-09-12T03:08:49.649526+0000, chain.objs.size()=1 2024-09-12T01:21:56.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.748+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.lbfKB48l5V3BJrZ4DqaNFhAcvJ95df7_0 2024-09-12T01:21:56.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3585246100876858252', time=2024-09-12T03:08:49.679702+0000, chain.objs.size()=1 2024-09-12T01:21:56.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.mnP4-g-BbYjFFhqBwJN8QKoqVKfdvuq_0 2024-09-12T01:21:56.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5189334889583783800', time=2024-09-12T03:08:49.743368+0000, chain.objs.size()=1 2024-09-12T01:21:56.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.fCr4RtuCW6FBrEe6VHYp4UzICYwchBv_0 2024-09-12T01:21:56.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5140957717375987538', time=2024-09-12T03:08:56.009284+0000, chain.objs.size()=1 2024-09-12T01:21:56.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.272__shadow_.HoIt2Gs9zHH-wFF5so6Xy9M2Ou-D5st_0 2024-09-12T01:21:56.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3709487130379719169', time=2024-09-12T03:09:02.219041+0000, chain.objs.size()=1 2024-09-12T01:21:56.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.281__shadow_.LRa4LYheLbc8yJKT15diLWD83dSGDIF_0 2024-09-12T01:21:56.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2009430841423281134', time=2024-09-12T03:09:05.039331+0000, chain.objs.size()=1 2024-09-12T01:21:56.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.285__shadow_.2IktAHrMsdlBjvHmKk0NxAtlDy2Hpke_0 2024-09-12T01:21:56.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17493667008656584607', time=2024-09-12T03:09:11.604956+0000, chain.objs.size()=1 2024-09-12T01:21:56.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.293__shadow_.2KSndgpIM2jyiijENqny5oSmTDFtXJ__0 2024-09-12T01:21:56.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1532026625694003028', time=2024-09-12T03:09:52.914339+0000, chain.objs.size()=1 2024-09-12T01:21:56.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.lGibT-Gmrlb1LY8TY1qWFh991dOfTj3_0 2024-09-12T01:21:56.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11035556187880816539', time=2024-09-12T03:09:52.937257+0000, chain.objs.size()=1 2024-09-12T01:21:56.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.tCh06PofSC5GdWz5ifCn48sGSVmMU8f_0 2024-09-12T01:21:56.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15766025045579446726', time=2024-09-12T03:09:53.344925+0000, chain.objs.size()=1 2024-09-12T01:21:56.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.PvabYOGE1CW8M43mqpMqUpvyEWRfAIU_0 2024-09-12T01:21:56.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8216344971492993379', time=2024-09-12T03:09:53.404231+0000, chain.objs.size()=1 2024-09-12T01:21:56.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.4aTD8ikbOsQGHsAt1tY_eHrelQQNJGw_0 2024-09-12T01:21:56.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16720574320978318998', time=2024-09-12T03:09:53.455761+0000, chain.objs.size()=1 2024-09-12T01:21:56.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Ccgh37xWyDrWxYTRwNMbTtKWcWmdtLc_0 2024-09-12T01:21:56.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13420258419160411398', time=2024-09-12T03:09:53.462243+0000, chain.objs.size()=1 2024-09-12T01:21:56.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.MPj_9nYKyIdW-xVO3yjzn22cLF7nEvD_0 2024-09-12T01:21:56.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7400850681942805450', time=2024-09-12T03:09:53.473607+0000, chain.objs.size()=1 2024-09-12T01:21:56.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.udPVilbv1wsNk3NAMLEFl3qk8evqX3f_0 2024-09-12T01:21:56.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12121412057038417386', time=2024-09-12T03:09:53.482488+0000, chain.objs.size()=1 2024-09-12T01:21:56.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Jo9zLyyeQlzSaA3gxJZdSir228f-Yzt_0 2024-09-12T01:21:56.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13324234317241425577', time=2024-09-12T03:09:53.490186+0000, chain.objs.size()=1 2024-09-12T01:21:56.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.KYD7LXiej-jV5d9jEP5kNQXrVH5dagJ_0 2024-09-12T01:21:56.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17569683742213931038', time=2024-09-12T03:09:53.667886+0000, chain.objs.size()=1 2024-09-12T01:21:56.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.EEIe43A3xl5JkP3Skwoi-zH4Q5C8g28_0 2024-09-12T01:21:56.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5768991884118812702', time=2024-09-12T03:09:53.793717+0000, chain.objs.size()=1 2024-09-12T01:21:56.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.opQnSK-Dnytn2gJ993iVasBwCcKrOvk_0 2024-09-12T01:21:56.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.756+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11856802280367159457', time=2024-09-12T03:09:53.818227+0000, chain.objs.size()=1 2024-09-12T01:21:56.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.756+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.8F_7ezNk5CZYGkCZNKXXimPR2sAiMJ__0 2024-09-12T01:21:56.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.756+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13341268447603196618', time=2024-09-12T03:09:53.840372+0000, chain.objs.size()=1 2024-09-12T01:21:56.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.756+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.QvXGIkzqybYd5kPRFEfFDUAzBbD1-sg_0 2024-09-12T01:21:56.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.756+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4499153455602601317', time=2024-09-12T03:09:53.844062+0000, chain.objs.size()=1 2024-09-12T01:21:56.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.756+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.iBJwptkuDjjcTJ7Hdi9hj4xuVQgizcw_0 2024-09-12T01:21:56.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.756+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9465630938050048131', time=2024-09-12T03:09:54.015421+0000, chain.objs.size()=1 2024-09-12T01:21:56.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.756+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.0aas2Hjg99S19JKJTtSYzjWhD24d5Rq_0 2024-09-12T01:21:56.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.756+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13921513137849762990', time=2024-09-12T03:09:54.060069+0000, chain.objs.size()=1 2024-09-12T01:21:56.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.756+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Ux9hFWqYiltxhMzc8tXidclACJ5kiEs_0 2024-09-12T01:21:56.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.756+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11724998185915953025', time=2024-09-12T03:09:54.146818+0000, chain.objs.size()=1 2024-09-12T01:21:56.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.756+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.H1at-VIVwcpxrpirPrka4SOBueq698I_0 2024-09-12T01:21:56.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.756+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16109200248000830894', time=2024-09-12T03:09:54.154488+0000, chain.objs.size()=1 2024-09-12T01:21:56.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.756+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.vFaAAWP5EzKED-eRhfAE4Lzma2qd_Xa_0 2024-09-12T01:21:56.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.756+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10938057756033247239', time=2024-09-12T03:09:54.163103+0000, chain.objs.size()=1 2024-09-12T01:21:56.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.756+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.5D9nssVWLSuXOAsJqNUiXcDOgSyq03H_0 2024-09-12T01:21:56.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.756+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13652136004662545678', time=2024-09-12T03:09:54.329199+0000, chain.objs.size()=1 2024-09-12T01:21:56.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.756+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.GepaFBD_ObW1etz84Dvb7_dvCX8iyMe_0 2024-09-12T01:21:56.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.756+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13930556236487895152', time=2024-09-12T03:09:54.361990+0000, chain.objs.size()=1 2024-09-12T01:21:56.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.756+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.MbRoXRFRSe49s5XWvBCa0tpnqoPBDVl_0 2024-09-12T01:21:56.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.756+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.329828214372641755', time=2024-09-12T03:09:54.381133+0000, chain.objs.size()=1 2024-09-12T01:21:56.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.756+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.I1oeoYnZP2NF0ZtweIAlEidssRZDYAf_0 2024-09-12T01:21:56.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.756+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12242567452662717646', time=2024-09-12T03:09:54.465953+0000, chain.objs.size()=1 2024-09-12T01:21:56.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.756+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.vzg0J__LJUpvaA5A_2UIu-BDL5gDMkc_0 2024-09-12T01:21:56.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.760+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5791892706543490585', time=2024-09-12T03:09:54.665824+0000, chain.objs.size()=1 2024-09-12T01:21:56.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.760+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.WmYisR9I4be9pt8BYzb0I57UBN9mi_y_0 2024-09-12T01:21:56.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.760+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15501861367029806840', time=2024-09-12T03:09:54.817321+0000, chain.objs.size()=1 2024-09-12T01:21:56.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.760+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.DrShYMt3zRajwgoq6DrbBkNFKHCTq4K_0 2024-09-12T01:21:56.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.760+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11573016583084700566', time=2024-09-12T03:09:54.972018+0000, chain.objs.size()=1 2024-09-12T01:21:56.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.760+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.wazTWS1r01nIWW5OFTr_S5ty0NumSkj_0 2024-09-12T01:21:56.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.760+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6305248070591110208', time=2024-09-12T03:09:55.150000+0000, chain.objs.size()=1 2024-09-12T01:21:56.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.760+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.cXq_42dquV8i_PDF_a21siPr-hd8uUb_0 2024-09-12T01:21:56.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.760+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4025441134604837522', time=2024-09-12T03:09:55.266229+0000, chain.objs.size()=1 2024-09-12T01:21:56.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.760+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.0twzWHh1-sy-gOgZu6uLCA_vBIb2z--_0 2024-09-12T01:21:56.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.760+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11628120632956870532', time=2024-09-12T03:10:15.221856+0000, chain.objs.size()=1 2024-09-12T01:21:56.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.760+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.TbLi_psPFYJzPNV25I1rkuo8AWQJ6D8_0 2024-09-12T01:21:56.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.760+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8812564369997769177', time=2024-09-12T03:10:15.274498+0000, chain.objs.size()=1 2024-09-12T01:21:56.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.760+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.AbyG2g5FPo4tZo2PigLz6pLDb1_-ZVa_0 2024-09-12T01:21:56.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.760+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8654231296203832397', time=2024-09-12T03:10:15.342259+0000, chain.objs.size()=1 2024-09-12T01:21:56.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.760+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.dlt3cEU_t2vAll3E4NSZSrStb03Z4xZ_0 2024-09-12T01:21:56.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.760+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1410715688759392431', time=2024-09-12T03:10:15.376811+0000, chain.objs.size()=1 2024-09-12T01:21:56.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.760+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.zhC0dnQo76THJXzqyAgPK_ZkOaRDXqn_0 2024-09-12T01:21:56.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.760+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324975660071227310', time=2024-09-12T03:10:15.598402+0000, chain.objs.size()=1 2024-09-12T01:21:56.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.760+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.P-1hZyP6NcWzxn2yz2E7FI43z4ks58r_0 2024-09-12T01:21:56.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.760+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11024629258895186075', time=2024-09-12T03:10:15.632688+0000, chain.objs.size()=1 2024-09-12T01:21:56.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.760+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.q8MvY8hUzvuxRu6tlROd1dZfCvx7Lwl_0 2024-09-12T01:21:56.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.760+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8863263250042947700', time=2024-09-12T03:10:15.743773+0000, chain.objs.size()=1 2024-09-12T01:21:56.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.760+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.BW2ZU6IK1AHorycbGcEZ0WCCFzxntsl_0 2024-09-12T01:21:56.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2559258423299191806', time=2024-09-12T03:10:15.883705+0000, chain.objs.size()=1 2024-09-12T01:21:56.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.UbJTEBMRCUSc95zvXGWUhiGGpNx0OSB_0 2024-09-12T01:21:56.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1191315433080018713', time=2024-09-12T03:10:15.892087+0000, chain.objs.size()=1 2024-09-12T01:21:56.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.BKDQctMR7JziTdRYp2S_x4DcglNXSAv_0 2024-09-12T01:21:56.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2248063746085805456', time=2024-09-12T03:10:16.021019+0000, chain.objs.size()=1 2024-09-12T01:21:56.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Y57pFPpP_f93s1g1ZGPPnywGYmGV8TX_0 2024-09-12T01:21:56.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1032106432506260969', time=2024-09-12T03:10:16.028843+0000, chain.objs.size()=1 2024-09-12T01:21:56.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ybp2w8kDFTslJ01l_3xJu_BfBvQE_5y_0 2024-09-12T01:21:56.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12818413799986182243', time=2024-09-12T03:10:16.076378+0000, chain.objs.size()=1 2024-09-12T01:21:56.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.vXIXJ1DryjqTPkRlmXUxH2CKjHH9xZZ_0 2024-09-12T01:21:56.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8157845293904321335', time=2024-09-12T03:10:16.341518+0000, chain.objs.size()=1 2024-09-12T01:21:56.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.sG-V3URa82oTQOCCweUdFvx--1PIbu3_0 2024-09-12T01:21:56.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9147154430400174304', time=2024-09-12T03:10:16.839788+0000, chain.objs.size()=1 2024-09-12T01:21:56.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Fs0Ys0yvV5tEDr7OdmKd9X18H_9PPKo_0 2024-09-12T01:21:56.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4831643799584468506', time=2024-09-12T03:10:16.896515+0000, chain.objs.size()=1 2024-09-12T01:21:56.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.jdLpX4vkiGM5ooxBkgSE6lw1K5Q6U-y_0 2024-09-12T01:21:56.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9352854266701201358', time=2024-09-12T03:10:16.902780+0000, chain.objs.size()=1 2024-09-12T01:21:56.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.EsjOvQeQlV7pOa9Q_IWy4uCLw8dEeig_0 2024-09-12T01:21:56.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12354779144559852396', time=2024-09-12T03:10:16.956763+0000, chain.objs.size()=1 2024-09-12T01:21:56.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.eGBLzYjBrRi8Dw7p1TZ2n1idgEozMZa_0 2024-09-12T01:21:56.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14359674722726166189', time=2024-09-12T03:10:17.270639+0000, chain.objs.size()=1 2024-09-12T01:21:56.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.4uSyQVJ5VRsvKX3MzrIZUJEJZiGaASH_0 2024-09-12T01:21:56.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16429729055261257225', time=2024-09-12T03:10:17.330607+0000, chain.objs.size()=1 2024-09-12T01:21:56.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.vt0mmLA3hPyctRZXAWQNLs1PBIlYL48_0 2024-09-12T01:21:56.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14433153984780599737', time=2024-09-12T03:10:17.442760+0000, chain.objs.size()=1 2024-09-12T01:21:56.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.U4-Cf40C8D19JGzRXEZ_LdyvL-NIN1H_0 2024-09-12T01:21:56.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2244945343497815666', time=2024-09-12T03:10:17.461606+0000, chain.objs.size()=1 2024-09-12T01:21:56.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.e7C514Q-dWtKUcCMX1Ii2AuPOao3Obv_0 2024-09-12T01:21:56.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4027585942092403908', time=2024-09-12T03:10:17.476386+0000, chain.objs.size()=1 2024-09-12T01:21:56.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.zpn0Y0PjvSwKuo0FK0sm85kqir_OBz5_0 2024-09-12T01:21:56.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8300390541371970107', time=2024-09-12T03:10:17.545112+0000, chain.objs.size()=1 2024-09-12T01:21:56.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.srq4-gUWytlfYRy7O6Ykku8dLKL26GE_0 2024-09-12T01:21:56.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13834739757060189017', time=2024-09-12T03:10:17.545863+0000, chain.objs.size()=1 2024-09-12T01:21:56.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.OE-1bTi1A1Fpl0qJNLJ5rBcO2IHTwt__0 2024-09-12T01:21:56.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.768+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13453887969163876951', time=2024-09-12T03:10:17.574348+0000, chain.objs.size()=1 2024-09-12T01:21:56.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.768+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.EFTTVuNMW9qYmJhgysaH71jE3BYoVE5_0 2024-09-12T01:21:56.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.768+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.756333720844571976', time=2024-09-12T03:10:17.819596+0000, chain.objs.size()=1 2024-09-12T01:21:56.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.768+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.UKgfplF7Pu3oHKsFGs_3SiPKJSHXKK3_0 2024-09-12T01:21:56.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.768+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7817258585449112877', time=2024-09-12T03:10:17.874866+0000, chain.objs.size()=1 2024-09-12T01:21:56.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.768+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.y-AQ4WEBbr4NbLNfLwZQV6BeaapcVea_0 2024-09-12T01:21:56.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.768+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16108291271189038260', time=2024-09-12T03:10:53.300425+0000, chain.objs.size()=1 2024-09-12T01:21:56.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.768+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.382__shadow_.9SOmN6Eshe398JZjMw6BBulCYyzNXNa_0 2024-09-12T01:21:56.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.768+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15429335968841651338', time=2024-09-12T03:11:30.561474+0000, chain.objs.size()=1 2024-09-12T01:21:56.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.768+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.435__shadow_.Bu0mxbcjqzPf5wfr8sgyN3R0kaKzs0U_0 2024-09-12T01:21:56.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.768+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.741915787204820345', time=2024-09-12T03:11:57.061751+0000, chain.objs.size()=1 2024-09-12T01:21:56.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.768+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.467__shadow_.uvp1p0E2IchvImSuUE_ahhIhyFe953N_0 2024-09-12T01:21:56.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.768+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14109342772470088459', time=2024-09-12T03:12:22.339016+0000, chain.objs.size()=6 2024-09-12T01:21:56.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.768+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.1 2024-09-12T01:21:56.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.768+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.2 2024-09-12T01:21:56.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.768+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.3 2024-09-12T01:21:56.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.768+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.4 2024-09-12T01:21:56.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.768+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.5 2024-09-12T01:21:56.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.768+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.6 2024-09-12T01:21:56.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.768+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8812846261644749028', time=2024-09-12T03:12:37.630430+0000, chain.objs.size()=1 2024-09-12T01:21:56.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.768+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.521__shadow:rDMphxLT8LAvqKb.i34VISlvQOLCE1a_.eAadsAv_Q7ZcDbz2YJVvggN3rztD6x5_0 2024-09-12T01:21:56.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.768+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14414373457657837841', time=2024-09-12T03:12:37.657573+0000, chain.objs.size()=3 2024-09-12T01:21:56.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.768+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.521__shadow:CUGs-5Um30uLHamcIudstRo-aItCmXA_.jNL74MWko2jogSzaeKtD1mdDlkl4aMU_0 2024-09-12T01:21:56.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.768+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.521__shadow:CUGs-5Um30uLHamcIudstRo-aItCmXA_.jNL74MWko2jogSzaeKtD1mdDlkl4aMU_1 2024-09-12T01:21:56.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.768+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.521__shadow:CUGs-5Um30uLHamcIudstRo-aItCmXA_.jNL74MWko2jogSzaeKtD1mdDlkl4aMU_2 2024-09-12T01:21:56.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.772+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44002 2024-09-12T01:21:56.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T01:21:56.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~BYC4FBvQexRl9lS9EcDWgYWQUAzEPSo', time=2024-09-12T03:12:39.361537+0000, chain.objs.size()=1 2024-09-12T01:21:56.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~BYC4FBvQexRl9lS9EcDWgYWQUAzEPSo.1 2024-09-12T01:21:56.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~NogDQhpVOKUfSzb4X3Ptb-E_TQ9IGqe', time=2024-09-12T03:13:08.845366+0000, chain.objs.size()=1 2024-09-12T01:21:56.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.534__multipart_mymultipart.2~NogDQhpVOKUfSzb4X3Ptb-E_TQ9IGqe.1 2024-09-12T01:21:56.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16154256742405452037', time=2024-09-12T03:13:50.607042+0000, chain.objs.size()=1 2024-09-12T01:21:56.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.554__shadow_.1gEIVcaOZD7_tSZwvaZlL4wt06Fj59w_0 2024-09-12T01:21:56.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13590029731060369289', time=2024-09-12T03:14:11.718650+0000, chain.objs.size()=1 2024-09-12T01:21:56.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:0LcLY8yye1IP6DLUgkidU3KgdVzGHBh_.gRzOOkuO1G4eq_SZOJShXSftVOENtFh_0 2024-09-12T01:21:56.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10176124992549760782', time=2024-09-12T03:14:12.794233+0000, chain.objs.size()=1 2024-09-12T01:21:56.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:Alj49miXVcia1VhzqBb4Yqwx2isrvJ8_.fj9SrHjfcmkeHhj_A0WkJOd3zGyqUa7_0 2024-09-12T01:21:56.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9768304692097968340', time=2024-09-12T03:14:16.408587+0000, chain.objs.size()=1 2024-09-12T01:21:56.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:8SHE5o0SfFC-pHhBGOQUOhUkGhlWRqb_.AGZpUZqqlqhaApb6jg8QfCUuxkAxhtx_0 2024-09-12T01:21:56.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.895829393113732802', time=2024-09-12T03:14:23.404695+0000, chain.objs.size()=1 2024-09-12T01:21:56.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.575__shadow:z.kHleNNDU.Oq21PjXCf14V9rZRdRt0_.xJxLqw2OoRGxOQb6ac3asO3pjm5sVDR_0 2024-09-12T01:21:56.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3289915997360966030', time=2024-09-12T03:14:54.423268+0000, chain.objs.size()=1 2024-09-12T01:21:56.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.583__shadow:IYt6wJ5sigqKQ12KdZnkzI7ZOG2w3Sj_.BBhZiOxUcby3DUgP0Fb1JI8xZMGioee_0 2024-09-12T01:21:56.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7924717813745963412', time=2024-09-12T03:14:58.321813+0000, chain.objs.size()=1 2024-09-12T01:21:56.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.587__shadow:ohAyKGGt55b0aSDNnNnU7D5GZ6vT4r._.QF2PqgIkhjotiWIreqFNkuQWlEcoWtd_0 2024-09-12T01:21:56.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6464790764817775069', time=2024-09-12T03:17:47.559766+0000, chain.objs.size()=1 2024-09-12T01:21:56.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.638__shadow_.cZZ_86dSbNo9cUT09jufeYbLXmlr_B6_0 2024-09-12T01:21:56.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17144827612727526038', time=2024-09-12T03:18:09.221538+0000, chain.objs.size()=1 2024-09-12T01:21:56.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.665__shadow_.gY6j0fTqdT1uwMK0F1KPvqmGjpXKDPh_0 2024-09-12T01:21:56.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11916076226359208351', time=2024-09-12T03:18:35.590459+0000, chain.objs.size()=1 2024-09-12T01:21:56.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.708__shadow:4DiBXFMXAgXcV-cP4L0lCbfemWEFp4L_.28SnmyzWP03lOxG0LqLWUqvpsxbC0Df_0 2024-09-12T01:21:56.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11540073707088617640', time=2024-09-12T03:18:38.334727+0000, chain.objs.size()=1 2024-09-12T01:21:56.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.712__multipart_file1.2~dhFsaTEr2jv6-yvdzU5Bt4X14v4WdcW.1 2024-09-12T01:21:56.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2576916404690093412', time=2024-09-12T03:19:20.647750+0000, chain.objs.size()=1 2024-09-12T01:21:56.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.745__shadow_.0YKdRcpfA4Jfc1RoJ3jIp96F3U0m5Vp_0 2024-09-12T01:21:56.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.780+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:56.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.780+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:21:56.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:56.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:56.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53630' 2024-09-12T01:21:56.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_U07wZ6MXII_5RPg0hIHJf1ffY4HM0Ku', time=2024-09-12T03:06:00.029661+0000, chain.objs.size()=2 2024-09-12T01:21:56.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.161__shadow_.tqfe3jkaGocetO5AOCZNYXWC0yNkVns_0 2024-09-12T01:21:56.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.161__shadow_.tqfe3jkaGocetO5AOCZNYXWC0yNkVns_1 2024-09-12T01:21:56.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.878002650399715385', time=2024-09-12T03:06:17.343718+0000, chain.objs.size()=1 2024-09-12T01:21:56.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.182__shadow_.5d25tEvkRSlFyzXm0efYbrNqNk95GFH_0 2024-09-12T01:21:56.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8045574382534694657', time=2024-09-12T03:08:05.730889+0000, chain.objs.size()=1 2024-09-12T01:21:56.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.232__shadow_.ZdJpicFIIhyQIJTzy6sWp9z3omLj8Rb_0 2024-09-12T01:21:56.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11752142598086021372', time=2024-09-12T03:08:09.119386+0000, chain.objs.size()=1 2024-09-12T01:21:56.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.237__shadow_.vCOxEZHnaKIJxnqGwdVlwf5zEgyJ649_0 2024-09-12T01:21:56.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11877865533899097564', time=2024-09-12T03:08:21.246116+0000, chain.objs.size()=1 2024-09-12T01:21:56.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.252__shadow_.V-4mTfmltiSNAur8Re1yRe88bg7NJXE_0 2024-09-12T01:21:56.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7289644082535255061', time=2024-09-12T03:08:21.919703+0000, chain.objs.size()=1 2024-09-12T01:21:56.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.253__shadow_.ZFM3J8Hy3H4NhwuJiRzr6AzIqb3jsL-_0 2024-09-12T01:21:56.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3487070098276309786', time=2024-09-12T03:08:47.572783+0000, chain.objs.size()=1 2024-09-12T01:21:56.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.-HWWnz5TvMqQkQwO7m7ozFFCGlD3Swc_0 2024-09-12T01:21:56.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10965258722627762147', time=2024-09-12T03:08:47.590138+0000, chain.objs.size()=1 2024-09-12T01:21:56.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.D9ICjYOvmZ6BNhM-NBorZu8Ba8PP-hq_0 2024-09-12T01:21:56.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6946243396861289993', time=2024-09-12T03:08:47.591181+0000, chain.objs.size()=1 2024-09-12T01:21:56.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ut_khe4WE98QYOqE0CTeyLTq6kaJYp__0 2024-09-12T01:21:56.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13232045666164236211', time=2024-09-12T03:08:48.213262+0000, chain.objs.size()=1 2024-09-12T01:21:56.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.h-wY-4glLjwbwjzZjF0KsA7qpNh4lPy_0 2024-09-12T01:21:56.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9470570820457383821', time=2024-09-12T03:08:48.268545+0000, chain.objs.size()=1 2024-09-12T01:21:56.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Kd1pT66TjC2suMO7Pwaw_QLeZpThrTX_0 2024-09-12T01:21:56.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8204522137530827692', time=2024-09-12T03:08:48.511263+0000, chain.objs.size()=1 2024-09-12T01:21:56.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.633gAW30dWIOMdsaR8UxTSg27i4osZN_0 2024-09-12T01:21:56.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14002379803610453947', time=2024-09-12T03:08:48.542126+0000, chain.objs.size()=1 2024-09-12T01:21:56.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.jret5FBBhTEt3W3WN-XemXB7NJ5gdAX_0 2024-09-12T01:21:56.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10207460589011698646', time=2024-09-12T03:08:48.574842+0000, chain.objs.size()=1 2024-09-12T01:21:56.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.bnwCZESX-Wyc8sHej93gEI5HPX7RXJT_0 2024-09-12T01:21:56.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.673675801333411094', time=2024-09-12T03:08:48.581423+0000, chain.objs.size()=1 2024-09-12T01:21:56.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.VA6wXCNuSGn5V6ZI1JzITJEpz7VkPcn_0 2024-09-12T01:21:56.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8682099759626701448', time=2024-09-12T03:08:48.621554+0000, chain.objs.size()=1 2024-09-12T01:21:56.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.qI_U9t_5fYbeFUXnkkfwfsNJuPIYAZN_0 2024-09-12T01:21:56.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4409040037293302043', time=2024-09-12T03:08:48.627056+0000, chain.objs.size()=1 2024-09-12T01:21:56.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.u34l9K0rv1rKuyXZU98f8pzoo5To5b4_0 2024-09-12T01:21:56.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.289233418449469986', time=2024-09-12T03:08:48.655300+0000, chain.objs.size()=1 2024-09-12T01:21:56.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.MSYqvwwOvL9SH0UUg3UX0_3DCH42j2g_0 2024-09-12T01:21:56.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9408876465359632333', time=2024-09-12T03:08:48.896917+0000, chain.objs.size()=1 2024-09-12T01:21:56.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.IMr2VAJIK3CzQYZ4JcoNWRZ3ZJDyezM_0 2024-09-12T01:21:56.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.88213247630870901', time=2024-09-12T03:08:48.902454+0000, chain.objs.size()=1 2024-09-12T01:21:56.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.TuBXSpswCbM7p6rRqLakNyKFVFDS80t_0 2024-09-12T01:21:56.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5915944038741336200', time=2024-09-12T03:08:48.913270+0000, chain.objs.size()=1 2024-09-12T01:21:56.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.3BwKtaH1tHVrinS1qymxJ6KT9UQ4tPe_0 2024-09-12T01:21:56.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1322390071019817852', time=2024-09-12T03:08:48.953223+0000, chain.objs.size()=1 2024-09-12T01:21:56.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ZGL9fcRyIrPkPIzUOuQPaXO7WgxnJqh_0 2024-09-12T01:21:56.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12078707498687588544', time=2024-09-12T03:08:49.246769+0000, chain.objs.size()=1 2024-09-12T01:21:56.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.8xszLYx5Fvp-DiQ_PLQgDAzow-tibQ-_0 2024-09-12T01:21:56.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6814167312887675687', time=2024-09-12T03:08:49.285246+0000, chain.objs.size()=1 2024-09-12T01:21:56.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ii8BXgdfkwJccx-xQ9QJE6DCqesT8lD_0 2024-09-12T01:21:56.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1660470839721264826', time=2024-09-12T03:08:49.295419+0000, chain.objs.size()=1 2024-09-12T01:21:56.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.-LJkDx7MsNO5tTR_AYqkzWH0RsGKywG_0 2024-09-12T01:21:56.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3443219629388675208', time=2024-09-12T03:08:49.372146+0000, chain.objs.size()=1 2024-09-12T01:21:56.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.VH0tqP6TIwa_rcYyzigkrMCz83p2dF5_0 2024-09-12T01:21:56.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17326518673137593053', time=2024-09-12T03:08:49.379289+0000, chain.objs.size()=1 2024-09-12T01:21:56.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ZUvcnjRl1y28F5RF6Ep241hMrm6jnsf_0 2024-09-12T01:21:56.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10197465718172746466', time=2024-09-12T03:08:49.561786+0000, chain.objs.size()=1 2024-09-12T01:21:56.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.C_5Da7tFxtIgV74n3nWFodqSCKq49SL_0 2024-09-12T01:21:56.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4677015711684807525', time=2024-09-12T03:08:49.664407+0000, chain.objs.size()=1 2024-09-12T01:21:56.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.EH27oVTCVG31jZADaSdZbpSPG9x15OP_0 2024-09-12T01:21:56.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2821770377645294536', time=2024-09-12T03:08:49.666999+0000, chain.objs.size()=1 2024-09-12T01:21:56.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.jhtcldzOe9ipSKnS5RynnSf66dJFVOB_0 2024-09-12T01:21:56.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9295142352408752816', time=2024-09-12T03:08:49.724159+0000, chain.objs.size()=1 2024-09-12T01:21:56.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.D4wWYl0R0FscQeW5CvD3SDtr46yBWsj_0 2024-09-12T01:21:56.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2582771684935576206', time=2024-09-12T03:08:49.865070+0000, chain.objs.size()=1 2024-09-12T01:21:56.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Iw9lNLIls6k3iPga_k6fu4Qm2ILOdtX_0 2024-09-12T01:21:56.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4177994917456820913', time=2024-09-12T03:08:49.883077+0000, chain.objs.size()=1 2024-09-12T01:21:56.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.-T48BJ2SbXz9Occ7FnDJ73DRELHCZIX_0 2024-09-12T01:21:56.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3234673294122031313', time=2024-09-12T03:08:49.913180+0000, chain.objs.size()=1 2024-09-12T01:21:56.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.PAoXnXvNyx5nwy315yUNz0K58NWInqC_0 2024-09-12T01:21:56.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16074211209950506943', time=2024-09-12T03:08:49.965158+0000, chain.objs.size()=1 2024-09-12T01:21:56.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.y4_svjiNN872l08d4bugIzCL-6bVRKR_0 2024-09-12T01:21:56.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3216962009622385794', time=2024-09-12T03:08:50.036641+0000, chain.objs.size()=1 2024-09-12T01:21:56.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ICOwz8bSVHe52h5Q7093UZ8WJeGVwbJ_0 2024-09-12T01:21:56.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6085317234122280621', time=2024-09-12T03:08:56.007013+0000, chain.objs.size()=1 2024-09-12T01:21:56.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.272__shadow_.uRdz8bCEYZCpvlHpwGcfwtg8zGifiEZ_0 2024-09-12T01:21:56.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13198721280270142864', time=2024-09-12T03:08:59.468808+0000, chain.objs.size()=1 2024-09-12T01:21:56.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.277__shadow_.aBLRU0PHG0FVaRWI87wNmH-NrBaEDe6_0 2024-09-12T01:21:56.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14268056366164326827', time=2024-09-12T03:09:00.145183+0000, chain.objs.size()=1 2024-09-12T01:21:56.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.278__shadow_.qjjfH8ouXrvpF0DDazNkx1-e9xnAFrt_0 2024-09-12T01:21:56.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16695062750040270966', time=2024-09-12T03:09:09.234081+0000, chain.objs.size()=1 2024-09-12T01:21:56.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.291__shadow_.Clj2NjDGTu1TQXyhS7lsHkSDQ4XK1Pg_0 2024-09-12T01:21:56.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6365041610760280617', time=2024-09-12T03:09:20.066284+0000, chain.objs.size()=1 2024-09-12T01:21:56.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.304__shadow_.wHPRnuTBZD8SddvFbJ-66p6nJK6hAuc_0 2024-09-12T01:21:56.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11922286273679560357', time=2024-09-12T03:09:20.778919+0000, chain.objs.size()=1 2024-09-12T01:21:56.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.305__shadow_.JrPc6eNihiAcc--gn3LsJn0-BrhozyV_0 2024-09-12T01:21:56.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13892680597048478231', time=2024-09-12T03:09:22.349413+0000, chain.objs.size()=1 2024-09-12T01:21:56.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.307__shadow_.uZdtflyumIW0RBSggiCmHHeE-lKijrU_0 2024-09-12T01:21:56.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2993062096243572280', time=2024-09-12T03:09:53.351724+0000, chain.objs.size()=1 2024-09-12T01:21:56.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.8A6xVaFi3aVbdxJB366cOE3857g7dnR_0 2024-09-12T01:21:56.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6004881661897542596', time=2024-09-12T03:09:53.416455+0000, chain.objs.size()=1 2024-09-12T01:21:56.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Ihrep-kFfwRNIInLYIsZUXgMuj7iwBT_0 2024-09-12T01:21:56.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7462110082298806318', time=2024-09-12T03:09:53.470673+0000, chain.objs.size()=1 2024-09-12T01:21:56.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.8Cy3z9jYPhHhrBbZ10u6_GTbIBeeGq4_0 2024-09-12T01:21:56.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14862360881465037137', time=2024-09-12T03:09:53.504522+0000, chain.objs.size()=1 2024-09-12T01:21:56.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.5ADnSBnyfUXPAv8HF88rwv2twyAbQFk_0 2024-09-12T01:21:56.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6666936376198845088', time=2024-09-12T03:09:53.682973+0000, chain.objs.size()=1 2024-09-12T01:21:56.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.bV5yn7WPoq7c4TszN1Cs2a84ljSlvPa_0 2024-09-12T01:21:56.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10923596260346806503', time=2024-09-12T03:09:53.703892+0000, chain.objs.size()=1 2024-09-12T01:21:56.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.1F3UopDfXonMb_wNXb4s03T7fQ3yeuq_0 2024-09-12T01:21:56.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12843601439808382496', time=2024-09-12T03:09:53.759192+0000, chain.objs.size()=1 2024-09-12T01:21:56.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.VPpXMIwb6W9v3tXrIEmaT9u4DVGbWGH_0 2024-09-12T01:21:56.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4017373460737531526', time=2024-09-12T03:09:54.051532+0000, chain.objs.size()=1 2024-09-12T01:21:56.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.S6JVPgtEmrc3TiM8FBKREkgnIl23WdC_0 2024-09-12T01:21:56.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14866690135003531383', time=2024-09-12T03:09:54.083223+0000, chain.objs.size()=1 2024-09-12T01:21:56.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.tZL3rgh-MDeLUZF9_Burtrq_RZw6uHf_0 2024-09-12T01:21:56.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.583475643333297891', time=2024-09-12T03:09:54.105872+0000, chain.objs.size()=1 2024-09-12T01:21:56.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.TDCk5FyDtiP4gfU8_2c9kx2GppJOtLK_0 2024-09-12T01:21:56.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4987419505283795358', time=2024-09-12T03:09:54.129311+0000, chain.objs.size()=1 2024-09-12T01:21:56.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.UNUSRd5bVl36rMdrcllYs8eOYqknBUA_0 2024-09-12T01:21:56.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16074027991654341536', time=2024-09-12T03:09:54.149953+0000, chain.objs.size()=1 2024-09-12T01:21:56.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.5aYegNkM4zJkRcPUfQsXJ2L4Vv1o7t__0 2024-09-12T01:21:56.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14889978179677407861', time=2024-09-12T03:09:54.298926+0000, chain.objs.size()=1 2024-09-12T01:21:56.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Nlh6Vc9M8Meuht01LNvaL7JatC25DJx_0 2024-09-12T01:21:56.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12843183965720302490', time=2024-09-12T03:09:54.312043+0000, chain.objs.size()=1 2024-09-12T01:21:56.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.MqdrDRB04adHb6-3ExWz0OTHj8EOCBh_0 2024-09-12T01:21:56.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5269037442593846199', time=2024-09-12T03:09:54.347962+0000, chain.objs.size()=1 2024-09-12T01:21:56.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.pttEO4c0c6DUn0cNzIMMHianIJ8JaH1_0 2024-09-12T01:21:56.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10840578007439602233', time=2024-09-12T03:09:54.386832+0000, chain.objs.size()=1 2024-09-12T01:21:56.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.mWuG5sTGnZtmj4GJDC5IxhXO7V8qy_u_0 2024-09-12T01:21:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7655487455772224098', time=2024-09-12T03:09:54.428133+0000, chain.objs.size()=1 2024-09-12T01:21:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.gY9DSt1nlHRhucI_IVJi8a6rIRw_bCQ_0 2024-09-12T01:21:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12359799976996763921', time=2024-09-12T03:09:54.444481+0000, chain.objs.size()=1 2024-09-12T01:21:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.4aL91swlaPQzZj_d1MER2feHDVcz_eT_0 2024-09-12T01:21:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13374967531523846664', time=2024-09-12T03:09:54.506643+0000, chain.objs.size()=1 2024-09-12T01:21:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.6wu3bKzzX2teUho3TjWkXwd9_WBCIjx_0 2024-09-12T01:21:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15075823311276498841', time=2024-09-12T03:09:54.637258+0000, chain.objs.size()=1 2024-09-12T01:21:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.KEq9j-tQ4CEcduuNst0F_Jlj5Lhddvi_0 2024-09-12T01:21:56.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8455626565174904470', time=2024-09-12T03:09:54.679296+0000, chain.objs.size()=1 2024-09-12T01:21:56.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Vo_Ko1GaDNsruOXCT_X6GSniDJHXDfq_0 2024-09-12T01:21:56.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10282338997003856143', time=2024-09-12T03:09:54.768779+0000, chain.objs.size()=1 2024-09-12T01:21:56.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.WrR8_7P3Xri7_FuJX8ZeqT9mEGIOFde_0 2024-09-12T01:21:56.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6302562844614512760', time=2024-09-12T03:09:55.065610+0000, chain.objs.size()=1 2024-09-12T01:21:56.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.UfoQ5pRvf4v9Fm835CXVRw9U7t9scb0_0 2024-09-12T01:21:56.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5452326906918686027', time=2024-09-12T03:09:55.134263+0000, chain.objs.size()=1 2024-09-12T01:21:56.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.PsEvL0Eqidq5yJ0ZDHI-4z1woeVq37C_0 2024-09-12T01:21:56.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12058182632109252961', time=2024-09-12T03:09:55.272226+0000, chain.objs.size()=1 2024-09-12T01:21:56.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.KexHUiV5EAlnjv7-q2XXOLW5Q4Ljbqs_0 2024-09-12T01:21:56.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6462591874678800331', time=2024-09-12T03:09:55.294950+0000, chain.objs.size()=1 2024-09-12T01:21:56.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.gGr3QmeQVzaphvOyCGzTh2HvlFtUk_m_0 2024-09-12T01:21:56.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17208326594061068282', time=2024-09-12T03:10:15.396706+0000, chain.objs.size()=1 2024-09-12T01:21:56.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.JpbqcICvjEf1FuOFPrVXzrFqo5uj8d9_0 2024-09-12T01:21:56.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13948312790297089911', time=2024-09-12T03:10:15.615978+0000, chain.objs.size()=1 2024-09-12T01:21:56.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Ekh2Rt_LEAfFPZuQEspRAnbOAKhwKzS_0 2024-09-12T01:21:56.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4085200286849270848', time=2024-09-12T03:10:15.625785+0000, chain.objs.size()=1 2024-09-12T01:21:56.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.8xceiOAmUfSBZ3AgrBrrqbs64upeJ6Y_0 2024-09-12T01:21:56.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4864153554804170868', time=2024-09-12T03:10:15.763887+0000, chain.objs.size()=1 2024-09-12T01:21:56.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.rOu_IRSJ79pwD46FFs3BGEwsG2tJa9O_0 2024-09-12T01:21:56.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7504907103429156334', time=2024-09-12T03:10:15.890449+0000, chain.objs.size()=1 2024-09-12T01:21:56.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.TT7FlWzYESzh7ASLBNe7nIps3GNUd_B_0 2024-09-12T01:21:56.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13643620332135703928', time=2024-09-12T03:10:15.918398+0000, chain.objs.size()=1 2024-09-12T01:21:56.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.bbJ_zveZe9H3tLSLS008p7oHcJYRNDB_0 2024-09-12T01:21:56.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.804+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17018391242903922386', time=2024-09-12T03:10:16.014572+0000, chain.objs.size()=1 2024-09-12T01:21:56.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.804+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.rSPcy5IMNy19xwWQstfpld4RcRdkfV2_0 2024-09-12T01:21:56.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.804+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16531747816647626899', time=2024-09-12T03:10:16.075170+0000, chain.objs.size()=1 2024-09-12T01:21:56.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.804+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Sd1FuOHXY8dkcxyYuO9My4lq47DHKZ0_0 2024-09-12T01:21:56.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.804+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7311110041794657893', time=2024-09-12T03:10:16.206719+0000, chain.objs.size()=1 2024-09-12T01:21:56.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.804+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.MFgHi0aNlMULs_EMifbe1FB2Mj4sHrm_0 2024-09-12T01:21:56.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.804+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11053221013355661856', time=2024-09-12T03:10:16.215489+0000, chain.objs.size()=1 2024-09-12T01:21:56.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.804+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.HXYDryV0Nh6TF1YN4jIAPo08G3zhaCu_0 2024-09-12T01:21:56.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.804+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3297875441500441732', time=2024-09-12T03:10:16.254800+0000, chain.objs.size()=1 2024-09-12T01:21:56.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.804+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.WzrWUESso9s8nOwwAHl2ArTNQdSt37Z_0 2024-09-12T01:21:56.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.804+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13141765623294771861', time=2024-09-12T03:10:16.258188+0000, chain.objs.size()=1 2024-09-12T01:21:56.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.804+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.9BhYlWtsUas9kf2CN5wqOqdNaumJLgj_0 2024-09-12T01:21:56.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.804+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4966929640815343222', time=2024-09-12T03:10:16.274430+0000, chain.objs.size()=1 2024-09-12T01:21:56.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.804+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.XlHJB57W7uj1tQLjYbZDzdKw1HLVuR3_0 2024-09-12T01:21:56.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.804+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4432183050524068360', time=2024-09-12T03:10:16.289343+0000, chain.objs.size()=1 2024-09-12T01:21:56.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.804+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.KsRSWDAQz3lyexo1PSZCBOAOZIK80XM_0 2024-09-12T01:21:56.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.804+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13643918561966130203', time=2024-09-12T03:10:16.343896+0000, chain.objs.size()=1 2024-09-12T01:21:56.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.804+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.MlSHNk_DGCqzJMOz5RgwcANuCLlw-nB_0 2024-09-12T01:21:56.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.804+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15338995914072027903', time=2024-09-12T03:10:16.586789+0000, chain.objs.size()=1 2024-09-12T01:21:56.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.804+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.CMl7ciAtO3ErBCqZPZ7NgxSfX3yATGT_0 2024-09-12T01:21:56.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.804+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.519561646799677520', time=2024-09-12T03:10:16.814420+0000, chain.objs.size()=1 2024-09-12T01:21:56.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.804+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.LzwIX-t2fqb3v8f2SAW6YuiBEUY8W4z_0 2024-09-12T01:21:56.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.804+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2532026807578194876', time=2024-09-12T03:10:16.911352+0000, chain.objs.size()=1 2024-09-12T01:21:56.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.804+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.xYyjH3E3ghgY8viujAW5qOzZf77hXoq_0 2024-09-12T01:21:56.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.804+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9905197845075494913', time=2024-09-12T03:10:16.920498+0000, chain.objs.size()=1 2024-09-12T01:21:56.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.804+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.5tTHx-2yyIJc5exCd5J29IpLer0_Qku_0 2024-09-12T01:21:56.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17126649195339291729', time=2024-09-12T03:10:16.979693+0000, chain.objs.size()=1 2024-09-12T01:21:56.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.808+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.lL8rX0cFemuQUTlnK21CCQd8sUG2u-2_0 2024-09-12T01:21:56.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4667014677519538429', time=2024-09-12T03:10:17.013233+0000, chain.objs.size()=1 2024-09-12T01:21:56.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.808+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ofFKq1WRm31zAMG9BYSWViUI4WYkVD6_0 2024-09-12T01:21:56.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9817823555004163387', time=2024-09-12T03:10:17.174666+0000, chain.objs.size()=1 2024-09-12T01:21:56.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.808+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ODAOU7CDEwCNeTfXkX04vfb-uv1hYpn_0 2024-09-12T01:21:56.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17051802102198756684', time=2024-09-12T03:10:17.210703+0000, chain.objs.size()=1 2024-09-12T01:21:56.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.808+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.yBhkJ1DpFMY7fu5Zp4wVH7ysdZeyfZu_0 2024-09-12T01:21:56.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12567438407054341229', time=2024-09-12T03:10:17.275572+0000, chain.objs.size()=1 2024-09-12T01:21:56.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.808+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.DdxNUeWka_9xpc6AKFDawqEKvsfvRqe_0 2024-09-12T01:21:56.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12939512456501013790', time=2024-09-12T03:10:17.450632+0000, chain.objs.size()=1 2024-09-12T01:21:56.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.808+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.RQiEy4ORxWcKZnVUi1Ofx0QW6JGylBF_0 2024-09-12T01:21:56.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17617281829174834371', time=2024-09-12T03:10:17.569580+0000, chain.objs.size()=1 2024-09-12T01:21:56.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.808+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_._glkZEqyWumHbIQBkSDj_WI4W_imWLo_0 2024-09-12T01:21:56.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4569420394136716314', time=2024-09-12T03:10:17.586034+0000, chain.objs.size()=1 2024-09-12T01:21:56.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.808+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.JGXEJl6nJLwK0wLGkqYKfds8VV6rrIc_0 2024-09-12T01:21:56.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17382027683612720200', time=2024-09-12T03:10:17.839227+0000, chain.objs.size()=1 2024-09-12T01:21:56.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.808+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.wCHhBIuM4vUC5sKwrTNOba3gpPSBHRV_0 2024-09-12T01:21:56.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10456976149790514384', time=2024-09-12T03:10:17.840539+0000, chain.objs.size()=1 2024-09-12T01:21:56.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.808+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.PvAHCfIlZd1P3B7hjqiRMXpNQMFd_5F_0 2024-09-12T01:21:56.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9697089870486353708', time=2024-09-12T03:10:17.900334+0000, chain.objs.size()=1 2024-09-12T01:21:56.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.808+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.YpeNE4UL9MljcTRVVqy-nz-W9L-hqTf_0 2024-09-12T01:21:56.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16893513574006716483', time=2024-09-12T03:10:20.287285+0000, chain.objs.size()=1 2024-09-12T01:21:56.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.808+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.329__shadow_.qQCgkw7wsXPh9Ze_yAP-nZX9ZN_Z1GL_0 2024-09-12T01:21:56.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/53630 2024-09-12T01:21:56.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T01:21:56.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4392378137480067204', time=2024-09-12T03:10:59.765924+0000, chain.objs.size()=1 2024-09-12T01:21:56.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.391__shadow_.p-vfqMGLAz_yIytqSHgQ9OG630bySTy_0 2024-09-12T01:21:56.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1080378744414420888', time=2024-09-12T03:12:07.364107+0000, chain.objs.size()=1 2024-09-12T01:21:56.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.487__shadow_.iHeJsoQ4g_svHFF6-zOO5O9xrOgN_TZ_0 2024-09-12T01:21:56.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17773417234757554170', time=2024-09-12T03:12:14.427522+0000, chain.objs.size()=1 2024-09-12T01:21:56.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.498__shadow_.ztcVOoAGMINEMbRM72alNnAK9TaUkZv_0 2024-09-12T01:21:56.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2051475451409864934', time=2024-09-12T03:12:24.878889+0000, chain.objs.size()=1 2024-09-12T01:21:56.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.513__shadow_.vTE_XfgMbNtTuF8f3QWfPA36VVdwa8g_0 2024-09-12T01:21:56.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12169904191387964097', time=2024-09-12T03:12:30.121137+0000, chain.objs.size()=1 2024-09-12T01:21:56.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.519__multipart_mymultipart.2~PW3EgW6JEmhFd_Tnm9vp2sAhcMi_Es9.1 2024-09-12T01:21:56.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7357501783261007164', time=2024-09-12T03:12:56.089348+0000, chain.objs.size()=2 2024-09-12T01:21:56.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.524__multipart_mymultipart.2~riHl9G4fKkdjf4CLWkH9vgMY69Woi0F.1 2024-09-12T01:21:56.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.524__multipart_mymultipart.2~riHl9G4fKkdjf4CLWkH9vgMY69Woi0F.2 2024-09-12T01:21:56.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10282110466448132436', time=2024-09-12T03:14:09.600030+0000, chain.objs.size()=1 2024-09-12T01:21:56.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:kKbJs.N3jzbTWb-pIWM3993pJ1A4d1R_.wlDc_bXbl0I807U3XEV4vYz3eTzHNem_0 2024-09-12T01:21:56.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7484096786795590279', time=2024-09-12T03:14:13.820663+0000, chain.objs.size()=1 2024-09-12T01:21:56.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:TlJKiNDzTuljmty3saJ1w1y7lDgrdmB_.Bg7dDSBljX_kw7mh70uopu9XK3wSoiq_0 2024-09-12T01:21:56.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18275817662118635303', time=2024-09-12T03:14:29.184781+0000, chain.objs.size()=1 2024-09-12T01:21:56.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.577__shadow:i2r0jP8PEi.wMzvDY48Di2pOGfSk6LB_.13B9V6PIKT-yAfSx5hr557gIJ-Noz5b_0 2024-09-12T01:21:56.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10003489630162983680', time=2024-09-12T03:14:55.334779+0000, chain.objs.size()=1 2024-09-12T01:21:56.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.584__shadow:VgOrQAATqizsPE9IcfHinMu.VwqjDWL_.IMjEe0JcVOWCjf0IBP7zhkhnihj4qeE_0 2024-09-12T01:21:56.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14241317094987220101', time=2024-09-12T03:17:53.718815+0000, chain.objs.size()=2 2024-09-12T01:21:56.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.647__shadow_.4LmXsH6nuD3hgbbkh9DHaxtFg2bj_Cp_0 2024-09-12T01:21:56.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.816+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.647__shadow_.4LmXsH6nuD3hgbbkh9DHaxtFg2bj_Cp_1 2024-09-12T01:21:56.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.816+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4615325241415358708', time=2024-09-12T03:18:10.089388+0000, chain.objs.size()=1 2024-09-12T01:21:56.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.816+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.666__shadow_.Y_aOAj7IYeu6wqpf-U-p68--nBLYNql_0 2024-09-12T01:21:56.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.816+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11173326856788499296', time=2024-09-12T03:18:18.372228+0000, chain.objs.size()=1 2024-09-12T01:21:56.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.816+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.680__shadow_.wSra--YNnWRU9P05HBuLZqZWejd3KiY_0 2024-09-12T01:21:56.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.816+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5326546158245931428', time=2024-09-12T03:18:26.962596+0000, chain.objs.size()=1 2024-09-12T01:21:56.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.816+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.695__shadow:HaJ6G67Ngse1AVdTL1zpIm4tLtBGkDO_.8MkPx4-4TnyBwD5HLAzA4Y5cmX5C0R6_0 2024-09-12T01:21:56.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.816+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~DrnuxYEi-gjlcLB9Dcawbv7AMN7Jbbi', time=2024-09-12T03:19:18.666849+0000, chain.objs.size()=1 2024-09-12T01:21:56.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.816+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.743__multipart_mymultipart.2~DrnuxYEi-gjlcLB9Dcawbv7AMN7Jbbi.1 2024-09-12T01:21:56.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.816+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:56.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.820+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:21:56.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.820+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:56.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:56.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47233' 2024-09-12T01:21:56.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8517335879760828362', time=2024-09-12T03:08:17.866420+0000, chain.objs.size()=1 2024-09-12T01:21:56.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.247__shadow_.sUFjlggrsrSajmTwRYYim1KeqzcafQY_0 2024-09-12T01:21:56.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6716644238472408212', time=2024-09-12T03:08:18.524009+0000, chain.objs.size()=1 2024-09-12T01:21:56.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.248__shadow_.4bPcmLbsH8ZbN8pEEqV9awimj9ix0xd_0 2024-09-12T01:21:56.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11986652602528613830', time=2024-09-12T03:08:24.720471+0000, chain.objs.size()=1 2024-09-12T01:21:56.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.257__shadow_.Pcnyegp4G83K2gEtKvqnAJB1oRjThG2_0 2024-09-12T01:21:56.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17698741514300652172', time=2024-09-12T03:08:27.447554+0000, chain.objs.size()=1 2024-09-12T01:21:56.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.261__shadow_.JcuLagiu0rT1RYb4Kt9CdQsEan2XTP8_0 2024-09-12T01:21:56.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11446712411241483141', time=2024-09-12T03:08:47.446333+0000, chain.objs.size()=1 2024-09-12T01:21:56.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Y5Wec0obSTj9I1_0bDAJrKXrbwapIge_0 2024-09-12T01:21:56.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2784103196074867131', time=2024-09-12T03:08:47.468681+0000, chain.objs.size()=1 2024-09-12T01:21:56.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.RnMcXgOtn9JfxxZMTl034nEhYGoliOG_0 2024-09-12T01:21:56.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10256881835137285319', time=2024-09-12T03:08:47.485892+0000, chain.objs.size()=1 2024-09-12T01:21:56.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.zcF4neeGziz1iP_Ca4pepaHxYt7Jv69_0 2024-09-12T01:21:56.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4398227718259364542', time=2024-09-12T03:08:47.504687+0000, chain.objs.size()=1 2024-09-12T01:21:56.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.60HXqd-eU3mVNtU_aLvcpidoN3vZrY6_0 2024-09-12T01:21:56.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5673861640608447201', time=2024-09-12T03:08:47.543604+0000, chain.objs.size()=1 2024-09-12T01:21:56.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.hrRcGVbASQaM9bc2PVNdRNIFi3gtPDp_0 2024-09-12T01:21:56.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15679080229828726570', time=2024-09-12T03:08:47.557108+0000, chain.objs.size()=1 2024-09-12T01:21:56.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.UnpGEGXCnghkT6bpycSzmYuAt_zIRfz_0 2024-09-12T01:21:56.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13992375857434587389', time=2024-09-12T03:08:47.575295+0000, chain.objs.size()=1 2024-09-12T01:21:56.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.purdiYvia0ncmEqYTAElB7JgzG772vK_0 2024-09-12T01:21:56.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5544693471965921890', time=2024-09-12T03:08:47.595535+0000, chain.objs.size()=1 2024-09-12T01:21:56.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.dRiIS2FITKTTyJV2FJn-Nns9gfhivqU_0 2024-09-12T01:21:56.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9600659921046740423', time=2024-09-12T03:08:47.636139+0000, chain.objs.size()=1 2024-09-12T01:21:56.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.UKfNLHbSW7myKEhTiu6fxgt9jgrA7Jm_0 2024-09-12T01:21:56.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14452742420901351534', time=2024-09-12T03:08:47.679782+0000, chain.objs.size()=1 2024-09-12T01:21:56.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.p7eicj4EHG9mXaQQpKTr4y53lGQxXTU_0 2024-09-12T01:21:56.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13703255468376460151', time=2024-09-12T03:08:47.861499+0000, chain.objs.size()=1 2024-09-12T01:21:56.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Lh0ZhAl58lG4jmMH9QUm18SUZ5c8_8Y_0 2024-09-12T01:21:56.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11070159094612172019', time=2024-09-12T03:08:47.886421+0000, chain.objs.size()=1 2024-09-12T01:21:56.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.zM-pY8mKx70xgcPimAPdEZKTddqujEE_0 2024-09-12T01:21:56.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8266334467713498800', time=2024-09-12T03:08:47.896565+0000, chain.objs.size()=1 2024-09-12T01:21:56.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.uZhO1kdaiEeui_E6BCrCxJCEhUb4LaE_0 2024-09-12T01:21:56.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5444030073278023595', time=2024-09-12T03:08:47.914236+0000, chain.objs.size()=1 2024-09-12T01:21:56.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.LUO_FxjkpNg9-Z12_Stsuf5vvoUh9dl_0 2024-09-12T01:21:56.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2671358702872808110', time=2024-09-12T03:08:48.216889+0000, chain.objs.size()=1 2024-09-12T01:21:56.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.3Q1Kv09TfZAxdGQM35m5P27RwqyZ6F5_0 2024-09-12T01:21:56.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14412961007954807557', time=2024-09-12T03:08:48.258790+0000, chain.objs.size()=1 2024-09-12T01:21:56.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.xsAaq_WdItkxUAxjefavyrdWVr98xan_0 2024-09-12T01:21:56.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6935463988271777911', time=2024-09-12T03:08:48.626094+0000, chain.objs.size()=1 2024-09-12T01:21:56.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.M62RcR0JbUJ4UQsG92iuvz3P7snqWzP_0 2024-09-12T01:21:56.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9698578981660555186', time=2024-09-12T03:08:48.630713+0000, chain.objs.size()=1 2024-09-12T01:21:56.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.JX3cNCVaAKDb2N0YMYXnynC7mDdcs50_0 2024-09-12T01:21:56.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16774172646612783078', time=2024-09-12T03:08:48.874914+0000, chain.objs.size()=1 2024-09-12T01:21:56.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.wuXFBTJCOcc6beO6uwXqJJ0_UFxo8Sz_0 2024-09-12T01:21:56.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6927656069616782242', time=2024-09-12T03:08:48.926979+0000, chain.objs.size()=1 2024-09-12T01:21:56.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.AJHkIkiWIw9lv6q33BdpbIYu4Wzljdb_0 2024-09-12T01:21:56.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17307997641379569865', time=2024-09-12T03:08:48.955397+0000, chain.objs.size()=1 2024-09-12T01:21:56.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.4_LaEIhGl52O_5-YnsL3Rzt4zXuJCuY_0 2024-09-12T01:21:56.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14254138705640137876', time=2024-09-12T03:08:48.992218+0000, chain.objs.size()=1 2024-09-12T01:21:56.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.RmwWKZdNxEdtpxLnDg_5uNUhK24Iehx_0 2024-09-12T01:21:56.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7847191773920138685', time=2024-09-12T03:08:49.014485+0000, chain.objs.size()=1 2024-09-12T01:21:56.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.iJJeCupaH9G3CcImaCps_3fIvrp0SUj_0 2024-09-12T01:21:56.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3219875781187193314', time=2024-09-12T03:08:49.019465+0000, chain.objs.size()=1 2024-09-12T01:21:56.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.cn-1HXm5lOFQegY9CYQDPyi3EZJK_MV_0 2024-09-12T01:21:56.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7656827687182520445', time=2024-09-12T03:08:49.167869+0000, chain.objs.size()=1 2024-09-12T01:21:56.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.arGe0SBnS7jCfoUgaCnILWgls-WAXMP_0 2024-09-12T01:21:56.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7989233980144140860', time=2024-09-12T03:08:49.289608+0000, chain.objs.size()=1 2024-09-12T01:21:56.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.mko6YvBBGefbc9W1EXLuxiHNaFEjrnb_0 2024-09-12T01:21:56.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2057189520615560260', time=2024-09-12T03:08:49.334531+0000, chain.objs.size()=1 2024-09-12T01:21:56.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.CnJ82UVSkWkvJ9IuaO2ukosXKO72-xN_0 2024-09-12T01:21:56.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9156222590368592976', time=2024-09-12T03:08:49.712618+0000, chain.objs.size()=1 2024-09-12T01:21:56.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.fzapn2EYuv5VGaVJbaV1zQyEDPGm2w__0 2024-09-12T01:21:56.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14996187047310419646', time=2024-09-12T03:08:49.730160+0000, chain.objs.size()=1 2024-09-12T01:21:56.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.7zIwEOzzIDyvkNXPp4xC_NL4CO810jw_0 2024-09-12T01:21:56.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16867624214788943079', time=2024-09-12T03:08:49.882035+0000, chain.objs.size()=1 2024-09-12T01:21:56.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Vm3VNfrO2G0Fg7w-adjZwrUJMfm2YOh_0 2024-09-12T01:21:56.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5619853168157431945', time=2024-09-12T03:08:50.055238+0000, chain.objs.size()=1 2024-09-12T01:21:56.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.bP0YB8WnFAsOMjdawuJKRGd2IdNAVTE_0 2024-09-12T01:21:56.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6761727995395263384', time=2024-09-12T03:08:59.470810+0000, chain.objs.size()=1 2024-09-12T01:21:56.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.277__shadow_.mKWjAbpSYJEQlTZvq8tQ1RVMWSf-MBe_0 2024-09-12T01:21:56.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2982622508125759724', time=2024-09-12T03:09:08.572107+0000, chain.objs.size()=1 2024-09-12T01:21:56.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.290__shadow_.uROIfN5qfA81MzOiZIugewq7lDtc4v5_0 2024-09-12T01:21:56.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3172876870475232382', time=2024-09-12T03:09:13.038613+0000, chain.objs.size()=1 2024-09-12T01:21:56.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.294__shadow_.u-h_VP_2vPvj_g01xJzwZso1b_jr5KO_0 2024-09-12T01:21:56.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13771411328065140386', time=2024-09-12T03:09:13.091235+0000, chain.objs.size()=1 2024-09-12T01:21:56.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.294__shadow_.-fAX9TSaoOO7MPfGZ58uWZZhway_v5F_0 2024-09-12T01:21:56.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9905040506307305415', time=2024-09-12T03:09:20.066123+0000, chain.objs.size()=1 2024-09-12T01:21:56.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.304__shadow_.OekkJUIRdhyWi6NXujuJp6I1GYvWLZ6_0 2024-09-12T01:21:56.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17055692758834698410', time=2024-09-12T03:09:20.780720+0000, chain.objs.size()=1 2024-09-12T01:21:56.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.305__shadow_.3ABR61-KwOOT6rtJXSJtt2H5C4VtA0k_0 2024-09-12T01:21:56.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10383129282903520396', time=2024-09-12T03:09:22.349891+0000, chain.objs.size()=1 2024-09-12T01:21:56.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.307__shadow_.Ljz6wjSA5Zcka_IF-_--a1sd3356Yf__0 2024-09-12T01:21:56.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13750535029480139100', time=2024-09-12T03:09:53.047289+0000, chain.objs.size()=1 2024-09-12T01:21:56.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.7sgOU7Dhc2uf0285qCGEqBJcivfWylY_0 2024-09-12T01:21:56.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9473195362366180395', time=2024-09-12T03:09:53.289238+0000, chain.objs.size()=1 2024-09-12T01:21:56.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.8iqDwkWWhXXwWb73R2ok05yukWaLnDq_0 2024-09-12T01:21:56.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1567931551212594173', time=2024-09-12T03:09:53.643860+0000, chain.objs.size()=1 2024-09-12T01:21:56.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.QD8mktqtn6MXuV5eppy82jAMm4zpssc_0 2024-09-12T01:21:56.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1039528200514784090', time=2024-09-12T03:09:53.680837+0000, chain.objs.size()=1 2024-09-12T01:21:56.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.xm3pO5jIZYPCt72YB8YG45maPB_zFKr_0 2024-09-12T01:21:56.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1805797939948393781', time=2024-09-12T03:09:53.729499+0000, chain.objs.size()=1 2024-09-12T01:21:56.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.u0JfC3LcEoTLgJmYBBgXR5NJ-lmkbWJ_0 2024-09-12T01:21:56.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4372483908032310472', time=2024-09-12T03:09:53.768460+0000, chain.objs.size()=1 2024-09-12T01:21:56.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.u5RpheUDw9m1gTZ60G0Bgf0ri1ffcKv_0 2024-09-12T01:21:56.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.864199451649688140', time=2024-09-12T03:09:53.793507+0000, chain.objs.size()=1 2024-09-12T01:21:56.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.J1oX0hT1iDaNw-ioH9R1JHgRhSFKdVw_0 2024-09-12T01:21:56.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17865020331181174514', time=2024-09-12T03:09:53.803600+0000, chain.objs.size()=1 2024-09-12T01:21:56.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.roBA_8aPLGEA9yq2J316nBo5bZHBOfa_0 2024-09-12T01:21:56.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3324346449068443345', time=2024-09-12T03:09:54.066226+0000, chain.objs.size()=1 2024-09-12T01:21:56.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Y2NLk2AIUH1v6Cliv7QOVCK55IMXUsT_0 2024-09-12T01:21:56.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5055458579602823741', time=2024-09-12T03:09:54.078021+0000, chain.objs.size()=1 2024-09-12T01:21:56.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.QlcO6m29Bz0KF90W0E_MGnWWDgMRlEv_0 2024-09-12T01:21:56.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16939891975200251718', time=2024-09-12T03:09:54.095400+0000, chain.objs.size()=1 2024-09-12T01:21:56.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.7zs_bYhh7FYU1yl7bv43tqQJ6zbO7E3_0 2024-09-12T01:21:56.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14869346429854026015', time=2024-09-12T03:09:54.292213+0000, chain.objs.size()=1 2024-09-12T01:21:56.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.gok6JjsknIrSPgGrSY0GBUxy_h2Kvv9_0 2024-09-12T01:21:56.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.891682977763823782', time=2024-09-12T03:09:54.331639+0000, chain.objs.size()=1 2024-09-12T01:21:56.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.kFT1aX2y2PdHhKFpwRXqaZAqqa5Axs4_0 2024-09-12T01:21:56.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6778489472657003380', time=2024-09-12T03:09:54.406966+0000, chain.objs.size()=1 2024-09-12T01:21:56.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.OPmXqIP4QB085c4mUWrL9d6T5tPl_WD_0 2024-09-12T01:21:56.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10769009254130794606', time=2024-09-12T03:09:54.447474+0000, chain.objs.size()=1 2024-09-12T01:21:56.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.EbLoVuLNbE8jyAuHDlXpWtqOs8R3a82_0 2024-09-12T01:21:56.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1753904697461188936', time=2024-09-12T03:09:54.694251+0000, chain.objs.size()=1 2024-09-12T01:21:56.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.GQ2UV5duNyXqaWo3hjhLklpAP6dUu_L_0 2024-09-12T01:21:56.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.836+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14527253146750915477', time=2024-09-12T03:09:54.722393+0000, chain.objs.size()=1 2024-09-12T01:21:56.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.836+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.sgdw3Ci5eV-tRU5kEnFjlElyaTzL_SH_0 2024-09-12T01:21:56.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.836+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16218746103702975139', time=2024-09-12T03:09:54.739181+0000, chain.objs.size()=1 2024-09-12T01:21:56.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.836+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.SauH6225UsIFtmJKyx5eJtKLH8IevGB_0 2024-09-12T01:21:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.836+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9043375341417358358', time=2024-09-12T03:09:54.757299+0000, chain.objs.size()=1 2024-09-12T01:21:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.836+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.lfoBR9HZGk_hm5hABHyTb87xNlCD8tn_0 2024-09-12T01:21:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.836+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17701993171439267871', time=2024-09-12T03:09:54.968442+0000, chain.objs.size()=1 2024-09-12T01:21:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.836+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ImT9tZQ0RrVJSt2ekDKO8moKqj3ad9G_0 2024-09-12T01:21:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.836+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6826152276691558321', time=2024-09-12T03:09:54.970401+0000, chain.objs.size()=1 2024-09-12T01:21:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.836+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.LR_PhzlbHawZIzEAMNADUkJBqvXeV3R_0 2024-09-12T01:21:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.836+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11358262500470689828', time=2024-09-12T03:09:55.118671+0000, chain.objs.size()=1 2024-09-12T01:21:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.836+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.6UogR_LHA24FhrBIjc2Fxq7xNUjYrI-_0 2024-09-12T01:21:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.836+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6384872160377121346', time=2024-09-12T03:09:55.156352+0000, chain.objs.size()=1 2024-09-12T01:21:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.836+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.pjc7xgaoaDLMSnPn3YY44gaddM93Bu0_0 2024-09-12T01:21:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.836+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1728775703728876466', time=2024-09-12T03:09:55.358567+0000, chain.objs.size()=1 2024-09-12T01:21:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.836+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.pf1YeDtdYM17jyqBAPEfBi6eVM_eOyl_0 2024-09-12T01:21:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.836+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3903667649695122096', time=2024-09-12T03:09:55.377228+0000, chain.objs.size()=1 2024-09-12T01:21:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.836+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.-GfyTOIKW_weOGu3ctJUyD2g81GQS8A_0 2024-09-12T01:21:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.836+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1086265947254137527', time=2024-09-12T03:09:55.379481+0000, chain.objs.size()=1 2024-09-12T01:21:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.836+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.f5HZ4LUiIlCJ4suAHkOV0e3FlMfmPE9_0 2024-09-12T01:21:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.836+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14990547848560534518', time=2024-09-12T03:09:55.427494+0000, chain.objs.size()=1 2024-09-12T01:21:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.836+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.jGDkmx1Wbf-6FdNphLq86S1AWj7QatY_0 2024-09-12T01:21:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.836+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10590975878770025612', time=2024-09-12T03:10:15.352369+0000, chain.objs.size()=1 2024-09-12T01:21:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.836+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.WJGppNpFZ6yxRduvkwBXMK4EJiIlbmE_0 2024-09-12T01:21:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.836+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18149179521742452777', time=2024-09-12T03:10:15.438586+0000, chain.objs.size()=1 2024-09-12T01:21:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.836+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.6pvR7f5U4ALECnAhwka7-P44pExM-qo_0 2024-09-12T01:21:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15789163652139283487', time=2024-09-12T03:10:15.441812+0000, chain.objs.size()=1 2024-09-12T01:21:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.x3zkOxPC9sjQqrx1Cxwg0Oc0djFNkRh_0 2024-09-12T01:21:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4313724430133818588', time=2024-09-12T03:10:15.698047+0000, chain.objs.size()=1 2024-09-12T01:21:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.XoF7QUM_ex61d5dVnZENrWhXeybwSu0_0 2024-09-12T01:21:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13424403077854949864', time=2024-09-12T03:10:15.737467+0000, chain.objs.size()=1 2024-09-12T01:21:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.4nX2JEYohBaeTZVaT2HPickFEAd42hz_0 2024-09-12T01:21:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14444954733848106772', time=2024-09-12T03:10:15.757442+0000, chain.objs.size()=1 2024-09-12T01:21:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.1qkqLiCdtS0YdlvQ0dWvUZsYvOMLQpC_0 2024-09-12T01:21:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2399202317549176005', time=2024-09-12T03:10:15.932253+0000, chain.objs.size()=1 2024-09-12T01:21:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.MTidGIF-ugGmEpW9dqsjcHB1qOY9UKh_0 2024-09-12T01:21:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1103453168628218838', time=2024-09-12T03:10:16.003901+0000, chain.objs.size()=1 2024-09-12T01:21:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.KK1-3wsRFmyjxlurDdK2CinxlH76y4e_0 2024-09-12T01:21:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7704146506741997493', time=2024-09-12T03:10:16.013143+0000, chain.objs.size()=1 2024-09-12T01:21:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.2djDqtRL-pz68uRehwP_oLFZnjSLrFB_0 2024-09-12T01:21:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16907310744722972157', time=2024-09-12T03:10:16.063384+0000, chain.objs.size()=1 2024-09-12T01:21:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.VBXlfaA6NgB16uzjlH5RstQqoxtD7Yr_0 2024-09-12T01:21:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.144200620274438769', time=2024-09-12T03:10:16.329675+0000, chain.objs.size()=1 2024-09-12T01:21:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.DkrM2Lw2FH4JpXLTAmwZEu2jLbivNBl_0 2024-09-12T01:21:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12700653205290709656', time=2024-09-12T03:10:16.368353+0000, chain.objs.size()=1 2024-09-12T01:21:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.dtnzQwm3_66gDoJhC8SaodcAC9vGyWj_0 2024-09-12T01:21:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9420577501686088866', time=2024-09-12T03:10:16.634642+0000, chain.objs.size()=1 2024-09-12T01:21:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.pg3s6DQ9sIXhp6RjBhvL9pwezAh5rpI_0 2024-09-12T01:21:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6456523521585854524', time=2024-09-12T03:10:16.775782+0000, chain.objs.size()=1 2024-09-12T01:21:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.T4eT_hzz9StgpahZJrEIOYbUkiL76ZE_0 2024-09-12T01:21:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11495042340586797050', time=2024-09-12T03:10:16.791914+0000, chain.objs.size()=1 2024-09-12T01:21:56.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.PgSMSX8rN-3xB_Ye7hpgDBfBHKSQ8r1_0 2024-09-12T01:21:56.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7091721820707839593', time=2024-09-12T03:10:16.870452+0000, chain.objs.size()=1 2024-09-12T01:21:56.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.I4GcgPadSwRhG4UqnwQSvaoBq4QUEo__0 2024-09-12T01:21:56.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.274092234574603426', time=2024-09-12T03:10:16.909580+0000, chain.objs.size()=1 2024-09-12T01:21:56.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_._8eDHi-AqProPVLOHhdYsJ0ciSyak8P_0 2024-09-12T01:21:56.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18134004922760554343', time=2024-09-12T03:10:16.923098+0000, chain.objs.size()=1 2024-09-12T01:21:56.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.yFPSVudZvqlJwgZKOSTW8MIQ0C4yafb_0 2024-09-12T01:21:56.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15651967194787760200', time=2024-09-12T03:10:16.957343+0000, chain.objs.size()=1 2024-09-12T01:21:56.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.uBAE8aKTTR4S_1GHP4gFLCAHBE8Vm7j_0 2024-09-12T01:21:56.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17676987304645428156', time=2024-09-12T03:10:17.000346+0000, chain.objs.size()=1 2024-09-12T01:21:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.mFFv617-SBeNqQis90oRsDYkBxRjnt__0 2024-09-12T01:21:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17038040756085057956', time=2024-09-12T03:10:17.132812+0000, chain.objs.size()=1 2024-09-12T01:21:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.nfFwFV4mZp_uQOXIHLkL2HhODRVAtvH_0 2024-09-12T01:21:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15165223980627915162', time=2024-09-12T03:10:17.307980+0000, chain.objs.size()=1 2024-09-12T01:21:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.XS6zPGxbYj4pGgIZ6sm01Fyt6PYzYU3_0 2024-09-12T01:21:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4631851092779878285', time=2024-09-12T03:10:17.466062+0000, chain.objs.size()=1 2024-09-12T01:21:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.tgpd5YMR-UrWox-VAkSIvr1tOd9_fC9_0 2024-09-12T01:21:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.254685206407151963', time=2024-09-12T03:10:17.504069+0000, chain.objs.size()=1 2024-09-12T01:21:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.hBP3jtntLRuuNIF6bMW6umcDOweMK9d_0 2024-09-12T01:21:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.844+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17343667235208502652', time=2024-09-12T03:10:17.596554+0000, chain.objs.size()=1 2024-09-12T01:21:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.844+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.UkFYiyvVupnqmXbdJXuOzYtAfubPbXc_0 2024-09-12T01:21:56.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.844+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10062981536713509809', time=2024-09-12T03:10:17.863301+0000, chain.objs.size()=1 2024-09-12T01:21:56.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.844+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.yCX9yVzboskNGPTkMubc9BEi8snE5t6_0 2024-09-12T01:21:56.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.844+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.848089921165505308', time=2024-09-12T03:10:17.918457+0000, chain.objs.size()=1 2024-09-12T01:21:56.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.844+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.aCnI39mYjNGR_93RmXLGjPSQG-iNivp_0 2024-09-12T01:21:56.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.844+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15619191435129446087', time=2024-09-12T03:10:28.360245+0000, chain.objs.size()=1 2024-09-12T01:21:56.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.844+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.342__shadow_.-X28CwtVfQ1--orw6A_QCFl_X4tnmeJ_0 2024-09-12T01:21:56.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.844+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15193037145914119463', time=2024-09-12T03:11:31.277627+0000, chain.objs.size()=1 2024-09-12T01:21:56.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.844+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.436__shadow_.p0KPiWKBW18qQ-PoEWDC0qdH2Er4yBq_0 2024-09-12T01:21:56.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.844+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7451544330676880465', time=2024-09-12T03:11:52.436834+0000, chain.objs.size()=1 2024-09-12T01:21:56.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.844+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.462__shadow_.EK7mtgXiGmsV0mYQcqGUXLG1shTAqMG_0 2024-09-12T01:21:56.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.844+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1687032160420817354', time=2024-09-12T03:11:55.971362+0000, chain.objs.size()=1 2024-09-12T01:21:56.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.844+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.466__shadow_.RBHA_PZvVc98nGJzKJgeBeY3hc9P7Wy_0 2024-09-12T01:21:56.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47233 2024-09-12T01:21:56.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T01:21:56.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14670320385006208118', time=2024-09-12T03:11:57.061779+0000, chain.objs.size()=1 2024-09-12T01:21:56.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.467__shadow_.RP7fyJg2Jld_kHJswB89hcPZgzbjUoe_0 2024-09-12T01:21:56.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11389710643136385322', time=2024-09-12T03:12:04.999194+0000, chain.objs.size()=1 2024-09-12T01:21:56.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.484__shadow_.Su279N_s1q-n6ogJ13kqHuSKfwpg-UI_0 2024-09-12T01:21:56.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14215411880773619004', time=2024-09-12T03:12:08.131646+0000, chain.objs.size()=1 2024-09-12T01:21:56.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.488__shadow_.XPwXWOitzel9dU4VXOwrSVzRsZxPwBV_0 2024-09-12T01:21:56.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12235403195728531467', time=2024-09-12T03:12:09.976491+0000, chain.objs.size()=1 2024-09-12T01:21:56.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.491__shadow_.Bg6V8Uj4JgkWI17AYBOOm9QPjgtvAyB_0 2024-09-12T01:21:56.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12235403195728531467', time=2024-09-12T03:12:10.188459+0000, chain.objs.size()=1 2024-09-12T01:21:56.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.491__shadow_.Bg6V8Uj4JgkWI17AYBOOm9QPjgtvAyB_0 2024-09-12T01:21:56.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13099676538573789625', time=2024-09-12T03:12:14.567311+0000, chain.objs.size()=1 2024-09-12T01:21:56.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.499__shadow_.RKWoUE7ROLt8qsmOLmT4l0gATYLpe2c_0 2024-09-12T01:21:56.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15323578754913929507', time=2024-09-12T03:12:22.090968+0000, chain.objs.size()=6 2024-09-12T01:21:56.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.1 2024-09-12T01:21:56.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.2 2024-09-12T01:21:56.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.3 2024-09-12T01:21:56.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.4 2024-09-12T01:21:56.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.5 2024-09-12T01:21:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.6 2024-09-12T01:21:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.167157333545906430', time=2024-09-12T03:12:52.286058+0000, chain.objs.size()=6 2024-09-12T01:21:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~vd_YKCp0taNnw9JKaVFVFi5eT5xF9UG.1 2024-09-12T01:21:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.6GrDtEtarl4JVyzCOB7pTE4dgE_pmrQp.2 2024-09-12T01:21:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.-fhDQR_K2ygVjvGKAPbVFgikDlA-lyK7.3 2024-09-12T01:21:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~vd_YKCp0taNnw9JKaVFVFi5eT5xF9UG.4 2024-09-12T01:21:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~vd_YKCp0taNnw9JKaVFVFi5eT5xF9UG.5 2024-09-12T01:21:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~vd_YKCp0taNnw9JKaVFVFi5eT5xF9UG.6 2024-09-12T01:21:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~GAlEjG4eU3ncOYg4z-xFYqu4XBS1Z-B', time=2024-09-12T03:13:07.260688+0000, chain.objs.size()=1 2024-09-12T01:21:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.532__multipart_mymultipart.2~GAlEjG4eU3ncOYg4z-xFYqu4XBS1Z-B.1 2024-09-12T01:21:56.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6715826678607399335', time=2024-09-12T03:14:19.845764+0000, chain.objs.size()=1 2024-09-12T01:21:56.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.573__shadow:duuwfXG19v15y7RfXlZwKY-GkUVFiuv_.UyJpZrWVeZ9ndSuMV811TPKvkWUhYhs_0 2024-09-12T01:21:56.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9243555272618664434', time=2024-09-12T03:14:28.812312+0000, chain.objs.size()=1 2024-09-12T01:21:56.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.577__shadow:4t-e8me33vRbV.b16a5zEdFZ-c1Db-5_.Md0V-5veMpYMvVlmEKrXMyvUEIjMJgj_0 2024-09-12T01:21:56.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6657505969411479405', time=2024-09-12T03:14:39.349195+0000, chain.objs.size()=1 2024-09-12T01:21:56.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:ZwEnllv4UeUKwYA1woETHKTZEh1MnV2_.Lh4tsJPfwsPluUcQ2fVnXDoID_xtVxO_0 2024-09-12T01:21:56.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8994491000470044833', time=2024-09-12T03:14:44.533150+0000, chain.objs.size()=1 2024-09-12T01:21:56.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:l5CawdHhKcBm1oIBFhcdOiuC7qt--Ls_.fAgpKyZjLKpChORDl_3gRvIZVk-7ihA_0 2024-09-12T01:21:56.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5146048010715068154', time=2024-09-12T03:14:44.909413+0000, chain.objs.size()=1 2024-09-12T01:21:56.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:-1B1uaiDl4Rkmrluj8bxENWNgFEM6DK_.J0Ddi8_77BynXELC4pGFzyrfyxRY2fo_0 2024-09-12T01:21:56.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4108866950885531203', time=2024-09-12T03:14:45.234144+0000, chain.objs.size()=1 2024-09-12T01:21:56.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:bPsp.EKOshxBF8cbJt19RvLFuF7sKDH_.LgEFZodgpGuhR0q428XEhekz-vWBfZB_0 2024-09-12T01:21:56.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17574290261683429373', time=2024-09-12T03:14:53.781339+0000, chain.objs.size()=1 2024-09-12T01:21:56.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.581__shadow:Hlpx7f3Y0G1KYveYpJ3BijpqIMDT--x_.G1FB6asNJW3t2HG3PI-GPOtFeAO4_oE_0 2024-09-12T01:21:56.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5781159580883758365', time=2024-09-12T03:14:57.375649+0000, chain.objs.size()=1 2024-09-12T01:21:56.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.586__shadow:Nkg5HMTIn7veDqan-TbUm6G2LwrQhgO_.5uu1CN7pyfFShNUZ3FNFq14PbnLqeRD_0 2024-09-12T01:21:56.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7747989607555577828', time=2024-09-12T03:17:48.303939+0000, chain.objs.size()=1 2024-09-12T01:21:56.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.639__shadow_.fmyXMu75Ed8fh7YQdDr-21AfxVBpAqF_0 2024-09-12T01:21:56.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9734273510117247756', time=2024-09-12T03:18:11.178493+0000, chain.objs.size()=1 2024-09-12T01:21:56.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.667__shadow_.k2hpU9y5zh1QLJJViNkkf4KsirBTwaO_0 2024-09-12T01:21:56.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11062847001599284061', time=2024-09-12T03:18:12.999289+0000, chain.objs.size()=1 2024-09-12T01:21:56.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.671__shadow_.98_1dZRDXVo-ftx5EbVo5UHFjgeD-Wr_0 2024-09-12T01:21:56.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.856+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12635193433635934949', time=2024-09-12T03:18:13.900220+0000, chain.objs.size()=1 2024-09-12T01:21:56.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.856+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.673__shadow_.NmVqfs1gEBfGxNH5q6TfMyG_LE1K4Pz_0 2024-09-12T01:21:56.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.856+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14302696574978550917', time=2024-09-12T03:19:01.696938+0000, chain.objs.size()=1 2024-09-12T01:21:56.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.856+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.719__shadow_.6BbvuYwCvt7Du3R3jtDpRKiiFrW6Edx_0 2024-09-12T01:21:56.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.856+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:56.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.860+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:21:56.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.860+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:56.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.860+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:56.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49116' 2024-09-12T01:21:56.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16180679160628187266', time=2024-09-12T03:06:02.340372+0000, chain.objs.size()=3 2024-09-12T01:21:56.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.162__multipart_foo-FROZEN.2~KyvpbX4d_BeCDNN4WDLa4L18lwddxAK.1 2024-09-12T01:21:56.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.162__multipart_foo-FROZEN.2~KyvpbX4d_BeCDNN4WDLa4L18lwddxAK.2 2024-09-12T01:21:56.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.162__multipart_foo-FROZEN.2~KyvpbX4d_BeCDNN4WDLa4L18lwddxAK.3 2024-09-12T01:21:56.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14071830217374778413', time=2024-09-12T03:06:18.557947+0000, chain.objs.size()=1 2024-09-12T01:21:56.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.184__shadow_.TAp84NRzJ-aKDo0-BrmIUg7cg9_NjC3_0 2024-09-12T01:21:56.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13731404103298446200', time=2024-09-12T03:08:10.268206+0000, chain.objs.size()=1 2024-09-12T01:21:56.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.238__shadow_.s2W5se2UkySQ9G8GDoHfrGxvdNiHRqY_0 2024-09-12T01:21:56.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8332925364364443532', time=2024-09-12T03:08:18.525830+0000, chain.objs.size()=1 2024-09-12T01:21:56.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.248__shadow_.X1IV7hJ7sxmsfkHryQ484gKHN-hBFj5_0 2024-09-12T01:21:56.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15850949005421247203', time=2024-09-12T03:08:27.451094+0000, chain.objs.size()=1 2024-09-12T01:21:56.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.261__shadow_.LfZbskkGc05ZH_ai-fk0b7T3h6-4_io_0 2024-09-12T01:21:56.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9309506697322183479', time=2024-09-12T03:08:47.468932+0000, chain.objs.size()=1 2024-09-12T01:21:56.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.y1FufYK_QqodDTGzzsfe3zBhoxC-fBu_0 2024-09-12T01:21:56.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17046255492930902651', time=2024-09-12T03:08:47.511703+0000, chain.objs.size()=1 2024-09-12T01:21:56.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.uNBKSKZZCX3CAOLdCYC_84g3xzAwZ_8_0 2024-09-12T01:21:56.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5905203057524946906', time=2024-09-12T03:08:47.559393+0000, chain.objs.size()=1 2024-09-12T01:21:56.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.06oADlqdCLkh3OmCpUJH4Okz8ntt5el_0 2024-09-12T01:21:56.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.64025471134651954', time=2024-09-12T03:08:47.610121+0000, chain.objs.size()=1 2024-09-12T01:21:56.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.etxtQbg8PfZcp6YaY0GqEHKHJElXgMz_0 2024-09-12T01:21:56.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11523942551274873098', time=2024-09-12T03:08:47.622458+0000, chain.objs.size()=1 2024-09-12T01:21:56.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.XA28EKzGrTz21xFo9o-PchR_m8BjT9Q_0 2024-09-12T01:21:56.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5773407269605475872', time=2024-09-12T03:08:47.856902+0000, chain.objs.size()=1 2024-09-12T01:21:56.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.r-w5hg-Yq2QAD8PtggYecC7slIR9XnN_0 2024-09-12T01:21:56.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12472016088449830945', time=2024-09-12T03:08:47.915313+0000, chain.objs.size()=1 2024-09-12T01:21:56.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.z8iz-qCZKaMhNFVLAJKMeWjk4b3YiK7_0 2024-09-12T01:21:56.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17281184448941886779', time=2024-09-12T03:08:47.940413+0000, chain.objs.size()=1 2024-09-12T01:21:56.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Xzh8BC0TAQYLDzEgkm-MZOoFjlIl2ft_0 2024-09-12T01:21:56.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15539321379231533335', time=2024-09-12T03:08:48.017291+0000, chain.objs.size()=1 2024-09-12T01:21:56.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.-vWEQYAx4aq8gfzXaR0IpVE2SVi77d1_0 2024-09-12T01:21:56.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10452022776785332948', time=2024-09-12T03:08:48.275684+0000, chain.objs.size()=1 2024-09-12T01:21:56.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.4JYBP4Pj6-IaOvuag2h8jtOWniX18Y5_0 2024-09-12T01:21:56.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2308057718914789326', time=2024-09-12T03:08:48.289140+0000, chain.objs.size()=1 2024-09-12T01:21:56.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.FJ5kVYdy4ISbnsBb43Sn7GymTa4-_xq_0 2024-09-12T01:21:56.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6750829784933190889', time=2024-09-12T03:08:48.341529+0000, chain.objs.size()=1 2024-09-12T01:21:56.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.xweVZcdtRtU0WS9SW47VEaPOSP-sRQZ_0 2024-09-12T01:21:56.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8287676329364207315', time=2024-09-12T03:08:48.549308+0000, chain.objs.size()=1 2024-09-12T01:21:56.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.6b7VF0KuZMeFcEiFtGPt0UesR5L0kq__0 2024-09-12T01:21:56.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4963222919740718205', time=2024-09-12T03:08:48.555260+0000, chain.objs.size()=1 2024-09-12T01:21:56.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.zrH605QhBNOZ_d0dFgfgwurekYCH4Cr_0 2024-09-12T01:21:56.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18322127139285114697', time=2024-09-12T03:08:48.637000+0000, chain.objs.size()=1 2024-09-12T01:21:56.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.XhTJCPLT3eoFPiFW1Q0_4Rk2xNbOmc2_0 2024-09-12T01:21:56.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1787090318318493976', time=2024-09-12T03:08:48.862770+0000, chain.objs.size()=1 2024-09-12T01:21:56.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Y_3ejpsF_lAvQDWHppS-KjxXLBl8qU__0 2024-09-12T01:21:56.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15478084525482788514', time=2024-09-12T03:08:48.873080+0000, chain.objs.size()=1 2024-09-12T01:21:56.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.jUw8BkJakC6X_xxVjNEKxmJ-tcJsUUA_0 2024-09-12T01:21:56.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.885694528867733199', time=2024-09-12T03:08:48.920603+0000, chain.objs.size()=1 2024-09-12T01:21:56.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_._xxc1fTCi7HMHg-NA7Jl98lwROfaOp2_0 2024-09-12T01:21:56.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3560589898696794615', time=2024-09-12T03:08:48.926260+0000, chain.objs.size()=1 2024-09-12T01:21:56.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.RfyfF-lrIDYvmnORUcD3DK4Q_XuxkzR_0 2024-09-12T01:21:56.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4264574131992886472', time=2024-09-12T03:08:48.936614+0000, chain.objs.size()=1 2024-09-12T01:21:56.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.iTQzFRFxF7hG6bKCToqTUsinvMWqexA_0 2024-09-12T01:21:56.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14577854680600559510', time=2024-09-12T03:08:49.216410+0000, chain.objs.size()=1 2024-09-12T01:21:56.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.8-A5LJLS47D3JyFnUcz2NbNrWFNgCA7_0 2024-09-12T01:21:56.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4856889879336496248', time=2024-09-12T03:08:49.538965+0000, chain.objs.size()=1 2024-09-12T01:21:56.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.CeLMkbW0c26Trh9h3V3OXZjrCqIlwub_0 2024-09-12T01:21:56.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6922351999050106835', time=2024-09-12T03:08:49.638202+0000, chain.objs.size()=1 2024-09-12T01:21:56.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.8BgbvjuNFH6d2EolmpxUME4vmvGtEJ5_0 2024-09-12T01:21:56.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1033228705505563728', time=2024-09-12T03:08:49.646116+0000, chain.objs.size()=1 2024-09-12T01:21:56.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.rcb84CtMwUe31FyEn2ClsCbn5XuGIKs_0 2024-09-12T01:21:56.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15437568003803644948', time=2024-09-12T03:08:49.685730+0000, chain.objs.size()=1 2024-09-12T01:21:56.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.oZzr-G7hwsF1guYxRtneWEPlRbs-NRb_0 2024-09-12T01:21:56.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16589696832170123877', time=2024-09-12T03:08:49.701020+0000, chain.objs.size()=1 2024-09-12T01:21:56.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.7WSXdF01FUl9f5ysV0-xuCzJ9fjfd0A_0 2024-09-12T01:21:56.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15360753445910452710', time=2024-09-12T03:08:49.722504+0000, chain.objs.size()=1 2024-09-12T01:21:56.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.IRK3gBdlw9Z3iSO6RbzQHvgycP3CmEs_0 2024-09-12T01:21:56.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18160983255835589482', time=2024-09-12T03:08:49.861084+0000, chain.objs.size()=1 2024-09-12T01:21:56.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.NnbPefWM27Ic1AT9wDYWmjzZJF1SNwF_0 2024-09-12T01:21:56.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10245878399300516277', time=2024-09-12T03:08:49.938585+0000, chain.objs.size()=1 2024-09-12T01:21:56.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.868+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.LYyH_EKcvr9Fh338Ni7dX4avXRYFKVb_0 2024-09-12T01:21:56.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9285227533944187117', time=2024-09-12T03:08:49.944030+0000, chain.objs.size()=1 2024-09-12T01:21:56.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.AbQXiXO2FiI6oIzOwfo6Yq8aFhb4DFI_0 2024-09-12T01:21:56.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9868365639598750215', time=2024-09-12T03:08:49.963588+0000, chain.objs.size()=1 2024-09-12T01:21:56.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.UXcM1jiFUz6ZFa6P52N-jomCgvp87gy_0 2024-09-12T01:21:56.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7151551252052097797', time=2024-09-12T03:08:50.000251+0000, chain.objs.size()=1 2024-09-12T01:21:56.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.MqVX11TIUkdT_R3pTXH-nFs2s3Fbwwb_0 2024-09-12T01:21:56.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4921537406189900059', time=2024-09-12T03:08:50.027608+0000, chain.objs.size()=1 2024-09-12T01:21:56.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.bCi-Z_vG64qaqkIAvrpRgQrcSnZx3Oe_0 2024-09-12T01:21:56.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6966024367135155505', time=2024-09-12T03:08:50.050326+0000, chain.objs.size()=1 2024-09-12T01:21:56.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.kHFvsTl0PuqedOGkH07H1AvuVU9zKEV_0 2024-09-12T01:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4791926830979018606', time=2024-09-12T03:08:50.051157+0000, chain.objs.size()=1 2024-09-12T01:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.vDHCaZINxS2CHCpvP-HjVu76slZPEOk_0 2024-09-12T01:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1508104969601437100', time=2024-09-12T03:08:50.054182+0000, chain.objs.size()=1 2024-09-12T01:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.XwpaVTAv0jQUAVVionY2Ja1hv6yiwTU_0 2024-09-12T01:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16011801670629341994', time=2024-09-12T03:08:55.352772+0000, chain.objs.size()=1 2024-09-12T01:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.271__shadow_.pCmwGQD58b4BB5cImrN8HGQiBstFXiI_0 2024-09-12T01:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12824706444468957535', time=2024-09-12T03:09:00.873238+0000, chain.objs.size()=1 2024-09-12T01:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.279__shadow_.3bQ-Vn5r7KAa5Dlk95-3xjnq-g_5QTH_0 2024-09-12T01:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8054582996610552545', time=2024-09-12T03:09:07.817976+0000, chain.objs.size()=1 2024-09-12T01:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.289__shadow_.5ABCh3CuNsdIQ2SEHYsNrkBdERfp_t-_0 2024-09-12T01:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3798328006493017462', time=2024-09-12T03:09:13.087601+0000, chain.objs.size()=1 2024-09-12T01:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.294__shadow_.lWnmHjsQPZDLWqFU1whaF-ZdifjEShN_0 2024-09-12T01:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14844846647311974798', time=2024-09-12T03:09:14.421205+0000, chain.objs.size()=1 2024-09-12T01:21:56.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.296__shadow_._2GeHNU3pl2GUOKNs2CgJ0X9ML_Apha_0 2024-09-12T01:21:56.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.479277261329501442', time=2024-09-12T03:09:19.373807+0000, chain.objs.size()=1 2024-09-12T01:21:56.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.303__shadow_.Ohlj1gjucovBUZ5-f_NpJD-4P_sQKfa_0 2024-09-12T01:21:56.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7730304642821467471', time=2024-09-12T03:09:53.038944+0000, chain.objs.size()=1 2024-09-12T01:21:56.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Ry3TOKkcnNApnfPz_r-sgWd7s7oC0TI_0 2024-09-12T01:21:56.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4529509203442796641', time=2024-09-12T03:09:53.049222+0000, chain.objs.size()=1 2024-09-12T01:21:56.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.lhtniBiTwsmYVVbUc4O8F6kv9utJqX1_0 2024-09-12T01:21:56.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7945145087166195604', time=2024-09-12T03:09:53.069665+0000, chain.objs.size()=1 2024-09-12T01:21:56.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.lRkuaKd7bjjh8ChJFOzBI6GRPkrC5DN_0 2024-09-12T01:21:56.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14861455482388999201', time=2024-09-12T03:09:53.139907+0000, chain.objs.size()=1 2024-09-12T01:21:56.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.POZZteEeGSqdBSVJCKn4C1okDyRxg5Q_0 2024-09-12T01:21:56.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17624636081916598819', time=2024-09-12T03:09:53.330485+0000, chain.objs.size()=1 2024-09-12T01:21:56.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.dlWDSUHTk9NH7kW4IJ0FZDArYJsVdRD_0 2024-09-12T01:21:56.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18202513391286114913', time=2024-09-12T03:09:53.376926+0000, chain.objs.size()=1 2024-09-12T01:21:56.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.roFMZg6abyViQvdejSoQp1m-KSjpNuR_0 2024-09-12T01:21:56.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14700716224532343693', time=2024-09-12T03:09:53.659096+0000, chain.objs.size()=1 2024-09-12T01:21:56.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.8ABb7aW-hvHc0VJBrErBQEsvIYKyNMk_0 2024-09-12T01:21:56.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3236974349447557073', time=2024-09-12T03:09:53.805424+0000, chain.objs.size()=1 2024-09-12T01:21:56.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.NOZdLH7pF9o_3zHFvrxpMLiNkHWc_L4_0 2024-09-12T01:21:56.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4705038103645146710', time=2024-09-12T03:09:53.842301+0000, chain.objs.size()=1 2024-09-12T01:21:56.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.872+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.kQ2BK1BCgoD1LLsJ8S-4bFOJB0R3B_E_0 2024-09-12T01:21:56.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.876+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16191423513420287770', time=2024-09-12T03:09:54.059274+0000, chain.objs.size()=1 2024-09-12T01:21:56.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.876+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.tjh8qN0CzmRE7l2ACQNSdLf20zUT4ZS_0 2024-09-12T01:21:56.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.876+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10841701626921689023', time=2024-09-12T03:09:54.097216+0000, chain.objs.size()=1 2024-09-12T01:21:56.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.876+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ZaPJKDBuGCL9KI6kDFpnbzRZKiQ70qj_0 2024-09-12T01:21:56.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.876+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11293161930479202972', time=2024-09-12T03:09:54.168109+0000, chain.objs.size()=1 2024-09-12T01:21:56.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.876+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.87xP1K_ZVrI9lAvFGmxHa6buIklqqNx_0 2024-09-12T01:21:56.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.876+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12571339717440030288', time=2024-09-12T03:09:54.367569+0000, chain.objs.size()=1 2024-09-12T01:21:56.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.876+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.yXmUZZ4pbggKWECBJ-BmSmYKql4CWAJ_0 2024-09-12T01:21:56.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.876+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11393446780672215533', time=2024-09-12T03:09:54.374995+0000, chain.objs.size()=1 2024-09-12T01:21:56.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.876+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.2X8tCvNbNGIUX4n8M5-lrmVTZQwZYgY_0 2024-09-12T01:21:56.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.876+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17570807361696017828', time=2024-09-12T03:09:54.394956+0000, chain.objs.size()=1 2024-09-12T01:21:56.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.876+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.aKthdKgv3ldApj28gdh1GyeEVvA07EY_0 2024-09-12T01:21:56.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.876+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14699869739983733359', time=2024-09-12T03:09:54.472457+0000, chain.objs.size()=1 2024-09-12T01:21:56.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.876+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.EM6jXwDQYKfIpwaItfIX_UnUyXpx2oZ_0 2024-09-12T01:21:56.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.876+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2135498002231469149', time=2024-09-12T03:09:54.629235+0000, chain.objs.size()=1 2024-09-12T01:21:56.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.876+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Jq3O2eqfhu8XCiXIg_lJwMHxP_-Pno5_0 2024-09-12T01:21:56.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.876+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3541811978639565855', time=2024-09-12T03:09:54.714380+0000, chain.objs.size()=1 2024-09-12T01:21:56.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.876+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.jM5dbxb0IKbWlXZsevkmz0AsDuVcqpP_0 2024-09-12T01:21:56.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.876+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12197633565501476438', time=2024-09-12T03:09:54.733070+0000, chain.objs.size()=1 2024-09-12T01:21:56.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.876+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.SxlIpEt2qSypPSJm1JOJi4lkU1NZZrE_0 2024-09-12T01:21:56.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.876+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15377071543786131355', time=2024-09-12T03:09:54.990173+0000, chain.objs.size()=1 2024-09-12T01:21:56.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.876+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.-tarMKEZ7yyOV-LO8aIlDZ58FhcTXV6_0 2024-09-12T01:21:56.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.876+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17800241635000101463', time=2024-09-12T03:09:55.021778+0000, chain.objs.size()=1 2024-09-12T01:21:56.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.876+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.5mofl-V3Xth_LbpsaLlYft-bzlcZS-B_0 2024-09-12T01:21:56.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.876+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17722082542105721872', time=2024-09-12T03:09:55.053018+0000, chain.objs.size()=1 2024-09-12T01:21:56.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.876+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.6PSzNDPStaXAaxFPCIaOfy_Me-MI3hV_0 2024-09-12T01:21:56.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13780412546149421336', time=2024-09-12T03:09:55.124575+0000, chain.objs.size()=1 2024-09-12T01:21:56.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.-UhFMDntoDd1JjZFBqQbjQc8RwTaRs2_0 2024-09-12T01:21:56.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2860108253672250601', time=2024-09-12T03:09:55.137929+0000, chain.objs.size()=1 2024-09-12T01:21:56.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.gF4BxJ4_4QLqi92kKRrcDeHxuvqEhQt_0 2024-09-12T01:21:56.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16653940021195701877', time=2024-09-12T03:09:55.266812+0000, chain.objs.size()=1 2024-09-12T01:21:56.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.-FUNGuXkRtdfPtbswu0AIp1mwC5A8pa_0 2024-09-12T01:21:56.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11935304945416546771', time=2024-09-12T03:09:55.287328+0000, chain.objs.size()=1 2024-09-12T01:21:56.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.PWbQNalU27gxmPgZFxJObFYdS7EZWJv_0 2024-09-12T01:21:56.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17104736513035639031', time=2024-09-12T03:09:55.317673+0000, chain.objs.size()=1 2024-09-12T01:21:56.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.UwZjtF47Iyaw57pZZthiWzjaeHfNm2b_0 2024-09-12T01:21:56.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1104378539458469674', time=2024-09-12T03:09:55.322760+0000, chain.objs.size()=1 2024-09-12T01:21:56.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.or99X4iqZ-rPO-1HWZfiWwrZr87mrzG_0 2024-09-12T01:21:56.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10688015398360757012', time=2024-09-12T03:09:55.324653+0000, chain.objs.size()=1 2024-09-12T01:21:56.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.DPwYtaNXWHdQw_z6BDTRKi2jcj1eXiq_0 2024-09-12T01:21:56.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9395834836842786543', time=2024-09-12T03:09:55.351088+0000, chain.objs.size()=1 2024-09-12T01:21:56.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.P9DrWz3t3Z74CyeS9R2_-e74t6G7Jfu_0 2024-09-12T01:21:56.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16785282166824429867', time=2024-09-12T03:09:55.381941+0000, chain.objs.size()=1 2024-09-12T01:21:56.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.xCpjwfURncE9IPFfFMrR6XKZhKJb5Rg_0 2024-09-12T01:21:56.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7157799917873096102', time=2024-09-12T03:10:15.225535+0000, chain.objs.size()=1 2024-09-12T01:21:56.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.6Tw59A4nDEjWxDYjwz1UtQeEyeaHdo1_0 2024-09-12T01:21:56.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12304188923742594767', time=2024-09-12T03:10:15.313336+0000, chain.objs.size()=1 2024-09-12T01:21:56.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.78Mpx6emhSWc1uYqcpWkgtqD1BF9wAZ_0 2024-09-12T01:21:56.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18253464862482092555', time=2024-09-12T03:10:15.427827+0000, chain.objs.size()=1 2024-09-12T01:21:56.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.mKtIGt3WGRMS0bxccMmYgGUnEo0yy-C_0 2024-09-12T01:21:56.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17623571196571901579', time=2024-09-12T03:10:15.575179+0000, chain.objs.size()=1 2024-09-12T01:21:56.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.4UDGaGwSG2qTiG9uTPdUlOmvT-VTXnu_0 2024-09-12T01:21:56.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15944716007053979268', time=2024-09-12T03:10:15.744218+0000, chain.objs.size()=1 2024-09-12T01:21:56.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Blr4a-b7yiU43z9-fGj-g-SOwt9giIy_0 2024-09-12T01:21:56.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6683876497580768795', time=2024-09-12T03:10:15.767358+0000, chain.objs.size()=1 2024-09-12T01:21:56.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.WWTKUMk4li-MFXCWEvH922Mc_gbfK6__0 2024-09-12T01:21:56.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17752419522939441623', time=2024-09-12T03:10:15.883947+0000, chain.objs.size()=1 2024-09-12T01:21:56.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.880+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.TbfINq5uDhP8Yet3qmEfC3cQC6cHSZK_0 2024-09-12T01:21:56.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10367030642394134727', time=2024-09-12T03:10:15.924274+0000, chain.objs.size()=1 2024-09-12T01:21:56.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.O8tDQcxLXwmeGx-qifAedaJAL33uXU5_0 2024-09-12T01:21:56.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13719373140034860306', time=2024-09-12T03:10:15.941630+0000, chain.objs.size()=1 2024-09-12T01:21:56.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.QKNOGZo3Mn0adxi2bxzKg_TCy9oGP62_0 2024-09-12T01:21:56.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2164419458141526726', time=2024-09-12T03:10:15.966050+0000, chain.objs.size()=1 2024-09-12T01:21:56.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ExK7WeQ_CppgvEQoO9UyKRTyIz_yYmR_0 2024-09-12T01:21:56.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9989723611088282418', time=2024-09-12T03:10:16.032958+0000, chain.objs.size()=1 2024-09-12T01:21:56.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_._Hs0QCuTUTKMu5LzNWjUvtrun1qfM2h_0 2024-09-12T01:21:56.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1942117096119789378', time=2024-09-12T03:10:16.306543+0000, chain.objs.size()=1 2024-09-12T01:21:56.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.7YXEgnCpszGPSfb0vfNOFQZwwIxeNom_0 2024-09-12T01:21:56.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7812540956453676775', time=2024-09-12T03:10:16.316045+0000, chain.objs.size()=1 2024-09-12T01:21:56.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Q4w7aAX69IqSwESTOLam_bR4T0CcX6G_0 2024-09-12T01:21:56.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11381898919110570131', time=2024-09-12T03:10:16.348183+0000, chain.objs.size()=1 2024-09-12T01:21:56.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.PDzp0tSRN8USh3NowbIctdr4YavOQuX_0 2024-09-12T01:21:56.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7049389267417999388', time=2024-09-12T03:10:16.621927+0000, chain.objs.size()=1 2024-09-12T01:21:56.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.UVuQW8LrLs4_uGyKi3s_DvI-mW8PziW_0 2024-09-12T01:21:56.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12679962897424975406', time=2024-09-12T03:10:16.877709+0000, chain.objs.size()=1 2024-09-12T01:21:56.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.5klzkDdKL34SUpyTGG5xP8ZTheVFyOI_0 2024-09-12T01:21:56.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6329653726040805982', time=2024-09-12T03:10:16.881199+0000, chain.objs.size()=1 2024-09-12T01:21:56.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.jjD6mtTL40THM3h3WVfxf8pv0QJpsgN_0 2024-09-12T01:21:56.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17322500390549712731', time=2024-09-12T03:10:16.935180+0000, chain.objs.size()=1 2024-09-12T01:21:56.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.7hWTJeR8fHsswVIWS78xQkct3fOxFDw_0 2024-09-12T01:21:56.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2475964637493849018', time=2024-09-12T03:10:17.183936+0000, chain.objs.size()=1 2024-09-12T01:21:56.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.E7yhmOXJaBTftG_HLY305CZ_NeUMLWK_0 2024-09-12T01:21:56.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11944091692630586611', time=2024-09-12T03:10:17.189179+0000, chain.objs.size()=1 2024-09-12T01:21:56.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.QNpf7CrlX-nYfB1rNtrn3PriiI_BqF3_0 2024-09-12T01:21:56.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1421648501896264115', time=2024-09-12T03:10:17.338779+0000, chain.objs.size()=1 2024-09-12T01:21:56.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.FHeg_6-bP8wnodFifoq42retPXcfwX1_0 2024-09-12T01:21:56.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7137095361341839391', time=2024-09-12T03:10:17.342344+0000, chain.objs.size()=1 2024-09-12T01:21:56.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.884+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.JodQ_bFnPr9dmhai6yhGGQZnhyWcMNE_0 2024-09-12T01:21:56.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.888+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49116 2024-09-12T01:21:56.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.888+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T01:21:56.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.888+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2977785772312698883', time=2024-09-12T03:10:17.512291+0000, chain.objs.size()=1 2024-09-12T01:21:56.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.888+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.jqMhw7VkKecH6hdNcZ07DL8m8UcmIzs_0 2024-09-12T01:21:56.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.888+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1291761365134527157', time=2024-09-12T03:10:17.533123+0000, chain.objs.size()=1 2024-09-12T01:21:56.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.888+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.oTB7Db9pa8F5pm6UTovHtE9QX-MsZW__0 2024-09-12T01:21:56.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.888+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18099742429211023417', time=2024-09-12T03:10:17.756476+0000, chain.objs.size()=1 2024-09-12T01:21:56.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.888+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.bKMgpmDkiYt104RsxlLn3Oo6-9UepK2_0 2024-09-12T01:21:56.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.888+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11658491634492783515', time=2024-09-12T03:10:17.803876+0000, chain.objs.size()=1 2024-09-12T01:21:56.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.888+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.OzoXIzRU_8_aHWRMU0E6kM_azY94kCP_0 2024-09-12T01:21:56.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.888+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18384920776242335932', time=2024-09-12T03:10:17.829910+0000, chain.objs.size()=1 2024-09-12T01:21:56.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.888+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.yUR7E3FXIrdcAvdoXoGZc2-76up788v_0 2024-09-12T01:21:56.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.888+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15561546351051094905', time=2024-09-12T03:10:17.892553+0000, chain.objs.size()=1 2024-09-12T01:21:56.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.888+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.2weub7MWi3LPEizdckMCy-ZmRUbNpRX_0 2024-09-12T01:21:56.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.888+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1137055557045954847', time=2024-09-12T03:10:29.046084+0000, chain.objs.size()=1 2024-09-12T01:21:56.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.888+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.343__shadow_.wvMDVTdZzh_JsDJbG5LmdQuaFaRcyf8_0 2024-09-12T01:21:56.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.888+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14252933820445891854', time=2024-09-12T03:12:15.510853+0000, chain.objs.size()=1 2024-09-12T01:21:56.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.888+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.501__shadow_.9LW5R3TzMHi89LnGCYrcoeB7mtDLA5u_0 2024-09-12T01:21:56.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.888+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4482802262597441489', time=2024-09-12T03:12:28.461953+0000, chain.objs.size()=1 2024-09-12T01:21:56.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.888+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.519__multipart_mymultipart.2~4KSNUs2f0lBgiM6tS-mwMximELtdPQU.1 2024-09-12T01:21:56.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.888+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11982334232522415388', time=2024-09-12T03:13:51.796905+0000, chain.objs.size()=1 2024-09-12T01:21:56.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.888+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.555__shadow_.BgTjm73g08eEC5ItpSkX5gPGb2FDkYS_0 2024-09-12T01:21:56.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.888+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5553248229001008240', time=2024-09-12T03:13:55.242916+0000, chain.objs.size()=1 2024-09-12T01:21:56.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.888+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.558__shadow_.2SqnhW13tDV4H1rd0SjKC2Ccl-szqgp_0 2024-09-12T01:21:56.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.888+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5979657063592546213', time=2024-09-12T03:14:15.613496+0000, chain.objs.size()=1 2024-09-12T01:21:56.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.888+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:vDN0buaF4jmEy2gfckhAftbvc2OTUkD_.gfGe3Web52qWyCNeqEA5ehbcZGz0zDX_0 2024-09-12T01:21:56.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.892+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17159998777856200125', time=2024-09-12T03:14:17.089239+0000, chain.objs.size()=1 2024-09-12T01:21:56.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.892+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:wsv1cRyCHz8YDh1NaCPBO4enPyAeKbp_.scQimbr_HNSrYcP0_TlFKQd8uDsrvuE_0 2024-09-12T01:21:56.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.892+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6588738928946358111', time=2024-09-12T03:14:18.072101+0000, chain.objs.size()=1 2024-09-12T01:21:56.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.892+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.571__shadow:egL7hGA3cgbL5JXA6txO5g5kTX2f7v-_.QhQ2jMFLvcyk1lvg3pXhhqr1AiOjcgF_0 2024-09-12T01:21:56.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.892+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16464278276628788158', time=2024-09-12T03:14:25.836488+0000, chain.objs.size()=1 2024-09-12T01:21:56.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.892+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.576__shadow:SII.BfF7Q96dmh1lR.-uCc9bRPC5OHs_.7irdhRvkcaxUkER78jHyiibWY3oQ4z1_0 2024-09-12T01:21:56.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.892+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5462804791412060126', time=2024-09-12T03:14:33.933364+0000, chain.objs.size()=1 2024-09-12T01:21:56.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.892+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:c3iDBz88D5JTuC5sIRLXA2wmThR3nZ7_.Ji2d9Si55bph11_1Nh1zjPzLEqPjS0L_0 2024-09-12T01:21:56.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.892+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13021970282657449591', time=2024-09-12T03:14:45.513090+0000, chain.objs.size()=1 2024-09-12T01:21:56.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.892+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:PkFZLNtkm.ZmiX--2-KCyRoMoLUrEmC_.kgxFV3_xrW7AwQpYAZe4XID_dfm3shD_0 2024-09-12T01:21:56.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.892+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14244016838066879829', time=2024-09-12T03:14:58.338275+0000, chain.objs.size()=1 2024-09-12T01:21:56.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.892+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.587__shadow:6bCQKo2asazT8CRMOOsS8tqEXKGuJYh_.OdKZ0lYuCl_5MKR956HgDUC2v_PQCvS_0 2024-09-12T01:21:56.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.892+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9128884795782698367', time=2024-09-12T03:14:58.921038+0000, chain.objs.size()=1 2024-09-12T01:21:56.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.892+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.588__shadow:sHXEdQx16vfYbVR-ERndQuzIudIBVzq_.nFH26Bv3sidnjj9uh_oZtm86HVIEYd__0 2024-09-12T01:21:56.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.892+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5647928977044039052', time=2024-09-12T03:16:28.533924+0000, chain.objs.size()=1 2024-09-12T01:21:56.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.892+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.618__shadow_.gObsmZJEj8NH8IzNC0HVQTHTPZq_Orp_0 2024-09-12T01:21:56.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.896+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:56.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.896+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:21:56.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.896+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:56.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.900+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:56.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.900+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48496' 2024-09-12T01:21:56.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.900+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5348084546253112591', time=2024-09-12T03:05:56.717526+0000, chain.objs.size()=2 2024-09-12T01:21:56.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.900+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.159__shadow_.Ilp2GUQSlYKxavKEaG8mA3BbYEjRUzg_0 2024-09-12T01:21:56.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.900+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.159__shadow_.Ilp2GUQSlYKxavKEaG8mA3BbYEjRUzg_1 2024-09-12T01:21:56.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.900+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5650234924375596746', time=2024-09-12T03:05:56.744822+0000, chain.objs.size()=2 2024-09-12T01:21:56.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.900+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.159__shadow_.6ajtxYxowtkrTSqSO3EeiU6h9qXr2OT_0 2024-09-12T01:21:56.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.900+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.159__shadow_.6ajtxYxowtkrTSqSO3EeiU6h9qXr2OT_1 2024-09-12T01:21:56.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.900+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1501242133683350354', time=2024-09-12T03:05:58.790467+0000, chain.objs.size()=1 2024-09-12T01:21:56.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.900+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.161__shadow_.MAsQOCWG-a1qsgIPVYKPhEL-QB2LTeK_0 2024-09-12T01:21:56.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.900+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11455886565389777340', time=2024-09-12T03:08:11.443832+0000, chain.objs.size()=1 2024-09-12T01:21:56.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.900+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.239__shadow_.11TMJgtXwxnmTV7SSugDnkHsBwYfWIR_0 2024-09-12T01:21:56.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.900+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10926464657374542586', time=2024-09-12T03:08:12.067151+0000, chain.objs.size()=1 2024-09-12T01:21:56.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.900+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.240__shadow_.ftB_6438WlpGdJoRJhYubli6ALzHemM_0 2024-09-12T01:21:56.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.900+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4886650975711220448', time=2024-09-12T03:08:24.720159+0000, chain.objs.size()=1 2024-09-12T01:21:56.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.900+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.257__shadow_.wzV34xMDVPkOhvDpvT2oBjIBR76XAHo_0 2024-09-12T01:21:56.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.900+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8620109457491488418', time=2024-09-12T03:08:47.566911+0000, chain.objs.size()=1 2024-09-12T01:21:56.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.900+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Gajz_RJKvRsyn0s4ZfLU5lXg5JV0ZFo_0 2024-09-12T01:21:56.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.900+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1780735473632597992', time=2024-09-12T03:08:47.577526+0000, chain.objs.size()=1 2024-09-12T01:21:56.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.900+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.s2gqOHsn6s_YcsrnGzWQbqQ9FZS_PSv_0 2024-09-12T01:21:56.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.900+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18394114586462276440', time=2024-09-12T03:08:47.598712+0000, chain.objs.size()=1 2024-09-12T01:21:56.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.900+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.FHRFlI5inPGNKCJ2x8Fjdasf934Hzp9_0 2024-09-12T01:21:56.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.900+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17238616856022449824', time=2024-09-12T03:08:47.637984+0000, chain.objs.size()=1 2024-09-12T01:21:56.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.900+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.zBdD0Mzhnhqgq8d1d0A66exUHOgAhRq_0 2024-09-12T01:21:56.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.977508475475864507', time=2024-09-12T03:08:47.654250+0000, chain.objs.size()=1 2024-09-12T01:21:56.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.7bt8yftjCgf094kkqz9MJKNdYLom98D_0 2024-09-12T01:21:56.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9685139122807188723', time=2024-09-12T03:08:47.665774+0000, chain.objs.size()=1 2024-09-12T01:21:56.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Xl5S8N2ZNPNDw_lhWZLih6l-O72aHqe_0 2024-09-12T01:21:56.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7584668197301567513', time=2024-09-12T03:08:47.670650+0000, chain.objs.size()=1 2024-09-12T01:21:56.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.P9ZUGEWTl4iNxVZteqjr9JAxPayW-RE_0 2024-09-12T01:21:56.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6484049057103851752', time=2024-09-12T03:08:47.863929+0000, chain.objs.size()=1 2024-09-12T01:21:56.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.xbMD4rL66RCj9r8WFJOij83WrflKImP_0 2024-09-12T01:21:56.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14467751554973329512', time=2024-09-12T03:08:47.956701+0000, chain.objs.size()=1 2024-09-12T01:21:56.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.A4YvAShtZIqK89JEig7cWy9S8KR3Bsk_0 2024-09-12T01:21:56.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9768586414092412404', time=2024-09-12T03:08:48.001438+0000, chain.objs.size()=1 2024-09-12T01:21:56.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ROwn8E3FwDScyMNrqelAeZldtgmLl5n_0 2024-09-12T01:21:56.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14093028595930236992', time=2024-09-12T03:08:48.194348+0000, chain.objs.size()=1 2024-09-12T01:21:56.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.KMtH_iNzeDBDn7CscZI_vVXdPvE6YfO_0 2024-09-12T01:21:56.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.594514616007563177', time=2024-09-12T03:08:48.227974+0000, chain.objs.size()=1 2024-09-12T01:21:56.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.zjIpTestBigGwB3kc34ccCwTPl787qa_0 2024-09-12T01:21:56.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7712335634644940163', time=2024-09-12T03:08:48.255056+0000, chain.objs.size()=1 2024-09-12T01:21:56.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.1_svbDbNC6l3S10N0-cg7eNBUTqZnRt_0 2024-09-12T01:21:56.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2682949097828425630', time=2024-09-12T03:08:48.257889+0000, chain.objs.size()=1 2024-09-12T01:21:56.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.XyfII2eR0Ap2PMxnxyPnG6fLfLekenm_0 2024-09-12T01:21:56.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6123307358958364231', time=2024-09-12T03:08:48.301766+0000, chain.objs.size()=1 2024-09-12T01:21:56.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.YvsiR0WRh2b6qyROh4nKqdzSD3suWQs_0 2024-09-12T01:21:56.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5858293132789256935', time=2024-09-12T03:08:48.488448+0000, chain.objs.size()=1 2024-09-12T01:21:56.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.gntpMhn7D0pw9UZSg7hqydHt0N-uraG_0 2024-09-12T01:21:56.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3069215385059724075', time=2024-09-12T03:08:48.571175+0000, chain.objs.size()=1 2024-09-12T01:21:56.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.lAWsNHD5Oy2-1sqeneP46rUSRiSC-pX_0 2024-09-12T01:21:56.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10493224044016469153', time=2024-09-12T03:08:48.606168+0000, chain.objs.size()=1 2024-09-12T01:21:56.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Asqyazbl_Eib5d7VIEy7kAK_Nw0ahsA_0 2024-09-12T01:21:56.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2504448417779048412', time=2024-09-12T03:08:48.610585+0000, chain.objs.size()=1 2024-09-12T01:21:56.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.JIWnxl1inKx4k4i0fwpA5lvZsbnfyCt_0 2024-09-12T01:21:56.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14504008707073737164', time=2024-09-12T03:08:48.683947+0000, chain.objs.size()=1 2024-09-12T01:21:56.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.F4Wsrzo2rYqUwcOoORE7UCbwCt_KkSP_0 2024-09-12T01:21:56.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16712314654127979831', time=2024-09-12T03:08:48.922921+0000, chain.objs.size()=1 2024-09-12T01:21:56.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.rgYuPXaBAC0zycV0OYksjeXudSObsaX_0 2024-09-12T01:21:56.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16874588451383436385', time=2024-09-12T03:08:48.928266+0000, chain.objs.size()=1 2024-09-12T01:21:56.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.pq6ZAsyYOtFODvfCNlpMkTcbryIffas_0 2024-09-12T01:21:56.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1929953724420772863', time=2024-09-12T03:08:48.974003+0000, chain.objs.size()=1 2024-09-12T01:21:56.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.904+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.GzFwLMdgB9yNfzchZGg5K505e8w_eHQ_0 2024-09-12T01:21:56.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5479772370734792697', time=2024-09-12T03:08:48.985857+0000, chain.objs.size()=1 2024-09-12T01:21:56.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.C6SwVa5c-yhy5uZVmij39mT31oHVT6K_0 2024-09-12T01:21:56.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15365728012597604803', time=2024-09-12T03:08:49.019867+0000, chain.objs.size()=1 2024-09-12T01:21:56.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.-Uu-BUK5gOuRCmlgBvBaAw_2S6Pfnje_0 2024-09-12T01:21:56.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5994739902027588410', time=2024-09-12T03:08:49.050094+0000, chain.objs.size()=1 2024-09-12T01:21:56.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.jwrhLAjKO5D3gwibvaxanhhK1U-KNex_0 2024-09-12T01:21:56.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12795275324423873115', time=2024-09-12T03:08:49.305091+0000, chain.objs.size()=1 2024-09-12T01:21:56.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.9oFY-BYGqVrKbz9efvXzg5xrkxCeEAW_0 2024-09-12T01:21:56.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5613084274646661684', time=2024-09-12T03:08:49.379785+0000, chain.objs.size()=1 2024-09-12T01:21:56.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.tvFRc-vrYzhNCZeSJgxYkZhA_D-Ginj_0 2024-09-12T01:21:56.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15341874097259328307', time=2024-09-12T03:08:49.546983+0000, chain.objs.size()=1 2024-09-12T01:21:56.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.KbShD-b2c3MvJvX6t34y9piJEEoozC1_0 2024-09-12T01:21:56.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9318087713992825919', time=2024-09-12T03:08:49.561678+0000, chain.objs.size()=1 2024-09-12T01:21:56.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.GXE_Lfz3QFXgxHxyQmby6atJFG3I-yD_0 2024-09-12T01:21:56.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.218798558264916301', time=2024-09-12T03:08:49.596847+0000, chain.objs.size()=1 2024-09-12T01:21:56.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.TBGg5vnlJAe66nnmaFQJsBCVr5vVGA3_0 2024-09-12T01:21:56.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16899515294455606606', time=2024-09-12T03:08:49.621474+0000, chain.objs.size()=1 2024-09-12T01:21:56.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.LExjHqS9aBATK_9-eSpoWjG3VX-Y9Ek_0 2024-09-12T01:21:56.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13481811850983436120', time=2024-09-12T03:08:49.668081+0000, chain.objs.size()=1 2024-09-12T01:21:56.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.mRxOxFFyUkBxUaufCSFQ40QNWkpENtb_0 2024-09-12T01:21:56.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15638692794401812834', time=2024-09-12T03:08:49.707097+0000, chain.objs.size()=1 2024-09-12T01:21:56.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Ld4g4kKM1ISUwa1Qk4pmElQGpkXGK0N_0 2024-09-12T01:21:56.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6658832162611314491', time=2024-09-12T03:08:49.927984+0000, chain.objs.size()=1 2024-09-12T01:21:56.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ku24VLuJ9KlMAQXoByZ_x9DXcatHaa0_0 2024-09-12T01:21:56.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8858505544394057712', time=2024-09-12T03:08:51.978275+0000, chain.objs.size()=1 2024-09-12T01:21:56.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.266__shadow_.rpUmU7DWJ1o8euqfepWwxM-Mp4w6svz_0 2024-09-12T01:21:56.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1247045511546795392', time=2024-09-12T03:09:02.219983+0000, chain.objs.size()=1 2024-09-12T01:21:56.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.281__shadow_.NIgces-iA_BK8VzOEl5pSPhUsJe0Z_h_0 2024-09-12T01:21:56.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11179030373176968580', time=2024-09-12T03:09:13.071724+0000, chain.objs.size()=1 2024-09-12T01:21:56.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.294__shadow_.Lo82-U0gjNW3cHikgxSEMfI57m1BY0__0 2024-09-12T01:21:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.376607951188352701', time=2024-09-12T03:09:15.802783+0000, chain.objs.size()=1 2024-09-12T01:21:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.298__shadow_.9Ux-6Rc2mCyACeaG2VX3oRgNHeO-lk__0 2024-09-12T01:21:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14315271845854488256', time=2024-09-12T03:09:18.003979+0000, chain.objs.size()=1 2024-09-12T01:21:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.301__shadow_.jULVCt-Nxw67sqhn-tZbaW4AzH7n_E-_0 2024-09-12T01:21:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1256540923172873385', time=2024-09-12T03:09:53.087260+0000, chain.objs.size()=1 2024-09-12T01:21:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.908+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.cbecWHJGzXvXC1ic2dd76eNQsIyFgoX_0 2024-09-12T01:21:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16899847665248234675', time=2024-09-12T03:09:53.110304+0000, chain.objs.size()=1 2024-09-12T01:21:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.-XGWmAHvF8QwX3bOPhG09IVIxR_kgks_0 2024-09-12T01:21:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14337233914226075401', time=2024-09-12T03:09:53.126003+0000, chain.objs.size()=1 2024-09-12T01:21:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Ejf-CqKDNFeNURYRKWRcQWfda1X9wdI_0 2024-09-12T01:21:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3622631609845352012', time=2024-09-12T03:09:53.361656+0000, chain.objs.size()=1 2024-09-12T01:21:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Yc2GI3_0MmjyTpiDFasco4R_z992Mvg_0 2024-09-12T01:21:56.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3902157761454037843', time=2024-09-12T03:09:53.393445+0000, chain.objs.size()=1 2024-09-12T01:21:56.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.zYeK9-xMwlyJ92k3T3DNq3vHjxd_3KS_0 2024-09-12T01:21:56.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3088969792900486430', time=2024-09-12T03:09:53.396682+0000, chain.objs.size()=1 2024-09-12T01:21:56.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.LgKsvsbdKlVsK2xso7e-BgfnUzuQhgp_0 2024-09-12T01:21:56.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11943999502583639774', time=2024-09-12T03:09:53.410428+0000, chain.objs.size()=1 2024-09-12T01:21:56.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.myh4lPrOZ6Km-Ks8ryQTIOoFKnL0Aem_0 2024-09-12T01:21:56.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8725754069380440841', time=2024-09-12T03:09:53.419282+0000, chain.objs.size()=1 2024-09-12T01:21:56.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.cHgYNxE1zd984DP-UVI9BL0BYGSI-ij_0 2024-09-12T01:21:56.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12744801442296173114', time=2024-09-12T03:09:53.452215+0000, chain.objs.size()=1 2024-09-12T01:21:56.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.cGpgO1Ph9uLXVC5ME4UnLsIiGREQMsA_0 2024-09-12T01:21:56.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3822218712809054754', time=2024-09-12T03:09:53.624415+0000, chain.objs.size()=1 2024-09-12T01:21:56.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.q7oGyREpD_iDRScb0S3Ed-MNXUrdrRf_0 2024-09-12T01:21:56.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13530473764571296558', time=2024-09-12T03:09:53.725741+0000, chain.objs.size()=1 2024-09-12T01:21:56.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.XGakejKi6YXHykoofH65a6GR7k3w4Tf_0 2024-09-12T01:21:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13153607432570940256', time=2024-09-12T03:09:53.822694+0000, chain.objs.size()=1 2024-09-12T01:21:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.15_6RCifj9sHM8W00Y7b1s7iZU0LZA2_0 2024-09-12T01:21:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.159056087804001879', time=2024-09-12T03:09:53.989680+0000, chain.objs.size()=1 2024-09-12T01:21:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.cbI4Yk8JASIL2ugfsednD--zN8eiFoj_0 2024-09-12T01:21:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.774398232661261906', time=2024-09-12T03:09:54.000627+0000, chain.objs.size()=1 2024-09-12T01:21:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.g2JR-cR4_oKNsy1PLq67_TgAkkpYp5k_0 2024-09-12T01:21:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10303012717576091421', time=2024-09-12T03:09:54.012240+0000, chain.objs.size()=1 2024-09-12T01:21:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.CtsU28tYSV1iK2ZGeXQlDU0xg4WxkkG_0 2024-09-12T01:21:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7453184898615547480', time=2024-09-12T03:09:54.112397+0000, chain.objs.size()=1 2024-09-12T01:21:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.vSEtI0jTyqN07C56oinyFmdcS8Hecwc_0 2024-09-12T01:21:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16784325975067677575', time=2024-09-12T03:09:54.159605+0000, chain.objs.size()=1 2024-09-12T01:21:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.AqoB-sFe29pva8-mzLImIv-hQ7cayft_0 2024-09-12T01:21:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10746350824377281351', time=2024-09-12T03:09:54.298415+0000, chain.objs.size()=1 2024-09-12T01:21:56.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.v91NxT6AAOXgOL1dZ8GezSe--Y3PAPP_0 2024-09-12T01:21:56.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1939882087170695633', time=2024-09-12T03:09:54.316465+0000, chain.objs.size()=1 2024-09-12T01:21:56.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.oktwqg8wKEfxhubcgkil_bBskaMLZoD_0 2024-09-12T01:21:56.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15853651329796451437', time=2024-09-12T03:09:54.660817+0000, chain.objs.size()=1 2024-09-12T01:21:56.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.912+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ERI_uWP34OU7kOm4XDr9ECf3X3YBIcf_0 2024-09-12T01:21:56.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14114899799262639995', time=2024-09-12T03:09:54.730412+0000, chain.objs.size()=1 2024-09-12T01:21:56.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ot9TOJNmj9M-8L-u6bU9-obdH-ihOzm_0 2024-09-12T01:21:56.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3648705529547057142', time=2024-09-12T03:09:54.752204+0000, chain.objs.size()=1 2024-09-12T01:21:56.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.rD7Z8Z1cymDQ-906CJVpb8u4a1VJMTI_0 2024-09-12T01:21:56.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15060371246646054189', time=2024-09-12T03:09:54.945630+0000, chain.objs.size()=1 2024-09-12T01:21:56.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.2y3d8t4TpfGk71XTuEGuXMs0TqKPIuk_0 2024-09-12T01:21:56.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1573520350274347844', time=2024-09-12T03:09:54.959512+0000, chain.objs.size()=1 2024-09-12T01:21:56.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.tj3YlV5Gf8L0YBKC6iZdVg8u_N_fp3r_0 2024-09-12T01:21:56.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5027560225121149383', time=2024-09-12T03:09:55.289355+0000, chain.objs.size()=1 2024-09-12T01:21:56.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.1DSqrMxWPGt_HCy15dTNNZyxaMkqBq2_0 2024-09-12T01:21:56.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9546994329255570218', time=2024-09-12T03:09:55.349297+0000, chain.objs.size()=1 2024-09-12T01:21:56.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.5gaLgei4sYANIkMar36ZPqYLTTU8sx0_0 2024-09-12T01:21:56.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18135033841767647933', time=2024-09-12T03:09:55.359864+0000, chain.objs.size()=1 2024-09-12T01:21:56.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Cpe_pqW9OsjVVlF9ywDG_qeq0pJr4BE_0 2024-09-12T01:21:56.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12402099879689716714', time=2024-09-12T03:09:55.422466+0000, chain.objs.size()=1 2024-09-12T01:21:56.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.7Uz20VAD_VhgpHRvZ7phtkzTuzyxYVY_0 2024-09-12T01:21:56.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9683208610094843107', time=2024-09-12T03:10:15.345869+0000, chain.objs.size()=1 2024-09-12T01:21:56.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.bSMMIzl6oRbxgBjRBZsbUPsAi0qtT0a_0 2024-09-12T01:21:56.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12776968299676009995', time=2024-09-12T03:10:15.581033+0000, chain.objs.size()=1 2024-09-12T01:21:56.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.AUdqJ9MxBnfk7dxOW8JgL1QvSEeepuT_0 2024-09-12T01:21:56.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12960732623596051701', time=2024-09-12T03:10:15.714473+0000, chain.objs.size()=1 2024-09-12T01:21:56.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.SN1jPn2b5jzDqwB_AqStVTm_2N-q4eO_0 2024-09-12T01:21:56.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7749440598449238103', time=2024-09-12T03:10:15.766807+0000, chain.objs.size()=1 2024-09-12T01:21:56.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.i-WRGVTD-ko7Kp3LI6h6gBrAtJC58hH_0 2024-09-12T01:21:56.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8687396451381820347', time=2024-09-12T03:10:15.938824+0000, chain.objs.size()=1 2024-09-12T01:21:56.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.DMbpYEYE911oahu8O6PEW-uaiPXB-pT_0 2024-09-12T01:21:56.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1048381062825270441', time=2024-09-12T03:10:15.949600+0000, chain.objs.size()=1 2024-09-12T01:21:56.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.fDKu4H3iIlb6EsxW9AWtdSTXIOpGfO9_0 2024-09-12T01:21:56.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3348964651227991147', time=2024-09-12T03:10:16.066408+0000, chain.objs.size()=1 2024-09-12T01:21:56.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.LoK7iJDkMu6jgRJ3TsFC_-9fQxHhtfT_0 2024-09-12T01:21:56.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11564415294009781806', time=2024-09-12T03:10:16.237945+0000, chain.objs.size()=1 2024-09-12T01:21:56.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.UBCCRuGoEL0LJueb9CPWLOBJ86xm5do_0 2024-09-12T01:21:56.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10877774310880684428', time=2024-09-12T03:10:16.269042+0000, chain.objs.size()=1 2024-09-12T01:21:56.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Q3aikbgRNgRoyGtumBZqnp_QJAWSW6n_0 2024-09-12T01:21:56.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1220669155061276560', time=2024-09-12T03:10:16.275649+0000, chain.objs.size()=1 2024-09-12T01:21:56.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.0cdF6eUOlBep4u5zioJdINz0FBAQUXI_0 2024-09-12T01:21:56.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.902490525051771523', time=2024-09-12T03:10:16.288858+0000, chain.objs.size()=1 2024-09-12T01:21:56.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.916+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.LY4XPJjazUpDwaeEIxHQMaT_L25gbub_0 2024-09-12T01:21:56.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7487498738900909636', time=2024-09-12T03:10:16.309315+0000, chain.objs.size()=1 2024-09-12T01:21:56.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.hf7OFROwg0soMjOO-fpacxEvQK7U7sW_0 2024-09-12T01:21:56.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17286288222141294070', time=2024-09-12T03:10:16.643486+0000, chain.objs.size()=1 2024-09-12T01:21:56.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ILPR3DC0UX5O8E1TlWxos7jObJE3mOS_0 2024-09-12T01:21:56.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6807942157901653632', time=2024-09-12T03:10:16.932373+0000, chain.objs.size()=1 2024-09-12T01:21:56.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.k8Lj47gN5cFk_bMFCDDmvq2T0dOvTKg_0 2024-09-12T01:21:56.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13710093635956843286', time=2024-09-12T03:10:17.012776+0000, chain.objs.size()=1 2024-09-12T01:21:56.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.DhhEjUY1pORt86QFXTL2FmtYVXoUOBw_0 2024-09-12T01:21:56.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6314493989909525955', time=2024-09-12T03:10:17.319067+0000, chain.objs.size()=1 2024-09-12T01:21:56.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.fjKCSjptvCnmRzLzX7fqTns4PVNZOaT_0 2024-09-12T01:21:56.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3850153022890813691', time=2024-09-12T03:10:17.450795+0000, chain.objs.size()=1 2024-09-12T01:21:56.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.XiBDPJcF_AOJmxmHEE9gt7GsZTpjrCQ_0 2024-09-12T01:21:56.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15015574410816239794', time=2024-09-12T03:10:17.486109+0000, chain.objs.size()=1 2024-09-12T01:21:56.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.wtlViRmt1J1tdrUgriMZzRTr0dyNaQe_0 2024-09-12T01:21:56.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5968368420368097888', time=2024-09-12T03:10:17.556478+0000, chain.objs.size()=1 2024-09-12T01:21:56.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.3-YPryjdT5f1bVUEETk_HVqilYd_HUW_0 2024-09-12T01:21:56.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5715083210308866068', time=2024-09-12T03:10:17.569342+0000, chain.objs.size()=1 2024-09-12T01:21:56.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.m2t3ln6v9qWPZRF_f-8Jp42_uGd6Clm_0 2024-09-12T01:21:56.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6057263074187740207', time=2024-09-12T03:10:17.614632+0000, chain.objs.size()=1 2024-09-12T01:21:56.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.iiJmBHilY912x9lorYcuoxdQThlaE8j_0 2024-09-12T01:21:56.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7039521893680941818', time=2024-09-12T03:10:17.785914+0000, chain.objs.size()=1 2024-09-12T01:21:56.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.W1NtbyaSZOdN_xaSel3LJhzDt5szMAY_0 2024-09-12T01:21:56.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10115105126541804793', time=2024-09-12T03:10:17.816990+0000, chain.objs.size()=1 2024-09-12T01:21:56.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.km2obTw-mkxNvcjlMyRMl5ZGJ8f1G3Q_0 2024-09-12T01:21:56.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1464260148639993912', time=2024-09-12T03:10:17.837443+0000, chain.objs.size()=1 2024-09-12T01:21:56.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.0PN1BK7R26VxxTXKEl4wi2SgWcLzkIj_0 2024-09-12T01:21:56.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6320055133460462698', time=2024-09-12T03:10:17.866824+0000, chain.objs.size()=1 2024-09-12T01:21:56.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Cv85JRsl-i2f4U-luWLuheqAtqIE6gM_0 2024-09-12T01:21:56.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3516554147765059297', time=2024-09-12T03:10:17.875616+0000, chain.objs.size()=1 2024-09-12T01:21:56.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.920+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.OQn1hlc-kyZEMjHPupD8HAnmcAX6F4W_0 2024-09-12T01:21:56.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.924+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48496 2024-09-12T01:21:56.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.924+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T01:21:56.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.924+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11835154567406900164', time=2024-09-12T03:11:56.761679+0000, chain.objs.size()=1 2024-09-12T01:21:56.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.924+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.467__shadow_.MmGFxoSKz4Q-PATz3gZipbbUcGZWltx_0 2024-09-12T01:21:56.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.924+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17413846491299121659', time=2024-09-12T03:12:05.774831+0000, chain.objs.size()=1 2024-09-12T01:21:56.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.924+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.485__shadow_.irJE_0Ng9xDRXM8NkYdC3vBUQ5-Rks3_0 2024-09-12T01:21:56.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.924+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12681487371489136435', time=2024-09-12T03:12:10.951720+0000, chain.objs.size()=1 2024-09-12T01:21:56.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.924+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.492__shadow_.uuCvT7liYOpSe6mkX_WJdIUHti2Xz0X_0 2024-09-12T01:21:56.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.924+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7468707171478318867', time=2024-09-12T03:12:54.469748+0000, chain.objs.size()=6 2024-09-12T01:21:56.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.924+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.DoELwUnWHIwYj8TbBdXQmLM-iAdT_X68.1 2024-09-12T01:21:56.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.924+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.UjbYADzcbIasF-yGwCFBdkO5NzpIAFpA.2 2024-09-12T01:21:56.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.924+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.inkknnTyXtpQdBWKbHdojABi1UcJbUZ1.3 2024-09-12T01:21:56.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.924+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.pwI76o1PvVg20dMwe4KfsSbjeB9YSHZZ.4 2024-09-12T01:21:56.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.924+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.T5EbDvMVGzXD9MlYwFGBKjofsLMwiBjv.5 2024-09-12T01:21:56.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.924+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.R6b67r2zLa7MKKlyUjSN2tp-SOArSbqJ.6 2024-09-12T01:21:56.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.924+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4320774906051486662', time=2024-09-12T03:14:30.012900+0000, chain.objs.size()=1 2024-09-12T01:21:56.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.924+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.577__shadow:gVazQm2wUOLK4ZSbg5bysQoqyrHwzdz_.17M8X2CA-tI13nSH0zzOjE3wAj7Bhop_0 2024-09-12T01:21:56.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.924+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16430927497954127441', time=2024-09-12T03:14:49.860307+0000, chain.objs.size()=4 2024-09-12T01:21:56.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.924+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.579__multipart_testobj.2~W1Gvy73cLLCok7BrkAxcL-pPWxg6pZS.1 2024-09-12T01:21:56.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.924+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.579__multipart_testobj.2~W1Gvy73cLLCok7BrkAxcL-pPWxg6pZS.2 2024-09-12T01:21:56.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.928+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.579__multipart_testobj.2~W1Gvy73cLLCok7BrkAxcL-pPWxg6pZS.3 2024-09-12T01:21:56.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.928+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.579__multipart_testobj.2~W1Gvy73cLLCok7BrkAxcL-pPWxg6pZS.4 2024-09-12T01:21:56.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.928+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14635663797206012191', time=2024-09-12T03:17:46.819661+0000, chain.objs.size()=1 2024-09-12T01:21:56.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.928+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.637__shadow_.T0klYBL_90qnCyznhZetbR8CcAkufQ0_0 2024-09-12T01:21:56.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.928+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5295427974729855284', time=2024-09-12T03:18:07.266151+0000, chain.objs.size()=6 2024-09-12T01:21:56.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.928+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.662__multipart_baz.2~naNmdovvASnnp-JPdTcPs4JAig0ptnW.1 2024-09-12T01:21:56.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.928+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.662__multipart_baz.2~naNmdovvASnnp-JPdTcPs4JAig0ptnW.2 2024-09-12T01:21:56.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.932+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.662__multipart_baz.2~naNmdovvASnnp-JPdTcPs4JAig0ptnW.3 2024-09-12T01:21:56.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.932+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.662__multipart_baz.2~naNmdovvASnnp-JPdTcPs4JAig0ptnW.4 2024-09-12T01:21:56.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.932+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.662__multipart_baz.2~naNmdovvASnnp-JPdTcPs4JAig0ptnW.5 2024-09-12T01:21:56.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.932+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.662__multipart_baz.2~naNmdovvASnnp-JPdTcPs4JAig0ptnW.6 2024-09-12T01:21:56.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.932+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17607481828969488770', time=2024-09-12T03:18:10.089539+0000, chain.objs.size()=1 2024-09-12T01:21:56.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.932+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.666__shadow_.Peo982kPRe-aGF6LJ8nRVPoTxpZEHqY_0 2024-09-12T01:21:56.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.932+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8102230068056788808', time=2024-09-12T03:18:11.319936+0000, chain.objs.size()=1 2024-09-12T01:21:56.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.932+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.667__shadow_.stfX1lT97rF1zCbRerpnpoOMgRZA0gx_0 2024-09-12T01:21:56.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.932+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13738268813984428415', time=2024-09-12T03:18:33.583764+0000, chain.objs.size()=1 2024-09-12T01:21:56.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.932+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.705__shadow:NHCfum3F0Dw53c0rRzo.eJTdJKXVIxq_.h-w6dhsf3yL5O3OGTJVFX9YsijJiEOs_0 2024-09-12T01:21:56.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.932+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:56.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.936+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:21:56.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.936+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:56.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.940+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:56.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.940+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46042' 2024-09-12T01:21:56.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.940+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9105826585197320567', time=2024-09-12T03:05:59.712369+0000, chain.objs.size()=2 2024-09-12T01:21:56.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.940+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.161__shadow_.FGpLf-McsnN0VfSVYqI-vgk74PMFZdN_0 2024-09-12T01:21:56.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.940+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.161__shadow_.FGpLf-McsnN0VfSVYqI-vgk74PMFZdN_1 2024-09-12T01:21:56.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.940+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_FvpaYbky5O24EbeluvbNAPpLwVv_KYx', time=2024-09-12T03:06:00.035746+0000, chain.objs.size()=2 2024-09-12T01:21:56.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.940+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.161__shadow_.oRhb_IfKuROaYhrgzfjNLjGHytlPkzD_0 2024-09-12T01:21:56.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.940+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.161__shadow_.oRhb_IfKuROaYhrgzfjNLjGHytlPkzD_1 2024-09-12T01:21:56.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.940+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16457622094679293602', time=2024-09-12T03:08:24.718536+0000, chain.objs.size()=1 2024-09-12T01:21:56.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.940+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.257__shadow_.Xe4riGuyGcnrXX0I1L2SEU68i2ohu8B_0 2024-09-12T01:21:56.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.940+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.360935241623847758', time=2024-09-12T03:08:47.556914+0000, chain.objs.size()=1 2024-09-12T01:21:56.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.940+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.7-Mt4ELH1hWOKqV9SZx9S4EzOC_qN6E_0 2024-09-12T01:21:56.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.940+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12539254596074935040', time=2024-09-12T03:08:47.582439+0000, chain.objs.size()=1 2024-09-12T01:21:56.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.940+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.njLLdv3gTcMUM5aLaO6r5dhbwt1HqZn_0 2024-09-12T01:21:56.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.940+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1423190617676646539', time=2024-09-12T03:08:47.645397+0000, chain.objs.size()=1 2024-09-12T01:21:56.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.940+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.l4QEUE4czTyHs26exm-yOxyUlfeY4GJ_0 2024-09-12T01:21:56.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.940+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17848504016866166710', time=2024-09-12T03:08:47.668898+0000, chain.objs.size()=1 2024-09-12T01:21:56.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.940+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.4Zc2HW3duBh3YmSNW3v35c_H3LBsjJt_0 2024-09-12T01:21:56.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.940+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1224208564375608347', time=2024-09-12T03:08:47.675138+0000, chain.objs.size()=1 2024-09-12T01:21:56.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.940+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Vd7pJDjxVyB5EUta1DvSwM7TRkyhzi2_0 2024-09-12T01:21:56.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.940+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6130705989796989924', time=2024-09-12T03:08:47.848117+0000, chain.objs.size()=1 2024-09-12T01:21:56.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.940+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_._BTQsmztsfq0vqWDXqHRXSY24EF81ti_0 2024-09-12T01:21:56.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.940+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7025612724373544029', time=2024-09-12T03:08:47.900595+0000, chain.objs.size()=1 2024-09-12T01:21:56.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.940+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.QvUnafIrik2oDCIgl2H49B1eEWWw4b__0 2024-09-12T01:21:56.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3877002830211237233', time=2024-09-12T03:08:47.944753+0000, chain.objs.size()=1 2024-09-12T01:21:56.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.FUyHuoOiVQMqTKOIaiHzBA3vl1vmCQn_0 2024-09-12T01:21:56.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16971798746652708510', time=2024-09-12T03:08:47.999263+0000, chain.objs.size()=1 2024-09-12T01:21:56.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.uBSdXWTSX2qJHWbUHH0rr5cGfLnEf2v_0 2024-09-12T01:21:56.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12465478450672859248', time=2024-09-12T03:08:48.008894+0000, chain.objs.size()=1 2024-09-12T01:21:56.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.AAgRsQezcKWimOi-eN7mrXSQVe2gxde_0 2024-09-12T01:21:56.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2993300958423958564', time=2024-09-12T03:08:48.247258+0000, chain.objs.size()=1 2024-09-12T01:21:56.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.w9po1aUgoZVsugHBS__8XAlnONwGTYy_0 2024-09-12T01:21:56.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2001443913573007938', time=2024-09-12T03:08:48.261109+0000, chain.objs.size()=1 2024-09-12T01:21:56.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.fZY4_XHiRCK2jaET8Rh-EkDrZ2c1WRO_0 2024-09-12T01:21:56.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11284499626621413576', time=2024-09-12T03:08:48.293277+0000, chain.objs.size()=1 2024-09-12T01:21:56.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.effOcNUk-WVeFIX6pII2gBkyf_oKI1X_0 2024-09-12T01:21:56.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5379524118244500162', time=2024-09-12T03:08:48.489676+0000, chain.objs.size()=1 2024-09-12T01:21:56.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.advnRbL1w117BptwtfSz46L1ENz4iyV_0 2024-09-12T01:21:56.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3587113960263487593', time=2024-09-12T03:08:48.501792+0000, chain.objs.size()=1 2024-09-12T01:21:56.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.YRjh-FcZqOjbpy5iBs-STIkl9PxQBTP_0 2024-09-12T01:21:56.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6554572896822175039', time=2024-09-12T03:08:48.583516+0000, chain.objs.size()=1 2024-09-12T01:21:56.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ll-OaUmYzkrY7VVhgmUQ-G6XwINdTCg_0 2024-09-12T01:21:56.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13351141001111346824', time=2024-09-12T03:08:48.879158+0000, chain.objs.size()=1 2024-09-12T01:21:56.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.U8ArCy5iXLgQT8925NA3xJL0BvOnCp4_0 2024-09-12T01:21:56.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14141568237284804969', time=2024-09-12T03:08:48.930013+0000, chain.objs.size()=1 2024-09-12T01:21:56.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.tke7sF1OZHrfRQPfe1YPKF84h_JtnuN_0 2024-09-12T01:21:56.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5828445837893849768', time=2024-09-12T03:08:48.945637+0000, chain.objs.size()=1 2024-09-12T01:21:56.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.LmgtlUUCS1IHP7Ual4VMs73YtM6qJIn_0 2024-09-12T01:21:56.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12853323779954846258', time=2024-09-12T03:08:49.188498+0000, chain.objs.size()=1 2024-09-12T01:21:56.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.NNm3k5tr1NdhF5l8_lzRdQRRx1pwGmn_0 2024-09-12T01:21:56.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7312233966221809009', time=2024-09-12T03:08:49.337040+0000, chain.objs.size()=1 2024-09-12T01:21:56.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.0BG1JMCCT_Eh3vz5STA96x-bL6l1Igc_0 2024-09-12T01:21:56.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9069239087397212025', time=2024-09-12T03:08:49.375046+0000, chain.objs.size()=1 2024-09-12T01:21:56.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.f472Yx1nkV8MngtnTS-HibSAIKFIdtI_0 2024-09-12T01:21:56.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9127182787856071022', time=2024-09-12T03:08:49.656397+0000, chain.objs.size()=1 2024-09-12T01:21:56.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.CRAhN9YAk13ZgkTE0dlcKVG2IXbjCOJ_0 2024-09-12T01:21:56.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16920426053980360377', time=2024-09-12T03:08:49.706599+0000, chain.objs.size()=1 2024-09-12T01:21:56.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Cf1QzwYGlYHyRdu0LnMlDXm59AtV3Le_0 2024-09-12T01:21:56.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.944+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3559158654069799675', time=2024-09-12T03:08:49.715643+0000, chain.objs.size()=1 2024-09-12T01:21:56.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.iHJJiqbqgTVuSt_CRpQZ4FK_W0FiTyV_0 2024-09-12T01:21:56.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4969967479923838717', time=2024-09-12T03:08:49.858832+0000, chain.objs.size()=1 2024-09-12T01:21:56.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.des-_zCyl3LvbhvpE_NbTdB6XKpvOqD_0 2024-09-12T01:21:56.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8095594918726730934', time=2024-09-12T03:08:49.979655+0000, chain.objs.size()=1 2024-09-12T01:21:56.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.DT440B15jf6ooCKP8eSBkClj1gfIG_m_0 2024-09-12T01:21:56.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2159680248914021621', time=2024-09-12T03:08:49.998640+0000, chain.objs.size()=1 2024-09-12T01:21:56.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.qonPVcR6T8pkm6Kckg4U8f6I_gIbOxF_0 2024-09-12T01:21:56.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4206681385277275806', time=2024-09-12T03:08:50.017670+0000, chain.objs.size()=1 2024-09-12T01:21:56.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.qh72eLuua8Zpt-Z5VgYrgVEB-ZcZ1Z-_0 2024-09-12T01:21:56.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7842415997054936702', time=2024-09-12T03:08:50.021483+0000, chain.objs.size()=1 2024-09-12T01:21:56.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.AVzs9IooscolqWW9N9QtPDTV8FCrSGX_0 2024-09-12T01:21:56.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15655349273923887495', time=2024-09-12T03:08:54.656397+0000, chain.objs.size()=1 2024-09-12T01:21:56.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.270__shadow_.Ukmn0EQP0rQ9eRO55bVETcUar_oHTku_0 2024-09-12T01:21:56.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7386687433266811419', time=2024-09-12T03:09:01.533471+0000, chain.objs.size()=1 2024-09-12T01:21:56.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.280__shadow_.doKFpgNYAFQC--tT099qspk1ZBmz9wh_0 2024-09-12T01:21:56.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18060456017266430005', time=2024-09-12T03:09:02.935798+0000, chain.objs.size()=1 2024-09-12T01:21:56.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.282__shadow_.-dHdHr2nuc0sva4DzFp1WZP2bk83v4x_0 2024-09-12T01:21:56.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1652347388824676255', time=2024-09-12T03:09:11.604855+0000, chain.objs.size()=1 2024-09-12T01:21:56.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.293__shadow_.k2-IfW0d1ob-OcG8-27m-JNAjUiVZuP_0 2024-09-12T01:21:56.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6936706761816516212', time=2024-09-12T03:09:11.647645+0000, chain.objs.size()=1 2024-09-12T01:21:56.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.293__shadow_.bqr3ws_GFa_fcM-KA31LeEVYzKqOxIV_0 2024-09-12T01:21:56.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12816870082170461881', time=2024-09-12T03:09:13.037946+0000, chain.objs.size()=1 2024-09-12T01:21:56.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.294__shadow_.Xtx0k-kEUN5UVBNLi-2-QvOQckjhfs2_0 2024-09-12T01:21:56.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4464119111735220425', time=2024-09-12T03:09:32.548379+0000, chain.objs.size()=1 2024-09-12T01:21:56.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.322__shadow_.DnphIam_Ov5HrsBp2ol5DDrdc5hMz57_0 2024-09-12T01:21:56.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17836002600678325300', time=2024-09-12T03:09:53.082133+0000, chain.objs.size()=1 2024-09-12T01:21:56.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Pa8nVlOI_uLs-RKkNFJyGbHdqvg5D0C_0 2024-09-12T01:21:56.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18313169027977426816', time=2024-09-12T03:09:53.117216+0000, chain.objs.size()=1 2024-09-12T01:21:56.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.7oupNYl7jw6_mTj_uxM0TPgfrAMZUEq_0 2024-09-12T01:21:56.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8287487641384404923', time=2024-09-12T03:09:53.127546+0000, chain.objs.size()=1 2024-09-12T01:21:56.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.E_wE3AZVtCHnO_wEiuVjCcmntgjLsER_0 2024-09-12T01:21:56.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17061619643187802389', time=2024-09-12T03:09:53.425733+0000, chain.objs.size()=1 2024-09-12T01:21:56.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.948+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.psaC9xNsIinSa19eO03-Eia7f8VB_jr_0 2024-09-12T01:21:56.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14697251485956279975', time=2024-09-12T03:09:53.495620+0000, chain.objs.size()=1 2024-09-12T01:21:56.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Ay6NcY2GWKg4vYE6ZbEj41hZMnTrqfn_0 2024-09-12T01:21:56.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4804056252843390450', time=2024-09-12T03:09:53.697421+0000, chain.objs.size()=1 2024-09-12T01:21:56.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.wAY-V33uPSE0s9kPoodjh93GOAJ5WNb_0 2024-09-12T01:21:56.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1026067190929456030', time=2024-09-12T03:09:53.752847+0000, chain.objs.size()=1 2024-09-12T01:21:56.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.YAGBd7IF4_kAKbw3rpdfBhH3fEgXFs4_0 2024-09-12T01:21:56.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4793347144828724582', time=2024-09-12T03:09:53.785965+0000, chain.objs.size()=1 2024-09-12T01:21:56.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.-UsZ-UHRvgwM6TNz0oLAwTfYaoZ-g1__0 2024-09-12T01:21:56.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9326372399223425730', time=2024-09-12T03:09:53.805881+0000, chain.objs.size()=1 2024-09-12T01:21:56.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.SAOo9-OxzJp3_JeoqN03DsblR8-e5qD_0 2024-09-12T01:21:56.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17933041445953914458', time=2024-09-12T03:09:54.060223+0000, chain.objs.size()=1 2024-09-12T01:21:56.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.sTiCNtchPA-EnfBCXDKOSTC3w7epAwD_0 2024-09-12T01:21:56.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13640811337117998278', time=2024-09-12T03:09:54.119950+0000, chain.objs.size()=1 2024-09-12T01:21:56.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.CDgDU8B3nM5UNS0mcP-uo4YRoz70mgo_0 2024-09-12T01:21:56.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10306351030652986576', time=2024-09-12T03:09:54.127935+0000, chain.objs.size()=1 2024-09-12T01:21:56.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.9KG_5sXhDDOeQPu6UU-usgBZDogKHYt_0 2024-09-12T01:21:56.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11547271046267282284', time=2024-09-12T03:09:54.136368+0000, chain.objs.size()=1 2024-09-12T01:21:56.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.14PPw2jiw_oLTZ9qR5ulZhA8WHX_dac_0 2024-09-12T01:21:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.657709388869417994', time=2024-09-12T03:09:54.170052+0000, chain.objs.size()=1 2024-09-12T01:21:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.NG0PUPlA2SmbuatHzsZ5irssBt5pLQC_0 2024-09-12T01:21:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1229146140367457515', time=2024-09-12T03:09:54.173087+0000, chain.objs.size()=1 2024-09-12T01:21:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.kEXNqMpCDgPRDQ3n_FK7C7T6ui36bKp_0 2024-09-12T01:21:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17975129396794657510', time=2024-09-12T03:09:54.312864+0000, chain.objs.size()=1 2024-09-12T01:21:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.jFwJSI02QmG5QscbMxpfsy_OTFKqbyp_0 2024-09-12T01:21:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7107249045706638792', time=2024-09-12T03:09:54.424761+0000, chain.objs.size()=1 2024-09-12T01:21:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.d7dJLQBqnf17l_8v8Y8eKd96InpsYDi_0 2024-09-12T01:21:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5818219573881070032', time=2024-09-12T03:09:54.621645+0000, chain.objs.size()=1 2024-09-12T01:21:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ky7x17asVUhBxIbW0gxmSPkEecgXbXd_0 2024-09-12T01:21:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7248208935324766726', time=2024-09-12T03:09:54.627930+0000, chain.objs.size()=1 2024-09-12T01:21:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.5h6z1XzaK_qob4zIte0o8l2xJ4riqpO_0 2024-09-12T01:21:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2408276591451384368', time=2024-09-12T03:09:54.759773+0000, chain.objs.size()=1 2024-09-12T01:21:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.PCBO0H_bSSRlSaFCb8CM5tbwqeTaxbl_0 2024-09-12T01:21:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13450099325241970890', time=2024-09-12T03:09:54.803275+0000, chain.objs.size()=1 2024-09-12T01:21:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.e_Uxxm6uLFFo5AAiB5_pthbfaqCL0Hc_0 2024-09-12T01:21:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3552788527770663337', time=2024-09-12T03:09:54.806857+0000, chain.objs.size()=1 2024-09-12T01:21:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.u4TWVg1jZKUNS40mS5Tupe0fk5221gO_0 2024-09-12T01:21:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11137270734353014233', time=2024-09-12T03:09:54.814162+0000, chain.objs.size()=1 2024-09-12T01:21:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.X0gnF8gpYHDhepZGO3mfXE1Ut6M492p_0 2024-09-12T01:21:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16661740988391731185', time=2024-09-12T03:09:54.822638+0000, chain.objs.size()=1 2024-09-12T01:21:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Q9srEV0UVCtIUBfX4R0sh3l9_PXAbvL_0 2024-09-12T01:21:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7199718796003140852', time=2024-09-12T03:09:55.036666+0000, chain.objs.size()=1 2024-09-12T01:21:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.952+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.bd5V9GmU8w9keziTQuw4miCBhViOIep_0 2024-09-12T01:21:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8688856798934954343', time=2024-09-12T03:09:55.139009+0000, chain.objs.size()=1 2024-09-12T01:21:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.fDp50qOUIbN8B_rjdhOFHy6Wb5lANDw_0 2024-09-12T01:21:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5237646049775138489', time=2024-09-12T03:09:55.156245+0000, chain.objs.size()=1 2024-09-12T01:21:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.c8BAscmv7UwviAyRpOzkJYCZd6Er4wI_0 2024-09-12T01:21:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2055990663455085809', time=2024-09-12T03:09:55.345670+0000, chain.objs.size()=1 2024-09-12T01:21:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.BkESpf5JTO5g_yKOeYFsbWPof5JcByH_0 2024-09-12T01:21:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10264329566426285210', time=2024-09-12T03:09:55.353783+0000, chain.objs.size()=1 2024-09-12T01:21:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.k1Ra1KR7CfyBhIzTHzAucyzV1nY-R5E_0 2024-09-12T01:21:56.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4446846533660633723', time=2024-09-12T03:09:55.404058+0000, chain.objs.size()=1 2024-09-12T01:21:56.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.qNgOON0v9bW8pH4PJE0sW8su3NzbDDY_0 2024-09-12T01:21:56.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6718987432051822738', time=2024-09-12T03:09:55.409266+0000, chain.objs.size()=1 2024-09-12T01:21:56.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.R1ODhjp39Ef22h5u5nMq7aKD-SFYLkh_0 2024-09-12T01:21:56.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6144709086479217833', time=2024-09-12T03:10:15.206867+0000, chain.objs.size()=1 2024-09-12T01:21:56.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.gE0VP8Qs13DgawsobxtphiryAIyx8jB_0 2024-09-12T01:21:56.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10464679803003515997', time=2024-09-12T03:10:15.276154+0000, chain.objs.size()=1 2024-09-12T01:21:56.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Vs6O7tW_ceHKzxpkR2EsmC6cHQinzp6_0 2024-09-12T01:21:56.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.595271566967287035', time=2024-09-12T03:10:15.307136+0000, chain.objs.size()=1 2024-09-12T01:21:56.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ijqMUL-0ny7MSwAZJfIHqcGEIbqQhGD_0 2024-09-12T01:21:56.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8850406068192526433', time=2024-09-12T03:10:15.569072+0000, chain.objs.size()=1 2024-09-12T01:21:56.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Ehy9ALl1shTqJ37e9lcEKM_CCzLIO2I_0 2024-09-12T01:21:56.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7877575168681165931', time=2024-09-12T03:10:15.587243+0000, chain.objs.size()=1 2024-09-12T01:21:56.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.C_vEO1yRq1a8p5oduiNwv2n7LzH8twC_0 2024-09-12T01:21:56.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17097583358678794862', time=2024-09-12T03:10:15.652760+0000, chain.objs.size()=1 2024-09-12T01:21:56.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.v8TA-NQkgbMhWIiyVaRtmYF4VrRkc_T_0 2024-09-12T01:21:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14600631392531540358', time=2024-09-12T03:10:15.902749+0000, chain.objs.size()=1 2024-09-12T01:21:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.e_KHK9Hz_XpbYGlWzlRHBjSCRdH1hy5_0 2024-09-12T01:21:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5480299455393511082', time=2024-09-12T03:10:15.917263+0000, chain.objs.size()=1 2024-09-12T01:21:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.5wfCcLBsqZdzAg616xw-BDCqdWs75WZ_0 2024-09-12T01:21:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2844741440514789143', time=2024-09-12T03:10:15.971666+0000, chain.objs.size()=1 2024-09-12T01:21:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.cKpQv9zvqhB4asHz_ec9pYL_cu3OBbB_0 2024-09-12T01:21:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15131051941944981855', time=2024-09-12T03:10:16.050906+0000, chain.objs.size()=1 2024-09-12T01:21:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.XMcgdlKYChcnwnqZP95Tp1eCfAq9nBx_0 2024-09-12T01:21:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15751135273877647394', time=2024-09-12T03:10:16.271032+0000, chain.objs.size()=1 2024-09-12T01:21:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.rarvYtjDxv83foPYolwIzsyVrOTRTqG_0 2024-09-12T01:21:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4025030064363091556', time=2024-09-12T03:10:16.339502+0000, chain.objs.size()=1 2024-09-12T01:21:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ngLLjApGZRSTs3OfeJjaOIdqvi_ww14_0 2024-09-12T01:21:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5710154984533989262', time=2024-09-12T03:10:16.584442+0000, chain.objs.size()=1 2024-09-12T01:21:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.wBw46D5JdfIpOMmKrEwhhl0T5bn_2Ee_0 2024-09-12T01:21:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2486607237419485476', time=2024-09-12T03:10:16.628081+0000, chain.objs.size()=1 2024-09-12T01:21:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.RQCFWBBzXLrzOJlzMfy27s5kAQWIAcP_0 2024-09-12T01:21:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3307161746712393403', time=2024-09-12T03:10:16.945828+0000, chain.objs.size()=1 2024-09-12T01:21:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.HDp3yn0e2LY54oftCBTLZvwU5AL4ibi_0 2024-09-12T01:21:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18017873282321298947', time=2024-09-12T03:10:17.130843+0000, chain.objs.size()=1 2024-09-12T01:21:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.eG4X1jzpQJAs9dqejchBwhdiuRWey4Y_0 2024-09-12T01:21:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17147426829163463577', time=2024-09-12T03:10:17.233524+0000, chain.objs.size()=1 2024-09-12T01:21:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.956+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.bcZxL2RltIl5kqS5Sk1NPFfDMy6M5rR_0 2024-09-12T01:21:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.960+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17915991763393862791', time=2024-09-12T03:10:17.429508+0000, chain.objs.size()=1 2024-09-12T01:21:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.960+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.saBKn1sA6VSNVBReT34jI3D-VCBPatf_0 2024-09-12T01:21:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.960+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15538210301152092065', time=2024-09-12T03:10:17.462833+0000, chain.objs.size()=1 2024-09-12T01:21:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.960+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.MHtlx_3Oj2YDHGsPv66IHyPYGEZ2ZYI_0 2024-09-12T01:21:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.960+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12401837624786879095', time=2024-09-12T03:10:17.521090+0000, chain.objs.size()=1 2024-09-12T01:21:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.960+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.aTJGXS-ivxCQD87S_nv4qwGHg7KO9qP_0 2024-09-12T01:21:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.960+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4007347062444412047', time=2024-09-12T03:10:17.530209+0000, chain.objs.size()=1 2024-09-12T01:21:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.960+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.4NYGUMOEYOVb651po4NRxfsrfNsa-hq_0 2024-09-12T01:21:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.960+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18384833598461446397', time=2024-09-12T03:10:17.581185+0000, chain.objs.size()=1 2024-09-12T01:21:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.960+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.9YMDg9n8NRgQGXcjz2X0D6nq6VmcUV5_0 2024-09-12T01:21:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.960+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16106793357410479935', time=2024-09-12T03:11:47.502829+0000, chain.objs.size()=1 2024-09-12T01:21:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.960+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.457__shadow_.G4GVlRAtAb-R_YDFAGhvvLDve2p8ccC_0 2024-09-12T01:21:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.960+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10002674625823513873', time=2024-09-12T03:11:47.504693+0000, chain.objs.size()=1 2024-09-12T01:21:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.960+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.457__shadow_.pBcSuuhJ0xI4PPRXGjXbnTX80QP-EnJ_0 2024-09-12T01:21:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.960+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13600115993076099790', time=2024-09-12T03:11:55.315263+0000, chain.objs.size()=1 2024-09-12T01:21:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.960+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.465__shadow_.6n2xtl240LYj8FGcMe5LGbc-9UmzVfN_0 2024-09-12T01:21:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.960+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10439344382937642549', time=2024-09-12T03:13:04.296973+0000, chain.objs.size()=1 2024-09-12T01:21:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.960+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.529__shadow_.hbCCUe0G5hqlgp8UQK5-Y19xDb8gAWa_0 2024-09-12T01:21:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.960+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14889866060826257184', time=2024-09-12T03:13:56.355747+0000, chain.objs.size()=1 2024-09-12T01:21:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.960+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.559__shadow_.rHpT6yPDJWLiUwhv4ZirI6MGGhHa2tW_0 2024-09-12T01:21:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.960+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.352676103058636835', time=2024-09-12T03:14:07.310735+0000, chain.objs.size()=1 2024-09-12T01:21:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.960+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.567__shadow_.YMJsxoCpiXazcPpasB4fORCkXHDy9fk_0 2024-09-12T01:21:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.960+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17346624534460008835', time=2024-09-12T03:15:08.730415+0000, chain.objs.size()=1 2024-09-12T01:21:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.960+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.604__shadow_.ucCAp0wqVCSXImiJCHLk-oxtnJAI8XK_0 2024-09-12T01:21:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.964+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46042 2024-09-12T01:21:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.964+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:21:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.964+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14250939692327627019', time=2024-09-12T03:15:26.394710+0000, chain.objs.size()=6 2024-09-12T01:21:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.964+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.616__multipart_multipart_enc.2~uXj3gTWm1B7zvNk73GBNlG93g-aZGKO.1 2024-09-12T01:21:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.964+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.616__multipart_multipart_enc.2~uXj3gTWm1B7zvNk73GBNlG93g-aZGKO.2 2024-09-12T01:21:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.964+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.616__multipart_multipart_enc.2~uXj3gTWm1B7zvNk73GBNlG93g-aZGKO.3 2024-09-12T01:21:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.964+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.616__multipart_multipart_enc.2~uXj3gTWm1B7zvNk73GBNlG93g-aZGKO.4 2024-09-12T01:21:56.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.964+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.616__multipart_multipart_enc.2~uXj3gTWm1B7zvNk73GBNlG93g-aZGKO.5 2024-09-12T01:21:56.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.964+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.616__multipart_multipart_enc.2~uXj3gTWm1B7zvNk73GBNlG93g-aZGKO.6 2024-09-12T01:21:56.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.964+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4478937601454483328', time=2024-09-12T03:17:29.982585+0000, chain.objs.size()=1 2024-09-12T01:21:56.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.964+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.619__shadow_.uEJjWbSxP1HU9Ol2PQ-EKx1BN_yAtL2_0 2024-09-12T01:21:56.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.964+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7001270615609752978', time=2024-09-12T03:17:48.436332+0000, chain.objs.size()=1 2024-09-12T01:21:56.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.964+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.640__shadow_.eM3Me84zkxW2hCDMSwX3rs4ZwTI8NZV_0 2024-09-12T01:21:56.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.964+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16308681178542137316', time=2024-09-12T03:19:02.416606+0000, chain.objs.size()=1 2024-09-12T01:21:56.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.964+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.720__shadow_.cboU_WI2LLF45z3vMwl3_xhgfeR4dWu_0 2024-09-12T01:21:56.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.968+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:56.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.972+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:21:56.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.972+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:56.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.972+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:56.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.976+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47724' 2024-09-12T01:21:56.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.976+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1087785881502357720', time=2024-09-12T03:05:56.731160+0000, chain.objs.size()=2 2024-09-12T01:21:56.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.976+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.159__shadow_.PnqFnHcMzWynKGik3NzZWgjx1g8x4Lo_0 2024-09-12T01:21:56.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.976+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.159__shadow_.PnqFnHcMzWynKGik3NzZWgjx1g8x4Lo_1 2024-09-12T01:21:56.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.976+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_gHx7Eohc4oKxh0dbhSXl3oyrdEX8xRe', time=2024-09-12T03:06:02.676794+0000, chain.objs.size()=2 2024-09-12T01:21:56.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.976+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.162__shadow_.2Szd3epGrs0b6UggmzBCzEExIjearku_0 2024-09-12T01:21:56.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.976+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.162__shadow_.2Szd3epGrs0b6UggmzBCzEExIjearku_1 2024-09-12T01:21:56.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.976+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5384778195000629729', time=2024-09-12T03:06:17.950979+0000, chain.objs.size()=1 2024-09-12T01:21:56.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.976+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.183__shadow_.5QVlBdTh9QEsKdv1Dr9thYKxf84hoqI_0 2024-09-12T01:21:56.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.976+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10913836867227526679', time=2024-09-12T03:08:17.155079+0000, chain.objs.size()=1 2024-09-12T01:21:56.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.976+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.246__shadow_.2bBsfVLo-2CakeaZAfj_kEb3kqib0-u_0 2024-09-12T01:21:56.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.976+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15816449183006653435', time=2024-09-12T03:08:19.209023+0000, chain.objs.size()=1 2024-09-12T01:21:56.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.976+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.249__shadow_.d1lwPlFBxtznD9YnvthhLtW_B2iaIn__0 2024-09-12T01:21:56.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.976+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5797828140095881151', time=2024-09-12T03:08:47.564889+0000, chain.objs.size()=1 2024-09-12T01:21:56.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.976+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.i5zywTixbwRpJg-CW0jHAp-wYP74BSO_0 2024-09-12T01:21:56.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.976+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15444419550311850273', time=2024-09-12T03:08:47.639857+0000, chain.objs.size()=1 2024-09-12T01:21:56.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.976+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.AW2nmyYPZM3_YErv0H7uFQkl2075D2g_0 2024-09-12T01:21:56.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.976+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17232712000728992719', time=2024-09-12T03:08:47.664035+0000, chain.objs.size()=1 2024-09-12T01:21:56.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.976+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.mkUV_EeXi3GnMH3ODnuwHh-ZOFjpnsN_0 2024-09-12T01:21:56.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.976+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15911651436502225738', time=2024-09-12T03:08:47.811769+0000, chain.objs.size()=1 2024-09-12T01:21:56.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.976+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.r_Dq_kHtmfewcdaRuTW-BANTovbebCd_0 2024-09-12T01:21:56.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.976+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6970106151311431037', time=2024-09-12T03:08:47.891668+0000, chain.objs.size()=1 2024-09-12T01:21:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.976+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.I8z49Kbs_21wIRbnt2f3EjyumO7Yceg_0 2024-09-12T01:21:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.976+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13655344786954617232', time=2024-09-12T03:08:47.927958+0000, chain.objs.size()=1 2024-09-12T01:21:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.976+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.qrtgKU73ku4UR1CftPptYkwvFX5JNL4_0 2024-09-12T01:21:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.976+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15696139082215712547', time=2024-09-12T03:08:47.929228+0000, chain.objs.size()=1 2024-09-12T01:21:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.976+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.y_e0jjFVmb2LFQ1FE2pVQTtXzCpM60i_0 2024-09-12T01:21:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12423674358589527801', time=2024-09-12T03:08:47.932933+0000, chain.objs.size()=1 2024-09-12T01:21:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.p_6_piugQwPvBgOzavIgnGE78Tfr_kL_0 2024-09-12T01:21:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6273570237719446387', time=2024-09-12T03:08:48.184485+0000, chain.objs.size()=1 2024-09-12T01:21:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.p4CxEdawboDOeZcrAKr9SnRTtxjQRp4_0 2024-09-12T01:21:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7412591593057690093', time=2024-09-12T03:08:48.309961+0000, chain.objs.size()=1 2024-09-12T01:21:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.WpW1QHiJrxzfQBTe6C2cdXmGngk-3v8_0 2024-09-12T01:21:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5125579378583594829', time=2024-09-12T03:08:48.325841+0000, chain.objs.size()=1 2024-09-12T01:21:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.amna-bBcEmX3jxVHduPa3iTUwyPGaHt_0 2024-09-12T01:21:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3993363967581420186', time=2024-09-12T03:08:48.354447+0000, chain.objs.size()=1 2024-09-12T01:21:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.p0Wr6lWuhhVXbRYx_c0rGiZfp8ilKS-_0 2024-09-12T01:21:56.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12820962165758910001', time=2024-09-12T03:08:48.569696+0000, chain.objs.size()=1 2024-09-12T01:21:56.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.kMcJI3_kVsHqpFeAe30_9Yr3T2gKGFa_0 2024-09-12T01:21:56.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5159894795134289487', time=2024-09-12T03:08:48.708273+0000, chain.objs.size()=1 2024-09-12T01:21:56.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.i7pwsqd1E9juHD7apPt5S1G-V3-Tauo_0 2024-09-12T01:21:56.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8158739326260478348', time=2024-09-12T03:08:48.828281+0000, chain.objs.size()=1 2024-09-12T01:21:56.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.AHvHmih-taWodTPDG7oXJSN6oFA7abz_0 2024-09-12T01:21:56.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8633625397990903765', time=2024-09-12T03:08:49.009208+0000, chain.objs.size()=1 2024-09-12T01:21:56.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.wSdM7mdglL77fxFb2P2LGRPwsejw4vW_0 2024-09-12T01:21:56.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16458819431409447329', time=2024-09-12T03:08:49.020899+0000, chain.objs.size()=1 2024-09-12T01:21:56.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.DCNW9Ucp8G0UTekxnTm-LIvhoSlLldX_0 2024-09-12T01:21:56.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7576656994106173605', time=2024-09-12T03:08:49.041220+0000, chain.objs.size()=1 2024-09-12T01:21:56.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.THaG-MwMDXk16RtXQpu_6K5GhzYPckb_0 2024-09-12T01:21:56.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18329738933166239235', time=2024-09-12T03:08:49.205811+0000, chain.objs.size()=1 2024-09-12T01:21:56.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.S9jBYOtZvhAuwZnNh8bld8QwfwQZ1oY_0 2024-09-12T01:21:56.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11120289883477482122', time=2024-09-12T03:08:49.323896+0000, chain.objs.size()=1 2024-09-12T01:21:56.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.BD9g3u0iZ-dtyleAz6IcGzOMhLe8ORR_0 2024-09-12T01:21:56.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4077754924253270616', time=2024-09-12T03:08:49.337922+0000, chain.objs.size()=1 2024-09-12T01:21:56.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.980+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.VwI0yvx2UYnjBRpig2uWhNFeJKog8Jr_0 2024-09-12T01:21:56.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10947366970780014708', time=2024-09-12T03:08:49.341211+0000, chain.objs.size()=1 2024-09-12T01:21:56.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.oIK5S_4sdnwGiUdQIB5lzpKbbERwCm5_0 2024-09-12T01:21:56.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2827839415790884850', time=2024-09-12T03:08:49.620442+0000, chain.objs.size()=1 2024-09-12T01:21:56.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.vXgut17dDKGvbj8mXwJHeQX0HZIZlVc_0 2024-09-12T01:21:56.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3804770737634969277', time=2024-09-12T03:08:49.662046+0000, chain.objs.size()=1 2024-09-12T01:21:56.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.IyuVzdxmnAeDS_zX3LjiQLV3RmvZ6Bw_0 2024-09-12T01:21:56.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14547942629976492581', time=2024-09-12T03:08:49.935686+0000, chain.objs.size()=1 2024-09-12T01:21:56.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.big3HaeKq4KlIKz5jBFEOKZCCWX9XWH_0 2024-09-12T01:21:56.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6855421221797433087', time=2024-09-12T03:08:49.957752+0000, chain.objs.size()=1 2024-09-12T01:21:56.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_._L219FjQNmwQagCuU5PPflrVsSePhrO_0 2024-09-12T01:21:56.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13149137977317871452', time=2024-09-12T03:08:49.988730+0000, chain.objs.size()=1 2024-09-12T01:21:56.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.dHttf6ApACYtmGyjLUO03uIdkG-LOGJ_0 2024-09-12T01:21:56.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15442856378289509378', time=2024-09-12T03:08:50.032945+0000, chain.objs.size()=1 2024-09-12T01:21:56.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.DemZOjD9kWNwJPsQpU7gDfIyaz-DCIy_0 2024-09-12T01:21:56.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3707670123803833674', time=2024-09-12T03:08:53.286458+0000, chain.objs.size()=1 2024-09-12T01:21:56.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.268__shadow_.yoljSxD5Vh_aL8okdeyIDnN149NEfxQ_0 2024-09-12T01:21:56.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17988554886722492950', time=2024-09-12T03:09:01.536753+0000, chain.objs.size()=1 2024-09-12T01:21:56.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.280__shadow_.hXl0eMcPyFl9cRhWv6VNm23ua-Fmf0u_0 2024-09-12T01:21:56.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15664230197622810003', time=2024-09-12T03:09:09.236633+0000, chain.objs.size()=1 2024-09-12T01:21:56.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.291__shadow_.KTyNIaEyJGoPvZR7CvX24sO6kZhQuRM_0 2024-09-12T01:21:56.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13493767011776032020', time=2024-09-12T03:09:13.025201+0000, chain.objs.size()=1 2024-09-12T01:21:56.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.294__shadow_.7-CfZSWVW5JzZjCKCy6PDU09h2porCc_0 2024-09-12T01:21:56.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3256466276897934244', time=2024-09-12T03:09:33.397798+0000, chain.objs.size()=1 2024-09-12T01:21:56.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.323__shadow_.lQrRXENg69yVIBu0Ua3Hmz9ffqdennD_0 2024-09-12T01:21:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12745593025995702503', time=2024-09-12T03:09:52.983253+0000, chain.objs.size()=1 2024-09-12T01:21:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.-PJ5-F9rQ8UzGuylMl2Ltr4tbJcB7Hh_0 2024-09-12T01:21:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1081094160567866467', time=2024-09-12T03:09:52.991625+0000, chain.objs.size()=1 2024-09-12T01:21:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.c983ZTbV-iQ9CtV_dI_HUxfTqepHy1B_0 2024-09-12T01:21:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14307826478963470312', time=2024-09-12T03:09:53.034714+0000, chain.objs.size()=1 2024-09-12T01:21:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.eXYQC4f-oHcmtClC0ifGJOC6ijIUIUz_0 2024-09-12T01:21:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3854116374564606726', time=2024-09-12T03:09:53.060288+0000, chain.objs.size()=1 2024-09-12T01:21:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.9RibxC51ngAbK6cGIOZZ-hF5O04o6DK_0 2024-09-12T01:21:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10982155720053089161', time=2024-09-12T03:09:53.061283+0000, chain.objs.size()=1 2024-09-12T01:21:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.bxfjSwrknNGhYP3TPFt06VuJCHSOYiB_0 2024-09-12T01:21:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8172866688056402296', time=2024-09-12T03:09:53.104474+0000, chain.objs.size()=1 2024-09-12T01:21:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.l6qtsCU20HWvqhRcdtWirPl-r70Z9Xm_0 2024-09-12T01:21:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2760089955530465306', time=2024-09-12T03:09:53.122110+0000, chain.objs.size()=1 2024-09-12T01:21:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.rI9UefJgDUGYp3dLrY6NnuLmaMLCdJE_0 2024-09-12T01:21:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13249057217706244410', time=2024-09-12T03:09:53.420617+0000, chain.objs.size()=1 2024-09-12T01:21:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.SvSgguL8iaBMY6jAUYv8HlDeQolWAnR_0 2024-09-12T01:21:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1198838752089980104', time=2024-09-12T03:09:53.673229+0000, chain.objs.size()=1 2024-09-12T01:21:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.E_WyA9e61kkHY0rf3MmDQSrO-T2oG3G_0 2024-09-12T01:21:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12364667276036288664', time=2024-09-12T03:09:53.815594+0000, chain.objs.size()=1 2024-09-12T01:21:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.984+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.z0wX7rcZbimEiiXUR3elwD5vQ9Fv2xX_0 2024-09-12T01:21:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.988+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14532818550942734166', time=2024-09-12T03:09:54.032117+0000, chain.objs.size()=1 2024-09-12T01:21:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.988+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.V6GBaFtt3FaGR4YJrOxc-4As2gpqatt_0 2024-09-12T01:21:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.988+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2623385387452736187', time=2024-09-12T03:09:54.034949+0000, chain.objs.size()=1 2024-09-12T01:21:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.988+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.SBjCFRM1Y3EtyaizZUzF6boEm8br8LZ_0 2024-09-12T01:21:56.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.988+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15055196399771637604', time=2024-09-12T03:09:54.114847+0000, chain.objs.size()=1 2024-09-12T01:21:56.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.988+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Zm9my1ygWzp50dcWR-VZ7MeikZ6K5p6_0 2024-09-12T01:21:56.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.988+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3540752569421040571', time=2024-09-12T03:09:54.143238+0000, chain.objs.size()=1 2024-09-12T01:21:56.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.988+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.EQUboBN-yTjtPnuSnyyo_-pAEX3UO_Y_0 2024-09-12T01:21:56.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.988+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10822478729738078686', time=2024-09-12T03:09:54.154605+0000, chain.objs.size()=1 2024-09-12T01:21:56.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.988+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.VF49_FsppBfCOFIEeKvilrn__ahiUZk_0 2024-09-12T01:21:56.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.988+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17943228137975846763', time=2024-09-12T03:09:54.325189+0000, chain.objs.size()=1 2024-09-12T01:21:56.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.988+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.d_7q-RqZlN12FSmrhk2fsoJsbXwGZLG_0 2024-09-12T01:21:56.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.988+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1405023966443411023', time=2024-09-12T03:09:54.365021+0000, chain.objs.size()=1 2024-09-12T01:21:56.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.988+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.SIRyatKzJr-ucvYYfUcF_Nc2IbNXgpw_0 2024-09-12T01:21:56.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.988+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9508231873061535170', time=2024-09-12T03:09:54.380976+0000, chain.objs.size()=1 2024-09-12T01:21:56.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.988+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.rWvdzfCe7xlc7jOJeHogkAKHCqH6elL_0 2024-09-12T01:21:56.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.988+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16936246225958488277', time=2024-09-12T03:09:54.649502+0000, chain.objs.size()=1 2024-09-12T01:21:56.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.988+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.fi4a1h9Jwhvxi0FgF4RXoXSjRG-B3o5_0 2024-09-12T01:21:56.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.988+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14489643153117551462', time=2024-09-12T03:09:54.719274+0000, chain.objs.size()=1 2024-09-12T01:21:56.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.988+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.pnHD046ax0AAseuPnxVCrNp-D6GZkjl_0 2024-09-12T01:21:56.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.988+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9569120977766891183', time=2024-09-12T03:09:54.747388+0000, chain.objs.size()=1 2024-09-12T01:21:56.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.988+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.kCRoRTztw5SLOHzC3cBwROd2LKrgn72_0 2024-09-12T01:21:56.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.988+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13625933692351240231', time=2024-09-12T03:09:55.109456+0000, chain.objs.size()=1 2024-09-12T01:21:56.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.988+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.dzm8W3CwTcK1UcL1W_ZyL5ORSXXjRct_0 2024-09-12T01:21:56.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.988+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3592884519468599084', time=2024-09-12T03:09:55.136327+0000, chain.objs.size()=1 2024-09-12T01:21:56.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.988+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.xQvQ_JngLNf92_yFnpHqmJEYvEt17OC_0 2024-09-12T01:21:56.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7595459556731100540', time=2024-09-12T03:10:15.265786+0000, chain.objs.size()=1 2024-09-12T01:21:56.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.EqemhoTN2wpI1SSln4JGWzNabd36np3_0 2024-09-12T01:21:56.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7714036364808797973', time=2024-09-12T03:10:15.294886+0000, chain.objs.size()=1 2024-09-12T01:21:56.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.2lrgTtH7XHUXJbFd4IHetOogWIEHtUy_0 2024-09-12T01:21:56.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13057353876671035938', time=2024-09-12T03:10:15.319618+0000, chain.objs.size()=1 2024-09-12T01:21:56.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.9__Kxlt4ghOsYetLRt2NW5o8BLaOPBR_0 2024-09-12T01:21:56.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11494348871887981131', time=2024-09-12T03:10:15.385632+0000, chain.objs.size()=1 2024-09-12T01:21:56.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.CSuihPrqUC3s7eAmY3wGHIEOINi6AhA_0 2024-09-12T01:21:56.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16030207817555614235', time=2024-09-12T03:10:15.387860+0000, chain.objs.size()=1 2024-09-12T01:21:56.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.xIkgYW534Etf67gQkXv_1bPcpj6OcFk_0 2024-09-12T01:21:56.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16960796021638589411', time=2024-09-12T03:10:15.431760+0000, chain.objs.size()=1 2024-09-12T01:21:56.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.MdcSkfOvHH9Q0ICCC8fLx75QWfY2v5v_0 2024-09-12T01:21:56.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18076705264130085017', time=2024-09-12T03:10:15.586735+0000, chain.objs.size()=1 2024-09-12T01:21:56.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.q19ivSKRWtbv2yGq6PsaG8IeM7I5Cis_0 2024-09-12T01:21:56.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8693650464478946622', time=2024-09-12T03:10:15.588570+0000, chain.objs.size()=1 2024-09-12T01:21:56.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.UZ2SrO8lQU9i9rDTjoBhvtdCmY20Hmr_0 2024-09-12T01:21:57.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6994730789529819674', time=2024-09-12T03:10:15.594507+0000, chain.objs.size()=1 2024-09-12T01:21:57.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.WNCnlhdpy3U4ysSjMtoepi0dxCZi4t7_0 2024-09-12T01:21:57.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6693879451611442873', time=2024-09-12T03:10:15.620711+0000, chain.objs.size()=1 2024-09-12T01:21:57.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.XjEFsMxcvZxzZSCpeVGeMSyaMy8q32b_0 2024-09-12T01:21:57.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8260278409060646418', time=2024-09-12T03:10:15.688620+0000, chain.objs.size()=1 2024-09-12T01:21:57.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.T7sYDCQxTESCHHFuWQ5xXHjMPYhke9X_0 2024-09-12T01:21:57.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14657281825267509665', time=2024-09-12T03:10:15.710535+0000, chain.objs.size()=1 2024-09-12T01:21:57.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.zR6wFH-Nheh-Ajz_54S_t88AFEiRSuF_0 2024-09-12T01:21:57.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8385642957113072834', time=2024-09-12T03:10:15.778921+0000, chain.objs.size()=1 2024-09-12T01:21:57.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.gI1zqLQN6S2lISltKlGX-XIxl9olym9_0 2024-09-12T01:21:57.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5084123480076229155', time=2024-09-12T03:10:15.881169+0000, chain.objs.size()=1 2024-09-12T01:21:57.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.1uLS7H_uLHvwCJY52adBmLl5Kg20RkL_0 2024-09-12T01:21:57.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17590703010641590799', time=2024-09-12T03:10:15.895408+0000, chain.objs.size()=1 2024-09-12T01:21:57.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.8Mf0M6zeYp2HL6elCXiHI7giZyU6zTE_0 2024-09-12T01:21:57.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4905396432004084401', time=2024-09-12T03:10:15.929613+0000, chain.objs.size()=1 2024-09-12T01:21:57.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.fG_i33Oo41SVdzDuU80C1OzmEHil2pi_0 2024-09-12T01:21:57.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15240206211676973397', time=2024-09-12T03:10:16.271282+0000, chain.objs.size()=1 2024-09-12T01:21:57.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.iVxFkC-Sj3RlpP6b_XY7N57V5kWknwg_0 2024-09-12T01:21:57.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17288086045095649722', time=2024-09-12T03:10:16.310364+0000, chain.objs.size()=1 2024-09-12T01:21:57.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.DnXx38qCr5oIdwXK0GYhh6FUV8fuepC_0 2024-09-12T01:21:57.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.609028841420126875', time=2024-09-12T03:10:16.324972+0000, chain.objs.size()=1 2024-09-12T01:21:57.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.WsOjoJMF6_87ait8mgeDkJBRLqH6jo__0 2024-09-12T01:21:57.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17439966159202977048', time=2024-09-12T03:10:16.615488+0000, chain.objs.size()=1 2024-09-12T01:21:57.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.PMicaq_EIQkDZWG1teE7MPihEP1Aa_b_0 2024-09-12T01:21:57.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.992+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5933468243739018624', time=2024-09-12T03:10:16.864554+0000, chain.objs.size()=1 2024-09-12T01:21:57.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ia_vx-qcvO20txsSSHR_ljUnyr2_4yy_0 2024-09-12T01:21:57.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.729633102528135603', time=2024-09-12T03:10:16.903226+0000, chain.objs.size()=1 2024-09-12T01:21:57.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.xmB-d51KVLjpToCYjmwcVhRDDIRur9c_0 2024-09-12T01:21:57.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15372416593886416964', time=2024-09-12T03:10:17.012568+0000, chain.objs.size()=1 2024-09-12T01:21:57.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.OtT2INDuzbit4VmHy5IoTBYZ72Tnw12_0 2024-09-12T01:21:57.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4673193768620860440', time=2024-09-12T03:10:17.232876+0000, chain.objs.size()=1 2024-09-12T01:21:57.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.IlMu948m1yHbnPz9j4mz2q_BN9-0UGW_0 2024-09-12T01:21:57.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16636441193210872554', time=2024-09-12T03:10:17.239973+0000, chain.objs.size()=1 2024-09-12T01:21:57.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.p8Utin3MFJBWe-ULW6A_jOUmmaj2JQc_0 2024-09-12T01:21:57.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9014509134251455112', time=2024-09-12T03:10:17.247896+0000, chain.objs.size()=1 2024-09-12T01:21:57.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.1dCy6P_7lZJihgbuR_0hbNkWMyp0aHF_0 2024-09-12T01:21:57.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13888006935977300045', time=2024-09-12T03:10:17.446659+0000, chain.objs.size()=1 2024-09-12T01:21:57.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.XrGyXE4GWDQZfvlcN5A9l0ph13feyfx_0 2024-09-12T01:21:57.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2747145883664215206', time=2024-09-12T03:10:17.500064+0000, chain.objs.size()=1 2024-09-12T01:21:57.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.CgVM308lLYm0H1QCL2Y67RSH52k4UsG_0 2024-09-12T01:21:57.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11627606143388325798', time=2024-09-12T03:10:17.504782+0000, chain.objs.size()=1 2024-09-12T01:21:57.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Y6izT6OmJWpGHtmVC_UF8znHSZeSWjD_0 2024-09-12T01:21:57.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2025191976466438805', time=2024-09-12T03:10:17.516634+0000, chain.objs.size()=1 2024-09-12T01:21:57.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.yE1D1NVEG5VNijxl3umEmU_FvW6oz8J_0 2024-09-12T01:21:57.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11270932670101236761', time=2024-09-12T03:10:17.568478+0000, chain.objs.size()=1 2024-09-12T01:21:57.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.2nZqOk4s0VB_IDawWkcnfIoK_cQCm7z_0 2024-09-12T01:21:57.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7815380409470307324', time=2024-09-12T03:10:17.608632+0000, chain.objs.size()=1 2024-09-12T01:21:57.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.N882nogEvxRwqfrKdZJLgmA5M804K9P_0 2024-09-12T01:21:57.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9750764108114347691', time=2024-09-12T03:10:17.763676+0000, chain.objs.size()=1 2024-09-12T01:21:57.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.MB-43J3UfwX_AVKQzkU_OPVuieVJMDk_0 2024-09-12T01:21:57.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3655743796924666717', time=2024-09-12T03:10:17.805572+0000, chain.objs.size()=1 2024-09-12T01:21:57.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.0fN2B-9443DCC-9vLEOqrqHZOPXTL_1_0 2024-09-12T01:21:57.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9776675616651776531', time=2024-09-12T03:10:17.838549+0000, chain.objs.size()=1 2024-09-12T01:21:57.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.bXfK_CsgNwwIgYo5HDba3oeaYF60_1r_0 2024-09-12T01:21:57.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18127996781285309750', time=2024-09-12T03:10:30.282352+0000, chain.objs.size()=1 2024-09-12T01:21:57.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.345__shadow_.pF8hl7t6r4VWlAvyu0VvWacJFeo3cLF_0 2024-09-12T01:21:57.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5426523926611650448', time=2024-09-12T03:11:32.131238+0000, chain.objs.size()=1 2024-09-12T01:21:57.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:56.996+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.437__shadow_.rmQcJLx-2Nh3vb5SjkLWlCIgfZxddg6_0 2024-09-12T01:21:57.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.000+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1801167065676257973', time=2024-09-12T03:11:36.887441+0000, chain.objs.size()=1 2024-09-12T01:21:57.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.000+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.444__shadow_.vX1qC32bjUheved0NE64n3WFq4D9gN8_0 2024-09-12T01:21:57.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.000+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18085322195598286623', time=2024-09-12T03:12:05.014556+0000, chain.objs.size()=1 2024-09-12T01:21:57.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.000+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.484__shadow_.WhmKSa7nbSCAVGDWGHUzNahX8kSyaAm_0 2024-09-12T01:21:57.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.000+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47724 2024-09-12T01:21:57.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.004+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T01:21:57.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.004+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11842498838566575874', time=2024-09-12T03:12:18.040612+0000, chain.objs.size()=1 2024-09-12T01:21:57.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.004+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.504__shadow:fzRg7xrdrpV0hjFUnNiyrRjat2TjEPZ_.vHz-mc05LslsPFizOQCh8qlCeQstO_b_0 2024-09-12T01:21:57.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.004+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~X6P74dZ-aiMwZgNlTkgnfCQzAz8_QG7', time=2024-09-12T03:12:42.740406+0000, chain.objs.size()=1 2024-09-12T01:21:57.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.004+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~X6P74dZ-aiMwZgNlTkgnfCQzAz8_QG7.2 2024-09-12T01:21:57.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.004+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~vd_YKCp0taNnw9JKaVFVFi5eT5xF9UG', time=2024-09-12T03:12:48.697846+0000, chain.objs.size()=1 2024-09-12T01:21:57.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.004+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~vd_YKCp0taNnw9JKaVFVFi5eT5xF9UG.2 2024-09-12T01:21:57.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.004+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~vd_YKCp0taNnw9JKaVFVFi5eT5xF9UG', time=2024-09-12T03:12:48.700721+0000, chain.objs.size()=1 2024-09-12T01:21:57.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.004+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~vd_YKCp0taNnw9JKaVFVFi5eT5xF9UG.3 2024-09-12T01:21:57.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.004+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~pB3JS7oxLiRqxBk9kfvHtychWYo-AtF', time=2024-09-12T03:12:52.249130+0000, chain.objs.size()=1 2024-09-12T01:21:57.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.004+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~pB3JS7oxLiRqxBk9kfvHtychWYo-AtF.1 2024-09-12T01:21:57.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.004+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~pB3JS7oxLiRqxBk9kfvHtychWYo-AtF', time=2024-09-12T03:12:52.252866+0000, chain.objs.size()=1 2024-09-12T01:21:57.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.004+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~pB3JS7oxLiRqxBk9kfvHtychWYo-AtF.2 2024-09-12T01:21:57.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.004+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~pB3JS7oxLiRqxBk9kfvHtychWYo-AtF', time=2024-09-12T03:12:52.255990+0000, chain.objs.size()=1 2024-09-12T01:21:57.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.004+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~pB3JS7oxLiRqxBk9kfvHtychWYo-AtF.3 2024-09-12T01:21:57.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.004+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~pB3JS7oxLiRqxBk9kfvHtychWYo-AtF', time=2024-09-12T03:12:52.258925+0000, chain.objs.size()=1 2024-09-12T01:21:57.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.004+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~pB3JS7oxLiRqxBk9kfvHtychWYo-AtF.4 2024-09-12T01:21:57.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.004+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~pB3JS7oxLiRqxBk9kfvHtychWYo-AtF', time=2024-09-12T03:12:52.262292+0000, chain.objs.size()=1 2024-09-12T01:21:57.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.004+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~pB3JS7oxLiRqxBk9kfvHtychWYo-AtF.5 2024-09-12T01:21:57.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.004+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~pB3JS7oxLiRqxBk9kfvHtychWYo-AtF', time=2024-09-12T03:12:52.265395+0000, chain.objs.size()=1 2024-09-12T01:21:57.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.004+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~pB3JS7oxLiRqxBk9kfvHtychWYo-AtF.6 2024-09-12T01:21:57.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.004+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10911669974845301641', time=2024-09-12T03:12:56.465041+0000, chain.objs.size()=3 2024-09-12T01:21:57.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.004+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.524__multipart_mymultipart.2~ReJhtQwnhM3ddSQ__xaUYQEdTDV13VK.1 2024-09-12T01:21:57.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.004+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.524__multipart_mymultipart.2~ReJhtQwnhM3ddSQ__xaUYQEdTDV13VK.2 2024-09-12T01:21:57.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.008+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.524__multipart_mymultipart.2~ReJhtQwnhM3ddSQ__xaUYQEdTDV13VK.3 2024-09-12T01:21:57.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.008+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12658743361695053871', time=2024-09-12T03:14:53.636860+0000, chain.objs.size()=1 2024-09-12T01:21:57.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.008+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.581__shadow:Hlpx7f3Y0G1KYveYpJ3BijpqIMDT--x_.G1FB6asNJW3t2HG3PI-GPOtFeAO4_oE_0 2024-09-12T01:21:57.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.008+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6686431146939822031', time=2024-09-12T03:17:49.493647+0000, chain.objs.size()=1 2024-09-12T01:21:57.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.008+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.642__shadow_.QnZSE7P1ZE9C0V7oL8Jpkzbr4nIZ666_0 2024-09-12T01:21:57.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.008+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11234087001944135400', time=2024-09-12T03:19:01.038671+0000, chain.objs.size()=1 2024-09-12T01:21:57.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.008+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.718__shadow:LWsRCZrjuoM5qWYbI0w2kJn-PukY2mY_.1SnpsD79ynf94-IMmAYFrxqOegO1NJS_0 2024-09-12T01:21:57.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.008+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:57.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.012+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:21:57.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.012+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:57.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.012+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:57.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52286' 2024-09-12T01:21:57.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.885984342643884167', time=2024-09-12T03:05:51.796828+0000, chain.objs.size()=1 2024-09-12T01:21:57.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.152__shadow_.vATgaCIwUeq6or7tSt9cXyZLfCLYsVI_0 2024-09-12T01:21:57.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9962004753284488418', time=2024-09-12T03:06:15.987309+0000, chain.objs.size()=1 2024-09-12T01:21:57.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.180__shadow_.u3UR5nMdNx6o6kqOUJUhkOHwrN1D7Gp_0 2024-09-12T01:21:57.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29513863237555316', time=2024-09-12T03:08:26.043349+0000, chain.objs.size()=1 2024-09-12T01:21:57.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.259__shadow_.a3bjmuOa4Pi0nahMfDPRWnm2gZpx70c_0 2024-09-12T01:21:57.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9219949427942716685', time=2024-09-12T03:08:28.148456+0000, chain.objs.size()=1 2024-09-12T01:21:57.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.262__shadow_.povlwF1YRoYH9AM44nx8pNflZKeQkJx_0 2024-09-12T01:21:57.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14667446043697201325', time=2024-09-12T03:08:28.151455+0000, chain.objs.size()=1 2024-09-12T01:21:57.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.262__shadow_.Esx2SfJWAbmzA5Svs553bnk13onURzw_0 2024-09-12T01:21:57.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7261268310785356108', time=2024-09-12T03:08:47.586052+0000, chain.objs.size()=1 2024-09-12T01:21:57.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.MVRTjf7NrIV2aErT5mL8hd7hXo-nW25_0 2024-09-12T01:21:57.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18348197842031141233', time=2024-09-12T03:08:47.648687+0000, chain.objs.size()=1 2024-09-12T01:21:57.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Ogi48aXb74BC63FS0CDHO2Vqlv7MQCR_0 2024-09-12T01:21:57.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17907496693986367123', time=2024-09-12T03:08:47.878037+0000, chain.objs.size()=1 2024-09-12T01:21:57.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.3IKXZGXd_mlDnKwRXIPYKBLiX_BRV2h_0 2024-09-12T01:21:57.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6058682735197291665', time=2024-09-12T03:08:47.905202+0000, chain.objs.size()=1 2024-09-12T01:21:57.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.6-0WnfBro0G4nRgboohLDXbh5-5B2eJ_0 2024-09-12T01:21:57.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16869813374603365274', time=2024-09-12T03:08:47.907495+0000, chain.objs.size()=1 2024-09-12T01:21:57.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Ixk_Y_dQ8_q7yzXdTHSeQHtZwEkezNj_0 2024-09-12T01:21:57.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17870470972948784883', time=2024-09-12T03:08:47.964093+0000, chain.objs.size()=1 2024-09-12T01:21:57.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.XtHZKQOTAeuOYtBovz9I6icbuHgaq3F_0 2024-09-12T01:21:57.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1426799507220634688', time=2024-09-12T03:08:48.144284+0000, chain.objs.size()=1 2024-09-12T01:21:57.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.8VEA_9eClu9J27cw1c3PZVP8Q3UV6O1_0 2024-09-12T01:21:57.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14346051800196683741', time=2024-09-12T03:08:48.201676+0000, chain.objs.size()=1 2024-09-12T01:21:57.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.uuE86zWGKALSw_5mB40GQBJniky-XA8_0 2024-09-12T01:21:57.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2659930564461417458', time=2024-09-12T03:08:48.277306+0000, chain.objs.size()=1 2024-09-12T01:21:57.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.PfRMMPF7a9KEGgEQhJTzGiGAXmLPEDm_0 2024-09-12T01:21:57.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1336394355269779464', time=2024-09-12T03:08:48.310113+0000, chain.objs.size()=1 2024-09-12T01:21:57.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.LK2YsuO_zfGO5r4Br0o4wDK2m9iAZRz_0 2024-09-12T01:21:57.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10150185914401499522', time=2024-09-12T03:08:48.531342+0000, chain.objs.size()=1 2024-09-12T01:21:57.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.CZDbxOy9Tw15rydo7rqJy3RfC-p4H_n_0 2024-09-12T01:21:57.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17750110221212176343', time=2024-09-12T03:08:48.533222+0000, chain.objs.size()=1 2024-09-12T01:21:57.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.uUAS1i76J1JeorupxBtVhuS_zZNiH1w_0 2024-09-12T01:21:57.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4124748032419007542', time=2024-09-12T03:08:48.581548+0000, chain.objs.size()=1 2024-09-12T01:21:57.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.OEICRf13ZNf2ez5UIdIjElriRt3kw-P_0 2024-09-12T01:21:57.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5549733137981806225', time=2024-09-12T03:08:48.602939+0000, chain.objs.size()=1 2024-09-12T01:21:57.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.QeXjf2BtuAx8FtZkB6eXMg4YY4bblK1_0 2024-09-12T01:21:57.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6914644931311368146', time=2024-09-12T03:08:48.623499+0000, chain.objs.size()=1 2024-09-12T01:21:57.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.39PDMAHaQZKD7waVA80i51l9pI29TMF_0 2024-09-12T01:21:57.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.383047486849613646', time=2024-09-12T03:08:48.642560+0000, chain.objs.size()=1 2024-09-12T01:21:57.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.RZHdwOYVrJbDt_WCZHLdJCdUdAhFdth_0 2024-09-12T01:21:57.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9854443860168692410', time=2024-09-12T03:08:48.664165+0000, chain.objs.size()=1 2024-09-12T01:21:57.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ENijp666g1K66fuCabaZqhV7yiUkkS6_0 2024-09-12T01:21:57.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17946841657530828386', time=2024-09-12T03:08:48.686836+0000, chain.objs.size()=1 2024-09-12T01:21:57.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.016+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.yq-mEQOINw3w8xNcWVtg-_ubaTQYVz7_0 2024-09-12T01:21:57.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8196431317903639262', time=2024-09-12T03:08:48.694789+0000, chain.objs.size()=1 2024-09-12T01:21:57.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.t0drLqqiYyI23A9hBPv8nSHFlHXtkMY_0 2024-09-12T01:21:57.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16518527376505562064', time=2024-09-12T03:08:48.846363+0000, chain.objs.size()=1 2024-09-12T01:21:57.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Zseb3JKg2DliCMhN9dHz3dIiuaD0yaK_0 2024-09-12T01:21:57.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15172690743065929539', time=2024-09-12T03:08:48.861792+0000, chain.objs.size()=1 2024-09-12T01:21:57.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.5zTeH2D4dO1qdvbMgXckEgCXoVPxevm_0 2024-09-12T01:21:57.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16853833003386444480', time=2024-09-12T03:08:48.917469+0000, chain.objs.size()=1 2024-09-12T01:21:57.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.OND59lR-2pT8720HVDscGJVVPQ2kBYv_0 2024-09-12T01:21:57.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1762632238087739566', time=2024-09-12T03:08:48.952649+0000, chain.objs.size()=1 2024-09-12T01:21:57.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.gFE63Dnk3DvweMrK-Wrtw0tGRNpc7KI_0 2024-09-12T01:21:57.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14524539962465920422', time=2024-09-12T03:08:49.011934+0000, chain.objs.size()=1 2024-09-12T01:21:57.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.GT8FP3c1kFalf_MGsMJ46nq9yyYqRms_0 2024-09-12T01:21:57.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6785368870098583662', time=2024-09-12T03:08:49.038893+0000, chain.objs.size()=1 2024-09-12T01:21:57.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.PXIQQ7iyWufgfJmGZ84I3aI8AUXlbDQ_0 2024-09-12T01:21:57.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2950460351624414460', time=2024-09-12T03:08:49.205293+0000, chain.objs.size()=1 2024-09-12T01:21:57.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.2SLy1AUPLLWl6rKAp3121OMpma7jTgV_0 2024-09-12T01:21:57.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11071814087311381835', time=2024-09-12T03:08:49.285691+0000, chain.objs.size()=1 2024-09-12T01:21:57.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.RseMwqOSUBogMvdzAy9GZc7AJiqOwFI_0 2024-09-12T01:21:57.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8274404441553789959', time=2024-09-12T03:08:49.300199+0000, chain.objs.size()=1 2024-09-12T01:21:57.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.y5880jOqLJgpAFIJMYCno43q29CrA13_0 2024-09-12T01:21:57.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5050757177120810507', time=2024-09-12T03:08:49.377653+0000, chain.objs.size()=1 2024-09-12T01:21:57.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.e_fEVR1s3mU9-MAkY503_uMqoVz-nIR_0 2024-09-12T01:21:57.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9629057036803641743', time=2024-09-12T03:08:49.606191+0000, chain.objs.size()=1 2024-09-12T01:21:57.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.tDlugWve7ljXPb3vLdes-T4VQqctE3J_0 2024-09-12T01:21:57.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4563906506333264642', time=2024-09-12T03:08:49.625797+0000, chain.objs.size()=1 2024-09-12T01:21:57.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.8xbif8Qxl8O2FXVUnk2-Ev58I_Q-ez__0 2024-09-12T01:21:57.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4762451951317203405', time=2024-09-12T03:08:49.641244+0000, chain.objs.size()=1 2024-09-12T01:21:57.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.lT3S3-6VkNCKHAYYfyNv8bxXL8nLQUn_0 2024-09-12T01:21:57.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18379667859136450985', time=2024-09-12T03:08:49.654680+0000, chain.objs.size()=1 2024-09-12T01:21:57.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.020+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.e8tdx__4hSWjbAKCVZfYhnQdqSEFeEX_0 2024-09-12T01:21:57.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3230756382145551209', time=2024-09-12T03:08:49.907923+0000, chain.objs.size()=1 2024-09-12T01:21:57.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.6iN_oV_kgrHxh5X7r339Gae-euXSEtI_0 2024-09-12T01:21:57.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4463307642181496256', time=2024-09-12T03:08:49.950986+0000, chain.objs.size()=1 2024-09-12T01:21:57.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.lVmYU5xT_1yIrG4eqWtagURLWJ1ZMYP_0 2024-09-12T01:21:57.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11030940573746899749', time=2024-09-12T03:08:49.971771+0000, chain.objs.size()=1 2024-09-12T01:21:57.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.E0eQmFDm-9fhyAuGH-g3Pj7bLN8olBt_0 2024-09-12T01:21:57.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3677088332213439217', time=2024-09-12T03:08:49.983712+0000, chain.objs.size()=1 2024-09-12T01:21:57.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.4q5EHgt-wUk7SNqXgl8v7MRmSLdOmoB_0 2024-09-12T01:21:57.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7695996731784856048', time=2024-09-12T03:09:00.143197+0000, chain.objs.size()=1 2024-09-12T01:21:57.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.278__shadow_.0CnNkTc5etZ3eR0fX1W6rCSCd8tUCDt_0 2024-09-12T01:21:57.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14029475907757848865', time=2024-09-12T03:09:00.145173+0000, chain.objs.size()=1 2024-09-12T01:21:57.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.278__shadow_.U6BbVoU6yQGv0hyiy_demhOHXskb-3R_0 2024-09-12T01:21:57.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7865085205113223564', time=2024-09-12T03:09:11.591861+0000, chain.objs.size()=1 2024-09-12T01:21:57.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.293__shadow_.bfez8Wg_IuyajONcMIs-F9A_QIMh7nP_0 2024-09-12T01:21:57.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7385204352273865159', time=2024-09-12T03:09:11.612346+0000, chain.objs.size()=1 2024-09-12T01:21:57.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.293__shadow_.UfhyM7SyOfZCzw18D9GLCvdxeZh6SGQ_0 2024-09-12T01:21:57.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2486978894585400727', time=2024-09-12T03:09:13.078011+0000, chain.objs.size()=1 2024-09-12T01:21:57.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.294__shadow_.ZaWhHNc1c7HhQ6CMQxjcKIPXLtquXGV_0 2024-09-12T01:21:57.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.702897190041737369', time=2024-09-12T03:09:18.696623+0000, chain.objs.size()=1 2024-09-12T01:21:57.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.302__shadow_.Lr_m3-cwHHetvPAEnA6CQaF5qijiyKd_0 2024-09-12T01:21:57.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6873860126695615390', time=2024-09-12T03:09:20.779517+0000, chain.objs.size()=1 2024-09-12T01:21:57.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.305__shadow_.99fOPvz88PoC6iGXY5Gw5Owq4JNwGn8_0 2024-09-12T01:21:57.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3504942552684969761', time=2024-09-12T03:09:33.398887+0000, chain.objs.size()=1 2024-09-12T01:21:57.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.323__shadow_.G-BhqyGWHVwLfEWi9uH9vV8nLTWqWJK_0 2024-09-12T01:21:57.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16695163804969087787', time=2024-09-12T03:09:52.925881+0000, chain.objs.size()=1 2024-09-12T01:21:57.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.qB_-OM2_G-bJLbpeZWeHKiOStHasVnm_0 2024-09-12T01:21:57.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9671906233604997847', time=2024-09-12T03:09:53.115613+0000, chain.objs.size()=1 2024-09-12T01:21:57.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.KtDFMYRMlQT7V4XmqgM0Sw6xkGmA7BO_0 2024-09-12T01:21:57.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5432747906914941518', time=2024-09-12T03:09:53.303748+0000, chain.objs.size()=1 2024-09-12T01:21:57.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.oGeHv3o2ZjywG53korveiDOHDpUzhoT_0 2024-09-12T01:21:57.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11217872576800325783', time=2024-09-12T03:09:53.359366+0000, chain.objs.size()=1 2024-09-12T01:21:57.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.zPwnC2k3GmJPu5uXGGVJL19JyInd3E2_0 2024-09-12T01:21:57.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.898932028753413472', time=2024-09-12T03:09:53.435983+0000, chain.objs.size()=1 2024-09-12T01:21:57.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.FKDWN3btKfI8v4Th366rpjT5t-AJ5HP_0 2024-09-12T01:21:57.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17643910304361052662', time=2024-09-12T03:09:53.770640+0000, chain.objs.size()=1 2024-09-12T01:21:57.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.LjgvMN8O0Bep1QVPgL4hsDP_G-z3nlU_0 2024-09-12T01:21:57.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18088686575035697098', time=2024-09-12T03:09:53.781994+0000, chain.objs.size()=1 2024-09-12T01:21:57.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.bTU_5eSQDV3FmFhBUwIrcnVqSr81D0N_0 2024-09-12T01:21:57.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4679492821244987484', time=2024-09-12T03:09:53.788369+0000, chain.objs.size()=1 2024-09-12T01:21:57.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.024+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.vqijXxzYEOU01Cjo6fbus2mac1Z2eiv_0 2024-09-12T01:21:57.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13399809548328106579', time=2024-09-12T03:09:53.791174+0000, chain.objs.size()=1 2024-09-12T01:21:57.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.aSFaO6iI3LJB1bciNB8ry02ZtKtekbq_0 2024-09-12T01:21:57.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3676805113411179412', time=2024-09-12T03:09:53.828418+0000, chain.objs.size()=1 2024-09-12T01:21:57.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Zam23vO5fJB3v3NFxD8IIct06Gf4ebO_0 2024-09-12T01:21:57.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3455979982591171158', time=2024-09-12T03:09:54.032788+0000, chain.objs.size()=1 2024-09-12T01:21:57.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.jiiW7pgdcI0tR4YIo5bbp__1P818wlM_0 2024-09-12T01:21:57.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13576906297808767370', time=2024-09-12T03:09:54.093978+0000, chain.objs.size()=1 2024-09-12T01:21:57.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.uqnDDv_5akbMuic4U6c0Od8_JUthSOR_0 2024-09-12T01:21:57.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17082892509943956920', time=2024-09-12T03:09:54.112646+0000, chain.objs.size()=1 2024-09-12T01:21:57.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Dv9zUvFw83wGSNvwSL5uJGZxUC4sfyY_0 2024-09-12T01:21:57.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15285048961066489738', time=2024-09-12T03:09:54.136576+0000, chain.objs.size()=1 2024-09-12T01:21:57.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.SxR5oO4woPxX7gInwQcmEjiDFVCQBHi_0 2024-09-12T01:21:57.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12167005875383900012', time=2024-09-12T03:09:54.149122+0000, chain.objs.size()=1 2024-09-12T01:21:57.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.VODEMGvqr4T4EDC-0XXOvYpNnhzLDAS_0 2024-09-12T01:21:57.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18415293392698589571', time=2024-09-12T03:09:54.348868+0000, chain.objs.size()=1 2024-09-12T01:21:57.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.pYgiINaxlmAYSjLsL5Hu3fAmfTOVLEQ_0 2024-09-12T01:21:57.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6640028414566154306', time=2024-09-12T03:09:54.375906+0000, chain.objs.size()=1 2024-09-12T01:21:57.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.xNLJvZTVeiTUDSsNRNaTYZKE0PrCKbc_0 2024-09-12T01:21:57.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2412555932784349988', time=2024-09-12T03:09:54.402847+0000, chain.objs.size()=1 2024-09-12T01:21:57.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.og8vEyBDKRJ3-AdO-VgdzzcJPoeqMTh_0 2024-09-12T01:21:57.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13527463280323571377', time=2024-09-12T03:09:54.403662+0000, chain.objs.size()=1 2024-09-12T01:21:57.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.AtJww4VIDsaUBKmt7bdEe9qytSnC_xo_0 2024-09-12T01:21:57.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11880349706588267440', time=2024-09-12T03:09:54.490874+0000, chain.objs.size()=1 2024-09-12T01:21:57.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.WZ511r8-L777cH13rSN_eJuovE1w6jR_0 2024-09-12T01:21:57.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3831548983797780694', time=2024-09-12T03:09:54.698003+0000, chain.objs.size()=1 2024-09-12T01:21:57.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.bmeedROFlVKIFcf-wziuDtFG8zD9A3Z_0 2024-09-12T01:21:57.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8209473403838064735', time=2024-09-12T03:09:54.754161+0000, chain.objs.size()=1 2024-09-12T01:21:57.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.O9kWlvZ6g0ZFoUBxsWaD5xIHEOAP1OV_0 2024-09-12T01:21:57.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17109970424762514928', time=2024-09-12T03:09:54.949098+0000, chain.objs.size()=1 2024-09-12T01:21:57.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ZGhI6F23CZ7pPVX5dUa4PdzcSnT0LG8_0 2024-09-12T01:21:57.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3384370237793716667', time=2024-09-12T03:09:55.008558+0000, chain.objs.size()=1 2024-09-12T01:21:57.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.mvInRp40Bidwp-Wl7wdvf2HIOaxmv_3_0 2024-09-12T01:21:57.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4129853624551298524', time=2024-09-12T03:09:55.034027+0000, chain.objs.size()=1 2024-09-12T01:21:57.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.vjAOKXLxWyZu3LQQ-UAzATkYC-bud_m_0 2024-09-12T01:21:57.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9421311985496073438', time=2024-09-12T03:09:55.069510+0000, chain.objs.size()=1 2024-09-12T01:21:57.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.CyCnUJzL6iH6LQb6RNBxYW39GmFJipG_0 2024-09-12T01:21:57.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11859498029095976605', time=2024-09-12T03:09:55.096156+0000, chain.objs.size()=1 2024-09-12T01:21:57.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.gB1b0lxng9tilvnZcyQP69tLaetIwN8_0 2024-09-12T01:21:57.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8540661950225226111', time=2024-09-12T03:09:55.312029+0000, chain.objs.size()=1 2024-09-12T01:21:57.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.028+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.p90-GPQcCZvUK5d1nX2PsSHlvCNpBcl_0 2024-09-12T01:21:57.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5644518726996969303', time=2024-09-12T03:09:55.343562+0000, chain.objs.size()=1 2024-09-12T01:21:57.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.aqS5_MxoKlaXQsO2Lms3iSkKvF7Dmp7_0 2024-09-12T01:21:57.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1761322368038864539', time=2024-09-12T03:09:55.396274+0000, chain.objs.size()=1 2024-09-12T01:21:57.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.3bTn0r2FePCzPWfmbg46qH-1Sp1X_Qe_0 2024-09-12T01:21:57.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12910697338370904220', time=2024-09-12T03:09:55.401279+0000, chain.objs.size()=1 2024-09-12T01:21:57.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.TimnoykxNMF9iwSk9T-eCxxzO3E4oZ0_0 2024-09-12T01:21:57.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9744424083329061054', time=2024-09-12T03:10:15.208363+0000, chain.objs.size()=1 2024-09-12T01:21:57.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.TBYZ61YK5b3HXwpVJb6C083AdkhDUjq_0 2024-09-12T01:21:57.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9726859290572816930', time=2024-09-12T03:10:15.430936+0000, chain.objs.size()=1 2024-09-12T01:21:57.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.GuZlgYZjk99unlGjM4MTKZa6pt-AxDb_0 2024-09-12T01:21:57.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1319747234554662171', time=2024-09-12T03:10:15.431623+0000, chain.objs.size()=1 2024-09-12T01:21:57.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.4OFR8wqr_IlHjwtFUsYKkLopbEqx96D_0 2024-09-12T01:21:57.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3332398083254865884', time=2024-09-12T03:10:15.583001+0000, chain.objs.size()=1 2024-09-12T01:21:57.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.K_3J7LI1qTSiWQfqXV-K_INbZhjY1gr_0 2024-09-12T01:21:57.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5813061196187627504', time=2024-09-12T03:10:15.597175+0000, chain.objs.size()=1 2024-09-12T01:21:57.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_._BuRp_YSEOK14Bpos0V1N8h8Y8LMCxj_0 2024-09-12T01:21:57.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15187213521972797536', time=2024-09-12T03:10:15.608482+0000, chain.objs.size()=1 2024-09-12T01:21:57.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.NyMDpGGDDS3Grqib7UQYVr7aTkVUx3g_0 2024-09-12T01:21:57.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4314037104052291741', time=2024-09-12T03:10:15.663319+0000, chain.objs.size()=1 2024-09-12T01:21:57.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.iaun2iz1yiaR2ZAYRfPGXNMv1VRw2zO_0 2024-09-12T01:21:57.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17115764041679990280', time=2024-09-12T03:10:15.674930+0000, chain.objs.size()=1 2024-09-12T01:21:57.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.5u0gTaPKox14Hxx87MeeeybpfnPOR54_0 2024-09-12T01:21:57.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3486700766853385134', time=2024-09-12T03:10:15.678622+0000, chain.objs.size()=1 2024-09-12T01:21:57.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.JDqUGzs_Yd_dtAkrtoJ51RUBkbnyKSy_0 2024-09-12T01:21:57.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4201499866118968556', time=2024-09-12T03:10:15.697887+0000, chain.objs.size()=1 2024-09-12T01:21:57.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.D0ZVEXxFzs3a5SB2hiiyWy9a_y4oqnK_0 2024-09-12T01:21:57.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12850673661315654454', time=2024-09-12T03:10:15.715921+0000, chain.objs.size()=1 2024-09-12T01:21:57.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.PRkyAHtJNAO171eirM9n0GNBSSc4BlM_0 2024-09-12T01:21:57.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8949415509276433258', time=2024-09-12T03:10:15.720722+0000, chain.objs.size()=1 2024-09-12T01:21:57.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.fghWleOVbYkr5EHEj1d4NfQCXlCXxdc_0 2024-09-12T01:21:57.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15404161295627186299', time=2024-09-12T03:10:15.736910+0000, chain.objs.size()=1 2024-09-12T01:21:57.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.oOH-DjJni8puyYbib-l0zaL0Vj4vdGq_0 2024-09-12T01:21:57.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8162741803245007784', time=2024-09-12T03:10:15.779771+0000, chain.objs.size()=1 2024-09-12T01:21:57.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.X6S0YDgkhpN4vDMbpiyW-RoFMAd9UQr_0 2024-09-12T01:21:57.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8137425781550726285', time=2024-09-12T03:10:15.914150+0000, chain.objs.size()=1 2024-09-12T01:21:57.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.HHScjwEu1Ka1d6lNqaegI_mYv9aidqV_0 2024-09-12T01:21:57.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12324537826281311983', time=2024-09-12T03:10:15.947714+0000, chain.objs.size()=1 2024-09-12T01:21:57.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.032+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.KCtD42aAKChbxTOfOZohVqwvlXTl0ZE_0 2024-09-12T01:21:57.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.036+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8508360719447044114', time=2024-09-12T03:10:15.971065+0000, chain.objs.size()=1 2024-09-12T01:21:57.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.036+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.u2ukmFIkNLt9cZIh0v7L9Hgm5CviEVt_0 2024-09-12T01:21:57.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.036+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10028000646279904540', time=2024-09-12T03:10:16.210654+0000, chain.objs.size()=1 2024-09-12T01:21:57.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.036+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_._WhT5GByeR-qi5wiWl5-KELIDLruJn0_0 2024-09-12T01:21:57.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.036+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2493082597683303367', time=2024-09-12T03:10:16.868023+0000, chain.objs.size()=1 2024-09-12T01:21:57.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.036+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.IAYjBbJXX4ROSKuw8_I_jTRemYgLXfG_0 2024-09-12T01:21:57.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.036+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/52286 2024-09-12T01:21:57.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-09-12T01:21:57.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8376775801039571315', time=2024-09-12T03:10:16.875385+0000, chain.objs.size()=1 2024-09-12T01:21:57.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.qKUNRb4yNhalM-LVIQCqLl4tRooYp0q_0 2024-09-12T01:21:57.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5835148300625590121', time=2024-09-12T03:10:16.944339+0000, chain.objs.size()=1 2024-09-12T01:21:57.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.rQ8lZc8wiDzYeJHiLssTCYMw89nZWAc_0 2024-09-12T01:21:57.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17095886483278233381', time=2024-09-12T03:10:17.132754+0000, chain.objs.size()=1 2024-09-12T01:21:57.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.6BWvkcbPnMoE5LW4XjVAj8t0iBwoMen_0 2024-09-12T01:21:57.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2200888523439135965', time=2024-09-12T03:10:17.263793+0000, chain.objs.size()=1 2024-09-12T01:21:57.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.C9vJpXTnTNZGgP25gBEvo97Glfn5VIb_0 2024-09-12T01:21:57.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12454737594011496228', time=2024-09-12T03:10:17.304132+0000, chain.objs.size()=1 2024-09-12T01:21:57.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.lcrW1NooRG9cl0r6BMLBVCNeQ6JSLgS_0 2024-09-12T01:21:57.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16502173565697350029', time=2024-09-12T03:10:17.505041+0000, chain.objs.size()=1 2024-09-12T01:21:57.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.bEZ0wvK7t-d1k5h2bBSvhUfVdI8k1Bv_0 2024-09-12T01:21:57.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11767983963746119929', time=2024-09-12T03:10:17.555326+0000, chain.objs.size()=1 2024-09-12T01:21:57.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.5KYgDAo6L8sAhGRiNtoiRDlvJH_ySZo_0 2024-09-12T01:21:57.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2765104908111153323', time=2024-09-12T03:10:17.603371+0000, chain.objs.size()=1 2024-09-12T01:21:57.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.KSpIh-f4AdE9bKqhniX-7lPAz7BL6Ss_0 2024-09-12T01:21:57.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7263191792581218602', time=2024-09-12T03:10:17.758317+0000, chain.objs.size()=1 2024-09-12T01:21:57.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.vxNq-i_1PIiS1BInP-eR00lTdWLviYP_0 2024-09-12T01:21:57.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7331486857544263203', time=2024-09-12T03:10:17.817344+0000, chain.objs.size()=1 2024-09-12T01:21:57.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.rPyXJ1xpW_eYdhCE7_iLXP5IpkFBIHS_0 2024-09-12T01:21:57.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15056447887873214179', time=2024-09-12T03:10:17.841520+0000, chain.objs.size()=1 2024-09-12T01:21:57.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.JPgfTvFduB4VbUpjL3MKCmwBWK29T88_0 2024-09-12T01:21:57.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8403087371731424043', time=2024-09-12T03:10:17.884339+0000, chain.objs.size()=1 2024-09-12T01:21:57.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.EkNbl9QOqky8M95ENIvxwiTe6j0Fl1N_0 2024-09-12T01:21:57.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6113389576943156586', time=2024-09-12T03:10:17.891972+0000, chain.objs.size()=1 2024-09-12T01:21:57.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.VnfALuv_FNjjzKnL6dtBoQjWP57hhd0_0 2024-09-12T01:21:57.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.220777059022384655', time=2024-09-12T03:10:24.095151+0000, chain.objs.size()=1 2024-09-12T01:21:57.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.335__shadow_.lkV63gZd1HrzWCgeqPn8g73MmXKzDU9_0 2024-09-12T01:21:57.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3035543853569886019', time=2024-09-12T03:10:59.767063+0000, chain.objs.size()=1 2024-09-12T01:21:57.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.391__shadow_.EXxrMBg1tIK0ZpgyVztDiE4VTpeGHb9_0 2024-09-12T01:21:57.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1870932509167052533', time=2024-09-12T03:11:14.043650+0000, chain.objs.size()=1 2024-09-12T01:21:57.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.411__shadow_._7AO9lNpDW8lNKRaGKHgmTbQXxBXSrM_0 2024-09-12T01:21:57.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6331080256904306587', time=2024-09-12T03:11:49.481028+0000, chain.objs.size()=1 2024-09-12T01:21:57.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.459__shadow_.MgXGuubVJigWymE6Y3v4oSJiHPikceJ_0 2024-09-12T01:21:57.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3923570597994734814', time=2024-09-12T03:12:05.015172+0000, chain.objs.size()=1 2024-09-12T01:21:57.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.484__shadow_.eYGHIqpRI-a7XiK-YZJ3b_fF-Tdwt2D_0 2024-09-12T01:21:57.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2948931445119318439', time=2024-09-12T03:12:14.428787+0000, chain.objs.size()=1 2024-09-12T01:21:57.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.040+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.498__shadow_.ztcVOoAGMINEMbRM72alNnAK9TaUkZv_0 2024-09-12T01:21:57.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.044+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17280665898449968616', time=2024-09-12T03:12:22.090101+0000, chain.objs.size()=6 2024-09-12T01:21:57.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.044+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.1 2024-09-12T01:21:57.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.044+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.2 2024-09-12T01:21:57.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.044+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.3 2024-09-12T01:21:57.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.044+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.4 2024-09-12T01:21:57.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.044+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.5 2024-09-12T01:21:57.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.044+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.6 2024-09-12T01:21:57.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.044+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16464237959455266730', time=2024-09-12T03:13:03.429573+0000, chain.objs.size()=4 2024-09-12T01:21:57.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.044+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.528__multipart_mymultipart.2~wjxksg7tORe4PXZ2ooNSP0S67MqioWy.1 2024-09-12T01:21:57.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.044+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.528__multipart_mymultipart.2~wjxksg7tORe4PXZ2ooNSP0S67MqioWy.2 2024-09-12T01:21:57.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.044+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.528__multipart_mymultipart.2~wjxksg7tORe4PXZ2ooNSP0S67MqioWy.3 2024-09-12T01:21:57.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.044+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.528__multipart_mymultipart.2~wjxksg7tORe4PXZ2ooNSP0S67MqioWy.4 2024-09-12T01:21:57.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.044+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16947287730535787650', time=2024-09-12T03:13:55.498850+0000, chain.objs.size()=1 2024-09-12T01:21:57.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.044+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.558__shadow_.xIqR5rNWwQfIgDYajJ7Ztpx4DxN23_a_0 2024-09-12T01:21:57.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.044+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1402144823323408128', time=2024-09-12T03:14:06.641234+0000, chain.objs.size()=1 2024-09-12T01:21:57.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.044+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.566__shadow_.IIN9a5ytvGUbhSwIkYF5hsrkLDPVWBE_0 2024-09-12T01:21:57.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.044+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12131331157618886367', time=2024-09-12T03:14:24.607848+0000, chain.objs.size()=1 2024-09-12T01:21:57.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.044+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.575__shadow:0QIxKflfJrnrZxi9QosOv6LOZThYQ9Y_.kLQHsmvF01G5UllfadGCBMGpIQx2vGF_0 2024-09-12T01:21:57.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.044+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13509264657103591597', time=2024-09-12T03:14:44.111759+0000, chain.objs.size()=1 2024-09-12T01:21:57.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.044+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:4x-PcSpRdbeXsjoMpBtaGDxzDzO6yB3_.Lb_MqHbasGVSzLpVyOe-Zg-GRMGtdRN_0 2024-09-12T01:21:57.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.044+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12404375263794827312', time=2024-09-12T03:14:51.924121+0000, chain.objs.size()=1 2024-09-12T01:21:57.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.044+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.580__shadow:wBZEKuWCeZ0pxrHShAqEfcNsLnYq25T_.aa04_dR1DdPnQwGopxzQyeh3t5WSFEW_0 2024-09-12T01:21:57.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.044+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4573560749240363774', time=2024-09-12T03:15:04.580284+0000, chain.objs.size()=1 2024-09-12T01:21:57.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.044+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.597__shadow_.QK680AUScuSiI2ywtfxvYB4is8vUgYb_0 2024-09-12T01:21:57.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.048+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10408636464350642496', time=2024-09-12T03:15:08.087079+0000, chain.objs.size()=1 2024-09-12T01:21:57.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.048+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.603__shadow_.6Cn2BeltY_SmcsXsslZcNhMXgy3QilB_0 2024-09-12T01:21:57.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.048+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6870620057469444079', time=2024-09-12T03:17:58.719721+0000, chain.objs.size()=1 2024-09-12T01:21:57.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.048+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.653__shadow_.wV0Y8VWvlgMCd3M7gC_tP417HjxakmX_0 2024-09-12T01:21:57.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.048+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11349043021177834611', time=2024-09-12T03:18:26.391371+0000, chain.objs.size()=1 2024-09-12T01:21:57.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.048+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.694__shadow:kQ.9AD8nkz1OZCiFZdl1-dDu7SVjv5F_.inw3bcawta0ONtlpfRxpHjY9i8oceAd_0 2024-09-12T01:21:57.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.048+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:57.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.052+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:21:57.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.052+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:57.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.052+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:57.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46352' 2024-09-12T01:21:57.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_JBNjyYtpyI58pmlw8rM01liN1qk6_cv', time=2024-09-12T03:06:01.644483+0000, chain.objs.size()=2 2024-09-12T01:21:57.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.162__shadow_.hLInW5OFW4UL8ZI5AdSP2rc6FuICMUu_0 2024-09-12T01:21:57.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.162__shadow_.hLInW5OFW4UL8ZI5AdSP2rc6FuICMUu_1 2024-09-12T01:21:57.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_MjPOa5xYZWL-Wav095Diz1FkcpRd7pk', time=2024-09-12T03:06:03.540559+0000, chain.objs.size()=1 2024-09-12T01:21:57.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.164__shadow_.Afa2UhBubniX-dOFlUIipsieDoTZdyc_0 2024-09-12T01:21:57.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15428727403720745227', time=2024-09-12T03:06:05.073561+0000, chain.objs.size()=1 2024-09-12T01:21:57.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.167__shadow_.L6dsEZIkaCYSTIpSlD8YpOOebpRJUID_0 2024-09-12T01:21:57.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14654307706792455586', time=2024-09-12T03:06:06.285730+0000, chain.objs.size()=1 2024-09-12T01:21:57.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.171__shadow_._LGENcJJe4jyNekrpPHCmO9LDZqdmXW_0 2024-09-12T01:21:57.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14044036051025098609', time=2024-09-12T03:08:11.437329+0000, chain.objs.size()=1 2024-09-12T01:21:57.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.239__shadow_.V-QIXgnxppounhhwr7XwYZQ6eZVcOX1_0 2024-09-12T01:21:57.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11461190992441527945', time=2024-09-12T03:08:17.152045+0000, chain.objs.size()=1 2024-09-12T01:21:57.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.246__shadow_.O41T68EQ-DmWzqpPCwbc373LotpfrIZ_0 2024-09-12T01:21:57.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1586757815800004063', time=2024-09-12T03:08:18.523197+0000, chain.objs.size()=1 2024-09-12T01:21:57.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.248__shadow_.SDhRf1DCbbZaKZEHdi-l30hf3AL4US1_0 2024-09-12T01:21:57.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13355271707495442149', time=2024-09-12T03:08:19.876159+0000, chain.objs.size()=1 2024-09-12T01:21:57.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.250__shadow_.zo3mAfTzOLI6Mm5lcZE47jyZvU6eNj3_0 2024-09-12T01:21:57.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7808523863581047415', time=2024-09-12T03:08:21.916520+0000, chain.objs.size()=1 2024-09-12T01:21:57.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.253__shadow_.WbXhwj3mJVBwXJ3y3lQpxDEp-1Y-sX6_0 2024-09-12T01:21:57.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18063386369682235138', time=2024-09-12T03:08:47.657942+0000, chain.objs.size()=1 2024-09-12T01:21:57.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.aISE4YJL2cUh2wNkEMAvIY_Dbjdc7hi_0 2024-09-12T01:21:57.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15416446671121955456', time=2024-09-12T03:08:47.669872+0000, chain.objs.size()=1 2024-09-12T01:21:57.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.k3ZkyJGgJ1yOxd1OE68RuiLxa7WbmXD_0 2024-09-12T01:21:57.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14810402979886709721', time=2024-09-12T03:08:47.810084+0000, chain.objs.size()=1 2024-09-12T01:21:57.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.EZTTFwLafErM_q38I5TPNs_IfoGwDV1_0 2024-09-12T01:21:57.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8973332988480618101', time=2024-09-12T03:08:47.900897+0000, chain.objs.size()=1 2024-09-12T01:21:57.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.O8reHJbM1HQ98-QeCfVsFFXCaioIP6Z_0 2024-09-12T01:21:57.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12421959727655237722', time=2024-09-12T03:08:47.916352+0000, chain.objs.size()=1 2024-09-12T01:21:57.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.YdHOmZDjZNBhfSLpcTEbHCdwLJwBUP-_0 2024-09-12T01:21:57.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.511694772814728836', time=2024-09-12T03:08:47.943589+0000, chain.objs.size()=1 2024-09-12T01:21:57.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.mDGwV7vIWkFBgrQKUbA9QAu8et1YtXQ_0 2024-09-12T01:21:57.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8700652224348838391', time=2024-09-12T03:08:48.298969+0000, chain.objs.size()=1 2024-09-12T01:21:57.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.YSauxMe32256uwNLjXXG26hxqCukQ1r_0 2024-09-12T01:21:57.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7070834249892977316', time=2024-09-12T03:08:48.522221+0000, chain.objs.size()=1 2024-09-12T01:21:57.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.pe3hYoNA9rVl4b7zU7rSFCYe7eYWhGs_0 2024-09-12T01:21:57.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7833026309023660352', time=2024-09-12T03:08:48.548524+0000, chain.objs.size()=1 2024-09-12T01:21:57.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.88TmfAZOBQKJejpSmf7thEvUR9jfscg_0 2024-09-12T01:21:57.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.883208036878074083', time=2024-09-12T03:08:48.648274+0000, chain.objs.size()=1 2024-09-12T01:21:57.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.056+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.gmsNNCaji9LZwK_99kX7SZKnTgkyw44_0 2024-09-12T01:21:57.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18182972129307830973', time=2024-09-12T03:08:48.690554+0000, chain.objs.size()=1 2024-09-12T01:21:57.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.QG-w7e8Za6J8fnxujioO2yIB5gTdAQB_0 2024-09-12T01:21:57.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6980488637392164711', time=2024-09-12T03:08:48.867484+0000, chain.objs.size()=1 2024-09-12T01:21:57.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.bqdKE_VMCfzhjtnlvjKK7VHcPl_xBCu_0 2024-09-12T01:21:57.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15750266723761865679', time=2024-09-12T03:08:48.885530+0000, chain.objs.size()=1 2024-09-12T01:21:57.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.4RRsnwFK-1-f_FtSPPCTsWNmmBFxlbE_0 2024-09-12T01:21:57.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5277617471414263453', time=2024-09-12T03:08:49.177096+0000, chain.objs.size()=1 2024-09-12T01:21:57.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.AzfGKeiHLV7cOZ6Sl5x7s8e95d_LayB_0 2024-09-12T01:21:57.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12444322614101391405', time=2024-09-12T03:08:49.178741+0000, chain.objs.size()=1 2024-09-12T01:21:57.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.m5NFFHwtgTf81RUZ8L5a4DOxUxaeI-0_0 2024-09-12T01:21:57.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9539451654824025938', time=2024-09-12T03:08:49.223847+0000, chain.objs.size()=1 2024-09-12T01:21:57.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ry7reuF7lZG-ztnP8vzGXTehbgAq9kY_0 2024-09-12T01:21:57.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14158655627805310863', time=2024-09-12T03:08:49.291348+0000, chain.objs.size()=1 2024-09-12T01:21:57.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.yvRqcqnL3lfmxqBsiXXjYC8F_8oMOs1_0 2024-09-12T01:21:57.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10860713207913223707', time=2024-09-12T03:08:49.334323+0000, chain.objs.size()=1 2024-09-12T01:21:57.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.zXDQ0LK6k-GnOkPaIvAjEg7ztthd1hz_0 2024-09-12T01:21:57.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1971043053190796443', time=2024-09-12T03:08:49.342822+0000, chain.objs.size()=1 2024-09-12T01:21:57.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.EOisgqxALkrtELqoMGvQdKjfbIutWS0_0 2024-09-12T01:21:57.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7609667731116571331', time=2024-09-12T03:08:49.371405+0000, chain.objs.size()=1 2024-09-12T01:21:57.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.wduROTSVdMFtdCp9Bvb7KKklq8dOkVE_0 2024-09-12T01:21:57.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12708146452851827688', time=2024-09-12T03:08:49.604940+0000, chain.objs.size()=1 2024-09-12T01:21:57.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_._Zhv5X5LJQXC0_7gw4ZWQhSsLRLQutp_0 2024-09-12T01:21:57.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11469418414572548511', time=2024-09-12T03:08:49.633199+0000, chain.objs.size()=1 2024-09-12T01:21:57.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.1bYy3y4zKhyI55fz7KiLzE_E-0NTnNb_0 2024-09-12T01:21:57.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4274781006224092877', time=2024-09-12T03:08:49.649887+0000, chain.objs.size()=1 2024-09-12T01:21:57.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.n6VOkg85wDJCvX6KWIQeX5h-k8JQW_o_0 2024-09-12T01:21:57.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.770160763292128880', time=2024-09-12T03:08:49.657006+0000, chain.objs.size()=1 2024-09-12T01:21:57.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.cTxmRi0kh7FaqP5dYgx9Ccf75YcNAet_0 2024-09-12T01:21:57.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15902721073047874264', time=2024-09-12T03:08:49.679245+0000, chain.objs.size()=1 2024-09-12T01:21:57.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.aryWRBGgiSshz1zA1B_L26JLIeLDZ1S_0 2024-09-12T01:21:57.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.934017096581494224', time=2024-09-12T03:08:49.692203+0000, chain.objs.size()=1 2024-09-12T01:21:57.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.060+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.5uP3I4v2Erqy2DT0WZE_VcJQcpOweUo_0 2024-09-12T01:21:57.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5253156842100471332', time=2024-09-12T03:08:49.695918+0000, chain.objs.size()=1 2024-09-12T01:21:57.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.O-zo4MbVOwQvTzWLAQvy3vYoWasy5mp_0 2024-09-12T01:21:57.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5619074362085597906', time=2024-09-12T03:08:49.720340+0000, chain.objs.size()=1 2024-09-12T01:21:57.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.sOCskilApMXLWlVnAB1tOLHK0WvE1_d_0 2024-09-12T01:21:57.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10053827807442040899', time=2024-09-12T03:08:49.895157+0000, chain.objs.size()=1 2024-09-12T01:21:57.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.FHQyZSFgzbkxY3AHw2bpQRHiKuvtUmV_0 2024-09-12T01:21:57.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4238393522321175849', time=2024-09-12T03:08:49.921600+0000, chain.objs.size()=1 2024-09-12T01:21:57.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.B6LI3mMI1mlft15H84QbZDtAk_bzvmk_0 2024-09-12T01:21:57.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16478348051052564458', time=2024-09-12T03:08:50.006819+0000, chain.objs.size()=1 2024-09-12T01:21:57.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.-mlukqxP0G0j7rmscMdE4IuBhAnGQ1R_0 2024-09-12T01:21:57.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2205750908997624244', time=2024-09-12T03:08:50.030513+0000, chain.objs.size()=1 2024-09-12T01:21:57.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.BbVUDj0ontFvIoW1ALVRHHoEiZLAD4a_0 2024-09-12T01:21:57.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16003862260521592329', time=2024-09-12T03:08:50.049313+0000, chain.objs.size()=1 2024-09-12T01:21:57.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.t11o6vW_ovD1bCqJW_QlNuGcIR6LGDY_0 2024-09-12T01:21:57.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17749191627893338369', time=2024-09-12T03:08:58.035473+0000, chain.objs.size()=1 2024-09-12T01:21:57.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.275__shadow_.uarzkTAz0aURpPimI3rzrnSGjH0N8V1_0 2024-09-12T01:21:57.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.965797504812295590', time=2024-09-12T03:09:03.675950+0000, chain.objs.size()=1 2024-09-12T01:21:57.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.283__shadow_.PXQW0U32kAsOEkNitAT0nTDkqVhdp1__0 2024-09-12T01:21:57.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12448931540918897553', time=2024-09-12T03:09:11.596090+0000, chain.objs.size()=1 2024-09-12T01:21:57.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.293__shadow_.zqgyO44jUaOBajffuBPDhGHK9TUeFgh_0 2024-09-12T01:21:57.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10215640864917774050', time=2024-09-12T03:09:15.122097+0000, chain.objs.size()=1 2024-09-12T01:21:57.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.297__shadow_.QwgiCJ-YFYqPhPLfgjb5YNHnVeYZlNJ_0 2024-09-12T01:21:57.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1859623151153234570', time=2024-09-12T03:09:18.005833+0000, chain.objs.size()=1 2024-09-12T01:21:57.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.301__shadow_.yeGgepZk74R2-wsyHa7d7q8pG88YFu__0 2024-09-12T01:21:57.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8410524101375603215', time=2024-09-12T03:09:23.473942+0000, chain.objs.size()=1 2024-09-12T01:21:57.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.308__shadow:o0UITbhQ870xq0YYxqpkdmFK9RRHyMd_.a0IJpigkGGfi8DjBxgrkX489dzMHsDX_0 2024-09-12T01:21:57.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.289278032771381061', time=2024-09-12T03:09:31.753472+0000, chain.objs.size()=1 2024-09-12T01:21:57.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.320__shadow:hLSaaGe8f1BS2.N.K20AujvhCRUZqeY_.4onnANSOmdruMqlA6aGCOmJLA3M-T_L_0 2024-09-12T01:21:57.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10585805120736471539', time=2024-09-12T03:09:52.913589+0000, chain.objs.size()=1 2024-09-12T01:21:57.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.eymnm9rzHqJP_hTVfY-LNJSjcMOrCt__0 2024-09-12T01:21:57.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10896571794667023212', time=2024-09-12T03:09:52.928223+0000, chain.objs.size()=1 2024-09-12T01:21:57.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.RXrFwpke9n4MissRRa59HpvgLBI8-2o_0 2024-09-12T01:21:57.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.332504403667316173', time=2024-09-12T03:09:52.971273+0000, chain.objs.size()=1 2024-09-12T01:21:57.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.79A7GSpSdq9xQaH7d7CO0398Evs6cpS_0 2024-09-12T01:21:57.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.617552124688574057', time=2024-09-12T03:09:53.070710+0000, chain.objs.size()=1 2024-09-12T01:21:57.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ScXrXkE8oHEyVJvvUEFsFOzx4eVBoBu_0 2024-09-12T01:21:57.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1487499595378619000', time=2024-09-12T03:09:53.078097+0000, chain.objs.size()=1 2024-09-12T01:21:57.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.eL4jTOBaBYEMPwmBHMczU7U-uvNZ-34_0 2024-09-12T01:21:57.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6218516596125392884', time=2024-09-12T03:09:53.094326+0000, chain.objs.size()=1 2024-09-12T01:21:57.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.064+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.CzMXWmkn-Zd5VlZPM-to9uRxtjRLEhI_0 2024-09-12T01:21:57.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13054241010339213982', time=2024-09-12T03:09:53.115702+0000, chain.objs.size()=1 2024-09-12T01:21:57.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.IHw3JIjzNvVS_-uR1TB3zd1LqM2OFgJ_0 2024-09-12T01:21:57.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5778181186735302363', time=2024-09-12T03:09:53.266529+0000, chain.objs.size()=1 2024-09-12T01:21:57.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.KbuQW__8yeKdR1gWVT6RyKUXFjWdfZp_0 2024-09-12T01:21:57.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3697653561062788935', time=2024-09-12T03:09:53.293972+0000, chain.objs.size()=1 2024-09-12T01:21:57.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.gKhS1j2_A1ZhQYXnVXLEvUq2-zWxDtl_0 2024-09-12T01:21:57.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12060262162025532700', time=2024-09-12T03:09:53.411392+0000, chain.objs.size()=1 2024-09-12T01:21:57.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.xlLpYTlhjq2aURDh5FRELBdDNEmEH7T_0 2024-09-12T01:21:57.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7444037422865397706', time=2024-09-12T03:09:53.472186+0000, chain.objs.size()=1 2024-09-12T01:21:57.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.fMmY_nCB9j7yxNNxBTogw2yqDER4-uQ_0 2024-09-12T01:21:57.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7115841076907104669', time=2024-09-12T03:09:53.503857+0000, chain.objs.size()=1 2024-09-12T01:21:57.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.mFk7w28AlGz4VLi74_gmESnSRUbsHWv_0 2024-09-12T01:21:57.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14508249311793531570', time=2024-09-12T03:09:53.511594+0000, chain.objs.size()=1 2024-09-12T01:21:57.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.jzpgRpdhOdElWwvC-p8r57C_E3HD9Mj_0 2024-09-12T01:21:57.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18108875031373035713', time=2024-09-12T03:09:53.794311+0000, chain.objs.size()=1 2024-09-12T01:21:57.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.TddwLJJ8zF-a4o-UlMjzFq8b_OBacGZ_0 2024-09-12T01:21:57.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10913191380131332139', time=2024-09-12T03:09:53.830160+0000, chain.objs.size()=1 2024-09-12T01:21:57.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.g1ceiDmvmkkTHrpZrjhtHkwY0aCNCJb_0 2024-09-12T01:21:57.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12894007087256688875', time=2024-09-12T03:09:53.837209+0000, chain.objs.size()=1 2024-09-12T01:21:57.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.CnIxC7Z-tWtYjh2AfdVyjqYUOdZJ4rR_0 2024-09-12T01:21:57.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11208234856761728839', time=2024-09-12T03:09:53.968271+0000, chain.objs.size()=1 2024-09-12T01:21:57.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.v_dbc9B0pARe0Kaeik3WBK_BVzSpTwa_0 2024-09-12T01:21:57.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17701786768728228682', time=2024-09-12T03:09:53.999158+0000, chain.objs.size()=1 2024-09-12T01:21:57.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.HW1pjzmNTRQH-0BuXJsG0qSQqYJzZCR_0 2024-09-12T01:21:57.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14338115669322125807', time=2024-09-12T03:09:54.414534+0000, chain.objs.size()=1 2024-09-12T01:21:57.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.4uR8lp43SdZv6tLlQW-EdRhCzFbqiMy_0 2024-09-12T01:21:57.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16459784056400478552', time=2024-09-12T03:09:54.434871+0000, chain.objs.size()=1 2024-09-12T01:21:57.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.NYunC7xrStAjQyaUTdovKPt_iJ1jX1A_0 2024-09-12T01:21:57.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14605845143524163491', time=2024-09-12T03:09:54.491382+0000, chain.objs.size()=1 2024-09-12T01:21:57.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.6lCUSITKvNira5mzAnz28emu6DTQmr8_0 2024-09-12T01:21:57.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1285556495437784140', time=2024-09-12T03:09:54.733546+0000, chain.objs.size()=1 2024-09-12T01:21:57.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.QSCcgei0cmiXdsSvQ9FsPStY9FmMbps_0 2024-09-12T01:21:57.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14118536327137475060', time=2024-09-12T03:09:54.741061+0000, chain.objs.size()=1 2024-09-12T01:21:57.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.BMareUyqUpwnB4zzROTXVOUrlhaFHCO_0 2024-09-12T01:21:57.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17373107660373066727', time=2024-09-12T03:09:54.755203+0000, chain.objs.size()=1 2024-09-12T01:21:57.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_._Ymyn41gpS25TzwRFfD9nGlr80tgcMe_0 2024-09-12T01:21:57.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18377713382466550342', time=2024-09-12T03:09:54.775905+0000, chain.objs.size()=1 2024-09-12T01:21:57.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ykdau_JhZwVp0V-jPg_kc_w-5FNEat__0 2024-09-12T01:21:57.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3663037533103665625', time=2024-09-12T03:09:54.788411+0000, chain.objs.size()=1 2024-09-12T01:21:57.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.8tYnBhqGw772yW_d94ihmduPr8Yfetl_0 2024-09-12T01:21:57.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11980378903294834904', time=2024-09-12T03:09:55.041433+0000, chain.objs.size()=1 2024-09-12T01:21:57.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.068+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.lOqYueK0IVApdEWcpfa-_vFmpYeKkFW_0 2024-09-12T01:21:57.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15854081955177322421', time=2024-09-12T03:09:55.086901+0000, chain.objs.size()=1 2024-09-12T01:21:57.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.aIUtd5cUsDpyNKOr2Bd0Y_9AB1kPK6b_0 2024-09-12T01:21:57.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3966992984142034760', time=2024-09-12T03:09:55.143176+0000, chain.objs.size()=1 2024-09-12T01:21:57.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.IT1yWI13gWpWxgHtuDcLuReW4_SezFm_0 2024-09-12T01:21:57.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14089530285479574719', time=2024-09-12T03:09:55.150895+0000, chain.objs.size()=1 2024-09-12T01:21:57.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.OPOUWMTKAhPuFoiFxZDdmfeNGRY1SLj_0 2024-09-12T01:21:57.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16644532878280743543', time=2024-09-12T03:09:55.270901+0000, chain.objs.size()=1 2024-09-12T01:21:57.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.mYb98C1jQ5ubaxqEfY6ML6YXLcFtN8N_0 2024-09-12T01:21:57.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8736975300418169043', time=2024-09-12T03:09:55.365890+0000, chain.objs.size()=1 2024-09-12T01:21:57.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.P6tCDGMcmcp3cOo36slRaHxD0e_LD3g_0 2024-09-12T01:21:57.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5544370520110280679', time=2024-09-12T03:09:55.378071+0000, chain.objs.size()=1 2024-09-12T01:21:57.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.r_I3Y5a6Y3FUJo4nnzUC6QJLj_BGgLK_0 2024-09-12T01:21:57.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17802102113427673843', time=2024-09-12T03:09:55.391859+0000, chain.objs.size()=1 2024-09-12T01:21:57.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.48SK7pOLqZxeWhICvaK-eRRRRo-1hC7_0 2024-09-12T01:21:57.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9321405748222943395', time=2024-09-12T03:10:15.240403+0000, chain.objs.size()=1 2024-09-12T01:21:57.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.wBDQ8xsBUtz0h3hCBrDIuUZktbutvow_0 2024-09-12T01:21:57.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40167061077927329', time=2024-09-12T03:10:15.362151+0000, chain.objs.size()=1 2024-09-12T01:21:57.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ztxe0eSG97MtLcdWUOq_88ulizsMPUE_0 2024-09-12T01:21:57.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12063393142523692517', time=2024-09-12T03:10:15.399930+0000, chain.objs.size()=1 2024-09-12T01:21:57.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.15UMK6ywnqd--aZ7w-0gzXvVNGcM_pn_0 2024-09-12T01:21:57.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12843316593200779317', time=2024-09-12T03:10:15.631526+0000, chain.objs.size()=1 2024-09-12T01:21:57.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.uunu35flYL2hJmeBemTd39KjHlhC9Ee_0 2024-09-12T01:21:57.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2737356565126139633', time=2024-09-12T03:10:15.641378+0000, chain.objs.size()=1 2024-09-12T01:21:57.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.HL15Z33vSNiowJbfkYEYeHsfkUsOtAm_0 2024-09-12T01:21:57.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11087257954932597386', time=2024-09-12T03:10:15.728136+0000, chain.objs.size()=1 2024-09-12T01:21:57.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.NxEiUl3eR8ZdelgqRwVC5aU07D0f2wy_0 2024-09-12T01:21:57.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1057221594188155666', time=2024-09-12T03:10:15.898984+0000, chain.objs.size()=1 2024-09-12T01:21:57.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.YcBO_wkkbnRd7RFRMJHinJNqC8NCpFt_0 2024-09-12T01:21:57.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6768263109859202806', time=2024-09-12T03:10:15.935652+0000, chain.objs.size()=1 2024-09-12T01:21:57.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.NsbO9CTN8Vb0CaXv3HngP-BBaMmm_8L_0 2024-09-12T01:21:57.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6104943345990979850', time=2024-09-12T03:10:15.958498+0000, chain.objs.size()=1 2024-09-12T01:21:57.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.mRtmZiOmOIFop6rY6ZzbkkOaknz5jev_0 2024-09-12T01:21:57.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9020271221567279518', time=2024-09-12T03:10:16.022550+0000, chain.objs.size()=1 2024-09-12T01:21:57.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.EvftwCCWMeyaGfpjySQ0izqGkL9zmkd_0 2024-09-12T01:21:57.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17912327294390650549', time=2024-09-12T03:10:16.029483+0000, chain.objs.size()=1 2024-09-12T01:21:57.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.q3krxNZPRwRYXIVyPRLyyzT-f6REnjD_0 2024-09-12T01:21:57.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9896443187960724252', time=2024-09-12T03:10:16.082109+0000, chain.objs.size()=1 2024-09-12T01:21:57.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.072+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.TAuM2kSwpDy8WZwKL4MvvUSWiJmmVr6_0 2024-09-12T01:21:57.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.076+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8636091849506335485', time=2024-09-12T03:10:16.244517+0000, chain.objs.size()=1 2024-09-12T01:21:57.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.076+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.h4_niMspUIU6AUaUiqfzeL7kG2sFoNE_0 2024-09-12T01:21:57.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.076+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5376590780803048553', time=2024-09-12T03:10:16.280814+0000, chain.objs.size()=1 2024-09-12T01:21:57.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.076+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Tg668bYfzKNtOTDhSQPDVvgA_Xh48b4_0 2024-09-12T01:21:57.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.076+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9639768032471205798', time=2024-09-12T03:10:16.350207+0000, chain.objs.size()=1 2024-09-12T01:21:57.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.076+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.r6PuYsW7Uw_Nn2t1T33DjZQg8NiyPNK_0 2024-09-12T01:21:57.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.076+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17363014180608296887', time=2024-09-12T03:10:16.774411+0000, chain.objs.size()=1 2024-09-12T01:21:57.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.076+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.uF0BPl9eIh6pKxLX17HmWv_vwMl8wKm_0 2024-09-12T01:21:57.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.076+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3185199361220330738', time=2024-09-12T03:10:16.786692+0000, chain.objs.size()=1 2024-09-12T01:21:57.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.076+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.iEr3y3fhgyCz_eSPZVDXOZvUUlu5m9S_0 2024-09-12T01:21:57.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.076+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46352 2024-09-12T01:21:57.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T01:21:57.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2394442773639898249', time=2024-09-12T03:10:16.830419+0000, chain.objs.size()=1 2024-09-12T01:21:57.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.w9Y3wJUCasj8xcshuviNUuwf4SzkTKS_0 2024-09-12T01:21:57.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3335147603247525699', time=2024-09-12T03:10:16.845040+0000, chain.objs.size()=1 2024-09-12T01:21:57.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.GybF6Nku6O4QoAIaRh_bV0ercitpKRd_0 2024-09-12T01:21:57.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17801426505490125525', time=2024-09-12T03:10:16.875480+0000, chain.objs.size()=1 2024-09-12T01:21:57.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.mDgmt7sE8JYT75cqfhQQq5wu_s5hcnP_0 2024-09-12T01:21:57.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1061138418117134003', time=2024-09-12T03:10:16.935384+0000, chain.objs.size()=1 2024-09-12T01:21:57.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.wEkKH2VjJZJY5T-ugdRYBgBwUvd_NTb_0 2024-09-12T01:21:57.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10445605478491262818', time=2024-09-12T03:10:16.994070+0000, chain.objs.size()=1 2024-09-12T01:21:57.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.knlbIxc58V2OUQjlJWjigyjud3Rdi2f_0 2024-09-12T01:21:57.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10588236232984448691', time=2024-09-12T03:10:17.174766+0000, chain.objs.size()=1 2024-09-12T01:21:57.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.X2Fk3BZmdpnGOIx1lPGZWepliGu4DYr_0 2024-09-12T01:21:57.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13841403292051251452', time=2024-09-12T03:10:17.180732+0000, chain.objs.size()=1 2024-09-12T01:21:57.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.jeMgnssnpHJqLWahUPdMIGcsy1FFzA2_0 2024-09-12T01:21:57.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13695971649354553197', time=2024-09-12T03:10:17.205897+0000, chain.objs.size()=1 2024-09-12T01:21:57.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.-C6NQoOE9RWUWN-tj7Hu5qOvMLrP0nE_0 2024-09-12T01:21:57.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8034425698357269701', time=2024-09-12T03:10:17.277671+0000, chain.objs.size()=1 2024-09-12T01:21:57.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.z21rNZspLq0VWf7zuMDNIn25CtzP6y5_0 2024-09-12T01:21:57.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10401427812139591448', time=2024-09-12T03:10:17.278993+0000, chain.objs.size()=1 2024-09-12T01:21:57.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.z-H3dlnjcyphF-RB24Pa3AKKll7CWFG_0 2024-09-12T01:21:57.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18160569441088281388', time=2024-09-12T03:10:17.321465+0000, chain.objs.size()=1 2024-09-12T01:21:57.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.43ivJXhuupJGBxCSsxxU2afs3p2ssaW_0 2024-09-12T01:21:57.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2674959844235161835', time=2024-09-12T03:10:17.468105+0000, chain.objs.size()=1 2024-09-12T01:21:57.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.2UE10ZVCnnr67QBDYfE8ED9ia9ov0zN_0 2024-09-12T01:21:57.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10749705082645040031', time=2024-09-12T03:10:17.608029+0000, chain.objs.size()=1 2024-09-12T01:21:57.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.RuqR_iZ9liARvz6lZ1RX9T3Jb5wxbtz_0 2024-09-12T01:21:57.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13567520655668344472', time=2024-09-12T03:10:17.781946+0000, chain.objs.size()=1 2024-09-12T01:21:57.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.DuTiIXtfIp0-Jcl3KLuTCkudxPufJZP_0 2024-09-12T01:21:57.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3790668600379349461', time=2024-09-12T03:10:17.784416+0000, chain.objs.size()=1 2024-09-12T01:21:57.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.k9slReh5ePDtNAXrYW7zoNfc4HK29OO_0 2024-09-12T01:21:57.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10276758669831389557', time=2024-09-12T03:11:03.964491+0000, chain.objs.size()=1 2024-09-12T01:21:57.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.080+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.395__shadow:W7CdeVPIoY7hk-0JqfDtURIYyaEpFDb_.9EhuRf1VFanY3cb3UCcdADPv2YaTe4T_0 2024-09-12T01:21:57.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.084+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14512036426695131901', time=2024-09-12T03:12:03.395131+0000, chain.objs.size()=1 2024-09-12T01:21:57.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.084+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.482__shadow_.uF2XKHGlBcJolOvmpJ1kNxyAdgoPUIW_0 2024-09-12T01:21:57.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.084+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17020989080644569099', time=2024-09-12T03:12:29.053917+0000, chain.objs.size()=1 2024-09-12T01:21:57.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.084+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.519__multipart_mymultipart.2~3rlCdEVRpAoNFIpbkC5y6xWAYUet4An.1 2024-09-12T01:21:57.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.084+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15588251034585888807', time=2024-09-12T03:14:24.380579+0000, chain.objs.size()=1 2024-09-12T01:21:57.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.084+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.575__shadow:yAPqz8hUnfGjzHlQFguNIRR2OUa53lT_.tps6PDYf6jCt_esoFj5eicbUETcJ7p8_0 2024-09-12T01:21:57.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.084+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9443278099758514035', time=2024-09-12T03:14:36.991329+0000, chain.objs.size()=1 2024-09-12T01:21:57.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.084+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:reelNLQYaxTbeml7d6ejOHbVQwkDKMn_.ieyyXFumMSVeL9GN_ZuZIyHEEhhMnXl_0 2024-09-12T01:21:57.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.084+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2198175586116709811', time=2024-09-12T03:14:37.372859+0000, chain.objs.size()=1 2024-09-12T01:21:57.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.084+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:mD4BUAa24vgVidroweA80fHj88YuTVG_.14b8FrC2HeaW-wyvGGdUoZlC9hR8_VA_0 2024-09-12T01:21:57.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.084+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3959682306331945329', time=2024-09-12T03:14:37.977525+0000, chain.objs.size()=1 2024-09-12T01:21:57.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.084+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:JZFfHbjpW1pqICkAMJ93UPmoJKoPqG1_.91jPqO0MCBockUd--qcPwlWOgKUDur__0 2024-09-12T01:21:57.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.084+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12418966210808591694', time=2024-09-12T03:14:51.952491+0000, chain.objs.size()=1 2024-09-12T01:21:57.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.084+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.580__shadow:R7qCu.xqsuwGnrEe4v2IFJmatcvP2wH_.tR01G4m87kXsP_Nt1z9eUlGD9N_dETc_0 2024-09-12T01:21:57.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.084+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7958747561196381392', time=2024-09-12T03:14:58.994578+0000, chain.objs.size()=1 2024-09-12T01:21:57.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.084+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.588__shadow:5K4TAKoRYPqvrPGUP7SZtrzo3U81wBw_.3nwNHS8Yu--PjtjHj56mdnCv0fYkp4z_0 2024-09-12T01:21:57.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.084+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2294007175357569641', time=2024-09-12T03:15:04.579662+0000, chain.objs.size()=1 2024-09-12T01:21:57.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.084+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.597__shadow_.IMSIxxNwm2Pf7b6DtV_y1bRzjjqpLwo_0 2024-09-12T01:21:57.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.084+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11212191581249123916', time=2024-09-12T03:17:55.506086+0000, chain.objs.size()=1 2024-09-12T01:21:57.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.084+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.649__shadow_.bD63cxcKcVJM5o6nWsm98PkKhmYSLI0_0 2024-09-12T01:21:57.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.084+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:57.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.088+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:21:57.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.088+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:57.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.088+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:57.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47159' 2024-09-12T01:21:57.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18114460263436553757', time=2024-09-12T03:06:14.097729+0000, chain.objs.size()=1 2024-09-12T01:21:57.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.177__shadow_.-hSzFiP-PZjBLhgreisjJ0JctAIjHOU_0 2024-09-12T01:21:57.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10471453646502830423', time=2024-09-12T03:06:35.591183+0000, chain.objs.size()=1 2024-09-12T01:21:57.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.198__shadow_.qw8I9WKuoUXRG7LjQiJXkfgG0S_SI4E_0 2024-09-12T01:21:57.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12381470698276876656', time=2024-09-12T03:08:13.453918+0000, chain.objs.size()=1 2024-09-12T01:21:57.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.242__shadow_.OkOYSt_wcfJ9BZqe3gH4UTgfbeL4CFg_0 2024-09-12T01:21:57.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14729976553866401023', time=2024-09-12T03:08:14.136904+0000, chain.objs.size()=1 2024-09-12T01:21:57.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.243__shadow_.8BN-H17PFIi7z82-obEOvUqodIyKohs_0 2024-09-12T01:21:57.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12318086137914970705', time=2024-09-12T03:08:15.292447+0000, chain.objs.size()=1 2024-09-12T01:21:57.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.244__shadow_.rVekmyV1g9j4sc32Sb6ZNZ2rmKVoGrm_0 2024-09-12T01:21:57.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3768031390077812299', time=2024-09-12T03:08:28.149405+0000, chain.objs.size()=1 2024-09-12T01:21:57.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.262__shadow_.488_QFh6QxsgyyABehE-EZaLCmCuGC8_0 2024-09-12T01:21:57.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8837764171115034769', time=2024-09-12T03:08:47.474545+0000, chain.objs.size()=1 2024-09-12T01:21:57.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Mzzzl4kEJz6emlDXsGflRxKrJddeKsH_0 2024-09-12T01:21:57.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7450170037761899085', time=2024-09-12T03:08:47.523541+0000, chain.objs.size()=1 2024-09-12T01:21:57.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.c9pP2lEov_pzCYgZLIHRwYtzmdpabUr_0 2024-09-12T01:21:57.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6834068285486871645', time=2024-09-12T03:08:47.571514+0000, chain.objs.size()=1 2024-09-12T01:21:57.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.pfuy3tOhMgHl8GyEpynFhlxMl5zkIW__0 2024-09-12T01:21:57.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5170410958823255117', time=2024-09-12T03:08:47.606391+0000, chain.objs.size()=1 2024-09-12T01:21:57.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.0wT8t3h-jfb9qSkrv6n6St10L2ZDHwS_0 2024-09-12T01:21:57.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12455869666055366026', time=2024-09-12T03:08:47.613551+0000, chain.objs.size()=1 2024-09-12T01:21:57.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.JyHWZMaZNq7mCiD5aoT6JbyF3SXay8b_0 2024-09-12T01:21:57.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11742096698341305006', time=2024-09-12T03:08:47.675143+0000, chain.objs.size()=1 2024-09-12T01:21:57.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.rDciYKKiyIxdwXh-TNH9pp6NM3t3G9u_0 2024-09-12T01:21:57.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18084200489539103456', time=2024-09-12T03:08:47.877033+0000, chain.objs.size()=1 2024-09-12T01:21:57.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ESmfpM0qOaXuCIuuRW-9W_7ZVv6GYaN_0 2024-09-12T01:21:57.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2725671259240484519', time=2024-09-12T03:08:48.159526+0000, chain.objs.size()=1 2024-09-12T01:21:57.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ma38vTRix-zoqn1CfHwjHw6VJ4L1uGW_0 2024-09-12T01:21:57.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7104011012310913731', time=2024-09-12T03:08:48.201390+0000, chain.objs.size()=1 2024-09-12T01:21:57.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.31lgW3cwH6HBu4GTj1ULNAbFVh58cT8_0 2024-09-12T01:21:57.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3528124362658936782', time=2024-09-12T03:08:48.208042+0000, chain.objs.size()=1 2024-09-12T01:21:57.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.pxfJQkLfWADssGnLQcsiqz5a2OI4qmM_0 2024-09-12T01:21:57.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17451493295237750547', time=2024-09-12T03:08:48.252284+0000, chain.objs.size()=1 2024-09-12T01:21:57.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.hr3g0OZnVmH066fVusmvM0DlhW70Zkc_0 2024-09-12T01:21:57.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1573207777288395982', time=2024-09-12T03:08:48.336677+0000, chain.objs.size()=1 2024-09-12T01:21:57.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Fe0-eB86N61n7zDot5qal7A0qKF53_c_0 2024-09-12T01:21:57.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6035373509726447248', time=2024-09-12T03:08:48.342401+0000, chain.objs.size()=1 2024-09-12T01:21:57.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.NROXvANWx9zQfi7sH0PucxCeG3KKa63_0 2024-09-12T01:21:57.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.559675318868826010', time=2024-09-12T03:08:48.685075+0000, chain.objs.size()=1 2024-09-12T01:21:57.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.j_BHjSmZOdlGHITOU0zssapgunRDpFS_0 2024-09-12T01:21:57.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4064735301173566717', time=2024-09-12T03:08:48.850344+0000, chain.objs.size()=1 2024-09-12T01:21:57.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.jrmZyj1--jWxS9e6sMVODQC99WSuQbN_0 2024-09-12T01:21:57.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6461990608911933967', time=2024-09-12T03:08:48.916806+0000, chain.objs.size()=1 2024-09-12T01:21:57.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.k3-ZyD3jpEdBRwmOCXcC7sQyx2O74sj_0 2024-09-12T01:21:57.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10359529419016351059', time=2024-09-12T03:08:48.978379+0000, chain.objs.size()=1 2024-09-12T01:21:57.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.092+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ZsXDBBDLoRrsLDO9WW8QOY_H3XbzKIo_0 2024-09-12T01:21:57.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12998641950875074833', time=2024-09-12T03:08:49.006375+0000, chain.objs.size()=1 2024-09-12T01:21:57.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ayyV_rjouNt_diUU4k1UlLPSqs_IuKX_0 2024-09-12T01:21:57.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3510826688894039516', time=2024-09-12T03:08:49.032855+0000, chain.objs.size()=1 2024-09-12T01:21:57.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.3EmKo9Onh2JzWAEIhUMS_Vtt58OsNqi_0 2024-09-12T01:21:57.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13397480498186675511', time=2024-09-12T03:08:49.034351+0000, chain.objs.size()=1 2024-09-12T01:21:57.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.VukdTIrDs_SAG2llJXwPQETEDqW24mR_0 2024-09-12T01:21:57.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7297348053578323718', time=2024-09-12T03:08:49.268395+0000, chain.objs.size()=1 2024-09-12T01:21:57.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.SWezrvcZYawaQdmM3yznntTY0FXeHIL_0 2024-09-12T01:21:57.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6159778382776386606', time=2024-09-12T03:08:49.275439+0000, chain.objs.size()=1 2024-09-12T01:21:57.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.aYSiM80gYbDsUfGEGcmDuzUUWRNoJJw_0 2024-09-12T01:21:57.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1322356441162723872', time=2024-09-12T03:08:49.276721+0000, chain.objs.size()=1 2024-09-12T01:21:57.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.n2-KY_6dUttU8vqkEEpp9CTieaQaOAA_0 2024-09-12T01:21:57.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7809302326052808974', time=2024-09-12T03:08:49.540158+0000, chain.objs.size()=1 2024-09-12T01:21:57.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.2EmhVUYdJyYzvTImknVTBTDxylN6fw1_0 2024-09-12T01:21:57.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3777691613773656230', time=2024-09-12T03:08:49.593397+0000, chain.objs.size()=1 2024-09-12T01:21:57.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.K417y4VANnMq3JBTbSzZioe1tspwF8V_0 2024-09-12T01:21:57.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16190190835275195828', time=2024-09-12T03:08:49.630506+0000, chain.objs.size()=1 2024-09-12T01:21:57.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.fruYDomAWmbEvz6V-sOAZopfGX3x-S6_0 2024-09-12T01:21:57.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2576573360820213933', time=2024-09-12T03:08:49.861300+0000, chain.objs.size()=1 2024-09-12T01:21:57.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.AcpZc8FWpnFgFulBJRjBWkni-Zj0kLj_0 2024-09-12T01:21:57.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2978480037734182865', time=2024-09-12T03:08:50.021874+0000, chain.objs.size()=1 2024-09-12T01:21:57.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.tdQdyeAafjEww2Bvm6-36MuXOz3W_NB_0 2024-09-12T01:21:57.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10797741139438346802', time=2024-09-12T03:08:50.051379+0000, chain.objs.size()=1 2024-09-12T01:21:57.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.D36aGIbn06uxBX1Wav4JtMwWbif6gAG_0 2024-09-12T01:21:57.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17627003915916227873', time=2024-09-12T03:08:50.663540+0000, chain.objs.size()=1 2024-09-12T01:21:57.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.264__shadow_.9Ac3KH2fZ-ZaCntv1L43u2zDC9-dUM9_0 2024-09-12T01:21:57.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15399672003912433134', time=2024-09-12T03:08:58.706140+0000, chain.objs.size()=1 2024-09-12T01:21:57.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.276__shadow_.j3sb4JVQkN94C3FULXK_RcByUGBpvdB_0 2024-09-12T01:21:57.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7493884776030885445', time=2024-09-12T03:09:03.676130+0000, chain.objs.size()=1 2024-09-12T01:21:57.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.283__shadow_.eHYfbQChO2zkvjHqCkipxbcznZoziQr_0 2024-09-12T01:21:57.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7848382380383855904', time=2024-09-12T03:09:03.678244+0000, chain.objs.size()=1 2024-09-12T01:21:57.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.283__shadow_.g5Zbq45_6ad1V3YBiz6YwmcNGO-F_SX_0 2024-09-12T01:21:57.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.865870690189824901', time=2024-09-12T03:09:07.822973+0000, chain.objs.size()=1 2024-09-12T01:21:57.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.289__shadow_.L2Oxs-k6uaiyKr9F-JTWVnPGtGcgprC_0 2024-09-12T01:21:57.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8036081870034228214', time=2024-09-12T03:09:13.019813+0000, chain.objs.size()=1 2024-09-12T01:21:57.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.294__shadow_.37rXwp-gAVXjbHgYpww71NmLKV3yuRf_0 2024-09-12T01:21:57.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14904599455840053156', time=2024-09-12T03:09:23.474829+0000, chain.objs.size()=1 2024-09-12T01:21:57.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.308__shadow:2H.IbdwxuvsVA0p7r5iAebE59MRIP4y_.Izg0KeHPhS6OJRX8dLuFdkP6QK92pWd_0 2024-09-12T01:21:57.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14520365520087599299', time=2024-09-12T03:09:53.043688+0000, chain.objs.size()=1 2024-09-12T01:21:57.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.nQ1EL77x4rm0B5lWNCOc6o5Y25Xd3Dg_0 2024-09-12T01:21:57.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16401087639852789013', time=2024-09-12T03:09:53.380022+0000, chain.objs.size()=1 2024-09-12T01:21:57.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.koDPfx6PPpYCG3SZVbve8OORY_SVCMy_0 2024-09-12T01:21:57.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3691876613043829769', time=2024-09-12T03:09:53.383938+0000, chain.objs.size()=1 2024-09-12T01:21:57.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.096+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.9_gXL99DGfdIExNZ6KcliqnJRw4g17M_0 2024-09-12T01:21:57.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.100+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5773743709911479182', time=2024-09-12T03:09:53.501535+0000, chain.objs.size()=1 2024-09-12T01:21:57.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.100+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.96QbOXyWvUSZhOmnN_jJyGB06HyNiDJ_0 2024-09-12T01:21:57.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.100+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18003969891937620181', time=2024-09-12T03:09:53.502273+0000, chain.objs.size()=1 2024-09-12T01:21:57.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.100+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Iy05aH6ZaHC0tN40xwsHYGubov5SvVQ_0 2024-09-12T01:21:57.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.100+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13246321903429081190', time=2024-09-12T03:09:53.625289+0000, chain.objs.size()=1 2024-09-12T01:21:57.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.100+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ErolPgh3zriaMZM9XW5zFBET86U967d_0 2024-09-12T01:21:57.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.100+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13338152980648326079', time=2024-09-12T03:09:53.714272+0000, chain.objs.size()=1 2024-09-12T01:21:57.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.100+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.0uysfI8emkdXcMPFluMFpRXS1_MJjmB_0 2024-09-12T01:21:57.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.100+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3293046883369105915', time=2024-09-12T03:09:53.721796+0000, chain.objs.size()=1 2024-09-12T01:21:57.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.100+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.3GB6w-ZGGY0s0UFyuJEUiNW7r7jxF-h_0 2024-09-12T01:21:57.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.100+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.347535416473926121', time=2024-09-12T03:09:53.732211+0000, chain.objs.size()=1 2024-09-12T01:21:57.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.100+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.2n1ZB7WbPOgw9kbgaF0NZBlSn16jaGe_0 2024-09-12T01:21:57.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.100+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3695496459135145930', time=2024-09-12T03:09:53.788252+0000, chain.objs.size()=1 2024-09-12T01:21:57.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.100+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.viRMaeBdTPtendh8GKVUxL2mwVP6ucY_0 2024-09-12T01:21:57.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.100+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7920754736952228361', time=2024-09-12T03:09:53.842783+0000, chain.objs.size()=1 2024-09-12T01:21:57.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.100+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.k2Y89qrtYs7P_WZR0IR27d0QI0Ny6d1_0 2024-09-12T01:21:57.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.100+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.420192318999838337', time=2024-09-12T03:09:54.158992+0000, chain.objs.size()=1 2024-09-12T01:21:57.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.100+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.HWm-AuZ_RAC9wlBnZ9DWvfmp0zQk3pP_0 2024-09-12T01:21:57.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.100+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18171872919245859037', time=2024-09-12T03:09:54.292164+0000, chain.objs.size()=1 2024-09-12T01:21:57.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.100+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.IhlXBOnSzOOu0QwsjrS40SioclSpXbf_0 2024-09-12T01:21:57.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.100+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15767996539042936941', time=2024-09-12T03:09:54.338631+0000, chain.objs.size()=1 2024-09-12T01:21:57.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.100+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.OqcVSyx3fIKmY1KB_EkQVKvjmZ5wMeL_0 2024-09-12T01:21:57.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.100+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.939939829816222554', time=2024-09-12T03:09:54.443365+0000, chain.objs.size()=1 2024-09-12T01:21:57.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.100+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.DRZ4TjhHY6yH08hWqc4_jssq6jHfY4n_0 2024-09-12T01:21:57.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.100+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12954789093966936519', time=2024-09-12T03:09:54.495262+0000, chain.objs.size()=1 2024-09-12T01:21:57.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.100+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.11KEKPtg1tIrVUFyEaNIpSealUMqOnY_0 2024-09-12T01:21:57.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5448823229864391707', time=2024-09-12T03:09:54.622998+0000, chain.objs.size()=1 2024-09-12T01:21:57.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.O5V8dz6YdQDGzoTZmEvoyv6f_r57Y17_0 2024-09-12T01:21:57.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9396718767356795838', time=2024-09-12T03:09:54.643898+0000, chain.objs.size()=1 2024-09-12T01:21:57.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.rXuq7VjYrF4AUitKzIjo6ua_K9JKcTf_0 2024-09-12T01:21:57.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15686045409175901937', time=2024-09-12T03:09:54.746840+0000, chain.objs.size()=1 2024-09-12T01:21:57.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.7zi62hRnToACpgkgVdlMwj2vvcVPW9h_0 2024-09-12T01:21:57.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7837288601350529605', time=2024-09-12T03:09:54.773187+0000, chain.objs.size()=1 2024-09-12T01:21:57.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Zpvj2r5mDyXUemT1M6v1GD6WL-dRaLf_0 2024-09-12T01:21:57.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1095736404924951660', time=2024-09-12T03:09:54.775807+0000, chain.objs.size()=1 2024-09-12T01:21:57.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.mwcP9XmVi5fuebSPVzfT4CNb5yRc1Fh_0 2024-09-12T01:21:57.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9296436927959418383', time=2024-09-12T03:09:54.796683+0000, chain.objs.size()=1 2024-09-12T01:21:57.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.k5lCNTAddF6wDE0iC_0Nnoc8EHPgd74_0 2024-09-12T01:21:57.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6273064677457768421', time=2024-09-12T03:09:54.812405+0000, chain.objs.size()=1 2024-09-12T01:21:57.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.yWkbMXs-BCq1drplTE6qRR7Z0iVR3Lz_0 2024-09-12T01:21:57.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14138856985750217614', time=2024-09-12T03:09:54.951776+0000, chain.objs.size()=1 2024-09-12T01:21:57.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.g7TMNWRz94LWGROJ0Q_5PhxUrabzaRv_0 2024-09-12T01:21:57.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10628241471313207046', time=2024-09-12T03:09:54.966148+0000, chain.objs.size()=1 2024-09-12T01:21:57.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.9zKOCpInObYSw7Trc3-YCkXBJZne6oY_0 2024-09-12T01:21:57.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14617804607907650397', time=2024-09-12T03:09:55.110306+0000, chain.objs.size()=1 2024-09-12T01:21:57.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.2kmkjzUCTfXt0qoOx434PAvpelYVANh_0 2024-09-12T01:21:57.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10255296758610323824', time=2024-09-12T03:09:55.113453+0000, chain.objs.size()=1 2024-09-12T01:21:57.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.SRRjYFXCw4UcsHwXh_ZfibAzcKyEnRf_0 2024-09-12T01:21:57.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15953928229942803798', time=2024-09-12T03:09:55.329910+0000, chain.objs.size()=1 2024-09-12T01:21:57.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.6rnORLpdfPcbHC0kg32PZoSepm3evZf_0 2024-09-12T01:21:57.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2951290010506975539', time=2024-09-12T03:09:55.347857+0000, chain.objs.size()=1 2024-09-12T01:21:57.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.d19KJTlIjMF7R5JQbwLxlmvy47gI7-9_0 2024-09-12T01:21:57.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.972975930954470663', time=2024-09-12T03:09:55.367478+0000, chain.objs.size()=1 2024-09-12T01:21:57.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.1saRlITVVDApPL1-wCRljwGpTQICq7c_0 2024-09-12T01:21:57.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1189634008945233373', time=2024-09-12T03:09:55.380557+0000, chain.objs.size()=1 2024-09-12T01:21:57.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.LT03lfy2pUGrI0pCpOejNXvF_QYUlYT_0 2024-09-12T01:21:57.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11403811560611731028', time=2024-09-12T03:10:15.305443+0000, chain.objs.size()=1 2024-09-12T01:21:57.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.NqjcbAWVYStBUZ2JYRrf_xYSPHFVOF5_0 2024-09-12T01:21:57.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14348847991816688605', time=2024-09-12T03:10:15.405061+0000, chain.objs.size()=1 2024-09-12T01:21:57.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.bgFC3S13JpCK2S2x7YJy96mIf0v8SCJ_0 2024-09-12T01:21:57.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10091849208474722001', time=2024-09-12T03:10:15.571844+0000, chain.objs.size()=1 2024-09-12T01:21:57.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.tBp1EmDBDfyQtZR_BM7NMUeupJ0ewML_0 2024-09-12T01:21:57.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13938546774286429841', time=2024-09-12T03:10:15.585313+0000, chain.objs.size()=1 2024-09-12T01:21:57.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ddg1Wy4PXih2II_aSAE86UX_JYNIk9W_0 2024-09-12T01:21:57.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.319231457139175488', time=2024-09-12T03:10:15.631230+0000, chain.objs.size()=1 2024-09-12T01:21:57.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.siDty9UzNtHn1DoqQVDqvEs92-Io4RK_0 2024-09-12T01:21:57.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7957003135840789585', time=2024-09-12T03:10:15.669344+0000, chain.objs.size()=1 2024-09-12T01:21:57.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.skNdwQTD1jfy3jXeWMfKEpYr84e-xtG_0 2024-09-12T01:21:57.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1513765561750835014', time=2024-09-12T03:10:15.688498+0000, chain.objs.size()=1 2024-09-12T01:21:57.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.104+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.fa-Rp3QDIdgeNzBWO5dnnzzBas74cBv_0 2024-09-12T01:21:57.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3296445244853667856', time=2024-09-12T03:10:15.922636+0000, chain.objs.size()=1 2024-09-12T01:21:57.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.UJmnxy46EbU5fQpU652yy2xpx3m_fTJ_0 2024-09-12T01:21:57.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7800390935764976561', time=2024-09-12T03:10:15.965231+0000, chain.objs.size()=1 2024-09-12T01:21:57.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.8Y2y3ef_V8t7qka1s9CYMhEbdupMEms_0 2024-09-12T01:21:57.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16863178010523278906', time=2024-09-12T03:10:15.976096+0000, chain.objs.size()=1 2024-09-12T01:21:57.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.BHI5sBE1SWc_faj9-oFPGMNIVQdsT-l_0 2024-09-12T01:21:57.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6720789588662092544', time=2024-09-12T03:10:15.980647+0000, chain.objs.size()=1 2024-09-12T01:21:57.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.gC84dZnsSiRcEnScNktZaJnMoLXILo5_0 2024-09-12T01:21:57.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13400330624280557470', time=2024-09-12T03:10:16.018699+0000, chain.objs.size()=1 2024-09-12T01:21:57.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.nEEgS5H7-Rmn_l5oDpA36nNaSk_jGzl_0 2024-09-12T01:21:57.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9217647264506957177', time=2024-09-12T03:10:16.069709+0000, chain.objs.size()=1 2024-09-12T01:21:57.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.aQvknGJsDHKLivFoFgVR8hKGwo0kyWq_0 2024-09-12T01:21:57.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11289921156872883077', time=2024-09-12T03:10:16.211753+0000, chain.objs.size()=1 2024-09-12T01:21:57.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.61CdxBX-sqxE0n6ppWlwzdpVNJX3WiZ_0 2024-09-12T01:21:57.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13367063273851012156', time=2024-09-12T03:10:16.219473+0000, chain.objs.size()=1 2024-09-12T01:21:57.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.e1u6ZdbOHX1ed6QAJp1AiVuMl0nxzYR_0 2024-09-12T01:21:57.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17415452643395528896', time=2024-09-12T03:10:16.318802+0000, chain.objs.size()=1 2024-09-12T01:21:57.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.DOsrISnlpw8S0SRnok2rO1HOKHJ2Ymb_0 2024-09-12T01:21:57.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13626333964960708513', time=2024-09-12T03:10:16.365880+0000, chain.objs.size()=1 2024-09-12T01:21:57.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.10pF66C6PqRMKZooefIWKA_2iJGUNjT_0 2024-09-12T01:21:57.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17270723957054681527', time=2024-09-12T03:10:16.601575+0000, chain.objs.size()=1 2024-09-12T01:21:57.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.3kAko43K0AU0dY7xujWUczd3ctoVKRP_0 2024-09-12T01:21:57.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4063341429496955336', time=2024-09-12T03:10:16.832795+0000, chain.objs.size()=1 2024-09-12T01:21:57.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.vXhEfaLPd971dy_n-J7NvQmX1YaGAOe_0 2024-09-12T01:21:57.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1264863428033950979', time=2024-09-12T03:10:16.888469+0000, chain.objs.size()=1 2024-09-12T01:21:57.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.q-HBZTbGw8H4c_FeFjeWIuLQ4j4FJ53_0 2024-09-12T01:21:57.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13641390017622600441', time=2024-09-12T03:10:16.940769+0000, chain.objs.size()=1 2024-09-12T01:21:57.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.klD5dOh1v9ro3G-SwKq1yaFhyZTWFa3_0 2024-09-12T01:21:57.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12847593789180792390', time=2024-09-12T03:10:16.968803+0000, chain.objs.size()=1 2024-09-12T01:21:57.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.108+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.QjXmxRsjsSIO5HFusaa4s4p-7xEJFx3_0 2024-09-12T01:21:57.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.112+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14332388770948724259', time=2024-09-12T03:10:16.982078+0000, chain.objs.size()=1 2024-09-12T01:21:57.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.112+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.pPBFRaXLLICiamFcVc3gzLfmKif1itm_0 2024-09-12T01:21:57.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.112+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16325600123422110796', time=2024-09-12T03:10:17.008878+0000, chain.objs.size()=1 2024-09-12T01:21:57.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.112+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.jtfZxhJ8PRwv3RWHGyjweYi51ehIM00_0 2024-09-12T01:21:57.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.112+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9154829253419594392', time=2024-09-12T03:10:17.145898+0000, chain.objs.size()=1 2024-09-12T01:21:57.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.112+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.WyQ8QmX4r9Sv-fJr0-XJHO3XNmBMPQc_0 2024-09-12T01:21:57.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.112+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13156074045148905951', time=2024-09-12T03:10:17.196457+0000, chain.objs.size()=1 2024-09-12T01:21:57.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.112+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.jdEeHN9_OyMeMBuPiuqXy4E2t1HshCw_0 2024-09-12T01:21:57.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.112+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10815278691151344621', time=2024-09-12T03:10:17.228947+0000, chain.objs.size()=1 2024-09-12T01:21:57.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.112+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.0EegC58RrEysJNDEVaGRzmbK_VL5olf_0 2024-09-12T01:21:57.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.112+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47159 2024-09-12T01:21:57.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-12T01:21:57.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10054912080420827823', time=2024-09-12T03:10:17.233656+0000, chain.objs.size()=1 2024-09-12T01:21:57.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.yA4CG9FPOakeMzEbkJwrePdXKXuLtzg_0 2024-09-12T01:21:57.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5053543288373688989', time=2024-09-12T03:10:17.284608+0000, chain.objs.size()=1 2024-09-12T01:21:57.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.7ShRjLdIR2rnRJncuLmCqYOpMnc6L8G_0 2024-09-12T01:21:57.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6761033641926260829', time=2024-09-12T03:10:17.299384+0000, chain.objs.size()=1 2024-09-12T01:21:57.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.fPxmf33V3g0oldSKE1eFPhaxN-MYoIV_0 2024-09-12T01:21:57.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9993368660244914987', time=2024-09-12T03:10:17.449538+0000, chain.objs.size()=1 2024-09-12T01:21:57.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_._dTgsFDp49KABkYckyo86Ef5_C6VKKA_0 2024-09-12T01:21:57.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12932039384706668499', time=2024-09-12T03:10:17.494971+0000, chain.objs.size()=1 2024-09-12T01:21:57.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.KIvLQbUW62xbJn18wW4gnvyF3QhdVw4_0 2024-09-12T01:21:57.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16093007035866496011', time=2024-09-12T03:10:17.547052+0000, chain.objs.size()=1 2024-09-12T01:21:57.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Sq0hhqi8wtYkhmez0OCB7SjQxdQkjYF_0 2024-09-12T01:21:57.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9498541685291853724', time=2024-09-12T03:10:17.555485+0000, chain.objs.size()=1 2024-09-12T01:21:57.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.H7HVfqsU1Ghjy81GmGbVd0QnbGP_ml8_0 2024-09-12T01:21:57.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9923284972219455386', time=2024-09-12T03:10:17.597927+0000, chain.objs.size()=1 2024-09-12T01:21:57.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.VXQ5omqBiqs2aWea35DNYKSgvQR9-CP_0 2024-09-12T01:21:57.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12742503636138832743', time=2024-09-12T03:10:17.901757+0000, chain.objs.size()=1 2024-09-12T01:21:57.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.niXLTKyE7tVCm0-UbM5IK1jFJ176l_4_0 2024-09-12T01:21:57.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6952287038666523129', time=2024-09-12T03:10:50.519053+0000, chain.objs.size()=1 2024-09-12T01:21:57.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.378__shadow_.Q22fDJWTxQkCWX7rz9pz-6rbA1hqRLi_0 2024-09-12T01:21:57.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2397895273610880320', time=2024-09-12T03:10:51.299993+0000, chain.objs.size()=1 2024-09-12T01:21:57.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.379__shadow_.iwJblKrnJngaRfLY4FkNuYQBtLhC7Px_0 2024-09-12T01:21:57.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3513918172563867757', time=2024-09-12T03:10:59.765874+0000, chain.objs.size()=1 2024-09-12T01:21:57.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.391__shadow_.-C_79eRCf0VZ2ZofdslxgzpgSOyBQjF_0 2024-09-12T01:21:57.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12279262316895491182', time=2024-09-12T03:11:27.399576+0000, chain.objs.size()=1 2024-09-12T01:21:57.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.430__shadow_.qXppx5Xz6bz6n7qKymMNdU9tYE11H80_0 2024-09-12T01:21:57.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6233069425006116516', time=2024-09-12T03:12:18.175309+0000, chain.objs.size()=1 2024-09-12T01:21:57.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.504__shadow:fzRg7xrdrpV0hjFUnNiyrRjat2TjEPZ_.vHz-mc05LslsPFizOQCh8qlCeQstO_b_0 2024-09-12T01:21:57.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12172190815510445697', time=2024-09-12T03:14:17.880726+0000, chain.objs.size()=1 2024-09-12T01:21:57.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.571__shadow:q3F2VvEagaH8XqoVavWxmOChn2PIivb_.wd6vAbhwbvNEXRMUEb1Ez61IAcGPIAQ_0 2024-09-12T01:21:57.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5131367485014907783', time=2024-09-12T03:14:25.698923+0000, chain.objs.size()=1 2024-09-12T01:21:57.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.576__shadow_.4YOpbpW458d3pG9fmqSaDpekGg90GX9_0 2024-09-12T01:21:57.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12960626120458585619', time=2024-09-12T03:14:41.976330+0000, chain.objs.size()=1 2024-09-12T01:21:57.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:claa3XcnYiLWCL3lasjITE52oaupZO4_._PnnlfS8--8mexc5-kOWaXuqgGhI26G_0 2024-09-12T01:21:57.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9865112872202400315', time=2024-09-12T03:14:43.117666+0000, chain.objs.size()=1 2024-09-12T01:21:57.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:HhcwW6sihNhuk4uEqszpjFT7crYK3oz_.dVJaHp3NecjwefBf10JOeYZuOQZj7Jl_0 2024-09-12T01:21:57.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17461977055292380860', time=2024-09-12T03:14:53.626118+0000, chain.objs.size()=1 2024-09-12T01:21:57.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.581__shadow:W19j6HeAodlX9np4sXn.lWER--gj6zC_.rlE_sY18r6jtV4q0rKV0vhLCr7tBM8S_0 2024-09-12T01:21:57.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1691510274395712654', time=2024-09-12T03:14:53.627792+0000, chain.objs.size()=1 2024-09-12T01:21:57.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.581__shadow:8QYw-jrzGAJKN0blYPZkhu3EIhFEtdX_.gyODW4f5lIAJKpw6DMEb3V8hga8I3UB_0 2024-09-12T01:21:57.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17905592292732029534', time=2024-09-12T03:14:53.780417+0000, chain.objs.size()=1 2024-09-12T01:21:57.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.581__shadow:Hlpx7f3Y0G1KYveYpJ3BijpqIMDT--x_.G1FB6asNJW3t2HG3PI-GPOtFeAO4_oE_0 2024-09-12T01:21:57.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13537111177366831894', time=2024-09-12T03:14:57.388735+0000, chain.objs.size()=1 2024-09-12T01:21:57.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.586__shadow:aUoNzgrdYKBfjI0G4cZaGkvDE.BPqEh_.ndfXeYj3dsXmqTsz0HPYgkmTyJLF_E4_0 2024-09-12T01:21:57.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16605744452363730366', time=2024-09-12T03:15:09.351360+0000, chain.objs.size()=1 2024-09-12T01:21:57.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.116+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.605__shadow_.TLjm778xAU6ggp2C6HLU9AhFDDsDHHr_0 2024-09-12T01:21:57.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.120+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3073241035721658640', time=2024-09-12T03:17:36.191573+0000, chain.objs.size()=6 2024-09-12T01:21:57.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.120+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.624__multipart_multipart_enc.2~dpkC2hPHhyYbL9sCSAuO3gmhlKwoK1T.1 2024-09-12T01:21:57.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.120+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.624__multipart_multipart_enc.2~dpkC2hPHhyYbL9sCSAuO3gmhlKwoK1T.2 2024-09-12T01:21:57.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.120+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.624__multipart_multipart_enc.2~dpkC2hPHhyYbL9sCSAuO3gmhlKwoK1T.3 2024-09-12T01:21:57.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.120+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.624__multipart_multipart_enc.2~dpkC2hPHhyYbL9sCSAuO3gmhlKwoK1T.4 2024-09-12T01:21:57.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.120+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.624__multipart_multipart_enc.2~dpkC2hPHhyYbL9sCSAuO3gmhlKwoK1T.5 2024-09-12T01:21:57.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.120+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.624__multipart_multipart_enc.2~dpkC2hPHhyYbL9sCSAuO3gmhlKwoK1T.6 2024-09-12T01:21:57.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.120+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8335990762346252376', time=2024-09-12T03:18:02.459474+0000, chain.objs.size()=1 2024-09-12T01:21:57.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.120+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.657__shadow_.sUcyc8ZlqYuBD7KTj_cGoKr0307iBhp_0 2024-09-12T01:21:57.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.120+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17908110346535846391', time=2024-09-12T03:18:11.320090+0000, chain.objs.size()=1 2024-09-12T01:21:57.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.120+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.667__shadow_.k2hpU9y5zh1QLJJViNkkf4KsirBTwaO_0 2024-09-12T01:21:57.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.120+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8592822266606285107', time=2024-09-12T03:18:34.923978+0000, chain.objs.size()=1 2024-09-12T01:21:57.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.120+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.707__shadow_._YY5cnkz_xISaHY3_4XNtHGGU3i9Uci_0 2024-09-12T01:21:57.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.120+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15442150252223006671', time=2024-09-12T03:18:36.302819+0000, chain.objs.size()=1 2024-09-12T01:21:57.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.120+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.709__shadow:u2pZMdOWeUXtC9we-6tfg2YfRpM96-y_.mVtjWuQqBjibtGk6ZTBwS3xc8GCoHri_0 2024-09-12T01:21:57.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.124+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:57.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.128+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:21:57.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.128+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:57.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.128+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:57.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.128+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45999' 2024-09-12T01:21:57.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.128+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_QMBiBm8JSrf-VMuG_qyxzVsPuLPMgKs', time=2024-09-12T03:05:59.853684+0000, chain.objs.size()=2 2024-09-12T01:21:57.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.128+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.161__shadow_.ccLqzJ8o1_pPSFMta_4hROYqmXrO6za_0 2024-09-12T01:21:57.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.128+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.161__shadow_.ccLqzJ8o1_pPSFMta_4hROYqmXrO6za_1 2024-09-12T01:21:57.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.128+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_Ft7yz5Y1QSDFj3VsSEreWTHusF0GeJX', time=2024-09-12T03:06:02.483890+0000, chain.objs.size()=2 2024-09-12T01:21:57.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.128+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.162__shadow_.kMsA95bScREz4HOis4QFtg-MM5zOOsB_0 2024-09-12T01:21:57.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.128+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.162__shadow_.kMsA95bScREz4HOis4QFtg-MM5zOOsB_1 2024-09-12T01:21:57.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.128+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18322566341782794963', time=2024-09-12T03:06:03.449104+0000, chain.objs.size()=1 2024-09-12T01:21:57.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.128+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.163__shadow_.Q_B1H0jP__WfHFCFEQVrLWXsqsnK9xv_0 2024-09-12T01:21:57.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.128+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_dflv-mIHbSywpXItC7Hd7VyhwjvWVv4', time=2024-09-12T03:06:04.635005+0000, chain.objs.size()=1 2024-09-12T01:21:57.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.128+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.166__shadow_.AfVR9GdNPRoDsLDvh5tzOLY-3CS-cON_0 2024-09-12T01:21:57.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.128+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12369906161374213709', time=2024-09-12T03:06:04.838154+0000, chain.objs.size()=1 2024-09-12T01:21:57.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.128+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.167__shadow_.akB_sZ_SyApoOmcnron-W03nU3TMd6v_0 2024-09-12T01:21:57.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.128+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6119061237309906068', time=2024-09-12T03:06:14.739443+0000, chain.objs.size()=1 2024-09-12T01:21:57.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.128+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.178__shadow_.SbCdRt1vjCuBC_qusgCaunUBYVTkgPs_0 2024-09-12T01:21:57.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.128+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6621344215723712178', time=2024-09-12T03:08:07.699328+0000, chain.objs.size()=1 2024-09-12T01:21:57.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.128+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.235__shadow_.dQ_1i9A9d0cp4KFr-7Uks0vxQOxqAbs_0 2024-09-12T01:21:57.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.128+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17633126587885631862', time=2024-09-12T03:08:15.294982+0000, chain.objs.size()=1 2024-09-12T01:21:57.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.128+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.244__shadow_.tbQd596_ltrViMfAmcI3SvTqQokIcEP_0 2024-09-12T01:21:57.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.128+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6459832785424121948', time=2024-09-12T03:08:16.455129+0000, chain.objs.size()=1 2024-09-12T01:21:57.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.128+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.245__shadow_.8Xbs4pZ8aNgT2uMSEYN2eKkq5kn7ohN_0 2024-09-12T01:21:57.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.128+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11387364952013927151', time=2024-09-12T03:08:22.671491+0000, chain.objs.size()=1 2024-09-12T01:21:57.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.128+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.254__shadow_.osUwf05vpCFVonK9bGHXQPd_F6YY5h5_0 2024-09-12T01:21:57.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.132+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13678021474756981893', time=2024-09-12T03:08:24.044609+0000, chain.objs.size()=1 2024-09-12T01:21:57.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.132+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.256__shadow_.Ct8797xDNDkrd0uCJT9UlNQIvgn5KQC_0 2024-09-12T01:21:57.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.132+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6560300611245748727', time=2024-09-12T03:08:47.517890+0000, chain.objs.size()=1 2024-09-12T01:21:57.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.132+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.KbyMC3KSDov69CibZu5NdPFWVtzD8pX_0 2024-09-12T01:21:57.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.132+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17124091676919650091', time=2024-09-12T03:08:47.541668+0000, chain.objs.size()=1 2024-09-12T01:21:57.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.132+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.3d0jFx0LGjclxLojRWE-fDa7HLlEU90_0 2024-09-12T01:21:57.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.132+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11309464132556528511', time=2024-09-12T03:08:47.629798+0000, chain.objs.size()=1 2024-09-12T01:21:57.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.132+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.gsDy37n9YJ09lMagpdDKPjsiOdbWZhk_0 2024-09-12T01:21:57.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.132+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13481692318960721687', time=2024-09-12T03:08:47.648255+0000, chain.objs.size()=1 2024-09-12T01:21:57.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.132+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.lO7B5uxuX7UYod50japaqUb2XhJ5NA__0 2024-09-12T01:21:57.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.132+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9680828213217580809', time=2024-09-12T03:08:47.954224+0000, chain.objs.size()=1 2024-09-12T01:21:57.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.132+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.GgKAGiIahg8lHvKVR6F6Z2xis0ketui_0 2024-09-12T01:21:57.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.132+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6333139533743814083', time=2024-09-12T03:08:48.220299+0000, chain.objs.size()=1 2024-09-12T01:21:57.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.132+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.w4pIuvkkVPiz5Q5kLB0biuELnHsRMfa_0 2024-09-12T01:21:57.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.132+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.507948816906827509', time=2024-09-12T03:08:48.228283+0000, chain.objs.size()=1 2024-09-12T01:21:57.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.132+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.RaifHkHgXnUYWDAP5Snq1EOCEru6ScT_0 2024-09-12T01:21:57.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.132+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10232637051094041034', time=2024-09-12T03:08:48.291461+0000, chain.objs.size()=1 2024-09-12T01:21:57.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.132+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.1_jpvNEJvRWG4YSFQckL3_EibtWB-b6_0 2024-09-12T01:21:57.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.132+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3152825143344235824', time=2024-09-12T03:08:48.315339+0000, chain.objs.size()=1 2024-09-12T01:21:57.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.132+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.8aaZNFnBraP_WpEgGhEDocUH6Gi1YRO_0 2024-09-12T01:21:57.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.132+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4861555669818497383', time=2024-09-12T03:08:48.325651+0000, chain.objs.size()=1 2024-09-12T01:21:57.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.132+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.qIeMf1F-Dna6OT4m0rXFQEn3l1GcW6T_0 2024-09-12T01:21:57.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6274123386591162833', time=2024-09-12T03:08:48.331265+0000, chain.objs.size()=1 2024-09-12T01:21:57.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.nwE7EZbGkoUiPkNP5MuXQ2gDzJmpf0w_0 2024-09-12T01:21:57.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.873161183643156585', time=2024-09-12T03:08:48.339817+0000, chain.objs.size()=1 2024-09-12T01:21:57.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.wnaWdg2ghGFGRrFe9WjjRj77l1PgT3q_0 2024-09-12T01:21:57.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9375758948184193282', time=2024-09-12T03:08:48.348440+0000, chain.objs.size()=1 2024-09-12T01:21:57.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.lceL17XnMms0PhOPZsM3kOSYXKUwCJi_0 2024-09-12T01:21:57.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6304385194171525319', time=2024-09-12T03:08:48.358066+0000, chain.objs.size()=1 2024-09-12T01:21:57.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ynxzkwhRDIDyZ9c1Ng1FD8mhN0jNJZq_0 2024-09-12T01:21:57.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15743754473735266154', time=2024-09-12T03:08:48.634047+0000, chain.objs.size()=1 2024-09-12T01:21:57.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.4CFW4FueDJMopq-tVii_7WYVOOmKCfO_0 2024-09-12T01:21:57.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3981038665758228853', time=2024-09-12T03:08:48.666465+0000, chain.objs.size()=1 2024-09-12T01:21:57.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Yi6i0AlknEGzLZSRmZ2urC2GYhP0YA7_0 2024-09-12T01:21:57.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16405040019946767671', time=2024-09-12T03:08:48.947067+0000, chain.objs.size()=1 2024-09-12T01:21:57.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.PemcoLvKYe73D_nOw3LJ8c1aK2rvnnd_0 2024-09-12T01:21:57.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8443348568491708627', time=2024-09-12T03:08:48.999510+0000, chain.objs.size()=1 2024-09-12T01:21:57.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.CLyo7ZtR6H2yqTy4ur1XpyWQ_niT1ek_0 2024-09-12T01:21:57.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15838330883321270702', time=2024-09-12T03:08:49.036211+0000, chain.objs.size()=1 2024-09-12T01:21:57.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.0r4ATT2sh2_4d4TPr0U9ZJKA2I4eBCG_0 2024-09-12T01:21:57.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5889509923083616674', time=2024-09-12T03:08:49.043302+0000, chain.objs.size()=1 2024-09-12T01:21:57.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.FPU3zTOT-0t9gcgIz-yVnyWsW_6YigA_0 2024-09-12T01:21:57.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2152081687930705275', time=2024-09-12T03:08:49.046179+0000, chain.objs.size()=1 2024-09-12T01:21:57.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.qooEd8qnElRfGq_0VZb7WRO3Bu4t1pj_0 2024-09-12T01:21:57.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2086200860157078152', time=2024-09-12T03:08:49.179179+0000, chain.objs.size()=1 2024-09-12T01:21:57.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.eyv6SQvVV5KtZJ-aBpsb-HLvWxLNlIX_0 2024-09-12T01:21:57.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18278063417159995860', time=2024-09-12T03:08:49.231913+0000, chain.objs.size()=1 2024-09-12T01:21:57.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.z5HFKzY2-jxIqcgecUZN4Vtz98EBpWx_0 2024-09-12T01:21:57.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11837211855660988182', time=2024-09-12T03:08:49.284727+0000, chain.objs.size()=1 2024-09-12T01:21:57.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.QkHbkVL_kzGNdFdR9VHTar8FhRbeQuh_0 2024-09-12T01:21:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7873198949307764575', time=2024-09-12T03:08:49.314481+0000, chain.objs.size()=1 2024-09-12T01:21:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.136+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.KMYltVD8Rx3JnrKzfZ1oheIfbNuZ4RF_0 2024-09-12T01:21:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7192520316501735665', time=2024-09-12T03:08:49.583141+0000, chain.objs.size()=1 2024-09-12T01:21:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.KrHrwJusEeTATeNdpKZWUrIT0844Rbw_0 2024-09-12T01:21:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15561205179801593636', time=2024-09-12T03:08:49.727586+0000, chain.objs.size()=1 2024-09-12T01:21:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.rJywdEc5Y6Ou2d-bsZ4yHdC0ECrwdUd_0 2024-09-12T01:21:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2484505130830926542', time=2024-09-12T03:08:49.877489+0000, chain.objs.size()=1 2024-09-12T01:21:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.OurUx-R0j-DIdmjL0OJ5iGiT4vgqpCb_0 2024-09-12T01:21:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15972827646985644680', time=2024-09-12T03:08:49.946382+0000, chain.objs.size()=1 2024-09-12T01:21:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.SYvBxuTHJuFDpFlbm_8dYCN8szOf7Qq_0 2024-09-12T01:21:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4601892237383421414', time=2024-09-12T03:08:49.953591+0000, chain.objs.size()=1 2024-09-12T01:21:57.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.gsKKiGL_0gaJGaGvSLuxgz6q09spgT0_0 2024-09-12T01:21:57.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15950891713694587351', time=2024-09-12T03:08:55.355572+0000, chain.objs.size()=1 2024-09-12T01:21:57.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.271__shadow_.8v3PqdctWeWQI9RRL6kRM167fN4WN2j_0 2024-09-12T01:21:57.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4201275057181529898', time=2024-09-12T03:09:52.933855+0000, chain.objs.size()=1 2024-09-12T01:21:57.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Xtc6OZGnMt3dAJje0Vzww5pMOCPi5i0_0 2024-09-12T01:21:57.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11067835885671973111', time=2024-09-12T03:09:53.001055+0000, chain.objs.size()=1 2024-09-12T01:21:57.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.J2Q7CYZQ0PQ9er4VoPQvWeZrrcXG4pX_0 2024-09-12T01:21:57.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6796461040654087470', time=2024-09-12T03:09:53.032078+0000, chain.objs.size()=1 2024-09-12T01:21:57.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_._YreCthkytwI6KRw2AqXzKi2s0SklOx_0 2024-09-12T01:21:57.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12903537339930116340', time=2024-09-12T03:09:53.037446+0000, chain.objs.size()=1 2024-09-12T01:21:57.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Iqu28vEtA7XFdwns88aSjOVFE9AMZX7_0 2024-09-12T01:21:57.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15101623972283045180', time=2024-09-12T03:09:53.047937+0000, chain.objs.size()=1 2024-09-12T01:21:57.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Czm7b_iyO6fhb3qAdo9ypASq-V3-NUx_0 2024-09-12T01:21:57.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.829328543304282813', time=2024-09-12T03:09:53.056337+0000, chain.objs.size()=1 2024-09-12T01:21:57.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.j2D0aA4VHUU27SA-33_ooR0zzlOBG-o_0 2024-09-12T01:21:57.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8297873922098455854', time=2024-09-12T03:09:53.107148+0000, chain.objs.size()=1 2024-09-12T01:21:57.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.UJWKASuU9YcUWoHdn9OYdTEUuulpOr9_0 2024-09-12T01:21:57.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17932121310729768036', time=2024-09-12T03:09:53.133980+0000, chain.objs.size()=1 2024-09-12T01:21:57.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.nh-IWN-oaM6t8ghOOFciZdgk2KIJMCF_0 2024-09-12T01:21:57.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9319260174077715288', time=2024-09-12T03:09:53.139736+0000, chain.objs.size()=1 2024-09-12T01:21:57.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.t3SIMqeEVOMVZs33FOoV4mydZ5ofESu_0 2024-09-12T01:21:57.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5881371920723975381', time=2024-09-12T03:09:53.289353+0000, chain.objs.size()=1 2024-09-12T01:21:57.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.TAc1ALICGVLBAQ1LO09sDmi5xqeTmT7_0 2024-09-12T01:21:57.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.237185306819596593', time=2024-09-12T03:09:53.496575+0000, chain.objs.size()=1 2024-09-12T01:21:57.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Y2K_aKlYhmG4kWjq7y_K_YZeDtq0sgK_0 2024-09-12T01:21:57.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6421475616253096131', time=2024-09-12T03:09:53.501867+0000, chain.objs.size()=1 2024-09-12T01:21:57.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Ut6D0mLrlM7W87vBBZfJK-j-b2NDagi_0 2024-09-12T01:21:57.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6601006385697330630', time=2024-09-12T03:09:53.692304+0000, chain.objs.size()=1 2024-09-12T01:21:57.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.b6-FnQYkmSka8u3SS8J7B1F145RYoeb_0 2024-09-12T01:21:57.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5581342134873932778', time=2024-09-12T03:09:53.705109+0000, chain.objs.size()=1 2024-09-12T01:21:57.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Z90htJ5aeTqPImRsymF9t_MaNsPI0RV_0 2024-09-12T01:21:57.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18166529940265959370', time=2024-09-12T03:09:53.714512+0000, chain.objs.size()=1 2024-09-12T01:21:57.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.uuk1HY4l2c9zE889XB4vsBMYcGp8vFB_0 2024-09-12T01:21:57.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11181664621787795908', time=2024-09-12T03:09:53.725111+0000, chain.objs.size()=1 2024-09-12T01:21:57.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.140+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.5YLixBJ-J_bHZMfsbwkNeaxw6JE1og-_0 2024-09-12T01:21:57.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.144+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17480573204468732729', time=2024-09-12T03:09:53.726144+0000, chain.objs.size()=1 2024-09-12T01:21:57.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.144+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.GuL948YLeifdVj4EinIsXsgSBstUzJb_0 2024-09-12T01:21:57.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.144+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6494386102075016752', time=2024-09-12T03:09:53.814278+0000, chain.objs.size()=1 2024-09-12T01:21:57.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.144+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.FrbLb4T7vMzG42s_2Zu-3iZtn7yF3m3_0 2024-09-12T01:21:57.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.144+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11236667732696190321', time=2024-09-12T03:09:54.020780+0000, chain.objs.size()=1 2024-09-12T01:21:57.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.144+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.rW1NZnzVVbQ1wd4eYoE_4zhyyl3ZHun_0 2024-09-12T01:21:57.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.144+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16770170577653322906', time=2024-09-12T03:09:54.040515+0000, chain.objs.size()=1 2024-09-12T01:21:57.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.144+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.4NWJnWlUWfe-JJm3s_zFmkvQO4cGHmZ_0 2024-09-12T01:21:57.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.144+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4872651916329860985', time=2024-09-12T03:09:54.086831+0000, chain.objs.size()=1 2024-09-12T01:21:57.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.144+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.7BhmW77yR-1ijwzXjwSH-WOYDwMJII4_0 2024-09-12T01:21:57.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.144+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8862287178874501987', time=2024-09-12T03:09:54.102584+0000, chain.objs.size()=1 2024-09-12T01:21:57.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.144+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.S0MtNCfqK6I0rEfwV3nO6AJ5Q3fC_ub_0 2024-09-12T01:21:57.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.144+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.550843875727857881', time=2024-09-12T03:09:54.103194+0000, chain.objs.size()=1 2024-09-12T01:21:57.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.144+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Adm8UmPbENKWQrpPPnMLpdZtegO0cIy_0 2024-09-12T01:21:57.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.144+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15670009091277179587', time=2024-09-12T03:09:54.337211+0000, chain.objs.size()=1 2024-09-12T01:21:57.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.144+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.MJG2YghJ-UkqOdXZP7TOiUvoV4CDQOT_0 2024-09-12T01:21:57.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.144+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6652843769550235686', time=2024-09-12T03:09:54.344522+0000, chain.objs.size()=1 2024-09-12T01:21:57.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.144+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.hWcNGHhHbo5-5EDOMGO-8kRZmXFWeVh_0 2024-09-12T01:21:57.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.144+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8170150748528326042', time=2024-09-12T03:09:54.620957+0000, chain.objs.size()=1 2024-09-12T01:21:57.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.144+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.CCJV1zvthtyrcRo6ptVgIUnkullBjUo_0 2024-09-12T01:21:57.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.144+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9019945301866012261', time=2024-09-12T03:09:54.676361+0000, chain.objs.size()=1 2024-09-12T01:21:57.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.144+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.0wgSLUXtqNDpKarxcf7TdqXP9tI1B_O_0 2024-09-12T01:21:57.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.144+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6927114454969998859', time=2024-09-12T03:09:54.695675+0000, chain.objs.size()=1 2024-09-12T01:21:57.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.144+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.zVpFzG7sxcwBx-8MNDEDVyzoq8yn87W_0 2024-09-12T01:21:57.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.144+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.890762511824607598', time=2024-09-12T03:09:54.749585+0000, chain.objs.size()=1 2024-09-12T01:21:57.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.144+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.rPiVgJw9vPNXzAl-csw6qKWts4NabEM_0 2024-09-12T01:21:57.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10807843415364972130', time=2024-09-12T03:09:54.829262+0000, chain.objs.size()=1 2024-09-12T01:21:57.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.paPfVurYywjB6QpH15SfYXCvxxIsF5a_0 2024-09-12T01:21:57.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6146266599837848267', time=2024-09-12T03:09:55.044939+0000, chain.objs.size()=1 2024-09-12T01:21:57.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.8txUMwLOJ77a-6iWgvsqJDUae_jd_tu_0 2024-09-12T01:21:57.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16382200231632464501', time=2024-09-12T03:09:55.102428+0000, chain.objs.size()=1 2024-09-12T01:21:57.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.b5ieXwZ38e-sM0GwUIUKrCO2vzI7kiT_0 2024-09-12T01:21:57.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6946467666776098142', time=2024-09-12T03:09:55.129395+0000, chain.objs.size()=1 2024-09-12T01:21:57.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.XgTV0KPTNmVtVcQ43zmxm137EZhijk4_0 2024-09-12T01:21:57.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8197494004207872630', time=2024-09-12T03:09:55.159870+0000, chain.objs.size()=1 2024-09-12T01:21:57.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.MUOAvfBwJ-3O3W-cRaAKC2UaBcX7P-i_0 2024-09-12T01:21:57.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9782749198908325393', time=2024-09-12T03:10:15.625959+0000, chain.objs.size()=1 2024-09-12T01:21:57.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.8z5nYN_RzdOWKOOqlvDvouXYhKRBhp__0 2024-09-12T01:21:57.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12024393651672139882', time=2024-09-12T03:10:16.081210+0000, chain.objs.size()=1 2024-09-12T01:21:57.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.M73abcvMR3E42NdlJFqBfRoaLez67dF_0 2024-09-12T01:21:57.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1026802565952128597', time=2024-09-12T03:10:16.245283+0000, chain.objs.size()=1 2024-09-12T01:21:57.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.lmHiDAqHAPWbjIoPoNQkYmLL-ByIR3X_0 2024-09-12T01:21:57.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8962410124713345166', time=2024-09-12T03:10:16.247624+0000, chain.objs.size()=1 2024-09-12T01:21:57.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.oz5RBarr9MEKls9S0lM4Ehux2FIjEbK_0 2024-09-12T01:21:57.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9039368728346939638', time=2024-09-12T03:10:16.249254+0000, chain.objs.size()=1 2024-09-12T01:21:57.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.DWoI53jW68oHCgUpiID-A2jYT4p9sZD_0 2024-09-12T01:21:57.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14467903361780368888', time=2024-09-12T03:10:16.339367+0000, chain.objs.size()=1 2024-09-12T01:21:57.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.qZiXlvcYDfwnBLRtz4x2g_pil91P6bI_0 2024-09-12T01:21:57.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5757350584812457270', time=2024-09-12T03:10:16.844491+0000, chain.objs.size()=1 2024-09-12T01:21:57.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.5rjw5QGHszNUT5JLpYUgB4-2sb-SgSP_0 2024-09-12T01:21:57.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3998077651618524127', time=2024-09-12T03:10:16.850211+0000, chain.objs.size()=1 2024-09-12T01:21:57.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.yBHZ1Ci0vK_ueSYy1LN5gf9-KcAAUDZ_0 2024-09-12T01:21:57.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16952131542362841126', time=2024-09-12T03:10:16.929440+0000, chain.objs.size()=1 2024-09-12T01:21:57.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.o-tjBQ1znEsFi02HqvEGPpJ6gKMkF9i_0 2024-09-12T01:21:57.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16276419388757275117', time=2024-09-12T03:10:16.940457+0000, chain.objs.size()=1 2024-09-12T01:21:57.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.W64qLeNSzmvoYe6mtcxrTsu-_-LqaTW_0 2024-09-12T01:21:57.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18205857298601706939', time=2024-09-12T03:10:16.983148+0000, chain.objs.size()=1 2024-09-12T01:21:57.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.q5tNE2tgz1EmyK10BB_vCKDsY_YBMIa_0 2024-09-12T01:21:57.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3885522205028859955', time=2024-09-12T03:10:17.161101+0000, chain.objs.size()=1 2024-09-12T01:21:57.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ofIgXtbEXLmpG4gCz4emd_L2B3aMtHp_0 2024-09-12T01:21:57.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9586814072937699792', time=2024-09-12T03:10:17.162026+0000, chain.objs.size()=1 2024-09-12T01:21:57.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.tRWfizEtc2uf0t8U-oDBIoTvRkgrgiO_0 2024-09-12T01:21:57.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1754299560517016111', time=2024-09-12T03:10:17.216468+0000, chain.objs.size()=1 2024-09-12T01:21:57.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.wpsFVn4nQTjXyplb5Xj7mrb1QdVexGM_0 2024-09-12T01:21:57.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10550619113944581622', time=2024-09-12T03:10:17.287405+0000, chain.objs.size()=1 2024-09-12T01:21:57.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.FGcVGZy_4uHXP-KlszMgS5-lcgaC-Xj_0 2024-09-12T01:21:57.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10986426464941741422', time=2024-09-12T03:10:17.437445+0000, chain.objs.size()=1 2024-09-12T01:21:57.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.oB6M9bynWRhr6GGrSRjACQacLESNQrM_0 2024-09-12T01:21:57.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8539665140644905777', time=2024-09-12T03:10:17.461560+0000, chain.objs.size()=1 2024-09-12T01:21:57.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.RUGNOz-xZspeNosKkLoIj-YNmCDZAxP_0 2024-09-12T01:21:57.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2489246075238780865', time=2024-09-12T03:10:17.523631+0000, chain.objs.size()=1 2024-09-12T01:21:57.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.J27FkGRCFCm2h5244M1Syg3a2kA4tl7_0 2024-09-12T01:21:57.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4151829187815749127', time=2024-09-12T03:10:17.524244+0000, chain.objs.size()=1 2024-09-12T01:21:57.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.148+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.y7mCpuNZYVyKtmuM3e8g0tabLFfBlaV_0 2024-09-12T01:21:57.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.152+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2626567321694144335', time=2024-09-12T03:10:17.541331+0000, chain.objs.size()=1 2024-09-12T01:21:57.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.152+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.mxZiL4dZOFPHR-u2IX3pDG9No9_sypg_0 2024-09-12T01:21:57.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.152+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16749073799491813016', time=2024-09-12T03:10:17.577136+0000, chain.objs.size()=1 2024-09-12T01:21:57.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.152+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.SUdhMZlmJcpvgktC5NKSyc_kX7KXtl1_0 2024-09-12T01:21:57.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.152+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11354606821186831715', time=2024-09-12T03:10:17.581181+0000, chain.objs.size()=1 2024-09-12T01:21:57.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.152+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.TwLVeZrVus83TGIUIf4Zul-V0OXuIQ-_0 2024-09-12T01:21:57.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.152+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14812274099179026716', time=2024-09-12T03:10:17.586231+0000, chain.objs.size()=1 2024-09-12T01:21:57.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.152+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.fU2A8NtcUraWOWheLwZemqGOe-015qz_0 2024-09-12T01:21:57.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.152+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3068566569337827385', time=2024-09-12T03:10:17.829979+0000, chain.objs.size()=1 2024-09-12T01:21:57.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.152+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.vjqdIJ08ZQXfh-3VtMy7H4H6yKA60f3_0 2024-09-12T01:21:57.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.152+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45999 2024-09-12T01:21:57.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T01:21:57.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7618802407764038031', time=2024-09-12T03:10:17.881904+0000, chain.objs.size()=1 2024-09-12T01:21:57.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.nGZxsbpyEbYuCBZAtW_0N4UmV1AqC1y_0 2024-09-12T01:21:57.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2883941591661186451', time=2024-09-12T03:10:17.907370+0000, chain.objs.size()=1 2024-09-12T01:21:57.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.I7-uL4e-rG--8saniTKMWluBxXq9N_T_0 2024-09-12T01:21:57.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18299592006122609984', time=2024-09-12T03:10:43.050666+0000, chain.objs.size()=1 2024-09-12T01:21:57.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.368__shadow_.lPI6Ku63aozE6ZIvtcyFJjMLWIzry-C_0 2024-09-12T01:21:57.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1260373051831469049', time=2024-09-12T03:10:48.550703+0000, chain.objs.size()=1 2024-09-12T01:21:57.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.375__shadow_.skoM7yHSQWNN3bWhnOPNJWCRkdsyUJO_0 2024-09-12T01:21:57.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13322482747151826639', time=2024-09-12T03:11:54.421155+0000, chain.objs.size()=1 2024-09-12T01:21:57.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.464__shadow_.pFOEc1ijR6JrxSoBjByY_vLi-xR6-Mc_0 2024-09-12T01:21:57.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5036823777565801519', time=2024-09-12T03:11:57.062691+0000, chain.objs.size()=1 2024-09-12T01:21:57.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.467__shadow_.a-iqtfaqJGLcJXRWRxjmPwDX4f9MtI3_0 2024-09-12T01:21:57.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13012033497410750155', time=2024-09-12T03:12:05.022858+0000, chain.objs.size()=1 2024-09-12T01:21:57.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.484__shadow_.q56g2MzDIAUkjzE9jxN0FEtPdgYvgPV_0 2024-09-12T01:21:57.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12043510634133391453', time=2024-09-12T03:12:05.025595+0000, chain.objs.size()=1 2024-09-12T01:21:57.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.484__shadow_.HXEPCA-Ebh0OJJd69hoOh014PmYVK-W_0 2024-09-12T01:21:57.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11977811603010629851', time=2024-09-12T03:13:01.161375+0000, chain.objs.size()=2 2024-09-12T01:21:57.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.526__multipart_mymultipart.2~_LHLl98IZuilE2e95oFl2KUX2lZh6hk.1 2024-09-12T01:21:57.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.526__multipart_mymultipart.2~_LHLl98IZuilE2e95oFl2KUX2lZh6hk.2 2024-09-12T01:21:57.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18370697700351204968', time=2024-09-12T03:14:11.493870+0000, chain.objs.size()=1 2024-09-12T01:21:57.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:uTwSisSK2ZFEJAKXNlW3uOYdQQgZTYA_.vb_uJeqS3e2tXZcBCy6PpAuVEcpz_WT_0 2024-09-12T01:21:57.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8332234657351210171', time=2024-09-12T03:14:41.148547+0000, chain.objs.size()=1 2024-09-12T01:21:57.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:Z9wCbSThGx43uN4EJXfBptwTt4NcF1K_.zzlzKEG6uJvSxC2b3IMyqOpguirS12i_0 2024-09-12T01:21:57.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12012369309152450587', time=2024-09-12T03:14:41.754074+0000, chain.objs.size()=1 2024-09-12T01:21:57.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:w2zqGSeEm9Z24cwQFHOcuHaursDmoK4_.qm609V3GXp2IxmB0haMQ4ao8zJpMt0m_0 2024-09-12T01:21:57.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2844998696036572178', time=2024-09-12T03:14:57.348697+0000, chain.objs.size()=1 2024-09-12T01:21:57.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.586__shadow:K9HBi6t-g-oVzGja6BCm-i1HugfBFHN_.fXUDLOJrHchUwPH_K58j2rP_zjJm1wQ_0 2024-09-12T01:21:57.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4603000072737178654', time=2024-09-12T03:14:58.307265+0000, chain.objs.size()=1 2024-09-12T01:21:57.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.587__shadow:1GphubL2WkSUSCVBdktLsMpNYVZUGtO_.CVPTaTAk5HxB3AZqMTgs7CWCyfLxORa_0 2024-09-12T01:21:57.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7084475606566348316', time=2024-09-12T03:15:10.664240+0000, chain.objs.size()=1 2024-09-12T01:21:57.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.156+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.607__shadow_.7foevW6208CUOhnNsVAj6VWd3F9nQO-_0 2024-09-12T01:21:57.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.160+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8772636173247762197', time=2024-09-12T03:18:33.633628+0000, chain.objs.size()=1 2024-09-12T01:21:57.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.160+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.705__shadow:2P4pRTFD3hucecSZBu4aWEyF.JUhSV2_.jYr5itV_2STGm-5p1UIwJJf4sw-vYpP_0 2024-09-12T01:21:57.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.160+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:57.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.160+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:21:57.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:57.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:57.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48080' 2024-09-12T01:21:57.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9482478064072371932', time=2024-09-12T03:08:10.280161+0000, chain.objs.size()=1 2024-09-12T01:21:57.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.238__shadow_.vi_FaYkQO8gtatFHJnvPNARC-bxljSL_0 2024-09-12T01:21:57.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10008699311642248378', time=2024-09-12T03:08:24.041540+0000, chain.objs.size()=1 2024-09-12T01:21:57.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.256__shadow_.XRnGGOdzbH9sNnNzRMv3ts32xPmgwcd_0 2024-09-12T01:21:57.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4694532020323307462', time=2024-09-12T03:08:47.444284+0000, chain.objs.size()=1 2024-09-12T01:21:57.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.EKYSb6kb9BAfZzg6K-G7KbWyofZrvtr_0 2024-09-12T01:21:57.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12965900426668982446', time=2024-09-12T03:08:47.606294+0000, chain.objs.size()=1 2024-09-12T01:21:57.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.46cvauotlN8Sw5cfO0hMcHddmxQM61k_0 2024-09-12T01:21:57.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5950794569454943010', time=2024-09-12T03:08:47.837178+0000, chain.objs.size()=1 2024-09-12T01:21:57.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Il_3EuaUEWlHq7af_zyDEYDIAHH3ok4_0 2024-09-12T01:21:57.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1825246938864698676', time=2024-09-12T03:08:47.918418+0000, chain.objs.size()=1 2024-09-12T01:21:57.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.8hHWaXMtOBjbYILHpjGtVJD0ybwA3Kb_0 2024-09-12T01:21:57.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9266146086172914531', time=2024-09-12T03:08:48.155318+0000, chain.objs.size()=1 2024-09-12T01:21:57.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Aq8MVHO_0UOoXQeWTKDSk2cJi018nQN_0 2024-09-12T01:21:57.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10761405874156461728', time=2024-09-12T03:08:48.181803+0000, chain.objs.size()=1 2024-09-12T01:21:57.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.tZC6WWRdtvS9utsEsms5GRYvOaYv-Fo_0 2024-09-12T01:21:57.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2586354424366548174', time=2024-09-12T03:08:48.194517+0000, chain.objs.size()=1 2024-09-12T01:21:57.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.jA5yCAonPUekOov5_4xBHfS2ThxoxJM_0 2024-09-12T01:21:57.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9062867805742848779', time=2024-09-12T03:08:48.236783+0000, chain.objs.size()=1 2024-09-12T01:21:57.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.heW932-Xc_fumhHBcf9nVWp9PpxgITx_0 2024-09-12T01:21:57.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16562151382880409174', time=2024-09-12T03:08:48.283640+0000, chain.objs.size()=1 2024-09-12T01:21:57.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.OzwbQ40srThqdGyoOO1EOg_nf13ZyBh_0 2024-09-12T01:21:57.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14348062790488505532', time=2024-09-12T03:08:48.318944+0000, chain.objs.size()=1 2024-09-12T01:21:57.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.IYPvUSET0kpHtrlrWxL5zOKgT-gYl0Y_0 2024-09-12T01:21:57.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5154418638913797025', time=2024-09-12T03:08:48.342915+0000, chain.objs.size()=1 2024-09-12T01:21:57.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Iz_Wb7b8BwFP-RxqvJbwFCC9G-e7OnD_0 2024-09-12T01:21:57.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6631084897671528207', time=2024-09-12T03:08:48.517299+0000, chain.objs.size()=1 2024-09-12T01:21:57.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.cbZVBmUVdZUg9C32r2yXLDiRDSeZN-N_0 2024-09-12T01:21:57.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9865289433247161422', time=2024-09-12T03:08:48.659176+0000, chain.objs.size()=1 2024-09-12T01:21:57.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.9FbKxDhlUM114i4OY9cERDgQ3h3R1uB_0 2024-09-12T01:21:57.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8303415063830156549', time=2024-09-12T03:08:48.896878+0000, chain.objs.size()=1 2024-09-12T01:21:57.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.164+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.XSQTS-B4xVPEVhJyXpfc0AaVSt30vrY_0 2024-09-12T01:21:57.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9435428549659719702', time=2024-09-12T03:08:48.938556+0000, chain.objs.size()=1 2024-09-12T01:21:57.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.HuSKpm-ZANl-MUp4L5qTxNshHud1Ke__0 2024-09-12T01:21:57.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13374029694453449357', time=2024-09-12T03:08:48.965586+0000, chain.objs.size()=1 2024-09-12T01:21:57.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.nxBbhTyZabFIFXj8InnojsRFSq4DBMs_0 2024-09-12T01:21:57.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5879235336015643532', time=2024-09-12T03:08:48.979723+0000, chain.objs.size()=1 2024-09-12T01:21:57.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.KarvitA1Heca5ZK4XOoQrvcmF26H3XQ_0 2024-09-12T01:21:57.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17339839682873372331', time=2024-09-12T03:08:49.027639+0000, chain.objs.size()=1 2024-09-12T01:21:57.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.0RNz2ObqZqudsaW_hwyUcQMcx5mbovZ_0 2024-09-12T01:21:57.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1468480833145569484', time=2024-09-12T03:08:49.032118+0000, chain.objs.size()=1 2024-09-12T01:21:57.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.UEpAvfLcmolgTLMN6oliZkFMdzKrPRH_0 2024-09-12T01:21:57.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14511017338945095339', time=2024-09-12T03:08:49.042714+0000, chain.objs.size()=1 2024-09-12T01:21:57.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Cz62Izzll0PTfG8VtXt4n7xpK5xTYil_0 2024-09-12T01:21:57.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14923265252751113527', time=2024-09-12T03:08:49.219478+0000, chain.objs.size()=1 2024-09-12T01:21:57.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.gQcvUOMSQKidfW3kQn4hx2GerguSDjY_0 2024-09-12T01:21:57.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16980582420793600107', time=2024-09-12T03:08:49.284543+0000, chain.objs.size()=1 2024-09-12T01:21:57.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.DKNWp7szmEKyMhEOm_BMdVmp6UEs77l_0 2024-09-12T01:21:57.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5702685329412864694', time=2024-09-12T03:08:49.310226+0000, chain.objs.size()=1 2024-09-12T01:21:57.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Z7ulBEQ_ch3H1MRLTaRNabda6ZHQ6-1_0 2024-09-12T01:21:57.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7240162762231996166', time=2024-09-12T03:08:49.645279+0000, chain.objs.size()=1 2024-09-12T01:21:57.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Hc_6RhbASIPVhePq860Xxc1a5jtWcYB_0 2024-09-12T01:21:57.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11999745970773873749', time=2024-09-12T03:08:49.733785+0000, chain.objs.size()=1 2024-09-12T01:21:57.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.zcYp2kUYx5ez3wHvBZKnIOFQX5mVtm7_0 2024-09-12T01:21:57.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17063773553929772236', time=2024-09-12T03:08:49.738893+0000, chain.objs.size()=1 2024-09-12T01:21:57.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.EQ09bsT20fL7vsUbkVr6waoD3PvJNAy_0 2024-09-12T01:21:57.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5819481943367425152', time=2024-09-12T03:08:51.979426+0000, chain.objs.size()=1 2024-09-12T01:21:57.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.266__shadow_.BZX5ADkRfaJl_6uuVvPXpf4GOz8TihP_0 2024-09-12T01:21:57.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578412440712431870', time=2024-09-12T03:09:02.930457+0000, chain.objs.size()=1 2024-09-12T01:21:57.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.282__shadow_.HcOyW2WiP4zCAhd2qkOmX7JkrEmtmYD_0 2024-09-12T01:21:57.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5160941242040097269', time=2024-09-12T03:09:05.039332+0000, chain.objs.size()=1 2024-09-12T01:21:57.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.285__shadow_.VTvMaQ6lIo9cCOm3kQB0Z51vviGhHiS_0 2024-09-12T01:21:57.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14732150066992522660', time=2024-09-12T03:09:08.572202+0000, chain.objs.size()=1 2024-09-12T01:21:57.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.290__shadow_.fQ8ZmxSLxF3e6W0w7-yhFu1w8zndiIa_0 2024-09-12T01:21:57.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10623465264947914463', time=2024-09-12T03:09:13.047070+0000, chain.objs.size()=1 2024-09-12T01:21:57.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.294__shadow_.q3CqeUpMA-f5AJ2TD70UUNclyW3JEHj_0 2024-09-12T01:21:57.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12050126941294457899', time=2024-09-12T03:09:14.425112+0000, chain.objs.size()=1 2024-09-12T01:21:57.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.296__shadow_.d-ATuvMoFYeKOla1yrDstKU48cHE4L1_0 2024-09-12T01:21:57.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6908057928941483338', time=2024-09-12T03:09:15.804502+0000, chain.objs.size()=1 2024-09-12T01:21:57.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.298__shadow_.JckI1mx76pyz34BwsmPM9fQFSiAeaPp_0 2024-09-12T01:21:57.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18218472147910993068', time=2024-09-12T03:09:17.238129+0000, chain.objs.size()=1 2024-09-12T01:21:57.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.300__shadow_.NBjGwWzloIiJkk9KqWPsCzzSZmOj7vV_0 2024-09-12T01:21:57.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3257437894150457241', time=2024-09-12T03:09:31.765221+0000, chain.objs.size()=1 2024-09-12T01:21:57.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.168+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.320__shadow:.otEqDsTFyirtPLixxnkyA6bJ4NsAPU_.zdteWIA4G5nbFoWjYdKE2nDr6jjg1iU_0 2024-09-12T01:21:57.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9037155842947512699', time=2024-09-12T03:09:53.026734+0000, chain.objs.size()=1 2024-09-12T01:21:57.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.pjH-pasacBD2dNg6n0E0H3rVp8_cKgK_0 2024-09-12T01:21:57.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15676784622711850071', time=2024-09-12T03:09:53.068468+0000, chain.objs.size()=1 2024-09-12T01:21:57.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.wwnTnWrDwCCF_dtCJ-Mm27j0__cbrma_0 2024-09-12T01:21:57.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12022931105078525208', time=2024-09-12T03:09:53.093696+0000, chain.objs.size()=1 2024-09-12T01:21:57.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.jhsUXaVC3bL014Kec29xxGVTBDmUVge_0 2024-09-12T01:21:57.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5935571331735267773', time=2024-09-12T03:09:53.117433+0000, chain.objs.size()=1 2024-09-12T01:21:57.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.6-94Zrv84_dIvKNSzNOG0kedx8KswO6_0 2024-09-12T01:21:57.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17870876637931890648', time=2024-09-12T03:09:53.410195+0000, chain.objs.size()=1 2024-09-12T01:21:57.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.OS9VEDQCO_CO-6c1-YCqt4j2x61duxu_0 2024-09-12T01:21:57.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2275585706015565245', time=2024-09-12T03:09:53.452535+0000, chain.objs.size()=1 2024-09-12T01:21:57.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.wipIi6Eefppltv--lims4tiUWbwa0sW_0 2024-09-12T01:21:57.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7680779487738961940', time=2024-09-12T03:09:53.459056+0000, chain.objs.size()=1 2024-09-12T01:21:57.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.eoFHo-m_5rblZI4q03A84tPDeF1dYxH_0 2024-09-12T01:21:57.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4293538600189517186', time=2024-09-12T03:09:53.467427+0000, chain.objs.size()=1 2024-09-12T01:21:57.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.5oDDHxh0_uWJP7aNE_Hmsnfm18iEdXH_0 2024-09-12T01:21:57.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12275708358265590320', time=2024-09-12T03:09:53.650422+0000, chain.objs.size()=1 2024-09-12T01:21:57.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.-OW5ofraxO4kYdkucfnL6mBWe7ia995_0 2024-09-12T01:21:57.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.599650191541195751', time=2024-09-12T03:09:53.762832+0000, chain.objs.size()=1 2024-09-12T01:21:57.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.fWEfPCuWdt70YSSwbkzCqbI-RfL9A1L_0 2024-09-12T01:21:57.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2166294586817172666', time=2024-09-12T03:09:53.807577+0000, chain.objs.size()=1 2024-09-12T01:21:57.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.yaBePw96xrieNzLg_vxfnAxq5_PmRh0_0 2024-09-12T01:21:57.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12258877478084193464', time=2024-09-12T03:09:53.811978+0000, chain.objs.size()=1 2024-09-12T01:21:57.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.TWL3m2pZCV96_PZq4183O_RNrIXlx4A_0 2024-09-12T01:21:57.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5470861478667065380', time=2024-09-12T03:09:53.832844+0000, chain.objs.size()=1 2024-09-12T01:21:57.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.D4K9TJMT_LIglFUpnA1r9B-aWV7cTN0_0 2024-09-12T01:21:57.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18239794703532629113', time=2024-09-12T03:09:53.969928+0000, chain.objs.size()=1 2024-09-12T01:21:57.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.0Y6jSGh2TdOovXYQ2D-Y2GiAXCJXe8g_0 2024-09-12T01:21:57.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3188722413023712024', time=2024-09-12T03:09:54.076442+0000, chain.objs.size()=1 2024-09-12T01:21:57.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.R5cftQT4mtUWAWVMrdeA_MeS8_vCP78_0 2024-09-12T01:21:57.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5460735135702863281', time=2024-09-12T03:09:54.123314+0000, chain.objs.size()=1 2024-09-12T01:21:57.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.cSeTeLgTR2e42c6x7pMQlRDDJ4aulWP_0 2024-09-12T01:21:57.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9174870814283446448', time=2024-09-12T03:09:54.127333+0000, chain.objs.size()=1 2024-09-12T01:21:57.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.IDaIeGQCTYtU7O3skOZn9kU2b7OCFmh_0 2024-09-12T01:21:57.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9596707147960178866', time=2024-09-12T03:09:54.391527+0000, chain.objs.size()=1 2024-09-12T01:21:57.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.172+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.2KtVeXhlf7uqfoa5k6d4pv32RpcF1dd_0 2024-09-12T01:21:57.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.176+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9564429327084418216', time=2024-09-12T03:09:54.776223+0000, chain.objs.size()=1 2024-09-12T01:21:57.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.176+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Y9I31OaLm4uMzGfXvgo3vIgHcinFywm_0 2024-09-12T01:21:57.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.176+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16127272845156726369', time=2024-09-12T03:09:54.826267+0000, chain.objs.size()=1 2024-09-12T01:21:57.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.176+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.rwixCtp6O1z99mDIDiv_mUwKJsMFNBc_0 2024-09-12T01:21:57.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.176+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6428470727461602218', time=2024-09-12T03:09:54.945014+0000, chain.objs.size()=1 2024-09-12T01:21:57.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.176+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.EV4F8GBsBv2WClHR0HyoQReRlr2JwYC_0 2024-09-12T01:21:57.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.176+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13249519235248737348', time=2024-09-12T03:09:55.012038+0000, chain.objs.size()=1 2024-09-12T01:21:57.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.176+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.66vag1-T-7gsLpnt3BdvVEazzi32xmA_0 2024-09-12T01:21:57.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.176+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13477922646057800622', time=2024-09-12T03:09:55.023105+0000, chain.objs.size()=1 2024-09-12T01:21:57.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.176+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.KcF2rfnqMTdIueFkxuMPqS0Q8CtnAYq_0 2024-09-12T01:21:57.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.176+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13558845333662825796', time=2024-09-12T03:09:55.090218+0000, chain.objs.size()=1 2024-09-12T01:21:57.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.176+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.V_fbTHmQ_Xso6eZUvHy6UrYwT0Z9zsP_0 2024-09-12T01:21:57.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.176+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8087727948104278671', time=2024-09-12T03:09:55.106005+0000, chain.objs.size()=1 2024-09-12T01:21:57.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.176+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.mixhWmGyaLZo03Kr5f94YGRdnRZZaOx_0 2024-09-12T01:21:57.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.176+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12105246435989902647', time=2024-09-12T03:09:55.166775+0000, chain.objs.size()=1 2024-09-12T01:21:57.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.176+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.SjtvWTAbJIPP5dQB5_jLVH4J4-Fktip_0 2024-09-12T01:21:57.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.176+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3590866524030282801', time=2024-09-12T03:09:55.403523+0000, chain.objs.size()=1 2024-09-12T01:21:57.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.176+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.S6zqjQKIku1K9-zBE2nk4OxhAMkIVNn_0 2024-09-12T01:21:57.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.176+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9146746403166570239', time=2024-09-12T03:10:15.333386+0000, chain.objs.size()=1 2024-09-12T01:21:57.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.176+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.h-JhVvKRTgoGOQmIB6UnQ-Xja10xjLU_0 2024-09-12T01:21:57.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.176+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1584147410886706394', time=2024-09-12T03:10:15.365796+0000, chain.objs.size()=1 2024-09-12T01:21:57.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.176+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.u1LrdKAbmuKuXthP_iG8MjL_jI759H__0 2024-09-12T01:21:57.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.176+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10258684096975077322', time=2024-09-12T03:10:15.620374+0000, chain.objs.size()=1 2024-09-12T01:21:57.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.176+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.XqbrpRMYqOL688893uLFomeOj-oyiNP_0 2024-09-12T01:21:57.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.176+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9914095555785458522', time=2024-09-12T03:10:15.737471+0000, chain.objs.size()=1 2024-09-12T01:21:57.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.176+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.LttJPrdzAr6jIwPDvmIVBmKkxjJ-Itt_0 2024-09-12T01:21:57.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1882922459466987033', time=2024-09-12T03:10:16.011146+0000, chain.objs.size()=1 2024-09-12T01:21:57.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.NzqWcQXcmZhVQpyO5uask_4TbFYzth3_0 2024-09-12T01:21:57.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2307305531111070222', time=2024-09-12T03:10:16.047957+0000, chain.objs.size()=1 2024-09-12T01:21:57.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.KY4GHQpFg_w_9XtLLcytCf5PKrCxsfO_0 2024-09-12T01:21:57.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12851540280828512116', time=2024-09-12T03:10:16.060200+0000, chain.objs.size()=1 2024-09-12T01:21:57.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.xgKicoF0t4_oqkgUlb_7Ex0IfiOp12S_0 2024-09-12T01:21:57.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1342934355297249461', time=2024-09-12T03:10:16.287177+0000, chain.objs.size()=1 2024-09-12T01:21:57.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.6JXlclOPG1OPEe_3RvQ0_oKdQsVRlYg_0 2024-09-12T01:21:57.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12655454748221159301', time=2024-09-12T03:10:16.314241+0000, chain.objs.size()=1 2024-09-12T01:21:57.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.fda59IoZs0-Z0auTTtPT4z4ec-WsCHU_0 2024-09-12T01:21:57.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15466981668965047384', time=2024-09-12T03:10:16.354482+0000, chain.objs.size()=1 2024-09-12T01:21:57.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.gShdbpfpJG9spJnJdBPl9Qljw2_I-Lm_0 2024-09-12T01:21:57.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3919265349216304202', time=2024-09-12T03:10:16.791985+0000, chain.objs.size()=1 2024-09-12T01:21:57.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.W78SDBf8dcSX-n1CAnH22sMmSqoedZ7_0 2024-09-12T01:21:57.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13132689852584747757', time=2024-09-12T03:10:16.965402+0000, chain.objs.size()=1 2024-09-12T01:21:57.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_._clQe4FQU3gZyJbQ9_be122hbHitei9_0 2024-09-12T01:21:57.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8259025535821277658', time=2024-09-12T03:10:17.188097+0000, chain.objs.size()=1 2024-09-12T01:21:57.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.GUmJyc8i7uJlOdPzi0gTfnx-k1-yzRC_0 2024-09-12T01:21:57.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8013374754297944996', time=2024-09-12T03:10:17.201531+0000, chain.objs.size()=1 2024-09-12T01:21:57.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ovsOMWYJ5kOxbPsoD1gbFTodRB2lXB4_0 2024-09-12T01:21:57.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8289825281527647991', time=2024-09-12T03:10:17.202598+0000, chain.objs.size()=1 2024-09-12T01:21:57.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.i0mZwmK8jokBb-JexTJLjSPrkZhffz1_0 2024-09-12T01:21:57.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16793036964908236934', time=2024-09-12T03:10:17.252902+0000, chain.objs.size()=1 2024-09-12T01:21:57.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.xg34da4T0oh2Jjz-aOyvU6nHuUtjjtD_0 2024-09-12T01:21:57.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14916061436711082635', time=2024-09-12T03:10:17.285557+0000, chain.objs.size()=1 2024-09-12T01:21:57.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.3FZpeEiH51E51KvvszS33QK9SalbLxl_0 2024-09-12T01:21:57.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5666854703114946443', time=2024-09-12T03:10:17.319883+0000, chain.objs.size()=1 2024-09-12T01:21:57.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Z6IQF5vucajLsKnnp9G4Bmo-0EJvGhK_0 2024-09-12T01:21:57.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13493492114538027590', time=2024-09-12T03:10:17.436247+0000, chain.objs.size()=1 2024-09-12T01:21:57.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.aTF2JxjoLwWRL0Rv6NZMCKXYOx1w9Ja_0 2024-09-12T01:21:57.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13621549013973554508', time=2024-09-12T03:10:17.496116+0000, chain.objs.size()=1 2024-09-12T01:21:57.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.RHvYzsksSktAeNIr-cwMRSoGoyhwSrP_0 2024-09-12T01:21:57.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10436259154936650703', time=2024-09-12T03:10:17.499932+0000, chain.objs.size()=1 2024-09-12T01:21:57.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.arYe06wjMTgj0mh7ZhSOTjvMvlS6Lr3_0 2024-09-12T01:21:57.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15140695964897408354', time=2024-09-12T03:10:17.544888+0000, chain.objs.size()=1 2024-09-12T01:21:57.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.EvzgrGCaeswkdq5hqy8Vw51JyNuBBwb_0 2024-09-12T01:21:57.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17905667002125305757', time=2024-09-12T03:10:17.548424+0000, chain.objs.size()=1 2024-09-12T01:21:57.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.6FpqacxsFwhHV6OceB33u4_9Mj7HNxE_0 2024-09-12T01:21:57.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7288203687408829888', time=2024-09-12T03:10:17.549250+0000, chain.objs.size()=1 2024-09-12T01:21:57.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.j0g2XeSFxMs5FhSkzFCq5jORE2Hinly_0 2024-09-12T01:21:57.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3328969562273942011', time=2024-09-12T03:10:17.626323+0000, chain.objs.size()=1 2024-09-12T01:21:57.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.1SPAukzaxAmlhrkqk1fvgL6cxgwPRag_0 2024-09-12T01:21:57.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5148333449417299698', time=2024-09-12T03:10:17.740788+0000, chain.objs.size()=1 2024-09-12T01:21:57.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.JNMJlU9lahl_9cmDUmsmtBAusFYziw9_0 2024-09-12T01:21:57.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10442857017216326332', time=2024-09-12T03:10:17.789634+0000, chain.objs.size()=1 2024-09-12T01:21:57.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.180+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.UiKASk_NGxuNJzjX9zP2i2Lg71eZaFN_0 2024-09-12T01:21:57.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.184+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8710690478991958883', time=2024-09-12T03:10:17.795563+0000, chain.objs.size()=1 2024-09-12T01:21:57.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.184+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Do3nNhIl5JPBTKL6Raw2nF9N_EdxLnQ_0 2024-09-12T01:21:57.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.184+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12078321238518576087', time=2024-09-12T03:10:17.807963+0000, chain.objs.size()=1 2024-09-12T01:21:57.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.184+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.QtFFExmo9nvGlvmgJwDTiEMqfobQK0Z_0 2024-09-12T01:21:57.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.184+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10132586201140389165', time=2024-09-12T03:10:17.850378+0000, chain.objs.size()=1 2024-09-12T01:21:57.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.184+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.fzhIbV98JYRNrpAL5NOJx6P8YUGMM_y_0 2024-09-12T01:21:57.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.184+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18017459656554013911', time=2024-09-12T03:10:17.865203+0000, chain.objs.size()=1 2024-09-12T01:21:57.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.184+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_._mr9r6Nz3xE2mZaf6k9vRPktjfvnqG__0 2024-09-12T01:21:57.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.184+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.426224746557705907', time=2024-09-12T03:10:17.888986+0000, chain.objs.size()=1 2024-09-12T01:21:57.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.184+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.pxdf3-MmiKUqL0jTB8GqfXYvNbAJWnR_0 2024-09-12T01:21:57.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.184+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17717624633962572043', time=2024-09-12T03:11:40.719590+0000, chain.objs.size()=1 2024-09-12T01:21:57.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.184+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.448__shadow_.cQdYxp0rJ7wICJQgIkY_cRCK0hPWpUP_0 2024-09-12T01:21:57.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.184+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15100825379142054005', time=2024-09-12T03:11:45.498438+0000, chain.objs.size()=1 2024-09-12T01:21:57.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.184+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.455__shadow_.kdofjnkNcEHu4g9XuyCGzY4hqr_0SUT_0 2024-09-12T01:21:57.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.184+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7874181166622506774', time=2024-09-12T03:11:53.418653+0000, chain.objs.size()=1 2024-09-12T01:21:57.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.184+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.463__shadow_.8EU2nJ5L2VBvIT9-Oh9hFB-djfZCJRf_0 2024-09-12T01:21:57.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.184+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2642703440381435760', time=2024-09-12T03:11:55.893615+0000, chain.objs.size()=1 2024-09-12T01:21:57.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.184+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.466__shadow_.haJaif3bLXkXz6tgofBivU0L4nHzx9b_0 2024-09-12T01:21:57.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.188+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48080 2024-09-12T01:21:57.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.188+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T01:21:57.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.188+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9108384614722070019', time=2024-09-12T03:12:18.042308+0000, chain.objs.size()=1 2024-09-12T01:21:57.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.188+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.504__shadow:fzRg7xrdrpV0hjFUnNiyrRjat2TjEPZ_.vHz-mc05LslsPFizOQCh8qlCeQstO_b_0 2024-09-12T01:21:57.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.188+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14029713902348068943', time=2024-09-12T03:12:36.453368+0000, chain.objs.size()=3 2024-09-12T01:21:57.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.188+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.522__multipart_mymultipart.2~xkRlfA3IbKIc9zJvrwSetck13ULRd4Z.1 2024-09-12T01:21:57.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.188+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.522__multipart_mymultipart.2~xkRlfA3IbKIc9zJvrwSetck13ULRd4Z.2 2024-09-12T01:21:57.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.188+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.522__multipart_mymultipart.2~xkRlfA3IbKIc9zJvrwSetck13ULRd4Z.3 2024-09-12T01:21:57.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.188+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1751915182173897145', time=2024-09-12T03:12:45.739065+0000, chain.objs.size()=6 2024-09-12T01:21:57.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.188+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~X6P74dZ-aiMwZgNlTkgnfCQzAz8_QG7.1 2024-09-12T01:21:57.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.188+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.TDyWHXjp1ptvAs8hAyq6G5Kmcq16HmHF.2 2024-09-12T01:21:57.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.188+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~X6P74dZ-aiMwZgNlTkgnfCQzAz8_QG7.3 2024-09-12T01:21:57.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.188+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~X6P74dZ-aiMwZgNlTkgnfCQzAz8_QG7.4 2024-09-12T01:21:57.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.188+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~X6P74dZ-aiMwZgNlTkgnfCQzAz8_QG7.5 2024-09-12T01:21:57.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.188+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~X6P74dZ-aiMwZgNlTkgnfCQzAz8_QG7.6 2024-09-12T01:21:57.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.188+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10942211788567263050', time=2024-09-12T03:14:14.097553+0000, chain.objs.size()=1 2024-09-12T01:21:57.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.188+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:JE6M5UOL9hmX5cVCZIN.fAQvotTSJ9L_.hO-dCXFb9EywYw2D4EsOGVfAiW9tz4G_0 2024-09-12T01:21:57.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.188+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5612891287370935580', time=2024-09-12T03:14:15.389643+0000, chain.objs.size()=1 2024-09-12T01:21:57.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.188+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:VYVyB1mF2lCOqmc87BCAnEDThRnkbj6_.gji9LRYR_dS_cOKG5DKN5j1Wlb5bl6z_0 2024-09-12T01:21:57.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.188+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7836923614321021372', time=2024-09-12T03:14:18.136476+0000, chain.objs.size()=1 2024-09-12T01:21:57.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.188+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.571__shadow:K6EKkcxXpJsSIRTB-GppPNUNt6uDgPX_.MSa4We7CRgmp6JgLGXu3qg_1iUUWjfR_0 2024-09-12T01:21:57.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.188+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9074237648106925487', time=2024-09-12T03:14:22.510199+0000, chain.objs.size()=1 2024-09-12T01:21:57.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.188+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.575__shadow:3C5snXIG4g8NgA3OX5e3DqNYJSIcKl-_.crHRYmPbg0DjATrLypseWWTTO967wH-_0 2024-09-12T01:21:57.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.188+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5829078384152314530', time=2024-09-12T03:17:41.319372+0000, chain.objs.size()=1 2024-09-12T01:21:57.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.188+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.629__shadow_.0j5A-khKkjVbihXEdr1ScTg9NtkXlQB_0 2024-09-12T01:21:57.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.188+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15544425313493474601', time=2024-09-12T03:18:11.179206+0000, chain.objs.size()=1 2024-09-12T01:21:57.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.188+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.667__shadow_.stfX1lT97rF1zCbRerpnpoOMgRZA0gx_0 2024-09-12T01:21:57.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.192+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8627069607392602859', time=2024-09-12T03:19:01.698429+0000, chain.objs.size()=1 2024-09-12T01:21:57.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.192+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.719__shadow_.6BbvuYwCvt7Du3R3jtDpRKiiFrW6Edx_0 2024-09-12T01:21:57.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.192+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:57.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:21:57.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:57.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:57.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44454' 2024-09-12T01:21:57.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6778311762699516724', time=2024-09-12T03:06:37.786638+0000, chain.objs.size()=1 2024-09-12T01:21:57.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.201__shadow_.u11oWX4Pad1lciAr8LitqJiJm_R58ZX_0 2024-09-12T01:21:57.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5588979499042951187', time=2024-09-12T03:06:39.960866+0000, chain.objs.size()=1 2024-09-12T01:21:57.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.204__shadow_.gg47_juHrYCKDdR_tNFEVaoOakMiQ72_0 2024-09-12T01:21:57.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3282777772427271117', time=2024-09-12T03:08:07.039547+0000, chain.objs.size()=1 2024-09-12T01:21:57.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.234__shadow_.W3bOq98Sun76WgOnWHxaB9z9r5fgcHR_0 2024-09-12T01:21:57.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11193404916570050540', time=2024-09-12T03:08:17.860299+0000, chain.objs.size()=1 2024-09-12T01:21:57.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.247__shadow_.uojfFzX7sKqCD7NqOVcNOOiS23xMWgM_0 2024-09-12T01:21:57.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17535227737398580282', time=2024-09-12T03:08:17.862303+0000, chain.objs.size()=1 2024-09-12T01:21:57.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.247__shadow_.N35sRHJ36if4sfeNS7wm2Mm6wmhBd_V_0 2024-09-12T01:21:57.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14486856809934624056', time=2024-09-12T03:08:20.561936+0000, chain.objs.size()=1 2024-09-12T01:21:57.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.251__shadow_.CoOQpUFO2tGASo07eLF4KdVKvU5kDlq_0 2024-09-12T01:21:57.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18299152719872428857', time=2024-09-12T03:08:26.738378+0000, chain.objs.size()=1 2024-09-12T01:21:57.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.260__shadow_.AwSPP2fuzKKMMUZnylTJYUOfPfzWS9c_0 2024-09-12T01:21:57.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4958611188287620439', time=2024-09-12T03:08:47.542969+0000, chain.objs.size()=1 2024-09-12T01:21:57.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.kIKCqsjxpj8fJbFiCXu_qohcScZvVwK_0 2024-09-12T01:21:57.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5868354535339743508', time=2024-09-12T03:08:47.658029+0000, chain.objs.size()=1 2024-09-12T01:21:57.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.g0t5WLbGvZuNJhoMZXMWVBnUzNlEFwP_0 2024-09-12T01:21:57.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9755410090052153548', time=2024-09-12T03:08:47.870731+0000, chain.objs.size()=1 2024-09-12T01:21:57.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.NeBwWJAzHOamJrlMCRqe0axm4PMiFg-_0 2024-09-12T01:21:57.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6991607325283262163', time=2024-09-12T03:08:47.970590+0000, chain.objs.size()=1 2024-09-12T01:21:57.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.5Yp5rujxmS3Z_M88jNfYPQT8yBC46va_0 2024-09-12T01:21:57.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8752447375457834749', time=2024-09-12T03:08:47.971427+0000, chain.objs.size()=1 2024-09-12T01:21:57.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.196+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.I1lbQkdGarYVxRxpH9mCOykx-7nMbzl_0 2024-09-12T01:21:57.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.200+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4646220230914320044', time=2024-09-12T03:08:47.979722+0000, chain.objs.size()=1 2024-09-12T01:21:57.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.200+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.gwpUPSyGZNmI0hiC1Ax9P_kSf8KMpke_0 2024-09-12T01:21:57.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.200+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13023161623566338542', time=2024-09-12T03:08:47.992789+0000, chain.objs.size()=1 2024-09-12T01:21:57.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.200+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.MawTzOY8goDxjcYMSi9W-1yR3AKpVl__0 2024-09-12T01:21:57.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.200+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10623809144195470159', time=2024-09-12T03:08:48.176998+0000, chain.objs.size()=1 2024-09-12T01:21:57.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.200+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.HikXk7bio7bjF8SxRDKfUdp8NPwIk_E_0 2024-09-12T01:21:57.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.200+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7079727444409471460', time=2024-09-12T03:08:48.251092+0000, chain.objs.size()=1 2024-09-12T01:21:57.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.200+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.e9My4eohbeAVoP7-arCPntlNRl12lMQ_0 2024-09-12T01:21:57.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.200+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15334677114565738861', time=2024-09-12T03:08:48.261207+0000, chain.objs.size()=1 2024-09-12T01:21:57.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.200+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.x8eCJg5lVsfCfSnrYF3qlzMe0Qm7ndA_0 2024-09-12T01:21:57.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.200+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12646154915903854183', time=2024-09-12T03:08:48.350664+0000, chain.objs.size()=1 2024-09-12T01:21:57.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.200+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ftEzGCVY1hRoCQnBljpYua6KN5o0OaJ_0 2024-09-12T01:21:57.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.200+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7751613426522715233', time=2024-09-12T03:08:48.677609+0000, chain.objs.size()=1 2024-09-12T01:21:57.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.200+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.D0hbrEYHYkIGowAt-IvXjYQcF6tZhm3_0 2024-09-12T01:21:57.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.200+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1888366761813260146', time=2024-09-12T03:08:48.852131+0000, chain.objs.size()=1 2024-09-12T01:21:57.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.200+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.nEEjV_y7wUTm99bxXDUU1df-eN8pn34_0 2024-09-12T01:21:57.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.200+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4430797369414184721', time=2024-09-12T03:08:48.897972+0000, chain.objs.size()=1 2024-09-12T01:21:57.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.200+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.cBy1tMJTi7M_7asvLTsXAXJleFmn4XE_0 2024-09-12T01:21:57.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.200+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16467253986401661104', time=2024-09-12T03:08:48.978264+0000, chain.objs.size()=1 2024-09-12T01:21:57.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.200+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.OCstQrhVsXU_ahRvn3KOSaIm7gvlMuT_0 2024-09-12T01:21:57.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.200+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4379783478970040181', time=2024-09-12T03:08:48.989972+0000, chain.objs.size()=1 2024-09-12T01:21:57.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.200+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.oXz1r8JM4p7vKxYZngaAc2sgN_1IS2o_0 2024-09-12T01:21:57.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.200+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1173413431212625911', time=2024-09-12T03:08:49.004853+0000, chain.objs.size()=1 2024-09-12T01:21:57.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.200+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.FLMwiDyMsJePelvej225ik4FOVB9cb2_0 2024-09-12T01:21:57.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.204+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9248570321836856030', time=2024-09-12T03:08:49.042702+0000, chain.objs.size()=1 2024-09-12T01:21:57.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.204+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.GClxn8o_kEYF4Atp-LY_kvBvlYvXmrO_0 2024-09-12T01:21:57.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.204+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18006992550365413419', time=2024-09-12T03:08:49.166771+0000, chain.objs.size()=1 2024-09-12T01:21:57.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.204+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.DsDfjustbgkQWYECphlQ4pzKi8Ffy_z_0 2024-09-12T01:21:57.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.204+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2187861985407990212', time=2024-09-12T03:08:49.225872+0000, chain.objs.size()=1 2024-09-12T01:21:57.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.204+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.yXnUnE-RjEn-5LafUmGP_SkIsQ_Fa2n_0 2024-09-12T01:21:57.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.204+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10396684885588819006', time=2024-09-12T03:08:49.304477+0000, chain.objs.size()=1 2024-09-12T01:21:57.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.204+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.CDEccE9I8CyW8EILpx_-4RP5uO8p_EP_0 2024-09-12T01:21:57.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.204+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1646746389812849091', time=2024-09-12T03:08:49.361903+0000, chain.objs.size()=1 2024-09-12T01:21:57.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.204+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.SrQdvMeiN-VZ9oW1dvFZdMNx7NOxSFu_0 2024-09-12T01:21:57.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.204+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10806380192308731567', time=2024-09-12T03:08:49.548326+0000, chain.objs.size()=1 2024-09-12T01:21:57.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.204+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.pjAeGQU62x72bg33YfiOfSNuW9i2-pM_0 2024-09-12T01:21:57.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.204+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10281671083560414118', time=2024-09-12T03:08:49.591915+0000, chain.objs.size()=1 2024-09-12T01:21:57.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.204+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.S0leuro3Ht8huCPomktXeTIrdXosBwT_0 2024-09-12T01:21:57.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.204+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3462444010495098568', time=2024-09-12T03:08:49.626536+0000, chain.objs.size()=1 2024-09-12T01:21:57.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.204+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.SUet-STytl9FwIgNHE07XDCWfDeKm3y_0 2024-09-12T01:21:57.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.204+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.367486805941257160', time=2024-09-12T03:08:49.873410+0000, chain.objs.size()=1 2024-09-12T01:21:57.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.204+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.pZRXKblEhhlu0hQ46uDvCs_n70qztDc_0 2024-09-12T01:21:57.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.204+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9616068580398029039', time=2024-09-12T03:08:49.985531+0000, chain.objs.size()=1 2024-09-12T01:21:57.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.204+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.hBda89Gc7oL3nx2AgQCKSb_UKeTWD6Y_0 2024-09-12T01:21:57.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.204+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17067393973403709348', time=2024-09-12T03:08:50.041489+0000, chain.objs.size()=1 2024-09-12T01:21:57.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.204+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Xl9_NfsRP5TY9QsdV1uJCqb9Ce40PJD_0 2024-09-12T01:21:57.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.204+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9837223678957675261', time=2024-09-12T03:08:50.043634+0000, chain.objs.size()=1 2024-09-12T01:21:57.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.204+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.8ocqpOUEgPd4Y9Upf8j-s4zLV7quFZd_0 2024-09-12T01:21:57.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10932660797481960964', time=2024-09-12T03:08:59.466549+0000, chain.objs.size()=1 2024-09-12T01:21:57.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.277__shadow_.1Uded5s7wqwNI3Jc5bxo0cJoblqmaRB_0 2024-09-12T01:21:57.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10705793156589441499', time=2024-09-12T03:09:13.759950+0000, chain.objs.size()=1 2024-09-12T01:21:57.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.295__shadow_.Ap2RAQuIpIXVk8gho_IcL9CxbfMzeYJ_0 2024-09-12T01:21:57.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3501229397698987556', time=2024-09-12T03:09:16.517576+0000, chain.objs.size()=1 2024-09-12T01:21:57.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.299__shadow_.MCvT1f0DIJlWBr9PDbELYNT49iySYda_0 2024-09-12T01:21:57.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1601550591348842744', time=2024-09-12T03:09:52.983963+0000, chain.objs.size()=1 2024-09-12T01:21:57.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Gd9xFoutVrXb3qE6FKHWD3LvgklLaBq_0 2024-09-12T01:21:57.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8680829813758731338', time=2024-09-12T03:09:53.061406+0000, chain.objs.size()=1 2024-09-12T01:21:57.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.LEBogfTK0JNpmdJyhdBu16pqKhbyHDs_0 2024-09-12T01:21:57.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14598319979811312973', time=2024-09-12T03:09:53.090575+0000, chain.objs.size()=1 2024-09-12T01:21:57.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.mgC0XfUUrF906TYtQvS6c1MZqQ9VtW6_0 2024-09-12T01:21:57.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15015420634751285017', time=2024-09-12T03:09:53.429362+0000, chain.objs.size()=1 2024-09-12T01:21:57.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.19M4T5soIrADbH0YhqD1tfuy9UbvLZQ_0 2024-09-12T01:21:57.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1980430224351525071', time=2024-09-12T03:09:53.459667+0000, chain.objs.size()=1 2024-09-12T01:21:57.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.PD9EYk4NhgQQyTv2wWxxhi8g-fGeFPh_0 2024-09-12T01:21:57.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17253820517127978707', time=2024-09-12T03:09:53.510460+0000, chain.objs.size()=1 2024-09-12T01:21:57.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.9QP_sjvw0kQE7DMaqxulpTpWto32514_0 2024-09-12T01:21:57.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9309475315898063790', time=2024-09-12T03:09:53.653336+0000, chain.objs.size()=1 2024-09-12T01:21:57.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.5oAYSBbtu9bLsZNBmxmQVf7MoqevlLv_0 2024-09-12T01:21:57.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1493828880514123378', time=2024-09-12T03:09:53.655217+0000, chain.objs.size()=1 2024-09-12T01:21:57.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.WqmNe-x8UStpWOWBhQfRtZLNec3juxs_0 2024-09-12T01:21:57.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17459984331639395481', time=2024-09-12T03:09:53.830149+0000, chain.objs.size()=1 2024-09-12T01:21:57.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.yU-bFvv6IheGUVjtgwyQdm5zZaXMtjS_0 2024-09-12T01:21:57.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7157124361475541850', time=2024-09-12T03:09:53.850299+0000, chain.objs.size()=1 2024-09-12T01:21:57.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ELYzFWgrxC0MNjHuRD5ttypTTeTmXSm_0 2024-09-12T01:21:57.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2853301147538419658', time=2024-09-12T03:09:54.065169+0000, chain.objs.size()=1 2024-09-12T01:21:57.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.s-gN-bsGdvuMmLilQUaDmjRDxX9l4Ue_0 2024-09-12T01:21:57.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17846694496476860373', time=2024-09-12T03:09:54.074057+0000, chain.objs.size()=1 2024-09-12T01:21:57.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.P7QHasKK_NP_70Z-JeRWM0yPjkO8JQg_0 2024-09-12T01:21:57.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2682278719054480367', time=2024-09-12T03:09:54.075032+0000, chain.objs.size()=1 2024-09-12T01:21:57.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.YvkcXZCYkmiX3sD17TrY5rtTiz8aGo-_0 2024-09-12T01:21:57.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13631357840405761939', time=2024-09-12T03:09:54.079633+0000, chain.objs.size()=1 2024-09-12T01:21:57.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.66noklowxoeekpuZUMx4hiaeJQlUGeQ_0 2024-09-12T01:21:57.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9950946094473570481', time=2024-09-12T03:09:54.086404+0000, chain.objs.size()=1 2024-09-12T01:21:57.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.OzL9ed__k9lFkiLOV5U6IjksNapcPSg_0 2024-09-12T01:21:57.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9830363063555056917', time=2024-09-12T03:09:54.466533+0000, chain.objs.size()=1 2024-09-12T01:21:57.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.f2YhNYqYT2J8YaeIOxLTlfkKMhL0m8V_0 2024-09-12T01:21:57.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6748705621367495998', time=2024-09-12T03:09:54.480471+0000, chain.objs.size()=1 2024-09-12T01:21:57.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.208+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.HqqV-Gj2UFTGTQYcjMdgFxZlZeS8Gra_0 2024-09-12T01:21:57.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7493555727421458167', time=2024-09-12T03:09:54.492911+0000, chain.objs.size()=1 2024-09-12T01:21:57.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.z2FcUDk5olKk8P2-ezFeFDr2P_WbCZY_0 2024-09-12T01:21:57.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14636850991291526399', time=2024-09-12T03:09:54.732550+0000, chain.objs.size()=1 2024-09-12T01:21:57.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.E1muwEMbpiF6-dTo8srUdfAH3-YI08t_0 2024-09-12T01:21:57.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6928137874228449122', time=2024-09-12T03:09:54.736455+0000, chain.objs.size()=1 2024-09-12T01:21:57.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.5XXJdS_cDPzxymYQ6OwjYxGo2v2N6A8_0 2024-09-12T01:21:57.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7317163875637040967', time=2024-09-12T03:09:54.789583+0000, chain.objs.size()=1 2024-09-12T01:21:57.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.imQv2lEJoKSzrGJV4XZAJ9o480sZcwk_0 2024-09-12T01:21:57.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5267176272671127953', time=2024-09-12T03:09:54.796715+0000, chain.objs.size()=1 2024-09-12T01:21:57.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_._0o5trLavbQQykulIguBpxEcVed4eDy_0 2024-09-12T01:21:57.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16993528257905222573', time=2024-09-12T03:09:54.828283+0000, chain.objs.size()=1 2024-09-12T01:21:57.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.utJvHPAWy4qYd9Lj7C_mtOxjdOhJibZ_0 2024-09-12T01:21:57.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14938903041810752237', time=2024-09-12T03:09:55.110910+0000, chain.objs.size()=1 2024-09-12T01:21:57.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.byocOJAnY3fD6o1xvD5uEKEEGpfzWYN_0 2024-09-12T01:21:57.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1217255297213445771', time=2024-09-12T03:09:55.133817+0000, chain.objs.size()=1 2024-09-12T01:21:57.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.lTv9tltpjWLF9XLpUiqV-6-sVJu5JsP_0 2024-09-12T01:21:57.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4037705241255120167', time=2024-09-12T03:09:55.158646+0000, chain.objs.size()=1 2024-09-12T01:21:57.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.AWQvma40OG9UA7Xm494jJwq71xq_iqd_0 2024-09-12T01:21:57.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13374298482052665002', time=2024-09-12T03:09:55.169664+0000, chain.objs.size()=1 2024-09-12T01:21:57.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.RRS5eWoW1G_NZPjgwJm9W1CMyjYds7n_0 2024-09-12T01:21:57.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9818347323922182340', time=2024-09-12T03:09:55.380012+0000, chain.objs.size()=1 2024-09-12T01:21:57.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.0vHer_TtdQuyyj4Ux1PzG36SlIvzkL7_0 2024-09-12T01:21:57.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4259189764236772942', time=2024-09-12T03:09:55.423562+0000, chain.objs.size()=1 2024-09-12T01:21:57.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.v2zvjGrxtXTijh6RDeUF181DHDmKtO3_0 2024-09-12T01:21:57.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6938630905042518230', time=2024-09-12T03:10:15.252838+0000, chain.objs.size()=1 2024-09-12T01:21:57.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.PYOo9VEv4WzA0BTLG6fZLSOjM2YQfxX_0 2024-09-12T01:21:57.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8128111518030377007', time=2024-09-12T03:10:15.283132+0000, chain.objs.size()=1 2024-09-12T01:21:57.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.8QcFozDlhqBu52apRVFvtZ_C5Uuf5Qh_0 2024-09-12T01:21:57.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7421704852683122218', time=2024-09-12T03:10:15.333543+0000, chain.objs.size()=1 2024-09-12T01:21:57.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.B437oA1a9kqlMBP8CS6xgN_QvTVgZhB_0 2024-09-12T01:21:57.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15930647254840418596', time=2024-09-12T03:10:15.359333+0000, chain.objs.size()=1 2024-09-12T01:21:57.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.XVzmFSE763PJQwC0l_4R9r6hOGEWYWL_0 2024-09-12T01:21:57.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15874590191512133166', time=2024-09-12T03:10:15.400890+0000, chain.objs.size()=1 2024-09-12T01:21:57.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.2VOjGkGBM58IqJcURu5Yo2lMxHpEqmX_0 2024-09-12T01:21:57.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8075079806095469683', time=2024-09-12T03:10:15.568024+0000, chain.objs.size()=1 2024-09-12T01:21:57.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.212+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ShsfDqt6OZVlpCMqpgrODrW2GMjJ9Ll_0 2024-09-12T01:21:57.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.216+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4175553943886763585', time=2024-09-12T03:10:15.597810+0000, chain.objs.size()=1 2024-09-12T01:21:57.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.216+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.QxcfI6Wv4QUSz-y99IpBofp_vutGpn3_0 2024-09-12T01:21:57.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.216+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2085158472027126540', time=2024-09-12T03:10:15.617600+0000, chain.objs.size()=1 2024-09-12T01:21:57.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.216+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.xrMqeC0G-7ckyjLfedZepmYy3PeOAYP_0 2024-09-12T01:21:57.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.216+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16288847111319571379', time=2024-09-12T03:10:15.625301+0000, chain.objs.size()=1 2024-09-12T01:21:57.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.216+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.zsMxt5LI9doUHJhc-ubbkI2FfL3fLD0_0 2024-09-12T01:21:57.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.216+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16831988948754768303', time=2024-09-12T03:10:15.633931+0000, chain.objs.size()=1 2024-09-12T01:21:57.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.216+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.4YFAa098GGbm4YC9s1Gb1yGYU-wDG_u_0 2024-09-12T01:21:57.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.216+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4400878835486250185', time=2024-09-12T03:10:15.639304+0000, chain.objs.size()=1 2024-09-12T01:21:57.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.216+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.r83LCrIa2bnFdwJffiANvA8-CDFvneb_0 2024-09-12T01:21:57.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.216+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10287153516924730699', time=2024-09-12T03:10:15.707894+0000, chain.objs.size()=1 2024-09-12T01:21:57.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.216+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.1q4M5fkslL4d33ap6Bn21e6xwkgEzPz_0 2024-09-12T01:21:57.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.216+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15105399237277145857', time=2024-09-12T03:10:15.774994+0000, chain.objs.size()=1 2024-09-12T01:21:57.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.216+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.5dKnbPvjfQ6AM4g0EsD_IcLo1kk34xK_0 2024-09-12T01:21:57.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.216+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8637015953311335857', time=2024-09-12T03:10:15.882607+0000, chain.objs.size()=1 2024-09-12T01:21:57.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.216+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.VTg5YbtItG9VPLqSjO70Dzpt3GIbDJF_0 2024-09-12T01:21:57.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.216+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5378587870324438075', time=2024-09-12T03:10:15.987092+0000, chain.objs.size()=1 2024-09-12T01:21:57.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.216+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.36nyJ-yKXGJvvH81m4ySo0osf2yS2DK_0 2024-09-12T01:21:57.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.216+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3036415339318786985', time=2024-09-12T03:10:15.994006+0000, chain.objs.size()=1 2024-09-12T01:21:57.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.216+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.df7JfeLuthFJi9LzbUl2EGOzkDN-XBR_0 2024-09-12T01:21:57.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.216+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6175521206083198352', time=2024-09-12T03:10:16.001267+0000, chain.objs.size()=1 2024-09-12T01:21:57.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.216+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.9d1aX75FpuOGW02PCBnS8vlk7xeXRYX_0 2024-09-12T01:21:57.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.216+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508342677079926327', time=2024-09-12T03:10:16.204106+0000, chain.objs.size()=1 2024-09-12T01:21:57.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.216+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.1Tm8e7mm_gCInlQpbu3JuIa9LQ_z4sV_0 2024-09-12T01:21:57.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11322093138188800816', time=2024-09-12T03:10:16.301491+0000, chain.objs.size()=1 2024-09-12T01:21:57.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.XB7Cx7mRmuxXvlnmKtkn-CYzDMtJxkz_0 2024-09-12T01:21:57.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.626321773504007111', time=2024-09-12T03:10:16.651324+0000, chain.objs.size()=1 2024-09-12T01:21:57.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.VTawDYJSH4t1tqOMk5lcDTuEuUiwGiw_0 2024-09-12T01:21:57.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15939999711656324479', time=2024-09-12T03:10:16.853980+0000, chain.objs.size()=1 2024-09-12T01:21:57.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ksFVSXBTDcCSrDBJEk_JYAt2zKtcH7c_0 2024-09-12T01:21:57.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3305471208585685531', time=2024-09-12T03:10:16.862888+0000, chain.objs.size()=1 2024-09-12T01:21:57.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.HUxfGtqf8o_F8_J2GWuUY-u7TwubbL4_0 2024-09-12T01:21:57.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2043554419610992043', time=2024-09-12T03:10:16.876733+0000, chain.objs.size()=1 2024-09-12T01:21:57.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.tc5NK8XW2X8D-21QRfUCBrsUEaHn5yp_0 2024-09-12T01:21:57.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10154249721851482991', time=2024-09-12T03:10:17.314075+0000, chain.objs.size()=1 2024-09-12T01:21:57.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.rBri84tMJa_78ZR0IlNCJLxewRl1b1e_0 2024-09-12T01:21:57.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15972612684337799833', time=2024-09-12T03:10:17.448613+0000, chain.objs.size()=1 2024-09-12T01:21:57.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.nv-kRFm2c4p-p4f-0-4EQugHPwhKcGa_0 2024-09-12T01:21:57.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7569838093899854786', time=2024-09-12T03:10:17.465437+0000, chain.objs.size()=1 2024-09-12T01:21:57.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.WQ7Pvh2FC_uz8btlQ95Lmu9Pjnwxs_8_0 2024-09-12T01:21:57.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14650453100246618371', time=2024-09-12T03:10:17.473155+0000, chain.objs.size()=1 2024-09-12T01:21:57.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.FfxwdqtjCrgDClboNzEuXzM4HoNxuao_0 2024-09-12T01:21:57.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10332935490669920179', time=2024-09-12T03:10:17.477449+0000, chain.objs.size()=1 2024-09-12T01:21:57.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.bXdiyMm8bJqvvUy5Gs6qd85HDrf2-7N_0 2024-09-12T01:21:57.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4592591320578387531', time=2024-09-12T03:10:17.483612+0000, chain.objs.size()=1 2024-09-12T01:21:57.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Kd2dZIxhEP2nLTu2ifSCzt0J_CdXebf_0 2024-09-12T01:21:57.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14041737927037691194', time=2024-09-12T03:10:17.488587+0000, chain.objs.size()=1 2024-09-12T01:21:57.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.9TOp25ruyDY_HYONuPx9y0viFPA2Vxt_0 2024-09-12T01:21:57.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7744359674654633926', time=2024-09-12T03:10:17.510446+0000, chain.objs.size()=1 2024-09-12T01:21:57.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.wgq9FOrOoO5pmC47NuJK2fFtUCa_X1T_0 2024-09-12T01:21:57.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2525391331828084952', time=2024-09-12T03:10:17.525864+0000, chain.objs.size()=1 2024-09-12T01:21:57.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.220+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.l2tZyVY_CujEQXHlxqVIk1cHSkP5EH-_0 2024-09-12T01:21:57.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.224+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44454 2024-09-12T01:21:57.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.224+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T01:21:57.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.224+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10476940767860635903', time=2024-09-12T03:10:17.631678+0000, chain.objs.size()=1 2024-09-12T01:21:57.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.224+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.KHZSGTwl-zzXb45C1Ly7t7nnx2INsLb_0 2024-09-12T01:21:57.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6426801179004321968', time=2024-09-12T03:10:17.739778+0000, chain.objs.size()=1 2024-09-12T01:21:57.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.AfrQV1C8gcjS5EEiRA8EeKaC64carGU_0 2024-09-12T01:21:57.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.301686885247196812', time=2024-09-12T03:10:17.743389+0000, chain.objs.size()=1 2024-09-12T01:21:57.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.X8JMKM0rv32KJb5zyP512lvfMOhin8m_0 2024-09-12T01:21:57.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6302191408641127362', time=2024-09-12T03:10:17.745640+0000, chain.objs.size()=1 2024-09-12T01:21:57.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Tal_x_BIhonMr4WrLCmnyGF-RGPDzd5_0 2024-09-12T01:21:57.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5683851698898884208', time=2024-09-12T03:10:17.754203+0000, chain.objs.size()=1 2024-09-12T01:21:57.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.S5pvJrONE2Tzcj1WTF0f0GqdDXlla92_0 2024-09-12T01:21:57.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2662608478198972441', time=2024-09-12T03:10:17.768462+0000, chain.objs.size()=1 2024-09-12T01:21:57.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.TZQqbzwm6qbnMc_XQmfhsG_Hf-AW5LU_0 2024-09-12T01:21:57.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17785808396124638107', time=2024-09-12T03:10:17.890383+0000, chain.objs.size()=1 2024-09-12T01:21:57.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.6OTdwEO4NxEGM9j4p0HyVDwQPkbP4xm_0 2024-09-12T01:21:57.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10869738647655130850', time=2024-09-12T03:12:22.089735+0000, chain.objs.size()=6 2024-09-12T01:21:57.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.1 2024-09-12T01:21:57.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.2 2024-09-12T01:21:57.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.3 2024-09-12T01:21:57.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.4 2024-09-12T01:21:57.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.5 2024-09-12T01:21:57.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.6 2024-09-12T01:21:57.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7781971339043350375', time=2024-09-12T03:12:37.642543+0000, chain.objs.size()=1 2024-09-12T01:21:57.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.521__shadow:Fj8Sfxy9NU0-HqmB2vfSNZLd.Xtmln1_.0c4ZK0u_BNitjAX5mDOeKl47K0HAnpN_0 2024-09-12T01:21:57.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6056165405101127469', time=2024-09-12T03:12:58.283587+0000, chain.objs.size()=1 2024-09-12T01:21:57.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.526__multipart_mymultipart.2~r5RljaaY3S269DZfpx3x2MMu_EZh81f.1 2024-09-12T01:21:57.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~8JOCIHs-iPWnAuXzoDExWUj2gxtsg2O', time=2024-09-12T03:13:05.285320+0000, chain.objs.size()=2 2024-09-12T01:21:57.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.530__multipart_mymultipart.2~8JOCIHs-iPWnAuXzoDExWUj2gxtsg2O.1 2024-09-12T01:21:57.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.530__multipart_mymultipart.2~8JOCIHs-iPWnAuXzoDExWUj2gxtsg2O.2 2024-09-12T01:21:57.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11668615913709050281', time=2024-09-12T03:13:27.312651+0000, chain.objs.size()=1 2024-09-12T01:21:57.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.537__multipart_mymultipart.2~9WtpXgTmIeut28Mb9qAPCSWRUfvTnKB.1 2024-09-12T01:21:57.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12423849120028892488', time=2024-09-12T03:13:48.375214+0000, chain.objs.size()=1 2024-09-12T01:21:57.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.552__shadow_.Wc4gUpUgcdPNhL3HlClR0sTsNZ0kdgq_0 2024-09-12T01:21:57.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9617307323084400253', time=2024-09-12T03:13:49.563288+0000, chain.objs.size()=1 2024-09-12T01:21:57.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.553__shadow_.NoHoSXUyjbM1rGy4bJVq0uf81av0fEO_0 2024-09-12T01:21:57.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14015993012995404282', time=2024-09-12T03:14:16.685101+0000, chain.objs.size()=1 2024-09-12T01:21:57.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:DB1j-mhW2H4TodtIn3mzVhjmZbF7L7M_.yMgSqC9Uj2wxaNe9IMfQBThvmgGY4jY_0 2024-09-12T01:21:57.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2881580303242938141', time=2024-09-12T03:14:34.208653+0000, chain.objs.size()=1 2024-09-12T01:21:57.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:zVyWVIMMso3YKi8RVmiBXUqi2-AnooX_.Cw2xMh0c9bhUilNdpCmYAk5Cbx_-EjM_0 2024-09-12T01:21:57.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11632305314617368365', time=2024-09-12T03:14:39.870418+0000, chain.objs.size()=1 2024-09-12T01:21:57.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.228+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:WzGW2EUy0fz7hq04FJlmAmxKbYEpkvv_.hI_Ijwh3caSFmHatm40_Q1HDP3zbJhe_0 2024-09-12T01:21:57.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.232+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4891850289058298062', time=2024-09-12T03:18:18.371010+0000, chain.objs.size()=1 2024-09-12T01:21:57.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.232+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.680__shadow_.Tx9y3dlLLeA1SVD3POQ1oy4zZHTuR-x_0 2024-09-12T01:21:57.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.232+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:57.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:21:57.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:57.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:57.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47046' 2024-09-12T01:21:57.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4501256384683833750', time=2024-09-12T03:08:19.208041+0000, chain.objs.size()=1 2024-09-12T01:21:57.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.249__shadow_.D_bi_-dVbiv7Q0EBd-ZJQ0SPqkNORPB_0 2024-09-12T01:21:57.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10242502977415793282', time=2024-09-12T03:08:19.876061+0000, chain.objs.size()=1 2024-09-12T01:21:57.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.250__shadow_.yBIb499zbYqnO5MV6Zg4hl4uV-KX6tX_0 2024-09-12T01:21:57.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2892570841191986465', time=2024-09-12T03:08:19.880587+0000, chain.objs.size()=1 2024-09-12T01:21:57.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.250__shadow_.WLh0LJ-KAgQP_fj_grGlohqsYEOwxuU_0 2024-09-12T01:21:57.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12371139069301854122', time=2024-09-12T03:08:21.247842+0000, chain.objs.size()=1 2024-09-12T01:21:57.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.252__shadow_.4iVsyQxfZEVVmgMKfwx2wuqzfHwLqEQ_0 2024-09-12T01:21:57.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14846599359871797926', time=2024-09-12T03:08:26.740161+0000, chain.objs.size()=1 2024-09-12T01:21:57.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.260__shadow_.elR8mo_NAnAuyU8dXM9cJqc-1n49hD5_0 2024-09-12T01:21:57.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12041134457094519300', time=2024-09-12T03:08:27.447825+0000, chain.objs.size()=1 2024-09-12T01:21:57.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.261__shadow_.sVoBtZciAf9OtmBRPcqVgfGa0coZKTi_0 2024-09-12T01:21:57.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10533236437816753710', time=2024-09-12T03:08:47.520212+0000, chain.objs.size()=1 2024-09-12T01:21:57.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.VQlv7tAE9_2QxntYc8CSRwkVB-rhRAm_0 2024-09-12T01:21:57.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2260105337329133247', time=2024-09-12T03:08:47.622397+0000, chain.objs.size()=1 2024-09-12T01:21:57.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.p6SnXSmjSKmlu3E-_1arc0tFdp5l5Ll_0 2024-09-12T01:21:57.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4896322046431852482', time=2024-09-12T03:08:47.869965+0000, chain.objs.size()=1 2024-09-12T01:21:57.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ZocyIUajInB-HGceuQRF0WCpO7gecN4_0 2024-09-12T01:21:57.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9203072945589217180', time=2024-09-12T03:08:47.933486+0000, chain.objs.size()=1 2024-09-12T01:21:57.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.4647YBdUDZZS5ew9uWD-Il1HqstyPDC_0 2024-09-12T01:21:57.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10458514181025052008', time=2024-09-12T03:08:47.979009+0000, chain.objs.size()=1 2024-09-12T01:21:57.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Ia17HOWDb30lJAN04q9D2jxkGELZcQ8_0 2024-09-12T01:21:57.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9129232308601020539', time=2024-09-12T03:08:48.263886+0000, chain.objs.size()=1 2024-09-12T01:21:57.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.236+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.EpuQ-8Or-2j_jB-QSoEMkmHi-C-GD1t_0 2024-09-12T01:21:57.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8855591893089258754', time=2024-09-12T03:08:48.315643+0000, chain.objs.size()=1 2024-09-12T01:21:57.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.dDG_hFJgGBUzr30wPoHvd6qVT9AvnbX_0 2024-09-12T01:21:57.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5821450164040224995', time=2024-09-12T03:08:48.352451+0000, chain.objs.size()=1 2024-09-12T01:21:57.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.n2hb3g4U5Q0-v-2u95NAKRkXbisN9TG_0 2024-09-12T01:21:57.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6819648300984187399', time=2024-09-12T03:08:48.692270+0000, chain.objs.size()=1 2024-09-12T01:21:57.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Vhb-N37kB18EB8LgpoW6QfYz3scgDaD_0 2024-09-12T01:21:57.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11161496543082255810', time=2024-09-12T03:08:48.971214+0000, chain.objs.size()=1 2024-09-12T01:21:57.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.cBLwbXtZcpI1z-PE4CaJPMvPxNyzPpk_0 2024-09-12T01:21:57.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2847225557368947241', time=2024-09-12T03:08:49.002209+0000, chain.objs.size()=1 2024-09-12T01:21:57.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.NOYSdNPhM0IKjpWXVdm2KczZQ5Yw69Y_0 2024-09-12T01:21:57.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2137141475738249073', time=2024-09-12T03:08:49.003830+0000, chain.objs.size()=1 2024-09-12T01:21:57.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.5F76ZYKOt5NhSRKEMa7nvGEVpdhgrST_0 2024-09-12T01:21:57.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17674504484881543670', time=2024-09-12T03:08:49.009305+0000, chain.objs.size()=1 2024-09-12T01:21:57.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.eW4tP5ePAn0rkIQ9ZVk6YxCTXsPiLtU_0 2024-09-12T01:21:57.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9580340198744178571', time=2024-09-12T03:08:49.217690+0000, chain.objs.size()=1 2024-09-12T01:21:57.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.UsviV2uydN1yQq5MmKs4slpCqCMxZH-_0 2024-09-12T01:21:57.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17491637410273337571', time=2024-09-12T03:08:49.219367+0000, chain.objs.size()=1 2024-09-12T01:21:57.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.5P61gX_tfl4o6JavstwNEWwfKgAhl6W_0 2024-09-12T01:21:57.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14535734757773072194', time=2024-09-12T03:08:49.258786+0000, chain.objs.size()=1 2024-09-12T01:21:57.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.DbLZhlt4DFd1z6w5Vx_NChEh8Qj1U_9_0 2024-09-12T01:21:57.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.36794089491221207', time=2024-09-12T03:08:49.269472+0000, chain.objs.size()=1 2024-09-12T01:21:57.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.WEr7Z05O3wMOI6vSx1XFTeAV2xU75hr_0 2024-09-12T01:21:57.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.219858420606053974', time=2024-09-12T03:08:49.582284+0000, chain.objs.size()=1 2024-09-12T01:21:57.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.iIzvKOllh1zeqHZznFq3binleIVy-EM_0 2024-09-12T01:21:57.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7071620106208798554', time=2024-09-12T03:08:49.669770+0000, chain.objs.size()=1 2024-09-12T01:21:57.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Ug9rREGXmFA8dKfPWB-eZI8HSLCcgg7_0 2024-09-12T01:21:57.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12612824403190968427', time=2024-09-12T03:08:49.684665+0000, chain.objs.size()=1 2024-09-12T01:21:57.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.peQP3uGerHtmR0MXyxbzizzfIteLicJ_0 2024-09-12T01:21:57.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3218883535045335605', time=2024-09-12T03:08:49.741647+0000, chain.objs.size()=1 2024-09-12T01:21:57.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.kwGF3FPao6wighw3gNcCuwIdJtNOFTb_0 2024-09-12T01:21:57.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12203049473596759985', time=2024-09-12T03:08:49.748610+0000, chain.objs.size()=1 2024-09-12T01:21:57.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Bl9vYjGSgN0L85sy17x4b1l4Bo2b1gP_0 2024-09-12T01:21:57.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5273023409594909777', time=2024-09-12T03:08:49.918825+0000, chain.objs.size()=1 2024-09-12T01:21:57.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Uiil030X1t3mh1TnIbN7_nuks8ZiHEs_0 2024-09-12T01:21:57.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5518581440573677369', time=2024-09-12T03:08:49.921932+0000, chain.objs.size()=1 2024-09-12T01:21:57.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.240+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.J1JieX7LPxHi3CmuxezF_ULVs3TXuMY_0 2024-09-12T01:21:57.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15897565263764973524', time=2024-09-12T03:08:49.938371+0000, chain.objs.size()=1 2024-09-12T01:21:57.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.f1pmsE58JcFaXPuxg1GYqjLN7csyPlJ_0 2024-09-12T01:21:57.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8437749766372828076', time=2024-09-12T03:08:50.033753+0000, chain.objs.size()=1 2024-09-12T01:21:57.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.rssFdpORMNDYgtxM3Y7IA6qCTgvawUH_0 2024-09-12T01:21:57.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3046078773527808151', time=2024-09-12T03:08:53.285881+0000, chain.objs.size()=1 2024-09-12T01:21:57.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.268__shadow_.xP-DSLlDdZoN5b7tAjD0Bl-2p4Phapj_0 2024-09-12T01:21:57.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7100916711120491154', time=2024-09-12T03:08:55.355043+0000, chain.objs.size()=1 2024-09-12T01:21:57.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.271__shadow_.SGDLKZqDuRDh98o5xxUVZzDvCuOak97_0 2024-09-12T01:21:57.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11774077032421779313', time=2024-09-12T03:08:56.671490+0000, chain.objs.size()=1 2024-09-12T01:21:57.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.273__shadow_.YDfnIhMihVKnHG1P_isNcej0hlFdQI7_0 2024-09-12T01:21:57.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1105587640196104935', time=2024-09-12T03:09:05.043787+0000, chain.objs.size()=1 2024-09-12T01:21:57.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.285__shadow_.hoXvzUaVthDa3KDo1jReO4JOIRup2Xg_0 2024-09-12T01:21:57.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11868412866122036083', time=2024-09-12T03:09:06.469645+0000, chain.objs.size()=1 2024-09-12T01:21:57.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.287__shadow_.wwV-d9Mln-QG30Wh84hx2HvXdSq-LGg_0 2024-09-12T01:21:57.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2564330673339449510', time=2024-09-12T03:09:13.039665+0000, chain.objs.size()=1 2024-09-12T01:21:57.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.294__shadow_.JvKCYnuRRNqQHAPIcxRaH0hL7YIRV1S_0 2024-09-12T01:21:57.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16975191277673557362', time=2024-09-12T03:09:15.124226+0000, chain.objs.size()=1 2024-09-12T01:21:57.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.297__shadow_.VpNThk2EEZ3UWlZCh_GfAxW9EzsNSUW_0 2024-09-12T01:21:57.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7524598546556619923', time=2024-09-12T03:09:18.004800+0000, chain.objs.size()=1 2024-09-12T01:21:57.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.301__shadow_.F1mDtG3JdUQMRapP3ILtjS3X14rLtiA_0 2024-09-12T01:21:57.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2980539338196212150', time=2024-09-12T03:09:52.920040+0000, chain.objs.size()=1 2024-09-12T01:21:57.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.032UIdO-1eVu2Goy4UXESHFmgKTYKZC_0 2024-09-12T01:21:57.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16767718688338462979', time=2024-09-12T03:09:52.960446+0000, chain.objs.size()=1 2024-09-12T01:21:57.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.RI5BWlcAYoFB7-yaC6erJs0Xgw7oCdY_0 2024-09-12T01:21:57.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9666758889768882833', time=2024-09-12T03:09:52.967558+0000, chain.objs.size()=1 2024-09-12T01:21:57.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.3hLolMumniCev-zNVZ-kOtcsLEg_Fr4_0 2024-09-12T01:21:57.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.543135390638837018', time=2024-09-12T03:09:52.981292+0000, chain.objs.size()=1 2024-09-12T01:21:57.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.VFWdxGlh7tY3REKfDVXTezkTllsvzX-_0 2024-09-12T01:21:57.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2602458538854588540', time=2024-09-12T03:09:53.124677+0000, chain.objs.size()=1 2024-09-12T01:21:57.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.KSIggdUTWF44zTnPvOOBB4tmtjOJV6B_0 2024-09-12T01:21:57.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10029490530554269098', time=2024-09-12T03:09:53.138969+0000, chain.objs.size()=1 2024-09-12T01:21:57.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.244+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.z7aVx0EmYsgWOqrgSb5irjvQexC_Evu_0 2024-09-12T01:21:57.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2431502891192236190', time=2024-09-12T03:09:53.394051+0000, chain.objs.size()=1 2024-09-12T01:21:57.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ZBlGaZErV4iwsl331bodV-sGBQs7sKh_0 2024-09-12T01:21:57.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17533017983054797011', time=2024-09-12T03:09:53.414707+0000, chain.objs.size()=1 2024-09-12T01:21:57.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.vxZqOWyohlHq12az0JknrjuGSAkAvCF_0 2024-09-12T01:21:57.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1327905880836174959', time=2024-09-12T03:09:53.438690+0000, chain.objs.size()=1 2024-09-12T01:21:57.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.AoC54ph3Y77Sgl2Egpd8gbL8Zy7enxf_0 2024-09-12T01:21:57.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15436614651042474716', time=2024-09-12T03:09:53.456685+0000, chain.objs.size()=1 2024-09-12T01:21:57.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.5tkoviS-SrYyPAN4guLoWCpBPbgLrTO_0 2024-09-12T01:21:57.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14914961867086568992', time=2024-09-12T03:09:53.641066+0000, chain.objs.size()=1 2024-09-12T01:21:57.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.kiDF9Np3wkmLHFuihHIEEYQN0htRamf_0 2024-09-12T01:21:57.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7423081114856018999', time=2024-09-12T03:09:53.748889+0000, chain.objs.size()=1 2024-09-12T01:21:57.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.pilLKId2F14kXY1gD56CkinSOI7QjPG_0 2024-09-12T01:21:57.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2414338343127937653', time=2024-09-12T03:09:53.755295+0000, chain.objs.size()=1 2024-09-12T01:21:57.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.3u6a6qERlIoEifuLxEtlLwmdJTU8Adz_0 2024-09-12T01:21:57.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7134417260771744997', time=2024-09-12T03:09:53.785536+0000, chain.objs.size()=1 2024-09-12T01:21:57.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.6whiiA_t444s-kHM-qBLSwXngYcGuAw_0 2024-09-12T01:21:57.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1513872803628473734', time=2024-09-12T03:09:53.786319+0000, chain.objs.size()=1 2024-09-12T01:21:57.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Ml2W5Zxte6WgpGyFoWyCqiWiXjcIPxN_0 2024-09-12T01:21:57.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3487657269997703111', time=2024-09-12T03:09:53.971543+0000, chain.objs.size()=1 2024-09-12T01:21:57.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.UWOp3W10zX3Wu3FRY-PFUkGMWrFScoI_0 2024-09-12T01:21:57.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8964778506325589735', time=2024-09-12T03:09:53.978361+0000, chain.objs.size()=1 2024-09-12T01:21:57.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.c2SxhYVqYyP6pDdxyn-p6NsGgf3XuTX_0 2024-09-12T01:21:57.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4778030308301805340', time=2024-09-12T03:09:53.982914+0000, chain.objs.size()=1 2024-09-12T01:21:57.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Aqdb-eL5m-MiRPEJQlLsZoYJk2NwFQi_0 2024-09-12T01:21:57.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8354276498922124907', time=2024-09-12T03:09:54.001091+0000, chain.objs.size()=1 2024-09-12T01:21:57.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.gb9U56xXv6ZiuX9AjDjDq9hA7UXpWym_0 2024-09-12T01:21:57.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11566529830330962704', time=2024-09-12T03:09:54.176675+0000, chain.objs.size()=1 2024-09-12T01:21:57.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.VSb-9rw371ywh7wdsKoKJ9cW_r5jk2S_0 2024-09-12T01:21:57.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10529231280751658930', time=2024-09-12T03:09:54.356051+0000, chain.objs.size()=1 2024-09-12T01:21:57.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.buyuimZC8xDcMXzwltxLxeTq8o70DFy_0 2024-09-12T01:21:57.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8887520137398761899', time=2024-09-12T03:09:54.385473+0000, chain.objs.size()=1 2024-09-12T01:21:57.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.248+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.K68oCg38IYYCQ2L39qOB8nsXwyT3eT7_0 2024-09-12T01:21:57.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9915442420824654186', time=2024-09-12T03:09:54.429313+0000, chain.objs.size()=1 2024-09-12T01:21:57.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.eHnxZu20A36R416-_f9zBRIdgC5dTGG_0 2024-09-12T01:21:57.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12353672941306439436', time=2024-09-12T03:09:54.431038+0000, chain.objs.size()=1 2024-09-12T01:21:57.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Jmr-0dcu_mf9r1Be8cC7UolONYRSILt_0 2024-09-12T01:21:57.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15944724833280841098', time=2024-09-12T03:09:54.455264+0000, chain.objs.size()=1 2024-09-12T01:21:57.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.xYIW-PNXT4cOXJVvpdu02WWWItd4xZY_0 2024-09-12T01:21:57.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6741509654441620821', time=2024-09-12T03:09:54.458103+0000, chain.objs.size()=1 2024-09-12T01:21:57.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Rgxg_OMazfvC20PzLfsXQI4XSdq3QFE_0 2024-09-12T01:21:57.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16430557082043474024', time=2024-09-12T03:09:54.488629+0000, chain.objs.size()=1 2024-09-12T01:21:57.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Ms60cQ3ZK_pJzRXr3P24K5bOYYGtXL__0 2024-09-12T01:21:57.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17979621892580086551', time=2024-09-12T03:09:54.701705+0000, chain.objs.size()=1 2024-09-12T01:21:57.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.8RXltrQuikExyQrbVC6AoIKzl42P91P_0 2024-09-12T01:21:57.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11922581561434366022', time=2024-09-12T03:09:54.728349+0000, chain.objs.size()=1 2024-09-12T01:21:57.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.G1r_MTOETilCjwcTJiPOtKATLNqv5_T_0 2024-09-12T01:21:57.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1513928383087697827', time=2024-09-12T03:09:54.766377+0000, chain.objs.size()=1 2024-09-12T01:21:57.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.eduekF2enhtqw1mPptq9oixBBnPYfyl_0 2024-09-12T01:21:57.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18191177938994292547', time=2024-09-12T03:09:54.804083+0000, chain.objs.size()=1 2024-09-12T01:21:57.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.XDOxsx2Tcd1Vrcg2rYyBR7ZlpIp5Tqf_0 2024-09-12T01:21:57.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12284555965642468180', time=2024-09-12T03:09:54.960074+0000, chain.objs.size()=1 2024-09-12T01:21:57.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.8GEg8Gy_LPItxmKDQV_Nc-f0FPg1Rn2_0 2024-09-12T01:21:57.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15607778382908737760', time=2024-09-12T03:09:54.984662+0000, chain.objs.size()=1 2024-09-12T01:21:57.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.YyG3ZcluRftZESjrCKu02nn51urXMZg_0 2024-09-12T01:21:57.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8142976148944373068', time=2024-09-12T03:09:55.015811+0000, chain.objs.size()=1 2024-09-12T01:21:57.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.LYEUnKM4mucd5Oen_PZEpx3HFG9iMl9_0 2024-09-12T01:21:57.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5777241809907080255', time=2024-09-12T03:09:55.100339+0000, chain.objs.size()=1 2024-09-12T01:21:57.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.s7csWkCT00DDiaTsFGoBewckqh6MAv5_0 2024-09-12T01:21:57.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12072840767969673548', time=2024-09-12T03:09:55.145966+0000, chain.objs.size()=1 2024-09-12T01:21:57.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.W_MEfNSdnFpy4YMIlC_YReyAC8XapB0_0 2024-09-12T01:21:57.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4387046924655166330', time=2024-09-12T03:09:55.402556+0000, chain.objs.size()=1 2024-09-12T01:21:57.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.bCw7VA4aLr0947pjROaZp837ZzwvRXn_0 2024-09-12T01:21:57.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3750305526197574557', time=2024-09-12T03:09:55.422097+0000, chain.objs.size()=1 2024-09-12T01:21:57.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.66ipSs5aY81W7p8g0ExrnS762DwoIi9_0 2024-09-12T01:21:57.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12314329661402333325', time=2024-09-12T03:10:15.212363+0000, chain.objs.size()=1 2024-09-12T01:21:57.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.qTxOXumpOB9vH7tyMw08gc9ZNdLufJi_0 2024-09-12T01:21:57.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.64124518150545220', time=2024-09-12T03:10:15.268097+0000, chain.objs.size()=1 2024-09-12T01:21:57.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.90i3Cu8LXt3HjUoolB1gaAAsKiQoeVp_0 2024-09-12T01:21:57.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15276459682961621413', time=2024-09-12T03:10:15.282611+0000, chain.objs.size()=1 2024-09-12T01:21:57.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.zNPI638lLfhTaY0XP2jZrhEm_udMexY_0 2024-09-12T01:21:57.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1828627987200625337', time=2024-09-12T03:10:15.355003+0000, chain.objs.size()=1 2024-09-12T01:21:57.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.yHZ-GnZqNwkuc1-L7t-MjxC8YfxzWv1_0 2024-09-12T01:21:57.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13159805020093663956', time=2024-09-12T03:10:15.413001+0000, chain.objs.size()=1 2024-09-12T01:21:57.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.rlQBHvSg0wTFmbr1TgBxX9for0bh9NE_0 2024-09-12T01:21:57.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9231411499008781997', time=2024-09-12T03:10:15.445880+0000, chain.objs.size()=1 2024-09-12T01:21:57.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.252+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.0UnDpNZXIAi3ffW8eeIDprCIVTHQI2m_0 2024-09-12T01:21:57.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3553750339536117936', time=2024-09-12T03:10:15.699671+0000, chain.objs.size()=1 2024-09-12T01:21:57.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.NEwTgBeDYd_X3N2UULXF3Gam-hjf2Ba_0 2024-09-12T01:21:57.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7806898854283162385', time=2024-09-12T03:10:15.712410+0000, chain.objs.size()=1 2024-09-12T01:21:57.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.8BdbyCWSBInvymXrztwxtPKTrJSdPxn_0 2024-09-12T01:21:57.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.432598265907541179', time=2024-09-12T03:10:15.739632+0000, chain.objs.size()=1 2024-09-12T01:21:57.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.b-5EilWUtMfxV4a8-8qdUlWZe8eVaE-_0 2024-09-12T01:21:57.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6084784937479962805', time=2024-09-12T03:10:15.744660+0000, chain.objs.size()=1 2024-09-12T01:21:57.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.KXnEmNW7oZB0xspKk5Y3nNobou1JN_V_0 2024-09-12T01:21:57.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16846427897833936186', time=2024-09-12T03:10:15.937402+0000, chain.objs.size()=1 2024-09-12T01:21:57.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.l8SrXzMQOAvLLlMW6DYPb9CMRkK1XZZ_0 2024-09-12T01:21:57.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7273283421200597956', time=2024-09-12T03:10:15.987163+0000, chain.objs.size()=1 2024-09-12T01:21:57.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.mK8S7SkqDhnp93I7iCs5GWfXRM1d6i0_0 2024-09-12T01:21:57.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4709587007824974702', time=2024-09-12T03:10:16.003813+0000, chain.objs.size()=1 2024-09-12T01:21:57.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Eqx7aNxseHIcsWC2IhkjPLcZzsDzwJ4_0 2024-09-12T01:21:57.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6092974713928042281', time=2024-09-12T03:10:16.081793+0000, chain.objs.size()=1 2024-09-12T01:21:57.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.SQDhSM_poKBaM4q7UxnJet1feOJ_sfp_0 2024-09-12T01:21:57.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14728561722585368362', time=2024-09-12T03:10:16.302342+0000, chain.objs.size()=1 2024-09-12T01:21:57.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.5LLfDBj8WTiOOsYj19v1d3mCQ_sXg-Z_0 2024-09-12T01:21:57.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9244051587890892235', time=2024-09-12T03:10:16.366085+0000, chain.objs.size()=1 2024-09-12T01:21:57.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.alIaD2KXL5mXs0LXcRUw2HxqCm0bifm_0 2024-09-12T01:21:57.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17793119020247199407', time=2024-09-12T03:10:16.806799+0000, chain.objs.size()=1 2024-09-12T01:21:57.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ASXgQEhJ5LW22of77-cGjR7ye0aM4XH_0 2024-09-12T01:21:57.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17808189248559581588', time=2024-09-12T03:10:16.823156+0000, chain.objs.size()=1 2024-09-12T01:21:57.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.zgD_7EADZji1KzWgeXSyNh7OHSt-1hx_0 2024-09-12T01:21:57.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2416927457721761086', time=2024-09-12T03:10:16.889498+0000, chain.objs.size()=1 2024-09-12T01:21:57.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.5iGmB_9uR0co9of2RuhkqLAoHV7BFJN_0 2024-09-12T01:21:57.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8411346398626611410', time=2024-09-12T03:10:17.162918+0000, chain.objs.size()=1 2024-09-12T01:21:57.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.uQP-OEtxUq034dl2aIMq-sUdKK2nKlp_0 2024-09-12T01:21:57.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5353041005216444988', time=2024-09-12T03:10:17.186208+0000, chain.objs.size()=1 2024-09-12T01:21:57.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.4LiioxqB3wz_z-THrNHJncGeEDI4Xxm_0 2024-09-12T01:21:57.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2259964074749334907', time=2024-09-12T03:10:17.213274+0000, chain.objs.size()=1 2024-09-12T01:21:57.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.256+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.3t12H0-Nd6s9a3j79TZYsAtFsb9W8Mv_0 2024-09-12T01:21:57.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.260+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47046 2024-09-12T01:21:57.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.260+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-12T01:21:57.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.260+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3221208595130924999', time=2024-09-12T03:10:17.227356+0000, chain.objs.size()=1 2024-09-12T01:21:57.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.260+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.AhRaCbExv9DUJwgFnbMQK6k-Sgm4Fi6_0 2024-09-12T01:21:57.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.260+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15857383457948952703', time=2024-09-12T03:10:17.310260+0000, chain.objs.size()=1 2024-09-12T01:21:57.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.260+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.8s4bjuKJnp5d1HGTVFOsXn9Tpe2eD2v_0 2024-09-12T01:21:57.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.260+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10062580132371319602', time=2024-09-12T03:10:17.323915+0000, chain.objs.size()=1 2024-09-12T01:21:57.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.260+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.PxQgZTB3As0coVnSWcVAQcOKHhF3Qjy_0 2024-09-12T01:21:57.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.260+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16022687777778844575', time=2024-09-12T03:10:17.479446+0000, chain.objs.size()=1 2024-09-12T01:21:57.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.260+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.qQljAzs3gGPbDJOvyIH2z_DE2lGVdUm_0 2024-09-12T01:21:57.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.260+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12002389120774078762', time=2024-09-12T03:10:17.511422+0000, chain.objs.size()=1 2024-09-12T01:21:57.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.260+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.keYnjfbDRDEjV4ivNs1TvEgw_Fzr69O_0 2024-09-12T01:21:57.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.260+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2244846558476977666', time=2024-09-12T03:10:17.567806+0000, chain.objs.size()=1 2024-09-12T01:21:57.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.260+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.06jafMR0h1_XpOVJ8mk3HXRI_HMb1W8_0 2024-09-12T01:21:57.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.260+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9074408954218078103', time=2024-09-12T03:10:17.627373+0000, chain.objs.size()=1 2024-09-12T01:21:57.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.260+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.YcdltGJ3d2qvj9xrw-uwa8_pjzWXW8P_0 2024-09-12T01:21:57.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.260+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3278499545647057410', time=2024-09-12T03:10:17.737473+0000, chain.objs.size()=1 2024-09-12T01:21:57.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.260+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.JBejUXOj4t1yedSyO8aw7hh37KVvjq4_0 2024-09-12T01:21:57.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.260+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17470479050388837453', time=2024-09-12T03:10:17.808062+0000, chain.objs.size()=1 2024-09-12T01:21:57.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.260+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.zTuz8lsPTEt4d0Olm_wqKsUSJwyguqx_0 2024-09-12T01:21:57.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.260+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18039284802444218229', time=2024-09-12T03:10:17.824122+0000, chain.objs.size()=1 2024-09-12T01:21:57.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.260+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Wk2_BpAWyRBzdswPXyhpcC9duusCIju_0 2024-09-12T01:21:57.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.260+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3641247960558482058', time=2024-09-12T03:10:17.830534+0000, chain.objs.size()=1 2024-09-12T01:21:57.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.260+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.pMzbDxlbbpiFTCCb83ejuddfvZbyaEA_0 2024-09-12T01:21:57.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.260+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14377721549876625664', time=2024-09-12T03:10:55.711381+0000, chain.objs.size()=1 2024-09-12T01:21:57.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.260+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.385__shadow_.8_s7REUcpqKU4536LLmMT4UWz5-KsLo_0 2024-09-12T01:21:57.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2290757880469452242', time=2024-09-12T03:11:28.810223+0000, chain.objs.size()=1 2024-09-12T01:21:57.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.432__shadow_.chhex_-g_TeZyjemhsQVb4WK2fJuF_e_0 2024-09-12T01:21:57.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.581101594467357855', time=2024-09-12T03:11:34.800376+0000, chain.objs.size()=1 2024-09-12T01:21:57.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.441__shadow_.bulilXuF6rtTyw-7m6GxAoLgQ7J6gnq_0 2024-09-12T01:21:57.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2561975406512471412', time=2024-09-12T03:11:48.477328+0000, chain.objs.size()=1 2024-09-12T01:21:57.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.458__shadow_.waqn0rafawtQY0R6k6oDDXNfmdjhHRB_0 2024-09-12T01:21:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3218553041168086652', time=2024-09-12T03:12:11.089136+0000, chain.objs.size()=1 2024-09-12T01:21:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.492__shadow_.uuCvT7liYOpSe6mkX_WJdIUHti2Xz0X_0 2024-09-12T01:21:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2969084263686639519', time=2024-09-12T03:12:15.510551+0000, chain.objs.size()=1 2024-09-12T01:21:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.501__shadow_.9LW5R3TzMHi89LnGCYrcoeB7mtDLA5u_0 2024-09-12T01:21:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9350902309049332084', time=2024-09-12T03:12:18.301095+0000, chain.objs.size()=1 2024-09-12T01:21:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.504__shadow:fzRg7xrdrpV0hjFUnNiyrRjat2TjEPZ_.vHz-mc05LslsPFizOQCh8qlCeQstO_b_0 2024-09-12T01:21:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3974845688918994550', time=2024-09-12T03:12:58.740370+0000, chain.objs.size()=2 2024-09-12T01:21:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.526__multipart_mymultipart.2~tjOIckrFI_vUuJh9KW1XRk3TiOmp13K.1 2024-09-12T01:21:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.526__multipart_mymultipart.2~tjOIckrFI_vUuJh9KW1XRk3TiOmp13K.2 2024-09-12T01:21:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~QL8euX9fjib4QFsrGx9YqPKIQkcKFXk', time=2024-09-12T03:13:10.509903+0000, chain.objs.size()=1 2024-09-12T01:21:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.536__multipart_mymultipart.2~QL8euX9fjib4QFsrGx9YqPKIQkcKFXk.3 2024-09-12T01:21:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12777092347892193893', time=2024-09-12T03:14:11.894444+0000, chain.objs.size()=1 2024-09-12T01:21:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:TvfDrH2WnYwZd7c8xtIW9WoJsPP5uJC_.nR6vRnu5x7DnpltBt5aPjCSzIST3kxT_0 2024-09-12T01:21:57.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10576013268147844620', time=2024-09-12T03:14:13.193147+0000, chain.objs.size()=1 2024-09-12T01:21:57.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:g2CwkCc4BQ.uS1RtQ4G1TeTKxO4bdWN_.5ms4bRgGdjZ91orERfcwU2D9-gO6Re6_0 2024-09-12T01:21:57.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8801017013098730230', time=2024-09-12T03:14:28.393597+0000, chain.objs.size()=1 2024-09-12T01:21:57.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.577__shadow:vWm0r.HF4nbxB1NfGfJunt-0vxCVRyp_.KYSmLdGj3xUw09DVBqE_g19eddbuXNV_0 2024-09-12T01:21:57.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9909812082661621330', time=2024-09-12T03:17:50.351961+0000, chain.objs.size()=2 2024-09-12T01:21:57.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.643__shadow_.mEolNYqDy090oLjjGaFya60liFek9Pa_0 2024-09-12T01:21:57.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.643__shadow_.mEolNYqDy090oLjjGaFya60liFek9Pa_1 2024-09-12T01:21:57.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1609436502925307273', time=2024-09-12T03:17:56.536070+0000, chain.objs.size()=1 2024-09-12T01:21:57.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.650__shadow_.z99jPTltfFsZsaHE4LRchvaDJUGCPls_0 2024-09-12T01:21:57.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14856524655991073812', time=2024-09-12T03:18:09.223131+0000, chain.objs.size()=1 2024-09-12T01:21:57.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.665__shadow_.KT_CbUEobOXtlbK9U_abvkR0U_YYY4W_0 2024-09-12T01:21:57.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14866269781117343904', time=2024-09-12T03:18:31.497725+0000, chain.objs.size()=1 2024-09-12T01:21:57.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.702__shadow:EkVpV5Sg3SChk1biPZ0gp3W35XVCVFV_.0C-qDBkXXulgL75Acehkcw9Os3WLbex_0 2024-09-12T01:21:57.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14984293685138376533', time=2024-09-12T03:19:16.986814+0000, chain.objs.size()=1 2024-09-12T01:21:57.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.264+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.741__shadow_.1V-OneI-4jgi0j39U3n5ZbhB825as1n_0 2024-09-12T01:21:57.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.268+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:57.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.268+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:21:57.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.272+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:57.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.272+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:57.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.272+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52849' 2024-09-12T01:21:57.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.272+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12416552622164311022', time=2024-09-12T03:06:36.911432+0000, chain.objs.size()=1 2024-09-12T01:21:57.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.272+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.200__shadow_.3dXetfOBszvGSCudYgZPsURkQ2qYVNm_0 2024-09-12T01:21:57.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.272+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7918965295692157574', time=2024-09-12T03:08:10.272472+0000, chain.objs.size()=1 2024-09-12T01:21:57.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.272+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.238__shadow_.2sp6eFA-M1cirQpcHhkpYAZZaiwsndz_0 2024-09-12T01:21:57.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.272+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10431600771183711965', time=2024-09-12T03:08:15.285244+0000, chain.objs.size()=1 2024-09-12T01:21:57.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.272+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.244__shadow_.fzeAEIezNNXIvKdQxokNTGhA3IRetKy_0 2024-09-12T01:21:57.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.272+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3880359843722077112', time=2024-09-12T03:08:47.528703+0000, chain.objs.size()=1 2024-09-12T01:21:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.272+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.PClhzrLJUTeON9QsvzAD_s2hEa4kQ-2_0 2024-09-12T01:21:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.272+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7561417259288035228', time=2024-09-12T03:08:47.572270+0000, chain.objs.size()=1 2024-09-12T01:21:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.272+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.h11zBfA3Os75pnGOHtqHtILg14w-bfT_0 2024-09-12T01:21:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.272+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13772621053725390664', time=2024-09-12T03:08:47.580593+0000, chain.objs.size()=1 2024-09-12T01:21:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.272+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.5Q5Y87A8ZgQ6Nf4UxUNhc5P2uhYDEwh_0 2024-09-12T01:21:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.272+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2701794833802459677', time=2024-09-12T03:08:47.654277+0000, chain.objs.size()=1 2024-09-12T01:21:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.272+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Q1Q8TU_HbKPd_EFvvdHmRm4glo5vdYb_0 2024-09-12T01:21:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.272+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.246010797089309006', time=2024-09-12T03:08:47.799164+0000, chain.objs.size()=1 2024-09-12T01:21:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.272+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Z43Np6mlTtdt9TfI4e7u3tDWPNSVk1U_0 2024-09-12T01:21:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.272+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12452182594609885959', time=2024-09-12T03:08:47.889060+0000, chain.objs.size()=1 2024-09-12T01:21:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.272+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Pjkxyz-IeGuUnnhwrWaZxmqAKcNp9uE_0 2024-09-12T01:21:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.272+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8327204225587256930', time=2024-09-12T03:08:47.933421+0000, chain.objs.size()=1 2024-09-12T01:21:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.272+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.hjnoUsp2LJaDcsELFhiPmDCz6vn-LF3_0 2024-09-12T01:21:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.272+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5400561700556023107', time=2024-09-12T03:08:47.958698+0000, chain.objs.size()=1 2024-09-12T01:21:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.272+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.UOMoF5UJbVIQ-kaLN3fBZzocog5STtL_0 2024-09-12T01:21:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.272+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10359752589410944078', time=2024-09-12T03:08:47.969995+0000, chain.objs.size()=1 2024-09-12T01:21:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.272+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.vjZkrZTIjzIa2KBbpv708nleJmUqauY_0 2024-09-12T01:21:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4330287671628725348', time=2024-09-12T03:08:47.998063+0000, chain.objs.size()=1 2024-09-12T01:21:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Vu9FvdrhTg88uMVMAwj3Uf0TpxCpQlh_0 2024-09-12T01:21:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15839163653931988178', time=2024-09-12T03:08:48.158233+0000, chain.objs.size()=1 2024-09-12T01:21:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.srXUOMhZKNxVbIrHbHmC308hsAUjNl-_0 2024-09-12T01:21:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4455965920104858257', time=2024-09-12T03:08:48.196091+0000, chain.objs.size()=1 2024-09-12T01:21:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.z4x9ZXmtMF5s1TmuBTZjzxkUetK05E3_0 2024-09-12T01:21:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1436356706729746397', time=2024-09-12T03:08:48.202603+0000, chain.objs.size()=1 2024-09-12T01:21:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.HQmOS17PmYN_jEiA7dQOlT9satsXCmK_0 2024-09-12T01:21:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8948839869632472543', time=2024-09-12T03:08:48.250585+0000, chain.objs.size()=1 2024-09-12T01:21:57.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.wHBm8aQU2FbrpXy4MZo9wzWlDgYXHNx_0 2024-09-12T01:21:57.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15324925437415586666', time=2024-09-12T03:08:48.314911+0000, chain.objs.size()=1 2024-09-12T01:21:57.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.bJV64h20lyA2_dGjQsKVJwhJZzdDjNZ_0 2024-09-12T01:21:57.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17149357822915910665', time=2024-09-12T03:08:48.499063+0000, chain.objs.size()=1 2024-09-12T01:21:57.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.u0XEhtYW9CDl-KXhaL3SWp0Rp1VLc-q_0 2024-09-12T01:21:57.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16863754547822428975', time=2024-09-12T03:08:48.613915+0000, chain.objs.size()=1 2024-09-12T01:21:57.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.uvJnnhSFQVkG-KOUbMb5FM4dzTDUGXY_0 2024-09-12T01:21:57.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17160205695967364840', time=2024-09-12T03:08:48.626536+0000, chain.objs.size()=1 2024-09-12T01:21:57.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.wptIF-Kh4xxO74c7iPm3EpcXFUi__lS_0 2024-09-12T01:21:57.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2304837204827743033', time=2024-09-12T03:08:48.671602+0000, chain.objs.size()=1 2024-09-12T01:21:57.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.vUvm8daNfhdtYluwGSrtgitbG_ydpbX_0 2024-09-12T01:21:57.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10122375665420927201', time=2024-09-12T03:08:49.009285+0000, chain.objs.size()=1 2024-09-12T01:21:57.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.CE4QTwN8C0Ka3N-bU37h6A3o1TKFIZc_0 2024-09-12T01:21:57.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13308783586208762238', time=2024-09-12T03:08:49.027390+0000, chain.objs.size()=1 2024-09-12T01:21:57.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.M8bANpaZ5IC_Q0wVmbexb1lbRZopJnQ_0 2024-09-12T01:21:57.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14794238063218343566', time=2024-09-12T03:08:49.183113+0000, chain.objs.size()=1 2024-09-12T01:21:57.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.S_tEOrusOlVgiygqaRYU0fQf5vMbXpw_0 2024-09-12T01:21:57.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10877079877954148306', time=2024-09-12T03:08:49.231796+0000, chain.objs.size()=1 2024-09-12T01:21:57.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ZArCFheB0lk6X7WsJUW-fkc_m3cj4Nt_0 2024-09-12T01:21:57.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11051091152471265156', time=2024-09-12T03:08:49.325275+0000, chain.objs.size()=1 2024-09-12T01:21:57.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.KiSimUu1jUhnrwi8hOD53oe2gnJLH0p_0 2024-09-12T01:21:57.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11094048211777874091', time=2024-09-12T03:08:49.356286+0000, chain.objs.size()=1 2024-09-12T01:21:57.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.3Dk3rDPQ8JlL_mJ7MEb4de-JwtxAd2n_0 2024-09-12T01:21:57.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5786414581065082722', time=2024-09-12T03:08:49.714469+0000, chain.objs.size()=1 2024-09-12T01:21:57.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.P04brEPd58AVaQ5n3tqIPniilEGgO-x_0 2024-09-12T01:21:57.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10566758861907621811', time=2024-09-12T03:08:49.724780+0000, chain.objs.size()=1 2024-09-12T01:21:57.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.R74QRz4FT47vzYlr3E6MvV_nPH5Ovdo_0 2024-09-12T01:21:57.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5192595667156823390', time=2024-09-12T03:08:49.736372+0000, chain.objs.size()=1 2024-09-12T01:21:57.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.hh982036xWdvPYUuW0uOknhlmh8oU9a_0 2024-09-12T01:21:57.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5997520453401794075', time=2024-09-12T03:08:49.737889+0000, chain.objs.size()=1 2024-09-12T01:21:57.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.yfDbG5bj2WpZ5gzYcKnaNgOSZoP50cr_0 2024-09-12T01:21:57.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2772247247655716184', time=2024-09-12T03:08:49.883704+0000, chain.objs.size()=1 2024-09-12T01:21:57.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.DjAQgZsxZyPKbLwLmhuSYdw_0rfFKKY_0 2024-09-12T01:21:57.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9142797044605745758', time=2024-09-12T03:08:50.027655+0000, chain.objs.size()=1 2024-09-12T01:21:57.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.276+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.5wy8MS1o0AuoyPONw3gEs6dYo6vXsIE_0 2024-09-12T01:21:57.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.280+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7799196547552944803', time=2024-09-12T03:08:50.045367+0000, chain.objs.size()=1 2024-09-12T01:21:57.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.280+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.-hV43yJX-WqWsUl-BmUkjAEvb5OjLAc_0 2024-09-12T01:21:57.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.280+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.113335581964295424', time=2024-09-12T03:08:56.670811+0000, chain.objs.size()=1 2024-09-12T01:21:57.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.280+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.273__shadow_.7gfnpuOQhtx1LIvobMF1591xagRJSVs_0 2024-09-12T01:21:57.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.280+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.775476615046306251', time=2024-09-12T03:08:58.705041+0000, chain.objs.size()=1 2024-09-12T01:21:57.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.280+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.276__shadow_.RNngihQMcmMNeV9sZXgoqslmB9NrwHc_0 2024-09-12T01:21:57.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.280+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10932048218682708196', time=2024-09-12T03:09:01.533505+0000, chain.objs.size()=1 2024-09-12T01:21:57.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.280+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.280__shadow_.UCuM6I3R13lgUQrmS5R_XP-xgcjACog_0 2024-09-12T01:21:57.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.280+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16439005550691122786', time=2024-09-12T03:09:03.681315+0000, chain.objs.size()=1 2024-09-12T01:21:57.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.280+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.283__shadow_.4o92SHdOZpL-Rg5dDSl8Fgxw91WCAYp_0 2024-09-12T01:21:57.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.280+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1377257185019507875', time=2024-09-12T03:09:06.469029+0000, chain.objs.size()=1 2024-09-12T01:21:57.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.280+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.287__shadow_.GUktmBNN7vFKecGidhMx6BIzdUM6O1B_0 2024-09-12T01:21:57.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.280+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14180733680528864085', time=2024-09-12T03:09:06.471470+0000, chain.objs.size()=1 2024-09-12T01:21:57.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.280+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.287__shadow_.1au7bWlBiNMW_pqkH9kGk_ywld0k60D_0 2024-09-12T01:21:57.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.280+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.993845552960563572', time=2024-09-12T03:09:09.235359+0000, chain.objs.size()=1 2024-09-12T01:21:57.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.280+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.291__shadow_.BU4ESnfBihzL1zEXddNtRmHcZiS6V-W_0 2024-09-12T01:21:57.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.280+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12608809696191359156', time=2024-09-12T03:09:11.636032+0000, chain.objs.size()=1 2024-09-12T01:21:57.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.280+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.293__shadow_.byrmSo6j0YJFGDcjJ39wPRoZ4TRRlfT_0 2024-09-12T01:21:57.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.280+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.542250775072183216', time=2024-09-12T03:09:13.081091+0000, chain.objs.size()=1 2024-09-12T01:21:57.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.280+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.294__shadow_.8XodqZFzudhZrO6zydn0El4l9AxWmxR_0 2024-09-12T01:21:57.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.280+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8667613299247494587', time=2024-09-12T03:09:17.232532+0000, chain.objs.size()=1 2024-09-12T01:21:57.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.280+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.300__shadow_.vX0i8f0IofbVD8lINx518c6EH-O8HEb_0 2024-09-12T01:21:57.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.280+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15432515785647596022', time=2024-09-12T03:09:18.698113+0000, chain.objs.size()=1 2024-09-12T01:21:57.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.280+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.302__shadow_.A4hJwS_TlnKaSwNT3UIoE5vZ1ctM-mW_0 2024-09-12T01:21:57.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.280+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17116863168919410605', time=2024-09-12T03:09:52.951104+0000, chain.objs.size()=1 2024-09-12T01:21:57.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.280+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.oKXmznTjMNxVrRLiKuKFz6LOKuYnRf3_0 2024-09-12T01:21:57.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.284+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16855546169725425613', time=2024-09-12T03:09:52.960153+0000, chain.objs.size()=1 2024-09-12T01:21:57.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.284+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.zchJRy4AJjdmLi9OvBjLDxpd8MIanjq_0 2024-09-12T01:21:57.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.284+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13938580436356030616', time=2024-09-12T03:09:52.983592+0000, chain.objs.size()=1 2024-09-12T01:21:57.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.284+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.hceTIgW9ippcxj9hSQCB-c-QWh44QNB_0 2024-09-12T01:21:57.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.284+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2092740016216853314', time=2024-09-12T03:09:53.041692+0000, chain.objs.size()=1 2024-09-12T01:21:57.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.284+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.AatFDLiXcYqsDFuWYKNvkB9_lOVkAFM_0 2024-09-12T01:21:57.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.284+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13109996603258872754', time=2024-09-12T03:09:53.287380+0000, chain.objs.size()=1 2024-09-12T01:21:57.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.284+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.g9LFCkF3X6rDnLBsIBZivW1B17ol4Go_0 2024-09-12T01:21:57.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.284+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9731714874997370558', time=2024-09-12T03:09:53.315675+0000, chain.objs.size()=1 2024-09-12T01:21:57.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.284+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.OOhRkJcZHziuIQtW84ZxVK0aoxUroFV_0 2024-09-12T01:21:57.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.284+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15868775417420194858', time=2024-09-12T03:09:53.383245+0000, chain.objs.size()=1 2024-09-12T01:21:57.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.284+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.67GPEP3u9UAf_IWHbAlY-pN9uy2iYiW_0 2024-09-12T01:21:57.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.284+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13463789477420634956', time=2024-09-12T03:09:53.448136+0000, chain.objs.size()=1 2024-09-12T01:21:57.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.284+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.1d2avOyNFHpvxSB4uvHg_zZC-bfJOYr_0 2024-09-12T01:21:57.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.284+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6895470498917997919', time=2024-09-12T03:09:53.484235+0000, chain.objs.size()=1 2024-09-12T01:21:57.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.284+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.409UF6ZYs-2StyAVv6oftNBo2LNNeXz_0 2024-09-12T01:21:57.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.284+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8361893803289411843', time=2024-09-12T03:09:53.707436+0000, chain.objs.size()=1 2024-09-12T01:21:57.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.284+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.GBv183LsV9ihwf6ZkNquwDciFJUcQm-_0 2024-09-12T01:21:57.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.284+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1852100542965923122', time=2024-09-12T03:09:53.717452+0000, chain.objs.size()=1 2024-09-12T01:21:57.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.284+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.zvcyRCoFMl9NDpEth2Tpdaur25pj1x-_0 2024-09-12T01:21:57.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.284+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9083184686902294506', time=2024-09-12T03:09:53.761749+0000, chain.objs.size()=1 2024-09-12T01:21:57.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.284+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.00CziB7i__BdMZ28CkV5s6dyQ_C7GM2_0 2024-09-12T01:21:57.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.284+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16179209978258189628', time=2024-09-12T03:09:54.141829+0000, chain.objs.size()=1 2024-09-12T01:21:57.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.XB6mWwvqYMlaFKpEY2Y25XHAvNgiJFO_0 2024-09-12T01:21:57.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7541488553867989228', time=2024-09-12T03:09:54.163786+0000, chain.objs.size()=1 2024-09-12T01:21:57.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.7VKQHuA72dQL529zTOxH2CSvqMit0ld_0 2024-09-12T01:21:57.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.826013313709756955', time=2024-09-12T03:09:54.335513+0000, chain.objs.size()=1 2024-09-12T01:21:57.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.f0uDzImFSzEXCtNrGRX6y596C3I5Nbt_0 2024-09-12T01:21:57.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15569267963810384957', time=2024-09-12T03:09:54.450885+0000, chain.objs.size()=1 2024-09-12T01:21:57.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.4mIQjjE6GTalnUXYG6623Azu3CbWD7a_0 2024-09-12T01:21:57.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13542026848854060462', time=2024-09-12T03:09:54.460821+0000, chain.objs.size()=1 2024-09-12T01:21:57.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.PqXHVPbkIshEnmgN80UHlFGOn7vTdj5_0 2024-09-12T01:21:57.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2126747534890082291', time=2024-09-12T03:09:54.622183+0000, chain.objs.size()=1 2024-09-12T01:21:57.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.pcY2ZssTJkk3mcYkQeDkzxoHh6_s0A8_0 2024-09-12T01:21:57.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4040298135449724074', time=2024-09-12T03:09:54.701904+0000, chain.objs.size()=1 2024-09-12T01:21:57.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.dl4GeCo81FkEDxnRBEBFz0c8wkQLiOn_0 2024-09-12T01:21:57.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8380998527818094496', time=2024-09-12T03:09:54.778484+0000, chain.objs.size()=1 2024-09-12T01:21:57.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Qk-JsmVv6ARYNvnNmPis7bMyVPT9FF0_0 2024-09-12T01:21:57.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14458027597759041447', time=2024-09-12T03:09:54.978604+0000, chain.objs.size()=1 2024-09-12T01:21:57.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.sonlfpdhvvYqkye5j1tPnE4NmnuypJa_0 2024-09-12T01:21:57.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1913830939563794115', time=2024-09-12T03:09:54.992253+0000, chain.objs.size()=1 2024-09-12T01:21:57.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.sOfCC_UO7pRPqBjkXTIlJCUaPwhLle7_0 2024-09-12T01:21:57.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17141248146087244442', time=2024-09-12T03:09:55.050954+0000, chain.objs.size()=1 2024-09-12T01:21:57.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.qkr-1j__zLdChHF2aYOGcLJNYO8uMfj_0 2024-09-12T01:21:57.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15426514750251350406', time=2024-09-12T03:09:55.083641+0000, chain.objs.size()=1 2024-09-12T01:21:57.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.1FUHQ_RH_gdrY4ZPTbOM3f_hRhg02qF_0 2024-09-12T01:21:57.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6164166190062232350', time=2024-09-12T03:09:55.280447+0000, chain.objs.size()=1 2024-09-12T01:21:57.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.vdi-LITTNufqOQgu60GYcoYr2g-yRNw_0 2024-09-12T01:21:57.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14632437701765305357', time=2024-09-12T03:09:55.305394+0000, chain.objs.size()=1 2024-09-12T01:21:57.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.E32c3RI4F_9PlfH5_itnjUAzxEihVLC_0 2024-09-12T01:21:57.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15753271336743352358', time=2024-09-12T03:09:55.397952+0000, chain.objs.size()=1 2024-09-12T01:21:57.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.9nxbqYbKujfanYzvsqqEPNSkWviMeuN_0 2024-09-12T01:21:57.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.902483238582734494', time=2024-09-12T03:10:15.369059+0000, chain.objs.size()=1 2024-09-12T01:21:57.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.iUETntZ4cfso48pz3BRtbxe05ZxBmjW_0 2024-09-12T01:21:57.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2179021739662665236', time=2024-09-12T03:10:15.641311+0000, chain.objs.size()=1 2024-09-12T01:21:57.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Av_uLDY8gxlp__CsympJGissb6uZKgv_0 2024-09-12T01:21:57.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5357579889159176088', time=2024-09-12T03:10:15.664562+0000, chain.objs.size()=1 2024-09-12T01:21:57.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.K64lvZ5fWEC03aS3v9fUYosPe5y9kMQ_0 2024-09-12T01:21:57.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9926629637602690515', time=2024-09-12T03:10:15.687190+0000, chain.objs.size()=1 2024-09-12T01:21:57.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.RNiP72na-vQJcVJq3k8qRDUSUIsu_Vb_0 2024-09-12T01:21:57.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12200550395106945836', time=2024-09-12T03:10:15.742863+0000, chain.objs.size()=1 2024-09-12T01:21:57.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.X8DFjr0qoSTYNWY_DFBHb-7e8DK4AG1_0 2024-09-12T01:21:57.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18151571740609725646', time=2024-09-12T03:10:15.994756+0000, chain.objs.size()=1 2024-09-12T01:21:57.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.dyxHabSpPVZVUF8jtFtwKJUuLoiOT3f_0 2024-09-12T01:21:57.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5189837052499745120', time=2024-09-12T03:10:16.257666+0000, chain.objs.size()=1 2024-09-12T01:21:57.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.QI2RsB6-zGvPnrOPlNIbTdN3XSDIabt_0 2024-09-12T01:21:57.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17894574127189653365', time=2024-09-12T03:10:16.328017+0000, chain.objs.size()=1 2024-09-12T01:21:57.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.316SEhnWdrIaZN6a2EsRXgxaOZ4CLPh_0 2024-09-12T01:21:57.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14010173862297542760', time=2024-09-12T03:10:16.620162+0000, chain.objs.size()=1 2024-09-12T01:21:57.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.288+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.lqUY4FQYSjOfFhxMg9WuLyP4vOcU8oe_0 2024-09-12T01:21:57.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16515964976817390757', time=2024-09-12T03:10:16.774814+0000, chain.objs.size()=1 2024-09-12T01:21:57.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.jR_mFZa__lhP2qju-Ux8OoBJINlesmW_0 2024-09-12T01:21:57.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.712010144722105168', time=2024-09-12T03:10:17.130232+0000, chain.objs.size()=1 2024-09-12T01:21:57.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Bs_umptY-h8DEN411NrbfMH_3RZkJRo_0 2024-09-12T01:21:57.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15236974150480008129', time=2024-09-12T03:10:17.178989+0000, chain.objs.size()=1 2024-09-12T01:21:57.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Nvf0gQnJhVhAIM5NNGeeTzg98JEFOY9_0 2024-09-12T01:21:57.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16749824958642815133', time=2024-09-12T03:10:17.237793+0000, chain.objs.size()=1 2024-09-12T01:21:57.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.xgEuEdN6kSqbYLEXqnoty09oaNWpRca_0 2024-09-12T01:21:57.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18017113913276065011', time=2024-09-12T03:10:17.267630+0000, chain.objs.size()=1 2024-09-12T01:21:57.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.IG97jfyvutv7oTpqxP5ks1AYK8YgHHE_0 2024-09-12T01:21:57.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.215734034315791828', time=2024-09-12T03:10:17.314585+0000, chain.objs.size()=1 2024-09-12T01:21:57.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.vq5JN5jR1aw8ds56IAi6MqWLci9hlQd_0 2024-09-12T01:21:57.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17121594069467646247', time=2024-09-12T03:10:17.430758+0000, chain.objs.size()=1 2024-09-12T01:21:57.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.u5IyduJBtAy1ZPM9Sac9Odiep07KwaT_0 2024-09-12T01:21:57.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9714655082005186167', time=2024-09-12T03:10:17.537703+0000, chain.objs.size()=1 2024-09-12T01:21:57.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.9GSbQ7EIh0IhPAYUxFfQp1ByK8pMsO5_0 2024-09-12T01:21:57.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1069656433566969976', time=2024-09-12T03:10:17.829668+0000, chain.objs.size()=1 2024-09-12T01:21:57.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ejn6GAwi4q0-EVYlcrVhYQEUJ2JDzal_0 2024-09-12T01:21:57.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7283155594601167981', time=2024-09-12T03:10:17.907544+0000, chain.objs.size()=1 2024-09-12T01:21:57.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.lCn_fAPistnADuWpKBdkrTpRKOWh3Ut_0 2024-09-12T01:21:57.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6731001588976863454', time=2024-09-12T03:11:50.483307+0000, chain.objs.size()=1 2024-09-12T01:21:57.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.460__shadow_.lckCkGR202AWohfg9cvK7lYkbif8GFs_0 2024-09-12T01:21:57.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17466448007353265405', time=2024-09-12T03:11:50.485123+0000, chain.objs.size()=1 2024-09-12T01:21:57.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.460__shadow_.QR_-6RP8iw4Bd6SpoYsfx5wyTpTsOhX_0 2024-09-12T01:21:57.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1510036654849030054', time=2024-09-12T03:11:55.313002+0000, chain.objs.size()=1 2024-09-12T01:21:57.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.465__shadow_.qbu25NFb9daqdUpO41CRtOKiuDYXehX_0 2024-09-12T01:21:57.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7351413451971347098', time=2024-09-12T03:11:56.192798+0000, chain.objs.size()=1 2024-09-12T01:21:57.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.466__shadow_.sikOabqZNiYi5ahdlKPB0tymKHdX88E_0 2024-09-12T01:21:57.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9634015265307347412', time=2024-09-12T03:12:25.746569+0000, chain.objs.size()=1 2024-09-12T01:21:57.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.292+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.515__shadow_.WnzYgBQzALvwVUNL_FCP_6Anjl8CvJc_0 2024-09-12T01:21:57.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.296+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8810542109623570042', time=2024-09-12T03:12:55.418295+0000, chain.objs.size()=1 2024-09-12T01:21:57.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.296+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.524__multipart_mymultipart.2~NzC8-es81nIcPkmVr_r455FypD6sUHD.1 2024-09-12T01:21:57.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.296+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3673457250399769766', time=2024-09-12T03:14:18.040388+0000, chain.objs.size()=1 2024-09-12T01:21:57.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.296+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.571__shadow:yZSStiPpaGcbDfFcbDNL8Msno1pBvT6_.ChxPdBEJRgpTA4gP9Bj9_UaGnCrUv8c_0 2024-09-12T01:21:57.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.296+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13755090988198972003', time=2024-09-12T03:14:19.927093+0000, chain.objs.size()=1 2024-09-12T01:21:57.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.296+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.573__shadow_.w0zGIYlKFjr_VCZwR1ifjtgIrUoAWRv_0 2024-09-12T01:21:57.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.296+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/52849 2024-09-12T01:21:57.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.296+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T01:21:57.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.296+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8853725979338039831', time=2024-09-12T03:14:24.793495+0000, chain.objs.size()=1 2024-09-12T01:21:57.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.296+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.575__shadow:HXTW6RRkqpD4oy9eMKo2SrVGdY31IKE_.vFRajKPfvUUqlppn0M0N5UPo9nCW0RP_0 2024-09-12T01:21:57.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.296+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1439456993003931485', time=2024-09-12T03:14:33.608725+0000, chain.objs.size()=1 2024-09-12T01:21:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.296+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:XV6.qV6FXVYQEaXp0cdHSUYBv1avqrw_.cEcnT5OhD_VqoYTZOj7mnBi4NQCwN6Z_0 2024-09-12T01:21:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.296+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13899781303001741975', time=2024-09-12T03:14:58.933118+0000, chain.objs.size()=1 2024-09-12T01:21:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.296+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.588__shadow:Omh8zla7mUYIfzBZXgisLF648xrP507_.7w7US9Xs-myMZCFXLocWzNt98yN6mIG_0 2024-09-12T01:21:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.296+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15986702194290739203', time=2024-09-12T03:17:40.654670+0000, chain.objs.size()=1 2024-09-12T01:21:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.296+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.628__shadow_.MJDuIItuXxWvPzYbRHoiMjA7_8gSXpK_0 2024-09-12T01:21:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.296+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6876292447986347581', time=2024-09-12T03:17:45.446099+0000, chain.objs.size()=1 2024-09-12T01:21:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.296+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.635__shadow_.LzHbRVjYKE_rx6KlOBRrj3TC5Wqnfjv_0 2024-09-12T01:21:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.296+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10966886686886270505', time=2024-09-12T03:17:59.658441+0000, chain.objs.size()=1 2024-09-12T01:21:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.296+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.654__shadow_.qngL4QcKoIQqbMLxK_PwEa0y-KlQrhC_0 2024-09-12T01:21:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.296+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9597954409780863937', time=2024-09-12T03:18:09.220004+0000, chain.objs.size()=1 2024-09-12T01:21:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.296+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.665__shadow_.0kTXzgusQVRd6Z3jwxvHpmnIa6BWcoF_0 2024-09-12T01:21:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.296+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11532045794192182133', time=2024-09-12T03:19:18.617583+0000, chain.objs.size()=1 2024-09-12T01:21:57.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.296+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.743__multipart_mymultipart3.2~eIh9FB0OAcCBH05RARgVXNjkZMVSaw3.1 2024-09-12T01:21:57.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.300+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:57.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.300+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:21:57.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:57.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:57.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47275' 2024-09-12T01:21:57.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4235915508663305177', time=2024-09-12T03:08:11.440451+0000, chain.objs.size()=1 2024-09-12T01:21:57.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.239__shadow_.ZUNYbkHAxETY8N39-EM9X_eY_ao3uzD_0 2024-09-12T01:21:57.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11008708257475788919', time=2024-09-12T03:08:16.455606+0000, chain.objs.size()=1 2024-09-12T01:21:57.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.245__shadow_.0mlIWV-B7nwlr0NFhtts-Eenb1KwBth_0 2024-09-12T01:21:57.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4279503497160554571', time=2024-09-12T03:08:20.568834+0000, chain.objs.size()=1 2024-09-12T01:21:57.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.251__shadow_.8ObZiVQ3xzDKS3d3foRtI3-6H9Zk_2p_0 2024-09-12T01:21:57.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13882752852778669119', time=2024-09-12T03:08:47.463155+0000, chain.objs.size()=1 2024-09-12T01:21:57.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.9Blej2zmoLPVSaewZ9tItrWHLIyMHBL_0 2024-09-12T01:21:57.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15968673487749102142', time=2024-09-12T03:08:47.552057+0000, chain.objs.size()=1 2024-09-12T01:21:57.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.CDiy64QXH3ywCGgqTEvAX6IDksODlOz_0 2024-09-12T01:21:57.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11234319099498111540', time=2024-09-12T03:08:47.621839+0000, chain.objs.size()=1 2024-09-12T01:21:57.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.f6r5--2uugooBsjv_I0LoKN2pPYIGbH_0 2024-09-12T01:21:57.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16183108651513322403', time=2024-09-12T03:08:47.630006+0000, chain.objs.size()=1 2024-09-12T01:21:57.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Zg7pCRscKHlOZtN788iW5z6XMeaKdDh_0 2024-09-12T01:21:57.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3725278072729181286', time=2024-09-12T03:08:47.637225+0000, chain.objs.size()=1 2024-09-12T01:21:57.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Mr0Yn2a9n37GdiYmBIpENGvix8rrDJN_0 2024-09-12T01:21:57.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13067231448887744805', time=2024-09-12T03:08:47.639034+0000, chain.objs.size()=1 2024-09-12T01:21:57.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.8g7Tdn7z_JZsQyCWPG2_fvvtsYyju-P_0 2024-09-12T01:21:57.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7474438414245136834', time=2024-09-12T03:08:47.643188+0000, chain.objs.size()=1 2024-09-12T01:21:57.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_._8GjF0JFgJzuysWKx4OIv7fqladq4k1_0 2024-09-12T01:21:57.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13405056188290167407', time=2024-09-12T03:08:47.819988+0000, chain.objs.size()=1 2024-09-12T01:21:57.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Yey3ClmOrj0YPZV-qePB9-P36HIt-us_0 2024-09-12T01:21:57.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7002701198806608394', time=2024-09-12T03:08:47.941351+0000, chain.objs.size()=1 2024-09-12T01:21:57.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.vajM5IGYHrl4ePFighC2zdQq9D2Ml7R_0 2024-09-12T01:21:57.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2649043042109116350', time=2024-09-12T03:08:47.985914+0000, chain.objs.size()=1 2024-09-12T01:21:57.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.5GXXFBhYQU7t6obahlicXqyBKbcT_pM_0 2024-09-12T01:21:57.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17255157488632587400', time=2024-09-12T03:08:47.994823+0000, chain.objs.size()=1 2024-09-12T01:21:57.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.FMPQdC3Xj_IZMcszdT2wKUkJz6ZWspR_0 2024-09-12T01:21:57.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2941577106477519065', time=2024-09-12T03:08:48.146852+0000, chain.objs.size()=1 2024-09-12T01:21:57.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.aqT39qiFdRvyOzL1Ya5qAsuW0ikE5_J_0 2024-09-12T01:21:57.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15719450017096917552', time=2024-09-12T03:08:48.304054+0000, chain.objs.size()=1 2024-09-12T01:21:57.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.FmeWwd9c22W4Gnn1ZtI8Rxh6gGJ7Y13_0 2024-09-12T01:21:57.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6223286941961966036', time=2024-09-12T03:08:48.313023+0000, chain.objs.size()=1 2024-09-12T01:21:57.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.7t41fGzBByMVmUxHEPat_tiYe-JHrEO_0 2024-09-12T01:21:57.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12875811219279790294', time=2024-09-12T03:08:48.623859+0000, chain.objs.size()=1 2024-09-12T01:21:57.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.27RFVT_JV4AA6_kgjkDJDH8Yw0rq7bR_0 2024-09-12T01:21:57.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10382634881054196218', time=2024-09-12T03:08:48.646033+0000, chain.objs.size()=1 2024-09-12T01:21:57.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.GweoENRoIutTxIqy9ozZKYnNdV-blAZ_0 2024-09-12T01:21:57.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5069965456268837273', time=2024-09-12T03:08:48.668996+0000, chain.objs.size()=1 2024-09-12T01:21:57.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.DfnV8TCLbZKJSS1Qf9BT6qO_AtlT0xL_0 2024-09-12T01:21:57.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15164171898680918708', time=2024-09-12T03:08:48.692611+0000, chain.objs.size()=1 2024-09-12T01:21:57.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.RCotZZSE372nslVhaKjzjQLnJmLErs-_0 2024-09-12T01:21:57.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15082624402261560931', time=2024-09-12T03:08:48.708369+0000, chain.objs.size()=1 2024-09-12T01:21:57.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.O3MsxIcFDYkzCu6IdakprmwUwn54SP2_0 2024-09-12T01:21:57.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10886084154079091134', time=2024-09-12T03:08:48.835535+0000, chain.objs.size()=1 2024-09-12T01:21:57.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.304+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.I5ZCxd98hhKkppPxNJvkvGy61Xp8bdO_0 2024-09-12T01:21:57.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.308+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11695188530260985589', time=2024-09-12T03:08:48.956505+0000, chain.objs.size()=1 2024-09-12T01:21:57.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.308+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Yxo-tHvkHlZSgRLW7fVdWZ9hpKfcXBS_0 2024-09-12T01:21:57.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.308+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9869576522761761466', time=2024-09-12T03:08:48.958398+0000, chain.objs.size()=1 2024-09-12T01:21:57.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.308+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.OxJdn7xudvhvpGpSIFHf7oHLwf7Tlg2_0 2024-09-12T01:21:57.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.308+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4867508150229500669', time=2024-09-12T03:08:48.987998+0000, chain.objs.size()=1 2024-09-12T01:21:57.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.308+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.5Yz559ikw-eU5VSMq7TtAWQIBTXBD76_0 2024-09-12T01:21:57.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.308+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4455781318818401118', time=2024-09-12T03:08:48.996130+0000, chain.objs.size()=1 2024-09-12T01:21:57.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.308+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.0rFzxyEFfp_ASm0dYQ8Y59jTrG6ahqp_0 2024-09-12T01:21:57.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.308+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17156991852016725565', time=2024-09-12T03:08:49.025314+0000, chain.objs.size()=1 2024-09-12T01:21:57.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.308+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.a-gmvDgqcRNKZ_fJs97c0CnBrM3kpcB_0 2024-09-12T01:21:57.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.308+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8053871753050470339', time=2024-09-12T03:08:49.167643+0000, chain.objs.size()=1 2024-09-12T01:21:57.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.308+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.h591ywcQha55vppawpwkeCbtMGlHzEX_0 2024-09-12T01:21:57.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.308+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9415080450286188714', time=2024-09-12T03:08:49.180015+0000, chain.objs.size()=1 2024-09-12T01:21:57.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.308+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.6kKxz0t_-85OQfeSfNHC60v50PITP6D_0 2024-09-12T01:21:57.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.308+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13326043002253055697', time=2024-09-12T03:08:49.275218+0000, chain.objs.size()=1 2024-09-12T01:21:57.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.308+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.E2Ysxw0VW8e3tIyFTSVN1Q6tfUb40sP_0 2024-09-12T01:21:57.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.308+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5390276543490803493', time=2024-09-12T03:08:49.308662+0000, chain.objs.size()=1 2024-09-12T01:21:57.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.308+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.dUvEw7KThSAgdmlZBI6O7hCiXuwvyi6_0 2024-09-12T01:21:57.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.308+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11535114469259699061', time=2024-09-12T03:08:49.387516+0000, chain.objs.size()=1 2024-09-12T01:21:57.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.308+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.JxSdSye77ZUTsPUl-mGVQtkVppgIXLl_0 2024-09-12T01:21:57.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.308+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2550531806097835966', time=2024-09-12T03:08:49.549064+0000, chain.objs.size()=1 2024-09-12T01:21:57.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.308+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.76_Bxph918kYXf2S-1o-Ina6CsR5A2D_0 2024-09-12T01:21:57.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6325094494531282707', time=2024-09-12T03:08:49.622620+0000, chain.objs.size()=1 2024-09-12T01:21:57.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Tovmq0hA6SlLDl4cljE-adUpVVcQbtw_0 2024-09-12T01:21:57.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8861687785728013833', time=2024-09-12T03:08:49.899479+0000, chain.objs.size()=1 2024-09-12T01:21:57.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.z8G4_LkaZRqQ0MshXHGQUBwsm0jRIzm_0 2024-09-12T01:21:57.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.284749665138368302', time=2024-09-12T03:08:49.912255+0000, chain.objs.size()=1 2024-09-12T01:21:57.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.UVUlZEjoNGvmGxOlD__iwQ0IhD0x0Ai_0 2024-09-12T01:21:57.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11262344371256558198', time=2024-09-12T03:08:49.970308+0000, chain.objs.size()=1 2024-09-12T01:21:57.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.wHNAms8KyLRZ1o2QJLFQbsnGn-fYMo9_0 2024-09-12T01:21:57.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5440023659925147004', time=2024-09-12T03:08:50.029450+0000, chain.objs.size()=1 2024-09-12T01:21:57.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.IdR_ErwszsRGBlCvI5GA96Swq-PfOej_0 2024-09-12T01:21:57.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17274218292481988491', time=2024-09-12T03:08:52.616126+0000, chain.objs.size()=1 2024-09-12T01:21:57.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.267__shadow_.DWMViFWBxT40nEEixwNOCzr-gsQApPJ_0 2024-09-12T01:21:57.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3739186924206512031', time=2024-09-12T03:08:53.286798+0000, chain.objs.size()=1 2024-09-12T01:21:57.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.268__shadow_.IZMtd9uIo5lDj1jshnDTAwPmDLxO5qa_0 2024-09-12T01:21:57.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15954949931200874855', time=2024-09-12T03:09:00.870850+0000, chain.objs.size()=1 2024-09-12T01:21:57.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.279__shadow_.czEwaEDz-daoNtox0Yp66Uw2vilw5IE_0 2024-09-12T01:21:57.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6803374817430419829', time=2024-09-12T03:09:06.473596+0000, chain.objs.size()=1 2024-09-12T01:21:57.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.287__shadow_.0awQFL-IMyRg_61LUfaO1h68JQLQ7pU_0 2024-09-12T01:21:57.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12529993693645841906', time=2024-09-12T03:09:07.159901+0000, chain.objs.size()=1 2024-09-12T01:21:57.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.288__shadow_.2c1CiTompSY3943U3g7LVKhbKCPUOQS_0 2024-09-12T01:21:57.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18254260380402451840', time=2024-09-12T03:09:11.584945+0000, chain.objs.size()=1 2024-09-12T01:21:57.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.293__shadow_.MVGGHkzqNwCpSmbeWzzV4LILeZaSiuf_0 2024-09-12T01:21:57.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15800451047665968619', time=2024-09-12T03:09:11.591781+0000, chain.objs.size()=1 2024-09-12T01:21:57.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.293__shadow_.DAfUe6kObNjLaCaHfwsdDZdH3w4Vb5X_0 2024-09-12T01:21:57.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14580275950853943757', time=2024-09-12T03:09:11.657143+0000, chain.objs.size()=1 2024-09-12T01:21:57.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.293__shadow_.tGEMmx8FKZHJQSWmuf7zxjLzOxmUMhk_0 2024-09-12T01:21:57.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.768221890360519735', time=2024-09-12T03:09:13.086764+0000, chain.objs.size()=1 2024-09-12T01:21:57.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.294__shadow_.hZe6yvLcWYodw-aQEw7G-_x6XeJF-6__0 2024-09-12T01:21:57.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14093332031301761339', time=2024-09-12T03:09:13.758697+0000, chain.objs.size()=1 2024-09-12T01:21:57.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.295__shadow_.PbS0MoJOnrsQDfryQrF5NHLgJeNpRWe_0 2024-09-12T01:21:57.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3790398771242414111', time=2024-09-12T03:09:21.493908+0000, chain.objs.size()=1 2024-09-12T01:21:57.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.312+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.306__shadow_.TzFY4m3LYSMgefD8g7JCfxzQg8gMaog_0 2024-09-12T01:21:57.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.316+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14644310922530599783', time=2024-09-12T03:09:31.757333+0000, chain.objs.size()=1 2024-09-12T01:21:57.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.316+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.320__shadow:oGTmDvi9Ec5S4aINfe.eo78Df9V44e5_.vIkrvA1-ZA7yNacrWONUdLQF_IDZSQL_0 2024-09-12T01:21:57.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.316+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5096641782060149310', time=2024-09-12T03:09:53.012693+0000, chain.objs.size()=1 2024-09-12T01:21:57.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.316+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.v24w18qCkW-sExku0kgxDv250wn1j_l_0 2024-09-12T01:21:57.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.316+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7708133841700832826', time=2024-09-12T03:09:53.023429+0000, chain.objs.size()=1 2024-09-12T01:21:57.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.316+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Hk-8BIKT0oT3WJvVrxakphr_viJ2Up9_0 2024-09-12T01:21:57.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.316+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9815699213195914091', time=2024-09-12T03:09:53.052734+0000, chain.objs.size()=1 2024-09-12T01:21:57.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.316+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_._IOXL4cqwpjks6odffqi0F5IInZS4MO_0 2024-09-12T01:21:57.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.316+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8335681417053481373', time=2024-09-12T03:09:53.106638+0000, chain.objs.size()=1 2024-09-12T01:21:57.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.316+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.3o46YBzF6S3FOUuRLOZ-Gcm2Pmfm18y_0 2024-09-12T01:21:57.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.316+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17346770175793247648', time=2024-09-12T03:09:53.267808+0000, chain.objs.size()=1 2024-09-12T01:21:57.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.316+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.P2uVI_VONi66D-RL7azDh4Ul1aqOUKz_0 2024-09-12T01:21:57.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.316+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5995431139473433662', time=2024-09-12T03:09:53.272462+0000, chain.objs.size()=1 2024-09-12T01:21:57.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.316+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.VAgWbEj5-nw8d0zik8AK5BfVlVrc6LN_0 2024-09-12T01:21:57.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.316+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10031396196686373504', time=2024-09-12T03:09:53.278668+0000, chain.objs.size()=1 2024-09-12T01:21:57.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.316+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.7VVSz9IzB6_zK6XgK4cFBElke-S-xW3_0 2024-09-12T01:21:57.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.316+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16704681189819800876', time=2024-09-12T03:09:53.288989+0000, chain.objs.size()=1 2024-09-12T01:21:57.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.316+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.2sZmEaQzN3C990nYLrSna6eopzRmmeE_0 2024-09-12T01:21:57.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.316+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3260367385418597527', time=2024-09-12T03:09:53.328469+0000, chain.objs.size()=1 2024-09-12T01:21:57.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.316+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.WsIh3HYnhvbyMLkGjtFo_4miJrDq-iN_0 2024-09-12T01:21:57.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.316+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17704653200793050270', time=2024-09-12T03:09:53.364312+0000, chain.objs.size()=1 2024-09-12T01:21:57.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.316+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.6ByBvwrax51FdZSt7V1mXtZ70gWB8eT_0 2024-09-12T01:21:57.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12548795693625650155', time=2024-09-12T03:09:53.432978+0000, chain.objs.size()=1 2024-09-12T01:21:57.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.6G0XoNNPSbrJs98yw4jdBNuPiqu8Ob5_0 2024-09-12T01:21:57.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13473147517737735445', time=2024-09-12T03:09:53.494464+0000, chain.objs.size()=1 2024-09-12T01:21:57.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ePe9cdIai2sT5YPKlovV6_QUQK5aael_0 2024-09-12T01:21:57.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11835860102910778296', time=2024-09-12T03:09:53.749085+0000, chain.objs.size()=1 2024-09-12T01:21:57.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.MLA__XTVYzbmSVfAS1zs2Y0q_FJObTK_0 2024-09-12T01:21:57.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16394868575178051666', time=2024-09-12T03:09:53.775476+0000, chain.objs.size()=1 2024-09-12T01:21:57.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.wXGI2GJ5jQcuR17yEvCCSlEj93dxKcL_0 2024-09-12T01:21:57.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6858877456271702925', time=2024-09-12T03:09:53.781721+0000, chain.objs.size()=1 2024-09-12T01:21:57.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.i3JlATWeZveUboXI6_Jsew0QCESVokS_0 2024-09-12T01:21:57.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2389963772747315860', time=2024-09-12T03:09:53.806537+0000, chain.objs.size()=1 2024-09-12T01:21:57.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.A_snuGB-8maCoxtA3kO0HEaFvYftilz_0 2024-09-12T01:21:57.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3635293373449534379', time=2024-09-12T03:09:53.966481+0000, chain.objs.size()=1 2024-09-12T01:21:57.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.j7vzU2BfLiEm3v6hBnv76bP9RLuZ256_0 2024-09-12T01:21:57.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6534292276207878217', time=2024-09-12T03:09:53.996690+0000, chain.objs.size()=1 2024-09-12T01:21:57.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.aeFBbYhgt73kF-pGYJsaIwVPo-F3J2k_0 2024-09-12T01:21:57.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4924034158936723609', time=2024-09-12T03:09:54.014089+0000, chain.objs.size()=1 2024-09-12T01:21:57.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.XKESgSrlZPrPs8o_MHZWhy3ZfhvuoLs_0 2024-09-12T01:21:57.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5218039093610480020', time=2024-09-12T03:09:54.051129+0000, chain.objs.size()=1 2024-09-12T01:21:57.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.7UrGAqz9BNvitHnr4IpHjqooYksxcco_0 2024-09-12T01:21:57.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6076979194242926025', time=2024-09-12T03:09:54.069006+0000, chain.objs.size()=1 2024-09-12T01:21:57.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.CQOGSQIj0s5Usd0nFvV8VYzmvGh2eBR_0 2024-09-12T01:21:57.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15544851444155897456', time=2024-09-12T03:09:54.084140+0000, chain.objs.size()=1 2024-09-12T01:21:57.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_._NzQJZ5b6Ay0t6jKA_GuVsIEOxgVowY_0 2024-09-12T01:21:57.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17256118660442890199', time=2024-09-12T03:09:54.144389+0000, chain.objs.size()=1 2024-09-12T01:21:57.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.bRpTGdrOZAOGUmWhRYXlu_d8KpE1W09_0 2024-09-12T01:21:57.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18031302309182363672', time=2024-09-12T03:09:54.296826+0000, chain.objs.size()=1 2024-09-12T01:21:57.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ACx4gMIjeXIkdUbxST0lXOJdUFMcbXU_0 2024-09-12T01:21:57.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15924702709443589145', time=2024-09-12T03:09:54.303619+0000, chain.objs.size()=1 2024-09-12T01:21:57.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.vALycxk3pxe7Y6qaLJV2xADdCVd-M-h_0 2024-09-12T01:21:57.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3704717948488408349', time=2024-09-12T03:09:54.312959+0000, chain.objs.size()=1 2024-09-12T01:21:57.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.o8jtjQtYlAvXm2r6DuDmx4lkEm3Bhle_0 2024-09-12T01:21:57.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9302415876313504894', time=2024-09-12T03:09:54.420260+0000, chain.objs.size()=1 2024-09-12T01:21:57.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.FJ2sYidzrVkvOdXPTLX43Ru01-fbP0E_0 2024-09-12T01:21:57.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11851436142742374638', time=2024-09-12T03:09:54.719147+0000, chain.objs.size()=1 2024-09-12T01:21:57.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.jOnmyXFmAFnGMTuW3X55uJNv1iz0Wcu_0 2024-09-12T01:21:57.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1513195071812960593', time=2024-09-12T03:09:54.799598+0000, chain.objs.size()=1 2024-09-12T01:21:57.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.sR2db2f8yWRtC0_j6zR_Fu0zc6snLGI_0 2024-09-12T01:21:57.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11048264268774769210', time=2024-09-12T03:09:55.004862+0000, chain.objs.size()=1 2024-09-12T01:21:57.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.WCTfANckk7eAAfIZDz4JzesqOErnfVo_0 2024-09-12T01:21:57.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17629907611408926723', time=2024-09-12T03:09:55.020891+0000, chain.objs.size()=1 2024-09-12T01:21:57.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.320+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_._hZEIGXbV_QSM6sTELmbdvFcIAa9Cmo_0 2024-09-12T01:21:57.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.324+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3976592966155171135', time=2024-09-12T03:09:55.046761+0000, chain.objs.size()=1 2024-09-12T01:21:57.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.324+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.aKm6LqfI6ewSWg4T8tc8Y4s_u5It9QV_0 2024-09-12T01:21:57.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.324+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10089699788156182571', time=2024-09-12T03:09:55.120628+0000, chain.objs.size()=1 2024-09-12T01:21:57.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.324+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Sqlmr0t4aE5dNX_I--WKx6FuhB7te8h_0 2024-09-12T01:21:57.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.324+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8645227861899067145', time=2024-09-12T03:09:55.162154+0000, chain.objs.size()=1 2024-09-12T01:21:57.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.324+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.F1KMb8xbaRyplBXxIoIrvb8ZKz6DESM_0 2024-09-12T01:21:57.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.324+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12892125988529766789', time=2024-09-12T03:09:55.337577+0000, chain.objs.size()=1 2024-09-12T01:21:57.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.324+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.vUw633NkCZrnvAom-kSK965ZVCcvZ1l_0 2024-09-12T01:21:57.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.324+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16188393123990863732', time=2024-09-12T03:09:55.361771+0000, chain.objs.size()=1 2024-09-12T01:21:57.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.324+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.6JRcqYuDGUpYGrDoPPbLM8wgyUQAPQp_0 2024-09-12T01:21:57.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.324+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12839669291316188357', time=2024-09-12T03:09:55.370581+0000, chain.objs.size()=1 2024-09-12T01:21:57.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.324+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Pw7DHVClxngrkfDBNAsm_-9HQwF8Kq4_0 2024-09-12T01:21:57.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.324+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13857769277039531544', time=2024-09-12T03:09:55.374569+0000, chain.objs.size()=1 2024-09-12T01:21:57.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.324+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.9e0zOi0MNJiVoQGXGoU6hr9_EQ0KX7H_0 2024-09-12T01:21:57.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.324+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6101334314711944997', time=2024-09-12T03:09:55.399378+0000, chain.objs.size()=1 2024-09-12T01:21:57.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.324+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ZY1i0zAgpNYv2_AN47P61k-UiJvUIzW_0 2024-09-12T01:21:57.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.324+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17213296142039661714', time=2024-09-12T03:09:55.409724+0000, chain.objs.size()=1 2024-09-12T01:21:57.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.324+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.P94pAs4Ce2sofrgsUF7fhzLBNHV10R4_0 2024-09-12T01:21:57.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.324+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15628915566291270845', time=2024-09-12T03:10:15.218096+0000, chain.objs.size()=1 2024-09-12T01:21:57.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.324+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.V3KjAby6gg6132mEtfHdD72ZS_ogHiw_0 2024-09-12T01:21:57.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.324+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5370497070024753722', time=2024-09-12T03:10:15.225480+0000, chain.objs.size()=1 2024-09-12T01:21:57.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.324+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.u1dgYu4K287qGBtiUajqlNOyAxI2Ubv_0 2024-09-12T01:21:57.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.324+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1292247625809634012', time=2024-09-12T03:10:15.228387+0000, chain.objs.size()=1 2024-09-12T01:21:57.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.324+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.xaat4KCrJcQttw_4fC6eQ3E4qZ5Esf5_0 2024-09-12T01:21:57.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.328+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.411849707092002498', time=2024-09-12T03:10:15.266017+0000, chain.objs.size()=1 2024-09-12T01:21:57.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.328+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.NHdzaA3adR0G3RSTJfrzp-bcWfZYBo2_0 2024-09-12T01:21:57.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.328+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5114710893822809566', time=2024-09-12T03:10:15.353143+0000, chain.objs.size()=1 2024-09-12T01:21:57.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.328+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.nQBOziYMM9-7U2MU5Q7IvJjOlpyPGW3_0 2024-09-12T01:21:57.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.328+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8639954148398795346', time=2024-09-12T03:10:15.414305+0000, chain.objs.size()=1 2024-09-12T01:21:57.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.328+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ND2U8dZ3CcuJ76bilmatqMN6v2j9R9v_0 2024-09-12T01:21:57.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.328+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.663618277168725833', time=2024-09-12T03:10:15.417546+0000, chain.objs.size()=1 2024-09-12T01:21:57.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.328+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.PCnsQD_Nf7nuv7tva9hn-XM1npreaVA_0 2024-09-12T01:21:57.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.328+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7923220969422613875', time=2024-09-12T03:10:15.453846+0000, chain.objs.size()=1 2024-09-12T01:21:57.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.328+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.BAkigP1QOCgKNo0Z7lwfr_xW9bnb9Ww_0 2024-09-12T01:21:57.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.328+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12187883279931617787', time=2024-09-12T03:10:15.658471+0000, chain.objs.size()=1 2024-09-12T01:21:57.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.328+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.aZIjBNj0q_-dh5oDwYX4yIZNsGC6bjp_0 2024-09-12T01:21:57.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.328+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47275 2024-09-12T01:21:57.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=51, truncated=0, next_marker='' 2024-09-12T01:21:57.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.283574505645409512', time=2024-09-12T03:10:15.682387+0000, chain.objs.size()=1 2024-09-12T01:21:57.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.IohszhS82rRPinlq-KMwbQ_tOTQiD2J_0 2024-09-12T01:21:57.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6672093220576964174', time=2024-09-12T03:10:15.728586+0000, chain.objs.size()=1 2024-09-12T01:21:57.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.32LDBp_P2xPDTex16tfHkgmj2sc9303_0 2024-09-12T01:21:57.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15322511530941238950', time=2024-09-12T03:10:15.952608+0000, chain.objs.size()=1 2024-09-12T01:21:57.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.CHOaJcStXUQPC4IxlfPO2LMl5OKB2r4_0 2024-09-12T01:21:57.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13473058684233979841', time=2024-09-12T03:10:16.042400+0000, chain.objs.size()=1 2024-09-12T01:21:57.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.wDjFprjBbZkON6pvnQnUyd1ZtXLYFNb_0 2024-09-12T01:21:57.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3933015330757605654', time=2024-09-12T03:10:16.218183+0000, chain.objs.size()=1 2024-09-12T01:21:57.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.5uCHTuLk9EelbDDtU3yoGvwkoAb456k_0 2024-09-12T01:21:57.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7349019347598693301', time=2024-09-12T03:10:16.231482+0000, chain.objs.size()=1 2024-09-12T01:21:57.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ijFfKooTvNa8wb9MjoMOsyP_tTkGKhg_0 2024-09-12T01:21:57.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12765714010016308311', time=2024-09-12T03:10:16.270261+0000, chain.objs.size()=1 2024-09-12T01:21:57.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Ij7JoCqFCiFLz7EwnhM16QDuOBo-IYE_0 2024-09-12T01:21:57.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5014911048017122049', time=2024-09-12T03:10:16.325365+0000, chain.objs.size()=1 2024-09-12T01:21:57.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.-3tjaRYfPAxaozcoHY1YbVpAefCi6mk_0 2024-09-12T01:21:57.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8720331553426263413', time=2024-09-12T03:10:16.336675+0000, chain.objs.size()=1 2024-09-12T01:21:57.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ju2-W1iIp1riIHsH-ta4K_VGNJnFldu_0 2024-09-12T01:21:57.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3999324159666550195', time=2024-09-12T03:10:16.361223+0000, chain.objs.size()=1 2024-09-12T01:21:57.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.4bBFxnMcmiz-qqUP8Ja5ZeKbcoY_w8f_0 2024-09-12T01:21:57.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15522748370904549525', time=2024-09-12T03:10:16.578843+0000, chain.objs.size()=1 2024-09-12T01:21:57.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.HRHtdgbdqtNQ9m6WZQ9aSOopuVg-DOC_0 2024-09-12T01:21:57.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11795451531784389328', time=2024-09-12T03:10:16.864144+0000, chain.objs.size()=1 2024-09-12T01:21:57.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.2ZMA9dKZ9fo40qZn7zZXt1P7vWuDNQw_0 2024-09-12T01:21:57.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7752774554247714121', time=2024-09-12T03:10:16.908912+0000, chain.objs.size()=1 2024-09-12T01:21:57.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Cd4UDDgfgl5mNu52FKdzjMWTChv5uUl_0 2024-09-12T01:21:57.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9193347781479657723', time=2024-09-12T03:10:16.945422+0000, chain.objs.size()=1 2024-09-12T01:21:57.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.WSL5F3CF7ZOKhnKZBcnoABNb4TcG2kY_0 2024-09-12T01:21:57.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3432439619499053092', time=2024-09-12T03:10:16.964430+0000, chain.objs.size()=1 2024-09-12T01:21:57.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.HXvvPyBPlSTFfrJz9gCtuZTHlBifR7__0 2024-09-12T01:21:57.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10372347116923443468', time=2024-09-12T03:10:17.202257+0000, chain.objs.size()=1 2024-09-12T01:21:57.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.wVBoX3Remf1_wNcQ1KrrSimXgN6lwOF_0 2024-09-12T01:21:57.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14852642277969378401', time=2024-09-12T03:10:17.230825+0000, chain.objs.size()=1 2024-09-12T01:21:57.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.X_Xkj6CxiNNXZyjPDMSqQtSZAZBtUdC_0 2024-09-12T01:21:57.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4833855544661154902', time=2024-09-12T03:10:17.308419+0000, chain.objs.size()=1 2024-09-12T01:21:57.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.4b2Gp-qyIKKj3Xuq4mKNOeN7i287XVu_0 2024-09-12T01:21:57.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2253283020449593705', time=2024-09-12T03:10:17.315849+0000, chain.objs.size()=1 2024-09-12T01:21:57.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.4CRyhbWsksCNcx4RLmTOfWBCjfVfFbk_0 2024-09-12T01:21:57.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16277022587274549181', time=2024-09-12T03:10:17.329308+0000, chain.objs.size()=1 2024-09-12T01:21:57.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.P5oBWmfu-hzn5NrpOIGFNqovLL4xbKr_0 2024-09-12T01:21:57.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1118147345988758930', time=2024-09-12T03:10:17.451777+0000, chain.objs.size()=1 2024-09-12T01:21:57.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.yGejzK795cbVGoSW0aGOWOzw-DM_nmD_0 2024-09-12T01:21:57.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2924591829603553321', time=2024-09-12T03:10:17.555717+0000, chain.objs.size()=1 2024-09-12T01:21:57.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.XbT3dMYWvJ3m0XYdR5h0XblnDpfRuTs_0 2024-09-12T01:21:57.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3296877266109833290', time=2024-09-12T03:10:17.563166+0000, chain.objs.size()=1 2024-09-12T01:21:57.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.332+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.u5a6VgNsRxm09PW7CckW6xxZifkXtn5_0 2024-09-12T01:21:57.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14886317874677573986', time=2024-09-12T03:10:17.578988+0000, chain.objs.size()=1 2024-09-12T01:21:57.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.SYR6mQK4_wYunvyicTkzcVW4J95rEV2_0 2024-09-12T01:21:57.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.799117670139664581', time=2024-09-12T03:10:17.598982+0000, chain.objs.size()=1 2024-09-12T01:21:57.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.2we2j9m0E9UOEpWtIZqHWDvxTJ09FhZ_0 2024-09-12T01:21:57.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14565703478786593340', time=2024-09-12T03:10:17.745997+0000, chain.objs.size()=1 2024-09-12T01:21:57.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.iQaUHVeMMr5Qz2cRYJw_V06PpMQU3xl_0 2024-09-12T01:21:57.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3692234004364252547', time=2024-09-12T03:10:17.787871+0000, chain.objs.size()=1 2024-09-12T01:21:57.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.V5jn34sfYafvB0S8g2KAATGdgDTgktO_0 2024-09-12T01:21:57.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3568616454372927020', time=2024-09-12T03:10:17.790364+0000, chain.objs.size()=1 2024-09-12T01:21:57.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.rrKiFSIN0jptKihRl8lKZwdh2TS0XyZ_0 2024-09-12T01:21:57.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15221285643902170918', time=2024-09-12T03:10:17.871680+0000, chain.objs.size()=1 2024-09-12T01:21:57.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.3y9YVDrnwS1nlKkbBN-7IAVSdJ56v74_0 2024-09-12T01:21:57.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8680842666548942543', time=2024-09-12T03:10:17.902040+0000, chain.objs.size()=1 2024-09-12T01:21:57.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.h1dM6TuDv4TrvYpE-EmB6aLp3KUXHop_0 2024-09-12T01:21:57.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14434063109769940434', time=2024-09-12T03:10:17.910366+0000, chain.objs.size()=1 2024-09-12T01:21:57.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.5r_V7KnY8oVGCJbu56P240yoCiACx_G_0 2024-09-12T01:21:57.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16622986424261860912', time=2024-09-12T03:10:20.879341+0000, chain.objs.size()=1 2024-09-12T01:21:57.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.330__shadow_.dADzVG4usD7t5Wtx0-3hpyhsfqNz-nX_0 2024-09-12T01:21:57.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10495379230373724888', time=2024-09-12T03:10:31.567566+0000, chain.objs.size()=1 2024-09-12T01:21:57.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.347__shadow_.L25D_sg4YeGgDtvGIUjh1V739IxW5HD_0 2024-09-12T01:21:57.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11201974527865770291', time=2024-09-12T03:10:45.494722+0000, chain.objs.size()=1 2024-09-12T01:21:57.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.372__shadow_.MHV4dSKsWDAyDf6O_QRGN__ork-sWU8_0 2024-09-12T01:21:57.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2465454138911095208', time=2024-09-12T03:11:54.420501+0000, chain.objs.size()=1 2024-09-12T01:21:57.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.464__shadow_.51319CkblB3z2Ngn_I95hLxqJzl9tjx_0 2024-09-12T01:21:57.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.55895618539212990', time=2024-09-12T03:12:05.009063+0000, chain.objs.size()=1 2024-09-12T01:21:57.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.484__shadow_.qcTS6gnEop2pLIM2NF72iDZ4Atfh06u_0 2024-09-12T01:21:57.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17313103282904388072', time=2024-09-12T03:12:13.369272+0000, chain.objs.size()=1 2024-09-12T01:21:57.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.497__shadow_.wSuVrt8P9skwtxQwMcONLHm4hCf6c1U_0 2024-09-12T01:21:57.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17422515235510769602', time=2024-09-12T03:12:14.566792+0000, chain.objs.size()=1 2024-09-12T01:21:57.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.499__shadow_.RKWoUE7ROLt8qsmOLmT4l0gATYLpe2c_0 2024-09-12T01:21:57.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11311296459400662514', time=2024-09-12T03:12:23.703328+0000, chain.objs.size()=1 2024-09-12T01:21:57.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.512__multipart_mymultipart.2~B9Rrbv4Z2raLM3wQsRBASZ_8snwo2N3.1 2024-09-12T01:21:57.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11310039752872985149', time=2024-09-12T03:13:00.712005+0000, chain.objs.size()=3 2024-09-12T01:21:57.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.526__multipart_mymultipart.2~fDR9cBiIcR_URjk0uggaDvMf3dTrqHp.1 2024-09-12T01:21:57.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.336+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.526__multipart_mymultipart.2~fDR9cBiIcR_URjk0uggaDvMf3dTrqHp.2 2024-09-12T01:21:57.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.340+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.526__multipart_mymultipart.2~fDR9cBiIcR_URjk0uggaDvMf3dTrqHp.3 2024-09-12T01:21:57.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.340+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ve4oR8e0XRSATYhFzi8Lz4PmQo44YGL', time=2024-09-12T03:13:07.279638+0000, chain.objs.size()=2 2024-09-12T01:21:57.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.340+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.532__multipart_mymultipart.2~ve4oR8e0XRSATYhFzi8Lz4PmQo44YGL.1 2024-09-12T01:21:57.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.340+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.532__multipart_mymultipart.2~ve4oR8e0XRSATYhFzi8Lz4PmQo44YGL.2 2024-09-12T01:21:57.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.340+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1381382020137364698', time=2024-09-12T03:13:58.386646+0000, chain.objs.size()=1 2024-09-12T01:21:57.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.340+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.561__shadow_.7wQUBWEfFCi-rU3vQJ8k6DZ6SddAI34_0 2024-09-12T01:21:57.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.340+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5904520663485950302', time=2024-09-12T03:14:14.322486+0000, chain.objs.size()=1 2024-09-12T01:21:57.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.340+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:oMdYgOFHg5DfkOjsVDBD.oxTzh.0Lvz_.4IziarnPEoRuVBxw64Sgg6J0zs3DEoU_0 2024-09-12T01:21:57.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.340+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.40261095827763293', time=2024-09-12T03:14:20.904395+0000, chain.objs.size()=1 2024-09-12T01:21:57.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.340+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.574__shadow_._OAR-nORmbB3FQ8cXkA-jkCcPJkvorf_0 2024-09-12T01:21:57.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.340+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.433669080500989152', time=2024-09-12T03:14:41.473200+0000, chain.objs.size()=1 2024-09-12T01:21:57.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.340+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:xGDOc-nuHYo.Z0COetXpVHdUsu5PQIH_.E5A-uX1nRTnB2HK0PKpetBpCu5S1npE_0 2024-09-12T01:21:57.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.340+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4940791384147566665', time=2024-09-12T03:14:42.155623+0000, chain.objs.size()=1 2024-09-12T01:21:57.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.340+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:zYfRkONUrIT3Ok3eyioGfWjaxvj.ca6_.zVPVMOPqJM85XZmo1yHkFYgkVxHG5ch_0 2024-09-12T01:21:57.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.340+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9360629605626841370', time=2024-09-12T03:14:58.928297+0000, chain.objs.size()=1 2024-09-12T01:21:57.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.340+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.588__shadow:FSFwqawU-ZNqqITV0vDd5j5nr9YvKYD_.pvK5yEXimO5SvKXYg1SiZAtj69ZsC6x_0 2024-09-12T01:21:57.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.340+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15281159476965795350', time=2024-09-12T03:17:31.437387+0000, chain.objs.size()=1 2024-09-12T01:21:57.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.340+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.621__shadow_.6CorO8jcoh6nDff44OidkgSBAyTNSaC_0 2024-09-12T01:21:57.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.340+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15016311999911879404', time=2024-09-12T03:17:44.742403+0000, chain.objs.size()=1 2024-09-12T01:21:57.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.340+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.634__shadow_.bQ4z4sx3uSK-pi6jMdkmBjWdqbtak76_0 2024-09-12T01:21:57.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.340+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17367092835876412398', time=2024-09-12T03:18:11.180069+0000, chain.objs.size()=1 2024-09-12T01:21:57.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.340+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.667__shadow_.m56MfBvvUR-6Gv0YIoP1NFNyNDeulN__0 2024-09-12T01:21:57.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.340+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5793520359414433258', time=2024-09-12T03:18:28.365274+0000, chain.objs.size()=1 2024-09-12T01:21:57.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.340+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.697__shadow:cMI4hoZ.jh1kiDu0ctGDLIEYhLWXI2l_.PDTnV46sZbKr1Jw-eliCqTSfvkfh5Lr_0 2024-09-12T01:21:57.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.344+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:57.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.344+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:21:57.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.348+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:57.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.348+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:57.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.348+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45730' 2024-09-12T01:21:57.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.348+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_8r4A4poXY1Qfxo5u7UBCNXnt0UHpWhd', time=2024-09-12T03:06:00.048101+0000, chain.objs.size()=1 2024-09-12T01:21:57.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.348+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.161__shadow_.xjMcc9zrY-HfxVDxciMoCgxRyPVru1y_0 2024-09-12T01:21:57.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.348+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10805865500875127445', time=2024-09-12T03:08:13.450700+0000, chain.objs.size()=1 2024-09-12T01:21:57.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.348+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.242__shadow_.mEnP63Rjh1LtUS0G60aAr-JXlMEkfyh_0 2024-09-12T01:21:57.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.348+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2045811588617260295', time=2024-09-12T03:08:23.359403+0000, chain.objs.size()=1 2024-09-12T01:21:57.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.348+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.255__shadow_.8PHdlpkcsiWCORUs8RkYga35at4_TTj_0 2024-09-12T01:21:57.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.348+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14990316294324172987', time=2024-09-12T03:08:24.040395+0000, chain.objs.size()=1 2024-09-12T01:21:57.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.348+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.256__shadow_.bKv8uaDVTUDRUz2yIf_NpKkZZoNoedu_0 2024-09-12T01:21:57.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.348+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11400294337124579184', time=2024-09-12T03:08:25.382978+0000, chain.objs.size()=1 2024-09-12T01:21:57.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.348+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.258__shadow_.VOf1D9CGHU40XBDW-7UOZZJKpi2ivca_0 2024-09-12T01:21:57.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.348+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13464981211322106806', time=2024-09-12T03:08:47.577081+0000, chain.objs.size()=1 2024-09-12T01:21:57.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.348+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.9zZ1q5kW9CNdI8-GMEDzFeBTose3qUI_0 2024-09-12T01:21:57.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.348+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1268187994960446481', time=2024-09-12T03:08:47.587815+0000, chain.objs.size()=1 2024-09-12T01:21:57.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.348+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.MUQ6vTv9FXLVz92k7zknX5mcuSShUDi_0 2024-09-12T01:21:57.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.348+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10841622446432486460', time=2024-09-12T03:08:47.616815+0000, chain.objs.size()=1 2024-09-12T01:21:57.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.348+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_._KpXNHDL_2agD58AecPbB392MzOZf87_0 2024-09-12T01:21:57.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.348+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14590883462769678648', time=2024-09-12T03:08:47.618733+0000, chain.objs.size()=1 2024-09-12T01:21:57.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.348+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.XoI0tkaHQMtDr8vf_hNRJgSBQpz24Yn_0 2024-09-12T01:21:57.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.348+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17037417051085941389', time=2024-09-12T03:08:47.641500+0000, chain.objs.size()=1 2024-09-12T01:21:57.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.348+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.GWvHIFxlji1JJEImT02EADlNuIRS-W9_0 2024-09-12T01:21:57.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.348+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12288186572858537518', time=2024-09-12T03:08:47.809864+0000, chain.objs.size()=1 2024-09-12T01:21:57.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.348+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ioeIsLlfF89PjwhYVKkYtUkONYyUk1T_0 2024-09-12T01:21:57.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.348+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10427923848825355970', time=2024-09-12T03:08:47.910290+0000, chain.objs.size()=1 2024-09-12T01:21:57.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.348+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.j4E2Q0MfS4GacX2jaJgolUowrXe2v5b_0 2024-09-12T01:21:57.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17763780545519157860', time=2024-09-12T03:08:47.961915+0000, chain.objs.size()=1 2024-09-12T01:21:57.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.gQ_TGUMR5PpXrjCWjMfAgSp4HeA4abY_0 2024-09-12T01:21:57.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12379029694641812986', time=2024-09-12T03:08:48.263511+0000, chain.objs.size()=1 2024-09-12T01:21:57.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.vhyG8ExLpdXp1L2gIIPDC_fRz3SG6Sp_0 2024-09-12T01:21:57.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14367865272274408745', time=2024-09-12T03:08:48.542098+0000, chain.objs.size()=1 2024-09-12T01:21:57.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ptPfgTmPO35P_rOgecIUAEdJj_y2_eX_0 2024-09-12T01:21:57.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13785196150653791310', time=2024-09-12T03:08:48.572388+0000, chain.objs.size()=1 2024-09-12T01:21:57.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.n0vsdmoqw5J7qrw0ZgWWdj3awIv9gAg_0 2024-09-12T01:21:57.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6989667361421422894', time=2024-09-12T03:08:48.674528+0000, chain.objs.size()=1 2024-09-12T01:21:57.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.emv06HT4DAqjCpKinrgAWDz3HUMO6h0_0 2024-09-12T01:21:57.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2894290331919818489', time=2024-09-12T03:08:48.702791+0000, chain.objs.size()=1 2024-09-12T01:21:57.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Kc-pXUA2HyuPK1EfYm241_OTafAFYae_0 2024-09-12T01:21:57.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9742378726587489904', time=2024-09-12T03:08:48.828905+0000, chain.objs.size()=1 2024-09-12T01:21:57.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.oNtBwFAPWZKrzWucjToV8fPqOjZrYsT_0 2024-09-12T01:21:57.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15603426655778002869', time=2024-09-12T03:08:49.235328+0000, chain.objs.size()=1 2024-09-12T01:21:57.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.kqWJdlOyuOQKsr_gtZ42Dn1OYytYUYV_0 2024-09-12T01:21:57.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14542741220668972839', time=2024-09-12T03:08:49.263821+0000, chain.objs.size()=1 2024-09-12T01:21:57.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.7U8k4XDKHlA_l4hI0-gbVlCMBlN_AoU_0 2024-09-12T01:21:57.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12195392092576019163', time=2024-09-12T03:08:49.289124+0000, chain.objs.size()=1 2024-09-12T01:21:57.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.cWqF-8v7tNnGAcWYDJdgQzUvh_Woo3w_0 2024-09-12T01:21:57.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13136606846166245075', time=2024-09-12T03:08:49.332872+0000, chain.objs.size()=1 2024-09-12T01:21:57.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.KgPJXEU8OoziRJgqARQ8RtpxmDLcSc8_0 2024-09-12T01:21:57.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13048680324205890534', time=2024-09-12T03:08:49.355209+0000, chain.objs.size()=1 2024-09-12T01:21:57.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.KJEjb1m8r1CpatActX2GCARjZpEMh8L_0 2024-09-12T01:21:57.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14940946470096933399', time=2024-09-12T03:08:49.547714+0000, chain.objs.size()=1 2024-09-12T01:21:57.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.vZXk6685jNv-VTC6zdBM81urGKAsmlv_0 2024-09-12T01:21:57.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17083977231750338521', time=2024-09-12T03:08:49.567149+0000, chain.objs.size()=1 2024-09-12T01:21:57.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ERa1kkTSZD5b8d11jBWdF8Q2VcjUych_0 2024-09-12T01:21:57.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14229343824323304052', time=2024-09-12T03:08:49.569280+0000, chain.objs.size()=1 2024-09-12T01:21:57.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.T47Rtll5dzdHS0l3hYirbE-5ix1IE6x_0 2024-09-12T01:21:57.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2554112806053441004', time=2024-09-12T03:08:49.658492+0000, chain.objs.size()=1 2024-09-12T01:21:57.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.fmQOsod9tvukJFeIpDun-xHtI3RfmDF_0 2024-09-12T01:21:57.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2263317441804405592', time=2024-09-12T03:08:51.977515+0000, chain.objs.size()=1 2024-09-12T01:21:57.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.266__shadow_.5dPtkVCIgdO9zs3BpwvAC3t1H-0rm_C_0 2024-09-12T01:21:57.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12089299376800008789', time=2024-09-12T03:08:52.613736+0000, chain.objs.size()=1 2024-09-12T01:21:57.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.267__shadow_.kjNOycA5CsHoUT061Zme77aArIVD3X2_0 2024-09-12T01:21:57.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10576945283344513844', time=2024-09-12T03:08:53.946914+0000, chain.objs.size()=1 2024-09-12T01:21:57.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.269__shadow_.HcwwQg9HnMbBqkTw_w8P3eMq3ywf0Us_0 2024-09-12T01:21:57.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8348874979079876460', time=2024-09-12T03:08:58.038157+0000, chain.objs.size()=1 2024-09-12T01:21:57.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.275__shadow_.tkZMDmjLfO2bX2h1jeRhUedoRo9WPf8_0 2024-09-12T01:21:57.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8868108137767744935', time=2024-09-12T03:09:02.218659+0000, chain.objs.size()=1 2024-09-12T01:21:57.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.281__shadow_.3l1mZUV78q9c3f8U5oDeN8rcwZwK6bM_0 2024-09-12T01:21:57.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1659078063269884475', time=2024-09-12T03:09:05.744382+0000, chain.objs.size()=1 2024-09-12T01:21:57.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.352+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.286__shadow_.ra6eAyetddjDo3A2kFybQDxAPcv2kT3_0 2024-09-12T01:21:57.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1310418522651265109', time=2024-09-12T03:09:11.610918+0000, chain.objs.size()=1 2024-09-12T01:21:57.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.293__shadow_.SJ0rN7wL43ZbB8HNdaxd5p6eEOgLisQ_0 2024-09-12T01:21:57.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5636607320295126758', time=2024-09-12T03:09:31.757635+0000, chain.objs.size()=1 2024-09-12T01:21:57.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.320__shadow:xbOChoGIpfnDTunU4xkUtKgoWqYfYhN_.K94zIzYVdAnqiwMG8gbcQWViWL5O7PR_0 2024-09-12T01:21:57.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11167271515400798216', time=2024-09-12T03:09:52.909405+0000, chain.objs.size()=1 2024-09-12T01:21:57.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.mdKbKoJvvexMedm5mvb950DfwhvVKTb_0 2024-09-12T01:21:57.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4872835074495996902', time=2024-09-12T03:09:53.094812+0000, chain.objs.size()=1 2024-09-12T01:21:57.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.0CVs-ox8a9DK0A5OtGT-xg-1XHG7fXb_0 2024-09-12T01:21:57.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4454057898164756910', time=2024-09-12T03:09:53.102192+0000, chain.objs.size()=1 2024-09-12T01:21:57.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.mZBMjDd4jxEkVCvJcuLKqeZqfGXOy60_0 2024-09-12T01:21:57.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4279582054874625764', time=2024-09-12T03:09:53.137456+0000, chain.objs.size()=1 2024-09-12T01:21:57.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.lAue2gUY4VWCnnmHmr1oT5hCJnXfSE2_0 2024-09-12T01:21:57.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10081468113974265065', time=2024-09-12T03:09:53.276679+0000, chain.objs.size()=1 2024-09-12T01:21:57.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.h5HsXTV0Wxy4wQWzfSQVk1M2aHe0fe2_0 2024-09-12T01:21:57.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5229888221568192239', time=2024-09-12T03:09:53.358464+0000, chain.objs.size()=1 2024-09-12T01:21:57.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.85SPvFB-cxVAIp9xEazCztvOyVHnmi7_0 2024-09-12T01:21:57.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5513300335376829538', time=2024-09-12T03:09:53.363104+0000, chain.objs.size()=1 2024-09-12T01:21:57.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.lgrVWb4zbgS_woR1-Amywz7FHDegyAl_0 2024-09-12T01:21:57.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9037709346156803890', time=2024-09-12T03:09:53.458431+0000, chain.objs.size()=1 2024-09-12T01:21:57.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.JhQ894fqoREZWB66oee_qChUgIPHDw8_0 2024-09-12T01:21:57.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1461411762021478883', time=2024-09-12T03:09:53.460402+0000, chain.objs.size()=1 2024-09-12T01:21:57.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.gA0zG_6cy2grf2ORPFjS7X1zWJY5LYo_0 2024-09-12T01:21:57.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.548302059831528579', time=2024-09-12T03:09:53.464456+0000, chain.objs.size()=1 2024-09-12T01:21:57.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Vp3Iu9PIhv4aqIL48RG_UaOdN-1iwZX_0 2024-09-12T01:21:57.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9001548904591796640', time=2024-09-12T03:09:53.468625+0000, chain.objs.size()=1 2024-09-12T01:21:57.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.jire9D5GNyyJ8juoAO4HQ1Nu6ypS4e5_0 2024-09-12T01:21:57.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7300398496366977870', time=2024-09-12T03:09:53.623566+0000, chain.objs.size()=1 2024-09-12T01:21:57.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.zHPe3Hyx-3Kfh6WdDsYSkHunkZe0C53_0 2024-09-12T01:21:57.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.356+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18013037950973517562', time=2024-09-12T03:09:53.735628+0000, chain.objs.size()=1 2024-09-12T01:21:57.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_._ZdU5eIT4Y0-T6kQpWAyHSA9H0Ie8IM_0 2024-09-12T01:21:57.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12761518011028439974', time=2024-09-12T03:09:53.774102+0000, chain.objs.size()=1 2024-09-12T01:21:57.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ZwoKg61QUyUVWD_WChdF4yMAQU5L9Yr_0 2024-09-12T01:21:57.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11794853132930627719', time=2024-09-12T03:09:53.796411+0000, chain.objs.size()=1 2024-09-12T01:21:57.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.IjhYK_tqlkQ0BZNr8xDIqiuJCvh7Ahb_0 2024-09-12T01:21:57.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6963093342551691777', time=2024-09-12T03:09:53.831220+0000, chain.objs.size()=1 2024-09-12T01:21:57.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.6SY55tIg_WRN8n_3_mTltlMaA8DJaWc_0 2024-09-12T01:21:57.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17963572775578664321', time=2024-09-12T03:09:54.050700+0000, chain.objs.size()=1 2024-09-12T01:21:57.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.4RHd837lj59aAaT9_dJMHqAep1B9ESt_0 2024-09-12T01:21:57.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2970680567345969298', time=2024-09-12T03:09:54.089179+0000, chain.objs.size()=1 2024-09-12T01:21:57.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.KQa0VNdU1EhLSTR0GS_lzyhwbyi3Rsk_0 2024-09-12T01:21:57.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12732058565452380484', time=2024-09-12T03:09:54.106115+0000, chain.objs.size()=1 2024-09-12T01:21:57.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Ct3J4SlxPYZ0VXJOoLi_O-1tn-ThUo9_0 2024-09-12T01:21:57.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12431025493160651299', time=2024-09-12T03:09:54.175446+0000, chain.objs.size()=1 2024-09-12T01:21:57.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.qVTcllMOiV9yp8P_pIC-A2KXcxlAJhU_0 2024-09-12T01:21:57.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8247695089353011235', time=2024-09-12T03:09:54.298172+0000, chain.objs.size()=1 2024-09-12T01:21:57.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.I-5GW6IPjeDsgfwKBJNUgZSRvWj462I_0 2024-09-12T01:21:57.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1249370270982338172', time=2024-09-12T03:09:54.311007+0000, chain.objs.size()=1 2024-09-12T01:21:57.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.hqhA-BlurscU_qvMGjpJV47z73PLt26_0 2024-09-12T01:21:57.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4967838656282144010', time=2024-09-12T03:09:54.339588+0000, chain.objs.size()=1 2024-09-12T01:21:57.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.1LYy9batjpfRoFLo5DCMZ4ZWj9u9LJ9_0 2024-09-12T01:21:57.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13380537804099192304', time=2024-09-12T03:09:54.370669+0000, chain.objs.size()=1 2024-09-12T01:21:57.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.IMb30mbsuzTX9It-Y_rpewS8v2emzv3_0 2024-09-12T01:21:57.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6180900662505775871', time=2024-09-12T03:09:54.400066+0000, chain.objs.size()=1 2024-09-12T01:21:57.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.RLIskBTT3dFbq2B-0mu52cUH4G0sF-m_0 2024-09-12T01:21:57.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4448736864492003256', time=2024-09-12T03:09:54.440647+0000, chain.objs.size()=1 2024-09-12T01:21:57.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.rHdT30IagAbo-3VbnuFi2gt6_DhLcSQ_0 2024-09-12T01:21:57.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12351765741859011588', time=2024-09-12T03:09:54.457467+0000, chain.objs.size()=1 2024-09-12T01:21:57.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.EkD7ao7jAzYS2XVwWQkpQVQRC9PDmlw_0 2024-09-12T01:21:57.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13660530034173710890', time=2024-09-12T03:09:54.464728+0000, chain.objs.size()=1 2024-09-12T01:21:57.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.cAzfNezKqk-ygzVMnCzmnrVlWdm7pxV_0 2024-09-12T01:21:57.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17707707440362505326', time=2024-09-12T03:09:54.486649+0000, chain.objs.size()=1 2024-09-12T01:21:57.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.tjp1k8f7P4hS8baCVBMUUKeR4sc73Yh_0 2024-09-12T01:21:57.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16020657606012976588', time=2024-09-12T03:09:54.499691+0000, chain.objs.size()=1 2024-09-12T01:21:57.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.7jaRzPUC1j9S9m5Xz0EYpU_yXUhMUFQ_0 2024-09-12T01:21:57.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17553863913835875618', time=2024-09-12T03:09:54.659878+0000, chain.objs.size()=1 2024-09-12T01:21:57.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.360+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.PC5q8Ll4jNMWMHgzV6K5zR5AoFeRuJO_0 2024-09-12T01:21:57.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12031443086052088251', time=2024-09-12T03:09:54.750257+0000, chain.objs.size()=1 2024-09-12T01:21:57.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.1vMKfFGXA_WALzEQWv3aUeEnoHiIUel_0 2024-09-12T01:21:57.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2530509577033061816', time=2024-09-12T03:09:54.757623+0000, chain.objs.size()=1 2024-09-12T01:21:57.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Msq-H7PJ3ZWFvVS8U8aOdajnjd-XfDF_0 2024-09-12T01:21:57.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8788709494726790190', time=2024-09-12T03:09:54.826371+0000, chain.objs.size()=1 2024-09-12T01:21:57.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ZY238EG-UqOouHRRQlmUVV8I0P11SEl_0 2024-09-12T01:21:57.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.337182879434493179', time=2024-09-12T03:09:55.070496+0000, chain.objs.size()=1 2024-09-12T01:21:57.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ewJE5ZkNHCl_sDj01DiOvvLsk_M07c1_0 2024-09-12T01:21:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1078439278772686715', time=2024-09-12T03:09:55.136781+0000, chain.objs.size()=1 2024-09-12T01:21:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.OZwrSjx1qye7fl981mAYPV-_1erlUw0_0 2024-09-12T01:21:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13148751068603722189', time=2024-09-12T03:09:55.299602+0000, chain.objs.size()=1 2024-09-12T01:21:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.poVqbm3oKyY25EHO9AaIilTYrIeyTIl_0 2024-09-12T01:21:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18307662813193093713', time=2024-09-12T03:09:55.327126+0000, chain.objs.size()=1 2024-09-12T01:21:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.2mFU7dTYsLEKiet9RxGoeqLY_H5IaHn_0 2024-09-12T01:21:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4886141481228712586', time=2024-09-12T03:09:55.345724+0000, chain.objs.size()=1 2024-09-12T01:21:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.I6cw1uXbkyex4fkStFg-vqhVHpgk1dq_0 2024-09-12T01:21:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3707681250003680667', time=2024-09-12T03:10:15.231501+0000, chain.objs.size()=1 2024-09-12T01:21:57.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.PfMYhkyEud-HtotChVZaz2ccwSPTNxK_0 2024-09-12T01:21:57.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12562369227939714509', time=2024-09-12T03:10:15.326973+0000, chain.objs.size()=1 2024-09-12T01:21:57.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Tny5Nu4RUKsCjC48Ox4p-gPtsBD1z93_0 2024-09-12T01:21:57.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17660134966639521730', time=2024-09-12T03:10:15.614776+0000, chain.objs.size()=1 2024-09-12T01:21:57.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.UhlVPLpKIYChoYqI3M7HkYfAkg7TCxS_0 2024-09-12T01:21:57.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5657644269093999262', time=2024-09-12T03:10:15.660950+0000, chain.objs.size()=1 2024-09-12T01:21:57.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.2LrzcjiNtz0Phk-ztUgHjTRXxx6wR7m_0 2024-09-12T01:21:57.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.584488913504607276', time=2024-09-12T03:10:15.683804+0000, chain.objs.size()=1 2024-09-12T01:21:57.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.7n-xeo-qnz6Smsov2jdK9oJLevS0dr4_0 2024-09-12T01:21:57.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8691035025824570315', time=2024-09-12T03:10:15.718001+0000, chain.objs.size()=1 2024-09-12T01:21:57.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.L7N8jqQ-odW_mMek4rMiEKaRJrM5L6z_0 2024-09-12T01:21:57.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11681774860175643461', time=2024-09-12T03:10:15.750593+0000, chain.objs.size()=1 2024-09-12T01:21:57.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.VrC2nqTPEBu5gMcvRHiLQsaWfUpxb68_0 2024-09-12T01:21:57.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6798725073071803510', time=2024-09-12T03:10:15.763066+0000, chain.objs.size()=1 2024-09-12T01:21:57.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.364+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.oG7zZrlX4Y1PHpBFC50hm1ZJpCrpdnF_0 2024-09-12T01:21:57.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.614146470292473728', time=2024-09-12T03:10:15.929743+0000, chain.objs.size()=1 2024-09-12T01:21:57.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_._1yXyWJ1Qan0QAtEFyy1Ld0grwvufgu_0 2024-09-12T01:21:57.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6737622066583809626', time=2024-09-12T03:10:16.057593+0000, chain.objs.size()=1 2024-09-12T01:21:57.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.uC8-JNM4lwZJN0yKsgAKpFfWRBpft_0_0 2024-09-12T01:21:57.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16216663827133599207', time=2024-09-12T03:10:16.084953+0000, chain.objs.size()=1 2024-09-12T01:21:57.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.juH8jJpzTDsfEhe5j1nmdqGReW1Ho4v_0 2024-09-12T01:21:57.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17390977733203724325', time=2024-09-12T03:10:16.203497+0000, chain.objs.size()=1 2024-09-12T01:21:57.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ZyN5LqhL_-WdtchiPasXfa7pJsQM8tI_0 2024-09-12T01:21:57.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8389093704723702063', time=2024-09-12T03:10:16.244618+0000, chain.objs.size()=1 2024-09-12T01:21:57.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.I-jAMBekWFhouwY3ifJV10OeNAjlFvq_0 2024-09-12T01:21:57.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14265196960720970649', time=2024-09-12T03:10:16.359590+0000, chain.objs.size()=1 2024-09-12T01:21:57.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.xpPzd9OzJ0Ed-i79FdJHTgT2v6PJvIR_0 2024-09-12T01:21:57.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15184437937767139660', time=2024-09-12T03:10:16.366241+0000, chain.objs.size()=1 2024-09-12T01:21:57.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.JnDq8kSKN_UqR1PtxcpWhWPw3n9COmu_0 2024-09-12T01:21:57.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14304194057109518189', time=2024-09-12T03:10:16.644470+0000, chain.objs.size()=1 2024-09-12T01:21:57.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.UGe43j8ITBxurh_nfjIgdnA5xfqiYfI_0 2024-09-12T01:21:57.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4879195348063038070', time=2024-09-12T03:10:16.960120+0000, chain.objs.size()=1 2024-09-12T01:21:57.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ZyREHGy1RSr15e55GMlHfhsNQRzvA7Y_0 2024-09-12T01:21:57.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2612909094257197761', time=2024-09-12T03:10:17.176420+0000, chain.objs.size()=1 2024-09-12T01:21:57.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.04TMq0tw0Ykya5goLjmn_Mb-vkqERqE_0 2024-09-12T01:21:57.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1868959319178204448', time=2024-09-12T03:10:17.206553+0000, chain.objs.size()=1 2024-09-12T01:21:57.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.BcrIqOzL9Hk75s16pk1N9B62owYt3OI_0 2024-09-12T01:21:57.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13098656750738622191', time=2024-09-12T03:10:17.236294+0000, chain.objs.size()=1 2024-09-12T01:21:57.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.lCsN2zHy9Zp1BPt3zAbo4NwN7RVzolZ_0 2024-09-12T01:21:57.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13162991792653575907', time=2024-09-12T03:10:17.239897+0000, chain.objs.size()=1 2024-09-12T01:21:57.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.FSmXDy81wOI9ClvwkQVElKE90qEimyQ_0 2024-09-12T01:21:57.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2156884574841625930', time=2024-09-12T03:10:17.242208+0000, chain.objs.size()=1 2024-09-12T01:21:57.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.GZS02OYlTKK0FsfrqD5wNziO6SBbnnq_0 2024-09-12T01:21:57.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8910956829906494584', time=2024-09-12T03:10:17.290378+0000, chain.objs.size()=1 2024-09-12T01:21:57.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.UHyuU2UsE1hz-uGIApQGJy-jH_ojH30_0 2024-09-12T01:21:57.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1149129987866209914', time=2024-09-12T03:10:17.453652+0000, chain.objs.size()=1 2024-09-12T01:21:57.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.3u8H2JhKWu2rQnbjTeg-OoTNpf9yHRa_0 2024-09-12T01:21:57.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1969367450929739186', time=2024-09-12T03:10:17.591969+0000, chain.objs.size()=1 2024-09-12T01:21:57.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.368+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.MEmGTBnhmb3gIWan_CkcNNMKVhqTo1V_0 2024-09-12T01:21:57.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.372+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45730 2024-09-12T01:21:57.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.372+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T01:21:57.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.372+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1027313982447525088', time=2024-09-12T03:10:17.613687+0000, chain.objs.size()=1 2024-09-12T01:21:57.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.372+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.wqfiQ1rnd5Mx4gIyHpHe9sKG1FsvbSG_0 2024-09-12T01:21:57.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.372+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3579819901959403929', time=2024-09-12T03:10:17.774259+0000, chain.objs.size()=1 2024-09-12T01:21:57.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.372+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.GoaeFU-sM_kkHE_Hj_-mzHDMlGgYLG7_0 2024-09-12T01:21:57.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.372+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10747137129520697266', time=2024-09-12T03:10:17.784898+0000, chain.objs.size()=1 2024-09-12T01:21:57.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.372+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.z6OQdJMbG4e4VKvr3Y3vGx3iy8tdGF6_0 2024-09-12T01:21:57.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.372+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8346122871349170780', time=2024-09-12T03:10:17.803058+0000, chain.objs.size()=1 2024-09-12T01:21:57.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.372+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.MqxdCa4PWOgt5MeUDqLtUG5x1wrzf5q_0 2024-09-12T01:21:57.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.372+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1415122819254314269', time=2024-09-12T03:10:17.849414+0000, chain.objs.size()=1 2024-09-12T01:21:57.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.372+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.RPftodkoegahJmFOU6kQGlpXfiyWRVc_0 2024-09-12T01:21:57.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.372+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7467733346595330186', time=2024-09-12T03:10:23.417991+0000, chain.objs.size()=1 2024-09-12T01:21:57.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.372+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.334__shadow_.bHOkNl767N1PultslQ0o9Qh_cvS2gTu_0 2024-09-12T01:21:57.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.372+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14806282602979793326', time=2024-09-12T03:10:46.182528+0000, chain.objs.size()=1 2024-09-12T01:21:57.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.372+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.373__shadow_.jmoRAcYpE_bjVWO5HoO_U8DH0HN071L_0 2024-09-12T01:21:57.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.372+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7594646727809589622', time=2024-09-12T03:11:56.838847+0000, chain.objs.size()=1 2024-09-12T01:21:57.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.372+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.467__shadow_.Xs1NZJomXiF0gKJy3xt6xSYBdHYO52I_0 2024-09-12T01:21:57.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.372+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17749122882108836933', time=2024-09-12T03:12:09.515267+0000, chain.objs.size()=1 2024-09-12T01:21:57.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.372+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.490__shadow_.Vzv80nZFHK7gWwCwvX2HkcEkAtCeShJ_0 2024-09-12T01:21:57.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.372+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13520320098958830940', time=2024-09-12T03:12:29.989887+0000, chain.objs.size()=1 2024-09-12T01:21:57.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.372+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.518__shadow_._U4KpgndQpijO9wRTmr65dYuQei2Rsc_0 2024-09-12T01:21:57.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.372+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9131905596622599760', time=2024-09-12T03:12:29.991969+0000, chain.objs.size()=1 2024-09-12T01:21:57.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.372+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.518__shadow_.GYhxsFt9Ojp8plm5ShLwblUIlS8FOJj_0 2024-09-12T01:21:57.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.372+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~9pMhh_C5ubJUR515zkiAuHQPq_s-q0u', time=2024-09-12T03:13:02.090949+0000, chain.objs.size()=10 2024-09-12T01:21:57.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.372+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.527__multipart_mymultipart.2~9pMhh_C5ubJUR515zkiAuHQPq_s-q0u.1 2024-09-12T01:21:57.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.376+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.527__multipart_mymultipart.2~9pMhh_C5ubJUR515zkiAuHQPq_s-q0u.2 2024-09-12T01:21:57.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.376+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.527__multipart_mymultipart.2~9pMhh_C5ubJUR515zkiAuHQPq_s-q0u.3 2024-09-12T01:21:57.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.376+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.527__multipart_mymultipart.2~9pMhh_C5ubJUR515zkiAuHQPq_s-q0u.4 2024-09-12T01:21:57.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.376+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.527__multipart_mymultipart.2~9pMhh_C5ubJUR515zkiAuHQPq_s-q0u.5 2024-09-12T01:21:57.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.376+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.527__multipart_mymultipart.2~9pMhh_C5ubJUR515zkiAuHQPq_s-q0u.6 2024-09-12T01:21:57.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.376+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.527__multipart_mymultipart.2~9pMhh_C5ubJUR515zkiAuHQPq_s-q0u.7 2024-09-12T01:21:57.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.376+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.527__multipart_mymultipart.2~9pMhh_C5ubJUR515zkiAuHQPq_s-q0u.8 2024-09-12T01:21:57.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.376+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.527__multipart_mymultipart.2~9pMhh_C5ubJUR515zkiAuHQPq_s-q0u.9 2024-09-12T01:21:57.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.376+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.527__multipart_mymultipart.2~9pMhh_C5ubJUR515zkiAuHQPq_s-q0u.10 2024-09-12T01:21:57.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.376+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18017845768545478305', time=2024-09-12T03:13:27.994785+0000, chain.objs.size()=1 2024-09-12T01:21:57.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.376+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.538__shadow_.tj9aMgCtvi1qRRnOKEpYnEWcyBmLHXe_0 2024-09-12T01:21:57.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.376+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4460563813065036891', time=2024-09-12T03:13:57.391190+0000, chain.objs.size()=1 2024-09-12T01:21:57.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.376+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.560__shadow_.tbI1a_jRMsGuzDmHGfpADDdl_PhTLCp_0 2024-09-12T01:21:57.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.376+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1400816267873074742', time=2024-09-12T03:14:09.929927+0000, chain.objs.size()=1 2024-09-12T01:21:57.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.376+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:UZlcNH3qTZyRRl.0XmyhVTJmrJY7EwC_.BavgNGiDsngagPNHk-i6bea8WTxruvd_0 2024-09-12T01:21:57.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.376+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.792212988027750677', time=2024-09-12T03:14:12.513001+0000, chain.objs.size()=1 2024-09-12T01:21:57.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.376+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:V8s.CL1IG1d3M51VYUqXrokbyFMpXT6_.hHgHiuY6uScHWqtO4OJxlwA3oAOGxPl_0 2024-09-12T01:21:57.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.380+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3005275356525612438', time=2024-09-12T03:14:18.103471+0000, chain.objs.size()=1 2024-09-12T01:21:57.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.380+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.571__shadow:wHXKCyOzYroQL8-3--htiddVHqDOVpX_.aN4v6M3-dmNZ9wTO7prDAs2so3ifSXm_0 2024-09-12T01:21:57.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.380+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4200412303169487636', time=2024-09-12T03:14:34.608403+0000, chain.objs.size()=1 2024-09-12T01:21:57.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.380+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:aV3BDf3vbAdUbmpZhcbIeykVzVBDCDq_.DjH3D6BSt8WZDyYw7BCMygcluYWo5OQ_0 2024-09-12T01:21:57.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.380+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10263420108574391104', time=2024-09-12T03:14:45.922082+0000, chain.objs.size()=1 2024-09-12T01:21:57.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.380+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:leEAlIW9zP3jOEEp3CkEOswOnq0l2.5_.TTC8xbcxE5IT4Lrdh-qfN5ZaaLHfZ2m_0 2024-09-12T01:21:57.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.380+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4199963013862179629', time=2024-09-12T03:14:51.997744+0000, chain.objs.size()=1 2024-09-12T01:21:57.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.380+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.580__shadow:KVoKWKtBHqXWyw1r5r8dNIzqBTMAsMj_.kq_BsO5SoYR-vZPEEukxZqCM6iLyyZ9_0 2024-09-12T01:21:57.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.380+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14934239800411788813', time=2024-09-12T03:14:53.626341+0000, chain.objs.size()=1 2024-09-12T01:21:57.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.380+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.581__shadow:Hlpx7f3Y0G1KYveYpJ3BijpqIMDT--x_.G1FB6asNJW3t2HG3PI-GPOtFeAO4_oE_0 2024-09-12T01:21:57.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.380+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4342576931951813982', time=2024-09-12T03:18:01.470555+0000, chain.objs.size()=1 2024-09-12T01:21:57.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.380+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.656__shadow_.7lfPw7ellIa3zkI7KwQvqBmXNKXdoMy_0 2024-09-12T01:21:57.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.380+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8070628391993689726', time=2024-09-12T03:18:07.412137+0000, chain.objs.size()=6 2024-09-12T01:21:57.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.380+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.663__multipart_foo.2~uNTreCFyaaStOaufR-_MADnCsE5cEaY.1 2024-09-12T01:21:57.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.380+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.663__multipart_foo.2~uNTreCFyaaStOaufR-_MADnCsE5cEaY.2 2024-09-12T01:21:57.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.380+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.663__multipart_foo.2~uNTreCFyaaStOaufR-_MADnCsE5cEaY.3 2024-09-12T01:21:57.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.380+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.663__multipart_foo.2~uNTreCFyaaStOaufR-_MADnCsE5cEaY.4 2024-09-12T01:21:57.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.380+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.663__multipart_foo.2~uNTreCFyaaStOaufR-_MADnCsE5cEaY.5 2024-09-12T01:21:57.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.380+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.663__multipart_foo.2~uNTreCFyaaStOaufR-_MADnCsE5cEaY.6 2024-09-12T01:21:57.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.380+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1858297101835929835', time=2024-09-12T03:18:28.884461+0000, chain.objs.size()=1 2024-09-12T01:21:57.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.380+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.698__shadow:eDmtZYu7evpX8Qf4qehX-IAXEZy.waM_.pbisWWAZ49aEmm4VwW2kGdeHu9Qwrzh_0 2024-09-12T01:21:57.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.380+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16531172913596321563', time=2024-09-12T03:18:32.964498+0000, chain.objs.size()=1 2024-09-12T01:21:57.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.380+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.704__shadow:aONB-xiHdGBRJ8TL3DUsJbIWVR9Okn5_.HelA0BNB6CtRzZ46JA7Sq5nLkBe69Gt_0 2024-09-12T01:21:57.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.380+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14861853399190470542', time=2024-09-12T03:18:38.797181+0000, chain.objs.size()=1 2024-09-12T01:21:57.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.380+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.713__shadow:.Be3.CU5vkngPFSGVFZLLJBKJ2oD7mA_.52Ts8gcHUPM8GXFIUy9ciIuorEpXfvw_0 2024-09-12T01:21:57.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.384+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:57.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.384+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:21:57.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.388+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:57.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.388+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:57.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.388+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48166' 2024-09-12T01:21:57.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.388+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16043115759874243063', time=2024-09-12T03:05:58.444332+0000, chain.objs.size()=3 2024-09-12T01:21:57.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.388+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.160__multipart_mymultipart-STANDARD.2~W_IJMDrvqgaCw1SFHWGBN_9sKY_vFCd.1 2024-09-12T01:21:57.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.388+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.160__multipart_mymultipart-STANDARD.2~W_IJMDrvqgaCw1SFHWGBN_9sKY_vFCd.2 2024-09-12T01:21:57.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.388+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.160__multipart_mymultipart-STANDARD.2~W_IJMDrvqgaCw1SFHWGBN_9sKY_vFCd.3 2024-09-12T01:21:57.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.388+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_heyE4pujDSmAIkuYmHEwy5zECwfwnwt', time=2024-09-12T03:06:02.657301+0000, chain.objs.size()=2 2024-09-12T01:21:57.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.388+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.162__shadow_.Ynfp-frol5rjw-vKh3UL5DskBEaE_N-_0 2024-09-12T01:21:57.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.388+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.162__shadow_.Ynfp-frol5rjw-vKh3UL5DskBEaE_N-_1 2024-09-12T01:21:57.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.388+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13859490949627823816', time=2024-09-12T03:06:04.520794+0000, chain.objs.size()=2 2024-09-12T01:21:57.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.388+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.165__multipart_foo.2~0Qi5KOyHnSZ_eyiGl8gWhvyslRlJvob.1 2024-09-12T01:21:57.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.388+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.165__multipart_foo.2~0Qi5KOyHnSZ_eyiGl8gWhvyslRlJvob.2 2024-09-12T01:21:57.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.388+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4931585300962537262', time=2024-09-12T03:06:06.536718+0000, chain.objs.size()=1 2024-09-12T01:21:57.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.388+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.172__shadow_.xbAAV4NCrCeVJ1R2nvbFje-0V_icjpz_0 2024-09-12T01:21:57.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.388+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7036774985048832851', time=2024-09-12T03:08:07.037287+0000, chain.objs.size()=1 2024-09-12T01:21:57.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.388+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.234__shadow_.bofYIvN0l2VCDGsovTJPq5zNMHcATRP_0 2024-09-12T01:21:57.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.388+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3851203047532376171', time=2024-09-12T03:08:08.432215+0000, chain.objs.size()=1 2024-09-12T01:21:57.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.388+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.236__shadow_.J6ojt5RGw19RpVEbOurNm-Me8O6ygWG_0 2024-09-12T01:21:57.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.388+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15385087477925023222', time=2024-09-12T03:08:13.448338+0000, chain.objs.size()=1 2024-09-12T01:21:57.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.388+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.242__shadow_.Ih_9ihNPCX0LHpwVBP1dLMR_H20PVd6_0 2024-09-12T01:21:57.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.388+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16776827152595400361', time=2024-09-12T03:08:47.506929+0000, chain.objs.size()=1 2024-09-12T01:21:57.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.388+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.WiY9BfVFYrNrJOpB472sy_0cZc9Yleb_0 2024-09-12T01:21:57.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.938641113884683603', time=2024-09-12T03:08:47.532383+0000, chain.objs.size()=1 2024-09-12T01:21:57.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Djr8d7XsDoTTgZd67GJXYSt4xN7aklJ_0 2024-09-12T01:21:57.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7699462838318725133', time=2024-09-12T03:08:47.595491+0000, chain.objs.size()=1 2024-09-12T01:21:57.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.lq1zW7xnI1s1rTvtF1gRxDL0V013w1o_0 2024-09-12T01:21:57.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4426101900475923126', time=2024-09-12T03:08:47.597169+0000, chain.objs.size()=1 2024-09-12T01:21:57.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ybKtq660lXSwFEyOM5WaireLSaCMyYA_0 2024-09-12T01:21:57.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14145787356262550304', time=2024-09-12T03:08:48.002065+0000, chain.objs.size()=1 2024-09-12T01:21:57.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.vKa7Xqzv_JqDMP5xfOhAov8dpU5DFA7_0 2024-09-12T01:21:57.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17266980702702333268', time=2024-09-12T03:08:48.253003+0000, chain.objs.size()=1 2024-09-12T01:21:57.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.CIypK-l3hibdZis6Th6cZWDgSrsrXqr_0 2024-09-12T01:21:57.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16386634165080557038', time=2024-09-12T03:08:48.304168+0000, chain.objs.size()=1 2024-09-12T01:21:57.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.rnziWnBiWR2mNqDWj1MvLrAr78MKdSM_0 2024-09-12T01:21:57.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12857470257582268415', time=2024-09-12T03:08:48.635660+0000, chain.objs.size()=1 2024-09-12T01:21:57.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Cufg7e74v5InUKReffeyJk9hCTJIBN__0 2024-09-12T01:21:57.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11561035583566654170', time=2024-09-12T03:08:48.638363+0000, chain.objs.size()=1 2024-09-12T01:21:57.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.1qPeZw23Fe9UWDtqkuEJMOUeltydWkI_0 2024-09-12T01:21:57.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11165913760386805389', time=2024-09-12T03:08:48.913937+0000, chain.objs.size()=1 2024-09-12T01:21:57.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.pljosuFBum4RXARTHBVtOC6-LPJRxsr_0 2024-09-12T01:21:57.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.483530980834562319', time=2024-09-12T03:08:48.932351+0000, chain.objs.size()=1 2024-09-12T01:21:57.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.epLOyNH4domSr4SPwcpWs23e78dt6Nb_0 2024-09-12T01:21:57.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13346095418731714474', time=2024-09-12T03:08:49.239701+0000, chain.objs.size()=1 2024-09-12T01:21:57.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.4ebM6x3UVkrzpYUwcOZiv19cAh6C7BE_0 2024-09-12T01:21:57.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8656348332215540587', time=2024-09-12T03:08:49.326499+0000, chain.objs.size()=1 2024-09-12T01:21:57.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.lSCZvk_jyB653p3fjOfLRj2Qcmv4blp_0 2024-09-12T01:21:57.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1734355850511305000', time=2024-09-12T03:08:49.364161+0000, chain.objs.size()=1 2024-09-12T01:21:57.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.8dJbM-LMr9bf7r-kp3O897tQiS4YTcV_0 2024-09-12T01:21:57.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12374832211731131626', time=2024-09-12T03:08:49.697686+0000, chain.objs.size()=1 2024-09-12T01:21:57.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_._udKho_xJf7M9oYayCNJMY7iIwzUlUO_0 2024-09-12T01:21:57.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8516110290514731773', time=2024-09-12T03:08:49.707913+0000, chain.objs.size()=1 2024-09-12T01:21:57.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.iyz1Y0sm8-q9Pz9N0on-j9yoDaDl94a_0 2024-09-12T01:21:57.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11024862352889372407', time=2024-09-12T03:08:49.719297+0000, chain.objs.size()=1 2024-09-12T01:21:57.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.iI0lHgrwkeQrjOjLU7CtpKMsJXyHRn0_0 2024-09-12T01:21:57.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11598135161439815986', time=2024-09-12T03:08:49.892337+0000, chain.objs.size()=1 2024-09-12T01:21:57.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.gCh0mUfb3T7h6BI_c3TCkugo-xYpa8e_0 2024-09-12T01:21:57.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12062659867756462984', time=2024-09-12T03:08:49.934697+0000, chain.objs.size()=1 2024-09-12T01:21:57.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ugz50Bg1CJdQpiNoZOlxDTAbxnlek7Q_0 2024-09-12T01:21:57.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3323602003003857306', time=2024-09-12T03:08:49.992134+0000, chain.objs.size()=1 2024-09-12T01:21:57.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.2m_A13mgFjR12MNSsoBdxR7hJxVbDSQ_0 2024-09-12T01:21:57.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17970285898502653366', time=2024-09-12T03:08:50.025093+0000, chain.objs.size()=1 2024-09-12T01:21:57.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.3zZY-Z-FJMQEG6Pp6B-ZogY3CGP7nKC_0 2024-09-12T01:21:57.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.939384181253978816', time=2024-09-12T03:08:57.357694+0000, chain.objs.size()=1 2024-09-12T01:21:57.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.274__shadow_.hGFQdSduqAJo89iV-bRDotsiv6eVQkj_0 2024-09-12T01:21:57.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13121259482920386438', time=2024-09-12T03:09:00.871559+0000, chain.objs.size()=1 2024-09-12T01:21:57.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.392+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.279__shadow_.2-KYXvUCgC18k9FdrIObcVzP5xtagHY_0 2024-09-12T01:21:57.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3521071133645671156', time=2024-09-12T03:09:08.570916+0000, chain.objs.size()=1 2024-09-12T01:21:57.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.290__shadow_.4ne4VCNbA0CFR9J14d8hTFVpjleErpV_0 2024-09-12T01:21:57.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16760473668207240376', time=2024-09-12T03:09:13.033049+0000, chain.objs.size()=1 2024-09-12T01:21:57.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.294__shadow_.Xl90JMAbIGrelvfBmPNSrP67sV8ihdB_0 2024-09-12T01:21:57.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17372613039478696343', time=2024-09-12T03:09:13.048765+0000, chain.objs.size()=1 2024-09-12T01:21:57.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.294__shadow_.9bwqIk54NLD-PuC42StZ9oFkhcwbR_t_0 2024-09-12T01:21:57.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9320398817472971266', time=2024-09-12T03:09:13.056889+0000, chain.objs.size()=1 2024-09-12T01:21:57.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.294__shadow_.fdTpfl1yh-bhE2SAHia_x0jF8R932fl_0 2024-09-12T01:21:57.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2906827480367697366', time=2024-09-12T03:09:15.121936+0000, chain.objs.size()=1 2024-09-12T01:21:57.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.297__shadow_.H4OJF4oQ3zYMEnhWjjIs4SHjGv7C3dZ_0 2024-09-12T01:21:57.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11402924688022101123', time=2024-09-12T03:09:19.376433+0000, chain.objs.size()=1 2024-09-12T01:21:57.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.303__shadow_.8377nLcoJsAF9hMBkdGwShIRYdRx7xG_0 2024-09-12T01:21:57.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5010047820638456194', time=2024-09-12T03:09:19.378271+0000, chain.objs.size()=1 2024-09-12T01:21:57.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.303__shadow_.XZ7vpCqSoohaT1zlKWRXLNz8qMXCwd3_0 2024-09-12T01:21:57.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7949369149689983745', time=2024-09-12T03:09:19.380268+0000, chain.objs.size()=1 2024-09-12T01:21:57.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.303__shadow_.tlKeeze8OPFNiIv8nuPh6au32wu8bB1_0 2024-09-12T01:21:57.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7696191301768416013', time=2024-09-12T03:09:20.778684+0000, chain.objs.size()=1 2024-09-12T01:21:57.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.305__shadow_.nzE45OjkFZoIdFDRlSWdbu3xpkDtTdg_0 2024-09-12T01:21:57.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12158674744013502717', time=2024-09-12T03:09:33.396908+0000, chain.objs.size()=1 2024-09-12T01:21:57.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.323__shadow_.fQILnoSjDGGEI_CteCGoeM-ldujRhRA_0 2024-09-12T01:21:57.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16444218659581110472', time=2024-09-12T03:09:52.908122+0000, chain.objs.size()=1 2024-09-12T01:21:57.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.BLctZUPByvfJtSRvRKhBpGdDRXOBgUi_0 2024-09-12T01:21:57.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6880179095238943556', time=2024-09-12T03:09:52.956210+0000, chain.objs.size()=1 2024-09-12T01:21:57.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.lNNVPihLuQ6CrM7AlACofxb-foBvdJE_0 2024-09-12T01:21:57.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10770900010167253833', time=2024-09-12T03:09:53.019195+0000, chain.objs.size()=1 2024-09-12T01:21:57.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.JiGmHVMEH-5qtRXKidBSw57ug7Yj5-4_0 2024-09-12T01:21:57.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2104336205128709834', time=2024-09-12T03:09:53.024970+0000, chain.objs.size()=1 2024-09-12T01:21:57.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.396+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.rzYOXp0hlse_JpPFoAJSheZCK0Dv9gT_0 2024-09-12T01:21:57.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14828055837341530469', time=2024-09-12T03:09:53.063663+0000, chain.objs.size()=1 2024-09-12T01:21:57.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.yEeP-vMhgMnLTq0ReNcUfJV9CTqfpWl_0 2024-09-12T01:21:57.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12921417224690343695', time=2024-09-12T03:09:53.113159+0000, chain.objs.size()=1 2024-09-12T01:21:57.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.NTSH-mhcWHYTj14Y-pmv95_qijqRN2N_0 2024-09-12T01:21:57.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11321456801592036509', time=2024-09-12T03:09:53.119577+0000, chain.objs.size()=1 2024-09-12T01:21:57.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.8aGjvlW3EHM-D289GC16B6UFbyZqg5h_0 2024-09-12T01:21:57.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17654626662337247858', time=2024-09-12T03:09:53.497983+0000, chain.objs.size()=1 2024-09-12T01:21:57.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Odi_9IRw1Xtm9YJvMHmlvBwRt-V84mD_0 2024-09-12T01:21:57.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2623355915156519215', time=2024-09-12T03:09:53.631143+0000, chain.objs.size()=1 2024-09-12T01:21:57.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.WjJzNVE4EaKmtO7IcXTtlOQIvR9dEc__0 2024-09-12T01:21:57.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12833365052478467318', time=2024-09-12T03:09:54.039574+0000, chain.objs.size()=1 2024-09-12T01:21:57.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.QhLDntYyiak9s9JDNUAFv2rAGjVneUs_0 2024-09-12T01:21:57.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5192916351251986233', time=2024-09-12T03:09:54.117900+0000, chain.objs.size()=1 2024-09-12T01:21:57.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.7VJKAqgvW401vZH8k7yhXuLER8BzBGA_0 2024-09-12T01:21:57.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9292312810106712862', time=2024-09-12T03:09:54.154731+0000, chain.objs.size()=1 2024-09-12T01:21:57.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.66v05zsXveac-0Mg61U6HmMwQK_1uit_0 2024-09-12T01:21:57.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17863103294034171473', time=2024-09-12T03:09:54.784577+0000, chain.objs.size()=1 2024-09-12T01:21:57.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.TK0cZAJDzoxA2kewz9K6pffhAarhPjk_0 2024-09-12T01:21:57.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11519176444604194168', time=2024-09-12T03:09:54.811545+0000, chain.objs.size()=1 2024-09-12T01:21:57.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.YUr295gIG-OG0eBhqV_U8GslcTq-qMo_0 2024-09-12T01:21:57.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9179900374162198965', time=2024-09-12T03:09:54.822292+0000, chain.objs.size()=1 2024-09-12T01:21:57.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ALCc2mPb9cBgzbREon__nOro1wXkI39_0 2024-09-12T01:21:57.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2175379898871726255', time=2024-09-12T03:09:54.829486+0000, chain.objs.size()=1 2024-09-12T01:21:57.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.tpqQpb5v0PeFB72SyDFE2C5idG7Tef2_0 2024-09-12T01:21:57.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15132668193736019551', time=2024-09-12T03:09:55.059594+0000, chain.objs.size()=1 2024-09-12T01:21:57.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.YhS1lgsAjrRjnPkZXLLQZOywzE9y4EP_0 2024-09-12T01:21:57.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8104593540482981013', time=2024-09-12T03:09:55.072337+0000, chain.objs.size()=1 2024-09-12T01:21:57.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.5zTCEFrRB-i7UhX4lFudndsh8bmz666_0 2024-09-12T01:21:57.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4796327647822608624', time=2024-09-12T03:09:55.077578+0000, chain.objs.size()=1 2024-09-12T01:21:57.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.eQqKVjrJQpEDa6C1TjtsFw8Ok0P_1TM_0 2024-09-12T01:21:57.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14594874491429309947', time=2024-09-12T03:09:55.373558+0000, chain.objs.size()=1 2024-09-12T01:21:57.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.OHXKx_lKkNt-peC49yztRyza7bLL49Z_0 2024-09-12T01:21:57.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14646941288460608087', time=2024-09-12T03:09:55.394684+0000, chain.objs.size()=1 2024-09-12T01:21:57.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.5iFMjbSlUfoxw0S26Yw99z1vzbsojWq_0 2024-09-12T01:21:57.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4863089884944730026', time=2024-09-12T03:10:15.211951+0000, chain.objs.size()=1 2024-09-12T01:21:57.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Qz_KHxpnLVrRJLkim9FcZv0MZ1qiKJC_0 2024-09-12T01:21:57.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6191859501200637462', time=2024-09-12T03:10:15.274508+0000, chain.objs.size()=1 2024-09-12T01:21:57.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.QbVs-MlPl3Wcp_7T91xUWl9O6ueLMKB_0 2024-09-12T01:21:57.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.20943970619276222', time=2024-09-12T03:10:15.307317+0000, chain.objs.size()=1 2024-09-12T01:21:57.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.-9AGY7lAaqzV4N_wZPZxzQtcNVmvWFw_0 2024-09-12T01:21:57.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3817839901402606627', time=2024-09-12T03:10:15.320298+0000, chain.objs.size()=1 2024-09-12T01:21:57.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.400+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_._-Pu5yOdwmP6x_92DKdPiMfr418ECXg_0 2024-09-12T01:21:57.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.449833960661847606', time=2024-09-12T03:10:15.352440+0000, chain.objs.size()=1 2024-09-12T01:21:57.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.GJDCX4QBT0DCYaceRKilDmmlkAfDVKh_0 2024-09-12T01:21:57.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16856712419239021712', time=2024-09-12T03:10:15.358122+0000, chain.objs.size()=1 2024-09-12T01:21:57.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.PpqGvD3pAtTLhNW0-5tLk0LvIhTTfz3_0 2024-09-12T01:21:57.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8239526519471905134', time=2024-09-12T03:10:15.366030+0000, chain.objs.size()=1 2024-09-12T01:21:57.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.D_9RvpxhBmIPiPiSoaNWsrvvrMnizj4_0 2024-09-12T01:21:57.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9375286856717075321', time=2024-09-12T03:10:15.373200+0000, chain.objs.size()=1 2024-09-12T01:21:57.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.KkkHxBvXy7X7LW5tKYUbLH7ZSW0meXq_0 2024-09-12T01:21:57.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17608121625189482860', time=2024-09-12T03:10:15.375250+0000, chain.objs.size()=1 2024-09-12T01:21:57.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.BiubX_QD2j3-ajlbDoW83fU4teJuAky_0 2024-09-12T01:21:57.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14489457540358380960', time=2024-09-12T03:10:15.645256+0000, chain.objs.size()=1 2024-09-12T01:21:57.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.lMZcZvvjHncmSlrY_JItZkfyEGCcdr8_0 2024-09-12T01:21:57.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17035811135214583982', time=2024-09-12T03:10:15.769110+0000, chain.objs.size()=1 2024-09-12T01:21:57.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.asPnpWgP_2QehlMY9ZFnjPgLUXhj_Ku_0 2024-09-12T01:21:57.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16420308067410878400', time=2024-09-12T03:10:15.944647+0000, chain.objs.size()=1 2024-09-12T01:21:57.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.1BPsmzo9dNqNdx2-X5d8SVduPMPCCWM_0 2024-09-12T01:21:57.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13674360540539515289', time=2024-09-12T03:10:15.970209+0000, chain.objs.size()=1 2024-09-12T01:21:57.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.UHMhMSwGbGAmAn-2TM-L9mRN1jGuZdn_0 2024-09-12T01:21:57.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3877505572952320863', time=2024-09-12T03:10:16.025970+0000, chain.objs.size()=1 2024-09-12T01:21:57.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.7EQUidEEndJfHcCptXX36qFkbjaBm5G_0 2024-09-12T01:21:57.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3533985664495689788', time=2024-09-12T03:10:16.039892+0000, chain.objs.size()=1 2024-09-12T01:21:57.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.FWdbQCwboQkirHvK7uYq8GCGdGh5nf5_0 2024-09-12T01:21:57.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13393296480103834461', time=2024-09-12T03:10:16.052696+0000, chain.objs.size()=1 2024-09-12T01:21:57.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.tXiI6sxmHikr2dEXJP5fAOjWC1FfsDt_0 2024-09-12T01:21:57.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7641549677463808249', time=2024-09-12T03:10:16.632979+0000, chain.objs.size()=1 2024-09-12T01:21:57.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.nYx-JM42fjXajWUKGMoqTv_g0emtAwX_0 2024-09-12T01:21:57.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7771074797189146667', time=2024-09-12T03:10:16.843240+0000, chain.objs.size()=1 2024-09-12T01:21:57.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.gO4ziIysdF7p4Fb1XeNGBAwMzLAu_1z_0 2024-09-12T01:21:57.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2634934958424742177', time=2024-09-12T03:10:16.854136+0000, chain.objs.size()=1 2024-09-12T01:21:57.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.3chIuO_sOIPOvaOuHeM117q6aOyASQ__0 2024-09-12T01:21:57.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12071349176432448855', time=2024-09-12T03:10:16.860306+0000, chain.objs.size()=1 2024-09-12T01:21:57.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Sa5_vBfTiBHb6RMbNFLC_X_jnWr25OT_0 2024-09-12T01:21:57.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14899943408567607282', time=2024-09-12T03:10:16.892706+0000, chain.objs.size()=1 2024-09-12T01:21:57.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.nFwytke4b82hIrs2uqaz9aAHejTMSG-_0 2024-09-12T01:21:57.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7595060454509379143', time=2024-09-12T03:10:16.915878+0000, chain.objs.size()=1 2024-09-12T01:21:57.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ySI2-bqrcgHAzlPs7NkwObELD6xnNlr_0 2024-09-12T01:21:57.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13390317476065249807', time=2024-09-12T03:10:16.930891+0000, chain.objs.size()=1 2024-09-12T01:21:57.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.404+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.r0M3UKVjH-O31TcZ3sS-4gOZM8kOHKe_0 2024-09-12T01:21:57.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.408+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8586282794863926548', time=2024-09-12T03:10:16.959617+0000, chain.objs.size()=1 2024-09-12T01:21:57.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.408+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.OSH3IGYijrde7nBma3zpXNODcnaLWxr_0 2024-09-12T01:21:57.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.408+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6169677408522637749', time=2024-09-12T03:10:16.985887+0000, chain.objs.size()=1 2024-09-12T01:21:57.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.408+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.QMOyYGfmLf2pUpctOJjAr92nQ90OnWx_0 2024-09-12T01:21:57.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.408+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16946144699797106193', time=2024-09-12T03:10:17.004444+0000, chain.objs.size()=1 2024-09-12T01:21:57.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.408+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.iQ9iXrUzdRnBpvCLE3z2Ehg5_nB5pbA_0 2024-09-12T01:21:57.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.408+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1807738359080329086', time=2024-09-12T03:10:17.146107+0000, chain.objs.size()=1 2024-09-12T01:21:57.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.408+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.jzl6itU26fhNQ5YwzRdBiVrc3DmHjfz_0 2024-09-12T01:21:57.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.408+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4465315379010131752', time=2024-09-12T03:10:17.191355+0000, chain.objs.size()=1 2024-09-12T01:21:57.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.408+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ZdIxKG7r9OWHM2fUrWZ-7KwGwBD_lEw_0 2024-09-12T01:21:57.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.408+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12402502140884604474', time=2024-09-12T03:10:17.223897+0000, chain.objs.size()=1 2024-09-12T01:21:57.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.408+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.UtYinhcnGTz11zAjObDAZhFnrmIm4pV_0 2024-09-12T01:21:57.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.408+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16900459958429927194', time=2024-09-12T03:10:17.294073+0000, chain.objs.size()=1 2024-09-12T01:21:57.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.408+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.X2LILgaGnXlF_HzbUk8YyXaP8PmrYzg_0 2024-09-12T01:21:57.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.408+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11532902271060400276', time=2024-09-12T03:10:17.311787+0000, chain.objs.size()=1 2024-09-12T01:21:57.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.408+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.VcDc0HwintWhtVhkxcDcbQgqLQj3zBJ_0 2024-09-12T01:21:57.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.408+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14972935544504251416', time=2024-09-12T03:10:17.320174+0000, chain.objs.size()=1 2024-09-12T01:21:57.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.408+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.AFTLBOT5lI4T_SAC7zqCYXKafgMQad8_0 2024-09-12T01:21:57.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.408+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4072429748052126319', time=2024-09-12T03:10:17.604390+0000, chain.objs.size()=1 2024-09-12T01:21:57.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.408+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.1UiMYtZd0eq6kJHRCHZZjOjqArZH-MT_0 2024-09-12T01:21:57.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.408+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2896105792295377824', time=2024-09-12T03:10:17.820200+0000, chain.objs.size()=1 2024-09-12T01:21:57.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.408+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.EziisWFGLIhK1B8SWzYgudweryf-m-q_0 2024-09-12T01:21:57.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.408+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3223791447613410678', time=2024-09-12T03:10:20.943146+0000, chain.objs.size()=1 2024-09-12T01:21:57.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.408+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.330__shadow_.ZOb8p7RtULml4VvWQfJbGVtGPH5FGdN_0 2024-09-12T01:21:57.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.412+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5458347746564109209', time=2024-09-12T03:10:25.326504+0000, chain.objs.size()=1 2024-09-12T01:21:57.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.412+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.337__shadow_.5pzq8F3fnwPaeJGxxmOrPTSFG-m78Lf_0 2024-09-12T01:21:57.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.412+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2166386836994148993', time=2024-09-12T03:10:49.842774+0000, chain.objs.size()=1 2024-09-12T01:21:57.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.412+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.377__shadow_.whZE3xiuzrcVNPMXLanQzPWds2mPvYM_0 2024-09-12T01:21:57.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.412+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13907441376988050859', time=2024-09-12T03:10:53.502565+0000, chain.objs.size()=1 2024-09-12T01:21:57.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.412+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.382__shadow_.fbzKmBVS_xRD5kI-XOXhL4MMvmpQtmw_0 2024-09-12T01:21:57.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.412+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17036041244183140644', time=2024-09-12T03:11:43.447126+0000, chain.objs.size()=1 2024-09-12T01:21:57.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.412+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.452__shadow_.LXf1Gv4UC4Qq31Pmrq-oN0hY3J-xrbC_0 2024-09-12T01:21:57.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.412+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48166 2024-09-12T01:21:57.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.416+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T01:21:57.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.416+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16709291177502514000', time=2024-09-12T03:12:12.783704+0000, chain.objs.size()=1 2024-09-12T01:21:57.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.416+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.496__shadow_.yjpq_TmaNfwfTzMBrOCDSidSdOyKB6h_0 2024-09-12T01:21:57.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.416+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6662779848269302891', time=2024-09-12T03:12:18.045206+0000, chain.objs.size()=1 2024-09-12T01:21:57.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.416+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.504__shadow:fzRg7xrdrpV0hjFUnNiyrRjat2TjEPZ_.vHz-mc05LslsPFizOQCh8qlCeQstO_b_0 2024-09-12T01:21:57.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.416+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10410906943564718442', time=2024-09-12T03:12:22.338037+0000, chain.objs.size()=6 2024-09-12T01:21:57.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.416+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.1 2024-09-12T01:21:57.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.416+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.2 2024-09-12T01:21:57.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.416+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.3 2024-09-12T01:21:57.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.416+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.4 2024-09-12T01:21:57.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.416+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.5 2024-09-12T01:21:57.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.416+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.6 2024-09-12T01:21:57.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.416+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ZhnKwtekwmGa7FuJJ1alFcAUcbLxnwl', time=2024-09-12T03:13:09.543337+0000, chain.objs.size()=1 2024-09-12T01:21:57.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.416+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.535__multipart_mymultipart.2~ZhnKwtekwmGa7FuJJ1alFcAUcbLxnwl.1 2024-09-12T01:21:57.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.416+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4059891452839005540', time=2024-09-12T03:14:10.209623+0000, chain.objs.size()=1 2024-09-12T01:21:57.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.416+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:9NZg9mV2oWE2bjDCwLdNE21fratwqb0_.laRGqODSyxNaDLUkjE0whoX2zmVOW9A_0 2024-09-12T01:21:57.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.416+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3955230093360013662', time=2024-09-12T03:18:10.088944+0000, chain.objs.size()=1 2024-09-12T01:21:57.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.416+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.666__shadow_.sJACQ7Do79R05bqGt8iBOreQQUvbG76_0 2024-09-12T01:21:57.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.416+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7156661605192909886', time=2024-09-12T03:19:36.419063+0000, chain.objs.size()=1 2024-09-12T01:21:57.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.416+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.746__shadow_.B9ajQiruVSdQ-nhahW25lIrkwXkVhrZ_0 2024-09-12T01:21:57.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.416+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:57.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.420+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:21:57.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.420+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:57.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.420+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:57.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47179' 2024-09-12T01:21:57.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1604162664870009200', time=2024-09-12T03:06:00.728423+0000, chain.objs.size()=3 2024-09-12T01:21:57.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.162__multipart_foo-STANDARD.2~8p6kLFS9j7M0BupMcLrVigoAcAbMMaC.1 2024-09-12T01:21:57.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.162__multipart_foo-STANDARD.2~8p6kLFS9j7M0BupMcLrVigoAcAbMMaC.2 2024-09-12T01:21:57.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.162__multipart_foo-STANDARD.2~8p6kLFS9j7M0BupMcLrVigoAcAbMMaC.3 2024-09-12T01:21:57.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~PQfYe4KINghd9bf3L2iiJag0kCnEgbu', time=2024-09-12T03:06:38.427606+0000, chain.objs.size()=1 2024-09-12T01:21:57.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.202__multipart_mymultipart.2~PQfYe4KINghd9bf3L2iiJag0kCnEgbu.1 2024-09-12T01:21:57.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2107599052892186116', time=2024-09-12T03:08:08.431501+0000, chain.objs.size()=1 2024-09-12T01:21:57.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.236__shadow_.sce0KNvL1XQwb69AJ7NLBi6grNT8hfP_0 2024-09-12T01:21:57.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5876476820143586100', time=2024-09-12T03:08:16.456212+0000, chain.objs.size()=1 2024-09-12T01:21:57.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.245__shadow_.Fy0IEIhNIptuMCXQeVtMfQlryboH5-2_0 2024-09-12T01:21:57.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15783034602093534088', time=2024-09-12T03:08:22.669263+0000, chain.objs.size()=1 2024-09-12T01:21:57.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.254__shadow_.t6z2I2JoFvX7uh3_doJdvDTQfVlP-6o_0 2024-09-12T01:21:57.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17994090848683101009', time=2024-09-12T03:08:25.382809+0000, chain.objs.size()=1 2024-09-12T01:21:57.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.258__shadow_.vUFSGLbXF36fhJufu0drV97b6px8HAi_0 2024-09-12T01:21:57.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1332744497859649434', time=2024-09-12T03:08:47.447253+0000, chain.objs.size()=1 2024-09-12T01:21:57.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.LNM80Yboq_vkzJwkJuhzoqEMt-dDhot_0 2024-09-12T01:21:57.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12871002798260185452', time=2024-09-12T03:08:47.623430+0000, chain.objs.size()=1 2024-09-12T01:21:57.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.hgh4fqNcIasb6URUG6M_zyhDGoKlJ2T_0 2024-09-12T01:21:57.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14777422408815175286', time=2024-09-12T03:08:47.629219+0000, chain.objs.size()=1 2024-09-12T01:21:57.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Auj9vo-Qb8b_eK4dqaAqve1e4K-MrDQ_0 2024-09-12T01:21:57.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9678605977601181508', time=2024-09-12T03:08:47.937028+0000, chain.objs.size()=1 2024-09-12T01:21:57.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.KV6kfx3qD-gb3SM7Gg7IfmceD411o-Q_0 2024-09-12T01:21:57.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.810572532046692365', time=2024-09-12T03:08:47.944278+0000, chain.objs.size()=1 2024-09-12T01:21:57.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.jcHSgS8tDWXOzjjyiBiY_ai8li6ABnQ_0 2024-09-12T01:21:57.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16434950580205520218', time=2024-09-12T03:08:47.976542+0000, chain.objs.size()=1 2024-09-12T01:21:57.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.DcpQ581JkeN-h4eQ47H08riWBgIU_uI_0 2024-09-12T01:21:57.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16917675891885065115', time=2024-09-12T03:08:47.988372+0000, chain.objs.size()=1 2024-09-12T01:21:57.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.fAWgLbwR31DJ4vLm9KFSPhRX5VXceUU_0 2024-09-12T01:21:57.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4443304250990695822', time=2024-09-12T03:08:48.282023+0000, chain.objs.size()=1 2024-09-12T01:21:57.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.424+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.qfdKVto0L5980hwU5AtSq3NhZxAtwEb_0 2024-09-12T01:21:57.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9871954052725919009', time=2024-09-12T03:08:48.291459+0000, chain.objs.size()=1 2024-09-12T01:21:57.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.3HhBLEKkGsrOLr4BIbCEKOmdWI_wKXh_0 2024-09-12T01:21:57.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14511978598802916711', time=2024-09-12T03:08:48.294422+0000, chain.objs.size()=1 2024-09-12T01:21:57.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ZlB3gRK8z2pa8PlrQxhl1iYKNpAOZMg_0 2024-09-12T01:21:57.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3963329556676542223', time=2024-09-12T03:08:48.525093+0000, chain.objs.size()=1 2024-09-12T01:21:57.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.s4_FJ620KqJuo0bh-nSt5h7_147f3bE_0 2024-09-12T01:21:57.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8810014226094683141', time=2024-09-12T03:08:48.628686+0000, chain.objs.size()=1 2024-09-12T01:21:57.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.-elPTiqccM_qAWdli0dzikSS2CzTH7m_0 2024-09-12T01:21:57.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3278435120633467410', time=2024-09-12T03:08:48.655573+0000, chain.objs.size()=1 2024-09-12T01:21:57.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Uu7qgot3vT32vNoXmLLDojzNHQ003eE_0 2024-09-12T01:21:57.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13913814645080349936', time=2024-09-12T03:08:48.671787+0000, chain.objs.size()=1 2024-09-12T01:21:57.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.EoRCt4WoZd6RZndUKP9YvLLHkP6dnbH_0 2024-09-12T01:21:57.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12943265125495331195', time=2024-09-12T03:08:48.958377+0000, chain.objs.size()=1 2024-09-12T01:21:57.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.u6M8RwWUBVDE2mAvZThsrYD1JOqoO_R_0 2024-09-12T01:21:57.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6614249514181698216', time=2024-09-12T03:08:49.026522+0000, chain.objs.size()=1 2024-09-12T01:21:57.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.-ndcRN-L57FoWdNT1HyqQTUXXS1q8up_0 2024-09-12T01:21:57.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13420489131576595353', time=2024-09-12T03:08:49.191535+0000, chain.objs.size()=1 2024-09-12T01:21:57.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.dmf3eYxyICyKxXy3UtB_kosp7zNSfTE_0 2024-09-12T01:21:57.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3276400056861550683', time=2024-09-12T03:08:49.256848+0000, chain.objs.size()=1 2024-09-12T01:21:57.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.dnACPeyenyb2aavkoUXkfOhYijw-Bgs_0 2024-09-12T01:21:57.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.577770724627032798', time=2024-09-12T03:08:49.259555+0000, chain.objs.size()=1 2024-09-12T01:21:57.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.neOzVBbucIvOaYhjd16MjscHa1zrn64_0 2024-09-12T01:21:57.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5220206192152748546', time=2024-09-12T03:08:49.297323+0000, chain.objs.size()=1 2024-09-12T01:21:57.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.-RFePb4NccF7j1nwTA1Tr7HeCTqq8oJ_0 2024-09-12T01:21:57.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6133495453298092345', time=2024-09-12T03:08:49.354062+0000, chain.objs.size()=1 2024-09-12T01:21:57.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.sUBIh8f6vZbVffObkuv-yYXViQUmdM5_0 2024-09-12T01:21:57.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2421756078130610040', time=2024-09-12T03:08:49.687308+0000, chain.objs.size()=1 2024-09-12T01:21:57.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.yJbXuqMB5zGHMx62Ui5ekLKvXvqypbq_0 2024-09-12T01:21:57.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15380759742669366053', time=2024-09-12T03:08:49.887817+0000, chain.objs.size()=1 2024-09-12T01:21:57.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.nqOiFeg45QFN6-d9RI20filNEbSHaSF_0 2024-09-12T01:21:57.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12060587138974117896', time=2024-09-12T03:08:50.021763+0000, chain.objs.size()=1 2024-09-12T01:21:57.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.XwjN8v372Cl5BciWS4c0miQ-Kyg_J6R_0 2024-09-12T01:21:57.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7902721424022119615', time=2024-09-12T03:08:50.026453+0000, chain.objs.size()=1 2024-09-12T01:21:57.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ZDJR5Vu48MRYfftMPZMjPcwy0MLJxwC_0 2024-09-12T01:21:57.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17330459037966520370', time=2024-09-12T03:08:54.657111+0000, chain.objs.size()=1 2024-09-12T01:21:57.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.270__shadow_.hvlxnYtyMhn3H9uDy2ten-i4HczB1PW_0 2024-09-12T01:21:57.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15685472350827485728', time=2024-09-12T03:09:00.141393+0000, chain.objs.size()=1 2024-09-12T01:21:57.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.278__shadow_.qkiDXvmiGfAiEcg0jJSkjx3-g0KUA0f_0 2024-09-12T01:21:57.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12796748202642150366', time=2024-09-12T03:09:07.159543+0000, chain.objs.size()=1 2024-09-12T01:21:57.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.288__shadow_.td4_CdPlq9boPHFafw9R52z2DfkZjjX_0 2024-09-12T01:21:57.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1547970225260667103', time=2024-09-12T03:09:11.629853+0000, chain.objs.size()=1 2024-09-12T01:21:57.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.293__shadow_.9rSA_NYpvFbXVqikOTeoTNJ4HbT5gI3_0 2024-09-12T01:21:57.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1635165357959206651', time=2024-09-12T03:09:11.638747+0000, chain.objs.size()=1 2024-09-12T01:21:57.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.293__shadow_.I0BXUn8H-bcfYqe9Yixl661zayB8NwP_0 2024-09-12T01:21:57.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17179858578576694361', time=2024-09-12T03:09:15.805365+0000, chain.objs.size()=1 2024-09-12T01:21:57.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.428+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.298__shadow_.IDwaucgVphQOLs9wuwe_txAAetSBUiH_0 2024-09-12T01:21:57.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7483393216254626642', time=2024-09-12T03:09:17.232894+0000, chain.objs.size()=1 2024-09-12T01:21:57.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.300__shadow_.I-Nv5ZPmbP3HbivqUQDMqIeWFWGQt5u_0 2024-09-12T01:21:57.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7112910271368687147', time=2024-09-12T03:09:18.694055+0000, chain.objs.size()=1 2024-09-12T01:21:57.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.302__shadow_.yhL-PsRuo_2872TqtdEMdZ3XeXul0ld_0 2024-09-12T01:21:57.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15293926433732167469', time=2024-09-12T03:09:29.293519+0000, chain.objs.size()=1 2024-09-12T01:21:57.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.316__shadow_.5Z_9PPbNGRjlJgZjn675LvNO7ONLoja_0 2024-09-12T01:21:57.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16040875029983925720', time=2024-09-12T03:09:53.043440+0000, chain.objs.size()=1 2024-09-12T01:21:57.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.k64uDcBWWovTsxMv8Frm2eeH5o8jR45_0 2024-09-12T01:21:57.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6917876554418257808', time=2024-09-12T03:09:53.068573+0000, chain.objs.size()=1 2024-09-12T01:21:57.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.07v-DRxOtNdRTpGHGU4jKHhqT7p-hhz_0 2024-09-12T01:21:57.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14923589162391973582', time=2024-09-12T03:09:53.083960+0000, chain.objs.size()=1 2024-09-12T01:21:57.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.kvHS9xnp7Nq_pJW5OVnlc3yc6v4qaKp_0 2024-09-12T01:21:57.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.380188852358936901', time=2024-09-12T03:09:53.345713+0000, chain.objs.size()=1 2024-09-12T01:21:57.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.hn6aX__51lbkTR-YfVxQ7xi5Y_KFCDe_0 2024-09-12T01:21:57.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1601484364582372677', time=2024-09-12T03:09:53.347366+0000, chain.objs.size()=1 2024-09-12T01:21:57.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.tfgg66EcohEdPk32b7qCML5q34GoKXY_0 2024-09-12T01:21:57.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.880228440129364401', time=2024-09-12T03:09:53.433723+0000, chain.objs.size()=1 2024-09-12T01:21:57.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.n4hkdWI4EyzEYILZy9CBOubvI6TQ1PB_0 2024-09-12T01:21:57.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16422860197751900267', time=2024-09-12T03:09:53.439554+0000, chain.objs.size()=1 2024-09-12T01:21:57.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.AW5EKMN1kOA40iOqGG0uKpklaFsU0QM_0 2024-09-12T01:21:57.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4055649282591380897', time=2024-09-12T03:09:53.453090+0000, chain.objs.size()=1 2024-09-12T01:21:57.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.1k8TOeuwlwYbMRhiFeOFP5jQa3cfFWQ_0 2024-09-12T01:21:57.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7938813414010187490', time=2024-09-12T03:09:53.498483+0000, chain.objs.size()=1 2024-09-12T01:21:57.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.GZsPB0km704lEhsZzH6vM_MUAYhoQXV_0 2024-09-12T01:21:57.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8735297535624155615', time=2024-09-12T03:09:53.669170+0000, chain.objs.size()=1 2024-09-12T01:21:57.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.9hWrOaRisV3-fjxoBk_qdj96LEWgDFr_0 2024-09-12T01:21:57.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10871726898064655824', time=2024-09-12T03:09:53.685159+0000, chain.objs.size()=1 2024-09-12T01:21:57.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.JaYY0JNEGM0NbXoECm7slYtNLc4wtGl_0 2024-09-12T01:21:57.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8018729200930246877', time=2024-09-12T03:09:53.759855+0000, chain.objs.size()=1 2024-09-12T01:21:57.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.432+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.OJYY_BJlaA-SslJDfnOsExInVr-SDII_0 2024-09-12T01:21:57.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16808702692948769174', time=2024-09-12T03:09:53.783960+0000, chain.objs.size()=1 2024-09-12T01:21:57.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.DwYCn0jiquPIx6AAoOL4Mrwz3R4LCMm_0 2024-09-12T01:21:57.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8639647390844070208', time=2024-09-12T03:09:54.011959+0000, chain.objs.size()=1 2024-09-12T01:21:57.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.JeGAenwAUYNmNnQ-O2G_5UAYkalOxhq_0 2024-09-12T01:21:57.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15488711815877695535', time=2024-09-12T03:09:54.029349+0000, chain.objs.size()=1 2024-09-12T01:21:57.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.x9dsPZUvFCd4ViX28bkCzyG89QJ-nbZ_0 2024-09-12T01:21:57.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5370604644764945851', time=2024-09-12T03:09:54.048039+0000, chain.objs.size()=1 2024-09-12T01:21:57.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.RdvVimWYFsiRK40k9K7D5JsqpTj7otR_0 2024-09-12T01:21:57.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17198316237596349519', time=2024-09-12T03:09:54.099456+0000, chain.objs.size()=1 2024-09-12T01:21:57.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.x35X8EqWVk1Pk3Ne_u9kpr2mG4makPi_0 2024-09-12T01:21:57.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17756564941849140451', time=2024-09-12T03:09:54.130698+0000, chain.objs.size()=1 2024-09-12T01:21:57.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.XOcZPs7C5KhWIuGRZNNpJBLSthD73Xl_0 2024-09-12T01:21:57.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16565939932312312109', time=2024-09-12T03:09:54.171232+0000, chain.objs.size()=1 2024-09-12T01:21:57.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.M3rW3i_bI3LpSAUmIl9aijXWHMp5Gw-_0 2024-09-12T01:21:57.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15011641225081310050', time=2024-09-12T03:09:54.417451+0000, chain.objs.size()=1 2024-09-12T01:21:57.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.btIQjM-RyJM_F_lPgkT77hoUXPZi13h_0 2024-09-12T01:21:57.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12559249079433856430', time=2024-09-12T03:09:54.683295+0000, chain.objs.size()=1 2024-09-12T01:21:57.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.SHf4NrCzB9fJxelBnmK8gfYBiT0DpUx_0 2024-09-12T01:21:57.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6959491309976650057', time=2024-09-12T03:09:54.726273+0000, chain.objs.size()=1 2024-09-12T01:21:57.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.wr2cp8hY6WlBrSXUY09QMmkoNS7XPcM_0 2024-09-12T01:21:57.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9785799392586926997', time=2024-09-12T03:09:54.800109+0000, chain.objs.size()=1 2024-09-12T01:21:57.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ey14u7zvk-gEQeU997S-dDDZUPfqT1v_0 2024-09-12T01:21:57.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1201747773383785588', time=2024-09-12T03:09:54.820489+0000, chain.objs.size()=1 2024-09-12T01:21:57.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.DOnEAFJWhPMpkpF6SMnVKohIk__YQuG_0 2024-09-12T01:21:57.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17134835967434237458', time=2024-09-12T03:09:54.836280+0000, chain.objs.size()=1 2024-09-12T01:21:57.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.iX-P9uNQyo9fGxMosxNj9-9HPc7HZtk_0 2024-09-12T01:21:57.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10441247392611686594', time=2024-09-12T03:09:55.067978+0000, chain.objs.size()=1 2024-09-12T01:21:57.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.AMHbIo_vYIhmnsnNdRDyZlmXFr5HV8E_0 2024-09-12T01:21:57.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18338810153322803432', time=2024-09-12T03:09:55.143227+0000, chain.objs.size()=1 2024-09-12T01:21:57.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.zKTR0BNmXd95SgK4CaCz1WO3hXVUjX7_0 2024-09-12T01:21:57.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7306818393136612936', time=2024-09-12T03:09:55.277591+0000, chain.objs.size()=1 2024-09-12T01:21:57.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.436+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.jusjgIk5MWACRkUFgfC27j7xOPng2IN_0 2024-09-12T01:21:57.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18416345137488014904', time=2024-09-12T03:09:55.292305+0000, chain.objs.size()=1 2024-09-12T01:21:57.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.umAnAY7Oj4y5346bQ4vGNUesvVOMpqz_0 2024-09-12T01:21:57.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7449181113803242167', time=2024-09-12T03:10:15.321082+0000, chain.objs.size()=1 2024-09-12T01:21:57.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Yc2SCd6KASkjVOXdKghScGQbWJ9bOEu_0 2024-09-12T01:21:57.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11737386909870022807', time=2024-09-12T03:10:15.440272+0000, chain.objs.size()=1 2024-09-12T01:21:57.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.tQeqqatvhMW8ZFxqPixzlDPjImN0GAy_0 2024-09-12T01:21:57.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13649112616084598420', time=2024-09-12T03:10:15.444337+0000, chain.objs.size()=1 2024-09-12T01:21:57.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.TddGbr4IpckbjocVZX_Ce_wwgIz6H07_0 2024-09-12T01:21:57.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16654539416489673678', time=2024-09-12T03:10:15.762206+0000, chain.objs.size()=1 2024-09-12T01:21:57.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.J833Z8WK1SI3u1wEAETklm6JRlLzi1i_0 2024-09-12T01:21:57.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14225500694019887669', time=2024-09-12T03:10:15.962647+0000, chain.objs.size()=1 2024-09-12T01:21:57.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.wSNGXZTbcM7JEEeOp2UuSZYtLae0qas_0 2024-09-12T01:21:57.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1127975205717464494', time=2024-09-12T03:10:16.065704+0000, chain.objs.size()=1 2024-09-12T01:21:57.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.xNYe3IUIZhaNojFGLt0cmhtrOOMS4G7_0 2024-09-12T01:21:57.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6185198910432729703', time=2024-09-12T03:10:16.248461+0000, chain.objs.size()=1 2024-09-12T01:21:57.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.NqSQAp3tQWYGlVB--3_xITOJ5aC4K0Y_0 2024-09-12T01:21:57.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3629251975782274628', time=2024-09-12T03:10:16.260532+0000, chain.objs.size()=1 2024-09-12T01:21:57.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.6I2vYHY7qyEQfl2xx4zipyFqtii1Vtw_0 2024-09-12T01:21:57.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5292256380703145137', time=2024-09-12T03:10:16.281873+0000, chain.objs.size()=1 2024-09-12T01:21:57.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.db4Ga5Mp2av3tdPxiFecGWzXAWXb8Kw_0 2024-09-12T01:21:57.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17538962154786547640', time=2024-09-12T03:10:16.315222+0000, chain.objs.size()=1 2024-09-12T01:21:57.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.VkjW3Drr6EIN6owUO2dC8wqSeoC4MhX_0 2024-09-12T01:21:57.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1835370926020903834', time=2024-09-12T03:10:16.787829+0000, chain.objs.size()=1 2024-09-12T01:21:57.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_._bWf83k8roYOWwx2p1bMjD3hwxVtP-F_0 2024-09-12T01:21:57.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9603364380037378133', time=2024-09-12T03:10:16.800673+0000, chain.objs.size()=1 2024-09-12T01:21:57.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.YI_mImXwpUa5jb2i7crGS-oTZLa96D2_0 2024-09-12T01:21:57.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10515814580543177619', time=2024-09-12T03:10:16.933482+0000, chain.objs.size()=1 2024-09-12T01:21:57.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.slbQneuMhbx5YCBmH9Pn9hISKFCDxDw_0 2024-09-12T01:21:57.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9813486845344096325', time=2024-09-12T03:10:16.955928+0000, chain.objs.size()=1 2024-09-12T01:21:57.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.7eLZy8EMjDDmNcq02yUqWQ1oM9hKGtA_0 2024-09-12T01:21:57.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13830029453188798098', time=2024-09-12T03:10:16.969384+0000, chain.objs.size()=1 2024-09-12T01:21:57.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.4gCMwLW1wKZYFXa2ngAJqcXfHpEn55B_0 2024-09-12T01:21:57.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7060276377450213520', time=2024-09-12T03:10:16.997832+0000, chain.objs.size()=1 2024-09-12T01:21:57.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.F4s_SIJgOMaVD64JxoNgybbXfDqBNOY_0 2024-09-12T01:21:57.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7226727591372118602', time=2024-09-12T03:10:16.999091+0000, chain.objs.size()=1 2024-09-12T01:21:57.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.440+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.KsqAJzBfZcCejdIor1KFD6ZpU5K7Van_0 2024-09-12T01:21:57.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13137820486719821172', time=2024-09-12T03:10:17.304248+0000, chain.objs.size()=1 2024-09-12T01:21:57.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.RapEsT-lBRxitnkQkkQb4xn0sz7tls0_0 2024-09-12T01:21:57.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5087306704965409556', time=2024-09-12T03:10:17.486651+0000, chain.objs.size()=1 2024-09-12T01:21:57.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.4cF50WzRPY_zpMp1kd6gu36R5GGXmbl_0 2024-09-12T01:21:57.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12095719984392293798', time=2024-09-12T03:10:17.491954+0000, chain.objs.size()=1 2024-09-12T01:21:57.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.4zwWfgqpfJBV_2Wrc5i8LIVvOqfDggQ_0 2024-09-12T01:21:57.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4344911093144323190', time=2024-09-12T03:10:17.559330+0000, chain.objs.size()=1 2024-09-12T01:21:57.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.HT40BEUuJMn7Op7yhJ_dmxZl2c-vyzd_0 2024-09-12T01:21:57.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2716724944152768161', time=2024-09-12T03:10:17.590940+0000, chain.objs.size()=1 2024-09-12T01:21:57.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ZpDm19UdiOWj8B37JqZ9wG4cIzwzmPu_0 2024-09-12T01:21:57.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9269251021785580364', time=2024-09-12T03:10:17.600639+0000, chain.objs.size()=1 2024-09-12T01:21:57.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.hcPCd5Q9rWtRisF0vnMermNZn5vLvQC_0 2024-09-12T01:21:57.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15867879437281143780', time=2024-09-12T03:10:17.779021+0000, chain.objs.size()=1 2024-09-12T01:21:57.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.1J_PD4wxxmu1boFOjB985ayti3tzVg5_0 2024-09-12T01:21:57.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4213657241996720295', time=2024-09-12T03:10:17.846562+0000, chain.objs.size()=1 2024-09-12T01:21:57.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ceBhW5uMViCE1QfYMqsdahfsaP9KMhc_0 2024-09-12T01:21:57.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10297624591694185141', time=2024-09-12T03:10:17.910602+0000, chain.objs.size()=1 2024-09-12T01:21:57.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.sjFIW58Ge1BHgh6bnQpUkOBmfO6xaMD_0 2024-09-12T01:21:57.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16897821850760785825', time=2024-09-12T03:10:22.174588+0000, chain.objs.size()=1 2024-09-12T01:21:57.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.332__shadow_.8fjjPTDCl17kpqC87fSP4XvOWDHLlDX_0 2024-09-12T01:21:57.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5935790037476419005', time=2024-09-12T03:10:22.621418+0000, chain.objs.size()=1 2024-09-12T01:21:57.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.333__shadow_.EKA7ZVELkbHASZAnvPHyPOoYKIwUIs7_0 2024-09-12T01:21:57.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18086816078518511473', time=2024-09-12T03:10:30.946123+0000, chain.objs.size()=1 2024-09-12T01:21:57.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.346__shadow_.PaB8BG3C8FIi5SU3eKIozHVGLqARHUI_0 2024-09-12T01:21:57.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7360796478456201436', time=2024-09-12T03:11:46.513290+0000, chain.objs.size()=1 2024-09-12T01:21:57.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.456__shadow_.GPHCaOZfVz3ZPO-QJ9PTANYS2bFt9NI_0 2024-09-12T01:21:57.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14290458936271351497', time=2024-09-12T03:11:51.427161+0000, chain.objs.size()=1 2024-09-12T01:21:57.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.448+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.461__shadow_.cLdEfmG2Z_X5PUChzfREPEw_x6-8p-m_0 2024-09-12T01:21:57.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.452+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47179 2024-09-12T01:21:57.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.452+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T01:21:57.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.452+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14377309504669690842', time=2024-09-12T03:11:52.435970+0000, chain.objs.size()=1 2024-09-12T01:21:57.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.452+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.462__shadow_.mthasE2Rxws24b8mxdgeF1b77OsMyT6_0 2024-09-12T01:21:57.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.452+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3970591563536348056', time=2024-09-12T03:12:03.396846+0000, chain.objs.size()=1 2024-09-12T01:21:57.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.452+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.482__shadow_.YXWxY6Dw3uRbC8v4i6-Jx2KMh9Qt86d_0 2024-09-12T01:21:57.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.452+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9863750281017387332', time=2024-09-12T03:12:05.774448+0000, chain.objs.size()=1 2024-09-12T01:21:57.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.452+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.485__shadow_.1p3sPSOP7u9xamdhYbI2vq2USwjJZod_0 2024-09-12T01:21:57.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.452+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10414986889480606206', time=2024-09-12T03:12:25.016803+0000, chain.objs.size()=1 2024-09-12T01:21:57.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.452+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.514__multipart_mymultipart.2~pwkMjR6ZakH6uZig-3la8ZzMxNRE8hp.1 2024-09-12T01:21:57.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.452+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~Yg1Ew04wrmGlk2Ve2_P7wFvb-OR7Bgt', time=2024-09-12T03:12:45.723366+0000, chain.objs.size()=1 2024-09-12T01:21:57.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.452+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~Yg1Ew04wrmGlk2Ve2_P7wFvb-OR7Bgt.3 2024-09-12T01:21:57.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.452+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2263053752371265369', time=2024-09-12T03:14:00.108179+0000, chain.objs.size()=1 2024-09-12T01:21:57.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.452+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.563__shadow_.KQzy5dZ9uUX0LqZHW8dhRJXOCPIpVmz_0 2024-09-12T01:21:57.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.452+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7710522938102447033', time=2024-09-12T03:14:16.912600+0000, chain.objs.size()=1 2024-09-12T01:21:57.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.452+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:fo39z6fP1PlnaVNsFKle83ou8z-2FyQ_.7uSvJUFvpyF0zujUklptDurKtPQJ960_0 2024-09-12T01:21:57.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.452+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3090434087559453040', time=2024-09-12T03:14:27.406420+0000, chain.objs.size()=1 2024-09-12T01:21:57.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.452+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.577__shadow:LOWPs-34dhq3aamE26SVF1LDDju7G1D_.vxWCTqC290gO6miCCUrIEC3w4BuhqXi_0 2024-09-12T01:21:57.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.452+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7435702054476589836', time=2024-09-12T03:14:51.948591+0000, chain.objs.size()=1 2024-09-12T01:21:57.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.452+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.580__shadow:Mjp-G3X6ksvkb-atRGiPooNCJWRerC5_.mstEkgbsQataMOYM1jAsCB1RZC45oUx_0 2024-09-12T01:21:57.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.452+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6356563263938829266', time=2024-09-12T03:17:43.302963+0000, chain.objs.size()=1 2024-09-12T01:21:57.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.452+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.632__shadow_.24qeqbqmpvcukL4s_XYjDOpg3QT5G_9_0 2024-09-12T01:21:57.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.456+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:57.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.456+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:21:57.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.460+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:57.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.460+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:57.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.460+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/66883' 2024-09-12T01:21:57.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.460+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11402265675968036783', time=2024-09-12T03:06:40.704962+0000, chain.objs.size()=1 2024-09-12T01:21:57.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.460+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.205__shadow_.dKxtzp5xBgP4-ZivamvAjRvU5jhLANx_0 2024-09-12T01:21:57.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.460+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1936907607915565450', time=2024-09-12T03:08:04.241901+0000, chain.objs.size()=1 2024-09-12T01:21:57.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.460+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.229__shadow_.8g0huYdRKBZJtx8EA07N2yFBOzOnbyU_0 2024-09-12T01:21:57.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.460+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5169610490914351667', time=2024-09-12T03:08:05.730579+0000, chain.objs.size()=1 2024-09-12T01:21:57.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.460+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.232__shadow_.SFV8KeBcDY0EM16rOXcFRhYKqhk_HcE_0 2024-09-12T01:21:57.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.460+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18282110343108918296', time=2024-09-12T03:08:09.122803+0000, chain.objs.size()=1 2024-09-12T01:21:57.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.460+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.237__shadow_.pSWhaLzkUlCihdwAwJB0zmgTwj3sXr2_0 2024-09-12T01:21:57.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.460+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14151807042700230225', time=2024-09-12T03:08:15.295841+0000, chain.objs.size()=1 2024-09-12T01:21:57.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.460+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.244__shadow_.SAwjc5LkWJ7QLmHbZ9-o3aarsvIPdE4_0 2024-09-12T01:21:57.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.460+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6986686448254935523', time=2024-09-12T03:08:17.155450+0000, chain.objs.size()=1 2024-09-12T01:21:57.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.460+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.246__shadow_.uIrzZAq14FUsx5b_dWnFo6B_GUXE7N8_0 2024-09-12T01:21:57.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.460+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7024249003603292768', time=2024-09-12T03:08:17.863021+0000, chain.objs.size()=1 2024-09-12T01:21:57.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.460+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.247__shadow_.DrMc_PC591LKwqAGAhejLMrxPFewKHn_0 2024-09-12T01:21:57.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.460+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12678686373763117757', time=2024-09-12T03:08:19.875773+0000, chain.objs.size()=1 2024-09-12T01:21:57.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.460+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.250__shadow_.Y4RvPiObpX-neUMgrBLV1nwdyITcpt__0 2024-09-12T01:21:57.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.460+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8002200804777690495', time=2024-09-12T03:08:20.564581+0000, chain.objs.size()=1 2024-09-12T01:21:57.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.460+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.251__shadow_.jEBimj96L0o8A0lZ6PfsRC2yNrcLvqF_0 2024-09-12T01:21:57.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.460+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1210870782661274333', time=2024-09-12T03:08:21.919841+0000, chain.objs.size()=1 2024-09-12T01:21:57.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.460+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.253__shadow_.4gYtQ4hxXME7hpU8IigXIWZldFOFMZa_0 2024-09-12T01:21:57.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.460+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15834058609412312711', time=2024-09-12T03:08:22.671573+0000, chain.objs.size()=1 2024-09-12T01:21:57.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.460+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.254__shadow_.YOIgWlgB_4HtlJD6zz6UtNpuAfbVKJr_0 2024-09-12T01:21:57.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.460+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10891954587087787102', time=2024-09-12T03:08:47.566984+0000, chain.objs.size()=1 2024-09-12T01:21:57.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.460+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.XjNEnzbiijv8ouNGSVWiEI6_OBd-0vQ_0 2024-09-12T01:21:57.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8894856780636811747', time=2024-09-12T03:08:47.582547+0000, chain.objs.size()=1 2024-09-12T01:21:57.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.79_70aPEm-6bp_VW1Fbg5WchCZ7WLuG_0 2024-09-12T01:21:57.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4555569003329023296', time=2024-09-12T03:08:47.853111+0000, chain.objs.size()=1 2024-09-12T01:21:57.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.qRWx4UNZqWnCQacT09Ib9w80HzInCRZ_0 2024-09-12T01:21:57.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12637826791034074282', time=2024-09-12T03:08:47.950322+0000, chain.objs.size()=1 2024-09-12T01:21:57.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Xv7JtAqbUqOBJqHgNERMmzVTThIws1J_0 2024-09-12T01:21:57.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10917756495792096634', time=2024-09-12T03:08:47.960797+0000, chain.objs.size()=1 2024-09-12T01:21:57.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.XnOv-IvkNxyZGf5exvAlxA-QfsJRght_0 2024-09-12T01:21:57.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1789889325311609529', time=2024-09-12T03:08:47.968520+0000, chain.objs.size()=1 2024-09-12T01:21:57.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.FsDrRZh6NobByGchNCtodV7ICxsD-yf_0 2024-09-12T01:21:57.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4651376108917235280', time=2024-09-12T03:08:47.983346+0000, chain.objs.size()=1 2024-09-12T01:21:57.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.6PJD1bGXftySAmwcXhesqAtXnZdai4E_0 2024-09-12T01:21:57.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4539293138197253349', time=2024-09-12T03:08:47.996655+0000, chain.objs.size()=1 2024-09-12T01:21:57.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.tAcv7qJIu_wtUVTPI_Z7On-p5PJozOv_0 2024-09-12T01:21:57.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11397249866534684825', time=2024-09-12T03:08:48.178570+0000, chain.objs.size()=1 2024-09-12T01:21:57.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.EOQ97oV7J3IsyaWeLHGUZ6-FIzgQ1Jj_0 2024-09-12T01:21:57.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15593153054412737654', time=2024-09-12T03:08:48.219175+0000, chain.objs.size()=1 2024-09-12T01:21:57.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.fjjw0TxZBHBOoS-tXAUxQr9DNYjrgSB_0 2024-09-12T01:21:57.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17319602327950718906', time=2024-09-12T03:08:48.285923+0000, chain.objs.size()=1 2024-09-12T01:21:57.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.oJD76q09x2Wwpq5zqmP8RjMY0jqsB0A_0 2024-09-12T01:21:57.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6453882237763526362', time=2024-09-12T03:08:48.305710+0000, chain.objs.size()=1 2024-09-12T01:21:57.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.z9uMlIsFfPFvwNtENBQRM18Q4LtaHMr_0 2024-09-12T01:21:57.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3021117914048462410', time=2024-09-12T03:08:48.347016+0000, chain.objs.size()=1 2024-09-12T01:21:57.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.LDcjLIwzwpSCWac6w5CQLI6uqPqc76P_0 2024-09-12T01:21:57.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14472880509763065487', time=2024-09-12T03:08:48.359231+0000, chain.objs.size()=1 2024-09-12T01:21:57.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.kzIdVFhReEFX3lbLh9KQTiUKN6DpFop_0 2024-09-12T01:21:57.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12197764616716620763', time=2024-09-12T03:08:48.360881+0000, chain.objs.size()=1 2024-09-12T01:21:57.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.p4wPk9zmOhU6sxSr3UIq1BPrbu3KYfp_0 2024-09-12T01:21:57.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16593879385657655981', time=2024-09-12T03:08:48.586092+0000, chain.objs.size()=1 2024-09-12T01:21:57.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ib5iFQbT_AJYUkK70YH0OR-0viUv6-w_0 2024-09-12T01:21:57.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.386927792533388718', time=2024-09-12T03:08:48.617220+0000, chain.objs.size()=1 2024-09-12T01:21:57.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.42anKWsMGWbhbk_A5SeAMYfJTs6nDSp_0 2024-09-12T01:21:57.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6646505806365400735', time=2024-09-12T03:08:48.661884+0000, chain.objs.size()=1 2024-09-12T01:21:57.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.c-rvAaj4-o6wn1nPjV43I-GGMQf0w1N_0 2024-09-12T01:21:57.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1872839646336967244', time=2024-09-12T03:08:48.667089+0000, chain.objs.size()=1 2024-09-12T01:21:57.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.uDY4aB_4TlMmnrdZuxuwbYRwRo4U9Xg_0 2024-09-12T01:21:57.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17800460310676246353', time=2024-09-12T03:08:48.697495+0000, chain.objs.size()=1 2024-09-12T01:21:57.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.koo9txAJmCb1zkfXzXffPKmVHzfGkYV_0 2024-09-12T01:21:57.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6879821184223427958', time=2024-09-12T03:08:48.849981+0000, chain.objs.size()=1 2024-09-12T01:21:57.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.LH9pjhF50oqzVpg0erm-7q55YozVwlv_0 2024-09-12T01:21:57.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11939596441602076371', time=2024-09-12T03:08:48.872292+0000, chain.objs.size()=1 2024-09-12T01:21:57.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.LvBTGOsW4udmCq0ryezgJEiDj442R0J_0 2024-09-12T01:21:57.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15241184149023329573', time=2024-09-12T03:08:49.218029+0000, chain.objs.size()=1 2024-09-12T01:21:57.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.qk_xGBhCYd6W7iU4-km-55hPPBtWfeE_0 2024-09-12T01:21:57.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3557938315462293865', time=2024-09-12T03:08:49.322262+0000, chain.objs.size()=1 2024-09-12T01:21:57.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.guF1m5J-3wJsgAeKBEbEioq7-r6Fr2g_0 2024-09-12T01:21:57.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6280451125526341051', time=2024-09-12T03:08:49.345615+0000, chain.objs.size()=1 2024-09-12T01:21:57.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.464+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Zg2KvEvoaZ0qBzKbvbjgILEgQnFUN_n_0 2024-09-12T01:21:57.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8965912262009814685', time=2024-09-12T03:08:49.370026+0000, chain.objs.size()=1 2024-09-12T01:21:57.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.XYGA-buyIqZ8GxAUjie6PcN6qTA4u5U_0 2024-09-12T01:21:57.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17395930313781238604', time=2024-09-12T03:08:49.695937+0000, chain.objs.size()=1 2024-09-12T01:21:57.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.szupygAXeIneoZIkDv7LoiYNwBuhom3_0 2024-09-12T01:21:57.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.265590095595616482', time=2024-09-12T03:08:49.730854+0000, chain.objs.size()=1 2024-09-12T01:21:57.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.sFILdevC_KhbkRjd2DufcuqseoDiDH5_0 2024-09-12T01:21:57.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1097788975120544437', time=2024-09-12T03:08:49.870459+0000, chain.objs.size()=1 2024-09-12T01:21:57.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Zc5_Mtd0vsBsi89DuaxlefDey-OjE54_0 2024-09-12T01:21:57.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6459302683527267098', time=2024-09-12T03:08:49.893120+0000, chain.objs.size()=1 2024-09-12T01:21:57.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.QRogU_IzA3dMtT1_B49A3yofLOXks73_0 2024-09-12T01:21:57.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14774085880311156574', time=2024-09-12T03:08:58.705777+0000, chain.objs.size()=1 2024-09-12T01:21:57.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.276__shadow_.fcbjDvIDspaibr9FagFWZfcnS_aYW0s_0 2024-09-12T01:21:57.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3756263293754693129', time=2024-09-12T03:09:08.573983+0000, chain.objs.size()=1 2024-09-12T01:21:57.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.290__shadow_.5IvYcEhbfbYc0C0lGM5LoRX7MsJ5M2b_0 2024-09-12T01:21:57.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11003923772496250021', time=2024-09-12T03:09:11.587916+0000, chain.objs.size()=1 2024-09-12T01:21:57.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.293__shadow_.aceGI_tlLYhjdDJ69Csjy7Tr5ZKVdU7_0 2024-09-12T01:21:57.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6313571473107377156', time=2024-09-12T03:09:13.021530+0000, chain.objs.size()=1 2024-09-12T01:21:57.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.294__shadow_.74PTwkworxyiC0voOzmzc2QRiNA4F7P_0 2024-09-12T01:21:57.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17578183375059889331', time=2024-09-12T03:09:14.426413+0000, chain.objs.size()=1 2024-09-12T01:21:57.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.296__shadow_.v1_0GGLp-bIaMH0SUFiaIp5d_5-39Vd_0 2024-09-12T01:21:57.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11939973508321632729', time=2024-09-12T03:09:21.487409+0000, chain.objs.size()=1 2024-09-12T01:21:57.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.306__shadow_.ffz3ElEua4cNu3yGEB5U9f-tMmgBWVg_0 2024-09-12T01:21:57.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15891788109585970870', time=2024-09-12T03:09:22.351052+0000, chain.objs.size()=1 2024-09-12T01:21:57.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.307__shadow_.rBUP1YSMd3bBJ8AQHDaluHeSTJxeAy-_0 2024-09-12T01:21:57.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11000596184036600342', time=2024-09-12T03:09:52.929845+0000, chain.objs.size()=1 2024-09-12T01:21:57.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.hWIwFWNDyIQM_VLirAbIEllqPX-7mXP_0 2024-09-12T01:21:57.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13557620530401878199', time=2024-09-12T03:09:53.046710+0000, chain.objs.size()=1 2024-09-12T01:21:57.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.468+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.0nMIO2H8Yrpw2KSJZRwxVuGrXssRANV_0 2024-09-12T01:21:57.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11665041452892324628', time=2024-09-12T03:09:53.083118+0000, chain.objs.size()=1 2024-09-12T01:21:57.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.b23toyMRXe9pYG9Wb-womWE9jhtpIqK_0 2024-09-12T01:21:57.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6647240676725466847', time=2024-09-12T03:09:53.091915+0000, chain.objs.size()=1 2024-09-12T01:21:57.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.tINXU7DKIjCYQQufkqmsZ5Mho3cm4jW_0 2024-09-12T01:21:57.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3049443174440206350', time=2024-09-12T03:09:53.130502+0000, chain.objs.size()=1 2024-09-12T01:21:57.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.owaUPdxBxINw5aLorgGkx0WAqG4AD2X_0 2024-09-12T01:21:57.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15398817459794622691', time=2024-09-12T03:09:53.143641+0000, chain.objs.size()=1 2024-09-12T01:21:57.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.bmAseSODJOqukbB2-RuCQAKfEEF12_a_0 2024-09-12T01:21:57.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5284353862505677559', time=2024-09-12T03:09:53.272928+0000, chain.objs.size()=1 2024-09-12T01:21:57.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.NOi9E8Ty5jNkNVkktJoGmoe1xsT3A2L_0 2024-09-12T01:21:57.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.96644652239936931', time=2024-09-12T03:09:53.342598+0000, chain.objs.size()=1 2024-09-12T01:21:57.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Bl8OrJfH1HkPYiodXEgK1Z4aL5Z32wG_0 2024-09-12T01:21:57.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1530850244273286481', time=2024-09-12T03:09:53.383941+0000, chain.objs.size()=1 2024-09-12T01:21:57.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.SIGL8yzV5qvQpTle0qC3N5rhAuJNDHQ_0 2024-09-12T01:21:57.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12412105631913481051', time=2024-09-12T03:09:53.392528+0000, chain.objs.size()=1 2024-09-12T01:21:57.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.1V1JMMwntIwcwcji5Ozc0FxhmzHEhj5_0 2024-09-12T01:21:57.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3093887377810618621', time=2024-09-12T03:09:53.431321+0000, chain.objs.size()=1 2024-09-12T01:21:57.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.iscIrq1p4y1I2UFKP6CJkeCkOaOZTsv_0 2024-09-12T01:21:57.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16408110784532208562', time=2024-09-12T03:09:53.455649+0000, chain.objs.size()=1 2024-09-12T01:21:57.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.tISeAnV3_EGQtI1jv5mfzpp6Rp5ucQz_0 2024-09-12T01:21:57.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7057825598393087794', time=2024-09-12T03:09:53.463654+0000, chain.objs.size()=1 2024-09-12T01:21:57.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.TpWDsA30Fhi2JA1ZGqatFpCMW3lgiBF_0 2024-09-12T01:21:57.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13877601110861643167', time=2024-09-12T03:09:53.635970+0000, chain.objs.size()=1 2024-09-12T01:21:57.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ygymR8L8uTI2igqIZQnOZJT2ppf0_M5_0 2024-09-12T01:21:57.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8561396090722723350', time=2024-09-12T03:09:53.699077+0000, chain.objs.size()=1 2024-09-12T01:21:57.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.CqbN7wPRYayodC-3hH_NiMskJJvNmAu_0 2024-09-12T01:21:57.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17846902071723146900', time=2024-09-12T03:09:53.730738+0000, chain.objs.size()=1 2024-09-12T01:21:57.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.N_9JDl36Gbh4OJpqk1Gt0zg_rhhHZqf_0 2024-09-12T01:21:57.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17294582622663960059', time=2024-09-12T03:09:53.736673+0000, chain.objs.size()=1 2024-09-12T01:21:57.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.dPfJzpyuTCFul_kM0hU0tTHUXl9CivW_0 2024-09-12T01:21:57.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15000886261489471273', time=2024-09-12T03:09:53.749572+0000, chain.objs.size()=1 2024-09-12T01:21:57.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.G-nG1lFjcvh2HETs6cAP4X5-wpRzGjh_0 2024-09-12T01:21:57.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13093800131218850217', time=2024-09-12T03:09:53.752135+0000, chain.objs.size()=1 2024-09-12T01:21:57.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.wsR-RFYSZmaIeBYA1IEm34fh585gxVj_0 2024-09-12T01:21:57.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.331579531057170433', time=2024-09-12T03:09:53.760763+0000, chain.objs.size()=1 2024-09-12T01:21:57.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.472+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.2fMfA8gMouYj2VdsyeQnfCTucljtDsX_0 2024-09-12T01:21:57.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9060716727553959633', time=2024-09-12T03:09:53.797789+0000, chain.objs.size()=1 2024-09-12T01:21:57.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.55rC1ZERPZdLXbY5h08tXG9gNqtapC3_0 2024-09-12T01:21:57.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2658390961256565044', time=2024-09-12T03:09:53.979809+0000, chain.objs.size()=1 2024-09-12T01:21:57.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.jNSuxLM2lezlPDlgqO0sij7QLYf89TT_0 2024-09-12T01:21:57.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9214638811794660534', time=2024-09-12T03:09:54.125896+0000, chain.objs.size()=1 2024-09-12T01:21:57.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.D_HT3t_EyHR-gKsHiRJejHE3jm9RxSq_0 2024-09-12T01:21:57.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11877976342774971911', time=2024-09-12T03:09:54.132552+0000, chain.objs.size()=1 2024-09-12T01:21:57.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.2S1zI4w9O95HjjDM7sLNVhKaBkBwpaA_0 2024-09-12T01:21:57.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5830572561280101441', time=2024-09-12T03:09:54.133974+0000, chain.objs.size()=1 2024-09-12T01:21:57.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.lGJyyrmValphqZmBFyw46qqhGoKv8uy_0 2024-09-12T01:21:57.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8417509233149504211', time=2024-09-12T03:09:54.145431+0000, chain.objs.size()=1 2024-09-12T01:21:57.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.gneDRBPavrqj8SzzxYBsw4-yslY8b_s_0 2024-09-12T01:21:57.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14973740107696518737', time=2024-09-12T03:09:54.163650+0000, chain.objs.size()=1 2024-09-12T01:21:57.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.h2RTgbQjkTkQSGoahySXRL5-ZlBmW07_0 2024-09-12T01:21:57.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15457968278848182024', time=2024-09-12T03:09:54.165958+0000, chain.objs.size()=1 2024-09-12T01:21:57.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.vQASD9NtxFnZ0n15dH5G_rs8LxQ5AqY_0 2024-09-12T01:21:57.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5498360002924364774', time=2024-09-12T03:09:54.168159+0000, chain.objs.size()=1 2024-09-12T01:21:57.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.-EnKIA9cAZt4ep_TbIIUkt7x2edzdL9_0 2024-09-12T01:21:57.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3875724199851435191', time=2024-09-12T03:09:54.368664+0000, chain.objs.size()=1 2024-09-12T01:21:57.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_._seN_Ey8l9JGga2Y2ahxOIURM7TSbo-_0 2024-09-12T01:21:57.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3858034154131269842', time=2024-09-12T03:09:54.435279+0000, chain.objs.size()=1 2024-09-12T01:21:57.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.dpLbIncY56ykPuGdyVn1B8DIpOdruE__0 2024-09-12T01:21:57.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12947304764975216602', time=2024-09-12T03:09:54.438409+0000, chain.objs.size()=1 2024-09-12T01:21:57.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.AoKtJptRD8TjJI3WOix9s_vm3qwOYqV_0 2024-09-12T01:21:57.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8196663346737600906', time=2024-09-12T03:09:54.479419+0000, chain.objs.size()=1 2024-09-12T01:21:57.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.97AN-5BGXjfH3yFCNGHBgAZ0_8JatRo_0 2024-09-12T01:21:57.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4244772908642248717', time=2024-09-12T03:09:54.504757+0000, chain.objs.size()=1 2024-09-12T01:21:57.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.RRPftfjnuw_gcB930hnVxPImxkq8nKA_0 2024-09-12T01:21:57.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15582591952129292546', time=2024-09-12T03:09:54.669824+0000, chain.objs.size()=1 2024-09-12T01:21:57.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.476+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.KQX_8YN4KMZJoPpNM_VKwKjlOGe-wFR_0 2024-09-12T01:21:57.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14983923769595311859', time=2024-09-12T03:09:54.682410+0000, chain.objs.size()=1 2024-09-12T01:21:57.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.7EIrOuVbttQrBoDODCUXwzpatXRFSXd_0 2024-09-12T01:21:57.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9971921309076937400', time=2024-09-12T03:09:54.704550+0000, chain.objs.size()=1 2024-09-12T01:21:57.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.NFtl6vCo_jEsg6Cb414meNbgdMeJ_Cv_0 2024-09-12T01:21:57.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14990311812490727576', time=2024-09-12T03:09:54.713429+0000, chain.objs.size()=1 2024-09-12T01:21:57.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.dOXbUXKJIT33S2v-h1tRI7t8ae85zPs_0 2024-09-12T01:21:57.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7852303623868766515', time=2024-09-12T03:09:54.822168+0000, chain.objs.size()=1 2024-09-12T01:21:57.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.8egIbcfM1W2xvXsZE_HeqZBu_ZowbQW_0 2024-09-12T01:21:57.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14235053156143000060', time=2024-09-12T03:09:54.958416+0000, chain.objs.size()=1 2024-09-12T01:21:57.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.KdcLcAQkboGBE9sJm_JzAf8E2nmTu4Z_0 2024-09-12T01:21:57.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11024135325200960651', time=2024-09-12T03:09:55.029202+0000, chain.objs.size()=1 2024-09-12T01:21:57.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.oOso_27gJqV8DWduBUSjhQlCDxCi-hl_0 2024-09-12T01:21:57.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9058654098466228198', time=2024-09-12T03:09:55.072667+0000, chain.objs.size()=1 2024-09-12T01:21:57.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.7f2an2k3k0DVDx1c5YPaCuTepfuuPl7_0 2024-09-12T01:21:57.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16483390029926436674', time=2024-09-12T03:09:55.088063+0000, chain.objs.size()=1 2024-09-12T01:21:57.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.tpxiYvu88eCBHIvxoGVorFFLMip9sXi_0 2024-09-12T01:21:57.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9036636948855522056', time=2024-09-12T03:09:55.124732+0000, chain.objs.size()=1 2024-09-12T01:21:57.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.tqrBzMyqx8GrbxqX7BDBQ6s_mduJb0a_0 2024-09-12T01:21:57.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2164050901966248801', time=2024-09-12T03:09:55.295478+0000, chain.objs.size()=1 2024-09-12T01:21:57.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.4JFMXj8wHZlOt8-xe7GrU57U2WFtoCS_0 2024-09-12T01:21:57.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1737249609519407819', time=2024-09-12T03:09:55.350181+0000, chain.objs.size()=1 2024-09-12T01:21:57.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.WbuULATUP5T4Hts7Z43XniCN8Xyv7pv_0 2024-09-12T01:21:57.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5654180778215698737', time=2024-09-12T03:09:55.401090+0000, chain.objs.size()=1 2024-09-12T01:21:57.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.q3CA0EPh3ihU35y-2UEskiaFEpLJ7mT_0 2024-09-12T01:21:57.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.827376310772355555', time=2024-09-12T03:09:55.417433+0000, chain.objs.size()=1 2024-09-12T01:21:57.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.cGKacqX2fjd_3ZWEOYxJ45tJx6DuNIa_0 2024-09-12T01:21:57.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8068192228824663924', time=2024-09-12T03:10:15.330571+0000, chain.objs.size()=1 2024-09-12T01:21:57.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.jM60a3TGbR2PVdTVx_r-3r2tbP5m-QS_0 2024-09-12T01:21:57.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18428194072170686353', time=2024-09-12T03:10:15.338127+0000, chain.objs.size()=1 2024-09-12T01:21:57.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.2_kueafEjQymH6JRKJIxyXAecrmgQCI_0 2024-09-12T01:21:57.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14511962565564534613', time=2024-09-12T03:10:15.371952+0000, chain.objs.size()=1 2024-09-12T01:21:57.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.luVrhspqPl-Pi4BfQ6WlHG4xdBI9sQq_0 2024-09-12T01:21:57.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11224591843723127667', time=2024-09-12T03:10:15.421960+0000, chain.objs.size()=1 2024-09-12T01:21:57.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.480+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.06LGlZkIB6E5MbUmmqZ60e9sWn8VA4e_0 2024-09-12T01:21:57.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.484+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/66883 2024-09-12T01:21:57.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.484+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=50, truncated=0, next_marker='' 2024-09-12T01:21:57.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.484+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13888698538498239113', time=2024-09-12T03:10:15.425253+0000, chain.objs.size()=1 2024-09-12T01:21:57.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.484+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.h9JDbu0GNts7UnR6u3ArNwfKEDONHe5_0 2024-09-12T01:21:57.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.484+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13185723379157537866', time=2024-09-12T03:10:15.607818+0000, chain.objs.size()=1 2024-09-12T01:21:57.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.484+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.g0wR8IhPEP4wHxWct_jPLjXMqTOCp4e_0 2024-09-12T01:21:57.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.484+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7682466815352492577', time=2024-09-12T03:10:15.655431+0000, chain.objs.size()=1 2024-09-12T01:21:57.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.484+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.GcgHSTh_66CIqPudtnlcQKZPbKUEnQG_0 2024-09-12T01:21:57.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.484+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14977003122965030353', time=2024-09-12T03:10:15.770716+0000, chain.objs.size()=1 2024-09-12T01:21:57.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.484+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.LrDvOTAE5oVTKEfC8QWAVVzTHgcYfTb_0 2024-09-12T01:21:57.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.484+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2432056531841556373', time=2024-09-12T03:10:15.961945+0000, chain.objs.size()=1 2024-09-12T01:21:57.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.484+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.CENsQ9KPG1s3cDhLoxNW_XrdWAe5Vs-_0 2024-09-12T01:21:57.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.484+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7134064417857298479', time=2024-09-12T03:10:16.016356+0000, chain.objs.size()=1 2024-09-12T01:21:57.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.484+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.SAtLn8osqcWS3Idy950iOgyYI0F_eHb_0 2024-09-12T01:21:57.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.484+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5849143713551180390', time=2024-09-12T03:10:16.028834+0000, chain.objs.size()=1 2024-09-12T01:21:57.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.484+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.w8VJh2xxJiZe_ZfMe4z3QuYk4hOSka7_0 2024-09-12T01:21:57.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.484+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11659485536357507293', time=2024-09-12T03:10:16.236844+0000, chain.objs.size()=1 2024-09-12T01:21:57.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.484+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.0foANMmtxcJ8qLtktaMi8RDQk6bNMz7_0 2024-09-12T01:21:57.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.484+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14682881134484065465', time=2024-09-12T03:10:16.641580+0000, chain.objs.size()=1 2024-09-12T01:21:57.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.484+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.vtBQFYjofDw-Z0YKQnMrQfEBISgkGqL_0 2024-09-12T01:21:57.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.484+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12925938432556829346', time=2024-09-12T03:10:16.782096+0000, chain.objs.size()=1 2024-09-12T01:21:57.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.484+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.j_sgqCUWi9LajKroVfghgGobAyqWOBk_0 2024-09-12T01:21:57.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.484+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3112441566975636129', time=2024-09-12T03:10:16.893381+0000, chain.objs.size()=1 2024-09-12T01:21:57.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.484+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.7lZNqpgOWK3zN30ujWuznc_Zo2w65jn_0 2024-09-12T01:21:57.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.484+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14753631771725246888', time=2024-09-12T03:10:16.973203+0000, chain.objs.size()=1 2024-09-12T01:21:57.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.484+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.6IJlMKECoodXkrRo2GqZ4WTFe5SHXwQ_0 2024-09-12T01:21:57.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3028633903639360906', time=2024-09-12T03:10:17.216312+0000, chain.objs.size()=1 2024-09-12T01:21:57.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.VWaToMQSKN1i_6KB9nn1qeZ4d8bC0tM_0 2024-09-12T01:21:57.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16727555776231427652', time=2024-09-12T03:10:17.221057+0000, chain.objs.size()=1 2024-09-12T01:21:57.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.rJQfeSO_8J4fbNyNRRjB2aI-O7nA9rg_0 2024-09-12T01:21:57.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3010221112346687083', time=2024-09-12T03:10:17.222063+0000, chain.objs.size()=1 2024-09-12T01:21:57.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.R2FK1dDLCIhUavKc3hXsSlFWApG5gX-_0 2024-09-12T01:21:57.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14748233011421097352', time=2024-09-12T03:10:17.268735+0000, chain.objs.size()=1 2024-09-12T01:21:57.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.34GhHgcpVpG-5FA17fqjD6eWqx2LcTh_0 2024-09-12T01:21:57.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12262407442691532957', time=2024-09-12T03:10:17.323737+0000, chain.objs.size()=1 2024-09-12T01:21:57.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.aK_4soj22tjP0DaIh6Etklvb0B9M_dt_0 2024-09-12T01:21:57.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5728087693510359511', time=2024-09-12T03:10:17.325937+0000, chain.objs.size()=1 2024-09-12T01:21:57.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Q0BptlfjBTE9PN57FxLf-GIV6gdieAg_0 2024-09-12T01:21:57.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4338161628070168026', time=2024-09-12T03:10:17.502601+0000, chain.objs.size()=1 2024-09-12T01:21:57.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ckUioWw1QSMyVILdLNX2Nj4-IeLfo82_0 2024-09-12T01:21:57.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14953241575916255099', time=2024-09-12T03:10:17.521702+0000, chain.objs.size()=1 2024-09-12T01:21:57.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.9U0FE_VY_8rf1YLWMGInkWDFmSVpvFZ_0 2024-09-12T01:21:57.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.543761148648369847', time=2024-09-12T03:10:17.573763+0000, chain.objs.size()=1 2024-09-12T01:21:57.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.svi3WOL6ky3ODfLHdfg0KsTgEx1bmc4_0 2024-09-12T01:21:57.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1862739197933227419', time=2024-09-12T03:10:17.621686+0000, chain.objs.size()=1 2024-09-12T01:21:57.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Kathv-xDGVJzUFEIpNOVKGJ10wTPwQy_0 2024-09-12T01:21:57.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11030712453363762565', time=2024-09-12T03:10:17.631822+0000, chain.objs.size()=1 2024-09-12T01:21:57.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.3XdjD2gTGYRDcpmp_ITH28kumwLlXB9_0 2024-09-12T01:21:57.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11833346234585327530', time=2024-09-12T03:10:17.737922+0000, chain.objs.size()=1 2024-09-12T01:21:57.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.cV0ZOj_26F_i5J5swb8D5sbdb2O6vyY_0 2024-09-12T01:21:57.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1401248478109263234', time=2024-09-12T03:10:17.799981+0000, chain.objs.size()=1 2024-09-12T01:21:57.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.R4h7IKdkzth_z6qT9ICNspocxDBFgGM_0 2024-09-12T01:21:57.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3844368850680330633', time=2024-09-12T03:10:17.856629+0000, chain.objs.size()=1 2024-09-12T01:21:57.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.J2wZrKrfOhhiVK3wenNaxxL99ATDaDX_0 2024-09-12T01:21:57.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17954209430935444922', time=2024-09-12T03:10:17.863404+0000, chain.objs.size()=1 2024-09-12T01:21:57.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.sWZfYziwHKTzcZicLwgQPtNdtdTezec_0 2024-09-12T01:21:57.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15853648256723303194', time=2024-09-12T03:10:17.882532+0000, chain.objs.size()=1 2024-09-12T01:21:57.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.nk7ygU_7dTZgWCcWorKtgiqEnWIJiDP_0 2024-09-12T01:21:57.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15089176415406565010', time=2024-09-12T03:10:46.843752+0000, chain.objs.size()=1 2024-09-12T01:21:57.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.488+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.374__shadow_.Y6Qn7cq6Fl6ic_Hlc4K1LXApgcwX127_0 2024-09-12T01:21:57.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.798258182475811332', time=2024-09-12T03:12:05.004070+0000, chain.objs.size()=1 2024-09-12T01:21:57.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.484__shadow_.EmW688FAFjui8s8Bc8FMUT4CLWOvHZT_0 2024-09-12T01:21:57.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4584580729420622728', time=2024-09-12T03:12:06.215868+0000, chain.objs.size()=1 2024-09-12T01:21:57.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.486__shadow_.1f6WMisQnWqix7n4-Ej6dvWTThwKRl-_0 2024-09-12T01:21:57.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13346471239901008092', time=2024-09-12T03:12:13.576151+0000, chain.objs.size()=1 2024-09-12T01:21:57.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.497__shadow_.wSuVrt8P9skwtxQwMcONLHm4hCf6c1U_0 2024-09-12T01:21:57.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2774118062002968853', time=2024-09-12T03:12:15.373415+0000, chain.objs.size()=1 2024-09-12T01:21:57.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.500__shadow_.AFs7IIJ4rCiiqJowLExplfiewU60ic3_0 2024-09-12T01:21:57.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4348774482967013175', time=2024-09-12T03:13:24.800180+0000, chain.objs.size()=4 2024-09-12T01:21:57.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.536__multipart_mymultipart.2~QL8euX9fjib4QFsrGx9YqPKIQkcKFXk.1 2024-09-12T01:21:57.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.536__multipart_mymultipart.2~QL8euX9fjib4QFsrGx9YqPKIQkcKFXk.2 2024-09-12T01:21:57.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.536__multipart_mymultipart.N7qkphzE4VrvGcW52Qwc2zHtHBe0s6EN.3 2024-09-12T01:21:57.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.536__multipart_mymultipart.2~QL8euX9fjib4QFsrGx9YqPKIQkcKFXk.4 2024-09-12T01:21:57.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16582309430611350115', time=2024-09-12T03:13:54.165629+0000, chain.objs.size()=1 2024-09-12T01:21:57.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.557__shadow_.oJ4VAVrRkOpr-IFAeU5is9ekz0E8DSt_0 2024-09-12T01:21:57.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7796104202735451715', time=2024-09-12T03:13:54.450855+0000, chain.objs.size()=1 2024-09-12T01:21:57.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.557__shadow_.NWMKfl9-VxnkOYU5DcZ7ADlGO96hThQ_0 2024-09-12T01:21:57.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3697391705595035574', time=2024-09-12T03:13:56.732621+0000, chain.objs.size()=2 2024-09-12T01:21:57.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.559__shadow_.QSk64dfJqS27cj3-kEMpbsyaosaXLmf_0 2024-09-12T01:21:57.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.559__shadow_.QSk64dfJqS27cj3-kEMpbsyaosaXLmf_1 2024-09-12T01:21:57.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6027126526013800305', time=2024-09-12T03:13:59.470711+0000, chain.objs.size()=1 2024-09-12T01:21:57.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.562__multipart_mymultipart.88HateYRBG-dxCGaDfJREx9jyNpc_DUN.1 2024-09-12T01:21:57.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9334038350918474475', time=2024-09-12T03:14:14.787773+0000, chain.objs.size()=1 2024-09-12T01:21:57.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:z8hpy.cupteDI.p9nqlqEEVCdFDYceI_.BE5YDOAcLiwEksa1UC7sMnSC6adO2Dl_0 2024-09-12T01:21:57.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2091112861566015737', time=2024-09-12T03:14:18.915944+0000, chain.objs.size()=1 2024-09-12T01:21:57.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.572__shadow_.0hlGpGZrZYYCEQH50U4GKrqBhmLS9lW_0 2024-09-12T01:21:57.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13261568707818710843', time=2024-09-12T03:14:22.982868+0000, chain.objs.size()=1 2024-09-12T01:21:57.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.575__shadow:aO8jTbQM0yrbxsorRZrxl-GxUTupo4o_.hCLH8j84ihQllhySxDokDBuBDhZ2ZYH_0 2024-09-12T01:21:57.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16497962652318818801', time=2024-09-12T03:14:31.817660+0000, chain.objs.size()=1 2024-09-12T01:21:57.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:kQ0wsDfja731QHSC6aX89StoRjvPBCp_.dUBWPu6pjc_JA098sbJKnS9pPmQtxBM_0 2024-09-12T01:21:57.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10852065571483528301', time=2024-09-12T03:14:35.009119+0000, chain.objs.size()=1 2024-09-12T01:21:57.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:8BjYGnfSoSFJZw0AVMC..nYyhNeXe8F_.SDo8p0hj13IQvv9ZceYxx44FpvP1XA6_0 2024-09-12T01:21:57.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6136705534827921158', time=2024-09-12T03:14:43.636200+0000, chain.objs.size()=1 2024-09-12T01:21:57.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.492+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:OfhUFfpVe-hPqhGbaBc1QpMHNixEUKG_.BHRS30JkLksao9NU5RZQGaZgwS4GHzd_0 2024-09-12T01:21:57.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.496+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6729419162465460961', time=2024-09-12T03:14:53.618771+0000, chain.objs.size()=1 2024-09-12T01:21:57.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.496+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.581__shadow:W19j6HeAodlX9np4sXn.lWER--gj6zC_.rlE_sY18r6jtV4q0rKV0vhLCr7tBM8S_0 2024-09-12T01:21:57.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.496+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11646443940053168298', time=2024-09-12T03:17:42.639398+0000, chain.objs.size()=1 2024-09-12T01:21:57.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.496+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.631__shadow_.rpg9AF_UZ8hNYqRAMPaQWKm8kXU5i0E_0 2024-09-12T01:21:57.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.496+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10361473933431650235', time=2024-09-12T03:17:52.847447+0000, chain.objs.size()=1 2024-09-12T01:21:57.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.496+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.646__shadow_.3f7nh1NAQOEjcRE-Y0aunXPm0WCMaLU_0 2024-09-12T01:21:57.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.496+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12662264598860552372', time=2024-09-12T03:18:12.196880+0000, chain.objs.size()=1 2024-09-12T01:21:57.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.496+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.669__shadow_.vZsd0LPl7_82XeCDflm0nJOMabOmert_0 2024-09-12T01:21:57.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.496+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5783372977388293118', time=2024-09-12T03:18:37.557406+0000, chain.objs.size()=1 2024-09-12T01:21:57.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.496+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.711__shadow:8RGswCdvEVqags06.qbWnbOI.wOnsJa_.8C15AXPzmeaaHT5e6ZTBLkYluf1pxbW_0 2024-09-12T01:21:57.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.496+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2708400201596218541', time=2024-09-12T03:18:51.174994+0000, chain.objs.size()=1 2024-09-12T01:21:57.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.496+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.717__shadow:LA-mdKtXw5XOaeEn.cHkgALFzuruSDE_.zKMYkEkBqG66vP1wOaxWX4j4aIKnrda_0 2024-09-12T01:21:57.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.496+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:57.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.500+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:21:57.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.500+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:57.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:57.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54671' 2024-09-12T01:21:57.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7941301177320114782', time=2024-09-12T03:08:10.272767+0000, chain.objs.size()=1 2024-09-12T01:21:57.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.238__shadow_.pgDL_ForCrF1_LLtSvfdw6AxdJ_twr9_0 2024-09-12T01:21:57.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4963502193584645849', time=2024-09-12T03:08:13.449318+0000, chain.objs.size()=1 2024-09-12T01:21:57.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.242__shadow_.eBs2O86zDc1Oh1GbksCTJk8Ujl9L3KE_0 2024-09-12T01:21:57.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15869669344548829674', time=2024-09-12T03:08:14.134056+0000, chain.objs.size()=1 2024-09-12T01:21:57.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.243__shadow_.5W7HhRFTyllFTmENywbRnAyvHiH9EOM_0 2024-09-12T01:21:57.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.520229001892984959', time=2024-09-12T03:08:47.442661+0000, chain.objs.size()=1 2024-09-12T01:21:57.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.TDoAKDK11hyOnYDZRxa8tX420rXuD2L_0 2024-09-12T01:21:57.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8065048968918913853', time=2024-09-12T03:08:47.499264+0000, chain.objs.size()=1 2024-09-12T01:21:57.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.o2RnHD_Aks4JvTFff41yiIdZK9XXehR_0 2024-09-12T01:21:57.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17571266044170307257', time=2024-09-12T03:08:47.611901+0000, chain.objs.size()=1 2024-09-12T01:21:57.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.zG-V_2lN26V2qgaMdSElUsLlqKRNhyn_0 2024-09-12T01:21:57.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9452997624531867108', time=2024-09-12T03:08:47.660464+0000, chain.objs.size()=1 2024-09-12T01:21:57.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ro76uS6qUEMSgutqEODeVg804ChB-z-_0 2024-09-12T01:21:57.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11099700909715623583', time=2024-09-12T03:08:47.818427+0000, chain.objs.size()=1 2024-09-12T01:21:57.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.fqGH33LvzxIjBqnFCcjf9iKQPFVUbp4_0 2024-09-12T01:21:57.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16114688565516388695', time=2024-09-12T03:08:47.826918+0000, chain.objs.size()=1 2024-09-12T01:21:57.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.O3MpG5BQZm3lcsIyqvAkyMNTxbz1YUT_0 2024-09-12T01:21:57.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6741038434859686778', time=2024-09-12T03:08:47.907658+0000, chain.objs.size()=1 2024-09-12T01:21:57.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.NxtWUgQZk8Lxo67kktQSXjz65xykD1n_0 2024-09-12T01:21:57.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3166971261409116274', time=2024-09-12T03:08:47.925894+0000, chain.objs.size()=1 2024-09-12T01:21:57.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.PDz-drWSeJWB73kVQ8wfCJsVectH1Ab_0 2024-09-12T01:21:57.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14403096657898387811', time=2024-09-12T03:08:48.003433+0000, chain.objs.size()=1 2024-09-12T01:21:57.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.o383VThrFasbz_K-3qPu32f49VHldl2_0 2024-09-12T01:21:57.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2614763082938401175', time=2024-09-12T03:08:48.008725+0000, chain.objs.size()=1 2024-09-12T01:21:57.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.DUck0hgbhbJ7vuFktU1vj39Kx0DPvQJ_0 2024-09-12T01:21:57.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8913796377413145065', time=2024-09-12T03:08:48.153379+0000, chain.objs.size()=1 2024-09-12T01:21:57.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.jZ5CJgE4NiSm8FWHMpi6XKIRXJW9TYJ_0 2024-09-12T01:21:57.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1001204618250843193', time=2024-09-12T03:08:48.177118+0000, chain.objs.size()=1 2024-09-12T01:21:57.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.zvfmA80g86TcqMFxphNjvxFFBD1QQSE_0 2024-09-12T01:21:57.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12481702481586195134', time=2024-09-12T03:08:48.214748+0000, chain.objs.size()=1 2024-09-12T01:21:57.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.LmE7aNar0WzON6vE1GDKnwydu-dVEdA_0 2024-09-12T01:21:57.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2445267585259141145', time=2024-09-12T03:08:48.215880+0000, chain.objs.size()=1 2024-09-12T01:21:57.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.AvuI_VcIl2_UXrlaWROvS6T1d54IZZP_0 2024-09-12T01:21:57.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15965164422616188051', time=2024-09-12T03:08:48.268354+0000, chain.objs.size()=1 2024-09-12T01:21:57.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Yao7j3wXLefABs5w2DHQ1XEdmEAgIbo_0 2024-09-12T01:21:57.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1237696815004182712', time=2024-09-12T03:08:48.271308+0000, chain.objs.size()=1 2024-09-12T01:21:57.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.4i_DmkxLNOtav6y_C0aMb7GXXZ0pkN7_0 2024-09-12T01:21:57.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10070802748396326354', time=2024-09-12T03:08:48.583741+0000, chain.objs.size()=1 2024-09-12T01:21:57.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.504+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.hFglPhv8X_EYTN4WyvqeFucW3mPMqnZ_0 2024-09-12T01:21:57.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10256126548490412536', time=2024-09-12T03:08:48.704346+0000, chain.objs.size()=1 2024-09-12T01:21:57.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.zjaXmQpTdOnDFlrNl9a1PxvUYUI2oY2_0 2024-09-12T01:21:57.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2465803135652230403', time=2024-09-12T03:08:48.933198+0000, chain.objs.size()=1 2024-09-12T01:21:57.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.zVMjjLd5DiKvtUiz8qPLlieo_Gt3C_H_0 2024-09-12T01:21:57.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7307693445883749529', time=2024-09-12T03:08:48.939869+0000, chain.objs.size()=1 2024-09-12T01:21:57.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.2yhU7fPxiIXH5B78v4JEmTf-ciOkyvj_0 2024-09-12T01:21:57.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5218203504097678053', time=2024-09-12T03:08:48.971775+0000, chain.objs.size()=1 2024-09-12T01:21:57.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.89qU2p3sh7okAQitnxsy-9G9-ougTan_0 2024-09-12T01:21:57.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2163497592031998380', time=2024-09-12T03:08:48.986843+0000, chain.objs.size()=1 2024-09-12T01:21:57.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.E78Kxa9UHU6JFhR1eOQTINPljE6IUWJ_0 2024-09-12T01:21:57.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5208006714528615742', time=2024-09-12T03:08:49.032138+0000, chain.objs.size()=1 2024-09-12T01:21:57.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.lbK64Uu3YhRn1IcOv0xOBlSbxX1LNEM_0 2024-09-12T01:21:57.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3987130942006221080', time=2024-09-12T03:08:49.282069+0000, chain.objs.size()=1 2024-09-12T01:21:57.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.MjESrhKjo2KDmsEuCIauCifl0Gksp_w_0 2024-09-12T01:21:57.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11864649365135416940', time=2024-09-12T03:08:49.282907+0000, chain.objs.size()=1 2024-09-12T01:21:57.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_._JFzZEFXBwtKpFPVNxAmmDfxn0tjWdG_0 2024-09-12T01:21:57.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7367189920167755995', time=2024-09-12T03:08:49.302922+0000, chain.objs.size()=1 2024-09-12T01:21:57.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.7PtbsF_daVpc_89igbGX-3r5evEdsFv_0 2024-09-12T01:21:57.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1625247760629054770', time=2024-09-12T03:08:49.344578+0000, chain.objs.size()=1 2024-09-12T01:21:57.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.U2VFYifbsIowhzSIptXQGSGtC9XyD9a_0 2024-09-12T01:21:57.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16407988282516350824', time=2024-09-12T03:08:49.351169+0000, chain.objs.size()=1 2024-09-12T01:21:57.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Fnw8I-ec4h2rOM4UtH3D7CClOyeial-_0 2024-09-12T01:21:57.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3390734177144031106', time=2024-09-12T03:08:49.380206+0000, chain.objs.size()=1 2024-09-12T01:21:57.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.gE_hMBTyeuNzcNl96WNO0Jmxajo5wpU_0 2024-09-12T01:21:57.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14056440346504953094', time=2024-09-12T03:08:49.538390+0000, chain.objs.size()=1 2024-09-12T01:21:57.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.TT3cX54uZ_vnhi3VRchUQyTLWdAjtW0_0 2024-09-12T01:21:57.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.202436103767364135', time=2024-09-12T03:08:49.558185+0000, chain.objs.size()=1 2024-09-12T01:21:57.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.508+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Gj_If1bZ1tFwULxCvpK7VrnD-sdnsU__0 2024-09-12T01:21:57.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2597335468216093785', time=2024-09-12T03:08:49.659880+0000, chain.objs.size()=1 2024-09-12T01:21:57.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.LAyL4lAEsEUrGbqKfJuH-i-momKhi59_0 2024-09-12T01:21:57.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3207541434092093945', time=2024-09-12T03:08:49.692380+0000, chain.objs.size()=1 2024-09-12T01:21:57.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.DJ8X4FAQoJuRRxdabM8CU2TSwgiQx_K_0 2024-09-12T01:21:57.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7136965426826930626', time=2024-09-12T03:08:49.707423+0000, chain.objs.size()=1 2024-09-12T01:21:57.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.XY9fBCa16CieDImFxQ8PzeSAE05T_ar_0 2024-09-12T01:21:57.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.510432989595997385', time=2024-09-12T03:08:49.710630+0000, chain.objs.size()=1 2024-09-12T01:21:57.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.kOJf5K6t2oH9pqJxboU0sgZDQFa8Ir5_0 2024-09-12T01:21:57.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8668562737115339000', time=2024-09-12T03:08:49.728857+0000, chain.objs.size()=1 2024-09-12T01:21:57.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.mPNzkSJgjfj5cuEc35cb4fD8k-_IwLm_0 2024-09-12T01:21:57.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7085726914277886839', time=2024-09-12T03:08:49.862467+0000, chain.objs.size()=1 2024-09-12T01:21:57.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.twWY5gUywBa5qd4n6XJHpsaPVt8XwBo_0 2024-09-12T01:21:57.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10874919767378353842', time=2024-09-12T03:08:49.946732+0000, chain.objs.size()=1 2024-09-12T01:21:57.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.BDvrICsNP5nlx-Mmp9ymSSdkyHTKRfo_0 2024-09-12T01:21:57.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16699890921621525243', time=2024-09-12T03:09:11.610918+0000, chain.objs.size()=1 2024-09-12T01:21:57.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.293__shadow_.iP0F74RGJquCktOp_jI538NdfuroUk-_0 2024-09-12T01:21:57.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12577602009151402878', time=2024-09-12T03:09:11.623509+0000, chain.objs.size()=1 2024-09-12T01:21:57.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.293__shadow_.HS6F3XAUBy7i9RDd2pOYvjrUC7mcfrP_0 2024-09-12T01:21:57.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9085959901737874466', time=2024-09-12T03:09:18.005564+0000, chain.objs.size()=1 2024-09-12T01:21:57.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.301__shadow_.5h-cEt_IHzkesyS9v8GHOJTMkX-MlcG_0 2024-09-12T01:21:57.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8476973273734152212', time=2024-09-12T03:09:18.695394+0000, chain.objs.size()=1 2024-09-12T01:21:57.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.302__shadow_.5-jeHwJPTCvco5LNAtSNg5Bn5o5Falq_0 2024-09-12T01:21:57.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16029552101914745250', time=2024-09-12T03:09:20.065953+0000, chain.objs.size()=1 2024-09-12T01:21:57.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.304__shadow_.5-TM2nZSeWU5shJOJ9A44Yn9I3-q8R-_0 2024-09-12T01:21:57.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15238411614268314957', time=2024-09-12T03:09:52.943952+0000, chain.objs.size()=1 2024-09-12T01:21:57.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.iWVWHPdhp1guny4DsxVae4pTvq9UPCF_0 2024-09-12T01:21:57.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14580391366118306595', time=2024-09-12T03:09:52.995016+0000, chain.objs.size()=1 2024-09-12T01:21:57.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.irYCC5dDP87ftMvKu86docoJtFPK10e_0 2024-09-12T01:21:57.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5685157720626964265', time=2024-09-12T03:09:53.018785+0000, chain.objs.size()=1 2024-09-12T01:21:57.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.5yKfdYsZF3q787pa3xuAaXrOyBs7k1S_0 2024-09-12T01:21:57.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1018698889239711250', time=2024-09-12T03:09:53.038296+0000, chain.objs.size()=1 2024-09-12T01:21:57.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.8Zl12ygKoXTKpUTLHY8AQIJgqpJaaGv_0 2024-09-12T01:21:57.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16511412670996828407', time=2024-09-12T03:09:53.098518+0000, chain.objs.size()=1 2024-09-12T01:21:57.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.pK79dBIoE_1A0V161YZ8kSoTONoCTfk_0 2024-09-12T01:21:57.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3630584776841003595', time=2024-09-12T03:09:53.111079+0000, chain.objs.size()=1 2024-09-12T01:21:57.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.p6Uqh5GF-hwdN1otAiZeGMEaKKnRVBm_0 2024-09-12T01:21:57.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3932608566254284759', time=2024-09-12T03:09:53.132624+0000, chain.objs.size()=1 2024-09-12T01:21:57.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.MhCP1jw9ISyEjWfrFwHR_yHUFSSeIcv_0 2024-09-12T01:21:57.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11603632225724718856', time=2024-09-12T03:09:53.334500+0000, chain.objs.size()=1 2024-09-12T01:21:57.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.vVX6aTBhxWWX3mAwQlVPLNm9Mn418qD_0 2024-09-12T01:21:57.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13352566346554597373', time=2024-09-12T03:09:53.336512+0000, chain.objs.size()=1 2024-09-12T01:21:57.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.a6sQ6UjpaQgo0QV47w8UBob4Ei7a-Mb_0 2024-09-12T01:21:57.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11695237763856371067', time=2024-09-12T03:09:53.339181+0000, chain.objs.size()=1 2024-09-12T01:21:57.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.zMUlGK7483IzEyXxdDb5ZgG36nZmLw6_0 2024-09-12T01:21:57.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4364043707261388954', time=2024-09-12T03:09:53.458477+0000, chain.objs.size()=1 2024-09-12T01:21:57.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.512+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.kgTQQ4q715nh2HS5D384JVp4cyCs6VU_0 2024-09-12T01:21:57.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13038762018200572357', time=2024-09-12T03:09:53.488563+0000, chain.objs.size()=1 2024-09-12T01:21:57.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.X2FnMGK8YekX_IFiomvSJOdFkDYlXB__0 2024-09-12T01:21:57.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13454782257072587871', time=2024-09-12T03:09:53.735464+0000, chain.objs.size()=1 2024-09-12T01:21:57.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.1N-AjaRogZ3tdgLMbNleOd-Eh8jaZMq_0 2024-09-12T01:21:57.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10500952960424816664', time=2024-09-12T03:09:53.737656+0000, chain.objs.size()=1 2024-09-12T01:21:57.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.F_wEf-i1ocfGVREzT-TlGSQCJX3UC5x_0 2024-09-12T01:21:57.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9976700270685311182', time=2024-09-12T03:09:53.763333+0000, chain.objs.size()=1 2024-09-12T01:21:57.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.LGDlgBhbGnwA8jV4TyAawrUC6RTxS-J_0 2024-09-12T01:21:57.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5582644838713812950', time=2024-09-12T03:09:53.807779+0000, chain.objs.size()=1 2024-09-12T01:21:57.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.7lgurPHwIjfbF5miCSQ8rfn_pcw-aDX_0 2024-09-12T01:21:57.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2663053191182815105', time=2024-09-12T03:09:53.816397+0000, chain.objs.size()=1 2024-09-12T01:21:57.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.9vgCzo4aiGEL4K69CrNsjwQiO_R6Hbw_0 2024-09-12T01:21:57.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14208322253775175481', time=2024-09-12T03:09:54.043035+0000, chain.objs.size()=1 2024-09-12T01:21:57.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.RpKpHHiFDXIYPGQ49Q_ryWGp1cqqtE2_0 2024-09-12T01:21:57.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1022317259998199394', time=2024-09-12T03:09:54.098385+0000, chain.objs.size()=1 2024-09-12T01:21:57.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.tPTdJHmHEvkuGLz8HCG_NfCxsERgvAJ_0 2024-09-12T01:21:57.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15210441610581526707', time=2024-09-12T03:09:54.302376+0000, chain.objs.size()=1 2024-09-12T01:21:57.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.LaK2r7NPnr47F_bqNBH2o7GvVSmuxw4_0 2024-09-12T01:21:57.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17485641724300720378', time=2024-09-12T03:09:54.392482+0000, chain.objs.size()=1 2024-09-12T01:21:57.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.oFxAvaToFzxuPaI-7Hj-vCuMY5BnbsO_0 2024-09-12T01:21:57.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16074946941458254708', time=2024-09-12T03:09:54.440823+0000, chain.objs.size()=1 2024-09-12T01:21:57.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.xjGwzWe07qDsw1hjrN7m0le657_s7fC_0 2024-09-12T01:21:57.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11304199913155759425', time=2024-09-12T03:09:54.449453+0000, chain.objs.size()=1 2024-09-12T01:21:57.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.loKFmIX0Nk0NMI4prJA3xfcmW4lKa3Q_0 2024-09-12T01:21:57.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13625523180459628851', time=2024-09-12T03:09:54.619761+0000, chain.objs.size()=1 2024-09-12T01:21:57.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.rwLL7wyX9IlXoN5HenkOTt2ChFxNr0D_0 2024-09-12T01:21:57.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.72720595241864549', time=2024-09-12T03:09:54.663377+0000, chain.objs.size()=1 2024-09-12T01:21:57.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.92B4p5-hKNxjEBgXf6zjANdmcUJ-bXT_0 2024-09-12T01:21:57.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10947711358985194571', time=2024-09-12T03:09:54.706021+0000, chain.objs.size()=1 2024-09-12T01:21:57.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.8Lytsbc3iXC7k23vQnqDo6o7DDk6tRy_0 2024-09-12T01:21:57.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9767431838391295619', time=2024-09-12T03:09:54.743594+0000, chain.objs.size()=1 2024-09-12T01:21:57.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.HKCRMdhc5PTppaghjFhLCC-iDKD_0O4_0 2024-09-12T01:21:57.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5908783484097930993', time=2024-09-12T03:09:54.808627+0000, chain.objs.size()=1 2024-09-12T01:21:57.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Ir8eCXNrdyw1kKMPH8Bad0bNCeChX92_0 2024-09-12T01:21:57.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18220599509104862476', time=2024-09-12T03:09:55.432073+0000, chain.objs.size()=1 2024-09-12T01:21:57.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.y4ccBf8HwTwU4uL-9AnX1XvMQfmqQQ1_0 2024-09-12T01:21:57.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5840669296655541223', time=2024-09-12T03:10:15.327436+0000, chain.objs.size()=1 2024-09-12T01:21:57.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.516+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.JLGDc6DteKpY5M3PLtCZS_CifE74SnK_0 2024-09-12T01:21:57.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1055806627614594466', time=2024-09-12T03:10:15.348515+0000, chain.objs.size()=1 2024-09-12T01:21:57.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.QIrL3QNVTr4TjSCnfZj-IJTSLX93qkH_0 2024-09-12T01:21:57.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13574621073856564320', time=2024-09-12T03:10:15.379882+0000, chain.objs.size()=1 2024-09-12T01:21:57.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.5u_jjsZwBIRzIwxP6OtoLbZwF5-h1o7_0 2024-09-12T01:21:57.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14050431126984481095', time=2024-09-12T03:10:15.384419+0000, chain.objs.size()=1 2024-09-12T01:21:57.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.W-mPXxTJAHxI7CIAnJOIydA4H3FCqC7_0 2024-09-12T01:21:57.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11105143412456500276', time=2024-09-12T03:10:15.393721+0000, chain.objs.size()=1 2024-09-12T01:21:57.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.q9vpdftDbPxjYUwzWtE4WHaaRG60U7M_0 2024-09-12T01:21:57.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14485281309112182488', time=2024-09-12T03:10:15.405706+0000, chain.objs.size()=1 2024-09-12T01:21:57.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.QpUXgg0I8EXphZPAGjeiAxyDj5fFg-8_0 2024-09-12T01:21:57.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4054261563503567361', time=2024-09-12T03:10:15.419505+0000, chain.objs.size()=1 2024-09-12T01:21:57.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.34nE3-CmZo0uA_kM2EEejPGChweg4vP_0 2024-09-12T01:21:57.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.107126108026564369', time=2024-09-12T03:10:15.445320+0000, chain.objs.size()=1 2024-09-12T01:21:57.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.48kvl1VPJeEH0_JccJpTbm-F0IrILZA_0 2024-09-12T01:21:57.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3408256331278780915', time=2024-09-12T03:10:15.580625+0000, chain.objs.size()=1 2024-09-12T01:21:57.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.q9ldwVVzyorwngVNRtcdWdd1gPOUn83_0 2024-09-12T01:21:57.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18260675672931098868', time=2024-09-12T03:10:15.726150+0000, chain.objs.size()=1 2024-09-12T01:21:57.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ODpY54HXNhC4WE3e6gFd6X_B-OvIaak_0 2024-09-12T01:21:57.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10769204341661963744', time=2024-09-12T03:10:15.879929+0000, chain.objs.size()=1 2024-09-12T01:21:57.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Z7EASRNlA5j0U2OUbrhKPgDY9u-Qq-3_0 2024-09-12T01:21:57.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14452779149601599193', time=2024-09-12T03:10:15.904988+0000, chain.objs.size()=1 2024-09-12T01:21:57.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.SMazpUpJ_2Yd0vfBUMsQWGe2-HNaG7r_0 2024-09-12T01:21:57.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2725094004676183148', time=2024-09-12T03:10:15.912909+0000, chain.objs.size()=1 2024-09-12T01:21:57.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.LoXg5qhqWb0f2sakY0gkcmeWFa1VGQO_0 2024-09-12T01:21:57.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3284073464678172244', time=2024-09-12T03:10:15.954265+0000, chain.objs.size()=1 2024-09-12T01:21:57.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.U_qUuD67dIZp6LgSToGaCt-TkJDuUD4_0 2024-09-12T01:21:57.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10211886383433057507', time=2024-09-12T03:10:15.981015+0000, chain.objs.size()=1 2024-09-12T01:21:57.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.zNVqCm5zWqc41Hoh5ugD15cXWnK-mhQ_0 2024-09-12T01:21:57.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8454145477062395400', time=2024-09-12T03:10:16.051035+0000, chain.objs.size()=1 2024-09-12T01:21:57.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.RZpSy9-Rz_ZvirijTK8ZZGZ3h9cOUWQ_0 2024-09-12T01:21:57.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7683231763603903407', time=2024-09-12T03:10:16.073874+0000, chain.objs.size()=1 2024-09-12T01:21:57.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.WNPnxIpqM1e_Q07T5SE78t2CCSDk1Ln_0 2024-09-12T01:21:57.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18309093563894984463', time=2024-09-12T03:10:16.216177+0000, chain.objs.size()=1 2024-09-12T01:21:57.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.520+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.eBJQsirKSa8cS1dv3uE_8w_Bc_N8U0z_0 2024-09-12T01:21:57.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.524+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16969318918356955053', time=2024-09-12T03:10:16.229371+0000, chain.objs.size()=1 2024-09-12T01:21:57.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.524+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.7jnf6NpIoHUrA26tzkvyAbgXDbBHBrs_0 2024-09-12T01:21:57.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.524+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4925191483438420234', time=2024-09-12T03:10:16.301724+0000, chain.objs.size()=1 2024-09-12T01:21:57.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.524+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.VeRTLq0sWJfoFZlmPLz29ogJI9sqBJZ_0 2024-09-12T01:21:57.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.524+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3249776948278964439', time=2024-09-12T03:10:16.323730+0000, chain.objs.size()=1 2024-09-12T01:21:57.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.524+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.wFD9LeIF7Z-2QWE04EHHwe6SKsobQVh_0 2024-09-12T01:21:57.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.524+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5836769912577758505', time=2024-09-12T03:10:16.611222+0000, chain.objs.size()=1 2024-09-12T01:21:57.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.524+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.c6QHJGHT8aXhSiMfXhkMjcCqkYfRT5C_0 2024-09-12T01:21:57.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.524+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6356885013194216797', time=2024-09-12T03:10:16.640381+0000, chain.objs.size()=1 2024-09-12T01:21:57.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.524+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.HayoX5br5XnNkSt6QI8hu56A3aPPzAK_0 2024-09-12T01:21:57.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.524+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7981056040718558320', time=2024-09-12T03:10:16.815956+0000, chain.objs.size()=1 2024-09-12T01:21:57.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.524+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.grsOYhK97u5QDiojtV3SiVti7-qPkxY_0 2024-09-12T01:21:57.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.524+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17915666210915172997', time=2024-09-12T03:10:16.920866+0000, chain.objs.size()=1 2024-09-12T01:21:57.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.524+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.mi9arkNEDe3iMFGWJuU47TKCHBWHqNu_0 2024-09-12T01:21:57.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.524+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/54671 2024-09-12T01:21:57.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.524+0000 7f82be4a9640 0 -- 172.21.15.70:0/2230280201 >> [v2:172.21.15.70:6816/1979013808,v1:172.21.15.70:6817/1979013808] conn(0x7f82b0018030 msgr2=0x7f8184086310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:21:57.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=40, truncated=0, next_marker='' 2024-09-12T01:21:57.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13108993830069777633', time=2024-09-12T03:10:16.951856+0000, chain.objs.size()=1 2024-09-12T01:21:57.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.DyTBt5psP6Mlo8mnNABHBVX8tc9_-08_0 2024-09-12T01:21:57.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.364824345616961965', time=2024-09-12T03:10:16.973926+0000, chain.objs.size()=1 2024-09-12T01:21:57.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.TbrG01IopHxNC8JMaIX6QjHQ5mMVGYM_0 2024-09-12T01:21:57.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6334444606276693914', time=2024-09-12T03:10:17.192914+0000, chain.objs.size()=1 2024-09-12T01:21:57.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.xu6ara8JLkcnM71JyA7yEJp6Wxm93T9_0 2024-09-12T01:21:57.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2593931396527827317', time=2024-09-12T03:10:17.297330+0000, chain.objs.size()=1 2024-09-12T01:21:57.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.7oebusdZ_Y-xu_I6tv3shXdpnRATFO5_0 2024-09-12T01:21:57.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3049167104666954582', time=2024-09-12T03:10:17.492011+0000, chain.objs.size()=1 2024-09-12T01:21:57.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.BwzouEl5Xkuqlyd5KUA_sOYkel7uZXg_0 2024-09-12T01:21:57.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11177581415966220490', time=2024-09-12T03:10:17.595063+0000, chain.objs.size()=1 2024-09-12T01:21:57.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.LRGfTM36wTjSefO-PeOXZA6OhdNTU5R_0 2024-09-12T01:21:57.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5218710790949720231', time=2024-09-12T03:10:17.607287+0000, chain.objs.size()=1 2024-09-12T01:21:57.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.PPWKFSG55z2IdYpDETycTENor04v1uA_0 2024-09-12T01:21:57.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15121361724110294067', time=2024-09-12T03:10:17.619453+0000, chain.objs.size()=1 2024-09-12T01:21:57.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.0bTfL3ANQH683DSCTc5eKWIflKu-TE7_0 2024-09-12T01:21:57.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16378277459127248160', time=2024-09-12T03:10:17.620809+0000, chain.objs.size()=1 2024-09-12T01:21:57.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.2AuM_7ULL0EZaNf9ssFMyW-4HALyNOX_0 2024-09-12T01:21:57.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12617317139496465010', time=2024-09-12T03:10:17.636985+0000, chain.objs.size()=1 2024-09-12T01:21:57.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ScjYJva9wNMh0vmnOVk8SZzkJsg6GBX_0 2024-09-12T01:21:57.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8752601295405319877', time=2024-09-12T03:10:17.772722+0000, chain.objs.size()=1 2024-09-12T01:21:57.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.gkVylLc0kCTvPrzuwflh8_TxaKTV0zi_0 2024-09-12T01:21:57.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15333849274616061473', time=2024-09-12T03:10:17.778121+0000, chain.objs.size()=1 2024-09-12T01:21:57.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.UZHphKLLcnsFV_RCsuoRdPpb2Xv_HmN_0 2024-09-12T01:21:57.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8554608241225454458', time=2024-09-12T03:10:17.825925+0000, chain.objs.size()=1 2024-09-12T01:21:57.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.3KZQ9u3GxmyNZMPq8XTwzBOxJFDb21B_0 2024-09-12T01:21:57.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5477719944421730271', time=2024-09-12T03:10:17.833951+0000, chain.objs.size()=1 2024-09-12T01:21:57.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ZB83eZbuXYzBLQb_14pZVBsuyq1_wBM_0 2024-09-12T01:21:57.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9468757909164862197', time=2024-09-12T03:10:17.856222+0000, chain.objs.size()=1 2024-09-12T01:21:57.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.iry-S-QuxnWR9BZUDE_bBAnfhxvgUGJ_0 2024-09-12T01:21:57.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3353239100554908027', time=2024-09-12T03:10:17.895088+0000, chain.objs.size()=1 2024-09-12T01:21:57.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.-lIeW46xeLBxrhhvWulSlAFZkDkSnIv_0 2024-09-12T01:21:57.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5974575527760312931', time=2024-09-12T03:10:25.964702+0000, chain.objs.size()=1 2024-09-12T01:21:57.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.338__shadow_.sI8W-kzdoVNRGd6kurDL2K81jJCxukx_0 2024-09-12T01:21:57.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12532803541221244203', time=2024-09-12T03:12:05.013261+0000, chain.objs.size()=1 2024-09-12T01:21:57.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.484__shadow_.4Oqw2Oq6WZNPcgJefeX2OUyYfdO4LHx_0 2024-09-12T01:21:57.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9102436332674469154', time=2024-09-12T03:12:15.374108+0000, chain.objs.size()=1 2024-09-12T01:21:57.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.500__shadow_.AFs7IIJ4rCiiqJowLExplfiewU60ic3_0 2024-09-12T01:21:57.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6271044274671461131', time=2024-09-12T03:12:29.987794+0000, chain.objs.size()=2 2024-09-12T01:21:57.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.518__shadow_.-rmE-gRWzyRC9M8TWdPcRa6_004KNWX_0 2024-09-12T01:21:57.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.518__shadow_.-rmE-gRWzyRC9M8TWdPcRa6_004KNWX_1 2024-09-12T01:21:57.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1765902011540176773', time=2024-09-12T03:12:48.713634+0000, chain.objs.size()=6 2024-09-12T01:21:57.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~Yg1Ew04wrmGlk2Ve2_P7wFvb-OR7Bgt.1 2024-09-12T01:21:57.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.528+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~Yg1Ew04wrmGlk2Ve2_P7wFvb-OR7Bgt.2 2024-09-12T01:21:57.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.532+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.1p_jW6iVZ-WDu1kdvP5fFDOIUxbwucSj.3 2024-09-12T01:21:57.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.532+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~Yg1Ew04wrmGlk2Ve2_P7wFvb-OR7Bgt.4 2024-09-12T01:21:57.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.532+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~Yg1Ew04wrmGlk2Ve2_P7wFvb-OR7Bgt.5 2024-09-12T01:21:57.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.532+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~Yg1Ew04wrmGlk2Ve2_P7wFvb-OR7Bgt.6 2024-09-12T01:21:57.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.532+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18099264876650253477', time=2024-09-12T03:13:04.566417+0000, chain.objs.size()=2 2024-09-12T01:21:57.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.532+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.529__multipart_mymultipart.2~Kw4zrwh5zYVdvhiJflSZ2B--1kVv2wQ.1 2024-09-12T01:21:57.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.532+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.529__multipart_mymultipart.2~Kw4zrwh5zYVdvhiJflSZ2B--1kVv2wQ.2 2024-09-12T01:21:57.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.532+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1942646038366399608', time=2024-09-12T03:13:53.611811+0000, chain.objs.size()=1 2024-09-12T01:21:57.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.532+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.556__shadow_.yaQmtyM4m_6ORipRh7Sz6PMFa9Vy6YP_0 2024-09-12T01:21:57.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.532+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3338606665979908944', time=2024-09-12T03:14:12.188902+0000, chain.objs.size()=1 2024-09-12T01:21:57.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.532+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:YWRiYTQyneNIjDCaBGHUNubJLArurhu_.Fi0QKgP4uF9jf1z-5VlMzQHQ5NyVHG6_0 2024-09-12T01:21:57.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.532+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12702581624190113597', time=2024-09-12T03:14:21.034007+0000, chain.objs.size()=1 2024-09-12T01:21:57.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.532+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.574__shadow_.2YSeKWHwYDjwUNXs_v6SQUYZ2TAHqaH_0 2024-09-12T01:21:57.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.532+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16745823211808439717', time=2024-09-12T03:14:22.215040+0000, chain.objs.size()=1 2024-09-12T01:21:57.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.532+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.575__shadow_.0iLqoTWc3GDowd8A0BCQwJX3FQgPPa1_0 2024-09-12T01:21:57.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.532+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15890310543374204720', time=2024-09-12T03:14:29.784031+0000, chain.objs.size()=1 2024-09-12T01:21:57.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.532+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.577__shadow:lXJOcvynIKOEx2rUH1z3SDOtKXFTtXs_.YUJ3whu2VcAztztzflwH60TI-63x2Rl_0 2024-09-12T01:21:57.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.532+0000 7f82be4a9640 0 -- 172.21.15.70:0/2230280201 >> [v2:172.21.15.70:6816/1979013808,v1:172.21.15.70:6817/1979013808] conn(0x561a13c523e0 msgr2=0x7f8184086d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:21:57.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6289836340314156996', time=2024-09-12T03:14:30.189112+0000, chain.objs.size()=1 2024-09-12T01:21:57.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.577__shadow:44XzC984Pn550RGqTFp6ZnwLtR1CRpM_.qvIQKdvm5gxDrf7NSAVaP_kKVBNJg-u_0 2024-09-12T01:21:57.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16361810683352690160', time=2024-09-12T03:14:36.560900+0000, chain.objs.size()=1 2024-09-12T01:21:57.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:bnklxdSevQGDvAwYdS3fhgQCnd5FURk_.8yXaCoLd4eFgQOcwzq0v4C0ifrLgt1d_0 2024-09-12T01:21:57.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6396760735770654722', time=2024-09-12T03:14:40.773959+0000, chain.objs.size()=1 2024-09-12T01:21:57.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:e5dLSMmzkq.ddEbR9uvhbMVayiaD3H5_.IQ8PriA7WD6b8uiS2w4xuENkoioVMOm_0 2024-09-12T01:21:57.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14171284358557525184', time=2024-09-12T03:14:50.199257+0000, chain.objs.size()=4 2024-09-12T01:21:57.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.579__multipart_testobj.2~QpPnOhYVPuOQjhbJ5lCnM0pLO-csJu2.1 2024-09-12T01:21:57.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.579__multipart_testobj.2~QpPnOhYVPuOQjhbJ5lCnM0pLO-csJu2.2 2024-09-12T01:21:57.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.579__multipart_testobj.2~QpPnOhYVPuOQjhbJ5lCnM0pLO-csJu2.3 2024-09-12T01:21:57.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.579__multipart_testobj.2~QpPnOhYVPuOQjhbJ5lCnM0pLO-csJu2.4 2024-09-12T01:21:57.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17693000463899282160', time=2024-09-12T03:14:51.976059+0000, chain.objs.size()=1 2024-09-12T01:21:57.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.580__shadow:pTpSr3vVttY4oNIMIQcZJfMkbtbrSLO_.ZOXYat-ST9587Ks4_NeQPIfvjQWqu-A_0 2024-09-12T01:21:57.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1919331476356929486', time=2024-09-12T03:14:55.344249+0000, chain.objs.size()=1 2024-09-12T01:21:57.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.584__shadow:GLTpDDStLKzZrAqvKhuKhGGejtMuNFh_.kl7rW7L6ksiLoyNEPqi2p6Paeb7byJM_0 2024-09-12T01:21:57.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8165881914915093757', time=2024-09-12T03:14:58.985849+0000, chain.objs.size()=1 2024-09-12T01:21:57.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.588__shadow:5FGMCGsKdVkG.ZvcGmzt2JijkItkLUy_.9xv2O8xnHmWxwLPGGXPT_NRJtEqaHTk_0 2024-09-12T01:21:57.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11536134592104937163', time=2024-09-12T03:15:27.038687+0000, chain.objs.size()=1 2024-09-12T01:21:57.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.617__shadow_.cQRus-9Xjq-_xVvXh083HEpnxNT31kl_0 2024-09-12T01:21:57.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82be4a9640 0 -- 172.21.15.70:0/2230280201 >> [v2:172.21.15.70:6816/1979013808,v1:172.21.15.70:6817/1979013808] conn(0x7f82b0018030 msgr2=0x7f8184086310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:21:57.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9745199528562686148', time=2024-09-12T03:17:49.359154+0000, chain.objs.size()=1 2024-09-12T01:21:57.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.641__shadow_.xlWsoiX7fRmxEaB9emP0RtERNLBlM6B_0 2024-09-12T01:21:57.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11151992030349258003', time=2024-09-12T03:17:54.646569+0000, chain.objs.size()=1 2024-09-12T01:21:57.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.648__shadow_.2xL0XOuW3ol64nee7IuM-u1MiFh3oJ2_0 2024-09-12T01:21:57.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1923318016740614015', time=2024-09-12T03:18:00.605272+0000, chain.objs.size()=1 2024-09-12T01:21:57.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.655__shadow_.MZ3jHVM08lwnyYiFGULn5iHuFcFcL_c_0 2024-09-12T01:21:57.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5689613006672044175', time=2024-09-12T03:18:34.347547+0000, chain.objs.size()=1 2024-09-12T01:21:57.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.706__shadow:Js6FxrXwCJxaKKg8naS5WK0q6QVTd.F_.v5DOYBW309kRTANtd7Xw2Gshc3BpDf4_0 2024-09-12T01:21:57.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12451478156478739310', time=2024-09-12T03:19:11.758240+0000, chain.objs.size()=1 2024-09-12T01:21:57.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.536+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.735__shadow_.YzWPXAbLrKFnkfY7zr9I7HBCpRzEDs0_0 2024-09-12T01:21:57.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.540+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:57.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.540+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:21:57.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.544+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:57.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.544+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:57.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.544+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45958' 2024-09-12T01:21:57.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.544+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12461167678523263520', time=2024-09-12T03:08:07.702514+0000, chain.objs.size()=1 2024-09-12T01:21:57.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.544+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.235__shadow_.rA8KpfcXEUJvY7SNdavXO_kmu3t0YaA_0 2024-09-12T01:21:57.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.544+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.323141954531802481', time=2024-09-12T03:08:23.359824+0000, chain.objs.size()=1 2024-09-12T01:21:57.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.544+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.255__shadow_.G3GQeWaAUeiqEN-ZMj4zrENF5JAzitb_0 2024-09-12T01:21:57.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.544+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9049161371215733261', time=2024-09-12T03:08:26.042645+0000, chain.objs.size()=1 2024-09-12T01:21:57.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.544+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.259__shadow_.bf_uBoRmdtuCqz904DUJQSa6XCvHYew_0 2024-09-12T01:21:57.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.544+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9664688916229618944', time=2024-09-12T03:08:47.457098+0000, chain.objs.size()=1 2024-09-12T01:21:57.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.544+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.A_5CwOYPjBK1Lp15VlcpRXwc44fQtGl_0 2024-09-12T01:21:57.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.544+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3992274508389039267', time=2024-09-12T03:08:47.569524+0000, chain.objs.size()=1 2024-09-12T01:21:57.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.544+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.OxtniBohNG0tdptObhocCXTqMzwFfyd_0 2024-09-12T01:21:57.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.544+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15324164161389950466', time=2024-09-12T03:08:47.660077+0000, chain.objs.size()=1 2024-09-12T01:21:57.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.544+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.w9ipRXeKRdeBLzozMH9wE2q-LbOPiyO_0 2024-09-12T01:21:57.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.544+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15954520214212712296', time=2024-09-12T03:08:47.667299+0000, chain.objs.size()=1 2024-09-12T01:21:57.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.544+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.OMIboReyc-PN4TmGDjhh85qBzI1oT0n_0 2024-09-12T01:21:57.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.544+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14574634727011131450', time=2024-09-12T03:08:47.855098+0000, chain.objs.size()=1 2024-09-12T01:21:57.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.544+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.wEfLd0Ny6YDD82OCvvFozfykf-mcQvl_0 2024-09-12T01:21:57.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.544+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3699468035735657149', time=2024-09-12T03:08:47.898404+0000, chain.objs.size()=1 2024-09-12T01:21:57.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.544+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.YcIZR3x9XzDRu8xOiYR8Ds9p3eLjq4T_0 2024-09-12T01:21:57.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.544+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13446559149269977382', time=2024-09-12T03:08:47.923725+0000, chain.objs.size()=1 2024-09-12T01:21:57.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.544+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.UtJHyHoxfDvV6OELYiJTr5-dpDev6-r_0 2024-09-12T01:21:57.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.544+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11199346942948848622', time=2024-09-12T03:08:47.981793+0000, chain.objs.size()=1 2024-09-12T01:21:57.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.544+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.3F-_V7aGmTGE16mVVLdgAPxPMCC8wWQ_0 2024-09-12T01:21:57.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.544+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13856333402401559936', time=2024-09-12T03:08:48.214278+0000, chain.objs.size()=1 2024-09-12T01:21:57.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.544+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.f4RMWdt9hECC3U6kzlh5RLeSRptJVq7_0 2024-09-12T01:21:57.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3651235096100802532', time=2024-09-12T03:08:48.279108+0000, chain.objs.size()=1 2024-09-12T01:21:57.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.xTTe8nPjp7mu764U_IfOBBZwL9u9CfQ_0 2024-09-12T01:21:57.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11010128884860544227', time=2024-09-12T03:08:48.315194+0000, chain.objs.size()=1 2024-09-12T01:21:57.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.3C9Rl2gBvVX8ZfcNkvLUICVhiMHOVhU_0 2024-09-12T01:21:57.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2983387213709619365', time=2024-09-12T03:08:48.328003+0000, chain.objs.size()=1 2024-09-12T01:21:57.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.s7RpT_rXHLGMCAWoTHc85oaKCAgSQe8_0 2024-09-12T01:21:57.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4669519296560521318', time=2024-09-12T03:08:48.328804+0000, chain.objs.size()=1 2024-09-12T01:21:57.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.gjsce3gqDE4JpYl0isHCwn_zYrM5w2r_0 2024-09-12T01:21:57.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2174073896471150275', time=2024-09-12T03:08:48.539970+0000, chain.objs.size()=1 2024-09-12T01:21:57.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.BK-9NN5XlC22Atg5yMZE5wgAzcM10st_0 2024-09-12T01:21:57.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16118096045287890880', time=2024-09-12T03:08:48.573858+0000, chain.objs.size()=1 2024-09-12T01:21:57.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.4lOLoJm8k-tVbUCKO8OTlblmd8OKeUr_0 2024-09-12T01:21:57.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4157369607987297614', time=2024-09-12T03:08:48.603410+0000, chain.objs.size()=1 2024-09-12T01:21:57.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.m0cTsAsmFpS45Z7bnxV8abJ2WaAFI5a_0 2024-09-12T01:21:57.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18389560403726318168', time=2024-09-12T03:08:48.617147+0000, chain.objs.size()=1 2024-09-12T01:21:57.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.XuPJ2f8wkxBtmVCLrvje6cg6dkR2c39_0 2024-09-12T01:21:57.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17153271073404135210', time=2024-09-12T03:08:48.640292+0000, chain.objs.size()=1 2024-09-12T01:21:57.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.DYI6G7oG_6gIf3Vg7LVH4VcOYusNLwL_0 2024-09-12T01:21:57.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8682584742539038768', time=2024-09-12T03:08:48.647364+0000, chain.objs.size()=1 2024-09-12T01:21:57.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.sAF-zrMUYFrW6pL-DLbU7hywpXubNRZ_0 2024-09-12T01:21:57.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1910900076042881168', time=2024-09-12T03:08:48.660332+0000, chain.objs.size()=1 2024-09-12T01:21:57.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.BnH_FWIYRImYrc500LKl96e-YdeFCAZ_0 2024-09-12T01:21:57.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8447677441922622692', time=2024-09-12T03:08:48.688963+0000, chain.objs.size()=1 2024-09-12T01:21:57.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.I6lHaAXKA8jYrOOudJkLR994_6lSoIE_0 2024-09-12T01:21:57.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13132269956116139961', time=2024-09-12T03:08:48.696423+0000, chain.objs.size()=1 2024-09-12T01:21:57.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.uCSVTPEAatyg2xMdpZHxI8yaBSccFE3_0 2024-09-12T01:21:57.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15443324063085697783', time=2024-09-12T03:08:48.942663+0000, chain.objs.size()=1 2024-09-12T01:21:57.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.miaXzIZAQnZpW2h4Hq74Kh-_vQzdbc0_0 2024-09-12T01:21:57.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16074281040222737144', time=2024-09-12T03:08:48.951640+0000, chain.objs.size()=1 2024-09-12T01:21:57.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.548+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.9DMHm7lCP2kzKIvTtlM0t-3aJKjqQwE_0 2024-09-12T01:21:57.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17651377796949221059', time=2024-09-12T03:08:48.981801+0000, chain.objs.size()=1 2024-09-12T01:21:57.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.omAYZxRo4-ccJdLoZYAU43MiMUFIRKp_0 2024-09-12T01:21:57.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7269202371469477350', time=2024-09-12T03:08:48.996107+0000, chain.objs.size()=1 2024-09-12T01:21:57.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.HAqD6Z1Y4RdUZ1Df7IvTlQ6huAtZz8o_0 2024-09-12T01:21:57.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10767266228945514961', time=2024-09-12T03:08:49.016915+0000, chain.objs.size()=1 2024-09-12T01:21:57.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.MIxiu_sOxVaRIbg-CFu_03qbcimNpRH_0 2024-09-12T01:21:57.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8243878233717637307', time=2024-09-12T03:08:49.190876+0000, chain.objs.size()=1 2024-09-12T01:21:57.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.1fM5oDTjMLF68E72tkatAFI1uz9ORE1_0 2024-09-12T01:21:57.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17548548764314363184', time=2024-09-12T03:08:49.274815+0000, chain.objs.size()=1 2024-09-12T01:21:57.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.tVIvSccsyf6PFmKJcdGIqStEND08Yny_0 2024-09-12T01:21:57.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3210665836796366223', time=2024-09-12T03:08:49.322390+0000, chain.objs.size()=1 2024-09-12T01:21:57.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.otuWE3XfrAQS4CM2Lnr4hTNbFt0VIyy_0 2024-09-12T01:21:57.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3319021178377279116', time=2024-09-12T03:08:49.345342+0000, chain.objs.size()=1 2024-09-12T01:21:57.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.-tB0xX4sEEPlOOoZ4Qjc35dSOIF11Zb_0 2024-09-12T01:21:57.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4625261708831991100', time=2024-09-12T03:08:49.552671+0000, chain.objs.size()=1 2024-09-12T01:21:57.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.8Ta62rhnhCC-xputu2ZeU2SUeE0vECS_0 2024-09-12T01:21:57.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3235813657665150144', time=2024-09-12T03:08:49.569699+0000, chain.objs.size()=1 2024-09-12T01:21:57.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.cDNEeK8OZ7RmX3xvK21hU358XLDck1__0 2024-09-12T01:21:57.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8683994237281445724', time=2024-09-12T03:08:49.644483+0000, chain.objs.size()=1 2024-09-12T01:21:57.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.djWoX8qFmcTOUatIJDQ6QvdWFXnnqIX_0 2024-09-12T01:21:57.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17384585219212382268', time=2024-09-12T03:08:49.663805+0000, chain.objs.size()=1 2024-09-12T01:21:57.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.-vGnGrPF1HpPdKtkmLMCR099yMbIduR_0 2024-09-12T01:21:57.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1041454768268797545', time=2024-09-12T03:08:49.688178+0000, chain.objs.size()=1 2024-09-12T01:21:57.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.fGU_IXqP4I8Kam5Qwclk8eQmnL2TKAC_0 2024-09-12T01:21:57.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14950315333816300202', time=2024-09-12T03:08:49.870048+0000, chain.objs.size()=1 2024-09-12T01:21:57.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.tQL3FFpqUT8RxYYw2ozqYEO8KIJtzMf_0 2024-09-12T01:21:57.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11957766277578483686', time=2024-09-12T03:08:49.906233+0000, chain.objs.size()=1 2024-09-12T01:21:57.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.uCtcQpNvhI45SNPBbY0ktnOybn_48rb_0 2024-09-12T01:21:57.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4926008420528297741', time=2024-09-12T03:08:49.932956+0000, chain.objs.size()=1 2024-09-12T01:21:57.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.dPeTUlC-KavjFZaQ9J6lx-HKd5tNU40_0 2024-09-12T01:21:57.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13500669823415051361', time=2024-09-12T03:08:49.940111+0000, chain.objs.size()=1 2024-09-12T01:21:57.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_._7Gacneci36NODGl1vmkEcgV4KNgofu_0 2024-09-12T01:21:57.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15291465524915404942', time=2024-09-12T03:08:50.006819+0000, chain.objs.size()=1 2024-09-12T01:21:57.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.fsNNYwIfSCWdP6DOw1rHRE4HXvZH15O_0 2024-09-12T01:21:57.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.326880913883244740', time=2024-09-12T03:08:50.046190+0000, chain.objs.size()=1 2024-09-12T01:21:57.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Jxm887-PuzCa-0r5fv_wIqFEg7_yZNU_0 2024-09-12T01:21:57.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11404239954739631345', time=2024-09-12T03:08:53.950091+0000, chain.objs.size()=1 2024-09-12T01:21:57.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.269__shadow_.Yaa3HEvDSR18n90hDuOM7l9a_OkaSLk_0 2024-09-12T01:21:57.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13784682118502826259', time=2024-09-12T03:08:56.671079+0000, chain.objs.size()=1 2024-09-12T01:21:57.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.273__shadow_.okLhMzh3eaa1W5AMG6w2nH_wkDGbLI6_0 2024-09-12T01:21:57.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13903934474388092939', time=2024-09-12T03:08:58.036475+0000, chain.objs.size()=1 2024-09-12T01:21:57.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.275__shadow_.ysWtUh9VylHnXl4G0MYjL3CcLjVGvc6_0 2024-09-12T01:21:57.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10028103689794140839', time=2024-09-12T03:08:58.703776+0000, chain.objs.size()=1 2024-09-12T01:21:57.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.552+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.276__shadow_.0UjNSgXJ38SarTC_PSpD0TRpl2xvOtj_0 2024-09-12T01:21:57.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16710198837896545751', time=2024-09-12T03:09:04.380288+0000, chain.objs.size()=1 2024-09-12T01:21:57.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.284__shadow_.A0R0e4naKtoraNqO1nuAljvywKTIXlT_0 2024-09-12T01:21:57.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6943971169581828499', time=2024-09-12T03:09:05.747765+0000, chain.objs.size()=1 2024-09-12T01:21:57.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.286__shadow_.k_5SZq1vwraB46YU-dTzJ0edyDNUyMh_0 2024-09-12T01:21:57.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9142567216959748439', time=2024-09-12T03:09:07.818384+0000, chain.objs.size()=1 2024-09-12T01:21:57.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.289__shadow_.WpoaCdM6hU4oEwp-bXKHF2UQYwzZjew_0 2024-09-12T01:21:57.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6624641996877057411', time=2024-09-12T03:09:11.606447+0000, chain.objs.size()=1 2024-09-12T01:21:57.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.293__shadow_.rB3EZDRTzissKCv90gqAgCvjvBkT8vc_0 2024-09-12T01:21:57.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2061806507002266517', time=2024-09-12T03:09:52.988950+0000, chain.objs.size()=1 2024-09-12T01:21:57.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.wlhU6Pd2KN9M_2g6HXDQBLeoXhSqZf4_0 2024-09-12T01:21:57.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13934422731596240175', time=2024-09-12T03:09:53.016016+0000, chain.objs.size()=1 2024-09-12T01:21:57.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.qnGHzdw_OGbjgP3lq5YAvfJ1woepwI8_0 2024-09-12T01:21:57.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9373186502488886035', time=2024-09-12T03:09:53.023952+0000, chain.objs.size()=1 2024-09-12T01:21:57.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.K-frtcDvuNVrSwHo4sY82yTVgIXBAy8_0 2024-09-12T01:21:57.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4381295845426664002', time=2024-09-12T03:09:53.029215+0000, chain.objs.size()=1 2024-09-12T01:21:57.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.oWgRGXaKCsunDga9Wne0qslY9gkDtBJ_0 2024-09-12T01:21:57.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17146228648465648627', time=2024-09-12T03:09:53.091793+0000, chain.objs.size()=1 2024-09-12T01:21:57.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.gyMO8BRS6v9h6NM9j0IBpjE0EjTrF5B_0 2024-09-12T01:21:57.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13751352172730060095', time=2024-09-12T03:09:53.630636+0000, chain.objs.size()=1 2024-09-12T01:21:57.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.X9w0jXXpEBXFCJvXLrY9D8a9yLEeF___0 2024-09-12T01:21:57.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5755704162787555377', time=2024-09-12T03:09:53.782577+0000, chain.objs.size()=1 2024-09-12T01:21:57.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.7GPsw0RgDhPNTar7qmnUzqqQ59Vztke_0 2024-09-12T01:21:57.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2402380068459701709', time=2024-09-12T03:09:53.802400+0000, chain.objs.size()=1 2024-09-12T01:21:57.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.svhH7IiDAgJIdglRwAzXyECs1hYl9tc_0 2024-09-12T01:21:57.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2696378869872164352', time=2024-09-12T03:09:54.074109+0000, chain.objs.size()=1 2024-09-12T01:21:57.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.FfUYsvJZVXCgmWPWhJzPTTts20-Uk0W_0 2024-09-12T01:21:57.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9772923710020103135', time=2024-09-12T03:09:54.120876+0000, chain.objs.size()=1 2024-09-12T01:21:57.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.cmdGJEGrUe2NCroqrFzanNiavEWzyqQ_0 2024-09-12T01:21:57.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13212804828761841512', time=2024-09-12T03:09:54.137917+0000, chain.objs.size()=1 2024-09-12T01:21:57.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.VWzydaYFFuc_BPS-JfaAPK8hnjxtLIs_0 2024-09-12T01:21:57.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17041300058325269529', time=2024-09-12T03:09:54.323623+0000, chain.objs.size()=1 2024-09-12T01:21:57.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.XR_HTgQlIZQQzNF6N9-ZKIyeMf-SvmY_0 2024-09-12T01:21:57.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14515787444261600949', time=2024-09-12T03:09:54.396370+0000, chain.objs.size()=1 2024-09-12T01:21:57.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.2_shUIzsnYtLXm7P0bI_s-X_PhAPH8x_0 2024-09-12T01:21:57.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6365582926904501033', time=2024-09-12T03:09:54.397221+0000, chain.objs.size()=1 2024-09-12T01:21:57.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.xl5okR4fx8ONLXqFmHwu0kRSGNihRvb_0 2024-09-12T01:21:57.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6155799942764427599', time=2024-09-12T03:09:54.418347+0000, chain.objs.size()=1 2024-09-12T01:21:57.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_._V1Gn9brb3RgFEYcLxYtV4VOhi2uEEr_0 2024-09-12T01:21:57.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6325510920639141649', time=2024-09-12T03:09:54.473286+0000, chain.objs.size()=1 2024-09-12T01:21:57.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.556+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Ebx1jTC8NtE7bZbF3y5AJ66KcVGfk5U_0 2024-09-12T01:21:57.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10877022571904560001', time=2024-09-12T03:09:54.621729+0000, chain.objs.size()=1 2024-09-12T01:21:57.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_._jzZlNlfpEKWKi-aqsDJOakmkSWygfv_0 2024-09-12T01:21:57.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17704952266001152762', time=2024-09-12T03:09:55.083548+0000, chain.objs.size()=1 2024-09-12T01:21:57.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.4mURORJckykhBDSow_wH6PcBAmD2Xww_0 2024-09-12T01:21:57.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4195614647569653683', time=2024-09-12T03:09:55.149064+0000, chain.objs.size()=1 2024-09-12T01:21:57.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.p-JN6VgptFijfIzU0qcH19qJqqwl17c_0 2024-09-12T01:21:57.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17819221194612381464', time=2024-09-12T03:09:55.166393+0000, chain.objs.size()=1 2024-09-12T01:21:57.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.kxhlRc_kWP9FSCAjQ4YPd8DtaS2RmfZ_0 2024-09-12T01:21:57.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8111179222140087226', time=2024-09-12T03:09:55.282060+0000, chain.objs.size()=1 2024-09-12T01:21:57.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.UryAIIUbLtwLhH7R5oxRfU5Zj-5xFDG_0 2024-09-12T01:21:57.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12717497818737503447', time=2024-09-12T03:09:55.361915+0000, chain.objs.size()=1 2024-09-12T01:21:57.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.QM5BhZghepp3UVruJxJTz6sYTrpmA_Y_0 2024-09-12T01:21:57.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8317542219466037009', time=2024-09-12T03:10:15.238682+0000, chain.objs.size()=1 2024-09-12T01:21:57.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.jPqOurXV_zXHh_ob5IzRoH6BAOFk369_0 2024-09-12T01:21:57.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13639942911557242837', time=2024-09-12T03:10:15.339740+0000, chain.objs.size()=1 2024-09-12T01:21:57.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Yb5A1EEpXLLRYbBllDX5vJQXfZv5J0p_0 2024-09-12T01:21:57.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3627135556103196449', time=2024-09-12T03:10:15.358859+0000, chain.objs.size()=1 2024-09-12T01:21:57.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.lUYZh1FkoctpcfAYo9zSmS78xvKnW_M_0 2024-09-12T01:21:57.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16112513211982395643', time=2024-09-12T03:10:15.390740+0000, chain.objs.size()=1 2024-09-12T01:21:57.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.mo8NRiuqZXf0hV8y6kCbZ21TaEf7mG5_0 2024-09-12T01:21:57.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8529243035328297900', time=2024-09-12T03:10:15.692225+0000, chain.objs.size()=1 2024-09-12T01:21:57.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.aR8-8Z0ZUlc44WznJku3XvyEczoRPA9_0 2024-09-12T01:21:57.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4865818123207900611', time=2024-09-12T03:10:15.704792+0000, chain.objs.size()=1 2024-09-12T01:21:57.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.RGkpAagtzLbKNfmfxureHSNotgcq5oF_0 2024-09-12T01:21:57.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10321039547202332560', time=2024-09-12T03:10:15.775108+0000, chain.objs.size()=1 2024-09-12T01:21:57.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.xEhpWH7tHNWF4dlN51jgHYDsXr3qaSN_0 2024-09-12T01:21:57.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16011368689440474069', time=2024-09-12T03:10:15.887409+0000, chain.objs.size()=1 2024-09-12T01:21:57.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.O2vsDrCZQwk4CgGxkgFoXFEub3BnT7l_0 2024-09-12T01:21:57.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15905605271383943521', time=2024-09-12T03:10:15.922948+0000, chain.objs.size()=1 2024-09-12T01:21:57.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.hfHHQsb8i9Visas5IF0IaocL7k_qnsC_0 2024-09-12T01:21:57.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1757555145433960347', time=2024-09-12T03:10:15.985806+0000, chain.objs.size()=1 2024-09-12T01:21:57.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.j7xvII5G5rr7i9PxIWOy2xLp1R8RxMC_0 2024-09-12T01:21:57.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3687985133915214544', time=2024-09-12T03:10:15.999666+0000, chain.objs.size()=1 2024-09-12T01:21:57.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.uBkEVkI2wwzRYQZcRizW5wCSMLwh9SU_0 2024-09-12T01:21:57.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10436252877792826584', time=2024-09-12T03:10:16.044418+0000, chain.objs.size()=1 2024-09-12T01:21:57.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.23GGhHSiHru2x_CxIcsSofs7QKrkkbs_0 2024-09-12T01:21:57.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15347975962096843179', time=2024-09-12T03:10:16.220245+0000, chain.objs.size()=1 2024-09-12T01:21:57.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.uRg-vNeo-8ivTzS_H_a6b3Z-_lVqLdz_0 2024-09-12T01:21:57.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2334626993956019766', time=2024-09-12T03:10:16.262717+0000, chain.objs.size()=1 2024-09-12T01:21:57.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.rYw5RcIpyqo5MkySDLELUuzuVdD8sE7_0 2024-09-12T01:21:57.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.121259603083782085', time=2024-09-12T03:10:16.332670+0000, chain.objs.size()=1 2024-09-12T01:21:57.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.560+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.WWa6UxQic5PuzXApOkjHJu2o9yv8KLe_0 2024-09-12T01:21:57.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.564+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6082753013353725170', time=2024-09-12T03:10:16.352102+0000, chain.objs.size()=1 2024-09-12T01:21:57.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.564+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.a6sX_JL8yguv5xQ2ifqTwkDuCegf8uk_0 2024-09-12T01:21:57.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.564+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3292233824665046526', time=2024-09-12T03:10:16.359801+0000, chain.objs.size()=1 2024-09-12T01:21:57.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.564+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.pL4JzQ_grDiwObCNUxSAV8U85VYcHm0_0 2024-09-12T01:21:57.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.564+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18162859499063987335', time=2024-09-12T03:10:16.584008+0000, chain.objs.size()=1 2024-09-12T01:21:57.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.564+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.OtaHxikDzSA2GCfHmDELRAUkpbsHvip_0 2024-09-12T01:21:57.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.564+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6876352247283961819', time=2024-09-12T03:10:16.603192+0000, chain.objs.size()=1 2024-09-12T01:21:57.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.564+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.FWLfOHZGRzrbIjQhgxfngLLz3KPsz7W_0 2024-09-12T01:21:57.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.564+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.929071796030515615', time=2024-09-12T03:10:16.788662+0000, chain.objs.size()=1 2024-09-12T01:21:57.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.564+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.DGU4egxh6_oOU4tkkZsU25UU2F9cIfp_0 2024-09-12T01:21:57.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.564+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1249924117791701843', time=2024-09-12T03:10:16.819218+0000, chain.objs.size()=1 2024-09-12T01:21:57.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.564+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.e12bAsBaiqNEPRff4sv2Ufe43HdyAdv_0 2024-09-12T01:21:57.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.564+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4656323378726129290', time=2024-09-12T03:10:16.834898+0000, chain.objs.size()=1 2024-09-12T01:21:57.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.564+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.m4KDcshkN4fFpsF6gjKHDBCR0hR-9T-_0 2024-09-12T01:21:57.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.564+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11844325077246908816', time=2024-09-12T03:10:16.883815+0000, chain.objs.size()=1 2024-09-12T01:21:57.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.564+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.TxeyFhxhFbBlr19te3S-arMpwDV8Dxp_0 2024-09-12T01:21:57.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.564+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7931183205312678477', time=2024-09-12T03:10:16.888427+0000, chain.objs.size()=1 2024-09-12T01:21:57.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.564+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.sdolRrW96ZBpxZJ509jJVJZb37SvyR0_0 2024-09-12T01:21:57.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.564+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4414312827368379052', time=2024-09-12T03:10:17.329216+0000, chain.objs.size()=1 2024-09-12T01:21:57.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.564+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Xx8BfJ4bIeSoEebp3ufZt4q8YD5O0GS_0 2024-09-12T01:21:57.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.568+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45958 2024-09-12T01:21:57.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.568+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T01:21:57.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.568+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13320952562883961083', time=2024-09-12T03:10:17.440154+0000, chain.objs.size()=1 2024-09-12T01:21:57.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.568+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Vo2A2ZefD-YeRGR0wF4FLRBRXHxBV0A_0 2024-09-12T01:21:57.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.568+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7639563492949702255', time=2024-09-12T03:10:17.847944+0000, chain.objs.size()=1 2024-09-12T01:21:57.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.568+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.dgZDPi9wjY7aU3CPi681A9aRmCQ10Og_0 2024-09-12T01:21:57.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.568+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17050792514990724194', time=2024-09-12T03:10:54.307443+0000, chain.objs.size()=1 2024-09-12T01:21:57.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.568+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.383__shadow_.DIoJcuf18nR3shZnLvH2iLEGHnuhV6o_0 2024-09-12T01:21:57.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.568+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17432200456111886453', time=2024-09-12T03:11:42.835349+0000, chain.objs.size()=1 2024-09-12T01:21:57.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.568+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.451__shadow_.J_NJYb7NK9D-CtXNKriGkOiorqcviTF_0 2024-09-12T01:21:57.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.568+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16166798821514371002', time=2024-09-12T03:12:05.003772+0000, chain.objs.size()=1 2024-09-12T01:21:57.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.568+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.484__shadow_.Hc1_CBja1NLlHDvoOnbr-bDohRZUBKq_0 2024-09-12T01:21:57.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.568+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18415583294522259112', time=2024-09-12T03:12:05.017721+0000, chain.objs.size()=1 2024-09-12T01:21:57.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.568+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.484__shadow_.Aj3TAgue5NJ2T5DYcYtrhnZ27LGtTZc_0 2024-09-12T01:21:57.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.568+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8721426709937346141', time=2024-09-12T03:12:56.943343+0000, chain.objs.size()=2 2024-09-12T01:21:57.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.568+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.524__multipart_mymultipart.2~IfK5jjDf56KP8CUVONvC68Oi559f8Cc.1 2024-09-12T01:21:57.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.568+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.524__multipart_mymultipart.2~IfK5jjDf56KP8CUVONvC68Oi559f8Cc.2 2024-09-12T01:21:57.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.568+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3184108244157600103', time=2024-09-12T03:13:52.039407+0000, chain.objs.size()=1 2024-09-12T01:21:57.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.568+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.555__shadow_.f_-eIjr5ha-XA_FkAXjU1FlERu9k0rR_0 2024-09-12T01:21:57.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.568+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8215696840823741196', time=2024-09-12T03:14:52.019188+0000, chain.objs.size()=1 2024-09-12T01:21:57.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.568+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.580__shadow:ir7VwJjRbuJ-0piQF7vguezTovJ1QVe_.xoexbHzJtrMipiiM__2LkGrlkVW2O5n_0 2024-09-12T01:21:57.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.568+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17652180833268666297', time=2024-09-12T03:17:51.151780+0000, chain.objs.size()=2 2024-09-12T01:21:57.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.568+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.644__shadow_.5WsoySOv9q_bmHd_Prp8lbUnjWAkk1p_0 2024-09-12T01:21:57.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.568+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.644__shadow_.5WsoySOv9q_bmHd_Prp8lbUnjWAkk1p_1 2024-09-12T01:21:57.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.572+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5768701814790107827', time=2024-09-12T03:18:12.197669+0000, chain.objs.size()=1 2024-09-12T01:21:57.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.572+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.669__shadow_.7piqnWRiXj4ypb9eV8ElNxb7cBKpHQl_0 2024-09-12T01:21:57.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.572+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3498876014229906739', time=2024-09-12T03:18:30.871992+0000, chain.objs.size()=1 2024-09-12T01:21:57.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.572+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.701__shadow:oQBJB2Bj7ySQ1N47mxSfFe72HmjfgS2_.nmGEchS1eay8Ot57KIPdmBqksk0tti__0 2024-09-12T01:21:57.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.572+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:57.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:21:57.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:57.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:57.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44427' 2024-09-12T01:21:57.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.525267231231083043', time=2024-09-12T03:08:08.431732+0000, chain.objs.size()=1 2024-09-12T01:21:57.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.236__shadow_.pUSWoWbOhztIKaxcO-VVdrJzwnBpRlK_0 2024-09-12T01:21:57.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15786580294994191353', time=2024-09-12T03:08:12.767009+0000, chain.objs.size()=1 2024-09-12T01:21:57.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.241__shadow_.KtqS6ZJuKTexGWCsuy2jWrZqUrviCF6_0 2024-09-12T01:21:57.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17146934452407066578', time=2024-09-12T03:08:26.043520+0000, chain.objs.size()=1 2024-09-12T01:21:57.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.259__shadow_.vcnBm-Mc6-kvpSA-5k5EiH05J74zRjo_0 2024-09-12T01:21:57.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4056107797560634992', time=2024-09-12T03:08:47.491424+0000, chain.objs.size()=1 2024-09-12T01:21:57.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.YhmIeEuVdmEH9v_gb7ZtZ56Oz06TJu3_0 2024-09-12T01:21:57.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.924183445044066919', time=2024-09-12T03:08:47.609247+0000, chain.objs.size()=1 2024-09-12T01:21:57.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.5WNJ3hvhNcEDWUegVKoy3hD8dVHQqZ4_0 2024-09-12T01:21:57.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14678449597646495282', time=2024-09-12T03:08:47.667449+0000, chain.objs.size()=1 2024-09-12T01:21:57.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.-sXcVw_HWPSddYBTteZqnj3GjelL3Zs_0 2024-09-12T01:21:57.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4575526689267682531', time=2024-09-12T03:08:47.816393+0000, chain.objs.size()=1 2024-09-12T01:21:57.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.cQdXOA2dY0pU9SMIe8MGKMKk73wT-Ti_0 2024-09-12T01:21:57.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2339585789399845027', time=2024-09-12T03:08:47.828739+0000, chain.objs.size()=1 2024-09-12T01:21:57.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.HZg35z4fjJmTBSIosi1uGEThqfYvEOy_0 2024-09-12T01:21:57.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2470067659232070323', time=2024-09-12T03:08:47.842635+0000, chain.objs.size()=1 2024-09-12T01:21:57.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.cfzqPi9uyUI813y5AHrIicMgnU1PgY2_0 2024-09-12T01:21:57.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3146876807609106828', time=2024-09-12T03:08:47.949737+0000, chain.objs.size()=1 2024-09-12T01:21:57.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.eBkSJQCkD2JkxZvQCdnNR4Iy9kucQT-_0 2024-09-12T01:21:57.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10740302750131113223', time=2024-09-12T03:08:47.976118+0000, chain.objs.size()=1 2024-09-12T01:21:57.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_._U47iDo7YZNHNjtAIihYZDALs2FJU52_0 2024-09-12T01:21:57.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2777649549188112717', time=2024-09-12T03:08:47.977828+0000, chain.objs.size()=1 2024-09-12T01:21:57.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.576+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Av16x17oIjWlU_XjowQjxuUVaw_Jveq_0 2024-09-12T01:21:57.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11233782071912295765', time=2024-09-12T03:08:47.987271+0000, chain.objs.size()=1 2024-09-12T01:21:57.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.lNDqkLHcaBfr8mlGu2uwvBu4DitEGXP_0 2024-09-12T01:21:57.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15779992798699202355', time=2024-09-12T03:08:48.163863+0000, chain.objs.size()=1 2024-09-12T01:21:57.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.IdthdfjfCAnFwx9tumeZmGIMM78Xtel_0 2024-09-12T01:21:57.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9009987395952357570', time=2024-09-12T03:08:48.169103+0000, chain.objs.size()=1 2024-09-12T01:21:57.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.NlCwIZlYbMIZYY7Jn_iYYYv0sdGFQU3_0 2024-09-12T01:21:57.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13202232151450954734', time=2024-09-12T03:08:48.246454+0000, chain.objs.size()=1 2024-09-12T01:21:57.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.fBE5qBbRs48nmFVs64RgW6TZ6tTEvsZ_0 2024-09-12T01:21:57.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11703107592801943079', time=2024-09-12T03:08:48.288095+0000, chain.objs.size()=1 2024-09-12T01:21:57.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Gbp7QuqJhLm4lj25Gv_ZthHSnS2h7Uf_0 2024-09-12T01:21:57.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7009507469562763120', time=2024-09-12T03:08:48.288870+0000, chain.objs.size()=1 2024-09-12T01:21:57.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.sBjLc_JmtBYULJoNtabZPdU1134RCBn_0 2024-09-12T01:21:57.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11300936842052236031', time=2024-09-12T03:08:48.322010+0000, chain.objs.size()=1 2024-09-12T01:21:57.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.fTLaOoJES6e8F8Bkf93rXMmxrR118-W_0 2024-09-12T01:21:57.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17442546136182372966', time=2024-09-12T03:08:48.322665+0000, chain.objs.size()=1 2024-09-12T01:21:57.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.CS4itS4S6VeBpWxZOrl82XBjgDm_RWl_0 2024-09-12T01:21:57.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10255237064540231783', time=2024-09-12T03:08:48.499471+0000, chain.objs.size()=1 2024-09-12T01:21:57.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.1HnMOTCpaTUSg97BBlqaC8sXzCuRYyS_0 2024-09-12T01:21:57.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14986320646391067285', time=2024-09-12T03:08:48.509137+0000, chain.objs.size()=1 2024-09-12T01:21:57.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.li4onCqrZOLgreg9bnEuMIGeWDsqAcM_0 2024-09-12T01:21:57.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9150700696683452520', time=2024-09-12T03:08:48.589599+0000, chain.objs.size()=1 2024-09-12T01:21:57.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.gn9HjT8jJdnx7iHuKyv7V0CUA_uUCNw_0 2024-09-12T01:21:57.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16987246198452180118', time=2024-09-12T03:08:48.590763+0000, chain.objs.size()=1 2024-09-12T01:21:57.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.RS6l0L5_5w3N5rbgu_8fPzJq6qilNVa_0 2024-09-12T01:21:57.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8508155010378634438', time=2024-09-12T03:08:48.595837+0000, chain.objs.size()=1 2024-09-12T01:21:57.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.I1f02-43Pk87Kwu4dDCbiCek7rlD6CI_0 2024-09-12T01:21:57.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13226173382010149757', time=2024-09-12T03:08:48.597496+0000, chain.objs.size()=1 2024-09-12T01:21:57.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.c_YCOVQZZ6497bfdixFjZwaPdgJ81mT_0 2024-09-12T01:21:57.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5931454182521532237', time=2024-09-12T03:08:48.610942+0000, chain.objs.size()=1 2024-09-12T01:21:57.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.eu_GE9BlZCwYWW95EvUXJ3y6byTJWN4_0 2024-09-12T01:21:57.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16495161628822794687', time=2024-09-12T03:08:48.644082+0000, chain.objs.size()=1 2024-09-12T01:21:57.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.CibjTvjfAMkPt97fdjajcQeTrDeIM2s_0 2024-09-12T01:21:57.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10663459935426960411', time=2024-09-12T03:08:48.683043+0000, chain.objs.size()=1 2024-09-12T01:21:57.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.3btm_JnxgSjU_EWyekqnLbLz3gpdldE_0 2024-09-12T01:21:57.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16816274362931413054', time=2024-09-12T03:08:48.886555+0000, chain.objs.size()=1 2024-09-12T01:21:57.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.kUvpEyZakXsRREAGynmz_AK6eZAc9YO_0 2024-09-12T01:21:57.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4752901153506942089', time=2024-09-12T03:08:48.889411+0000, chain.objs.size()=1 2024-09-12T01:21:57.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.uFAo4VRaN4L4S8MwlPetKCI0rEcRJCJ_0 2024-09-12T01:21:57.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16396765653455827719', time=2024-09-12T03:08:49.173262+0000, chain.objs.size()=1 2024-09-12T01:21:57.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.9Ry6SUWbQNkE61Qpyy9V_nhfTc76C1L_0 2024-09-12T01:21:57.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15698616859648533389', time=2024-09-12T03:08:49.204635+0000, chain.objs.size()=1 2024-09-12T01:21:57.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.YRPm5v7zMmMZY1uK6XFoIc2YxNTcdD3_0 2024-09-12T01:21:57.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.23569055845670599', time=2024-09-12T03:08:49.382298+0000, chain.objs.size()=1 2024-09-12T01:21:57.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.580+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.sDtMVKvbcE8DRE49XLEOPJs_rF9741h_0 2024-09-12T01:21:57.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8065098202514299331', time=2024-09-12T03:08:49.583470+0000, chain.objs.size()=1 2024-09-12T01:21:57.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.tPP45nxYid2KXgAUZ8jubL3GWRG4Ojb_0 2024-09-12T01:21:57.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.715318193075116194', time=2024-09-12T03:08:49.879393+0000, chain.objs.size()=1 2024-09-12T01:21:57.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.rSdGfIA1ORgkjN22i6abD7_yK-nbaPk_0 2024-09-12T01:21:57.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13886947470923762983', time=2024-09-12T03:08:49.922643+0000, chain.objs.size()=1 2024-09-12T01:21:57.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.pKuVc5N6V_QM2cnlboVkuNH20VQHX7u_0 2024-09-12T01:21:57.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3906772780730312346', time=2024-09-12T03:08:49.976437+0000, chain.objs.size()=1 2024-09-12T01:21:57.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.o44_h7Th3ql9BBDOu30ezi1s6kPKugW_0 2024-09-12T01:21:57.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14941821404731545077', time=2024-09-12T03:08:50.661272+0000, chain.objs.size()=1 2024-09-12T01:21:57.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.264__shadow_.5pXt2FCnKSThXDJFSOQYZBUyVaWzl6V_0 2024-09-12T01:21:57.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6311647385716386916', time=2024-09-12T03:08:51.317452+0000, chain.objs.size()=1 2024-09-12T01:21:57.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.265__shadow_.aL-9uufLtEJLegOPNb3gUiWUazEzDwn_0 2024-09-12T01:21:57.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17689700170170406917', time=2024-09-12T03:09:04.383598+0000, chain.objs.size()=1 2024-09-12T01:21:57.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.284__shadow_.d3RDO99f_hdvla-FBckW1rHkS6Ky4BA_0 2024-09-12T01:21:57.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12847604829480621263', time=2024-09-12T03:09:11.613007+0000, chain.objs.size()=1 2024-09-12T01:21:57.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.293__shadow_.9y1F0iBz8GH91fBQvkDB4tNDNDmFL-3_0 2024-09-12T01:21:57.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1213352773489983961', time=2024-09-12T03:09:14.422448+0000, chain.objs.size()=1 2024-09-12T01:21:57.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.296__shadow_.6mRvuiRhz4ITgQW-XIgGrKUC7yYaWcI_0 2024-09-12T01:21:57.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9297656471991739777', time=2024-09-12T03:09:31.766148+0000, chain.objs.size()=1 2024-09-12T01:21:57.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.320__shadow:UVAaLJJcPWGvoFLjU4V0sCsshn41uxD_.2ZGQZ_PTKU6ybrF9qYXdPUnlHB3e9yr_0 2024-09-12T01:21:57.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6710053377044209363', time=2024-09-12T03:09:52.980122+0000, chain.objs.size()=1 2024-09-12T01:21:57.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.GetNGs4K69fI2eVvw-K2--QkJK3ZEhE_0 2024-09-12T01:21:57.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11330306721826902250', time=2024-09-12T03:09:53.009798+0000, chain.objs.size()=1 2024-09-12T01:21:57.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.HEllS5mDGqfIl81GaK0ELu4seQXxps-_0 2024-09-12T01:21:57.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2356946494450521490', time=2024-09-12T03:09:53.036353+0000, chain.objs.size()=1 2024-09-12T01:21:57.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.1qPBfRctKEmaOVTccSviEd4aCbHG1y5_0 2024-09-12T01:21:57.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3994673229887683820', time=2024-09-12T03:09:53.072838+0000, chain.objs.size()=1 2024-09-12T01:21:57.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.WS-nXlaghnGyAbU8X7wPYh5HchisnNn_0 2024-09-12T01:21:57.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14765531509826151764', time=2024-09-12T03:09:53.110084+0000, chain.objs.size()=1 2024-09-12T01:21:57.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.UnYNXi-WnNSKzK-5vNs8K9i8bHsxCY3_0 2024-09-12T01:21:57.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11095101253657573036', time=2024-09-12T03:09:53.279718+0000, chain.objs.size()=1 2024-09-12T01:21:57.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.584+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.hcVFF9OKZn_C6ginPqBWZcXAnLErkf2_0 2024-09-12T01:21:57.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9133754811410296155', time=2024-09-12T03:09:53.350794+0000, chain.objs.size()=1 2024-09-12T01:21:57.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.qm1cYaUIYvGI1dkKaWHbdGHsYvogdTo_0 2024-09-12T01:21:57.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14304342840235919741', time=2024-09-12T03:09:53.425359+0000, chain.objs.size()=1 2024-09-12T01:21:57.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.8D5wVzJ8sPWDridFyyGh6hJkC0WWD0m_0 2024-09-12T01:21:57.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2997432283288184353', time=2024-09-12T03:09:53.441348+0000, chain.objs.size()=1 2024-09-12T01:21:57.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.N7V3tk7kK7IvT20nreLGycakt5K4_IK_0 2024-09-12T01:21:57.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2487714911710708741', time=2024-09-12T03:09:53.711487+0000, chain.objs.size()=1 2024-09-12T01:21:57.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.xfxJmJFZzxjGzQOr2X3ycnjJ_StrO3H_0 2024-09-12T01:21:57.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17478704084499354283', time=2024-09-12T03:09:53.713868+0000, chain.objs.size()=1 2024-09-12T01:21:57.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.8nq5EJUdx-UqfYN7NAMGOERJM-Jiw0d_0 2024-09-12T01:21:57.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.647703346733109308', time=2024-09-12T03:09:53.733425+0000, chain.objs.size()=1 2024-09-12T01:21:57.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.4paVTVe4OwZ09c8jddEXKJ-8wBfKGLv_0 2024-09-12T01:21:57.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11510898517557519948', time=2024-09-12T03:09:53.760758+0000, chain.objs.size()=1 2024-09-12T01:21:57.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.s_v7C4ox3VgSLPUeGV9C5-ysSnGEV3a_0 2024-09-12T01:21:57.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7834478208310029052', time=2024-09-12T03:09:53.776981+0000, chain.objs.size()=1 2024-09-12T01:21:57.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.UJC6w-4wBCLGOlNT0nmCyxHhWnBhC6o_0 2024-09-12T01:21:57.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3410497398326652573', time=2024-09-12T03:09:53.836508+0000, chain.objs.size()=1 2024-09-12T01:21:57.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.xAW6vIUzjeWVtdn-Z5ijCFazVTcJgP2_0 2024-09-12T01:21:57.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8747172895299901229', time=2024-09-12T03:09:54.003399+0000, chain.objs.size()=1 2024-09-12T01:21:57.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.KuB-yGuLO6QrS8F-XQxJgiXBPiXbWLs_0 2024-09-12T01:21:57.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8427843937345158635', time=2024-09-12T03:09:54.032601+0000, chain.objs.size()=1 2024-09-12T01:21:57.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.b8hNwfgb3aq5XK_gFaokw4NH4DutKbc_0 2024-09-12T01:21:57.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3740142959195731254', time=2024-09-12T03:09:54.083167+0000, chain.objs.size()=1 2024-09-12T01:21:57.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.sCDEcOTX8rozA0RYY3xOYWvKxavIYY2_0 2024-09-12T01:21:57.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16600325733190353842', time=2024-09-12T03:09:54.314685+0000, chain.objs.size()=1 2024-09-12T01:21:57.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.aApd7PiegL2mroPlxNpDYwHgCkr85c__0 2024-09-12T01:21:57.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.948334754835093473', time=2024-09-12T03:09:54.385333+0000, chain.objs.size()=1 2024-09-12T01:21:57.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.3DEfxlKxSSDj2Nb0LgQ9N0B7NUg1hZy_0 2024-09-12T01:21:57.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8012252101191062056', time=2024-09-12T03:09:54.389358+0000, chain.objs.size()=1 2024-09-12T01:21:57.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.CP00S7XmzJTMGN5WXyide1zdbOGyZIu_0 2024-09-12T01:21:57.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16142704111245300522', time=2024-09-12T03:09:54.420214+0000, chain.objs.size()=1 2024-09-12T01:21:57.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.p3r8IRN3ZB1SxJCpVw8QJFvwz6_yWGb_0 2024-09-12T01:21:57.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12495885637591405281', time=2024-09-12T03:09:54.420971+0000, chain.objs.size()=1 2024-09-12T01:21:57.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.qLtum8iwBmkESXuPQ0Hm6L_HqHVLD2O_0 2024-09-12T01:21:57.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17258994086239625757', time=2024-09-12T03:09:54.472960+0000, chain.objs.size()=1 2024-09-12T01:21:57.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.QtCdK-72Jf4urromfltCSxI6ArpwzsZ_0 2024-09-12T01:21:57.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2355093820039595312', time=2024-09-12T03:09:54.689553+0000, chain.objs.size()=1 2024-09-12T01:21:57.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.cLUo6-1-M8DMfsesSFxwL_DIcuKyvN2_0 2024-09-12T01:21:57.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9935349535275128918', time=2024-09-12T03:09:54.742336+0000, chain.objs.size()=1 2024-09-12T01:21:57.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.9bMdyY_Gx9K9HBI7iY1RpKHFEY9x8pr_0 2024-09-12T01:21:57.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11841794183537883472', time=2024-09-12T03:09:54.763535+0000, chain.objs.size()=1 2024-09-12T01:21:57.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.JegWBau32dtcVYynmr9DN2g22YXKfY2_0 2024-09-12T01:21:57.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.55414481800186993', time=2024-09-12T03:09:54.950911+0000, chain.objs.size()=1 2024-09-12T01:21:57.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_._9xZEQ2KOxZFoh46d7hzsVpnKHpHl6C_0 2024-09-12T01:21:57.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3108988457114508600', time=2024-09-12T03:09:55.010483+0000, chain.objs.size()=1 2024-09-12T01:21:57.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.588+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.DZaZNqGvBPUMoCot8vWKuq-ybkfuj31_0 2024-09-12T01:21:57.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13904542174066316491', time=2024-09-12T03:09:55.013051+0000, chain.objs.size()=1 2024-09-12T01:21:57.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.4Rqd6t5bEkOotg59TNVYGFGBL5tmgpx_0 2024-09-12T01:21:57.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15066804090695920392', time=2024-09-12T03:09:55.033877+0000, chain.objs.size()=1 2024-09-12T01:21:57.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.MTv_ScuhQPspPF0kn97E8e7LxFu_oWK_0 2024-09-12T01:21:57.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13396704846793006929', time=2024-09-12T03:09:55.048506+0000, chain.objs.size()=1 2024-09-12T01:21:57.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.TPPglILRiXi38H_P7qAKsrehs8YI8gF_0 2024-09-12T01:21:57.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4278291473674802777', time=2024-09-12T03:09:55.115133+0000, chain.objs.size()=1 2024-09-12T01:21:57.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.R8wsk_j81oGRCiIbQfweqc_K0GIz8hB_0 2024-09-12T01:21:57.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7889398015528334336', time=2024-09-12T03:09:55.307013+0000, chain.objs.size()=1 2024-09-12T01:21:57.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.LjCIdER3hB9lcApmbF0ZVj5f6sj-S1I_0 2024-09-12T01:21:57.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12415907435718163096', time=2024-09-12T03:09:55.308928+0000, chain.objs.size()=1 2024-09-12T01:21:57.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.bL7y7r8G0wokSC0g9DFVVjbFoj0Qy2u_0 2024-09-12T01:21:57.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13332836879784096160', time=2024-09-12T03:09:55.342397+0000, chain.objs.size()=1 2024-09-12T01:21:57.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.VLjd8GYVi9qXsYwKQ2bH-QK_uwpSRGY_0 2024-09-12T01:21:57.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15067115093859041111', time=2024-09-12T03:09:55.376937+0000, chain.objs.size()=1 2024-09-12T01:21:57.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.5U8g53PCPU0NzTc4_-JV1W8EiZyim5c_0 2024-09-12T01:21:57.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14000172205357142294', time=2024-09-12T03:10:15.317292+0000, chain.objs.size()=1 2024-09-12T01:21:57.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.-_eBTmPhh09MJ0ebwIpnmm1yfNtH62V_0 2024-09-12T01:21:57.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6703153239043254007', time=2024-09-12T03:10:15.354723+0000, chain.objs.size()=1 2024-09-12T01:21:57.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.MkgneIuzdoiAuHUVPZeCtAmrnpIEdhA_0 2024-09-12T01:21:57.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1814060894621909685', time=2024-09-12T03:10:15.607567+0000, chain.objs.size()=1 2024-09-12T01:21:57.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.qPfE6VA5JYINPLBzy3VSba7bmItCJ5X_0 2024-09-12T01:21:57.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1153995708492901702', time=2024-09-12T03:10:15.646329+0000, chain.objs.size()=1 2024-09-12T01:21:57.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.-MDF8nHAy8MIwJRrZgabGbsKXmpl2Kz_0 2024-09-12T01:21:57.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13901319183911247889', time=2024-09-12T03:10:15.650651+0000, chain.objs.size()=1 2024-09-12T01:21:57.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.IihUUOnKMDy-03zRvC8yrScjZQGFOma_0 2024-09-12T01:21:57.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12742447644359521674', time=2024-09-12T03:10:15.703953+0000, chain.objs.size()=1 2024-09-12T01:21:57.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.S9QEtoFCmWpLMH63T2tMcgqfr_oDaNE_0 2024-09-12T01:21:57.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10553956572316296483', time=2024-09-12T03:10:15.760328+0000, chain.objs.size()=1 2024-09-12T01:21:57.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.592+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.joRuDhpw6TUGPSt0rzWDiXfbGn-_D5K_0 2024-09-12T01:21:57.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.596+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6984053797384428421', time=2024-09-12T03:10:16.039344+0000, chain.objs.size()=1 2024-09-12T01:21:57.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.596+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.kMSjb21IIkSM5HLOnLDAfXU_5J6SqWa_0 2024-09-12T01:21:57.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.596+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12680114674166991634', time=2024-09-12T03:10:16.078373+0000, chain.objs.size()=1 2024-09-12T01:21:57.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.596+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Fq_jrAHDspA3j17aPkuN84AvMU6XKeZ_0 2024-09-12T01:21:57.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.596+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16455840420928361316', time=2024-09-12T03:10:16.228957+0000, chain.objs.size()=1 2024-09-12T01:21:57.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.596+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.96Wq7FmO15TBvNo9PRqi1wOPQkpipbg_0 2024-09-12T01:21:57.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.596+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9959598524124276983', time=2024-09-12T03:10:16.263143+0000, chain.objs.size()=1 2024-09-12T01:21:57.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.596+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.NZ7pxsWf3wWVCKD7choJwQze0pRD8CE_0 2024-09-12T01:21:57.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.596+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5784908914809872261', time=2024-09-12T03:10:16.275265+0000, chain.objs.size()=1 2024-09-12T01:21:57.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.596+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.kfTZgxE-eedmBVwDQY5ramLQtmSlx8a_0 2024-09-12T01:21:57.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.596+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3556222855592828928', time=2024-09-12T03:10:16.321107+0000, chain.objs.size()=1 2024-09-12T01:21:57.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.596+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.6Wrrl9Bg-onTcwAMlV1YwimEoRgcEWY_0 2024-09-12T01:21:57.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.596+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1943982492323399128', time=2024-09-12T03:10:16.356292+0000, chain.objs.size()=1 2024-09-12T01:21:57.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.596+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.pMtXbqm3r0PILl-8EkvlDt-_rMk51FQ_0 2024-09-12T01:21:57.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.596+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10190292523341658095', time=2024-09-12T03:10:16.628953+0000, chain.objs.size()=1 2024-09-12T01:21:57.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.596+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.8oA3B7gLbZ1Ejm3rV6Lk4vJOrNwCHyd_0 2024-09-12T01:21:57.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.596+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11031645422050632921', time=2024-09-12T03:10:16.779249+0000, chain.objs.size()=1 2024-09-12T01:21:57.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.596+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.plrLm5vCtUKDFHk22Q4ZIYIavQCpj2y_0 2024-09-12T01:21:57.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.596+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16491501199267934538', time=2024-09-12T03:10:16.798043+0000, chain.objs.size()=1 2024-09-12T01:21:57.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.596+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.YscXDFbt-B9X2xNJ7y3Ms4WH6llfQWf_0 2024-09-12T01:21:57.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.596+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18006879810886615019', time=2024-09-12T03:10:16.861587+0000, chain.objs.size()=1 2024-09-12T01:21:57.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.596+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.HmZTbExhk_ZwSmNA63Q4C8U7khCSPXQ_0 2024-09-12T01:21:57.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.596+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9052865599042332345', time=2024-09-12T03:10:16.879069+0000, chain.objs.size()=1 2024-09-12T01:21:57.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.596+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.twD4CNU-q5vCNDHBw5llzQvHu70Sjsy_0 2024-09-12T01:21:57.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.596+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44427 2024-09-12T01:21:57.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=34, truncated=0, next_marker='' 2024-09-12T01:21:57.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7760591299129571620', time=2024-09-12T03:10:16.925417+0000, chain.objs.size()=1 2024-09-12T01:21:57.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Jdq9KXQRRLgczy9f_xThdbCNRjKKwXT_0 2024-09-12T01:21:57.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18254942523183878637', time=2024-09-12T03:10:16.967359+0000, chain.objs.size()=1 2024-09-12T01:21:57.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.QxZQra3SQiI8s0TumTbdN0-oHjvW3ia_0 2024-09-12T01:21:57.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13461674515894381170', time=2024-09-12T03:10:17.120595+0000, chain.objs.size()=1 2024-09-12T01:21:57.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_._RZSjbJFhi1zikt6YSHQfvNws0_GcFj_0 2024-09-12T01:21:57.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15517386974960781736', time=2024-09-12T03:10:17.152107+0000, chain.objs.size()=1 2024-09-12T01:21:57.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.BxDKqmZtUn4vCBVY62g5K6Cnx5VMApm_0 2024-09-12T01:21:57.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6623739243521560765', time=2024-09-12T03:10:17.165686+0000, chain.objs.size()=1 2024-09-12T01:21:57.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.pXRC2p9z3FtzwfdZKQeqptyGEVFSAZi_0 2024-09-12T01:21:57.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4310273141353075203', time=2024-09-12T03:10:17.167575+0000, chain.objs.size()=1 2024-09-12T01:21:57.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.vQ86NhILoo7DDRaqSmf1g1c6-tzoI6W_0 2024-09-12T01:21:57.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12881224941219595881', time=2024-09-12T03:10:17.196352+0000, chain.objs.size()=1 2024-09-12T01:21:57.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.51khQmlh4hNCAsT5crMi-vaAmeEQAT6_0 2024-09-12T01:21:57.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14700633633812421766', time=2024-09-12T03:10:17.256650+0000, chain.objs.size()=1 2024-09-12T01:21:57.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.xNOrOzBn4KWNUy2YLd_jb6ZxekdASzC_0 2024-09-12T01:21:57.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.205780805658106965', time=2024-09-12T03:10:17.269251+0000, chain.objs.size()=1 2024-09-12T01:21:57.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.22bCmMfkUQXLxGlWaRp1eWXWl-o2TCQ_0 2024-09-12T01:21:57.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4334961334847387181', time=2024-09-12T03:10:17.274141+0000, chain.objs.size()=1 2024-09-12T01:21:57.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.yxO6VtltQxQErMhsld5R8m2wv-jCkIC_0 2024-09-12T01:21:57.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14651560499657783652', time=2024-09-12T03:10:17.339574+0000, chain.objs.size()=1 2024-09-12T01:21:57.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.JtWYZ_kKpCAMfG9fDApiZR_IwkBMZlR_0 2024-09-12T01:21:57.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7012236562531113999', time=2024-09-12T03:10:17.552768+0000, chain.objs.size()=1 2024-09-12T01:21:57.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.xK9Csxy4TBOajLSI36Lsqb1PzGLJO3p_0 2024-09-12T01:21:57.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12829658382943836367', time=2024-09-12T03:10:17.614546+0000, chain.objs.size()=1 2024-09-12T01:21:57.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.130GV-LWUOiE2Q_XVSLc5WPgpQSuAak_0 2024-09-12T01:21:57.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5284790827307885799', time=2024-09-12T03:10:17.757035+0000, chain.objs.size()=1 2024-09-12T01:21:57.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Fdk9ZPX10OR1XAECUfkctl5qCPhk6VZ_0 2024-09-12T01:21:57.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3871080221531535177', time=2024-09-12T03:10:17.858556+0000, chain.objs.size()=1 2024-09-12T01:21:57.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.pk1tDwAdPAGdKSauAckyRiB0lmaF9zi_0 2024-09-12T01:21:57.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.962615181873322255', time=2024-09-12T03:10:27.102182+0000, chain.objs.size()=1 2024-09-12T01:21:57.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.340__shadow_.Ne7m3F5p0a0mQTrfrw0vniKN-4AN_H7_0 2024-09-12T01:21:57.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5416026594354173981', time=2024-09-12T03:11:30.082906+0000, chain.objs.size()=1 2024-09-12T01:21:57.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.434__shadow_.HGs8YK08vbvB4GNF0nLZ6Vxv3w5QPV5_0 2024-09-12T01:21:57.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10731028352809173437', time=2024-09-12T03:11:36.162902+0000, chain.objs.size()=1 2024-09-12T01:21:57.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.600+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.443__shadow_.Xtx137CnSZmXnnzKQQIkWBqlRk3pZ3V_0 2024-09-12T01:21:57.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18041852594506027019', time=2024-09-12T03:11:37.894881+0000, chain.objs.size()=1 2024-09-12T01:21:57.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.445__shadow_.-H4RJoPUmpvVISqeNH2OLE0jw9QhtrM_0 2024-09-12T01:21:57.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5335408420165900560', time=2024-09-12T03:11:49.479624+0000, chain.objs.size()=1 2024-09-12T01:21:57.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.459__shadow_.oImtuuSCzBqEK_otC9uMzx2aETmqKJ9_0 2024-09-12T01:21:57.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10416702042257523170', time=2024-09-12T03:12:07.364723+0000, chain.objs.size()=1 2024-09-12T01:21:57.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.487__shadow_.iHeJsoQ4g_svHFF6-zOO5O9xrOgN_TZ_0 2024-09-12T01:21:57.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6127416251032841176', time=2024-09-12T03:12:08.132013+0000, chain.objs.size()=1 2024-09-12T01:21:57.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.488__shadow_.XPwXWOitzel9dU4VXOwrSVzRsZxPwBV_0 2024-09-12T01:21:57.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5194429823671326543', time=2024-09-12T03:13:00.155861+0000, chain.objs.size()=3 2024-09-12T01:21:57.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.526__multipart_mymultipart.2~Sn9OWlM7l2lVjBh5Ise6AS0FRCz2DeR.1 2024-09-12T01:21:57.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.526__multipart_mymultipart.2~Sn9OWlM7l2lVjBh5Ise6AS0FRCz2DeR.2 2024-09-12T01:21:57.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.526__multipart_mymultipart.2~Sn9OWlM7l2lVjBh5Ise6AS0FRCz2DeR.3 2024-09-12T01:21:57.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14728605084914515338', time=2024-09-12T03:13:47.440822+0000, chain.objs.size()=1 2024-09-12T01:21:57.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.551__shadow_.IkoDUZCSBm0VTHcvQtCxagslOSSsNQG_0 2024-09-12T01:21:57.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11332519469786300197', time=2024-09-12T03:14:23.777312+0000, chain.objs.size()=1 2024-09-12T01:21:57.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.575__shadow:jzI8Uvq--J38NP2x6SYe5ne3Tgbh6op_.dCZUN3ROe_Fw7792Hj-zL5B8NN2fWzU_0 2024-09-12T01:21:57.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2385192898625631270', time=2024-09-12T03:14:34.432557+0000, chain.objs.size()=1 2024-09-12T01:21:57.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:1klbsFtM6ocJxB754YUDCWd7myRZ6Yt_.GmN7d2025skH5OvOTA28K1b4ts6W0HU_0 2024-09-12T01:21:57.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.595468935143937259', time=2024-09-12T03:14:36.093288+0000, chain.objs.size()=1 2024-09-12T01:21:57.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:LNhGxw72mv78maMGaLCFd-yNRY9siwo_.ULvvOLt_7MKVBDShYsu_vLiL6qwiMyi_0 2024-09-12T01:21:57.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6248886500288574384', time=2024-09-12T03:14:37.699183+0000, chain.objs.size()=1 2024-09-12T01:21:57.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:.Twvy0bernQB4TvCVQ0keNn7R6fSatP_.k7jdAwEJd0dYPedJA5hZtGhNXdnHBrl_0 2024-09-12T01:21:57.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5893505377741681606', time=2024-09-12T03:15:11.928755+0000, chain.objs.size()=1 2024-09-12T01:21:57.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.609__shadow_.kIIRT6bW0Yooo64JRtCox3BnEAlRed8_0 2024-09-12T01:21:57.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15697442316488204610', time=2024-09-12T03:15:19.367725+0000, chain.objs.size()=6 2024-09-12T01:21:57.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.614__multipart_multipart_enc.2~1H2HaKYC3XnTFeiwTtqT5ZoygEgkqJF.1 2024-09-12T01:21:57.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.614__multipart_multipart_enc.2~1H2HaKYC3XnTFeiwTtqT5ZoygEgkqJF.2 2024-09-12T01:21:57.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.614__multipart_multipart_enc.2~1H2HaKYC3XnTFeiwTtqT5ZoygEgkqJF.3 2024-09-12T01:21:57.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.604+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.614__multipart_multipart_enc.2~1H2HaKYC3XnTFeiwTtqT5ZoygEgkqJF.4 2024-09-12T01:21:57.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.608+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.614__multipart_multipart_enc.2~1H2HaKYC3XnTFeiwTtqT5ZoygEgkqJF.5 2024-09-12T01:21:57.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.608+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.614__multipart_multipart_enc.2~1H2HaKYC3XnTFeiwTtqT5ZoygEgkqJF.6 2024-09-12T01:21:57.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.608+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5263387602979216456', time=2024-09-12T03:17:43.971090+0000, chain.objs.size()=1 2024-09-12T01:21:57.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.608+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.633__shadow_.-XjwHHhmeEABg4qm9eOwdv_YJnNlyoH_0 2024-09-12T01:21:57.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.608+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5630064470534555630', time=2024-09-12T03:18:13.767283+0000, chain.objs.size()=1 2024-09-12T01:21:57.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.608+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.672__shadow_.ANG68ZiTjwrte-cno1lZv5UFOzqsFDr_0 2024-09-12T01:21:57.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.608+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14141238218005156129', time=2024-09-12T03:18:39.983552+0000, chain.objs.size()=1 2024-09-12T01:21:57.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.608+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.715__shadow:.h5Pd-xm1xryUpFpZnxEU8zJ8hl9akP_.txYHXREHDzHo4oUVTkapda0pcmJMV_d_0 2024-09-12T01:21:57.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.608+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9807099311406304775', time=2024-09-12T03:19:17.631766+0000, chain.objs.size()=1 2024-09-12T01:21:57.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.608+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.742__shadow_.2kZB3uCCyND0PkkRww_bjsDXozcjTJK_0 2024-09-12T01:21:57.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.612+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:57.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.612+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:21:57.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.612+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:57.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:57.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49984' 2024-09-12T01:21:57.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_A11zoS0YPFTFNvEgnNZcoOgLBfRBjiw', time=2024-09-12T03:05:59.355536+0000, chain.objs.size()=2 2024-09-12T01:21:57.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.161__shadow_.nrQiUU1h2OP-3zAnz859x9huBHRqMg9_0 2024-09-12T01:21:57.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.161__shadow_.nrQiUU1h2OP-3zAnz859x9huBHRqMg9_1 2024-09-12T01:21:57.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1893781001300674906', time=2024-09-12T03:08:05.044371+0000, chain.objs.size()=1 2024-09-12T01:21:57.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.231__shadow_.GJrl5QoJrXBAFtlTRGjUXIQfikbbb31_0 2024-09-12T01:21:57.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6238050917382229534', time=2024-09-12T03:08:07.698886+0000, chain.objs.size()=1 2024-09-12T01:21:57.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.235__shadow_.fOPtCDzyTA7m_eK_MLcAdnS1aajW1ki_0 2024-09-12T01:21:57.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12214438490992381530', time=2024-09-12T03:08:08.432574+0000, chain.objs.size()=1 2024-09-12T01:21:57.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.236__shadow_.psMWvQpSr9N1LAtZjm1VD2x9OCIt4Z5_0 2024-09-12T01:21:57.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13981586608998016467', time=2024-09-12T03:08:10.270605+0000, chain.objs.size()=1 2024-09-12T01:21:57.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.238__shadow_.TPQf526CAA4rDXt1oi1eOXM9FU5RaKY_0 2024-09-12T01:21:57.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16355568706995602950', time=2024-09-12T03:08:47.491177+0000, chain.objs.size()=1 2024-09-12T01:21:57.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.EyZKvXqJEFILey78M5TY6wfQfbAp8er_0 2024-09-12T01:21:57.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11772795788553942776', time=2024-09-12T03:08:47.536364+0000, chain.objs.size()=1 2024-09-12T01:21:57.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.iF48ABZFsJbIaNlnExtft0-GdPdaA4J_0 2024-09-12T01:21:57.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2957484312354006149', time=2024-09-12T03:08:47.624819+0000, chain.objs.size()=1 2024-09-12T01:21:57.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.CcWaiAvARQqtRTNLgJn2Jko3kAPrdVD_0 2024-09-12T01:21:57.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3944117936017810589', time=2024-09-12T03:08:47.817015+0000, chain.objs.size()=1 2024-09-12T01:21:57.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ombG9flLTJZSNmupoAqOrjuIjeAcZ-w_0 2024-09-12T01:21:57.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1958998058159250647', time=2024-09-12T03:08:47.952831+0000, chain.objs.size()=1 2024-09-12T01:21:57.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.e8BabA8lUu4neVT_5CwmwqM4_14tTrl_0 2024-09-12T01:21:57.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7275288770008729716', time=2024-09-12T03:08:47.996916+0000, chain.objs.size()=1 2024-09-12T01:21:57.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.cRRh2rbQgbiNHN7fwGc20iCrsYUe9WB_0 2024-09-12T01:21:57.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12571358231041435601', time=2024-09-12T03:08:48.014481+0000, chain.objs.size()=1 2024-09-12T01:21:57.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.J0mmjHiWru0uWIPiDwT9G286e3Bw2AV_0 2024-09-12T01:21:57.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5866080454767407881', time=2024-09-12T03:08:48.019737+0000, chain.objs.size()=1 2024-09-12T01:21:57.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.4vTrB4-CDfIerH00R2B_G-voqrW_vTX_0 2024-09-12T01:21:57.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11626377320006530185', time=2024-09-12T03:08:48.207128+0000, chain.objs.size()=1 2024-09-12T01:21:57.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.j5J7UO-FIo4ucyccZoKEDrozR-1dNkh_0 2024-09-12T01:21:57.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14110006554122658912', time=2024-09-12T03:08:48.280284+0000, chain.objs.size()=1 2024-09-12T01:21:57.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.HY3aQWvoyZ-SC1kzZ_G0-vWF_tNa7V1_0 2024-09-12T01:21:57.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14527652259710139139', time=2024-09-12T03:08:48.285586+0000, chain.objs.size()=1 2024-09-12T01:21:57.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.nWijpKhgKFDUBAKllfNO_nt82hqaNM6_0 2024-09-12T01:21:57.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6808387422793095911', time=2024-09-12T03:08:48.305189+0000, chain.objs.size()=1 2024-09-12T01:21:57.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.X7lbX4_899LD_3D8BN5ziu4bBfHhRsJ_0 2024-09-12T01:21:57.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12736634150177836548', time=2024-09-12T03:08:48.327351+0000, chain.objs.size()=1 2024-09-12T01:21:57.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.8PC92a5MQqAFoJWQFCjgxRWY_AEzom5_0 2024-09-12T01:21:57.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9739204534085214821', time=2024-09-12T03:08:48.336326+0000, chain.objs.size()=1 2024-09-12T01:21:57.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Ffh6DBLRn1wX5f4ICA_gPdYEWdHZDeu_0 2024-09-12T01:21:57.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.928745558499181314', time=2024-09-12T03:08:48.350702+0000, chain.objs.size()=1 2024-09-12T01:21:57.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.tIfUOLZfsDjYCaiR75uufFbdyFg3POG_0 2024-09-12T01:21:57.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16026220186241699582', time=2024-09-12T03:08:48.548970+0000, chain.objs.size()=1 2024-09-12T01:21:57.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.pX3Vv08Iumk3wGVIr0a-UJ8Bh98oakr_0 2024-09-12T01:21:57.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.402823822817518390', time=2024-09-12T03:08:48.604871+0000, chain.objs.size()=1 2024-09-12T01:21:57.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.616+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.GYjps7G8fyr1G4SLftJjiWJ-nJmMfUF_0 2024-09-12T01:21:57.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.620+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17643469519155538535', time=2024-09-12T03:08:48.612349+0000, chain.objs.size()=1 2024-09-12T01:21:57.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.620+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.aKgekGCBrS57Y5T83Q24Tnz-HjEpnHz_0 2024-09-12T01:21:57.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.620+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2461623500617813926', time=2024-09-12T03:08:48.853320+0000, chain.objs.size()=1 2024-09-12T01:21:57.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.620+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.mAUrVJSVNif7cF_ioPNJ7MIDSguBdZb_0 2024-09-12T01:21:57.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.620+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3159608762265595500', time=2024-09-12T03:08:48.908962+0000, chain.objs.size()=1 2024-09-12T01:21:57.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.620+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.6nDsRJ9XuCdXDMtbV1WOxaO1E-E3h2B_0 2024-09-12T01:21:57.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.620+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.89487177112181326', time=2024-09-12T03:08:48.936732+0000, chain.objs.size()=1 2024-09-12T01:21:57.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.620+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.DjwHkDTnBDpKPdjW2dG21vGC8H9oOTj_0 2024-09-12T01:21:57.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.620+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17899128159600579927', time=2024-09-12T03:08:48.960407+0000, chain.objs.size()=1 2024-09-12T01:21:57.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.620+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.KtY5qiW8TCwlHfqRqPd5GJsBPi10LSk_0 2024-09-12T01:21:57.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.620+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7424547333675408303', time=2024-09-12T03:08:48.984039+0000, chain.objs.size()=1 2024-09-12T01:21:57.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.620+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.V0mpk1wxs__DDeOfcfpPZHAD6r1xK3K_0 2024-09-12T01:21:57.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.620+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11021337656100644123', time=2024-09-12T03:08:49.307569+0000, chain.objs.size()=1 2024-09-12T01:21:57.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.620+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.WeyEEJqBuESwHDfR0I4z-88m-USZoYy_0 2024-09-12T01:21:57.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.620+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11287470115820702085', time=2024-09-12T03:08:49.558645+0000, chain.objs.size()=1 2024-09-12T01:21:57.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.620+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.x8zbYDHA5o7nZaTTEthmuEnTo3D9UfW_0 2024-09-12T01:21:57.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.620+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13824359845832498490', time=2024-09-12T03:08:49.698566+0000, chain.objs.size()=1 2024-09-12T01:21:57.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.620+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.hhCak-Jb4pXwSrsG7mocn-XvYWvMNWc_0 2024-09-12T01:21:57.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.620+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3154611498646155650', time=2024-09-12T03:08:49.743327+0000, chain.objs.size()=1 2024-09-12T01:21:57.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.620+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.UOrY-7XroE6CZh7_2sN3Q6Y6kTB_9pL_0 2024-09-12T01:21:57.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.620+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16499293920062224326', time=2024-09-12T03:08:49.926488+0000, chain.objs.size()=1 2024-09-12T01:21:57.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.620+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ZAbGtznKkR-gQ_3QrJo_hf0FadyFhLq_0 2024-09-12T01:21:57.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.620+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8140077912397842550', time=2024-09-12T03:08:49.956659+0000, chain.objs.size()=1 2024-09-12T01:21:57.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.620+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.WN9ZiL3J_o0HDSXhhKDcihCduUQ0D1X_0 2024-09-12T01:21:57.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8552362866291674082', time=2024-09-12T03:09:01.535429+0000, chain.objs.size()=1 2024-09-12T01:21:57.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.280__shadow_.fHwBtkwMd9UOs3-ZZjM1lNaFQEN5O0R_0 2024-09-12T01:21:57.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10453288590862431486', time=2024-09-12T03:09:02.928915+0000, chain.objs.size()=1 2024-09-12T01:21:57.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.282__shadow_.bZfpakru8ocYhV449FFhHsMGqu2iOmg_0 2024-09-12T01:21:57.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15622458777611370498', time=2024-09-12T03:09:04.377379+0000, chain.objs.size()=1 2024-09-12T01:21:57.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.284__shadow_.lVIBDI105uDvhmJ--_Dnl4P6ZxH9e_g_0 2024-09-12T01:21:57.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7282395315015741973', time=2024-09-12T03:09:04.381398+0000, chain.objs.size()=1 2024-09-12T01:21:57.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.284__shadow_.xexglssUBlIMDNsv-AEnQK6Y2nx4Bla_0 2024-09-12T01:21:57.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16174259598868639674', time=2024-09-12T03:09:11.595050+0000, chain.objs.size()=1 2024-09-12T01:21:57.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.293__shadow_.157Zn3_qaTF6eKQ9mlLcOSsLEjuLEui_0 2024-09-12T01:21:57.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9608688209755738399', time=2024-09-12T03:09:11.640794+0000, chain.objs.size()=1 2024-09-12T01:21:57.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.293__shadow_.b9FSLpAIDCuoYxihw0ZutXgKqZx9sDQ_0 2024-09-12T01:21:57.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.421368101267928497', time=2024-09-12T03:09:13.029204+0000, chain.objs.size()=1 2024-09-12T01:21:57.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.294__shadow_.8xyJQmNGFeD-Bi5VXWYU9Qpk0P-16TM_0 2024-09-12T01:21:57.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17651315691236120299', time=2024-09-12T03:09:13.036035+0000, chain.objs.size()=1 2024-09-12T01:21:57.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.294__shadow_.N2r3TulmKKnF5o9x6pksQ8ai6zcyiiX_0 2024-09-12T01:21:57.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3026323006319259047', time=2024-09-12T03:09:16.520367+0000, chain.objs.size()=1 2024-09-12T01:21:57.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.299__shadow_.EPgwfEKPWZs5oX1AJnDcV4yqVpEUg8i_0 2024-09-12T01:21:57.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.479342964105860977', time=2024-09-12T03:09:27.741500+0000, chain.objs.size()=1 2024-09-12T01:21:57.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.314__shadow_.wG5uD4dM2WeMiRTvsNyoe4ZAMdBAVCI_0 2024-09-12T01:21:57.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6342234322717849955', time=2024-09-12T03:09:53.075149+0000, chain.objs.size()=1 2024-09-12T01:21:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.T1V1Xo11DQuvYZW4xMfuhri4kKDOjNl_0 2024-09-12T01:21:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82bd4a7640 0 -- 172.21.15.70:0/2230280201 >> [v2:172.21.15.70:6800/936993313,v1:172.21.15.70:6801/936993313] conn(0x7f82b8047060 msgr2=0x7f82b8055410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:21:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6429113373414697439', time=2024-09-12T03:09:53.079485+0000, chain.objs.size()=1 2024-09-12T01:21:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.pGHAIToqRLPrUw63X9s9lcPHx92R2VE_0 2024-09-12T01:21:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13758786548713759585', time=2024-09-12T03:09:53.087075+0000, chain.objs.size()=1 2024-09-12T01:21:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.mF_Oe3LInE9mhzLweXCBGuWZUyZMjhF_0 2024-09-12T01:21:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4212861973186413558', time=2024-09-12T03:09:53.089426+0000, chain.objs.size()=1 2024-09-12T01:21:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.tI98urqozsTbhWN_RP-WQ3BYOeVi_Vd_0 2024-09-12T01:21:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17422810323548033138', time=2024-09-12T03:09:53.270356+0000, chain.objs.size()=1 2024-09-12T01:21:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.82IExjj9ITZ8gAXq2TlMZ5g2X3Xg6mn_0 2024-09-12T01:21:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7236246211035592166', time=2024-09-12T03:09:53.287467+0000, chain.objs.size()=1 2024-09-12T01:21:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ynUi31iJikpuZvUfZUEmpRouNS4mPbH_0 2024-09-12T01:21:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12197005887626538627', time=2024-09-12T03:09:53.319070+0000, chain.objs.size()=1 2024-09-12T01:21:57.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.bEyxoYWscuk9jjyr8wGMCAnt_k_9vtV_0 2024-09-12T01:21:57.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13694687633063615031', time=2024-09-12T03:09:53.365485+0000, chain.objs.size()=1 2024-09-12T01:21:57.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.IvBTClry37bT-WS84gWWr2fxb5422sF_0 2024-09-12T01:21:57.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11670946619573347418', time=2024-09-12T03:09:53.369256+0000, chain.objs.size()=1 2024-09-12T01:21:57.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.DrXUsi4M1sYBSkUJAEivhVh2tKvJdzF_0 2024-09-12T01:21:57.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15341924621502486038', time=2024-09-12T03:09:53.372582+0000, chain.objs.size()=1 2024-09-12T01:21:57.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.epVk1BzRs2oKlHWNPFPe0BYmDJdFKG7_0 2024-09-12T01:21:57.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7443596860999930691', time=2024-09-12T03:09:53.443334+0000, chain.objs.size()=1 2024-09-12T01:21:57.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.NDaOtlsKiynRbFEwDTohS9toatZQJAJ_0 2024-09-12T01:21:57.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12485781493339385843', time=2024-09-12T03:09:53.445754+0000, chain.objs.size()=1 2024-09-12T01:21:57.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.624+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Lw4xekPVUbT1rVFneeFqO1Ei_pNWuE__0 2024-09-12T01:21:57.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3998234887306708687', time=2024-09-12T03:09:53.473632+0000, chain.objs.size()=1 2024-09-12T01:21:57.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Otx-AzpadZQsOXKro_vftEVKobcTzKO_0 2024-09-12T01:21:57.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.521218902964364798', time=2024-09-12T03:09:53.737533+0000, chain.objs.size()=1 2024-09-12T01:21:57.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.7B9x36jrFiJ19WaSTh2n5E9XyXvgNFF_0 2024-09-12T01:21:57.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16745684146121587990', time=2024-09-12T03:09:53.822916+0000, chain.objs.size()=1 2024-09-12T01:21:57.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.jPIqO_8GJYKy_ciiRjm7Vigc-cSuek0_0 2024-09-12T01:21:57.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2119375990474653481', time=2024-09-12T03:09:53.977406+0000, chain.objs.size()=1 2024-09-12T01:21:57.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ucGAK5dfNFCfvqAqO1SRkqTpytZI7I4_0 2024-09-12T01:21:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6851041411803274315', time=2024-09-12T03:09:54.148505+0000, chain.objs.size()=1 2024-09-12T01:21:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.CvZkDj2lo7zTHIB5VhjVDNUXn5I-TKz_0 2024-09-12T01:21:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17889931845395111221', time=2024-09-12T03:09:54.177464+0000, chain.objs.size()=1 2024-09-12T01:21:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.T3-sA6WoOjtDwbpWQzyyPSHnA9VBUWX_0 2024-09-12T01:21:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13135815193746701190', time=2024-09-12T03:09:54.428123+0000, chain.objs.size()=1 2024-09-12T01:21:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.9Hav2ZvNNrSWhvvPrYI1SM80NIW0ofR_0 2024-09-12T01:21:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10529544508725248957', time=2024-09-12T03:09:54.475177+0000, chain.objs.size()=1 2024-09-12T01:21:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.cfzhOBNihWUFTht5vAfChryjkYFjxZY_0 2024-09-12T01:21:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.479810567297032168', time=2024-09-12T03:09:54.493351+0000, chain.objs.size()=1 2024-09-12T01:21:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.2lMU8KNG95p0x4rIr9AF-BhwDzfgfQf_0 2024-09-12T01:21:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3746425448148864309', time=2024-09-12T03:09:54.499738+0000, chain.objs.size()=1 2024-09-12T01:21:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.qrVK1zH3Gmg4OSHqaTUUimFJsPaO7bT_0 2024-09-12T01:21:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.37663975352267882', time=2024-09-12T03:09:54.503332+0000, chain.objs.size()=1 2024-09-12T01:21:57.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.lgXtc8ILBRIWtpL40Zdkhs85lLdOf14_0 2024-09-12T01:21:57.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13043998159032935274', time=2024-09-12T03:09:54.671354+0000, chain.objs.size()=1 2024-09-12T01:21:57.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.LbJRPhxETJojCK33zubkgbxSYtVIZYP_0 2024-09-12T01:21:57.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2915764861853529244', time=2024-09-12T03:09:54.687420+0000, chain.objs.size()=1 2024-09-12T01:21:57.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.AsiENAmZ7RHw8Tg8JYLtBxtZ_VKAxpC_0 2024-09-12T01:21:57.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9132624371466770637', time=2024-09-12T03:09:54.737042+0000, chain.objs.size()=1 2024-09-12T01:21:57.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.DYjBmTf5EbT0twF4Z42PAlrYZmAhaK4_0 2024-09-12T01:21:57.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2741368896990247886', time=2024-09-12T03:09:54.989237+0000, chain.objs.size()=1 2024-09-12T01:21:57.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.S2Po5FWAgecKMzocAdYhWl0C6qskF3w_0 2024-09-12T01:21:57.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16813184161319372060', time=2024-09-12T03:09:55.054869+0000, chain.objs.size()=1 2024-09-12T01:21:57.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.qY2Gr1zv4ePNrS0GkpTW0UI_X9oLYqT_0 2024-09-12T01:21:57.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2733247920014197977', time=2024-09-12T03:09:55.077037+0000, chain.objs.size()=1 2024-09-12T01:21:57.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.n0mv_I4vb5oVogIUr7FxQ677qKGAr_G_0 2024-09-12T01:21:57.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16717274669352079202', time=2024-09-12T03:09:55.130984+0000, chain.objs.size()=1 2024-09-12T01:21:57.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Hfu8PWuTnP3LgTYn0YxyVnxh4tdi5Po_0 2024-09-12T01:21:57.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17951597443314313392', time=2024-09-12T03:09:55.142965+0000, chain.objs.size()=1 2024-09-12T01:21:57.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.bjgN6sL3v7Se3a0jVwDsVzPU6uSplts_0 2024-09-12T01:21:57.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14907847217412847113', time=2024-09-12T03:09:55.281195+0000, chain.objs.size()=1 2024-09-12T01:21:57.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.628+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.s4jvFT2fNVYxC7JK6n_ZC3nxBKQ7xif_0 2024-09-12T01:21:57.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9880143305183887953', time=2024-09-12T03:09:55.322446+0000, chain.objs.size()=1 2024-09-12T01:21:57.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Mqvzdd6rZ5_i28zx9Mn8lNwbPFT1OkM_0 2024-09-12T01:21:57.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13820513507163388519', time=2024-09-12T03:09:55.430231+0000, chain.objs.size()=1 2024-09-12T01:21:57.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.FArolMCs83mxXY4ox4LptVESet1_wbi_0 2024-09-12T01:21:57.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6674300707160252271', time=2024-09-12T03:10:15.300856+0000, chain.objs.size()=1 2024-09-12T01:21:57.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.jVCA-yop7RV4xnmKW0LIb0vkIKt553b_0 2024-09-12T01:21:57.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5020958834498229475', time=2024-09-12T03:10:15.342337+0000, chain.objs.size()=1 2024-09-12T01:21:57.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ijGsYufG3_N2Gb76mMhKKLCtJQciob__0 2024-09-12T01:21:57.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2434677126644520333', time=2024-09-12T03:10:15.579472+0000, chain.objs.size()=1 2024-09-12T01:21:57.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ddI5KQS4737yPHZjL0T1kpMNp2KxLqQ_0 2024-09-12T01:21:57.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3420741609000718030', time=2024-09-12T03:10:15.629764+0000, chain.objs.size()=1 2024-09-12T01:21:57.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.RuNcahDFjV9zKafX798-I-SVrSRaSJK_0 2024-09-12T01:21:57.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13451538665945673640', time=2024-09-12T03:10:15.651320+0000, chain.objs.size()=1 2024-09-12T01:21:57.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.tmBxrmxJxTmcIsuajYqgP0WD1mphczY_0 2024-09-12T01:21:57.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3448722210602241835', time=2024-09-12T03:10:15.667712+0000, chain.objs.size()=1 2024-09-12T01:21:57.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.D2wGKyeoWTmSRj6IpVbQCOSisgbnGRm_0 2024-09-12T01:21:57.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5916312895566660739', time=2024-09-12T03:10:15.677602+0000, chain.objs.size()=1 2024-09-12T01:21:57.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.aWMR5QPVpsrPH-OvXBXfHtXQn4wmjCa_0 2024-09-12T01:21:57.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10419422970429134937', time=2024-09-12T03:10:15.681844+0000, chain.objs.size()=1 2024-09-12T01:21:57.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.R3DllGEk5J01BUM3QWWq8Raqg15IpGI_0 2024-09-12T01:21:57.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16035924139489267952', time=2024-09-12T03:10:15.890009+0000, chain.objs.size()=1 2024-09-12T01:21:57.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.jCG66MdhPY2SgIUNSHjf8O0Q85-2REQ_0 2024-09-12T01:21:57.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11573353811523353321', time=2024-09-12T03:10:15.905857+0000, chain.objs.size()=1 2024-09-12T01:21:57.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.oamd6YBtgP1NyMa8_zPliFoQLFAKRve_0 2024-09-12T01:21:57.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5359371980434805877', time=2024-09-12T03:10:15.943183+0000, chain.objs.size()=1 2024-09-12T01:21:57.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.oEqCUqtPrxZ8ORn5cedasn5apf99Bt7_0 2024-09-12T01:21:57.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14913177343602535575', time=2024-09-12T03:10:15.977700+0000, chain.objs.size()=1 2024-09-12T01:21:57.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.FgEnnumjqimz2IPhjbiK5fx38aFu9cj_0 2024-09-12T01:21:57.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5542446190051739250', time=2024-09-12T03:10:15.990399+0000, chain.objs.size()=1 2024-09-12T01:21:57.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.k0nK6P5TH-d01R_ZQsaU5PmiKO5RDWW_0 2024-09-12T01:21:57.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10591338671054070879', time=2024-09-12T03:10:16.010782+0000, chain.objs.size()=1 2024-09-12T01:21:57.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.EptLr_S_3E0fwoEsQGoe-GIn5cy15tv_0 2024-09-12T01:21:57.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14406771069828697443', time=2024-09-12T03:10:16.035712+0000, chain.objs.size()=1 2024-09-12T01:21:57.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.AGZEYuUkDCqezcg09iWSmXynZXwsncf_0 2024-09-12T01:21:57.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16559233030697135405', time=2024-09-12T03:10:16.280833+0000, chain.objs.size()=1 2024-09-12T01:21:57.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.zId22Y-Zlkwt53O7ESj24Q8ShvSPt4q_0 2024-09-12T01:21:57.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17476861808285621531', time=2024-09-12T03:10:16.324641+0000, chain.objs.size()=1 2024-09-12T01:21:57.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.PXSSPgmMHsSgaSwbThRxu4zSEVybpoH_0 2024-09-12T01:21:57.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8339032007390483135', time=2024-09-12T03:10:16.838066+0000, chain.objs.size()=1 2024-09-12T01:21:57.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.oxLVqPLUc6srM5tOyUZl9kYptElFUPy_0 2024-09-12T01:21:57.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7274868100439958840', time=2024-09-12T03:10:16.915099+0000, chain.objs.size()=1 2024-09-12T01:21:57.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.jGTeSArqkly7UcX5e9bJy8SEhnF3atL_0 2024-09-12T01:21:57.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6645219107846413578', time=2024-09-12T03:10:16.916243+0000, chain.objs.size()=1 2024-09-12T01:21:57.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.632+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.7ssfjEYPbGv--0VV98rWgJUYpe_Zm1u_0 2024-09-12T01:21:57.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.636+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10035315251868322508', time=2024-09-12T03:10:16.997594+0000, chain.objs.size()=1 2024-09-12T01:21:57.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.636+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.y93N31-_WCOOd1SYdsilAexh_vZyLVT_0 2024-09-12T01:21:57.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.636+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2362192629749975863', time=2024-09-12T03:10:17.139389+0000, chain.objs.size()=1 2024-09-12T01:21:57.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.636+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.MhYt4g6KhjNR5p-GM8l9VeroM-HVWM__0 2024-09-12T01:21:57.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.636+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49984 2024-09-12T01:21:57.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-12T01:21:57.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16358379701336247149', time=2024-09-12T03:10:17.144572+0000, chain.objs.size()=1 2024-09-12T01:21:57.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.k-ye2PmXSRz84Ujkgzn-ubwXs3S7ixh_0 2024-09-12T01:21:57.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4335478384236488697', time=2024-09-12T03:10:17.207449+0000, chain.objs.size()=1 2024-09-12T01:21:57.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.v4T6atXIwKFCXtKJ7nl05TizMWgmYny_0 2024-09-12T01:21:57.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1195056119021825184', time=2024-09-12T03:10:17.242039+0000, chain.objs.size()=1 2024-09-12T01:21:57.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_._EMo90BpkaoaJN8VyXtbLKPmr_djgOJ_0 2024-09-12T01:21:57.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17109514366533779065', time=2024-09-12T03:10:17.243896+0000, chain.objs.size()=1 2024-09-12T01:21:57.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.qc_Znarpq9MRSb51pcRYNJH-8Nnnmnn_0 2024-09-12T01:21:57.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.87654676320510630', time=2024-09-12T03:10:17.263328+0000, chain.objs.size()=1 2024-09-12T01:21:57.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.d7hluwmYNYNFClYYbAQCeDWkewoK8MO_0 2024-09-12T01:21:57.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16420558547568732220', time=2024-09-12T03:10:17.331227+0000, chain.objs.size()=1 2024-09-12T01:21:57.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.RmiJ8NEMntZpcaP3Qls571szKTR1ieE_0 2024-09-12T01:21:57.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6680883633574277285', time=2024-09-12T03:10:17.335685+0000, chain.objs.size()=1 2024-09-12T01:21:57.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.CXeaq82tCV32T3pRjkA02MOVDghFn_l_0 2024-09-12T01:21:57.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5729355751725431434', time=2024-09-12T03:10:17.489109+0000, chain.objs.size()=1 2024-09-12T01:21:57.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ykEMuClTQd-VBNnrexXn-zTapjnV47G_0 2024-09-12T01:21:57.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14208054793331239790', time=2024-09-12T03:10:17.548005+0000, chain.objs.size()=1 2024-09-12T01:21:57.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.8EhKIHSkHQnoKGaUHIdMM5G-iTjqJzU_0 2024-09-12T01:21:57.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1967688663925510130', time=2024-09-12T03:10:17.560302+0000, chain.objs.size()=1 2024-09-12T01:21:57.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.C_2gXmgqSsO3dcJfadyIKMjztKSnHW1_0 2024-09-12T01:21:57.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8933225999432879347', time=2024-09-12T03:10:17.571944+0000, chain.objs.size()=1 2024-09-12T01:21:57.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.9TKcpFvmfxP4GWf1WkGiTBTlGhBZIEC_0 2024-09-12T01:21:57.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11277922472688606226', time=2024-09-12T03:10:17.624724+0000, chain.objs.size()=1 2024-09-12T01:21:57.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.bw12h3-OBzzZ6Uf1IoUudoOfnD_EwHu_0 2024-09-12T01:21:57.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17636867106322402999', time=2024-09-12T03:10:35.530439+0000, chain.objs.size()=1 2024-09-12T01:21:57.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.354__shadow_.YIaraABXf69d-jvd5e14FpO8jwJhTAR_0 2024-09-12T01:21:57.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4603287399707805048', time=2024-09-12T03:10:49.218929+0000, chain.objs.size()=1 2024-09-12T01:21:57.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.376__shadow_.O-nm21lpYXEszI1BvJEkoto6lIB-ao__0 2024-09-12T01:21:57.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17675684761868081959', time=2024-09-12T03:11:32.806238+0000, chain.objs.size()=1 2024-09-12T01:21:57.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.438__shadow_.za0iAppE11dbNk8RAVfC11WX8e3ztb4_0 2024-09-12T01:21:57.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6276320724087310052', time=2024-09-12T03:12:12.787189+0000, chain.objs.size()=1 2024-09-12T01:21:57.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.496__shadow_.yjpq_TmaNfwfTzMBrOCDSidSdOyKB6h_0 2024-09-12T01:21:57.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2944228408389460472', time=2024-09-12T03:12:22.215058+0000, chain.objs.size()=6 2024-09-12T01:21:57.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.1 2024-09-12T01:21:57.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.2 2024-09-12T01:21:57.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.3 2024-09-12T01:21:57.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.4 2024-09-12T01:21:57.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.5 2024-09-12T01:21:57.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.508__multipart_srcmultipart.2~jQCue4gc-ZPnTPaG-8a5UYWJFo4Phrs.6 2024-09-12T01:21:57.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12366966029241328808', time=2024-09-12T03:14:10.432927+0000, chain.objs.size()=1 2024-09-12T01:21:57.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.640+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:mqJMhtWeRViMk0.uzegdoJRN-rCoY5a_.Z-_jSslQFUCmzIdZAFeQc-iqbmd4VRU_0 2024-09-12T01:21:57.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.644+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16787544376014278116', time=2024-09-12T03:14:11.220450+0000, chain.objs.size()=1 2024-09-12T01:21:57.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.644+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:vjpjTYRa61r.XWxgvPv9HBbmQMYb24r_.UOhst-mqtkD4jDR4FDAqZhgD-JwygeI_0 2024-09-12T01:21:57.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.644+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11971934407523007386', time=2024-09-12T03:14:31.250577+0000, chain.objs.size()=1 2024-09-12T01:21:57.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.644+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:dy55EHKgeId.uwWWiBXGnv62MebL59x_.mCNKsgCSph4e_3kD2ylzvHN8Vy3LQbg_0 2024-09-12T01:21:57.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.644+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10832341041816568535', time=2024-09-12T03:14:40.345508+0000, chain.objs.size()=1 2024-09-12T01:21:57.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.644+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:lNa9b.Go7M1Qnv2rR5gMPV-ymoi3mUL_.YkCzTIDdOhwTwRVfpVmbHlqDvBzEkb7_0 2024-09-12T01:21:57.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.644+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7424104714504507314', time=2024-09-12T03:14:45.737864+0000, chain.objs.size()=1 2024-09-12T01:21:57.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.644+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:9CjH9323bBzpyseV2LurVZcyS3T7KNp_.9NEBphXRGbWKFCEUkkxbUs_JxcXzwkm_0 2024-09-12T01:21:57.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.644+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5599439417547535488', time=2024-09-12T03:16:28.377925+0000, chain.objs.size()=1 2024-09-12T01:21:57.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.644+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.618__shadow_.TxQwsDhh3Nqv6_JjMMRQ949PZYh4g2F_0 2024-09-12T01:21:57.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.644+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13005548864239959404', time=2024-09-12T03:17:41.977636+0000, chain.objs.size()=1 2024-09-12T01:21:57.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.644+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.630__shadow_.P_OEKrMX_ef89Y43dl1cK0i14ovfxIS_0 2024-09-12T01:21:57.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.644+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6218128931491100971', time=2024-09-12T03:18:12.332470+0000, chain.objs.size()=1 2024-09-12T01:21:57.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.644+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.669__shadow_.7piqnWRiXj4ypb9eV8ElNxb7cBKpHQl_0 2024-09-12T01:21:57.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.644+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3586711879458637885', time=2024-09-12T03:18:32.228423+0000, chain.objs.size()=1 2024-09-12T01:21:57.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.644+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.703__multipart_file1.2~5z-Z1mZrwj3RSlwu-7VYM_mHBKNBiL9.1 2024-09-12T01:21:57.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.648+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15367362840267560949', time=2024-09-12T03:19:16.201128+0000, chain.objs.size()=1 2024-09-12T01:21:57.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.648+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.740__shadow_.fmAlAL-4xkk575lFkoDc1tSVATyRFYv_0 2024-09-12T01:21:57.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.648+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:57.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.648+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:21:57.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.652+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:57.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.652+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:57.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.652+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47447' 2024-09-12T01:21:57.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.652+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.168594704991693779', time=2024-09-12T03:06:01.511732+0000, chain.objs.size()=3 2024-09-12T01:21:57.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.652+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.162__multipart_foo-LUKEWARM.2~fIX54uf95ykCurk7L9-jVWrYDGkW3VQ.1 2024-09-12T01:21:57.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.652+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.162__multipart_foo-LUKEWARM.2~fIX54uf95ykCurk7L9-jVWrYDGkW3VQ.2 2024-09-12T01:21:57.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.652+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.162__multipart_foo-LUKEWARM.2~fIX54uf95ykCurk7L9-jVWrYDGkW3VQ.3 2024-09-12T01:21:57.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.652+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2122470865047697009', time=2024-09-12T03:08:07.037520+0000, chain.objs.size()=1 2024-09-12T01:21:57.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.652+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.234__shadow_.2ucPzU9-qsXeWjlZtiJRfcSyLpLQowE_0 2024-09-12T01:21:57.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.652+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5380120951570431534', time=2024-09-12T03:08:14.134184+0000, chain.objs.size()=1 2024-09-12T01:21:57.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.652+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.243__shadow_.1tbDUXoyFNR4C081h43nD7Zw5T3OqLt_0 2024-09-12T01:21:57.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.652+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6587233239068642667', time=2024-09-12T03:08:16.453806+0000, chain.objs.size()=1 2024-09-12T01:21:57.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.652+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.245__shadow_.HGB5B_dS5tiyKR-ajAvTEwcvUeA7l9O_0 2024-09-12T01:21:57.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.652+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9266752155898311062', time=2024-09-12T03:08:23.356829+0000, chain.objs.size()=1 2024-09-12T01:21:57.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.652+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.255__shadow_.LjYNZnfuAYFI50pMB4mxg0iZgmD8i85_0 2024-09-12T01:21:57.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.652+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5044116429257071662', time=2024-09-12T03:08:24.722111+0000, chain.objs.size()=1 2024-09-12T01:21:57.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.652+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.257__shadow_.LxT9kCBwt5OYBRR3ZfYqmp3C8xi4I-l_0 2024-09-12T01:21:57.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.652+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14364851440073477337', time=2024-09-12T03:08:25.384358+0000, chain.objs.size()=1 2024-09-12T01:21:57.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.652+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.258__shadow_.6rW15HQcLiwwu77fGuhzK-eTMaLXnbA_0 2024-09-12T01:21:57.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.652+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12171840253241480265', time=2024-09-12T03:08:47.894348+0000, chain.objs.size()=1 2024-09-12T01:21:57.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.652+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.d-Boys5HzKjAffsNdmWc_8-npX8TUt2_0 2024-09-12T01:21:57.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.652+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11704812074649092280', time=2024-09-12T03:08:47.912389+0000, chain.objs.size()=1 2024-09-12T01:21:57.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.652+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.swtmzmBvf7SRyFw3SQ7Z6v_3dAqTGrE_0 2024-09-12T01:21:57.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.652+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4289320359539457128', time=2024-09-12T03:08:47.919341+0000, chain.objs.size()=1 2024-09-12T01:21:57.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.652+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.8Qu7L0-mH8SqRqyo5eL70pbagDMTLQt_0 2024-09-12T01:21:57.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.656+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4693395286055954201', time=2024-09-12T03:08:48.142283+0000, chain.objs.size()=1 2024-09-12T01:21:57.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.656+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.HAYzJ-AXXNBz6lgYCsb5rOwDsd4pq-y_0 2024-09-12T01:21:57.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.656+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6413274269072575891', time=2024-09-12T03:08:48.164948+0000, chain.objs.size()=1 2024-09-12T01:21:57.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.656+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_._-Y2t2vXVUSUK2ek9XppYeQPB-Y-ecY_0 2024-09-12T01:21:57.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.656+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12227413942135267672', time=2024-09-12T03:08:48.234158+0000, chain.objs.size()=1 2024-09-12T01:21:57.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.656+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.gleUKwhe-8jRfe7CV4DGjVC7XRKrlNY_0 2024-09-12T01:21:57.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.656+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5361408882467110372', time=2024-09-12T03:08:48.337619+0000, chain.objs.size()=1 2024-09-12T01:21:57.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.656+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.iDqU_yBtZx5bUDZkWyJmweu7gS853_7_0 2024-09-12T01:21:57.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.656+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.513947962502674485', time=2024-09-12T03:08:48.355970+0000, chain.objs.size()=1 2024-09-12T01:21:57.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.656+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Y6MHFiw8cXhe0fFNFXll_G7TV14MNOO_0 2024-09-12T01:21:57.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.656+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15816684903393876980', time=2024-09-12T03:08:48.501520+0000, chain.objs.size()=1 2024-09-12T01:21:57.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.656+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.7o6hufOiR5IzTU8S849Dybuz4ZYyqhk_0 2024-09-12T01:21:57.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.656+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2017046799307784039', time=2024-09-12T03:08:48.505513+0000, chain.objs.size()=1 2024-09-12T01:21:57.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.656+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.x1_wcuYu3gcJ9DVj6ccTXucSFBftKR8_0 2024-09-12T01:21:57.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.656+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10600982350406424898', time=2024-09-12T03:08:48.554499+0000, chain.objs.size()=1 2024-09-12T01:21:57.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.656+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.vDyS4Cb4PWMct262Xe5SaekbqNr2NU9_0 2024-09-12T01:21:57.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.656+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2561031670258346520', time=2024-09-12T03:08:48.825753+0000, chain.objs.size()=1 2024-09-12T01:21:57.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.656+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.m-8jw3h4E6xh0QOLOfj0-bjhSDHoj7C_0 2024-09-12T01:21:57.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.656+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12688942855254788462', time=2024-09-12T03:08:48.833625+0000, chain.objs.size()=1 2024-09-12T01:21:57.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.656+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.3M9pmREJMN7b21_0otdl_SF4YZ8TDH6_0 2024-09-12T01:21:57.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.656+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11169506180749819481', time=2024-09-12T03:08:48.954508+0000, chain.objs.size()=1 2024-09-12T01:21:57.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.656+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.QsO-Mkgddch_eeVZ4h2PxZoaBq5ycZ7_0 2024-09-12T01:21:57.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5379806072168993150', time=2024-09-12T03:08:49.242489+0000, chain.objs.size()=1 2024-09-12T01:21:57.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.rLet67QlPphgGqcbD6XO3lqgungph0Q_0 2024-09-12T01:21:57.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17493237534335973237', time=2024-09-12T03:08:49.315609+0000, chain.objs.size()=1 2024-09-12T01:21:57.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.nlAUCOTAIXHidPz_ARNH-cnE8m_FlTn_0 2024-09-12T01:21:57.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16986379778656864585', time=2024-09-12T03:08:49.347854+0000, chain.objs.size()=1 2024-09-12T01:21:57.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.tPLi7WIbrSe138YWh2qpibY7UJMQ10m_0 2024-09-12T01:21:57.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8334947212418572497', time=2024-09-12T03:08:49.381715+0000, chain.objs.size()=1 2024-09-12T01:21:57.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.0E6MsCiYf1TsoFQt3MFEELQuxw7W2vf_0 2024-09-12T01:21:57.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7203091529217313497', time=2024-09-12T03:08:49.537769+0000, chain.objs.size()=1 2024-09-12T01:21:57.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.O2Z8JU04VbWLZkxhNHRNnfQAoGhgGuZ_0 2024-09-12T01:21:57.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15292320867903383901', time=2024-09-12T03:08:49.650359+0000, chain.objs.size()=1 2024-09-12T01:21:57.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ixT9VXkaOVaRZkvNsf7q8XqkhlBnSRo_0 2024-09-12T01:21:57.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8225738718300125899', time=2024-09-12T03:08:49.886463+0000, chain.objs.size()=1 2024-09-12T01:21:57.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.oaf8rdbKyQPPSEsOYVIXw3Yhb-3T4qH_0 2024-09-12T01:21:57.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5853655375778169262', time=2024-09-12T03:08:49.965543+0000, chain.objs.size()=1 2024-09-12T01:21:57.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.RGBmSSF_W0qwsMIThoVqaA0cETBe7r7_0 2024-09-12T01:21:57.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1018695504778997322', time=2024-09-12T03:08:49.993593+0000, chain.objs.size()=1 2024-09-12T01:21:57.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.q2wJk_4AYZfcdnSnHvthN4MEkPBd24__0 2024-09-12T01:21:57.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4136394616723977807', time=2024-09-12T03:08:52.614762+0000, chain.objs.size()=1 2024-09-12T01:21:57.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.267__shadow_.5gZUrF9pr6EOWUUYAMVgZfDdj_NlYXQ_0 2024-09-12T01:21:57.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8014708216786813487', time=2024-09-12T03:08:56.007539+0000, chain.objs.size()=1 2024-09-12T01:21:57.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.272__shadow_.Ro4dY45nepZJH1vwNTacrJCfR0nqvCh_0 2024-09-12T01:21:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14466779188243165224', time=2024-09-12T03:09:11.582611+0000, chain.objs.size()=1 2024-09-12T01:21:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.293__shadow_.cBvCktjiTNTHYswFW-1EsZXePRX4ILK_0 2024-09-12T01:21:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5420186624856955021', time=2024-09-12T03:09:21.485046+0000, chain.objs.size()=1 2024-09-12T01:21:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.306__shadow_.UAWYmjn5A4brBQRQqdlcXu6efTLaV7O_0 2024-09-12T01:21:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15179701327015199491', time=2024-09-12T03:09:23.472869+0000, chain.objs.size()=1 2024-09-12T01:21:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.308__shadow:PWjqFQrQTw4PBz9bpukAHRj-ea2ZVcD_.wNIuW1f4ZGBIhkb6hdqN0sOijAd2_B1_0 2024-09-12T01:21:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17879747659506207567', time=2024-09-12T03:09:53.000197+0000, chain.objs.size()=1 2024-09-12T01:21:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.kwOJv3ASTL6i2R8Z7Ax9nvVawNiAUUh_0 2024-09-12T01:21:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6340132344979335007', time=2024-09-12T03:09:53.026437+0000, chain.objs.size()=1 2024-09-12T01:21:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.5buUfT4SpEWZk87Md9ylJ1dxLl9oP6E_0 2024-09-12T01:21:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10900722623130363147', time=2024-09-12T03:09:53.053032+0000, chain.objs.size()=1 2024-09-12T01:21:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.jubV6T_3Cmnr4czt2U3paka4KDSklja_0 2024-09-12T01:21:57.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6872301026334133383', time=2024-09-12T03:09:53.114039+0000, chain.objs.size()=1 2024-09-12T01:21:57.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Gh9p4qY_I0WOVnTXHJlzfQhQr7HGZis_0 2024-09-12T01:21:57.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4364570362420016739', time=2024-09-12T03:09:53.323699+0000, chain.objs.size()=1 2024-09-12T01:21:57.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.I4f2sKl8PH9K2s3uNkeswBJ4YIxfamH_0 2024-09-12T01:21:57.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.230596214931771016', time=2024-09-12T03:09:53.388972+0000, chain.objs.size()=1 2024-09-12T01:21:57.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.wVSRe4DOKTVf6zmEwZdC_aArg3Sex55_0 2024-09-12T01:21:57.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10438143296671714690', time=2024-09-12T03:09:53.416779+0000, chain.objs.size()=1 2024-09-12T01:21:57.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.yp7bW2ijcZf8gCbEer69iE9xqpThohs_0 2024-09-12T01:21:57.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5572046292612469334', time=2024-09-12T03:09:53.503863+0000, chain.objs.size()=1 2024-09-12T01:21:57.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.660+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.yzSa3GKV3rQOk4qEVr-tYHVc1CKukM8_0 2024-09-12T01:21:57.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.664+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1698681656736401887', time=2024-09-12T03:09:53.679159+0000, chain.objs.size()=1 2024-09-12T01:21:57.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.664+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.nno_IKNuVId5xQ6DeC0kOUgo7QJlLd7_0 2024-09-12T01:21:57.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.664+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2345915929240529699', time=2024-09-12T03:09:53.703253+0000, chain.objs.size()=1 2024-09-12T01:21:57.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.664+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.dZ7KRJCXHVZwGDvbbtrsl_tjpR3Hyi1_0 2024-09-12T01:21:57.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.664+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5792952598949634600', time=2024-09-12T03:09:53.739797+0000, chain.objs.size()=1 2024-09-12T01:21:57.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.664+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.lbXR8fKGfT-EjwHRDpkB8PvUk4RWFw9_0 2024-09-12T01:21:57.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.664+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.119292454013708289', time=2024-09-12T03:09:53.840256+0000, chain.objs.size()=1 2024-09-12T01:21:57.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.664+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ka6wZEeTwx8ECqvagw_Vaz_4PfwxfpD_0 2024-09-12T01:21:57.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.664+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1838961295520985311', time=2024-09-12T03:09:54.062599+0000, chain.objs.size()=1 2024-09-12T01:21:57.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.664+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.OJF67cB_oLkgI8q5D55JcIgL5BWoJdG_0 2024-09-12T01:21:57.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.664+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15311353101406775086', time=2024-09-12T03:09:54.089941+0000, chain.objs.size()=1 2024-09-12T01:21:57.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.664+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.pGM8r5XmivgCdGqtpNdNk5BzvhHkKRX_0 2024-09-12T01:21:57.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.664+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13951528897713206648', time=2024-09-12T03:09:54.180037+0000, chain.objs.size()=1 2024-09-12T01:21:57.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.664+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.MC5IV_V9QRE5QqlwzjyrHPY0kVcLuMH_0 2024-09-12T01:21:57.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.664+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15324276415533646488', time=2024-09-12T03:09:54.181111+0000, chain.objs.size()=1 2024-09-12T01:21:57.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.664+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ao15P_I11xraG2ysnM1XNudcwuG8jww_0 2024-09-12T01:21:57.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.664+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1953675304338634140', time=2024-09-12T03:09:54.430250+0000, chain.objs.size()=1 2024-09-12T01:21:57.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.664+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.eBzRU24bQpimXsJj5PNnV8SZYAy7LaK_0 2024-09-12T01:21:57.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.664+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.82121450275479693', time=2024-09-12T03:09:54.451438+0000, chain.objs.size()=1 2024-09-12T01:21:57.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.664+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.XXAxnCAq_L_OavvGfT2s9ctAE2itOD8_0 2024-09-12T01:21:57.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.664+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1247144749690245781', time=2024-09-12T03:09:54.478853+0000, chain.objs.size()=1 2024-09-12T01:21:57.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.664+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Fv9eHnBFPA8N6NeWQR0lmlqLgaV9io9_0 2024-09-12T01:21:57.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17256849085477018601', time=2024-09-12T03:09:54.491993+0000, chain.objs.size()=1 2024-09-12T01:21:57.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.0SqRxgFbbCltejer8GC5ylhx8CXlyXV_0 2024-09-12T01:21:57.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10039098958686687122', time=2024-09-12T03:09:54.502526+0000, chain.objs.size()=1 2024-09-12T01:21:57.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.WeEw7yHWyFN8_LYQkbAnBOfMezVXjIF_0 2024-09-12T01:21:57.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16192470533708716503', time=2024-09-12T03:09:54.658669+0000, chain.objs.size()=1 2024-09-12T01:21:57.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.TWswnUw8SgocXzyBVSWDmcqvC7EdVho_0 2024-09-12T01:21:57.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18229948411807518644', time=2024-09-12T03:09:54.692629+0000, chain.objs.size()=1 2024-09-12T01:21:57.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.X4itf-zICUH01_Le-kgu1qn1hHSSY_C_0 2024-09-12T01:21:57.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11725187135890810683', time=2024-09-12T03:09:54.727125+0000, chain.objs.size()=1 2024-09-12T01:21:57.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.GJniUoWFMAAsrZeDsD30-94vJWpJwBF_0 2024-09-12T01:21:57.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7763069759467553322', time=2024-09-12T03:09:54.740720+0000, chain.objs.size()=1 2024-09-12T01:21:57.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.VCMoT61n9yHyVCTSIw8xCd7Z_YxMEdg_0 2024-09-12T01:21:57.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3715415754208190078', time=2024-09-12T03:09:54.782256+0000, chain.objs.size()=1 2024-09-12T01:21:57.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.TJBc6Z114htFNfYmEpK5GT9_E0vZ3dY_0 2024-09-12T01:21:57.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8132667940609290952', time=2024-09-12T03:09:54.823583+0000, chain.objs.size()=1 2024-09-12T01:21:57.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.2yV6w1slQQ5u5od_t084ZMipofEhR4m_0 2024-09-12T01:21:57.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4504238549843085220', time=2024-09-12T03:09:55.029862+0000, chain.objs.size()=1 2024-09-12T01:21:57.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.xxUBT-K-DeKKXLuKKsUODEiegRim_WW_0 2024-09-12T01:21:57.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17396045892255619064', time=2024-09-12T03:09:55.108508+0000, chain.objs.size()=1 2024-09-12T01:21:57.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.gxLQUlS0pFCDbx6g8XgYELwzt5tz8Z8_0 2024-09-12T01:21:57.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6458682672228946497', time=2024-09-12T03:09:55.294610+0000, chain.objs.size()=1 2024-09-12T01:21:57.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.X3hm7XQmL-KYnkY6uoiA6KjYAKO5aVC_0 2024-09-12T01:21:57.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16919655427737751815', time=2024-09-12T03:09:55.308312+0000, chain.objs.size()=1 2024-09-12T01:21:57.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.EQScLx7DraP0khq0rqgcwXVOciUe5iZ_0 2024-09-12T01:21:57.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7232931582741176342', time=2024-09-12T03:09:55.311318+0000, chain.objs.size()=1 2024-09-12T01:21:57.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.oTiT8B4qhatkvwxmfWMNL2nwzhLV4RS_0 2024-09-12T01:21:57.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2115505183185398834', time=2024-09-12T03:09:55.313407+0000, chain.objs.size()=1 2024-09-12T01:21:57.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.B1AXG1A_ncCu2sv1Az8Op3JrShTh91h_0 2024-09-12T01:21:57.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1549198969184929149', time=2024-09-12T03:09:55.406259+0000, chain.objs.size()=1 2024-09-12T01:21:57.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.3khCQZZrUFUzD_sD_L7xiUJqYe-7jlb_0 2024-09-12T01:21:57.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.981842049785270189', time=2024-09-12T03:09:55.435007+0000, chain.objs.size()=1 2024-09-12T01:21:57.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.fTWzQNoYs1-3K0h8m5oE4rUQboZUQxH_0 2024-09-12T01:21:57.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10754888800843827959', time=2024-09-12T03:09:55.440145+0000, chain.objs.size()=1 2024-09-12T01:21:57.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.SjkDoQlPyDKQz9yTDa_NcrcBNlZvK21_0 2024-09-12T01:21:57.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10739917731217362600', time=2024-09-12T03:10:15.231606+0000, chain.objs.size()=1 2024-09-12T01:21:57.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.F3GAjA5KSIr-1QDV5Ji-tyMZ3AfxxFD_0 2024-09-12T01:21:57.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6386660018929358272', time=2024-09-12T03:10:15.265736+0000, chain.objs.size()=1 2024-09-12T01:21:57.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.7M22mBjuSo8ptXAUp5R8lpNc6vCWdJS_0 2024-09-12T01:21:57.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12495682290773493905', time=2024-09-12T03:10:15.312543+0000, chain.objs.size()=1 2024-09-12T01:21:57.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.e9I_dmsjM_7ZhoswLUbxy0n8QJ1p66Z_0 2024-09-12T01:21:57.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13994394739790573955', time=2024-09-12T03:10:15.361082+0000, chain.objs.size()=1 2024-09-12T01:21:57.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.TXMcm9p6tofBmONRdV-W4__YCijYoTF_0 2024-09-12T01:21:57.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6121176091461154010', time=2024-09-12T03:10:15.388364+0000, chain.objs.size()=1 2024-09-12T01:21:57.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ITVej569xAzWoVQCB9cgCMU9LKti0-O_0 2024-09-12T01:21:57.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2833579759664622631', time=2024-09-12T03:10:15.395336+0000, chain.objs.size()=1 2024-09-12T01:21:57.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.668+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.YnhIzrK1RZt0r-YLAGLk0xrKhRMVCt5_0 2024-09-12T01:21:57.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.921678944115608945', time=2024-09-12T03:10:15.407746+0000, chain.objs.size()=1 2024-09-12T01:21:57.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.5_W9pbWbZ36xC5tG2rPNncn2R0IYbRx_0 2024-09-12T01:21:57.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13990426042988170209', time=2024-09-12T03:10:15.417247+0000, chain.objs.size()=1 2024-09-12T01:21:57.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.0kyUYv1JFyeTbEhS0QHh8lJaAQQHrUr_0 2024-09-12T01:21:57.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13203597061936456957', time=2024-09-12T03:10:15.603503+0000, chain.objs.size()=1 2024-09-12T01:21:57.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.3qLuqkTWfa3jcSYT-bvDH7AMTdHCVeW_0 2024-09-12T01:21:57.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13154564683045415877', time=2024-09-12T03:10:15.644708+0000, chain.objs.size()=1 2024-09-12T01:21:57.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.FrE4Ed9vZWCgnKHSWD-X97zQvTZrEZV_0 2024-09-12T01:21:57.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4348582797076578395', time=2024-09-12T03:10:15.700931+0000, chain.objs.size()=1 2024-09-12T01:21:57.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Uj-Zb2RjVo2vWnXYSvKBX4R8IxFbMzK_0 2024-09-12T01:21:57.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5104485119440116308', time=2024-09-12T03:10:15.764674+0000, chain.objs.size()=1 2024-09-12T01:21:57.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.LbEWmWOkXQVH75nG8g-_GPxjNlz0g_W_0 2024-09-12T01:21:57.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11027587923956980366', time=2024-09-12T03:10:15.894223+0000, chain.objs.size()=1 2024-09-12T01:21:57.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.JVTBY4FARM_f_mCkmBFLv26KoDPLUWk_0 2024-09-12T01:21:57.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8066082112059415300', time=2024-09-12T03:10:15.896239+0000, chain.objs.size()=1 2024-09-12T01:21:57.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.2BonbxiAcEZiSbGX1LaIKIqW5AEWB00_0 2024-09-12T01:21:57.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13228920120989722937', time=2024-09-12T03:10:15.967458+0000, chain.objs.size()=1 2024-09-12T01:21:57.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.fwKKbf53VA5dh3N1cCaIeG4VYJvdCm6_0 2024-09-12T01:21:57.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12787781245780096578', time=2024-09-12T03:10:15.983462+0000, chain.objs.size()=1 2024-09-12T01:21:57.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.7bbduxBZymoa1PESy6c0A3DpXgkXEXc_0 2024-09-12T01:21:57.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15221587788625923012', time=2024-09-12T03:10:16.050584+0000, chain.objs.size()=1 2024-09-12T01:21:57.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.QoPXEJEQMJ_U5cjMBcY478SgGiNljKc_0 2024-09-12T01:21:57.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6797804613575088685', time=2024-09-12T03:10:16.279523+0000, chain.objs.size()=1 2024-09-12T01:21:57.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.PJdwDt8baap1F2xvUPJVP8CvGs2x9i6_0 2024-09-12T01:21:57.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13559843352285901169', time=2024-09-12T03:10:16.297176+0000, chain.objs.size()=1 2024-09-12T01:21:57.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.woYqcq05P6GyJ1_dzKRM2oZf703d11d_0 2024-09-12T01:21:57.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4190469230041445010', time=2024-09-12T03:10:16.309884+0000, chain.objs.size()=1 2024-09-12T01:21:57.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.BJdHS8TwDyYNojAOeibtcxOPzUutelT_0 2024-09-12T01:21:57.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2963420703691615559', time=2024-09-12T03:10:16.333561+0000, chain.objs.size()=1 2024-09-12T01:21:57.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.XbGS-OZgvKPdBdm_rWgzxBR1aEQuXpV_0 2024-09-12T01:21:57.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1062564667658075265', time=2024-09-12T03:10:16.805838+0000, chain.objs.size()=1 2024-09-12T01:21:57.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.LzqJd9M5eth6T7qW6a6FiTSsuOoZ1SP_0 2024-09-12T01:21:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3441986908293574206', time=2024-09-12T03:10:16.821649+0000, chain.objs.size()=1 2024-09-12T01:21:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.pnOUAf1Bp1rCpcQ26o0S1wK5mWjkyAI_0 2024-09-12T01:21:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15184847972913667280', time=2024-09-12T03:10:16.848217+0000, chain.objs.size()=1 2024-09-12T01:21:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.hySet9h0jlMni-baPOWoarbPm1O9gqc_0 2024-09-12T01:21:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11468572752516611676', time=2024-09-12T03:10:16.893207+0000, chain.objs.size()=1 2024-09-12T01:21:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.bOkhlNvkwlhGatIK4cUngHtY8G5x3ct_0 2024-09-12T01:21:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3592882835828243932', time=2024-09-12T03:10:16.898038+0000, chain.objs.size()=1 2024-09-12T01:21:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.2_xFDZVshMjGnkQJG77_RH0wZFn2BrW_0 2024-09-12T01:21:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3387224521448475634', time=2024-09-12T03:10:16.948742+0000, chain.objs.size()=1 2024-09-12T01:21:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.zJ934vvvgtoR7cVps-Cpv19dAI-yFEI_0 2024-09-12T01:21:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11653938403099542728', time=2024-09-12T03:10:16.959473+0000, chain.objs.size()=1 2024-09-12T01:21:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.q_4Wbfn0CmHQJc-SjR74Bw7Y3sBnmE-_0 2024-09-12T01:21:57.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.973313704858255286', time=2024-09-12T03:10:16.982958+0000, chain.objs.size()=1 2024-09-12T01:21:57.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.672+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Yw-Mmm6ImaTxXSXUAsiqb_hxKyXcpLL_0 2024-09-12T01:21:57.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.676+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47447 2024-09-12T01:21:57.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=35, truncated=0, next_marker='' 2024-09-12T01:21:57.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14535046612727879262', time=2024-09-12T03:10:17.294793+0000, chain.objs.size()=1 2024-09-12T01:21:57.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Qn-2fRH9t0d2rSMN3k2vHSVYlMjjVOa_0 2024-09-12T01:21:57.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11828781421722143714', time=2024-09-12T03:10:17.446814+0000, chain.objs.size()=1 2024-09-12T01:21:57.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.8R9azTXgUWXmjZ8UZJKCkxLZzA4PH1E_0 2024-09-12T01:21:57.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13921999069957283730', time=2024-09-12T03:10:17.500204+0000, chain.objs.size()=1 2024-09-12T01:21:57.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.zaHhoUIsSn5oOmEDdTWfjI0hzPuibee_0 2024-09-12T01:21:57.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1967252983328572784', time=2024-09-12T03:10:17.512060+0000, chain.objs.size()=1 2024-09-12T01:21:57.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.41og7ZnzpGWL8_XHgOpTBKRRbtBbgDX_0 2024-09-12T01:21:57.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13018005913068458640', time=2024-09-12T03:10:17.518040+0000, chain.objs.size()=1 2024-09-12T01:21:57.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.D3xkBih-i3HoYG8cQ7FIxKij_s1AI6z_0 2024-09-12T01:21:57.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14253427754140117278', time=2024-09-12T03:10:17.621480+0000, chain.objs.size()=1 2024-09-12T01:21:57.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.cg7L6E6H9pKCdupyP9PKHYlI1qO9WZx_0 2024-09-12T01:21:57.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9006446721760258966', time=2024-09-12T03:10:17.762782+0000, chain.objs.size()=1 2024-09-12T01:21:57.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.iBQCw7CUc9e7WEwCrYeoKIftHwXz2yC_0 2024-09-12T01:21:57.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14261822885319031685', time=2024-09-12T03:10:17.895268+0000, chain.objs.size()=1 2024-09-12T01:21:57.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.z6Y4TKZVMNNI93jnNcPRHrEK_R--wDX_0 2024-09-12T01:21:57.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7066971738397972608', time=2024-09-12T03:10:19.711840+0000, chain.objs.size()=1 2024-09-12T01:21:57.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.328__shadow_.TaYt7D5s3Ik9esOBuPJtpMErLrswQYk_0 2024-09-12T01:21:57.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11966673710022981220', time=2024-09-12T03:10:29.681900+0000, chain.objs.size()=1 2024-09-12T01:21:57.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.344__shadow_.3QgBpqieCll8y2i8CETYk02B-oAmhUK_0 2024-09-12T01:21:57.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9785264933411653010', time=2024-09-12T03:10:44.891654+0000, chain.objs.size()=1 2024-09-12T01:21:57.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.371__shadow_.pDGyKZBpvz7CyqFLuY8DAPQ7V9ZV64V_0 2024-09-12T01:21:57.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2860394502597649589', time=2024-09-12T03:10:51.969101+0000, chain.objs.size()=1 2024-09-12T01:21:57.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.380__shadow_.6Y2e3KHnwAHTS3gC_EoMGTC-HmpLwWl_0 2024-09-12T01:21:57.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14765814984180965476', time=2024-09-12T03:11:29.406077+0000, chain.objs.size()=1 2024-09-12T01:21:57.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.433__shadow_.SpM-lp2MUjvNgEVpQ6V_YxhBzheRAlq_0 2024-09-12T01:21:57.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15642196821498680993', time=2024-09-12T03:11:51.428509+0000, chain.objs.size()=1 2024-09-12T01:21:57.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.461__shadow_.8d-vCfPQow8kHnsjFaLPB-0vSrpXeF4_0 2024-09-12T01:21:57.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14306912053943028417', time=2024-09-12T03:11:55.018119+0000, chain.objs.size()=1 2024-09-12T01:21:57.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.465__shadow_.umvjVP6iPZT5_Th4O_8pdu7wGqQyuI0_0 2024-09-12T01:21:57.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1201921379467923367', time=2024-09-12T03:12:08.832675+0000, chain.objs.size()=1 2024-09-12T01:21:57.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.489__shadow_.HxDP0mItCtDtfComTLVnCXFkhLAk6pk_0 2024-09-12T01:21:57.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17580456384029498911', time=2024-09-12T03:12:11.741806+0000, chain.objs.size()=1 2024-09-12T01:21:57.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.494__shadow_.y6s-HddFrtpjGVD1Jg1fzkCKP9F-Q-T_0 2024-09-12T01:21:57.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15379462379663112492', time=2024-09-12T03:12:29.658039+0000, chain.objs.size()=1 2024-09-12T01:21:57.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.519__multipart_mymultipart.2~Hb6ZqRWKkfFKVXxftust7Xq1mizH2oH.1 2024-09-12T01:21:57.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2225958128046437526', time=2024-09-12T03:12:33.509578+0000, chain.objs.size()=6 2024-09-12T01:21:57.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.520__multipart_mymultipart.2~12GN36VzueIccrxhPCBFWqREDTDAvWw.1 2024-09-12T01:21:57.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.520__multipart_mymultipart.2~12GN36VzueIccrxhPCBFWqREDTDAvWw.2 2024-09-12T01:21:57.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.520__multipart_mymultipart.2~12GN36VzueIccrxhPCBFWqREDTDAvWw.3 2024-09-12T01:21:57.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.520__multipart_mymultipart.2~12GN36VzueIccrxhPCBFWqREDTDAvWw.4 2024-09-12T01:21:57.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.680+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.520__multipart_mymultipart.2~12GN36VzueIccrxhPCBFWqREDTDAvWw.5 2024-09-12T01:21:57.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.520__multipart_mymultipart.2~12GN36VzueIccrxhPCBFWqREDTDAvWw.6 2024-09-12T01:21:57.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10733624786084540694', time=2024-09-12T03:12:37.193666+0000, chain.objs.size()=3 2024-09-12T01:21:57.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.522__multipart_mymultipart.2~WkvsHfTrb-d3nJNFV-EEnNGcctNbEPz.1 2024-09-12T01:21:57.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.522__multipart_mymultipart.2~WkvsHfTrb-d3nJNFV-EEnNGcctNbEPz.2 2024-09-12T01:21:57.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.522__multipart_mymultipart.2~WkvsHfTrb-d3nJNFV-EEnNGcctNbEPz.3 2024-09-12T01:21:57.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2177917750482219319', time=2024-09-12T03:13:01.026094+0000, chain.objs.size()=1 2024-09-12T01:21:57.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.525__shadow_.QVEZXpJMRaLhR-XdYnOnlw6b0I3MDNw_0 2024-09-12T01:21:57.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1h_lV9pt5ZSwg9DhzNH3DLndvRo0grz', time=2024-09-12T03:13:07.296270+0000, chain.objs.size()=1 2024-09-12T01:21:57.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.532__multipart_mymultipart2.2~1h_lV9pt5ZSwg9DhzNH3DLndvRo0grz.1 2024-09-12T01:21:57.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4105086873342915353', time=2024-09-12T03:13:54.137269+0000, chain.objs.size()=1 2024-09-12T01:21:57.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.557__shadow_.gh8y4rjkZU8PMdquszXsHg_T9I4AtZO_0 2024-09-12T01:21:57.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8988175341224914740', time=2024-09-12T03:14:05.978688+0000, chain.objs.size()=1 2024-09-12T01:21:57.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.565__shadow_.ZolJO0AtHZXvrO1jKDDOVzI4thOiRTH_0 2024-09-12T01:21:57.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17549414567777048706', time=2024-09-12T03:14:10.608595+0000, chain.objs.size()=1 2024-09-12T01:21:57.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:M6NPWew-pe4OX.QISXdHBRix8meqbiN_.YkXhBR8COLJiH-hTcDAUuCHwmHtWQ18_0 2024-09-12T01:21:57.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9772642859910842989', time=2024-09-12T03:14:16.081218+0000, chain.objs.size()=1 2024-09-12T01:21:57.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:Gh6vwoZ90PS-l5OgHFoPnFWBBqT0-gY_.VMiO2NZYCmZUm9drLBpMIkanZ7Bb04W_0 2024-09-12T01:21:57.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13302463509555183518', time=2024-09-12T03:14:22.108370+0000, chain.objs.size()=1 2024-09-12T01:21:57.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.575__shadow_.pdTz_-8SQRzFGKWvNhqb8lDP3kMMk03_0 2024-09-12T01:21:57.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7533438347769367934', time=2024-09-12T03:14:25.781809+0000, chain.objs.size()=1 2024-09-12T01:21:57.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.576__shadow_.4YOpbpW458d3pG9fmqSaDpekGg90GX9_0 2024-09-12T01:21:57.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12275279790190153310', time=2024-09-12T03:14:26.840896+0000, chain.objs.size()=1 2024-09-12T01:21:57.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.577__shadow:aOjT4L9.q0itcodbTxSTS8df44J1FP._.BmXmCxbdpBWxk5IL_1D67SnLc8JseTT_0 2024-09-12T01:21:57.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3630764909179018041', time=2024-09-12T03:14:49.406558+0000, chain.objs.size()=4 2024-09-12T01:21:57.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.579__multipart_testobj.2~AXYLVZvdsmEPQ3RlD7ipl8W06QHER6g.1 2024-09-12T01:21:57.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.579__multipart_testobj.2~AXYLVZvdsmEPQ3RlD7ipl8W06QHER6g.2 2024-09-12T01:21:57.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.579__multipart_testobj.2~AXYLVZvdsmEPQ3RlD7ipl8W06QHER6g.3 2024-09-12T01:21:57.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.579__multipart_testobj.2~AXYLVZvdsmEPQ3RlD7ipl8W06QHER6g.4 2024-09-12T01:21:57.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.999636096804890681', time=2024-09-12T03:15:24.582644+0000, chain.objs.size()=6 2024-09-12T01:21:57.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.615__multipart_multipart_enc.2~SvC9EX5iGkOC2XA3RwMKvhEvAjZc4H5.1 2024-09-12T01:21:57.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.615__multipart_multipart_enc.2~SvC9EX5iGkOC2XA3RwMKvhEvAjZc4H5.2 2024-09-12T01:21:57.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.615__multipart_multipart_enc.2~SvC9EX5iGkOC2XA3RwMKvhEvAjZc4H5.3 2024-09-12T01:21:57.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.615__multipart_multipart_enc.2~SvC9EX5iGkOC2XA3RwMKvhEvAjZc4H5.4 2024-09-12T01:21:57.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.684+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.615__multipart_multipart_enc.2~SvC9EX5iGkOC2XA3RwMKvhEvAjZc4H5.5 2024-09-12T01:21:57.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.688+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.615__multipart_multipart_enc.2~SvC9EX5iGkOC2XA3RwMKvhEvAjZc4H5.6 2024-09-12T01:21:57.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.688+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~IoBzYPEXx4iqYw5qxnHi1kcMPNEferS', time=2024-09-12T03:17:37.761628+0000, chain.objs.size()=6 2024-09-12T01:21:57.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.688+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.625__multipart_multipart_enc.2~IoBzYPEXx4iqYw5qxnHi1kcMPNEferS.1 2024-09-12T01:21:57.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.688+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.625__multipart_multipart_enc.2~IoBzYPEXx4iqYw5qxnHi1kcMPNEferS.2 2024-09-12T01:21:57.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.688+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.625__multipart_multipart_enc.2~IoBzYPEXx4iqYw5qxnHi1kcMPNEferS.3 2024-09-12T01:21:57.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.688+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.625__multipart_multipart_enc.2~IoBzYPEXx4iqYw5qxnHi1kcMPNEferS.4 2024-09-12T01:21:57.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.688+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.625__multipart_multipart_enc.2~IoBzYPEXx4iqYw5qxnHi1kcMPNEferS.5 2024-09-12T01:21:57.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.688+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.625__multipart_multipart_enc.2~IoBzYPEXx4iqYw5qxnHi1kcMPNEferS.6 2024-09-12T01:21:57.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.688+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13134376550980645665', time=2024-09-12T03:18:25.217921+0000, chain.objs.size()=1 2024-09-12T01:21:57.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.688+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.692__shadow_.Hp5zgwAnzsLRIQ6UymjaNR5gZKHfAad_0 2024-09-12T01:21:57.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.688+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13014118548550711363', time=2024-09-12T03:18:36.877459+0000, chain.objs.size()=1 2024-09-12T01:21:57.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.688+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.710__shadow_.mb93DqSbGIegQVDrhGXFOoVsrGm4jqw_0 2024-09-12T01:21:57.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.688+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~sBSlsGEkgd0eaN7DT5qvm3Wxh1BVA6Q', time=2024-09-12T03:19:18.678069+0000, chain.objs.size()=1 2024-09-12T01:21:57.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.688+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.743__multipart_mymultipart2.2~sBSlsGEkgd0eaN7DT5qvm3Wxh1BVA6Q.1 2024-09-12T01:21:57.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.692+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:57.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.696+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:21:57.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.696+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:57.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.696+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:57.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44615' 2024-09-12T01:21:57.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14555414834180654860', time=2024-09-12T03:08:11.441203+0000, chain.objs.size()=1 2024-09-12T01:21:57.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.239__shadow_.GswJhAdP0mXyevSPL54y5LJzvvKniM8_0 2024-09-12T01:21:57.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10073364961251958250', time=2024-09-12T03:08:47.587587+0000, chain.objs.size()=1 2024-09-12T01:21:57.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.hHF29WExy_m4msMt1mzm6H2kq6q11lo_0 2024-09-12T01:21:57.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17148169260872624702', time=2024-09-12T03:08:47.642310+0000, chain.objs.size()=1 2024-09-12T01:21:57.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.CeUiy4XfNTk-csjQWBAV_juvf0CCAUj_0 2024-09-12T01:21:57.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14081003768075445319', time=2024-09-12T03:08:47.654896+0000, chain.objs.size()=1 2024-09-12T01:21:57.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.LtYXVyj7oWJuoirF5_eSuO1oBU7kC2R_0 2024-09-12T01:21:57.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8200337090795269655', time=2024-09-12T03:08:47.826362+0000, chain.objs.size()=1 2024-09-12T01:21:57.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.tNGqu6uxVFO_Ry-B5zbHqJ01r-f22YZ_0 2024-09-12T01:21:57.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1471335088882839368', time=2024-09-12T03:08:47.910902+0000, chain.objs.size()=1 2024-09-12T01:21:57.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.kcBOWfBRCrTIKoArrDVaHG8XqLsapyP_0 2024-09-12T01:21:57.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15952105508868196064', time=2024-09-12T03:08:47.938236+0000, chain.objs.size()=1 2024-09-12T01:21:57.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.vD-vqG3R2Z5PvovqM3QyWGPV95LEfsd_0 2024-09-12T01:21:57.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.697661433611972345', time=2024-09-12T03:08:48.241947+0000, chain.objs.size()=1 2024-09-12T01:21:57.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.aihvQG-pcbZNz1iMPr12uGBfibN5dOF_0 2024-09-12T01:21:57.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9310848124890232147', time=2024-09-12T03:08:48.270915+0000, chain.objs.size()=1 2024-09-12T01:21:57.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Gi3_kWBlMUsQGphiD3-jw98P2Cb9b-W_0 2024-09-12T01:21:57.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7861564272892789389', time=2024-09-12T03:08:48.301813+0000, chain.objs.size()=1 2024-09-12T01:21:57.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.X0ayFQHDcIPX10rRAG0OJvGpXlaompH_0 2024-09-12T01:21:57.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16983960935078975422', time=2024-09-12T03:08:48.489383+0000, chain.objs.size()=1 2024-09-12T01:21:57.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.U-sMiBe9y0NHIiy-mE5MrJ--gotmMUo_0 2024-09-12T01:21:57.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3291433350313641717', time=2024-09-12T03:08:48.531291+0000, chain.objs.size()=1 2024-09-12T01:21:57.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.zS2WAkHB1iQ5e3wK7HAYESKq449a9If_0 2024-09-12T01:21:57.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14627436866852595362', time=2024-09-12T03:08:48.561975+0000, chain.objs.size()=1 2024-09-12T01:21:57.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.PuZMrKcaVecOWFyd0fB0hn_Tt4NReND_0 2024-09-12T01:21:57.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15731757939198942756', time=2024-09-12T03:08:48.569851+0000, chain.objs.size()=1 2024-09-12T01:21:57.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.O08gpMQKd3xqWbbuVuNzCC2rG-89QrD_0 2024-09-12T01:21:57.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9064108930007222370', time=2024-09-12T03:08:48.660842+0000, chain.objs.size()=1 2024-09-12T01:21:57.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.700+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_._YB3Aiu804TKdKKfUhvQTHGUnv_KBXS_0 2024-09-12T01:21:57.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.704+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17131203781805335165', time=2024-09-12T03:08:48.686935+0000, chain.objs.size()=1 2024-09-12T01:21:57.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.704+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.e5wcVC5BdTB_yF0BwkhW_aryQbEnzpB_0 2024-09-12T01:21:57.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.704+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5545884540142236504', time=2024-09-12T03:08:49.271242+0000, chain.objs.size()=1 2024-09-12T01:21:57.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.704+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.KXff1hIhN6YA3ETiqXEU11e2qq75tVy_0 2024-09-12T01:21:57.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.704+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13150517817226522931', time=2024-09-12T03:08:49.349903+0000, chain.objs.size()=1 2024-09-12T01:21:57.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.704+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.lb6ZnkbW59ULLXzdzV5EHXZden9cI1Y_0 2024-09-12T01:21:57.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.704+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12561363609312535969', time=2024-09-12T03:08:49.360609+0000, chain.objs.size()=1 2024-09-12T01:21:57.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.704+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.WiypYNL_jMBg2FDsxYzaSgrQwEeyTsE_0 2024-09-12T01:21:57.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.704+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13508348273562736566', time=2024-09-12T03:08:49.361340+0000, chain.objs.size()=1 2024-09-12T01:21:57.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.704+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.u9bQOLaa0n43zk6J1DPVz60MuSpZT9y_0 2024-09-12T01:21:57.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.704+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17078491201322763165', time=2024-09-12T03:08:49.598423+0000, chain.objs.size()=1 2024-09-12T01:21:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.704+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.QQN7rpB1NQ0vU_Wh76SpEd9MdfzGlyZ_0 2024-09-12T01:21:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.704+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9308661215656284696', time=2024-09-12T03:08:49.626907+0000, chain.objs.size()=1 2024-09-12T01:21:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.704+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.9798_5AF1I3c8fuzfk3AZOY6ye0ew2k_0 2024-09-12T01:21:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.704+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.799233897159181847', time=2024-09-12T03:08:49.629122+0000, chain.objs.size()=1 2024-09-12T01:21:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.704+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.YD0ThTtg8Cl18XMd13F9mSBca_kkX6__0 2024-09-12T01:21:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.704+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17793607754842828118', time=2024-09-12T03:08:49.644815+0000, chain.objs.size()=1 2024-09-12T01:21:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.704+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.-XPvrBg2lXies8GM1yCFom9GBTJ88EP_0 2024-09-12T01:21:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.704+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1823853329183142561', time=2024-09-12T03:08:49.651998+0000, chain.objs.size()=1 2024-09-12T01:21:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.704+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.7dH5SBTuoiUwLSEaCkqT4aSl_hAslWR_0 2024-09-12T01:21:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.704+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10873505554577451645', time=2024-09-12T03:08:49.675029+0000, chain.objs.size()=1 2024-09-12T01:21:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.704+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.3iBcMOhW8_oIa7Na2QL3u8BJvjlBSB__0 2024-09-12T01:21:57.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.704+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1198511999158520277', time=2024-09-12T03:08:49.677164+0000, chain.objs.size()=1 2024-09-12T01:21:57.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.704+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ytogoeP6dJGc4eRgRETshTkCQgMXLF2_0 2024-09-12T01:21:57.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13575604023468977798', time=2024-09-12T03:08:49.703838+0000, chain.objs.size()=1 2024-09-12T01:21:57.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.HEczHKqPfCe4PQZfMzBzhl51MWpYmQX_0 2024-09-12T01:21:57.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8797584167051894015', time=2024-09-12T03:08:49.715150+0000, chain.objs.size()=1 2024-09-12T01:21:57.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.F8SsvUdm6vckWLdYGM_MVXVt9DpSryk_0 2024-09-12T01:21:57.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8603857324387224574', time=2024-09-12T03:08:49.719493+0000, chain.objs.size()=1 2024-09-12T01:21:57.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.iGkQfMZ-w_1TRPBHIBObxndCNQRzqU6_0 2024-09-12T01:21:57.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17333414267027589861', time=2024-09-12T03:08:49.976277+0000, chain.objs.size()=1 2024-09-12T01:21:57.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.BitqHnemZqsUTjwHUU6NAAQHf5VTulg_0 2024-09-12T01:21:57.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1533393911315006269', time=2024-09-12T03:08:50.003857+0000, chain.objs.size()=1 2024-09-12T01:21:57.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.qNa3f3D4jwZjaL_cDZKmWKAY96Gp7U1_0 2024-09-12T01:21:57.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12994023356010529279', time=2024-09-12T03:08:50.004828+0000, chain.objs.size()=1 2024-09-12T01:21:57.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.0ruxRmk2xSGUhgSboam_CNRfcOFI4Td_0 2024-09-12T01:21:57.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15783187957248383271', time=2024-09-12T03:08:50.044066+0000, chain.objs.size()=1 2024-09-12T01:21:57.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.jjfY5H9x_PqEtmGDWC1Yy8gwkj8vJac_0 2024-09-12T01:21:57.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5738884700866083928', time=2024-09-12T03:08:51.321621+0000, chain.objs.size()=1 2024-09-12T01:21:57.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.265__shadow_.MWSm3QMCx-7k561AG4zVXHT_NozYe3X_0 2024-09-12T01:21:57.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9932702070946513828', time=2024-09-12T03:09:07.161039+0000, chain.objs.size()=1 2024-09-12T01:21:57.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.288__shadow_.BfLFVTIXlL0V0WU6JEGV0sBgyVzIwxT_0 2024-09-12T01:21:57.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14855294765301569864', time=2024-09-12T03:09:07.822981+0000, chain.objs.size()=1 2024-09-12T01:21:57.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.289__shadow_.Dy_FF1hR-NnAO31nVNwObtwYQahNtBY_0 2024-09-12T01:21:57.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14663188057108757143', time=2024-09-12T03:09:13.029476+0000, chain.objs.size()=1 2024-09-12T01:21:57.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.294__shadow_.-KN0lhNObC8IltRjDWjQdQd35r5LUQc_0 2024-09-12T01:21:57.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15853799758585278244', time=2024-09-12T03:09:13.067704+0000, chain.objs.size()=1 2024-09-12T01:21:57.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.294__shadow_.v3OsSgwfJagACXxrMsM5EGBSVu48dtg_0 2024-09-12T01:21:57.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5047600750889783093', time=2024-09-12T03:09:13.762060+0000, chain.objs.size()=1 2024-09-12T01:21:57.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.295__shadow_.RAJ6aqLBd7c7h13RyG4z6LIzkTkYR6m_0 2024-09-12T01:21:57.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.835242495409642020', time=2024-09-12T03:09:52.907006+0000, chain.objs.size()=1 2024-09-12T01:21:57.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.W99BWkv_azMukc13VKFTF3xOQPWAZfu_0 2024-09-12T01:21:57.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.976245783864424631', time=2024-09-12T03:09:53.307541+0000, chain.objs.size()=1 2024-09-12T01:21:57.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.XnO4A684RNtBV6zdqzkQ-ZPlg3GNN7n_0 2024-09-12T01:21:57.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17332546625304516571', time=2024-09-12T03:09:53.375315+0000, chain.objs.size()=1 2024-09-12T01:21:57.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.EpMzDzIWAOvC12mhRkHBPqYQZpBZSvn_0 2024-09-12T01:21:57.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12724821682200357492', time=2024-09-12T03:09:53.390368+0000, chain.objs.size()=1 2024-09-12T01:21:57.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.3Q62f_NyuKravO7941ph844TSHHmBKd_0 2024-09-12T01:21:57.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15510575298945986809', time=2024-09-12T03:09:53.400270+0000, chain.objs.size()=1 2024-09-12T01:21:57.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.VJnzoFsovxJkQrnzBXpLNsuRPe6uQXS_0 2024-09-12T01:21:57.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6532024590891891624', time=2024-09-12T03:09:53.484882+0000, chain.objs.size()=1 2024-09-12T01:21:57.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.zdsA1EYCxZgbOtS7NDAHgJpwsrWcOOf_0 2024-09-12T01:21:57.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18268695818318395874', time=2024-09-12T03:09:53.698445+0000, chain.objs.size()=1 2024-09-12T01:21:57.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Kwy1IVJCuRE_foHSoUGzVarn9FXGQC-_0 2024-09-12T01:21:57.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16274262407089640674', time=2024-09-12T03:09:53.800836+0000, chain.objs.size()=1 2024-09-12T01:21:57.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.P2CUOi0u0TlaaSLm3fezuC2ebAu8rif_0 2024-09-12T01:21:57.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7955901489583337891', time=2024-09-12T03:09:54.012792+0000, chain.objs.size()=1 2024-09-12T01:21:57.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.sCruTF7qLEjPp1kzB8rqEt-xcuYiZH2_0 2024-09-12T01:21:57.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15015361569898825705', time=2024-09-12T03:09:54.097674+0000, chain.objs.size()=1 2024-09-12T01:21:57.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.a8cL1meD5bgCkjxmGviyygrjBZaCsvv_0 2024-09-12T01:21:57.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16604049264898541749', time=2024-09-12T03:09:54.101180+0000, chain.objs.size()=1 2024-09-12T01:21:57.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.5DTo5S_SsuefRq2V_gSt8SZzKN8FzPf_0 2024-09-12T01:21:57.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4230258440562133830', time=2024-09-12T03:09:54.305349+0000, chain.objs.size()=1 2024-09-12T01:21:57.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.t8D3EsmLzffvqxw-6zDlThfo_vLBa_-_0 2024-09-12T01:21:57.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.708+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15107072625465236071', time=2024-09-12T03:09:54.307536+0000, chain.objs.size()=1 2024-09-12T01:21:57.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.PzKy7Q6BeZxxEfM1pe3_OPT6Ag-n1JR_0 2024-09-12T01:21:57.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1155036625585043009', time=2024-09-12T03:09:54.377578+0000, chain.objs.size()=1 2024-09-12T01:21:57.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Bjw3khT-zRs4Fn23JWkFBzHJ4iW5IR-_0 2024-09-12T01:21:57.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.714197184953580252', time=2024-09-12T03:09:54.380102+0000, chain.objs.size()=1 2024-09-12T01:21:57.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.0XKdlBtTYC4mnKd6UG9KxXMZFmGregr_0 2024-09-12T01:21:57.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8760818095999099905', time=2024-09-12T03:09:54.409320+0000, chain.objs.size()=1 2024-09-12T01:21:57.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.3pEsT4GOquVzH7bep07EQ0YTYaZVgul_0 2024-09-12T01:21:57.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13696315970987202211', time=2024-09-12T03:09:54.410226+0000, chain.objs.size()=1 2024-09-12T01:21:57.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.h3PTa1-DO0cxLYOVV6IEYdpjUaz3Jph_0 2024-09-12T01:21:57.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16817825620621240705', time=2024-09-12T03:09:54.683811+0000, chain.objs.size()=1 2024-09-12T01:21:57.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.3wGSfCQ8oMAf2No2xKmERVb5iOckE1L_0 2024-09-12T01:21:57.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12494516618937536469', time=2024-09-12T03:09:54.696020+0000, chain.objs.size()=1 2024-09-12T01:21:57.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.C6_UDoJOwUQWKOZb_ctmaexJlOx50Jj_0 2024-09-12T01:21:57.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16582500461514146730', time=2024-09-12T03:09:54.749098+0000, chain.objs.size()=1 2024-09-12T01:21:57.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.QZYwR3E4EswyDXn7C0pFcWTSPUjKhDr_0 2024-09-12T01:21:57.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7023335177735477260', time=2024-09-12T03:09:54.771562+0000, chain.objs.size()=1 2024-09-12T01:21:57.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.YOJhrwBzuDsQbMG5z4IfFSMmcFyZEef_0 2024-09-12T01:21:57.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4090453242610163949', time=2024-09-12T03:09:54.787718+0000, chain.objs.size()=1 2024-09-12T01:21:57.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.a-x5ym49rm0_ICnyyMRrnEm8kT5dyGN_0 2024-09-12T01:21:57.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5463993282587847946', time=2024-09-12T03:09:55.064838+0000, chain.objs.size()=1 2024-09-12T01:21:57.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.SwtAnXkLDD47Ny_UGdl_FJ4ndWEHzEQ_0 2024-09-12T01:21:57.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8893825911699290027', time=2024-09-12T03:09:55.075994+0000, chain.objs.size()=1 2024-09-12T01:21:57.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.c2LpiYNZMaGb2PGDKqtsl-AP97ZRMnD_0 2024-09-12T01:21:57.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1532756103680431657', time=2024-09-12T03:09:55.081344+0000, chain.objs.size()=1 2024-09-12T01:21:57.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.44hDsFJ8d3PB1RFlWp3x9MXujmKI7zn_0 2024-09-12T01:21:57.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5790102313940702313', time=2024-09-12T03:09:55.103712+0000, chain.objs.size()=1 2024-09-12T01:21:57.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.W_-fMUdYPkG5EU-d7atssyXGT3UWXar_0 2024-09-12T01:21:57.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10659410552737519743', time=2024-09-12T03:09:55.113380+0000, chain.objs.size()=1 2024-09-12T01:21:57.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.jXFM_AtC7av8I4gMWqD0KyoyBwR4GVP_0 2024-09-12T01:21:57.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4751878756458707454', time=2024-09-12T03:09:55.133816+0000, chain.objs.size()=1 2024-09-12T01:21:57.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.2iMHnNPrPWdqWb9Ovd1YuaO-aWTGeeK_0 2024-09-12T01:21:57.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1348207059472308350', time=2024-09-12T03:09:55.339119+0000, chain.objs.size()=1 2024-09-12T01:21:57.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.nicn7d73vsJfjdN7tIwp5JRPUBJ3Pyj_0 2024-09-12T01:21:57.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17068617868271948520', time=2024-09-12T03:09:55.362225+0000, chain.objs.size()=1 2024-09-12T01:21:57.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.DHM6Yq1ud8jKXumDhWHVSTG-_13DZe2_0 2024-09-12T01:21:57.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9549976264632273217', time=2024-09-12T03:09:55.367927+0000, chain.objs.size()=1 2024-09-12T01:21:57.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.QwLjJY7QSDJad1KfaUm0vFsgbMTe7aO_0 2024-09-12T01:21:57.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4590808420604679776', time=2024-09-12T03:09:55.369003+0000, chain.objs.size()=1 2024-09-12T01:21:57.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.mMR2dgjwlHhb62XRZaslSzACixIGMMt_0 2024-09-12T01:21:57.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1410397248802202973', time=2024-09-12T03:09:55.421288+0000, chain.objs.size()=1 2024-09-12T01:21:57.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.712+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.x6mG2qywzqtsHkVvY35CZvnfIAxCWzG_0 2024-09-12T01:21:57.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2326545981963383381', time=2024-09-12T03:10:15.253732+0000, chain.objs.size()=1 2024-09-12T01:21:57.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.SVX_pC6ABqs-0aNlgdINmHqv5dy5YND_0 2024-09-12T01:21:57.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1888221320197563462', time=2024-09-12T03:10:15.292681+0000, chain.objs.size()=1 2024-09-12T01:21:57.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.n0uaOVSEmT_U-j6VKNTE8YL4wRLKw8F_0 2024-09-12T01:21:57.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8324253718879700392', time=2024-09-12T03:10:15.343969+0000, chain.objs.size()=1 2024-09-12T01:21:57.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.fl794SLFchfej_5-5ncMf3Pvg0fqCYX_0 2024-09-12T01:21:57.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16315223467805090211', time=2024-09-12T03:10:15.375515+0000, chain.objs.size()=1 2024-09-12T01:21:57.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.JeF-UDbX1nUviDjepaejn6ARjXsVSX__0 2024-09-12T01:21:57.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.393447698399103188', time=2024-09-12T03:10:15.415361+0000, chain.objs.size()=1 2024-09-12T01:21:57.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.3FbRK-5GWjNcEMmbPxE5vF8YM8IV9pR_0 2024-09-12T01:21:57.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4368531770605883003', time=2024-09-12T03:10:15.436280+0000, chain.objs.size()=1 2024-09-12T01:21:57.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.fvTVFiEyxXdYZ7DBSIdRfG0IwktHGdv_0 2024-09-12T01:21:57.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10201740822487301511', time=2024-09-12T03:10:15.437139+0000, chain.objs.size()=1 2024-09-12T01:21:57.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.XM3rph4KSQfdXgfSy8utsKCtw0AwE1O_0 2024-09-12T01:21:57.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3262018856217064423', time=2024-09-12T03:10:15.582359+0000, chain.objs.size()=1 2024-09-12T01:21:57.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.uJhs0gYl55LQsGha_oo3HVfa5JvZW19_0 2024-09-12T01:21:57.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8940965552410953761', time=2024-09-12T03:10:15.615801+0000, chain.objs.size()=1 2024-09-12T01:21:57.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.4TDJguG3m2_-pI0NaZiNqnWXRgsN2Ae_0 2024-09-12T01:21:57.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15491132811251038604', time=2024-09-12T03:10:15.658141+0000, chain.objs.size()=1 2024-09-12T01:21:57.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.3ScNk5WF6Z45R1VrEp1VqzF7hpeJPXP_0 2024-09-12T01:21:57.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4201550197087085517', time=2024-09-12T03:10:15.676822+0000, chain.objs.size()=1 2024-09-12T01:21:57.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.8pisOqkrA4e-k3MdebJKQ5DHroOcoLB_0 2024-09-12T01:21:57.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14005955836397511196', time=2024-09-12T03:10:15.722712+0000, chain.objs.size()=1 2024-09-12T01:21:57.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.9u-D9gEerclgkdDRd0iapaBCaSngUHg_0 2024-09-12T01:21:57.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10114242920142378046', time=2024-09-12T03:10:15.723518+0000, chain.objs.size()=1 2024-09-12T01:21:57.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.rlsYjoxQTlUwyqZBSKBFkDwn12l8y0b_0 2024-09-12T01:21:57.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.513102901746847684', time=2024-09-12T03:10:15.770832+0000, chain.objs.size()=1 2024-09-12T01:21:57.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.EVdWp7dJh2JaUHZjS0jIkIkFNkfx0vQ_0 2024-09-12T01:21:57.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5054944648384379981', time=2024-09-12T03:10:15.897325+0000, chain.objs.size()=1 2024-09-12T01:21:57.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.qyLg2X7nPiKr4xKQWS0XCwVFrxXO7nD_0 2024-09-12T01:21:57.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11126363072741448085', time=2024-09-12T03:10:15.951205+0000, chain.objs.size()=1 2024-09-12T01:21:57.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.wRoC7d5LiRCd1jNENvk8GrUYnDuQfBq_0 2024-09-12T01:21:57.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17698832929099952282', time=2024-09-12T03:10:16.008185+0000, chain.objs.size()=1 2024-09-12T01:21:57.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.8tkOd-EK3iwqnMkTYddm30vTxoVJ7Oa_0 2024-09-12T01:21:57.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6272357438986047866', time=2024-09-12T03:10:16.039444+0000, chain.objs.size()=1 2024-09-12T01:21:57.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.iTeXk0pJg-wm2xroqwCKcjjUr8TAPqR_0 2024-09-12T01:21:57.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15481250295488286931', time=2024-09-12T03:10:16.210703+0000, chain.objs.size()=1 2024-09-12T01:21:57.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.sGIUYOKPSdMjye6RMopOivLs2i28eJS_0 2024-09-12T01:21:57.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10535956659460733246', time=2024-09-12T03:10:16.236821+0000, chain.objs.size()=1 2024-09-12T01:21:57.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.4ap1BQoRizZ_Xi5ZkM813sFbjedXGwd_0 2024-09-12T01:21:57.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12796930418055604222', time=2024-09-12T03:10:16.249943+0000, chain.objs.size()=1 2024-09-12T01:21:57.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.QD9lOcsJ76XtGSrRKj6xGUHNUDBESJR_0 2024-09-12T01:21:57.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.689147513445500243', time=2024-09-12T03:10:16.348932+0000, chain.objs.size()=1 2024-09-12T01:21:57.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.OU8eEsoeQqyRzgEkQ3LP_-qEZuNi-pz_0 2024-09-12T01:21:57.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3220770850786052320', time=2024-09-12T03:10:16.869081+0000, chain.objs.size()=1 2024-09-12T01:21:57.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.716+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.shT0MCBuQzJM955vPjXQG7zRTPZ5ct-_0 2024-09-12T01:21:57.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.720+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16739596656652105500', time=2024-09-12T03:10:16.903015+0000, chain.objs.size()=1 2024-09-12T01:21:57.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.720+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.pNsxwePkVswszRJehQ4-nsNUE49pu44_0 2024-09-12T01:21:57.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.720+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14253988470803430096', time=2024-09-12T03:10:16.917162+0000, chain.objs.size()=1 2024-09-12T01:21:57.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.720+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.JiMI9K1tBuPkIhe1oazvp0ffArjQvMS_0 2024-09-12T01:21:57.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.720+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5594769656337196756', time=2024-09-12T03:10:16.931356+0000, chain.objs.size()=1 2024-09-12T01:21:57.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.720+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.G4iZtudHQNjTW9pREW2fpm0HQQN8wkr_0 2024-09-12T01:21:57.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.720+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10602757184368431185', time=2024-09-12T03:10:17.003311+0000, chain.objs.size()=1 2024-09-12T01:21:57.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.720+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.pSmLvwX9drvUggrNjTipHi_o655-1Ym_0 2024-09-12T01:21:57.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.720+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44615 2024-09-12T01:21:57.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T01:21:57.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14401484920153302321', time=2024-09-12T03:10:17.335048+0000, chain.objs.size()=1 2024-09-12T01:21:57.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.6J2mGa_pNoWCBiz3o_tMHlsaycMqWtd_0 2024-09-12T01:21:57.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.739639967157117788', time=2024-09-12T03:10:17.438476+0000, chain.objs.size()=1 2024-09-12T01:21:57.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.y7u3sTJvq9BfOwTTiey134wJqqli4tq_0 2024-09-12T01:21:57.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13609016055299059434', time=2024-09-12T03:10:17.473299+0000, chain.objs.size()=1 2024-09-12T01:21:57.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.tjwKr_WG-SvVu9Rp8vAscyZMDXXpXCW_0 2024-09-12T01:21:57.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16965607092673753255', time=2024-09-12T03:10:17.542231+0000, chain.objs.size()=1 2024-09-12T01:21:57.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.BIJ3XDc4KC6UtUGIJ8ynyB-vPBkAcfo_0 2024-09-12T01:21:57.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4014180593571317155', time=2024-09-12T03:10:17.613291+0000, chain.objs.size()=1 2024-09-12T01:21:57.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.bk6Aa7JAf4aXN_wcm4pBseiBjm75P9C_0 2024-09-12T01:21:57.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18236185676548611972', time=2024-09-12T03:10:17.814440+0000, chain.objs.size()=1 2024-09-12T01:21:57.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.jUCWoBrcjrKp3U8jYRDQ9dv3jRwYqFg_0 2024-09-12T01:21:57.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18178841141601176305', time=2024-09-12T03:10:17.823985+0000, chain.objs.size()=1 2024-09-12T01:21:57.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.dZ45Z_uEqoDGTNEHBItt67CS4gicR1a_0 2024-09-12T01:21:57.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9561202956763653398', time=2024-09-12T03:10:17.886486+0000, chain.objs.size()=1 2024-09-12T01:21:57.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.MMtsKUtjck17xGJK-yzm9_IOZ89BOz4_0 2024-09-12T01:21:57.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4420632345671823186', time=2024-09-12T03:10:54.907610+0000, chain.objs.size()=1 2024-09-12T01:21:57.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.384__shadow_.GgFEYyx8P1Wr6HbgYBmdmg2lfJ9y6BP_0 2024-09-12T01:21:57.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11308902101622938457', time=2024-09-12T03:12:18.044806+0000, chain.objs.size()=1 2024-09-12T01:21:57.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.504__shadow:fzRg7xrdrpV0hjFUnNiyrRjat2TjEPZ_.vHz-mc05LslsPFizOQCh8qlCeQstO_b_0 2024-09-12T01:21:57.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10622061287134171264', time=2024-09-12T03:12:37.781224+0000, chain.objs.size()=3 2024-09-12T01:21:57.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.522__multipart_mymultipart.2~FUeMhpmSOLSKEJ8-p5HPsML3raQr8Mh.1 2024-09-12T01:21:57.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.522__multipart_mymultipart.2~FUeMhpmSOLSKEJ8-p5HPsML3raQr8Mh.2 2024-09-12T01:21:57.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.522__multipart_mymultipart.2~FUeMhpmSOLSKEJ8-p5HPsML3raQr8Mh.3 2024-09-12T01:21:57.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14983123587303985464', time=2024-09-12T03:13:47.715916+0000, chain.objs.size()=1 2024-09-12T01:21:57.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.551__shadow_.P3mhyRwIjT9oKFc9Ow2EZrsjytnKWiQ_0 2024-09-12T01:21:57.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1876799845480078469', time=2024-09-12T03:13:48.722673+0000, chain.objs.size()=1 2024-09-12T01:21:57.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.552__shadow_.RJ_5-_4YGsJ_ogS1xE5Nnn9v94J-CZW_0 2024-09-12T01:21:57.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13751715660804268940', time=2024-09-12T03:13:57.667151+0000, chain.objs.size()=1 2024-09-12T01:21:57.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.560__shadow_.Rx1vaCBxVLJyLOZfectUPVyrvLJTmUg_0 2024-09-12T01:21:57.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9831388136388839184', time=2024-09-12T03:14:14.496623+0000, chain.objs.size()=1 2024-09-12T01:21:57.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.724+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:lCo5J1uj-fmrlCDQbNT6.aKZ3FtYchh_.6eC5wliCH3SQWR8ZKZH5kTbJmtCPWXo_0 2024-09-12T01:21:57.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.728+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8014643476090640090', time=2024-09-12T03:14:38.382148+0000, chain.objs.size()=1 2024-09-12T01:21:57.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.728+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:yc5cal8LPAofn5CN-pvUH3bKHM.QyZd_.Zg1kc2BX_4POvbmBNxP2PSUK0QVLMP8_0 2024-09-12T01:21:57.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.728+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4311073720932002209', time=2024-09-12T03:14:53.778065+0000, chain.objs.size()=1 2024-09-12T01:21:57.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.728+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.581__shadow:W19j6HeAodlX9np4sXn.lWER--gj6zC_.rlE_sY18r6jtV4q0rKV0vhLCr7tBM8S_0 2024-09-12T01:21:57.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.728+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13538145445797553907', time=2024-09-12T03:14:59.069144+0000, chain.objs.size()=1 2024-09-12T01:21:57.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.728+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.588__shadow:v6kAIRDk4CR8Wj1H-lfMgesx7hmlR6w_.Yzmo5v1uKhxcxiIbVhurJ0ebTFMy68z_0 2024-09-12T01:21:57.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.728+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15865212413518385960', time=2024-09-12T03:15:10.031852+0000, chain.objs.size()=1 2024-09-12T01:21:57.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.728+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.606__shadow_.vMTjfp_M4s2SgAgfWF148YyCCpLBzvp_0 2024-09-12T01:21:57.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.728+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6650035191147617918', time=2024-09-12T03:17:30.770494+0000, chain.objs.size()=1 2024-09-12T01:21:57.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.728+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.620__shadow_.qGjWNxGC33KbPMPXZWeuyvwTTFaDxIl_0 2024-09-12T01:21:57.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.728+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.178339432830363260', time=2024-09-12T03:17:40.023747+0000, chain.objs.size()=1 2024-09-12T01:21:57.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.728+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.627__shadow_.MySOegrYGBHqk8vJP7M_sgJ1hjPbIui_0 2024-09-12T01:21:57.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.728+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1692100313030210734', time=2024-09-12T03:17:57.447291+0000, chain.objs.size()=1 2024-09-12T01:21:57.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.728+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.651__shadow_.OOV-yocUr01kVuIOzp22qY4bSKNtCfA_0 2024-09-12T01:21:57.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.728+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14244456770714714115', time=2024-09-12T03:18:25.901354+0000, chain.objs.size()=1 2024-09-12T01:21:57.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.728+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.693__shadow:xgZFwSi5dPI0ar1k9462tAcbFvDIH4e_.NqfMcuFJxooL5u5Bq2J5FOam6ioRPnS_0 2024-09-12T01:21:57.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.728+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14320290148535866147', time=2024-09-12T03:18:29.599390+0000, chain.objs.size()=1 2024-09-12T01:21:57.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.728+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.699__shadow:gOEpGJHu8gHp7.ku7gTw4cYgDGF9i6r_.oimWk2Yi5NR3gpt8APh0JdjaOUjgdV__0 2024-09-12T01:21:57.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.728+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11404597928032660080', time=2024-09-12T03:18:39.389061+0000, chain.objs.size()=1 2024-09-12T01:21:57.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.728+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.714__shadow:UwB24VnoB0uDRDXuY1xQI6ybeah5Hsz_.lfGLVNMFqyAwgCyhR-V4k04neUntRsZ_0 2024-09-12T01:21:57.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.732+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:57.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.732+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:21:57.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.732+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:57.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.732+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:57.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46738' 2024-09-12T01:21:57.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_F4zd0De-KimCpDJtEPk8fhbWu9TNMJ4', time=2024-09-12T03:05:58.886114+0000, chain.objs.size()=1 2024-09-12T01:21:57.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.161__shadow_._pM62WNUzJLkfzhhHnJhZ4RLFlsTdUu_0 2024-09-12T01:21:57.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1670860927953618926', time=2024-09-12T03:05:59.209867+0000, chain.objs.size()=2 2024-09-12T01:21:57.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.161__shadow_.cvQqHQpJ8YxvsDjTCuTnLjpQgQXqUWt_0 2024-09-12T01:21:57.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.161__shadow_.cvQqHQpJ8YxvsDjTCuTnLjpQgQXqUWt_1 2024-09-12T01:21:57.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6158802635880509296', time=2024-09-12T03:08:19.206518+0000, chain.objs.size()=1 2024-09-12T01:21:57.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.249__shadow_.nlvvJTlpGHSx1GxZHBpO2RCJQJmnGDn_0 2024-09-12T01:21:57.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10537202295623575396', time=2024-09-12T03:08:19.208790+0000, chain.objs.size()=1 2024-09-12T01:21:57.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.249__shadow_.SYL_2-9CLqrClf075d_lDSaTSAK3JZn_0 2024-09-12T01:21:57.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.363523473594968202', time=2024-09-12T03:08:21.917560+0000, chain.objs.size()=1 2024-09-12T01:21:57.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.253__shadow_.dFJeh1xDAO8GrLE3OIn0UTdMNiVp_jp_0 2024-09-12T01:21:57.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17478340720980171712', time=2024-09-12T03:08:47.452787+0000, chain.objs.size()=1 2024-09-12T01:21:57.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.3Vd-ujcD-Oy5svN81vsLnydALiY63lr_0 2024-09-12T01:21:57.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.568370406468530904', time=2024-09-12T03:08:47.468664+0000, chain.objs.size()=1 2024-09-12T01:21:57.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.yc1rw-MPCQUpjnPZTGdU8ZZ_zE_E91F_0 2024-09-12T01:21:57.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6366274211595373057', time=2024-09-12T03:08:47.489748+0000, chain.objs.size()=1 2024-09-12T01:21:57.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.L4UzFWoyWnrn9ZARQUQIzcF43r0Zbmy_0 2024-09-12T01:21:57.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9486617186510742564', time=2024-09-12T03:08:47.524869+0000, chain.objs.size()=1 2024-09-12T01:21:57.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.6yXrmCGsV1oBn1TJq5Snzl3pE8MDH2M_0 2024-09-12T01:21:57.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6965451931561870666', time=2024-09-12T03:08:47.553237+0000, chain.objs.size()=1 2024-09-12T01:21:57.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Zbc1KGnboErD9DAL3pVBoVVkXBl_lUX_0 2024-09-12T01:21:57.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9087339649304006466', time=2024-09-12T03:08:47.612376+0000, chain.objs.size()=1 2024-09-12T01:21:57.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.P298wiFEQWXOQbIK76s7K40GDpL6tyc_0 2024-09-12T01:21:57.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14421841497858621753', time=2024-09-12T03:08:47.886232+0000, chain.objs.size()=1 2024-09-12T01:21:57.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.J_IjCQquj_wtJWspSv2JWuEMnM6Yx-L_0 2024-09-12T01:21:57.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18442338021260109273', time=2024-09-12T03:08:48.005472+0000, chain.objs.size()=1 2024-09-12T01:21:57.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.JX5LHjgO5H8ovTVsg3hHKREQLwTvhUj_0 2024-09-12T01:21:57.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2056188244234280880', time=2024-09-12T03:08:48.012391+0000, chain.objs.size()=1 2024-09-12T01:21:57.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.muiEFWTefBW0xbcPVLV5fZFpwiy_EcV_0 2024-09-12T01:21:57.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.48345685556154376', time=2024-09-12T03:08:48.016878+0000, chain.objs.size()=1 2024-09-12T01:21:57.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.eWMDdkkRjhT8HBp_JBnzUx1hs5SZSY8_0 2024-09-12T01:21:57.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11505068620767391614', time=2024-09-12T03:08:48.148839+0000, chain.objs.size()=1 2024-09-12T01:21:57.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.2fN_EFWQVDKtJ8vsj9UP5D2Zexj10BB_0 2024-09-12T01:21:57.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11542981787777224710', time=2024-09-12T03:08:48.157606+0000, chain.objs.size()=1 2024-09-12T01:21:57.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ZLRdKoKgNRHRkiz0Rn3M_znsQ4_oblK_0 2024-09-12T01:21:57.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12027887868986921931', time=2024-09-12T03:08:48.277323+0000, chain.objs.size()=1 2024-09-12T01:21:57.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.0KDmOlGPEMNTXfBJuMxfRse_hCT_JqI_0 2024-09-12T01:21:57.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11533049845144046789', time=2024-09-12T03:08:48.587503+0000, chain.objs.size()=1 2024-09-12T01:21:57.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.4optBVx4IJityS6z8nxk_EE8nrpUd08_0 2024-09-12T01:21:57.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3219653727492835855', time=2024-09-12T03:08:48.617268+0000, chain.objs.size()=1 2024-09-12T01:21:57.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.yXNPeQbLPpQVWorNlO9IxH2ng4DrXOp_0 2024-09-12T01:21:57.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11602481178366846350', time=2024-09-12T03:08:48.645633+0000, chain.objs.size()=1 2024-09-12T01:21:57.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.wg5emqaj_QINytAmal2NDDvc4bc8phE_0 2024-09-12T01:21:57.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12750103543604933120', time=2024-09-12T03:08:48.653394+0000, chain.objs.size()=1 2024-09-12T01:21:57.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ON1se9o7O5Zn7qmUh8H-iDXB7nAPDLw_0 2024-09-12T01:21:57.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12521654083943656167', time=2024-09-12T03:08:48.675009+0000, chain.objs.size()=1 2024-09-12T01:21:57.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.736+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.16_0D5wuHzWvGw6KPN9dImYpFItZb5h_0 2024-09-12T01:21:57.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13409163270021779279', time=2024-09-12T03:08:48.690575+0000, chain.objs.size()=1 2024-09-12T01:21:57.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.7I_FACd3ay5qhO2Pq4CVta5FJnIj8h-_0 2024-09-12T01:21:57.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6450578228858867429', time=2024-09-12T03:08:48.893975+0000, chain.objs.size()=1 2024-09-12T01:21:57.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.qDITc0qcyjiLxeJusJpqgD1OSxoj8QA_0 2024-09-12T01:21:57.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14478511309638695738', time=2024-09-12T03:08:48.906252+0000, chain.objs.size()=1 2024-09-12T01:21:57.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.VEsqBm_Z0-VJ33PtLrAa_ljcOjXd3Dp_0 2024-09-12T01:21:57.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9451600211627008730', time=2024-09-12T03:08:48.958439+0000, chain.objs.size()=1 2024-09-12T01:21:57.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.xXV9BeYRdzUVoqHJLu_nUCmgncbYN1s_0 2024-09-12T01:21:57.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8563249289123760060', time=2024-09-12T03:08:48.961868+0000, chain.objs.size()=1 2024-09-12T01:21:57.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.3Zgfkm6yHRU6nleTnwyC9SXlsx7uuRK_0 2024-09-12T01:21:57.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15878288408484981109', time=2024-09-12T03:08:48.992198+0000, chain.objs.size()=1 2024-09-12T01:21:57.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.GmqG5oGIxwbUM6b5sKeEQGhYpti_cDU_0 2024-09-12T01:21:57.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13737643146169897806', time=2024-09-12T03:08:49.202395+0000, chain.objs.size()=1 2024-09-12T01:21:57.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.i4fgWDWlryqDkCeVSlZ_tPtch0jqT0o_0 2024-09-12T01:21:57.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5475264932641211682', time=2024-09-12T03:08:49.253665+0000, chain.objs.size()=1 2024-09-12T01:21:57.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.FuCVUO74z_tavQWVjzpU4grR04Kb9ZM_0 2024-09-12T01:21:57.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15242628072492999025', time=2024-09-12T03:08:49.282936+0000, chain.objs.size()=1 2024-09-12T01:21:57.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.bss7wYw8nmusXpTGKvxD2o2o_8Xkpa2_0 2024-09-12T01:21:57.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10963801873352849282', time=2024-09-12T03:08:49.321897+0000, chain.objs.size()=1 2024-09-12T01:21:57.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.d_ssh2QbAPGoQYoEXwuIu8PWgqivo9q_0 2024-09-12T01:21:57.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5905031016968639364', time=2024-09-12T03:08:49.633342+0000, chain.objs.size()=1 2024-09-12T01:21:57.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.q-xwp1HcZbd0hfs7Mml1-UJPEENyT73_0 2024-09-12T01:21:57.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3967957347138010717', time=2024-09-12T03:08:49.665666+0000, chain.objs.size()=1 2024-09-12T01:21:57.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.6v7FPO2ennqrj05WfIZu7CA6mihq9O__0 2024-09-12T01:21:57.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15653063803009149156', time=2024-09-12T03:08:49.734095+0000, chain.objs.size()=1 2024-09-12T01:21:57.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.0ZuC5i1BE3TIKjbFdtE8iv3oKbRXL2z_0 2024-09-12T01:21:57.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10028532631534656671', time=2024-09-12T03:08:49.989129+0000, chain.objs.size()=1 2024-09-12T01:21:57.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.jjdkHQUdJvivy65Bi7_bQ6KOihcjZsP_0 2024-09-12T01:21:57.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13780195987908739910', time=2024-09-12T03:08:49.996087+0000, chain.objs.size()=1 2024-09-12T01:21:57.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.pEL15lZnXBKEvodrud0vvMnYNGGyOOl_0 2024-09-12T01:21:57.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11952262120099584557', time=2024-09-12T03:08:50.018575+0000, chain.objs.size()=1 2024-09-12T01:21:57.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Si3aipKp9p8tUd1W9Rb2izp6zyomIwD_0 2024-09-12T01:21:57.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15605754426009180755', time=2024-09-12T03:08:50.022980+0000, chain.objs.size()=1 2024-09-12T01:21:57.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.b45uetwMYAuZ4XYYyefpcIQeh6cP3yG_0 2024-09-12T01:21:57.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.118867648359081741', time=2024-09-12T03:08:50.052628+0000, chain.objs.size()=1 2024-09-12T01:21:57.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Zd4zhhO1mo9Xo5_MAWy09mv1pPN2g5B_0 2024-09-12T01:21:57.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3744999759105541280', time=2024-09-12T03:09:05.043400+0000, chain.objs.size()=1 2024-09-12T01:21:57.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.285__shadow_.8v7v1Hdhy988djgxA7U9nNXK4b2mLHN_0 2024-09-12T01:21:57.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2144956397392238781', time=2024-09-12T03:09:05.744200+0000, chain.objs.size()=1 2024-09-12T01:21:57.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.286__shadow_.Ef5vhnzUPpt7fzMnvtjm2UhViL-MJsu_0 2024-09-12T01:21:57.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17978454736821316092', time=2024-09-12T03:09:15.120972+0000, chain.objs.size()=1 2024-09-12T01:21:57.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.297__shadow_.qQ1MVkndIjLxffkcDl5PRT0pc6wc5Bn_0 2024-09-12T01:21:57.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5795420302457830419', time=2024-09-12T03:09:53.005418+0000, chain.objs.size()=1 2024-09-12T01:21:57.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.740+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.9CYH_PpxtdGXmEL4NsXGyOaxZfqKMRM_0 2024-09-12T01:21:57.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10356193562679974136', time=2024-09-12T03:09:53.137014+0000, chain.objs.size()=1 2024-09-12T01:21:57.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.vqcxRzUXQfWA5Ri-Nb9BiCtfRY-43k2_0 2024-09-12T01:21:57.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10653653814845323760', time=2024-09-12T03:09:53.392862+0000, chain.objs.size()=1 2024-09-12T01:21:57.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.nbTKcVsAAClyQoqVDiN1dUGpXhv7Pry_0 2024-09-12T01:21:57.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14600296036713265813', time=2024-09-12T03:09:53.408211+0000, chain.objs.size()=1 2024-09-12T01:21:57.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.okRdgwGgD4CXmcbxefqiZJgZ8isqQnZ_0 2024-09-12T01:21:57.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13229494474280929111', time=2024-09-12T03:09:53.420123+0000, chain.objs.size()=1 2024-09-12T01:21:57.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.dPpLrFoKjcVePSN8eaGb-jTLCSHpv2j_0 2024-09-12T01:21:57.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17085767126133021697', time=2024-09-12T03:09:53.421666+0000, chain.objs.size()=1 2024-09-12T01:21:57.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.YsG2ztfs_QFmpZdA9jh_KKwButjdbhU_0 2024-09-12T01:21:57.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10726426109013077025', time=2024-09-12T03:09:53.429790+0000, chain.objs.size()=1 2024-09-12T01:21:57.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.YwayvkDj5YELIjT9quCZiU6oYGvaBzI_0 2024-09-12T01:21:57.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16523843962704894361', time=2024-09-12T03:09:53.434269+0000, chain.objs.size()=1 2024-09-12T01:21:57.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.LNLDaV_hBF8ZrGUKQ-6bMUPnHXY327a_0 2024-09-12T01:21:57.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3590432043886115488', time=2024-09-12T03:09:53.495025+0000, chain.objs.size()=1 2024-09-12T01:21:57.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.7PlD_U0hbTRb7TcmTup9ZNVn5nh5LYD_0 2024-09-12T01:21:57.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9367119358438695267', time=2024-09-12T03:09:53.674290+0000, chain.objs.size()=1 2024-09-12T01:21:57.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.pq57enVLXhKplGATlEG_bqv8X38pFtR_0 2024-09-12T01:21:57.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1759116479195896668', time=2024-09-12T03:09:53.739906+0000, chain.objs.size()=1 2024-09-12T01:21:57.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.X1Ax5D9p5G3lcd6wE881CCM7Pz_oswj_0 2024-09-12T01:21:57.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5437681144955875626', time=2024-09-12T03:09:53.821221+0000, chain.objs.size()=1 2024-09-12T01:21:57.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.zYEZIBUcznHUYbKKKjIIQElwZ-2kfBg_0 2024-09-12T01:21:57.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2955303942258938083', time=2024-09-12T03:09:53.828011+0000, chain.objs.size()=1 2024-09-12T01:21:57.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.eTCFeSHx3hEIhAE9Wff5a0aw9fKi10o_0 2024-09-12T01:21:57.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15137824909264094651', time=2024-09-12T03:09:53.976088+0000, chain.objs.size()=1 2024-09-12T01:21:57.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.jYT7GFIHTpP2lAJRm-OE-d8MiTQJofz_0 2024-09-12T01:21:57.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.945102178238002679', time=2024-09-12T03:09:54.039465+0000, chain.objs.size()=1 2024-09-12T01:21:57.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.t41AmRElUgeZB_l0Gzw4XMZFQgBOVSQ_0 2024-09-12T01:21:57.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2731741837143899634', time=2024-09-12T03:09:54.132863+0000, chain.objs.size()=1 2024-09-12T01:21:57.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.dUa_vT18KPAgISpgipxwsxGPjSqcBhr_0 2024-09-12T01:21:57.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14914916840444570941', time=2024-09-12T03:09:54.151742+0000, chain.objs.size()=1 2024-09-12T01:21:57.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.YiG1qVJYYF0kDZEj-2SyZJekP5ba7oZ_0 2024-09-12T01:21:57.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.112959296934887152', time=2024-09-12T03:09:54.443862+0000, chain.objs.size()=1 2024-09-12T01:21:57.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ByD8IldYfYW6uFEgzC3XlWzT73TP0j4_0 2024-09-12T01:21:57.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1955952932581718123', time=2024-09-12T03:09:54.448585+0000, chain.objs.size()=1 2024-09-12T01:21:57.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.UiCje-1cK2NQPiH4RYEENx1Z67WAo40_0 2024-09-12T01:21:57.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16152293701503744830', time=2024-09-12T03:09:54.470542+0000, chain.objs.size()=1 2024-09-12T01:21:57.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.wQ2rdQbyt8labBYy7gAhm-opJJEURPC_0 2024-09-12T01:21:57.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7504466118506100078', time=2024-09-12T03:09:54.480794+0000, chain.objs.size()=1 2024-09-12T01:21:57.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.64r0CXOGJ0OMDFxli8uhHo0wB3DnHbK_0 2024-09-12T01:21:57.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10757778644958604959', time=2024-09-12T03:09:54.628118+0000, chain.objs.size()=1 2024-09-12T01:21:57.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.T_XsrV7Nq3WIZk-9B0ifheantfk4mWf_0 2024-09-12T01:21:57.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14228399589849074064', time=2024-09-12T03:09:54.688989+0000, chain.objs.size()=1 2024-09-12T01:21:57.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.744+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.pPzahlQjdEhgXGkl9rDypkQcNknFaiY_0 2024-09-12T01:21:57.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.748+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3863325339695227249', time=2024-09-12T03:09:54.707123+0000, chain.objs.size()=1 2024-09-12T01:21:57.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.748+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Lr5N_38sPGW4ZvTj2kMKFBvkfn8eyS9_0 2024-09-12T01:21:57.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.748+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12684912155819288894', time=2024-09-12T03:09:54.800470+0000, chain.objs.size()=1 2024-09-12T01:21:57.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.748+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.6rp2woceGya4ImMm9iYjgBlw-yfwD4s_0 2024-09-12T01:21:57.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.748+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16109761634684301854', time=2024-09-12T03:09:55.058054+0000, chain.objs.size()=1 2024-09-12T01:21:57.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.748+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.4wVLVJKh36O2PwJZmizLMRHfpixE37j_0 2024-09-12T01:21:57.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.748+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12265771873668937498', time=2024-09-12T03:09:55.060906+0000, chain.objs.size()=1 2024-09-12T01:21:57.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.748+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.WpDPZbZsgTGGiEHzTvVd8kdBlJnTGHP_0 2024-09-12T01:21:57.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.748+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9351619569905683596', time=2024-09-12T03:09:55.103535+0000, chain.objs.size()=1 2024-09-12T01:21:57.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.748+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.vuRkbtudoojVtAkR6RghQFatCcEFrMh_0 2024-09-12T01:21:57.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.748+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8268529724281707062', time=2024-09-12T03:09:55.152971+0000, chain.objs.size()=1 2024-09-12T01:21:57.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.748+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.eIZi-5fQ0S60jp0qTT3s3knT4Az5GBY_0 2024-09-12T01:21:57.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.748+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4782413270826629116', time=2024-09-12T03:09:55.155839+0000, chain.objs.size()=1 2024-09-12T01:21:57.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.748+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.yGAPt4OU-kF1APnaBMttj-iWOe65tPV_0 2024-09-12T01:21:57.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.748+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11333053024863883471', time=2024-09-12T03:09:55.316053+0000, chain.objs.size()=1 2024-09-12T01:21:57.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.748+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.2pjgAkQLJ39BzG5H0T3uhbZlMiOlyek_0 2024-09-12T01:21:57.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.748+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14531345715674465975', time=2024-09-12T03:09:55.355717+0000, chain.objs.size()=1 2024-09-12T01:21:57.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.748+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.-JAI702NhcNHL7_xw02gbg9ob4PD-aR_0 2024-09-12T01:21:57.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.748+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15412615023503461264', time=2024-09-12T03:09:55.372834+0000, chain.objs.size()=1 2024-09-12T01:21:57.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.748+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.xPxg4OaIBG1QdQctbP3wPY1IxJKy4A2_0 2024-09-12T01:21:57.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.748+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8302978897898116825', time=2024-09-12T03:09:55.391680+0000, chain.objs.size()=1 2024-09-12T01:21:57.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.748+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.0XADtbglDbYwq9V8eQh-HDpSVesfTjz_0 2024-09-12T01:21:57.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.748+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8585785569051506675', time=2024-09-12T03:09:55.425746+0000, chain.objs.size()=1 2024-09-12T01:21:57.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.748+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.uOhqs-0k4Ig4e4hfBe7qiKtEmbG0AUq_0 2024-09-12T01:21:57.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.748+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16928344556023699634', time=2024-09-12T03:10:15.240863+0000, chain.objs.size()=1 2024-09-12T01:21:57.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.748+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.B7VNxE78i-0LHVB1ZQUpjFzqQ1K8uv0_0 2024-09-12T01:21:57.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9274992780862116672', time=2024-09-12T03:10:15.258513+0000, chain.objs.size()=1 2024-09-12T01:21:57.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.jTsMpVoHM8Uj4dUlC3aUqd-sLowo0Ou_0 2024-09-12T01:21:57.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13478400703281177017', time=2024-09-12T03:10:15.259888+0000, chain.objs.size()=1 2024-09-12T01:21:57.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.aPI_C27Tcx8YpQwzO1JomwOJBW6b-An_0 2024-09-12T01:21:57.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14322559959877301210', time=2024-09-12T03:10:15.282333+0000, chain.objs.size()=1 2024-09-12T01:21:57.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.B6ole-lAOCkL1XtdbJeLvo4CNR2lvWA_0 2024-09-12T01:21:57.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9822690815388679976', time=2024-09-12T03:10:15.299343+0000, chain.objs.size()=1 2024-09-12T01:21:57.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.VOsMb2DoD53PK8SVxrWy3xKag4WDpQA_0 2024-09-12T01:21:57.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8844971721658353428', time=2024-09-12T03:10:15.443054+0000, chain.objs.size()=1 2024-09-12T01:21:57.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.KUl0NmkIRmVpIm2l4PSAdZ081MJB8vs_0 2024-09-12T01:21:57.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15032512200012688349', time=2024-09-12T03:10:15.683022+0000, chain.objs.size()=1 2024-09-12T01:21:57.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Bj_kjnRCJOPFufqb9YYANTdqTc5KIVp_0 2024-09-12T01:21:57.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6202162929199711200', time=2024-09-12T03:10:15.698585+0000, chain.objs.size()=1 2024-09-12T01:21:57.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.-u5vutEcvXyHkpfNBy-lD9Y0aDN0ur4_0 2024-09-12T01:21:57.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3591500272889001243', time=2024-09-12T03:10:15.720861+0000, chain.objs.size()=1 2024-09-12T01:21:57.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.zDyICDleqa6KAepGRaFWzr0cFBXx61p_0 2024-09-12T01:21:57.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2524182372825496395', time=2024-09-12T03:10:15.878801+0000, chain.objs.size()=1 2024-09-12T01:21:57.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.RUqm_tBGdO54ND4mWu3JlyD9qy-MY6T_0 2024-09-12T01:21:57.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17146812983338943539', time=2024-09-12T03:10:15.899791+0000, chain.objs.size()=1 2024-09-12T01:21:57.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.sX6Gn3Y75o2wMli0Z4B5tR1hPS7sHnE_0 2024-09-12T01:21:57.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14394199569963555572', time=2024-09-12T03:10:15.936364+0000, chain.objs.size()=1 2024-09-12T01:21:57.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.1vZvfNwcM3cKVNyrv2H4VYdbyjG45Qt_0 2024-09-12T01:21:57.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2698890103214542481', time=2024-09-12T03:10:16.056200+0000, chain.objs.size()=1 2024-09-12T01:21:57.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.IA1HSyRoU6MIe5xNj9WulaxetU6aJ7i_0 2024-09-12T01:21:57.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12837082526087860506', time=2024-09-12T03:10:16.063199+0000, chain.objs.size()=1 2024-09-12T01:21:57.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.biOL6r1M8aJ1nshUx_Qcb8_gxnvtefg_0 2024-09-12T01:21:57.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.879881593036182659', time=2024-09-12T03:10:16.200552+0000, chain.objs.size()=1 2024-09-12T01:21:57.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.pyfyc2qUsPJX4WRs1kC2MaDnMH_QWrI_0 2024-09-12T01:21:57.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3945522238104122191', time=2024-09-12T03:10:16.253447+0000, chain.objs.size()=1 2024-09-12T01:21:57.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.WM5J--9UOwD47gwq5vRmvWs-VkZu-3A_0 2024-09-12T01:21:57.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4194173485785566789', time=2024-09-12T03:10:16.255389+0000, chain.objs.size()=1 2024-09-12T01:21:57.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.KJNESqHXENFSIU1Geb5cmyIsc2NYOBV_0 2024-09-12T01:21:57.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15886575112366006740', time=2024-09-12T03:10:16.286359+0000, chain.objs.size()=1 2024-09-12T01:21:57.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.fjIRcaRtL7_EJN0zdTgADNTiNPkUSAB_0 2024-09-12T01:21:57.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12880175558680668848', time=2024-09-12T03:10:16.297578+0000, chain.objs.size()=1 2024-09-12T01:21:57.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.rwDpQ9I9J_C4YArox2ZcXtE5mGW9KmC_0 2024-09-12T01:21:57.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10404642092032822682', time=2024-09-12T03:10:16.303297+0000, chain.objs.size()=1 2024-09-12T01:21:57.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.m1svJ_Lhg96_udhmgmzj5R13b8qF5qx_0 2024-09-12T01:21:57.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11717855893616383324', time=2024-09-12T03:10:16.334840+0000, chain.objs.size()=1 2024-09-12T01:21:57.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.752+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.siZsqvpqg9XUZIRu-zxDYPlHP5ziJE3_0 2024-09-12T01:21:57.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.756+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46738 2024-09-12T01:21:57.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.756+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-12T01:21:57.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.756+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14140468923212845233', time=2024-09-12T03:10:16.342458+0000, chain.objs.size()=1 2024-09-12T01:21:57.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.756+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.NqjGQ4OrVqSv0gNwf_X-p6fJF15XfSo_0 2024-09-12T01:21:57.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.756+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3562314970778287180', time=2024-09-12T03:10:16.586544+0000, chain.objs.size()=1 2024-09-12T01:21:57.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.756+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.PNwxGZ_siCtNMxPbMNcR3CLgG2Ctoh6_0 2024-09-12T01:21:57.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.756+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4400001781268691396', time=2024-09-12T03:10:16.814925+0000, chain.objs.size()=1 2024-09-12T01:21:57.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.756+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.8Ei_Y5QLYld23Kf01z0IdUHKcRml4qI_0 2024-09-12T01:21:57.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.756+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17110399443813030262', time=2024-09-12T03:10:16.884366+0000, chain.objs.size()=1 2024-09-12T01:21:57.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.756+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.M7GH1kQJwI_WdSQz4zPZulvITggCu18_0 2024-09-12T01:21:57.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.756+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10125418009985373090', time=2024-09-12T03:10:16.904492+0000, chain.objs.size()=1 2024-09-12T01:21:57.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.756+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.GvyMCXr9fPRuhz3OoUt-bUsQsqo4cCg_0 2024-09-12T01:21:57.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.756+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10617411929325636485', time=2024-09-12T03:10:16.925421+0000, chain.objs.size()=1 2024-09-12T01:21:57.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.756+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.evxmPvaZJhNSo1Oq5Qgfs0Y4-MyR2ly_0 2024-09-12T01:21:57.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.756+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14406111475802027146', time=2024-09-12T03:10:16.948054+0000, chain.objs.size()=1 2024-09-12T01:21:57.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.756+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.vsWKcN3WPG9YBVMEa2hMUqTE4n9isQG_0 2024-09-12T01:21:57.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.756+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14587770813335402445', time=2024-09-12T03:10:17.134000+0000, chain.objs.size()=1 2024-09-12T01:21:57.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.756+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.q2x3hXqVkdjX71pnsyKA2X4oT5ip22K_0 2024-09-12T01:21:57.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.756+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6659658568030689275', time=2024-09-12T03:10:17.142423+0000, chain.objs.size()=1 2024-09-12T01:21:57.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.756+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.bNXW0w64xq8gTHnCmh-tYQAKteFCHu3_0 2024-09-12T01:21:57.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.756+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9039913510556891196', time=2024-09-12T03:10:17.144322+0000, chain.objs.size()=1 2024-09-12T01:21:57.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.756+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.XSwztIEtMaeOF2lRUcdu7tFQJ28SPcT_0 2024-09-12T01:21:57.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.756+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16252834430670750053', time=2024-09-12T03:10:17.166514+0000, chain.objs.size()=1 2024-09-12T01:21:57.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.756+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.H_Buq5c4-lrV8Lj0Lt3jjWsYKxYMqGR_0 2024-09-12T01:21:57.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.756+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13302250604212772645', time=2024-09-12T03:10:17.199899+0000, chain.objs.size()=1 2024-09-12T01:21:57.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.756+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.zH6kklLq4RqhopGiWRvAJ6Dkk5JNFW9_0 2024-09-12T01:21:57.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15140747361025750003', time=2024-09-12T03:10:17.227690+0000, chain.objs.size()=1 2024-09-12T01:21:57.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.5wUagy33FGZ6F1596kVjD6EdeGXlg4D_0 2024-09-12T01:21:57.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13495518944793190709', time=2024-09-12T03:10:17.247265+0000, chain.objs.size()=1 2024-09-12T01:21:57.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.EfB5SUdD_7ZBs52hJJ75FcMdM2RR210_0 2024-09-12T01:21:57.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1737449110164007872', time=2024-09-12T03:10:17.850121+0000, chain.objs.size()=1 2024-09-12T01:21:57.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ZF3oPvW3LX-hpzntoGJR85LHDD-r0Ay_0 2024-09-12T01:21:57.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3192114939749543164', time=2024-09-12T03:10:17.876295+0000, chain.objs.size()=1 2024-09-12T01:21:57.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.2gNeIwEOSijggDvXQ4NJqU9SlhS9zTo_0 2024-09-12T01:21:57.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12008452764398547946', time=2024-09-12T03:11:11.930888+0000, chain.objs.size()=1 2024-09-12T01:21:57.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.408__shadow_.-HxLPsmmN0f7q6i3o5ulXYwvGt_ezly_0 2024-09-12T01:21:57.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4292727242305816573', time=2024-09-12T03:11:34.134071+0000, chain.objs.size()=1 2024-09-12T01:21:57.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.440__shadow_.SdOK0VJHyj1RaX7nbIFy4EOE0iK0u2__0 2024-09-12T01:21:57.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3888342577503965599', time=2024-09-12T03:12:05.775129+0000, chain.objs.size()=1 2024-09-12T01:21:57.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.485__shadow_.loPYr2fwBgkwfF7zw4LDnVnjWGmc2Sz_0 2024-09-12T01:21:57.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.604370981657298669', time=2024-09-12T03:12:13.580075+0000, chain.objs.size()=1 2024-09-12T01:21:57.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.497__shadow_.wSuVrt8P9skwtxQwMcONLHm4hCf6c1U_0 2024-09-12T01:21:57.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6416774593878663078', time=2024-09-12T03:12:55.674061+0000, chain.objs.size()=2 2024-09-12T01:21:57.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.524__multipart_mymultipart.2~jaRBqqYDMNHogCExPyRiy52cN5xZdZk.1 2024-09-12T01:21:57.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.524__multipart_mymultipart.2~jaRBqqYDMNHogCExPyRiy52cN5xZdZk.2 2024-09-12T01:21:57.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.83997949056431453', time=2024-09-12T03:13:55.155016+0000, chain.objs.size()=1 2024-09-12T01:21:57.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.558__shadow_.-nyjn3NONnoEXEd7iz7pAa_wLKuWd-J_0 2024-09-12T01:21:57.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4314713740642557046', time=2024-09-12T03:13:56.421345+0000, chain.objs.size()=1 2024-09-12T01:21:57.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.559__shadow_.mnrAccyaR2b2-xqzmXOwHiTdIhHgeYb_0 2024-09-12T01:21:57.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1534373386271669987', time=2024-09-12T03:13:58.980468+0000, chain.objs.size()=1 2024-09-12T01:21:57.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.562__multipart_mymultipart.2~a4g1HqNmSZnItfYNLbbA3k7QKqxrdGj.1 2024-09-12T01:21:57.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.239893403676018491', time=2024-09-12T03:14:29.507708+0000, chain.objs.size()=1 2024-09-12T01:21:57.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.577__shadow:l80jwpwJH19txcrAmnUELqn2VpW5DxE_.WzeJNUt4YWLxpMQixaNyxk9M6x7msF0_0 2024-09-12T01:21:57.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2929870112984789104', time=2024-09-12T03:14:32.338112+0000, chain.objs.size()=1 2024-09-12T01:21:57.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.760+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:k2qyYD373vLmVbvILU8sFoUltW4aC6q_.RDi328Y2LHZ33EGTWnklyO2dxu13P_3_0 2024-09-12T01:21:57.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.764+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8082721647802915791', time=2024-09-12T03:14:38.777072+0000, chain.objs.size()=1 2024-09-12T01:21:57.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:IFmE22mt7.ZxhrihlEahs0rvlyuBPuy_.DYBTPkz5DoUr6HT-7nde27et2Oyd-8P_0 2024-09-12T01:21:57.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.764+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2484396503815512443', time=2024-09-12T03:14:51.997684+0000, chain.objs.size()=1 2024-09-12T01:21:57.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.580__shadow:0GIGLlCHrhhnvI.5TvLpYCSPGlZ.CZ9_.NDNaNvdCsnrXjCCSV-Q9q-uUUydPl4G_0 2024-09-12T01:21:57.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.764+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17314504623587574987', time=2024-09-12T03:15:11.283236+0000, chain.objs.size()=1 2024-09-12T01:21:57.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.608__shadow_.Lr9tiqpARF_cEAuPoMB3U__Jl6Ht1TY_0 2024-09-12T01:21:57.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.764+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6554598385505051696', time=2024-09-12T03:17:30.146853+0000, chain.objs.size()=1 2024-09-12T01:21:57.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.619__shadow_.3K4iyR1MTDpyRW4UfnMWV7lXPJCLD0c_0 2024-09-12T01:21:57.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.764+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~D_FpTLw0S8bRrYH1-5-eg6DtJRd2fCR', time=2024-09-12T03:17:39.390727+0000, chain.objs.size()=6 2024-09-12T01:21:57.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.626__multipart_multipart_enc.2~D_FpTLw0S8bRrYH1-5-eg6DtJRd2fCR.1 2024-09-12T01:21:57.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.626__multipart_multipart_enc.2~D_FpTLw0S8bRrYH1-5-eg6DtJRd2fCR.2 2024-09-12T01:21:57.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.626__multipart_multipart_enc.2~D_FpTLw0S8bRrYH1-5-eg6DtJRd2fCR.3 2024-09-12T01:21:57.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.626__multipart_multipart_enc.2~D_FpTLw0S8bRrYH1-5-eg6DtJRd2fCR.4 2024-09-12T01:21:57.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.626__multipart_multipart_enc.2~D_FpTLw0S8bRrYH1-5-eg6DtJRd2fCR.5 2024-09-12T01:21:57.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.626__multipart_multipart_enc.2~D_FpTLw0S8bRrYH1-5-eg6DtJRd2fCR.6 2024-09-12T01:21:57.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.764+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16406186372868649919', time=2024-09-12T03:21:20.365189+0000, chain.objs.size()=1 2024-09-12T01:21:57.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.764+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.783__shadow_.Ah56ojX8OIdVN-hCK_wjxkcqe_Eqi6y_0 2024-09-12T01:21:57.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.768+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:57.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.768+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:21:57.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:57.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:57.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51708' 2024-09-12T01:21:57.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_UR7G_xyTt5ITSND9I4fwVm1t7XLmTUc', time=2024-09-12T03:06:00.833962+0000, chain.objs.size()=1 2024-09-12T01:21:57.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.162__shadow_.lzOIJlCYGxuaocupIqMoS-c6bLhw45i_0 2024-09-12T01:21:57.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7590285457186841599', time=2024-09-12T03:08:47.451474+0000, chain.objs.size()=1 2024-09-12T01:21:57.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.y9fewKngasxomTEuTTi6OaLiK84HiMA_0 2024-09-12T01:21:57.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11396277336594486109', time=2024-09-12T03:08:47.498383+0000, chain.objs.size()=1 2024-09-12T01:21:57.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.KObBZtGNTDOgMP7Su8bgBkB8Xx6lKor_0 2024-09-12T01:21:57.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10413608095404675338', time=2024-09-12T03:08:47.533500+0000, chain.objs.size()=1 2024-09-12T01:21:57.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.LwqUjLogQ4vQ_xVaSbpHiGAbCmWFPYh_0 2024-09-12T01:21:57.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14591587613135764595', time=2024-09-12T03:08:47.550143+0000, chain.objs.size()=1 2024-09-12T01:21:57.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.iwdDDBHjwUvA_i6v2-e-d65NFU0CKnK_0 2024-09-12T01:21:57.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3521838581587609278', time=2024-09-12T03:08:47.558865+0000, chain.objs.size()=1 2024-09-12T01:21:57.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.xB3X9zpIj06w5cK22vfOL-DXT82Aw18_0 2024-09-12T01:21:57.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9472596465292313690', time=2024-09-12T03:08:47.600023+0000, chain.objs.size()=1 2024-09-12T01:21:57.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.zQIrSvP87Fu9jocquM-bTdReAE5x9oP_0 2024-09-12T01:21:57.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3927952351476803551', time=2024-09-12T03:08:47.616858+0000, chain.objs.size()=1 2024-09-12T01:21:57.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.SWTrfGpK7dq5P5xHQKcD1IndeR7drWA_0 2024-09-12T01:21:57.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4307126056749035145', time=2024-09-12T03:08:47.651707+0000, chain.objs.size()=1 2024-09-12T01:21:57.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.niiQFOxt9hHvrCI9K0A0PDWJvRWlXMR_0 2024-09-12T01:21:57.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7750132789385284487', time=2024-09-12T03:08:47.672590+0000, chain.objs.size()=1 2024-09-12T01:21:57.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.mLUIHkndum_KDHFOo_8xdyxEb-ZABbT_0 2024-09-12T01:21:57.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3158178696616349257', time=2024-09-12T03:08:47.841277+0000, chain.objs.size()=1 2024-09-12T01:21:57.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.C1ups1ylknOsn_VZz__sccm47cKC3-c_0 2024-09-12T01:21:57.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11692565304769966704', time=2024-09-12T03:08:47.881122+0000, chain.objs.size()=1 2024-09-12T01:21:57.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.RxqwTTYT8ATckls1eOftZPvZwQ1wkQk_0 2024-09-12T01:21:57.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17467999303698101210', time=2024-09-12T03:08:47.903728+0000, chain.objs.size()=1 2024-09-12T01:21:57.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.772+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.6sQSm-wlrm7LPo8YolsrUyWa1UhS5BC_0 2024-09-12T01:21:57.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7794891337429522345', time=2024-09-12T03:08:47.951621+0000, chain.objs.size()=1 2024-09-12T01:21:57.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.JUzWmkd6mH5vzgDyjvXcS9WzSD6558C_0 2024-09-12T01:21:57.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3597261868427221912', time=2024-09-12T03:08:47.990845+0000, chain.objs.size()=1 2024-09-12T01:21:57.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.bnKjzN8cmk8LKeLmg3ZSW53Gf5zDJaS_0 2024-09-12T01:21:57.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12332602070590394538', time=2024-09-12T03:08:48.021996+0000, chain.objs.size()=1 2024-09-12T01:21:57.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.MN4YgvpbouKUrAu6-SccRFiaBsUgl9S_0 2024-09-12T01:21:57.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6891681021765899288', time=2024-09-12T03:08:48.161354+0000, chain.objs.size()=1 2024-09-12T01:21:57.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.GZ9DVUdd6V5KhCS-1HnM7oqycGJ7-ya_0 2024-09-12T01:21:57.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1608527912663596179', time=2024-09-12T03:08:48.183200+0000, chain.objs.size()=1 2024-09-12T01:21:57.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.8pxjHACZCIag4EkR4IRquKmohpDxEVu_0 2024-09-12T01:21:57.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16367790306021918913', time=2024-09-12T03:08:48.233533+0000, chain.objs.size()=1 2024-09-12T01:21:57.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.WPJU2R8wEB4T3FQ0yQLkv9J8mhOp29s_0 2024-09-12T01:21:57.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9914515005573955288', time=2024-09-12T03:08:48.310400+0000, chain.objs.size()=1 2024-09-12T01:21:57.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.qW3vrVmbOybkwiLBUH5a4dieMZ7PGst_0 2024-09-12T01:21:57.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14905189580374586162', time=2024-09-12T03:08:48.330793+0000, chain.objs.size()=1 2024-09-12T01:21:57.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.uc2smjj7nB9i8u2V98QOWsiYIjkCbRo_0 2024-09-12T01:21:57.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17450487938605627273', time=2024-09-12T03:08:48.539265+0000, chain.objs.size()=1 2024-09-12T01:21:57.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.qXQ1_rEI5BRQJuQ23HO8X_IG73zAFJm_0 2024-09-12T01:21:57.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16426276518782750647', time=2024-09-12T03:08:48.566195+0000, chain.objs.size()=1 2024-09-12T01:21:57.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.xE05C1D0Yj8LZVDHDpIkItdzsFVhV7I_0 2024-09-12T01:21:57.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.861154319629654257', time=2024-09-12T03:08:48.700954+0000, chain.objs.size()=1 2024-09-12T01:21:57.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.dIwllQAnBF6G1yd6Gai10wJ8sCkBefb_0 2024-09-12T01:21:57.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12512045780366264417', time=2024-09-12T03:08:48.921619+0000, chain.objs.size()=1 2024-09-12T01:21:57.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.iYs1bwqGoUkVXkjUkJvF2z_9aKjxleC_0 2024-09-12T01:21:57.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2116246255526773210', time=2024-09-12T03:08:48.943002+0000, chain.objs.size()=1 2024-09-12T01:21:57.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.6_c4pD_UdMtR9otCNnEBiEW0Q5f-Wot_0 2024-09-12T01:21:57.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5940338703283713520', time=2024-09-12T03:08:49.022145+0000, chain.objs.size()=1 2024-09-12T01:21:57.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.zMEgTK_3l8kXJMl7xZr0HMcMaQRbfHJ_0 2024-09-12T01:21:57.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4059379566040993036', time=2024-09-12T03:08:49.023635+0000, chain.objs.size()=1 2024-09-12T01:21:57.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.oCiD6Cn5McWWd4lms92aC5El5gYdi0f_0 2024-09-12T01:21:57.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10655814442968727397', time=2024-09-12T03:08:49.047890+0000, chain.objs.size()=1 2024-09-12T01:21:57.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.VQNej9XGYV5CPOC0KAjcUELrTXYzn1e_0 2024-09-12T01:21:57.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.986326067238910786', time=2024-09-12T03:08:49.179842+0000, chain.objs.size()=1 2024-09-12T01:21:57.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.O6EA7C4IXyp0xP8tbPZuMho5vSMosA6_0 2024-09-12T01:21:57.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11260683599633629359', time=2024-09-12T03:08:49.255276+0000, chain.objs.size()=1 2024-09-12T01:21:57.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.SYBdplZOcqMvpxF_fWcXhCVoGPT70Q1_0 2024-09-12T01:21:57.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16749095963844005235', time=2024-09-12T03:08:49.306726+0000, chain.objs.size()=1 2024-09-12T01:21:57.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.KaYTjcw1wJuWqxDW9CZxS2z4gjaAJXG_0 2024-09-12T01:21:57.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10678313695693663386', time=2024-09-12T03:08:49.317673+0000, chain.objs.size()=1 2024-09-12T01:21:57.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.EHQh4lVTscEZT7JCpPtw6xN0SAe79fU_0 2024-09-12T01:21:57.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18342980425255244829', time=2024-09-12T03:08:49.330494+0000, chain.objs.size()=1 2024-09-12T01:21:57.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.LeDt7Yp8hbaS3_7DhGMdfMnQXekcDWb_0 2024-09-12T01:21:57.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6040543681492377652', time=2024-09-12T03:08:49.331707+0000, chain.objs.size()=1 2024-09-12T01:21:57.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.sGLezBBhA6NoHwEqB9lo5rZ_J1JfuCr_0 2024-09-12T01:21:57.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6263414016581441699', time=2024-09-12T03:08:49.352294+0000, chain.objs.size()=1 2024-09-12T01:21:57.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.eB2u_-RqxwL7rbrzrCIFWG0B3xqqU2s_0 2024-09-12T01:21:57.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11651655603675351115', time=2024-09-12T03:08:49.561110+0000, chain.objs.size()=1 2024-09-12T01:21:57.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.776+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.0NTAUNE5s4t7hl81r3FpF027wbIAm7M_0 2024-09-12T01:21:57.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1543971272324364234', time=2024-09-12T03:08:49.640492+0000, chain.objs.size()=1 2024-09-12T01:21:57.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.0gwr3nxCcXctLwhyJS1qIRO8TKtpqIP_0 2024-09-12T01:21:57.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1149147498584903676', time=2024-09-12T03:08:49.746701+0000, chain.objs.size()=1 2024-09-12T01:21:57.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.-l4Dj0GdabF4YD8JIxLU6r5KRXBDpY-_0 2024-09-12T01:21:57.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.846378219421833121', time=2024-09-12T03:08:49.899586+0000, chain.objs.size()=1 2024-09-12T01:21:57.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.UTb_AW0-lv2W6tpnPOczLUc2P5UM7LM_0 2024-09-12T01:21:57.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6041751798674788633', time=2024-09-12T03:08:49.978988+0000, chain.objs.size()=1 2024-09-12T01:21:57.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.3G47PgoIqHbrNmU75Gv7ivdSiXu2R1y_0 2024-09-12T01:21:57.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17883192422033074285', time=2024-09-12T03:08:49.993121+0000, chain.objs.size()=1 2024-09-12T01:21:57.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.4FPEgR9U271xsR8OXs84ukyIoO8czGf_0 2024-09-12T01:21:57.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4474340337711937423', time=2024-09-12T03:08:49.998175+0000, chain.objs.size()=1 2024-09-12T01:21:57.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.8Dnfno-eT5eZLG2v-IWHiVxg_MogfZL_0 2024-09-12T01:21:57.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17220927746612465177', time=2024-09-12T03:08:50.046826+0000, chain.objs.size()=1 2024-09-12T01:21:57.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.TunodLY0YvbwM0KiPO_aMhiqBn1P8GV_0 2024-09-12T01:21:57.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8505627393755300372', time=2024-09-12T03:08:50.663251+0000, chain.objs.size()=1 2024-09-12T01:21:57.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.264__shadow_.BJPpyIt-0xFiMAjZFFqqSetlp3UNONc_0 2024-09-12T01:21:57.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18338132911137410381', time=2024-09-12T03:08:54.658831+0000, chain.objs.size()=1 2024-09-12T01:21:57.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.270__shadow_.Cml5DNsi_ZHGyr0VnSIApMMsVHGfnuG_0 2024-09-12T01:21:57.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6181747769829517575', time=2024-09-12T03:09:00.871957+0000, chain.objs.size()=1 2024-09-12T01:21:57.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.279__shadow_.PlpSdiQr60j_aAb6IaHP4vL2eMlyjyO_0 2024-09-12T01:21:57.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13182634405915755988', time=2024-09-12T03:09:21.487996+0000, chain.objs.size()=1 2024-09-12T01:21:57.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.306__shadow_.elqkjFWis3diuofvEIf8GZQ8RGpZHzs_0 2024-09-12T01:21:57.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3837906263749207186', time=2024-09-12T03:09:53.085631+0000, chain.objs.size()=1 2024-09-12T01:21:57.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.7wELNuX5ZkSgIi0cv5aYSz4fZdgdbFb_0 2024-09-12T01:21:57.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4997899627472641483', time=2024-09-12T03:09:53.098528+0000, chain.objs.size()=1 2024-09-12T01:21:57.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.92LO6EZ-erV184jet7O9T8Gwo9bi7pM_0 2024-09-12T01:21:57.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7945638741685362138', time=2024-09-12T03:09:53.105816+0000, chain.objs.size()=1 2024-09-12T01:21:57.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.8Ymx4GYIBlmKT-7FWOrj-ibiULHm97y_0 2024-09-12T01:21:57.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6114767703146446571', time=2024-09-12T03:09:53.439411+0000, chain.objs.size()=1 2024-09-12T01:21:57.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.okEESp5IFz8PXDiVT5dcP3K_xhdAevk_0 2024-09-12T01:21:57.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14562072658967979155', time=2024-09-12T03:09:53.476847+0000, chain.objs.size()=1 2024-09-12T01:21:57.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.780+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.hZp1jBiLm8i6ENvs44vDSOhjC5IXPSl_0 2024-09-12T01:21:57.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2676762093187951120', time=2024-09-12T03:09:53.639676+0000, chain.objs.size()=1 2024-09-12T01:21:57.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.s9mobPVn5RLcg3C0LnRt7iQUSBk_0ln_0 2024-09-12T01:21:57.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5887999504409920530', time=2024-09-12T03:09:53.747341+0000, chain.objs.size()=1 2024-09-12T01:21:57.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.OhXuCWPill5ISAUvu48exQrdo1Dw7cn_0 2024-09-12T01:21:57.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1923670954145080465', time=2024-09-12T03:09:53.771969+0000, chain.objs.size()=1 2024-09-12T01:21:57.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.mbWmbPm6Z1tMDgIDs8LxNHHvxEdGhw2_0 2024-09-12T01:21:57.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16690752858365860968', time=2024-09-12T03:09:54.091303+0000, chain.objs.size()=1 2024-09-12T01:21:57.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.m-wa_m0SRwF53BNzoFJsLIU_BabvOaJ_0 2024-09-12T01:21:57.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17070850115535459707', time=2024-09-12T03:09:54.361681+0000, chain.objs.size()=1 2024-09-12T01:21:57.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.jhi9fkNHAfflePQhOfesgoUcONds5oy_0 2024-09-12T01:21:57.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16474955139924135425', time=2024-09-12T03:09:54.457648+0000, chain.objs.size()=1 2024-09-12T01:21:57.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.5LzKQwW3bbOjfOf0hBx2ixNkRIXFP9v_0 2024-09-12T01:21:57.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2426789819192761354', time=2024-09-12T03:09:54.641116+0000, chain.objs.size()=1 2024-09-12T01:21:57.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_._5QsW9PvPgr6aCjb26LcrCRe-0l0XHP_0 2024-09-12T01:21:57.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11889181729554357879', time=2024-09-12T03:09:54.652125+0000, chain.objs.size()=1 2024-09-12T01:21:57.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.phpRMc7a9K2r8x7CBbB4XzeuHpW6pII_0 2024-09-12T01:21:57.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16152720931686382815', time=2024-09-12T03:09:54.655171+0000, chain.objs.size()=1 2024-09-12T01:21:57.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.oSjJb31sK7Q5owVgRhKKDel-seng2q8_0 2024-09-12T01:21:57.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12099343098979282619', time=2024-09-12T03:09:54.820030+0000, chain.objs.size()=1 2024-09-12T01:21:57.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.p12K2piGwykAwboa60lgMy4ncY5pDR4_0 2024-09-12T01:21:57.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16419157468880600571', time=2024-09-12T03:09:55.015232+0000, chain.objs.size()=1 2024-09-12T01:21:57.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.R92bmBaWwnuMCav_SIjkrJURy4_bKLq_0 2024-09-12T01:21:57.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16743378011957490885', time=2024-09-12T03:09:55.026909+0000, chain.objs.size()=1 2024-09-12T01:21:57.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.36GQgShyN-t0bRwSMVJN6QdMmgDJdJN_0 2024-09-12T01:21:57.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3159023398739583601', time=2024-09-12T03:09:55.044163+0000, chain.objs.size()=1 2024-09-12T01:21:57.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.02yRXQoHVaafsqiI6gjSjMqwU4vlXSv_0 2024-09-12T01:21:57.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11796493290696708211', time=2024-09-12T03:09:55.057450+0000, chain.objs.size()=1 2024-09-12T01:21:57.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.EumyAVkDWoTodwjITMvB5rTuN4iD_Dj_0 2024-09-12T01:21:57.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9197511907265802634', time=2024-09-12T03:09:55.088453+0000, chain.objs.size()=1 2024-09-12T01:21:57.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.8nTjC6bb6eribWAEbbuR_2cRo6ce4Fx_0 2024-09-12T01:21:57.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17625160250269702030', time=2024-09-12T03:09:55.093429+0000, chain.objs.size()=1 2024-09-12T01:21:57.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.HYAphb3w0KUpcnA3gxPZ1WK2YYgJZpx_0 2024-09-12T01:21:57.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16398650568291054786', time=2024-09-12T03:09:55.133923+0000, chain.objs.size()=1 2024-09-12T01:21:57.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.y8Up33wPnUEKiqHTUKUJ6NM6rZ9yhXl_0 2024-09-12T01:21:57.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1112334972802310270', time=2024-09-12T03:09:55.278210+0000, chain.objs.size()=1 2024-09-12T01:21:57.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.WBxDKu4qr_ilJ5AJZ1vb2wy06Hh3lzk_0 2024-09-12T01:21:57.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8464374676708294387', time=2024-09-12T03:09:55.310386+0000, chain.objs.size()=1 2024-09-12T01:21:57.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.vu-3NPdkx1C5Yi6y-MWk9VBhkszvEq0_0 2024-09-12T01:21:57.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12014663917681616441', time=2024-09-12T03:09:55.347305+0000, chain.objs.size()=1 2024-09-12T01:21:57.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.AQsnqLdAVeWsnPMKcQtDXTu3lP7dc7v_0 2024-09-12T01:21:57.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9454259991870738581', time=2024-09-12T03:09:55.388459+0000, chain.objs.size()=1 2024-09-12T01:21:57.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.LQDr8SUp75mKccDeea-O5xNRwZBjJ9C_0 2024-09-12T01:21:57.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4423852367981265742', time=2024-09-12T03:09:55.428743+0000, chain.objs.size()=1 2024-09-12T01:21:57.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.784+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.UJZcEVVFSR_TOJWVLjL5IgDfErP9v-R_0 2024-09-12T01:21:57.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11703481605775855271', time=2024-09-12T03:10:15.218692+0000, chain.objs.size()=1 2024-09-12T01:21:57.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.tgzqdu6_uijifp92TxxRic6MmagN180_0 2024-09-12T01:21:57.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5783029398790784036', time=2024-09-12T03:10:15.289497+0000, chain.objs.size()=1 2024-09-12T01:21:57.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.u3gaqAOjhSplTKrcd3paxBXQuIoXzi9_0 2024-09-12T01:21:57.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3485717879518484793', time=2024-09-12T03:10:15.391345+0000, chain.objs.size()=1 2024-09-12T01:21:57.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.1mfpZvRwF3Nq9ELhcvGO8gZEJveCQtl_0 2024-09-12T01:21:57.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5932384632190371224', time=2024-09-12T03:10:15.405027+0000, chain.objs.size()=1 2024-09-12T01:21:57.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Xyw_pBYpNMJRTAiv4mpBy_cfT7RrLsJ_0 2024-09-12T01:21:57.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.685811919104178586', time=2024-09-12T03:10:15.428140+0000, chain.objs.size()=1 2024-09-12T01:21:57.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.pC38YY2-Tdp-q2x40UdEuIjoD2bUrRB_0 2024-09-12T01:21:57.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3842213775993098454', time=2024-09-12T03:10:15.588961+0000, chain.objs.size()=1 2024-09-12T01:21:57.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.OI2O-rTsU3rxhZwyTGnoeQl5z0GTQHs_0 2024-09-12T01:21:57.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15594445899078021297', time=2024-09-12T03:10:15.602148+0000, chain.objs.size()=1 2024-09-12T01:21:57.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.mIjRpolhCrHGjDqjMvegL5wxeOSY0sd_0 2024-09-12T01:21:57.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10575429457264660240', time=2024-09-12T03:10:15.613703+0000, chain.objs.size()=1 2024-09-12T01:21:57.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ktAKXxBvps4wzO-4CyXASzUqdMFeza5_0 2024-09-12T01:21:57.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13222246101901482569', time=2024-09-12T03:10:15.707479+0000, chain.objs.size()=1 2024-09-12T01:21:57.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.4kvofPMAgXW4S9YFH6MxoupzXRv3BIw_0 2024-09-12T01:21:57.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7180649533149455394', time=2024-09-12T03:10:15.728358+0000, chain.objs.size()=1 2024-09-12T01:21:57.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.E0bfYXwW9T1f4zCvHrVK1XOxMDV7C3g_0 2024-09-12T01:21:57.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13331952506884993547', time=2024-09-12T03:10:15.752993+0000, chain.objs.size()=1 2024-09-12T01:21:57.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ZReSd-YsFtIV75v0M1I20mzjH28Xvr9_0 2024-09-12T01:21:57.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12773521776198788623', time=2024-09-12T03:10:15.937564+0000, chain.objs.size()=1 2024-09-12T01:21:57.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.kpRbNQsAHqocFkF5zsn4AIOKrjecNBH_0 2024-09-12T01:21:57.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11263590194251939759', time=2024-09-12T03:10:15.956501+0000, chain.objs.size()=1 2024-09-12T01:21:57.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.KBoAzQI--cxZ106Hfjrupi6Cs1ZSxTs_0 2024-09-12T01:21:57.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11350422762301465252', time=2024-09-12T03:10:15.994488+0000, chain.objs.size()=1 2024-09-12T01:21:57.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.NIoH6VMytsWrpnUmcvJlcdf-7mAezhj_0 2024-09-12T01:21:57.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.788+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17013649426610884145', time=2024-09-12T03:10:15.998572+0000, chain.objs.size()=1 2024-09-12T01:21:57.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.XLP8-_2krDR0ZTV5rcXrPDTBExoVdop_0 2024-09-12T01:21:57.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5270731227741239007', time=2024-09-12T03:10:16.055715+0000, chain.objs.size()=1 2024-09-12T01:21:57.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.BhHzP2egf7We4kTSWsfaXn1HsnYNdgV_0 2024-09-12T01:21:57.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10525660983938311644', time=2024-09-12T03:10:16.094316+0000, chain.objs.size()=1 2024-09-12T01:21:57.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.l-K915NZdKYtv9h13eMLW0a65Mmz2b6_0 2024-09-12T01:21:57.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5399328376013278006', time=2024-09-12T03:10:16.202850+0000, chain.objs.size()=1 2024-09-12T01:21:57.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.16q-jhVZvue5VvaJeMTA05Yh-If8lz3_0 2024-09-12T01:21:57.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16465826190660393682', time=2024-09-12T03:10:16.268553+0000, chain.objs.size()=1 2024-09-12T01:21:57.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.1vc2tfSxUsbyqNXTF2OBs6Ga8Do44sH_0 2024-09-12T01:21:57.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6630989834268975256', time=2024-09-12T03:10:16.366969+0000, chain.objs.size()=1 2024-09-12T01:21:57.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.K_V6rui2XQW7MaKyJ0IBNodpJ6L48j0_0 2024-09-12T01:21:57.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4943064137564622338', time=2024-09-12T03:10:16.957552+0000, chain.objs.size()=1 2024-09-12T01:21:57.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.4Lkyo8nvRJ3YeXSOWDskC-0G3bnDWdS_0 2024-09-12T01:21:57.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2457839969894469652', time=2024-09-12T03:10:16.972833+0000, chain.objs.size()=1 2024-09-12T01:21:57.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.-p3A50YTZbCjTSZhVimdvAb0tUtQRMj_0 2024-09-12T01:21:57.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10602189741733699571', time=2024-09-12T03:10:17.134577+0000, chain.objs.size()=1 2024-09-12T01:21:57.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.IQ74x3YCBp_7cC4HW24NAdsJ1uFSuYN_0 2024-09-12T01:21:57.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12205719428697619344', time=2024-09-12T03:10:17.151185+0000, chain.objs.size()=1 2024-09-12T01:21:57.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.oK7VrumYtaDDtFbjpsPPIOBZNokHA_C_0 2024-09-12T01:21:57.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.792+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1698547863163179081', time=2024-09-12T03:10:17.220070+0000, chain.objs.size()=1 2024-09-12T01:21:57.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.792+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.4jP08bqlcdaqfw-dqKHlW4yQy8HHbOn_0 2024-09-12T01:21:57.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51708 2024-09-12T01:21:57.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-12T01:21:57.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8986961015618694136', time=2024-09-12T03:10:17.251010+0000, chain.objs.size()=1 2024-09-12T01:21:57.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.3xtGzkJzt23fzGeWghSg3RQNOinfGEI_0 2024-09-12T01:21:57.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17593037096671584152', time=2024-09-12T03:10:17.336434+0000, chain.objs.size()=1 2024-09-12T01:21:57.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Z2cXoknEAvqgPS-H45H4MNuOgIRUSVD_0 2024-09-12T01:21:57.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6459565531140229745', time=2024-09-12T03:10:17.498537+0000, chain.objs.size()=1 2024-09-12T01:21:57.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.1zzGKnKsXX1nJsubMfhn-Py5C56BWkG_0 2024-09-12T01:21:57.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14200723495221800653', time=2024-09-12T03:10:17.512925+0000, chain.objs.size()=1 2024-09-12T01:21:57.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.yAyKgOYCq-bv5g3pftREwtnWniX4EK8_0 2024-09-12T01:21:57.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17618250343289185977', time=2024-09-12T03:10:17.537175+0000, chain.objs.size()=1 2024-09-12T01:21:57.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.znWTRQ78dRMnaWYx9xZK7rUy7ra_7DE_0 2024-09-12T01:21:57.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5115928112112140361', time=2024-09-12T03:10:17.629645+0000, chain.objs.size()=1 2024-09-12T01:21:57.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.WzRdd5k8FcDckqUtvIZwfPY7PFvbAcJ_0 2024-09-12T01:21:57.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13808903887783715743', time=2024-09-12T03:10:17.816609+0000, chain.objs.size()=1 2024-09-12T01:21:57.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.EPlPCeYDMrR3G0krig5hBEqE684pQsM_0 2024-09-12T01:21:57.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.109782658429612908', time=2024-09-12T03:10:22.789432+0000, chain.objs.size()=1 2024-09-12T01:21:57.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.333__shadow_.0BfJB7NgsaFxaTK6JSoQtlglp7J4H3m_0 2024-09-12T01:21:57.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2114490070458717581', time=2024-09-12T03:10:24.716403+0000, chain.objs.size()=1 2024-09-12T01:21:57.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.336__shadow_.I1eXIjS9S9PSzYVgbxYnKEyDi4yq49e_0 2024-09-12T01:21:57.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4959005716333360140', time=2024-09-12T03:10:50.319455+0000, chain.objs.size()=1 2024-09-12T01:21:57.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.378__shadow_.6fw3iPr-FaUNLjw9YG__Uc_aEAgUOS1_0 2024-09-12T01:21:57.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.932131219666081019', time=2024-09-12T03:10:52.174217+0000, chain.objs.size()=1 2024-09-12T01:21:57.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.380__shadow_.0yZ1oa0P34UuaH7pZo4ICOy_ZBfXXDo_0 2024-09-12T01:21:57.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11150738886524848971', time=2024-09-12T03:11:28.032091+0000, chain.objs.size()=1 2024-09-12T01:21:57.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.431__shadow_.Ou4wNXf7hnlFoV-7m-wYkHHbUJz5Dym_0 2024-09-12T01:21:57.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18297228982524012456', time=2024-09-12T03:11:35.459207+0000, chain.objs.size()=1 2024-09-12T01:21:57.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.442__shadow_.AM3lBjwcKclORU5tlC_RQYBh7hI3u5M_0 2024-09-12T01:21:57.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6968867279775015837', time=2024-09-12T03:11:55.091168+0000, chain.objs.size()=1 2024-09-12T01:21:57.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.796+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.465__shadow_.KY3wUq4NrFtc5u-914UnkylqWAqQfm5_0 2024-09-12T01:21:57.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3647685950019416843', time=2024-09-12T03:11:56.194500+0000, chain.objs.size()=1 2024-09-12T01:21:57.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.466__shadow_.vGmggr_mNYSb9eODECLhdeG0jvvl4Sq_0 2024-09-12T01:21:57.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16222711209884621469', time=2024-09-12T03:12:05.775580+0000, chain.objs.size()=1 2024-09-12T01:21:57.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.485__shadow_.VQXKPBpD7ciA4eSFLO0BCceE-N8OVSq_0 2024-09-12T01:21:57.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12489533200253517110', time=2024-09-12T03:12:08.832975+0000, chain.objs.size()=1 2024-09-12T01:21:57.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.489__shadow_.HxDP0mItCtDtfComTLVnCXFkhLAk6pk_0 2024-09-12T01:21:57.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1621919579459280063', time=2024-09-12T03:12:26.875783+0000, chain.objs.size()=1 2024-09-12T01:21:57.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.516__shadow_.hlJqHEfqd2aD0QOj4VgmEUQDv0LvwAq_0 2024-09-12T01:21:57.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4269005005252833484', time=2024-09-12T03:12:56.792106+0000, chain.objs.size()=3 2024-09-12T01:21:57.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.524__multipart_mymultipart.2~sQ0TwKdGZWt3OEMFsOeO0W5zBBU5UY2.1 2024-09-12T01:21:57.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.524__multipart_mymultipart.2~sQ0TwKdGZWt3OEMFsOeO0W5zBBU5UY2.2 2024-09-12T01:21:57.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.524__multipart_mymultipart.2~sQ0TwKdGZWt3OEMFsOeO0W5zBBU5UY2.3 2024-09-12T01:21:57.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16620208379020683898', time=2024-09-12T03:12:59.421775+0000, chain.objs.size()=2 2024-09-12T01:21:57.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.526__multipart_mymultipart.2~okQeSvOTMFJ0TcDpKyDi4HIr1gO--Qd.1 2024-09-12T01:21:57.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.526__multipart_mymultipart.2~okQeSvOTMFJ0TcDpKyDi4HIr1gO--Qd.2 2024-09-12T01:21:57.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16037533557933864202', time=2024-09-12T03:14:24.105094+0000, chain.objs.size()=1 2024-09-12T01:21:57.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.575__shadow:HdYDyvG8Ralo4DK.djutrot8JbpZ7AE_.zXfhMwwHJS6KeOFk4i-DnUyupUyx8zR_0 2024-09-12T01:21:57.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13500246061445628165', time=2024-09-12T03:14:32.816797+0000, chain.objs.size()=1 2024-09-12T01:21:57.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:G7Jn9aC21kg-c580FAfuFV5eYFIP-no_.RRMZySq0Glg-NYEt7ChOyDwSvhnUh1__0 2024-09-12T01:21:57.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7265480841231711639', time=2024-09-12T03:14:38.204998+0000, chain.objs.size()=1 2024-09-12T01:21:57.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:SXoldK493WSl3EFJf2xqkS8R9qvTIEN_.CWoQt82tVGINrkpFIvQw9qQ_DCuhCzV_0 2024-09-12T01:21:57.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10268765198547219264', time=2024-09-12T03:14:58.989785+0000, chain.objs.size()=1 2024-09-12T01:21:57.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.588__shadow:cEqAJlZuH4JH71W5HVycsSsZp0lTxPo_.eWhSVWD8Wk6DaFp85v9gjaJ0za3sb0u_0 2024-09-12T01:21:57.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6730047067975463596', time=2024-09-12T03:14:59.076940+0000, chain.objs.size()=1 2024-09-12T01:21:57.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.588__shadow:v5gQJN0Uqx0xs5bPVueM4dHNG8WKXZj_.lDED_WVIBKctQvAVRPXqgfQrxTqIlkd_0 2024-09-12T01:21:57.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5376453527606595964', time=2024-09-12T03:18:27.668220+0000, chain.objs.size()=1 2024-09-12T01:21:57.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.696__shadow_.D3FhECryrNh0pezLJc8A7YpjS5bYYtU_0 2024-09-12T01:21:57.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9397390939293636162', time=2024-09-12T03:18:50.549515+0000, chain.objs.size()=1 2024-09-12T01:21:57.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.716__shadow:ivWZetjLS0YBNg4hRiZMIrUTI1C0MA9_.ee_tIqqZSvIn4BlUp95QN-Na2cL8aA7_0 2024-09-12T01:21:57.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5699886895802370092', time=2024-09-12T03:19:13.655383+0000, chain.objs.size()=10 2024-09-12T01:21:57.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.736__multipart_foo.2~XtgzI_2VpwS9SM3ZJ24lRRW7H5MbgaH.1 2024-09-12T01:21:57.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.736__multipart_foo.2~XtgzI_2VpwS9SM3ZJ24lRRW7H5MbgaH.2 2024-09-12T01:21:57.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.736__multipart_foo.2~XtgzI_2VpwS9SM3ZJ24lRRW7H5MbgaH.3 2024-09-12T01:21:57.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.736__multipart_foo.2~XtgzI_2VpwS9SM3ZJ24lRRW7H5MbgaH.4 2024-09-12T01:21:57.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.736__multipart_foo.2~XtgzI_2VpwS9SM3ZJ24lRRW7H5MbgaH.5 2024-09-12T01:21:57.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.736__multipart_foo.2~XtgzI_2VpwS9SM3ZJ24lRRW7H5MbgaH.6 2024-09-12T01:21:57.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.736__multipart_foo.2~XtgzI_2VpwS9SM3ZJ24lRRW7H5MbgaH.7 2024-09-12T01:21:57.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.800+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.736__multipart_foo.2~XtgzI_2VpwS9SM3ZJ24lRRW7H5MbgaH.8 2024-09-12T01:21:57.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.804+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.736__multipart_foo.2~XtgzI_2VpwS9SM3ZJ24lRRW7H5MbgaH.9 2024-09-12T01:21:57.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.804+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.736__multipart_foo.2~XtgzI_2VpwS9SM3ZJ24lRRW7H5MbgaH.10 2024-09-12T01:21:57.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.804+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:57.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:21:57.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:57.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:57.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48045' 2024-09-12T01:21:57.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17550555715157832882', time=2024-09-12T03:08:09.118413+0000, chain.objs.size()=1 2024-09-12T01:21:57.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.237__shadow_.fpkoWCRvtRUiGw2dWnaW08vjYhjP-QK_0 2024-09-12T01:21:57.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12448655939300744539', time=2024-09-12T03:08:14.134514+0000, chain.objs.size()=1 2024-09-12T01:21:57.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.243__shadow_.kQKT9PWdV8g3Kh3KSNH07An9lOmn3rT_0 2024-09-12T01:21:57.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8361712242863596152', time=2024-09-12T03:08:21.243288+0000, chain.objs.size()=1 2024-09-12T01:21:57.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.252__shadow_.QhvLxkJ4Y2A0Pal-pliPifICmWY_7O9_0 2024-09-12T01:21:57.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5530995429870576696', time=2024-09-12T03:08:26.739919+0000, chain.objs.size()=1 2024-09-12T01:21:57.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.260__shadow_.8I8T0KDS2uOPvvThRg9bVq59aYUZkgg_0 2024-09-12T01:21:57.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7371746808754268241', time=2024-09-12T03:08:27.445058+0000, chain.objs.size()=1 2024-09-12T01:21:57.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.261__shadow_.97N0bsXtKOeV1FWwNoYIdP2UKlKOMrt_0 2024-09-12T01:21:57.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3861704513728224663', time=2024-09-12T03:08:47.462306+0000, chain.objs.size()=1 2024-09-12T01:21:57.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.SHNNEpjDT04ynf3BYjBpeqDzxmByrU5_0 2024-09-12T01:21:57.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12035320277860189667', time=2024-09-12T03:08:47.464508+0000, chain.objs.size()=1 2024-09-12T01:21:57.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.7_1kr4t-p12WrqTe8FbDOcsygm7sfX-_0 2024-09-12T01:21:57.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2827561563592257092', time=2024-09-12T03:08:47.520326+0000, chain.objs.size()=1 2024-09-12T01:21:57.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.LM6gmAeJSW2hA82yubN8Rov4uyFavSk_0 2024-09-12T01:21:57.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5250675660879432485', time=2024-09-12T03:08:47.799653+0000, chain.objs.size()=1 2024-09-12T01:21:57.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.VNV3ZXO58VfowQAOM8sbL0wjeuglZcA_0 2024-09-12T01:21:57.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9959337802536762806', time=2024-09-12T03:08:47.920980+0000, chain.objs.size()=1 2024-09-12T01:21:57.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.d44xxGZpitSsxkBrrtetxo1INIr6xEO_0 2024-09-12T01:21:57.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9747855069640521777', time=2024-09-12T03:08:47.954811+0000, chain.objs.size()=1 2024-09-12T01:21:57.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.4T0MX7exPODN6BWD0nUEkbigExrWmQ-_0 2024-09-12T01:21:57.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6746645792620355275', time=2024-09-12T03:08:47.966719+0000, chain.objs.size()=1 2024-09-12T01:21:57.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.808+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.7M4TveBqLv4tZjnX1WW6SFL8TzJj-HO_0 2024-09-12T01:21:57.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15107212139979682475', time=2024-09-12T03:08:47.983986+0000, chain.objs.size()=1 2024-09-12T01:21:57.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.sAF6rDacIJ6PbGTCIkuF-Q05RvJkdDG_0 2024-09-12T01:21:57.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17127462902588487924', time=2024-09-12T03:08:48.240102+0000, chain.objs.size()=1 2024-09-12T01:21:57.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Yq9mPUeqFBGxJuLxn2Mz8YD_7_Ivb0w_0 2024-09-12T01:21:57.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7230630359910615248', time=2024-09-12T03:08:48.333142+0000, chain.objs.size()=1 2024-09-12T01:21:57.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.bclM5hbjtEVGjwKIvtr0eRhiYeRD4jz_0 2024-09-12T01:21:57.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14476067967375638751', time=2024-09-12T03:08:48.491396+0000, chain.objs.size()=1 2024-09-12T01:21:57.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.sJCo5vOHRarKIa7Ak3yPbfCIzafU77s_0 2024-09-12T01:21:57.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18386991595896795109', time=2024-09-12T03:08:48.598650+0000, chain.objs.size()=1 2024-09-12T01:21:57.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.p825YJWmYCbcaKOJjR7biDM6CTk7XUt_0 2024-09-12T01:21:57.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16958549257272015944', time=2024-09-12T03:08:48.603334+0000, chain.objs.size()=1 2024-09-12T01:21:57.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.JzMGmGwGoe3dA9AaPj4-HFQi8BypFaj_0 2024-09-12T01:21:57.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.178143756884086806', time=2024-09-12T03:08:48.666712+0000, chain.objs.size()=1 2024-09-12T01:21:57.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Fni_z2C7s1iayG9QxhHve0gbB9NmOcu_0 2024-09-12T01:21:57.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12718343330468408572', time=2024-09-12T03:08:48.697456+0000, chain.objs.size()=1 2024-09-12T01:21:57.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.HwI3z72N4GHRTz4ETnauNTFKPiE6QSg_0 2024-09-12T01:21:57.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5589616606592394927', time=2024-09-12T03:08:48.701091+0000, chain.objs.size()=1 2024-09-12T01:21:57.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.t7AA_grJ_rdSZnaQ2XVLg8pBMfT97gE_0 2024-09-12T01:21:57.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7069133146064040684', time=2024-09-12T03:08:48.842934+0000, chain.objs.size()=1 2024-09-12T01:21:57.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.X8FpiDK76T5s7BIbIVmjA4wW2hGkxG6_0 2024-09-12T01:21:57.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.437863857561099732', time=2024-09-12T03:08:48.854990+0000, chain.objs.size()=1 2024-09-12T01:21:57.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.KS8CYpfw4xrZO1IG7vXSMgjfkpp9EgZ_0 2024-09-12T01:21:57.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1965962047791175052', time=2024-09-12T03:08:48.968569+0000, chain.objs.size()=1 2024-09-12T01:21:57.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.bJK_XCJ97oPwtopYaKkWJnRM5RkCebw_0 2024-09-12T01:21:57.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4298526968862080710', time=2024-09-12T03:08:49.002947+0000, chain.objs.size()=1 2024-09-12T01:21:57.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.MpWHcZNgEL2lFW2avMeZg5EXMSTMWeZ_0 2024-09-12T01:21:57.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6784524891683001979', time=2024-09-12T03:08:49.013693+0000, chain.objs.size()=1 2024-09-12T01:21:57.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.tG4vVkGYY9PjeOnKW_GFdppATF79vkZ_0 2024-09-12T01:21:57.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11424708445136057966', time=2024-09-12T03:08:49.165727+0000, chain.objs.size()=1 2024-09-12T01:21:57.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.-utNIaTtEbrbxVWpqQLTqwD3cpvmnGq_0 2024-09-12T01:21:57.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1385616697755892018', time=2024-09-12T03:08:49.252744+0000, chain.objs.size()=1 2024-09-12T01:21:57.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.vih0eAStTWf5FkvqORWkw5HjzUEstiF_0 2024-09-12T01:21:57.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4731755092357536302', time=2024-09-12T03:08:49.568147+0000, chain.objs.size()=1 2024-09-12T01:21:57.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.812+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.MMcGnPRHQblHVaQSz34v1rq1g1gOSTy_0 2024-09-12T01:21:57.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6725616952783193299', time=2024-09-12T03:08:49.583670+0000, chain.objs.size()=1 2024-09-12T01:21:57.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.voGSY7ZWoFJO5iVH3Iwfaun2chJZNEe_0 2024-09-12T01:21:57.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3494349409694765893', time=2024-09-12T03:08:49.585812+0000, chain.objs.size()=1 2024-09-12T01:21:57.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.zktAMAKQve5eT4jC_gxAoaEmQDdX9r7_0 2024-09-12T01:21:57.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14031598915968316848', time=2024-09-12T03:08:49.594233+0000, chain.objs.size()=1 2024-09-12T01:21:57.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.JM3eqpA_DWsAGrpxXL2aGQ6oaEJesO__0 2024-09-12T01:21:57.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7593331349422035844', time=2024-09-12T03:08:49.613135+0000, chain.objs.size()=1 2024-09-12T01:21:57.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.EeFAsMouc8UeaID2Nu96vqcr2stba-c_0 2024-09-12T01:21:57.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7745470409134002716', time=2024-09-12T03:08:49.633336+0000, chain.objs.size()=1 2024-09-12T01:21:57.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.1uWq9Rzfo6-9KqyTaEXDc7NDaLrx2PW_0 2024-09-12T01:21:57.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.29324597580114261', time=2024-09-12T03:08:49.703714+0000, chain.objs.size()=1 2024-09-12T01:21:57.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.N7vtP_-NymdMzK7BOVWJ-JKM9g-d4o3_0 2024-09-12T01:21:57.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.431775326553897537', time=2024-09-12T03:08:49.949621+0000, chain.objs.size()=1 2024-09-12T01:21:57.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.NvWmH2HO9xVF5JE46QSwGtd0THgkEGR_0 2024-09-12T01:21:57.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9277139235482513703', time=2024-09-12T03:08:49.971103+0000, chain.objs.size()=1 2024-09-12T01:21:57.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.HrT3WXzRj97YV7UmisGt5iEBcuu3eBl_0 2024-09-12T01:21:57.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14958345368443166467', time=2024-09-12T03:08:50.022138+0000, chain.objs.size()=1 2024-09-12T01:21:57.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.bCoczFar1jGuQt16jZjZ_5PJ0kexV8k_0 2024-09-12T01:21:57.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8411493343492625194', time=2024-09-12T03:08:57.357496+0000, chain.objs.size()=1 2024-09-12T01:21:57.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.274__shadow_.coS2ufHSl_N9ibpxAoJVKH1J36bPJv__0 2024-09-12T01:21:57.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15257007649627159623', time=2024-09-12T03:09:13.040259+0000, chain.objs.size()=1 2024-09-12T01:21:57.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.294__shadow_.1n1A1s_igOPh8f-gtnZVPbY5O8jUMFV_0 2024-09-12T01:21:57.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.583382493353648563', time=2024-09-12T03:09:13.043395+0000, chain.objs.size()=1 2024-09-12T01:21:57.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.294__shadow_.TO3lgRadc0LZJvlDIvd9yexBWy0lqUb_0 2024-09-12T01:21:57.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14370282657699490321', time=2024-09-12T03:09:13.045620+0000, chain.objs.size()=1 2024-09-12T01:21:57.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.294__shadow_.1hg2kWAlsxeNGBntWsBY4_oKjVjECR6_0 2024-09-12T01:21:57.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11985952427185883192', time=2024-09-12T03:09:13.759141+0000, chain.objs.size()=1 2024-09-12T01:21:57.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.295__shadow_.0iod1bnz9jLerLBwKk6SCCVaesMojHe_0 2024-09-12T01:21:57.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.213977016017543629', time=2024-09-12T03:09:52.919094+0000, chain.objs.size()=1 2024-09-12T01:21:57.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.UIJkAAZ2mqQm8a20_go9KzMj-nTtzQ4_0 2024-09-12T01:21:57.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16893224992895825537', time=2024-09-12T03:09:53.015161+0000, chain.objs.size()=1 2024-09-12T01:21:57.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.4bQod3hG8q6wyJ4jaCbotcTpiAm_ciR_0 2024-09-12T01:21:57.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18268554678146106549', time=2024-09-12T03:09:53.131783+0000, chain.objs.size()=1 2024-09-12T01:21:57.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.6sYLBzd-XrQhB6SviV6bmaUSWMyAhk4_0 2024-09-12T01:21:57.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.47075701033176112', time=2024-09-12T03:09:53.698342+0000, chain.objs.size()=1 2024-09-12T01:21:57.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.zmGGTqy_Gi5nPAe90F81rvjHe1eBAqP_0 2024-09-12T01:21:57.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3948585490732978488', time=2024-09-12T03:09:53.750983+0000, chain.objs.size()=1 2024-09-12T01:21:57.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.GGX8FP_uX7W8ADypm9rRCqQyHk8yrq1_0 2024-09-12T01:21:57.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1185872932486625667', time=2024-09-12T03:09:54.067346+0000, chain.objs.size()=1 2024-09-12T01:21:57.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.B567N6seIgRI-ond1j-GUf3biHTNg6w_0 2024-09-12T01:21:57.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.816+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.661526624612372103', time=2024-09-12T03:09:54.121752+0000, chain.objs.size()=1 2024-09-12T01:21:57.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.XH2SaLX1NDpxKE3NQA7MmPbWl-qTmus_0 2024-09-12T01:21:57.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15800699595073414739', time=2024-09-12T03:09:54.164475+0000, chain.objs.size()=1 2024-09-12T01:21:57.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.8SpYMWCV0SIdmMZbHBZEjHp7ksRAlPB_0 2024-09-12T01:21:57.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15433511046880106549', time=2024-09-12T03:09:54.324398+0000, chain.objs.size()=1 2024-09-12T01:21:57.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.hb02kjj1L6Z3VSEV5S06H--11_EWkDF_0 2024-09-12T01:21:57.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15034925984079493438', time=2024-09-12T03:09:54.337912+0000, chain.objs.size()=1 2024-09-12T01:21:57.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.KdeDi2QHvRwDs16g_w-qk-TI4morbEV_0 2024-09-12T01:21:57.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4674312801041979622', time=2024-09-12T03:09:54.434736+0000, chain.objs.size()=1 2024-09-12T01:21:57.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.8BIdyD-X4Z5o-f8TAV3jWiGzBvlqrs5_0 2024-09-12T01:21:57.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7377305229274630580', time=2024-09-12T03:09:54.724104+0000, chain.objs.size()=1 2024-09-12T01:21:57.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.nOfwYfQFcXItQoo5_z_DwKpL7TPlzAL_0 2024-09-12T01:21:57.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2634084352822762536', time=2024-09-12T03:09:54.789819+0000, chain.objs.size()=1 2024-09-12T01:21:57.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.uh4KO6WHqPmcGC-I25AwcIl6Z9Otkay_0 2024-09-12T01:21:57.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3539004235614624304', time=2024-09-12T03:09:54.794837+0000, chain.objs.size()=1 2024-09-12T01:21:57.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.yQHIypcmcMecfmzzGUeZMyVMcjnjwv9_0 2024-09-12T01:21:57.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5046048000687157413', time=2024-09-12T03:09:54.797482+0000, chain.objs.size()=1 2024-09-12T01:21:57.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.YeKaXvPASe1LzGFT8gkw6SuY1QfOv0K_0 2024-09-12T01:21:57.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10052549688187346671', time=2024-09-12T03:09:55.028212+0000, chain.objs.size()=1 2024-09-12T01:21:57.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.eIdOchZKu0ykx7QUzf1alZiy6HL-zjy_0 2024-09-12T01:21:57.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4666706137539437301', time=2024-09-12T03:09:55.121569+0000, chain.objs.size()=1 2024-09-12T01:21:57.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.riG9eHA5BJxJToLJB22YyF886_hrLc6_0 2024-09-12T01:21:57.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12062219497018553092', time=2024-09-12T03:09:55.123244+0000, chain.objs.size()=1 2024-09-12T01:21:57.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.vxJ0hDRVGQ-XXe2uLcn1I4CdwMFHG2P_0 2024-09-12T01:21:57.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9997106013266001596', time=2024-09-12T03:09:55.166925+0000, chain.objs.size()=1 2024-09-12T01:21:57.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.YW4b8CVkbUTGTskWXDi5qo9cBBW67QP_0 2024-09-12T01:21:57.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5210673783388866269', time=2024-09-12T03:09:55.272425+0000, chain.objs.size()=1 2024-09-12T01:21:57.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.GCVEsEL1cCpJaQA85dW5cpd7KbFhmLK_0 2024-09-12T01:21:57.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8464455119927780120', time=2024-09-12T03:09:55.408503+0000, chain.objs.size()=1 2024-09-12T01:21:57.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.J1oT166uhEO99mKfIcvqqjbEdEdcW1u_0 2024-09-12T01:21:57.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11214442810269139170', time=2024-09-12T03:10:15.284265+0000, chain.objs.size()=1 2024-09-12T01:21:57.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.eK6GQCI_LodSrEHwyIi7xidt6qUKKTy_0 2024-09-12T01:21:57.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12168218684854817604', time=2024-09-12T03:10:15.289595+0000, chain.objs.size()=1 2024-09-12T01:21:57.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.820+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.L2pYfaUi5fYK2P1RkmBXYKUDTPWqDQn_0 2024-09-12T01:21:57.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6105052847039078320', time=2024-09-12T03:10:15.366687+0000, chain.objs.size()=1 2024-09-12T01:21:57.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.KbcdCdGbRnWt-mbkx7Gly6Jc5ZTp6FC_0 2024-09-12T01:21:57.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3305669929687621145', time=2024-09-12T03:10:15.371918+0000, chain.objs.size()=1 2024-09-12T01:21:57.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.mDpa6Cqjo696tnVg2khnwsRDVaFxJwd_0 2024-09-12T01:21:57.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8757673214730507819', time=2024-09-12T03:10:15.377072+0000, chain.objs.size()=1 2024-09-12T01:21:57.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.qzJMK2t1kw3RxmrrdQAFVatglR4bdg7_0 2024-09-12T01:21:57.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4178243065429182775', time=2024-09-12T03:10:15.399403+0000, chain.objs.size()=1 2024-09-12T01:21:57.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.WfhMIpzTdSZRrd2Zc3kibaW6Vg8LOPC_0 2024-09-12T01:21:57.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.164072794892543191', time=2024-09-12T03:10:15.421793+0000, chain.objs.size()=1 2024-09-12T01:21:57.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.R7siKtvLsDHUCGDPRviSMwWYhXon3tT_0 2024-09-12T01:21:57.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.196704431500455568', time=2024-09-12T03:10:15.734511+0000, chain.objs.size()=1 2024-09-12T01:21:57.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.TDEkc3AJ7bTTBkwXvEUgtOt-nrm-yE1_0 2024-09-12T01:21:57.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14708752950770638312', time=2024-09-12T03:10:15.909502+0000, chain.objs.size()=1 2024-09-12T01:21:57.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.BsfJC22Srq1F-za9Cpf0K3lB-lrA9QP_0 2024-09-12T01:21:57.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14129908413639525153', time=2024-09-12T03:10:15.987404+0000, chain.objs.size()=1 2024-09-12T01:21:57.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.D_9YSzjJNPnl9cqd_WJxn5iPvD6Cetp_0 2024-09-12T01:21:57.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3187152609519972265', time=2024-09-12T03:10:16.026030+0000, chain.objs.size()=1 2024-09-12T01:21:57.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.hOg4tmGEwqocvyHQZKUw9nP3v09Vty-_0 2024-09-12T01:21:57.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10915433875267005042', time=2024-09-12T03:10:16.061261+0000, chain.objs.size()=1 2024-09-12T01:21:57.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.rR20WBhIAUwgNVp3xSPrzJc7q4uBubL_0 2024-09-12T01:21:57.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17680521714578705359', time=2024-09-12T03:10:16.213268+0000, chain.objs.size()=1 2024-09-12T01:21:57.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.mRcjghsEjOgk9HkMHKdzHOo9-q83g-o_0 2024-09-12T01:21:57.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2642058820875407426', time=2024-09-12T03:10:16.226056+0000, chain.objs.size()=1 2024-09-12T01:21:57.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Oh1fvZbuhIi6GJ2JXu_vB_UT4bEHzac_0 2024-09-12T01:21:57.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.298899053846455477', time=2024-09-12T03:10:16.246491+0000, chain.objs.size()=1 2024-09-12T01:21:57.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.bHRvvomoREITXHcFlCNyfBzUIDiNjO-_0 2024-09-12T01:21:57.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13576109371128110917', time=2024-09-12T03:10:16.599960+0000, chain.objs.size()=1 2024-09-12T01:21:57.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.raXJ_8cIS_8a2skQgWKejiD3m3hhfeN_0 2024-09-12T01:21:57.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17221023215892603745', time=2024-09-12T03:10:16.647649+0000, chain.objs.size()=1 2024-09-12T01:21:57.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Eg2gbPuFPouuu4p7m5s6NhJP3ELMo6h_0 2024-09-12T01:21:57.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5007857894166372278', time=2024-09-12T03:10:16.797275+0000, chain.objs.size()=1 2024-09-12T01:21:57.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.pmSVv0iGx5dJLJ8Yyyp4jDDCZYthAzP_0 2024-09-12T01:21:57.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2644918170483751826', time=2024-09-12T03:10:17.196212+0000, chain.objs.size()=1 2024-09-12T01:21:57.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.-9nOp8tEBrlESdMLYSkoWhsj2SKX3Dj_0 2024-09-12T01:21:57.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.541189261303197186', time=2024-09-12T03:10:17.534413+0000, chain.objs.size()=1 2024-09-12T01:21:57.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.824+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_._hsxaLyGf7buezvwFThbPR3cPUjueIr_0 2024-09-12T01:21:57.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4091921052727372120', time=2024-09-12T03:10:17.589130+0000, chain.objs.size()=1 2024-09-12T01:21:57.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.kQQ4S_nFn1CTa_oLoiJ-Fy9Jubxv1SK_0 2024-09-12T01:21:57.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12704599351190873255', time=2024-09-12T03:10:17.749005+0000, chain.objs.size()=1 2024-09-12T01:21:57.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.FtyLJf_Tow2o-J0qnbYkL21X-7SI8gq_0 2024-09-12T01:21:57.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9243901769669272337', time=2024-09-12T03:10:17.777831+0000, chain.objs.size()=1 2024-09-12T01:21:57.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_._EFvDMC1cw6QraFx2oAJ2k8XmH1UD1-_0 2024-09-12T01:21:57.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2808979695293917673', time=2024-09-12T03:10:17.795528+0000, chain.objs.size()=1 2024-09-12T01:21:57.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.fT9n55mCGpEiwkV1u3sdd_zKsZTuQu3_0 2024-09-12T01:21:57.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4370864913883194295', time=2024-09-12T03:10:17.812496+0000, chain.objs.size()=1 2024-09-12T01:21:57.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.XeEbNEVM3-MyBQ8Ptpv-UY5aao2vupY_0 2024-09-12T01:21:57.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1692912905726671822', time=2024-09-12T03:10:17.820078+0000, chain.objs.size()=1 2024-09-12T01:21:57.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.MkCYz9-H2dge5jkCmk74_ndRxKklENd_0 2024-09-12T01:21:57.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10920636805004845508', time=2024-09-12T03:10:17.874024+0000, chain.objs.size()=1 2024-09-12T01:21:57.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.tuUC31bGjJAOBmc40SAAi1t7KcYzr1e_0 2024-09-12T01:21:57.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12029006519152960479', time=2024-09-12T03:10:21.603475+0000, chain.objs.size()=1 2024-09-12T01:21:57.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.331__shadow_.4beQ95kSrRKzUjTERxTHDa3YmEBOSca_0 2024-09-12T01:21:57.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1913268672405154231', time=2024-09-12T03:10:44.262084+0000, chain.objs.size()=1 2024-09-12T01:21:57.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.370__shadow_.4TIaYs7OJr0e757XSh10OCanhHmrx37_0 2024-09-12T01:21:57.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4160738346850610873', time=2024-09-12T03:11:48.474828+0000, chain.objs.size()=1 2024-09-12T01:21:57.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.458__shadow_.YH8ldpd_6rgpRTE8dpCIpWtATIrL6I3_0 2024-09-12T01:21:57.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12261712702672448862', time=2024-09-12T03:11:53.419106+0000, chain.objs.size()=1 2024-09-12T01:21:57.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.463__shadow_.MP9ahyFCwEFpc1Vjoq1j0w68E-svMj4_0 2024-09-12T01:21:57.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10889141099499116970', time=2024-09-12T03:11:55.312566+0000, chain.objs.size()=1 2024-09-12T01:21:57.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.465__shadow_.vSZI4mSQ4NMmyEysidkPoPYgJizhxn6_0 2024-09-12T01:21:57.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9226301139425468549', time=2024-09-12T03:11:56.192144+0000, chain.objs.size()=1 2024-09-12T01:21:57.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.466__shadow_.Mtbxg5Kj5l31oqkfuCfpv38aoA7JiiX_0 2024-09-12T01:21:57.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.56371287742085649', time=2024-09-12T03:12:04.999402+0000, chain.objs.size()=1 2024-09-12T01:21:57.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.484__shadow_.dTs3ZdHKdrMW6HJHWRa5rDRXkUe3E3d_0 2024-09-12T01:21:57.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14327579104378856677', time=2024-09-12T03:12:05.773885+0000, chain.objs.size()=1 2024-09-12T01:21:57.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.485__shadow_.n9xAw10fF8C5QRWXv7bbchK6QcGOKJI_0 2024-09-12T01:21:57.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14270657663528203323', time=2024-09-12T03:12:42.754874+0000, chain.objs.size()=6 2024-09-12T01:21:57.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.QOKoIOP8lkuE21BuQ9qXLm66pDhpUIYw.1 2024-09-12T01:21:57.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~BYC4FBvQexRl9lS9EcDWgYWQUAzEPSo.2 2024-09-12T01:21:57.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~BYC4FBvQexRl9lS9EcDWgYWQUAzEPSo.3 2024-09-12T01:21:57.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~BYC4FBvQexRl9lS9EcDWgYWQUAzEPSo.4 2024-09-12T01:21:57.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~BYC4FBvQexRl9lS9EcDWgYWQUAzEPSo.5 2024-09-12T01:21:57.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.828+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.523__multipart_mymultipart.2~BYC4FBvQexRl9lS9EcDWgYWQUAzEPSo.6 2024-09-12T01:21:57.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48045 2024-09-12T01:21:57.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T01:21:57.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4199588683058200393', time=2024-09-12T03:13:49.879243+0000, chain.objs.size()=1 2024-09-12T01:21:57.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.553__shadow_.FeCkoPVfgq5LJr59wlS-23t9ucC8tmQ_0 2024-09-12T01:21:57.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13278799894969566423', time=2024-09-12T03:13:53.285330+0000, chain.objs.size()=1 2024-09-12T01:21:57.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.556__shadow_.JljSjw4ztnj5BCA3fp-ZKZbmaP9hWcB_0 2024-09-12T01:21:57.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8767325559247189693', time=2024-09-12T03:14:15.112303+0000, chain.objs.size()=1 2024-09-12T01:21:57.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:h1NWGfrt3Ap3M95VjdXSBV0jwbOaPdB_.zRNLM7ETS-HHPb0bJhO55_yZhsPIIjE_0 2024-09-12T01:21:57.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17525620462473905519', time=2024-09-12T03:14:33.237391+0000, chain.objs.size()=1 2024-09-12T01:21:57.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:Vs-BOXxim7Se.AkME-pqwsciwQ4Ko1i_.GbLLCdr87aWQnB6Lx8Uaoboo2ARVAek_0 2024-09-12T01:21:57.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12617099305640497696', time=2024-09-12T03:14:51.971995+0000, chain.objs.size()=1 2024-09-12T01:21:57.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.580__shadow:.gQU1qNIgMU4A6iq6LcRizmXsrRvawb_.rsNsOsoDKBVa_2mNzPccaMRxftvfLIv_0 2024-09-12T01:21:57.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8955559669135369965', time=2024-09-12T03:14:53.652291+0000, chain.objs.size()=1 2024-09-12T01:21:57.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.581__shadow:8QYw-jrzGAJKN0blYPZkhu3EIhFEtdX_.gyODW4f5lIAJKpw6DMEb3V8hga8I3UB_0 2024-09-12T01:21:57.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16183286934853430010', time=2024-09-12T03:18:08.288277+0000, chain.objs.size()=1 2024-09-12T01:21:57.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.664__shadow_.Cpc7rQBmxzv9Zp0lTKoFdhjQOOjG_vK_0 2024-09-12T01:21:57.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2853372871906049405', time=2024-09-12T03:18:08.289644+0000, chain.objs.size()=1 2024-09-12T01:21:57.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.664__shadow_.fpX0uIrm7UGokEbu3Ie7Bp2SzolJ3Ds_0 2024-09-12T01:21:57.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.832+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9158616437041209219', time=2024-09-12T03:18:18.370515+0000, chain.objs.size()=1 2024-09-12T01:21:57.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.832+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.680__shadow_.l_O4D9xMnUjiZ-Kfye1SNa6WiTsOyl-_0 2024-09-12T01:21:57.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.836+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:57.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.836+0000 7f82c01a29c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:21:57.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.836+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:21:57.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:21:57.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45216' 2024-09-12T01:21:57.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8236077219276581227', time=2024-09-12T03:05:50.988701+0000, chain.objs.size()=1 2024-09-12T01:21:57.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.148__shadow_.5KtPYGEZ70Rm3XbYcHQAVKX-A8U4OCP_0 2024-09-12T01:21:57.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2965552054941326641', time=2024-09-12T03:05:51.199602+0000, chain.objs.size()=1 2024-09-12T01:21:57.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.149__shadow_.L7PGz7vBPosd-OgkrEKQjBDw8R5f4lq_0 2024-09-12T01:21:57.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='_YslwGu8sBDSnj0N9Sd56ORZG0DmkPMg', time=2024-09-12T03:06:04.616715+0000, chain.objs.size()=1 2024-09-12T01:21:57.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.166__shadow_.La8u12gxR-FocFygo0FsWf6-VsUYb6Z_0 2024-09-12T01:21:57.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5726300384718238553', time=2024-09-12T03:08:05.726073+0000, chain.objs.size()=1 2024-09-12T01:21:57.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.232__shadow_.TvdunCWl5jgL4Qg6j8LUyx-Hi-gNCSH_0 2024-09-12T01:21:57.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10696421294959442308', time=2024-09-12T03:08:17.148715+0000, chain.objs.size()=1 2024-09-12T01:21:57.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.246__shadow_.8NQZg__hLERR2mWzH55SRAmSF7Eqg3M_0 2024-09-12T01:21:57.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12621004069206915179', time=2024-09-12T03:08:18.522764+0000, chain.objs.size()=1 2024-09-12T01:21:57.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.248__shadow_.D24tUR9Ah4RlG9A4LzVYyYyZbYheqGv_0 2024-09-12T01:21:57.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16873475872201178468', time=2024-09-12T03:08:20.565974+0000, chain.objs.size()=1 2024-09-12T01:21:57.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.251__shadow_.LYD41JWFi5qDsdGSt_Bnbd0gPVr4zxS_0 2024-09-12T01:21:57.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6805045089595352740', time=2024-09-12T03:08:28.144245+0000, chain.objs.size()=1 2024-09-12T01:21:57.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.262__shadow_.x5iosI5UMPBKzzySz2MV3LAGIFRaeLb_0 2024-09-12T01:21:57.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18080647110734324904', time=2024-09-12T03:08:47.572263+0000, chain.objs.size()=1 2024-09-12T01:21:57.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.5ciUPKZyxNpvbpdnGmtZGSDQvrWDIt2_0 2024-09-12T01:21:57.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2964721416798558994', time=2024-09-12T03:08:47.600238+0000, chain.objs.size()=1 2024-09-12T01:21:57.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.aUTBuw9w_9PxyKvXQtgL8uco0Bz8-Rq_0 2024-09-12T01:21:57.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.667441236000387187', time=2024-09-12T03:08:47.800557+0000, chain.objs.size()=1 2024-09-12T01:21:57.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.oOYe83kv6UAOv_ZZp3zVIxsF4BZ8I8s_0 2024-09-12T01:21:57.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5086595478585330974', time=2024-09-12T03:08:47.838782+0000, chain.objs.size()=1 2024-09-12T01:21:57.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.gw0V3TXD-xN9jkj8VEsXaZYLwU4nyV3_0 2024-09-12T01:21:57.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7148721666800048783', time=2024-09-12T03:08:47.940655+0000, chain.objs.size()=1 2024-09-12T01:21:57.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.xjzSzimWnF02f1huMhQOElOyVvAPbll_0 2024-09-12T01:21:57.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14057657631366814738', time=2024-09-12T03:08:48.140642+0000, chain.objs.size()=1 2024-09-12T01:21:57.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.7wIxqRj4jVWt7ymduFHRlptNDl2rdXk_0 2024-09-12T01:21:57.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3514253380204594239', time=2024-09-12T03:08:48.143999+0000, chain.objs.size()=1 2024-09-12T01:21:57.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Cdn0cugsHmaSLFsclXpFFKvSur8ciFa_0 2024-09-12T01:21:57.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12708827154660450522', time=2024-09-12T03:08:48.200518+0000, chain.objs.size()=1 2024-09-12T01:21:57.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.EkoDPRQi2nP-lVr_NIHieP27_Zns6IX_0 2024-09-12T01:21:57.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3003981491797596814', time=2024-09-12T03:08:48.347864+0000, chain.objs.size()=1 2024-09-12T01:21:57.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.N2F914PWFA9SS7Fae8sVdCMWUxLB27g_0 2024-09-12T01:21:57.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7235764707073988706', time=2024-09-12T03:08:48.524149+0000, chain.objs.size()=1 2024-09-12T01:21:57.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.BjS8Qd4RWfEdwCSh1PYf9d__MUtMJlQ_0 2024-09-12T01:21:57.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12075696988669857927', time=2024-09-12T03:08:48.592645+0000, chain.objs.size()=1 2024-09-12T01:21:57.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.gfXlVspbsFevU33NrpaGYLVJBOBJEGI_0 2024-09-12T01:21:57.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11461060583329019067', time=2024-09-12T03:08:48.657396+0000, chain.objs.size()=1 2024-09-12T01:21:57.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.FOEJarjBxNsaV2lo4zC2PHiqmR0Jw6O_0 2024-09-12T01:21:57.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13614706905729840118', time=2024-09-12T03:08:48.967722+0000, chain.objs.size()=1 2024-09-12T01:21:57.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.3Ku-CvcK9l5eGFH7wy0Omwo8pupho-__0 2024-09-12T01:21:57.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9883216464232333939', time=2024-09-12T03:08:49.242719+0000, chain.objs.size()=1 2024-09-12T01:21:57.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.qRMqeFukx3qcgEViUJbwX6M9lmu49tr_0 2024-09-12T01:21:57.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13040766991196141648', time=2024-09-12T03:08:49.244519+0000, chain.objs.size()=1 2024-09-12T01:21:57.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.840+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.BDYzta-q_euGQw5V37iza_9oWtBvZYT_0 2024-09-12T01:21:57.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5534470774951394587', time=2024-09-12T03:08:49.260446+0000, chain.objs.size()=1 2024-09-12T01:21:57.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.4pcOwIiRB8BXCLSNT0O4LEklG9bpGbK_0 2024-09-12T01:21:57.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10296020582803229998', time=2024-09-12T03:08:49.272737+0000, chain.objs.size()=1 2024-09-12T01:21:57.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Sb3yI_MUcqY1q0-e-AfmqVJs34AMIZZ_0 2024-09-12T01:21:57.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3451075551121313592', time=2024-09-12T03:08:49.295323+0000, chain.objs.size()=1 2024-09-12T01:21:57.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.eYaJ-KBNyVke-st3D0HxM8QfrfTkhJI_0 2024-09-12T01:21:57.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13727680041157646402', time=2024-09-12T03:08:49.314568+0000, chain.objs.size()=1 2024-09-12T01:21:57.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.HxMbt-tpytmkKf-B3rVTzyE48qS1PG1_0 2024-09-12T01:21:57.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9677469848928939187', time=2024-09-12T03:08:49.367414+0000, chain.objs.size()=1 2024-09-12T01:21:57.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.4uIZqXOLZFTaj3eYBiVdPbHnR5eQllB_0 2024-09-12T01:21:57.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10930339536324656121', time=2024-09-12T03:08:49.383948+0000, chain.objs.size()=1 2024-09-12T01:21:57.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.6weXdHpb7gRc_xfA4Bcn-UMQk95gg8U_0 2024-09-12T01:21:57.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16348327844425257355', time=2024-09-12T03:08:49.611336+0000, chain.objs.size()=1 2024-09-12T01:21:57.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.EwE8bjLkrwOYe4IGJ4NNJut3ntAxbz3_0 2024-09-12T01:21:57.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.708013858981381731', time=2024-09-12T03:08:49.623662+0000, chain.objs.size()=1 2024-09-12T01:21:57.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Usp2DPlEaSGZUVnWxJLyIvt0eb-fnD__0 2024-09-12T01:21:57.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2692972173938344318', time=2024-09-12T03:08:49.634667+0000, chain.objs.size()=1 2024-09-12T01:21:57.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ujJWQWaO_ENXssN6dE4HqWlPkLfKbz3_0 2024-09-12T01:21:57.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4082523021656852671', time=2024-09-12T03:08:49.670527+0000, chain.objs.size()=1 2024-09-12T01:21:57.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.RZv2g73lY1f7ECYpIcW4EKqCI9aKKCA_0 2024-09-12T01:21:57.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5950812254121173465', time=2024-09-12T03:08:49.675140+0000, chain.objs.size()=1 2024-09-12T01:21:57.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.Mtt_YVqv6-uzkgyHUcluyk2TO3u_gOO_0 2024-09-12T01:21:57.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.328597565615461092', time=2024-09-12T03:08:49.680655+0000, chain.objs.size()=1 2024-09-12T01:21:57.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.jYQo6WB_7G97X1XTFYjY2hlN-c1CBGd_0 2024-09-12T01:21:57.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14390405093430402357', time=2024-09-12T03:08:49.684295+0000, chain.objs.size()=1 2024-09-12T01:21:57.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.a-hbVyJ1njOpK8VelOhfKHB2jkACSE5_0 2024-09-12T01:21:57.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1986606835089823867', time=2024-09-12T03:08:49.690178+0000, chain.objs.size()=1 2024-09-12T01:21:57.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.V0p6K9izK1Km1_NxnevA7ZwEWJMjpnL_0 2024-09-12T01:21:57.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16257069658049393341', time=2024-09-12T03:08:49.925721+0000, chain.objs.size()=1 2024-09-12T01:21:57.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.844+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.ZlzVu8vmSdUAtafL05T1KXyIxxWDET8_0 2024-09-12T01:21:57.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11539984237924727948', time=2024-09-12T03:08:50.009794+0000, chain.objs.size()=1 2024-09-12T01:21:57.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.263__shadow_.KmQpLwn9e2lx3I8B57wt-2nRshMIJ5D_0 2024-09-12T01:21:57.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16766486553510985646', time=2024-09-12T03:08:53.946493+0000, chain.objs.size()=1 2024-09-12T01:21:57.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.269__shadow_.h8xx9knB_dDldeyNEAwUEkU43fuTvjy_0 2024-09-12T01:21:57.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17130775473577469774', time=2024-09-12T03:09:05.747973+0000, chain.objs.size()=1 2024-09-12T01:21:57.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.286__shadow_.9CmH5qyeja1nm4hF_3cxYOFIILFfAr5_0 2024-09-12T01:21:57.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12164125310618597231', time=2024-09-12T03:09:11.595185+0000, chain.objs.size()=1 2024-09-12T01:21:57.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.293__shadow_.hs_5LOH2QcZcJ6YF-o4LFszVoQHtfXJ_0 2024-09-12T01:21:57.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12409731857927598999', time=2024-09-12T03:09:11.596777+0000, chain.objs.size()=1 2024-09-12T01:21:57.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.293__shadow_.5m0Ju6TN4R6NRxZHt-bkaJUgJP4Bx8h_0 2024-09-12T01:21:57.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14597509575417813492', time=2024-09-12T03:09:15.801878+0000, chain.objs.size()=1 2024-09-12T01:21:57.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.298__shadow_.AJcFX2j_r8cSbpiZFO9GA-cFTLSfaAj_0 2024-09-12T01:21:57.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1159876507486284301', time=2024-09-12T03:09:16.520691+0000, chain.objs.size()=1 2024-09-12T01:21:57.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.299__shadow_.N_fSx8WCwRRPgIpkHvSUrDk1O5Efv13_0 2024-09-12T01:21:57.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1660344332617079049', time=2024-09-12T03:09:17.235092+0000, chain.objs.size()=1 2024-09-12T01:21:57.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.300__shadow_.Ov2w-j4O9oxYVLrgAwdzWvvIVNShPLk_0 2024-09-12T01:21:57.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1248173894184886936', time=2024-09-12T03:09:52.925776+0000, chain.objs.size()=1 2024-09-12T01:21:57.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.nXlUCKEN1cfuTFh52lV5dsZbChrTMjp_0 2024-09-12T01:21:57.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.6910004915129820723', time=2024-09-12T03:09:53.064290+0000, chain.objs.size()=1 2024-09-12T01:21:57.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Iflh8RnS9QAZ4wZyg3eutSaAuR6KLA3_0 2024-09-12T01:21:57.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8539953994488354254', time=2024-09-12T03:09:53.127568+0000, chain.objs.size()=1 2024-09-12T01:21:57.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.6NeRFKMnCQRzPnxGoC_qMoroK_zJvOE_0 2024-09-12T01:21:57.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4919139008963823909', time=2024-09-12T03:09:53.405041+0000, chain.objs.size()=1 2024-09-12T01:21:57.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.DwJBxvBTFO7lNkdIM3upK9gKzut8go3_0 2024-09-12T01:21:57.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15127213755187608278', time=2024-09-12T03:09:53.479603+0000, chain.objs.size()=1 2024-09-12T01:21:57.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ejvCexGqpsVyJg2EKsz8ujVxFzWZmES_0 2024-09-12T01:21:57.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14157780978788259434', time=2024-09-12T03:09:53.644155+0000, chain.objs.size()=1 2024-09-12T01:21:57.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.A8M9_-iNsb84uK6H4fX7hsGRvek5A_O_0 2024-09-12T01:21:57.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15381041602103839109', time=2024-09-12T03:09:53.661717+0000, chain.objs.size()=1 2024-09-12T01:21:57.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.XkuN_cAv9mMkq-5qLoB3eSwiWkFgt--_0 2024-09-12T01:21:57.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13144986972759494371', time=2024-09-12T03:09:53.730585+0000, chain.objs.size()=1 2024-09-12T01:21:57.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.U8gWnfWCfTyR2tCIpYjrmrQApVaYldD_0 2024-09-12T01:21:57.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11896236210560387604', time=2024-09-12T03:09:53.764716+0000, chain.objs.size()=1 2024-09-12T01:21:57.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.XZm0Kl8LfKHdwWcV1TVXIQzeJy8G0JF_0 2024-09-12T01:21:57.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3148980696623041752', time=2024-09-12T03:09:53.817999+0000, chain.objs.size()=1 2024-09-12T01:21:57.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.MSiGlakRlrUVt5DJTgtNvvPl17tehah_0 2024-09-12T01:21:57.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5740922695976102194', time=2024-09-12T03:09:53.828051+0000, chain.objs.size()=1 2024-09-12T01:21:57.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_._qp5tnMxJzCMojd1psL5N0apS3y1Ry-_0 2024-09-12T01:21:57.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17756926241620387689', time=2024-09-12T03:09:53.965615+0000, chain.objs.size()=1 2024-09-12T01:21:57.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.AGummIVxK2z4QRg5KDovsVVs4I__XGv_0 2024-09-12T01:21:57.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8083590515748764550', time=2024-09-12T03:09:54.018954+0000, chain.objs.size()=1 2024-09-12T01:21:57.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.oWPpHeNbkyFoZ8yHuHaHVlt0KwEKPNV_0 2024-09-12T01:21:57.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18016808845804196384', time=2024-09-12T03:09:54.049014+0000, chain.objs.size()=1 2024-09-12T01:21:57.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.848+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.wjPt52SnYvhGNES1lXbFTYGVixnT28v_0 2024-09-12T01:21:57.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12993927742847860360', time=2024-09-12T03:09:54.108587+0000, chain.objs.size()=1 2024-09-12T01:21:57.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.JFWMgkzAIrjo5t1H7BK0_lfWqr1OGm2_0 2024-09-12T01:21:57.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1257355747122305140', time=2024-09-12T03:09:54.390057+0000, chain.objs.size()=1 2024-09-12T01:21:57.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.5gOiXYZcyd6DuL26l6RJZyRlC6GNHxT_0 2024-09-12T01:21:57.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17041807882052424957', time=2024-09-12T03:09:54.412597+0000, chain.objs.size()=1 2024-09-12T01:21:57.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.4DXCyd0zGwHpcnBonXnO-h7_M98NklN_0 2024-09-12T01:21:57.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18215409071377157111', time=2024-09-12T03:09:54.461792+0000, chain.objs.size()=1 2024-09-12T01:21:57.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.V7WlGJPGNnMb2AwmfZusdNqqHZ02x5o_0 2024-09-12T01:21:57.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13014902143548538786', time=2024-09-12T03:09:54.499500+0000, chain.objs.size()=1 2024-09-12T01:21:57.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.8r-4TH0poCuA19eAbnpia8PabHororu_0 2024-09-12T01:21:57.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17126872677121450433', time=2024-09-12T03:09:54.635358+0000, chain.objs.size()=1 2024-09-12T01:21:57.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.UMkhdGzQfRM97atFs-q4f_DKP6q8ye2_0 2024-09-12T01:21:57.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13896188846131220182', time=2024-09-12T03:09:54.663419+0000, chain.objs.size()=1 2024-09-12T01:21:57.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.xP0z-BMAw-hL2FOstpfiSGvPkNRDClO_0 2024-09-12T01:21:57.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10238693708899519803', time=2024-09-12T03:09:54.686845+0000, chain.objs.size()=1 2024-09-12T01:21:57.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ByGad-851NqC6-XetYGGW2SEaxIejtb_0 2024-09-12T01:21:57.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.5878402309852372149', time=2024-09-12T03:09:54.755499+0000, chain.objs.size()=1 2024-09-12T01:21:57.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.bkMqWZr2e2pPLSdWQPvfUa3e4div-kE_0 2024-09-12T01:21:57.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10409773037555461782', time=2024-09-12T03:09:54.778130+0000, chain.objs.size()=1 2024-09-12T01:21:57.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.nZcvivMQocu-cdobvlB_zvl_JpWeXSY_0 2024-09-12T01:21:57.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14952443770907913369', time=2024-09-12T03:09:54.817952+0000, chain.objs.size()=1 2024-09-12T01:21:57.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.LIGu6PLHp28e_XbnM3WnQlTJh2NHskt_0 2024-09-12T01:21:57.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11616209199568515424', time=2024-09-12T03:09:54.950423+0000, chain.objs.size()=1 2024-09-12T01:21:57.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.eIog5fdAZH8seVhKbJnprgObaGpGq8D_0 2024-09-12T01:21:57.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15893007327198240214', time=2024-09-12T03:09:54.984266+0000, chain.objs.size()=1 2024-09-12T01:21:57.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.Gk5I4Q7ciQ7aI1S5S1aCvPxSBvmgNlN_0 2024-09-12T01:21:57.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14151894276316131538', time=2024-09-12T03:09:55.091374+0000, chain.objs.size()=1 2024-09-12T01:21:57.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.IBLYn6d8wJoWTPg1eOIkvbdOfsPHhbT_0 2024-09-12T01:21:57.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3585462347729973993', time=2024-09-12T03:09:55.157397+0000, chain.objs.size()=1 2024-09-12T01:21:57.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.bgDpV8NLjWUzKsF3GMEh8EoA77R328b_0 2024-09-12T01:21:57.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10425141384028246682', time=2024-09-12T03:09:55.166186+0000, chain.objs.size()=1 2024-09-12T01:21:57.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.4F0MDYAxow1k8VOYut-Dyi-R4dckK2X_0 2024-09-12T01:21:57.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8371105137113032025', time=2024-09-12T03:09:55.353034+0000, chain.objs.size()=1 2024-09-12T01:21:57.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.852+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.bz5JtDPtpWAJ2ZN5rKt8gb_nzd5KSqQ_0 2024-09-12T01:21:57.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4644462787410998957', time=2024-09-12T03:09:55.388912+0000, chain.objs.size()=1 2024-09-12T01:21:57.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.3jvYHtLu0H-gVWkVkc845B04xz_SgLE_0 2024-09-12T01:21:57.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13047256488455441638', time=2024-09-12T03:09:55.414437+0000, chain.objs.size()=1 2024-09-12T01:21:57.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.324__shadow_.ZYrO-SAmzEcpZn6z2CIAOSfAXjTePm-_0 2024-09-12T01:21:57.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16787351738781125851', time=2024-09-12T03:10:15.241258+0000, chain.objs.size()=1 2024-09-12T01:21:57.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.bGWi1t-8sWU9nxCnQIy5HK4ZqoDN1Il_0 2024-09-12T01:21:57.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3984407666616597378', time=2024-09-12T03:10:15.302609+0000, chain.objs.size()=1 2024-09-12T01:21:57.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.GRBDLDED7_ZHDa01MAHIA_3fjg3s0BU_0 2024-09-12T01:21:57.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.846689271977464259', time=2024-09-12T03:10:15.399032+0000, chain.objs.size()=1 2024-09-12T01:21:57.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Lsyje2zPCD8KuMVO8CGkbriU7qlQtO7_0 2024-09-12T01:21:57.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4053956463819191939', time=2024-09-12T03:10:15.420631+0000, chain.objs.size()=1 2024-09-12T01:21:57.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.FG3iBnZJKSGrXdn6Jqc_pqTNyBLRoao_0 2024-09-12T01:21:57.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.18021135172299556385', time=2024-09-12T03:10:15.576823+0000, chain.objs.size()=1 2024-09-12T01:21:57.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.YwgFOIh8CJv3jtOWmCQkyLAaNgiynhy_0 2024-09-12T01:21:57.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12168404978371614901', time=2024-09-12T03:10:15.654606+0000, chain.objs.size()=1 2024-09-12T01:21:57.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.4nc5mAFqTCHFCFOEKHIIIFKUIwuxVIH_0 2024-09-12T01:21:57.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3415446469888426650', time=2024-09-12T03:10:15.675282+0000, chain.objs.size()=1 2024-09-12T01:21:57.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Cq30KTqSFytCLsTl6gu4mcKGztn_Cki_0 2024-09-12T01:21:57.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.3223131129879087720', time=2024-09-12T03:10:15.710591+0000, chain.objs.size()=1 2024-09-12T01:21:57.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.yOq3qGvBUTsJGJZ_2FTBgRZaScTTpe4_0 2024-09-12T01:21:57.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13631753064241665218', time=2024-09-12T03:10:15.727926+0000, chain.objs.size()=1 2024-09-12T01:21:57.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.7cNg-LZ0dL9DMo92TAcWFd42r-RQrEG_0 2024-09-12T01:21:57.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.17340591733237062443', time=2024-09-12T03:10:15.729756+0000, chain.objs.size()=1 2024-09-12T01:21:57.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.RIF4fv77Hur5Ddplo99V_iiZ97Scaw5_0 2024-09-12T01:21:57.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.403238915327596019', time=2024-09-12T03:10:15.776123+0000, chain.objs.size()=1 2024-09-12T01:21:57.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.KWMc4aK73d6iyYscLp6K7_rPhyDZAf1_0 2024-09-12T01:21:57.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9286348342348180930', time=2024-09-12T03:10:15.926710+0000, chain.objs.size()=1 2024-09-12T01:21:57.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.3Jk9KGTGqYk8n1wvqUGl_oBYSsF0q2Y_0 2024-09-12T01:21:57.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8286615704660425633', time=2024-09-12T03:10:16.213025+0000, chain.objs.size()=1 2024-09-12T01:21:57.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ZQwS62NNX7BRunAZDzSRASZmB8Cp5mV_0 2024-09-12T01:21:57.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16988039858784647558', time=2024-09-12T03:10:16.621022+0000, chain.objs.size()=1 2024-09-12T01:21:57.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Vs3iXseudACQy4SoIOT5ptXIa9sF32D_0 2024-09-12T01:21:57.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1758021479452347009', time=2024-09-12T03:10:16.628366+0000, chain.objs.size()=1 2024-09-12T01:21:57.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.tJYlRASelfwiJhoThc6JswHUl_YBy_q_0 2024-09-12T01:21:57.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11866792426705115037', time=2024-09-12T03:10:16.856083+0000, chain.objs.size()=1 2024-09-12T01:21:57.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.aOGVOpghafc4jJNL16tvgIfyhb5delj_0 2024-09-12T01:21:57.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10278451688321120644', time=2024-09-12T03:10:17.153315+0000, chain.objs.size()=1 2024-09-12T01:21:57.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.tNqpfIeylrl5aE52oUsA6hqTAHpfwyc_0 2024-09-12T01:21:57.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4623193133315505308', time=2024-09-12T03:10:17.248183+0000, chain.objs.size()=1 2024-09-12T01:21:57.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.e1xFuSYgbyBDm-Wx_mb6k2zsTFS4EVK_0 2024-09-12T01:21:57.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10661102755177078690', time=2024-09-12T03:10:17.273732+0000, chain.objs.size()=1 2024-09-12T01:21:57.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.pD3kyEOfjdh2YIlccvIL4SRZ69pHUFt_0 2024-09-12T01:21:57.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.11954588576060468401', time=2024-09-12T03:10:17.282853+0000, chain.objs.size()=1 2024-09-12T01:21:57.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.856+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ZBTd-FvkL0-d_pmn6SWwA4lZv72f6cE_0 2024-09-12T01:21:57.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.860+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4120326874451126708', time=2024-09-12T03:10:17.289370+0000, chain.objs.size()=1 2024-09-12T01:21:57.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.860+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.gPavzzgdF-wbZrlKbeRgfkTp0jZWh8g_0 2024-09-12T01:21:57.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.860+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45216 2024-09-12T01:21:57.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T01:21:57.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2438499121248461484', time=2024-09-12T03:10:17.297959+0000, chain.objs.size()=1 2024-09-12T01:21:57.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.Vj8f9Qjx8P4oV0auzvMS8bol2m8MI6u_0 2024-09-12T01:21:57.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.990653993622125078', time=2024-09-12T03:10:17.479219+0000, chain.objs.size()=1 2024-09-12T01:21:57.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.-qrTxDm8m7H041ttylKkdpzZGsanj7C_0 2024-09-12T01:21:57.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8812028688894737433', time=2024-09-12T03:10:17.529876+0000, chain.objs.size()=1 2024-09-12T01:21:57.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.CfAJpWWKPMqQh0d84Ys26a2xER4VLXf_0 2024-09-12T01:21:57.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1778919676099467536', time=2024-09-12T03:10:17.563347+0000, chain.objs.size()=1 2024-09-12T01:21:57.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.A8YunchUH3JDa-_1AvN2xIxAfGPeG6K_0 2024-09-12T01:21:57.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.10022993888560961977', time=2024-09-12T03:10:17.583825+0000, chain.objs.size()=1 2024-09-12T01:21:57.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.jvt7IXXTJwN07-57C7y_9xKVidv5RhP_0 2024-09-12T01:21:57.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14748881260202874450', time=2024-09-12T03:10:17.745832+0000, chain.objs.size()=1 2024-09-12T01:21:57.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.ygNAQQIFvX4AnDhFPZqt1UfIIV9dGBo_0 2024-09-12T01:21:57.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.952075505201896728', time=2024-09-12T03:10:17.812990+0000, chain.objs.size()=1 2024-09-12T01:21:57.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.tvfgTTKEEnyYbj-FRXzHoAR86D4x5Jh_0 2024-09-12T01:21:57.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.2871065453824266553', time=2024-09-12T03:10:17.868665+0000, chain.objs.size()=1 2024-09-12T01:21:57.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.6sk1vEQTBzXOe5a9aeABIcDwo5GBXuT_0 2024-09-12T01:21:57.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7887328080644061795', time=2024-09-12T03:10:17.907699+0000, chain.objs.size()=1 2024-09-12T01:21:57.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.325__shadow_.eAHXYJ6Nb2i8llhduDt911geeHrKhsZ_0 2024-09-12T01:21:57.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9277973657521079536', time=2024-09-12T03:12:05.009019+0000, chain.objs.size()=1 2024-09-12T01:21:57.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.484__shadow_.uWzpvWMDigUuW11NYJP8YJJb-xpFd3t_0 2024-09-12T01:21:57.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.9583782667740561485', time=2024-09-12T03:13:50.838547+0000, chain.objs.size()=1 2024-09-12T01:21:57.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.554__shadow_.KbmwxSYvwYIvmtliiaVfL3Kds3KlmYL_0 2024-09-12T01:21:57.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16860906092483899450', time=2024-09-12T03:14:05.351868+0000, chain.objs.size()=2 2024-09-12T01:21:57.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.564__shadow_.LMuFV-21mmZjUXNLSXONa9D5upCJqh5_0 2024-09-12T01:21:57.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.564__shadow_.LMuFV-21mmZjUXNLSXONa9D5upCJqh5_1 2024-09-12T01:21:57.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4513035059594184398', time=2024-09-12T03:14:10.897011+0000, chain.objs.size()=1 2024-09-12T01:21:57.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:KL8OfDvI30IQ3bZe9d9Cw1TPWwyqYos_.3G4szgMHD6jBga1vDcqpetRACV2lzIu_0 2024-09-12T01:21:57.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.13550109029086926473', time=2024-09-12T03:14:13.487380+0000, chain.objs.size()=1 2024-09-12T01:21:57.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.570__shadow:2brNAu.A1iiqAndeiBbPXll8tg14cPm_.uJCL5KYbgsNY9_ia1hsZSgW3XUfPlDz_0 2024-09-12T01:21:57.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.12493229660570977693', time=2024-09-12T03:14:22.150967+0000, chain.objs.size()=1 2024-09-12T01:21:57.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.575__shadow_.Y8O-QXLkrJE8QTI9akMcYsTgqTRnom3_0 2024-09-12T01:21:57.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.1983736421559145611', time=2024-09-12T03:14:27.925557+0000, chain.objs.size()=1 2024-09-12T01:21:57.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.577__shadow:xO4o6F1rdrBaPlG6QNusPdDzWP51cWj_.ryPprm2DSMciixMxyYs4Dn3pxkm8-H1_0 2024-09-12T01:21:57.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.8960010864192103716', time=2024-09-12T03:14:35.573644+0000, chain.objs.size()=1 2024-09-12T01:21:57.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.578__shadow:1tPJU327aLIRF.ILbFEU2hHE39d9Smm_.xsiXQL4DlXGf9d_nBuimauCvO76PTjA_0 2024-09-12T01:21:57.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.15932828440985658802', time=2024-09-12T03:14:51.921836+0000, chain.objs.size()=1 2024-09-12T01:21:57.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.580__shadow:NcSddGWGuVoiQ1YFlVozUS7cUA991dG_.MYaMw1gwV5ZwEpBtY2sc8VBR2lgDv0q_0 2024-09-12T01:21:57.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.16803326524349368392', time=2024-09-12T03:14:52.020729+0000, chain.objs.size()=1 2024-09-12T01:21:57.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.580__shadow:fKSINIygrU97yYq8SKYouRk.ZaNs-pq_.duv6hm-thJTB_J1dTszAADTTOD5czS-_0 2024-09-12T01:21:57.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.7347225426652660750', time=2024-09-12T03:17:51.982350+0000, chain.objs.size()=2 2024-09-12T01:21:57.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.645__shadow_.yR1J4QNsqi_JC_3Bzf-cuJQlnmK55cN_0 2024-09-12T01:21:57.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.645__shadow_.yR1J4QNsqi_JC_3Bzf-cuJQlnmK55cN_1 2024-09-12T01:21:57.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.14012671643697083297', time=2024-09-12T03:18:24.462938+0000, chain.objs.size()=1 2024-09-12T01:21:57.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.864+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.691__shadow:Gw9qHALtVDkA1LRqIPlDctq62yWVQxr_.pxlpkb8ix_BWKKYqe8A7MpU-bhgSH-B_0 2024-09-12T01:21:57.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.868+0000 7f82c01a29c0 20 garbage collection: RGWGC::process iterating over entry tag='81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.4559264359831251037', time=2024-09-12T03:19:02.414375+0000, chain.objs.size()=1 2024-09-12T01:21:57.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.868+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:81cc4b79-0c9d-4eec-9f0c-9e3f43df96c1.4635.720__shadow_.cboU_WI2LLF45z3vMwl3_xhgfeR4dWu_0 2024-09-12T01:21:57.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.868+0000 7f82c01a29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:21:57.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.872+0000 7f816ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:21:57.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.872+0000 7f82c01a29c0 20 remove_watcher() i=0 2024-09-12T01:21:57.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.872+0000 7f82c01a29c0 2 removed watcher, disabling cache 2024-09-12T01:21:57.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.876+0000 7f82c01a29c0 20 remove_watcher() i=1 2024-09-12T01:21:57.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.876+0000 7f82c01a29c0 20 remove_watcher() i=2 2024-09-12T01:21:57.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.876+0000 7f82c01a29c0 20 remove_watcher() i=3 2024-09-12T01:21:57.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.876+0000 7f82c01a29c0 20 remove_watcher() i=4 2024-09-12T01:21:57.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.876+0000 7f82c01a29c0 20 remove_watcher() i=5 2024-09-12T01:21:57.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.880+0000 7f82c01a29c0 20 remove_watcher() i=6 2024-09-12T01:21:57.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:21:57.880+0000 7f82c01a29c0 20 remove_watcher() i=7 2024-09-12T01:21:57.890 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-12T01:21:57.900 DEBUG:teuthology.orchestra.run.smithi070:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-09-12T01:21:57.936 DEBUG:teuthology.orchestra.run.smithi070:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-12T01:21:57.985 DEBUG:teuthology.orchestra.run.smithi070:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-09-12T01:21:58.033 DEBUG:teuthology.orchestra.run.smithi070:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-12T01:21:58.081 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm /usr/local/share/ca-certificates/root.crt 2024-09-12T01:21:58.137 DEBUG:teuthology.orchestra.run.smithi070:> sudo update-ca-certificates 2024-09-12T01:21:58.193 INFO:teuthology.orchestra.run.smithi070.stdout:Updating certificates in /etc/ssl/certs... 2024-09-12T01:21:58.575 INFO:teuthology.orchestra.run.smithi070.stdout:0 added, 0 removed; done. 2024-09-12T01:21:58.575 INFO:teuthology.orchestra.run.smithi070.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-09-12T01:21:58.577 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:21:58.752 INFO:teuthology.orchestra.run.smithi070.stdout:done. 2024-09-12T01:21:58.752 INFO:teuthology.orchestra.run.smithi070.stdout:done. 2024-09-12T01:21:58.755 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T01:21:58.765 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:21:58.765 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:21:59.146 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:21:59.161 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-12T01:21:59.176 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":1656,"stamp":"2024-09-12T01:21:57.127448+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":720369566,"num_objects":4785,"num_object_clones":0,"num_object_copies":9570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4785,"num_whiteouts":0,"num_read":174790,"num_read_kb":2452017,"num_write":137984,"num_write_kb":2416803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14143,"ondisk_log_size":14143,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2719976,"kb_used_data":1466920,"kb_used_omap":12,"kb_used_meta":1252915,"kb_avail":752254744,"statfs":{"total":773094113280,"available":770308857856,"internally_reserved":0,"allocated":1502126080,"data_stored":1456930414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1282985520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008689"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:43.558042+0000","last_change":"2024-09-12T01:03:40.585433+0000","last_active":"2024-09-12T01:18:43.558042+0000","last_peered":"2024-09-12T01:18:43.558042+0000","last_clean":"2024-09-12T01:18:43.558042+0000","last_became_active":"2024-09-12T01:03:40.584744+0000","last_became_peered":"2024-09-12T01:03:40.584744+0000","last_unstale":"2024-09-12T01:18:43.558042+0000","last_undegraded":"2024-09-12T01:18:43.558042+0000","last_fullsized":"2024-09-12T01:18:43.558042+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:08.339816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.544106+0000","last_change":"2024-09-12T00:52:40.345897+0000","last_active":"2024-09-12T01:17:43.544106+0000","last_peered":"2024-09-12T01:17:43.544106+0000","last_clean":"2024-09-12T01:17:43.544106+0000","last_became_active":"2024-09-12T00:52:40.345120+0000","last_became_peered":"2024-09-12T00:52:40.345120+0000","last_unstale":"2024-09-12T01:17:43.544106+0000","last_undegraded":"2024-09-12T01:17:43.544106+0000","last_fullsized":"2024-09-12T01:17:43.544106+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:08.139060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"265'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:38.569968+0000","last_change":"2024-09-12T00:52:37.282365+0000","last_active":"2024-09-12T01:17:38.569968+0000","last_peered":"2024-09-12T01:17:38.569968+0000","last_clean":"2024-09-12T01:17:38.569968+0000","last_became_active":"2024-09-12T00:52:37.276676+0000","last_became_peered":"2024-09-12T00:52:37.276676+0000","last_unstale":"2024-09-12T01:17:38.569968+0000","last_undegraded":"2024-09-12T01:17:38.569968+0000","last_fullsized":"2024-09-12T01:17:38.569968+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:49.462408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'38","reported_seq":155,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.558454+0000","last_change":"2024-09-12T00:51:04.999562+0000","last_active":"2024-09-12T01:18:13.558454+0000","last_peered":"2024-09-12T01:18:13.558454+0000","last_clean":"2024-09-12T01:18:13.558454+0000","last_became_active":"2024-09-12T00:51:04.998763+0000","last_became_peered":"2024-09-12T00:51:04.998763+0000","last_unstale":"2024-09-12T01:18:13.558454+0000","last_undegraded":"2024-09-12T01:18:13.558454+0000","last_fullsized":"2024-09-12T01:18:13.558454+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:53.376151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":142,"num_write":56,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:40.559635+0000","last_change":"2024-09-12T01:03:40.582702+0000","last_active":"2024-09-12T01:18:40.559635+0000","last_peered":"2024-09-12T01:18:40.559635+0000","last_clean":"2024-09-12T01:18:40.559635+0000","last_became_active":"2024-09-12T01:03:40.581266+0000","last_became_peered":"2024-09-12T01:03:40.581266+0000","last_unstale":"2024-09-12T01:18:40.559635+0000","last_undegraded":"2024-09-12T01:18:40.559635+0000","last_fullsized":"2024-09-12T01:18:40.559635+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:25.009896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"265'1","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:42.731685+0000","last_change":"2024-09-12T00:52:40.345386+0000","last_active":"2024-09-12T01:17:42.731685+0000","last_peered":"2024-09-12T01:17:42.731685+0000","last_clean":"2024-09-12T01:17:42.731685+0000","last_became_active":"2024-09-12T00:52:40.344674+0000","last_became_peered":"2024-09-12T00:52:40.344674+0000","last_unstale":"2024-09-12T01:17:42.731685+0000","last_undegraded":"2024-09-12T01:17:42.731685+0000","last_fullsized":"2024-09-12T01:17:42.731685+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:43.041640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4968,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":10,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'5","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:38.552662+0000","last_change":"2024-09-12T00:52:37.295217+0000","last_active":"2024-09-12T01:17:38.552662+0000","last_peered":"2024-09-12T01:17:38.552662+0000","last_clean":"2024-09-12T01:17:38.552662+0000","last_became_active":"2024-09-12T00:52:37.294438+0000","last_became_peered":"2024-09-12T00:52:37.294438+0000","last_unstale":"2024-09-12T01:17:38.552662+0000","last_undegraded":"2024-09-12T01:17:38.552662+0000","last_fullsized":"2024-09-12T01:17:38.552662+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:53.566890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":10,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'42","reported_seq":164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:10.566329+0000","last_change":"2024-09-12T00:51:04.962325+0000","last_active":"2024-09-12T01:19:10.566329+0000","last_peered":"2024-09-12T01:19:10.566329+0000","last_clean":"2024-09-12T01:19:10.566329+0000","last_became_active":"2024-09-12T00:51:04.961677+0000","last_became_peered":"2024-09-12T00:51:04.961677+0000","last_unstale":"2024-09-12T01:19:10.566329+0000","last_undegraded":"2024-09-12T01:19:10.566329+0000","last_fullsized":"2024-09-12T01:19:10.566329+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:51.606282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":168,"num_write":72,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:12.545131+0000","last_change":"2024-09-12T01:03:40.577634+0000","last_active":"2024-09-12T01:18:12.545131+0000","last_peered":"2024-09-12T01:18:12.545131+0000","last_clean":"2024-09-12T01:18:12.545131+0000","last_became_active":"2024-09-12T01:03:40.576550+0000","last_became_peered":"2024-09-12T01:03:40.576550+0000","last_unstale":"2024-09-12T01:18:12.545131+0000","last_undegraded":"2024-09-12T01:18:12.545131+0000","last_fullsized":"2024-09-12T01:18:12.545131+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:55.304251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"265'4","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.582110+0000","last_change":"2024-09-12T00:52:40.341193+0000","last_active":"2024-09-12T01:19:48.582110+0000","last_peered":"2024-09-12T01:19:48.582110+0000","last_clean":"2024-09-12T01:19:48.582110+0000","last_became_active":"2024-09-12T00:52:40.337945+0000","last_became_peered":"2024-09-12T00:52:40.337945+0000","last_unstale":"2024-09-12T01:19:48.582110+0000","last_undegraded":"2024-09-12T01:19:48.582110+0000","last_fullsized":"2024-09-12T01:19:48.582110+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:20.078369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:45.560948+0000","last_change":"2024-09-12T00:52:37.297111+0000","last_active":"2024-09-12T01:18:45.560948+0000","last_peered":"2024-09-12T01:18:45.560948+0000","last_clean":"2024-09-12T01:18:45.560948+0000","last_became_active":"2024-09-12T00:52:37.296335+0000","last_became_peered":"2024-09-12T00:52:37.296335+0000","last_unstale":"2024-09-12T01:18:45.560948+0000","last_undegraded":"2024-09-12T01:18:45.560948+0000","last_fullsized":"2024-09-12T01:18:45.560948+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:01.174517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'30","reported_seq":128,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.564783+0000","last_change":"2024-09-12T00:51:04.997842+0000","last_active":"2024-09-12T01:18:38.564783+0000","last_peered":"2024-09-12T01:18:38.564783+0000","last_clean":"2024-09-12T01:18:38.564783+0000","last_became_active":"2024-09-12T00:51:04.992519+0000","last_became_peered":"2024-09-12T00:51:04.992519+0000","last_unstale":"2024-09-12T01:18:38.564783+0000","last_undegraded":"2024-09-12T01:18:38.564783+0000","last_fullsized":"2024-09-12T01:18:38.564783+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:13.960445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":105,"num_write":58,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.579674+0000","last_change":"2024-09-12T01:03:40.587244+0000","last_active":"2024-09-12T01:18:18.579674+0000","last_peered":"2024-09-12T01:18:18.579674+0000","last_clean":"2024-09-12T01:18:18.579674+0000","last_became_active":"2024-09-12T01:03:40.586582+0000","last_became_peered":"2024-09-12T01:03:40.586582+0000","last_unstale":"2024-09-12T01:18:18.579674+0000","last_undegraded":"2024-09-12T01:18:18.579674+0000","last_fullsized":"2024-09-12T01:18:18.579674+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:46.195286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'3","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:23.575693+0000","last_change":"2024-09-12T00:53:18.616189+0000","last_active":"2024-09-12T01:19:23.575693+0000","last_peered":"2024-09-12T01:19:23.575693+0000","last_clean":"2024-09-12T01:19:23.575693+0000","last_became_active":"2024-09-12T00:53:18.615877+0000","last_became_peered":"2024-09-12T00:53:18.615877+0000","last_unstale":"2024-09-12T01:19:23.575693+0000","last_undegraded":"2024-09-12T01:19:23.575693+0000","last_fullsized":"2024-09-12T01:19:23.575693+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:35.115620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6331601,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6184,"num_write":3,"num_write_kb":6184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:42.558460+0000","last_change":"2024-09-12T00:52:37.277359+0000","last_active":"2024-09-12T01:19:42.558460+0000","last_peered":"2024-09-12T01:19:42.558460+0000","last_clean":"2024-09-12T01:19:42.558460+0000","last_became_active":"2024-09-12T00:52:37.270357+0000","last_became_peered":"2024-09-12T00:52:37.270357+0000","last_unstale":"2024-09-12T01:19:42.558460+0000","last_undegraded":"2024-09-12T01:19:42.558460+0000","last_fullsized":"2024-09-12T01:19:42.558460+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:03.048579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'29","reported_seq":125,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.585016+0000","last_change":"2024-09-12T00:51:04.995220+0000","last_active":"2024-09-12T01:18:38.585016+0000","last_peered":"2024-09-12T01:18:38.585016+0000","last_clean":"2024-09-12T01:18:38.585016+0000","last_became_active":"2024-09-12T00:51:04.994459+0000","last_became_peered":"2024-09-12T00:51:04.994459+0000","last_unstale":"2024-09-12T01:18:38.585016+0000","last_undegraded":"2024-09-12T01:18:38.585016+0000","last_fullsized":"2024-09-12T01:18:38.585016+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:32.327605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":61,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.601539+0000","last_change":"2024-09-12T01:03:40.594312+0000","last_active":"2024-09-12T01:19:48.601539+0000","last_peered":"2024-09-12T01:19:48.601539+0000","last_clean":"2024-09-12T01:19:48.601539+0000","last_became_active":"2024-09-12T01:03:40.593614+0000","last_became_peered":"2024-09-12T01:03:40.593614+0000","last_unstale":"2024-09-12T01:19:48.601539+0000","last_undegraded":"2024-09-12T01:19:48.601539+0000","last_fullsized":"2024-09-12T01:19:48.601539+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:51.667787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"265'5","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:23.567256+0000","last_change":"2024-09-12T00:52:40.358057+0000","last_active":"2024-09-12T01:19:23.567256+0000","last_peered":"2024-09-12T01:19:23.567256+0000","last_clean":"2024-09-12T01:19:23.567256+0000","last_became_active":"2024-09-12T00:52:40.356507+0000","last_became_peered":"2024-09-12T00:52:40.356507+0000","last_unstale":"2024-09-12T01:19:23.567256+0000","last_undegraded":"2024-09-12T01:19:23.567256+0000","last_fullsized":"2024-09-12T01:19:23.567256+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:07.353171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":17408,"num_write":5,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:13.572946+0000","last_change":"2024-09-12T00:52:37.293774+0000","last_active":"2024-09-12T01:19:13.572946+0000","last_peered":"2024-09-12T01:19:13.572946+0000","last_clean":"2024-09-12T01:19:13.572946+0000","last_became_active":"2024-09-12T00:52:37.293298+0000","last_became_peered":"2024-09-12T00:52:37.293298+0000","last_unstale":"2024-09-12T01:19:13.572946+0000","last_undegraded":"2024-09-12T01:19:13.572946+0000","last_fullsized":"2024-09-12T01:19:13.572946+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:24.891123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"262'30","reported_seq":137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.584909+0000","last_change":"2024-09-12T00:51:04.996662+0000","last_active":"2024-09-12T01:18:38.584909+0000","last_peered":"2024-09-12T01:18:38.584909+0000","last_clean":"2024-09-12T01:18:38.584909+0000","last_became_active":"2024-09-12T00:51:04.995863+0000","last_became_peered":"2024-09-12T00:51:04.995863+0000","last_unstale":"2024-09-12T01:18:38.584909+0000","last_undegraded":"2024-09-12T01:18:38.584909+0000","last_fullsized":"2024-09-12T01:18:38.584909+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:04.557157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":123,"num_write":48,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.561295+0000","last_change":"2024-09-12T01:03:40.576503+0000","last_active":"2024-09-12T01:18:18.561295+0000","last_peered":"2024-09-12T01:18:18.561295+0000","last_clean":"2024-09-12T01:18:18.561295+0000","last_became_active":"2024-09-12T01:03:40.575481+0000","last_became_peered":"2024-09-12T01:03:40.575481+0000","last_unstale":"2024-09-12T01:18:18.561295+0000","last_undegraded":"2024-09-12T01:18:18.561295+0000","last_fullsized":"2024-09-12T01:18:18.561295+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:48.119658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:17.559249+0000","last_change":"2024-09-12T00:52:40.350599+0000","last_active":"2024-09-12T01:19:17.559249+0000","last_peered":"2024-09-12T01:19:17.559249+0000","last_clean":"2024-09-12T01:19:17.559249+0000","last_became_active":"2024-09-12T00:52:40.349826+0000","last_became_peered":"2024-09-12T00:52:40.349826+0000","last_unstale":"2024-09-12T01:19:17.559249+0000","last_undegraded":"2024-09-12T01:19:17.559249+0000","last_fullsized":"2024-09-12T01:19:17.559249+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:49.311099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"265'15","reported_seq":83,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:22.553034+0000","last_change":"2024-09-12T00:52:37.284934+0000","last_active":"2024-09-12T01:19:22.553034+0000","last_peered":"2024-09-12T01:19:22.553034+0000","last_clean":"2024-09-12T01:19:22.553034+0000","last_became_active":"2024-09-12T00:52:37.283600+0000","last_became_peered":"2024-09-12T00:52:37.283600+0000","last_unstale":"2024-09-12T01:19:22.553034+0000","last_undegraded":"2024-09-12T01:19:22.553034+0000","last_fullsized":"2024-09-12T01:19:22.553034+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:50.299864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10488976,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":56328,"num_write":25,"num_write_kb":20484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"265'59","reported_seq":206,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:37.551106+0000","last_change":"2024-09-12T00:51:04.983051+0000","last_active":"2024-09-12T01:18:37.551106+0000","last_peered":"2024-09-12T01:18:37.551106+0000","last_clean":"2024-09-12T01:18:37.551106+0000","last_became_active":"2024-09-12T00:51:04.982228+0000","last_became_peered":"2024-09-12T00:51:04.982228+0000","last_unstale":"2024-09-12T01:18:37.551106+0000","last_undegraded":"2024-09-12T01:18:37.551106+0000","last_fullsized":"2024-09-12T01:18:37.551106+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:07.565984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":210,"num_write":106,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.785889+0000","last_change":"2024-09-12T01:03:40.569067+0000","last_active":"2024-09-12T01:18:42.785889+0000","last_peered":"2024-09-12T01:18:42.785889+0000","last_clean":"2024-09-12T01:18:42.785889+0000","last_became_active":"2024-09-12T01:03:40.568346+0000","last_became_peered":"2024-09-12T01:03:40.568346+0000","last_unstale":"2024-09-12T01:18:42.785889+0000","last_undegraded":"2024-09-12T01:18:42.785889+0000","last_fullsized":"2024-09-12T01:18:42.785889+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:12.448021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"265'2","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:42.538508+0000","last_change":"2024-09-12T00:52:40.340425+0000","last_active":"2024-09-12T01:17:42.538508+0000","last_peered":"2024-09-12T01:17:42.538508+0000","last_clean":"2024-09-12T01:17:42.538508+0000","last_became_active":"2024-09-12T00:52:40.339627+0000","last_became_peered":"2024-09-12T00:52:40.339627+0000","last_unstale":"2024-09-12T01:17:42.538508+0000","last_undegraded":"2024-09-12T01:17:42.538508+0000","last_fullsized":"2024-09-12T01:17:42.538508+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:05.869695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"262'3","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:37.730433+0000","last_change":"2024-09-12T00:52:37.283996+0000","last_active":"2024-09-12T01:17:37.730433+0000","last_peered":"2024-09-12T01:17:37.730433+0000","last_clean":"2024-09-12T01:17:37.730433+0000","last_became_active":"2024-09-12T00:52:37.283199+0000","last_became_peered":"2024-09-12T00:52:37.283199+0000","last_unstale":"2024-09-12T01:17:37.730433+0000","last_undegraded":"2024-09-12T01:17:37.730433+0000","last_fullsized":"2024-09-12T01:17:37.730433+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:03.588195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"265'5","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.689244+0000","last_change":"2024-09-12T00:51:04.988358+0000","last_active":"2024-09-12T01:19:18.689244+0000","last_peered":"2024-09-12T01:19:18.689244+0000","last_clean":"2024-09-12T01:19:18.689244+0000","last_became_active":"2024-09-12T00:51:04.981675+0000","last_became_peered":"2024-09-12T00:51:04.981675+0000","last_unstale":"2024-09-12T01:19:18.689244+0000","last_undegraded":"2024-09-12T01:19:18.689244+0000","last_fullsized":"2024-09-12T01:19:18.689244+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:29.580737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.785967+0000","last_change":"2024-09-12T01:03:40.577284+0000","last_active":"2024-09-12T01:18:42.785967+0000","last_peered":"2024-09-12T01:18:42.785967+0000","last_clean":"2024-09-12T01:18:42.785967+0000","last_became_active":"2024-09-12T01:03:40.576430+0000","last_became_peered":"2024-09-12T01:03:40.576430+0000","last_unstale":"2024-09-12T01:18:42.785967+0000","last_undegraded":"2024-09-12T01:18:42.785967+0000","last_fullsized":"2024-09-12T01:18:42.785967+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:37.105480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'1","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.571021+0000","last_change":"2024-09-12T00:52:40.346703+0000","last_active":"2024-09-12T01:17:43.571021+0000","last_peered":"2024-09-12T01:17:43.571021+0000","last_clean":"2024-09-12T01:17:43.571021+0000","last_became_active":"2024-09-12T00:52:40.345995+0000","last_became_peered":"2024-09-12T00:52:40.345995+0000","last_unstale":"2024-09-12T01:17:43.571021+0000","last_undegraded":"2024-09-12T01:17:43.571021+0000","last_fullsized":"2024-09-12T01:17:43.571021+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:53.845660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3216,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'1","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:38.549833+0000","last_change":"2024-09-12T00:52:37.300110+0000","last_active":"2024-09-12T01:17:38.549833+0000","last_peered":"2024-09-12T01:17:38.549833+0000","last_clean":"2024-09-12T01:17:38.549833+0000","last_became_active":"2024-09-12T00:52:37.299604+0000","last_became_peered":"2024-09-12T00:52:37.299604+0000","last_unstale":"2024-09-12T01:17:38.549833+0000","last_undegraded":"2024-09-12T01:17:38.549833+0000","last_fullsized":"2024-09-12T01:17:38.549833+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:04.899567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'41","reported_seq":157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.553749+0000","last_change":"2024-09-12T00:51:04.969892+0000","last_active":"2024-09-12T01:17:43.553749+0000","last_peered":"2024-09-12T01:17:43.553749+0000","last_clean":"2024-09-12T01:17:43.553749+0000","last_became_active":"2024-09-12T00:51:04.968673+0000","last_became_peered":"2024-09-12T00:51:04.968673+0000","last_unstale":"2024-09-12T01:17:43.553749+0000","last_undegraded":"2024-09-12T01:17:43.553749+0000","last_fullsized":"2024-09-12T01:17:43.553749+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:09.083642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":145,"num_write":79,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.553934+0000","last_change":"2024-09-12T01:03:40.591077+0000","last_active":"2024-09-12T01:17:43.553934+0000","last_peered":"2024-09-12T01:17:43.553934+0000","last_clean":"2024-09-12T01:17:43.553934+0000","last_became_active":"2024-09-12T01:03:40.590440+0000","last_became_peered":"2024-09-12T01:03:40.590440+0000","last_unstale":"2024-09-12T01:17:43.553934+0000","last_undegraded":"2024-09-12T01:17:43.553934+0000","last_fullsized":"2024-09-12T01:17:43.553934+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:52.159624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.594467+0000","last_change":"2024-09-12T00:52:40.363386+0000","last_active":"2024-09-12T01:19:18.594467+0000","last_peered":"2024-09-12T01:19:18.594467+0000","last_clean":"2024-09-12T01:19:18.594467+0000","last_became_active":"2024-09-12T00:52:40.359069+0000","last_became_peered":"2024-09-12T00:52:40.359069+0000","last_unstale":"2024-09-12T01:19:18.594467+0000","last_undegraded":"2024-09-12T01:19:18.594467+0000","last_fullsized":"2024-09-12T01:19:18.594467+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:47.963386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"262'5","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.553521+0000","last_change":"2024-09-12T00:52:37.274416+0000","last_active":"2024-09-12T01:18:23.553521+0000","last_peered":"2024-09-12T01:18:23.553521+0000","last_clean":"2024-09-12T01:18:23.553521+0000","last_became_active":"2024-09-12T00:52:37.273684+0000","last_became_peered":"2024-09-12T00:52:37.273684+0000","last_unstale":"2024-09-12T01:18:23.553521+0000","last_undegraded":"2024-09-12T01:18:23.553521+0000","last_fullsized":"2024-09-12T01:18:23.553521+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:25.538379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":25602,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'50","reported_seq":182,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.551251+0000","last_change":"2024-09-12T00:51:04.999190+0000","last_active":"2024-09-12T01:17:43.551251+0000","last_peered":"2024-09-12T01:17:43.551251+0000","last_clean":"2024-09-12T01:17:43.551251+0000","last_became_active":"2024-09-12T00:51:04.993887+0000","last_became_peered":"2024-09-12T00:51:04.993887+0000","last_unstale":"2024-09-12T01:17:43.551251+0000","last_undegraded":"2024-09-12T01:17:43.551251+0000","last_fullsized":"2024-09-12T01:17:43.551251+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:49.567739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":256,"num_read_kb":177,"num_write":91,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:40.546741+0000","last_change":"2024-09-12T01:03:40.581951+0000","last_active":"2024-09-12T01:17:40.546741+0000","last_peered":"2024-09-12T01:17:40.546741+0000","last_clean":"2024-09-12T01:17:40.546741+0000","last_became_active":"2024-09-12T01:03:40.580348+0000","last_became_peered":"2024-09-12T01:03:40.580348+0000","last_unstale":"2024-09-12T01:17:40.546741+0000","last_undegraded":"2024-09-12T01:17:40.546741+0000","last_fullsized":"2024-09-12T01:17:40.546741+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:17.235776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"262'8","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:28.582340+0000","last_change":"2024-09-12T00:52:40.366179+0000","last_active":"2024-09-12T01:18:28.582340+0000","last_peered":"2024-09-12T01:18:28.582340+0000","last_clean":"2024-09-12T01:18:28.582340+0000","last_became_active":"2024-09-12T00:52:40.363347+0000","last_became_peered":"2024-09-12T00:52:40.363347+0000","last_unstale":"2024-09-12T01:18:28.582340+0000","last_undegraded":"2024-09-12T01:18:28.582340+0000","last_fullsized":"2024-09-12T01:18:28.582340+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:06.883385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":21506,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:12.793072+0000","last_change":"2024-09-12T00:52:37.288899+0000","last_active":"2024-09-12T01:19:12.793072+0000","last_peered":"2024-09-12T01:19:12.793072+0000","last_clean":"2024-09-12T01:19:12.793072+0000","last_became_active":"2024-09-12T00:52:37.288074+0000","last_became_peered":"2024-09-12T00:52:37.288074+0000","last_unstale":"2024-09-12T01:19:12.793072+0000","last_undegraded":"2024-09-12T01:19:12.793072+0000","last_fullsized":"2024-09-12T01:19:12.793072+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:03.061143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'39","reported_seq":155,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.571162+0000","last_change":"2024-09-12T00:51:04.982973+0000","last_active":"2024-09-12T01:17:43.571162+0000","last_peered":"2024-09-12T01:17:43.571162+0000","last_clean":"2024-09-12T01:17:43.571162+0000","last_became_active":"2024-09-12T00:51:04.976345+0000","last_became_peered":"2024-09-12T00:51:04.976345+0000","last_unstale":"2024-09-12T01:17:43.571162+0000","last_undegraded":"2024-09-12T01:17:43.571162+0000","last_fullsized":"2024-09-12T01:17:43.571162+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:17.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":155,"num_write":57,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:42.771617+0000","last_change":"2024-09-12T01:03:40.561539+0000","last_active":"2024-09-12T01:17:42.771617+0000","last_peered":"2024-09-12T01:17:42.771617+0000","last_clean":"2024-09-12T01:17:42.771617+0000","last_became_active":"2024-09-12T01:03:40.560777+0000","last_became_peered":"2024-09-12T01:03:40.560777+0000","last_unstale":"2024-09-12T01:17:42.771617+0000","last_undegraded":"2024-09-12T01:17:42.771617+0000","last_fullsized":"2024-09-12T01:17:42.771617+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:37.457658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"265'2","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.594548+0000","last_change":"2024-09-12T00:52:40.353226+0000","last_active":"2024-09-12T01:19:18.594548+0000","last_peered":"2024-09-12T01:19:18.594548+0000","last_clean":"2024-09-12T01:19:18.594548+0000","last_became_active":"2024-09-12T00:52:40.352292+0000","last_became_peered":"2024-09-12T00:52:40.352292+0000","last_unstale":"2024-09-12T01:19:18.594548+0000","last_undegraded":"2024-09-12T01:19:18.594548+0000","last_fullsized":"2024-09-12T01:19:18.594548+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:37.809308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:15.567423+0000","last_change":"2024-09-12T00:52:37.286387+0000","last_active":"2024-09-12T01:19:15.567423+0000","last_peered":"2024-09-12T01:19:15.567423+0000","last_clean":"2024-09-12T01:19:15.567423+0000","last_became_active":"2024-09-12T00:52:37.284325+0000","last_became_peered":"2024-09-12T00:52:37.284325+0000","last_unstale":"2024-09-12T01:19:15.567423+0000","last_undegraded":"2024-09-12T01:19:15.567423+0000","last_fullsized":"2024-09-12T01:19:15.567423+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:25.766191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'20","reported_seq":101,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:40.546841+0000","last_change":"2024-09-12T00:51:04.962264+0000","last_active":"2024-09-12T01:17:40.546841+0000","last_peered":"2024-09-12T01:17:40.546841+0000","last_clean":"2024-09-12T01:17:40.546841+0000","last_became_active":"2024-09-12T00:51:04.961563+0000","last_became_peered":"2024-09-12T00:51:04.961563+0000","last_unstale":"2024-09-12T01:17:40.546841+0000","last_undegraded":"2024-09-12T01:17:40.546841+0000","last_fullsized":"2024-09-12T01:17:40.546841+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:40.487439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":68,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.543964+0000","last_change":"2024-09-12T01:03:40.580752+0000","last_active":"2024-09-12T01:17:43.543964+0000","last_peered":"2024-09-12T01:17:43.543964+0000","last_clean":"2024-09-12T01:17:43.543964+0000","last_became_active":"2024-09-12T01:03:40.580083+0000","last_became_peered":"2024-09-12T01:03:40.580083+0000","last_unstale":"2024-09-12T01:17:43.543964+0000","last_undegraded":"2024-09-12T01:17:43.543964+0000","last_fullsized":"2024-09-12T01:17:43.543964+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:14.771651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:17.551978+0000","last_change":"2024-09-12T00:52:40.344308+0000","last_active":"2024-09-12T01:19:17.551978+0000","last_peered":"2024-09-12T01:19:17.551978+0000","last_clean":"2024-09-12T01:19:17.551978+0000","last_became_active":"2024-09-12T00:52:40.336368+0000","last_became_peered":"2024-09-12T00:52:40.336368+0000","last_unstale":"2024-09-12T01:19:17.551978+0000","last_undegraded":"2024-09-12T01:19:17.551978+0000","last_fullsized":"2024-09-12T01:19:17.551978+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:44.066859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:13.573252+0000","last_change":"2024-09-12T00:52:37.299654+0000","last_active":"2024-09-12T01:19:13.573252+0000","last_peered":"2024-09-12T01:19:13.573252+0000","last_clean":"2024-09-12T01:19:13.573252+0000","last_became_active":"2024-09-12T00:52:37.295945+0000","last_became_peered":"2024-09-12T00:52:37.295945+0000","last_unstale":"2024-09-12T01:19:13.573252+0000","last_undegraded":"2024-09-12T01:19:13.573252+0000","last_fullsized":"2024-09-12T01:19:13.573252+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:17.464675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"265'27","reported_seq":124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.791931+0000","last_change":"2024-09-12T00:51:04.976524+0000","last_active":"2024-09-12T01:19:07.791931+0000","last_peered":"2024-09-12T01:19:07.791931+0000","last_clean":"2024-09-12T01:19:07.791931+0000","last_became_active":"2024-09-12T00:51:04.975831+0000","last_became_peered":"2024-09-12T00:51:04.975831+0000","last_unstale":"2024-09-12T01:19:07.791931+0000","last_undegraded":"2024-09-12T01:19:07.791931+0000","last_fullsized":"2024-09-12T01:19:07.791931+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:24.928244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":101,"num_write":53,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.578542+0000","last_change":"2024-09-12T01:03:40.580652+0000","last_active":"2024-09-12T01:18:13.578542+0000","last_peered":"2024-09-12T01:18:13.578542+0000","last_clean":"2024-09-12T01:18:13.578542+0000","last_became_active":"2024-09-12T01:03:40.579923+0000","last_became_peered":"2024-09-12T01:03:40.579923+0000","last_unstale":"2024-09-12T01:18:13.578542+0000","last_undegraded":"2024-09-12T01:18:13.578542+0000","last_fullsized":"2024-09-12T01:18:13.578542+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:55.542873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.562207+0000","last_change":"2024-09-12T00:52:40.350130+0000","last_active":"2024-09-12T01:18:23.562207+0000","last_peered":"2024-09-12T01:18:23.562207+0000","last_clean":"2024-09-12T01:18:23.562207+0000","last_became_active":"2024-09-12T00:52:40.349363+0000","last_became_peered":"2024-09-12T00:52:40.349363+0000","last_unstale":"2024-09-12T01:18:23.562207+0000","last_undegraded":"2024-09-12T01:18:23.562207+0000","last_fullsized":"2024-09-12T01:18:23.562207+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:18.586220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.739114+0000","last_change":"2024-09-12T00:52:37.278835+0000","last_active":"2024-09-12T01:18:17.739114+0000","last_peered":"2024-09-12T01:18:17.739114+0000","last_clean":"2024-09-12T01:18:17.739114+0000","last_became_active":"2024-09-12T00:52:37.270958+0000","last_became_peered":"2024-09-12T00:52:37.270958+0000","last_unstale":"2024-09-12T01:18:17.739114+0000","last_undegraded":"2024-09-12T01:18:17.739114+0000","last_fullsized":"2024-09-12T01:18:17.739114+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:49.398281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'19","reported_seq":96,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.791884+0000","last_change":"2024-09-12T00:51:04.976492+0000","last_active":"2024-09-12T01:19:07.791884+0000","last_peered":"2024-09-12T01:19:07.791884+0000","last_clean":"2024-09-12T01:19:07.791884+0000","last_became_active":"2024-09-12T00:51:04.975763+0000","last_became_peered":"2024-09-12T00:51:04.975763+0000","last_unstale":"2024-09-12T01:19:07.791884+0000","last_undegraded":"2024-09-12T01:19:07.791884+0000","last_fullsized":"2024-09-12T01:19:07.791884+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:51.238336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.558357+0000","last_change":"2024-09-12T01:03:40.586341+0000","last_active":"2024-09-12T01:18:13.558357+0000","last_peered":"2024-09-12T01:18:13.558357+0000","last_clean":"2024-09-12T01:18:13.558357+0000","last_became_active":"2024-09-12T01:03:40.581062+0000","last_became_peered":"2024-09-12T01:03:40.581062+0000","last_unstale":"2024-09-12T01:18:13.558357+0000","last_undegraded":"2024-09-12T01:18:13.558357+0000","last_fullsized":"2024-09-12T01:18:13.558357+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:40.147480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'8","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.562133+0000","last_change":"2024-09-12T00:52:40.344506+0000","last_active":"2024-09-12T01:18:23.562133+0000","last_peered":"2024-09-12T01:18:23.562133+0000","last_clean":"2024-09-12T01:18:23.562133+0000","last_became_active":"2024-09-12T00:52:40.343871+0000","last_became_peered":"2024-09-12T00:52:40.343871+0000","last_unstale":"2024-09-12T01:18:23.562133+0000","last_undegraded":"2024-09-12T01:18:23.562133+0000","last_fullsized":"2024-09-12T01:18:23.562133+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:04.586939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088721,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":22610,"num_write":13,"num_write_kb":6184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.579601+0000","last_change":"2024-09-12T00:52:37.281395+0000","last_active":"2024-09-12T01:18:18.579601+0000","last_peered":"2024-09-12T01:18:18.579601+0000","last_clean":"2024-09-12T01:18:18.579601+0000","last_became_active":"2024-09-12T00:52:37.276237+0000","last_became_peered":"2024-09-12T00:52:37.276237+0000","last_unstale":"2024-09-12T01:18:18.579601+0000","last_undegraded":"2024-09-12T01:18:18.579601+0000","last_fullsized":"2024-09-12T01:18:18.579601+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:50.583225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'15","reported_seq":87,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.571778+0000","last_change":"2024-09-12T00:51:04.995560+0000","last_active":"2024-09-12T01:19:08.571778+0000","last_peered":"2024-09-12T01:19:08.571778+0000","last_clean":"2024-09-12T01:19:08.571778+0000","last_became_active":"2024-09-12T00:51:04.994606+0000","last_became_peered":"2024-09-12T00:51:04.994606+0000","last_unstale":"2024-09-12T01:19:08.571778+0000","last_undegraded":"2024-09-12T01:19:08.571778+0000","last_fullsized":"2024-09-12T01:19:08.571778+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:54.892667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:48.552306+0000","last_change":"2024-09-12T01:03:40.582311+0000","last_active":"2024-09-12T01:17:48.552306+0000","last_peered":"2024-09-12T01:17:48.552306+0000","last_clean":"2024-09-12T01:17:48.552306+0000","last_became_active":"2024-09-12T01:03:40.581586+0000","last_became_peered":"2024-09-12T01:03:40.581586+0000","last_unstale":"2024-09-12T01:17:48.552306+0000","last_undegraded":"2024-09-12T01:17:48.552306+0000","last_fullsized":"2024-09-12T01:17:48.552306+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:01.950258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'6","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.580901+0000","last_change":"2024-09-12T00:52:40.366365+0000","last_active":"2024-09-12T01:18:23.580901+0000","last_peered":"2024-09-12T01:18:23.580901+0000","last_clean":"2024-09-12T01:18:23.580901+0000","last_became_active":"2024-09-12T00:52:40.363072+0000","last_became_peered":"2024-09-12T00:52:40.363072+0000","last_unstale":"2024-09-12T01:18:23.580901+0000","last_undegraded":"2024-09-12T01:18:23.580901+0000","last_fullsized":"2024-09-12T01:18:23.580901+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:34.771598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":9232,"num_write":6,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.546176+0000","last_change":"2024-09-12T00:52:37.291760+0000","last_active":"2024-09-12T01:18:17.546176+0000","last_peered":"2024-09-12T01:18:17.546176+0000","last_clean":"2024-09-12T01:18:17.546176+0000","last_became_active":"2024-09-12T00:52:37.291045+0000","last_became_peered":"2024-09-12T00:52:37.291045+0000","last_unstale":"2024-09-12T01:18:17.546176+0000","last_undegraded":"2024-09-12T01:18:17.546176+0000","last_fullsized":"2024-09-12T01:18:17.546176+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:59.783464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'47","reported_seq":178,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.750363+0000","last_change":"2024-09-12T00:51:04.981572+0000","last_active":"2024-09-12T01:19:07.750363+0000","last_peered":"2024-09-12T01:19:07.750363+0000","last_clean":"2024-09-12T01:19:07.750363+0000","last_became_active":"2024-09-12T00:51:04.980601+0000","last_became_peered":"2024-09-12T00:51:04.980601+0000","last_unstale":"2024-09-12T01:19:07.750363+0000","last_undegraded":"2024-09-12T01:19:07.750363+0000","last_fullsized":"2024-09-12T01:19:07.750363+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:04.644563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":177,"num_write":81,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.578495+0000","last_change":"2024-09-12T01:03:40.580511+0000","last_active":"2024-09-12T01:18:13.578495+0000","last_peered":"2024-09-12T01:18:13.578495+0000","last_clean":"2024-09-12T01:18:13.578495+0000","last_became_active":"2024-09-12T01:03:40.579772+0000","last_became_peered":"2024-09-12T01:03:40.579772+0000","last_unstale":"2024-09-12T01:18:13.578495+0000","last_undegraded":"2024-09-12T01:18:13.578495+0000","last_fullsized":"2024-09-12T01:18:13.578495+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:33.962377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:22.547666+0000","last_change":"2024-09-12T00:52:40.347889+0000","last_active":"2024-09-12T01:18:22.547666+0000","last_peered":"2024-09-12T01:18:22.547666+0000","last_clean":"2024-09-12T01:18:22.547666+0000","last_became_active":"2024-09-12T00:52:40.347156+0000","last_became_peered":"2024-09-12T00:52:40.347156+0000","last_unstale":"2024-09-12T01:18:22.547666+0000","last_undegraded":"2024-09-12T01:18:22.547666+0000","last_fullsized":"2024-09-12T01:18:22.547666+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:29.288092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.552252+0000","last_change":"2024-09-12T00:52:37.291590+0000","last_active":"2024-09-12T01:18:18.552252+0000","last_peered":"2024-09-12T01:18:18.552252+0000","last_clean":"2024-09-12T01:18:18.552252+0000","last_became_active":"2024-09-12T00:52:37.290858+0000","last_became_peered":"2024-09-12T00:52:37.290858+0000","last_unstale":"2024-09-12T01:18:18.552252+0000","last_undegraded":"2024-09-12T01:18:18.552252+0000","last_fullsized":"2024-09-12T01:18:18.552252+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:11.150903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'11","reported_seq":79,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.591802+0000","last_change":"2024-09-12T00:51:04.989507+0000","last_active":"2024-09-12T01:19:08.591802+0000","last_peered":"2024-09-12T01:19:08.591802+0000","last_clean":"2024-09-12T01:19:08.591802+0000","last_became_active":"2024-09-12T00:51:04.988521+0000","last_became_peered":"2024-09-12T00:51:04.988521+0000","last_unstale":"2024-09-12T01:19:08.591802+0000","last_undegraded":"2024-09-12T01:19:08.591802+0000","last_fullsized":"2024-09-12T01:19:08.591802+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:52.795091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:55.563144+0000","last_change":"2024-09-12T01:03:40.592444+0000","last_active":"2024-09-12T01:18:55.563144+0000","last_peered":"2024-09-12T01:18:55.563144+0000","last_clean":"2024-09-12T01:18:55.563144+0000","last_became_active":"2024-09-12T01:03:40.591869+0000","last_became_peered":"2024-09-12T01:03:40.591869+0000","last_unstale":"2024-09-12T01:18:55.563144+0000","last_undegraded":"2024-09-12T01:18:55.563144+0000","last_fullsized":"2024-09-12T01:18:55.563144+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:13.806273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:28.567259+0000","last_change":"2024-09-12T00:52:40.345399+0000","last_active":"2024-09-12T01:17:28.567259+0000","last_peered":"2024-09-12T01:17:28.567259+0000","last_clean":"2024-09-12T01:17:28.567259+0000","last_became_active":"2024-09-12T00:52:40.344566+0000","last_became_peered":"2024-09-12T00:52:40.344566+0000","last_unstale":"2024-09-12T01:17:28.567259+0000","last_undegraded":"2024-09-12T01:17:28.567259+0000","last_fullsized":"2024-09-12T01:17:28.567259+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:08.365603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.799024+0000","last_change":"2024-09-12T00:52:37.289694+0000","last_active":"2024-09-12T01:19:37.799024+0000","last_peered":"2024-09-12T01:19:37.799024+0000","last_clean":"2024-09-12T01:19:37.799024+0000","last_became_active":"2024-09-12T00:52:37.282987+0000","last_became_peered":"2024-09-12T00:52:37.282987+0000","last_unstale":"2024-09-12T01:19:37.799024+0000","last_undegraded":"2024-09-12T01:19:37.799024+0000","last_fullsized":"2024-09-12T01:19:37.799024+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:53.081978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'40","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.578586+0000","last_change":"2024-09-12T00:51:05.001750+0000","last_active":"2024-09-12T01:18:13.578586+0000","last_peered":"2024-09-12T01:18:13.578586+0000","last_clean":"2024-09-12T01:18:13.578586+0000","last_became_active":"2024-09-12T00:51:05.001162+0000","last_became_peered":"2024-09-12T00:51:05.001162+0000","last_unstale":"2024-09-12T01:18:13.578586+0000","last_undegraded":"2024-09-12T01:18:13.578586+0000","last_fullsized":"2024-09-12T01:18:13.578586+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:51.741336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":142,"num_write":73,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:27.796530+0000","last_change":"2024-09-12T01:03:40.558405+0000","last_active":"2024-09-12T01:19:27.796530+0000","last_peered":"2024-09-12T01:19:27.796530+0000","last_clean":"2024-09-12T01:19:27.796530+0000","last_became_active":"2024-09-12T01:03:40.551803+0000","last_became_peered":"2024-09-12T01:03:40.551803+0000","last_unstale":"2024-09-12T01:19:27.796530+0000","last_undegraded":"2024-09-12T01:19:27.796530+0000","last_fullsized":"2024-09-12T01:19:27.796530+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:06.456829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:28.567202+0000","last_change":"2024-09-12T00:52:40.358765+0000","last_active":"2024-09-12T01:17:28.567202+0000","last_peered":"2024-09-12T01:17:28.567202+0000","last_clean":"2024-09-12T01:17:28.567202+0000","last_became_active":"2024-09-12T00:52:40.354387+0000","last_became_peered":"2024-09-12T00:52:40.354387+0000","last_unstale":"2024-09-12T01:17:28.567202+0000","last_undegraded":"2024-09-12T01:17:28.567202+0000","last_fullsized":"2024-09-12T01:17:28.567202+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:13.780637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:40.572945+0000","last_change":"2024-09-12T00:52:37.285727+0000","last_active":"2024-09-12T01:19:40.572945+0000","last_peered":"2024-09-12T01:19:40.572945+0000","last_clean":"2024-09-12T01:19:40.572945+0000","last_became_active":"2024-09-12T00:52:37.285154+0000","last_became_peered":"2024-09-12T00:52:37.285154+0000","last_unstale":"2024-09-12T01:19:40.572945+0000","last_undegraded":"2024-09-12T01:19:40.572945+0000","last_fullsized":"2024-09-12T01:19:40.572945+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:04.603498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'61","reported_seq":212,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.410803+0000","last_change":"2024-09-12T00:51:04.976377+0000","last_active":"2024-09-12T01:19:18.410803+0000","last_peered":"2024-09-12T01:19:18.410803+0000","last_clean":"2024-09-12T01:19:18.410803+0000","last_became_active":"2024-09-12T00:51:04.975583+0000","last_became_peered":"2024-09-12T00:51:04.975583+0000","last_unstale":"2024-09-12T01:19:18.410803+0000","last_undegraded":"2024-09-12T01:19:18.410803+0000","last_fullsized":"2024-09-12T01:19:18.410803+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:40.033682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":309,"num_read_kb":216,"num_write":105,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:52.554219+0000","last_change":"2024-09-12T01:03:40.570955+0000","last_active":"2024-09-12T01:18:52.554219+0000","last_peered":"2024-09-12T01:18:52.554219+0000","last_clean":"2024-09-12T01:18:52.554219+0000","last_became_active":"2024-09-12T01:03:40.569907+0000","last_became_peered":"2024-09-12T01:03:40.569907+0000","last_unstale":"2024-09-12T01:18:52.554219+0000","last_undegraded":"2024-09-12T01:18:52.554219+0000","last_fullsized":"2024-09-12T01:18:52.554219+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:17.110556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:33.551635+0000","last_change":"2024-09-12T00:52:40.343485+0000","last_active":"2024-09-12T01:17:33.551635+0000","last_peered":"2024-09-12T01:17:33.551635+0000","last_clean":"2024-09-12T01:17:33.551635+0000","last_became_active":"2024-09-12T00:52:40.342703+0000","last_became_peered":"2024-09-12T00:52:40.342703+0000","last_unstale":"2024-09-12T01:17:33.551635+0000","last_undegraded":"2024-09-12T01:17:33.551635+0000","last_fullsized":"2024-09-12T01:17:33.551635+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:39.152830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"265'5","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:38.579334+0000","last_change":"2024-09-12T00:52:37.292687+0000","last_active":"2024-09-12T01:19:38.579334+0000","last_peered":"2024-09-12T01:19:38.579334+0000","last_clean":"2024-09-12T01:19:38.579334+0000","last_became_active":"2024-09-12T00:52:37.292449+0000","last_became_peered":"2024-09-12T00:52:37.292449+0000","last_unstale":"2024-09-12T01:19:38.579334+0000","last_undegraded":"2024-09-12T01:19:38.579334+0000","last_fullsized":"2024-09-12T01:19:38.579334+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:54.986888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":15,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'116","reported_seq":403,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:32.106066+0000","last_change":"2024-09-12T00:51:04.985227+0000","last_active":"2024-09-12T01:18:32.106066+0000","last_peered":"2024-09-12T01:18:32.106066+0000","last_clean":"2024-09-12T01:18:32.106066+0000","last_became_active":"2024-09-12T00:51:04.984495+0000","last_became_peered":"2024-09-12T00:51:04.984495+0000","last_unstale":"2024-09-12T01:18:32.106066+0000","last_undegraded":"2024-09-12T01:18:32.106066+0000","last_fullsized":"2024-09-12T01:18:32.106066+0000","mapping_epoch":252,"log_start":"265'100","ondisk_log_start":"265'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:40.069078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":690,"num_read_kb":506,"num_write":167,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:52.788303+0000","last_change":"2024-09-12T01:03:40.566870+0000","last_active":"2024-09-12T01:18:52.788303+0000","last_peered":"2024-09-12T01:18:52.788303+0000","last_clean":"2024-09-12T01:18:52.788303+0000","last_became_active":"2024-09-12T01:03:40.566107+0000","last_became_peered":"2024-09-12T01:03:40.566107+0000","last_unstale":"2024-09-12T01:18:52.788303+0000","last_undegraded":"2024-09-12T01:18:52.788303+0000","last_fullsized":"2024-09-12T01:18:52.788303+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:23.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:28.567304+0000","last_change":"2024-09-12T00:52:40.367723+0000","last_active":"2024-09-12T01:17:28.567304+0000","last_peered":"2024-09-12T01:17:28.567304+0000","last_clean":"2024-09-12T01:17:28.567304+0000","last_became_active":"2024-09-12T00:52:40.367188+0000","last_became_peered":"2024-09-12T00:52:40.367188+0000","last_unstale":"2024-09-12T01:17:28.567304+0000","last_undegraded":"2024-09-12T01:17:28.567304+0000","last_fullsized":"2024-09-12T01:17:28.567304+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:21.283584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"265'1","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:28.550474+0000","last_change":"2024-09-12T00:52:37.289836+0000","last_active":"2024-09-12T01:17:28.550474+0000","last_peered":"2024-09-12T01:17:28.550474+0000","last_clean":"2024-09-12T01:17:28.550474+0000","last_became_active":"2024-09-12T00:52:37.281129+0000","last_became_peered":"2024-09-12T00:52:37.281129+0000","last_unstale":"2024-09-12T01:17:28.550474+0000","last_undegraded":"2024-09-12T01:17:28.550474+0000","last_fullsized":"2024-09-12T01:17:28.550474+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:00.364762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"265'9","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:05.551886+0000","last_change":"2024-09-12T00:51:04.984390+0000","last_active":"2024-09-12T01:18:05.551886+0000","last_peered":"2024-09-12T01:18:05.551886+0000","last_clean":"2024-09-12T01:18:05.551886+0000","last_became_active":"2024-09-12T00:51:04.983577+0000","last_became_peered":"2024-09-12T00:51:04.983577+0000","last_unstale":"2024-09-12T01:18:05.551886+0000","last_undegraded":"2024-09-12T01:18:05.551886+0000","last_fullsized":"2024-09-12T01:18:05.551886+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:11.081544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:28.596883+0000","last_change":"2024-09-12T01:03:40.590449+0000","last_active":"2024-09-12T01:19:28.596883+0000","last_peered":"2024-09-12T01:19:28.596883+0000","last_clean":"2024-09-12T01:19:28.596883+0000","last_became_active":"2024-09-12T01:03:40.589838+0000","last_became_peered":"2024-09-12T01:03:40.589838+0000","last_unstale":"2024-09-12T01:19:28.596883+0000","last_undegraded":"2024-09-12T01:19:28.596883+0000","last_fullsized":"2024-09-12T01:19:28.596883+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:53.282415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.744871+0000","last_change":"2024-09-12T00:52:40.357689+0000","last_active":"2024-09-12T01:18:42.744871+0000","last_peered":"2024-09-12T01:18:42.744871+0000","last_clean":"2024-09-12T01:18:42.744871+0000","last_became_active":"2024-09-12T00:52:40.356802+0000","last_became_peered":"2024-09-12T00:52:40.356802+0000","last_unstale":"2024-09-12T01:18:42.744871+0000","last_undegraded":"2024-09-12T01:18:42.744871+0000","last_fullsized":"2024-09-12T01:18:42.744871+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:51.102558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"265'4","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.564572+0000","last_change":"2024-09-12T00:52:37.294017+0000","last_active":"2024-09-12T01:18:38.564572+0000","last_peered":"2024-09-12T01:18:38.564572+0000","last_clean":"2024-09-12T01:18:38.564572+0000","last_became_active":"2024-09-12T00:52:37.293564+0000","last_became_peered":"2024-09-12T00:52:37.293564+0000","last_unstale":"2024-09-12T01:18:38.564572+0000","last_undegraded":"2024-09-12T01:18:38.564572+0000","last_fullsized":"2024-09-12T01:18:38.564572+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:56.643360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3185873,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3128,"num_write":4,"num_write_kb":3128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"262'16","reported_seq":93,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:08.556985+0000","last_change":"2024-09-12T00:51:04.990981+0000","last_active":"2024-09-12T01:18:08.556985+0000","last_peered":"2024-09-12T01:18:08.556985+0000","last_clean":"2024-09-12T01:18:08.556985+0000","last_became_active":"2024-09-12T00:51:04.981091+0000","last_became_peered":"2024-09-12T00:51:04.981091+0000","last_unstale":"2024-09-12T01:18:08.556985+0000","last_undegraded":"2024-09-12T01:18:08.556985+0000","last_fullsized":"2024-09-12T01:18:08.556985+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:43.002634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:27.796717+0000","last_change":"2024-09-12T01:03:40.566702+0000","last_active":"2024-09-12T01:19:27.796717+0000","last_peered":"2024-09-12T01:19:27.796717+0000","last_clean":"2024-09-12T01:19:27.796717+0000","last_became_active":"2024-09-12T01:03:40.565926+0000","last_became_peered":"2024-09-12T01:03:40.565926+0000","last_unstale":"2024-09-12T01:19:27.796717+0000","last_undegraded":"2024-09-12T01:19:27.796717+0000","last_fullsized":"2024-09-12T01:19:27.796717+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:31.308325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.785653+0000","last_change":"2024-09-12T00:52:40.341080+0000","last_active":"2024-09-12T01:18:42.785653+0000","last_peered":"2024-09-12T01:18:42.785653+0000","last_clean":"2024-09-12T01:18:42.785653+0000","last_became_active":"2024-09-12T00:52:40.340423+0000","last_became_peered":"2024-09-12T00:52:40.340423+0000","last_unstale":"2024-09-12T01:18:42.785653+0000","last_undegraded":"2024-09-12T01:18:42.785653+0000","last_fullsized":"2024-09-12T01:18:42.785653+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:11.370534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"265'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.569352+0000","last_change":"2024-09-12T00:52:37.294639+0000","last_active":"2024-09-12T01:18:38.569352+0000","last_peered":"2024-09-12T01:18:38.569352+0000","last_clean":"2024-09-12T01:18:38.569352+0000","last_became_active":"2024-09-12T00:52:37.293885+0000","last_became_peered":"2024-09-12T00:52:37.293885+0000","last_unstale":"2024-09-12T01:18:38.569352+0000","last_undegraded":"2024-09-12T01:18:38.569352+0000","last_fullsized":"2024-09-12T01:18:38.569352+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:20.571782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'39","reported_seq":151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:19.686513+0000","last_change":"2024-09-12T00:51:04.989066+0000","last_active":"2024-09-12T01:19:19.686513+0000","last_peered":"2024-09-12T01:19:19.686513+0000","last_clean":"2024-09-12T01:19:19.686513+0000","last_became_active":"2024-09-12T00:51:04.988252+0000","last_became_peered":"2024-09-12T00:51:04.988252+0000","last_unstale":"2024-09-12T01:19:19.686513+0000","last_undegraded":"2024-09-12T01:19:19.686513+0000","last_fullsized":"2024-09-12T01:19:19.686513+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:49.691881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":135,"num_write":72,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:27.796591+0000","last_change":"2024-09-12T01:03:40.581034+0000","last_active":"2024-09-12T01:19:27.796591+0000","last_peered":"2024-09-12T01:19:27.796591+0000","last_clean":"2024-09-12T01:19:27.796591+0000","last_became_active":"2024-09-12T01:03:40.580376+0000","last_became_peered":"2024-09-12T01:03:40.580376+0000","last_unstale":"2024-09-12T01:19:27.796591+0000","last_undegraded":"2024-09-12T01:19:27.796591+0000","last_fullsized":"2024-09-12T01:19:27.796591+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:38.778592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:28.550359+0000","last_change":"2024-09-12T00:52:40.338165+0000","last_active":"2024-09-12T01:17:28.550359+0000","last_peered":"2024-09-12T01:17:28.550359+0000","last_clean":"2024-09-12T01:17:28.550359+0000","last_became_active":"2024-09-12T00:52:40.337359+0000","last_became_peered":"2024-09-12T00:52:40.337359+0000","last_unstale":"2024-09-12T01:17:28.550359+0000","last_undegraded":"2024-09-12T01:17:28.550359+0000","last_fullsized":"2024-09-12T01:17:28.550359+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:52.904218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"265'4","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:43.565914+0000","last_change":"2024-09-12T00:52:37.300132+0000","last_active":"2024-09-12T01:18:43.565914+0000","last_peered":"2024-09-12T01:18:43.565914+0000","last_clean":"2024-09-12T01:18:43.565914+0000","last_became_active":"2024-09-12T00:52:37.299461+0000","last_became_peered":"2024-09-12T00:52:37.299461+0000","last_unstale":"2024-09-12T01:18:43.565914+0000","last_undegraded":"2024-09-12T01:18:43.565914+0000","last_fullsized":"2024-09-12T01:18:43.565914+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:06.604639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4968,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5125,"num_write":9,"num_write_kb":5125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'112","reported_seq":395,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.594307+0000","last_change":"2024-09-12T00:51:04.983673+0000","last_active":"2024-09-12T01:19:18.594307+0000","last_peered":"2024-09-12T01:19:18.594307+0000","last_clean":"2024-09-12T01:19:18.594307+0000","last_became_active":"2024-09-12T00:51:04.975690+0000","last_became_peered":"2024-09-12T00:51:04.975690+0000","last_unstale":"2024-09-12T01:19:18.594307+0000","last_undegraded":"2024-09-12T01:19:18.594307+0000","last_fullsized":"2024-09-12T01:19:18.594307+0000","mapping_epoch":252,"log_start":"265'100","ondisk_log_start":"265'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:00.184799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":675,"num_read_kb":541,"num_write":147,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:28.576824+0000","last_change":"2024-09-12T01:03:40.586682+0000","last_active":"2024-09-12T01:19:28.576824+0000","last_peered":"2024-09-12T01:19:28.576824+0000","last_clean":"2024-09-12T01:19:28.576824+0000","last_became_active":"2024-09-12T01:03:40.585894+0000","last_became_peered":"2024-09-12T01:03:40.585894+0000","last_unstale":"2024-09-12T01:19:28.576824+0000","last_undegraded":"2024-09-12T01:19:28.576824+0000","last_fullsized":"2024-09-12T01:19:28.576824+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:09.789910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"262'3","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.785780+0000","last_change":"2024-09-12T00:52:40.355779+0000","last_active":"2024-09-12T01:18:42.785780+0000","last_peered":"2024-09-12T01:18:42.785780+0000","last_clean":"2024-09-12T01:18:42.785780+0000","last_became_active":"2024-09-12T00:52:40.355113+0000","last_became_peered":"2024-09-12T00:52:40.355113+0000","last_unstale":"2024-09-12T01:18:42.785780+0000","last_undegraded":"2024-09-12T01:18:42.785780+0000","last_fullsized":"2024-09-12T01:18:42.785780+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:00.005104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.557067+0000","last_change":"2024-09-12T00:52:37.281177+0000","last_active":"2024-09-12T01:19:37.557067+0000","last_peered":"2024-09-12T01:19:37.557067+0000","last_clean":"2024-09-12T01:19:37.557067+0000","last_became_active":"2024-09-12T00:52:37.280444+0000","last_became_peered":"2024-09-12T00:52:37.280444+0000","last_unstale":"2024-09-12T01:19:37.557067+0000","last_undegraded":"2024-09-12T01:19:37.557067+0000","last_fullsized":"2024-09-12T01:19:37.557067+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:12.563116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'48","reported_seq":181,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:17.559211+0000","last_change":"2024-09-12T00:51:04.985402+0000","last_active":"2024-09-12T01:19:17.559211+0000","last_peered":"2024-09-12T01:19:17.559211+0000","last_clean":"2024-09-12T01:19:17.559211+0000","last_became_active":"2024-09-12T00:51:04.984384+0000","last_became_peered":"2024-09-12T00:51:04.984384+0000","last_unstale":"2024-09-12T01:19:17.559211+0000","last_undegraded":"2024-09-12T01:19:17.559211+0000","last_fullsized":"2024-09-12T01:19:17.559211+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:51.787094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":174,"num_write":98,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.779633+0000","last_change":"2024-09-12T01:03:40.566732+0000","last_active":"2024-09-12T01:18:17.779633+0000","last_peered":"2024-09-12T01:18:17.779633+0000","last_clean":"2024-09-12T01:18:17.779633+0000","last_became_active":"2024-09-12T01:03:40.565972+0000","last_became_peered":"2024-09-12T01:03:40.565972+0000","last_unstale":"2024-09-12T01:18:17.779633+0000","last_undegraded":"2024-09-12T01:18:17.779633+0000","last_fullsized":"2024-09-12T01:18:17.779633+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:13.523686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"262'2","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:48.552357+0000","last_change":"2024-09-12T00:52:40.352965+0000","last_active":"2024-09-12T01:17:48.552357+0000","last_peered":"2024-09-12T01:17:48.552357+0000","last_clean":"2024-09-12T01:17:48.552357+0000","last_became_active":"2024-09-12T00:52:40.352178+0000","last_became_peered":"2024-09-12T00:52:40.352178+0000","last_unstale":"2024-09-12T01:17:48.552357+0000","last_undegraded":"2024-09-12T01:17:48.552357+0000","last_fullsized":"2024-09-12T01:17:48.552357+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:25.540435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:42.800116+0000","last_change":"2024-09-12T00:52:37.281424+0000","last_active":"2024-09-12T01:19:42.800116+0000","last_peered":"2024-09-12T01:19:42.800116+0000","last_clean":"2024-09-12T01:19:42.800116+0000","last_became_active":"2024-09-12T00:52:37.280679+0000","last_became_peered":"2024-09-12T00:52:37.280679+0000","last_unstale":"2024-09-12T01:19:42.800116+0000","last_undegraded":"2024-09-12T01:19:42.800116+0000","last_fullsized":"2024-09-12T01:19:42.800116+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:14.781208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'2","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.574476+0000","last_change":"2024-09-12T00:51:04.998155+0000","last_active":"2024-09-12T01:19:18.574476+0000","last_peered":"2024-09-12T01:19:18.574476+0000","last_clean":"2024-09-12T01:19:18.574476+0000","last_became_active":"2024-09-12T00:51:04.996736+0000","last_became_peered":"2024-09-12T00:51:04.996736+0000","last_unstale":"2024-09-12T01:19:18.574476+0000","last_undegraded":"2024-09-12T01:19:18.574476+0000","last_fullsized":"2024-09-12T01:19:18.574476+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:00.791980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.552215+0000","last_change":"2024-09-12T01:03:40.577490+0000","last_active":"2024-09-12T01:18:18.552215+0000","last_peered":"2024-09-12T01:18:18.552215+0000","last_clean":"2024-09-12T01:18:18.552215+0000","last_became_active":"2024-09-12T01:03:40.576752+0000","last_became_peered":"2024-09-12T01:03:40.576752+0000","last_unstale":"2024-09-12T01:18:18.552215+0000","last_undegraded":"2024-09-12T01:18:18.552215+0000","last_fullsized":"2024-09-12T01:18:18.552215+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:58.912810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"262'8","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.582004+0000","last_change":"2024-09-12T00:52:40.340084+0000","last_active":"2024-09-12T01:19:48.582004+0000","last_peered":"2024-09-12T01:19:48.582004+0000","last_clean":"2024-09-12T01:19:48.582004+0000","last_became_active":"2024-09-12T00:52:40.338378+0000","last_became_peered":"2024-09-12T00:52:40.338378+0000","last_unstale":"2024-09-12T01:19:48.582004+0000","last_undegraded":"2024-09-12T01:19:48.582004+0000","last_fullsized":"2024-09-12T01:19:48.582004+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:29.194283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'5","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:50.575099+0000","last_change":"2024-09-12T00:52:37.285880+0000","last_active":"2024-09-12T01:19:50.575099+0000","last_peered":"2024-09-12T01:19:50.575099+0000","last_clean":"2024-09-12T01:19:50.575099+0000","last_became_active":"2024-09-12T00:52:37.284206+0000","last_became_peered":"2024-09-12T00:52:37.284206+0000","last_unstale":"2024-09-12T01:19:50.575099+0000","last_undegraded":"2024-09-12T01:19:50.575099+0000","last_fullsized":"2024-09-12T01:19:50.575099+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:30.930785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":18432,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'21","reported_seq":106,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:17.559410+0000","last_change":"2024-09-12T00:51:04.983851+0000","last_active":"2024-09-12T01:19:17.559410+0000","last_peered":"2024-09-12T01:19:17.559410+0000","last_clean":"2024-09-12T01:19:17.559410+0000","last_became_active":"2024-09-12T00:51:04.983165+0000","last_became_peered":"2024-09-12T00:51:04.983165+0000","last_unstale":"2024-09-12T01:19:17.559410+0000","last_undegraded":"2024-09-12T01:19:17.559410+0000","last_fullsized":"2024-09-12T01:19:17.559410+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:30.417623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":73,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.584915+0000","last_change":"2024-09-12T01:03:40.579521+0000","last_active":"2024-09-12T01:19:48.584915+0000","last_peered":"2024-09-12T01:19:48.584915+0000","last_clean":"2024-09-12T01:19:48.584915+0000","last_became_active":"2024-09-12T01:03:40.578825+0000","last_became_peered":"2024-09-12T01:03:40.578825+0000","last_unstale":"2024-09-12T01:19:48.584915+0000","last_undegraded":"2024-09-12T01:19:48.584915+0000","last_fullsized":"2024-09-12T01:19:48.584915+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:02.779228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"265'2","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.786027+0000","last_change":"2024-09-12T00:52:40.353791+0000","last_active":"2024-09-12T01:18:42.786027+0000","last_peered":"2024-09-12T01:18:42.786027+0000","last_clean":"2024-09-12T01:18:42.786027+0000","last_became_active":"2024-09-12T00:52:40.352922+0000","last_became_peered":"2024-09-12T00:52:40.352922+0000","last_unstale":"2024-09-12T01:18:42.786027+0000","last_undegraded":"2024-09-12T01:18:42.786027+0000","last_fullsized":"2024-09-12T01:18:42.786027+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:33.594783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.556947+0000","last_change":"2024-09-12T00:52:37.281272+0000","last_active":"2024-09-12T01:18:38.556947+0000","last_peered":"2024-09-12T01:18:38.556947+0000","last_clean":"2024-09-12T01:18:38.556947+0000","last_became_active":"2024-09-12T00:52:37.280548+0000","last_became_peered":"2024-09-12T00:52:37.280548+0000","last_unstale":"2024-09-12T01:18:38.556947+0000","last_undegraded":"2024-09-12T01:18:38.556947+0000","last_fullsized":"2024-09-12T01:18:38.556947+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:57.882529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'10","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:12.778458+0000","last_change":"2024-09-12T00:51:04.995585+0000","last_active":"2024-09-12T01:18:12.778458+0000","last_peered":"2024-09-12T01:18:12.778458+0000","last_clean":"2024-09-12T01:18:12.778458+0000","last_became_active":"2024-09-12T00:51:04.994904+0000","last_became_peered":"2024-09-12T00:51:04.994904+0000","last_unstale":"2024-09-12T01:18:12.778458+0000","last_undegraded":"2024-09-12T01:18:12.778458+0000","last_fullsized":"2024-09-12T01:18:12.778458+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:29.572409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":34,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.739185+0000","last_change":"2024-09-12T01:03:40.577193+0000","last_active":"2024-09-12T01:18:17.739185+0000","last_peered":"2024-09-12T01:18:17.739185+0000","last_clean":"2024-09-12T01:18:17.739185+0000","last_became_active":"2024-09-12T01:03:40.576442+0000","last_became_peered":"2024-09-12T01:03:40.576442+0000","last_unstale":"2024-09-12T01:18:17.739185+0000","last_undegraded":"2024-09-12T01:18:17.739185+0000","last_fullsized":"2024-09-12T01:18:17.739185+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:03.900955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"265'5","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.745043+0000","last_change":"2024-09-12T00:52:40.346550+0000","last_active":"2024-09-12T01:18:42.745043+0000","last_peered":"2024-09-12T01:18:42.745043+0000","last_clean":"2024-09-12T01:18:42.745043+0000","last_became_active":"2024-09-12T00:52:40.345375+0000","last_became_peered":"2024-09-12T00:52:40.345375+0000","last_unstale":"2024-09-12T01:18:42.745043+0000","last_undegraded":"2024-09-12T01:18:42.745043+0000","last_fullsized":"2024-09-12T01:18:42.745043+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:05.935202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"262'5","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:37.784692+0000","last_change":"2024-09-12T00:52:37.282759+0000","last_active":"2024-09-12T01:18:37.784692+0000","last_peered":"2024-09-12T01:18:37.784692+0000","last_clean":"2024-09-12T01:18:37.784692+0000","last_became_active":"2024-09-12T00:52:37.282005+0000","last_became_peered":"2024-09-12T00:52:37.282005+0000","last_unstale":"2024-09-12T01:18:37.784692+0000","last_undegraded":"2024-09-12T01:18:37.784692+0000","last_fullsized":"2024-09-12T01:18:37.784692+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:50.148380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":5,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"265'13","reported_seq":82,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.560095+0000","last_change":"2024-09-12T00:51:04.991796+0000","last_active":"2024-09-12T01:18:13.560095+0000","last_peered":"2024-09-12T01:18:13.560095+0000","last_clean":"2024-09-12T01:18:13.560095+0000","last_became_active":"2024-09-12T00:51:04.990945+0000","last_became_peered":"2024-09-12T00:51:04.990945+0000","last_unstale":"2024-09-12T01:18:13.560095+0000","last_undegraded":"2024-09-12T01:18:13.560095+0000","last_fullsized":"2024-09-12T01:18:13.560095+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:18.841995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:50.562171+0000","last_change":"2024-09-12T01:03:40.582179+0000","last_active":"2024-09-12T01:18:50.562171+0000","last_peered":"2024-09-12T01:18:50.562171+0000","last_clean":"2024-09-12T01:18:50.562171+0000","last_became_active":"2024-09-12T01:03:40.581227+0000","last_became_peered":"2024-09-12T01:03:40.581227+0000","last_unstale":"2024-09-12T01:18:50.562171+0000","last_undegraded":"2024-09-12T01:18:50.562171+0000","last_fullsized":"2024-09-12T01:18:50.562171+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:44.601346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.584983+0000","last_change":"2024-09-12T00:52:40.341544+0000","last_active":"2024-09-12T01:19:48.584983+0000","last_peered":"2024-09-12T01:19:48.584983+0000","last_clean":"2024-09-12T01:19:48.584983+0000","last_became_active":"2024-09-12T00:52:40.340078+0000","last_became_peered":"2024-09-12T00:52:40.340078+0000","last_unstale":"2024-09-12T01:19:48.584983+0000","last_undegraded":"2024-09-12T01:19:48.584983+0000","last_fullsized":"2024-09-12T01:19:48.584983+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:01.427475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"262'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:37.784418+0000","last_change":"2024-09-12T00:52:37.280400+0000","last_active":"2024-09-12T01:18:37.784418+0000","last_peered":"2024-09-12T01:18:37.784418+0000","last_clean":"2024-09-12T01:18:37.784418+0000","last_became_active":"2024-09-12T00:52:37.277753+0000","last_became_peered":"2024-09-12T00:52:37.277753+0000","last_unstale":"2024-09-12T01:18:37.784418+0000","last_undegraded":"2024-09-12T01:18:37.784418+0000","last_fullsized":"2024-09-12T01:18:37.784418+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:24.031905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"254'7","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.550912+0000","last_change":"2024-09-12T00:51:04.957439+0000","last_active":"2024-09-12T01:18:13.550912+0000","last_peered":"2024-09-12T01:18:13.550912+0000","last_clean":"2024-09-12T01:18:13.550912+0000","last_became_active":"2024-09-12T00:51:04.956754+0000","last_became_peered":"2024-09-12T00:51:04.956754+0000","last_unstale":"2024-09-12T01:18:13.550912+0000","last_undegraded":"2024-09-12T01:18:13.550912+0000","last_fullsized":"2024-09-12T01:18:13.550912+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:38.742856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":30,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:53.568338+0000","last_change":"2024-09-12T01:03:40.586675+0000","last_active":"2024-09-12T01:18:53.568338+0000","last_peered":"2024-09-12T01:18:53.568338+0000","last_clean":"2024-09-12T01:18:53.568338+0000","last_became_active":"2024-09-12T01:03:40.583308+0000","last_became_peered":"2024-09-12T01:03:40.583308+0000","last_unstale":"2024-09-12T01:18:53.568338+0000","last_undegraded":"2024-09-12T01:18:53.568338+0000","last_fullsized":"2024-09-12T01:18:53.568338+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:58.594413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:48.559222+0000","last_change":"2024-09-12T00:52:40.333654+0000","last_active":"2024-09-12T01:18:48.559222+0000","last_peered":"2024-09-12T01:18:48.559222+0000","last_clean":"2024-09-12T01:18:48.559222+0000","last_became_active":"2024-09-12T00:52:40.332913+0000","last_became_peered":"2024-09-12T00:52:40.332913+0000","last_unstale":"2024-09-12T01:18:48.559222+0000","last_undegraded":"2024-09-12T01:18:48.559222+0000","last_fullsized":"2024-09-12T01:18:48.559222+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:55.862557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":9,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"265'2","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:42.800018+0000","last_change":"2024-09-12T00:52:37.287265+0000","last_active":"2024-09-12T01:19:42.800018+0000","last_peered":"2024-09-12T01:19:42.800018+0000","last_clean":"2024-09-12T01:19:42.800018+0000","last_became_active":"2024-09-12T00:52:37.282758+0000","last_became_peered":"2024-09-12T00:52:37.282758+0000","last_unstale":"2024-09-12T01:19:42.800018+0000","last_undegraded":"2024-09-12T01:19:42.800018+0000","last_fullsized":"2024-09-12T01:19:42.800018+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:54.106634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'71","reported_seq":244,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:12.738155+0000","last_change":"2024-09-12T00:51:04.983438+0000","last_active":"2024-09-12T01:18:12.738155+0000","last_peered":"2024-09-12T01:18:12.738155+0000","last_clean":"2024-09-12T01:18:12.738155+0000","last_became_active":"2024-09-12T00:51:04.982747+0000","last_became_peered":"2024-09-12T00:51:04.982747+0000","last_unstale":"2024-09-12T01:18:12.738155+0000","last_undegraded":"2024-09-12T01:18:12.738155+0000","last_fullsized":"2024-09-12T01:18:12.738155+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:57.630612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":369,"num_read_kb":267,"num_write":124,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.559537+0000","last_change":"2024-09-12T01:03:40.573794+0000","last_active":"2024-09-12T01:18:18.559537+0000","last_peered":"2024-09-12T01:18:18.559537+0000","last_clean":"2024-09-12T01:18:18.559537+0000","last_became_active":"2024-09-12T01:03:40.571968+0000","last_became_peered":"2024-09-12T01:03:40.571968+0000","last_unstale":"2024-09-12T01:18:18.559537+0000","last_undegraded":"2024-09-12T01:18:18.559537+0000","last_fullsized":"2024-09-12T01:18:18.559537+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:38.415524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'6","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:47.565437+0000","last_change":"2024-09-12T00:52:40.360097+0000","last_active":"2024-09-12T01:19:47.565437+0000","last_peered":"2024-09-12T01:19:47.565437+0000","last_clean":"2024-09-12T01:19:47.565437+0000","last_became_active":"2024-09-12T00:52:40.359434+0000","last_became_peered":"2024-09-12T00:52:40.359434+0000","last_unstale":"2024-09-12T01:19:47.565437+0000","last_undegraded":"2024-09-12T01:19:47.565437+0000","last_fullsized":"2024-09-12T01:19:47.565437+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:26.806456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":11,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'4","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.583853+0000","last_change":"2024-09-12T00:52:37.292083+0000","last_active":"2024-09-12T01:19:43.583853+0000","last_peered":"2024-09-12T01:19:43.583853+0000","last_clean":"2024-09-12T01:19:43.583853+0000","last_became_active":"2024-09-12T00:52:37.291369+0000","last_became_peered":"2024-09-12T00:52:37.291369+0000","last_unstale":"2024-09-12T01:19:43.583853+0000","last_undegraded":"2024-09-12T01:19:43.583853+0000","last_fullsized":"2024-09-12T01:19:43.583853+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:43.999305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":9,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'35","reported_seq":136,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:12.545173+0000","last_change":"2024-09-12T00:51:04.990882+0000","last_active":"2024-09-12T01:18:12.545173+0000","last_peered":"2024-09-12T01:18:12.545173+0000","last_clean":"2024-09-12T01:18:12.545173+0000","last_became_active":"2024-09-12T00:51:04.990179+0000","last_became_peered":"2024-09-12T00:51:04.990179+0000","last_unstale":"2024-09-12T01:18:12.545173+0000","last_undegraded":"2024-09-12T01:18:12.545173+0000","last_fullsized":"2024-09-12T01:18:12.545173+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:33.185513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":108,"num_write":67,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.779809+0000","last_change":"2024-09-12T01:03:40.574488+0000","last_active":"2024-09-12T01:18:17.779809+0000","last_peered":"2024-09-12T01:18:17.779809+0000","last_clean":"2024-09-12T01:18:17.779809+0000","last_became_active":"2024-09-12T01:03:40.573928+0000","last_became_peered":"2024-09-12T01:03:40.573928+0000","last_unstale":"2024-09-12T01:18:17.779809+0000","last_undegraded":"2024-09-12T01:18:17.779809+0000","last_fullsized":"2024-09-12T01:18:17.779809+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:15.934749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:47.559411+0000","last_change":"2024-09-12T00:52:40.349488+0000","last_active":"2024-09-12T01:19:47.559411+0000","last_peered":"2024-09-12T01:19:47.559411+0000","last_clean":"2024-09-12T01:19:47.559411+0000","last_became_active":"2024-09-12T00:52:40.348494+0000","last_became_peered":"2024-09-12T00:52:40.348494+0000","last_unstale":"2024-09-12T01:19:47.559411+0000","last_undegraded":"2024-09-12T01:19:47.559411+0000","last_fullsized":"2024-09-12T01:19:47.559411+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:17.271665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'2","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:42.564451+0000","last_change":"2024-09-12T00:52:37.279058+0000","last_active":"2024-09-12T01:19:42.564451+0000","last_peered":"2024-09-12T01:19:42.564451+0000","last_clean":"2024-09-12T01:19:42.564451+0000","last_became_active":"2024-09-12T00:52:37.278285+0000","last_became_peered":"2024-09-12T00:52:37.278285+0000","last_unstale":"2024-09-12T01:19:42.564451+0000","last_undegraded":"2024-09-12T01:19:42.564451+0000","last_fullsized":"2024-09-12T01:19:42.564451+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:15.749368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'29","reported_seq":125,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.791752+0000","last_change":"2024-09-12T00:51:04.986057+0000","last_active":"2024-09-12T01:19:07.791752+0000","last_peered":"2024-09-12T01:19:07.791752+0000","last_clean":"2024-09-12T01:19:07.791752+0000","last_became_active":"2024-09-12T00:51:04.984999+0000","last_became_peered":"2024-09-12T00:51:04.984999+0000","last_unstale":"2024-09-12T01:19:07.791752+0000","last_undegraded":"2024-09-12T01:19:07.791752+0000","last_fullsized":"2024-09-12T01:19:07.791752+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:46.905997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":53,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'264","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:17.558005+0000","last_change":"2024-09-12T00:35:43.948445+0000","last_active":"2024-09-12T01:21:17.558005+0000","last_peered":"2024-09-12T01:21:17.558005+0000","last_clean":"2024-09-12T01:21:17.558005+0000","last_became_active":"2024-09-12T00:35:43.947816+0000","last_became_peered":"2024-09-12T00:35:43.947816+0000","last_unstale":"2024-09-12T01:21:17.558005+0000","last_undegraded":"2024-09-12T01:21:17.558005+0000","last_fullsized":"2024-09-12T01:21:17.558005+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:16.574434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16001660,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":466,"num_read_kb":33235,"num_write":1011,"num_write_kb":21608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'253","reported_seq":876,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:14.250255+0000","last_change":"2024-09-12T00:35:45.926951+0000","last_active":"2024-09-12T01:19:14.250255+0000","last_peered":"2024-09-12T01:19:14.250255+0000","last_clean":"2024-09-12T01:19:14.250255+0000","last_became_active":"2024-09-12T00:35:45.925856+0000","last_became_peered":"2024-09-12T00:35:45.925856+0000","last_unstale":"2024-09-12T01:19:14.250255+0000","last_undegraded":"2024-09-12T01:19:14.250255+0000","last_fullsized":"2024-09-12T01:19:14.250255+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:07.944413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1075,"num_read_kb":882,"num_write":373,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'306","reported_seq":970,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:28.580436+0000","last_change":"2024-09-12T00:35:43.933369+0000","last_active":"2024-09-12T01:19:28.580436+0000","last_peered":"2024-09-12T01:19:28.580436+0000","last_clean":"2024-09-12T01:19:28.580436+0000","last_became_active":"2024-09-12T00:35:43.933088+0000","last_became_peered":"2024-09-12T00:35:43.933088+0000","last_unstale":"2024-09-12T01:19:28.580436+0000","last_undegraded":"2024-09-12T01:19:28.580436+0000","last_fullsized":"2024-09-12T01:19:28.580436+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:49.773500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6964226,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":498,"num_read_kb":47488,"num_write":1147,"num_write_kb":29880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'45","reported_seq":579,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:03.587115+0000","last_change":"2024-09-12T00:35:45.947951+0000","last_active":"2024-09-12T01:19:03.587115+0000","last_peered":"2024-09-12T01:19:03.587115+0000","last_clean":"2024-09-12T01:19:03.587115+0000","last_became_active":"2024-09-12T00:35:45.947212+0000","last_became_peered":"2024-09-12T00:35:45.947212+0000","last_unstale":"2024-09-12T01:19:03.587115+0000","last_undegraded":"2024-09-12T01:19:03.587115+0000","last_fullsized":"2024-09-12T01:19:03.587115+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:09.409072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":168,"num_write":71,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'267","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:41.658852+0000","last_change":"2024-09-12T00:35:43.927529+0000","last_active":"2024-09-12T01:19:41.658852+0000","last_peered":"2024-09-12T01:19:41.658852+0000","last_clean":"2024-09-12T01:19:41.658852+0000","last_became_active":"2024-09-12T00:35:43.926443+0000","last_became_peered":"2024-09-12T00:35:43.926443+0000","last_unstale":"2024-09-12T01:19:41.658852+0000","last_undegraded":"2024-09-12T01:19:41.658852+0000","last_fullsized":"2024-09-12T01:19:41.658852+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:06.887907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32795823,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":493,"num_read_kb":98039,"num_write":1033,"num_write_kb":58371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'116","reported_seq":729,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.447686+0000","last_change":"2024-09-12T00:35:45.932367+0000","last_active":"2024-09-12T01:19:43.447686+0000","last_peered":"2024-09-12T01:19:43.447686+0000","last_clean":"2024-09-12T01:19:43.447686+0000","last_became_active":"2024-09-12T00:35:45.930987+0000","last_became_peered":"2024-09-12T00:35:45.930987+0000","last_unstale":"2024-09-12T01:19:43.447686+0000","last_undegraded":"2024-09-12T01:19:43.447686+0000","last_fullsized":"2024-09-12T01:19:43.447686+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:08.829843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":522,"num_read_kb":443,"num_write":187,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'316","reported_seq":987,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:07.203708+0000","last_change":"2024-09-12T00:35:43.920497+0000","last_active":"2024-09-12T01:20:07.203708+0000","last_peered":"2024-09-12T01:20:07.203708+0000","last_clean":"2024-09-12T01:20:07.203708+0000","last_became_active":"2024-09-12T00:35:43.914356+0000","last_became_peered":"2024-09-12T00:35:43.914356+0000","last_unstale":"2024-09-12T01:20:07.203708+0000","last_undegraded":"2024-09-12T01:20:07.203708+0000","last_fullsized":"2024-09-12T01:20:07.203708+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:16.053246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27394430,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":532,"num_read_kb":17763,"num_write":1139,"num_write_kb":54335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'197","reported_seq":794,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:40.733551+0000","last_change":"2024-09-12T00:35:45.943011+0000","last_active":"2024-09-12T01:19:40.733551+0000","last_peered":"2024-09-12T01:19:40.733551+0000","last_clean":"2024-09-12T01:19:40.733551+0000","last_became_active":"2024-09-12T00:35:45.942567+0000","last_became_peered":"2024-09-12T00:35:45.942567+0000","last_unstale":"2024-09-12T01:19:40.733551+0000","last_undegraded":"2024-09-12T01:19:40.733551+0000","last_fullsized":"2024-09-12T01:19:40.733551+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:28.500033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":861,"num_read_kb":699,"num_write":314,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'287","reported_seq":944,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:02.751215+0000","last_change":"2024-09-12T00:35:43.945400+0000","last_active":"2024-09-12T01:20:02.751215+0000","last_peered":"2024-09-12T01:20:02.751215+0000","last_clean":"2024-09-12T01:20:02.751215+0000","last_became_active":"2024-09-12T00:35:43.944644+0000","last_became_peered":"2024-09-12T00:35:43.944644+0000","last_unstale":"2024-09-12T01:20:02.751215+0000","last_undegraded":"2024-09-12T01:20:02.751215+0000","last_fullsized":"2024-09-12T01:20:02.751215+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:50.172251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5948766,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":533,"num_read_kb":29244,"num_write":1118,"num_write_kb":25136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'341","reported_seq":1074,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.242539+0000","last_change":"2024-09-12T00:35:45.943860+0000","last_active":"2024-09-12T01:20:22.242539+0000","last_peered":"2024-09-12T01:20:22.242539+0000","last_clean":"2024-09-12T01:20:22.242539+0000","last_became_active":"2024-09-12T00:35:45.943110+0000","last_became_peered":"2024-09-12T00:35:45.943110+0000","last_unstale":"2024-09-12T01:20:22.242539+0000","last_undegraded":"2024-09-12T01:20:22.242539+0000","last_fullsized":"2024-09-12T01:20:22.242539+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:24.346213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1719,"num_read_kb":1451,"num_write":623,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'279","reported_seq":889,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:19.048741+0000","last_change":"2024-09-12T00:35:43.930576+0000","last_active":"2024-09-12T01:20:19.048741+0000","last_peered":"2024-09-12T01:20:19.048741+0000","last_clean":"2024-09-12T01:20:19.048741+0000","last_became_active":"2024-09-12T00:35:43.929553+0000","last_became_peered":"2024-09-12T00:35:43.929553+0000","last_unstale":"2024-09-12T01:20:19.048741+0000","last_undegraded":"2024-09-12T01:20:19.048741+0000","last_fullsized":"2024-09-12T01:20:19.048741+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:22.833352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13268268,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":399,"num_read_kb":14436,"num_write":1071,"num_write_kb":49786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'350","reported_seq":931,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:00.371052+0000","last_change":"2024-09-12T00:35:45.934966+0000","last_active":"2024-09-12T01:20:00.371052+0000","last_peered":"2024-09-12T01:20:00.371052+0000","last_clean":"2024-09-12T01:20:00.371052+0000","last_became_active":"2024-09-12T00:35:45.934193+0000","last_became_peered":"2024-09-12T00:35:45.934193+0000","last_unstale":"2024-09-12T01:20:00.371052+0000","last_undegraded":"2024-09-12T01:20:00.371052+0000","last_fullsized":"2024-09-12T01:20:00.371052+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:43.914081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1452,"num_read_kb":1165,"num_write":550,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'321","reported_seq":1002,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.244554+0000","last_change":"2024-09-12T00:35:43.942971+0000","last_active":"2024-09-12T01:19:18.244554+0000","last_peered":"2024-09-12T01:19:18.244554+0000","last_clean":"2024-09-12T01:19:18.244554+0000","last_became_active":"2024-09-12T00:35:43.942199+0000","last_became_peered":"2024-09-12T00:35:43.942199+0000","last_unstale":"2024-09-12T01:19:18.244554+0000","last_undegraded":"2024-09-12T01:19:18.244554+0000","last_fullsized":"2024-09-12T01:19:18.244554+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:07.698617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5300840,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":579,"num_read_kb":42927,"num_write":1138,"num_write_kb":42524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'254","reported_seq":917,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:33.569572+0000","last_change":"2024-09-12T00:35:45.938322+0000","last_active":"2024-09-12T01:19:33.569572+0000","last_peered":"2024-09-12T01:19:33.569572+0000","last_clean":"2024-09-12T01:19:33.569572+0000","last_became_active":"2024-09-12T00:35:45.937211+0000","last_became_peered":"2024-09-12T00:35:45.937211+0000","last_unstale":"2024-09-12T01:19:33.569572+0000","last_undegraded":"2024-09-12T01:19:33.569572+0000","last_fullsized":"2024-09-12T01:19:33.569572+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:08.919655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1131,"num_read_kb":929,"num_write":387,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'291","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:40.114404+0000","last_change":"2024-09-12T00:35:43.920009+0000","last_active":"2024-09-12T01:19:40.114404+0000","last_peered":"2024-09-12T01:19:40.114404+0000","last_clean":"2024-09-12T01:19:40.114404+0000","last_became_active":"2024-09-12T00:35:43.918653+0000","last_became_peered":"2024-09-12T00:35:43.918653+0000","last_unstale":"2024-09-12T01:19:40.114404+0000","last_undegraded":"2024-09-12T01:19:40.114404+0000","last_fullsized":"2024-09-12T01:19:40.114404+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:08.630692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5754362,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":575,"num_read_kb":7519,"num_write":1173,"num_write_kb":32586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'269","reported_seq":929,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:51.427937+0000","last_change":"2024-09-12T00:35:45.942221+0000","last_active":"2024-09-12T01:19:51.427937+0000","last_peered":"2024-09-12T01:19:51.427937+0000","last_clean":"2024-09-12T01:19:51.427937+0000","last_became_active":"2024-09-12T00:35:45.941814+0000","last_became_peered":"2024-09-12T00:35:45.941814+0000","last_unstale":"2024-09-12T01:19:51.427937+0000","last_undegraded":"2024-09-12T01:19:51.427937+0000","last_fullsized":"2024-09-12T01:19:51.427937+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:48.303334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1198,"num_read_kb":983,"num_write":434,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'104","reported_seq":678,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:36.090439+0000","last_change":"2024-09-12T00:35:45.930414+0000","last_active":"2024-09-12T01:19:36.090439+0000","last_peered":"2024-09-12T01:19:36.090439+0000","last_clean":"2024-09-12T01:19:36.090439+0000","last_became_active":"2024-09-12T00:35:45.929168+0000","last_became_peered":"2024-09-12T00:35:45.929168+0000","last_unstale":"2024-09-12T01:19:36.090439+0000","last_undegraded":"2024-09-12T01:19:36.090439+0000","last_fullsized":"2024-09-12T01:19:36.090439+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:46.680426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":468,"num_read_kb":393,"num_write":157,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'293","reported_seq":942,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:08.161918+0000","last_change":"2024-09-12T00:35:43.951280+0000","last_active":"2024-09-12T01:20:08.161918+0000","last_peered":"2024-09-12T01:20:08.161918+0000","last_clean":"2024-09-12T01:20:08.161918+0000","last_became_active":"2024-09-12T00:35:43.949857+0000","last_became_peered":"2024-09-12T00:35:43.949857+0000","last_unstale":"2024-09-12T01:20:08.161918+0000","last_undegraded":"2024-09-12T01:20:08.161918+0000","last_fullsized":"2024-09-12T01:20:08.161918+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:10.127383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":776690,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":464,"num_read_kb":3397,"num_write":1037,"num_write_kb":43442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'111","reported_seq":684,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:47.772837+0000","last_change":"2024-09-12T00:35:45.948146+0000","last_active":"2024-09-12T01:17:47.772837+0000","last_peered":"2024-09-12T01:17:47.772837+0000","last_clean":"2024-09-12T01:17:47.772837+0000","last_became_active":"2024-09-12T00:35:45.947366+0000","last_became_peered":"2024-09-12T00:35:45.947366+0000","last_unstale":"2024-09-12T01:17:47.772837+0000","last_undegraded":"2024-09-12T01:17:47.772837+0000","last_fullsized":"2024-09-12T01:17:47.772837+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:11.387874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":482,"num_read_kb":394,"num_write":173,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'304","reported_seq":979,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:15.313213+0000","last_change":"2024-09-12T00:35:43.926785+0000","last_active":"2024-09-12T01:21:15.313213+0000","last_peered":"2024-09-12T01:21:15.313213+0000","last_clean":"2024-09-12T01:21:15.313213+0000","last_became_active":"2024-09-12T00:35:43.926027+0000","last_became_peered":"2024-09-12T00:35:43.926027+0000","last_unstale":"2024-09-12T01:21:15.313213+0000","last_undegraded":"2024-09-12T01:21:15.313213+0000","last_fullsized":"2024-09-12T01:21:15.313213+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:47.685516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25217565,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":514,"num_read_kb":69210,"num_write":1206,"num_write_kb":64702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'169","reported_seq":777,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:58.547349+0000","last_change":"2024-09-12T00:35:45.933189+0000","last_active":"2024-09-12T01:17:58.547349+0000","last_peered":"2024-09-12T01:17:58.547349+0000","last_clean":"2024-09-12T01:17:58.547349+0000","last_became_active":"2024-09-12T00:35:45.932116+0000","last_became_peered":"2024-09-12T00:35:45.932116+0000","last_unstale":"2024-09-12T01:17:58.547349+0000","last_undegraded":"2024-09-12T01:17:58.547349+0000","last_fullsized":"2024-09-12T01:17:58.547349+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:10.046459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":828,"num_read_kb":701,"num_write":304,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'285","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:55.938770+0000","last_change":"2024-09-12T00:36:17.046117+0000","last_active":"2024-09-12T01:19:55.938770+0000","last_peered":"2024-09-12T01:19:55.938770+0000","last_clean":"2024-09-12T01:19:55.938770+0000","last_became_active":"2024-09-12T00:36:17.045217+0000","last_became_peered":"2024-09-12T00:36:17.045217+0000","last_unstale":"2024-09-12T01:19:55.938770+0000","last_undegraded":"2024-09-12T01:19:55.938770+0000","last_fullsized":"2024-09-12T01:19:55.938770+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:17.813892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9103285,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":519,"num_read_kb":9909,"num_write":1014,"num_write_kb":33583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'99","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:56.473406+0000","last_change":"2024-09-12T00:35:45.939622+0000","last_active":"2024-09-12T01:19:56.473406+0000","last_peered":"2024-09-12T01:19:56.473406+0000","last_clean":"2024-09-12T01:19:56.473406+0000","last_became_active":"2024-09-12T00:35:45.939261+0000","last_became_peered":"2024-09-12T00:35:45.939261+0000","last_unstale":"2024-09-12T01:19:56.473406+0000","last_undegraded":"2024-09-12T01:19:56.473406+0000","last_fullsized":"2024-09-12T01:19:56.473406+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:47.746126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":439,"num_read_kb":359,"num_write":158,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'283","reported_seq":923,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:19.799488+0000","last_change":"2024-09-12T00:35:43.949757+0000","last_active":"2024-09-12T01:21:19.799488+0000","last_peered":"2024-09-12T01:21:19.799488+0000","last_clean":"2024-09-12T01:21:19.799488+0000","last_became_active":"2024-09-12T00:35:43.949045+0000","last_became_peered":"2024-09-12T00:35:43.949045+0000","last_unstale":"2024-09-12T01:21:19.799488+0000","last_undegraded":"2024-09-12T01:21:19.799488+0000","last_fullsized":"2024-09-12T01:21:19.799488+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:36.497824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11862755,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":498,"num_read_kb":18745,"num_write":980,"num_write_kb":46080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'126","reported_seq":725,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:46.094592+0000","last_change":"2024-09-12T00:35:45.943288+0000","last_active":"2024-09-12T01:19:46.094592+0000","last_peered":"2024-09-12T01:19:46.094592+0000","last_clean":"2024-09-12T01:19:46.094592+0000","last_became_active":"2024-09-12T00:35:45.942814+0000","last_became_peered":"2024-09-12T00:35:45.942814+0000","last_unstale":"2024-09-12T01:19:46.094592+0000","last_undegraded":"2024-09-12T01:19:46.094592+0000","last_fullsized":"2024-09-12T01:19:46.094592+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:06.467847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":574,"num_read_kb":483,"num_write":214,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'261","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:13.593117+0000","last_change":"2024-09-12T00:35:43.939756+0000","last_active":"2024-09-12T01:19:13.593117+0000","last_peered":"2024-09-12T01:19:13.593117+0000","last_clean":"2024-09-12T01:19:13.593117+0000","last_became_active":"2024-09-12T00:35:43.939128+0000","last_became_peered":"2024-09-12T00:35:43.939128+0000","last_unstale":"2024-09-12T01:19:13.593117+0000","last_undegraded":"2024-09-12T01:19:13.593117+0000","last_fullsized":"2024-09-12T01:19:13.593117+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:36.964204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":733,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":395,"num_read_kb":9693,"num_write":1003,"num_write_kb":13466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'4124","reported_seq":4720,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:01.277760+0000","last_change":"2024-09-12T00:35:45.944333+0000","last_active":"2024-09-12T01:20:01.277760+0000","last_peered":"2024-09-12T01:20:01.277760+0000","last_clean":"2024-09-12T01:20:01.277760+0000","last_became_active":"2024-09-12T00:35:45.943253+0000","last_became_peered":"2024-09-12T00:35:45.943253+0000","last_unstale":"2024-09-12T01:20:01.277760+0000","last_undegraded":"2024-09-12T01:20:01.277760+0000","last_fullsized":"2024-09-12T01:20:01.277760+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:04.022329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16581,"num_read_kb":13903,"num_write":6185,"num_write_kb":3084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'285","reported_seq":946,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:20.381299+0000","last_change":"2024-09-12T00:35:43.933614+0000","last_active":"2024-09-12T01:19:20.381299+0000","last_peered":"2024-09-12T01:19:20.381299+0000","last_clean":"2024-09-12T01:19:20.381299+0000","last_became_active":"2024-09-12T00:35:43.933191+0000","last_became_peered":"2024-09-12T00:35:43.933191+0000","last_unstale":"2024-09-12T01:19:20.381299+0000","last_undegraded":"2024-09-12T01:19:20.381299+0000","last_fullsized":"2024-09-12T01:19:20.381299+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:15.373281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11972819,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":480,"num_read_kb":44643,"num_write":943,"num_write_kb":28437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'146","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.077594+0000","last_change":"2024-09-12T00:35:53.985466+0000","last_active":"2024-09-12T01:20:23.077594+0000","last_peered":"2024-09-12T01:20:23.077594+0000","last_clean":"2024-09-12T01:20:23.077594+0000","last_became_active":"2024-09-12T00:35:53.981609+0000","last_became_peered":"2024-09-12T00:35:53.981609+0000","last_unstale":"2024-09-12T01:20:23.077594+0000","last_undegraded":"2024-09-12T01:20:23.077594+0000","last_fullsized":"2024-09-12T01:20:23.077594+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:05.745536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":187,"num_read_kb":176,"num_write":375,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'258","reported_seq":901,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:50.602115+0000","last_change":"2024-09-12T00:35:45.948978+0000","last_active":"2024-09-12T01:18:50.602115+0000","last_peered":"2024-09-12T01:18:50.602115+0000","last_clean":"2024-09-12T01:18:50.602115+0000","last_became_active":"2024-09-12T00:35:45.948575+0000","last_became_peered":"2024-09-12T00:35:45.948575+0000","last_unstale":"2024-09-12T01:18:50.602115+0000","last_undegraded":"2024-09-12T01:18:50.602115+0000","last_fullsized":"2024-09-12T01:18:50.602115+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:55.123044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1199,"num_read_kb":1005,"num_write":430,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"265'235","reported_seq":832,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:13.107142+0000","last_change":"2024-09-12T00:35:43.957625+0000","last_active":"2024-09-12T01:19:13.107142+0000","last_peered":"2024-09-12T01:19:13.107142+0000","last_clean":"2024-09-12T01:19:13.107142+0000","last_became_active":"2024-09-12T00:35:43.956812+0000","last_became_peered":"2024-09-12T00:35:43.956812+0000","last_unstale":"2024-09-12T01:19:13.107142+0000","last_undegraded":"2024-09-12T01:19:13.107142+0000","last_fullsized":"2024-09-12T01:19:13.107142+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:33.110636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5307858,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":362,"num_read_kb":399,"num_write":907,"num_write_kb":26614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.566225+0000","last_change":"2024-09-12T00:35:47.933988+0000","last_active":"2024-09-12T01:19:18.566225+0000","last_peered":"2024-09-12T01:19:18.566225+0000","last_clean":"2024-09-12T01:19:18.566225+0000","last_became_active":"2024-09-12T00:35:47.933249+0000","last_became_peered":"2024-09-12T00:35:47.933249+0000","last_unstale":"2024-09-12T01:19:18.566225+0000","last_undegraded":"2024-09-12T01:19:18.566225+0000","last_fullsized":"2024-09-12T01:19:18.566225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:47.085642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'334","reported_seq":937,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.323038+0000","last_change":"2024-09-12T00:35:49.952443+0000","last_active":"2024-09-12T01:21:25.323038+0000","last_peered":"2024-09-12T01:21:25.323038+0000","last_clean":"2024-09-12T01:21:25.323038+0000","last_became_active":"2024-09-12T00:35:49.951438+0000","last_became_peered":"2024-09-12T00:35:49.951438+0000","last_unstale":"2024-09-12T01:21:25.323038+0000","last_undegraded":"2024-09-12T01:21:25.323038+0000","last_fullsized":"2024-09-12T01:21:25.323038+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:58.543209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53999,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":541,"num_read_kb":1025,"num_write":432,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:22.795536+0000","last_change":"2024-09-12T00:35:51.984956+0000","last_active":"2024-09-12T01:19:22.795536+0000","last_peered":"2024-09-12T01:19:22.795536+0000","last_clean":"2024-09-12T01:19:22.795536+0000","last_became_active":"2024-09-12T00:35:51.984350+0000","last_became_peered":"2024-09-12T00:35:51.984350+0000","last_unstale":"2024-09-12T01:19:22.795536+0000","last_undegraded":"2024-09-12T01:19:22.795536+0000","last_fullsized":"2024-09-12T01:19:22.795536+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:25.562363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'203","reported_seq":801,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:17.805609+0000","last_change":"2024-09-12T00:35:53.998522+0000","last_active":"2024-09-12T01:20:17.805609+0000","last_peered":"2024-09-12T01:20:17.805609+0000","last_clean":"2024-09-12T01:20:17.805609+0000","last_became_active":"2024-09-12T00:35:53.995513+0000","last_became_peered":"2024-09-12T00:35:53.995513+0000","last_unstale":"2024-09-12T01:20:17.805609+0000","last_undegraded":"2024-09-12T01:20:17.805609+0000","last_fullsized":"2024-09-12T01:20:17.805609+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:28.256858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":409,"num_read_kb":360,"num_write":396,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'241","reported_seq":868,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:07.808738+0000","last_change":"2024-09-12T00:35:45.940693+0000","last_active":"2024-09-12T01:20:07.808738+0000","last_peered":"2024-09-12T01:20:07.808738+0000","last_clean":"2024-09-12T01:20:07.808738+0000","last_became_active":"2024-09-12T00:35:45.939962+0000","last_became_peered":"2024-09-12T00:35:45.939962+0000","last_unstale":"2024-09-12T01:20:07.808738+0000","last_undegraded":"2024-09-12T01:20:07.808738+0000","last_fullsized":"2024-09-12T01:20:07.808738+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:44.308762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1036,"num_read_kb":844,"num_write":371,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'309","reported_seq":1013,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:04.618210+0000","last_change":"2024-09-12T00:35:43.945052+0000","last_active":"2024-09-12T01:20:04.618210+0000","last_peered":"2024-09-12T01:20:04.618210+0000","last_clean":"2024-09-12T01:20:04.618210+0000","last_became_active":"2024-09-12T00:35:43.944705+0000","last_became_peered":"2024-09-12T00:35:43.944705+0000","last_unstale":"2024-09-12T01:20:04.618210+0000","last_undegraded":"2024-09-12T01:20:04.618210+0000","last_fullsized":"2024-09-12T01:20:04.618210+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:40.455249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1368592,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":733,"num_read_kb":8209,"num_write":1125,"num_write_kb":28685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:58.575009+0000","last_change":"2024-09-12T00:35:47.946592+0000","last_active":"2024-09-12T01:17:58.575009+0000","last_peered":"2024-09-12T01:17:58.575009+0000","last_clean":"2024-09-12T01:17:58.575009+0000","last_became_active":"2024-09-12T00:35:47.945971+0000","last_became_peered":"2024-09-12T00:35:47.945971+0000","last_unstale":"2024-09-12T01:17:58.575009+0000","last_undegraded":"2024-09-12T01:17:58.575009+0000","last_fullsized":"2024-09-12T01:17:58.575009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:39.808186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'93","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:22.553249+0000","last_change":"2024-09-12T00:35:49.939105+0000","last_active":"2024-09-12T01:19:22.553249+0000","last_peered":"2024-09-12T01:19:22.553249+0000","last_clean":"2024-09-12T01:19:22.553249+0000","last_became_active":"2024-09-12T00:35:49.938374+0000","last_became_peered":"2024-09-12T00:35:49.938374+0000","last_unstale":"2024-09-12T01:19:22.553249+0000","last_undegraded":"2024-09-12T01:19:22.553249+0000","last_fullsized":"2024-09-12T01:19:22.553249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:28.914067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:22.553202+0000","last_change":"2024-09-12T00:35:51.975432+0000","last_active":"2024-09-12T01:19:22.553202+0000","last_peered":"2024-09-12T01:19:22.553202+0000","last_clean":"2024-09-12T01:19:22.553202+0000","last_became_active":"2024-09-12T00:35:51.974659+0000","last_became_peered":"2024-09-12T00:35:51.974659+0000","last_unstale":"2024-09-12T01:19:22.553202+0000","last_undegraded":"2024-09-12T01:19:22.553202+0000","last_fullsized":"2024-09-12T01:19:22.553202+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:42.719938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'114","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:44.542108+0000","last_change":"2024-09-12T00:35:53.994008+0000","last_active":"2024-09-12T01:19:44.542108+0000","last_peered":"2024-09-12T01:19:44.542108+0000","last_clean":"2024-09-12T01:19:44.542108+0000","last_became_active":"2024-09-12T00:35:53.992311+0000","last_became_peered":"2024-09-12T00:35:53.992311+0000","last_unstale":"2024-09-12T01:19:44.542108+0000","last_undegraded":"2024-09-12T01:19:44.542108+0000","last_fullsized":"2024-09-12T01:19:44.542108+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:28.357194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":265,"num_read_kb":226,"num_write":268,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'268","reported_seq":913,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.574373+0000","last_change":"2024-09-12T00:35:45.941958+0000","last_active":"2024-09-12T01:19:18.574373+0000","last_peered":"2024-09-12T01:19:18.574373+0000","last_clean":"2024-09-12T01:19:18.574373+0000","last_became_active":"2024-09-12T00:35:45.941543+0000","last_became_peered":"2024-09-12T00:35:45.941543+0000","last_unstale":"2024-09-12T01:19:18.574373+0000","last_undegraded":"2024-09-12T01:19:18.574373+0000","last_fullsized":"2024-09-12T01:19:18.574373+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:08.224075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1165,"num_read_kb":955,"num_write":416,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'323","reported_seq":1037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:50.556899+0000","last_change":"2024-09-12T00:35:43.953442+0000","last_active":"2024-09-12T01:18:50.556899+0000","last_peered":"2024-09-12T01:18:50.556899+0000","last_clean":"2024-09-12T01:18:50.556899+0000","last_became_active":"2024-09-12T00:35:43.952543+0000","last_became_peered":"2024-09-12T00:35:43.952543+0000","last_unstale":"2024-09-12T01:18:50.556899+0000","last_undegraded":"2024-09-12T01:18:50.556899+0000","last_fullsized":"2024-09-12T01:18:50.556899+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:44.952950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5506879,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":707,"num_read_kb":774,"num_write":1156,"num_write_kb":19641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.594613+0000","last_change":"2024-09-12T00:35:47.934527+0000","last_active":"2024-09-12T01:19:18.594613+0000","last_peered":"2024-09-12T01:19:18.594613+0000","last_clean":"2024-09-12T01:19:18.594613+0000","last_became_active":"2024-09-12T00:35:47.933896+0000","last_became_peered":"2024-09-12T00:35:47.933896+0000","last_unstale":"2024-09-12T01:19:18.594613+0000","last_undegraded":"2024-09-12T01:19:18.594613+0000","last_fullsized":"2024-09-12T01:19:18.594613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:11.718346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'113","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.483543+0000","last_change":"2024-09-12T00:35:49.937626+0000","last_active":"2024-09-12T01:18:23.483543+0000","last_peered":"2024-09-12T01:18:23.483543+0000","last_clean":"2024-09-12T01:18:23.483543+0000","last_became_active":"2024-09-12T00:35:49.936846+0000","last_became_peered":"2024-09-12T00:35:49.936846+0000","last_unstale":"2024-09-12T01:18:23.483543+0000","last_undegraded":"2024-09-12T01:18:23.483543+0000","last_fullsized":"2024-09-12T01:18:23.483543+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:16.548831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":139,"num_read_kb":131,"num_write":92,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'768","reported_seq":2283,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.651744+0000","last_change":"2024-09-12T00:35:51.980021+0000","last_active":"2024-09-12T01:21:25.651744+0000","last_peered":"2024-09-12T01:21:25.651744+0000","last_clean":"2024-09-12T01:21:25.651744+0000","last_became_active":"2024-09-12T00:35:51.979288+0000","last_became_peered":"2024-09-12T00:35:51.979288+0000","last_unstale":"2024-09-12T01:21:25.651744+0000","last_undegraded":"2024-09-12T01:21:25.651744+0000","last_fullsized":"2024-09-12T01:21:25.651744+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:56.227079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'188","reported_seq":1012,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.127347+0000","last_change":"2024-09-12T00:35:54.014161+0000","last_active":"2024-09-12T01:20:23.127347+0000","last_peered":"2024-09-12T01:20:23.127347+0000","last_clean":"2024-09-12T01:20:23.127347+0000","last_became_active":"2024-09-12T00:35:54.013299+0000","last_became_peered":"2024-09-12T00:35:54.013299+0000","last_unstale":"2024-09-12T01:20:23.127347+0000","last_undegraded":"2024-09-12T01:20:23.127347+0000","last_fullsized":"2024-09-12T01:20:23.127347+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:35.433076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":837,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":580,"num_read_kb":578,"num_write":407,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'105","reported_seq":677,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.594579+0000","last_change":"2024-09-12T00:35:45.955221+0000","last_active":"2024-09-12T01:19:18.594579+0000","last_peered":"2024-09-12T01:19:18.594579+0000","last_clean":"2024-09-12T01:19:18.594579+0000","last_became_active":"2024-09-12T00:35:45.954858+0000","last_became_peered":"2024-09-12T00:35:45.954858+0000","last_unstale":"2024-09-12T01:19:18.594579+0000","last_undegraded":"2024-09-12T01:19:18.594579+0000","last_fullsized":"2024-09-12T01:19:18.594579+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:35.164506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":470,"num_read_kb":391,"num_write":166,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'282","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:19.046036+0000","last_change":"2024-09-12T00:35:43.931623+0000","last_active":"2024-09-12T01:20:19.046036+0000","last_peered":"2024-09-12T01:20:19.046036+0000","last_clean":"2024-09-12T01:20:19.046036+0000","last_became_active":"2024-09-12T00:35:43.930867+0000","last_became_peered":"2024-09-12T00:35:43.930867+0000","last_unstale":"2024-09-12T01:20:19.046036+0000","last_undegraded":"2024-09-12T01:20:19.046036+0000","last_fullsized":"2024-09-12T01:20:19.046036+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:00.843291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7688273,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":456,"num_read_kb":73816,"num_write":997,"num_write_kb":41341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.566330+0000","last_change":"2024-09-12T00:35:47.931572+0000","last_active":"2024-09-12T01:19:18.566330+0000","last_peered":"2024-09-12T01:19:18.566330+0000","last_clean":"2024-09-12T01:19:18.566330+0000","last_became_active":"2024-09-12T00:35:47.930883+0000","last_became_peered":"2024-09-12T00:35:47.930883+0000","last_unstale":"2024-09-12T01:19:18.566330+0000","last_undegraded":"2024-09-12T01:19:18.566330+0000","last_fullsized":"2024-09-12T01:19:18.566330+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:26.632000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'284","reported_seq":851,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.310753+0000","last_change":"2024-09-12T00:35:50.030382+0000","last_active":"2024-09-12T01:21:25.310753+0000","last_peered":"2024-09-12T01:21:25.310753+0000","last_clean":"2024-09-12T01:21:25.310753+0000","last_became_active":"2024-09-12T00:35:50.029236+0000","last_became_peered":"2024-09-12T00:35:50.029236+0000","last_unstale":"2024-09-12T01:21:25.310753+0000","last_undegraded":"2024-09-12T01:21:25.310753+0000","last_fullsized":"2024-09-12T01:21:25.310753+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:36.054917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71213,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":456,"num_read_kb":975,"num_write":380,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'782","reported_seq":2327,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.389739+0000","last_change":"2024-09-12T00:35:51.983959+0000","last_active":"2024-09-12T01:21:25.389739+0000","last_peered":"2024-09-12T01:21:25.389739+0000","last_clean":"2024-09-12T01:21:25.389739+0000","last_became_active":"2024-09-12T00:35:51.983271+0000","last_became_peered":"2024-09-12T00:35:51.983271+0000","last_unstale":"2024-09-12T01:21:25.389739+0000","last_undegraded":"2024-09-12T01:21:25.389739+0000","last_fullsized":"2024-09-12T01:21:25.389739+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:13.842922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'260","reported_seq":932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.563677+0000","last_change":"2024-09-12T00:35:45.940778+0000","last_active":"2024-09-12T01:19:08.563677+0000","last_peered":"2024-09-12T01:19:08.563677+0000","last_clean":"2024-09-12T01:19:08.563677+0000","last_became_active":"2024-09-12T00:35:45.940073+0000","last_became_peered":"2024-09-12T00:35:45.940073+0000","last_unstale":"2024-09-12T01:19:08.563677+0000","last_undegraded":"2024-09-12T01:19:08.563677+0000","last_fullsized":"2024-09-12T01:19:08.563677+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:47.849352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1192,"num_read_kb":982,"num_write":401,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'283","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:35.089176+0000","last_change":"2024-09-12T00:35:43.957315+0000","last_active":"2024-09-12T01:19:35.089176+0000","last_peered":"2024-09-12T01:19:35.089176+0000","last_clean":"2024-09-12T01:19:35.089176+0000","last_became_active":"2024-09-12T00:35:43.956814+0000","last_became_peered":"2024-09-12T00:35:43.956814+0000","last_unstale":"2024-09-12T01:19:35.089176+0000","last_undegraded":"2024-09-12T01:19:35.089176+0000","last_fullsized":"2024-09-12T01:19:35.089176+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:24.210436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243802,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":698,"num_read_kb":6356,"num_write":927,"num_write_kb":17273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.791834+0000","last_change":"2024-09-12T00:35:47.945726+0000","last_active":"2024-09-12T01:19:07.791834+0000","last_peered":"2024-09-12T01:19:07.791834+0000","last_clean":"2024-09-12T01:19:07.791834+0000","last_became_active":"2024-09-12T00:35:47.944913+0000","last_became_peered":"2024-09-12T00:35:47.944913+0000","last_unstale":"2024-09-12T01:19:07.791834+0000","last_undegraded":"2024-09-12T01:19:07.791834+0000","last_fullsized":"2024-09-12T01:19:07.791834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:02.558771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'343","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.331819+0000","last_change":"2024-09-12T00:35:50.028219+0000","last_active":"2024-09-12T01:21:25.331819+0000","last_peered":"2024-09-12T01:21:25.331819+0000","last_clean":"2024-09-12T01:21:25.331819+0000","last_became_active":"2024-09-12T00:35:50.027282+0000","last_became_peered":"2024-09-12T00:35:50.027282+0000","last_unstale":"2024-09-12T01:21:25.331819+0000","last_undegraded":"2024-09-12T01:21:25.331819+0000","last_fullsized":"2024-09-12T01:21:25.331819+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:27.196205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53438,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":550,"num_read_kb":1012,"num_write":434,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.569449+0000","last_change":"2024-09-12T00:35:51.972158+0000","last_active":"2024-09-12T01:18:38.569449+0000","last_peered":"2024-09-12T01:18:38.569449+0000","last_clean":"2024-09-12T01:18:38.569449+0000","last_became_active":"2024-09-12T00:35:51.971491+0000","last_became_peered":"2024-09-12T00:35:51.971491+0000","last_unstale":"2024-09-12T01:18:38.569449+0000","last_undegraded":"2024-09-12T01:18:38.569449+0000","last_fullsized":"2024-09-12T01:18:38.569449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:22.911772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'555","reported_seq":1370,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.367346+0000","last_change":"2024-09-12T00:35:54.000046+0000","last_active":"2024-09-12T01:21:25.367346+0000","last_peered":"2024-09-12T01:21:25.367346+0000","last_clean":"2024-09-12T01:21:25.367346+0000","last_became_active":"2024-09-12T00:35:53.996514+0000","last_became_peered":"2024-09-12T00:35:53.996514+0000","last_unstale":"2024-09-12T01:21:25.367346+0000","last_undegraded":"2024-09-12T01:21:25.367346+0000","last_fullsized":"2024-09-12T01:21:25.367346+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:55.200677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1307,"num_read_kb":1296,"num_write":1166,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'136","reported_seq":740,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.750429+0000","last_change":"2024-09-12T00:35:45.943831+0000","last_active":"2024-09-12T01:19:07.750429+0000","last_peered":"2024-09-12T01:19:07.750429+0000","last_clean":"2024-09-12T01:19:07.750429+0000","last_became_active":"2024-09-12T00:35:45.943083+0000","last_became_peered":"2024-09-12T00:35:45.943083+0000","last_unstale":"2024-09-12T01:19:07.750429+0000","last_undegraded":"2024-09-12T01:19:07.750429+0000","last_fullsized":"2024-09-12T01:19:07.750429+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:26.091545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":650,"num_read_kb":541,"num_write":222,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'267","reported_seq":910,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:41.721457+0000","last_change":"2024-09-12T00:35:43.954537+0000","last_active":"2024-09-12T01:19:41.721457+0000","last_peered":"2024-09-12T01:19:41.721457+0000","last_clean":"2024-09-12T01:19:41.721457+0000","last_became_active":"2024-09-12T00:35:43.953664+0000","last_became_peered":"2024-09-12T00:35:43.953664+0000","last_unstale":"2024-09-12T01:19:41.721457+0000","last_undegraded":"2024-09-12T01:19:41.721457+0000","last_fullsized":"2024-09-12T01:19:41.721457+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:13.149672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12193953,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":408,"num_read_kb":49547,"num_write":980,"num_write_kb":45556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:10.566168+0000","last_change":"2024-09-12T00:35:47.937702+0000","last_active":"2024-09-12T01:19:10.566168+0000","last_peered":"2024-09-12T01:19:10.566168+0000","last_clean":"2024-09-12T01:19:10.566168+0000","last_became_active":"2024-09-12T00:35:47.936972+0000","last_became_peered":"2024-09-12T00:35:47.936972+0000","last_unstale":"2024-09-12T01:19:10.566168+0000","last_undegraded":"2024-09-12T01:19:10.566168+0000","last_fullsized":"2024-09-12T01:19:10.566168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:21.464118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'261","reported_seq":828,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:53.400149+0000","last_change":"2024-09-12T00:35:49.955401+0000","last_active":"2024-09-12T01:20:53.400149+0000","last_peered":"2024-09-12T01:20:53.400149+0000","last_clean":"2024-09-12T01:20:53.400149+0000","last_became_active":"2024-09-12T00:35:49.954568+0000","last_became_peered":"2024-09-12T00:35:49.954568+0000","last_unstale":"2024-09-12T01:20:53.400149+0000","last_undegraded":"2024-09-12T01:20:53.400149+0000","last_fullsized":"2024-09-12T01:20:53.400149+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:57.669990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51998,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":428,"num_read_kb":893,"num_write":350,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:23.595568+0000","last_change":"2024-09-12T00:35:51.982044+0000","last_active":"2024-09-12T01:19:23.595568+0000","last_peered":"2024-09-12T01:19:23.595568+0000","last_clean":"2024-09-12T01:19:23.595568+0000","last_became_active":"2024-09-12T00:35:51.981326+0000","last_became_peered":"2024-09-12T00:35:51.981326+0000","last_unstale":"2024-09-12T01:19:23.595568+0000","last_undegraded":"2024-09-12T01:19:23.595568+0000","last_fullsized":"2024-09-12T01:19:23.595568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:53.955317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'2394","reported_seq":4227,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:58.564164+0000","last_change":"2024-09-12T00:35:53.975817+0000","last_active":"2024-09-12T01:20:58.564164+0000","last_peered":"2024-09-12T01:20:58.564164+0000","last_clean":"2024-09-12T01:20:58.564164+0000","last_became_active":"2024-09-12T00:35:53.975054+0000","last_became_peered":"2024-09-12T00:35:53.975054+0000","last_unstale":"2024-09-12T01:20:58.564164+0000","last_undegraded":"2024-09-12T01:20:58.564164+0000","last_fullsized":"2024-09-12T01:20:58.564164+0000","mapping_epoch":34,"log_start":"265'2300","ondisk_log_start":"265'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":2300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:31.278726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6031,"num_read_kb":6023,"num_write":4852,"num_write_kb":1786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'134","reported_seq":750,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:12.558238+0000","last_change":"2024-09-12T00:35:45.954433+0000","last_active":"2024-09-12T01:19:12.558238+0000","last_peered":"2024-09-12T01:19:12.558238+0000","last_clean":"2024-09-12T01:19:12.558238+0000","last_became_active":"2024-09-12T00:35:45.953664+0000","last_became_peered":"2024-09-12T00:35:45.953664+0000","last_unstale":"2024-09-12T01:19:12.558238+0000","last_undegraded":"2024-09-12T01:19:12.558238+0000","last_fullsized":"2024-09-12T01:19:12.558238+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:20.996949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":607,"num_read_kb":511,"num_write":198,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'262","reported_seq":964,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:02.413249+0000","last_change":"2024-09-12T00:35:43.943348+0000","last_active":"2024-09-12T01:19:02.413249+0000","last_peered":"2024-09-12T01:19:02.413249+0000","last_clean":"2024-09-12T01:19:02.413249+0000","last_became_active":"2024-09-12T00:35:43.942454+0000","last_became_peered":"2024-09-12T00:35:43.942454+0000","last_unstale":"2024-09-12T01:19:02.413249+0000","last_undegraded":"2024-09-12T01:19:02.413249+0000","last_fullsized":"2024-09-12T01:19:02.413249+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:18.360119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356895,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":553,"num_read_kb":3432,"num_write":962,"num_write_kb":23754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:35.558281+0000","last_change":"2024-09-12T00:35:47.942488+0000","last_active":"2024-09-12T01:18:35.558281+0000","last_peered":"2024-09-12T01:18:35.558281+0000","last_clean":"2024-09-12T01:18:35.558281+0000","last_became_active":"2024-09-12T00:35:47.942189+0000","last_became_peered":"2024-09-12T00:35:47.942189+0000","last_unstale":"2024-09-12T01:18:35.558281+0000","last_undegraded":"2024-09-12T01:18:35.558281+0000","last_fullsized":"2024-09-12T01:18:35.558281+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:52.594512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'313","reported_seq":903,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:22.822846+0000","last_change":"2024-09-12T00:35:49.943225+0000","last_active":"2024-09-12T01:21:22.822846+0000","last_peered":"2024-09-12T01:21:22.822846+0000","last_clean":"2024-09-12T01:21:22.822846+0000","last_became_active":"2024-09-12T00:35:49.942480+0000","last_became_peered":"2024-09-12T00:35:49.942480+0000","last_unstale":"2024-09-12T01:21:22.822846+0000","last_undegraded":"2024-09-12T01:21:22.822846+0000","last_fullsized":"2024-09-12T01:21:22.822846+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:22.668385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57491,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":516,"num_read_kb":1028,"num_write":422,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'769","reported_seq":2434,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.391002+0000","last_change":"2024-09-12T00:35:51.985725+0000","last_active":"2024-09-12T01:21:25.391002+0000","last_peered":"2024-09-12T01:21:25.391002+0000","last_clean":"2024-09-12T01:21:25.391002+0000","last_became_active":"2024-09-12T00:35:51.984968+0000","last_became_peered":"2024-09-12T00:35:51.984968+0000","last_unstale":"2024-09-12T01:21:25.391002+0000","last_undegraded":"2024-09-12T01:21:25.391002+0000","last_fullsized":"2024-09-12T01:21:25.391002+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:26.578990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'109","reported_seq":600,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:24.451554+0000","last_change":"2024-09-12T00:35:53.995319+0000","last_active":"2024-09-12T01:21:24.451554+0000","last_peered":"2024-09-12T01:21:24.451554+0000","last_clean":"2024-09-12T01:21:24.451554+0000","last_became_active":"2024-09-12T00:35:53.992664+0000","last_became_peered":"2024-09-12T00:35:53.992664+0000","last_unstale":"2024-09-12T01:21:24.451554+0000","last_undegraded":"2024-09-12T01:21:24.451554+0000","last_fullsized":"2024-09-12T01:21:24.451554+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:16.209394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":110,"num_write":262,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'190","reported_seq":797,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:01.759116+0000","last_change":"2024-09-12T00:35:45.940151+0000","last_active":"2024-09-12T01:19:01.759116+0000","last_peered":"2024-09-12T01:19:01.759116+0000","last_clean":"2024-09-12T01:19:01.759116+0000","last_became_active":"2024-09-12T00:35:45.939817+0000","last_became_peered":"2024-09-12T00:35:45.939817+0000","last_unstale":"2024-09-12T01:19:01.759116+0000","last_undegraded":"2024-09-12T01:19:01.759116+0000","last_fullsized":"2024-09-12T01:19:01.759116+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:58.194408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":809,"num_read_kb":663,"num_write":268,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'289","reported_seq":943,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:19.055349+0000","last_change":"2024-09-12T00:35:43.913025+0000","last_active":"2024-09-12T01:20:19.055349+0000","last_peered":"2024-09-12T01:20:19.055349+0000","last_clean":"2024-09-12T01:20:19.055349+0000","last_became_active":"2024-09-12T00:35:43.912282+0000","last_became_peered":"2024-09-12T00:35:43.912282+0000","last_unstale":"2024-09-12T01:20:19.055349+0000","last_undegraded":"2024-09-12T01:20:19.055349+0000","last_fullsized":"2024-09-12T01:20:19.055349+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:35.570049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14032931,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":456,"num_read_kb":19019,"num_write":1097,"num_write_kb":32789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:20.568395+0000","last_change":"2024-09-12T00:35:47.947337+0000","last_active":"2024-09-12T01:19:20.568395+0000","last_peered":"2024-09-12T01:19:20.568395+0000","last_clean":"2024-09-12T01:19:20.568395+0000","last_became_active":"2024-09-12T00:35:47.946636+0000","last_became_peered":"2024-09-12T00:35:47.946636+0000","last_unstale":"2024-09-12T01:19:20.568395+0000","last_undegraded":"2024-09-12T01:19:20.568395+0000","last_fullsized":"2024-09-12T01:19:20.568395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:32.769942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'499","reported_seq":1126,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.296835+0000","last_change":"2024-09-12T00:35:49.951472+0000","last_active":"2024-09-12T01:21:25.296835+0000","last_peered":"2024-09-12T01:21:25.296835+0000","last_clean":"2024-09-12T01:21:25.296835+0000","last_became_active":"2024-09-12T00:35:49.950845+0000","last_became_peered":"2024-09-12T00:35:49.950845+0000","last_unstale":"2024-09-12T01:21:25.296835+0000","last_undegraded":"2024-09-12T01:21:25.296835+0000","last_fullsized":"2024-09-12T01:21:25.296835+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:03.493730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116704,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":844,"num_read_kb":1837,"num_write":704,"num_write_kb":598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:15.567238+0000","last_change":"2024-09-12T00:35:51.979349+0000","last_active":"2024-09-12T01:19:15.567238+0000","last_peered":"2024-09-12T01:19:15.567238+0000","last_clean":"2024-09-12T01:19:15.567238+0000","last_became_active":"2024-09-12T00:35:51.978188+0000","last_became_peered":"2024-09-12T00:35:51.978188+0000","last_unstale":"2024-09-12T01:19:15.567238+0000","last_undegraded":"2024-09-12T01:19:15.567238+0000","last_fullsized":"2024-09-12T01:19:15.567238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:57.588270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'133","reported_seq":651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:07.813191+0000","last_change":"2024-09-12T00:35:53.986321+0000","last_active":"2024-09-12T01:20:07.813191+0000","last_peered":"2024-09-12T01:20:07.813191+0000","last_clean":"2024-09-12T01:20:07.813191+0000","last_became_active":"2024-09-12T00:35:53.985635+0000","last_became_peered":"2024-09-12T00:35:53.985635+0000","last_unstale":"2024-09-12T01:20:07.813191+0000","last_undegraded":"2024-09-12T01:20:07.813191+0000","last_fullsized":"2024-09-12T01:20:07.813191+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:38.196418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":203,"num_read_kb":181,"num_write":311,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'153","reported_seq":748,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:32.742795+0000","last_change":"2024-09-12T00:35:45.938944+0000","last_active":"2024-09-12T01:18:32.742795+0000","last_peered":"2024-09-12T01:18:32.742795+0000","last_clean":"2024-09-12T01:18:32.742795+0000","last_became_active":"2024-09-12T00:35:45.938135+0000","last_became_peered":"2024-09-12T00:35:45.938135+0000","last_unstale":"2024-09-12T01:18:32.742795+0000","last_undegraded":"2024-09-12T01:18:32.742795+0000","last_fullsized":"2024-09-12T01:18:32.742795+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:04.224264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":684,"num_read_kb":556,"num_write":242,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'305","reported_seq":943,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:02.416989+0000","last_change":"2024-09-12T00:35:43.939014+0000","last_active":"2024-09-12T01:19:02.416989+0000","last_peered":"2024-09-12T01:19:02.416989+0000","last_clean":"2024-09-12T01:19:02.416989+0000","last_became_active":"2024-09-12T00:35:43.936713+0000","last_became_peered":"2024-09-12T00:35:43.936713+0000","last_unstale":"2024-09-12T01:19:02.416989+0000","last_undegraded":"2024-09-12T01:19:02.416989+0000","last_fullsized":"2024-09-12T01:19:02.416989+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:51.023354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13751828,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":478,"num_read_kb":26420,"num_write":1140,"num_write_kb":29680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:35.558367+0000","last_change":"2024-09-12T00:35:47.939169+0000","last_active":"2024-09-12T01:18:35.558367+0000","last_peered":"2024-09-12T01:18:35.558367+0000","last_clean":"2024-09-12T01:18:35.558367+0000","last_became_active":"2024-09-12T00:35:47.938604+0000","last_became_peered":"2024-09-12T00:35:47.938604+0000","last_unstale":"2024-09-12T01:18:35.558367+0000","last_undegraded":"2024-09-12T01:18:35.558367+0000","last_fullsized":"2024-09-12T01:18:35.558367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:16.268476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'302","reported_seq":880,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:52.574188+0000","last_change":"2024-09-12T00:35:49.941521+0000","last_active":"2024-09-12T01:20:52.574188+0000","last_peered":"2024-09-12T01:20:52.574188+0000","last_clean":"2024-09-12T01:20:52.574188+0000","last_became_active":"2024-09-12T00:35:49.940679+0000","last_became_peered":"2024-09-12T00:35:49.940679+0000","last_unstale":"2024-09-12T01:20:52.574188+0000","last_undegraded":"2024-09-12T01:20:52.574188+0000","last_fullsized":"2024-09-12T01:20:52.574188+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:45.183044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55735,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":489,"num_read_kb":975,"num_write":444,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":483,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:48.567233+0000","last_change":"2024-09-12T00:35:51.978558+0000","last_active":"2024-09-12T01:18:48.567233+0000","last_peered":"2024-09-12T01:18:48.567233+0000","last_clean":"2024-09-12T01:18:48.567233+0000","last_became_active":"2024-09-12T00:35:51.977807+0000","last_became_peered":"2024-09-12T00:35:51.977807+0000","last_unstale":"2024-09-12T01:18:48.567233+0000","last_undegraded":"2024-09-12T01:18:48.567233+0000","last_fullsized":"2024-09-12T01:18:48.567233+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:54.797988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'99","reported_seq":602,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:03.604948+0000","last_change":"2024-09-12T00:35:54.003890+0000","last_active":"2024-09-12T01:20:03.604948+0000","last_peered":"2024-09-12T01:20:03.604948+0000","last_clean":"2024-09-12T01:20:03.604948+0000","last_became_active":"2024-09-12T00:35:54.003115+0000","last_became_peered":"2024-09-12T00:35:54.003115+0000","last_unstale":"2024-09-12T01:20:03.604948+0000","last_undegraded":"2024-09-12T01:20:03.604948+0000","last_fullsized":"2024-09-12T01:20:03.604948+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:19.982476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":131,"num_write":237,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'498","reported_seq":1281,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.989879+0000","last_change":"2024-09-12T00:35:45.930828+0000","last_active":"2024-09-12T01:20:22.989879+0000","last_peered":"2024-09-12T01:20:22.989879+0000","last_clean":"2024-09-12T01:20:22.989879+0000","last_became_active":"2024-09-12T00:35:45.929526+0000","last_became_peered":"2024-09-12T00:35:45.929526+0000","last_unstale":"2024-09-12T01:20:22.989879+0000","last_undegraded":"2024-09-12T01:20:22.989879+0000","last_fullsized":"2024-09-12T01:20:22.989879+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:44.529056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2425,"num_read_kb":2075,"num_write":878,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'221","reported_seq":809,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:35.672198+0000","last_change":"2024-09-12T00:35:43.945078+0000","last_active":"2024-09-12T01:19:35.672198+0000","last_peered":"2024-09-12T01:19:35.672198+0000","last_clean":"2024-09-12T01:19:35.672198+0000","last_became_active":"2024-09-12T00:35:43.944483+0000","last_became_peered":"2024-09-12T00:35:43.944483+0000","last_unstale":"2024-09-12T01:19:35.672198+0000","last_undegraded":"2024-09-12T01:19:35.672198+0000","last_fullsized":"2024-09-12T01:19:35.672198+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:23.857439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3731,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":302,"num_read_kb":347,"num_write":834,"num_write_kb":15629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:33.568409+0000","last_change":"2024-09-12T00:35:47.944100+0000","last_active":"2024-09-12T01:18:33.568409+0000","last_peered":"2024-09-12T01:18:33.568409+0000","last_clean":"2024-09-12T01:18:33.568409+0000","last_became_active":"2024-09-12T00:35:47.943382+0000","last_became_peered":"2024-09-12T00:35:47.943382+0000","last_unstale":"2024-09-12T01:18:33.568409+0000","last_undegraded":"2024-09-12T01:18:33.568409+0000","last_fullsized":"2024-09-12T01:18:33.568409+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:55.004421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'314","reported_seq":890,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:00.587241+0000","last_change":"2024-09-12T00:35:49.949821+0000","last_active":"2024-09-12T01:21:00.587241+0000","last_peered":"2024-09-12T01:21:00.587241+0000","last_clean":"2024-09-12T01:21:00.587241+0000","last_became_active":"2024-09-12T00:35:49.949283+0000","last_became_peered":"2024-09-12T00:35:49.949283+0000","last_unstale":"2024-09-12T01:21:00.587241+0000","last_undegraded":"2024-09-12T01:21:00.587241+0000","last_fullsized":"2024-09-12T01:21:00.587241+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:44.062401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64702,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":519,"num_read_kb":1067,"num_write":430,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'721","reported_seq":2252,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.385714+0000","last_change":"2024-09-12T00:35:51.979871+0000","last_active":"2024-09-12T01:21:25.385714+0000","last_peered":"2024-09-12T01:21:25.385714+0000","last_clean":"2024-09-12T01:21:25.385714+0000","last_became_active":"2024-09-12T00:35:51.979162+0000","last_became_peered":"2024-09-12T00:35:51.979162+0000","last_unstale":"2024-09-12T01:21:25.385714+0000","last_undegraded":"2024-09-12T01:21:25.385714+0000","last_fullsized":"2024-09-12T01:21:25.385714+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:24.612749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'115","reported_seq":603,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.981076+0000","last_change":"2024-09-12T00:35:53.982884+0000","last_active":"2024-09-12T01:20:22.981076+0000","last_peered":"2024-09-12T01:20:22.981076+0000","last_clean":"2024-09-12T01:20:22.981076+0000","last_became_active":"2024-09-12T00:35:53.981735+0000","last_became_peered":"2024-09-12T00:35:53.981735+0000","last_unstale":"2024-09-12T01:20:22.981076+0000","last_undegraded":"2024-09-12T01:20:22.981076+0000","last_fullsized":"2024-09-12T01:20:22.981076+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:48.987492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":92,"num_write":265,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'349","reported_seq":1039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:57.362515+0000","last_change":"2024-09-12T00:35:45.954531+0000","last_active":"2024-09-12T01:19:57.362515+0000","last_peered":"2024-09-12T01:19:57.362515+0000","last_clean":"2024-09-12T01:19:57.362515+0000","last_became_active":"2024-09-12T00:35:45.953935+0000","last_became_peered":"2024-09-12T00:35:45.953935+0000","last_unstale":"2024-09-12T01:19:57.362515+0000","last_undegraded":"2024-09-12T01:19:57.362515+0000","last_fullsized":"2024-09-12T01:19:57.362515+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:23.435584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1509,"num_read_kb":1228,"num_write":558,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'251","reported_seq":902,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:06.357133+0000","last_change":"2024-09-12T00:35:43.930345+0000","last_active":"2024-09-12T01:20:06.357133+0000","last_peered":"2024-09-12T01:20:06.357133+0000","last_clean":"2024-09-12T01:20:06.357133+0000","last_became_active":"2024-09-12T00:35:43.929559+0000","last_became_peered":"2024-09-12T00:35:43.929559+0000","last_unstale":"2024-09-12T01:20:06.357133+0000","last_undegraded":"2024-09-12T01:20:06.357133+0000","last_fullsized":"2024-09-12T01:20:06.357133+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:34.819090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13605078,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":379,"num_read_kb":47620,"num_write":857,"num_write_kb":27870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1458,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.242341+0000","last_change":"2024-09-12T00:35:47.936838+0000","last_active":"2024-09-12T01:21:25.242341+0000","last_peered":"2024-09-12T01:21:25.242341+0000","last_clean":"2024-09-12T01:21:25.242341+0000","last_became_active":"2024-09-12T00:35:47.936026+0000","last_became_peered":"2024-09-12T00:35:47.936026+0000","last_unstale":"2024-09-12T01:21:25.242341+0000","last_undegraded":"2024-09-12T01:21:25.242341+0000","last_fullsized":"2024-09-12T01:21:25.242341+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:42.930790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'80","reported_seq":595,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:51.233520+0000","last_change":"2024-09-12T00:35:50.027677+0000","last_active":"2024-09-12T01:18:51.233520+0000","last_peered":"2024-09-12T01:18:51.233520+0000","last_clean":"2024-09-12T01:18:51.233520+0000","last_became_active":"2024-09-12T00:35:50.027161+0000","last_became_peered":"2024-09-12T00:35:50.027161+0000","last_unstale":"2024-09-12T01:18:51.233520+0000","last_undegraded":"2024-09-12T01:18:51.233520+0000","last_fullsized":"2024-09-12T01:18:51.233520+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:29.997291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'770","reported_seq":6315,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.385635+0000","last_change":"2024-09-12T00:35:51.977887+0000","last_active":"2024-09-12T01:21:25.385635+0000","last_peered":"2024-09-12T01:21:25.385635+0000","last_clean":"2024-09-12T01:21:25.385635+0000","last_became_active":"2024-09-12T00:35:51.976947+0000","last_became_peered":"2024-09-12T00:35:51.976947+0000","last_unstale":"2024-09-12T01:21:25.385635+0000","last_undegraded":"2024-09-12T01:21:25.385635+0000","last_fullsized":"2024-09-12T01:21:25.385635+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:41.190642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'156","reported_seq":653,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:03.702547+0000","last_change":"2024-09-12T00:35:53.995354+0000","last_active":"2024-09-12T01:20:03.702547+0000","last_peered":"2024-09-12T01:20:03.702547+0000","last_clean":"2024-09-12T01:20:03.702547+0000","last_became_active":"2024-09-12T00:35:53.994715+0000","last_became_peered":"2024-09-12T00:35:53.994715+0000","last_unstale":"2024-09-12T01:20:03.702547+0000","last_undegraded":"2024-09-12T01:20:03.702547+0000","last_fullsized":"2024-09-12T01:20:03.702547+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:57.399598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":132,"num_read_kb":125,"num_write":372,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'158","reported_seq":698,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:58.526770+0000","last_change":"2024-09-12T00:36:17.050284+0000","last_active":"2024-09-12T01:20:58.526770+0000","last_peered":"2024-09-12T01:20:58.526770+0000","last_clean":"2024-09-12T01:20:58.526770+0000","last_became_active":"2024-09-12T00:36:17.049999+0000","last_became_peered":"2024-09-12T00:36:17.049999+0000","last_unstale":"2024-09-12T01:20:58.526770+0000","last_undegraded":"2024-09-12T01:20:58.526770+0000","last_fullsized":"2024-09-12T01:20:58.526770+0000","mapping_epoch":37,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:09.446877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":667,"num_read_kb":538,"num_write":243,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"265'287","reported_seq":1038,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:45.549191+0000","last_change":"2024-09-12T00:35:43.931842+0000","last_active":"2024-09-12T01:19:45.549191+0000","last_peered":"2024-09-12T01:19:45.549191+0000","last_clean":"2024-09-12T01:19:45.549191+0000","last_became_active":"2024-09-12T00:35:43.931562+0000","last_became_peered":"2024-09-12T00:35:43.931562+0000","last_unstale":"2024-09-12T01:19:45.549191+0000","last_undegraded":"2024-09-12T01:19:45.549191+0000","last_fullsized":"2024-09-12T01:19:45.549191+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:22.693505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8974689,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":606,"num_read_kb":113907,"num_write":1089,"num_write_kb":34109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:32.742956+0000","last_change":"2024-09-12T00:35:47.930885+0000","last_active":"2024-09-12T01:18:32.742956+0000","last_peered":"2024-09-12T01:18:32.742956+0000","last_clean":"2024-09-12T01:18:32.742956+0000","last_became_active":"2024-09-12T00:35:47.930147+0000","last_became_peered":"2024-09-12T00:35:47.930147+0000","last_unstale":"2024-09-12T01:18:32.742956+0000","last_undegraded":"2024-09-12T01:18:32.742956+0000","last_fullsized":"2024-09-12T01:18:32.742956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:58.003654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'340","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:20.368061+0000","last_change":"2024-09-12T00:35:49.939362+0000","last_active":"2024-09-12T01:21:20.368061+0000","last_peered":"2024-09-12T01:21:20.368061+0000","last_clean":"2024-09-12T01:21:20.368061+0000","last_became_active":"2024-09-12T00:35:49.938597+0000","last_became_peered":"2024-09-12T00:35:49.938597+0000","last_unstale":"2024-09-12T01:21:20.368061+0000","last_undegraded":"2024-09-12T01:21:20.368061+0000","last_fullsized":"2024-09-12T01:21:20.368061+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.934056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59302,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":558,"num_read_kb":1066,"num_write":448,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:37.551187+0000","last_change":"2024-09-12T00:35:51.968545+0000","last_active":"2024-09-12T01:18:37.551187+0000","last_peered":"2024-09-12T01:18:37.551187+0000","last_clean":"2024-09-12T01:18:37.551187+0000","last_became_active":"2024-09-12T00:35:51.967708+0000","last_became_peered":"2024-09-12T00:35:51.967708+0000","last_unstale":"2024-09-12T01:18:37.551187+0000","last_undegraded":"2024-09-12T01:18:37.551187+0000","last_fullsized":"2024-09-12T01:18:37.551187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:40.081105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'116","reported_seq":605,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:38.582809+0000","last_change":"2024-09-12T00:35:53.998562+0000","last_active":"2024-09-12T01:19:38.582809+0000","last_peered":"2024-09-12T01:19:38.582809+0000","last_clean":"2024-09-12T01:19:38.582809+0000","last_became_active":"2024-09-12T00:35:53.997893+0000","last_became_peered":"2024-09-12T00:35:53.997893+0000","last_unstale":"2024-09-12T01:19:38.582809+0000","last_undegraded":"2024-09-12T01:19:38.582809+0000","last_fullsized":"2024-09-12T01:19:38.582809+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:57.696902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":114,"num_write":260,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'95","reported_seq":679,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.563475+0000","last_change":"2024-09-12T00:35:45.945106+0000","last_active":"2024-09-12T01:19:37.563475+0000","last_peered":"2024-09-12T01:19:37.563475+0000","last_clean":"2024-09-12T01:19:37.563475+0000","last_became_active":"2024-09-12T00:35:45.941291+0000","last_became_peered":"2024-09-12T00:35:45.941291+0000","last_unstale":"2024-09-12T01:19:37.563475+0000","last_undegraded":"2024-09-12T01:19:37.563475+0000","last_fullsized":"2024-09-12T01:19:37.563475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:41.263421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":459,"num_read_kb":386,"num_write":145,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":611,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.797702+0000","last_change":"2024-09-12T00:35:25.098793+0000","last_active":"2024-09-12T01:19:32.797702+0000","last_peered":"2024-09-12T01:19:32.797702+0000","last_clean":"2024-09-12T01:19:32.797702+0000","last_became_active":"2024-09-12T00:35:25.096843+0000","last_became_peered":"2024-09-12T00:35:25.096843+0000","last_unstale":"2024-09-12T01:19:32.797702+0000","last_undegraded":"2024-09-12T01:19:32.797702+0000","last_fullsized":"2024-09-12T01:19:32.797702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:23.614097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:23.614097+0000","last_clean_scrub_stamp":"2024-09-12T00:35:23.614097+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:42.023728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.566130+0000","last_change":"2024-09-12T00:35:31.691879+0000","last_active":"2024-09-12T01:19:18.566130+0000","last_peered":"2024-09-12T01:19:18.566130+0000","last_clean":"2024-09-12T01:19:18.566130+0000","last_became_active":"2024-09-12T00:35:29.668145+0000","last_became_peered":"2024-09-12T00:35:29.668145+0000","last_unstale":"2024-09-12T01:19:18.566130+0000","last_undegraded":"2024-09-12T01:19:18.566130+0000","last_fullsized":"2024-09-12T01:19:18.566130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:18.650004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011070749999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'249","reported_seq":908,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:46.860660+0000","last_change":"2024-09-12T00:35:43.920876+0000","last_active":"2024-09-12T01:19:46.860660+0000","last_peered":"2024-09-12T01:19:46.860660+0000","last_clean":"2024-09-12T01:19:46.860660+0000","last_became_active":"2024-09-12T00:35:43.916969+0000","last_became_peered":"2024-09-12T00:35:43.916969+0000","last_unstale":"2024-09-12T01:19:46.860660+0000","last_undegraded":"2024-09-12T01:19:46.860660+0000","last_fullsized":"2024-09-12T01:19:46.860660+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:16.584205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5815168,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":421,"num_read_kb":119474,"num_write":944,"num_write_kb":17296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.797857+0000","last_change":"2024-09-12T00:35:47.944667+0000","last_active":"2024-09-12T01:19:32.797857+0000","last_peered":"2024-09-12T01:19:32.797857+0000","last_clean":"2024-09-12T01:19:32.797857+0000","last_became_active":"2024-09-12T00:35:47.942643+0000","last_became_peered":"2024-09-12T00:35:47.942643+0000","last_unstale":"2024-09-12T01:19:32.797857+0000","last_undegraded":"2024-09-12T01:19:32.797857+0000","last_fullsized":"2024-09-12T01:19:32.797857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:06.078372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'681","reported_seq":1373,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.328575+0000","last_change":"2024-09-12T00:35:49.958641+0000","last_active":"2024-09-12T01:21:25.328575+0000","last_peered":"2024-09-12T01:21:25.328575+0000","last_clean":"2024-09-12T01:21:25.328575+0000","last_became_active":"2024-09-12T00:35:49.957694+0000","last_became_peered":"2024-09-12T00:35:49.957694+0000","last_unstale":"2024-09-12T01:21:25.328575+0000","last_undegraded":"2024-09-12T01:21:25.328575+0000","last_fullsized":"2024-09-12T01:21:25.328575+0000","mapping_epoch":30,"log_start":"265'600","ondisk_log_start":"265'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":600,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:23.494190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160704,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1343,"num_read_kb":2746,"num_write":1290,"num_write_kb":1148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:13.573190+0000","last_change":"2024-09-12T00:35:51.978016+0000","last_active":"2024-09-12T01:19:13.573190+0000","last_peered":"2024-09-12T01:19:13.573190+0000","last_clean":"2024-09-12T01:19:13.573190+0000","last_became_active":"2024-09-12T00:35:51.977282+0000","last_became_peered":"2024-09-12T00:35:51.977282+0000","last_unstale":"2024-09-12T01:19:13.573190+0000","last_undegraded":"2024-09-12T01:19:13.573190+0000","last_fullsized":"2024-09-12T01:19:13.573190+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:23.231926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'206","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.003775+0000","last_change":"2024-09-12T00:35:53.998069+0000","last_active":"2024-09-12T01:20:23.003775+0000","last_peered":"2024-09-12T01:20:23.003775+0000","last_clean":"2024-09-12T01:20:23.003775+0000","last_became_active":"2024-09-12T00:35:53.997354+0000","last_became_peered":"2024-09-12T00:35:53.997354+0000","last_unstale":"2024-09-12T01:20:23.003775+0000","last_undegraded":"2024-09-12T01:20:23.003775+0000","last_fullsized":"2024-09-12T01:20:23.003775+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:55.234664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":471,"num_write":454,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'239","reported_seq":897,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:02.408975+0000","last_change":"2024-09-12T00:35:45.946145+0000","last_active":"2024-09-12T01:20:02.408975+0000","last_peered":"2024-09-12T01:20:02.408975+0000","last_clean":"2024-09-12T01:20:02.408975+0000","last_became_active":"2024-09-12T00:35:45.945766+0000","last_became_peered":"2024-09-12T00:35:45.945766+0000","last_unstale":"2024-09-12T01:20:02.408975+0000","last_undegraded":"2024-09-12T01:20:02.408975+0000","last_fullsized":"2024-09-12T01:20:02.408975+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:50.991641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1032,"num_read_kb":857,"num_write":339,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.798875+0000","last_change":"2024-09-12T00:35:31.861888+0000","last_active":"2024-09-12T01:19:37.798875+0000","last_peered":"2024-09-12T01:19:37.798875+0000","last_clean":"2024-09-12T01:19:37.798875+0000","last_became_active":"2024-09-12T00:35:29.671287+0000","last_became_peered":"2024-09-12T00:35:29.671287+0000","last_unstale":"2024-09-12T01:19:37.798875+0000","last_undegraded":"2024-09-12T01:19:37.798875+0000","last_fullsized":"2024-09-12T01:19:37.798875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:47.739072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075002000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'328","reported_seq":1037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:28.576695+0000","last_change":"2024-09-12T00:35:43.945658+0000","last_active":"2024-09-12T01:19:28.576695+0000","last_peered":"2024-09-12T01:19:28.576695+0000","last_clean":"2024-09-12T01:19:28.576695+0000","last_became_active":"2024-09-12T00:35:43.945335+0000","last_became_peered":"2024-09-12T00:35:43.945335+0000","last_unstale":"2024-09-12T01:19:28.576695+0000","last_undegraded":"2024-09-12T01:19:28.576695+0000","last_fullsized":"2024-09-12T01:19:28.576695+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:30.924593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14308890,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":613,"num_read_kb":63011,"num_write":1416,"num_write_kb":40970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.563896+0000","last_change":"2024-09-12T00:35:47.926465+0000","last_active":"2024-09-12T01:19:08.563896+0000","last_peered":"2024-09-12T01:19:08.563896+0000","last_clean":"2024-09-12T01:19:08.563896+0000","last_became_active":"2024-09-12T00:35:47.925704+0000","last_became_peered":"2024-09-12T00:35:47.925704+0000","last_unstale":"2024-09-12T01:19:08.563896+0000","last_undegraded":"2024-09-12T01:19:08.563896+0000","last_fullsized":"2024-09-12T01:19:08.563896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:53.561342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1241","reported_seq":2720,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.645392+0000","last_change":"2024-09-12T00:35:49.948152+0000","last_active":"2024-09-12T01:21:25.645392+0000","last_peered":"2024-09-12T01:21:25.645392+0000","last_clean":"2024-09-12T01:21:25.645392+0000","last_became_active":"2024-09-12T00:35:49.947643+0000","last_became_peered":"2024-09-12T00:35:49.947643+0000","last_unstale":"2024-09-12T01:21:25.645392+0000","last_undegraded":"2024-09-12T01:21:25.645392+0000","last_fullsized":"2024-09-12T01:21:25.645392+0000","mapping_epoch":30,"log_start":"265'1200","ondisk_log_start":"265'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":1200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:30.009318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176147,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2001,"num_read_kb":3469,"num_write":1110,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:42.800216+0000","last_change":"2024-09-12T00:35:51.981967+0000","last_active":"2024-09-12T01:19:42.800216+0000","last_peered":"2024-09-12T01:19:42.800216+0000","last_clean":"2024-09-12T01:19:42.800216+0000","last_became_active":"2024-09-12T00:35:51.981240+0000","last_became_peered":"2024-09-12T00:35:51.981240+0000","last_unstale":"2024-09-12T01:19:42.800216+0000","last_undegraded":"2024-09-12T01:19:42.800216+0000","last_fullsized":"2024-09-12T01:19:42.800216+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:42.148309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'135","reported_seq":643,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.074739+0000","last_change":"2024-09-12T00:35:54.014383+0000","last_active":"2024-09-12T01:20:23.074739+0000","last_peered":"2024-09-12T01:20:23.074739+0000","last_clean":"2024-09-12T01:20:23.074739+0000","last_became_active":"2024-09-12T00:35:54.013658+0000","last_became_peered":"2024-09-12T00:35:54.013658+0000","last_unstale":"2024-09-12T01:20:23.074739+0000","last_undegraded":"2024-09-12T01:20:23.074739+0000","last_fullsized":"2024-09-12T01:20:23.074739+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:12.904906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":184,"num_read_kb":167,"num_write":336,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'141","reported_seq":771,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:42.252694+0000","last_change":"2024-09-12T00:35:45.929654+0000","last_active":"2024-09-12T01:19:42.252694+0000","last_peered":"2024-09-12T01:19:42.252694+0000","last_clean":"2024-09-12T01:19:42.252694+0000","last_became_active":"2024-09-12T00:35:45.929073+0000","last_became_peered":"2024-09-12T00:35:45.929073+0000","last_unstale":"2024-09-12T01:19:42.252694+0000","last_undegraded":"2024-09-12T01:19:42.252694+0000","last_fullsized":"2024-09-12T01:19:42.252694+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:33.683146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":635,"num_read_kb":540,"num_write":217,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:15.567287+0000","last_change":"2024-09-12T00:35:31.904599+0000","last_active":"2024-09-12T01:19:15.567287+0000","last_peered":"2024-09-12T01:19:15.567287+0000","last_clean":"2024-09-12T01:19:15.567287+0000","last_became_active":"2024-09-12T00:35:29.699432+0000","last_became_peered":"2024-09-12T00:35:29.699432+0000","last_unstale":"2024-09-12T01:19:15.567287+0000","last_undegraded":"2024-09-12T01:19:15.567287+0000","last_fullsized":"2024-09-12T01:19:15.567287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:03.035417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099979400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'273","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:08.165361+0000","last_change":"2024-09-12T00:35:43.929255+0000","last_active":"2024-09-12T01:20:08.165361+0000","last_peered":"2024-09-12T01:20:08.165361+0000","last_clean":"2024-09-12T01:20:08.165361+0000","last_became_active":"2024-09-12T00:35:43.928667+0000","last_became_peered":"2024-09-12T00:35:43.928667+0000","last_unstale":"2024-09-12T01:20:08.165361+0000","last_undegraded":"2024-09-12T01:20:08.165361+0000","last_fullsized":"2024-09-12T01:20:08.165361+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:17.228103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5494446,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":433,"num_read_kb":16531,"num_write":982,"num_write_kb":18962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:10.566295+0000","last_change":"2024-09-12T00:35:47.945027+0000","last_active":"2024-09-12T01:19:10.566295+0000","last_peered":"2024-09-12T01:19:10.566295+0000","last_clean":"2024-09-12T01:19:10.566295+0000","last_became_active":"2024-09-12T00:35:47.944385+0000","last_became_peered":"2024-09-12T00:35:47.944385+0000","last_unstale":"2024-09-12T01:19:10.566295+0000","last_undegraded":"2024-09-12T01:19:10.566295+0000","last_fullsized":"2024-09-12T01:19:10.566295+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:59.954589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'226","reported_seq":1321,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.532346+0000","last_change":"2024-09-12T00:35:50.026399+0000","last_active":"2024-09-12T01:21:25.532346+0000","last_peered":"2024-09-12T01:21:25.532346+0000","last_clean":"2024-09-12T01:21:25.532346+0000","last_became_active":"2024-09-12T00:35:50.025610+0000","last_became_peered":"2024-09-12T00:35:50.025610+0000","last_unstale":"2024-09-12T01:21:25.532346+0000","last_undegraded":"2024-09-12T01:21:25.532346+0000","last_fullsized":"2024-09-12T01:21:25.532346+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:54.581195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":183,"num_read_kb":174,"num_write":155,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:38.579276+0000","last_change":"2024-09-12T00:35:51.974368+0000","last_active":"2024-09-12T01:19:38.579276+0000","last_peered":"2024-09-12T01:19:38.579276+0000","last_clean":"2024-09-12T01:19:38.579276+0000","last_became_active":"2024-09-12T00:35:51.973593+0000","last_became_peered":"2024-09-12T00:35:51.973593+0000","last_unstale":"2024-09-12T01:19:38.579276+0000","last_undegraded":"2024-09-12T01:19:38.579276+0000","last_fullsized":"2024-09-12T01:19:38.579276+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:59.292452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'273","reported_seq":876,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.184767+0000","last_change":"2024-09-12T00:35:53.995709+0000","last_active":"2024-09-12T01:20:23.184767+0000","last_peered":"2024-09-12T01:20:23.184767+0000","last_clean":"2024-09-12T01:20:23.184767+0000","last_became_active":"2024-09-12T00:35:53.994828+0000","last_became_peered":"2024-09-12T00:35:53.994828+0000","last_unstale":"2024-09-12T01:20:23.184767+0000","last_undegraded":"2024-09-12T01:20:23.184767+0000","last_fullsized":"2024-09-12T01:20:23.184767+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:01.920282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":532,"num_read_kb":546,"num_write":608,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'101","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:33.581546+0000","last_change":"2024-09-12T00:35:45.933047+0000","last_active":"2024-09-12T01:19:33.581546+0000","last_peered":"2024-09-12T01:19:33.581546+0000","last_clean":"2024-09-12T01:19:33.581546+0000","last_became_active":"2024-09-12T00:35:45.932642+0000","last_became_peered":"2024-09-12T00:35:45.932642+0000","last_unstale":"2024-09-12T01:19:33.581546+0000","last_undegraded":"2024-09-12T01:19:33.581546+0000","last_fullsized":"2024-09-12T01:19:33.581546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:58.000694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":466,"num_read_kb":396,"num_write":153,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.566063+0000","last_change":"2024-09-12T00:35:31.692803+0000","last_active":"2024-09-12T01:19:18.566063+0000","last_peered":"2024-09-12T01:19:18.566063+0000","last_clean":"2024-09-12T01:19:18.566063+0000","last_became_active":"2024-09-12T00:35:29.664963+0000","last_became_peered":"2024-09-12T00:35:29.664963+0000","last_unstale":"2024-09-12T01:19:18.566063+0000","last_undegraded":"2024-09-12T01:19:18.566063+0000","last_fullsized":"2024-09-12T01:19:18.566063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:27.056845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020842569999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'243","reported_seq":913,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:01.778924+0000","last_change":"2024-09-12T00:35:43.931465+0000","last_active":"2024-09-12T01:20:01.778924+0000","last_peered":"2024-09-12T01:20:01.778924+0000","last_clean":"2024-09-12T01:20:01.778924+0000","last_became_active":"2024-09-12T00:35:43.930731+0000","last_became_peered":"2024-09-12T00:35:43.930731+0000","last_unstale":"2024-09-12T01:20:01.778924+0000","last_undegraded":"2024-09-12T01:20:01.778924+0000","last_fullsized":"2024-09-12T01:20:01.778924+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:34.455587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11205310,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":473,"num_read_kb":45060,"num_write":1048,"num_write_kb":33877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.580737+0000","last_change":"2024-09-12T00:35:47.939774+0000","last_active":"2024-09-12T01:19:43.580737+0000","last_peered":"2024-09-12T01:19:43.580737+0000","last_clean":"2024-09-12T01:19:43.580737+0000","last_became_active":"2024-09-12T00:35:47.939055+0000","last_became_peered":"2024-09-12T00:35:47.939055+0000","last_unstale":"2024-09-12T01:19:43.580737+0000","last_undegraded":"2024-09-12T01:19:43.580737+0000","last_fullsized":"2024-09-12T01:19:43.580737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:08.442651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'117","reported_seq":654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:23.406053+0000","last_change":"2024-09-12T00:35:49.952715+0000","last_active":"2024-09-12T01:21:23.406053+0000","last_peered":"2024-09-12T01:21:23.406053+0000","last_clean":"2024-09-12T01:21:23.406053+0000","last_became_active":"2024-09-12T00:35:49.948258+0000","last_became_peered":"2024-09-12T00:35:49.948258+0000","last_unstale":"2024-09-12T01:21:23.406053+0000","last_undegraded":"2024-09-12T01:21:23.406053+0000","last_fullsized":"2024-09-12T01:21:23.406053+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:13.173314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:12.558370+0000","last_change":"2024-09-12T00:35:51.975246+0000","last_active":"2024-09-12T01:19:12.558370+0000","last_peered":"2024-09-12T01:19:12.558370+0000","last_clean":"2024-09-12T01:19:12.558370+0000","last_became_active":"2024-09-12T00:35:51.974302+0000","last_became_peered":"2024-09-12T00:35:51.974302+0000","last_unstale":"2024-09-12T01:19:12.558370+0000","last_undegraded":"2024-09-12T01:19:12.558370+0000","last_fullsized":"2024-09-12T01:19:12.558370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:22.264781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'140","reported_seq":703,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:02.410395+0000","last_change":"2024-09-12T00:35:53.995956+0000","last_active":"2024-09-12T01:20:02.410395+0000","last_peered":"2024-09-12T01:20:02.410395+0000","last_clean":"2024-09-12T01:20:02.410395+0000","last_became_active":"2024-09-12T00:35:53.995254+0000","last_became_peered":"2024-09-12T00:35:53.995254+0000","last_unstale":"2024-09-12T01:20:02.410395+0000","last_undegraded":"2024-09-12T01:20:02.410395+0000","last_fullsized":"2024-09-12T01:20:02.410395+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:26.022607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1272,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":285,"num_read_kb":262,"num_write":355,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'53","reported_seq":591,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.121613+0000","last_change":"2024-09-12T00:35:45.936327+0000","last_active":"2024-09-12T01:19:37.121613+0000","last_peered":"2024-09-12T01:19:37.121613+0000","last_clean":"2024-09-12T01:19:37.121613+0000","last_became_active":"2024-09-12T00:35:45.936061+0000","last_became_peered":"2024-09-12T00:35:45.936061+0000","last_unstale":"2024-09-12T01:19:37.121613+0000","last_undegraded":"2024-09-12T01:19:37.121613+0000","last_fullsized":"2024-09-12T01:19:37.121613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:11.296362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":179,"num_write":83,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"265'278","reported_seq":932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:02.749462+0000","last_change":"2024-09-12T00:36:17.052149+0000","last_active":"2024-09-12T01:20:02.749462+0000","last_peered":"2024-09-12T01:20:02.749462+0000","last_clean":"2024-09-12T01:20:02.749462+0000","last_became_active":"2024-09-12T00:36:17.051542+0000","last_became_peered":"2024-09-12T00:36:17.051542+0000","last_unstale":"2024-09-12T01:20:02.749462+0000","last_undegraded":"2024-09-12T01:20:02.749462+0000","last_fullsized":"2024-09-12T01:20:02.749462+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:58.989806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13290846,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":408,"num_read_kb":44411,"num_write":960,"num_write_kb":33814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.578146+0000","last_change":"2024-09-12T00:35:31.699054+0000","last_active":"2024-09-12T01:19:18.578146+0000","last_peered":"2024-09-12T01:19:18.578146+0000","last_clean":"2024-09-12T01:19:18.578146+0000","last_became_active":"2024-09-12T00:35:29.700869+0000","last_became_peered":"2024-09-12T00:35:29.700869+0000","last_unstale":"2024-09-12T01:19:18.578146+0000","last_undegraded":"2024-09-12T01:19:18.578146+0000","last_fullsized":"2024-09-12T01:19:18.578146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:14.134437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099003299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"36'5","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.245067+0000","last_change":"2024-09-12T00:35:47.947133+0000","last_active":"2024-09-12T01:21:25.245067+0000","last_peered":"2024-09-12T01:21:25.245067+0000","last_clean":"2024-09-12T01:21:25.245067+0000","last_became_active":"2024-09-12T00:35:47.946690+0000","last_became_peered":"2024-09-12T00:35:47.946690+0000","last_unstale":"2024-09-12T01:21:25.245067+0000","last_undegraded":"2024-09-12T01:21:25.245067+0000","last_fullsized":"2024-09-12T01:21:25.245067+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:37.935723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":1199,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'560","reported_seq":1219,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.314186+0000","last_change":"2024-09-12T00:35:49.948760+0000","last_active":"2024-09-12T01:21:25.314186+0000","last_peered":"2024-09-12T01:21:25.314186+0000","last_clean":"2024-09-12T01:21:25.314186+0000","last_became_active":"2024-09-12T00:35:49.948095+0000","last_became_peered":"2024-09-12T00:35:49.948095+0000","last_unstale":"2024-09-12T01:21:25.314186+0000","last_undegraded":"2024-09-12T01:21:25.314186+0000","last_fullsized":"2024-09-12T01:21:25.314186+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:35.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103759,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1551,"num_read_kb":2476,"num_write":2038,"num_write_kb":1870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.556917+0000","last_change":"2024-09-12T00:35:51.968432+0000","last_active":"2024-09-12T01:19:37.556917+0000","last_peered":"2024-09-12T01:19:37.556917+0000","last_clean":"2024-09-12T01:19:37.556917+0000","last_became_active":"2024-09-12T00:35:51.967708+0000","last_became_peered":"2024-09-12T00:35:51.967708+0000","last_unstale":"2024-09-12T01:19:37.556917+0000","last_undegraded":"2024-09-12T01:19:37.556917+0000","last_fullsized":"2024-09-12T01:19:37.556917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:43.503668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'147","reported_seq":643,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:40.914651+0000","last_change":"2024-09-12T00:35:54.015204+0000","last_active":"2024-09-12T01:19:40.914651+0000","last_peered":"2024-09-12T01:19:40.914651+0000","last_clean":"2024-09-12T01:19:40.914651+0000","last_became_active":"2024-09-12T00:35:54.014321+0000","last_became_peered":"2024-09-12T00:35:54.014321+0000","last_unstale":"2024-09-12T01:19:40.914651+0000","last_undegraded":"2024-09-12T01:19:40.914651+0000","last_fullsized":"2024-09-12T01:19:40.914651+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:14.339505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":134,"num_write":336,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'165","reported_seq":787,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:33.578060+0000","last_change":"2024-09-12T00:35:45.936514+0000","last_active":"2024-09-12T01:19:33.578060+0000","last_peered":"2024-09-12T01:19:33.578060+0000","last_clean":"2024-09-12T01:19:33.578060+0000","last_became_active":"2024-09-12T00:35:45.936178+0000","last_became_peered":"2024-09-12T00:35:45.936178+0000","last_unstale":"2024-09-12T01:19:33.578060+0000","last_undegraded":"2024-09-12T01:19:33.578060+0000","last_fullsized":"2024-09-12T01:19:33.578060+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:06.218590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":595,"num_write":226,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'304","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:28.580329+0000","last_change":"2024-09-12T00:35:43.931012+0000","last_active":"2024-09-12T01:19:28.580329+0000","last_peered":"2024-09-12T01:19:28.580329+0000","last_clean":"2024-09-12T01:19:28.580329+0000","last_became_active":"2024-09-12T00:35:43.928834+0000","last_became_peered":"2024-09-12T00:35:43.928834+0000","last_unstale":"2024-09-12T01:19:28.580329+0000","last_undegraded":"2024-09-12T01:19:28.580329+0000","last_fullsized":"2024-09-12T01:19:28.580329+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:38.654576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17061491,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":443,"num_read_kb":29312,"num_write":1177,"num_write_kb":48953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:22.795333+0000","last_change":"2024-09-12T00:35:31.861538+0000","last_active":"2024-09-12T01:19:22.795333+0000","last_peered":"2024-09-12T01:19:22.795333+0000","last_clean":"2024-09-12T01:19:22.795333+0000","last_became_active":"2024-09-12T00:35:29.697973+0000","last_became_peered":"2024-09-12T00:35:29.697973+0000","last_unstale":"2024-09-12T01:19:22.795333+0000","last_undegraded":"2024-09-12T01:19:22.795333+0000","last_fullsized":"2024-09-12T01:19:22.795333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:08.455168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083354399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.562424+0000","last_change":"2024-09-12T00:35:47.940734+0000","last_active":"2024-09-12T01:19:32.562424+0000","last_peered":"2024-09-12T01:19:32.562424+0000","last_clean":"2024-09-12T01:19:32.562424+0000","last_became_active":"2024-09-12T00:35:47.940014+0000","last_became_peered":"2024-09-12T00:35:47.940014+0000","last_unstale":"2024-09-12T01:19:32.562424+0000","last_undegraded":"2024-09-12T01:19:32.562424+0000","last_fullsized":"2024-09-12T01:19:32.562424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:23.603431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'186","reported_seq":750,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.995320+0000","last_change":"2024-09-12T00:35:50.029129+0000","last_active":"2024-09-12T01:20:22.995320+0000","last_peered":"2024-09-12T01:20:22.995320+0000","last_clean":"2024-09-12T01:20:22.995320+0000","last_became_active":"2024-09-12T00:35:50.028173+0000","last_became_peered":"2024-09-12T00:35:50.028173+0000","last_unstale":"2024-09-12T01:20:22.995320+0000","last_undegraded":"2024-09-12T01:20:22.995320+0000","last_fullsized":"2024-09-12T01:20:22.995320+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:11.842961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":223,"num_read_kb":207,"num_write":158,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'788","reported_seq":2675,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.379576+0000","last_change":"2024-09-12T00:35:51.977915+0000","last_active":"2024-09-12T01:21:25.379576+0000","last_peered":"2024-09-12T01:21:25.379576+0000","last_clean":"2024-09-12T01:21:25.379576+0000","last_became_active":"2024-09-12T00:35:51.977203+0000","last_became_peered":"2024-09-12T00:35:51.977203+0000","last_unstale":"2024-09-12T01:21:25.379576+0000","last_undegraded":"2024-09-12T01:21:25.379576+0000","last_fullsized":"2024-09-12T01:21:25.379576+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:06.229745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'110","reported_seq":608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:08.402637+0000","last_change":"2024-09-12T00:35:54.015222+0000","last_active":"2024-09-12T01:21:08.402637+0000","last_peered":"2024-09-12T01:21:08.402637+0000","last_clean":"2024-09-12T01:21:08.402637+0000","last_became_active":"2024-09-12T00:35:54.014699+0000","last_became_peered":"2024-09-12T00:35:54.014699+0000","last_unstale":"2024-09-12T01:21:08.402637+0000","last_undegraded":"2024-09-12T01:21:08.402637+0000","last_fullsized":"2024-09-12T01:21:08.402637+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:06.666673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1113,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":127,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'102","reported_seq":698,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.470217+0000","last_change":"2024-09-12T00:35:45.943991+0000","last_active":"2024-09-12T01:19:08.470217+0000","last_peered":"2024-09-12T01:19:08.470217+0000","last_clean":"2024-09-12T01:19:08.470217+0000","last_became_active":"2024-09-12T00:35:45.942032+0000","last_became_peered":"2024-09-12T00:35:45.942032+0000","last_unstale":"2024-09-12T01:19:08.470217+0000","last_undegraded":"2024-09-12T01:19:08.470217+0000","last_fullsized":"2024-09-12T01:19:08.470217+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:52.127080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":475,"num_read_kb":403,"num_write":145,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'250","reported_seq":870,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:55.942085+0000","last_change":"2024-09-12T00:35:43.954091+0000","last_active":"2024-09-12T01:19:55.942085+0000","last_peered":"2024-09-12T01:19:55.942085+0000","last_clean":"2024-09-12T01:19:55.942085+0000","last_became_active":"2024-09-12T00:35:43.953619+0000","last_became_peered":"2024-09-12T00:35:43.953619+0000","last_unstale":"2024-09-12T01:19:55.942085+0000","last_undegraded":"2024-09-12T01:19:55.942085+0000","last_fullsized":"2024-09-12T01:19:55.942085+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:57.329602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6434671,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":350,"num_read_kb":24303,"num_write":895,"num_write_kb":33018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":517,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:53.572551+0000","last_change":"2024-09-12T00:35:31.699143+0000","last_active":"2024-09-12T01:18:53.572551+0000","last_peered":"2024-09-12T01:18:53.572551+0000","last_clean":"2024-09-12T01:18:53.572551+0000","last_became_active":"2024-09-12T00:35:29.671727+0000","last_became_peered":"2024-09-12T00:35:29.671727+0000","last_unstale":"2024-09-12T01:18:53.572551+0000","last_undegraded":"2024-09-12T01:18:53.572551+0000","last_fullsized":"2024-09-12T01:18:53.572551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:24.616311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010553139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.555547+0000","last_change":"2024-09-12T00:35:47.937179+0000","last_active":"2024-09-12T01:19:32.555547+0000","last_peered":"2024-09-12T01:19:32.555547+0000","last_clean":"2024-09-12T01:19:32.555547+0000","last_became_active":"2024-09-12T00:35:47.936452+0000","last_became_peered":"2024-09-12T00:35:47.936452+0000","last_unstale":"2024-09-12T01:19:32.555547+0000","last_undegraded":"2024-09-12T01:19:32.555547+0000","last_fullsized":"2024-09-12T01:19:32.555547+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:33.795481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'113","reported_seq":658,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.557003+0000","last_change":"2024-09-12T00:35:49.941635+0000","last_active":"2024-09-12T01:19:37.557003+0000","last_peered":"2024-09-12T01:19:37.557003+0000","last_clean":"2024-09-12T01:19:37.557003+0000","last_became_active":"2024-09-12T00:35:49.940788+0000","last_became_peered":"2024-09-12T00:35:49.940788+0000","last_unstale":"2024-09-12T01:19:37.557003+0000","last_undegraded":"2024-09-12T01:19:37.557003+0000","last_fullsized":"2024-09-12T01:19:37.557003+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:50.095723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'785","reported_seq":2412,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.659942+0000","last_change":"2024-09-12T00:35:51.980717+0000","last_active":"2024-09-12T01:21:25.659942+0000","last_peered":"2024-09-12T01:21:25.659942+0000","last_clean":"2024-09-12T01:21:25.659942+0000","last_became_active":"2024-09-12T00:35:51.979997+0000","last_became_peered":"2024-09-12T00:35:51.979997+0000","last_unstale":"2024-09-12T01:21:25.659942+0000","last_undegraded":"2024-09-12T01:21:25.659942+0000","last_fullsized":"2024-09-12T01:21:25.659942+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:15.785752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'278","reported_seq":795,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:36.375145+0000","last_change":"2024-09-12T00:35:53.993708+0000","last_active":"2024-09-12T01:19:36.375145+0000","last_peered":"2024-09-12T01:19:36.375145+0000","last_clean":"2024-09-12T01:19:36.375145+0000","last_became_active":"2024-09-12T00:35:53.992431+0000","last_became_peered":"2024-09-12T00:35:53.992431+0000","last_unstale":"2024-09-12T01:19:36.375145+0000","last_undegraded":"2024-09-12T01:19:36.375145+0000","last_fullsized":"2024-09-12T01:19:36.375145+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:35.605076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":344,"num_read_kb":342,"num_write":602,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'372","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.555503+0000","last_change":"2024-09-12T00:35:45.929519+0000","last_active":"2024-09-12T01:19:32.555503+0000","last_peered":"2024-09-12T01:19:32.555503+0000","last_clean":"2024-09-12T01:19:32.555503+0000","last_became_active":"2024-09-12T00:35:45.928789+0000","last_became_peered":"2024-09-12T00:35:45.928789+0000","last_unstale":"2024-09-12T01:19:32.555503+0000","last_undegraded":"2024-09-12T01:19:32.555503+0000","last_fullsized":"2024-09-12T01:19:32.555503+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:09.582521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1634,"num_read_kb":1297,"num_write":639,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'294","reported_seq":971,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:57.902836+0000","last_change":"2024-09-12T00:35:43.933310+0000","last_active":"2024-09-12T01:19:57.902836+0000","last_peered":"2024-09-12T01:19:57.902836+0000","last_clean":"2024-09-12T01:19:57.902836+0000","last_became_active":"2024-09-12T00:35:43.932994+0000","last_became_peered":"2024-09-12T00:35:43.932994+0000","last_unstale":"2024-09-12T01:19:57.902836+0000","last_undegraded":"2024-09-12T01:19:57.902836+0000","last_fullsized":"2024-09-12T01:19:57.902836+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:30.435523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6651904,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":558,"num_read_kb":1635,"num_write":1104,"num_write_kb":36329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:52.554359+0000","last_change":"2024-09-12T00:35:31.686791+0000","last_active":"2024-09-12T01:18:52.554359+0000","last_peered":"2024-09-12T01:18:52.554359+0000","last_clean":"2024-09-12T01:18:52.554359+0000","last_became_active":"2024-09-12T00:35:29.670571+0000","last_became_peered":"2024-09-12T00:35:29.670571+0000","last_unstale":"2024-09-12T01:18:52.554359+0000","last_undegraded":"2024-09-12T01:18:52.554359+0000","last_fullsized":"2024-09-12T01:18:52.554359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:53.106651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012596770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:58.574739+0000","last_change":"2024-09-12T00:35:47.934122+0000","last_active":"2024-09-12T01:17:58.574739+0000","last_peered":"2024-09-12T01:17:58.574739+0000","last_clean":"2024-09-12T01:17:58.574739+0000","last_became_active":"2024-09-12T00:35:47.933798+0000","last_became_peered":"2024-09-12T00:35:47.933798+0000","last_unstale":"2024-09-12T01:17:58.574739+0000","last_undegraded":"2024-09-12T01:17:58.574739+0000","last_fullsized":"2024-09-12T01:17:58.574739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:45.253346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'710","reported_seq":1419,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.318962+0000","last_change":"2024-09-12T00:35:50.029172+0000","last_active":"2024-09-12T01:21:25.318962+0000","last_peered":"2024-09-12T01:21:25.318962+0000","last_clean":"2024-09-12T01:21:25.318962+0000","last_became_active":"2024-09-12T00:35:50.028341+0000","last_became_peered":"2024-09-12T00:35:50.028341+0000","last_unstale":"2024-09-12T01:21:25.318962+0000","last_undegraded":"2024-09-12T01:21:25.318962+0000","last_fullsized":"2024-09-12T01:21:25.318962+0000","mapping_epoch":30,"log_start":"265'600","ondisk_log_start":"265'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":600,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:00.896912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167860,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1273,"num_read_kb":2719,"num_write":1050,"num_write_kb":877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:38.599116+0000","last_change":"2024-09-12T00:35:51.975754+0000","last_active":"2024-09-12T01:19:38.599116+0000","last_peered":"2024-09-12T01:19:38.599116+0000","last_clean":"2024-09-12T01:19:38.599116+0000","last_became_active":"2024-09-12T00:35:51.974473+0000","last_became_peered":"2024-09-12T00:35:51.974473+0000","last_unstale":"2024-09-12T01:19:38.599116+0000","last_undegraded":"2024-09-12T01:19:38.599116+0000","last_fullsized":"2024-09-12T01:19:38.599116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:18.151442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'108","reported_seq":610,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:09.188058+0000","last_change":"2024-09-12T00:35:53.996281+0000","last_active":"2024-09-12T01:19:09.188058+0000","last_peered":"2024-09-12T01:19:09.188058+0000","last_clean":"2024-09-12T01:19:09.188058+0000","last_became_active":"2024-09-12T00:35:53.995431+0000","last_became_peered":"2024-09-12T00:35:53.995431+0000","last_unstale":"2024-09-12T01:19:09.188058+0000","last_undegraded":"2024-09-12T01:19:09.188058+0000","last_fullsized":"2024-09-12T01:19:09.188058+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:23.854939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":133,"num_write":267,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'116","reported_seq":666,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:24.501863+0000","last_change":"2024-09-12T00:35:54.003023+0000","last_active":"2024-09-12T01:21:24.501863+0000","last_peered":"2024-09-12T01:21:24.501863+0000","last_clean":"2024-09-12T01:21:24.501863+0000","last_became_active":"2024-09-12T00:35:54.002052+0000","last_became_peered":"2024-09-12T00:35:54.002052+0000","last_unstale":"2024-09-12T01:21:24.501863+0000","last_undegraded":"2024-09-12T01:21:24.501863+0000","last_fullsized":"2024-09-12T01:21:24.501863+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:18.230366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":193,"num_write":267,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'96","reported_seq":682,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.975864+0000","last_change":"2024-09-12T00:35:45.954536+0000","last_active":"2024-09-12T01:18:18.975864+0000","last_peered":"2024-09-12T01:18:18.975864+0000","last_clean":"2024-09-12T01:18:18.975864+0000","last_became_active":"2024-09-12T00:35:45.954079+0000","last_became_peered":"2024-09-12T00:35:45.954079+0000","last_unstale":"2024-09-12T01:18:18.975864+0000","last_undegraded":"2024-09-12T01:18:18.975864+0000","last_fullsized":"2024-09-12T01:18:18.975864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:37.716853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":455,"num_read_kb":391,"num_write":154,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'373","reported_seq":1071,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:45.549136+0000","last_change":"2024-09-12T00:35:43.948592+0000","last_active":"2024-09-12T01:19:45.549136+0000","last_peered":"2024-09-12T01:19:45.549136+0000","last_clean":"2024-09-12T01:19:45.549136+0000","last_became_active":"2024-09-12T00:35:43.947940+0000","last_became_peered":"2024-09-12T00:35:43.947940+0000","last_unstale":"2024-09-12T01:19:45.549136+0000","last_undegraded":"2024-09-12T01:19:45.549136+0000","last_fullsized":"2024-09-12T01:19:45.549136+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:06.011716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5293613,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":737,"num_read_kb":4159,"num_write":1205,"num_write_kb":17308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:48.555127+0000","last_change":"2024-09-12T00:35:47.930161+0000","last_active":"2024-09-12T01:17:48.555127+0000","last_peered":"2024-09-12T01:17:48.555127+0000","last_clean":"2024-09-12T01:17:48.555127+0000","last_became_active":"2024-09-12T00:35:47.929844+0000","last_became_peered":"2024-09-12T00:35:47.929844+0000","last_unstale":"2024-09-12T01:17:48.555127+0000","last_undegraded":"2024-09-12T01:17:48.555127+0000","last_fullsized":"2024-09-12T01:17:48.555127+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:35.960740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'282","reported_seq":853,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:13.607469+0000","last_change":"2024-09-12T00:35:49.947886+0000","last_active":"2024-09-12T01:20:13.607469+0000","last_peered":"2024-09-12T01:20:13.607469+0000","last_clean":"2024-09-12T01:20:13.607469+0000","last_became_active":"2024-09-12T00:35:49.947136+0000","last_became_peered":"2024-09-12T00:35:49.947136+0000","last_unstale":"2024-09-12T01:20:13.607469+0000","last_undegraded":"2024-09-12T01:20:13.607469+0000","last_fullsized":"2024-09-12T01:20:13.607469+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:30.278867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55066,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":946,"num_write":382,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:53.573483+0000","last_change":"2024-09-12T00:35:51.980791+0000","last_active":"2024-09-12T01:17:53.573483+0000","last_peered":"2024-09-12T01:17:53.573483+0000","last_clean":"2024-09-12T01:17:53.573483+0000","last_became_active":"2024-09-12T00:35:51.980092+0000","last_became_peered":"2024-09-12T00:35:51.980092+0000","last_unstale":"2024-09-12T01:17:53.573483+0000","last_undegraded":"2024-09-12T01:17:53.573483+0000","last_fullsized":"2024-09-12T01:17:53.573483+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:52.492457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'134","reported_seq":633,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:20.655512+0000","last_change":"2024-09-12T00:35:53.993259+0000","last_active":"2024-09-12T01:20:20.655512+0000","last_peered":"2024-09-12T01:20:20.655512+0000","last_clean":"2024-09-12T01:20:20.655512+0000","last_became_active":"2024-09-12T00:35:53.992579+0000","last_became_peered":"2024-09-12T00:35:53.992579+0000","last_unstale":"2024-09-12T01:20:20.655512+0000","last_undegraded":"2024-09-12T01:20:20.655512+0000","last_fullsized":"2024-09-12T01:20:20.655512+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:44.006963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":139,"num_write":341,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'161","reported_seq":745,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:03.701304+0000","last_change":"2024-09-12T00:35:45.958044+0000","last_active":"2024-09-12T01:20:03.701304+0000","last_peered":"2024-09-12T01:20:03.701304+0000","last_clean":"2024-09-12T01:20:03.701304+0000","last_became_active":"2024-09-12T00:35:45.957614+0000","last_became_peered":"2024-09-12T00:35:45.957614+0000","last_unstale":"2024-09-12T01:20:03.701304+0000","last_undegraded":"2024-09-12T01:20:03.701304+0000","last_fullsized":"2024-09-12T01:20:03.701304+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:29.459571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":661,"num_read_kb":539,"num_write":259,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'299","reported_seq":896,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:18.773125+0000","last_change":"2024-09-12T00:36:17.270183+0000","last_active":"2024-09-12T01:20:18.773125+0000","last_peered":"2024-09-12T01:20:18.773125+0000","last_clean":"2024-09-12T01:20:18.773125+0000","last_became_active":"2024-09-12T00:36:17.269377+0000","last_became_peered":"2024-09-12T00:36:17.269377+0000","last_unstale":"2024-09-12T01:20:18.773125+0000","last_undegraded":"2024-09-12T01:20:18.773125+0000","last_fullsized":"2024-09-12T01:20:18.773125+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:25.952652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8732019,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":453,"num_read_kb":25436,"num_write":1204,"num_write_kb":33386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:48.572327+0000","last_change":"2024-09-12T00:35:47.941929+0000","last_active":"2024-09-12T01:17:48.572327+0000","last_peered":"2024-09-12T01:17:48.572327+0000","last_clean":"2024-09-12T01:17:48.572327+0000","last_became_active":"2024-09-12T00:35:47.941493+0000","last_became_peered":"2024-09-12T00:35:47.941493+0000","last_unstale":"2024-09-12T01:17:48.572327+0000","last_undegraded":"2024-09-12T01:17:48.572327+0000","last_fullsized":"2024-09-12T01:17:48.572327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:06.034904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'46","reported_seq":542,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:09.885099+0000","last_change":"2024-09-12T00:35:49.950088+0000","last_active":"2024-09-12T01:19:09.885099+0000","last_peered":"2024-09-12T01:19:09.885099+0000","last_clean":"2024-09-12T01:19:09.885099+0000","last_became_active":"2024-09-12T00:35:49.949331+0000","last_became_peered":"2024-09-12T00:35:49.949331+0000","last_unstale":"2024-09-12T01:19:09.885099+0000","last_undegraded":"2024-09-12T01:19:09.885099+0000","last_fullsized":"2024-09-12T01:19:09.885099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:00.112784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:52.773954+0000","last_change":"2024-09-12T00:35:51.977921+0000","last_active":"2024-09-12T01:17:52.773954+0000","last_peered":"2024-09-12T01:17:52.773954+0000","last_clean":"2024-09-12T01:17:52.773954+0000","last_became_active":"2024-09-12T00:35:51.977211+0000","last_became_peered":"2024-09-12T00:35:51.977211+0000","last_unstale":"2024-09-12T01:17:52.773954+0000","last_undegraded":"2024-09-12T01:17:52.773954+0000","last_fullsized":"2024-09-12T01:17:52.773954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:37.744652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'214","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.264295+0000","last_change":"2024-09-12T00:35:53.992509+0000","last_active":"2024-09-12T01:20:22.264295+0000","last_peered":"2024-09-12T01:20:22.264295+0000","last_clean":"2024-09-12T01:20:22.264295+0000","last_became_active":"2024-09-12T00:35:53.985696+0000","last_became_peered":"2024-09-12T00:35:53.985696+0000","last_unstale":"2024-09-12T01:20:22.264295+0000","last_undegraded":"2024-09-12T01:20:22.264295+0000","last_fullsized":"2024-09-12T01:20:22.264295+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:55.326440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":288,"num_read_kb":283,"num_write":478,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'116","reported_seq":720,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:36.946980+0000","last_change":"2024-09-12T00:35:45.944333+0000","last_active":"2024-09-12T01:18:36.946980+0000","last_peered":"2024-09-12T01:18:36.946980+0000","last_clean":"2024-09-12T01:18:36.946980+0000","last_became_active":"2024-09-12T00:35:45.942161+0000","last_became_peered":"2024-09-12T00:35:45.942161+0000","last_unstale":"2024-09-12T01:18:36.946980+0000","last_undegraded":"2024-09-12T01:18:36.946980+0000","last_fullsized":"2024-09-12T01:18:36.946980+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:45.930313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":566,"num_read_kb":479,"num_write":187,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'233","reported_seq":833,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:56.953706+0000","last_change":"2024-09-12T00:35:43.951301+0000","last_active":"2024-09-12T01:19:56.953706+0000","last_peered":"2024-09-12T01:19:56.953706+0000","last_clean":"2024-09-12T01:19:56.953706+0000","last_became_active":"2024-09-12T00:35:43.950660+0000","last_became_peered":"2024-09-12T00:35:43.950660+0000","last_unstale":"2024-09-12T01:19:56.953706+0000","last_undegraded":"2024-09-12T01:19:56.953706+0000","last_fullsized":"2024-09-12T01:19:56.953706+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:51.119280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134126,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":330,"num_read_kb":2177,"num_write":823,"num_write_kb":8684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:47.772763+0000","last_change":"2024-09-12T00:35:47.946510+0000","last_active":"2024-09-12T01:17:47.772763+0000","last_peered":"2024-09-12T01:17:47.772763+0000","last_clean":"2024-09-12T01:17:47.772763+0000","last_became_active":"2024-09-12T00:35:47.945819+0000","last_became_peered":"2024-09-12T00:35:47.945819+0000","last_unstale":"2024-09-12T01:17:47.772763+0000","last_undegraded":"2024-09-12T01:17:47.772763+0000","last_fullsized":"2024-09-12T01:17:47.772763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:13.092089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'343","reported_seq":924,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:24.506055+0000","last_change":"2024-09-12T00:35:49.955755+0000","last_active":"2024-09-12T01:21:24.506055+0000","last_peered":"2024-09-12T01:21:24.506055+0000","last_clean":"2024-09-12T01:21:24.506055+0000","last_became_active":"2024-09-12T00:35:49.954646+0000","last_became_peered":"2024-09-12T00:35:49.954646+0000","last_unstale":"2024-09-12T01:21:24.506055+0000","last_undegraded":"2024-09-12T01:21:24.506055+0000","last_fullsized":"2024-09-12T01:21:24.506055+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:59.408731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85101,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":561,"num_read_kb":1185,"num_write":466,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:52.540778+0000","last_change":"2024-09-12T00:35:51.974798+0000","last_active":"2024-09-12T01:17:52.540778+0000","last_peered":"2024-09-12T01:17:52.540778+0000","last_clean":"2024-09-12T01:17:52.540778+0000","last_became_active":"2024-09-12T00:35:51.973993+0000","last_became_peered":"2024-09-12T00:35:51.973993+0000","last_unstale":"2024-09-12T01:17:52.540778+0000","last_undegraded":"2024-09-12T01:17:52.540778+0000","last_fullsized":"2024-09-12T01:17:52.540778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:02.005519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'103","reported_seq":609,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:56.474802+0000","last_change":"2024-09-12T00:35:54.001932+0000","last_active":"2024-09-12T01:19:56.474802+0000","last_peered":"2024-09-12T01:19:56.474802+0000","last_clean":"2024-09-12T01:19:56.474802+0000","last_became_active":"2024-09-12T00:35:54.001337+0000","last_became_peered":"2024-09-12T00:35:54.001337+0000","last_unstale":"2024-09-12T01:19:56.474802+0000","last_undegraded":"2024-09-12T01:19:56.474802+0000","last_fullsized":"2024-09-12T01:19:56.474802+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:46.072438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":126,"num_write":245,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'4114","reported_seq":4735,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:05.320945+0000","last_change":"2024-09-12T00:35:45.940670+0000","last_active":"2024-09-12T01:20:05.320945+0000","last_peered":"2024-09-12T01:20:05.320945+0000","last_clean":"2024-09-12T01:20:05.320945+0000","last_became_active":"2024-09-12T00:35:45.938175+0000","last_became_peered":"2024-09-12T00:35:45.938175+0000","last_unstale":"2024-09-12T01:20:05.320945+0000","last_undegraded":"2024-09-12T01:20:05.320945+0000","last_fullsized":"2024-09-12T01:20:05.320945+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:06.702726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16557,"num_read_kb":13901,"num_write":6164,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'250","reported_seq":853,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:56.953843+0000","last_change":"2024-09-12T00:35:43.935984+0000","last_active":"2024-09-12T01:19:56.953843+0000","last_peered":"2024-09-12T01:19:56.953843+0000","last_clean":"2024-09-12T01:19:56.953843+0000","last_became_active":"2024-09-12T00:35:43.935194+0000","last_became_peered":"2024-09-12T00:35:43.935194+0000","last_unstale":"2024-09-12T01:19:56.953843+0000","last_undegraded":"2024-09-12T01:19:56.953843+0000","last_fullsized":"2024-09-12T01:19:56.953843+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:19.822537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992993,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":361,"num_read_kb":10373,"num_write":921,"num_write_kb":15779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:47.539641+0000","last_change":"2024-09-12T00:35:47.945331+0000","last_active":"2024-09-12T01:17:47.539641+0000","last_peered":"2024-09-12T01:17:47.539641+0000","last_clean":"2024-09-12T01:17:47.539641+0000","last_became_active":"2024-09-12T00:35:47.944477+0000","last_became_peered":"2024-09-12T00:35:47.944477+0000","last_unstale":"2024-09-12T01:17:47.539641+0000","last_undegraded":"2024-09-12T01:17:47.539641+0000","last_fullsized":"2024-09-12T01:17:47.539641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:59.438695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'269","reported_seq":830,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:12.806685+0000","last_change":"2024-09-12T00:35:49.942723+0000","last_active":"2024-09-12T01:20:12.806685+0000","last_peered":"2024-09-12T01:20:12.806685+0000","last_clean":"2024-09-12T01:20:12.806685+0000","last_became_active":"2024-09-12T00:35:49.941948+0000","last_became_peered":"2024-09-12T00:35:49.941948+0000","last_unstale":"2024-09-12T01:20:12.806685+0000","last_undegraded":"2024-09-12T01:20:12.806685+0000","last_fullsized":"2024-09-12T01:20:12.806685+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:32.893865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58647,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":439,"num_read_kb":933,"num_write":366,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":482,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:53.553514+0000","last_change":"2024-09-12T00:35:51.975893+0000","last_active":"2024-09-12T01:17:53.553514+0000","last_peered":"2024-09-12T01:17:53.553514+0000","last_clean":"2024-09-12T01:17:53.553514+0000","last_became_active":"2024-09-12T00:35:51.975124+0000","last_became_peered":"2024-09-12T00:35:51.975124+0000","last_unstale":"2024-09-12T01:17:53.553514+0000","last_undegraded":"2024-09-12T01:17:53.553514+0000","last_fullsized":"2024-09-12T01:17:53.553514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:49.874523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'251","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:55.418732+0000","last_change":"2024-09-12T00:35:45.942083+0000","last_active":"2024-09-12T01:19:55.418732+0000","last_peered":"2024-09-12T01:19:55.418732+0000","last_clean":"2024-09-12T01:19:55.418732+0000","last_became_active":"2024-09-12T00:35:45.941357+0000","last_became_peered":"2024-09-12T00:35:45.941357+0000","last_unstale":"2024-09-12T01:19:55.418732+0000","last_undegraded":"2024-09-12T01:19:55.418732+0000","last_fullsized":"2024-09-12T01:19:55.418732+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:58.892422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1115,"num_read_kb":918,"num_write":405,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'241","reported_seq":860,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:20.375774+0000","last_change":"2024-09-12T00:35:43.933290+0000","last_active":"2024-09-12T01:21:20.375774+0000","last_peered":"2024-09-12T01:21:20.375774+0000","last_clean":"2024-09-12T01:21:20.375774+0000","last_became_active":"2024-09-12T00:35:43.933037+0000","last_became_peered":"2024-09-12T00:35:43.933037+0000","last_unstale":"2024-09-12T01:21:20.375774+0000","last_undegraded":"2024-09-12T01:21:20.375774+0000","last_fullsized":"2024-09-12T01:21:20.375774+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:43.925660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1774101,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":413,"num_read_kb":7309,"num_write":925,"num_write_kb":23054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"36'3","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.232335+0000","last_change":"2024-09-12T00:35:47.942588+0000","last_active":"2024-09-12T01:21:25.232335+0000","last_peered":"2024-09-12T01:21:25.232335+0000","last_clean":"2024-09-12T01:21:25.232335+0000","last_became_active":"2024-09-12T00:35:47.941749+0000","last_became_peered":"2024-09-12T00:35:47.941749+0000","last_unstale":"2024-09-12T01:21:25.232335+0000","last_undegraded":"2024-09-12T01:21:25.232335+0000","last_fullsized":"2024-09-12T01:21:25.232335+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:24.632274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'496","reported_seq":1117,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.300859+0000","last_change":"2024-09-12T00:35:49.948724+0000","last_active":"2024-09-12T01:21:25.300859+0000","last_peered":"2024-09-12T01:21:25.300859+0000","last_clean":"2024-09-12T01:21:25.300859+0000","last_became_active":"2024-09-12T00:35:49.947963+0000","last_became_peered":"2024-09-12T00:35:49.947963+0000","last_unstale":"2024-09-12T01:21:25.300859+0000","last_undegraded":"2024-09-12T01:21:25.300859+0000","last_fullsized":"2024-09-12T01:21:25.300859+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:23.048505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121072,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":889,"num_read_kb":1919,"num_write":780,"num_write_kb":707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.553625+0000","last_change":"2024-09-12T00:35:51.968910+0000","last_active":"2024-09-12T01:18:23.553625+0000","last_peered":"2024-09-12T01:18:23.553625+0000","last_clean":"2024-09-12T01:18:23.553625+0000","last_became_active":"2024-09-12T00:35:51.968209+0000","last_became_peered":"2024-09-12T00:35:51.968209+0000","last_unstale":"2024-09-12T01:18:23.553625+0000","last_undegraded":"2024-09-12T01:18:23.553625+0000","last_fullsized":"2024-09-12T01:18:23.553625+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:40.274641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'158","reported_seq":653,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.097347+0000","last_change":"2024-09-12T00:35:54.013532+0000","last_active":"2024-09-12T01:20:22.097347+0000","last_peered":"2024-09-12T01:20:22.097347+0000","last_clean":"2024-09-12T01:20:22.097347+0000","last_became_active":"2024-09-12T00:35:54.012958+0000","last_became_peered":"2024-09-12T00:35:54.012958+0000","last_unstale":"2024-09-12T01:20:22.097347+0000","last_undegraded":"2024-09-12T01:20:22.097347+0000","last_fullsized":"2024-09-12T01:20:22.097347+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:34.515746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1092,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":166,"num_read_kb":178,"num_write":351,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'60","reported_seq":613,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:09.194519+0000","last_change":"2024-09-12T00:35:45.946291+0000","last_active":"2024-09-12T01:19:09.194519+0000","last_peered":"2024-09-12T01:19:09.194519+0000","last_clean":"2024-09-12T01:19:09.194519+0000","last_became_active":"2024-09-12T00:35:45.945952+0000","last_became_peered":"2024-09-12T00:35:45.945952+0000","last_unstale":"2024-09-12T01:19:09.194519+0000","last_undegraded":"2024-09-12T01:19:09.194519+0000","last_fullsized":"2024-09-12T01:19:09.194519+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:19.912313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":234,"num_write":86,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'282","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.577971+0000","last_change":"2024-09-12T00:35:43.930088+0000","last_active":"2024-09-12T01:19:18.577971+0000","last_peered":"2024-09-12T01:19:18.577971+0000","last_clean":"2024-09-12T01:19:18.577971+0000","last_became_active":"2024-09-12T00:35:43.928779+0000","last_became_peered":"2024-09-12T00:35:43.928779+0000","last_unstale":"2024-09-12T01:19:18.577971+0000","last_undegraded":"2024-09-12T01:19:18.577971+0000","last_fullsized":"2024-09-12T01:19:18.577971+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:27.466245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15875618,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":431,"num_read_kb":67515,"num_write":1080,"num_write_kb":41697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.562535+0000","last_change":"2024-09-12T00:35:47.944821+0000","last_active":"2024-09-12T01:19:32.562535+0000","last_peered":"2024-09-12T01:19:32.562535+0000","last_clean":"2024-09-12T01:19:32.562535+0000","last_became_active":"2024-09-12T00:35:47.944056+0000","last_became_peered":"2024-09-12T00:35:47.944056+0000","last_unstale":"2024-09-12T01:19:32.562535+0000","last_undegraded":"2024-09-12T01:19:32.562535+0000","last_fullsized":"2024-09-12T01:19:32.562535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:34.718996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'265","reported_seq":840,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:52.815807+0000","last_change":"2024-09-12T00:35:49.946966+0000","last_active":"2024-09-12T01:20:52.815807+0000","last_peered":"2024-09-12T01:20:52.815807+0000","last_clean":"2024-09-12T01:20:52.815807+0000","last_became_active":"2024-09-12T00:35:49.946226+0000","last_became_peered":"2024-09-12T00:35:49.946226+0000","last_unstale":"2024-09-12T01:20:52.815807+0000","last_undegraded":"2024-09-12T01:20:52.815807+0000","last_fullsized":"2024-09-12T01:20:52.815807+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:45.810230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51987,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":448,"num_read_kb":873,"num_write":370,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":483,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.562310+0000","last_change":"2024-09-12T00:35:51.970897+0000","last_active":"2024-09-12T01:18:23.562310+0000","last_peered":"2024-09-12T01:18:23.562310+0000","last_clean":"2024-09-12T01:18:23.562310+0000","last_became_active":"2024-09-12T00:35:51.963735+0000","last_became_peered":"2024-09-12T00:35:51.963735+0000","last_unstale":"2024-09-12T01:18:23.562310+0000","last_undegraded":"2024-09-12T01:18:23.562310+0000","last_fullsized":"2024-09-12T01:18:23.562310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:20.013004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'196","reported_seq":702,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.113351+0000","last_change":"2024-09-12T00:35:53.991284+0000","last_active":"2024-09-12T01:20:22.113351+0000","last_peered":"2024-09-12T01:20:22.113351+0000","last_clean":"2024-09-12T01:20:22.113351+0000","last_became_active":"2024-09-12T00:35:53.990488+0000","last_became_peered":"2024-09-12T00:35:53.990488+0000","last_unstale":"2024-09-12T01:20:22.113351+0000","last_undegraded":"2024-09-12T01:20:22.113351+0000","last_fullsized":"2024-09-12T01:20:22.113351+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:57.849221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1821,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":235,"num_read_kb":229,"num_write":573,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'191","reported_seq":788,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:06.954169+0000","last_change":"2024-09-12T00:35:45.945163+0000","last_active":"2024-09-12T01:20:06.954169+0000","last_peered":"2024-09-12T01:20:06.954169+0000","last_clean":"2024-09-12T01:20:06.954169+0000","last_became_active":"2024-09-12T00:35:45.940529+0000","last_became_peered":"2024-09-12T00:35:45.940529+0000","last_unstale":"2024-09-12T01:20:06.954169+0000","last_undegraded":"2024-09-12T01:20:06.954169+0000","last_fullsized":"2024-09-12T01:20:06.954169+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:51.722964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":840,"num_read_kb":692,"num_write":286,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'278","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:27.896787+0000","last_change":"2024-09-12T00:35:43.928101+0000","last_active":"2024-09-12T01:19:27.896787+0000","last_peered":"2024-09-12T01:19:27.896787+0000","last_clean":"2024-09-12T01:19:27.896787+0000","last_became_active":"2024-09-12T00:35:43.927426+0000","last_became_peered":"2024-09-12T00:35:43.927426+0000","last_unstale":"2024-09-12T01:19:27.896787+0000","last_undegraded":"2024-09-12T01:19:27.896787+0000","last_fullsized":"2024-09-12T01:19:27.896787+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:04.964381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10835840,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":759,"num_read_kb":46781,"num_write":1048,"num_write_kb":16393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.739497+0000","last_change":"2024-09-12T00:35:47.934105+0000","last_active":"2024-09-12T01:18:17.739497+0000","last_peered":"2024-09-12T01:18:17.739497+0000","last_clean":"2024-09-12T01:18:17.739497+0000","last_became_active":"2024-09-12T00:35:47.933189+0000","last_became_peered":"2024-09-12T00:35:47.933189+0000","last_unstale":"2024-09-12T01:18:17.739497+0000","last_undegraded":"2024-09-12T01:18:17.739497+0000","last_fullsized":"2024-09-12T01:18:17.739497+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:01.418064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'279","reported_seq":853,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.344895+0000","last_change":"2024-09-12T00:35:50.030204+0000","last_active":"2024-09-12T01:21:25.344895+0000","last_peered":"2024-09-12T01:21:25.344895+0000","last_clean":"2024-09-12T01:21:25.344895+0000","last_became_active":"2024-09-12T00:35:50.029579+0000","last_became_peered":"2024-09-12T00:35:50.029579+0000","last_unstale":"2024-09-12T01:21:25.344895+0000","last_undegraded":"2024-09-12T01:21:25.344895+0000","last_fullsized":"2024-09-12T01:21:25.344895+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:54.577958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57774,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":464,"num_read_kb":954,"num_write":384,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:58.557153+0000","last_change":"2024-09-12T00:35:51.972390+0000","last_active":"2024-09-12T01:17:58.557153+0000","last_peered":"2024-09-12T01:17:58.557153+0000","last_clean":"2024-09-12T01:17:58.557153+0000","last_became_active":"2024-09-12T00:35:51.971682+0000","last_became_peered":"2024-09-12T00:35:51.971682+0000","last_unstale":"2024-09-12T01:17:58.557153+0000","last_undegraded":"2024-09-12T01:17:58.557153+0000","last_fullsized":"2024-09-12T01:17:58.557153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:54.514575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'102","reported_seq":593,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.357123+0000","last_change":"2024-09-12T00:35:53.996274+0000","last_active":"2024-09-12T01:21:25.357123+0000","last_peered":"2024-09-12T01:21:25.357123+0000","last_clean":"2024-09-12T01:21:25.357123+0000","last_became_active":"2024-09-12T00:35:53.995464+0000","last_became_peered":"2024-09-12T00:35:53.995464+0000","last_unstale":"2024-09-12T01:21:25.357123+0000","last_undegraded":"2024-09-12T01:21:25.357123+0000","last_fullsized":"2024-09-12T01:21:25.357123+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:47.747130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":101,"num_write":247,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'297","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:54.778656+0000","last_change":"2024-09-12T00:35:45.947620+0000","last_active":"2024-09-12T01:19:54.778656+0000","last_peered":"2024-09-12T01:19:54.778656+0000","last_clean":"2024-09-12T01:19:54.778656+0000","last_became_active":"2024-09-12T00:35:45.947244+0000","last_became_peered":"2024-09-12T00:35:45.947244+0000","last_unstale":"2024-09-12T01:19:54.778656+0000","last_undegraded":"2024-09-12T01:19:54.778656+0000","last_fullsized":"2024-09-12T01:19:54.778656+0000","mapping_epoch":26,"log_start":"251'200","ondisk_log_start":"251'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:20.082192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1444,"num_read_kb":1250,"num_write":453,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'294","reported_seq":1050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:09.077004+0000","last_change":"2024-09-12T00:35:43.947838+0000","last_active":"2024-09-12T01:20:09.077004+0000","last_peered":"2024-09-12T01:20:09.077004+0000","last_clean":"2024-09-12T01:20:09.077004+0000","last_became_active":"2024-09-12T00:35:43.947420+0000","last_became_peered":"2024-09-12T00:35:43.947420+0000","last_unstale":"2024-09-12T01:20:09.077004+0000","last_undegraded":"2024-09-12T01:20:09.077004+0000","last_fullsized":"2024-09-12T01:20:09.077004+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:47.159137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12868444,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":662,"num_read_kb":19884,"num_write":1101,"num_write_kb":29921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.561198+0000","last_change":"2024-09-12T00:35:47.935965+0000","last_active":"2024-09-12T01:18:18.561198+0000","last_peered":"2024-09-12T01:18:18.561198+0000","last_clean":"2024-09-12T01:18:18.561198+0000","last_became_active":"2024-09-12T00:35:47.935440+0000","last_became_peered":"2024-09-12T00:35:47.935440+0000","last_unstale":"2024-09-12T01:18:18.561198+0000","last_undegraded":"2024-09-12T01:18:18.561198+0000","last_fullsized":"2024-09-12T01:18:18.561198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:47.836745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'90","reported_seq":619,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:57.735007+0000","last_change":"2024-09-12T00:35:50.026452+0000","last_active":"2024-09-12T01:17:57.735007+0000","last_peered":"2024-09-12T01:17:57.735007+0000","last_clean":"2024-09-12T01:17:57.735007+0000","last_became_active":"2024-09-12T00:35:50.025145+0000","last_became_peered":"2024-09-12T00:35:50.025145+0000","last_unstale":"2024-09-12T01:17:57.735007+0000","last_undegraded":"2024-09-12T01:17:57.735007+0000","last_fullsized":"2024-09-12T01:17:57.735007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:49.606844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":97,"num_read_kb":88,"num_write":76,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'769","reported_seq":2387,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.645887+0000","last_change":"2024-09-12T00:35:51.968551+0000","last_active":"2024-09-12T01:21:25.645887+0000","last_peered":"2024-09-12T01:21:25.645887+0000","last_clean":"2024-09-12T01:21:25.645887+0000","last_became_active":"2024-09-12T00:35:51.967797+0000","last_became_peered":"2024-09-12T00:35:51.967797+0000","last_unstale":"2024-09-12T01:21:25.645887+0000","last_undegraded":"2024-09-12T01:21:25.645887+0000","last_fullsized":"2024-09-12T01:21:25.645887+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:42.194060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'103","reported_seq":603,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.236409+0000","last_change":"2024-09-12T00:35:54.003014+0000","last_active":"2024-09-12T01:20:22.236409+0000","last_peered":"2024-09-12T01:20:22.236409+0000","last_clean":"2024-09-12T01:20:22.236409+0000","last_became_active":"2024-09-12T00:35:54.002318+0000","last_became_peered":"2024-09-12T00:35:54.002318+0000","last_unstale":"2024-09-12T01:20:22.236409+0000","last_undegraded":"2024-09-12T01:20:22.236409+0000","last_fullsized":"2024-09-12T01:20:22.236409+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:45.348319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":119,"num_write":243,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'135","reported_seq":740,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.739424+0000","last_change":"2024-09-12T00:35:45.936713+0000","last_active":"2024-09-12T01:18:17.739424+0000","last_peered":"2024-09-12T01:18:17.739424+0000","last_clean":"2024-09-12T01:18:17.739424+0000","last_became_active":"2024-09-12T00:35:45.935880+0000","last_became_peered":"2024-09-12T00:35:45.935880+0000","last_unstale":"2024-09-12T01:18:17.739424+0000","last_undegraded":"2024-09-12T01:18:17.739424+0000","last_fullsized":"2024-09-12T01:18:17.739424+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:29.055252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":617,"num_read_kb":515,"num_write":204,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'292","reported_seq":934,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:36.515740+0000","last_change":"2024-09-12T00:35:43.931892+0000","last_active":"2024-09-12T01:19:36.515740+0000","last_peered":"2024-09-12T01:19:36.515740+0000","last_clean":"2024-09-12T01:19:36.515740+0000","last_became_active":"2024-09-12T00:35:43.931008+0000","last_became_peered":"2024-09-12T00:35:43.931008+0000","last_unstale":"2024-09-12T01:19:36.515740+0000","last_undegraded":"2024-09-12T01:19:36.515740+0000","last_fullsized":"2024-09-12T01:19:36.515740+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:13.452075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11191314,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":453,"num_read_kb":33271,"num_write":1148,"num_write_kb":48012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.779666+0000","last_change":"2024-09-12T00:35:47.951130+0000","last_active":"2024-09-12T01:18:17.779666+0000","last_peered":"2024-09-12T01:18:17.779666+0000","last_clean":"2024-09-12T01:18:17.779666+0000","last_became_active":"2024-09-12T00:35:47.950328+0000","last_became_peered":"2024-09-12T00:35:47.950328+0000","last_unstale":"2024-09-12T01:18:17.779666+0000","last_undegraded":"2024-09-12T01:18:17.779666+0000","last_fullsized":"2024-09-12T01:18:17.779666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:21.340191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'315","reported_seq":914,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:33.569402+0000","last_change":"2024-09-12T00:35:49.939297+0000","last_active":"2024-09-12T01:19:33.569402+0000","last_peered":"2024-09-12T01:19:33.569402+0000","last_clean":"2024-09-12T01:19:33.569402+0000","last_became_active":"2024-09-12T00:35:49.938536+0000","last_became_peered":"2024-09-12T00:35:49.938536+0000","last_unstale":"2024-09-12T01:19:33.569402+0000","last_undegraded":"2024-09-12T01:19:33.569402+0000","last_fullsized":"2024-09-12T01:19:33.569402+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:13.330863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55479,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":519,"num_read_kb":1004,"num_write":418,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":482,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:23.575502+0000","last_change":"2024-09-12T00:35:51.965185+0000","last_active":"2024-09-12T01:19:23.575502+0000","last_peered":"2024-09-12T01:19:23.575502+0000","last_clean":"2024-09-12T01:19:23.575502+0000","last_became_active":"2024-09-12T00:35:51.964446+0000","last_became_peered":"2024-09-12T00:35:51.964446+0000","last_unstale":"2024-09-12T01:19:23.575502+0000","last_undegraded":"2024-09-12T01:19:23.575502+0000","last_fullsized":"2024-09-12T01:19:23.575502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:04.163874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'136","reported_seq":648,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:20.487261+0000","last_change":"2024-09-12T00:35:53.998710+0000","last_active":"2024-09-12T01:20:20.487261+0000","last_peered":"2024-09-12T01:20:20.487261+0000","last_clean":"2024-09-12T01:20:20.487261+0000","last_became_active":"2024-09-12T00:35:53.997969+0000","last_became_peered":"2024-09-12T00:35:53.997969+0000","last_unstale":"2024-09-12T01:20:20.487261+0000","last_undegraded":"2024-09-12T01:20:20.487261+0000","last_fullsized":"2024-09-12T01:20:20.487261+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:50.127097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":591,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":213,"num_read_kb":189,"num_write":344,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'117","reported_seq":701,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:17.808530+0000","last_change":"2024-09-12T00:35:45.940384+0000","last_active":"2024-09-12T01:20:17.808530+0000","last_peered":"2024-09-12T01:20:17.808530+0000","last_clean":"2024-09-12T01:20:17.808530+0000","last_became_active":"2024-09-12T00:35:45.937597+0000","last_became_peered":"2024-09-12T00:35:45.937597+0000","last_unstale":"2024-09-12T01:20:17.808530+0000","last_undegraded":"2024-09-12T01:20:17.808530+0000","last_fullsized":"2024-09-12T01:20:17.808530+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:26.977811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":514,"num_read_kb":428,"num_write":167,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'246","reported_seq":840,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:13.314667+0000","last_change":"2024-09-12T00:35:43.914480+0000","last_active":"2024-09-12T01:19:13.314667+0000","last_peered":"2024-09-12T01:19:13.314667+0000","last_clean":"2024-09-12T01:19:13.314667+0000","last_became_active":"2024-09-12T00:35:43.913717+0000","last_became_peered":"2024-09-12T00:35:43.913717+0000","last_unstale":"2024-09-12T01:19:13.314667+0000","last_undegraded":"2024-09-12T01:19:13.314667+0000","last_fullsized":"2024-09-12T01:19:13.314667+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:01.278323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91515,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":339,"num_read_kb":6749,"num_write":873,"num_write_kb":25345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.552287+0000","last_change":"2024-09-12T00:35:47.940913+0000","last_active":"2024-09-12T01:18:18.552287+0000","last_peered":"2024-09-12T01:18:18.552287+0000","last_clean":"2024-09-12T01:18:18.552287+0000","last_became_active":"2024-09-12T00:35:47.940170+0000","last_became_peered":"2024-09-12T00:35:47.940170+0000","last_unstale":"2024-09-12T01:18:18.552287+0000","last_undegraded":"2024-09-12T01:18:18.552287+0000","last_fullsized":"2024-09-12T01:18:18.552287+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:41.868094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'271","reported_seq":834,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.288096+0000","last_change":"2024-09-12T00:35:49.954441+0000","last_active":"2024-09-12T01:21:25.288096+0000","last_peered":"2024-09-12T01:21:25.288096+0000","last_clean":"2024-09-12T01:21:25.288096+0000","last_became_active":"2024-09-12T00:35:49.952570+0000","last_became_peered":"2024-09-12T00:35:49.952570+0000","last_unstale":"2024-09-12T01:21:25.288096+0000","last_undegraded":"2024-09-12T01:21:25.288096+0000","last_fullsized":"2024-09-12T01:21:25.288096+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:31.309890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58420,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":451,"num_read_kb":947,"num_write":374,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:02.529760+0000","last_change":"2024-09-12T00:35:51.974531+0000","last_active":"2024-09-12T01:17:02.529760+0000","last_peered":"2024-09-12T01:17:02.529760+0000","last_clean":"2024-09-12T01:17:02.529760+0000","last_became_active":"2024-09-12T00:35:51.973732+0000","last_became_peered":"2024-09-12T00:35:51.973732+0000","last_unstale":"2024-09-12T01:17:02.529760+0000","last_undegraded":"2024-09-12T01:17:02.529760+0000","last_fullsized":"2024-09-12T01:17:02.529760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:28.353680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'193","reported_seq":706,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.123850+0000","last_change":"2024-09-12T00:35:54.016500+0000","last_active":"2024-09-12T01:19:37.123850+0000","last_peered":"2024-09-12T01:19:37.123850+0000","last_clean":"2024-09-12T01:19:37.123850+0000","last_became_active":"2024-09-12T00:35:54.016028+0000","last_became_peered":"2024-09-12T00:35:54.016028+0000","last_unstale":"2024-09-12T01:19:37.123850+0000","last_undegraded":"2024-09-12T01:19:37.123850+0000","last_fullsized":"2024-09-12T01:19:37.123850+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:13.793560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":175,"num_read_kb":171,"num_write":438,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'198","reported_seq":810,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:40.870335+0000","last_change":"2024-09-12T00:35:45.941739+0000","last_active":"2024-09-12T01:19:40.870335+0000","last_peered":"2024-09-12T01:19:40.870335+0000","last_clean":"2024-09-12T01:19:40.870335+0000","last_became_active":"2024-09-12T00:35:45.941396+0000","last_became_peered":"2024-09-12T00:35:45.941396+0000","last_unstale":"2024-09-12T01:19:40.870335+0000","last_undegraded":"2024-09-12T01:19:40.870335+0000","last_fullsized":"2024-09-12T01:19:40.870335+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:23.094406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":858,"num_read_kb":711,"num_write":323,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'387","reported_seq":1262,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:26.971716+0000","last_change":"2024-09-12T00:35:43.942784+0000","last_active":"2024-09-12T01:18:26.971716+0000","last_peered":"2024-09-12T01:18:26.971716+0000","last_clean":"2024-09-12T01:18:26.971716+0000","last_became_active":"2024-09-12T00:35:43.942359+0000","last_became_peered":"2024-09-12T00:35:43.942359+0000","last_unstale":"2024-09-12T01:18:26.971716+0000","last_undegraded":"2024-09-12T01:18:26.971716+0000","last_fullsized":"2024-09-12T01:18:26.971716+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:02.785832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20972321,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":1052,"num_read_kb":58431,"num_write":1438,"num_write_kb":72479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:17.551730+0000","last_change":"2024-09-12T00:35:47.941539+0000","last_active":"2024-09-12T01:19:17.551730+0000","last_peered":"2024-09-12T01:19:17.551730+0000","last_clean":"2024-09-12T01:19:17.551730+0000","last_became_active":"2024-09-12T00:35:47.940501+0000","last_became_peered":"2024-09-12T00:35:47.940501+0000","last_unstale":"2024-09-12T01:19:17.551730+0000","last_undegraded":"2024-09-12T01:19:17.551730+0000","last_fullsized":"2024-09-12T01:19:17.551730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:32.448595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'223","reported_seq":778,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:53.400164+0000","last_change":"2024-09-12T00:35:49.956360+0000","last_active":"2024-09-12T01:20:53.400164+0000","last_peered":"2024-09-12T01:20:53.400164+0000","last_clean":"2024-09-12T01:20:53.400164+0000","last_became_active":"2024-09-12T00:35:49.955264+0000","last_became_peered":"2024-09-12T00:35:49.955264+0000","last_unstale":"2024-09-12T01:20:53.400164+0000","last_undegraded":"2024-09-12T01:20:53.400164+0000","last_fullsized":"2024-09-12T01:20:53.400164+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:15.469778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49129,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":372,"num_read_kb":788,"num_write":306,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:22.740634+0000","last_change":"2024-09-12T00:35:51.965221+0000","last_active":"2024-09-12T01:18:22.740634+0000","last_peered":"2024-09-12T01:18:22.740634+0000","last_clean":"2024-09-12T01:18:22.740634+0000","last_became_active":"2024-09-12T00:35:51.961691+0000","last_became_peered":"2024-09-12T00:35:51.961691+0000","last_unstale":"2024-09-12T01:18:22.740634+0000","last_undegraded":"2024-09-12T01:18:22.740634+0000","last_fullsized":"2024-09-12T01:18:22.740634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:22.139991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'194","reported_seq":1651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:20.421505+0000","last_change":"2024-09-12T00:35:53.992266+0000","last_active":"2024-09-12T01:20:20.421505+0000","last_peered":"2024-09-12T01:20:20.421505+0000","last_clean":"2024-09-12T01:20:20.421505+0000","last_became_active":"2024-09-12T00:35:53.991532+0000","last_became_peered":"2024-09-12T00:35:53.991532+0000","last_unstale":"2024-09-12T01:20:20.421505+0000","last_undegraded":"2024-09-12T01:20:20.421505+0000","last_fullsized":"2024-09-12T01:20:20.421505+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:47.645297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1185,"num_read_kb":1184,"num_write":442,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'185","reported_seq":796,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:52.882363+0000","last_change":"2024-09-12T00:35:45.955138+0000","last_active":"2024-09-12T01:19:52.882363+0000","last_peered":"2024-09-12T01:19:52.882363+0000","last_clean":"2024-09-12T01:19:52.882363+0000","last_became_active":"2024-09-12T00:35:45.954474+0000","last_became_peered":"2024-09-12T00:35:45.954474+0000","last_unstale":"2024-09-12T01:19:52.882363+0000","last_undegraded":"2024-09-12T01:19:52.882363+0000","last_fullsized":"2024-09-12T01:19:52.882363+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:40.526235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":774,"num_read_kb":643,"num_write":252,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'300","reported_seq":924,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:06.357384+0000","last_change":"2024-09-12T00:35:43.935329+0000","last_active":"2024-09-12T01:20:06.357384+0000","last_peered":"2024-09-12T01:20:06.357384+0000","last_clean":"2024-09-12T01:20:06.357384+0000","last_became_active":"2024-09-12T00:35:43.934998+0000","last_became_peered":"2024-09-12T00:35:43.934998+0000","last_unstale":"2024-09-12T01:20:06.357384+0000","last_undegraded":"2024-09-12T01:20:06.357384+0000","last_fullsized":"2024-09-12T01:20:06.357384+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:30.951798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6617078,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":452,"num_read_kb":15471,"num_write":1064,"num_write_kb":44978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:23.579165+0000","last_change":"2024-09-12T00:35:47.929157+0000","last_active":"2024-09-12T01:19:23.579165+0000","last_peered":"2024-09-12T01:19:23.579165+0000","last_clean":"2024-09-12T01:19:23.579165+0000","last_became_active":"2024-09-12T00:35:47.928424+0000","last_became_peered":"2024-09-12T00:35:47.928424+0000","last_unstale":"2024-09-12T01:19:23.579165+0000","last_undegraded":"2024-09-12T01:19:23.579165+0000","last_fullsized":"2024-09-12T01:19:23.579165+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:48.464754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'292","reported_seq":885,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:52.574045+0000","last_change":"2024-09-12T00:35:49.934387+0000","last_active":"2024-09-12T01:20:52.574045+0000","last_peered":"2024-09-12T01:20:52.574045+0000","last_clean":"2024-09-12T01:20:52.574045+0000","last_became_active":"2024-09-12T00:35:49.933165+0000","last_became_peered":"2024-09-12T00:35:49.933165+0000","last_unstale":"2024-09-12T01:20:52.574045+0000","last_undegraded":"2024-09-12T01:20:52.574045+0000","last_fullsized":"2024-09-12T01:20:52.574045+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:40.275776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56310,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":480,"num_read_kb":946,"num_write":386,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.560633+0000","last_change":"2024-09-12T00:35:51.985500+0000","last_active":"2024-09-12T01:18:23.560633+0000","last_peered":"2024-09-12T01:18:23.560633+0000","last_clean":"2024-09-12T01:18:23.560633+0000","last_became_active":"2024-09-12T00:35:51.984756+0000","last_became_peered":"2024-09-12T00:35:51.984756+0000","last_unstale":"2024-09-12T01:18:23.560633+0000","last_undegraded":"2024-09-12T01:18:23.560633+0000","last_fullsized":"2024-09-12T01:18:23.560633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:50.437627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'185","reported_seq":692,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:24.493960+0000","last_change":"2024-09-12T00:35:53.986078+0000","last_active":"2024-09-12T01:21:24.493960+0000","last_peered":"2024-09-12T01:21:24.493960+0000","last_clean":"2024-09-12T01:21:24.493960+0000","last_became_active":"2024-09-12T00:35:53.985486+0000","last_became_peered":"2024-09-12T00:35:53.985486+0000","last_unstale":"2024-09-12T01:21:24.493960+0000","last_undegraded":"2024-09-12T01:21:24.493960+0000","last_fullsized":"2024-09-12T01:21:24.493960+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:09.339192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1062,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":193,"num_read_kb":167,"num_write":361,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'182","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:49.296781+0000","last_change":"2024-09-12T00:35:45.958055+0000","last_active":"2024-09-12T01:19:49.296781+0000","last_peered":"2024-09-12T01:19:49.296781+0000","last_clean":"2024-09-12T01:19:49.296781+0000","last_became_active":"2024-09-12T00:35:45.957698+0000","last_became_peered":"2024-09-12T00:35:45.957698+0000","last_unstale":"2024-09-12T01:19:49.296781+0000","last_undegraded":"2024-09-12T01:19:49.296781+0000","last_fullsized":"2024-09-12T01:19:49.296781+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:17.032556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":768,"num_read_kb":623,"num_write":277,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'318","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:59.822384+0000","last_change":"2024-09-12T00:35:43.938029+0000","last_active":"2024-09-12T01:19:59.822384+0000","last_peered":"2024-09-12T01:19:59.822384+0000","last_clean":"2024-09-12T01:19:59.822384+0000","last_became_active":"2024-09-12T00:35:43.937281+0000","last_became_peered":"2024-09-12T00:35:43.937281+0000","last_unstale":"2024-09-12T01:19:59.822384+0000","last_undegraded":"2024-09-12T01:19:59.822384+0000","last_fullsized":"2024-09-12T01:19:59.822384+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:12.183580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11608076,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":533,"num_read_kb":52869,"num_write":1291,"num_write_kb":41162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'421","reported_seq":1110,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:44.539784+0000","last_change":"2024-09-12T00:35:45.932905+0000","last_active":"2024-09-12T01:19:44.539784+0000","last_peered":"2024-09-12T01:19:44.539784+0000","last_clean":"2024-09-12T01:19:44.539784+0000","last_became_active":"2024-09-12T00:35:45.932615+0000","last_became_peered":"2024-09-12T00:35:45.932615+0000","last_unstale":"2024-09-12T01:19:44.539784+0000","last_undegraded":"2024-09-12T01:19:44.539784+0000","last_fullsized":"2024-09-12T01:19:44.539784+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:14.286299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2107,"num_read_kb":1905,"num_write":744,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'235","reported_seq":896,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.242860+0000","last_change":"2024-09-12T00:35:43.922351+0000","last_active":"2024-09-12T01:19:48.242860+0000","last_peered":"2024-09-12T01:19:48.242860+0000","last_clean":"2024-09-12T01:19:48.242860+0000","last_became_active":"2024-09-12T00:35:43.922005+0000","last_became_peered":"2024-09-12T00:35:43.922005+0000","last_unstale":"2024-09-12T01:19:48.242860+0000","last_undegraded":"2024-09-12T01:19:48.242860+0000","last_fullsized":"2024-09-12T01:19:48.242860+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:30.017931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470543,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":483,"num_read_kb":1388,"num_write":945,"num_write_kb":25405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'246","reported_seq":865,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.563835+0000","last_change":"2024-09-12T00:35:45.940788+0000","last_active":"2024-09-12T01:19:08.563835+0000","last_peered":"2024-09-12T01:19:08.563835+0000","last_clean":"2024-09-12T01:19:08.563835+0000","last_became_active":"2024-09-12T00:35:45.940153+0000","last_became_peered":"2024-09-12T00:35:45.940153+0000","last_unstale":"2024-09-12T01:19:08.563835+0000","last_undegraded":"2024-09-12T01:19:08.563835+0000","last_fullsized":"2024-09-12T01:19:08.563835+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:41.108403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1055,"num_read_kb":856,"num_write":397,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'274","reported_seq":881,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:05.577849+0000","last_change":"2024-09-12T00:36:17.268203+0000","last_active":"2024-09-12T01:20:05.577849+0000","last_peered":"2024-09-12T01:20:05.577849+0000","last_clean":"2024-09-12T01:20:05.577849+0000","last_became_active":"2024-09-12T00:36:17.267594+0000","last_became_peered":"2024-09-12T00:36:17.267594+0000","last_unstale":"2024-09-12T01:20:05.577849+0000","last_undegraded":"2024-09-12T01:20:05.577849+0000","last_fullsized":"2024-09-12T01:20:05.577849+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:49.169181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5830246,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":399,"num_read_kb":41046,"num_write":1064,"num_write_kb":25796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"265'92","reported_seq":669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:59.355559+0000","last_change":"2024-09-12T00:35:45.945797+0000","last_active":"2024-09-12T01:19:59.355559+0000","last_peered":"2024-09-12T01:19:59.355559+0000","last_clean":"2024-09-12T01:19:59.355559+0000","last_became_active":"2024-09-12T00:35:45.945534+0000","last_became_peered":"2024-09-12T00:35:45.945534+0000","last_unstale":"2024-09-12T01:19:59.355559+0000","last_undegraded":"2024-09-12T01:19:59.355559+0000","last_fullsized":"2024-09-12T01:19:59.355559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:37.784859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":411,"num_read_kb":349,"num_write":136,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'263","reported_seq":894,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:00.740433+0000","last_change":"2024-09-12T00:35:43.934445+0000","last_active":"2024-09-12T01:20:00.740433+0000","last_peered":"2024-09-12T01:20:00.740433+0000","last_clean":"2024-09-12T01:20:00.740433+0000","last_became_active":"2024-09-12T00:35:43.934068+0000","last_became_peered":"2024-09-12T00:35:43.934068+0000","last_unstale":"2024-09-12T01:20:00.740433+0000","last_undegraded":"2024-09-12T01:20:00.740433+0000","last_fullsized":"2024-09-12T01:20:00.740433+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:30.567561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9215770,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":418,"num_read_kb":16449,"num_write":991,"num_write_kb":32400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'160","reported_seq":796,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.600355+0000","last_change":"2024-09-12T00:35:45.944926+0000","last_active":"2024-09-12T01:19:43.600355+0000","last_peered":"2024-09-12T01:19:43.600355+0000","last_clean":"2024-09-12T01:19:43.600355+0000","last_became_active":"2024-09-12T00:35:45.944423+0000","last_became_peered":"2024-09-12T00:35:45.944423+0000","last_unstale":"2024-09-12T01:19:43.600355+0000","last_undegraded":"2024-09-12T01:19:43.600355+0000","last_fullsized":"2024-09-12T01:19:43.600355+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:02.168577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":713,"num_read_kb":599,"num_write":226,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"265'279","reported_seq":949,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:12.975100+0000","last_change":"2024-09-12T00:35:43.937795+0000","last_active":"2024-09-12T01:19:12.975100+0000","last_peered":"2024-09-12T01:19:12.975100+0000","last_clean":"2024-09-12T01:19:12.975100+0000","last_became_active":"2024-09-12T00:35:43.937104+0000","last_became_peered":"2024-09-12T00:35:43.937104+0000","last_unstale":"2024-09-12T01:19:12.975100+0000","last_undegraded":"2024-09-12T01:19:12.975100+0000","last_fullsized":"2024-09-12T01:19:12.975100+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:30.010970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17412122,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":513,"num_read_kb":63032,"num_write":1057,"num_write_kb":29306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'251","reported_seq":846,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:45.359695+0000","last_change":"2024-09-12T00:35:45.958347+0000","last_active":"2024-09-12T01:19:45.359695+0000","last_peered":"2024-09-12T01:19:45.359695+0000","last_clean":"2024-09-12T01:19:45.359695+0000","last_became_active":"2024-09-12T00:35:45.957860+0000","last_became_peered":"2024-09-12T00:35:45.957860+0000","last_unstale":"2024-09-12T01:19:45.359695+0000","last_undegraded":"2024-09-12T01:19:45.359695+0000","last_fullsized":"2024-09-12T01:19:45.359695+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:49.651072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1076,"num_read_kb":859,"num_write":407,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'284","reported_seq":927,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:46.858989+0000","last_change":"2024-09-12T00:35:43.929564+0000","last_active":"2024-09-12T01:19:46.858989+0000","last_peered":"2024-09-12T01:19:46.858989+0000","last_clean":"2024-09-12T01:19:46.858989+0000","last_became_active":"2024-09-12T00:35:43.929027+0000","last_became_peered":"2024-09-12T00:35:43.929027+0000","last_unstale":"2024-09-12T01:19:46.858989+0000","last_undegraded":"2024-09-12T01:19:46.858989+0000","last_fullsized":"2024-09-12T01:19:46.858989+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:38.958866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":308232,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":529,"num_read_kb":747,"num_write":1165,"num_write_kb":5740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'102","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:33.597890+0000","last_change":"2024-09-12T00:35:45.949059+0000","last_active":"2024-09-12T01:19:33.597890+0000","last_peered":"2024-09-12T01:19:33.597890+0000","last_clean":"2024-09-12T01:19:33.597890+0000","last_became_active":"2024-09-12T00:35:45.948581+0000","last_became_peered":"2024-09-12T00:35:45.948581+0000","last_unstale":"2024-09-12T01:19:33.597890+0000","last_undegraded":"2024-09-12T01:19:33.597890+0000","last_fullsized":"2024-09-12T01:19:33.597890+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:03.771381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":463,"num_read_kb":395,"num_write":145,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"265'275","reported_seq":906,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:57.902642+0000","last_change":"2024-09-12T00:35:43.941896+0000","last_active":"2024-09-12T01:19:57.902642+0000","last_peered":"2024-09-12T01:19:57.902642+0000","last_clean":"2024-09-12T01:19:57.902642+0000","last_became_active":"2024-09-12T00:35:43.941155+0000","last_became_peered":"2024-09-12T00:35:43.941155+0000","last_unstale":"2024-09-12T01:19:57.902642+0000","last_undegraded":"2024-09-12T01:19:57.902642+0000","last_fullsized":"2024-09-12T01:19:57.902642+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:16.416635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5628527,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":400,"num_read_kb":4200,"num_write":1024,"num_write_kb":60173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"265'210","reported_seq":843,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.562354+0000","last_change":"2024-09-12T00:35:45.946815+0000","last_active":"2024-09-12T01:19:32.562354+0000","last_peered":"2024-09-12T01:19:32.562354+0000","last_clean":"2024-09-12T01:19:32.562354+0000","last_became_active":"2024-09-12T00:35:45.946047+0000","last_became_peered":"2024-09-12T00:35:45.946047+0000","last_unstale":"2024-09-12T01:19:32.562354+0000","last_undegraded":"2024-09-12T01:19:32.562354+0000","last_fullsized":"2024-09-12T01:19:32.562354+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:52.299599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":932,"num_read_kb":766,"num_write":302,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'247","reported_seq":886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:03.590861+0000","last_change":"2024-09-12T00:35:43.924021+0000","last_active":"2024-09-12T01:19:03.590861+0000","last_peered":"2024-09-12T01:19:03.590861+0000","last_clean":"2024-09-12T01:19:03.590861+0000","last_became_active":"2024-09-12T00:35:43.923685+0000","last_became_peered":"2024-09-12T00:35:43.923685+0000","last_unstale":"2024-09-12T01:19:03.590861+0000","last_undegraded":"2024-09-12T01:19:03.590861+0000","last_fullsized":"2024-09-12T01:19:03.590861+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:37.087675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12014120,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":369,"num_read_kb":73835,"num_write":890,"num_write_kb":48353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'100","reported_seq":678,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:51.229959+0000","last_change":"2024-09-12T00:35:45.942310+0000","last_active":"2024-09-12T01:18:51.229959+0000","last_peered":"2024-09-12T01:18:51.229959+0000","last_clean":"2024-09-12T01:18:51.229959+0000","last_became_active":"2024-09-12T00:35:45.941986+0000","last_became_peered":"2024-09-12T00:35:45.941986+0000","last_unstale":"2024-09-12T01:18:51.229959+0000","last_undegraded":"2024-09-12T01:18:51.229959+0000","last_fullsized":"2024-09-12T01:18:51.229959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:26.966357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":455,"num_read_kb":381,"num_write":169,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'283","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:35.090927+0000","last_change":"2024-09-12T00:35:43.912420+0000","last_active":"2024-09-12T01:19:35.090927+0000","last_peered":"2024-09-12T01:19:35.090927+0000","last_clean":"2024-09-12T01:19:35.090927+0000","last_became_active":"2024-09-12T00:35:43.911654+0000","last_became_peered":"2024-09-12T00:35:43.911654+0000","last_unstale":"2024-09-12T01:19:35.090927+0000","last_undegraded":"2024-09-12T01:19:35.090927+0000","last_fullsized":"2024-09-12T01:19:35.090927+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:17.425827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15991459,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":520,"num_read_kb":5667,"num_write":1033,"num_write_kb":32435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'261","reported_seq":851,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:08.858632+0000","last_change":"2024-09-12T00:35:45.927243+0000","last_active":"2024-09-12T01:20:08.858632+0000","last_peered":"2024-09-12T01:20:08.858632+0000","last_clean":"2024-09-12T01:20:08.858632+0000","last_became_active":"2024-09-12T00:35:45.926462+0000","last_became_peered":"2024-09-12T00:35:45.926462+0000","last_unstale":"2024-09-12T01:20:08.858632+0000","last_undegraded":"2024-09-12T01:20:08.858632+0000","last_fullsized":"2024-09-12T01:20:08.858632+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:10.440313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1050,"num_read_kb":836,"num_write":420,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'265","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:53.433440+0000","last_change":"2024-09-12T00:35:43.937158+0000","last_active":"2024-09-12T01:19:53.433440+0000","last_peered":"2024-09-12T01:19:53.433440+0000","last_clean":"2024-09-12T01:19:53.433440+0000","last_became_active":"2024-09-12T00:35:43.936883+0000","last_became_peered":"2024-09-12T00:35:43.936883+0000","last_unstale":"2024-09-12T01:19:53.433440+0000","last_undegraded":"2024-09-12T01:19:53.433440+0000","last_fullsized":"2024-09-12T01:19:53.433440+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:57.094162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14696240,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":475,"num_read_kb":80814,"num_write":981,"num_write_kb":32955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"265'151","reported_seq":737,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:15.520650+0000","last_change":"2024-09-12T00:35:45.959301+0000","last_active":"2024-09-12T01:19:15.520650+0000","last_peered":"2024-09-12T01:19:15.520650+0000","last_clean":"2024-09-12T01:19:15.520650+0000","last_became_active":"2024-09-12T00:35:45.958997+0000","last_became_peered":"2024-09-12T00:35:45.958997+0000","last_unstale":"2024-09-12T01:19:15.520650+0000","last_undegraded":"2024-09-12T01:19:15.520650+0000","last_fullsized":"2024-09-12T01:19:15.520650+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:39.026757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":623,"num_read_kb":511,"num_write":250,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'297","reported_seq":955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:01.780641+0000","last_change":"2024-09-12T00:35:43.943348+0000","last_active":"2024-09-12T01:20:01.780641+0000","last_peered":"2024-09-12T01:20:01.780641+0000","last_clean":"2024-09-12T01:20:01.780641+0000","last_became_active":"2024-09-12T00:35:43.942591+0000","last_became_peered":"2024-09-12T00:35:43.942591+0000","last_unstale":"2024-09-12T01:20:01.780641+0000","last_undegraded":"2024-09-12T01:20:01.780641+0000","last_fullsized":"2024-09-12T01:20:01.780641+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:50.909125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16697068,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":435,"num_read_kb":28247,"num_write":1061,"num_write_kb":59925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"265'83","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:32.742834+0000","last_change":"2024-09-12T00:35:45.954876+0000","last_active":"2024-09-12T01:18:32.742834+0000","last_peered":"2024-09-12T01:18:32.742834+0000","last_clean":"2024-09-12T01:18:32.742834+0000","last_became_active":"2024-09-12T00:35:45.954252+0000","last_became_peered":"2024-09-12T00:35:45.954252+0000","last_unstale":"2024-09-12T01:18:32.742834+0000","last_undegraded":"2024-09-12T01:18:32.742834+0000","last_fullsized":"2024-09-12T01:18:32.742834+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:48.605386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":370,"num_read_kb":310,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'320","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:00.738510+0000","last_change":"2024-09-12T00:35:43.953256+0000","last_active":"2024-09-12T01:20:00.738510+0000","last_peered":"2024-09-12T01:20:00.738510+0000","last_clean":"2024-09-12T01:20:00.738510+0000","last_became_active":"2024-09-12T00:35:43.952828+0000","last_became_peered":"2024-09-12T00:35:43.952828+0000","last_unstale":"2024-09-12T01:20:00.738510+0000","last_undegraded":"2024-09-12T01:20:00.738510+0000","last_fullsized":"2024-09-12T01:20:00.738510+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:32.309244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8396062,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":550,"num_read_kb":10105,"num_write":1219,"num_write_kb":30495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'4192","reported_seq":4817,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:24.494966+0000","last_change":"2024-09-12T00:35:45.951097+0000","last_active":"2024-09-12T01:21:24.494966+0000","last_peered":"2024-09-12T01:21:24.494966+0000","last_clean":"2024-09-12T01:21:24.494966+0000","last_became_active":"2024-09-12T00:35:45.949770+0000","last_became_peered":"2024-09-12T00:35:45.949770+0000","last_unstale":"2024-09-12T01:21:24.494966+0000","last_undegraded":"2024-09-12T01:21:24.494966+0000","last_fullsized":"2024-09-12T01:21:24.494966+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":3000,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:12.568875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16900,"num_read_kb":14167,"num_write":6311,"num_write_kb":3148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'292","reported_seq":937,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:52.333861+0000","last_change":"2024-09-12T00:35:43.945424+0000","last_active":"2024-09-12T01:19:52.333861+0000","last_peered":"2024-09-12T01:19:52.333861+0000","last_clean":"2024-09-12T01:19:52.333861+0000","last_became_active":"2024-09-12T00:35:43.944721+0000","last_became_peered":"2024-09-12T00:35:43.944721+0000","last_unstale":"2024-09-12T01:19:52.333861+0000","last_undegraded":"2024-09-12T01:19:52.333861+0000","last_fullsized":"2024-09-12T01:19:52.333861+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:48.957484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2078150,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":474,"num_read_kb":12444,"num_write":1101,"num_write_kb":48295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'221","reported_seq":856,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:48.594988+0000","last_change":"2024-09-12T00:35:45.940317+0000","last_active":"2024-09-12T01:20:48.594988+0000","last_peered":"2024-09-12T01:20:48.594988+0000","last_clean":"2024-09-12T01:20:48.594988+0000","last_became_active":"2024-09-12T00:35:45.939921+0000","last_became_peered":"2024-09-12T00:35:45.939921+0000","last_unstale":"2024-09-12T01:20:48.594988+0000","last_undegraded":"2024-09-12T01:20:48.594988+0000","last_fullsized":"2024-09-12T01:20:48.594988+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:13.796483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":991,"num_read_kb":821,"num_write":345,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'275","reported_seq":904,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:52.335973+0000","last_change":"2024-09-12T00:35:43.943721+0000","last_active":"2024-09-12T01:19:52.335973+0000","last_peered":"2024-09-12T01:19:52.335973+0000","last_clean":"2024-09-12T01:19:52.335973+0000","last_became_active":"2024-09-12T00:35:43.942772+0000","last_became_peered":"2024-09-12T00:35:43.942772+0000","last_unstale":"2024-09-12T01:19:52.335973+0000","last_undegraded":"2024-09-12T01:19:52.335973+0000","last_fullsized":"2024-09-12T01:19:52.335973+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:17.244534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2655471,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":405,"num_read_kb":15742,"num_write":1028,"num_write_kb":41173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'153","reported_seq":771,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:33.583730+0000","last_change":"2024-09-12T00:35:45.938724+0000","last_active":"2024-09-12T01:18:33.583730+0000","last_peered":"2024-09-12T01:18:33.583730+0000","last_clean":"2024-09-12T01:18:33.583730+0000","last_became_active":"2024-09-12T00:35:45.937998+0000","last_became_peered":"2024-09-12T00:35:45.937998+0000","last_unstale":"2024-09-12T01:18:33.583730+0000","last_undegraded":"2024-09-12T01:18:33.583730+0000","last_fullsized":"2024-09-12T01:18:33.583730+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:04.489640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":680,"num_read_kb":568,"num_write":226,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'289","reported_seq":990,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:35.296244+0000","last_change":"2024-09-12T00:35:43.941342+0000","last_active":"2024-09-12T01:18:35.296244+0000","last_peered":"2024-09-12T01:18:35.296244+0000","last_clean":"2024-09-12T01:18:35.296244+0000","last_became_active":"2024-09-12T00:35:43.940876+0000","last_became_peered":"2024-09-12T00:35:43.940876+0000","last_unstale":"2024-09-12T01:18:35.296244+0000","last_undegraded":"2024-09-12T01:18:35.296244+0000","last_fullsized":"2024-09-12T01:18:35.296244+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:09.198397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5957581,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":658,"num_read_kb":28884,"num_write":1044,"num_write_kb":16361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'146","reported_seq":783,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:14.901305+0000","last_change":"2024-09-12T00:35:45.948798+0000","last_active":"2024-09-12T01:19:14.901305+0000","last_peered":"2024-09-12T01:19:14.901305+0000","last_clean":"2024-09-12T01:19:14.901305+0000","last_became_active":"2024-09-12T00:35:45.948028+0000","last_became_peered":"2024-09-12T00:35:45.948028+0000","last_unstale":"2024-09-12T01:19:14.901305+0000","last_undegraded":"2024-09-12T01:19:14.901305+0000","last_fullsized":"2024-09-12T01:19:14.901305+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:30.737963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":702,"num_read_kb":590,"num_write":208,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'274","reported_seq":951,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:58.734715+0000","last_change":"2024-09-12T00:35:43.951405+0000","last_active":"2024-09-12T01:19:58.734715+0000","last_peered":"2024-09-12T01:19:58.734715+0000","last_clean":"2024-09-12T01:19:58.734715+0000","last_became_active":"2024-09-12T00:35:43.950791+0000","last_became_peered":"2024-09-12T00:35:43.950791+0000","last_unstale":"2024-09-12T01:19:58.734715+0000","last_undegraded":"2024-09-12T01:19:58.734715+0000","last_fullsized":"2024-09-12T01:19:58.734715+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:26.346445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12826072,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":516,"num_read_kb":37013,"num_write":1017,"num_write_kb":45879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'246","reported_seq":876,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:27.665427+0000","last_change":"2024-09-12T00:35:43.932104+0000","last_active":"2024-09-12T01:18:27.665427+0000","last_peered":"2024-09-12T01:18:27.665427+0000","last_clean":"2024-09-12T01:18:27.665427+0000","last_became_active":"2024-09-12T00:35:43.931367+0000","last_became_peered":"2024-09-12T00:35:43.931367+0000","last_unstale":"2024-09-12T01:18:27.665427+0000","last_undegraded":"2024-09-12T01:18:27.665427+0000","last_fullsized":"2024-09-12T01:18:27.665427+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:38.049554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243608,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":414,"num_read_kb":37317,"num_write":928,"num_write_kb":22412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'443","reported_seq":1072,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:28.576933+0000","last_change":"2024-09-12T00:35:45.941592+0000","last_active":"2024-09-12T01:19:28.576933+0000","last_peered":"2024-09-12T01:19:28.576933+0000","last_clean":"2024-09-12T01:19:28.576933+0000","last_became_active":"2024-09-12T00:35:45.941136+0000","last_became_peered":"2024-09-12T00:35:45.941136+0000","last_unstale":"2024-09-12T01:19:28.576933+0000","last_undegraded":"2024-09-12T01:19:28.576933+0000","last_fullsized":"2024-09-12T01:19:28.576933+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:02.451398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1924,"num_read_kb":1655,"num_write":712,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'275","reported_seq":925,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:23.895181+0000","last_change":"2024-09-12T00:35:43.937060+0000","last_active":"2024-09-12T01:21:23.895181+0000","last_peered":"2024-09-12T01:21:23.895181+0000","last_clean":"2024-09-12T01:21:23.895181+0000","last_became_active":"2024-09-12T00:35:43.936772+0000","last_became_peered":"2024-09-12T00:35:43.936772+0000","last_unstale":"2024-09-12T01:21:23.895181+0000","last_undegraded":"2024-09-12T01:21:23.895181+0000","last_fullsized":"2024-09-12T01:21:23.895181+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:27.825066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6845022,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":458,"num_read_kb":11204,"num_write":1035,"num_write_kb":22250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'123","reported_seq":729,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.566303+0000","last_change":"2024-09-12T00:35:45.934557+0000","last_active":"2024-09-12T01:19:18.566303+0000","last_peered":"2024-09-12T01:19:18.566303+0000","last_clean":"2024-09-12T01:19:18.566303+0000","last_became_active":"2024-09-12T00:35:45.933748+0000","last_became_peered":"2024-09-12T00:35:45.933748+0000","last_unstale":"2024-09-12T01:19:18.566303+0000","last_undegraded":"2024-09-12T01:19:18.566303+0000","last_fullsized":"2024-09-12T01:19:18.566303+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:12.558899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":571,"num_read_kb":478,"num_write":188,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5965,"num_read_kb":4303,"num_write":1960,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":931,"ondisk_log_size":931,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":15013,"num_read_kb":14673,"num_write":16730,"num_write_kb":4883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2159,"ondisk_log_size":2159,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":552,"ondisk_log_size":552,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1842191,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":17272,"num_read_kb":32834,"num_write":14569,"num_write_kb":11466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3252224,"data_stored":2746064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1881,"ondisk_log_size":1881,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2423,"num_read_kb":2888,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102034,"num_read_kb":85265,"num_write":36996,"num_write_kb":18612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3934,"ondisk_log_size":3934,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":591912808,"num_objects":4393,"num_object_clones":0,"num_object_copies":8786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4393,"num_whiteouts":0,"num_read":31773,"num_read_kb":1958390,"num_write":67314,"num_write_kb":2147647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1216569344,"data_stored":1183825616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4441,"ondisk_log_size":4441,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":63003034,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":174261,"num_write":136,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":126017536,"data_stored":126006068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":63003034,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":179336,"num_write":136,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":126017536,"data_stored":126006068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424510003,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":321224,"kb_used_data":209592,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94050616,"statfs":{"total":96636764160,"available":96307830784,"internally_reserved":0,"allocated":214622208,"data_stored":208163901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510002,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":496972,"kb_used_data":236732,"kb_used_omap":1,"kb_used_meta":260222,"kb_avail":93874868,"statfs":{"total":96636764160,"available":96127864832,"internally_reserved":0,"allocated":242413568,"data_stored":235906771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":266467783},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510004,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248612,"kb_used_data":136980,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94123228,"statfs":{"total":96636764160,"available":96382185472,"internally_reserved":0,"allocated":140267520,"data_stored":135894511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510003,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":436536,"kb_used_data":224872,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":93935304,"statfs":{"total":96636764160,"available":96189751296,"internally_reserved":0,"allocated":230268928,"data_stored":223912362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":216725957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542706,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378920,"kb_used_data":153368,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":93992920,"statfs":{"total":96636764160,"available":96248750080,"internally_reserved":0,"allocated":157048832,"data_stored":150777424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":230947274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542705,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":363656,"kb_used_data":156152,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94008184,"statfs":{"total":96636764160,"available":96264380416,"internally_reserved":0,"allocated":159899648,"data_stored":155281946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":212466118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542706,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272756,"kb_used_data":205476,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94099084,"statfs":{"total":96636764160,"available":96357462016,"internally_reserved":0,"allocated":210407424,"data_stored":204196692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575410,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":201300,"kb_used_data":143748,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94170540,"statfs":{"total":96636764160,"available":96430632960,"internally_reserved":0,"allocated":147197952,"data_stored":142796807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":187768832,"data_stored":182992905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102543360,"data_stored":99716306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":116109312,"data_stored":113213576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":209895424,"data_stored":204981060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":177270784,"data_stored":172564636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":183005184,"data_stored":178162931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":119222272,"data_stored":116122657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":120754176,"data_stored":116071545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":344512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":394577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":134108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":536576,"data_stored":463381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":77458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":553207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":265538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":610304,"data_stored":513283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":4558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":6362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23117824,"data_stored":23113785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27303936,"data_stored":27303121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12586128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8429568,"data_stored":8428753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":19976192,"data_stored":19971273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14725120,"data_stored":14723425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6340608,"data_stored":6336569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21012480,"data_stored":21011665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17829888,"data_stored":17829008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16826368,"data_stored":16822329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18874368,"data_stored":18874368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:21:59.193 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:21:59.580 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:21:59.595 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-12T01:21:59.597 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":1657,"stamp":"2024-09-12T01:21:59.137711+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":149162027,"num_objects":1213,"num_object_clones":0,"num_object_copies":2426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1213,"num_whiteouts":0,"num_read":178830,"num_read_kb":2455954,"num_write":141793,"num_write_kb":2416865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13350,"ondisk_log_size":13350,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1923820,"kb_used_data":673388,"kb_used_omap":12,"kb_used_meta":1248755,"kb_avail":753050900,"statfs":{"total":773094113280,"available":771124121600,"internally_reserved":0,"allocated":689549312,"data_stored":663475884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1278725680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-571207539,"num_objects":-3572,"num_object_clones":0,"num_object_copies":-7144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-3572,"num_whiteouts":0,"num_read":4040,"num_read_kb":3937,"num_write":3809,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.017254"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:43.558042+0000","last_change":"2024-09-12T01:03:40.585433+0000","last_active":"2024-09-12T01:18:43.558042+0000","last_peered":"2024-09-12T01:18:43.558042+0000","last_clean":"2024-09-12T01:18:43.558042+0000","last_became_active":"2024-09-12T01:03:40.584744+0000","last_became_peered":"2024-09-12T01:03:40.584744+0000","last_unstale":"2024-09-12T01:18:43.558042+0000","last_undegraded":"2024-09-12T01:18:43.558042+0000","last_fullsized":"2024-09-12T01:18:43.558042+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:08.339816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.544106+0000","last_change":"2024-09-12T00:52:40.345897+0000","last_active":"2024-09-12T01:17:43.544106+0000","last_peered":"2024-09-12T01:17:43.544106+0000","last_clean":"2024-09-12T01:17:43.544106+0000","last_became_active":"2024-09-12T00:52:40.345120+0000","last_became_peered":"2024-09-12T00:52:40.345120+0000","last_unstale":"2024-09-12T01:17:43.544106+0000","last_undegraded":"2024-09-12T01:17:43.544106+0000","last_fullsized":"2024-09-12T01:17:43.544106+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:08.139060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"265'3","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:08.606428+0000","last_change":"2024-09-12T00:52:37.282365+0000","last_active":"2024-09-12T01:20:08.606428+0000","last_peered":"2024-09-12T01:20:08.606428+0000","last_clean":"2024-09-12T01:20:08.606428+0000","last_became_active":"2024-09-12T00:52:37.276676+0000","last_became_peered":"2024-09-12T00:52:37.276676+0000","last_unstale":"2024-09-12T01:20:08.606428+0000","last_undegraded":"2024-09-12T01:20:08.606428+0000","last_fullsized":"2024-09-12T01:20:08.606428+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:49.462408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'38","reported_seq":155,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.558454+0000","last_change":"2024-09-12T00:51:04.999562+0000","last_active":"2024-09-12T01:18:13.558454+0000","last_peered":"2024-09-12T01:18:13.558454+0000","last_clean":"2024-09-12T01:18:13.558454+0000","last_became_active":"2024-09-12T00:51:04.998763+0000","last_became_peered":"2024-09-12T00:51:04.998763+0000","last_unstale":"2024-09-12T01:18:13.558454+0000","last_undegraded":"2024-09-12T01:18:13.558454+0000","last_fullsized":"2024-09-12T01:18:13.558454+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:53.376151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":142,"num_write":56,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:40.559635+0000","last_change":"2024-09-12T01:03:40.582702+0000","last_active":"2024-09-12T01:18:40.559635+0000","last_peered":"2024-09-12T01:18:40.559635+0000","last_clean":"2024-09-12T01:18:40.559635+0000","last_became_active":"2024-09-12T01:03:40.581266+0000","last_became_peered":"2024-09-12T01:03:40.581266+0000","last_unstale":"2024-09-12T01:18:40.559635+0000","last_undegraded":"2024-09-12T01:18:40.559635+0000","last_fullsized":"2024-09-12T01:18:40.559635+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:25.009896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"265'1","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:42.731685+0000","last_change":"2024-09-12T00:52:40.345386+0000","last_active":"2024-09-12T01:17:42.731685+0000","last_peered":"2024-09-12T01:17:42.731685+0000","last_clean":"2024-09-12T01:17:42.731685+0000","last_became_active":"2024-09-12T00:52:40.344674+0000","last_became_peered":"2024-09-12T00:52:40.344674+0000","last_unstale":"2024-09-12T01:17:42.731685+0000","last_undegraded":"2024-09-12T01:17:42.731685+0000","last_fullsized":"2024-09-12T01:17:42.731685+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:43.041640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4968,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":10,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'6","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:08.589427+0000","last_change":"2024-09-12T00:52:37.295217+0000","last_active":"2024-09-12T01:20:08.589427+0000","last_peered":"2024-09-12T01:20:08.589427+0000","last_clean":"2024-09-12T01:20:08.589427+0000","last_became_active":"2024-09-12T00:52:37.294438+0000","last_became_peered":"2024-09-12T00:52:37.294438+0000","last_unstale":"2024-09-12T01:20:08.589427+0000","last_undegraded":"2024-09-12T01:20:08.589427+0000","last_fullsized":"2024-09-12T01:20:08.589427+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:53.566890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'42","reported_seq":164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:10.566329+0000","last_change":"2024-09-12T00:51:04.962325+0000","last_active":"2024-09-12T01:19:10.566329+0000","last_peered":"2024-09-12T01:19:10.566329+0000","last_clean":"2024-09-12T01:19:10.566329+0000","last_became_active":"2024-09-12T00:51:04.961677+0000","last_became_peered":"2024-09-12T00:51:04.961677+0000","last_unstale":"2024-09-12T01:19:10.566329+0000","last_undegraded":"2024-09-12T01:19:10.566329+0000","last_fullsized":"2024-09-12T01:19:10.566329+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:51.606282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":168,"num_write":72,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:12.545131+0000","last_change":"2024-09-12T01:03:40.577634+0000","last_active":"2024-09-12T01:18:12.545131+0000","last_peered":"2024-09-12T01:18:12.545131+0000","last_clean":"2024-09-12T01:18:12.545131+0000","last_became_active":"2024-09-12T01:03:40.576550+0000","last_became_peered":"2024-09-12T01:03:40.576550+0000","last_unstale":"2024-09-12T01:18:12.545131+0000","last_undegraded":"2024-09-12T01:18:12.545131+0000","last_fullsized":"2024-09-12T01:18:12.545131+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:55.304251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"265'5","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:53.609270+0000","last_change":"2024-09-12T00:52:40.341193+0000","last_active":"2024-09-12T01:21:53.609270+0000","last_peered":"2024-09-12T01:21:53.609270+0000","last_clean":"2024-09-12T01:21:53.609270+0000","last_became_active":"2024-09-12T00:52:40.337945+0000","last_became_peered":"2024-09-12T00:52:40.337945+0000","last_unstale":"2024-09-12T01:21:53.609270+0000","last_undegraded":"2024-09-12T01:21:53.609270+0000","last_fullsized":"2024-09-12T01:21:53.609270+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:20.078369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:45.560948+0000","last_change":"2024-09-12T00:52:37.297111+0000","last_active":"2024-09-12T01:18:45.560948+0000","last_peered":"2024-09-12T01:18:45.560948+0000","last_clean":"2024-09-12T01:18:45.560948+0000","last_became_active":"2024-09-12T00:52:37.296335+0000","last_became_peered":"2024-09-12T00:52:37.296335+0000","last_unstale":"2024-09-12T01:18:45.560948+0000","last_undegraded":"2024-09-12T01:18:45.560948+0000","last_fullsized":"2024-09-12T01:18:45.560948+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:01.174517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'30","reported_seq":128,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.564783+0000","last_change":"2024-09-12T00:51:04.997842+0000","last_active":"2024-09-12T01:18:38.564783+0000","last_peered":"2024-09-12T01:18:38.564783+0000","last_clean":"2024-09-12T01:18:38.564783+0000","last_became_active":"2024-09-12T00:51:04.992519+0000","last_became_peered":"2024-09-12T00:51:04.992519+0000","last_unstale":"2024-09-12T01:18:38.564783+0000","last_undegraded":"2024-09-12T01:18:38.564783+0000","last_fullsized":"2024-09-12T01:18:38.564783+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:13.960445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":105,"num_write":58,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.579674+0000","last_change":"2024-09-12T01:03:40.587244+0000","last_active":"2024-09-12T01:18:18.579674+0000","last_peered":"2024-09-12T01:18:18.579674+0000","last_clean":"2024-09-12T01:18:18.579674+0000","last_became_active":"2024-09-12T01:03:40.586582+0000","last_became_peered":"2024-09-12T01:03:40.586582+0000","last_unstale":"2024-09-12T01:18:18.579674+0000","last_undegraded":"2024-09-12T01:18:18.579674+0000","last_fullsized":"2024-09-12T01:18:18.579674+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:46.195286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'5","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.135882+0000","last_change":"2024-09-12T00:53:18.616189+0000","last_active":"2024-09-12T01:21:57.135882+0000","last_peered":"2024-09-12T01:21:57.135882+0000","last_clean":"2024-09-12T01:21:57.135882+0000","last_became_active":"2024-09-12T00:53:18.615877+0000","last_became_peered":"2024-09-12T00:53:18.615877+0000","last_unstale":"2024-09-12T01:21:57.135882+0000","last_undegraded":"2024-09-12T01:21:57.135882+0000","last_fullsized":"2024-09-12T01:21:57.135882+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:35.115620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6184,"num_write":5,"num_write_kb":6184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:42.558460+0000","last_change":"2024-09-12T00:52:37.277359+0000","last_active":"2024-09-12T01:19:42.558460+0000","last_peered":"2024-09-12T01:19:42.558460+0000","last_clean":"2024-09-12T01:19:42.558460+0000","last_became_active":"2024-09-12T00:52:37.270357+0000","last_became_peered":"2024-09-12T00:52:37.270357+0000","last_unstale":"2024-09-12T01:19:42.558460+0000","last_undegraded":"2024-09-12T01:19:42.558460+0000","last_fullsized":"2024-09-12T01:19:42.558460+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:03.048579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'29","reported_seq":125,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.585016+0000","last_change":"2024-09-12T00:51:04.995220+0000","last_active":"2024-09-12T01:18:38.585016+0000","last_peered":"2024-09-12T01:18:38.585016+0000","last_clean":"2024-09-12T01:18:38.585016+0000","last_became_active":"2024-09-12T00:51:04.994459+0000","last_became_peered":"2024-09-12T00:51:04.994459+0000","last_unstale":"2024-09-12T01:18:38.585016+0000","last_undegraded":"2024-09-12T01:18:38.585016+0000","last_fullsized":"2024-09-12T01:18:38.585016+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:32.327605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":61,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.601539+0000","last_change":"2024-09-12T01:03:40.594312+0000","last_active":"2024-09-12T01:19:48.601539+0000","last_peered":"2024-09-12T01:19:48.601539+0000","last_clean":"2024-09-12T01:19:48.601539+0000","last_became_active":"2024-09-12T01:03:40.593614+0000","last_became_peered":"2024-09-12T01:03:40.593614+0000","last_unstale":"2024-09-12T01:19:48.601539+0000","last_undegraded":"2024-09-12T01:19:48.601539+0000","last_fullsized":"2024-09-12T01:19:48.601539+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:51.667787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"265'6","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:53.402527+0000","last_change":"2024-09-12T00:52:40.358057+0000","last_active":"2024-09-12T01:21:53.402527+0000","last_peered":"2024-09-12T01:21:53.402527+0000","last_clean":"2024-09-12T01:21:53.402527+0000","last_became_active":"2024-09-12T00:52:40.356507+0000","last_became_peered":"2024-09-12T00:52:40.356507+0000","last_unstale":"2024-09-12T01:21:53.402527+0000","last_undegraded":"2024-09-12T01:21:53.402527+0000","last_fullsized":"2024-09-12T01:21:53.402527+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:07.353171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":17408,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:13.572946+0000","last_change":"2024-09-12T00:52:37.293774+0000","last_active":"2024-09-12T01:19:13.572946+0000","last_peered":"2024-09-12T01:19:13.572946+0000","last_clean":"2024-09-12T01:19:13.572946+0000","last_became_active":"2024-09-12T00:52:37.293298+0000","last_became_peered":"2024-09-12T00:52:37.293298+0000","last_unstale":"2024-09-12T01:19:13.572946+0000","last_undegraded":"2024-09-12T01:19:13.572946+0000","last_fullsized":"2024-09-12T01:19:13.572946+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:24.891123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"262'30","reported_seq":137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.584909+0000","last_change":"2024-09-12T00:51:04.996662+0000","last_active":"2024-09-12T01:18:38.584909+0000","last_peered":"2024-09-12T01:18:38.584909+0000","last_clean":"2024-09-12T01:18:38.584909+0000","last_became_active":"2024-09-12T00:51:04.995863+0000","last_became_peered":"2024-09-12T00:51:04.995863+0000","last_unstale":"2024-09-12T01:18:38.584909+0000","last_undegraded":"2024-09-12T01:18:38.584909+0000","last_fullsized":"2024-09-12T01:18:38.584909+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:04.557157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":123,"num_write":48,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.561295+0000","last_change":"2024-09-12T01:03:40.576503+0000","last_active":"2024-09-12T01:18:18.561295+0000","last_peered":"2024-09-12T01:18:18.561295+0000","last_clean":"2024-09-12T01:18:18.561295+0000","last_became_active":"2024-09-12T01:03:40.575481+0000","last_became_peered":"2024-09-12T01:03:40.575481+0000","last_unstale":"2024-09-12T01:18:18.561295+0000","last_undegraded":"2024-09-12T01:18:18.561295+0000","last_fullsized":"2024-09-12T01:18:18.561295+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:48.119658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:17.559249+0000","last_change":"2024-09-12T00:52:40.350599+0000","last_active":"2024-09-12T01:19:17.559249+0000","last_peered":"2024-09-12T01:19:17.559249+0000","last_clean":"2024-09-12T01:19:17.559249+0000","last_became_active":"2024-09-12T00:52:40.349826+0000","last_became_peered":"2024-09-12T00:52:40.349826+0000","last_unstale":"2024-09-12T01:19:17.559249+0000","last_undegraded":"2024-09-12T01:19:17.559249+0000","last_fullsized":"2024-09-12T01:19:17.559249+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:49.311099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"265'18","reported_seq":86,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.980038+0000","last_change":"2024-09-12T00:52:37.284934+0000","last_active":"2024-09-12T01:21:56.980038+0000","last_peered":"2024-09-12T01:21:56.980038+0000","last_clean":"2024-09-12T01:21:56.980038+0000","last_became_active":"2024-09-12T00:52:37.283600+0000","last_became_peered":"2024-09-12T00:52:37.283600+0000","last_unstale":"2024-09-12T01:21:56.980038+0000","last_undegraded":"2024-09-12T01:21:56.980038+0000","last_fullsized":"2024-09-12T01:21:56.980038+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:50.299864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":56328,"num_write":28,"num_write_kb":20484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"265'59","reported_seq":206,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:37.551106+0000","last_change":"2024-09-12T00:51:04.983051+0000","last_active":"2024-09-12T01:18:37.551106+0000","last_peered":"2024-09-12T01:18:37.551106+0000","last_clean":"2024-09-12T01:18:37.551106+0000","last_became_active":"2024-09-12T00:51:04.982228+0000","last_became_peered":"2024-09-12T00:51:04.982228+0000","last_unstale":"2024-09-12T01:18:37.551106+0000","last_undegraded":"2024-09-12T01:18:37.551106+0000","last_fullsized":"2024-09-12T01:18:37.551106+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:07.565984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":210,"num_write":106,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.785889+0000","last_change":"2024-09-12T01:03:40.569067+0000","last_active":"2024-09-12T01:18:42.785889+0000","last_peered":"2024-09-12T01:18:42.785889+0000","last_clean":"2024-09-12T01:18:42.785889+0000","last_became_active":"2024-09-12T01:03:40.568346+0000","last_became_peered":"2024-09-12T01:03:40.568346+0000","last_unstale":"2024-09-12T01:18:42.785889+0000","last_undegraded":"2024-09-12T01:18:42.785889+0000","last_fullsized":"2024-09-12T01:18:42.785889+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:12.448021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"265'2","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:42.538508+0000","last_change":"2024-09-12T00:52:40.340425+0000","last_active":"2024-09-12T01:17:42.538508+0000","last_peered":"2024-09-12T01:17:42.538508+0000","last_clean":"2024-09-12T01:17:42.538508+0000","last_became_active":"2024-09-12T00:52:40.339627+0000","last_became_peered":"2024-09-12T00:52:40.339627+0000","last_unstale":"2024-09-12T01:17:42.538508+0000","last_undegraded":"2024-09-12T01:17:42.538508+0000","last_fullsized":"2024-09-12T01:17:42.538508+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:05.869695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"262'3","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:37.730433+0000","last_change":"2024-09-12T00:52:37.283996+0000","last_active":"2024-09-12T01:17:37.730433+0000","last_peered":"2024-09-12T01:17:37.730433+0000","last_clean":"2024-09-12T01:17:37.730433+0000","last_became_active":"2024-09-12T00:52:37.283199+0000","last_became_peered":"2024-09-12T00:52:37.283199+0000","last_unstale":"2024-09-12T01:17:37.730433+0000","last_undegraded":"2024-09-12T01:17:37.730433+0000","last_fullsized":"2024-09-12T01:17:37.730433+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:03.588195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"265'5","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.689244+0000","last_change":"2024-09-12T00:51:04.988358+0000","last_active":"2024-09-12T01:19:18.689244+0000","last_peered":"2024-09-12T01:19:18.689244+0000","last_clean":"2024-09-12T01:19:18.689244+0000","last_became_active":"2024-09-12T00:51:04.981675+0000","last_became_peered":"2024-09-12T00:51:04.981675+0000","last_unstale":"2024-09-12T01:19:18.689244+0000","last_undegraded":"2024-09-12T01:19:18.689244+0000","last_fullsized":"2024-09-12T01:19:18.689244+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:29.580737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.785967+0000","last_change":"2024-09-12T01:03:40.577284+0000","last_active":"2024-09-12T01:18:42.785967+0000","last_peered":"2024-09-12T01:18:42.785967+0000","last_clean":"2024-09-12T01:18:42.785967+0000","last_became_active":"2024-09-12T01:03:40.576430+0000","last_became_peered":"2024-09-12T01:03:40.576430+0000","last_unstale":"2024-09-12T01:18:42.785967+0000","last_undegraded":"2024-09-12T01:18:42.785967+0000","last_fullsized":"2024-09-12T01:18:42.785967+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:37.105480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:13.607494+0000","last_change":"2024-09-12T00:52:40.346703+0000","last_active":"2024-09-12T01:20:13.607494+0000","last_peered":"2024-09-12T01:20:13.607494+0000","last_clean":"2024-09-12T01:20:13.607494+0000","last_became_active":"2024-09-12T00:52:40.345995+0000","last_became_peered":"2024-09-12T00:52:40.345995+0000","last_unstale":"2024-09-12T01:20:13.607494+0000","last_undegraded":"2024-09-12T01:20:13.607494+0000","last_fullsized":"2024-09-12T01:20:13.607494+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:53.845660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'2","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:08.587182+0000","last_change":"2024-09-12T00:52:37.300110+0000","last_active":"2024-09-12T01:20:08.587182+0000","last_peered":"2024-09-12T01:20:08.587182+0000","last_clean":"2024-09-12T01:20:08.587182+0000","last_became_active":"2024-09-12T00:52:37.299604+0000","last_became_peered":"2024-09-12T00:52:37.299604+0000","last_unstale":"2024-09-12T01:20:08.587182+0000","last_undegraded":"2024-09-12T01:20:08.587182+0000","last_fullsized":"2024-09-12T01:20:08.587182+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:04.899567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'41","reported_seq":157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.553749+0000","last_change":"2024-09-12T00:51:04.969892+0000","last_active":"2024-09-12T01:17:43.553749+0000","last_peered":"2024-09-12T01:17:43.553749+0000","last_clean":"2024-09-12T01:17:43.553749+0000","last_became_active":"2024-09-12T00:51:04.968673+0000","last_became_peered":"2024-09-12T00:51:04.968673+0000","last_unstale":"2024-09-12T01:17:43.553749+0000","last_undegraded":"2024-09-12T01:17:43.553749+0000","last_fullsized":"2024-09-12T01:17:43.553749+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:09.083642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":145,"num_write":79,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.553934+0000","last_change":"2024-09-12T01:03:40.591077+0000","last_active":"2024-09-12T01:17:43.553934+0000","last_peered":"2024-09-12T01:17:43.553934+0000","last_clean":"2024-09-12T01:17:43.553934+0000","last_became_active":"2024-09-12T01:03:40.590440+0000","last_became_peered":"2024-09-12T01:03:40.590440+0000","last_unstale":"2024-09-12T01:17:43.553934+0000","last_undegraded":"2024-09-12T01:17:43.553934+0000","last_fullsized":"2024-09-12T01:17:43.553934+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:52.159624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.594467+0000","last_change":"2024-09-12T00:52:40.363386+0000","last_active":"2024-09-12T01:19:18.594467+0000","last_peered":"2024-09-12T01:19:18.594467+0000","last_clean":"2024-09-12T01:19:18.594467+0000","last_became_active":"2024-09-12T00:52:40.359069+0000","last_became_peered":"2024-09-12T00:52:40.359069+0000","last_unstale":"2024-09-12T01:19:18.594467+0000","last_undegraded":"2024-09-12T01:19:18.594467+0000","last_fullsized":"2024-09-12T01:19:18.594467+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:47.963386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"262'5","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.553521+0000","last_change":"2024-09-12T00:52:37.274416+0000","last_active":"2024-09-12T01:18:23.553521+0000","last_peered":"2024-09-12T01:18:23.553521+0000","last_clean":"2024-09-12T01:18:23.553521+0000","last_became_active":"2024-09-12T00:52:37.273684+0000","last_became_peered":"2024-09-12T00:52:37.273684+0000","last_unstale":"2024-09-12T01:18:23.553521+0000","last_undegraded":"2024-09-12T01:18:23.553521+0000","last_fullsized":"2024-09-12T01:18:23.553521+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:25.538379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":25602,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'50","reported_seq":182,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.551251+0000","last_change":"2024-09-12T00:51:04.999190+0000","last_active":"2024-09-12T01:17:43.551251+0000","last_peered":"2024-09-12T01:17:43.551251+0000","last_clean":"2024-09-12T01:17:43.551251+0000","last_became_active":"2024-09-12T00:51:04.993887+0000","last_became_peered":"2024-09-12T00:51:04.993887+0000","last_unstale":"2024-09-12T01:17:43.551251+0000","last_undegraded":"2024-09-12T01:17:43.551251+0000","last_fullsized":"2024-09-12T01:17:43.551251+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:49.567739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":256,"num_read_kb":177,"num_write":91,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:40.546741+0000","last_change":"2024-09-12T01:03:40.581951+0000","last_active":"2024-09-12T01:17:40.546741+0000","last_peered":"2024-09-12T01:17:40.546741+0000","last_clean":"2024-09-12T01:17:40.546741+0000","last_became_active":"2024-09-12T01:03:40.580348+0000","last_became_peered":"2024-09-12T01:03:40.580348+0000","last_unstale":"2024-09-12T01:17:40.546741+0000","last_undegraded":"2024-09-12T01:17:40.546741+0000","last_fullsized":"2024-09-12T01:17:40.546741+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:17.235776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"262'8","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:28.582340+0000","last_change":"2024-09-12T00:52:40.366179+0000","last_active":"2024-09-12T01:18:28.582340+0000","last_peered":"2024-09-12T01:18:28.582340+0000","last_clean":"2024-09-12T01:18:28.582340+0000","last_became_active":"2024-09-12T00:52:40.363347+0000","last_became_peered":"2024-09-12T00:52:40.363347+0000","last_unstale":"2024-09-12T01:18:28.582340+0000","last_undegraded":"2024-09-12T01:18:28.582340+0000","last_fullsized":"2024-09-12T01:18:28.582340+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:06.883385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":21506,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:12.793072+0000","last_change":"2024-09-12T00:52:37.288899+0000","last_active":"2024-09-12T01:19:12.793072+0000","last_peered":"2024-09-12T01:19:12.793072+0000","last_clean":"2024-09-12T01:19:12.793072+0000","last_became_active":"2024-09-12T00:52:37.288074+0000","last_became_peered":"2024-09-12T00:52:37.288074+0000","last_unstale":"2024-09-12T01:19:12.793072+0000","last_undegraded":"2024-09-12T01:19:12.793072+0000","last_fullsized":"2024-09-12T01:19:12.793072+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:03.061143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'39","reported_seq":155,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.571162+0000","last_change":"2024-09-12T00:51:04.982973+0000","last_active":"2024-09-12T01:17:43.571162+0000","last_peered":"2024-09-12T01:17:43.571162+0000","last_clean":"2024-09-12T01:17:43.571162+0000","last_became_active":"2024-09-12T00:51:04.976345+0000","last_became_peered":"2024-09-12T00:51:04.976345+0000","last_unstale":"2024-09-12T01:17:43.571162+0000","last_undegraded":"2024-09-12T01:17:43.571162+0000","last_fullsized":"2024-09-12T01:17:43.571162+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:17.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":155,"num_write":57,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:42.771617+0000","last_change":"2024-09-12T01:03:40.561539+0000","last_active":"2024-09-12T01:17:42.771617+0000","last_peered":"2024-09-12T01:17:42.771617+0000","last_clean":"2024-09-12T01:17:42.771617+0000","last_became_active":"2024-09-12T01:03:40.560777+0000","last_became_peered":"2024-09-12T01:03:40.560777+0000","last_unstale":"2024-09-12T01:17:42.771617+0000","last_undegraded":"2024-09-12T01:17:42.771617+0000","last_fullsized":"2024-09-12T01:17:42.771617+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:37.457658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"265'3","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:43.411382+0000","last_change":"2024-09-12T00:52:40.353226+0000","last_active":"2024-09-12T01:21:43.411382+0000","last_peered":"2024-09-12T01:21:43.411382+0000","last_clean":"2024-09-12T01:21:43.411382+0000","last_became_active":"2024-09-12T00:52:40.352292+0000","last_became_peered":"2024-09-12T00:52:40.352292+0000","last_unstale":"2024-09-12T01:21:43.411382+0000","last_undegraded":"2024-09-12T01:21:43.411382+0000","last_fullsized":"2024-09-12T01:21:43.411382+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:37.809308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:15.567423+0000","last_change":"2024-09-12T00:52:37.286387+0000","last_active":"2024-09-12T01:19:15.567423+0000","last_peered":"2024-09-12T01:19:15.567423+0000","last_clean":"2024-09-12T01:19:15.567423+0000","last_became_active":"2024-09-12T00:52:37.284325+0000","last_became_peered":"2024-09-12T00:52:37.284325+0000","last_unstale":"2024-09-12T01:19:15.567423+0000","last_undegraded":"2024-09-12T01:19:15.567423+0000","last_fullsized":"2024-09-12T01:19:15.567423+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:25.766191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'20","reported_seq":101,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:40.546841+0000","last_change":"2024-09-12T00:51:04.962264+0000","last_active":"2024-09-12T01:17:40.546841+0000","last_peered":"2024-09-12T01:17:40.546841+0000","last_clean":"2024-09-12T01:17:40.546841+0000","last_became_active":"2024-09-12T00:51:04.961563+0000","last_became_peered":"2024-09-12T00:51:04.961563+0000","last_unstale":"2024-09-12T01:17:40.546841+0000","last_undegraded":"2024-09-12T01:17:40.546841+0000","last_fullsized":"2024-09-12T01:17:40.546841+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:40.487439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":68,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.543964+0000","last_change":"2024-09-12T01:03:40.580752+0000","last_active":"2024-09-12T01:17:43.543964+0000","last_peered":"2024-09-12T01:17:43.543964+0000","last_clean":"2024-09-12T01:17:43.543964+0000","last_became_active":"2024-09-12T01:03:40.580083+0000","last_became_peered":"2024-09-12T01:03:40.580083+0000","last_unstale":"2024-09-12T01:17:43.543964+0000","last_undegraded":"2024-09-12T01:17:43.543964+0000","last_fullsized":"2024-09-12T01:17:43.543964+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:14.771651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'5","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:42.585420+0000","last_change":"2024-09-12T00:52:40.344308+0000","last_active":"2024-09-12T01:21:42.585420+0000","last_peered":"2024-09-12T01:21:42.585420+0000","last_clean":"2024-09-12T01:21:42.585420+0000","last_became_active":"2024-09-12T00:52:40.336368+0000","last_became_peered":"2024-09-12T00:52:40.336368+0000","last_unstale":"2024-09-12T01:21:42.585420+0000","last_undegraded":"2024-09-12T01:21:42.585420+0000","last_fullsized":"2024-09-12T01:21:42.585420+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:44.066859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:13.573252+0000","last_change":"2024-09-12T00:52:37.299654+0000","last_active":"2024-09-12T01:19:13.573252+0000","last_peered":"2024-09-12T01:19:13.573252+0000","last_clean":"2024-09-12T01:19:13.573252+0000","last_became_active":"2024-09-12T00:52:37.295945+0000","last_became_peered":"2024-09-12T00:52:37.295945+0000","last_unstale":"2024-09-12T01:19:13.573252+0000","last_undegraded":"2024-09-12T01:19:13.573252+0000","last_fullsized":"2024-09-12T01:19:13.573252+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:17.464675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"265'27","reported_seq":124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.791931+0000","last_change":"2024-09-12T00:51:04.976524+0000","last_active":"2024-09-12T01:19:07.791931+0000","last_peered":"2024-09-12T01:19:07.791931+0000","last_clean":"2024-09-12T01:19:07.791931+0000","last_became_active":"2024-09-12T00:51:04.975831+0000","last_became_peered":"2024-09-12T00:51:04.975831+0000","last_unstale":"2024-09-12T01:19:07.791931+0000","last_undegraded":"2024-09-12T01:19:07.791931+0000","last_fullsized":"2024-09-12T01:19:07.791931+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:24.928244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":101,"num_write":53,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.578542+0000","last_change":"2024-09-12T01:03:40.580652+0000","last_active":"2024-09-12T01:18:13.578542+0000","last_peered":"2024-09-12T01:18:13.578542+0000","last_clean":"2024-09-12T01:18:13.578542+0000","last_became_active":"2024-09-12T01:03:40.579923+0000","last_became_peered":"2024-09-12T01:03:40.579923+0000","last_unstale":"2024-09-12T01:18:13.578542+0000","last_undegraded":"2024-09-12T01:18:13.578542+0000","last_fullsized":"2024-09-12T01:18:13.578542+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:55.542873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.562207+0000","last_change":"2024-09-12T00:52:40.350130+0000","last_active":"2024-09-12T01:18:23.562207+0000","last_peered":"2024-09-12T01:18:23.562207+0000","last_clean":"2024-09-12T01:18:23.562207+0000","last_became_active":"2024-09-12T00:52:40.349363+0000","last_became_peered":"2024-09-12T00:52:40.349363+0000","last_unstale":"2024-09-12T01:18:23.562207+0000","last_undegraded":"2024-09-12T01:18:23.562207+0000","last_fullsized":"2024-09-12T01:18:23.562207+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:18.586220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.739114+0000","last_change":"2024-09-12T00:52:37.278835+0000","last_active":"2024-09-12T01:18:17.739114+0000","last_peered":"2024-09-12T01:18:17.739114+0000","last_clean":"2024-09-12T01:18:17.739114+0000","last_became_active":"2024-09-12T00:52:37.270958+0000","last_became_peered":"2024-09-12T00:52:37.270958+0000","last_unstale":"2024-09-12T01:18:17.739114+0000","last_undegraded":"2024-09-12T01:18:17.739114+0000","last_fullsized":"2024-09-12T01:18:17.739114+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:49.398281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'19","reported_seq":96,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.791884+0000","last_change":"2024-09-12T00:51:04.976492+0000","last_active":"2024-09-12T01:19:07.791884+0000","last_peered":"2024-09-12T01:19:07.791884+0000","last_clean":"2024-09-12T01:19:07.791884+0000","last_became_active":"2024-09-12T00:51:04.975763+0000","last_became_peered":"2024-09-12T00:51:04.975763+0000","last_unstale":"2024-09-12T01:19:07.791884+0000","last_undegraded":"2024-09-12T01:19:07.791884+0000","last_fullsized":"2024-09-12T01:19:07.791884+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:51.238336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.558357+0000","last_change":"2024-09-12T01:03:40.586341+0000","last_active":"2024-09-12T01:18:13.558357+0000","last_peered":"2024-09-12T01:18:13.558357+0000","last_clean":"2024-09-12T01:18:13.558357+0000","last_became_active":"2024-09-12T01:03:40.581062+0000","last_became_peered":"2024-09-12T01:03:40.581062+0000","last_unstale":"2024-09-12T01:18:13.558357+0000","last_undegraded":"2024-09-12T01:18:13.558357+0000","last_fullsized":"2024-09-12T01:18:13.558357+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:40.147480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'10","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.659887+0000","last_change":"2024-09-12T00:52:40.344506+0000","last_active":"2024-09-12T01:21:57.659887+0000","last_peered":"2024-09-12T01:21:57.659887+0000","last_clean":"2024-09-12T01:21:57.659887+0000","last_became_active":"2024-09-12T00:52:40.343871+0000","last_became_peered":"2024-09-12T00:52:40.343871+0000","last_unstale":"2024-09-12T01:21:57.659887+0000","last_undegraded":"2024-09-12T01:21:57.659887+0000","last_fullsized":"2024-09-12T01:21:57.659887+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:04.586939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":22610,"num_write":15,"num_write_kb":6184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.579601+0000","last_change":"2024-09-12T00:52:37.281395+0000","last_active":"2024-09-12T01:18:18.579601+0000","last_peered":"2024-09-12T01:18:18.579601+0000","last_clean":"2024-09-12T01:18:18.579601+0000","last_became_active":"2024-09-12T00:52:37.276237+0000","last_became_peered":"2024-09-12T00:52:37.276237+0000","last_unstale":"2024-09-12T01:18:18.579601+0000","last_undegraded":"2024-09-12T01:18:18.579601+0000","last_fullsized":"2024-09-12T01:18:18.579601+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:50.583225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'15","reported_seq":87,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.571778+0000","last_change":"2024-09-12T00:51:04.995560+0000","last_active":"2024-09-12T01:19:08.571778+0000","last_peered":"2024-09-12T01:19:08.571778+0000","last_clean":"2024-09-12T01:19:08.571778+0000","last_became_active":"2024-09-12T00:51:04.994606+0000","last_became_peered":"2024-09-12T00:51:04.994606+0000","last_unstale":"2024-09-12T01:19:08.571778+0000","last_undegraded":"2024-09-12T01:19:08.571778+0000","last_fullsized":"2024-09-12T01:19:08.571778+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:54.892667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:48.552306+0000","last_change":"2024-09-12T01:03:40.582311+0000","last_active":"2024-09-12T01:17:48.552306+0000","last_peered":"2024-09-12T01:17:48.552306+0000","last_clean":"2024-09-12T01:17:48.552306+0000","last_became_active":"2024-09-12T01:03:40.581586+0000","last_became_peered":"2024-09-12T01:03:40.581586+0000","last_unstale":"2024-09-12T01:17:48.552306+0000","last_undegraded":"2024-09-12T01:17:48.552306+0000","last_fullsized":"2024-09-12T01:17:48.552306+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:01.950258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'7","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:43.398671+0000","last_change":"2024-09-12T00:52:40.366365+0000","last_active":"2024-09-12T01:20:43.398671+0000","last_peered":"2024-09-12T01:20:43.398671+0000","last_clean":"2024-09-12T01:20:43.398671+0000","last_became_active":"2024-09-12T00:52:40.363072+0000","last_became_peered":"2024-09-12T00:52:40.363072+0000","last_unstale":"2024-09-12T01:20:43.398671+0000","last_undegraded":"2024-09-12T01:20:43.398671+0000","last_fullsized":"2024-09-12T01:20:43.398671+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:34.771598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9232,"num_write":7,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.546176+0000","last_change":"2024-09-12T00:52:37.291760+0000","last_active":"2024-09-12T01:18:17.546176+0000","last_peered":"2024-09-12T01:18:17.546176+0000","last_clean":"2024-09-12T01:18:17.546176+0000","last_became_active":"2024-09-12T00:52:37.291045+0000","last_became_peered":"2024-09-12T00:52:37.291045+0000","last_unstale":"2024-09-12T01:18:17.546176+0000","last_undegraded":"2024-09-12T01:18:17.546176+0000","last_fullsized":"2024-09-12T01:18:17.546176+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:59.783464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'47","reported_seq":178,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.750363+0000","last_change":"2024-09-12T00:51:04.981572+0000","last_active":"2024-09-12T01:19:07.750363+0000","last_peered":"2024-09-12T01:19:07.750363+0000","last_clean":"2024-09-12T01:19:07.750363+0000","last_became_active":"2024-09-12T00:51:04.980601+0000","last_became_peered":"2024-09-12T00:51:04.980601+0000","last_unstale":"2024-09-12T01:19:07.750363+0000","last_undegraded":"2024-09-12T01:19:07.750363+0000","last_fullsized":"2024-09-12T01:19:07.750363+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:04.644563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":177,"num_write":81,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.578495+0000","last_change":"2024-09-12T01:03:40.580511+0000","last_active":"2024-09-12T01:18:13.578495+0000","last_peered":"2024-09-12T01:18:13.578495+0000","last_clean":"2024-09-12T01:18:13.578495+0000","last_became_active":"2024-09-12T01:03:40.579772+0000","last_became_peered":"2024-09-12T01:03:40.579772+0000","last_unstale":"2024-09-12T01:18:13.578495+0000","last_undegraded":"2024-09-12T01:18:13.578495+0000","last_fullsized":"2024-09-12T01:18:13.578495+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:33.962377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:22.547666+0000","last_change":"2024-09-12T00:52:40.347889+0000","last_active":"2024-09-12T01:18:22.547666+0000","last_peered":"2024-09-12T01:18:22.547666+0000","last_clean":"2024-09-12T01:18:22.547666+0000","last_became_active":"2024-09-12T00:52:40.347156+0000","last_became_peered":"2024-09-12T00:52:40.347156+0000","last_unstale":"2024-09-12T01:18:22.547666+0000","last_undegraded":"2024-09-12T01:18:22.547666+0000","last_fullsized":"2024-09-12T01:18:22.547666+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:29.288092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.552252+0000","last_change":"2024-09-12T00:52:37.291590+0000","last_active":"2024-09-12T01:18:18.552252+0000","last_peered":"2024-09-12T01:18:18.552252+0000","last_clean":"2024-09-12T01:18:18.552252+0000","last_became_active":"2024-09-12T00:52:37.290858+0000","last_became_peered":"2024-09-12T00:52:37.290858+0000","last_unstale":"2024-09-12T01:18:18.552252+0000","last_undegraded":"2024-09-12T01:18:18.552252+0000","last_fullsized":"2024-09-12T01:18:18.552252+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:11.150903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'11","reported_seq":79,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.591802+0000","last_change":"2024-09-12T00:51:04.989507+0000","last_active":"2024-09-12T01:19:08.591802+0000","last_peered":"2024-09-12T01:19:08.591802+0000","last_clean":"2024-09-12T01:19:08.591802+0000","last_became_active":"2024-09-12T00:51:04.988521+0000","last_became_peered":"2024-09-12T00:51:04.988521+0000","last_unstale":"2024-09-12T01:19:08.591802+0000","last_undegraded":"2024-09-12T01:19:08.591802+0000","last_fullsized":"2024-09-12T01:19:08.591802+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:52.795091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:55.563144+0000","last_change":"2024-09-12T01:03:40.592444+0000","last_active":"2024-09-12T01:18:55.563144+0000","last_peered":"2024-09-12T01:18:55.563144+0000","last_clean":"2024-09-12T01:18:55.563144+0000","last_became_active":"2024-09-12T01:03:40.591869+0000","last_became_peered":"2024-09-12T01:03:40.591869+0000","last_unstale":"2024-09-12T01:18:55.563144+0000","last_undegraded":"2024-09-12T01:18:55.563144+0000","last_fullsized":"2024-09-12T01:18:55.563144+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:13.806273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.600454+0000","last_change":"2024-09-12T00:52:40.345399+0000","last_active":"2024-09-12T01:19:43.600454+0000","last_peered":"2024-09-12T01:19:43.600454+0000","last_clean":"2024-09-12T01:19:43.600454+0000","last_became_active":"2024-09-12T00:52:40.344566+0000","last_became_peered":"2024-09-12T00:52:40.344566+0000","last_unstale":"2024-09-12T01:19:43.600454+0000","last_undegraded":"2024-09-12T01:19:43.600454+0000","last_fullsized":"2024-09-12T01:19:43.600454+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:08.365603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.799024+0000","last_change":"2024-09-12T00:52:37.289694+0000","last_active":"2024-09-12T01:19:37.799024+0000","last_peered":"2024-09-12T01:19:37.799024+0000","last_clean":"2024-09-12T01:19:37.799024+0000","last_became_active":"2024-09-12T00:52:37.282987+0000","last_became_peered":"2024-09-12T00:52:37.282987+0000","last_unstale":"2024-09-12T01:19:37.799024+0000","last_undegraded":"2024-09-12T01:19:37.799024+0000","last_fullsized":"2024-09-12T01:19:37.799024+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:53.081978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'40","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.578586+0000","last_change":"2024-09-12T00:51:05.001750+0000","last_active":"2024-09-12T01:18:13.578586+0000","last_peered":"2024-09-12T01:18:13.578586+0000","last_clean":"2024-09-12T01:18:13.578586+0000","last_became_active":"2024-09-12T00:51:05.001162+0000","last_became_peered":"2024-09-12T00:51:05.001162+0000","last_unstale":"2024-09-12T01:18:13.578586+0000","last_undegraded":"2024-09-12T01:18:13.578586+0000","last_fullsized":"2024-09-12T01:18:13.578586+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:51.741336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":142,"num_write":73,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:27.796530+0000","last_change":"2024-09-12T01:03:40.558405+0000","last_active":"2024-09-12T01:19:27.796530+0000","last_peered":"2024-09-12T01:19:27.796530+0000","last_clean":"2024-09-12T01:19:27.796530+0000","last_became_active":"2024-09-12T01:03:40.551803+0000","last_became_peered":"2024-09-12T01:03:40.551803+0000","last_unstale":"2024-09-12T01:19:27.796530+0000","last_undegraded":"2024-09-12T01:19:27.796530+0000","last_fullsized":"2024-09-12T01:19:27.796530+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:06.456829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.600404+0000","last_change":"2024-09-12T00:52:40.358765+0000","last_active":"2024-09-12T01:19:43.600404+0000","last_peered":"2024-09-12T01:19:43.600404+0000","last_clean":"2024-09-12T01:19:43.600404+0000","last_became_active":"2024-09-12T00:52:40.354387+0000","last_became_peered":"2024-09-12T00:52:40.354387+0000","last_unstale":"2024-09-12T01:19:43.600404+0000","last_undegraded":"2024-09-12T01:19:43.600404+0000","last_fullsized":"2024-09-12T01:19:43.600404+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:13.780637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:40.572945+0000","last_change":"2024-09-12T00:52:37.285727+0000","last_active":"2024-09-12T01:19:40.572945+0000","last_peered":"2024-09-12T01:19:40.572945+0000","last_clean":"2024-09-12T01:19:40.572945+0000","last_became_active":"2024-09-12T00:52:37.285154+0000","last_became_peered":"2024-09-12T00:52:37.285154+0000","last_unstale":"2024-09-12T01:19:40.572945+0000","last_undegraded":"2024-09-12T01:19:40.572945+0000","last_fullsized":"2024-09-12T01:19:40.572945+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:04.603498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'61","reported_seq":212,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.410803+0000","last_change":"2024-09-12T00:51:04.976377+0000","last_active":"2024-09-12T01:19:18.410803+0000","last_peered":"2024-09-12T01:19:18.410803+0000","last_clean":"2024-09-12T01:19:18.410803+0000","last_became_active":"2024-09-12T00:51:04.975583+0000","last_became_peered":"2024-09-12T00:51:04.975583+0000","last_unstale":"2024-09-12T01:19:18.410803+0000","last_undegraded":"2024-09-12T01:19:18.410803+0000","last_fullsized":"2024-09-12T01:19:18.410803+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:40.033682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":309,"num_read_kb":216,"num_write":105,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:52.554219+0000","last_change":"2024-09-12T01:03:40.570955+0000","last_active":"2024-09-12T01:18:52.554219+0000","last_peered":"2024-09-12T01:18:52.554219+0000","last_clean":"2024-09-12T01:18:52.554219+0000","last_became_active":"2024-09-12T01:03:40.569907+0000","last_became_peered":"2024-09-12T01:03:40.569907+0000","last_unstale":"2024-09-12T01:18:52.554219+0000","last_undegraded":"2024-09-12T01:18:52.554219+0000","last_fullsized":"2024-09-12T01:18:52.554219+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:17.110556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:33.551635+0000","last_change":"2024-09-12T00:52:40.343485+0000","last_active":"2024-09-12T01:17:33.551635+0000","last_peered":"2024-09-12T01:17:33.551635+0000","last_clean":"2024-09-12T01:17:33.551635+0000","last_became_active":"2024-09-12T00:52:40.342703+0000","last_became_peered":"2024-09-12T00:52:40.342703+0000","last_unstale":"2024-09-12T01:17:33.551635+0000","last_undegraded":"2024-09-12T01:17:33.551635+0000","last_fullsized":"2024-09-12T01:17:33.551635+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:39.152830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"265'6","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:53.609196+0000","last_change":"2024-09-12T00:52:37.292687+0000","last_active":"2024-09-12T01:21:53.609196+0000","last_peered":"2024-09-12T01:21:53.609196+0000","last_clean":"2024-09-12T01:21:53.609196+0000","last_became_active":"2024-09-12T00:52:37.292449+0000","last_became_peered":"2024-09-12T00:52:37.292449+0000","last_unstale":"2024-09-12T01:21:53.609196+0000","last_undegraded":"2024-09-12T01:21:53.609196+0000","last_fullsized":"2024-09-12T01:21:53.609196+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:54.986888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'116","reported_seq":403,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:32.106066+0000","last_change":"2024-09-12T00:51:04.985227+0000","last_active":"2024-09-12T01:18:32.106066+0000","last_peered":"2024-09-12T01:18:32.106066+0000","last_clean":"2024-09-12T01:18:32.106066+0000","last_became_active":"2024-09-12T00:51:04.984495+0000","last_became_peered":"2024-09-12T00:51:04.984495+0000","last_unstale":"2024-09-12T01:18:32.106066+0000","last_undegraded":"2024-09-12T01:18:32.106066+0000","last_fullsized":"2024-09-12T01:18:32.106066+0000","mapping_epoch":252,"log_start":"265'100","ondisk_log_start":"265'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:40.069078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":690,"num_read_kb":506,"num_write":167,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:52.788303+0000","last_change":"2024-09-12T01:03:40.566870+0000","last_active":"2024-09-12T01:18:52.788303+0000","last_peered":"2024-09-12T01:18:52.788303+0000","last_clean":"2024-09-12T01:18:52.788303+0000","last_became_active":"2024-09-12T01:03:40.566107+0000","last_became_peered":"2024-09-12T01:03:40.566107+0000","last_unstale":"2024-09-12T01:18:52.788303+0000","last_undegraded":"2024-09-12T01:18:52.788303+0000","last_fullsized":"2024-09-12T01:18:52.788303+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:23.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.600492+0000","last_change":"2024-09-12T00:52:40.367723+0000","last_active":"2024-09-12T01:19:43.600492+0000","last_peered":"2024-09-12T01:19:43.600492+0000","last_clean":"2024-09-12T01:19:43.600492+0000","last_became_active":"2024-09-12T00:52:40.367188+0000","last_became_peered":"2024-09-12T00:52:40.367188+0000","last_unstale":"2024-09-12T01:19:43.600492+0000","last_undegraded":"2024-09-12T01:19:43.600492+0000","last_fullsized":"2024-09-12T01:19:43.600492+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:21.283584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"265'2","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.355886+0000","last_change":"2024-09-12T00:52:37.289836+0000","last_active":"2024-09-12T01:21:57.355886+0000","last_peered":"2024-09-12T01:21:57.355886+0000","last_clean":"2024-09-12T01:21:57.355886+0000","last_became_active":"2024-09-12T00:52:37.281129+0000","last_became_peered":"2024-09-12T00:52:37.281129+0000","last_unstale":"2024-09-12T01:21:57.355886+0000","last_undegraded":"2024-09-12T01:21:57.355886+0000","last_fullsized":"2024-09-12T01:21:57.355886+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:00.364762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"265'9","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:05.551886+0000","last_change":"2024-09-12T00:51:04.984390+0000","last_active":"2024-09-12T01:18:05.551886+0000","last_peered":"2024-09-12T01:18:05.551886+0000","last_clean":"2024-09-12T01:18:05.551886+0000","last_became_active":"2024-09-12T00:51:04.983577+0000","last_became_peered":"2024-09-12T00:51:04.983577+0000","last_unstale":"2024-09-12T01:18:05.551886+0000","last_undegraded":"2024-09-12T01:18:05.551886+0000","last_fullsized":"2024-09-12T01:18:05.551886+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:11.081544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:28.596883+0000","last_change":"2024-09-12T01:03:40.590449+0000","last_active":"2024-09-12T01:19:28.596883+0000","last_peered":"2024-09-12T01:19:28.596883+0000","last_clean":"2024-09-12T01:19:28.596883+0000","last_became_active":"2024-09-12T01:03:40.589838+0000","last_became_peered":"2024-09-12T01:03:40.589838+0000","last_unstale":"2024-09-12T01:19:28.596883+0000","last_undegraded":"2024-09-12T01:19:28.596883+0000","last_fullsized":"2024-09-12T01:19:28.596883+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:53.282415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.744871+0000","last_change":"2024-09-12T00:52:40.357689+0000","last_active":"2024-09-12T01:18:42.744871+0000","last_peered":"2024-09-12T01:18:42.744871+0000","last_clean":"2024-09-12T01:18:42.744871+0000","last_became_active":"2024-09-12T00:52:40.356802+0000","last_became_peered":"2024-09-12T00:52:40.356802+0000","last_unstale":"2024-09-12T01:18:42.744871+0000","last_undegraded":"2024-09-12T01:18:42.744871+0000","last_fullsized":"2024-09-12T01:18:42.744871+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:51.102558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"265'6","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.947096+0000","last_change":"2024-09-12T00:52:37.294017+0000","last_active":"2024-09-12T01:21:56.947096+0000","last_peered":"2024-09-12T01:21:56.947096+0000","last_clean":"2024-09-12T01:21:56.947096+0000","last_became_active":"2024-09-12T00:52:37.293564+0000","last_became_peered":"2024-09-12T00:52:37.293564+0000","last_unstale":"2024-09-12T01:21:56.947096+0000","last_undegraded":"2024-09-12T01:21:56.947096+0000","last_fullsized":"2024-09-12T01:21:56.947096+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:56.643360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3128,"num_write":6,"num_write_kb":3128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"262'16","reported_seq":93,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:08.556985+0000","last_change":"2024-09-12T00:51:04.990981+0000","last_active":"2024-09-12T01:18:08.556985+0000","last_peered":"2024-09-12T01:18:08.556985+0000","last_clean":"2024-09-12T01:18:08.556985+0000","last_became_active":"2024-09-12T00:51:04.981091+0000","last_became_peered":"2024-09-12T00:51:04.981091+0000","last_unstale":"2024-09-12T01:18:08.556985+0000","last_undegraded":"2024-09-12T01:18:08.556985+0000","last_fullsized":"2024-09-12T01:18:08.556985+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:43.002634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:27.796717+0000","last_change":"2024-09-12T01:03:40.566702+0000","last_active":"2024-09-12T01:19:27.796717+0000","last_peered":"2024-09-12T01:19:27.796717+0000","last_clean":"2024-09-12T01:19:27.796717+0000","last_became_active":"2024-09-12T01:03:40.565926+0000","last_became_peered":"2024-09-12T01:03:40.565926+0000","last_unstale":"2024-09-12T01:19:27.796717+0000","last_undegraded":"2024-09-12T01:19:27.796717+0000","last_fullsized":"2024-09-12T01:19:27.796717+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:31.308325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.785653+0000","last_change":"2024-09-12T00:52:40.341080+0000","last_active":"2024-09-12T01:18:42.785653+0000","last_peered":"2024-09-12T01:18:42.785653+0000","last_clean":"2024-09-12T01:18:42.785653+0000","last_became_active":"2024-09-12T00:52:40.340423+0000","last_became_peered":"2024-09-12T00:52:40.340423+0000","last_unstale":"2024-09-12T01:18:42.785653+0000","last_undegraded":"2024-09-12T01:18:42.785653+0000","last_fullsized":"2024-09-12T01:18:42.785653+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:11.370534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"265'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.947626+0000","last_change":"2024-09-12T00:52:37.294639+0000","last_active":"2024-09-12T01:21:56.947626+0000","last_peered":"2024-09-12T01:21:56.947626+0000","last_clean":"2024-09-12T01:21:56.947626+0000","last_became_active":"2024-09-12T00:52:37.293885+0000","last_became_peered":"2024-09-12T00:52:37.293885+0000","last_unstale":"2024-09-12T01:21:56.947626+0000","last_undegraded":"2024-09-12T01:21:56.947626+0000","last_fullsized":"2024-09-12T01:21:56.947626+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:20.571782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'39","reported_seq":151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:19.686513+0000","last_change":"2024-09-12T00:51:04.989066+0000","last_active":"2024-09-12T01:19:19.686513+0000","last_peered":"2024-09-12T01:19:19.686513+0000","last_clean":"2024-09-12T01:19:19.686513+0000","last_became_active":"2024-09-12T00:51:04.988252+0000","last_became_peered":"2024-09-12T00:51:04.988252+0000","last_unstale":"2024-09-12T01:19:19.686513+0000","last_undegraded":"2024-09-12T01:19:19.686513+0000","last_fullsized":"2024-09-12T01:19:19.686513+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:49.691881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":135,"num_write":72,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:27.796591+0000","last_change":"2024-09-12T01:03:40.581034+0000","last_active":"2024-09-12T01:19:27.796591+0000","last_peered":"2024-09-12T01:19:27.796591+0000","last_clean":"2024-09-12T01:19:27.796591+0000","last_became_active":"2024-09-12T01:03:40.580376+0000","last_became_peered":"2024-09-12T01:03:40.580376+0000","last_unstale":"2024-09-12T01:19:27.796591+0000","last_undegraded":"2024-09-12T01:19:27.796591+0000","last_fullsized":"2024-09-12T01:19:27.796591+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:38.778592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.583906+0000","last_change":"2024-09-12T00:52:40.338165+0000","last_active":"2024-09-12T01:19:43.583906+0000","last_peered":"2024-09-12T01:19:43.583906+0000","last_clean":"2024-09-12T01:19:43.583906+0000","last_became_active":"2024-09-12T00:52:40.337359+0000","last_became_peered":"2024-09-12T00:52:40.337359+0000","last_unstale":"2024-09-12T01:19:43.583906+0000","last_undegraded":"2024-09-12T01:19:43.583906+0000","last_fullsized":"2024-09-12T01:19:43.583906+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:52.904218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"265'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:53.595693+0000","last_change":"2024-09-12T00:52:37.300132+0000","last_active":"2024-09-12T01:20:53.595693+0000","last_peered":"2024-09-12T01:20:53.595693+0000","last_clean":"2024-09-12T01:20:53.595693+0000","last_became_active":"2024-09-12T00:52:37.299461+0000","last_became_peered":"2024-09-12T00:52:37.299461+0000","last_unstale":"2024-09-12T01:20:53.595693+0000","last_undegraded":"2024-09-12T01:20:53.595693+0000","last_fullsized":"2024-09-12T01:20:53.595693+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:06.604639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5125,"num_write":10,"num_write_kb":5125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'112","reported_seq":395,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.594307+0000","last_change":"2024-09-12T00:51:04.983673+0000","last_active":"2024-09-12T01:19:18.594307+0000","last_peered":"2024-09-12T01:19:18.594307+0000","last_clean":"2024-09-12T01:19:18.594307+0000","last_became_active":"2024-09-12T00:51:04.975690+0000","last_became_peered":"2024-09-12T00:51:04.975690+0000","last_unstale":"2024-09-12T01:19:18.594307+0000","last_undegraded":"2024-09-12T01:19:18.594307+0000","last_fullsized":"2024-09-12T01:19:18.594307+0000","mapping_epoch":252,"log_start":"265'100","ondisk_log_start":"265'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:00.184799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":675,"num_read_kb":541,"num_write":147,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:28.576824+0000","last_change":"2024-09-12T01:03:40.586682+0000","last_active":"2024-09-12T01:19:28.576824+0000","last_peered":"2024-09-12T01:19:28.576824+0000","last_clean":"2024-09-12T01:19:28.576824+0000","last_became_active":"2024-09-12T01:03:40.585894+0000","last_became_peered":"2024-09-12T01:03:40.585894+0000","last_unstale":"2024-09-12T01:19:28.576824+0000","last_undegraded":"2024-09-12T01:19:28.576824+0000","last_fullsized":"2024-09-12T01:19:28.576824+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:09.789910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"262'3","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.785780+0000","last_change":"2024-09-12T00:52:40.355779+0000","last_active":"2024-09-12T01:18:42.785780+0000","last_peered":"2024-09-12T01:18:42.785780+0000","last_clean":"2024-09-12T01:18:42.785780+0000","last_became_active":"2024-09-12T00:52:40.355113+0000","last_became_peered":"2024-09-12T00:52:40.355113+0000","last_unstale":"2024-09-12T01:18:42.785780+0000","last_undegraded":"2024-09-12T01:18:42.785780+0000","last_fullsized":"2024-09-12T01:18:42.785780+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:00.005104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:52.587580+0000","last_change":"2024-09-12T00:52:37.281177+0000","last_active":"2024-09-12T01:21:52.587580+0000","last_peered":"2024-09-12T01:21:52.587580+0000","last_clean":"2024-09-12T01:21:52.587580+0000","last_became_active":"2024-09-12T00:52:37.280444+0000","last_became_peered":"2024-09-12T00:52:37.280444+0000","last_unstale":"2024-09-12T01:21:52.587580+0000","last_undegraded":"2024-09-12T01:21:52.587580+0000","last_fullsized":"2024-09-12T01:21:52.587580+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:12.563116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'48","reported_seq":181,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:17.559211+0000","last_change":"2024-09-12T00:51:04.985402+0000","last_active":"2024-09-12T01:19:17.559211+0000","last_peered":"2024-09-12T01:19:17.559211+0000","last_clean":"2024-09-12T01:19:17.559211+0000","last_became_active":"2024-09-12T00:51:04.984384+0000","last_became_peered":"2024-09-12T00:51:04.984384+0000","last_unstale":"2024-09-12T01:19:17.559211+0000","last_undegraded":"2024-09-12T01:19:17.559211+0000","last_fullsized":"2024-09-12T01:19:17.559211+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:51.787094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":174,"num_write":98,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.779633+0000","last_change":"2024-09-12T01:03:40.566732+0000","last_active":"2024-09-12T01:18:17.779633+0000","last_peered":"2024-09-12T01:18:17.779633+0000","last_clean":"2024-09-12T01:18:17.779633+0000","last_became_active":"2024-09-12T01:03:40.565972+0000","last_became_peered":"2024-09-12T01:03:40.565972+0000","last_unstale":"2024-09-12T01:18:17.779633+0000","last_undegraded":"2024-09-12T01:18:17.779633+0000","last_fullsized":"2024-09-12T01:18:17.779633+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:13.523686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:53.583277+0000","last_change":"2024-09-12T00:52:40.352965+0000","last_active":"2024-09-12T01:19:53.583277+0000","last_peered":"2024-09-12T01:19:53.583277+0000","last_clean":"2024-09-12T01:19:53.583277+0000","last_became_active":"2024-09-12T00:52:40.352178+0000","last_became_peered":"2024-09-12T00:52:40.352178+0000","last_unstale":"2024-09-12T01:19:53.583277+0000","last_undegraded":"2024-09-12T01:19:53.583277+0000","last_fullsized":"2024-09-12T01:19:53.583277+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:25.540435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:42.800116+0000","last_change":"2024-09-12T00:52:37.281424+0000","last_active":"2024-09-12T01:19:42.800116+0000","last_peered":"2024-09-12T01:19:42.800116+0000","last_clean":"2024-09-12T01:19:42.800116+0000","last_became_active":"2024-09-12T00:52:37.280679+0000","last_became_peered":"2024-09-12T00:52:37.280679+0000","last_unstale":"2024-09-12T01:19:42.800116+0000","last_undegraded":"2024-09-12T01:19:42.800116+0000","last_fullsized":"2024-09-12T01:19:42.800116+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:14.781208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'2","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.574476+0000","last_change":"2024-09-12T00:51:04.998155+0000","last_active":"2024-09-12T01:19:18.574476+0000","last_peered":"2024-09-12T01:19:18.574476+0000","last_clean":"2024-09-12T01:19:18.574476+0000","last_became_active":"2024-09-12T00:51:04.996736+0000","last_became_peered":"2024-09-12T00:51:04.996736+0000","last_unstale":"2024-09-12T01:19:18.574476+0000","last_undegraded":"2024-09-12T01:19:18.574476+0000","last_fullsized":"2024-09-12T01:19:18.574476+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:00.791980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.552215+0000","last_change":"2024-09-12T01:03:40.577490+0000","last_active":"2024-09-12T01:18:18.552215+0000","last_peered":"2024-09-12T01:18:18.552215+0000","last_clean":"2024-09-12T01:18:18.552215+0000","last_became_active":"2024-09-12T01:03:40.576752+0000","last_became_peered":"2024-09-12T01:03:40.576752+0000","last_unstale":"2024-09-12T01:18:18.552215+0000","last_undegraded":"2024-09-12T01:18:18.552215+0000","last_fullsized":"2024-09-12T01:18:18.552215+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:58.912810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"262'8","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.582004+0000","last_change":"2024-09-12T00:52:40.340084+0000","last_active":"2024-09-12T01:19:48.582004+0000","last_peered":"2024-09-12T01:19:48.582004+0000","last_clean":"2024-09-12T01:19:48.582004+0000","last_became_active":"2024-09-12T00:52:40.338378+0000","last_became_peered":"2024-09-12T00:52:40.338378+0000","last_unstale":"2024-09-12T01:19:48.582004+0000","last_undegraded":"2024-09-12T01:19:48.582004+0000","last_fullsized":"2024-09-12T01:19:48.582004+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:29.194283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'5","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:50.575099+0000","last_change":"2024-09-12T00:52:37.285880+0000","last_active":"2024-09-12T01:19:50.575099+0000","last_peered":"2024-09-12T01:19:50.575099+0000","last_clean":"2024-09-12T01:19:50.575099+0000","last_became_active":"2024-09-12T00:52:37.284206+0000","last_became_peered":"2024-09-12T00:52:37.284206+0000","last_unstale":"2024-09-12T01:19:50.575099+0000","last_undegraded":"2024-09-12T01:19:50.575099+0000","last_fullsized":"2024-09-12T01:19:50.575099+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:30.930785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":18432,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'21","reported_seq":106,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:17.559410+0000","last_change":"2024-09-12T00:51:04.983851+0000","last_active":"2024-09-12T01:19:17.559410+0000","last_peered":"2024-09-12T01:19:17.559410+0000","last_clean":"2024-09-12T01:19:17.559410+0000","last_became_active":"2024-09-12T00:51:04.983165+0000","last_became_peered":"2024-09-12T00:51:04.983165+0000","last_unstale":"2024-09-12T01:19:17.559410+0000","last_undegraded":"2024-09-12T01:19:17.559410+0000","last_fullsized":"2024-09-12T01:19:17.559410+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:30.417623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":73,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.584915+0000","last_change":"2024-09-12T01:03:40.579521+0000","last_active":"2024-09-12T01:19:48.584915+0000","last_peered":"2024-09-12T01:19:48.584915+0000","last_clean":"2024-09-12T01:19:48.584915+0000","last_became_active":"2024-09-12T01:03:40.578825+0000","last_became_peered":"2024-09-12T01:03:40.578825+0000","last_unstale":"2024-09-12T01:19:48.584915+0000","last_undegraded":"2024-09-12T01:19:48.584915+0000","last_fullsized":"2024-09-12T01:19:48.584915+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:02.779228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"265'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:52.815957+0000","last_change":"2024-09-12T00:52:40.353791+0000","last_active":"2024-09-12T01:20:52.815957+0000","last_peered":"2024-09-12T01:20:52.815957+0000","last_clean":"2024-09-12T01:20:52.815957+0000","last_became_active":"2024-09-12T00:52:40.352922+0000","last_became_peered":"2024-09-12T00:52:40.352922+0000","last_unstale":"2024-09-12T01:20:52.815957+0000","last_undegraded":"2024-09-12T01:20:52.815957+0000","last_fullsized":"2024-09-12T01:20:52.815957+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:33.594783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.556947+0000","last_change":"2024-09-12T00:52:37.281272+0000","last_active":"2024-09-12T01:18:38.556947+0000","last_peered":"2024-09-12T01:18:38.556947+0000","last_clean":"2024-09-12T01:18:38.556947+0000","last_became_active":"2024-09-12T00:52:37.280548+0000","last_became_peered":"2024-09-12T00:52:37.280548+0000","last_unstale":"2024-09-12T01:18:38.556947+0000","last_undegraded":"2024-09-12T01:18:38.556947+0000","last_fullsized":"2024-09-12T01:18:38.556947+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:57.882529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'10","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:12.778458+0000","last_change":"2024-09-12T00:51:04.995585+0000","last_active":"2024-09-12T01:18:12.778458+0000","last_peered":"2024-09-12T01:18:12.778458+0000","last_clean":"2024-09-12T01:18:12.778458+0000","last_became_active":"2024-09-12T00:51:04.994904+0000","last_became_peered":"2024-09-12T00:51:04.994904+0000","last_unstale":"2024-09-12T01:18:12.778458+0000","last_undegraded":"2024-09-12T01:18:12.778458+0000","last_fullsized":"2024-09-12T01:18:12.778458+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:29.572409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":34,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.739185+0000","last_change":"2024-09-12T01:03:40.577193+0000","last_active":"2024-09-12T01:18:17.739185+0000","last_peered":"2024-09-12T01:18:17.739185+0000","last_clean":"2024-09-12T01:18:17.739185+0000","last_became_active":"2024-09-12T01:03:40.576442+0000","last_became_peered":"2024-09-12T01:03:40.576442+0000","last_unstale":"2024-09-12T01:18:17.739185+0000","last_undegraded":"2024-09-12T01:18:17.739185+0000","last_fullsized":"2024-09-12T01:18:17.739185+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:03.900955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"265'6","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:52.574160+0000","last_change":"2024-09-12T00:52:40.346550+0000","last_active":"2024-09-12T01:20:52.574160+0000","last_peered":"2024-09-12T01:20:52.574160+0000","last_clean":"2024-09-12T01:20:52.574160+0000","last_became_active":"2024-09-12T00:52:40.345375+0000","last_became_peered":"2024-09-12T00:52:40.345375+0000","last_unstale":"2024-09-12T01:20:52.574160+0000","last_undegraded":"2024-09-12T01:20:52.574160+0000","last_fullsized":"2024-09-12T01:20:52.574160+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:05.935202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"262'5","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:37.784692+0000","last_change":"2024-09-12T00:52:37.282759+0000","last_active":"2024-09-12T01:18:37.784692+0000","last_peered":"2024-09-12T01:18:37.784692+0000","last_clean":"2024-09-12T01:18:37.784692+0000","last_became_active":"2024-09-12T00:52:37.282005+0000","last_became_peered":"2024-09-12T00:52:37.282005+0000","last_unstale":"2024-09-12T01:18:37.784692+0000","last_undegraded":"2024-09-12T01:18:37.784692+0000","last_fullsized":"2024-09-12T01:18:37.784692+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:50.148380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":5,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"265'13","reported_seq":82,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.560095+0000","last_change":"2024-09-12T00:51:04.991796+0000","last_active":"2024-09-12T01:18:13.560095+0000","last_peered":"2024-09-12T01:18:13.560095+0000","last_clean":"2024-09-12T01:18:13.560095+0000","last_became_active":"2024-09-12T00:51:04.990945+0000","last_became_peered":"2024-09-12T00:51:04.990945+0000","last_unstale":"2024-09-12T01:18:13.560095+0000","last_undegraded":"2024-09-12T01:18:13.560095+0000","last_fullsized":"2024-09-12T01:18:13.560095+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:18.841995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:50.562171+0000","last_change":"2024-09-12T01:03:40.582179+0000","last_active":"2024-09-12T01:18:50.562171+0000","last_peered":"2024-09-12T01:18:50.562171+0000","last_clean":"2024-09-12T01:18:50.562171+0000","last_became_active":"2024-09-12T01:03:40.581227+0000","last_became_peered":"2024-09-12T01:03:40.581227+0000","last_unstale":"2024-09-12T01:18:50.562171+0000","last_undegraded":"2024-09-12T01:18:50.562171+0000","last_fullsized":"2024-09-12T01:18:50.562171+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:44.601346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.584983+0000","last_change":"2024-09-12T00:52:40.341544+0000","last_active":"2024-09-12T01:19:48.584983+0000","last_peered":"2024-09-12T01:19:48.584983+0000","last_clean":"2024-09-12T01:19:48.584983+0000","last_became_active":"2024-09-12T00:52:40.340078+0000","last_became_peered":"2024-09-12T00:52:40.340078+0000","last_unstale":"2024-09-12T01:19:48.584983+0000","last_undegraded":"2024-09-12T01:19:48.584983+0000","last_fullsized":"2024-09-12T01:19:48.584983+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:01.427475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"262'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:37.784418+0000","last_change":"2024-09-12T00:52:37.280400+0000","last_active":"2024-09-12T01:18:37.784418+0000","last_peered":"2024-09-12T01:18:37.784418+0000","last_clean":"2024-09-12T01:18:37.784418+0000","last_became_active":"2024-09-12T00:52:37.277753+0000","last_became_peered":"2024-09-12T00:52:37.277753+0000","last_unstale":"2024-09-12T01:18:37.784418+0000","last_undegraded":"2024-09-12T01:18:37.784418+0000","last_fullsized":"2024-09-12T01:18:37.784418+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:24.031905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"254'7","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.550912+0000","last_change":"2024-09-12T00:51:04.957439+0000","last_active":"2024-09-12T01:18:13.550912+0000","last_peered":"2024-09-12T01:18:13.550912+0000","last_clean":"2024-09-12T01:18:13.550912+0000","last_became_active":"2024-09-12T00:51:04.956754+0000","last_became_peered":"2024-09-12T00:51:04.956754+0000","last_unstale":"2024-09-12T01:18:13.550912+0000","last_undegraded":"2024-09-12T01:18:13.550912+0000","last_fullsized":"2024-09-12T01:18:13.550912+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:38.742856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":30,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:53.568338+0000","last_change":"2024-09-12T01:03:40.586675+0000","last_active":"2024-09-12T01:18:53.568338+0000","last_peered":"2024-09-12T01:18:53.568338+0000","last_clean":"2024-09-12T01:18:53.568338+0000","last_became_active":"2024-09-12T01:03:40.583308+0000","last_became_peered":"2024-09-12T01:03:40.583308+0000","last_unstale":"2024-09-12T01:18:53.568338+0000","last_undegraded":"2024-09-12T01:18:53.568338+0000","last_fullsized":"2024-09-12T01:18:53.568338+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:58.594413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'6","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.619618+0000","last_change":"2024-09-12T00:52:40.333654+0000","last_active":"2024-09-12T01:21:56.619618+0000","last_peered":"2024-09-12T01:21:56.619618+0000","last_clean":"2024-09-12T01:21:56.619618+0000","last_became_active":"2024-09-12T00:52:40.332913+0000","last_became_peered":"2024-09-12T00:52:40.332913+0000","last_unstale":"2024-09-12T01:21:56.619618+0000","last_undegraded":"2024-09-12T01:21:56.619618+0000","last_fullsized":"2024-09-12T01:21:56.619618+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:55.862557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:47.828740+0000","last_change":"2024-09-12T00:52:37.287265+0000","last_active":"2024-09-12T01:21:47.828740+0000","last_peered":"2024-09-12T01:21:47.828740+0000","last_clean":"2024-09-12T01:21:47.828740+0000","last_became_active":"2024-09-12T00:52:37.282758+0000","last_became_peered":"2024-09-12T00:52:37.282758+0000","last_unstale":"2024-09-12T01:21:47.828740+0000","last_undegraded":"2024-09-12T01:21:47.828740+0000","last_fullsized":"2024-09-12T01:21:47.828740+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:54.106634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'71","reported_seq":244,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:12.738155+0000","last_change":"2024-09-12T00:51:04.983438+0000","last_active":"2024-09-12T01:18:12.738155+0000","last_peered":"2024-09-12T01:18:12.738155+0000","last_clean":"2024-09-12T01:18:12.738155+0000","last_became_active":"2024-09-12T00:51:04.982747+0000","last_became_peered":"2024-09-12T00:51:04.982747+0000","last_unstale":"2024-09-12T01:18:12.738155+0000","last_undegraded":"2024-09-12T01:18:12.738155+0000","last_fullsized":"2024-09-12T01:18:12.738155+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:57.630612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":369,"num_read_kb":267,"num_write":124,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.559537+0000","last_change":"2024-09-12T01:03:40.573794+0000","last_active":"2024-09-12T01:18:18.559537+0000","last_peered":"2024-09-12T01:18:18.559537+0000","last_clean":"2024-09-12T01:18:18.559537+0000","last_became_active":"2024-09-12T01:03:40.571968+0000","last_became_peered":"2024-09-12T01:03:40.571968+0000","last_unstale":"2024-09-12T01:18:18.559537+0000","last_undegraded":"2024-09-12T01:18:18.559537+0000","last_fullsized":"2024-09-12T01:18:18.559537+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:38.415524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'7","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:52.398884+0000","last_change":"2024-09-12T00:52:40.360097+0000","last_active":"2024-09-12T01:21:52.398884+0000","last_peered":"2024-09-12T01:21:52.398884+0000","last_clean":"2024-09-12T01:21:52.398884+0000","last_became_active":"2024-09-12T00:52:40.359434+0000","last_became_peered":"2024-09-12T00:52:40.359434+0000","last_unstale":"2024-09-12T01:21:52.398884+0000","last_undegraded":"2024-09-12T01:21:52.398884+0000","last_fullsized":"2024-09-12T01:21:52.398884+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:26.806456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":12,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'6","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.749444+0000","last_change":"2024-09-12T00:52:37.292083+0000","last_active":"2024-09-12T01:21:56.749444+0000","last_peered":"2024-09-12T01:21:56.749444+0000","last_clean":"2024-09-12T01:21:56.749444+0000","last_became_active":"2024-09-12T00:52:37.291369+0000","last_became_peered":"2024-09-12T00:52:37.291369+0000","last_unstale":"2024-09-12T01:21:56.749444+0000","last_undegraded":"2024-09-12T01:21:56.749444+0000","last_fullsized":"2024-09-12T01:21:56.749444+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:43.999305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'35","reported_seq":136,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:12.545173+0000","last_change":"2024-09-12T00:51:04.990882+0000","last_active":"2024-09-12T01:18:12.545173+0000","last_peered":"2024-09-12T01:18:12.545173+0000","last_clean":"2024-09-12T01:18:12.545173+0000","last_became_active":"2024-09-12T00:51:04.990179+0000","last_became_peered":"2024-09-12T00:51:04.990179+0000","last_unstale":"2024-09-12T01:18:12.545173+0000","last_undegraded":"2024-09-12T01:18:12.545173+0000","last_fullsized":"2024-09-12T01:18:12.545173+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:33.185513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":108,"num_write":67,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.779809+0000","last_change":"2024-09-12T01:03:40.574488+0000","last_active":"2024-09-12T01:18:17.779809+0000","last_peered":"2024-09-12T01:18:17.779809+0000","last_clean":"2024-09-12T01:18:17.779809+0000","last_became_active":"2024-09-12T01:03:40.573928+0000","last_became_peered":"2024-09-12T01:03:40.573928+0000","last_unstale":"2024-09-12T01:18:17.779809+0000","last_undegraded":"2024-09-12T01:18:17.779809+0000","last_fullsized":"2024-09-12T01:18:17.779809+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:15.934749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:47.559411+0000","last_change":"2024-09-12T00:52:40.349488+0000","last_active":"2024-09-12T01:19:47.559411+0000","last_peered":"2024-09-12T01:19:47.559411+0000","last_clean":"2024-09-12T01:19:47.559411+0000","last_became_active":"2024-09-12T00:52:40.348494+0000","last_became_peered":"2024-09-12T00:52:40.348494+0000","last_unstale":"2024-09-12T01:19:47.559411+0000","last_undegraded":"2024-09-12T01:19:47.559411+0000","last_fullsized":"2024-09-12T01:19:47.559411+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:17.271665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'2","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:42.564451+0000","last_change":"2024-09-12T00:52:37.279058+0000","last_active":"2024-09-12T01:19:42.564451+0000","last_peered":"2024-09-12T01:19:42.564451+0000","last_clean":"2024-09-12T01:19:42.564451+0000","last_became_active":"2024-09-12T00:52:37.278285+0000","last_became_peered":"2024-09-12T00:52:37.278285+0000","last_unstale":"2024-09-12T01:19:42.564451+0000","last_undegraded":"2024-09-12T01:19:42.564451+0000","last_fullsized":"2024-09-12T01:19:42.564451+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:15.749368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'29","reported_seq":125,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.791752+0000","last_change":"2024-09-12T00:51:04.986057+0000","last_active":"2024-09-12T01:19:07.791752+0000","last_peered":"2024-09-12T01:19:07.791752+0000","last_clean":"2024-09-12T01:19:07.791752+0000","last_became_active":"2024-09-12T00:51:04.984999+0000","last_became_peered":"2024-09-12T00:51:04.984999+0000","last_unstale":"2024-09-12T01:19:07.791752+0000","last_undegraded":"2024-09-12T01:19:07.791752+0000","last_fullsized":"2024-09-12T01:19:07.791752+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:46.905997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":53,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'326","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.765788+0000","last_change":"2024-09-12T00:35:43.948445+0000","last_active":"2024-09-12T01:21:57.765788+0000","last_peered":"2024-09-12T01:21:57.765788+0000","last_clean":"2024-09-12T01:21:57.765788+0000","last_became_active":"2024-09-12T00:35:43.947816+0000","last_became_peered":"2024-09-12T00:35:43.947816+0000","last_unstale":"2024-09-12T01:21:57.765788+0000","last_undegraded":"2024-09-12T01:21:57.765788+0000","last_fullsized":"2024-09-12T01:21:57.765788+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:16.574434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1291331,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":528,"num_read_kb":33235,"num_write":1073,"num_write_kb":21608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'253","reported_seq":876,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:14.250255+0000","last_change":"2024-09-12T00:35:45.926951+0000","last_active":"2024-09-12T01:19:14.250255+0000","last_peered":"2024-09-12T01:19:14.250255+0000","last_clean":"2024-09-12T01:19:14.250255+0000","last_became_active":"2024-09-12T00:35:45.925856+0000","last_became_peered":"2024-09-12T00:35:45.925856+0000","last_unstale":"2024-09-12T01:19:14.250255+0000","last_undegraded":"2024-09-12T01:19:14.250255+0000","last_fullsized":"2024-09-12T01:19:14.250255+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:07.944413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1075,"num_read_kb":882,"num_write":373,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'375","reported_seq":1039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.834716+0000","last_change":"2024-09-12T00:35:43.933369+0000","last_active":"2024-09-12T01:21:57.834716+0000","last_peered":"2024-09-12T01:21:57.834716+0000","last_clean":"2024-09-12T01:21:57.834716+0000","last_became_active":"2024-09-12T00:35:43.933088+0000","last_became_peered":"2024-09-12T00:35:43.933088+0000","last_unstale":"2024-09-12T01:21:57.834716+0000","last_undegraded":"2024-09-12T01:21:57.834716+0000","last_fullsized":"2024-09-12T01:21:57.834716+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:49.773500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":567,"num_read_kb":47488,"num_write":1216,"num_write_kb":29880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'45","reported_seq":579,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:03.587115+0000","last_change":"2024-09-12T00:35:45.947951+0000","last_active":"2024-09-12T01:19:03.587115+0000","last_peered":"2024-09-12T01:19:03.587115+0000","last_clean":"2024-09-12T01:19:03.587115+0000","last_became_active":"2024-09-12T00:35:45.947212+0000","last_became_peered":"2024-09-12T00:35:45.947212+0000","last_unstale":"2024-09-12T01:19:03.587115+0000","last_undegraded":"2024-09-12T01:19:03.587115+0000","last_fullsized":"2024-09-12T01:19:03.587115+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:09.409072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":168,"num_write":71,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'327","reported_seq":1017,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.847684+0000","last_change":"2024-09-12T00:35:43.927529+0000","last_active":"2024-09-12T01:21:57.847684+0000","last_peered":"2024-09-12T01:21:57.847684+0000","last_clean":"2024-09-12T01:21:57.847684+0000","last_became_active":"2024-09-12T00:35:43.926443+0000","last_became_peered":"2024-09-12T00:35:43.926443+0000","last_unstale":"2024-09-12T01:21:57.847684+0000","last_undegraded":"2024-09-12T01:21:57.847684+0000","last_fullsized":"2024-09-12T01:21:57.847684+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:06.887907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262209,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":553,"num_read_kb":98039,"num_write":1093,"num_write_kb":58371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'116","reported_seq":729,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.447686+0000","last_change":"2024-09-12T00:35:45.932367+0000","last_active":"2024-09-12T01:19:43.447686+0000","last_peered":"2024-09-12T01:19:43.447686+0000","last_clean":"2024-09-12T01:19:43.447686+0000","last_became_active":"2024-09-12T00:35:45.930987+0000","last_became_peered":"2024-09-12T00:35:45.930987+0000","last_unstale":"2024-09-12T01:19:43.447686+0000","last_undegraded":"2024-09-12T01:19:43.447686+0000","last_fullsized":"2024-09-12T01:19:43.447686+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:08.829843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":522,"num_read_kb":443,"num_write":187,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'380","reported_seq":1052,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.843793+0000","last_change":"2024-09-12T00:35:43.920497+0000","last_active":"2024-09-12T01:21:57.843793+0000","last_peered":"2024-09-12T01:21:57.843793+0000","last_clean":"2024-09-12T01:21:57.843793+0000","last_became_active":"2024-09-12T00:35:43.914356+0000","last_became_peered":"2024-09-12T00:35:43.914356+0000","last_unstale":"2024-09-12T01:21:57.843793+0000","last_undegraded":"2024-09-12T01:21:57.843793+0000","last_fullsized":"2024-09-12T01:21:57.843793+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:16.053246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6370276,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":596,"num_read_kb":17763,"num_write":1203,"num_write_kb":54335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'197","reported_seq":794,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:40.733551+0000","last_change":"2024-09-12T00:35:45.943011+0000","last_active":"2024-09-12T01:19:40.733551+0000","last_peered":"2024-09-12T01:19:40.733551+0000","last_clean":"2024-09-12T01:19:40.733551+0000","last_became_active":"2024-09-12T00:35:45.942567+0000","last_became_peered":"2024-09-12T00:35:45.942567+0000","last_unstale":"2024-09-12T01:19:40.733551+0000","last_undegraded":"2024-09-12T01:19:40.733551+0000","last_fullsized":"2024-09-12T01:19:40.733551+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:28.500033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":861,"num_read_kb":699,"num_write":314,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'338","reported_seq":995,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.782673+0000","last_change":"2024-09-12T00:35:43.945400+0000","last_active":"2024-09-12T01:21:57.782673+0000","last_peered":"2024-09-12T01:21:57.782673+0000","last_clean":"2024-09-12T01:21:57.782673+0000","last_became_active":"2024-09-12T00:35:43.944644+0000","last_became_peered":"2024-09-12T00:35:43.944644+0000","last_unstale":"2024-09-12T01:21:57.782673+0000","last_undegraded":"2024-09-12T01:21:57.782673+0000","last_fullsized":"2024-09-12T01:21:57.782673+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:50.172251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289235,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":584,"num_read_kb":29244,"num_write":1169,"num_write_kb":25136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'341","reported_seq":1075,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.255694+0000","last_change":"2024-09-12T00:35:45.943860+0000","last_active":"2024-09-12T01:20:22.255694+0000","last_peered":"2024-09-12T01:20:22.255694+0000","last_clean":"2024-09-12T01:20:22.255694+0000","last_became_active":"2024-09-12T00:35:45.943110+0000","last_became_peered":"2024-09-12T00:35:45.943110+0000","last_unstale":"2024-09-12T01:20:22.255694+0000","last_undegraded":"2024-09-12T01:20:22.255694+0000","last_fullsized":"2024-09-12T01:20:22.255694+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:24.346213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1719,"num_read_kb":1451,"num_write":623,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'333","reported_seq":943,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.794513+0000","last_change":"2024-09-12T00:35:43.930576+0000","last_active":"2024-09-12T01:21:57.794513+0000","last_peered":"2024-09-12T01:21:57.794513+0000","last_clean":"2024-09-12T01:21:57.794513+0000","last_became_active":"2024-09-12T00:35:43.929553+0000","last_became_peered":"2024-09-12T00:35:43.929553+0000","last_unstale":"2024-09-12T01:21:57.794513+0000","last_undegraded":"2024-09-12T01:21:57.794513+0000","last_fullsized":"2024-09-12T01:21:57.794513+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:22.833352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8021586,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":453,"num_read_kb":14436,"num_write":1125,"num_write_kb":49786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'350","reported_seq":931,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:00.371052+0000","last_change":"2024-09-12T00:35:45.934966+0000","last_active":"2024-09-12T01:20:00.371052+0000","last_peered":"2024-09-12T01:20:00.371052+0000","last_clean":"2024-09-12T01:20:00.371052+0000","last_became_active":"2024-09-12T00:35:45.934193+0000","last_became_peered":"2024-09-12T00:35:45.934193+0000","last_unstale":"2024-09-12T01:20:00.371052+0000","last_undegraded":"2024-09-12T01:20:00.371052+0000","last_fullsized":"2024-09-12T01:20:00.371052+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:43.914081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1452,"num_read_kb":1165,"num_write":550,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'389","reported_seq":1070,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.822478+0000","last_change":"2024-09-12T00:35:43.942971+0000","last_active":"2024-09-12T01:21:57.822478+0000","last_peered":"2024-09-12T01:21:57.822478+0000","last_clean":"2024-09-12T01:21:57.822478+0000","last_became_active":"2024-09-12T00:35:43.942199+0000","last_became_peered":"2024-09-12T00:35:43.942199+0000","last_unstale":"2024-09-12T01:21:57.822478+0000","last_undegraded":"2024-09-12T01:21:57.822478+0000","last_fullsized":"2024-09-12T01:21:57.822478+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:07.698617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":647,"num_read_kb":42927,"num_write":1206,"num_write_kb":42524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'254","reported_seq":917,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:33.569572+0000","last_change":"2024-09-12T00:35:45.938322+0000","last_active":"2024-09-12T01:19:33.569572+0000","last_peered":"2024-09-12T01:19:33.569572+0000","last_clean":"2024-09-12T01:19:33.569572+0000","last_became_active":"2024-09-12T00:35:45.937211+0000","last_became_peered":"2024-09-12T00:35:45.937211+0000","last_unstale":"2024-09-12T01:19:33.569572+0000","last_undegraded":"2024-09-12T01:19:33.569572+0000","last_fullsized":"2024-09-12T01:19:33.569572+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:08.919655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1131,"num_read_kb":929,"num_write":387,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'357","reported_seq":1040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.824404+0000","last_change":"2024-09-12T00:35:43.920009+0000","last_active":"2024-09-12T01:21:57.824404+0000","last_peered":"2024-09-12T01:21:57.824404+0000","last_clean":"2024-09-12T01:21:57.824404+0000","last_became_active":"2024-09-12T00:35:43.918653+0000","last_became_peered":"2024-09-12T00:35:43.918653+0000","last_unstale":"2024-09-12T01:21:57.824404+0000","last_undegraded":"2024-09-12T01:21:57.824404+0000","last_fullsized":"2024-09-12T01:21:57.824404+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:08.630692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262196,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":641,"num_read_kb":7519,"num_write":1239,"num_write_kb":32586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'269","reported_seq":929,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:51.427937+0000","last_change":"2024-09-12T00:35:45.942221+0000","last_active":"2024-09-12T01:19:51.427937+0000","last_peered":"2024-09-12T01:19:51.427937+0000","last_clean":"2024-09-12T01:19:51.427937+0000","last_became_active":"2024-09-12T00:35:45.941814+0000","last_became_peered":"2024-09-12T00:35:45.941814+0000","last_unstale":"2024-09-12T01:19:51.427937+0000","last_undegraded":"2024-09-12T01:19:51.427937+0000","last_fullsized":"2024-09-12T01:19:51.427937+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:48.303334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1198,"num_read_kb":983,"num_write":434,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'104","reported_seq":678,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:36.090439+0000","last_change":"2024-09-12T00:35:45.930414+0000","last_active":"2024-09-12T01:19:36.090439+0000","last_peered":"2024-09-12T01:19:36.090439+0000","last_clean":"2024-09-12T01:19:36.090439+0000","last_became_active":"2024-09-12T00:35:45.929168+0000","last_became_peered":"2024-09-12T00:35:45.929168+0000","last_unstale":"2024-09-12T01:19:36.090439+0000","last_undegraded":"2024-09-12T01:19:36.090439+0000","last_fullsized":"2024-09-12T01:19:36.090439+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:46.680426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":468,"num_read_kb":393,"num_write":157,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'368","reported_seq":1017,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.776450+0000","last_change":"2024-09-12T00:35:43.951280+0000","last_active":"2024-09-12T01:21:57.776450+0000","last_peered":"2024-09-12T01:21:57.776450+0000","last_clean":"2024-09-12T01:21:57.776450+0000","last_became_active":"2024-09-12T00:35:43.949857+0000","last_became_peered":"2024-09-12T00:35:43.949857+0000","last_unstale":"2024-09-12T01:21:57.776450+0000","last_undegraded":"2024-09-12T01:21:57.776450+0000","last_fullsized":"2024-09-12T01:21:57.776450+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:10.127383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":539,"num_read_kb":3399,"num_write":1112,"num_write_kb":43442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'111","reported_seq":684,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:47.772837+0000","last_change":"2024-09-12T00:35:45.948146+0000","last_active":"2024-09-12T01:17:47.772837+0000","last_peered":"2024-09-12T01:17:47.772837+0000","last_clean":"2024-09-12T01:17:47.772837+0000","last_became_active":"2024-09-12T00:35:45.947366+0000","last_became_peered":"2024-09-12T00:35:45.947366+0000","last_unstale":"2024-09-12T01:17:47.772837+0000","last_undegraded":"2024-09-12T01:17:47.772837+0000","last_fullsized":"2024-09-12T01:17:47.772837+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:11.387874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":482,"num_read_kb":394,"num_write":173,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'337","reported_seq":1012,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.362442+0000","last_change":"2024-09-12T00:35:43.926785+0000","last_active":"2024-09-12T01:21:57.362442+0000","last_peered":"2024-09-12T01:21:57.362442+0000","last_clean":"2024-09-12T01:21:57.362442+0000","last_became_active":"2024-09-12T00:35:43.926027+0000","last_became_peered":"2024-09-12T00:35:43.926027+0000","last_unstale":"2024-09-12T01:21:57.362442+0000","last_undegraded":"2024-09-12T01:21:57.362442+0000","last_fullsized":"2024-09-12T01:21:57.362442+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:47.685516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6341811,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":547,"num_read_kb":69210,"num_write":1239,"num_write_kb":64702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'169","reported_seq":777,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:58.547349+0000","last_change":"2024-09-12T00:35:45.933189+0000","last_active":"2024-09-12T01:17:58.547349+0000","last_peered":"2024-09-12T01:17:58.547349+0000","last_clean":"2024-09-12T01:17:58.547349+0000","last_became_active":"2024-09-12T00:35:45.932116+0000","last_became_peered":"2024-09-12T00:35:45.932116+0000","last_unstale":"2024-09-12T01:17:58.547349+0000","last_undegraded":"2024-09-12T01:17:58.547349+0000","last_fullsized":"2024-09-12T01:17:58.547349+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:10.046459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":828,"num_read_kb":701,"num_write":304,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'331","reported_seq":1019,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.360497+0000","last_change":"2024-09-12T00:36:17.046117+0000","last_active":"2024-09-12T01:21:57.360497+0000","last_peered":"2024-09-12T01:21:57.360497+0000","last_clean":"2024-09-12T01:21:57.360497+0000","last_became_active":"2024-09-12T00:36:17.045217+0000","last_became_peered":"2024-09-12T00:36:17.045217+0000","last_unstale":"2024-09-12T01:21:57.360497+0000","last_undegraded":"2024-09-12T01:21:57.360497+0000","last_fullsized":"2024-09-12T01:21:57.360497+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:17.813892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3859835,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":565,"num_read_kb":9910,"num_write":1060,"num_write_kb":33583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'99","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:56.473406+0000","last_change":"2024-09-12T00:35:45.939622+0000","last_active":"2024-09-12T01:19:56.473406+0000","last_peered":"2024-09-12T01:19:56.473406+0000","last_clean":"2024-09-12T01:19:56.473406+0000","last_became_active":"2024-09-12T00:35:45.939261+0000","last_became_peered":"2024-09-12T00:35:45.939261+0000","last_unstale":"2024-09-12T01:19:56.473406+0000","last_undegraded":"2024-09-12T01:19:56.473406+0000","last_fullsized":"2024-09-12T01:19:56.473406+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:47.746126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":439,"num_read_kb":359,"num_write":158,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'322","reported_seq":962,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.558934+0000","last_change":"2024-09-12T00:35:43.949757+0000","last_active":"2024-09-12T01:21:57.558934+0000","last_peered":"2024-09-12T01:21:57.558934+0000","last_clean":"2024-09-12T01:21:57.558934+0000","last_became_active":"2024-09-12T00:35:43.949045+0000","last_became_peered":"2024-09-12T00:35:43.949045+0000","last_unstale":"2024-09-12T01:21:57.558934+0000","last_undegraded":"2024-09-12T01:21:57.558934+0000","last_fullsized":"2024-09-12T01:21:57.558934+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:36.497824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5533541,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":537,"num_read_kb":18745,"num_write":1019,"num_write_kb":46080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'126","reported_seq":725,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:46.094592+0000","last_change":"2024-09-12T00:35:45.943288+0000","last_active":"2024-09-12T01:19:46.094592+0000","last_peered":"2024-09-12T01:19:46.094592+0000","last_clean":"2024-09-12T01:19:46.094592+0000","last_became_active":"2024-09-12T00:35:45.942814+0000","last_became_peered":"2024-09-12T00:35:45.942814+0000","last_unstale":"2024-09-12T01:19:46.094592+0000","last_undegraded":"2024-09-12T01:19:46.094592+0000","last_fullsized":"2024-09-12T01:19:46.094592+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:06.467847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":574,"num_read_kb":483,"num_write":214,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'319","reported_seq":933,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.784921+0000","last_change":"2024-09-12T00:35:43.939756+0000","last_active":"2024-09-12T01:21:57.784921+0000","last_peered":"2024-09-12T01:21:57.784921+0000","last_clean":"2024-09-12T01:21:57.784921+0000","last_became_active":"2024-09-12T00:35:43.939128+0000","last_became_peered":"2024-09-12T00:35:43.939128+0000","last_unstale":"2024-09-12T01:21:57.784921+0000","last_undegraded":"2024-09-12T01:21:57.784921+0000","last_fullsized":"2024-09-12T01:21:57.784921+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:36.964204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":453,"num_read_kb":9693,"num_write":1061,"num_write_kb":13466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'4124","reported_seq":4720,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:01.277760+0000","last_change":"2024-09-12T00:35:45.944333+0000","last_active":"2024-09-12T01:20:01.277760+0000","last_peered":"2024-09-12T01:20:01.277760+0000","last_clean":"2024-09-12T01:20:01.277760+0000","last_became_active":"2024-09-12T00:35:45.943253+0000","last_became_peered":"2024-09-12T00:35:45.943253+0000","last_unstale":"2024-09-12T01:20:01.277760+0000","last_undegraded":"2024-09-12T01:20:01.277760+0000","last_fullsized":"2024-09-12T01:20:01.277760+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:04.022329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16581,"num_read_kb":13903,"num_write":6185,"num_write_kb":3084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'354","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.850617+0000","last_change":"2024-09-12T00:35:43.933614+0000","last_active":"2024-09-12T01:21:57.850617+0000","last_peered":"2024-09-12T01:21:57.850617+0000","last_clean":"2024-09-12T01:21:57.850617+0000","last_became_active":"2024-09-12T00:35:43.933191+0000","last_became_peered":"2024-09-12T00:35:43.933191+0000","last_unstale":"2024-09-12T01:21:57.850617+0000","last_undegraded":"2024-09-12T01:21:57.850617+0000","last_fullsized":"2024-09-12T01:21:57.850617+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:15.373281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":549,"num_read_kb":44649,"num_write":1012,"num_write_kb":28437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'146","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.077594+0000","last_change":"2024-09-12T00:35:53.985466+0000","last_active":"2024-09-12T01:20:23.077594+0000","last_peered":"2024-09-12T01:20:23.077594+0000","last_clean":"2024-09-12T01:20:23.077594+0000","last_became_active":"2024-09-12T00:35:53.981609+0000","last_became_peered":"2024-09-12T00:35:53.981609+0000","last_unstale":"2024-09-12T01:20:23.077594+0000","last_undegraded":"2024-09-12T01:20:23.077594+0000","last_fullsized":"2024-09-12T01:20:23.077594+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:05.745536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":187,"num_read_kb":176,"num_write":375,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'258","reported_seq":901,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:50.602115+0000","last_change":"2024-09-12T00:35:45.948978+0000","last_active":"2024-09-12T01:18:50.602115+0000","last_peered":"2024-09-12T01:18:50.602115+0000","last_clean":"2024-09-12T01:18:50.602115+0000","last_became_active":"2024-09-12T00:35:45.948575+0000","last_became_peered":"2024-09-12T00:35:45.948575+0000","last_unstale":"2024-09-12T01:18:50.602115+0000","last_undegraded":"2024-09-12T01:18:50.602115+0000","last_fullsized":"2024-09-12T01:18:50.602115+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:55.123044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1199,"num_read_kb":1005,"num_write":430,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"265'282","reported_seq":879,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.805974+0000","last_change":"2024-09-12T00:35:43.957625+0000","last_active":"2024-09-12T01:21:57.805974+0000","last_peered":"2024-09-12T01:21:57.805974+0000","last_clean":"2024-09-12T01:21:57.805974+0000","last_became_active":"2024-09-12T00:35:43.956812+0000","last_became_peered":"2024-09-12T00:35:43.956812+0000","last_unstale":"2024-09-12T01:21:57.805974+0000","last_undegraded":"2024-09-12T01:21:57.805974+0000","last_fullsized":"2024-09-12T01:21:57.805974+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:33.110636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":409,"num_read_kb":399,"num_write":954,"num_write_kb":26614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.566225+0000","last_change":"2024-09-12T00:35:47.933988+0000","last_active":"2024-09-12T01:19:18.566225+0000","last_peered":"2024-09-12T01:19:18.566225+0000","last_clean":"2024-09-12T01:19:18.566225+0000","last_became_active":"2024-09-12T00:35:47.933249+0000","last_became_peered":"2024-09-12T00:35:47.933249+0000","last_unstale":"2024-09-12T01:19:18.566225+0000","last_undegraded":"2024-09-12T01:19:18.566225+0000","last_fullsized":"2024-09-12T01:19:18.566225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:47.085642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'339","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.735988+0000","last_change":"2024-09-12T00:35:49.952443+0000","last_active":"2024-09-12T01:21:57.735988+0000","last_peered":"2024-09-12T01:21:57.735988+0000","last_clean":"2024-09-12T01:21:57.735988+0000","last_became_active":"2024-09-12T00:35:49.951438+0000","last_became_peered":"2024-09-12T00:35:49.951438+0000","last_unstale":"2024-09-12T01:21:57.735988+0000","last_undegraded":"2024-09-12T01:21:57.735988+0000","last_fullsized":"2024-09-12T01:21:57.735988+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:58.543209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44615,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":554,"num_read_kb":1150,"num_write":438,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:22.795536+0000","last_change":"2024-09-12T00:35:51.984956+0000","last_active":"2024-09-12T01:19:22.795536+0000","last_peered":"2024-09-12T01:19:22.795536+0000","last_clean":"2024-09-12T01:19:22.795536+0000","last_became_active":"2024-09-12T00:35:51.984350+0000","last_became_peered":"2024-09-12T00:35:51.984350+0000","last_unstale":"2024-09-12T01:19:22.795536+0000","last_undegraded":"2024-09-12T01:19:22.795536+0000","last_fullsized":"2024-09-12T01:19:22.795536+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:25.562363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'203","reported_seq":801,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:17.805609+0000","last_change":"2024-09-12T00:35:53.998522+0000","last_active":"2024-09-12T01:20:17.805609+0000","last_peered":"2024-09-12T01:20:17.805609+0000","last_clean":"2024-09-12T01:20:17.805609+0000","last_became_active":"2024-09-12T00:35:53.995513+0000","last_became_peered":"2024-09-12T00:35:53.995513+0000","last_unstale":"2024-09-12T01:20:17.805609+0000","last_undegraded":"2024-09-12T01:20:17.805609+0000","last_fullsized":"2024-09-12T01:20:17.805609+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:28.256858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":409,"num_read_kb":360,"num_write":396,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'241","reported_seq":868,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:07.808738+0000","last_change":"2024-09-12T00:35:45.940693+0000","last_active":"2024-09-12T01:20:07.808738+0000","last_peered":"2024-09-12T01:20:07.808738+0000","last_clean":"2024-09-12T01:20:07.808738+0000","last_became_active":"2024-09-12T00:35:45.939962+0000","last_became_peered":"2024-09-12T00:35:45.939962+0000","last_unstale":"2024-09-12T01:20:07.808738+0000","last_undegraded":"2024-09-12T01:20:07.808738+0000","last_fullsized":"2024-09-12T01:20:07.808738+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:44.308762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1036,"num_read_kb":844,"num_write":371,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'368","reported_seq":1072,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.848475+0000","last_change":"2024-09-12T00:35:43.945052+0000","last_active":"2024-09-12T01:21:57.848475+0000","last_peered":"2024-09-12T01:21:57.848475+0000","last_clean":"2024-09-12T01:21:57.848475+0000","last_became_active":"2024-09-12T00:35:43.944705+0000","last_became_peered":"2024-09-12T00:35:43.944705+0000","last_unstale":"2024-09-12T01:21:57.848475+0000","last_undegraded":"2024-09-12T01:21:57.848475+0000","last_fullsized":"2024-09-12T01:21:57.848475+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:40.455249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1344150,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":792,"num_read_kb":8209,"num_write":1184,"num_write_kb":28685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:58.575009+0000","last_change":"2024-09-12T00:35:47.946592+0000","last_active":"2024-09-12T01:17:58.575009+0000","last_peered":"2024-09-12T01:17:58.575009+0000","last_clean":"2024-09-12T01:17:58.575009+0000","last_became_active":"2024-09-12T00:35:47.945971+0000","last_became_peered":"2024-09-12T00:35:47.945971+0000","last_unstale":"2024-09-12T01:17:58.575009+0000","last_undegraded":"2024-09-12T01:17:58.575009+0000","last_fullsized":"2024-09-12T01:17:58.575009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:39.808186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'93","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:22.553249+0000","last_change":"2024-09-12T00:35:49.939105+0000","last_active":"2024-09-12T01:19:22.553249+0000","last_peered":"2024-09-12T01:19:22.553249+0000","last_clean":"2024-09-12T01:19:22.553249+0000","last_became_active":"2024-09-12T00:35:49.938374+0000","last_became_peered":"2024-09-12T00:35:49.938374+0000","last_unstale":"2024-09-12T01:19:22.553249+0000","last_undegraded":"2024-09-12T01:19:22.553249+0000","last_fullsized":"2024-09-12T01:19:22.553249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:28.914067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:22.553202+0000","last_change":"2024-09-12T00:35:51.975432+0000","last_active":"2024-09-12T01:19:22.553202+0000","last_peered":"2024-09-12T01:19:22.553202+0000","last_clean":"2024-09-12T01:19:22.553202+0000","last_became_active":"2024-09-12T00:35:51.974659+0000","last_became_peered":"2024-09-12T00:35:51.974659+0000","last_unstale":"2024-09-12T01:19:22.553202+0000","last_undegraded":"2024-09-12T01:19:22.553202+0000","last_fullsized":"2024-09-12T01:19:22.553202+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:42.719938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'114","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:44.542108+0000","last_change":"2024-09-12T00:35:53.994008+0000","last_active":"2024-09-12T01:19:44.542108+0000","last_peered":"2024-09-12T01:19:44.542108+0000","last_clean":"2024-09-12T01:19:44.542108+0000","last_became_active":"2024-09-12T00:35:53.992311+0000","last_became_peered":"2024-09-12T00:35:53.992311+0000","last_unstale":"2024-09-12T01:19:44.542108+0000","last_undegraded":"2024-09-12T01:19:44.542108+0000","last_fullsized":"2024-09-12T01:19:44.542108+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:28.357194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":265,"num_read_kb":226,"num_write":268,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'268","reported_seq":913,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.574373+0000","last_change":"2024-09-12T00:35:45.941958+0000","last_active":"2024-09-12T01:19:18.574373+0000","last_peered":"2024-09-12T01:19:18.574373+0000","last_clean":"2024-09-12T01:19:18.574373+0000","last_became_active":"2024-09-12T00:35:45.941543+0000","last_became_peered":"2024-09-12T00:35:45.941543+0000","last_unstale":"2024-09-12T01:19:18.574373+0000","last_undegraded":"2024-09-12T01:19:18.574373+0000","last_fullsized":"2024-09-12T01:19:18.574373+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:08.224075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1165,"num_read_kb":955,"num_write":416,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'387","reported_seq":1101,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.785682+0000","last_change":"2024-09-12T00:35:43.953442+0000","last_active":"2024-09-12T01:21:57.785682+0000","last_peered":"2024-09-12T01:21:57.785682+0000","last_clean":"2024-09-12T01:21:57.785682+0000","last_became_active":"2024-09-12T00:35:43.952543+0000","last_became_peered":"2024-09-12T00:35:43.952543+0000","last_unstale":"2024-09-12T01:21:57.785682+0000","last_undegraded":"2024-09-12T01:21:57.785682+0000","last_fullsized":"2024-09-12T01:21:57.785682+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:44.952950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262206,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":771,"num_read_kb":780,"num_write":1220,"num_write_kb":19641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.594613+0000","last_change":"2024-09-12T00:35:47.934527+0000","last_active":"2024-09-12T01:19:18.594613+0000","last_peered":"2024-09-12T01:19:18.594613+0000","last_clean":"2024-09-12T01:19:18.594613+0000","last_became_active":"2024-09-12T00:35:47.933896+0000","last_became_peered":"2024-09-12T00:35:47.933896+0000","last_unstale":"2024-09-12T01:19:18.594613+0000","last_undegraded":"2024-09-12T01:19:18.594613+0000","last_fullsized":"2024-09-12T01:19:18.594613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:11.718346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'113","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.483543+0000","last_change":"2024-09-12T00:35:49.937626+0000","last_active":"2024-09-12T01:18:23.483543+0000","last_peered":"2024-09-12T01:18:23.483543+0000","last_clean":"2024-09-12T01:18:23.483543+0000","last_became_active":"2024-09-12T00:35:49.936846+0000","last_became_peered":"2024-09-12T00:35:49.936846+0000","last_unstale":"2024-09-12T01:18:23.483543+0000","last_undegraded":"2024-09-12T01:18:23.483543+0000","last_fullsized":"2024-09-12T01:18:23.483543+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:16.548831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":139,"num_read_kb":131,"num_write":92,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'772","reported_seq":2287,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.351324+0000","last_change":"2024-09-12T00:35:51.980021+0000","last_active":"2024-09-12T01:21:57.351324+0000","last_peered":"2024-09-12T01:21:57.351324+0000","last_clean":"2024-09-12T01:21:57.351324+0000","last_became_active":"2024-09-12T00:35:51.979288+0000","last_became_peered":"2024-09-12T00:35:51.979288+0000","last_unstale":"2024-09-12T01:21:57.351324+0000","last_undegraded":"2024-09-12T01:21:57.351324+0000","last_fullsized":"2024-09-12T01:21:57.351324+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:56.227079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'188","reported_seq":1012,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.127347+0000","last_change":"2024-09-12T00:35:54.014161+0000","last_active":"2024-09-12T01:20:23.127347+0000","last_peered":"2024-09-12T01:20:23.127347+0000","last_clean":"2024-09-12T01:20:23.127347+0000","last_became_active":"2024-09-12T00:35:54.013299+0000","last_became_peered":"2024-09-12T00:35:54.013299+0000","last_unstale":"2024-09-12T01:20:23.127347+0000","last_undegraded":"2024-09-12T01:20:23.127347+0000","last_fullsized":"2024-09-12T01:20:23.127347+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:35.433076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":837,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":580,"num_read_kb":578,"num_write":407,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'105","reported_seq":677,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.594579+0000","last_change":"2024-09-12T00:35:45.955221+0000","last_active":"2024-09-12T01:19:18.594579+0000","last_peered":"2024-09-12T01:19:18.594579+0000","last_clean":"2024-09-12T01:19:18.594579+0000","last_became_active":"2024-09-12T00:35:45.954858+0000","last_became_peered":"2024-09-12T00:35:45.954858+0000","last_unstale":"2024-09-12T01:19:18.594579+0000","last_undegraded":"2024-09-12T01:19:18.594579+0000","last_fullsized":"2024-09-12T01:19:18.594579+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:35.164506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":470,"num_read_kb":391,"num_write":166,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'330","reported_seq":986,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.376538+0000","last_change":"2024-09-12T00:35:43.931623+0000","last_active":"2024-09-12T01:21:57.376538+0000","last_peered":"2024-09-12T01:21:57.376538+0000","last_clean":"2024-09-12T01:21:57.376538+0000","last_became_active":"2024-09-12T00:35:43.930867+0000","last_became_peered":"2024-09-12T00:35:43.930867+0000","last_unstale":"2024-09-12T01:21:57.376538+0000","last_undegraded":"2024-09-12T01:21:57.376538+0000","last_fullsized":"2024-09-12T01:21:57.376538+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:00.843291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291822,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":504,"num_read_kb":73816,"num_write":1045,"num_write_kb":41341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.566330+0000","last_change":"2024-09-12T00:35:47.931572+0000","last_active":"2024-09-12T01:19:18.566330+0000","last_peered":"2024-09-12T01:19:18.566330+0000","last_clean":"2024-09-12T01:19:18.566330+0000","last_became_active":"2024-09-12T00:35:47.930883+0000","last_became_peered":"2024-09-12T00:35:47.930883+0000","last_unstale":"2024-09-12T01:19:18.566330+0000","last_undegraded":"2024-09-12T01:19:18.566330+0000","last_fullsized":"2024-09-12T01:19:18.566330+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:26.632000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'289","reported_seq":861,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.543556+0000","last_change":"2024-09-12T00:35:50.030382+0000","last_active":"2024-09-12T01:21:57.543556+0000","last_peered":"2024-09-12T01:21:57.543556+0000","last_clean":"2024-09-12T01:21:57.543556+0000","last_became_active":"2024-09-12T00:35:50.029236+0000","last_became_peered":"2024-09-12T00:35:50.029236+0000","last_unstale":"2024-09-12T01:21:57.543556+0000","last_undegraded":"2024-09-12T01:21:57.543556+0000","last_fullsized":"2024-09-12T01:21:57.543556+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:36.054917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54671,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":1128,"num_write":386,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'786","reported_seq":2331,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.316034+0000","last_change":"2024-09-12T00:35:51.983959+0000","last_active":"2024-09-12T01:21:57.316034+0000","last_peered":"2024-09-12T01:21:57.316034+0000","last_clean":"2024-09-12T01:21:57.316034+0000","last_became_active":"2024-09-12T00:35:51.983271+0000","last_became_peered":"2024-09-12T00:35:51.983271+0000","last_unstale":"2024-09-12T01:21:57.316034+0000","last_undegraded":"2024-09-12T01:21:57.316034+0000","last_fullsized":"2024-09-12T01:21:57.316034+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:13.842922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'260","reported_seq":932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.563677+0000","last_change":"2024-09-12T00:35:45.940778+0000","last_active":"2024-09-12T01:19:08.563677+0000","last_peered":"2024-09-12T01:19:08.563677+0000","last_clean":"2024-09-12T01:19:08.563677+0000","last_became_active":"2024-09-12T00:35:45.940073+0000","last_became_peered":"2024-09-12T00:35:45.940073+0000","last_unstale":"2024-09-12T01:19:08.563677+0000","last_undegraded":"2024-09-12T01:19:08.563677+0000","last_fullsized":"2024-09-12T01:19:08.563677+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:47.849352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1192,"num_read_kb":982,"num_write":401,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'350","reported_seq":1059,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.796405+0000","last_change":"2024-09-12T00:35:43.957315+0000","last_active":"2024-09-12T01:21:57.796405+0000","last_peered":"2024-09-12T01:21:57.796405+0000","last_clean":"2024-09-12T01:21:57.796405+0000","last_became_active":"2024-09-12T00:35:43.956814+0000","last_became_peered":"2024-09-12T00:35:43.956814+0000","last_unstale":"2024-09-12T01:21:57.796405+0000","last_undegraded":"2024-09-12T01:21:57.796405+0000","last_fullsized":"2024-09-12T01:21:57.796405+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:24.210436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":765,"num_read_kb":6356,"num_write":994,"num_write_kb":17273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.791834+0000","last_change":"2024-09-12T00:35:47.945726+0000","last_active":"2024-09-12T01:19:07.791834+0000","last_peered":"2024-09-12T01:19:07.791834+0000","last_clean":"2024-09-12T01:19:07.791834+0000","last_became_active":"2024-09-12T00:35:47.944913+0000","last_became_peered":"2024-09-12T00:35:47.944913+0000","last_unstale":"2024-09-12T01:19:07.791834+0000","last_undegraded":"2024-09-12T01:19:07.791834+0000","last_fullsized":"2024-09-12T01:19:07.791834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:02.558771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'348","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.872006+0000","last_change":"2024-09-12T00:35:50.028219+0000","last_active":"2024-09-12T01:21:57.872006+0000","last_peered":"2024-09-12T01:21:57.872006+0000","last_clean":"2024-09-12T01:21:57.872006+0000","last_became_active":"2024-09-12T00:35:50.027282+0000","last_became_peered":"2024-09-12T00:35:50.027282+0000","last_unstale":"2024-09-12T01:21:57.872006+0000","last_undegraded":"2024-09-12T01:21:57.872006+0000","last_fullsized":"2024-09-12T01:21:57.872006+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:27.196205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45216,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":563,"num_read_kb":1133,"num_write":440,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.569449+0000","last_change":"2024-09-12T00:35:51.972158+0000","last_active":"2024-09-12T01:18:38.569449+0000","last_peered":"2024-09-12T01:18:38.569449+0000","last_clean":"2024-09-12T01:18:38.569449+0000","last_became_active":"2024-09-12T00:35:51.971491+0000","last_became_peered":"2024-09-12T00:35:51.971491+0000","last_unstale":"2024-09-12T01:18:38.569449+0000","last_undegraded":"2024-09-12T01:18:38.569449+0000","last_fullsized":"2024-09-12T01:18:38.569449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:22.911772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'555","reported_seq":1370,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.367346+0000","last_change":"2024-09-12T00:35:54.000046+0000","last_active":"2024-09-12T01:21:25.367346+0000","last_peered":"2024-09-12T01:21:25.367346+0000","last_clean":"2024-09-12T01:21:25.367346+0000","last_became_active":"2024-09-12T00:35:53.996514+0000","last_became_peered":"2024-09-12T00:35:53.996514+0000","last_unstale":"2024-09-12T01:21:25.367346+0000","last_undegraded":"2024-09-12T01:21:25.367346+0000","last_fullsized":"2024-09-12T01:21:25.367346+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:55.200677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1307,"num_read_kb":1296,"num_write":1166,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'136","reported_seq":740,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.750429+0000","last_change":"2024-09-12T00:35:45.943831+0000","last_active":"2024-09-12T01:19:07.750429+0000","last_peered":"2024-09-12T01:19:07.750429+0000","last_clean":"2024-09-12T01:19:07.750429+0000","last_became_active":"2024-09-12T00:35:45.943083+0000","last_became_peered":"2024-09-12T00:35:45.943083+0000","last_unstale":"2024-09-12T01:19:07.750429+0000","last_undegraded":"2024-09-12T01:19:07.750429+0000","last_fullsized":"2024-09-12T01:19:07.750429+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:26.091545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":650,"num_read_kb":541,"num_write":222,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'336","reported_seq":979,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.814680+0000","last_change":"2024-09-12T00:35:43.954537+0000","last_active":"2024-09-12T01:21:57.814680+0000","last_peered":"2024-09-12T01:21:57.814680+0000","last_clean":"2024-09-12T01:21:57.814680+0000","last_became_active":"2024-09-12T00:35:43.953664+0000","last_became_peered":"2024-09-12T00:35:43.953664+0000","last_unstale":"2024-09-12T01:21:57.814680+0000","last_undegraded":"2024-09-12T01:21:57.814680+0000","last_fullsized":"2024-09-12T01:21:57.814680+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:13.149672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289008,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":477,"num_read_kb":49556,"num_write":1049,"num_write_kb":45556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:10.566168+0000","last_change":"2024-09-12T00:35:47.937702+0000","last_active":"2024-09-12T01:19:10.566168+0000","last_peered":"2024-09-12T01:19:10.566168+0000","last_clean":"2024-09-12T01:19:10.566168+0000","last_became_active":"2024-09-12T00:35:47.936972+0000","last_became_peered":"2024-09-12T00:35:47.936972+0000","last_unstale":"2024-09-12T01:19:10.566168+0000","last_undegraded":"2024-09-12T01:19:10.566168+0000","last_fullsized":"2024-09-12T01:19:10.566168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:21.464118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'266","reported_seq":838,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.165456+0000","last_change":"2024-09-12T00:35:49.955401+0000","last_active":"2024-09-12T01:21:57.165456+0000","last_peered":"2024-09-12T01:21:57.165456+0000","last_clean":"2024-09-12T01:21:57.165456+0000","last_became_active":"2024-09-12T00:35:49.954568+0000","last_became_peered":"2024-09-12T00:35:49.954568+0000","last_unstale":"2024-09-12T01:21:57.165456+0000","last_undegraded":"2024-09-12T01:21:57.165456+0000","last_fullsized":"2024-09-12T01:21:57.165456+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:57.669990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45999,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":441,"num_read_kb":1004,"num_write":356,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:23.595568+0000","last_change":"2024-09-12T00:35:51.982044+0000","last_active":"2024-09-12T01:19:23.595568+0000","last_peered":"2024-09-12T01:19:23.595568+0000","last_clean":"2024-09-12T01:19:23.595568+0000","last_became_active":"2024-09-12T00:35:51.981326+0000","last_became_peered":"2024-09-12T00:35:51.981326+0000","last_unstale":"2024-09-12T01:19:23.595568+0000","last_undegraded":"2024-09-12T01:19:23.595568+0000","last_fullsized":"2024-09-12T01:19:23.595568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:53.955317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'2394","reported_seq":4228,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:14.960049+0000","last_change":"2024-09-12T00:35:53.975817+0000","last_active":"2024-09-12T01:21:14.960049+0000","last_peered":"2024-09-12T01:21:14.960049+0000","last_clean":"2024-09-12T01:21:14.960049+0000","last_became_active":"2024-09-12T00:35:53.975054+0000","last_became_peered":"2024-09-12T00:35:53.975054+0000","last_unstale":"2024-09-12T01:21:14.960049+0000","last_undegraded":"2024-09-12T01:21:14.960049+0000","last_fullsized":"2024-09-12T01:21:14.960049+0000","mapping_epoch":34,"log_start":"265'2300","ondisk_log_start":"265'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":2300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:31.278726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6031,"num_read_kb":6023,"num_write":4852,"num_write_kb":1786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'134","reported_seq":750,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:12.558238+0000","last_change":"2024-09-12T00:35:45.954433+0000","last_active":"2024-09-12T01:19:12.558238+0000","last_peered":"2024-09-12T01:19:12.558238+0000","last_clean":"2024-09-12T01:19:12.558238+0000","last_became_active":"2024-09-12T00:35:45.953664+0000","last_became_peered":"2024-09-12T00:35:45.953664+0000","last_unstale":"2024-09-12T01:19:12.558238+0000","last_undegraded":"2024-09-12T01:19:12.558238+0000","last_fullsized":"2024-09-12T01:19:12.558238+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:20.996949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":607,"num_read_kb":511,"num_write":198,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'327","reported_seq":1029,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.815595+0000","last_change":"2024-09-12T00:35:43.943348+0000","last_active":"2024-09-12T01:21:57.815595+0000","last_peered":"2024-09-12T01:21:57.815595+0000","last_clean":"2024-09-12T01:21:57.815595+0000","last_became_active":"2024-09-12T00:35:43.942454+0000","last_became_peered":"2024-09-12T00:35:43.942454+0000","last_unstale":"2024-09-12T01:21:57.815595+0000","last_undegraded":"2024-09-12T01:21:57.815595+0000","last_fullsized":"2024-09-12T01:21:57.815595+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:18.360119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":618,"num_read_kb":3434,"num_write":1027,"num_write_kb":23754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:35.558281+0000","last_change":"2024-09-12T00:35:47.942488+0000","last_active":"2024-09-12T01:18:35.558281+0000","last_peered":"2024-09-12T01:18:35.558281+0000","last_clean":"2024-09-12T01:18:35.558281+0000","last_became_active":"2024-09-12T00:35:47.942189+0000","last_became_peered":"2024-09-12T00:35:47.942189+0000","last_unstale":"2024-09-12T01:18:35.558281+0000","last_undegraded":"2024-09-12T01:18:35.558281+0000","last_fullsized":"2024-09-12T01:18:35.558281+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:52.594512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'318","reported_seq":913,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.738514+0000","last_change":"2024-09-12T00:35:49.943225+0000","last_active":"2024-09-12T01:21:56.738514+0000","last_peered":"2024-09-12T01:21:56.738514+0000","last_clean":"2024-09-12T01:21:56.738514+0000","last_became_active":"2024-09-12T00:35:49.942480+0000","last_became_peered":"2024-09-12T00:35:49.942480+0000","last_unstale":"2024-09-12T01:21:56.738514+0000","last_undegraded":"2024-09-12T01:21:56.738514+0000","last_fullsized":"2024-09-12T01:21:56.738514+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:22.668385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48782,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":529,"num_read_kb":1149,"num_write":428,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'772","reported_seq":2437,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.510993+0000","last_change":"2024-09-12T00:35:51.985725+0000","last_active":"2024-09-12T01:21:56.510993+0000","last_peered":"2024-09-12T01:21:56.510993+0000","last_clean":"2024-09-12T01:21:56.510993+0000","last_became_active":"2024-09-12T00:35:51.984968+0000","last_became_peered":"2024-09-12T00:35:51.984968+0000","last_unstale":"2024-09-12T01:21:56.510993+0000","last_undegraded":"2024-09-12T01:21:56.510993+0000","last_fullsized":"2024-09-12T01:21:56.510993+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:26.578990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'109","reported_seq":600,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:24.451554+0000","last_change":"2024-09-12T00:35:53.995319+0000","last_active":"2024-09-12T01:21:24.451554+0000","last_peered":"2024-09-12T01:21:24.451554+0000","last_clean":"2024-09-12T01:21:24.451554+0000","last_became_active":"2024-09-12T00:35:53.992664+0000","last_became_peered":"2024-09-12T00:35:53.992664+0000","last_unstale":"2024-09-12T01:21:24.451554+0000","last_undegraded":"2024-09-12T01:21:24.451554+0000","last_fullsized":"2024-09-12T01:21:24.451554+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:16.209394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":110,"num_write":262,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'190","reported_seq":797,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:01.759116+0000","last_change":"2024-09-12T00:35:45.940151+0000","last_active":"2024-09-12T01:19:01.759116+0000","last_peered":"2024-09-12T01:19:01.759116+0000","last_clean":"2024-09-12T01:19:01.759116+0000","last_became_active":"2024-09-12T00:35:45.939817+0000","last_became_peered":"2024-09-12T00:35:45.939817+0000","last_unstale":"2024-09-12T01:19:01.759116+0000","last_undegraded":"2024-09-12T01:19:01.759116+0000","last_fullsized":"2024-09-12T01:19:01.759116+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:58.194408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":809,"num_read_kb":663,"num_write":268,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'359","reported_seq":1013,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.869525+0000","last_change":"2024-09-12T00:35:43.913025+0000","last_active":"2024-09-12T01:21:57.869525+0000","last_peered":"2024-09-12T01:21:57.869525+0000","last_clean":"2024-09-12T01:21:57.869525+0000","last_became_active":"2024-09-12T00:35:43.912282+0000","last_became_peered":"2024-09-12T00:35:43.912282+0000","last_unstale":"2024-09-12T01:21:57.869525+0000","last_undegraded":"2024-09-12T01:21:57.869525+0000","last_fullsized":"2024-09-12T01:21:57.869525+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:35.570049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6327796,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":526,"num_read_kb":19021,"num_write":1167,"num_write_kb":32789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:20.568395+0000","last_change":"2024-09-12T00:35:47.947337+0000","last_active":"2024-09-12T01:19:20.568395+0000","last_peered":"2024-09-12T01:19:20.568395+0000","last_clean":"2024-09-12T01:19:20.568395+0000","last_became_active":"2024-09-12T00:35:47.946636+0000","last_became_peered":"2024-09-12T00:35:47.946636+0000","last_unstale":"2024-09-12T01:19:20.568395+0000","last_undegraded":"2024-09-12T01:19:20.568395+0000","last_fullsized":"2024-09-12T01:19:20.568395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:32.769942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'509","reported_seq":1146,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.273493+0000","last_change":"2024-09-12T00:35:49.951472+0000","last_active":"2024-09-12T01:21:57.273493+0000","last_peered":"2024-09-12T01:21:57.273493+0000","last_clean":"2024-09-12T01:21:57.273493+0000","last_became_active":"2024-09-12T00:35:49.950845+0000","last_became_peered":"2024-09-12T00:35:49.950845+0000","last_unstale":"2024-09-12T01:21:57.273493+0000","last_undegraded":"2024-09-12T01:21:57.273493+0000","last_fullsized":"2024-09-12T01:21:57.273493+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:03.493730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100676,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":870,"num_read_kb":2075,"num_write":716,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:15.567238+0000","last_change":"2024-09-12T00:35:51.979349+0000","last_active":"2024-09-12T01:19:15.567238+0000","last_peered":"2024-09-12T01:19:15.567238+0000","last_clean":"2024-09-12T01:19:15.567238+0000","last_became_active":"2024-09-12T00:35:51.978188+0000","last_became_peered":"2024-09-12T00:35:51.978188+0000","last_unstale":"2024-09-12T01:19:15.567238+0000","last_undegraded":"2024-09-12T01:19:15.567238+0000","last_fullsized":"2024-09-12T01:19:15.567238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:57.588270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'133","reported_seq":651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:07.813191+0000","last_change":"2024-09-12T00:35:53.986321+0000","last_active":"2024-09-12T01:20:07.813191+0000","last_peered":"2024-09-12T01:20:07.813191+0000","last_clean":"2024-09-12T01:20:07.813191+0000","last_became_active":"2024-09-12T00:35:53.985635+0000","last_became_peered":"2024-09-12T00:35:53.985635+0000","last_unstale":"2024-09-12T01:20:07.813191+0000","last_undegraded":"2024-09-12T01:20:07.813191+0000","last_fullsized":"2024-09-12T01:20:07.813191+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:38.196418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":203,"num_read_kb":181,"num_write":311,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'153","reported_seq":748,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:32.742795+0000","last_change":"2024-09-12T00:35:45.938944+0000","last_active":"2024-09-12T01:18:32.742795+0000","last_peered":"2024-09-12T01:18:32.742795+0000","last_clean":"2024-09-12T01:18:32.742795+0000","last_became_active":"2024-09-12T00:35:45.938135+0000","last_became_peered":"2024-09-12T00:35:45.938135+0000","last_unstale":"2024-09-12T01:18:32.742795+0000","last_undegraded":"2024-09-12T01:18:32.742795+0000","last_fullsized":"2024-09-12T01:18:32.742795+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:04.224264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":684,"num_read_kb":556,"num_write":242,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'379","reported_seq":1017,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.851838+0000","last_change":"2024-09-12T00:35:43.939014+0000","last_active":"2024-09-12T01:21:57.851838+0000","last_peered":"2024-09-12T01:21:57.851838+0000","last_clean":"2024-09-12T01:21:57.851838+0000","last_became_active":"2024-09-12T00:35:43.936713+0000","last_became_peered":"2024-09-12T00:35:43.936713+0000","last_unstale":"2024-09-12T01:21:57.851838+0000","last_undegraded":"2024-09-12T01:21:57.851838+0000","last_fullsized":"2024-09-12T01:21:57.851838+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:51.023354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730170,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":551,"num_read_kb":26422,"num_write":1213,"num_write_kb":29680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:35.558367+0000","last_change":"2024-09-12T00:35:47.939169+0000","last_active":"2024-09-12T01:18:35.558367+0000","last_peered":"2024-09-12T01:18:35.558367+0000","last_clean":"2024-09-12T01:18:35.558367+0000","last_became_active":"2024-09-12T00:35:47.938604+0000","last_became_peered":"2024-09-12T00:35:47.938604+0000","last_unstale":"2024-09-12T01:18:35.558367+0000","last_undegraded":"2024-09-12T01:18:35.558367+0000","last_fullsized":"2024-09-12T01:18:35.558367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:16.268476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'307","reported_seq":890,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.303125+0000","last_change":"2024-09-12T00:35:49.941521+0000","last_active":"2024-09-12T01:21:57.303125+0000","last_peered":"2024-09-12T01:21:57.303125+0000","last_clean":"2024-09-12T01:21:57.303125+0000","last_became_active":"2024-09-12T00:35:49.940679+0000","last_became_peered":"2024-09-12T00:35:49.940679+0000","last_unstale":"2024-09-12T01:21:57.303125+0000","last_undegraded":"2024-09-12T01:21:57.303125+0000","last_fullsized":"2024-09-12T01:21:57.303125+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:45.183044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52849,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":502,"num_read_kb":1074,"num_write":450,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":483,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:48.567233+0000","last_change":"2024-09-12T00:35:51.978558+0000","last_active":"2024-09-12T01:18:48.567233+0000","last_peered":"2024-09-12T01:18:48.567233+0000","last_clean":"2024-09-12T01:18:48.567233+0000","last_became_active":"2024-09-12T00:35:51.977807+0000","last_became_peered":"2024-09-12T00:35:51.977807+0000","last_unstale":"2024-09-12T01:18:48.567233+0000","last_undegraded":"2024-09-12T01:18:48.567233+0000","last_fullsized":"2024-09-12T01:18:48.567233+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:54.797988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'99","reported_seq":602,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:03.604948+0000","last_change":"2024-09-12T00:35:54.003890+0000","last_active":"2024-09-12T01:20:03.604948+0000","last_peered":"2024-09-12T01:20:03.604948+0000","last_clean":"2024-09-12T01:20:03.604948+0000","last_became_active":"2024-09-12T00:35:54.003115+0000","last_became_peered":"2024-09-12T00:35:54.003115+0000","last_unstale":"2024-09-12T01:20:03.604948+0000","last_undegraded":"2024-09-12T01:20:03.604948+0000","last_fullsized":"2024-09-12T01:20:03.604948+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:19.982476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":131,"num_write":237,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'498","reported_seq":1281,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.989879+0000","last_change":"2024-09-12T00:35:45.930828+0000","last_active":"2024-09-12T01:20:22.989879+0000","last_peered":"2024-09-12T01:20:22.989879+0000","last_clean":"2024-09-12T01:20:22.989879+0000","last_became_active":"2024-09-12T00:35:45.929526+0000","last_became_peered":"2024-09-12T00:35:45.929526+0000","last_unstale":"2024-09-12T01:20:22.989879+0000","last_undegraded":"2024-09-12T01:20:22.989879+0000","last_fullsized":"2024-09-12T01:20:22.989879+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:44.529056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2425,"num_read_kb":2075,"num_write":878,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'252","reported_seq":840,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.396738+0000","last_change":"2024-09-12T00:35:43.945078+0000","last_active":"2024-09-12T01:21:57.396738+0000","last_peered":"2024-09-12T01:21:57.396738+0000","last_clean":"2024-09-12T01:21:57.396738+0000","last_became_active":"2024-09-12T00:35:43.944483+0000","last_became_peered":"2024-09-12T00:35:43.944483+0000","last_unstale":"2024-09-12T01:21:57.396738+0000","last_undegraded":"2024-09-12T01:21:57.396738+0000","last_fullsized":"2024-09-12T01:21:57.396738+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:23.857439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3310,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":333,"num_read_kb":347,"num_write":865,"num_write_kb":15629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:33.568409+0000","last_change":"2024-09-12T00:35:47.944100+0000","last_active":"2024-09-12T01:18:33.568409+0000","last_peered":"2024-09-12T01:18:33.568409+0000","last_clean":"2024-09-12T01:18:33.568409+0000","last_became_active":"2024-09-12T00:35:47.943382+0000","last_became_peered":"2024-09-12T00:35:47.943382+0000","last_unstale":"2024-09-12T01:18:33.568409+0000","last_undegraded":"2024-09-12T01:18:33.568409+0000","last_fullsized":"2024-09-12T01:18:33.568409+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:55.004421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'314","reported_seq":890,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:00.587241+0000","last_change":"2024-09-12T00:35:49.949821+0000","last_active":"2024-09-12T01:21:00.587241+0000","last_peered":"2024-09-12T01:21:00.587241+0000","last_clean":"2024-09-12T01:21:00.587241+0000","last_became_active":"2024-09-12T00:35:49.949283+0000","last_became_peered":"2024-09-12T00:35:49.949283+0000","last_unstale":"2024-09-12T01:21:00.587241+0000","last_undegraded":"2024-09-12T01:21:00.587241+0000","last_fullsized":"2024-09-12T01:21:00.587241+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:44.062401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64702,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":519,"num_read_kb":1067,"num_write":430,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'721","reported_seq":2252,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.385714+0000","last_change":"2024-09-12T00:35:51.979871+0000","last_active":"2024-09-12T01:21:25.385714+0000","last_peered":"2024-09-12T01:21:25.385714+0000","last_clean":"2024-09-12T01:21:25.385714+0000","last_became_active":"2024-09-12T00:35:51.979162+0000","last_became_peered":"2024-09-12T00:35:51.979162+0000","last_unstale":"2024-09-12T01:21:25.385714+0000","last_undegraded":"2024-09-12T01:21:25.385714+0000","last_fullsized":"2024-09-12T01:21:25.385714+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:24.612749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'115","reported_seq":603,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.981076+0000","last_change":"2024-09-12T00:35:53.982884+0000","last_active":"2024-09-12T01:20:22.981076+0000","last_peered":"2024-09-12T01:20:22.981076+0000","last_clean":"2024-09-12T01:20:22.981076+0000","last_became_active":"2024-09-12T00:35:53.981735+0000","last_became_peered":"2024-09-12T00:35:53.981735+0000","last_unstale":"2024-09-12T01:20:22.981076+0000","last_undegraded":"2024-09-12T01:20:22.981076+0000","last_fullsized":"2024-09-12T01:20:22.981076+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:48.987492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":92,"num_write":265,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'349","reported_seq":1039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:57.362515+0000","last_change":"2024-09-12T00:35:45.954531+0000","last_active":"2024-09-12T01:19:57.362515+0000","last_peered":"2024-09-12T01:19:57.362515+0000","last_clean":"2024-09-12T01:19:57.362515+0000","last_became_active":"2024-09-12T00:35:45.953935+0000","last_became_peered":"2024-09-12T00:35:45.953935+0000","last_unstale":"2024-09-12T01:19:57.362515+0000","last_undegraded":"2024-09-12T01:19:57.362515+0000","last_fullsized":"2024-09-12T01:19:57.362515+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:23.435584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1509,"num_read_kb":1228,"num_write":558,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'303","reported_seq":954,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.563583+0000","last_change":"2024-09-12T00:35:43.930345+0000","last_active":"2024-09-12T01:21:57.563583+0000","last_peered":"2024-09-12T01:21:57.563583+0000","last_clean":"2024-09-12T01:21:57.563583+0000","last_became_active":"2024-09-12T00:35:43.929559+0000","last_became_peered":"2024-09-12T00:35:43.929559+0000","last_unstale":"2024-09-12T01:21:57.563583+0000","last_undegraded":"2024-09-12T01:21:57.563583+0000","last_fullsized":"2024-09-12T01:21:57.563583+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:34.819090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7269752,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":431,"num_read_kb":47620,"num_write":909,"num_write_kb":27870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1462,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.247461+0000","last_change":"2024-09-12T00:35:47.936838+0000","last_active":"2024-09-12T01:21:56.247461+0000","last_peered":"2024-09-12T01:21:56.247461+0000","last_clean":"2024-09-12T01:21:56.247461+0000","last_became_active":"2024-09-12T00:35:47.936026+0000","last_became_peered":"2024-09-12T00:35:47.936026+0000","last_unstale":"2024-09-12T01:21:56.247461+0000","last_undegraded":"2024-09-12T01:21:56.247461+0000","last_fullsized":"2024-09-12T01:21:56.247461+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:42.930790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":965,"num_read_kb":965,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'80","reported_seq":595,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:51.233520+0000","last_change":"2024-09-12T00:35:50.027677+0000","last_active":"2024-09-12T01:18:51.233520+0000","last_peered":"2024-09-12T01:18:51.233520+0000","last_clean":"2024-09-12T01:18:51.233520+0000","last_became_active":"2024-09-12T00:35:50.027161+0000","last_became_peered":"2024-09-12T00:35:50.027161+0000","last_unstale":"2024-09-12T01:18:51.233520+0000","last_undegraded":"2024-09-12T01:18:51.233520+0000","last_fullsized":"2024-09-12T01:18:51.233520+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:29.997291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'772","reported_seq":6317,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.498244+0000","last_change":"2024-09-12T00:35:51.977887+0000","last_active":"2024-09-12T01:21:56.498244+0000","last_peered":"2024-09-12T01:21:56.498244+0000","last_clean":"2024-09-12T01:21:56.498244+0000","last_became_active":"2024-09-12T00:35:51.976947+0000","last_became_peered":"2024-09-12T00:35:51.976947+0000","last_unstale":"2024-09-12T01:21:56.498244+0000","last_undegraded":"2024-09-12T01:21:56.498244+0000","last_fullsized":"2024-09-12T01:21:56.498244+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:41.190642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'156","reported_seq":653,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:03.702547+0000","last_change":"2024-09-12T00:35:53.995354+0000","last_active":"2024-09-12T01:20:03.702547+0000","last_peered":"2024-09-12T01:20:03.702547+0000","last_clean":"2024-09-12T01:20:03.702547+0000","last_became_active":"2024-09-12T00:35:53.994715+0000","last_became_peered":"2024-09-12T00:35:53.994715+0000","last_unstale":"2024-09-12T01:20:03.702547+0000","last_undegraded":"2024-09-12T01:20:03.702547+0000","last_fullsized":"2024-09-12T01:20:03.702547+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:57.399598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":132,"num_read_kb":125,"num_write":372,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'158","reported_seq":698,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:58.526770+0000","last_change":"2024-09-12T00:36:17.050284+0000","last_active":"2024-09-12T01:20:58.526770+0000","last_peered":"2024-09-12T01:20:58.526770+0000","last_clean":"2024-09-12T01:20:58.526770+0000","last_became_active":"2024-09-12T00:36:17.049999+0000","last_became_peered":"2024-09-12T00:36:17.049999+0000","last_unstale":"2024-09-12T01:20:58.526770+0000","last_undegraded":"2024-09-12T01:20:58.526770+0000","last_fullsized":"2024-09-12T01:20:58.526770+0000","mapping_epoch":37,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:09.446877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":667,"num_read_kb":538,"num_write":243,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"265'359","reported_seq":1110,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.839026+0000","last_change":"2024-09-12T00:35:43.931842+0000","last_active":"2024-09-12T01:21:57.839026+0000","last_peered":"2024-09-12T01:21:57.839026+0000","last_clean":"2024-09-12T01:21:57.839026+0000","last_became_active":"2024-09-12T00:35:43.931562+0000","last_became_peered":"2024-09-12T00:35:43.931562+0000","last_unstale":"2024-09-12T01:21:57.839026+0000","last_undegraded":"2024-09-12T01:21:57.839026+0000","last_fullsized":"2024-09-12T01:21:57.839026+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:22.693505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992276,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":678,"num_read_kb":113913,"num_write":1161,"num_write_kb":34109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:32.742956+0000","last_change":"2024-09-12T00:35:47.930885+0000","last_active":"2024-09-12T01:18:32.742956+0000","last_peered":"2024-09-12T01:18:32.742956+0000","last_clean":"2024-09-12T01:18:32.742956+0000","last_became_active":"2024-09-12T00:35:47.930147+0000","last_became_peered":"2024-09-12T00:35:47.930147+0000","last_unstale":"2024-09-12T01:18:32.742956+0000","last_undegraded":"2024-09-12T01:18:32.742956+0000","last_fullsized":"2024-09-12T01:18:32.742956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:58.003654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'345","reported_seq":948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.771341+0000","last_change":"2024-09-12T00:35:49.939362+0000","last_active":"2024-09-12T01:21:57.771341+0000","last_peered":"2024-09-12T01:21:57.771341+0000","last_clean":"2024-09-12T01:21:57.771341+0000","last_became_active":"2024-09-12T00:35:49.938597+0000","last_became_peered":"2024-09-12T00:35:49.938597+0000","last_unstale":"2024-09-12T01:21:57.771341+0000","last_undegraded":"2024-09-12T01:21:57.771341+0000","last_fullsized":"2024-09-12T01:21:57.771341+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.934056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46738,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":571,"num_read_kb":1203,"num_write":454,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:37.551187+0000","last_change":"2024-09-12T00:35:51.968545+0000","last_active":"2024-09-12T01:18:37.551187+0000","last_peered":"2024-09-12T01:18:37.551187+0000","last_clean":"2024-09-12T01:18:37.551187+0000","last_became_active":"2024-09-12T00:35:51.967708+0000","last_became_peered":"2024-09-12T00:35:51.967708+0000","last_unstale":"2024-09-12T01:18:37.551187+0000","last_undegraded":"2024-09-12T01:18:37.551187+0000","last_fullsized":"2024-09-12T01:18:37.551187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:40.081105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'116","reported_seq":605,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:38.582809+0000","last_change":"2024-09-12T00:35:53.998562+0000","last_active":"2024-09-12T01:19:38.582809+0000","last_peered":"2024-09-12T01:19:38.582809+0000","last_clean":"2024-09-12T01:19:38.582809+0000","last_became_active":"2024-09-12T00:35:53.997893+0000","last_became_peered":"2024-09-12T00:35:53.997893+0000","last_unstale":"2024-09-12T01:19:38.582809+0000","last_undegraded":"2024-09-12T01:19:38.582809+0000","last_fullsized":"2024-09-12T01:19:38.582809+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:57.696902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":114,"num_write":260,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'95","reported_seq":679,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.563475+0000","last_change":"2024-09-12T00:35:45.945106+0000","last_active":"2024-09-12T01:19:37.563475+0000","last_peered":"2024-09-12T01:19:37.563475+0000","last_clean":"2024-09-12T01:19:37.563475+0000","last_became_active":"2024-09-12T00:35:45.941291+0000","last_became_peered":"2024-09-12T00:35:45.941291+0000","last_unstale":"2024-09-12T01:19:37.563475+0000","last_undegraded":"2024-09-12T01:19:37.563475+0000","last_fullsized":"2024-09-12T01:19:37.563475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:41.263421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":459,"num_read_kb":386,"num_write":145,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":611,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.797702+0000","last_change":"2024-09-12T00:35:25.098793+0000","last_active":"2024-09-12T01:19:32.797702+0000","last_peered":"2024-09-12T01:19:32.797702+0000","last_clean":"2024-09-12T01:19:32.797702+0000","last_became_active":"2024-09-12T00:35:25.096843+0000","last_became_peered":"2024-09-12T00:35:25.096843+0000","last_unstale":"2024-09-12T01:19:32.797702+0000","last_undegraded":"2024-09-12T01:19:32.797702+0000","last_fullsized":"2024-09-12T01:19:32.797702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:23.614097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:23.614097+0000","last_clean_scrub_stamp":"2024-09-12T00:35:23.614097+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:42.023728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.566130+0000","last_change":"2024-09-12T00:35:31.691879+0000","last_active":"2024-09-12T01:19:18.566130+0000","last_peered":"2024-09-12T01:19:18.566130+0000","last_clean":"2024-09-12T01:19:18.566130+0000","last_became_active":"2024-09-12T00:35:29.668145+0000","last_became_peered":"2024-09-12T00:35:29.668145+0000","last_unstale":"2024-09-12T01:19:18.566130+0000","last_undegraded":"2024-09-12T01:19:18.566130+0000","last_fullsized":"2024-09-12T01:19:18.566130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:18.650004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011070749999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'319","reported_seq":978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.852317+0000","last_change":"2024-09-12T00:35:43.920876+0000","last_active":"2024-09-12T01:21:57.852317+0000","last_peered":"2024-09-12T01:21:57.852317+0000","last_clean":"2024-09-12T01:21:57.852317+0000","last_became_active":"2024-09-12T00:35:43.916969+0000","last_became_peered":"2024-09-12T00:35:43.916969+0000","last_unstale":"2024-09-12T01:21:57.852317+0000","last_undegraded":"2024-09-12T01:21:57.852317+0000","last_fullsized":"2024-09-12T01:21:57.852317+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:16.584205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568993,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":119474,"num_write":1014,"num_write_kb":17296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.797857+0000","last_change":"2024-09-12T00:35:47.944667+0000","last_active":"2024-09-12T01:19:32.797857+0000","last_peered":"2024-09-12T01:19:32.797857+0000","last_clean":"2024-09-12T01:19:32.797857+0000","last_became_active":"2024-09-12T00:35:47.942643+0000","last_became_peered":"2024-09-12T00:35:47.942643+0000","last_unstale":"2024-09-12T01:19:32.797857+0000","last_undegraded":"2024-09-12T01:19:32.797857+0000","last_fullsized":"2024-09-12T01:19:32.797857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:06.078372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'696","reported_seq":1403,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.838470+0000","last_change":"2024-09-12T00:35:49.958641+0000","last_active":"2024-09-12T01:21:57.838470+0000","last_peered":"2024-09-12T01:21:57.838470+0000","last_clean":"2024-09-12T01:21:57.838470+0000","last_became_active":"2024-09-12T00:35:49.957694+0000","last_became_peered":"2024-09-12T00:35:49.957694+0000","last_unstale":"2024-09-12T01:21:57.838470+0000","last_undegraded":"2024-09-12T01:21:57.838470+0000","last_fullsized":"2024-09-12T01:21:57.838470+0000","mapping_epoch":30,"log_start":"265'600","ondisk_log_start":"265'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:23.494190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144071,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1382,"num_read_kb":3079,"num_write":1308,"num_write_kb":1154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:13.573190+0000","last_change":"2024-09-12T00:35:51.978016+0000","last_active":"2024-09-12T01:19:13.573190+0000","last_peered":"2024-09-12T01:19:13.573190+0000","last_clean":"2024-09-12T01:19:13.573190+0000","last_became_active":"2024-09-12T00:35:51.977282+0000","last_became_peered":"2024-09-12T00:35:51.977282+0000","last_unstale":"2024-09-12T01:19:13.573190+0000","last_undegraded":"2024-09-12T01:19:13.573190+0000","last_fullsized":"2024-09-12T01:19:13.573190+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:23.231926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'206","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.003775+0000","last_change":"2024-09-12T00:35:53.998069+0000","last_active":"2024-09-12T01:20:23.003775+0000","last_peered":"2024-09-12T01:20:23.003775+0000","last_clean":"2024-09-12T01:20:23.003775+0000","last_became_active":"2024-09-12T00:35:53.997354+0000","last_became_peered":"2024-09-12T00:35:53.997354+0000","last_unstale":"2024-09-12T01:20:23.003775+0000","last_undegraded":"2024-09-12T01:20:23.003775+0000","last_fullsized":"2024-09-12T01:20:23.003775+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:55.234664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":471,"num_write":454,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'239","reported_seq":897,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:02.408975+0000","last_change":"2024-09-12T00:35:45.946145+0000","last_active":"2024-09-12T01:20:02.408975+0000","last_peered":"2024-09-12T01:20:02.408975+0000","last_clean":"2024-09-12T01:20:02.408975+0000","last_became_active":"2024-09-12T00:35:45.945766+0000","last_became_peered":"2024-09-12T00:35:45.945766+0000","last_unstale":"2024-09-12T01:20:02.408975+0000","last_undegraded":"2024-09-12T01:20:02.408975+0000","last_fullsized":"2024-09-12T01:20:02.408975+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:50.991641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1032,"num_read_kb":857,"num_write":339,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.798875+0000","last_change":"2024-09-12T00:35:31.861888+0000","last_active":"2024-09-12T01:19:37.798875+0000","last_peered":"2024-09-12T01:19:37.798875+0000","last_clean":"2024-09-12T01:19:37.798875+0000","last_became_active":"2024-09-12T00:35:29.671287+0000","last_became_peered":"2024-09-12T00:35:29.671287+0000","last_unstale":"2024-09-12T01:19:37.798875+0000","last_undegraded":"2024-09-12T01:19:37.798875+0000","last_fullsized":"2024-09-12T01:19:37.798875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:47.739072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075002000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'397","reported_seq":1106,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.869110+0000","last_change":"2024-09-12T00:35:43.945658+0000","last_active":"2024-09-12T01:21:57.869110+0000","last_peered":"2024-09-12T01:21:57.869110+0000","last_clean":"2024-09-12T01:21:57.869110+0000","last_became_active":"2024-09-12T00:35:43.945335+0000","last_became_peered":"2024-09-12T00:35:43.945335+0000","last_unstale":"2024-09-12T01:21:57.869110+0000","last_undegraded":"2024-09-12T01:21:57.869110+0000","last_fullsized":"2024-09-12T01:21:57.869110+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:30.924593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":682,"num_read_kb":63013,"num_write":1485,"num_write_kb":40970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.563896+0000","last_change":"2024-09-12T00:35:47.926465+0000","last_active":"2024-09-12T01:19:08.563896+0000","last_peered":"2024-09-12T01:19:08.563896+0000","last_clean":"2024-09-12T01:19:08.563896+0000","last_became_active":"2024-09-12T00:35:47.925704+0000","last_became_peered":"2024-09-12T00:35:47.925704+0000","last_unstale":"2024-09-12T01:19:08.563896+0000","last_undegraded":"2024-09-12T01:19:08.563896+0000","last_fullsized":"2024-09-12T01:19:08.563896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:53.561342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1262","reported_seq":2757,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.811770+0000","last_change":"2024-09-12T00:35:49.948152+0000","last_active":"2024-09-12T01:21:57.811770+0000","last_peered":"2024-09-12T01:21:57.811770+0000","last_clean":"2024-09-12T01:21:57.811770+0000","last_became_active":"2024-09-12T00:35:49.947643+0000","last_became_peered":"2024-09-12T00:35:49.947643+0000","last_unstale":"2024-09-12T01:21:57.811770+0000","last_undegraded":"2024-09-12T01:21:57.811770+0000","last_fullsized":"2024-09-12T01:21:57.811770+0000","mapping_epoch":30,"log_start":"265'1200","ondisk_log_start":"265'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":1200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:30.009318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144243,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2043,"num_read_kb":3859,"num_write":1128,"num_write_kb":966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:42.800216+0000","last_change":"2024-09-12T00:35:51.981967+0000","last_active":"2024-09-12T01:19:42.800216+0000","last_peered":"2024-09-12T01:19:42.800216+0000","last_clean":"2024-09-12T01:19:42.800216+0000","last_became_active":"2024-09-12T00:35:51.981240+0000","last_became_peered":"2024-09-12T00:35:51.981240+0000","last_unstale":"2024-09-12T01:19:42.800216+0000","last_undegraded":"2024-09-12T01:19:42.800216+0000","last_fullsized":"2024-09-12T01:19:42.800216+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:42.148309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'135","reported_seq":643,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.074739+0000","last_change":"2024-09-12T00:35:54.014383+0000","last_active":"2024-09-12T01:20:23.074739+0000","last_peered":"2024-09-12T01:20:23.074739+0000","last_clean":"2024-09-12T01:20:23.074739+0000","last_became_active":"2024-09-12T00:35:54.013658+0000","last_became_peered":"2024-09-12T00:35:54.013658+0000","last_unstale":"2024-09-12T01:20:23.074739+0000","last_undegraded":"2024-09-12T01:20:23.074739+0000","last_fullsized":"2024-09-12T01:20:23.074739+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:12.904906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":184,"num_read_kb":167,"num_write":336,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'141","reported_seq":771,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:42.252694+0000","last_change":"2024-09-12T00:35:45.929654+0000","last_active":"2024-09-12T01:19:42.252694+0000","last_peered":"2024-09-12T01:19:42.252694+0000","last_clean":"2024-09-12T01:19:42.252694+0000","last_became_active":"2024-09-12T00:35:45.929073+0000","last_became_peered":"2024-09-12T00:35:45.929073+0000","last_unstale":"2024-09-12T01:19:42.252694+0000","last_undegraded":"2024-09-12T01:19:42.252694+0000","last_fullsized":"2024-09-12T01:19:42.252694+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:33.683146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":635,"num_read_kb":540,"num_write":217,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:15.567287+0000","last_change":"2024-09-12T00:35:31.904599+0000","last_active":"2024-09-12T01:19:15.567287+0000","last_peered":"2024-09-12T01:19:15.567287+0000","last_clean":"2024-09-12T01:19:15.567287+0000","last_became_active":"2024-09-12T00:35:29.699432+0000","last_became_peered":"2024-09-12T00:35:29.699432+0000","last_unstale":"2024-09-12T01:19:15.567287+0000","last_undegraded":"2024-09-12T01:19:15.567287+0000","last_fullsized":"2024-09-12T01:19:15.567287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:03.035417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099979400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'343","reported_seq":985,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.827966+0000","last_change":"2024-09-12T00:35:43.929255+0000","last_active":"2024-09-12T01:21:57.827966+0000","last_peered":"2024-09-12T01:21:57.827966+0000","last_clean":"2024-09-12T01:21:57.827966+0000","last_became_active":"2024-09-12T00:35:43.928667+0000","last_became_peered":"2024-09-12T00:35:43.928667+0000","last_unstale":"2024-09-12T01:21:57.827966+0000","last_undegraded":"2024-09-12T01:21:57.827966+0000","last_fullsized":"2024-09-12T01:21:57.827966+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:17.228103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174664,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":503,"num_read_kb":16533,"num_write":1052,"num_write_kb":18962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:10.566295+0000","last_change":"2024-09-12T00:35:47.945027+0000","last_active":"2024-09-12T01:19:10.566295+0000","last_peered":"2024-09-12T01:19:10.566295+0000","last_clean":"2024-09-12T01:19:10.566295+0000","last_became_active":"2024-09-12T00:35:47.944385+0000","last_became_peered":"2024-09-12T00:35:47.944385+0000","last_unstale":"2024-09-12T01:19:10.566295+0000","last_undegraded":"2024-09-12T01:19:10.566295+0000","last_fullsized":"2024-09-12T01:19:10.566295+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:59.954589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'226","reported_seq":1321,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.532346+0000","last_change":"2024-09-12T00:35:50.026399+0000","last_active":"2024-09-12T01:21:25.532346+0000","last_peered":"2024-09-12T01:21:25.532346+0000","last_clean":"2024-09-12T01:21:25.532346+0000","last_became_active":"2024-09-12T00:35:50.025610+0000","last_became_peered":"2024-09-12T00:35:50.025610+0000","last_unstale":"2024-09-12T01:21:25.532346+0000","last_undegraded":"2024-09-12T01:21:25.532346+0000","last_fullsized":"2024-09-12T01:21:25.532346+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:54.581195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":183,"num_read_kb":174,"num_write":155,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:38.579276+0000","last_change":"2024-09-12T00:35:51.974368+0000","last_active":"2024-09-12T01:19:38.579276+0000","last_peered":"2024-09-12T01:19:38.579276+0000","last_clean":"2024-09-12T01:19:38.579276+0000","last_became_active":"2024-09-12T00:35:51.973593+0000","last_became_peered":"2024-09-12T00:35:51.973593+0000","last_unstale":"2024-09-12T01:19:38.579276+0000","last_undegraded":"2024-09-12T01:19:38.579276+0000","last_fullsized":"2024-09-12T01:19:38.579276+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:59.292452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'273","reported_seq":876,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.184767+0000","last_change":"2024-09-12T00:35:53.995709+0000","last_active":"2024-09-12T01:20:23.184767+0000","last_peered":"2024-09-12T01:20:23.184767+0000","last_clean":"2024-09-12T01:20:23.184767+0000","last_became_active":"2024-09-12T00:35:53.994828+0000","last_became_peered":"2024-09-12T00:35:53.994828+0000","last_unstale":"2024-09-12T01:20:23.184767+0000","last_undegraded":"2024-09-12T01:20:23.184767+0000","last_fullsized":"2024-09-12T01:20:23.184767+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:01.920282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":532,"num_read_kb":546,"num_write":608,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'101","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:33.581546+0000","last_change":"2024-09-12T00:35:45.933047+0000","last_active":"2024-09-12T01:19:33.581546+0000","last_peered":"2024-09-12T01:19:33.581546+0000","last_clean":"2024-09-12T01:19:33.581546+0000","last_became_active":"2024-09-12T00:35:45.932642+0000","last_became_peered":"2024-09-12T00:35:45.932642+0000","last_unstale":"2024-09-12T01:19:33.581546+0000","last_undegraded":"2024-09-12T01:19:33.581546+0000","last_fullsized":"2024-09-12T01:19:33.581546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:58.000694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":466,"num_read_kb":396,"num_write":153,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.566063+0000","last_change":"2024-09-12T00:35:31.692803+0000","last_active":"2024-09-12T01:19:18.566063+0000","last_peered":"2024-09-12T01:19:18.566063+0000","last_clean":"2024-09-12T01:19:18.566063+0000","last_became_active":"2024-09-12T00:35:29.664963+0000","last_became_peered":"2024-09-12T00:35:29.664963+0000","last_unstale":"2024-09-12T01:19:18.566063+0000","last_undegraded":"2024-09-12T01:19:18.566063+0000","last_fullsized":"2024-09-12T01:19:18.566063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:27.056845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020842569999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'274","reported_seq":944,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.563048+0000","last_change":"2024-09-12T00:35:43.931465+0000","last_active":"2024-09-12T01:21:57.563048+0000","last_peered":"2024-09-12T01:21:57.563048+0000","last_clean":"2024-09-12T01:21:57.563048+0000","last_became_active":"2024-09-12T00:35:43.930731+0000","last_became_peered":"2024-09-12T00:35:43.930731+0000","last_unstale":"2024-09-12T01:21:57.563048+0000","last_undegraded":"2024-09-12T01:21:57.563048+0000","last_fullsized":"2024-09-12T01:21:57.563048+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:34.455587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11182236,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":504,"num_read_kb":45060,"num_write":1079,"num_write_kb":33877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.580737+0000","last_change":"2024-09-12T00:35:47.939774+0000","last_active":"2024-09-12T01:19:43.580737+0000","last_peered":"2024-09-12T01:19:43.580737+0000","last_clean":"2024-09-12T01:19:43.580737+0000","last_became_active":"2024-09-12T00:35:47.939055+0000","last_became_peered":"2024-09-12T00:35:47.939055+0000","last_unstale":"2024-09-12T01:19:43.580737+0000","last_undegraded":"2024-09-12T01:19:43.580737+0000","last_fullsized":"2024-09-12T01:19:43.580737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:08.442651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'117","reported_seq":654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:23.406053+0000","last_change":"2024-09-12T00:35:49.952715+0000","last_active":"2024-09-12T01:21:23.406053+0000","last_peered":"2024-09-12T01:21:23.406053+0000","last_clean":"2024-09-12T01:21:23.406053+0000","last_became_active":"2024-09-12T00:35:49.948258+0000","last_became_peered":"2024-09-12T00:35:49.948258+0000","last_unstale":"2024-09-12T01:21:23.406053+0000","last_undegraded":"2024-09-12T01:21:23.406053+0000","last_fullsized":"2024-09-12T01:21:23.406053+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:13.173314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:12.558370+0000","last_change":"2024-09-12T00:35:51.975246+0000","last_active":"2024-09-12T01:19:12.558370+0000","last_peered":"2024-09-12T01:19:12.558370+0000","last_clean":"2024-09-12T01:19:12.558370+0000","last_became_active":"2024-09-12T00:35:51.974302+0000","last_became_peered":"2024-09-12T00:35:51.974302+0000","last_unstale":"2024-09-12T01:19:12.558370+0000","last_undegraded":"2024-09-12T01:19:12.558370+0000","last_fullsized":"2024-09-12T01:19:12.558370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:22.264781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'140","reported_seq":703,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:02.410395+0000","last_change":"2024-09-12T00:35:53.995956+0000","last_active":"2024-09-12T01:20:02.410395+0000","last_peered":"2024-09-12T01:20:02.410395+0000","last_clean":"2024-09-12T01:20:02.410395+0000","last_became_active":"2024-09-12T00:35:53.995254+0000","last_became_peered":"2024-09-12T00:35:53.995254+0000","last_unstale":"2024-09-12T01:20:02.410395+0000","last_undegraded":"2024-09-12T01:20:02.410395+0000","last_fullsized":"2024-09-12T01:20:02.410395+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:26.022607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1272,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":285,"num_read_kb":262,"num_write":355,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'53","reported_seq":591,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.121613+0000","last_change":"2024-09-12T00:35:45.936327+0000","last_active":"2024-09-12T01:19:37.121613+0000","last_peered":"2024-09-12T01:19:37.121613+0000","last_clean":"2024-09-12T01:19:37.121613+0000","last_became_active":"2024-09-12T00:35:45.936061+0000","last_became_peered":"2024-09-12T00:35:45.936061+0000","last_unstale":"2024-09-12T01:19:37.121613+0000","last_undegraded":"2024-09-12T01:19:37.121613+0000","last_fullsized":"2024-09-12T01:19:37.121613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:11.296362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":179,"num_write":83,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"265'349","reported_seq":1003,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.853709+0000","last_change":"2024-09-12T00:36:17.052149+0000","last_active":"2024-09-12T01:21:57.853709+0000","last_peered":"2024-09-12T01:21:57.853709+0000","last_clean":"2024-09-12T01:21:57.853709+0000","last_became_active":"2024-09-12T00:36:17.051542+0000","last_became_peered":"2024-09-12T00:36:17.051542+0000","last_unstale":"2024-09-12T01:21:57.853709+0000","last_undegraded":"2024-09-12T01:21:57.853709+0000","last_fullsized":"2024-09-12T01:21:57.853709+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:58.989806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730210,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":479,"num_read_kb":44411,"num_write":1031,"num_write_kb":33814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.578146+0000","last_change":"2024-09-12T00:35:31.699054+0000","last_active":"2024-09-12T01:19:18.578146+0000","last_peered":"2024-09-12T01:19:18.578146+0000","last_clean":"2024-09-12T01:19:18.578146+0000","last_became_active":"2024-09-12T00:35:29.700869+0000","last_became_peered":"2024-09-12T00:35:29.700869+0000","last_unstale":"2024-09-12T01:19:18.578146+0000","last_undegraded":"2024-09-12T01:19:18.578146+0000","last_fullsized":"2024-09-12T01:19:18.578146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:14.134437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099003299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"36'5","reported_seq":979,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.234521+0000","last_change":"2024-09-12T00:35:47.947133+0000","last_active":"2024-09-12T01:21:56.234521+0000","last_peered":"2024-09-12T01:21:56.234521+0000","last_clean":"2024-09-12T01:21:56.234521+0000","last_became_active":"2024-09-12T00:35:47.946690+0000","last_became_peered":"2024-09-12T00:35:47.946690+0000","last_unstale":"2024-09-12T01:21:56.234521+0000","last_undegraded":"2024-09-12T01:21:56.234521+0000","last_fullsized":"2024-09-12T01:21:56.234521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:37.935723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'570","reported_seq":1239,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.578410+0000","last_change":"2024-09-12T00:35:49.948760+0000","last_active":"2024-09-12T01:21:57.578410+0000","last_peered":"2024-09-12T01:21:57.578410+0000","last_clean":"2024-09-12T01:21:57.578410+0000","last_became_active":"2024-09-12T00:35:49.948095+0000","last_became_peered":"2024-09-12T00:35:49.948095+0000","last_unstale":"2024-09-12T01:21:57.578410+0000","last_undegraded":"2024-09-12T01:21:57.578410+0000","last_fullsized":"2024-09-12T01:21:57.578410+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":500,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:35.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93682,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1577,"num_read_kb":2692,"num_write":2050,"num_write_kb":1874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.556917+0000","last_change":"2024-09-12T00:35:51.968432+0000","last_active":"2024-09-12T01:19:37.556917+0000","last_peered":"2024-09-12T01:19:37.556917+0000","last_clean":"2024-09-12T01:19:37.556917+0000","last_became_active":"2024-09-12T00:35:51.967708+0000","last_became_peered":"2024-09-12T00:35:51.967708+0000","last_unstale":"2024-09-12T01:19:37.556917+0000","last_undegraded":"2024-09-12T01:19:37.556917+0000","last_fullsized":"2024-09-12T01:19:37.556917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:43.503668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'147","reported_seq":643,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:40.914651+0000","last_change":"2024-09-12T00:35:54.015204+0000","last_active":"2024-09-12T01:19:40.914651+0000","last_peered":"2024-09-12T01:19:40.914651+0000","last_clean":"2024-09-12T01:19:40.914651+0000","last_became_active":"2024-09-12T00:35:54.014321+0000","last_became_peered":"2024-09-12T00:35:54.014321+0000","last_unstale":"2024-09-12T01:19:40.914651+0000","last_undegraded":"2024-09-12T01:19:40.914651+0000","last_fullsized":"2024-09-12T01:19:40.914651+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:14.339505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":134,"num_write":336,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'165","reported_seq":787,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:33.578060+0000","last_change":"2024-09-12T00:35:45.936514+0000","last_active":"2024-09-12T01:19:33.578060+0000","last_peered":"2024-09-12T01:19:33.578060+0000","last_clean":"2024-09-12T01:19:33.578060+0000","last_became_active":"2024-09-12T00:35:45.936178+0000","last_became_peered":"2024-09-12T00:35:45.936178+0000","last_unstale":"2024-09-12T01:19:33.578060+0000","last_undegraded":"2024-09-12T01:19:33.578060+0000","last_fullsized":"2024-09-12T01:19:33.578060+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:06.218590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":595,"num_write":226,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'364","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.838928+0000","last_change":"2024-09-12T00:35:43.931012+0000","last_active":"2024-09-12T01:21:57.838928+0000","last_peered":"2024-09-12T01:21:57.838928+0000","last_clean":"2024-09-12T01:21:57.838928+0000","last_became_active":"2024-09-12T00:35:43.928834+0000","last_became_peered":"2024-09-12T00:35:43.928834+0000","last_unstale":"2024-09-12T01:21:57.838928+0000","last_undegraded":"2024-09-12T01:21:57.838928+0000","last_fullsized":"2024-09-12T01:21:57.838928+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:38.654576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262157,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":503,"num_read_kb":29317,"num_write":1237,"num_write_kb":48953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:22.795333+0000","last_change":"2024-09-12T00:35:31.861538+0000","last_active":"2024-09-12T01:19:22.795333+0000","last_peered":"2024-09-12T01:19:22.795333+0000","last_clean":"2024-09-12T01:19:22.795333+0000","last_became_active":"2024-09-12T00:35:29.697973+0000","last_became_peered":"2024-09-12T00:35:29.697973+0000","last_unstale":"2024-09-12T01:19:22.795333+0000","last_undegraded":"2024-09-12T01:19:22.795333+0000","last_fullsized":"2024-09-12T01:19:22.795333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:08.455168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083354399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.562424+0000","last_change":"2024-09-12T00:35:47.940734+0000","last_active":"2024-09-12T01:19:32.562424+0000","last_peered":"2024-09-12T01:19:32.562424+0000","last_clean":"2024-09-12T01:19:32.562424+0000","last_became_active":"2024-09-12T00:35:47.940014+0000","last_became_peered":"2024-09-12T00:35:47.940014+0000","last_unstale":"2024-09-12T01:19:32.562424+0000","last_undegraded":"2024-09-12T01:19:32.562424+0000","last_fullsized":"2024-09-12T01:19:32.562424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:23.603431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'186","reported_seq":750,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.995320+0000","last_change":"2024-09-12T00:35:50.029129+0000","last_active":"2024-09-12T01:20:22.995320+0000","last_peered":"2024-09-12T01:20:22.995320+0000","last_clean":"2024-09-12T01:20:22.995320+0000","last_became_active":"2024-09-12T00:35:50.028173+0000","last_became_peered":"2024-09-12T00:35:50.028173+0000","last_unstale":"2024-09-12T01:20:22.995320+0000","last_undegraded":"2024-09-12T01:20:22.995320+0000","last_fullsized":"2024-09-12T01:20:22.995320+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:11.842961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":223,"num_read_kb":207,"num_write":158,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'791","reported_seq":2678,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.492109+0000","last_change":"2024-09-12T00:35:51.977915+0000","last_active":"2024-09-12T01:21:56.492109+0000","last_peered":"2024-09-12T01:21:56.492109+0000","last_clean":"2024-09-12T01:21:56.492109+0000","last_became_active":"2024-09-12T00:35:51.977203+0000","last_became_peered":"2024-09-12T00:35:51.977203+0000","last_unstale":"2024-09-12T01:21:56.492109+0000","last_undegraded":"2024-09-12T01:21:56.492109+0000","last_fullsized":"2024-09-12T01:21:56.492109+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:06.229745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'110","reported_seq":608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:08.402637+0000","last_change":"2024-09-12T00:35:54.015222+0000","last_active":"2024-09-12T01:21:08.402637+0000","last_peered":"2024-09-12T01:21:08.402637+0000","last_clean":"2024-09-12T01:21:08.402637+0000","last_became_active":"2024-09-12T00:35:54.014699+0000","last_became_peered":"2024-09-12T00:35:54.014699+0000","last_unstale":"2024-09-12T01:21:08.402637+0000","last_undegraded":"2024-09-12T01:21:08.402637+0000","last_fullsized":"2024-09-12T01:21:08.402637+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:06.666673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1113,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":127,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'102","reported_seq":698,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.470217+0000","last_change":"2024-09-12T00:35:45.943991+0000","last_active":"2024-09-12T01:19:08.470217+0000","last_peered":"2024-09-12T01:19:08.470217+0000","last_clean":"2024-09-12T01:19:08.470217+0000","last_became_active":"2024-09-12T00:35:45.942032+0000","last_became_peered":"2024-09-12T00:35:45.942032+0000","last_unstale":"2024-09-12T01:19:08.470217+0000","last_undegraded":"2024-09-12T01:19:08.470217+0000","last_fullsized":"2024-09-12T01:19:08.470217+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:52.127080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":475,"num_read_kb":403,"num_write":145,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'318","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.845856+0000","last_change":"2024-09-12T00:35:43.954091+0000","last_active":"2024-09-12T01:21:57.845856+0000","last_peered":"2024-09-12T01:21:57.845856+0000","last_clean":"2024-09-12T01:21:57.845856+0000","last_became_active":"2024-09-12T00:35:43.953619+0000","last_became_peered":"2024-09-12T00:35:43.953619+0000","last_unstale":"2024-09-12T01:21:57.845856+0000","last_undegraded":"2024-09-12T01:21:57.845856+0000","last_fullsized":"2024-09-12T01:21:57.845856+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:57.329602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2238687,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":418,"num_read_kb":24307,"num_write":963,"num_write_kb":33018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":517,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:53.572551+0000","last_change":"2024-09-12T00:35:31.699143+0000","last_active":"2024-09-12T01:18:53.572551+0000","last_peered":"2024-09-12T01:18:53.572551+0000","last_clean":"2024-09-12T01:18:53.572551+0000","last_became_active":"2024-09-12T00:35:29.671727+0000","last_became_peered":"2024-09-12T00:35:29.671727+0000","last_unstale":"2024-09-12T01:18:53.572551+0000","last_undegraded":"2024-09-12T01:18:53.572551+0000","last_fullsized":"2024-09-12T01:18:53.572551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:24.616311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010553139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.555547+0000","last_change":"2024-09-12T00:35:47.937179+0000","last_active":"2024-09-12T01:19:32.555547+0000","last_peered":"2024-09-12T01:19:32.555547+0000","last_clean":"2024-09-12T01:19:32.555547+0000","last_became_active":"2024-09-12T00:35:47.936452+0000","last_became_peered":"2024-09-12T00:35:47.936452+0000","last_unstale":"2024-09-12T01:19:32.555547+0000","last_undegraded":"2024-09-12T01:19:32.555547+0000","last_fullsized":"2024-09-12T01:19:32.555547+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:33.795481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'113","reported_seq":658,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.557003+0000","last_change":"2024-09-12T00:35:49.941635+0000","last_active":"2024-09-12T01:19:37.557003+0000","last_peered":"2024-09-12T01:19:37.557003+0000","last_clean":"2024-09-12T01:19:37.557003+0000","last_became_active":"2024-09-12T00:35:49.940788+0000","last_became_peered":"2024-09-12T00:35:49.940788+0000","last_unstale":"2024-09-12T01:19:37.557003+0000","last_undegraded":"2024-09-12T01:19:37.557003+0000","last_fullsized":"2024-09-12T01:19:37.557003+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:50.095723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'789","reported_seq":2416,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.316325+0000","last_change":"2024-09-12T00:35:51.980717+0000","last_active":"2024-09-12T01:21:57.316325+0000","last_peered":"2024-09-12T01:21:57.316325+0000","last_clean":"2024-09-12T01:21:57.316325+0000","last_became_active":"2024-09-12T00:35:51.979997+0000","last_became_peered":"2024-09-12T00:35:51.979997+0000","last_unstale":"2024-09-12T01:21:57.316325+0000","last_undegraded":"2024-09-12T01:21:57.316325+0000","last_fullsized":"2024-09-12T01:21:57.316325+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:15.785752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'278","reported_seq":795,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:36.375145+0000","last_change":"2024-09-12T00:35:53.993708+0000","last_active":"2024-09-12T01:19:36.375145+0000","last_peered":"2024-09-12T01:19:36.375145+0000","last_clean":"2024-09-12T01:19:36.375145+0000","last_became_active":"2024-09-12T00:35:53.992431+0000","last_became_peered":"2024-09-12T00:35:53.992431+0000","last_unstale":"2024-09-12T01:19:36.375145+0000","last_undegraded":"2024-09-12T01:19:36.375145+0000","last_fullsized":"2024-09-12T01:19:36.375145+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:35.605076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":344,"num_read_kb":342,"num_write":602,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'372","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.555503+0000","last_change":"2024-09-12T00:35:45.929519+0000","last_active":"2024-09-12T01:19:32.555503+0000","last_peered":"2024-09-12T01:19:32.555503+0000","last_clean":"2024-09-12T01:19:32.555503+0000","last_became_active":"2024-09-12T00:35:45.928789+0000","last_became_peered":"2024-09-12T00:35:45.928789+0000","last_unstale":"2024-09-12T01:19:32.555503+0000","last_undegraded":"2024-09-12T01:19:32.555503+0000","last_fullsized":"2024-09-12T01:19:32.555503+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:09.582521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1634,"num_read_kb":1297,"num_write":639,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'360","reported_seq":1037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.826735+0000","last_change":"2024-09-12T00:35:43.933310+0000","last_active":"2024-09-12T01:21:57.826735+0000","last_peered":"2024-09-12T01:21:57.826735+0000","last_clean":"2024-09-12T01:21:57.826735+0000","last_became_active":"2024-09-12T00:35:43.932994+0000","last_became_peered":"2024-09-12T00:35:43.932994+0000","last_unstale":"2024-09-12T01:21:57.826735+0000","last_undegraded":"2024-09-12T01:21:57.826735+0000","last_fullsized":"2024-09-12T01:21:57.826735+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:30.435523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":624,"num_read_kb":1635,"num_write":1170,"num_write_kb":36329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:52.554359+0000","last_change":"2024-09-12T00:35:31.686791+0000","last_active":"2024-09-12T01:18:52.554359+0000","last_peered":"2024-09-12T01:18:52.554359+0000","last_clean":"2024-09-12T01:18:52.554359+0000","last_became_active":"2024-09-12T00:35:29.670571+0000","last_became_peered":"2024-09-12T00:35:29.670571+0000","last_unstale":"2024-09-12T01:18:52.554359+0000","last_undegraded":"2024-09-12T01:18:52.554359+0000","last_fullsized":"2024-09-12T01:18:52.554359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:53.106651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012596770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:58.574739+0000","last_change":"2024-09-12T00:35:47.934122+0000","last_active":"2024-09-12T01:17:58.574739+0000","last_peered":"2024-09-12T01:17:58.574739+0000","last_clean":"2024-09-12T01:17:58.574739+0000","last_became_active":"2024-09-12T00:35:47.933798+0000","last_became_peered":"2024-09-12T00:35:47.933798+0000","last_unstale":"2024-09-12T01:17:58.574739+0000","last_undegraded":"2024-09-12T01:17:58.574739+0000","last_fullsized":"2024-09-12T01:17:58.574739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:45.253346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'725","reported_seq":1449,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.696858+0000","last_change":"2024-09-12T00:35:50.029172+0000","last_active":"2024-09-12T01:21:57.696858+0000","last_peered":"2024-09-12T01:21:57.696858+0000","last_clean":"2024-09-12T01:21:57.696858+0000","last_became_active":"2024-09-12T00:35:50.028341+0000","last_became_peered":"2024-09-12T00:35:50.028341+0000","last_unstale":"2024-09-12T01:21:57.696858+0000","last_undegraded":"2024-09-12T01:21:57.696858+0000","last_fullsized":"2024-09-12T01:21:57.696858+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:00.896912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139080,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1312,"num_read_kb":3096,"num_write":1068,"num_write_kb":883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:38.599116+0000","last_change":"2024-09-12T00:35:51.975754+0000","last_active":"2024-09-12T01:19:38.599116+0000","last_peered":"2024-09-12T01:19:38.599116+0000","last_clean":"2024-09-12T01:19:38.599116+0000","last_became_active":"2024-09-12T00:35:51.974473+0000","last_became_peered":"2024-09-12T00:35:51.974473+0000","last_unstale":"2024-09-12T01:19:38.599116+0000","last_undegraded":"2024-09-12T01:19:38.599116+0000","last_fullsized":"2024-09-12T01:19:38.599116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:18.151442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'108","reported_seq":610,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:09.188058+0000","last_change":"2024-09-12T00:35:53.996281+0000","last_active":"2024-09-12T01:19:09.188058+0000","last_peered":"2024-09-12T01:19:09.188058+0000","last_clean":"2024-09-12T01:19:09.188058+0000","last_became_active":"2024-09-12T00:35:53.995431+0000","last_became_peered":"2024-09-12T00:35:53.995431+0000","last_unstale":"2024-09-12T01:19:09.188058+0000","last_undegraded":"2024-09-12T01:19:09.188058+0000","last_fullsized":"2024-09-12T01:19:09.188058+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:23.854939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":133,"num_write":267,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'116","reported_seq":666,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:24.501863+0000","last_change":"2024-09-12T00:35:54.003023+0000","last_active":"2024-09-12T01:21:24.501863+0000","last_peered":"2024-09-12T01:21:24.501863+0000","last_clean":"2024-09-12T01:21:24.501863+0000","last_became_active":"2024-09-12T00:35:54.002052+0000","last_became_peered":"2024-09-12T00:35:54.002052+0000","last_unstale":"2024-09-12T01:21:24.501863+0000","last_undegraded":"2024-09-12T01:21:24.501863+0000","last_fullsized":"2024-09-12T01:21:24.501863+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:18.230366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":193,"num_write":267,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'96","reported_seq":682,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.975864+0000","last_change":"2024-09-12T00:35:45.954536+0000","last_active":"2024-09-12T01:18:18.975864+0000","last_peered":"2024-09-12T01:18:18.975864+0000","last_clean":"2024-09-12T01:18:18.975864+0000","last_became_active":"2024-09-12T00:35:45.954079+0000","last_became_peered":"2024-09-12T00:35:45.954079+0000","last_unstale":"2024-09-12T01:18:18.975864+0000","last_undegraded":"2024-09-12T01:18:18.975864+0000","last_fullsized":"2024-09-12T01:18:18.975864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:37.716853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":455,"num_read_kb":391,"num_write":154,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'413","reported_seq":1111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.568960+0000","last_change":"2024-09-12T00:35:43.948592+0000","last_active":"2024-09-12T01:21:57.568960+0000","last_peered":"2024-09-12T01:21:57.568960+0000","last_clean":"2024-09-12T01:21:57.568960+0000","last_became_active":"2024-09-12T00:35:43.947940+0000","last_became_peered":"2024-09-12T00:35:43.947940+0000","last_unstale":"2024-09-12T01:21:57.568960+0000","last_undegraded":"2024-09-12T01:21:57.568960+0000","last_fullsized":"2024-09-12T01:21:57.568960+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:06.011716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5270410,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":777,"num_read_kb":4159,"num_write":1245,"num_write_kb":17308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:48.555127+0000","last_change":"2024-09-12T00:35:47.930161+0000","last_active":"2024-09-12T01:17:48.555127+0000","last_peered":"2024-09-12T01:17:48.555127+0000","last_clean":"2024-09-12T01:17:48.555127+0000","last_became_active":"2024-09-12T00:35:47.929844+0000","last_became_peered":"2024-09-12T00:35:47.929844+0000","last_unstale":"2024-09-12T01:17:48.555127+0000","last_undegraded":"2024-09-12T01:17:48.555127+0000","last_fullsized":"2024-09-12T01:17:48.555127+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:35.960740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'287","reported_seq":863,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.686059+0000","last_change":"2024-09-12T00:35:49.947886+0000","last_active":"2024-09-12T01:21:56.686059+0000","last_peered":"2024-09-12T01:21:56.686059+0000","last_clean":"2024-09-12T01:21:56.686059+0000","last_became_active":"2024-09-12T00:35:49.947136+0000","last_became_peered":"2024-09-12T00:35:49.947136+0000","last_unstale":"2024-09-12T01:21:56.686059+0000","last_undegraded":"2024-09-12T01:21:56.686059+0000","last_fullsized":"2024-09-12T01:21:56.686059+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:30.278867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43778,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":475,"num_read_kb":1081,"num_write":388,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:53.573483+0000","last_change":"2024-09-12T00:35:51.980791+0000","last_active":"2024-09-12T01:17:53.573483+0000","last_peered":"2024-09-12T01:17:53.573483+0000","last_clean":"2024-09-12T01:17:53.573483+0000","last_became_active":"2024-09-12T00:35:51.980092+0000","last_became_peered":"2024-09-12T00:35:51.980092+0000","last_unstale":"2024-09-12T01:17:53.573483+0000","last_undegraded":"2024-09-12T01:17:53.573483+0000","last_fullsized":"2024-09-12T01:17:53.573483+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:52.492457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'134","reported_seq":633,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:20.655512+0000","last_change":"2024-09-12T00:35:53.993259+0000","last_active":"2024-09-12T01:20:20.655512+0000","last_peered":"2024-09-12T01:20:20.655512+0000","last_clean":"2024-09-12T01:20:20.655512+0000","last_became_active":"2024-09-12T00:35:53.992579+0000","last_became_peered":"2024-09-12T00:35:53.992579+0000","last_unstale":"2024-09-12T01:20:20.655512+0000","last_undegraded":"2024-09-12T01:20:20.655512+0000","last_fullsized":"2024-09-12T01:20:20.655512+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:44.006963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":139,"num_write":341,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'161","reported_seq":745,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:03.701304+0000","last_change":"2024-09-12T00:35:45.958044+0000","last_active":"2024-09-12T01:20:03.701304+0000","last_peered":"2024-09-12T01:20:03.701304+0000","last_clean":"2024-09-12T01:20:03.701304+0000","last_became_active":"2024-09-12T00:35:45.957614+0000","last_became_peered":"2024-09-12T00:35:45.957614+0000","last_unstale":"2024-09-12T01:20:03.701304+0000","last_undegraded":"2024-09-12T01:20:03.701304+0000","last_fullsized":"2024-09-12T01:20:03.701304+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:29.459571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":661,"num_read_kb":539,"num_write":259,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'359","reported_seq":956,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.830383+0000","last_change":"2024-09-12T00:36:17.270183+0000","last_active":"2024-09-12T01:21:57.830383+0000","last_peered":"2024-09-12T01:21:57.830383+0000","last_clean":"2024-09-12T01:21:57.830383+0000","last_became_active":"2024-09-12T00:36:17.269377+0000","last_became_peered":"2024-09-12T00:36:17.269377+0000","last_unstale":"2024-09-12T01:21:57.830383+0000","last_undegraded":"2024-09-12T01:21:57.830383+0000","last_fullsized":"2024-09-12T01:21:57.830383+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:25.952652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":513,"num_read_kb":25436,"num_write":1264,"num_write_kb":33386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:48.572327+0000","last_change":"2024-09-12T00:35:47.941929+0000","last_active":"2024-09-12T01:17:48.572327+0000","last_peered":"2024-09-12T01:17:48.572327+0000","last_clean":"2024-09-12T01:17:48.572327+0000","last_became_active":"2024-09-12T00:35:47.941493+0000","last_became_peered":"2024-09-12T00:35:47.941493+0000","last_unstale":"2024-09-12T01:17:48.572327+0000","last_undegraded":"2024-09-12T01:17:48.572327+0000","last_fullsized":"2024-09-12T01:17:48.572327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:06.034904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'46","reported_seq":542,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:09.885099+0000","last_change":"2024-09-12T00:35:49.950088+0000","last_active":"2024-09-12T01:19:09.885099+0000","last_peered":"2024-09-12T01:19:09.885099+0000","last_clean":"2024-09-12T01:19:09.885099+0000","last_became_active":"2024-09-12T00:35:49.949331+0000","last_became_peered":"2024-09-12T00:35:49.949331+0000","last_unstale":"2024-09-12T01:19:09.885099+0000","last_undegraded":"2024-09-12T01:19:09.885099+0000","last_fullsized":"2024-09-12T01:19:09.885099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:00.112784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:52.773954+0000","last_change":"2024-09-12T00:35:51.977921+0000","last_active":"2024-09-12T01:17:52.773954+0000","last_peered":"2024-09-12T01:17:52.773954+0000","last_clean":"2024-09-12T01:17:52.773954+0000","last_became_active":"2024-09-12T00:35:51.977211+0000","last_became_peered":"2024-09-12T00:35:51.977211+0000","last_unstale":"2024-09-12T01:17:52.773954+0000","last_undegraded":"2024-09-12T01:17:52.773954+0000","last_fullsized":"2024-09-12T01:17:52.773954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:37.744652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'214","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.264295+0000","last_change":"2024-09-12T00:35:53.992509+0000","last_active":"2024-09-12T01:20:22.264295+0000","last_peered":"2024-09-12T01:20:22.264295+0000","last_clean":"2024-09-12T01:20:22.264295+0000","last_became_active":"2024-09-12T00:35:53.985696+0000","last_became_peered":"2024-09-12T00:35:53.985696+0000","last_unstale":"2024-09-12T01:20:22.264295+0000","last_undegraded":"2024-09-12T01:20:22.264295+0000","last_fullsized":"2024-09-12T01:20:22.264295+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:55.326440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":288,"num_read_kb":283,"num_write":478,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'116","reported_seq":720,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:36.946980+0000","last_change":"2024-09-12T00:35:45.944333+0000","last_active":"2024-09-12T01:18:36.946980+0000","last_peered":"2024-09-12T01:18:36.946980+0000","last_clean":"2024-09-12T01:18:36.946980+0000","last_became_active":"2024-09-12T00:35:45.942161+0000","last_became_peered":"2024-09-12T00:35:45.942161+0000","last_unstale":"2024-09-12T01:18:36.946980+0000","last_undegraded":"2024-09-12T01:18:36.946980+0000","last_fullsized":"2024-09-12T01:18:36.946980+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:45.930313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":566,"num_read_kb":479,"num_write":187,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'289","reported_seq":889,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.822707+0000","last_change":"2024-09-12T00:35:43.951301+0000","last_active":"2024-09-12T01:21:57.822707+0000","last_peered":"2024-09-12T01:21:57.822707+0000","last_clean":"2024-09-12T01:21:57.822707+0000","last_became_active":"2024-09-12T00:35:43.950660+0000","last_became_peered":"2024-09-12T00:35:43.950660+0000","last_unstale":"2024-09-12T01:21:57.822707+0000","last_undegraded":"2024-09-12T01:21:57.822707+0000","last_fullsized":"2024-09-12T01:21:57.822707+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:51.119280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110814,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":386,"num_read_kb":2177,"num_write":879,"num_write_kb":8684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:47.772763+0000","last_change":"2024-09-12T00:35:47.946510+0000","last_active":"2024-09-12T01:17:47.772763+0000","last_peered":"2024-09-12T01:17:47.772763+0000","last_clean":"2024-09-12T01:17:47.772763+0000","last_became_active":"2024-09-12T00:35:47.945819+0000","last_became_peered":"2024-09-12T00:35:47.945819+0000","last_unstale":"2024-09-12T01:17:47.772763+0000","last_undegraded":"2024-09-12T01:17:47.772763+0000","last_fullsized":"2024-09-12T01:17:47.772763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:13.092089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'348","reported_seq":934,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.503752+0000","last_change":"2024-09-12T00:35:49.955755+0000","last_active":"2024-09-12T01:21:57.503752+0000","last_peered":"2024-09-12T01:21:57.503752+0000","last_clean":"2024-09-12T01:21:57.503752+0000","last_became_active":"2024-09-12T00:35:49.954646+0000","last_became_peered":"2024-09-12T00:35:49.954646+0000","last_unstale":"2024-09-12T01:21:57.503752+0000","last_undegraded":"2024-09-12T01:21:57.503752+0000","last_fullsized":"2024-09-12T01:21:57.503752+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:59.408731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66883,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":574,"num_read_kb":1344,"num_write":472,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:52.540778+0000","last_change":"2024-09-12T00:35:51.974798+0000","last_active":"2024-09-12T01:17:52.540778+0000","last_peered":"2024-09-12T01:17:52.540778+0000","last_clean":"2024-09-12T01:17:52.540778+0000","last_became_active":"2024-09-12T00:35:51.973993+0000","last_became_peered":"2024-09-12T00:35:51.973993+0000","last_unstale":"2024-09-12T01:17:52.540778+0000","last_undegraded":"2024-09-12T01:17:52.540778+0000","last_fullsized":"2024-09-12T01:17:52.540778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:02.005519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'103","reported_seq":609,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:56.474802+0000","last_change":"2024-09-12T00:35:54.001932+0000","last_active":"2024-09-12T01:19:56.474802+0000","last_peered":"2024-09-12T01:19:56.474802+0000","last_clean":"2024-09-12T01:19:56.474802+0000","last_became_active":"2024-09-12T00:35:54.001337+0000","last_became_peered":"2024-09-12T00:35:54.001337+0000","last_unstale":"2024-09-12T01:19:56.474802+0000","last_undegraded":"2024-09-12T01:19:56.474802+0000","last_fullsized":"2024-09-12T01:19:56.474802+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:46.072438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":126,"num_write":245,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'4114","reported_seq":4735,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:05.320945+0000","last_change":"2024-09-12T00:35:45.940670+0000","last_active":"2024-09-12T01:20:05.320945+0000","last_peered":"2024-09-12T01:20:05.320945+0000","last_clean":"2024-09-12T01:20:05.320945+0000","last_became_active":"2024-09-12T00:35:45.938175+0000","last_became_peered":"2024-09-12T00:35:45.938175+0000","last_unstale":"2024-09-12T01:20:05.320945+0000","last_undegraded":"2024-09-12T01:20:05.320945+0000","last_fullsized":"2024-09-12T01:20:05.320945+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:06.702726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16557,"num_read_kb":13901,"num_write":6164,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'305","reported_seq":908,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.855189+0000","last_change":"2024-09-12T00:35:43.935984+0000","last_active":"2024-09-12T01:21:57.855189+0000","last_peered":"2024-09-12T01:21:57.855189+0000","last_clean":"2024-09-12T01:21:57.855189+0000","last_became_active":"2024-09-12T00:35:43.935194+0000","last_became_peered":"2024-09-12T00:35:43.935194+0000","last_unstale":"2024-09-12T01:21:57.855189+0000","last_undegraded":"2024-09-12T01:21:57.855189+0000","last_fullsized":"2024-09-12T01:21:57.855189+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:19.822537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992287,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":416,"num_read_kb":10375,"num_write":976,"num_write_kb":15779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:47.539641+0000","last_change":"2024-09-12T00:35:47.945331+0000","last_active":"2024-09-12T01:17:47.539641+0000","last_peered":"2024-09-12T01:17:47.539641+0000","last_clean":"2024-09-12T01:17:47.539641+0000","last_became_active":"2024-09-12T00:35:47.944477+0000","last_became_peered":"2024-09-12T00:35:47.944477+0000","last_unstale":"2024-09-12T01:17:47.539641+0000","last_undegraded":"2024-09-12T01:17:47.539641+0000","last_fullsized":"2024-09-12T01:17:47.539641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:59.438695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'274","reported_seq":841,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.386915+0000","last_change":"2024-09-12T00:35:49.942723+0000","last_active":"2024-09-12T01:21:57.386915+0000","last_peered":"2024-09-12T01:21:57.386915+0000","last_clean":"2024-09-12T01:21:57.386915+0000","last_became_active":"2024-09-12T00:35:49.941948+0000","last_became_peered":"2024-09-12T00:35:49.941948+0000","last_unstale":"2024-09-12T01:21:57.386915+0000","last_undegraded":"2024-09-12T01:21:57.386915+0000","last_fullsized":"2024-09-12T01:21:57.386915+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:32.893865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45730,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":1073,"num_write":372,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":482,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:53.553514+0000","last_change":"2024-09-12T00:35:51.975893+0000","last_active":"2024-09-12T01:17:53.553514+0000","last_peered":"2024-09-12T01:17:53.553514+0000","last_clean":"2024-09-12T01:17:53.553514+0000","last_became_active":"2024-09-12T00:35:51.975124+0000","last_became_peered":"2024-09-12T00:35:51.975124+0000","last_unstale":"2024-09-12T01:17:53.553514+0000","last_undegraded":"2024-09-12T01:17:53.553514+0000","last_fullsized":"2024-09-12T01:17:53.553514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:49.874523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'251","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:55.418732+0000","last_change":"2024-09-12T00:35:45.942083+0000","last_active":"2024-09-12T01:19:55.418732+0000","last_peered":"2024-09-12T01:19:55.418732+0000","last_clean":"2024-09-12T01:19:55.418732+0000","last_became_active":"2024-09-12T00:35:45.941357+0000","last_became_peered":"2024-09-12T00:35:45.941357+0000","last_unstale":"2024-09-12T01:19:55.418732+0000","last_undegraded":"2024-09-12T01:19:55.418732+0000","last_fullsized":"2024-09-12T01:19:55.418732+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:58.892422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1115,"num_read_kb":918,"num_write":405,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'296","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.822255+0000","last_change":"2024-09-12T00:35:43.933290+0000","last_active":"2024-09-12T01:21:57.822255+0000","last_peered":"2024-09-12T01:21:57.822255+0000","last_clean":"2024-09-12T01:21:57.822255+0000","last_became_active":"2024-09-12T00:35:43.933037+0000","last_became_peered":"2024-09-12T00:35:43.933037+0000","last_unstale":"2024-09-12T01:21:57.822255+0000","last_undegraded":"2024-09-12T01:21:57.822255+0000","last_fullsized":"2024-09-12T01:21:57.822255+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:43.925660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730132,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":468,"num_read_kb":7309,"num_write":980,"num_write_kb":23054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"36'3","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.482835+0000","last_change":"2024-09-12T00:35:47.942588+0000","last_active":"2024-09-12T01:21:56.482835+0000","last_peered":"2024-09-12T01:21:56.482835+0000","last_clean":"2024-09-12T01:21:56.482835+0000","last_became_active":"2024-09-12T00:35:47.941749+0000","last_became_peered":"2024-09-12T00:35:47.941749+0000","last_unstale":"2024-09-12T01:21:56.482835+0000","last_undegraded":"2024-09-12T01:21:56.482835+0000","last_fullsized":"2024-09-12T01:21:56.482835+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:24.632274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'506","reported_seq":1137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.349319+0000","last_change":"2024-09-12T00:35:49.948724+0000","last_active":"2024-09-12T01:21:57.349319+0000","last_peered":"2024-09-12T01:21:57.349319+0000","last_clean":"2024-09-12T01:21:57.349319+0000","last_became_active":"2024-09-12T00:35:49.947963+0000","last_became_peered":"2024-09-12T00:35:49.947963+0000","last_unstale":"2024-09-12T01:21:57.349319+0000","last_undegraded":"2024-09-12T01:21:57.349319+0000","last_fullsized":"2024-09-12T01:21:57.349319+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:23.048505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95771,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":915,"num_read_kb":2195,"num_write":792,"num_write_kb":711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.553625+0000","last_change":"2024-09-12T00:35:51.968910+0000","last_active":"2024-09-12T01:18:23.553625+0000","last_peered":"2024-09-12T01:18:23.553625+0000","last_clean":"2024-09-12T01:18:23.553625+0000","last_became_active":"2024-09-12T00:35:51.968209+0000","last_became_peered":"2024-09-12T00:35:51.968209+0000","last_unstale":"2024-09-12T01:18:23.553625+0000","last_undegraded":"2024-09-12T01:18:23.553625+0000","last_fullsized":"2024-09-12T01:18:23.553625+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:40.274641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'158","reported_seq":653,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.097347+0000","last_change":"2024-09-12T00:35:54.013532+0000","last_active":"2024-09-12T01:20:22.097347+0000","last_peered":"2024-09-12T01:20:22.097347+0000","last_clean":"2024-09-12T01:20:22.097347+0000","last_became_active":"2024-09-12T00:35:54.012958+0000","last_became_peered":"2024-09-12T00:35:54.012958+0000","last_unstale":"2024-09-12T01:20:22.097347+0000","last_undegraded":"2024-09-12T01:20:22.097347+0000","last_fullsized":"2024-09-12T01:20:22.097347+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:34.515746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1092,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":166,"num_read_kb":178,"num_write":351,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'60","reported_seq":614,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:58.584807+0000","last_change":"2024-09-12T00:35:45.946291+0000","last_active":"2024-09-12T01:19:58.584807+0000","last_peered":"2024-09-12T01:19:58.584807+0000","last_clean":"2024-09-12T01:19:58.584807+0000","last_became_active":"2024-09-12T00:35:45.945952+0000","last_became_peered":"2024-09-12T00:35:45.945952+0000","last_unstale":"2024-09-12T01:19:58.584807+0000","last_undegraded":"2024-09-12T01:19:58.584807+0000","last_fullsized":"2024-09-12T01:19:58.584807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:19.912313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":234,"num_write":86,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'358","reported_seq":1014,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.835535+0000","last_change":"2024-09-12T00:35:43.930088+0000","last_active":"2024-09-12T01:21:57.835535+0000","last_peered":"2024-09-12T01:21:57.835535+0000","last_clean":"2024-09-12T01:21:57.835535+0000","last_became_active":"2024-09-12T00:35:43.928779+0000","last_became_peered":"2024-09-12T00:35:43.928779+0000","last_unstale":"2024-09-12T01:21:57.835535+0000","last_undegraded":"2024-09-12T01:21:57.835535+0000","last_fullsized":"2024-09-12T01:21:57.835535+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:27.466245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":507,"num_read_kb":67515,"num_write":1156,"num_write_kb":41697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.562535+0000","last_change":"2024-09-12T00:35:47.944821+0000","last_active":"2024-09-12T01:19:32.562535+0000","last_peered":"2024-09-12T01:19:32.562535+0000","last_clean":"2024-09-12T01:19:32.562535+0000","last_became_active":"2024-09-12T00:35:47.944056+0000","last_became_peered":"2024-09-12T00:35:47.944056+0000","last_unstale":"2024-09-12T01:19:32.562535+0000","last_undegraded":"2024-09-12T01:19:32.562535+0000","last_fullsized":"2024-09-12T01:19:32.562535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:34.718996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'270","reported_seq":850,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.421484+0000","last_change":"2024-09-12T00:35:49.946966+0000","last_active":"2024-09-12T01:21:57.421484+0000","last_peered":"2024-09-12T01:21:57.421484+0000","last_clean":"2024-09-12T01:21:57.421484+0000","last_became_active":"2024-09-12T00:35:49.946226+0000","last_became_peered":"2024-09-12T00:35:49.946226+0000","last_unstale":"2024-09-12T01:21:57.421484+0000","last_undegraded":"2024-09-12T01:21:57.421484+0000","last_fullsized":"2024-09-12T01:21:57.421484+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:45.810230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48166,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":461,"num_read_kb":978,"num_write":376,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":483,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.562310+0000","last_change":"2024-09-12T00:35:51.970897+0000","last_active":"2024-09-12T01:18:23.562310+0000","last_peered":"2024-09-12T01:18:23.562310+0000","last_clean":"2024-09-12T01:18:23.562310+0000","last_became_active":"2024-09-12T00:35:51.963735+0000","last_became_peered":"2024-09-12T00:35:51.963735+0000","last_unstale":"2024-09-12T01:18:23.562310+0000","last_undegraded":"2024-09-12T01:18:23.562310+0000","last_fullsized":"2024-09-12T01:18:23.562310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:20.013004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'196","reported_seq":702,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.113351+0000","last_change":"2024-09-12T00:35:53.991284+0000","last_active":"2024-09-12T01:20:22.113351+0000","last_peered":"2024-09-12T01:20:22.113351+0000","last_clean":"2024-09-12T01:20:22.113351+0000","last_became_active":"2024-09-12T00:35:53.990488+0000","last_became_peered":"2024-09-12T00:35:53.990488+0000","last_unstale":"2024-09-12T01:20:22.113351+0000","last_undegraded":"2024-09-12T01:20:22.113351+0000","last_fullsized":"2024-09-12T01:20:22.113351+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:57.849221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1821,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":235,"num_read_kb":229,"num_write":573,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'191","reported_seq":788,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:06.954169+0000","last_change":"2024-09-12T00:35:45.945163+0000","last_active":"2024-09-12T01:20:06.954169+0000","last_peered":"2024-09-12T01:20:06.954169+0000","last_clean":"2024-09-12T01:20:06.954169+0000","last_became_active":"2024-09-12T00:35:45.940529+0000","last_became_peered":"2024-09-12T00:35:45.940529+0000","last_unstale":"2024-09-12T01:20:06.954169+0000","last_undegraded":"2024-09-12T01:20:06.954169+0000","last_fullsized":"2024-09-12T01:20:06.954169+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:51.722964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":840,"num_read_kb":692,"num_write":286,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'327","reported_seq":1081,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.559299+0000","last_change":"2024-09-12T00:35:43.928101+0000","last_active":"2024-09-12T01:21:57.559299+0000","last_peered":"2024-09-12T01:21:57.559299+0000","last_clean":"2024-09-12T01:21:57.559299+0000","last_became_active":"2024-09-12T00:35:43.927426+0000","last_became_peered":"2024-09-12T00:35:43.927426+0000","last_unstale":"2024-09-12T01:21:57.559299+0000","last_undegraded":"2024-09-12T01:21:57.559299+0000","last_fullsized":"2024-09-12T01:21:57.559299+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:04.964381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":206,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":808,"num_read_kb":46781,"num_write":1097,"num_write_kb":16393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.739497+0000","last_change":"2024-09-12T00:35:47.934105+0000","last_active":"2024-09-12T01:18:17.739497+0000","last_peered":"2024-09-12T01:18:17.739497+0000","last_clean":"2024-09-12T01:18:17.739497+0000","last_became_active":"2024-09-12T00:35:47.933189+0000","last_became_peered":"2024-09-12T00:35:47.933189+0000","last_unstale":"2024-09-12T01:18:17.739497+0000","last_undegraded":"2024-09-12T01:18:17.739497+0000","last_fullsized":"2024-09-12T01:18:17.739497+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:01.418064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'284","reported_seq":863,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.862874+0000","last_change":"2024-09-12T00:35:50.030204+0000","last_active":"2024-09-12T01:21:56.862874+0000","last_peered":"2024-09-12T01:21:56.862874+0000","last_clean":"2024-09-12T01:21:56.862874+0000","last_became_active":"2024-09-12T00:35:50.029579+0000","last_became_peered":"2024-09-12T00:35:50.029579+0000","last_unstale":"2024-09-12T01:21:56.862874+0000","last_undegraded":"2024-09-12T01:21:56.862874+0000","last_fullsized":"2024-09-12T01:21:56.862874+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:54.577958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47233,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":1083,"num_write":390,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:58.587193+0000","last_change":"2024-09-12T00:35:51.972390+0000","last_active":"2024-09-12T01:19:58.587193+0000","last_peered":"2024-09-12T01:19:58.587193+0000","last_clean":"2024-09-12T01:19:58.587193+0000","last_became_active":"2024-09-12T00:35:51.971682+0000","last_became_peered":"2024-09-12T00:35:51.971682+0000","last_unstale":"2024-09-12T01:19:58.587193+0000","last_undegraded":"2024-09-12T01:19:58.587193+0000","last_fullsized":"2024-09-12T01:19:58.587193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:54.514575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'102","reported_seq":593,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.357123+0000","last_change":"2024-09-12T00:35:53.996274+0000","last_active":"2024-09-12T01:21:25.357123+0000","last_peered":"2024-09-12T01:21:25.357123+0000","last_clean":"2024-09-12T01:21:25.357123+0000","last_became_active":"2024-09-12T00:35:53.995464+0000","last_became_peered":"2024-09-12T00:35:53.995464+0000","last_unstale":"2024-09-12T01:21:25.357123+0000","last_undegraded":"2024-09-12T01:21:25.357123+0000","last_fullsized":"2024-09-12T01:21:25.357123+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:47.747130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":101,"num_write":247,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'297","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:54.778656+0000","last_change":"2024-09-12T00:35:45.947620+0000","last_active":"2024-09-12T01:19:54.778656+0000","last_peered":"2024-09-12T01:19:54.778656+0000","last_clean":"2024-09-12T01:19:54.778656+0000","last_became_active":"2024-09-12T00:35:45.947244+0000","last_became_peered":"2024-09-12T00:35:45.947244+0000","last_unstale":"2024-09-12T01:19:54.778656+0000","last_undegraded":"2024-09-12T01:19:54.778656+0000","last_fullsized":"2024-09-12T01:19:54.778656+0000","mapping_epoch":26,"log_start":"251'200","ondisk_log_start":"251'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:20.082192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1444,"num_read_kb":1250,"num_write":453,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'352","reported_seq":1108,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.824755+0000","last_change":"2024-09-12T00:35:43.947838+0000","last_active":"2024-09-12T01:21:57.824755+0000","last_peered":"2024-09-12T01:21:57.824755+0000","last_clean":"2024-09-12T01:21:57.824755+0000","last_became_active":"2024-09-12T00:35:43.947420+0000","last_became_peered":"2024-09-12T00:35:43.947420+0000","last_unstale":"2024-09-12T01:21:57.824755+0000","last_undegraded":"2024-09-12T01:21:57.824755+0000","last_fullsized":"2024-09-12T01:21:57.824755+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:47.159137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262187,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":720,"num_read_kb":19884,"num_write":1159,"num_write_kb":29921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.561198+0000","last_change":"2024-09-12T00:35:47.935965+0000","last_active":"2024-09-12T01:18:18.561198+0000","last_peered":"2024-09-12T01:18:18.561198+0000","last_clean":"2024-09-12T01:18:18.561198+0000","last_became_active":"2024-09-12T00:35:47.935440+0000","last_became_peered":"2024-09-12T00:35:47.935440+0000","last_unstale":"2024-09-12T01:18:18.561198+0000","last_undegraded":"2024-09-12T01:18:18.561198+0000","last_fullsized":"2024-09-12T01:18:18.561198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:47.836745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'90","reported_seq":619,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:57.735007+0000","last_change":"2024-09-12T00:35:50.026452+0000","last_active":"2024-09-12T01:17:57.735007+0000","last_peered":"2024-09-12T01:17:57.735007+0000","last_clean":"2024-09-12T01:17:57.735007+0000","last_became_active":"2024-09-12T00:35:50.025145+0000","last_became_peered":"2024-09-12T00:35:50.025145+0000","last_unstale":"2024-09-12T01:17:57.735007+0000","last_undegraded":"2024-09-12T01:17:57.735007+0000","last_fullsized":"2024-09-12T01:17:57.735007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:49.606844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":97,"num_read_kb":88,"num_write":76,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'771","reported_seq":2389,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.485653+0000","last_change":"2024-09-12T00:35:51.968551+0000","last_active":"2024-09-12T01:21:56.485653+0000","last_peered":"2024-09-12T01:21:56.485653+0000","last_clean":"2024-09-12T01:21:56.485653+0000","last_became_active":"2024-09-12T00:35:51.967797+0000","last_became_peered":"2024-09-12T00:35:51.967797+0000","last_unstale":"2024-09-12T01:21:56.485653+0000","last_undegraded":"2024-09-12T01:21:56.485653+0000","last_fullsized":"2024-09-12T01:21:56.485653+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:42.194060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'103","reported_seq":603,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.236409+0000","last_change":"2024-09-12T00:35:54.003014+0000","last_active":"2024-09-12T01:20:22.236409+0000","last_peered":"2024-09-12T01:20:22.236409+0000","last_clean":"2024-09-12T01:20:22.236409+0000","last_became_active":"2024-09-12T00:35:54.002318+0000","last_became_peered":"2024-09-12T00:35:54.002318+0000","last_unstale":"2024-09-12T01:20:22.236409+0000","last_undegraded":"2024-09-12T01:20:22.236409+0000","last_fullsized":"2024-09-12T01:20:22.236409+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:45.348319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":119,"num_write":243,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'135","reported_seq":740,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.739424+0000","last_change":"2024-09-12T00:35:45.936713+0000","last_active":"2024-09-12T01:18:17.739424+0000","last_peered":"2024-09-12T01:18:17.739424+0000","last_clean":"2024-09-12T01:18:17.739424+0000","last_became_active":"2024-09-12T00:35:45.935880+0000","last_became_peered":"2024-09-12T00:35:45.935880+0000","last_unstale":"2024-09-12T01:18:17.739424+0000","last_undegraded":"2024-09-12T01:18:17.739424+0000","last_fullsized":"2024-09-12T01:18:17.739424+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:29.055252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":617,"num_read_kb":515,"num_write":204,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'355","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.859915+0000","last_change":"2024-09-12T00:35:43.931892+0000","last_active":"2024-09-12T01:21:57.859915+0000","last_peered":"2024-09-12T01:21:57.859915+0000","last_clean":"2024-09-12T01:21:57.859915+0000","last_became_active":"2024-09-12T00:35:43.931008+0000","last_became_peered":"2024-09-12T00:35:43.931008+0000","last_unstale":"2024-09-12T01:21:57.859915+0000","last_undegraded":"2024-09-12T01:21:57.859915+0000","last_fullsized":"2024-09-12T01:21:57.859915+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:13.452075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730252,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":516,"num_read_kb":33271,"num_write":1211,"num_write_kb":48012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.779666+0000","last_change":"2024-09-12T00:35:47.951130+0000","last_active":"2024-09-12T01:18:17.779666+0000","last_peered":"2024-09-12T01:18:17.779666+0000","last_clean":"2024-09-12T01:18:17.779666+0000","last_became_active":"2024-09-12T00:35:47.950328+0000","last_became_peered":"2024-09-12T00:35:47.950328+0000","last_unstale":"2024-09-12T01:18:17.779666+0000","last_undegraded":"2024-09-12T01:18:17.779666+0000","last_fullsized":"2024-09-12T01:18:17.779666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:21.340191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'320","reported_seq":924,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.089170+0000","last_change":"2024-09-12T00:35:49.939297+0000","last_active":"2024-09-12T01:21:57.089170+0000","last_peered":"2024-09-12T01:21:57.089170+0000","last_clean":"2024-09-12T01:21:57.089170+0000","last_became_active":"2024-09-12T00:35:49.938536+0000","last_became_peered":"2024-09-12T00:35:49.938536+0000","last_unstale":"2024-09-12T01:21:57.089170+0000","last_undegraded":"2024-09-12T01:21:57.089170+0000","last_fullsized":"2024-09-12T01:21:57.089170+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:13.330863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46352,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":532,"num_read_kb":1127,"num_write":424,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":482,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:23.575502+0000","last_change":"2024-09-12T00:35:51.965185+0000","last_active":"2024-09-12T01:19:23.575502+0000","last_peered":"2024-09-12T01:19:23.575502+0000","last_clean":"2024-09-12T01:19:23.575502+0000","last_became_active":"2024-09-12T00:35:51.964446+0000","last_became_peered":"2024-09-12T00:35:51.964446+0000","last_unstale":"2024-09-12T01:19:23.575502+0000","last_undegraded":"2024-09-12T01:19:23.575502+0000","last_fullsized":"2024-09-12T01:19:23.575502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:04.163874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'136","reported_seq":648,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:20.487261+0000","last_change":"2024-09-12T00:35:53.998710+0000","last_active":"2024-09-12T01:20:20.487261+0000","last_peered":"2024-09-12T01:20:20.487261+0000","last_clean":"2024-09-12T01:20:20.487261+0000","last_became_active":"2024-09-12T00:35:53.997969+0000","last_became_peered":"2024-09-12T00:35:53.997969+0000","last_unstale":"2024-09-12T01:20:20.487261+0000","last_undegraded":"2024-09-12T01:20:20.487261+0000","last_fullsized":"2024-09-12T01:20:20.487261+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:50.127097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":591,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":213,"num_read_kb":189,"num_write":344,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'117","reported_seq":701,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:17.808530+0000","last_change":"2024-09-12T00:35:45.940384+0000","last_active":"2024-09-12T01:20:17.808530+0000","last_peered":"2024-09-12T01:20:17.808530+0000","last_clean":"2024-09-12T01:20:17.808530+0000","last_became_active":"2024-09-12T00:35:45.937597+0000","last_became_peered":"2024-09-12T00:35:45.937597+0000","last_unstale":"2024-09-12T01:20:17.808530+0000","last_undegraded":"2024-09-12T01:20:17.808530+0000","last_fullsized":"2024-09-12T01:20:17.808530+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:26.977811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":514,"num_read_kb":428,"num_write":167,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'305","reported_seq":899,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.850312+0000","last_change":"2024-09-12T00:35:43.914480+0000","last_active":"2024-09-12T01:21:57.850312+0000","last_peered":"2024-09-12T01:21:57.850312+0000","last_clean":"2024-09-12T01:21:57.850312+0000","last_became_active":"2024-09-12T00:35:43.913717+0000","last_became_peered":"2024-09-12T00:35:43.913717+0000","last_unstale":"2024-09-12T01:21:57.850312+0000","last_undegraded":"2024-09-12T01:21:57.850312+0000","last_fullsized":"2024-09-12T01:21:57.850312+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:01.278323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":6749,"num_write":932,"num_write_kb":25345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.552287+0000","last_change":"2024-09-12T00:35:47.940913+0000","last_active":"2024-09-12T01:18:18.552287+0000","last_peered":"2024-09-12T01:18:18.552287+0000","last_clean":"2024-09-12T01:18:18.552287+0000","last_became_active":"2024-09-12T00:35:47.940170+0000","last_became_peered":"2024-09-12T00:35:47.940170+0000","last_unstale":"2024-09-12T01:18:18.552287+0000","last_undegraded":"2024-09-12T01:18:18.552287+0000","last_fullsized":"2024-09-12T01:18:18.552287+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:41.868094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'276","reported_seq":844,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.130796+0000","last_change":"2024-09-12T00:35:49.954441+0000","last_active":"2024-09-12T01:21:57.130796+0000","last_peered":"2024-09-12T01:21:57.130796+0000","last_clean":"2024-09-12T01:21:57.130796+0000","last_became_active":"2024-09-12T00:35:49.952570+0000","last_became_peered":"2024-09-12T00:35:49.952570+0000","last_unstale":"2024-09-12T01:21:57.130796+0000","last_undegraded":"2024-09-12T01:21:57.130796+0000","last_fullsized":"2024-09-12T01:21:57.130796+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:31.309890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47159,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":464,"num_read_kb":1078,"num_write":380,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:27.561305+0000","last_change":"2024-09-12T00:35:51.974531+0000","last_active":"2024-09-12T01:19:27.561305+0000","last_peered":"2024-09-12T01:19:27.561305+0000","last_clean":"2024-09-12T01:19:27.561305+0000","last_became_active":"2024-09-12T00:35:51.973732+0000","last_became_peered":"2024-09-12T00:35:51.973732+0000","last_unstale":"2024-09-12T01:19:27.561305+0000","last_undegraded":"2024-09-12T01:19:27.561305+0000","last_fullsized":"2024-09-12T01:19:27.561305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:28.353680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'193","reported_seq":706,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.123850+0000","last_change":"2024-09-12T00:35:54.016500+0000","last_active":"2024-09-12T01:19:37.123850+0000","last_peered":"2024-09-12T01:19:37.123850+0000","last_clean":"2024-09-12T01:19:37.123850+0000","last_became_active":"2024-09-12T00:35:54.016028+0000","last_became_peered":"2024-09-12T00:35:54.016028+0000","last_unstale":"2024-09-12T01:19:37.123850+0000","last_undegraded":"2024-09-12T01:19:37.123850+0000","last_fullsized":"2024-09-12T01:19:37.123850+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:13.793560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":175,"num_read_kb":171,"num_write":438,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'198","reported_seq":811,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:40.883260+0000","last_change":"2024-09-12T00:35:45.941739+0000","last_active":"2024-09-12T01:19:40.883260+0000","last_peered":"2024-09-12T01:19:40.883260+0000","last_clean":"2024-09-12T01:19:40.883260+0000","last_became_active":"2024-09-12T00:35:45.941396+0000","last_became_peered":"2024-09-12T00:35:45.941396+0000","last_unstale":"2024-09-12T01:19:40.883260+0000","last_undegraded":"2024-09-12T01:19:40.883260+0000","last_fullsized":"2024-09-12T01:19:40.883260+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:23.094406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":858,"num_read_kb":711,"num_write":323,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'457","reported_seq":1333,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.864472+0000","last_change":"2024-09-12T00:35:43.942784+0000","last_active":"2024-09-12T01:21:57.864472+0000","last_peered":"2024-09-12T01:21:57.864472+0000","last_clean":"2024-09-12T01:21:57.864472+0000","last_became_active":"2024-09-12T00:35:43.942359+0000","last_became_peered":"2024-09-12T00:35:43.942359+0000","last_unstale":"2024-09-12T01:21:57.864472+0000","last_undegraded":"2024-09-12T01:21:57.864472+0000","last_fullsized":"2024-09-12T01:21:57.864472+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:02.785832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1122,"num_read_kb":58431,"num_write":1508,"num_write_kb":72479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:17.551730+0000","last_change":"2024-09-12T00:35:47.941539+0000","last_active":"2024-09-12T01:19:17.551730+0000","last_peered":"2024-09-12T01:19:17.551730+0000","last_clean":"2024-09-12T01:19:17.551730+0000","last_became_active":"2024-09-12T00:35:47.940501+0000","last_became_peered":"2024-09-12T00:35:47.940501+0000","last_unstale":"2024-09-12T01:19:17.551730+0000","last_undegraded":"2024-09-12T01:19:17.551730+0000","last_fullsized":"2024-09-12T01:19:17.551730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:32.448595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'228","reported_seq":788,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.785257+0000","last_change":"2024-09-12T00:35:49.956360+0000","last_active":"2024-09-12T01:21:56.785257+0000","last_peered":"2024-09-12T01:21:56.785257+0000","last_clean":"2024-09-12T01:21:56.785257+0000","last_became_active":"2024-09-12T00:35:49.955264+0000","last_became_peered":"2024-09-12T00:35:49.955264+0000","last_unstale":"2024-09-12T01:21:56.785257+0000","last_undegraded":"2024-09-12T01:21:56.785257+0000","last_fullsized":"2024-09-12T01:21:56.785257+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:15.469778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44002,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":385,"num_read_kb":903,"num_write":312,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:22.740634+0000","last_change":"2024-09-12T00:35:51.965221+0000","last_active":"2024-09-12T01:18:22.740634+0000","last_peered":"2024-09-12T01:18:22.740634+0000","last_clean":"2024-09-12T01:18:22.740634+0000","last_became_active":"2024-09-12T00:35:51.961691+0000","last_became_peered":"2024-09-12T00:35:51.961691+0000","last_unstale":"2024-09-12T01:18:22.740634+0000","last_undegraded":"2024-09-12T01:18:22.740634+0000","last_fullsized":"2024-09-12T01:18:22.740634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:22.139991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'194","reported_seq":1651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:20.421505+0000","last_change":"2024-09-12T00:35:53.992266+0000","last_active":"2024-09-12T01:20:20.421505+0000","last_peered":"2024-09-12T01:20:20.421505+0000","last_clean":"2024-09-12T01:20:20.421505+0000","last_became_active":"2024-09-12T00:35:53.991532+0000","last_became_peered":"2024-09-12T00:35:53.991532+0000","last_unstale":"2024-09-12T01:20:20.421505+0000","last_undegraded":"2024-09-12T01:20:20.421505+0000","last_fullsized":"2024-09-12T01:20:20.421505+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:47.645297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1185,"num_read_kb":1184,"num_write":442,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'185","reported_seq":796,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:52.882363+0000","last_change":"2024-09-12T00:35:45.955138+0000","last_active":"2024-09-12T01:19:52.882363+0000","last_peered":"2024-09-12T01:19:52.882363+0000","last_clean":"2024-09-12T01:19:52.882363+0000","last_became_active":"2024-09-12T00:35:45.954474+0000","last_became_peered":"2024-09-12T00:35:45.954474+0000","last_unstale":"2024-09-12T01:19:52.882363+0000","last_undegraded":"2024-09-12T01:19:52.882363+0000","last_fullsized":"2024-09-12T01:19:52.882363+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:40.526235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":774,"num_read_kb":643,"num_write":252,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'368","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.852623+0000","last_change":"2024-09-12T00:35:43.935329+0000","last_active":"2024-09-12T01:21:57.852623+0000","last_peered":"2024-09-12T01:21:57.852623+0000","last_clean":"2024-09-12T01:21:57.852623+0000","last_became_active":"2024-09-12T00:35:43.934998+0000","last_became_peered":"2024-09-12T00:35:43.934998+0000","last_unstale":"2024-09-12T01:21:57.852623+0000","last_undegraded":"2024-09-12T01:21:57.852623+0000","last_fullsized":"2024-09-12T01:21:57.852623+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:30.951798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":520,"num_read_kb":15471,"num_write":1132,"num_write_kb":44978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:23.579165+0000","last_change":"2024-09-12T00:35:47.929157+0000","last_active":"2024-09-12T01:19:23.579165+0000","last_peered":"2024-09-12T01:19:23.579165+0000","last_clean":"2024-09-12T01:19:23.579165+0000","last_became_active":"2024-09-12T00:35:47.928424+0000","last_became_peered":"2024-09-12T00:35:47.928424+0000","last_unstale":"2024-09-12T01:19:23.579165+0000","last_undegraded":"2024-09-12T01:19:23.579165+0000","last_fullsized":"2024-09-12T01:19:23.579165+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:48.464754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'297","reported_seq":895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.898129+0000","last_change":"2024-09-12T00:35:49.934387+0000","last_active":"2024-09-12T01:21:56.898129+0000","last_peered":"2024-09-12T01:21:56.898129+0000","last_clean":"2024-09-12T01:21:56.898129+0000","last_became_active":"2024-09-12T00:35:49.933165+0000","last_became_peered":"2024-09-12T00:35:49.933165+0000","last_unstale":"2024-09-12T01:21:56.898129+0000","last_undegraded":"2024-09-12T01:21:56.898129+0000","last_fullsized":"2024-09-12T01:21:56.898129+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:40.275776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49116,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":493,"num_read_kb":1065,"num_write":392,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.560633+0000","last_change":"2024-09-12T00:35:51.985500+0000","last_active":"2024-09-12T01:18:23.560633+0000","last_peered":"2024-09-12T01:18:23.560633+0000","last_clean":"2024-09-12T01:18:23.560633+0000","last_became_active":"2024-09-12T00:35:51.984756+0000","last_became_peered":"2024-09-12T00:35:51.984756+0000","last_unstale":"2024-09-12T01:18:23.560633+0000","last_undegraded":"2024-09-12T01:18:23.560633+0000","last_fullsized":"2024-09-12T01:18:23.560633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:50.437627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'185","reported_seq":692,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:24.493960+0000","last_change":"2024-09-12T00:35:53.986078+0000","last_active":"2024-09-12T01:21:24.493960+0000","last_peered":"2024-09-12T01:21:24.493960+0000","last_clean":"2024-09-12T01:21:24.493960+0000","last_became_active":"2024-09-12T00:35:53.985486+0000","last_became_peered":"2024-09-12T00:35:53.985486+0000","last_unstale":"2024-09-12T01:21:24.493960+0000","last_undegraded":"2024-09-12T01:21:24.493960+0000","last_fullsized":"2024-09-12T01:21:24.493960+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:09.339192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1062,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":193,"num_read_kb":167,"num_write":361,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'182","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:49.296781+0000","last_change":"2024-09-12T00:35:45.958055+0000","last_active":"2024-09-12T01:19:49.296781+0000","last_peered":"2024-09-12T01:19:49.296781+0000","last_clean":"2024-09-12T01:19:49.296781+0000","last_became_active":"2024-09-12T00:35:45.957698+0000","last_became_peered":"2024-09-12T00:35:45.957698+0000","last_unstale":"2024-09-12T01:19:49.296781+0000","last_undegraded":"2024-09-12T01:19:49.296781+0000","last_fullsized":"2024-09-12T01:19:49.296781+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:17.032556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":768,"num_read_kb":623,"num_write":277,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'358","reported_seq":1029,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.363805+0000","last_change":"2024-09-12T00:35:43.938029+0000","last_active":"2024-09-12T01:21:57.363805+0000","last_peered":"2024-09-12T01:21:57.363805+0000","last_clean":"2024-09-12T01:21:57.363805+0000","last_became_active":"2024-09-12T00:35:43.937281+0000","last_became_peered":"2024-09-12T00:35:43.937281+0000","last_unstale":"2024-09-12T01:21:57.363805+0000","last_undegraded":"2024-09-12T01:21:57.363805+0000","last_fullsized":"2024-09-12T01:21:57.363805+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:12.183580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6040124,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":573,"num_read_kb":52874,"num_write":1331,"num_write_kb":41162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'421","reported_seq":1110,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:44.539784+0000","last_change":"2024-09-12T00:35:45.932905+0000","last_active":"2024-09-12T01:19:44.539784+0000","last_peered":"2024-09-12T01:19:44.539784+0000","last_clean":"2024-09-12T01:19:44.539784+0000","last_became_active":"2024-09-12T00:35:45.932615+0000","last_became_peered":"2024-09-12T00:35:45.932615+0000","last_unstale":"2024-09-12T01:19:44.539784+0000","last_undegraded":"2024-09-12T01:19:44.539784+0000","last_fullsized":"2024-09-12T01:19:44.539784+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:14.286299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2107,"num_read_kb":1905,"num_write":744,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'235","reported_seq":896,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.242860+0000","last_change":"2024-09-12T00:35:43.922351+0000","last_active":"2024-09-12T01:19:48.242860+0000","last_peered":"2024-09-12T01:19:48.242860+0000","last_clean":"2024-09-12T01:19:48.242860+0000","last_became_active":"2024-09-12T00:35:43.922005+0000","last_became_peered":"2024-09-12T00:35:43.922005+0000","last_unstale":"2024-09-12T01:19:48.242860+0000","last_undegraded":"2024-09-12T01:19:48.242860+0000","last_fullsized":"2024-09-12T01:19:48.242860+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:30.017931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470543,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":483,"num_read_kb":1388,"num_write":945,"num_write_kb":25405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'246","reported_seq":865,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.563835+0000","last_change":"2024-09-12T00:35:45.940788+0000","last_active":"2024-09-12T01:19:08.563835+0000","last_peered":"2024-09-12T01:19:08.563835+0000","last_clean":"2024-09-12T01:19:08.563835+0000","last_became_active":"2024-09-12T00:35:45.940153+0000","last_became_peered":"2024-09-12T00:35:45.940153+0000","last_unstale":"2024-09-12T01:19:08.563835+0000","last_undegraded":"2024-09-12T01:19:08.563835+0000","last_fullsized":"2024-09-12T01:19:08.563835+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:41.108403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1055,"num_read_kb":856,"num_write":397,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'274","reported_seq":881,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:05.577849+0000","last_change":"2024-09-12T00:36:17.268203+0000","last_active":"2024-09-12T01:20:05.577849+0000","last_peered":"2024-09-12T01:20:05.577849+0000","last_clean":"2024-09-12T01:20:05.577849+0000","last_became_active":"2024-09-12T00:36:17.267594+0000","last_became_peered":"2024-09-12T00:36:17.267594+0000","last_unstale":"2024-09-12T01:20:05.577849+0000","last_undegraded":"2024-09-12T01:20:05.577849+0000","last_fullsized":"2024-09-12T01:20:05.577849+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:49.169181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5830246,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":399,"num_read_kb":41046,"num_write":1064,"num_write_kb":25796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"265'92","reported_seq":669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:59.355559+0000","last_change":"2024-09-12T00:35:45.945797+0000","last_active":"2024-09-12T01:19:59.355559+0000","last_peered":"2024-09-12T01:19:59.355559+0000","last_clean":"2024-09-12T01:19:59.355559+0000","last_became_active":"2024-09-12T00:35:45.945534+0000","last_became_peered":"2024-09-12T00:35:45.945534+0000","last_unstale":"2024-09-12T01:19:59.355559+0000","last_undegraded":"2024-09-12T01:19:59.355559+0000","last_fullsized":"2024-09-12T01:19:59.355559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:37.784859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":411,"num_read_kb":349,"num_write":136,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'318","reported_seq":949,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.834229+0000","last_change":"2024-09-12T00:35:43.934445+0000","last_active":"2024-09-12T01:21:57.834229+0000","last_peered":"2024-09-12T01:21:57.834229+0000","last_clean":"2024-09-12T01:21:57.834229+0000","last_became_active":"2024-09-12T00:35:43.934068+0000","last_became_peered":"2024-09-12T00:35:43.934068+0000","last_unstale":"2024-09-12T01:21:57.834229+0000","last_undegraded":"2024-09-12T01:21:57.834229+0000","last_fullsized":"2024-09-12T01:21:57.834229+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:30.567561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":780267,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":473,"num_read_kb":16449,"num_write":1046,"num_write_kb":32400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'160","reported_seq":796,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.600355+0000","last_change":"2024-09-12T00:35:45.944926+0000","last_active":"2024-09-12T01:19:43.600355+0000","last_peered":"2024-09-12T01:19:43.600355+0000","last_clean":"2024-09-12T01:19:43.600355+0000","last_became_active":"2024-09-12T00:35:45.944423+0000","last_became_peered":"2024-09-12T00:35:45.944423+0000","last_unstale":"2024-09-12T01:19:43.600355+0000","last_undegraded":"2024-09-12T01:19:43.600355+0000","last_fullsized":"2024-09-12T01:19:43.600355+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:02.168577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":713,"num_read_kb":599,"num_write":226,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"265'338","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.857603+0000","last_change":"2024-09-12T00:35:43.937795+0000","last_active":"2024-09-12T01:21:57.857603+0000","last_peered":"2024-09-12T01:21:57.857603+0000","last_clean":"2024-09-12T01:21:57.857603+0000","last_became_active":"2024-09-12T00:35:43.937104+0000","last_became_peered":"2024-09-12T00:35:43.937104+0000","last_unstale":"2024-09-12T01:21:57.857603+0000","last_undegraded":"2024-09-12T01:21:57.857603+0000","last_fullsized":"2024-09-12T01:21:57.857603+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:30.010970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262271,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":572,"num_read_kb":63038,"num_write":1116,"num_write_kb":29306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'251","reported_seq":846,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:45.359695+0000","last_change":"2024-09-12T00:35:45.958347+0000","last_active":"2024-09-12T01:19:45.359695+0000","last_peered":"2024-09-12T01:19:45.359695+0000","last_clean":"2024-09-12T01:19:45.359695+0000","last_became_active":"2024-09-12T00:35:45.957860+0000","last_became_peered":"2024-09-12T00:35:45.957860+0000","last_unstale":"2024-09-12T01:19:45.359695+0000","last_undegraded":"2024-09-12T01:19:45.359695+0000","last_fullsized":"2024-09-12T01:19:45.359695+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:49.651072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1076,"num_read_kb":859,"num_write":407,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'343","reported_seq":986,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.839108+0000","last_change":"2024-09-12T00:35:43.929564+0000","last_active":"2024-09-12T01:21:57.839108+0000","last_peered":"2024-09-12T01:21:57.839108+0000","last_clean":"2024-09-12T01:21:57.839108+0000","last_became_active":"2024-09-12T00:35:43.929027+0000","last_became_peered":"2024-09-12T00:35:43.929027+0000","last_unstale":"2024-09-12T01:21:57.839108+0000","last_undegraded":"2024-09-12T01:21:57.839108+0000","last_fullsized":"2024-09-12T01:21:57.839108+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:38.958866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":588,"num_read_kb":747,"num_write":1224,"num_write_kb":5740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'102","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:33.597890+0000","last_change":"2024-09-12T00:35:45.949059+0000","last_active":"2024-09-12T01:19:33.597890+0000","last_peered":"2024-09-12T01:19:33.597890+0000","last_clean":"2024-09-12T01:19:33.597890+0000","last_became_active":"2024-09-12T00:35:45.948581+0000","last_became_peered":"2024-09-12T00:35:45.948581+0000","last_unstale":"2024-09-12T01:19:33.597890+0000","last_undegraded":"2024-09-12T01:19:33.597890+0000","last_fullsized":"2024-09-12T01:19:33.597890+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:03.771381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":463,"num_read_kb":395,"num_write":145,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"265'309","reported_seq":940,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.368841+0000","last_change":"2024-09-12T00:35:43.941896+0000","last_active":"2024-09-12T01:21:57.368841+0000","last_peered":"2024-09-12T01:21:57.368841+0000","last_clean":"2024-09-12T01:21:57.368841+0000","last_became_active":"2024-09-12T00:35:43.941155+0000","last_became_peered":"2024-09-12T00:35:43.941155+0000","last_unstale":"2024-09-12T01:21:57.368841+0000","last_undegraded":"2024-09-12T01:21:57.368841+0000","last_fullsized":"2024-09-12T01:21:57.368841+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:16.416635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5276258,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":434,"num_read_kb":4200,"num_write":1058,"num_write_kb":60173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"265'210","reported_seq":843,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.562354+0000","last_change":"2024-09-12T00:35:45.946815+0000","last_active":"2024-09-12T01:19:32.562354+0000","last_peered":"2024-09-12T01:19:32.562354+0000","last_clean":"2024-09-12T01:19:32.562354+0000","last_became_active":"2024-09-12T00:35:45.946047+0000","last_became_peered":"2024-09-12T00:35:45.946047+0000","last_unstale":"2024-09-12T01:19:32.562354+0000","last_undegraded":"2024-09-12T01:19:32.562354+0000","last_fullsized":"2024-09-12T01:19:32.562354+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:52.299599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":932,"num_read_kb":766,"num_write":302,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'318","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.857919+0000","last_change":"2024-09-12T00:35:43.924021+0000","last_active":"2024-09-12T01:21:57.857919+0000","last_peered":"2024-09-12T01:21:57.857919+0000","last_clean":"2024-09-12T01:21:57.857919+0000","last_became_active":"2024-09-12T00:35:43.923685+0000","last_became_peered":"2024-09-12T00:35:43.923685+0000","last_unstale":"2024-09-12T01:21:57.857919+0000","last_undegraded":"2024-09-12T01:21:57.857919+0000","last_fullsized":"2024-09-12T01:21:57.857919+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:37.087675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524322,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":440,"num_read_kb":73837,"num_write":961,"num_write_kb":48353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'100","reported_seq":678,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:51.229959+0000","last_change":"2024-09-12T00:35:45.942310+0000","last_active":"2024-09-12T01:18:51.229959+0000","last_peered":"2024-09-12T01:18:51.229959+0000","last_clean":"2024-09-12T01:18:51.229959+0000","last_became_active":"2024-09-12T00:35:45.941986+0000","last_became_peered":"2024-09-12T00:35:45.941986+0000","last_unstale":"2024-09-12T01:18:51.229959+0000","last_undegraded":"2024-09-12T01:18:51.229959+0000","last_fullsized":"2024-09-12T01:18:51.229959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:26.966357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":455,"num_read_kb":381,"num_write":169,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'335","reported_seq":1049,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.858500+0000","last_change":"2024-09-12T00:35:43.912420+0000","last_active":"2024-09-12T01:21:57.858500+0000","last_peered":"2024-09-12T01:21:57.858500+0000","last_clean":"2024-09-12T01:21:57.858500+0000","last_became_active":"2024-09-12T00:35:43.911654+0000","last_became_peered":"2024-09-12T00:35:43.911654+0000","last_unstale":"2024-09-12T01:21:57.858500+0000","last_undegraded":"2024-09-12T01:21:57.858500+0000","last_fullsized":"2024-09-12T01:21:57.858500+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:17.425827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262180,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":572,"num_read_kb":5667,"num_write":1085,"num_write_kb":32435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'261","reported_seq":851,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:08.858632+0000","last_change":"2024-09-12T00:35:45.927243+0000","last_active":"2024-09-12T01:20:08.858632+0000","last_peered":"2024-09-12T01:20:08.858632+0000","last_clean":"2024-09-12T01:20:08.858632+0000","last_became_active":"2024-09-12T00:35:45.926462+0000","last_became_peered":"2024-09-12T00:35:45.926462+0000","last_unstale":"2024-09-12T01:20:08.858632+0000","last_undegraded":"2024-09-12T01:20:08.858632+0000","last_fullsized":"2024-09-12T01:20:08.858632+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:10.440313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1050,"num_read_kb":836,"num_write":420,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'326","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.803189+0000","last_change":"2024-09-12T00:35:43.937158+0000","last_active":"2024-09-12T01:21:57.803189+0000","last_peered":"2024-09-12T01:21:57.803189+0000","last_clean":"2024-09-12T01:21:57.803189+0000","last_became_active":"2024-09-12T00:35:43.936883+0000","last_became_peered":"2024-09-12T00:35:43.936883+0000","last_unstale":"2024-09-12T01:21:57.803189+0000","last_undegraded":"2024-09-12T01:21:57.803189+0000","last_fullsized":"2024-09-12T01:21:57.803189+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:57.094162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2075264,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":536,"num_read_kb":80814,"num_write":1042,"num_write_kb":32955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"265'151","reported_seq":737,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:15.520650+0000","last_change":"2024-09-12T00:35:45.959301+0000","last_active":"2024-09-12T01:19:15.520650+0000","last_peered":"2024-09-12T01:19:15.520650+0000","last_clean":"2024-09-12T01:19:15.520650+0000","last_became_active":"2024-09-12T00:35:45.958997+0000","last_became_peered":"2024-09-12T00:35:45.958997+0000","last_unstale":"2024-09-12T01:19:15.520650+0000","last_undegraded":"2024-09-12T01:19:15.520650+0000","last_fullsized":"2024-09-12T01:19:15.520650+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:39.026757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":623,"num_read_kb":511,"num_write":250,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'370","reported_seq":1028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.848244+0000","last_change":"2024-09-12T00:35:43.943348+0000","last_active":"2024-09-12T01:21:57.848244+0000","last_peered":"2024-09-12T01:21:57.848244+0000","last_clean":"2024-09-12T01:21:57.848244+0000","last_became_active":"2024-09-12T00:35:43.942591+0000","last_became_peered":"2024-09-12T00:35:43.942591+0000","last_unstale":"2024-09-12T01:21:57.848244+0000","last_undegraded":"2024-09-12T01:21:57.848244+0000","last_fullsized":"2024-09-12T01:21:57.848244+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:50.909125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":894961,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":508,"num_read_kb":28251,"num_write":1134,"num_write_kb":59925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"265'83","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:32.742834+0000","last_change":"2024-09-12T00:35:45.954876+0000","last_active":"2024-09-12T01:18:32.742834+0000","last_peered":"2024-09-12T01:18:32.742834+0000","last_clean":"2024-09-12T01:18:32.742834+0000","last_became_active":"2024-09-12T00:35:45.954252+0000","last_became_peered":"2024-09-12T00:35:45.954252+0000","last_unstale":"2024-09-12T01:18:32.742834+0000","last_undegraded":"2024-09-12T01:18:32.742834+0000","last_fullsized":"2024-09-12T01:18:32.742834+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:48.605386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":370,"num_read_kb":310,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'381","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.857418+0000","last_change":"2024-09-12T00:35:43.953256+0000","last_active":"2024-09-12T01:21:57.857418+0000","last_peered":"2024-09-12T01:21:57.857418+0000","last_clean":"2024-09-12T01:21:57.857418+0000","last_became_active":"2024-09-12T00:35:43.952828+0000","last_became_peered":"2024-09-12T00:35:43.952828+0000","last_unstale":"2024-09-12T01:21:57.857418+0000","last_undegraded":"2024-09-12T01:21:57.857418+0000","last_fullsized":"2024-09-12T01:21:57.857418+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:32.309244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":611,"num_read_kb":10107,"num_write":1280,"num_write_kb":30495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'4192","reported_seq":4817,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:24.494966+0000","last_change":"2024-09-12T00:35:45.951097+0000","last_active":"2024-09-12T01:21:24.494966+0000","last_peered":"2024-09-12T01:21:24.494966+0000","last_clean":"2024-09-12T01:21:24.494966+0000","last_became_active":"2024-09-12T00:35:45.949770+0000","last_became_peered":"2024-09-12T00:35:45.949770+0000","last_unstale":"2024-09-12T01:21:24.494966+0000","last_undegraded":"2024-09-12T01:21:24.494966+0000","last_fullsized":"2024-09-12T01:21:24.494966+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":3000,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:12.568875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16900,"num_read_kb":14167,"num_write":6311,"num_write_kb":3148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'325","reported_seq":970,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.362592+0000","last_change":"2024-09-12T00:35:43.945424+0000","last_active":"2024-09-12T01:21:57.362592+0000","last_peered":"2024-09-12T01:21:57.362592+0000","last_clean":"2024-09-12T01:21:57.362592+0000","last_became_active":"2024-09-12T00:35:43.944721+0000","last_became_peered":"2024-09-12T00:35:43.944721+0000","last_unstale":"2024-09-12T01:21:57.362592+0000","last_undegraded":"2024-09-12T01:21:57.362592+0000","last_fullsized":"2024-09-12T01:21:57.362592+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:48.957484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1753109,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":507,"num_read_kb":12444,"num_write":1134,"num_write_kb":48295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'221","reported_seq":856,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:48.594988+0000","last_change":"2024-09-12T00:35:45.940317+0000","last_active":"2024-09-12T01:20:48.594988+0000","last_peered":"2024-09-12T01:20:48.594988+0000","last_clean":"2024-09-12T01:20:48.594988+0000","last_became_active":"2024-09-12T00:35:45.939921+0000","last_became_peered":"2024-09-12T00:35:45.939921+0000","last_unstale":"2024-09-12T01:20:48.594988+0000","last_undegraded":"2024-09-12T01:20:48.594988+0000","last_fullsized":"2024-09-12T01:20:48.594988+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:13.796483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":991,"num_read_kb":821,"num_write":345,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'340","reported_seq":969,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.803740+0000","last_change":"2024-09-12T00:35:43.943721+0000","last_active":"2024-09-12T01:21:57.803740+0000","last_peered":"2024-09-12T01:21:57.803740+0000","last_clean":"2024-09-12T01:21:57.803740+0000","last_became_active":"2024-09-12T00:35:43.942772+0000","last_became_peered":"2024-09-12T00:35:43.942772+0000","last_unstale":"2024-09-12T01:21:57.803740+0000","last_undegraded":"2024-09-12T01:21:57.803740+0000","last_fullsized":"2024-09-12T01:21:57.803740+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:17.244534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2330004,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":470,"num_read_kb":15742,"num_write":1093,"num_write_kb":41173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'153","reported_seq":771,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:33.583730+0000","last_change":"2024-09-12T00:35:45.938724+0000","last_active":"2024-09-12T01:18:33.583730+0000","last_peered":"2024-09-12T01:18:33.583730+0000","last_clean":"2024-09-12T01:18:33.583730+0000","last_became_active":"2024-09-12T00:35:45.937998+0000","last_became_peered":"2024-09-12T00:35:45.937998+0000","last_unstale":"2024-09-12T01:18:33.583730+0000","last_undegraded":"2024-09-12T01:18:33.583730+0000","last_fullsized":"2024-09-12T01:18:33.583730+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:04.489640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":680,"num_read_kb":568,"num_write":226,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'289","reported_seq":990,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:35.296244+0000","last_change":"2024-09-12T00:35:43.941342+0000","last_active":"2024-09-12T01:18:35.296244+0000","last_peered":"2024-09-12T01:18:35.296244+0000","last_clean":"2024-09-12T01:18:35.296244+0000","last_became_active":"2024-09-12T00:35:43.940876+0000","last_became_peered":"2024-09-12T00:35:43.940876+0000","last_unstale":"2024-09-12T01:18:35.296244+0000","last_undegraded":"2024-09-12T01:18:35.296244+0000","last_fullsized":"2024-09-12T01:18:35.296244+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:09.198397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5957581,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":658,"num_read_kb":28884,"num_write":1044,"num_write_kb":16361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'146","reported_seq":783,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:14.901305+0000","last_change":"2024-09-12T00:35:45.948798+0000","last_active":"2024-09-12T01:19:14.901305+0000","last_peered":"2024-09-12T01:19:14.901305+0000","last_clean":"2024-09-12T01:19:14.901305+0000","last_became_active":"2024-09-12T00:35:45.948028+0000","last_became_peered":"2024-09-12T00:35:45.948028+0000","last_unstale":"2024-09-12T01:19:14.901305+0000","last_undegraded":"2024-09-12T01:19:14.901305+0000","last_fullsized":"2024-09-12T01:19:14.901305+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:30.737963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":702,"num_read_kb":590,"num_write":208,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'337","reported_seq":1014,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.857128+0000","last_change":"2024-09-12T00:35:43.951405+0000","last_active":"2024-09-12T01:21:57.857128+0000","last_peered":"2024-09-12T01:21:57.857128+0000","last_clean":"2024-09-12T01:21:57.857128+0000","last_became_active":"2024-09-12T00:35:43.950791+0000","last_became_peered":"2024-09-12T00:35:43.950791+0000","last_unstale":"2024-09-12T01:21:57.857128+0000","last_undegraded":"2024-09-12T01:21:57.857128+0000","last_fullsized":"2024-09-12T01:21:57.857128+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:26.346445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5529046,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":579,"num_read_kb":37013,"num_write":1080,"num_write_kb":45879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'298","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.752923+0000","last_change":"2024-09-12T00:35:43.932104+0000","last_active":"2024-09-12T01:21:57.752923+0000","last_peered":"2024-09-12T01:21:57.752923+0000","last_clean":"2024-09-12T01:21:57.752923+0000","last_became_active":"2024-09-12T00:35:43.931367+0000","last_became_peered":"2024-09-12T00:35:43.931367+0000","last_unstale":"2024-09-12T01:21:57.752923+0000","last_undegraded":"2024-09-12T01:21:57.752923+0000","last_fullsized":"2024-09-12T01:21:57.752923+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:38.049554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":466,"num_read_kb":37317,"num_write":980,"num_write_kb":22412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'443","reported_seq":1072,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:28.576933+0000","last_change":"2024-09-12T00:35:45.941592+0000","last_active":"2024-09-12T01:19:28.576933+0000","last_peered":"2024-09-12T01:19:28.576933+0000","last_clean":"2024-09-12T01:19:28.576933+0000","last_became_active":"2024-09-12T00:35:45.941136+0000","last_became_peered":"2024-09-12T00:35:45.941136+0000","last_unstale":"2024-09-12T01:19:28.576933+0000","last_undegraded":"2024-09-12T01:19:28.576933+0000","last_fullsized":"2024-09-12T01:19:28.576933+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:02.451398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1924,"num_read_kb":1655,"num_write":712,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'343","reported_seq":993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.856682+0000","last_change":"2024-09-12T00:35:43.937060+0000","last_active":"2024-09-12T01:21:57.856682+0000","last_peered":"2024-09-12T01:21:57.856682+0000","last_clean":"2024-09-12T01:21:57.856682+0000","last_became_active":"2024-09-12T00:35:43.936772+0000","last_became_peered":"2024-09-12T00:35:43.936772+0000","last_unstale":"2024-09-12T01:21:57.856682+0000","last_undegraded":"2024-09-12T01:21:57.856682+0000","last_fullsized":"2024-09-12T01:21:57.856682+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:27.825066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":514466,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":11206,"num_write":1103,"num_write_kb":22250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'123","reported_seq":729,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.566303+0000","last_change":"2024-09-12T00:35:45.934557+0000","last_active":"2024-09-12T01:19:18.566303+0000","last_peered":"2024-09-12T01:19:18.566303+0000","last_clean":"2024-09-12T01:19:18.566303+0000","last_became_active":"2024-09-12T00:35:45.933748+0000","last_became_peered":"2024-09-12T00:35:45.933748+0000","last_unstale":"2024-09-12T01:19:18.566303+0000","last_undegraded":"2024-09-12T01:19:18.566303+0000","last_fullsized":"2024-09-12T01:19:18.566303+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:12.558899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":571,"num_read_kb":478,"num_write":188,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5965,"num_read_kb":4303,"num_write":1960,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":931,"ondisk_log_size":931,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":15013,"num_read_kb":14673,"num_write":16730,"num_write_kb":4883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2159,"ondisk_log_size":2159,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":574,"ondisk_log_size":574,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1559668,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":17679,"num_read_kb":36687,"num_write":14755,"num_write_kb":11528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":622592,"data_stored":320957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1942,"ondisk_log_size":1942,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2433,"num_read_kb":2900,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102034,"num_read_kb":85265,"num_write":36996,"num_write_kb":18612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3934,"ondisk_log_size":3934,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":130211676,"num_objects":853,"num_object_clones":0,"num_object_copies":1706,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":853,"num_whiteouts":0,"num_read":35364,"num_read_kb":1958462,"num_write":70905,"num_write_kb":2147647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":375255040,"data_stored":368641180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3533,"ondisk_log_size":3533,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":10490728,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":131,"num_read_kb":174261,"num_write":151,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37838848,"data_stored":37833994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91,"ondisk_log_size":91,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":179336,"num_write":153,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":93,"ondisk_log_size":93,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424510004,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148692,"kb_used_data":36832,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94223148,"statfs":{"total":96636764160,"available":96484503552,"internally_reserved":0,"allocated":37715968,"data_stored":35946887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510003,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":330504,"kb_used_data":86872,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94041336,"statfs":{"total":96636764160,"available":96298328064,"internally_reserved":0,"allocated":88956928,"data_stored":85964588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":249428423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510005,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126224,"kb_used_data":10384,"kb_used_omap":1,"kb_used_meta":115774,"kb_avail":94245616,"statfs":{"total":96636764160,"available":96507510784,"internally_reserved":0,"allocated":10633216,"data_stored":9073175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":118553029},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510004,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289016,"kb_used_data":72236,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94082824,"statfs":{"total":96636764160,"available":96340811776,"internally_reserved":0,"allocated":73969664,"data_stored":71447056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220985797},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542707,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299000,"kb_used_data":73272,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94072840,"statfs":{"total":96636764160,"available":96330588160,"internally_reserved":0,"allocated":75030528,"data_stored":71320599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":230947274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542706,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309408,"kb_used_data":101852,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94062432,"statfs":{"total":96636764160,"available":96319930368,"internally_reserved":0,"allocated":104296448,"data_stored":100380510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":212466118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542707,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":219676,"kb_used_data":148192,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94152164,"statfs":{"total":96636764160,"available":96411815936,"internally_reserved":0,"allocated":151748608,"data_stored":146546262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575410,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":201300,"kb_used_data":143748,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94170540,"statfs":{"total":96636764160,"available":96430632960,"internally_reserved":0,"allocated":147197952,"data_stored":142796807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25833472,"data_stored":25645853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6983680,"data_stored":6928219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":116109312,"data_stored":113213576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29499392,"data_stored":29284181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":95399936,"data_stored":94049345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34000896,"data_stored":33800787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":43352064,"data_stored":42014456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24076288,"data_stored":23704763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":134108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":180589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":4558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":6362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21012480,"data_stored":21011665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6340608,"data_stored":6336569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:21:59.616 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:21:59.617 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:21:59.991 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:22:00.004 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-12T01:22:00.009 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":1657,"stamp":"2024-09-12T01:21:59.137711+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":149162027,"num_objects":1213,"num_object_clones":0,"num_object_copies":2426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1213,"num_whiteouts":0,"num_read":178830,"num_read_kb":2455954,"num_write":141793,"num_write_kb":2416865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13350,"ondisk_log_size":13350,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1923820,"kb_used_data":673388,"kb_used_omap":12,"kb_used_meta":1248755,"kb_avail":753050900,"statfs":{"total":773094113280,"available":771124121600,"internally_reserved":0,"allocated":689549312,"data_stored":663475884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1278725680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-571207539,"num_objects":-3572,"num_object_clones":0,"num_object_copies":-7144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-3572,"num_whiteouts":0,"num_read":4040,"num_read_kb":3937,"num_write":3809,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.017254"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:43.558042+0000","last_change":"2024-09-12T01:03:40.585433+0000","last_active":"2024-09-12T01:18:43.558042+0000","last_peered":"2024-09-12T01:18:43.558042+0000","last_clean":"2024-09-12T01:18:43.558042+0000","last_became_active":"2024-09-12T01:03:40.584744+0000","last_became_peered":"2024-09-12T01:03:40.584744+0000","last_unstale":"2024-09-12T01:18:43.558042+0000","last_undegraded":"2024-09-12T01:18:43.558042+0000","last_fullsized":"2024-09-12T01:18:43.558042+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:08.339816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.544106+0000","last_change":"2024-09-12T00:52:40.345897+0000","last_active":"2024-09-12T01:17:43.544106+0000","last_peered":"2024-09-12T01:17:43.544106+0000","last_clean":"2024-09-12T01:17:43.544106+0000","last_became_active":"2024-09-12T00:52:40.345120+0000","last_became_peered":"2024-09-12T00:52:40.345120+0000","last_unstale":"2024-09-12T01:17:43.544106+0000","last_undegraded":"2024-09-12T01:17:43.544106+0000","last_fullsized":"2024-09-12T01:17:43.544106+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:08.139060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"265'3","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:08.606428+0000","last_change":"2024-09-12T00:52:37.282365+0000","last_active":"2024-09-12T01:20:08.606428+0000","last_peered":"2024-09-12T01:20:08.606428+0000","last_clean":"2024-09-12T01:20:08.606428+0000","last_became_active":"2024-09-12T00:52:37.276676+0000","last_became_peered":"2024-09-12T00:52:37.276676+0000","last_unstale":"2024-09-12T01:20:08.606428+0000","last_undegraded":"2024-09-12T01:20:08.606428+0000","last_fullsized":"2024-09-12T01:20:08.606428+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:49.462408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'38","reported_seq":155,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.558454+0000","last_change":"2024-09-12T00:51:04.999562+0000","last_active":"2024-09-12T01:18:13.558454+0000","last_peered":"2024-09-12T01:18:13.558454+0000","last_clean":"2024-09-12T01:18:13.558454+0000","last_became_active":"2024-09-12T00:51:04.998763+0000","last_became_peered":"2024-09-12T00:51:04.998763+0000","last_unstale":"2024-09-12T01:18:13.558454+0000","last_undegraded":"2024-09-12T01:18:13.558454+0000","last_fullsized":"2024-09-12T01:18:13.558454+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:53.376151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":142,"num_write":56,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:40.559635+0000","last_change":"2024-09-12T01:03:40.582702+0000","last_active":"2024-09-12T01:18:40.559635+0000","last_peered":"2024-09-12T01:18:40.559635+0000","last_clean":"2024-09-12T01:18:40.559635+0000","last_became_active":"2024-09-12T01:03:40.581266+0000","last_became_peered":"2024-09-12T01:03:40.581266+0000","last_unstale":"2024-09-12T01:18:40.559635+0000","last_undegraded":"2024-09-12T01:18:40.559635+0000","last_fullsized":"2024-09-12T01:18:40.559635+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:25.009896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"265'1","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:42.731685+0000","last_change":"2024-09-12T00:52:40.345386+0000","last_active":"2024-09-12T01:17:42.731685+0000","last_peered":"2024-09-12T01:17:42.731685+0000","last_clean":"2024-09-12T01:17:42.731685+0000","last_became_active":"2024-09-12T00:52:40.344674+0000","last_became_peered":"2024-09-12T00:52:40.344674+0000","last_unstale":"2024-09-12T01:17:42.731685+0000","last_undegraded":"2024-09-12T01:17:42.731685+0000","last_fullsized":"2024-09-12T01:17:42.731685+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:43.041640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4968,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":10,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'6","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:08.589427+0000","last_change":"2024-09-12T00:52:37.295217+0000","last_active":"2024-09-12T01:20:08.589427+0000","last_peered":"2024-09-12T01:20:08.589427+0000","last_clean":"2024-09-12T01:20:08.589427+0000","last_became_active":"2024-09-12T00:52:37.294438+0000","last_became_peered":"2024-09-12T00:52:37.294438+0000","last_unstale":"2024-09-12T01:20:08.589427+0000","last_undegraded":"2024-09-12T01:20:08.589427+0000","last_fullsized":"2024-09-12T01:20:08.589427+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:53.566890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'42","reported_seq":164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:10.566329+0000","last_change":"2024-09-12T00:51:04.962325+0000","last_active":"2024-09-12T01:19:10.566329+0000","last_peered":"2024-09-12T01:19:10.566329+0000","last_clean":"2024-09-12T01:19:10.566329+0000","last_became_active":"2024-09-12T00:51:04.961677+0000","last_became_peered":"2024-09-12T00:51:04.961677+0000","last_unstale":"2024-09-12T01:19:10.566329+0000","last_undegraded":"2024-09-12T01:19:10.566329+0000","last_fullsized":"2024-09-12T01:19:10.566329+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:51.606282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":168,"num_write":72,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:12.545131+0000","last_change":"2024-09-12T01:03:40.577634+0000","last_active":"2024-09-12T01:18:12.545131+0000","last_peered":"2024-09-12T01:18:12.545131+0000","last_clean":"2024-09-12T01:18:12.545131+0000","last_became_active":"2024-09-12T01:03:40.576550+0000","last_became_peered":"2024-09-12T01:03:40.576550+0000","last_unstale":"2024-09-12T01:18:12.545131+0000","last_undegraded":"2024-09-12T01:18:12.545131+0000","last_fullsized":"2024-09-12T01:18:12.545131+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:55.304251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"265'5","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:53.609270+0000","last_change":"2024-09-12T00:52:40.341193+0000","last_active":"2024-09-12T01:21:53.609270+0000","last_peered":"2024-09-12T01:21:53.609270+0000","last_clean":"2024-09-12T01:21:53.609270+0000","last_became_active":"2024-09-12T00:52:40.337945+0000","last_became_peered":"2024-09-12T00:52:40.337945+0000","last_unstale":"2024-09-12T01:21:53.609270+0000","last_undegraded":"2024-09-12T01:21:53.609270+0000","last_fullsized":"2024-09-12T01:21:53.609270+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:20.078369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:45.560948+0000","last_change":"2024-09-12T00:52:37.297111+0000","last_active":"2024-09-12T01:18:45.560948+0000","last_peered":"2024-09-12T01:18:45.560948+0000","last_clean":"2024-09-12T01:18:45.560948+0000","last_became_active":"2024-09-12T00:52:37.296335+0000","last_became_peered":"2024-09-12T00:52:37.296335+0000","last_unstale":"2024-09-12T01:18:45.560948+0000","last_undegraded":"2024-09-12T01:18:45.560948+0000","last_fullsized":"2024-09-12T01:18:45.560948+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:01.174517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'30","reported_seq":128,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.564783+0000","last_change":"2024-09-12T00:51:04.997842+0000","last_active":"2024-09-12T01:18:38.564783+0000","last_peered":"2024-09-12T01:18:38.564783+0000","last_clean":"2024-09-12T01:18:38.564783+0000","last_became_active":"2024-09-12T00:51:04.992519+0000","last_became_peered":"2024-09-12T00:51:04.992519+0000","last_unstale":"2024-09-12T01:18:38.564783+0000","last_undegraded":"2024-09-12T01:18:38.564783+0000","last_fullsized":"2024-09-12T01:18:38.564783+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:13.960445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":105,"num_write":58,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.579674+0000","last_change":"2024-09-12T01:03:40.587244+0000","last_active":"2024-09-12T01:18:18.579674+0000","last_peered":"2024-09-12T01:18:18.579674+0000","last_clean":"2024-09-12T01:18:18.579674+0000","last_became_active":"2024-09-12T01:03:40.586582+0000","last_became_peered":"2024-09-12T01:03:40.586582+0000","last_unstale":"2024-09-12T01:18:18.579674+0000","last_undegraded":"2024-09-12T01:18:18.579674+0000","last_fullsized":"2024-09-12T01:18:18.579674+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:46.195286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'5","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.135882+0000","last_change":"2024-09-12T00:53:18.616189+0000","last_active":"2024-09-12T01:21:57.135882+0000","last_peered":"2024-09-12T01:21:57.135882+0000","last_clean":"2024-09-12T01:21:57.135882+0000","last_became_active":"2024-09-12T00:53:18.615877+0000","last_became_peered":"2024-09-12T00:53:18.615877+0000","last_unstale":"2024-09-12T01:21:57.135882+0000","last_undegraded":"2024-09-12T01:21:57.135882+0000","last_fullsized":"2024-09-12T01:21:57.135882+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:35.115620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6184,"num_write":5,"num_write_kb":6184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:42.558460+0000","last_change":"2024-09-12T00:52:37.277359+0000","last_active":"2024-09-12T01:19:42.558460+0000","last_peered":"2024-09-12T01:19:42.558460+0000","last_clean":"2024-09-12T01:19:42.558460+0000","last_became_active":"2024-09-12T00:52:37.270357+0000","last_became_peered":"2024-09-12T00:52:37.270357+0000","last_unstale":"2024-09-12T01:19:42.558460+0000","last_undegraded":"2024-09-12T01:19:42.558460+0000","last_fullsized":"2024-09-12T01:19:42.558460+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:03.048579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'29","reported_seq":125,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.585016+0000","last_change":"2024-09-12T00:51:04.995220+0000","last_active":"2024-09-12T01:18:38.585016+0000","last_peered":"2024-09-12T01:18:38.585016+0000","last_clean":"2024-09-12T01:18:38.585016+0000","last_became_active":"2024-09-12T00:51:04.994459+0000","last_became_peered":"2024-09-12T00:51:04.994459+0000","last_unstale":"2024-09-12T01:18:38.585016+0000","last_undegraded":"2024-09-12T01:18:38.585016+0000","last_fullsized":"2024-09-12T01:18:38.585016+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:32.327605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":61,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.601539+0000","last_change":"2024-09-12T01:03:40.594312+0000","last_active":"2024-09-12T01:19:48.601539+0000","last_peered":"2024-09-12T01:19:48.601539+0000","last_clean":"2024-09-12T01:19:48.601539+0000","last_became_active":"2024-09-12T01:03:40.593614+0000","last_became_peered":"2024-09-12T01:03:40.593614+0000","last_unstale":"2024-09-12T01:19:48.601539+0000","last_undegraded":"2024-09-12T01:19:48.601539+0000","last_fullsized":"2024-09-12T01:19:48.601539+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:51.667787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"265'6","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:53.402527+0000","last_change":"2024-09-12T00:52:40.358057+0000","last_active":"2024-09-12T01:21:53.402527+0000","last_peered":"2024-09-12T01:21:53.402527+0000","last_clean":"2024-09-12T01:21:53.402527+0000","last_became_active":"2024-09-12T00:52:40.356507+0000","last_became_peered":"2024-09-12T00:52:40.356507+0000","last_unstale":"2024-09-12T01:21:53.402527+0000","last_undegraded":"2024-09-12T01:21:53.402527+0000","last_fullsized":"2024-09-12T01:21:53.402527+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:07.353171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":17408,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:13.572946+0000","last_change":"2024-09-12T00:52:37.293774+0000","last_active":"2024-09-12T01:19:13.572946+0000","last_peered":"2024-09-12T01:19:13.572946+0000","last_clean":"2024-09-12T01:19:13.572946+0000","last_became_active":"2024-09-12T00:52:37.293298+0000","last_became_peered":"2024-09-12T00:52:37.293298+0000","last_unstale":"2024-09-12T01:19:13.572946+0000","last_undegraded":"2024-09-12T01:19:13.572946+0000","last_fullsized":"2024-09-12T01:19:13.572946+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:24.891123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"262'30","reported_seq":137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.584909+0000","last_change":"2024-09-12T00:51:04.996662+0000","last_active":"2024-09-12T01:18:38.584909+0000","last_peered":"2024-09-12T01:18:38.584909+0000","last_clean":"2024-09-12T01:18:38.584909+0000","last_became_active":"2024-09-12T00:51:04.995863+0000","last_became_peered":"2024-09-12T00:51:04.995863+0000","last_unstale":"2024-09-12T01:18:38.584909+0000","last_undegraded":"2024-09-12T01:18:38.584909+0000","last_fullsized":"2024-09-12T01:18:38.584909+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:04.557157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":123,"num_write":48,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.561295+0000","last_change":"2024-09-12T01:03:40.576503+0000","last_active":"2024-09-12T01:18:18.561295+0000","last_peered":"2024-09-12T01:18:18.561295+0000","last_clean":"2024-09-12T01:18:18.561295+0000","last_became_active":"2024-09-12T01:03:40.575481+0000","last_became_peered":"2024-09-12T01:03:40.575481+0000","last_unstale":"2024-09-12T01:18:18.561295+0000","last_undegraded":"2024-09-12T01:18:18.561295+0000","last_fullsized":"2024-09-12T01:18:18.561295+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:48.119658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:17.559249+0000","last_change":"2024-09-12T00:52:40.350599+0000","last_active":"2024-09-12T01:19:17.559249+0000","last_peered":"2024-09-12T01:19:17.559249+0000","last_clean":"2024-09-12T01:19:17.559249+0000","last_became_active":"2024-09-12T00:52:40.349826+0000","last_became_peered":"2024-09-12T00:52:40.349826+0000","last_unstale":"2024-09-12T01:19:17.559249+0000","last_undegraded":"2024-09-12T01:19:17.559249+0000","last_fullsized":"2024-09-12T01:19:17.559249+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:49.311099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"265'18","reported_seq":86,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.980038+0000","last_change":"2024-09-12T00:52:37.284934+0000","last_active":"2024-09-12T01:21:56.980038+0000","last_peered":"2024-09-12T01:21:56.980038+0000","last_clean":"2024-09-12T01:21:56.980038+0000","last_became_active":"2024-09-12T00:52:37.283600+0000","last_became_peered":"2024-09-12T00:52:37.283600+0000","last_unstale":"2024-09-12T01:21:56.980038+0000","last_undegraded":"2024-09-12T01:21:56.980038+0000","last_fullsized":"2024-09-12T01:21:56.980038+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:50.299864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":56328,"num_write":28,"num_write_kb":20484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"265'59","reported_seq":206,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:37.551106+0000","last_change":"2024-09-12T00:51:04.983051+0000","last_active":"2024-09-12T01:18:37.551106+0000","last_peered":"2024-09-12T01:18:37.551106+0000","last_clean":"2024-09-12T01:18:37.551106+0000","last_became_active":"2024-09-12T00:51:04.982228+0000","last_became_peered":"2024-09-12T00:51:04.982228+0000","last_unstale":"2024-09-12T01:18:37.551106+0000","last_undegraded":"2024-09-12T01:18:37.551106+0000","last_fullsized":"2024-09-12T01:18:37.551106+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:07.565984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":210,"num_write":106,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.785889+0000","last_change":"2024-09-12T01:03:40.569067+0000","last_active":"2024-09-12T01:18:42.785889+0000","last_peered":"2024-09-12T01:18:42.785889+0000","last_clean":"2024-09-12T01:18:42.785889+0000","last_became_active":"2024-09-12T01:03:40.568346+0000","last_became_peered":"2024-09-12T01:03:40.568346+0000","last_unstale":"2024-09-12T01:18:42.785889+0000","last_undegraded":"2024-09-12T01:18:42.785889+0000","last_fullsized":"2024-09-12T01:18:42.785889+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:12.448021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"265'2","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:42.538508+0000","last_change":"2024-09-12T00:52:40.340425+0000","last_active":"2024-09-12T01:17:42.538508+0000","last_peered":"2024-09-12T01:17:42.538508+0000","last_clean":"2024-09-12T01:17:42.538508+0000","last_became_active":"2024-09-12T00:52:40.339627+0000","last_became_peered":"2024-09-12T00:52:40.339627+0000","last_unstale":"2024-09-12T01:17:42.538508+0000","last_undegraded":"2024-09-12T01:17:42.538508+0000","last_fullsized":"2024-09-12T01:17:42.538508+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:05.869695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"262'3","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:37.730433+0000","last_change":"2024-09-12T00:52:37.283996+0000","last_active":"2024-09-12T01:17:37.730433+0000","last_peered":"2024-09-12T01:17:37.730433+0000","last_clean":"2024-09-12T01:17:37.730433+0000","last_became_active":"2024-09-12T00:52:37.283199+0000","last_became_peered":"2024-09-12T00:52:37.283199+0000","last_unstale":"2024-09-12T01:17:37.730433+0000","last_undegraded":"2024-09-12T01:17:37.730433+0000","last_fullsized":"2024-09-12T01:17:37.730433+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:03.588195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"265'5","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.689244+0000","last_change":"2024-09-12T00:51:04.988358+0000","last_active":"2024-09-12T01:19:18.689244+0000","last_peered":"2024-09-12T01:19:18.689244+0000","last_clean":"2024-09-12T01:19:18.689244+0000","last_became_active":"2024-09-12T00:51:04.981675+0000","last_became_peered":"2024-09-12T00:51:04.981675+0000","last_unstale":"2024-09-12T01:19:18.689244+0000","last_undegraded":"2024-09-12T01:19:18.689244+0000","last_fullsized":"2024-09-12T01:19:18.689244+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:29.580737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.785967+0000","last_change":"2024-09-12T01:03:40.577284+0000","last_active":"2024-09-12T01:18:42.785967+0000","last_peered":"2024-09-12T01:18:42.785967+0000","last_clean":"2024-09-12T01:18:42.785967+0000","last_became_active":"2024-09-12T01:03:40.576430+0000","last_became_peered":"2024-09-12T01:03:40.576430+0000","last_unstale":"2024-09-12T01:18:42.785967+0000","last_undegraded":"2024-09-12T01:18:42.785967+0000","last_fullsized":"2024-09-12T01:18:42.785967+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:37.105480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:13.607494+0000","last_change":"2024-09-12T00:52:40.346703+0000","last_active":"2024-09-12T01:20:13.607494+0000","last_peered":"2024-09-12T01:20:13.607494+0000","last_clean":"2024-09-12T01:20:13.607494+0000","last_became_active":"2024-09-12T00:52:40.345995+0000","last_became_peered":"2024-09-12T00:52:40.345995+0000","last_unstale":"2024-09-12T01:20:13.607494+0000","last_undegraded":"2024-09-12T01:20:13.607494+0000","last_fullsized":"2024-09-12T01:20:13.607494+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:53.845660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'2","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:08.587182+0000","last_change":"2024-09-12T00:52:37.300110+0000","last_active":"2024-09-12T01:20:08.587182+0000","last_peered":"2024-09-12T01:20:08.587182+0000","last_clean":"2024-09-12T01:20:08.587182+0000","last_became_active":"2024-09-12T00:52:37.299604+0000","last_became_peered":"2024-09-12T00:52:37.299604+0000","last_unstale":"2024-09-12T01:20:08.587182+0000","last_undegraded":"2024-09-12T01:20:08.587182+0000","last_fullsized":"2024-09-12T01:20:08.587182+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:04.899567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'41","reported_seq":157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.553749+0000","last_change":"2024-09-12T00:51:04.969892+0000","last_active":"2024-09-12T01:17:43.553749+0000","last_peered":"2024-09-12T01:17:43.553749+0000","last_clean":"2024-09-12T01:17:43.553749+0000","last_became_active":"2024-09-12T00:51:04.968673+0000","last_became_peered":"2024-09-12T00:51:04.968673+0000","last_unstale":"2024-09-12T01:17:43.553749+0000","last_undegraded":"2024-09-12T01:17:43.553749+0000","last_fullsized":"2024-09-12T01:17:43.553749+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:09.083642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":145,"num_write":79,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.553934+0000","last_change":"2024-09-12T01:03:40.591077+0000","last_active":"2024-09-12T01:17:43.553934+0000","last_peered":"2024-09-12T01:17:43.553934+0000","last_clean":"2024-09-12T01:17:43.553934+0000","last_became_active":"2024-09-12T01:03:40.590440+0000","last_became_peered":"2024-09-12T01:03:40.590440+0000","last_unstale":"2024-09-12T01:17:43.553934+0000","last_undegraded":"2024-09-12T01:17:43.553934+0000","last_fullsized":"2024-09-12T01:17:43.553934+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:52.159624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.594467+0000","last_change":"2024-09-12T00:52:40.363386+0000","last_active":"2024-09-12T01:19:18.594467+0000","last_peered":"2024-09-12T01:19:18.594467+0000","last_clean":"2024-09-12T01:19:18.594467+0000","last_became_active":"2024-09-12T00:52:40.359069+0000","last_became_peered":"2024-09-12T00:52:40.359069+0000","last_unstale":"2024-09-12T01:19:18.594467+0000","last_undegraded":"2024-09-12T01:19:18.594467+0000","last_fullsized":"2024-09-12T01:19:18.594467+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:47.963386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"262'5","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.553521+0000","last_change":"2024-09-12T00:52:37.274416+0000","last_active":"2024-09-12T01:18:23.553521+0000","last_peered":"2024-09-12T01:18:23.553521+0000","last_clean":"2024-09-12T01:18:23.553521+0000","last_became_active":"2024-09-12T00:52:37.273684+0000","last_became_peered":"2024-09-12T00:52:37.273684+0000","last_unstale":"2024-09-12T01:18:23.553521+0000","last_undegraded":"2024-09-12T01:18:23.553521+0000","last_fullsized":"2024-09-12T01:18:23.553521+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:25.538379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":25602,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'50","reported_seq":182,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.551251+0000","last_change":"2024-09-12T00:51:04.999190+0000","last_active":"2024-09-12T01:17:43.551251+0000","last_peered":"2024-09-12T01:17:43.551251+0000","last_clean":"2024-09-12T01:17:43.551251+0000","last_became_active":"2024-09-12T00:51:04.993887+0000","last_became_peered":"2024-09-12T00:51:04.993887+0000","last_unstale":"2024-09-12T01:17:43.551251+0000","last_undegraded":"2024-09-12T01:17:43.551251+0000","last_fullsized":"2024-09-12T01:17:43.551251+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:49.567739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":256,"num_read_kb":177,"num_write":91,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:40.546741+0000","last_change":"2024-09-12T01:03:40.581951+0000","last_active":"2024-09-12T01:17:40.546741+0000","last_peered":"2024-09-12T01:17:40.546741+0000","last_clean":"2024-09-12T01:17:40.546741+0000","last_became_active":"2024-09-12T01:03:40.580348+0000","last_became_peered":"2024-09-12T01:03:40.580348+0000","last_unstale":"2024-09-12T01:17:40.546741+0000","last_undegraded":"2024-09-12T01:17:40.546741+0000","last_fullsized":"2024-09-12T01:17:40.546741+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:17.235776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"262'8","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:28.582340+0000","last_change":"2024-09-12T00:52:40.366179+0000","last_active":"2024-09-12T01:18:28.582340+0000","last_peered":"2024-09-12T01:18:28.582340+0000","last_clean":"2024-09-12T01:18:28.582340+0000","last_became_active":"2024-09-12T00:52:40.363347+0000","last_became_peered":"2024-09-12T00:52:40.363347+0000","last_unstale":"2024-09-12T01:18:28.582340+0000","last_undegraded":"2024-09-12T01:18:28.582340+0000","last_fullsized":"2024-09-12T01:18:28.582340+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:06.883385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":21506,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:12.793072+0000","last_change":"2024-09-12T00:52:37.288899+0000","last_active":"2024-09-12T01:19:12.793072+0000","last_peered":"2024-09-12T01:19:12.793072+0000","last_clean":"2024-09-12T01:19:12.793072+0000","last_became_active":"2024-09-12T00:52:37.288074+0000","last_became_peered":"2024-09-12T00:52:37.288074+0000","last_unstale":"2024-09-12T01:19:12.793072+0000","last_undegraded":"2024-09-12T01:19:12.793072+0000","last_fullsized":"2024-09-12T01:19:12.793072+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:03.061143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'39","reported_seq":155,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.571162+0000","last_change":"2024-09-12T00:51:04.982973+0000","last_active":"2024-09-12T01:17:43.571162+0000","last_peered":"2024-09-12T01:17:43.571162+0000","last_clean":"2024-09-12T01:17:43.571162+0000","last_became_active":"2024-09-12T00:51:04.976345+0000","last_became_peered":"2024-09-12T00:51:04.976345+0000","last_unstale":"2024-09-12T01:17:43.571162+0000","last_undegraded":"2024-09-12T01:17:43.571162+0000","last_fullsized":"2024-09-12T01:17:43.571162+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:17.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":155,"num_write":57,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:42.771617+0000","last_change":"2024-09-12T01:03:40.561539+0000","last_active":"2024-09-12T01:17:42.771617+0000","last_peered":"2024-09-12T01:17:42.771617+0000","last_clean":"2024-09-12T01:17:42.771617+0000","last_became_active":"2024-09-12T01:03:40.560777+0000","last_became_peered":"2024-09-12T01:03:40.560777+0000","last_unstale":"2024-09-12T01:17:42.771617+0000","last_undegraded":"2024-09-12T01:17:42.771617+0000","last_fullsized":"2024-09-12T01:17:42.771617+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:37.457658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"265'3","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:43.411382+0000","last_change":"2024-09-12T00:52:40.353226+0000","last_active":"2024-09-12T01:21:43.411382+0000","last_peered":"2024-09-12T01:21:43.411382+0000","last_clean":"2024-09-12T01:21:43.411382+0000","last_became_active":"2024-09-12T00:52:40.352292+0000","last_became_peered":"2024-09-12T00:52:40.352292+0000","last_unstale":"2024-09-12T01:21:43.411382+0000","last_undegraded":"2024-09-12T01:21:43.411382+0000","last_fullsized":"2024-09-12T01:21:43.411382+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:37.809308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:15.567423+0000","last_change":"2024-09-12T00:52:37.286387+0000","last_active":"2024-09-12T01:19:15.567423+0000","last_peered":"2024-09-12T01:19:15.567423+0000","last_clean":"2024-09-12T01:19:15.567423+0000","last_became_active":"2024-09-12T00:52:37.284325+0000","last_became_peered":"2024-09-12T00:52:37.284325+0000","last_unstale":"2024-09-12T01:19:15.567423+0000","last_undegraded":"2024-09-12T01:19:15.567423+0000","last_fullsized":"2024-09-12T01:19:15.567423+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:25.766191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'20","reported_seq":101,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:40.546841+0000","last_change":"2024-09-12T00:51:04.962264+0000","last_active":"2024-09-12T01:17:40.546841+0000","last_peered":"2024-09-12T01:17:40.546841+0000","last_clean":"2024-09-12T01:17:40.546841+0000","last_became_active":"2024-09-12T00:51:04.961563+0000","last_became_peered":"2024-09-12T00:51:04.961563+0000","last_unstale":"2024-09-12T01:17:40.546841+0000","last_undegraded":"2024-09-12T01:17:40.546841+0000","last_fullsized":"2024-09-12T01:17:40.546841+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:40.487439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":68,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.543964+0000","last_change":"2024-09-12T01:03:40.580752+0000","last_active":"2024-09-12T01:17:43.543964+0000","last_peered":"2024-09-12T01:17:43.543964+0000","last_clean":"2024-09-12T01:17:43.543964+0000","last_became_active":"2024-09-12T01:03:40.580083+0000","last_became_peered":"2024-09-12T01:03:40.580083+0000","last_unstale":"2024-09-12T01:17:43.543964+0000","last_undegraded":"2024-09-12T01:17:43.543964+0000","last_fullsized":"2024-09-12T01:17:43.543964+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:14.771651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'5","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:42.585420+0000","last_change":"2024-09-12T00:52:40.344308+0000","last_active":"2024-09-12T01:21:42.585420+0000","last_peered":"2024-09-12T01:21:42.585420+0000","last_clean":"2024-09-12T01:21:42.585420+0000","last_became_active":"2024-09-12T00:52:40.336368+0000","last_became_peered":"2024-09-12T00:52:40.336368+0000","last_unstale":"2024-09-12T01:21:42.585420+0000","last_undegraded":"2024-09-12T01:21:42.585420+0000","last_fullsized":"2024-09-12T01:21:42.585420+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:44.066859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:13.573252+0000","last_change":"2024-09-12T00:52:37.299654+0000","last_active":"2024-09-12T01:19:13.573252+0000","last_peered":"2024-09-12T01:19:13.573252+0000","last_clean":"2024-09-12T01:19:13.573252+0000","last_became_active":"2024-09-12T00:52:37.295945+0000","last_became_peered":"2024-09-12T00:52:37.295945+0000","last_unstale":"2024-09-12T01:19:13.573252+0000","last_undegraded":"2024-09-12T01:19:13.573252+0000","last_fullsized":"2024-09-12T01:19:13.573252+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:17.464675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"265'27","reported_seq":124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.791931+0000","last_change":"2024-09-12T00:51:04.976524+0000","last_active":"2024-09-12T01:19:07.791931+0000","last_peered":"2024-09-12T01:19:07.791931+0000","last_clean":"2024-09-12T01:19:07.791931+0000","last_became_active":"2024-09-12T00:51:04.975831+0000","last_became_peered":"2024-09-12T00:51:04.975831+0000","last_unstale":"2024-09-12T01:19:07.791931+0000","last_undegraded":"2024-09-12T01:19:07.791931+0000","last_fullsized":"2024-09-12T01:19:07.791931+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:24.928244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":101,"num_write":53,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.578542+0000","last_change":"2024-09-12T01:03:40.580652+0000","last_active":"2024-09-12T01:18:13.578542+0000","last_peered":"2024-09-12T01:18:13.578542+0000","last_clean":"2024-09-12T01:18:13.578542+0000","last_became_active":"2024-09-12T01:03:40.579923+0000","last_became_peered":"2024-09-12T01:03:40.579923+0000","last_unstale":"2024-09-12T01:18:13.578542+0000","last_undegraded":"2024-09-12T01:18:13.578542+0000","last_fullsized":"2024-09-12T01:18:13.578542+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:55.542873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.562207+0000","last_change":"2024-09-12T00:52:40.350130+0000","last_active":"2024-09-12T01:18:23.562207+0000","last_peered":"2024-09-12T01:18:23.562207+0000","last_clean":"2024-09-12T01:18:23.562207+0000","last_became_active":"2024-09-12T00:52:40.349363+0000","last_became_peered":"2024-09-12T00:52:40.349363+0000","last_unstale":"2024-09-12T01:18:23.562207+0000","last_undegraded":"2024-09-12T01:18:23.562207+0000","last_fullsized":"2024-09-12T01:18:23.562207+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:18.586220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.739114+0000","last_change":"2024-09-12T00:52:37.278835+0000","last_active":"2024-09-12T01:18:17.739114+0000","last_peered":"2024-09-12T01:18:17.739114+0000","last_clean":"2024-09-12T01:18:17.739114+0000","last_became_active":"2024-09-12T00:52:37.270958+0000","last_became_peered":"2024-09-12T00:52:37.270958+0000","last_unstale":"2024-09-12T01:18:17.739114+0000","last_undegraded":"2024-09-12T01:18:17.739114+0000","last_fullsized":"2024-09-12T01:18:17.739114+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:49.398281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'19","reported_seq":96,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.791884+0000","last_change":"2024-09-12T00:51:04.976492+0000","last_active":"2024-09-12T01:19:07.791884+0000","last_peered":"2024-09-12T01:19:07.791884+0000","last_clean":"2024-09-12T01:19:07.791884+0000","last_became_active":"2024-09-12T00:51:04.975763+0000","last_became_peered":"2024-09-12T00:51:04.975763+0000","last_unstale":"2024-09-12T01:19:07.791884+0000","last_undegraded":"2024-09-12T01:19:07.791884+0000","last_fullsized":"2024-09-12T01:19:07.791884+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:51.238336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.558357+0000","last_change":"2024-09-12T01:03:40.586341+0000","last_active":"2024-09-12T01:18:13.558357+0000","last_peered":"2024-09-12T01:18:13.558357+0000","last_clean":"2024-09-12T01:18:13.558357+0000","last_became_active":"2024-09-12T01:03:40.581062+0000","last_became_peered":"2024-09-12T01:03:40.581062+0000","last_unstale":"2024-09-12T01:18:13.558357+0000","last_undegraded":"2024-09-12T01:18:13.558357+0000","last_fullsized":"2024-09-12T01:18:13.558357+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:40.147480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'10","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.659887+0000","last_change":"2024-09-12T00:52:40.344506+0000","last_active":"2024-09-12T01:21:57.659887+0000","last_peered":"2024-09-12T01:21:57.659887+0000","last_clean":"2024-09-12T01:21:57.659887+0000","last_became_active":"2024-09-12T00:52:40.343871+0000","last_became_peered":"2024-09-12T00:52:40.343871+0000","last_unstale":"2024-09-12T01:21:57.659887+0000","last_undegraded":"2024-09-12T01:21:57.659887+0000","last_fullsized":"2024-09-12T01:21:57.659887+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:04.586939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":22610,"num_write":15,"num_write_kb":6184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.579601+0000","last_change":"2024-09-12T00:52:37.281395+0000","last_active":"2024-09-12T01:18:18.579601+0000","last_peered":"2024-09-12T01:18:18.579601+0000","last_clean":"2024-09-12T01:18:18.579601+0000","last_became_active":"2024-09-12T00:52:37.276237+0000","last_became_peered":"2024-09-12T00:52:37.276237+0000","last_unstale":"2024-09-12T01:18:18.579601+0000","last_undegraded":"2024-09-12T01:18:18.579601+0000","last_fullsized":"2024-09-12T01:18:18.579601+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:50.583225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'15","reported_seq":87,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.571778+0000","last_change":"2024-09-12T00:51:04.995560+0000","last_active":"2024-09-12T01:19:08.571778+0000","last_peered":"2024-09-12T01:19:08.571778+0000","last_clean":"2024-09-12T01:19:08.571778+0000","last_became_active":"2024-09-12T00:51:04.994606+0000","last_became_peered":"2024-09-12T00:51:04.994606+0000","last_unstale":"2024-09-12T01:19:08.571778+0000","last_undegraded":"2024-09-12T01:19:08.571778+0000","last_fullsized":"2024-09-12T01:19:08.571778+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:54.892667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:48.552306+0000","last_change":"2024-09-12T01:03:40.582311+0000","last_active":"2024-09-12T01:17:48.552306+0000","last_peered":"2024-09-12T01:17:48.552306+0000","last_clean":"2024-09-12T01:17:48.552306+0000","last_became_active":"2024-09-12T01:03:40.581586+0000","last_became_peered":"2024-09-12T01:03:40.581586+0000","last_unstale":"2024-09-12T01:17:48.552306+0000","last_undegraded":"2024-09-12T01:17:48.552306+0000","last_fullsized":"2024-09-12T01:17:48.552306+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:01.950258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'7","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:43.398671+0000","last_change":"2024-09-12T00:52:40.366365+0000","last_active":"2024-09-12T01:20:43.398671+0000","last_peered":"2024-09-12T01:20:43.398671+0000","last_clean":"2024-09-12T01:20:43.398671+0000","last_became_active":"2024-09-12T00:52:40.363072+0000","last_became_peered":"2024-09-12T00:52:40.363072+0000","last_unstale":"2024-09-12T01:20:43.398671+0000","last_undegraded":"2024-09-12T01:20:43.398671+0000","last_fullsized":"2024-09-12T01:20:43.398671+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:34.771598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9232,"num_write":7,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.546176+0000","last_change":"2024-09-12T00:52:37.291760+0000","last_active":"2024-09-12T01:18:17.546176+0000","last_peered":"2024-09-12T01:18:17.546176+0000","last_clean":"2024-09-12T01:18:17.546176+0000","last_became_active":"2024-09-12T00:52:37.291045+0000","last_became_peered":"2024-09-12T00:52:37.291045+0000","last_unstale":"2024-09-12T01:18:17.546176+0000","last_undegraded":"2024-09-12T01:18:17.546176+0000","last_fullsized":"2024-09-12T01:18:17.546176+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:59.783464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'47","reported_seq":178,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.750363+0000","last_change":"2024-09-12T00:51:04.981572+0000","last_active":"2024-09-12T01:19:07.750363+0000","last_peered":"2024-09-12T01:19:07.750363+0000","last_clean":"2024-09-12T01:19:07.750363+0000","last_became_active":"2024-09-12T00:51:04.980601+0000","last_became_peered":"2024-09-12T00:51:04.980601+0000","last_unstale":"2024-09-12T01:19:07.750363+0000","last_undegraded":"2024-09-12T01:19:07.750363+0000","last_fullsized":"2024-09-12T01:19:07.750363+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:04.644563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":177,"num_write":81,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.578495+0000","last_change":"2024-09-12T01:03:40.580511+0000","last_active":"2024-09-12T01:18:13.578495+0000","last_peered":"2024-09-12T01:18:13.578495+0000","last_clean":"2024-09-12T01:18:13.578495+0000","last_became_active":"2024-09-12T01:03:40.579772+0000","last_became_peered":"2024-09-12T01:03:40.579772+0000","last_unstale":"2024-09-12T01:18:13.578495+0000","last_undegraded":"2024-09-12T01:18:13.578495+0000","last_fullsized":"2024-09-12T01:18:13.578495+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:33.962377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:22.547666+0000","last_change":"2024-09-12T00:52:40.347889+0000","last_active":"2024-09-12T01:18:22.547666+0000","last_peered":"2024-09-12T01:18:22.547666+0000","last_clean":"2024-09-12T01:18:22.547666+0000","last_became_active":"2024-09-12T00:52:40.347156+0000","last_became_peered":"2024-09-12T00:52:40.347156+0000","last_unstale":"2024-09-12T01:18:22.547666+0000","last_undegraded":"2024-09-12T01:18:22.547666+0000","last_fullsized":"2024-09-12T01:18:22.547666+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:29.288092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.552252+0000","last_change":"2024-09-12T00:52:37.291590+0000","last_active":"2024-09-12T01:18:18.552252+0000","last_peered":"2024-09-12T01:18:18.552252+0000","last_clean":"2024-09-12T01:18:18.552252+0000","last_became_active":"2024-09-12T00:52:37.290858+0000","last_became_peered":"2024-09-12T00:52:37.290858+0000","last_unstale":"2024-09-12T01:18:18.552252+0000","last_undegraded":"2024-09-12T01:18:18.552252+0000","last_fullsized":"2024-09-12T01:18:18.552252+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:11.150903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'11","reported_seq":79,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.591802+0000","last_change":"2024-09-12T00:51:04.989507+0000","last_active":"2024-09-12T01:19:08.591802+0000","last_peered":"2024-09-12T01:19:08.591802+0000","last_clean":"2024-09-12T01:19:08.591802+0000","last_became_active":"2024-09-12T00:51:04.988521+0000","last_became_peered":"2024-09-12T00:51:04.988521+0000","last_unstale":"2024-09-12T01:19:08.591802+0000","last_undegraded":"2024-09-12T01:19:08.591802+0000","last_fullsized":"2024-09-12T01:19:08.591802+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:52.795091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:55.563144+0000","last_change":"2024-09-12T01:03:40.592444+0000","last_active":"2024-09-12T01:18:55.563144+0000","last_peered":"2024-09-12T01:18:55.563144+0000","last_clean":"2024-09-12T01:18:55.563144+0000","last_became_active":"2024-09-12T01:03:40.591869+0000","last_became_peered":"2024-09-12T01:03:40.591869+0000","last_unstale":"2024-09-12T01:18:55.563144+0000","last_undegraded":"2024-09-12T01:18:55.563144+0000","last_fullsized":"2024-09-12T01:18:55.563144+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:13.806273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.600454+0000","last_change":"2024-09-12T00:52:40.345399+0000","last_active":"2024-09-12T01:19:43.600454+0000","last_peered":"2024-09-12T01:19:43.600454+0000","last_clean":"2024-09-12T01:19:43.600454+0000","last_became_active":"2024-09-12T00:52:40.344566+0000","last_became_peered":"2024-09-12T00:52:40.344566+0000","last_unstale":"2024-09-12T01:19:43.600454+0000","last_undegraded":"2024-09-12T01:19:43.600454+0000","last_fullsized":"2024-09-12T01:19:43.600454+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:08.365603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.799024+0000","last_change":"2024-09-12T00:52:37.289694+0000","last_active":"2024-09-12T01:19:37.799024+0000","last_peered":"2024-09-12T01:19:37.799024+0000","last_clean":"2024-09-12T01:19:37.799024+0000","last_became_active":"2024-09-12T00:52:37.282987+0000","last_became_peered":"2024-09-12T00:52:37.282987+0000","last_unstale":"2024-09-12T01:19:37.799024+0000","last_undegraded":"2024-09-12T01:19:37.799024+0000","last_fullsized":"2024-09-12T01:19:37.799024+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:53.081978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'40","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.578586+0000","last_change":"2024-09-12T00:51:05.001750+0000","last_active":"2024-09-12T01:18:13.578586+0000","last_peered":"2024-09-12T01:18:13.578586+0000","last_clean":"2024-09-12T01:18:13.578586+0000","last_became_active":"2024-09-12T00:51:05.001162+0000","last_became_peered":"2024-09-12T00:51:05.001162+0000","last_unstale":"2024-09-12T01:18:13.578586+0000","last_undegraded":"2024-09-12T01:18:13.578586+0000","last_fullsized":"2024-09-12T01:18:13.578586+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:51.741336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":142,"num_write":73,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:27.796530+0000","last_change":"2024-09-12T01:03:40.558405+0000","last_active":"2024-09-12T01:19:27.796530+0000","last_peered":"2024-09-12T01:19:27.796530+0000","last_clean":"2024-09-12T01:19:27.796530+0000","last_became_active":"2024-09-12T01:03:40.551803+0000","last_became_peered":"2024-09-12T01:03:40.551803+0000","last_unstale":"2024-09-12T01:19:27.796530+0000","last_undegraded":"2024-09-12T01:19:27.796530+0000","last_fullsized":"2024-09-12T01:19:27.796530+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:06.456829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.600404+0000","last_change":"2024-09-12T00:52:40.358765+0000","last_active":"2024-09-12T01:19:43.600404+0000","last_peered":"2024-09-12T01:19:43.600404+0000","last_clean":"2024-09-12T01:19:43.600404+0000","last_became_active":"2024-09-12T00:52:40.354387+0000","last_became_peered":"2024-09-12T00:52:40.354387+0000","last_unstale":"2024-09-12T01:19:43.600404+0000","last_undegraded":"2024-09-12T01:19:43.600404+0000","last_fullsized":"2024-09-12T01:19:43.600404+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:13.780637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:40.572945+0000","last_change":"2024-09-12T00:52:37.285727+0000","last_active":"2024-09-12T01:19:40.572945+0000","last_peered":"2024-09-12T01:19:40.572945+0000","last_clean":"2024-09-12T01:19:40.572945+0000","last_became_active":"2024-09-12T00:52:37.285154+0000","last_became_peered":"2024-09-12T00:52:37.285154+0000","last_unstale":"2024-09-12T01:19:40.572945+0000","last_undegraded":"2024-09-12T01:19:40.572945+0000","last_fullsized":"2024-09-12T01:19:40.572945+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:04.603498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'61","reported_seq":212,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.410803+0000","last_change":"2024-09-12T00:51:04.976377+0000","last_active":"2024-09-12T01:19:18.410803+0000","last_peered":"2024-09-12T01:19:18.410803+0000","last_clean":"2024-09-12T01:19:18.410803+0000","last_became_active":"2024-09-12T00:51:04.975583+0000","last_became_peered":"2024-09-12T00:51:04.975583+0000","last_unstale":"2024-09-12T01:19:18.410803+0000","last_undegraded":"2024-09-12T01:19:18.410803+0000","last_fullsized":"2024-09-12T01:19:18.410803+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:40.033682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":309,"num_read_kb":216,"num_write":105,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:52.554219+0000","last_change":"2024-09-12T01:03:40.570955+0000","last_active":"2024-09-12T01:18:52.554219+0000","last_peered":"2024-09-12T01:18:52.554219+0000","last_clean":"2024-09-12T01:18:52.554219+0000","last_became_active":"2024-09-12T01:03:40.569907+0000","last_became_peered":"2024-09-12T01:03:40.569907+0000","last_unstale":"2024-09-12T01:18:52.554219+0000","last_undegraded":"2024-09-12T01:18:52.554219+0000","last_fullsized":"2024-09-12T01:18:52.554219+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:17.110556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:33.551635+0000","last_change":"2024-09-12T00:52:40.343485+0000","last_active":"2024-09-12T01:17:33.551635+0000","last_peered":"2024-09-12T01:17:33.551635+0000","last_clean":"2024-09-12T01:17:33.551635+0000","last_became_active":"2024-09-12T00:52:40.342703+0000","last_became_peered":"2024-09-12T00:52:40.342703+0000","last_unstale":"2024-09-12T01:17:33.551635+0000","last_undegraded":"2024-09-12T01:17:33.551635+0000","last_fullsized":"2024-09-12T01:17:33.551635+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:39.152830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"265'6","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:53.609196+0000","last_change":"2024-09-12T00:52:37.292687+0000","last_active":"2024-09-12T01:21:53.609196+0000","last_peered":"2024-09-12T01:21:53.609196+0000","last_clean":"2024-09-12T01:21:53.609196+0000","last_became_active":"2024-09-12T00:52:37.292449+0000","last_became_peered":"2024-09-12T00:52:37.292449+0000","last_unstale":"2024-09-12T01:21:53.609196+0000","last_undegraded":"2024-09-12T01:21:53.609196+0000","last_fullsized":"2024-09-12T01:21:53.609196+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:54.986888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'116","reported_seq":403,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:32.106066+0000","last_change":"2024-09-12T00:51:04.985227+0000","last_active":"2024-09-12T01:18:32.106066+0000","last_peered":"2024-09-12T01:18:32.106066+0000","last_clean":"2024-09-12T01:18:32.106066+0000","last_became_active":"2024-09-12T00:51:04.984495+0000","last_became_peered":"2024-09-12T00:51:04.984495+0000","last_unstale":"2024-09-12T01:18:32.106066+0000","last_undegraded":"2024-09-12T01:18:32.106066+0000","last_fullsized":"2024-09-12T01:18:32.106066+0000","mapping_epoch":252,"log_start":"265'100","ondisk_log_start":"265'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:40.069078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":690,"num_read_kb":506,"num_write":167,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:52.788303+0000","last_change":"2024-09-12T01:03:40.566870+0000","last_active":"2024-09-12T01:18:52.788303+0000","last_peered":"2024-09-12T01:18:52.788303+0000","last_clean":"2024-09-12T01:18:52.788303+0000","last_became_active":"2024-09-12T01:03:40.566107+0000","last_became_peered":"2024-09-12T01:03:40.566107+0000","last_unstale":"2024-09-12T01:18:52.788303+0000","last_undegraded":"2024-09-12T01:18:52.788303+0000","last_fullsized":"2024-09-12T01:18:52.788303+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:23.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.600492+0000","last_change":"2024-09-12T00:52:40.367723+0000","last_active":"2024-09-12T01:19:43.600492+0000","last_peered":"2024-09-12T01:19:43.600492+0000","last_clean":"2024-09-12T01:19:43.600492+0000","last_became_active":"2024-09-12T00:52:40.367188+0000","last_became_peered":"2024-09-12T00:52:40.367188+0000","last_unstale":"2024-09-12T01:19:43.600492+0000","last_undegraded":"2024-09-12T01:19:43.600492+0000","last_fullsized":"2024-09-12T01:19:43.600492+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:21.283584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"265'2","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.355886+0000","last_change":"2024-09-12T00:52:37.289836+0000","last_active":"2024-09-12T01:21:57.355886+0000","last_peered":"2024-09-12T01:21:57.355886+0000","last_clean":"2024-09-12T01:21:57.355886+0000","last_became_active":"2024-09-12T00:52:37.281129+0000","last_became_peered":"2024-09-12T00:52:37.281129+0000","last_unstale":"2024-09-12T01:21:57.355886+0000","last_undegraded":"2024-09-12T01:21:57.355886+0000","last_fullsized":"2024-09-12T01:21:57.355886+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:00.364762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"265'9","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:05.551886+0000","last_change":"2024-09-12T00:51:04.984390+0000","last_active":"2024-09-12T01:18:05.551886+0000","last_peered":"2024-09-12T01:18:05.551886+0000","last_clean":"2024-09-12T01:18:05.551886+0000","last_became_active":"2024-09-12T00:51:04.983577+0000","last_became_peered":"2024-09-12T00:51:04.983577+0000","last_unstale":"2024-09-12T01:18:05.551886+0000","last_undegraded":"2024-09-12T01:18:05.551886+0000","last_fullsized":"2024-09-12T01:18:05.551886+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:11.081544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:28.596883+0000","last_change":"2024-09-12T01:03:40.590449+0000","last_active":"2024-09-12T01:19:28.596883+0000","last_peered":"2024-09-12T01:19:28.596883+0000","last_clean":"2024-09-12T01:19:28.596883+0000","last_became_active":"2024-09-12T01:03:40.589838+0000","last_became_peered":"2024-09-12T01:03:40.589838+0000","last_unstale":"2024-09-12T01:19:28.596883+0000","last_undegraded":"2024-09-12T01:19:28.596883+0000","last_fullsized":"2024-09-12T01:19:28.596883+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:53.282415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.744871+0000","last_change":"2024-09-12T00:52:40.357689+0000","last_active":"2024-09-12T01:18:42.744871+0000","last_peered":"2024-09-12T01:18:42.744871+0000","last_clean":"2024-09-12T01:18:42.744871+0000","last_became_active":"2024-09-12T00:52:40.356802+0000","last_became_peered":"2024-09-12T00:52:40.356802+0000","last_unstale":"2024-09-12T01:18:42.744871+0000","last_undegraded":"2024-09-12T01:18:42.744871+0000","last_fullsized":"2024-09-12T01:18:42.744871+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:51.102558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"265'6","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.947096+0000","last_change":"2024-09-12T00:52:37.294017+0000","last_active":"2024-09-12T01:21:56.947096+0000","last_peered":"2024-09-12T01:21:56.947096+0000","last_clean":"2024-09-12T01:21:56.947096+0000","last_became_active":"2024-09-12T00:52:37.293564+0000","last_became_peered":"2024-09-12T00:52:37.293564+0000","last_unstale":"2024-09-12T01:21:56.947096+0000","last_undegraded":"2024-09-12T01:21:56.947096+0000","last_fullsized":"2024-09-12T01:21:56.947096+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:56.643360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3128,"num_write":6,"num_write_kb":3128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"262'16","reported_seq":93,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:08.556985+0000","last_change":"2024-09-12T00:51:04.990981+0000","last_active":"2024-09-12T01:18:08.556985+0000","last_peered":"2024-09-12T01:18:08.556985+0000","last_clean":"2024-09-12T01:18:08.556985+0000","last_became_active":"2024-09-12T00:51:04.981091+0000","last_became_peered":"2024-09-12T00:51:04.981091+0000","last_unstale":"2024-09-12T01:18:08.556985+0000","last_undegraded":"2024-09-12T01:18:08.556985+0000","last_fullsized":"2024-09-12T01:18:08.556985+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:43.002634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:27.796717+0000","last_change":"2024-09-12T01:03:40.566702+0000","last_active":"2024-09-12T01:19:27.796717+0000","last_peered":"2024-09-12T01:19:27.796717+0000","last_clean":"2024-09-12T01:19:27.796717+0000","last_became_active":"2024-09-12T01:03:40.565926+0000","last_became_peered":"2024-09-12T01:03:40.565926+0000","last_unstale":"2024-09-12T01:19:27.796717+0000","last_undegraded":"2024-09-12T01:19:27.796717+0000","last_fullsized":"2024-09-12T01:19:27.796717+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:31.308325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.785653+0000","last_change":"2024-09-12T00:52:40.341080+0000","last_active":"2024-09-12T01:18:42.785653+0000","last_peered":"2024-09-12T01:18:42.785653+0000","last_clean":"2024-09-12T01:18:42.785653+0000","last_became_active":"2024-09-12T00:52:40.340423+0000","last_became_peered":"2024-09-12T00:52:40.340423+0000","last_unstale":"2024-09-12T01:18:42.785653+0000","last_undegraded":"2024-09-12T01:18:42.785653+0000","last_fullsized":"2024-09-12T01:18:42.785653+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:11.370534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"265'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.947626+0000","last_change":"2024-09-12T00:52:37.294639+0000","last_active":"2024-09-12T01:21:56.947626+0000","last_peered":"2024-09-12T01:21:56.947626+0000","last_clean":"2024-09-12T01:21:56.947626+0000","last_became_active":"2024-09-12T00:52:37.293885+0000","last_became_peered":"2024-09-12T00:52:37.293885+0000","last_unstale":"2024-09-12T01:21:56.947626+0000","last_undegraded":"2024-09-12T01:21:56.947626+0000","last_fullsized":"2024-09-12T01:21:56.947626+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:20.571782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'39","reported_seq":151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:19.686513+0000","last_change":"2024-09-12T00:51:04.989066+0000","last_active":"2024-09-12T01:19:19.686513+0000","last_peered":"2024-09-12T01:19:19.686513+0000","last_clean":"2024-09-12T01:19:19.686513+0000","last_became_active":"2024-09-12T00:51:04.988252+0000","last_became_peered":"2024-09-12T00:51:04.988252+0000","last_unstale":"2024-09-12T01:19:19.686513+0000","last_undegraded":"2024-09-12T01:19:19.686513+0000","last_fullsized":"2024-09-12T01:19:19.686513+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:49.691881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":135,"num_write":72,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:27.796591+0000","last_change":"2024-09-12T01:03:40.581034+0000","last_active":"2024-09-12T01:19:27.796591+0000","last_peered":"2024-09-12T01:19:27.796591+0000","last_clean":"2024-09-12T01:19:27.796591+0000","last_became_active":"2024-09-12T01:03:40.580376+0000","last_became_peered":"2024-09-12T01:03:40.580376+0000","last_unstale":"2024-09-12T01:19:27.796591+0000","last_undegraded":"2024-09-12T01:19:27.796591+0000","last_fullsized":"2024-09-12T01:19:27.796591+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:38.778592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.583906+0000","last_change":"2024-09-12T00:52:40.338165+0000","last_active":"2024-09-12T01:19:43.583906+0000","last_peered":"2024-09-12T01:19:43.583906+0000","last_clean":"2024-09-12T01:19:43.583906+0000","last_became_active":"2024-09-12T00:52:40.337359+0000","last_became_peered":"2024-09-12T00:52:40.337359+0000","last_unstale":"2024-09-12T01:19:43.583906+0000","last_undegraded":"2024-09-12T01:19:43.583906+0000","last_fullsized":"2024-09-12T01:19:43.583906+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:52.904218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"265'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:53.595693+0000","last_change":"2024-09-12T00:52:37.300132+0000","last_active":"2024-09-12T01:20:53.595693+0000","last_peered":"2024-09-12T01:20:53.595693+0000","last_clean":"2024-09-12T01:20:53.595693+0000","last_became_active":"2024-09-12T00:52:37.299461+0000","last_became_peered":"2024-09-12T00:52:37.299461+0000","last_unstale":"2024-09-12T01:20:53.595693+0000","last_undegraded":"2024-09-12T01:20:53.595693+0000","last_fullsized":"2024-09-12T01:20:53.595693+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:06.604639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5125,"num_write":10,"num_write_kb":5125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'112","reported_seq":395,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.594307+0000","last_change":"2024-09-12T00:51:04.983673+0000","last_active":"2024-09-12T01:19:18.594307+0000","last_peered":"2024-09-12T01:19:18.594307+0000","last_clean":"2024-09-12T01:19:18.594307+0000","last_became_active":"2024-09-12T00:51:04.975690+0000","last_became_peered":"2024-09-12T00:51:04.975690+0000","last_unstale":"2024-09-12T01:19:18.594307+0000","last_undegraded":"2024-09-12T01:19:18.594307+0000","last_fullsized":"2024-09-12T01:19:18.594307+0000","mapping_epoch":252,"log_start":"265'100","ondisk_log_start":"265'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:00.184799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":675,"num_read_kb":541,"num_write":147,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:28.576824+0000","last_change":"2024-09-12T01:03:40.586682+0000","last_active":"2024-09-12T01:19:28.576824+0000","last_peered":"2024-09-12T01:19:28.576824+0000","last_clean":"2024-09-12T01:19:28.576824+0000","last_became_active":"2024-09-12T01:03:40.585894+0000","last_became_peered":"2024-09-12T01:03:40.585894+0000","last_unstale":"2024-09-12T01:19:28.576824+0000","last_undegraded":"2024-09-12T01:19:28.576824+0000","last_fullsized":"2024-09-12T01:19:28.576824+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:09.789910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"262'3","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.785780+0000","last_change":"2024-09-12T00:52:40.355779+0000","last_active":"2024-09-12T01:18:42.785780+0000","last_peered":"2024-09-12T01:18:42.785780+0000","last_clean":"2024-09-12T01:18:42.785780+0000","last_became_active":"2024-09-12T00:52:40.355113+0000","last_became_peered":"2024-09-12T00:52:40.355113+0000","last_unstale":"2024-09-12T01:18:42.785780+0000","last_undegraded":"2024-09-12T01:18:42.785780+0000","last_fullsized":"2024-09-12T01:18:42.785780+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:00.005104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:52.587580+0000","last_change":"2024-09-12T00:52:37.281177+0000","last_active":"2024-09-12T01:21:52.587580+0000","last_peered":"2024-09-12T01:21:52.587580+0000","last_clean":"2024-09-12T01:21:52.587580+0000","last_became_active":"2024-09-12T00:52:37.280444+0000","last_became_peered":"2024-09-12T00:52:37.280444+0000","last_unstale":"2024-09-12T01:21:52.587580+0000","last_undegraded":"2024-09-12T01:21:52.587580+0000","last_fullsized":"2024-09-12T01:21:52.587580+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:12.563116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'48","reported_seq":181,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:17.559211+0000","last_change":"2024-09-12T00:51:04.985402+0000","last_active":"2024-09-12T01:19:17.559211+0000","last_peered":"2024-09-12T01:19:17.559211+0000","last_clean":"2024-09-12T01:19:17.559211+0000","last_became_active":"2024-09-12T00:51:04.984384+0000","last_became_peered":"2024-09-12T00:51:04.984384+0000","last_unstale":"2024-09-12T01:19:17.559211+0000","last_undegraded":"2024-09-12T01:19:17.559211+0000","last_fullsized":"2024-09-12T01:19:17.559211+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:51.787094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":174,"num_write":98,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.779633+0000","last_change":"2024-09-12T01:03:40.566732+0000","last_active":"2024-09-12T01:18:17.779633+0000","last_peered":"2024-09-12T01:18:17.779633+0000","last_clean":"2024-09-12T01:18:17.779633+0000","last_became_active":"2024-09-12T01:03:40.565972+0000","last_became_peered":"2024-09-12T01:03:40.565972+0000","last_unstale":"2024-09-12T01:18:17.779633+0000","last_undegraded":"2024-09-12T01:18:17.779633+0000","last_fullsized":"2024-09-12T01:18:17.779633+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:13.523686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:53.583277+0000","last_change":"2024-09-12T00:52:40.352965+0000","last_active":"2024-09-12T01:19:53.583277+0000","last_peered":"2024-09-12T01:19:53.583277+0000","last_clean":"2024-09-12T01:19:53.583277+0000","last_became_active":"2024-09-12T00:52:40.352178+0000","last_became_peered":"2024-09-12T00:52:40.352178+0000","last_unstale":"2024-09-12T01:19:53.583277+0000","last_undegraded":"2024-09-12T01:19:53.583277+0000","last_fullsized":"2024-09-12T01:19:53.583277+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:25.540435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:42.800116+0000","last_change":"2024-09-12T00:52:37.281424+0000","last_active":"2024-09-12T01:19:42.800116+0000","last_peered":"2024-09-12T01:19:42.800116+0000","last_clean":"2024-09-12T01:19:42.800116+0000","last_became_active":"2024-09-12T00:52:37.280679+0000","last_became_peered":"2024-09-12T00:52:37.280679+0000","last_unstale":"2024-09-12T01:19:42.800116+0000","last_undegraded":"2024-09-12T01:19:42.800116+0000","last_fullsized":"2024-09-12T01:19:42.800116+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:14.781208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'2","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.574476+0000","last_change":"2024-09-12T00:51:04.998155+0000","last_active":"2024-09-12T01:19:18.574476+0000","last_peered":"2024-09-12T01:19:18.574476+0000","last_clean":"2024-09-12T01:19:18.574476+0000","last_became_active":"2024-09-12T00:51:04.996736+0000","last_became_peered":"2024-09-12T00:51:04.996736+0000","last_unstale":"2024-09-12T01:19:18.574476+0000","last_undegraded":"2024-09-12T01:19:18.574476+0000","last_fullsized":"2024-09-12T01:19:18.574476+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:00.791980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.552215+0000","last_change":"2024-09-12T01:03:40.577490+0000","last_active":"2024-09-12T01:18:18.552215+0000","last_peered":"2024-09-12T01:18:18.552215+0000","last_clean":"2024-09-12T01:18:18.552215+0000","last_became_active":"2024-09-12T01:03:40.576752+0000","last_became_peered":"2024-09-12T01:03:40.576752+0000","last_unstale":"2024-09-12T01:18:18.552215+0000","last_undegraded":"2024-09-12T01:18:18.552215+0000","last_fullsized":"2024-09-12T01:18:18.552215+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:58.912810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"262'8","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.582004+0000","last_change":"2024-09-12T00:52:40.340084+0000","last_active":"2024-09-12T01:19:48.582004+0000","last_peered":"2024-09-12T01:19:48.582004+0000","last_clean":"2024-09-12T01:19:48.582004+0000","last_became_active":"2024-09-12T00:52:40.338378+0000","last_became_peered":"2024-09-12T00:52:40.338378+0000","last_unstale":"2024-09-12T01:19:48.582004+0000","last_undegraded":"2024-09-12T01:19:48.582004+0000","last_fullsized":"2024-09-12T01:19:48.582004+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:29.194283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'5","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:50.575099+0000","last_change":"2024-09-12T00:52:37.285880+0000","last_active":"2024-09-12T01:19:50.575099+0000","last_peered":"2024-09-12T01:19:50.575099+0000","last_clean":"2024-09-12T01:19:50.575099+0000","last_became_active":"2024-09-12T00:52:37.284206+0000","last_became_peered":"2024-09-12T00:52:37.284206+0000","last_unstale":"2024-09-12T01:19:50.575099+0000","last_undegraded":"2024-09-12T01:19:50.575099+0000","last_fullsized":"2024-09-12T01:19:50.575099+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:30.930785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":18432,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'21","reported_seq":106,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:17.559410+0000","last_change":"2024-09-12T00:51:04.983851+0000","last_active":"2024-09-12T01:19:17.559410+0000","last_peered":"2024-09-12T01:19:17.559410+0000","last_clean":"2024-09-12T01:19:17.559410+0000","last_became_active":"2024-09-12T00:51:04.983165+0000","last_became_peered":"2024-09-12T00:51:04.983165+0000","last_unstale":"2024-09-12T01:19:17.559410+0000","last_undegraded":"2024-09-12T01:19:17.559410+0000","last_fullsized":"2024-09-12T01:19:17.559410+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:30.417623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":73,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.584915+0000","last_change":"2024-09-12T01:03:40.579521+0000","last_active":"2024-09-12T01:19:48.584915+0000","last_peered":"2024-09-12T01:19:48.584915+0000","last_clean":"2024-09-12T01:19:48.584915+0000","last_became_active":"2024-09-12T01:03:40.578825+0000","last_became_peered":"2024-09-12T01:03:40.578825+0000","last_unstale":"2024-09-12T01:19:48.584915+0000","last_undegraded":"2024-09-12T01:19:48.584915+0000","last_fullsized":"2024-09-12T01:19:48.584915+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:02.779228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"265'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:52.815957+0000","last_change":"2024-09-12T00:52:40.353791+0000","last_active":"2024-09-12T01:20:52.815957+0000","last_peered":"2024-09-12T01:20:52.815957+0000","last_clean":"2024-09-12T01:20:52.815957+0000","last_became_active":"2024-09-12T00:52:40.352922+0000","last_became_peered":"2024-09-12T00:52:40.352922+0000","last_unstale":"2024-09-12T01:20:52.815957+0000","last_undegraded":"2024-09-12T01:20:52.815957+0000","last_fullsized":"2024-09-12T01:20:52.815957+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:33.594783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.556947+0000","last_change":"2024-09-12T00:52:37.281272+0000","last_active":"2024-09-12T01:18:38.556947+0000","last_peered":"2024-09-12T01:18:38.556947+0000","last_clean":"2024-09-12T01:18:38.556947+0000","last_became_active":"2024-09-12T00:52:37.280548+0000","last_became_peered":"2024-09-12T00:52:37.280548+0000","last_unstale":"2024-09-12T01:18:38.556947+0000","last_undegraded":"2024-09-12T01:18:38.556947+0000","last_fullsized":"2024-09-12T01:18:38.556947+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:57.882529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'10","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:12.778458+0000","last_change":"2024-09-12T00:51:04.995585+0000","last_active":"2024-09-12T01:18:12.778458+0000","last_peered":"2024-09-12T01:18:12.778458+0000","last_clean":"2024-09-12T01:18:12.778458+0000","last_became_active":"2024-09-12T00:51:04.994904+0000","last_became_peered":"2024-09-12T00:51:04.994904+0000","last_unstale":"2024-09-12T01:18:12.778458+0000","last_undegraded":"2024-09-12T01:18:12.778458+0000","last_fullsized":"2024-09-12T01:18:12.778458+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:29.572409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":34,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.739185+0000","last_change":"2024-09-12T01:03:40.577193+0000","last_active":"2024-09-12T01:18:17.739185+0000","last_peered":"2024-09-12T01:18:17.739185+0000","last_clean":"2024-09-12T01:18:17.739185+0000","last_became_active":"2024-09-12T01:03:40.576442+0000","last_became_peered":"2024-09-12T01:03:40.576442+0000","last_unstale":"2024-09-12T01:18:17.739185+0000","last_undegraded":"2024-09-12T01:18:17.739185+0000","last_fullsized":"2024-09-12T01:18:17.739185+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:03.900955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"265'6","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:52.574160+0000","last_change":"2024-09-12T00:52:40.346550+0000","last_active":"2024-09-12T01:20:52.574160+0000","last_peered":"2024-09-12T01:20:52.574160+0000","last_clean":"2024-09-12T01:20:52.574160+0000","last_became_active":"2024-09-12T00:52:40.345375+0000","last_became_peered":"2024-09-12T00:52:40.345375+0000","last_unstale":"2024-09-12T01:20:52.574160+0000","last_undegraded":"2024-09-12T01:20:52.574160+0000","last_fullsized":"2024-09-12T01:20:52.574160+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:05.935202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"262'5","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:37.784692+0000","last_change":"2024-09-12T00:52:37.282759+0000","last_active":"2024-09-12T01:18:37.784692+0000","last_peered":"2024-09-12T01:18:37.784692+0000","last_clean":"2024-09-12T01:18:37.784692+0000","last_became_active":"2024-09-12T00:52:37.282005+0000","last_became_peered":"2024-09-12T00:52:37.282005+0000","last_unstale":"2024-09-12T01:18:37.784692+0000","last_undegraded":"2024-09-12T01:18:37.784692+0000","last_fullsized":"2024-09-12T01:18:37.784692+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:50.148380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":5,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"265'13","reported_seq":82,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.560095+0000","last_change":"2024-09-12T00:51:04.991796+0000","last_active":"2024-09-12T01:18:13.560095+0000","last_peered":"2024-09-12T01:18:13.560095+0000","last_clean":"2024-09-12T01:18:13.560095+0000","last_became_active":"2024-09-12T00:51:04.990945+0000","last_became_peered":"2024-09-12T00:51:04.990945+0000","last_unstale":"2024-09-12T01:18:13.560095+0000","last_undegraded":"2024-09-12T01:18:13.560095+0000","last_fullsized":"2024-09-12T01:18:13.560095+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:18.841995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:50.562171+0000","last_change":"2024-09-12T01:03:40.582179+0000","last_active":"2024-09-12T01:18:50.562171+0000","last_peered":"2024-09-12T01:18:50.562171+0000","last_clean":"2024-09-12T01:18:50.562171+0000","last_became_active":"2024-09-12T01:03:40.581227+0000","last_became_peered":"2024-09-12T01:03:40.581227+0000","last_unstale":"2024-09-12T01:18:50.562171+0000","last_undegraded":"2024-09-12T01:18:50.562171+0000","last_fullsized":"2024-09-12T01:18:50.562171+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:44.601346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.584983+0000","last_change":"2024-09-12T00:52:40.341544+0000","last_active":"2024-09-12T01:19:48.584983+0000","last_peered":"2024-09-12T01:19:48.584983+0000","last_clean":"2024-09-12T01:19:48.584983+0000","last_became_active":"2024-09-12T00:52:40.340078+0000","last_became_peered":"2024-09-12T00:52:40.340078+0000","last_unstale":"2024-09-12T01:19:48.584983+0000","last_undegraded":"2024-09-12T01:19:48.584983+0000","last_fullsized":"2024-09-12T01:19:48.584983+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:01.427475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"262'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:37.784418+0000","last_change":"2024-09-12T00:52:37.280400+0000","last_active":"2024-09-12T01:18:37.784418+0000","last_peered":"2024-09-12T01:18:37.784418+0000","last_clean":"2024-09-12T01:18:37.784418+0000","last_became_active":"2024-09-12T00:52:37.277753+0000","last_became_peered":"2024-09-12T00:52:37.277753+0000","last_unstale":"2024-09-12T01:18:37.784418+0000","last_undegraded":"2024-09-12T01:18:37.784418+0000","last_fullsized":"2024-09-12T01:18:37.784418+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:24.031905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"254'7","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.550912+0000","last_change":"2024-09-12T00:51:04.957439+0000","last_active":"2024-09-12T01:18:13.550912+0000","last_peered":"2024-09-12T01:18:13.550912+0000","last_clean":"2024-09-12T01:18:13.550912+0000","last_became_active":"2024-09-12T00:51:04.956754+0000","last_became_peered":"2024-09-12T00:51:04.956754+0000","last_unstale":"2024-09-12T01:18:13.550912+0000","last_undegraded":"2024-09-12T01:18:13.550912+0000","last_fullsized":"2024-09-12T01:18:13.550912+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:38.742856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":30,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:53.568338+0000","last_change":"2024-09-12T01:03:40.586675+0000","last_active":"2024-09-12T01:18:53.568338+0000","last_peered":"2024-09-12T01:18:53.568338+0000","last_clean":"2024-09-12T01:18:53.568338+0000","last_became_active":"2024-09-12T01:03:40.583308+0000","last_became_peered":"2024-09-12T01:03:40.583308+0000","last_unstale":"2024-09-12T01:18:53.568338+0000","last_undegraded":"2024-09-12T01:18:53.568338+0000","last_fullsized":"2024-09-12T01:18:53.568338+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:58.594413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'6","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.619618+0000","last_change":"2024-09-12T00:52:40.333654+0000","last_active":"2024-09-12T01:21:56.619618+0000","last_peered":"2024-09-12T01:21:56.619618+0000","last_clean":"2024-09-12T01:21:56.619618+0000","last_became_active":"2024-09-12T00:52:40.332913+0000","last_became_peered":"2024-09-12T00:52:40.332913+0000","last_unstale":"2024-09-12T01:21:56.619618+0000","last_undegraded":"2024-09-12T01:21:56.619618+0000","last_fullsized":"2024-09-12T01:21:56.619618+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:55.862557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:47.828740+0000","last_change":"2024-09-12T00:52:37.287265+0000","last_active":"2024-09-12T01:21:47.828740+0000","last_peered":"2024-09-12T01:21:47.828740+0000","last_clean":"2024-09-12T01:21:47.828740+0000","last_became_active":"2024-09-12T00:52:37.282758+0000","last_became_peered":"2024-09-12T00:52:37.282758+0000","last_unstale":"2024-09-12T01:21:47.828740+0000","last_undegraded":"2024-09-12T01:21:47.828740+0000","last_fullsized":"2024-09-12T01:21:47.828740+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:54.106634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'71","reported_seq":244,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:12.738155+0000","last_change":"2024-09-12T00:51:04.983438+0000","last_active":"2024-09-12T01:18:12.738155+0000","last_peered":"2024-09-12T01:18:12.738155+0000","last_clean":"2024-09-12T01:18:12.738155+0000","last_became_active":"2024-09-12T00:51:04.982747+0000","last_became_peered":"2024-09-12T00:51:04.982747+0000","last_unstale":"2024-09-12T01:18:12.738155+0000","last_undegraded":"2024-09-12T01:18:12.738155+0000","last_fullsized":"2024-09-12T01:18:12.738155+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:57.630612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":369,"num_read_kb":267,"num_write":124,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.559537+0000","last_change":"2024-09-12T01:03:40.573794+0000","last_active":"2024-09-12T01:18:18.559537+0000","last_peered":"2024-09-12T01:18:18.559537+0000","last_clean":"2024-09-12T01:18:18.559537+0000","last_became_active":"2024-09-12T01:03:40.571968+0000","last_became_peered":"2024-09-12T01:03:40.571968+0000","last_unstale":"2024-09-12T01:18:18.559537+0000","last_undegraded":"2024-09-12T01:18:18.559537+0000","last_fullsized":"2024-09-12T01:18:18.559537+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:38.415524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'7","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:52.398884+0000","last_change":"2024-09-12T00:52:40.360097+0000","last_active":"2024-09-12T01:21:52.398884+0000","last_peered":"2024-09-12T01:21:52.398884+0000","last_clean":"2024-09-12T01:21:52.398884+0000","last_became_active":"2024-09-12T00:52:40.359434+0000","last_became_peered":"2024-09-12T00:52:40.359434+0000","last_unstale":"2024-09-12T01:21:52.398884+0000","last_undegraded":"2024-09-12T01:21:52.398884+0000","last_fullsized":"2024-09-12T01:21:52.398884+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:26.806456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":12,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'6","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.749444+0000","last_change":"2024-09-12T00:52:37.292083+0000","last_active":"2024-09-12T01:21:56.749444+0000","last_peered":"2024-09-12T01:21:56.749444+0000","last_clean":"2024-09-12T01:21:56.749444+0000","last_became_active":"2024-09-12T00:52:37.291369+0000","last_became_peered":"2024-09-12T00:52:37.291369+0000","last_unstale":"2024-09-12T01:21:56.749444+0000","last_undegraded":"2024-09-12T01:21:56.749444+0000","last_fullsized":"2024-09-12T01:21:56.749444+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:43.999305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'35","reported_seq":136,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:12.545173+0000","last_change":"2024-09-12T00:51:04.990882+0000","last_active":"2024-09-12T01:18:12.545173+0000","last_peered":"2024-09-12T01:18:12.545173+0000","last_clean":"2024-09-12T01:18:12.545173+0000","last_became_active":"2024-09-12T00:51:04.990179+0000","last_became_peered":"2024-09-12T00:51:04.990179+0000","last_unstale":"2024-09-12T01:18:12.545173+0000","last_undegraded":"2024-09-12T01:18:12.545173+0000","last_fullsized":"2024-09-12T01:18:12.545173+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:33.185513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":108,"num_write":67,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.779809+0000","last_change":"2024-09-12T01:03:40.574488+0000","last_active":"2024-09-12T01:18:17.779809+0000","last_peered":"2024-09-12T01:18:17.779809+0000","last_clean":"2024-09-12T01:18:17.779809+0000","last_became_active":"2024-09-12T01:03:40.573928+0000","last_became_peered":"2024-09-12T01:03:40.573928+0000","last_unstale":"2024-09-12T01:18:17.779809+0000","last_undegraded":"2024-09-12T01:18:17.779809+0000","last_fullsized":"2024-09-12T01:18:17.779809+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:15.934749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:47.559411+0000","last_change":"2024-09-12T00:52:40.349488+0000","last_active":"2024-09-12T01:19:47.559411+0000","last_peered":"2024-09-12T01:19:47.559411+0000","last_clean":"2024-09-12T01:19:47.559411+0000","last_became_active":"2024-09-12T00:52:40.348494+0000","last_became_peered":"2024-09-12T00:52:40.348494+0000","last_unstale":"2024-09-12T01:19:47.559411+0000","last_undegraded":"2024-09-12T01:19:47.559411+0000","last_fullsized":"2024-09-12T01:19:47.559411+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:17.271665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'2","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:42.564451+0000","last_change":"2024-09-12T00:52:37.279058+0000","last_active":"2024-09-12T01:19:42.564451+0000","last_peered":"2024-09-12T01:19:42.564451+0000","last_clean":"2024-09-12T01:19:42.564451+0000","last_became_active":"2024-09-12T00:52:37.278285+0000","last_became_peered":"2024-09-12T00:52:37.278285+0000","last_unstale":"2024-09-12T01:19:42.564451+0000","last_undegraded":"2024-09-12T01:19:42.564451+0000","last_fullsized":"2024-09-12T01:19:42.564451+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:15.749368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'29","reported_seq":125,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.791752+0000","last_change":"2024-09-12T00:51:04.986057+0000","last_active":"2024-09-12T01:19:07.791752+0000","last_peered":"2024-09-12T01:19:07.791752+0000","last_clean":"2024-09-12T01:19:07.791752+0000","last_became_active":"2024-09-12T00:51:04.984999+0000","last_became_peered":"2024-09-12T00:51:04.984999+0000","last_unstale":"2024-09-12T01:19:07.791752+0000","last_undegraded":"2024-09-12T01:19:07.791752+0000","last_fullsized":"2024-09-12T01:19:07.791752+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:46.905997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":53,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'326","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.765788+0000","last_change":"2024-09-12T00:35:43.948445+0000","last_active":"2024-09-12T01:21:57.765788+0000","last_peered":"2024-09-12T01:21:57.765788+0000","last_clean":"2024-09-12T01:21:57.765788+0000","last_became_active":"2024-09-12T00:35:43.947816+0000","last_became_peered":"2024-09-12T00:35:43.947816+0000","last_unstale":"2024-09-12T01:21:57.765788+0000","last_undegraded":"2024-09-12T01:21:57.765788+0000","last_fullsized":"2024-09-12T01:21:57.765788+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:16.574434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1291331,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":528,"num_read_kb":33235,"num_write":1073,"num_write_kb":21608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'253","reported_seq":876,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:14.250255+0000","last_change":"2024-09-12T00:35:45.926951+0000","last_active":"2024-09-12T01:19:14.250255+0000","last_peered":"2024-09-12T01:19:14.250255+0000","last_clean":"2024-09-12T01:19:14.250255+0000","last_became_active":"2024-09-12T00:35:45.925856+0000","last_became_peered":"2024-09-12T00:35:45.925856+0000","last_unstale":"2024-09-12T01:19:14.250255+0000","last_undegraded":"2024-09-12T01:19:14.250255+0000","last_fullsized":"2024-09-12T01:19:14.250255+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:07.944413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1075,"num_read_kb":882,"num_write":373,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'375","reported_seq":1039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.834716+0000","last_change":"2024-09-12T00:35:43.933369+0000","last_active":"2024-09-12T01:21:57.834716+0000","last_peered":"2024-09-12T01:21:57.834716+0000","last_clean":"2024-09-12T01:21:57.834716+0000","last_became_active":"2024-09-12T00:35:43.933088+0000","last_became_peered":"2024-09-12T00:35:43.933088+0000","last_unstale":"2024-09-12T01:21:57.834716+0000","last_undegraded":"2024-09-12T01:21:57.834716+0000","last_fullsized":"2024-09-12T01:21:57.834716+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:49.773500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":567,"num_read_kb":47488,"num_write":1216,"num_write_kb":29880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'45","reported_seq":579,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:03.587115+0000","last_change":"2024-09-12T00:35:45.947951+0000","last_active":"2024-09-12T01:19:03.587115+0000","last_peered":"2024-09-12T01:19:03.587115+0000","last_clean":"2024-09-12T01:19:03.587115+0000","last_became_active":"2024-09-12T00:35:45.947212+0000","last_became_peered":"2024-09-12T00:35:45.947212+0000","last_unstale":"2024-09-12T01:19:03.587115+0000","last_undegraded":"2024-09-12T01:19:03.587115+0000","last_fullsized":"2024-09-12T01:19:03.587115+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:09.409072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":168,"num_write":71,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'327","reported_seq":1017,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.847684+0000","last_change":"2024-09-12T00:35:43.927529+0000","last_active":"2024-09-12T01:21:57.847684+0000","last_peered":"2024-09-12T01:21:57.847684+0000","last_clean":"2024-09-12T01:21:57.847684+0000","last_became_active":"2024-09-12T00:35:43.926443+0000","last_became_peered":"2024-09-12T00:35:43.926443+0000","last_unstale":"2024-09-12T01:21:57.847684+0000","last_undegraded":"2024-09-12T01:21:57.847684+0000","last_fullsized":"2024-09-12T01:21:57.847684+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:06.887907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262209,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":553,"num_read_kb":98039,"num_write":1093,"num_write_kb":58371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'116","reported_seq":729,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.447686+0000","last_change":"2024-09-12T00:35:45.932367+0000","last_active":"2024-09-12T01:19:43.447686+0000","last_peered":"2024-09-12T01:19:43.447686+0000","last_clean":"2024-09-12T01:19:43.447686+0000","last_became_active":"2024-09-12T00:35:45.930987+0000","last_became_peered":"2024-09-12T00:35:45.930987+0000","last_unstale":"2024-09-12T01:19:43.447686+0000","last_undegraded":"2024-09-12T01:19:43.447686+0000","last_fullsized":"2024-09-12T01:19:43.447686+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:08.829843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":522,"num_read_kb":443,"num_write":187,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'380","reported_seq":1052,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.843793+0000","last_change":"2024-09-12T00:35:43.920497+0000","last_active":"2024-09-12T01:21:57.843793+0000","last_peered":"2024-09-12T01:21:57.843793+0000","last_clean":"2024-09-12T01:21:57.843793+0000","last_became_active":"2024-09-12T00:35:43.914356+0000","last_became_peered":"2024-09-12T00:35:43.914356+0000","last_unstale":"2024-09-12T01:21:57.843793+0000","last_undegraded":"2024-09-12T01:21:57.843793+0000","last_fullsized":"2024-09-12T01:21:57.843793+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:16.053246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6370276,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":596,"num_read_kb":17763,"num_write":1203,"num_write_kb":54335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'197","reported_seq":794,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:40.733551+0000","last_change":"2024-09-12T00:35:45.943011+0000","last_active":"2024-09-12T01:19:40.733551+0000","last_peered":"2024-09-12T01:19:40.733551+0000","last_clean":"2024-09-12T01:19:40.733551+0000","last_became_active":"2024-09-12T00:35:45.942567+0000","last_became_peered":"2024-09-12T00:35:45.942567+0000","last_unstale":"2024-09-12T01:19:40.733551+0000","last_undegraded":"2024-09-12T01:19:40.733551+0000","last_fullsized":"2024-09-12T01:19:40.733551+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:28.500033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":861,"num_read_kb":699,"num_write":314,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'338","reported_seq":995,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.782673+0000","last_change":"2024-09-12T00:35:43.945400+0000","last_active":"2024-09-12T01:21:57.782673+0000","last_peered":"2024-09-12T01:21:57.782673+0000","last_clean":"2024-09-12T01:21:57.782673+0000","last_became_active":"2024-09-12T00:35:43.944644+0000","last_became_peered":"2024-09-12T00:35:43.944644+0000","last_unstale":"2024-09-12T01:21:57.782673+0000","last_undegraded":"2024-09-12T01:21:57.782673+0000","last_fullsized":"2024-09-12T01:21:57.782673+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:50.172251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289235,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":584,"num_read_kb":29244,"num_write":1169,"num_write_kb":25136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'341","reported_seq":1075,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.255694+0000","last_change":"2024-09-12T00:35:45.943860+0000","last_active":"2024-09-12T01:20:22.255694+0000","last_peered":"2024-09-12T01:20:22.255694+0000","last_clean":"2024-09-12T01:20:22.255694+0000","last_became_active":"2024-09-12T00:35:45.943110+0000","last_became_peered":"2024-09-12T00:35:45.943110+0000","last_unstale":"2024-09-12T01:20:22.255694+0000","last_undegraded":"2024-09-12T01:20:22.255694+0000","last_fullsized":"2024-09-12T01:20:22.255694+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:24.346213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1719,"num_read_kb":1451,"num_write":623,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'333","reported_seq":943,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.794513+0000","last_change":"2024-09-12T00:35:43.930576+0000","last_active":"2024-09-12T01:21:57.794513+0000","last_peered":"2024-09-12T01:21:57.794513+0000","last_clean":"2024-09-12T01:21:57.794513+0000","last_became_active":"2024-09-12T00:35:43.929553+0000","last_became_peered":"2024-09-12T00:35:43.929553+0000","last_unstale":"2024-09-12T01:21:57.794513+0000","last_undegraded":"2024-09-12T01:21:57.794513+0000","last_fullsized":"2024-09-12T01:21:57.794513+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:22.833352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8021586,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":453,"num_read_kb":14436,"num_write":1125,"num_write_kb":49786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'350","reported_seq":931,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:00.371052+0000","last_change":"2024-09-12T00:35:45.934966+0000","last_active":"2024-09-12T01:20:00.371052+0000","last_peered":"2024-09-12T01:20:00.371052+0000","last_clean":"2024-09-12T01:20:00.371052+0000","last_became_active":"2024-09-12T00:35:45.934193+0000","last_became_peered":"2024-09-12T00:35:45.934193+0000","last_unstale":"2024-09-12T01:20:00.371052+0000","last_undegraded":"2024-09-12T01:20:00.371052+0000","last_fullsized":"2024-09-12T01:20:00.371052+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:43.914081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1452,"num_read_kb":1165,"num_write":550,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'389","reported_seq":1070,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.822478+0000","last_change":"2024-09-12T00:35:43.942971+0000","last_active":"2024-09-12T01:21:57.822478+0000","last_peered":"2024-09-12T01:21:57.822478+0000","last_clean":"2024-09-12T01:21:57.822478+0000","last_became_active":"2024-09-12T00:35:43.942199+0000","last_became_peered":"2024-09-12T00:35:43.942199+0000","last_unstale":"2024-09-12T01:21:57.822478+0000","last_undegraded":"2024-09-12T01:21:57.822478+0000","last_fullsized":"2024-09-12T01:21:57.822478+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:07.698617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":647,"num_read_kb":42927,"num_write":1206,"num_write_kb":42524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'254","reported_seq":917,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:33.569572+0000","last_change":"2024-09-12T00:35:45.938322+0000","last_active":"2024-09-12T01:19:33.569572+0000","last_peered":"2024-09-12T01:19:33.569572+0000","last_clean":"2024-09-12T01:19:33.569572+0000","last_became_active":"2024-09-12T00:35:45.937211+0000","last_became_peered":"2024-09-12T00:35:45.937211+0000","last_unstale":"2024-09-12T01:19:33.569572+0000","last_undegraded":"2024-09-12T01:19:33.569572+0000","last_fullsized":"2024-09-12T01:19:33.569572+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:08.919655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1131,"num_read_kb":929,"num_write":387,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'357","reported_seq":1040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.824404+0000","last_change":"2024-09-12T00:35:43.920009+0000","last_active":"2024-09-12T01:21:57.824404+0000","last_peered":"2024-09-12T01:21:57.824404+0000","last_clean":"2024-09-12T01:21:57.824404+0000","last_became_active":"2024-09-12T00:35:43.918653+0000","last_became_peered":"2024-09-12T00:35:43.918653+0000","last_unstale":"2024-09-12T01:21:57.824404+0000","last_undegraded":"2024-09-12T01:21:57.824404+0000","last_fullsized":"2024-09-12T01:21:57.824404+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:08.630692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262196,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":641,"num_read_kb":7519,"num_write":1239,"num_write_kb":32586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'269","reported_seq":929,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:51.427937+0000","last_change":"2024-09-12T00:35:45.942221+0000","last_active":"2024-09-12T01:19:51.427937+0000","last_peered":"2024-09-12T01:19:51.427937+0000","last_clean":"2024-09-12T01:19:51.427937+0000","last_became_active":"2024-09-12T00:35:45.941814+0000","last_became_peered":"2024-09-12T00:35:45.941814+0000","last_unstale":"2024-09-12T01:19:51.427937+0000","last_undegraded":"2024-09-12T01:19:51.427937+0000","last_fullsized":"2024-09-12T01:19:51.427937+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:48.303334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1198,"num_read_kb":983,"num_write":434,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'104","reported_seq":678,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:36.090439+0000","last_change":"2024-09-12T00:35:45.930414+0000","last_active":"2024-09-12T01:19:36.090439+0000","last_peered":"2024-09-12T01:19:36.090439+0000","last_clean":"2024-09-12T01:19:36.090439+0000","last_became_active":"2024-09-12T00:35:45.929168+0000","last_became_peered":"2024-09-12T00:35:45.929168+0000","last_unstale":"2024-09-12T01:19:36.090439+0000","last_undegraded":"2024-09-12T01:19:36.090439+0000","last_fullsized":"2024-09-12T01:19:36.090439+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:46.680426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":468,"num_read_kb":393,"num_write":157,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'368","reported_seq":1017,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.776450+0000","last_change":"2024-09-12T00:35:43.951280+0000","last_active":"2024-09-12T01:21:57.776450+0000","last_peered":"2024-09-12T01:21:57.776450+0000","last_clean":"2024-09-12T01:21:57.776450+0000","last_became_active":"2024-09-12T00:35:43.949857+0000","last_became_peered":"2024-09-12T00:35:43.949857+0000","last_unstale":"2024-09-12T01:21:57.776450+0000","last_undegraded":"2024-09-12T01:21:57.776450+0000","last_fullsized":"2024-09-12T01:21:57.776450+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:10.127383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":539,"num_read_kb":3399,"num_write":1112,"num_write_kb":43442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'111","reported_seq":684,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:47.772837+0000","last_change":"2024-09-12T00:35:45.948146+0000","last_active":"2024-09-12T01:17:47.772837+0000","last_peered":"2024-09-12T01:17:47.772837+0000","last_clean":"2024-09-12T01:17:47.772837+0000","last_became_active":"2024-09-12T00:35:45.947366+0000","last_became_peered":"2024-09-12T00:35:45.947366+0000","last_unstale":"2024-09-12T01:17:47.772837+0000","last_undegraded":"2024-09-12T01:17:47.772837+0000","last_fullsized":"2024-09-12T01:17:47.772837+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:11.387874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":482,"num_read_kb":394,"num_write":173,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'337","reported_seq":1012,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.362442+0000","last_change":"2024-09-12T00:35:43.926785+0000","last_active":"2024-09-12T01:21:57.362442+0000","last_peered":"2024-09-12T01:21:57.362442+0000","last_clean":"2024-09-12T01:21:57.362442+0000","last_became_active":"2024-09-12T00:35:43.926027+0000","last_became_peered":"2024-09-12T00:35:43.926027+0000","last_unstale":"2024-09-12T01:21:57.362442+0000","last_undegraded":"2024-09-12T01:21:57.362442+0000","last_fullsized":"2024-09-12T01:21:57.362442+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:47.685516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6341811,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":547,"num_read_kb":69210,"num_write":1239,"num_write_kb":64702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'169","reported_seq":777,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:58.547349+0000","last_change":"2024-09-12T00:35:45.933189+0000","last_active":"2024-09-12T01:17:58.547349+0000","last_peered":"2024-09-12T01:17:58.547349+0000","last_clean":"2024-09-12T01:17:58.547349+0000","last_became_active":"2024-09-12T00:35:45.932116+0000","last_became_peered":"2024-09-12T00:35:45.932116+0000","last_unstale":"2024-09-12T01:17:58.547349+0000","last_undegraded":"2024-09-12T01:17:58.547349+0000","last_fullsized":"2024-09-12T01:17:58.547349+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:10.046459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":828,"num_read_kb":701,"num_write":304,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'331","reported_seq":1019,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.360497+0000","last_change":"2024-09-12T00:36:17.046117+0000","last_active":"2024-09-12T01:21:57.360497+0000","last_peered":"2024-09-12T01:21:57.360497+0000","last_clean":"2024-09-12T01:21:57.360497+0000","last_became_active":"2024-09-12T00:36:17.045217+0000","last_became_peered":"2024-09-12T00:36:17.045217+0000","last_unstale":"2024-09-12T01:21:57.360497+0000","last_undegraded":"2024-09-12T01:21:57.360497+0000","last_fullsized":"2024-09-12T01:21:57.360497+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:17.813892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3859835,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":565,"num_read_kb":9910,"num_write":1060,"num_write_kb":33583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'99","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:56.473406+0000","last_change":"2024-09-12T00:35:45.939622+0000","last_active":"2024-09-12T01:19:56.473406+0000","last_peered":"2024-09-12T01:19:56.473406+0000","last_clean":"2024-09-12T01:19:56.473406+0000","last_became_active":"2024-09-12T00:35:45.939261+0000","last_became_peered":"2024-09-12T00:35:45.939261+0000","last_unstale":"2024-09-12T01:19:56.473406+0000","last_undegraded":"2024-09-12T01:19:56.473406+0000","last_fullsized":"2024-09-12T01:19:56.473406+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:47.746126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":439,"num_read_kb":359,"num_write":158,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'322","reported_seq":962,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.558934+0000","last_change":"2024-09-12T00:35:43.949757+0000","last_active":"2024-09-12T01:21:57.558934+0000","last_peered":"2024-09-12T01:21:57.558934+0000","last_clean":"2024-09-12T01:21:57.558934+0000","last_became_active":"2024-09-12T00:35:43.949045+0000","last_became_peered":"2024-09-12T00:35:43.949045+0000","last_unstale":"2024-09-12T01:21:57.558934+0000","last_undegraded":"2024-09-12T01:21:57.558934+0000","last_fullsized":"2024-09-12T01:21:57.558934+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:36.497824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5533541,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":537,"num_read_kb":18745,"num_write":1019,"num_write_kb":46080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'126","reported_seq":725,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:46.094592+0000","last_change":"2024-09-12T00:35:45.943288+0000","last_active":"2024-09-12T01:19:46.094592+0000","last_peered":"2024-09-12T01:19:46.094592+0000","last_clean":"2024-09-12T01:19:46.094592+0000","last_became_active":"2024-09-12T00:35:45.942814+0000","last_became_peered":"2024-09-12T00:35:45.942814+0000","last_unstale":"2024-09-12T01:19:46.094592+0000","last_undegraded":"2024-09-12T01:19:46.094592+0000","last_fullsized":"2024-09-12T01:19:46.094592+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:06.467847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":574,"num_read_kb":483,"num_write":214,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'319","reported_seq":933,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.784921+0000","last_change":"2024-09-12T00:35:43.939756+0000","last_active":"2024-09-12T01:21:57.784921+0000","last_peered":"2024-09-12T01:21:57.784921+0000","last_clean":"2024-09-12T01:21:57.784921+0000","last_became_active":"2024-09-12T00:35:43.939128+0000","last_became_peered":"2024-09-12T00:35:43.939128+0000","last_unstale":"2024-09-12T01:21:57.784921+0000","last_undegraded":"2024-09-12T01:21:57.784921+0000","last_fullsized":"2024-09-12T01:21:57.784921+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:36.964204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":453,"num_read_kb":9693,"num_write":1061,"num_write_kb":13466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'4124","reported_seq":4720,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:01.277760+0000","last_change":"2024-09-12T00:35:45.944333+0000","last_active":"2024-09-12T01:20:01.277760+0000","last_peered":"2024-09-12T01:20:01.277760+0000","last_clean":"2024-09-12T01:20:01.277760+0000","last_became_active":"2024-09-12T00:35:45.943253+0000","last_became_peered":"2024-09-12T00:35:45.943253+0000","last_unstale":"2024-09-12T01:20:01.277760+0000","last_undegraded":"2024-09-12T01:20:01.277760+0000","last_fullsized":"2024-09-12T01:20:01.277760+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:04.022329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16581,"num_read_kb":13903,"num_write":6185,"num_write_kb":3084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'354","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.850617+0000","last_change":"2024-09-12T00:35:43.933614+0000","last_active":"2024-09-12T01:21:57.850617+0000","last_peered":"2024-09-12T01:21:57.850617+0000","last_clean":"2024-09-12T01:21:57.850617+0000","last_became_active":"2024-09-12T00:35:43.933191+0000","last_became_peered":"2024-09-12T00:35:43.933191+0000","last_unstale":"2024-09-12T01:21:57.850617+0000","last_undegraded":"2024-09-12T01:21:57.850617+0000","last_fullsized":"2024-09-12T01:21:57.850617+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:15.373281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":549,"num_read_kb":44649,"num_write":1012,"num_write_kb":28437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'146","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.077594+0000","last_change":"2024-09-12T00:35:53.985466+0000","last_active":"2024-09-12T01:20:23.077594+0000","last_peered":"2024-09-12T01:20:23.077594+0000","last_clean":"2024-09-12T01:20:23.077594+0000","last_became_active":"2024-09-12T00:35:53.981609+0000","last_became_peered":"2024-09-12T00:35:53.981609+0000","last_unstale":"2024-09-12T01:20:23.077594+0000","last_undegraded":"2024-09-12T01:20:23.077594+0000","last_fullsized":"2024-09-12T01:20:23.077594+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:05.745536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":187,"num_read_kb":176,"num_write":375,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'258","reported_seq":901,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:50.602115+0000","last_change":"2024-09-12T00:35:45.948978+0000","last_active":"2024-09-12T01:18:50.602115+0000","last_peered":"2024-09-12T01:18:50.602115+0000","last_clean":"2024-09-12T01:18:50.602115+0000","last_became_active":"2024-09-12T00:35:45.948575+0000","last_became_peered":"2024-09-12T00:35:45.948575+0000","last_unstale":"2024-09-12T01:18:50.602115+0000","last_undegraded":"2024-09-12T01:18:50.602115+0000","last_fullsized":"2024-09-12T01:18:50.602115+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:55.123044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1199,"num_read_kb":1005,"num_write":430,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"265'282","reported_seq":879,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.805974+0000","last_change":"2024-09-12T00:35:43.957625+0000","last_active":"2024-09-12T01:21:57.805974+0000","last_peered":"2024-09-12T01:21:57.805974+0000","last_clean":"2024-09-12T01:21:57.805974+0000","last_became_active":"2024-09-12T00:35:43.956812+0000","last_became_peered":"2024-09-12T00:35:43.956812+0000","last_unstale":"2024-09-12T01:21:57.805974+0000","last_undegraded":"2024-09-12T01:21:57.805974+0000","last_fullsized":"2024-09-12T01:21:57.805974+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:33.110636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":409,"num_read_kb":399,"num_write":954,"num_write_kb":26614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.566225+0000","last_change":"2024-09-12T00:35:47.933988+0000","last_active":"2024-09-12T01:19:18.566225+0000","last_peered":"2024-09-12T01:19:18.566225+0000","last_clean":"2024-09-12T01:19:18.566225+0000","last_became_active":"2024-09-12T00:35:47.933249+0000","last_became_peered":"2024-09-12T00:35:47.933249+0000","last_unstale":"2024-09-12T01:19:18.566225+0000","last_undegraded":"2024-09-12T01:19:18.566225+0000","last_fullsized":"2024-09-12T01:19:18.566225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:47.085642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'339","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.735988+0000","last_change":"2024-09-12T00:35:49.952443+0000","last_active":"2024-09-12T01:21:57.735988+0000","last_peered":"2024-09-12T01:21:57.735988+0000","last_clean":"2024-09-12T01:21:57.735988+0000","last_became_active":"2024-09-12T00:35:49.951438+0000","last_became_peered":"2024-09-12T00:35:49.951438+0000","last_unstale":"2024-09-12T01:21:57.735988+0000","last_undegraded":"2024-09-12T01:21:57.735988+0000","last_fullsized":"2024-09-12T01:21:57.735988+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:58.543209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44615,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":554,"num_read_kb":1150,"num_write":438,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:22.795536+0000","last_change":"2024-09-12T00:35:51.984956+0000","last_active":"2024-09-12T01:19:22.795536+0000","last_peered":"2024-09-12T01:19:22.795536+0000","last_clean":"2024-09-12T01:19:22.795536+0000","last_became_active":"2024-09-12T00:35:51.984350+0000","last_became_peered":"2024-09-12T00:35:51.984350+0000","last_unstale":"2024-09-12T01:19:22.795536+0000","last_undegraded":"2024-09-12T01:19:22.795536+0000","last_fullsized":"2024-09-12T01:19:22.795536+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:25.562363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'203","reported_seq":801,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:17.805609+0000","last_change":"2024-09-12T00:35:53.998522+0000","last_active":"2024-09-12T01:20:17.805609+0000","last_peered":"2024-09-12T01:20:17.805609+0000","last_clean":"2024-09-12T01:20:17.805609+0000","last_became_active":"2024-09-12T00:35:53.995513+0000","last_became_peered":"2024-09-12T00:35:53.995513+0000","last_unstale":"2024-09-12T01:20:17.805609+0000","last_undegraded":"2024-09-12T01:20:17.805609+0000","last_fullsized":"2024-09-12T01:20:17.805609+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:28.256858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":409,"num_read_kb":360,"num_write":396,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'241","reported_seq":868,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:07.808738+0000","last_change":"2024-09-12T00:35:45.940693+0000","last_active":"2024-09-12T01:20:07.808738+0000","last_peered":"2024-09-12T01:20:07.808738+0000","last_clean":"2024-09-12T01:20:07.808738+0000","last_became_active":"2024-09-12T00:35:45.939962+0000","last_became_peered":"2024-09-12T00:35:45.939962+0000","last_unstale":"2024-09-12T01:20:07.808738+0000","last_undegraded":"2024-09-12T01:20:07.808738+0000","last_fullsized":"2024-09-12T01:20:07.808738+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:44.308762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1036,"num_read_kb":844,"num_write":371,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'368","reported_seq":1072,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.848475+0000","last_change":"2024-09-12T00:35:43.945052+0000","last_active":"2024-09-12T01:21:57.848475+0000","last_peered":"2024-09-12T01:21:57.848475+0000","last_clean":"2024-09-12T01:21:57.848475+0000","last_became_active":"2024-09-12T00:35:43.944705+0000","last_became_peered":"2024-09-12T00:35:43.944705+0000","last_unstale":"2024-09-12T01:21:57.848475+0000","last_undegraded":"2024-09-12T01:21:57.848475+0000","last_fullsized":"2024-09-12T01:21:57.848475+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:40.455249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1344150,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":792,"num_read_kb":8209,"num_write":1184,"num_write_kb":28685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:58.575009+0000","last_change":"2024-09-12T00:35:47.946592+0000","last_active":"2024-09-12T01:17:58.575009+0000","last_peered":"2024-09-12T01:17:58.575009+0000","last_clean":"2024-09-12T01:17:58.575009+0000","last_became_active":"2024-09-12T00:35:47.945971+0000","last_became_peered":"2024-09-12T00:35:47.945971+0000","last_unstale":"2024-09-12T01:17:58.575009+0000","last_undegraded":"2024-09-12T01:17:58.575009+0000","last_fullsized":"2024-09-12T01:17:58.575009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:39.808186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'93","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:22.553249+0000","last_change":"2024-09-12T00:35:49.939105+0000","last_active":"2024-09-12T01:19:22.553249+0000","last_peered":"2024-09-12T01:19:22.553249+0000","last_clean":"2024-09-12T01:19:22.553249+0000","last_became_active":"2024-09-12T00:35:49.938374+0000","last_became_peered":"2024-09-12T00:35:49.938374+0000","last_unstale":"2024-09-12T01:19:22.553249+0000","last_undegraded":"2024-09-12T01:19:22.553249+0000","last_fullsized":"2024-09-12T01:19:22.553249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:28.914067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:22.553202+0000","last_change":"2024-09-12T00:35:51.975432+0000","last_active":"2024-09-12T01:19:22.553202+0000","last_peered":"2024-09-12T01:19:22.553202+0000","last_clean":"2024-09-12T01:19:22.553202+0000","last_became_active":"2024-09-12T00:35:51.974659+0000","last_became_peered":"2024-09-12T00:35:51.974659+0000","last_unstale":"2024-09-12T01:19:22.553202+0000","last_undegraded":"2024-09-12T01:19:22.553202+0000","last_fullsized":"2024-09-12T01:19:22.553202+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:42.719938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'114","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:44.542108+0000","last_change":"2024-09-12T00:35:53.994008+0000","last_active":"2024-09-12T01:19:44.542108+0000","last_peered":"2024-09-12T01:19:44.542108+0000","last_clean":"2024-09-12T01:19:44.542108+0000","last_became_active":"2024-09-12T00:35:53.992311+0000","last_became_peered":"2024-09-12T00:35:53.992311+0000","last_unstale":"2024-09-12T01:19:44.542108+0000","last_undegraded":"2024-09-12T01:19:44.542108+0000","last_fullsized":"2024-09-12T01:19:44.542108+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:28.357194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":265,"num_read_kb":226,"num_write":268,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'268","reported_seq":913,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.574373+0000","last_change":"2024-09-12T00:35:45.941958+0000","last_active":"2024-09-12T01:19:18.574373+0000","last_peered":"2024-09-12T01:19:18.574373+0000","last_clean":"2024-09-12T01:19:18.574373+0000","last_became_active":"2024-09-12T00:35:45.941543+0000","last_became_peered":"2024-09-12T00:35:45.941543+0000","last_unstale":"2024-09-12T01:19:18.574373+0000","last_undegraded":"2024-09-12T01:19:18.574373+0000","last_fullsized":"2024-09-12T01:19:18.574373+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:08.224075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1165,"num_read_kb":955,"num_write":416,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'387","reported_seq":1101,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.785682+0000","last_change":"2024-09-12T00:35:43.953442+0000","last_active":"2024-09-12T01:21:57.785682+0000","last_peered":"2024-09-12T01:21:57.785682+0000","last_clean":"2024-09-12T01:21:57.785682+0000","last_became_active":"2024-09-12T00:35:43.952543+0000","last_became_peered":"2024-09-12T00:35:43.952543+0000","last_unstale":"2024-09-12T01:21:57.785682+0000","last_undegraded":"2024-09-12T01:21:57.785682+0000","last_fullsized":"2024-09-12T01:21:57.785682+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:44.952950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262206,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":771,"num_read_kb":780,"num_write":1220,"num_write_kb":19641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.594613+0000","last_change":"2024-09-12T00:35:47.934527+0000","last_active":"2024-09-12T01:19:18.594613+0000","last_peered":"2024-09-12T01:19:18.594613+0000","last_clean":"2024-09-12T01:19:18.594613+0000","last_became_active":"2024-09-12T00:35:47.933896+0000","last_became_peered":"2024-09-12T00:35:47.933896+0000","last_unstale":"2024-09-12T01:19:18.594613+0000","last_undegraded":"2024-09-12T01:19:18.594613+0000","last_fullsized":"2024-09-12T01:19:18.594613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:11.718346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'113","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.483543+0000","last_change":"2024-09-12T00:35:49.937626+0000","last_active":"2024-09-12T01:18:23.483543+0000","last_peered":"2024-09-12T01:18:23.483543+0000","last_clean":"2024-09-12T01:18:23.483543+0000","last_became_active":"2024-09-12T00:35:49.936846+0000","last_became_peered":"2024-09-12T00:35:49.936846+0000","last_unstale":"2024-09-12T01:18:23.483543+0000","last_undegraded":"2024-09-12T01:18:23.483543+0000","last_fullsized":"2024-09-12T01:18:23.483543+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:16.548831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":139,"num_read_kb":131,"num_write":92,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'772","reported_seq":2287,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.351324+0000","last_change":"2024-09-12T00:35:51.980021+0000","last_active":"2024-09-12T01:21:57.351324+0000","last_peered":"2024-09-12T01:21:57.351324+0000","last_clean":"2024-09-12T01:21:57.351324+0000","last_became_active":"2024-09-12T00:35:51.979288+0000","last_became_peered":"2024-09-12T00:35:51.979288+0000","last_unstale":"2024-09-12T01:21:57.351324+0000","last_undegraded":"2024-09-12T01:21:57.351324+0000","last_fullsized":"2024-09-12T01:21:57.351324+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:56.227079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'188","reported_seq":1012,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.127347+0000","last_change":"2024-09-12T00:35:54.014161+0000","last_active":"2024-09-12T01:20:23.127347+0000","last_peered":"2024-09-12T01:20:23.127347+0000","last_clean":"2024-09-12T01:20:23.127347+0000","last_became_active":"2024-09-12T00:35:54.013299+0000","last_became_peered":"2024-09-12T00:35:54.013299+0000","last_unstale":"2024-09-12T01:20:23.127347+0000","last_undegraded":"2024-09-12T01:20:23.127347+0000","last_fullsized":"2024-09-12T01:20:23.127347+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:35.433076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":837,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":580,"num_read_kb":578,"num_write":407,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'105","reported_seq":677,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.594579+0000","last_change":"2024-09-12T00:35:45.955221+0000","last_active":"2024-09-12T01:19:18.594579+0000","last_peered":"2024-09-12T01:19:18.594579+0000","last_clean":"2024-09-12T01:19:18.594579+0000","last_became_active":"2024-09-12T00:35:45.954858+0000","last_became_peered":"2024-09-12T00:35:45.954858+0000","last_unstale":"2024-09-12T01:19:18.594579+0000","last_undegraded":"2024-09-12T01:19:18.594579+0000","last_fullsized":"2024-09-12T01:19:18.594579+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:35.164506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":470,"num_read_kb":391,"num_write":166,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'330","reported_seq":986,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.376538+0000","last_change":"2024-09-12T00:35:43.931623+0000","last_active":"2024-09-12T01:21:57.376538+0000","last_peered":"2024-09-12T01:21:57.376538+0000","last_clean":"2024-09-12T01:21:57.376538+0000","last_became_active":"2024-09-12T00:35:43.930867+0000","last_became_peered":"2024-09-12T00:35:43.930867+0000","last_unstale":"2024-09-12T01:21:57.376538+0000","last_undegraded":"2024-09-12T01:21:57.376538+0000","last_fullsized":"2024-09-12T01:21:57.376538+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:00.843291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291822,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":504,"num_read_kb":73816,"num_write":1045,"num_write_kb":41341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.566330+0000","last_change":"2024-09-12T00:35:47.931572+0000","last_active":"2024-09-12T01:19:18.566330+0000","last_peered":"2024-09-12T01:19:18.566330+0000","last_clean":"2024-09-12T01:19:18.566330+0000","last_became_active":"2024-09-12T00:35:47.930883+0000","last_became_peered":"2024-09-12T00:35:47.930883+0000","last_unstale":"2024-09-12T01:19:18.566330+0000","last_undegraded":"2024-09-12T01:19:18.566330+0000","last_fullsized":"2024-09-12T01:19:18.566330+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:26.632000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'289","reported_seq":861,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.543556+0000","last_change":"2024-09-12T00:35:50.030382+0000","last_active":"2024-09-12T01:21:57.543556+0000","last_peered":"2024-09-12T01:21:57.543556+0000","last_clean":"2024-09-12T01:21:57.543556+0000","last_became_active":"2024-09-12T00:35:50.029236+0000","last_became_peered":"2024-09-12T00:35:50.029236+0000","last_unstale":"2024-09-12T01:21:57.543556+0000","last_undegraded":"2024-09-12T01:21:57.543556+0000","last_fullsized":"2024-09-12T01:21:57.543556+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:36.054917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54671,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":1128,"num_write":386,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'786","reported_seq":2331,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.316034+0000","last_change":"2024-09-12T00:35:51.983959+0000","last_active":"2024-09-12T01:21:57.316034+0000","last_peered":"2024-09-12T01:21:57.316034+0000","last_clean":"2024-09-12T01:21:57.316034+0000","last_became_active":"2024-09-12T00:35:51.983271+0000","last_became_peered":"2024-09-12T00:35:51.983271+0000","last_unstale":"2024-09-12T01:21:57.316034+0000","last_undegraded":"2024-09-12T01:21:57.316034+0000","last_fullsized":"2024-09-12T01:21:57.316034+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:13.842922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'260","reported_seq":932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.563677+0000","last_change":"2024-09-12T00:35:45.940778+0000","last_active":"2024-09-12T01:19:08.563677+0000","last_peered":"2024-09-12T01:19:08.563677+0000","last_clean":"2024-09-12T01:19:08.563677+0000","last_became_active":"2024-09-12T00:35:45.940073+0000","last_became_peered":"2024-09-12T00:35:45.940073+0000","last_unstale":"2024-09-12T01:19:08.563677+0000","last_undegraded":"2024-09-12T01:19:08.563677+0000","last_fullsized":"2024-09-12T01:19:08.563677+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:47.849352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1192,"num_read_kb":982,"num_write":401,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'350","reported_seq":1059,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.796405+0000","last_change":"2024-09-12T00:35:43.957315+0000","last_active":"2024-09-12T01:21:57.796405+0000","last_peered":"2024-09-12T01:21:57.796405+0000","last_clean":"2024-09-12T01:21:57.796405+0000","last_became_active":"2024-09-12T00:35:43.956814+0000","last_became_peered":"2024-09-12T00:35:43.956814+0000","last_unstale":"2024-09-12T01:21:57.796405+0000","last_undegraded":"2024-09-12T01:21:57.796405+0000","last_fullsized":"2024-09-12T01:21:57.796405+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:24.210436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":765,"num_read_kb":6356,"num_write":994,"num_write_kb":17273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.791834+0000","last_change":"2024-09-12T00:35:47.945726+0000","last_active":"2024-09-12T01:19:07.791834+0000","last_peered":"2024-09-12T01:19:07.791834+0000","last_clean":"2024-09-12T01:19:07.791834+0000","last_became_active":"2024-09-12T00:35:47.944913+0000","last_became_peered":"2024-09-12T00:35:47.944913+0000","last_unstale":"2024-09-12T01:19:07.791834+0000","last_undegraded":"2024-09-12T01:19:07.791834+0000","last_fullsized":"2024-09-12T01:19:07.791834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:02.558771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'348","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.872006+0000","last_change":"2024-09-12T00:35:50.028219+0000","last_active":"2024-09-12T01:21:57.872006+0000","last_peered":"2024-09-12T01:21:57.872006+0000","last_clean":"2024-09-12T01:21:57.872006+0000","last_became_active":"2024-09-12T00:35:50.027282+0000","last_became_peered":"2024-09-12T00:35:50.027282+0000","last_unstale":"2024-09-12T01:21:57.872006+0000","last_undegraded":"2024-09-12T01:21:57.872006+0000","last_fullsized":"2024-09-12T01:21:57.872006+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:27.196205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45216,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":563,"num_read_kb":1133,"num_write":440,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.569449+0000","last_change":"2024-09-12T00:35:51.972158+0000","last_active":"2024-09-12T01:18:38.569449+0000","last_peered":"2024-09-12T01:18:38.569449+0000","last_clean":"2024-09-12T01:18:38.569449+0000","last_became_active":"2024-09-12T00:35:51.971491+0000","last_became_peered":"2024-09-12T00:35:51.971491+0000","last_unstale":"2024-09-12T01:18:38.569449+0000","last_undegraded":"2024-09-12T01:18:38.569449+0000","last_fullsized":"2024-09-12T01:18:38.569449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:22.911772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'555","reported_seq":1370,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.367346+0000","last_change":"2024-09-12T00:35:54.000046+0000","last_active":"2024-09-12T01:21:25.367346+0000","last_peered":"2024-09-12T01:21:25.367346+0000","last_clean":"2024-09-12T01:21:25.367346+0000","last_became_active":"2024-09-12T00:35:53.996514+0000","last_became_peered":"2024-09-12T00:35:53.996514+0000","last_unstale":"2024-09-12T01:21:25.367346+0000","last_undegraded":"2024-09-12T01:21:25.367346+0000","last_fullsized":"2024-09-12T01:21:25.367346+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:55.200677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1307,"num_read_kb":1296,"num_write":1166,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'136","reported_seq":740,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.750429+0000","last_change":"2024-09-12T00:35:45.943831+0000","last_active":"2024-09-12T01:19:07.750429+0000","last_peered":"2024-09-12T01:19:07.750429+0000","last_clean":"2024-09-12T01:19:07.750429+0000","last_became_active":"2024-09-12T00:35:45.943083+0000","last_became_peered":"2024-09-12T00:35:45.943083+0000","last_unstale":"2024-09-12T01:19:07.750429+0000","last_undegraded":"2024-09-12T01:19:07.750429+0000","last_fullsized":"2024-09-12T01:19:07.750429+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:26.091545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":650,"num_read_kb":541,"num_write":222,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'336","reported_seq":979,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.814680+0000","last_change":"2024-09-12T00:35:43.954537+0000","last_active":"2024-09-12T01:21:57.814680+0000","last_peered":"2024-09-12T01:21:57.814680+0000","last_clean":"2024-09-12T01:21:57.814680+0000","last_became_active":"2024-09-12T00:35:43.953664+0000","last_became_peered":"2024-09-12T00:35:43.953664+0000","last_unstale":"2024-09-12T01:21:57.814680+0000","last_undegraded":"2024-09-12T01:21:57.814680+0000","last_fullsized":"2024-09-12T01:21:57.814680+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:13.149672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289008,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":477,"num_read_kb":49556,"num_write":1049,"num_write_kb":45556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:10.566168+0000","last_change":"2024-09-12T00:35:47.937702+0000","last_active":"2024-09-12T01:19:10.566168+0000","last_peered":"2024-09-12T01:19:10.566168+0000","last_clean":"2024-09-12T01:19:10.566168+0000","last_became_active":"2024-09-12T00:35:47.936972+0000","last_became_peered":"2024-09-12T00:35:47.936972+0000","last_unstale":"2024-09-12T01:19:10.566168+0000","last_undegraded":"2024-09-12T01:19:10.566168+0000","last_fullsized":"2024-09-12T01:19:10.566168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:21.464118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'266","reported_seq":838,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.165456+0000","last_change":"2024-09-12T00:35:49.955401+0000","last_active":"2024-09-12T01:21:57.165456+0000","last_peered":"2024-09-12T01:21:57.165456+0000","last_clean":"2024-09-12T01:21:57.165456+0000","last_became_active":"2024-09-12T00:35:49.954568+0000","last_became_peered":"2024-09-12T00:35:49.954568+0000","last_unstale":"2024-09-12T01:21:57.165456+0000","last_undegraded":"2024-09-12T01:21:57.165456+0000","last_fullsized":"2024-09-12T01:21:57.165456+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:57.669990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45999,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":441,"num_read_kb":1004,"num_write":356,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:23.595568+0000","last_change":"2024-09-12T00:35:51.982044+0000","last_active":"2024-09-12T01:19:23.595568+0000","last_peered":"2024-09-12T01:19:23.595568+0000","last_clean":"2024-09-12T01:19:23.595568+0000","last_became_active":"2024-09-12T00:35:51.981326+0000","last_became_peered":"2024-09-12T00:35:51.981326+0000","last_unstale":"2024-09-12T01:19:23.595568+0000","last_undegraded":"2024-09-12T01:19:23.595568+0000","last_fullsized":"2024-09-12T01:19:23.595568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:53.955317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'2394","reported_seq":4228,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:14.960049+0000","last_change":"2024-09-12T00:35:53.975817+0000","last_active":"2024-09-12T01:21:14.960049+0000","last_peered":"2024-09-12T01:21:14.960049+0000","last_clean":"2024-09-12T01:21:14.960049+0000","last_became_active":"2024-09-12T00:35:53.975054+0000","last_became_peered":"2024-09-12T00:35:53.975054+0000","last_unstale":"2024-09-12T01:21:14.960049+0000","last_undegraded":"2024-09-12T01:21:14.960049+0000","last_fullsized":"2024-09-12T01:21:14.960049+0000","mapping_epoch":34,"log_start":"265'2300","ondisk_log_start":"265'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":2300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:31.278726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6031,"num_read_kb":6023,"num_write":4852,"num_write_kb":1786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'134","reported_seq":750,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:12.558238+0000","last_change":"2024-09-12T00:35:45.954433+0000","last_active":"2024-09-12T01:19:12.558238+0000","last_peered":"2024-09-12T01:19:12.558238+0000","last_clean":"2024-09-12T01:19:12.558238+0000","last_became_active":"2024-09-12T00:35:45.953664+0000","last_became_peered":"2024-09-12T00:35:45.953664+0000","last_unstale":"2024-09-12T01:19:12.558238+0000","last_undegraded":"2024-09-12T01:19:12.558238+0000","last_fullsized":"2024-09-12T01:19:12.558238+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:20.996949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":607,"num_read_kb":511,"num_write":198,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'327","reported_seq":1029,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.815595+0000","last_change":"2024-09-12T00:35:43.943348+0000","last_active":"2024-09-12T01:21:57.815595+0000","last_peered":"2024-09-12T01:21:57.815595+0000","last_clean":"2024-09-12T01:21:57.815595+0000","last_became_active":"2024-09-12T00:35:43.942454+0000","last_became_peered":"2024-09-12T00:35:43.942454+0000","last_unstale":"2024-09-12T01:21:57.815595+0000","last_undegraded":"2024-09-12T01:21:57.815595+0000","last_fullsized":"2024-09-12T01:21:57.815595+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:18.360119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":618,"num_read_kb":3434,"num_write":1027,"num_write_kb":23754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:35.558281+0000","last_change":"2024-09-12T00:35:47.942488+0000","last_active":"2024-09-12T01:18:35.558281+0000","last_peered":"2024-09-12T01:18:35.558281+0000","last_clean":"2024-09-12T01:18:35.558281+0000","last_became_active":"2024-09-12T00:35:47.942189+0000","last_became_peered":"2024-09-12T00:35:47.942189+0000","last_unstale":"2024-09-12T01:18:35.558281+0000","last_undegraded":"2024-09-12T01:18:35.558281+0000","last_fullsized":"2024-09-12T01:18:35.558281+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:52.594512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'318","reported_seq":913,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.738514+0000","last_change":"2024-09-12T00:35:49.943225+0000","last_active":"2024-09-12T01:21:56.738514+0000","last_peered":"2024-09-12T01:21:56.738514+0000","last_clean":"2024-09-12T01:21:56.738514+0000","last_became_active":"2024-09-12T00:35:49.942480+0000","last_became_peered":"2024-09-12T00:35:49.942480+0000","last_unstale":"2024-09-12T01:21:56.738514+0000","last_undegraded":"2024-09-12T01:21:56.738514+0000","last_fullsized":"2024-09-12T01:21:56.738514+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:22.668385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48782,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":529,"num_read_kb":1149,"num_write":428,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'772","reported_seq":2437,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.510993+0000","last_change":"2024-09-12T00:35:51.985725+0000","last_active":"2024-09-12T01:21:56.510993+0000","last_peered":"2024-09-12T01:21:56.510993+0000","last_clean":"2024-09-12T01:21:56.510993+0000","last_became_active":"2024-09-12T00:35:51.984968+0000","last_became_peered":"2024-09-12T00:35:51.984968+0000","last_unstale":"2024-09-12T01:21:56.510993+0000","last_undegraded":"2024-09-12T01:21:56.510993+0000","last_fullsized":"2024-09-12T01:21:56.510993+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:26.578990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'109","reported_seq":600,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:24.451554+0000","last_change":"2024-09-12T00:35:53.995319+0000","last_active":"2024-09-12T01:21:24.451554+0000","last_peered":"2024-09-12T01:21:24.451554+0000","last_clean":"2024-09-12T01:21:24.451554+0000","last_became_active":"2024-09-12T00:35:53.992664+0000","last_became_peered":"2024-09-12T00:35:53.992664+0000","last_unstale":"2024-09-12T01:21:24.451554+0000","last_undegraded":"2024-09-12T01:21:24.451554+0000","last_fullsized":"2024-09-12T01:21:24.451554+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:16.209394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":110,"num_write":262,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'190","reported_seq":797,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:01.759116+0000","last_change":"2024-09-12T00:35:45.940151+0000","last_active":"2024-09-12T01:19:01.759116+0000","last_peered":"2024-09-12T01:19:01.759116+0000","last_clean":"2024-09-12T01:19:01.759116+0000","last_became_active":"2024-09-12T00:35:45.939817+0000","last_became_peered":"2024-09-12T00:35:45.939817+0000","last_unstale":"2024-09-12T01:19:01.759116+0000","last_undegraded":"2024-09-12T01:19:01.759116+0000","last_fullsized":"2024-09-12T01:19:01.759116+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:58.194408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":809,"num_read_kb":663,"num_write":268,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'359","reported_seq":1013,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.869525+0000","last_change":"2024-09-12T00:35:43.913025+0000","last_active":"2024-09-12T01:21:57.869525+0000","last_peered":"2024-09-12T01:21:57.869525+0000","last_clean":"2024-09-12T01:21:57.869525+0000","last_became_active":"2024-09-12T00:35:43.912282+0000","last_became_peered":"2024-09-12T00:35:43.912282+0000","last_unstale":"2024-09-12T01:21:57.869525+0000","last_undegraded":"2024-09-12T01:21:57.869525+0000","last_fullsized":"2024-09-12T01:21:57.869525+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:35.570049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6327796,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":526,"num_read_kb":19021,"num_write":1167,"num_write_kb":32789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:20.568395+0000","last_change":"2024-09-12T00:35:47.947337+0000","last_active":"2024-09-12T01:19:20.568395+0000","last_peered":"2024-09-12T01:19:20.568395+0000","last_clean":"2024-09-12T01:19:20.568395+0000","last_became_active":"2024-09-12T00:35:47.946636+0000","last_became_peered":"2024-09-12T00:35:47.946636+0000","last_unstale":"2024-09-12T01:19:20.568395+0000","last_undegraded":"2024-09-12T01:19:20.568395+0000","last_fullsized":"2024-09-12T01:19:20.568395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:32.769942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'509","reported_seq":1146,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.273493+0000","last_change":"2024-09-12T00:35:49.951472+0000","last_active":"2024-09-12T01:21:57.273493+0000","last_peered":"2024-09-12T01:21:57.273493+0000","last_clean":"2024-09-12T01:21:57.273493+0000","last_became_active":"2024-09-12T00:35:49.950845+0000","last_became_peered":"2024-09-12T00:35:49.950845+0000","last_unstale":"2024-09-12T01:21:57.273493+0000","last_undegraded":"2024-09-12T01:21:57.273493+0000","last_fullsized":"2024-09-12T01:21:57.273493+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:03.493730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100676,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":870,"num_read_kb":2075,"num_write":716,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:15.567238+0000","last_change":"2024-09-12T00:35:51.979349+0000","last_active":"2024-09-12T01:19:15.567238+0000","last_peered":"2024-09-12T01:19:15.567238+0000","last_clean":"2024-09-12T01:19:15.567238+0000","last_became_active":"2024-09-12T00:35:51.978188+0000","last_became_peered":"2024-09-12T00:35:51.978188+0000","last_unstale":"2024-09-12T01:19:15.567238+0000","last_undegraded":"2024-09-12T01:19:15.567238+0000","last_fullsized":"2024-09-12T01:19:15.567238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:57.588270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'133","reported_seq":651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:07.813191+0000","last_change":"2024-09-12T00:35:53.986321+0000","last_active":"2024-09-12T01:20:07.813191+0000","last_peered":"2024-09-12T01:20:07.813191+0000","last_clean":"2024-09-12T01:20:07.813191+0000","last_became_active":"2024-09-12T00:35:53.985635+0000","last_became_peered":"2024-09-12T00:35:53.985635+0000","last_unstale":"2024-09-12T01:20:07.813191+0000","last_undegraded":"2024-09-12T01:20:07.813191+0000","last_fullsized":"2024-09-12T01:20:07.813191+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:38.196418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":203,"num_read_kb":181,"num_write":311,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'153","reported_seq":748,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:32.742795+0000","last_change":"2024-09-12T00:35:45.938944+0000","last_active":"2024-09-12T01:18:32.742795+0000","last_peered":"2024-09-12T01:18:32.742795+0000","last_clean":"2024-09-12T01:18:32.742795+0000","last_became_active":"2024-09-12T00:35:45.938135+0000","last_became_peered":"2024-09-12T00:35:45.938135+0000","last_unstale":"2024-09-12T01:18:32.742795+0000","last_undegraded":"2024-09-12T01:18:32.742795+0000","last_fullsized":"2024-09-12T01:18:32.742795+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:04.224264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":684,"num_read_kb":556,"num_write":242,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'379","reported_seq":1017,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.851838+0000","last_change":"2024-09-12T00:35:43.939014+0000","last_active":"2024-09-12T01:21:57.851838+0000","last_peered":"2024-09-12T01:21:57.851838+0000","last_clean":"2024-09-12T01:21:57.851838+0000","last_became_active":"2024-09-12T00:35:43.936713+0000","last_became_peered":"2024-09-12T00:35:43.936713+0000","last_unstale":"2024-09-12T01:21:57.851838+0000","last_undegraded":"2024-09-12T01:21:57.851838+0000","last_fullsized":"2024-09-12T01:21:57.851838+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:51.023354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730170,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":551,"num_read_kb":26422,"num_write":1213,"num_write_kb":29680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:35.558367+0000","last_change":"2024-09-12T00:35:47.939169+0000","last_active":"2024-09-12T01:18:35.558367+0000","last_peered":"2024-09-12T01:18:35.558367+0000","last_clean":"2024-09-12T01:18:35.558367+0000","last_became_active":"2024-09-12T00:35:47.938604+0000","last_became_peered":"2024-09-12T00:35:47.938604+0000","last_unstale":"2024-09-12T01:18:35.558367+0000","last_undegraded":"2024-09-12T01:18:35.558367+0000","last_fullsized":"2024-09-12T01:18:35.558367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:16.268476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'307","reported_seq":890,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.303125+0000","last_change":"2024-09-12T00:35:49.941521+0000","last_active":"2024-09-12T01:21:57.303125+0000","last_peered":"2024-09-12T01:21:57.303125+0000","last_clean":"2024-09-12T01:21:57.303125+0000","last_became_active":"2024-09-12T00:35:49.940679+0000","last_became_peered":"2024-09-12T00:35:49.940679+0000","last_unstale":"2024-09-12T01:21:57.303125+0000","last_undegraded":"2024-09-12T01:21:57.303125+0000","last_fullsized":"2024-09-12T01:21:57.303125+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:45.183044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52849,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":502,"num_read_kb":1074,"num_write":450,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":483,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:48.567233+0000","last_change":"2024-09-12T00:35:51.978558+0000","last_active":"2024-09-12T01:18:48.567233+0000","last_peered":"2024-09-12T01:18:48.567233+0000","last_clean":"2024-09-12T01:18:48.567233+0000","last_became_active":"2024-09-12T00:35:51.977807+0000","last_became_peered":"2024-09-12T00:35:51.977807+0000","last_unstale":"2024-09-12T01:18:48.567233+0000","last_undegraded":"2024-09-12T01:18:48.567233+0000","last_fullsized":"2024-09-12T01:18:48.567233+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:54.797988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'99","reported_seq":602,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:03.604948+0000","last_change":"2024-09-12T00:35:54.003890+0000","last_active":"2024-09-12T01:20:03.604948+0000","last_peered":"2024-09-12T01:20:03.604948+0000","last_clean":"2024-09-12T01:20:03.604948+0000","last_became_active":"2024-09-12T00:35:54.003115+0000","last_became_peered":"2024-09-12T00:35:54.003115+0000","last_unstale":"2024-09-12T01:20:03.604948+0000","last_undegraded":"2024-09-12T01:20:03.604948+0000","last_fullsized":"2024-09-12T01:20:03.604948+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:19.982476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":131,"num_write":237,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'498","reported_seq":1281,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.989879+0000","last_change":"2024-09-12T00:35:45.930828+0000","last_active":"2024-09-12T01:20:22.989879+0000","last_peered":"2024-09-12T01:20:22.989879+0000","last_clean":"2024-09-12T01:20:22.989879+0000","last_became_active":"2024-09-12T00:35:45.929526+0000","last_became_peered":"2024-09-12T00:35:45.929526+0000","last_unstale":"2024-09-12T01:20:22.989879+0000","last_undegraded":"2024-09-12T01:20:22.989879+0000","last_fullsized":"2024-09-12T01:20:22.989879+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:44.529056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2425,"num_read_kb":2075,"num_write":878,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'252","reported_seq":840,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.396738+0000","last_change":"2024-09-12T00:35:43.945078+0000","last_active":"2024-09-12T01:21:57.396738+0000","last_peered":"2024-09-12T01:21:57.396738+0000","last_clean":"2024-09-12T01:21:57.396738+0000","last_became_active":"2024-09-12T00:35:43.944483+0000","last_became_peered":"2024-09-12T00:35:43.944483+0000","last_unstale":"2024-09-12T01:21:57.396738+0000","last_undegraded":"2024-09-12T01:21:57.396738+0000","last_fullsized":"2024-09-12T01:21:57.396738+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:23.857439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3310,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":333,"num_read_kb":347,"num_write":865,"num_write_kb":15629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:33.568409+0000","last_change":"2024-09-12T00:35:47.944100+0000","last_active":"2024-09-12T01:18:33.568409+0000","last_peered":"2024-09-12T01:18:33.568409+0000","last_clean":"2024-09-12T01:18:33.568409+0000","last_became_active":"2024-09-12T00:35:47.943382+0000","last_became_peered":"2024-09-12T00:35:47.943382+0000","last_unstale":"2024-09-12T01:18:33.568409+0000","last_undegraded":"2024-09-12T01:18:33.568409+0000","last_fullsized":"2024-09-12T01:18:33.568409+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:55.004421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'314","reported_seq":890,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:00.587241+0000","last_change":"2024-09-12T00:35:49.949821+0000","last_active":"2024-09-12T01:21:00.587241+0000","last_peered":"2024-09-12T01:21:00.587241+0000","last_clean":"2024-09-12T01:21:00.587241+0000","last_became_active":"2024-09-12T00:35:49.949283+0000","last_became_peered":"2024-09-12T00:35:49.949283+0000","last_unstale":"2024-09-12T01:21:00.587241+0000","last_undegraded":"2024-09-12T01:21:00.587241+0000","last_fullsized":"2024-09-12T01:21:00.587241+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:44.062401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64702,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":519,"num_read_kb":1067,"num_write":430,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'721","reported_seq":2252,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.385714+0000","last_change":"2024-09-12T00:35:51.979871+0000","last_active":"2024-09-12T01:21:25.385714+0000","last_peered":"2024-09-12T01:21:25.385714+0000","last_clean":"2024-09-12T01:21:25.385714+0000","last_became_active":"2024-09-12T00:35:51.979162+0000","last_became_peered":"2024-09-12T00:35:51.979162+0000","last_unstale":"2024-09-12T01:21:25.385714+0000","last_undegraded":"2024-09-12T01:21:25.385714+0000","last_fullsized":"2024-09-12T01:21:25.385714+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:24.612749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'115","reported_seq":603,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.981076+0000","last_change":"2024-09-12T00:35:53.982884+0000","last_active":"2024-09-12T01:20:22.981076+0000","last_peered":"2024-09-12T01:20:22.981076+0000","last_clean":"2024-09-12T01:20:22.981076+0000","last_became_active":"2024-09-12T00:35:53.981735+0000","last_became_peered":"2024-09-12T00:35:53.981735+0000","last_unstale":"2024-09-12T01:20:22.981076+0000","last_undegraded":"2024-09-12T01:20:22.981076+0000","last_fullsized":"2024-09-12T01:20:22.981076+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:48.987492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":92,"num_write":265,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'349","reported_seq":1039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:57.362515+0000","last_change":"2024-09-12T00:35:45.954531+0000","last_active":"2024-09-12T01:19:57.362515+0000","last_peered":"2024-09-12T01:19:57.362515+0000","last_clean":"2024-09-12T01:19:57.362515+0000","last_became_active":"2024-09-12T00:35:45.953935+0000","last_became_peered":"2024-09-12T00:35:45.953935+0000","last_unstale":"2024-09-12T01:19:57.362515+0000","last_undegraded":"2024-09-12T01:19:57.362515+0000","last_fullsized":"2024-09-12T01:19:57.362515+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:23.435584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1509,"num_read_kb":1228,"num_write":558,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'303","reported_seq":954,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.563583+0000","last_change":"2024-09-12T00:35:43.930345+0000","last_active":"2024-09-12T01:21:57.563583+0000","last_peered":"2024-09-12T01:21:57.563583+0000","last_clean":"2024-09-12T01:21:57.563583+0000","last_became_active":"2024-09-12T00:35:43.929559+0000","last_became_peered":"2024-09-12T00:35:43.929559+0000","last_unstale":"2024-09-12T01:21:57.563583+0000","last_undegraded":"2024-09-12T01:21:57.563583+0000","last_fullsized":"2024-09-12T01:21:57.563583+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:34.819090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7269752,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":431,"num_read_kb":47620,"num_write":909,"num_write_kb":27870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1462,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.247461+0000","last_change":"2024-09-12T00:35:47.936838+0000","last_active":"2024-09-12T01:21:56.247461+0000","last_peered":"2024-09-12T01:21:56.247461+0000","last_clean":"2024-09-12T01:21:56.247461+0000","last_became_active":"2024-09-12T00:35:47.936026+0000","last_became_peered":"2024-09-12T00:35:47.936026+0000","last_unstale":"2024-09-12T01:21:56.247461+0000","last_undegraded":"2024-09-12T01:21:56.247461+0000","last_fullsized":"2024-09-12T01:21:56.247461+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:42.930790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":965,"num_read_kb":965,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'80","reported_seq":595,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:51.233520+0000","last_change":"2024-09-12T00:35:50.027677+0000","last_active":"2024-09-12T01:18:51.233520+0000","last_peered":"2024-09-12T01:18:51.233520+0000","last_clean":"2024-09-12T01:18:51.233520+0000","last_became_active":"2024-09-12T00:35:50.027161+0000","last_became_peered":"2024-09-12T00:35:50.027161+0000","last_unstale":"2024-09-12T01:18:51.233520+0000","last_undegraded":"2024-09-12T01:18:51.233520+0000","last_fullsized":"2024-09-12T01:18:51.233520+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:29.997291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'772","reported_seq":6317,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.498244+0000","last_change":"2024-09-12T00:35:51.977887+0000","last_active":"2024-09-12T01:21:56.498244+0000","last_peered":"2024-09-12T01:21:56.498244+0000","last_clean":"2024-09-12T01:21:56.498244+0000","last_became_active":"2024-09-12T00:35:51.976947+0000","last_became_peered":"2024-09-12T00:35:51.976947+0000","last_unstale":"2024-09-12T01:21:56.498244+0000","last_undegraded":"2024-09-12T01:21:56.498244+0000","last_fullsized":"2024-09-12T01:21:56.498244+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:41.190642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'156","reported_seq":653,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:03.702547+0000","last_change":"2024-09-12T00:35:53.995354+0000","last_active":"2024-09-12T01:20:03.702547+0000","last_peered":"2024-09-12T01:20:03.702547+0000","last_clean":"2024-09-12T01:20:03.702547+0000","last_became_active":"2024-09-12T00:35:53.994715+0000","last_became_peered":"2024-09-12T00:35:53.994715+0000","last_unstale":"2024-09-12T01:20:03.702547+0000","last_undegraded":"2024-09-12T01:20:03.702547+0000","last_fullsized":"2024-09-12T01:20:03.702547+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:57.399598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":132,"num_read_kb":125,"num_write":372,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'158","reported_seq":698,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:58.526770+0000","last_change":"2024-09-12T00:36:17.050284+0000","last_active":"2024-09-12T01:20:58.526770+0000","last_peered":"2024-09-12T01:20:58.526770+0000","last_clean":"2024-09-12T01:20:58.526770+0000","last_became_active":"2024-09-12T00:36:17.049999+0000","last_became_peered":"2024-09-12T00:36:17.049999+0000","last_unstale":"2024-09-12T01:20:58.526770+0000","last_undegraded":"2024-09-12T01:20:58.526770+0000","last_fullsized":"2024-09-12T01:20:58.526770+0000","mapping_epoch":37,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:09.446877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":667,"num_read_kb":538,"num_write":243,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"265'359","reported_seq":1110,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.839026+0000","last_change":"2024-09-12T00:35:43.931842+0000","last_active":"2024-09-12T01:21:57.839026+0000","last_peered":"2024-09-12T01:21:57.839026+0000","last_clean":"2024-09-12T01:21:57.839026+0000","last_became_active":"2024-09-12T00:35:43.931562+0000","last_became_peered":"2024-09-12T00:35:43.931562+0000","last_unstale":"2024-09-12T01:21:57.839026+0000","last_undegraded":"2024-09-12T01:21:57.839026+0000","last_fullsized":"2024-09-12T01:21:57.839026+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:22.693505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992276,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":678,"num_read_kb":113913,"num_write":1161,"num_write_kb":34109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:32.742956+0000","last_change":"2024-09-12T00:35:47.930885+0000","last_active":"2024-09-12T01:18:32.742956+0000","last_peered":"2024-09-12T01:18:32.742956+0000","last_clean":"2024-09-12T01:18:32.742956+0000","last_became_active":"2024-09-12T00:35:47.930147+0000","last_became_peered":"2024-09-12T00:35:47.930147+0000","last_unstale":"2024-09-12T01:18:32.742956+0000","last_undegraded":"2024-09-12T01:18:32.742956+0000","last_fullsized":"2024-09-12T01:18:32.742956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:58.003654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'345","reported_seq":948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.771341+0000","last_change":"2024-09-12T00:35:49.939362+0000","last_active":"2024-09-12T01:21:57.771341+0000","last_peered":"2024-09-12T01:21:57.771341+0000","last_clean":"2024-09-12T01:21:57.771341+0000","last_became_active":"2024-09-12T00:35:49.938597+0000","last_became_peered":"2024-09-12T00:35:49.938597+0000","last_unstale":"2024-09-12T01:21:57.771341+0000","last_undegraded":"2024-09-12T01:21:57.771341+0000","last_fullsized":"2024-09-12T01:21:57.771341+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.934056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46738,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":571,"num_read_kb":1203,"num_write":454,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:37.551187+0000","last_change":"2024-09-12T00:35:51.968545+0000","last_active":"2024-09-12T01:18:37.551187+0000","last_peered":"2024-09-12T01:18:37.551187+0000","last_clean":"2024-09-12T01:18:37.551187+0000","last_became_active":"2024-09-12T00:35:51.967708+0000","last_became_peered":"2024-09-12T00:35:51.967708+0000","last_unstale":"2024-09-12T01:18:37.551187+0000","last_undegraded":"2024-09-12T01:18:37.551187+0000","last_fullsized":"2024-09-12T01:18:37.551187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:40.081105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'116","reported_seq":605,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:38.582809+0000","last_change":"2024-09-12T00:35:53.998562+0000","last_active":"2024-09-12T01:19:38.582809+0000","last_peered":"2024-09-12T01:19:38.582809+0000","last_clean":"2024-09-12T01:19:38.582809+0000","last_became_active":"2024-09-12T00:35:53.997893+0000","last_became_peered":"2024-09-12T00:35:53.997893+0000","last_unstale":"2024-09-12T01:19:38.582809+0000","last_undegraded":"2024-09-12T01:19:38.582809+0000","last_fullsized":"2024-09-12T01:19:38.582809+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:57.696902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":114,"num_write":260,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'95","reported_seq":679,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.563475+0000","last_change":"2024-09-12T00:35:45.945106+0000","last_active":"2024-09-12T01:19:37.563475+0000","last_peered":"2024-09-12T01:19:37.563475+0000","last_clean":"2024-09-12T01:19:37.563475+0000","last_became_active":"2024-09-12T00:35:45.941291+0000","last_became_peered":"2024-09-12T00:35:45.941291+0000","last_unstale":"2024-09-12T01:19:37.563475+0000","last_undegraded":"2024-09-12T01:19:37.563475+0000","last_fullsized":"2024-09-12T01:19:37.563475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:41.263421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":459,"num_read_kb":386,"num_write":145,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":611,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.797702+0000","last_change":"2024-09-12T00:35:25.098793+0000","last_active":"2024-09-12T01:19:32.797702+0000","last_peered":"2024-09-12T01:19:32.797702+0000","last_clean":"2024-09-12T01:19:32.797702+0000","last_became_active":"2024-09-12T00:35:25.096843+0000","last_became_peered":"2024-09-12T00:35:25.096843+0000","last_unstale":"2024-09-12T01:19:32.797702+0000","last_undegraded":"2024-09-12T01:19:32.797702+0000","last_fullsized":"2024-09-12T01:19:32.797702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:23.614097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:23.614097+0000","last_clean_scrub_stamp":"2024-09-12T00:35:23.614097+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:42.023728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.566130+0000","last_change":"2024-09-12T00:35:31.691879+0000","last_active":"2024-09-12T01:19:18.566130+0000","last_peered":"2024-09-12T01:19:18.566130+0000","last_clean":"2024-09-12T01:19:18.566130+0000","last_became_active":"2024-09-12T00:35:29.668145+0000","last_became_peered":"2024-09-12T00:35:29.668145+0000","last_unstale":"2024-09-12T01:19:18.566130+0000","last_undegraded":"2024-09-12T01:19:18.566130+0000","last_fullsized":"2024-09-12T01:19:18.566130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:18.650004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011070749999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'319","reported_seq":978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.852317+0000","last_change":"2024-09-12T00:35:43.920876+0000","last_active":"2024-09-12T01:21:57.852317+0000","last_peered":"2024-09-12T01:21:57.852317+0000","last_clean":"2024-09-12T01:21:57.852317+0000","last_became_active":"2024-09-12T00:35:43.916969+0000","last_became_peered":"2024-09-12T00:35:43.916969+0000","last_unstale":"2024-09-12T01:21:57.852317+0000","last_undegraded":"2024-09-12T01:21:57.852317+0000","last_fullsized":"2024-09-12T01:21:57.852317+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:16.584205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568993,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":119474,"num_write":1014,"num_write_kb":17296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.797857+0000","last_change":"2024-09-12T00:35:47.944667+0000","last_active":"2024-09-12T01:19:32.797857+0000","last_peered":"2024-09-12T01:19:32.797857+0000","last_clean":"2024-09-12T01:19:32.797857+0000","last_became_active":"2024-09-12T00:35:47.942643+0000","last_became_peered":"2024-09-12T00:35:47.942643+0000","last_unstale":"2024-09-12T01:19:32.797857+0000","last_undegraded":"2024-09-12T01:19:32.797857+0000","last_fullsized":"2024-09-12T01:19:32.797857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:06.078372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'696","reported_seq":1403,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.838470+0000","last_change":"2024-09-12T00:35:49.958641+0000","last_active":"2024-09-12T01:21:57.838470+0000","last_peered":"2024-09-12T01:21:57.838470+0000","last_clean":"2024-09-12T01:21:57.838470+0000","last_became_active":"2024-09-12T00:35:49.957694+0000","last_became_peered":"2024-09-12T00:35:49.957694+0000","last_unstale":"2024-09-12T01:21:57.838470+0000","last_undegraded":"2024-09-12T01:21:57.838470+0000","last_fullsized":"2024-09-12T01:21:57.838470+0000","mapping_epoch":30,"log_start":"265'600","ondisk_log_start":"265'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:23.494190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144071,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1382,"num_read_kb":3079,"num_write":1308,"num_write_kb":1154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:13.573190+0000","last_change":"2024-09-12T00:35:51.978016+0000","last_active":"2024-09-12T01:19:13.573190+0000","last_peered":"2024-09-12T01:19:13.573190+0000","last_clean":"2024-09-12T01:19:13.573190+0000","last_became_active":"2024-09-12T00:35:51.977282+0000","last_became_peered":"2024-09-12T00:35:51.977282+0000","last_unstale":"2024-09-12T01:19:13.573190+0000","last_undegraded":"2024-09-12T01:19:13.573190+0000","last_fullsized":"2024-09-12T01:19:13.573190+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:23.231926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'206","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.003775+0000","last_change":"2024-09-12T00:35:53.998069+0000","last_active":"2024-09-12T01:20:23.003775+0000","last_peered":"2024-09-12T01:20:23.003775+0000","last_clean":"2024-09-12T01:20:23.003775+0000","last_became_active":"2024-09-12T00:35:53.997354+0000","last_became_peered":"2024-09-12T00:35:53.997354+0000","last_unstale":"2024-09-12T01:20:23.003775+0000","last_undegraded":"2024-09-12T01:20:23.003775+0000","last_fullsized":"2024-09-12T01:20:23.003775+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:55.234664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":471,"num_write":454,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'239","reported_seq":897,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:02.408975+0000","last_change":"2024-09-12T00:35:45.946145+0000","last_active":"2024-09-12T01:20:02.408975+0000","last_peered":"2024-09-12T01:20:02.408975+0000","last_clean":"2024-09-12T01:20:02.408975+0000","last_became_active":"2024-09-12T00:35:45.945766+0000","last_became_peered":"2024-09-12T00:35:45.945766+0000","last_unstale":"2024-09-12T01:20:02.408975+0000","last_undegraded":"2024-09-12T01:20:02.408975+0000","last_fullsized":"2024-09-12T01:20:02.408975+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:50.991641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1032,"num_read_kb":857,"num_write":339,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.798875+0000","last_change":"2024-09-12T00:35:31.861888+0000","last_active":"2024-09-12T01:19:37.798875+0000","last_peered":"2024-09-12T01:19:37.798875+0000","last_clean":"2024-09-12T01:19:37.798875+0000","last_became_active":"2024-09-12T00:35:29.671287+0000","last_became_peered":"2024-09-12T00:35:29.671287+0000","last_unstale":"2024-09-12T01:19:37.798875+0000","last_undegraded":"2024-09-12T01:19:37.798875+0000","last_fullsized":"2024-09-12T01:19:37.798875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:47.739072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075002000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'397","reported_seq":1106,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.869110+0000","last_change":"2024-09-12T00:35:43.945658+0000","last_active":"2024-09-12T01:21:57.869110+0000","last_peered":"2024-09-12T01:21:57.869110+0000","last_clean":"2024-09-12T01:21:57.869110+0000","last_became_active":"2024-09-12T00:35:43.945335+0000","last_became_peered":"2024-09-12T00:35:43.945335+0000","last_unstale":"2024-09-12T01:21:57.869110+0000","last_undegraded":"2024-09-12T01:21:57.869110+0000","last_fullsized":"2024-09-12T01:21:57.869110+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:30.924593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":682,"num_read_kb":63013,"num_write":1485,"num_write_kb":40970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.563896+0000","last_change":"2024-09-12T00:35:47.926465+0000","last_active":"2024-09-12T01:19:08.563896+0000","last_peered":"2024-09-12T01:19:08.563896+0000","last_clean":"2024-09-12T01:19:08.563896+0000","last_became_active":"2024-09-12T00:35:47.925704+0000","last_became_peered":"2024-09-12T00:35:47.925704+0000","last_unstale":"2024-09-12T01:19:08.563896+0000","last_undegraded":"2024-09-12T01:19:08.563896+0000","last_fullsized":"2024-09-12T01:19:08.563896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:53.561342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1262","reported_seq":2757,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.811770+0000","last_change":"2024-09-12T00:35:49.948152+0000","last_active":"2024-09-12T01:21:57.811770+0000","last_peered":"2024-09-12T01:21:57.811770+0000","last_clean":"2024-09-12T01:21:57.811770+0000","last_became_active":"2024-09-12T00:35:49.947643+0000","last_became_peered":"2024-09-12T00:35:49.947643+0000","last_unstale":"2024-09-12T01:21:57.811770+0000","last_undegraded":"2024-09-12T01:21:57.811770+0000","last_fullsized":"2024-09-12T01:21:57.811770+0000","mapping_epoch":30,"log_start":"265'1200","ondisk_log_start":"265'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":1200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:30.009318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144243,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2043,"num_read_kb":3859,"num_write":1128,"num_write_kb":966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:42.800216+0000","last_change":"2024-09-12T00:35:51.981967+0000","last_active":"2024-09-12T01:19:42.800216+0000","last_peered":"2024-09-12T01:19:42.800216+0000","last_clean":"2024-09-12T01:19:42.800216+0000","last_became_active":"2024-09-12T00:35:51.981240+0000","last_became_peered":"2024-09-12T00:35:51.981240+0000","last_unstale":"2024-09-12T01:19:42.800216+0000","last_undegraded":"2024-09-12T01:19:42.800216+0000","last_fullsized":"2024-09-12T01:19:42.800216+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:42.148309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'135","reported_seq":643,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.074739+0000","last_change":"2024-09-12T00:35:54.014383+0000","last_active":"2024-09-12T01:20:23.074739+0000","last_peered":"2024-09-12T01:20:23.074739+0000","last_clean":"2024-09-12T01:20:23.074739+0000","last_became_active":"2024-09-12T00:35:54.013658+0000","last_became_peered":"2024-09-12T00:35:54.013658+0000","last_unstale":"2024-09-12T01:20:23.074739+0000","last_undegraded":"2024-09-12T01:20:23.074739+0000","last_fullsized":"2024-09-12T01:20:23.074739+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:12.904906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":184,"num_read_kb":167,"num_write":336,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'141","reported_seq":771,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:42.252694+0000","last_change":"2024-09-12T00:35:45.929654+0000","last_active":"2024-09-12T01:19:42.252694+0000","last_peered":"2024-09-12T01:19:42.252694+0000","last_clean":"2024-09-12T01:19:42.252694+0000","last_became_active":"2024-09-12T00:35:45.929073+0000","last_became_peered":"2024-09-12T00:35:45.929073+0000","last_unstale":"2024-09-12T01:19:42.252694+0000","last_undegraded":"2024-09-12T01:19:42.252694+0000","last_fullsized":"2024-09-12T01:19:42.252694+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:33.683146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":635,"num_read_kb":540,"num_write":217,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:15.567287+0000","last_change":"2024-09-12T00:35:31.904599+0000","last_active":"2024-09-12T01:19:15.567287+0000","last_peered":"2024-09-12T01:19:15.567287+0000","last_clean":"2024-09-12T01:19:15.567287+0000","last_became_active":"2024-09-12T00:35:29.699432+0000","last_became_peered":"2024-09-12T00:35:29.699432+0000","last_unstale":"2024-09-12T01:19:15.567287+0000","last_undegraded":"2024-09-12T01:19:15.567287+0000","last_fullsized":"2024-09-12T01:19:15.567287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:03.035417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099979400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'343","reported_seq":985,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.827966+0000","last_change":"2024-09-12T00:35:43.929255+0000","last_active":"2024-09-12T01:21:57.827966+0000","last_peered":"2024-09-12T01:21:57.827966+0000","last_clean":"2024-09-12T01:21:57.827966+0000","last_became_active":"2024-09-12T00:35:43.928667+0000","last_became_peered":"2024-09-12T00:35:43.928667+0000","last_unstale":"2024-09-12T01:21:57.827966+0000","last_undegraded":"2024-09-12T01:21:57.827966+0000","last_fullsized":"2024-09-12T01:21:57.827966+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:17.228103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174664,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":503,"num_read_kb":16533,"num_write":1052,"num_write_kb":18962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:10.566295+0000","last_change":"2024-09-12T00:35:47.945027+0000","last_active":"2024-09-12T01:19:10.566295+0000","last_peered":"2024-09-12T01:19:10.566295+0000","last_clean":"2024-09-12T01:19:10.566295+0000","last_became_active":"2024-09-12T00:35:47.944385+0000","last_became_peered":"2024-09-12T00:35:47.944385+0000","last_unstale":"2024-09-12T01:19:10.566295+0000","last_undegraded":"2024-09-12T01:19:10.566295+0000","last_fullsized":"2024-09-12T01:19:10.566295+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:59.954589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'226","reported_seq":1321,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.532346+0000","last_change":"2024-09-12T00:35:50.026399+0000","last_active":"2024-09-12T01:21:25.532346+0000","last_peered":"2024-09-12T01:21:25.532346+0000","last_clean":"2024-09-12T01:21:25.532346+0000","last_became_active":"2024-09-12T00:35:50.025610+0000","last_became_peered":"2024-09-12T00:35:50.025610+0000","last_unstale":"2024-09-12T01:21:25.532346+0000","last_undegraded":"2024-09-12T01:21:25.532346+0000","last_fullsized":"2024-09-12T01:21:25.532346+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:54.581195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":183,"num_read_kb":174,"num_write":155,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:38.579276+0000","last_change":"2024-09-12T00:35:51.974368+0000","last_active":"2024-09-12T01:19:38.579276+0000","last_peered":"2024-09-12T01:19:38.579276+0000","last_clean":"2024-09-12T01:19:38.579276+0000","last_became_active":"2024-09-12T00:35:51.973593+0000","last_became_peered":"2024-09-12T00:35:51.973593+0000","last_unstale":"2024-09-12T01:19:38.579276+0000","last_undegraded":"2024-09-12T01:19:38.579276+0000","last_fullsized":"2024-09-12T01:19:38.579276+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:59.292452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'273","reported_seq":876,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.184767+0000","last_change":"2024-09-12T00:35:53.995709+0000","last_active":"2024-09-12T01:20:23.184767+0000","last_peered":"2024-09-12T01:20:23.184767+0000","last_clean":"2024-09-12T01:20:23.184767+0000","last_became_active":"2024-09-12T00:35:53.994828+0000","last_became_peered":"2024-09-12T00:35:53.994828+0000","last_unstale":"2024-09-12T01:20:23.184767+0000","last_undegraded":"2024-09-12T01:20:23.184767+0000","last_fullsized":"2024-09-12T01:20:23.184767+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:01.920282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":532,"num_read_kb":546,"num_write":608,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'101","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:33.581546+0000","last_change":"2024-09-12T00:35:45.933047+0000","last_active":"2024-09-12T01:19:33.581546+0000","last_peered":"2024-09-12T01:19:33.581546+0000","last_clean":"2024-09-12T01:19:33.581546+0000","last_became_active":"2024-09-12T00:35:45.932642+0000","last_became_peered":"2024-09-12T00:35:45.932642+0000","last_unstale":"2024-09-12T01:19:33.581546+0000","last_undegraded":"2024-09-12T01:19:33.581546+0000","last_fullsized":"2024-09-12T01:19:33.581546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:58.000694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":466,"num_read_kb":396,"num_write":153,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.566063+0000","last_change":"2024-09-12T00:35:31.692803+0000","last_active":"2024-09-12T01:19:18.566063+0000","last_peered":"2024-09-12T01:19:18.566063+0000","last_clean":"2024-09-12T01:19:18.566063+0000","last_became_active":"2024-09-12T00:35:29.664963+0000","last_became_peered":"2024-09-12T00:35:29.664963+0000","last_unstale":"2024-09-12T01:19:18.566063+0000","last_undegraded":"2024-09-12T01:19:18.566063+0000","last_fullsized":"2024-09-12T01:19:18.566063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:27.056845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020842569999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'274","reported_seq":944,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.563048+0000","last_change":"2024-09-12T00:35:43.931465+0000","last_active":"2024-09-12T01:21:57.563048+0000","last_peered":"2024-09-12T01:21:57.563048+0000","last_clean":"2024-09-12T01:21:57.563048+0000","last_became_active":"2024-09-12T00:35:43.930731+0000","last_became_peered":"2024-09-12T00:35:43.930731+0000","last_unstale":"2024-09-12T01:21:57.563048+0000","last_undegraded":"2024-09-12T01:21:57.563048+0000","last_fullsized":"2024-09-12T01:21:57.563048+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:34.455587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11182236,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":504,"num_read_kb":45060,"num_write":1079,"num_write_kb":33877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.580737+0000","last_change":"2024-09-12T00:35:47.939774+0000","last_active":"2024-09-12T01:19:43.580737+0000","last_peered":"2024-09-12T01:19:43.580737+0000","last_clean":"2024-09-12T01:19:43.580737+0000","last_became_active":"2024-09-12T00:35:47.939055+0000","last_became_peered":"2024-09-12T00:35:47.939055+0000","last_unstale":"2024-09-12T01:19:43.580737+0000","last_undegraded":"2024-09-12T01:19:43.580737+0000","last_fullsized":"2024-09-12T01:19:43.580737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:08.442651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'117","reported_seq":654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:23.406053+0000","last_change":"2024-09-12T00:35:49.952715+0000","last_active":"2024-09-12T01:21:23.406053+0000","last_peered":"2024-09-12T01:21:23.406053+0000","last_clean":"2024-09-12T01:21:23.406053+0000","last_became_active":"2024-09-12T00:35:49.948258+0000","last_became_peered":"2024-09-12T00:35:49.948258+0000","last_unstale":"2024-09-12T01:21:23.406053+0000","last_undegraded":"2024-09-12T01:21:23.406053+0000","last_fullsized":"2024-09-12T01:21:23.406053+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:13.173314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:12.558370+0000","last_change":"2024-09-12T00:35:51.975246+0000","last_active":"2024-09-12T01:19:12.558370+0000","last_peered":"2024-09-12T01:19:12.558370+0000","last_clean":"2024-09-12T01:19:12.558370+0000","last_became_active":"2024-09-12T00:35:51.974302+0000","last_became_peered":"2024-09-12T00:35:51.974302+0000","last_unstale":"2024-09-12T01:19:12.558370+0000","last_undegraded":"2024-09-12T01:19:12.558370+0000","last_fullsized":"2024-09-12T01:19:12.558370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:22.264781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'140","reported_seq":703,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:02.410395+0000","last_change":"2024-09-12T00:35:53.995956+0000","last_active":"2024-09-12T01:20:02.410395+0000","last_peered":"2024-09-12T01:20:02.410395+0000","last_clean":"2024-09-12T01:20:02.410395+0000","last_became_active":"2024-09-12T00:35:53.995254+0000","last_became_peered":"2024-09-12T00:35:53.995254+0000","last_unstale":"2024-09-12T01:20:02.410395+0000","last_undegraded":"2024-09-12T01:20:02.410395+0000","last_fullsized":"2024-09-12T01:20:02.410395+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:26.022607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1272,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":285,"num_read_kb":262,"num_write":355,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'53","reported_seq":591,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.121613+0000","last_change":"2024-09-12T00:35:45.936327+0000","last_active":"2024-09-12T01:19:37.121613+0000","last_peered":"2024-09-12T01:19:37.121613+0000","last_clean":"2024-09-12T01:19:37.121613+0000","last_became_active":"2024-09-12T00:35:45.936061+0000","last_became_peered":"2024-09-12T00:35:45.936061+0000","last_unstale":"2024-09-12T01:19:37.121613+0000","last_undegraded":"2024-09-12T01:19:37.121613+0000","last_fullsized":"2024-09-12T01:19:37.121613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:11.296362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":179,"num_write":83,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"265'349","reported_seq":1003,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.853709+0000","last_change":"2024-09-12T00:36:17.052149+0000","last_active":"2024-09-12T01:21:57.853709+0000","last_peered":"2024-09-12T01:21:57.853709+0000","last_clean":"2024-09-12T01:21:57.853709+0000","last_became_active":"2024-09-12T00:36:17.051542+0000","last_became_peered":"2024-09-12T00:36:17.051542+0000","last_unstale":"2024-09-12T01:21:57.853709+0000","last_undegraded":"2024-09-12T01:21:57.853709+0000","last_fullsized":"2024-09-12T01:21:57.853709+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:58.989806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730210,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":479,"num_read_kb":44411,"num_write":1031,"num_write_kb":33814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.578146+0000","last_change":"2024-09-12T00:35:31.699054+0000","last_active":"2024-09-12T01:19:18.578146+0000","last_peered":"2024-09-12T01:19:18.578146+0000","last_clean":"2024-09-12T01:19:18.578146+0000","last_became_active":"2024-09-12T00:35:29.700869+0000","last_became_peered":"2024-09-12T00:35:29.700869+0000","last_unstale":"2024-09-12T01:19:18.578146+0000","last_undegraded":"2024-09-12T01:19:18.578146+0000","last_fullsized":"2024-09-12T01:19:18.578146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:14.134437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099003299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"36'5","reported_seq":979,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.234521+0000","last_change":"2024-09-12T00:35:47.947133+0000","last_active":"2024-09-12T01:21:56.234521+0000","last_peered":"2024-09-12T01:21:56.234521+0000","last_clean":"2024-09-12T01:21:56.234521+0000","last_became_active":"2024-09-12T00:35:47.946690+0000","last_became_peered":"2024-09-12T00:35:47.946690+0000","last_unstale":"2024-09-12T01:21:56.234521+0000","last_undegraded":"2024-09-12T01:21:56.234521+0000","last_fullsized":"2024-09-12T01:21:56.234521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:37.935723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'570","reported_seq":1239,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.578410+0000","last_change":"2024-09-12T00:35:49.948760+0000","last_active":"2024-09-12T01:21:57.578410+0000","last_peered":"2024-09-12T01:21:57.578410+0000","last_clean":"2024-09-12T01:21:57.578410+0000","last_became_active":"2024-09-12T00:35:49.948095+0000","last_became_peered":"2024-09-12T00:35:49.948095+0000","last_unstale":"2024-09-12T01:21:57.578410+0000","last_undegraded":"2024-09-12T01:21:57.578410+0000","last_fullsized":"2024-09-12T01:21:57.578410+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":500,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:35.891225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93682,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1577,"num_read_kb":2692,"num_write":2050,"num_write_kb":1874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.556917+0000","last_change":"2024-09-12T00:35:51.968432+0000","last_active":"2024-09-12T01:19:37.556917+0000","last_peered":"2024-09-12T01:19:37.556917+0000","last_clean":"2024-09-12T01:19:37.556917+0000","last_became_active":"2024-09-12T00:35:51.967708+0000","last_became_peered":"2024-09-12T00:35:51.967708+0000","last_unstale":"2024-09-12T01:19:37.556917+0000","last_undegraded":"2024-09-12T01:19:37.556917+0000","last_fullsized":"2024-09-12T01:19:37.556917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:43.503668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'147","reported_seq":643,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:40.914651+0000","last_change":"2024-09-12T00:35:54.015204+0000","last_active":"2024-09-12T01:19:40.914651+0000","last_peered":"2024-09-12T01:19:40.914651+0000","last_clean":"2024-09-12T01:19:40.914651+0000","last_became_active":"2024-09-12T00:35:54.014321+0000","last_became_peered":"2024-09-12T00:35:54.014321+0000","last_unstale":"2024-09-12T01:19:40.914651+0000","last_undegraded":"2024-09-12T01:19:40.914651+0000","last_fullsized":"2024-09-12T01:19:40.914651+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:14.339505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":134,"num_write":336,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'165","reported_seq":787,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:33.578060+0000","last_change":"2024-09-12T00:35:45.936514+0000","last_active":"2024-09-12T01:19:33.578060+0000","last_peered":"2024-09-12T01:19:33.578060+0000","last_clean":"2024-09-12T01:19:33.578060+0000","last_became_active":"2024-09-12T00:35:45.936178+0000","last_became_peered":"2024-09-12T00:35:45.936178+0000","last_unstale":"2024-09-12T01:19:33.578060+0000","last_undegraded":"2024-09-12T01:19:33.578060+0000","last_fullsized":"2024-09-12T01:19:33.578060+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:06.218590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":595,"num_write":226,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'364","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.838928+0000","last_change":"2024-09-12T00:35:43.931012+0000","last_active":"2024-09-12T01:21:57.838928+0000","last_peered":"2024-09-12T01:21:57.838928+0000","last_clean":"2024-09-12T01:21:57.838928+0000","last_became_active":"2024-09-12T00:35:43.928834+0000","last_became_peered":"2024-09-12T00:35:43.928834+0000","last_unstale":"2024-09-12T01:21:57.838928+0000","last_undegraded":"2024-09-12T01:21:57.838928+0000","last_fullsized":"2024-09-12T01:21:57.838928+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:38.654576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262157,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":503,"num_read_kb":29317,"num_write":1237,"num_write_kb":48953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:22.795333+0000","last_change":"2024-09-12T00:35:31.861538+0000","last_active":"2024-09-12T01:19:22.795333+0000","last_peered":"2024-09-12T01:19:22.795333+0000","last_clean":"2024-09-12T01:19:22.795333+0000","last_became_active":"2024-09-12T00:35:29.697973+0000","last_became_peered":"2024-09-12T00:35:29.697973+0000","last_unstale":"2024-09-12T01:19:22.795333+0000","last_undegraded":"2024-09-12T01:19:22.795333+0000","last_fullsized":"2024-09-12T01:19:22.795333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:08.455168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083354399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.562424+0000","last_change":"2024-09-12T00:35:47.940734+0000","last_active":"2024-09-12T01:19:32.562424+0000","last_peered":"2024-09-12T01:19:32.562424+0000","last_clean":"2024-09-12T01:19:32.562424+0000","last_became_active":"2024-09-12T00:35:47.940014+0000","last_became_peered":"2024-09-12T00:35:47.940014+0000","last_unstale":"2024-09-12T01:19:32.562424+0000","last_undegraded":"2024-09-12T01:19:32.562424+0000","last_fullsized":"2024-09-12T01:19:32.562424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:23.603431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'186","reported_seq":750,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.995320+0000","last_change":"2024-09-12T00:35:50.029129+0000","last_active":"2024-09-12T01:20:22.995320+0000","last_peered":"2024-09-12T01:20:22.995320+0000","last_clean":"2024-09-12T01:20:22.995320+0000","last_became_active":"2024-09-12T00:35:50.028173+0000","last_became_peered":"2024-09-12T00:35:50.028173+0000","last_unstale":"2024-09-12T01:20:22.995320+0000","last_undegraded":"2024-09-12T01:20:22.995320+0000","last_fullsized":"2024-09-12T01:20:22.995320+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:11.842961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":223,"num_read_kb":207,"num_write":158,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'791","reported_seq":2678,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.492109+0000","last_change":"2024-09-12T00:35:51.977915+0000","last_active":"2024-09-12T01:21:56.492109+0000","last_peered":"2024-09-12T01:21:56.492109+0000","last_clean":"2024-09-12T01:21:56.492109+0000","last_became_active":"2024-09-12T00:35:51.977203+0000","last_became_peered":"2024-09-12T00:35:51.977203+0000","last_unstale":"2024-09-12T01:21:56.492109+0000","last_undegraded":"2024-09-12T01:21:56.492109+0000","last_fullsized":"2024-09-12T01:21:56.492109+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:06.229745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'110","reported_seq":608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:08.402637+0000","last_change":"2024-09-12T00:35:54.015222+0000","last_active":"2024-09-12T01:21:08.402637+0000","last_peered":"2024-09-12T01:21:08.402637+0000","last_clean":"2024-09-12T01:21:08.402637+0000","last_became_active":"2024-09-12T00:35:54.014699+0000","last_became_peered":"2024-09-12T00:35:54.014699+0000","last_unstale":"2024-09-12T01:21:08.402637+0000","last_undegraded":"2024-09-12T01:21:08.402637+0000","last_fullsized":"2024-09-12T01:21:08.402637+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:06.666673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1113,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":127,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'102","reported_seq":698,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.470217+0000","last_change":"2024-09-12T00:35:45.943991+0000","last_active":"2024-09-12T01:19:08.470217+0000","last_peered":"2024-09-12T01:19:08.470217+0000","last_clean":"2024-09-12T01:19:08.470217+0000","last_became_active":"2024-09-12T00:35:45.942032+0000","last_became_peered":"2024-09-12T00:35:45.942032+0000","last_unstale":"2024-09-12T01:19:08.470217+0000","last_undegraded":"2024-09-12T01:19:08.470217+0000","last_fullsized":"2024-09-12T01:19:08.470217+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:52.127080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":475,"num_read_kb":403,"num_write":145,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'318","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.845856+0000","last_change":"2024-09-12T00:35:43.954091+0000","last_active":"2024-09-12T01:21:57.845856+0000","last_peered":"2024-09-12T01:21:57.845856+0000","last_clean":"2024-09-12T01:21:57.845856+0000","last_became_active":"2024-09-12T00:35:43.953619+0000","last_became_peered":"2024-09-12T00:35:43.953619+0000","last_unstale":"2024-09-12T01:21:57.845856+0000","last_undegraded":"2024-09-12T01:21:57.845856+0000","last_fullsized":"2024-09-12T01:21:57.845856+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:57.329602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2238687,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":418,"num_read_kb":24307,"num_write":963,"num_write_kb":33018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":517,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:53.572551+0000","last_change":"2024-09-12T00:35:31.699143+0000","last_active":"2024-09-12T01:18:53.572551+0000","last_peered":"2024-09-12T01:18:53.572551+0000","last_clean":"2024-09-12T01:18:53.572551+0000","last_became_active":"2024-09-12T00:35:29.671727+0000","last_became_peered":"2024-09-12T00:35:29.671727+0000","last_unstale":"2024-09-12T01:18:53.572551+0000","last_undegraded":"2024-09-12T01:18:53.572551+0000","last_fullsized":"2024-09-12T01:18:53.572551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:24.616311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010553139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.555547+0000","last_change":"2024-09-12T00:35:47.937179+0000","last_active":"2024-09-12T01:19:32.555547+0000","last_peered":"2024-09-12T01:19:32.555547+0000","last_clean":"2024-09-12T01:19:32.555547+0000","last_became_active":"2024-09-12T00:35:47.936452+0000","last_became_peered":"2024-09-12T00:35:47.936452+0000","last_unstale":"2024-09-12T01:19:32.555547+0000","last_undegraded":"2024-09-12T01:19:32.555547+0000","last_fullsized":"2024-09-12T01:19:32.555547+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:33.795481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'113","reported_seq":658,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.557003+0000","last_change":"2024-09-12T00:35:49.941635+0000","last_active":"2024-09-12T01:19:37.557003+0000","last_peered":"2024-09-12T01:19:37.557003+0000","last_clean":"2024-09-12T01:19:37.557003+0000","last_became_active":"2024-09-12T00:35:49.940788+0000","last_became_peered":"2024-09-12T00:35:49.940788+0000","last_unstale":"2024-09-12T01:19:37.557003+0000","last_undegraded":"2024-09-12T01:19:37.557003+0000","last_fullsized":"2024-09-12T01:19:37.557003+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:50.095723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'789","reported_seq":2416,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.316325+0000","last_change":"2024-09-12T00:35:51.980717+0000","last_active":"2024-09-12T01:21:57.316325+0000","last_peered":"2024-09-12T01:21:57.316325+0000","last_clean":"2024-09-12T01:21:57.316325+0000","last_became_active":"2024-09-12T00:35:51.979997+0000","last_became_peered":"2024-09-12T00:35:51.979997+0000","last_unstale":"2024-09-12T01:21:57.316325+0000","last_undegraded":"2024-09-12T01:21:57.316325+0000","last_fullsized":"2024-09-12T01:21:57.316325+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:15.785752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'278","reported_seq":795,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:36.375145+0000","last_change":"2024-09-12T00:35:53.993708+0000","last_active":"2024-09-12T01:19:36.375145+0000","last_peered":"2024-09-12T01:19:36.375145+0000","last_clean":"2024-09-12T01:19:36.375145+0000","last_became_active":"2024-09-12T00:35:53.992431+0000","last_became_peered":"2024-09-12T00:35:53.992431+0000","last_unstale":"2024-09-12T01:19:36.375145+0000","last_undegraded":"2024-09-12T01:19:36.375145+0000","last_fullsized":"2024-09-12T01:19:36.375145+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:35.605076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":344,"num_read_kb":342,"num_write":602,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'372","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.555503+0000","last_change":"2024-09-12T00:35:45.929519+0000","last_active":"2024-09-12T01:19:32.555503+0000","last_peered":"2024-09-12T01:19:32.555503+0000","last_clean":"2024-09-12T01:19:32.555503+0000","last_became_active":"2024-09-12T00:35:45.928789+0000","last_became_peered":"2024-09-12T00:35:45.928789+0000","last_unstale":"2024-09-12T01:19:32.555503+0000","last_undegraded":"2024-09-12T01:19:32.555503+0000","last_fullsized":"2024-09-12T01:19:32.555503+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:09.582521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1634,"num_read_kb":1297,"num_write":639,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'360","reported_seq":1037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.826735+0000","last_change":"2024-09-12T00:35:43.933310+0000","last_active":"2024-09-12T01:21:57.826735+0000","last_peered":"2024-09-12T01:21:57.826735+0000","last_clean":"2024-09-12T01:21:57.826735+0000","last_became_active":"2024-09-12T00:35:43.932994+0000","last_became_peered":"2024-09-12T00:35:43.932994+0000","last_unstale":"2024-09-12T01:21:57.826735+0000","last_undegraded":"2024-09-12T01:21:57.826735+0000","last_fullsized":"2024-09-12T01:21:57.826735+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:30.435523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":624,"num_read_kb":1635,"num_write":1170,"num_write_kb":36329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:52.554359+0000","last_change":"2024-09-12T00:35:31.686791+0000","last_active":"2024-09-12T01:18:52.554359+0000","last_peered":"2024-09-12T01:18:52.554359+0000","last_clean":"2024-09-12T01:18:52.554359+0000","last_became_active":"2024-09-12T00:35:29.670571+0000","last_became_peered":"2024-09-12T00:35:29.670571+0000","last_unstale":"2024-09-12T01:18:52.554359+0000","last_undegraded":"2024-09-12T01:18:52.554359+0000","last_fullsized":"2024-09-12T01:18:52.554359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:53.106651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012596770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:58.574739+0000","last_change":"2024-09-12T00:35:47.934122+0000","last_active":"2024-09-12T01:17:58.574739+0000","last_peered":"2024-09-12T01:17:58.574739+0000","last_clean":"2024-09-12T01:17:58.574739+0000","last_became_active":"2024-09-12T00:35:47.933798+0000","last_became_peered":"2024-09-12T00:35:47.933798+0000","last_unstale":"2024-09-12T01:17:58.574739+0000","last_undegraded":"2024-09-12T01:17:58.574739+0000","last_fullsized":"2024-09-12T01:17:58.574739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:45.253346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'725","reported_seq":1449,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.696858+0000","last_change":"2024-09-12T00:35:50.029172+0000","last_active":"2024-09-12T01:21:57.696858+0000","last_peered":"2024-09-12T01:21:57.696858+0000","last_clean":"2024-09-12T01:21:57.696858+0000","last_became_active":"2024-09-12T00:35:50.028341+0000","last_became_peered":"2024-09-12T00:35:50.028341+0000","last_unstale":"2024-09-12T01:21:57.696858+0000","last_undegraded":"2024-09-12T01:21:57.696858+0000","last_fullsized":"2024-09-12T01:21:57.696858+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:00.896912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139080,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1312,"num_read_kb":3096,"num_write":1068,"num_write_kb":883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:38.599116+0000","last_change":"2024-09-12T00:35:51.975754+0000","last_active":"2024-09-12T01:19:38.599116+0000","last_peered":"2024-09-12T01:19:38.599116+0000","last_clean":"2024-09-12T01:19:38.599116+0000","last_became_active":"2024-09-12T00:35:51.974473+0000","last_became_peered":"2024-09-12T00:35:51.974473+0000","last_unstale":"2024-09-12T01:19:38.599116+0000","last_undegraded":"2024-09-12T01:19:38.599116+0000","last_fullsized":"2024-09-12T01:19:38.599116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:18.151442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'108","reported_seq":610,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:09.188058+0000","last_change":"2024-09-12T00:35:53.996281+0000","last_active":"2024-09-12T01:19:09.188058+0000","last_peered":"2024-09-12T01:19:09.188058+0000","last_clean":"2024-09-12T01:19:09.188058+0000","last_became_active":"2024-09-12T00:35:53.995431+0000","last_became_peered":"2024-09-12T00:35:53.995431+0000","last_unstale":"2024-09-12T01:19:09.188058+0000","last_undegraded":"2024-09-12T01:19:09.188058+0000","last_fullsized":"2024-09-12T01:19:09.188058+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:23.854939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":133,"num_write":267,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'116","reported_seq":666,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:24.501863+0000","last_change":"2024-09-12T00:35:54.003023+0000","last_active":"2024-09-12T01:21:24.501863+0000","last_peered":"2024-09-12T01:21:24.501863+0000","last_clean":"2024-09-12T01:21:24.501863+0000","last_became_active":"2024-09-12T00:35:54.002052+0000","last_became_peered":"2024-09-12T00:35:54.002052+0000","last_unstale":"2024-09-12T01:21:24.501863+0000","last_undegraded":"2024-09-12T01:21:24.501863+0000","last_fullsized":"2024-09-12T01:21:24.501863+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:18.230366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":193,"num_write":267,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'96","reported_seq":682,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.975864+0000","last_change":"2024-09-12T00:35:45.954536+0000","last_active":"2024-09-12T01:18:18.975864+0000","last_peered":"2024-09-12T01:18:18.975864+0000","last_clean":"2024-09-12T01:18:18.975864+0000","last_became_active":"2024-09-12T00:35:45.954079+0000","last_became_peered":"2024-09-12T00:35:45.954079+0000","last_unstale":"2024-09-12T01:18:18.975864+0000","last_undegraded":"2024-09-12T01:18:18.975864+0000","last_fullsized":"2024-09-12T01:18:18.975864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:37.716853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":455,"num_read_kb":391,"num_write":154,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'413","reported_seq":1111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.568960+0000","last_change":"2024-09-12T00:35:43.948592+0000","last_active":"2024-09-12T01:21:57.568960+0000","last_peered":"2024-09-12T01:21:57.568960+0000","last_clean":"2024-09-12T01:21:57.568960+0000","last_became_active":"2024-09-12T00:35:43.947940+0000","last_became_peered":"2024-09-12T00:35:43.947940+0000","last_unstale":"2024-09-12T01:21:57.568960+0000","last_undegraded":"2024-09-12T01:21:57.568960+0000","last_fullsized":"2024-09-12T01:21:57.568960+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:06.011716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5270410,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":777,"num_read_kb":4159,"num_write":1245,"num_write_kb":17308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:48.555127+0000","last_change":"2024-09-12T00:35:47.930161+0000","last_active":"2024-09-12T01:17:48.555127+0000","last_peered":"2024-09-12T01:17:48.555127+0000","last_clean":"2024-09-12T01:17:48.555127+0000","last_became_active":"2024-09-12T00:35:47.929844+0000","last_became_peered":"2024-09-12T00:35:47.929844+0000","last_unstale":"2024-09-12T01:17:48.555127+0000","last_undegraded":"2024-09-12T01:17:48.555127+0000","last_fullsized":"2024-09-12T01:17:48.555127+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:35.960740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'287","reported_seq":863,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.686059+0000","last_change":"2024-09-12T00:35:49.947886+0000","last_active":"2024-09-12T01:21:56.686059+0000","last_peered":"2024-09-12T01:21:56.686059+0000","last_clean":"2024-09-12T01:21:56.686059+0000","last_became_active":"2024-09-12T00:35:49.947136+0000","last_became_peered":"2024-09-12T00:35:49.947136+0000","last_unstale":"2024-09-12T01:21:56.686059+0000","last_undegraded":"2024-09-12T01:21:56.686059+0000","last_fullsized":"2024-09-12T01:21:56.686059+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:30.278867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43778,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":475,"num_read_kb":1081,"num_write":388,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:53.573483+0000","last_change":"2024-09-12T00:35:51.980791+0000","last_active":"2024-09-12T01:17:53.573483+0000","last_peered":"2024-09-12T01:17:53.573483+0000","last_clean":"2024-09-12T01:17:53.573483+0000","last_became_active":"2024-09-12T00:35:51.980092+0000","last_became_peered":"2024-09-12T00:35:51.980092+0000","last_unstale":"2024-09-12T01:17:53.573483+0000","last_undegraded":"2024-09-12T01:17:53.573483+0000","last_fullsized":"2024-09-12T01:17:53.573483+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:52.492457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'134","reported_seq":633,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:20.655512+0000","last_change":"2024-09-12T00:35:53.993259+0000","last_active":"2024-09-12T01:20:20.655512+0000","last_peered":"2024-09-12T01:20:20.655512+0000","last_clean":"2024-09-12T01:20:20.655512+0000","last_became_active":"2024-09-12T00:35:53.992579+0000","last_became_peered":"2024-09-12T00:35:53.992579+0000","last_unstale":"2024-09-12T01:20:20.655512+0000","last_undegraded":"2024-09-12T01:20:20.655512+0000","last_fullsized":"2024-09-12T01:20:20.655512+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:44.006963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":139,"num_write":341,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'161","reported_seq":745,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:03.701304+0000","last_change":"2024-09-12T00:35:45.958044+0000","last_active":"2024-09-12T01:20:03.701304+0000","last_peered":"2024-09-12T01:20:03.701304+0000","last_clean":"2024-09-12T01:20:03.701304+0000","last_became_active":"2024-09-12T00:35:45.957614+0000","last_became_peered":"2024-09-12T00:35:45.957614+0000","last_unstale":"2024-09-12T01:20:03.701304+0000","last_undegraded":"2024-09-12T01:20:03.701304+0000","last_fullsized":"2024-09-12T01:20:03.701304+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:29.459571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":661,"num_read_kb":539,"num_write":259,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'359","reported_seq":956,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.830383+0000","last_change":"2024-09-12T00:36:17.270183+0000","last_active":"2024-09-12T01:21:57.830383+0000","last_peered":"2024-09-12T01:21:57.830383+0000","last_clean":"2024-09-12T01:21:57.830383+0000","last_became_active":"2024-09-12T00:36:17.269377+0000","last_became_peered":"2024-09-12T00:36:17.269377+0000","last_unstale":"2024-09-12T01:21:57.830383+0000","last_undegraded":"2024-09-12T01:21:57.830383+0000","last_fullsized":"2024-09-12T01:21:57.830383+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:25.952652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":513,"num_read_kb":25436,"num_write":1264,"num_write_kb":33386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:48.572327+0000","last_change":"2024-09-12T00:35:47.941929+0000","last_active":"2024-09-12T01:17:48.572327+0000","last_peered":"2024-09-12T01:17:48.572327+0000","last_clean":"2024-09-12T01:17:48.572327+0000","last_became_active":"2024-09-12T00:35:47.941493+0000","last_became_peered":"2024-09-12T00:35:47.941493+0000","last_unstale":"2024-09-12T01:17:48.572327+0000","last_undegraded":"2024-09-12T01:17:48.572327+0000","last_fullsized":"2024-09-12T01:17:48.572327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:06.034904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'46","reported_seq":542,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:09.885099+0000","last_change":"2024-09-12T00:35:49.950088+0000","last_active":"2024-09-12T01:19:09.885099+0000","last_peered":"2024-09-12T01:19:09.885099+0000","last_clean":"2024-09-12T01:19:09.885099+0000","last_became_active":"2024-09-12T00:35:49.949331+0000","last_became_peered":"2024-09-12T00:35:49.949331+0000","last_unstale":"2024-09-12T01:19:09.885099+0000","last_undegraded":"2024-09-12T01:19:09.885099+0000","last_fullsized":"2024-09-12T01:19:09.885099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:00.112784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:52.773954+0000","last_change":"2024-09-12T00:35:51.977921+0000","last_active":"2024-09-12T01:17:52.773954+0000","last_peered":"2024-09-12T01:17:52.773954+0000","last_clean":"2024-09-12T01:17:52.773954+0000","last_became_active":"2024-09-12T00:35:51.977211+0000","last_became_peered":"2024-09-12T00:35:51.977211+0000","last_unstale":"2024-09-12T01:17:52.773954+0000","last_undegraded":"2024-09-12T01:17:52.773954+0000","last_fullsized":"2024-09-12T01:17:52.773954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:37.744652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'214","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.264295+0000","last_change":"2024-09-12T00:35:53.992509+0000","last_active":"2024-09-12T01:20:22.264295+0000","last_peered":"2024-09-12T01:20:22.264295+0000","last_clean":"2024-09-12T01:20:22.264295+0000","last_became_active":"2024-09-12T00:35:53.985696+0000","last_became_peered":"2024-09-12T00:35:53.985696+0000","last_unstale":"2024-09-12T01:20:22.264295+0000","last_undegraded":"2024-09-12T01:20:22.264295+0000","last_fullsized":"2024-09-12T01:20:22.264295+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:55.326440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":288,"num_read_kb":283,"num_write":478,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'116","reported_seq":720,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:36.946980+0000","last_change":"2024-09-12T00:35:45.944333+0000","last_active":"2024-09-12T01:18:36.946980+0000","last_peered":"2024-09-12T01:18:36.946980+0000","last_clean":"2024-09-12T01:18:36.946980+0000","last_became_active":"2024-09-12T00:35:45.942161+0000","last_became_peered":"2024-09-12T00:35:45.942161+0000","last_unstale":"2024-09-12T01:18:36.946980+0000","last_undegraded":"2024-09-12T01:18:36.946980+0000","last_fullsized":"2024-09-12T01:18:36.946980+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:45.930313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":566,"num_read_kb":479,"num_write":187,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'289","reported_seq":889,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.822707+0000","last_change":"2024-09-12T00:35:43.951301+0000","last_active":"2024-09-12T01:21:57.822707+0000","last_peered":"2024-09-12T01:21:57.822707+0000","last_clean":"2024-09-12T01:21:57.822707+0000","last_became_active":"2024-09-12T00:35:43.950660+0000","last_became_peered":"2024-09-12T00:35:43.950660+0000","last_unstale":"2024-09-12T01:21:57.822707+0000","last_undegraded":"2024-09-12T01:21:57.822707+0000","last_fullsized":"2024-09-12T01:21:57.822707+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:51.119280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110814,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":386,"num_read_kb":2177,"num_write":879,"num_write_kb":8684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:47.772763+0000","last_change":"2024-09-12T00:35:47.946510+0000","last_active":"2024-09-12T01:17:47.772763+0000","last_peered":"2024-09-12T01:17:47.772763+0000","last_clean":"2024-09-12T01:17:47.772763+0000","last_became_active":"2024-09-12T00:35:47.945819+0000","last_became_peered":"2024-09-12T00:35:47.945819+0000","last_unstale":"2024-09-12T01:17:47.772763+0000","last_undegraded":"2024-09-12T01:17:47.772763+0000","last_fullsized":"2024-09-12T01:17:47.772763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:13.092089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'348","reported_seq":934,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.503752+0000","last_change":"2024-09-12T00:35:49.955755+0000","last_active":"2024-09-12T01:21:57.503752+0000","last_peered":"2024-09-12T01:21:57.503752+0000","last_clean":"2024-09-12T01:21:57.503752+0000","last_became_active":"2024-09-12T00:35:49.954646+0000","last_became_peered":"2024-09-12T00:35:49.954646+0000","last_unstale":"2024-09-12T01:21:57.503752+0000","last_undegraded":"2024-09-12T01:21:57.503752+0000","last_fullsized":"2024-09-12T01:21:57.503752+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:59.408731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66883,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":574,"num_read_kb":1344,"num_write":472,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:52.540778+0000","last_change":"2024-09-12T00:35:51.974798+0000","last_active":"2024-09-12T01:17:52.540778+0000","last_peered":"2024-09-12T01:17:52.540778+0000","last_clean":"2024-09-12T01:17:52.540778+0000","last_became_active":"2024-09-12T00:35:51.973993+0000","last_became_peered":"2024-09-12T00:35:51.973993+0000","last_unstale":"2024-09-12T01:17:52.540778+0000","last_undegraded":"2024-09-12T01:17:52.540778+0000","last_fullsized":"2024-09-12T01:17:52.540778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:02.005519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'103","reported_seq":609,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:56.474802+0000","last_change":"2024-09-12T00:35:54.001932+0000","last_active":"2024-09-12T01:19:56.474802+0000","last_peered":"2024-09-12T01:19:56.474802+0000","last_clean":"2024-09-12T01:19:56.474802+0000","last_became_active":"2024-09-12T00:35:54.001337+0000","last_became_peered":"2024-09-12T00:35:54.001337+0000","last_unstale":"2024-09-12T01:19:56.474802+0000","last_undegraded":"2024-09-12T01:19:56.474802+0000","last_fullsized":"2024-09-12T01:19:56.474802+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:46.072438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":126,"num_write":245,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'4114","reported_seq":4735,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:05.320945+0000","last_change":"2024-09-12T00:35:45.940670+0000","last_active":"2024-09-12T01:20:05.320945+0000","last_peered":"2024-09-12T01:20:05.320945+0000","last_clean":"2024-09-12T01:20:05.320945+0000","last_became_active":"2024-09-12T00:35:45.938175+0000","last_became_peered":"2024-09-12T00:35:45.938175+0000","last_unstale":"2024-09-12T01:20:05.320945+0000","last_undegraded":"2024-09-12T01:20:05.320945+0000","last_fullsized":"2024-09-12T01:20:05.320945+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:06.702726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16557,"num_read_kb":13901,"num_write":6164,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'305","reported_seq":908,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.855189+0000","last_change":"2024-09-12T00:35:43.935984+0000","last_active":"2024-09-12T01:21:57.855189+0000","last_peered":"2024-09-12T01:21:57.855189+0000","last_clean":"2024-09-12T01:21:57.855189+0000","last_became_active":"2024-09-12T00:35:43.935194+0000","last_became_peered":"2024-09-12T00:35:43.935194+0000","last_unstale":"2024-09-12T01:21:57.855189+0000","last_undegraded":"2024-09-12T01:21:57.855189+0000","last_fullsized":"2024-09-12T01:21:57.855189+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:19.822537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992287,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":416,"num_read_kb":10375,"num_write":976,"num_write_kb":15779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:47.539641+0000","last_change":"2024-09-12T00:35:47.945331+0000","last_active":"2024-09-12T01:17:47.539641+0000","last_peered":"2024-09-12T01:17:47.539641+0000","last_clean":"2024-09-12T01:17:47.539641+0000","last_became_active":"2024-09-12T00:35:47.944477+0000","last_became_peered":"2024-09-12T00:35:47.944477+0000","last_unstale":"2024-09-12T01:17:47.539641+0000","last_undegraded":"2024-09-12T01:17:47.539641+0000","last_fullsized":"2024-09-12T01:17:47.539641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:59.438695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'274","reported_seq":841,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.386915+0000","last_change":"2024-09-12T00:35:49.942723+0000","last_active":"2024-09-12T01:21:57.386915+0000","last_peered":"2024-09-12T01:21:57.386915+0000","last_clean":"2024-09-12T01:21:57.386915+0000","last_became_active":"2024-09-12T00:35:49.941948+0000","last_became_peered":"2024-09-12T00:35:49.941948+0000","last_unstale":"2024-09-12T01:21:57.386915+0000","last_undegraded":"2024-09-12T01:21:57.386915+0000","last_fullsized":"2024-09-12T01:21:57.386915+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:32.893865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45730,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":1073,"num_write":372,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":482,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:53.553514+0000","last_change":"2024-09-12T00:35:51.975893+0000","last_active":"2024-09-12T01:17:53.553514+0000","last_peered":"2024-09-12T01:17:53.553514+0000","last_clean":"2024-09-12T01:17:53.553514+0000","last_became_active":"2024-09-12T00:35:51.975124+0000","last_became_peered":"2024-09-12T00:35:51.975124+0000","last_unstale":"2024-09-12T01:17:53.553514+0000","last_undegraded":"2024-09-12T01:17:53.553514+0000","last_fullsized":"2024-09-12T01:17:53.553514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:49.874523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'251","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:55.418732+0000","last_change":"2024-09-12T00:35:45.942083+0000","last_active":"2024-09-12T01:19:55.418732+0000","last_peered":"2024-09-12T01:19:55.418732+0000","last_clean":"2024-09-12T01:19:55.418732+0000","last_became_active":"2024-09-12T00:35:45.941357+0000","last_became_peered":"2024-09-12T00:35:45.941357+0000","last_unstale":"2024-09-12T01:19:55.418732+0000","last_undegraded":"2024-09-12T01:19:55.418732+0000","last_fullsized":"2024-09-12T01:19:55.418732+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:58.892422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1115,"num_read_kb":918,"num_write":405,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'296","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.822255+0000","last_change":"2024-09-12T00:35:43.933290+0000","last_active":"2024-09-12T01:21:57.822255+0000","last_peered":"2024-09-12T01:21:57.822255+0000","last_clean":"2024-09-12T01:21:57.822255+0000","last_became_active":"2024-09-12T00:35:43.933037+0000","last_became_peered":"2024-09-12T00:35:43.933037+0000","last_unstale":"2024-09-12T01:21:57.822255+0000","last_undegraded":"2024-09-12T01:21:57.822255+0000","last_fullsized":"2024-09-12T01:21:57.822255+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:43.925660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730132,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":468,"num_read_kb":7309,"num_write":980,"num_write_kb":23054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"36'3","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.482835+0000","last_change":"2024-09-12T00:35:47.942588+0000","last_active":"2024-09-12T01:21:56.482835+0000","last_peered":"2024-09-12T01:21:56.482835+0000","last_clean":"2024-09-12T01:21:56.482835+0000","last_became_active":"2024-09-12T00:35:47.941749+0000","last_became_peered":"2024-09-12T00:35:47.941749+0000","last_unstale":"2024-09-12T01:21:56.482835+0000","last_undegraded":"2024-09-12T01:21:56.482835+0000","last_fullsized":"2024-09-12T01:21:56.482835+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:24.632274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'506","reported_seq":1137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.349319+0000","last_change":"2024-09-12T00:35:49.948724+0000","last_active":"2024-09-12T01:21:57.349319+0000","last_peered":"2024-09-12T01:21:57.349319+0000","last_clean":"2024-09-12T01:21:57.349319+0000","last_became_active":"2024-09-12T00:35:49.947963+0000","last_became_peered":"2024-09-12T00:35:49.947963+0000","last_unstale":"2024-09-12T01:21:57.349319+0000","last_undegraded":"2024-09-12T01:21:57.349319+0000","last_fullsized":"2024-09-12T01:21:57.349319+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:23.048505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95771,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":915,"num_read_kb":2195,"num_write":792,"num_write_kb":711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.553625+0000","last_change":"2024-09-12T00:35:51.968910+0000","last_active":"2024-09-12T01:18:23.553625+0000","last_peered":"2024-09-12T01:18:23.553625+0000","last_clean":"2024-09-12T01:18:23.553625+0000","last_became_active":"2024-09-12T00:35:51.968209+0000","last_became_peered":"2024-09-12T00:35:51.968209+0000","last_unstale":"2024-09-12T01:18:23.553625+0000","last_undegraded":"2024-09-12T01:18:23.553625+0000","last_fullsized":"2024-09-12T01:18:23.553625+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:40.274641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'158","reported_seq":653,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.097347+0000","last_change":"2024-09-12T00:35:54.013532+0000","last_active":"2024-09-12T01:20:22.097347+0000","last_peered":"2024-09-12T01:20:22.097347+0000","last_clean":"2024-09-12T01:20:22.097347+0000","last_became_active":"2024-09-12T00:35:54.012958+0000","last_became_peered":"2024-09-12T00:35:54.012958+0000","last_unstale":"2024-09-12T01:20:22.097347+0000","last_undegraded":"2024-09-12T01:20:22.097347+0000","last_fullsized":"2024-09-12T01:20:22.097347+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:34.515746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1092,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":166,"num_read_kb":178,"num_write":351,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'60","reported_seq":614,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:58.584807+0000","last_change":"2024-09-12T00:35:45.946291+0000","last_active":"2024-09-12T01:19:58.584807+0000","last_peered":"2024-09-12T01:19:58.584807+0000","last_clean":"2024-09-12T01:19:58.584807+0000","last_became_active":"2024-09-12T00:35:45.945952+0000","last_became_peered":"2024-09-12T00:35:45.945952+0000","last_unstale":"2024-09-12T01:19:58.584807+0000","last_undegraded":"2024-09-12T01:19:58.584807+0000","last_fullsized":"2024-09-12T01:19:58.584807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:19.912313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":234,"num_write":86,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'358","reported_seq":1014,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.835535+0000","last_change":"2024-09-12T00:35:43.930088+0000","last_active":"2024-09-12T01:21:57.835535+0000","last_peered":"2024-09-12T01:21:57.835535+0000","last_clean":"2024-09-12T01:21:57.835535+0000","last_became_active":"2024-09-12T00:35:43.928779+0000","last_became_peered":"2024-09-12T00:35:43.928779+0000","last_unstale":"2024-09-12T01:21:57.835535+0000","last_undegraded":"2024-09-12T01:21:57.835535+0000","last_fullsized":"2024-09-12T01:21:57.835535+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:27.466245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":507,"num_read_kb":67515,"num_write":1156,"num_write_kb":41697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.562535+0000","last_change":"2024-09-12T00:35:47.944821+0000","last_active":"2024-09-12T01:19:32.562535+0000","last_peered":"2024-09-12T01:19:32.562535+0000","last_clean":"2024-09-12T01:19:32.562535+0000","last_became_active":"2024-09-12T00:35:47.944056+0000","last_became_peered":"2024-09-12T00:35:47.944056+0000","last_unstale":"2024-09-12T01:19:32.562535+0000","last_undegraded":"2024-09-12T01:19:32.562535+0000","last_fullsized":"2024-09-12T01:19:32.562535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:34.718996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'270","reported_seq":850,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.421484+0000","last_change":"2024-09-12T00:35:49.946966+0000","last_active":"2024-09-12T01:21:57.421484+0000","last_peered":"2024-09-12T01:21:57.421484+0000","last_clean":"2024-09-12T01:21:57.421484+0000","last_became_active":"2024-09-12T00:35:49.946226+0000","last_became_peered":"2024-09-12T00:35:49.946226+0000","last_unstale":"2024-09-12T01:21:57.421484+0000","last_undegraded":"2024-09-12T01:21:57.421484+0000","last_fullsized":"2024-09-12T01:21:57.421484+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:45.810230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48166,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":461,"num_read_kb":978,"num_write":376,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":483,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.562310+0000","last_change":"2024-09-12T00:35:51.970897+0000","last_active":"2024-09-12T01:18:23.562310+0000","last_peered":"2024-09-12T01:18:23.562310+0000","last_clean":"2024-09-12T01:18:23.562310+0000","last_became_active":"2024-09-12T00:35:51.963735+0000","last_became_peered":"2024-09-12T00:35:51.963735+0000","last_unstale":"2024-09-12T01:18:23.562310+0000","last_undegraded":"2024-09-12T01:18:23.562310+0000","last_fullsized":"2024-09-12T01:18:23.562310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:20.013004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'196","reported_seq":702,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.113351+0000","last_change":"2024-09-12T00:35:53.991284+0000","last_active":"2024-09-12T01:20:22.113351+0000","last_peered":"2024-09-12T01:20:22.113351+0000","last_clean":"2024-09-12T01:20:22.113351+0000","last_became_active":"2024-09-12T00:35:53.990488+0000","last_became_peered":"2024-09-12T00:35:53.990488+0000","last_unstale":"2024-09-12T01:20:22.113351+0000","last_undegraded":"2024-09-12T01:20:22.113351+0000","last_fullsized":"2024-09-12T01:20:22.113351+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:57.849221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1821,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":235,"num_read_kb":229,"num_write":573,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'191","reported_seq":788,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:06.954169+0000","last_change":"2024-09-12T00:35:45.945163+0000","last_active":"2024-09-12T01:20:06.954169+0000","last_peered":"2024-09-12T01:20:06.954169+0000","last_clean":"2024-09-12T01:20:06.954169+0000","last_became_active":"2024-09-12T00:35:45.940529+0000","last_became_peered":"2024-09-12T00:35:45.940529+0000","last_unstale":"2024-09-12T01:20:06.954169+0000","last_undegraded":"2024-09-12T01:20:06.954169+0000","last_fullsized":"2024-09-12T01:20:06.954169+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:51.722964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":840,"num_read_kb":692,"num_write":286,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'327","reported_seq":1081,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.559299+0000","last_change":"2024-09-12T00:35:43.928101+0000","last_active":"2024-09-12T01:21:57.559299+0000","last_peered":"2024-09-12T01:21:57.559299+0000","last_clean":"2024-09-12T01:21:57.559299+0000","last_became_active":"2024-09-12T00:35:43.927426+0000","last_became_peered":"2024-09-12T00:35:43.927426+0000","last_unstale":"2024-09-12T01:21:57.559299+0000","last_undegraded":"2024-09-12T01:21:57.559299+0000","last_fullsized":"2024-09-12T01:21:57.559299+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:04.964381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":206,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":808,"num_read_kb":46781,"num_write":1097,"num_write_kb":16393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.739497+0000","last_change":"2024-09-12T00:35:47.934105+0000","last_active":"2024-09-12T01:18:17.739497+0000","last_peered":"2024-09-12T01:18:17.739497+0000","last_clean":"2024-09-12T01:18:17.739497+0000","last_became_active":"2024-09-12T00:35:47.933189+0000","last_became_peered":"2024-09-12T00:35:47.933189+0000","last_unstale":"2024-09-12T01:18:17.739497+0000","last_undegraded":"2024-09-12T01:18:17.739497+0000","last_fullsized":"2024-09-12T01:18:17.739497+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:01.418064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'284","reported_seq":863,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.862874+0000","last_change":"2024-09-12T00:35:50.030204+0000","last_active":"2024-09-12T01:21:56.862874+0000","last_peered":"2024-09-12T01:21:56.862874+0000","last_clean":"2024-09-12T01:21:56.862874+0000","last_became_active":"2024-09-12T00:35:50.029579+0000","last_became_peered":"2024-09-12T00:35:50.029579+0000","last_unstale":"2024-09-12T01:21:56.862874+0000","last_undegraded":"2024-09-12T01:21:56.862874+0000","last_fullsized":"2024-09-12T01:21:56.862874+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:54.577958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47233,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":1083,"num_write":390,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:58.587193+0000","last_change":"2024-09-12T00:35:51.972390+0000","last_active":"2024-09-12T01:19:58.587193+0000","last_peered":"2024-09-12T01:19:58.587193+0000","last_clean":"2024-09-12T01:19:58.587193+0000","last_became_active":"2024-09-12T00:35:51.971682+0000","last_became_peered":"2024-09-12T00:35:51.971682+0000","last_unstale":"2024-09-12T01:19:58.587193+0000","last_undegraded":"2024-09-12T01:19:58.587193+0000","last_fullsized":"2024-09-12T01:19:58.587193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:54.514575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'102","reported_seq":593,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.357123+0000","last_change":"2024-09-12T00:35:53.996274+0000","last_active":"2024-09-12T01:21:25.357123+0000","last_peered":"2024-09-12T01:21:25.357123+0000","last_clean":"2024-09-12T01:21:25.357123+0000","last_became_active":"2024-09-12T00:35:53.995464+0000","last_became_peered":"2024-09-12T00:35:53.995464+0000","last_unstale":"2024-09-12T01:21:25.357123+0000","last_undegraded":"2024-09-12T01:21:25.357123+0000","last_fullsized":"2024-09-12T01:21:25.357123+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:47.747130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":101,"num_write":247,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'297","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:54.778656+0000","last_change":"2024-09-12T00:35:45.947620+0000","last_active":"2024-09-12T01:19:54.778656+0000","last_peered":"2024-09-12T01:19:54.778656+0000","last_clean":"2024-09-12T01:19:54.778656+0000","last_became_active":"2024-09-12T00:35:45.947244+0000","last_became_peered":"2024-09-12T00:35:45.947244+0000","last_unstale":"2024-09-12T01:19:54.778656+0000","last_undegraded":"2024-09-12T01:19:54.778656+0000","last_fullsized":"2024-09-12T01:19:54.778656+0000","mapping_epoch":26,"log_start":"251'200","ondisk_log_start":"251'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:20.082192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1444,"num_read_kb":1250,"num_write":453,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'352","reported_seq":1108,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.824755+0000","last_change":"2024-09-12T00:35:43.947838+0000","last_active":"2024-09-12T01:21:57.824755+0000","last_peered":"2024-09-12T01:21:57.824755+0000","last_clean":"2024-09-12T01:21:57.824755+0000","last_became_active":"2024-09-12T00:35:43.947420+0000","last_became_peered":"2024-09-12T00:35:43.947420+0000","last_unstale":"2024-09-12T01:21:57.824755+0000","last_undegraded":"2024-09-12T01:21:57.824755+0000","last_fullsized":"2024-09-12T01:21:57.824755+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:47.159137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262187,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":720,"num_read_kb":19884,"num_write":1159,"num_write_kb":29921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.561198+0000","last_change":"2024-09-12T00:35:47.935965+0000","last_active":"2024-09-12T01:18:18.561198+0000","last_peered":"2024-09-12T01:18:18.561198+0000","last_clean":"2024-09-12T01:18:18.561198+0000","last_became_active":"2024-09-12T00:35:47.935440+0000","last_became_peered":"2024-09-12T00:35:47.935440+0000","last_unstale":"2024-09-12T01:18:18.561198+0000","last_undegraded":"2024-09-12T01:18:18.561198+0000","last_fullsized":"2024-09-12T01:18:18.561198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:47.836745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'90","reported_seq":619,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:57.735007+0000","last_change":"2024-09-12T00:35:50.026452+0000","last_active":"2024-09-12T01:17:57.735007+0000","last_peered":"2024-09-12T01:17:57.735007+0000","last_clean":"2024-09-12T01:17:57.735007+0000","last_became_active":"2024-09-12T00:35:50.025145+0000","last_became_peered":"2024-09-12T00:35:50.025145+0000","last_unstale":"2024-09-12T01:17:57.735007+0000","last_undegraded":"2024-09-12T01:17:57.735007+0000","last_fullsized":"2024-09-12T01:17:57.735007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:49.606844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":97,"num_read_kb":88,"num_write":76,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'771","reported_seq":2389,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.485653+0000","last_change":"2024-09-12T00:35:51.968551+0000","last_active":"2024-09-12T01:21:56.485653+0000","last_peered":"2024-09-12T01:21:56.485653+0000","last_clean":"2024-09-12T01:21:56.485653+0000","last_became_active":"2024-09-12T00:35:51.967797+0000","last_became_peered":"2024-09-12T00:35:51.967797+0000","last_unstale":"2024-09-12T01:21:56.485653+0000","last_undegraded":"2024-09-12T01:21:56.485653+0000","last_fullsized":"2024-09-12T01:21:56.485653+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:42.194060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'103","reported_seq":603,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.236409+0000","last_change":"2024-09-12T00:35:54.003014+0000","last_active":"2024-09-12T01:20:22.236409+0000","last_peered":"2024-09-12T01:20:22.236409+0000","last_clean":"2024-09-12T01:20:22.236409+0000","last_became_active":"2024-09-12T00:35:54.002318+0000","last_became_peered":"2024-09-12T00:35:54.002318+0000","last_unstale":"2024-09-12T01:20:22.236409+0000","last_undegraded":"2024-09-12T01:20:22.236409+0000","last_fullsized":"2024-09-12T01:20:22.236409+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:45.348319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":119,"num_write":243,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'135","reported_seq":740,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.739424+0000","last_change":"2024-09-12T00:35:45.936713+0000","last_active":"2024-09-12T01:18:17.739424+0000","last_peered":"2024-09-12T01:18:17.739424+0000","last_clean":"2024-09-12T01:18:17.739424+0000","last_became_active":"2024-09-12T00:35:45.935880+0000","last_became_peered":"2024-09-12T00:35:45.935880+0000","last_unstale":"2024-09-12T01:18:17.739424+0000","last_undegraded":"2024-09-12T01:18:17.739424+0000","last_fullsized":"2024-09-12T01:18:17.739424+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:29.055252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":617,"num_read_kb":515,"num_write":204,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'355","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.859915+0000","last_change":"2024-09-12T00:35:43.931892+0000","last_active":"2024-09-12T01:21:57.859915+0000","last_peered":"2024-09-12T01:21:57.859915+0000","last_clean":"2024-09-12T01:21:57.859915+0000","last_became_active":"2024-09-12T00:35:43.931008+0000","last_became_peered":"2024-09-12T00:35:43.931008+0000","last_unstale":"2024-09-12T01:21:57.859915+0000","last_undegraded":"2024-09-12T01:21:57.859915+0000","last_fullsized":"2024-09-12T01:21:57.859915+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:13.452075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730252,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":516,"num_read_kb":33271,"num_write":1211,"num_write_kb":48012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.779666+0000","last_change":"2024-09-12T00:35:47.951130+0000","last_active":"2024-09-12T01:18:17.779666+0000","last_peered":"2024-09-12T01:18:17.779666+0000","last_clean":"2024-09-12T01:18:17.779666+0000","last_became_active":"2024-09-12T00:35:47.950328+0000","last_became_peered":"2024-09-12T00:35:47.950328+0000","last_unstale":"2024-09-12T01:18:17.779666+0000","last_undegraded":"2024-09-12T01:18:17.779666+0000","last_fullsized":"2024-09-12T01:18:17.779666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:21.340191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'320","reported_seq":924,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.089170+0000","last_change":"2024-09-12T00:35:49.939297+0000","last_active":"2024-09-12T01:21:57.089170+0000","last_peered":"2024-09-12T01:21:57.089170+0000","last_clean":"2024-09-12T01:21:57.089170+0000","last_became_active":"2024-09-12T00:35:49.938536+0000","last_became_peered":"2024-09-12T00:35:49.938536+0000","last_unstale":"2024-09-12T01:21:57.089170+0000","last_undegraded":"2024-09-12T01:21:57.089170+0000","last_fullsized":"2024-09-12T01:21:57.089170+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:13.330863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46352,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":532,"num_read_kb":1127,"num_write":424,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":482,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:23.575502+0000","last_change":"2024-09-12T00:35:51.965185+0000","last_active":"2024-09-12T01:19:23.575502+0000","last_peered":"2024-09-12T01:19:23.575502+0000","last_clean":"2024-09-12T01:19:23.575502+0000","last_became_active":"2024-09-12T00:35:51.964446+0000","last_became_peered":"2024-09-12T00:35:51.964446+0000","last_unstale":"2024-09-12T01:19:23.575502+0000","last_undegraded":"2024-09-12T01:19:23.575502+0000","last_fullsized":"2024-09-12T01:19:23.575502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:04.163874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'136","reported_seq":648,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:20.487261+0000","last_change":"2024-09-12T00:35:53.998710+0000","last_active":"2024-09-12T01:20:20.487261+0000","last_peered":"2024-09-12T01:20:20.487261+0000","last_clean":"2024-09-12T01:20:20.487261+0000","last_became_active":"2024-09-12T00:35:53.997969+0000","last_became_peered":"2024-09-12T00:35:53.997969+0000","last_unstale":"2024-09-12T01:20:20.487261+0000","last_undegraded":"2024-09-12T01:20:20.487261+0000","last_fullsized":"2024-09-12T01:20:20.487261+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:50.127097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":591,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":213,"num_read_kb":189,"num_write":344,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'117","reported_seq":701,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:17.808530+0000","last_change":"2024-09-12T00:35:45.940384+0000","last_active":"2024-09-12T01:20:17.808530+0000","last_peered":"2024-09-12T01:20:17.808530+0000","last_clean":"2024-09-12T01:20:17.808530+0000","last_became_active":"2024-09-12T00:35:45.937597+0000","last_became_peered":"2024-09-12T00:35:45.937597+0000","last_unstale":"2024-09-12T01:20:17.808530+0000","last_undegraded":"2024-09-12T01:20:17.808530+0000","last_fullsized":"2024-09-12T01:20:17.808530+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:26.977811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":514,"num_read_kb":428,"num_write":167,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'305","reported_seq":899,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.850312+0000","last_change":"2024-09-12T00:35:43.914480+0000","last_active":"2024-09-12T01:21:57.850312+0000","last_peered":"2024-09-12T01:21:57.850312+0000","last_clean":"2024-09-12T01:21:57.850312+0000","last_became_active":"2024-09-12T00:35:43.913717+0000","last_became_peered":"2024-09-12T00:35:43.913717+0000","last_unstale":"2024-09-12T01:21:57.850312+0000","last_undegraded":"2024-09-12T01:21:57.850312+0000","last_fullsized":"2024-09-12T01:21:57.850312+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:01.278323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":6749,"num_write":932,"num_write_kb":25345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.552287+0000","last_change":"2024-09-12T00:35:47.940913+0000","last_active":"2024-09-12T01:18:18.552287+0000","last_peered":"2024-09-12T01:18:18.552287+0000","last_clean":"2024-09-12T01:18:18.552287+0000","last_became_active":"2024-09-12T00:35:47.940170+0000","last_became_peered":"2024-09-12T00:35:47.940170+0000","last_unstale":"2024-09-12T01:18:18.552287+0000","last_undegraded":"2024-09-12T01:18:18.552287+0000","last_fullsized":"2024-09-12T01:18:18.552287+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:41.868094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'276","reported_seq":844,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.130796+0000","last_change":"2024-09-12T00:35:49.954441+0000","last_active":"2024-09-12T01:21:57.130796+0000","last_peered":"2024-09-12T01:21:57.130796+0000","last_clean":"2024-09-12T01:21:57.130796+0000","last_became_active":"2024-09-12T00:35:49.952570+0000","last_became_peered":"2024-09-12T00:35:49.952570+0000","last_unstale":"2024-09-12T01:21:57.130796+0000","last_undegraded":"2024-09-12T01:21:57.130796+0000","last_fullsized":"2024-09-12T01:21:57.130796+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:31.309890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47159,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":464,"num_read_kb":1078,"num_write":380,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:27.561305+0000","last_change":"2024-09-12T00:35:51.974531+0000","last_active":"2024-09-12T01:19:27.561305+0000","last_peered":"2024-09-12T01:19:27.561305+0000","last_clean":"2024-09-12T01:19:27.561305+0000","last_became_active":"2024-09-12T00:35:51.973732+0000","last_became_peered":"2024-09-12T00:35:51.973732+0000","last_unstale":"2024-09-12T01:19:27.561305+0000","last_undegraded":"2024-09-12T01:19:27.561305+0000","last_fullsized":"2024-09-12T01:19:27.561305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:28.353680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'193","reported_seq":706,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.123850+0000","last_change":"2024-09-12T00:35:54.016500+0000","last_active":"2024-09-12T01:19:37.123850+0000","last_peered":"2024-09-12T01:19:37.123850+0000","last_clean":"2024-09-12T01:19:37.123850+0000","last_became_active":"2024-09-12T00:35:54.016028+0000","last_became_peered":"2024-09-12T00:35:54.016028+0000","last_unstale":"2024-09-12T01:19:37.123850+0000","last_undegraded":"2024-09-12T01:19:37.123850+0000","last_fullsized":"2024-09-12T01:19:37.123850+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:13.793560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":175,"num_read_kb":171,"num_write":438,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'198","reported_seq":811,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:40.883260+0000","last_change":"2024-09-12T00:35:45.941739+0000","last_active":"2024-09-12T01:19:40.883260+0000","last_peered":"2024-09-12T01:19:40.883260+0000","last_clean":"2024-09-12T01:19:40.883260+0000","last_became_active":"2024-09-12T00:35:45.941396+0000","last_became_peered":"2024-09-12T00:35:45.941396+0000","last_unstale":"2024-09-12T01:19:40.883260+0000","last_undegraded":"2024-09-12T01:19:40.883260+0000","last_fullsized":"2024-09-12T01:19:40.883260+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:23.094406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":858,"num_read_kb":711,"num_write":323,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'457","reported_seq":1333,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.864472+0000","last_change":"2024-09-12T00:35:43.942784+0000","last_active":"2024-09-12T01:21:57.864472+0000","last_peered":"2024-09-12T01:21:57.864472+0000","last_clean":"2024-09-12T01:21:57.864472+0000","last_became_active":"2024-09-12T00:35:43.942359+0000","last_became_peered":"2024-09-12T00:35:43.942359+0000","last_unstale":"2024-09-12T01:21:57.864472+0000","last_undegraded":"2024-09-12T01:21:57.864472+0000","last_fullsized":"2024-09-12T01:21:57.864472+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:02.785832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1122,"num_read_kb":58431,"num_write":1508,"num_write_kb":72479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:17.551730+0000","last_change":"2024-09-12T00:35:47.941539+0000","last_active":"2024-09-12T01:19:17.551730+0000","last_peered":"2024-09-12T01:19:17.551730+0000","last_clean":"2024-09-12T01:19:17.551730+0000","last_became_active":"2024-09-12T00:35:47.940501+0000","last_became_peered":"2024-09-12T00:35:47.940501+0000","last_unstale":"2024-09-12T01:19:17.551730+0000","last_undegraded":"2024-09-12T01:19:17.551730+0000","last_fullsized":"2024-09-12T01:19:17.551730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:32.448595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'228","reported_seq":788,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.785257+0000","last_change":"2024-09-12T00:35:49.956360+0000","last_active":"2024-09-12T01:21:56.785257+0000","last_peered":"2024-09-12T01:21:56.785257+0000","last_clean":"2024-09-12T01:21:56.785257+0000","last_became_active":"2024-09-12T00:35:49.955264+0000","last_became_peered":"2024-09-12T00:35:49.955264+0000","last_unstale":"2024-09-12T01:21:56.785257+0000","last_undegraded":"2024-09-12T01:21:56.785257+0000","last_fullsized":"2024-09-12T01:21:56.785257+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:15.469778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44002,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":385,"num_read_kb":903,"num_write":312,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:22.740634+0000","last_change":"2024-09-12T00:35:51.965221+0000","last_active":"2024-09-12T01:18:22.740634+0000","last_peered":"2024-09-12T01:18:22.740634+0000","last_clean":"2024-09-12T01:18:22.740634+0000","last_became_active":"2024-09-12T00:35:51.961691+0000","last_became_peered":"2024-09-12T00:35:51.961691+0000","last_unstale":"2024-09-12T01:18:22.740634+0000","last_undegraded":"2024-09-12T01:18:22.740634+0000","last_fullsized":"2024-09-12T01:18:22.740634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:22.139991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'194","reported_seq":1651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:20.421505+0000","last_change":"2024-09-12T00:35:53.992266+0000","last_active":"2024-09-12T01:20:20.421505+0000","last_peered":"2024-09-12T01:20:20.421505+0000","last_clean":"2024-09-12T01:20:20.421505+0000","last_became_active":"2024-09-12T00:35:53.991532+0000","last_became_peered":"2024-09-12T00:35:53.991532+0000","last_unstale":"2024-09-12T01:20:20.421505+0000","last_undegraded":"2024-09-12T01:20:20.421505+0000","last_fullsized":"2024-09-12T01:20:20.421505+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:47.645297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1185,"num_read_kb":1184,"num_write":442,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'185","reported_seq":796,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:52.882363+0000","last_change":"2024-09-12T00:35:45.955138+0000","last_active":"2024-09-12T01:19:52.882363+0000","last_peered":"2024-09-12T01:19:52.882363+0000","last_clean":"2024-09-12T01:19:52.882363+0000","last_became_active":"2024-09-12T00:35:45.954474+0000","last_became_peered":"2024-09-12T00:35:45.954474+0000","last_unstale":"2024-09-12T01:19:52.882363+0000","last_undegraded":"2024-09-12T01:19:52.882363+0000","last_fullsized":"2024-09-12T01:19:52.882363+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:40.526235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":774,"num_read_kb":643,"num_write":252,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'368","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.852623+0000","last_change":"2024-09-12T00:35:43.935329+0000","last_active":"2024-09-12T01:21:57.852623+0000","last_peered":"2024-09-12T01:21:57.852623+0000","last_clean":"2024-09-12T01:21:57.852623+0000","last_became_active":"2024-09-12T00:35:43.934998+0000","last_became_peered":"2024-09-12T00:35:43.934998+0000","last_unstale":"2024-09-12T01:21:57.852623+0000","last_undegraded":"2024-09-12T01:21:57.852623+0000","last_fullsized":"2024-09-12T01:21:57.852623+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:30.951798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":520,"num_read_kb":15471,"num_write":1132,"num_write_kb":44978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:23.579165+0000","last_change":"2024-09-12T00:35:47.929157+0000","last_active":"2024-09-12T01:19:23.579165+0000","last_peered":"2024-09-12T01:19:23.579165+0000","last_clean":"2024-09-12T01:19:23.579165+0000","last_became_active":"2024-09-12T00:35:47.928424+0000","last_became_peered":"2024-09-12T00:35:47.928424+0000","last_unstale":"2024-09-12T01:19:23.579165+0000","last_undegraded":"2024-09-12T01:19:23.579165+0000","last_fullsized":"2024-09-12T01:19:23.579165+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:48.464754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'297","reported_seq":895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.898129+0000","last_change":"2024-09-12T00:35:49.934387+0000","last_active":"2024-09-12T01:21:56.898129+0000","last_peered":"2024-09-12T01:21:56.898129+0000","last_clean":"2024-09-12T01:21:56.898129+0000","last_became_active":"2024-09-12T00:35:49.933165+0000","last_became_peered":"2024-09-12T00:35:49.933165+0000","last_unstale":"2024-09-12T01:21:56.898129+0000","last_undegraded":"2024-09-12T01:21:56.898129+0000","last_fullsized":"2024-09-12T01:21:56.898129+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:40.275776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49116,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":493,"num_read_kb":1065,"num_write":392,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.560633+0000","last_change":"2024-09-12T00:35:51.985500+0000","last_active":"2024-09-12T01:18:23.560633+0000","last_peered":"2024-09-12T01:18:23.560633+0000","last_clean":"2024-09-12T01:18:23.560633+0000","last_became_active":"2024-09-12T00:35:51.984756+0000","last_became_peered":"2024-09-12T00:35:51.984756+0000","last_unstale":"2024-09-12T01:18:23.560633+0000","last_undegraded":"2024-09-12T01:18:23.560633+0000","last_fullsized":"2024-09-12T01:18:23.560633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:50.437627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'185","reported_seq":692,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:24.493960+0000","last_change":"2024-09-12T00:35:53.986078+0000","last_active":"2024-09-12T01:21:24.493960+0000","last_peered":"2024-09-12T01:21:24.493960+0000","last_clean":"2024-09-12T01:21:24.493960+0000","last_became_active":"2024-09-12T00:35:53.985486+0000","last_became_peered":"2024-09-12T00:35:53.985486+0000","last_unstale":"2024-09-12T01:21:24.493960+0000","last_undegraded":"2024-09-12T01:21:24.493960+0000","last_fullsized":"2024-09-12T01:21:24.493960+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:09.339192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1062,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":193,"num_read_kb":167,"num_write":361,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'182","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:49.296781+0000","last_change":"2024-09-12T00:35:45.958055+0000","last_active":"2024-09-12T01:19:49.296781+0000","last_peered":"2024-09-12T01:19:49.296781+0000","last_clean":"2024-09-12T01:19:49.296781+0000","last_became_active":"2024-09-12T00:35:45.957698+0000","last_became_peered":"2024-09-12T00:35:45.957698+0000","last_unstale":"2024-09-12T01:19:49.296781+0000","last_undegraded":"2024-09-12T01:19:49.296781+0000","last_fullsized":"2024-09-12T01:19:49.296781+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:17.032556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":768,"num_read_kb":623,"num_write":277,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'358","reported_seq":1029,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.363805+0000","last_change":"2024-09-12T00:35:43.938029+0000","last_active":"2024-09-12T01:21:57.363805+0000","last_peered":"2024-09-12T01:21:57.363805+0000","last_clean":"2024-09-12T01:21:57.363805+0000","last_became_active":"2024-09-12T00:35:43.937281+0000","last_became_peered":"2024-09-12T00:35:43.937281+0000","last_unstale":"2024-09-12T01:21:57.363805+0000","last_undegraded":"2024-09-12T01:21:57.363805+0000","last_fullsized":"2024-09-12T01:21:57.363805+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:12.183580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6040124,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":573,"num_read_kb":52874,"num_write":1331,"num_write_kb":41162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'421","reported_seq":1110,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:44.539784+0000","last_change":"2024-09-12T00:35:45.932905+0000","last_active":"2024-09-12T01:19:44.539784+0000","last_peered":"2024-09-12T01:19:44.539784+0000","last_clean":"2024-09-12T01:19:44.539784+0000","last_became_active":"2024-09-12T00:35:45.932615+0000","last_became_peered":"2024-09-12T00:35:45.932615+0000","last_unstale":"2024-09-12T01:19:44.539784+0000","last_undegraded":"2024-09-12T01:19:44.539784+0000","last_fullsized":"2024-09-12T01:19:44.539784+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:14.286299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2107,"num_read_kb":1905,"num_write":744,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'235","reported_seq":896,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.242860+0000","last_change":"2024-09-12T00:35:43.922351+0000","last_active":"2024-09-12T01:19:48.242860+0000","last_peered":"2024-09-12T01:19:48.242860+0000","last_clean":"2024-09-12T01:19:48.242860+0000","last_became_active":"2024-09-12T00:35:43.922005+0000","last_became_peered":"2024-09-12T00:35:43.922005+0000","last_unstale":"2024-09-12T01:19:48.242860+0000","last_undegraded":"2024-09-12T01:19:48.242860+0000","last_fullsized":"2024-09-12T01:19:48.242860+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:30.017931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470543,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":483,"num_read_kb":1388,"num_write":945,"num_write_kb":25405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'246","reported_seq":865,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.563835+0000","last_change":"2024-09-12T00:35:45.940788+0000","last_active":"2024-09-12T01:19:08.563835+0000","last_peered":"2024-09-12T01:19:08.563835+0000","last_clean":"2024-09-12T01:19:08.563835+0000","last_became_active":"2024-09-12T00:35:45.940153+0000","last_became_peered":"2024-09-12T00:35:45.940153+0000","last_unstale":"2024-09-12T01:19:08.563835+0000","last_undegraded":"2024-09-12T01:19:08.563835+0000","last_fullsized":"2024-09-12T01:19:08.563835+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:41.108403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1055,"num_read_kb":856,"num_write":397,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'274","reported_seq":881,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:05.577849+0000","last_change":"2024-09-12T00:36:17.268203+0000","last_active":"2024-09-12T01:20:05.577849+0000","last_peered":"2024-09-12T01:20:05.577849+0000","last_clean":"2024-09-12T01:20:05.577849+0000","last_became_active":"2024-09-12T00:36:17.267594+0000","last_became_peered":"2024-09-12T00:36:17.267594+0000","last_unstale":"2024-09-12T01:20:05.577849+0000","last_undegraded":"2024-09-12T01:20:05.577849+0000","last_fullsized":"2024-09-12T01:20:05.577849+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:49.169181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5830246,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":399,"num_read_kb":41046,"num_write":1064,"num_write_kb":25796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"265'92","reported_seq":669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:59.355559+0000","last_change":"2024-09-12T00:35:45.945797+0000","last_active":"2024-09-12T01:19:59.355559+0000","last_peered":"2024-09-12T01:19:59.355559+0000","last_clean":"2024-09-12T01:19:59.355559+0000","last_became_active":"2024-09-12T00:35:45.945534+0000","last_became_peered":"2024-09-12T00:35:45.945534+0000","last_unstale":"2024-09-12T01:19:59.355559+0000","last_undegraded":"2024-09-12T01:19:59.355559+0000","last_fullsized":"2024-09-12T01:19:59.355559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:37.784859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":411,"num_read_kb":349,"num_write":136,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'318","reported_seq":949,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.834229+0000","last_change":"2024-09-12T00:35:43.934445+0000","last_active":"2024-09-12T01:21:57.834229+0000","last_peered":"2024-09-12T01:21:57.834229+0000","last_clean":"2024-09-12T01:21:57.834229+0000","last_became_active":"2024-09-12T00:35:43.934068+0000","last_became_peered":"2024-09-12T00:35:43.934068+0000","last_unstale":"2024-09-12T01:21:57.834229+0000","last_undegraded":"2024-09-12T01:21:57.834229+0000","last_fullsized":"2024-09-12T01:21:57.834229+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:30.567561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":780267,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":473,"num_read_kb":16449,"num_write":1046,"num_write_kb":32400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'160","reported_seq":796,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.600355+0000","last_change":"2024-09-12T00:35:45.944926+0000","last_active":"2024-09-12T01:19:43.600355+0000","last_peered":"2024-09-12T01:19:43.600355+0000","last_clean":"2024-09-12T01:19:43.600355+0000","last_became_active":"2024-09-12T00:35:45.944423+0000","last_became_peered":"2024-09-12T00:35:45.944423+0000","last_unstale":"2024-09-12T01:19:43.600355+0000","last_undegraded":"2024-09-12T01:19:43.600355+0000","last_fullsized":"2024-09-12T01:19:43.600355+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:02.168577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":713,"num_read_kb":599,"num_write":226,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"265'338","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.857603+0000","last_change":"2024-09-12T00:35:43.937795+0000","last_active":"2024-09-12T01:21:57.857603+0000","last_peered":"2024-09-12T01:21:57.857603+0000","last_clean":"2024-09-12T01:21:57.857603+0000","last_became_active":"2024-09-12T00:35:43.937104+0000","last_became_peered":"2024-09-12T00:35:43.937104+0000","last_unstale":"2024-09-12T01:21:57.857603+0000","last_undegraded":"2024-09-12T01:21:57.857603+0000","last_fullsized":"2024-09-12T01:21:57.857603+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:30.010970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262271,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":572,"num_read_kb":63038,"num_write":1116,"num_write_kb":29306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'251","reported_seq":846,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:45.359695+0000","last_change":"2024-09-12T00:35:45.958347+0000","last_active":"2024-09-12T01:19:45.359695+0000","last_peered":"2024-09-12T01:19:45.359695+0000","last_clean":"2024-09-12T01:19:45.359695+0000","last_became_active":"2024-09-12T00:35:45.957860+0000","last_became_peered":"2024-09-12T00:35:45.957860+0000","last_unstale":"2024-09-12T01:19:45.359695+0000","last_undegraded":"2024-09-12T01:19:45.359695+0000","last_fullsized":"2024-09-12T01:19:45.359695+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:49.651072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1076,"num_read_kb":859,"num_write":407,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'343","reported_seq":986,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.839108+0000","last_change":"2024-09-12T00:35:43.929564+0000","last_active":"2024-09-12T01:21:57.839108+0000","last_peered":"2024-09-12T01:21:57.839108+0000","last_clean":"2024-09-12T01:21:57.839108+0000","last_became_active":"2024-09-12T00:35:43.929027+0000","last_became_peered":"2024-09-12T00:35:43.929027+0000","last_unstale":"2024-09-12T01:21:57.839108+0000","last_undegraded":"2024-09-12T01:21:57.839108+0000","last_fullsized":"2024-09-12T01:21:57.839108+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:38.958866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":588,"num_read_kb":747,"num_write":1224,"num_write_kb":5740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'102","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:33.597890+0000","last_change":"2024-09-12T00:35:45.949059+0000","last_active":"2024-09-12T01:19:33.597890+0000","last_peered":"2024-09-12T01:19:33.597890+0000","last_clean":"2024-09-12T01:19:33.597890+0000","last_became_active":"2024-09-12T00:35:45.948581+0000","last_became_peered":"2024-09-12T00:35:45.948581+0000","last_unstale":"2024-09-12T01:19:33.597890+0000","last_undegraded":"2024-09-12T01:19:33.597890+0000","last_fullsized":"2024-09-12T01:19:33.597890+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:03.771381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":463,"num_read_kb":395,"num_write":145,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"265'309","reported_seq":940,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.368841+0000","last_change":"2024-09-12T00:35:43.941896+0000","last_active":"2024-09-12T01:21:57.368841+0000","last_peered":"2024-09-12T01:21:57.368841+0000","last_clean":"2024-09-12T01:21:57.368841+0000","last_became_active":"2024-09-12T00:35:43.941155+0000","last_became_peered":"2024-09-12T00:35:43.941155+0000","last_unstale":"2024-09-12T01:21:57.368841+0000","last_undegraded":"2024-09-12T01:21:57.368841+0000","last_fullsized":"2024-09-12T01:21:57.368841+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:16.416635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5276258,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":434,"num_read_kb":4200,"num_write":1058,"num_write_kb":60173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"265'210","reported_seq":843,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.562354+0000","last_change":"2024-09-12T00:35:45.946815+0000","last_active":"2024-09-12T01:19:32.562354+0000","last_peered":"2024-09-12T01:19:32.562354+0000","last_clean":"2024-09-12T01:19:32.562354+0000","last_became_active":"2024-09-12T00:35:45.946047+0000","last_became_peered":"2024-09-12T00:35:45.946047+0000","last_unstale":"2024-09-12T01:19:32.562354+0000","last_undegraded":"2024-09-12T01:19:32.562354+0000","last_fullsized":"2024-09-12T01:19:32.562354+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:52.299599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":932,"num_read_kb":766,"num_write":302,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'318","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.857919+0000","last_change":"2024-09-12T00:35:43.924021+0000","last_active":"2024-09-12T01:21:57.857919+0000","last_peered":"2024-09-12T01:21:57.857919+0000","last_clean":"2024-09-12T01:21:57.857919+0000","last_became_active":"2024-09-12T00:35:43.923685+0000","last_became_peered":"2024-09-12T00:35:43.923685+0000","last_unstale":"2024-09-12T01:21:57.857919+0000","last_undegraded":"2024-09-12T01:21:57.857919+0000","last_fullsized":"2024-09-12T01:21:57.857919+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:37.087675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524322,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":440,"num_read_kb":73837,"num_write":961,"num_write_kb":48353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'100","reported_seq":678,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:51.229959+0000","last_change":"2024-09-12T00:35:45.942310+0000","last_active":"2024-09-12T01:18:51.229959+0000","last_peered":"2024-09-12T01:18:51.229959+0000","last_clean":"2024-09-12T01:18:51.229959+0000","last_became_active":"2024-09-12T00:35:45.941986+0000","last_became_peered":"2024-09-12T00:35:45.941986+0000","last_unstale":"2024-09-12T01:18:51.229959+0000","last_undegraded":"2024-09-12T01:18:51.229959+0000","last_fullsized":"2024-09-12T01:18:51.229959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:26.966357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":455,"num_read_kb":381,"num_write":169,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'335","reported_seq":1049,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.858500+0000","last_change":"2024-09-12T00:35:43.912420+0000","last_active":"2024-09-12T01:21:57.858500+0000","last_peered":"2024-09-12T01:21:57.858500+0000","last_clean":"2024-09-12T01:21:57.858500+0000","last_became_active":"2024-09-12T00:35:43.911654+0000","last_became_peered":"2024-09-12T00:35:43.911654+0000","last_unstale":"2024-09-12T01:21:57.858500+0000","last_undegraded":"2024-09-12T01:21:57.858500+0000","last_fullsized":"2024-09-12T01:21:57.858500+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:17.425827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262180,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":572,"num_read_kb":5667,"num_write":1085,"num_write_kb":32435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'261","reported_seq":851,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:08.858632+0000","last_change":"2024-09-12T00:35:45.927243+0000","last_active":"2024-09-12T01:20:08.858632+0000","last_peered":"2024-09-12T01:20:08.858632+0000","last_clean":"2024-09-12T01:20:08.858632+0000","last_became_active":"2024-09-12T00:35:45.926462+0000","last_became_peered":"2024-09-12T00:35:45.926462+0000","last_unstale":"2024-09-12T01:20:08.858632+0000","last_undegraded":"2024-09-12T01:20:08.858632+0000","last_fullsized":"2024-09-12T01:20:08.858632+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:10.440313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1050,"num_read_kb":836,"num_write":420,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'326","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.803189+0000","last_change":"2024-09-12T00:35:43.937158+0000","last_active":"2024-09-12T01:21:57.803189+0000","last_peered":"2024-09-12T01:21:57.803189+0000","last_clean":"2024-09-12T01:21:57.803189+0000","last_became_active":"2024-09-12T00:35:43.936883+0000","last_became_peered":"2024-09-12T00:35:43.936883+0000","last_unstale":"2024-09-12T01:21:57.803189+0000","last_undegraded":"2024-09-12T01:21:57.803189+0000","last_fullsized":"2024-09-12T01:21:57.803189+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:57.094162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2075264,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":536,"num_read_kb":80814,"num_write":1042,"num_write_kb":32955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"265'151","reported_seq":737,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:15.520650+0000","last_change":"2024-09-12T00:35:45.959301+0000","last_active":"2024-09-12T01:19:15.520650+0000","last_peered":"2024-09-12T01:19:15.520650+0000","last_clean":"2024-09-12T01:19:15.520650+0000","last_became_active":"2024-09-12T00:35:45.958997+0000","last_became_peered":"2024-09-12T00:35:45.958997+0000","last_unstale":"2024-09-12T01:19:15.520650+0000","last_undegraded":"2024-09-12T01:19:15.520650+0000","last_fullsized":"2024-09-12T01:19:15.520650+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:39.026757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":623,"num_read_kb":511,"num_write":250,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'370","reported_seq":1028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.848244+0000","last_change":"2024-09-12T00:35:43.943348+0000","last_active":"2024-09-12T01:21:57.848244+0000","last_peered":"2024-09-12T01:21:57.848244+0000","last_clean":"2024-09-12T01:21:57.848244+0000","last_became_active":"2024-09-12T00:35:43.942591+0000","last_became_peered":"2024-09-12T00:35:43.942591+0000","last_unstale":"2024-09-12T01:21:57.848244+0000","last_undegraded":"2024-09-12T01:21:57.848244+0000","last_fullsized":"2024-09-12T01:21:57.848244+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:50.909125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":894961,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":508,"num_read_kb":28251,"num_write":1134,"num_write_kb":59925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"265'83","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:32.742834+0000","last_change":"2024-09-12T00:35:45.954876+0000","last_active":"2024-09-12T01:18:32.742834+0000","last_peered":"2024-09-12T01:18:32.742834+0000","last_clean":"2024-09-12T01:18:32.742834+0000","last_became_active":"2024-09-12T00:35:45.954252+0000","last_became_peered":"2024-09-12T00:35:45.954252+0000","last_unstale":"2024-09-12T01:18:32.742834+0000","last_undegraded":"2024-09-12T01:18:32.742834+0000","last_fullsized":"2024-09-12T01:18:32.742834+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:48.605386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":370,"num_read_kb":310,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'381","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.857418+0000","last_change":"2024-09-12T00:35:43.953256+0000","last_active":"2024-09-12T01:21:57.857418+0000","last_peered":"2024-09-12T01:21:57.857418+0000","last_clean":"2024-09-12T01:21:57.857418+0000","last_became_active":"2024-09-12T00:35:43.952828+0000","last_became_peered":"2024-09-12T00:35:43.952828+0000","last_unstale":"2024-09-12T01:21:57.857418+0000","last_undegraded":"2024-09-12T01:21:57.857418+0000","last_fullsized":"2024-09-12T01:21:57.857418+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:32.309244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":611,"num_read_kb":10107,"num_write":1280,"num_write_kb":30495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'4192","reported_seq":4817,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:24.494966+0000","last_change":"2024-09-12T00:35:45.951097+0000","last_active":"2024-09-12T01:21:24.494966+0000","last_peered":"2024-09-12T01:21:24.494966+0000","last_clean":"2024-09-12T01:21:24.494966+0000","last_became_active":"2024-09-12T00:35:45.949770+0000","last_became_peered":"2024-09-12T00:35:45.949770+0000","last_unstale":"2024-09-12T01:21:24.494966+0000","last_undegraded":"2024-09-12T01:21:24.494966+0000","last_fullsized":"2024-09-12T01:21:24.494966+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":3000,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:12.568875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16900,"num_read_kb":14167,"num_write":6311,"num_write_kb":3148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'325","reported_seq":970,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.362592+0000","last_change":"2024-09-12T00:35:43.945424+0000","last_active":"2024-09-12T01:21:57.362592+0000","last_peered":"2024-09-12T01:21:57.362592+0000","last_clean":"2024-09-12T01:21:57.362592+0000","last_became_active":"2024-09-12T00:35:43.944721+0000","last_became_peered":"2024-09-12T00:35:43.944721+0000","last_unstale":"2024-09-12T01:21:57.362592+0000","last_undegraded":"2024-09-12T01:21:57.362592+0000","last_fullsized":"2024-09-12T01:21:57.362592+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:48.957484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1753109,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":507,"num_read_kb":12444,"num_write":1134,"num_write_kb":48295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'221","reported_seq":856,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:48.594988+0000","last_change":"2024-09-12T00:35:45.940317+0000","last_active":"2024-09-12T01:20:48.594988+0000","last_peered":"2024-09-12T01:20:48.594988+0000","last_clean":"2024-09-12T01:20:48.594988+0000","last_became_active":"2024-09-12T00:35:45.939921+0000","last_became_peered":"2024-09-12T00:35:45.939921+0000","last_unstale":"2024-09-12T01:20:48.594988+0000","last_undegraded":"2024-09-12T01:20:48.594988+0000","last_fullsized":"2024-09-12T01:20:48.594988+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:13.796483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":991,"num_read_kb":821,"num_write":345,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'340","reported_seq":969,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.803740+0000","last_change":"2024-09-12T00:35:43.943721+0000","last_active":"2024-09-12T01:21:57.803740+0000","last_peered":"2024-09-12T01:21:57.803740+0000","last_clean":"2024-09-12T01:21:57.803740+0000","last_became_active":"2024-09-12T00:35:43.942772+0000","last_became_peered":"2024-09-12T00:35:43.942772+0000","last_unstale":"2024-09-12T01:21:57.803740+0000","last_undegraded":"2024-09-12T01:21:57.803740+0000","last_fullsized":"2024-09-12T01:21:57.803740+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:17.244534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2330004,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":470,"num_read_kb":15742,"num_write":1093,"num_write_kb":41173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'153","reported_seq":771,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:33.583730+0000","last_change":"2024-09-12T00:35:45.938724+0000","last_active":"2024-09-12T01:18:33.583730+0000","last_peered":"2024-09-12T01:18:33.583730+0000","last_clean":"2024-09-12T01:18:33.583730+0000","last_became_active":"2024-09-12T00:35:45.937998+0000","last_became_peered":"2024-09-12T00:35:45.937998+0000","last_unstale":"2024-09-12T01:18:33.583730+0000","last_undegraded":"2024-09-12T01:18:33.583730+0000","last_fullsized":"2024-09-12T01:18:33.583730+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:04.489640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":680,"num_read_kb":568,"num_write":226,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'289","reported_seq":990,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:35.296244+0000","last_change":"2024-09-12T00:35:43.941342+0000","last_active":"2024-09-12T01:18:35.296244+0000","last_peered":"2024-09-12T01:18:35.296244+0000","last_clean":"2024-09-12T01:18:35.296244+0000","last_became_active":"2024-09-12T00:35:43.940876+0000","last_became_peered":"2024-09-12T00:35:43.940876+0000","last_unstale":"2024-09-12T01:18:35.296244+0000","last_undegraded":"2024-09-12T01:18:35.296244+0000","last_fullsized":"2024-09-12T01:18:35.296244+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:09.198397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5957581,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":658,"num_read_kb":28884,"num_write":1044,"num_write_kb":16361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'146","reported_seq":783,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:14.901305+0000","last_change":"2024-09-12T00:35:45.948798+0000","last_active":"2024-09-12T01:19:14.901305+0000","last_peered":"2024-09-12T01:19:14.901305+0000","last_clean":"2024-09-12T01:19:14.901305+0000","last_became_active":"2024-09-12T00:35:45.948028+0000","last_became_peered":"2024-09-12T00:35:45.948028+0000","last_unstale":"2024-09-12T01:19:14.901305+0000","last_undegraded":"2024-09-12T01:19:14.901305+0000","last_fullsized":"2024-09-12T01:19:14.901305+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:30.737963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":702,"num_read_kb":590,"num_write":208,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'337","reported_seq":1014,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.857128+0000","last_change":"2024-09-12T00:35:43.951405+0000","last_active":"2024-09-12T01:21:57.857128+0000","last_peered":"2024-09-12T01:21:57.857128+0000","last_clean":"2024-09-12T01:21:57.857128+0000","last_became_active":"2024-09-12T00:35:43.950791+0000","last_became_peered":"2024-09-12T00:35:43.950791+0000","last_unstale":"2024-09-12T01:21:57.857128+0000","last_undegraded":"2024-09-12T01:21:57.857128+0000","last_fullsized":"2024-09-12T01:21:57.857128+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:26.346445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5529046,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":579,"num_read_kb":37013,"num_write":1080,"num_write_kb":45879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'298","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.752923+0000","last_change":"2024-09-12T00:35:43.932104+0000","last_active":"2024-09-12T01:21:57.752923+0000","last_peered":"2024-09-12T01:21:57.752923+0000","last_clean":"2024-09-12T01:21:57.752923+0000","last_became_active":"2024-09-12T00:35:43.931367+0000","last_became_peered":"2024-09-12T00:35:43.931367+0000","last_unstale":"2024-09-12T01:21:57.752923+0000","last_undegraded":"2024-09-12T01:21:57.752923+0000","last_fullsized":"2024-09-12T01:21:57.752923+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:38.049554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":466,"num_read_kb":37317,"num_write":980,"num_write_kb":22412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'443","reported_seq":1072,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:28.576933+0000","last_change":"2024-09-12T00:35:45.941592+0000","last_active":"2024-09-12T01:19:28.576933+0000","last_peered":"2024-09-12T01:19:28.576933+0000","last_clean":"2024-09-12T01:19:28.576933+0000","last_became_active":"2024-09-12T00:35:45.941136+0000","last_became_peered":"2024-09-12T00:35:45.941136+0000","last_unstale":"2024-09-12T01:19:28.576933+0000","last_undegraded":"2024-09-12T01:19:28.576933+0000","last_fullsized":"2024-09-12T01:19:28.576933+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:02.451398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1924,"num_read_kb":1655,"num_write":712,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'343","reported_seq":993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.856682+0000","last_change":"2024-09-12T00:35:43.937060+0000","last_active":"2024-09-12T01:21:57.856682+0000","last_peered":"2024-09-12T01:21:57.856682+0000","last_clean":"2024-09-12T01:21:57.856682+0000","last_became_active":"2024-09-12T00:35:43.936772+0000","last_became_peered":"2024-09-12T00:35:43.936772+0000","last_unstale":"2024-09-12T01:21:57.856682+0000","last_undegraded":"2024-09-12T01:21:57.856682+0000","last_fullsized":"2024-09-12T01:21:57.856682+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:27.825066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":514466,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":11206,"num_write":1103,"num_write_kb":22250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'123","reported_seq":729,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.566303+0000","last_change":"2024-09-12T00:35:45.934557+0000","last_active":"2024-09-12T01:19:18.566303+0000","last_peered":"2024-09-12T01:19:18.566303+0000","last_clean":"2024-09-12T01:19:18.566303+0000","last_became_active":"2024-09-12T00:35:45.933748+0000","last_became_peered":"2024-09-12T00:35:45.933748+0000","last_unstale":"2024-09-12T01:19:18.566303+0000","last_undegraded":"2024-09-12T01:19:18.566303+0000","last_fullsized":"2024-09-12T01:19:18.566303+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:12.558899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":571,"num_read_kb":478,"num_write":188,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5965,"num_read_kb":4303,"num_write":1960,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":931,"ondisk_log_size":931,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":15013,"num_read_kb":14673,"num_write":16730,"num_write_kb":4883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2159,"ondisk_log_size":2159,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":574,"ondisk_log_size":574,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1559668,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":17679,"num_read_kb":36687,"num_write":14755,"num_write_kb":11528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":622592,"data_stored":320957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1942,"ondisk_log_size":1942,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2433,"num_read_kb":2900,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102034,"num_read_kb":85265,"num_write":36996,"num_write_kb":18612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3934,"ondisk_log_size":3934,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":130211676,"num_objects":853,"num_object_clones":0,"num_object_copies":1706,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":853,"num_whiteouts":0,"num_read":35364,"num_read_kb":1958462,"num_write":70905,"num_write_kb":2147647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":375255040,"data_stored":368641180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3533,"ondisk_log_size":3533,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":10490728,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":131,"num_read_kb":174261,"num_write":151,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37838848,"data_stored":37833994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91,"ondisk_log_size":91,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":179336,"num_write":153,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":93,"ondisk_log_size":93,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424510004,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148692,"kb_used_data":36832,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94223148,"statfs":{"total":96636764160,"available":96484503552,"internally_reserved":0,"allocated":37715968,"data_stored":35946887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510003,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":330504,"kb_used_data":86872,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94041336,"statfs":{"total":96636764160,"available":96298328064,"internally_reserved":0,"allocated":88956928,"data_stored":85964588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":249428423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510005,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126224,"kb_used_data":10384,"kb_used_omap":1,"kb_used_meta":115774,"kb_avail":94245616,"statfs":{"total":96636764160,"available":96507510784,"internally_reserved":0,"allocated":10633216,"data_stored":9073175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":118553029},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510004,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289016,"kb_used_data":72236,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94082824,"statfs":{"total":96636764160,"available":96340811776,"internally_reserved":0,"allocated":73969664,"data_stored":71447056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220985797},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542707,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299000,"kb_used_data":73272,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94072840,"statfs":{"total":96636764160,"available":96330588160,"internally_reserved":0,"allocated":75030528,"data_stored":71320599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":230947274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542706,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309408,"kb_used_data":101852,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94062432,"statfs":{"total":96636764160,"available":96319930368,"internally_reserved":0,"allocated":104296448,"data_stored":100380510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":212466118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542707,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":219676,"kb_used_data":148192,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94152164,"statfs":{"total":96636764160,"available":96411815936,"internally_reserved":0,"allocated":151748608,"data_stored":146546262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575410,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":201300,"kb_used_data":143748,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94170540,"statfs":{"total":96636764160,"available":96430632960,"internally_reserved":0,"allocated":147197952,"data_stored":142796807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25833472,"data_stored":25645853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6983680,"data_stored":6928219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":116109312,"data_stored":113213576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29499392,"data_stored":29284181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":95399936,"data_stored":94049345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34000896,"data_stored":33800787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":43352064,"data_stored":42014456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24076288,"data_stored":23704763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":134108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":180589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":4558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":6362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21012480,"data_stored":21011665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6340608,"data_stored":6336569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:22:00.023 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:22:00.364 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:22:00.364 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":265,"fsid":"6fe4ca1d-13c4-4ac4-bffb-6ad3069e447d","created":"2024-09-12T00:35:10.203939+0000","modified":"2024-09-12T01:03:41.543080+0000","last_up_change":"2024-09-12T00:35:22.610801+0000","last_in_change":"2024-09-12T00:35:12.490394+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":15,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:35:23.354290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:35:28.516192+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T00:35:42.458614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T00:35:44.272074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T00:35:46.048571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T00:35:48.260319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T00:35:49.974973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T00:35:52.098471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-12T00:51:03.716984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"254","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-12T00:52:35.845396+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"257","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-12T00:52:38.500062+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"260","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-12T01:03:39.128701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"265","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba70ea6f-e898-4fa5-b77c-fe7610a092ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2477739226},{"type":"v1","addr":"172.21.15.70:6825","nonce":2477739226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2477739226},{"type":"v1","addr":"172.21.15.70:6827","nonce":2477739226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2477739226},{"type":"v1","addr":"172.21.15.70:6831","nonce":2477739226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2477739226},{"type":"v1","addr":"172.21.15.70:6829","nonce":2477739226}]},"public_addr":"172.21.15.70:6825/2477739226","cluster_addr":"172.21.15.70:6827/2477739226","heartbeat_back_addr":"172.21.15.70:6831/2477739226","heartbeat_front_addr":"172.21.15.70:6829/2477739226","state":["exists","up"]},{"osd":1,"uuid":"7297d677-8ba5-41c6-b527-d2f3478cf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":1979013808},{"type":"v1","addr":"172.21.15.70:6817","nonce":1979013808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1979013808},{"type":"v1","addr":"172.21.15.70:6819","nonce":1979013808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1979013808},{"type":"v1","addr":"172.21.15.70:6823","nonce":1979013808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1979013808},{"type":"v1","addr":"172.21.15.70:6821","nonce":1979013808}]},"public_addr":"172.21.15.70:6817/1979013808","cluster_addr":"172.21.15.70:6819/1979013808","heartbeat_back_addr":"172.21.15.70:6823/1979013808","heartbeat_front_addr":"172.21.15.70:6821/1979013808","state":["exists","up"]},{"osd":2,"uuid":"6454a4f1-ae89-4c6c-a91e-f11c7cac7bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":936993313},{"type":"v1","addr":"172.21.15.70:6801","nonce":936993313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":936993313},{"type":"v1","addr":"172.21.15.70:6803","nonce":936993313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":936993313},{"type":"v1","addr":"172.21.15.70:6807","nonce":936993313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":936993313},{"type":"v1","addr":"172.21.15.70:6805","nonce":936993313}]},"public_addr":"172.21.15.70:6801/936993313","cluster_addr":"172.21.15.70:6803/936993313","heartbeat_back_addr":"172.21.15.70:6807/936993313","heartbeat_front_addr":"172.21.15.70:6805/936993313","state":["exists","up"]},{"osd":3,"uuid":"5c936a97-b8a6-4ae7-af74-618bd51182cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":276433067},{"type":"v1","addr":"172.21.15.70:6809","nonce":276433067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":276433067},{"type":"v1","addr":"172.21.15.70:6811","nonce":276433067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":276433067},{"type":"v1","addr":"172.21.15.70:6815","nonce":276433067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":276433067},{"type":"v1","addr":"172.21.15.70:6813","nonce":276433067}]},"public_addr":"172.21.15.70:6809/276433067","cluster_addr":"172.21.15.70:6811/276433067","heartbeat_back_addr":"172.21.15.70:6815/276433067","heartbeat_front_addr":"172.21.15.70:6813/276433067","state":["exists","up"]},{"osd":4,"uuid":"c5b466a6-f6ff-4d36-bc87-732dd5ac0c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3474756626},{"type":"v1","addr":"172.21.15.187:6809","nonce":3474756626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3474756626},{"type":"v1","addr":"172.21.15.187:6811","nonce":3474756626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3474756626},{"type":"v1","addr":"172.21.15.187:6815","nonce":3474756626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3474756626},{"type":"v1","addr":"172.21.15.187:6813","nonce":3474756626}]},"public_addr":"172.21.15.187:6809/3474756626","cluster_addr":"172.21.15.187:6811/3474756626","heartbeat_back_addr":"172.21.15.187:6815/3474756626","heartbeat_front_addr":"172.21.15.187:6813/3474756626","state":["exists","up"]},{"osd":5,"uuid":"aeb3d2d0-34f5-4325-98cc-097e3b839193","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":1546875221},{"type":"v1","addr":"172.21.15.187:6825","nonce":1546875221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1546875221},{"type":"v1","addr":"172.21.15.187:6827","nonce":1546875221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":1546875221},{"type":"v1","addr":"172.21.15.187:6831","nonce":1546875221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":1546875221},{"type":"v1","addr":"172.21.15.187:6829","nonce":1546875221}]},"public_addr":"172.21.15.187:6825/1546875221","cluster_addr":"172.21.15.187:6827/1546875221","heartbeat_back_addr":"172.21.15.187:6831/1546875221","heartbeat_front_addr":"172.21.15.187:6829/1546875221","state":["exists","up"]},{"osd":6,"uuid":"c9895de0-47c9-4b70-84a1-3179ed2e8772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2182256562},{"type":"v1","addr":"172.21.15.187:6817","nonce":2182256562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2182256562},{"type":"v1","addr":"172.21.15.187:6819","nonce":2182256562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2182256562},{"type":"v1","addr":"172.21.15.187:6823","nonce":2182256562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2182256562},{"type":"v1","addr":"172.21.15.187:6821","nonce":2182256562}]},"public_addr":"172.21.15.187:6817/2182256562","cluster_addr":"172.21.15.187:6819/2182256562","heartbeat_back_addr":"172.21.15.187:6823/2182256562","heartbeat_front_addr":"172.21.15.187:6821/2182256562","state":["exists","up"]},{"osd":7,"uuid":"791cef60-f4d7-4656-b446-49116d64bf35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":354474645},{"type":"v1","addr":"172.21.15.187:6801","nonce":354474645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":354474645},{"type":"v1","addr":"172.21.15.187:6803","nonce":354474645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":354474645},{"type":"v1","addr":"172.21.15.187:6807","nonce":354474645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":354474645},{"type":"v1","addr":"172.21.15.187:6805","nonce":354474645}]},"public_addr":"172.21.15.187:6801/354474645","cluster_addr":"172.21.15.187:6803/354474645","heartbeat_back_addr":"172.21.15.187:6807/354474645","heartbeat_front_addr":"172.21.15.187:6805/354474645","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:19.522527+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:19.550700+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:18.810225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:19.567260+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:18.975276+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:19.654766+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:19.126591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:35:18.913839+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":2}]},{"pgid":"3.15","mappings":[{"from":7,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2},{"from":3,"to":5}]},{"pgid":"67.1e","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:22:01.386 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T01:22:01.386 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:22:01.550 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:22:01.550 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:22:01.551 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:22:01.567 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T01:22:01.870 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T01:22:01.889 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T01:22:01.890 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:22:02.033 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:22:02.033 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:22:02.033 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:22:02.051 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T01:22:02.337 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T01:22:02.356 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T01:22:02.356 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:22:02.504 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:22:02.504 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:22:02.504 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:22:02.521 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T01:22:02.812 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T01:22:02.829 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T01:22:02.830 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:22:02.977 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:22:02.978 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:22:02.978 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:22:02.993 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T01:22:03.282 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T01:22:03.300 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T01:22:03.300 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:22:03.439 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:22:03.439 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:22:03.439 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:22:03.454 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T01:22:03.738 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T01:22:03.756 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T01:22:03.757 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:22:03.898 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:22:03.898 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:22:03.898 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:22:03.914 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T01:22:04.194 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T01:22:04.213 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T01:22:04.213 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:22:04.355 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:22:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:22:04.356 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:22:04.371 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T01:22:04.664 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T01:22:04.683 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T01:22:04.683 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:22:04.835 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:22:04.835 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:22:04.835 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:22:04.852 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T01:22:05.131 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T01:22:05.149 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:22:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:22:05.497 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-12T01:22:05.502 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":1660,"stamp":"2024-09-12T01:22:05.142680+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75758925,"num_objects":722,"num_object_clones":0,"num_object_copies":1444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":722,"num_whiteouts":0,"num_read":179342,"num_read_kb":2456104,"num_write":142298,"num_write_kb":2416867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13473,"ondisk_log_size":13473,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1445464,"kb_used_data":174808,"kb_used_omap":12,"kb_used_meta":1269555,"kb_avail":753529256,"statfs":{"total":773094113280,"available":771613958144,"internally_reserved":0,"allocated":179003392,"data_stored":165560350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1300024880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-644610641,"num_objects":-4063,"num_object_clones":0,"num_object_copies":-8126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4063,"num_whiteouts":0,"num_read":4552,"num_read_kb":4087,"num_write":4314,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.018199"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:43.558042+0000","last_change":"2024-09-12T01:03:40.585433+0000","last_active":"2024-09-12T01:18:43.558042+0000","last_peered":"2024-09-12T01:18:43.558042+0000","last_clean":"2024-09-12T01:18:43.558042+0000","last_became_active":"2024-09-12T01:03:40.584744+0000","last_became_peered":"2024-09-12T01:03:40.584744+0000","last_unstale":"2024-09-12T01:18:43.558042+0000","last_undegraded":"2024-09-12T01:18:43.558042+0000","last_fullsized":"2024-09-12T01:18:43.558042+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:08.339816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.544106+0000","last_change":"2024-09-12T00:52:40.345897+0000","last_active":"2024-09-12T01:17:43.544106+0000","last_peered":"2024-09-12T01:17:43.544106+0000","last_clean":"2024-09-12T01:17:43.544106+0000","last_became_active":"2024-09-12T00:52:40.345120+0000","last_became_peered":"2024-09-12T00:52:40.345120+0000","last_unstale":"2024-09-12T01:17:43.544106+0000","last_undegraded":"2024-09-12T01:17:43.544106+0000","last_fullsized":"2024-09-12T01:17:43.544106+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:08.139060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"265'3","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:08.606428+0000","last_change":"2024-09-12T00:52:37.282365+0000","last_active":"2024-09-12T01:20:08.606428+0000","last_peered":"2024-09-12T01:20:08.606428+0000","last_clean":"2024-09-12T01:20:08.606428+0000","last_became_active":"2024-09-12T00:52:37.276676+0000","last_became_peered":"2024-09-12T00:52:37.276676+0000","last_unstale":"2024-09-12T01:20:08.606428+0000","last_undegraded":"2024-09-12T01:20:08.606428+0000","last_fullsized":"2024-09-12T01:20:08.606428+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:49.462408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'38","reported_seq":155,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.558454+0000","last_change":"2024-09-12T00:51:04.999562+0000","last_active":"2024-09-12T01:18:13.558454+0000","last_peered":"2024-09-12T01:18:13.558454+0000","last_clean":"2024-09-12T01:18:13.558454+0000","last_became_active":"2024-09-12T00:51:04.998763+0000","last_became_peered":"2024-09-12T00:51:04.998763+0000","last_unstale":"2024-09-12T01:18:13.558454+0000","last_undegraded":"2024-09-12T01:18:13.558454+0000","last_fullsized":"2024-09-12T01:18:13.558454+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:53.376151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":142,"num_write":56,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:40.559635+0000","last_change":"2024-09-12T01:03:40.582702+0000","last_active":"2024-09-12T01:18:40.559635+0000","last_peered":"2024-09-12T01:18:40.559635+0000","last_clean":"2024-09-12T01:18:40.559635+0000","last_became_active":"2024-09-12T01:03:40.581266+0000","last_became_peered":"2024-09-12T01:03:40.581266+0000","last_unstale":"2024-09-12T01:18:40.559635+0000","last_undegraded":"2024-09-12T01:18:40.559635+0000","last_fullsized":"2024-09-12T01:18:40.559635+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:25.009896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"265'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:12.564921+0000","last_change":"2024-09-12T00:52:40.345386+0000","last_active":"2024-09-12T01:20:12.564921+0000","last_peered":"2024-09-12T01:20:12.564921+0000","last_clean":"2024-09-12T01:20:12.564921+0000","last_became_active":"2024-09-12T00:52:40.344674+0000","last_became_peered":"2024-09-12T00:52:40.344674+0000","last_unstale":"2024-09-12T01:20:12.564921+0000","last_undegraded":"2024-09-12T01:20:12.564921+0000","last_fullsized":"2024-09-12T01:20:12.564921+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:43.041640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":10,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'6","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:08.589427+0000","last_change":"2024-09-12T00:52:37.295217+0000","last_active":"2024-09-12T01:20:08.589427+0000","last_peered":"2024-09-12T01:20:08.589427+0000","last_clean":"2024-09-12T01:20:08.589427+0000","last_became_active":"2024-09-12T00:52:37.294438+0000","last_became_peered":"2024-09-12T00:52:37.294438+0000","last_unstale":"2024-09-12T01:20:08.589427+0000","last_undegraded":"2024-09-12T01:20:08.589427+0000","last_fullsized":"2024-09-12T01:20:08.589427+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:53.566890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'42","reported_seq":164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:10.566329+0000","last_change":"2024-09-12T00:51:04.962325+0000","last_active":"2024-09-12T01:19:10.566329+0000","last_peered":"2024-09-12T01:19:10.566329+0000","last_clean":"2024-09-12T01:19:10.566329+0000","last_became_active":"2024-09-12T00:51:04.961677+0000","last_became_peered":"2024-09-12T00:51:04.961677+0000","last_unstale":"2024-09-12T01:19:10.566329+0000","last_undegraded":"2024-09-12T01:19:10.566329+0000","last_fullsized":"2024-09-12T01:19:10.566329+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:51.606282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":168,"num_write":72,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:12.545131+0000","last_change":"2024-09-12T01:03:40.577634+0000","last_active":"2024-09-12T01:18:12.545131+0000","last_peered":"2024-09-12T01:18:12.545131+0000","last_clean":"2024-09-12T01:18:12.545131+0000","last_became_active":"2024-09-12T01:03:40.576550+0000","last_became_peered":"2024-09-12T01:03:40.576550+0000","last_unstale":"2024-09-12T01:18:12.545131+0000","last_undegraded":"2024-09-12T01:18:12.545131+0000","last_fullsized":"2024-09-12T01:18:12.545131+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:55.304251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"265'5","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:53.609270+0000","last_change":"2024-09-12T00:52:40.341193+0000","last_active":"2024-09-12T01:21:53.609270+0000","last_peered":"2024-09-12T01:21:53.609270+0000","last_clean":"2024-09-12T01:21:53.609270+0000","last_became_active":"2024-09-12T00:52:40.337945+0000","last_became_peered":"2024-09-12T00:52:40.337945+0000","last_unstale":"2024-09-12T01:21:53.609270+0000","last_undegraded":"2024-09-12T01:21:53.609270+0000","last_fullsized":"2024-09-12T01:21:53.609270+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:20.078369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:45.560948+0000","last_change":"2024-09-12T00:52:37.297111+0000","last_active":"2024-09-12T01:18:45.560948+0000","last_peered":"2024-09-12T01:18:45.560948+0000","last_clean":"2024-09-12T01:18:45.560948+0000","last_became_active":"2024-09-12T00:52:37.296335+0000","last_became_peered":"2024-09-12T00:52:37.296335+0000","last_unstale":"2024-09-12T01:18:45.560948+0000","last_undegraded":"2024-09-12T01:18:45.560948+0000","last_fullsized":"2024-09-12T01:18:45.560948+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:01.174517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'30","reported_seq":128,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.564783+0000","last_change":"2024-09-12T00:51:04.997842+0000","last_active":"2024-09-12T01:18:38.564783+0000","last_peered":"2024-09-12T01:18:38.564783+0000","last_clean":"2024-09-12T01:18:38.564783+0000","last_became_active":"2024-09-12T00:51:04.992519+0000","last_became_peered":"2024-09-12T00:51:04.992519+0000","last_unstale":"2024-09-12T01:18:38.564783+0000","last_undegraded":"2024-09-12T01:18:38.564783+0000","last_fullsized":"2024-09-12T01:18:38.564783+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:13.960445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":105,"num_write":58,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.579674+0000","last_change":"2024-09-12T01:03:40.587244+0000","last_active":"2024-09-12T01:18:18.579674+0000","last_peered":"2024-09-12T01:18:18.579674+0000","last_clean":"2024-09-12T01:18:18.579674+0000","last_became_active":"2024-09-12T01:03:40.586582+0000","last_became_peered":"2024-09-12T01:03:40.586582+0000","last_unstale":"2024-09-12T01:18:18.579674+0000","last_undegraded":"2024-09-12T01:18:18.579674+0000","last_fullsized":"2024-09-12T01:18:18.579674+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:46.195286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'5","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.135882+0000","last_change":"2024-09-12T00:53:18.616189+0000","last_active":"2024-09-12T01:21:57.135882+0000","last_peered":"2024-09-12T01:21:57.135882+0000","last_clean":"2024-09-12T01:21:57.135882+0000","last_became_active":"2024-09-12T00:53:18.615877+0000","last_became_peered":"2024-09-12T00:53:18.615877+0000","last_unstale":"2024-09-12T01:21:57.135882+0000","last_undegraded":"2024-09-12T01:21:57.135882+0000","last_fullsized":"2024-09-12T01:21:57.135882+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:35.115620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6184,"num_write":5,"num_write_kb":6184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:42.558460+0000","last_change":"2024-09-12T00:52:37.277359+0000","last_active":"2024-09-12T01:19:42.558460+0000","last_peered":"2024-09-12T01:19:42.558460+0000","last_clean":"2024-09-12T01:19:42.558460+0000","last_became_active":"2024-09-12T00:52:37.270357+0000","last_became_peered":"2024-09-12T00:52:37.270357+0000","last_unstale":"2024-09-12T01:19:42.558460+0000","last_undegraded":"2024-09-12T01:19:42.558460+0000","last_fullsized":"2024-09-12T01:19:42.558460+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:03.048579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'29","reported_seq":125,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.585016+0000","last_change":"2024-09-12T00:51:04.995220+0000","last_active":"2024-09-12T01:18:38.585016+0000","last_peered":"2024-09-12T01:18:38.585016+0000","last_clean":"2024-09-12T01:18:38.585016+0000","last_became_active":"2024-09-12T00:51:04.994459+0000","last_became_peered":"2024-09-12T00:51:04.994459+0000","last_unstale":"2024-09-12T01:18:38.585016+0000","last_undegraded":"2024-09-12T01:18:38.585016+0000","last_fullsized":"2024-09-12T01:18:38.585016+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:32.327605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":61,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.601539+0000","last_change":"2024-09-12T01:03:40.594312+0000","last_active":"2024-09-12T01:19:48.601539+0000","last_peered":"2024-09-12T01:19:48.601539+0000","last_clean":"2024-09-12T01:19:48.601539+0000","last_became_active":"2024-09-12T01:03:40.593614+0000","last_became_peered":"2024-09-12T01:03:40.593614+0000","last_unstale":"2024-09-12T01:19:48.601539+0000","last_undegraded":"2024-09-12T01:19:48.601539+0000","last_fullsized":"2024-09-12T01:19:48.601539+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:51.667787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"265'6","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:53.402527+0000","last_change":"2024-09-12T00:52:40.358057+0000","last_active":"2024-09-12T01:21:53.402527+0000","last_peered":"2024-09-12T01:21:53.402527+0000","last_clean":"2024-09-12T01:21:53.402527+0000","last_became_active":"2024-09-12T00:52:40.356507+0000","last_became_peered":"2024-09-12T00:52:40.356507+0000","last_unstale":"2024-09-12T01:21:53.402527+0000","last_undegraded":"2024-09-12T01:21:53.402527+0000","last_fullsized":"2024-09-12T01:21:53.402527+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:07.353171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":17408,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:13.572946+0000","last_change":"2024-09-12T00:52:37.293774+0000","last_active":"2024-09-12T01:19:13.572946+0000","last_peered":"2024-09-12T01:19:13.572946+0000","last_clean":"2024-09-12T01:19:13.572946+0000","last_became_active":"2024-09-12T00:52:37.293298+0000","last_became_peered":"2024-09-12T00:52:37.293298+0000","last_unstale":"2024-09-12T01:19:13.572946+0000","last_undegraded":"2024-09-12T01:19:13.572946+0000","last_fullsized":"2024-09-12T01:19:13.572946+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:24.891123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"262'30","reported_seq":137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.584909+0000","last_change":"2024-09-12T00:51:04.996662+0000","last_active":"2024-09-12T01:18:38.584909+0000","last_peered":"2024-09-12T01:18:38.584909+0000","last_clean":"2024-09-12T01:18:38.584909+0000","last_became_active":"2024-09-12T00:51:04.995863+0000","last_became_peered":"2024-09-12T00:51:04.995863+0000","last_unstale":"2024-09-12T01:18:38.584909+0000","last_undegraded":"2024-09-12T01:18:38.584909+0000","last_fullsized":"2024-09-12T01:18:38.584909+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:04.557157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":123,"num_write":48,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.561295+0000","last_change":"2024-09-12T01:03:40.576503+0000","last_active":"2024-09-12T01:18:18.561295+0000","last_peered":"2024-09-12T01:18:18.561295+0000","last_clean":"2024-09-12T01:18:18.561295+0000","last_became_active":"2024-09-12T01:03:40.575481+0000","last_became_peered":"2024-09-12T01:03:40.575481+0000","last_unstale":"2024-09-12T01:18:18.561295+0000","last_undegraded":"2024-09-12T01:18:18.561295+0000","last_fullsized":"2024-09-12T01:18:18.561295+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:48.119658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:17.559249+0000","last_change":"2024-09-12T00:52:40.350599+0000","last_active":"2024-09-12T01:19:17.559249+0000","last_peered":"2024-09-12T01:19:17.559249+0000","last_clean":"2024-09-12T01:19:17.559249+0000","last_became_active":"2024-09-12T00:52:40.349826+0000","last_became_peered":"2024-09-12T00:52:40.349826+0000","last_unstale":"2024-09-12T01:19:17.559249+0000","last_undegraded":"2024-09-12T01:19:17.559249+0000","last_fullsized":"2024-09-12T01:19:17.559249+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:49.311099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"265'18","reported_seq":86,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.980038+0000","last_change":"2024-09-12T00:52:37.284934+0000","last_active":"2024-09-12T01:21:56.980038+0000","last_peered":"2024-09-12T01:21:56.980038+0000","last_clean":"2024-09-12T01:21:56.980038+0000","last_became_active":"2024-09-12T00:52:37.283600+0000","last_became_peered":"2024-09-12T00:52:37.283600+0000","last_unstale":"2024-09-12T01:21:56.980038+0000","last_undegraded":"2024-09-12T01:21:56.980038+0000","last_fullsized":"2024-09-12T01:21:56.980038+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:50.299864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":56328,"num_write":28,"num_write_kb":20484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"265'59","reported_seq":206,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:37.551106+0000","last_change":"2024-09-12T00:51:04.983051+0000","last_active":"2024-09-12T01:18:37.551106+0000","last_peered":"2024-09-12T01:18:37.551106+0000","last_clean":"2024-09-12T01:18:37.551106+0000","last_became_active":"2024-09-12T00:51:04.982228+0000","last_became_peered":"2024-09-12T00:51:04.982228+0000","last_unstale":"2024-09-12T01:18:37.551106+0000","last_undegraded":"2024-09-12T01:18:37.551106+0000","last_fullsized":"2024-09-12T01:18:37.551106+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:07.565984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":210,"num_write":106,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.785889+0000","last_change":"2024-09-12T01:03:40.569067+0000","last_active":"2024-09-12T01:18:42.785889+0000","last_peered":"2024-09-12T01:18:42.785889+0000","last_clean":"2024-09-12T01:18:42.785889+0000","last_became_active":"2024-09-12T01:03:40.568346+0000","last_became_peered":"2024-09-12T01:03:40.568346+0000","last_unstale":"2024-09-12T01:18:42.785889+0000","last_undegraded":"2024-09-12T01:18:42.785889+0000","last_fullsized":"2024-09-12T01:18:42.785889+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:12.448021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"265'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:12.570529+0000","last_change":"2024-09-12T00:52:40.340425+0000","last_active":"2024-09-12T01:20:12.570529+0000","last_peered":"2024-09-12T01:20:12.570529+0000","last_clean":"2024-09-12T01:20:12.570529+0000","last_became_active":"2024-09-12T00:52:40.339627+0000","last_became_peered":"2024-09-12T00:52:40.339627+0000","last_unstale":"2024-09-12T01:20:12.570529+0000","last_undegraded":"2024-09-12T01:20:12.570529+0000","last_fullsized":"2024-09-12T01:20:12.570529+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:05.869695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"262'3","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:37.730433+0000","last_change":"2024-09-12T00:52:37.283996+0000","last_active":"2024-09-12T01:17:37.730433+0000","last_peered":"2024-09-12T01:17:37.730433+0000","last_clean":"2024-09-12T01:17:37.730433+0000","last_became_active":"2024-09-12T00:52:37.283199+0000","last_became_peered":"2024-09-12T00:52:37.283199+0000","last_unstale":"2024-09-12T01:17:37.730433+0000","last_undegraded":"2024-09-12T01:17:37.730433+0000","last_fullsized":"2024-09-12T01:17:37.730433+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:03.588195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"265'5","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.689244+0000","last_change":"2024-09-12T00:51:04.988358+0000","last_active":"2024-09-12T01:19:18.689244+0000","last_peered":"2024-09-12T01:19:18.689244+0000","last_clean":"2024-09-12T01:19:18.689244+0000","last_became_active":"2024-09-12T00:51:04.981675+0000","last_became_peered":"2024-09-12T00:51:04.981675+0000","last_unstale":"2024-09-12T01:19:18.689244+0000","last_undegraded":"2024-09-12T01:19:18.689244+0000","last_fullsized":"2024-09-12T01:19:18.689244+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:29.580737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.785967+0000","last_change":"2024-09-12T01:03:40.577284+0000","last_active":"2024-09-12T01:18:42.785967+0000","last_peered":"2024-09-12T01:18:42.785967+0000","last_clean":"2024-09-12T01:18:42.785967+0000","last_became_active":"2024-09-12T01:03:40.576430+0000","last_became_peered":"2024-09-12T01:03:40.576430+0000","last_unstale":"2024-09-12T01:18:42.785967+0000","last_undegraded":"2024-09-12T01:18:42.785967+0000","last_fullsized":"2024-09-12T01:18:42.785967+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:37.105480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:13.607494+0000","last_change":"2024-09-12T00:52:40.346703+0000","last_active":"2024-09-12T01:20:13.607494+0000","last_peered":"2024-09-12T01:20:13.607494+0000","last_clean":"2024-09-12T01:20:13.607494+0000","last_became_active":"2024-09-12T00:52:40.345995+0000","last_became_peered":"2024-09-12T00:52:40.345995+0000","last_unstale":"2024-09-12T01:20:13.607494+0000","last_undegraded":"2024-09-12T01:20:13.607494+0000","last_fullsized":"2024-09-12T01:20:13.607494+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:53.845660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'2","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:08.587182+0000","last_change":"2024-09-12T00:52:37.300110+0000","last_active":"2024-09-12T01:20:08.587182+0000","last_peered":"2024-09-12T01:20:08.587182+0000","last_clean":"2024-09-12T01:20:08.587182+0000","last_became_active":"2024-09-12T00:52:37.299604+0000","last_became_peered":"2024-09-12T00:52:37.299604+0000","last_unstale":"2024-09-12T01:20:08.587182+0000","last_undegraded":"2024-09-12T01:20:08.587182+0000","last_fullsized":"2024-09-12T01:20:08.587182+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:04.899567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'41","reported_seq":157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.553749+0000","last_change":"2024-09-12T00:51:04.969892+0000","last_active":"2024-09-12T01:17:43.553749+0000","last_peered":"2024-09-12T01:17:43.553749+0000","last_clean":"2024-09-12T01:17:43.553749+0000","last_became_active":"2024-09-12T00:51:04.968673+0000","last_became_peered":"2024-09-12T00:51:04.968673+0000","last_unstale":"2024-09-12T01:17:43.553749+0000","last_undegraded":"2024-09-12T01:17:43.553749+0000","last_fullsized":"2024-09-12T01:17:43.553749+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:09.083642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":145,"num_write":79,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.553934+0000","last_change":"2024-09-12T01:03:40.591077+0000","last_active":"2024-09-12T01:17:43.553934+0000","last_peered":"2024-09-12T01:17:43.553934+0000","last_clean":"2024-09-12T01:17:43.553934+0000","last_became_active":"2024-09-12T01:03:40.590440+0000","last_became_peered":"2024-09-12T01:03:40.590440+0000","last_unstale":"2024-09-12T01:17:43.553934+0000","last_undegraded":"2024-09-12T01:17:43.553934+0000","last_fullsized":"2024-09-12T01:17:43.553934+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:52.159624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.594467+0000","last_change":"2024-09-12T00:52:40.363386+0000","last_active":"2024-09-12T01:19:18.594467+0000","last_peered":"2024-09-12T01:19:18.594467+0000","last_clean":"2024-09-12T01:19:18.594467+0000","last_became_active":"2024-09-12T00:52:40.359069+0000","last_became_peered":"2024-09-12T00:52:40.359069+0000","last_unstale":"2024-09-12T01:19:18.594467+0000","last_undegraded":"2024-09-12T01:19:18.594467+0000","last_fullsized":"2024-09-12T01:19:18.594467+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:47.963386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"262'5","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.553521+0000","last_change":"2024-09-12T00:52:37.274416+0000","last_active":"2024-09-12T01:18:23.553521+0000","last_peered":"2024-09-12T01:18:23.553521+0000","last_clean":"2024-09-12T01:18:23.553521+0000","last_became_active":"2024-09-12T00:52:37.273684+0000","last_became_peered":"2024-09-12T00:52:37.273684+0000","last_unstale":"2024-09-12T01:18:23.553521+0000","last_undegraded":"2024-09-12T01:18:23.553521+0000","last_fullsized":"2024-09-12T01:18:23.553521+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:25.538379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":25602,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'50","reported_seq":182,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.551251+0000","last_change":"2024-09-12T00:51:04.999190+0000","last_active":"2024-09-12T01:17:43.551251+0000","last_peered":"2024-09-12T01:17:43.551251+0000","last_clean":"2024-09-12T01:17:43.551251+0000","last_became_active":"2024-09-12T00:51:04.993887+0000","last_became_peered":"2024-09-12T00:51:04.993887+0000","last_unstale":"2024-09-12T01:17:43.551251+0000","last_undegraded":"2024-09-12T01:17:43.551251+0000","last_fullsized":"2024-09-12T01:17:43.551251+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:49.567739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":256,"num_read_kb":177,"num_write":91,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:40.546741+0000","last_change":"2024-09-12T01:03:40.581951+0000","last_active":"2024-09-12T01:17:40.546741+0000","last_peered":"2024-09-12T01:17:40.546741+0000","last_clean":"2024-09-12T01:17:40.546741+0000","last_became_active":"2024-09-12T01:03:40.580348+0000","last_became_peered":"2024-09-12T01:03:40.580348+0000","last_unstale":"2024-09-12T01:17:40.546741+0000","last_undegraded":"2024-09-12T01:17:40.546741+0000","last_fullsized":"2024-09-12T01:17:40.546741+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:17.235776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"262'8","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:28.582340+0000","last_change":"2024-09-12T00:52:40.366179+0000","last_active":"2024-09-12T01:18:28.582340+0000","last_peered":"2024-09-12T01:18:28.582340+0000","last_clean":"2024-09-12T01:18:28.582340+0000","last_became_active":"2024-09-12T00:52:40.363347+0000","last_became_peered":"2024-09-12T00:52:40.363347+0000","last_unstale":"2024-09-12T01:18:28.582340+0000","last_undegraded":"2024-09-12T01:18:28.582340+0000","last_fullsized":"2024-09-12T01:18:28.582340+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:06.883385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":21506,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:12.793072+0000","last_change":"2024-09-12T00:52:37.288899+0000","last_active":"2024-09-12T01:19:12.793072+0000","last_peered":"2024-09-12T01:19:12.793072+0000","last_clean":"2024-09-12T01:19:12.793072+0000","last_became_active":"2024-09-12T00:52:37.288074+0000","last_became_peered":"2024-09-12T00:52:37.288074+0000","last_unstale":"2024-09-12T01:19:12.793072+0000","last_undegraded":"2024-09-12T01:19:12.793072+0000","last_fullsized":"2024-09-12T01:19:12.793072+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:03.061143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'39","reported_seq":155,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.571162+0000","last_change":"2024-09-12T00:51:04.982973+0000","last_active":"2024-09-12T01:17:43.571162+0000","last_peered":"2024-09-12T01:17:43.571162+0000","last_clean":"2024-09-12T01:17:43.571162+0000","last_became_active":"2024-09-12T00:51:04.976345+0000","last_became_peered":"2024-09-12T00:51:04.976345+0000","last_unstale":"2024-09-12T01:17:43.571162+0000","last_undegraded":"2024-09-12T01:17:43.571162+0000","last_fullsized":"2024-09-12T01:17:43.571162+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:17.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":155,"num_write":57,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:42.771617+0000","last_change":"2024-09-12T01:03:40.561539+0000","last_active":"2024-09-12T01:17:42.771617+0000","last_peered":"2024-09-12T01:17:42.771617+0000","last_clean":"2024-09-12T01:17:42.771617+0000","last_became_active":"2024-09-12T01:03:40.560777+0000","last_became_peered":"2024-09-12T01:03:40.560777+0000","last_unstale":"2024-09-12T01:17:42.771617+0000","last_undegraded":"2024-09-12T01:17:42.771617+0000","last_fullsized":"2024-09-12T01:17:42.771617+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:37.457658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"265'3","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:43.411382+0000","last_change":"2024-09-12T00:52:40.353226+0000","last_active":"2024-09-12T01:21:43.411382+0000","last_peered":"2024-09-12T01:21:43.411382+0000","last_clean":"2024-09-12T01:21:43.411382+0000","last_became_active":"2024-09-12T00:52:40.352292+0000","last_became_peered":"2024-09-12T00:52:40.352292+0000","last_unstale":"2024-09-12T01:21:43.411382+0000","last_undegraded":"2024-09-12T01:21:43.411382+0000","last_fullsized":"2024-09-12T01:21:43.411382+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:37.809308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:15.567423+0000","last_change":"2024-09-12T00:52:37.286387+0000","last_active":"2024-09-12T01:19:15.567423+0000","last_peered":"2024-09-12T01:19:15.567423+0000","last_clean":"2024-09-12T01:19:15.567423+0000","last_became_active":"2024-09-12T00:52:37.284325+0000","last_became_peered":"2024-09-12T00:52:37.284325+0000","last_unstale":"2024-09-12T01:19:15.567423+0000","last_undegraded":"2024-09-12T01:19:15.567423+0000","last_fullsized":"2024-09-12T01:19:15.567423+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:25.766191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'20","reported_seq":101,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:40.546841+0000","last_change":"2024-09-12T00:51:04.962264+0000","last_active":"2024-09-12T01:17:40.546841+0000","last_peered":"2024-09-12T01:17:40.546841+0000","last_clean":"2024-09-12T01:17:40.546841+0000","last_became_active":"2024-09-12T00:51:04.961563+0000","last_became_peered":"2024-09-12T00:51:04.961563+0000","last_unstale":"2024-09-12T01:17:40.546841+0000","last_undegraded":"2024-09-12T01:17:40.546841+0000","last_fullsized":"2024-09-12T01:17:40.546841+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:40.487439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":68,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.543964+0000","last_change":"2024-09-12T01:03:40.580752+0000","last_active":"2024-09-12T01:17:43.543964+0000","last_peered":"2024-09-12T01:17:43.543964+0000","last_clean":"2024-09-12T01:17:43.543964+0000","last_became_active":"2024-09-12T01:03:40.580083+0000","last_became_peered":"2024-09-12T01:03:40.580083+0000","last_unstale":"2024-09-12T01:17:43.543964+0000","last_undegraded":"2024-09-12T01:17:43.543964+0000","last_fullsized":"2024-09-12T01:17:43.543964+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:14.771651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'5","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:42.585420+0000","last_change":"2024-09-12T00:52:40.344308+0000","last_active":"2024-09-12T01:21:42.585420+0000","last_peered":"2024-09-12T01:21:42.585420+0000","last_clean":"2024-09-12T01:21:42.585420+0000","last_became_active":"2024-09-12T00:52:40.336368+0000","last_became_peered":"2024-09-12T00:52:40.336368+0000","last_unstale":"2024-09-12T01:21:42.585420+0000","last_undegraded":"2024-09-12T01:21:42.585420+0000","last_fullsized":"2024-09-12T01:21:42.585420+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:44.066859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:13.573252+0000","last_change":"2024-09-12T00:52:37.299654+0000","last_active":"2024-09-12T01:19:13.573252+0000","last_peered":"2024-09-12T01:19:13.573252+0000","last_clean":"2024-09-12T01:19:13.573252+0000","last_became_active":"2024-09-12T00:52:37.295945+0000","last_became_peered":"2024-09-12T00:52:37.295945+0000","last_unstale":"2024-09-12T01:19:13.573252+0000","last_undegraded":"2024-09-12T01:19:13.573252+0000","last_fullsized":"2024-09-12T01:19:13.573252+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:17.464675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"265'27","reported_seq":124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.791931+0000","last_change":"2024-09-12T00:51:04.976524+0000","last_active":"2024-09-12T01:19:07.791931+0000","last_peered":"2024-09-12T01:19:07.791931+0000","last_clean":"2024-09-12T01:19:07.791931+0000","last_became_active":"2024-09-12T00:51:04.975831+0000","last_became_peered":"2024-09-12T00:51:04.975831+0000","last_unstale":"2024-09-12T01:19:07.791931+0000","last_undegraded":"2024-09-12T01:19:07.791931+0000","last_fullsized":"2024-09-12T01:19:07.791931+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:24.928244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":101,"num_write":53,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.578542+0000","last_change":"2024-09-12T01:03:40.580652+0000","last_active":"2024-09-12T01:18:13.578542+0000","last_peered":"2024-09-12T01:18:13.578542+0000","last_clean":"2024-09-12T01:18:13.578542+0000","last_became_active":"2024-09-12T01:03:40.579923+0000","last_became_peered":"2024-09-12T01:03:40.579923+0000","last_unstale":"2024-09-12T01:18:13.578542+0000","last_undegraded":"2024-09-12T01:18:13.578542+0000","last_fullsized":"2024-09-12T01:18:13.578542+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:55.542873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.562207+0000","last_change":"2024-09-12T00:52:40.350130+0000","last_active":"2024-09-12T01:18:23.562207+0000","last_peered":"2024-09-12T01:18:23.562207+0000","last_clean":"2024-09-12T01:18:23.562207+0000","last_became_active":"2024-09-12T00:52:40.349363+0000","last_became_peered":"2024-09-12T00:52:40.349363+0000","last_unstale":"2024-09-12T01:18:23.562207+0000","last_undegraded":"2024-09-12T01:18:23.562207+0000","last_fullsized":"2024-09-12T01:18:23.562207+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:18.586220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.739114+0000","last_change":"2024-09-12T00:52:37.278835+0000","last_active":"2024-09-12T01:18:17.739114+0000","last_peered":"2024-09-12T01:18:17.739114+0000","last_clean":"2024-09-12T01:18:17.739114+0000","last_became_active":"2024-09-12T00:52:37.270958+0000","last_became_peered":"2024-09-12T00:52:37.270958+0000","last_unstale":"2024-09-12T01:18:17.739114+0000","last_undegraded":"2024-09-12T01:18:17.739114+0000","last_fullsized":"2024-09-12T01:18:17.739114+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:49.398281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'19","reported_seq":96,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.791884+0000","last_change":"2024-09-12T00:51:04.976492+0000","last_active":"2024-09-12T01:19:07.791884+0000","last_peered":"2024-09-12T01:19:07.791884+0000","last_clean":"2024-09-12T01:19:07.791884+0000","last_became_active":"2024-09-12T00:51:04.975763+0000","last_became_peered":"2024-09-12T00:51:04.975763+0000","last_unstale":"2024-09-12T01:19:07.791884+0000","last_undegraded":"2024-09-12T01:19:07.791884+0000","last_fullsized":"2024-09-12T01:19:07.791884+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:51.238336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.558357+0000","last_change":"2024-09-12T01:03:40.586341+0000","last_active":"2024-09-12T01:18:13.558357+0000","last_peered":"2024-09-12T01:18:13.558357+0000","last_clean":"2024-09-12T01:18:13.558357+0000","last_became_active":"2024-09-12T01:03:40.581062+0000","last_became_peered":"2024-09-12T01:03:40.581062+0000","last_unstale":"2024-09-12T01:18:13.558357+0000","last_undegraded":"2024-09-12T01:18:13.558357+0000","last_fullsized":"2024-09-12T01:18:13.558357+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:40.147480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'10","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.659887+0000","last_change":"2024-09-12T00:52:40.344506+0000","last_active":"2024-09-12T01:21:57.659887+0000","last_peered":"2024-09-12T01:21:57.659887+0000","last_clean":"2024-09-12T01:21:57.659887+0000","last_became_active":"2024-09-12T00:52:40.343871+0000","last_became_peered":"2024-09-12T00:52:40.343871+0000","last_unstale":"2024-09-12T01:21:57.659887+0000","last_undegraded":"2024-09-12T01:21:57.659887+0000","last_fullsized":"2024-09-12T01:21:57.659887+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:04.586939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":22610,"num_write":15,"num_write_kb":6184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.579601+0000","last_change":"2024-09-12T00:52:37.281395+0000","last_active":"2024-09-12T01:18:18.579601+0000","last_peered":"2024-09-12T01:18:18.579601+0000","last_clean":"2024-09-12T01:18:18.579601+0000","last_became_active":"2024-09-12T00:52:37.276237+0000","last_became_peered":"2024-09-12T00:52:37.276237+0000","last_unstale":"2024-09-12T01:18:18.579601+0000","last_undegraded":"2024-09-12T01:18:18.579601+0000","last_fullsized":"2024-09-12T01:18:18.579601+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:50.583225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'15","reported_seq":87,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.571778+0000","last_change":"2024-09-12T00:51:04.995560+0000","last_active":"2024-09-12T01:19:08.571778+0000","last_peered":"2024-09-12T01:19:08.571778+0000","last_clean":"2024-09-12T01:19:08.571778+0000","last_became_active":"2024-09-12T00:51:04.994606+0000","last_became_peered":"2024-09-12T00:51:04.994606+0000","last_unstale":"2024-09-12T01:19:08.571778+0000","last_undegraded":"2024-09-12T01:19:08.571778+0000","last_fullsized":"2024-09-12T01:19:08.571778+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:54.892667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:48.552306+0000","last_change":"2024-09-12T01:03:40.582311+0000","last_active":"2024-09-12T01:17:48.552306+0000","last_peered":"2024-09-12T01:17:48.552306+0000","last_clean":"2024-09-12T01:17:48.552306+0000","last_became_active":"2024-09-12T01:03:40.581586+0000","last_became_peered":"2024-09-12T01:03:40.581586+0000","last_unstale":"2024-09-12T01:17:48.552306+0000","last_undegraded":"2024-09-12T01:17:48.552306+0000","last_fullsized":"2024-09-12T01:17:48.552306+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:01.950258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'7","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:43.398671+0000","last_change":"2024-09-12T00:52:40.366365+0000","last_active":"2024-09-12T01:20:43.398671+0000","last_peered":"2024-09-12T01:20:43.398671+0000","last_clean":"2024-09-12T01:20:43.398671+0000","last_became_active":"2024-09-12T00:52:40.363072+0000","last_became_peered":"2024-09-12T00:52:40.363072+0000","last_unstale":"2024-09-12T01:20:43.398671+0000","last_undegraded":"2024-09-12T01:20:43.398671+0000","last_fullsized":"2024-09-12T01:20:43.398671+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:34.771598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9232,"num_write":7,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.546176+0000","last_change":"2024-09-12T00:52:37.291760+0000","last_active":"2024-09-12T01:18:17.546176+0000","last_peered":"2024-09-12T01:18:17.546176+0000","last_clean":"2024-09-12T01:18:17.546176+0000","last_became_active":"2024-09-12T00:52:37.291045+0000","last_became_peered":"2024-09-12T00:52:37.291045+0000","last_unstale":"2024-09-12T01:18:17.546176+0000","last_undegraded":"2024-09-12T01:18:17.546176+0000","last_fullsized":"2024-09-12T01:18:17.546176+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:59.783464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'47","reported_seq":178,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.750363+0000","last_change":"2024-09-12T00:51:04.981572+0000","last_active":"2024-09-12T01:19:07.750363+0000","last_peered":"2024-09-12T01:19:07.750363+0000","last_clean":"2024-09-12T01:19:07.750363+0000","last_became_active":"2024-09-12T00:51:04.980601+0000","last_became_peered":"2024-09-12T00:51:04.980601+0000","last_unstale":"2024-09-12T01:19:07.750363+0000","last_undegraded":"2024-09-12T01:19:07.750363+0000","last_fullsized":"2024-09-12T01:19:07.750363+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:04.644563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":177,"num_write":81,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.578495+0000","last_change":"2024-09-12T01:03:40.580511+0000","last_active":"2024-09-12T01:18:13.578495+0000","last_peered":"2024-09-12T01:18:13.578495+0000","last_clean":"2024-09-12T01:18:13.578495+0000","last_became_active":"2024-09-12T01:03:40.579772+0000","last_became_peered":"2024-09-12T01:03:40.579772+0000","last_unstale":"2024-09-12T01:18:13.578495+0000","last_undegraded":"2024-09-12T01:18:13.578495+0000","last_fullsized":"2024-09-12T01:18:13.578495+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:33.962377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'3","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:42.383530+0000","last_change":"2024-09-12T00:52:40.347889+0000","last_active":"2024-09-12T01:20:42.383530+0000","last_peered":"2024-09-12T01:20:42.383530+0000","last_clean":"2024-09-12T01:20:42.383530+0000","last_became_active":"2024-09-12T00:52:40.347156+0000","last_became_peered":"2024-09-12T00:52:40.347156+0000","last_unstale":"2024-09-12T01:20:42.383530+0000","last_undegraded":"2024-09-12T01:20:42.383530+0000","last_fullsized":"2024-09-12T01:20:42.383530+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:29.288092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.552252+0000","last_change":"2024-09-12T00:52:37.291590+0000","last_active":"2024-09-12T01:18:18.552252+0000","last_peered":"2024-09-12T01:18:18.552252+0000","last_clean":"2024-09-12T01:18:18.552252+0000","last_became_active":"2024-09-12T00:52:37.290858+0000","last_became_peered":"2024-09-12T00:52:37.290858+0000","last_unstale":"2024-09-12T01:18:18.552252+0000","last_undegraded":"2024-09-12T01:18:18.552252+0000","last_fullsized":"2024-09-12T01:18:18.552252+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:11.150903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'11","reported_seq":79,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.591802+0000","last_change":"2024-09-12T00:51:04.989507+0000","last_active":"2024-09-12T01:19:08.591802+0000","last_peered":"2024-09-12T01:19:08.591802+0000","last_clean":"2024-09-12T01:19:08.591802+0000","last_became_active":"2024-09-12T00:51:04.988521+0000","last_became_peered":"2024-09-12T00:51:04.988521+0000","last_unstale":"2024-09-12T01:19:08.591802+0000","last_undegraded":"2024-09-12T01:19:08.591802+0000","last_fullsized":"2024-09-12T01:19:08.591802+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:52.795091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:55.563144+0000","last_change":"2024-09-12T01:03:40.592444+0000","last_active":"2024-09-12T01:18:55.563144+0000","last_peered":"2024-09-12T01:18:55.563144+0000","last_clean":"2024-09-12T01:18:55.563144+0000","last_became_active":"2024-09-12T01:03:40.591869+0000","last_became_peered":"2024-09-12T01:03:40.591869+0000","last_unstale":"2024-09-12T01:18:55.563144+0000","last_undegraded":"2024-09-12T01:18:55.563144+0000","last_fullsized":"2024-09-12T01:18:55.563144+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:13.806273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.600454+0000","last_change":"2024-09-12T00:52:40.345399+0000","last_active":"2024-09-12T01:19:43.600454+0000","last_peered":"2024-09-12T01:19:43.600454+0000","last_clean":"2024-09-12T01:19:43.600454+0000","last_became_active":"2024-09-12T00:52:40.344566+0000","last_became_peered":"2024-09-12T00:52:40.344566+0000","last_unstale":"2024-09-12T01:19:43.600454+0000","last_undegraded":"2024-09-12T01:19:43.600454+0000","last_fullsized":"2024-09-12T01:19:43.600454+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:08.365603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.799024+0000","last_change":"2024-09-12T00:52:37.289694+0000","last_active":"2024-09-12T01:19:37.799024+0000","last_peered":"2024-09-12T01:19:37.799024+0000","last_clean":"2024-09-12T01:19:37.799024+0000","last_became_active":"2024-09-12T00:52:37.282987+0000","last_became_peered":"2024-09-12T00:52:37.282987+0000","last_unstale":"2024-09-12T01:19:37.799024+0000","last_undegraded":"2024-09-12T01:19:37.799024+0000","last_fullsized":"2024-09-12T01:19:37.799024+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:53.081978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'40","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.578586+0000","last_change":"2024-09-12T00:51:05.001750+0000","last_active":"2024-09-12T01:18:13.578586+0000","last_peered":"2024-09-12T01:18:13.578586+0000","last_clean":"2024-09-12T01:18:13.578586+0000","last_became_active":"2024-09-12T00:51:05.001162+0000","last_became_peered":"2024-09-12T00:51:05.001162+0000","last_unstale":"2024-09-12T01:18:13.578586+0000","last_undegraded":"2024-09-12T01:18:13.578586+0000","last_fullsized":"2024-09-12T01:18:13.578586+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:51.741336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":142,"num_write":73,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:27.796530+0000","last_change":"2024-09-12T01:03:40.558405+0000","last_active":"2024-09-12T01:19:27.796530+0000","last_peered":"2024-09-12T01:19:27.796530+0000","last_clean":"2024-09-12T01:19:27.796530+0000","last_became_active":"2024-09-12T01:03:40.551803+0000","last_became_peered":"2024-09-12T01:03:40.551803+0000","last_unstale":"2024-09-12T01:19:27.796530+0000","last_undegraded":"2024-09-12T01:19:27.796530+0000","last_fullsized":"2024-09-12T01:19:27.796530+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:06.456829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.600404+0000","last_change":"2024-09-12T00:52:40.358765+0000","last_active":"2024-09-12T01:19:43.600404+0000","last_peered":"2024-09-12T01:19:43.600404+0000","last_clean":"2024-09-12T01:19:43.600404+0000","last_became_active":"2024-09-12T00:52:40.354387+0000","last_became_peered":"2024-09-12T00:52:40.354387+0000","last_unstale":"2024-09-12T01:19:43.600404+0000","last_undegraded":"2024-09-12T01:19:43.600404+0000","last_fullsized":"2024-09-12T01:19:43.600404+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:13.780637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:40.572945+0000","last_change":"2024-09-12T00:52:37.285727+0000","last_active":"2024-09-12T01:19:40.572945+0000","last_peered":"2024-09-12T01:19:40.572945+0000","last_clean":"2024-09-12T01:19:40.572945+0000","last_became_active":"2024-09-12T00:52:37.285154+0000","last_became_peered":"2024-09-12T00:52:37.285154+0000","last_unstale":"2024-09-12T01:19:40.572945+0000","last_undegraded":"2024-09-12T01:19:40.572945+0000","last_fullsized":"2024-09-12T01:19:40.572945+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:04.603498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'61","reported_seq":212,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.410803+0000","last_change":"2024-09-12T00:51:04.976377+0000","last_active":"2024-09-12T01:19:18.410803+0000","last_peered":"2024-09-12T01:19:18.410803+0000","last_clean":"2024-09-12T01:19:18.410803+0000","last_became_active":"2024-09-12T00:51:04.975583+0000","last_became_peered":"2024-09-12T00:51:04.975583+0000","last_unstale":"2024-09-12T01:19:18.410803+0000","last_undegraded":"2024-09-12T01:19:18.410803+0000","last_fullsized":"2024-09-12T01:19:18.410803+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:40.033682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":309,"num_read_kb":216,"num_write":105,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:52.554219+0000","last_change":"2024-09-12T01:03:40.570955+0000","last_active":"2024-09-12T01:18:52.554219+0000","last_peered":"2024-09-12T01:18:52.554219+0000","last_clean":"2024-09-12T01:18:52.554219+0000","last_became_active":"2024-09-12T01:03:40.569907+0000","last_became_peered":"2024-09-12T01:03:40.569907+0000","last_unstale":"2024-09-12T01:18:52.554219+0000","last_undegraded":"2024-09-12T01:18:52.554219+0000","last_fullsized":"2024-09-12T01:18:52.554219+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:17.110556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.585136+0000","last_change":"2024-09-12T00:52:40.343485+0000","last_active":"2024-09-12T01:19:48.585136+0000","last_peered":"2024-09-12T01:19:48.585136+0000","last_clean":"2024-09-12T01:19:48.585136+0000","last_became_active":"2024-09-12T00:52:40.342703+0000","last_became_peered":"2024-09-12T00:52:40.342703+0000","last_unstale":"2024-09-12T01:19:48.585136+0000","last_undegraded":"2024-09-12T01:19:48.585136+0000","last_fullsized":"2024-09-12T01:19:48.585136+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"265'6","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:53.609196+0000","last_change":"2024-09-12T00:52:37.292687+0000","last_active":"2024-09-12T01:21:53.609196+0000","last_peered":"2024-09-12T01:21:53.609196+0000","last_clean":"2024-09-12T01:21:53.609196+0000","last_became_active":"2024-09-12T00:52:37.292449+0000","last_became_peered":"2024-09-12T00:52:37.292449+0000","last_unstale":"2024-09-12T01:21:53.609196+0000","last_undegraded":"2024-09-12T01:21:53.609196+0000","last_fullsized":"2024-09-12T01:21:53.609196+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:54.986888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'116","reported_seq":403,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:32.106066+0000","last_change":"2024-09-12T00:51:04.985227+0000","last_active":"2024-09-12T01:18:32.106066+0000","last_peered":"2024-09-12T01:18:32.106066+0000","last_clean":"2024-09-12T01:18:32.106066+0000","last_became_active":"2024-09-12T00:51:04.984495+0000","last_became_peered":"2024-09-12T00:51:04.984495+0000","last_unstale":"2024-09-12T01:18:32.106066+0000","last_undegraded":"2024-09-12T01:18:32.106066+0000","last_fullsized":"2024-09-12T01:18:32.106066+0000","mapping_epoch":252,"log_start":"265'100","ondisk_log_start":"265'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:40.069078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":690,"num_read_kb":506,"num_write":167,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:52.788303+0000","last_change":"2024-09-12T01:03:40.566870+0000","last_active":"2024-09-12T01:18:52.788303+0000","last_peered":"2024-09-12T01:18:52.788303+0000","last_clean":"2024-09-12T01:18:52.788303+0000","last_became_active":"2024-09-12T01:03:40.566107+0000","last_became_peered":"2024-09-12T01:03:40.566107+0000","last_unstale":"2024-09-12T01:18:52.788303+0000","last_undegraded":"2024-09-12T01:18:52.788303+0000","last_fullsized":"2024-09-12T01:18:52.788303+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:23.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.600492+0000","last_change":"2024-09-12T00:52:40.367723+0000","last_active":"2024-09-12T01:19:43.600492+0000","last_peered":"2024-09-12T01:19:43.600492+0000","last_clean":"2024-09-12T01:19:43.600492+0000","last_became_active":"2024-09-12T00:52:40.367188+0000","last_became_peered":"2024-09-12T00:52:40.367188+0000","last_unstale":"2024-09-12T01:19:43.600492+0000","last_undegraded":"2024-09-12T01:19:43.600492+0000","last_fullsized":"2024-09-12T01:19:43.600492+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:21.283584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"265'2","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.355886+0000","last_change":"2024-09-12T00:52:37.289836+0000","last_active":"2024-09-12T01:21:57.355886+0000","last_peered":"2024-09-12T01:21:57.355886+0000","last_clean":"2024-09-12T01:21:57.355886+0000","last_became_active":"2024-09-12T00:52:37.281129+0000","last_became_peered":"2024-09-12T00:52:37.281129+0000","last_unstale":"2024-09-12T01:21:57.355886+0000","last_undegraded":"2024-09-12T01:21:57.355886+0000","last_fullsized":"2024-09-12T01:21:57.355886+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:00.364762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"265'9","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:05.551886+0000","last_change":"2024-09-12T00:51:04.984390+0000","last_active":"2024-09-12T01:18:05.551886+0000","last_peered":"2024-09-12T01:18:05.551886+0000","last_clean":"2024-09-12T01:18:05.551886+0000","last_became_active":"2024-09-12T00:51:04.983577+0000","last_became_peered":"2024-09-12T00:51:04.983577+0000","last_unstale":"2024-09-12T01:18:05.551886+0000","last_undegraded":"2024-09-12T01:18:05.551886+0000","last_fullsized":"2024-09-12T01:18:05.551886+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:11.081544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:28.596883+0000","last_change":"2024-09-12T01:03:40.590449+0000","last_active":"2024-09-12T01:19:28.596883+0000","last_peered":"2024-09-12T01:19:28.596883+0000","last_clean":"2024-09-12T01:19:28.596883+0000","last_became_active":"2024-09-12T01:03:40.589838+0000","last_became_peered":"2024-09-12T01:03:40.589838+0000","last_unstale":"2024-09-12T01:19:28.596883+0000","last_undegraded":"2024-09-12T01:19:28.596883+0000","last_fullsized":"2024-09-12T01:19:28.596883+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:53.282415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.744871+0000","last_change":"2024-09-12T00:52:40.357689+0000","last_active":"2024-09-12T01:18:42.744871+0000","last_peered":"2024-09-12T01:18:42.744871+0000","last_clean":"2024-09-12T01:18:42.744871+0000","last_became_active":"2024-09-12T00:52:40.356802+0000","last_became_peered":"2024-09-12T00:52:40.356802+0000","last_unstale":"2024-09-12T01:18:42.744871+0000","last_undegraded":"2024-09-12T01:18:42.744871+0000","last_fullsized":"2024-09-12T01:18:42.744871+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:51.102558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"265'6","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.947096+0000","last_change":"2024-09-12T00:52:37.294017+0000","last_active":"2024-09-12T01:21:56.947096+0000","last_peered":"2024-09-12T01:21:56.947096+0000","last_clean":"2024-09-12T01:21:56.947096+0000","last_became_active":"2024-09-12T00:52:37.293564+0000","last_became_peered":"2024-09-12T00:52:37.293564+0000","last_unstale":"2024-09-12T01:21:56.947096+0000","last_undegraded":"2024-09-12T01:21:56.947096+0000","last_fullsized":"2024-09-12T01:21:56.947096+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:56.643360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3128,"num_write":6,"num_write_kb":3128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"262'16","reported_seq":93,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:08.556985+0000","last_change":"2024-09-12T00:51:04.990981+0000","last_active":"2024-09-12T01:18:08.556985+0000","last_peered":"2024-09-12T01:18:08.556985+0000","last_clean":"2024-09-12T01:18:08.556985+0000","last_became_active":"2024-09-12T00:51:04.981091+0000","last_became_peered":"2024-09-12T00:51:04.981091+0000","last_unstale":"2024-09-12T01:18:08.556985+0000","last_undegraded":"2024-09-12T01:18:08.556985+0000","last_fullsized":"2024-09-12T01:18:08.556985+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:43.002634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:27.796717+0000","last_change":"2024-09-12T01:03:40.566702+0000","last_active":"2024-09-12T01:19:27.796717+0000","last_peered":"2024-09-12T01:19:27.796717+0000","last_clean":"2024-09-12T01:19:27.796717+0000","last_became_active":"2024-09-12T01:03:40.565926+0000","last_became_peered":"2024-09-12T01:03:40.565926+0000","last_unstale":"2024-09-12T01:19:27.796717+0000","last_undegraded":"2024-09-12T01:19:27.796717+0000","last_fullsized":"2024-09-12T01:19:27.796717+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:31.308325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.785653+0000","last_change":"2024-09-12T00:52:40.341080+0000","last_active":"2024-09-12T01:18:42.785653+0000","last_peered":"2024-09-12T01:18:42.785653+0000","last_clean":"2024-09-12T01:18:42.785653+0000","last_became_active":"2024-09-12T00:52:40.340423+0000","last_became_peered":"2024-09-12T00:52:40.340423+0000","last_unstale":"2024-09-12T01:18:42.785653+0000","last_undegraded":"2024-09-12T01:18:42.785653+0000","last_fullsized":"2024-09-12T01:18:42.785653+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:11.370534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"265'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.947626+0000","last_change":"2024-09-12T00:52:37.294639+0000","last_active":"2024-09-12T01:21:56.947626+0000","last_peered":"2024-09-12T01:21:56.947626+0000","last_clean":"2024-09-12T01:21:56.947626+0000","last_became_active":"2024-09-12T00:52:37.293885+0000","last_became_peered":"2024-09-12T00:52:37.293885+0000","last_unstale":"2024-09-12T01:21:56.947626+0000","last_undegraded":"2024-09-12T01:21:56.947626+0000","last_fullsized":"2024-09-12T01:21:56.947626+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:20.571782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'39","reported_seq":151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:19.686513+0000","last_change":"2024-09-12T00:51:04.989066+0000","last_active":"2024-09-12T01:19:19.686513+0000","last_peered":"2024-09-12T01:19:19.686513+0000","last_clean":"2024-09-12T01:19:19.686513+0000","last_became_active":"2024-09-12T00:51:04.988252+0000","last_became_peered":"2024-09-12T00:51:04.988252+0000","last_unstale":"2024-09-12T01:19:19.686513+0000","last_undegraded":"2024-09-12T01:19:19.686513+0000","last_fullsized":"2024-09-12T01:19:19.686513+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:49.691881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":135,"num_write":72,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:27.796591+0000","last_change":"2024-09-12T01:03:40.581034+0000","last_active":"2024-09-12T01:19:27.796591+0000","last_peered":"2024-09-12T01:19:27.796591+0000","last_clean":"2024-09-12T01:19:27.796591+0000","last_became_active":"2024-09-12T01:03:40.580376+0000","last_became_peered":"2024-09-12T01:03:40.580376+0000","last_unstale":"2024-09-12T01:19:27.796591+0000","last_undegraded":"2024-09-12T01:19:27.796591+0000","last_fullsized":"2024-09-12T01:19:27.796591+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:38.778592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.583906+0000","last_change":"2024-09-12T00:52:40.338165+0000","last_active":"2024-09-12T01:19:43.583906+0000","last_peered":"2024-09-12T01:19:43.583906+0000","last_clean":"2024-09-12T01:19:43.583906+0000","last_became_active":"2024-09-12T00:52:40.337359+0000","last_became_peered":"2024-09-12T00:52:40.337359+0000","last_unstale":"2024-09-12T01:19:43.583906+0000","last_undegraded":"2024-09-12T01:19:43.583906+0000","last_fullsized":"2024-09-12T01:19:43.583906+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:52.904218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"265'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:53.595693+0000","last_change":"2024-09-12T00:52:37.300132+0000","last_active":"2024-09-12T01:20:53.595693+0000","last_peered":"2024-09-12T01:20:53.595693+0000","last_clean":"2024-09-12T01:20:53.595693+0000","last_became_active":"2024-09-12T00:52:37.299461+0000","last_became_peered":"2024-09-12T00:52:37.299461+0000","last_unstale":"2024-09-12T01:20:53.595693+0000","last_undegraded":"2024-09-12T01:20:53.595693+0000","last_fullsized":"2024-09-12T01:20:53.595693+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:06.604639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5125,"num_write":10,"num_write_kb":5125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'112","reported_seq":395,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.594307+0000","last_change":"2024-09-12T00:51:04.983673+0000","last_active":"2024-09-12T01:19:18.594307+0000","last_peered":"2024-09-12T01:19:18.594307+0000","last_clean":"2024-09-12T01:19:18.594307+0000","last_became_active":"2024-09-12T00:51:04.975690+0000","last_became_peered":"2024-09-12T00:51:04.975690+0000","last_unstale":"2024-09-12T01:19:18.594307+0000","last_undegraded":"2024-09-12T01:19:18.594307+0000","last_fullsized":"2024-09-12T01:19:18.594307+0000","mapping_epoch":252,"log_start":"265'100","ondisk_log_start":"265'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:00.184799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":675,"num_read_kb":541,"num_write":147,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:28.576824+0000","last_change":"2024-09-12T01:03:40.586682+0000","last_active":"2024-09-12T01:19:28.576824+0000","last_peered":"2024-09-12T01:19:28.576824+0000","last_clean":"2024-09-12T01:19:28.576824+0000","last_became_active":"2024-09-12T01:03:40.585894+0000","last_became_peered":"2024-09-12T01:03:40.585894+0000","last_unstale":"2024-09-12T01:19:28.576824+0000","last_undegraded":"2024-09-12T01:19:28.576824+0000","last_fullsized":"2024-09-12T01:19:28.576824+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:09.789910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"262'3","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.785780+0000","last_change":"2024-09-12T00:52:40.355779+0000","last_active":"2024-09-12T01:18:42.785780+0000","last_peered":"2024-09-12T01:18:42.785780+0000","last_clean":"2024-09-12T01:18:42.785780+0000","last_became_active":"2024-09-12T00:52:40.355113+0000","last_became_peered":"2024-09-12T00:52:40.355113+0000","last_unstale":"2024-09-12T01:18:42.785780+0000","last_undegraded":"2024-09-12T01:18:42.785780+0000","last_fullsized":"2024-09-12T01:18:42.785780+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:00.005104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:52.587580+0000","last_change":"2024-09-12T00:52:37.281177+0000","last_active":"2024-09-12T01:21:52.587580+0000","last_peered":"2024-09-12T01:21:52.587580+0000","last_clean":"2024-09-12T01:21:52.587580+0000","last_became_active":"2024-09-12T00:52:37.280444+0000","last_became_peered":"2024-09-12T00:52:37.280444+0000","last_unstale":"2024-09-12T01:21:52.587580+0000","last_undegraded":"2024-09-12T01:21:52.587580+0000","last_fullsized":"2024-09-12T01:21:52.587580+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:12.563116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'48","reported_seq":181,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:17.559211+0000","last_change":"2024-09-12T00:51:04.985402+0000","last_active":"2024-09-12T01:19:17.559211+0000","last_peered":"2024-09-12T01:19:17.559211+0000","last_clean":"2024-09-12T01:19:17.559211+0000","last_became_active":"2024-09-12T00:51:04.984384+0000","last_became_peered":"2024-09-12T00:51:04.984384+0000","last_unstale":"2024-09-12T01:19:17.559211+0000","last_undegraded":"2024-09-12T01:19:17.559211+0000","last_fullsized":"2024-09-12T01:19:17.559211+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:51.787094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":174,"num_write":98,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.779633+0000","last_change":"2024-09-12T01:03:40.566732+0000","last_active":"2024-09-12T01:18:17.779633+0000","last_peered":"2024-09-12T01:18:17.779633+0000","last_clean":"2024-09-12T01:18:17.779633+0000","last_became_active":"2024-09-12T01:03:40.565972+0000","last_became_peered":"2024-09-12T01:03:40.565972+0000","last_unstale":"2024-09-12T01:18:17.779633+0000","last_undegraded":"2024-09-12T01:18:17.779633+0000","last_fullsized":"2024-09-12T01:18:17.779633+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:13.523686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:53.583277+0000","last_change":"2024-09-12T00:52:40.352965+0000","last_active":"2024-09-12T01:19:53.583277+0000","last_peered":"2024-09-12T01:19:53.583277+0000","last_clean":"2024-09-12T01:19:53.583277+0000","last_became_active":"2024-09-12T00:52:40.352178+0000","last_became_peered":"2024-09-12T00:52:40.352178+0000","last_unstale":"2024-09-12T01:19:53.583277+0000","last_undegraded":"2024-09-12T01:19:53.583277+0000","last_fullsized":"2024-09-12T01:19:53.583277+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:25.540435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:42.800116+0000","last_change":"2024-09-12T00:52:37.281424+0000","last_active":"2024-09-12T01:19:42.800116+0000","last_peered":"2024-09-12T01:19:42.800116+0000","last_clean":"2024-09-12T01:19:42.800116+0000","last_became_active":"2024-09-12T00:52:37.280679+0000","last_became_peered":"2024-09-12T00:52:37.280679+0000","last_unstale":"2024-09-12T01:19:42.800116+0000","last_undegraded":"2024-09-12T01:19:42.800116+0000","last_fullsized":"2024-09-12T01:19:42.800116+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:14.781208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'2","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.574476+0000","last_change":"2024-09-12T00:51:04.998155+0000","last_active":"2024-09-12T01:19:18.574476+0000","last_peered":"2024-09-12T01:19:18.574476+0000","last_clean":"2024-09-12T01:19:18.574476+0000","last_became_active":"2024-09-12T00:51:04.996736+0000","last_became_peered":"2024-09-12T00:51:04.996736+0000","last_unstale":"2024-09-12T01:19:18.574476+0000","last_undegraded":"2024-09-12T01:19:18.574476+0000","last_fullsized":"2024-09-12T01:19:18.574476+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:00.791980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.552215+0000","last_change":"2024-09-12T01:03:40.577490+0000","last_active":"2024-09-12T01:18:18.552215+0000","last_peered":"2024-09-12T01:18:18.552215+0000","last_clean":"2024-09-12T01:18:18.552215+0000","last_became_active":"2024-09-12T01:03:40.576752+0000","last_became_peered":"2024-09-12T01:03:40.576752+0000","last_unstale":"2024-09-12T01:18:18.552215+0000","last_undegraded":"2024-09-12T01:18:18.552215+0000","last_fullsized":"2024-09-12T01:18:18.552215+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:58.912810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"262'8","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.582004+0000","last_change":"2024-09-12T00:52:40.340084+0000","last_active":"2024-09-12T01:19:48.582004+0000","last_peered":"2024-09-12T01:19:48.582004+0000","last_clean":"2024-09-12T01:19:48.582004+0000","last_became_active":"2024-09-12T00:52:40.338378+0000","last_became_peered":"2024-09-12T00:52:40.338378+0000","last_unstale":"2024-09-12T01:19:48.582004+0000","last_undegraded":"2024-09-12T01:19:48.582004+0000","last_fullsized":"2024-09-12T01:19:48.582004+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:29.194283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'6","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:55.597554+0000","last_change":"2024-09-12T00:52:37.285880+0000","last_active":"2024-09-12T01:21:55.597554+0000","last_peered":"2024-09-12T01:21:55.597554+0000","last_clean":"2024-09-12T01:21:55.597554+0000","last_became_active":"2024-09-12T00:52:37.284206+0000","last_became_peered":"2024-09-12T00:52:37.284206+0000","last_unstale":"2024-09-12T01:21:55.597554+0000","last_undegraded":"2024-09-12T01:21:55.597554+0000","last_fullsized":"2024-09-12T01:21:55.597554+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:30.930785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'21","reported_seq":106,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:17.559410+0000","last_change":"2024-09-12T00:51:04.983851+0000","last_active":"2024-09-12T01:19:17.559410+0000","last_peered":"2024-09-12T01:19:17.559410+0000","last_clean":"2024-09-12T01:19:17.559410+0000","last_became_active":"2024-09-12T00:51:04.983165+0000","last_became_peered":"2024-09-12T00:51:04.983165+0000","last_unstale":"2024-09-12T01:19:17.559410+0000","last_undegraded":"2024-09-12T01:19:17.559410+0000","last_fullsized":"2024-09-12T01:19:17.559410+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:30.417623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":73,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.584915+0000","last_change":"2024-09-12T01:03:40.579521+0000","last_active":"2024-09-12T01:19:48.584915+0000","last_peered":"2024-09-12T01:19:48.584915+0000","last_clean":"2024-09-12T01:19:48.584915+0000","last_became_active":"2024-09-12T01:03:40.578825+0000","last_became_peered":"2024-09-12T01:03:40.578825+0000","last_unstale":"2024-09-12T01:19:48.584915+0000","last_undegraded":"2024-09-12T01:19:48.584915+0000","last_fullsized":"2024-09-12T01:19:48.584915+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:02.779228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"265'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:52.815957+0000","last_change":"2024-09-12T00:52:40.353791+0000","last_active":"2024-09-12T01:20:52.815957+0000","last_peered":"2024-09-12T01:20:52.815957+0000","last_clean":"2024-09-12T01:20:52.815957+0000","last_became_active":"2024-09-12T00:52:40.352922+0000","last_became_peered":"2024-09-12T00:52:40.352922+0000","last_unstale":"2024-09-12T01:20:52.815957+0000","last_undegraded":"2024-09-12T01:20:52.815957+0000","last_fullsized":"2024-09-12T01:20:52.815957+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:33.594783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.556947+0000","last_change":"2024-09-12T00:52:37.281272+0000","last_active":"2024-09-12T01:18:38.556947+0000","last_peered":"2024-09-12T01:18:38.556947+0000","last_clean":"2024-09-12T01:18:38.556947+0000","last_became_active":"2024-09-12T00:52:37.280548+0000","last_became_peered":"2024-09-12T00:52:37.280548+0000","last_unstale":"2024-09-12T01:18:38.556947+0000","last_undegraded":"2024-09-12T01:18:38.556947+0000","last_fullsized":"2024-09-12T01:18:38.556947+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:57.882529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'10","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:12.778458+0000","last_change":"2024-09-12T00:51:04.995585+0000","last_active":"2024-09-12T01:18:12.778458+0000","last_peered":"2024-09-12T01:18:12.778458+0000","last_clean":"2024-09-12T01:18:12.778458+0000","last_became_active":"2024-09-12T00:51:04.994904+0000","last_became_peered":"2024-09-12T00:51:04.994904+0000","last_unstale":"2024-09-12T01:18:12.778458+0000","last_undegraded":"2024-09-12T01:18:12.778458+0000","last_fullsized":"2024-09-12T01:18:12.778458+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:29.572409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":34,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.739185+0000","last_change":"2024-09-12T01:03:40.577193+0000","last_active":"2024-09-12T01:18:17.739185+0000","last_peered":"2024-09-12T01:18:17.739185+0000","last_clean":"2024-09-12T01:18:17.739185+0000","last_became_active":"2024-09-12T01:03:40.576442+0000","last_became_peered":"2024-09-12T01:03:40.576442+0000","last_unstale":"2024-09-12T01:18:17.739185+0000","last_undegraded":"2024-09-12T01:18:17.739185+0000","last_fullsized":"2024-09-12T01:18:17.739185+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:03.900955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"265'6","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:52.574160+0000","last_change":"2024-09-12T00:52:40.346550+0000","last_active":"2024-09-12T01:20:52.574160+0000","last_peered":"2024-09-12T01:20:52.574160+0000","last_clean":"2024-09-12T01:20:52.574160+0000","last_became_active":"2024-09-12T00:52:40.345375+0000","last_became_peered":"2024-09-12T00:52:40.345375+0000","last_unstale":"2024-09-12T01:20:52.574160+0000","last_undegraded":"2024-09-12T01:20:52.574160+0000","last_fullsized":"2024-09-12T01:20:52.574160+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:05.935202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"262'5","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:37.784692+0000","last_change":"2024-09-12T00:52:37.282759+0000","last_active":"2024-09-12T01:18:37.784692+0000","last_peered":"2024-09-12T01:18:37.784692+0000","last_clean":"2024-09-12T01:18:37.784692+0000","last_became_active":"2024-09-12T00:52:37.282005+0000","last_became_peered":"2024-09-12T00:52:37.282005+0000","last_unstale":"2024-09-12T01:18:37.784692+0000","last_undegraded":"2024-09-12T01:18:37.784692+0000","last_fullsized":"2024-09-12T01:18:37.784692+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:50.148380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":5,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"265'13","reported_seq":82,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.560095+0000","last_change":"2024-09-12T00:51:04.991796+0000","last_active":"2024-09-12T01:18:13.560095+0000","last_peered":"2024-09-12T01:18:13.560095+0000","last_clean":"2024-09-12T01:18:13.560095+0000","last_became_active":"2024-09-12T00:51:04.990945+0000","last_became_peered":"2024-09-12T00:51:04.990945+0000","last_unstale":"2024-09-12T01:18:13.560095+0000","last_undegraded":"2024-09-12T01:18:13.560095+0000","last_fullsized":"2024-09-12T01:18:13.560095+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:18.841995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:50.562171+0000","last_change":"2024-09-12T01:03:40.582179+0000","last_active":"2024-09-12T01:18:50.562171+0000","last_peered":"2024-09-12T01:18:50.562171+0000","last_clean":"2024-09-12T01:18:50.562171+0000","last_became_active":"2024-09-12T01:03:40.581227+0000","last_became_peered":"2024-09-12T01:03:40.581227+0000","last_unstale":"2024-09-12T01:18:50.562171+0000","last_undegraded":"2024-09-12T01:18:50.562171+0000","last_fullsized":"2024-09-12T01:18:50.562171+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:44.601346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.584983+0000","last_change":"2024-09-12T00:52:40.341544+0000","last_active":"2024-09-12T01:19:48.584983+0000","last_peered":"2024-09-12T01:19:48.584983+0000","last_clean":"2024-09-12T01:19:48.584983+0000","last_became_active":"2024-09-12T00:52:40.340078+0000","last_became_peered":"2024-09-12T00:52:40.340078+0000","last_unstale":"2024-09-12T01:19:48.584983+0000","last_undegraded":"2024-09-12T01:19:48.584983+0000","last_fullsized":"2024-09-12T01:19:48.584983+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:01.427475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"262'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:37.784418+0000","last_change":"2024-09-12T00:52:37.280400+0000","last_active":"2024-09-12T01:18:37.784418+0000","last_peered":"2024-09-12T01:18:37.784418+0000","last_clean":"2024-09-12T01:18:37.784418+0000","last_became_active":"2024-09-12T00:52:37.277753+0000","last_became_peered":"2024-09-12T00:52:37.277753+0000","last_unstale":"2024-09-12T01:18:37.784418+0000","last_undegraded":"2024-09-12T01:18:37.784418+0000","last_fullsized":"2024-09-12T01:18:37.784418+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:24.031905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"254'7","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.550912+0000","last_change":"2024-09-12T00:51:04.957439+0000","last_active":"2024-09-12T01:18:13.550912+0000","last_peered":"2024-09-12T01:18:13.550912+0000","last_clean":"2024-09-12T01:18:13.550912+0000","last_became_active":"2024-09-12T00:51:04.956754+0000","last_became_peered":"2024-09-12T00:51:04.956754+0000","last_unstale":"2024-09-12T01:18:13.550912+0000","last_undegraded":"2024-09-12T01:18:13.550912+0000","last_fullsized":"2024-09-12T01:18:13.550912+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:38.742856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":30,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:53.568338+0000","last_change":"2024-09-12T01:03:40.586675+0000","last_active":"2024-09-12T01:18:53.568338+0000","last_peered":"2024-09-12T01:18:53.568338+0000","last_clean":"2024-09-12T01:18:53.568338+0000","last_became_active":"2024-09-12T01:03:40.583308+0000","last_became_peered":"2024-09-12T01:03:40.583308+0000","last_unstale":"2024-09-12T01:18:53.568338+0000","last_undegraded":"2024-09-12T01:18:53.568338+0000","last_fullsized":"2024-09-12T01:18:53.568338+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:58.594413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'6","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.619618+0000","last_change":"2024-09-12T00:52:40.333654+0000","last_active":"2024-09-12T01:21:56.619618+0000","last_peered":"2024-09-12T01:21:56.619618+0000","last_clean":"2024-09-12T01:21:56.619618+0000","last_became_active":"2024-09-12T00:52:40.332913+0000","last_became_peered":"2024-09-12T00:52:40.332913+0000","last_unstale":"2024-09-12T01:21:56.619618+0000","last_undegraded":"2024-09-12T01:21:56.619618+0000","last_fullsized":"2024-09-12T01:21:56.619618+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:55.862557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:47.828740+0000","last_change":"2024-09-12T00:52:37.287265+0000","last_active":"2024-09-12T01:21:47.828740+0000","last_peered":"2024-09-12T01:21:47.828740+0000","last_clean":"2024-09-12T01:21:47.828740+0000","last_became_active":"2024-09-12T00:52:37.282758+0000","last_became_peered":"2024-09-12T00:52:37.282758+0000","last_unstale":"2024-09-12T01:21:47.828740+0000","last_undegraded":"2024-09-12T01:21:47.828740+0000","last_fullsized":"2024-09-12T01:21:47.828740+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:54.106634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'71","reported_seq":244,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:12.738155+0000","last_change":"2024-09-12T00:51:04.983438+0000","last_active":"2024-09-12T01:18:12.738155+0000","last_peered":"2024-09-12T01:18:12.738155+0000","last_clean":"2024-09-12T01:18:12.738155+0000","last_became_active":"2024-09-12T00:51:04.982747+0000","last_became_peered":"2024-09-12T00:51:04.982747+0000","last_unstale":"2024-09-12T01:18:12.738155+0000","last_undegraded":"2024-09-12T01:18:12.738155+0000","last_fullsized":"2024-09-12T01:18:12.738155+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:57.630612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":369,"num_read_kb":267,"num_write":124,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.559537+0000","last_change":"2024-09-12T01:03:40.573794+0000","last_active":"2024-09-12T01:18:18.559537+0000","last_peered":"2024-09-12T01:18:18.559537+0000","last_clean":"2024-09-12T01:18:18.559537+0000","last_became_active":"2024-09-12T01:03:40.571968+0000","last_became_peered":"2024-09-12T01:03:40.571968+0000","last_unstale":"2024-09-12T01:18:18.559537+0000","last_undegraded":"2024-09-12T01:18:18.559537+0000","last_fullsized":"2024-09-12T01:18:18.559537+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:38.415524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'7","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:52.398884+0000","last_change":"2024-09-12T00:52:40.360097+0000","last_active":"2024-09-12T01:21:52.398884+0000","last_peered":"2024-09-12T01:21:52.398884+0000","last_clean":"2024-09-12T01:21:52.398884+0000","last_became_active":"2024-09-12T00:52:40.359434+0000","last_became_peered":"2024-09-12T00:52:40.359434+0000","last_unstale":"2024-09-12T01:21:52.398884+0000","last_undegraded":"2024-09-12T01:21:52.398884+0000","last_fullsized":"2024-09-12T01:21:52.398884+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:26.806456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":12,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'6","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.749444+0000","last_change":"2024-09-12T00:52:37.292083+0000","last_active":"2024-09-12T01:21:56.749444+0000","last_peered":"2024-09-12T01:21:56.749444+0000","last_clean":"2024-09-12T01:21:56.749444+0000","last_became_active":"2024-09-12T00:52:37.291369+0000","last_became_peered":"2024-09-12T00:52:37.291369+0000","last_unstale":"2024-09-12T01:21:56.749444+0000","last_undegraded":"2024-09-12T01:21:56.749444+0000","last_fullsized":"2024-09-12T01:21:56.749444+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:43.999305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'35","reported_seq":136,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:12.545173+0000","last_change":"2024-09-12T00:51:04.990882+0000","last_active":"2024-09-12T01:18:12.545173+0000","last_peered":"2024-09-12T01:18:12.545173+0000","last_clean":"2024-09-12T01:18:12.545173+0000","last_became_active":"2024-09-12T00:51:04.990179+0000","last_became_peered":"2024-09-12T00:51:04.990179+0000","last_unstale":"2024-09-12T01:18:12.545173+0000","last_undegraded":"2024-09-12T01:18:12.545173+0000","last_fullsized":"2024-09-12T01:18:12.545173+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:33.185513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":108,"num_write":67,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.779809+0000","last_change":"2024-09-12T01:03:40.574488+0000","last_active":"2024-09-12T01:18:17.779809+0000","last_peered":"2024-09-12T01:18:17.779809+0000","last_clean":"2024-09-12T01:18:17.779809+0000","last_became_active":"2024-09-12T01:03:40.573928+0000","last_became_peered":"2024-09-12T01:03:40.573928+0000","last_unstale":"2024-09-12T01:18:17.779809+0000","last_undegraded":"2024-09-12T01:18:17.779809+0000","last_fullsized":"2024-09-12T01:18:17.779809+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:15.934749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:47.559411+0000","last_change":"2024-09-12T00:52:40.349488+0000","last_active":"2024-09-12T01:19:47.559411+0000","last_peered":"2024-09-12T01:19:47.559411+0000","last_clean":"2024-09-12T01:19:47.559411+0000","last_became_active":"2024-09-12T00:52:40.348494+0000","last_became_peered":"2024-09-12T00:52:40.348494+0000","last_unstale":"2024-09-12T01:19:47.559411+0000","last_undegraded":"2024-09-12T01:19:47.559411+0000","last_fullsized":"2024-09-12T01:19:47.559411+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:17.271665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'2","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:42.564451+0000","last_change":"2024-09-12T00:52:37.279058+0000","last_active":"2024-09-12T01:19:42.564451+0000","last_peered":"2024-09-12T01:19:42.564451+0000","last_clean":"2024-09-12T01:19:42.564451+0000","last_became_active":"2024-09-12T00:52:37.278285+0000","last_became_peered":"2024-09-12T00:52:37.278285+0000","last_unstale":"2024-09-12T01:19:42.564451+0000","last_undegraded":"2024-09-12T01:19:42.564451+0000","last_fullsized":"2024-09-12T01:19:42.564451+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:15.749368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'29","reported_seq":125,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.791752+0000","last_change":"2024-09-12T00:51:04.986057+0000","last_active":"2024-09-12T01:19:07.791752+0000","last_peered":"2024-09-12T01:19:07.791752+0000","last_clean":"2024-09-12T01:19:07.791752+0000","last_became_active":"2024-09-12T00:51:04.984999+0000","last_became_peered":"2024-09-12T00:51:04.984999+0000","last_unstale":"2024-09-12T01:19:07.791752+0000","last_undegraded":"2024-09-12T01:19:07.791752+0000","last_fullsized":"2024-09-12T01:19:07.791752+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:46.905997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":53,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'329","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.837044+0000","last_change":"2024-09-12T00:35:43.948445+0000","last_active":"2024-09-12T01:21:57.837044+0000","last_peered":"2024-09-12T01:21:57.837044+0000","last_clean":"2024-09-12T01:21:57.837044+0000","last_became_active":"2024-09-12T00:35:43.947816+0000","last_became_peered":"2024-09-12T00:35:43.947816+0000","last_unstale":"2024-09-12T01:21:57.837044+0000","last_undegraded":"2024-09-12T01:21:57.837044+0000","last_fullsized":"2024-09-12T01:21:57.837044+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:16.574434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1291295,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":33235,"num_write":1076,"num_write_kb":21608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'253","reported_seq":876,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:14.250255+0000","last_change":"2024-09-12T00:35:45.926951+0000","last_active":"2024-09-12T01:19:14.250255+0000","last_peered":"2024-09-12T01:19:14.250255+0000","last_clean":"2024-09-12T01:19:14.250255+0000","last_became_active":"2024-09-12T00:35:45.925856+0000","last_became_peered":"2024-09-12T00:35:45.925856+0000","last_unstale":"2024-09-12T01:19:14.250255+0000","last_undegraded":"2024-09-12T01:19:14.250255+0000","last_fullsized":"2024-09-12T01:19:14.250255+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:07.944413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1075,"num_read_kb":882,"num_write":373,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'375","reported_seq":1039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.834716+0000","last_change":"2024-09-12T00:35:43.933369+0000","last_active":"2024-09-12T01:21:57.834716+0000","last_peered":"2024-09-12T01:21:57.834716+0000","last_clean":"2024-09-12T01:21:57.834716+0000","last_became_active":"2024-09-12T00:35:43.933088+0000","last_became_peered":"2024-09-12T00:35:43.933088+0000","last_unstale":"2024-09-12T01:21:57.834716+0000","last_undegraded":"2024-09-12T01:21:57.834716+0000","last_fullsized":"2024-09-12T01:21:57.834716+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:49.773500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":567,"num_read_kb":47488,"num_write":1216,"num_write_kb":29880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'45","reported_seq":579,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:03.587115+0000","last_change":"2024-09-12T00:35:45.947951+0000","last_active":"2024-09-12T01:19:03.587115+0000","last_peered":"2024-09-12T01:19:03.587115+0000","last_clean":"2024-09-12T01:19:03.587115+0000","last_became_active":"2024-09-12T00:35:45.947212+0000","last_became_peered":"2024-09-12T00:35:45.947212+0000","last_unstale":"2024-09-12T01:19:03.587115+0000","last_undegraded":"2024-09-12T01:19:03.587115+0000","last_fullsized":"2024-09-12T01:19:03.587115+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:09.409072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":168,"num_write":71,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'327","reported_seq":1017,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.847684+0000","last_change":"2024-09-12T00:35:43.927529+0000","last_active":"2024-09-12T01:21:57.847684+0000","last_peered":"2024-09-12T01:21:57.847684+0000","last_clean":"2024-09-12T01:21:57.847684+0000","last_became_active":"2024-09-12T00:35:43.926443+0000","last_became_peered":"2024-09-12T00:35:43.926443+0000","last_unstale":"2024-09-12T01:21:57.847684+0000","last_undegraded":"2024-09-12T01:21:57.847684+0000","last_fullsized":"2024-09-12T01:21:57.847684+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:06.887907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262209,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":553,"num_read_kb":98039,"num_write":1093,"num_write_kb":58371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'116","reported_seq":729,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.447686+0000","last_change":"2024-09-12T00:35:45.932367+0000","last_active":"2024-09-12T01:19:43.447686+0000","last_peered":"2024-09-12T01:19:43.447686+0000","last_clean":"2024-09-12T01:19:43.447686+0000","last_became_active":"2024-09-12T00:35:45.930987+0000","last_became_peered":"2024-09-12T00:35:45.930987+0000","last_unstale":"2024-09-12T01:19:43.447686+0000","last_undegraded":"2024-09-12T01:19:43.447686+0000","last_fullsized":"2024-09-12T01:19:43.447686+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:08.829843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":522,"num_read_kb":443,"num_write":187,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'380","reported_seq":1052,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.843793+0000","last_change":"2024-09-12T00:35:43.920497+0000","last_active":"2024-09-12T01:21:57.843793+0000","last_peered":"2024-09-12T01:21:57.843793+0000","last_clean":"2024-09-12T01:21:57.843793+0000","last_became_active":"2024-09-12T00:35:43.914356+0000","last_became_peered":"2024-09-12T00:35:43.914356+0000","last_unstale":"2024-09-12T01:21:57.843793+0000","last_undegraded":"2024-09-12T01:21:57.843793+0000","last_fullsized":"2024-09-12T01:21:57.843793+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:16.053246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6370276,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":596,"num_read_kb":17763,"num_write":1203,"num_write_kb":54335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'197","reported_seq":794,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:40.733551+0000","last_change":"2024-09-12T00:35:45.943011+0000","last_active":"2024-09-12T01:19:40.733551+0000","last_peered":"2024-09-12T01:19:40.733551+0000","last_clean":"2024-09-12T01:19:40.733551+0000","last_became_active":"2024-09-12T00:35:45.942567+0000","last_became_peered":"2024-09-12T00:35:45.942567+0000","last_unstale":"2024-09-12T01:19:40.733551+0000","last_undegraded":"2024-09-12T01:19:40.733551+0000","last_fullsized":"2024-09-12T01:19:40.733551+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:28.500033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":861,"num_read_kb":699,"num_write":314,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'343","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.854060+0000","last_change":"2024-09-12T00:35:43.945400+0000","last_active":"2024-09-12T01:21:57.854060+0000","last_peered":"2024-09-12T01:21:57.854060+0000","last_clean":"2024-09-12T01:21:57.854060+0000","last_became_active":"2024-09-12T00:35:43.944644+0000","last_became_peered":"2024-09-12T00:35:43.944644+0000","last_unstale":"2024-09-12T01:21:57.854060+0000","last_undegraded":"2024-09-12T01:21:57.854060+0000","last_fullsized":"2024-09-12T01:21:57.854060+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:50.172251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289155,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":589,"num_read_kb":29244,"num_write":1174,"num_write_kb":25136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'341","reported_seq":1075,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.255694+0000","last_change":"2024-09-12T00:35:45.943860+0000","last_active":"2024-09-12T01:20:22.255694+0000","last_peered":"2024-09-12T01:20:22.255694+0000","last_clean":"2024-09-12T01:20:22.255694+0000","last_became_active":"2024-09-12T00:35:45.943110+0000","last_became_peered":"2024-09-12T00:35:45.943110+0000","last_unstale":"2024-09-12T01:20:22.255694+0000","last_undegraded":"2024-09-12T01:20:22.255694+0000","last_fullsized":"2024-09-12T01:20:22.255694+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:24.346213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1719,"num_read_kb":1451,"num_write":623,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'333","reported_seq":943,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.794513+0000","last_change":"2024-09-12T00:35:43.930576+0000","last_active":"2024-09-12T01:21:57.794513+0000","last_peered":"2024-09-12T01:21:57.794513+0000","last_clean":"2024-09-12T01:21:57.794513+0000","last_became_active":"2024-09-12T00:35:43.929553+0000","last_became_peered":"2024-09-12T00:35:43.929553+0000","last_unstale":"2024-09-12T01:21:57.794513+0000","last_undegraded":"2024-09-12T01:21:57.794513+0000","last_fullsized":"2024-09-12T01:21:57.794513+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:22.833352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8021586,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":453,"num_read_kb":14436,"num_write":1125,"num_write_kb":49786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'350","reported_seq":931,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:00.371052+0000","last_change":"2024-09-12T00:35:45.934966+0000","last_active":"2024-09-12T01:20:00.371052+0000","last_peered":"2024-09-12T01:20:00.371052+0000","last_clean":"2024-09-12T01:20:00.371052+0000","last_became_active":"2024-09-12T00:35:45.934193+0000","last_became_peered":"2024-09-12T00:35:45.934193+0000","last_unstale":"2024-09-12T01:20:00.371052+0000","last_undegraded":"2024-09-12T01:20:00.371052+0000","last_fullsized":"2024-09-12T01:20:00.371052+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:43.914081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1452,"num_read_kb":1165,"num_write":550,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'392","reported_seq":1073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.866648+0000","last_change":"2024-09-12T00:35:43.942971+0000","last_active":"2024-09-12T01:21:57.866648+0000","last_peered":"2024-09-12T01:21:57.866648+0000","last_clean":"2024-09-12T01:21:57.866648+0000","last_became_active":"2024-09-12T00:35:43.942199+0000","last_became_peered":"2024-09-12T00:35:43.942199+0000","last_unstale":"2024-09-12T01:21:57.866648+0000","last_undegraded":"2024-09-12T01:21:57.866648+0000","last_fullsized":"2024-09-12T01:21:57.866648+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:07.698617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":650,"num_read_kb":42927,"num_write":1209,"num_write_kb":42524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'254","reported_seq":917,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:33.569572+0000","last_change":"2024-09-12T00:35:45.938322+0000","last_active":"2024-09-12T01:19:33.569572+0000","last_peered":"2024-09-12T01:19:33.569572+0000","last_clean":"2024-09-12T01:19:33.569572+0000","last_became_active":"2024-09-12T00:35:45.937211+0000","last_became_peered":"2024-09-12T00:35:45.937211+0000","last_unstale":"2024-09-12T01:19:33.569572+0000","last_undegraded":"2024-09-12T01:19:33.569572+0000","last_fullsized":"2024-09-12T01:19:33.569572+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:08.919655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1131,"num_read_kb":929,"num_write":387,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'357","reported_seq":1040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.824404+0000","last_change":"2024-09-12T00:35:43.920009+0000","last_active":"2024-09-12T01:21:57.824404+0000","last_peered":"2024-09-12T01:21:57.824404+0000","last_clean":"2024-09-12T01:21:57.824404+0000","last_became_active":"2024-09-12T00:35:43.918653+0000","last_became_peered":"2024-09-12T00:35:43.918653+0000","last_unstale":"2024-09-12T01:21:57.824404+0000","last_undegraded":"2024-09-12T01:21:57.824404+0000","last_fullsized":"2024-09-12T01:21:57.824404+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:08.630692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262196,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":641,"num_read_kb":7519,"num_write":1239,"num_write_kb":32586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'269","reported_seq":929,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:51.427937+0000","last_change":"2024-09-12T00:35:45.942221+0000","last_active":"2024-09-12T01:19:51.427937+0000","last_peered":"2024-09-12T01:19:51.427937+0000","last_clean":"2024-09-12T01:19:51.427937+0000","last_became_active":"2024-09-12T00:35:45.941814+0000","last_became_peered":"2024-09-12T00:35:45.941814+0000","last_unstale":"2024-09-12T01:19:51.427937+0000","last_undegraded":"2024-09-12T01:19:51.427937+0000","last_fullsized":"2024-09-12T01:19:51.427937+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:48.303334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1198,"num_read_kb":983,"num_write":434,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'104","reported_seq":678,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:36.090439+0000","last_change":"2024-09-12T00:35:45.930414+0000","last_active":"2024-09-12T01:19:36.090439+0000","last_peered":"2024-09-12T01:19:36.090439+0000","last_clean":"2024-09-12T01:19:36.090439+0000","last_became_active":"2024-09-12T00:35:45.929168+0000","last_became_peered":"2024-09-12T00:35:45.929168+0000","last_unstale":"2024-09-12T01:19:36.090439+0000","last_undegraded":"2024-09-12T01:19:36.090439+0000","last_fullsized":"2024-09-12T01:19:36.090439+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:46.680426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":468,"num_read_kb":393,"num_write":157,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'370","reported_seq":1019,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.846270+0000","last_change":"2024-09-12T00:35:43.951280+0000","last_active":"2024-09-12T01:21:57.846270+0000","last_peered":"2024-09-12T01:21:57.846270+0000","last_clean":"2024-09-12T01:21:57.846270+0000","last_became_active":"2024-09-12T00:35:43.949857+0000","last_became_peered":"2024-09-12T00:35:43.949857+0000","last_unstale":"2024-09-12T01:21:57.846270+0000","last_undegraded":"2024-09-12T01:21:57.846270+0000","last_fullsized":"2024-09-12T01:21:57.846270+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:10.127383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":541,"num_read_kb":3399,"num_write":1114,"num_write_kb":43442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'111","reported_seq":684,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:47.772837+0000","last_change":"2024-09-12T00:35:45.948146+0000","last_active":"2024-09-12T01:17:47.772837+0000","last_peered":"2024-09-12T01:17:47.772837+0000","last_clean":"2024-09-12T01:17:47.772837+0000","last_became_active":"2024-09-12T00:35:45.947366+0000","last_became_peered":"2024-09-12T00:35:45.947366+0000","last_unstale":"2024-09-12T01:17:47.772837+0000","last_undegraded":"2024-09-12T01:17:47.772837+0000","last_fullsized":"2024-09-12T01:17:47.772837+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:11.387874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":482,"num_read_kb":394,"num_write":173,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'364","reported_seq":1039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.867151+0000","last_change":"2024-09-12T00:35:43.926785+0000","last_active":"2024-09-12T01:21:57.867151+0000","last_peered":"2024-09-12T01:21:57.867151+0000","last_clean":"2024-09-12T01:21:57.867151+0000","last_became_active":"2024-09-12T00:35:43.926027+0000","last_became_peered":"2024-09-12T00:35:43.926027+0000","last_unstale":"2024-09-12T01:21:57.867151+0000","last_undegraded":"2024-09-12T01:21:57.867151+0000","last_fullsized":"2024-09-12T01:21:57.867151+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:47.685516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":574,"num_read_kb":69210,"num_write":1266,"num_write_kb":64702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'169","reported_seq":777,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:58.547349+0000","last_change":"2024-09-12T00:35:45.933189+0000","last_active":"2024-09-12T01:17:58.547349+0000","last_peered":"2024-09-12T01:17:58.547349+0000","last_clean":"2024-09-12T01:17:58.547349+0000","last_became_active":"2024-09-12T00:35:45.932116+0000","last_became_peered":"2024-09-12T00:35:45.932116+0000","last_unstale":"2024-09-12T01:17:58.547349+0000","last_undegraded":"2024-09-12T01:17:58.547349+0000","last_fullsized":"2024-09-12T01:17:58.547349+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:10.046459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":828,"num_read_kb":701,"num_write":304,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'365","reported_seq":1053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.829093+0000","last_change":"2024-09-12T00:36:17.046117+0000","last_active":"2024-09-12T01:21:57.829093+0000","last_peered":"2024-09-12T01:21:57.829093+0000","last_clean":"2024-09-12T01:21:57.829093+0000","last_became_active":"2024-09-12T00:36:17.045217+0000","last_became_peered":"2024-09-12T00:36:17.045217+0000","last_unstale":"2024-09-12T01:21:57.829093+0000","last_undegraded":"2024-09-12T01:21:57.829093+0000","last_fullsized":"2024-09-12T01:21:57.829093+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:17.813892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460235,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":599,"num_read_kb":9912,"num_write":1094,"num_write_kb":33583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'99","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:56.473406+0000","last_change":"2024-09-12T00:35:45.939622+0000","last_active":"2024-09-12T01:19:56.473406+0000","last_peered":"2024-09-12T01:19:56.473406+0000","last_clean":"2024-09-12T01:19:56.473406+0000","last_became_active":"2024-09-12T00:35:45.939261+0000","last_became_peered":"2024-09-12T00:35:45.939261+0000","last_unstale":"2024-09-12T01:19:56.473406+0000","last_undegraded":"2024-09-12T01:19:56.473406+0000","last_fullsized":"2024-09-12T01:19:56.473406+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:47.746126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":439,"num_read_kb":359,"num_write":158,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'341","reported_seq":981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.830092+0000","last_change":"2024-09-12T00:35:43.949757+0000","last_active":"2024-09-12T01:21:57.830092+0000","last_peered":"2024-09-12T01:21:57.830092+0000","last_clean":"2024-09-12T01:21:57.830092+0000","last_became_active":"2024-09-12T00:35:43.949045+0000","last_became_peered":"2024-09-12T00:35:43.949045+0000","last_unstale":"2024-09-12T01:21:57.830092+0000","last_undegraded":"2024-09-12T01:21:57.830092+0000","last_fullsized":"2024-09-12T01:21:57.830092+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:36.497824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289432,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":556,"num_read_kb":18745,"num_write":1038,"num_write_kb":46080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'126","reported_seq":725,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:46.094592+0000","last_change":"2024-09-12T00:35:45.943288+0000","last_active":"2024-09-12T01:19:46.094592+0000","last_peered":"2024-09-12T01:19:46.094592+0000","last_clean":"2024-09-12T01:19:46.094592+0000","last_became_active":"2024-09-12T00:35:45.942814+0000","last_became_peered":"2024-09-12T00:35:45.942814+0000","last_unstale":"2024-09-12T01:19:46.094592+0000","last_undegraded":"2024-09-12T01:19:46.094592+0000","last_fullsized":"2024-09-12T01:19:46.094592+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:06.467847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":574,"num_read_kb":483,"num_write":214,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'319","reported_seq":933,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.784921+0000","last_change":"2024-09-12T00:35:43.939756+0000","last_active":"2024-09-12T01:21:57.784921+0000","last_peered":"2024-09-12T01:21:57.784921+0000","last_clean":"2024-09-12T01:21:57.784921+0000","last_became_active":"2024-09-12T00:35:43.939128+0000","last_became_peered":"2024-09-12T00:35:43.939128+0000","last_unstale":"2024-09-12T01:21:57.784921+0000","last_undegraded":"2024-09-12T01:21:57.784921+0000","last_fullsized":"2024-09-12T01:21:57.784921+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:36.964204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":453,"num_read_kb":9693,"num_write":1061,"num_write_kb":13466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'4124","reported_seq":4720,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:01.277760+0000","last_change":"2024-09-12T00:35:45.944333+0000","last_active":"2024-09-12T01:20:01.277760+0000","last_peered":"2024-09-12T01:20:01.277760+0000","last_clean":"2024-09-12T01:20:01.277760+0000","last_became_active":"2024-09-12T00:35:45.943253+0000","last_became_peered":"2024-09-12T00:35:45.943253+0000","last_unstale":"2024-09-12T01:20:01.277760+0000","last_undegraded":"2024-09-12T01:20:01.277760+0000","last_fullsized":"2024-09-12T01:20:01.277760+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:04.022329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16581,"num_read_kb":13903,"num_write":6185,"num_write_kb":3084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'354","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.850617+0000","last_change":"2024-09-12T00:35:43.933614+0000","last_active":"2024-09-12T01:21:57.850617+0000","last_peered":"2024-09-12T01:21:57.850617+0000","last_clean":"2024-09-12T01:21:57.850617+0000","last_became_active":"2024-09-12T00:35:43.933191+0000","last_became_peered":"2024-09-12T00:35:43.933191+0000","last_unstale":"2024-09-12T01:21:57.850617+0000","last_undegraded":"2024-09-12T01:21:57.850617+0000","last_fullsized":"2024-09-12T01:21:57.850617+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:15.373281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":549,"num_read_kb":44649,"num_write":1012,"num_write_kb":28437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'146","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.077594+0000","last_change":"2024-09-12T00:35:53.985466+0000","last_active":"2024-09-12T01:20:23.077594+0000","last_peered":"2024-09-12T01:20:23.077594+0000","last_clean":"2024-09-12T01:20:23.077594+0000","last_became_active":"2024-09-12T00:35:53.981609+0000","last_became_peered":"2024-09-12T00:35:53.981609+0000","last_unstale":"2024-09-12T01:20:23.077594+0000","last_undegraded":"2024-09-12T01:20:23.077594+0000","last_fullsized":"2024-09-12T01:20:23.077594+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:05.745536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":187,"num_read_kb":176,"num_write":375,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'258","reported_seq":901,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:50.602115+0000","last_change":"2024-09-12T00:35:45.948978+0000","last_active":"2024-09-12T01:18:50.602115+0000","last_peered":"2024-09-12T01:18:50.602115+0000","last_clean":"2024-09-12T01:18:50.602115+0000","last_became_active":"2024-09-12T00:35:45.948575+0000","last_became_peered":"2024-09-12T00:35:45.948575+0000","last_unstale":"2024-09-12T01:18:50.602115+0000","last_undegraded":"2024-09-12T01:18:50.602115+0000","last_fullsized":"2024-09-12T01:18:50.602115+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:55.123044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1199,"num_read_kb":1005,"num_write":430,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"265'286","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.859795+0000","last_change":"2024-09-12T00:35:43.957625+0000","last_active":"2024-09-12T01:21:57.859795+0000","last_peered":"2024-09-12T01:21:57.859795+0000","last_clean":"2024-09-12T01:21:57.859795+0000","last_became_active":"2024-09-12T00:35:43.956812+0000","last_became_peered":"2024-09-12T00:35:43.956812+0000","last_unstale":"2024-09-12T01:21:57.859795+0000","last_undegraded":"2024-09-12T01:21:57.859795+0000","last_fullsized":"2024-09-12T01:21:57.859795+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:33.110636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":413,"num_read_kb":399,"num_write":958,"num_write_kb":26614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.566225+0000","last_change":"2024-09-12T00:35:47.933988+0000","last_active":"2024-09-12T01:19:18.566225+0000","last_peered":"2024-09-12T01:19:18.566225+0000","last_clean":"2024-09-12T01:19:18.566225+0000","last_became_active":"2024-09-12T00:35:47.933249+0000","last_became_peered":"2024-09-12T00:35:47.933249+0000","last_unstale":"2024-09-12T01:19:18.566225+0000","last_undegraded":"2024-09-12T01:19:18.566225+0000","last_fullsized":"2024-09-12T01:19:18.566225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:47.085642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'339","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.735988+0000","last_change":"2024-09-12T00:35:49.952443+0000","last_active":"2024-09-12T01:21:57.735988+0000","last_peered":"2024-09-12T01:21:57.735988+0000","last_clean":"2024-09-12T01:21:57.735988+0000","last_became_active":"2024-09-12T00:35:49.951438+0000","last_became_peered":"2024-09-12T00:35:49.951438+0000","last_unstale":"2024-09-12T01:21:57.735988+0000","last_undegraded":"2024-09-12T01:21:57.735988+0000","last_fullsized":"2024-09-12T01:21:57.735988+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:58.543209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44615,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":554,"num_read_kb":1150,"num_write":438,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:22.795536+0000","last_change":"2024-09-12T00:35:51.984956+0000","last_active":"2024-09-12T01:19:22.795536+0000","last_peered":"2024-09-12T01:19:22.795536+0000","last_clean":"2024-09-12T01:19:22.795536+0000","last_became_active":"2024-09-12T00:35:51.984350+0000","last_became_peered":"2024-09-12T00:35:51.984350+0000","last_unstale":"2024-09-12T01:19:22.795536+0000","last_undegraded":"2024-09-12T01:19:22.795536+0000","last_fullsized":"2024-09-12T01:19:22.795536+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:25.562363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'203","reported_seq":802,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:17.912553+0000","last_change":"2024-09-12T00:35:53.998522+0000","last_active":"2024-09-12T01:20:17.912553+0000","last_peered":"2024-09-12T01:20:17.912553+0000","last_clean":"2024-09-12T01:20:17.912553+0000","last_became_active":"2024-09-12T00:35:53.995513+0000","last_became_peered":"2024-09-12T00:35:53.995513+0000","last_unstale":"2024-09-12T01:20:17.912553+0000","last_undegraded":"2024-09-12T01:20:17.912553+0000","last_fullsized":"2024-09-12T01:20:17.912553+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:28.256858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":409,"num_read_kb":360,"num_write":396,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'241","reported_seq":868,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:07.808738+0000","last_change":"2024-09-12T00:35:45.940693+0000","last_active":"2024-09-12T01:20:07.808738+0000","last_peered":"2024-09-12T01:20:07.808738+0000","last_clean":"2024-09-12T01:20:07.808738+0000","last_became_active":"2024-09-12T00:35:45.939962+0000","last_became_peered":"2024-09-12T00:35:45.939962+0000","last_unstale":"2024-09-12T01:20:07.808738+0000","last_undegraded":"2024-09-12T01:20:07.808738+0000","last_fullsized":"2024-09-12T01:20:07.808738+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:44.308762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1036,"num_read_kb":844,"num_write":371,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'378","reported_seq":1090,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:02.751301+0000","last_change":"2024-09-12T01:22:02.751301+0000","last_active":"2024-09-12T01:22:02.751301+0000","last_peered":"2024-09-12T01:22:02.751301+0000","last_clean":"2024-09-12T01:22:02.751301+0000","last_became_active":"2024-09-12T00:35:43.944705+0000","last_became_peered":"2024-09-12T00:35:43.944705+0000","last_unstale":"2024-09-12T01:22:02.751301+0000","last_undegraded":"2024-09-12T01:22:02.751301+0000","last_fullsized":"2024-09-12T01:22:02.751301+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'378","last_scrub_stamp":"2024-09-12T01:22:02.751158+0000","last_deep_scrub":"265'378","last_deep_scrub_stamp":"2024-09-12T01:22:02.751158+0000","last_clean_scrub_stamp":"2024-09-12T01:22:02.751158+0000","objects_scrubbed":10,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:41.394968+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1344150,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":792,"num_read_kb":8209,"num_write":1184,"num_write_kb":28685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:58.575009+0000","last_change":"2024-09-12T00:35:47.946592+0000","last_active":"2024-09-12T01:17:58.575009+0000","last_peered":"2024-09-12T01:17:58.575009+0000","last_clean":"2024-09-12T01:17:58.575009+0000","last_became_active":"2024-09-12T00:35:47.945971+0000","last_became_peered":"2024-09-12T00:35:47.945971+0000","last_unstale":"2024-09-12T01:17:58.575009+0000","last_undegraded":"2024-09-12T01:17:58.575009+0000","last_fullsized":"2024-09-12T01:17:58.575009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:39.808186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'93","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:22.553249+0000","last_change":"2024-09-12T00:35:49.939105+0000","last_active":"2024-09-12T01:19:22.553249+0000","last_peered":"2024-09-12T01:19:22.553249+0000","last_clean":"2024-09-12T01:19:22.553249+0000","last_became_active":"2024-09-12T00:35:49.938374+0000","last_became_peered":"2024-09-12T00:35:49.938374+0000","last_unstale":"2024-09-12T01:19:22.553249+0000","last_undegraded":"2024-09-12T01:19:22.553249+0000","last_fullsized":"2024-09-12T01:19:22.553249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:28.914067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:22.553202+0000","last_change":"2024-09-12T00:35:51.975432+0000","last_active":"2024-09-12T01:19:22.553202+0000","last_peered":"2024-09-12T01:19:22.553202+0000","last_clean":"2024-09-12T01:19:22.553202+0000","last_became_active":"2024-09-12T00:35:51.974659+0000","last_became_peered":"2024-09-12T00:35:51.974659+0000","last_unstale":"2024-09-12T01:19:22.553202+0000","last_undegraded":"2024-09-12T01:19:22.553202+0000","last_fullsized":"2024-09-12T01:19:22.553202+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:42.719938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'114","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:44.542108+0000","last_change":"2024-09-12T00:35:53.994008+0000","last_active":"2024-09-12T01:19:44.542108+0000","last_peered":"2024-09-12T01:19:44.542108+0000","last_clean":"2024-09-12T01:19:44.542108+0000","last_became_active":"2024-09-12T00:35:53.992311+0000","last_became_peered":"2024-09-12T00:35:53.992311+0000","last_unstale":"2024-09-12T01:19:44.542108+0000","last_undegraded":"2024-09-12T01:19:44.542108+0000","last_fullsized":"2024-09-12T01:19:44.542108+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:28.357194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":265,"num_read_kb":226,"num_write":268,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'268","reported_seq":913,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.574373+0000","last_change":"2024-09-12T00:35:45.941958+0000","last_active":"2024-09-12T01:19:18.574373+0000","last_peered":"2024-09-12T01:19:18.574373+0000","last_clean":"2024-09-12T01:19:18.574373+0000","last_became_active":"2024-09-12T00:35:45.941543+0000","last_became_peered":"2024-09-12T00:35:45.941543+0000","last_unstale":"2024-09-12T01:19:18.574373+0000","last_undegraded":"2024-09-12T01:19:18.574373+0000","last_fullsized":"2024-09-12T01:19:18.574373+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:08.224075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1165,"num_read_kb":955,"num_write":416,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'388","reported_seq":1102,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.830452+0000","last_change":"2024-09-12T00:35:43.953442+0000","last_active":"2024-09-12T01:21:57.830452+0000","last_peered":"2024-09-12T01:21:57.830452+0000","last_clean":"2024-09-12T01:21:57.830452+0000","last_became_active":"2024-09-12T00:35:43.952543+0000","last_became_peered":"2024-09-12T00:35:43.952543+0000","last_unstale":"2024-09-12T01:21:57.830452+0000","last_undegraded":"2024-09-12T01:21:57.830452+0000","last_fullsized":"2024-09-12T01:21:57.830452+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:44.952950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262200,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":772,"num_read_kb":780,"num_write":1221,"num_write_kb":19641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.594613+0000","last_change":"2024-09-12T00:35:47.934527+0000","last_active":"2024-09-12T01:19:18.594613+0000","last_peered":"2024-09-12T01:19:18.594613+0000","last_clean":"2024-09-12T01:19:18.594613+0000","last_became_active":"2024-09-12T00:35:47.933896+0000","last_became_peered":"2024-09-12T00:35:47.933896+0000","last_unstale":"2024-09-12T01:19:18.594613+0000","last_undegraded":"2024-09-12T01:19:18.594613+0000","last_fullsized":"2024-09-12T01:19:18.594613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:11.718346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'113","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.483543+0000","last_change":"2024-09-12T00:35:49.937626+0000","last_active":"2024-09-12T01:18:23.483543+0000","last_peered":"2024-09-12T01:18:23.483543+0000","last_clean":"2024-09-12T01:18:23.483543+0000","last_became_active":"2024-09-12T00:35:49.936846+0000","last_became_peered":"2024-09-12T00:35:49.936846+0000","last_unstale":"2024-09-12T01:18:23.483543+0000","last_undegraded":"2024-09-12T01:18:23.483543+0000","last_fullsized":"2024-09-12T01:18:23.483543+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:16.548831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":139,"num_read_kb":131,"num_write":92,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'773","reported_seq":2288,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.434294+0000","last_change":"2024-09-12T00:35:51.980021+0000","last_active":"2024-09-12T01:21:57.434294+0000","last_peered":"2024-09-12T01:21:57.434294+0000","last_clean":"2024-09-12T01:21:57.434294+0000","last_became_active":"2024-09-12T00:35:51.979288+0000","last_became_peered":"2024-09-12T00:35:51.979288+0000","last_unstale":"2024-09-12T01:21:57.434294+0000","last_undegraded":"2024-09-12T01:21:57.434294+0000","last_fullsized":"2024-09-12T01:21:57.434294+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:56.227079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'188","reported_seq":1012,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.127347+0000","last_change":"2024-09-12T00:35:54.014161+0000","last_active":"2024-09-12T01:20:23.127347+0000","last_peered":"2024-09-12T01:20:23.127347+0000","last_clean":"2024-09-12T01:20:23.127347+0000","last_became_active":"2024-09-12T00:35:54.013299+0000","last_became_peered":"2024-09-12T00:35:54.013299+0000","last_unstale":"2024-09-12T01:20:23.127347+0000","last_undegraded":"2024-09-12T01:20:23.127347+0000","last_fullsized":"2024-09-12T01:20:23.127347+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:35.433076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":837,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":580,"num_read_kb":578,"num_write":407,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'105","reported_seq":677,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.594579+0000","last_change":"2024-09-12T00:35:45.955221+0000","last_active":"2024-09-12T01:19:18.594579+0000","last_peered":"2024-09-12T01:19:18.594579+0000","last_clean":"2024-09-12T01:19:18.594579+0000","last_became_active":"2024-09-12T00:35:45.954858+0000","last_became_peered":"2024-09-12T00:35:45.954858+0000","last_unstale":"2024-09-12T01:19:18.594579+0000","last_undegraded":"2024-09-12T01:19:18.594579+0000","last_fullsized":"2024-09-12T01:19:18.594579+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:35.164506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":470,"num_read_kb":391,"num_write":166,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'355","reported_seq":1011,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.828208+0000","last_change":"2024-09-12T00:35:43.931623+0000","last_active":"2024-09-12T01:21:57.828208+0000","last_peered":"2024-09-12T01:21:57.828208+0000","last_clean":"2024-09-12T01:21:57.828208+0000","last_became_active":"2024-09-12T00:35:43.930867+0000","last_became_peered":"2024-09-12T00:35:43.930867+0000","last_unstale":"2024-09-12T01:21:57.828208+0000","last_undegraded":"2024-09-12T01:21:57.828208+0000","last_fullsized":"2024-09-12T01:21:57.828208+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:00.843291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291487,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":529,"num_read_kb":73816,"num_write":1070,"num_write_kb":41341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.566330+0000","last_change":"2024-09-12T00:35:47.931572+0000","last_active":"2024-09-12T01:19:18.566330+0000","last_peered":"2024-09-12T01:19:18.566330+0000","last_clean":"2024-09-12T01:19:18.566330+0000","last_became_active":"2024-09-12T00:35:47.930883+0000","last_became_peered":"2024-09-12T00:35:47.930883+0000","last_unstale":"2024-09-12T01:19:18.566330+0000","last_undegraded":"2024-09-12T01:19:18.566330+0000","last_fullsized":"2024-09-12T01:19:18.566330+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:26.632000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'289","reported_seq":861,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.543556+0000","last_change":"2024-09-12T00:35:50.030382+0000","last_active":"2024-09-12T01:21:57.543556+0000","last_peered":"2024-09-12T01:21:57.543556+0000","last_clean":"2024-09-12T01:21:57.543556+0000","last_became_active":"2024-09-12T00:35:50.029236+0000","last_became_peered":"2024-09-12T00:35:50.029236+0000","last_unstale":"2024-09-12T01:21:57.543556+0000","last_undegraded":"2024-09-12T01:21:57.543556+0000","last_fullsized":"2024-09-12T01:21:57.543556+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:36.054917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54671,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":1128,"num_write":386,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'786","reported_seq":2331,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.316034+0000","last_change":"2024-09-12T00:35:51.983959+0000","last_active":"2024-09-12T01:21:57.316034+0000","last_peered":"2024-09-12T01:21:57.316034+0000","last_clean":"2024-09-12T01:21:57.316034+0000","last_became_active":"2024-09-12T00:35:51.983271+0000","last_became_peered":"2024-09-12T00:35:51.983271+0000","last_unstale":"2024-09-12T01:21:57.316034+0000","last_undegraded":"2024-09-12T01:21:57.316034+0000","last_fullsized":"2024-09-12T01:21:57.316034+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:13.842922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'260","reported_seq":932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.563677+0000","last_change":"2024-09-12T00:35:45.940778+0000","last_active":"2024-09-12T01:19:08.563677+0000","last_peered":"2024-09-12T01:19:08.563677+0000","last_clean":"2024-09-12T01:19:08.563677+0000","last_became_active":"2024-09-12T00:35:45.940073+0000","last_became_peered":"2024-09-12T00:35:45.940073+0000","last_unstale":"2024-09-12T01:19:08.563677+0000","last_undegraded":"2024-09-12T01:19:08.563677+0000","last_fullsized":"2024-09-12T01:19:08.563677+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:47.849352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1192,"num_read_kb":982,"num_write":401,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'352","reported_seq":1061,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.857709+0000","last_change":"2024-09-12T00:35:43.957315+0000","last_active":"2024-09-12T01:21:57.857709+0000","last_peered":"2024-09-12T01:21:57.857709+0000","last_clean":"2024-09-12T01:21:57.857709+0000","last_became_active":"2024-09-12T00:35:43.956814+0000","last_became_peered":"2024-09-12T00:35:43.956814+0000","last_unstale":"2024-09-12T01:21:57.857709+0000","last_undegraded":"2024-09-12T01:21:57.857709+0000","last_fullsized":"2024-09-12T01:21:57.857709+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:24.210436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":767,"num_read_kb":6356,"num_write":996,"num_write_kb":17273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.791834+0000","last_change":"2024-09-12T00:35:47.945726+0000","last_active":"2024-09-12T01:19:07.791834+0000","last_peered":"2024-09-12T01:19:07.791834+0000","last_clean":"2024-09-12T01:19:07.791834+0000","last_became_active":"2024-09-12T00:35:47.944913+0000","last_became_peered":"2024-09-12T00:35:47.944913+0000","last_unstale":"2024-09-12T01:19:07.791834+0000","last_undegraded":"2024-09-12T01:19:07.791834+0000","last_fullsized":"2024-09-12T01:19:07.791834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:02.558771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'348","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.872006+0000","last_change":"2024-09-12T00:35:50.028219+0000","last_active":"2024-09-12T01:21:57.872006+0000","last_peered":"2024-09-12T01:21:57.872006+0000","last_clean":"2024-09-12T01:21:57.872006+0000","last_became_active":"2024-09-12T00:35:50.027282+0000","last_became_peered":"2024-09-12T00:35:50.027282+0000","last_unstale":"2024-09-12T01:21:57.872006+0000","last_undegraded":"2024-09-12T01:21:57.872006+0000","last_fullsized":"2024-09-12T01:21:57.872006+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:27.196205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45216,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":563,"num_read_kb":1133,"num_write":440,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.569449+0000","last_change":"2024-09-12T00:35:51.972158+0000","last_active":"2024-09-12T01:18:38.569449+0000","last_peered":"2024-09-12T01:18:38.569449+0000","last_clean":"2024-09-12T01:18:38.569449+0000","last_became_active":"2024-09-12T00:35:51.971491+0000","last_became_peered":"2024-09-12T00:35:51.971491+0000","last_unstale":"2024-09-12T01:18:38.569449+0000","last_undegraded":"2024-09-12T01:18:38.569449+0000","last_fullsized":"2024-09-12T01:18:38.569449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:22.911772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'555","reported_seq":1370,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.367346+0000","last_change":"2024-09-12T00:35:54.000046+0000","last_active":"2024-09-12T01:21:25.367346+0000","last_peered":"2024-09-12T01:21:25.367346+0000","last_clean":"2024-09-12T01:21:25.367346+0000","last_became_active":"2024-09-12T00:35:53.996514+0000","last_became_peered":"2024-09-12T00:35:53.996514+0000","last_unstale":"2024-09-12T01:21:25.367346+0000","last_undegraded":"2024-09-12T01:21:25.367346+0000","last_fullsized":"2024-09-12T01:21:25.367346+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:55.200677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1307,"num_read_kb":1296,"num_write":1166,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'136","reported_seq":740,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.750429+0000","last_change":"2024-09-12T00:35:45.943831+0000","last_active":"2024-09-12T01:19:07.750429+0000","last_peered":"2024-09-12T01:19:07.750429+0000","last_clean":"2024-09-12T01:19:07.750429+0000","last_became_active":"2024-09-12T00:35:45.943083+0000","last_became_peered":"2024-09-12T00:35:45.943083+0000","last_unstale":"2024-09-12T01:19:07.750429+0000","last_undegraded":"2024-09-12T01:19:07.750429+0000","last_fullsized":"2024-09-12T01:19:07.750429+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:26.091545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":650,"num_read_kb":541,"num_write":222,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'338","reported_seq":981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.856796+0000","last_change":"2024-09-12T00:35:43.954537+0000","last_active":"2024-09-12T01:21:57.856796+0000","last_peered":"2024-09-12T01:21:57.856796+0000","last_clean":"2024-09-12T01:21:57.856796+0000","last_became_active":"2024-09-12T00:35:43.953664+0000","last_became_peered":"2024-09-12T00:35:43.953664+0000","last_unstale":"2024-09-12T01:21:57.856796+0000","last_undegraded":"2024-09-12T01:21:57.856796+0000","last_fullsized":"2024-09-12T01:21:57.856796+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:13.149672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288989,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":479,"num_read_kb":49556,"num_write":1051,"num_write_kb":45556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:10.566168+0000","last_change":"2024-09-12T00:35:47.937702+0000","last_active":"2024-09-12T01:19:10.566168+0000","last_peered":"2024-09-12T01:19:10.566168+0000","last_clean":"2024-09-12T01:19:10.566168+0000","last_became_active":"2024-09-12T00:35:47.936972+0000","last_became_peered":"2024-09-12T00:35:47.936972+0000","last_unstale":"2024-09-12T01:19:10.566168+0000","last_undegraded":"2024-09-12T01:19:10.566168+0000","last_fullsized":"2024-09-12T01:19:10.566168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:21.464118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'266","reported_seq":838,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.165456+0000","last_change":"2024-09-12T00:35:49.955401+0000","last_active":"2024-09-12T01:21:57.165456+0000","last_peered":"2024-09-12T01:21:57.165456+0000","last_clean":"2024-09-12T01:21:57.165456+0000","last_became_active":"2024-09-12T00:35:49.954568+0000","last_became_peered":"2024-09-12T00:35:49.954568+0000","last_unstale":"2024-09-12T01:21:57.165456+0000","last_undegraded":"2024-09-12T01:21:57.165456+0000","last_fullsized":"2024-09-12T01:21:57.165456+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:57.669990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45999,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":441,"num_read_kb":1004,"num_write":356,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:23.595568+0000","last_change":"2024-09-12T00:35:51.982044+0000","last_active":"2024-09-12T01:19:23.595568+0000","last_peered":"2024-09-12T01:19:23.595568+0000","last_clean":"2024-09-12T01:19:23.595568+0000","last_became_active":"2024-09-12T00:35:51.981326+0000","last_became_peered":"2024-09-12T00:35:51.981326+0000","last_unstale":"2024-09-12T01:19:23.595568+0000","last_undegraded":"2024-09-12T01:19:23.595568+0000","last_fullsized":"2024-09-12T01:19:23.595568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:53.955317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'2394","reported_seq":4228,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:14.960049+0000","last_change":"2024-09-12T00:35:53.975817+0000","last_active":"2024-09-12T01:21:14.960049+0000","last_peered":"2024-09-12T01:21:14.960049+0000","last_clean":"2024-09-12T01:21:14.960049+0000","last_became_active":"2024-09-12T00:35:53.975054+0000","last_became_peered":"2024-09-12T00:35:53.975054+0000","last_unstale":"2024-09-12T01:21:14.960049+0000","last_undegraded":"2024-09-12T01:21:14.960049+0000","last_fullsized":"2024-09-12T01:21:14.960049+0000","mapping_epoch":34,"log_start":"265'2300","ondisk_log_start":"265'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":2300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:31.278726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6031,"num_read_kb":6023,"num_write":4852,"num_write_kb":1786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'134","reported_seq":750,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:12.558238+0000","last_change":"2024-09-12T00:35:45.954433+0000","last_active":"2024-09-12T01:19:12.558238+0000","last_peered":"2024-09-12T01:19:12.558238+0000","last_clean":"2024-09-12T01:19:12.558238+0000","last_became_active":"2024-09-12T00:35:45.953664+0000","last_became_peered":"2024-09-12T00:35:45.953664+0000","last_unstale":"2024-09-12T01:19:12.558238+0000","last_undegraded":"2024-09-12T01:19:12.558238+0000","last_fullsized":"2024-09-12T01:19:12.558238+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:20.996949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":607,"num_read_kb":511,"num_write":198,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'327","reported_seq":1029,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.815595+0000","last_change":"2024-09-12T00:35:43.943348+0000","last_active":"2024-09-12T01:21:57.815595+0000","last_peered":"2024-09-12T01:21:57.815595+0000","last_clean":"2024-09-12T01:21:57.815595+0000","last_became_active":"2024-09-12T00:35:43.942454+0000","last_became_peered":"2024-09-12T00:35:43.942454+0000","last_unstale":"2024-09-12T01:21:57.815595+0000","last_undegraded":"2024-09-12T01:21:57.815595+0000","last_fullsized":"2024-09-12T01:21:57.815595+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:18.360119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":618,"num_read_kb":3434,"num_write":1027,"num_write_kb":23754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:35.558281+0000","last_change":"2024-09-12T00:35:47.942488+0000","last_active":"2024-09-12T01:18:35.558281+0000","last_peered":"2024-09-12T01:18:35.558281+0000","last_clean":"2024-09-12T01:18:35.558281+0000","last_became_active":"2024-09-12T00:35:47.942189+0000","last_became_peered":"2024-09-12T00:35:47.942189+0000","last_unstale":"2024-09-12T01:18:35.558281+0000","last_undegraded":"2024-09-12T01:18:35.558281+0000","last_fullsized":"2024-09-12T01:18:35.558281+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:52.594512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'318","reported_seq":913,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.738514+0000","last_change":"2024-09-12T00:35:49.943225+0000","last_active":"2024-09-12T01:21:56.738514+0000","last_peered":"2024-09-12T01:21:56.738514+0000","last_clean":"2024-09-12T01:21:56.738514+0000","last_became_active":"2024-09-12T00:35:49.942480+0000","last_became_peered":"2024-09-12T00:35:49.942480+0000","last_unstale":"2024-09-12T01:21:56.738514+0000","last_undegraded":"2024-09-12T01:21:56.738514+0000","last_fullsized":"2024-09-12T01:21:56.738514+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:22.668385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48782,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":529,"num_read_kb":1149,"num_write":428,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'772","reported_seq":2437,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.510993+0000","last_change":"2024-09-12T00:35:51.985725+0000","last_active":"2024-09-12T01:21:56.510993+0000","last_peered":"2024-09-12T01:21:56.510993+0000","last_clean":"2024-09-12T01:21:56.510993+0000","last_became_active":"2024-09-12T00:35:51.984968+0000","last_became_peered":"2024-09-12T00:35:51.984968+0000","last_unstale":"2024-09-12T01:21:56.510993+0000","last_undegraded":"2024-09-12T01:21:56.510993+0000","last_fullsized":"2024-09-12T01:21:56.510993+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:26.578990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'109","reported_seq":600,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:24.451554+0000","last_change":"2024-09-12T00:35:53.995319+0000","last_active":"2024-09-12T01:21:24.451554+0000","last_peered":"2024-09-12T01:21:24.451554+0000","last_clean":"2024-09-12T01:21:24.451554+0000","last_became_active":"2024-09-12T00:35:53.992664+0000","last_became_peered":"2024-09-12T00:35:53.992664+0000","last_unstale":"2024-09-12T01:21:24.451554+0000","last_undegraded":"2024-09-12T01:21:24.451554+0000","last_fullsized":"2024-09-12T01:21:24.451554+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:16.209394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":110,"num_write":262,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'190","reported_seq":797,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:01.759116+0000","last_change":"2024-09-12T00:35:45.940151+0000","last_active":"2024-09-12T01:19:01.759116+0000","last_peered":"2024-09-12T01:19:01.759116+0000","last_clean":"2024-09-12T01:19:01.759116+0000","last_became_active":"2024-09-12T00:35:45.939817+0000","last_became_peered":"2024-09-12T00:35:45.939817+0000","last_unstale":"2024-09-12T01:19:01.759116+0000","last_undegraded":"2024-09-12T01:19:01.759116+0000","last_fullsized":"2024-09-12T01:19:01.759116+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:58.194408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":809,"num_read_kb":663,"num_write":268,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'359","reported_seq":1013,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.869525+0000","last_change":"2024-09-12T00:35:43.913025+0000","last_active":"2024-09-12T01:21:57.869525+0000","last_peered":"2024-09-12T01:21:57.869525+0000","last_clean":"2024-09-12T01:21:57.869525+0000","last_became_active":"2024-09-12T00:35:43.912282+0000","last_became_peered":"2024-09-12T00:35:43.912282+0000","last_unstale":"2024-09-12T01:21:57.869525+0000","last_undegraded":"2024-09-12T01:21:57.869525+0000","last_fullsized":"2024-09-12T01:21:57.869525+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:35.570049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6327796,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":526,"num_read_kb":19021,"num_write":1167,"num_write_kb":32789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:20.568395+0000","last_change":"2024-09-12T00:35:47.947337+0000","last_active":"2024-09-12T01:19:20.568395+0000","last_peered":"2024-09-12T01:19:20.568395+0000","last_clean":"2024-09-12T01:19:20.568395+0000","last_became_active":"2024-09-12T00:35:47.946636+0000","last_became_peered":"2024-09-12T00:35:47.946636+0000","last_unstale":"2024-09-12T01:19:20.568395+0000","last_undegraded":"2024-09-12T01:19:20.568395+0000","last_fullsized":"2024-09-12T01:19:20.568395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:32.769942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'509","reported_seq":1146,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.273493+0000","last_change":"2024-09-12T00:35:49.951472+0000","last_active":"2024-09-12T01:21:57.273493+0000","last_peered":"2024-09-12T01:21:57.273493+0000","last_clean":"2024-09-12T01:21:57.273493+0000","last_became_active":"2024-09-12T00:35:49.950845+0000","last_became_peered":"2024-09-12T00:35:49.950845+0000","last_unstale":"2024-09-12T01:21:57.273493+0000","last_undegraded":"2024-09-12T01:21:57.273493+0000","last_fullsized":"2024-09-12T01:21:57.273493+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:03.493730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100676,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":870,"num_read_kb":2075,"num_write":716,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:15.567238+0000","last_change":"2024-09-12T00:35:51.979349+0000","last_active":"2024-09-12T01:19:15.567238+0000","last_peered":"2024-09-12T01:19:15.567238+0000","last_clean":"2024-09-12T01:19:15.567238+0000","last_became_active":"2024-09-12T00:35:51.978188+0000","last_became_peered":"2024-09-12T00:35:51.978188+0000","last_unstale":"2024-09-12T01:19:15.567238+0000","last_undegraded":"2024-09-12T01:19:15.567238+0000","last_fullsized":"2024-09-12T01:19:15.567238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:57.588270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'133","reported_seq":651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:07.813191+0000","last_change":"2024-09-12T00:35:53.986321+0000","last_active":"2024-09-12T01:20:07.813191+0000","last_peered":"2024-09-12T01:20:07.813191+0000","last_clean":"2024-09-12T01:20:07.813191+0000","last_became_active":"2024-09-12T00:35:53.985635+0000","last_became_peered":"2024-09-12T00:35:53.985635+0000","last_unstale":"2024-09-12T01:20:07.813191+0000","last_undegraded":"2024-09-12T01:20:07.813191+0000","last_fullsized":"2024-09-12T01:20:07.813191+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:38.196418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":203,"num_read_kb":181,"num_write":311,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'153","reported_seq":748,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:32.742795+0000","last_change":"2024-09-12T00:35:45.938944+0000","last_active":"2024-09-12T01:18:32.742795+0000","last_peered":"2024-09-12T01:18:32.742795+0000","last_clean":"2024-09-12T01:18:32.742795+0000","last_became_active":"2024-09-12T00:35:45.938135+0000","last_became_peered":"2024-09-12T00:35:45.938135+0000","last_unstale":"2024-09-12T01:18:32.742795+0000","last_undegraded":"2024-09-12T01:18:32.742795+0000","last_fullsized":"2024-09-12T01:18:32.742795+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:04.224264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":684,"num_read_kb":556,"num_write":242,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'379","reported_seq":1017,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.851838+0000","last_change":"2024-09-12T00:35:43.939014+0000","last_active":"2024-09-12T01:21:57.851838+0000","last_peered":"2024-09-12T01:21:57.851838+0000","last_clean":"2024-09-12T01:21:57.851838+0000","last_became_active":"2024-09-12T00:35:43.936713+0000","last_became_peered":"2024-09-12T00:35:43.936713+0000","last_unstale":"2024-09-12T01:21:57.851838+0000","last_undegraded":"2024-09-12T01:21:57.851838+0000","last_fullsized":"2024-09-12T01:21:57.851838+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:51.023354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730170,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":551,"num_read_kb":26422,"num_write":1213,"num_write_kb":29680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:35.558367+0000","last_change":"2024-09-12T00:35:47.939169+0000","last_active":"2024-09-12T01:18:35.558367+0000","last_peered":"2024-09-12T01:18:35.558367+0000","last_clean":"2024-09-12T01:18:35.558367+0000","last_became_active":"2024-09-12T00:35:47.938604+0000","last_became_peered":"2024-09-12T00:35:47.938604+0000","last_unstale":"2024-09-12T01:18:35.558367+0000","last_undegraded":"2024-09-12T01:18:35.558367+0000","last_fullsized":"2024-09-12T01:18:35.558367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:16.268476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'307","reported_seq":890,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.303125+0000","last_change":"2024-09-12T00:35:49.941521+0000","last_active":"2024-09-12T01:21:57.303125+0000","last_peered":"2024-09-12T01:21:57.303125+0000","last_clean":"2024-09-12T01:21:57.303125+0000","last_became_active":"2024-09-12T00:35:49.940679+0000","last_became_peered":"2024-09-12T00:35:49.940679+0000","last_unstale":"2024-09-12T01:21:57.303125+0000","last_undegraded":"2024-09-12T01:21:57.303125+0000","last_fullsized":"2024-09-12T01:21:57.303125+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:45.183044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52849,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":502,"num_read_kb":1074,"num_write":450,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":483,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:48.567233+0000","last_change":"2024-09-12T00:35:51.978558+0000","last_active":"2024-09-12T01:18:48.567233+0000","last_peered":"2024-09-12T01:18:48.567233+0000","last_clean":"2024-09-12T01:18:48.567233+0000","last_became_active":"2024-09-12T00:35:51.977807+0000","last_became_peered":"2024-09-12T00:35:51.977807+0000","last_unstale":"2024-09-12T01:18:48.567233+0000","last_undegraded":"2024-09-12T01:18:48.567233+0000","last_fullsized":"2024-09-12T01:18:48.567233+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:54.797988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'99","reported_seq":602,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:03.604948+0000","last_change":"2024-09-12T00:35:54.003890+0000","last_active":"2024-09-12T01:20:03.604948+0000","last_peered":"2024-09-12T01:20:03.604948+0000","last_clean":"2024-09-12T01:20:03.604948+0000","last_became_active":"2024-09-12T00:35:54.003115+0000","last_became_peered":"2024-09-12T00:35:54.003115+0000","last_unstale":"2024-09-12T01:20:03.604948+0000","last_undegraded":"2024-09-12T01:20:03.604948+0000","last_fullsized":"2024-09-12T01:20:03.604948+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:19.982476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":131,"num_write":237,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'498","reported_seq":1281,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.989879+0000","last_change":"2024-09-12T00:35:45.930828+0000","last_active":"2024-09-12T01:20:22.989879+0000","last_peered":"2024-09-12T01:20:22.989879+0000","last_clean":"2024-09-12T01:20:22.989879+0000","last_became_active":"2024-09-12T00:35:45.929526+0000","last_became_peered":"2024-09-12T00:35:45.929526+0000","last_unstale":"2024-09-12T01:20:22.989879+0000","last_undegraded":"2024-09-12T01:20:22.989879+0000","last_fullsized":"2024-09-12T01:20:22.989879+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:44.529056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2425,"num_read_kb":2075,"num_write":878,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'274","reported_seq":862,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.786591+0000","last_change":"2024-09-12T00:35:43.945078+0000","last_active":"2024-09-12T01:21:57.786591+0000","last_peered":"2024-09-12T01:21:57.786591+0000","last_clean":"2024-09-12T01:21:57.786591+0000","last_became_active":"2024-09-12T00:35:43.944483+0000","last_became_peered":"2024-09-12T00:35:43.944483+0000","last_unstale":"2024-09-12T01:21:57.786591+0000","last_undegraded":"2024-09-12T01:21:57.786591+0000","last_fullsized":"2024-09-12T01:21:57.786591+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:23.857439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":355,"num_read_kb":347,"num_write":887,"num_write_kb":15629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:33.568409+0000","last_change":"2024-09-12T00:35:47.944100+0000","last_active":"2024-09-12T01:18:33.568409+0000","last_peered":"2024-09-12T01:18:33.568409+0000","last_clean":"2024-09-12T01:18:33.568409+0000","last_became_active":"2024-09-12T00:35:47.943382+0000","last_became_peered":"2024-09-12T00:35:47.943382+0000","last_unstale":"2024-09-12T01:18:33.568409+0000","last_undegraded":"2024-09-12T01:18:33.568409+0000","last_fullsized":"2024-09-12T01:18:33.568409+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:55.004421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'319","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.055614+0000","last_change":"2024-09-12T00:35:49.949821+0000","last_active":"2024-09-12T01:21:57.055614+0000","last_peered":"2024-09-12T01:21:57.055614+0000","last_clean":"2024-09-12T01:21:57.055614+0000","last_became_active":"2024-09-12T00:35:49.949283+0000","last_became_peered":"2024-09-12T00:35:49.949283+0000","last_unstale":"2024-09-12T01:21:57.055614+0000","last_undegraded":"2024-09-12T01:21:57.055614+0000","last_fullsized":"2024-09-12T01:21:57.055614+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:44.062401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52286,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":532,"num_read_kb":1204,"num_write":436,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'725","reported_seq":2256,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.630942+0000","last_change":"2024-09-12T00:35:51.979871+0000","last_active":"2024-09-12T01:21:57.630942+0000","last_peered":"2024-09-12T01:21:57.630942+0000","last_clean":"2024-09-12T01:21:57.630942+0000","last_became_active":"2024-09-12T00:35:51.979162+0000","last_became_peered":"2024-09-12T00:35:51.979162+0000","last_unstale":"2024-09-12T01:21:57.630942+0000","last_undegraded":"2024-09-12T01:21:57.630942+0000","last_fullsized":"2024-09-12T01:21:57.630942+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:24.612749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'115","reported_seq":603,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.981076+0000","last_change":"2024-09-12T00:35:53.982884+0000","last_active":"2024-09-12T01:20:22.981076+0000","last_peered":"2024-09-12T01:20:22.981076+0000","last_clean":"2024-09-12T01:20:22.981076+0000","last_became_active":"2024-09-12T00:35:53.981735+0000","last_became_peered":"2024-09-12T00:35:53.981735+0000","last_unstale":"2024-09-12T01:20:22.981076+0000","last_undegraded":"2024-09-12T01:20:22.981076+0000","last_fullsized":"2024-09-12T01:20:22.981076+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:48.987492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":92,"num_write":265,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'349","reported_seq":1039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:57.362515+0000","last_change":"2024-09-12T00:35:45.954531+0000","last_active":"2024-09-12T01:19:57.362515+0000","last_peered":"2024-09-12T01:19:57.362515+0000","last_clean":"2024-09-12T01:19:57.362515+0000","last_became_active":"2024-09-12T00:35:45.953935+0000","last_became_peered":"2024-09-12T00:35:45.953935+0000","last_unstale":"2024-09-12T01:19:57.362515+0000","last_undegraded":"2024-09-12T01:19:57.362515+0000","last_fullsized":"2024-09-12T01:19:57.362515+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:23.435584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1509,"num_read_kb":1228,"num_write":558,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'323","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.851138+0000","last_change":"2024-09-12T00:35:43.930345+0000","last_active":"2024-09-12T01:21:57.851138+0000","last_peered":"2024-09-12T01:21:57.851138+0000","last_clean":"2024-09-12T01:21:57.851138+0000","last_became_active":"2024-09-12T00:35:43.929559+0000","last_became_peered":"2024-09-12T00:35:43.929559+0000","last_unstale":"2024-09-12T01:21:57.851138+0000","last_undegraded":"2024-09-12T01:21:57.851138+0000","last_fullsized":"2024-09-12T01:21:57.851138+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:34.819090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2025256,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":451,"num_read_kb":47620,"num_write":929,"num_write_kb":27870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1462,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.247461+0000","last_change":"2024-09-12T00:35:47.936838+0000","last_active":"2024-09-12T01:21:56.247461+0000","last_peered":"2024-09-12T01:21:56.247461+0000","last_clean":"2024-09-12T01:21:56.247461+0000","last_became_active":"2024-09-12T00:35:47.936026+0000","last_became_peered":"2024-09-12T00:35:47.936026+0000","last_unstale":"2024-09-12T01:21:56.247461+0000","last_undegraded":"2024-09-12T01:21:56.247461+0000","last_fullsized":"2024-09-12T01:21:56.247461+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:42.930790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":965,"num_read_kb":965,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'80","reported_seq":595,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:51.233520+0000","last_change":"2024-09-12T00:35:50.027677+0000","last_active":"2024-09-12T01:18:51.233520+0000","last_peered":"2024-09-12T01:18:51.233520+0000","last_clean":"2024-09-12T01:18:51.233520+0000","last_became_active":"2024-09-12T00:35:50.027161+0000","last_became_peered":"2024-09-12T00:35:50.027161+0000","last_unstale":"2024-09-12T01:18:51.233520+0000","last_undegraded":"2024-09-12T01:18:51.233520+0000","last_fullsized":"2024-09-12T01:18:51.233520+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:29.997291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'774","reported_seq":6319,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.429142+0000","last_change":"2024-09-12T00:35:51.977887+0000","last_active":"2024-09-12T01:21:57.429142+0000","last_peered":"2024-09-12T01:21:57.429142+0000","last_clean":"2024-09-12T01:21:57.429142+0000","last_became_active":"2024-09-12T00:35:51.976947+0000","last_became_peered":"2024-09-12T00:35:51.976947+0000","last_unstale":"2024-09-12T01:21:57.429142+0000","last_undegraded":"2024-09-12T01:21:57.429142+0000","last_fullsized":"2024-09-12T01:21:57.429142+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:41.190642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'156","reported_seq":653,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:03.702547+0000","last_change":"2024-09-12T00:35:53.995354+0000","last_active":"2024-09-12T01:20:03.702547+0000","last_peered":"2024-09-12T01:20:03.702547+0000","last_clean":"2024-09-12T01:20:03.702547+0000","last_became_active":"2024-09-12T00:35:53.994715+0000","last_became_peered":"2024-09-12T00:35:53.994715+0000","last_unstale":"2024-09-12T01:20:03.702547+0000","last_undegraded":"2024-09-12T01:20:03.702547+0000","last_fullsized":"2024-09-12T01:20:03.702547+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:57.399598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":132,"num_read_kb":125,"num_write":372,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'158","reported_seq":698,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:58.526770+0000","last_change":"2024-09-12T00:36:17.050284+0000","last_active":"2024-09-12T01:20:58.526770+0000","last_peered":"2024-09-12T01:20:58.526770+0000","last_clean":"2024-09-12T01:20:58.526770+0000","last_became_active":"2024-09-12T00:36:17.049999+0000","last_became_peered":"2024-09-12T00:36:17.049999+0000","last_unstale":"2024-09-12T01:20:58.526770+0000","last_undegraded":"2024-09-12T01:20:58.526770+0000","last_fullsized":"2024-09-12T01:20:58.526770+0000","mapping_epoch":37,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:09.446877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":667,"num_read_kb":538,"num_write":243,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"265'359","reported_seq":1110,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.839026+0000","last_change":"2024-09-12T00:35:43.931842+0000","last_active":"2024-09-12T01:21:57.839026+0000","last_peered":"2024-09-12T01:21:57.839026+0000","last_clean":"2024-09-12T01:21:57.839026+0000","last_became_active":"2024-09-12T00:35:43.931562+0000","last_became_peered":"2024-09-12T00:35:43.931562+0000","last_unstale":"2024-09-12T01:21:57.839026+0000","last_undegraded":"2024-09-12T01:21:57.839026+0000","last_fullsized":"2024-09-12T01:21:57.839026+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:22.693505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992276,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":678,"num_read_kb":113913,"num_write":1161,"num_write_kb":34109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:32.742956+0000","last_change":"2024-09-12T00:35:47.930885+0000","last_active":"2024-09-12T01:18:32.742956+0000","last_peered":"2024-09-12T01:18:32.742956+0000","last_clean":"2024-09-12T01:18:32.742956+0000","last_became_active":"2024-09-12T00:35:47.930147+0000","last_became_peered":"2024-09-12T00:35:47.930147+0000","last_unstale":"2024-09-12T01:18:32.742956+0000","last_undegraded":"2024-09-12T01:18:32.742956+0000","last_fullsized":"2024-09-12T01:18:32.742956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:58.003654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'345","reported_seq":948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.771341+0000","last_change":"2024-09-12T00:35:49.939362+0000","last_active":"2024-09-12T01:21:57.771341+0000","last_peered":"2024-09-12T01:21:57.771341+0000","last_clean":"2024-09-12T01:21:57.771341+0000","last_became_active":"2024-09-12T00:35:49.938597+0000","last_became_peered":"2024-09-12T00:35:49.938597+0000","last_unstale":"2024-09-12T01:21:57.771341+0000","last_undegraded":"2024-09-12T01:21:57.771341+0000","last_fullsized":"2024-09-12T01:21:57.771341+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.934056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46738,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":571,"num_read_kb":1203,"num_write":454,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:37.551187+0000","last_change":"2024-09-12T00:35:51.968545+0000","last_active":"2024-09-12T01:18:37.551187+0000","last_peered":"2024-09-12T01:18:37.551187+0000","last_clean":"2024-09-12T01:18:37.551187+0000","last_became_active":"2024-09-12T00:35:51.967708+0000","last_became_peered":"2024-09-12T00:35:51.967708+0000","last_unstale":"2024-09-12T01:18:37.551187+0000","last_undegraded":"2024-09-12T01:18:37.551187+0000","last_fullsized":"2024-09-12T01:18:37.551187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:40.081105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'116","reported_seq":605,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:38.582809+0000","last_change":"2024-09-12T00:35:53.998562+0000","last_active":"2024-09-12T01:19:38.582809+0000","last_peered":"2024-09-12T01:19:38.582809+0000","last_clean":"2024-09-12T01:19:38.582809+0000","last_became_active":"2024-09-12T00:35:53.997893+0000","last_became_peered":"2024-09-12T00:35:53.997893+0000","last_unstale":"2024-09-12T01:19:38.582809+0000","last_undegraded":"2024-09-12T01:19:38.582809+0000","last_fullsized":"2024-09-12T01:19:38.582809+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:57.696902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":114,"num_write":260,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'95","reported_seq":679,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.563475+0000","last_change":"2024-09-12T00:35:45.945106+0000","last_active":"2024-09-12T01:19:37.563475+0000","last_peered":"2024-09-12T01:19:37.563475+0000","last_clean":"2024-09-12T01:19:37.563475+0000","last_became_active":"2024-09-12T00:35:45.941291+0000","last_became_peered":"2024-09-12T00:35:45.941291+0000","last_unstale":"2024-09-12T01:19:37.563475+0000","last_undegraded":"2024-09-12T01:19:37.563475+0000","last_fullsized":"2024-09-12T01:19:37.563475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:41.263421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":459,"num_read_kb":386,"num_write":145,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":611,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.797702+0000","last_change":"2024-09-12T00:35:25.098793+0000","last_active":"2024-09-12T01:19:32.797702+0000","last_peered":"2024-09-12T01:19:32.797702+0000","last_clean":"2024-09-12T01:19:32.797702+0000","last_became_active":"2024-09-12T00:35:25.096843+0000","last_became_peered":"2024-09-12T00:35:25.096843+0000","last_unstale":"2024-09-12T01:19:32.797702+0000","last_undegraded":"2024-09-12T01:19:32.797702+0000","last_fullsized":"2024-09-12T01:19:32.797702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:23.614097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:23.614097+0000","last_clean_scrub_stamp":"2024-09-12T00:35:23.614097+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:42.023728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.566130+0000","last_change":"2024-09-12T00:35:31.691879+0000","last_active":"2024-09-12T01:19:18.566130+0000","last_peered":"2024-09-12T01:19:18.566130+0000","last_clean":"2024-09-12T01:19:18.566130+0000","last_became_active":"2024-09-12T00:35:29.668145+0000","last_became_peered":"2024-09-12T00:35:29.668145+0000","last_unstale":"2024-09-12T01:19:18.566130+0000","last_undegraded":"2024-09-12T01:19:18.566130+0000","last_fullsized":"2024-09-12T01:19:18.566130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:18.650004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011070749999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'319","reported_seq":978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.852317+0000","last_change":"2024-09-12T00:35:43.920876+0000","last_active":"2024-09-12T01:21:57.852317+0000","last_peered":"2024-09-12T01:21:57.852317+0000","last_clean":"2024-09-12T01:21:57.852317+0000","last_became_active":"2024-09-12T00:35:43.916969+0000","last_became_peered":"2024-09-12T00:35:43.916969+0000","last_unstale":"2024-09-12T01:21:57.852317+0000","last_undegraded":"2024-09-12T01:21:57.852317+0000","last_fullsized":"2024-09-12T01:21:57.852317+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:16.584205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568993,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":119474,"num_write":1014,"num_write_kb":17296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.797857+0000","last_change":"2024-09-12T00:35:47.944667+0000","last_active":"2024-09-12T01:19:32.797857+0000","last_peered":"2024-09-12T01:19:32.797857+0000","last_clean":"2024-09-12T01:19:32.797857+0000","last_became_active":"2024-09-12T00:35:47.942643+0000","last_became_peered":"2024-09-12T00:35:47.942643+0000","last_unstale":"2024-09-12T01:19:32.797857+0000","last_undegraded":"2024-09-12T01:19:32.797857+0000","last_fullsized":"2024-09-12T01:19:32.797857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:06.078372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'696","reported_seq":1403,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.838470+0000","last_change":"2024-09-12T00:35:49.958641+0000","last_active":"2024-09-12T01:21:57.838470+0000","last_peered":"2024-09-12T01:21:57.838470+0000","last_clean":"2024-09-12T01:21:57.838470+0000","last_became_active":"2024-09-12T00:35:49.957694+0000","last_became_peered":"2024-09-12T00:35:49.957694+0000","last_unstale":"2024-09-12T01:21:57.838470+0000","last_undegraded":"2024-09-12T01:21:57.838470+0000","last_fullsized":"2024-09-12T01:21:57.838470+0000","mapping_epoch":30,"log_start":"265'600","ondisk_log_start":"265'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:23.494190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144071,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1382,"num_read_kb":3079,"num_write":1308,"num_write_kb":1154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:13.573190+0000","last_change":"2024-09-12T00:35:51.978016+0000","last_active":"2024-09-12T01:19:13.573190+0000","last_peered":"2024-09-12T01:19:13.573190+0000","last_clean":"2024-09-12T01:19:13.573190+0000","last_became_active":"2024-09-12T00:35:51.977282+0000","last_became_peered":"2024-09-12T00:35:51.977282+0000","last_unstale":"2024-09-12T01:19:13.573190+0000","last_undegraded":"2024-09-12T01:19:13.573190+0000","last_fullsized":"2024-09-12T01:19:13.573190+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:23.231926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'206","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.003775+0000","last_change":"2024-09-12T00:35:53.998069+0000","last_active":"2024-09-12T01:20:23.003775+0000","last_peered":"2024-09-12T01:20:23.003775+0000","last_clean":"2024-09-12T01:20:23.003775+0000","last_became_active":"2024-09-12T00:35:53.997354+0000","last_became_peered":"2024-09-12T00:35:53.997354+0000","last_unstale":"2024-09-12T01:20:23.003775+0000","last_undegraded":"2024-09-12T01:20:23.003775+0000","last_fullsized":"2024-09-12T01:20:23.003775+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:55.234664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":471,"num_write":454,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'239","reported_seq":897,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:02.408975+0000","last_change":"2024-09-12T00:35:45.946145+0000","last_active":"2024-09-12T01:20:02.408975+0000","last_peered":"2024-09-12T01:20:02.408975+0000","last_clean":"2024-09-12T01:20:02.408975+0000","last_became_active":"2024-09-12T00:35:45.945766+0000","last_became_peered":"2024-09-12T00:35:45.945766+0000","last_unstale":"2024-09-12T01:20:02.408975+0000","last_undegraded":"2024-09-12T01:20:02.408975+0000","last_fullsized":"2024-09-12T01:20:02.408975+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:50.991641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1032,"num_read_kb":857,"num_write":339,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.798875+0000","last_change":"2024-09-12T00:35:31.861888+0000","last_active":"2024-09-12T01:19:37.798875+0000","last_peered":"2024-09-12T01:19:37.798875+0000","last_clean":"2024-09-12T01:19:37.798875+0000","last_became_active":"2024-09-12T00:35:29.671287+0000","last_became_peered":"2024-09-12T00:35:29.671287+0000","last_unstale":"2024-09-12T01:19:37.798875+0000","last_undegraded":"2024-09-12T01:19:37.798875+0000","last_fullsized":"2024-09-12T01:19:37.798875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:47.739072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075002000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'397","reported_seq":1106,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.869110+0000","last_change":"2024-09-12T00:35:43.945658+0000","last_active":"2024-09-12T01:21:57.869110+0000","last_peered":"2024-09-12T01:21:57.869110+0000","last_clean":"2024-09-12T01:21:57.869110+0000","last_became_active":"2024-09-12T00:35:43.945335+0000","last_became_peered":"2024-09-12T00:35:43.945335+0000","last_unstale":"2024-09-12T01:21:57.869110+0000","last_undegraded":"2024-09-12T01:21:57.869110+0000","last_fullsized":"2024-09-12T01:21:57.869110+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:30.924593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":682,"num_read_kb":63013,"num_write":1485,"num_write_kb":40970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.563896+0000","last_change":"2024-09-12T00:35:47.926465+0000","last_active":"2024-09-12T01:19:08.563896+0000","last_peered":"2024-09-12T01:19:08.563896+0000","last_clean":"2024-09-12T01:19:08.563896+0000","last_became_active":"2024-09-12T00:35:47.925704+0000","last_became_peered":"2024-09-12T00:35:47.925704+0000","last_unstale":"2024-09-12T01:19:08.563896+0000","last_undegraded":"2024-09-12T01:19:08.563896+0000","last_fullsized":"2024-09-12T01:19:08.563896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:53.561342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1262","reported_seq":2757,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.811770+0000","last_change":"2024-09-12T00:35:49.948152+0000","last_active":"2024-09-12T01:21:57.811770+0000","last_peered":"2024-09-12T01:21:57.811770+0000","last_clean":"2024-09-12T01:21:57.811770+0000","last_became_active":"2024-09-12T00:35:49.947643+0000","last_became_peered":"2024-09-12T00:35:49.947643+0000","last_unstale":"2024-09-12T01:21:57.811770+0000","last_undegraded":"2024-09-12T01:21:57.811770+0000","last_fullsized":"2024-09-12T01:21:57.811770+0000","mapping_epoch":30,"log_start":"265'1200","ondisk_log_start":"265'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":1200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:30.009318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144243,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2043,"num_read_kb":3859,"num_write":1128,"num_write_kb":966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:42.800216+0000","last_change":"2024-09-12T00:35:51.981967+0000","last_active":"2024-09-12T01:19:42.800216+0000","last_peered":"2024-09-12T01:19:42.800216+0000","last_clean":"2024-09-12T01:19:42.800216+0000","last_became_active":"2024-09-12T00:35:51.981240+0000","last_became_peered":"2024-09-12T00:35:51.981240+0000","last_unstale":"2024-09-12T01:19:42.800216+0000","last_undegraded":"2024-09-12T01:19:42.800216+0000","last_fullsized":"2024-09-12T01:19:42.800216+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:42.148309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'135","reported_seq":643,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.074739+0000","last_change":"2024-09-12T00:35:54.014383+0000","last_active":"2024-09-12T01:20:23.074739+0000","last_peered":"2024-09-12T01:20:23.074739+0000","last_clean":"2024-09-12T01:20:23.074739+0000","last_became_active":"2024-09-12T00:35:54.013658+0000","last_became_peered":"2024-09-12T00:35:54.013658+0000","last_unstale":"2024-09-12T01:20:23.074739+0000","last_undegraded":"2024-09-12T01:20:23.074739+0000","last_fullsized":"2024-09-12T01:20:23.074739+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:12.904906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":184,"num_read_kb":167,"num_write":336,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'141","reported_seq":771,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:42.252694+0000","last_change":"2024-09-12T00:35:45.929654+0000","last_active":"2024-09-12T01:19:42.252694+0000","last_peered":"2024-09-12T01:19:42.252694+0000","last_clean":"2024-09-12T01:19:42.252694+0000","last_became_active":"2024-09-12T00:35:45.929073+0000","last_became_peered":"2024-09-12T00:35:45.929073+0000","last_unstale":"2024-09-12T01:19:42.252694+0000","last_undegraded":"2024-09-12T01:19:42.252694+0000","last_fullsized":"2024-09-12T01:19:42.252694+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:33.683146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":635,"num_read_kb":540,"num_write":217,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:15.567287+0000","last_change":"2024-09-12T00:35:31.904599+0000","last_active":"2024-09-12T01:19:15.567287+0000","last_peered":"2024-09-12T01:19:15.567287+0000","last_clean":"2024-09-12T01:19:15.567287+0000","last_became_active":"2024-09-12T00:35:29.699432+0000","last_became_peered":"2024-09-12T00:35:29.699432+0000","last_unstale":"2024-09-12T01:19:15.567287+0000","last_undegraded":"2024-09-12T01:19:15.567287+0000","last_fullsized":"2024-09-12T01:19:15.567287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:03.035417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099979400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'343","reported_seq":985,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.827966+0000","last_change":"2024-09-12T00:35:43.929255+0000","last_active":"2024-09-12T01:21:57.827966+0000","last_peered":"2024-09-12T01:21:57.827966+0000","last_clean":"2024-09-12T01:21:57.827966+0000","last_became_active":"2024-09-12T00:35:43.928667+0000","last_became_peered":"2024-09-12T00:35:43.928667+0000","last_unstale":"2024-09-12T01:21:57.827966+0000","last_undegraded":"2024-09-12T01:21:57.827966+0000","last_fullsized":"2024-09-12T01:21:57.827966+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:17.228103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174664,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":503,"num_read_kb":16533,"num_write":1052,"num_write_kb":18962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:10.566295+0000","last_change":"2024-09-12T00:35:47.945027+0000","last_active":"2024-09-12T01:19:10.566295+0000","last_peered":"2024-09-12T01:19:10.566295+0000","last_clean":"2024-09-12T01:19:10.566295+0000","last_became_active":"2024-09-12T00:35:47.944385+0000","last_became_peered":"2024-09-12T00:35:47.944385+0000","last_unstale":"2024-09-12T01:19:10.566295+0000","last_undegraded":"2024-09-12T01:19:10.566295+0000","last_fullsized":"2024-09-12T01:19:10.566295+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:59.954589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'226","reported_seq":1321,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.532346+0000","last_change":"2024-09-12T00:35:50.026399+0000","last_active":"2024-09-12T01:21:25.532346+0000","last_peered":"2024-09-12T01:21:25.532346+0000","last_clean":"2024-09-12T01:21:25.532346+0000","last_became_active":"2024-09-12T00:35:50.025610+0000","last_became_peered":"2024-09-12T00:35:50.025610+0000","last_unstale":"2024-09-12T01:21:25.532346+0000","last_undegraded":"2024-09-12T01:21:25.532346+0000","last_fullsized":"2024-09-12T01:21:25.532346+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:54.581195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":183,"num_read_kb":174,"num_write":155,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:38.579276+0000","last_change":"2024-09-12T00:35:51.974368+0000","last_active":"2024-09-12T01:19:38.579276+0000","last_peered":"2024-09-12T01:19:38.579276+0000","last_clean":"2024-09-12T01:19:38.579276+0000","last_became_active":"2024-09-12T00:35:51.973593+0000","last_became_peered":"2024-09-12T00:35:51.973593+0000","last_unstale":"2024-09-12T01:19:38.579276+0000","last_undegraded":"2024-09-12T01:19:38.579276+0000","last_fullsized":"2024-09-12T01:19:38.579276+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:59.292452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'273","reported_seq":876,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.184767+0000","last_change":"2024-09-12T00:35:53.995709+0000","last_active":"2024-09-12T01:20:23.184767+0000","last_peered":"2024-09-12T01:20:23.184767+0000","last_clean":"2024-09-12T01:20:23.184767+0000","last_became_active":"2024-09-12T00:35:53.994828+0000","last_became_peered":"2024-09-12T00:35:53.994828+0000","last_unstale":"2024-09-12T01:20:23.184767+0000","last_undegraded":"2024-09-12T01:20:23.184767+0000","last_fullsized":"2024-09-12T01:20:23.184767+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:01.920282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":532,"num_read_kb":546,"num_write":608,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'101","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:33.581546+0000","last_change":"2024-09-12T00:35:45.933047+0000","last_active":"2024-09-12T01:19:33.581546+0000","last_peered":"2024-09-12T01:19:33.581546+0000","last_clean":"2024-09-12T01:19:33.581546+0000","last_became_active":"2024-09-12T00:35:45.932642+0000","last_became_peered":"2024-09-12T00:35:45.932642+0000","last_unstale":"2024-09-12T01:19:33.581546+0000","last_undegraded":"2024-09-12T01:19:33.581546+0000","last_fullsized":"2024-09-12T01:19:33.581546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:58.000694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":466,"num_read_kb":396,"num_write":153,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.566063+0000","last_change":"2024-09-12T00:35:31.692803+0000","last_active":"2024-09-12T01:19:18.566063+0000","last_peered":"2024-09-12T01:19:18.566063+0000","last_clean":"2024-09-12T01:19:18.566063+0000","last_became_active":"2024-09-12T00:35:29.664963+0000","last_became_peered":"2024-09-12T00:35:29.664963+0000","last_unstale":"2024-09-12T01:19:18.566063+0000","last_undegraded":"2024-09-12T01:19:18.566063+0000","last_fullsized":"2024-09-12T01:19:18.566063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:27.056845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020842569999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'289","reported_seq":959,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.860071+0000","last_change":"2024-09-12T00:35:43.931465+0000","last_active":"2024-09-12T01:21:57.860071+0000","last_peered":"2024-09-12T01:21:57.860071+0000","last_clean":"2024-09-12T01:21:57.860071+0000","last_became_active":"2024-09-12T00:35:43.930731+0000","last_became_peered":"2024-09-12T00:35:43.930731+0000","last_unstale":"2024-09-12T01:21:57.860071+0000","last_undegraded":"2024-09-12T01:21:57.860071+0000","last_fullsized":"2024-09-12T01:21:57.860071+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:34.455587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":688153,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":45060,"num_write":1094,"num_write_kb":33877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.580737+0000","last_change":"2024-09-12T00:35:47.939774+0000","last_active":"2024-09-12T01:19:43.580737+0000","last_peered":"2024-09-12T01:19:43.580737+0000","last_clean":"2024-09-12T01:19:43.580737+0000","last_became_active":"2024-09-12T00:35:47.939055+0000","last_became_peered":"2024-09-12T00:35:47.939055+0000","last_unstale":"2024-09-12T01:19:43.580737+0000","last_undegraded":"2024-09-12T01:19:43.580737+0000","last_fullsized":"2024-09-12T01:19:43.580737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:08.442651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'117","reported_seq":654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:23.406053+0000","last_change":"2024-09-12T00:35:49.952715+0000","last_active":"2024-09-12T01:21:23.406053+0000","last_peered":"2024-09-12T01:21:23.406053+0000","last_clean":"2024-09-12T01:21:23.406053+0000","last_became_active":"2024-09-12T00:35:49.948258+0000","last_became_peered":"2024-09-12T00:35:49.948258+0000","last_unstale":"2024-09-12T01:21:23.406053+0000","last_undegraded":"2024-09-12T01:21:23.406053+0000","last_fullsized":"2024-09-12T01:21:23.406053+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:13.173314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:12.558370+0000","last_change":"2024-09-12T00:35:51.975246+0000","last_active":"2024-09-12T01:19:12.558370+0000","last_peered":"2024-09-12T01:19:12.558370+0000","last_clean":"2024-09-12T01:19:12.558370+0000","last_became_active":"2024-09-12T00:35:51.974302+0000","last_became_peered":"2024-09-12T00:35:51.974302+0000","last_unstale":"2024-09-12T01:19:12.558370+0000","last_undegraded":"2024-09-12T01:19:12.558370+0000","last_fullsized":"2024-09-12T01:19:12.558370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:22.264781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'140","reported_seq":703,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:02.410395+0000","last_change":"2024-09-12T00:35:53.995956+0000","last_active":"2024-09-12T01:20:02.410395+0000","last_peered":"2024-09-12T01:20:02.410395+0000","last_clean":"2024-09-12T01:20:02.410395+0000","last_became_active":"2024-09-12T00:35:53.995254+0000","last_became_peered":"2024-09-12T00:35:53.995254+0000","last_unstale":"2024-09-12T01:20:02.410395+0000","last_undegraded":"2024-09-12T01:20:02.410395+0000","last_fullsized":"2024-09-12T01:20:02.410395+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:26.022607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1272,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":285,"num_read_kb":262,"num_write":355,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'53","reported_seq":591,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.121613+0000","last_change":"2024-09-12T00:35:45.936327+0000","last_active":"2024-09-12T01:19:37.121613+0000","last_peered":"2024-09-12T01:19:37.121613+0000","last_clean":"2024-09-12T01:19:37.121613+0000","last_became_active":"2024-09-12T00:35:45.936061+0000","last_became_peered":"2024-09-12T00:35:45.936061+0000","last_unstale":"2024-09-12T01:19:37.121613+0000","last_undegraded":"2024-09-12T01:19:37.121613+0000","last_fullsized":"2024-09-12T01:19:37.121613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:11.296362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":179,"num_write":83,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"265'349","reported_seq":1003,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.853709+0000","last_change":"2024-09-12T00:36:17.052149+0000","last_active":"2024-09-12T01:21:57.853709+0000","last_peered":"2024-09-12T01:21:57.853709+0000","last_clean":"2024-09-12T01:21:57.853709+0000","last_became_active":"2024-09-12T00:36:17.051542+0000","last_became_peered":"2024-09-12T00:36:17.051542+0000","last_unstale":"2024-09-12T01:21:57.853709+0000","last_undegraded":"2024-09-12T01:21:57.853709+0000","last_fullsized":"2024-09-12T01:21:57.853709+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:58.989806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730210,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":479,"num_read_kb":44411,"num_write":1031,"num_write_kb":33814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:03.236128+0000","last_change":"2024-09-12T01:22:03.236128+0000","last_active":"2024-09-12T01:22:03.236128+0000","last_peered":"2024-09-12T01:22:03.236128+0000","last_clean":"2024-09-12T01:22:03.236128+0000","last_became_active":"2024-09-12T00:35:29.700869+0000","last_became_peered":"2024-09-12T00:35:29.700869+0000","last_unstale":"2024-09-12T01:22:03.236128+0000","last_undegraded":"2024-09-12T01:22:03.236128+0000","last_fullsized":"2024-09-12T01:22:03.236128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:03.235936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:03.235936+0000","last_clean_scrub_stamp":"2024-09-12T01:22:03.235936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:19.598037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00099003299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"36'5","reported_seq":979,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.234521+0000","last_change":"2024-09-12T00:35:47.947133+0000","last_active":"2024-09-12T01:21:56.234521+0000","last_peered":"2024-09-12T01:21:56.234521+0000","last_clean":"2024-09-12T01:21:56.234521+0000","last_became_active":"2024-09-12T00:35:47.946690+0000","last_became_peered":"2024-09-12T00:35:47.946690+0000","last_unstale":"2024-09-12T01:21:56.234521+0000","last_undegraded":"2024-09-12T01:21:56.234521+0000","last_fullsized":"2024-09-12T01:21:56.234521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:37.935723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'570","reported_seq":1240,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.579334+0000","last_change":"2024-09-12T00:35:49.948760+0000","last_active":"2024-09-12T01:21:57.579334+0000","last_peered":"2024-09-12T01:21:57.579334+0000","last_clean":"2024-09-12T01:21:57.579334+0000","last_became_active":"2024-09-12T00:35:49.948095+0000","last_became_peered":"2024-09-12T00:35:49.948095+0000","last_unstale":"2024-09-12T01:21:57.579334+0000","last_undegraded":"2024-09-12T01:21:57.579334+0000","last_fullsized":"2024-09-12T01:21:57.579334+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":500,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93682,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1577,"num_read_kb":2692,"num_write":2050,"num_write_kb":1874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.556917+0000","last_change":"2024-09-12T00:35:51.968432+0000","last_active":"2024-09-12T01:19:37.556917+0000","last_peered":"2024-09-12T01:19:37.556917+0000","last_clean":"2024-09-12T01:19:37.556917+0000","last_became_active":"2024-09-12T00:35:51.967708+0000","last_became_peered":"2024-09-12T00:35:51.967708+0000","last_unstale":"2024-09-12T01:19:37.556917+0000","last_undegraded":"2024-09-12T01:19:37.556917+0000","last_fullsized":"2024-09-12T01:19:37.556917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:43.503668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'147","reported_seq":643,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:40.914651+0000","last_change":"2024-09-12T00:35:54.015204+0000","last_active":"2024-09-12T01:19:40.914651+0000","last_peered":"2024-09-12T01:19:40.914651+0000","last_clean":"2024-09-12T01:19:40.914651+0000","last_became_active":"2024-09-12T00:35:54.014321+0000","last_became_peered":"2024-09-12T00:35:54.014321+0000","last_unstale":"2024-09-12T01:19:40.914651+0000","last_undegraded":"2024-09-12T01:19:40.914651+0000","last_fullsized":"2024-09-12T01:19:40.914651+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:14.339505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":134,"num_write":336,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'165","reported_seq":787,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:33.578060+0000","last_change":"2024-09-12T00:35:45.936514+0000","last_active":"2024-09-12T01:19:33.578060+0000","last_peered":"2024-09-12T01:19:33.578060+0000","last_clean":"2024-09-12T01:19:33.578060+0000","last_became_active":"2024-09-12T00:35:45.936178+0000","last_became_peered":"2024-09-12T00:35:45.936178+0000","last_unstale":"2024-09-12T01:19:33.578060+0000","last_undegraded":"2024-09-12T01:19:33.578060+0000","last_fullsized":"2024-09-12T01:19:33.578060+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:06.218590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":595,"num_write":226,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'364","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.838928+0000","last_change":"2024-09-12T00:35:43.931012+0000","last_active":"2024-09-12T01:21:57.838928+0000","last_peered":"2024-09-12T01:21:57.838928+0000","last_clean":"2024-09-12T01:21:57.838928+0000","last_became_active":"2024-09-12T00:35:43.928834+0000","last_became_peered":"2024-09-12T00:35:43.928834+0000","last_unstale":"2024-09-12T01:21:57.838928+0000","last_undegraded":"2024-09-12T01:21:57.838928+0000","last_fullsized":"2024-09-12T01:21:57.838928+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:38.654576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262157,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":503,"num_read_kb":29317,"num_write":1237,"num_write_kb":48953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:22.795333+0000","last_change":"2024-09-12T00:35:31.861538+0000","last_active":"2024-09-12T01:19:22.795333+0000","last_peered":"2024-09-12T01:19:22.795333+0000","last_clean":"2024-09-12T01:19:22.795333+0000","last_became_active":"2024-09-12T00:35:29.697973+0000","last_became_peered":"2024-09-12T00:35:29.697973+0000","last_unstale":"2024-09-12T01:19:22.795333+0000","last_undegraded":"2024-09-12T01:19:22.795333+0000","last_fullsized":"2024-09-12T01:19:22.795333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:08.455168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083354399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.562424+0000","last_change":"2024-09-12T00:35:47.940734+0000","last_active":"2024-09-12T01:19:32.562424+0000","last_peered":"2024-09-12T01:19:32.562424+0000","last_clean":"2024-09-12T01:19:32.562424+0000","last_became_active":"2024-09-12T00:35:47.940014+0000","last_became_peered":"2024-09-12T00:35:47.940014+0000","last_unstale":"2024-09-12T01:19:32.562424+0000","last_undegraded":"2024-09-12T01:19:32.562424+0000","last_fullsized":"2024-09-12T01:19:32.562424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:23.603431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'186","reported_seq":750,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.995320+0000","last_change":"2024-09-12T00:35:50.029129+0000","last_active":"2024-09-12T01:20:22.995320+0000","last_peered":"2024-09-12T01:20:22.995320+0000","last_clean":"2024-09-12T01:20:22.995320+0000","last_became_active":"2024-09-12T00:35:50.028173+0000","last_became_peered":"2024-09-12T00:35:50.028173+0000","last_unstale":"2024-09-12T01:20:22.995320+0000","last_undegraded":"2024-09-12T01:20:22.995320+0000","last_fullsized":"2024-09-12T01:20:22.995320+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:11.842961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":223,"num_read_kb":207,"num_write":158,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'791","reported_seq":2678,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.492109+0000","last_change":"2024-09-12T00:35:51.977915+0000","last_active":"2024-09-12T01:21:56.492109+0000","last_peered":"2024-09-12T01:21:56.492109+0000","last_clean":"2024-09-12T01:21:56.492109+0000","last_became_active":"2024-09-12T00:35:51.977203+0000","last_became_peered":"2024-09-12T00:35:51.977203+0000","last_unstale":"2024-09-12T01:21:56.492109+0000","last_undegraded":"2024-09-12T01:21:56.492109+0000","last_fullsized":"2024-09-12T01:21:56.492109+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:06.229745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'110","reported_seq":608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:08.402637+0000","last_change":"2024-09-12T00:35:54.015222+0000","last_active":"2024-09-12T01:21:08.402637+0000","last_peered":"2024-09-12T01:21:08.402637+0000","last_clean":"2024-09-12T01:21:08.402637+0000","last_became_active":"2024-09-12T00:35:54.014699+0000","last_became_peered":"2024-09-12T00:35:54.014699+0000","last_unstale":"2024-09-12T01:21:08.402637+0000","last_undegraded":"2024-09-12T01:21:08.402637+0000","last_fullsized":"2024-09-12T01:21:08.402637+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:06.666673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1113,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":127,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'102","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:58.603736+0000","last_change":"2024-09-12T00:35:45.943991+0000","last_active":"2024-09-12T01:19:58.603736+0000","last_peered":"2024-09-12T01:19:58.603736+0000","last_clean":"2024-09-12T01:19:58.603736+0000","last_became_active":"2024-09-12T00:35:45.942032+0000","last_became_peered":"2024-09-12T00:35:45.942032+0000","last_unstale":"2024-09-12T01:19:58.603736+0000","last_undegraded":"2024-09-12T01:19:58.603736+0000","last_fullsized":"2024-09-12T01:19:58.603736+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":475,"num_read_kb":403,"num_write":145,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'318","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.845856+0000","last_change":"2024-09-12T00:35:43.954091+0000","last_active":"2024-09-12T01:21:57.845856+0000","last_peered":"2024-09-12T01:21:57.845856+0000","last_clean":"2024-09-12T01:21:57.845856+0000","last_became_active":"2024-09-12T00:35:43.953619+0000","last_became_peered":"2024-09-12T00:35:43.953619+0000","last_unstale":"2024-09-12T01:21:57.845856+0000","last_undegraded":"2024-09-12T01:21:57.845856+0000","last_fullsized":"2024-09-12T01:21:57.845856+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:57.329602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2238687,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":418,"num_read_kb":24307,"num_write":963,"num_write_kb":33018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":517,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:53.572551+0000","last_change":"2024-09-12T00:35:31.699143+0000","last_active":"2024-09-12T01:18:53.572551+0000","last_peered":"2024-09-12T01:18:53.572551+0000","last_clean":"2024-09-12T01:18:53.572551+0000","last_became_active":"2024-09-12T00:35:29.671727+0000","last_became_peered":"2024-09-12T00:35:29.671727+0000","last_unstale":"2024-09-12T01:18:53.572551+0000","last_undegraded":"2024-09-12T01:18:53.572551+0000","last_fullsized":"2024-09-12T01:18:53.572551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:24.616311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010553139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.555547+0000","last_change":"2024-09-12T00:35:47.937179+0000","last_active":"2024-09-12T01:19:32.555547+0000","last_peered":"2024-09-12T01:19:32.555547+0000","last_clean":"2024-09-12T01:19:32.555547+0000","last_became_active":"2024-09-12T00:35:47.936452+0000","last_became_peered":"2024-09-12T00:35:47.936452+0000","last_unstale":"2024-09-12T01:19:32.555547+0000","last_undegraded":"2024-09-12T01:19:32.555547+0000","last_fullsized":"2024-09-12T01:19:32.555547+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:33.795481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'113","reported_seq":658,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.557003+0000","last_change":"2024-09-12T00:35:49.941635+0000","last_active":"2024-09-12T01:19:37.557003+0000","last_peered":"2024-09-12T01:19:37.557003+0000","last_clean":"2024-09-12T01:19:37.557003+0000","last_became_active":"2024-09-12T00:35:49.940788+0000","last_became_peered":"2024-09-12T00:35:49.940788+0000","last_unstale":"2024-09-12T01:19:37.557003+0000","last_undegraded":"2024-09-12T01:19:37.557003+0000","last_fullsized":"2024-09-12T01:19:37.557003+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:50.095723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'789","reported_seq":2416,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.316325+0000","last_change":"2024-09-12T00:35:51.980717+0000","last_active":"2024-09-12T01:21:57.316325+0000","last_peered":"2024-09-12T01:21:57.316325+0000","last_clean":"2024-09-12T01:21:57.316325+0000","last_became_active":"2024-09-12T00:35:51.979997+0000","last_became_peered":"2024-09-12T00:35:51.979997+0000","last_unstale":"2024-09-12T01:21:57.316325+0000","last_undegraded":"2024-09-12T01:21:57.316325+0000","last_fullsized":"2024-09-12T01:21:57.316325+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:15.785752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'278","reported_seq":795,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:36.375145+0000","last_change":"2024-09-12T00:35:53.993708+0000","last_active":"2024-09-12T01:19:36.375145+0000","last_peered":"2024-09-12T01:19:36.375145+0000","last_clean":"2024-09-12T01:19:36.375145+0000","last_became_active":"2024-09-12T00:35:53.992431+0000","last_became_peered":"2024-09-12T00:35:53.992431+0000","last_unstale":"2024-09-12T01:19:36.375145+0000","last_undegraded":"2024-09-12T01:19:36.375145+0000","last_fullsized":"2024-09-12T01:19:36.375145+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:35.605076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":344,"num_read_kb":342,"num_write":602,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'372","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.555503+0000","last_change":"2024-09-12T00:35:45.929519+0000","last_active":"2024-09-12T01:19:32.555503+0000","last_peered":"2024-09-12T01:19:32.555503+0000","last_clean":"2024-09-12T01:19:32.555503+0000","last_became_active":"2024-09-12T00:35:45.928789+0000","last_became_peered":"2024-09-12T00:35:45.928789+0000","last_unstale":"2024-09-12T01:19:32.555503+0000","last_undegraded":"2024-09-12T01:19:32.555503+0000","last_fullsized":"2024-09-12T01:19:32.555503+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:09.582521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1634,"num_read_kb":1297,"num_write":639,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'360","reported_seq":1037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.826735+0000","last_change":"2024-09-12T00:35:43.933310+0000","last_active":"2024-09-12T01:21:57.826735+0000","last_peered":"2024-09-12T01:21:57.826735+0000","last_clean":"2024-09-12T01:21:57.826735+0000","last_became_active":"2024-09-12T00:35:43.932994+0000","last_became_peered":"2024-09-12T00:35:43.932994+0000","last_unstale":"2024-09-12T01:21:57.826735+0000","last_undegraded":"2024-09-12T01:21:57.826735+0000","last_fullsized":"2024-09-12T01:21:57.826735+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:30.435523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":624,"num_read_kb":1635,"num_write":1170,"num_write_kb":36329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:52.554359+0000","last_change":"2024-09-12T00:35:31.686791+0000","last_active":"2024-09-12T01:18:52.554359+0000","last_peered":"2024-09-12T01:18:52.554359+0000","last_clean":"2024-09-12T01:18:52.554359+0000","last_became_active":"2024-09-12T00:35:29.670571+0000","last_became_peered":"2024-09-12T00:35:29.670571+0000","last_unstale":"2024-09-12T01:18:52.554359+0000","last_undegraded":"2024-09-12T01:18:52.554359+0000","last_fullsized":"2024-09-12T01:18:52.554359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:28.645695+0000","last_clean_scrub_stamp":"2024-09-12T00:35:28.645695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:53.106651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012596770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:58.603799+0000","last_change":"2024-09-12T00:35:47.934122+0000","last_active":"2024-09-12T01:19:58.603799+0000","last_peered":"2024-09-12T01:19:58.603799+0000","last_clean":"2024-09-12T01:19:58.603799+0000","last_became_active":"2024-09-12T00:35:47.933798+0000","last_became_peered":"2024-09-12T00:35:47.933798+0000","last_unstale":"2024-09-12T01:19:58.603799+0000","last_undegraded":"2024-09-12T01:19:58.603799+0000","last_fullsized":"2024-09-12T01:19:58.603799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'725","reported_seq":1449,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.696858+0000","last_change":"2024-09-12T00:35:50.029172+0000","last_active":"2024-09-12T01:21:57.696858+0000","last_peered":"2024-09-12T01:21:57.696858+0000","last_clean":"2024-09-12T01:21:57.696858+0000","last_became_active":"2024-09-12T00:35:50.028341+0000","last_became_peered":"2024-09-12T00:35:50.028341+0000","last_unstale":"2024-09-12T01:21:57.696858+0000","last_undegraded":"2024-09-12T01:21:57.696858+0000","last_fullsized":"2024-09-12T01:21:57.696858+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:00.896912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139080,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1312,"num_read_kb":3096,"num_write":1068,"num_write_kb":883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:38.599116+0000","last_change":"2024-09-12T00:35:51.975754+0000","last_active":"2024-09-12T01:19:38.599116+0000","last_peered":"2024-09-12T01:19:38.599116+0000","last_clean":"2024-09-12T01:19:38.599116+0000","last_became_active":"2024-09-12T00:35:51.974473+0000","last_became_peered":"2024-09-12T00:35:51.974473+0000","last_unstale":"2024-09-12T01:19:38.599116+0000","last_undegraded":"2024-09-12T01:19:38.599116+0000","last_fullsized":"2024-09-12T01:19:38.599116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:18.151442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'108","reported_seq":610,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:09.188058+0000","last_change":"2024-09-12T00:35:53.996281+0000","last_active":"2024-09-12T01:19:09.188058+0000","last_peered":"2024-09-12T01:19:09.188058+0000","last_clean":"2024-09-12T01:19:09.188058+0000","last_became_active":"2024-09-12T00:35:53.995431+0000","last_became_peered":"2024-09-12T00:35:53.995431+0000","last_unstale":"2024-09-12T01:19:09.188058+0000","last_undegraded":"2024-09-12T01:19:09.188058+0000","last_fullsized":"2024-09-12T01:19:09.188058+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:23.854939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":133,"num_write":267,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'116","reported_seq":666,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:24.501863+0000","last_change":"2024-09-12T00:35:54.003023+0000","last_active":"2024-09-12T01:21:24.501863+0000","last_peered":"2024-09-12T01:21:24.501863+0000","last_clean":"2024-09-12T01:21:24.501863+0000","last_became_active":"2024-09-12T00:35:54.002052+0000","last_became_peered":"2024-09-12T00:35:54.002052+0000","last_unstale":"2024-09-12T01:21:24.501863+0000","last_undegraded":"2024-09-12T01:21:24.501863+0000","last_fullsized":"2024-09-12T01:21:24.501863+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:18.230366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":193,"num_write":267,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'96","reported_seq":682,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.975864+0000","last_change":"2024-09-12T00:35:45.954536+0000","last_active":"2024-09-12T01:18:18.975864+0000","last_peered":"2024-09-12T01:18:18.975864+0000","last_clean":"2024-09-12T01:18:18.975864+0000","last_became_active":"2024-09-12T00:35:45.954079+0000","last_became_peered":"2024-09-12T00:35:45.954079+0000","last_unstale":"2024-09-12T01:18:18.975864+0000","last_undegraded":"2024-09-12T01:18:18.975864+0000","last_fullsized":"2024-09-12T01:18:18.975864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:37.716853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":455,"num_read_kb":391,"num_write":154,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'435","reported_seq":1133,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.833585+0000","last_change":"2024-09-12T00:35:43.948592+0000","last_active":"2024-09-12T01:21:57.833585+0000","last_peered":"2024-09-12T01:21:57.833585+0000","last_clean":"2024-09-12T01:21:57.833585+0000","last_became_active":"2024-09-12T00:35:43.947940+0000","last_became_peered":"2024-09-12T00:35:43.947940+0000","last_unstale":"2024-09-12T01:21:57.833585+0000","last_undegraded":"2024-09-12T01:21:57.833585+0000","last_fullsized":"2024-09-12T01:21:57.833585+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:06.011716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":799,"num_read_kb":4159,"num_write":1267,"num_write_kb":17308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:48.555127+0000","last_change":"2024-09-12T00:35:47.930161+0000","last_active":"2024-09-12T01:17:48.555127+0000","last_peered":"2024-09-12T01:17:48.555127+0000","last_clean":"2024-09-12T01:17:48.555127+0000","last_became_active":"2024-09-12T00:35:47.929844+0000","last_became_peered":"2024-09-12T00:35:47.929844+0000","last_unstale":"2024-09-12T01:17:48.555127+0000","last_undegraded":"2024-09-12T01:17:48.555127+0000","last_fullsized":"2024-09-12T01:17:48.555127+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:35.960740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'287","reported_seq":863,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.686059+0000","last_change":"2024-09-12T00:35:49.947886+0000","last_active":"2024-09-12T01:21:56.686059+0000","last_peered":"2024-09-12T01:21:56.686059+0000","last_clean":"2024-09-12T01:21:56.686059+0000","last_became_active":"2024-09-12T00:35:49.947136+0000","last_became_peered":"2024-09-12T00:35:49.947136+0000","last_unstale":"2024-09-12T01:21:56.686059+0000","last_undegraded":"2024-09-12T01:21:56.686059+0000","last_fullsized":"2024-09-12T01:21:56.686059+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:30.278867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43778,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":475,"num_read_kb":1081,"num_write":388,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:53.573483+0000","last_change":"2024-09-12T00:35:51.980791+0000","last_active":"2024-09-12T01:17:53.573483+0000","last_peered":"2024-09-12T01:17:53.573483+0000","last_clean":"2024-09-12T01:17:53.573483+0000","last_became_active":"2024-09-12T00:35:51.980092+0000","last_became_peered":"2024-09-12T00:35:51.980092+0000","last_unstale":"2024-09-12T01:17:53.573483+0000","last_undegraded":"2024-09-12T01:17:53.573483+0000","last_fullsized":"2024-09-12T01:17:53.573483+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:52.492457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'134","reported_seq":633,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:20.655512+0000","last_change":"2024-09-12T00:35:53.993259+0000","last_active":"2024-09-12T01:20:20.655512+0000","last_peered":"2024-09-12T01:20:20.655512+0000","last_clean":"2024-09-12T01:20:20.655512+0000","last_became_active":"2024-09-12T00:35:53.992579+0000","last_became_peered":"2024-09-12T00:35:53.992579+0000","last_unstale":"2024-09-12T01:20:20.655512+0000","last_undegraded":"2024-09-12T01:20:20.655512+0000","last_fullsized":"2024-09-12T01:20:20.655512+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:44.006963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":139,"num_write":341,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'161","reported_seq":745,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:03.701304+0000","last_change":"2024-09-12T00:35:45.958044+0000","last_active":"2024-09-12T01:20:03.701304+0000","last_peered":"2024-09-12T01:20:03.701304+0000","last_clean":"2024-09-12T01:20:03.701304+0000","last_became_active":"2024-09-12T00:35:45.957614+0000","last_became_peered":"2024-09-12T00:35:45.957614+0000","last_unstale":"2024-09-12T01:20:03.701304+0000","last_undegraded":"2024-09-12T01:20:03.701304+0000","last_fullsized":"2024-09-12T01:20:03.701304+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:29.459571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":661,"num_read_kb":539,"num_write":259,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'359","reported_seq":956,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.830383+0000","last_change":"2024-09-12T00:36:17.270183+0000","last_active":"2024-09-12T01:21:57.830383+0000","last_peered":"2024-09-12T01:21:57.830383+0000","last_clean":"2024-09-12T01:21:57.830383+0000","last_became_active":"2024-09-12T00:36:17.269377+0000","last_became_peered":"2024-09-12T00:36:17.269377+0000","last_unstale":"2024-09-12T01:21:57.830383+0000","last_undegraded":"2024-09-12T01:21:57.830383+0000","last_fullsized":"2024-09-12T01:21:57.830383+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:25.952652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":513,"num_read_kb":25436,"num_write":1264,"num_write_kb":33386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:48.572327+0000","last_change":"2024-09-12T00:35:47.941929+0000","last_active":"2024-09-12T01:17:48.572327+0000","last_peered":"2024-09-12T01:17:48.572327+0000","last_clean":"2024-09-12T01:17:48.572327+0000","last_became_active":"2024-09-12T00:35:47.941493+0000","last_became_peered":"2024-09-12T00:35:47.941493+0000","last_unstale":"2024-09-12T01:17:48.572327+0000","last_undegraded":"2024-09-12T01:17:48.572327+0000","last_fullsized":"2024-09-12T01:17:48.572327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:06.034904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'46","reported_seq":542,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:09.885099+0000","last_change":"2024-09-12T00:35:49.950088+0000","last_active":"2024-09-12T01:19:09.885099+0000","last_peered":"2024-09-12T01:19:09.885099+0000","last_clean":"2024-09-12T01:19:09.885099+0000","last_became_active":"2024-09-12T00:35:49.949331+0000","last_became_peered":"2024-09-12T00:35:49.949331+0000","last_unstale":"2024-09-12T01:19:09.885099+0000","last_undegraded":"2024-09-12T01:19:09.885099+0000","last_fullsized":"2024-09-12T01:19:09.885099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:00.112784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:52.773954+0000","last_change":"2024-09-12T00:35:51.977921+0000","last_active":"2024-09-12T01:17:52.773954+0000","last_peered":"2024-09-12T01:17:52.773954+0000","last_clean":"2024-09-12T01:17:52.773954+0000","last_became_active":"2024-09-12T00:35:51.977211+0000","last_became_peered":"2024-09-12T00:35:51.977211+0000","last_unstale":"2024-09-12T01:17:52.773954+0000","last_undegraded":"2024-09-12T01:17:52.773954+0000","last_fullsized":"2024-09-12T01:17:52.773954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:37.744652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'214","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.264295+0000","last_change":"2024-09-12T00:35:53.992509+0000","last_active":"2024-09-12T01:20:22.264295+0000","last_peered":"2024-09-12T01:20:22.264295+0000","last_clean":"2024-09-12T01:20:22.264295+0000","last_became_active":"2024-09-12T00:35:53.985696+0000","last_became_peered":"2024-09-12T00:35:53.985696+0000","last_unstale":"2024-09-12T01:20:22.264295+0000","last_undegraded":"2024-09-12T01:20:22.264295+0000","last_fullsized":"2024-09-12T01:20:22.264295+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:55.326440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":288,"num_read_kb":283,"num_write":478,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'116","reported_seq":720,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:36.946980+0000","last_change":"2024-09-12T00:35:45.944333+0000","last_active":"2024-09-12T01:18:36.946980+0000","last_peered":"2024-09-12T01:18:36.946980+0000","last_clean":"2024-09-12T01:18:36.946980+0000","last_became_active":"2024-09-12T00:35:45.942161+0000","last_became_peered":"2024-09-12T00:35:45.942161+0000","last_unstale":"2024-09-12T01:18:36.946980+0000","last_undegraded":"2024-09-12T01:18:36.946980+0000","last_fullsized":"2024-09-12T01:18:36.946980+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:45.930313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":566,"num_read_kb":479,"num_write":187,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'289","reported_seq":889,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.822707+0000","last_change":"2024-09-12T00:35:43.951301+0000","last_active":"2024-09-12T01:21:57.822707+0000","last_peered":"2024-09-12T01:21:57.822707+0000","last_clean":"2024-09-12T01:21:57.822707+0000","last_became_active":"2024-09-12T00:35:43.950660+0000","last_became_peered":"2024-09-12T00:35:43.950660+0000","last_unstale":"2024-09-12T01:21:57.822707+0000","last_undegraded":"2024-09-12T01:21:57.822707+0000","last_fullsized":"2024-09-12T01:21:57.822707+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:51.119280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110814,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":386,"num_read_kb":2177,"num_write":879,"num_write_kb":8684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:47.772763+0000","last_change":"2024-09-12T00:35:47.946510+0000","last_active":"2024-09-12T01:17:47.772763+0000","last_peered":"2024-09-12T01:17:47.772763+0000","last_clean":"2024-09-12T01:17:47.772763+0000","last_became_active":"2024-09-12T00:35:47.945819+0000","last_became_peered":"2024-09-12T00:35:47.945819+0000","last_unstale":"2024-09-12T01:17:47.772763+0000","last_undegraded":"2024-09-12T01:17:47.772763+0000","last_fullsized":"2024-09-12T01:17:47.772763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:13.092089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'348","reported_seq":934,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.503752+0000","last_change":"2024-09-12T00:35:49.955755+0000","last_active":"2024-09-12T01:21:57.503752+0000","last_peered":"2024-09-12T01:21:57.503752+0000","last_clean":"2024-09-12T01:21:57.503752+0000","last_became_active":"2024-09-12T00:35:49.954646+0000","last_became_peered":"2024-09-12T00:35:49.954646+0000","last_unstale":"2024-09-12T01:21:57.503752+0000","last_undegraded":"2024-09-12T01:21:57.503752+0000","last_fullsized":"2024-09-12T01:21:57.503752+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:59.408731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66883,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":574,"num_read_kb":1344,"num_write":472,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:52.540778+0000","last_change":"2024-09-12T00:35:51.974798+0000","last_active":"2024-09-12T01:17:52.540778+0000","last_peered":"2024-09-12T01:17:52.540778+0000","last_clean":"2024-09-12T01:17:52.540778+0000","last_became_active":"2024-09-12T00:35:51.973993+0000","last_became_peered":"2024-09-12T00:35:51.973993+0000","last_unstale":"2024-09-12T01:17:52.540778+0000","last_undegraded":"2024-09-12T01:17:52.540778+0000","last_fullsized":"2024-09-12T01:17:52.540778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:02.005519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'103","reported_seq":609,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:56.474802+0000","last_change":"2024-09-12T00:35:54.001932+0000","last_active":"2024-09-12T01:19:56.474802+0000","last_peered":"2024-09-12T01:19:56.474802+0000","last_clean":"2024-09-12T01:19:56.474802+0000","last_became_active":"2024-09-12T00:35:54.001337+0000","last_became_peered":"2024-09-12T00:35:54.001337+0000","last_unstale":"2024-09-12T01:19:56.474802+0000","last_undegraded":"2024-09-12T01:19:56.474802+0000","last_fullsized":"2024-09-12T01:19:56.474802+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:46.072438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":126,"num_write":245,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'4114","reported_seq":4735,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:05.320945+0000","last_change":"2024-09-12T00:35:45.940670+0000","last_active":"2024-09-12T01:20:05.320945+0000","last_peered":"2024-09-12T01:20:05.320945+0000","last_clean":"2024-09-12T01:20:05.320945+0000","last_became_active":"2024-09-12T00:35:45.938175+0000","last_became_peered":"2024-09-12T00:35:45.938175+0000","last_unstale":"2024-09-12T01:20:05.320945+0000","last_undegraded":"2024-09-12T01:20:05.320945+0000","last_fullsized":"2024-09-12T01:20:05.320945+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:06.702726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16557,"num_read_kb":13901,"num_write":6164,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'305","reported_seq":908,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.855189+0000","last_change":"2024-09-12T00:35:43.935984+0000","last_active":"2024-09-12T01:21:57.855189+0000","last_peered":"2024-09-12T01:21:57.855189+0000","last_clean":"2024-09-12T01:21:57.855189+0000","last_became_active":"2024-09-12T00:35:43.935194+0000","last_became_peered":"2024-09-12T00:35:43.935194+0000","last_unstale":"2024-09-12T01:21:57.855189+0000","last_undegraded":"2024-09-12T01:21:57.855189+0000","last_fullsized":"2024-09-12T01:21:57.855189+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:19.822537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992287,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":416,"num_read_kb":10375,"num_write":976,"num_write_kb":15779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:47.539641+0000","last_change":"2024-09-12T00:35:47.945331+0000","last_active":"2024-09-12T01:17:47.539641+0000","last_peered":"2024-09-12T01:17:47.539641+0000","last_clean":"2024-09-12T01:17:47.539641+0000","last_became_active":"2024-09-12T00:35:47.944477+0000","last_became_peered":"2024-09-12T00:35:47.944477+0000","last_unstale":"2024-09-12T01:17:47.539641+0000","last_undegraded":"2024-09-12T01:17:47.539641+0000","last_fullsized":"2024-09-12T01:17:47.539641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:59.438695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'274","reported_seq":841,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.386915+0000","last_change":"2024-09-12T00:35:49.942723+0000","last_active":"2024-09-12T01:21:57.386915+0000","last_peered":"2024-09-12T01:21:57.386915+0000","last_clean":"2024-09-12T01:21:57.386915+0000","last_became_active":"2024-09-12T00:35:49.941948+0000","last_became_peered":"2024-09-12T00:35:49.941948+0000","last_unstale":"2024-09-12T01:21:57.386915+0000","last_undegraded":"2024-09-12T01:21:57.386915+0000","last_fullsized":"2024-09-12T01:21:57.386915+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:32.893865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45730,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":1073,"num_write":372,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":482,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:53.553514+0000","last_change":"2024-09-12T00:35:51.975893+0000","last_active":"2024-09-12T01:17:53.553514+0000","last_peered":"2024-09-12T01:17:53.553514+0000","last_clean":"2024-09-12T01:17:53.553514+0000","last_became_active":"2024-09-12T00:35:51.975124+0000","last_became_peered":"2024-09-12T00:35:51.975124+0000","last_unstale":"2024-09-12T01:17:53.553514+0000","last_undegraded":"2024-09-12T01:17:53.553514+0000","last_fullsized":"2024-09-12T01:17:53.553514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:49.874523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'251","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:55.418732+0000","last_change":"2024-09-12T00:35:45.942083+0000","last_active":"2024-09-12T01:19:55.418732+0000","last_peered":"2024-09-12T01:19:55.418732+0000","last_clean":"2024-09-12T01:19:55.418732+0000","last_became_active":"2024-09-12T00:35:45.941357+0000","last_became_peered":"2024-09-12T00:35:45.941357+0000","last_unstale":"2024-09-12T01:19:55.418732+0000","last_undegraded":"2024-09-12T01:19:55.418732+0000","last_fullsized":"2024-09-12T01:19:55.418732+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:58.892422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1115,"num_read_kb":918,"num_write":405,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'296","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.822255+0000","last_change":"2024-09-12T00:35:43.933290+0000","last_active":"2024-09-12T01:21:57.822255+0000","last_peered":"2024-09-12T01:21:57.822255+0000","last_clean":"2024-09-12T01:21:57.822255+0000","last_became_active":"2024-09-12T00:35:43.933037+0000","last_became_peered":"2024-09-12T00:35:43.933037+0000","last_unstale":"2024-09-12T01:21:57.822255+0000","last_undegraded":"2024-09-12T01:21:57.822255+0000","last_fullsized":"2024-09-12T01:21:57.822255+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:43.925660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730132,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":468,"num_read_kb":7309,"num_write":980,"num_write_kb":23054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"36'3","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.482835+0000","last_change":"2024-09-12T00:35:47.942588+0000","last_active":"2024-09-12T01:21:56.482835+0000","last_peered":"2024-09-12T01:21:56.482835+0000","last_clean":"2024-09-12T01:21:56.482835+0000","last_became_active":"2024-09-12T00:35:47.941749+0000","last_became_peered":"2024-09-12T00:35:47.941749+0000","last_unstale":"2024-09-12T01:21:56.482835+0000","last_undegraded":"2024-09-12T01:21:56.482835+0000","last_fullsized":"2024-09-12T01:21:56.482835+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:24.632274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'506","reported_seq":1137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.349319+0000","last_change":"2024-09-12T00:35:49.948724+0000","last_active":"2024-09-12T01:21:57.349319+0000","last_peered":"2024-09-12T01:21:57.349319+0000","last_clean":"2024-09-12T01:21:57.349319+0000","last_became_active":"2024-09-12T00:35:49.947963+0000","last_became_peered":"2024-09-12T00:35:49.947963+0000","last_unstale":"2024-09-12T01:21:57.349319+0000","last_undegraded":"2024-09-12T01:21:57.349319+0000","last_fullsized":"2024-09-12T01:21:57.349319+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:23.048505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95771,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":915,"num_read_kb":2195,"num_write":792,"num_write_kb":711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.553625+0000","last_change":"2024-09-12T00:35:51.968910+0000","last_active":"2024-09-12T01:18:23.553625+0000","last_peered":"2024-09-12T01:18:23.553625+0000","last_clean":"2024-09-12T01:18:23.553625+0000","last_became_active":"2024-09-12T00:35:51.968209+0000","last_became_peered":"2024-09-12T00:35:51.968209+0000","last_unstale":"2024-09-12T01:18:23.553625+0000","last_undegraded":"2024-09-12T01:18:23.553625+0000","last_fullsized":"2024-09-12T01:18:23.553625+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:40.274641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'158","reported_seq":653,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.097347+0000","last_change":"2024-09-12T00:35:54.013532+0000","last_active":"2024-09-12T01:20:22.097347+0000","last_peered":"2024-09-12T01:20:22.097347+0000","last_clean":"2024-09-12T01:20:22.097347+0000","last_became_active":"2024-09-12T00:35:54.012958+0000","last_became_peered":"2024-09-12T00:35:54.012958+0000","last_unstale":"2024-09-12T01:20:22.097347+0000","last_undegraded":"2024-09-12T01:20:22.097347+0000","last_fullsized":"2024-09-12T01:20:22.097347+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:34.515746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1092,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":166,"num_read_kb":178,"num_write":351,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'60","reported_seq":614,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:58.584807+0000","last_change":"2024-09-12T00:35:45.946291+0000","last_active":"2024-09-12T01:19:58.584807+0000","last_peered":"2024-09-12T01:19:58.584807+0000","last_clean":"2024-09-12T01:19:58.584807+0000","last_became_active":"2024-09-12T00:35:45.945952+0000","last_became_peered":"2024-09-12T00:35:45.945952+0000","last_unstale":"2024-09-12T01:19:58.584807+0000","last_undegraded":"2024-09-12T01:19:58.584807+0000","last_fullsized":"2024-09-12T01:19:58.584807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:19.912313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":234,"num_write":86,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'358","reported_seq":1014,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.835535+0000","last_change":"2024-09-12T00:35:43.930088+0000","last_active":"2024-09-12T01:21:57.835535+0000","last_peered":"2024-09-12T01:21:57.835535+0000","last_clean":"2024-09-12T01:21:57.835535+0000","last_became_active":"2024-09-12T00:35:43.928779+0000","last_became_peered":"2024-09-12T00:35:43.928779+0000","last_unstale":"2024-09-12T01:21:57.835535+0000","last_undegraded":"2024-09-12T01:21:57.835535+0000","last_fullsized":"2024-09-12T01:21:57.835535+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:27.466245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":507,"num_read_kb":67515,"num_write":1156,"num_write_kb":41697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.562535+0000","last_change":"2024-09-12T00:35:47.944821+0000","last_active":"2024-09-12T01:19:32.562535+0000","last_peered":"2024-09-12T01:19:32.562535+0000","last_clean":"2024-09-12T01:19:32.562535+0000","last_became_active":"2024-09-12T00:35:47.944056+0000","last_became_peered":"2024-09-12T00:35:47.944056+0000","last_unstale":"2024-09-12T01:19:32.562535+0000","last_undegraded":"2024-09-12T01:19:32.562535+0000","last_fullsized":"2024-09-12T01:19:32.562535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:34.718996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'270","reported_seq":850,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.421484+0000","last_change":"2024-09-12T00:35:49.946966+0000","last_active":"2024-09-12T01:21:57.421484+0000","last_peered":"2024-09-12T01:21:57.421484+0000","last_clean":"2024-09-12T01:21:57.421484+0000","last_became_active":"2024-09-12T00:35:49.946226+0000","last_became_peered":"2024-09-12T00:35:49.946226+0000","last_unstale":"2024-09-12T01:21:57.421484+0000","last_undegraded":"2024-09-12T01:21:57.421484+0000","last_fullsized":"2024-09-12T01:21:57.421484+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:45.810230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48166,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":461,"num_read_kb":978,"num_write":376,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":483,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.562310+0000","last_change":"2024-09-12T00:35:51.970897+0000","last_active":"2024-09-12T01:18:23.562310+0000","last_peered":"2024-09-12T01:18:23.562310+0000","last_clean":"2024-09-12T01:18:23.562310+0000","last_became_active":"2024-09-12T00:35:51.963735+0000","last_became_peered":"2024-09-12T00:35:51.963735+0000","last_unstale":"2024-09-12T01:18:23.562310+0000","last_undegraded":"2024-09-12T01:18:23.562310+0000","last_fullsized":"2024-09-12T01:18:23.562310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:20.013004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'196","reported_seq":702,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.113351+0000","last_change":"2024-09-12T00:35:53.991284+0000","last_active":"2024-09-12T01:20:22.113351+0000","last_peered":"2024-09-12T01:20:22.113351+0000","last_clean":"2024-09-12T01:20:22.113351+0000","last_became_active":"2024-09-12T00:35:53.990488+0000","last_became_peered":"2024-09-12T00:35:53.990488+0000","last_unstale":"2024-09-12T01:20:22.113351+0000","last_undegraded":"2024-09-12T01:20:22.113351+0000","last_fullsized":"2024-09-12T01:20:22.113351+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:57.849221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1821,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":235,"num_read_kb":229,"num_write":573,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'191","reported_seq":788,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:06.954169+0000","last_change":"2024-09-12T00:35:45.945163+0000","last_active":"2024-09-12T01:20:06.954169+0000","last_peered":"2024-09-12T01:20:06.954169+0000","last_clean":"2024-09-12T01:20:06.954169+0000","last_became_active":"2024-09-12T00:35:45.940529+0000","last_became_peered":"2024-09-12T00:35:45.940529+0000","last_unstale":"2024-09-12T01:20:06.954169+0000","last_undegraded":"2024-09-12T01:20:06.954169+0000","last_fullsized":"2024-09-12T01:20:06.954169+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:51.722964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":840,"num_read_kb":692,"num_write":286,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'343","reported_seq":1097,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.850755+0000","last_change":"2024-09-12T00:35:43.928101+0000","last_active":"2024-09-12T01:21:57.850755+0000","last_peered":"2024-09-12T01:21:57.850755+0000","last_clean":"2024-09-12T01:21:57.850755+0000","last_became_active":"2024-09-12T00:35:43.927426+0000","last_became_peered":"2024-09-12T00:35:43.927426+0000","last_unstale":"2024-09-12T01:21:57.850755+0000","last_undegraded":"2024-09-12T01:21:57.850755+0000","last_fullsized":"2024-09-12T01:21:57.850755+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:04.964381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":824,"num_read_kb":46781,"num_write":1113,"num_write_kb":16393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.739497+0000","last_change":"2024-09-12T00:35:47.934105+0000","last_active":"2024-09-12T01:18:17.739497+0000","last_peered":"2024-09-12T01:18:17.739497+0000","last_clean":"2024-09-12T01:18:17.739497+0000","last_became_active":"2024-09-12T00:35:47.933189+0000","last_became_peered":"2024-09-12T00:35:47.933189+0000","last_unstale":"2024-09-12T01:18:17.739497+0000","last_undegraded":"2024-09-12T01:18:17.739497+0000","last_fullsized":"2024-09-12T01:18:17.739497+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:01.418064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'284","reported_seq":863,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.862874+0000","last_change":"2024-09-12T00:35:50.030204+0000","last_active":"2024-09-12T01:21:56.862874+0000","last_peered":"2024-09-12T01:21:56.862874+0000","last_clean":"2024-09-12T01:21:56.862874+0000","last_became_active":"2024-09-12T00:35:50.029579+0000","last_became_peered":"2024-09-12T00:35:50.029579+0000","last_unstale":"2024-09-12T01:21:56.862874+0000","last_undegraded":"2024-09-12T01:21:56.862874+0000","last_fullsized":"2024-09-12T01:21:56.862874+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:54.577958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47233,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":1083,"num_write":390,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:58.587193+0000","last_change":"2024-09-12T00:35:51.972390+0000","last_active":"2024-09-12T01:19:58.587193+0000","last_peered":"2024-09-12T01:19:58.587193+0000","last_clean":"2024-09-12T01:19:58.587193+0000","last_became_active":"2024-09-12T00:35:51.971682+0000","last_became_peered":"2024-09-12T00:35:51.971682+0000","last_unstale":"2024-09-12T01:19:58.587193+0000","last_undegraded":"2024-09-12T01:19:58.587193+0000","last_fullsized":"2024-09-12T01:19:58.587193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:54.514575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'102","reported_seq":593,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.357123+0000","last_change":"2024-09-12T00:35:53.996274+0000","last_active":"2024-09-12T01:21:25.357123+0000","last_peered":"2024-09-12T01:21:25.357123+0000","last_clean":"2024-09-12T01:21:25.357123+0000","last_became_active":"2024-09-12T00:35:53.995464+0000","last_became_peered":"2024-09-12T00:35:53.995464+0000","last_unstale":"2024-09-12T01:21:25.357123+0000","last_undegraded":"2024-09-12T01:21:25.357123+0000","last_fullsized":"2024-09-12T01:21:25.357123+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:47.747130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":101,"num_write":247,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'297","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:54.778656+0000","last_change":"2024-09-12T00:35:45.947620+0000","last_active":"2024-09-12T01:19:54.778656+0000","last_peered":"2024-09-12T01:19:54.778656+0000","last_clean":"2024-09-12T01:19:54.778656+0000","last_became_active":"2024-09-12T00:35:45.947244+0000","last_became_peered":"2024-09-12T00:35:45.947244+0000","last_unstale":"2024-09-12T01:19:54.778656+0000","last_undegraded":"2024-09-12T01:19:54.778656+0000","last_fullsized":"2024-09-12T01:19:54.778656+0000","mapping_epoch":26,"log_start":"251'200","ondisk_log_start":"251'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:20.082192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1444,"num_read_kb":1250,"num_write":453,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'352","reported_seq":1108,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.824755+0000","last_change":"2024-09-12T00:35:43.947838+0000","last_active":"2024-09-12T01:21:57.824755+0000","last_peered":"2024-09-12T01:21:57.824755+0000","last_clean":"2024-09-12T01:21:57.824755+0000","last_became_active":"2024-09-12T00:35:43.947420+0000","last_became_peered":"2024-09-12T00:35:43.947420+0000","last_unstale":"2024-09-12T01:21:57.824755+0000","last_undegraded":"2024-09-12T01:21:57.824755+0000","last_fullsized":"2024-09-12T01:21:57.824755+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:47.159137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262187,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":720,"num_read_kb":19884,"num_write":1159,"num_write_kb":29921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.561198+0000","last_change":"2024-09-12T00:35:47.935965+0000","last_active":"2024-09-12T01:18:18.561198+0000","last_peered":"2024-09-12T01:18:18.561198+0000","last_clean":"2024-09-12T01:18:18.561198+0000","last_became_active":"2024-09-12T00:35:47.935440+0000","last_became_peered":"2024-09-12T00:35:47.935440+0000","last_unstale":"2024-09-12T01:18:18.561198+0000","last_undegraded":"2024-09-12T01:18:18.561198+0000","last_fullsized":"2024-09-12T01:18:18.561198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:47.836745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'90","reported_seq":620,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:02.562788+0000","last_change":"2024-09-12T00:35:50.026452+0000","last_active":"2024-09-12T01:20:02.562788+0000","last_peered":"2024-09-12T01:20:02.562788+0000","last_clean":"2024-09-12T01:20:02.562788+0000","last_became_active":"2024-09-12T00:35:50.025145+0000","last_became_peered":"2024-09-12T00:35:50.025145+0000","last_unstale":"2024-09-12T01:20:02.562788+0000","last_undegraded":"2024-09-12T01:20:02.562788+0000","last_fullsized":"2024-09-12T01:20:02.562788+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:49.606844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":97,"num_read_kb":88,"num_write":76,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'773","reported_seq":2391,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.428899+0000","last_change":"2024-09-12T00:35:51.968551+0000","last_active":"2024-09-12T01:21:57.428899+0000","last_peered":"2024-09-12T01:21:57.428899+0000","last_clean":"2024-09-12T01:21:57.428899+0000","last_became_active":"2024-09-12T00:35:51.967797+0000","last_became_peered":"2024-09-12T00:35:51.967797+0000","last_unstale":"2024-09-12T01:21:57.428899+0000","last_undegraded":"2024-09-12T01:21:57.428899+0000","last_fullsized":"2024-09-12T01:21:57.428899+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:42.194060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'103","reported_seq":603,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.236409+0000","last_change":"2024-09-12T00:35:54.003014+0000","last_active":"2024-09-12T01:20:22.236409+0000","last_peered":"2024-09-12T01:20:22.236409+0000","last_clean":"2024-09-12T01:20:22.236409+0000","last_became_active":"2024-09-12T00:35:54.002318+0000","last_became_peered":"2024-09-12T00:35:54.002318+0000","last_unstale":"2024-09-12T01:20:22.236409+0000","last_undegraded":"2024-09-12T01:20:22.236409+0000","last_fullsized":"2024-09-12T01:20:22.236409+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:45.348319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":119,"num_write":243,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'135","reported_seq":740,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.739424+0000","last_change":"2024-09-12T00:35:45.936713+0000","last_active":"2024-09-12T01:18:17.739424+0000","last_peered":"2024-09-12T01:18:17.739424+0000","last_clean":"2024-09-12T01:18:17.739424+0000","last_became_active":"2024-09-12T00:35:45.935880+0000","last_became_peered":"2024-09-12T00:35:45.935880+0000","last_unstale":"2024-09-12T01:18:17.739424+0000","last_undegraded":"2024-09-12T01:18:17.739424+0000","last_fullsized":"2024-09-12T01:18:17.739424+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:29.055252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":617,"num_read_kb":515,"num_write":204,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'355","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.859915+0000","last_change":"2024-09-12T00:35:43.931892+0000","last_active":"2024-09-12T01:21:57.859915+0000","last_peered":"2024-09-12T01:21:57.859915+0000","last_clean":"2024-09-12T01:21:57.859915+0000","last_became_active":"2024-09-12T00:35:43.931008+0000","last_became_peered":"2024-09-12T00:35:43.931008+0000","last_unstale":"2024-09-12T01:21:57.859915+0000","last_undegraded":"2024-09-12T01:21:57.859915+0000","last_fullsized":"2024-09-12T01:21:57.859915+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:13.452075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730252,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":516,"num_read_kb":33271,"num_write":1211,"num_write_kb":48012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.779666+0000","last_change":"2024-09-12T00:35:47.951130+0000","last_active":"2024-09-12T01:18:17.779666+0000","last_peered":"2024-09-12T01:18:17.779666+0000","last_clean":"2024-09-12T01:18:17.779666+0000","last_became_active":"2024-09-12T00:35:47.950328+0000","last_became_peered":"2024-09-12T00:35:47.950328+0000","last_unstale":"2024-09-12T01:18:17.779666+0000","last_undegraded":"2024-09-12T01:18:17.779666+0000","last_fullsized":"2024-09-12T01:18:17.779666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:21.340191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'320","reported_seq":925,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.090083+0000","last_change":"2024-09-12T00:35:49.939297+0000","last_active":"2024-09-12T01:21:57.090083+0000","last_peered":"2024-09-12T01:21:57.090083+0000","last_clean":"2024-09-12T01:21:57.090083+0000","last_became_active":"2024-09-12T00:35:49.938536+0000","last_became_peered":"2024-09-12T00:35:49.938536+0000","last_unstale":"2024-09-12T01:21:57.090083+0000","last_undegraded":"2024-09-12T01:21:57.090083+0000","last_fullsized":"2024-09-12T01:21:57.090083+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:13.330863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46352,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":532,"num_read_kb":1127,"num_write":424,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":482,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:23.575502+0000","last_change":"2024-09-12T00:35:51.965185+0000","last_active":"2024-09-12T01:19:23.575502+0000","last_peered":"2024-09-12T01:19:23.575502+0000","last_clean":"2024-09-12T01:19:23.575502+0000","last_became_active":"2024-09-12T00:35:51.964446+0000","last_became_peered":"2024-09-12T00:35:51.964446+0000","last_unstale":"2024-09-12T01:19:23.575502+0000","last_undegraded":"2024-09-12T01:19:23.575502+0000","last_fullsized":"2024-09-12T01:19:23.575502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:04.163874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'136","reported_seq":648,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:20.487261+0000","last_change":"2024-09-12T00:35:53.998710+0000","last_active":"2024-09-12T01:20:20.487261+0000","last_peered":"2024-09-12T01:20:20.487261+0000","last_clean":"2024-09-12T01:20:20.487261+0000","last_became_active":"2024-09-12T00:35:53.997969+0000","last_became_peered":"2024-09-12T00:35:53.997969+0000","last_unstale":"2024-09-12T01:20:20.487261+0000","last_undegraded":"2024-09-12T01:20:20.487261+0000","last_fullsized":"2024-09-12T01:20:20.487261+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:50.127097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":591,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":213,"num_read_kb":189,"num_write":344,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'117","reported_seq":701,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:17.808530+0000","last_change":"2024-09-12T00:35:45.940384+0000","last_active":"2024-09-12T01:20:17.808530+0000","last_peered":"2024-09-12T01:20:17.808530+0000","last_clean":"2024-09-12T01:20:17.808530+0000","last_became_active":"2024-09-12T00:35:45.937597+0000","last_became_peered":"2024-09-12T00:35:45.937597+0000","last_unstale":"2024-09-12T01:20:17.808530+0000","last_undegraded":"2024-09-12T01:20:17.808530+0000","last_fullsized":"2024-09-12T01:20:17.808530+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:26.977811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":514,"num_read_kb":428,"num_write":167,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'305","reported_seq":899,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.850312+0000","last_change":"2024-09-12T00:35:43.914480+0000","last_active":"2024-09-12T01:21:57.850312+0000","last_peered":"2024-09-12T01:21:57.850312+0000","last_clean":"2024-09-12T01:21:57.850312+0000","last_became_active":"2024-09-12T00:35:43.913717+0000","last_became_peered":"2024-09-12T00:35:43.913717+0000","last_unstale":"2024-09-12T01:21:57.850312+0000","last_undegraded":"2024-09-12T01:21:57.850312+0000","last_fullsized":"2024-09-12T01:21:57.850312+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:01.278323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":6749,"num_write":932,"num_write_kb":25345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.552287+0000","last_change":"2024-09-12T00:35:47.940913+0000","last_active":"2024-09-12T01:18:18.552287+0000","last_peered":"2024-09-12T01:18:18.552287+0000","last_clean":"2024-09-12T01:18:18.552287+0000","last_became_active":"2024-09-12T00:35:47.940170+0000","last_became_peered":"2024-09-12T00:35:47.940170+0000","last_unstale":"2024-09-12T01:18:18.552287+0000","last_undegraded":"2024-09-12T01:18:18.552287+0000","last_fullsized":"2024-09-12T01:18:18.552287+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:41.868094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'276","reported_seq":844,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.130796+0000","last_change":"2024-09-12T00:35:49.954441+0000","last_active":"2024-09-12T01:21:57.130796+0000","last_peered":"2024-09-12T01:21:57.130796+0000","last_clean":"2024-09-12T01:21:57.130796+0000","last_became_active":"2024-09-12T00:35:49.952570+0000","last_became_peered":"2024-09-12T00:35:49.952570+0000","last_unstale":"2024-09-12T01:21:57.130796+0000","last_undegraded":"2024-09-12T01:21:57.130796+0000","last_fullsized":"2024-09-12T01:21:57.130796+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:31.309890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47159,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":464,"num_read_kb":1078,"num_write":380,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:27.561305+0000","last_change":"2024-09-12T00:35:51.974531+0000","last_active":"2024-09-12T01:19:27.561305+0000","last_peered":"2024-09-12T01:19:27.561305+0000","last_clean":"2024-09-12T01:19:27.561305+0000","last_became_active":"2024-09-12T00:35:51.973732+0000","last_became_peered":"2024-09-12T00:35:51.973732+0000","last_unstale":"2024-09-12T01:19:27.561305+0000","last_undegraded":"2024-09-12T01:19:27.561305+0000","last_fullsized":"2024-09-12T01:19:27.561305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:28.353680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'193","reported_seq":706,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.123850+0000","last_change":"2024-09-12T00:35:54.016500+0000","last_active":"2024-09-12T01:19:37.123850+0000","last_peered":"2024-09-12T01:19:37.123850+0000","last_clean":"2024-09-12T01:19:37.123850+0000","last_became_active":"2024-09-12T00:35:54.016028+0000","last_became_peered":"2024-09-12T00:35:54.016028+0000","last_unstale":"2024-09-12T01:19:37.123850+0000","last_undegraded":"2024-09-12T01:19:37.123850+0000","last_fullsized":"2024-09-12T01:19:37.123850+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:13.793560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":175,"num_read_kb":171,"num_write":438,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'198","reported_seq":811,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:40.883260+0000","last_change":"2024-09-12T00:35:45.941739+0000","last_active":"2024-09-12T01:19:40.883260+0000","last_peered":"2024-09-12T01:19:40.883260+0000","last_clean":"2024-09-12T01:19:40.883260+0000","last_became_active":"2024-09-12T00:35:45.941396+0000","last_became_peered":"2024-09-12T00:35:45.941396+0000","last_unstale":"2024-09-12T01:19:40.883260+0000","last_undegraded":"2024-09-12T01:19:40.883260+0000","last_fullsized":"2024-09-12T01:19:40.883260+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:23.094406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":858,"num_read_kb":711,"num_write":323,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'457","reported_seq":1333,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.864472+0000","last_change":"2024-09-12T00:35:43.942784+0000","last_active":"2024-09-12T01:21:57.864472+0000","last_peered":"2024-09-12T01:21:57.864472+0000","last_clean":"2024-09-12T01:21:57.864472+0000","last_became_active":"2024-09-12T00:35:43.942359+0000","last_became_peered":"2024-09-12T00:35:43.942359+0000","last_unstale":"2024-09-12T01:21:57.864472+0000","last_undegraded":"2024-09-12T01:21:57.864472+0000","last_fullsized":"2024-09-12T01:21:57.864472+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:02.785832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1122,"num_read_kb":58431,"num_write":1508,"num_write_kb":72479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:17.551730+0000","last_change":"2024-09-12T00:35:47.941539+0000","last_active":"2024-09-12T01:19:17.551730+0000","last_peered":"2024-09-12T01:19:17.551730+0000","last_clean":"2024-09-12T01:19:17.551730+0000","last_became_active":"2024-09-12T00:35:47.940501+0000","last_became_peered":"2024-09-12T00:35:47.940501+0000","last_unstale":"2024-09-12T01:19:17.551730+0000","last_undegraded":"2024-09-12T01:19:17.551730+0000","last_fullsized":"2024-09-12T01:19:17.551730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:32.448595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'228","reported_seq":788,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.785257+0000","last_change":"2024-09-12T00:35:49.956360+0000","last_active":"2024-09-12T01:21:56.785257+0000","last_peered":"2024-09-12T01:21:56.785257+0000","last_clean":"2024-09-12T01:21:56.785257+0000","last_became_active":"2024-09-12T00:35:49.955264+0000","last_became_peered":"2024-09-12T00:35:49.955264+0000","last_unstale":"2024-09-12T01:21:56.785257+0000","last_undegraded":"2024-09-12T01:21:56.785257+0000","last_fullsized":"2024-09-12T01:21:56.785257+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:15.469778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44002,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":385,"num_read_kb":903,"num_write":312,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:22.740634+0000","last_change":"2024-09-12T00:35:51.965221+0000","last_active":"2024-09-12T01:18:22.740634+0000","last_peered":"2024-09-12T01:18:22.740634+0000","last_clean":"2024-09-12T01:18:22.740634+0000","last_became_active":"2024-09-12T00:35:51.961691+0000","last_became_peered":"2024-09-12T00:35:51.961691+0000","last_unstale":"2024-09-12T01:18:22.740634+0000","last_undegraded":"2024-09-12T01:18:22.740634+0000","last_fullsized":"2024-09-12T01:18:22.740634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:22.139991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'194","reported_seq":1651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:20.421505+0000","last_change":"2024-09-12T00:35:53.992266+0000","last_active":"2024-09-12T01:20:20.421505+0000","last_peered":"2024-09-12T01:20:20.421505+0000","last_clean":"2024-09-12T01:20:20.421505+0000","last_became_active":"2024-09-12T00:35:53.991532+0000","last_became_peered":"2024-09-12T00:35:53.991532+0000","last_unstale":"2024-09-12T01:20:20.421505+0000","last_undegraded":"2024-09-12T01:20:20.421505+0000","last_fullsized":"2024-09-12T01:20:20.421505+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:47.645297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1185,"num_read_kb":1184,"num_write":442,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'185","reported_seq":796,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:52.882363+0000","last_change":"2024-09-12T00:35:45.955138+0000","last_active":"2024-09-12T01:19:52.882363+0000","last_peered":"2024-09-12T01:19:52.882363+0000","last_clean":"2024-09-12T01:19:52.882363+0000","last_became_active":"2024-09-12T00:35:45.954474+0000","last_became_peered":"2024-09-12T00:35:45.954474+0000","last_unstale":"2024-09-12T01:19:52.882363+0000","last_undegraded":"2024-09-12T01:19:52.882363+0000","last_fullsized":"2024-09-12T01:19:52.882363+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:40.526235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":774,"num_read_kb":643,"num_write":252,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'368","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.852623+0000","last_change":"2024-09-12T00:35:43.935329+0000","last_active":"2024-09-12T01:21:57.852623+0000","last_peered":"2024-09-12T01:21:57.852623+0000","last_clean":"2024-09-12T01:21:57.852623+0000","last_became_active":"2024-09-12T00:35:43.934998+0000","last_became_peered":"2024-09-12T00:35:43.934998+0000","last_unstale":"2024-09-12T01:21:57.852623+0000","last_undegraded":"2024-09-12T01:21:57.852623+0000","last_fullsized":"2024-09-12T01:21:57.852623+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:30.951798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":520,"num_read_kb":15471,"num_write":1132,"num_write_kb":44978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:23.579165+0000","last_change":"2024-09-12T00:35:47.929157+0000","last_active":"2024-09-12T01:19:23.579165+0000","last_peered":"2024-09-12T01:19:23.579165+0000","last_clean":"2024-09-12T01:19:23.579165+0000","last_became_active":"2024-09-12T00:35:47.928424+0000","last_became_peered":"2024-09-12T00:35:47.928424+0000","last_unstale":"2024-09-12T01:19:23.579165+0000","last_undegraded":"2024-09-12T01:19:23.579165+0000","last_fullsized":"2024-09-12T01:19:23.579165+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:48.464754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'297","reported_seq":895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.898129+0000","last_change":"2024-09-12T00:35:49.934387+0000","last_active":"2024-09-12T01:21:56.898129+0000","last_peered":"2024-09-12T01:21:56.898129+0000","last_clean":"2024-09-12T01:21:56.898129+0000","last_became_active":"2024-09-12T00:35:49.933165+0000","last_became_peered":"2024-09-12T00:35:49.933165+0000","last_unstale":"2024-09-12T01:21:56.898129+0000","last_undegraded":"2024-09-12T01:21:56.898129+0000","last_fullsized":"2024-09-12T01:21:56.898129+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:40.275776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49116,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":493,"num_read_kb":1065,"num_write":392,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.560633+0000","last_change":"2024-09-12T00:35:51.985500+0000","last_active":"2024-09-12T01:18:23.560633+0000","last_peered":"2024-09-12T01:18:23.560633+0000","last_clean":"2024-09-12T01:18:23.560633+0000","last_became_active":"2024-09-12T00:35:51.984756+0000","last_became_peered":"2024-09-12T00:35:51.984756+0000","last_unstale":"2024-09-12T01:18:23.560633+0000","last_undegraded":"2024-09-12T01:18:23.560633+0000","last_fullsized":"2024-09-12T01:18:23.560633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:50.437627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'185","reported_seq":692,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:24.493960+0000","last_change":"2024-09-12T00:35:53.986078+0000","last_active":"2024-09-12T01:21:24.493960+0000","last_peered":"2024-09-12T01:21:24.493960+0000","last_clean":"2024-09-12T01:21:24.493960+0000","last_became_active":"2024-09-12T00:35:53.985486+0000","last_became_peered":"2024-09-12T00:35:53.985486+0000","last_unstale":"2024-09-12T01:21:24.493960+0000","last_undegraded":"2024-09-12T01:21:24.493960+0000","last_fullsized":"2024-09-12T01:21:24.493960+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:09.339192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1062,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":193,"num_read_kb":167,"num_write":361,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'182","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:49.296781+0000","last_change":"2024-09-12T00:35:45.958055+0000","last_active":"2024-09-12T01:19:49.296781+0000","last_peered":"2024-09-12T01:19:49.296781+0000","last_clean":"2024-09-12T01:19:49.296781+0000","last_became_active":"2024-09-12T00:35:45.957698+0000","last_became_peered":"2024-09-12T00:35:45.957698+0000","last_unstale":"2024-09-12T01:19:49.296781+0000","last_undegraded":"2024-09-12T01:19:49.296781+0000","last_fullsized":"2024-09-12T01:19:49.296781+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:17.032556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":768,"num_read_kb":623,"num_write":277,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'391","reported_seq":1062,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.843864+0000","last_change":"2024-09-12T00:35:43.938029+0000","last_active":"2024-09-12T01:21:57.843864+0000","last_peered":"2024-09-12T01:21:57.843864+0000","last_clean":"2024-09-12T01:21:57.843864+0000","last_became_active":"2024-09-12T00:35:43.937281+0000","last_became_peered":"2024-09-12T00:35:43.937281+0000","last_unstale":"2024-09-12T01:21:57.843864+0000","last_undegraded":"2024-09-12T01:21:57.843864+0000","last_fullsized":"2024-09-12T01:21:57.843864+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:12.183580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550668,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":606,"num_read_kb":52877,"num_write":1364,"num_write_kb":41162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'421","reported_seq":1110,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:44.539784+0000","last_change":"2024-09-12T00:35:45.932905+0000","last_active":"2024-09-12T01:19:44.539784+0000","last_peered":"2024-09-12T01:19:44.539784+0000","last_clean":"2024-09-12T01:19:44.539784+0000","last_became_active":"2024-09-12T00:35:45.932615+0000","last_became_peered":"2024-09-12T00:35:45.932615+0000","last_unstale":"2024-09-12T01:19:44.539784+0000","last_undegraded":"2024-09-12T01:19:44.539784+0000","last_fullsized":"2024-09-12T01:19:44.539784+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:14.286299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2107,"num_read_kb":1905,"num_write":744,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'287","reported_seq":948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.826277+0000","last_change":"2024-09-12T00:35:43.922351+0000","last_active":"2024-09-12T01:21:57.826277+0000","last_peered":"2024-09-12T01:21:57.826277+0000","last_clean":"2024-09-12T01:21:57.826277+0000","last_became_active":"2024-09-12T00:35:43.922005+0000","last_became_peered":"2024-09-12T00:35:43.922005+0000","last_unstale":"2024-09-12T01:21:57.826277+0000","last_undegraded":"2024-09-12T01:21:57.826277+0000","last_fullsized":"2024-09-12T01:21:57.826277+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:30.017931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":535,"num_read_kb":1388,"num_write":997,"num_write_kb":25405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'246","reported_seq":865,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.563835+0000","last_change":"2024-09-12T00:35:45.940788+0000","last_active":"2024-09-12T01:19:08.563835+0000","last_peered":"2024-09-12T01:19:08.563835+0000","last_clean":"2024-09-12T01:19:08.563835+0000","last_became_active":"2024-09-12T00:35:45.940153+0000","last_became_peered":"2024-09-12T00:35:45.940153+0000","last_unstale":"2024-09-12T01:19:08.563835+0000","last_undegraded":"2024-09-12T01:19:08.563835+0000","last_fullsized":"2024-09-12T01:19:08.563835+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:41.108403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1055,"num_read_kb":856,"num_write":397,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'346","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.803735+0000","last_change":"2024-09-12T00:36:17.268203+0000","last_active":"2024-09-12T01:21:57.803735+0000","last_peered":"2024-09-12T01:21:57.803735+0000","last_clean":"2024-09-12T01:21:57.803735+0000","last_became_active":"2024-09-12T00:36:17.267594+0000","last_became_peered":"2024-09-12T00:36:17.267594+0000","last_unstale":"2024-09-12T01:21:57.803735+0000","last_undegraded":"2024-09-12T01:21:57.803735+0000","last_fullsized":"2024-09-12T01:21:57.803735+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:49.169181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436874,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":471,"num_read_kb":41052,"num_write":1136,"num_write_kb":25796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"265'92","reported_seq":669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:59.355559+0000","last_change":"2024-09-12T00:35:45.945797+0000","last_active":"2024-09-12T01:19:59.355559+0000","last_peered":"2024-09-12T01:19:59.355559+0000","last_clean":"2024-09-12T01:19:59.355559+0000","last_became_active":"2024-09-12T00:35:45.945534+0000","last_became_peered":"2024-09-12T00:35:45.945534+0000","last_unstale":"2024-09-12T01:19:59.355559+0000","last_undegraded":"2024-09-12T01:19:59.355559+0000","last_fullsized":"2024-09-12T01:19:59.355559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:37.784859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":411,"num_read_kb":349,"num_write":136,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'318","reported_seq":949,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.834229+0000","last_change":"2024-09-12T00:35:43.934445+0000","last_active":"2024-09-12T01:21:57.834229+0000","last_peered":"2024-09-12T01:21:57.834229+0000","last_clean":"2024-09-12T01:21:57.834229+0000","last_became_active":"2024-09-12T00:35:43.934068+0000","last_became_peered":"2024-09-12T00:35:43.934068+0000","last_unstale":"2024-09-12T01:21:57.834229+0000","last_undegraded":"2024-09-12T01:21:57.834229+0000","last_fullsized":"2024-09-12T01:21:57.834229+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:30.567561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":780267,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":473,"num_read_kb":16449,"num_write":1046,"num_write_kb":32400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'160","reported_seq":796,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.600355+0000","last_change":"2024-09-12T00:35:45.944926+0000","last_active":"2024-09-12T01:19:43.600355+0000","last_peered":"2024-09-12T01:19:43.600355+0000","last_clean":"2024-09-12T01:19:43.600355+0000","last_became_active":"2024-09-12T00:35:45.944423+0000","last_became_peered":"2024-09-12T00:35:45.944423+0000","last_unstale":"2024-09-12T01:19:43.600355+0000","last_undegraded":"2024-09-12T01:19:43.600355+0000","last_fullsized":"2024-09-12T01:19:43.600355+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:02.168577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":713,"num_read_kb":599,"num_write":226,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"265'338","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.857603+0000","last_change":"2024-09-12T00:35:43.937795+0000","last_active":"2024-09-12T01:21:57.857603+0000","last_peered":"2024-09-12T01:21:57.857603+0000","last_clean":"2024-09-12T01:21:57.857603+0000","last_became_active":"2024-09-12T00:35:43.937104+0000","last_became_peered":"2024-09-12T00:35:43.937104+0000","last_unstale":"2024-09-12T01:21:57.857603+0000","last_undegraded":"2024-09-12T01:21:57.857603+0000","last_fullsized":"2024-09-12T01:21:57.857603+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:30.010970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262271,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":572,"num_read_kb":63038,"num_write":1116,"num_write_kb":29306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'251","reported_seq":846,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:45.359695+0000","last_change":"2024-09-12T00:35:45.958347+0000","last_active":"2024-09-12T01:19:45.359695+0000","last_peered":"2024-09-12T01:19:45.359695+0000","last_clean":"2024-09-12T01:19:45.359695+0000","last_became_active":"2024-09-12T00:35:45.957860+0000","last_became_peered":"2024-09-12T00:35:45.957860+0000","last_unstale":"2024-09-12T01:19:45.359695+0000","last_undegraded":"2024-09-12T01:19:45.359695+0000","last_fullsized":"2024-09-12T01:19:45.359695+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:49.651072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1076,"num_read_kb":859,"num_write":407,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'343","reported_seq":986,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.839108+0000","last_change":"2024-09-12T00:35:43.929564+0000","last_active":"2024-09-12T01:21:57.839108+0000","last_peered":"2024-09-12T01:21:57.839108+0000","last_clean":"2024-09-12T01:21:57.839108+0000","last_became_active":"2024-09-12T00:35:43.929027+0000","last_became_peered":"2024-09-12T00:35:43.929027+0000","last_unstale":"2024-09-12T01:21:57.839108+0000","last_undegraded":"2024-09-12T01:21:57.839108+0000","last_fullsized":"2024-09-12T01:21:57.839108+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:38.958866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":588,"num_read_kb":747,"num_write":1224,"num_write_kb":5740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'102","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:33.597890+0000","last_change":"2024-09-12T00:35:45.949059+0000","last_active":"2024-09-12T01:19:33.597890+0000","last_peered":"2024-09-12T01:19:33.597890+0000","last_clean":"2024-09-12T01:19:33.597890+0000","last_became_active":"2024-09-12T00:35:45.948581+0000","last_became_peered":"2024-09-12T00:35:45.948581+0000","last_unstale":"2024-09-12T01:19:33.597890+0000","last_undegraded":"2024-09-12T01:19:33.597890+0000","last_fullsized":"2024-09-12T01:19:33.597890+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:03.771381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":463,"num_read_kb":395,"num_write":145,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"265'332","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.836763+0000","last_change":"2024-09-12T00:35:43.941896+0000","last_active":"2024-09-12T01:21:57.836763+0000","last_peered":"2024-09-12T01:21:57.836763+0000","last_clean":"2024-09-12T01:21:57.836763+0000","last_became_active":"2024-09-12T00:35:43.941155+0000","last_became_peered":"2024-09-12T00:35:43.941155+0000","last_unstale":"2024-09-12T01:21:57.836763+0000","last_undegraded":"2024-09-12T01:21:57.836763+0000","last_fullsized":"2024-09-12T01:21:57.836763+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:16.416635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":4200,"num_write":1081,"num_write_kb":60173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"265'210","reported_seq":843,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.562354+0000","last_change":"2024-09-12T00:35:45.946815+0000","last_active":"2024-09-12T01:19:32.562354+0000","last_peered":"2024-09-12T01:19:32.562354+0000","last_clean":"2024-09-12T01:19:32.562354+0000","last_became_active":"2024-09-12T00:35:45.946047+0000","last_became_peered":"2024-09-12T00:35:45.946047+0000","last_unstale":"2024-09-12T01:19:32.562354+0000","last_undegraded":"2024-09-12T01:19:32.562354+0000","last_fullsized":"2024-09-12T01:19:32.562354+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:52.299599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":932,"num_read_kb":766,"num_write":302,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'318","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.857919+0000","last_change":"2024-09-12T00:35:43.924021+0000","last_active":"2024-09-12T01:21:57.857919+0000","last_peered":"2024-09-12T01:21:57.857919+0000","last_clean":"2024-09-12T01:21:57.857919+0000","last_became_active":"2024-09-12T00:35:43.923685+0000","last_became_peered":"2024-09-12T00:35:43.923685+0000","last_unstale":"2024-09-12T01:21:57.857919+0000","last_undegraded":"2024-09-12T01:21:57.857919+0000","last_fullsized":"2024-09-12T01:21:57.857919+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:37.087675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524322,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":440,"num_read_kb":73837,"num_write":961,"num_write_kb":48353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'100","reported_seq":678,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:51.229959+0000","last_change":"2024-09-12T00:35:45.942310+0000","last_active":"2024-09-12T01:18:51.229959+0000","last_peered":"2024-09-12T01:18:51.229959+0000","last_clean":"2024-09-12T01:18:51.229959+0000","last_became_active":"2024-09-12T00:35:45.941986+0000","last_became_peered":"2024-09-12T00:35:45.941986+0000","last_unstale":"2024-09-12T01:18:51.229959+0000","last_undegraded":"2024-09-12T01:18:51.229959+0000","last_fullsized":"2024-09-12T01:18:51.229959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:26.966357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":455,"num_read_kb":381,"num_write":169,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'335","reported_seq":1049,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.858500+0000","last_change":"2024-09-12T00:35:43.912420+0000","last_active":"2024-09-12T01:21:57.858500+0000","last_peered":"2024-09-12T01:21:57.858500+0000","last_clean":"2024-09-12T01:21:57.858500+0000","last_became_active":"2024-09-12T00:35:43.911654+0000","last_became_peered":"2024-09-12T00:35:43.911654+0000","last_unstale":"2024-09-12T01:21:57.858500+0000","last_undegraded":"2024-09-12T01:21:57.858500+0000","last_fullsized":"2024-09-12T01:21:57.858500+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:17.425827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262180,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":572,"num_read_kb":5667,"num_write":1085,"num_write_kb":32435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'261","reported_seq":851,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:08.858632+0000","last_change":"2024-09-12T00:35:45.927243+0000","last_active":"2024-09-12T01:20:08.858632+0000","last_peered":"2024-09-12T01:20:08.858632+0000","last_clean":"2024-09-12T01:20:08.858632+0000","last_became_active":"2024-09-12T00:35:45.926462+0000","last_became_peered":"2024-09-12T00:35:45.926462+0000","last_unstale":"2024-09-12T01:20:08.858632+0000","last_undegraded":"2024-09-12T01:20:08.858632+0000","last_fullsized":"2024-09-12T01:20:08.858632+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:10.440313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1050,"num_read_kb":836,"num_write":420,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'326","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.803189+0000","last_change":"2024-09-12T00:35:43.937158+0000","last_active":"2024-09-12T01:21:57.803189+0000","last_peered":"2024-09-12T01:21:57.803189+0000","last_clean":"2024-09-12T01:21:57.803189+0000","last_became_active":"2024-09-12T00:35:43.936883+0000","last_became_peered":"2024-09-12T00:35:43.936883+0000","last_unstale":"2024-09-12T01:21:57.803189+0000","last_undegraded":"2024-09-12T01:21:57.803189+0000","last_fullsized":"2024-09-12T01:21:57.803189+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:57.094162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2075264,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":536,"num_read_kb":80814,"num_write":1042,"num_write_kb":32955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"265'151","reported_seq":737,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:15.520650+0000","last_change":"2024-09-12T00:35:45.959301+0000","last_active":"2024-09-12T01:19:15.520650+0000","last_peered":"2024-09-12T01:19:15.520650+0000","last_clean":"2024-09-12T01:19:15.520650+0000","last_became_active":"2024-09-12T00:35:45.958997+0000","last_became_peered":"2024-09-12T00:35:45.958997+0000","last_unstale":"2024-09-12T01:19:15.520650+0000","last_undegraded":"2024-09-12T01:19:15.520650+0000","last_fullsized":"2024-09-12T01:19:15.520650+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:39.026757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":623,"num_read_kb":511,"num_write":250,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'370","reported_seq":1028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.848244+0000","last_change":"2024-09-12T00:35:43.943348+0000","last_active":"2024-09-12T01:21:57.848244+0000","last_peered":"2024-09-12T01:21:57.848244+0000","last_clean":"2024-09-12T01:21:57.848244+0000","last_became_active":"2024-09-12T00:35:43.942591+0000","last_became_peered":"2024-09-12T00:35:43.942591+0000","last_unstale":"2024-09-12T01:21:57.848244+0000","last_undegraded":"2024-09-12T01:21:57.848244+0000","last_fullsized":"2024-09-12T01:21:57.848244+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:50.909125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":894961,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":508,"num_read_kb":28251,"num_write":1134,"num_write_kb":59925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"265'83","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:32.742834+0000","last_change":"2024-09-12T00:35:45.954876+0000","last_active":"2024-09-12T01:18:32.742834+0000","last_peered":"2024-09-12T01:18:32.742834+0000","last_clean":"2024-09-12T01:18:32.742834+0000","last_became_active":"2024-09-12T00:35:45.954252+0000","last_became_peered":"2024-09-12T00:35:45.954252+0000","last_unstale":"2024-09-12T01:18:32.742834+0000","last_undegraded":"2024-09-12T01:18:32.742834+0000","last_fullsized":"2024-09-12T01:18:32.742834+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:48.605386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":370,"num_read_kb":310,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'381","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.857418+0000","last_change":"2024-09-12T00:35:43.953256+0000","last_active":"2024-09-12T01:21:57.857418+0000","last_peered":"2024-09-12T01:21:57.857418+0000","last_clean":"2024-09-12T01:21:57.857418+0000","last_became_active":"2024-09-12T00:35:43.952828+0000","last_became_peered":"2024-09-12T00:35:43.952828+0000","last_unstale":"2024-09-12T01:21:57.857418+0000","last_undegraded":"2024-09-12T01:21:57.857418+0000","last_fullsized":"2024-09-12T01:21:57.857418+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:32.309244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":611,"num_read_kb":10107,"num_write":1280,"num_write_kb":30495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'4192","reported_seq":4817,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:24.494966+0000","last_change":"2024-09-12T00:35:45.951097+0000","last_active":"2024-09-12T01:21:24.494966+0000","last_peered":"2024-09-12T01:21:24.494966+0000","last_clean":"2024-09-12T01:21:24.494966+0000","last_became_active":"2024-09-12T00:35:45.949770+0000","last_became_peered":"2024-09-12T00:35:45.949770+0000","last_unstale":"2024-09-12T01:21:24.494966+0000","last_undegraded":"2024-09-12T01:21:24.494966+0000","last_fullsized":"2024-09-12T01:21:24.494966+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":3000,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:12.568875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16900,"num_read_kb":14167,"num_write":6311,"num_write_kb":3148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'350","reported_seq":995,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.816103+0000","last_change":"2024-09-12T00:35:43.945424+0000","last_active":"2024-09-12T01:21:57.816103+0000","last_peered":"2024-09-12T01:21:57.816103+0000","last_clean":"2024-09-12T01:21:57.816103+0000","last_became_active":"2024-09-12T00:35:43.944721+0000","last_became_peered":"2024-09-12T00:35:43.944721+0000","last_unstale":"2024-09-12T01:21:57.816103+0000","last_undegraded":"2024-09-12T01:21:57.816103+0000","last_fullsized":"2024-09-12T01:21:57.816103+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:48.957484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730131,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":532,"num_read_kb":12444,"num_write":1159,"num_write_kb":48295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'221","reported_seq":856,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:48.594988+0000","last_change":"2024-09-12T00:35:45.940317+0000","last_active":"2024-09-12T01:20:48.594988+0000","last_peered":"2024-09-12T01:20:48.594988+0000","last_clean":"2024-09-12T01:20:48.594988+0000","last_became_active":"2024-09-12T00:35:45.939921+0000","last_became_peered":"2024-09-12T00:35:45.939921+0000","last_unstale":"2024-09-12T01:20:48.594988+0000","last_undegraded":"2024-09-12T01:20:48.594988+0000","last_fullsized":"2024-09-12T01:20:48.594988+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:13.796483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":991,"num_read_kb":821,"num_write":345,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'342","reported_seq":971,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.847905+0000","last_change":"2024-09-12T00:35:43.943721+0000","last_active":"2024-09-12T01:21:57.847905+0000","last_peered":"2024-09-12T01:21:57.847905+0000","last_clean":"2024-09-12T01:21:57.847905+0000","last_became_active":"2024-09-12T00:35:43.942772+0000","last_became_peered":"2024-09-12T00:35:43.942772+0000","last_unstale":"2024-09-12T01:21:57.847905+0000","last_undegraded":"2024-09-12T01:21:57.847905+0000","last_fullsized":"2024-09-12T01:21:57.847905+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:17.244534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2329981,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":472,"num_read_kb":15742,"num_write":1095,"num_write_kb":41173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'153","reported_seq":771,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:33.583730+0000","last_change":"2024-09-12T00:35:45.938724+0000","last_active":"2024-09-12T01:18:33.583730+0000","last_peered":"2024-09-12T01:18:33.583730+0000","last_clean":"2024-09-12T01:18:33.583730+0000","last_became_active":"2024-09-12T00:35:45.937998+0000","last_became_peered":"2024-09-12T00:35:45.937998+0000","last_unstale":"2024-09-12T01:18:33.583730+0000","last_undegraded":"2024-09-12T01:18:33.583730+0000","last_fullsized":"2024-09-12T01:18:33.583730+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:04.489640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":680,"num_read_kb":568,"num_write":226,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'355","reported_seq":1056,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.848252+0000","last_change":"2024-09-12T00:35:43.941342+0000","last_active":"2024-09-12T01:21:57.848252+0000","last_peered":"2024-09-12T01:21:57.848252+0000","last_clean":"2024-09-12T01:21:57.848252+0000","last_became_active":"2024-09-12T00:35:43.940876+0000","last_became_peered":"2024-09-12T00:35:43.940876+0000","last_unstale":"2024-09-12T01:21:57.848252+0000","last_undegraded":"2024-09-12T01:21:57.848252+0000","last_fullsized":"2024-09-12T01:21:57.848252+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:09.198397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":724,"num_read_kb":28886,"num_write":1110,"num_write_kb":16361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'146","reported_seq":783,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:14.901305+0000","last_change":"2024-09-12T00:35:45.948798+0000","last_active":"2024-09-12T01:19:14.901305+0000","last_peered":"2024-09-12T01:19:14.901305+0000","last_clean":"2024-09-12T01:19:14.901305+0000","last_became_active":"2024-09-12T00:35:45.948028+0000","last_became_peered":"2024-09-12T00:35:45.948028+0000","last_unstale":"2024-09-12T01:19:14.901305+0000","last_undegraded":"2024-09-12T01:19:14.901305+0000","last_fullsized":"2024-09-12T01:19:14.901305+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:30.737963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":702,"num_read_kb":590,"num_write":208,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'337","reported_seq":1014,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.857128+0000","last_change":"2024-09-12T00:35:43.951405+0000","last_active":"2024-09-12T01:21:57.857128+0000","last_peered":"2024-09-12T01:21:57.857128+0000","last_clean":"2024-09-12T01:21:57.857128+0000","last_became_active":"2024-09-12T00:35:43.950791+0000","last_became_peered":"2024-09-12T00:35:43.950791+0000","last_unstale":"2024-09-12T01:21:57.857128+0000","last_undegraded":"2024-09-12T01:21:57.857128+0000","last_fullsized":"2024-09-12T01:21:57.857128+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:26.346445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5529046,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":579,"num_read_kb":37013,"num_write":1080,"num_write_kb":45879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'298","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.752923+0000","last_change":"2024-09-12T00:35:43.932104+0000","last_active":"2024-09-12T01:21:57.752923+0000","last_peered":"2024-09-12T01:21:57.752923+0000","last_clean":"2024-09-12T01:21:57.752923+0000","last_became_active":"2024-09-12T00:35:43.931367+0000","last_became_peered":"2024-09-12T00:35:43.931367+0000","last_unstale":"2024-09-12T01:21:57.752923+0000","last_undegraded":"2024-09-12T01:21:57.752923+0000","last_fullsized":"2024-09-12T01:21:57.752923+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:38.049554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":466,"num_read_kb":37317,"num_write":980,"num_write_kb":22412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'443","reported_seq":1072,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:28.576933+0000","last_change":"2024-09-12T00:35:45.941592+0000","last_active":"2024-09-12T01:19:28.576933+0000","last_peered":"2024-09-12T01:19:28.576933+0000","last_clean":"2024-09-12T01:19:28.576933+0000","last_became_active":"2024-09-12T00:35:45.941136+0000","last_became_peered":"2024-09-12T00:35:45.941136+0000","last_unstale":"2024-09-12T01:19:28.576933+0000","last_undegraded":"2024-09-12T01:19:28.576933+0000","last_fullsized":"2024-09-12T01:19:28.576933+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:02.451398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1924,"num_read_kb":1655,"num_write":712,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'343","reported_seq":993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.856682+0000","last_change":"2024-09-12T00:35:43.937060+0000","last_active":"2024-09-12T01:21:57.856682+0000","last_peered":"2024-09-12T01:21:57.856682+0000","last_clean":"2024-09-12T01:21:57.856682+0000","last_became_active":"2024-09-12T00:35:43.936772+0000","last_became_peered":"2024-09-12T00:35:43.936772+0000","last_unstale":"2024-09-12T01:21:57.856682+0000","last_undegraded":"2024-09-12T01:21:57.856682+0000","last_fullsized":"2024-09-12T01:21:57.856682+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:42.883458+0000","last_clean_scrub_stamp":"2024-09-12T00:35:42.883458+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:27.825066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":514466,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":11206,"num_write":1103,"num_write_kb":22250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'123","reported_seq":729,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.566303+0000","last_change":"2024-09-12T00:35:45.934557+0000","last_active":"2024-09-12T01:19:18.566303+0000","last_peered":"2024-09-12T01:19:18.566303+0000","last_clean":"2024-09-12T01:19:18.566303+0000","last_became_active":"2024-09-12T00:35:45.933748+0000","last_became_peered":"2024-09-12T00:35:45.933748+0000","last_unstale":"2024-09-12T01:19:18.566303+0000","last_undegraded":"2024-09-12T01:19:18.566303+0000","last_fullsized":"2024-09-12T01:19:18.566303+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:12.558899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":571,"num_read_kb":478,"num_write":188,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5965,"num_read_kb":4303,"num_write":1960,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":931,"ondisk_log_size":931,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":15013,"num_read_kb":14673,"num_write":16730,"num_write_kb":4883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2159,"ondisk_log_size":2159,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":583,"ondisk_log_size":583,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1547252,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":17692,"num_read_kb":36824,"num_write":14761,"num_write_kb":11530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1947,"ondisk_log_size":1947,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2433,"num_read_kb":2900,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102034,"num_read_kb":85265,"num_write":36996,"num_write_kb":18612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3934,"ondisk_log_size":3934,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":73603174,"num_objects":366,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":366,"num_whiteouts":0,"num_read":35859,"num_read_kb":1958475,"num_write":71400,"num_write_kb":2147647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":148455424,"data_stored":147206348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3638,"ondisk_log_size":3638,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":174261,"num_write":154,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":179336,"num_write":154,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424510005,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":152852,"kb_used_data":36832,"kb_used_omap":1,"kb_used_meta":115774,"kb_avail":94218988,"statfs":{"total":96636764160,"available":96480243712,"internally_reserved":0,"allocated":37715968,"data_stored":35946887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":118553029},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510004,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280316,"kb_used_data":32432,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":94091524,"statfs":{"total":96636764160,"available":96349720576,"internally_reserved":0,"allocated":33210368,"data_stored":31432953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":253688263},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510006,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126224,"kb_used_data":10384,"kb_used_omap":1,"kb_used_meta":115774,"kb_avail":94245616,"statfs":{"total":96636764160,"available":96507510784,"internally_reserved":0,"allocated":10633216,"data_stored":9073175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":118553029},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510005,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245236,"kb_used_data":29412,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94126604,"statfs":{"total":96636764160,"available":96385642496,"internally_reserved":0,"allocated":30117888,"data_stored":28384468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220985797},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542708,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250064,"kb_used_data":20304,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94121776,"statfs":{"total":96636764160,"available":96380698624,"internally_reserved":0,"allocated":20791296,"data_stored":19046587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235207114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542707,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":228892,"kb_used_data":16944,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94142948,"statfs":{"total":96636764160,"available":96402378752,"internally_reserved":0,"allocated":17350656,"data_stored":15759617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":216725958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542708,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85652,"kb_used_data":14128,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94286188,"statfs":{"total":96636764160,"available":96549056512,"internally_reserved":0,"allocated":14467072,"data_stored":12799537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575411,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76228,"kb_used_data":14372,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94295612,"statfs":{"total":96636764160,"available":96558706688,"internally_reserved":0,"allocated":14716928,"data_stored":13117126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25833472,"data_stored":25645853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6983680,"data_stored":6928219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11079680,"data_stored":10970794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29499392,"data_stored":29284181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10829824,"data_stored":10653176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34000896,"data_stored":33800787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13717504,"data_stored":13613541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16510976,"data_stored":16309797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":4558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":6362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:22:05.523 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.523 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.523 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.523 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.524 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.524 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.524 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.524 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.524 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.524 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.525 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.525 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.525 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.525 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.525 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.525 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.525 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.525 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.526 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.526 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.526 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.526 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.526 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.526 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.526 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.526 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.527 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.527 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.527 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.527 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.527 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.527 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.527 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.527 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.528 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.528 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.528 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.528 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.528 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.528 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.528 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.528 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.529 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.529 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.529 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.529 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.529 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.529 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.529 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.529 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.530 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.530 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.530 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.530 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.530 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.530 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.531 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.531 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.531 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.531 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.531 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.531 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.531 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.531 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.532 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.532 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.532 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.532 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.532 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.532 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.532 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.532 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.533 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.533 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.533 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.533 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.533 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.533 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.533 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.533 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.534 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.534 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.534 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.534 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.534 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.534 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.534 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.534 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.535 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.535 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.535 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.535 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.535 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.535 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.535 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.535 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.536 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.536 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.536 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.536 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.536 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.536 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.536 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.536 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.537 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.537 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.537 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.537 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.537 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.537 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.537 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.537 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.537 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.538 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.538 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.538 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.538 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.538 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.538 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.538 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.538 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.538 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.539 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.539 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.539 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.539 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.539 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.539 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.539 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.539 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.539 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.540 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.540 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.540 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.540 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.540 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.540 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.540 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.540 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.540 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.541 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.541 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.541 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.541 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.541 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.541 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.541 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.541 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.541 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.541 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.542 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.542 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.542 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.542 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.542 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.542 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.542 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.542 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.542 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.543 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.543 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.543 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.543 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.543 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.543 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.543 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.543 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.543 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.543 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.544 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.544 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.544 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.544 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.544 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.544 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.544 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.544 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.544 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.544 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.545 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.545 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.545 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.545 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.545 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.545 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.545 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.545 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.545 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.546 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.546 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.546 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.546 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.546 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.546 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.546 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.546 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.546 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.546 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.547 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.547 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.547 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.547 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.547 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.547 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.547 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.547 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.548 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.548 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.548 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.548 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.548 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.548 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.548 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.549 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.549 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.549 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.549 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.549 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.549 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.549 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.549 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.549 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.550 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.550 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.550 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.551 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.551 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.551 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.551 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T00:35:23.614097+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.552 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T00:35:28.645695+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.552 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.552 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.552 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.552 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.553 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.553 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.553 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T00:35:28.645695+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.553 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.554 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.554 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.554 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.554 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.554 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.555 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T00:35:28.645695+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.555 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.555 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.555 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.556 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.556 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.556 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.556 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T00:35:28.645695+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.556 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.557 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.557 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.557 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.557 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.558 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.558 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.558 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.558 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.558 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.559 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.559 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.559 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.559 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T00:35:28.645695+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.559 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.559 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.559 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.560 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.560 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.560 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.560 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T00:35:28.645695+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.560 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.560 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.560 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.560 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.561 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.561 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.561 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T00:35:28.645695+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.561 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.561 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.561 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.561 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.561 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.561 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.562 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.562 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.562 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.562 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.562 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.562 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.562 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.562 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.563 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.563 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.563 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.563 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.563 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.563 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.563 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.563 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.564 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.564 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.564 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.564 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.564 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.564 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.564 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.565 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.565 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.565 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.565 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.565 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.565 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.565 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.565 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.565 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.565 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.566 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.566 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.566 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.566 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.566 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.566 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.566 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.566 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.566 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.567 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.567 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.567 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.567 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.567 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.567 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.567 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.567 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.567 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.568 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.568 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.568 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.568 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.568 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.568 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.568 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.568 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.568 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.569 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.569 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.569 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.569 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.569 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.569 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.569 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.569 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.569 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.570 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.570 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.570 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.570 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.570 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.570 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.570 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.570 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.570 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.571 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.571 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.571 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.571 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.571 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.571 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.571 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.571 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.571 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.571 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.572 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.572 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.572 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.572 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.572 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.572 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.572 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.572 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.572 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.573 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.573 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.573 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.573 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.573 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.573 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.573 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.573 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T00:35:42.883458+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.573 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:05.574 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:22:25.574 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:22:25.936 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:22:25.949 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-12T01:22:25.954 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":1670,"stamp":"2024-09-12T01:22:25.157694+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75758925,"num_objects":722,"num_object_clones":0,"num_object_copies":1444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":722,"num_whiteouts":0,"num_read":179342,"num_read_kb":2456104,"num_write":142298,"num_write_kb":2416867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":553508,"num_omap_keys":1325,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13773,"ondisk_log_size":13773,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1419544,"kb_used_data":174808,"kb_used_omap":12,"kb_used_meta":1244595,"kb_avail":753555176,"statfs":{"total":773094113280,"available":771640500224,"internally_reserved":0,"allocated":179003392,"data_stored":165560350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1274465840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":519675,"num_omap_keys":1192,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008960"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:43.558042+0000","last_change":"2024-09-12T01:03:40.585433+0000","last_active":"2024-09-12T01:18:43.558042+0000","last_peered":"2024-09-12T01:18:43.558042+0000","last_clean":"2024-09-12T01:18:43.558042+0000","last_became_active":"2024-09-12T01:03:40.584744+0000","last_became_peered":"2024-09-12T01:03:40.584744+0000","last_unstale":"2024-09-12T01:18:43.558042+0000","last_undegraded":"2024-09-12T01:18:43.558042+0000","last_fullsized":"2024-09-12T01:18:43.558042+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:08.339816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.544106+0000","last_change":"2024-09-12T00:52:40.345897+0000","last_active":"2024-09-12T01:17:43.544106+0000","last_peered":"2024-09-12T01:17:43.544106+0000","last_clean":"2024-09-12T01:17:43.544106+0000","last_became_active":"2024-09-12T00:52:40.345120+0000","last_became_peered":"2024-09-12T00:52:40.345120+0000","last_unstale":"2024-09-12T01:17:43.544106+0000","last_undegraded":"2024-09-12T01:17:43.544106+0000","last_fullsized":"2024-09-12T01:17:43.544106+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:08.139060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"265'3","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:08.606428+0000","last_change":"2024-09-12T00:52:37.282365+0000","last_active":"2024-09-12T01:20:08.606428+0000","last_peered":"2024-09-12T01:20:08.606428+0000","last_clean":"2024-09-12T01:20:08.606428+0000","last_became_active":"2024-09-12T00:52:37.276676+0000","last_became_peered":"2024-09-12T00:52:37.276676+0000","last_unstale":"2024-09-12T01:20:08.606428+0000","last_undegraded":"2024-09-12T01:20:08.606428+0000","last_fullsized":"2024-09-12T01:20:08.606428+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:49.462408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'38","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:18.589631+0000","last_change":"2024-09-12T00:51:04.999562+0000","last_active":"2024-09-12T01:20:18.589631+0000","last_peered":"2024-09-12T01:20:18.589631+0000","last_clean":"2024-09-12T01:20:18.589631+0000","last_became_active":"2024-09-12T00:51:04.998763+0000","last_became_peered":"2024-09-12T00:51:04.998763+0000","last_unstale":"2024-09-12T01:20:18.589631+0000","last_undegraded":"2024-09-12T01:20:18.589631+0000","last_fullsized":"2024-09-12T01:20:18.589631+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":142,"num_write":56,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:40.559635+0000","last_change":"2024-09-12T01:03:40.582702+0000","last_active":"2024-09-12T01:18:40.559635+0000","last_peered":"2024-09-12T01:18:40.559635+0000","last_clean":"2024-09-12T01:18:40.559635+0000","last_became_active":"2024-09-12T01:03:40.581266+0000","last_became_peered":"2024-09-12T01:03:40.581266+0000","last_unstale":"2024-09-12T01:18:40.559635+0000","last_undegraded":"2024-09-12T01:18:40.559635+0000","last_fullsized":"2024-09-12T01:18:40.559635+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:25.009896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"265'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:12.564921+0000","last_change":"2024-09-12T00:52:40.345386+0000","last_active":"2024-09-12T01:20:12.564921+0000","last_peered":"2024-09-12T01:20:12.564921+0000","last_clean":"2024-09-12T01:20:12.564921+0000","last_became_active":"2024-09-12T00:52:40.344674+0000","last_became_peered":"2024-09-12T00:52:40.344674+0000","last_unstale":"2024-09-12T01:20:12.564921+0000","last_undegraded":"2024-09-12T01:20:12.564921+0000","last_fullsized":"2024-09-12T01:20:12.564921+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:43.041640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":10,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'6","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:08.589427+0000","last_change":"2024-09-12T00:52:37.295217+0000","last_active":"2024-09-12T01:20:08.589427+0000","last_peered":"2024-09-12T01:20:08.589427+0000","last_clean":"2024-09-12T01:20:08.589427+0000","last_became_active":"2024-09-12T00:52:37.294438+0000","last_became_peered":"2024-09-12T00:52:37.294438+0000","last_unstale":"2024-09-12T01:20:08.589427+0000","last_undegraded":"2024-09-12T01:20:08.589427+0000","last_fullsized":"2024-09-12T01:20:08.589427+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:53.566890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'42","reported_seq":164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:10.566329+0000","last_change":"2024-09-12T00:51:04.962325+0000","last_active":"2024-09-12T01:19:10.566329+0000","last_peered":"2024-09-12T01:19:10.566329+0000","last_clean":"2024-09-12T01:19:10.566329+0000","last_became_active":"2024-09-12T00:51:04.961677+0000","last_became_peered":"2024-09-12T00:51:04.961677+0000","last_unstale":"2024-09-12T01:19:10.566329+0000","last_undegraded":"2024-09-12T01:19:10.566329+0000","last_fullsized":"2024-09-12T01:19:10.566329+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:51.606282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":168,"num_write":72,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:12.545131+0000","last_change":"2024-09-12T01:03:40.577634+0000","last_active":"2024-09-12T01:18:12.545131+0000","last_peered":"2024-09-12T01:18:12.545131+0000","last_clean":"2024-09-12T01:18:12.545131+0000","last_became_active":"2024-09-12T01:03:40.576550+0000","last_became_peered":"2024-09-12T01:03:40.576550+0000","last_unstale":"2024-09-12T01:18:12.545131+0000","last_undegraded":"2024-09-12T01:18:12.545131+0000","last_fullsized":"2024-09-12T01:18:12.545131+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:55.304251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"265'5","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:53.609270+0000","last_change":"2024-09-12T00:52:40.341193+0000","last_active":"2024-09-12T01:21:53.609270+0000","last_peered":"2024-09-12T01:21:53.609270+0000","last_clean":"2024-09-12T01:21:53.609270+0000","last_became_active":"2024-09-12T00:52:40.337945+0000","last_became_peered":"2024-09-12T00:52:40.337945+0000","last_unstale":"2024-09-12T01:21:53.609270+0000","last_undegraded":"2024-09-12T01:21:53.609270+0000","last_fullsized":"2024-09-12T01:21:53.609270+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:20.078369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:45.560948+0000","last_change":"2024-09-12T00:52:37.297111+0000","last_active":"2024-09-12T01:18:45.560948+0000","last_peered":"2024-09-12T01:18:45.560948+0000","last_clean":"2024-09-12T01:18:45.560948+0000","last_became_active":"2024-09-12T00:52:37.296335+0000","last_became_peered":"2024-09-12T00:52:37.296335+0000","last_unstale":"2024-09-12T01:18:45.560948+0000","last_undegraded":"2024-09-12T01:18:45.560948+0000","last_fullsized":"2024-09-12T01:18:45.560948+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:01.174517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'30","reported_seq":128,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.564783+0000","last_change":"2024-09-12T00:51:04.997842+0000","last_active":"2024-09-12T01:18:38.564783+0000","last_peered":"2024-09-12T01:18:38.564783+0000","last_clean":"2024-09-12T01:18:38.564783+0000","last_became_active":"2024-09-12T00:51:04.992519+0000","last_became_peered":"2024-09-12T00:51:04.992519+0000","last_unstale":"2024-09-12T01:18:38.564783+0000","last_undegraded":"2024-09-12T01:18:38.564783+0000","last_fullsized":"2024-09-12T01:18:38.564783+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:13.960445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":105,"num_write":58,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.579674+0000","last_change":"2024-09-12T01:03:40.587244+0000","last_active":"2024-09-12T01:18:18.579674+0000","last_peered":"2024-09-12T01:18:18.579674+0000","last_clean":"2024-09-12T01:18:18.579674+0000","last_became_active":"2024-09-12T01:03:40.586582+0000","last_became_peered":"2024-09-12T01:03:40.586582+0000","last_unstale":"2024-09-12T01:18:18.579674+0000","last_undegraded":"2024-09-12T01:18:18.579674+0000","last_fullsized":"2024-09-12T01:18:18.579674+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:46.195286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'5","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.135882+0000","last_change":"2024-09-12T00:53:18.616189+0000","last_active":"2024-09-12T01:21:57.135882+0000","last_peered":"2024-09-12T01:21:57.135882+0000","last_clean":"2024-09-12T01:21:57.135882+0000","last_became_active":"2024-09-12T00:53:18.615877+0000","last_became_peered":"2024-09-12T00:53:18.615877+0000","last_unstale":"2024-09-12T01:21:57.135882+0000","last_undegraded":"2024-09-12T01:21:57.135882+0000","last_fullsized":"2024-09-12T01:21:57.135882+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:35.115620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6184,"num_write":5,"num_write_kb":6184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:42.558460+0000","last_change":"2024-09-12T00:52:37.277359+0000","last_active":"2024-09-12T01:19:42.558460+0000","last_peered":"2024-09-12T01:19:42.558460+0000","last_clean":"2024-09-12T01:19:42.558460+0000","last_became_active":"2024-09-12T00:52:37.270357+0000","last_became_peered":"2024-09-12T00:52:37.270357+0000","last_unstale":"2024-09-12T01:19:42.558460+0000","last_undegraded":"2024-09-12T01:19:42.558460+0000","last_fullsized":"2024-09-12T01:19:42.558460+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:03.048579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'29","reported_seq":125,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.585016+0000","last_change":"2024-09-12T00:51:04.995220+0000","last_active":"2024-09-12T01:18:38.585016+0000","last_peered":"2024-09-12T01:18:38.585016+0000","last_clean":"2024-09-12T01:18:38.585016+0000","last_became_active":"2024-09-12T00:51:04.994459+0000","last_became_peered":"2024-09-12T00:51:04.994459+0000","last_unstale":"2024-09-12T01:18:38.585016+0000","last_undegraded":"2024-09-12T01:18:38.585016+0000","last_fullsized":"2024-09-12T01:18:38.585016+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:32.327605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":61,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.601539+0000","last_change":"2024-09-12T01:03:40.594312+0000","last_active":"2024-09-12T01:19:48.601539+0000","last_peered":"2024-09-12T01:19:48.601539+0000","last_clean":"2024-09-12T01:19:48.601539+0000","last_became_active":"2024-09-12T01:03:40.593614+0000","last_became_peered":"2024-09-12T01:03:40.593614+0000","last_unstale":"2024-09-12T01:19:48.601539+0000","last_undegraded":"2024-09-12T01:19:48.601539+0000","last_fullsized":"2024-09-12T01:19:48.601539+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:51.667787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"265'6","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:53.402527+0000","last_change":"2024-09-12T00:52:40.358057+0000","last_active":"2024-09-12T01:21:53.402527+0000","last_peered":"2024-09-12T01:21:53.402527+0000","last_clean":"2024-09-12T01:21:53.402527+0000","last_became_active":"2024-09-12T00:52:40.356507+0000","last_became_peered":"2024-09-12T00:52:40.356507+0000","last_unstale":"2024-09-12T01:21:53.402527+0000","last_undegraded":"2024-09-12T01:21:53.402527+0000","last_fullsized":"2024-09-12T01:21:53.402527+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:07.353171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":17408,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:13.572946+0000","last_change":"2024-09-12T00:52:37.293774+0000","last_active":"2024-09-12T01:19:13.572946+0000","last_peered":"2024-09-12T01:19:13.572946+0000","last_clean":"2024-09-12T01:19:13.572946+0000","last_became_active":"2024-09-12T00:52:37.293298+0000","last_became_peered":"2024-09-12T00:52:37.293298+0000","last_unstale":"2024-09-12T01:19:13.572946+0000","last_undegraded":"2024-09-12T01:19:13.572946+0000","last_fullsized":"2024-09-12T01:19:13.572946+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:24.891123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"262'30","reported_seq":137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.584909+0000","last_change":"2024-09-12T00:51:04.996662+0000","last_active":"2024-09-12T01:18:38.584909+0000","last_peered":"2024-09-12T01:18:38.584909+0000","last_clean":"2024-09-12T01:18:38.584909+0000","last_became_active":"2024-09-12T00:51:04.995863+0000","last_became_peered":"2024-09-12T00:51:04.995863+0000","last_unstale":"2024-09-12T01:18:38.584909+0000","last_undegraded":"2024-09-12T01:18:38.584909+0000","last_fullsized":"2024-09-12T01:18:38.584909+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:04.557157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":123,"num_write":48,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.561295+0000","last_change":"2024-09-12T01:03:40.576503+0000","last_active":"2024-09-12T01:18:18.561295+0000","last_peered":"2024-09-12T01:18:18.561295+0000","last_clean":"2024-09-12T01:18:18.561295+0000","last_became_active":"2024-09-12T01:03:40.575481+0000","last_became_peered":"2024-09-12T01:03:40.575481+0000","last_unstale":"2024-09-12T01:18:18.561295+0000","last_undegraded":"2024-09-12T01:18:18.561295+0000","last_fullsized":"2024-09-12T01:18:18.561295+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:48.119658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:17.559249+0000","last_change":"2024-09-12T00:52:40.350599+0000","last_active":"2024-09-12T01:19:17.559249+0000","last_peered":"2024-09-12T01:19:17.559249+0000","last_clean":"2024-09-12T01:19:17.559249+0000","last_became_active":"2024-09-12T00:52:40.349826+0000","last_became_peered":"2024-09-12T00:52:40.349826+0000","last_unstale":"2024-09-12T01:19:17.559249+0000","last_undegraded":"2024-09-12T01:19:17.559249+0000","last_fullsized":"2024-09-12T01:19:17.559249+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:49.311099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"265'18","reported_seq":86,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.980038+0000","last_change":"2024-09-12T00:52:37.284934+0000","last_active":"2024-09-12T01:21:56.980038+0000","last_peered":"2024-09-12T01:21:56.980038+0000","last_clean":"2024-09-12T01:21:56.980038+0000","last_became_active":"2024-09-12T00:52:37.283600+0000","last_became_peered":"2024-09-12T00:52:37.283600+0000","last_unstale":"2024-09-12T01:21:56.980038+0000","last_undegraded":"2024-09-12T01:21:56.980038+0000","last_fullsized":"2024-09-12T01:21:56.980038+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:50.299864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":56328,"num_write":28,"num_write_kb":20484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"265'59","reported_seq":206,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:37.551106+0000","last_change":"2024-09-12T00:51:04.983051+0000","last_active":"2024-09-12T01:18:37.551106+0000","last_peered":"2024-09-12T01:18:37.551106+0000","last_clean":"2024-09-12T01:18:37.551106+0000","last_became_active":"2024-09-12T00:51:04.982228+0000","last_became_peered":"2024-09-12T00:51:04.982228+0000","last_unstale":"2024-09-12T01:18:37.551106+0000","last_undegraded":"2024-09-12T01:18:37.551106+0000","last_fullsized":"2024-09-12T01:18:37.551106+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:07.565984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":210,"num_write":106,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.785889+0000","last_change":"2024-09-12T01:03:40.569067+0000","last_active":"2024-09-12T01:18:42.785889+0000","last_peered":"2024-09-12T01:18:42.785889+0000","last_clean":"2024-09-12T01:18:42.785889+0000","last_became_active":"2024-09-12T01:03:40.568346+0000","last_became_peered":"2024-09-12T01:03:40.568346+0000","last_unstale":"2024-09-12T01:18:42.785889+0000","last_undegraded":"2024-09-12T01:18:42.785889+0000","last_fullsized":"2024-09-12T01:18:42.785889+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:12.448021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"265'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:12.570529+0000","last_change":"2024-09-12T00:52:40.340425+0000","last_active":"2024-09-12T01:20:12.570529+0000","last_peered":"2024-09-12T01:20:12.570529+0000","last_clean":"2024-09-12T01:20:12.570529+0000","last_became_active":"2024-09-12T00:52:40.339627+0000","last_became_peered":"2024-09-12T00:52:40.339627+0000","last_unstale":"2024-09-12T01:20:12.570529+0000","last_undegraded":"2024-09-12T01:20:12.570529+0000","last_fullsized":"2024-09-12T01:20:12.570529+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:05.869695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"262'3","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:37.730433+0000","last_change":"2024-09-12T00:52:37.283996+0000","last_active":"2024-09-12T01:17:37.730433+0000","last_peered":"2024-09-12T01:17:37.730433+0000","last_clean":"2024-09-12T01:17:37.730433+0000","last_became_active":"2024-09-12T00:52:37.283199+0000","last_became_peered":"2024-09-12T00:52:37.283199+0000","last_unstale":"2024-09-12T01:17:37.730433+0000","last_undegraded":"2024-09-12T01:17:37.730433+0000","last_fullsized":"2024-09-12T01:17:37.730433+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:03.588195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"265'5","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.689244+0000","last_change":"2024-09-12T00:51:04.988358+0000","last_active":"2024-09-12T01:19:18.689244+0000","last_peered":"2024-09-12T01:19:18.689244+0000","last_clean":"2024-09-12T01:19:18.689244+0000","last_became_active":"2024-09-12T00:51:04.981675+0000","last_became_peered":"2024-09-12T00:51:04.981675+0000","last_unstale":"2024-09-12T01:19:18.689244+0000","last_undegraded":"2024-09-12T01:19:18.689244+0000","last_fullsized":"2024-09-12T01:19:18.689244+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:29.580737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.785967+0000","last_change":"2024-09-12T01:03:40.577284+0000","last_active":"2024-09-12T01:18:42.785967+0000","last_peered":"2024-09-12T01:18:42.785967+0000","last_clean":"2024-09-12T01:18:42.785967+0000","last_became_active":"2024-09-12T01:03:40.576430+0000","last_became_peered":"2024-09-12T01:03:40.576430+0000","last_unstale":"2024-09-12T01:18:42.785967+0000","last_undegraded":"2024-09-12T01:18:42.785967+0000","last_fullsized":"2024-09-12T01:18:42.785967+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:37.105480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:13.607494+0000","last_change":"2024-09-12T00:52:40.346703+0000","last_active":"2024-09-12T01:20:13.607494+0000","last_peered":"2024-09-12T01:20:13.607494+0000","last_clean":"2024-09-12T01:20:13.607494+0000","last_became_active":"2024-09-12T00:52:40.345995+0000","last_became_peered":"2024-09-12T00:52:40.345995+0000","last_unstale":"2024-09-12T01:20:13.607494+0000","last_undegraded":"2024-09-12T01:20:13.607494+0000","last_fullsized":"2024-09-12T01:20:13.607494+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:53.845660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'2","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:08.587182+0000","last_change":"2024-09-12T00:52:37.300110+0000","last_active":"2024-09-12T01:20:08.587182+0000","last_peered":"2024-09-12T01:20:08.587182+0000","last_clean":"2024-09-12T01:20:08.587182+0000","last_became_active":"2024-09-12T00:52:37.299604+0000","last_became_peered":"2024-09-12T00:52:37.299604+0000","last_unstale":"2024-09-12T01:20:08.587182+0000","last_undegraded":"2024-09-12T01:20:08.587182+0000","last_fullsized":"2024-09-12T01:20:08.587182+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:04.899567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'41","reported_seq":157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.553749+0000","last_change":"2024-09-12T00:51:04.969892+0000","last_active":"2024-09-12T01:17:43.553749+0000","last_peered":"2024-09-12T01:17:43.553749+0000","last_clean":"2024-09-12T01:17:43.553749+0000","last_became_active":"2024-09-12T00:51:04.968673+0000","last_became_peered":"2024-09-12T00:51:04.968673+0000","last_unstale":"2024-09-12T01:17:43.553749+0000","last_undegraded":"2024-09-12T01:17:43.553749+0000","last_fullsized":"2024-09-12T01:17:43.553749+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:09.083642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":145,"num_write":79,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:03.588190+0000","last_change":"2024-09-12T01:03:40.591077+0000","last_active":"2024-09-12T01:20:03.588190+0000","last_peered":"2024-09-12T01:20:03.588190+0000","last_clean":"2024-09-12T01:20:03.588190+0000","last_became_active":"2024-09-12T01:03:40.590440+0000","last_became_peered":"2024-09-12T01:03:40.590440+0000","last_unstale":"2024-09-12T01:20:03.588190+0000","last_undegraded":"2024-09-12T01:20:03.588190+0000","last_fullsized":"2024-09-12T01:20:03.588190+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.594467+0000","last_change":"2024-09-12T00:52:40.363386+0000","last_active":"2024-09-12T01:19:18.594467+0000","last_peered":"2024-09-12T01:19:18.594467+0000","last_clean":"2024-09-12T01:19:18.594467+0000","last_became_active":"2024-09-12T00:52:40.359069+0000","last_became_peered":"2024-09-12T00:52:40.359069+0000","last_unstale":"2024-09-12T01:19:18.594467+0000","last_undegraded":"2024-09-12T01:19:18.594467+0000","last_fullsized":"2024-09-12T01:19:18.594467+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:47.963386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"262'5","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.553521+0000","last_change":"2024-09-12T00:52:37.274416+0000","last_active":"2024-09-12T01:18:23.553521+0000","last_peered":"2024-09-12T01:18:23.553521+0000","last_clean":"2024-09-12T01:18:23.553521+0000","last_became_active":"2024-09-12T00:52:37.273684+0000","last_became_peered":"2024-09-12T00:52:37.273684+0000","last_unstale":"2024-09-12T01:18:23.553521+0000","last_undegraded":"2024-09-12T01:18:23.553521+0000","last_fullsized":"2024-09-12T01:18:23.553521+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:25.538379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":25602,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'50","reported_seq":182,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.551251+0000","last_change":"2024-09-12T00:51:04.999190+0000","last_active":"2024-09-12T01:17:43.551251+0000","last_peered":"2024-09-12T01:17:43.551251+0000","last_clean":"2024-09-12T01:17:43.551251+0000","last_became_active":"2024-09-12T00:51:04.993887+0000","last_became_peered":"2024-09-12T00:51:04.993887+0000","last_unstale":"2024-09-12T01:17:43.551251+0000","last_undegraded":"2024-09-12T01:17:43.551251+0000","last_fullsized":"2024-09-12T01:17:43.551251+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:49.567739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":256,"num_read_kb":177,"num_write":91,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:00.576916+0000","last_change":"2024-09-12T01:03:40.581951+0000","last_active":"2024-09-12T01:20:00.576916+0000","last_peered":"2024-09-12T01:20:00.576916+0000","last_clean":"2024-09-12T01:20:00.576916+0000","last_became_active":"2024-09-12T01:03:40.580348+0000","last_became_peered":"2024-09-12T01:03:40.580348+0000","last_unstale":"2024-09-12T01:20:00.576916+0000","last_undegraded":"2024-09-12T01:20:00.576916+0000","last_fullsized":"2024-09-12T01:20:00.576916+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"262'8","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:28.582340+0000","last_change":"2024-09-12T00:52:40.366179+0000","last_active":"2024-09-12T01:18:28.582340+0000","last_peered":"2024-09-12T01:18:28.582340+0000","last_clean":"2024-09-12T01:18:28.582340+0000","last_became_active":"2024-09-12T00:52:40.363347+0000","last_became_peered":"2024-09-12T00:52:40.363347+0000","last_unstale":"2024-09-12T01:18:28.582340+0000","last_undegraded":"2024-09-12T01:18:28.582340+0000","last_fullsized":"2024-09-12T01:18:28.582340+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:06.883385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":21506,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:12.793072+0000","last_change":"2024-09-12T00:52:37.288899+0000","last_active":"2024-09-12T01:19:12.793072+0000","last_peered":"2024-09-12T01:19:12.793072+0000","last_clean":"2024-09-12T01:19:12.793072+0000","last_became_active":"2024-09-12T00:52:37.288074+0000","last_became_peered":"2024-09-12T00:52:37.288074+0000","last_unstale":"2024-09-12T01:19:12.793072+0000","last_undegraded":"2024-09-12T01:19:12.793072+0000","last_fullsized":"2024-09-12T01:19:12.793072+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:03.061143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'39","reported_seq":155,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:43.571162+0000","last_change":"2024-09-12T00:51:04.982973+0000","last_active":"2024-09-12T01:17:43.571162+0000","last_peered":"2024-09-12T01:17:43.571162+0000","last_clean":"2024-09-12T01:17:43.571162+0000","last_became_active":"2024-09-12T00:51:04.976345+0000","last_became_peered":"2024-09-12T00:51:04.976345+0000","last_unstale":"2024-09-12T01:17:43.571162+0000","last_undegraded":"2024-09-12T01:17:43.571162+0000","last_fullsized":"2024-09-12T01:17:43.571162+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:17.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":155,"num_write":57,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:02.804336+0000","last_change":"2024-09-12T01:03:40.561539+0000","last_active":"2024-09-12T01:20:02.804336+0000","last_peered":"2024-09-12T01:20:02.804336+0000","last_clean":"2024-09-12T01:20:02.804336+0000","last_became_active":"2024-09-12T01:03:40.560777+0000","last_became_peered":"2024-09-12T01:03:40.560777+0000","last_unstale":"2024-09-12T01:20:02.804336+0000","last_undegraded":"2024-09-12T01:20:02.804336+0000","last_fullsized":"2024-09-12T01:20:02.804336+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"265'3","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:43.411382+0000","last_change":"2024-09-12T00:52:40.353226+0000","last_active":"2024-09-12T01:21:43.411382+0000","last_peered":"2024-09-12T01:21:43.411382+0000","last_clean":"2024-09-12T01:21:43.411382+0000","last_became_active":"2024-09-12T00:52:40.352292+0000","last_became_peered":"2024-09-12T00:52:40.352292+0000","last_unstale":"2024-09-12T01:21:43.411382+0000","last_undegraded":"2024-09-12T01:21:43.411382+0000","last_fullsized":"2024-09-12T01:21:43.411382+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:37.809308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:15.567423+0000","last_change":"2024-09-12T00:52:37.286387+0000","last_active":"2024-09-12T01:19:15.567423+0000","last_peered":"2024-09-12T01:19:15.567423+0000","last_clean":"2024-09-12T01:19:15.567423+0000","last_became_active":"2024-09-12T00:52:37.284325+0000","last_became_peered":"2024-09-12T00:52:37.284325+0000","last_unstale":"2024-09-12T01:19:15.567423+0000","last_undegraded":"2024-09-12T01:19:15.567423+0000","last_fullsized":"2024-09-12T01:19:15.567423+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:25.766191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'20","reported_seq":109,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.383347+0000","last_change":"2024-09-12T01:22:17.383347+0000","last_active":"2024-09-12T01:22:17.383347+0000","last_peered":"2024-09-12T01:22:17.383347+0000","last_clean":"2024-09-12T01:22:17.383347+0000","last_became_active":"2024-09-12T00:51:04.961563+0000","last_became_peered":"2024-09-12T00:51:04.961563+0000","last_unstale":"2024-09-12T01:22:17.383347+0000","last_undegraded":"2024-09-12T01:22:17.383347+0000","last_fullsized":"2024-09-12T01:22:17.383347+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'20","last_scrub_stamp":"2024-09-12T01:22:17.383043+0000","last_deep_scrub":"265'20","last_deep_scrub_stamp":"2024-09-12T01:22:17.383043+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.383043+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:52.621490+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":68,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:03.576415+0000","last_change":"2024-09-12T01:03:40.580752+0000","last_active":"2024-09-12T01:20:03.576415+0000","last_peered":"2024-09-12T01:20:03.576415+0000","last_clean":"2024-09-12T01:20:03.576415+0000","last_became_active":"2024-09-12T01:03:40.580083+0000","last_became_peered":"2024-09-12T01:03:40.580083+0000","last_unstale":"2024-09-12T01:20:03.576415+0000","last_undegraded":"2024-09-12T01:20:03.576415+0000","last_fullsized":"2024-09-12T01:20:03.576415+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'5","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:42.585420+0000","last_change":"2024-09-12T00:52:40.344308+0000","last_active":"2024-09-12T01:21:42.585420+0000","last_peered":"2024-09-12T01:21:42.585420+0000","last_clean":"2024-09-12T01:21:42.585420+0000","last_became_active":"2024-09-12T00:52:40.336368+0000","last_became_peered":"2024-09-12T00:52:40.336368+0000","last_unstale":"2024-09-12T01:21:42.585420+0000","last_undegraded":"2024-09-12T01:21:42.585420+0000","last_fullsized":"2024-09-12T01:21:42.585420+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:44.066859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:13.573252+0000","last_change":"2024-09-12T00:52:37.299654+0000","last_active":"2024-09-12T01:19:13.573252+0000","last_peered":"2024-09-12T01:19:13.573252+0000","last_clean":"2024-09-12T01:19:13.573252+0000","last_became_active":"2024-09-12T00:52:37.295945+0000","last_became_peered":"2024-09-12T00:52:37.295945+0000","last_unstale":"2024-09-12T01:19:13.573252+0000","last_undegraded":"2024-09-12T01:19:13.573252+0000","last_fullsized":"2024-09-12T01:19:13.573252+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:17.464675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"265'27","reported_seq":124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.791931+0000","last_change":"2024-09-12T00:51:04.976524+0000","last_active":"2024-09-12T01:19:07.791931+0000","last_peered":"2024-09-12T01:19:07.791931+0000","last_clean":"2024-09-12T01:19:07.791931+0000","last_became_active":"2024-09-12T00:51:04.975831+0000","last_became_peered":"2024-09-12T00:51:04.975831+0000","last_unstale":"2024-09-12T01:19:07.791931+0000","last_undegraded":"2024-09-12T01:19:07.791931+0000","last_fullsized":"2024-09-12T01:19:07.791931+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:24.928244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":101,"num_write":53,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.578542+0000","last_change":"2024-09-12T01:03:40.580652+0000","last_active":"2024-09-12T01:18:13.578542+0000","last_peered":"2024-09-12T01:18:13.578542+0000","last_clean":"2024-09-12T01:18:13.578542+0000","last_became_active":"2024-09-12T01:03:40.579923+0000","last_became_peered":"2024-09-12T01:03:40.579923+0000","last_unstale":"2024-09-12T01:18:13.578542+0000","last_undegraded":"2024-09-12T01:18:13.578542+0000","last_fullsized":"2024-09-12T01:18:13.578542+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:55.542873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.562207+0000","last_change":"2024-09-12T00:52:40.350130+0000","last_active":"2024-09-12T01:18:23.562207+0000","last_peered":"2024-09-12T01:18:23.562207+0000","last_clean":"2024-09-12T01:18:23.562207+0000","last_became_active":"2024-09-12T00:52:40.349363+0000","last_became_peered":"2024-09-12T00:52:40.349363+0000","last_unstale":"2024-09-12T01:18:23.562207+0000","last_undegraded":"2024-09-12T01:18:23.562207+0000","last_fullsized":"2024-09-12T01:18:23.562207+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:18.586220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.739114+0000","last_change":"2024-09-12T00:52:37.278835+0000","last_active":"2024-09-12T01:18:17.739114+0000","last_peered":"2024-09-12T01:18:17.739114+0000","last_clean":"2024-09-12T01:18:17.739114+0000","last_became_active":"2024-09-12T00:52:37.270958+0000","last_became_peered":"2024-09-12T00:52:37.270958+0000","last_unstale":"2024-09-12T01:18:17.739114+0000","last_undegraded":"2024-09-12T01:18:17.739114+0000","last_fullsized":"2024-09-12T01:18:17.739114+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:49.398281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'19","reported_seq":96,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.791884+0000","last_change":"2024-09-12T00:51:04.976492+0000","last_active":"2024-09-12T01:19:07.791884+0000","last_peered":"2024-09-12T01:19:07.791884+0000","last_clean":"2024-09-12T01:19:07.791884+0000","last_became_active":"2024-09-12T00:51:04.975763+0000","last_became_peered":"2024-09-12T00:51:04.975763+0000","last_unstale":"2024-09-12T01:19:07.791884+0000","last_undegraded":"2024-09-12T01:19:07.791884+0000","last_fullsized":"2024-09-12T01:19:07.791884+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:51.238336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.558357+0000","last_change":"2024-09-12T01:03:40.586341+0000","last_active":"2024-09-12T01:18:13.558357+0000","last_peered":"2024-09-12T01:18:13.558357+0000","last_clean":"2024-09-12T01:18:13.558357+0000","last_became_active":"2024-09-12T01:03:40.581062+0000","last_became_peered":"2024-09-12T01:03:40.581062+0000","last_unstale":"2024-09-12T01:18:13.558357+0000","last_undegraded":"2024-09-12T01:18:13.558357+0000","last_fullsized":"2024-09-12T01:18:13.558357+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:40.147480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'10","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.659887+0000","last_change":"2024-09-12T00:52:40.344506+0000","last_active":"2024-09-12T01:21:57.659887+0000","last_peered":"2024-09-12T01:21:57.659887+0000","last_clean":"2024-09-12T01:21:57.659887+0000","last_became_active":"2024-09-12T00:52:40.343871+0000","last_became_peered":"2024-09-12T00:52:40.343871+0000","last_unstale":"2024-09-12T01:21:57.659887+0000","last_undegraded":"2024-09-12T01:21:57.659887+0000","last_fullsized":"2024-09-12T01:21:57.659887+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:04.586939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":22610,"num_write":15,"num_write_kb":6184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.579601+0000","last_change":"2024-09-12T00:52:37.281395+0000","last_active":"2024-09-12T01:18:18.579601+0000","last_peered":"2024-09-12T01:18:18.579601+0000","last_clean":"2024-09-12T01:18:18.579601+0000","last_became_active":"2024-09-12T00:52:37.276237+0000","last_became_peered":"2024-09-12T00:52:37.276237+0000","last_unstale":"2024-09-12T01:18:18.579601+0000","last_undegraded":"2024-09-12T01:18:18.579601+0000","last_fullsized":"2024-09-12T01:18:18.579601+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:50.583225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'15","reported_seq":87,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.571778+0000","last_change":"2024-09-12T00:51:04.995560+0000","last_active":"2024-09-12T01:19:08.571778+0000","last_peered":"2024-09-12T01:19:08.571778+0000","last_clean":"2024-09-12T01:19:08.571778+0000","last_became_active":"2024-09-12T00:51:04.994606+0000","last_became_peered":"2024-09-12T00:51:04.994606+0000","last_unstale":"2024-09-12T01:19:08.571778+0000","last_undegraded":"2024-09-12T01:19:08.571778+0000","last_fullsized":"2024-09-12T01:19:08.571778+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:54.892667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:48.552306+0000","last_change":"2024-09-12T01:03:40.582311+0000","last_active":"2024-09-12T01:17:48.552306+0000","last_peered":"2024-09-12T01:17:48.552306+0000","last_clean":"2024-09-12T01:17:48.552306+0000","last_became_active":"2024-09-12T01:03:40.581586+0000","last_became_peered":"2024-09-12T01:03:40.581586+0000","last_unstale":"2024-09-12T01:17:48.552306+0000","last_undegraded":"2024-09-12T01:17:48.552306+0000","last_fullsized":"2024-09-12T01:17:48.552306+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:01.950258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'7","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:43.398671+0000","last_change":"2024-09-12T00:52:40.366365+0000","last_active":"2024-09-12T01:20:43.398671+0000","last_peered":"2024-09-12T01:20:43.398671+0000","last_clean":"2024-09-12T01:20:43.398671+0000","last_became_active":"2024-09-12T00:52:40.363072+0000","last_became_peered":"2024-09-12T00:52:40.363072+0000","last_unstale":"2024-09-12T01:20:43.398671+0000","last_undegraded":"2024-09-12T01:20:43.398671+0000","last_fullsized":"2024-09-12T01:20:43.398671+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:34.771598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9232,"num_write":7,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.546176+0000","last_change":"2024-09-12T00:52:37.291760+0000","last_active":"2024-09-12T01:18:17.546176+0000","last_peered":"2024-09-12T01:18:17.546176+0000","last_clean":"2024-09-12T01:18:17.546176+0000","last_became_active":"2024-09-12T00:52:37.291045+0000","last_became_peered":"2024-09-12T00:52:37.291045+0000","last_unstale":"2024-09-12T01:18:17.546176+0000","last_undegraded":"2024-09-12T01:18:17.546176+0000","last_fullsized":"2024-09-12T01:18:17.546176+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:59.783464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'47","reported_seq":178,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.750363+0000","last_change":"2024-09-12T00:51:04.981572+0000","last_active":"2024-09-12T01:19:07.750363+0000","last_peered":"2024-09-12T01:19:07.750363+0000","last_clean":"2024-09-12T01:19:07.750363+0000","last_became_active":"2024-09-12T00:51:04.980601+0000","last_became_peered":"2024-09-12T00:51:04.980601+0000","last_unstale":"2024-09-12T01:19:07.750363+0000","last_undegraded":"2024-09-12T01:19:07.750363+0000","last_fullsized":"2024-09-12T01:19:07.750363+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:04.644563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":177,"num_write":81,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.578495+0000","last_change":"2024-09-12T01:03:40.580511+0000","last_active":"2024-09-12T01:18:13.578495+0000","last_peered":"2024-09-12T01:18:13.578495+0000","last_clean":"2024-09-12T01:18:13.578495+0000","last_became_active":"2024-09-12T01:03:40.579772+0000","last_became_peered":"2024-09-12T01:03:40.579772+0000","last_unstale":"2024-09-12T01:18:13.578495+0000","last_undegraded":"2024-09-12T01:18:13.578495+0000","last_fullsized":"2024-09-12T01:18:13.578495+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:33.962377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'3","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:42.383530+0000","last_change":"2024-09-12T00:52:40.347889+0000","last_active":"2024-09-12T01:20:42.383530+0000","last_peered":"2024-09-12T01:20:42.383530+0000","last_clean":"2024-09-12T01:20:42.383530+0000","last_became_active":"2024-09-12T00:52:40.347156+0000","last_became_peered":"2024-09-12T00:52:40.347156+0000","last_unstale":"2024-09-12T01:20:42.383530+0000","last_undegraded":"2024-09-12T01:20:42.383530+0000","last_fullsized":"2024-09-12T01:20:42.383530+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:29.288092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.552252+0000","last_change":"2024-09-12T00:52:37.291590+0000","last_active":"2024-09-12T01:18:18.552252+0000","last_peered":"2024-09-12T01:18:18.552252+0000","last_clean":"2024-09-12T01:18:18.552252+0000","last_became_active":"2024-09-12T00:52:37.290858+0000","last_became_peered":"2024-09-12T00:52:37.290858+0000","last_unstale":"2024-09-12T01:18:18.552252+0000","last_undegraded":"2024-09-12T01:18:18.552252+0000","last_fullsized":"2024-09-12T01:18:18.552252+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:11.150903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'11","reported_seq":79,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.591802+0000","last_change":"2024-09-12T00:51:04.989507+0000","last_active":"2024-09-12T01:19:08.591802+0000","last_peered":"2024-09-12T01:19:08.591802+0000","last_clean":"2024-09-12T01:19:08.591802+0000","last_became_active":"2024-09-12T00:51:04.988521+0000","last_became_peered":"2024-09-12T00:51:04.988521+0000","last_unstale":"2024-09-12T01:19:08.591802+0000","last_undegraded":"2024-09-12T01:19:08.591802+0000","last_fullsized":"2024-09-12T01:19:08.591802+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:52.795091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:55.563144+0000","last_change":"2024-09-12T01:03:40.592444+0000","last_active":"2024-09-12T01:18:55.563144+0000","last_peered":"2024-09-12T01:18:55.563144+0000","last_clean":"2024-09-12T01:18:55.563144+0000","last_became_active":"2024-09-12T01:03:40.591869+0000","last_became_peered":"2024-09-12T01:03:40.591869+0000","last_unstale":"2024-09-12T01:18:55.563144+0000","last_undegraded":"2024-09-12T01:18:55.563144+0000","last_fullsized":"2024-09-12T01:18:55.563144+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:13.806273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.600454+0000","last_change":"2024-09-12T00:52:40.345399+0000","last_active":"2024-09-12T01:19:43.600454+0000","last_peered":"2024-09-12T01:19:43.600454+0000","last_clean":"2024-09-12T01:19:43.600454+0000","last_became_active":"2024-09-12T00:52:40.344566+0000","last_became_peered":"2024-09-12T00:52:40.344566+0000","last_unstale":"2024-09-12T01:19:43.600454+0000","last_undegraded":"2024-09-12T01:19:43.600454+0000","last_fullsized":"2024-09-12T01:19:43.600454+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:08.365603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.799024+0000","last_change":"2024-09-12T00:52:37.289694+0000","last_active":"2024-09-12T01:19:37.799024+0000","last_peered":"2024-09-12T01:19:37.799024+0000","last_clean":"2024-09-12T01:19:37.799024+0000","last_became_active":"2024-09-12T00:52:37.282987+0000","last_became_peered":"2024-09-12T00:52:37.282987+0000","last_unstale":"2024-09-12T01:19:37.799024+0000","last_undegraded":"2024-09-12T01:19:37.799024+0000","last_fullsized":"2024-09-12T01:19:37.799024+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:53.081978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'40","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.578586+0000","last_change":"2024-09-12T00:51:05.001750+0000","last_active":"2024-09-12T01:18:13.578586+0000","last_peered":"2024-09-12T01:18:13.578586+0000","last_clean":"2024-09-12T01:18:13.578586+0000","last_became_active":"2024-09-12T00:51:05.001162+0000","last_became_peered":"2024-09-12T00:51:05.001162+0000","last_unstale":"2024-09-12T01:18:13.578586+0000","last_undegraded":"2024-09-12T01:18:13.578586+0000","last_fullsized":"2024-09-12T01:18:13.578586+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:51.741336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":142,"num_write":73,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:27.796530+0000","last_change":"2024-09-12T01:03:40.558405+0000","last_active":"2024-09-12T01:19:27.796530+0000","last_peered":"2024-09-12T01:19:27.796530+0000","last_clean":"2024-09-12T01:19:27.796530+0000","last_became_active":"2024-09-12T01:03:40.551803+0000","last_became_peered":"2024-09-12T01:03:40.551803+0000","last_unstale":"2024-09-12T01:19:27.796530+0000","last_undegraded":"2024-09-12T01:19:27.796530+0000","last_fullsized":"2024-09-12T01:19:27.796530+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:06.456829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.600404+0000","last_change":"2024-09-12T00:52:40.358765+0000","last_active":"2024-09-12T01:19:43.600404+0000","last_peered":"2024-09-12T01:19:43.600404+0000","last_clean":"2024-09-12T01:19:43.600404+0000","last_became_active":"2024-09-12T00:52:40.354387+0000","last_became_peered":"2024-09-12T00:52:40.354387+0000","last_unstale":"2024-09-12T01:19:43.600404+0000","last_undegraded":"2024-09-12T01:19:43.600404+0000","last_fullsized":"2024-09-12T01:19:43.600404+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:13.780637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:40.572945+0000","last_change":"2024-09-12T00:52:37.285727+0000","last_active":"2024-09-12T01:19:40.572945+0000","last_peered":"2024-09-12T01:19:40.572945+0000","last_clean":"2024-09-12T01:19:40.572945+0000","last_became_active":"2024-09-12T00:52:37.285154+0000","last_became_peered":"2024-09-12T00:52:37.285154+0000","last_unstale":"2024-09-12T01:19:40.572945+0000","last_undegraded":"2024-09-12T01:19:40.572945+0000","last_fullsized":"2024-09-12T01:19:40.572945+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:04.603498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'61","reported_seq":212,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.410803+0000","last_change":"2024-09-12T00:51:04.976377+0000","last_active":"2024-09-12T01:19:18.410803+0000","last_peered":"2024-09-12T01:19:18.410803+0000","last_clean":"2024-09-12T01:19:18.410803+0000","last_became_active":"2024-09-12T00:51:04.975583+0000","last_became_peered":"2024-09-12T00:51:04.975583+0000","last_unstale":"2024-09-12T01:19:18.410803+0000","last_undegraded":"2024-09-12T01:19:18.410803+0000","last_fullsized":"2024-09-12T01:19:18.410803+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:40.033682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":309,"num_read_kb":216,"num_write":105,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:52.554219+0000","last_change":"2024-09-12T01:03:40.570955+0000","last_active":"2024-09-12T01:18:52.554219+0000","last_peered":"2024-09-12T01:18:52.554219+0000","last_clean":"2024-09-12T01:18:52.554219+0000","last_became_active":"2024-09-12T01:03:40.569907+0000","last_became_peered":"2024-09-12T01:03:40.569907+0000","last_unstale":"2024-09-12T01:18:52.554219+0000","last_undegraded":"2024-09-12T01:18:52.554219+0000","last_fullsized":"2024-09-12T01:18:52.554219+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:17.110556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.585136+0000","last_change":"2024-09-12T00:52:40.343485+0000","last_active":"2024-09-12T01:19:48.585136+0000","last_peered":"2024-09-12T01:19:48.585136+0000","last_clean":"2024-09-12T01:19:48.585136+0000","last_became_active":"2024-09-12T00:52:40.342703+0000","last_became_peered":"2024-09-12T00:52:40.342703+0000","last_unstale":"2024-09-12T01:19:48.585136+0000","last_undegraded":"2024-09-12T01:19:48.585136+0000","last_fullsized":"2024-09-12T01:19:48.585136+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"265'6","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:53.609196+0000","last_change":"2024-09-12T00:52:37.292687+0000","last_active":"2024-09-12T01:21:53.609196+0000","last_peered":"2024-09-12T01:21:53.609196+0000","last_clean":"2024-09-12T01:21:53.609196+0000","last_became_active":"2024-09-12T00:52:37.292449+0000","last_became_peered":"2024-09-12T00:52:37.292449+0000","last_unstale":"2024-09-12T01:21:53.609196+0000","last_undegraded":"2024-09-12T01:21:53.609196+0000","last_fullsized":"2024-09-12T01:21:53.609196+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:54.986888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'116","reported_seq":403,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:32.106066+0000","last_change":"2024-09-12T00:51:04.985227+0000","last_active":"2024-09-12T01:18:32.106066+0000","last_peered":"2024-09-12T01:18:32.106066+0000","last_clean":"2024-09-12T01:18:32.106066+0000","last_became_active":"2024-09-12T00:51:04.984495+0000","last_became_peered":"2024-09-12T00:51:04.984495+0000","last_unstale":"2024-09-12T01:18:32.106066+0000","last_undegraded":"2024-09-12T01:18:32.106066+0000","last_fullsized":"2024-09-12T01:18:32.106066+0000","mapping_epoch":252,"log_start":"265'100","ondisk_log_start":"265'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:40.069078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":690,"num_read_kb":506,"num_write":167,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:52.788303+0000","last_change":"2024-09-12T01:03:40.566870+0000","last_active":"2024-09-12T01:18:52.788303+0000","last_peered":"2024-09-12T01:18:52.788303+0000","last_clean":"2024-09-12T01:18:52.788303+0000","last_became_active":"2024-09-12T01:03:40.566107+0000","last_became_peered":"2024-09-12T01:03:40.566107+0000","last_unstale":"2024-09-12T01:18:52.788303+0000","last_undegraded":"2024-09-12T01:18:52.788303+0000","last_fullsized":"2024-09-12T01:18:52.788303+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:23.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.600492+0000","last_change":"2024-09-12T00:52:40.367723+0000","last_active":"2024-09-12T01:19:43.600492+0000","last_peered":"2024-09-12T01:19:43.600492+0000","last_clean":"2024-09-12T01:19:43.600492+0000","last_became_active":"2024-09-12T00:52:40.367188+0000","last_became_peered":"2024-09-12T00:52:40.367188+0000","last_unstale":"2024-09-12T01:19:43.600492+0000","last_undegraded":"2024-09-12T01:19:43.600492+0000","last_fullsized":"2024-09-12T01:19:43.600492+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:21.283584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"265'2","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.355886+0000","last_change":"2024-09-12T00:52:37.289836+0000","last_active":"2024-09-12T01:21:57.355886+0000","last_peered":"2024-09-12T01:21:57.355886+0000","last_clean":"2024-09-12T01:21:57.355886+0000","last_became_active":"2024-09-12T00:52:37.281129+0000","last_became_peered":"2024-09-12T00:52:37.281129+0000","last_unstale":"2024-09-12T01:21:57.355886+0000","last_undegraded":"2024-09-12T01:21:57.355886+0000","last_fullsized":"2024-09-12T01:21:57.355886+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:00.364762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"265'9","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:05.551886+0000","last_change":"2024-09-12T00:51:04.984390+0000","last_active":"2024-09-12T01:18:05.551886+0000","last_peered":"2024-09-12T01:18:05.551886+0000","last_clean":"2024-09-12T01:18:05.551886+0000","last_became_active":"2024-09-12T00:51:04.983577+0000","last_became_peered":"2024-09-12T00:51:04.983577+0000","last_unstale":"2024-09-12T01:18:05.551886+0000","last_undegraded":"2024-09-12T01:18:05.551886+0000","last_fullsized":"2024-09-12T01:18:05.551886+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:11.081544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:28.596883+0000","last_change":"2024-09-12T01:03:40.590449+0000","last_active":"2024-09-12T01:19:28.596883+0000","last_peered":"2024-09-12T01:19:28.596883+0000","last_clean":"2024-09-12T01:19:28.596883+0000","last_became_active":"2024-09-12T01:03:40.589838+0000","last_became_peered":"2024-09-12T01:03:40.589838+0000","last_unstale":"2024-09-12T01:19:28.596883+0000","last_undegraded":"2024-09-12T01:19:28.596883+0000","last_fullsized":"2024-09-12T01:19:28.596883+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:53.282415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.744871+0000","last_change":"2024-09-12T00:52:40.357689+0000","last_active":"2024-09-12T01:18:42.744871+0000","last_peered":"2024-09-12T01:18:42.744871+0000","last_clean":"2024-09-12T01:18:42.744871+0000","last_became_active":"2024-09-12T00:52:40.356802+0000","last_became_peered":"2024-09-12T00:52:40.356802+0000","last_unstale":"2024-09-12T01:18:42.744871+0000","last_undegraded":"2024-09-12T01:18:42.744871+0000","last_fullsized":"2024-09-12T01:18:42.744871+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:51.102558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"265'6","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.947096+0000","last_change":"2024-09-12T00:52:37.294017+0000","last_active":"2024-09-12T01:21:56.947096+0000","last_peered":"2024-09-12T01:21:56.947096+0000","last_clean":"2024-09-12T01:21:56.947096+0000","last_became_active":"2024-09-12T00:52:37.293564+0000","last_became_peered":"2024-09-12T00:52:37.293564+0000","last_unstale":"2024-09-12T01:21:56.947096+0000","last_undegraded":"2024-09-12T01:21:56.947096+0000","last_fullsized":"2024-09-12T01:21:56.947096+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:56.643360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3128,"num_write":6,"num_write_kb":3128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"262'16","reported_seq":93,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:08.556985+0000","last_change":"2024-09-12T00:51:04.990981+0000","last_active":"2024-09-12T01:18:08.556985+0000","last_peered":"2024-09-12T01:18:08.556985+0000","last_clean":"2024-09-12T01:18:08.556985+0000","last_became_active":"2024-09-12T00:51:04.981091+0000","last_became_peered":"2024-09-12T00:51:04.981091+0000","last_unstale":"2024-09-12T01:18:08.556985+0000","last_undegraded":"2024-09-12T01:18:08.556985+0000","last_fullsized":"2024-09-12T01:18:08.556985+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:43.002634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:27.796717+0000","last_change":"2024-09-12T01:03:40.566702+0000","last_active":"2024-09-12T01:19:27.796717+0000","last_peered":"2024-09-12T01:19:27.796717+0000","last_clean":"2024-09-12T01:19:27.796717+0000","last_became_active":"2024-09-12T01:03:40.565926+0000","last_became_peered":"2024-09-12T01:03:40.565926+0000","last_unstale":"2024-09-12T01:19:27.796717+0000","last_undegraded":"2024-09-12T01:19:27.796717+0000","last_fullsized":"2024-09-12T01:19:27.796717+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:31.308325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.785653+0000","last_change":"2024-09-12T00:52:40.341080+0000","last_active":"2024-09-12T01:18:42.785653+0000","last_peered":"2024-09-12T01:18:42.785653+0000","last_clean":"2024-09-12T01:18:42.785653+0000","last_became_active":"2024-09-12T00:52:40.340423+0000","last_became_peered":"2024-09-12T00:52:40.340423+0000","last_unstale":"2024-09-12T01:18:42.785653+0000","last_undegraded":"2024-09-12T01:18:42.785653+0000","last_fullsized":"2024-09-12T01:18:42.785653+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:11.370534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"265'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.947626+0000","last_change":"2024-09-12T00:52:37.294639+0000","last_active":"2024-09-12T01:21:56.947626+0000","last_peered":"2024-09-12T01:21:56.947626+0000","last_clean":"2024-09-12T01:21:56.947626+0000","last_became_active":"2024-09-12T00:52:37.293885+0000","last_became_peered":"2024-09-12T00:52:37.293885+0000","last_unstale":"2024-09-12T01:21:56.947626+0000","last_undegraded":"2024-09-12T01:21:56.947626+0000","last_fullsized":"2024-09-12T01:21:56.947626+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:20.571782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'39","reported_seq":151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:19.686513+0000","last_change":"2024-09-12T00:51:04.989066+0000","last_active":"2024-09-12T01:19:19.686513+0000","last_peered":"2024-09-12T01:19:19.686513+0000","last_clean":"2024-09-12T01:19:19.686513+0000","last_became_active":"2024-09-12T00:51:04.988252+0000","last_became_peered":"2024-09-12T00:51:04.988252+0000","last_unstale":"2024-09-12T01:19:19.686513+0000","last_undegraded":"2024-09-12T01:19:19.686513+0000","last_fullsized":"2024-09-12T01:19:19.686513+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:49.691881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":135,"num_write":72,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:27.796591+0000","last_change":"2024-09-12T01:03:40.581034+0000","last_active":"2024-09-12T01:19:27.796591+0000","last_peered":"2024-09-12T01:19:27.796591+0000","last_clean":"2024-09-12T01:19:27.796591+0000","last_became_active":"2024-09-12T01:03:40.580376+0000","last_became_peered":"2024-09-12T01:03:40.580376+0000","last_unstale":"2024-09-12T01:19:27.796591+0000","last_undegraded":"2024-09-12T01:19:27.796591+0000","last_fullsized":"2024-09-12T01:19:27.796591+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:38.778592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.583906+0000","last_change":"2024-09-12T00:52:40.338165+0000","last_active":"2024-09-12T01:19:43.583906+0000","last_peered":"2024-09-12T01:19:43.583906+0000","last_clean":"2024-09-12T01:19:43.583906+0000","last_became_active":"2024-09-12T00:52:40.337359+0000","last_became_peered":"2024-09-12T00:52:40.337359+0000","last_unstale":"2024-09-12T01:19:43.583906+0000","last_undegraded":"2024-09-12T01:19:43.583906+0000","last_fullsized":"2024-09-12T01:19:43.583906+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:52.904218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"265'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:53.595693+0000","last_change":"2024-09-12T00:52:37.300132+0000","last_active":"2024-09-12T01:20:53.595693+0000","last_peered":"2024-09-12T01:20:53.595693+0000","last_clean":"2024-09-12T01:20:53.595693+0000","last_became_active":"2024-09-12T00:52:37.299461+0000","last_became_peered":"2024-09-12T00:52:37.299461+0000","last_unstale":"2024-09-12T01:20:53.595693+0000","last_undegraded":"2024-09-12T01:20:53.595693+0000","last_fullsized":"2024-09-12T01:20:53.595693+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:06.604639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5125,"num_write":10,"num_write_kb":5125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'112","reported_seq":395,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.594307+0000","last_change":"2024-09-12T00:51:04.983673+0000","last_active":"2024-09-12T01:19:18.594307+0000","last_peered":"2024-09-12T01:19:18.594307+0000","last_clean":"2024-09-12T01:19:18.594307+0000","last_became_active":"2024-09-12T00:51:04.975690+0000","last_became_peered":"2024-09-12T00:51:04.975690+0000","last_unstale":"2024-09-12T01:19:18.594307+0000","last_undegraded":"2024-09-12T01:19:18.594307+0000","last_fullsized":"2024-09-12T01:19:18.594307+0000","mapping_epoch":252,"log_start":"265'100","ondisk_log_start":"265'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:00.184799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":675,"num_read_kb":541,"num_write":147,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:28.576824+0000","last_change":"2024-09-12T01:03:40.586682+0000","last_active":"2024-09-12T01:19:28.576824+0000","last_peered":"2024-09-12T01:19:28.576824+0000","last_clean":"2024-09-12T01:19:28.576824+0000","last_became_active":"2024-09-12T01:03:40.585894+0000","last_became_peered":"2024-09-12T01:03:40.585894+0000","last_unstale":"2024-09-12T01:19:28.576824+0000","last_undegraded":"2024-09-12T01:19:28.576824+0000","last_fullsized":"2024-09-12T01:19:28.576824+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:09.789910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"262'3","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.785780+0000","last_change":"2024-09-12T00:52:40.355779+0000","last_active":"2024-09-12T01:18:42.785780+0000","last_peered":"2024-09-12T01:18:42.785780+0000","last_clean":"2024-09-12T01:18:42.785780+0000","last_became_active":"2024-09-12T00:52:40.355113+0000","last_became_peered":"2024-09-12T00:52:40.355113+0000","last_unstale":"2024-09-12T01:18:42.785780+0000","last_undegraded":"2024-09-12T01:18:42.785780+0000","last_fullsized":"2024-09-12T01:18:42.785780+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:00.005104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:52.587580+0000","last_change":"2024-09-12T00:52:37.281177+0000","last_active":"2024-09-12T01:21:52.587580+0000","last_peered":"2024-09-12T01:21:52.587580+0000","last_clean":"2024-09-12T01:21:52.587580+0000","last_became_active":"2024-09-12T00:52:37.280444+0000","last_became_peered":"2024-09-12T00:52:37.280444+0000","last_unstale":"2024-09-12T01:21:52.587580+0000","last_undegraded":"2024-09-12T01:21:52.587580+0000","last_fullsized":"2024-09-12T01:21:52.587580+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:12.563116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'48","reported_seq":181,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:17.559211+0000","last_change":"2024-09-12T00:51:04.985402+0000","last_active":"2024-09-12T01:19:17.559211+0000","last_peered":"2024-09-12T01:19:17.559211+0000","last_clean":"2024-09-12T01:19:17.559211+0000","last_became_active":"2024-09-12T00:51:04.984384+0000","last_became_peered":"2024-09-12T00:51:04.984384+0000","last_unstale":"2024-09-12T01:19:17.559211+0000","last_undegraded":"2024-09-12T01:19:17.559211+0000","last_fullsized":"2024-09-12T01:19:17.559211+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:51.787094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":174,"num_write":98,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.779633+0000","last_change":"2024-09-12T01:03:40.566732+0000","last_active":"2024-09-12T01:18:17.779633+0000","last_peered":"2024-09-12T01:18:17.779633+0000","last_clean":"2024-09-12T01:18:17.779633+0000","last_became_active":"2024-09-12T01:03:40.565972+0000","last_became_peered":"2024-09-12T01:03:40.565972+0000","last_unstale":"2024-09-12T01:18:17.779633+0000","last_undegraded":"2024-09-12T01:18:17.779633+0000","last_fullsized":"2024-09-12T01:18:17.779633+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:13.523686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:53.583277+0000","last_change":"2024-09-12T00:52:40.352965+0000","last_active":"2024-09-12T01:19:53.583277+0000","last_peered":"2024-09-12T01:19:53.583277+0000","last_clean":"2024-09-12T01:19:53.583277+0000","last_became_active":"2024-09-12T00:52:40.352178+0000","last_became_peered":"2024-09-12T00:52:40.352178+0000","last_unstale":"2024-09-12T01:19:53.583277+0000","last_undegraded":"2024-09-12T01:19:53.583277+0000","last_fullsized":"2024-09-12T01:19:53.583277+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:25.540435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:42.800116+0000","last_change":"2024-09-12T00:52:37.281424+0000","last_active":"2024-09-12T01:19:42.800116+0000","last_peered":"2024-09-12T01:19:42.800116+0000","last_clean":"2024-09-12T01:19:42.800116+0000","last_became_active":"2024-09-12T00:52:37.280679+0000","last_became_peered":"2024-09-12T00:52:37.280679+0000","last_unstale":"2024-09-12T01:19:42.800116+0000","last_undegraded":"2024-09-12T01:19:42.800116+0000","last_fullsized":"2024-09-12T01:19:42.800116+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:14.781208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'2","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.574476+0000","last_change":"2024-09-12T00:51:04.998155+0000","last_active":"2024-09-12T01:19:18.574476+0000","last_peered":"2024-09-12T01:19:18.574476+0000","last_clean":"2024-09-12T01:19:18.574476+0000","last_became_active":"2024-09-12T00:51:04.996736+0000","last_became_peered":"2024-09-12T00:51:04.996736+0000","last_unstale":"2024-09-12T01:19:18.574476+0000","last_undegraded":"2024-09-12T01:19:18.574476+0000","last_fullsized":"2024-09-12T01:19:18.574476+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:00.791980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.552215+0000","last_change":"2024-09-12T01:03:40.577490+0000","last_active":"2024-09-12T01:18:18.552215+0000","last_peered":"2024-09-12T01:18:18.552215+0000","last_clean":"2024-09-12T01:18:18.552215+0000","last_became_active":"2024-09-12T01:03:40.576752+0000","last_became_peered":"2024-09-12T01:03:40.576752+0000","last_unstale":"2024-09-12T01:18:18.552215+0000","last_undegraded":"2024-09-12T01:18:18.552215+0000","last_fullsized":"2024-09-12T01:18:18.552215+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:58.912810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"262'8","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.582004+0000","last_change":"2024-09-12T00:52:40.340084+0000","last_active":"2024-09-12T01:19:48.582004+0000","last_peered":"2024-09-12T01:19:48.582004+0000","last_clean":"2024-09-12T01:19:48.582004+0000","last_became_active":"2024-09-12T00:52:40.338378+0000","last_became_peered":"2024-09-12T00:52:40.338378+0000","last_unstale":"2024-09-12T01:19:48.582004+0000","last_undegraded":"2024-09-12T01:19:48.582004+0000","last_fullsized":"2024-09-12T01:19:48.582004+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:29.194283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'6","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:55.597554+0000","last_change":"2024-09-12T00:52:37.285880+0000","last_active":"2024-09-12T01:21:55.597554+0000","last_peered":"2024-09-12T01:21:55.597554+0000","last_clean":"2024-09-12T01:21:55.597554+0000","last_became_active":"2024-09-12T00:52:37.284206+0000","last_became_peered":"2024-09-12T00:52:37.284206+0000","last_unstale":"2024-09-12T01:21:55.597554+0000","last_undegraded":"2024-09-12T01:21:55.597554+0000","last_fullsized":"2024-09-12T01:21:55.597554+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:30.930785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'21","reported_seq":106,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:17.559410+0000","last_change":"2024-09-12T00:51:04.983851+0000","last_active":"2024-09-12T01:19:17.559410+0000","last_peered":"2024-09-12T01:19:17.559410+0000","last_clean":"2024-09-12T01:19:17.559410+0000","last_became_active":"2024-09-12T00:51:04.983165+0000","last_became_peered":"2024-09-12T00:51:04.983165+0000","last_unstale":"2024-09-12T01:19:17.559410+0000","last_undegraded":"2024-09-12T01:19:17.559410+0000","last_fullsized":"2024-09-12T01:19:17.559410+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:30.417623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":73,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.584915+0000","last_change":"2024-09-12T01:03:40.579521+0000","last_active":"2024-09-12T01:19:48.584915+0000","last_peered":"2024-09-12T01:19:48.584915+0000","last_clean":"2024-09-12T01:19:48.584915+0000","last_became_active":"2024-09-12T01:03:40.578825+0000","last_became_peered":"2024-09-12T01:03:40.578825+0000","last_unstale":"2024-09-12T01:19:48.584915+0000","last_undegraded":"2024-09-12T01:19:48.584915+0000","last_fullsized":"2024-09-12T01:19:48.584915+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:02.779228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"265'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:52.815957+0000","last_change":"2024-09-12T00:52:40.353791+0000","last_active":"2024-09-12T01:20:52.815957+0000","last_peered":"2024-09-12T01:20:52.815957+0000","last_clean":"2024-09-12T01:20:52.815957+0000","last_became_active":"2024-09-12T00:52:40.352922+0000","last_became_peered":"2024-09-12T00:52:40.352922+0000","last_unstale":"2024-09-12T01:20:52.815957+0000","last_undegraded":"2024-09-12T01:20:52.815957+0000","last_fullsized":"2024-09-12T01:20:52.815957+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:33.594783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.556947+0000","last_change":"2024-09-12T00:52:37.281272+0000","last_active":"2024-09-12T01:18:38.556947+0000","last_peered":"2024-09-12T01:18:38.556947+0000","last_clean":"2024-09-12T01:18:38.556947+0000","last_became_active":"2024-09-12T00:52:37.280548+0000","last_became_peered":"2024-09-12T00:52:37.280548+0000","last_unstale":"2024-09-12T01:18:38.556947+0000","last_undegraded":"2024-09-12T01:18:38.556947+0000","last_fullsized":"2024-09-12T01:18:38.556947+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:57.882529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'10","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:17.807776+0000","last_change":"2024-09-12T00:51:04.995585+0000","last_active":"2024-09-12T01:20:17.807776+0000","last_peered":"2024-09-12T01:20:17.807776+0000","last_clean":"2024-09-12T01:20:17.807776+0000","last_became_active":"2024-09-12T00:51:04.994904+0000","last_became_peered":"2024-09-12T00:51:04.994904+0000","last_unstale":"2024-09-12T01:20:17.807776+0000","last_undegraded":"2024-09-12T01:20:17.807776+0000","last_fullsized":"2024-09-12T01:20:17.807776+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":34,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.739185+0000","last_change":"2024-09-12T01:03:40.577193+0000","last_active":"2024-09-12T01:18:17.739185+0000","last_peered":"2024-09-12T01:18:17.739185+0000","last_clean":"2024-09-12T01:18:17.739185+0000","last_became_active":"2024-09-12T01:03:40.576442+0000","last_became_peered":"2024-09-12T01:03:40.576442+0000","last_unstale":"2024-09-12T01:18:17.739185+0000","last_undegraded":"2024-09-12T01:18:17.739185+0000","last_fullsized":"2024-09-12T01:18:17.739185+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:03.900955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"265'6","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:52.574160+0000","last_change":"2024-09-12T00:52:40.346550+0000","last_active":"2024-09-12T01:20:52.574160+0000","last_peered":"2024-09-12T01:20:52.574160+0000","last_clean":"2024-09-12T01:20:52.574160+0000","last_became_active":"2024-09-12T00:52:40.345375+0000","last_became_peered":"2024-09-12T00:52:40.345375+0000","last_unstale":"2024-09-12T01:20:52.574160+0000","last_undegraded":"2024-09-12T01:20:52.574160+0000","last_fullsized":"2024-09-12T01:20:52.574160+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:05.935202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"262'5","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:37.784692+0000","last_change":"2024-09-12T00:52:37.282759+0000","last_active":"2024-09-12T01:18:37.784692+0000","last_peered":"2024-09-12T01:18:37.784692+0000","last_clean":"2024-09-12T01:18:37.784692+0000","last_became_active":"2024-09-12T00:52:37.282005+0000","last_became_peered":"2024-09-12T00:52:37.282005+0000","last_unstale":"2024-09-12T01:18:37.784692+0000","last_undegraded":"2024-09-12T01:18:37.784692+0000","last_fullsized":"2024-09-12T01:18:37.784692+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:50.148380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":5,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"265'13","reported_seq":83,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:18.591299+0000","last_change":"2024-09-12T00:51:04.991796+0000","last_active":"2024-09-12T01:20:18.591299+0000","last_peered":"2024-09-12T01:20:18.591299+0000","last_clean":"2024-09-12T01:20:18.591299+0000","last_became_active":"2024-09-12T00:51:04.990945+0000","last_became_peered":"2024-09-12T00:51:04.990945+0000","last_unstale":"2024-09-12T01:20:18.591299+0000","last_undegraded":"2024-09-12T01:20:18.591299+0000","last_fullsized":"2024-09-12T01:20:18.591299+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:50.562171+0000","last_change":"2024-09-12T01:03:40.582179+0000","last_active":"2024-09-12T01:18:50.562171+0000","last_peered":"2024-09-12T01:18:50.562171+0000","last_clean":"2024-09-12T01:18:50.562171+0000","last_became_active":"2024-09-12T01:03:40.581227+0000","last_became_peered":"2024-09-12T01:03:40.581227+0000","last_unstale":"2024-09-12T01:18:50.562171+0000","last_undegraded":"2024-09-12T01:18:50.562171+0000","last_fullsized":"2024-09-12T01:18:50.562171+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:44.601346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.584983+0000","last_change":"2024-09-12T00:52:40.341544+0000","last_active":"2024-09-12T01:19:48.584983+0000","last_peered":"2024-09-12T01:19:48.584983+0000","last_clean":"2024-09-12T01:19:48.584983+0000","last_became_active":"2024-09-12T00:52:40.340078+0000","last_became_peered":"2024-09-12T00:52:40.340078+0000","last_unstale":"2024-09-12T01:19:48.584983+0000","last_undegraded":"2024-09-12T01:19:48.584983+0000","last_fullsized":"2024-09-12T01:19:48.584983+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:01.427475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"262'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:37.784418+0000","last_change":"2024-09-12T00:52:37.280400+0000","last_active":"2024-09-12T01:18:37.784418+0000","last_peered":"2024-09-12T01:18:37.784418+0000","last_clean":"2024-09-12T01:18:37.784418+0000","last_became_active":"2024-09-12T00:52:37.277753+0000","last_became_peered":"2024-09-12T00:52:37.277753+0000","last_unstale":"2024-09-12T01:18:37.784418+0000","last_undegraded":"2024-09-12T01:18:37.784418+0000","last_fullsized":"2024-09-12T01:18:37.784418+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:24.031905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"254'7","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:18.579955+0000","last_change":"2024-09-12T00:51:04.957439+0000","last_active":"2024-09-12T01:20:18.579955+0000","last_peered":"2024-09-12T01:20:18.579955+0000","last_clean":"2024-09-12T01:20:18.579955+0000","last_became_active":"2024-09-12T00:51:04.956754+0000","last_became_peered":"2024-09-12T00:51:04.956754+0000","last_unstale":"2024-09-12T01:20:18.579955+0000","last_undegraded":"2024-09-12T01:20:18.579955+0000","last_fullsized":"2024-09-12T01:20:18.579955+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":30,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:53.568338+0000","last_change":"2024-09-12T01:03:40.586675+0000","last_active":"2024-09-12T01:18:53.568338+0000","last_peered":"2024-09-12T01:18:53.568338+0000","last_clean":"2024-09-12T01:18:53.568338+0000","last_became_active":"2024-09-12T01:03:40.583308+0000","last_became_peered":"2024-09-12T01:03:40.583308+0000","last_unstale":"2024-09-12T01:18:53.568338+0000","last_undegraded":"2024-09-12T01:18:53.568338+0000","last_fullsized":"2024-09-12T01:18:53.568338+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:58.594413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'6","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.619618+0000","last_change":"2024-09-12T00:52:40.333654+0000","last_active":"2024-09-12T01:21:56.619618+0000","last_peered":"2024-09-12T01:21:56.619618+0000","last_clean":"2024-09-12T01:21:56.619618+0000","last_became_active":"2024-09-12T00:52:40.332913+0000","last_became_peered":"2024-09-12T00:52:40.332913+0000","last_unstale":"2024-09-12T01:21:56.619618+0000","last_undegraded":"2024-09-12T01:21:56.619618+0000","last_fullsized":"2024-09-12T01:21:56.619618+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:55.862557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:47.828740+0000","last_change":"2024-09-12T00:52:37.287265+0000","last_active":"2024-09-12T01:21:47.828740+0000","last_peered":"2024-09-12T01:21:47.828740+0000","last_clean":"2024-09-12T01:21:47.828740+0000","last_became_active":"2024-09-12T00:52:37.282758+0000","last_became_peered":"2024-09-12T00:52:37.282758+0000","last_unstale":"2024-09-12T01:21:47.828740+0000","last_undegraded":"2024-09-12T01:21:47.828740+0000","last_fullsized":"2024-09-12T01:21:47.828740+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:54.106634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'71","reported_seq":245,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:17.565961+0000","last_change":"2024-09-12T00:51:04.983438+0000","last_active":"2024-09-12T01:20:17.565961+0000","last_peered":"2024-09-12T01:20:17.565961+0000","last_clean":"2024-09-12T01:20:17.565961+0000","last_became_active":"2024-09-12T00:51:04.982747+0000","last_became_peered":"2024-09-12T00:51:04.982747+0000","last_unstale":"2024-09-12T01:20:17.565961+0000","last_undegraded":"2024-09-12T01:20:17.565961+0000","last_fullsized":"2024-09-12T01:20:17.565961+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":369,"num_read_kb":267,"num_write":124,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.559537+0000","last_change":"2024-09-12T01:03:40.573794+0000","last_active":"2024-09-12T01:18:18.559537+0000","last_peered":"2024-09-12T01:18:18.559537+0000","last_clean":"2024-09-12T01:18:18.559537+0000","last_became_active":"2024-09-12T01:03:40.571968+0000","last_became_peered":"2024-09-12T01:03:40.571968+0000","last_unstale":"2024-09-12T01:18:18.559537+0000","last_undegraded":"2024-09-12T01:18:18.559537+0000","last_fullsized":"2024-09-12T01:18:18.559537+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:38.415524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'7","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:52.398884+0000","last_change":"2024-09-12T00:52:40.360097+0000","last_active":"2024-09-12T01:21:52.398884+0000","last_peered":"2024-09-12T01:21:52.398884+0000","last_clean":"2024-09-12T01:21:52.398884+0000","last_became_active":"2024-09-12T00:52:40.359434+0000","last_became_peered":"2024-09-12T00:52:40.359434+0000","last_unstale":"2024-09-12T01:21:52.398884+0000","last_undegraded":"2024-09-12T01:21:52.398884+0000","last_fullsized":"2024-09-12T01:21:52.398884+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:26.806456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":12,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'6","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.749444+0000","last_change":"2024-09-12T00:52:37.292083+0000","last_active":"2024-09-12T01:21:56.749444+0000","last_peered":"2024-09-12T01:21:56.749444+0000","last_clean":"2024-09-12T01:21:56.749444+0000","last_became_active":"2024-09-12T00:52:37.291369+0000","last_became_peered":"2024-09-12T00:52:37.291369+0000","last_unstale":"2024-09-12T01:21:56.749444+0000","last_undegraded":"2024-09-12T01:21:56.749444+0000","last_fullsized":"2024-09-12T01:21:56.749444+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:43.999305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'35","reported_seq":137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:17.571492+0000","last_change":"2024-09-12T00:51:04.990882+0000","last_active":"2024-09-12T01:20:17.571492+0000","last_peered":"2024-09-12T01:20:17.571492+0000","last_clean":"2024-09-12T01:20:17.571492+0000","last_became_active":"2024-09-12T00:51:04.990179+0000","last_became_peered":"2024-09-12T00:51:04.990179+0000","last_unstale":"2024-09-12T01:20:17.571492+0000","last_undegraded":"2024-09-12T01:20:17.571492+0000","last_fullsized":"2024-09-12T01:20:17.571492+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":108,"num_write":67,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.779809+0000","last_change":"2024-09-12T01:03:40.574488+0000","last_active":"2024-09-12T01:18:17.779809+0000","last_peered":"2024-09-12T01:18:17.779809+0000","last_clean":"2024-09-12T01:18:17.779809+0000","last_became_active":"2024-09-12T01:03:40.573928+0000","last_became_peered":"2024-09-12T01:03:40.573928+0000","last_unstale":"2024-09-12T01:18:17.779809+0000","last_undegraded":"2024-09-12T01:18:17.779809+0000","last_fullsized":"2024-09-12T01:18:17.779809+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:15.934749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:47.559411+0000","last_change":"2024-09-12T00:52:40.349488+0000","last_active":"2024-09-12T01:19:47.559411+0000","last_peered":"2024-09-12T01:19:47.559411+0000","last_clean":"2024-09-12T01:19:47.559411+0000","last_became_active":"2024-09-12T00:52:40.348494+0000","last_became_peered":"2024-09-12T00:52:40.348494+0000","last_unstale":"2024-09-12T01:19:47.559411+0000","last_undegraded":"2024-09-12T01:19:47.559411+0000","last_fullsized":"2024-09-12T01:19:47.559411+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:17.271665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'2","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:42.564451+0000","last_change":"2024-09-12T00:52:37.279058+0000","last_active":"2024-09-12T01:19:42.564451+0000","last_peered":"2024-09-12T01:19:42.564451+0000","last_clean":"2024-09-12T01:19:42.564451+0000","last_became_active":"2024-09-12T00:52:37.278285+0000","last_became_peered":"2024-09-12T00:52:37.278285+0000","last_unstale":"2024-09-12T01:19:42.564451+0000","last_undegraded":"2024-09-12T01:19:42.564451+0000","last_fullsized":"2024-09-12T01:19:42.564451+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:15.749368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'29","reported_seq":125,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.791752+0000","last_change":"2024-09-12T00:51:04.986057+0000","last_active":"2024-09-12T01:19:07.791752+0000","last_peered":"2024-09-12T01:19:07.791752+0000","last_clean":"2024-09-12T01:19:07.791752+0000","last_became_active":"2024-09-12T00:51:04.984999+0000","last_became_peered":"2024-09-12T00:51:04.984999+0000","last_unstale":"2024-09-12T01:19:07.791752+0000","last_undegraded":"2024-09-12T01:19:07.791752+0000","last_fullsized":"2024-09-12T01:19:07.791752+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:46.905997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":53,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'333","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.526698+0000","last_change":"2024-09-12T01:22:17.526698+0000","last_active":"2024-09-12T01:22:17.526698+0000","last_peered":"2024-09-12T01:22:17.526698+0000","last_clean":"2024-09-12T01:22:17.526698+0000","last_became_active":"2024-09-12T00:35:43.947816+0000","last_became_peered":"2024-09-12T00:35:43.947816+0000","last_unstale":"2024-09-12T01:22:17.526698+0000","last_undegraded":"2024-09-12T01:22:17.526698+0000","last_fullsized":"2024-09-12T01:22:17.526698+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-12T01:22:17.526459+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-12T01:22:17.526459+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.526459+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:45.054333+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1291295,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":33235,"num_write":1076,"num_write_kb":21608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'253","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.685823+0000","last_change":"2024-09-12T01:22:22.685823+0000","last_active":"2024-09-12T01:22:22.685823+0000","last_peered":"2024-09-12T01:22:22.685823+0000","last_clean":"2024-09-12T01:22:22.685823+0000","last_became_active":"2024-09-12T00:35:45.925856+0000","last_became_peered":"2024-09-12T00:35:45.925856+0000","last_unstale":"2024-09-12T01:22:22.685823+0000","last_undegraded":"2024-09-12T01:22:22.685823+0000","last_fullsized":"2024-09-12T01:22:22.685823+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'253","last_scrub_stamp":"2024-09-12T01:22:22.685653+0000","last_deep_scrub":"265'253","last_deep_scrub_stamp":"2024-09-12T01:22:22.685653+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.685653+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:53.425516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1075,"num_read_kb":882,"num_write":373,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'379","reported_seq":1051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.216236+0000","last_change":"2024-09-12T01:22:10.216236+0000","last_active":"2024-09-12T01:22:10.216236+0000","last_peered":"2024-09-12T01:22:10.216236+0000","last_clean":"2024-09-12T01:22:10.216236+0000","last_became_active":"2024-09-12T00:35:43.933088+0000","last_became_peered":"2024-09-12T00:35:43.933088+0000","last_unstale":"2024-09-12T01:22:10.216236+0000","last_undegraded":"2024-09-12T01:22:10.216236+0000","last_fullsized":"2024-09-12T01:22:10.216236+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'379","last_scrub_stamp":"2024-09-12T01:22:10.215975+0000","last_deep_scrub":"265'379","last_deep_scrub_stamp":"2024-09-12T01:22:10.215975+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.215975+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:43.999693+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":567,"num_read_kb":47488,"num_write":1216,"num_write_kb":29880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'45","reported_seq":587,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.419078+0000","last_change":"2024-09-12T01:22:21.419078+0000","last_active":"2024-09-12T01:22:21.419078+0000","last_peered":"2024-09-12T01:22:21.419078+0000","last_clean":"2024-09-12T01:22:21.419078+0000","last_became_active":"2024-09-12T00:35:45.947212+0000","last_became_peered":"2024-09-12T00:35:45.947212+0000","last_unstale":"2024-09-12T01:22:21.419078+0000","last_undegraded":"2024-09-12T01:22:21.419078+0000","last_fullsized":"2024-09-12T01:22:21.419078+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'45","last_scrub_stamp":"2024-09-12T01:22:21.418869+0000","last_deep_scrub":"265'45","last_deep_scrub_stamp":"2024-09-12T01:22:21.418869+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.418869+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:50:21.799809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":168,"num_write":71,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'336","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.537484+0000","last_change":"2024-09-12T01:22:12.537484+0000","last_active":"2024-09-12T01:22:12.537484+0000","last_peered":"2024-09-12T01:22:12.537484+0000","last_clean":"2024-09-12T01:22:12.537484+0000","last_became_active":"2024-09-12T00:35:43.926443+0000","last_became_peered":"2024-09-12T00:35:43.926443+0000","last_unstale":"2024-09-12T01:22:12.537484+0000","last_undegraded":"2024-09-12T01:22:12.537484+0000","last_fullsized":"2024-09-12T01:22:12.537484+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'336","last_scrub_stamp":"2024-09-12T01:22:12.537222+0000","last_deep_scrub":"265'336","last_deep_scrub_stamp":"2024-09-12T01:22:12.537222+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.537222+0000","objects_scrubbed":9,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:43.392767+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262209,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":553,"num_read_kb":98039,"num_write":1093,"num_write_kb":58371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'116","reported_seq":737,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.906406+0000","last_change":"2024-09-12T01:22:21.906406+0000","last_active":"2024-09-12T01:22:21.906406+0000","last_peered":"2024-09-12T01:22:21.906406+0000","last_clean":"2024-09-12T01:22:21.906406+0000","last_became_active":"2024-09-12T00:35:45.930987+0000","last_became_peered":"2024-09-12T00:35:45.930987+0000","last_unstale":"2024-09-12T01:22:21.906406+0000","last_undegraded":"2024-09-12T01:22:21.906406+0000","last_fullsized":"2024-09-12T01:22:21.906406+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'116","last_scrub_stamp":"2024-09-12T01:22:21.906229+0000","last_deep_scrub":"265'116","last_deep_scrub_stamp":"2024-09-12T01:22:21.906229+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.906229+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:48.016467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":522,"num_read_kb":443,"num_write":187,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'383","reported_seq":1063,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.820355+0000","last_change":"2024-09-12T01:22:15.820355+0000","last_active":"2024-09-12T01:22:15.820355+0000","last_peered":"2024-09-12T01:22:15.820355+0000","last_clean":"2024-09-12T01:22:15.820355+0000","last_became_active":"2024-09-12T00:35:43.914356+0000","last_became_peered":"2024-09-12T00:35:43.914356+0000","last_unstale":"2024-09-12T01:22:15.820355+0000","last_undegraded":"2024-09-12T01:22:15.820355+0000","last_fullsized":"2024-09-12T01:22:15.820355+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'383","last_scrub_stamp":"2024-09-12T01:22:15.820094+0000","last_deep_scrub":"265'383","last_deep_scrub_stamp":"2024-09-12T01:22:15.820094+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.820094+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:01.760407+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6370276,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":596,"num_read_kb":17763,"num_write":1203,"num_write_kb":54335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'197","reported_seq":802,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.513443+0000","last_change":"2024-09-12T01:22:17.513443+0000","last_active":"2024-09-12T01:22:17.513443+0000","last_peered":"2024-09-12T01:22:17.513443+0000","last_clean":"2024-09-12T01:22:17.513443+0000","last_became_active":"2024-09-12T00:35:45.942567+0000","last_became_peered":"2024-09-12T00:35:45.942567+0000","last_unstale":"2024-09-12T01:22:17.513443+0000","last_undegraded":"2024-09-12T01:22:17.513443+0000","last_fullsized":"2024-09-12T01:22:17.513443+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'197","last_scrub_stamp":"2024-09-12T01:22:17.513255+0000","last_deep_scrub":"265'197","last_deep_scrub_stamp":"2024-09-12T01:22:17.513255+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.513255+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:58.319165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":861,"num_read_kb":699,"num_write":314,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'348","reported_seq":1013,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.507635+0000","last_change":"2024-09-12T01:22:16.507635+0000","last_active":"2024-09-12T01:22:16.507635+0000","last_peered":"2024-09-12T01:22:16.507635+0000","last_clean":"2024-09-12T01:22:16.507635+0000","last_became_active":"2024-09-12T00:35:43.944644+0000","last_became_peered":"2024-09-12T00:35:43.944644+0000","last_unstale":"2024-09-12T01:22:16.507635+0000","last_undegraded":"2024-09-12T01:22:16.507635+0000","last_fullsized":"2024-09-12T01:22:16.507635+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-12T01:22:16.507410+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-12T01:22:16.507410+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.507410+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:46.731365+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289155,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":589,"num_read_kb":29244,"num_write":1174,"num_write_kb":25136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'342","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.112383+0000","last_change":"2024-09-12T01:22:17.112383+0000","last_active":"2024-09-12T01:22:17.112383+0000","last_peered":"2024-09-12T01:22:17.112383+0000","last_clean":"2024-09-12T01:22:17.112383+0000","last_became_active":"2024-09-12T00:35:45.943110+0000","last_became_peered":"2024-09-12T00:35:45.943110+0000","last_unstale":"2024-09-12T01:22:17.112383+0000","last_undegraded":"2024-09-12T01:22:17.112383+0000","last_fullsized":"2024-09-12T01:22:17.112383+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T01:22:17.112199+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T01:22:17.112199+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.112199+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:44.660281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1719,"num_read_kb":1451,"num_write":623,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'340","reported_seq":958,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.811940+0000","last_change":"2024-09-12T01:22:16.811940+0000","last_active":"2024-09-12T01:22:16.811940+0000","last_peered":"2024-09-12T01:22:16.811940+0000","last_clean":"2024-09-12T01:22:16.811940+0000","last_became_active":"2024-09-12T00:35:43.929553+0000","last_became_peered":"2024-09-12T00:35:43.929553+0000","last_unstale":"2024-09-12T01:22:16.811940+0000","last_undegraded":"2024-09-12T01:22:16.811940+0000","last_fullsized":"2024-09-12T01:22:16.811940+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'340","last_scrub_stamp":"2024-09-12T01:22:16.811714+0000","last_deep_scrub":"265'340","last_deep_scrub_stamp":"2024-09-12T01:22:16.811714+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.811714+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:09.205040+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8021586,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":453,"num_read_kb":14436,"num_write":1125,"num_write_kb":49786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'350","reported_seq":931,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:00.371052+0000","last_change":"2024-09-12T00:35:45.934966+0000","last_active":"2024-09-12T01:20:00.371052+0000","last_peered":"2024-09-12T01:20:00.371052+0000","last_clean":"2024-09-12T01:20:00.371052+0000","last_became_active":"2024-09-12T00:35:45.934193+0000","last_became_peered":"2024-09-12T00:35:45.934193+0000","last_unstale":"2024-09-12T01:20:00.371052+0000","last_undegraded":"2024-09-12T01:20:00.371052+0000","last_fullsized":"2024-09-12T01:20:00.371052+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:43.914081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1452,"num_read_kb":1165,"num_write":550,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'395","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.543860+0000","last_change":"2024-09-12T01:22:15.543860+0000","last_active":"2024-09-12T01:22:15.543860+0000","last_peered":"2024-09-12T01:22:15.543860+0000","last_clean":"2024-09-12T01:22:15.543860+0000","last_became_active":"2024-09-12T00:35:43.942199+0000","last_became_peered":"2024-09-12T00:35:43.942199+0000","last_unstale":"2024-09-12T01:22:15.543860+0000","last_undegraded":"2024-09-12T01:22:15.543860+0000","last_fullsized":"2024-09-12T01:22:15.543860+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'395","last_scrub_stamp":"2024-09-12T01:22:15.543686+0000","last_deep_scrub":"265'395","last_deep_scrub_stamp":"2024-09-12T01:22:15.543686+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.543686+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:08.555732+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":650,"num_read_kb":42927,"num_write":1209,"num_write_kb":42524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'254","reported_seq":917,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:33.569572+0000","last_change":"2024-09-12T00:35:45.938322+0000","last_active":"2024-09-12T01:19:33.569572+0000","last_peered":"2024-09-12T01:19:33.569572+0000","last_clean":"2024-09-12T01:19:33.569572+0000","last_became_active":"2024-09-12T00:35:45.937211+0000","last_became_peered":"2024-09-12T00:35:45.937211+0000","last_unstale":"2024-09-12T01:19:33.569572+0000","last_undegraded":"2024-09-12T01:19:33.569572+0000","last_fullsized":"2024-09-12T01:19:33.569572+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:08.919655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1131,"num_read_kb":929,"num_write":387,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'365","reported_seq":1056,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.610299+0000","last_change":"2024-09-12T01:22:15.610299+0000","last_active":"2024-09-12T01:22:15.610299+0000","last_peered":"2024-09-12T01:22:15.610299+0000","last_clean":"2024-09-12T01:22:15.610299+0000","last_became_active":"2024-09-12T00:35:43.918653+0000","last_became_peered":"2024-09-12T00:35:43.918653+0000","last_unstale":"2024-09-12T01:22:15.610299+0000","last_undegraded":"2024-09-12T01:22:15.610299+0000","last_fullsized":"2024-09-12T01:22:15.610299+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T01:22:15.610082+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T01:22:15.610082+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.610082+0000","objects_scrubbed":8,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:31.364055+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262196,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":641,"num_read_kb":7519,"num_write":1239,"num_write_kb":32586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'269","reported_seq":937,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.447841+0000","last_change":"2024-09-12T01:22:10.447841+0000","last_active":"2024-09-12T01:22:10.447841+0000","last_peered":"2024-09-12T01:22:10.447841+0000","last_clean":"2024-09-12T01:22:10.447841+0000","last_became_active":"2024-09-12T00:35:45.941814+0000","last_became_peered":"2024-09-12T00:35:45.941814+0000","last_unstale":"2024-09-12T01:22:10.447841+0000","last_undegraded":"2024-09-12T01:22:10.447841+0000","last_fullsized":"2024-09-12T01:22:10.447841+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'269","last_scrub_stamp":"2024-09-12T01:22:10.447618+0000","last_deep_scrub":"265'269","last_deep_scrub_stamp":"2024-09-12T01:22:10.447618+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.447618+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:20.433161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1198,"num_read_kb":983,"num_write":434,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'104","reported_seq":686,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.952362+0000","last_change":"2024-09-12T01:22:20.952362+0000","last_active":"2024-09-12T01:22:20.952362+0000","last_peered":"2024-09-12T01:22:20.952362+0000","last_clean":"2024-09-12T01:22:20.952362+0000","last_became_active":"2024-09-12T00:35:45.929168+0000","last_became_peered":"2024-09-12T00:35:45.929168+0000","last_unstale":"2024-09-12T01:22:20.952362+0000","last_undegraded":"2024-09-12T01:22:20.952362+0000","last_fullsized":"2024-09-12T01:22:20.952362+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'104","last_scrub_stamp":"2024-09-12T01:22:20.952183+0000","last_deep_scrub":"265'104","last_deep_scrub_stamp":"2024-09-12T01:22:20.952183+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.952183+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:31.113426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":468,"num_read_kb":393,"num_write":157,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'374","reported_seq":1031,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.525467+0000","last_change":"2024-09-12T01:22:14.525467+0000","last_active":"2024-09-12T01:22:14.525467+0000","last_peered":"2024-09-12T01:22:14.525467+0000","last_clean":"2024-09-12T01:22:14.525467+0000","last_became_active":"2024-09-12T00:35:43.949857+0000","last_became_peered":"2024-09-12T00:35:43.949857+0000","last_unstale":"2024-09-12T01:22:14.525467+0000","last_undegraded":"2024-09-12T01:22:14.525467+0000","last_fullsized":"2024-09-12T01:22:14.525467+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T01:22:14.525234+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T01:22:14.525234+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.525234+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:51.992259+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":541,"num_read_kb":3399,"num_write":1114,"num_write_kb":43442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'111","reported_seq":692,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.429285+0000","last_change":"2024-09-12T01:22:19.429285+0000","last_active":"2024-09-12T01:22:19.429285+0000","last_peered":"2024-09-12T01:22:19.429285+0000","last_clean":"2024-09-12T01:22:19.429285+0000","last_became_active":"2024-09-12T00:35:45.947366+0000","last_became_peered":"2024-09-12T00:35:45.947366+0000","last_unstale":"2024-09-12T01:22:19.429285+0000","last_undegraded":"2024-09-12T01:22:19.429285+0000","last_fullsized":"2024-09-12T01:22:19.429285+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'111","last_scrub_stamp":"2024-09-12T01:22:19.429104+0000","last_deep_scrub":"265'111","last_deep_scrub_stamp":"2024-09-12T01:22:19.429104+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.429104+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:52.961560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":482,"num_read_kb":394,"num_write":173,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'368","reported_seq":1051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.214862+0000","last_change":"2024-09-12T01:22:12.214862+0000","last_active":"2024-09-12T01:22:12.214862+0000","last_peered":"2024-09-12T01:22:12.214862+0000","last_clean":"2024-09-12T01:22:12.214862+0000","last_became_active":"2024-09-12T00:35:43.926027+0000","last_became_peered":"2024-09-12T00:35:43.926027+0000","last_unstale":"2024-09-12T01:22:12.214862+0000","last_undegraded":"2024-09-12T01:22:12.214862+0000","last_fullsized":"2024-09-12T01:22:12.214862+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'368","last_scrub_stamp":"2024-09-12T01:22:12.214580+0000","last_deep_scrub":"265'368","last_deep_scrub_stamp":"2024-09-12T01:22:12.214580+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.214580+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:50.008326+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":574,"num_read_kb":69210,"num_write":1266,"num_write_kb":64702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'169","reported_seq":785,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.750840+0000","last_change":"2024-09-12T01:22:20.750840+0000","last_active":"2024-09-12T01:22:20.750840+0000","last_peered":"2024-09-12T01:22:20.750840+0000","last_clean":"2024-09-12T01:22:20.750840+0000","last_became_active":"2024-09-12T00:35:45.932116+0000","last_became_peered":"2024-09-12T00:35:45.932116+0000","last_unstale":"2024-09-12T01:22:20.750840+0000","last_undegraded":"2024-09-12T01:22:20.750840+0000","last_fullsized":"2024-09-12T01:22:20.750840+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'169","last_scrub_stamp":"2024-09-12T01:22:20.750664+0000","last_deep_scrub":"265'169","last_deep_scrub_stamp":"2024-09-12T01:22:20.750664+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.750664+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:56.693844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":828,"num_read_kb":701,"num_write":304,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'373","reported_seq":1069,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.243782+0000","last_change":"2024-09-12T01:22:11.243782+0000","last_active":"2024-09-12T01:22:11.243782+0000","last_peered":"2024-09-12T01:22:11.243782+0000","last_clean":"2024-09-12T01:22:11.243782+0000","last_became_active":"2024-09-12T00:36:17.045217+0000","last_became_peered":"2024-09-12T00:36:17.045217+0000","last_unstale":"2024-09-12T01:22:11.243782+0000","last_undegraded":"2024-09-12T01:22:11.243782+0000","last_fullsized":"2024-09-12T01:22:11.243782+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T01:22:11.243529+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T01:22:11.243529+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.243529+0000","objects_scrubbed":8,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:11.316579+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460235,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":599,"num_read_kb":9912,"num_write":1094,"num_write_kb":33583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'100","reported_seq":659,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.371858+0000","last_change":"2024-09-12T01:22:12.371858+0000","last_active":"2024-09-12T01:22:12.371858+0000","last_peered":"2024-09-12T01:22:12.371858+0000","last_clean":"2024-09-12T01:22:12.371858+0000","last_became_active":"2024-09-12T00:35:45.939261+0000","last_became_peered":"2024-09-12T00:35:45.939261+0000","last_unstale":"2024-09-12T01:22:12.371858+0000","last_undegraded":"2024-09-12T01:22:12.371858+0000","last_fullsized":"2024-09-12T01:22:12.371858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'100","last_scrub_stamp":"2024-09-12T01:22:12.371622+0000","last_deep_scrub":"265'100","last_deep_scrub_stamp":"2024-09-12T01:22:12.371622+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.371622+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:46.453737+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":439,"num_read_kb":359,"num_write":158,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'344","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.047647+0000","last_change":"2024-09-12T01:22:08.047647+0000","last_active":"2024-09-12T01:22:08.047647+0000","last_peered":"2024-09-12T01:22:08.047647+0000","last_clean":"2024-09-12T01:22:08.047647+0000","last_became_active":"2024-09-12T00:35:43.949045+0000","last_became_peered":"2024-09-12T00:35:43.949045+0000","last_unstale":"2024-09-12T01:22:08.047647+0000","last_undegraded":"2024-09-12T01:22:08.047647+0000","last_fullsized":"2024-09-12T01:22:08.047647+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'344","last_scrub_stamp":"2024-09-12T01:22:08.047386+0000","last_deep_scrub":"265'344","last_deep_scrub_stamp":"2024-09-12T01:22:08.047386+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.047386+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:24.278106+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289432,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":556,"num_read_kb":18745,"num_write":1038,"num_write_kb":46080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'126","reported_seq":733,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.474888+0000","last_change":"2024-09-12T01:22:06.474888+0000","last_active":"2024-09-12T01:22:06.474888+0000","last_peered":"2024-09-12T01:22:06.474888+0000","last_clean":"2024-09-12T01:22:06.474888+0000","last_became_active":"2024-09-12T00:35:45.942814+0000","last_became_peered":"2024-09-12T00:35:45.942814+0000","last_unstale":"2024-09-12T01:22:06.474888+0000","last_undegraded":"2024-09-12T01:22:06.474888+0000","last_fullsized":"2024-09-12T01:22:06.474888+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'126","last_scrub_stamp":"2024-09-12T01:22:06.474688+0000","last_deep_scrub":"265'126","last_deep_scrub_stamp":"2024-09-12T01:22:06.474688+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.474688+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:09.883585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":574,"num_read_kb":483,"num_write":214,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'325","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.633517+0000","last_change":"2024-09-12T01:22:12.633517+0000","last_active":"2024-09-12T01:22:12.633517+0000","last_peered":"2024-09-12T01:22:12.633517+0000","last_clean":"2024-09-12T01:22:12.633517+0000","last_became_active":"2024-09-12T00:35:43.939128+0000","last_became_peered":"2024-09-12T00:35:43.939128+0000","last_unstale":"2024-09-12T01:22:12.633517+0000","last_undegraded":"2024-09-12T01:22:12.633517+0000","last_fullsized":"2024-09-12T01:22:12.633517+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'325","last_scrub_stamp":"2024-09-12T01:22:12.633317+0000","last_deep_scrub":"265'325","last_deep_scrub_stamp":"2024-09-12T01:22:12.633317+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.633317+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:15.440772+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":453,"num_read_kb":9693,"num_write":1061,"num_write_kb":13466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'4124","reported_seq":4720,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:01.277760+0000","last_change":"2024-09-12T00:35:45.944333+0000","last_active":"2024-09-12T01:20:01.277760+0000","last_peered":"2024-09-12T01:20:01.277760+0000","last_clean":"2024-09-12T01:20:01.277760+0000","last_became_active":"2024-09-12T00:35:45.943253+0000","last_became_peered":"2024-09-12T00:35:45.943253+0000","last_unstale":"2024-09-12T01:20:01.277760+0000","last_undegraded":"2024-09-12T01:20:01.277760+0000","last_fullsized":"2024-09-12T01:20:01.277760+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:04.022329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16581,"num_read_kb":13903,"num_write":6185,"num_write_kb":3084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'358","reported_seq":1027,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.573810+0000","last_change":"2024-09-12T01:22:10.573810+0000","last_active":"2024-09-12T01:22:10.573810+0000","last_peered":"2024-09-12T01:22:10.573810+0000","last_clean":"2024-09-12T01:22:10.573810+0000","last_became_active":"2024-09-12T00:35:43.933191+0000","last_became_peered":"2024-09-12T00:35:43.933191+0000","last_unstale":"2024-09-12T01:22:10.573810+0000","last_undegraded":"2024-09-12T01:22:10.573810+0000","last_fullsized":"2024-09-12T01:22:10.573810+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T01:22:10.573611+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T01:22:10.573611+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.573611+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:05.894738+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":549,"num_read_kb":44649,"num_write":1012,"num_write_kb":28437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'146","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.077594+0000","last_change":"2024-09-12T00:35:53.985466+0000","last_active":"2024-09-12T01:20:23.077594+0000","last_peered":"2024-09-12T01:20:23.077594+0000","last_clean":"2024-09-12T01:20:23.077594+0000","last_became_active":"2024-09-12T00:35:53.981609+0000","last_became_peered":"2024-09-12T00:35:53.981609+0000","last_unstale":"2024-09-12T01:20:23.077594+0000","last_undegraded":"2024-09-12T01:20:23.077594+0000","last_fullsized":"2024-09-12T01:20:23.077594+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:05.745536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":187,"num_read_kb":176,"num_write":375,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'259","reported_seq":910,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.620618+0000","last_change":"2024-09-12T01:22:17.620618+0000","last_active":"2024-09-12T01:22:17.620618+0000","last_peered":"2024-09-12T01:22:17.620618+0000","last_clean":"2024-09-12T01:22:17.620618+0000","last_became_active":"2024-09-12T00:35:45.948575+0000","last_became_peered":"2024-09-12T00:35:45.948575+0000","last_unstale":"2024-09-12T01:22:17.620618+0000","last_undegraded":"2024-09-12T01:22:17.620618+0000","last_fullsized":"2024-09-12T01:22:17.620618+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'259","last_scrub_stamp":"2024-09-12T01:22:17.620446+0000","last_deep_scrub":"265'259","last_deep_scrub_stamp":"2024-09-12T01:22:17.620446+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.620446+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:30.407262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1199,"num_read_kb":1005,"num_write":430,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"265'290","reported_seq":895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.507305+0000","last_change":"2024-09-12T01:22:12.507305+0000","last_active":"2024-09-12T01:22:12.507305+0000","last_peered":"2024-09-12T01:22:12.507305+0000","last_clean":"2024-09-12T01:22:12.507305+0000","last_became_active":"2024-09-12T00:35:43.956812+0000","last_became_peered":"2024-09-12T00:35:43.956812+0000","last_unstale":"2024-09-12T01:22:12.507305+0000","last_undegraded":"2024-09-12T01:22:12.507305+0000","last_fullsized":"2024-09-12T01:22:12.507305+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'290","last_scrub_stamp":"2024-09-12T01:22:12.507085+0000","last_deep_scrub":"265'290","last_deep_scrub_stamp":"2024-09-12T01:22:12.507085+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.507085+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:34.635767+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":413,"num_read_kb":399,"num_write":958,"num_write_kb":26614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.566225+0000","last_change":"2024-09-12T00:35:47.933988+0000","last_active":"2024-09-12T01:19:18.566225+0000","last_peered":"2024-09-12T01:19:18.566225+0000","last_clean":"2024-09-12T01:19:18.566225+0000","last_became_active":"2024-09-12T00:35:47.933249+0000","last_became_peered":"2024-09-12T00:35:47.933249+0000","last_unstale":"2024-09-12T01:19:18.566225+0000","last_undegraded":"2024-09-12T01:19:18.566225+0000","last_fullsized":"2024-09-12T01:19:18.566225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:47.085642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'339","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.735988+0000","last_change":"2024-09-12T00:35:49.952443+0000","last_active":"2024-09-12T01:21:57.735988+0000","last_peered":"2024-09-12T01:21:57.735988+0000","last_clean":"2024-09-12T01:21:57.735988+0000","last_became_active":"2024-09-12T00:35:49.951438+0000","last_became_peered":"2024-09-12T00:35:49.951438+0000","last_unstale":"2024-09-12T01:21:57.735988+0000","last_undegraded":"2024-09-12T01:21:57.735988+0000","last_fullsized":"2024-09-12T01:21:57.735988+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:58.543209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44615,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":554,"num_read_kb":1150,"num_write":438,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:22.795536+0000","last_change":"2024-09-12T00:35:51.984956+0000","last_active":"2024-09-12T01:19:22.795536+0000","last_peered":"2024-09-12T01:19:22.795536+0000","last_clean":"2024-09-12T01:19:22.795536+0000","last_became_active":"2024-09-12T00:35:51.984350+0000","last_became_peered":"2024-09-12T00:35:51.984350+0000","last_unstale":"2024-09-12T01:19:22.795536+0000","last_undegraded":"2024-09-12T01:19:22.795536+0000","last_fullsized":"2024-09-12T01:19:22.795536+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:25.562363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'203","reported_seq":802,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:17.912553+0000","last_change":"2024-09-12T00:35:53.998522+0000","last_active":"2024-09-12T01:20:17.912553+0000","last_peered":"2024-09-12T01:20:17.912553+0000","last_clean":"2024-09-12T01:20:17.912553+0000","last_became_active":"2024-09-12T00:35:53.995513+0000","last_became_peered":"2024-09-12T00:35:53.995513+0000","last_unstale":"2024-09-12T01:20:17.912553+0000","last_undegraded":"2024-09-12T01:20:17.912553+0000","last_fullsized":"2024-09-12T01:20:17.912553+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:28.256858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":409,"num_read_kb":360,"num_write":396,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'241","reported_seq":876,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.747102+0000","last_change":"2024-09-12T01:22:18.747102+0000","last_active":"2024-09-12T01:22:18.747102+0000","last_peered":"2024-09-12T01:22:18.747102+0000","last_clean":"2024-09-12T01:22:18.747102+0000","last_became_active":"2024-09-12T00:35:45.939962+0000","last_became_peered":"2024-09-12T00:35:45.939962+0000","last_unstale":"2024-09-12T01:22:18.747102+0000","last_undegraded":"2024-09-12T01:22:18.747102+0000","last_fullsized":"2024-09-12T01:22:18.747102+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'241","last_scrub_stamp":"2024-09-12T01:22:18.746925+0000","last_deep_scrub":"265'241","last_deep_scrub_stamp":"2024-09-12T01:22:18.746925+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.746925+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:11.880068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1036,"num_read_kb":844,"num_write":371,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'378","reported_seq":1091,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:02.751401+0000","last_change":"2024-09-12T01:22:02.751301+0000","last_active":"2024-09-12T01:22:02.751401+0000","last_peered":"2024-09-12T01:22:02.751401+0000","last_clean":"2024-09-12T01:22:02.751401+0000","last_became_active":"2024-09-12T00:35:43.944705+0000","last_became_peered":"2024-09-12T00:35:43.944705+0000","last_unstale":"2024-09-12T01:22:02.751401+0000","last_undegraded":"2024-09-12T01:22:02.751401+0000","last_fullsized":"2024-09-12T01:22:02.751401+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'378","last_scrub_stamp":"2024-09-12T01:22:02.751158+0000","last_deep_scrub":"265'378","last_deep_scrub_stamp":"2024-09-12T01:22:02.751158+0000","last_clean_scrub_stamp":"2024-09-12T01:22:02.751158+0000","objects_scrubbed":10,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:41.394968+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1344150,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":792,"num_read_kb":8209,"num_write":1184,"num_write_kb":28685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:58.575009+0000","last_change":"2024-09-12T00:35:47.946592+0000","last_active":"2024-09-12T01:17:58.575009+0000","last_peered":"2024-09-12T01:17:58.575009+0000","last_clean":"2024-09-12T01:17:58.575009+0000","last_became_active":"2024-09-12T00:35:47.945971+0000","last_became_peered":"2024-09-12T00:35:47.945971+0000","last_unstale":"2024-09-12T01:17:58.575009+0000","last_undegraded":"2024-09-12T01:17:58.575009+0000","last_fullsized":"2024-09-12T01:17:58.575009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:39.808186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'93","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:22.553249+0000","last_change":"2024-09-12T00:35:49.939105+0000","last_active":"2024-09-12T01:19:22.553249+0000","last_peered":"2024-09-12T01:19:22.553249+0000","last_clean":"2024-09-12T01:19:22.553249+0000","last_became_active":"2024-09-12T00:35:49.938374+0000","last_became_peered":"2024-09-12T00:35:49.938374+0000","last_unstale":"2024-09-12T01:19:22.553249+0000","last_undegraded":"2024-09-12T01:19:22.553249+0000","last_fullsized":"2024-09-12T01:19:22.553249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:28.914067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:22.553202+0000","last_change":"2024-09-12T00:35:51.975432+0000","last_active":"2024-09-12T01:19:22.553202+0000","last_peered":"2024-09-12T01:19:22.553202+0000","last_clean":"2024-09-12T01:19:22.553202+0000","last_became_active":"2024-09-12T00:35:51.974659+0000","last_became_peered":"2024-09-12T00:35:51.974659+0000","last_unstale":"2024-09-12T01:19:22.553202+0000","last_undegraded":"2024-09-12T01:19:22.553202+0000","last_fullsized":"2024-09-12T01:19:22.553202+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:42.719938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'114","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:44.542108+0000","last_change":"2024-09-12T00:35:53.994008+0000","last_active":"2024-09-12T01:19:44.542108+0000","last_peered":"2024-09-12T01:19:44.542108+0000","last_clean":"2024-09-12T01:19:44.542108+0000","last_became_active":"2024-09-12T00:35:53.992311+0000","last_became_peered":"2024-09-12T00:35:53.992311+0000","last_unstale":"2024-09-12T01:19:44.542108+0000","last_undegraded":"2024-09-12T01:19:44.542108+0000","last_fullsized":"2024-09-12T01:19:44.542108+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:28.357194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":265,"num_read_kb":226,"num_write":268,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'268","reported_seq":921,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.573840+0000","last_change":"2024-09-12T01:22:15.573840+0000","last_active":"2024-09-12T01:22:15.573840+0000","last_peered":"2024-09-12T01:22:15.573840+0000","last_clean":"2024-09-12T01:22:15.573840+0000","last_became_active":"2024-09-12T00:35:45.941543+0000","last_became_peered":"2024-09-12T00:35:45.941543+0000","last_unstale":"2024-09-12T01:22:15.573840+0000","last_undegraded":"2024-09-12T01:22:15.573840+0000","last_fullsized":"2024-09-12T01:22:15.573840+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'268","last_scrub_stamp":"2024-09-12T01:22:15.573638+0000","last_deep_scrub":"265'268","last_deep_scrub_stamp":"2024-09-12T01:22:15.573638+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.573638+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:55.006640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1165,"num_read_kb":955,"num_write":416,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'393","reported_seq":1115,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.480017+0000","last_change":"2024-09-12T01:22:11.480017+0000","last_active":"2024-09-12T01:22:11.480017+0000","last_peered":"2024-09-12T01:22:11.480017+0000","last_clean":"2024-09-12T01:22:11.480017+0000","last_became_active":"2024-09-12T00:35:43.952543+0000","last_became_peered":"2024-09-12T00:35:43.952543+0000","last_unstale":"2024-09-12T01:22:11.480017+0000","last_undegraded":"2024-09-12T01:22:11.480017+0000","last_fullsized":"2024-09-12T01:22:11.480017+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'393","last_scrub_stamp":"2024-09-12T01:22:11.479778+0000","last_deep_scrub":"265'393","last_deep_scrub_stamp":"2024-09-12T01:22:11.479778+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.479778+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:16.175100+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262200,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":772,"num_read_kb":780,"num_write":1221,"num_write_kb":19641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.594613+0000","last_change":"2024-09-12T00:35:47.934527+0000","last_active":"2024-09-12T01:19:18.594613+0000","last_peered":"2024-09-12T01:19:18.594613+0000","last_clean":"2024-09-12T01:19:18.594613+0000","last_became_active":"2024-09-12T00:35:47.933896+0000","last_became_peered":"2024-09-12T00:35:47.933896+0000","last_unstale":"2024-09-12T01:19:18.594613+0000","last_undegraded":"2024-09-12T01:19:18.594613+0000","last_fullsized":"2024-09-12T01:19:18.594613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:11.718346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'120","reported_seq":670,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.374611+0000","last_change":"2024-09-12T01:22:18.374611+0000","last_active":"2024-09-12T01:22:18.374611+0000","last_peered":"2024-09-12T01:22:18.374611+0000","last_clean":"2024-09-12T01:22:18.374611+0000","last_became_active":"2024-09-12T00:35:49.936846+0000","last_became_peered":"2024-09-12T00:35:49.936846+0000","last_unstale":"2024-09-12T01:22:18.374611+0000","last_undegraded":"2024-09-12T01:22:18.374611+0000","last_fullsized":"2024-09-12T01:22:18.374611+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'120","last_scrub_stamp":"2024-09-12T01:22:18.374419+0000","last_deep_scrub":"265'120","last_deep_scrub_stamp":"2024-09-12T01:22:18.374419+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.374419+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:24.935816+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":139,"num_read_kb":131,"num_write":92,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'773","reported_seq":2288,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.434294+0000","last_change":"2024-09-12T00:35:51.980021+0000","last_active":"2024-09-12T01:21:57.434294+0000","last_peered":"2024-09-12T01:21:57.434294+0000","last_clean":"2024-09-12T01:21:57.434294+0000","last_became_active":"2024-09-12T00:35:51.979288+0000","last_became_peered":"2024-09-12T00:35:51.979288+0000","last_unstale":"2024-09-12T01:21:57.434294+0000","last_undegraded":"2024-09-12T01:21:57.434294+0000","last_fullsized":"2024-09-12T01:21:57.434294+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:56.227079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'188","reported_seq":1012,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.127347+0000","last_change":"2024-09-12T00:35:54.014161+0000","last_active":"2024-09-12T01:20:23.127347+0000","last_peered":"2024-09-12T01:20:23.127347+0000","last_clean":"2024-09-12T01:20:23.127347+0000","last_became_active":"2024-09-12T00:35:54.013299+0000","last_became_peered":"2024-09-12T00:35:54.013299+0000","last_unstale":"2024-09-12T01:20:23.127347+0000","last_undegraded":"2024-09-12T01:20:23.127347+0000","last_fullsized":"2024-09-12T01:20:23.127347+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:35.433076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":837,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":580,"num_read_kb":578,"num_write":407,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'105","reported_seq":685,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.602937+0000","last_change":"2024-09-12T01:22:19.602937+0000","last_active":"2024-09-12T01:22:19.602937+0000","last_peered":"2024-09-12T01:22:19.602937+0000","last_clean":"2024-09-12T01:22:19.602937+0000","last_became_active":"2024-09-12T00:35:45.954858+0000","last_became_peered":"2024-09-12T00:35:45.954858+0000","last_unstale":"2024-09-12T01:22:19.602937+0000","last_undegraded":"2024-09-12T01:22:19.602937+0000","last_fullsized":"2024-09-12T01:22:19.602937+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'105","last_scrub_stamp":"2024-09-12T01:22:19.602704+0000","last_deep_scrub":"265'105","last_deep_scrub_stamp":"2024-09-12T01:22:19.602704+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.602704+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:45.698367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":470,"num_read_kb":391,"num_write":166,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'358","reported_seq":1022,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.147932+0000","last_change":"2024-09-12T01:22:06.147932+0000","last_active":"2024-09-12T01:22:06.147932+0000","last_peered":"2024-09-12T01:22:06.147932+0000","last_clean":"2024-09-12T01:22:06.147932+0000","last_became_active":"2024-09-12T00:35:43.930867+0000","last_became_peered":"2024-09-12T00:35:43.930867+0000","last_unstale":"2024-09-12T01:22:06.147932+0000","last_undegraded":"2024-09-12T01:22:06.147932+0000","last_fullsized":"2024-09-12T01:22:06.147932+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T01:22:06.147754+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T01:22:06.147754+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.147754+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:37.175214+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291487,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":529,"num_read_kb":73816,"num_write":1070,"num_write_kb":41341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.566330+0000","last_change":"2024-09-12T00:35:47.931572+0000","last_active":"2024-09-12T01:19:18.566330+0000","last_peered":"2024-09-12T01:19:18.566330+0000","last_clean":"2024-09-12T01:19:18.566330+0000","last_became_active":"2024-09-12T00:35:47.930883+0000","last_became_peered":"2024-09-12T00:35:47.930883+0000","last_unstale":"2024-09-12T01:19:18.566330+0000","last_undegraded":"2024-09-12T01:19:18.566330+0000","last_fullsized":"2024-09-12T01:19:18.566330+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:26.632000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'289","reported_seq":861,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.543556+0000","last_change":"2024-09-12T00:35:50.030382+0000","last_active":"2024-09-12T01:21:57.543556+0000","last_peered":"2024-09-12T01:21:57.543556+0000","last_clean":"2024-09-12T01:21:57.543556+0000","last_became_active":"2024-09-12T00:35:50.029236+0000","last_became_peered":"2024-09-12T00:35:50.029236+0000","last_unstale":"2024-09-12T01:21:57.543556+0000","last_undegraded":"2024-09-12T01:21:57.543556+0000","last_fullsized":"2024-09-12T01:21:57.543556+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:36.054917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54671,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":1128,"num_write":386,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'786","reported_seq":2331,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.316034+0000","last_change":"2024-09-12T00:35:51.983959+0000","last_active":"2024-09-12T01:21:57.316034+0000","last_peered":"2024-09-12T01:21:57.316034+0000","last_clean":"2024-09-12T01:21:57.316034+0000","last_became_active":"2024-09-12T00:35:51.983271+0000","last_became_peered":"2024-09-12T00:35:51.983271+0000","last_unstale":"2024-09-12T01:21:57.316034+0000","last_undegraded":"2024-09-12T01:21:57.316034+0000","last_fullsized":"2024-09-12T01:21:57.316034+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:13.842922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'260","reported_seq":940,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.783023+0000","last_change":"2024-09-12T01:22:17.783023+0000","last_active":"2024-09-12T01:22:17.783023+0000","last_peered":"2024-09-12T01:22:17.783023+0000","last_clean":"2024-09-12T01:22:17.783023+0000","last_became_active":"2024-09-12T00:35:45.940073+0000","last_became_peered":"2024-09-12T00:35:45.940073+0000","last_unstale":"2024-09-12T01:22:17.783023+0000","last_undegraded":"2024-09-12T01:22:17.783023+0000","last_fullsized":"2024-09-12T01:22:17.783023+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'260","last_scrub_stamp":"2024-09-12T01:22:17.782804+0000","last_deep_scrub":"265'260","last_deep_scrub_stamp":"2024-09-12T01:22:17.782804+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.782804+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:47.983931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1192,"num_read_kb":982,"num_write":401,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'356","reported_seq":1073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.438750+0000","last_change":"2024-09-12T01:22:09.438750+0000","last_active":"2024-09-12T01:22:09.438750+0000","last_peered":"2024-09-12T01:22:09.438750+0000","last_clean":"2024-09-12T01:22:09.438750+0000","last_became_active":"2024-09-12T00:35:43.956814+0000","last_became_peered":"2024-09-12T00:35:43.956814+0000","last_unstale":"2024-09-12T01:22:09.438750+0000","last_undegraded":"2024-09-12T01:22:09.438750+0000","last_fullsized":"2024-09-12T01:22:09.438750+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T01:22:09.438513+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T01:22:09.438513+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.438513+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:18.913267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":767,"num_read_kb":6356,"num_write":996,"num_write_kb":17273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.791834+0000","last_change":"2024-09-12T00:35:47.945726+0000","last_active":"2024-09-12T01:19:07.791834+0000","last_peered":"2024-09-12T01:19:07.791834+0000","last_clean":"2024-09-12T01:19:07.791834+0000","last_became_active":"2024-09-12T00:35:47.944913+0000","last_became_peered":"2024-09-12T00:35:47.944913+0000","last_unstale":"2024-09-12T01:19:07.791834+0000","last_undegraded":"2024-09-12T01:19:07.791834+0000","last_fullsized":"2024-09-12T01:19:07.791834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:02.558771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'348","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.872006+0000","last_change":"2024-09-12T00:35:50.028219+0000","last_active":"2024-09-12T01:21:57.872006+0000","last_peered":"2024-09-12T01:21:57.872006+0000","last_clean":"2024-09-12T01:21:57.872006+0000","last_became_active":"2024-09-12T00:35:50.027282+0000","last_became_peered":"2024-09-12T00:35:50.027282+0000","last_unstale":"2024-09-12T01:21:57.872006+0000","last_undegraded":"2024-09-12T01:21:57.872006+0000","last_fullsized":"2024-09-12T01:21:57.872006+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:27.196205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45216,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":563,"num_read_kb":1133,"num_write":440,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.569449+0000","last_change":"2024-09-12T00:35:51.972158+0000","last_active":"2024-09-12T01:18:38.569449+0000","last_peered":"2024-09-12T01:18:38.569449+0000","last_clean":"2024-09-12T01:18:38.569449+0000","last_became_active":"2024-09-12T00:35:51.971491+0000","last_became_peered":"2024-09-12T00:35:51.971491+0000","last_unstale":"2024-09-12T01:18:38.569449+0000","last_undegraded":"2024-09-12T01:18:38.569449+0000","last_fullsized":"2024-09-12T01:18:38.569449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:22.911772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'555","reported_seq":1370,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.367346+0000","last_change":"2024-09-12T00:35:54.000046+0000","last_active":"2024-09-12T01:21:25.367346+0000","last_peered":"2024-09-12T01:21:25.367346+0000","last_clean":"2024-09-12T01:21:25.367346+0000","last_became_active":"2024-09-12T00:35:53.996514+0000","last_became_peered":"2024-09-12T00:35:53.996514+0000","last_unstale":"2024-09-12T01:21:25.367346+0000","last_undegraded":"2024-09-12T01:21:25.367346+0000","last_fullsized":"2024-09-12T01:21:25.367346+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:55.200677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1307,"num_read_kb":1296,"num_write":1166,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'136","reported_seq":748,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.018297+0000","last_change":"2024-09-12T01:22:10.018297+0000","last_active":"2024-09-12T01:22:10.018297+0000","last_peered":"2024-09-12T01:22:10.018297+0000","last_clean":"2024-09-12T01:22:10.018297+0000","last_became_active":"2024-09-12T00:35:45.943083+0000","last_became_peered":"2024-09-12T00:35:45.943083+0000","last_unstale":"2024-09-12T01:22:10.018297+0000","last_undegraded":"2024-09-12T01:22:10.018297+0000","last_fullsized":"2024-09-12T01:22:10.018297+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'136","last_scrub_stamp":"2024-09-12T01:22:10.018112+0000","last_deep_scrub":"265'136","last_deep_scrub_stamp":"2024-09-12T01:22:10.018112+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.018112+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:19.240513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":650,"num_read_kb":541,"num_write":222,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'345","reported_seq":996,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.455546+0000","last_change":"2024-09-12T01:22:08.455546+0000","last_active":"2024-09-12T01:22:08.455546+0000","last_peered":"2024-09-12T01:22:08.455546+0000","last_clean":"2024-09-12T01:22:08.455546+0000","last_became_active":"2024-09-12T00:35:43.953664+0000","last_became_peered":"2024-09-12T00:35:43.953664+0000","last_unstale":"2024-09-12T01:22:08.455546+0000","last_undegraded":"2024-09-12T01:22:08.455546+0000","last_fullsized":"2024-09-12T01:22:08.455546+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'345","last_scrub_stamp":"2024-09-12T01:22:08.455336+0000","last_deep_scrub":"265'345","last_deep_scrub_stamp":"2024-09-12T01:22:08.455336+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.455336+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:59.956866+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288989,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":479,"num_read_kb":49556,"num_write":1051,"num_write_kb":45556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.362512+0000","last_change":"2024-09-12T01:22:16.362512+0000","last_active":"2024-09-12T01:22:16.362512+0000","last_peered":"2024-09-12T01:22:16.362512+0000","last_clean":"2024-09-12T01:22:16.362512+0000","last_became_active":"2024-09-12T00:35:47.936972+0000","last_became_peered":"2024-09-12T00:35:47.936972+0000","last_unstale":"2024-09-12T01:22:16.362512+0000","last_undegraded":"2024-09-12T01:22:16.362512+0000","last_fullsized":"2024-09-12T01:22:16.362512+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:16.362319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:16.362319+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.362319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:40.167192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'266","reported_seq":838,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.165456+0000","last_change":"2024-09-12T00:35:49.955401+0000","last_active":"2024-09-12T01:21:57.165456+0000","last_peered":"2024-09-12T01:21:57.165456+0000","last_clean":"2024-09-12T01:21:57.165456+0000","last_became_active":"2024-09-12T00:35:49.954568+0000","last_became_peered":"2024-09-12T00:35:49.954568+0000","last_unstale":"2024-09-12T01:21:57.165456+0000","last_undegraded":"2024-09-12T01:21:57.165456+0000","last_fullsized":"2024-09-12T01:21:57.165456+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:57.669990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45999,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":441,"num_read_kb":1004,"num_write":356,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:23.595568+0000","last_change":"2024-09-12T00:35:51.982044+0000","last_active":"2024-09-12T01:19:23.595568+0000","last_peered":"2024-09-12T01:19:23.595568+0000","last_clean":"2024-09-12T01:19:23.595568+0000","last_became_active":"2024-09-12T00:35:51.981326+0000","last_became_peered":"2024-09-12T00:35:51.981326+0000","last_unstale":"2024-09-12T01:19:23.595568+0000","last_undegraded":"2024-09-12T01:19:23.595568+0000","last_fullsized":"2024-09-12T01:19:23.595568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:53.955317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'2394","reported_seq":4228,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:14.960049+0000","last_change":"2024-09-12T00:35:53.975817+0000","last_active":"2024-09-12T01:21:14.960049+0000","last_peered":"2024-09-12T01:21:14.960049+0000","last_clean":"2024-09-12T01:21:14.960049+0000","last_became_active":"2024-09-12T00:35:53.975054+0000","last_became_peered":"2024-09-12T00:35:53.975054+0000","last_unstale":"2024-09-12T01:21:14.960049+0000","last_undegraded":"2024-09-12T01:21:14.960049+0000","last_fullsized":"2024-09-12T01:21:14.960049+0000","mapping_epoch":34,"log_start":"265'2300","ondisk_log_start":"265'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":2300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:31.278726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6031,"num_read_kb":6023,"num_write":4852,"num_write_kb":1786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'134","reported_seq":758,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.095091+0000","last_change":"2024-09-12T01:22:20.095091+0000","last_active":"2024-09-12T01:22:20.095091+0000","last_peered":"2024-09-12T01:22:20.095091+0000","last_clean":"2024-09-12T01:22:20.095091+0000","last_became_active":"2024-09-12T00:35:45.953664+0000","last_became_peered":"2024-09-12T00:35:45.953664+0000","last_unstale":"2024-09-12T01:22:20.095091+0000","last_undegraded":"2024-09-12T01:22:20.095091+0000","last_fullsized":"2024-09-12T01:22:20.095091+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'134","last_scrub_stamp":"2024-09-12T01:22:20.094911+0000","last_deep_scrub":"265'134","last_deep_scrub_stamp":"2024-09-12T01:22:20.094911+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.094911+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:20.389870+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":607,"num_read_kb":511,"num_write":198,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'330","reported_seq":1040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.446889+0000","last_change":"2024-09-12T01:22:10.446889+0000","last_active":"2024-09-12T01:22:10.446889+0000","last_peered":"2024-09-12T01:22:10.446889+0000","last_clean":"2024-09-12T01:22:10.446889+0000","last_became_active":"2024-09-12T00:35:43.942454+0000","last_became_peered":"2024-09-12T00:35:43.942454+0000","last_unstale":"2024-09-12T01:22:10.446889+0000","last_undegraded":"2024-09-12T01:22:10.446889+0000","last_fullsized":"2024-09-12T01:22:10.446889+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'330","last_scrub_stamp":"2024-09-12T01:22:10.446675+0000","last_deep_scrub":"265'330","last_deep_scrub_stamp":"2024-09-12T01:22:10.446675+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.446675+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:23.036504+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":618,"num_read_kb":3434,"num_write":1027,"num_write_kb":23754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.382878+0000","last_change":"2024-09-12T01:22:13.382878+0000","last_active":"2024-09-12T01:22:13.382878+0000","last_peered":"2024-09-12T01:22:13.382878+0000","last_clean":"2024-09-12T01:22:13.382878+0000","last_became_active":"2024-09-12T00:35:47.942189+0000","last_became_peered":"2024-09-12T00:35:47.942189+0000","last_unstale":"2024-09-12T01:22:13.382878+0000","last_undegraded":"2024-09-12T01:22:13.382878+0000","last_fullsized":"2024-09-12T01:22:13.382878+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:13.382636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:13.382636+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.382636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:49.972499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'318","reported_seq":913,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.738514+0000","last_change":"2024-09-12T00:35:49.943225+0000","last_active":"2024-09-12T01:21:56.738514+0000","last_peered":"2024-09-12T01:21:56.738514+0000","last_clean":"2024-09-12T01:21:56.738514+0000","last_became_active":"2024-09-12T00:35:49.942480+0000","last_became_peered":"2024-09-12T00:35:49.942480+0000","last_unstale":"2024-09-12T01:21:56.738514+0000","last_undegraded":"2024-09-12T01:21:56.738514+0000","last_fullsized":"2024-09-12T01:21:56.738514+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:22.668385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48782,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":529,"num_read_kb":1149,"num_write":428,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'772","reported_seq":2437,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.510993+0000","last_change":"2024-09-12T00:35:51.985725+0000","last_active":"2024-09-12T01:21:56.510993+0000","last_peered":"2024-09-12T01:21:56.510993+0000","last_clean":"2024-09-12T01:21:56.510993+0000","last_became_active":"2024-09-12T00:35:51.984968+0000","last_became_peered":"2024-09-12T00:35:51.984968+0000","last_unstale":"2024-09-12T01:21:56.510993+0000","last_undegraded":"2024-09-12T01:21:56.510993+0000","last_fullsized":"2024-09-12T01:21:56.510993+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:26.578990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'109","reported_seq":600,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:24.451554+0000","last_change":"2024-09-12T00:35:53.995319+0000","last_active":"2024-09-12T01:21:24.451554+0000","last_peered":"2024-09-12T01:21:24.451554+0000","last_clean":"2024-09-12T01:21:24.451554+0000","last_became_active":"2024-09-12T00:35:53.992664+0000","last_became_peered":"2024-09-12T00:35:53.992664+0000","last_unstale":"2024-09-12T01:21:24.451554+0000","last_undegraded":"2024-09-12T01:21:24.451554+0000","last_fullsized":"2024-09-12T01:21:24.451554+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:16.209394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":110,"num_write":262,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'190","reported_seq":805,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.525068+0000","last_change":"2024-09-12T01:22:14.525068+0000","last_active":"2024-09-12T01:22:14.525068+0000","last_peered":"2024-09-12T01:22:14.525068+0000","last_clean":"2024-09-12T01:22:14.525068+0000","last_became_active":"2024-09-12T00:35:45.939817+0000","last_became_peered":"2024-09-12T00:35:45.939817+0000","last_unstale":"2024-09-12T01:22:14.525068+0000","last_undegraded":"2024-09-12T01:22:14.525068+0000","last_fullsized":"2024-09-12T01:22:14.525068+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'190","last_scrub_stamp":"2024-09-12T01:22:14.524892+0000","last_deep_scrub":"265'190","last_deep_scrub_stamp":"2024-09-12T01:22:14.524892+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.524892+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:07.182122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":809,"num_read_kb":663,"num_write":268,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'374","reported_seq":1036,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.814217+0000","last_change":"2024-09-12T01:22:07.814217+0000","last_active":"2024-09-12T01:22:07.814217+0000","last_peered":"2024-09-12T01:22:07.814217+0000","last_clean":"2024-09-12T01:22:07.814217+0000","last_became_active":"2024-09-12T00:35:43.912282+0000","last_became_peered":"2024-09-12T00:35:43.912282+0000","last_unstale":"2024-09-12T01:22:07.814217+0000","last_undegraded":"2024-09-12T01:22:07.814217+0000","last_fullsized":"2024-09-12T01:22:07.814217+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T01:22:07.813838+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T01:22:07.813838+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.813838+0000","objects_scrubbed":15,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:43.752646+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6327796,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":526,"num_read_kb":19021,"num_write":1167,"num_write_kb":32789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.373561+0000","last_change":"2024-09-12T01:22:14.373561+0000","last_active":"2024-09-12T01:22:14.373561+0000","last_peered":"2024-09-12T01:22:14.373561+0000","last_clean":"2024-09-12T01:22:14.373561+0000","last_became_active":"2024-09-12T00:35:47.946636+0000","last_became_peered":"2024-09-12T00:35:47.946636+0000","last_unstale":"2024-09-12T01:22:14.373561+0000","last_undegraded":"2024-09-12T01:22:14.373561+0000","last_fullsized":"2024-09-12T01:22:14.373561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:14.373377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:14.373377+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.373377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:28.908478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'509","reported_seq":1146,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.273493+0000","last_change":"2024-09-12T00:35:49.951472+0000","last_active":"2024-09-12T01:21:57.273493+0000","last_peered":"2024-09-12T01:21:57.273493+0000","last_clean":"2024-09-12T01:21:57.273493+0000","last_became_active":"2024-09-12T00:35:49.950845+0000","last_became_peered":"2024-09-12T00:35:49.950845+0000","last_unstale":"2024-09-12T01:21:57.273493+0000","last_undegraded":"2024-09-12T01:21:57.273493+0000","last_fullsized":"2024-09-12T01:21:57.273493+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:03.493730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100676,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":870,"num_read_kb":2075,"num_write":716,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.408954+0000","last_change":"2024-09-12T01:22:19.408954+0000","last_active":"2024-09-12T01:22:19.408954+0000","last_peered":"2024-09-12T01:22:19.408954+0000","last_clean":"2024-09-12T01:22:19.408954+0000","last_became_active":"2024-09-12T00:35:51.978188+0000","last_became_peered":"2024-09-12T00:35:51.978188+0000","last_unstale":"2024-09-12T01:22:19.408954+0000","last_undegraded":"2024-09-12T01:22:19.408954+0000","last_fullsized":"2024-09-12T01:22:19.408954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:19.408763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:19.408763+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.408763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:33.873801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'133","reported_seq":651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:07.813191+0000","last_change":"2024-09-12T00:35:53.986321+0000","last_active":"2024-09-12T01:20:07.813191+0000","last_peered":"2024-09-12T01:20:07.813191+0000","last_clean":"2024-09-12T01:20:07.813191+0000","last_became_active":"2024-09-12T00:35:53.985635+0000","last_became_peered":"2024-09-12T00:35:53.985635+0000","last_unstale":"2024-09-12T01:20:07.813191+0000","last_undegraded":"2024-09-12T01:20:07.813191+0000","last_fullsized":"2024-09-12T01:20:07.813191+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:38.196418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":203,"num_read_kb":181,"num_write":311,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'153","reported_seq":756,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.992417+0000","last_change":"2024-09-12T01:22:10.992417+0000","last_active":"2024-09-12T01:22:10.992417+0000","last_peered":"2024-09-12T01:22:10.992417+0000","last_clean":"2024-09-12T01:22:10.992417+0000","last_became_active":"2024-09-12T00:35:45.938135+0000","last_became_peered":"2024-09-12T00:35:45.938135+0000","last_unstale":"2024-09-12T01:22:10.992417+0000","last_undegraded":"2024-09-12T01:22:10.992417+0000","last_fullsized":"2024-09-12T01:22:10.992417+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'153","last_scrub_stamp":"2024-09-12T01:22:10.992236+0000","last_deep_scrub":"265'153","last_deep_scrub_stamp":"2024-09-12T01:22:10.992236+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.992236+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:32.291897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":684,"num_read_kb":556,"num_write":242,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'387","reported_seq":1033,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.627241+0000","last_change":"2024-09-12T01:22:05.627241+0000","last_active":"2024-09-12T01:22:05.627241+0000","last_peered":"2024-09-12T01:22:05.627241+0000","last_clean":"2024-09-12T01:22:05.627241+0000","last_became_active":"2024-09-12T00:35:43.936713+0000","last_became_peered":"2024-09-12T00:35:43.936713+0000","last_unstale":"2024-09-12T01:22:05.627241+0000","last_undegraded":"2024-09-12T01:22:05.627241+0000","last_fullsized":"2024-09-12T01:22:05.627241+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'387","last_scrub_stamp":"2024-09-12T01:22:05.626966+0000","last_deep_scrub":"265'387","last_deep_scrub_stamp":"2024-09-12T01:22:05.626966+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.626966+0000","objects_scrubbed":8,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:33.798620+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730170,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":551,"num_read_kb":26422,"num_write":1213,"num_write_kb":29680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.334177+0000","last_change":"2024-09-12T01:22:15.334177+0000","last_active":"2024-09-12T01:22:15.334177+0000","last_peered":"2024-09-12T01:22:15.334177+0000","last_clean":"2024-09-12T01:22:15.334177+0000","last_became_active":"2024-09-12T00:35:47.938604+0000","last_became_peered":"2024-09-12T00:35:47.938604+0000","last_unstale":"2024-09-12T01:22:15.334177+0000","last_undegraded":"2024-09-12T01:22:15.334177+0000","last_fullsized":"2024-09-12T01:22:15.334177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:15.333992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:15.333992+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.333992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:44.787901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'307","reported_seq":890,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.303125+0000","last_change":"2024-09-12T00:35:49.941521+0000","last_active":"2024-09-12T01:21:57.303125+0000","last_peered":"2024-09-12T01:21:57.303125+0000","last_clean":"2024-09-12T01:21:57.303125+0000","last_became_active":"2024-09-12T00:35:49.940679+0000","last_became_peered":"2024-09-12T00:35:49.940679+0000","last_unstale":"2024-09-12T01:21:57.303125+0000","last_undegraded":"2024-09-12T01:21:57.303125+0000","last_fullsized":"2024-09-12T01:21:57.303125+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:45.183044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52849,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":502,"num_read_kb":1074,"num_write":450,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":483,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:48.567233+0000","last_change":"2024-09-12T00:35:51.978558+0000","last_active":"2024-09-12T01:18:48.567233+0000","last_peered":"2024-09-12T01:18:48.567233+0000","last_clean":"2024-09-12T01:18:48.567233+0000","last_became_active":"2024-09-12T00:35:51.977807+0000","last_became_peered":"2024-09-12T00:35:51.977807+0000","last_unstale":"2024-09-12T01:18:48.567233+0000","last_undegraded":"2024-09-12T01:18:48.567233+0000","last_fullsized":"2024-09-12T01:18:48.567233+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:54.797988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'99","reported_seq":603,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:14.964716+0000","last_change":"2024-09-12T00:35:54.003890+0000","last_active":"2024-09-12T01:21:14.964716+0000","last_peered":"2024-09-12T01:21:14.964716+0000","last_clean":"2024-09-12T01:21:14.964716+0000","last_became_active":"2024-09-12T00:35:54.003115+0000","last_became_peered":"2024-09-12T00:35:54.003115+0000","last_unstale":"2024-09-12T01:21:14.964716+0000","last_undegraded":"2024-09-12T01:21:14.964716+0000","last_fullsized":"2024-09-12T01:21:14.964716+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":131,"num_write":237,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'498","reported_seq":1289,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.027976+0000","last_change":"2024-09-12T01:22:12.027976+0000","last_active":"2024-09-12T01:22:12.027976+0000","last_peered":"2024-09-12T01:22:12.027976+0000","last_clean":"2024-09-12T01:22:12.027976+0000","last_became_active":"2024-09-12T00:35:45.929526+0000","last_became_peered":"2024-09-12T00:35:45.929526+0000","last_unstale":"2024-09-12T01:22:12.027976+0000","last_undegraded":"2024-09-12T01:22:12.027976+0000","last_fullsized":"2024-09-12T01:22:12.027976+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'498","last_scrub_stamp":"2024-09-12T01:22:12.027707+0000","last_deep_scrub":"265'498","last_deep_scrub_stamp":"2024-09-12T01:22:12.027707+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.027707+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:44.755420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2425,"num_read_kb":2075,"num_write":878,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'279","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.151970+0000","last_change":"2024-09-12T01:22:07.151970+0000","last_active":"2024-09-12T01:22:07.151970+0000","last_peered":"2024-09-12T01:22:07.151970+0000","last_clean":"2024-09-12T01:22:07.151970+0000","last_became_active":"2024-09-12T00:35:43.944483+0000","last_became_peered":"2024-09-12T00:35:43.944483+0000","last_unstale":"2024-09-12T01:22:07.151970+0000","last_undegraded":"2024-09-12T01:22:07.151970+0000","last_fullsized":"2024-09-12T01:22:07.151970+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'279","last_scrub_stamp":"2024-09-12T01:22:07.151758+0000","last_deep_scrub":"265'279","last_deep_scrub_stamp":"2024-09-12T01:22:07.151758+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.151758+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:49.773260+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":355,"num_read_kb":347,"num_write":887,"num_write_kb":15629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.223262+0000","last_change":"2024-09-12T01:22:20.223262+0000","last_active":"2024-09-12T01:22:20.223262+0000","last_peered":"2024-09-12T01:22:20.223262+0000","last_clean":"2024-09-12T01:22:20.223262+0000","last_became_active":"2024-09-12T00:35:47.943382+0000","last_became_peered":"2024-09-12T00:35:47.943382+0000","last_unstale":"2024-09-12T01:22:20.223262+0000","last_undegraded":"2024-09-12T01:22:20.223262+0000","last_fullsized":"2024-09-12T01:22:20.223262+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:20.223057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:20.223057+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.223057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:18.669022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'319","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.055614+0000","last_change":"2024-09-12T00:35:49.949821+0000","last_active":"2024-09-12T01:21:57.055614+0000","last_peered":"2024-09-12T01:21:57.055614+0000","last_clean":"2024-09-12T01:21:57.055614+0000","last_became_active":"2024-09-12T00:35:49.949283+0000","last_became_peered":"2024-09-12T00:35:49.949283+0000","last_unstale":"2024-09-12T01:21:57.055614+0000","last_undegraded":"2024-09-12T01:21:57.055614+0000","last_fullsized":"2024-09-12T01:21:57.055614+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:44.062401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52286,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":532,"num_read_kb":1204,"num_write":436,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'725","reported_seq":2264,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.400295+0000","last_change":"2024-09-12T01:22:20.400295+0000","last_active":"2024-09-12T01:22:20.400295+0000","last_peered":"2024-09-12T01:22:20.400295+0000","last_clean":"2024-09-12T01:22:20.400295+0000","last_became_active":"2024-09-12T00:35:51.979162+0000","last_became_peered":"2024-09-12T00:35:51.979162+0000","last_unstale":"2024-09-12T01:22:20.400295+0000","last_undegraded":"2024-09-12T01:22:20.400295+0000","last_fullsized":"2024-09-12T01:22:20.400295+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'725","last_scrub_stamp":"2024-09-12T01:22:20.400017+0000","last_deep_scrub":"265'725","last_deep_scrub_stamp":"2024-09-12T01:22:20.400017+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.400017+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:36.962961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'115","reported_seq":603,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.981076+0000","last_change":"2024-09-12T00:35:53.982884+0000","last_active":"2024-09-12T01:20:22.981076+0000","last_peered":"2024-09-12T01:20:22.981076+0000","last_clean":"2024-09-12T01:20:22.981076+0000","last_became_active":"2024-09-12T00:35:53.981735+0000","last_became_peered":"2024-09-12T00:35:53.981735+0000","last_unstale":"2024-09-12T01:20:22.981076+0000","last_undegraded":"2024-09-12T01:20:22.981076+0000","last_fullsized":"2024-09-12T01:20:22.981076+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:48.987492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":92,"num_write":265,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'349","reported_seq":1047,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.978642+0000","last_change":"2024-09-12T01:22:12.978642+0000","last_active":"2024-09-12T01:22:12.978642+0000","last_peered":"2024-09-12T01:22:12.978642+0000","last_clean":"2024-09-12T01:22:12.978642+0000","last_became_active":"2024-09-12T00:35:45.953935+0000","last_became_peered":"2024-09-12T00:35:45.953935+0000","last_unstale":"2024-09-12T01:22:12.978642+0000","last_undegraded":"2024-09-12T01:22:12.978642+0000","last_fullsized":"2024-09-12T01:22:12.978642+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'349","last_scrub_stamp":"2024-09-12T01:22:12.978442+0000","last_deep_scrub":"265'349","last_deep_scrub_stamp":"2024-09-12T01:22:12.978442+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.978442+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:16.697478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1509,"num_read_kb":1228,"num_write":558,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'331","reported_seq":990,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.065472+0000","last_change":"2024-09-12T01:22:05.065472+0000","last_active":"2024-09-12T01:22:05.065472+0000","last_peered":"2024-09-12T01:22:05.065472+0000","last_clean":"2024-09-12T01:22:05.065472+0000","last_became_active":"2024-09-12T00:35:43.929559+0000","last_became_peered":"2024-09-12T00:35:43.929559+0000","last_unstale":"2024-09-12T01:22:05.065472+0000","last_undegraded":"2024-09-12T01:22:05.065472+0000","last_fullsized":"2024-09-12T01:22:05.065472+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'331","last_scrub_stamp":"2024-09-12T01:22:05.065301+0000","last_deep_scrub":"265'331","last_deep_scrub_stamp":"2024-09-12T01:22:05.065301+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.065301+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:54.088835+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2025256,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":451,"num_read_kb":47620,"num_write":929,"num_write_kb":27870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1462,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.247461+0000","last_change":"2024-09-12T00:35:47.936838+0000","last_active":"2024-09-12T01:21:56.247461+0000","last_peered":"2024-09-12T01:21:56.247461+0000","last_clean":"2024-09-12T01:21:56.247461+0000","last_became_active":"2024-09-12T00:35:47.936026+0000","last_became_peered":"2024-09-12T00:35:47.936026+0000","last_unstale":"2024-09-12T01:21:56.247461+0000","last_undegraded":"2024-09-12T01:21:56.247461+0000","last_fullsized":"2024-09-12T01:21:56.247461+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:42.930790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":965,"num_read_kb":965,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'80","reported_seq":595,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:51.233520+0000","last_change":"2024-09-12T00:35:50.027677+0000","last_active":"2024-09-12T01:18:51.233520+0000","last_peered":"2024-09-12T01:18:51.233520+0000","last_clean":"2024-09-12T01:18:51.233520+0000","last_became_active":"2024-09-12T00:35:50.027161+0000","last_became_peered":"2024-09-12T00:35:50.027161+0000","last_unstale":"2024-09-12T01:18:51.233520+0000","last_undegraded":"2024-09-12T01:18:51.233520+0000","last_fullsized":"2024-09-12T01:18:51.233520+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:29.997291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'774","reported_seq":6319,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.429142+0000","last_change":"2024-09-12T00:35:51.977887+0000","last_active":"2024-09-12T01:21:57.429142+0000","last_peered":"2024-09-12T01:21:57.429142+0000","last_clean":"2024-09-12T01:21:57.429142+0000","last_became_active":"2024-09-12T00:35:51.976947+0000","last_became_peered":"2024-09-12T00:35:51.976947+0000","last_unstale":"2024-09-12T01:21:57.429142+0000","last_undegraded":"2024-09-12T01:21:57.429142+0000","last_fullsized":"2024-09-12T01:21:57.429142+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:41.190642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'156","reported_seq":653,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:03.702547+0000","last_change":"2024-09-12T00:35:53.995354+0000","last_active":"2024-09-12T01:20:03.702547+0000","last_peered":"2024-09-12T01:20:03.702547+0000","last_clean":"2024-09-12T01:20:03.702547+0000","last_became_active":"2024-09-12T00:35:53.994715+0000","last_became_peered":"2024-09-12T00:35:53.994715+0000","last_unstale":"2024-09-12T01:20:03.702547+0000","last_undegraded":"2024-09-12T01:20:03.702547+0000","last_fullsized":"2024-09-12T01:20:03.702547+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:57.399598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":132,"num_read_kb":125,"num_write":372,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'159","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.435354+0000","last_change":"2024-09-12T01:22:09.435354+0000","last_active":"2024-09-12T01:22:09.435354+0000","last_peered":"2024-09-12T01:22:09.435354+0000","last_clean":"2024-09-12T01:22:09.435354+0000","last_became_active":"2024-09-12T00:36:17.049999+0000","last_became_peered":"2024-09-12T00:36:17.049999+0000","last_unstale":"2024-09-12T01:22:09.435354+0000","last_undegraded":"2024-09-12T01:22:09.435354+0000","last_fullsized":"2024-09-12T01:22:09.435354+0000","mapping_epoch":37,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'159","last_scrub_stamp":"2024-09-12T01:22:09.435171+0000","last_deep_scrub":"265'159","last_deep_scrub_stamp":"2024-09-12T01:22:09.435171+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.435171+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:31.966275+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":667,"num_read_kb":538,"num_write":243,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8078,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"265'365","reported_seq":1124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:04.665974+0000","last_change":"2024-09-12T01:22:04.665974+0000","last_active":"2024-09-12T01:22:04.665974+0000","last_peered":"2024-09-12T01:22:04.665974+0000","last_clean":"2024-09-12T01:22:04.665974+0000","last_became_active":"2024-09-12T00:35:43.931562+0000","last_became_peered":"2024-09-12T00:35:43.931562+0000","last_unstale":"2024-09-12T01:22:04.665974+0000","last_undegraded":"2024-09-12T01:22:04.665974+0000","last_fullsized":"2024-09-12T01:22:04.665974+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T01:22:04.665854+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T01:22:04.665854+0000","last_clean_scrub_stamp":"2024-09-12T01:22:04.665854+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:17.732533+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992276,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":678,"num_read_kb":113913,"num_write":1161,"num_write_kb":34109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:32.742956+0000","last_change":"2024-09-12T00:35:47.930885+0000","last_active":"2024-09-12T01:18:32.742956+0000","last_peered":"2024-09-12T01:18:32.742956+0000","last_clean":"2024-09-12T01:18:32.742956+0000","last_became_active":"2024-09-12T00:35:47.930147+0000","last_became_peered":"2024-09-12T00:35:47.930147+0000","last_unstale":"2024-09-12T01:18:32.742956+0000","last_undegraded":"2024-09-12T01:18:32.742956+0000","last_fullsized":"2024-09-12T01:18:32.742956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:58.003654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'345","reported_seq":948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.771341+0000","last_change":"2024-09-12T00:35:49.939362+0000","last_active":"2024-09-12T01:21:57.771341+0000","last_peered":"2024-09-12T01:21:57.771341+0000","last_clean":"2024-09-12T01:21:57.771341+0000","last_became_active":"2024-09-12T00:35:49.938597+0000","last_became_peered":"2024-09-12T00:35:49.938597+0000","last_unstale":"2024-09-12T01:21:57.771341+0000","last_undegraded":"2024-09-12T01:21:57.771341+0000","last_fullsized":"2024-09-12T01:21:57.771341+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.934056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46738,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":571,"num_read_kb":1203,"num_write":454,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.084666+0000","last_change":"2024-09-12T01:22:22.084666+0000","last_active":"2024-09-12T01:22:22.084666+0000","last_peered":"2024-09-12T01:22:22.084666+0000","last_clean":"2024-09-12T01:22:22.084666+0000","last_became_active":"2024-09-12T00:35:51.967708+0000","last_became_peered":"2024-09-12T00:35:51.967708+0000","last_unstale":"2024-09-12T01:22:22.084666+0000","last_undegraded":"2024-09-12T01:22:22.084666+0000","last_fullsized":"2024-09-12T01:22:22.084666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:22.084485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:22.084485+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.084485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:12.944518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'116","reported_seq":605,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:38.582809+0000","last_change":"2024-09-12T00:35:53.998562+0000","last_active":"2024-09-12T01:19:38.582809+0000","last_peered":"2024-09-12T01:19:38.582809+0000","last_clean":"2024-09-12T01:19:38.582809+0000","last_became_active":"2024-09-12T00:35:53.997893+0000","last_became_peered":"2024-09-12T00:35:53.997893+0000","last_unstale":"2024-09-12T01:19:38.582809+0000","last_undegraded":"2024-09-12T01:19:38.582809+0000","last_fullsized":"2024-09-12T01:19:38.582809+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:57.696902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":114,"num_write":260,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'95","reported_seq":687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.199979+0000","last_change":"2024-09-12T01:22:13.199979+0000","last_active":"2024-09-12T01:22:13.199979+0000","last_peered":"2024-09-12T01:22:13.199979+0000","last_clean":"2024-09-12T01:22:13.199979+0000","last_became_active":"2024-09-12T00:35:45.941291+0000","last_became_peered":"2024-09-12T00:35:45.941291+0000","last_unstale":"2024-09-12T01:22:13.199979+0000","last_undegraded":"2024-09-12T01:22:13.199979+0000","last_fullsized":"2024-09-12T01:22:13.199979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'95","last_scrub_stamp":"2024-09-12T01:22:13.199797+0000","last_deep_scrub":"265'95","last_deep_scrub_stamp":"2024-09-12T01:22:13.199797+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.199797+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:29.571782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":459,"num_read_kb":386,"num_write":145,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":621,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.470742+0000","last_change":"2024-09-12T01:22:05.470742+0000","last_active":"2024-09-12T01:22:05.470742+0000","last_peered":"2024-09-12T01:22:05.470742+0000","last_clean":"2024-09-12T01:22:05.470742+0000","last_became_active":"2024-09-12T00:35:25.096843+0000","last_became_peered":"2024-09-12T00:35:25.096843+0000","last_unstale":"2024-09-12T01:22:05.470742+0000","last_undegraded":"2024-09-12T01:22:05.470742+0000","last_fullsized":"2024-09-12T01:22:05.470742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-12T01:22:05.470506+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-12T01:22:05.470506+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.470506+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:45.363711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.800395+0000","last_change":"2024-09-12T01:22:09.800395+0000","last_active":"2024-09-12T01:22:09.800395+0000","last_peered":"2024-09-12T01:22:09.800395+0000","last_clean":"2024-09-12T01:22:09.800395+0000","last_became_active":"2024-09-12T00:35:29.668145+0000","last_became_peered":"2024-09-12T00:35:29.668145+0000","last_unstale":"2024-09-12T01:22:09.800395+0000","last_undegraded":"2024-09-12T01:22:09.800395+0000","last_fullsized":"2024-09-12T01:22:09.800395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:09.800200+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:09.800200+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.800200+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:15.267436+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0011070749999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'322","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:03.609476+0000","last_change":"2024-09-12T01:22:03.609476+0000","last_active":"2024-09-12T01:22:03.609476+0000","last_peered":"2024-09-12T01:22:03.609476+0000","last_clean":"2024-09-12T01:22:03.609476+0000","last_became_active":"2024-09-12T00:35:43.916969+0000","last_became_peered":"2024-09-12T00:35:43.916969+0000","last_unstale":"2024-09-12T01:22:03.609476+0000","last_undegraded":"2024-09-12T01:22:03.609476+0000","last_fullsized":"2024-09-12T01:22:03.609476+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T01:22:03.609346+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T01:22:03.609346+0000","last_clean_scrub_stamp":"2024-09-12T01:22:03.609346+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:29.571575+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568993,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":119474,"num_write":1014,"num_write_kb":17296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.373693+0000","last_change":"2024-09-12T01:22:22.373693+0000","last_active":"2024-09-12T01:22:22.373693+0000","last_peered":"2024-09-12T01:22:22.373693+0000","last_clean":"2024-09-12T01:22:22.373693+0000","last_became_active":"2024-09-12T00:35:47.942643+0000","last_became_peered":"2024-09-12T00:35:47.942643+0000","last_unstale":"2024-09-12T01:22:22.373693+0000","last_undegraded":"2024-09-12T01:22:22.373693+0000","last_fullsized":"2024-09-12T01:22:22.373693+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:22.373489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:22.373489+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.373489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:26.791309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'696","reported_seq":1403,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.838470+0000","last_change":"2024-09-12T00:35:49.958641+0000","last_active":"2024-09-12T01:21:57.838470+0000","last_peered":"2024-09-12T01:21:57.838470+0000","last_clean":"2024-09-12T01:21:57.838470+0000","last_became_active":"2024-09-12T00:35:49.957694+0000","last_became_peered":"2024-09-12T00:35:49.957694+0000","last_unstale":"2024-09-12T01:21:57.838470+0000","last_undegraded":"2024-09-12T01:21:57.838470+0000","last_fullsized":"2024-09-12T01:21:57.838470+0000","mapping_epoch":30,"log_start":"265'600","ondisk_log_start":"265'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:23.494190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144071,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1382,"num_read_kb":3079,"num_write":1308,"num_write_kb":1154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:13.573190+0000","last_change":"2024-09-12T00:35:51.978016+0000","last_active":"2024-09-12T01:19:13.573190+0000","last_peered":"2024-09-12T01:19:13.573190+0000","last_clean":"2024-09-12T01:19:13.573190+0000","last_became_active":"2024-09-12T00:35:51.977282+0000","last_became_peered":"2024-09-12T00:35:51.977282+0000","last_unstale":"2024-09-12T01:19:13.573190+0000","last_undegraded":"2024-09-12T01:19:13.573190+0000","last_fullsized":"2024-09-12T01:19:13.573190+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:23.231926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'206","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.003775+0000","last_change":"2024-09-12T00:35:53.998069+0000","last_active":"2024-09-12T01:20:23.003775+0000","last_peered":"2024-09-12T01:20:23.003775+0000","last_clean":"2024-09-12T01:20:23.003775+0000","last_became_active":"2024-09-12T00:35:53.997354+0000","last_became_peered":"2024-09-12T00:35:53.997354+0000","last_unstale":"2024-09-12T01:20:23.003775+0000","last_undegraded":"2024-09-12T01:20:23.003775+0000","last_fullsized":"2024-09-12T01:20:23.003775+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:55.234664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":471,"num_write":454,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'239","reported_seq":905,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.549409+0000","last_change":"2024-09-12T01:22:11.549409+0000","last_active":"2024-09-12T01:22:11.549409+0000","last_peered":"2024-09-12T01:22:11.549409+0000","last_clean":"2024-09-12T01:22:11.549409+0000","last_became_active":"2024-09-12T00:35:45.945766+0000","last_became_peered":"2024-09-12T00:35:45.945766+0000","last_unstale":"2024-09-12T01:22:11.549409+0000","last_undegraded":"2024-09-12T01:22:11.549409+0000","last_fullsized":"2024-09-12T01:22:11.549409+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'239","last_scrub_stamp":"2024-09-12T01:22:11.549218+0000","last_deep_scrub":"265'239","last_deep_scrub_stamp":"2024-09-12T01:22:11.549218+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.549218+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:53.581793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1032,"num_read_kb":857,"num_write":339,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.466487+0000","last_change":"2024-09-12T01:22:06.466487+0000","last_active":"2024-09-12T01:22:06.466487+0000","last_peered":"2024-09-12T01:22:06.466487+0000","last_clean":"2024-09-12T01:22:06.466487+0000","last_became_active":"2024-09-12T00:35:29.671287+0000","last_became_peered":"2024-09-12T00:35:29.671287+0000","last_unstale":"2024-09-12T01:22:06.466487+0000","last_undegraded":"2024-09-12T01:22:06.466487+0000","last_fullsized":"2024-09-12T01:22:06.466487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:06.466276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:06.466276+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.466276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:01.838180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075002000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'404","reported_seq":1121,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:03.716502+0000","last_change":"2024-09-12T01:22:03.716502+0000","last_active":"2024-09-12T01:22:03.716502+0000","last_peered":"2024-09-12T01:22:03.716502+0000","last_clean":"2024-09-12T01:22:03.716502+0000","last_became_active":"2024-09-12T00:35:43.945335+0000","last_became_peered":"2024-09-12T00:35:43.945335+0000","last_unstale":"2024-09-12T01:22:03.716502+0000","last_undegraded":"2024-09-12T01:22:03.716502+0000","last_fullsized":"2024-09-12T01:22:03.716502+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'404","last_scrub_stamp":"2024-09-12T01:22:03.716386+0000","last_deep_scrub":"265'404","last_deep_scrub_stamp":"2024-09-12T01:22:03.716386+0000","last_clean_scrub_stamp":"2024-09-12T01:22:03.716386+0000","objects_scrubbed":7,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:53.096747+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":682,"num_read_kb":63013,"num_write":1485,"num_write_kb":40970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.563896+0000","last_change":"2024-09-12T00:35:47.926465+0000","last_active":"2024-09-12T01:19:08.563896+0000","last_peered":"2024-09-12T01:19:08.563896+0000","last_clean":"2024-09-12T01:19:08.563896+0000","last_became_active":"2024-09-12T00:35:47.925704+0000","last_became_peered":"2024-09-12T00:35:47.925704+0000","last_unstale":"2024-09-12T01:19:08.563896+0000","last_undegraded":"2024-09-12T01:19:08.563896+0000","last_fullsized":"2024-09-12T01:19:08.563896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:53.561342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1270","reported_seq":2773,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:23.233400+0000","last_change":"2024-09-12T01:22:23.233400+0000","last_active":"2024-09-12T01:22:23.233400+0000","last_peered":"2024-09-12T01:22:23.233400+0000","last_clean":"2024-09-12T01:22:23.233400+0000","last_became_active":"2024-09-12T00:35:49.947643+0000","last_became_peered":"2024-09-12T00:35:49.947643+0000","last_unstale":"2024-09-12T01:22:23.233400+0000","last_undegraded":"2024-09-12T01:22:23.233400+0000","last_fullsized":"2024-09-12T01:22:23.233400+0000","mapping_epoch":30,"log_start":"265'1200","ondisk_log_start":"265'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1270","last_scrub_stamp":"2024-09-12T01:22:23.233211+0000","last_deep_scrub":"265'1270","last_deep_scrub_stamp":"2024-09-12T01:22:23.233211+0000","last_clean_scrub_stamp":"2024-09-12T01:22:23.233211+0000","objects_scrubbed":12,"log_size":70,"log_dups_size":1200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:51.857102+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144243,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2043,"num_read_kb":3859,"num_write":1128,"num_write_kb":966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:42.800216+0000","last_change":"2024-09-12T00:35:51.981967+0000","last_active":"2024-09-12T01:19:42.800216+0000","last_peered":"2024-09-12T01:19:42.800216+0000","last_clean":"2024-09-12T01:19:42.800216+0000","last_became_active":"2024-09-12T00:35:51.981240+0000","last_became_peered":"2024-09-12T00:35:51.981240+0000","last_unstale":"2024-09-12T01:19:42.800216+0000","last_undegraded":"2024-09-12T01:19:42.800216+0000","last_fullsized":"2024-09-12T01:19:42.800216+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:42.148309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'135","reported_seq":643,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.074739+0000","last_change":"2024-09-12T00:35:54.014383+0000","last_active":"2024-09-12T01:20:23.074739+0000","last_peered":"2024-09-12T01:20:23.074739+0000","last_clean":"2024-09-12T01:20:23.074739+0000","last_became_active":"2024-09-12T00:35:54.013658+0000","last_became_peered":"2024-09-12T00:35:54.013658+0000","last_unstale":"2024-09-12T01:20:23.074739+0000","last_undegraded":"2024-09-12T01:20:23.074739+0000","last_fullsized":"2024-09-12T01:20:23.074739+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:12.904906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":184,"num_read_kb":167,"num_write":336,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'142","reported_seq":780,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.143929+0000","last_change":"2024-09-12T01:22:13.143929+0000","last_active":"2024-09-12T01:22:13.143929+0000","last_peered":"2024-09-12T01:22:13.143929+0000","last_clean":"2024-09-12T01:22:13.143929+0000","last_became_active":"2024-09-12T00:35:45.929073+0000","last_became_peered":"2024-09-12T00:35:45.929073+0000","last_unstale":"2024-09-12T01:22:13.143929+0000","last_undegraded":"2024-09-12T01:22:13.143929+0000","last_fullsized":"2024-09-12T01:22:13.143929+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'142","last_scrub_stamp":"2024-09-12T01:22:13.143744+0000","last_deep_scrub":"265'142","last_deep_scrub_stamp":"2024-09-12T01:22:13.143744+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.143744+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:36.562063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":635,"num_read_kb":540,"num_write":217,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:03.482812+0000","last_change":"2024-09-12T01:22:03.482812+0000","last_active":"2024-09-12T01:22:03.482812+0000","last_peered":"2024-09-12T01:22:03.482812+0000","last_clean":"2024-09-12T01:22:03.482812+0000","last_became_active":"2024-09-12T00:35:29.699432+0000","last_became_peered":"2024-09-12T00:35:29.699432+0000","last_unstale":"2024-09-12T01:22:03.482812+0000","last_undegraded":"2024-09-12T01:22:03.482812+0000","last_fullsized":"2024-09-12T01:22:03.482812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:03.482726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:03.482726+0000","last_clean_scrub_stamp":"2024-09-12T01:22:03.482726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:09.949801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099979400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'347","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.188799+0000","last_change":"2024-09-12T01:22:05.188799+0000","last_active":"2024-09-12T01:22:05.188799+0000","last_peered":"2024-09-12T01:22:05.188799+0000","last_clean":"2024-09-12T01:22:05.188799+0000","last_became_active":"2024-09-12T00:35:43.928667+0000","last_became_peered":"2024-09-12T00:35:43.928667+0000","last_unstale":"2024-09-12T01:22:05.188799+0000","last_undegraded":"2024-09-12T01:22:05.188799+0000","last_fullsized":"2024-09-12T01:22:05.188799+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T01:22:05.188675+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T01:22:05.188675+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.188675+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:11.123392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174664,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":503,"num_read_kb":16533,"num_write":1052,"num_write_kb":18962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:10.566295+0000","last_change":"2024-09-12T00:35:47.945027+0000","last_active":"2024-09-12T01:19:10.566295+0000","last_peered":"2024-09-12T01:19:10.566295+0000","last_clean":"2024-09-12T01:19:10.566295+0000","last_became_active":"2024-09-12T00:35:47.944385+0000","last_became_peered":"2024-09-12T00:35:47.944385+0000","last_unstale":"2024-09-12T01:19:10.566295+0000","last_undegraded":"2024-09-12T01:19:10.566295+0000","last_fullsized":"2024-09-12T01:19:10.566295+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:59.954589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'226","reported_seq":1321,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.532346+0000","last_change":"2024-09-12T00:35:50.026399+0000","last_active":"2024-09-12T01:21:25.532346+0000","last_peered":"2024-09-12T01:21:25.532346+0000","last_clean":"2024-09-12T01:21:25.532346+0000","last_became_active":"2024-09-12T00:35:50.025610+0000","last_became_peered":"2024-09-12T00:35:50.025610+0000","last_unstale":"2024-09-12T01:21:25.532346+0000","last_undegraded":"2024-09-12T01:21:25.532346+0000","last_fullsized":"2024-09-12T01:21:25.532346+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:54.581195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":183,"num_read_kb":174,"num_write":155,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:38.579276+0000","last_change":"2024-09-12T00:35:51.974368+0000","last_active":"2024-09-12T01:19:38.579276+0000","last_peered":"2024-09-12T01:19:38.579276+0000","last_clean":"2024-09-12T01:19:38.579276+0000","last_became_active":"2024-09-12T00:35:51.973593+0000","last_became_peered":"2024-09-12T00:35:51.973593+0000","last_unstale":"2024-09-12T01:19:38.579276+0000","last_undegraded":"2024-09-12T01:19:38.579276+0000","last_fullsized":"2024-09-12T01:19:38.579276+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:59.292452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'273","reported_seq":876,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.184767+0000","last_change":"2024-09-12T00:35:53.995709+0000","last_active":"2024-09-12T01:20:23.184767+0000","last_peered":"2024-09-12T01:20:23.184767+0000","last_clean":"2024-09-12T01:20:23.184767+0000","last_became_active":"2024-09-12T00:35:53.994828+0000","last_became_peered":"2024-09-12T00:35:53.994828+0000","last_unstale":"2024-09-12T01:20:23.184767+0000","last_undegraded":"2024-09-12T01:20:23.184767+0000","last_fullsized":"2024-09-12T01:20:23.184767+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:01.920282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":532,"num_read_kb":546,"num_write":608,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'101","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.159831+0000","last_change":"2024-09-12T01:22:12.159831+0000","last_active":"2024-09-12T01:22:12.159831+0000","last_peered":"2024-09-12T01:22:12.159831+0000","last_clean":"2024-09-12T01:22:12.159831+0000","last_became_active":"2024-09-12T00:35:45.932642+0000","last_became_peered":"2024-09-12T00:35:45.932642+0000","last_unstale":"2024-09-12T01:22:12.159831+0000","last_undegraded":"2024-09-12T01:22:12.159831+0000","last_fullsized":"2024-09-12T01:22:12.159831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'101","last_scrub_stamp":"2024-09-12T01:22:12.159645+0000","last_deep_scrub":"265'101","last_deep_scrub_stamp":"2024-09-12T01:22:12.159645+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.159645+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:07.949915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":466,"num_read_kb":396,"num_write":153,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:04.843329+0000","last_change":"2024-09-12T01:22:04.843329+0000","last_active":"2024-09-12T01:22:04.843329+0000","last_peered":"2024-09-12T01:22:04.843329+0000","last_clean":"2024-09-12T01:22:04.843329+0000","last_became_active":"2024-09-12T00:35:29.664963+0000","last_became_peered":"2024-09-12T00:35:29.664963+0000","last_unstale":"2024-09-12T01:22:04.843329+0000","last_undegraded":"2024-09-12T01:22:04.843329+0000","last_fullsized":"2024-09-12T01:22:04.843329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:22:04.843146+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:22:04.843146+0000","last_clean_scrub_stamp":"2024-09-12T01:22:04.843146+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:56.597168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0020842569999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'294","reported_seq":972,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:04.048022+0000","last_change":"2024-09-12T01:22:04.048022+0000","last_active":"2024-09-12T01:22:04.048022+0000","last_peered":"2024-09-12T01:22:04.048022+0000","last_clean":"2024-09-12T01:22:04.048022+0000","last_became_active":"2024-09-12T00:35:43.930731+0000","last_became_peered":"2024-09-12T00:35:43.930731+0000","last_unstale":"2024-09-12T01:22:04.048022+0000","last_undegraded":"2024-09-12T01:22:04.048022+0000","last_fullsized":"2024-09-12T01:22:04.048022+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'294","last_scrub_stamp":"2024-09-12T01:22:04.047797+0000","last_deep_scrub":"265'294","last_deep_scrub_stamp":"2024-09-12T01:22:04.047797+0000","last_clean_scrub_stamp":"2024-09-12T01:22:04.047797+0000","objects_scrubbed":5,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:39.342877+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":688153,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":45060,"num_write":1094,"num_write_kb":33877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.462404+0000","last_change":"2024-09-12T01:22:21.462404+0000","last_active":"2024-09-12T01:22:21.462404+0000","last_peered":"2024-09-12T01:22:21.462404+0000","last_clean":"2024-09-12T01:22:21.462404+0000","last_became_active":"2024-09-12T00:35:47.939055+0000","last_became_peered":"2024-09-12T00:35:47.939055+0000","last_unstale":"2024-09-12T01:22:21.462404+0000","last_undegraded":"2024-09-12T01:22:21.462404+0000","last_fullsized":"2024-09-12T01:22:21.462404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:21.462198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:21.462198+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.462198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:09.095594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'117","reported_seq":654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:23.406053+0000","last_change":"2024-09-12T00:35:49.952715+0000","last_active":"2024-09-12T01:21:23.406053+0000","last_peered":"2024-09-12T01:21:23.406053+0000","last_clean":"2024-09-12T01:21:23.406053+0000","last_became_active":"2024-09-12T00:35:49.948258+0000","last_became_peered":"2024-09-12T00:35:49.948258+0000","last_unstale":"2024-09-12T01:21:23.406053+0000","last_undegraded":"2024-09-12T01:21:23.406053+0000","last_fullsized":"2024-09-12T01:21:23.406053+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:13.173314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.048163+0000","last_change":"2024-09-12T01:22:21.048163+0000","last_active":"2024-09-12T01:22:21.048163+0000","last_peered":"2024-09-12T01:22:21.048163+0000","last_clean":"2024-09-12T01:22:21.048163+0000","last_became_active":"2024-09-12T00:35:51.974302+0000","last_became_peered":"2024-09-12T00:35:51.974302+0000","last_unstale":"2024-09-12T01:22:21.048163+0000","last_undegraded":"2024-09-12T01:22:21.048163+0000","last_fullsized":"2024-09-12T01:22:21.048163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:21.047984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:21.047984+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.047984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:34.374068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'140","reported_seq":703,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:02.410395+0000","last_change":"2024-09-12T00:35:53.995956+0000","last_active":"2024-09-12T01:20:02.410395+0000","last_peered":"2024-09-12T01:20:02.410395+0000","last_clean":"2024-09-12T01:20:02.410395+0000","last_became_active":"2024-09-12T00:35:53.995254+0000","last_became_peered":"2024-09-12T00:35:53.995254+0000","last_unstale":"2024-09-12T01:20:02.410395+0000","last_undegraded":"2024-09-12T01:20:02.410395+0000","last_fullsized":"2024-09-12T01:20:02.410395+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:26.022607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1272,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":285,"num_read_kb":262,"num_write":355,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'53","reported_seq":599,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.173036+0000","last_change":"2024-09-12T01:22:11.173036+0000","last_active":"2024-09-12T01:22:11.173036+0000","last_peered":"2024-09-12T01:22:11.173036+0000","last_clean":"2024-09-12T01:22:11.173036+0000","last_became_active":"2024-09-12T00:35:45.936061+0000","last_became_peered":"2024-09-12T00:35:45.936061+0000","last_unstale":"2024-09-12T01:22:11.173036+0000","last_undegraded":"2024-09-12T01:22:11.173036+0000","last_fullsized":"2024-09-12T01:22:11.173036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'53","last_scrub_stamp":"2024-09-12T01:22:11.172855+0000","last_deep_scrub":"265'53","last_deep_scrub_stamp":"2024-09-12T01:22:11.172855+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.172855+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:11.840647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":179,"num_write":83,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"265'358","reported_seq":1020,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.848155+0000","last_change":"2024-09-12T01:22:05.848155+0000","last_active":"2024-09-12T01:22:05.848155+0000","last_peered":"2024-09-12T01:22:05.848155+0000","last_clean":"2024-09-12T01:22:05.848155+0000","last_became_active":"2024-09-12T00:36:17.051542+0000","last_became_peered":"2024-09-12T00:36:17.051542+0000","last_unstale":"2024-09-12T01:22:05.848155+0000","last_undegraded":"2024-09-12T01:22:05.848155+0000","last_fullsized":"2024-09-12T01:22:05.848155+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T01:22:05.847893+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T01:22:05.847893+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.847893+0000","objects_scrubbed":9,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:51.384435+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730210,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":479,"num_read_kb":44411,"num_write":1031,"num_write_kb":33814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:03.236128+0000","last_change":"2024-09-12T01:22:03.236128+0000","last_active":"2024-09-12T01:22:03.236128+0000","last_peered":"2024-09-12T01:22:03.236128+0000","last_clean":"2024-09-12T01:22:03.236128+0000","last_became_active":"2024-09-12T00:35:29.700869+0000","last_became_peered":"2024-09-12T00:35:29.700869+0000","last_unstale":"2024-09-12T01:22:03.236128+0000","last_undegraded":"2024-09-12T01:22:03.236128+0000","last_fullsized":"2024-09-12T01:22:03.236128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:03.235936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:03.235936+0000","last_clean_scrub_stamp":"2024-09-12T01:22:03.235936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:19.598037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00099003299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"265'6","reported_seq":988,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.474373+0000","last_change":"2024-09-12T01:22:18.474373+0000","last_active":"2024-09-12T01:22:18.474373+0000","last_peered":"2024-09-12T01:22:18.474373+0000","last_clean":"2024-09-12T01:22:18.474373+0000","last_became_active":"2024-09-12T00:35:47.946690+0000","last_became_peered":"2024-09-12T00:35:47.946690+0000","last_unstale":"2024-09-12T01:22:18.474373+0000","last_undegraded":"2024-09-12T01:22:18.474373+0000","last_fullsized":"2024-09-12T01:22:18.474373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:22:18.474192+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:22:18.474192+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.474192+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:24.840674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'579","reported_seq":1257,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:23.516688+0000","last_change":"2024-09-12T01:22:23.516688+0000","last_active":"2024-09-12T01:22:23.516688+0000","last_peered":"2024-09-12T01:22:23.516688+0000","last_clean":"2024-09-12T01:22:23.516688+0000","last_became_active":"2024-09-12T00:35:49.948095+0000","last_became_peered":"2024-09-12T00:35:49.948095+0000","last_unstale":"2024-09-12T01:22:23.516688+0000","last_undegraded":"2024-09-12T01:22:23.516688+0000","last_fullsized":"2024-09-12T01:22:23.516688+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'579","last_scrub_stamp":"2024-09-12T01:22:23.516444+0000","last_deep_scrub":"265'579","last_deep_scrub_stamp":"2024-09-12T01:22:23.516444+0000","last_clean_scrub_stamp":"2024-09-12T01:22:23.516444+0000","objects_scrubbed":11,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:57.103924+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93682,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1577,"num_read_kb":2692,"num_write":2050,"num_write_kb":1874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506876,"num_omap_keys":1146,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.556917+0000","last_change":"2024-09-12T00:35:51.968432+0000","last_active":"2024-09-12T01:19:37.556917+0000","last_peered":"2024-09-12T01:19:37.556917+0000","last_clean":"2024-09-12T01:19:37.556917+0000","last_became_active":"2024-09-12T00:35:51.967708+0000","last_became_peered":"2024-09-12T00:35:51.967708+0000","last_unstale":"2024-09-12T01:19:37.556917+0000","last_undegraded":"2024-09-12T01:19:37.556917+0000","last_fullsized":"2024-09-12T01:19:37.556917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:43.503668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'147","reported_seq":643,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:40.914651+0000","last_change":"2024-09-12T00:35:54.015204+0000","last_active":"2024-09-12T01:19:40.914651+0000","last_peered":"2024-09-12T01:19:40.914651+0000","last_clean":"2024-09-12T01:19:40.914651+0000","last_became_active":"2024-09-12T00:35:54.014321+0000","last_became_peered":"2024-09-12T00:35:54.014321+0000","last_unstale":"2024-09-12T01:19:40.914651+0000","last_undegraded":"2024-09-12T01:19:40.914651+0000","last_fullsized":"2024-09-12T01:19:40.914651+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:14.339505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":134,"num_write":336,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'165","reported_seq":795,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.492877+0000","last_change":"2024-09-12T01:22:13.492877+0000","last_active":"2024-09-12T01:22:13.492877+0000","last_peered":"2024-09-12T01:22:13.492877+0000","last_clean":"2024-09-12T01:22:13.492877+0000","last_became_active":"2024-09-12T00:35:45.936178+0000","last_became_peered":"2024-09-12T00:35:45.936178+0000","last_unstale":"2024-09-12T01:22:13.492877+0000","last_undegraded":"2024-09-12T01:22:13.492877+0000","last_fullsized":"2024-09-12T01:22:13.492877+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'165","last_scrub_stamp":"2024-09-12T01:22:13.492696+0000","last_deep_scrub":"265'165","last_deep_scrub_stamp":"2024-09-12T01:22:13.492696+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.492696+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:10.154787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":595,"num_write":226,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'368","reported_seq":1010,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.263121+0000","last_change":"2024-09-12T01:22:07.263121+0000","last_active":"2024-09-12T01:22:07.263121+0000","last_peered":"2024-09-12T01:22:07.263121+0000","last_clean":"2024-09-12T01:22:07.263121+0000","last_became_active":"2024-09-12T00:35:43.928834+0000","last_became_peered":"2024-09-12T00:35:43.928834+0000","last_unstale":"2024-09-12T01:22:07.263121+0000","last_undegraded":"2024-09-12T01:22:07.263121+0000","last_fullsized":"2024-09-12T01:22:07.263121+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'368","last_scrub_stamp":"2024-09-12T01:22:07.262920+0000","last_deep_scrub":"265'368","last_deep_scrub_stamp":"2024-09-12T01:22:07.262920+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.262920+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:21.291964+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262157,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":503,"num_read_kb":29317,"num_write":1237,"num_write_kb":48953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.474150+0000","last_change":"2024-09-12T01:22:07.474150+0000","last_active":"2024-09-12T01:22:07.474150+0000","last_peered":"2024-09-12T01:22:07.474150+0000","last_clean":"2024-09-12T01:22:07.474150+0000","last_became_active":"2024-09-12T00:35:29.697973+0000","last_became_peered":"2024-09-12T00:35:29.697973+0000","last_unstale":"2024-09-12T01:22:07.474150+0000","last_undegraded":"2024-09-12T01:22:07.474150+0000","last_fullsized":"2024-09-12T01:22:07.474150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:07.473953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:07.473953+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.473953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:28.515287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083354399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.108138+0000","last_change":"2024-09-12T01:22:16.108138+0000","last_active":"2024-09-12T01:22:16.108138+0000","last_peered":"2024-09-12T01:22:16.108138+0000","last_clean":"2024-09-12T01:22:16.108138+0000","last_became_active":"2024-09-12T00:35:47.940014+0000","last_became_peered":"2024-09-12T00:35:47.940014+0000","last_unstale":"2024-09-12T01:22:16.108138+0000","last_undegraded":"2024-09-12T01:22:16.108138+0000","last_fullsized":"2024-09-12T01:22:16.108138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:16.107962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:16.107962+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.107962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:31.152033+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'186","reported_seq":750,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.995320+0000","last_change":"2024-09-12T00:35:50.029129+0000","last_active":"2024-09-12T01:20:22.995320+0000","last_peered":"2024-09-12T01:20:22.995320+0000","last_clean":"2024-09-12T01:20:22.995320+0000","last_became_active":"2024-09-12T00:35:50.028173+0000","last_became_peered":"2024-09-12T00:35:50.028173+0000","last_unstale":"2024-09-12T01:20:22.995320+0000","last_undegraded":"2024-09-12T01:20:22.995320+0000","last_fullsized":"2024-09-12T01:20:22.995320+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:11.842961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":223,"num_read_kb":207,"num_write":158,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'791","reported_seq":2679,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.876691+0000","last_change":"2024-09-12T00:35:51.977915+0000","last_active":"2024-09-12T01:21:57.876691+0000","last_peered":"2024-09-12T01:21:57.876691+0000","last_clean":"2024-09-12T01:21:57.876691+0000","last_became_active":"2024-09-12T00:35:51.977203+0000","last_became_peered":"2024-09-12T00:35:51.977203+0000","last_unstale":"2024-09-12T01:21:57.876691+0000","last_undegraded":"2024-09-12T01:21:57.876691+0000","last_fullsized":"2024-09-12T01:21:57.876691+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'110","reported_seq":608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:08.402637+0000","last_change":"2024-09-12T00:35:54.015222+0000","last_active":"2024-09-12T01:21:08.402637+0000","last_peered":"2024-09-12T01:21:08.402637+0000","last_clean":"2024-09-12T01:21:08.402637+0000","last_became_active":"2024-09-12T00:35:54.014699+0000","last_became_peered":"2024-09-12T00:35:54.014699+0000","last_unstale":"2024-09-12T01:21:08.402637+0000","last_undegraded":"2024-09-12T01:21:08.402637+0000","last_fullsized":"2024-09-12T01:21:08.402637+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:06.666673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1113,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":127,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'102","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.632609+0000","last_change":"2024-09-12T01:22:13.632609+0000","last_active":"2024-09-12T01:22:13.632609+0000","last_peered":"2024-09-12T01:22:13.632609+0000","last_clean":"2024-09-12T01:22:13.632609+0000","last_became_active":"2024-09-12T00:35:45.942032+0000","last_became_peered":"2024-09-12T00:35:45.942032+0000","last_unstale":"2024-09-12T01:22:13.632609+0000","last_undegraded":"2024-09-12T01:22:13.632609+0000","last_fullsized":"2024-09-12T01:22:13.632609+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'102","last_scrub_stamp":"2024-09-12T01:22:13.632428+0000","last_deep_scrub":"265'102","last_deep_scrub_stamp":"2024-09-12T01:22:13.632428+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.632428+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:15.552919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":475,"num_read_kb":403,"num_write":145,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'328","reported_seq":956,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.648628+0000","last_change":"2024-09-12T01:22:06.648628+0000","last_active":"2024-09-12T01:22:06.648628+0000","last_peered":"2024-09-12T01:22:06.648628+0000","last_clean":"2024-09-12T01:22:06.648628+0000","last_became_active":"2024-09-12T00:35:43.953619+0000","last_became_peered":"2024-09-12T00:35:43.953619+0000","last_unstale":"2024-09-12T01:22:06.648628+0000","last_undegraded":"2024-09-12T01:22:06.648628+0000","last_fullsized":"2024-09-12T01:22:06.648628+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'328","last_scrub_stamp":"2024-09-12T01:22:06.648414+0000","last_deep_scrub":"265'328","last_deep_scrub_stamp":"2024-09-12T01:22:06.648414+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.648414+0000","objects_scrubbed":10,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:28.512834+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2238687,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":418,"num_read_kb":24307,"num_write":963,"num_write_kb":33018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:04.229626+0000","last_change":"2024-09-12T01:22:04.229626+0000","last_active":"2024-09-12T01:22:04.229626+0000","last_peered":"2024-09-12T01:22:04.229626+0000","last_clean":"2024-09-12T01:22:04.229626+0000","last_became_active":"2024-09-12T00:35:29.671727+0000","last_became_peered":"2024-09-12T00:35:29.671727+0000","last_unstale":"2024-09-12T01:22:04.229626+0000","last_undegraded":"2024-09-12T01:22:04.229626+0000","last_fullsized":"2024-09-12T01:22:04.229626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:04.229530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:04.229530+0000","last_clean_scrub_stamp":"2024-09-12T01:22:04.229530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:25.823105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010553139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:32.555547+0000","last_change":"2024-09-12T00:35:47.937179+0000","last_active":"2024-09-12T01:19:32.555547+0000","last_peered":"2024-09-12T01:19:32.555547+0000","last_clean":"2024-09-12T01:19:32.555547+0000","last_became_active":"2024-09-12T00:35:47.936452+0000","last_became_peered":"2024-09-12T00:35:47.936452+0000","last_unstale":"2024-09-12T01:19:32.555547+0000","last_undegraded":"2024-09-12T01:19:32.555547+0000","last_fullsized":"2024-09-12T01:19:32.555547+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:33.795481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'113","reported_seq":658,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.557003+0000","last_change":"2024-09-12T00:35:49.941635+0000","last_active":"2024-09-12T01:19:37.557003+0000","last_peered":"2024-09-12T01:19:37.557003+0000","last_clean":"2024-09-12T01:19:37.557003+0000","last_became_active":"2024-09-12T00:35:49.940788+0000","last_became_peered":"2024-09-12T00:35:49.940788+0000","last_unstale":"2024-09-12T01:19:37.557003+0000","last_undegraded":"2024-09-12T01:19:37.557003+0000","last_fullsized":"2024-09-12T01:19:37.557003+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:50.095723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'789","reported_seq":2416,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.316325+0000","last_change":"2024-09-12T00:35:51.980717+0000","last_active":"2024-09-12T01:21:57.316325+0000","last_peered":"2024-09-12T01:21:57.316325+0000","last_clean":"2024-09-12T01:21:57.316325+0000","last_became_active":"2024-09-12T00:35:51.979997+0000","last_became_peered":"2024-09-12T00:35:51.979997+0000","last_unstale":"2024-09-12T01:21:57.316325+0000","last_undegraded":"2024-09-12T01:21:57.316325+0000","last_fullsized":"2024-09-12T01:21:57.316325+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:15.785752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'278","reported_seq":795,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:36.375145+0000","last_change":"2024-09-12T00:35:53.993708+0000","last_active":"2024-09-12T01:19:36.375145+0000","last_peered":"2024-09-12T01:19:36.375145+0000","last_clean":"2024-09-12T01:19:36.375145+0000","last_became_active":"2024-09-12T00:35:53.992431+0000","last_became_peered":"2024-09-12T00:35:53.992431+0000","last_unstale":"2024-09-12T01:19:36.375145+0000","last_undegraded":"2024-09-12T01:19:36.375145+0000","last_fullsized":"2024-09-12T01:19:36.375145+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:35.605076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":344,"num_read_kb":342,"num_write":602,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'372","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.008846+0000","last_change":"2024-09-12T01:22:09.008846+0000","last_active":"2024-09-12T01:22:09.008846+0000","last_peered":"2024-09-12T01:22:09.008846+0000","last_clean":"2024-09-12T01:22:09.008846+0000","last_became_active":"2024-09-12T00:35:45.928789+0000","last_became_peered":"2024-09-12T00:35:45.928789+0000","last_unstale":"2024-09-12T01:22:09.008846+0000","last_undegraded":"2024-09-12T01:22:09.008846+0000","last_fullsized":"2024-09-12T01:22:09.008846+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'372","last_scrub_stamp":"2024-09-12T01:22:09.008671+0000","last_deep_scrub":"265'372","last_deep_scrub_stamp":"2024-09-12T01:22:09.008671+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.008671+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:49.407471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1634,"num_read_kb":1297,"num_write":639,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'367","reported_seq":1052,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.642522+0000","last_change":"2024-09-12T01:22:05.642522+0000","last_active":"2024-09-12T01:22:05.642522+0000","last_peered":"2024-09-12T01:22:05.642522+0000","last_clean":"2024-09-12T01:22:05.642522+0000","last_became_active":"2024-09-12T00:35:43.932994+0000","last_became_peered":"2024-09-12T00:35:43.932994+0000","last_unstale":"2024-09-12T01:22:05.642522+0000","last_undegraded":"2024-09-12T01:22:05.642522+0000","last_fullsized":"2024-09-12T01:22:05.642522+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T01:22:05.642296+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T01:22:05.642296+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.642296+0000","objects_scrubbed":7,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:09.276375+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":624,"num_read_kb":1635,"num_write":1170,"num_write_kb":36329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.086834+0000","last_change":"2024-09-12T01:22:05.086834+0000","last_active":"2024-09-12T01:22:05.086834+0000","last_peered":"2024-09-12T01:22:05.086834+0000","last_clean":"2024-09-12T01:22:05.086834+0000","last_became_active":"2024-09-12T00:35:29.670571+0000","last_became_peered":"2024-09-12T00:35:29.670571+0000","last_unstale":"2024-09-12T01:22:05.086834+0000","last_undegraded":"2024-09-12T01:22:05.086834+0000","last_fullsized":"2024-09-12T01:22:05.086834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:05.086601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:05.086601+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.086601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:50.763843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012596770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:58.603799+0000","last_change":"2024-09-12T00:35:47.934122+0000","last_active":"2024-09-12T01:19:58.603799+0000","last_peered":"2024-09-12T01:19:58.603799+0000","last_clean":"2024-09-12T01:19:58.603799+0000","last_became_active":"2024-09-12T00:35:47.933798+0000","last_became_peered":"2024-09-12T00:35:47.933798+0000","last_unstale":"2024-09-12T01:19:58.603799+0000","last_undegraded":"2024-09-12T01:19:58.603799+0000","last_fullsized":"2024-09-12T01:19:58.603799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'725","reported_seq":1449,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.696858+0000","last_change":"2024-09-12T00:35:50.029172+0000","last_active":"2024-09-12T01:21:57.696858+0000","last_peered":"2024-09-12T01:21:57.696858+0000","last_clean":"2024-09-12T01:21:57.696858+0000","last_became_active":"2024-09-12T00:35:50.028341+0000","last_became_peered":"2024-09-12T00:35:50.028341+0000","last_unstale":"2024-09-12T01:21:57.696858+0000","last_undegraded":"2024-09-12T01:21:57.696858+0000","last_fullsized":"2024-09-12T01:21:57.696858+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:00.896912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139080,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1312,"num_read_kb":3096,"num_write":1068,"num_write_kb":883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:38.599116+0000","last_change":"2024-09-12T00:35:51.975754+0000","last_active":"2024-09-12T01:19:38.599116+0000","last_peered":"2024-09-12T01:19:38.599116+0000","last_clean":"2024-09-12T01:19:38.599116+0000","last_became_active":"2024-09-12T00:35:51.974473+0000","last_became_peered":"2024-09-12T00:35:51.974473+0000","last_unstale":"2024-09-12T01:19:38.599116+0000","last_undegraded":"2024-09-12T01:19:38.599116+0000","last_fullsized":"2024-09-12T01:19:38.599116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:18.151442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'108","reported_seq":610,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:09.188058+0000","last_change":"2024-09-12T00:35:53.996281+0000","last_active":"2024-09-12T01:19:09.188058+0000","last_peered":"2024-09-12T01:19:09.188058+0000","last_clean":"2024-09-12T01:19:09.188058+0000","last_became_active":"2024-09-12T00:35:53.995431+0000","last_became_peered":"2024-09-12T00:35:53.995431+0000","last_unstale":"2024-09-12T01:19:09.188058+0000","last_undegraded":"2024-09-12T01:19:09.188058+0000","last_fullsized":"2024-09-12T01:19:09.188058+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:23.854939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":133,"num_write":267,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'116","reported_seq":666,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:24.501863+0000","last_change":"2024-09-12T00:35:54.003023+0000","last_active":"2024-09-12T01:21:24.501863+0000","last_peered":"2024-09-12T01:21:24.501863+0000","last_clean":"2024-09-12T01:21:24.501863+0000","last_became_active":"2024-09-12T00:35:54.002052+0000","last_became_peered":"2024-09-12T00:35:54.002052+0000","last_unstale":"2024-09-12T01:21:24.501863+0000","last_undegraded":"2024-09-12T01:21:24.501863+0000","last_fullsized":"2024-09-12T01:21:24.501863+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:18.230366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":193,"num_write":267,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'96","reported_seq":690,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.013931+0000","last_change":"2024-09-12T01:22:14.013931+0000","last_active":"2024-09-12T01:22:14.013931+0000","last_peered":"2024-09-12T01:22:14.013931+0000","last_clean":"2024-09-12T01:22:14.013931+0000","last_became_active":"2024-09-12T00:35:45.954079+0000","last_became_peered":"2024-09-12T00:35:45.954079+0000","last_unstale":"2024-09-12T01:22:14.013931+0000","last_undegraded":"2024-09-12T01:22:14.013931+0000","last_fullsized":"2024-09-12T01:22:14.013931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'96","last_scrub_stamp":"2024-09-12T01:22:14.013751+0000","last_deep_scrub":"265'96","last_deep_scrub_stamp":"2024-09-12T01:22:14.013751+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.013751+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:36.327183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":455,"num_read_kb":391,"num_write":154,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'442","reported_seq":1148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.033238+0000","last_change":"2024-09-12T01:22:07.033238+0000","last_active":"2024-09-12T01:22:07.033238+0000","last_peered":"2024-09-12T01:22:07.033238+0000","last_clean":"2024-09-12T01:22:07.033238+0000","last_became_active":"2024-09-12T00:35:43.947940+0000","last_became_peered":"2024-09-12T00:35:43.947940+0000","last_unstale":"2024-09-12T01:22:07.033238+0000","last_undegraded":"2024-09-12T01:22:07.033238+0000","last_fullsized":"2024-09-12T01:22:07.033238+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'442","last_scrub_stamp":"2024-09-12T01:22:07.032998+0000","last_deep_scrub":"265'442","last_deep_scrub_stamp":"2024-09-12T01:22:07.032998+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.032998+0000","objects_scrubbed":7,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:14.761183+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":799,"num_read_kb":4159,"num_write":1267,"num_write_kb":17308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.199456+0000","last_change":"2024-09-12T01:22:22.199456+0000","last_active":"2024-09-12T01:22:22.199456+0000","last_peered":"2024-09-12T01:22:22.199456+0000","last_clean":"2024-09-12T01:22:22.199456+0000","last_became_active":"2024-09-12T00:35:47.929844+0000","last_became_peered":"2024-09-12T00:35:47.929844+0000","last_unstale":"2024-09-12T01:22:22.199456+0000","last_undegraded":"2024-09-12T01:22:22.199456+0000","last_fullsized":"2024-09-12T01:22:22.199456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:22.199245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:22.199245+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.199245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:59.906791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'287","reported_seq":863,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.686059+0000","last_change":"2024-09-12T00:35:49.947886+0000","last_active":"2024-09-12T01:21:56.686059+0000","last_peered":"2024-09-12T01:21:56.686059+0000","last_clean":"2024-09-12T01:21:56.686059+0000","last_became_active":"2024-09-12T00:35:49.947136+0000","last_became_peered":"2024-09-12T00:35:49.947136+0000","last_unstale":"2024-09-12T01:21:56.686059+0000","last_undegraded":"2024-09-12T01:21:56.686059+0000","last_fullsized":"2024-09-12T01:21:56.686059+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:30.278867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43778,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":475,"num_read_kb":1081,"num_write":388,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:53.573483+0000","last_change":"2024-09-12T00:35:51.980791+0000","last_active":"2024-09-12T01:17:53.573483+0000","last_peered":"2024-09-12T01:17:53.573483+0000","last_clean":"2024-09-12T01:17:53.573483+0000","last_became_active":"2024-09-12T00:35:51.980092+0000","last_became_peered":"2024-09-12T00:35:51.980092+0000","last_unstale":"2024-09-12T01:17:53.573483+0000","last_undegraded":"2024-09-12T01:17:53.573483+0000","last_fullsized":"2024-09-12T01:17:53.573483+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:52.492457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'134","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:20.759008+0000","last_change":"2024-09-12T00:35:53.993259+0000","last_active":"2024-09-12T01:20:20.759008+0000","last_peered":"2024-09-12T01:20:20.759008+0000","last_clean":"2024-09-12T01:20:20.759008+0000","last_became_active":"2024-09-12T00:35:53.992579+0000","last_became_peered":"2024-09-12T00:35:53.992579+0000","last_unstale":"2024-09-12T01:20:20.759008+0000","last_undegraded":"2024-09-12T01:20:20.759008+0000","last_fullsized":"2024-09-12T01:20:20.759008+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":139,"num_write":341,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'161","reported_seq":753,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.226327+0000","last_change":"2024-09-12T01:22:16.226327+0000","last_active":"2024-09-12T01:22:16.226327+0000","last_peered":"2024-09-12T01:22:16.226327+0000","last_clean":"2024-09-12T01:22:16.226327+0000","last_became_active":"2024-09-12T00:35:45.957614+0000","last_became_peered":"2024-09-12T00:35:45.957614+0000","last_unstale":"2024-09-12T01:22:16.226327+0000","last_undegraded":"2024-09-12T01:22:16.226327+0000","last_fullsized":"2024-09-12T01:22:16.226327+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'161","last_scrub_stamp":"2024-09-12T01:22:16.226150+0000","last_deep_scrub":"265'161","last_deep_scrub_stamp":"2024-09-12T01:22:16.226150+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.226150+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:34.804768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":661,"num_read_kb":539,"num_write":259,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'367","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.238457+0000","last_change":"2024-09-12T01:22:06.238323+0000","last_active":"2024-09-12T01:22:06.238457+0000","last_peered":"2024-09-12T01:22:06.238457+0000","last_clean":"2024-09-12T01:22:06.238457+0000","last_became_active":"2024-09-12T00:36:17.269377+0000","last_became_peered":"2024-09-12T00:36:17.269377+0000","last_unstale":"2024-09-12T01:22:06.238457+0000","last_undegraded":"2024-09-12T01:22:06.238457+0000","last_fullsized":"2024-09-12T01:22:06.238457+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T01:22:06.238069+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T01:22:06.238069+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.238069+0000","objects_scrubbed":8,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:52.160763+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":513,"num_read_kb":25436,"num_write":1264,"num_write_kb":33386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:48.572327+0000","last_change":"2024-09-12T00:35:47.941929+0000","last_active":"2024-09-12T01:17:48.572327+0000","last_peered":"2024-09-12T01:17:48.572327+0000","last_clean":"2024-09-12T01:17:48.572327+0000","last_became_active":"2024-09-12T00:35:47.941493+0000","last_became_peered":"2024-09-12T00:35:47.941493+0000","last_unstale":"2024-09-12T01:17:48.572327+0000","last_undegraded":"2024-09-12T01:17:48.572327+0000","last_fullsized":"2024-09-12T01:17:48.572327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:06.034904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'46","reported_seq":542,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:09.885099+0000","last_change":"2024-09-12T00:35:49.950088+0000","last_active":"2024-09-12T01:19:09.885099+0000","last_peered":"2024-09-12T01:19:09.885099+0000","last_clean":"2024-09-12T01:19:09.885099+0000","last_became_active":"2024-09-12T00:35:49.949331+0000","last_became_peered":"2024-09-12T00:35:49.949331+0000","last_unstale":"2024-09-12T01:19:09.885099+0000","last_undegraded":"2024-09-12T01:19:09.885099+0000","last_fullsized":"2024-09-12T01:19:09.885099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:00.112784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:52.773954+0000","last_change":"2024-09-12T00:35:51.977921+0000","last_active":"2024-09-12T01:17:52.773954+0000","last_peered":"2024-09-12T01:17:52.773954+0000","last_clean":"2024-09-12T01:17:52.773954+0000","last_became_active":"2024-09-12T00:35:51.977211+0000","last_became_peered":"2024-09-12T00:35:51.977211+0000","last_unstale":"2024-09-12T01:17:52.773954+0000","last_undegraded":"2024-09-12T01:17:52.773954+0000","last_fullsized":"2024-09-12T01:17:52.773954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:37.744652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'214","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.264295+0000","last_change":"2024-09-12T00:35:53.992509+0000","last_active":"2024-09-12T01:20:22.264295+0000","last_peered":"2024-09-12T01:20:22.264295+0000","last_clean":"2024-09-12T01:20:22.264295+0000","last_became_active":"2024-09-12T00:35:53.985696+0000","last_became_peered":"2024-09-12T00:35:53.985696+0000","last_unstale":"2024-09-12T01:20:22.264295+0000","last_undegraded":"2024-09-12T01:20:22.264295+0000","last_fullsized":"2024-09-12T01:20:22.264295+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:55.326440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":288,"num_read_kb":283,"num_write":478,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'116","reported_seq":728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.632479+0000","last_change":"2024-09-12T01:22:16.632479+0000","last_active":"2024-09-12T01:22:16.632479+0000","last_peered":"2024-09-12T01:22:16.632479+0000","last_clean":"2024-09-12T01:22:16.632479+0000","last_became_active":"2024-09-12T00:35:45.942161+0000","last_became_peered":"2024-09-12T00:35:45.942161+0000","last_unstale":"2024-09-12T01:22:16.632479+0000","last_undegraded":"2024-09-12T01:22:16.632479+0000","last_fullsized":"2024-09-12T01:22:16.632479+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'116","last_scrub_stamp":"2024-09-12T01:22:16.632298+0000","last_deep_scrub":"265'116","last_deep_scrub_stamp":"2024-09-12T01:22:16.632298+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.632298+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:43.861761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":566,"num_read_kb":479,"num_write":187,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'295","reported_seq":903,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.806007+0000","last_change":"2024-09-12T01:22:06.806007+0000","last_active":"2024-09-12T01:22:06.806007+0000","last_peered":"2024-09-12T01:22:06.806007+0000","last_clean":"2024-09-12T01:22:06.806007+0000","last_became_active":"2024-09-12T00:35:43.950660+0000","last_became_peered":"2024-09-12T00:35:43.950660+0000","last_unstale":"2024-09-12T01:22:06.806007+0000","last_undegraded":"2024-09-12T01:22:06.806007+0000","last_fullsized":"2024-09-12T01:22:06.806007+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'295","last_scrub_stamp":"2024-09-12T01:22:06.805784+0000","last_deep_scrub":"265'295","last_deep_scrub_stamp":"2024-09-12T01:22:06.805784+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.805784+0000","objects_scrubbed":6,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:35.026312+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110814,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":386,"num_read_kb":2177,"num_write":879,"num_write_kb":8684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:47.772763+0000","last_change":"2024-09-12T00:35:47.946510+0000","last_active":"2024-09-12T01:17:47.772763+0000","last_peered":"2024-09-12T01:17:47.772763+0000","last_clean":"2024-09-12T01:17:47.772763+0000","last_became_active":"2024-09-12T00:35:47.945819+0000","last_became_peered":"2024-09-12T00:35:47.945819+0000","last_unstale":"2024-09-12T01:17:47.772763+0000","last_undegraded":"2024-09-12T01:17:47.772763+0000","last_fullsized":"2024-09-12T01:17:47.772763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:13.092089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'348","reported_seq":934,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.503752+0000","last_change":"2024-09-12T00:35:49.955755+0000","last_active":"2024-09-12T01:21:57.503752+0000","last_peered":"2024-09-12T01:21:57.503752+0000","last_clean":"2024-09-12T01:21:57.503752+0000","last_became_active":"2024-09-12T00:35:49.954646+0000","last_became_peered":"2024-09-12T00:35:49.954646+0000","last_unstale":"2024-09-12T01:21:57.503752+0000","last_undegraded":"2024-09-12T01:21:57.503752+0000","last_fullsized":"2024-09-12T01:21:57.503752+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:59.408731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66883,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":574,"num_read_kb":1344,"num_write":472,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:52.540778+0000","last_change":"2024-09-12T00:35:51.974798+0000","last_active":"2024-09-12T01:17:52.540778+0000","last_peered":"2024-09-12T01:17:52.540778+0000","last_clean":"2024-09-12T01:17:52.540778+0000","last_became_active":"2024-09-12T00:35:51.973993+0000","last_became_peered":"2024-09-12T00:35:51.973993+0000","last_unstale":"2024-09-12T01:17:52.540778+0000","last_undegraded":"2024-09-12T01:17:52.540778+0000","last_fullsized":"2024-09-12T01:17:52.540778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:02.005519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'103","reported_seq":609,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:56.474802+0000","last_change":"2024-09-12T00:35:54.001932+0000","last_active":"2024-09-12T01:19:56.474802+0000","last_peered":"2024-09-12T01:19:56.474802+0000","last_clean":"2024-09-12T01:19:56.474802+0000","last_became_active":"2024-09-12T00:35:54.001337+0000","last_became_peered":"2024-09-12T00:35:54.001337+0000","last_unstale":"2024-09-12T01:19:56.474802+0000","last_undegraded":"2024-09-12T01:19:56.474802+0000","last_fullsized":"2024-09-12T01:19:56.474802+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:46.072438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":126,"num_write":245,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'4114","reported_seq":4743,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.616655+0000","last_change":"2024-09-12T01:22:14.616655+0000","last_active":"2024-09-12T01:22:14.616655+0000","last_peered":"2024-09-12T01:22:14.616655+0000","last_clean":"2024-09-12T01:22:14.616655+0000","last_became_active":"2024-09-12T00:35:45.938175+0000","last_became_peered":"2024-09-12T00:35:45.938175+0000","last_unstale":"2024-09-12T01:22:14.616655+0000","last_undegraded":"2024-09-12T01:22:14.616655+0000","last_fullsized":"2024-09-12T01:22:14.616655+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4114","last_scrub_stamp":"2024-09-12T01:22:14.616416+0000","last_deep_scrub":"265'4114","last_deep_scrub_stamp":"2024-09-12T01:22:14.616416+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.616416+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:57.910210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16557,"num_read_kb":13901,"num_write":6164,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'313","reported_seq":924,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.637162+0000","last_change":"2024-09-12T01:22:06.637162+0000","last_active":"2024-09-12T01:22:06.637162+0000","last_peered":"2024-09-12T01:22:06.637162+0000","last_clean":"2024-09-12T01:22:06.637162+0000","last_became_active":"2024-09-12T00:35:43.935194+0000","last_became_peered":"2024-09-12T00:35:43.935194+0000","last_unstale":"2024-09-12T01:22:06.637162+0000","last_undegraded":"2024-09-12T01:22:06.637162+0000","last_fullsized":"2024-09-12T01:22:06.637162+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'313","last_scrub_stamp":"2024-09-12T01:22:06.636919+0000","last_deep_scrub":"265'313","last_deep_scrub_stamp":"2024-09-12T01:22:06.636919+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.636919+0000","objects_scrubbed":8,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:10.162623+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992287,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":416,"num_read_kb":10375,"num_write":976,"num_write_kb":15779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.097959+0000","last_change":"2024-09-12T01:22:19.097959+0000","last_active":"2024-09-12T01:22:19.097959+0000","last_peered":"2024-09-12T01:22:19.097959+0000","last_clean":"2024-09-12T01:22:19.097959+0000","last_became_active":"2024-09-12T00:35:47.944477+0000","last_became_peered":"2024-09-12T00:35:47.944477+0000","last_unstale":"2024-09-12T01:22:19.097959+0000","last_undegraded":"2024-09-12T01:22:19.097959+0000","last_fullsized":"2024-09-12T01:22:19.097959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:19.097750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:19.097750+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.097750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:03.784360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'274","reported_seq":841,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.386915+0000","last_change":"2024-09-12T00:35:49.942723+0000","last_active":"2024-09-12T01:21:57.386915+0000","last_peered":"2024-09-12T01:21:57.386915+0000","last_clean":"2024-09-12T01:21:57.386915+0000","last_became_active":"2024-09-12T00:35:49.941948+0000","last_became_peered":"2024-09-12T00:35:49.941948+0000","last_unstale":"2024-09-12T01:21:57.386915+0000","last_undegraded":"2024-09-12T01:21:57.386915+0000","last_fullsized":"2024-09-12T01:21:57.386915+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:32.893865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45730,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":1073,"num_write":372,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":482,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:17:53.553514+0000","last_change":"2024-09-12T00:35:51.975893+0000","last_active":"2024-09-12T01:17:53.553514+0000","last_peered":"2024-09-12T01:17:53.553514+0000","last_clean":"2024-09-12T01:17:53.553514+0000","last_became_active":"2024-09-12T00:35:51.975124+0000","last_became_peered":"2024-09-12T00:35:51.975124+0000","last_unstale":"2024-09-12T01:17:53.553514+0000","last_undegraded":"2024-09-12T01:17:53.553514+0000","last_fullsized":"2024-09-12T01:17:53.553514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:49.874523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'251","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.166216+0000","last_change":"2024-09-12T01:22:14.166216+0000","last_active":"2024-09-12T01:22:14.166216+0000","last_peered":"2024-09-12T01:22:14.166216+0000","last_clean":"2024-09-12T01:22:14.166216+0000","last_became_active":"2024-09-12T00:35:45.941357+0000","last_became_peered":"2024-09-12T00:35:45.941357+0000","last_unstale":"2024-09-12T01:22:14.166216+0000","last_undegraded":"2024-09-12T01:22:14.166216+0000","last_fullsized":"2024-09-12T01:22:14.166216+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'251","last_scrub_stamp":"2024-09-12T01:22:14.165990+0000","last_deep_scrub":"265'251","last_deep_scrub_stamp":"2024-09-12T01:22:14.165990+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.165990+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:23.409041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1115,"num_read_kb":918,"num_write":405,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'305","reported_seq":932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.627274+0000","last_change":"2024-09-12T01:22:08.627274+0000","last_active":"2024-09-12T01:22:08.627274+0000","last_peered":"2024-09-12T01:22:08.627274+0000","last_clean":"2024-09-12T01:22:08.627274+0000","last_became_active":"2024-09-12T00:35:43.933037+0000","last_became_peered":"2024-09-12T00:35:43.933037+0000","last_unstale":"2024-09-12T01:22:08.627274+0000","last_undegraded":"2024-09-12T01:22:08.627274+0000","last_fullsized":"2024-09-12T01:22:08.627274+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'305","last_scrub_stamp":"2024-09-12T01:22:08.627056+0000","last_deep_scrub":"265'305","last_deep_scrub_stamp":"2024-09-12T01:22:08.627056+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.627056+0000","objects_scrubbed":9,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:16.887003+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730132,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":468,"num_read_kb":7309,"num_write":980,"num_write_kb":23054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"265'4","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.489438+0000","last_change":"2024-09-12T01:22:22.489438+0000","last_active":"2024-09-12T01:22:22.489438+0000","last_peered":"2024-09-12T01:22:22.489438+0000","last_clean":"2024-09-12T01:22:22.489438+0000","last_became_active":"2024-09-12T00:35:47.941749+0000","last_became_peered":"2024-09-12T00:35:47.941749+0000","last_unstale":"2024-09-12T01:22:22.489438+0000","last_undegraded":"2024-09-12T01:22:22.489438+0000","last_fullsized":"2024-09-12T01:22:22.489438+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T01:22:22.489259+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T01:22:22.489259+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.489259+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:29.570374+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'506","reported_seq":1137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.349319+0000","last_change":"2024-09-12T00:35:49.948724+0000","last_active":"2024-09-12T01:21:57.349319+0000","last_peered":"2024-09-12T01:21:57.349319+0000","last_clean":"2024-09-12T01:21:57.349319+0000","last_became_active":"2024-09-12T00:35:49.947963+0000","last_became_peered":"2024-09-12T00:35:49.947963+0000","last_unstale":"2024-09-12T01:21:57.349319+0000","last_undegraded":"2024-09-12T01:21:57.349319+0000","last_fullsized":"2024-09-12T01:21:57.349319+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:23.048505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95771,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":915,"num_read_kb":2195,"num_write":792,"num_write_kb":711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.553625+0000","last_change":"2024-09-12T00:35:51.968910+0000","last_active":"2024-09-12T01:18:23.553625+0000","last_peered":"2024-09-12T01:18:23.553625+0000","last_clean":"2024-09-12T01:18:23.553625+0000","last_became_active":"2024-09-12T00:35:51.968209+0000","last_became_peered":"2024-09-12T00:35:51.968209+0000","last_unstale":"2024-09-12T01:18:23.553625+0000","last_undegraded":"2024-09-12T01:18:23.553625+0000","last_fullsized":"2024-09-12T01:18:23.553625+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:40.274641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'158","reported_seq":653,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.097347+0000","last_change":"2024-09-12T00:35:54.013532+0000","last_active":"2024-09-12T01:20:22.097347+0000","last_peered":"2024-09-12T01:20:22.097347+0000","last_clean":"2024-09-12T01:20:22.097347+0000","last_became_active":"2024-09-12T00:35:54.012958+0000","last_became_peered":"2024-09-12T00:35:54.012958+0000","last_unstale":"2024-09-12T01:20:22.097347+0000","last_undegraded":"2024-09-12T01:20:22.097347+0000","last_fullsized":"2024-09-12T01:20:22.097347+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:34.515746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1092,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":166,"num_read_kb":178,"num_write":351,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'60","reported_seq":622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.501893+0000","last_change":"2024-09-12T01:22:19.501893+0000","last_active":"2024-09-12T01:22:19.501893+0000","last_peered":"2024-09-12T01:22:19.501893+0000","last_clean":"2024-09-12T01:22:19.501893+0000","last_became_active":"2024-09-12T00:35:45.945952+0000","last_became_peered":"2024-09-12T00:35:45.945952+0000","last_unstale":"2024-09-12T01:22:19.501893+0000","last_undegraded":"2024-09-12T01:22:19.501893+0000","last_fullsized":"2024-09-12T01:22:19.501893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'60","last_scrub_stamp":"2024-09-12T01:22:19.501688+0000","last_deep_scrub":"265'60","last_deep_scrub_stamp":"2024-09-12T01:22:19.501688+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.501688+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:13.144748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":234,"num_write":86,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'360","reported_seq":1024,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.256391+0000","last_change":"2024-09-12T01:22:08.256391+0000","last_active":"2024-09-12T01:22:08.256391+0000","last_peered":"2024-09-12T01:22:08.256391+0000","last_clean":"2024-09-12T01:22:08.256391+0000","last_became_active":"2024-09-12T00:35:43.928779+0000","last_became_peered":"2024-09-12T00:35:43.928779+0000","last_unstale":"2024-09-12T01:22:08.256391+0000","last_undegraded":"2024-09-12T01:22:08.256391+0000","last_fullsized":"2024-09-12T01:22:08.256391+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'360","last_scrub_stamp":"2024-09-12T01:22:08.256185+0000","last_deep_scrub":"265'360","last_deep_scrub_stamp":"2024-09-12T01:22:08.256185+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.256185+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:19.743658+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":507,"num_read_kb":67515,"num_write":1156,"num_write_kb":41697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.071518+0000","last_change":"2024-09-12T01:22:18.071518+0000","last_active":"2024-09-12T01:22:18.071518+0000","last_peered":"2024-09-12T01:22:18.071518+0000","last_clean":"2024-09-12T01:22:18.071518+0000","last_became_active":"2024-09-12T00:35:47.944056+0000","last_became_peered":"2024-09-12T00:35:47.944056+0000","last_unstale":"2024-09-12T01:22:18.071518+0000","last_undegraded":"2024-09-12T01:22:18.071518+0000","last_fullsized":"2024-09-12T01:22:18.071518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:18.071303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:18.071303+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.071303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:52.172452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'270","reported_seq":850,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.421484+0000","last_change":"2024-09-12T00:35:49.946966+0000","last_active":"2024-09-12T01:21:57.421484+0000","last_peered":"2024-09-12T01:21:57.421484+0000","last_clean":"2024-09-12T01:21:57.421484+0000","last_became_active":"2024-09-12T00:35:49.946226+0000","last_became_peered":"2024-09-12T00:35:49.946226+0000","last_unstale":"2024-09-12T01:21:57.421484+0000","last_undegraded":"2024-09-12T01:21:57.421484+0000","last_fullsized":"2024-09-12T01:21:57.421484+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:45.810230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48166,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":461,"num_read_kb":978,"num_write":376,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":483,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.562310+0000","last_change":"2024-09-12T00:35:51.970897+0000","last_active":"2024-09-12T01:18:23.562310+0000","last_peered":"2024-09-12T01:18:23.562310+0000","last_clean":"2024-09-12T01:18:23.562310+0000","last_became_active":"2024-09-12T00:35:51.963735+0000","last_became_peered":"2024-09-12T00:35:51.963735+0000","last_unstale":"2024-09-12T01:18:23.562310+0000","last_undegraded":"2024-09-12T01:18:23.562310+0000","last_fullsized":"2024-09-12T01:18:23.562310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:20.013004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'196","reported_seq":702,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.113351+0000","last_change":"2024-09-12T00:35:53.991284+0000","last_active":"2024-09-12T01:20:22.113351+0000","last_peered":"2024-09-12T01:20:22.113351+0000","last_clean":"2024-09-12T01:20:22.113351+0000","last_became_active":"2024-09-12T00:35:53.990488+0000","last_became_peered":"2024-09-12T00:35:53.990488+0000","last_unstale":"2024-09-12T01:20:22.113351+0000","last_undegraded":"2024-09-12T01:20:22.113351+0000","last_fullsized":"2024-09-12T01:20:22.113351+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:57.849221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1821,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":235,"num_read_kb":229,"num_write":573,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'191","reported_seq":796,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.619589+0000","last_change":"2024-09-12T01:22:21.619589+0000","last_active":"2024-09-12T01:22:21.619589+0000","last_peered":"2024-09-12T01:22:21.619589+0000","last_clean":"2024-09-12T01:22:21.619589+0000","last_became_active":"2024-09-12T00:35:45.940529+0000","last_became_peered":"2024-09-12T00:35:45.940529+0000","last_unstale":"2024-09-12T01:22:21.619589+0000","last_undegraded":"2024-09-12T01:22:21.619589+0000","last_fullsized":"2024-09-12T01:22:21.619589+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'191","last_scrub_stamp":"2024-09-12T01:22:21.619383+0000","last_deep_scrub":"265'191","last_deep_scrub_stamp":"2024-09-12T01:22:21.619383+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.619383+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:56.738297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":840,"num_read_kb":692,"num_write":286,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'348","reported_seq":1110,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.076975+0000","last_change":"2024-09-12T01:22:06.076975+0000","last_active":"2024-09-12T01:22:06.076975+0000","last_peered":"2024-09-12T01:22:06.076975+0000","last_clean":"2024-09-12T01:22:06.076975+0000","last_became_active":"2024-09-12T00:35:43.927426+0000","last_became_peered":"2024-09-12T00:35:43.927426+0000","last_unstale":"2024-09-12T01:22:06.076975+0000","last_undegraded":"2024-09-12T01:22:06.076975+0000","last_fullsized":"2024-09-12T01:22:06.076975+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-12T01:22:06.076783+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-12T01:22:06.076783+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.076783+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:53.298954+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":824,"num_read_kb":46781,"num_write":1113,"num_write_kb":16393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.739497+0000","last_change":"2024-09-12T00:35:47.934105+0000","last_active":"2024-09-12T01:18:17.739497+0000","last_peered":"2024-09-12T01:18:17.739497+0000","last_clean":"2024-09-12T01:18:17.739497+0000","last_became_active":"2024-09-12T00:35:47.933189+0000","last_became_peered":"2024-09-12T00:35:47.933189+0000","last_unstale":"2024-09-12T01:18:17.739497+0000","last_undegraded":"2024-09-12T01:18:17.739497+0000","last_fullsized":"2024-09-12T01:18:17.739497+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:01.418064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'284","reported_seq":863,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.862874+0000","last_change":"2024-09-12T00:35:50.030204+0000","last_active":"2024-09-12T01:21:56.862874+0000","last_peered":"2024-09-12T01:21:56.862874+0000","last_clean":"2024-09-12T01:21:56.862874+0000","last_became_active":"2024-09-12T00:35:50.029579+0000","last_became_peered":"2024-09-12T00:35:50.029579+0000","last_unstale":"2024-09-12T01:21:56.862874+0000","last_undegraded":"2024-09-12T01:21:56.862874+0000","last_fullsized":"2024-09-12T01:21:56.862874+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:54.577958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47233,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":1083,"num_write":390,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:58.587193+0000","last_change":"2024-09-12T00:35:51.972390+0000","last_active":"2024-09-12T01:19:58.587193+0000","last_peered":"2024-09-12T01:19:58.587193+0000","last_clean":"2024-09-12T01:19:58.587193+0000","last_became_active":"2024-09-12T00:35:51.971682+0000","last_became_peered":"2024-09-12T00:35:51.971682+0000","last_unstale":"2024-09-12T01:19:58.587193+0000","last_undegraded":"2024-09-12T01:19:58.587193+0000","last_fullsized":"2024-09-12T01:19:58.587193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:54.514575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'102","reported_seq":593,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:25.357123+0000","last_change":"2024-09-12T00:35:53.996274+0000","last_active":"2024-09-12T01:21:25.357123+0000","last_peered":"2024-09-12T01:21:25.357123+0000","last_clean":"2024-09-12T01:21:25.357123+0000","last_became_active":"2024-09-12T00:35:53.995464+0000","last_became_peered":"2024-09-12T00:35:53.995464+0000","last_unstale":"2024-09-12T01:21:25.357123+0000","last_undegraded":"2024-09-12T01:21:25.357123+0000","last_fullsized":"2024-09-12T01:21:25.357123+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:47.747130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":101,"num_write":247,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'298","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:04.495379+0000","last_change":"2024-09-12T01:22:04.495379+0000","last_active":"2024-09-12T01:22:04.495379+0000","last_peered":"2024-09-12T01:22:04.495379+0000","last_clean":"2024-09-12T01:22:04.495379+0000","last_became_active":"2024-09-12T00:35:45.947244+0000","last_became_peered":"2024-09-12T00:35:45.947244+0000","last_unstale":"2024-09-12T01:22:04.495379+0000","last_undegraded":"2024-09-12T01:22:04.495379+0000","last_fullsized":"2024-09-12T01:22:04.495379+0000","mapping_epoch":26,"log_start":"251'200","ondisk_log_start":"251'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'298","last_scrub_stamp":"2024-09-12T01:22:04.495267+0000","last_deep_scrub":"265'298","last_deep_scrub_stamp":"2024-09-12T01:22:04.495267+0000","last_clean_scrub_stamp":"2024-09-12T01:22:04.495267+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:57.480955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1444,"num_read_kb":1250,"num_write":453,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25755,"num_omap_keys":101,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'357","reported_seq":1121,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:04.679571+0000","last_change":"2024-09-12T01:22:04.679571+0000","last_active":"2024-09-12T01:22:04.679571+0000","last_peered":"2024-09-12T01:22:04.679571+0000","last_clean":"2024-09-12T01:22:04.679571+0000","last_became_active":"2024-09-12T00:35:43.947420+0000","last_became_peered":"2024-09-12T00:35:43.947420+0000","last_unstale":"2024-09-12T01:22:04.679571+0000","last_undegraded":"2024-09-12T01:22:04.679571+0000","last_fullsized":"2024-09-12T01:22:04.679571+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'357","last_scrub_stamp":"2024-09-12T01:22:04.679464+0000","last_deep_scrub":"265'357","last_deep_scrub_stamp":"2024-09-12T01:22:04.679464+0000","last_clean_scrub_stamp":"2024-09-12T01:22:04.679464+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:02.092461+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262187,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":720,"num_read_kb":19884,"num_write":1159,"num_write_kb":29921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.244173+0000","last_change":"2024-09-12T01:22:21.244173+0000","last_active":"2024-09-12T01:22:21.244173+0000","last_peered":"2024-09-12T01:22:21.244173+0000","last_clean":"2024-09-12T01:22:21.244173+0000","last_became_active":"2024-09-12T00:35:47.935440+0000","last_became_peered":"2024-09-12T00:35:47.935440+0000","last_unstale":"2024-09-12T01:22:21.244173+0000","last_undegraded":"2024-09-12T01:22:21.244173+0000","last_fullsized":"2024-09-12T01:22:21.244173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:21.244002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:21.244002+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.244002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:57.645912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'90","reported_seq":620,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:02.562788+0000","last_change":"2024-09-12T00:35:50.026452+0000","last_active":"2024-09-12T01:20:02.562788+0000","last_peered":"2024-09-12T01:20:02.562788+0000","last_clean":"2024-09-12T01:20:02.562788+0000","last_became_active":"2024-09-12T00:35:50.025145+0000","last_became_peered":"2024-09-12T00:35:50.025145+0000","last_unstale":"2024-09-12T01:20:02.562788+0000","last_undegraded":"2024-09-12T01:20:02.562788+0000","last_fullsized":"2024-09-12T01:20:02.562788+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:49.606844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":97,"num_read_kb":88,"num_write":76,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'773","reported_seq":2391,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.428899+0000","last_change":"2024-09-12T00:35:51.968551+0000","last_active":"2024-09-12T01:21:57.428899+0000","last_peered":"2024-09-12T01:21:57.428899+0000","last_clean":"2024-09-12T01:21:57.428899+0000","last_became_active":"2024-09-12T00:35:51.967797+0000","last_became_peered":"2024-09-12T00:35:51.967797+0000","last_unstale":"2024-09-12T01:21:57.428899+0000","last_undegraded":"2024-09-12T01:21:57.428899+0000","last_fullsized":"2024-09-12T01:21:57.428899+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:42.194060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'103","reported_seq":603,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.236409+0000","last_change":"2024-09-12T00:35:54.003014+0000","last_active":"2024-09-12T01:20:22.236409+0000","last_peered":"2024-09-12T01:20:22.236409+0000","last_clean":"2024-09-12T01:20:22.236409+0000","last_became_active":"2024-09-12T00:35:54.002318+0000","last_became_peered":"2024-09-12T00:35:54.002318+0000","last_unstale":"2024-09-12T01:20:22.236409+0000","last_undegraded":"2024-09-12T01:20:22.236409+0000","last_fullsized":"2024-09-12T01:20:22.236409+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:45.348319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":119,"num_write":243,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'135","reported_seq":748,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.027357+0000","last_change":"2024-09-12T01:22:16.027357+0000","last_active":"2024-09-12T01:22:16.027357+0000","last_peered":"2024-09-12T01:22:16.027357+0000","last_clean":"2024-09-12T01:22:16.027357+0000","last_became_active":"2024-09-12T00:35:45.935880+0000","last_became_peered":"2024-09-12T00:35:45.935880+0000","last_unstale":"2024-09-12T01:22:16.027357+0000","last_undegraded":"2024-09-12T01:22:16.027357+0000","last_fullsized":"2024-09-12T01:22:16.027357+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'135","last_scrub_stamp":"2024-09-12T01:22:16.027180+0000","last_deep_scrub":"265'135","last_deep_scrub_stamp":"2024-09-12T01:22:16.027180+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.027180+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:04.144948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":617,"num_read_kb":515,"num_write":204,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'358","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.838790+0000","last_change":"2024-09-12T01:22:08.838790+0000","last_active":"2024-09-12T01:22:08.838790+0000","last_peered":"2024-09-12T01:22:08.838790+0000","last_clean":"2024-09-12T01:22:08.838790+0000","last_became_active":"2024-09-12T00:35:43.931008+0000","last_became_peered":"2024-09-12T00:35:43.931008+0000","last_unstale":"2024-09-12T01:22:08.838790+0000","last_undegraded":"2024-09-12T01:22:08.838790+0000","last_fullsized":"2024-09-12T01:22:08.838790+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T01:22:08.838501+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T01:22:08.838501+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.838501+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:11.131001+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730252,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":516,"num_read_kb":33271,"num_write":1211,"num_write_kb":48012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.779666+0000","last_change":"2024-09-12T00:35:47.951130+0000","last_active":"2024-09-12T01:18:17.779666+0000","last_peered":"2024-09-12T01:18:17.779666+0000","last_clean":"2024-09-12T01:18:17.779666+0000","last_became_active":"2024-09-12T00:35:47.950328+0000","last_became_peered":"2024-09-12T00:35:47.950328+0000","last_unstale":"2024-09-12T01:18:17.779666+0000","last_undegraded":"2024-09-12T01:18:17.779666+0000","last_fullsized":"2024-09-12T01:18:17.779666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:21.340191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'320","reported_seq":925,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.090083+0000","last_change":"2024-09-12T00:35:49.939297+0000","last_active":"2024-09-12T01:21:57.090083+0000","last_peered":"2024-09-12T01:21:57.090083+0000","last_clean":"2024-09-12T01:21:57.090083+0000","last_became_active":"2024-09-12T00:35:49.938536+0000","last_became_peered":"2024-09-12T00:35:49.938536+0000","last_unstale":"2024-09-12T01:21:57.090083+0000","last_undegraded":"2024-09-12T01:21:57.090083+0000","last_fullsized":"2024-09-12T01:21:57.090083+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:13.330863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46352,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":532,"num_read_kb":1127,"num_write":424,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":482,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:23.575502+0000","last_change":"2024-09-12T00:35:51.965185+0000","last_active":"2024-09-12T01:19:23.575502+0000","last_peered":"2024-09-12T01:19:23.575502+0000","last_clean":"2024-09-12T01:19:23.575502+0000","last_became_active":"2024-09-12T00:35:51.964446+0000","last_became_peered":"2024-09-12T00:35:51.964446+0000","last_unstale":"2024-09-12T01:19:23.575502+0000","last_undegraded":"2024-09-12T01:19:23.575502+0000","last_fullsized":"2024-09-12T01:19:23.575502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:04.163874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'136","reported_seq":648,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:20.487261+0000","last_change":"2024-09-12T00:35:53.998710+0000","last_active":"2024-09-12T01:20:20.487261+0000","last_peered":"2024-09-12T01:20:20.487261+0000","last_clean":"2024-09-12T01:20:20.487261+0000","last_became_active":"2024-09-12T00:35:53.997969+0000","last_became_peered":"2024-09-12T00:35:53.997969+0000","last_unstale":"2024-09-12T01:20:20.487261+0000","last_undegraded":"2024-09-12T01:20:20.487261+0000","last_fullsized":"2024-09-12T01:20:20.487261+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:50.127097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":591,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":213,"num_read_kb":189,"num_write":344,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'118","reported_seq":710,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.065435+0000","last_change":"2024-09-12T01:22:18.065435+0000","last_active":"2024-09-12T01:22:18.065435+0000","last_peered":"2024-09-12T01:22:18.065435+0000","last_clean":"2024-09-12T01:22:18.065435+0000","last_became_active":"2024-09-12T00:35:45.937597+0000","last_became_peered":"2024-09-12T00:35:45.937597+0000","last_unstale":"2024-09-12T01:22:18.065435+0000","last_undegraded":"2024-09-12T01:22:18.065435+0000","last_fullsized":"2024-09-12T01:22:18.065435+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'118","last_scrub_stamp":"2024-09-12T01:22:18.065264+0000","last_deep_scrub":"265'118","last_deep_scrub_stamp":"2024-09-12T01:22:18.065264+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.065264+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:09.449396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":514,"num_read_kb":428,"num_write":167,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'305","reported_seq":907,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.754730+0000","last_change":"2024-09-12T01:22:10.754730+0000","last_active":"2024-09-12T01:22:10.754730+0000","last_peered":"2024-09-12T01:22:10.754730+0000","last_clean":"2024-09-12T01:22:10.754730+0000","last_became_active":"2024-09-12T00:35:43.913717+0000","last_became_peered":"2024-09-12T00:35:43.913717+0000","last_unstale":"2024-09-12T01:22:10.754730+0000","last_undegraded":"2024-09-12T01:22:10.754730+0000","last_fullsized":"2024-09-12T01:22:10.754730+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'305","last_scrub_stamp":"2024-09-12T01:22:10.754524+0000","last_deep_scrub":"265'305","last_deep_scrub_stamp":"2024-09-12T01:22:10.754524+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.754524+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:56.169168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":6749,"num_write":932,"num_write_kb":25345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.552287+0000","last_change":"2024-09-12T00:35:47.940913+0000","last_active":"2024-09-12T01:18:18.552287+0000","last_peered":"2024-09-12T01:18:18.552287+0000","last_clean":"2024-09-12T01:18:18.552287+0000","last_became_active":"2024-09-12T00:35:47.940170+0000","last_became_peered":"2024-09-12T00:35:47.940170+0000","last_unstale":"2024-09-12T01:18:18.552287+0000","last_undegraded":"2024-09-12T01:18:18.552287+0000","last_fullsized":"2024-09-12T01:18:18.552287+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:41.868094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'276","reported_seq":844,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.130796+0000","last_change":"2024-09-12T00:35:49.954441+0000","last_active":"2024-09-12T01:21:57.130796+0000","last_peered":"2024-09-12T01:21:57.130796+0000","last_clean":"2024-09-12T01:21:57.130796+0000","last_became_active":"2024-09-12T00:35:49.952570+0000","last_became_peered":"2024-09-12T00:35:49.952570+0000","last_unstale":"2024-09-12T01:21:57.130796+0000","last_undegraded":"2024-09-12T01:21:57.130796+0000","last_fullsized":"2024-09-12T01:21:57.130796+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:31.309890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47159,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":464,"num_read_kb":1078,"num_write":380,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:27.561305+0000","last_change":"2024-09-12T00:35:51.974531+0000","last_active":"2024-09-12T01:19:27.561305+0000","last_peered":"2024-09-12T01:19:27.561305+0000","last_clean":"2024-09-12T01:19:27.561305+0000","last_became_active":"2024-09-12T00:35:51.973732+0000","last_became_peered":"2024-09-12T00:35:51.973732+0000","last_unstale":"2024-09-12T01:19:27.561305+0000","last_undegraded":"2024-09-12T01:19:27.561305+0000","last_fullsized":"2024-09-12T01:19:27.561305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:28.353680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'193","reported_seq":706,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.123850+0000","last_change":"2024-09-12T00:35:54.016500+0000","last_active":"2024-09-12T01:19:37.123850+0000","last_peered":"2024-09-12T01:19:37.123850+0000","last_clean":"2024-09-12T01:19:37.123850+0000","last_became_active":"2024-09-12T00:35:54.016028+0000","last_became_peered":"2024-09-12T00:35:54.016028+0000","last_unstale":"2024-09-12T01:19:37.123850+0000","last_undegraded":"2024-09-12T01:19:37.123850+0000","last_fullsized":"2024-09-12T01:19:37.123850+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:13.793560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":175,"num_read_kb":171,"num_write":438,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'198","reported_seq":819,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.646649+0000","last_change":"2024-09-12T01:22:18.646649+0000","last_active":"2024-09-12T01:22:18.646649+0000","last_peered":"2024-09-12T01:22:18.646649+0000","last_clean":"2024-09-12T01:22:18.646649+0000","last_became_active":"2024-09-12T00:35:45.941396+0000","last_became_peered":"2024-09-12T00:35:45.941396+0000","last_unstale":"2024-09-12T01:22:18.646649+0000","last_undegraded":"2024-09-12T01:22:18.646649+0000","last_fullsized":"2024-09-12T01:22:18.646649+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'198","last_scrub_stamp":"2024-09-12T01:22:18.646473+0000","last_deep_scrub":"265'198","last_deep_scrub_stamp":"2024-09-12T01:22:18.646473+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.646473+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:34.987983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":858,"num_read_kb":711,"num_write":323,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'462","reported_seq":1346,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.610259+0000","last_change":"2024-09-12T01:22:07.610259+0000","last_active":"2024-09-12T01:22:07.610259+0000","last_peered":"2024-09-12T01:22:07.610259+0000","last_clean":"2024-09-12T01:22:07.610259+0000","last_became_active":"2024-09-12T00:35:43.942359+0000","last_became_peered":"2024-09-12T00:35:43.942359+0000","last_unstale":"2024-09-12T01:22:07.610259+0000","last_undegraded":"2024-09-12T01:22:07.610259+0000","last_fullsized":"2024-09-12T01:22:07.610259+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'462","last_scrub_stamp":"2024-09-12T01:22:07.610037+0000","last_deep_scrub":"265'462","last_deep_scrub_stamp":"2024-09-12T01:22:07.610037+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.610037+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:31.652109+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1122,"num_read_kb":58431,"num_write":1508,"num_write_kb":72479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:17.551730+0000","last_change":"2024-09-12T00:35:47.941539+0000","last_active":"2024-09-12T01:19:17.551730+0000","last_peered":"2024-09-12T01:19:17.551730+0000","last_clean":"2024-09-12T01:19:17.551730+0000","last_became_active":"2024-09-12T00:35:47.940501+0000","last_became_peered":"2024-09-12T00:35:47.940501+0000","last_unstale":"2024-09-12T01:19:17.551730+0000","last_undegraded":"2024-09-12T01:19:17.551730+0000","last_fullsized":"2024-09-12T01:19:17.551730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:46.907958+0000","last_clean_scrub_stamp":"2024-09-12T00:35:46.907958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:32.448595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'228","reported_seq":788,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.785257+0000","last_change":"2024-09-12T00:35:49.956360+0000","last_active":"2024-09-12T01:21:56.785257+0000","last_peered":"2024-09-12T01:21:56.785257+0000","last_clean":"2024-09-12T01:21:56.785257+0000","last_became_active":"2024-09-12T00:35:49.955264+0000","last_became_peered":"2024-09-12T00:35:49.955264+0000","last_unstale":"2024-09-12T01:21:56.785257+0000","last_undegraded":"2024-09-12T01:21:56.785257+0000","last_fullsized":"2024-09-12T01:21:56.785257+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:15.469778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44002,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":385,"num_read_kb":903,"num_write":312,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:22.740634+0000","last_change":"2024-09-12T00:35:51.965221+0000","last_active":"2024-09-12T01:18:22.740634+0000","last_peered":"2024-09-12T01:18:22.740634+0000","last_clean":"2024-09-12T01:18:22.740634+0000","last_became_active":"2024-09-12T00:35:51.961691+0000","last_became_peered":"2024-09-12T00:35:51.961691+0000","last_unstale":"2024-09-12T01:18:22.740634+0000","last_undegraded":"2024-09-12T01:18:22.740634+0000","last_fullsized":"2024-09-12T01:18:22.740634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:22.139991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'194","reported_seq":1651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:20.421505+0000","last_change":"2024-09-12T00:35:53.992266+0000","last_active":"2024-09-12T01:20:20.421505+0000","last_peered":"2024-09-12T01:20:20.421505+0000","last_clean":"2024-09-12T01:20:20.421505+0000","last_became_active":"2024-09-12T00:35:53.991532+0000","last_became_peered":"2024-09-12T00:35:53.991532+0000","last_unstale":"2024-09-12T01:20:20.421505+0000","last_undegraded":"2024-09-12T01:20:20.421505+0000","last_fullsized":"2024-09-12T01:20:20.421505+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:47.645297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1185,"num_read_kb":1184,"num_write":442,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'185","reported_seq":804,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.985260+0000","last_change":"2024-09-12T01:22:14.985260+0000","last_active":"2024-09-12T01:22:14.985260+0000","last_peered":"2024-09-12T01:22:14.985260+0000","last_clean":"2024-09-12T01:22:14.985260+0000","last_became_active":"2024-09-12T00:35:45.954474+0000","last_became_peered":"2024-09-12T00:35:45.954474+0000","last_unstale":"2024-09-12T01:22:14.985260+0000","last_undegraded":"2024-09-12T01:22:14.985260+0000","last_fullsized":"2024-09-12T01:22:14.985260+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'185","last_scrub_stamp":"2024-09-12T01:22:14.985076+0000","last_deep_scrub":"265'185","last_deep_scrub_stamp":"2024-09-12T01:22:14.985076+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.985076+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:20.057452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":774,"num_read_kb":643,"num_write":252,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'374","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.636292+0000","last_change":"2024-09-12T01:22:07.636292+0000","last_active":"2024-09-12T01:22:07.636292+0000","last_peered":"2024-09-12T01:22:07.636292+0000","last_clean":"2024-09-12T01:22:07.636292+0000","last_became_active":"2024-09-12T00:35:43.934998+0000","last_became_peered":"2024-09-12T00:35:43.934998+0000","last_unstale":"2024-09-12T01:22:07.636292+0000","last_undegraded":"2024-09-12T01:22:07.636292+0000","last_fullsized":"2024-09-12T01:22:07.636292+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T01:22:07.636085+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T01:22:07.636085+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.636085+0000","objects_scrubbed":6,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:58.942568+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":520,"num_read_kb":15471,"num_write":1132,"num_write_kb":44978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"265'2","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.266105+0000","last_change":"2024-09-12T01:22:18.266105+0000","last_active":"2024-09-12T01:22:18.266105+0000","last_peered":"2024-09-12T01:22:18.266105+0000","last_clean":"2024-09-12T01:22:18.266105+0000","last_became_active":"2024-09-12T00:35:47.928424+0000","last_became_peered":"2024-09-12T00:35:47.928424+0000","last_unstale":"2024-09-12T01:22:18.266105+0000","last_undegraded":"2024-09-12T01:22:18.266105+0000","last_fullsized":"2024-09-12T01:22:18.266105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:18.265915+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:18.265915+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.265915+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:57.030554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'297","reported_seq":895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.898129+0000","last_change":"2024-09-12T00:35:49.934387+0000","last_active":"2024-09-12T01:21:56.898129+0000","last_peered":"2024-09-12T01:21:56.898129+0000","last_clean":"2024-09-12T01:21:56.898129+0000","last_became_active":"2024-09-12T00:35:49.933165+0000","last_became_peered":"2024-09-12T00:35:49.933165+0000","last_unstale":"2024-09-12T01:21:56.898129+0000","last_undegraded":"2024-09-12T01:21:56.898129+0000","last_fullsized":"2024-09-12T01:21:56.898129+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:48.914482+0000","last_clean_scrub_stamp":"2024-09-12T00:35:48.914482+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:40.275776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49116,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":493,"num_read_kb":1065,"num_write":392,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.560633+0000","last_change":"2024-09-12T00:35:51.985500+0000","last_active":"2024-09-12T01:18:23.560633+0000","last_peered":"2024-09-12T01:18:23.560633+0000","last_clean":"2024-09-12T01:18:23.560633+0000","last_became_active":"2024-09-12T00:35:51.984756+0000","last_became_peered":"2024-09-12T00:35:51.984756+0000","last_unstale":"2024-09-12T01:18:23.560633+0000","last_undegraded":"2024-09-12T01:18:23.560633+0000","last_fullsized":"2024-09-12T01:18:23.560633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:50.936466+0000","last_clean_scrub_stamp":"2024-09-12T00:35:50.936466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:50.437627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'185","reported_seq":692,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:24.493960+0000","last_change":"2024-09-12T00:35:53.986078+0000","last_active":"2024-09-12T01:21:24.493960+0000","last_peered":"2024-09-12T01:21:24.493960+0000","last_clean":"2024-09-12T01:21:24.493960+0000","last_became_active":"2024-09-12T00:35:53.985486+0000","last_became_peered":"2024-09-12T00:35:53.985486+0000","last_unstale":"2024-09-12T01:21:24.493960+0000","last_undegraded":"2024-09-12T01:21:24.493960+0000","last_fullsized":"2024-09-12T01:21:24.493960+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:09.339192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1062,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":193,"num_read_kb":167,"num_write":361,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'182","reported_seq":732,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.261888+0000","last_change":"2024-09-12T01:22:19.261888+0000","last_active":"2024-09-12T01:22:19.261888+0000","last_peered":"2024-09-12T01:22:19.261888+0000","last_clean":"2024-09-12T01:22:19.261888+0000","last_became_active":"2024-09-12T00:35:45.957698+0000","last_became_peered":"2024-09-12T00:35:45.957698+0000","last_unstale":"2024-09-12T01:22:19.261888+0000","last_undegraded":"2024-09-12T01:22:19.261888+0000","last_fullsized":"2024-09-12T01:22:19.261888+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'182","last_scrub_stamp":"2024-09-12T01:22:19.261702+0000","last_deep_scrub":"265'182","last_deep_scrub_stamp":"2024-09-12T01:22:19.261702+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.261702+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:20.463886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":768,"num_read_kb":623,"num_write":277,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'396","reported_seq":1075,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.181416+0000","last_change":"2024-09-12T01:22:08.181416+0000","last_active":"2024-09-12T01:22:08.181416+0000","last_peered":"2024-09-12T01:22:08.181416+0000","last_clean":"2024-09-12T01:22:08.181416+0000","last_became_active":"2024-09-12T00:35:43.937281+0000","last_became_peered":"2024-09-12T00:35:43.937281+0000","last_unstale":"2024-09-12T01:22:08.181416+0000","last_undegraded":"2024-09-12T01:22:08.181416+0000","last_fullsized":"2024-09-12T01:22:08.181416+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'396","last_scrub_stamp":"2024-09-12T01:22:08.181179+0000","last_deep_scrub":"265'396","last_deep_scrub_stamp":"2024-09-12T01:22:08.181179+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.181179+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:58.834889+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550668,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":606,"num_read_kb":52877,"num_write":1364,"num_write_kb":41162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'421","reported_seq":1118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.183784+0000","last_change":"2024-09-12T01:22:15.183784+0000","last_active":"2024-09-12T01:22:15.183784+0000","last_peered":"2024-09-12T01:22:15.183784+0000","last_clean":"2024-09-12T01:22:15.183784+0000","last_became_active":"2024-09-12T00:35:45.932615+0000","last_became_peered":"2024-09-12T00:35:45.932615+0000","last_unstale":"2024-09-12T01:22:15.183784+0000","last_undegraded":"2024-09-12T01:22:15.183784+0000","last_fullsized":"2024-09-12T01:22:15.183784+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'421","last_scrub_stamp":"2024-09-12T01:22:15.183600+0000","last_deep_scrub":"265'421","last_deep_scrub_stamp":"2024-09-12T01:22:15.183600+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.183600+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:05.389393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2107,"num_read_kb":1905,"num_write":744,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'291","reported_seq":960,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.448034+0000","last_change":"2024-09-12T01:22:08.448034+0000","last_active":"2024-09-12T01:22:08.448034+0000","last_peered":"2024-09-12T01:22:08.448034+0000","last_clean":"2024-09-12T01:22:08.448034+0000","last_became_active":"2024-09-12T00:35:43.922005+0000","last_became_peered":"2024-09-12T00:35:43.922005+0000","last_unstale":"2024-09-12T01:22:08.448034+0000","last_undegraded":"2024-09-12T01:22:08.448034+0000","last_fullsized":"2024-09-12T01:22:08.448034+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'291","last_scrub_stamp":"2024-09-12T01:22:08.447802+0000","last_deep_scrub":"265'291","last_deep_scrub_stamp":"2024-09-12T01:22:08.447802+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.447802+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:44.780769+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":535,"num_read_kb":1388,"num_write":997,"num_write_kb":25405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'246","reported_seq":873,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.721615+0000","last_change":"2024-09-12T01:22:19.721615+0000","last_active":"2024-09-12T01:22:19.721615+0000","last_peered":"2024-09-12T01:22:19.721615+0000","last_clean":"2024-09-12T01:22:19.721615+0000","last_became_active":"2024-09-12T00:35:45.940153+0000","last_became_peered":"2024-09-12T00:35:45.940153+0000","last_unstale":"2024-09-12T01:22:19.721615+0000","last_undegraded":"2024-09-12T01:22:19.721615+0000","last_fullsized":"2024-09-12T01:22:19.721615+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'246","last_scrub_stamp":"2024-09-12T01:22:19.721431+0000","last_deep_scrub":"265'246","last_deep_scrub_stamp":"2024-09-12T01:22:19.721431+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.721431+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:39.443952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1055,"num_read_kb":856,"num_write":397,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'353","reported_seq":969,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.429300+0000","last_change":"2024-09-12T01:22:11.429300+0000","last_active":"2024-09-12T01:22:11.429300+0000","last_peered":"2024-09-12T01:22:11.429300+0000","last_clean":"2024-09-12T01:22:11.429300+0000","last_became_active":"2024-09-12T00:36:17.267594+0000","last_became_peered":"2024-09-12T00:36:17.267594+0000","last_unstale":"2024-09-12T01:22:11.429300+0000","last_undegraded":"2024-09-12T01:22:11.429300+0000","last_fullsized":"2024-09-12T01:22:11.429300+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'353","last_scrub_stamp":"2024-09-12T01:22:11.429005+0000","last_deep_scrub":"265'353","last_deep_scrub_stamp":"2024-09-12T01:22:11.429005+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.429005+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:45.151943+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436874,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":471,"num_read_kb":41052,"num_write":1136,"num_write_kb":25796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"265'93","reported_seq":678,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.152389+0000","last_change":"2024-09-12T01:22:14.152389+0000","last_active":"2024-09-12T01:22:14.152389+0000","last_peered":"2024-09-12T01:22:14.152389+0000","last_clean":"2024-09-12T01:22:14.152389+0000","last_became_active":"2024-09-12T00:35:45.945534+0000","last_became_peered":"2024-09-12T00:35:45.945534+0000","last_unstale":"2024-09-12T01:22:14.152389+0000","last_undegraded":"2024-09-12T01:22:14.152389+0000","last_fullsized":"2024-09-12T01:22:14.152389+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'93","last_scrub_stamp":"2024-09-12T01:22:14.152209+0000","last_deep_scrub":"265'93","last_deep_scrub_stamp":"2024-09-12T01:22:14.152209+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.152209+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:25.890852+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":411,"num_read_kb":349,"num_write":136,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'324","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.602990+0000","last_change":"2024-09-12T01:22:08.602990+0000","last_active":"2024-09-12T01:22:08.602990+0000","last_peered":"2024-09-12T01:22:08.602990+0000","last_clean":"2024-09-12T01:22:08.602990+0000","last_became_active":"2024-09-12T00:35:43.934068+0000","last_became_peered":"2024-09-12T00:35:43.934068+0000","last_unstale":"2024-09-12T01:22:08.602990+0000","last_undegraded":"2024-09-12T01:22:08.602990+0000","last_fullsized":"2024-09-12T01:22:08.602990+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T01:22:08.602769+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T01:22:08.602769+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.602769+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:18.211995+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":780267,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":473,"num_read_kb":16449,"num_write":1046,"num_write_kb":32400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'160","reported_seq":804,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.624197+0000","last_change":"2024-09-12T01:22:22.624197+0000","last_active":"2024-09-12T01:22:22.624197+0000","last_peered":"2024-09-12T01:22:22.624197+0000","last_clean":"2024-09-12T01:22:22.624197+0000","last_became_active":"2024-09-12T00:35:45.944423+0000","last_became_peered":"2024-09-12T00:35:45.944423+0000","last_unstale":"2024-09-12T01:22:22.624197+0000","last_undegraded":"2024-09-12T01:22:22.624197+0000","last_fullsized":"2024-09-12T01:22:22.624197+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'160","last_scrub_stamp":"2024-09-12T01:22:22.623982+0000","last_deep_scrub":"265'160","last_deep_scrub_stamp":"2024-09-12T01:22:22.623982+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.623982+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:20.633894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":713,"num_read_kb":599,"num_write":226,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"265'346","reported_seq":1024,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.595018+0000","last_change":"2024-09-12T01:22:09.595018+0000","last_active":"2024-09-12T01:22:09.595018+0000","last_peered":"2024-09-12T01:22:09.595018+0000","last_clean":"2024-09-12T01:22:09.595018+0000","last_became_active":"2024-09-12T00:35:43.937104+0000","last_became_peered":"2024-09-12T00:35:43.937104+0000","last_unstale":"2024-09-12T01:22:09.595018+0000","last_undegraded":"2024-09-12T01:22:09.595018+0000","last_fullsized":"2024-09-12T01:22:09.595018+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'346","last_scrub_stamp":"2024-09-12T01:22:09.594896+0000","last_deep_scrub":"265'346","last_deep_scrub_stamp":"2024-09-12T01:22:09.594896+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.594896+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:28.710562+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262271,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":572,"num_read_kb":63038,"num_write":1116,"num_write_kb":29306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'252","reported_seq":855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.042216+0000","last_change":"2024-09-12T01:22:17.042216+0000","last_active":"2024-09-12T01:22:17.042216+0000","last_peered":"2024-09-12T01:22:17.042216+0000","last_clean":"2024-09-12T01:22:17.042216+0000","last_became_active":"2024-09-12T00:35:45.957860+0000","last_became_peered":"2024-09-12T00:35:45.957860+0000","last_unstale":"2024-09-12T01:22:17.042216+0000","last_undegraded":"2024-09-12T01:22:17.042216+0000","last_fullsized":"2024-09-12T01:22:17.042216+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'252","last_scrub_stamp":"2024-09-12T01:22:17.042033+0000","last_deep_scrub":"265'252","last_deep_scrub_stamp":"2024-09-12T01:22:17.042033+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.042033+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:06.623032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1076,"num_read_kb":859,"num_write":407,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":266,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'346","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.234790+0000","last_change":"2024-09-12T01:22:09.234790+0000","last_active":"2024-09-12T01:22:09.234790+0000","last_peered":"2024-09-12T01:22:09.234790+0000","last_clean":"2024-09-12T01:22:09.234790+0000","last_became_active":"2024-09-12T00:35:43.929027+0000","last_became_peered":"2024-09-12T00:35:43.929027+0000","last_unstale":"2024-09-12T01:22:09.234790+0000","last_undegraded":"2024-09-12T01:22:09.234790+0000","last_fullsized":"2024-09-12T01:22:09.234790+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'346","last_scrub_stamp":"2024-09-12T01:22:09.234559+0000","last_deep_scrub":"265'346","last_deep_scrub_stamp":"2024-09-12T01:22:09.234559+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.234559+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:22.211508+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":588,"num_read_kb":747,"num_write":1224,"num_write_kb":5740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'102","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.588099+0000","last_change":"2024-09-12T01:22:20.588099+0000","last_active":"2024-09-12T01:22:20.588099+0000","last_peered":"2024-09-12T01:22:20.588099+0000","last_clean":"2024-09-12T01:22:20.588099+0000","last_became_active":"2024-09-12T00:35:45.948581+0000","last_became_peered":"2024-09-12T00:35:45.948581+0000","last_unstale":"2024-09-12T01:22:20.588099+0000","last_undegraded":"2024-09-12T01:22:20.588099+0000","last_fullsized":"2024-09-12T01:22:20.588099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'102","last_scrub_stamp":"2024-09-12T01:22:20.587828+0000","last_deep_scrub":"265'102","last_deep_scrub_stamp":"2024-09-12T01:22:20.587828+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.587828+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:41.592609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":463,"num_read_kb":395,"num_write":145,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"265'337","reported_seq":976,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.202666+0000","last_change":"2024-09-12T01:22:09.202666+0000","last_active":"2024-09-12T01:22:09.202666+0000","last_peered":"2024-09-12T01:22:09.202666+0000","last_clean":"2024-09-12T01:22:09.202666+0000","last_became_active":"2024-09-12T00:35:43.941155+0000","last_became_peered":"2024-09-12T00:35:43.941155+0000","last_unstale":"2024-09-12T01:22:09.202666+0000","last_undegraded":"2024-09-12T01:22:09.202666+0000","last_fullsized":"2024-09-12T01:22:09.202666+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'337","last_scrub_stamp":"2024-09-12T01:22:09.202393+0000","last_deep_scrub":"265'337","last_deep_scrub_stamp":"2024-09-12T01:22:09.202393+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.202393+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:57.460847+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":4200,"num_write":1081,"num_write_kb":60173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"265'210","reported_seq":851,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.155108+0000","last_change":"2024-09-12T01:22:15.155108+0000","last_active":"2024-09-12T01:22:15.155108+0000","last_peered":"2024-09-12T01:22:15.155108+0000","last_clean":"2024-09-12T01:22:15.155108+0000","last_became_active":"2024-09-12T00:35:45.946047+0000","last_became_peered":"2024-09-12T00:35:45.946047+0000","last_unstale":"2024-09-12T01:22:15.155108+0000","last_undegraded":"2024-09-12T01:22:15.155108+0000","last_fullsized":"2024-09-12T01:22:15.155108+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'210","last_scrub_stamp":"2024-09-12T01:22:15.154905+0000","last_deep_scrub":"265'210","last_deep_scrub_stamp":"2024-09-12T01:22:15.154905+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.154905+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:58.436758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":932,"num_read_kb":766,"num_write":302,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'323","reported_seq":970,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.593629+0000","last_change":"2024-09-12T01:22:11.593629+0000","last_active":"2024-09-12T01:22:11.593629+0000","last_peered":"2024-09-12T01:22:11.593629+0000","last_clean":"2024-09-12T01:22:11.593629+0000","last_became_active":"2024-09-12T00:35:43.923685+0000","last_became_peered":"2024-09-12T00:35:43.923685+0000","last_unstale":"2024-09-12T01:22:11.593629+0000","last_undegraded":"2024-09-12T01:22:11.593629+0000","last_fullsized":"2024-09-12T01:22:11.593629+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'323","last_scrub_stamp":"2024-09-12T01:22:11.593437+0000","last_deep_scrub":"265'323","last_deep_scrub_stamp":"2024-09-12T01:22:11.593437+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.593437+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:28.420949+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524322,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":440,"num_read_kb":73837,"num_write":961,"num_write_kb":48353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'100","reported_seq":686,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.511454+0000","last_change":"2024-09-12T01:22:20.511454+0000","last_active":"2024-09-12T01:22:20.511454+0000","last_peered":"2024-09-12T01:22:20.511454+0000","last_clean":"2024-09-12T01:22:20.511454+0000","last_became_active":"2024-09-12T00:35:45.941986+0000","last_became_peered":"2024-09-12T00:35:45.941986+0000","last_unstale":"2024-09-12T01:22:20.511454+0000","last_undegraded":"2024-09-12T01:22:20.511454+0000","last_fullsized":"2024-09-12T01:22:20.511454+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'100","last_scrub_stamp":"2024-09-12T01:22:20.511244+0000","last_deep_scrub":"265'100","last_deep_scrub_stamp":"2024-09-12T01:22:20.511244+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.511244+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:50.075824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":455,"num_read_kb":381,"num_write":169,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'340","reported_seq":1062,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.780884+0000","last_change":"2024-09-12T01:22:11.780884+0000","last_active":"2024-09-12T01:22:11.780884+0000","last_peered":"2024-09-12T01:22:11.780884+0000","last_clean":"2024-09-12T01:22:11.780884+0000","last_became_active":"2024-09-12T00:35:43.911654+0000","last_became_peered":"2024-09-12T00:35:43.911654+0000","last_unstale":"2024-09-12T01:22:11.780884+0000","last_undegraded":"2024-09-12T01:22:11.780884+0000","last_fullsized":"2024-09-12T01:22:11.780884+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'340","last_scrub_stamp":"2024-09-12T01:22:11.780673+0000","last_deep_scrub":"265'340","last_deep_scrub_stamp":"2024-09-12T01:22:11.780673+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.780673+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:55.696701+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262180,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":572,"num_read_kb":5667,"num_write":1085,"num_write_kb":32435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'262","reported_seq":860,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.999817+0000","last_change":"2024-09-12T01:22:19.999817+0000","last_active":"2024-09-12T01:22:19.999817+0000","last_peered":"2024-09-12T01:22:19.999817+0000","last_clean":"2024-09-12T01:22:19.999817+0000","last_became_active":"2024-09-12T00:35:45.926462+0000","last_became_peered":"2024-09-12T00:35:45.926462+0000","last_unstale":"2024-09-12T01:22:19.999817+0000","last_undegraded":"2024-09-12T01:22:19.999817+0000","last_fullsized":"2024-09-12T01:22:19.999817+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'262","last_scrub_stamp":"2024-09-12T01:22:19.999635+0000","last_deep_scrub":"265'262","last_deep_scrub_stamp":"2024-09-12T01:22:19.999635+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.999635+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:24.196701+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1050,"num_read_kb":836,"num_write":420,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'331","reported_seq":1013,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.620366+0000","last_change":"2024-09-12T01:22:10.620366+0000","last_active":"2024-09-12T01:22:10.620366+0000","last_peered":"2024-09-12T01:22:10.620366+0000","last_clean":"2024-09-12T01:22:10.620366+0000","last_became_active":"2024-09-12T00:35:43.936883+0000","last_became_peered":"2024-09-12T00:35:43.936883+0000","last_unstale":"2024-09-12T01:22:10.620366+0000","last_undegraded":"2024-09-12T01:22:10.620366+0000","last_fullsized":"2024-09-12T01:22:10.620366+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'331","last_scrub_stamp":"2024-09-12T01:22:10.620182+0000","last_deep_scrub":"265'331","last_deep_scrub_stamp":"2024-09-12T01:22:10.620182+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.620182+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:09.832438+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2075264,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":536,"num_read_kb":80814,"num_write":1042,"num_write_kb":32955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"265'151","reported_seq":745,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.482818+0000","last_change":"2024-09-12T01:22:05.482818+0000","last_active":"2024-09-12T01:22:05.482818+0000","last_peered":"2024-09-12T01:22:05.482818+0000","last_clean":"2024-09-12T01:22:05.482818+0000","last_became_active":"2024-09-12T00:35:45.958997+0000","last_became_peered":"2024-09-12T00:35:45.958997+0000","last_unstale":"2024-09-12T01:22:05.482818+0000","last_undegraded":"2024-09-12T01:22:05.482818+0000","last_fullsized":"2024-09-12T01:22:05.482818+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'151","last_scrub_stamp":"2024-09-12T01:22:05.482621+0000","last_deep_scrub":"265'151","last_deep_scrub_stamp":"2024-09-12T01:22:05.482621+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.482621+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:24.195434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":623,"num_read_kb":511,"num_write":250,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'381","reported_seq":1047,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.784028+0000","last_change":"2024-09-12T01:22:12.784028+0000","last_active":"2024-09-12T01:22:12.784028+0000","last_peered":"2024-09-12T01:22:12.784028+0000","last_clean":"2024-09-12T01:22:12.784028+0000","last_became_active":"2024-09-12T00:35:43.942591+0000","last_became_peered":"2024-09-12T00:35:43.942591+0000","last_unstale":"2024-09-12T01:22:12.784028+0000","last_undegraded":"2024-09-12T01:22:12.784028+0000","last_fullsized":"2024-09-12T01:22:12.784028+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'381","last_scrub_stamp":"2024-09-12T01:22:12.783792+0000","last_deep_scrub":"265'381","last_deep_scrub_stamp":"2024-09-12T01:22:12.783792+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.783792+0000","objects_scrubbed":11,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:25.661993+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":894961,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":508,"num_read_kb":28251,"num_write":1134,"num_write_kb":59925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"265'83","reported_seq":669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.041603+0000","last_change":"2024-09-12T01:22:19.041603+0000","last_active":"2024-09-12T01:22:19.041603+0000","last_peered":"2024-09-12T01:22:19.041603+0000","last_clean":"2024-09-12T01:22:19.041603+0000","last_became_active":"2024-09-12T00:35:45.954252+0000","last_became_peered":"2024-09-12T00:35:45.954252+0000","last_unstale":"2024-09-12T01:22:19.041603+0000","last_undegraded":"2024-09-12T01:22:19.041603+0000","last_fullsized":"2024-09-12T01:22:19.041603+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'83","last_scrub_stamp":"2024-09-12T01:22:19.041424+0000","last_deep_scrub":"265'83","last_deep_scrub_stamp":"2024-09-12T01:22:19.041424+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.041424+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:10.207954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":370,"num_read_kb":310,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'387","reported_seq":1048,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.572102+0000","last_change":"2024-09-12T01:22:09.572102+0000","last_active":"2024-09-12T01:22:09.572102+0000","last_peered":"2024-09-12T01:22:09.572102+0000","last_clean":"2024-09-12T01:22:09.572102+0000","last_became_active":"2024-09-12T00:35:43.952828+0000","last_became_peered":"2024-09-12T00:35:43.952828+0000","last_unstale":"2024-09-12T01:22:09.572102+0000","last_undegraded":"2024-09-12T01:22:09.572102+0000","last_fullsized":"2024-09-12T01:22:09.572102+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'387","last_scrub_stamp":"2024-09-12T01:22:09.571904+0000","last_deep_scrub":"265'387","last_deep_scrub_stamp":"2024-09-12T01:22:09.571904+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.571904+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:32.922872+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":611,"num_read_kb":10107,"num_write":1280,"num_write_kb":30495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'4193","reported_seq":4826,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.469762+0000","last_change":"2024-09-12T01:22:18.469762+0000","last_active":"2024-09-12T01:22:18.469762+0000","last_peered":"2024-09-12T01:22:18.469762+0000","last_clean":"2024-09-12T01:22:18.469762+0000","last_became_active":"2024-09-12T00:35:45.949770+0000","last_became_peered":"2024-09-12T00:35:45.949770+0000","last_unstale":"2024-09-12T01:22:18.469762+0000","last_undegraded":"2024-09-12T01:22:18.469762+0000","last_fullsized":"2024-09-12T01:22:18.469762+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4193","last_scrub_stamp":"2024-09-12T01:22:18.469588+0000","last_deep_scrub":"265'4193","last_deep_scrub_stamp":"2024-09-12T01:22:18.469588+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.469588+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":3000,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:27.939587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16900,"num_read_kb":14167,"num_write":6311,"num_write_kb":3148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'355","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.209104+0000","last_change":"2024-09-12T01:22:10.209104+0000","last_active":"2024-09-12T01:22:10.209104+0000","last_peered":"2024-09-12T01:22:10.209104+0000","last_clean":"2024-09-12T01:22:10.209104+0000","last_became_active":"2024-09-12T00:35:43.944721+0000","last_became_peered":"2024-09-12T00:35:43.944721+0000","last_unstale":"2024-09-12T01:22:10.209104+0000","last_undegraded":"2024-09-12T01:22:10.209104+0000","last_fullsized":"2024-09-12T01:22:10.209104+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'355","last_scrub_stamp":"2024-09-12T01:22:10.208841+0000","last_deep_scrub":"265'355","last_deep_scrub_stamp":"2024-09-12T01:22:10.208841+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.208841+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:01.036663+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730131,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":532,"num_read_kb":12444,"num_write":1159,"num_write_kb":48295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'222","reported_seq":865,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.539740+0000","last_change":"2024-09-12T01:22:16.539740+0000","last_active":"2024-09-12T01:22:16.539740+0000","last_peered":"2024-09-12T01:22:16.539740+0000","last_clean":"2024-09-12T01:22:16.539740+0000","last_became_active":"2024-09-12T00:35:45.939921+0000","last_became_peered":"2024-09-12T00:35:45.939921+0000","last_unstale":"2024-09-12T01:22:16.539740+0000","last_undegraded":"2024-09-12T01:22:16.539740+0000","last_fullsized":"2024-09-12T01:22:16.539740+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'222","last_scrub_stamp":"2024-09-12T01:22:16.539565+0000","last_deep_scrub":"265'222","last_deep_scrub_stamp":"2024-09-12T01:22:16.539565+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.539565+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:08.131916+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":991,"num_read_kb":821,"num_write":345,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":504,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'347","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.536922+0000","last_change":"2024-09-12T01:22:13.536922+0000","last_active":"2024-09-12T01:22:13.536922+0000","last_peered":"2024-09-12T01:22:13.536922+0000","last_clean":"2024-09-12T01:22:13.536922+0000","last_became_active":"2024-09-12T00:35:43.942772+0000","last_became_peered":"2024-09-12T00:35:43.942772+0000","last_unstale":"2024-09-12T01:22:13.536922+0000","last_undegraded":"2024-09-12T01:22:13.536922+0000","last_fullsized":"2024-09-12T01:22:13.536922+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T01:22:13.536675+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T01:22:13.536675+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.536675+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:15.728162+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2329981,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":472,"num_read_kb":15742,"num_write":1095,"num_write_kb":41173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'153","reported_seq":771,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:33.583730+0000","last_change":"2024-09-12T00:35:45.938724+0000","last_active":"2024-09-12T01:18:33.583730+0000","last_peered":"2024-09-12T01:18:33.583730+0000","last_clean":"2024-09-12T01:18:33.583730+0000","last_became_active":"2024-09-12T00:35:45.937998+0000","last_became_peered":"2024-09-12T00:35:45.937998+0000","last_unstale":"2024-09-12T01:18:33.583730+0000","last_undegraded":"2024-09-12T01:18:33.583730+0000","last_fullsized":"2024-09-12T01:18:33.583730+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:04.489640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":680,"num_read_kb":568,"num_write":226,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'362","reported_seq":1071,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.488496+0000","last_change":"2024-09-12T01:22:07.488496+0000","last_active":"2024-09-12T01:22:07.488496+0000","last_peered":"2024-09-12T01:22:07.488496+0000","last_clean":"2024-09-12T01:22:07.488496+0000","last_became_active":"2024-09-12T00:35:43.940876+0000","last_became_peered":"2024-09-12T00:35:43.940876+0000","last_unstale":"2024-09-12T01:22:07.488496+0000","last_undegraded":"2024-09-12T01:22:07.488496+0000","last_fullsized":"2024-09-12T01:22:07.488496+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'362","last_scrub_stamp":"2024-09-12T01:22:07.488235+0000","last_deep_scrub":"265'362","last_deep_scrub_stamp":"2024-09-12T01:22:07.488235+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.488235+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:21.148458+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":724,"num_read_kb":28886,"num_write":1110,"num_write_kb":16361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'147","reported_seq":792,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.458525+0000","last_change":"2024-09-12T01:22:20.458525+0000","last_active":"2024-09-12T01:22:20.458525+0000","last_peered":"2024-09-12T01:22:20.458525+0000","last_clean":"2024-09-12T01:22:20.458525+0000","last_became_active":"2024-09-12T00:35:45.948028+0000","last_became_peered":"2024-09-12T00:35:45.948028+0000","last_unstale":"2024-09-12T01:22:20.458525+0000","last_undegraded":"2024-09-12T01:22:20.458525+0000","last_fullsized":"2024-09-12T01:22:20.458525+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'147","last_scrub_stamp":"2024-09-12T01:22:20.458339+0000","last_deep_scrub":"265'147","last_deep_scrub_stamp":"2024-09-12T01:22:20.458339+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.458339+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:06.018727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":702,"num_read_kb":590,"num_write":208,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4004,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'347","reported_seq":1033,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.813763+0000","last_change":"2024-09-12T01:22:13.813608+0000","last_active":"2024-09-12T01:22:13.813763+0000","last_peered":"2024-09-12T01:22:13.813763+0000","last_clean":"2024-09-12T01:22:13.813763+0000","last_became_active":"2024-09-12T00:35:43.950791+0000","last_became_peered":"2024-09-12T00:35:43.950791+0000","last_unstale":"2024-09-12T01:22:13.813763+0000","last_undegraded":"2024-09-12T01:22:13.813763+0000","last_fullsized":"2024-09-12T01:22:13.813763+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T01:22:13.813378+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T01:22:13.813378+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.813378+0000","objects_scrubbed":10,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:26.242258+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5529046,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":579,"num_read_kb":37013,"num_write":1080,"num_write_kb":45879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'300","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.828572+0000","last_change":"2024-09-12T01:22:14.828375+0000","last_active":"2024-09-12T01:22:14.828572+0000","last_peered":"2024-09-12T01:22:14.828572+0000","last_clean":"2024-09-12T01:22:14.828572+0000","last_became_active":"2024-09-12T00:35:43.931367+0000","last_became_peered":"2024-09-12T00:35:43.931367+0000","last_unstale":"2024-09-12T01:22:14.828572+0000","last_undegraded":"2024-09-12T01:22:14.828572+0000","last_fullsized":"2024-09-12T01:22:14.828572+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'300","last_scrub_stamp":"2024-09-12T01:22:14.828161+0000","last_deep_scrub":"265'300","last_deep_scrub_stamp":"2024-09-12T01:22:14.828161+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.828161+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:57.972569+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":466,"num_read_kb":37317,"num_write":980,"num_write_kb":22412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'443","reported_seq":1072,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:28.576933+0000","last_change":"2024-09-12T00:35:45.941592+0000","last_active":"2024-09-12T01:19:28.576933+0000","last_peered":"2024-09-12T01:19:28.576933+0000","last_clean":"2024-09-12T01:19:28.576933+0000","last_became_active":"2024-09-12T00:35:45.941136+0000","last_became_peered":"2024-09-12T00:35:45.941136+0000","last_unstale":"2024-09-12T01:19:28.576933+0000","last_undegraded":"2024-09-12T01:19:28.576933+0000","last_fullsized":"2024-09-12T01:19:28.576933+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:44.901221+0000","last_clean_scrub_stamp":"2024-09-12T00:35:44.901221+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:02.451398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1924,"num_read_kb":1655,"num_write":712,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'347","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.229317+0000","last_change":"2024-09-12T01:22:17.229188+0000","last_active":"2024-09-12T01:22:17.229317+0000","last_peered":"2024-09-12T01:22:17.229317+0000","last_clean":"2024-09-12T01:22:17.229317+0000","last_became_active":"2024-09-12T00:35:43.936772+0000","last_became_peered":"2024-09-12T00:35:43.936772+0000","last_unstale":"2024-09-12T01:22:17.229317+0000","last_undegraded":"2024-09-12T01:22:17.229317+0000","last_fullsized":"2024-09-12T01:22:17.229317+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T01:22:17.228996+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T01:22:17.228996+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.228996+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:58.587295+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":514466,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":11206,"num_write":1103,"num_write_kb":22250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'123","reported_seq":737,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.713240+0000","last_change":"2024-09-12T01:22:21.713240+0000","last_active":"2024-09-12T01:22:21.713240+0000","last_peered":"2024-09-12T01:22:21.713240+0000","last_clean":"2024-09-12T01:22:21.713240+0000","last_became_active":"2024-09-12T00:35:45.933748+0000","last_became_peered":"2024-09-12T00:35:45.933748+0000","last_unstale":"2024-09-12T01:22:21.713240+0000","last_undegraded":"2024-09-12T01:22:21.713240+0000","last_fullsized":"2024-09-12T01:22:21.713240+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'123","last_scrub_stamp":"2024-09-12T01:22:21.713057+0000","last_deep_scrub":"265'123","last_deep_scrub_stamp":"2024-09-12T01:22:21.713057+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.713057+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:00.223366+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":571,"num_read_kb":478,"num_write":188,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5965,"num_read_kb":4303,"num_write":1960,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":931,"ondisk_log_size":931,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":15013,"num_read_kb":14673,"num_write":16730,"num_write_kb":4883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2159,"ondisk_log_size":2159,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":583,"ondisk_log_size":583,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1547252,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":17692,"num_read_kb":36824,"num_write":14761,"num_write_kb":11530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":512814,"num_omap_keys":1162,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1971,"ondisk_log_size":1971,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2433,"num_read_kb":2900,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102034,"num_read_kb":85265,"num_write":36996,"num_write_kb":18612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":40694,"num_omap_keys":163,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3947,"ondisk_log_size":3947,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":73603174,"num_objects":366,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":366,"num_whiteouts":0,"num_read":35859,"num_read_kb":1958475,"num_write":71400,"num_write_kb":2147647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":148455424,"data_stored":147206348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3894,"ondisk_log_size":3894,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":174261,"num_write":154,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":179336,"num_write":154,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424510009,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":152624,"kb_used_data":36832,"kb_used_omap":1,"kb_used_meta":115774,"kb_avail":94219216,"statfs":{"total":96636764160,"available":96480477184,"internally_reserved":0,"allocated":37715968,"data_stored":35946887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":118553029},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510008,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280192,"kb_used_data":32432,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":94091648,"statfs":{"total":96636764160,"available":96349847552,"internally_reserved":0,"allocated":33210368,"data_stored":31432953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":253688263},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510010,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109536,"kb_used_data":10384,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94262304,"statfs":{"total":96636764160,"available":96524599296,"internally_reserved":0,"allocated":10633216,"data_stored":9073175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510009,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249396,"kb_used_data":29412,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94122444,"statfs":{"total":96636764160,"available":96381382656,"internally_reserved":0,"allocated":30117888,"data_stored":28384468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":225245637},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542712,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250016,"kb_used_data":20304,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94121824,"statfs":{"total":96636764160,"available":96380747776,"internally_reserved":0,"allocated":20791296,"data_stored":19046587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235207114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542711,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":228608,"kb_used_data":16944,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94143232,"statfs":{"total":96636764160,"available":96402669568,"internally_reserved":0,"allocated":17350656,"data_stored":15759617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":216725958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542712,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89728,"kb_used_data":14128,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94282112,"statfs":{"total":96636764160,"available":96544882688,"internally_reserved":0,"allocated":14467072,"data_stored":12799537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575415,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59444,"kb_used_data":14372,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94312396,"statfs":{"total":96636764160,"available":96575893504,"internally_reserved":0,"allocated":14716928,"data_stored":13117126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25833472,"data_stored":25645853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6983680,"data_stored":6928219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11079680,"data_stored":10970794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29499392,"data_stored":29284181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10829824,"data_stored":10653176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34000896,"data_stored":33800787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13717504,"data_stored":13613541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16510976,"data_stored":16309797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":4558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":6362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:22:26.019 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.019 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.020 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.020 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.020 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.020 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.020 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.020 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.020 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.020 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.021 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.021 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.021 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.021 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.021 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.021 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.021 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.021 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.021 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.021 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.022 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.022 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.022 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.022 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.022 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.022 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.022 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.022 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.022 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.023 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.023 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.023 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.023 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.023 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.023 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.023 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.023 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.023 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.023 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.024 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.024 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.024 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.024 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.024 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.024 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.024 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.024 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.025 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.025 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.025 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.025 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.025 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.025 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.025 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.025 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.025 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.026 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.026 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.026 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.026 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.026 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.026 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.026 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.026 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.026 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.026 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.027 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.027 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.027 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.027 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.027 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.027 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.027 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.027 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.027 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.028 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.028 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.028 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.028 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.028 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.028 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.028 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.028 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.028 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.029 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.029 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.029 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.029 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.029 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.029 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.029 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.029 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.029 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.029 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.030 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.030 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.030 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.030 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.030 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.030 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.030 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.030 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.030 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.031 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.031 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.031 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.031 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.031 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.031 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.031 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.031 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.031 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.031 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.032 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.032 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.032 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.032 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.032 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.032 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.032 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.032 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.032 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.033 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.033 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.033 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.033 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.033 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.033 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.033 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.034 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.034 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.034 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.034 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.034 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.034 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.034 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.034 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.035 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.035 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.035 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.035 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.035 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.035 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.035 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.035 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.035 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.036 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.036 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.036 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.036 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.036 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.036 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.036 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.036 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.037 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.037 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.037 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.037 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.037 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.037 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.037 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.037 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.038 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.038 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.038 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.038 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.038 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.038 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.038 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.038 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.039 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.039 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.039 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.039 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.039 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.039 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.040 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.040 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.040 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.040 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.040 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.040 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.040 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.041 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.041 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.041 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.041 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.041 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.041 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.041 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.041 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.042 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.042 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.042 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.042 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.042 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.042 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.042 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.042 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.043 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.043 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.043 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.043 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.043 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.043 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.043 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.043 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.043 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.044 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.044 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.044 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.044 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.044 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.044 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.044 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.044 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.045 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.045 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.045 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.045 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.045 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.045 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.045 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.045 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.045 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.046 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.046 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.046 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.046 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.046 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:35:46.907958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.046 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.046 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.046 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.047 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:35:48.914482+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.047 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:35:50.936466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.047 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.047 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.047 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T00:35:44.901221+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:26.047 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:22:46.048 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:22:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:22:46.432 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-12T01:22:46.440 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":1680,"stamp":"2024-09-12T01:22:45.172932+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75758925,"num_objects":722,"num_object_clones":0,"num_object_copies":1444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":722,"num_whiteouts":0,"num_read":179342,"num_read_kb":2456104,"num_write":142298,"num_write_kb":2416867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":733999,"num_omap_keys":1767,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13651,"ondisk_log_size":13651,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1402904,"kb_used_data":174808,"kb_used_omap":12,"kb_used_meta":1227955,"kb_avail":753571816,"statfs":{"total":773094113280,"available":771657539584,"internally_reserved":0,"allocated":179003392,"data_stored":165560350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1257426480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":119141,"num_omap_keys":302,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008839"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:43.558042+0000","last_change":"2024-09-12T01:03:40.585433+0000","last_active":"2024-09-12T01:18:43.558042+0000","last_peered":"2024-09-12T01:18:43.558042+0000","last_clean":"2024-09-12T01:18:43.558042+0000","last_became_active":"2024-09-12T01:03:40.584744+0000","last_became_peered":"2024-09-12T01:03:40.584744+0000","last_unstale":"2024-09-12T01:18:43.558042+0000","last_undegraded":"2024-09-12T01:18:43.558042+0000","last_fullsized":"2024-09-12T01:18:43.558042+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:08.339816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:13.578887+0000","last_change":"2024-09-12T00:52:40.345897+0000","last_active":"2024-09-12T01:20:13.578887+0000","last_peered":"2024-09-12T01:20:13.578887+0000","last_clean":"2024-09-12T01:20:13.578887+0000","last_became_active":"2024-09-12T00:52:40.345120+0000","last_became_peered":"2024-09-12T00:52:40.345120+0000","last_unstale":"2024-09-12T01:20:13.578887+0000","last_undegraded":"2024-09-12T01:20:13.578887+0000","last_fullsized":"2024-09-12T01:20:13.578887+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"265'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.747729+0000","last_change":"2024-09-12T00:52:37.282365+0000","last_active":"2024-09-12T01:21:56.747729+0000","last_peered":"2024-09-12T01:21:56.747729+0000","last_clean":"2024-09-12T01:21:56.747729+0000","last_became_active":"2024-09-12T00:52:37.276676+0000","last_became_peered":"2024-09-12T00:52:37.276676+0000","last_unstale":"2024-09-12T01:21:56.747729+0000","last_undegraded":"2024-09-12T01:21:56.747729+0000","last_fullsized":"2024-09-12T01:21:56.747729+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'38","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:18.589631+0000","last_change":"2024-09-12T00:51:04.999562+0000","last_active":"2024-09-12T01:20:18.589631+0000","last_peered":"2024-09-12T01:20:18.589631+0000","last_clean":"2024-09-12T01:20:18.589631+0000","last_became_active":"2024-09-12T00:51:04.998763+0000","last_became_peered":"2024-09-12T00:51:04.998763+0000","last_unstale":"2024-09-12T01:20:18.589631+0000","last_undegraded":"2024-09-12T01:20:18.589631+0000","last_fullsized":"2024-09-12T01:20:18.589631+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":142,"num_write":56,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:32.349358+0000","last_change":"2024-09-12T01:22:32.349358+0000","last_active":"2024-09-12T01:22:32.349358+0000","last_peered":"2024-09-12T01:22:32.349358+0000","last_clean":"2024-09-12T01:22:32.349358+0000","last_became_active":"2024-09-12T01:03:40.581266+0000","last_became_peered":"2024-09-12T01:03:40.581266+0000","last_unstale":"2024-09-12T01:22:32.349358+0000","last_undegraded":"2024-09-12T01:22:32.349358+0000","last_fullsized":"2024-09-12T01:22:32.349358+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:32.349170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:32.349170+0000","last_clean_scrub_stamp":"2024-09-12T01:22:32.349170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:03.847107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"265'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.776422+0000","last_change":"2024-09-12T00:52:40.345386+0000","last_active":"2024-09-12T01:21:57.776422+0000","last_peered":"2024-09-12T01:21:57.776422+0000","last_clean":"2024-09-12T01:21:57.776422+0000","last_became_active":"2024-09-12T00:52:40.344674+0000","last_became_peered":"2024-09-12T00:52:40.344674+0000","last_unstale":"2024-09-12T01:21:57.776422+0000","last_undegraded":"2024-09-12T01:21:57.776422+0000","last_fullsized":"2024-09-12T01:21:57.776422+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":10,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'6","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:38.213077+0000","last_change":"2024-09-12T01:22:38.212886+0000","last_active":"2024-09-12T01:22:38.213077+0000","last_peered":"2024-09-12T01:22:38.213077+0000","last_clean":"2024-09-12T01:22:38.213077+0000","last_became_active":"2024-09-12T00:52:37.294438+0000","last_became_peered":"2024-09-12T00:52:37.294438+0000","last_unstale":"2024-09-12T01:22:38.213077+0000","last_undegraded":"2024-09-12T01:22:38.213077+0000","last_fullsized":"2024-09-12T01:22:38.213077+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:22:38.212701+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:22:38.212701+0000","last_clean_scrub_stamp":"2024-09-12T01:22:38.212701+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:19.389441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'42","reported_seq":172,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:24.384364+0000","last_change":"2024-09-12T01:22:24.384364+0000","last_active":"2024-09-12T01:22:24.384364+0000","last_peered":"2024-09-12T01:22:24.384364+0000","last_clean":"2024-09-12T01:22:24.384364+0000","last_became_active":"2024-09-12T00:51:04.961677+0000","last_became_peered":"2024-09-12T00:51:04.961677+0000","last_unstale":"2024-09-12T01:22:24.384364+0000","last_undegraded":"2024-09-12T01:22:24.384364+0000","last_fullsized":"2024-09-12T01:22:24.384364+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'42","last_scrub_stamp":"2024-09-12T01:22:24.384181+0000","last_deep_scrub":"265'42","last_deep_scrub_stamp":"2024-09-12T01:22:24.384181+0000","last_clean_scrub_stamp":"2024-09-12T01:22:24.384181+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:21.287887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":168,"num_write":72,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:41.001116+0000","last_change":"2024-09-12T01:22:41.001116+0000","last_active":"2024-09-12T01:22:41.001116+0000","last_peered":"2024-09-12T01:22:41.001116+0000","last_clean":"2024-09-12T01:22:41.001116+0000","last_became_active":"2024-09-12T01:03:40.576550+0000","last_became_peered":"2024-09-12T01:03:40.576550+0000","last_unstale":"2024-09-12T01:22:41.001116+0000","last_undegraded":"2024-09-12T01:22:41.001116+0000","last_fullsized":"2024-09-12T01:22:41.001116+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:41.000931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:41.000931+0000","last_clean_scrub_stamp":"2024-09-12T01:22:41.000931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:53.971314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"265'5","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:53.609270+0000","last_change":"2024-09-12T00:52:40.341193+0000","last_active":"2024-09-12T01:21:53.609270+0000","last_peered":"2024-09-12T01:21:53.609270+0000","last_clean":"2024-09-12T01:21:53.609270+0000","last_became_active":"2024-09-12T00:52:40.337945+0000","last_became_peered":"2024-09-12T00:52:40.337945+0000","last_unstale":"2024-09-12T01:21:53.609270+0000","last_undegraded":"2024-09-12T01:21:53.609270+0000","last_fullsized":"2024-09-12T01:21:53.609270+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:20.078369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:28.465858+0000","last_change":"2024-09-12T01:22:28.465858+0000","last_active":"2024-09-12T01:22:28.465858+0000","last_peered":"2024-09-12T01:22:28.465858+0000","last_clean":"2024-09-12T01:22:28.465858+0000","last_became_active":"2024-09-12T00:52:37.296335+0000","last_became_peered":"2024-09-12T00:52:37.296335+0000","last_unstale":"2024-09-12T01:22:28.465858+0000","last_undegraded":"2024-09-12T01:22:28.465858+0000","last_fullsized":"2024-09-12T01:22:28.465858+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:28.465685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:28.465685+0000","last_clean_scrub_stamp":"2024-09-12T01:22:28.465685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:34.410427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'30","reported_seq":128,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.564783+0000","last_change":"2024-09-12T00:51:04.997842+0000","last_active":"2024-09-12T01:18:38.564783+0000","last_peered":"2024-09-12T01:18:38.564783+0000","last_clean":"2024-09-12T01:18:38.564783+0000","last_became_active":"2024-09-12T00:51:04.992519+0000","last_became_peered":"2024-09-12T00:51:04.992519+0000","last_unstale":"2024-09-12T01:18:38.564783+0000","last_undegraded":"2024-09-12T01:18:38.564783+0000","last_fullsized":"2024-09-12T01:18:38.564783+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:13.960445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":105,"num_write":58,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.579674+0000","last_change":"2024-09-12T01:03:40.587244+0000","last_active":"2024-09-12T01:18:18.579674+0000","last_peered":"2024-09-12T01:18:18.579674+0000","last_clean":"2024-09-12T01:18:18.579674+0000","last_became_active":"2024-09-12T01:03:40.586582+0000","last_became_peered":"2024-09-12T01:03:40.586582+0000","last_unstale":"2024-09-12T01:18:18.579674+0000","last_undegraded":"2024-09-12T01:18:18.579674+0000","last_fullsized":"2024-09-12T01:18:18.579674+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:46.195286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'5","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:57.135882+0000","last_change":"2024-09-12T00:53:18.616189+0000","last_active":"2024-09-12T01:21:57.135882+0000","last_peered":"2024-09-12T01:21:57.135882+0000","last_clean":"2024-09-12T01:21:57.135882+0000","last_became_active":"2024-09-12T00:53:18.615877+0000","last_became_peered":"2024-09-12T00:53:18.615877+0000","last_unstale":"2024-09-12T01:21:57.135882+0000","last_undegraded":"2024-09-12T01:21:57.135882+0000","last_fullsized":"2024-09-12T01:21:57.135882+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:35.115620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6184,"num_write":5,"num_write_kb":6184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:42.558460+0000","last_change":"2024-09-12T00:52:37.277359+0000","last_active":"2024-09-12T01:19:42.558460+0000","last_peered":"2024-09-12T01:19:42.558460+0000","last_clean":"2024-09-12T01:19:42.558460+0000","last_became_active":"2024-09-12T00:52:37.270357+0000","last_became_peered":"2024-09-12T00:52:37.270357+0000","last_unstale":"2024-09-12T01:19:42.558460+0000","last_undegraded":"2024-09-12T01:19:42.558460+0000","last_fullsized":"2024-09-12T01:19:42.558460+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:03.048579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'29","reported_seq":125,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.585016+0000","last_change":"2024-09-12T00:51:04.995220+0000","last_active":"2024-09-12T01:18:38.585016+0000","last_peered":"2024-09-12T01:18:38.585016+0000","last_clean":"2024-09-12T01:18:38.585016+0000","last_became_active":"2024-09-12T00:51:04.994459+0000","last_became_peered":"2024-09-12T00:51:04.994459+0000","last_unstale":"2024-09-12T01:18:38.585016+0000","last_undegraded":"2024-09-12T01:18:38.585016+0000","last_fullsized":"2024-09-12T01:18:38.585016+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:32.327605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":61,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.601539+0000","last_change":"2024-09-12T01:03:40.594312+0000","last_active":"2024-09-12T01:19:48.601539+0000","last_peered":"2024-09-12T01:19:48.601539+0000","last_clean":"2024-09-12T01:19:48.601539+0000","last_became_active":"2024-09-12T01:03:40.593614+0000","last_became_peered":"2024-09-12T01:03:40.593614+0000","last_unstale":"2024-09-12T01:19:48.601539+0000","last_undegraded":"2024-09-12T01:19:48.601539+0000","last_fullsized":"2024-09-12T01:19:48.601539+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:51.667787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"265'6","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:53.402527+0000","last_change":"2024-09-12T00:52:40.358057+0000","last_active":"2024-09-12T01:21:53.402527+0000","last_peered":"2024-09-12T01:21:53.402527+0000","last_clean":"2024-09-12T01:21:53.402527+0000","last_became_active":"2024-09-12T00:52:40.356507+0000","last_became_peered":"2024-09-12T00:52:40.356507+0000","last_unstale":"2024-09-12T01:21:53.402527+0000","last_undegraded":"2024-09-12T01:21:53.402527+0000","last_fullsized":"2024-09-12T01:21:53.402527+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:07.353171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":17408,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:13.572946+0000","last_change":"2024-09-12T00:52:37.293774+0000","last_active":"2024-09-12T01:19:13.572946+0000","last_peered":"2024-09-12T01:19:13.572946+0000","last_clean":"2024-09-12T01:19:13.572946+0000","last_became_active":"2024-09-12T00:52:37.293298+0000","last_became_peered":"2024-09-12T00:52:37.293298+0000","last_unstale":"2024-09-12T01:19:13.572946+0000","last_undegraded":"2024-09-12T01:19:13.572946+0000","last_fullsized":"2024-09-12T01:19:13.572946+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:24.891123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"262'30","reported_seq":137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.584909+0000","last_change":"2024-09-12T00:51:04.996662+0000","last_active":"2024-09-12T01:18:38.584909+0000","last_peered":"2024-09-12T01:18:38.584909+0000","last_clean":"2024-09-12T01:18:38.584909+0000","last_became_active":"2024-09-12T00:51:04.995863+0000","last_became_peered":"2024-09-12T00:51:04.995863+0000","last_unstale":"2024-09-12T01:18:38.584909+0000","last_undegraded":"2024-09-12T01:18:38.584909+0000","last_fullsized":"2024-09-12T01:18:38.584909+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:04.557157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":123,"num_write":48,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.592345+0000","last_change":"2024-09-12T01:03:40.576503+0000","last_active":"2024-09-12T01:20:23.592345+0000","last_peered":"2024-09-12T01:20:23.592345+0000","last_clean":"2024-09-12T01:20:23.592345+0000","last_became_active":"2024-09-12T01:03:40.575481+0000","last_became_peered":"2024-09-12T01:03:40.575481+0000","last_unstale":"2024-09-12T01:20:23.592345+0000","last_undegraded":"2024-09-12T01:20:23.592345+0000","last_fullsized":"2024-09-12T01:20:23.592345+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:39.046247+0000","last_change":"2024-09-12T01:22:39.046247+0000","last_active":"2024-09-12T01:22:39.046247+0000","last_peered":"2024-09-12T01:22:39.046247+0000","last_clean":"2024-09-12T01:22:39.046247+0000","last_became_active":"2024-09-12T00:52:40.349826+0000","last_became_peered":"2024-09-12T00:52:40.349826+0000","last_unstale":"2024-09-12T01:22:39.046247+0000","last_undegraded":"2024-09-12T01:22:39.046247+0000","last_fullsized":"2024-09-12T01:22:39.046247+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:39.046063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:39.046063+0000","last_clean_scrub_stamp":"2024-09-12T01:22:39.046063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:06.281154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"265'18","reported_seq":86,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.980038+0000","last_change":"2024-09-12T00:52:37.284934+0000","last_active":"2024-09-12T01:21:56.980038+0000","last_peered":"2024-09-12T01:21:56.980038+0000","last_clean":"2024-09-12T01:21:56.980038+0000","last_became_active":"2024-09-12T00:52:37.283600+0000","last_became_peered":"2024-09-12T00:52:37.283600+0000","last_unstale":"2024-09-12T01:21:56.980038+0000","last_undegraded":"2024-09-12T01:21:56.980038+0000","last_fullsized":"2024-09-12T01:21:56.980038+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:50.299864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":56328,"num_write":28,"num_write_kb":20484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"265'59","reported_seq":214,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:34.091688+0000","last_change":"2024-09-12T01:22:34.091688+0000","last_active":"2024-09-12T01:22:34.091688+0000","last_peered":"2024-09-12T01:22:34.091688+0000","last_clean":"2024-09-12T01:22:34.091688+0000","last_became_active":"2024-09-12T00:51:04.982228+0000","last_became_peered":"2024-09-12T00:51:04.982228+0000","last_unstale":"2024-09-12T01:22:34.091688+0000","last_undegraded":"2024-09-12T01:22:34.091688+0000","last_fullsized":"2024-09-12T01:22:34.091688+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'59","last_scrub_stamp":"2024-09-12T01:22:34.091468+0000","last_deep_scrub":"265'59","last_deep_scrub_stamp":"2024-09-12T01:22:34.091468+0000","last_clean_scrub_stamp":"2024-09-12T01:22:34.091468+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:07.136953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":210,"num_write":106,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.785889+0000","last_change":"2024-09-12T01:03:40.569067+0000","last_active":"2024-09-12T01:18:42.785889+0000","last_peered":"2024-09-12T01:18:42.785889+0000","last_clean":"2024-09-12T01:18:42.785889+0000","last_became_active":"2024-09-12T01:03:40.568346+0000","last_became_peered":"2024-09-12T01:03:40.568346+0000","last_unstale":"2024-09-12T01:18:42.785889+0000","last_undegraded":"2024-09-12T01:18:42.785889+0000","last_fullsized":"2024-09-12T01:18:42.785889+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:12.448021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"265'3","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:42.018175+0000","last_change":"2024-09-12T01:22:42.017990+0000","last_active":"2024-09-12T01:22:42.018175+0000","last_peered":"2024-09-12T01:22:42.018175+0000","last_clean":"2024-09-12T01:22:42.018175+0000","last_became_active":"2024-09-12T00:52:40.339627+0000","last_became_peered":"2024-09-12T00:52:40.339627+0000","last_unstale":"2024-09-12T01:22:42.018175+0000","last_undegraded":"2024-09-12T01:22:42.018175+0000","last_fullsized":"2024-09-12T01:22:42.018175+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:22:42.017810+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:22:42.017810+0000","last_clean_scrub_stamp":"2024-09-12T01:22:42.017810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:57.124541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"262'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:07.563775+0000","last_change":"2024-09-12T00:52:37.283996+0000","last_active":"2024-09-12T01:20:07.563775+0000","last_peered":"2024-09-12T01:20:07.563775+0000","last_clean":"2024-09-12T01:20:07.563775+0000","last_became_active":"2024-09-12T00:52:37.283199+0000","last_became_peered":"2024-09-12T00:52:37.283199+0000","last_unstale":"2024-09-12T01:20:07.563775+0000","last_undegraded":"2024-09-12T01:20:07.563775+0000","last_fullsized":"2024-09-12T01:20:07.563775+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"265'5","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:13.588329+0000","last_change":"2024-09-12T00:51:04.988358+0000","last_active":"2024-09-12T01:20:13.588329+0000","last_peered":"2024-09-12T01:20:13.588329+0000","last_clean":"2024-09-12T01:20:13.588329+0000","last_became_active":"2024-09-12T00:51:04.981675+0000","last_became_peered":"2024-09-12T00:51:04.981675+0000","last_unstale":"2024-09-12T01:20:13.588329+0000","last_undegraded":"2024-09-12T01:20:13.588329+0000","last_fullsized":"2024-09-12T01:20:13.588329+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.785967+0000","last_change":"2024-09-12T01:03:40.577284+0000","last_active":"2024-09-12T01:18:42.785967+0000","last_peered":"2024-09-12T01:18:42.785967+0000","last_clean":"2024-09-12T01:18:42.785967+0000","last_became_active":"2024-09-12T01:03:40.576430+0000","last_became_peered":"2024-09-12T01:03:40.576430+0000","last_unstale":"2024-09-12T01:18:42.785967+0000","last_undegraded":"2024-09-12T01:18:42.785967+0000","last_fullsized":"2024-09-12T01:18:42.785967+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:37.105480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.747389+0000","last_change":"2024-09-12T00:52:40.346703+0000","last_active":"2024-09-12T01:21:56.747389+0000","last_peered":"2024-09-12T01:21:56.747389+0000","last_clean":"2024-09-12T01:21:56.747389+0000","last_became_active":"2024-09-12T00:52:40.345995+0000","last_became_peered":"2024-09-12T00:52:40.345995+0000","last_unstale":"2024-09-12T01:21:56.747389+0000","last_undegraded":"2024-09-12T01:21:56.747389+0000","last_fullsized":"2024-09-12T01:21:56.747389+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'2","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.907766+0000","last_change":"2024-09-12T00:52:37.300110+0000","last_active":"2024-09-12T01:21:56.907766+0000","last_peered":"2024-09-12T01:21:56.907766+0000","last_clean":"2024-09-12T01:21:56.907766+0000","last_became_active":"2024-09-12T00:52:37.299604+0000","last_became_peered":"2024-09-12T00:52:37.299604+0000","last_unstale":"2024-09-12T01:21:56.907766+0000","last_undegraded":"2024-09-12T01:21:56.907766+0000","last_fullsized":"2024-09-12T01:21:56.907766+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'41","reported_seq":166,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:31.285014+0000","last_change":"2024-09-12T01:22:31.284832+0000","last_active":"2024-09-12T01:22:31.285014+0000","last_peered":"2024-09-12T01:22:31.285014+0000","last_clean":"2024-09-12T01:22:31.285014+0000","last_became_active":"2024-09-12T00:51:04.968673+0000","last_became_peered":"2024-09-12T00:51:04.968673+0000","last_unstale":"2024-09-12T01:22:31.285014+0000","last_undegraded":"2024-09-12T01:22:31.285014+0000","last_fullsized":"2024-09-12T01:22:31.285014+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'41","last_scrub_stamp":"2024-09-12T01:22:31.284652+0000","last_deep_scrub":"265'41","last_deep_scrub_stamp":"2024-09-12T01:22:31.284652+0000","last_clean_scrub_stamp":"2024-09-12T01:22:31.284652+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:29.195882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":145,"num_write":79,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:03.588190+0000","last_change":"2024-09-12T01:03:40.591077+0000","last_active":"2024-09-12T01:20:03.588190+0000","last_peered":"2024-09-12T01:20:03.588190+0000","last_clean":"2024-09-12T01:20:03.588190+0000","last_became_active":"2024-09-12T01:03:40.590440+0000","last_became_peered":"2024-09-12T01:03:40.590440+0000","last_unstale":"2024-09-12T01:20:03.588190+0000","last_undegraded":"2024-09-12T01:20:03.588190+0000","last_fullsized":"2024-09-12T01:20:03.588190+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.594467+0000","last_change":"2024-09-12T00:52:40.363386+0000","last_active":"2024-09-12T01:19:18.594467+0000","last_peered":"2024-09-12T01:19:18.594467+0000","last_clean":"2024-09-12T01:19:18.594467+0000","last_became_active":"2024-09-12T00:52:40.359069+0000","last_became_peered":"2024-09-12T00:52:40.359069+0000","last_unstale":"2024-09-12T01:19:18.594467+0000","last_undegraded":"2024-09-12T01:19:18.594467+0000","last_fullsized":"2024-09-12T01:19:18.594467+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:47.963386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"262'5","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:23.553521+0000","last_change":"2024-09-12T00:52:37.274416+0000","last_active":"2024-09-12T01:18:23.553521+0000","last_peered":"2024-09-12T01:18:23.553521+0000","last_clean":"2024-09-12T01:18:23.553521+0000","last_became_active":"2024-09-12T00:52:37.273684+0000","last_became_peered":"2024-09-12T00:52:37.273684+0000","last_unstale":"2024-09-12T01:18:23.553521+0000","last_undegraded":"2024-09-12T01:18:23.553521+0000","last_fullsized":"2024-09-12T01:18:23.553521+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:25.538379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":25602,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'50","reported_seq":183,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:08.587418+0000","last_change":"2024-09-12T00:51:04.999190+0000","last_active":"2024-09-12T01:20:08.587418+0000","last_peered":"2024-09-12T01:20:08.587418+0000","last_clean":"2024-09-12T01:20:08.587418+0000","last_became_active":"2024-09-12T00:51:04.993887+0000","last_became_peered":"2024-09-12T00:51:04.993887+0000","last_unstale":"2024-09-12T01:20:08.587418+0000","last_undegraded":"2024-09-12T01:20:08.587418+0000","last_fullsized":"2024-09-12T01:20:08.587418+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":256,"num_read_kb":177,"num_write":91,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'2","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:30.402778+0000","last_change":"2024-09-12T01:22:30.402778+0000","last_active":"2024-09-12T01:22:30.402778+0000","last_peered":"2024-09-12T01:22:30.402778+0000","last_clean":"2024-09-12T01:22:30.402778+0000","last_became_active":"2024-09-12T01:03:40.580348+0000","last_became_peered":"2024-09-12T01:03:40.580348+0000","last_unstale":"2024-09-12T01:22:30.402778+0000","last_undegraded":"2024-09-12T01:22:30.402778+0000","last_fullsized":"2024-09-12T01:22:30.402778+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:30.402577+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:30.402577+0000","last_clean_scrub_stamp":"2024-09-12T01:22:30.402577+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:53.076131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"262'8","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:28.582340+0000","last_change":"2024-09-12T00:52:40.366179+0000","last_active":"2024-09-12T01:18:28.582340+0000","last_peered":"2024-09-12T01:18:28.582340+0000","last_clean":"2024-09-12T01:18:28.582340+0000","last_became_active":"2024-09-12T00:52:40.363347+0000","last_became_peered":"2024-09-12T00:52:40.363347+0000","last_unstale":"2024-09-12T01:18:28.582340+0000","last_undegraded":"2024-09-12T01:18:28.582340+0000","last_fullsized":"2024-09-12T01:18:28.582340+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:06.883385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":21506,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:12.793072+0000","last_change":"2024-09-12T00:52:37.288899+0000","last_active":"2024-09-12T01:19:12.793072+0000","last_peered":"2024-09-12T01:19:12.793072+0000","last_clean":"2024-09-12T01:19:12.793072+0000","last_became_active":"2024-09-12T00:52:37.288074+0000","last_became_peered":"2024-09-12T00:52:37.288074+0000","last_unstale":"2024-09-12T01:19:12.793072+0000","last_undegraded":"2024-09-12T01:19:12.793072+0000","last_fullsized":"2024-09-12T01:19:12.793072+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:03.061143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'39","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:08.606490+0000","last_change":"2024-09-12T00:51:04.982973+0000","last_active":"2024-09-12T01:20:08.606490+0000","last_peered":"2024-09-12T01:20:08.606490+0000","last_clean":"2024-09-12T01:20:08.606490+0000","last_became_active":"2024-09-12T00:51:04.976345+0000","last_became_peered":"2024-09-12T00:51:04.976345+0000","last_unstale":"2024-09-12T01:20:08.606490+0000","last_undegraded":"2024-09-12T01:20:08.606490+0000","last_fullsized":"2024-09-12T01:20:08.606490+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":155,"num_write":57,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:02.804336+0000","last_change":"2024-09-12T01:03:40.561539+0000","last_active":"2024-09-12T01:20:02.804336+0000","last_peered":"2024-09-12T01:20:02.804336+0000","last_clean":"2024-09-12T01:20:02.804336+0000","last_became_active":"2024-09-12T01:03:40.560777+0000","last_became_peered":"2024-09-12T01:03:40.560777+0000","last_unstale":"2024-09-12T01:20:02.804336+0000","last_undegraded":"2024-09-12T01:20:02.804336+0000","last_fullsized":"2024-09-12T01:20:02.804336+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"265'3","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:43.411382+0000","last_change":"2024-09-12T00:52:40.353226+0000","last_active":"2024-09-12T01:21:43.411382+0000","last_peered":"2024-09-12T01:21:43.411382+0000","last_clean":"2024-09-12T01:21:43.411382+0000","last_became_active":"2024-09-12T00:52:40.352292+0000","last_became_peered":"2024-09-12T00:52:40.352292+0000","last_unstale":"2024-09-12T01:21:43.411382+0000","last_undegraded":"2024-09-12T01:21:43.411382+0000","last_fullsized":"2024-09-12T01:21:43.411382+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:37.809308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:27.491057+0000","last_change":"2024-09-12T01:22:27.491057+0000","last_active":"2024-09-12T01:22:27.491057+0000","last_peered":"2024-09-12T01:22:27.491057+0000","last_clean":"2024-09-12T01:22:27.491057+0000","last_became_active":"2024-09-12T00:52:37.284325+0000","last_became_peered":"2024-09-12T00:52:37.284325+0000","last_unstale":"2024-09-12T01:22:27.491057+0000","last_undegraded":"2024-09-12T01:22:27.491057+0000","last_fullsized":"2024-09-12T01:22:27.491057+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:27.490874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:27.490874+0000","last_clean_scrub_stamp":"2024-09-12T01:22:27.490874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:46.906871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'20","reported_seq":110,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.383623+0000","last_change":"2024-09-12T01:22:17.383347+0000","last_active":"2024-09-12T01:22:17.383623+0000","last_peered":"2024-09-12T01:22:17.383623+0000","last_clean":"2024-09-12T01:22:17.383623+0000","last_became_active":"2024-09-12T00:51:04.961563+0000","last_became_peered":"2024-09-12T00:51:04.961563+0000","last_unstale":"2024-09-12T01:22:17.383623+0000","last_undegraded":"2024-09-12T01:22:17.383623+0000","last_fullsized":"2024-09-12T01:22:17.383623+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'20","last_scrub_stamp":"2024-09-12T01:22:17.383043+0000","last_deep_scrub":"265'20","last_deep_scrub_stamp":"2024-09-12T01:22:17.383043+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.383043+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:52.621490+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":68,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:03.576415+0000","last_change":"2024-09-12T01:03:40.580752+0000","last_active":"2024-09-12T01:20:03.576415+0000","last_peered":"2024-09-12T01:20:03.576415+0000","last_clean":"2024-09-12T01:20:03.576415+0000","last_became_active":"2024-09-12T01:03:40.580083+0000","last_became_peered":"2024-09-12T01:03:40.580083+0000","last_unstale":"2024-09-12T01:20:03.576415+0000","last_undegraded":"2024-09-12T01:20:03.576415+0000","last_fullsized":"2024-09-12T01:20:03.576415+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'5","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:42.585420+0000","last_change":"2024-09-12T00:52:40.344308+0000","last_active":"2024-09-12T01:21:42.585420+0000","last_peered":"2024-09-12T01:21:42.585420+0000","last_clean":"2024-09-12T01:21:42.585420+0000","last_became_active":"2024-09-12T00:52:40.336368+0000","last_became_peered":"2024-09-12T00:52:40.336368+0000","last_unstale":"2024-09-12T01:21:42.585420+0000","last_undegraded":"2024-09-12T01:21:42.585420+0000","last_fullsized":"2024-09-12T01:21:42.585420+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:44.066859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:13.573252+0000","last_change":"2024-09-12T00:52:37.299654+0000","last_active":"2024-09-12T01:19:13.573252+0000","last_peered":"2024-09-12T01:19:13.573252+0000","last_clean":"2024-09-12T01:19:13.573252+0000","last_became_active":"2024-09-12T00:52:37.295945+0000","last_became_peered":"2024-09-12T00:52:37.295945+0000","last_unstale":"2024-09-12T01:19:13.573252+0000","last_undegraded":"2024-09-12T01:19:13.573252+0000","last_fullsized":"2024-09-12T01:19:13.573252+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:17.464675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"265'27","reported_seq":132,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:41.493365+0000","last_change":"2024-09-12T01:22:41.493365+0000","last_active":"2024-09-12T01:22:41.493365+0000","last_peered":"2024-09-12T01:22:41.493365+0000","last_clean":"2024-09-12T01:22:41.493365+0000","last_became_active":"2024-09-12T00:51:04.975831+0000","last_became_peered":"2024-09-12T00:51:04.975831+0000","last_unstale":"2024-09-12T01:22:41.493365+0000","last_undegraded":"2024-09-12T01:22:41.493365+0000","last_fullsized":"2024-09-12T01:22:41.493365+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'27","last_scrub_stamp":"2024-09-12T01:22:41.493085+0000","last_deep_scrub":"265'27","last_deep_scrub_stamp":"2024-09-12T01:22:41.493085+0000","last_clean_scrub_stamp":"2024-09-12T01:22:41.493085+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:56.711739+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":101,"num_write":53,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.578542+0000","last_change":"2024-09-12T01:03:40.580652+0000","last_active":"2024-09-12T01:18:13.578542+0000","last_peered":"2024-09-12T01:18:13.578542+0000","last_clean":"2024-09-12T01:18:13.578542+0000","last_became_active":"2024-09-12T01:03:40.579923+0000","last_became_peered":"2024-09-12T01:03:40.579923+0000","last_unstale":"2024-09-12T01:18:13.578542+0000","last_undegraded":"2024-09-12T01:18:13.578542+0000","last_fullsized":"2024-09-12T01:18:13.578542+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:55.542873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:43.207483+0000","last_change":"2024-09-12T01:22:43.207483+0000","last_active":"2024-09-12T01:22:43.207483+0000","last_peered":"2024-09-12T01:22:43.207483+0000","last_clean":"2024-09-12T01:22:43.207483+0000","last_became_active":"2024-09-12T00:52:40.349363+0000","last_became_peered":"2024-09-12T00:52:40.349363+0000","last_unstale":"2024-09-12T01:22:43.207483+0000","last_undegraded":"2024-09-12T01:22:43.207483+0000","last_fullsized":"2024-09-12T01:22:43.207483+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:43.207311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:43.207311+0000","last_clean_scrub_stamp":"2024-09-12T01:22:43.207311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:47.937508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:17.739114+0000","last_change":"2024-09-12T00:52:37.278835+0000","last_active":"2024-09-12T01:18:17.739114+0000","last_peered":"2024-09-12T01:18:17.739114+0000","last_clean":"2024-09-12T01:18:17.739114+0000","last_became_active":"2024-09-12T00:52:37.270958+0000","last_became_peered":"2024-09-12T00:52:37.270958+0000","last_unstale":"2024-09-12T01:18:17.739114+0000","last_undegraded":"2024-09-12T01:18:17.739114+0000","last_fullsized":"2024-09-12T01:18:17.739114+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:49.398281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'19","reported_seq":104,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:40.470884+0000","last_change":"2024-09-12T01:22:40.470884+0000","last_active":"2024-09-12T01:22:40.470884+0000","last_peered":"2024-09-12T01:22:40.470884+0000","last_clean":"2024-09-12T01:22:40.470884+0000","last_became_active":"2024-09-12T00:51:04.975763+0000","last_became_peered":"2024-09-12T00:51:04.975763+0000","last_unstale":"2024-09-12T01:22:40.470884+0000","last_undegraded":"2024-09-12T01:22:40.470884+0000","last_fullsized":"2024-09-12T01:22:40.470884+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'19","last_scrub_stamp":"2024-09-12T01:22:40.470688+0000","last_deep_scrub":"265'19","last_deep_scrub_stamp":"2024-09-12T01:22:40.470688+0000","last_clean_scrub_stamp":"2024-09-12T01:22:40.470688+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:44.316701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.558357+0000","last_change":"2024-09-12T01:03:40.586341+0000","last_active":"2024-09-12T01:18:13.558357+0000","last_peered":"2024-09-12T01:18:13.558357+0000","last_clean":"2024-09-12T01:18:13.558357+0000","last_became_active":"2024-09-12T01:03:40.581062+0000","last_became_peered":"2024-09-12T01:03:40.581062+0000","last_unstale":"2024-09-12T01:18:13.558357+0000","last_undegraded":"2024-09-12T01:18:13.558357+0000","last_fullsized":"2024-09-12T01:18:13.558357+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:40.147480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'10","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:42.231395+0000","last_change":"2024-09-12T01:22:42.231395+0000","last_active":"2024-09-12T01:22:42.231395+0000","last_peered":"2024-09-12T01:22:42.231395+0000","last_clean":"2024-09-12T01:22:42.231395+0000","last_became_active":"2024-09-12T00:52:40.343871+0000","last_became_peered":"2024-09-12T00:52:40.343871+0000","last_unstale":"2024-09-12T01:22:42.231395+0000","last_undegraded":"2024-09-12T01:22:42.231395+0000","last_fullsized":"2024-09-12T01:22:42.231395+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-12T01:22:42.231221+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-12T01:22:42.231221+0000","last_clean_scrub_stamp":"2024-09-12T01:22:42.231221+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:49.732150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":22610,"num_write":15,"num_write_kb":6184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.579601+0000","last_change":"2024-09-12T00:52:37.281395+0000","last_active":"2024-09-12T01:18:18.579601+0000","last_peered":"2024-09-12T01:18:18.579601+0000","last_clean":"2024-09-12T01:18:18.579601+0000","last_became_active":"2024-09-12T00:52:37.276237+0000","last_became_peered":"2024-09-12T00:52:37.276237+0000","last_unstale":"2024-09-12T01:18:18.579601+0000","last_undegraded":"2024-09-12T01:18:18.579601+0000","last_fullsized":"2024-09-12T01:18:18.579601+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:50.583225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'15","reported_seq":87,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.571778+0000","last_change":"2024-09-12T00:51:04.995560+0000","last_active":"2024-09-12T01:19:08.571778+0000","last_peered":"2024-09-12T01:19:08.571778+0000","last_clean":"2024-09-12T01:19:08.571778+0000","last_became_active":"2024-09-12T00:51:04.994606+0000","last_became_peered":"2024-09-12T00:51:04.994606+0000","last_unstale":"2024-09-12T01:19:08.571778+0000","last_undegraded":"2024-09-12T01:19:08.571778+0000","last_fullsized":"2024-09-12T01:19:08.571778+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:54.892667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:08.587274+0000","last_change":"2024-09-12T01:03:40.582311+0000","last_active":"2024-09-12T01:20:08.587274+0000","last_peered":"2024-09-12T01:20:08.587274+0000","last_clean":"2024-09-12T01:20:08.587274+0000","last_became_active":"2024-09-12T01:03:40.581586+0000","last_became_peered":"2024-09-12T01:03:40.581586+0000","last_unstale":"2024-09-12T01:20:08.587274+0000","last_undegraded":"2024-09-12T01:20:08.587274+0000","last_fullsized":"2024-09-12T01:20:08.587274+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'7","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:43.398671+0000","last_change":"2024-09-12T00:52:40.366365+0000","last_active":"2024-09-12T01:20:43.398671+0000","last_peered":"2024-09-12T01:20:43.398671+0000","last_clean":"2024-09-12T01:20:43.398671+0000","last_became_active":"2024-09-12T00:52:40.363072+0000","last_became_peered":"2024-09-12T00:52:40.363072+0000","last_unstale":"2024-09-12T01:20:43.398671+0000","last_undegraded":"2024-09-12T01:20:43.398671+0000","last_fullsized":"2024-09-12T01:20:43.398671+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:34.771598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9232,"num_write":7,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:36.977341+0000","last_change":"2024-09-12T01:22:36.977341+0000","last_active":"2024-09-12T01:22:36.977341+0000","last_peered":"2024-09-12T01:22:36.977341+0000","last_clean":"2024-09-12T01:22:36.977341+0000","last_became_active":"2024-09-12T00:52:37.291045+0000","last_became_peered":"2024-09-12T00:52:37.291045+0000","last_unstale":"2024-09-12T01:22:36.977341+0000","last_undegraded":"2024-09-12T01:22:36.977341+0000","last_fullsized":"2024-09-12T01:22:36.977341+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:36.977080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:36.977080+0000","last_clean_scrub_stamp":"2024-09-12T01:22:36.977080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:27.874464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'47","reported_seq":178,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:07.750363+0000","last_change":"2024-09-12T00:51:04.981572+0000","last_active":"2024-09-12T01:19:07.750363+0000","last_peered":"2024-09-12T01:19:07.750363+0000","last_clean":"2024-09-12T01:19:07.750363+0000","last_became_active":"2024-09-12T00:51:04.980601+0000","last_became_peered":"2024-09-12T00:51:04.980601+0000","last_unstale":"2024-09-12T01:19:07.750363+0000","last_undegraded":"2024-09-12T01:19:07.750363+0000","last_fullsized":"2024-09-12T01:19:07.750363+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:04.644563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":177,"num_write":81,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.578495+0000","last_change":"2024-09-12T01:03:40.580511+0000","last_active":"2024-09-12T01:18:13.578495+0000","last_peered":"2024-09-12T01:18:13.578495+0000","last_clean":"2024-09-12T01:18:13.578495+0000","last_became_active":"2024-09-12T01:03:40.579772+0000","last_became_peered":"2024-09-12T01:03:40.579772+0000","last_unstale":"2024-09-12T01:18:13.578495+0000","last_undegraded":"2024-09-12T01:18:13.578495+0000","last_fullsized":"2024-09-12T01:18:13.578495+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:33.962377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'3","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:38.026163+0000","last_change":"2024-09-12T01:22:38.026163+0000","last_active":"2024-09-12T01:22:38.026163+0000","last_peered":"2024-09-12T01:22:38.026163+0000","last_clean":"2024-09-12T01:22:38.026163+0000","last_became_active":"2024-09-12T00:52:40.347156+0000","last_became_peered":"2024-09-12T00:52:40.347156+0000","last_unstale":"2024-09-12T01:22:38.026163+0000","last_undegraded":"2024-09-12T01:22:38.026163+0000","last_fullsized":"2024-09-12T01:22:38.026163+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:22:38.025979+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:22:38.025979+0000","last_clean_scrub_stamp":"2024-09-12T01:22:38.025979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:31.526630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.552252+0000","last_change":"2024-09-12T00:52:37.291590+0000","last_active":"2024-09-12T01:18:18.552252+0000","last_peered":"2024-09-12T01:18:18.552252+0000","last_clean":"2024-09-12T01:18:18.552252+0000","last_became_active":"2024-09-12T00:52:37.290858+0000","last_became_peered":"2024-09-12T00:52:37.290858+0000","last_unstale":"2024-09-12T01:18:18.552252+0000","last_undegraded":"2024-09-12T01:18:18.552252+0000","last_fullsized":"2024-09-12T01:18:18.552252+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:11.150903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'11","reported_seq":79,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:08.591802+0000","last_change":"2024-09-12T00:51:04.989507+0000","last_active":"2024-09-12T01:19:08.591802+0000","last_peered":"2024-09-12T01:19:08.591802+0000","last_clean":"2024-09-12T01:19:08.591802+0000","last_became_active":"2024-09-12T00:51:04.988521+0000","last_became_peered":"2024-09-12T00:51:04.988521+0000","last_unstale":"2024-09-12T01:19:08.591802+0000","last_undegraded":"2024-09-12T01:19:08.591802+0000","last_fullsized":"2024-09-12T01:19:08.591802+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:52.795091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:29.444544+0000","last_change":"2024-09-12T01:22:29.444544+0000","last_active":"2024-09-12T01:22:29.444544+0000","last_peered":"2024-09-12T01:22:29.444544+0000","last_clean":"2024-09-12T01:22:29.444544+0000","last_became_active":"2024-09-12T01:03:40.591869+0000","last_became_peered":"2024-09-12T01:03:40.591869+0000","last_unstale":"2024-09-12T01:22:29.444544+0000","last_undegraded":"2024-09-12T01:22:29.444544+0000","last_fullsized":"2024-09-12T01:22:29.444544+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:29.444338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:29.444338+0000","last_clean_scrub_stamp":"2024-09-12T01:22:29.444338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:18.046980+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.600454+0000","last_change":"2024-09-12T00:52:40.345399+0000","last_active":"2024-09-12T01:19:43.600454+0000","last_peered":"2024-09-12T01:19:43.600454+0000","last_clean":"2024-09-12T01:19:43.600454+0000","last_became_active":"2024-09-12T00:52:40.344566+0000","last_became_peered":"2024-09-12T00:52:40.344566+0000","last_unstale":"2024-09-12T01:19:43.600454+0000","last_undegraded":"2024-09-12T01:19:43.600454+0000","last_fullsized":"2024-09-12T01:19:43.600454+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:08.365603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.799024+0000","last_change":"2024-09-12T00:52:37.289694+0000","last_active":"2024-09-12T01:19:37.799024+0000","last_peered":"2024-09-12T01:19:37.799024+0000","last_clean":"2024-09-12T01:19:37.799024+0000","last_became_active":"2024-09-12T00:52:37.282987+0000","last_became_peered":"2024-09-12T00:52:37.282987+0000","last_unstale":"2024-09-12T01:19:37.799024+0000","last_undegraded":"2024-09-12T01:19:37.799024+0000","last_fullsized":"2024-09-12T01:19:37.799024+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:53.081978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'40","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:13.578586+0000","last_change":"2024-09-12T00:51:05.001750+0000","last_active":"2024-09-12T01:18:13.578586+0000","last_peered":"2024-09-12T01:18:13.578586+0000","last_clean":"2024-09-12T01:18:13.578586+0000","last_became_active":"2024-09-12T00:51:05.001162+0000","last_became_peered":"2024-09-12T00:51:05.001162+0000","last_unstale":"2024-09-12T01:18:13.578586+0000","last_undegraded":"2024-09-12T01:18:13.578586+0000","last_fullsized":"2024-09-12T01:18:13.578586+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:51.741336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":142,"num_write":73,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:27.796530+0000","last_change":"2024-09-12T01:03:40.558405+0000","last_active":"2024-09-12T01:19:27.796530+0000","last_peered":"2024-09-12T01:19:27.796530+0000","last_clean":"2024-09-12T01:19:27.796530+0000","last_became_active":"2024-09-12T01:03:40.551803+0000","last_became_peered":"2024-09-12T01:03:40.551803+0000","last_unstale":"2024-09-12T01:19:27.796530+0000","last_undegraded":"2024-09-12T01:19:27.796530+0000","last_fullsized":"2024-09-12T01:19:27.796530+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:06.456829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.600404+0000","last_change":"2024-09-12T00:52:40.358765+0000","last_active":"2024-09-12T01:19:43.600404+0000","last_peered":"2024-09-12T01:19:43.600404+0000","last_clean":"2024-09-12T01:19:43.600404+0000","last_became_active":"2024-09-12T00:52:40.354387+0000","last_became_peered":"2024-09-12T00:52:40.354387+0000","last_unstale":"2024-09-12T01:19:43.600404+0000","last_undegraded":"2024-09-12T01:19:43.600404+0000","last_fullsized":"2024-09-12T01:19:43.600404+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:13.780637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:26.445283+0000","last_change":"2024-09-12T01:22:26.445283+0000","last_active":"2024-09-12T01:22:26.445283+0000","last_peered":"2024-09-12T01:22:26.445283+0000","last_clean":"2024-09-12T01:22:26.445283+0000","last_became_active":"2024-09-12T00:52:37.285154+0000","last_became_peered":"2024-09-12T00:52:37.285154+0000","last_unstale":"2024-09-12T01:22:26.445283+0000","last_undegraded":"2024-09-12T01:22:26.445283+0000","last_fullsized":"2024-09-12T01:22:26.445283+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:26.445055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:26.445055+0000","last_clean_scrub_stamp":"2024-09-12T01:22:26.445055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:23.861328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'61","reported_seq":221,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:41.550167+0000","last_change":"2024-09-12T01:22:41.550167+0000","last_active":"2024-09-12T01:22:41.550167+0000","last_peered":"2024-09-12T01:22:41.550167+0000","last_clean":"2024-09-12T01:22:41.550167+0000","last_became_active":"2024-09-12T00:51:04.975583+0000","last_became_peered":"2024-09-12T00:51:04.975583+0000","last_unstale":"2024-09-12T01:22:41.550167+0000","last_undegraded":"2024-09-12T01:22:41.550167+0000","last_fullsized":"2024-09-12T01:22:41.550167+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'61","last_scrub_stamp":"2024-09-12T01:22:41.549939+0000","last_deep_scrub":"265'61","last_deep_scrub_stamp":"2024-09-12T01:22:41.549939+0000","last_clean_scrub_stamp":"2024-09-12T01:22:41.549939+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:37.092779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":309,"num_read_kb":216,"num_write":105,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:40.030260+0000","last_change":"2024-09-12T01:22:40.030260+0000","last_active":"2024-09-12T01:22:40.030260+0000","last_peered":"2024-09-12T01:22:40.030260+0000","last_clean":"2024-09-12T01:22:40.030260+0000","last_became_active":"2024-09-12T01:03:40.569907+0000","last_became_peered":"2024-09-12T01:03:40.569907+0000","last_unstale":"2024-09-12T01:22:40.030260+0000","last_undegraded":"2024-09-12T01:22:40.030260+0000","last_fullsized":"2024-09-12T01:22:40.030260+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:40.030080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:40.030080+0000","last_clean_scrub_stamp":"2024-09-12T01:22:40.030080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:02.085149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:41.205229+0000","last_change":"2024-09-12T01:22:41.205229+0000","last_active":"2024-09-12T01:22:41.205229+0000","last_peered":"2024-09-12T01:22:41.205229+0000","last_clean":"2024-09-12T01:22:41.205229+0000","last_became_active":"2024-09-12T00:52:40.342703+0000","last_became_peered":"2024-09-12T00:52:40.342703+0000","last_unstale":"2024-09-12T01:22:41.205229+0000","last_undegraded":"2024-09-12T01:22:41.205229+0000","last_fullsized":"2024-09-12T01:22:41.205229+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:41.205045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:41.205045+0000","last_clean_scrub_stamp":"2024-09-12T01:22:41.205045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:57.444570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"265'6","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:53.609196+0000","last_change":"2024-09-12T00:52:37.292687+0000","last_active":"2024-09-12T01:21:53.609196+0000","last_peered":"2024-09-12T01:21:53.609196+0000","last_clean":"2024-09-12T01:21:53.609196+0000","last_became_active":"2024-09-12T00:52:37.292449+0000","last_became_peered":"2024-09-12T00:52:37.292449+0000","last_unstale":"2024-09-12T01:21:53.609196+0000","last_undegraded":"2024-09-12T01:21:53.609196+0000","last_fullsized":"2024-09-12T01:21:53.609196+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:54.986888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'117","reported_seq":413,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:33.077945+0000","last_change":"2024-09-12T01:22:33.077685+0000","last_active":"2024-09-12T01:22:33.077945+0000","last_peered":"2024-09-12T01:22:33.077945+0000","last_clean":"2024-09-12T01:22:33.077945+0000","last_became_active":"2024-09-12T00:51:04.984495+0000","last_became_peered":"2024-09-12T00:51:04.984495+0000","last_unstale":"2024-09-12T01:22:33.077945+0000","last_undegraded":"2024-09-12T01:22:33.077945+0000","last_fullsized":"2024-09-12T01:22:33.077945+0000","mapping_epoch":252,"log_start":"265'100","ondisk_log_start":"265'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'117","last_scrub_stamp":"2024-09-12T01:22:33.077397+0000","last_deep_scrub":"265'117","last_deep_scrub_stamp":"2024-09-12T01:22:33.077397+0000","last_clean_scrub_stamp":"2024-09-12T01:22:33.077397+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:07.359308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":690,"num_read_kb":506,"num_write":167,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3728,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:52.788303+0000","last_change":"2024-09-12T01:03:40.566870+0000","last_active":"2024-09-12T01:18:52.788303+0000","last_peered":"2024-09-12T01:18:52.788303+0000","last_clean":"2024-09-12T01:18:52.788303+0000","last_became_active":"2024-09-12T01:03:40.566107+0000","last_became_peered":"2024-09-12T01:03:40.566107+0000","last_unstale":"2024-09-12T01:18:52.788303+0000","last_undegraded":"2024-09-12T01:18:52.788303+0000","last_fullsized":"2024-09-12T01:18:52.788303+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:23.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:43.600492+0000","last_change":"2024-09-12T00:52:40.367723+0000","last_active":"2024-09-12T01:19:43.600492+0000","last_peered":"2024-09-12T01:19:43.600492+0000","last_clean":"2024-09-12T01:19:43.600492+0000","last_became_active":"2024-09-12T00:52:40.367188+0000","last_became_peered":"2024-09-12T00:52:40.367188+0000","last_unstale":"2024-09-12T01:19:43.600492+0000","last_undegraded":"2024-09-12T01:19:43.600492+0000","last_fullsized":"2024-09-12T01:19:43.600492+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:21.283584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"265'2","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:37.216787+0000","last_change":"2024-09-12T01:22:37.216787+0000","last_active":"2024-09-12T01:22:37.216787+0000","last_peered":"2024-09-12T01:22:37.216787+0000","last_clean":"2024-09-12T01:22:37.216787+0000","last_became_active":"2024-09-12T00:52:37.281129+0000","last_became_peered":"2024-09-12T00:52:37.281129+0000","last_unstale":"2024-09-12T01:22:37.216787+0000","last_undegraded":"2024-09-12T01:22:37.216787+0000","last_fullsized":"2024-09-12T01:22:37.216787+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:37.216601+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:37.216601+0000","last_clean_scrub_stamp":"2024-09-12T01:22:37.216601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:14.358131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"265'9","reported_seq":81,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.365423+0000","last_change":"2024-09-12T01:22:21.365181+0000","last_active":"2024-09-12T01:22:21.365423+0000","last_peered":"2024-09-12T01:22:21.365423+0000","last_clean":"2024-09-12T01:22:21.365423+0000","last_became_active":"2024-09-12T00:51:04.983577+0000","last_became_peered":"2024-09-12T00:51:04.983577+0000","last_unstale":"2024-09-12T01:22:21.365423+0000","last_undegraded":"2024-09-12T01:22:21.365423+0000","last_fullsized":"2024-09-12T01:22:21.365423+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-12T01:22:21.364947+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-12T01:22:21.364947+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.364947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:01.811632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:28.596883+0000","last_change":"2024-09-12T01:03:40.590449+0000","last_active":"2024-09-12T01:19:28.596883+0000","last_peered":"2024-09-12T01:19:28.596883+0000","last_clean":"2024-09-12T01:19:28.596883+0000","last_became_active":"2024-09-12T01:03:40.589838+0000","last_became_peered":"2024-09-12T01:03:40.589838+0000","last_unstale":"2024-09-12T01:19:28.596883+0000","last_undegraded":"2024-09-12T01:19:28.596883+0000","last_fullsized":"2024-09-12T01:19:28.596883+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:53.282415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.744871+0000","last_change":"2024-09-12T00:52:40.357689+0000","last_active":"2024-09-12T01:18:42.744871+0000","last_peered":"2024-09-12T01:18:42.744871+0000","last_clean":"2024-09-12T01:18:42.744871+0000","last_became_active":"2024-09-12T00:52:40.356802+0000","last_became_peered":"2024-09-12T00:52:40.356802+0000","last_unstale":"2024-09-12T01:18:42.744871+0000","last_undegraded":"2024-09-12T01:18:42.744871+0000","last_fullsized":"2024-09-12T01:18:42.744871+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:51.102558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"265'6","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.947096+0000","last_change":"2024-09-12T00:52:37.294017+0000","last_active":"2024-09-12T01:21:56.947096+0000","last_peered":"2024-09-12T01:21:56.947096+0000","last_clean":"2024-09-12T01:21:56.947096+0000","last_became_active":"2024-09-12T00:52:37.293564+0000","last_became_peered":"2024-09-12T00:52:37.293564+0000","last_unstale":"2024-09-12T01:21:56.947096+0000","last_undegraded":"2024-09-12T01:21:56.947096+0000","last_fullsized":"2024-09-12T01:21:56.947096+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:56.643360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3128,"num_write":6,"num_write_kb":3128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"262'16","reported_seq":102,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:42.390141+0000","last_change":"2024-09-12T01:22:42.390141+0000","last_active":"2024-09-12T01:22:42.390141+0000","last_peered":"2024-09-12T01:22:42.390141+0000","last_clean":"2024-09-12T01:22:42.390141+0000","last_became_active":"2024-09-12T00:51:04.981091+0000","last_became_peered":"2024-09-12T00:51:04.981091+0000","last_unstale":"2024-09-12T01:22:42.390141+0000","last_undegraded":"2024-09-12T01:22:42.390141+0000","last_fullsized":"2024-09-12T01:22:42.390141+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'16","last_scrub_stamp":"2024-09-12T01:22:42.389938+0000","last_deep_scrub":"262'16","last_deep_scrub_stamp":"2024-09-12T01:22:42.389938+0000","last_clean_scrub_stamp":"2024-09-12T01:22:42.389938+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:56.771573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:27.796717+0000","last_change":"2024-09-12T01:03:40.566702+0000","last_active":"2024-09-12T01:19:27.796717+0000","last_peered":"2024-09-12T01:19:27.796717+0000","last_clean":"2024-09-12T01:19:27.796717+0000","last_became_active":"2024-09-12T01:03:40.565926+0000","last_became_peered":"2024-09-12T01:03:40.565926+0000","last_unstale":"2024-09-12T01:19:27.796717+0000","last_undegraded":"2024-09-12T01:19:27.796717+0000","last_fullsized":"2024-09-12T01:19:27.796717+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:31.308325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.785653+0000","last_change":"2024-09-12T00:52:40.341080+0000","last_active":"2024-09-12T01:18:42.785653+0000","last_peered":"2024-09-12T01:18:42.785653+0000","last_clean":"2024-09-12T01:18:42.785653+0000","last_became_active":"2024-09-12T00:52:40.340423+0000","last_became_peered":"2024-09-12T00:52:40.340423+0000","last_unstale":"2024-09-12T01:18:42.785653+0000","last_undegraded":"2024-09-12T01:18:42.785653+0000","last_fullsized":"2024-09-12T01:18:42.785653+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:11.370534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"265'5","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:35.244190+0000","last_change":"2024-09-12T01:22:35.244190+0000","last_active":"2024-09-12T01:22:35.244190+0000","last_peered":"2024-09-12T01:22:35.244190+0000","last_clean":"2024-09-12T01:22:35.244190+0000","last_became_active":"2024-09-12T00:52:37.293885+0000","last_became_peered":"2024-09-12T00:52:37.293885+0000","last_unstale":"2024-09-12T01:22:35.244190+0000","last_undegraded":"2024-09-12T01:22:35.244190+0000","last_fullsized":"2024-09-12T01:22:35.244190+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:22:35.244010+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:22:35.244010+0000","last_clean_scrub_stamp":"2024-09-12T01:22:35.244010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:14.998143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'39","reported_seq":151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:19.686513+0000","last_change":"2024-09-12T00:51:04.989066+0000","last_active":"2024-09-12T01:19:19.686513+0000","last_peered":"2024-09-12T01:19:19.686513+0000","last_clean":"2024-09-12T01:19:19.686513+0000","last_became_active":"2024-09-12T00:51:04.988252+0000","last_became_peered":"2024-09-12T00:51:04.988252+0000","last_unstale":"2024-09-12T01:19:19.686513+0000","last_undegraded":"2024-09-12T01:19:19.686513+0000","last_fullsized":"2024-09-12T01:19:19.686513+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:49.691881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":135,"num_write":72,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:27.796591+0000","last_change":"2024-09-12T01:03:40.581034+0000","last_active":"2024-09-12T01:19:27.796591+0000","last_peered":"2024-09-12T01:19:27.796591+0000","last_clean":"2024-09-12T01:19:27.796591+0000","last_became_active":"2024-09-12T01:03:40.580376+0000","last_became_peered":"2024-09-12T01:03:40.580376+0000","last_unstale":"2024-09-12T01:19:27.796591+0000","last_undegraded":"2024-09-12T01:19:27.796591+0000","last_fullsized":"2024-09-12T01:19:27.796591+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:38.778592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:40.195327+0000","last_change":"2024-09-12T01:22:40.195327+0000","last_active":"2024-09-12T01:22:40.195327+0000","last_peered":"2024-09-12T01:22:40.195327+0000","last_clean":"2024-09-12T01:22:40.195327+0000","last_became_active":"2024-09-12T00:52:40.337359+0000","last_became_peered":"2024-09-12T00:52:40.337359+0000","last_unstale":"2024-09-12T01:22:40.195327+0000","last_undegraded":"2024-09-12T01:22:40.195327+0000","last_fullsized":"2024-09-12T01:22:40.195327+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:40.195153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:40.195153+0000","last_clean_scrub_stamp":"2024-09-12T01:22:40.195153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:37.029617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"265'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:53.595693+0000","last_change":"2024-09-12T00:52:37.300132+0000","last_active":"2024-09-12T01:20:53.595693+0000","last_peered":"2024-09-12T01:20:53.595693+0000","last_clean":"2024-09-12T01:20:53.595693+0000","last_became_active":"2024-09-12T00:52:37.299461+0000","last_became_peered":"2024-09-12T00:52:37.299461+0000","last_unstale":"2024-09-12T01:20:53.595693+0000","last_undegraded":"2024-09-12T01:20:53.595693+0000","last_fullsized":"2024-09-12T01:20:53.595693+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:06.604639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5125,"num_write":10,"num_write_kb":5125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'112","reported_seq":395,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:18.594307+0000","last_change":"2024-09-12T00:51:04.983673+0000","last_active":"2024-09-12T01:19:18.594307+0000","last_peered":"2024-09-12T01:19:18.594307+0000","last_clean":"2024-09-12T01:19:18.594307+0000","last_became_active":"2024-09-12T00:51:04.975690+0000","last_became_peered":"2024-09-12T00:51:04.975690+0000","last_unstale":"2024-09-12T01:19:18.594307+0000","last_undegraded":"2024-09-12T01:19:18.594307+0000","last_fullsized":"2024-09-12T01:19:18.594307+0000","mapping_epoch":252,"log_start":"265'100","ondisk_log_start":"265'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:51:03.936889+0000","last_clean_scrub_stamp":"2024-09-12T00:51:03.936889+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:00.184799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":675,"num_read_kb":541,"num_write":147,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:28.576824+0000","last_change":"2024-09-12T01:03:40.586682+0000","last_active":"2024-09-12T01:19:28.576824+0000","last_peered":"2024-09-12T01:19:28.576824+0000","last_clean":"2024-09-12T01:19:28.576824+0000","last_became_active":"2024-09-12T01:03:40.585894+0000","last_became_peered":"2024-09-12T01:03:40.585894+0000","last_unstale":"2024-09-12T01:19:28.576824+0000","last_undegraded":"2024-09-12T01:19:28.576824+0000","last_fullsized":"2024-09-12T01:19:28.576824+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:09.789910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"262'3","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:42.785780+0000","last_change":"2024-09-12T00:52:40.355779+0000","last_active":"2024-09-12T01:18:42.785780+0000","last_peered":"2024-09-12T01:18:42.785780+0000","last_clean":"2024-09-12T01:18:42.785780+0000","last_became_active":"2024-09-12T00:52:40.355113+0000","last_became_peered":"2024-09-12T00:52:40.355113+0000","last_unstale":"2024-09-12T01:18:42.785780+0000","last_undegraded":"2024-09-12T01:18:42.785780+0000","last_fullsized":"2024-09-12T01:18:42.785780+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:00.005104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'3","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:41.955963+0000","last_change":"2024-09-12T01:22:41.955963+0000","last_active":"2024-09-12T01:22:41.955963+0000","last_peered":"2024-09-12T01:22:41.955963+0000","last_clean":"2024-09-12T01:22:41.955963+0000","last_became_active":"2024-09-12T00:52:37.280444+0000","last_became_peered":"2024-09-12T00:52:37.280444+0000","last_unstale":"2024-09-12T01:22:41.955963+0000","last_undegraded":"2024-09-12T01:22:41.955963+0000","last_fullsized":"2024-09-12T01:22:41.955963+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:22:41.955790+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:22:41.955790+0000","last_clean_scrub_stamp":"2024-09-12T01:22:41.955790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:07.749444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'48","reported_seq":189,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:32.107529+0000","last_change":"2024-09-12T01:22:32.107529+0000","last_active":"2024-09-12T01:22:32.107529+0000","last_peered":"2024-09-12T01:22:32.107529+0000","last_clean":"2024-09-12T01:22:32.107529+0000","last_became_active":"2024-09-12T00:51:04.984384+0000","last_became_peered":"2024-09-12T00:51:04.984384+0000","last_unstale":"2024-09-12T01:22:32.107529+0000","last_undegraded":"2024-09-12T01:22:32.107529+0000","last_fullsized":"2024-09-12T01:22:32.107529+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'48","last_scrub_stamp":"2024-09-12T01:22:32.107337+0000","last_deep_scrub":"265'48","last_deep_scrub_stamp":"2024-09-12T01:22:32.107337+0000","last_clean_scrub_stamp":"2024-09-12T01:22:32.107337+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:27.215513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":174,"num_write":98,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.808808+0000","last_change":"2024-09-12T01:03:40.566732+0000","last_active":"2024-09-12T01:20:22.808808+0000","last_peered":"2024-09-12T01:20:22.808808+0000","last_clean":"2024-09-12T01:20:22.808808+0000","last_became_active":"2024-09-12T01:03:40.565972+0000","last_became_peered":"2024-09-12T01:03:40.565972+0000","last_unstale":"2024-09-12T01:20:22.808808+0000","last_undegraded":"2024-09-12T01:20:22.808808+0000","last_fullsized":"2024-09-12T01:20:22.808808+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:53.583277+0000","last_change":"2024-09-12T00:52:40.352965+0000","last_active":"2024-09-12T01:19:53.583277+0000","last_peered":"2024-09-12T01:19:53.583277+0000","last_clean":"2024-09-12T01:19:53.583277+0000","last_became_active":"2024-09-12T00:52:40.352178+0000","last_became_peered":"2024-09-12T00:52:40.352178+0000","last_unstale":"2024-09-12T01:19:53.583277+0000","last_undegraded":"2024-09-12T01:19:53.583277+0000","last_fullsized":"2024-09-12T01:19:53.583277+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:25.540435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:42.800116+0000","last_change":"2024-09-12T00:52:37.281424+0000","last_active":"2024-09-12T01:19:42.800116+0000","last_peered":"2024-09-12T01:19:42.800116+0000","last_clean":"2024-09-12T01:19:42.800116+0000","last_became_active":"2024-09-12T00:52:37.280679+0000","last_became_peered":"2024-09-12T00:52:37.280679+0000","last_unstale":"2024-09-12T01:19:42.800116+0000","last_undegraded":"2024-09-12T01:19:42.800116+0000","last_fullsized":"2024-09-12T01:19:42.800116+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:14.781208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'2","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:40.367300+0000","last_change":"2024-09-12T01:22:40.367300+0000","last_active":"2024-09-12T01:22:40.367300+0000","last_peered":"2024-09-12T01:22:40.367300+0000","last_clean":"2024-09-12T01:22:40.367300+0000","last_became_active":"2024-09-12T00:51:04.996736+0000","last_became_peered":"2024-09-12T00:51:04.996736+0000","last_unstale":"2024-09-12T01:22:40.367300+0000","last_undegraded":"2024-09-12T01:22:40.367300+0000","last_fullsized":"2024-09-12T01:22:40.367300+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:40.367022+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:40.367022+0000","last_clean_scrub_stamp":"2024-09-12T01:22:40.367022+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:54.019658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.382379+0000","last_change":"2024-09-12T01:03:40.577490+0000","last_active":"2024-09-12T01:20:23.382379+0000","last_peered":"2024-09-12T01:20:23.382379+0000","last_clean":"2024-09-12T01:20:23.382379+0000","last_became_active":"2024-09-12T01:03:40.576752+0000","last_became_peered":"2024-09-12T01:03:40.576752+0000","last_unstale":"2024-09-12T01:20:23.382379+0000","last_undegraded":"2024-09-12T01:20:23.382379+0000","last_fullsized":"2024-09-12T01:20:23.382379+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"262'8","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.582004+0000","last_change":"2024-09-12T00:52:40.340084+0000","last_active":"2024-09-12T01:19:48.582004+0000","last_peered":"2024-09-12T01:19:48.582004+0000","last_clean":"2024-09-12T01:19:48.582004+0000","last_became_active":"2024-09-12T00:52:40.338378+0000","last_became_peered":"2024-09-12T00:52:40.338378+0000","last_unstale":"2024-09-12T01:19:48.582004+0000","last_undegraded":"2024-09-12T01:19:48.582004+0000","last_fullsized":"2024-09-12T01:19:48.582004+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:29.194283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'6","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:25.407022+0000","last_change":"2024-09-12T01:22:25.407022+0000","last_active":"2024-09-12T01:22:25.407022+0000","last_peered":"2024-09-12T01:22:25.407022+0000","last_clean":"2024-09-12T01:22:25.407022+0000","last_became_active":"2024-09-12T00:52:37.284206+0000","last_became_peered":"2024-09-12T00:52:37.284206+0000","last_unstale":"2024-09-12T01:22:25.407022+0000","last_undegraded":"2024-09-12T01:22:25.407022+0000","last_fullsized":"2024-09-12T01:22:25.407022+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:22:25.406833+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:22:25.406833+0000","last_clean_scrub_stamp":"2024-09-12T01:22:25.406833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:01.812060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'21","reported_seq":114,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:31.080122+0000","last_change":"2024-09-12T01:22:31.080122+0000","last_active":"2024-09-12T01:22:31.080122+0000","last_peered":"2024-09-12T01:22:31.080122+0000","last_clean":"2024-09-12T01:22:31.080122+0000","last_became_active":"2024-09-12T00:51:04.983165+0000","last_became_peered":"2024-09-12T00:51:04.983165+0000","last_unstale":"2024-09-12T01:22:31.080122+0000","last_undegraded":"2024-09-12T01:22:31.080122+0000","last_fullsized":"2024-09-12T01:22:31.080122+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'21","last_scrub_stamp":"2024-09-12T01:22:31.079934+0000","last_deep_scrub":"265'21","last_deep_scrub_stamp":"2024-09-12T01:22:31.079934+0000","last_clean_scrub_stamp":"2024-09-12T01:22:31.079934+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:01.034206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":73,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.584915+0000","last_change":"2024-09-12T01:03:40.579521+0000","last_active":"2024-09-12T01:19:48.584915+0000","last_peered":"2024-09-12T01:19:48.584915+0000","last_clean":"2024-09-12T01:19:48.584915+0000","last_became_active":"2024-09-12T01:03:40.578825+0000","last_became_peered":"2024-09-12T01:03:40.578825+0000","last_unstale":"2024-09-12T01:19:48.584915+0000","last_undegraded":"2024-09-12T01:19:48.584915+0000","last_fullsized":"2024-09-12T01:19:48.584915+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:02.779228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"265'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:52.815957+0000","last_change":"2024-09-12T00:52:40.353791+0000","last_active":"2024-09-12T01:20:52.815957+0000","last_peered":"2024-09-12T01:20:52.815957+0000","last_clean":"2024-09-12T01:20:52.815957+0000","last_became_active":"2024-09-12T00:52:40.352922+0000","last_became_peered":"2024-09-12T00:52:40.352922+0000","last_unstale":"2024-09-12T01:20:52.815957+0000","last_undegraded":"2024-09-12T01:20:52.815957+0000","last_fullsized":"2024-09-12T01:20:52.815957+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:33.594783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:38.556947+0000","last_change":"2024-09-12T00:52:37.281272+0000","last_active":"2024-09-12T01:18:38.556947+0000","last_peered":"2024-09-12T01:18:38.556947+0000","last_clean":"2024-09-12T01:18:38.556947+0000","last_became_active":"2024-09-12T00:52:37.280548+0000","last_became_peered":"2024-09-12T00:52:37.280548+0000","last_unstale":"2024-09-12T01:18:38.556947+0000","last_undegraded":"2024-09-12T01:18:38.556947+0000","last_fullsized":"2024-09-12T01:18:38.556947+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:57.882529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'10","reported_seq":85,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:39.485140+0000","last_change":"2024-09-12T01:22:39.485140+0000","last_active":"2024-09-12T01:22:39.485140+0000","last_peered":"2024-09-12T01:22:39.485140+0000","last_clean":"2024-09-12T01:22:39.485140+0000","last_became_active":"2024-09-12T00:51:04.994904+0000","last_became_peered":"2024-09-12T00:51:04.994904+0000","last_unstale":"2024-09-12T01:22:39.485140+0000","last_undegraded":"2024-09-12T01:22:39.485140+0000","last_fullsized":"2024-09-12T01:22:39.485140+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-12T01:22:39.484956+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-12T01:22:39.484956+0000","last_clean_scrub_stamp":"2024-09-12T01:22:39.484956+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:47.260111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":34,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.567092+0000","last_change":"2024-09-12T01:03:40.577193+0000","last_active":"2024-09-12T01:20:22.567092+0000","last_peered":"2024-09-12T01:20:22.567092+0000","last_clean":"2024-09-12T01:20:22.567092+0000","last_became_active":"2024-09-12T01:03:40.576442+0000","last_became_peered":"2024-09-12T01:03:40.576442+0000","last_unstale":"2024-09-12T01:20:22.567092+0000","last_undegraded":"2024-09-12T01:20:22.567092+0000","last_fullsized":"2024-09-12T01:20:22.567092+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"265'6","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:52.574160+0000","last_change":"2024-09-12T00:52:40.346550+0000","last_active":"2024-09-12T01:20:52.574160+0000","last_peered":"2024-09-12T01:20:52.574160+0000","last_clean":"2024-09-12T01:20:52.574160+0000","last_became_active":"2024-09-12T00:52:40.345375+0000","last_became_peered":"2024-09-12T00:52:40.345375+0000","last_unstale":"2024-09-12T01:20:52.574160+0000","last_undegraded":"2024-09-12T01:20:52.574160+0000","last_fullsized":"2024-09-12T01:20:52.574160+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:05.935202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"262'5","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:37.784692+0000","last_change":"2024-09-12T00:52:37.282759+0000","last_active":"2024-09-12T01:18:37.784692+0000","last_peered":"2024-09-12T01:18:37.784692+0000","last_clean":"2024-09-12T01:18:37.784692+0000","last_became_active":"2024-09-12T00:52:37.282005+0000","last_became_peered":"2024-09-12T00:52:37.282005+0000","last_unstale":"2024-09-12T01:18:37.784692+0000","last_undegraded":"2024-09-12T01:18:37.784692+0000","last_fullsized":"2024-09-12T01:18:37.784692+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:50.148380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":5,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"265'13","reported_seq":91,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:32.297808+0000","last_change":"2024-09-12T01:22:32.297808+0000","last_active":"2024-09-12T01:22:32.297808+0000","last_peered":"2024-09-12T01:22:32.297808+0000","last_clean":"2024-09-12T01:22:32.297808+0000","last_became_active":"2024-09-12T00:51:04.990945+0000","last_became_peered":"2024-09-12T00:51:04.990945+0000","last_unstale":"2024-09-12T01:22:32.297808+0000","last_undegraded":"2024-09-12T01:22:32.297808+0000","last_fullsized":"2024-09-12T01:22:32.297808+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'13","last_scrub_stamp":"2024-09-12T01:22:32.297522+0000","last_deep_scrub":"265'13","last_deep_scrub_stamp":"2024-09-12T01:22:32.297522+0000","last_clean_scrub_stamp":"2024-09-12T01:22:32.297522+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:38.583047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"265'2","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:31.394811+0000","last_change":"2024-09-12T01:22:31.394811+0000","last_active":"2024-09-12T01:22:31.394811+0000","last_peered":"2024-09-12T01:22:31.394811+0000","last_clean":"2024-09-12T01:22:31.394811+0000","last_became_active":"2024-09-12T01:03:40.581227+0000","last_became_peered":"2024-09-12T01:03:40.581227+0000","last_unstale":"2024-09-12T01:22:31.394811+0000","last_undegraded":"2024-09-12T01:22:31.394811+0000","last_fullsized":"2024-09-12T01:22:31.394811+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:31.394614+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:31.394614+0000","last_clean_scrub_stamp":"2024-09-12T01:22:31.394614+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:55.398951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:39.225501+0000","last_change":"2024-09-12T01:22:39.225501+0000","last_active":"2024-09-12T01:22:39.225501+0000","last_peered":"2024-09-12T01:22:39.225501+0000","last_clean":"2024-09-12T01:22:39.225501+0000","last_became_active":"2024-09-12T00:52:40.340078+0000","last_became_peered":"2024-09-12T00:52:40.340078+0000","last_unstale":"2024-09-12T01:22:39.225501+0000","last_undegraded":"2024-09-12T01:22:39.225501+0000","last_fullsized":"2024-09-12T01:22:39.225501+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:39.225310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:39.225310+0000","last_clean_scrub_stamp":"2024-09-12T01:22:39.225310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:20.437110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"262'5","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:42.492563+0000","last_change":"2024-09-12T01:22:42.492563+0000","last_active":"2024-09-12T01:22:42.492563+0000","last_peered":"2024-09-12T01:22:42.492563+0000","last_clean":"2024-09-12T01:22:42.492563+0000","last_became_active":"2024-09-12T00:52:37.277753+0000","last_became_peered":"2024-09-12T00:52:37.277753+0000","last_unstale":"2024-09-12T01:22:42.492563+0000","last_undegraded":"2024-09-12T01:22:42.492563+0000","last_fullsized":"2024-09-12T01:22:42.492563+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T01:22:42.492372+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T01:22:42.492372+0000","last_clean_scrub_stamp":"2024-09-12T01:22:42.492372+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:18.929803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"254'7","reported_seq":79,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:42.599498+0000","last_change":"2024-09-12T01:22:42.599498+0000","last_active":"2024-09-12T01:22:42.599498+0000","last_peered":"2024-09-12T01:22:42.599498+0000","last_clean":"2024-09-12T01:22:42.599498+0000","last_became_active":"2024-09-12T00:51:04.956754+0000","last_became_peered":"2024-09-12T00:51:04.956754+0000","last_unstale":"2024-09-12T01:22:42.599498+0000","last_undegraded":"2024-09-12T01:22:42.599498+0000","last_fullsized":"2024-09-12T01:22:42.599498+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'7","last_scrub_stamp":"2024-09-12T01:22:42.599303+0000","last_deep_scrub":"254'7","last_deep_scrub_stamp":"2024-09-12T01:22:42.599303+0000","last_clean_scrub_stamp":"2024-09-12T01:22:42.599303+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:17.291713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":30,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:53.568338+0000","last_change":"2024-09-12T01:03:40.586675+0000","last_active":"2024-09-12T01:18:53.568338+0000","last_peered":"2024-09-12T01:18:53.568338+0000","last_clean":"2024-09-12T01:18:53.568338+0000","last_became_active":"2024-09-12T01:03:40.583308+0000","last_became_peered":"2024-09-12T01:03:40.583308+0000","last_unstale":"2024-09-12T01:18:53.568338+0000","last_undegraded":"2024-09-12T01:18:53.568338+0000","last_fullsized":"2024-09-12T01:18:53.568338+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:58.594413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'6","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:56.619618+0000","last_change":"2024-09-12T00:52:40.333654+0000","last_active":"2024-09-12T01:21:56.619618+0000","last_peered":"2024-09-12T01:21:56.619618+0000","last_clean":"2024-09-12T01:21:56.619618+0000","last_became_active":"2024-09-12T00:52:40.332913+0000","last_became_peered":"2024-09-12T00:52:40.332913+0000","last_unstale":"2024-09-12T01:21:56.619618+0000","last_undegraded":"2024-09-12T01:21:56.619618+0000","last_fullsized":"2024-09-12T01:21:56.619618+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:55.862557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:21:47.828740+0000","last_change":"2024-09-12T00:52:37.287265+0000","last_active":"2024-09-12T01:21:47.828740+0000","last_peered":"2024-09-12T01:21:47.828740+0000","last_clean":"2024-09-12T01:21:47.828740+0000","last_became_active":"2024-09-12T00:52:37.282758+0000","last_became_peered":"2024-09-12T00:52:37.282758+0000","last_unstale":"2024-09-12T01:21:47.828740+0000","last_undegraded":"2024-09-12T01:21:47.828740+0000","last_fullsized":"2024-09-12T01:21:47.828740+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:36.240194+0000","last_clean_scrub_stamp":"2024-09-12T00:52:36.240194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:54.106634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'71","reported_seq":253,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:40.940513+0000","last_change":"2024-09-12T01:22:40.940513+0000","last_active":"2024-09-12T01:22:40.940513+0000","last_peered":"2024-09-12T01:22:40.940513+0000","last_clean":"2024-09-12T01:22:40.940513+0000","last_became_active":"2024-09-12T00:51:04.982747+0000","last_became_peered":"2024-09-12T00:51:04.982747+0000","last_unstale":"2024-09-12T01:22:40.940513+0000","last_undegraded":"2024-09-12T01:22:40.940513+0000","last_fullsized":"2024-09-12T01:22:40.940513+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'71","last_scrub_stamp":"2024-09-12T01:22:40.940337+0000","last_deep_scrub":"265'71","last_deep_scrub_stamp":"2024-09-12T01:22:40.940337+0000","last_clean_scrub_stamp":"2024-09-12T01:22:40.940337+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:33.997706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":369,"num_read_kb":267,"num_write":124,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:23.590698+0000","last_change":"2024-09-12T01:03:40.573794+0000","last_active":"2024-09-12T01:20:23.590698+0000","last_peered":"2024-09-12T01:20:23.590698+0000","last_clean":"2024-09-12T01:20:23.590698+0000","last_became_active":"2024-09-12T01:03:40.571968+0000","last_became_peered":"2024-09-12T01:03:40.571968+0000","last_unstale":"2024-09-12T01:20:23.590698+0000","last_undegraded":"2024-09-12T01:20:23.590698+0000","last_fullsized":"2024-09-12T01:20:23.590698+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'7","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:36.013174+0000","last_change":"2024-09-12T01:22:36.013174+0000","last_active":"2024-09-12T01:22:36.013174+0000","last_peered":"2024-09-12T01:22:36.013174+0000","last_clean":"2024-09-12T01:22:36.013174+0000","last_became_active":"2024-09-12T00:52:40.359434+0000","last_became_peered":"2024-09-12T00:52:40.359434+0000","last_unstale":"2024-09-12T01:22:36.013174+0000","last_undegraded":"2024-09-12T01:22:36.013174+0000","last_fullsized":"2024-09-12T01:22:36.013174+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T01:22:36.012999+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T01:22:36.012999+0000","last_clean_scrub_stamp":"2024-09-12T01:22:36.012999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:39.219563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":12,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'6","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:34.270661+0000","last_change":"2024-09-12T01:22:34.270661+0000","last_active":"2024-09-12T01:22:34.270661+0000","last_peered":"2024-09-12T01:22:34.270661+0000","last_clean":"2024-09-12T01:22:34.270661+0000","last_became_active":"2024-09-12T00:52:37.291369+0000","last_became_peered":"2024-09-12T00:52:37.291369+0000","last_unstale":"2024-09-12T01:22:34.270661+0000","last_undegraded":"2024-09-12T01:22:34.270661+0000","last_fullsized":"2024-09-12T01:22:34.270661+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:22:34.270471+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:22:34.270471+0000","last_clean_scrub_stamp":"2024-09-12T01:22:34.270471+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:30.065536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'35","reported_seq":145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:30.057750+0000","last_change":"2024-09-12T01:22:30.057750+0000","last_active":"2024-09-12T01:22:30.057750+0000","last_peered":"2024-09-12T01:22:30.057750+0000","last_clean":"2024-09-12T01:22:30.057750+0000","last_became_active":"2024-09-12T00:51:04.990179+0000","last_became_peered":"2024-09-12T00:51:04.990179+0000","last_unstale":"2024-09-12T01:22:30.057750+0000","last_undegraded":"2024-09-12T01:22:30.057750+0000","last_fullsized":"2024-09-12T01:22:30.057750+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'35","last_scrub_stamp":"2024-09-12T01:22:30.057517+0000","last_deep_scrub":"265'35","last_deep_scrub_stamp":"2024-09-12T01:22:30.057517+0000","last_clean_scrub_stamp":"2024-09-12T01:22:30.057517+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:37.573193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":108,"num_write":67,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.808897+0000","last_change":"2024-09-12T01:03:40.574488+0000","last_active":"2024-09-12T01:20:22.808897+0000","last_peered":"2024-09-12T01:20:22.808897+0000","last_clean":"2024-09-12T01:20:22.808897+0000","last_became_active":"2024-09-12T01:03:40.573928+0000","last_became_peered":"2024-09-12T01:03:40.573928+0000","last_unstale":"2024-09-12T01:20:22.808897+0000","last_undegraded":"2024-09-12T01:20:22.808897+0000","last_fullsized":"2024-09-12T01:20:22.808897+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:47.559411+0000","last_change":"2024-09-12T00:52:40.349488+0000","last_active":"2024-09-12T01:19:47.559411+0000","last_peered":"2024-09-12T01:19:47.559411+0000","last_clean":"2024-09-12T01:19:47.559411+0000","last_became_active":"2024-09-12T00:52:40.348494+0000","last_became_peered":"2024-09-12T00:52:40.348494+0000","last_unstale":"2024-09-12T01:19:47.559411+0000","last_undegraded":"2024-09-12T01:19:47.559411+0000","last_fullsized":"2024-09-12T01:19:47.559411+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:52:39.289102+0000","last_clean_scrub_stamp":"2024-09-12T00:52:39.289102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:17.271665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'2","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:35.053445+0000","last_change":"2024-09-12T01:22:35.053445+0000","last_active":"2024-09-12T01:22:35.053445+0000","last_peered":"2024-09-12T01:22:35.053445+0000","last_clean":"2024-09-12T01:22:35.053445+0000","last_became_active":"2024-09-12T00:52:37.278285+0000","last_became_peered":"2024-09-12T00:52:37.278285+0000","last_unstale":"2024-09-12T01:22:35.053445+0000","last_undegraded":"2024-09-12T01:22:35.053445+0000","last_fullsized":"2024-09-12T01:22:35.053445+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T01:22:35.053225+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T01:22:35.053225+0000","last_clean_scrub_stamp":"2024-09-12T01:22:35.053225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:02.281428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'29","reported_seq":133,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:37.474569+0000","last_change":"2024-09-12T01:22:37.474569+0000","last_active":"2024-09-12T01:22:37.474569+0000","last_peered":"2024-09-12T01:22:37.474569+0000","last_clean":"2024-09-12T01:22:37.474569+0000","last_became_active":"2024-09-12T00:51:04.984999+0000","last_became_peered":"2024-09-12T00:51:04.984999+0000","last_unstale":"2024-09-12T01:22:37.474569+0000","last_undegraded":"2024-09-12T01:22:37.474569+0000","last_fullsized":"2024-09-12T01:22:37.474569+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'29","last_scrub_stamp":"2024-09-12T01:22:37.474379+0000","last_deep_scrub":"265'29","last_deep_scrub_stamp":"2024-09-12T01:22:37.474379+0000","last_clean_scrub_stamp":"2024-09-12T01:22:37.474379+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:27.806721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":53,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'333","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.526698+0000","last_change":"2024-09-12T01:22:17.526698+0000","last_active":"2024-09-12T01:22:17.526698+0000","last_peered":"2024-09-12T01:22:17.526698+0000","last_clean":"2024-09-12T01:22:17.526698+0000","last_became_active":"2024-09-12T00:35:43.947816+0000","last_became_peered":"2024-09-12T00:35:43.947816+0000","last_unstale":"2024-09-12T01:22:17.526698+0000","last_undegraded":"2024-09-12T01:22:17.526698+0000","last_fullsized":"2024-09-12T01:22:17.526698+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-12T01:22:17.526459+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-12T01:22:17.526459+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.526459+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:45.054333+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1291295,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":33235,"num_write":1076,"num_write_kb":21608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'253","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.685823+0000","last_change":"2024-09-12T01:22:22.685823+0000","last_active":"2024-09-12T01:22:22.685823+0000","last_peered":"2024-09-12T01:22:22.685823+0000","last_clean":"2024-09-12T01:22:22.685823+0000","last_became_active":"2024-09-12T00:35:45.925856+0000","last_became_peered":"2024-09-12T00:35:45.925856+0000","last_unstale":"2024-09-12T01:22:22.685823+0000","last_undegraded":"2024-09-12T01:22:22.685823+0000","last_fullsized":"2024-09-12T01:22:22.685823+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'253","last_scrub_stamp":"2024-09-12T01:22:22.685653+0000","last_deep_scrub":"265'253","last_deep_scrub_stamp":"2024-09-12T01:22:22.685653+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.685653+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:53.425516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1075,"num_read_kb":882,"num_write":373,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'379","reported_seq":1051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.216236+0000","last_change":"2024-09-12T01:22:10.216236+0000","last_active":"2024-09-12T01:22:10.216236+0000","last_peered":"2024-09-12T01:22:10.216236+0000","last_clean":"2024-09-12T01:22:10.216236+0000","last_became_active":"2024-09-12T00:35:43.933088+0000","last_became_peered":"2024-09-12T00:35:43.933088+0000","last_unstale":"2024-09-12T01:22:10.216236+0000","last_undegraded":"2024-09-12T01:22:10.216236+0000","last_fullsized":"2024-09-12T01:22:10.216236+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'379","last_scrub_stamp":"2024-09-12T01:22:10.215975+0000","last_deep_scrub":"265'379","last_deep_scrub_stamp":"2024-09-12T01:22:10.215975+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.215975+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:43.999693+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":567,"num_read_kb":47488,"num_write":1216,"num_write_kb":29880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'45","reported_seq":587,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.419078+0000","last_change":"2024-09-12T01:22:21.419078+0000","last_active":"2024-09-12T01:22:21.419078+0000","last_peered":"2024-09-12T01:22:21.419078+0000","last_clean":"2024-09-12T01:22:21.419078+0000","last_became_active":"2024-09-12T00:35:45.947212+0000","last_became_peered":"2024-09-12T00:35:45.947212+0000","last_unstale":"2024-09-12T01:22:21.419078+0000","last_undegraded":"2024-09-12T01:22:21.419078+0000","last_fullsized":"2024-09-12T01:22:21.419078+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'45","last_scrub_stamp":"2024-09-12T01:22:21.418869+0000","last_deep_scrub":"265'45","last_deep_scrub_stamp":"2024-09-12T01:22:21.418869+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.418869+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:50:21.799809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":168,"num_write":71,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'336","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.537484+0000","last_change":"2024-09-12T01:22:12.537484+0000","last_active":"2024-09-12T01:22:12.537484+0000","last_peered":"2024-09-12T01:22:12.537484+0000","last_clean":"2024-09-12T01:22:12.537484+0000","last_became_active":"2024-09-12T00:35:43.926443+0000","last_became_peered":"2024-09-12T00:35:43.926443+0000","last_unstale":"2024-09-12T01:22:12.537484+0000","last_undegraded":"2024-09-12T01:22:12.537484+0000","last_fullsized":"2024-09-12T01:22:12.537484+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'336","last_scrub_stamp":"2024-09-12T01:22:12.537222+0000","last_deep_scrub":"265'336","last_deep_scrub_stamp":"2024-09-12T01:22:12.537222+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.537222+0000","objects_scrubbed":9,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:43.392767+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262209,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":553,"num_read_kb":98039,"num_write":1093,"num_write_kb":58371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'116","reported_seq":737,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.906406+0000","last_change":"2024-09-12T01:22:21.906406+0000","last_active":"2024-09-12T01:22:21.906406+0000","last_peered":"2024-09-12T01:22:21.906406+0000","last_clean":"2024-09-12T01:22:21.906406+0000","last_became_active":"2024-09-12T00:35:45.930987+0000","last_became_peered":"2024-09-12T00:35:45.930987+0000","last_unstale":"2024-09-12T01:22:21.906406+0000","last_undegraded":"2024-09-12T01:22:21.906406+0000","last_fullsized":"2024-09-12T01:22:21.906406+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'116","last_scrub_stamp":"2024-09-12T01:22:21.906229+0000","last_deep_scrub":"265'116","last_deep_scrub_stamp":"2024-09-12T01:22:21.906229+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.906229+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:48.016467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":522,"num_read_kb":443,"num_write":187,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'383","reported_seq":1063,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.820355+0000","last_change":"2024-09-12T01:22:15.820355+0000","last_active":"2024-09-12T01:22:15.820355+0000","last_peered":"2024-09-12T01:22:15.820355+0000","last_clean":"2024-09-12T01:22:15.820355+0000","last_became_active":"2024-09-12T00:35:43.914356+0000","last_became_peered":"2024-09-12T00:35:43.914356+0000","last_unstale":"2024-09-12T01:22:15.820355+0000","last_undegraded":"2024-09-12T01:22:15.820355+0000","last_fullsized":"2024-09-12T01:22:15.820355+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'383","last_scrub_stamp":"2024-09-12T01:22:15.820094+0000","last_deep_scrub":"265'383","last_deep_scrub_stamp":"2024-09-12T01:22:15.820094+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.820094+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:01.760407+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6370276,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":596,"num_read_kb":17763,"num_write":1203,"num_write_kb":54335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'197","reported_seq":802,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.513443+0000","last_change":"2024-09-12T01:22:17.513443+0000","last_active":"2024-09-12T01:22:17.513443+0000","last_peered":"2024-09-12T01:22:17.513443+0000","last_clean":"2024-09-12T01:22:17.513443+0000","last_became_active":"2024-09-12T00:35:45.942567+0000","last_became_peered":"2024-09-12T00:35:45.942567+0000","last_unstale":"2024-09-12T01:22:17.513443+0000","last_undegraded":"2024-09-12T01:22:17.513443+0000","last_fullsized":"2024-09-12T01:22:17.513443+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'197","last_scrub_stamp":"2024-09-12T01:22:17.513255+0000","last_deep_scrub":"265'197","last_deep_scrub_stamp":"2024-09-12T01:22:17.513255+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.513255+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:58.319165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":861,"num_read_kb":699,"num_write":314,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'348","reported_seq":1013,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.507635+0000","last_change":"2024-09-12T01:22:16.507635+0000","last_active":"2024-09-12T01:22:16.507635+0000","last_peered":"2024-09-12T01:22:16.507635+0000","last_clean":"2024-09-12T01:22:16.507635+0000","last_became_active":"2024-09-12T00:35:43.944644+0000","last_became_peered":"2024-09-12T00:35:43.944644+0000","last_unstale":"2024-09-12T01:22:16.507635+0000","last_undegraded":"2024-09-12T01:22:16.507635+0000","last_fullsized":"2024-09-12T01:22:16.507635+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-12T01:22:16.507410+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-12T01:22:16.507410+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.507410+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:46.731365+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289155,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":589,"num_read_kb":29244,"num_write":1174,"num_write_kb":25136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'342","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.112383+0000","last_change":"2024-09-12T01:22:17.112383+0000","last_active":"2024-09-12T01:22:17.112383+0000","last_peered":"2024-09-12T01:22:17.112383+0000","last_clean":"2024-09-12T01:22:17.112383+0000","last_became_active":"2024-09-12T00:35:45.943110+0000","last_became_peered":"2024-09-12T00:35:45.943110+0000","last_unstale":"2024-09-12T01:22:17.112383+0000","last_undegraded":"2024-09-12T01:22:17.112383+0000","last_fullsized":"2024-09-12T01:22:17.112383+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T01:22:17.112199+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T01:22:17.112199+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.112199+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:44.660281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1719,"num_read_kb":1451,"num_write":623,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'340","reported_seq":958,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.811940+0000","last_change":"2024-09-12T01:22:16.811940+0000","last_active":"2024-09-12T01:22:16.811940+0000","last_peered":"2024-09-12T01:22:16.811940+0000","last_clean":"2024-09-12T01:22:16.811940+0000","last_became_active":"2024-09-12T00:35:43.929553+0000","last_became_peered":"2024-09-12T00:35:43.929553+0000","last_unstale":"2024-09-12T01:22:16.811940+0000","last_undegraded":"2024-09-12T01:22:16.811940+0000","last_fullsized":"2024-09-12T01:22:16.811940+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'340","last_scrub_stamp":"2024-09-12T01:22:16.811714+0000","last_deep_scrub":"265'340","last_deep_scrub_stamp":"2024-09-12T01:22:16.811714+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.811714+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:09.205040+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8021586,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":453,"num_read_kb":14436,"num_write":1125,"num_write_kb":49786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'350","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:23.861032+0000","last_change":"2024-09-12T01:22:23.861032+0000","last_active":"2024-09-12T01:22:23.861032+0000","last_peered":"2024-09-12T01:22:23.861032+0000","last_clean":"2024-09-12T01:22:23.861032+0000","last_became_active":"2024-09-12T00:35:45.934193+0000","last_became_peered":"2024-09-12T00:35:45.934193+0000","last_unstale":"2024-09-12T01:22:23.861032+0000","last_undegraded":"2024-09-12T01:22:23.861032+0000","last_fullsized":"2024-09-12T01:22:23.861032+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'350","last_scrub_stamp":"2024-09-12T01:22:23.860857+0000","last_deep_scrub":"265'350","last_deep_scrub_stamp":"2024-09-12T01:22:23.860857+0000","last_clean_scrub_stamp":"2024-09-12T01:22:23.860857+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:53.109892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1452,"num_read_kb":1165,"num_write":550,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'395","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.543860+0000","last_change":"2024-09-12T01:22:15.543860+0000","last_active":"2024-09-12T01:22:15.543860+0000","last_peered":"2024-09-12T01:22:15.543860+0000","last_clean":"2024-09-12T01:22:15.543860+0000","last_became_active":"2024-09-12T00:35:43.942199+0000","last_became_peered":"2024-09-12T00:35:43.942199+0000","last_unstale":"2024-09-12T01:22:15.543860+0000","last_undegraded":"2024-09-12T01:22:15.543860+0000","last_fullsized":"2024-09-12T01:22:15.543860+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'395","last_scrub_stamp":"2024-09-12T01:22:15.543686+0000","last_deep_scrub":"265'395","last_deep_scrub_stamp":"2024-09-12T01:22:15.543686+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.543686+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:08.555732+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":650,"num_read_kb":42927,"num_write":1209,"num_write_kb":42524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'254","reported_seq":925,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:23.654827+0000","last_change":"2024-09-12T01:22:23.654827+0000","last_active":"2024-09-12T01:22:23.654827+0000","last_peered":"2024-09-12T01:22:23.654827+0000","last_clean":"2024-09-12T01:22:23.654827+0000","last_became_active":"2024-09-12T00:35:45.937211+0000","last_became_peered":"2024-09-12T00:35:45.937211+0000","last_unstale":"2024-09-12T01:22:23.654827+0000","last_undegraded":"2024-09-12T01:22:23.654827+0000","last_fullsized":"2024-09-12T01:22:23.654827+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'254","last_scrub_stamp":"2024-09-12T01:22:23.654583+0000","last_deep_scrub":"265'254","last_deep_scrub_stamp":"2024-09-12T01:22:23.654583+0000","last_clean_scrub_stamp":"2024-09-12T01:22:23.654583+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:22.042826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1131,"num_read_kb":929,"num_write":387,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'365","reported_seq":1056,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.610299+0000","last_change":"2024-09-12T01:22:15.610299+0000","last_active":"2024-09-12T01:22:15.610299+0000","last_peered":"2024-09-12T01:22:15.610299+0000","last_clean":"2024-09-12T01:22:15.610299+0000","last_became_active":"2024-09-12T00:35:43.918653+0000","last_became_peered":"2024-09-12T00:35:43.918653+0000","last_unstale":"2024-09-12T01:22:15.610299+0000","last_undegraded":"2024-09-12T01:22:15.610299+0000","last_fullsized":"2024-09-12T01:22:15.610299+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T01:22:15.610082+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T01:22:15.610082+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.610082+0000","objects_scrubbed":8,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:31.364055+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262196,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":641,"num_read_kb":7519,"num_write":1239,"num_write_kb":32586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'269","reported_seq":937,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.447841+0000","last_change":"2024-09-12T01:22:10.447841+0000","last_active":"2024-09-12T01:22:10.447841+0000","last_peered":"2024-09-12T01:22:10.447841+0000","last_clean":"2024-09-12T01:22:10.447841+0000","last_became_active":"2024-09-12T00:35:45.941814+0000","last_became_peered":"2024-09-12T00:35:45.941814+0000","last_unstale":"2024-09-12T01:22:10.447841+0000","last_undegraded":"2024-09-12T01:22:10.447841+0000","last_fullsized":"2024-09-12T01:22:10.447841+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'269","last_scrub_stamp":"2024-09-12T01:22:10.447618+0000","last_deep_scrub":"265'269","last_deep_scrub_stamp":"2024-09-12T01:22:10.447618+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.447618+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:20.433161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1198,"num_read_kb":983,"num_write":434,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'104","reported_seq":687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.952536+0000","last_change":"2024-09-12T01:22:20.952362+0000","last_active":"2024-09-12T01:22:20.952536+0000","last_peered":"2024-09-12T01:22:20.952536+0000","last_clean":"2024-09-12T01:22:20.952536+0000","last_became_active":"2024-09-12T00:35:45.929168+0000","last_became_peered":"2024-09-12T00:35:45.929168+0000","last_unstale":"2024-09-12T01:22:20.952536+0000","last_undegraded":"2024-09-12T01:22:20.952536+0000","last_fullsized":"2024-09-12T01:22:20.952536+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'104","last_scrub_stamp":"2024-09-12T01:22:20.952183+0000","last_deep_scrub":"265'104","last_deep_scrub_stamp":"2024-09-12T01:22:20.952183+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.952183+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:31.113426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":468,"num_read_kb":393,"num_write":157,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'374","reported_seq":1031,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.525467+0000","last_change":"2024-09-12T01:22:14.525467+0000","last_active":"2024-09-12T01:22:14.525467+0000","last_peered":"2024-09-12T01:22:14.525467+0000","last_clean":"2024-09-12T01:22:14.525467+0000","last_became_active":"2024-09-12T00:35:43.949857+0000","last_became_peered":"2024-09-12T00:35:43.949857+0000","last_unstale":"2024-09-12T01:22:14.525467+0000","last_undegraded":"2024-09-12T01:22:14.525467+0000","last_fullsized":"2024-09-12T01:22:14.525467+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T01:22:14.525234+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T01:22:14.525234+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.525234+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:51.992259+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":541,"num_read_kb":3399,"num_write":1114,"num_write_kb":43442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'111","reported_seq":693,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.429442+0000","last_change":"2024-09-12T01:22:19.429285+0000","last_active":"2024-09-12T01:22:19.429442+0000","last_peered":"2024-09-12T01:22:19.429442+0000","last_clean":"2024-09-12T01:22:19.429442+0000","last_became_active":"2024-09-12T00:35:45.947366+0000","last_became_peered":"2024-09-12T00:35:45.947366+0000","last_unstale":"2024-09-12T01:22:19.429442+0000","last_undegraded":"2024-09-12T01:22:19.429442+0000","last_fullsized":"2024-09-12T01:22:19.429442+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'111","last_scrub_stamp":"2024-09-12T01:22:19.429104+0000","last_deep_scrub":"265'111","last_deep_scrub_stamp":"2024-09-12T01:22:19.429104+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.429104+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:52.961560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":482,"num_read_kb":394,"num_write":173,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'368","reported_seq":1051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.214862+0000","last_change":"2024-09-12T01:22:12.214862+0000","last_active":"2024-09-12T01:22:12.214862+0000","last_peered":"2024-09-12T01:22:12.214862+0000","last_clean":"2024-09-12T01:22:12.214862+0000","last_became_active":"2024-09-12T00:35:43.926027+0000","last_became_peered":"2024-09-12T00:35:43.926027+0000","last_unstale":"2024-09-12T01:22:12.214862+0000","last_undegraded":"2024-09-12T01:22:12.214862+0000","last_fullsized":"2024-09-12T01:22:12.214862+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'368","last_scrub_stamp":"2024-09-12T01:22:12.214580+0000","last_deep_scrub":"265'368","last_deep_scrub_stamp":"2024-09-12T01:22:12.214580+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.214580+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:50.008326+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":574,"num_read_kb":69210,"num_write":1266,"num_write_kb":64702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'169","reported_seq":786,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.751016+0000","last_change":"2024-09-12T01:22:20.750840+0000","last_active":"2024-09-12T01:22:20.751016+0000","last_peered":"2024-09-12T01:22:20.751016+0000","last_clean":"2024-09-12T01:22:20.751016+0000","last_became_active":"2024-09-12T00:35:45.932116+0000","last_became_peered":"2024-09-12T00:35:45.932116+0000","last_unstale":"2024-09-12T01:22:20.751016+0000","last_undegraded":"2024-09-12T01:22:20.751016+0000","last_fullsized":"2024-09-12T01:22:20.751016+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'169","last_scrub_stamp":"2024-09-12T01:22:20.750664+0000","last_deep_scrub":"265'169","last_deep_scrub_stamp":"2024-09-12T01:22:20.750664+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.750664+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:56.693844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":828,"num_read_kb":701,"num_write":304,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'373","reported_seq":1069,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.243782+0000","last_change":"2024-09-12T01:22:11.243782+0000","last_active":"2024-09-12T01:22:11.243782+0000","last_peered":"2024-09-12T01:22:11.243782+0000","last_clean":"2024-09-12T01:22:11.243782+0000","last_became_active":"2024-09-12T00:36:17.045217+0000","last_became_peered":"2024-09-12T00:36:17.045217+0000","last_unstale":"2024-09-12T01:22:11.243782+0000","last_undegraded":"2024-09-12T01:22:11.243782+0000","last_fullsized":"2024-09-12T01:22:11.243782+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T01:22:11.243529+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T01:22:11.243529+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.243529+0000","objects_scrubbed":8,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:11.316579+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460235,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":599,"num_read_kb":9912,"num_write":1094,"num_write_kb":33583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'100","reported_seq":659,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.371858+0000","last_change":"2024-09-12T01:22:12.371858+0000","last_active":"2024-09-12T01:22:12.371858+0000","last_peered":"2024-09-12T01:22:12.371858+0000","last_clean":"2024-09-12T01:22:12.371858+0000","last_became_active":"2024-09-12T00:35:45.939261+0000","last_became_peered":"2024-09-12T00:35:45.939261+0000","last_unstale":"2024-09-12T01:22:12.371858+0000","last_undegraded":"2024-09-12T01:22:12.371858+0000","last_fullsized":"2024-09-12T01:22:12.371858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'100","last_scrub_stamp":"2024-09-12T01:22:12.371622+0000","last_deep_scrub":"265'100","last_deep_scrub_stamp":"2024-09-12T01:22:12.371622+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.371622+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:46.453737+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":439,"num_read_kb":359,"num_write":158,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'344","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.047647+0000","last_change":"2024-09-12T01:22:08.047647+0000","last_active":"2024-09-12T01:22:08.047647+0000","last_peered":"2024-09-12T01:22:08.047647+0000","last_clean":"2024-09-12T01:22:08.047647+0000","last_became_active":"2024-09-12T00:35:43.949045+0000","last_became_peered":"2024-09-12T00:35:43.949045+0000","last_unstale":"2024-09-12T01:22:08.047647+0000","last_undegraded":"2024-09-12T01:22:08.047647+0000","last_fullsized":"2024-09-12T01:22:08.047647+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'344","last_scrub_stamp":"2024-09-12T01:22:08.047386+0000","last_deep_scrub":"265'344","last_deep_scrub_stamp":"2024-09-12T01:22:08.047386+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.047386+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:24.278106+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289432,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":556,"num_read_kb":18745,"num_write":1038,"num_write_kb":46080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'126","reported_seq":733,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.474888+0000","last_change":"2024-09-12T01:22:06.474888+0000","last_active":"2024-09-12T01:22:06.474888+0000","last_peered":"2024-09-12T01:22:06.474888+0000","last_clean":"2024-09-12T01:22:06.474888+0000","last_became_active":"2024-09-12T00:35:45.942814+0000","last_became_peered":"2024-09-12T00:35:45.942814+0000","last_unstale":"2024-09-12T01:22:06.474888+0000","last_undegraded":"2024-09-12T01:22:06.474888+0000","last_fullsized":"2024-09-12T01:22:06.474888+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'126","last_scrub_stamp":"2024-09-12T01:22:06.474688+0000","last_deep_scrub":"265'126","last_deep_scrub_stamp":"2024-09-12T01:22:06.474688+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.474688+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:09.883585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":574,"num_read_kb":483,"num_write":214,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'325","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.633517+0000","last_change":"2024-09-12T01:22:12.633517+0000","last_active":"2024-09-12T01:22:12.633517+0000","last_peered":"2024-09-12T01:22:12.633517+0000","last_clean":"2024-09-12T01:22:12.633517+0000","last_became_active":"2024-09-12T00:35:43.939128+0000","last_became_peered":"2024-09-12T00:35:43.939128+0000","last_unstale":"2024-09-12T01:22:12.633517+0000","last_undegraded":"2024-09-12T01:22:12.633517+0000","last_fullsized":"2024-09-12T01:22:12.633517+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'325","last_scrub_stamp":"2024-09-12T01:22:12.633317+0000","last_deep_scrub":"265'325","last_deep_scrub_stamp":"2024-09-12T01:22:12.633317+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.633317+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:15.440772+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":453,"num_read_kb":9693,"num_write":1061,"num_write_kb":13466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'4124","reported_seq":4728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.894824+0000","last_change":"2024-09-12T01:22:22.894824+0000","last_active":"2024-09-12T01:22:22.894824+0000","last_peered":"2024-09-12T01:22:22.894824+0000","last_clean":"2024-09-12T01:22:22.894824+0000","last_became_active":"2024-09-12T00:35:45.943253+0000","last_became_peered":"2024-09-12T00:35:45.943253+0000","last_unstale":"2024-09-12T01:22:22.894824+0000","last_undegraded":"2024-09-12T01:22:22.894824+0000","last_fullsized":"2024-09-12T01:22:22.894824+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4124","last_scrub_stamp":"2024-09-12T01:22:22.894642+0000","last_deep_scrub":"265'4124","last_deep_scrub_stamp":"2024-09-12T01:22:22.894642+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.894642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:05.132607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16581,"num_read_kb":13903,"num_write":6185,"num_write_kb":3084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'358","reported_seq":1028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.573973+0000","last_change":"2024-09-12T01:22:10.573810+0000","last_active":"2024-09-12T01:22:10.573973+0000","last_peered":"2024-09-12T01:22:10.573973+0000","last_clean":"2024-09-12T01:22:10.573973+0000","last_became_active":"2024-09-12T00:35:43.933191+0000","last_became_peered":"2024-09-12T00:35:43.933191+0000","last_unstale":"2024-09-12T01:22:10.573973+0000","last_undegraded":"2024-09-12T01:22:10.573973+0000","last_fullsized":"2024-09-12T01:22:10.573973+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T01:22:10.573611+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T01:22:10.573611+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.573611+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:05.894738+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":549,"num_read_kb":44649,"num_write":1012,"num_write_kb":28437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'151","reported_seq":674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:38.865862+0000","last_change":"2024-09-12T01:22:38.865862+0000","last_active":"2024-09-12T01:22:38.865862+0000","last_peered":"2024-09-12T01:22:38.865862+0000","last_clean":"2024-09-12T01:22:38.865862+0000","last_became_active":"2024-09-12T00:35:53.981609+0000","last_became_peered":"2024-09-12T00:35:53.981609+0000","last_unstale":"2024-09-12T01:22:38.865862+0000","last_undegraded":"2024-09-12T01:22:38.865862+0000","last_fullsized":"2024-09-12T01:22:38.865862+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'151","last_scrub_stamp":"2024-09-12T01:22:38.865633+0000","last_deep_scrub":"265'151","last_deep_scrub_stamp":"2024-09-12T01:22:38.865633+0000","last_clean_scrub_stamp":"2024-09-12T01:22:38.865633+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:44.587924+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":187,"num_read_kb":176,"num_write":375,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'259","reported_seq":911,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.620747+0000","last_change":"2024-09-12T01:22:17.620618+0000","last_active":"2024-09-12T01:22:17.620747+0000","last_peered":"2024-09-12T01:22:17.620747+0000","last_clean":"2024-09-12T01:22:17.620747+0000","last_became_active":"2024-09-12T00:35:45.948575+0000","last_became_peered":"2024-09-12T00:35:45.948575+0000","last_unstale":"2024-09-12T01:22:17.620747+0000","last_undegraded":"2024-09-12T01:22:17.620747+0000","last_fullsized":"2024-09-12T01:22:17.620747+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'259","last_scrub_stamp":"2024-09-12T01:22:17.620446+0000","last_deep_scrub":"265'259","last_deep_scrub_stamp":"2024-09-12T01:22:17.620446+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.620446+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:30.407262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1199,"num_read_kb":1005,"num_write":430,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"265'290","reported_seq":896,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.507460+0000","last_change":"2024-09-12T01:22:12.507305+0000","last_active":"2024-09-12T01:22:12.507460+0000","last_peered":"2024-09-12T01:22:12.507460+0000","last_clean":"2024-09-12T01:22:12.507460+0000","last_became_active":"2024-09-12T00:35:43.956812+0000","last_became_peered":"2024-09-12T00:35:43.956812+0000","last_unstale":"2024-09-12T01:22:12.507460+0000","last_undegraded":"2024-09-12T01:22:12.507460+0000","last_fullsized":"2024-09-12T01:22:12.507460+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'290","last_scrub_stamp":"2024-09-12T01:22:12.507085+0000","last_deep_scrub":"265'290","last_deep_scrub_stamp":"2024-09-12T01:22:12.507085+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.507085+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:34.635767+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":413,"num_read_kb":399,"num_write":958,"num_write_kb":26614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:26.662866+0000","last_change":"2024-09-12T01:22:26.662866+0000","last_active":"2024-09-12T01:22:26.662866+0000","last_peered":"2024-09-12T01:22:26.662866+0000","last_clean":"2024-09-12T01:22:26.662866+0000","last_became_active":"2024-09-12T00:35:47.933249+0000","last_became_peered":"2024-09-12T00:35:47.933249+0000","last_unstale":"2024-09-12T01:22:26.662866+0000","last_undegraded":"2024-09-12T01:22:26.662866+0000","last_fullsized":"2024-09-12T01:22:26.662866+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:26.662691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:26.662691+0000","last_clean_scrub_stamp":"2024-09-12T01:22:26.662691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:33.845596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'344","reported_seq":960,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:26.488910+0000","last_change":"2024-09-12T01:22:26.488910+0000","last_active":"2024-09-12T01:22:26.488910+0000","last_peered":"2024-09-12T01:22:26.488910+0000","last_clean":"2024-09-12T01:22:26.488910+0000","last_became_active":"2024-09-12T00:35:49.951438+0000","last_became_peered":"2024-09-12T00:35:49.951438+0000","last_unstale":"2024-09-12T01:22:26.488910+0000","last_undegraded":"2024-09-12T01:22:26.488910+0000","last_fullsized":"2024-09-12T01:22:26.488910+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'344","last_scrub_stamp":"2024-09-12T01:22:26.488626+0000","last_deep_scrub":"265'344","last_deep_scrub_stamp":"2024-09-12T01:22:26.488626+0000","last_clean_scrub_stamp":"2024-09-12T01:22:26.488626+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:38.093876+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44615,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":554,"num_read_kb":1150,"num_write":438,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:35.418249+0000","last_change":"2024-09-12T01:22:35.418249+0000","last_active":"2024-09-12T01:22:35.418249+0000","last_peered":"2024-09-12T01:22:35.418249+0000","last_clean":"2024-09-12T01:22:35.418249+0000","last_became_active":"2024-09-12T00:35:51.984350+0000","last_became_peered":"2024-09-12T00:35:51.984350+0000","last_unstale":"2024-09-12T01:22:35.418249+0000","last_undegraded":"2024-09-12T01:22:35.418249+0000","last_fullsized":"2024-09-12T01:22:35.418249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:35.418076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:35.418076+0000","last_clean_scrub_stamp":"2024-09-12T01:22:35.418076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:53.339786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'206","reported_seq":813,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:39.554559+0000","last_change":"2024-09-12T01:22:39.554559+0000","last_active":"2024-09-12T01:22:39.554559+0000","last_peered":"2024-09-12T01:22:39.554559+0000","last_clean":"2024-09-12T01:22:39.554559+0000","last_became_active":"2024-09-12T00:35:53.995513+0000","last_became_peered":"2024-09-12T00:35:53.995513+0000","last_unstale":"2024-09-12T01:22:39.554559+0000","last_undegraded":"2024-09-12T01:22:39.554559+0000","last_fullsized":"2024-09-12T01:22:39.554559+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'206","last_scrub_stamp":"2024-09-12T01:22:39.554345+0000","last_deep_scrub":"265'206","last_deep_scrub_stamp":"2024-09-12T01:22:39.554345+0000","last_clean_scrub_stamp":"2024-09-12T01:22:39.554345+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:17.258884+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":409,"num_read_kb":360,"num_write":396,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'241","reported_seq":876,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.747102+0000","last_change":"2024-09-12T01:22:18.747102+0000","last_active":"2024-09-12T01:22:18.747102+0000","last_peered":"2024-09-12T01:22:18.747102+0000","last_clean":"2024-09-12T01:22:18.747102+0000","last_became_active":"2024-09-12T00:35:45.939962+0000","last_became_peered":"2024-09-12T00:35:45.939962+0000","last_unstale":"2024-09-12T01:22:18.747102+0000","last_undegraded":"2024-09-12T01:22:18.747102+0000","last_fullsized":"2024-09-12T01:22:18.747102+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'241","last_scrub_stamp":"2024-09-12T01:22:18.746925+0000","last_deep_scrub":"265'241","last_deep_scrub_stamp":"2024-09-12T01:22:18.746925+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.746925+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:11.880068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1036,"num_read_kb":844,"num_write":371,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'378","reported_seq":1091,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:02.751401+0000","last_change":"2024-09-12T01:22:02.751301+0000","last_active":"2024-09-12T01:22:02.751401+0000","last_peered":"2024-09-12T01:22:02.751401+0000","last_clean":"2024-09-12T01:22:02.751401+0000","last_became_active":"2024-09-12T00:35:43.944705+0000","last_became_peered":"2024-09-12T00:35:43.944705+0000","last_unstale":"2024-09-12T01:22:02.751401+0000","last_undegraded":"2024-09-12T01:22:02.751401+0000","last_fullsized":"2024-09-12T01:22:02.751401+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'378","last_scrub_stamp":"2024-09-12T01:22:02.751158+0000","last_deep_scrub":"265'378","last_deep_scrub_stamp":"2024-09-12T01:22:02.751158+0000","last_clean_scrub_stamp":"2024-09-12T01:22:02.751158+0000","objects_scrubbed":10,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:41.394968+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1344150,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":792,"num_read_kb":8209,"num_write":1184,"num_write_kb":28685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:26.485367+0000","last_change":"2024-09-12T01:22:26.485115+0000","last_active":"2024-09-12T01:22:26.485367+0000","last_peered":"2024-09-12T01:22:26.485367+0000","last_clean":"2024-09-12T01:22:26.485367+0000","last_became_active":"2024-09-12T00:35:47.945971+0000","last_became_peered":"2024-09-12T00:35:47.945971+0000","last_unstale":"2024-09-12T01:22:26.485367+0000","last_undegraded":"2024-09-12T01:22:26.485367+0000","last_fullsized":"2024-09-12T01:22:26.485367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:26.484886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:26.484886+0000","last_clean_scrub_stamp":"2024-09-12T01:22:26.484886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:48.584060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'97","reported_seq":637,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:30.939730+0000","last_change":"2024-09-12T01:22:30.939730+0000","last_active":"2024-09-12T01:22:30.939730+0000","last_peered":"2024-09-12T01:22:30.939730+0000","last_clean":"2024-09-12T01:22:30.939730+0000","last_became_active":"2024-09-12T00:35:49.938374+0000","last_became_peered":"2024-09-12T00:35:49.938374+0000","last_unstale":"2024-09-12T01:22:30.939730+0000","last_undegraded":"2024-09-12T01:22:30.939730+0000","last_fullsized":"2024-09-12T01:22:30.939730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'97","last_scrub_stamp":"2024-09-12T01:22:30.939542+0000","last_deep_scrub":"265'97","last_deep_scrub_stamp":"2024-09-12T01:22:30.939542+0000","last_clean_scrub_stamp":"2024-09-12T01:22:30.939542+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:36.378496+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:34.956608+0000","last_change":"2024-09-12T01:22:34.956608+0000","last_active":"2024-09-12T01:22:34.956608+0000","last_peered":"2024-09-12T01:22:34.956608+0000","last_clean":"2024-09-12T01:22:34.956608+0000","last_became_active":"2024-09-12T00:35:51.974659+0000","last_became_peered":"2024-09-12T00:35:51.974659+0000","last_unstale":"2024-09-12T01:22:34.956608+0000","last_undegraded":"2024-09-12T01:22:34.956608+0000","last_fullsized":"2024-09-12T01:22:34.956608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:34.956422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:34.956422+0000","last_clean_scrub_stamp":"2024-09-12T01:22:34.956422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:02.049351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'118","reported_seq":657,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:34.461563+0000","last_change":"2024-09-12T01:22:34.461563+0000","last_active":"2024-09-12T01:22:34.461563+0000","last_peered":"2024-09-12T01:22:34.461563+0000","last_clean":"2024-09-12T01:22:34.461563+0000","last_became_active":"2024-09-12T00:35:53.992311+0000","last_became_peered":"2024-09-12T00:35:53.992311+0000","last_unstale":"2024-09-12T01:22:34.461563+0000","last_undegraded":"2024-09-12T01:22:34.461563+0000","last_fullsized":"2024-09-12T01:22:34.461563+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'118","last_scrub_stamp":"2024-09-12T01:22:34.461375+0000","last_deep_scrub":"265'118","last_deep_scrub_stamp":"2024-09-12T01:22:34.461375+0000","last_clean_scrub_stamp":"2024-09-12T01:22:34.461375+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:20.457415+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":265,"num_read_kb":226,"num_write":268,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'268","reported_seq":921,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.573840+0000","last_change":"2024-09-12T01:22:15.573840+0000","last_active":"2024-09-12T01:22:15.573840+0000","last_peered":"2024-09-12T01:22:15.573840+0000","last_clean":"2024-09-12T01:22:15.573840+0000","last_became_active":"2024-09-12T00:35:45.941543+0000","last_became_peered":"2024-09-12T00:35:45.941543+0000","last_unstale":"2024-09-12T01:22:15.573840+0000","last_undegraded":"2024-09-12T01:22:15.573840+0000","last_fullsized":"2024-09-12T01:22:15.573840+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'268","last_scrub_stamp":"2024-09-12T01:22:15.573638+0000","last_deep_scrub":"265'268","last_deep_scrub_stamp":"2024-09-12T01:22:15.573638+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.573638+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:55.006640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1165,"num_read_kb":955,"num_write":416,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'393","reported_seq":1116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.480162+0000","last_change":"2024-09-12T01:22:11.480017+0000","last_active":"2024-09-12T01:22:11.480162+0000","last_peered":"2024-09-12T01:22:11.480162+0000","last_clean":"2024-09-12T01:22:11.480162+0000","last_became_active":"2024-09-12T00:35:43.952543+0000","last_became_peered":"2024-09-12T00:35:43.952543+0000","last_unstale":"2024-09-12T01:22:11.480162+0000","last_undegraded":"2024-09-12T01:22:11.480162+0000","last_fullsized":"2024-09-12T01:22:11.480162+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'393","last_scrub_stamp":"2024-09-12T01:22:11.479778+0000","last_deep_scrub":"265'393","last_deep_scrub_stamp":"2024-09-12T01:22:11.479778+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.479778+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:16.175100+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262200,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":772,"num_read_kb":780,"num_write":1221,"num_write_kb":19641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:27.520990+0000","last_change":"2024-09-12T01:22:27.520990+0000","last_active":"2024-09-12T01:22:27.520990+0000","last_peered":"2024-09-12T01:22:27.520990+0000","last_clean":"2024-09-12T01:22:27.520990+0000","last_became_active":"2024-09-12T00:35:47.933896+0000","last_became_peered":"2024-09-12T00:35:47.933896+0000","last_unstale":"2024-09-12T01:22:27.520990+0000","last_undegraded":"2024-09-12T01:22:27.520990+0000","last_fullsized":"2024-09-12T01:22:27.520990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:27.520810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:27.520810+0000","last_clean_scrub_stamp":"2024-09-12T01:22:27.520810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:28.480023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'120","reported_seq":671,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.374781+0000","last_change":"2024-09-12T01:22:18.374611+0000","last_active":"2024-09-12T01:22:18.374781+0000","last_peered":"2024-09-12T01:22:18.374781+0000","last_clean":"2024-09-12T01:22:18.374781+0000","last_became_active":"2024-09-12T00:35:49.936846+0000","last_became_peered":"2024-09-12T00:35:49.936846+0000","last_unstale":"2024-09-12T01:22:18.374781+0000","last_undegraded":"2024-09-12T01:22:18.374781+0000","last_fullsized":"2024-09-12T01:22:18.374781+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'120","last_scrub_stamp":"2024-09-12T01:22:18.374419+0000","last_deep_scrub":"265'120","last_deep_scrub_stamp":"2024-09-12T01:22:18.374419+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.374419+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:24.935816+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":139,"num_read_kb":131,"num_write":92,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'774","reported_seq":2297,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:34.414268+0000","last_change":"2024-09-12T01:22:34.414268+0000","last_active":"2024-09-12T01:22:34.414268+0000","last_peered":"2024-09-12T01:22:34.414268+0000","last_clean":"2024-09-12T01:22:34.414268+0000","last_became_active":"2024-09-12T00:35:51.979288+0000","last_became_peered":"2024-09-12T00:35:51.979288+0000","last_unstale":"2024-09-12T01:22:34.414268+0000","last_undegraded":"2024-09-12T01:22:34.414268+0000","last_fullsized":"2024-09-12T01:22:34.414268+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'774","last_scrub_stamp":"2024-09-12T01:22:34.414083+0000","last_deep_scrub":"265'774","last_deep_scrub_stamp":"2024-09-12T01:22:34.414083+0000","last_clean_scrub_stamp":"2024-09-12T01:22:34.414083+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:12.647174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'192","reported_seq":1024,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:39.899169+0000","last_change":"2024-09-12T01:22:39.899169+0000","last_active":"2024-09-12T01:22:39.899169+0000","last_peered":"2024-09-12T01:22:39.899169+0000","last_clean":"2024-09-12T01:22:39.899169+0000","last_became_active":"2024-09-12T00:35:54.013299+0000","last_became_peered":"2024-09-12T00:35:54.013299+0000","last_unstale":"2024-09-12T01:22:39.899169+0000","last_undegraded":"2024-09-12T01:22:39.899169+0000","last_fullsized":"2024-09-12T01:22:39.899169+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'192","last_scrub_stamp":"2024-09-12T01:22:39.898987+0000","last_deep_scrub":"265'192","last_deep_scrub_stamp":"2024-09-12T01:22:39.898987+0000","last_clean_scrub_stamp":"2024-09-12T01:22:39.898987+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:19.052550+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":837,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":580,"num_read_kb":578,"num_write":407,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'105","reported_seq":685,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.602937+0000","last_change":"2024-09-12T01:22:19.602937+0000","last_active":"2024-09-12T01:22:19.602937+0000","last_peered":"2024-09-12T01:22:19.602937+0000","last_clean":"2024-09-12T01:22:19.602937+0000","last_became_active":"2024-09-12T00:35:45.954858+0000","last_became_peered":"2024-09-12T00:35:45.954858+0000","last_unstale":"2024-09-12T01:22:19.602937+0000","last_undegraded":"2024-09-12T01:22:19.602937+0000","last_fullsized":"2024-09-12T01:22:19.602937+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'105","last_scrub_stamp":"2024-09-12T01:22:19.602704+0000","last_deep_scrub":"265'105","last_deep_scrub_stamp":"2024-09-12T01:22:19.602704+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.602704+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:45.698367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":470,"num_read_kb":391,"num_write":166,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'358","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.148076+0000","last_change":"2024-09-12T01:22:06.147932+0000","last_active":"2024-09-12T01:22:06.148076+0000","last_peered":"2024-09-12T01:22:06.148076+0000","last_clean":"2024-09-12T01:22:06.148076+0000","last_became_active":"2024-09-12T00:35:43.930867+0000","last_became_peered":"2024-09-12T00:35:43.930867+0000","last_unstale":"2024-09-12T01:22:06.148076+0000","last_undegraded":"2024-09-12T01:22:06.148076+0000","last_fullsized":"2024-09-12T01:22:06.148076+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T01:22:06.147754+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T01:22:06.147754+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.147754+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:37.175214+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291487,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":529,"num_read_kb":73816,"num_write":1070,"num_write_kb":41341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:27.679002+0000","last_change":"2024-09-12T01:22:27.679002+0000","last_active":"2024-09-12T01:22:27.679002+0000","last_peered":"2024-09-12T01:22:27.679002+0000","last_clean":"2024-09-12T01:22:27.679002+0000","last_became_active":"2024-09-12T00:35:47.930883+0000","last_became_peered":"2024-09-12T00:35:47.930883+0000","last_unstale":"2024-09-12T01:22:27.679002+0000","last_undegraded":"2024-09-12T01:22:27.679002+0000","last_fullsized":"2024-09-12T01:22:27.679002+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:27.678814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:27.678814+0000","last_clean_scrub_stamp":"2024-09-12T01:22:27.678814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:33.971827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'294","reported_seq":874,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:32.456344+0000","last_change":"2024-09-12T01:22:32.456344+0000","last_active":"2024-09-12T01:22:32.456344+0000","last_peered":"2024-09-12T01:22:32.456344+0000","last_clean":"2024-09-12T01:22:32.456344+0000","last_became_active":"2024-09-12T00:35:50.029236+0000","last_became_peered":"2024-09-12T00:35:50.029236+0000","last_unstale":"2024-09-12T01:22:32.456344+0000","last_undegraded":"2024-09-12T01:22:32.456344+0000","last_fullsized":"2024-09-12T01:22:32.456344+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'294","last_scrub_stamp":"2024-09-12T01:22:32.456135+0000","last_deep_scrub":"265'294","last_deep_scrub_stamp":"2024-09-12T01:22:32.456135+0000","last_clean_scrub_stamp":"2024-09-12T01:22:32.456135+0000","objects_scrubbed":5,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:06.127377+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54671,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":1128,"num_write":386,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'787","reported_seq":2340,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:39.692615+0000","last_change":"2024-09-12T01:22:39.692615+0000","last_active":"2024-09-12T01:22:39.692615+0000","last_peered":"2024-09-12T01:22:39.692615+0000","last_clean":"2024-09-12T01:22:39.692615+0000","last_became_active":"2024-09-12T00:35:51.983271+0000","last_became_peered":"2024-09-12T00:35:51.983271+0000","last_unstale":"2024-09-12T01:22:39.692615+0000","last_undegraded":"2024-09-12T01:22:39.692615+0000","last_fullsized":"2024-09-12T01:22:39.692615+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'787","last_scrub_stamp":"2024-09-12T01:22:39.692436+0000","last_deep_scrub":"265'787","last_deep_scrub_stamp":"2024-09-12T01:22:39.692436+0000","last_clean_scrub_stamp":"2024-09-12T01:22:39.692436+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:11.098708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'260","reported_seq":940,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.783023+0000","last_change":"2024-09-12T01:22:17.783023+0000","last_active":"2024-09-12T01:22:17.783023+0000","last_peered":"2024-09-12T01:22:17.783023+0000","last_clean":"2024-09-12T01:22:17.783023+0000","last_became_active":"2024-09-12T00:35:45.940073+0000","last_became_peered":"2024-09-12T00:35:45.940073+0000","last_unstale":"2024-09-12T01:22:17.783023+0000","last_undegraded":"2024-09-12T01:22:17.783023+0000","last_fullsized":"2024-09-12T01:22:17.783023+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'260","last_scrub_stamp":"2024-09-12T01:22:17.782804+0000","last_deep_scrub":"265'260","last_deep_scrub_stamp":"2024-09-12T01:22:17.782804+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.782804+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:47.983931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1192,"num_read_kb":982,"num_write":401,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'356","reported_seq":1073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.438750+0000","last_change":"2024-09-12T01:22:09.438750+0000","last_active":"2024-09-12T01:22:09.438750+0000","last_peered":"2024-09-12T01:22:09.438750+0000","last_clean":"2024-09-12T01:22:09.438750+0000","last_became_active":"2024-09-12T00:35:43.956814+0000","last_became_peered":"2024-09-12T00:35:43.956814+0000","last_unstale":"2024-09-12T01:22:09.438750+0000","last_undegraded":"2024-09-12T01:22:09.438750+0000","last_fullsized":"2024-09-12T01:22:09.438750+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T01:22:09.438513+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T01:22:09.438513+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.438513+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:18.913267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":767,"num_read_kb":6356,"num_write":996,"num_write_kb":17273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:23.361207+0000","last_change":"2024-09-12T01:22:23.361207+0000","last_active":"2024-09-12T01:22:23.361207+0000","last_peered":"2024-09-12T01:22:23.361207+0000","last_clean":"2024-09-12T01:22:23.361207+0000","last_became_active":"2024-09-12T00:35:47.944913+0000","last_became_peered":"2024-09-12T00:35:47.944913+0000","last_unstale":"2024-09-12T01:22:23.361207+0000","last_undegraded":"2024-09-12T01:22:23.361207+0000","last_fullsized":"2024-09-12T01:22:23.361207+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:23.360974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:23.360974+0000","last_clean_scrub_stamp":"2024-09-12T01:22:23.360974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:40.017227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'358","reported_seq":981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:30.677483+0000","last_change":"2024-09-12T01:22:30.677483+0000","last_active":"2024-09-12T01:22:30.677483+0000","last_peered":"2024-09-12T01:22:30.677483+0000","last_clean":"2024-09-12T01:22:30.677483+0000","last_became_active":"2024-09-12T00:35:50.027282+0000","last_became_peered":"2024-09-12T00:35:50.027282+0000","last_unstale":"2024-09-12T01:22:30.677483+0000","last_undegraded":"2024-09-12T01:22:30.677483+0000","last_fullsized":"2024-09-12T01:22:30.677483+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T01:22:30.677282+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T01:22:30.677282+0000","last_clean_scrub_stamp":"2024-09-12T01:22:30.677282+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:10.624962+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45216,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":563,"num_read_kb":1133,"num_write":440,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:26.211253+0000","last_change":"2024-09-12T01:22:26.211253+0000","last_active":"2024-09-12T01:22:26.211253+0000","last_peered":"2024-09-12T01:22:26.211253+0000","last_clean":"2024-09-12T01:22:26.211253+0000","last_became_active":"2024-09-12T00:35:51.971491+0000","last_became_peered":"2024-09-12T00:35:51.971491+0000","last_unstale":"2024-09-12T01:22:26.211253+0000","last_undegraded":"2024-09-12T01:22:26.211253+0000","last_fullsized":"2024-09-12T01:22:26.211253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:26.211085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:26.211085+0000","last_clean_scrub_stamp":"2024-09-12T01:22:26.211085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:51.214576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'559","reported_seq":1382,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:35.568496+0000","last_change":"2024-09-12T01:22:35.568496+0000","last_active":"2024-09-12T01:22:35.568496+0000","last_peered":"2024-09-12T01:22:35.568496+0000","last_clean":"2024-09-12T01:22:35.568496+0000","last_became_active":"2024-09-12T00:35:53.996514+0000","last_became_peered":"2024-09-12T00:35:53.996514+0000","last_unstale":"2024-09-12T01:22:35.568496+0000","last_undegraded":"2024-09-12T01:22:35.568496+0000","last_fullsized":"2024-09-12T01:22:35.568496+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'559","last_scrub_stamp":"2024-09-12T01:22:35.568268+0000","last_deep_scrub":"265'559","last_deep_scrub_stamp":"2024-09-12T01:22:35.568268+0000","last_clean_scrub_stamp":"2024-09-12T01:22:35.568268+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:59.901744+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1307,"num_read_kb":1296,"num_write":1166,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'136","reported_seq":748,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.018297+0000","last_change":"2024-09-12T01:22:10.018297+0000","last_active":"2024-09-12T01:22:10.018297+0000","last_peered":"2024-09-12T01:22:10.018297+0000","last_clean":"2024-09-12T01:22:10.018297+0000","last_became_active":"2024-09-12T00:35:45.943083+0000","last_became_peered":"2024-09-12T00:35:45.943083+0000","last_unstale":"2024-09-12T01:22:10.018297+0000","last_undegraded":"2024-09-12T01:22:10.018297+0000","last_fullsized":"2024-09-12T01:22:10.018297+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'136","last_scrub_stamp":"2024-09-12T01:22:10.018112+0000","last_deep_scrub":"265'136","last_deep_scrub_stamp":"2024-09-12T01:22:10.018112+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.018112+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:19.240513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":650,"num_read_kb":541,"num_write":222,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'345","reported_seq":996,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.455546+0000","last_change":"2024-09-12T01:22:08.455546+0000","last_active":"2024-09-12T01:22:08.455546+0000","last_peered":"2024-09-12T01:22:08.455546+0000","last_clean":"2024-09-12T01:22:08.455546+0000","last_became_active":"2024-09-12T00:35:43.953664+0000","last_became_peered":"2024-09-12T00:35:43.953664+0000","last_unstale":"2024-09-12T01:22:08.455546+0000","last_undegraded":"2024-09-12T01:22:08.455546+0000","last_fullsized":"2024-09-12T01:22:08.455546+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'345","last_scrub_stamp":"2024-09-12T01:22:08.455336+0000","last_deep_scrub":"265'345","last_deep_scrub_stamp":"2024-09-12T01:22:08.455336+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.455336+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:59.956866+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288989,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":479,"num_read_kb":49556,"num_write":1051,"num_write_kb":45556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.362512+0000","last_change":"2024-09-12T01:22:16.362512+0000","last_active":"2024-09-12T01:22:16.362512+0000","last_peered":"2024-09-12T01:22:16.362512+0000","last_clean":"2024-09-12T01:22:16.362512+0000","last_became_active":"2024-09-12T00:35:47.936972+0000","last_became_peered":"2024-09-12T00:35:47.936972+0000","last_unstale":"2024-09-12T01:22:16.362512+0000","last_undegraded":"2024-09-12T01:22:16.362512+0000","last_fullsized":"2024-09-12T01:22:16.362512+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:16.362319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:16.362319+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.362319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:40.167192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'271","reported_seq":851,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:29.582048+0000","last_change":"2024-09-12T01:22:29.582048+0000","last_active":"2024-09-12T01:22:29.582048+0000","last_peered":"2024-09-12T01:22:29.582048+0000","last_clean":"2024-09-12T01:22:29.582048+0000","last_became_active":"2024-09-12T00:35:49.954568+0000","last_became_peered":"2024-09-12T00:35:49.954568+0000","last_unstale":"2024-09-12T01:22:29.582048+0000","last_undegraded":"2024-09-12T01:22:29.582048+0000","last_fullsized":"2024-09-12T01:22:29.582048+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'271","last_scrub_stamp":"2024-09-12T01:22:29.581862+0000","last_deep_scrub":"265'271","last_deep_scrub_stamp":"2024-09-12T01:22:29.581862+0000","last_clean_scrub_stamp":"2024-09-12T01:22:29.581862+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:38.518669+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45999,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":441,"num_read_kb":1004,"num_write":356,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:36.620871+0000","last_change":"2024-09-12T01:22:36.620871+0000","last_active":"2024-09-12T01:22:36.620871+0000","last_peered":"2024-09-12T01:22:36.620871+0000","last_clean":"2024-09-12T01:22:36.620871+0000","last_became_active":"2024-09-12T00:35:51.981326+0000","last_became_peered":"2024-09-12T00:35:51.981326+0000","last_unstale":"2024-09-12T01:22:36.620871+0000","last_undegraded":"2024-09-12T01:22:36.620871+0000","last_fullsized":"2024-09-12T01:22:36.620871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:36.620663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:36.620663+0000","last_clean_scrub_stamp":"2024-09-12T01:22:36.620663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:23.602336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'2396","reported_seq":4238,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:27.139385+0000","last_change":"2024-09-12T01:22:27.139385+0000","last_active":"2024-09-12T01:22:27.139385+0000","last_peered":"2024-09-12T01:22:27.139385+0000","last_clean":"2024-09-12T01:22:27.139385+0000","last_became_active":"2024-09-12T00:35:53.975054+0000","last_became_peered":"2024-09-12T00:35:53.975054+0000","last_unstale":"2024-09-12T01:22:27.139385+0000","last_undegraded":"2024-09-12T01:22:27.139385+0000","last_fullsized":"2024-09-12T01:22:27.139385+0000","mapping_epoch":34,"log_start":"265'2300","ondisk_log_start":"265'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2396","last_scrub_stamp":"2024-09-12T01:22:27.139196+0000","last_deep_scrub":"265'2396","last_deep_scrub_stamp":"2024-09-12T01:22:27.139196+0000","last_clean_scrub_stamp":"2024-09-12T01:22:27.139196+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":2300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:34.088010+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6031,"num_read_kb":6023,"num_write":4852,"num_write_kb":1786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'134","reported_seq":758,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.095091+0000","last_change":"2024-09-12T01:22:20.095091+0000","last_active":"2024-09-12T01:22:20.095091+0000","last_peered":"2024-09-12T01:22:20.095091+0000","last_clean":"2024-09-12T01:22:20.095091+0000","last_became_active":"2024-09-12T00:35:45.953664+0000","last_became_peered":"2024-09-12T00:35:45.953664+0000","last_unstale":"2024-09-12T01:22:20.095091+0000","last_undegraded":"2024-09-12T01:22:20.095091+0000","last_fullsized":"2024-09-12T01:22:20.095091+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'134","last_scrub_stamp":"2024-09-12T01:22:20.094911+0000","last_deep_scrub":"265'134","last_deep_scrub_stamp":"2024-09-12T01:22:20.094911+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.094911+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:20.389870+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":607,"num_read_kb":511,"num_write":198,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'330","reported_seq":1040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.446889+0000","last_change":"2024-09-12T01:22:10.446889+0000","last_active":"2024-09-12T01:22:10.446889+0000","last_peered":"2024-09-12T01:22:10.446889+0000","last_clean":"2024-09-12T01:22:10.446889+0000","last_became_active":"2024-09-12T00:35:43.942454+0000","last_became_peered":"2024-09-12T00:35:43.942454+0000","last_unstale":"2024-09-12T01:22:10.446889+0000","last_undegraded":"2024-09-12T01:22:10.446889+0000","last_fullsized":"2024-09-12T01:22:10.446889+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'330","last_scrub_stamp":"2024-09-12T01:22:10.446675+0000","last_deep_scrub":"265'330","last_deep_scrub_stamp":"2024-09-12T01:22:10.446675+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.446675+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:23.036504+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":618,"num_read_kb":3434,"num_write":1027,"num_write_kb":23754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.382878+0000","last_change":"2024-09-12T01:22:13.382878+0000","last_active":"2024-09-12T01:22:13.382878+0000","last_peered":"2024-09-12T01:22:13.382878+0000","last_clean":"2024-09-12T01:22:13.382878+0000","last_became_active":"2024-09-12T00:35:47.942189+0000","last_became_peered":"2024-09-12T00:35:47.942189+0000","last_unstale":"2024-09-12T01:22:13.382878+0000","last_undegraded":"2024-09-12T01:22:13.382878+0000","last_fullsized":"2024-09-12T01:22:13.382878+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:13.382636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:13.382636+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.382636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:49.972499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'327","reported_seq":930,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:28.329109+0000","last_change":"2024-09-12T01:22:28.329109+0000","last_active":"2024-09-12T01:22:28.329109+0000","last_peered":"2024-09-12T01:22:28.329109+0000","last_clean":"2024-09-12T01:22:28.329109+0000","last_became_active":"2024-09-12T00:35:49.942480+0000","last_became_peered":"2024-09-12T00:35:49.942480+0000","last_unstale":"2024-09-12T01:22:28.329109+0000","last_undegraded":"2024-09-12T01:22:28.329109+0000","last_fullsized":"2024-09-12T01:22:28.329109+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'327","last_scrub_stamp":"2024-09-12T01:22:28.328925+0000","last_deep_scrub":"265'327","last_deep_scrub_stamp":"2024-09-12T01:22:28.328925+0000","last_clean_scrub_stamp":"2024-09-12T01:22:28.328925+0000","objects_scrubbed":9,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:14.895378+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48782,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":529,"num_read_kb":1149,"num_write":428,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'773","reported_seq":2446,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:30.491240+0000","last_change":"2024-09-12T01:22:30.491240+0000","last_active":"2024-09-12T01:22:30.491240+0000","last_peered":"2024-09-12T01:22:30.491240+0000","last_clean":"2024-09-12T01:22:30.491240+0000","last_became_active":"2024-09-12T00:35:51.984968+0000","last_became_peered":"2024-09-12T00:35:51.984968+0000","last_unstale":"2024-09-12T01:22:30.491240+0000","last_undegraded":"2024-09-12T01:22:30.491240+0000","last_fullsized":"2024-09-12T01:22:30.491240+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'773","last_scrub_stamp":"2024-09-12T01:22:30.491048+0000","last_deep_scrub":"265'773","last_deep_scrub_stamp":"2024-09-12T01:22:30.491048+0000","last_clean_scrub_stamp":"2024-09-12T01:22:30.491048+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:09.682841+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'109","reported_seq":608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:37.466320+0000","last_change":"2024-09-12T01:22:37.466320+0000","last_active":"2024-09-12T01:22:37.466320+0000","last_peered":"2024-09-12T01:22:37.466320+0000","last_clean":"2024-09-12T01:22:37.466320+0000","last_became_active":"2024-09-12T00:35:53.992664+0000","last_became_peered":"2024-09-12T00:35:53.992664+0000","last_unstale":"2024-09-12T01:22:37.466320+0000","last_undegraded":"2024-09-12T01:22:37.466320+0000","last_fullsized":"2024-09-12T01:22:37.466320+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'109","last_scrub_stamp":"2024-09-12T01:22:37.466134+0000","last_deep_scrub":"265'109","last_deep_scrub_stamp":"2024-09-12T01:22:37.466134+0000","last_clean_scrub_stamp":"2024-09-12T01:22:37.466134+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:02.774735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":110,"num_write":262,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'190","reported_seq":805,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.525068+0000","last_change":"2024-09-12T01:22:14.525068+0000","last_active":"2024-09-12T01:22:14.525068+0000","last_peered":"2024-09-12T01:22:14.525068+0000","last_clean":"2024-09-12T01:22:14.525068+0000","last_became_active":"2024-09-12T00:35:45.939817+0000","last_became_peered":"2024-09-12T00:35:45.939817+0000","last_unstale":"2024-09-12T01:22:14.525068+0000","last_undegraded":"2024-09-12T01:22:14.525068+0000","last_fullsized":"2024-09-12T01:22:14.525068+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'190","last_scrub_stamp":"2024-09-12T01:22:14.524892+0000","last_deep_scrub":"265'190","last_deep_scrub_stamp":"2024-09-12T01:22:14.524892+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.524892+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:07.182122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":809,"num_read_kb":663,"num_write":268,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'374","reported_seq":1036,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.814217+0000","last_change":"2024-09-12T01:22:07.814217+0000","last_active":"2024-09-12T01:22:07.814217+0000","last_peered":"2024-09-12T01:22:07.814217+0000","last_clean":"2024-09-12T01:22:07.814217+0000","last_became_active":"2024-09-12T00:35:43.912282+0000","last_became_peered":"2024-09-12T00:35:43.912282+0000","last_unstale":"2024-09-12T01:22:07.814217+0000","last_undegraded":"2024-09-12T01:22:07.814217+0000","last_fullsized":"2024-09-12T01:22:07.814217+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T01:22:07.813838+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T01:22:07.813838+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.813838+0000","objects_scrubbed":15,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:43.752646+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6327796,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":526,"num_read_kb":19021,"num_write":1167,"num_write_kb":32789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.373561+0000","last_change":"2024-09-12T01:22:14.373561+0000","last_active":"2024-09-12T01:22:14.373561+0000","last_peered":"2024-09-12T01:22:14.373561+0000","last_clean":"2024-09-12T01:22:14.373561+0000","last_became_active":"2024-09-12T00:35:47.946636+0000","last_became_peered":"2024-09-12T00:35:47.946636+0000","last_unstale":"2024-09-12T01:22:14.373561+0000","last_undegraded":"2024-09-12T01:22:14.373561+0000","last_fullsized":"2024-09-12T01:22:14.373561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:14.373377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:14.373377+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.373377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:28.908478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'514","reported_seq":1159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:25.513379+0000","last_change":"2024-09-12T01:22:25.513379+0000","last_active":"2024-09-12T01:22:25.513379+0000","last_peered":"2024-09-12T01:22:25.513379+0000","last_clean":"2024-09-12T01:22:25.513379+0000","last_became_active":"2024-09-12T00:35:49.950845+0000","last_became_peered":"2024-09-12T00:35:49.950845+0000","last_unstale":"2024-09-12T01:22:25.513379+0000","last_undegraded":"2024-09-12T01:22:25.513379+0000","last_fullsized":"2024-09-12T01:22:25.513379+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'514","last_scrub_stamp":"2024-09-12T01:22:25.513159+0000","last_deep_scrub":"265'514","last_deep_scrub_stamp":"2024-09-12T01:22:25.513159+0000","last_clean_scrub_stamp":"2024-09-12T01:22:25.513159+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:09.891812+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100676,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":870,"num_read_kb":2075,"num_write":716,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.408954+0000","last_change":"2024-09-12T01:22:19.408954+0000","last_active":"2024-09-12T01:22:19.408954+0000","last_peered":"2024-09-12T01:22:19.408954+0000","last_clean":"2024-09-12T01:22:19.408954+0000","last_became_active":"2024-09-12T00:35:51.978188+0000","last_became_peered":"2024-09-12T00:35:51.978188+0000","last_unstale":"2024-09-12T01:22:19.408954+0000","last_undegraded":"2024-09-12T01:22:19.408954+0000","last_fullsized":"2024-09-12T01:22:19.408954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:19.408763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:19.408763+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.408763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:33.873801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'135","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:28.249753+0000","last_change":"2024-09-12T01:22:28.249753+0000","last_active":"2024-09-12T01:22:28.249753+0000","last_peered":"2024-09-12T01:22:28.249753+0000","last_clean":"2024-09-12T01:22:28.249753+0000","last_became_active":"2024-09-12T00:35:53.985635+0000","last_became_peered":"2024-09-12T00:35:53.985635+0000","last_unstale":"2024-09-12T01:22:28.249753+0000","last_undegraded":"2024-09-12T01:22:28.249753+0000","last_fullsized":"2024-09-12T01:22:28.249753+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'135","last_scrub_stamp":"2024-09-12T01:22:28.249558+0000","last_deep_scrub":"265'135","last_deep_scrub_stamp":"2024-09-12T01:22:28.249558+0000","last_clean_scrub_stamp":"2024-09-12T01:22:28.249558+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:56.700780+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":203,"num_read_kb":181,"num_write":311,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'153","reported_seq":756,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.992417+0000","last_change":"2024-09-12T01:22:10.992417+0000","last_active":"2024-09-12T01:22:10.992417+0000","last_peered":"2024-09-12T01:22:10.992417+0000","last_clean":"2024-09-12T01:22:10.992417+0000","last_became_active":"2024-09-12T00:35:45.938135+0000","last_became_peered":"2024-09-12T00:35:45.938135+0000","last_unstale":"2024-09-12T01:22:10.992417+0000","last_undegraded":"2024-09-12T01:22:10.992417+0000","last_fullsized":"2024-09-12T01:22:10.992417+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'153","last_scrub_stamp":"2024-09-12T01:22:10.992236+0000","last_deep_scrub":"265'153","last_deep_scrub_stamp":"2024-09-12T01:22:10.992236+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.992236+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:32.291897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":684,"num_read_kb":556,"num_write":242,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'387","reported_seq":1033,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.627241+0000","last_change":"2024-09-12T01:22:05.627241+0000","last_active":"2024-09-12T01:22:05.627241+0000","last_peered":"2024-09-12T01:22:05.627241+0000","last_clean":"2024-09-12T01:22:05.627241+0000","last_became_active":"2024-09-12T00:35:43.936713+0000","last_became_peered":"2024-09-12T00:35:43.936713+0000","last_unstale":"2024-09-12T01:22:05.627241+0000","last_undegraded":"2024-09-12T01:22:05.627241+0000","last_fullsized":"2024-09-12T01:22:05.627241+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'387","last_scrub_stamp":"2024-09-12T01:22:05.626966+0000","last_deep_scrub":"265'387","last_deep_scrub_stamp":"2024-09-12T01:22:05.626966+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.626966+0000","objects_scrubbed":8,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:33.798620+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730170,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":551,"num_read_kb":26422,"num_write":1213,"num_write_kb":29680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.334177+0000","last_change":"2024-09-12T01:22:15.334177+0000","last_active":"2024-09-12T01:22:15.334177+0000","last_peered":"2024-09-12T01:22:15.334177+0000","last_clean":"2024-09-12T01:22:15.334177+0000","last_became_active":"2024-09-12T00:35:47.938604+0000","last_became_peered":"2024-09-12T00:35:47.938604+0000","last_unstale":"2024-09-12T01:22:15.334177+0000","last_undegraded":"2024-09-12T01:22:15.334177+0000","last_fullsized":"2024-09-12T01:22:15.334177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:15.333992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:15.333992+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.333992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:44.787901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'314","reported_seq":905,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:28.929248+0000","last_change":"2024-09-12T01:22:28.929248+0000","last_active":"2024-09-12T01:22:28.929248+0000","last_peered":"2024-09-12T01:22:28.929248+0000","last_clean":"2024-09-12T01:22:28.929248+0000","last_became_active":"2024-09-12T00:35:49.940679+0000","last_became_peered":"2024-09-12T00:35:49.940679+0000","last_unstale":"2024-09-12T01:22:28.929248+0000","last_undegraded":"2024-09-12T01:22:28.929248+0000","last_fullsized":"2024-09-12T01:22:28.929248+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'314","last_scrub_stamp":"2024-09-12T01:22:28.929055+0000","last_deep_scrub":"265'314","last_deep_scrub_stamp":"2024-09-12T01:22:28.929055+0000","last_clean_scrub_stamp":"2024-09-12T01:22:28.929055+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:39.328379+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52849,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":502,"num_read_kb":1074,"num_write":450,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:35.488571+0000","last_change":"2024-09-12T01:22:35.488571+0000","last_active":"2024-09-12T01:22:35.488571+0000","last_peered":"2024-09-12T01:22:35.488571+0000","last_clean":"2024-09-12T01:22:35.488571+0000","last_became_active":"2024-09-12T00:35:51.977807+0000","last_became_peered":"2024-09-12T00:35:51.977807+0000","last_unstale":"2024-09-12T01:22:35.488571+0000","last_undegraded":"2024-09-12T01:22:35.488571+0000","last_fullsized":"2024-09-12T01:22:35.488571+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:35.488385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:35.488385+0000","last_clean_scrub_stamp":"2024-09-12T01:22:35.488385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:18.337507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'103","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:40.706935+0000","last_change":"2024-09-12T01:22:40.706935+0000","last_active":"2024-09-12T01:22:40.706935+0000","last_peered":"2024-09-12T01:22:40.706935+0000","last_clean":"2024-09-12T01:22:40.706935+0000","last_became_active":"2024-09-12T00:35:54.003115+0000","last_became_peered":"2024-09-12T00:35:54.003115+0000","last_unstale":"2024-09-12T01:22:40.706935+0000","last_undegraded":"2024-09-12T01:22:40.706935+0000","last_fullsized":"2024-09-12T01:22:40.706935+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'103","last_scrub_stamp":"2024-09-12T01:22:40.706706+0000","last_deep_scrub":"265'103","last_deep_scrub_stamp":"2024-09-12T01:22:40.706706+0000","last_clean_scrub_stamp":"2024-09-12T01:22:40.706706+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:58.838187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":131,"num_write":237,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'498","reported_seq":1289,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.027976+0000","last_change":"2024-09-12T01:22:12.027976+0000","last_active":"2024-09-12T01:22:12.027976+0000","last_peered":"2024-09-12T01:22:12.027976+0000","last_clean":"2024-09-12T01:22:12.027976+0000","last_became_active":"2024-09-12T00:35:45.929526+0000","last_became_peered":"2024-09-12T00:35:45.929526+0000","last_unstale":"2024-09-12T01:22:12.027976+0000","last_undegraded":"2024-09-12T01:22:12.027976+0000","last_fullsized":"2024-09-12T01:22:12.027976+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'498","last_scrub_stamp":"2024-09-12T01:22:12.027707+0000","last_deep_scrub":"265'498","last_deep_scrub_stamp":"2024-09-12T01:22:12.027707+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.027707+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:44.755420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2425,"num_read_kb":2075,"num_write":878,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'279","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.151970+0000","last_change":"2024-09-12T01:22:07.151970+0000","last_active":"2024-09-12T01:22:07.151970+0000","last_peered":"2024-09-12T01:22:07.151970+0000","last_clean":"2024-09-12T01:22:07.151970+0000","last_became_active":"2024-09-12T00:35:43.944483+0000","last_became_peered":"2024-09-12T00:35:43.944483+0000","last_unstale":"2024-09-12T01:22:07.151970+0000","last_undegraded":"2024-09-12T01:22:07.151970+0000","last_fullsized":"2024-09-12T01:22:07.151970+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'279","last_scrub_stamp":"2024-09-12T01:22:07.151758+0000","last_deep_scrub":"265'279","last_deep_scrub_stamp":"2024-09-12T01:22:07.151758+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.151758+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:49.773260+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":355,"num_read_kb":347,"num_write":887,"num_write_kb":15629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.223262+0000","last_change":"2024-09-12T01:22:20.223262+0000","last_active":"2024-09-12T01:22:20.223262+0000","last_peered":"2024-09-12T01:22:20.223262+0000","last_clean":"2024-09-12T01:22:20.223262+0000","last_became_active":"2024-09-12T00:35:47.943382+0000","last_became_peered":"2024-09-12T00:35:47.943382+0000","last_unstale":"2024-09-12T01:22:20.223262+0000","last_undegraded":"2024-09-12T01:22:20.223262+0000","last_fullsized":"2024-09-12T01:22:20.223262+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:20.223057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:20.223057+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.223057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:18.669022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'325","reported_seq":914,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:23.351291+0000","last_change":"2024-09-12T01:22:23.351291+0000","last_active":"2024-09-12T01:22:23.351291+0000","last_peered":"2024-09-12T01:22:23.351291+0000","last_clean":"2024-09-12T01:22:23.351291+0000","last_became_active":"2024-09-12T00:35:49.949283+0000","last_became_peered":"2024-09-12T00:35:49.949283+0000","last_unstale":"2024-09-12T01:22:23.351291+0000","last_undegraded":"2024-09-12T01:22:23.351291+0000","last_fullsized":"2024-09-12T01:22:23.351291+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'325","last_scrub_stamp":"2024-09-12T01:22:23.351105+0000","last_deep_scrub":"265'325","last_deep_scrub_stamp":"2024-09-12T01:22:23.351105+0000","last_clean_scrub_stamp":"2024-09-12T01:22:23.351105+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:06.372682+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52286,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":532,"num_read_kb":1204,"num_write":436,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'725","reported_seq":2264,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.400295+0000","last_change":"2024-09-12T01:22:20.400295+0000","last_active":"2024-09-12T01:22:20.400295+0000","last_peered":"2024-09-12T01:22:20.400295+0000","last_clean":"2024-09-12T01:22:20.400295+0000","last_became_active":"2024-09-12T00:35:51.979162+0000","last_became_peered":"2024-09-12T00:35:51.979162+0000","last_unstale":"2024-09-12T01:22:20.400295+0000","last_undegraded":"2024-09-12T01:22:20.400295+0000","last_fullsized":"2024-09-12T01:22:20.400295+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'725","last_scrub_stamp":"2024-09-12T01:22:20.400017+0000","last_deep_scrub":"265'725","last_deep_scrub_stamp":"2024-09-12T01:22:20.400017+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.400017+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:36.962961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'118","reported_seq":614,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:30.283677+0000","last_change":"2024-09-12T01:22:30.283677+0000","last_active":"2024-09-12T01:22:30.283677+0000","last_peered":"2024-09-12T01:22:30.283677+0000","last_clean":"2024-09-12T01:22:30.283677+0000","last_became_active":"2024-09-12T00:35:53.981735+0000","last_became_peered":"2024-09-12T00:35:53.981735+0000","last_unstale":"2024-09-12T01:22:30.283677+0000","last_undegraded":"2024-09-12T01:22:30.283677+0000","last_fullsized":"2024-09-12T01:22:30.283677+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'118","last_scrub_stamp":"2024-09-12T01:22:30.283443+0000","last_deep_scrub":"265'118","last_deep_scrub_stamp":"2024-09-12T01:22:30.283443+0000","last_clean_scrub_stamp":"2024-09-12T01:22:30.283443+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:32.130551+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":92,"num_write":265,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'349","reported_seq":1047,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.978642+0000","last_change":"2024-09-12T01:22:12.978642+0000","last_active":"2024-09-12T01:22:12.978642+0000","last_peered":"2024-09-12T01:22:12.978642+0000","last_clean":"2024-09-12T01:22:12.978642+0000","last_became_active":"2024-09-12T00:35:45.953935+0000","last_became_peered":"2024-09-12T00:35:45.953935+0000","last_unstale":"2024-09-12T01:22:12.978642+0000","last_undegraded":"2024-09-12T01:22:12.978642+0000","last_fullsized":"2024-09-12T01:22:12.978642+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'349","last_scrub_stamp":"2024-09-12T01:22:12.978442+0000","last_deep_scrub":"265'349","last_deep_scrub_stamp":"2024-09-12T01:22:12.978442+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.978442+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:16.697478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1509,"num_read_kb":1228,"num_write":558,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'331","reported_seq":990,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.065472+0000","last_change":"2024-09-12T01:22:05.065472+0000","last_active":"2024-09-12T01:22:05.065472+0000","last_peered":"2024-09-12T01:22:05.065472+0000","last_clean":"2024-09-12T01:22:05.065472+0000","last_became_active":"2024-09-12T00:35:43.929559+0000","last_became_peered":"2024-09-12T00:35:43.929559+0000","last_unstale":"2024-09-12T01:22:05.065472+0000","last_undegraded":"2024-09-12T01:22:05.065472+0000","last_fullsized":"2024-09-12T01:22:05.065472+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'331","last_scrub_stamp":"2024-09-12T01:22:05.065301+0000","last_deep_scrub":"265'331","last_deep_scrub_stamp":"2024-09-12T01:22:05.065301+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.065301+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:54.088835+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2025256,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":451,"num_read_kb":47620,"num_write":929,"num_write_kb":27870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"265'4","reported_seq":1472,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:25.624904+0000","last_change":"2024-09-12T01:22:25.624904+0000","last_active":"2024-09-12T01:22:25.624904+0000","last_peered":"2024-09-12T01:22:25.624904+0000","last_clean":"2024-09-12T01:22:25.624904+0000","last_became_active":"2024-09-12T00:35:47.936026+0000","last_became_peered":"2024-09-12T00:35:47.936026+0000","last_unstale":"2024-09-12T01:22:25.624904+0000","last_undegraded":"2024-09-12T01:22:25.624904+0000","last_fullsized":"2024-09-12T01:22:25.624904+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T01:22:25.624719+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T01:22:25.624719+0000","last_clean_scrub_stamp":"2024-09-12T01:22:25.624719+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:27.524698+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":965,"num_read_kb":965,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'85","reported_seq":608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:30.595229+0000","last_change":"2024-09-12T01:22:30.595229+0000","last_active":"2024-09-12T01:22:30.595229+0000","last_peered":"2024-09-12T01:22:30.595229+0000","last_clean":"2024-09-12T01:22:30.595229+0000","last_became_active":"2024-09-12T00:35:50.027161+0000","last_became_peered":"2024-09-12T00:35:50.027161+0000","last_unstale":"2024-09-12T01:22:30.595229+0000","last_undegraded":"2024-09-12T01:22:30.595229+0000","last_fullsized":"2024-09-12T01:22:30.595229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'85","last_scrub_stamp":"2024-09-12T01:22:30.595013+0000","last_deep_scrub":"265'85","last_deep_scrub_stamp":"2024-09-12T01:22:30.595013+0000","last_clean_scrub_stamp":"2024-09-12T01:22:30.595013+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:04.958322+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'774","reported_seq":6327,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:24.099738+0000","last_change":"2024-09-12T01:22:24.099738+0000","last_active":"2024-09-12T01:22:24.099738+0000","last_peered":"2024-09-12T01:22:24.099738+0000","last_clean":"2024-09-12T01:22:24.099738+0000","last_became_active":"2024-09-12T00:35:51.976947+0000","last_became_peered":"2024-09-12T00:35:51.976947+0000","last_unstale":"2024-09-12T01:22:24.099738+0000","last_undegraded":"2024-09-12T01:22:24.099738+0000","last_fullsized":"2024-09-12T01:22:24.099738+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'774","last_scrub_stamp":"2024-09-12T01:22:24.099561+0000","last_deep_scrub":"265'774","last_deep_scrub_stamp":"2024-09-12T01:22:24.099561+0000","last_clean_scrub_stamp":"2024-09-12T01:22:24.099561+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:55.033935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'157","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:36.943142+0000","last_change":"2024-09-12T01:22:36.943142+0000","last_active":"2024-09-12T01:22:36.943142+0000","last_peered":"2024-09-12T01:22:36.943142+0000","last_clean":"2024-09-12T01:22:36.943142+0000","last_became_active":"2024-09-12T00:35:53.994715+0000","last_became_peered":"2024-09-12T00:35:53.994715+0000","last_unstale":"2024-09-12T01:22:36.943142+0000","last_undegraded":"2024-09-12T01:22:36.943142+0000","last_fullsized":"2024-09-12T01:22:36.943142+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'157","last_scrub_stamp":"2024-09-12T01:22:36.942957+0000","last_deep_scrub":"265'157","last_deep_scrub_stamp":"2024-09-12T01:22:36.942957+0000","last_clean_scrub_stamp":"2024-09-12T01:22:36.942957+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:47.928655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":132,"num_read_kb":125,"num_write":372,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'159","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.435354+0000","last_change":"2024-09-12T01:22:09.435354+0000","last_active":"2024-09-12T01:22:09.435354+0000","last_peered":"2024-09-12T01:22:09.435354+0000","last_clean":"2024-09-12T01:22:09.435354+0000","last_became_active":"2024-09-12T00:36:17.049999+0000","last_became_peered":"2024-09-12T00:36:17.049999+0000","last_unstale":"2024-09-12T01:22:09.435354+0000","last_undegraded":"2024-09-12T01:22:09.435354+0000","last_fullsized":"2024-09-12T01:22:09.435354+0000","mapping_epoch":37,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'159","last_scrub_stamp":"2024-09-12T01:22:09.435171+0000","last_deep_scrub":"265'159","last_deep_scrub_stamp":"2024-09-12T01:22:09.435171+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.435171+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:31.966275+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":667,"num_read_kb":538,"num_write":243,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8078,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"265'365","reported_seq":1124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:04.665974+0000","last_change":"2024-09-12T01:22:04.665974+0000","last_active":"2024-09-12T01:22:04.665974+0000","last_peered":"2024-09-12T01:22:04.665974+0000","last_clean":"2024-09-12T01:22:04.665974+0000","last_became_active":"2024-09-12T00:35:43.931562+0000","last_became_peered":"2024-09-12T00:35:43.931562+0000","last_unstale":"2024-09-12T01:22:04.665974+0000","last_undegraded":"2024-09-12T01:22:04.665974+0000","last_fullsized":"2024-09-12T01:22:04.665974+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T01:22:04.665854+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T01:22:04.665854+0000","last_clean_scrub_stamp":"2024-09-12T01:22:04.665854+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:17.732533+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992276,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":678,"num_read_kb":113913,"num_write":1161,"num_write_kb":34109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:25.865212+0000","last_change":"2024-09-12T01:22:25.865212+0000","last_active":"2024-09-12T01:22:25.865212+0000","last_peered":"2024-09-12T01:22:25.865212+0000","last_clean":"2024-09-12T01:22:25.865212+0000","last_became_active":"2024-09-12T00:35:47.930147+0000","last_became_peered":"2024-09-12T00:35:47.930147+0000","last_unstale":"2024-09-12T01:22:25.865212+0000","last_undegraded":"2024-09-12T01:22:25.865212+0000","last_fullsized":"2024-09-12T01:22:25.865212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:25.865042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:25.865042+0000","last_clean_scrub_stamp":"2024-09-12T01:22:25.865042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:36.302789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'353","reported_seq":964,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:31.632246+0000","last_change":"2024-09-12T01:22:31.632246+0000","last_active":"2024-09-12T01:22:31.632246+0000","last_peered":"2024-09-12T01:22:31.632246+0000","last_clean":"2024-09-12T01:22:31.632246+0000","last_became_active":"2024-09-12T00:35:49.938597+0000","last_became_peered":"2024-09-12T00:35:49.938597+0000","last_unstale":"2024-09-12T01:22:31.632246+0000","last_undegraded":"2024-09-12T01:22:31.632246+0000","last_fullsized":"2024-09-12T01:22:31.632246+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'353","last_scrub_stamp":"2024-09-12T01:22:31.632135+0000","last_deep_scrub":"265'353","last_deep_scrub_stamp":"2024-09-12T01:22:31.632135+0000","last_clean_scrub_stamp":"2024-09-12T01:22:31.632135+0000","objects_scrubbed":8,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:04.456182+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46738,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":571,"num_read_kb":1203,"num_write":454,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.084666+0000","last_change":"2024-09-12T01:22:22.084666+0000","last_active":"2024-09-12T01:22:22.084666+0000","last_peered":"2024-09-12T01:22:22.084666+0000","last_clean":"2024-09-12T01:22:22.084666+0000","last_became_active":"2024-09-12T00:35:51.967708+0000","last_became_peered":"2024-09-12T00:35:51.967708+0000","last_unstale":"2024-09-12T01:22:22.084666+0000","last_undegraded":"2024-09-12T01:22:22.084666+0000","last_fullsized":"2024-09-12T01:22:22.084666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:22.084485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:22.084485+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.084485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:12.944518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'119","reported_seq":616,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:33.290424+0000","last_change":"2024-09-12T01:22:33.290424+0000","last_active":"2024-09-12T01:22:33.290424+0000","last_peered":"2024-09-12T01:22:33.290424+0000","last_clean":"2024-09-12T01:22:33.290424+0000","last_became_active":"2024-09-12T00:35:53.997893+0000","last_became_peered":"2024-09-12T00:35:53.997893+0000","last_unstale":"2024-09-12T01:22:33.290424+0000","last_undegraded":"2024-09-12T01:22:33.290424+0000","last_fullsized":"2024-09-12T01:22:33.290424+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'119","last_scrub_stamp":"2024-09-12T01:22:33.290100+0000","last_deep_scrub":"265'119","last_deep_scrub_stamp":"2024-09-12T01:22:33.290100+0000","last_clean_scrub_stamp":"2024-09-12T01:22:33.290100+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:58.599965+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":114,"num_write":260,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'95","reported_seq":687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.199979+0000","last_change":"2024-09-12T01:22:13.199979+0000","last_active":"2024-09-12T01:22:13.199979+0000","last_peered":"2024-09-12T01:22:13.199979+0000","last_clean":"2024-09-12T01:22:13.199979+0000","last_became_active":"2024-09-12T00:35:45.941291+0000","last_became_peered":"2024-09-12T00:35:45.941291+0000","last_unstale":"2024-09-12T01:22:13.199979+0000","last_undegraded":"2024-09-12T01:22:13.199979+0000","last_fullsized":"2024-09-12T01:22:13.199979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'95","last_scrub_stamp":"2024-09-12T01:22:13.199797+0000","last_deep_scrub":"265'95","last_deep_scrub_stamp":"2024-09-12T01:22:13.199797+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.199797+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:29.571782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":459,"num_read_kb":386,"num_write":145,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":621,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.470742+0000","last_change":"2024-09-12T01:22:05.470742+0000","last_active":"2024-09-12T01:22:05.470742+0000","last_peered":"2024-09-12T01:22:05.470742+0000","last_clean":"2024-09-12T01:22:05.470742+0000","last_became_active":"2024-09-12T00:35:25.096843+0000","last_became_peered":"2024-09-12T00:35:25.096843+0000","last_unstale":"2024-09-12T01:22:05.470742+0000","last_undegraded":"2024-09-12T01:22:05.470742+0000","last_fullsized":"2024-09-12T01:22:05.470742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-12T01:22:05.470506+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-12T01:22:05.470506+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.470506+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:45.363711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.800395+0000","last_change":"2024-09-12T01:22:09.800395+0000","last_active":"2024-09-12T01:22:09.800395+0000","last_peered":"2024-09-12T01:22:09.800395+0000","last_clean":"2024-09-12T01:22:09.800395+0000","last_became_active":"2024-09-12T00:35:29.668145+0000","last_became_peered":"2024-09-12T00:35:29.668145+0000","last_unstale":"2024-09-12T01:22:09.800395+0000","last_undegraded":"2024-09-12T01:22:09.800395+0000","last_fullsized":"2024-09-12T01:22:09.800395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:09.800200+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:09.800200+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.800200+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:15.267436+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0011070749999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'322","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:03.609476+0000","last_change":"2024-09-12T01:22:03.609476+0000","last_active":"2024-09-12T01:22:03.609476+0000","last_peered":"2024-09-12T01:22:03.609476+0000","last_clean":"2024-09-12T01:22:03.609476+0000","last_became_active":"2024-09-12T00:35:43.916969+0000","last_became_peered":"2024-09-12T00:35:43.916969+0000","last_unstale":"2024-09-12T01:22:03.609476+0000","last_undegraded":"2024-09-12T01:22:03.609476+0000","last_fullsized":"2024-09-12T01:22:03.609476+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T01:22:03.609346+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T01:22:03.609346+0000","last_clean_scrub_stamp":"2024-09-12T01:22:03.609346+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:29.571575+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568993,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":119474,"num_write":1014,"num_write_kb":17296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.373693+0000","last_change":"2024-09-12T01:22:22.373693+0000","last_active":"2024-09-12T01:22:22.373693+0000","last_peered":"2024-09-12T01:22:22.373693+0000","last_clean":"2024-09-12T01:22:22.373693+0000","last_became_active":"2024-09-12T00:35:47.942643+0000","last_became_peered":"2024-09-12T00:35:47.942643+0000","last_unstale":"2024-09-12T01:22:22.373693+0000","last_undegraded":"2024-09-12T01:22:22.373693+0000","last_fullsized":"2024-09-12T01:22:22.373693+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:22.373489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:22.373489+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.373489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:26.791309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'703","reported_seq":1418,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:29.671617+0000","last_change":"2024-09-12T01:22:29.671617+0000","last_active":"2024-09-12T01:22:29.671617+0000","last_peered":"2024-09-12T01:22:29.671617+0000","last_clean":"2024-09-12T01:22:29.671617+0000","last_became_active":"2024-09-12T00:35:49.957694+0000","last_became_peered":"2024-09-12T00:35:49.957694+0000","last_unstale":"2024-09-12T01:22:29.671617+0000","last_undegraded":"2024-09-12T01:22:29.671617+0000","last_fullsized":"2024-09-12T01:22:29.671617+0000","mapping_epoch":30,"log_start":"265'600","ondisk_log_start":"265'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'703","last_scrub_stamp":"2024-09-12T01:22:29.671389+0000","last_deep_scrub":"265'703","last_deep_scrub_stamp":"2024-09-12T01:22:29.671389+0000","last_clean_scrub_stamp":"2024-09-12T01:22:29.671389+0000","objects_scrubbed":7,"log_size":103,"log_dups_size":600,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:45.223736+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144071,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1382,"num_read_kb":3079,"num_write":1308,"num_write_kb":1154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":107698,"num_omap_keys":260,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:31.484104+0000","last_change":"2024-09-12T01:22:31.484104+0000","last_active":"2024-09-12T01:22:31.484104+0000","last_peered":"2024-09-12T01:22:31.484104+0000","last_clean":"2024-09-12T01:22:31.484104+0000","last_became_active":"2024-09-12T00:35:51.977282+0000","last_became_peered":"2024-09-12T00:35:51.977282+0000","last_unstale":"2024-09-12T01:22:31.484104+0000","last_undegraded":"2024-09-12T01:22:31.484104+0000","last_fullsized":"2024-09-12T01:22:31.484104+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:31.483918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:31.483918+0000","last_clean_scrub_stamp":"2024-09-12T01:22:31.483918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:49.029998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'208","reported_seq":925,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:28.107049+0000","last_change":"2024-09-12T01:22:28.107049+0000","last_active":"2024-09-12T01:22:28.107049+0000","last_peered":"2024-09-12T01:22:28.107049+0000","last_clean":"2024-09-12T01:22:28.107049+0000","last_became_active":"2024-09-12T00:35:53.997354+0000","last_became_peered":"2024-09-12T00:35:53.997354+0000","last_unstale":"2024-09-12T01:22:28.107049+0000","last_undegraded":"2024-09-12T01:22:28.107049+0000","last_fullsized":"2024-09-12T01:22:28.107049+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'208","last_scrub_stamp":"2024-09-12T01:22:28.106812+0000","last_deep_scrub":"265'208","last_deep_scrub_stamp":"2024-09-12T01:22:28.106812+0000","last_clean_scrub_stamp":"2024-09-12T01:22:28.106812+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:03.140844+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":471,"num_write":454,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'239","reported_seq":905,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.549409+0000","last_change":"2024-09-12T01:22:11.549409+0000","last_active":"2024-09-12T01:22:11.549409+0000","last_peered":"2024-09-12T01:22:11.549409+0000","last_clean":"2024-09-12T01:22:11.549409+0000","last_became_active":"2024-09-12T00:35:45.945766+0000","last_became_peered":"2024-09-12T00:35:45.945766+0000","last_unstale":"2024-09-12T01:22:11.549409+0000","last_undegraded":"2024-09-12T01:22:11.549409+0000","last_fullsized":"2024-09-12T01:22:11.549409+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'239","last_scrub_stamp":"2024-09-12T01:22:11.549218+0000","last_deep_scrub":"265'239","last_deep_scrub_stamp":"2024-09-12T01:22:11.549218+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.549218+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:53.581793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1032,"num_read_kb":857,"num_write":339,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.466487+0000","last_change":"2024-09-12T01:22:06.466487+0000","last_active":"2024-09-12T01:22:06.466487+0000","last_peered":"2024-09-12T01:22:06.466487+0000","last_clean":"2024-09-12T01:22:06.466487+0000","last_became_active":"2024-09-12T00:35:29.671287+0000","last_became_peered":"2024-09-12T00:35:29.671287+0000","last_unstale":"2024-09-12T01:22:06.466487+0000","last_undegraded":"2024-09-12T01:22:06.466487+0000","last_fullsized":"2024-09-12T01:22:06.466487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:06.466276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:06.466276+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.466276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:01.838180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075002000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'404","reported_seq":1121,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:03.716502+0000","last_change":"2024-09-12T01:22:03.716502+0000","last_active":"2024-09-12T01:22:03.716502+0000","last_peered":"2024-09-12T01:22:03.716502+0000","last_clean":"2024-09-12T01:22:03.716502+0000","last_became_active":"2024-09-12T00:35:43.945335+0000","last_became_peered":"2024-09-12T00:35:43.945335+0000","last_unstale":"2024-09-12T01:22:03.716502+0000","last_undegraded":"2024-09-12T01:22:03.716502+0000","last_fullsized":"2024-09-12T01:22:03.716502+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'404","last_scrub_stamp":"2024-09-12T01:22:03.716386+0000","last_deep_scrub":"265'404","last_deep_scrub_stamp":"2024-09-12T01:22:03.716386+0000","last_clean_scrub_stamp":"2024-09-12T01:22:03.716386+0000","objects_scrubbed":7,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:53.096747+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":682,"num_read_kb":63013,"num_write":1485,"num_write_kb":40970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:24.648574+0000","last_change":"2024-09-12T01:22:24.648574+0000","last_active":"2024-09-12T01:22:24.648574+0000","last_peered":"2024-09-12T01:22:24.648574+0000","last_clean":"2024-09-12T01:22:24.648574+0000","last_became_active":"2024-09-12T00:35:47.925704+0000","last_became_peered":"2024-09-12T00:35:47.925704+0000","last_unstale":"2024-09-12T01:22:24.648574+0000","last_undegraded":"2024-09-12T01:22:24.648574+0000","last_fullsized":"2024-09-12T01:22:24.648574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:24.648314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:24.648314+0000","last_clean_scrub_stamp":"2024-09-12T01:22:24.648314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:34.513335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1270","reported_seq":2773,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:23.233400+0000","last_change":"2024-09-12T01:22:23.233400+0000","last_active":"2024-09-12T01:22:23.233400+0000","last_peered":"2024-09-12T01:22:23.233400+0000","last_clean":"2024-09-12T01:22:23.233400+0000","last_became_active":"2024-09-12T00:35:49.947643+0000","last_became_peered":"2024-09-12T00:35:49.947643+0000","last_unstale":"2024-09-12T01:22:23.233400+0000","last_undegraded":"2024-09-12T01:22:23.233400+0000","last_fullsized":"2024-09-12T01:22:23.233400+0000","mapping_epoch":30,"log_start":"265'1200","ondisk_log_start":"265'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1270","last_scrub_stamp":"2024-09-12T01:22:23.233211+0000","last_deep_scrub":"265'1270","last_deep_scrub_stamp":"2024-09-12T01:22:23.233211+0000","last_clean_scrub_stamp":"2024-09-12T01:22:23.233211+0000","objects_scrubbed":12,"log_size":70,"log_dups_size":1200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:51.857102+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144243,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2043,"num_read_kb":3859,"num_write":1128,"num_write_kb":966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:33.403165+0000","last_change":"2024-09-12T01:22:33.403165+0000","last_active":"2024-09-12T01:22:33.403165+0000","last_peered":"2024-09-12T01:22:33.403165+0000","last_clean":"2024-09-12T01:22:33.403165+0000","last_became_active":"2024-09-12T00:35:51.981240+0000","last_became_peered":"2024-09-12T00:35:51.981240+0000","last_unstale":"2024-09-12T01:22:33.403165+0000","last_undegraded":"2024-09-12T01:22:33.403165+0000","last_fullsized":"2024-09-12T01:22:33.403165+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:33.402987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:33.402987+0000","last_clean_scrub_stamp":"2024-09-12T01:22:33.402987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:18.450569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'137","reported_seq":653,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:36.253508+0000","last_change":"2024-09-12T01:22:36.253508+0000","last_active":"2024-09-12T01:22:36.253508+0000","last_peered":"2024-09-12T01:22:36.253508+0000","last_clean":"2024-09-12T01:22:36.253508+0000","last_became_active":"2024-09-12T00:35:54.013658+0000","last_became_peered":"2024-09-12T00:35:54.013658+0000","last_unstale":"2024-09-12T01:22:36.253508+0000","last_undegraded":"2024-09-12T01:22:36.253508+0000","last_fullsized":"2024-09-12T01:22:36.253508+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'137","last_scrub_stamp":"2024-09-12T01:22:36.253219+0000","last_deep_scrub":"265'137","last_deep_scrub_stamp":"2024-09-12T01:22:36.253219+0000","last_clean_scrub_stamp":"2024-09-12T01:22:36.253219+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:39.667502+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":184,"num_read_kb":167,"num_write":336,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'142","reported_seq":780,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.143929+0000","last_change":"2024-09-12T01:22:13.143929+0000","last_active":"2024-09-12T01:22:13.143929+0000","last_peered":"2024-09-12T01:22:13.143929+0000","last_clean":"2024-09-12T01:22:13.143929+0000","last_became_active":"2024-09-12T00:35:45.929073+0000","last_became_peered":"2024-09-12T00:35:45.929073+0000","last_unstale":"2024-09-12T01:22:13.143929+0000","last_undegraded":"2024-09-12T01:22:13.143929+0000","last_fullsized":"2024-09-12T01:22:13.143929+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'142","last_scrub_stamp":"2024-09-12T01:22:13.143744+0000","last_deep_scrub":"265'142","last_deep_scrub_stamp":"2024-09-12T01:22:13.143744+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.143744+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:36.562063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":635,"num_read_kb":540,"num_write":217,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:03.482812+0000","last_change":"2024-09-12T01:22:03.482812+0000","last_active":"2024-09-12T01:22:03.482812+0000","last_peered":"2024-09-12T01:22:03.482812+0000","last_clean":"2024-09-12T01:22:03.482812+0000","last_became_active":"2024-09-12T00:35:29.699432+0000","last_became_peered":"2024-09-12T00:35:29.699432+0000","last_unstale":"2024-09-12T01:22:03.482812+0000","last_undegraded":"2024-09-12T01:22:03.482812+0000","last_fullsized":"2024-09-12T01:22:03.482812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:03.482726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:03.482726+0000","last_clean_scrub_stamp":"2024-09-12T01:22:03.482726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:09.949801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099979400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'347","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.188799+0000","last_change":"2024-09-12T01:22:05.188799+0000","last_active":"2024-09-12T01:22:05.188799+0000","last_peered":"2024-09-12T01:22:05.188799+0000","last_clean":"2024-09-12T01:22:05.188799+0000","last_became_active":"2024-09-12T00:35:43.928667+0000","last_became_peered":"2024-09-12T00:35:43.928667+0000","last_unstale":"2024-09-12T01:22:05.188799+0000","last_undegraded":"2024-09-12T01:22:05.188799+0000","last_fullsized":"2024-09-12T01:22:05.188799+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T01:22:05.188675+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T01:22:05.188675+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.188675+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:11.123392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174664,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":503,"num_read_kb":16533,"num_write":1052,"num_write_kb":18962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"265'2","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.378468+0000","last_change":"2024-09-12T01:22:22.378468+0000","last_active":"2024-09-12T01:22:22.378468+0000","last_peered":"2024-09-12T01:22:22.378468+0000","last_clean":"2024-09-12T01:22:22.378468+0000","last_became_active":"2024-09-12T00:35:47.944385+0000","last_became_peered":"2024-09-12T00:35:47.944385+0000","last_unstale":"2024-09-12T01:22:22.378468+0000","last_undegraded":"2024-09-12T01:22:22.378468+0000","last_fullsized":"2024-09-12T01:22:22.378468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:22.378275+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:22.378275+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.378275+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:11.673153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'235","reported_seq":1338,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:27.344418+0000","last_change":"2024-09-12T01:22:27.344418+0000","last_active":"2024-09-12T01:22:27.344418+0000","last_peered":"2024-09-12T01:22:27.344418+0000","last_clean":"2024-09-12T01:22:27.344418+0000","last_became_active":"2024-09-12T00:35:50.025610+0000","last_became_peered":"2024-09-12T00:35:50.025610+0000","last_unstale":"2024-09-12T01:22:27.344418+0000","last_undegraded":"2024-09-12T01:22:27.344418+0000","last_fullsized":"2024-09-12T01:22:27.344418+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'235","last_scrub_stamp":"2024-09-12T01:22:27.344190+0000","last_deep_scrub":"265'235","last_deep_scrub_stamp":"2024-09-12T01:22:27.344190+0000","last_clean_scrub_stamp":"2024-09-12T01:22:27.344190+0000","objects_scrubbed":9,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:09.545564+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":183,"num_read_kb":174,"num_write":155,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:29.469905+0000","last_change":"2024-09-12T01:22:29.469905+0000","last_active":"2024-09-12T01:22:29.469905+0000","last_peered":"2024-09-12T01:22:29.469905+0000","last_clean":"2024-09-12T01:22:29.469905+0000","last_became_active":"2024-09-12T00:35:51.973593+0000","last_became_peered":"2024-09-12T00:35:51.973593+0000","last_unstale":"2024-09-12T01:22:29.469905+0000","last_undegraded":"2024-09-12T01:22:29.469905+0000","last_fullsized":"2024-09-12T01:22:29.469905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:29.469717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:29.469717+0000","last_clean_scrub_stamp":"2024-09-12T01:22:29.469717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:49.513054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'275","reported_seq":886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:41.719874+0000","last_change":"2024-09-12T01:22:41.719874+0000","last_active":"2024-09-12T01:22:41.719874+0000","last_peered":"2024-09-12T01:22:41.719874+0000","last_clean":"2024-09-12T01:22:41.719874+0000","last_became_active":"2024-09-12T00:35:53.994828+0000","last_became_peered":"2024-09-12T00:35:53.994828+0000","last_unstale":"2024-09-12T01:22:41.719874+0000","last_undegraded":"2024-09-12T01:22:41.719874+0000","last_fullsized":"2024-09-12T01:22:41.719874+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'275","last_scrub_stamp":"2024-09-12T01:22:41.719695+0000","last_deep_scrub":"265'275","last_deep_scrub_stamp":"2024-09-12T01:22:41.719695+0000","last_clean_scrub_stamp":"2024-09-12T01:22:41.719695+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:43.529849+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":532,"num_read_kb":546,"num_write":608,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'101","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.159831+0000","last_change":"2024-09-12T01:22:12.159831+0000","last_active":"2024-09-12T01:22:12.159831+0000","last_peered":"2024-09-12T01:22:12.159831+0000","last_clean":"2024-09-12T01:22:12.159831+0000","last_became_active":"2024-09-12T00:35:45.932642+0000","last_became_peered":"2024-09-12T00:35:45.932642+0000","last_unstale":"2024-09-12T01:22:12.159831+0000","last_undegraded":"2024-09-12T01:22:12.159831+0000","last_fullsized":"2024-09-12T01:22:12.159831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'101","last_scrub_stamp":"2024-09-12T01:22:12.159645+0000","last_deep_scrub":"265'101","last_deep_scrub_stamp":"2024-09-12T01:22:12.159645+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.159645+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:07.949915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":466,"num_read_kb":396,"num_write":153,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:04.843329+0000","last_change":"2024-09-12T01:22:04.843329+0000","last_active":"2024-09-12T01:22:04.843329+0000","last_peered":"2024-09-12T01:22:04.843329+0000","last_clean":"2024-09-12T01:22:04.843329+0000","last_became_active":"2024-09-12T00:35:29.664963+0000","last_became_peered":"2024-09-12T00:35:29.664963+0000","last_unstale":"2024-09-12T01:22:04.843329+0000","last_undegraded":"2024-09-12T01:22:04.843329+0000","last_fullsized":"2024-09-12T01:22:04.843329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:22:04.843146+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:22:04.843146+0000","last_clean_scrub_stamp":"2024-09-12T01:22:04.843146+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:56.597168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0020842569999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'294","reported_seq":972,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:04.048022+0000","last_change":"2024-09-12T01:22:04.048022+0000","last_active":"2024-09-12T01:22:04.048022+0000","last_peered":"2024-09-12T01:22:04.048022+0000","last_clean":"2024-09-12T01:22:04.048022+0000","last_became_active":"2024-09-12T00:35:43.930731+0000","last_became_peered":"2024-09-12T00:35:43.930731+0000","last_unstale":"2024-09-12T01:22:04.048022+0000","last_undegraded":"2024-09-12T01:22:04.048022+0000","last_fullsized":"2024-09-12T01:22:04.048022+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'294","last_scrub_stamp":"2024-09-12T01:22:04.047797+0000","last_deep_scrub":"265'294","last_deep_scrub_stamp":"2024-09-12T01:22:04.047797+0000","last_clean_scrub_stamp":"2024-09-12T01:22:04.047797+0000","objects_scrubbed":5,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:39.342877+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":688153,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":45060,"num_write":1094,"num_write_kb":33877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.462404+0000","last_change":"2024-09-12T01:22:21.462404+0000","last_active":"2024-09-12T01:22:21.462404+0000","last_peered":"2024-09-12T01:22:21.462404+0000","last_clean":"2024-09-12T01:22:21.462404+0000","last_became_active":"2024-09-12T00:35:47.939055+0000","last_became_peered":"2024-09-12T00:35:47.939055+0000","last_unstale":"2024-09-12T01:22:21.462404+0000","last_undegraded":"2024-09-12T01:22:21.462404+0000","last_fullsized":"2024-09-12T01:22:21.462404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:21.462198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:21.462198+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.462198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:09.095594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'124","reported_seq":669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:28.563444+0000","last_change":"2024-09-12T01:22:28.563444+0000","last_active":"2024-09-12T01:22:28.563444+0000","last_peered":"2024-09-12T01:22:28.563444+0000","last_clean":"2024-09-12T01:22:28.563444+0000","last_became_active":"2024-09-12T00:35:49.948258+0000","last_became_peered":"2024-09-12T00:35:49.948258+0000","last_unstale":"2024-09-12T01:22:28.563444+0000","last_undegraded":"2024-09-12T01:22:28.563444+0000","last_fullsized":"2024-09-12T01:22:28.563444+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'124","last_scrub_stamp":"2024-09-12T01:22:28.563234+0000","last_deep_scrub":"265'124","last_deep_scrub_stamp":"2024-09-12T01:22:28.563234+0000","last_clean_scrub_stamp":"2024-09-12T01:22:28.563234+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:25.266630+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3226,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.048163+0000","last_change":"2024-09-12T01:22:21.048163+0000","last_active":"2024-09-12T01:22:21.048163+0000","last_peered":"2024-09-12T01:22:21.048163+0000","last_clean":"2024-09-12T01:22:21.048163+0000","last_became_active":"2024-09-12T00:35:51.974302+0000","last_became_peered":"2024-09-12T00:35:51.974302+0000","last_unstale":"2024-09-12T01:22:21.048163+0000","last_undegraded":"2024-09-12T01:22:21.048163+0000","last_fullsized":"2024-09-12T01:22:21.048163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:21.047984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:21.047984+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.047984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:34.374068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'144","reported_seq":715,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:36.547164+0000","last_change":"2024-09-12T01:22:36.547164+0000","last_active":"2024-09-12T01:22:36.547164+0000","last_peered":"2024-09-12T01:22:36.547164+0000","last_clean":"2024-09-12T01:22:36.547164+0000","last_became_active":"2024-09-12T00:35:53.995254+0000","last_became_peered":"2024-09-12T00:35:53.995254+0000","last_unstale":"2024-09-12T01:22:36.547164+0000","last_undegraded":"2024-09-12T01:22:36.547164+0000","last_fullsized":"2024-09-12T01:22:36.547164+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'144","last_scrub_stamp":"2024-09-12T01:22:36.546872+0000","last_deep_scrub":"265'144","last_deep_scrub_stamp":"2024-09-12T01:22:36.546872+0000","last_clean_scrub_stamp":"2024-09-12T01:22:36.546872+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:16.036809+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1272,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":285,"num_read_kb":262,"num_write":355,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'53","reported_seq":599,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.173036+0000","last_change":"2024-09-12T01:22:11.173036+0000","last_active":"2024-09-12T01:22:11.173036+0000","last_peered":"2024-09-12T01:22:11.173036+0000","last_clean":"2024-09-12T01:22:11.173036+0000","last_became_active":"2024-09-12T00:35:45.936061+0000","last_became_peered":"2024-09-12T00:35:45.936061+0000","last_unstale":"2024-09-12T01:22:11.173036+0000","last_undegraded":"2024-09-12T01:22:11.173036+0000","last_fullsized":"2024-09-12T01:22:11.173036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'53","last_scrub_stamp":"2024-09-12T01:22:11.172855+0000","last_deep_scrub":"265'53","last_deep_scrub_stamp":"2024-09-12T01:22:11.172855+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.172855+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:11.840647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":179,"num_write":83,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"265'358","reported_seq":1020,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.848155+0000","last_change":"2024-09-12T01:22:05.848155+0000","last_active":"2024-09-12T01:22:05.848155+0000","last_peered":"2024-09-12T01:22:05.848155+0000","last_clean":"2024-09-12T01:22:05.848155+0000","last_became_active":"2024-09-12T00:36:17.051542+0000","last_became_peered":"2024-09-12T00:36:17.051542+0000","last_unstale":"2024-09-12T01:22:05.848155+0000","last_undegraded":"2024-09-12T01:22:05.848155+0000","last_fullsized":"2024-09-12T01:22:05.848155+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T01:22:05.847893+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T01:22:05.847893+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.847893+0000","objects_scrubbed":9,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:51.384435+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730210,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":479,"num_read_kb":44411,"num_write":1031,"num_write_kb":33814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:03.236128+0000","last_change":"2024-09-12T01:22:03.236128+0000","last_active":"2024-09-12T01:22:03.236128+0000","last_peered":"2024-09-12T01:22:03.236128+0000","last_clean":"2024-09-12T01:22:03.236128+0000","last_became_active":"2024-09-12T00:35:29.700869+0000","last_became_peered":"2024-09-12T00:35:29.700869+0000","last_unstale":"2024-09-12T01:22:03.236128+0000","last_undegraded":"2024-09-12T01:22:03.236128+0000","last_fullsized":"2024-09-12T01:22:03.236128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:03.235936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:03.235936+0000","last_clean_scrub_stamp":"2024-09-12T01:22:03.235936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:19.598037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00099003299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"265'6","reported_seq":988,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.474373+0000","last_change":"2024-09-12T01:22:18.474373+0000","last_active":"2024-09-12T01:22:18.474373+0000","last_peered":"2024-09-12T01:22:18.474373+0000","last_clean":"2024-09-12T01:22:18.474373+0000","last_became_active":"2024-09-12T00:35:47.946690+0000","last_became_peered":"2024-09-12T00:35:47.946690+0000","last_unstale":"2024-09-12T01:22:18.474373+0000","last_undegraded":"2024-09-12T01:22:18.474373+0000","last_fullsized":"2024-09-12T01:22:18.474373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:22:18.474192+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:22:18.474192+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.474192+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:24.840674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'579","reported_seq":1257,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:23.516688+0000","last_change":"2024-09-12T01:22:23.516688+0000","last_active":"2024-09-12T01:22:23.516688+0000","last_peered":"2024-09-12T01:22:23.516688+0000","last_clean":"2024-09-12T01:22:23.516688+0000","last_became_active":"2024-09-12T00:35:49.948095+0000","last_became_peered":"2024-09-12T00:35:49.948095+0000","last_unstale":"2024-09-12T01:22:23.516688+0000","last_undegraded":"2024-09-12T01:22:23.516688+0000","last_fullsized":"2024-09-12T01:22:23.516688+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'579","last_scrub_stamp":"2024-09-12T01:22:23.516444+0000","last_deep_scrub":"265'579","last_deep_scrub_stamp":"2024-09-12T01:22:23.516444+0000","last_clean_scrub_stamp":"2024-09-12T01:22:23.516444+0000","objects_scrubbed":11,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:57.103924+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93682,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1577,"num_read_kb":2692,"num_write":2050,"num_write_kb":1874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506876,"num_omap_keys":1146,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:33.956023+0000","last_change":"2024-09-12T01:22:33.956023+0000","last_active":"2024-09-12T01:22:33.956023+0000","last_peered":"2024-09-12T01:22:33.956023+0000","last_clean":"2024-09-12T01:22:33.956023+0000","last_became_active":"2024-09-12T00:35:51.967708+0000","last_became_peered":"2024-09-12T00:35:51.967708+0000","last_unstale":"2024-09-12T01:22:33.956023+0000","last_undegraded":"2024-09-12T01:22:33.956023+0000","last_fullsized":"2024-09-12T01:22:33.956023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:33.955853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:33.955853+0000","last_clean_scrub_stamp":"2024-09-12T01:22:33.955853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:22.354853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'151","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:41.353982+0000","last_change":"2024-09-12T01:22:41.353982+0000","last_active":"2024-09-12T01:22:41.353982+0000","last_peered":"2024-09-12T01:22:41.353982+0000","last_clean":"2024-09-12T01:22:41.353982+0000","last_became_active":"2024-09-12T00:35:54.014321+0000","last_became_peered":"2024-09-12T00:35:54.014321+0000","last_unstale":"2024-09-12T01:22:41.353982+0000","last_undegraded":"2024-09-12T01:22:41.353982+0000","last_fullsized":"2024-09-12T01:22:41.353982+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'151","last_scrub_stamp":"2024-09-12T01:22:41.353793+0000","last_deep_scrub":"265'151","last_deep_scrub_stamp":"2024-09-12T01:22:41.353793+0000","last_clean_scrub_stamp":"2024-09-12T01:22:41.353793+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:58.356575+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":134,"num_write":336,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'165","reported_seq":795,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.492877+0000","last_change":"2024-09-12T01:22:13.492877+0000","last_active":"2024-09-12T01:22:13.492877+0000","last_peered":"2024-09-12T01:22:13.492877+0000","last_clean":"2024-09-12T01:22:13.492877+0000","last_became_active":"2024-09-12T00:35:45.936178+0000","last_became_peered":"2024-09-12T00:35:45.936178+0000","last_unstale":"2024-09-12T01:22:13.492877+0000","last_undegraded":"2024-09-12T01:22:13.492877+0000","last_fullsized":"2024-09-12T01:22:13.492877+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'165","last_scrub_stamp":"2024-09-12T01:22:13.492696+0000","last_deep_scrub":"265'165","last_deep_scrub_stamp":"2024-09-12T01:22:13.492696+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.492696+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:10.154787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":595,"num_write":226,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'368","reported_seq":1010,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.263121+0000","last_change":"2024-09-12T01:22:07.263121+0000","last_active":"2024-09-12T01:22:07.263121+0000","last_peered":"2024-09-12T01:22:07.263121+0000","last_clean":"2024-09-12T01:22:07.263121+0000","last_became_active":"2024-09-12T00:35:43.928834+0000","last_became_peered":"2024-09-12T00:35:43.928834+0000","last_unstale":"2024-09-12T01:22:07.263121+0000","last_undegraded":"2024-09-12T01:22:07.263121+0000","last_fullsized":"2024-09-12T01:22:07.263121+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'368","last_scrub_stamp":"2024-09-12T01:22:07.262920+0000","last_deep_scrub":"265'368","last_deep_scrub_stamp":"2024-09-12T01:22:07.262920+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.262920+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:21.291964+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262157,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":503,"num_read_kb":29317,"num_write":1237,"num_write_kb":48953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.474150+0000","last_change":"2024-09-12T01:22:07.474150+0000","last_active":"2024-09-12T01:22:07.474150+0000","last_peered":"2024-09-12T01:22:07.474150+0000","last_clean":"2024-09-12T01:22:07.474150+0000","last_became_active":"2024-09-12T00:35:29.697973+0000","last_became_peered":"2024-09-12T00:35:29.697973+0000","last_unstale":"2024-09-12T01:22:07.474150+0000","last_undegraded":"2024-09-12T01:22:07.474150+0000","last_fullsized":"2024-09-12T01:22:07.474150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:07.473953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:07.473953+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.473953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:28.515287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083354399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.108138+0000","last_change":"2024-09-12T01:22:16.108138+0000","last_active":"2024-09-12T01:22:16.108138+0000","last_peered":"2024-09-12T01:22:16.108138+0000","last_clean":"2024-09-12T01:22:16.108138+0000","last_became_active":"2024-09-12T00:35:47.940014+0000","last_became_peered":"2024-09-12T00:35:47.940014+0000","last_unstale":"2024-09-12T01:22:16.108138+0000","last_undegraded":"2024-09-12T01:22:16.108138+0000","last_fullsized":"2024-09-12T01:22:16.108138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:16.107962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:16.107962+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.107962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:31.152033+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'194","reported_seq":766,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:24.261102+0000","last_change":"2024-09-12T01:22:24.261102+0000","last_active":"2024-09-12T01:22:24.261102+0000","last_peered":"2024-09-12T01:22:24.261102+0000","last_clean":"2024-09-12T01:22:24.261102+0000","last_became_active":"2024-09-12T00:35:50.028173+0000","last_became_peered":"2024-09-12T00:35:50.028173+0000","last_unstale":"2024-09-12T01:22:24.261102+0000","last_undegraded":"2024-09-12T01:22:24.261102+0000","last_fullsized":"2024-09-12T01:22:24.261102+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'194","last_scrub_stamp":"2024-09-12T01:22:24.260921+0000","last_deep_scrub":"265'194","last_deep_scrub_stamp":"2024-09-12T01:22:24.260921+0000","last_clean_scrub_stamp":"2024-09-12T01:22:24.260921+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:12.858541+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":223,"num_read_kb":207,"num_write":158,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'792","reported_seq":2688,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:33.634447+0000","last_change":"2024-09-12T01:22:33.634447+0000","last_active":"2024-09-12T01:22:33.634447+0000","last_peered":"2024-09-12T01:22:33.634447+0000","last_clean":"2024-09-12T01:22:33.634447+0000","last_became_active":"2024-09-12T00:35:51.977203+0000","last_became_peered":"2024-09-12T00:35:51.977203+0000","last_unstale":"2024-09-12T01:22:33.634447+0000","last_undegraded":"2024-09-12T01:22:33.634447+0000","last_fullsized":"2024-09-12T01:22:33.634447+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'792","last_scrub_stamp":"2024-09-12T01:22:33.634257+0000","last_deep_scrub":"265'792","last_deep_scrub_stamp":"2024-09-12T01:22:33.634257+0000","last_clean_scrub_stamp":"2024-09-12T01:22:33.634257+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:23.055471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'115","reported_seq":621,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:42.704003+0000","last_change":"2024-09-12T01:22:42.704003+0000","last_active":"2024-09-12T01:22:42.704003+0000","last_peered":"2024-09-12T01:22:42.704003+0000","last_clean":"2024-09-12T01:22:42.704003+0000","last_became_active":"2024-09-12T00:35:54.014699+0000","last_became_peered":"2024-09-12T00:35:54.014699+0000","last_unstale":"2024-09-12T01:22:42.704003+0000","last_undegraded":"2024-09-12T01:22:42.704003+0000","last_fullsized":"2024-09-12T01:22:42.704003+0000","mapping_epoch":34,"log_start":"265'101","ondisk_log_start":"265'101","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'115","last_scrub_stamp":"2024-09-12T01:22:42.703797+0000","last_deep_scrub":"265'115","last_deep_scrub_stamp":"2024-09-12T01:22:42.703797+0000","last_clean_scrub_stamp":"2024-09-12T01:22:42.703797+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":101,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:20.247818+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1113,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":127,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'102","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.632609+0000","last_change":"2024-09-12T01:22:13.632609+0000","last_active":"2024-09-12T01:22:13.632609+0000","last_peered":"2024-09-12T01:22:13.632609+0000","last_clean":"2024-09-12T01:22:13.632609+0000","last_became_active":"2024-09-12T00:35:45.942032+0000","last_became_peered":"2024-09-12T00:35:45.942032+0000","last_unstale":"2024-09-12T01:22:13.632609+0000","last_undegraded":"2024-09-12T01:22:13.632609+0000","last_fullsized":"2024-09-12T01:22:13.632609+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'102","last_scrub_stamp":"2024-09-12T01:22:13.632428+0000","last_deep_scrub":"265'102","last_deep_scrub_stamp":"2024-09-12T01:22:13.632428+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.632428+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:15.552919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":475,"num_read_kb":403,"num_write":145,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'328","reported_seq":956,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.648628+0000","last_change":"2024-09-12T01:22:06.648628+0000","last_active":"2024-09-12T01:22:06.648628+0000","last_peered":"2024-09-12T01:22:06.648628+0000","last_clean":"2024-09-12T01:22:06.648628+0000","last_became_active":"2024-09-12T00:35:43.953619+0000","last_became_peered":"2024-09-12T00:35:43.953619+0000","last_unstale":"2024-09-12T01:22:06.648628+0000","last_undegraded":"2024-09-12T01:22:06.648628+0000","last_fullsized":"2024-09-12T01:22:06.648628+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'328","last_scrub_stamp":"2024-09-12T01:22:06.648414+0000","last_deep_scrub":"265'328","last_deep_scrub_stamp":"2024-09-12T01:22:06.648414+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.648414+0000","objects_scrubbed":10,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:28.512834+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2238687,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":418,"num_read_kb":24307,"num_write":963,"num_write_kb":33018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:04.229626+0000","last_change":"2024-09-12T01:22:04.229626+0000","last_active":"2024-09-12T01:22:04.229626+0000","last_peered":"2024-09-12T01:22:04.229626+0000","last_clean":"2024-09-12T01:22:04.229626+0000","last_became_active":"2024-09-12T00:35:29.671727+0000","last_became_peered":"2024-09-12T00:35:29.671727+0000","last_unstale":"2024-09-12T01:22:04.229626+0000","last_undegraded":"2024-09-12T01:22:04.229626+0000","last_fullsized":"2024-09-12T01:22:04.229626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:04.229530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:04.229530+0000","last_clean_scrub_stamp":"2024-09-12T01:22:04.229530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:25.823105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010553139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:24.880194+0000","last_change":"2024-09-12T01:22:24.880194+0000","last_active":"2024-09-12T01:22:24.880194+0000","last_peered":"2024-09-12T01:22:24.880194+0000","last_clean":"2024-09-12T01:22:24.880194+0000","last_became_active":"2024-09-12T00:35:47.936452+0000","last_became_peered":"2024-09-12T00:35:47.936452+0000","last_unstale":"2024-09-12T01:22:24.880194+0000","last_undegraded":"2024-09-12T01:22:24.880194+0000","last_fullsized":"2024-09-12T01:22:24.880194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:24.880010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:24.880010+0000","last_clean_scrub_stamp":"2024-09-12T01:22:24.880010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:03.823274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'119","reported_seq":672,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:29.955037+0000","last_change":"2024-09-12T01:22:29.955037+0000","last_active":"2024-09-12T01:22:29.955037+0000","last_peered":"2024-09-12T01:22:29.955037+0000","last_clean":"2024-09-12T01:22:29.955037+0000","last_became_active":"2024-09-12T00:35:49.940788+0000","last_became_peered":"2024-09-12T00:35:49.940788+0000","last_unstale":"2024-09-12T01:22:29.955037+0000","last_undegraded":"2024-09-12T01:22:29.955037+0000","last_fullsized":"2024-09-12T01:22:29.955037+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'119","last_scrub_stamp":"2024-09-12T01:22:29.954843+0000","last_deep_scrub":"265'119","last_deep_scrub_stamp":"2024-09-12T01:22:29.954843+0000","last_clean_scrub_stamp":"2024-09-12T01:22:29.954843+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:39.091136+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'790","reported_seq":2425,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:38.715465+0000","last_change":"2024-09-12T01:22:38.715465+0000","last_active":"2024-09-12T01:22:38.715465+0000","last_peered":"2024-09-12T01:22:38.715465+0000","last_clean":"2024-09-12T01:22:38.715465+0000","last_became_active":"2024-09-12T00:35:51.979997+0000","last_became_peered":"2024-09-12T00:35:51.979997+0000","last_unstale":"2024-09-12T01:22:38.715465+0000","last_undegraded":"2024-09-12T01:22:38.715465+0000","last_fullsized":"2024-09-12T01:22:38.715465+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'790","last_scrub_stamp":"2024-09-12T01:22:38.715284+0000","last_deep_scrub":"265'790","last_deep_scrub_stamp":"2024-09-12T01:22:38.715284+0000","last_clean_scrub_stamp":"2024-09-12T01:22:38.715284+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:32.689881+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'283","reported_seq":808,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:32.456292+0000","last_change":"2024-09-12T01:22:32.456292+0000","last_active":"2024-09-12T01:22:32.456292+0000","last_peered":"2024-09-12T01:22:32.456292+0000","last_clean":"2024-09-12T01:22:32.456292+0000","last_became_active":"2024-09-12T00:35:53.992431+0000","last_became_peered":"2024-09-12T00:35:53.992431+0000","last_unstale":"2024-09-12T01:22:32.456292+0000","last_undegraded":"2024-09-12T01:22:32.456292+0000","last_fullsized":"2024-09-12T01:22:32.456292+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'283","last_scrub_stamp":"2024-09-12T01:22:32.456102+0000","last_deep_scrub":"265'283","last_deep_scrub_stamp":"2024-09-12T01:22:32.456102+0000","last_clean_scrub_stamp":"2024-09-12T01:22:32.456102+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:50.473537+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":344,"num_read_kb":342,"num_write":602,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'372","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.008846+0000","last_change":"2024-09-12T01:22:09.008846+0000","last_active":"2024-09-12T01:22:09.008846+0000","last_peered":"2024-09-12T01:22:09.008846+0000","last_clean":"2024-09-12T01:22:09.008846+0000","last_became_active":"2024-09-12T00:35:45.928789+0000","last_became_peered":"2024-09-12T00:35:45.928789+0000","last_unstale":"2024-09-12T01:22:09.008846+0000","last_undegraded":"2024-09-12T01:22:09.008846+0000","last_fullsized":"2024-09-12T01:22:09.008846+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'372","last_scrub_stamp":"2024-09-12T01:22:09.008671+0000","last_deep_scrub":"265'372","last_deep_scrub_stamp":"2024-09-12T01:22:09.008671+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.008671+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:49.407471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1634,"num_read_kb":1297,"num_write":639,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'367","reported_seq":1052,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.642522+0000","last_change":"2024-09-12T01:22:05.642522+0000","last_active":"2024-09-12T01:22:05.642522+0000","last_peered":"2024-09-12T01:22:05.642522+0000","last_clean":"2024-09-12T01:22:05.642522+0000","last_became_active":"2024-09-12T00:35:43.932994+0000","last_became_peered":"2024-09-12T00:35:43.932994+0000","last_unstale":"2024-09-12T01:22:05.642522+0000","last_undegraded":"2024-09-12T01:22:05.642522+0000","last_fullsized":"2024-09-12T01:22:05.642522+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T01:22:05.642296+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T01:22:05.642296+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.642296+0000","objects_scrubbed":7,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:09.276375+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":624,"num_read_kb":1635,"num_write":1170,"num_write_kb":36329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.086834+0000","last_change":"2024-09-12T01:22:05.086834+0000","last_active":"2024-09-12T01:22:05.086834+0000","last_peered":"2024-09-12T01:22:05.086834+0000","last_clean":"2024-09-12T01:22:05.086834+0000","last_became_active":"2024-09-12T00:35:29.670571+0000","last_became_peered":"2024-09-12T00:35:29.670571+0000","last_unstale":"2024-09-12T01:22:05.086834+0000","last_undegraded":"2024-09-12T01:22:05.086834+0000","last_fullsized":"2024-09-12T01:22:05.086834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:05.086601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:05.086601+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.086601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:50.763843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012596770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:24.551946+0000","last_change":"2024-09-12T01:22:24.551946+0000","last_active":"2024-09-12T01:22:24.551946+0000","last_peered":"2024-09-12T01:22:24.551946+0000","last_clean":"2024-09-12T01:22:24.551946+0000","last_became_active":"2024-09-12T00:35:47.933798+0000","last_became_peered":"2024-09-12T00:35:47.933798+0000","last_unstale":"2024-09-12T01:22:24.551946+0000","last_undegraded":"2024-09-12T01:22:24.551946+0000","last_fullsized":"2024-09-12T01:22:24.551946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:24.551752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:24.551752+0000","last_clean_scrub_stamp":"2024-09-12T01:22:24.551752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:04.069854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'731","reported_seq":1463,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:26.328699+0000","last_change":"2024-09-12T01:22:26.328699+0000","last_active":"2024-09-12T01:22:26.328699+0000","last_peered":"2024-09-12T01:22:26.328699+0000","last_clean":"2024-09-12T01:22:26.328699+0000","last_became_active":"2024-09-12T00:35:50.028341+0000","last_became_peered":"2024-09-12T00:35:50.028341+0000","last_unstale":"2024-09-12T01:22:26.328699+0000","last_undegraded":"2024-09-12T01:22:26.328699+0000","last_fullsized":"2024-09-12T01:22:26.328699+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'731","last_scrub_stamp":"2024-09-12T01:22:26.328474+0000","last_deep_scrub":"265'731","last_deep_scrub_stamp":"2024-09-12T01:22:26.328474+0000","last_clean_scrub_stamp":"2024-09-12T01:22:26.328474+0000","objects_scrubbed":9,"log_size":31,"log_dups_size":700,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:51.278555+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139080,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1312,"num_read_kb":3096,"num_write":1068,"num_write_kb":883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:35.628105+0000","last_change":"2024-09-12T01:22:35.628105+0000","last_active":"2024-09-12T01:22:35.628105+0000","last_peered":"2024-09-12T01:22:35.628105+0000","last_clean":"2024-09-12T01:22:35.628105+0000","last_became_active":"2024-09-12T00:35:51.974473+0000","last_became_peered":"2024-09-12T00:35:51.974473+0000","last_unstale":"2024-09-12T01:22:35.628105+0000","last_undegraded":"2024-09-12T01:22:35.628105+0000","last_fullsized":"2024-09-12T01:22:35.628105+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:35.627930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:35.627930+0000","last_clean_scrub_stamp":"2024-09-12T01:22:35.627930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:26.729104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'110","reported_seq":620,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:38.552872+0000","last_change":"2024-09-12T01:22:38.552872+0000","last_active":"2024-09-12T01:22:38.552872+0000","last_peered":"2024-09-12T01:22:38.552872+0000","last_clean":"2024-09-12T01:22:38.552872+0000","last_became_active":"2024-09-12T00:35:53.995431+0000","last_became_peered":"2024-09-12T00:35:53.995431+0000","last_unstale":"2024-09-12T01:22:38.552872+0000","last_undegraded":"2024-09-12T01:22:38.552872+0000","last_fullsized":"2024-09-12T01:22:38.552872+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'110","last_scrub_stamp":"2024-09-12T01:22:38.552693+0000","last_deep_scrub":"265'110","last_deep_scrub_stamp":"2024-09-12T01:22:38.552693+0000","last_clean_scrub_stamp":"2024-09-12T01:22:38.552693+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:36.943299+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":133,"num_write":267,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'117","reported_seq":675,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:38.458955+0000","last_change":"2024-09-12T01:22:38.458955+0000","last_active":"2024-09-12T01:22:38.458955+0000","last_peered":"2024-09-12T01:22:38.458955+0000","last_clean":"2024-09-12T01:22:38.458955+0000","last_became_active":"2024-09-12T00:35:54.002052+0000","last_became_peered":"2024-09-12T00:35:54.002052+0000","last_unstale":"2024-09-12T01:22:38.458955+0000","last_undegraded":"2024-09-12T01:22:38.458955+0000","last_fullsized":"2024-09-12T01:22:38.458955+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'117","last_scrub_stamp":"2024-09-12T01:22:38.458747+0000","last_deep_scrub":"265'117","last_deep_scrub_stamp":"2024-09-12T01:22:38.458747+0000","last_clean_scrub_stamp":"2024-09-12T01:22:38.458747+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:01.695518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":193,"num_write":267,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'96","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.014091+0000","last_change":"2024-09-12T01:22:14.013931+0000","last_active":"2024-09-12T01:22:14.014091+0000","last_peered":"2024-09-12T01:22:14.014091+0000","last_clean":"2024-09-12T01:22:14.014091+0000","last_became_active":"2024-09-12T00:35:45.954079+0000","last_became_peered":"2024-09-12T00:35:45.954079+0000","last_unstale":"2024-09-12T01:22:14.014091+0000","last_undegraded":"2024-09-12T01:22:14.014091+0000","last_fullsized":"2024-09-12T01:22:14.014091+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'96","last_scrub_stamp":"2024-09-12T01:22:14.013751+0000","last_deep_scrub":"265'96","last_deep_scrub_stamp":"2024-09-12T01:22:14.013751+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.013751+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:36.327183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":455,"num_read_kb":391,"num_write":154,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'442","reported_seq":1149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.033389+0000","last_change":"2024-09-12T01:22:07.033238+0000","last_active":"2024-09-12T01:22:07.033389+0000","last_peered":"2024-09-12T01:22:07.033389+0000","last_clean":"2024-09-12T01:22:07.033389+0000","last_became_active":"2024-09-12T00:35:43.947940+0000","last_became_peered":"2024-09-12T00:35:43.947940+0000","last_unstale":"2024-09-12T01:22:07.033389+0000","last_undegraded":"2024-09-12T01:22:07.033389+0000","last_fullsized":"2024-09-12T01:22:07.033389+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'442","last_scrub_stamp":"2024-09-12T01:22:07.032998+0000","last_deep_scrub":"265'442","last_deep_scrub_stamp":"2024-09-12T01:22:07.032998+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.032998+0000","objects_scrubbed":7,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:14.761183+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":799,"num_read_kb":4159,"num_write":1267,"num_write_kb":17308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.199735+0000","last_change":"2024-09-12T01:22:22.199456+0000","last_active":"2024-09-12T01:22:22.199735+0000","last_peered":"2024-09-12T01:22:22.199735+0000","last_clean":"2024-09-12T01:22:22.199735+0000","last_became_active":"2024-09-12T00:35:47.929844+0000","last_became_peered":"2024-09-12T00:35:47.929844+0000","last_unstale":"2024-09-12T01:22:22.199735+0000","last_undegraded":"2024-09-12T01:22:22.199735+0000","last_fullsized":"2024-09-12T01:22:22.199735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:22.199245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:22.199245+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.199245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:59.906791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'293","reported_seq":878,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:31.567824+0000","last_change":"2024-09-12T01:22:31.567655+0000","last_active":"2024-09-12T01:22:31.567824+0000","last_peered":"2024-09-12T01:22:31.567824+0000","last_clean":"2024-09-12T01:22:31.567824+0000","last_became_active":"2024-09-12T00:35:49.947136+0000","last_became_peered":"2024-09-12T00:35:49.947136+0000","last_unstale":"2024-09-12T01:22:31.567824+0000","last_undegraded":"2024-09-12T01:22:31.567824+0000","last_fullsized":"2024-09-12T01:22:31.567824+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'293","last_scrub_stamp":"2024-09-12T01:22:31.567462+0000","last_deep_scrub":"265'293","last_deep_scrub_stamp":"2024-09-12T01:22:31.567462+0000","last_clean_scrub_stamp":"2024-09-12T01:22:31.567462+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:50.917955+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43778,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":475,"num_read_kb":1081,"num_write":388,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:37.663678+0000","last_change":"2024-09-12T01:22:37.663678+0000","last_active":"2024-09-12T01:22:37.663678+0000","last_peered":"2024-09-12T01:22:37.663678+0000","last_clean":"2024-09-12T01:22:37.663678+0000","last_became_active":"2024-09-12T00:35:51.980092+0000","last_became_peered":"2024-09-12T00:35:51.980092+0000","last_unstale":"2024-09-12T01:22:37.663678+0000","last_undegraded":"2024-09-12T01:22:37.663678+0000","last_fullsized":"2024-09-12T01:22:37.663678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:37.663482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:37.663482+0000","last_clean_scrub_stamp":"2024-09-12T01:22:37.663482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:26.318770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'134","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:20.759008+0000","last_change":"2024-09-12T00:35:53.993259+0000","last_active":"2024-09-12T01:20:20.759008+0000","last_peered":"2024-09-12T01:20:20.759008+0000","last_clean":"2024-09-12T01:20:20.759008+0000","last_became_active":"2024-09-12T00:35:53.992579+0000","last_became_peered":"2024-09-12T00:35:53.992579+0000","last_unstale":"2024-09-12T01:20:20.759008+0000","last_undegraded":"2024-09-12T01:20:20.759008+0000","last_fullsized":"2024-09-12T01:20:20.759008+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":139,"num_write":341,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'161","reported_seq":754,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.226485+0000","last_change":"2024-09-12T01:22:16.226327+0000","last_active":"2024-09-12T01:22:16.226485+0000","last_peered":"2024-09-12T01:22:16.226485+0000","last_clean":"2024-09-12T01:22:16.226485+0000","last_became_active":"2024-09-12T00:35:45.957614+0000","last_became_peered":"2024-09-12T00:35:45.957614+0000","last_unstale":"2024-09-12T01:22:16.226485+0000","last_undegraded":"2024-09-12T01:22:16.226485+0000","last_fullsized":"2024-09-12T01:22:16.226485+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'161","last_scrub_stamp":"2024-09-12T01:22:16.226150+0000","last_deep_scrub":"265'161","last_deep_scrub_stamp":"2024-09-12T01:22:16.226150+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.226150+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:34.804768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":661,"num_read_kb":539,"num_write":259,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'367","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.238457+0000","last_change":"2024-09-12T01:22:06.238323+0000","last_active":"2024-09-12T01:22:06.238457+0000","last_peered":"2024-09-12T01:22:06.238457+0000","last_clean":"2024-09-12T01:22:06.238457+0000","last_became_active":"2024-09-12T00:36:17.269377+0000","last_became_peered":"2024-09-12T00:36:17.269377+0000","last_unstale":"2024-09-12T01:22:06.238457+0000","last_undegraded":"2024-09-12T01:22:06.238457+0000","last_fullsized":"2024-09-12T01:22:06.238457+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T01:22:06.238069+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T01:22:06.238069+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.238069+0000","objects_scrubbed":8,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:52.160763+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":513,"num_read_kb":25436,"num_write":1264,"num_write_kb":33386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:25.513194+0000","last_change":"2024-09-12T01:22:25.512967+0000","last_active":"2024-09-12T01:22:25.513194+0000","last_peered":"2024-09-12T01:22:25.513194+0000","last_clean":"2024-09-12T01:22:25.513194+0000","last_became_active":"2024-09-12T00:35:47.941493+0000","last_became_peered":"2024-09-12T00:35:47.941493+0000","last_unstale":"2024-09-12T01:22:25.513194+0000","last_undegraded":"2024-09-12T01:22:25.513194+0000","last_fullsized":"2024-09-12T01:22:25.513194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:25.512683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:25.512683+0000","last_clean_scrub_stamp":"2024-09-12T01:22:25.512683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:08.462610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'49","reported_seq":554,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:28.434070+0000","last_change":"2024-09-12T01:22:28.433811+0000","last_active":"2024-09-12T01:22:28.434070+0000","last_peered":"2024-09-12T01:22:28.434070+0000","last_clean":"2024-09-12T01:22:28.434070+0000","last_became_active":"2024-09-12T00:35:49.949331+0000","last_became_peered":"2024-09-12T00:35:49.949331+0000","last_unstale":"2024-09-12T01:22:28.434070+0000","last_undegraded":"2024-09-12T01:22:28.434070+0000","last_fullsized":"2024-09-12T01:22:28.434070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'49","last_scrub_stamp":"2024-09-12T01:22:28.433586+0000","last_deep_scrub":"265'49","last_deep_scrub_stamp":"2024-09-12T01:22:28.433586+0000","last_clean_scrub_stamp":"2024-09-12T01:22:28.433586+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:36.448449+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:31.424851+0000","last_change":"2024-09-12T01:22:31.424654+0000","last_active":"2024-09-12T01:22:31.424851+0000","last_peered":"2024-09-12T01:22:31.424851+0000","last_clean":"2024-09-12T01:22:31.424851+0000","last_became_active":"2024-09-12T00:35:51.977211+0000","last_became_peered":"2024-09-12T00:35:51.977211+0000","last_unstale":"2024-09-12T01:22:31.424851+0000","last_undegraded":"2024-09-12T01:22:31.424851+0000","last_fullsized":"2024-09-12T01:22:31.424851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:31.424473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:31.424473+0000","last_clean_scrub_stamp":"2024-09-12T01:22:31.424473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:12.683310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'215","reported_seq":733,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:36.498896+0000","last_change":"2024-09-12T01:22:36.498896+0000","last_active":"2024-09-12T01:22:36.498896+0000","last_peered":"2024-09-12T01:22:36.498896+0000","last_clean":"2024-09-12T01:22:36.498896+0000","last_became_active":"2024-09-12T00:35:53.985696+0000","last_became_peered":"2024-09-12T00:35:53.985696+0000","last_unstale":"2024-09-12T01:22:36.498896+0000","last_undegraded":"2024-09-12T01:22:36.498896+0000","last_fullsized":"2024-09-12T01:22:36.498896+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'215","last_scrub_stamp":"2024-09-12T01:22:36.498588+0000","last_deep_scrub":"265'215","last_deep_scrub_stamp":"2024-09-12T01:22:36.498588+0000","last_clean_scrub_stamp":"2024-09-12T01:22:36.498588+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:50.703674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":288,"num_read_kb":283,"num_write":478,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'116","reported_seq":729,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.632662+0000","last_change":"2024-09-12T01:22:16.632479+0000","last_active":"2024-09-12T01:22:16.632662+0000","last_peered":"2024-09-12T01:22:16.632662+0000","last_clean":"2024-09-12T01:22:16.632662+0000","last_became_active":"2024-09-12T00:35:45.942161+0000","last_became_peered":"2024-09-12T00:35:45.942161+0000","last_unstale":"2024-09-12T01:22:16.632662+0000","last_undegraded":"2024-09-12T01:22:16.632662+0000","last_fullsized":"2024-09-12T01:22:16.632662+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'116","last_scrub_stamp":"2024-09-12T01:22:16.632298+0000","last_deep_scrub":"265'116","last_deep_scrub_stamp":"2024-09-12T01:22:16.632298+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.632298+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:43.861761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":566,"num_read_kb":479,"num_write":187,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'295","reported_seq":903,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.806007+0000","last_change":"2024-09-12T01:22:06.806007+0000","last_active":"2024-09-12T01:22:06.806007+0000","last_peered":"2024-09-12T01:22:06.806007+0000","last_clean":"2024-09-12T01:22:06.806007+0000","last_became_active":"2024-09-12T00:35:43.950660+0000","last_became_peered":"2024-09-12T00:35:43.950660+0000","last_unstale":"2024-09-12T01:22:06.806007+0000","last_undegraded":"2024-09-12T01:22:06.806007+0000","last_fullsized":"2024-09-12T01:22:06.806007+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'295","last_scrub_stamp":"2024-09-12T01:22:06.805784+0000","last_deep_scrub":"265'295","last_deep_scrub_stamp":"2024-09-12T01:22:06.805784+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.805784+0000","objects_scrubbed":6,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:35.026312+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110814,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":386,"num_read_kb":2177,"num_write":879,"num_write_kb":8684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:24.345750+0000","last_change":"2024-09-12T01:22:24.345499+0000","last_active":"2024-09-12T01:22:24.345750+0000","last_peered":"2024-09-12T01:22:24.345750+0000","last_clean":"2024-09-12T01:22:24.345750+0000","last_became_active":"2024-09-12T00:35:47.945819+0000","last_became_peered":"2024-09-12T00:35:47.945819+0000","last_unstale":"2024-09-12T01:22:24.345750+0000","last_undegraded":"2024-09-12T01:22:24.345750+0000","last_fullsized":"2024-09-12T01:22:24.345750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:24.345289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:24.345289+0000","last_clean_scrub_stamp":"2024-09-12T01:22:24.345289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:11.155693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'353","reported_seq":948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:32.576801+0000","last_change":"2024-09-12T01:22:32.576642+0000","last_active":"2024-09-12T01:22:32.576801+0000","last_peered":"2024-09-12T01:22:32.576801+0000","last_clean":"2024-09-12T01:22:32.576801+0000","last_became_active":"2024-09-12T00:35:49.954646+0000","last_became_peered":"2024-09-12T00:35:49.954646+0000","last_unstale":"2024-09-12T01:22:32.576801+0000","last_undegraded":"2024-09-12T01:22:32.576801+0000","last_fullsized":"2024-09-12T01:22:32.576801+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'353","last_scrub_stamp":"2024-09-12T01:22:32.576449+0000","last_deep_scrub":"265'353","last_deep_scrub_stamp":"2024-09-12T01:22:32.576449+0000","last_clean_scrub_stamp":"2024-09-12T01:22:32.576449+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:35.618352+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66883,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":574,"num_read_kb":1344,"num_write":472,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:23.056635+0000","last_change":"2024-09-12T01:22:23.056469+0000","last_active":"2024-09-12T01:22:23.056635+0000","last_peered":"2024-09-12T01:22:23.056635+0000","last_clean":"2024-09-12T01:22:23.056635+0000","last_became_active":"2024-09-12T00:35:51.973993+0000","last_became_peered":"2024-09-12T00:35:51.973993+0000","last_unstale":"2024-09-12T01:22:23.056635+0000","last_undegraded":"2024-09-12T01:22:23.056635+0000","last_fullsized":"2024-09-12T01:22:23.056635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:23.056293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:23.056293+0000","last_clean_scrub_stamp":"2024-09-12T01:22:23.056293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:08.652989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'105","reported_seq":619,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:40.570482+0000","last_change":"2024-09-12T01:22:40.570482+0000","last_active":"2024-09-12T01:22:40.570482+0000","last_peered":"2024-09-12T01:22:40.570482+0000","last_clean":"2024-09-12T01:22:40.570482+0000","last_became_active":"2024-09-12T00:35:54.001337+0000","last_became_peered":"2024-09-12T00:35:54.001337+0000","last_unstale":"2024-09-12T01:22:40.570482+0000","last_undegraded":"2024-09-12T01:22:40.570482+0000","last_fullsized":"2024-09-12T01:22:40.570482+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'105","last_scrub_stamp":"2024-09-12T01:22:40.570295+0000","last_deep_scrub":"265'105","last_deep_scrub_stamp":"2024-09-12T01:22:40.570295+0000","last_clean_scrub_stamp":"2024-09-12T01:22:40.570295+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:19.687708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":126,"num_write":245,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'4114","reported_seq":4744,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.616911+0000","last_change":"2024-09-12T01:22:14.616655+0000","last_active":"2024-09-12T01:22:14.616911+0000","last_peered":"2024-09-12T01:22:14.616911+0000","last_clean":"2024-09-12T01:22:14.616911+0000","last_became_active":"2024-09-12T00:35:45.938175+0000","last_became_peered":"2024-09-12T00:35:45.938175+0000","last_unstale":"2024-09-12T01:22:14.616911+0000","last_undegraded":"2024-09-12T01:22:14.616911+0000","last_fullsized":"2024-09-12T01:22:14.616911+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4114","last_scrub_stamp":"2024-09-12T01:22:14.616416+0000","last_deep_scrub":"265'4114","last_deep_scrub_stamp":"2024-09-12T01:22:14.616416+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.616416+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:57.910210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16557,"num_read_kb":13901,"num_write":6164,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'313","reported_seq":924,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.637162+0000","last_change":"2024-09-12T01:22:06.637162+0000","last_active":"2024-09-12T01:22:06.637162+0000","last_peered":"2024-09-12T01:22:06.637162+0000","last_clean":"2024-09-12T01:22:06.637162+0000","last_became_active":"2024-09-12T00:35:43.935194+0000","last_became_peered":"2024-09-12T00:35:43.935194+0000","last_unstale":"2024-09-12T01:22:06.637162+0000","last_undegraded":"2024-09-12T01:22:06.637162+0000","last_fullsized":"2024-09-12T01:22:06.637162+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'313","last_scrub_stamp":"2024-09-12T01:22:06.636919+0000","last_deep_scrub":"265'313","last_deep_scrub_stamp":"2024-09-12T01:22:06.636919+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.636919+0000","objects_scrubbed":8,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:10.162623+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992287,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":416,"num_read_kb":10375,"num_write":976,"num_write_kb":15779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.098190+0000","last_change":"2024-09-12T01:22:19.097959+0000","last_active":"2024-09-12T01:22:19.098190+0000","last_peered":"2024-09-12T01:22:19.098190+0000","last_clean":"2024-09-12T01:22:19.098190+0000","last_became_active":"2024-09-12T00:35:47.944477+0000","last_became_peered":"2024-09-12T00:35:47.944477+0000","last_unstale":"2024-09-12T01:22:19.098190+0000","last_undegraded":"2024-09-12T01:22:19.098190+0000","last_fullsized":"2024-09-12T01:22:19.098190+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:19.097750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:19.097750+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.097750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:03.784360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'278","reported_seq":854,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:29.360131+0000","last_change":"2024-09-12T01:22:29.359974+0000","last_active":"2024-09-12T01:22:29.360131+0000","last_peered":"2024-09-12T01:22:29.360131+0000","last_clean":"2024-09-12T01:22:29.360131+0000","last_became_active":"2024-09-12T00:35:49.941948+0000","last_became_peered":"2024-09-12T00:35:49.941948+0000","last_unstale":"2024-09-12T01:22:29.360131+0000","last_undegraded":"2024-09-12T01:22:29.360131+0000","last_fullsized":"2024-09-12T01:22:29.360131+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'278","last_scrub_stamp":"2024-09-12T01:22:29.359800+0000","last_deep_scrub":"265'278","last_deep_scrub_stamp":"2024-09-12T01:22:29.359800+0000","last_clean_scrub_stamp":"2024-09-12T01:22:29.359800+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:28.047217+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45730,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":1073,"num_write":372,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:39.410275+0000","last_change":"2024-09-12T01:22:39.410275+0000","last_active":"2024-09-12T01:22:39.410275+0000","last_peered":"2024-09-12T01:22:39.410275+0000","last_clean":"2024-09-12T01:22:39.410275+0000","last_became_active":"2024-09-12T00:35:51.975124+0000","last_became_peered":"2024-09-12T00:35:51.975124+0000","last_unstale":"2024-09-12T01:22:39.410275+0000","last_undegraded":"2024-09-12T01:22:39.410275+0000","last_fullsized":"2024-09-12T01:22:39.410275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:39.410096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:39.410096+0000","last_clean_scrub_stamp":"2024-09-12T01:22:39.410096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:06.295932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'251","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.166216+0000","last_change":"2024-09-12T01:22:14.166216+0000","last_active":"2024-09-12T01:22:14.166216+0000","last_peered":"2024-09-12T01:22:14.166216+0000","last_clean":"2024-09-12T01:22:14.166216+0000","last_became_active":"2024-09-12T00:35:45.941357+0000","last_became_peered":"2024-09-12T00:35:45.941357+0000","last_unstale":"2024-09-12T01:22:14.166216+0000","last_undegraded":"2024-09-12T01:22:14.166216+0000","last_fullsized":"2024-09-12T01:22:14.166216+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'251","last_scrub_stamp":"2024-09-12T01:22:14.165990+0000","last_deep_scrub":"265'251","last_deep_scrub_stamp":"2024-09-12T01:22:14.165990+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.165990+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:23.409041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1115,"num_read_kb":918,"num_write":405,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'305","reported_seq":932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.627274+0000","last_change":"2024-09-12T01:22:08.627274+0000","last_active":"2024-09-12T01:22:08.627274+0000","last_peered":"2024-09-12T01:22:08.627274+0000","last_clean":"2024-09-12T01:22:08.627274+0000","last_became_active":"2024-09-12T00:35:43.933037+0000","last_became_peered":"2024-09-12T00:35:43.933037+0000","last_unstale":"2024-09-12T01:22:08.627274+0000","last_undegraded":"2024-09-12T01:22:08.627274+0000","last_fullsized":"2024-09-12T01:22:08.627274+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'305","last_scrub_stamp":"2024-09-12T01:22:08.627056+0000","last_deep_scrub":"265'305","last_deep_scrub_stamp":"2024-09-12T01:22:08.627056+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.627056+0000","objects_scrubbed":9,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:16.887003+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730132,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":468,"num_read_kb":7309,"num_write":980,"num_write_kb":23054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"265'4","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.489438+0000","last_change":"2024-09-12T01:22:22.489438+0000","last_active":"2024-09-12T01:22:22.489438+0000","last_peered":"2024-09-12T01:22:22.489438+0000","last_clean":"2024-09-12T01:22:22.489438+0000","last_became_active":"2024-09-12T00:35:47.941749+0000","last_became_peered":"2024-09-12T00:35:47.941749+0000","last_unstale":"2024-09-12T01:22:22.489438+0000","last_undegraded":"2024-09-12T01:22:22.489438+0000","last_fullsized":"2024-09-12T01:22:22.489438+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T01:22:22.489259+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T01:22:22.489259+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.489259+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:29.570374+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'511","reported_seq":1150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:25.222400+0000","last_change":"2024-09-12T01:22:25.222400+0000","last_active":"2024-09-12T01:22:25.222400+0000","last_peered":"2024-09-12T01:22:25.222400+0000","last_clean":"2024-09-12T01:22:25.222400+0000","last_became_active":"2024-09-12T00:35:49.947963+0000","last_became_peered":"2024-09-12T00:35:49.947963+0000","last_unstale":"2024-09-12T01:22:25.222400+0000","last_undegraded":"2024-09-12T01:22:25.222400+0000","last_fullsized":"2024-09-12T01:22:25.222400+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'511","last_scrub_stamp":"2024-09-12T01:22:25.222213+0000","last_deep_scrub":"265'511","last_deep_scrub_stamp":"2024-09-12T01:22:25.222213+0000","last_clean_scrub_stamp":"2024-09-12T01:22:25.222213+0000","objects_scrubbed":7,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:10.494053+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95771,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":915,"num_read_kb":2195,"num_write":792,"num_write_kb":711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:34.608743+0000","last_change":"2024-09-12T01:22:34.608743+0000","last_active":"2024-09-12T01:22:34.608743+0000","last_peered":"2024-09-12T01:22:34.608743+0000","last_clean":"2024-09-12T01:22:34.608743+0000","last_became_active":"2024-09-12T00:35:51.968209+0000","last_became_peered":"2024-09-12T00:35:51.968209+0000","last_unstale":"2024-09-12T01:22:34.608743+0000","last_undegraded":"2024-09-12T01:22:34.608743+0000","last_fullsized":"2024-09-12T01:22:34.608743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:34.608572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:34.608572+0000","last_clean_scrub_stamp":"2024-09-12T01:22:34.608572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:49.342386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'158","reported_seq":654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:22.247541+0000","last_change":"2024-09-12T00:35:54.013532+0000","last_active":"2024-09-12T01:20:22.247541+0000","last_peered":"2024-09-12T01:20:22.247541+0000","last_clean":"2024-09-12T01:20:22.247541+0000","last_became_active":"2024-09-12T00:35:54.012958+0000","last_became_peered":"2024-09-12T00:35:54.012958+0000","last_unstale":"2024-09-12T01:20:22.247541+0000","last_undegraded":"2024-09-12T01:20:22.247541+0000","last_fullsized":"2024-09-12T01:20:22.247541+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1092,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":166,"num_read_kb":178,"num_write":351,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'60","reported_seq":622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.501893+0000","last_change":"2024-09-12T01:22:19.501893+0000","last_active":"2024-09-12T01:22:19.501893+0000","last_peered":"2024-09-12T01:22:19.501893+0000","last_clean":"2024-09-12T01:22:19.501893+0000","last_became_active":"2024-09-12T00:35:45.945952+0000","last_became_peered":"2024-09-12T00:35:45.945952+0000","last_unstale":"2024-09-12T01:22:19.501893+0000","last_undegraded":"2024-09-12T01:22:19.501893+0000","last_fullsized":"2024-09-12T01:22:19.501893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'60","last_scrub_stamp":"2024-09-12T01:22:19.501688+0000","last_deep_scrub":"265'60","last_deep_scrub_stamp":"2024-09-12T01:22:19.501688+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.501688+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:13.144748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":234,"num_write":86,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'360","reported_seq":1024,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.256391+0000","last_change":"2024-09-12T01:22:08.256391+0000","last_active":"2024-09-12T01:22:08.256391+0000","last_peered":"2024-09-12T01:22:08.256391+0000","last_clean":"2024-09-12T01:22:08.256391+0000","last_became_active":"2024-09-12T00:35:43.928779+0000","last_became_peered":"2024-09-12T00:35:43.928779+0000","last_unstale":"2024-09-12T01:22:08.256391+0000","last_undegraded":"2024-09-12T01:22:08.256391+0000","last_fullsized":"2024-09-12T01:22:08.256391+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'360","last_scrub_stamp":"2024-09-12T01:22:08.256185+0000","last_deep_scrub":"265'360","last_deep_scrub_stamp":"2024-09-12T01:22:08.256185+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.256185+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:19.743658+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":507,"num_read_kb":67515,"num_write":1156,"num_write_kb":41697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.071518+0000","last_change":"2024-09-12T01:22:18.071518+0000","last_active":"2024-09-12T01:22:18.071518+0000","last_peered":"2024-09-12T01:22:18.071518+0000","last_clean":"2024-09-12T01:22:18.071518+0000","last_became_active":"2024-09-12T00:35:47.944056+0000","last_became_peered":"2024-09-12T00:35:47.944056+0000","last_unstale":"2024-09-12T01:22:18.071518+0000","last_undegraded":"2024-09-12T01:22:18.071518+0000","last_fullsized":"2024-09-12T01:22:18.071518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:18.071303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:18.071303+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.071303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:52.172452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'278","reported_seq":866,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:30.395019+0000","last_change":"2024-09-12T01:22:30.395019+0000","last_active":"2024-09-12T01:22:30.395019+0000","last_peered":"2024-09-12T01:22:30.395019+0000","last_clean":"2024-09-12T01:22:30.395019+0000","last_became_active":"2024-09-12T00:35:49.946226+0000","last_became_peered":"2024-09-12T00:35:49.946226+0000","last_unstale":"2024-09-12T01:22:30.395019+0000","last_undegraded":"2024-09-12T01:22:30.395019+0000","last_fullsized":"2024-09-12T01:22:30.395019+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'278","last_scrub_stamp":"2024-09-12T01:22:30.394752+0000","last_deep_scrub":"265'278","last_deep_scrub_stamp":"2024-09-12T01:22:30.394752+0000","last_clean_scrub_stamp":"2024-09-12T01:22:30.394752+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:13.222756+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48166,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":461,"num_read_kb":978,"num_write":376,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:29.229069+0000","last_change":"2024-09-12T01:22:29.229069+0000","last_active":"2024-09-12T01:22:29.229069+0000","last_peered":"2024-09-12T01:22:29.229069+0000","last_clean":"2024-09-12T01:22:29.229069+0000","last_became_active":"2024-09-12T00:35:51.963735+0000","last_became_peered":"2024-09-12T00:35:51.963735+0000","last_unstale":"2024-09-12T01:22:29.229069+0000","last_undegraded":"2024-09-12T01:22:29.229069+0000","last_fullsized":"2024-09-12T01:22:29.229069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:29.228872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:29.228872+0000","last_clean_scrub_stamp":"2024-09-12T01:22:29.228872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:08.991987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'202","reported_seq":717,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:29.088205+0000","last_change":"2024-09-12T01:22:29.087918+0000","last_active":"2024-09-12T01:22:29.088205+0000","last_peered":"2024-09-12T01:22:29.088205+0000","last_clean":"2024-09-12T01:22:29.088205+0000","last_became_active":"2024-09-12T00:35:53.990488+0000","last_became_peered":"2024-09-12T00:35:53.990488+0000","last_unstale":"2024-09-12T01:22:29.088205+0000","last_undegraded":"2024-09-12T01:22:29.088205+0000","last_fullsized":"2024-09-12T01:22:29.088205+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'202","last_scrub_stamp":"2024-09-12T01:22:29.087658+0000","last_deep_scrub":"265'202","last_deep_scrub_stamp":"2024-09-12T01:22:29.087658+0000","last_clean_scrub_stamp":"2024-09-12T01:22:29.087658+0000","objects_scrubbed":6,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:44.322341+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1821,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":235,"num_read_kb":229,"num_write":573,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'191","reported_seq":796,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.619589+0000","last_change":"2024-09-12T01:22:21.619589+0000","last_active":"2024-09-12T01:22:21.619589+0000","last_peered":"2024-09-12T01:22:21.619589+0000","last_clean":"2024-09-12T01:22:21.619589+0000","last_became_active":"2024-09-12T00:35:45.940529+0000","last_became_peered":"2024-09-12T00:35:45.940529+0000","last_unstale":"2024-09-12T01:22:21.619589+0000","last_undegraded":"2024-09-12T01:22:21.619589+0000","last_fullsized":"2024-09-12T01:22:21.619589+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'191","last_scrub_stamp":"2024-09-12T01:22:21.619383+0000","last_deep_scrub":"265'191","last_deep_scrub_stamp":"2024-09-12T01:22:21.619383+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.619383+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:56.738297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":840,"num_read_kb":692,"num_write":286,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'348","reported_seq":1110,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.076975+0000","last_change":"2024-09-12T01:22:06.076975+0000","last_active":"2024-09-12T01:22:06.076975+0000","last_peered":"2024-09-12T01:22:06.076975+0000","last_clean":"2024-09-12T01:22:06.076975+0000","last_became_active":"2024-09-12T00:35:43.927426+0000","last_became_peered":"2024-09-12T00:35:43.927426+0000","last_unstale":"2024-09-12T01:22:06.076975+0000","last_undegraded":"2024-09-12T01:22:06.076975+0000","last_fullsized":"2024-09-12T01:22:06.076975+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-12T01:22:06.076783+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-12T01:22:06.076783+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.076783+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:53.298954+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":824,"num_read_kb":46781,"num_write":1113,"num_write_kb":16393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:27.899248+0000","last_change":"2024-09-12T01:22:27.899248+0000","last_active":"2024-09-12T01:22:27.899248+0000","last_peered":"2024-09-12T01:22:27.899248+0000","last_clean":"2024-09-12T01:22:27.899248+0000","last_became_active":"2024-09-12T00:35:47.933189+0000","last_became_peered":"2024-09-12T00:35:47.933189+0000","last_unstale":"2024-09-12T01:22:27.899248+0000","last_undegraded":"2024-09-12T01:22:27.899248+0000","last_fullsized":"2024-09-12T01:22:27.899248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:27.899074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:27.899074+0000","last_clean_scrub_stamp":"2024-09-12T01:22:27.899074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:10.975721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'290","reported_seq":877,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:34.612507+0000","last_change":"2024-09-12T01:22:34.612507+0000","last_active":"2024-09-12T01:22:34.612507+0000","last_peered":"2024-09-12T01:22:34.612507+0000","last_clean":"2024-09-12T01:22:34.612507+0000","last_became_active":"2024-09-12T00:35:50.029579+0000","last_became_peered":"2024-09-12T00:35:50.029579+0000","last_unstale":"2024-09-12T01:22:34.612507+0000","last_undegraded":"2024-09-12T01:22:34.612507+0000","last_fullsized":"2024-09-12T01:22:34.612507+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'290","last_scrub_stamp":"2024-09-12T01:22:34.612310+0000","last_deep_scrub":"265'290","last_deep_scrub_stamp":"2024-09-12T01:22:34.612310+0000","last_clean_scrub_stamp":"2024-09-12T01:22:34.612310+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:27.497705+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47233,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":1083,"num_write":390,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:27.239752+0000","last_change":"2024-09-12T01:22:27.239752+0000","last_active":"2024-09-12T01:22:27.239752+0000","last_peered":"2024-09-12T01:22:27.239752+0000","last_clean":"2024-09-12T01:22:27.239752+0000","last_became_active":"2024-09-12T00:35:51.971682+0000","last_became_peered":"2024-09-12T00:35:51.971682+0000","last_unstale":"2024-09-12T01:22:27.239752+0000","last_undegraded":"2024-09-12T01:22:27.239752+0000","last_fullsized":"2024-09-12T01:22:27.239752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:27.239567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:27.239567+0000","last_clean_scrub_stamp":"2024-09-12T01:22:27.239567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:32.246865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'105","reported_seq":605,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:37.592662+0000","last_change":"2024-09-12T01:22:37.592662+0000","last_active":"2024-09-12T01:22:37.592662+0000","last_peered":"2024-09-12T01:22:37.592662+0000","last_clean":"2024-09-12T01:22:37.592662+0000","last_became_active":"2024-09-12T00:35:53.995464+0000","last_became_peered":"2024-09-12T00:35:53.995464+0000","last_unstale":"2024-09-12T01:22:37.592662+0000","last_undegraded":"2024-09-12T01:22:37.592662+0000","last_fullsized":"2024-09-12T01:22:37.592662+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'105","last_scrub_stamp":"2024-09-12T01:22:37.592475+0000","last_deep_scrub":"265'105","last_deep_scrub_stamp":"2024-09-12T01:22:37.592475+0000","last_clean_scrub_stamp":"2024-09-12T01:22:37.592475+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:47.712231+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":101,"num_write":247,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'298","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:04.495379+0000","last_change":"2024-09-12T01:22:04.495379+0000","last_active":"2024-09-12T01:22:04.495379+0000","last_peered":"2024-09-12T01:22:04.495379+0000","last_clean":"2024-09-12T01:22:04.495379+0000","last_became_active":"2024-09-12T00:35:45.947244+0000","last_became_peered":"2024-09-12T00:35:45.947244+0000","last_unstale":"2024-09-12T01:22:04.495379+0000","last_undegraded":"2024-09-12T01:22:04.495379+0000","last_fullsized":"2024-09-12T01:22:04.495379+0000","mapping_epoch":26,"log_start":"251'200","ondisk_log_start":"251'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'298","last_scrub_stamp":"2024-09-12T01:22:04.495267+0000","last_deep_scrub":"265'298","last_deep_scrub_stamp":"2024-09-12T01:22:04.495267+0000","last_clean_scrub_stamp":"2024-09-12T01:22:04.495267+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:57.480955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1444,"num_read_kb":1250,"num_write":453,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25755,"num_omap_keys":101,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'357","reported_seq":1121,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:04.679571+0000","last_change":"2024-09-12T01:22:04.679571+0000","last_active":"2024-09-12T01:22:04.679571+0000","last_peered":"2024-09-12T01:22:04.679571+0000","last_clean":"2024-09-12T01:22:04.679571+0000","last_became_active":"2024-09-12T00:35:43.947420+0000","last_became_peered":"2024-09-12T00:35:43.947420+0000","last_unstale":"2024-09-12T01:22:04.679571+0000","last_undegraded":"2024-09-12T01:22:04.679571+0000","last_fullsized":"2024-09-12T01:22:04.679571+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'357","last_scrub_stamp":"2024-09-12T01:22:04.679464+0000","last_deep_scrub":"265'357","last_deep_scrub_stamp":"2024-09-12T01:22:04.679464+0000","last_clean_scrub_stamp":"2024-09-12T01:22:04.679464+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:02.092461+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262187,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":720,"num_read_kb":19884,"num_write":1159,"num_write_kb":29921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.244173+0000","last_change":"2024-09-12T01:22:21.244173+0000","last_active":"2024-09-12T01:22:21.244173+0000","last_peered":"2024-09-12T01:22:21.244173+0000","last_clean":"2024-09-12T01:22:21.244173+0000","last_became_active":"2024-09-12T00:35:47.935440+0000","last_became_peered":"2024-09-12T00:35:47.935440+0000","last_unstale":"2024-09-12T01:22:21.244173+0000","last_undegraded":"2024-09-12T01:22:21.244173+0000","last_fullsized":"2024-09-12T01:22:21.244173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:21.244002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:21.244002+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.244002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:57.645912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'97","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:32.944551+0000","last_change":"2024-09-12T01:22:32.944551+0000","last_active":"2024-09-12T01:22:32.944551+0000","last_peered":"2024-09-12T01:22:32.944551+0000","last_clean":"2024-09-12T01:22:32.944551+0000","last_became_active":"2024-09-12T00:35:50.025145+0000","last_became_peered":"2024-09-12T00:35:50.025145+0000","last_unstale":"2024-09-12T01:22:32.944551+0000","last_undegraded":"2024-09-12T01:22:32.944551+0000","last_fullsized":"2024-09-12T01:22:32.944551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'97","last_scrub_stamp":"2024-09-12T01:22:32.944314+0000","last_deep_scrub":"265'97","last_deep_scrub_stamp":"2024-09-12T01:22:32.944314+0000","last_clean_scrub_stamp":"2024-09-12T01:22:32.944314+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:03.585579+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":97,"num_read_kb":88,"num_write":76,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'773","reported_seq":2399,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:26.156659+0000","last_change":"2024-09-12T01:22:26.156659+0000","last_active":"2024-09-12T01:22:26.156659+0000","last_peered":"2024-09-12T01:22:26.156659+0000","last_clean":"2024-09-12T01:22:26.156659+0000","last_became_active":"2024-09-12T00:35:51.967797+0000","last_became_peered":"2024-09-12T00:35:51.967797+0000","last_unstale":"2024-09-12T01:22:26.156659+0000","last_undegraded":"2024-09-12T01:22:26.156659+0000","last_fullsized":"2024-09-12T01:22:26.156659+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'773","last_scrub_stamp":"2024-09-12T01:22:26.156438+0000","last_deep_scrub":"265'773","last_deep_scrub_stamp":"2024-09-12T01:22:26.156438+0000","last_clean_scrub_stamp":"2024-09-12T01:22:26.156438+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:20.370270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'103","reported_seq":612,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:36.458506+0000","last_change":"2024-09-12T01:22:36.458366+0000","last_active":"2024-09-12T01:22:36.458506+0000","last_peered":"2024-09-12T01:22:36.458506+0000","last_clean":"2024-09-12T01:22:36.458506+0000","last_became_active":"2024-09-12T00:35:54.002318+0000","last_became_peered":"2024-09-12T00:35:54.002318+0000","last_unstale":"2024-09-12T01:22:36.458506+0000","last_undegraded":"2024-09-12T01:22:36.458506+0000","last_fullsized":"2024-09-12T01:22:36.458506+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'103","last_scrub_stamp":"2024-09-12T01:22:36.458187+0000","last_deep_scrub":"265'103","last_deep_scrub_stamp":"2024-09-12T01:22:36.458187+0000","last_clean_scrub_stamp":"2024-09-12T01:22:36.458187+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:43.305634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":119,"num_write":243,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'135","reported_seq":748,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.027357+0000","last_change":"2024-09-12T01:22:16.027357+0000","last_active":"2024-09-12T01:22:16.027357+0000","last_peered":"2024-09-12T01:22:16.027357+0000","last_clean":"2024-09-12T01:22:16.027357+0000","last_became_active":"2024-09-12T00:35:45.935880+0000","last_became_peered":"2024-09-12T00:35:45.935880+0000","last_unstale":"2024-09-12T01:22:16.027357+0000","last_undegraded":"2024-09-12T01:22:16.027357+0000","last_fullsized":"2024-09-12T01:22:16.027357+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'135","last_scrub_stamp":"2024-09-12T01:22:16.027180+0000","last_deep_scrub":"265'135","last_deep_scrub_stamp":"2024-09-12T01:22:16.027180+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.027180+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:04.144948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":617,"num_read_kb":515,"num_write":204,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'358","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.838790+0000","last_change":"2024-09-12T01:22:08.838790+0000","last_active":"2024-09-12T01:22:08.838790+0000","last_peered":"2024-09-12T01:22:08.838790+0000","last_clean":"2024-09-12T01:22:08.838790+0000","last_became_active":"2024-09-12T00:35:43.931008+0000","last_became_peered":"2024-09-12T00:35:43.931008+0000","last_unstale":"2024-09-12T01:22:08.838790+0000","last_undegraded":"2024-09-12T01:22:08.838790+0000","last_fullsized":"2024-09-12T01:22:08.838790+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T01:22:08.838501+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T01:22:08.838501+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.838501+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:11.131001+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730252,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":516,"num_read_kb":33271,"num_write":1211,"num_write_kb":48012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:25.340400+0000","last_change":"2024-09-12T01:22:25.340400+0000","last_active":"2024-09-12T01:22:25.340400+0000","last_peered":"2024-09-12T01:22:25.340400+0000","last_clean":"2024-09-12T01:22:25.340400+0000","last_became_active":"2024-09-12T00:35:47.950328+0000","last_became_peered":"2024-09-12T00:35:47.950328+0000","last_unstale":"2024-09-12T01:22:25.340400+0000","last_undegraded":"2024-09-12T01:22:25.340400+0000","last_fullsized":"2024-09-12T01:22:25.340400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:25.340222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:25.340222+0000","last_clean_scrub_stamp":"2024-09-12T01:22:25.340222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:23.703380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'331","reported_seq":944,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:32.676301+0000","last_change":"2024-09-12T01:22:32.676301+0000","last_active":"2024-09-12T01:22:32.676301+0000","last_peered":"2024-09-12T01:22:32.676301+0000","last_clean":"2024-09-12T01:22:32.676301+0000","last_became_active":"2024-09-12T00:35:49.938536+0000","last_became_peered":"2024-09-12T00:35:49.938536+0000","last_unstale":"2024-09-12T01:22:32.676301+0000","last_undegraded":"2024-09-12T01:22:32.676301+0000","last_fullsized":"2024-09-12T01:22:32.676301+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'331","last_scrub_stamp":"2024-09-12T01:22:32.676177+0000","last_deep_scrub":"265'331","last_deep_scrub_stamp":"2024-09-12T01:22:32.676177+0000","last_clean_scrub_stamp":"2024-09-12T01:22:32.676177+0000","objects_scrubbed":11,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:23.698139+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46352,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":532,"num_read_kb":1127,"num_write":424,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:33.484728+0000","last_change":"2024-09-12T01:22:33.484728+0000","last_active":"2024-09-12T01:22:33.484728+0000","last_peered":"2024-09-12T01:22:33.484728+0000","last_clean":"2024-09-12T01:22:33.484728+0000","last_became_active":"2024-09-12T00:35:51.964446+0000","last_became_peered":"2024-09-12T00:35:51.964446+0000","last_unstale":"2024-09-12T01:22:33.484728+0000","last_undegraded":"2024-09-12T01:22:33.484728+0000","last_fullsized":"2024-09-12T01:22:33.484728+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:33.484539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:33.484539+0000","last_clean_scrub_stamp":"2024-09-12T01:22:33.484539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:58.707395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'136","reported_seq":648,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:20.487261+0000","last_change":"2024-09-12T00:35:53.998710+0000","last_active":"2024-09-12T01:20:20.487261+0000","last_peered":"2024-09-12T01:20:20.487261+0000","last_clean":"2024-09-12T01:20:20.487261+0000","last_became_active":"2024-09-12T00:35:53.997969+0000","last_became_peered":"2024-09-12T00:35:53.997969+0000","last_unstale":"2024-09-12T01:20:20.487261+0000","last_undegraded":"2024-09-12T01:20:20.487261+0000","last_fullsized":"2024-09-12T01:20:20.487261+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:50.127097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":591,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":213,"num_read_kb":189,"num_write":344,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'118","reported_seq":710,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.065435+0000","last_change":"2024-09-12T01:22:18.065435+0000","last_active":"2024-09-12T01:22:18.065435+0000","last_peered":"2024-09-12T01:22:18.065435+0000","last_clean":"2024-09-12T01:22:18.065435+0000","last_became_active":"2024-09-12T00:35:45.937597+0000","last_became_peered":"2024-09-12T00:35:45.937597+0000","last_unstale":"2024-09-12T01:22:18.065435+0000","last_undegraded":"2024-09-12T01:22:18.065435+0000","last_fullsized":"2024-09-12T01:22:18.065435+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'118","last_scrub_stamp":"2024-09-12T01:22:18.065264+0000","last_deep_scrub":"265'118","last_deep_scrub_stamp":"2024-09-12T01:22:18.065264+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.065264+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:09.449396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":514,"num_read_kb":428,"num_write":167,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'305","reported_seq":907,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.754730+0000","last_change":"2024-09-12T01:22:10.754730+0000","last_active":"2024-09-12T01:22:10.754730+0000","last_peered":"2024-09-12T01:22:10.754730+0000","last_clean":"2024-09-12T01:22:10.754730+0000","last_became_active":"2024-09-12T00:35:43.913717+0000","last_became_peered":"2024-09-12T00:35:43.913717+0000","last_unstale":"2024-09-12T01:22:10.754730+0000","last_undegraded":"2024-09-12T01:22:10.754730+0000","last_fullsized":"2024-09-12T01:22:10.754730+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'305","last_scrub_stamp":"2024-09-12T01:22:10.754524+0000","last_deep_scrub":"265'305","last_deep_scrub_stamp":"2024-09-12T01:22:10.754524+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.754524+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:56.169168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":6749,"num_write":932,"num_write_kb":25345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:28.704366+0000","last_change":"2024-09-12T01:22:28.704366+0000","last_active":"2024-09-12T01:22:28.704366+0000","last_peered":"2024-09-12T01:22:28.704366+0000","last_clean":"2024-09-12T01:22:28.704366+0000","last_became_active":"2024-09-12T00:35:47.940170+0000","last_became_peered":"2024-09-12T00:35:47.940170+0000","last_unstale":"2024-09-12T01:22:28.704366+0000","last_undegraded":"2024-09-12T01:22:28.704366+0000","last_fullsized":"2024-09-12T01:22:28.704366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:28.704185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:28.704185+0000","last_clean_scrub_stamp":"2024-09-12T01:22:28.704185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:03.267354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'281","reported_seq":857,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:27.485365+0000","last_change":"2024-09-12T01:22:27.485365+0000","last_active":"2024-09-12T01:22:27.485365+0000","last_peered":"2024-09-12T01:22:27.485365+0000","last_clean":"2024-09-12T01:22:27.485365+0000","last_became_active":"2024-09-12T00:35:49.952570+0000","last_became_peered":"2024-09-12T00:35:49.952570+0000","last_unstale":"2024-09-12T01:22:27.485365+0000","last_undegraded":"2024-09-12T01:22:27.485365+0000","last_fullsized":"2024-09-12T01:22:27.485365+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'281","last_scrub_stamp":"2024-09-12T01:22:27.485160+0000","last_deep_scrub":"265'281","last_deep_scrub_stamp":"2024-09-12T01:22:27.485160+0000","last_clean_scrub_stamp":"2024-09-12T01:22:27.485160+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:19.061870+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47159,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":464,"num_read_kb":1078,"num_write":380,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:25.109601+0000","last_change":"2024-09-12T01:22:25.109601+0000","last_active":"2024-09-12T01:22:25.109601+0000","last_peered":"2024-09-12T01:22:25.109601+0000","last_clean":"2024-09-12T01:22:25.109601+0000","last_became_active":"2024-09-12T00:35:51.973732+0000","last_became_peered":"2024-09-12T00:35:51.973732+0000","last_unstale":"2024-09-12T01:22:25.109601+0000","last_undegraded":"2024-09-12T01:22:25.109601+0000","last_fullsized":"2024-09-12T01:22:25.109601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:25.109424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:25.109424+0000","last_clean_scrub_stamp":"2024-09-12T01:22:25.109424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:23.761850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'193","reported_seq":706,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:37.123850+0000","last_change":"2024-09-12T00:35:54.016500+0000","last_active":"2024-09-12T01:19:37.123850+0000","last_peered":"2024-09-12T01:19:37.123850+0000","last_clean":"2024-09-12T01:19:37.123850+0000","last_became_active":"2024-09-12T00:35:54.016028+0000","last_became_peered":"2024-09-12T00:35:54.016028+0000","last_unstale":"2024-09-12T01:19:37.123850+0000","last_undegraded":"2024-09-12T01:19:37.123850+0000","last_fullsized":"2024-09-12T01:19:37.123850+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:35:52.943066+0000","last_clean_scrub_stamp":"2024-09-12T00:35:52.943066+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:13.793560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":175,"num_read_kb":171,"num_write":438,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'198","reported_seq":819,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.646649+0000","last_change":"2024-09-12T01:22:18.646649+0000","last_active":"2024-09-12T01:22:18.646649+0000","last_peered":"2024-09-12T01:22:18.646649+0000","last_clean":"2024-09-12T01:22:18.646649+0000","last_became_active":"2024-09-12T00:35:45.941396+0000","last_became_peered":"2024-09-12T00:35:45.941396+0000","last_unstale":"2024-09-12T01:22:18.646649+0000","last_undegraded":"2024-09-12T01:22:18.646649+0000","last_fullsized":"2024-09-12T01:22:18.646649+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'198","last_scrub_stamp":"2024-09-12T01:22:18.646473+0000","last_deep_scrub":"265'198","last_deep_scrub_stamp":"2024-09-12T01:22:18.646473+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.646473+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:34.987983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":858,"num_read_kb":711,"num_write":323,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'462","reported_seq":1346,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.610259+0000","last_change":"2024-09-12T01:22:07.610259+0000","last_active":"2024-09-12T01:22:07.610259+0000","last_peered":"2024-09-12T01:22:07.610259+0000","last_clean":"2024-09-12T01:22:07.610259+0000","last_became_active":"2024-09-12T00:35:43.942359+0000","last_became_peered":"2024-09-12T00:35:43.942359+0000","last_unstale":"2024-09-12T01:22:07.610259+0000","last_undegraded":"2024-09-12T01:22:07.610259+0000","last_fullsized":"2024-09-12T01:22:07.610259+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'462","last_scrub_stamp":"2024-09-12T01:22:07.610037+0000","last_deep_scrub":"265'462","last_deep_scrub_stamp":"2024-09-12T01:22:07.610037+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.610037+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:31.652109+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1122,"num_read_kb":58431,"num_write":1508,"num_write_kb":72479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:26.881687+0000","last_change":"2024-09-12T01:22:26.881687+0000","last_active":"2024-09-12T01:22:26.881687+0000","last_peered":"2024-09-12T01:22:26.881687+0000","last_clean":"2024-09-12T01:22:26.881687+0000","last_became_active":"2024-09-12T00:35:47.940501+0000","last_became_peered":"2024-09-12T00:35:47.940501+0000","last_unstale":"2024-09-12T01:22:26.881687+0000","last_undegraded":"2024-09-12T01:22:26.881687+0000","last_fullsized":"2024-09-12T01:22:26.881687+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:26.881512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:26.881512+0000","last_clean_scrub_stamp":"2024-09-12T01:22:26.881512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:26.697220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'231","reported_seq":799,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:33.617118+0000","last_change":"2024-09-12T01:22:33.617118+0000","last_active":"2024-09-12T01:22:33.617118+0000","last_peered":"2024-09-12T01:22:33.617118+0000","last_clean":"2024-09-12T01:22:33.617118+0000","last_became_active":"2024-09-12T00:35:49.955264+0000","last_became_peered":"2024-09-12T00:35:49.955264+0000","last_unstale":"2024-09-12T01:22:33.617118+0000","last_undegraded":"2024-09-12T01:22:33.617118+0000","last_fullsized":"2024-09-12T01:22:33.617118+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'231","last_scrub_stamp":"2024-09-12T01:22:33.616855+0000","last_deep_scrub":"265'231","last_deep_scrub_stamp":"2024-09-12T01:22:33.616855+0000","last_clean_scrub_stamp":"2024-09-12T01:22:33.616855+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:39.383012+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44002,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":385,"num_read_kb":903,"num_write":312,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:35.958478+0000","last_change":"2024-09-12T01:22:35.958478+0000","last_active":"2024-09-12T01:22:35.958478+0000","last_peered":"2024-09-12T01:22:35.958478+0000","last_clean":"2024-09-12T01:22:35.958478+0000","last_became_active":"2024-09-12T00:35:51.961691+0000","last_became_peered":"2024-09-12T00:35:51.961691+0000","last_unstale":"2024-09-12T01:22:35.958478+0000","last_undegraded":"2024-09-12T01:22:35.958478+0000","last_fullsized":"2024-09-12T01:22:35.958478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:35.958302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:35.958302+0000","last_clean_scrub_stamp":"2024-09-12T01:22:35.958302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:53.107582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'199","reported_seq":1664,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:38.475707+0000","last_change":"2024-09-12T01:22:38.475707+0000","last_active":"2024-09-12T01:22:38.475707+0000","last_peered":"2024-09-12T01:22:38.475707+0000","last_clean":"2024-09-12T01:22:38.475707+0000","last_became_active":"2024-09-12T00:35:53.991532+0000","last_became_peered":"2024-09-12T00:35:53.991532+0000","last_unstale":"2024-09-12T01:22:38.475707+0000","last_undegraded":"2024-09-12T01:22:38.475707+0000","last_fullsized":"2024-09-12T01:22:38.475707+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'199","last_scrub_stamp":"2024-09-12T01:22:38.475475+0000","last_deep_scrub":"265'199","last_deep_scrub_stamp":"2024-09-12T01:22:38.475475+0000","last_clean_scrub_stamp":"2024-09-12T01:22:38.475475+0000","objects_scrubbed":5,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:31.432500+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1185,"num_read_kb":1184,"num_write":442,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'185","reported_seq":804,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.985260+0000","last_change":"2024-09-12T01:22:14.985260+0000","last_active":"2024-09-12T01:22:14.985260+0000","last_peered":"2024-09-12T01:22:14.985260+0000","last_clean":"2024-09-12T01:22:14.985260+0000","last_became_active":"2024-09-12T00:35:45.954474+0000","last_became_peered":"2024-09-12T00:35:45.954474+0000","last_unstale":"2024-09-12T01:22:14.985260+0000","last_undegraded":"2024-09-12T01:22:14.985260+0000","last_fullsized":"2024-09-12T01:22:14.985260+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'185","last_scrub_stamp":"2024-09-12T01:22:14.985076+0000","last_deep_scrub":"265'185","last_deep_scrub_stamp":"2024-09-12T01:22:14.985076+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.985076+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:20.057452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":774,"num_read_kb":643,"num_write":252,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'374","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.636292+0000","last_change":"2024-09-12T01:22:07.636292+0000","last_active":"2024-09-12T01:22:07.636292+0000","last_peered":"2024-09-12T01:22:07.636292+0000","last_clean":"2024-09-12T01:22:07.636292+0000","last_became_active":"2024-09-12T00:35:43.934998+0000","last_became_peered":"2024-09-12T00:35:43.934998+0000","last_unstale":"2024-09-12T01:22:07.636292+0000","last_undegraded":"2024-09-12T01:22:07.636292+0000","last_fullsized":"2024-09-12T01:22:07.636292+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T01:22:07.636085+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T01:22:07.636085+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.636085+0000","objects_scrubbed":6,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:58.942568+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":520,"num_read_kb":15471,"num_write":1132,"num_write_kb":44978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"265'2","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.266105+0000","last_change":"2024-09-12T01:22:18.266105+0000","last_active":"2024-09-12T01:22:18.266105+0000","last_peered":"2024-09-12T01:22:18.266105+0000","last_clean":"2024-09-12T01:22:18.266105+0000","last_became_active":"2024-09-12T00:35:47.928424+0000","last_became_peered":"2024-09-12T00:35:47.928424+0000","last_unstale":"2024-09-12T01:22:18.266105+0000","last_undegraded":"2024-09-12T01:22:18.266105+0000","last_fullsized":"2024-09-12T01:22:18.266105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:18.265915+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:18.265915+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.265915+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:57.030554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'303","reported_seq":909,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:31.988009+0000","last_change":"2024-09-12T01:22:31.988009+0000","last_active":"2024-09-12T01:22:31.988009+0000","last_peered":"2024-09-12T01:22:31.988009+0000","last_clean":"2024-09-12T01:22:31.988009+0000","last_became_active":"2024-09-12T00:35:49.933165+0000","last_became_peered":"2024-09-12T00:35:49.933165+0000","last_unstale":"2024-09-12T01:22:31.988009+0000","last_undegraded":"2024-09-12T01:22:31.988009+0000","last_fullsized":"2024-09-12T01:22:31.988009+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'303","last_scrub_stamp":"2024-09-12T01:22:31.987769+0000","last_deep_scrub":"265'303","last_deep_scrub_stamp":"2024-09-12T01:22:31.987769+0000","last_clean_scrub_stamp":"2024-09-12T01:22:31.987769+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:32.048586+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49116,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":493,"num_read_kb":1065,"num_write":392,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:43.408422+0000","last_change":"2024-09-12T01:22:43.408422+0000","last_active":"2024-09-12T01:22:43.408422+0000","last_peered":"2024-09-12T01:22:43.408422+0000","last_clean":"2024-09-12T01:22:43.408422+0000","last_became_active":"2024-09-12T00:35:51.984756+0000","last_became_peered":"2024-09-12T00:35:51.984756+0000","last_unstale":"2024-09-12T01:22:43.408422+0000","last_undegraded":"2024-09-12T01:22:43.408422+0000","last_fullsized":"2024-09-12T01:22:43.408422+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:43.408199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:43.408199+0000","last_clean_scrub_stamp":"2024-09-12T01:22:43.408199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:33.896156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'191","reported_seq":706,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:37.917782+0000","last_change":"2024-09-12T01:22:37.917782+0000","last_active":"2024-09-12T01:22:37.917782+0000","last_peered":"2024-09-12T01:22:37.917782+0000","last_clean":"2024-09-12T01:22:37.917782+0000","last_became_active":"2024-09-12T00:35:53.985486+0000","last_became_peered":"2024-09-12T00:35:53.985486+0000","last_unstale":"2024-09-12T01:22:37.917782+0000","last_undegraded":"2024-09-12T01:22:37.917782+0000","last_fullsized":"2024-09-12T01:22:37.917782+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'191","last_scrub_stamp":"2024-09-12T01:22:37.917552+0000","last_deep_scrub":"265'191","last_deep_scrub_stamp":"2024-09-12T01:22:37.917552+0000","last_clean_scrub_stamp":"2024-09-12T01:22:37.917552+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:54.809592+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1062,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":193,"num_read_kb":167,"num_write":361,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'182","reported_seq":732,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.261888+0000","last_change":"2024-09-12T01:22:19.261888+0000","last_active":"2024-09-12T01:22:19.261888+0000","last_peered":"2024-09-12T01:22:19.261888+0000","last_clean":"2024-09-12T01:22:19.261888+0000","last_became_active":"2024-09-12T00:35:45.957698+0000","last_became_peered":"2024-09-12T00:35:45.957698+0000","last_unstale":"2024-09-12T01:22:19.261888+0000","last_undegraded":"2024-09-12T01:22:19.261888+0000","last_fullsized":"2024-09-12T01:22:19.261888+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'182","last_scrub_stamp":"2024-09-12T01:22:19.261702+0000","last_deep_scrub":"265'182","last_deep_scrub_stamp":"2024-09-12T01:22:19.261702+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.261702+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:20.463886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":768,"num_read_kb":623,"num_write":277,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'396","reported_seq":1075,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.181416+0000","last_change":"2024-09-12T01:22:08.181416+0000","last_active":"2024-09-12T01:22:08.181416+0000","last_peered":"2024-09-12T01:22:08.181416+0000","last_clean":"2024-09-12T01:22:08.181416+0000","last_became_active":"2024-09-12T00:35:43.937281+0000","last_became_peered":"2024-09-12T00:35:43.937281+0000","last_unstale":"2024-09-12T01:22:08.181416+0000","last_undegraded":"2024-09-12T01:22:08.181416+0000","last_fullsized":"2024-09-12T01:22:08.181416+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'396","last_scrub_stamp":"2024-09-12T01:22:08.181179+0000","last_deep_scrub":"265'396","last_deep_scrub_stamp":"2024-09-12T01:22:08.181179+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.181179+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:58.834889+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550668,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":606,"num_read_kb":52877,"num_write":1364,"num_write_kb":41162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'421","reported_seq":1118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.183784+0000","last_change":"2024-09-12T01:22:15.183784+0000","last_active":"2024-09-12T01:22:15.183784+0000","last_peered":"2024-09-12T01:22:15.183784+0000","last_clean":"2024-09-12T01:22:15.183784+0000","last_became_active":"2024-09-12T00:35:45.932615+0000","last_became_peered":"2024-09-12T00:35:45.932615+0000","last_unstale":"2024-09-12T01:22:15.183784+0000","last_undegraded":"2024-09-12T01:22:15.183784+0000","last_fullsized":"2024-09-12T01:22:15.183784+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'421","last_scrub_stamp":"2024-09-12T01:22:15.183600+0000","last_deep_scrub":"265'421","last_deep_scrub_stamp":"2024-09-12T01:22:15.183600+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.183600+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:05.389393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2107,"num_read_kb":1905,"num_write":744,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'291","reported_seq":960,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.448034+0000","last_change":"2024-09-12T01:22:08.448034+0000","last_active":"2024-09-12T01:22:08.448034+0000","last_peered":"2024-09-12T01:22:08.448034+0000","last_clean":"2024-09-12T01:22:08.448034+0000","last_became_active":"2024-09-12T00:35:43.922005+0000","last_became_peered":"2024-09-12T00:35:43.922005+0000","last_unstale":"2024-09-12T01:22:08.448034+0000","last_undegraded":"2024-09-12T01:22:08.448034+0000","last_fullsized":"2024-09-12T01:22:08.448034+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'291","last_scrub_stamp":"2024-09-12T01:22:08.447802+0000","last_deep_scrub":"265'291","last_deep_scrub_stamp":"2024-09-12T01:22:08.447802+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.447802+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:44.780769+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":535,"num_read_kb":1388,"num_write":997,"num_write_kb":25405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'246","reported_seq":873,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.721615+0000","last_change":"2024-09-12T01:22:19.721615+0000","last_active":"2024-09-12T01:22:19.721615+0000","last_peered":"2024-09-12T01:22:19.721615+0000","last_clean":"2024-09-12T01:22:19.721615+0000","last_became_active":"2024-09-12T00:35:45.940153+0000","last_became_peered":"2024-09-12T00:35:45.940153+0000","last_unstale":"2024-09-12T01:22:19.721615+0000","last_undegraded":"2024-09-12T01:22:19.721615+0000","last_fullsized":"2024-09-12T01:22:19.721615+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'246","last_scrub_stamp":"2024-09-12T01:22:19.721431+0000","last_deep_scrub":"265'246","last_deep_scrub_stamp":"2024-09-12T01:22:19.721431+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.721431+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:39.443952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1055,"num_read_kb":856,"num_write":397,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'353","reported_seq":969,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.429300+0000","last_change":"2024-09-12T01:22:11.429300+0000","last_active":"2024-09-12T01:22:11.429300+0000","last_peered":"2024-09-12T01:22:11.429300+0000","last_clean":"2024-09-12T01:22:11.429300+0000","last_became_active":"2024-09-12T00:36:17.267594+0000","last_became_peered":"2024-09-12T00:36:17.267594+0000","last_unstale":"2024-09-12T01:22:11.429300+0000","last_undegraded":"2024-09-12T01:22:11.429300+0000","last_fullsized":"2024-09-12T01:22:11.429300+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'353","last_scrub_stamp":"2024-09-12T01:22:11.429005+0000","last_deep_scrub":"265'353","last_deep_scrub_stamp":"2024-09-12T01:22:11.429005+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.429005+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:45.151943+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436874,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":471,"num_read_kb":41052,"num_write":1136,"num_write_kb":25796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"265'93","reported_seq":678,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.152389+0000","last_change":"2024-09-12T01:22:14.152389+0000","last_active":"2024-09-12T01:22:14.152389+0000","last_peered":"2024-09-12T01:22:14.152389+0000","last_clean":"2024-09-12T01:22:14.152389+0000","last_became_active":"2024-09-12T00:35:45.945534+0000","last_became_peered":"2024-09-12T00:35:45.945534+0000","last_unstale":"2024-09-12T01:22:14.152389+0000","last_undegraded":"2024-09-12T01:22:14.152389+0000","last_fullsized":"2024-09-12T01:22:14.152389+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'93","last_scrub_stamp":"2024-09-12T01:22:14.152209+0000","last_deep_scrub":"265'93","last_deep_scrub_stamp":"2024-09-12T01:22:14.152209+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.152209+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:25.890852+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":411,"num_read_kb":349,"num_write":136,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'324","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.602990+0000","last_change":"2024-09-12T01:22:08.602990+0000","last_active":"2024-09-12T01:22:08.602990+0000","last_peered":"2024-09-12T01:22:08.602990+0000","last_clean":"2024-09-12T01:22:08.602990+0000","last_became_active":"2024-09-12T00:35:43.934068+0000","last_became_peered":"2024-09-12T00:35:43.934068+0000","last_unstale":"2024-09-12T01:22:08.602990+0000","last_undegraded":"2024-09-12T01:22:08.602990+0000","last_fullsized":"2024-09-12T01:22:08.602990+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T01:22:08.602769+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T01:22:08.602769+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.602769+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:18.211995+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":780267,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":473,"num_read_kb":16449,"num_write":1046,"num_write_kb":32400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'160","reported_seq":804,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.624197+0000","last_change":"2024-09-12T01:22:22.624197+0000","last_active":"2024-09-12T01:22:22.624197+0000","last_peered":"2024-09-12T01:22:22.624197+0000","last_clean":"2024-09-12T01:22:22.624197+0000","last_became_active":"2024-09-12T00:35:45.944423+0000","last_became_peered":"2024-09-12T00:35:45.944423+0000","last_unstale":"2024-09-12T01:22:22.624197+0000","last_undegraded":"2024-09-12T01:22:22.624197+0000","last_fullsized":"2024-09-12T01:22:22.624197+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'160","last_scrub_stamp":"2024-09-12T01:22:22.623982+0000","last_deep_scrub":"265'160","last_deep_scrub_stamp":"2024-09-12T01:22:22.623982+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.623982+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:20.633894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":713,"num_read_kb":599,"num_write":226,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"265'346","reported_seq":1024,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.595018+0000","last_change":"2024-09-12T01:22:09.595018+0000","last_active":"2024-09-12T01:22:09.595018+0000","last_peered":"2024-09-12T01:22:09.595018+0000","last_clean":"2024-09-12T01:22:09.595018+0000","last_became_active":"2024-09-12T00:35:43.937104+0000","last_became_peered":"2024-09-12T00:35:43.937104+0000","last_unstale":"2024-09-12T01:22:09.595018+0000","last_undegraded":"2024-09-12T01:22:09.595018+0000","last_fullsized":"2024-09-12T01:22:09.595018+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'346","last_scrub_stamp":"2024-09-12T01:22:09.594896+0000","last_deep_scrub":"265'346","last_deep_scrub_stamp":"2024-09-12T01:22:09.594896+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.594896+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:28.710562+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262271,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":572,"num_read_kb":63038,"num_write":1116,"num_write_kb":29306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'252","reported_seq":855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.042216+0000","last_change":"2024-09-12T01:22:17.042216+0000","last_active":"2024-09-12T01:22:17.042216+0000","last_peered":"2024-09-12T01:22:17.042216+0000","last_clean":"2024-09-12T01:22:17.042216+0000","last_became_active":"2024-09-12T00:35:45.957860+0000","last_became_peered":"2024-09-12T00:35:45.957860+0000","last_unstale":"2024-09-12T01:22:17.042216+0000","last_undegraded":"2024-09-12T01:22:17.042216+0000","last_fullsized":"2024-09-12T01:22:17.042216+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'252","last_scrub_stamp":"2024-09-12T01:22:17.042033+0000","last_deep_scrub":"265'252","last_deep_scrub_stamp":"2024-09-12T01:22:17.042033+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.042033+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:06.623032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1076,"num_read_kb":859,"num_write":407,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":266,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'346","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.234790+0000","last_change":"2024-09-12T01:22:09.234790+0000","last_active":"2024-09-12T01:22:09.234790+0000","last_peered":"2024-09-12T01:22:09.234790+0000","last_clean":"2024-09-12T01:22:09.234790+0000","last_became_active":"2024-09-12T00:35:43.929027+0000","last_became_peered":"2024-09-12T00:35:43.929027+0000","last_unstale":"2024-09-12T01:22:09.234790+0000","last_undegraded":"2024-09-12T01:22:09.234790+0000","last_fullsized":"2024-09-12T01:22:09.234790+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'346","last_scrub_stamp":"2024-09-12T01:22:09.234559+0000","last_deep_scrub":"265'346","last_deep_scrub_stamp":"2024-09-12T01:22:09.234559+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.234559+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:22.211508+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":588,"num_read_kb":747,"num_write":1224,"num_write_kb":5740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'102","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.588099+0000","last_change":"2024-09-12T01:22:20.588099+0000","last_active":"2024-09-12T01:22:20.588099+0000","last_peered":"2024-09-12T01:22:20.588099+0000","last_clean":"2024-09-12T01:22:20.588099+0000","last_became_active":"2024-09-12T00:35:45.948581+0000","last_became_peered":"2024-09-12T00:35:45.948581+0000","last_unstale":"2024-09-12T01:22:20.588099+0000","last_undegraded":"2024-09-12T01:22:20.588099+0000","last_fullsized":"2024-09-12T01:22:20.588099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'102","last_scrub_stamp":"2024-09-12T01:22:20.587828+0000","last_deep_scrub":"265'102","last_deep_scrub_stamp":"2024-09-12T01:22:20.587828+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.587828+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:41.592609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":463,"num_read_kb":395,"num_write":145,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"265'337","reported_seq":976,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.202666+0000","last_change":"2024-09-12T01:22:09.202666+0000","last_active":"2024-09-12T01:22:09.202666+0000","last_peered":"2024-09-12T01:22:09.202666+0000","last_clean":"2024-09-12T01:22:09.202666+0000","last_became_active":"2024-09-12T00:35:43.941155+0000","last_became_peered":"2024-09-12T00:35:43.941155+0000","last_unstale":"2024-09-12T01:22:09.202666+0000","last_undegraded":"2024-09-12T01:22:09.202666+0000","last_fullsized":"2024-09-12T01:22:09.202666+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'337","last_scrub_stamp":"2024-09-12T01:22:09.202393+0000","last_deep_scrub":"265'337","last_deep_scrub_stamp":"2024-09-12T01:22:09.202393+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.202393+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:57.460847+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":4200,"num_write":1081,"num_write_kb":60173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"265'210","reported_seq":851,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.155108+0000","last_change":"2024-09-12T01:22:15.155108+0000","last_active":"2024-09-12T01:22:15.155108+0000","last_peered":"2024-09-12T01:22:15.155108+0000","last_clean":"2024-09-12T01:22:15.155108+0000","last_became_active":"2024-09-12T00:35:45.946047+0000","last_became_peered":"2024-09-12T00:35:45.946047+0000","last_unstale":"2024-09-12T01:22:15.155108+0000","last_undegraded":"2024-09-12T01:22:15.155108+0000","last_fullsized":"2024-09-12T01:22:15.155108+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'210","last_scrub_stamp":"2024-09-12T01:22:15.154905+0000","last_deep_scrub":"265'210","last_deep_scrub_stamp":"2024-09-12T01:22:15.154905+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.154905+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:58.436758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":932,"num_read_kb":766,"num_write":302,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'323","reported_seq":970,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.593629+0000","last_change":"2024-09-12T01:22:11.593629+0000","last_active":"2024-09-12T01:22:11.593629+0000","last_peered":"2024-09-12T01:22:11.593629+0000","last_clean":"2024-09-12T01:22:11.593629+0000","last_became_active":"2024-09-12T00:35:43.923685+0000","last_became_peered":"2024-09-12T00:35:43.923685+0000","last_unstale":"2024-09-12T01:22:11.593629+0000","last_undegraded":"2024-09-12T01:22:11.593629+0000","last_fullsized":"2024-09-12T01:22:11.593629+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'323","last_scrub_stamp":"2024-09-12T01:22:11.593437+0000","last_deep_scrub":"265'323","last_deep_scrub_stamp":"2024-09-12T01:22:11.593437+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.593437+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:28.420949+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524322,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":440,"num_read_kb":73837,"num_write":961,"num_write_kb":48353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'100","reported_seq":687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.511606+0000","last_change":"2024-09-12T01:22:20.511454+0000","last_active":"2024-09-12T01:22:20.511606+0000","last_peered":"2024-09-12T01:22:20.511606+0000","last_clean":"2024-09-12T01:22:20.511606+0000","last_became_active":"2024-09-12T00:35:45.941986+0000","last_became_peered":"2024-09-12T00:35:45.941986+0000","last_unstale":"2024-09-12T01:22:20.511606+0000","last_undegraded":"2024-09-12T01:22:20.511606+0000","last_fullsized":"2024-09-12T01:22:20.511606+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'100","last_scrub_stamp":"2024-09-12T01:22:20.511244+0000","last_deep_scrub":"265'100","last_deep_scrub_stamp":"2024-09-12T01:22:20.511244+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.511244+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:50.075824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":455,"num_read_kb":381,"num_write":169,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'340","reported_seq":1062,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.780884+0000","last_change":"2024-09-12T01:22:11.780884+0000","last_active":"2024-09-12T01:22:11.780884+0000","last_peered":"2024-09-12T01:22:11.780884+0000","last_clean":"2024-09-12T01:22:11.780884+0000","last_became_active":"2024-09-12T00:35:43.911654+0000","last_became_peered":"2024-09-12T00:35:43.911654+0000","last_unstale":"2024-09-12T01:22:11.780884+0000","last_undegraded":"2024-09-12T01:22:11.780884+0000","last_fullsized":"2024-09-12T01:22:11.780884+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'340","last_scrub_stamp":"2024-09-12T01:22:11.780673+0000","last_deep_scrub":"265'340","last_deep_scrub_stamp":"2024-09-12T01:22:11.780673+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.780673+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:55.696701+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262180,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":572,"num_read_kb":5667,"num_write":1085,"num_write_kb":32435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'262","reported_seq":861,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.999977+0000","last_change":"2024-09-12T01:22:19.999817+0000","last_active":"2024-09-12T01:22:19.999977+0000","last_peered":"2024-09-12T01:22:19.999977+0000","last_clean":"2024-09-12T01:22:19.999977+0000","last_became_active":"2024-09-12T00:35:45.926462+0000","last_became_peered":"2024-09-12T00:35:45.926462+0000","last_unstale":"2024-09-12T01:22:19.999977+0000","last_undegraded":"2024-09-12T01:22:19.999977+0000","last_fullsized":"2024-09-12T01:22:19.999977+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'262","last_scrub_stamp":"2024-09-12T01:22:19.999635+0000","last_deep_scrub":"265'262","last_deep_scrub_stamp":"2024-09-12T01:22:19.999635+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.999635+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:24.196701+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1050,"num_read_kb":836,"num_write":420,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'331","reported_seq":1013,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.620366+0000","last_change":"2024-09-12T01:22:10.620366+0000","last_active":"2024-09-12T01:22:10.620366+0000","last_peered":"2024-09-12T01:22:10.620366+0000","last_clean":"2024-09-12T01:22:10.620366+0000","last_became_active":"2024-09-12T00:35:43.936883+0000","last_became_peered":"2024-09-12T00:35:43.936883+0000","last_unstale":"2024-09-12T01:22:10.620366+0000","last_undegraded":"2024-09-12T01:22:10.620366+0000","last_fullsized":"2024-09-12T01:22:10.620366+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'331","last_scrub_stamp":"2024-09-12T01:22:10.620182+0000","last_deep_scrub":"265'331","last_deep_scrub_stamp":"2024-09-12T01:22:10.620182+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.620182+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:09.832438+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2075264,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":536,"num_read_kb":80814,"num_write":1042,"num_write_kb":32955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"265'151","reported_seq":745,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.482818+0000","last_change":"2024-09-12T01:22:05.482818+0000","last_active":"2024-09-12T01:22:05.482818+0000","last_peered":"2024-09-12T01:22:05.482818+0000","last_clean":"2024-09-12T01:22:05.482818+0000","last_became_active":"2024-09-12T00:35:45.958997+0000","last_became_peered":"2024-09-12T00:35:45.958997+0000","last_unstale":"2024-09-12T01:22:05.482818+0000","last_undegraded":"2024-09-12T01:22:05.482818+0000","last_fullsized":"2024-09-12T01:22:05.482818+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'151","last_scrub_stamp":"2024-09-12T01:22:05.482621+0000","last_deep_scrub":"265'151","last_deep_scrub_stamp":"2024-09-12T01:22:05.482621+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.482621+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:24.195434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":623,"num_read_kb":511,"num_write":250,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'381","reported_seq":1047,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.784028+0000","last_change":"2024-09-12T01:22:12.784028+0000","last_active":"2024-09-12T01:22:12.784028+0000","last_peered":"2024-09-12T01:22:12.784028+0000","last_clean":"2024-09-12T01:22:12.784028+0000","last_became_active":"2024-09-12T00:35:43.942591+0000","last_became_peered":"2024-09-12T00:35:43.942591+0000","last_unstale":"2024-09-12T01:22:12.784028+0000","last_undegraded":"2024-09-12T01:22:12.784028+0000","last_fullsized":"2024-09-12T01:22:12.784028+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'381","last_scrub_stamp":"2024-09-12T01:22:12.783792+0000","last_deep_scrub":"265'381","last_deep_scrub_stamp":"2024-09-12T01:22:12.783792+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.783792+0000","objects_scrubbed":11,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:25.661993+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":894961,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":508,"num_read_kb":28251,"num_write":1134,"num_write_kb":59925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"265'83","reported_seq":669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.041603+0000","last_change":"2024-09-12T01:22:19.041603+0000","last_active":"2024-09-12T01:22:19.041603+0000","last_peered":"2024-09-12T01:22:19.041603+0000","last_clean":"2024-09-12T01:22:19.041603+0000","last_became_active":"2024-09-12T00:35:45.954252+0000","last_became_peered":"2024-09-12T00:35:45.954252+0000","last_unstale":"2024-09-12T01:22:19.041603+0000","last_undegraded":"2024-09-12T01:22:19.041603+0000","last_fullsized":"2024-09-12T01:22:19.041603+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'83","last_scrub_stamp":"2024-09-12T01:22:19.041424+0000","last_deep_scrub":"265'83","last_deep_scrub_stamp":"2024-09-12T01:22:19.041424+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.041424+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:10.207954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":370,"num_read_kb":310,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'387","reported_seq":1048,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.572102+0000","last_change":"2024-09-12T01:22:09.572102+0000","last_active":"2024-09-12T01:22:09.572102+0000","last_peered":"2024-09-12T01:22:09.572102+0000","last_clean":"2024-09-12T01:22:09.572102+0000","last_became_active":"2024-09-12T00:35:43.952828+0000","last_became_peered":"2024-09-12T00:35:43.952828+0000","last_unstale":"2024-09-12T01:22:09.572102+0000","last_undegraded":"2024-09-12T01:22:09.572102+0000","last_fullsized":"2024-09-12T01:22:09.572102+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'387","last_scrub_stamp":"2024-09-12T01:22:09.571904+0000","last_deep_scrub":"265'387","last_deep_scrub_stamp":"2024-09-12T01:22:09.571904+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.571904+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:32.922872+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":611,"num_read_kb":10107,"num_write":1280,"num_write_kb":30495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'4193","reported_seq":4826,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.469762+0000","last_change":"2024-09-12T01:22:18.469762+0000","last_active":"2024-09-12T01:22:18.469762+0000","last_peered":"2024-09-12T01:22:18.469762+0000","last_clean":"2024-09-12T01:22:18.469762+0000","last_became_active":"2024-09-12T00:35:45.949770+0000","last_became_peered":"2024-09-12T00:35:45.949770+0000","last_unstale":"2024-09-12T01:22:18.469762+0000","last_undegraded":"2024-09-12T01:22:18.469762+0000","last_fullsized":"2024-09-12T01:22:18.469762+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4193","last_scrub_stamp":"2024-09-12T01:22:18.469588+0000","last_deep_scrub":"265'4193","last_deep_scrub_stamp":"2024-09-12T01:22:18.469588+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.469588+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":3000,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:27.939587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16900,"num_read_kb":14167,"num_write":6311,"num_write_kb":3148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'355","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.209104+0000","last_change":"2024-09-12T01:22:10.209104+0000","last_active":"2024-09-12T01:22:10.209104+0000","last_peered":"2024-09-12T01:22:10.209104+0000","last_clean":"2024-09-12T01:22:10.209104+0000","last_became_active":"2024-09-12T00:35:43.944721+0000","last_became_peered":"2024-09-12T00:35:43.944721+0000","last_unstale":"2024-09-12T01:22:10.209104+0000","last_undegraded":"2024-09-12T01:22:10.209104+0000","last_fullsized":"2024-09-12T01:22:10.209104+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'355","last_scrub_stamp":"2024-09-12T01:22:10.208841+0000","last_deep_scrub":"265'355","last_deep_scrub_stamp":"2024-09-12T01:22:10.208841+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.208841+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:01.036663+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730131,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":532,"num_read_kb":12444,"num_write":1159,"num_write_kb":48295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'222","reported_seq":865,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.539740+0000","last_change":"2024-09-12T01:22:16.539740+0000","last_active":"2024-09-12T01:22:16.539740+0000","last_peered":"2024-09-12T01:22:16.539740+0000","last_clean":"2024-09-12T01:22:16.539740+0000","last_became_active":"2024-09-12T00:35:45.939921+0000","last_became_peered":"2024-09-12T00:35:45.939921+0000","last_unstale":"2024-09-12T01:22:16.539740+0000","last_undegraded":"2024-09-12T01:22:16.539740+0000","last_fullsized":"2024-09-12T01:22:16.539740+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'222","last_scrub_stamp":"2024-09-12T01:22:16.539565+0000","last_deep_scrub":"265'222","last_deep_scrub_stamp":"2024-09-12T01:22:16.539565+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.539565+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:08.131916+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":991,"num_read_kb":821,"num_write":345,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":504,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'347","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.536922+0000","last_change":"2024-09-12T01:22:13.536922+0000","last_active":"2024-09-12T01:22:13.536922+0000","last_peered":"2024-09-12T01:22:13.536922+0000","last_clean":"2024-09-12T01:22:13.536922+0000","last_became_active":"2024-09-12T00:35:43.942772+0000","last_became_peered":"2024-09-12T00:35:43.942772+0000","last_unstale":"2024-09-12T01:22:13.536922+0000","last_undegraded":"2024-09-12T01:22:13.536922+0000","last_fullsized":"2024-09-12T01:22:13.536922+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T01:22:13.536675+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T01:22:13.536675+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.536675+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:15.728162+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2329981,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":472,"num_read_kb":15742,"num_write":1095,"num_write_kb":41173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'153","reported_seq":779,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:23.587221+0000","last_change":"2024-09-12T01:22:23.587221+0000","last_active":"2024-09-12T01:22:23.587221+0000","last_peered":"2024-09-12T01:22:23.587221+0000","last_clean":"2024-09-12T01:22:23.587221+0000","last_became_active":"2024-09-12T00:35:45.937998+0000","last_became_peered":"2024-09-12T00:35:45.937998+0000","last_unstale":"2024-09-12T01:22:23.587221+0000","last_undegraded":"2024-09-12T01:22:23.587221+0000","last_fullsized":"2024-09-12T01:22:23.587221+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'153","last_scrub_stamp":"2024-09-12T01:22:23.587043+0000","last_deep_scrub":"265'153","last_deep_scrub_stamp":"2024-09-12T01:22:23.587043+0000","last_clean_scrub_stamp":"2024-09-12T01:22:23.587043+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:08.881855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":680,"num_read_kb":568,"num_write":226,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'362","reported_seq":1072,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.488740+0000","last_change":"2024-09-12T01:22:07.488496+0000","last_active":"2024-09-12T01:22:07.488740+0000","last_peered":"2024-09-12T01:22:07.488740+0000","last_clean":"2024-09-12T01:22:07.488740+0000","last_became_active":"2024-09-12T00:35:43.940876+0000","last_became_peered":"2024-09-12T00:35:43.940876+0000","last_unstale":"2024-09-12T01:22:07.488740+0000","last_undegraded":"2024-09-12T01:22:07.488740+0000","last_fullsized":"2024-09-12T01:22:07.488740+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'362","last_scrub_stamp":"2024-09-12T01:22:07.488235+0000","last_deep_scrub":"265'362","last_deep_scrub_stamp":"2024-09-12T01:22:07.488235+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.488235+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:21.148458+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":724,"num_read_kb":28886,"num_write":1110,"num_write_kb":16361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'147","reported_seq":792,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.458525+0000","last_change":"2024-09-12T01:22:20.458525+0000","last_active":"2024-09-12T01:22:20.458525+0000","last_peered":"2024-09-12T01:22:20.458525+0000","last_clean":"2024-09-12T01:22:20.458525+0000","last_became_active":"2024-09-12T00:35:45.948028+0000","last_became_peered":"2024-09-12T00:35:45.948028+0000","last_unstale":"2024-09-12T01:22:20.458525+0000","last_undegraded":"2024-09-12T01:22:20.458525+0000","last_fullsized":"2024-09-12T01:22:20.458525+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'147","last_scrub_stamp":"2024-09-12T01:22:20.458339+0000","last_deep_scrub":"265'147","last_deep_scrub_stamp":"2024-09-12T01:22:20.458339+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.458339+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:06.018727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":702,"num_read_kb":590,"num_write":208,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4004,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'347","reported_seq":1033,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.813763+0000","last_change":"2024-09-12T01:22:13.813608+0000","last_active":"2024-09-12T01:22:13.813763+0000","last_peered":"2024-09-12T01:22:13.813763+0000","last_clean":"2024-09-12T01:22:13.813763+0000","last_became_active":"2024-09-12T00:35:43.950791+0000","last_became_peered":"2024-09-12T00:35:43.950791+0000","last_unstale":"2024-09-12T01:22:13.813763+0000","last_undegraded":"2024-09-12T01:22:13.813763+0000","last_fullsized":"2024-09-12T01:22:13.813763+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T01:22:13.813378+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T01:22:13.813378+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.813378+0000","objects_scrubbed":10,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:26.242258+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5529046,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":579,"num_read_kb":37013,"num_write":1080,"num_write_kb":45879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'300","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.828572+0000","last_change":"2024-09-12T01:22:14.828375+0000","last_active":"2024-09-12T01:22:14.828572+0000","last_peered":"2024-09-12T01:22:14.828572+0000","last_clean":"2024-09-12T01:22:14.828572+0000","last_became_active":"2024-09-12T00:35:43.931367+0000","last_became_peered":"2024-09-12T00:35:43.931367+0000","last_unstale":"2024-09-12T01:22:14.828572+0000","last_undegraded":"2024-09-12T01:22:14.828572+0000","last_fullsized":"2024-09-12T01:22:14.828572+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'300","last_scrub_stamp":"2024-09-12T01:22:14.828161+0000","last_deep_scrub":"265'300","last_deep_scrub_stamp":"2024-09-12T01:22:14.828161+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.828161+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:57.972569+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":466,"num_read_kb":37317,"num_write":980,"num_write_kb":22412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'445","reported_seq":1082,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:24.476301+0000","last_change":"2024-09-12T01:22:24.476301+0000","last_active":"2024-09-12T01:22:24.476301+0000","last_peered":"2024-09-12T01:22:24.476301+0000","last_clean":"2024-09-12T01:22:24.476301+0000","last_became_active":"2024-09-12T00:35:45.941136+0000","last_became_peered":"2024-09-12T00:35:45.941136+0000","last_unstale":"2024-09-12T01:22:24.476301+0000","last_undegraded":"2024-09-12T01:22:24.476301+0000","last_fullsized":"2024-09-12T01:22:24.476301+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'445","last_scrub_stamp":"2024-09-12T01:22:24.476113+0000","last_deep_scrub":"265'445","last_deep_scrub_stamp":"2024-09-12T01:22:24.476113+0000","last_clean_scrub_stamp":"2024-09-12T01:22:24.476113+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:41.227716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1924,"num_read_kb":1655,"num_write":712,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3143,"num_omap_keys":13,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'347","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.229317+0000","last_change":"2024-09-12T01:22:17.229188+0000","last_active":"2024-09-12T01:22:17.229317+0000","last_peered":"2024-09-12T01:22:17.229317+0000","last_clean":"2024-09-12T01:22:17.229317+0000","last_became_active":"2024-09-12T00:35:43.936772+0000","last_became_peered":"2024-09-12T00:35:43.936772+0000","last_unstale":"2024-09-12T01:22:17.229317+0000","last_undegraded":"2024-09-12T01:22:17.229317+0000","last_fullsized":"2024-09-12T01:22:17.229317+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T01:22:17.228996+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T01:22:17.228996+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.228996+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:58.587295+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":514466,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":11206,"num_write":1103,"num_write_kb":22250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'123","reported_seq":737,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.713240+0000","last_change":"2024-09-12T01:22:21.713240+0000","last_active":"2024-09-12T01:22:21.713240+0000","last_peered":"2024-09-12T01:22:21.713240+0000","last_clean":"2024-09-12T01:22:21.713240+0000","last_became_active":"2024-09-12T00:35:45.933748+0000","last_became_peered":"2024-09-12T00:35:45.933748+0000","last_unstale":"2024-09-12T01:22:21.713240+0000","last_undegraded":"2024-09-12T01:22:21.713240+0000","last_fullsized":"2024-09-12T01:22:21.713240+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'123","last_scrub_stamp":"2024-09-12T01:22:21.713057+0000","last_deep_scrub":"265'123","last_deep_scrub_stamp":"2024-09-12T01:22:21.713057+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.713057+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:00.223366+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":571,"num_read_kb":478,"num_write":188,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5965,"num_read_kb":4303,"num_write":1960,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3728,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":932,"ondisk_log_size":932,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":15013,"num_read_kb":14673,"num_write":16730,"num_write_kb":4883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2934,"num_omap_keys":19,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2143,"ondisk_log_size":2143,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":588,"ondisk_log_size":588,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1547252,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":17692,"num_read_kb":36824,"num_write":14761,"num_write_kb":11530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":683124,"num_omap_keys":1560,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1852,"ondisk_log_size":1852,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2433,"num_read_kb":2900,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102034,"num_read_kb":85265,"num_write":36996,"num_write_kb":18612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43837,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3949,"ondisk_log_size":3949,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":73603174,"num_objects":366,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":366,"num_whiteouts":0,"num_read":35859,"num_read_kb":1958475,"num_write":71400,"num_write_kb":2147647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":148455424,"data_stored":147206348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3894,"ondisk_log_size":3894,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":174261,"num_write":154,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":179336,"num_write":154,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424510013,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":135984,"kb_used_data":36832,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94235856,"statfs":{"total":96636764160,"available":96497516544,"internally_reserved":0,"allocated":37715968,"data_stored":35946887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510012,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280192,"kb_used_data":32432,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":94091648,"statfs":{"total":96636764160,"available":96349847552,"internally_reserved":0,"allocated":33210368,"data_stored":31432953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":253688263},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510014,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109536,"kb_used_data":10384,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94262304,"statfs":{"total":96636764160,"available":96524599296,"internally_reserved":0,"allocated":10633216,"data_stored":9073175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510013,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249396,"kb_used_data":29412,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94122444,"statfs":{"total":96636764160,"available":96381382656,"internally_reserved":0,"allocated":30117888,"data_stored":28384468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":225245637},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542716,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250016,"kb_used_data":20304,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94121824,"statfs":{"total":96636764160,"available":96380747776,"internally_reserved":0,"allocated":20791296,"data_stored":19046587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235207114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542715,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":228608,"kb_used_data":16944,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94143232,"statfs":{"total":96636764160,"available":96402669568,"internally_reserved":0,"allocated":17350656,"data_stored":15759617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":216725958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542716,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89728,"kb_used_data":14128,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94282112,"statfs":{"total":96636764160,"available":96544882688,"internally_reserved":0,"allocated":14467072,"data_stored":12799537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575419,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59444,"kb_used_data":14372,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94312396,"statfs":{"total":96636764160,"available":96575893504,"internally_reserved":0,"allocated":14716928,"data_stored":13117126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25833472,"data_stored":25645853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6983680,"data_stored":6928219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11079680,"data_stored":10970794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29499392,"data_stored":29284181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10829824,"data_stored":10653176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34000896,"data_stored":33800787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13717504,"data_stored":13613541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16510976,"data_stored":16309797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":4558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":6362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:22:46.456 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.456 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.456 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.456 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.457 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.457 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.457 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.457 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.457 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.457 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.457 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.458 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.458 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.458 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.458 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.458 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.458 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.458 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.458 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.458 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.459 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.459 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.459 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.459 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.459 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.459 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.459 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.459 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.460 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.460 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.460 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.460 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.460 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.460 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.460 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.460 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.461 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.461 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.461 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.461 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.461 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.461 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.461 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.461 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.461 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.462 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.462 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.462 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.462 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.462 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.462 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.462 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.462 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.463 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.463 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.463 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.463 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.463 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.463 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.463 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.463 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.463 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.464 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:51:03.936889+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=51, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.464 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.464 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.464 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.464 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.464 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.464 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.464 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.465 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.465 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.465 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.465 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.465 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.465 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.465 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.466 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.466 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:52:36.240194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.466 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.466 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.466 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:52:39.289102+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=52, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.468 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.468 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.469 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.469 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:35:52.943066+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:22:46.469 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:23:06.470 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:23:06.837 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:23:06.849 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-12T01:23:06.858 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":1690,"stamp":"2024-09-12T01:23:05.187153+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75758925,"num_objects":722,"num_object_clones":0,"num_object_copies":1444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":722,"num_whiteouts":0,"num_read":179342,"num_read_kb":2456104,"num_write":142298,"num_write_kb":2416867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":737063,"num_omap_keys":1778,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13665,"ondisk_log_size":13665,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1402904,"kb_used_data":174808,"kb_used_omap":12,"kb_used_meta":1227955,"kb_avail":753571816,"statfs":{"total":773094113280,"available":771657539584,"internally_reserved":0,"allocated":179003392,"data_stored":165560350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1257426480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":564,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008385"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:50.514128+0000","last_change":"2024-09-12T01:22:50.514128+0000","last_active":"2024-09-12T01:22:50.514128+0000","last_peered":"2024-09-12T01:22:50.514128+0000","last_clean":"2024-09-12T01:22:50.514128+0000","last_became_active":"2024-09-12T01:03:40.584744+0000","last_became_peered":"2024-09-12T01:03:40.584744+0000","last_unstale":"2024-09-12T01:22:50.514128+0000","last_undegraded":"2024-09-12T01:22:50.514128+0000","last_fullsized":"2024-09-12T01:22:50.514128+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:50.513942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:50.513942+0000","last_clean_scrub_stamp":"2024-09-12T01:22:50.513942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:14.485943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:48.501154+0000","last_change":"2024-09-12T01:22:48.501154+0000","last_active":"2024-09-12T01:22:48.501154+0000","last_peered":"2024-09-12T01:22:48.501154+0000","last_clean":"2024-09-12T01:22:48.501154+0000","last_became_active":"2024-09-12T00:52:40.345120+0000","last_became_peered":"2024-09-12T00:52:40.345120+0000","last_unstale":"2024-09-12T01:22:48.501154+0000","last_undegraded":"2024-09-12T01:22:48.501154+0000","last_fullsized":"2024-09-12T01:22:48.501154+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:48.500952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:48.500952+0000","last_clean_scrub_stamp":"2024-09-12T01:22:48.500952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:17.500848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"265'3","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:53.753350+0000","last_change":"2024-09-12T01:22:53.753350+0000","last_active":"2024-09-12T01:22:53.753350+0000","last_peered":"2024-09-12T01:22:53.753350+0000","last_clean":"2024-09-12T01:22:53.753350+0000","last_became_active":"2024-09-12T00:52:37.276676+0000","last_became_peered":"2024-09-12T00:52:37.276676+0000","last_unstale":"2024-09-12T01:22:53.753350+0000","last_undegraded":"2024-09-12T01:22:53.753350+0000","last_fullsized":"2024-09-12T01:22:53.753350+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:22:53.753131+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:22:53.753131+0000","last_clean_scrub_stamp":"2024-09-12T01:22:53.753131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:47.954002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'38","reported_seq":164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:45.359825+0000","last_change":"2024-09-12T01:22:45.359825+0000","last_active":"2024-09-12T01:22:45.359825+0000","last_peered":"2024-09-12T01:22:45.359825+0000","last_clean":"2024-09-12T01:22:45.359825+0000","last_became_active":"2024-09-12T00:51:04.998763+0000","last_became_peered":"2024-09-12T00:51:04.998763+0000","last_unstale":"2024-09-12T01:22:45.359825+0000","last_undegraded":"2024-09-12T01:22:45.359825+0000","last_fullsized":"2024-09-12T01:22:45.359825+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'38","last_scrub_stamp":"2024-09-12T01:22:45.359617+0000","last_deep_scrub":"265'38","last_deep_scrub_stamp":"2024-09-12T01:22:45.359617+0000","last_clean_scrub_stamp":"2024-09-12T01:22:45.359617+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:42.475697+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":142,"num_write":56,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:32.349358+0000","last_change":"2024-09-12T01:22:32.349358+0000","last_active":"2024-09-12T01:22:32.349358+0000","last_peered":"2024-09-12T01:22:32.349358+0000","last_clean":"2024-09-12T01:22:32.349358+0000","last_became_active":"2024-09-12T01:03:40.581266+0000","last_became_peered":"2024-09-12T01:03:40.581266+0000","last_unstale":"2024-09-12T01:22:32.349358+0000","last_undegraded":"2024-09-12T01:22:32.349358+0000","last_fullsized":"2024-09-12T01:22:32.349358+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:32.349170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:32.349170+0000","last_clean_scrub_stamp":"2024-09-12T01:22:32.349170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:03.847107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"265'2","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:52.892905+0000","last_change":"2024-09-12T01:22:52.892905+0000","last_active":"2024-09-12T01:22:52.892905+0000","last_peered":"2024-09-12T01:22:52.892905+0000","last_clean":"2024-09-12T01:22:52.892905+0000","last_became_active":"2024-09-12T00:52:40.344674+0000","last_became_peered":"2024-09-12T00:52:40.344674+0000","last_unstale":"2024-09-12T01:22:52.892905+0000","last_undegraded":"2024-09-12T01:22:52.892905+0000","last_fullsized":"2024-09-12T01:22:52.892905+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:52.892701+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:52.892701+0000","last_clean_scrub_stamp":"2024-09-12T01:22:52.892701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:37.944983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":10,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'6","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:38.213077+0000","last_change":"2024-09-12T01:22:38.212886+0000","last_active":"2024-09-12T01:22:38.213077+0000","last_peered":"2024-09-12T01:22:38.213077+0000","last_clean":"2024-09-12T01:22:38.213077+0000","last_became_active":"2024-09-12T00:52:37.294438+0000","last_became_peered":"2024-09-12T00:52:37.294438+0000","last_unstale":"2024-09-12T01:22:38.213077+0000","last_undegraded":"2024-09-12T01:22:38.213077+0000","last_fullsized":"2024-09-12T01:22:38.213077+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:22:38.212701+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:22:38.212701+0000","last_clean_scrub_stamp":"2024-09-12T01:22:38.212701+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:19.389441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'42","reported_seq":172,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:24.384364+0000","last_change":"2024-09-12T01:22:24.384364+0000","last_active":"2024-09-12T01:22:24.384364+0000","last_peered":"2024-09-12T01:22:24.384364+0000","last_clean":"2024-09-12T01:22:24.384364+0000","last_became_active":"2024-09-12T00:51:04.961677+0000","last_became_peered":"2024-09-12T00:51:04.961677+0000","last_unstale":"2024-09-12T01:22:24.384364+0000","last_undegraded":"2024-09-12T01:22:24.384364+0000","last_fullsized":"2024-09-12T01:22:24.384364+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'42","last_scrub_stamp":"2024-09-12T01:22:24.384181+0000","last_deep_scrub":"265'42","last_deep_scrub_stamp":"2024-09-12T01:22:24.384181+0000","last_clean_scrub_stamp":"2024-09-12T01:22:24.384181+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:21.287887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":168,"num_write":72,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:41.001246+0000","last_change":"2024-09-12T01:22:41.001116+0000","last_active":"2024-09-12T01:22:41.001246+0000","last_peered":"2024-09-12T01:22:41.001246+0000","last_clean":"2024-09-12T01:22:41.001246+0000","last_became_active":"2024-09-12T01:03:40.576550+0000","last_became_peered":"2024-09-12T01:03:40.576550+0000","last_unstale":"2024-09-12T01:22:41.001246+0000","last_undegraded":"2024-09-12T01:22:41.001246+0000","last_fullsized":"2024-09-12T01:22:41.001246+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:41.000931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:41.000931+0000","last_clean_scrub_stamp":"2024-09-12T01:22:41.000931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:53.971314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"265'5","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:58.201220+0000","last_change":"2024-09-12T01:22:58.201220+0000","last_active":"2024-09-12T01:22:58.201220+0000","last_peered":"2024-09-12T01:22:58.201220+0000","last_clean":"2024-09-12T01:22:58.201220+0000","last_became_active":"2024-09-12T00:52:40.337945+0000","last_became_peered":"2024-09-12T00:52:40.337945+0000","last_unstale":"2024-09-12T01:22:58.201220+0000","last_undegraded":"2024-09-12T01:22:58.201220+0000","last_fullsized":"2024-09-12T01:22:58.201220+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:22:58.201029+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:22:58.201029+0000","last_clean_scrub_stamp":"2024-09-12T01:22:58.201029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:43.070973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:28.466021+0000","last_change":"2024-09-12T01:22:28.465858+0000","last_active":"2024-09-12T01:22:28.466021+0000","last_peered":"2024-09-12T01:22:28.466021+0000","last_clean":"2024-09-12T01:22:28.466021+0000","last_became_active":"2024-09-12T00:52:37.296335+0000","last_became_peered":"2024-09-12T00:52:37.296335+0000","last_unstale":"2024-09-12T01:22:28.466021+0000","last_undegraded":"2024-09-12T01:22:28.466021+0000","last_fullsized":"2024-09-12T01:22:28.466021+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:28.465685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:28.465685+0000","last_clean_scrub_stamp":"2024-09-12T01:22:28.465685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:34.410427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'30","reported_seq":136,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:55.201692+0000","last_change":"2024-09-12T01:22:55.201692+0000","last_active":"2024-09-12T01:22:55.201692+0000","last_peered":"2024-09-12T01:22:55.201692+0000","last_clean":"2024-09-12T01:22:55.201692+0000","last_became_active":"2024-09-12T00:51:04.992519+0000","last_became_peered":"2024-09-12T00:51:04.992519+0000","last_unstale":"2024-09-12T01:22:55.201692+0000","last_undegraded":"2024-09-12T01:22:55.201692+0000","last_fullsized":"2024-09-12T01:22:55.201692+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'30","last_scrub_stamp":"2024-09-12T01:22:55.201504+0000","last_deep_scrub":"265'30","last_deep_scrub_stamp":"2024-09-12T01:22:55.201504+0000","last_clean_scrub_stamp":"2024-09-12T01:22:55.201504+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:05.738274+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":105,"num_write":58,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:18:18.579674+0000","last_change":"2024-09-12T01:03:40.587244+0000","last_active":"2024-09-12T01:18:18.579674+0000","last_peered":"2024-09-12T01:18:18.579674+0000","last_clean":"2024-09-12T01:18:18.579674+0000","last_became_active":"2024-09-12T01:03:40.586582+0000","last_became_peered":"2024-09-12T01:03:40.586582+0000","last_unstale":"2024-09-12T01:18:18.579674+0000","last_undegraded":"2024-09-12T01:18:18.579674+0000","last_fullsized":"2024-09-12T01:18:18.579674+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:46.195286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'5","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:57.203884+0000","last_change":"2024-09-12T01:22:57.203884+0000","last_active":"2024-09-12T01:22:57.203884+0000","last_peered":"2024-09-12T01:22:57.203884+0000","last_clean":"2024-09-12T01:22:57.203884+0000","last_became_active":"2024-09-12T00:53:18.615877+0000","last_became_peered":"2024-09-12T00:53:18.615877+0000","last_unstale":"2024-09-12T01:22:57.203884+0000","last_undegraded":"2024-09-12T01:22:57.203884+0000","last_fullsized":"2024-09-12T01:22:57.203884+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:22:57.203642+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:22:57.203642+0000","last_clean_scrub_stamp":"2024-09-12T01:22:57.203642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:53.963630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6184,"num_write":5,"num_write_kb":6184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:46.804105+0000","last_change":"2024-09-12T01:22:46.804105+0000","last_active":"2024-09-12T01:22:46.804105+0000","last_peered":"2024-09-12T01:22:46.804105+0000","last_clean":"2024-09-12T01:22:46.804105+0000","last_became_active":"2024-09-12T00:52:37.270357+0000","last_became_peered":"2024-09-12T00:52:37.270357+0000","last_unstale":"2024-09-12T01:22:46.804105+0000","last_undegraded":"2024-09-12T01:22:46.804105+0000","last_fullsized":"2024-09-12T01:22:46.804105+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:46.803902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:46.803902+0000","last_clean_scrub_stamp":"2024-09-12T01:22:46.803902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:56.127839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'29","reported_seq":133,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:51.719446+0000","last_change":"2024-09-12T01:22:51.719446+0000","last_active":"2024-09-12T01:22:51.719446+0000","last_peered":"2024-09-12T01:22:51.719446+0000","last_clean":"2024-09-12T01:22:51.719446+0000","last_became_active":"2024-09-12T00:51:04.994459+0000","last_became_peered":"2024-09-12T00:51:04.994459+0000","last_unstale":"2024-09-12T01:22:51.719446+0000","last_undegraded":"2024-09-12T01:22:51.719446+0000","last_fullsized":"2024-09-12T01:22:51.719446+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'29","last_scrub_stamp":"2024-09-12T01:22:51.719252+0000","last_deep_scrub":"265'29","last_deep_scrub_stamp":"2024-09-12T01:22:51.719252+0000","last_clean_scrub_stamp":"2024-09-12T01:22:51.719252+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:16.492199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":61,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:19:48.601539+0000","last_change":"2024-09-12T01:03:40.594312+0000","last_active":"2024-09-12T01:19:48.601539+0000","last_peered":"2024-09-12T01:19:48.601539+0000","last_clean":"2024-09-12T01:19:48.601539+0000","last_became_active":"2024-09-12T01:03:40.593614+0000","last_became_peered":"2024-09-12T01:03:40.593614+0000","last_unstale":"2024-09-12T01:19:48.601539+0000","last_undegraded":"2024-09-12T01:19:48.601539+0000","last_fullsized":"2024-09-12T01:19:48.601539+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:51.667787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"265'6","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:47.534095+0000","last_change":"2024-09-12T01:22:47.534095+0000","last_active":"2024-09-12T01:22:47.534095+0000","last_peered":"2024-09-12T01:22:47.534095+0000","last_clean":"2024-09-12T01:22:47.534095+0000","last_became_active":"2024-09-12T00:52:40.356507+0000","last_became_peered":"2024-09-12T00:52:40.356507+0000","last_unstale":"2024-09-12T01:22:47.534095+0000","last_undegraded":"2024-09-12T01:22:47.534095+0000","last_fullsized":"2024-09-12T01:22:47.534095+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:22:47.533916+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:22:47.533916+0000","last_clean_scrub_stamp":"2024-09-12T01:22:47.533916+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:42.533506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":17408,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:54.185237+0000","last_change":"2024-09-12T01:22:54.185237+0000","last_active":"2024-09-12T01:22:54.185237+0000","last_peered":"2024-09-12T01:22:54.185237+0000","last_clean":"2024-09-12T01:22:54.185237+0000","last_became_active":"2024-09-12T00:52:37.293298+0000","last_became_peered":"2024-09-12T00:52:37.293298+0000","last_unstale":"2024-09-12T01:22:54.185237+0000","last_undegraded":"2024-09-12T01:22:54.185237+0000","last_fullsized":"2024-09-12T01:22:54.185237+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:54.185020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:54.185020+0000","last_clean_scrub_stamp":"2024-09-12T01:22:54.185020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:47.787147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"262'30","reported_seq":145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:50.732675+0000","last_change":"2024-09-12T01:22:50.732675+0000","last_active":"2024-09-12T01:22:50.732675+0000","last_peered":"2024-09-12T01:22:50.732675+0000","last_clean":"2024-09-12T01:22:50.732675+0000","last_became_active":"2024-09-12T00:51:04.995863+0000","last_became_peered":"2024-09-12T00:51:04.995863+0000","last_unstale":"2024-09-12T01:22:50.732675+0000","last_undegraded":"2024-09-12T01:22:50.732675+0000","last_fullsized":"2024-09-12T01:22:50.732675+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'30","last_scrub_stamp":"2024-09-12T01:22:50.732470+0000","last_deep_scrub":"262'30","last_deep_scrub_stamp":"2024-09-12T01:22:50.732470+0000","last_clean_scrub_stamp":"2024-09-12T01:22:50.732470+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:28.389976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":123,"num_write":48,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:46.190105+0000","last_change":"2024-09-12T01:22:46.190105+0000","last_active":"2024-09-12T01:22:46.190105+0000","last_peered":"2024-09-12T01:22:46.190105+0000","last_clean":"2024-09-12T01:22:46.190105+0000","last_became_active":"2024-09-12T01:03:40.575481+0000","last_became_peered":"2024-09-12T01:03:40.575481+0000","last_unstale":"2024-09-12T01:22:46.190105+0000","last_undegraded":"2024-09-12T01:22:46.190105+0000","last_fullsized":"2024-09-12T01:22:46.190105+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:46.190030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:46.190030+0000","last_clean_scrub_stamp":"2024-09-12T01:22:46.190030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:06.052250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:39.046247+0000","last_change":"2024-09-12T01:22:39.046247+0000","last_active":"2024-09-12T01:22:39.046247+0000","last_peered":"2024-09-12T01:22:39.046247+0000","last_clean":"2024-09-12T01:22:39.046247+0000","last_became_active":"2024-09-12T00:52:40.349826+0000","last_became_peered":"2024-09-12T00:52:40.349826+0000","last_unstale":"2024-09-12T01:22:39.046247+0000","last_undegraded":"2024-09-12T01:22:39.046247+0000","last_fullsized":"2024-09-12T01:22:39.046247+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:39.046063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:39.046063+0000","last_clean_scrub_stamp":"2024-09-12T01:22:39.046063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:06.281154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"265'18","reported_seq":94,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:45.817476+0000","last_change":"2024-09-12T01:22:45.817476+0000","last_active":"2024-09-12T01:22:45.817476+0000","last_peered":"2024-09-12T01:22:45.817476+0000","last_clean":"2024-09-12T01:22:45.817476+0000","last_became_active":"2024-09-12T00:52:37.283600+0000","last_became_peered":"2024-09-12T00:52:37.283600+0000","last_unstale":"2024-09-12T01:22:45.817476+0000","last_undegraded":"2024-09-12T01:22:45.817476+0000","last_fullsized":"2024-09-12T01:22:45.817476+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'18","last_scrub_stamp":"2024-09-12T01:22:45.817299+0000","last_deep_scrub":"265'18","last_deep_scrub_stamp":"2024-09-12T01:22:45.817299+0000","last_clean_scrub_stamp":"2024-09-12T01:22:45.817299+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:37.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":56328,"num_write":28,"num_write_kb":20484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"265'59","reported_seq":214,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:34.091688+0000","last_change":"2024-09-12T01:22:34.091688+0000","last_active":"2024-09-12T01:22:34.091688+0000","last_peered":"2024-09-12T01:22:34.091688+0000","last_clean":"2024-09-12T01:22:34.091688+0000","last_became_active":"2024-09-12T00:51:04.982228+0000","last_became_peered":"2024-09-12T00:51:04.982228+0000","last_unstale":"2024-09-12T01:22:34.091688+0000","last_undegraded":"2024-09-12T01:22:34.091688+0000","last_fullsized":"2024-09-12T01:22:34.091688+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'59","last_scrub_stamp":"2024-09-12T01:22:34.091468+0000","last_deep_scrub":"265'59","last_deep_scrub_stamp":"2024-09-12T01:22:34.091468+0000","last_clean_scrub_stamp":"2024-09-12T01:22:34.091468+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:07.136953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":210,"num_write":106,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'2","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:23:00.561872+0000","last_change":"2024-09-12T01:23:00.561872+0000","last_active":"2024-09-12T01:23:00.561872+0000","last_peered":"2024-09-12T01:23:00.561872+0000","last_clean":"2024-09-12T01:23:00.561872+0000","last_became_active":"2024-09-12T01:03:40.568346+0000","last_became_peered":"2024-09-12T01:03:40.568346+0000","last_unstale":"2024-09-12T01:23:00.561872+0000","last_undegraded":"2024-09-12T01:23:00.561872+0000","last_fullsized":"2024-09-12T01:23:00.561872+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:23:00.561702+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:23:00.561702+0000","last_clean_scrub_stamp":"2024-09-12T01:23:00.561702+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:25.545679+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"265'3","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:42.018175+0000","last_change":"2024-09-12T01:22:42.017990+0000","last_active":"2024-09-12T01:22:42.018175+0000","last_peered":"2024-09-12T01:22:42.018175+0000","last_clean":"2024-09-12T01:22:42.018175+0000","last_became_active":"2024-09-12T00:52:40.339627+0000","last_became_peered":"2024-09-12T00:52:40.339627+0000","last_unstale":"2024-09-12T01:22:42.018175+0000","last_undegraded":"2024-09-12T01:22:42.018175+0000","last_fullsized":"2024-09-12T01:22:42.018175+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:22:42.017810+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:22:42.017810+0000","last_clean_scrub_stamp":"2024-09-12T01:22:42.017810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:57.124541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"262'3","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:44.847036+0000","last_change":"2024-09-12T01:22:44.847036+0000","last_active":"2024-09-12T01:22:44.847036+0000","last_peered":"2024-09-12T01:22:44.847036+0000","last_clean":"2024-09-12T01:22:44.847036+0000","last_became_active":"2024-09-12T00:52:37.283199+0000","last_became_peered":"2024-09-12T00:52:37.283199+0000","last_unstale":"2024-09-12T01:22:44.847036+0000","last_undegraded":"2024-09-12T01:22:44.847036+0000","last_fullsized":"2024-09-12T01:22:44.847036+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T01:22:44.846819+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T01:22:44.846819+0000","last_clean_scrub_stamp":"2024-09-12T01:22:44.846819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:28.445555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"265'5","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:48.281462+0000","last_change":"2024-09-12T01:22:48.281462+0000","last_active":"2024-09-12T01:22:48.281462+0000","last_peered":"2024-09-12T01:22:48.281462+0000","last_clean":"2024-09-12T01:22:48.281462+0000","last_became_active":"2024-09-12T00:51:04.981675+0000","last_became_peered":"2024-09-12T00:51:04.981675+0000","last_unstale":"2024-09-12T01:22:48.281462+0000","last_undegraded":"2024-09-12T01:22:48.281462+0000","last_fullsized":"2024-09-12T01:22:48.281462+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:22:48.281224+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:22:48.281224+0000","last_clean_scrub_stamp":"2024-09-12T01:22:48.281224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:20.576199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:23:01.549719+0000","last_change":"2024-09-12T01:23:01.549719+0000","last_active":"2024-09-12T01:23:01.549719+0000","last_peered":"2024-09-12T01:23:01.549719+0000","last_clean":"2024-09-12T01:23:01.549719+0000","last_became_active":"2024-09-12T01:03:40.576430+0000","last_became_peered":"2024-09-12T01:03:40.576430+0000","last_unstale":"2024-09-12T01:23:01.549719+0000","last_undegraded":"2024-09-12T01:23:01.549719+0000","last_fullsized":"2024-09-12T01:23:01.549719+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:23:01.549542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:23:01.549542+0000","last_clean_scrub_stamp":"2024-09-12T01:23:01.549542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:13.381812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:23:00.864625+0000","last_change":"2024-09-12T01:23:00.864625+0000","last_active":"2024-09-12T01:23:00.864625+0000","last_peered":"2024-09-12T01:23:00.864625+0000","last_clean":"2024-09-12T01:23:00.864625+0000","last_became_active":"2024-09-12T00:52:40.345995+0000","last_became_peered":"2024-09-12T00:52:40.345995+0000","last_unstale":"2024-09-12T01:23:00.864625+0000","last_undegraded":"2024-09-12T01:23:00.864625+0000","last_fullsized":"2024-09-12T01:23:00.864625+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:23:00.864431+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:23:00.864431+0000","last_clean_scrub_stamp":"2024-09-12T01:23:00.864431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:59.063296+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'2","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:52.195359+0000","last_change":"2024-09-12T01:22:52.195359+0000","last_active":"2024-09-12T01:22:52.195359+0000","last_peered":"2024-09-12T01:22:52.195359+0000","last_clean":"2024-09-12T01:22:52.195359+0000","last_became_active":"2024-09-12T00:52:37.299604+0000","last_became_peered":"2024-09-12T00:52:37.299604+0000","last_unstale":"2024-09-12T01:22:52.195359+0000","last_undegraded":"2024-09-12T01:22:52.195359+0000","last_fullsized":"2024-09-12T01:22:52.195359+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:52.195168+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:52.195168+0000","last_clean_scrub_stamp":"2024-09-12T01:22:52.195168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:17.326944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'41","reported_seq":166,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:31.285014+0000","last_change":"2024-09-12T01:22:31.284832+0000","last_active":"2024-09-12T01:22:31.285014+0000","last_peered":"2024-09-12T01:22:31.285014+0000","last_clean":"2024-09-12T01:22:31.285014+0000","last_became_active":"2024-09-12T00:51:04.968673+0000","last_became_peered":"2024-09-12T00:51:04.968673+0000","last_unstale":"2024-09-12T01:22:31.285014+0000","last_undegraded":"2024-09-12T01:22:31.285014+0000","last_fullsized":"2024-09-12T01:22:31.285014+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'41","last_scrub_stamp":"2024-09-12T01:22:31.284652+0000","last_deep_scrub":"265'41","last_deep_scrub_stamp":"2024-09-12T01:22:31.284652+0000","last_clean_scrub_stamp":"2024-09-12T01:22:31.284652+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:29.195882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":145,"num_write":79,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:45.181942+0000","last_change":"2024-09-12T01:22:45.181942+0000","last_active":"2024-09-12T01:22:45.181942+0000","last_peered":"2024-09-12T01:22:45.181942+0000","last_clean":"2024-09-12T01:22:45.181942+0000","last_became_active":"2024-09-12T01:03:40.590440+0000","last_became_peered":"2024-09-12T01:03:40.590440+0000","last_unstale":"2024-09-12T01:22:45.181942+0000","last_undegraded":"2024-09-12T01:22:45.181942+0000","last_fullsized":"2024-09-12T01:22:45.181942+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:45.181767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:45.181767+0000","last_clean_scrub_stamp":"2024-09-12T01:22:45.181767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:36.799367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:58.843714+0000","last_change":"2024-09-12T01:22:58.843714+0000","last_active":"2024-09-12T01:22:58.843714+0000","last_peered":"2024-09-12T01:22:58.843714+0000","last_clean":"2024-09-12T01:22:58.843714+0000","last_became_active":"2024-09-12T00:52:40.359069+0000","last_became_peered":"2024-09-12T00:52:40.359069+0000","last_unstale":"2024-09-12T01:22:58.843714+0000","last_undegraded":"2024-09-12T01:22:58.843714+0000","last_fullsized":"2024-09-12T01:22:58.843714+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:58.843517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:58.843517+0000","last_clean_scrub_stamp":"2024-09-12T01:22:58.843517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:16.651969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"262'5","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:45.529495+0000","last_change":"2024-09-12T01:22:45.529495+0000","last_active":"2024-09-12T01:22:45.529495+0000","last_peered":"2024-09-12T01:22:45.529495+0000","last_clean":"2024-09-12T01:22:45.529495+0000","last_became_active":"2024-09-12T00:52:37.273684+0000","last_became_peered":"2024-09-12T00:52:37.273684+0000","last_unstale":"2024-09-12T01:22:45.529495+0000","last_undegraded":"2024-09-12T01:22:45.529495+0000","last_fullsized":"2024-09-12T01:22:45.529495+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T01:22:45.529202+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T01:22:45.529202+0000","last_clean_scrub_stamp":"2024-09-12T01:22:45.529202+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:26.116702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":25602,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'50","reported_seq":191,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:44.366544+0000","last_change":"2024-09-12T01:22:44.366544+0000","last_active":"2024-09-12T01:22:44.366544+0000","last_peered":"2024-09-12T01:22:44.366544+0000","last_clean":"2024-09-12T01:22:44.366544+0000","last_became_active":"2024-09-12T00:51:04.993887+0000","last_became_peered":"2024-09-12T00:51:04.993887+0000","last_unstale":"2024-09-12T01:22:44.366544+0000","last_undegraded":"2024-09-12T01:22:44.366544+0000","last_fullsized":"2024-09-12T01:22:44.366544+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'50","last_scrub_stamp":"2024-09-12T01:22:44.366315+0000","last_deep_scrub":"265'50","last_deep_scrub_stamp":"2024-09-12T01:22:44.366315+0000","last_clean_scrub_stamp":"2024-09-12T01:22:44.366315+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:19.628033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":256,"num_read_kb":177,"num_write":91,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'2","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:30.402778+0000","last_change":"2024-09-12T01:22:30.402778+0000","last_active":"2024-09-12T01:22:30.402778+0000","last_peered":"2024-09-12T01:22:30.402778+0000","last_clean":"2024-09-12T01:22:30.402778+0000","last_became_active":"2024-09-12T01:03:40.580348+0000","last_became_peered":"2024-09-12T01:03:40.580348+0000","last_unstale":"2024-09-12T01:22:30.402778+0000","last_undegraded":"2024-09-12T01:22:30.402778+0000","last_fullsized":"2024-09-12T01:22:30.402778+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:30.402577+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:30.402577+0000","last_clean_scrub_stamp":"2024-09-12T01:22:30.402577+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:53.076131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"262'8","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:57.807266+0000","last_change":"2024-09-12T01:22:57.807266+0000","last_active":"2024-09-12T01:22:57.807266+0000","last_peered":"2024-09-12T01:22:57.807266+0000","last_clean":"2024-09-12T01:22:57.807266+0000","last_became_active":"2024-09-12T00:52:40.363347+0000","last_became_peered":"2024-09-12T00:52:40.363347+0000","last_unstale":"2024-09-12T01:22:57.807266+0000","last_undegraded":"2024-09-12T01:22:57.807266+0000","last_fullsized":"2024-09-12T01:22:57.807266+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-12T01:22:57.807079+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-12T01:22:57.807079+0000","last_clean_scrub_stamp":"2024-09-12T01:22:57.807079+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:27.531911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":21506,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:48.489603+0000","last_change":"2024-09-12T01:22:48.489603+0000","last_active":"2024-09-12T01:22:48.489603+0000","last_peered":"2024-09-12T01:22:48.489603+0000","last_clean":"2024-09-12T01:22:48.489603+0000","last_became_active":"2024-09-12T00:52:37.288074+0000","last_became_peered":"2024-09-12T00:52:37.288074+0000","last_unstale":"2024-09-12T01:22:48.489603+0000","last_undegraded":"2024-09-12T01:22:48.489603+0000","last_fullsized":"2024-09-12T01:22:48.489603+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:48.489418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:48.489418+0000","last_clean_scrub_stamp":"2024-09-12T01:22:48.489418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:52.796988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'39","reported_seq":164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:49.733840+0000","last_change":"2024-09-12T01:22:49.733840+0000","last_active":"2024-09-12T01:22:49.733840+0000","last_peered":"2024-09-12T01:22:49.733840+0000","last_clean":"2024-09-12T01:22:49.733840+0000","last_became_active":"2024-09-12T00:51:04.976345+0000","last_became_peered":"2024-09-12T00:51:04.976345+0000","last_unstale":"2024-09-12T01:22:49.733840+0000","last_undegraded":"2024-09-12T01:22:49.733840+0000","last_fullsized":"2024-09-12T01:22:49.733840+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'39","last_scrub_stamp":"2024-09-12T01:22:49.733654+0000","last_deep_scrub":"265'39","last_deep_scrub_stamp":"2024-09-12T01:22:49.733654+0000","last_clean_scrub_stamp":"2024-09-12T01:22:49.733654+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:36.176380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":155,"num_write":57,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:59.551772+0000","last_change":"2024-09-12T01:22:59.551772+0000","last_active":"2024-09-12T01:22:59.551772+0000","last_peered":"2024-09-12T01:22:59.551772+0000","last_clean":"2024-09-12T01:22:59.551772+0000","last_became_active":"2024-09-12T01:03:40.560777+0000","last_became_peered":"2024-09-12T01:03:40.560777+0000","last_unstale":"2024-09-12T01:22:59.551772+0000","last_undegraded":"2024-09-12T01:22:59.551772+0000","last_fullsized":"2024-09-12T01:22:59.551772+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:59.551493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:59.551493+0000","last_clean_scrub_stamp":"2024-09-12T01:22:59.551493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:44.958084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"265'3","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:23:02.873836+0000","last_change":"2024-09-12T01:23:02.873836+0000","last_active":"2024-09-12T01:23:02.873836+0000","last_peered":"2024-09-12T01:23:02.873836+0000","last_clean":"2024-09-12T01:23:02.873836+0000","last_became_active":"2024-09-12T00:52:40.352292+0000","last_became_peered":"2024-09-12T00:52:40.352292+0000","last_unstale":"2024-09-12T01:23:02.873836+0000","last_undegraded":"2024-09-12T01:23:02.873836+0000","last_fullsized":"2024-09-12T01:23:02.873836+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:23:02.873639+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:23:02.873639+0000","last_clean_scrub_stamp":"2024-09-12T01:23:02.873639+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:21.120757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:27.491057+0000","last_change":"2024-09-12T01:22:27.491057+0000","last_active":"2024-09-12T01:22:27.491057+0000","last_peered":"2024-09-12T01:22:27.491057+0000","last_clean":"2024-09-12T01:22:27.491057+0000","last_became_active":"2024-09-12T00:52:37.284325+0000","last_became_peered":"2024-09-12T00:52:37.284325+0000","last_unstale":"2024-09-12T01:22:27.491057+0000","last_undegraded":"2024-09-12T01:22:27.491057+0000","last_fullsized":"2024-09-12T01:22:27.491057+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:27.490874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:27.490874+0000","last_clean_scrub_stamp":"2024-09-12T01:22:27.490874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:46.906871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'20","reported_seq":110,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.383623+0000","last_change":"2024-09-12T01:22:17.383347+0000","last_active":"2024-09-12T01:22:17.383623+0000","last_peered":"2024-09-12T01:22:17.383623+0000","last_clean":"2024-09-12T01:22:17.383623+0000","last_became_active":"2024-09-12T00:51:04.961563+0000","last_became_peered":"2024-09-12T00:51:04.961563+0000","last_unstale":"2024-09-12T01:22:17.383623+0000","last_undegraded":"2024-09-12T01:22:17.383623+0000","last_fullsized":"2024-09-12T01:22:17.383623+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'20","last_scrub_stamp":"2024-09-12T01:22:17.383043+0000","last_deep_scrub":"265'20","last_deep_scrub_stamp":"2024-09-12T01:22:17.383043+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.383043+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:52.621490+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":68,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:51.482419+0000","last_change":"2024-09-12T01:22:51.482419+0000","last_active":"2024-09-12T01:22:51.482419+0000","last_peered":"2024-09-12T01:22:51.482419+0000","last_clean":"2024-09-12T01:22:51.482419+0000","last_became_active":"2024-09-12T01:03:40.580083+0000","last_became_peered":"2024-09-12T01:03:40.580083+0000","last_unstale":"2024-09-12T01:22:51.482419+0000","last_undegraded":"2024-09-12T01:22:51.482419+0000","last_fullsized":"2024-09-12T01:22:51.482419+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:51.482234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:51.482234+0000","last_clean_scrub_stamp":"2024-09-12T01:22:51.482234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:18.293740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'5","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:50.895235+0000","last_change":"2024-09-12T01:22:50.895235+0000","last_active":"2024-09-12T01:22:50.895235+0000","last_peered":"2024-09-12T01:22:50.895235+0000","last_clean":"2024-09-12T01:22:50.895235+0000","last_became_active":"2024-09-12T00:52:40.336368+0000","last_became_peered":"2024-09-12T00:52:40.336368+0000","last_unstale":"2024-09-12T01:22:50.895235+0000","last_undegraded":"2024-09-12T01:22:50.895235+0000","last_fullsized":"2024-09-12T01:22:50.895235+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:22:50.895043+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:22:50.895043+0000","last_clean_scrub_stamp":"2024-09-12T01:22:50.895043+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:31.330347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:49.240617+0000","last_change":"2024-09-12T01:22:49.240617+0000","last_active":"2024-09-12T01:22:49.240617+0000","last_peered":"2024-09-12T01:22:49.240617+0000","last_clean":"2024-09-12T01:22:49.240617+0000","last_became_active":"2024-09-12T00:52:37.295945+0000","last_became_peered":"2024-09-12T00:52:37.295945+0000","last_unstale":"2024-09-12T01:22:49.240617+0000","last_undegraded":"2024-09-12T01:22:49.240617+0000","last_fullsized":"2024-09-12T01:22:49.240617+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:49.240364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:49.240364+0000","last_clean_scrub_stamp":"2024-09-12T01:22:49.240364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:01.460782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"265'27","reported_seq":132,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:41.493365+0000","last_change":"2024-09-12T01:22:41.493365+0000","last_active":"2024-09-12T01:22:41.493365+0000","last_peered":"2024-09-12T01:22:41.493365+0000","last_clean":"2024-09-12T01:22:41.493365+0000","last_became_active":"2024-09-12T00:51:04.975831+0000","last_became_peered":"2024-09-12T00:51:04.975831+0000","last_unstale":"2024-09-12T01:22:41.493365+0000","last_undegraded":"2024-09-12T01:22:41.493365+0000","last_fullsized":"2024-09-12T01:22:41.493365+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'27","last_scrub_stamp":"2024-09-12T01:22:41.493085+0000","last_deep_scrub":"265'27","last_deep_scrub_stamp":"2024-09-12T01:22:41.493085+0000","last_clean_scrub_stamp":"2024-09-12T01:22:41.493085+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:56.711739+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":101,"num_write":53,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:38.397914+0000","last_change":"2024-09-12T01:03:40.580652+0000","last_active":"2024-09-12T01:20:38.397914+0000","last_peered":"2024-09-12T01:20:38.397914+0000","last_clean":"2024-09-12T01:20:38.397914+0000","last_became_active":"2024-09-12T01:03:40.579923+0000","last_became_peered":"2024-09-12T01:03:40.579923+0000","last_unstale":"2024-09-12T01:20:38.397914+0000","last_undegraded":"2024-09-12T01:20:38.397914+0000","last_fullsized":"2024-09-12T01:20:38.397914+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:43.207623+0000","last_change":"2024-09-12T01:22:43.207483+0000","last_active":"2024-09-12T01:22:43.207623+0000","last_peered":"2024-09-12T01:22:43.207623+0000","last_clean":"2024-09-12T01:22:43.207623+0000","last_became_active":"2024-09-12T00:52:40.349363+0000","last_became_peered":"2024-09-12T00:52:40.349363+0000","last_unstale":"2024-09-12T01:22:43.207623+0000","last_undegraded":"2024-09-12T01:22:43.207623+0000","last_fullsized":"2024-09-12T01:22:43.207623+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:43.207311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:43.207311+0000","last_clean_scrub_stamp":"2024-09-12T01:22:43.207311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:47.937508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:43.893870+0000","last_change":"2024-09-12T01:22:43.893693+0000","last_active":"2024-09-12T01:22:43.893870+0000","last_peered":"2024-09-12T01:22:43.893870+0000","last_clean":"2024-09-12T01:22:43.893870+0000","last_became_active":"2024-09-12T00:52:37.270958+0000","last_became_peered":"2024-09-12T00:52:37.270958+0000","last_unstale":"2024-09-12T01:22:43.893870+0000","last_undegraded":"2024-09-12T01:22:43.893870+0000","last_fullsized":"2024-09-12T01:22:43.893870+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:43.893511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:43.893511+0000","last_clean_scrub_stamp":"2024-09-12T01:22:43.893511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:45.522023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'19","reported_seq":104,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:40.470884+0000","last_change":"2024-09-12T01:22:40.470884+0000","last_active":"2024-09-12T01:22:40.470884+0000","last_peered":"2024-09-12T01:22:40.470884+0000","last_clean":"2024-09-12T01:22:40.470884+0000","last_became_active":"2024-09-12T00:51:04.975763+0000","last_became_peered":"2024-09-12T00:51:04.975763+0000","last_unstale":"2024-09-12T01:22:40.470884+0000","last_undegraded":"2024-09-12T01:22:40.470884+0000","last_fullsized":"2024-09-12T01:22:40.470884+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'19","last_scrub_stamp":"2024-09-12T01:22:40.470688+0000","last_deep_scrub":"265'19","last_deep_scrub_stamp":"2024-09-12T01:22:40.470688+0000","last_clean_scrub_stamp":"2024-09-12T01:22:40.470688+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:44.316701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:23:01.163287+0000","last_change":"2024-09-12T01:23:01.163150+0000","last_active":"2024-09-12T01:23:01.163287+0000","last_peered":"2024-09-12T01:23:01.163287+0000","last_clean":"2024-09-12T01:23:01.163287+0000","last_became_active":"2024-09-12T01:03:40.581062+0000","last_became_peered":"2024-09-12T01:03:40.581062+0000","last_unstale":"2024-09-12T01:23:01.163287+0000","last_undegraded":"2024-09-12T01:23:01.163287+0000","last_fullsized":"2024-09-12T01:23:01.163287+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:23:01.162965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:23:01.162965+0000","last_clean_scrub_stamp":"2024-09-12T01:23:01.162965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:49.881618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'10","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:42.231590+0000","last_change":"2024-09-12T01:22:42.231395+0000","last_active":"2024-09-12T01:22:42.231590+0000","last_peered":"2024-09-12T01:22:42.231590+0000","last_clean":"2024-09-12T01:22:42.231590+0000","last_became_active":"2024-09-12T00:52:40.343871+0000","last_became_peered":"2024-09-12T00:52:40.343871+0000","last_unstale":"2024-09-12T01:22:42.231590+0000","last_undegraded":"2024-09-12T01:22:42.231590+0000","last_fullsized":"2024-09-12T01:22:42.231590+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-12T01:22:42.231221+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-12T01:22:42.231221+0000","last_clean_scrub_stamp":"2024-09-12T01:22:42.231221+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:49.732150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":22610,"num_write":15,"num_write_kb":6184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:52.728063+0000","last_change":"2024-09-12T01:22:52.727911+0000","last_active":"2024-09-12T01:22:52.728063+0000","last_peered":"2024-09-12T01:22:52.728063+0000","last_clean":"2024-09-12T01:22:52.728063+0000","last_became_active":"2024-09-12T00:52:37.276237+0000","last_became_peered":"2024-09-12T00:52:37.276237+0000","last_unstale":"2024-09-12T01:22:52.728063+0000","last_undegraded":"2024-09-12T01:22:52.728063+0000","last_fullsized":"2024-09-12T01:22:52.728063+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:52.727717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:52.727717+0000","last_clean_scrub_stamp":"2024-09-12T01:22:52.727717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:45.276702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'15","reported_seq":95,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:47.301103+0000","last_change":"2024-09-12T01:22:47.301103+0000","last_active":"2024-09-12T01:22:47.301103+0000","last_peered":"2024-09-12T01:22:47.301103+0000","last_clean":"2024-09-12T01:22:47.301103+0000","last_became_active":"2024-09-12T00:51:04.994606+0000","last_became_peered":"2024-09-12T00:51:04.994606+0000","last_unstale":"2024-09-12T01:22:47.301103+0000","last_undegraded":"2024-09-12T01:22:47.301103+0000","last_fullsized":"2024-09-12T01:22:47.301103+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'15","last_scrub_stamp":"2024-09-12T01:22:47.300879+0000","last_deep_scrub":"265'15","last_deep_scrub_stamp":"2024-09-12T01:22:47.300879+0000","last_clean_scrub_stamp":"2024-09-12T01:22:47.300879+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:47.259624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"265'2","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:23:02.147834+0000","last_change":"2024-09-12T01:23:02.147834+0000","last_active":"2024-09-12T01:23:02.147834+0000","last_peered":"2024-09-12T01:23:02.147834+0000","last_clean":"2024-09-12T01:23:02.147834+0000","last_became_active":"2024-09-12T01:03:40.581586+0000","last_became_peered":"2024-09-12T01:03:40.581586+0000","last_unstale":"2024-09-12T01:23:02.147834+0000","last_undegraded":"2024-09-12T01:23:02.147834+0000","last_fullsized":"2024-09-12T01:23:02.147834+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:23:02.147647+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:23:02.147647+0000","last_clean_scrub_stamp":"2024-09-12T01:23:02.147647+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:49.781836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'7","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:59.849501+0000","last_change":"2024-09-12T01:22:59.849298+0000","last_active":"2024-09-12T01:22:59.849501+0000","last_peered":"2024-09-12T01:22:59.849501+0000","last_clean":"2024-09-12T01:22:59.849501+0000","last_became_active":"2024-09-12T00:52:40.363072+0000","last_became_peered":"2024-09-12T00:52:40.363072+0000","last_unstale":"2024-09-12T01:22:59.849501+0000","last_undegraded":"2024-09-12T01:22:59.849501+0000","last_fullsized":"2024-09-12T01:22:59.849501+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T01:22:59.849107+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T01:22:59.849107+0000","last_clean_scrub_stamp":"2024-09-12T01:22:59.849107+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:30.866703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9232,"num_write":7,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:36.977562+0000","last_change":"2024-09-12T01:22:36.977341+0000","last_active":"2024-09-12T01:22:36.977562+0000","last_peered":"2024-09-12T01:22:36.977562+0000","last_clean":"2024-09-12T01:22:36.977562+0000","last_became_active":"2024-09-12T00:52:37.291045+0000","last_became_peered":"2024-09-12T00:52:37.291045+0000","last_unstale":"2024-09-12T01:22:36.977562+0000","last_undegraded":"2024-09-12T01:22:36.977562+0000","last_fullsized":"2024-09-12T01:22:36.977562+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:36.977080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:36.977080+0000","last_clean_scrub_stamp":"2024-09-12T01:22:36.977080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:27.874464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'47","reported_seq":186,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:42.924777+0000","last_change":"2024-09-12T01:22:42.924777+0000","last_active":"2024-09-12T01:22:42.924777+0000","last_peered":"2024-09-12T01:22:42.924777+0000","last_clean":"2024-09-12T01:22:42.924777+0000","last_became_active":"2024-09-12T00:51:04.980601+0000","last_became_peered":"2024-09-12T00:51:04.980601+0000","last_unstale":"2024-09-12T01:22:42.924777+0000","last_undegraded":"2024-09-12T01:22:42.924777+0000","last_fullsized":"2024-09-12T01:22:42.924777+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'47","last_scrub_stamp":"2024-09-12T01:22:42.924599+0000","last_deep_scrub":"265'47","last_deep_scrub_stamp":"2024-09-12T01:22:42.924599+0000","last_clean_scrub_stamp":"2024-09-12T01:22:42.924599+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:23.089967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":177,"num_write":81,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:20:38.397865+0000","last_change":"2024-09-12T01:03:40.580511+0000","last_active":"2024-09-12T01:20:38.397865+0000","last_peered":"2024-09-12T01:20:38.397865+0000","last_clean":"2024-09-12T01:20:38.397865+0000","last_became_active":"2024-09-12T01:03:40.579772+0000","last_became_peered":"2024-09-12T01:03:40.579772+0000","last_unstale":"2024-09-12T01:20:38.397865+0000","last_undegraded":"2024-09-12T01:20:38.397865+0000","last_fullsized":"2024-09-12T01:20:38.397865+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.536130+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.536130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'3","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:38.026339+0000","last_change":"2024-09-12T01:22:38.026163+0000","last_active":"2024-09-12T01:22:38.026339+0000","last_peered":"2024-09-12T01:22:38.026339+0000","last_clean":"2024-09-12T01:22:38.026339+0000","last_became_active":"2024-09-12T00:52:40.347156+0000","last_became_peered":"2024-09-12T00:52:40.347156+0000","last_unstale":"2024-09-12T01:22:38.026339+0000","last_undegraded":"2024-09-12T01:22:38.026339+0000","last_fullsized":"2024-09-12T01:22:38.026339+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:22:38.025979+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:22:38.025979+0000","last_clean_scrub_stamp":"2024-09-12T01:22:38.025979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:31.526630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:43.571256+0000","last_change":"2024-09-12T01:22:43.571124+0000","last_active":"2024-09-12T01:22:43.571256+0000","last_peered":"2024-09-12T01:22:43.571256+0000","last_clean":"2024-09-12T01:22:43.571256+0000","last_became_active":"2024-09-12T00:52:37.290858+0000","last_became_peered":"2024-09-12T00:52:37.290858+0000","last_unstale":"2024-09-12T01:22:43.571256+0000","last_undegraded":"2024-09-12T01:22:43.571256+0000","last_fullsized":"2024-09-12T01:22:43.571256+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:43.570920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:43.570920+0000","last_clean_scrub_stamp":"2024-09-12T01:22:43.570920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:01.454178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'11","reported_seq":87,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:48.684768+0000","last_change":"2024-09-12T01:22:48.684768+0000","last_active":"2024-09-12T01:22:48.684768+0000","last_peered":"2024-09-12T01:22:48.684768+0000","last_clean":"2024-09-12T01:22:48.684768+0000","last_became_active":"2024-09-12T00:51:04.988521+0000","last_became_peered":"2024-09-12T00:51:04.988521+0000","last_unstale":"2024-09-12T01:22:48.684768+0000","last_undegraded":"2024-09-12T01:22:48.684768+0000","last_fullsized":"2024-09-12T01:22:48.684768+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'11","last_scrub_stamp":"2024-09-12T01:22:48.684584+0000","last_deep_scrub":"265'11","last_deep_scrub_stamp":"2024-09-12T01:22:48.684584+0000","last_clean_scrub_stamp":"2024-09-12T01:22:48.684584+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:03.630542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:29.444544+0000","last_change":"2024-09-12T01:22:29.444544+0000","last_active":"2024-09-12T01:22:29.444544+0000","last_peered":"2024-09-12T01:22:29.444544+0000","last_clean":"2024-09-12T01:22:29.444544+0000","last_became_active":"2024-09-12T01:03:40.591869+0000","last_became_peered":"2024-09-12T01:03:40.591869+0000","last_unstale":"2024-09-12T01:22:29.444544+0000","last_undegraded":"2024-09-12T01:22:29.444544+0000","last_fullsized":"2024-09-12T01:22:29.444544+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:29.444338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:29.444338+0000","last_clean_scrub_stamp":"2024-09-12T01:22:29.444338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:18.046980+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:54.773318+0000","last_change":"2024-09-12T01:22:54.773318+0000","last_active":"2024-09-12T01:22:54.773318+0000","last_peered":"2024-09-12T01:22:54.773318+0000","last_clean":"2024-09-12T01:22:54.773318+0000","last_became_active":"2024-09-12T00:52:40.344566+0000","last_became_peered":"2024-09-12T00:52:40.344566+0000","last_unstale":"2024-09-12T01:22:54.773318+0000","last_undegraded":"2024-09-12T01:22:54.773318+0000","last_fullsized":"2024-09-12T01:22:54.773318+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:54.773142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:54.773142+0000","last_clean_scrub_stamp":"2024-09-12T01:22:54.773142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:12.232776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:52.555945+0000","last_change":"2024-09-12T01:22:52.555945+0000","last_active":"2024-09-12T01:22:52.555945+0000","last_peered":"2024-09-12T01:22:52.555945+0000","last_clean":"2024-09-12T01:22:52.555945+0000","last_became_active":"2024-09-12T00:52:37.282987+0000","last_became_peered":"2024-09-12T00:52:37.282987+0000","last_unstale":"2024-09-12T01:22:52.555945+0000","last_undegraded":"2024-09-12T01:22:52.555945+0000","last_fullsized":"2024-09-12T01:22:52.555945+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:52.555759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:52.555759+0000","last_clean_scrub_stamp":"2024-09-12T01:22:52.555759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:53.858151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'40","reported_seq":165,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:47.702380+0000","last_change":"2024-09-12T01:22:47.702233+0000","last_active":"2024-09-12T01:22:47.702380+0000","last_peered":"2024-09-12T01:22:47.702380+0000","last_clean":"2024-09-12T01:22:47.702380+0000","last_became_active":"2024-09-12T00:51:05.001162+0000","last_became_peered":"2024-09-12T00:51:05.001162+0000","last_unstale":"2024-09-12T01:22:47.702380+0000","last_undegraded":"2024-09-12T01:22:47.702380+0000","last_fullsized":"2024-09-12T01:22:47.702380+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'40","last_scrub_stamp":"2024-09-12T01:22:47.702053+0000","last_deep_scrub":"265'40","last_deep_scrub_stamp":"2024-09-12T01:22:47.702053+0000","last_clean_scrub_stamp":"2024-09-12T01:22:47.702053+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:28.125705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":142,"num_write":73,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:56.554578+0000","last_change":"2024-09-12T01:22:56.554578+0000","last_active":"2024-09-12T01:22:56.554578+0000","last_peered":"2024-09-12T01:22:56.554578+0000","last_clean":"2024-09-12T01:22:56.554578+0000","last_became_active":"2024-09-12T01:03:40.551803+0000","last_became_peered":"2024-09-12T01:03:40.551803+0000","last_unstale":"2024-09-12T01:22:56.554578+0000","last_undegraded":"2024-09-12T01:22:56.554578+0000","last_fullsized":"2024-09-12T01:22:56.554578+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:56.554380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:56.554380+0000","last_clean_scrub_stamp":"2024-09-12T01:22:56.554380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:21.574134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:56.807127+0000","last_change":"2024-09-12T01:22:56.807127+0000","last_active":"2024-09-12T01:22:56.807127+0000","last_peered":"2024-09-12T01:22:56.807127+0000","last_clean":"2024-09-12T01:22:56.807127+0000","last_became_active":"2024-09-12T00:52:40.354387+0000","last_became_peered":"2024-09-12T00:52:40.354387+0000","last_unstale":"2024-09-12T01:22:56.807127+0000","last_undegraded":"2024-09-12T01:22:56.807127+0000","last_fullsized":"2024-09-12T01:22:56.807127+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:56.806940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:56.806940+0000","last_clean_scrub_stamp":"2024-09-12T01:22:56.806940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:46.117079+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:26.445283+0000","last_change":"2024-09-12T01:22:26.445283+0000","last_active":"2024-09-12T01:22:26.445283+0000","last_peered":"2024-09-12T01:22:26.445283+0000","last_clean":"2024-09-12T01:22:26.445283+0000","last_became_active":"2024-09-12T00:52:37.285154+0000","last_became_peered":"2024-09-12T00:52:37.285154+0000","last_unstale":"2024-09-12T01:22:26.445283+0000","last_undegraded":"2024-09-12T01:22:26.445283+0000","last_fullsized":"2024-09-12T01:22:26.445283+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:26.445055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:26.445055+0000","last_clean_scrub_stamp":"2024-09-12T01:22:26.445055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:23.861328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'61","reported_seq":221,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:41.550167+0000","last_change":"2024-09-12T01:22:41.550167+0000","last_active":"2024-09-12T01:22:41.550167+0000","last_peered":"2024-09-12T01:22:41.550167+0000","last_clean":"2024-09-12T01:22:41.550167+0000","last_became_active":"2024-09-12T00:51:04.975583+0000","last_became_peered":"2024-09-12T00:51:04.975583+0000","last_unstale":"2024-09-12T01:22:41.550167+0000","last_undegraded":"2024-09-12T01:22:41.550167+0000","last_fullsized":"2024-09-12T01:22:41.550167+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'61","last_scrub_stamp":"2024-09-12T01:22:41.549939+0000","last_deep_scrub":"265'61","last_deep_scrub_stamp":"2024-09-12T01:22:41.549939+0000","last_clean_scrub_stamp":"2024-09-12T01:22:41.549939+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:37.092779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":309,"num_read_kb":216,"num_write":105,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:40.030260+0000","last_change":"2024-09-12T01:22:40.030260+0000","last_active":"2024-09-12T01:22:40.030260+0000","last_peered":"2024-09-12T01:22:40.030260+0000","last_clean":"2024-09-12T01:22:40.030260+0000","last_became_active":"2024-09-12T01:03:40.569907+0000","last_became_peered":"2024-09-12T01:03:40.569907+0000","last_unstale":"2024-09-12T01:22:40.030260+0000","last_undegraded":"2024-09-12T01:22:40.030260+0000","last_fullsized":"2024-09-12T01:22:40.030260+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:40.030080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:40.030080+0000","last_clean_scrub_stamp":"2024-09-12T01:22:40.030080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:02.085149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:41.205229+0000","last_change":"2024-09-12T01:22:41.205229+0000","last_active":"2024-09-12T01:22:41.205229+0000","last_peered":"2024-09-12T01:22:41.205229+0000","last_clean":"2024-09-12T01:22:41.205229+0000","last_became_active":"2024-09-12T00:52:40.342703+0000","last_became_peered":"2024-09-12T00:52:40.342703+0000","last_unstale":"2024-09-12T01:22:41.205229+0000","last_undegraded":"2024-09-12T01:22:41.205229+0000","last_fullsized":"2024-09-12T01:22:41.205229+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:41.205045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:41.205045+0000","last_clean_scrub_stamp":"2024-09-12T01:22:41.205045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:57.444570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"265'6","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:46.344526+0000","last_change":"2024-09-12T01:22:46.344526+0000","last_active":"2024-09-12T01:22:46.344526+0000","last_peered":"2024-09-12T01:22:46.344526+0000","last_clean":"2024-09-12T01:22:46.344526+0000","last_became_active":"2024-09-12T00:52:37.292449+0000","last_became_peered":"2024-09-12T00:52:37.292449+0000","last_unstale":"2024-09-12T01:22:46.344526+0000","last_undegraded":"2024-09-12T01:22:46.344526+0000","last_fullsized":"2024-09-12T01:22:46.344526+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:22:46.344345+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:22:46.344345+0000","last_clean_scrub_stamp":"2024-09-12T01:22:46.344345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:11.188496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'117","reported_seq":413,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:33.077945+0000","last_change":"2024-09-12T01:22:33.077685+0000","last_active":"2024-09-12T01:22:33.077945+0000","last_peered":"2024-09-12T01:22:33.077945+0000","last_clean":"2024-09-12T01:22:33.077945+0000","last_became_active":"2024-09-12T00:51:04.984495+0000","last_became_peered":"2024-09-12T00:51:04.984495+0000","last_unstale":"2024-09-12T01:22:33.077945+0000","last_undegraded":"2024-09-12T01:22:33.077945+0000","last_fullsized":"2024-09-12T01:22:33.077945+0000","mapping_epoch":252,"log_start":"265'100","ondisk_log_start":"265'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'117","last_scrub_stamp":"2024-09-12T01:22:33.077397+0000","last_deep_scrub":"265'117","last_deep_scrub_stamp":"2024-09-12T01:22:33.077397+0000","last_clean_scrub_stamp":"2024-09-12T01:22:33.077397+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:07.359308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":690,"num_read_kb":506,"num_write":167,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3728,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:55.574423+0000","last_change":"2024-09-12T01:22:55.574423+0000","last_active":"2024-09-12T01:22:55.574423+0000","last_peered":"2024-09-12T01:22:55.574423+0000","last_clean":"2024-09-12T01:22:55.574423+0000","last_became_active":"2024-09-12T01:03:40.566107+0000","last_became_peered":"2024-09-12T01:03:40.566107+0000","last_unstale":"2024-09-12T01:22:55.574423+0000","last_undegraded":"2024-09-12T01:22:55.574423+0000","last_fullsized":"2024-09-12T01:22:55.574423+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:55.574215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:55.574215+0000","last_clean_scrub_stamp":"2024-09-12T01:22:55.574215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:29.430902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:55.759751+0000","last_change":"2024-09-12T01:22:55.759751+0000","last_active":"2024-09-12T01:22:55.759751+0000","last_peered":"2024-09-12T01:22:55.759751+0000","last_clean":"2024-09-12T01:22:55.759751+0000","last_became_active":"2024-09-12T00:52:40.367188+0000","last_became_peered":"2024-09-12T00:52:40.367188+0000","last_unstale":"2024-09-12T01:22:55.759751+0000","last_undegraded":"2024-09-12T01:22:55.759751+0000","last_fullsized":"2024-09-12T01:22:55.759751+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:55.759565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:55.759565+0000","last_clean_scrub_stamp":"2024-09-12T01:22:55.759565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:46.645933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"265'2","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:37.216787+0000","last_change":"2024-09-12T01:22:37.216787+0000","last_active":"2024-09-12T01:22:37.216787+0000","last_peered":"2024-09-12T01:22:37.216787+0000","last_clean":"2024-09-12T01:22:37.216787+0000","last_became_active":"2024-09-12T00:52:37.281129+0000","last_became_peered":"2024-09-12T00:52:37.281129+0000","last_unstale":"2024-09-12T01:22:37.216787+0000","last_undegraded":"2024-09-12T01:22:37.216787+0000","last_fullsized":"2024-09-12T01:22:37.216787+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:37.216601+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:37.216601+0000","last_clean_scrub_stamp":"2024-09-12T01:22:37.216601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:14.358131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"265'9","reported_seq":81,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.365423+0000","last_change":"2024-09-12T01:22:21.365181+0000","last_active":"2024-09-12T01:22:21.365423+0000","last_peered":"2024-09-12T01:22:21.365423+0000","last_clean":"2024-09-12T01:22:21.365423+0000","last_became_active":"2024-09-12T00:51:04.983577+0000","last_became_peered":"2024-09-12T00:51:04.983577+0000","last_unstale":"2024-09-12T01:22:21.365423+0000","last_undegraded":"2024-09-12T01:22:21.365423+0000","last_fullsized":"2024-09-12T01:22:21.365423+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-12T01:22:21.364947+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-12T01:22:21.364947+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.364947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:01.811632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:23:01.857554+0000","last_change":"2024-09-12T01:23:01.857554+0000","last_active":"2024-09-12T01:23:01.857554+0000","last_peered":"2024-09-12T01:23:01.857554+0000","last_clean":"2024-09-12T01:23:01.857554+0000","last_became_active":"2024-09-12T01:03:40.589838+0000","last_became_peered":"2024-09-12T01:03:40.589838+0000","last_unstale":"2024-09-12T01:23:01.857554+0000","last_undegraded":"2024-09-12T01:23:01.857554+0000","last_fullsized":"2024-09-12T01:23:01.857554+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:23:01.857368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:23:01.857368+0000","last_clean_scrub_stamp":"2024-09-12T01:23:01.857368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:50.474399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:48.852646+0000","last_change":"2024-09-12T01:22:48.852505+0000","last_active":"2024-09-12T01:22:48.852646+0000","last_peered":"2024-09-12T01:22:48.852646+0000","last_clean":"2024-09-12T01:22:48.852646+0000","last_became_active":"2024-09-12T00:52:40.356802+0000","last_became_peered":"2024-09-12T00:52:40.356802+0000","last_unstale":"2024-09-12T01:22:48.852646+0000","last_undegraded":"2024-09-12T01:22:48.852646+0000","last_fullsized":"2024-09-12T01:22:48.852646+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:48.852311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:48.852311+0000","last_clean_scrub_stamp":"2024-09-12T01:22:48.852311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:03.441631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"265'6","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:51.218647+0000","last_change":"2024-09-12T01:22:51.218495+0000","last_active":"2024-09-12T01:22:51.218647+0000","last_peered":"2024-09-12T01:22:51.218647+0000","last_clean":"2024-09-12T01:22:51.218647+0000","last_became_active":"2024-09-12T00:52:37.293564+0000","last_became_peered":"2024-09-12T00:52:37.293564+0000","last_unstale":"2024-09-12T01:22:51.218647+0000","last_undegraded":"2024-09-12T01:22:51.218647+0000","last_fullsized":"2024-09-12T01:22:51.218647+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:22:51.218309+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:22:51.218309+0000","last_clean_scrub_stamp":"2024-09-12T01:22:51.218309+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:04.960161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3128,"num_write":6,"num_write_kb":3128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"262'16","reported_seq":102,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:42.390141+0000","last_change":"2024-09-12T01:22:42.390141+0000","last_active":"2024-09-12T01:22:42.390141+0000","last_peered":"2024-09-12T01:22:42.390141+0000","last_clean":"2024-09-12T01:22:42.390141+0000","last_became_active":"2024-09-12T00:51:04.981091+0000","last_became_peered":"2024-09-12T00:51:04.981091+0000","last_unstale":"2024-09-12T01:22:42.390141+0000","last_undegraded":"2024-09-12T01:22:42.390141+0000","last_fullsized":"2024-09-12T01:22:42.390141+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'16","last_scrub_stamp":"2024-09-12T01:22:42.389938+0000","last_deep_scrub":"262'16","last_deep_scrub_stamp":"2024-09-12T01:22:42.389938+0000","last_clean_scrub_stamp":"2024-09-12T01:22:42.389938+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:56.771573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:58.543899+0000","last_change":"2024-09-12T01:22:58.543899+0000","last_active":"2024-09-12T01:22:58.543899+0000","last_peered":"2024-09-12T01:22:58.543899+0000","last_clean":"2024-09-12T01:22:58.543899+0000","last_became_active":"2024-09-12T01:03:40.565926+0000","last_became_peered":"2024-09-12T01:03:40.565926+0000","last_unstale":"2024-09-12T01:22:58.543899+0000","last_undegraded":"2024-09-12T01:22:58.543899+0000","last_fullsized":"2024-09-12T01:22:58.543899+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:58.543713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:58.543713+0000","last_clean_scrub_stamp":"2024-09-12T01:22:58.543713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:16.372257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:51.528845+0000","last_change":"2024-09-12T01:22:51.528717+0000","last_active":"2024-09-12T01:22:51.528845+0000","last_peered":"2024-09-12T01:22:51.528845+0000","last_clean":"2024-09-12T01:22:51.528845+0000","last_became_active":"2024-09-12T00:52:40.340423+0000","last_became_peered":"2024-09-12T00:52:40.340423+0000","last_unstale":"2024-09-12T01:22:51.528845+0000","last_undegraded":"2024-09-12T01:22:51.528845+0000","last_fullsized":"2024-09-12T01:22:51.528845+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:51.528547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:51.528547+0000","last_clean_scrub_stamp":"2024-09-12T01:22:51.528547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:23.791022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"265'5","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:35.244335+0000","last_change":"2024-09-12T01:22:35.244190+0000","last_active":"2024-09-12T01:22:35.244335+0000","last_peered":"2024-09-12T01:22:35.244335+0000","last_clean":"2024-09-12T01:22:35.244335+0000","last_became_active":"2024-09-12T00:52:37.293885+0000","last_became_peered":"2024-09-12T00:52:37.293885+0000","last_unstale":"2024-09-12T01:22:35.244335+0000","last_undegraded":"2024-09-12T01:22:35.244335+0000","last_fullsized":"2024-09-12T01:22:35.244335+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:22:35.244010+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:22:35.244010+0000","last_clean_scrub_stamp":"2024-09-12T01:22:35.244010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:14.998143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'39","reported_seq":159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:44.538267+0000","last_change":"2024-09-12T01:22:44.538267+0000","last_active":"2024-09-12T01:22:44.538267+0000","last_peered":"2024-09-12T01:22:44.538267+0000","last_clean":"2024-09-12T01:22:44.538267+0000","last_became_active":"2024-09-12T00:51:04.988252+0000","last_became_peered":"2024-09-12T00:51:04.988252+0000","last_unstale":"2024-09-12T01:22:44.538267+0000","last_undegraded":"2024-09-12T01:22:44.538267+0000","last_fullsized":"2024-09-12T01:22:44.538267+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'39","last_scrub_stamp":"2024-09-12T01:22:44.538040+0000","last_deep_scrub":"265'39","last_deep_scrub_stamp":"2024-09-12T01:22:44.538040+0000","last_clean_scrub_stamp":"2024-09-12T01:22:44.538040+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:14.183876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":135,"num_write":72,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'2","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:57.575183+0000","last_change":"2024-09-12T01:22:57.575183+0000","last_active":"2024-09-12T01:22:57.575183+0000","last_peered":"2024-09-12T01:22:57.575183+0000","last_clean":"2024-09-12T01:22:57.575183+0000","last_became_active":"2024-09-12T01:03:40.580376+0000","last_became_peered":"2024-09-12T01:03:40.580376+0000","last_unstale":"2024-09-12T01:22:57.575183+0000","last_undegraded":"2024-09-12T01:22:57.575183+0000","last_fullsized":"2024-09-12T01:22:57.575183+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:57.574996+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:57.574996+0000","last_clean_scrub_stamp":"2024-09-12T01:22:57.574996+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:32.185418+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:40.195327+0000","last_change":"2024-09-12T01:22:40.195327+0000","last_active":"2024-09-12T01:22:40.195327+0000","last_peered":"2024-09-12T01:22:40.195327+0000","last_clean":"2024-09-12T01:22:40.195327+0000","last_became_active":"2024-09-12T00:52:40.337359+0000","last_became_peered":"2024-09-12T00:52:40.337359+0000","last_unstale":"2024-09-12T01:22:40.195327+0000","last_undegraded":"2024-09-12T01:22:40.195327+0000","last_fullsized":"2024-09-12T01:22:40.195327+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:40.195153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:40.195153+0000","last_clean_scrub_stamp":"2024-09-12T01:22:40.195153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:37.029617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"265'5","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:53.212970+0000","last_change":"2024-09-12T01:22:53.212797+0000","last_active":"2024-09-12T01:22:53.212970+0000","last_peered":"2024-09-12T01:22:53.212970+0000","last_clean":"2024-09-12T01:22:53.212970+0000","last_became_active":"2024-09-12T00:52:37.299461+0000","last_became_peered":"2024-09-12T00:52:37.299461+0000","last_unstale":"2024-09-12T01:22:53.212970+0000","last_undegraded":"2024-09-12T01:22:53.212970+0000","last_fullsized":"2024-09-12T01:22:53.212970+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:22:53.212616+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:22:53.212616+0000","last_clean_scrub_stamp":"2024-09-12T01:22:53.212616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:00.920627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5125,"num_write":10,"num_write_kb":5125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'113","reported_seq":404,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:46.667740+0000","last_change":"2024-09-12T01:22:46.667740+0000","last_active":"2024-09-12T01:22:46.667740+0000","last_peered":"2024-09-12T01:22:46.667740+0000","last_clean":"2024-09-12T01:22:46.667740+0000","last_became_active":"2024-09-12T00:51:04.975690+0000","last_became_peered":"2024-09-12T00:51:04.975690+0000","last_unstale":"2024-09-12T01:22:46.667740+0000","last_undegraded":"2024-09-12T01:22:46.667740+0000","last_fullsized":"2024-09-12T01:22:46.667740+0000","mapping_epoch":252,"log_start":"265'100","ondisk_log_start":"265'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'113","last_scrub_stamp":"2024-09-12T01:22:46.667485+0000","last_deep_scrub":"265'113","last_deep_scrub_stamp":"2024-09-12T01:22:46.667485+0000","last_clean_scrub_stamp":"2024-09-12T01:22:46.667485+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:56.640759+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":675,"num_read_kb":541,"num_write":147,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2500,"num_omap_keys":5,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:23:03.171554+0000","last_change":"2024-09-12T01:23:03.171554+0000","last_active":"2024-09-12T01:23:03.171554+0000","last_peered":"2024-09-12T01:23:03.171554+0000","last_clean":"2024-09-12T01:23:03.171554+0000","last_became_active":"2024-09-12T01:03:40.585894+0000","last_became_peered":"2024-09-12T01:03:40.585894+0000","last_unstale":"2024-09-12T01:23:03.171554+0000","last_undegraded":"2024-09-12T01:23:03.171554+0000","last_fullsized":"2024-09-12T01:23:03.171554+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:23:03.171370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:23:03.171370+0000","last_clean_scrub_stamp":"2024-09-12T01:23:03.171370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:10.286885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"262'3","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:50.522730+0000","last_change":"2024-09-12T01:22:50.522572+0000","last_active":"2024-09-12T01:22:50.522730+0000","last_peered":"2024-09-12T01:22:50.522730+0000","last_clean":"2024-09-12T01:22:50.522730+0000","last_became_active":"2024-09-12T00:52:40.355113+0000","last_became_peered":"2024-09-12T00:52:40.355113+0000","last_unstale":"2024-09-12T01:22:50.522730+0000","last_undegraded":"2024-09-12T01:22:50.522730+0000","last_fullsized":"2024-09-12T01:22:50.522730+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T01:22:50.522319+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T01:22:50.522319+0000","last_clean_scrub_stamp":"2024-09-12T01:22:50.522319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:33.444240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'3","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:41.955963+0000","last_change":"2024-09-12T01:22:41.955963+0000","last_active":"2024-09-12T01:22:41.955963+0000","last_peered":"2024-09-12T01:22:41.955963+0000","last_clean":"2024-09-12T01:22:41.955963+0000","last_became_active":"2024-09-12T00:52:37.280444+0000","last_became_peered":"2024-09-12T00:52:37.280444+0000","last_unstale":"2024-09-12T01:22:41.955963+0000","last_undegraded":"2024-09-12T01:22:41.955963+0000","last_fullsized":"2024-09-12T01:22:41.955963+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:22:41.955790+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:22:41.955790+0000","last_clean_scrub_stamp":"2024-09-12T01:22:41.955790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:07.749444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'48","reported_seq":189,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:32.107529+0000","last_change":"2024-09-12T01:22:32.107529+0000","last_active":"2024-09-12T01:22:32.107529+0000","last_peered":"2024-09-12T01:22:32.107529+0000","last_clean":"2024-09-12T01:22:32.107529+0000","last_became_active":"2024-09-12T00:51:04.984384+0000","last_became_peered":"2024-09-12T00:51:04.984384+0000","last_unstale":"2024-09-12T01:22:32.107529+0000","last_undegraded":"2024-09-12T01:22:32.107529+0000","last_fullsized":"2024-09-12T01:22:32.107529+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'48","last_scrub_stamp":"2024-09-12T01:22:32.107337+0000","last_deep_scrub":"265'48","last_deep_scrub_stamp":"2024-09-12T01:22:32.107337+0000","last_clean_scrub_stamp":"2024-09-12T01:22:32.107337+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:27.215513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":174,"num_write":98,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:53.562098+0000","last_change":"2024-09-12T01:22:53.562098+0000","last_active":"2024-09-12T01:22:53.562098+0000","last_peered":"2024-09-12T01:22:53.562098+0000","last_clean":"2024-09-12T01:22:53.562098+0000","last_became_active":"2024-09-12T01:03:40.565972+0000","last_became_peered":"2024-09-12T01:03:40.565972+0000","last_unstale":"2024-09-12T01:22:53.562098+0000","last_undegraded":"2024-09-12T01:22:53.562098+0000","last_fullsized":"2024-09-12T01:22:53.562098+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:53.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:53.561905+0000","last_clean_scrub_stamp":"2024-09-12T01:22:53.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:10.302712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"262'2","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:56.234634+0000","last_change":"2024-09-12T01:22:56.234634+0000","last_active":"2024-09-12T01:22:56.234634+0000","last_peered":"2024-09-12T01:22:56.234634+0000","last_clean":"2024-09-12T01:22:56.234634+0000","last_became_active":"2024-09-12T00:52:40.352178+0000","last_became_peered":"2024-09-12T00:52:40.352178+0000","last_unstale":"2024-09-12T01:22:56.234634+0000","last_undegraded":"2024-09-12T01:22:56.234634+0000","last_fullsized":"2024-09-12T01:22:56.234634+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T01:22:56.234405+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T01:22:56.234405+0000","last_clean_scrub_stamp":"2024-09-12T01:22:56.234405+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:34.775365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:47.529115+0000","last_change":"2024-09-12T01:22:47.529115+0000","last_active":"2024-09-12T01:22:47.529115+0000","last_peered":"2024-09-12T01:22:47.529115+0000","last_clean":"2024-09-12T01:22:47.529115+0000","last_became_active":"2024-09-12T00:52:37.280679+0000","last_became_peered":"2024-09-12T00:52:37.280679+0000","last_unstale":"2024-09-12T01:22:47.529115+0000","last_undegraded":"2024-09-12T01:22:47.529115+0000","last_fullsized":"2024-09-12T01:22:47.529115+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:47.528907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:47.528907+0000","last_clean_scrub_stamp":"2024-09-12T01:22:47.528907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:56.331674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'2","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:40.367300+0000","last_change":"2024-09-12T01:22:40.367300+0000","last_active":"2024-09-12T01:22:40.367300+0000","last_peered":"2024-09-12T01:22:40.367300+0000","last_clean":"2024-09-12T01:22:40.367300+0000","last_became_active":"2024-09-12T00:51:04.996736+0000","last_became_peered":"2024-09-12T00:51:04.996736+0000","last_unstale":"2024-09-12T01:22:40.367300+0000","last_undegraded":"2024-09-12T01:22:40.367300+0000","last_fullsized":"2024-09-12T01:22:40.367300+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:40.367022+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:40.367022+0000","last_clean_scrub_stamp":"2024-09-12T01:22:40.367022+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:54.019658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:49.541630+0000","last_change":"2024-09-12T01:22:49.541630+0000","last_active":"2024-09-12T01:22:49.541630+0000","last_peered":"2024-09-12T01:22:49.541630+0000","last_clean":"2024-09-12T01:22:49.541630+0000","last_became_active":"2024-09-12T01:03:40.576752+0000","last_became_peered":"2024-09-12T01:03:40.576752+0000","last_unstale":"2024-09-12T01:22:49.541630+0000","last_undegraded":"2024-09-12T01:22:49.541630+0000","last_fullsized":"2024-09-12T01:22:49.541630+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:49.541441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:49.541441+0000","last_clean_scrub_stamp":"2024-09-12T01:22:49.541441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:13.305717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"262'8","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:50.212219+0000","last_change":"2024-09-12T01:22:50.212219+0000","last_active":"2024-09-12T01:22:50.212219+0000","last_peered":"2024-09-12T01:22:50.212219+0000","last_clean":"2024-09-12T01:22:50.212219+0000","last_became_active":"2024-09-12T00:52:40.338378+0000","last_became_peered":"2024-09-12T00:52:40.338378+0000","last_unstale":"2024-09-12T01:22:50.212219+0000","last_undegraded":"2024-09-12T01:22:50.212219+0000","last_fullsized":"2024-09-12T01:22:50.212219+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-12T01:22:50.212015+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-12T01:22:50.212015+0000","last_clean_scrub_stamp":"2024-09-12T01:22:50.212015+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:27.082457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'6","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:25.407022+0000","last_change":"2024-09-12T01:22:25.407022+0000","last_active":"2024-09-12T01:22:25.407022+0000","last_peered":"2024-09-12T01:22:25.407022+0000","last_clean":"2024-09-12T01:22:25.407022+0000","last_became_active":"2024-09-12T00:52:37.284206+0000","last_became_peered":"2024-09-12T00:52:37.284206+0000","last_unstale":"2024-09-12T01:22:25.407022+0000","last_undegraded":"2024-09-12T01:22:25.407022+0000","last_fullsized":"2024-09-12T01:22:25.407022+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:22:25.406833+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:22:25.406833+0000","last_clean_scrub_stamp":"2024-09-12T01:22:25.406833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:01.812060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'21","reported_seq":114,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:31.080122+0000","last_change":"2024-09-12T01:22:31.080122+0000","last_active":"2024-09-12T01:22:31.080122+0000","last_peered":"2024-09-12T01:22:31.080122+0000","last_clean":"2024-09-12T01:22:31.080122+0000","last_became_active":"2024-09-12T00:51:04.983165+0000","last_became_peered":"2024-09-12T00:51:04.983165+0000","last_unstale":"2024-09-12T01:22:31.080122+0000","last_undegraded":"2024-09-12T01:22:31.080122+0000","last_fullsized":"2024-09-12T01:22:31.080122+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'21","last_scrub_stamp":"2024-09-12T01:22:31.079934+0000","last_deep_scrub":"265'21","last_deep_scrub_stamp":"2024-09-12T01:22:31.079934+0000","last_clean_scrub_stamp":"2024-09-12T01:22:31.079934+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:01.034206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":73,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:44.210029+0000","last_change":"2024-09-12T01:22:44.210029+0000","last_active":"2024-09-12T01:22:44.210029+0000","last_peered":"2024-09-12T01:22:44.210029+0000","last_clean":"2024-09-12T01:22:44.210029+0000","last_became_active":"2024-09-12T01:03:40.578825+0000","last_became_peered":"2024-09-12T01:03:40.578825+0000","last_unstale":"2024-09-12T01:22:44.210029+0000","last_undegraded":"2024-09-12T01:22:44.210029+0000","last_fullsized":"2024-09-12T01:22:44.210029+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:44.209845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:44.209845+0000","last_clean_scrub_stamp":"2024-09-12T01:22:44.209845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:49.070408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"265'3","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:49.515630+0000","last_change":"2024-09-12T01:22:49.515501+0000","last_active":"2024-09-12T01:22:49.515630+0000","last_peered":"2024-09-12T01:22:49.515630+0000","last_clean":"2024-09-12T01:22:49.515630+0000","last_became_active":"2024-09-12T00:52:40.352922+0000","last_became_peered":"2024-09-12T00:52:40.352922+0000","last_unstale":"2024-09-12T01:22:49.515630+0000","last_undegraded":"2024-09-12T01:22:49.515630+0000","last_fullsized":"2024-09-12T01:22:49.515630+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:22:49.515347+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:22:49.515347+0000","last_clean_scrub_stamp":"2024-09-12T01:22:49.515347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:01.262620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'3","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:44.554368+0000","last_change":"2024-09-12T01:22:44.554208+0000","last_active":"2024-09-12T01:22:44.554368+0000","last_peered":"2024-09-12T01:22:44.554368+0000","last_clean":"2024-09-12T01:22:44.554368+0000","last_became_active":"2024-09-12T00:52:37.280548+0000","last_became_peered":"2024-09-12T00:52:37.280548+0000","last_unstale":"2024-09-12T01:22:44.554368+0000","last_undegraded":"2024-09-12T01:22:44.554368+0000","last_fullsized":"2024-09-12T01:22:44.554368+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T01:22:44.554022+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T01:22:44.554022+0000","last_clean_scrub_stamp":"2024-09-12T01:22:44.554022+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:50.358571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'10","reported_seq":85,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:39.485140+0000","last_change":"2024-09-12T01:22:39.485140+0000","last_active":"2024-09-12T01:22:39.485140+0000","last_peered":"2024-09-12T01:22:39.485140+0000","last_clean":"2024-09-12T01:22:39.485140+0000","last_became_active":"2024-09-12T00:51:04.994904+0000","last_became_peered":"2024-09-12T00:51:04.994904+0000","last_unstale":"2024-09-12T01:22:39.485140+0000","last_undegraded":"2024-09-12T01:22:39.485140+0000","last_fullsized":"2024-09-12T01:22:39.485140+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-12T01:22:39.484956+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-12T01:22:39.484956+0000","last_clean_scrub_stamp":"2024-09-12T01:22:39.484956+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:47.260111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":34,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:51.923286+0000","last_change":"2024-09-12T01:22:51.923286+0000","last_active":"2024-09-12T01:22:51.923286+0000","last_peered":"2024-09-12T01:22:51.923286+0000","last_clean":"2024-09-12T01:22:51.923286+0000","last_became_active":"2024-09-12T01:03:40.576442+0000","last_became_peered":"2024-09-12T01:03:40.576442+0000","last_unstale":"2024-09-12T01:22:51.923286+0000","last_undegraded":"2024-09-12T01:22:51.923286+0000","last_fullsized":"2024-09-12T01:22:51.923286+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:51.923103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:51.923103+0000","last_clean_scrub_stamp":"2024-09-12T01:22:51.923103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:29.364701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"265'6","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:49.884143+0000","last_change":"2024-09-12T01:22:49.883998+0000","last_active":"2024-09-12T01:22:49.884143+0000","last_peered":"2024-09-12T01:22:49.884143+0000","last_clean":"2024-09-12T01:22:49.884143+0000","last_became_active":"2024-09-12T00:52:40.345375+0000","last_became_peered":"2024-09-12T00:52:40.345375+0000","last_unstale":"2024-09-12T01:22:49.884143+0000","last_undegraded":"2024-09-12T01:22:49.884143+0000","last_fullsized":"2024-09-12T01:22:49.884143+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:22:49.883811+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:22:49.883811+0000","last_clean_scrub_stamp":"2024-09-12T01:22:49.883811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:35.715106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"262'5","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:46.534936+0000","last_change":"2024-09-12T01:22:46.534784+0000","last_active":"2024-09-12T01:22:46.534936+0000","last_peered":"2024-09-12T01:22:46.534936+0000","last_clean":"2024-09-12T01:22:46.534936+0000","last_became_active":"2024-09-12T00:52:37.282005+0000","last_became_peered":"2024-09-12T00:52:37.282005+0000","last_unstale":"2024-09-12T01:22:46.534936+0000","last_undegraded":"2024-09-12T01:22:46.534936+0000","last_fullsized":"2024-09-12T01:22:46.534936+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T01:22:46.534547+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T01:22:46.534547+0000","last_clean_scrub_stamp":"2024-09-12T01:22:46.534547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:29.126571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":5,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"265'13","reported_seq":91,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:32.297808+0000","last_change":"2024-09-12T01:22:32.297808+0000","last_active":"2024-09-12T01:22:32.297808+0000","last_peered":"2024-09-12T01:22:32.297808+0000","last_clean":"2024-09-12T01:22:32.297808+0000","last_became_active":"2024-09-12T00:51:04.990945+0000","last_became_peered":"2024-09-12T00:51:04.990945+0000","last_unstale":"2024-09-12T01:22:32.297808+0000","last_undegraded":"2024-09-12T01:22:32.297808+0000","last_fullsized":"2024-09-12T01:22:32.297808+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'13","last_scrub_stamp":"2024-09-12T01:22:32.297522+0000","last_deep_scrub":"265'13","last_deep_scrub_stamp":"2024-09-12T01:22:32.297522+0000","last_clean_scrub_stamp":"2024-09-12T01:22:32.297522+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:38.583047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"265'2","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:31.394811+0000","last_change":"2024-09-12T01:22:31.394811+0000","last_active":"2024-09-12T01:22:31.394811+0000","last_peered":"2024-09-12T01:22:31.394811+0000","last_clean":"2024-09-12T01:22:31.394811+0000","last_became_active":"2024-09-12T01:03:40.581227+0000","last_became_peered":"2024-09-12T01:03:40.581227+0000","last_unstale":"2024-09-12T01:22:31.394811+0000","last_undegraded":"2024-09-12T01:22:31.394811+0000","last_fullsized":"2024-09-12T01:22:31.394811+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:31.394614+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:31.394614+0000","last_clean_scrub_stamp":"2024-09-12T01:22:31.394614+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:55.398951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:39.225501+0000","last_change":"2024-09-12T01:22:39.225501+0000","last_active":"2024-09-12T01:22:39.225501+0000","last_peered":"2024-09-12T01:22:39.225501+0000","last_clean":"2024-09-12T01:22:39.225501+0000","last_became_active":"2024-09-12T00:52:40.340078+0000","last_became_peered":"2024-09-12T00:52:40.340078+0000","last_unstale":"2024-09-12T01:22:39.225501+0000","last_undegraded":"2024-09-12T01:22:39.225501+0000","last_fullsized":"2024-09-12T01:22:39.225501+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:39.225310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:39.225310+0000","last_clean_scrub_stamp":"2024-09-12T01:22:39.225310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:20.437110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"262'5","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:42.492563+0000","last_change":"2024-09-12T01:22:42.492563+0000","last_active":"2024-09-12T01:22:42.492563+0000","last_peered":"2024-09-12T01:22:42.492563+0000","last_clean":"2024-09-12T01:22:42.492563+0000","last_became_active":"2024-09-12T00:52:37.277753+0000","last_became_peered":"2024-09-12T00:52:37.277753+0000","last_unstale":"2024-09-12T01:22:42.492563+0000","last_undegraded":"2024-09-12T01:22:42.492563+0000","last_fullsized":"2024-09-12T01:22:42.492563+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T01:22:42.492372+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T01:22:42.492372+0000","last_clean_scrub_stamp":"2024-09-12T01:22:42.492372+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:18.929803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"254'7","reported_seq":79,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:42.599498+0000","last_change":"2024-09-12T01:22:42.599498+0000","last_active":"2024-09-12T01:22:42.599498+0000","last_peered":"2024-09-12T01:22:42.599498+0000","last_clean":"2024-09-12T01:22:42.599498+0000","last_became_active":"2024-09-12T00:51:04.956754+0000","last_became_peered":"2024-09-12T00:51:04.956754+0000","last_unstale":"2024-09-12T01:22:42.599498+0000","last_undegraded":"2024-09-12T01:22:42.599498+0000","last_fullsized":"2024-09-12T01:22:42.599498+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'7","last_scrub_stamp":"2024-09-12T01:22:42.599303+0000","last_deep_scrub":"254'7","last_deep_scrub_stamp":"2024-09-12T01:22:42.599303+0000","last_clean_scrub_stamp":"2024-09-12T01:22:42.599303+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:17.291713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":30,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:59.193369+0000","last_change":"2024-09-12T01:22:59.193369+0000","last_active":"2024-09-12T01:22:59.193369+0000","last_peered":"2024-09-12T01:22:59.193369+0000","last_clean":"2024-09-12T01:22:59.193369+0000","last_became_active":"2024-09-12T01:03:40.583308+0000","last_became_peered":"2024-09-12T01:03:40.583308+0000","last_unstale":"2024-09-12T01:22:59.193369+0000","last_undegraded":"2024-09-12T01:22:59.193369+0000","last_fullsized":"2024-09-12T01:22:59.193369+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:59.193167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:59.193167+0000","last_clean_scrub_stamp":"2024-09-12T01:22:59.193167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:46.236216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'6","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:46.493862+0000","last_change":"2024-09-12T01:22:46.493725+0000","last_active":"2024-09-12T01:22:46.493862+0000","last_peered":"2024-09-12T01:22:46.493862+0000","last_clean":"2024-09-12T01:22:46.493862+0000","last_became_active":"2024-09-12T00:52:40.332913+0000","last_became_peered":"2024-09-12T00:52:40.332913+0000","last_unstale":"2024-09-12T01:22:46.493862+0000","last_undegraded":"2024-09-12T01:22:46.493862+0000","last_fullsized":"2024-09-12T01:22:46.493862+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:22:46.493474+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:22:46.493474+0000","last_clean_scrub_stamp":"2024-09-12T01:22:46.493474+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:34.535106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"265'3","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:45.549110+0000","last_change":"2024-09-12T01:22:45.549110+0000","last_active":"2024-09-12T01:22:45.549110+0000","last_peered":"2024-09-12T01:22:45.549110+0000","last_clean":"2024-09-12T01:22:45.549110+0000","last_became_active":"2024-09-12T00:52:37.282758+0000","last_became_peered":"2024-09-12T00:52:37.282758+0000","last_unstale":"2024-09-12T01:22:45.549110+0000","last_undegraded":"2024-09-12T01:22:45.549110+0000","last_fullsized":"2024-09-12T01:22:45.549110+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:22:45.548934+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:22:45.548934+0000","last_clean_scrub_stamp":"2024-09-12T01:22:45.548934+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:40.125683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'71","reported_seq":253,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:40.940513+0000","last_change":"2024-09-12T01:22:40.940513+0000","last_active":"2024-09-12T01:22:40.940513+0000","last_peered":"2024-09-12T01:22:40.940513+0000","last_clean":"2024-09-12T01:22:40.940513+0000","last_became_active":"2024-09-12T00:51:04.982747+0000","last_became_peered":"2024-09-12T00:51:04.982747+0000","last_unstale":"2024-09-12T01:22:40.940513+0000","last_undegraded":"2024-09-12T01:22:40.940513+0000","last_fullsized":"2024-09-12T01:22:40.940513+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'71","last_scrub_stamp":"2024-09-12T01:22:40.940337+0000","last_deep_scrub":"265'71","last_deep_scrub_stamp":"2024-09-12T01:22:40.940337+0000","last_clean_scrub_stamp":"2024-09-12T01:22:40.940337+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:33.997706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":369,"num_read_kb":267,"num_write":124,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:23:00.176177+0000","last_change":"2024-09-12T01:23:00.176177+0000","last_active":"2024-09-12T01:23:00.176177+0000","last_peered":"2024-09-12T01:23:00.176177+0000","last_clean":"2024-09-12T01:23:00.176177+0000","last_became_active":"2024-09-12T01:03:40.571968+0000","last_became_peered":"2024-09-12T01:03:40.571968+0000","last_unstale":"2024-09-12T01:23:00.176177+0000","last_undegraded":"2024-09-12T01:23:00.176177+0000","last_fullsized":"2024-09-12T01:23:00.176177+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:23:00.175995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:23:00.175995+0000","last_clean_scrub_stamp":"2024-09-12T01:23:00.175995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:57.742195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'7","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:36.013174+0000","last_change":"2024-09-12T01:22:36.013174+0000","last_active":"2024-09-12T01:22:36.013174+0000","last_peered":"2024-09-12T01:22:36.013174+0000","last_clean":"2024-09-12T01:22:36.013174+0000","last_became_active":"2024-09-12T00:52:40.359434+0000","last_became_peered":"2024-09-12T00:52:40.359434+0000","last_unstale":"2024-09-12T01:22:36.013174+0000","last_undegraded":"2024-09-12T01:22:36.013174+0000","last_fullsized":"2024-09-12T01:22:36.013174+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T01:22:36.012999+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T01:22:36.012999+0000","last_clean_scrub_stamp":"2024-09-12T01:22:36.012999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:39.219563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":12,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'6","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:34.270661+0000","last_change":"2024-09-12T01:22:34.270661+0000","last_active":"2024-09-12T01:22:34.270661+0000","last_peered":"2024-09-12T01:22:34.270661+0000","last_clean":"2024-09-12T01:22:34.270661+0000","last_became_active":"2024-09-12T00:52:37.291369+0000","last_became_peered":"2024-09-12T00:52:37.291369+0000","last_unstale":"2024-09-12T01:22:34.270661+0000","last_undegraded":"2024-09-12T01:22:34.270661+0000","last_fullsized":"2024-09-12T01:22:34.270661+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:22:34.270471+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:22:34.270471+0000","last_clean_scrub_stamp":"2024-09-12T01:22:34.270471+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:30.065536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'35","reported_seq":145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:30.057750+0000","last_change":"2024-09-12T01:22:30.057750+0000","last_active":"2024-09-12T01:22:30.057750+0000","last_peered":"2024-09-12T01:22:30.057750+0000","last_clean":"2024-09-12T01:22:30.057750+0000","last_became_active":"2024-09-12T00:51:04.990179+0000","last_became_peered":"2024-09-12T00:51:04.990179+0000","last_unstale":"2024-09-12T01:22:30.057750+0000","last_undegraded":"2024-09-12T01:22:30.057750+0000","last_fullsized":"2024-09-12T01:22:30.057750+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'35","last_scrub_stamp":"2024-09-12T01:22:30.057517+0000","last_deep_scrub":"265'35","last_deep_scrub_stamp":"2024-09-12T01:22:30.057517+0000","last_clean_scrub_stamp":"2024-09-12T01:22:30.057517+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:37.573193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":108,"num_write":67,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:54.584333+0000","last_change":"2024-09-12T01:22:54.584333+0000","last_active":"2024-09-12T01:22:54.584333+0000","last_peered":"2024-09-12T01:22:54.584333+0000","last_clean":"2024-09-12T01:22:54.584333+0000","last_became_active":"2024-09-12T01:03:40.573928+0000","last_became_peered":"2024-09-12T01:03:40.573928+0000","last_unstale":"2024-09-12T01:22:54.584333+0000","last_undegraded":"2024-09-12T01:22:54.584333+0000","last_fullsized":"2024-09-12T01:22:54.584333+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:54.584152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:54.584152+0000","last_clean_scrub_stamp":"2024-09-12T01:22:54.584152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:26.256330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:47.810080+0000","last_change":"2024-09-12T01:22:47.810080+0000","last_active":"2024-09-12T01:22:47.810080+0000","last_peered":"2024-09-12T01:22:47.810080+0000","last_clean":"2024-09-12T01:22:47.810080+0000","last_became_active":"2024-09-12T00:52:40.348494+0000","last_became_peered":"2024-09-12T00:52:40.348494+0000","last_unstale":"2024-09-12T01:22:47.810080+0000","last_undegraded":"2024-09-12T01:22:47.810080+0000","last_fullsized":"2024-09-12T01:22:47.810080+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:47.809899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:47.809899+0000","last_clean_scrub_stamp":"2024-09-12T01:22:47.809899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:42.801544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'2","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:35.053445+0000","last_change":"2024-09-12T01:22:35.053445+0000","last_active":"2024-09-12T01:22:35.053445+0000","last_peered":"2024-09-12T01:22:35.053445+0000","last_clean":"2024-09-12T01:22:35.053445+0000","last_became_active":"2024-09-12T00:52:37.278285+0000","last_became_peered":"2024-09-12T00:52:37.278285+0000","last_unstale":"2024-09-12T01:22:35.053445+0000","last_undegraded":"2024-09-12T01:22:35.053445+0000","last_fullsized":"2024-09-12T01:22:35.053445+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T01:22:35.053225+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T01:22:35.053225+0000","last_clean_scrub_stamp":"2024-09-12T01:22:35.053225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:02.281428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'29","reported_seq":133,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:37.474569+0000","last_change":"2024-09-12T01:22:37.474569+0000","last_active":"2024-09-12T01:22:37.474569+0000","last_peered":"2024-09-12T01:22:37.474569+0000","last_clean":"2024-09-12T01:22:37.474569+0000","last_became_active":"2024-09-12T00:51:04.984999+0000","last_became_peered":"2024-09-12T00:51:04.984999+0000","last_unstale":"2024-09-12T01:22:37.474569+0000","last_undegraded":"2024-09-12T01:22:37.474569+0000","last_fullsized":"2024-09-12T01:22:37.474569+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'29","last_scrub_stamp":"2024-09-12T01:22:37.474379+0000","last_deep_scrub":"265'29","last_deep_scrub_stamp":"2024-09-12T01:22:37.474379+0000","last_clean_scrub_stamp":"2024-09-12T01:22:37.474379+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:27.806721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":53,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'333","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.526698+0000","last_change":"2024-09-12T01:22:17.526698+0000","last_active":"2024-09-12T01:22:17.526698+0000","last_peered":"2024-09-12T01:22:17.526698+0000","last_clean":"2024-09-12T01:22:17.526698+0000","last_became_active":"2024-09-12T00:35:43.947816+0000","last_became_peered":"2024-09-12T00:35:43.947816+0000","last_unstale":"2024-09-12T01:22:17.526698+0000","last_undegraded":"2024-09-12T01:22:17.526698+0000","last_fullsized":"2024-09-12T01:22:17.526698+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-12T01:22:17.526459+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-12T01:22:17.526459+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.526459+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:45.054333+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1291295,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":33235,"num_write":1076,"num_write_kb":21608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'253","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.685823+0000","last_change":"2024-09-12T01:22:22.685823+0000","last_active":"2024-09-12T01:22:22.685823+0000","last_peered":"2024-09-12T01:22:22.685823+0000","last_clean":"2024-09-12T01:22:22.685823+0000","last_became_active":"2024-09-12T00:35:45.925856+0000","last_became_peered":"2024-09-12T00:35:45.925856+0000","last_unstale":"2024-09-12T01:22:22.685823+0000","last_undegraded":"2024-09-12T01:22:22.685823+0000","last_fullsized":"2024-09-12T01:22:22.685823+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'253","last_scrub_stamp":"2024-09-12T01:22:22.685653+0000","last_deep_scrub":"265'253","last_deep_scrub_stamp":"2024-09-12T01:22:22.685653+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.685653+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:53.425516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1075,"num_read_kb":882,"num_write":373,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'379","reported_seq":1051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.216236+0000","last_change":"2024-09-12T01:22:10.216236+0000","last_active":"2024-09-12T01:22:10.216236+0000","last_peered":"2024-09-12T01:22:10.216236+0000","last_clean":"2024-09-12T01:22:10.216236+0000","last_became_active":"2024-09-12T00:35:43.933088+0000","last_became_peered":"2024-09-12T00:35:43.933088+0000","last_unstale":"2024-09-12T01:22:10.216236+0000","last_undegraded":"2024-09-12T01:22:10.216236+0000","last_fullsized":"2024-09-12T01:22:10.216236+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'379","last_scrub_stamp":"2024-09-12T01:22:10.215975+0000","last_deep_scrub":"265'379","last_deep_scrub_stamp":"2024-09-12T01:22:10.215975+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.215975+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:43.999693+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":567,"num_read_kb":47488,"num_write":1216,"num_write_kb":29880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'45","reported_seq":587,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.419078+0000","last_change":"2024-09-12T01:22:21.419078+0000","last_active":"2024-09-12T01:22:21.419078+0000","last_peered":"2024-09-12T01:22:21.419078+0000","last_clean":"2024-09-12T01:22:21.419078+0000","last_became_active":"2024-09-12T00:35:45.947212+0000","last_became_peered":"2024-09-12T00:35:45.947212+0000","last_unstale":"2024-09-12T01:22:21.419078+0000","last_undegraded":"2024-09-12T01:22:21.419078+0000","last_fullsized":"2024-09-12T01:22:21.419078+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'45","last_scrub_stamp":"2024-09-12T01:22:21.418869+0000","last_deep_scrub":"265'45","last_deep_scrub_stamp":"2024-09-12T01:22:21.418869+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.418869+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:50:21.799809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":168,"num_write":71,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'336","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.537484+0000","last_change":"2024-09-12T01:22:12.537484+0000","last_active":"2024-09-12T01:22:12.537484+0000","last_peered":"2024-09-12T01:22:12.537484+0000","last_clean":"2024-09-12T01:22:12.537484+0000","last_became_active":"2024-09-12T00:35:43.926443+0000","last_became_peered":"2024-09-12T00:35:43.926443+0000","last_unstale":"2024-09-12T01:22:12.537484+0000","last_undegraded":"2024-09-12T01:22:12.537484+0000","last_fullsized":"2024-09-12T01:22:12.537484+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'336","last_scrub_stamp":"2024-09-12T01:22:12.537222+0000","last_deep_scrub":"265'336","last_deep_scrub_stamp":"2024-09-12T01:22:12.537222+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.537222+0000","objects_scrubbed":9,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:43.392767+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262209,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":553,"num_read_kb":98039,"num_write":1093,"num_write_kb":58371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'116","reported_seq":737,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.906406+0000","last_change":"2024-09-12T01:22:21.906406+0000","last_active":"2024-09-12T01:22:21.906406+0000","last_peered":"2024-09-12T01:22:21.906406+0000","last_clean":"2024-09-12T01:22:21.906406+0000","last_became_active":"2024-09-12T00:35:45.930987+0000","last_became_peered":"2024-09-12T00:35:45.930987+0000","last_unstale":"2024-09-12T01:22:21.906406+0000","last_undegraded":"2024-09-12T01:22:21.906406+0000","last_fullsized":"2024-09-12T01:22:21.906406+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'116","last_scrub_stamp":"2024-09-12T01:22:21.906229+0000","last_deep_scrub":"265'116","last_deep_scrub_stamp":"2024-09-12T01:22:21.906229+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.906229+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:48.016467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":522,"num_read_kb":443,"num_write":187,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'383","reported_seq":1063,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.820355+0000","last_change":"2024-09-12T01:22:15.820355+0000","last_active":"2024-09-12T01:22:15.820355+0000","last_peered":"2024-09-12T01:22:15.820355+0000","last_clean":"2024-09-12T01:22:15.820355+0000","last_became_active":"2024-09-12T00:35:43.914356+0000","last_became_peered":"2024-09-12T00:35:43.914356+0000","last_unstale":"2024-09-12T01:22:15.820355+0000","last_undegraded":"2024-09-12T01:22:15.820355+0000","last_fullsized":"2024-09-12T01:22:15.820355+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'383","last_scrub_stamp":"2024-09-12T01:22:15.820094+0000","last_deep_scrub":"265'383","last_deep_scrub_stamp":"2024-09-12T01:22:15.820094+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.820094+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:01.760407+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6370276,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":596,"num_read_kb":17763,"num_write":1203,"num_write_kb":54335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'197","reported_seq":802,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.513443+0000","last_change":"2024-09-12T01:22:17.513443+0000","last_active":"2024-09-12T01:22:17.513443+0000","last_peered":"2024-09-12T01:22:17.513443+0000","last_clean":"2024-09-12T01:22:17.513443+0000","last_became_active":"2024-09-12T00:35:45.942567+0000","last_became_peered":"2024-09-12T00:35:45.942567+0000","last_unstale":"2024-09-12T01:22:17.513443+0000","last_undegraded":"2024-09-12T01:22:17.513443+0000","last_fullsized":"2024-09-12T01:22:17.513443+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'197","last_scrub_stamp":"2024-09-12T01:22:17.513255+0000","last_deep_scrub":"265'197","last_deep_scrub_stamp":"2024-09-12T01:22:17.513255+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.513255+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:58.319165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":861,"num_read_kb":699,"num_write":314,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'348","reported_seq":1013,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.507635+0000","last_change":"2024-09-12T01:22:16.507635+0000","last_active":"2024-09-12T01:22:16.507635+0000","last_peered":"2024-09-12T01:22:16.507635+0000","last_clean":"2024-09-12T01:22:16.507635+0000","last_became_active":"2024-09-12T00:35:43.944644+0000","last_became_peered":"2024-09-12T00:35:43.944644+0000","last_unstale":"2024-09-12T01:22:16.507635+0000","last_undegraded":"2024-09-12T01:22:16.507635+0000","last_fullsized":"2024-09-12T01:22:16.507635+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-12T01:22:16.507410+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-12T01:22:16.507410+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.507410+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:46.731365+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289155,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":589,"num_read_kb":29244,"num_write":1174,"num_write_kb":25136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'342","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.112383+0000","last_change":"2024-09-12T01:22:17.112383+0000","last_active":"2024-09-12T01:22:17.112383+0000","last_peered":"2024-09-12T01:22:17.112383+0000","last_clean":"2024-09-12T01:22:17.112383+0000","last_became_active":"2024-09-12T00:35:45.943110+0000","last_became_peered":"2024-09-12T00:35:45.943110+0000","last_unstale":"2024-09-12T01:22:17.112383+0000","last_undegraded":"2024-09-12T01:22:17.112383+0000","last_fullsized":"2024-09-12T01:22:17.112383+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T01:22:17.112199+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T01:22:17.112199+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.112199+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:44.660281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1719,"num_read_kb":1451,"num_write":623,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'340","reported_seq":958,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.811940+0000","last_change":"2024-09-12T01:22:16.811940+0000","last_active":"2024-09-12T01:22:16.811940+0000","last_peered":"2024-09-12T01:22:16.811940+0000","last_clean":"2024-09-12T01:22:16.811940+0000","last_became_active":"2024-09-12T00:35:43.929553+0000","last_became_peered":"2024-09-12T00:35:43.929553+0000","last_unstale":"2024-09-12T01:22:16.811940+0000","last_undegraded":"2024-09-12T01:22:16.811940+0000","last_fullsized":"2024-09-12T01:22:16.811940+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'340","last_scrub_stamp":"2024-09-12T01:22:16.811714+0000","last_deep_scrub":"265'340","last_deep_scrub_stamp":"2024-09-12T01:22:16.811714+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.811714+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:09.205040+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8021586,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":453,"num_read_kb":14436,"num_write":1125,"num_write_kb":49786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'350","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:23.861032+0000","last_change":"2024-09-12T01:22:23.861032+0000","last_active":"2024-09-12T01:22:23.861032+0000","last_peered":"2024-09-12T01:22:23.861032+0000","last_clean":"2024-09-12T01:22:23.861032+0000","last_became_active":"2024-09-12T00:35:45.934193+0000","last_became_peered":"2024-09-12T00:35:45.934193+0000","last_unstale":"2024-09-12T01:22:23.861032+0000","last_undegraded":"2024-09-12T01:22:23.861032+0000","last_fullsized":"2024-09-12T01:22:23.861032+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'350","last_scrub_stamp":"2024-09-12T01:22:23.860857+0000","last_deep_scrub":"265'350","last_deep_scrub_stamp":"2024-09-12T01:22:23.860857+0000","last_clean_scrub_stamp":"2024-09-12T01:22:23.860857+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:53.109892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1452,"num_read_kb":1165,"num_write":550,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'395","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.543860+0000","last_change":"2024-09-12T01:22:15.543860+0000","last_active":"2024-09-12T01:22:15.543860+0000","last_peered":"2024-09-12T01:22:15.543860+0000","last_clean":"2024-09-12T01:22:15.543860+0000","last_became_active":"2024-09-12T00:35:43.942199+0000","last_became_peered":"2024-09-12T00:35:43.942199+0000","last_unstale":"2024-09-12T01:22:15.543860+0000","last_undegraded":"2024-09-12T01:22:15.543860+0000","last_fullsized":"2024-09-12T01:22:15.543860+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'395","last_scrub_stamp":"2024-09-12T01:22:15.543686+0000","last_deep_scrub":"265'395","last_deep_scrub_stamp":"2024-09-12T01:22:15.543686+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.543686+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:08.555732+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":650,"num_read_kb":42927,"num_write":1209,"num_write_kb":42524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'254","reported_seq":925,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:23.654827+0000","last_change":"2024-09-12T01:22:23.654827+0000","last_active":"2024-09-12T01:22:23.654827+0000","last_peered":"2024-09-12T01:22:23.654827+0000","last_clean":"2024-09-12T01:22:23.654827+0000","last_became_active":"2024-09-12T00:35:45.937211+0000","last_became_peered":"2024-09-12T00:35:45.937211+0000","last_unstale":"2024-09-12T01:22:23.654827+0000","last_undegraded":"2024-09-12T01:22:23.654827+0000","last_fullsized":"2024-09-12T01:22:23.654827+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'254","last_scrub_stamp":"2024-09-12T01:22:23.654583+0000","last_deep_scrub":"265'254","last_deep_scrub_stamp":"2024-09-12T01:22:23.654583+0000","last_clean_scrub_stamp":"2024-09-12T01:22:23.654583+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:22.042826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1131,"num_read_kb":929,"num_write":387,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'365","reported_seq":1056,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.610299+0000","last_change":"2024-09-12T01:22:15.610299+0000","last_active":"2024-09-12T01:22:15.610299+0000","last_peered":"2024-09-12T01:22:15.610299+0000","last_clean":"2024-09-12T01:22:15.610299+0000","last_became_active":"2024-09-12T00:35:43.918653+0000","last_became_peered":"2024-09-12T00:35:43.918653+0000","last_unstale":"2024-09-12T01:22:15.610299+0000","last_undegraded":"2024-09-12T01:22:15.610299+0000","last_fullsized":"2024-09-12T01:22:15.610299+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T01:22:15.610082+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T01:22:15.610082+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.610082+0000","objects_scrubbed":8,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:31.364055+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262196,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":641,"num_read_kb":7519,"num_write":1239,"num_write_kb":32586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'269","reported_seq":937,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.447841+0000","last_change":"2024-09-12T01:22:10.447841+0000","last_active":"2024-09-12T01:22:10.447841+0000","last_peered":"2024-09-12T01:22:10.447841+0000","last_clean":"2024-09-12T01:22:10.447841+0000","last_became_active":"2024-09-12T00:35:45.941814+0000","last_became_peered":"2024-09-12T00:35:45.941814+0000","last_unstale":"2024-09-12T01:22:10.447841+0000","last_undegraded":"2024-09-12T01:22:10.447841+0000","last_fullsized":"2024-09-12T01:22:10.447841+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'269","last_scrub_stamp":"2024-09-12T01:22:10.447618+0000","last_deep_scrub":"265'269","last_deep_scrub_stamp":"2024-09-12T01:22:10.447618+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.447618+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:20.433161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1198,"num_read_kb":983,"num_write":434,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'104","reported_seq":687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.952536+0000","last_change":"2024-09-12T01:22:20.952362+0000","last_active":"2024-09-12T01:22:20.952536+0000","last_peered":"2024-09-12T01:22:20.952536+0000","last_clean":"2024-09-12T01:22:20.952536+0000","last_became_active":"2024-09-12T00:35:45.929168+0000","last_became_peered":"2024-09-12T00:35:45.929168+0000","last_unstale":"2024-09-12T01:22:20.952536+0000","last_undegraded":"2024-09-12T01:22:20.952536+0000","last_fullsized":"2024-09-12T01:22:20.952536+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'104","last_scrub_stamp":"2024-09-12T01:22:20.952183+0000","last_deep_scrub":"265'104","last_deep_scrub_stamp":"2024-09-12T01:22:20.952183+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.952183+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:31.113426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":468,"num_read_kb":393,"num_write":157,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'374","reported_seq":1031,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.525467+0000","last_change":"2024-09-12T01:22:14.525467+0000","last_active":"2024-09-12T01:22:14.525467+0000","last_peered":"2024-09-12T01:22:14.525467+0000","last_clean":"2024-09-12T01:22:14.525467+0000","last_became_active":"2024-09-12T00:35:43.949857+0000","last_became_peered":"2024-09-12T00:35:43.949857+0000","last_unstale":"2024-09-12T01:22:14.525467+0000","last_undegraded":"2024-09-12T01:22:14.525467+0000","last_fullsized":"2024-09-12T01:22:14.525467+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T01:22:14.525234+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T01:22:14.525234+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.525234+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:51.992259+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":541,"num_read_kb":3399,"num_write":1114,"num_write_kb":43442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'111","reported_seq":693,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.429442+0000","last_change":"2024-09-12T01:22:19.429285+0000","last_active":"2024-09-12T01:22:19.429442+0000","last_peered":"2024-09-12T01:22:19.429442+0000","last_clean":"2024-09-12T01:22:19.429442+0000","last_became_active":"2024-09-12T00:35:45.947366+0000","last_became_peered":"2024-09-12T00:35:45.947366+0000","last_unstale":"2024-09-12T01:22:19.429442+0000","last_undegraded":"2024-09-12T01:22:19.429442+0000","last_fullsized":"2024-09-12T01:22:19.429442+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'111","last_scrub_stamp":"2024-09-12T01:22:19.429104+0000","last_deep_scrub":"265'111","last_deep_scrub_stamp":"2024-09-12T01:22:19.429104+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.429104+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:52.961560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":482,"num_read_kb":394,"num_write":173,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'368","reported_seq":1051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.214862+0000","last_change":"2024-09-12T01:22:12.214862+0000","last_active":"2024-09-12T01:22:12.214862+0000","last_peered":"2024-09-12T01:22:12.214862+0000","last_clean":"2024-09-12T01:22:12.214862+0000","last_became_active":"2024-09-12T00:35:43.926027+0000","last_became_peered":"2024-09-12T00:35:43.926027+0000","last_unstale":"2024-09-12T01:22:12.214862+0000","last_undegraded":"2024-09-12T01:22:12.214862+0000","last_fullsized":"2024-09-12T01:22:12.214862+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'368","last_scrub_stamp":"2024-09-12T01:22:12.214580+0000","last_deep_scrub":"265'368","last_deep_scrub_stamp":"2024-09-12T01:22:12.214580+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.214580+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:50.008326+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":574,"num_read_kb":69210,"num_write":1266,"num_write_kb":64702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'169","reported_seq":786,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.751016+0000","last_change":"2024-09-12T01:22:20.750840+0000","last_active":"2024-09-12T01:22:20.751016+0000","last_peered":"2024-09-12T01:22:20.751016+0000","last_clean":"2024-09-12T01:22:20.751016+0000","last_became_active":"2024-09-12T00:35:45.932116+0000","last_became_peered":"2024-09-12T00:35:45.932116+0000","last_unstale":"2024-09-12T01:22:20.751016+0000","last_undegraded":"2024-09-12T01:22:20.751016+0000","last_fullsized":"2024-09-12T01:22:20.751016+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'169","last_scrub_stamp":"2024-09-12T01:22:20.750664+0000","last_deep_scrub":"265'169","last_deep_scrub_stamp":"2024-09-12T01:22:20.750664+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.750664+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:56.693844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":828,"num_read_kb":701,"num_write":304,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'373","reported_seq":1069,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.243782+0000","last_change":"2024-09-12T01:22:11.243782+0000","last_active":"2024-09-12T01:22:11.243782+0000","last_peered":"2024-09-12T01:22:11.243782+0000","last_clean":"2024-09-12T01:22:11.243782+0000","last_became_active":"2024-09-12T00:36:17.045217+0000","last_became_peered":"2024-09-12T00:36:17.045217+0000","last_unstale":"2024-09-12T01:22:11.243782+0000","last_undegraded":"2024-09-12T01:22:11.243782+0000","last_fullsized":"2024-09-12T01:22:11.243782+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T01:22:11.243529+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T01:22:11.243529+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.243529+0000","objects_scrubbed":8,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:11.316579+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460235,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":599,"num_read_kb":9912,"num_write":1094,"num_write_kb":33583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'100","reported_seq":659,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.371858+0000","last_change":"2024-09-12T01:22:12.371858+0000","last_active":"2024-09-12T01:22:12.371858+0000","last_peered":"2024-09-12T01:22:12.371858+0000","last_clean":"2024-09-12T01:22:12.371858+0000","last_became_active":"2024-09-12T00:35:45.939261+0000","last_became_peered":"2024-09-12T00:35:45.939261+0000","last_unstale":"2024-09-12T01:22:12.371858+0000","last_undegraded":"2024-09-12T01:22:12.371858+0000","last_fullsized":"2024-09-12T01:22:12.371858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'100","last_scrub_stamp":"2024-09-12T01:22:12.371622+0000","last_deep_scrub":"265'100","last_deep_scrub_stamp":"2024-09-12T01:22:12.371622+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.371622+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:46.453737+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":439,"num_read_kb":359,"num_write":158,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'344","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.047647+0000","last_change":"2024-09-12T01:22:08.047647+0000","last_active":"2024-09-12T01:22:08.047647+0000","last_peered":"2024-09-12T01:22:08.047647+0000","last_clean":"2024-09-12T01:22:08.047647+0000","last_became_active":"2024-09-12T00:35:43.949045+0000","last_became_peered":"2024-09-12T00:35:43.949045+0000","last_unstale":"2024-09-12T01:22:08.047647+0000","last_undegraded":"2024-09-12T01:22:08.047647+0000","last_fullsized":"2024-09-12T01:22:08.047647+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'344","last_scrub_stamp":"2024-09-12T01:22:08.047386+0000","last_deep_scrub":"265'344","last_deep_scrub_stamp":"2024-09-12T01:22:08.047386+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.047386+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:24.278106+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289432,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":556,"num_read_kb":18745,"num_write":1038,"num_write_kb":46080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'126","reported_seq":733,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.474888+0000","last_change":"2024-09-12T01:22:06.474888+0000","last_active":"2024-09-12T01:22:06.474888+0000","last_peered":"2024-09-12T01:22:06.474888+0000","last_clean":"2024-09-12T01:22:06.474888+0000","last_became_active":"2024-09-12T00:35:45.942814+0000","last_became_peered":"2024-09-12T00:35:45.942814+0000","last_unstale":"2024-09-12T01:22:06.474888+0000","last_undegraded":"2024-09-12T01:22:06.474888+0000","last_fullsized":"2024-09-12T01:22:06.474888+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'126","last_scrub_stamp":"2024-09-12T01:22:06.474688+0000","last_deep_scrub":"265'126","last_deep_scrub_stamp":"2024-09-12T01:22:06.474688+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.474688+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:09.883585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":574,"num_read_kb":483,"num_write":214,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'325","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.633517+0000","last_change":"2024-09-12T01:22:12.633517+0000","last_active":"2024-09-12T01:22:12.633517+0000","last_peered":"2024-09-12T01:22:12.633517+0000","last_clean":"2024-09-12T01:22:12.633517+0000","last_became_active":"2024-09-12T00:35:43.939128+0000","last_became_peered":"2024-09-12T00:35:43.939128+0000","last_unstale":"2024-09-12T01:22:12.633517+0000","last_undegraded":"2024-09-12T01:22:12.633517+0000","last_fullsized":"2024-09-12T01:22:12.633517+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'325","last_scrub_stamp":"2024-09-12T01:22:12.633317+0000","last_deep_scrub":"265'325","last_deep_scrub_stamp":"2024-09-12T01:22:12.633317+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.633317+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:15.440772+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":453,"num_read_kb":9693,"num_write":1061,"num_write_kb":13466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'4124","reported_seq":4728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.894824+0000","last_change":"2024-09-12T01:22:22.894824+0000","last_active":"2024-09-12T01:22:22.894824+0000","last_peered":"2024-09-12T01:22:22.894824+0000","last_clean":"2024-09-12T01:22:22.894824+0000","last_became_active":"2024-09-12T00:35:45.943253+0000","last_became_peered":"2024-09-12T00:35:45.943253+0000","last_unstale":"2024-09-12T01:22:22.894824+0000","last_undegraded":"2024-09-12T01:22:22.894824+0000","last_fullsized":"2024-09-12T01:22:22.894824+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4124","last_scrub_stamp":"2024-09-12T01:22:22.894642+0000","last_deep_scrub":"265'4124","last_deep_scrub_stamp":"2024-09-12T01:22:22.894642+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.894642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:05.132607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16581,"num_read_kb":13903,"num_write":6185,"num_write_kb":3084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'358","reported_seq":1028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.573973+0000","last_change":"2024-09-12T01:22:10.573810+0000","last_active":"2024-09-12T01:22:10.573973+0000","last_peered":"2024-09-12T01:22:10.573973+0000","last_clean":"2024-09-12T01:22:10.573973+0000","last_became_active":"2024-09-12T00:35:43.933191+0000","last_became_peered":"2024-09-12T00:35:43.933191+0000","last_unstale":"2024-09-12T01:22:10.573973+0000","last_undegraded":"2024-09-12T01:22:10.573973+0000","last_fullsized":"2024-09-12T01:22:10.573973+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T01:22:10.573611+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T01:22:10.573611+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.573611+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:05.894738+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":549,"num_read_kb":44649,"num_write":1012,"num_write_kb":28437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'151","reported_seq":674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:38.865862+0000","last_change":"2024-09-12T01:22:38.865862+0000","last_active":"2024-09-12T01:22:38.865862+0000","last_peered":"2024-09-12T01:22:38.865862+0000","last_clean":"2024-09-12T01:22:38.865862+0000","last_became_active":"2024-09-12T00:35:53.981609+0000","last_became_peered":"2024-09-12T00:35:53.981609+0000","last_unstale":"2024-09-12T01:22:38.865862+0000","last_undegraded":"2024-09-12T01:22:38.865862+0000","last_fullsized":"2024-09-12T01:22:38.865862+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'151","last_scrub_stamp":"2024-09-12T01:22:38.865633+0000","last_deep_scrub":"265'151","last_deep_scrub_stamp":"2024-09-12T01:22:38.865633+0000","last_clean_scrub_stamp":"2024-09-12T01:22:38.865633+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:44.587924+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":187,"num_read_kb":176,"num_write":375,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'259","reported_seq":911,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.620747+0000","last_change":"2024-09-12T01:22:17.620618+0000","last_active":"2024-09-12T01:22:17.620747+0000","last_peered":"2024-09-12T01:22:17.620747+0000","last_clean":"2024-09-12T01:22:17.620747+0000","last_became_active":"2024-09-12T00:35:45.948575+0000","last_became_peered":"2024-09-12T00:35:45.948575+0000","last_unstale":"2024-09-12T01:22:17.620747+0000","last_undegraded":"2024-09-12T01:22:17.620747+0000","last_fullsized":"2024-09-12T01:22:17.620747+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'259","last_scrub_stamp":"2024-09-12T01:22:17.620446+0000","last_deep_scrub":"265'259","last_deep_scrub_stamp":"2024-09-12T01:22:17.620446+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.620446+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:30.407262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1199,"num_read_kb":1005,"num_write":430,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"265'290","reported_seq":896,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.507460+0000","last_change":"2024-09-12T01:22:12.507305+0000","last_active":"2024-09-12T01:22:12.507460+0000","last_peered":"2024-09-12T01:22:12.507460+0000","last_clean":"2024-09-12T01:22:12.507460+0000","last_became_active":"2024-09-12T00:35:43.956812+0000","last_became_peered":"2024-09-12T00:35:43.956812+0000","last_unstale":"2024-09-12T01:22:12.507460+0000","last_undegraded":"2024-09-12T01:22:12.507460+0000","last_fullsized":"2024-09-12T01:22:12.507460+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'290","last_scrub_stamp":"2024-09-12T01:22:12.507085+0000","last_deep_scrub":"265'290","last_deep_scrub_stamp":"2024-09-12T01:22:12.507085+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.507085+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:34.635767+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":413,"num_read_kb":399,"num_write":958,"num_write_kb":26614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:26.662866+0000","last_change":"2024-09-12T01:22:26.662866+0000","last_active":"2024-09-12T01:22:26.662866+0000","last_peered":"2024-09-12T01:22:26.662866+0000","last_clean":"2024-09-12T01:22:26.662866+0000","last_became_active":"2024-09-12T00:35:47.933249+0000","last_became_peered":"2024-09-12T00:35:47.933249+0000","last_unstale":"2024-09-12T01:22:26.662866+0000","last_undegraded":"2024-09-12T01:22:26.662866+0000","last_fullsized":"2024-09-12T01:22:26.662866+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:26.662691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:26.662691+0000","last_clean_scrub_stamp":"2024-09-12T01:22:26.662691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:33.845596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'344","reported_seq":960,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:26.488910+0000","last_change":"2024-09-12T01:22:26.488910+0000","last_active":"2024-09-12T01:22:26.488910+0000","last_peered":"2024-09-12T01:22:26.488910+0000","last_clean":"2024-09-12T01:22:26.488910+0000","last_became_active":"2024-09-12T00:35:49.951438+0000","last_became_peered":"2024-09-12T00:35:49.951438+0000","last_unstale":"2024-09-12T01:22:26.488910+0000","last_undegraded":"2024-09-12T01:22:26.488910+0000","last_fullsized":"2024-09-12T01:22:26.488910+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'344","last_scrub_stamp":"2024-09-12T01:22:26.488626+0000","last_deep_scrub":"265'344","last_deep_scrub_stamp":"2024-09-12T01:22:26.488626+0000","last_clean_scrub_stamp":"2024-09-12T01:22:26.488626+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:38.093876+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44615,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":554,"num_read_kb":1150,"num_write":438,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:35.418249+0000","last_change":"2024-09-12T01:22:35.418249+0000","last_active":"2024-09-12T01:22:35.418249+0000","last_peered":"2024-09-12T01:22:35.418249+0000","last_clean":"2024-09-12T01:22:35.418249+0000","last_became_active":"2024-09-12T00:35:51.984350+0000","last_became_peered":"2024-09-12T00:35:51.984350+0000","last_unstale":"2024-09-12T01:22:35.418249+0000","last_undegraded":"2024-09-12T01:22:35.418249+0000","last_fullsized":"2024-09-12T01:22:35.418249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:35.418076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:35.418076+0000","last_clean_scrub_stamp":"2024-09-12T01:22:35.418076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:53.339786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'206","reported_seq":813,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:39.554559+0000","last_change":"2024-09-12T01:22:39.554559+0000","last_active":"2024-09-12T01:22:39.554559+0000","last_peered":"2024-09-12T01:22:39.554559+0000","last_clean":"2024-09-12T01:22:39.554559+0000","last_became_active":"2024-09-12T00:35:53.995513+0000","last_became_peered":"2024-09-12T00:35:53.995513+0000","last_unstale":"2024-09-12T01:22:39.554559+0000","last_undegraded":"2024-09-12T01:22:39.554559+0000","last_fullsized":"2024-09-12T01:22:39.554559+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'206","last_scrub_stamp":"2024-09-12T01:22:39.554345+0000","last_deep_scrub":"265'206","last_deep_scrub_stamp":"2024-09-12T01:22:39.554345+0000","last_clean_scrub_stamp":"2024-09-12T01:22:39.554345+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:17.258884+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":409,"num_read_kb":360,"num_write":396,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'241","reported_seq":876,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.747102+0000","last_change":"2024-09-12T01:22:18.747102+0000","last_active":"2024-09-12T01:22:18.747102+0000","last_peered":"2024-09-12T01:22:18.747102+0000","last_clean":"2024-09-12T01:22:18.747102+0000","last_became_active":"2024-09-12T00:35:45.939962+0000","last_became_peered":"2024-09-12T00:35:45.939962+0000","last_unstale":"2024-09-12T01:22:18.747102+0000","last_undegraded":"2024-09-12T01:22:18.747102+0000","last_fullsized":"2024-09-12T01:22:18.747102+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'241","last_scrub_stamp":"2024-09-12T01:22:18.746925+0000","last_deep_scrub":"265'241","last_deep_scrub_stamp":"2024-09-12T01:22:18.746925+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.746925+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:11.880068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1036,"num_read_kb":844,"num_write":371,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'378","reported_seq":1091,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:02.751401+0000","last_change":"2024-09-12T01:22:02.751301+0000","last_active":"2024-09-12T01:22:02.751401+0000","last_peered":"2024-09-12T01:22:02.751401+0000","last_clean":"2024-09-12T01:22:02.751401+0000","last_became_active":"2024-09-12T00:35:43.944705+0000","last_became_peered":"2024-09-12T00:35:43.944705+0000","last_unstale":"2024-09-12T01:22:02.751401+0000","last_undegraded":"2024-09-12T01:22:02.751401+0000","last_fullsized":"2024-09-12T01:22:02.751401+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'378","last_scrub_stamp":"2024-09-12T01:22:02.751158+0000","last_deep_scrub":"265'378","last_deep_scrub_stamp":"2024-09-12T01:22:02.751158+0000","last_clean_scrub_stamp":"2024-09-12T01:22:02.751158+0000","objects_scrubbed":10,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:41.394968+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1344150,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":792,"num_read_kb":8209,"num_write":1184,"num_write_kb":28685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:26.485367+0000","last_change":"2024-09-12T01:22:26.485115+0000","last_active":"2024-09-12T01:22:26.485367+0000","last_peered":"2024-09-12T01:22:26.485367+0000","last_clean":"2024-09-12T01:22:26.485367+0000","last_became_active":"2024-09-12T00:35:47.945971+0000","last_became_peered":"2024-09-12T00:35:47.945971+0000","last_unstale":"2024-09-12T01:22:26.485367+0000","last_undegraded":"2024-09-12T01:22:26.485367+0000","last_fullsized":"2024-09-12T01:22:26.485367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:26.484886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:26.484886+0000","last_clean_scrub_stamp":"2024-09-12T01:22:26.484886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:48.584060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'97","reported_seq":637,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:30.939730+0000","last_change":"2024-09-12T01:22:30.939730+0000","last_active":"2024-09-12T01:22:30.939730+0000","last_peered":"2024-09-12T01:22:30.939730+0000","last_clean":"2024-09-12T01:22:30.939730+0000","last_became_active":"2024-09-12T00:35:49.938374+0000","last_became_peered":"2024-09-12T00:35:49.938374+0000","last_unstale":"2024-09-12T01:22:30.939730+0000","last_undegraded":"2024-09-12T01:22:30.939730+0000","last_fullsized":"2024-09-12T01:22:30.939730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'97","last_scrub_stamp":"2024-09-12T01:22:30.939542+0000","last_deep_scrub":"265'97","last_deep_scrub_stamp":"2024-09-12T01:22:30.939542+0000","last_clean_scrub_stamp":"2024-09-12T01:22:30.939542+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:36.378496+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:34.956608+0000","last_change":"2024-09-12T01:22:34.956608+0000","last_active":"2024-09-12T01:22:34.956608+0000","last_peered":"2024-09-12T01:22:34.956608+0000","last_clean":"2024-09-12T01:22:34.956608+0000","last_became_active":"2024-09-12T00:35:51.974659+0000","last_became_peered":"2024-09-12T00:35:51.974659+0000","last_unstale":"2024-09-12T01:22:34.956608+0000","last_undegraded":"2024-09-12T01:22:34.956608+0000","last_fullsized":"2024-09-12T01:22:34.956608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:34.956422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:34.956422+0000","last_clean_scrub_stamp":"2024-09-12T01:22:34.956422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:02.049351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'118","reported_seq":657,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:34.461563+0000","last_change":"2024-09-12T01:22:34.461563+0000","last_active":"2024-09-12T01:22:34.461563+0000","last_peered":"2024-09-12T01:22:34.461563+0000","last_clean":"2024-09-12T01:22:34.461563+0000","last_became_active":"2024-09-12T00:35:53.992311+0000","last_became_peered":"2024-09-12T00:35:53.992311+0000","last_unstale":"2024-09-12T01:22:34.461563+0000","last_undegraded":"2024-09-12T01:22:34.461563+0000","last_fullsized":"2024-09-12T01:22:34.461563+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'118","last_scrub_stamp":"2024-09-12T01:22:34.461375+0000","last_deep_scrub":"265'118","last_deep_scrub_stamp":"2024-09-12T01:22:34.461375+0000","last_clean_scrub_stamp":"2024-09-12T01:22:34.461375+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:20.457415+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":265,"num_read_kb":226,"num_write":268,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'268","reported_seq":921,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.573840+0000","last_change":"2024-09-12T01:22:15.573840+0000","last_active":"2024-09-12T01:22:15.573840+0000","last_peered":"2024-09-12T01:22:15.573840+0000","last_clean":"2024-09-12T01:22:15.573840+0000","last_became_active":"2024-09-12T00:35:45.941543+0000","last_became_peered":"2024-09-12T00:35:45.941543+0000","last_unstale":"2024-09-12T01:22:15.573840+0000","last_undegraded":"2024-09-12T01:22:15.573840+0000","last_fullsized":"2024-09-12T01:22:15.573840+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'268","last_scrub_stamp":"2024-09-12T01:22:15.573638+0000","last_deep_scrub":"265'268","last_deep_scrub_stamp":"2024-09-12T01:22:15.573638+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.573638+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:55.006640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1165,"num_read_kb":955,"num_write":416,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'393","reported_seq":1116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.480162+0000","last_change":"2024-09-12T01:22:11.480017+0000","last_active":"2024-09-12T01:22:11.480162+0000","last_peered":"2024-09-12T01:22:11.480162+0000","last_clean":"2024-09-12T01:22:11.480162+0000","last_became_active":"2024-09-12T00:35:43.952543+0000","last_became_peered":"2024-09-12T00:35:43.952543+0000","last_unstale":"2024-09-12T01:22:11.480162+0000","last_undegraded":"2024-09-12T01:22:11.480162+0000","last_fullsized":"2024-09-12T01:22:11.480162+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'393","last_scrub_stamp":"2024-09-12T01:22:11.479778+0000","last_deep_scrub":"265'393","last_deep_scrub_stamp":"2024-09-12T01:22:11.479778+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.479778+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:16.175100+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262200,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":772,"num_read_kb":780,"num_write":1221,"num_write_kb":19641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:27.520990+0000","last_change":"2024-09-12T01:22:27.520990+0000","last_active":"2024-09-12T01:22:27.520990+0000","last_peered":"2024-09-12T01:22:27.520990+0000","last_clean":"2024-09-12T01:22:27.520990+0000","last_became_active":"2024-09-12T00:35:47.933896+0000","last_became_peered":"2024-09-12T00:35:47.933896+0000","last_unstale":"2024-09-12T01:22:27.520990+0000","last_undegraded":"2024-09-12T01:22:27.520990+0000","last_fullsized":"2024-09-12T01:22:27.520990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:27.520810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:27.520810+0000","last_clean_scrub_stamp":"2024-09-12T01:22:27.520810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:28.480023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'120","reported_seq":671,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.374781+0000","last_change":"2024-09-12T01:22:18.374611+0000","last_active":"2024-09-12T01:22:18.374781+0000","last_peered":"2024-09-12T01:22:18.374781+0000","last_clean":"2024-09-12T01:22:18.374781+0000","last_became_active":"2024-09-12T00:35:49.936846+0000","last_became_peered":"2024-09-12T00:35:49.936846+0000","last_unstale":"2024-09-12T01:22:18.374781+0000","last_undegraded":"2024-09-12T01:22:18.374781+0000","last_fullsized":"2024-09-12T01:22:18.374781+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'120","last_scrub_stamp":"2024-09-12T01:22:18.374419+0000","last_deep_scrub":"265'120","last_deep_scrub_stamp":"2024-09-12T01:22:18.374419+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.374419+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:24.935816+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":139,"num_read_kb":131,"num_write":92,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'774","reported_seq":2297,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:34.414268+0000","last_change":"2024-09-12T01:22:34.414268+0000","last_active":"2024-09-12T01:22:34.414268+0000","last_peered":"2024-09-12T01:22:34.414268+0000","last_clean":"2024-09-12T01:22:34.414268+0000","last_became_active":"2024-09-12T00:35:51.979288+0000","last_became_peered":"2024-09-12T00:35:51.979288+0000","last_unstale":"2024-09-12T01:22:34.414268+0000","last_undegraded":"2024-09-12T01:22:34.414268+0000","last_fullsized":"2024-09-12T01:22:34.414268+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'774","last_scrub_stamp":"2024-09-12T01:22:34.414083+0000","last_deep_scrub":"265'774","last_deep_scrub_stamp":"2024-09-12T01:22:34.414083+0000","last_clean_scrub_stamp":"2024-09-12T01:22:34.414083+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:12.647174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'192","reported_seq":1024,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:39.899169+0000","last_change":"2024-09-12T01:22:39.899169+0000","last_active":"2024-09-12T01:22:39.899169+0000","last_peered":"2024-09-12T01:22:39.899169+0000","last_clean":"2024-09-12T01:22:39.899169+0000","last_became_active":"2024-09-12T00:35:54.013299+0000","last_became_peered":"2024-09-12T00:35:54.013299+0000","last_unstale":"2024-09-12T01:22:39.899169+0000","last_undegraded":"2024-09-12T01:22:39.899169+0000","last_fullsized":"2024-09-12T01:22:39.899169+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'192","last_scrub_stamp":"2024-09-12T01:22:39.898987+0000","last_deep_scrub":"265'192","last_deep_scrub_stamp":"2024-09-12T01:22:39.898987+0000","last_clean_scrub_stamp":"2024-09-12T01:22:39.898987+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:19.052550+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":837,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":580,"num_read_kb":578,"num_write":407,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'105","reported_seq":685,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.602937+0000","last_change":"2024-09-12T01:22:19.602937+0000","last_active":"2024-09-12T01:22:19.602937+0000","last_peered":"2024-09-12T01:22:19.602937+0000","last_clean":"2024-09-12T01:22:19.602937+0000","last_became_active":"2024-09-12T00:35:45.954858+0000","last_became_peered":"2024-09-12T00:35:45.954858+0000","last_unstale":"2024-09-12T01:22:19.602937+0000","last_undegraded":"2024-09-12T01:22:19.602937+0000","last_fullsized":"2024-09-12T01:22:19.602937+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'105","last_scrub_stamp":"2024-09-12T01:22:19.602704+0000","last_deep_scrub":"265'105","last_deep_scrub_stamp":"2024-09-12T01:22:19.602704+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.602704+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:45.698367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":470,"num_read_kb":391,"num_write":166,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'358","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.148076+0000","last_change":"2024-09-12T01:22:06.147932+0000","last_active":"2024-09-12T01:22:06.148076+0000","last_peered":"2024-09-12T01:22:06.148076+0000","last_clean":"2024-09-12T01:22:06.148076+0000","last_became_active":"2024-09-12T00:35:43.930867+0000","last_became_peered":"2024-09-12T00:35:43.930867+0000","last_unstale":"2024-09-12T01:22:06.148076+0000","last_undegraded":"2024-09-12T01:22:06.148076+0000","last_fullsized":"2024-09-12T01:22:06.148076+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T01:22:06.147754+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T01:22:06.147754+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.147754+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:37.175214+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291487,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":529,"num_read_kb":73816,"num_write":1070,"num_write_kb":41341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:27.679002+0000","last_change":"2024-09-12T01:22:27.679002+0000","last_active":"2024-09-12T01:22:27.679002+0000","last_peered":"2024-09-12T01:22:27.679002+0000","last_clean":"2024-09-12T01:22:27.679002+0000","last_became_active":"2024-09-12T00:35:47.930883+0000","last_became_peered":"2024-09-12T00:35:47.930883+0000","last_unstale":"2024-09-12T01:22:27.679002+0000","last_undegraded":"2024-09-12T01:22:27.679002+0000","last_fullsized":"2024-09-12T01:22:27.679002+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:27.678814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:27.678814+0000","last_clean_scrub_stamp":"2024-09-12T01:22:27.678814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:33.971827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'294","reported_seq":874,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:32.456344+0000","last_change":"2024-09-12T01:22:32.456344+0000","last_active":"2024-09-12T01:22:32.456344+0000","last_peered":"2024-09-12T01:22:32.456344+0000","last_clean":"2024-09-12T01:22:32.456344+0000","last_became_active":"2024-09-12T00:35:50.029236+0000","last_became_peered":"2024-09-12T00:35:50.029236+0000","last_unstale":"2024-09-12T01:22:32.456344+0000","last_undegraded":"2024-09-12T01:22:32.456344+0000","last_fullsized":"2024-09-12T01:22:32.456344+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'294","last_scrub_stamp":"2024-09-12T01:22:32.456135+0000","last_deep_scrub":"265'294","last_deep_scrub_stamp":"2024-09-12T01:22:32.456135+0000","last_clean_scrub_stamp":"2024-09-12T01:22:32.456135+0000","objects_scrubbed":5,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:06.127377+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54671,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":1128,"num_write":386,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'787","reported_seq":2341,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:39.692783+0000","last_change":"2024-09-12T01:22:39.692615+0000","last_active":"2024-09-12T01:22:39.692783+0000","last_peered":"2024-09-12T01:22:39.692783+0000","last_clean":"2024-09-12T01:22:39.692783+0000","last_became_active":"2024-09-12T00:35:51.983271+0000","last_became_peered":"2024-09-12T00:35:51.983271+0000","last_unstale":"2024-09-12T01:22:39.692783+0000","last_undegraded":"2024-09-12T01:22:39.692783+0000","last_fullsized":"2024-09-12T01:22:39.692783+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'787","last_scrub_stamp":"2024-09-12T01:22:39.692436+0000","last_deep_scrub":"265'787","last_deep_scrub_stamp":"2024-09-12T01:22:39.692436+0000","last_clean_scrub_stamp":"2024-09-12T01:22:39.692436+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:11.098708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'260","reported_seq":940,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.783023+0000","last_change":"2024-09-12T01:22:17.783023+0000","last_active":"2024-09-12T01:22:17.783023+0000","last_peered":"2024-09-12T01:22:17.783023+0000","last_clean":"2024-09-12T01:22:17.783023+0000","last_became_active":"2024-09-12T00:35:45.940073+0000","last_became_peered":"2024-09-12T00:35:45.940073+0000","last_unstale":"2024-09-12T01:22:17.783023+0000","last_undegraded":"2024-09-12T01:22:17.783023+0000","last_fullsized":"2024-09-12T01:22:17.783023+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'260","last_scrub_stamp":"2024-09-12T01:22:17.782804+0000","last_deep_scrub":"265'260","last_deep_scrub_stamp":"2024-09-12T01:22:17.782804+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.782804+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:47.983931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1192,"num_read_kb":982,"num_write":401,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'356","reported_seq":1073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.438750+0000","last_change":"2024-09-12T01:22:09.438750+0000","last_active":"2024-09-12T01:22:09.438750+0000","last_peered":"2024-09-12T01:22:09.438750+0000","last_clean":"2024-09-12T01:22:09.438750+0000","last_became_active":"2024-09-12T00:35:43.956814+0000","last_became_peered":"2024-09-12T00:35:43.956814+0000","last_unstale":"2024-09-12T01:22:09.438750+0000","last_undegraded":"2024-09-12T01:22:09.438750+0000","last_fullsized":"2024-09-12T01:22:09.438750+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T01:22:09.438513+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T01:22:09.438513+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.438513+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:18.913267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":767,"num_read_kb":6356,"num_write":996,"num_write_kb":17273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:23.361207+0000","last_change":"2024-09-12T01:22:23.361207+0000","last_active":"2024-09-12T01:22:23.361207+0000","last_peered":"2024-09-12T01:22:23.361207+0000","last_clean":"2024-09-12T01:22:23.361207+0000","last_became_active":"2024-09-12T00:35:47.944913+0000","last_became_peered":"2024-09-12T00:35:47.944913+0000","last_unstale":"2024-09-12T01:22:23.361207+0000","last_undegraded":"2024-09-12T01:22:23.361207+0000","last_fullsized":"2024-09-12T01:22:23.361207+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:23.360974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:23.360974+0000","last_clean_scrub_stamp":"2024-09-12T01:22:23.360974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:40.017227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'358","reported_seq":981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:30.677483+0000","last_change":"2024-09-12T01:22:30.677483+0000","last_active":"2024-09-12T01:22:30.677483+0000","last_peered":"2024-09-12T01:22:30.677483+0000","last_clean":"2024-09-12T01:22:30.677483+0000","last_became_active":"2024-09-12T00:35:50.027282+0000","last_became_peered":"2024-09-12T00:35:50.027282+0000","last_unstale":"2024-09-12T01:22:30.677483+0000","last_undegraded":"2024-09-12T01:22:30.677483+0000","last_fullsized":"2024-09-12T01:22:30.677483+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T01:22:30.677282+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T01:22:30.677282+0000","last_clean_scrub_stamp":"2024-09-12T01:22:30.677282+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:10.624962+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45216,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":563,"num_read_kb":1133,"num_write":440,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:26.211253+0000","last_change":"2024-09-12T01:22:26.211253+0000","last_active":"2024-09-12T01:22:26.211253+0000","last_peered":"2024-09-12T01:22:26.211253+0000","last_clean":"2024-09-12T01:22:26.211253+0000","last_became_active":"2024-09-12T00:35:51.971491+0000","last_became_peered":"2024-09-12T00:35:51.971491+0000","last_unstale":"2024-09-12T01:22:26.211253+0000","last_undegraded":"2024-09-12T01:22:26.211253+0000","last_fullsized":"2024-09-12T01:22:26.211253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:26.211085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:26.211085+0000","last_clean_scrub_stamp":"2024-09-12T01:22:26.211085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:51.214576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'559","reported_seq":1382,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:35.568496+0000","last_change":"2024-09-12T01:22:35.568496+0000","last_active":"2024-09-12T01:22:35.568496+0000","last_peered":"2024-09-12T01:22:35.568496+0000","last_clean":"2024-09-12T01:22:35.568496+0000","last_became_active":"2024-09-12T00:35:53.996514+0000","last_became_peered":"2024-09-12T00:35:53.996514+0000","last_unstale":"2024-09-12T01:22:35.568496+0000","last_undegraded":"2024-09-12T01:22:35.568496+0000","last_fullsized":"2024-09-12T01:22:35.568496+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'559","last_scrub_stamp":"2024-09-12T01:22:35.568268+0000","last_deep_scrub":"265'559","last_deep_scrub_stamp":"2024-09-12T01:22:35.568268+0000","last_clean_scrub_stamp":"2024-09-12T01:22:35.568268+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:59.901744+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1307,"num_read_kb":1296,"num_write":1166,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'136","reported_seq":748,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.018297+0000","last_change":"2024-09-12T01:22:10.018297+0000","last_active":"2024-09-12T01:22:10.018297+0000","last_peered":"2024-09-12T01:22:10.018297+0000","last_clean":"2024-09-12T01:22:10.018297+0000","last_became_active":"2024-09-12T00:35:45.943083+0000","last_became_peered":"2024-09-12T00:35:45.943083+0000","last_unstale":"2024-09-12T01:22:10.018297+0000","last_undegraded":"2024-09-12T01:22:10.018297+0000","last_fullsized":"2024-09-12T01:22:10.018297+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'136","last_scrub_stamp":"2024-09-12T01:22:10.018112+0000","last_deep_scrub":"265'136","last_deep_scrub_stamp":"2024-09-12T01:22:10.018112+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.018112+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:19.240513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":650,"num_read_kb":541,"num_write":222,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'345","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.455683+0000","last_change":"2024-09-12T01:22:08.455546+0000","last_active":"2024-09-12T01:22:08.455683+0000","last_peered":"2024-09-12T01:22:08.455683+0000","last_clean":"2024-09-12T01:22:08.455683+0000","last_became_active":"2024-09-12T00:35:43.953664+0000","last_became_peered":"2024-09-12T00:35:43.953664+0000","last_unstale":"2024-09-12T01:22:08.455683+0000","last_undegraded":"2024-09-12T01:22:08.455683+0000","last_fullsized":"2024-09-12T01:22:08.455683+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'345","last_scrub_stamp":"2024-09-12T01:22:08.455336+0000","last_deep_scrub":"265'345","last_deep_scrub_stamp":"2024-09-12T01:22:08.455336+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.455336+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:59.956866+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288989,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":479,"num_read_kb":49556,"num_write":1051,"num_write_kb":45556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.362512+0000","last_change":"2024-09-12T01:22:16.362512+0000","last_active":"2024-09-12T01:22:16.362512+0000","last_peered":"2024-09-12T01:22:16.362512+0000","last_clean":"2024-09-12T01:22:16.362512+0000","last_became_active":"2024-09-12T00:35:47.936972+0000","last_became_peered":"2024-09-12T00:35:47.936972+0000","last_unstale":"2024-09-12T01:22:16.362512+0000","last_undegraded":"2024-09-12T01:22:16.362512+0000","last_fullsized":"2024-09-12T01:22:16.362512+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:16.362319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:16.362319+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.362319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:40.167192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'271","reported_seq":851,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:29.582048+0000","last_change":"2024-09-12T01:22:29.582048+0000","last_active":"2024-09-12T01:22:29.582048+0000","last_peered":"2024-09-12T01:22:29.582048+0000","last_clean":"2024-09-12T01:22:29.582048+0000","last_became_active":"2024-09-12T00:35:49.954568+0000","last_became_peered":"2024-09-12T00:35:49.954568+0000","last_unstale":"2024-09-12T01:22:29.582048+0000","last_undegraded":"2024-09-12T01:22:29.582048+0000","last_fullsized":"2024-09-12T01:22:29.582048+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'271","last_scrub_stamp":"2024-09-12T01:22:29.581862+0000","last_deep_scrub":"265'271","last_deep_scrub_stamp":"2024-09-12T01:22:29.581862+0000","last_clean_scrub_stamp":"2024-09-12T01:22:29.581862+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:38.518669+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45999,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":441,"num_read_kb":1004,"num_write":356,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:36.620871+0000","last_change":"2024-09-12T01:22:36.620871+0000","last_active":"2024-09-12T01:22:36.620871+0000","last_peered":"2024-09-12T01:22:36.620871+0000","last_clean":"2024-09-12T01:22:36.620871+0000","last_became_active":"2024-09-12T00:35:51.981326+0000","last_became_peered":"2024-09-12T00:35:51.981326+0000","last_unstale":"2024-09-12T01:22:36.620871+0000","last_undegraded":"2024-09-12T01:22:36.620871+0000","last_fullsized":"2024-09-12T01:22:36.620871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:36.620663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:36.620663+0000","last_clean_scrub_stamp":"2024-09-12T01:22:36.620663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:23.602336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'2396","reported_seq":4238,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:27.139385+0000","last_change":"2024-09-12T01:22:27.139385+0000","last_active":"2024-09-12T01:22:27.139385+0000","last_peered":"2024-09-12T01:22:27.139385+0000","last_clean":"2024-09-12T01:22:27.139385+0000","last_became_active":"2024-09-12T00:35:53.975054+0000","last_became_peered":"2024-09-12T00:35:53.975054+0000","last_unstale":"2024-09-12T01:22:27.139385+0000","last_undegraded":"2024-09-12T01:22:27.139385+0000","last_fullsized":"2024-09-12T01:22:27.139385+0000","mapping_epoch":34,"log_start":"265'2300","ondisk_log_start":"265'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2396","last_scrub_stamp":"2024-09-12T01:22:27.139196+0000","last_deep_scrub":"265'2396","last_deep_scrub_stamp":"2024-09-12T01:22:27.139196+0000","last_clean_scrub_stamp":"2024-09-12T01:22:27.139196+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":2300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:34.088010+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6031,"num_read_kb":6023,"num_write":4852,"num_write_kb":1786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'134","reported_seq":758,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.095091+0000","last_change":"2024-09-12T01:22:20.095091+0000","last_active":"2024-09-12T01:22:20.095091+0000","last_peered":"2024-09-12T01:22:20.095091+0000","last_clean":"2024-09-12T01:22:20.095091+0000","last_became_active":"2024-09-12T00:35:45.953664+0000","last_became_peered":"2024-09-12T00:35:45.953664+0000","last_unstale":"2024-09-12T01:22:20.095091+0000","last_undegraded":"2024-09-12T01:22:20.095091+0000","last_fullsized":"2024-09-12T01:22:20.095091+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'134","last_scrub_stamp":"2024-09-12T01:22:20.094911+0000","last_deep_scrub":"265'134","last_deep_scrub_stamp":"2024-09-12T01:22:20.094911+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.094911+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:20.389870+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":607,"num_read_kb":511,"num_write":198,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'330","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.447041+0000","last_change":"2024-09-12T01:22:10.446889+0000","last_active":"2024-09-12T01:22:10.447041+0000","last_peered":"2024-09-12T01:22:10.447041+0000","last_clean":"2024-09-12T01:22:10.447041+0000","last_became_active":"2024-09-12T00:35:43.942454+0000","last_became_peered":"2024-09-12T00:35:43.942454+0000","last_unstale":"2024-09-12T01:22:10.447041+0000","last_undegraded":"2024-09-12T01:22:10.447041+0000","last_fullsized":"2024-09-12T01:22:10.447041+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'330","last_scrub_stamp":"2024-09-12T01:22:10.446675+0000","last_deep_scrub":"265'330","last_deep_scrub_stamp":"2024-09-12T01:22:10.446675+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.446675+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:23.036504+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":618,"num_read_kb":3434,"num_write":1027,"num_write_kb":23754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.382878+0000","last_change":"2024-09-12T01:22:13.382878+0000","last_active":"2024-09-12T01:22:13.382878+0000","last_peered":"2024-09-12T01:22:13.382878+0000","last_clean":"2024-09-12T01:22:13.382878+0000","last_became_active":"2024-09-12T00:35:47.942189+0000","last_became_peered":"2024-09-12T00:35:47.942189+0000","last_unstale":"2024-09-12T01:22:13.382878+0000","last_undegraded":"2024-09-12T01:22:13.382878+0000","last_fullsized":"2024-09-12T01:22:13.382878+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:13.382636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:13.382636+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.382636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:49.972499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'327","reported_seq":930,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:28.329109+0000","last_change":"2024-09-12T01:22:28.329109+0000","last_active":"2024-09-12T01:22:28.329109+0000","last_peered":"2024-09-12T01:22:28.329109+0000","last_clean":"2024-09-12T01:22:28.329109+0000","last_became_active":"2024-09-12T00:35:49.942480+0000","last_became_peered":"2024-09-12T00:35:49.942480+0000","last_unstale":"2024-09-12T01:22:28.329109+0000","last_undegraded":"2024-09-12T01:22:28.329109+0000","last_fullsized":"2024-09-12T01:22:28.329109+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'327","last_scrub_stamp":"2024-09-12T01:22:28.328925+0000","last_deep_scrub":"265'327","last_deep_scrub_stamp":"2024-09-12T01:22:28.328925+0000","last_clean_scrub_stamp":"2024-09-12T01:22:28.328925+0000","objects_scrubbed":9,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:14.895378+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48782,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":529,"num_read_kb":1149,"num_write":428,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'773","reported_seq":2446,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:30.491240+0000","last_change":"2024-09-12T01:22:30.491240+0000","last_active":"2024-09-12T01:22:30.491240+0000","last_peered":"2024-09-12T01:22:30.491240+0000","last_clean":"2024-09-12T01:22:30.491240+0000","last_became_active":"2024-09-12T00:35:51.984968+0000","last_became_peered":"2024-09-12T00:35:51.984968+0000","last_unstale":"2024-09-12T01:22:30.491240+0000","last_undegraded":"2024-09-12T01:22:30.491240+0000","last_fullsized":"2024-09-12T01:22:30.491240+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'773","last_scrub_stamp":"2024-09-12T01:22:30.491048+0000","last_deep_scrub":"265'773","last_deep_scrub_stamp":"2024-09-12T01:22:30.491048+0000","last_clean_scrub_stamp":"2024-09-12T01:22:30.491048+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:09.682841+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'109","reported_seq":608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:37.466320+0000","last_change":"2024-09-12T01:22:37.466320+0000","last_active":"2024-09-12T01:22:37.466320+0000","last_peered":"2024-09-12T01:22:37.466320+0000","last_clean":"2024-09-12T01:22:37.466320+0000","last_became_active":"2024-09-12T00:35:53.992664+0000","last_became_peered":"2024-09-12T00:35:53.992664+0000","last_unstale":"2024-09-12T01:22:37.466320+0000","last_undegraded":"2024-09-12T01:22:37.466320+0000","last_fullsized":"2024-09-12T01:22:37.466320+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'109","last_scrub_stamp":"2024-09-12T01:22:37.466134+0000","last_deep_scrub":"265'109","last_deep_scrub_stamp":"2024-09-12T01:22:37.466134+0000","last_clean_scrub_stamp":"2024-09-12T01:22:37.466134+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:02.774735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":110,"num_write":262,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'190","reported_seq":806,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.525199+0000","last_change":"2024-09-12T01:22:14.525068+0000","last_active":"2024-09-12T01:22:14.525199+0000","last_peered":"2024-09-12T01:22:14.525199+0000","last_clean":"2024-09-12T01:22:14.525199+0000","last_became_active":"2024-09-12T00:35:45.939817+0000","last_became_peered":"2024-09-12T00:35:45.939817+0000","last_unstale":"2024-09-12T01:22:14.525199+0000","last_undegraded":"2024-09-12T01:22:14.525199+0000","last_fullsized":"2024-09-12T01:22:14.525199+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'190","last_scrub_stamp":"2024-09-12T01:22:14.524892+0000","last_deep_scrub":"265'190","last_deep_scrub_stamp":"2024-09-12T01:22:14.524892+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.524892+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:07.182122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":809,"num_read_kb":663,"num_write":268,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'374","reported_seq":1037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.814407+0000","last_change":"2024-09-12T01:22:07.814217+0000","last_active":"2024-09-12T01:22:07.814407+0000","last_peered":"2024-09-12T01:22:07.814407+0000","last_clean":"2024-09-12T01:22:07.814407+0000","last_became_active":"2024-09-12T00:35:43.912282+0000","last_became_peered":"2024-09-12T00:35:43.912282+0000","last_unstale":"2024-09-12T01:22:07.814407+0000","last_undegraded":"2024-09-12T01:22:07.814407+0000","last_fullsized":"2024-09-12T01:22:07.814407+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T01:22:07.813838+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T01:22:07.813838+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.813838+0000","objects_scrubbed":15,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:43.752646+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6327796,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":526,"num_read_kb":19021,"num_write":1167,"num_write_kb":32789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.373561+0000","last_change":"2024-09-12T01:22:14.373561+0000","last_active":"2024-09-12T01:22:14.373561+0000","last_peered":"2024-09-12T01:22:14.373561+0000","last_clean":"2024-09-12T01:22:14.373561+0000","last_became_active":"2024-09-12T00:35:47.946636+0000","last_became_peered":"2024-09-12T00:35:47.946636+0000","last_unstale":"2024-09-12T01:22:14.373561+0000","last_undegraded":"2024-09-12T01:22:14.373561+0000","last_fullsized":"2024-09-12T01:22:14.373561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:14.373377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:14.373377+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.373377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:28.908478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'514","reported_seq":1159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:25.513379+0000","last_change":"2024-09-12T01:22:25.513379+0000","last_active":"2024-09-12T01:22:25.513379+0000","last_peered":"2024-09-12T01:22:25.513379+0000","last_clean":"2024-09-12T01:22:25.513379+0000","last_became_active":"2024-09-12T00:35:49.950845+0000","last_became_peered":"2024-09-12T00:35:49.950845+0000","last_unstale":"2024-09-12T01:22:25.513379+0000","last_undegraded":"2024-09-12T01:22:25.513379+0000","last_fullsized":"2024-09-12T01:22:25.513379+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'514","last_scrub_stamp":"2024-09-12T01:22:25.513159+0000","last_deep_scrub":"265'514","last_deep_scrub_stamp":"2024-09-12T01:22:25.513159+0000","last_clean_scrub_stamp":"2024-09-12T01:22:25.513159+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:09.891812+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100676,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":870,"num_read_kb":2075,"num_write":716,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.408954+0000","last_change":"2024-09-12T01:22:19.408954+0000","last_active":"2024-09-12T01:22:19.408954+0000","last_peered":"2024-09-12T01:22:19.408954+0000","last_clean":"2024-09-12T01:22:19.408954+0000","last_became_active":"2024-09-12T00:35:51.978188+0000","last_became_peered":"2024-09-12T00:35:51.978188+0000","last_unstale":"2024-09-12T01:22:19.408954+0000","last_undegraded":"2024-09-12T01:22:19.408954+0000","last_fullsized":"2024-09-12T01:22:19.408954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:19.408763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:19.408763+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.408763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:33.873801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'135","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:28.249753+0000","last_change":"2024-09-12T01:22:28.249753+0000","last_active":"2024-09-12T01:22:28.249753+0000","last_peered":"2024-09-12T01:22:28.249753+0000","last_clean":"2024-09-12T01:22:28.249753+0000","last_became_active":"2024-09-12T00:35:53.985635+0000","last_became_peered":"2024-09-12T00:35:53.985635+0000","last_unstale":"2024-09-12T01:22:28.249753+0000","last_undegraded":"2024-09-12T01:22:28.249753+0000","last_fullsized":"2024-09-12T01:22:28.249753+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'135","last_scrub_stamp":"2024-09-12T01:22:28.249558+0000","last_deep_scrub":"265'135","last_deep_scrub_stamp":"2024-09-12T01:22:28.249558+0000","last_clean_scrub_stamp":"2024-09-12T01:22:28.249558+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:56.700780+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":203,"num_read_kb":181,"num_write":311,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'153","reported_seq":757,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.992581+0000","last_change":"2024-09-12T01:22:10.992417+0000","last_active":"2024-09-12T01:22:10.992581+0000","last_peered":"2024-09-12T01:22:10.992581+0000","last_clean":"2024-09-12T01:22:10.992581+0000","last_became_active":"2024-09-12T00:35:45.938135+0000","last_became_peered":"2024-09-12T00:35:45.938135+0000","last_unstale":"2024-09-12T01:22:10.992581+0000","last_undegraded":"2024-09-12T01:22:10.992581+0000","last_fullsized":"2024-09-12T01:22:10.992581+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'153","last_scrub_stamp":"2024-09-12T01:22:10.992236+0000","last_deep_scrub":"265'153","last_deep_scrub_stamp":"2024-09-12T01:22:10.992236+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.992236+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:32.291897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":684,"num_read_kb":556,"num_write":242,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'387","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.627437+0000","last_change":"2024-09-12T01:22:05.627241+0000","last_active":"2024-09-12T01:22:05.627437+0000","last_peered":"2024-09-12T01:22:05.627437+0000","last_clean":"2024-09-12T01:22:05.627437+0000","last_became_active":"2024-09-12T00:35:43.936713+0000","last_became_peered":"2024-09-12T00:35:43.936713+0000","last_unstale":"2024-09-12T01:22:05.627437+0000","last_undegraded":"2024-09-12T01:22:05.627437+0000","last_fullsized":"2024-09-12T01:22:05.627437+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'387","last_scrub_stamp":"2024-09-12T01:22:05.626966+0000","last_deep_scrub":"265'387","last_deep_scrub_stamp":"2024-09-12T01:22:05.626966+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.626966+0000","objects_scrubbed":8,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:33.798620+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730170,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":551,"num_read_kb":26422,"num_write":1213,"num_write_kb":29680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.334177+0000","last_change":"2024-09-12T01:22:15.334177+0000","last_active":"2024-09-12T01:22:15.334177+0000","last_peered":"2024-09-12T01:22:15.334177+0000","last_clean":"2024-09-12T01:22:15.334177+0000","last_became_active":"2024-09-12T00:35:47.938604+0000","last_became_peered":"2024-09-12T00:35:47.938604+0000","last_unstale":"2024-09-12T01:22:15.334177+0000","last_undegraded":"2024-09-12T01:22:15.334177+0000","last_fullsized":"2024-09-12T01:22:15.334177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:15.333992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:15.333992+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.333992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:44.787901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'314","reported_seq":905,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:28.929248+0000","last_change":"2024-09-12T01:22:28.929248+0000","last_active":"2024-09-12T01:22:28.929248+0000","last_peered":"2024-09-12T01:22:28.929248+0000","last_clean":"2024-09-12T01:22:28.929248+0000","last_became_active":"2024-09-12T00:35:49.940679+0000","last_became_peered":"2024-09-12T00:35:49.940679+0000","last_unstale":"2024-09-12T01:22:28.929248+0000","last_undegraded":"2024-09-12T01:22:28.929248+0000","last_fullsized":"2024-09-12T01:22:28.929248+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'314","last_scrub_stamp":"2024-09-12T01:22:28.929055+0000","last_deep_scrub":"265'314","last_deep_scrub_stamp":"2024-09-12T01:22:28.929055+0000","last_clean_scrub_stamp":"2024-09-12T01:22:28.929055+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:39.328379+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52849,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":502,"num_read_kb":1074,"num_write":450,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:35.488571+0000","last_change":"2024-09-12T01:22:35.488571+0000","last_active":"2024-09-12T01:22:35.488571+0000","last_peered":"2024-09-12T01:22:35.488571+0000","last_clean":"2024-09-12T01:22:35.488571+0000","last_became_active":"2024-09-12T00:35:51.977807+0000","last_became_peered":"2024-09-12T00:35:51.977807+0000","last_unstale":"2024-09-12T01:22:35.488571+0000","last_undegraded":"2024-09-12T01:22:35.488571+0000","last_fullsized":"2024-09-12T01:22:35.488571+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:35.488385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:35.488385+0000","last_clean_scrub_stamp":"2024-09-12T01:22:35.488385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:18.337507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'103","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:40.706935+0000","last_change":"2024-09-12T01:22:40.706935+0000","last_active":"2024-09-12T01:22:40.706935+0000","last_peered":"2024-09-12T01:22:40.706935+0000","last_clean":"2024-09-12T01:22:40.706935+0000","last_became_active":"2024-09-12T00:35:54.003115+0000","last_became_peered":"2024-09-12T00:35:54.003115+0000","last_unstale":"2024-09-12T01:22:40.706935+0000","last_undegraded":"2024-09-12T01:22:40.706935+0000","last_fullsized":"2024-09-12T01:22:40.706935+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'103","last_scrub_stamp":"2024-09-12T01:22:40.706706+0000","last_deep_scrub":"265'103","last_deep_scrub_stamp":"2024-09-12T01:22:40.706706+0000","last_clean_scrub_stamp":"2024-09-12T01:22:40.706706+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:58.838187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":131,"num_write":237,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'498","reported_seq":1290,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.028238+0000","last_change":"2024-09-12T01:22:12.027976+0000","last_active":"2024-09-12T01:22:12.028238+0000","last_peered":"2024-09-12T01:22:12.028238+0000","last_clean":"2024-09-12T01:22:12.028238+0000","last_became_active":"2024-09-12T00:35:45.929526+0000","last_became_peered":"2024-09-12T00:35:45.929526+0000","last_unstale":"2024-09-12T01:22:12.028238+0000","last_undegraded":"2024-09-12T01:22:12.028238+0000","last_fullsized":"2024-09-12T01:22:12.028238+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'498","last_scrub_stamp":"2024-09-12T01:22:12.027707+0000","last_deep_scrub":"265'498","last_deep_scrub_stamp":"2024-09-12T01:22:12.027707+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.027707+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:44.755420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2425,"num_read_kb":2075,"num_write":878,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'279","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.151970+0000","last_change":"2024-09-12T01:22:07.151970+0000","last_active":"2024-09-12T01:22:07.151970+0000","last_peered":"2024-09-12T01:22:07.151970+0000","last_clean":"2024-09-12T01:22:07.151970+0000","last_became_active":"2024-09-12T00:35:43.944483+0000","last_became_peered":"2024-09-12T00:35:43.944483+0000","last_unstale":"2024-09-12T01:22:07.151970+0000","last_undegraded":"2024-09-12T01:22:07.151970+0000","last_fullsized":"2024-09-12T01:22:07.151970+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'279","last_scrub_stamp":"2024-09-12T01:22:07.151758+0000","last_deep_scrub":"265'279","last_deep_scrub_stamp":"2024-09-12T01:22:07.151758+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.151758+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:49.773260+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":355,"num_read_kb":347,"num_write":887,"num_write_kb":15629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.223498+0000","last_change":"2024-09-12T01:22:20.223262+0000","last_active":"2024-09-12T01:22:20.223498+0000","last_peered":"2024-09-12T01:22:20.223498+0000","last_clean":"2024-09-12T01:22:20.223498+0000","last_became_active":"2024-09-12T00:35:47.943382+0000","last_became_peered":"2024-09-12T00:35:47.943382+0000","last_unstale":"2024-09-12T01:22:20.223498+0000","last_undegraded":"2024-09-12T01:22:20.223498+0000","last_fullsized":"2024-09-12T01:22:20.223498+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:20.223057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:20.223057+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.223057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:18.669022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'325","reported_seq":914,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:23.351291+0000","last_change":"2024-09-12T01:22:23.351291+0000","last_active":"2024-09-12T01:22:23.351291+0000","last_peered":"2024-09-12T01:22:23.351291+0000","last_clean":"2024-09-12T01:22:23.351291+0000","last_became_active":"2024-09-12T00:35:49.949283+0000","last_became_peered":"2024-09-12T00:35:49.949283+0000","last_unstale":"2024-09-12T01:22:23.351291+0000","last_undegraded":"2024-09-12T01:22:23.351291+0000","last_fullsized":"2024-09-12T01:22:23.351291+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'325","last_scrub_stamp":"2024-09-12T01:22:23.351105+0000","last_deep_scrub":"265'325","last_deep_scrub_stamp":"2024-09-12T01:22:23.351105+0000","last_clean_scrub_stamp":"2024-09-12T01:22:23.351105+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:06.372682+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52286,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":532,"num_read_kb":1204,"num_write":436,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'725","reported_seq":2264,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.400295+0000","last_change":"2024-09-12T01:22:20.400295+0000","last_active":"2024-09-12T01:22:20.400295+0000","last_peered":"2024-09-12T01:22:20.400295+0000","last_clean":"2024-09-12T01:22:20.400295+0000","last_became_active":"2024-09-12T00:35:51.979162+0000","last_became_peered":"2024-09-12T00:35:51.979162+0000","last_unstale":"2024-09-12T01:22:20.400295+0000","last_undegraded":"2024-09-12T01:22:20.400295+0000","last_fullsized":"2024-09-12T01:22:20.400295+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'725","last_scrub_stamp":"2024-09-12T01:22:20.400017+0000","last_deep_scrub":"265'725","last_deep_scrub_stamp":"2024-09-12T01:22:20.400017+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.400017+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:36.962961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'118","reported_seq":614,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:30.283677+0000","last_change":"2024-09-12T01:22:30.283677+0000","last_active":"2024-09-12T01:22:30.283677+0000","last_peered":"2024-09-12T01:22:30.283677+0000","last_clean":"2024-09-12T01:22:30.283677+0000","last_became_active":"2024-09-12T00:35:53.981735+0000","last_became_peered":"2024-09-12T00:35:53.981735+0000","last_unstale":"2024-09-12T01:22:30.283677+0000","last_undegraded":"2024-09-12T01:22:30.283677+0000","last_fullsized":"2024-09-12T01:22:30.283677+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'118","last_scrub_stamp":"2024-09-12T01:22:30.283443+0000","last_deep_scrub":"265'118","last_deep_scrub_stamp":"2024-09-12T01:22:30.283443+0000","last_clean_scrub_stamp":"2024-09-12T01:22:30.283443+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:32.130551+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":92,"num_write":265,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'349","reported_seq":1048,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.978802+0000","last_change":"2024-09-12T01:22:12.978642+0000","last_active":"2024-09-12T01:22:12.978802+0000","last_peered":"2024-09-12T01:22:12.978802+0000","last_clean":"2024-09-12T01:22:12.978802+0000","last_became_active":"2024-09-12T00:35:45.953935+0000","last_became_peered":"2024-09-12T00:35:45.953935+0000","last_unstale":"2024-09-12T01:22:12.978802+0000","last_undegraded":"2024-09-12T01:22:12.978802+0000","last_fullsized":"2024-09-12T01:22:12.978802+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'349","last_scrub_stamp":"2024-09-12T01:22:12.978442+0000","last_deep_scrub":"265'349","last_deep_scrub_stamp":"2024-09-12T01:22:12.978442+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.978442+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:16.697478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1509,"num_read_kb":1228,"num_write":558,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'331","reported_seq":990,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.065472+0000","last_change":"2024-09-12T01:22:05.065472+0000","last_active":"2024-09-12T01:22:05.065472+0000","last_peered":"2024-09-12T01:22:05.065472+0000","last_clean":"2024-09-12T01:22:05.065472+0000","last_became_active":"2024-09-12T00:35:43.929559+0000","last_became_peered":"2024-09-12T00:35:43.929559+0000","last_unstale":"2024-09-12T01:22:05.065472+0000","last_undegraded":"2024-09-12T01:22:05.065472+0000","last_fullsized":"2024-09-12T01:22:05.065472+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'331","last_scrub_stamp":"2024-09-12T01:22:05.065301+0000","last_deep_scrub":"265'331","last_deep_scrub_stamp":"2024-09-12T01:22:05.065301+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.065301+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:54.088835+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2025256,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":451,"num_read_kb":47620,"num_write":929,"num_write_kb":27870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"265'4","reported_seq":1472,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:25.624904+0000","last_change":"2024-09-12T01:22:25.624904+0000","last_active":"2024-09-12T01:22:25.624904+0000","last_peered":"2024-09-12T01:22:25.624904+0000","last_clean":"2024-09-12T01:22:25.624904+0000","last_became_active":"2024-09-12T00:35:47.936026+0000","last_became_peered":"2024-09-12T00:35:47.936026+0000","last_unstale":"2024-09-12T01:22:25.624904+0000","last_undegraded":"2024-09-12T01:22:25.624904+0000","last_fullsized":"2024-09-12T01:22:25.624904+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T01:22:25.624719+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T01:22:25.624719+0000","last_clean_scrub_stamp":"2024-09-12T01:22:25.624719+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:27.524698+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":965,"num_read_kb":965,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'85","reported_seq":608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:30.595229+0000","last_change":"2024-09-12T01:22:30.595229+0000","last_active":"2024-09-12T01:22:30.595229+0000","last_peered":"2024-09-12T01:22:30.595229+0000","last_clean":"2024-09-12T01:22:30.595229+0000","last_became_active":"2024-09-12T00:35:50.027161+0000","last_became_peered":"2024-09-12T00:35:50.027161+0000","last_unstale":"2024-09-12T01:22:30.595229+0000","last_undegraded":"2024-09-12T01:22:30.595229+0000","last_fullsized":"2024-09-12T01:22:30.595229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'85","last_scrub_stamp":"2024-09-12T01:22:30.595013+0000","last_deep_scrub":"265'85","last_deep_scrub_stamp":"2024-09-12T01:22:30.595013+0000","last_clean_scrub_stamp":"2024-09-12T01:22:30.595013+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:04.958322+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'774","reported_seq":6327,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:24.099738+0000","last_change":"2024-09-12T01:22:24.099738+0000","last_active":"2024-09-12T01:22:24.099738+0000","last_peered":"2024-09-12T01:22:24.099738+0000","last_clean":"2024-09-12T01:22:24.099738+0000","last_became_active":"2024-09-12T00:35:51.976947+0000","last_became_peered":"2024-09-12T00:35:51.976947+0000","last_unstale":"2024-09-12T01:22:24.099738+0000","last_undegraded":"2024-09-12T01:22:24.099738+0000","last_fullsized":"2024-09-12T01:22:24.099738+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'774","last_scrub_stamp":"2024-09-12T01:22:24.099561+0000","last_deep_scrub":"265'774","last_deep_scrub_stamp":"2024-09-12T01:22:24.099561+0000","last_clean_scrub_stamp":"2024-09-12T01:22:24.099561+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:55.033935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'157","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:36.943142+0000","last_change":"2024-09-12T01:22:36.943142+0000","last_active":"2024-09-12T01:22:36.943142+0000","last_peered":"2024-09-12T01:22:36.943142+0000","last_clean":"2024-09-12T01:22:36.943142+0000","last_became_active":"2024-09-12T00:35:53.994715+0000","last_became_peered":"2024-09-12T00:35:53.994715+0000","last_unstale":"2024-09-12T01:22:36.943142+0000","last_undegraded":"2024-09-12T01:22:36.943142+0000","last_fullsized":"2024-09-12T01:22:36.943142+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'157","last_scrub_stamp":"2024-09-12T01:22:36.942957+0000","last_deep_scrub":"265'157","last_deep_scrub_stamp":"2024-09-12T01:22:36.942957+0000","last_clean_scrub_stamp":"2024-09-12T01:22:36.942957+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:47.928655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":132,"num_read_kb":125,"num_write":372,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'159","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.435354+0000","last_change":"2024-09-12T01:22:09.435354+0000","last_active":"2024-09-12T01:22:09.435354+0000","last_peered":"2024-09-12T01:22:09.435354+0000","last_clean":"2024-09-12T01:22:09.435354+0000","last_became_active":"2024-09-12T00:36:17.049999+0000","last_became_peered":"2024-09-12T00:36:17.049999+0000","last_unstale":"2024-09-12T01:22:09.435354+0000","last_undegraded":"2024-09-12T01:22:09.435354+0000","last_fullsized":"2024-09-12T01:22:09.435354+0000","mapping_epoch":37,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'159","last_scrub_stamp":"2024-09-12T01:22:09.435171+0000","last_deep_scrub":"265'159","last_deep_scrub_stamp":"2024-09-12T01:22:09.435171+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.435171+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:31.966275+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":667,"num_read_kb":538,"num_write":243,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8078,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"265'365","reported_seq":1124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:04.665974+0000","last_change":"2024-09-12T01:22:04.665974+0000","last_active":"2024-09-12T01:22:04.665974+0000","last_peered":"2024-09-12T01:22:04.665974+0000","last_clean":"2024-09-12T01:22:04.665974+0000","last_became_active":"2024-09-12T00:35:43.931562+0000","last_became_peered":"2024-09-12T00:35:43.931562+0000","last_unstale":"2024-09-12T01:22:04.665974+0000","last_undegraded":"2024-09-12T01:22:04.665974+0000","last_fullsized":"2024-09-12T01:22:04.665974+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T01:22:04.665854+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T01:22:04.665854+0000","last_clean_scrub_stamp":"2024-09-12T01:22:04.665854+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:17.732533+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992276,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":678,"num_read_kb":113913,"num_write":1161,"num_write_kb":34109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:25.865335+0000","last_change":"2024-09-12T01:22:25.865212+0000","last_active":"2024-09-12T01:22:25.865335+0000","last_peered":"2024-09-12T01:22:25.865335+0000","last_clean":"2024-09-12T01:22:25.865335+0000","last_became_active":"2024-09-12T00:35:47.930147+0000","last_became_peered":"2024-09-12T00:35:47.930147+0000","last_unstale":"2024-09-12T01:22:25.865335+0000","last_undegraded":"2024-09-12T01:22:25.865335+0000","last_fullsized":"2024-09-12T01:22:25.865335+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:25.865042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:25.865042+0000","last_clean_scrub_stamp":"2024-09-12T01:22:25.865042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:36.302789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'353","reported_seq":964,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:31.632246+0000","last_change":"2024-09-12T01:22:31.632246+0000","last_active":"2024-09-12T01:22:31.632246+0000","last_peered":"2024-09-12T01:22:31.632246+0000","last_clean":"2024-09-12T01:22:31.632246+0000","last_became_active":"2024-09-12T00:35:49.938597+0000","last_became_peered":"2024-09-12T00:35:49.938597+0000","last_unstale":"2024-09-12T01:22:31.632246+0000","last_undegraded":"2024-09-12T01:22:31.632246+0000","last_fullsized":"2024-09-12T01:22:31.632246+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'353","last_scrub_stamp":"2024-09-12T01:22:31.632135+0000","last_deep_scrub":"265'353","last_deep_scrub_stamp":"2024-09-12T01:22:31.632135+0000","last_clean_scrub_stamp":"2024-09-12T01:22:31.632135+0000","objects_scrubbed":8,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:04.456182+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46738,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":571,"num_read_kb":1203,"num_write":454,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.084666+0000","last_change":"2024-09-12T01:22:22.084666+0000","last_active":"2024-09-12T01:22:22.084666+0000","last_peered":"2024-09-12T01:22:22.084666+0000","last_clean":"2024-09-12T01:22:22.084666+0000","last_became_active":"2024-09-12T00:35:51.967708+0000","last_became_peered":"2024-09-12T00:35:51.967708+0000","last_unstale":"2024-09-12T01:22:22.084666+0000","last_undegraded":"2024-09-12T01:22:22.084666+0000","last_fullsized":"2024-09-12T01:22:22.084666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:22.084485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:22.084485+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.084485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:12.944518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'119","reported_seq":616,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:33.290424+0000","last_change":"2024-09-12T01:22:33.290424+0000","last_active":"2024-09-12T01:22:33.290424+0000","last_peered":"2024-09-12T01:22:33.290424+0000","last_clean":"2024-09-12T01:22:33.290424+0000","last_became_active":"2024-09-12T00:35:53.997893+0000","last_became_peered":"2024-09-12T00:35:53.997893+0000","last_unstale":"2024-09-12T01:22:33.290424+0000","last_undegraded":"2024-09-12T01:22:33.290424+0000","last_fullsized":"2024-09-12T01:22:33.290424+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'119","last_scrub_stamp":"2024-09-12T01:22:33.290100+0000","last_deep_scrub":"265'119","last_deep_scrub_stamp":"2024-09-12T01:22:33.290100+0000","last_clean_scrub_stamp":"2024-09-12T01:22:33.290100+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:58.599965+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":114,"num_write":260,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'95","reported_seq":687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.199979+0000","last_change":"2024-09-12T01:22:13.199979+0000","last_active":"2024-09-12T01:22:13.199979+0000","last_peered":"2024-09-12T01:22:13.199979+0000","last_clean":"2024-09-12T01:22:13.199979+0000","last_became_active":"2024-09-12T00:35:45.941291+0000","last_became_peered":"2024-09-12T00:35:45.941291+0000","last_unstale":"2024-09-12T01:22:13.199979+0000","last_undegraded":"2024-09-12T01:22:13.199979+0000","last_fullsized":"2024-09-12T01:22:13.199979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'95","last_scrub_stamp":"2024-09-12T01:22:13.199797+0000","last_deep_scrub":"265'95","last_deep_scrub_stamp":"2024-09-12T01:22:13.199797+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.199797+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:29.571782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":459,"num_read_kb":386,"num_write":145,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":621,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.470742+0000","last_change":"2024-09-12T01:22:05.470742+0000","last_active":"2024-09-12T01:22:05.470742+0000","last_peered":"2024-09-12T01:22:05.470742+0000","last_clean":"2024-09-12T01:22:05.470742+0000","last_became_active":"2024-09-12T00:35:25.096843+0000","last_became_peered":"2024-09-12T00:35:25.096843+0000","last_unstale":"2024-09-12T01:22:05.470742+0000","last_undegraded":"2024-09-12T01:22:05.470742+0000","last_fullsized":"2024-09-12T01:22:05.470742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-12T01:22:05.470506+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-12T01:22:05.470506+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.470506+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:45.363711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.800395+0000","last_change":"2024-09-12T01:22:09.800395+0000","last_active":"2024-09-12T01:22:09.800395+0000","last_peered":"2024-09-12T01:22:09.800395+0000","last_clean":"2024-09-12T01:22:09.800395+0000","last_became_active":"2024-09-12T00:35:29.668145+0000","last_became_peered":"2024-09-12T00:35:29.668145+0000","last_unstale":"2024-09-12T01:22:09.800395+0000","last_undegraded":"2024-09-12T01:22:09.800395+0000","last_fullsized":"2024-09-12T01:22:09.800395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:09.800200+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:09.800200+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.800200+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:15.267436+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0011070749999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'322","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:03.609476+0000","last_change":"2024-09-12T01:22:03.609476+0000","last_active":"2024-09-12T01:22:03.609476+0000","last_peered":"2024-09-12T01:22:03.609476+0000","last_clean":"2024-09-12T01:22:03.609476+0000","last_became_active":"2024-09-12T00:35:43.916969+0000","last_became_peered":"2024-09-12T00:35:43.916969+0000","last_unstale":"2024-09-12T01:22:03.609476+0000","last_undegraded":"2024-09-12T01:22:03.609476+0000","last_fullsized":"2024-09-12T01:22:03.609476+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T01:22:03.609346+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T01:22:03.609346+0000","last_clean_scrub_stamp":"2024-09-12T01:22:03.609346+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:29.571575+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568993,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":119474,"num_write":1014,"num_write_kb":17296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.373693+0000","last_change":"2024-09-12T01:22:22.373693+0000","last_active":"2024-09-12T01:22:22.373693+0000","last_peered":"2024-09-12T01:22:22.373693+0000","last_clean":"2024-09-12T01:22:22.373693+0000","last_became_active":"2024-09-12T00:35:47.942643+0000","last_became_peered":"2024-09-12T00:35:47.942643+0000","last_unstale":"2024-09-12T01:22:22.373693+0000","last_undegraded":"2024-09-12T01:22:22.373693+0000","last_fullsized":"2024-09-12T01:22:22.373693+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:22.373489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:22.373489+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.373489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:26.791309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'703","reported_seq":1418,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:29.671617+0000","last_change":"2024-09-12T01:22:29.671617+0000","last_active":"2024-09-12T01:22:29.671617+0000","last_peered":"2024-09-12T01:22:29.671617+0000","last_clean":"2024-09-12T01:22:29.671617+0000","last_became_active":"2024-09-12T00:35:49.957694+0000","last_became_peered":"2024-09-12T00:35:49.957694+0000","last_unstale":"2024-09-12T01:22:29.671617+0000","last_undegraded":"2024-09-12T01:22:29.671617+0000","last_fullsized":"2024-09-12T01:22:29.671617+0000","mapping_epoch":30,"log_start":"265'600","ondisk_log_start":"265'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'703","last_scrub_stamp":"2024-09-12T01:22:29.671389+0000","last_deep_scrub":"265'703","last_deep_scrub_stamp":"2024-09-12T01:22:29.671389+0000","last_clean_scrub_stamp":"2024-09-12T01:22:29.671389+0000","objects_scrubbed":7,"log_size":103,"log_dups_size":600,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:45.223736+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144071,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1382,"num_read_kb":3079,"num_write":1308,"num_write_kb":1154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":107698,"num_omap_keys":260,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:31.484104+0000","last_change":"2024-09-12T01:22:31.484104+0000","last_active":"2024-09-12T01:22:31.484104+0000","last_peered":"2024-09-12T01:22:31.484104+0000","last_clean":"2024-09-12T01:22:31.484104+0000","last_became_active":"2024-09-12T00:35:51.977282+0000","last_became_peered":"2024-09-12T00:35:51.977282+0000","last_unstale":"2024-09-12T01:22:31.484104+0000","last_undegraded":"2024-09-12T01:22:31.484104+0000","last_fullsized":"2024-09-12T01:22:31.484104+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:31.483918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:31.483918+0000","last_clean_scrub_stamp":"2024-09-12T01:22:31.483918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:49.029998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'208","reported_seq":925,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:28.107049+0000","last_change":"2024-09-12T01:22:28.107049+0000","last_active":"2024-09-12T01:22:28.107049+0000","last_peered":"2024-09-12T01:22:28.107049+0000","last_clean":"2024-09-12T01:22:28.107049+0000","last_became_active":"2024-09-12T00:35:53.997354+0000","last_became_peered":"2024-09-12T00:35:53.997354+0000","last_unstale":"2024-09-12T01:22:28.107049+0000","last_undegraded":"2024-09-12T01:22:28.107049+0000","last_fullsized":"2024-09-12T01:22:28.107049+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'208","last_scrub_stamp":"2024-09-12T01:22:28.106812+0000","last_deep_scrub":"265'208","last_deep_scrub_stamp":"2024-09-12T01:22:28.106812+0000","last_clean_scrub_stamp":"2024-09-12T01:22:28.106812+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:03.140844+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":471,"num_write":454,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'239","reported_seq":905,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.549409+0000","last_change":"2024-09-12T01:22:11.549409+0000","last_active":"2024-09-12T01:22:11.549409+0000","last_peered":"2024-09-12T01:22:11.549409+0000","last_clean":"2024-09-12T01:22:11.549409+0000","last_became_active":"2024-09-12T00:35:45.945766+0000","last_became_peered":"2024-09-12T00:35:45.945766+0000","last_unstale":"2024-09-12T01:22:11.549409+0000","last_undegraded":"2024-09-12T01:22:11.549409+0000","last_fullsized":"2024-09-12T01:22:11.549409+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'239","last_scrub_stamp":"2024-09-12T01:22:11.549218+0000","last_deep_scrub":"265'239","last_deep_scrub_stamp":"2024-09-12T01:22:11.549218+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.549218+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:53.581793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1032,"num_read_kb":857,"num_write":339,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.466487+0000","last_change":"2024-09-12T01:22:06.466487+0000","last_active":"2024-09-12T01:22:06.466487+0000","last_peered":"2024-09-12T01:22:06.466487+0000","last_clean":"2024-09-12T01:22:06.466487+0000","last_became_active":"2024-09-12T00:35:29.671287+0000","last_became_peered":"2024-09-12T00:35:29.671287+0000","last_unstale":"2024-09-12T01:22:06.466487+0000","last_undegraded":"2024-09-12T01:22:06.466487+0000","last_fullsized":"2024-09-12T01:22:06.466487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:06.466276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:06.466276+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.466276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:01.838180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075002000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'404","reported_seq":1121,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:03.716502+0000","last_change":"2024-09-12T01:22:03.716502+0000","last_active":"2024-09-12T01:22:03.716502+0000","last_peered":"2024-09-12T01:22:03.716502+0000","last_clean":"2024-09-12T01:22:03.716502+0000","last_became_active":"2024-09-12T00:35:43.945335+0000","last_became_peered":"2024-09-12T00:35:43.945335+0000","last_unstale":"2024-09-12T01:22:03.716502+0000","last_undegraded":"2024-09-12T01:22:03.716502+0000","last_fullsized":"2024-09-12T01:22:03.716502+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'404","last_scrub_stamp":"2024-09-12T01:22:03.716386+0000","last_deep_scrub":"265'404","last_deep_scrub_stamp":"2024-09-12T01:22:03.716386+0000","last_clean_scrub_stamp":"2024-09-12T01:22:03.716386+0000","objects_scrubbed":7,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:53.096747+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":682,"num_read_kb":63013,"num_write":1485,"num_write_kb":40970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:24.648574+0000","last_change":"2024-09-12T01:22:24.648574+0000","last_active":"2024-09-12T01:22:24.648574+0000","last_peered":"2024-09-12T01:22:24.648574+0000","last_clean":"2024-09-12T01:22:24.648574+0000","last_became_active":"2024-09-12T00:35:47.925704+0000","last_became_peered":"2024-09-12T00:35:47.925704+0000","last_unstale":"2024-09-12T01:22:24.648574+0000","last_undegraded":"2024-09-12T01:22:24.648574+0000","last_fullsized":"2024-09-12T01:22:24.648574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:24.648314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:24.648314+0000","last_clean_scrub_stamp":"2024-09-12T01:22:24.648314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:34.513335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1270","reported_seq":2773,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:23.233400+0000","last_change":"2024-09-12T01:22:23.233400+0000","last_active":"2024-09-12T01:22:23.233400+0000","last_peered":"2024-09-12T01:22:23.233400+0000","last_clean":"2024-09-12T01:22:23.233400+0000","last_became_active":"2024-09-12T00:35:49.947643+0000","last_became_peered":"2024-09-12T00:35:49.947643+0000","last_unstale":"2024-09-12T01:22:23.233400+0000","last_undegraded":"2024-09-12T01:22:23.233400+0000","last_fullsized":"2024-09-12T01:22:23.233400+0000","mapping_epoch":30,"log_start":"265'1200","ondisk_log_start":"265'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1270","last_scrub_stamp":"2024-09-12T01:22:23.233211+0000","last_deep_scrub":"265'1270","last_deep_scrub_stamp":"2024-09-12T01:22:23.233211+0000","last_clean_scrub_stamp":"2024-09-12T01:22:23.233211+0000","objects_scrubbed":12,"log_size":70,"log_dups_size":1200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:51.857102+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144243,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2043,"num_read_kb":3859,"num_write":1128,"num_write_kb":966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:33.403165+0000","last_change":"2024-09-12T01:22:33.403165+0000","last_active":"2024-09-12T01:22:33.403165+0000","last_peered":"2024-09-12T01:22:33.403165+0000","last_clean":"2024-09-12T01:22:33.403165+0000","last_became_active":"2024-09-12T00:35:51.981240+0000","last_became_peered":"2024-09-12T00:35:51.981240+0000","last_unstale":"2024-09-12T01:22:33.403165+0000","last_undegraded":"2024-09-12T01:22:33.403165+0000","last_fullsized":"2024-09-12T01:22:33.403165+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:33.402987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:33.402987+0000","last_clean_scrub_stamp":"2024-09-12T01:22:33.402987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:18.450569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'137","reported_seq":653,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:36.253508+0000","last_change":"2024-09-12T01:22:36.253508+0000","last_active":"2024-09-12T01:22:36.253508+0000","last_peered":"2024-09-12T01:22:36.253508+0000","last_clean":"2024-09-12T01:22:36.253508+0000","last_became_active":"2024-09-12T00:35:54.013658+0000","last_became_peered":"2024-09-12T00:35:54.013658+0000","last_unstale":"2024-09-12T01:22:36.253508+0000","last_undegraded":"2024-09-12T01:22:36.253508+0000","last_fullsized":"2024-09-12T01:22:36.253508+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'137","last_scrub_stamp":"2024-09-12T01:22:36.253219+0000","last_deep_scrub":"265'137","last_deep_scrub_stamp":"2024-09-12T01:22:36.253219+0000","last_clean_scrub_stamp":"2024-09-12T01:22:36.253219+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:39.667502+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":184,"num_read_kb":167,"num_write":336,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'142","reported_seq":780,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.143929+0000","last_change":"2024-09-12T01:22:13.143929+0000","last_active":"2024-09-12T01:22:13.143929+0000","last_peered":"2024-09-12T01:22:13.143929+0000","last_clean":"2024-09-12T01:22:13.143929+0000","last_became_active":"2024-09-12T00:35:45.929073+0000","last_became_peered":"2024-09-12T00:35:45.929073+0000","last_unstale":"2024-09-12T01:22:13.143929+0000","last_undegraded":"2024-09-12T01:22:13.143929+0000","last_fullsized":"2024-09-12T01:22:13.143929+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'142","last_scrub_stamp":"2024-09-12T01:22:13.143744+0000","last_deep_scrub":"265'142","last_deep_scrub_stamp":"2024-09-12T01:22:13.143744+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.143744+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:36.562063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":635,"num_read_kb":540,"num_write":217,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:03.482812+0000","last_change":"2024-09-12T01:22:03.482812+0000","last_active":"2024-09-12T01:22:03.482812+0000","last_peered":"2024-09-12T01:22:03.482812+0000","last_clean":"2024-09-12T01:22:03.482812+0000","last_became_active":"2024-09-12T00:35:29.699432+0000","last_became_peered":"2024-09-12T00:35:29.699432+0000","last_unstale":"2024-09-12T01:22:03.482812+0000","last_undegraded":"2024-09-12T01:22:03.482812+0000","last_fullsized":"2024-09-12T01:22:03.482812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:03.482726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:03.482726+0000","last_clean_scrub_stamp":"2024-09-12T01:22:03.482726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:09.949801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099979400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'347","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.188799+0000","last_change":"2024-09-12T01:22:05.188799+0000","last_active":"2024-09-12T01:22:05.188799+0000","last_peered":"2024-09-12T01:22:05.188799+0000","last_clean":"2024-09-12T01:22:05.188799+0000","last_became_active":"2024-09-12T00:35:43.928667+0000","last_became_peered":"2024-09-12T00:35:43.928667+0000","last_unstale":"2024-09-12T01:22:05.188799+0000","last_undegraded":"2024-09-12T01:22:05.188799+0000","last_fullsized":"2024-09-12T01:22:05.188799+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T01:22:05.188675+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T01:22:05.188675+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.188675+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:11.123392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174664,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":503,"num_read_kb":16533,"num_write":1052,"num_write_kb":18962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"265'2","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.378468+0000","last_change":"2024-09-12T01:22:22.378468+0000","last_active":"2024-09-12T01:22:22.378468+0000","last_peered":"2024-09-12T01:22:22.378468+0000","last_clean":"2024-09-12T01:22:22.378468+0000","last_became_active":"2024-09-12T00:35:47.944385+0000","last_became_peered":"2024-09-12T00:35:47.944385+0000","last_unstale":"2024-09-12T01:22:22.378468+0000","last_undegraded":"2024-09-12T01:22:22.378468+0000","last_fullsized":"2024-09-12T01:22:22.378468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:22.378275+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:22.378275+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.378275+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:11.673153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'235","reported_seq":1338,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:27.344418+0000","last_change":"2024-09-12T01:22:27.344418+0000","last_active":"2024-09-12T01:22:27.344418+0000","last_peered":"2024-09-12T01:22:27.344418+0000","last_clean":"2024-09-12T01:22:27.344418+0000","last_became_active":"2024-09-12T00:35:50.025610+0000","last_became_peered":"2024-09-12T00:35:50.025610+0000","last_unstale":"2024-09-12T01:22:27.344418+0000","last_undegraded":"2024-09-12T01:22:27.344418+0000","last_fullsized":"2024-09-12T01:22:27.344418+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'235","last_scrub_stamp":"2024-09-12T01:22:27.344190+0000","last_deep_scrub":"265'235","last_deep_scrub_stamp":"2024-09-12T01:22:27.344190+0000","last_clean_scrub_stamp":"2024-09-12T01:22:27.344190+0000","objects_scrubbed":9,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:09.545564+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":183,"num_read_kb":174,"num_write":155,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:29.469905+0000","last_change":"2024-09-12T01:22:29.469905+0000","last_active":"2024-09-12T01:22:29.469905+0000","last_peered":"2024-09-12T01:22:29.469905+0000","last_clean":"2024-09-12T01:22:29.469905+0000","last_became_active":"2024-09-12T00:35:51.973593+0000","last_became_peered":"2024-09-12T00:35:51.973593+0000","last_unstale":"2024-09-12T01:22:29.469905+0000","last_undegraded":"2024-09-12T01:22:29.469905+0000","last_fullsized":"2024-09-12T01:22:29.469905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:29.469717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:29.469717+0000","last_clean_scrub_stamp":"2024-09-12T01:22:29.469717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:49.513054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'275","reported_seq":886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:41.719874+0000","last_change":"2024-09-12T01:22:41.719874+0000","last_active":"2024-09-12T01:22:41.719874+0000","last_peered":"2024-09-12T01:22:41.719874+0000","last_clean":"2024-09-12T01:22:41.719874+0000","last_became_active":"2024-09-12T00:35:53.994828+0000","last_became_peered":"2024-09-12T00:35:53.994828+0000","last_unstale":"2024-09-12T01:22:41.719874+0000","last_undegraded":"2024-09-12T01:22:41.719874+0000","last_fullsized":"2024-09-12T01:22:41.719874+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'275","last_scrub_stamp":"2024-09-12T01:22:41.719695+0000","last_deep_scrub":"265'275","last_deep_scrub_stamp":"2024-09-12T01:22:41.719695+0000","last_clean_scrub_stamp":"2024-09-12T01:22:41.719695+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:43.529849+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":532,"num_read_kb":546,"num_write":608,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'101","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.159831+0000","last_change":"2024-09-12T01:22:12.159831+0000","last_active":"2024-09-12T01:22:12.159831+0000","last_peered":"2024-09-12T01:22:12.159831+0000","last_clean":"2024-09-12T01:22:12.159831+0000","last_became_active":"2024-09-12T00:35:45.932642+0000","last_became_peered":"2024-09-12T00:35:45.932642+0000","last_unstale":"2024-09-12T01:22:12.159831+0000","last_undegraded":"2024-09-12T01:22:12.159831+0000","last_fullsized":"2024-09-12T01:22:12.159831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'101","last_scrub_stamp":"2024-09-12T01:22:12.159645+0000","last_deep_scrub":"265'101","last_deep_scrub_stamp":"2024-09-12T01:22:12.159645+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.159645+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:07.949915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":466,"num_read_kb":396,"num_write":153,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:04.843329+0000","last_change":"2024-09-12T01:22:04.843329+0000","last_active":"2024-09-12T01:22:04.843329+0000","last_peered":"2024-09-12T01:22:04.843329+0000","last_clean":"2024-09-12T01:22:04.843329+0000","last_became_active":"2024-09-12T00:35:29.664963+0000","last_became_peered":"2024-09-12T00:35:29.664963+0000","last_unstale":"2024-09-12T01:22:04.843329+0000","last_undegraded":"2024-09-12T01:22:04.843329+0000","last_fullsized":"2024-09-12T01:22:04.843329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:22:04.843146+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:22:04.843146+0000","last_clean_scrub_stamp":"2024-09-12T01:22:04.843146+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:56.597168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0020842569999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'294","reported_seq":972,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:04.048022+0000","last_change":"2024-09-12T01:22:04.048022+0000","last_active":"2024-09-12T01:22:04.048022+0000","last_peered":"2024-09-12T01:22:04.048022+0000","last_clean":"2024-09-12T01:22:04.048022+0000","last_became_active":"2024-09-12T00:35:43.930731+0000","last_became_peered":"2024-09-12T00:35:43.930731+0000","last_unstale":"2024-09-12T01:22:04.048022+0000","last_undegraded":"2024-09-12T01:22:04.048022+0000","last_fullsized":"2024-09-12T01:22:04.048022+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'294","last_scrub_stamp":"2024-09-12T01:22:04.047797+0000","last_deep_scrub":"265'294","last_deep_scrub_stamp":"2024-09-12T01:22:04.047797+0000","last_clean_scrub_stamp":"2024-09-12T01:22:04.047797+0000","objects_scrubbed":5,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:39.342877+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":688153,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":45060,"num_write":1094,"num_write_kb":33877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.462404+0000","last_change":"2024-09-12T01:22:21.462404+0000","last_active":"2024-09-12T01:22:21.462404+0000","last_peered":"2024-09-12T01:22:21.462404+0000","last_clean":"2024-09-12T01:22:21.462404+0000","last_became_active":"2024-09-12T00:35:47.939055+0000","last_became_peered":"2024-09-12T00:35:47.939055+0000","last_unstale":"2024-09-12T01:22:21.462404+0000","last_undegraded":"2024-09-12T01:22:21.462404+0000","last_fullsized":"2024-09-12T01:22:21.462404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:21.462198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:21.462198+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.462198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:09.095594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'124","reported_seq":669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:28.563444+0000","last_change":"2024-09-12T01:22:28.563444+0000","last_active":"2024-09-12T01:22:28.563444+0000","last_peered":"2024-09-12T01:22:28.563444+0000","last_clean":"2024-09-12T01:22:28.563444+0000","last_became_active":"2024-09-12T00:35:49.948258+0000","last_became_peered":"2024-09-12T00:35:49.948258+0000","last_unstale":"2024-09-12T01:22:28.563444+0000","last_undegraded":"2024-09-12T01:22:28.563444+0000","last_fullsized":"2024-09-12T01:22:28.563444+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'124","last_scrub_stamp":"2024-09-12T01:22:28.563234+0000","last_deep_scrub":"265'124","last_deep_scrub_stamp":"2024-09-12T01:22:28.563234+0000","last_clean_scrub_stamp":"2024-09-12T01:22:28.563234+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:25.266630+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3226,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.048163+0000","last_change":"2024-09-12T01:22:21.048163+0000","last_active":"2024-09-12T01:22:21.048163+0000","last_peered":"2024-09-12T01:22:21.048163+0000","last_clean":"2024-09-12T01:22:21.048163+0000","last_became_active":"2024-09-12T00:35:51.974302+0000","last_became_peered":"2024-09-12T00:35:51.974302+0000","last_unstale":"2024-09-12T01:22:21.048163+0000","last_undegraded":"2024-09-12T01:22:21.048163+0000","last_fullsized":"2024-09-12T01:22:21.048163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:21.047984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:21.047984+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.047984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:34.374068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'144","reported_seq":715,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:36.547164+0000","last_change":"2024-09-12T01:22:36.547164+0000","last_active":"2024-09-12T01:22:36.547164+0000","last_peered":"2024-09-12T01:22:36.547164+0000","last_clean":"2024-09-12T01:22:36.547164+0000","last_became_active":"2024-09-12T00:35:53.995254+0000","last_became_peered":"2024-09-12T00:35:53.995254+0000","last_unstale":"2024-09-12T01:22:36.547164+0000","last_undegraded":"2024-09-12T01:22:36.547164+0000","last_fullsized":"2024-09-12T01:22:36.547164+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'144","last_scrub_stamp":"2024-09-12T01:22:36.546872+0000","last_deep_scrub":"265'144","last_deep_scrub_stamp":"2024-09-12T01:22:36.546872+0000","last_clean_scrub_stamp":"2024-09-12T01:22:36.546872+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:16.036809+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1272,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":285,"num_read_kb":262,"num_write":355,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'53","reported_seq":599,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.173036+0000","last_change":"2024-09-12T01:22:11.173036+0000","last_active":"2024-09-12T01:22:11.173036+0000","last_peered":"2024-09-12T01:22:11.173036+0000","last_clean":"2024-09-12T01:22:11.173036+0000","last_became_active":"2024-09-12T00:35:45.936061+0000","last_became_peered":"2024-09-12T00:35:45.936061+0000","last_unstale":"2024-09-12T01:22:11.173036+0000","last_undegraded":"2024-09-12T01:22:11.173036+0000","last_fullsized":"2024-09-12T01:22:11.173036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'53","last_scrub_stamp":"2024-09-12T01:22:11.172855+0000","last_deep_scrub":"265'53","last_deep_scrub_stamp":"2024-09-12T01:22:11.172855+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.172855+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:11.840647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":179,"num_write":83,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"265'358","reported_seq":1020,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.848155+0000","last_change":"2024-09-12T01:22:05.848155+0000","last_active":"2024-09-12T01:22:05.848155+0000","last_peered":"2024-09-12T01:22:05.848155+0000","last_clean":"2024-09-12T01:22:05.848155+0000","last_became_active":"2024-09-12T00:36:17.051542+0000","last_became_peered":"2024-09-12T00:36:17.051542+0000","last_unstale":"2024-09-12T01:22:05.848155+0000","last_undegraded":"2024-09-12T01:22:05.848155+0000","last_fullsized":"2024-09-12T01:22:05.848155+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T01:22:05.847893+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T01:22:05.847893+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.847893+0000","objects_scrubbed":9,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:51.384435+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730210,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":479,"num_read_kb":44411,"num_write":1031,"num_write_kb":33814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:03.236128+0000","last_change":"2024-09-12T01:22:03.236128+0000","last_active":"2024-09-12T01:22:03.236128+0000","last_peered":"2024-09-12T01:22:03.236128+0000","last_clean":"2024-09-12T01:22:03.236128+0000","last_became_active":"2024-09-12T00:35:29.700869+0000","last_became_peered":"2024-09-12T00:35:29.700869+0000","last_unstale":"2024-09-12T01:22:03.236128+0000","last_undegraded":"2024-09-12T01:22:03.236128+0000","last_fullsized":"2024-09-12T01:22:03.236128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:03.235936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:03.235936+0000","last_clean_scrub_stamp":"2024-09-12T01:22:03.235936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:19.598037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00099003299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"265'6","reported_seq":988,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.474373+0000","last_change":"2024-09-12T01:22:18.474373+0000","last_active":"2024-09-12T01:22:18.474373+0000","last_peered":"2024-09-12T01:22:18.474373+0000","last_clean":"2024-09-12T01:22:18.474373+0000","last_became_active":"2024-09-12T00:35:47.946690+0000","last_became_peered":"2024-09-12T00:35:47.946690+0000","last_unstale":"2024-09-12T01:22:18.474373+0000","last_undegraded":"2024-09-12T01:22:18.474373+0000","last_fullsized":"2024-09-12T01:22:18.474373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:22:18.474192+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:22:18.474192+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.474192+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:24.840674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'579","reported_seq":1257,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:23.516688+0000","last_change":"2024-09-12T01:22:23.516688+0000","last_active":"2024-09-12T01:22:23.516688+0000","last_peered":"2024-09-12T01:22:23.516688+0000","last_clean":"2024-09-12T01:22:23.516688+0000","last_became_active":"2024-09-12T00:35:49.948095+0000","last_became_peered":"2024-09-12T00:35:49.948095+0000","last_unstale":"2024-09-12T01:22:23.516688+0000","last_undegraded":"2024-09-12T01:22:23.516688+0000","last_fullsized":"2024-09-12T01:22:23.516688+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'579","last_scrub_stamp":"2024-09-12T01:22:23.516444+0000","last_deep_scrub":"265'579","last_deep_scrub_stamp":"2024-09-12T01:22:23.516444+0000","last_clean_scrub_stamp":"2024-09-12T01:22:23.516444+0000","objects_scrubbed":11,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:57.103924+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93682,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1577,"num_read_kb":2692,"num_write":2050,"num_write_kb":1874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506876,"num_omap_keys":1146,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:33.956023+0000","last_change":"2024-09-12T01:22:33.956023+0000","last_active":"2024-09-12T01:22:33.956023+0000","last_peered":"2024-09-12T01:22:33.956023+0000","last_clean":"2024-09-12T01:22:33.956023+0000","last_became_active":"2024-09-12T00:35:51.967708+0000","last_became_peered":"2024-09-12T00:35:51.967708+0000","last_unstale":"2024-09-12T01:22:33.956023+0000","last_undegraded":"2024-09-12T01:22:33.956023+0000","last_fullsized":"2024-09-12T01:22:33.956023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:33.955853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:33.955853+0000","last_clean_scrub_stamp":"2024-09-12T01:22:33.955853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:22.354853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'151","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:41.353982+0000","last_change":"2024-09-12T01:22:41.353982+0000","last_active":"2024-09-12T01:22:41.353982+0000","last_peered":"2024-09-12T01:22:41.353982+0000","last_clean":"2024-09-12T01:22:41.353982+0000","last_became_active":"2024-09-12T00:35:54.014321+0000","last_became_peered":"2024-09-12T00:35:54.014321+0000","last_unstale":"2024-09-12T01:22:41.353982+0000","last_undegraded":"2024-09-12T01:22:41.353982+0000","last_fullsized":"2024-09-12T01:22:41.353982+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'151","last_scrub_stamp":"2024-09-12T01:22:41.353793+0000","last_deep_scrub":"265'151","last_deep_scrub_stamp":"2024-09-12T01:22:41.353793+0000","last_clean_scrub_stamp":"2024-09-12T01:22:41.353793+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:58.356575+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":134,"num_write":336,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'165","reported_seq":795,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.492877+0000","last_change":"2024-09-12T01:22:13.492877+0000","last_active":"2024-09-12T01:22:13.492877+0000","last_peered":"2024-09-12T01:22:13.492877+0000","last_clean":"2024-09-12T01:22:13.492877+0000","last_became_active":"2024-09-12T00:35:45.936178+0000","last_became_peered":"2024-09-12T00:35:45.936178+0000","last_unstale":"2024-09-12T01:22:13.492877+0000","last_undegraded":"2024-09-12T01:22:13.492877+0000","last_fullsized":"2024-09-12T01:22:13.492877+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'165","last_scrub_stamp":"2024-09-12T01:22:13.492696+0000","last_deep_scrub":"265'165","last_deep_scrub_stamp":"2024-09-12T01:22:13.492696+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.492696+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:10.154787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":595,"num_write":226,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'368","reported_seq":1010,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.263121+0000","last_change":"2024-09-12T01:22:07.263121+0000","last_active":"2024-09-12T01:22:07.263121+0000","last_peered":"2024-09-12T01:22:07.263121+0000","last_clean":"2024-09-12T01:22:07.263121+0000","last_became_active":"2024-09-12T00:35:43.928834+0000","last_became_peered":"2024-09-12T00:35:43.928834+0000","last_unstale":"2024-09-12T01:22:07.263121+0000","last_undegraded":"2024-09-12T01:22:07.263121+0000","last_fullsized":"2024-09-12T01:22:07.263121+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'368","last_scrub_stamp":"2024-09-12T01:22:07.262920+0000","last_deep_scrub":"265'368","last_deep_scrub_stamp":"2024-09-12T01:22:07.262920+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.262920+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:21.291964+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262157,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":503,"num_read_kb":29317,"num_write":1237,"num_write_kb":48953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.474150+0000","last_change":"2024-09-12T01:22:07.474150+0000","last_active":"2024-09-12T01:22:07.474150+0000","last_peered":"2024-09-12T01:22:07.474150+0000","last_clean":"2024-09-12T01:22:07.474150+0000","last_became_active":"2024-09-12T00:35:29.697973+0000","last_became_peered":"2024-09-12T00:35:29.697973+0000","last_unstale":"2024-09-12T01:22:07.474150+0000","last_undegraded":"2024-09-12T01:22:07.474150+0000","last_fullsized":"2024-09-12T01:22:07.474150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:07.473953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:07.473953+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.473953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:28.515287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083354399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.108138+0000","last_change":"2024-09-12T01:22:16.108138+0000","last_active":"2024-09-12T01:22:16.108138+0000","last_peered":"2024-09-12T01:22:16.108138+0000","last_clean":"2024-09-12T01:22:16.108138+0000","last_became_active":"2024-09-12T00:35:47.940014+0000","last_became_peered":"2024-09-12T00:35:47.940014+0000","last_unstale":"2024-09-12T01:22:16.108138+0000","last_undegraded":"2024-09-12T01:22:16.108138+0000","last_fullsized":"2024-09-12T01:22:16.108138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:16.107962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:16.107962+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.107962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:31.152033+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'194","reported_seq":766,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:24.261102+0000","last_change":"2024-09-12T01:22:24.261102+0000","last_active":"2024-09-12T01:22:24.261102+0000","last_peered":"2024-09-12T01:22:24.261102+0000","last_clean":"2024-09-12T01:22:24.261102+0000","last_became_active":"2024-09-12T00:35:50.028173+0000","last_became_peered":"2024-09-12T00:35:50.028173+0000","last_unstale":"2024-09-12T01:22:24.261102+0000","last_undegraded":"2024-09-12T01:22:24.261102+0000","last_fullsized":"2024-09-12T01:22:24.261102+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'194","last_scrub_stamp":"2024-09-12T01:22:24.260921+0000","last_deep_scrub":"265'194","last_deep_scrub_stamp":"2024-09-12T01:22:24.260921+0000","last_clean_scrub_stamp":"2024-09-12T01:22:24.260921+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:12.858541+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":223,"num_read_kb":207,"num_write":158,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'792","reported_seq":2688,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:33.634447+0000","last_change":"2024-09-12T01:22:33.634447+0000","last_active":"2024-09-12T01:22:33.634447+0000","last_peered":"2024-09-12T01:22:33.634447+0000","last_clean":"2024-09-12T01:22:33.634447+0000","last_became_active":"2024-09-12T00:35:51.977203+0000","last_became_peered":"2024-09-12T00:35:51.977203+0000","last_unstale":"2024-09-12T01:22:33.634447+0000","last_undegraded":"2024-09-12T01:22:33.634447+0000","last_fullsized":"2024-09-12T01:22:33.634447+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'792","last_scrub_stamp":"2024-09-12T01:22:33.634257+0000","last_deep_scrub":"265'792","last_deep_scrub_stamp":"2024-09-12T01:22:33.634257+0000","last_clean_scrub_stamp":"2024-09-12T01:22:33.634257+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:23.055471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'115","reported_seq":621,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:42.704003+0000","last_change":"2024-09-12T01:22:42.704003+0000","last_active":"2024-09-12T01:22:42.704003+0000","last_peered":"2024-09-12T01:22:42.704003+0000","last_clean":"2024-09-12T01:22:42.704003+0000","last_became_active":"2024-09-12T00:35:54.014699+0000","last_became_peered":"2024-09-12T00:35:54.014699+0000","last_unstale":"2024-09-12T01:22:42.704003+0000","last_undegraded":"2024-09-12T01:22:42.704003+0000","last_fullsized":"2024-09-12T01:22:42.704003+0000","mapping_epoch":34,"log_start":"265'101","ondisk_log_start":"265'101","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'115","last_scrub_stamp":"2024-09-12T01:22:42.703797+0000","last_deep_scrub":"265'115","last_deep_scrub_stamp":"2024-09-12T01:22:42.703797+0000","last_clean_scrub_stamp":"2024-09-12T01:22:42.703797+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":101,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:20.247818+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1113,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":127,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'102","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.632609+0000","last_change":"2024-09-12T01:22:13.632609+0000","last_active":"2024-09-12T01:22:13.632609+0000","last_peered":"2024-09-12T01:22:13.632609+0000","last_clean":"2024-09-12T01:22:13.632609+0000","last_became_active":"2024-09-12T00:35:45.942032+0000","last_became_peered":"2024-09-12T00:35:45.942032+0000","last_unstale":"2024-09-12T01:22:13.632609+0000","last_undegraded":"2024-09-12T01:22:13.632609+0000","last_fullsized":"2024-09-12T01:22:13.632609+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'102","last_scrub_stamp":"2024-09-12T01:22:13.632428+0000","last_deep_scrub":"265'102","last_deep_scrub_stamp":"2024-09-12T01:22:13.632428+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.632428+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:15.552919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":475,"num_read_kb":403,"num_write":145,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'328","reported_seq":956,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.648628+0000","last_change":"2024-09-12T01:22:06.648628+0000","last_active":"2024-09-12T01:22:06.648628+0000","last_peered":"2024-09-12T01:22:06.648628+0000","last_clean":"2024-09-12T01:22:06.648628+0000","last_became_active":"2024-09-12T00:35:43.953619+0000","last_became_peered":"2024-09-12T00:35:43.953619+0000","last_unstale":"2024-09-12T01:22:06.648628+0000","last_undegraded":"2024-09-12T01:22:06.648628+0000","last_fullsized":"2024-09-12T01:22:06.648628+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'328","last_scrub_stamp":"2024-09-12T01:22:06.648414+0000","last_deep_scrub":"265'328","last_deep_scrub_stamp":"2024-09-12T01:22:06.648414+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.648414+0000","objects_scrubbed":10,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:28.512834+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2238687,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":418,"num_read_kb":24307,"num_write":963,"num_write_kb":33018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:04.229626+0000","last_change":"2024-09-12T01:22:04.229626+0000","last_active":"2024-09-12T01:22:04.229626+0000","last_peered":"2024-09-12T01:22:04.229626+0000","last_clean":"2024-09-12T01:22:04.229626+0000","last_became_active":"2024-09-12T00:35:29.671727+0000","last_became_peered":"2024-09-12T00:35:29.671727+0000","last_unstale":"2024-09-12T01:22:04.229626+0000","last_undegraded":"2024-09-12T01:22:04.229626+0000","last_fullsized":"2024-09-12T01:22:04.229626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:04.229530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:04.229530+0000","last_clean_scrub_stamp":"2024-09-12T01:22:04.229530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:25.823105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010553139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:24.880194+0000","last_change":"2024-09-12T01:22:24.880194+0000","last_active":"2024-09-12T01:22:24.880194+0000","last_peered":"2024-09-12T01:22:24.880194+0000","last_clean":"2024-09-12T01:22:24.880194+0000","last_became_active":"2024-09-12T00:35:47.936452+0000","last_became_peered":"2024-09-12T00:35:47.936452+0000","last_unstale":"2024-09-12T01:22:24.880194+0000","last_undegraded":"2024-09-12T01:22:24.880194+0000","last_fullsized":"2024-09-12T01:22:24.880194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:24.880010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:24.880010+0000","last_clean_scrub_stamp":"2024-09-12T01:22:24.880010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:03.823274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'119","reported_seq":672,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:29.955037+0000","last_change":"2024-09-12T01:22:29.955037+0000","last_active":"2024-09-12T01:22:29.955037+0000","last_peered":"2024-09-12T01:22:29.955037+0000","last_clean":"2024-09-12T01:22:29.955037+0000","last_became_active":"2024-09-12T00:35:49.940788+0000","last_became_peered":"2024-09-12T00:35:49.940788+0000","last_unstale":"2024-09-12T01:22:29.955037+0000","last_undegraded":"2024-09-12T01:22:29.955037+0000","last_fullsized":"2024-09-12T01:22:29.955037+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'119","last_scrub_stamp":"2024-09-12T01:22:29.954843+0000","last_deep_scrub":"265'119","last_deep_scrub_stamp":"2024-09-12T01:22:29.954843+0000","last_clean_scrub_stamp":"2024-09-12T01:22:29.954843+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:39.091136+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'790","reported_seq":2425,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:38.715465+0000","last_change":"2024-09-12T01:22:38.715465+0000","last_active":"2024-09-12T01:22:38.715465+0000","last_peered":"2024-09-12T01:22:38.715465+0000","last_clean":"2024-09-12T01:22:38.715465+0000","last_became_active":"2024-09-12T00:35:51.979997+0000","last_became_peered":"2024-09-12T00:35:51.979997+0000","last_unstale":"2024-09-12T01:22:38.715465+0000","last_undegraded":"2024-09-12T01:22:38.715465+0000","last_fullsized":"2024-09-12T01:22:38.715465+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'790","last_scrub_stamp":"2024-09-12T01:22:38.715284+0000","last_deep_scrub":"265'790","last_deep_scrub_stamp":"2024-09-12T01:22:38.715284+0000","last_clean_scrub_stamp":"2024-09-12T01:22:38.715284+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:32.689881+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'283","reported_seq":808,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:32.456292+0000","last_change":"2024-09-12T01:22:32.456292+0000","last_active":"2024-09-12T01:22:32.456292+0000","last_peered":"2024-09-12T01:22:32.456292+0000","last_clean":"2024-09-12T01:22:32.456292+0000","last_became_active":"2024-09-12T00:35:53.992431+0000","last_became_peered":"2024-09-12T00:35:53.992431+0000","last_unstale":"2024-09-12T01:22:32.456292+0000","last_undegraded":"2024-09-12T01:22:32.456292+0000","last_fullsized":"2024-09-12T01:22:32.456292+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'283","last_scrub_stamp":"2024-09-12T01:22:32.456102+0000","last_deep_scrub":"265'283","last_deep_scrub_stamp":"2024-09-12T01:22:32.456102+0000","last_clean_scrub_stamp":"2024-09-12T01:22:32.456102+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:50.473537+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":344,"num_read_kb":342,"num_write":602,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'372","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.008846+0000","last_change":"2024-09-12T01:22:09.008846+0000","last_active":"2024-09-12T01:22:09.008846+0000","last_peered":"2024-09-12T01:22:09.008846+0000","last_clean":"2024-09-12T01:22:09.008846+0000","last_became_active":"2024-09-12T00:35:45.928789+0000","last_became_peered":"2024-09-12T00:35:45.928789+0000","last_unstale":"2024-09-12T01:22:09.008846+0000","last_undegraded":"2024-09-12T01:22:09.008846+0000","last_fullsized":"2024-09-12T01:22:09.008846+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'372","last_scrub_stamp":"2024-09-12T01:22:09.008671+0000","last_deep_scrub":"265'372","last_deep_scrub_stamp":"2024-09-12T01:22:09.008671+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.008671+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:49.407471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1634,"num_read_kb":1297,"num_write":639,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'367","reported_seq":1052,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.642522+0000","last_change":"2024-09-12T01:22:05.642522+0000","last_active":"2024-09-12T01:22:05.642522+0000","last_peered":"2024-09-12T01:22:05.642522+0000","last_clean":"2024-09-12T01:22:05.642522+0000","last_became_active":"2024-09-12T00:35:43.932994+0000","last_became_peered":"2024-09-12T00:35:43.932994+0000","last_unstale":"2024-09-12T01:22:05.642522+0000","last_undegraded":"2024-09-12T01:22:05.642522+0000","last_fullsized":"2024-09-12T01:22:05.642522+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T01:22:05.642296+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T01:22:05.642296+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.642296+0000","objects_scrubbed":7,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:09.276375+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":624,"num_read_kb":1635,"num_write":1170,"num_write_kb":36329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.086834+0000","last_change":"2024-09-12T01:22:05.086834+0000","last_active":"2024-09-12T01:22:05.086834+0000","last_peered":"2024-09-12T01:22:05.086834+0000","last_clean":"2024-09-12T01:22:05.086834+0000","last_became_active":"2024-09-12T00:35:29.670571+0000","last_became_peered":"2024-09-12T00:35:29.670571+0000","last_unstale":"2024-09-12T01:22:05.086834+0000","last_undegraded":"2024-09-12T01:22:05.086834+0000","last_fullsized":"2024-09-12T01:22:05.086834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:05.086601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:05.086601+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.086601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:50.763843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012596770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:24.551946+0000","last_change":"2024-09-12T01:22:24.551946+0000","last_active":"2024-09-12T01:22:24.551946+0000","last_peered":"2024-09-12T01:22:24.551946+0000","last_clean":"2024-09-12T01:22:24.551946+0000","last_became_active":"2024-09-12T00:35:47.933798+0000","last_became_peered":"2024-09-12T00:35:47.933798+0000","last_unstale":"2024-09-12T01:22:24.551946+0000","last_undegraded":"2024-09-12T01:22:24.551946+0000","last_fullsized":"2024-09-12T01:22:24.551946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:24.551752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:24.551752+0000","last_clean_scrub_stamp":"2024-09-12T01:22:24.551752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:04.069854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'731","reported_seq":1463,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:26.328699+0000","last_change":"2024-09-12T01:22:26.328699+0000","last_active":"2024-09-12T01:22:26.328699+0000","last_peered":"2024-09-12T01:22:26.328699+0000","last_clean":"2024-09-12T01:22:26.328699+0000","last_became_active":"2024-09-12T00:35:50.028341+0000","last_became_peered":"2024-09-12T00:35:50.028341+0000","last_unstale":"2024-09-12T01:22:26.328699+0000","last_undegraded":"2024-09-12T01:22:26.328699+0000","last_fullsized":"2024-09-12T01:22:26.328699+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'731","last_scrub_stamp":"2024-09-12T01:22:26.328474+0000","last_deep_scrub":"265'731","last_deep_scrub_stamp":"2024-09-12T01:22:26.328474+0000","last_clean_scrub_stamp":"2024-09-12T01:22:26.328474+0000","objects_scrubbed":9,"log_size":31,"log_dups_size":700,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:51.278555+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139080,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1312,"num_read_kb":3096,"num_write":1068,"num_write_kb":883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:35.628105+0000","last_change":"2024-09-12T01:22:35.628105+0000","last_active":"2024-09-12T01:22:35.628105+0000","last_peered":"2024-09-12T01:22:35.628105+0000","last_clean":"2024-09-12T01:22:35.628105+0000","last_became_active":"2024-09-12T00:35:51.974473+0000","last_became_peered":"2024-09-12T00:35:51.974473+0000","last_unstale":"2024-09-12T01:22:35.628105+0000","last_undegraded":"2024-09-12T01:22:35.628105+0000","last_fullsized":"2024-09-12T01:22:35.628105+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:35.627930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:35.627930+0000","last_clean_scrub_stamp":"2024-09-12T01:22:35.627930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:26.729104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'110","reported_seq":620,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:38.552872+0000","last_change":"2024-09-12T01:22:38.552872+0000","last_active":"2024-09-12T01:22:38.552872+0000","last_peered":"2024-09-12T01:22:38.552872+0000","last_clean":"2024-09-12T01:22:38.552872+0000","last_became_active":"2024-09-12T00:35:53.995431+0000","last_became_peered":"2024-09-12T00:35:53.995431+0000","last_unstale":"2024-09-12T01:22:38.552872+0000","last_undegraded":"2024-09-12T01:22:38.552872+0000","last_fullsized":"2024-09-12T01:22:38.552872+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'110","last_scrub_stamp":"2024-09-12T01:22:38.552693+0000","last_deep_scrub":"265'110","last_deep_scrub_stamp":"2024-09-12T01:22:38.552693+0000","last_clean_scrub_stamp":"2024-09-12T01:22:38.552693+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:36.943299+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":133,"num_write":267,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'117","reported_seq":675,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:38.458955+0000","last_change":"2024-09-12T01:22:38.458955+0000","last_active":"2024-09-12T01:22:38.458955+0000","last_peered":"2024-09-12T01:22:38.458955+0000","last_clean":"2024-09-12T01:22:38.458955+0000","last_became_active":"2024-09-12T00:35:54.002052+0000","last_became_peered":"2024-09-12T00:35:54.002052+0000","last_unstale":"2024-09-12T01:22:38.458955+0000","last_undegraded":"2024-09-12T01:22:38.458955+0000","last_fullsized":"2024-09-12T01:22:38.458955+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'117","last_scrub_stamp":"2024-09-12T01:22:38.458747+0000","last_deep_scrub":"265'117","last_deep_scrub_stamp":"2024-09-12T01:22:38.458747+0000","last_clean_scrub_stamp":"2024-09-12T01:22:38.458747+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:01.695518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":193,"num_write":267,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'96","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.014091+0000","last_change":"2024-09-12T01:22:14.013931+0000","last_active":"2024-09-12T01:22:14.014091+0000","last_peered":"2024-09-12T01:22:14.014091+0000","last_clean":"2024-09-12T01:22:14.014091+0000","last_became_active":"2024-09-12T00:35:45.954079+0000","last_became_peered":"2024-09-12T00:35:45.954079+0000","last_unstale":"2024-09-12T01:22:14.014091+0000","last_undegraded":"2024-09-12T01:22:14.014091+0000","last_fullsized":"2024-09-12T01:22:14.014091+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'96","last_scrub_stamp":"2024-09-12T01:22:14.013751+0000","last_deep_scrub":"265'96","last_deep_scrub_stamp":"2024-09-12T01:22:14.013751+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.013751+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:36.327183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":455,"num_read_kb":391,"num_write":154,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'442","reported_seq":1149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.033389+0000","last_change":"2024-09-12T01:22:07.033238+0000","last_active":"2024-09-12T01:22:07.033389+0000","last_peered":"2024-09-12T01:22:07.033389+0000","last_clean":"2024-09-12T01:22:07.033389+0000","last_became_active":"2024-09-12T00:35:43.947940+0000","last_became_peered":"2024-09-12T00:35:43.947940+0000","last_unstale":"2024-09-12T01:22:07.033389+0000","last_undegraded":"2024-09-12T01:22:07.033389+0000","last_fullsized":"2024-09-12T01:22:07.033389+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'442","last_scrub_stamp":"2024-09-12T01:22:07.032998+0000","last_deep_scrub":"265'442","last_deep_scrub_stamp":"2024-09-12T01:22:07.032998+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.032998+0000","objects_scrubbed":7,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:14.761183+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":799,"num_read_kb":4159,"num_write":1267,"num_write_kb":17308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.199735+0000","last_change":"2024-09-12T01:22:22.199456+0000","last_active":"2024-09-12T01:22:22.199735+0000","last_peered":"2024-09-12T01:22:22.199735+0000","last_clean":"2024-09-12T01:22:22.199735+0000","last_became_active":"2024-09-12T00:35:47.929844+0000","last_became_peered":"2024-09-12T00:35:47.929844+0000","last_unstale":"2024-09-12T01:22:22.199735+0000","last_undegraded":"2024-09-12T01:22:22.199735+0000","last_fullsized":"2024-09-12T01:22:22.199735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:22.199245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:22.199245+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.199245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:59.906791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'293","reported_seq":878,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:31.567824+0000","last_change":"2024-09-12T01:22:31.567655+0000","last_active":"2024-09-12T01:22:31.567824+0000","last_peered":"2024-09-12T01:22:31.567824+0000","last_clean":"2024-09-12T01:22:31.567824+0000","last_became_active":"2024-09-12T00:35:49.947136+0000","last_became_peered":"2024-09-12T00:35:49.947136+0000","last_unstale":"2024-09-12T01:22:31.567824+0000","last_undegraded":"2024-09-12T01:22:31.567824+0000","last_fullsized":"2024-09-12T01:22:31.567824+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'293","last_scrub_stamp":"2024-09-12T01:22:31.567462+0000","last_deep_scrub":"265'293","last_deep_scrub_stamp":"2024-09-12T01:22:31.567462+0000","last_clean_scrub_stamp":"2024-09-12T01:22:31.567462+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:50.917955+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43778,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":475,"num_read_kb":1081,"num_write":388,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:37.663678+0000","last_change":"2024-09-12T01:22:37.663678+0000","last_active":"2024-09-12T01:22:37.663678+0000","last_peered":"2024-09-12T01:22:37.663678+0000","last_clean":"2024-09-12T01:22:37.663678+0000","last_became_active":"2024-09-12T00:35:51.980092+0000","last_became_peered":"2024-09-12T00:35:51.980092+0000","last_unstale":"2024-09-12T01:22:37.663678+0000","last_undegraded":"2024-09-12T01:22:37.663678+0000","last_fullsized":"2024-09-12T01:22:37.663678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:37.663482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:37.663482+0000","last_clean_scrub_stamp":"2024-09-12T01:22:37.663482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:26.318770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'134","reported_seq":642,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:45.701951+0000","last_change":"2024-09-12T01:22:45.701951+0000","last_active":"2024-09-12T01:22:45.701951+0000","last_peered":"2024-09-12T01:22:45.701951+0000","last_clean":"2024-09-12T01:22:45.701951+0000","last_became_active":"2024-09-12T00:35:53.992579+0000","last_became_peered":"2024-09-12T00:35:53.992579+0000","last_unstale":"2024-09-12T01:22:45.701951+0000","last_undegraded":"2024-09-12T01:22:45.701951+0000","last_fullsized":"2024-09-12T01:22:45.701951+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'134","last_scrub_stamp":"2024-09-12T01:22:45.701762+0000","last_deep_scrub":"265'134","last_deep_scrub_stamp":"2024-09-12T01:22:45.701762+0000","last_clean_scrub_stamp":"2024-09-12T01:22:45.701762+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:53.241636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":139,"num_write":341,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'161","reported_seq":754,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.226485+0000","last_change":"2024-09-12T01:22:16.226327+0000","last_active":"2024-09-12T01:22:16.226485+0000","last_peered":"2024-09-12T01:22:16.226485+0000","last_clean":"2024-09-12T01:22:16.226485+0000","last_became_active":"2024-09-12T00:35:45.957614+0000","last_became_peered":"2024-09-12T00:35:45.957614+0000","last_unstale":"2024-09-12T01:22:16.226485+0000","last_undegraded":"2024-09-12T01:22:16.226485+0000","last_fullsized":"2024-09-12T01:22:16.226485+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'161","last_scrub_stamp":"2024-09-12T01:22:16.226150+0000","last_deep_scrub":"265'161","last_deep_scrub_stamp":"2024-09-12T01:22:16.226150+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.226150+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:34.804768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":661,"num_read_kb":539,"num_write":259,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'367","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.238457+0000","last_change":"2024-09-12T01:22:06.238323+0000","last_active":"2024-09-12T01:22:06.238457+0000","last_peered":"2024-09-12T01:22:06.238457+0000","last_clean":"2024-09-12T01:22:06.238457+0000","last_became_active":"2024-09-12T00:36:17.269377+0000","last_became_peered":"2024-09-12T00:36:17.269377+0000","last_unstale":"2024-09-12T01:22:06.238457+0000","last_undegraded":"2024-09-12T01:22:06.238457+0000","last_fullsized":"2024-09-12T01:22:06.238457+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T01:22:06.238069+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T01:22:06.238069+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.238069+0000","objects_scrubbed":8,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:52.160763+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":513,"num_read_kb":25436,"num_write":1264,"num_write_kb":33386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:25.513194+0000","last_change":"2024-09-12T01:22:25.512967+0000","last_active":"2024-09-12T01:22:25.513194+0000","last_peered":"2024-09-12T01:22:25.513194+0000","last_clean":"2024-09-12T01:22:25.513194+0000","last_became_active":"2024-09-12T00:35:47.941493+0000","last_became_peered":"2024-09-12T00:35:47.941493+0000","last_unstale":"2024-09-12T01:22:25.513194+0000","last_undegraded":"2024-09-12T01:22:25.513194+0000","last_fullsized":"2024-09-12T01:22:25.513194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:25.512683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:25.512683+0000","last_clean_scrub_stamp":"2024-09-12T01:22:25.512683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:08.462610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'49","reported_seq":554,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:28.434070+0000","last_change":"2024-09-12T01:22:28.433811+0000","last_active":"2024-09-12T01:22:28.434070+0000","last_peered":"2024-09-12T01:22:28.434070+0000","last_clean":"2024-09-12T01:22:28.434070+0000","last_became_active":"2024-09-12T00:35:49.949331+0000","last_became_peered":"2024-09-12T00:35:49.949331+0000","last_unstale":"2024-09-12T01:22:28.434070+0000","last_undegraded":"2024-09-12T01:22:28.434070+0000","last_fullsized":"2024-09-12T01:22:28.434070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'49","last_scrub_stamp":"2024-09-12T01:22:28.433586+0000","last_deep_scrub":"265'49","last_deep_scrub_stamp":"2024-09-12T01:22:28.433586+0000","last_clean_scrub_stamp":"2024-09-12T01:22:28.433586+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:36.448449+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:31.424851+0000","last_change":"2024-09-12T01:22:31.424654+0000","last_active":"2024-09-12T01:22:31.424851+0000","last_peered":"2024-09-12T01:22:31.424851+0000","last_clean":"2024-09-12T01:22:31.424851+0000","last_became_active":"2024-09-12T00:35:51.977211+0000","last_became_peered":"2024-09-12T00:35:51.977211+0000","last_unstale":"2024-09-12T01:22:31.424851+0000","last_undegraded":"2024-09-12T01:22:31.424851+0000","last_fullsized":"2024-09-12T01:22:31.424851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:31.424473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:31.424473+0000","last_clean_scrub_stamp":"2024-09-12T01:22:31.424473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:12.683310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'215","reported_seq":733,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:36.498896+0000","last_change":"2024-09-12T01:22:36.498896+0000","last_active":"2024-09-12T01:22:36.498896+0000","last_peered":"2024-09-12T01:22:36.498896+0000","last_clean":"2024-09-12T01:22:36.498896+0000","last_became_active":"2024-09-12T00:35:53.985696+0000","last_became_peered":"2024-09-12T00:35:53.985696+0000","last_unstale":"2024-09-12T01:22:36.498896+0000","last_undegraded":"2024-09-12T01:22:36.498896+0000","last_fullsized":"2024-09-12T01:22:36.498896+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'215","last_scrub_stamp":"2024-09-12T01:22:36.498588+0000","last_deep_scrub":"265'215","last_deep_scrub_stamp":"2024-09-12T01:22:36.498588+0000","last_clean_scrub_stamp":"2024-09-12T01:22:36.498588+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:50.703674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":288,"num_read_kb":283,"num_write":478,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'116","reported_seq":729,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.632662+0000","last_change":"2024-09-12T01:22:16.632479+0000","last_active":"2024-09-12T01:22:16.632662+0000","last_peered":"2024-09-12T01:22:16.632662+0000","last_clean":"2024-09-12T01:22:16.632662+0000","last_became_active":"2024-09-12T00:35:45.942161+0000","last_became_peered":"2024-09-12T00:35:45.942161+0000","last_unstale":"2024-09-12T01:22:16.632662+0000","last_undegraded":"2024-09-12T01:22:16.632662+0000","last_fullsized":"2024-09-12T01:22:16.632662+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'116","last_scrub_stamp":"2024-09-12T01:22:16.632298+0000","last_deep_scrub":"265'116","last_deep_scrub_stamp":"2024-09-12T01:22:16.632298+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.632298+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:43.861761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":566,"num_read_kb":479,"num_write":187,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'295","reported_seq":903,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.806007+0000","last_change":"2024-09-12T01:22:06.806007+0000","last_active":"2024-09-12T01:22:06.806007+0000","last_peered":"2024-09-12T01:22:06.806007+0000","last_clean":"2024-09-12T01:22:06.806007+0000","last_became_active":"2024-09-12T00:35:43.950660+0000","last_became_peered":"2024-09-12T00:35:43.950660+0000","last_unstale":"2024-09-12T01:22:06.806007+0000","last_undegraded":"2024-09-12T01:22:06.806007+0000","last_fullsized":"2024-09-12T01:22:06.806007+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'295","last_scrub_stamp":"2024-09-12T01:22:06.805784+0000","last_deep_scrub":"265'295","last_deep_scrub_stamp":"2024-09-12T01:22:06.805784+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.805784+0000","objects_scrubbed":6,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:35.026312+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110814,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":386,"num_read_kb":2177,"num_write":879,"num_write_kb":8684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:24.345750+0000","last_change":"2024-09-12T01:22:24.345499+0000","last_active":"2024-09-12T01:22:24.345750+0000","last_peered":"2024-09-12T01:22:24.345750+0000","last_clean":"2024-09-12T01:22:24.345750+0000","last_became_active":"2024-09-12T00:35:47.945819+0000","last_became_peered":"2024-09-12T00:35:47.945819+0000","last_unstale":"2024-09-12T01:22:24.345750+0000","last_undegraded":"2024-09-12T01:22:24.345750+0000","last_fullsized":"2024-09-12T01:22:24.345750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:24.345289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:24.345289+0000","last_clean_scrub_stamp":"2024-09-12T01:22:24.345289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:11.155693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'353","reported_seq":948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:32.576801+0000","last_change":"2024-09-12T01:22:32.576642+0000","last_active":"2024-09-12T01:22:32.576801+0000","last_peered":"2024-09-12T01:22:32.576801+0000","last_clean":"2024-09-12T01:22:32.576801+0000","last_became_active":"2024-09-12T00:35:49.954646+0000","last_became_peered":"2024-09-12T00:35:49.954646+0000","last_unstale":"2024-09-12T01:22:32.576801+0000","last_undegraded":"2024-09-12T01:22:32.576801+0000","last_fullsized":"2024-09-12T01:22:32.576801+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'353","last_scrub_stamp":"2024-09-12T01:22:32.576449+0000","last_deep_scrub":"265'353","last_deep_scrub_stamp":"2024-09-12T01:22:32.576449+0000","last_clean_scrub_stamp":"2024-09-12T01:22:32.576449+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:35.618352+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66883,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":574,"num_read_kb":1344,"num_write":472,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:23.056635+0000","last_change":"2024-09-12T01:22:23.056469+0000","last_active":"2024-09-12T01:22:23.056635+0000","last_peered":"2024-09-12T01:22:23.056635+0000","last_clean":"2024-09-12T01:22:23.056635+0000","last_became_active":"2024-09-12T00:35:51.973993+0000","last_became_peered":"2024-09-12T00:35:51.973993+0000","last_unstale":"2024-09-12T01:22:23.056635+0000","last_undegraded":"2024-09-12T01:22:23.056635+0000","last_fullsized":"2024-09-12T01:22:23.056635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:23.056293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:23.056293+0000","last_clean_scrub_stamp":"2024-09-12T01:22:23.056293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:08.652989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'105","reported_seq":619,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:40.570482+0000","last_change":"2024-09-12T01:22:40.570482+0000","last_active":"2024-09-12T01:22:40.570482+0000","last_peered":"2024-09-12T01:22:40.570482+0000","last_clean":"2024-09-12T01:22:40.570482+0000","last_became_active":"2024-09-12T00:35:54.001337+0000","last_became_peered":"2024-09-12T00:35:54.001337+0000","last_unstale":"2024-09-12T01:22:40.570482+0000","last_undegraded":"2024-09-12T01:22:40.570482+0000","last_fullsized":"2024-09-12T01:22:40.570482+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'105","last_scrub_stamp":"2024-09-12T01:22:40.570295+0000","last_deep_scrub":"265'105","last_deep_scrub_stamp":"2024-09-12T01:22:40.570295+0000","last_clean_scrub_stamp":"2024-09-12T01:22:40.570295+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:19.687708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":126,"num_write":245,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'4114","reported_seq":4744,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.616911+0000","last_change":"2024-09-12T01:22:14.616655+0000","last_active":"2024-09-12T01:22:14.616911+0000","last_peered":"2024-09-12T01:22:14.616911+0000","last_clean":"2024-09-12T01:22:14.616911+0000","last_became_active":"2024-09-12T00:35:45.938175+0000","last_became_peered":"2024-09-12T00:35:45.938175+0000","last_unstale":"2024-09-12T01:22:14.616911+0000","last_undegraded":"2024-09-12T01:22:14.616911+0000","last_fullsized":"2024-09-12T01:22:14.616911+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4114","last_scrub_stamp":"2024-09-12T01:22:14.616416+0000","last_deep_scrub":"265'4114","last_deep_scrub_stamp":"2024-09-12T01:22:14.616416+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.616416+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:57.910210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16557,"num_read_kb":13901,"num_write":6164,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'313","reported_seq":924,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.637162+0000","last_change":"2024-09-12T01:22:06.637162+0000","last_active":"2024-09-12T01:22:06.637162+0000","last_peered":"2024-09-12T01:22:06.637162+0000","last_clean":"2024-09-12T01:22:06.637162+0000","last_became_active":"2024-09-12T00:35:43.935194+0000","last_became_peered":"2024-09-12T00:35:43.935194+0000","last_unstale":"2024-09-12T01:22:06.637162+0000","last_undegraded":"2024-09-12T01:22:06.637162+0000","last_fullsized":"2024-09-12T01:22:06.637162+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'313","last_scrub_stamp":"2024-09-12T01:22:06.636919+0000","last_deep_scrub":"265'313","last_deep_scrub_stamp":"2024-09-12T01:22:06.636919+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.636919+0000","objects_scrubbed":8,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:10.162623+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992287,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":416,"num_read_kb":10375,"num_write":976,"num_write_kb":15779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.098190+0000","last_change":"2024-09-12T01:22:19.097959+0000","last_active":"2024-09-12T01:22:19.098190+0000","last_peered":"2024-09-12T01:22:19.098190+0000","last_clean":"2024-09-12T01:22:19.098190+0000","last_became_active":"2024-09-12T00:35:47.944477+0000","last_became_peered":"2024-09-12T00:35:47.944477+0000","last_unstale":"2024-09-12T01:22:19.098190+0000","last_undegraded":"2024-09-12T01:22:19.098190+0000","last_fullsized":"2024-09-12T01:22:19.098190+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:19.097750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:19.097750+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.097750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:03.784360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'278","reported_seq":854,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:29.360131+0000","last_change":"2024-09-12T01:22:29.359974+0000","last_active":"2024-09-12T01:22:29.360131+0000","last_peered":"2024-09-12T01:22:29.360131+0000","last_clean":"2024-09-12T01:22:29.360131+0000","last_became_active":"2024-09-12T00:35:49.941948+0000","last_became_peered":"2024-09-12T00:35:49.941948+0000","last_unstale":"2024-09-12T01:22:29.360131+0000","last_undegraded":"2024-09-12T01:22:29.360131+0000","last_fullsized":"2024-09-12T01:22:29.360131+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'278","last_scrub_stamp":"2024-09-12T01:22:29.359800+0000","last_deep_scrub":"265'278","last_deep_scrub_stamp":"2024-09-12T01:22:29.359800+0000","last_clean_scrub_stamp":"2024-09-12T01:22:29.359800+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:28.047217+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45730,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":1073,"num_write":372,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:39.410275+0000","last_change":"2024-09-12T01:22:39.410275+0000","last_active":"2024-09-12T01:22:39.410275+0000","last_peered":"2024-09-12T01:22:39.410275+0000","last_clean":"2024-09-12T01:22:39.410275+0000","last_became_active":"2024-09-12T00:35:51.975124+0000","last_became_peered":"2024-09-12T00:35:51.975124+0000","last_unstale":"2024-09-12T01:22:39.410275+0000","last_undegraded":"2024-09-12T01:22:39.410275+0000","last_fullsized":"2024-09-12T01:22:39.410275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:39.410096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:39.410096+0000","last_clean_scrub_stamp":"2024-09-12T01:22:39.410096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:06.295932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'251","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.166216+0000","last_change":"2024-09-12T01:22:14.166216+0000","last_active":"2024-09-12T01:22:14.166216+0000","last_peered":"2024-09-12T01:22:14.166216+0000","last_clean":"2024-09-12T01:22:14.166216+0000","last_became_active":"2024-09-12T00:35:45.941357+0000","last_became_peered":"2024-09-12T00:35:45.941357+0000","last_unstale":"2024-09-12T01:22:14.166216+0000","last_undegraded":"2024-09-12T01:22:14.166216+0000","last_fullsized":"2024-09-12T01:22:14.166216+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'251","last_scrub_stamp":"2024-09-12T01:22:14.165990+0000","last_deep_scrub":"265'251","last_deep_scrub_stamp":"2024-09-12T01:22:14.165990+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.165990+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:23.409041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1115,"num_read_kb":918,"num_write":405,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'305","reported_seq":932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.627274+0000","last_change":"2024-09-12T01:22:08.627274+0000","last_active":"2024-09-12T01:22:08.627274+0000","last_peered":"2024-09-12T01:22:08.627274+0000","last_clean":"2024-09-12T01:22:08.627274+0000","last_became_active":"2024-09-12T00:35:43.933037+0000","last_became_peered":"2024-09-12T00:35:43.933037+0000","last_unstale":"2024-09-12T01:22:08.627274+0000","last_undegraded":"2024-09-12T01:22:08.627274+0000","last_fullsized":"2024-09-12T01:22:08.627274+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'305","last_scrub_stamp":"2024-09-12T01:22:08.627056+0000","last_deep_scrub":"265'305","last_deep_scrub_stamp":"2024-09-12T01:22:08.627056+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.627056+0000","objects_scrubbed":9,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:16.887003+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730132,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":468,"num_read_kb":7309,"num_write":980,"num_write_kb":23054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"265'4","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.489438+0000","last_change":"2024-09-12T01:22:22.489438+0000","last_active":"2024-09-12T01:22:22.489438+0000","last_peered":"2024-09-12T01:22:22.489438+0000","last_clean":"2024-09-12T01:22:22.489438+0000","last_became_active":"2024-09-12T00:35:47.941749+0000","last_became_peered":"2024-09-12T00:35:47.941749+0000","last_unstale":"2024-09-12T01:22:22.489438+0000","last_undegraded":"2024-09-12T01:22:22.489438+0000","last_fullsized":"2024-09-12T01:22:22.489438+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T01:22:22.489259+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T01:22:22.489259+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.489259+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:29.570374+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'511","reported_seq":1150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:25.222400+0000","last_change":"2024-09-12T01:22:25.222400+0000","last_active":"2024-09-12T01:22:25.222400+0000","last_peered":"2024-09-12T01:22:25.222400+0000","last_clean":"2024-09-12T01:22:25.222400+0000","last_became_active":"2024-09-12T00:35:49.947963+0000","last_became_peered":"2024-09-12T00:35:49.947963+0000","last_unstale":"2024-09-12T01:22:25.222400+0000","last_undegraded":"2024-09-12T01:22:25.222400+0000","last_fullsized":"2024-09-12T01:22:25.222400+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'511","last_scrub_stamp":"2024-09-12T01:22:25.222213+0000","last_deep_scrub":"265'511","last_deep_scrub_stamp":"2024-09-12T01:22:25.222213+0000","last_clean_scrub_stamp":"2024-09-12T01:22:25.222213+0000","objects_scrubbed":7,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:10.494053+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95771,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":915,"num_read_kb":2195,"num_write":792,"num_write_kb":711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:34.608743+0000","last_change":"2024-09-12T01:22:34.608743+0000","last_active":"2024-09-12T01:22:34.608743+0000","last_peered":"2024-09-12T01:22:34.608743+0000","last_clean":"2024-09-12T01:22:34.608743+0000","last_became_active":"2024-09-12T00:35:51.968209+0000","last_became_peered":"2024-09-12T00:35:51.968209+0000","last_unstale":"2024-09-12T01:22:34.608743+0000","last_undegraded":"2024-09-12T01:22:34.608743+0000","last_fullsized":"2024-09-12T01:22:34.608743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:34.608572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:34.608572+0000","last_clean_scrub_stamp":"2024-09-12T01:22:34.608572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:49.342386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'162","reported_seq":666,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:43.708300+0000","last_change":"2024-09-12T01:22:43.708300+0000","last_active":"2024-09-12T01:22:43.708300+0000","last_peered":"2024-09-12T01:22:43.708300+0000","last_clean":"2024-09-12T01:22:43.708300+0000","last_became_active":"2024-09-12T00:35:54.012958+0000","last_became_peered":"2024-09-12T00:35:54.012958+0000","last_unstale":"2024-09-12T01:22:43.708300+0000","last_undegraded":"2024-09-12T01:22:43.708300+0000","last_fullsized":"2024-09-12T01:22:43.708300+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'162","last_scrub_stamp":"2024-09-12T01:22:43.708111+0000","last_deep_scrub":"265'162","last_deep_scrub_stamp":"2024-09-12T01:22:43.708111+0000","last_clean_scrub_stamp":"2024-09-12T01:22:43.708111+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:19.855855+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1092,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":166,"num_read_kb":178,"num_write":351,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'60","reported_seq":622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.501893+0000","last_change":"2024-09-12T01:22:19.501893+0000","last_active":"2024-09-12T01:22:19.501893+0000","last_peered":"2024-09-12T01:22:19.501893+0000","last_clean":"2024-09-12T01:22:19.501893+0000","last_became_active":"2024-09-12T00:35:45.945952+0000","last_became_peered":"2024-09-12T00:35:45.945952+0000","last_unstale":"2024-09-12T01:22:19.501893+0000","last_undegraded":"2024-09-12T01:22:19.501893+0000","last_fullsized":"2024-09-12T01:22:19.501893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'60","last_scrub_stamp":"2024-09-12T01:22:19.501688+0000","last_deep_scrub":"265'60","last_deep_scrub_stamp":"2024-09-12T01:22:19.501688+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.501688+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:13.144748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":234,"num_write":86,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'360","reported_seq":1024,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.256391+0000","last_change":"2024-09-12T01:22:08.256391+0000","last_active":"2024-09-12T01:22:08.256391+0000","last_peered":"2024-09-12T01:22:08.256391+0000","last_clean":"2024-09-12T01:22:08.256391+0000","last_became_active":"2024-09-12T00:35:43.928779+0000","last_became_peered":"2024-09-12T00:35:43.928779+0000","last_unstale":"2024-09-12T01:22:08.256391+0000","last_undegraded":"2024-09-12T01:22:08.256391+0000","last_fullsized":"2024-09-12T01:22:08.256391+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'360","last_scrub_stamp":"2024-09-12T01:22:08.256185+0000","last_deep_scrub":"265'360","last_deep_scrub_stamp":"2024-09-12T01:22:08.256185+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.256185+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:19.743658+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":507,"num_read_kb":67515,"num_write":1156,"num_write_kb":41697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.071518+0000","last_change":"2024-09-12T01:22:18.071518+0000","last_active":"2024-09-12T01:22:18.071518+0000","last_peered":"2024-09-12T01:22:18.071518+0000","last_clean":"2024-09-12T01:22:18.071518+0000","last_became_active":"2024-09-12T00:35:47.944056+0000","last_became_peered":"2024-09-12T00:35:47.944056+0000","last_unstale":"2024-09-12T01:22:18.071518+0000","last_undegraded":"2024-09-12T01:22:18.071518+0000","last_fullsized":"2024-09-12T01:22:18.071518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:18.071303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:18.071303+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.071303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:52.172452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'278","reported_seq":866,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:30.395019+0000","last_change":"2024-09-12T01:22:30.395019+0000","last_active":"2024-09-12T01:22:30.395019+0000","last_peered":"2024-09-12T01:22:30.395019+0000","last_clean":"2024-09-12T01:22:30.395019+0000","last_became_active":"2024-09-12T00:35:49.946226+0000","last_became_peered":"2024-09-12T00:35:49.946226+0000","last_unstale":"2024-09-12T01:22:30.395019+0000","last_undegraded":"2024-09-12T01:22:30.395019+0000","last_fullsized":"2024-09-12T01:22:30.395019+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'278","last_scrub_stamp":"2024-09-12T01:22:30.394752+0000","last_deep_scrub":"265'278","last_deep_scrub_stamp":"2024-09-12T01:22:30.394752+0000","last_clean_scrub_stamp":"2024-09-12T01:22:30.394752+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:13.222756+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48166,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":461,"num_read_kb":978,"num_write":376,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:29.229069+0000","last_change":"2024-09-12T01:22:29.229069+0000","last_active":"2024-09-12T01:22:29.229069+0000","last_peered":"2024-09-12T01:22:29.229069+0000","last_clean":"2024-09-12T01:22:29.229069+0000","last_became_active":"2024-09-12T00:35:51.963735+0000","last_became_peered":"2024-09-12T00:35:51.963735+0000","last_unstale":"2024-09-12T01:22:29.229069+0000","last_undegraded":"2024-09-12T01:22:29.229069+0000","last_fullsized":"2024-09-12T01:22:29.229069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:29.228872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:29.228872+0000","last_clean_scrub_stamp":"2024-09-12T01:22:29.228872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:08.991987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'202","reported_seq":717,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:29.088205+0000","last_change":"2024-09-12T01:22:29.087918+0000","last_active":"2024-09-12T01:22:29.088205+0000","last_peered":"2024-09-12T01:22:29.088205+0000","last_clean":"2024-09-12T01:22:29.088205+0000","last_became_active":"2024-09-12T00:35:53.990488+0000","last_became_peered":"2024-09-12T00:35:53.990488+0000","last_unstale":"2024-09-12T01:22:29.088205+0000","last_undegraded":"2024-09-12T01:22:29.088205+0000","last_fullsized":"2024-09-12T01:22:29.088205+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'202","last_scrub_stamp":"2024-09-12T01:22:29.087658+0000","last_deep_scrub":"265'202","last_deep_scrub_stamp":"2024-09-12T01:22:29.087658+0000","last_clean_scrub_stamp":"2024-09-12T01:22:29.087658+0000","objects_scrubbed":6,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:44.322341+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1821,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":235,"num_read_kb":229,"num_write":573,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'191","reported_seq":796,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.619589+0000","last_change":"2024-09-12T01:22:21.619589+0000","last_active":"2024-09-12T01:22:21.619589+0000","last_peered":"2024-09-12T01:22:21.619589+0000","last_clean":"2024-09-12T01:22:21.619589+0000","last_became_active":"2024-09-12T00:35:45.940529+0000","last_became_peered":"2024-09-12T00:35:45.940529+0000","last_unstale":"2024-09-12T01:22:21.619589+0000","last_undegraded":"2024-09-12T01:22:21.619589+0000","last_fullsized":"2024-09-12T01:22:21.619589+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'191","last_scrub_stamp":"2024-09-12T01:22:21.619383+0000","last_deep_scrub":"265'191","last_deep_scrub_stamp":"2024-09-12T01:22:21.619383+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.619383+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:56.738297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":840,"num_read_kb":692,"num_write":286,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'348","reported_seq":1110,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.076975+0000","last_change":"2024-09-12T01:22:06.076975+0000","last_active":"2024-09-12T01:22:06.076975+0000","last_peered":"2024-09-12T01:22:06.076975+0000","last_clean":"2024-09-12T01:22:06.076975+0000","last_became_active":"2024-09-12T00:35:43.927426+0000","last_became_peered":"2024-09-12T00:35:43.927426+0000","last_unstale":"2024-09-12T01:22:06.076975+0000","last_undegraded":"2024-09-12T01:22:06.076975+0000","last_fullsized":"2024-09-12T01:22:06.076975+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-12T01:22:06.076783+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-12T01:22:06.076783+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.076783+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:53.298954+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":824,"num_read_kb":46781,"num_write":1113,"num_write_kb":16393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:27.899248+0000","last_change":"2024-09-12T01:22:27.899248+0000","last_active":"2024-09-12T01:22:27.899248+0000","last_peered":"2024-09-12T01:22:27.899248+0000","last_clean":"2024-09-12T01:22:27.899248+0000","last_became_active":"2024-09-12T00:35:47.933189+0000","last_became_peered":"2024-09-12T00:35:47.933189+0000","last_unstale":"2024-09-12T01:22:27.899248+0000","last_undegraded":"2024-09-12T01:22:27.899248+0000","last_fullsized":"2024-09-12T01:22:27.899248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:27.899074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:27.899074+0000","last_clean_scrub_stamp":"2024-09-12T01:22:27.899074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:10.975721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'290","reported_seq":877,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:34.612507+0000","last_change":"2024-09-12T01:22:34.612507+0000","last_active":"2024-09-12T01:22:34.612507+0000","last_peered":"2024-09-12T01:22:34.612507+0000","last_clean":"2024-09-12T01:22:34.612507+0000","last_became_active":"2024-09-12T00:35:50.029579+0000","last_became_peered":"2024-09-12T00:35:50.029579+0000","last_unstale":"2024-09-12T01:22:34.612507+0000","last_undegraded":"2024-09-12T01:22:34.612507+0000","last_fullsized":"2024-09-12T01:22:34.612507+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'290","last_scrub_stamp":"2024-09-12T01:22:34.612310+0000","last_deep_scrub":"265'290","last_deep_scrub_stamp":"2024-09-12T01:22:34.612310+0000","last_clean_scrub_stamp":"2024-09-12T01:22:34.612310+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:27.497705+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47233,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":1083,"num_write":390,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:27.239752+0000","last_change":"2024-09-12T01:22:27.239752+0000","last_active":"2024-09-12T01:22:27.239752+0000","last_peered":"2024-09-12T01:22:27.239752+0000","last_clean":"2024-09-12T01:22:27.239752+0000","last_became_active":"2024-09-12T00:35:51.971682+0000","last_became_peered":"2024-09-12T00:35:51.971682+0000","last_unstale":"2024-09-12T01:22:27.239752+0000","last_undegraded":"2024-09-12T01:22:27.239752+0000","last_fullsized":"2024-09-12T01:22:27.239752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:27.239567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:27.239567+0000","last_clean_scrub_stamp":"2024-09-12T01:22:27.239567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:32.246865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'105","reported_seq":605,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:37.592662+0000","last_change":"2024-09-12T01:22:37.592662+0000","last_active":"2024-09-12T01:22:37.592662+0000","last_peered":"2024-09-12T01:22:37.592662+0000","last_clean":"2024-09-12T01:22:37.592662+0000","last_became_active":"2024-09-12T00:35:53.995464+0000","last_became_peered":"2024-09-12T00:35:53.995464+0000","last_unstale":"2024-09-12T01:22:37.592662+0000","last_undegraded":"2024-09-12T01:22:37.592662+0000","last_fullsized":"2024-09-12T01:22:37.592662+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'105","last_scrub_stamp":"2024-09-12T01:22:37.592475+0000","last_deep_scrub":"265'105","last_deep_scrub_stamp":"2024-09-12T01:22:37.592475+0000","last_clean_scrub_stamp":"2024-09-12T01:22:37.592475+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:47.712231+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":101,"num_write":247,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'298","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:04.495379+0000","last_change":"2024-09-12T01:22:04.495379+0000","last_active":"2024-09-12T01:22:04.495379+0000","last_peered":"2024-09-12T01:22:04.495379+0000","last_clean":"2024-09-12T01:22:04.495379+0000","last_became_active":"2024-09-12T00:35:45.947244+0000","last_became_peered":"2024-09-12T00:35:45.947244+0000","last_unstale":"2024-09-12T01:22:04.495379+0000","last_undegraded":"2024-09-12T01:22:04.495379+0000","last_fullsized":"2024-09-12T01:22:04.495379+0000","mapping_epoch":26,"log_start":"251'200","ondisk_log_start":"251'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'298","last_scrub_stamp":"2024-09-12T01:22:04.495267+0000","last_deep_scrub":"265'298","last_deep_scrub_stamp":"2024-09-12T01:22:04.495267+0000","last_clean_scrub_stamp":"2024-09-12T01:22:04.495267+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:57.480955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1444,"num_read_kb":1250,"num_write":453,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25755,"num_omap_keys":101,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'357","reported_seq":1121,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:04.679571+0000","last_change":"2024-09-12T01:22:04.679571+0000","last_active":"2024-09-12T01:22:04.679571+0000","last_peered":"2024-09-12T01:22:04.679571+0000","last_clean":"2024-09-12T01:22:04.679571+0000","last_became_active":"2024-09-12T00:35:43.947420+0000","last_became_peered":"2024-09-12T00:35:43.947420+0000","last_unstale":"2024-09-12T01:22:04.679571+0000","last_undegraded":"2024-09-12T01:22:04.679571+0000","last_fullsized":"2024-09-12T01:22:04.679571+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'357","last_scrub_stamp":"2024-09-12T01:22:04.679464+0000","last_deep_scrub":"265'357","last_deep_scrub_stamp":"2024-09-12T01:22:04.679464+0000","last_clean_scrub_stamp":"2024-09-12T01:22:04.679464+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:02.092461+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262187,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":720,"num_read_kb":19884,"num_write":1159,"num_write_kb":29921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.244173+0000","last_change":"2024-09-12T01:22:21.244173+0000","last_active":"2024-09-12T01:22:21.244173+0000","last_peered":"2024-09-12T01:22:21.244173+0000","last_clean":"2024-09-12T01:22:21.244173+0000","last_became_active":"2024-09-12T00:35:47.935440+0000","last_became_peered":"2024-09-12T00:35:47.935440+0000","last_unstale":"2024-09-12T01:22:21.244173+0000","last_undegraded":"2024-09-12T01:22:21.244173+0000","last_fullsized":"2024-09-12T01:22:21.244173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:21.244002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:21.244002+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.244002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:57.645912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'97","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:32.944551+0000","last_change":"2024-09-12T01:22:32.944551+0000","last_active":"2024-09-12T01:22:32.944551+0000","last_peered":"2024-09-12T01:22:32.944551+0000","last_clean":"2024-09-12T01:22:32.944551+0000","last_became_active":"2024-09-12T00:35:50.025145+0000","last_became_peered":"2024-09-12T00:35:50.025145+0000","last_unstale":"2024-09-12T01:22:32.944551+0000","last_undegraded":"2024-09-12T01:22:32.944551+0000","last_fullsized":"2024-09-12T01:22:32.944551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'97","last_scrub_stamp":"2024-09-12T01:22:32.944314+0000","last_deep_scrub":"265'97","last_deep_scrub_stamp":"2024-09-12T01:22:32.944314+0000","last_clean_scrub_stamp":"2024-09-12T01:22:32.944314+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:03.585579+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":97,"num_read_kb":88,"num_write":76,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'773","reported_seq":2399,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:26.156659+0000","last_change":"2024-09-12T01:22:26.156659+0000","last_active":"2024-09-12T01:22:26.156659+0000","last_peered":"2024-09-12T01:22:26.156659+0000","last_clean":"2024-09-12T01:22:26.156659+0000","last_became_active":"2024-09-12T00:35:51.967797+0000","last_became_peered":"2024-09-12T00:35:51.967797+0000","last_unstale":"2024-09-12T01:22:26.156659+0000","last_undegraded":"2024-09-12T01:22:26.156659+0000","last_fullsized":"2024-09-12T01:22:26.156659+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'773","last_scrub_stamp":"2024-09-12T01:22:26.156438+0000","last_deep_scrub":"265'773","last_deep_scrub_stamp":"2024-09-12T01:22:26.156438+0000","last_clean_scrub_stamp":"2024-09-12T01:22:26.156438+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:20.370270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'103","reported_seq":612,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:36.458506+0000","last_change":"2024-09-12T01:22:36.458366+0000","last_active":"2024-09-12T01:22:36.458506+0000","last_peered":"2024-09-12T01:22:36.458506+0000","last_clean":"2024-09-12T01:22:36.458506+0000","last_became_active":"2024-09-12T00:35:54.002318+0000","last_became_peered":"2024-09-12T00:35:54.002318+0000","last_unstale":"2024-09-12T01:22:36.458506+0000","last_undegraded":"2024-09-12T01:22:36.458506+0000","last_fullsized":"2024-09-12T01:22:36.458506+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'103","last_scrub_stamp":"2024-09-12T01:22:36.458187+0000","last_deep_scrub":"265'103","last_deep_scrub_stamp":"2024-09-12T01:22:36.458187+0000","last_clean_scrub_stamp":"2024-09-12T01:22:36.458187+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:43.305634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":119,"num_write":243,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'135","reported_seq":748,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.027357+0000","last_change":"2024-09-12T01:22:16.027357+0000","last_active":"2024-09-12T01:22:16.027357+0000","last_peered":"2024-09-12T01:22:16.027357+0000","last_clean":"2024-09-12T01:22:16.027357+0000","last_became_active":"2024-09-12T00:35:45.935880+0000","last_became_peered":"2024-09-12T00:35:45.935880+0000","last_unstale":"2024-09-12T01:22:16.027357+0000","last_undegraded":"2024-09-12T01:22:16.027357+0000","last_fullsized":"2024-09-12T01:22:16.027357+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'135","last_scrub_stamp":"2024-09-12T01:22:16.027180+0000","last_deep_scrub":"265'135","last_deep_scrub_stamp":"2024-09-12T01:22:16.027180+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.027180+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:04.144948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":617,"num_read_kb":515,"num_write":204,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'358","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.838790+0000","last_change":"2024-09-12T01:22:08.838790+0000","last_active":"2024-09-12T01:22:08.838790+0000","last_peered":"2024-09-12T01:22:08.838790+0000","last_clean":"2024-09-12T01:22:08.838790+0000","last_became_active":"2024-09-12T00:35:43.931008+0000","last_became_peered":"2024-09-12T00:35:43.931008+0000","last_unstale":"2024-09-12T01:22:08.838790+0000","last_undegraded":"2024-09-12T01:22:08.838790+0000","last_fullsized":"2024-09-12T01:22:08.838790+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T01:22:08.838501+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T01:22:08.838501+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.838501+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:11.131001+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730252,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":516,"num_read_kb":33271,"num_write":1211,"num_write_kb":48012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:25.340400+0000","last_change":"2024-09-12T01:22:25.340400+0000","last_active":"2024-09-12T01:22:25.340400+0000","last_peered":"2024-09-12T01:22:25.340400+0000","last_clean":"2024-09-12T01:22:25.340400+0000","last_became_active":"2024-09-12T00:35:47.950328+0000","last_became_peered":"2024-09-12T00:35:47.950328+0000","last_unstale":"2024-09-12T01:22:25.340400+0000","last_undegraded":"2024-09-12T01:22:25.340400+0000","last_fullsized":"2024-09-12T01:22:25.340400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:25.340222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:25.340222+0000","last_clean_scrub_stamp":"2024-09-12T01:22:25.340222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:23.703380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'331","reported_seq":944,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:32.676301+0000","last_change":"2024-09-12T01:22:32.676301+0000","last_active":"2024-09-12T01:22:32.676301+0000","last_peered":"2024-09-12T01:22:32.676301+0000","last_clean":"2024-09-12T01:22:32.676301+0000","last_became_active":"2024-09-12T00:35:49.938536+0000","last_became_peered":"2024-09-12T00:35:49.938536+0000","last_unstale":"2024-09-12T01:22:32.676301+0000","last_undegraded":"2024-09-12T01:22:32.676301+0000","last_fullsized":"2024-09-12T01:22:32.676301+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'331","last_scrub_stamp":"2024-09-12T01:22:32.676177+0000","last_deep_scrub":"265'331","last_deep_scrub_stamp":"2024-09-12T01:22:32.676177+0000","last_clean_scrub_stamp":"2024-09-12T01:22:32.676177+0000","objects_scrubbed":11,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:23.698139+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46352,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":532,"num_read_kb":1127,"num_write":424,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:33.484728+0000","last_change":"2024-09-12T01:22:33.484728+0000","last_active":"2024-09-12T01:22:33.484728+0000","last_peered":"2024-09-12T01:22:33.484728+0000","last_clean":"2024-09-12T01:22:33.484728+0000","last_became_active":"2024-09-12T00:35:51.964446+0000","last_became_peered":"2024-09-12T00:35:51.964446+0000","last_unstale":"2024-09-12T01:22:33.484728+0000","last_undegraded":"2024-09-12T01:22:33.484728+0000","last_fullsized":"2024-09-12T01:22:33.484728+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:33.484539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:33.484539+0000","last_clean_scrub_stamp":"2024-09-12T01:22:33.484539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:58.707395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'140","reported_seq":660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:43.527637+0000","last_change":"2024-09-12T01:22:43.527637+0000","last_active":"2024-09-12T01:22:43.527637+0000","last_peered":"2024-09-12T01:22:43.527637+0000","last_clean":"2024-09-12T01:22:43.527637+0000","last_became_active":"2024-09-12T00:35:53.997969+0000","last_became_peered":"2024-09-12T00:35:53.997969+0000","last_unstale":"2024-09-12T01:22:43.527637+0000","last_undegraded":"2024-09-12T01:22:43.527637+0000","last_fullsized":"2024-09-12T01:22:43.527637+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'140","last_scrub_stamp":"2024-09-12T01:22:43.527440+0000","last_deep_scrub":"265'140","last_deep_scrub_stamp":"2024-09-12T01:22:43.527440+0000","last_clean_scrub_stamp":"2024-09-12T01:22:43.527440+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:22.757047+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":591,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":213,"num_read_kb":189,"num_write":344,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'118","reported_seq":710,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.065435+0000","last_change":"2024-09-12T01:22:18.065435+0000","last_active":"2024-09-12T01:22:18.065435+0000","last_peered":"2024-09-12T01:22:18.065435+0000","last_clean":"2024-09-12T01:22:18.065435+0000","last_became_active":"2024-09-12T00:35:45.937597+0000","last_became_peered":"2024-09-12T00:35:45.937597+0000","last_unstale":"2024-09-12T01:22:18.065435+0000","last_undegraded":"2024-09-12T01:22:18.065435+0000","last_fullsized":"2024-09-12T01:22:18.065435+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'118","last_scrub_stamp":"2024-09-12T01:22:18.065264+0000","last_deep_scrub":"265'118","last_deep_scrub_stamp":"2024-09-12T01:22:18.065264+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.065264+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:09.449396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":514,"num_read_kb":428,"num_write":167,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'305","reported_seq":907,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.754730+0000","last_change":"2024-09-12T01:22:10.754730+0000","last_active":"2024-09-12T01:22:10.754730+0000","last_peered":"2024-09-12T01:22:10.754730+0000","last_clean":"2024-09-12T01:22:10.754730+0000","last_became_active":"2024-09-12T00:35:43.913717+0000","last_became_peered":"2024-09-12T00:35:43.913717+0000","last_unstale":"2024-09-12T01:22:10.754730+0000","last_undegraded":"2024-09-12T01:22:10.754730+0000","last_fullsized":"2024-09-12T01:22:10.754730+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'305","last_scrub_stamp":"2024-09-12T01:22:10.754524+0000","last_deep_scrub":"265'305","last_deep_scrub_stamp":"2024-09-12T01:22:10.754524+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.754524+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:56.169168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":6749,"num_write":932,"num_write_kb":25345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:28.704366+0000","last_change":"2024-09-12T01:22:28.704366+0000","last_active":"2024-09-12T01:22:28.704366+0000","last_peered":"2024-09-12T01:22:28.704366+0000","last_clean":"2024-09-12T01:22:28.704366+0000","last_became_active":"2024-09-12T00:35:47.940170+0000","last_became_peered":"2024-09-12T00:35:47.940170+0000","last_unstale":"2024-09-12T01:22:28.704366+0000","last_undegraded":"2024-09-12T01:22:28.704366+0000","last_fullsized":"2024-09-12T01:22:28.704366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:28.704185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:28.704185+0000","last_clean_scrub_stamp":"2024-09-12T01:22:28.704185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:03.267354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'281","reported_seq":857,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:27.485365+0000","last_change":"2024-09-12T01:22:27.485365+0000","last_active":"2024-09-12T01:22:27.485365+0000","last_peered":"2024-09-12T01:22:27.485365+0000","last_clean":"2024-09-12T01:22:27.485365+0000","last_became_active":"2024-09-12T00:35:49.952570+0000","last_became_peered":"2024-09-12T00:35:49.952570+0000","last_unstale":"2024-09-12T01:22:27.485365+0000","last_undegraded":"2024-09-12T01:22:27.485365+0000","last_fullsized":"2024-09-12T01:22:27.485365+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'281","last_scrub_stamp":"2024-09-12T01:22:27.485160+0000","last_deep_scrub":"265'281","last_deep_scrub_stamp":"2024-09-12T01:22:27.485160+0000","last_clean_scrub_stamp":"2024-09-12T01:22:27.485160+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:19.061870+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47159,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":464,"num_read_kb":1078,"num_write":380,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:25.109601+0000","last_change":"2024-09-12T01:22:25.109601+0000","last_active":"2024-09-12T01:22:25.109601+0000","last_peered":"2024-09-12T01:22:25.109601+0000","last_clean":"2024-09-12T01:22:25.109601+0000","last_became_active":"2024-09-12T00:35:51.973732+0000","last_became_peered":"2024-09-12T00:35:51.973732+0000","last_unstale":"2024-09-12T01:22:25.109601+0000","last_undegraded":"2024-09-12T01:22:25.109601+0000","last_fullsized":"2024-09-12T01:22:25.109601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:25.109424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:25.109424+0000","last_clean_scrub_stamp":"2024-09-12T01:22:25.109424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:23.761850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'195","reported_seq":716,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:44.708585+0000","last_change":"2024-09-12T01:22:44.708585+0000","last_active":"2024-09-12T01:22:44.708585+0000","last_peered":"2024-09-12T01:22:44.708585+0000","last_clean":"2024-09-12T01:22:44.708585+0000","last_became_active":"2024-09-12T00:35:54.016028+0000","last_became_peered":"2024-09-12T00:35:54.016028+0000","last_unstale":"2024-09-12T01:22:44.708585+0000","last_undegraded":"2024-09-12T01:22:44.708585+0000","last_fullsized":"2024-09-12T01:22:44.708585+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'195","last_scrub_stamp":"2024-09-12T01:22:44.708346+0000","last_deep_scrub":"265'195","last_deep_scrub_stamp":"2024-09-12T01:22:44.708346+0000","last_clean_scrub_stamp":"2024-09-12T01:22:44.708346+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:01.384781+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":175,"num_read_kb":171,"num_write":438,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'198","reported_seq":819,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.646649+0000","last_change":"2024-09-12T01:22:18.646649+0000","last_active":"2024-09-12T01:22:18.646649+0000","last_peered":"2024-09-12T01:22:18.646649+0000","last_clean":"2024-09-12T01:22:18.646649+0000","last_became_active":"2024-09-12T00:35:45.941396+0000","last_became_peered":"2024-09-12T00:35:45.941396+0000","last_unstale":"2024-09-12T01:22:18.646649+0000","last_undegraded":"2024-09-12T01:22:18.646649+0000","last_fullsized":"2024-09-12T01:22:18.646649+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'198","last_scrub_stamp":"2024-09-12T01:22:18.646473+0000","last_deep_scrub":"265'198","last_deep_scrub_stamp":"2024-09-12T01:22:18.646473+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.646473+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:34.987983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":858,"num_read_kb":711,"num_write":323,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'462","reported_seq":1346,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.610259+0000","last_change":"2024-09-12T01:22:07.610259+0000","last_active":"2024-09-12T01:22:07.610259+0000","last_peered":"2024-09-12T01:22:07.610259+0000","last_clean":"2024-09-12T01:22:07.610259+0000","last_became_active":"2024-09-12T00:35:43.942359+0000","last_became_peered":"2024-09-12T00:35:43.942359+0000","last_unstale":"2024-09-12T01:22:07.610259+0000","last_undegraded":"2024-09-12T01:22:07.610259+0000","last_fullsized":"2024-09-12T01:22:07.610259+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'462","last_scrub_stamp":"2024-09-12T01:22:07.610037+0000","last_deep_scrub":"265'462","last_deep_scrub_stamp":"2024-09-12T01:22:07.610037+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.610037+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:31.652109+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1122,"num_read_kb":58431,"num_write":1508,"num_write_kb":72479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:26.881687+0000","last_change":"2024-09-12T01:22:26.881687+0000","last_active":"2024-09-12T01:22:26.881687+0000","last_peered":"2024-09-12T01:22:26.881687+0000","last_clean":"2024-09-12T01:22:26.881687+0000","last_became_active":"2024-09-12T00:35:47.940501+0000","last_became_peered":"2024-09-12T00:35:47.940501+0000","last_unstale":"2024-09-12T01:22:26.881687+0000","last_undegraded":"2024-09-12T01:22:26.881687+0000","last_fullsized":"2024-09-12T01:22:26.881687+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:26.881512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:26.881512+0000","last_clean_scrub_stamp":"2024-09-12T01:22:26.881512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:26.697220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'231","reported_seq":799,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:33.617118+0000","last_change":"2024-09-12T01:22:33.617118+0000","last_active":"2024-09-12T01:22:33.617118+0000","last_peered":"2024-09-12T01:22:33.617118+0000","last_clean":"2024-09-12T01:22:33.617118+0000","last_became_active":"2024-09-12T00:35:49.955264+0000","last_became_peered":"2024-09-12T00:35:49.955264+0000","last_unstale":"2024-09-12T01:22:33.617118+0000","last_undegraded":"2024-09-12T01:22:33.617118+0000","last_fullsized":"2024-09-12T01:22:33.617118+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'231","last_scrub_stamp":"2024-09-12T01:22:33.616855+0000","last_deep_scrub":"265'231","last_deep_scrub_stamp":"2024-09-12T01:22:33.616855+0000","last_clean_scrub_stamp":"2024-09-12T01:22:33.616855+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:39.383012+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44002,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":385,"num_read_kb":903,"num_write":312,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:35.958478+0000","last_change":"2024-09-12T01:22:35.958478+0000","last_active":"2024-09-12T01:22:35.958478+0000","last_peered":"2024-09-12T01:22:35.958478+0000","last_clean":"2024-09-12T01:22:35.958478+0000","last_became_active":"2024-09-12T00:35:51.961691+0000","last_became_peered":"2024-09-12T00:35:51.961691+0000","last_unstale":"2024-09-12T01:22:35.958478+0000","last_undegraded":"2024-09-12T01:22:35.958478+0000","last_fullsized":"2024-09-12T01:22:35.958478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:35.958302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:35.958302+0000","last_clean_scrub_stamp":"2024-09-12T01:22:35.958302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:53.107582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'199","reported_seq":1664,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:38.475707+0000","last_change":"2024-09-12T01:22:38.475707+0000","last_active":"2024-09-12T01:22:38.475707+0000","last_peered":"2024-09-12T01:22:38.475707+0000","last_clean":"2024-09-12T01:22:38.475707+0000","last_became_active":"2024-09-12T00:35:53.991532+0000","last_became_peered":"2024-09-12T00:35:53.991532+0000","last_unstale":"2024-09-12T01:22:38.475707+0000","last_undegraded":"2024-09-12T01:22:38.475707+0000","last_fullsized":"2024-09-12T01:22:38.475707+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'199","last_scrub_stamp":"2024-09-12T01:22:38.475475+0000","last_deep_scrub":"265'199","last_deep_scrub_stamp":"2024-09-12T01:22:38.475475+0000","last_clean_scrub_stamp":"2024-09-12T01:22:38.475475+0000","objects_scrubbed":5,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:31.432500+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1185,"num_read_kb":1184,"num_write":442,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'185","reported_seq":804,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.985260+0000","last_change":"2024-09-12T01:22:14.985260+0000","last_active":"2024-09-12T01:22:14.985260+0000","last_peered":"2024-09-12T01:22:14.985260+0000","last_clean":"2024-09-12T01:22:14.985260+0000","last_became_active":"2024-09-12T00:35:45.954474+0000","last_became_peered":"2024-09-12T00:35:45.954474+0000","last_unstale":"2024-09-12T01:22:14.985260+0000","last_undegraded":"2024-09-12T01:22:14.985260+0000","last_fullsized":"2024-09-12T01:22:14.985260+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'185","last_scrub_stamp":"2024-09-12T01:22:14.985076+0000","last_deep_scrub":"265'185","last_deep_scrub_stamp":"2024-09-12T01:22:14.985076+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.985076+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:20.057452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":774,"num_read_kb":643,"num_write":252,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'374","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.636292+0000","last_change":"2024-09-12T01:22:07.636292+0000","last_active":"2024-09-12T01:22:07.636292+0000","last_peered":"2024-09-12T01:22:07.636292+0000","last_clean":"2024-09-12T01:22:07.636292+0000","last_became_active":"2024-09-12T00:35:43.934998+0000","last_became_peered":"2024-09-12T00:35:43.934998+0000","last_unstale":"2024-09-12T01:22:07.636292+0000","last_undegraded":"2024-09-12T01:22:07.636292+0000","last_fullsized":"2024-09-12T01:22:07.636292+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T01:22:07.636085+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T01:22:07.636085+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.636085+0000","objects_scrubbed":6,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:58.942568+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":520,"num_read_kb":15471,"num_write":1132,"num_write_kb":44978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"265'2","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.266105+0000","last_change":"2024-09-12T01:22:18.266105+0000","last_active":"2024-09-12T01:22:18.266105+0000","last_peered":"2024-09-12T01:22:18.266105+0000","last_clean":"2024-09-12T01:22:18.266105+0000","last_became_active":"2024-09-12T00:35:47.928424+0000","last_became_peered":"2024-09-12T00:35:47.928424+0000","last_unstale":"2024-09-12T01:22:18.266105+0000","last_undegraded":"2024-09-12T01:22:18.266105+0000","last_fullsized":"2024-09-12T01:22:18.266105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:18.265915+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:18.265915+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.265915+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:57.030554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'303","reported_seq":909,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:31.988009+0000","last_change":"2024-09-12T01:22:31.988009+0000","last_active":"2024-09-12T01:22:31.988009+0000","last_peered":"2024-09-12T01:22:31.988009+0000","last_clean":"2024-09-12T01:22:31.988009+0000","last_became_active":"2024-09-12T00:35:49.933165+0000","last_became_peered":"2024-09-12T00:35:49.933165+0000","last_unstale":"2024-09-12T01:22:31.988009+0000","last_undegraded":"2024-09-12T01:22:31.988009+0000","last_fullsized":"2024-09-12T01:22:31.988009+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'303","last_scrub_stamp":"2024-09-12T01:22:31.987769+0000","last_deep_scrub":"265'303","last_deep_scrub_stamp":"2024-09-12T01:22:31.987769+0000","last_clean_scrub_stamp":"2024-09-12T01:22:31.987769+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:32.048586+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49116,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":493,"num_read_kb":1065,"num_write":392,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:43.408422+0000","last_change":"2024-09-12T01:22:43.408422+0000","last_active":"2024-09-12T01:22:43.408422+0000","last_peered":"2024-09-12T01:22:43.408422+0000","last_clean":"2024-09-12T01:22:43.408422+0000","last_became_active":"2024-09-12T00:35:51.984756+0000","last_became_peered":"2024-09-12T00:35:51.984756+0000","last_unstale":"2024-09-12T01:22:43.408422+0000","last_undegraded":"2024-09-12T01:22:43.408422+0000","last_fullsized":"2024-09-12T01:22:43.408422+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:43.408199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:43.408199+0000","last_clean_scrub_stamp":"2024-09-12T01:22:43.408199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:33.896156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'191","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:37.917931+0000","last_change":"2024-09-12T01:22:37.917782+0000","last_active":"2024-09-12T01:22:37.917931+0000","last_peered":"2024-09-12T01:22:37.917931+0000","last_clean":"2024-09-12T01:22:37.917931+0000","last_became_active":"2024-09-12T00:35:53.985486+0000","last_became_peered":"2024-09-12T00:35:53.985486+0000","last_unstale":"2024-09-12T01:22:37.917931+0000","last_undegraded":"2024-09-12T01:22:37.917931+0000","last_fullsized":"2024-09-12T01:22:37.917931+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'191","last_scrub_stamp":"2024-09-12T01:22:37.917552+0000","last_deep_scrub":"265'191","last_deep_scrub_stamp":"2024-09-12T01:22:37.917552+0000","last_clean_scrub_stamp":"2024-09-12T01:22:37.917552+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:54.809592+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1062,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":193,"num_read_kb":167,"num_write":361,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'182","reported_seq":732,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.261888+0000","last_change":"2024-09-12T01:22:19.261888+0000","last_active":"2024-09-12T01:22:19.261888+0000","last_peered":"2024-09-12T01:22:19.261888+0000","last_clean":"2024-09-12T01:22:19.261888+0000","last_became_active":"2024-09-12T00:35:45.957698+0000","last_became_peered":"2024-09-12T00:35:45.957698+0000","last_unstale":"2024-09-12T01:22:19.261888+0000","last_undegraded":"2024-09-12T01:22:19.261888+0000","last_fullsized":"2024-09-12T01:22:19.261888+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'182","last_scrub_stamp":"2024-09-12T01:22:19.261702+0000","last_deep_scrub":"265'182","last_deep_scrub_stamp":"2024-09-12T01:22:19.261702+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.261702+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:20.463886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":768,"num_read_kb":623,"num_write":277,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'396","reported_seq":1075,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.181416+0000","last_change":"2024-09-12T01:22:08.181416+0000","last_active":"2024-09-12T01:22:08.181416+0000","last_peered":"2024-09-12T01:22:08.181416+0000","last_clean":"2024-09-12T01:22:08.181416+0000","last_became_active":"2024-09-12T00:35:43.937281+0000","last_became_peered":"2024-09-12T00:35:43.937281+0000","last_unstale":"2024-09-12T01:22:08.181416+0000","last_undegraded":"2024-09-12T01:22:08.181416+0000","last_fullsized":"2024-09-12T01:22:08.181416+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'396","last_scrub_stamp":"2024-09-12T01:22:08.181179+0000","last_deep_scrub":"265'396","last_deep_scrub_stamp":"2024-09-12T01:22:08.181179+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.181179+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:58.834889+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550668,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":606,"num_read_kb":52877,"num_write":1364,"num_write_kb":41162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'421","reported_seq":1118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.183784+0000","last_change":"2024-09-12T01:22:15.183784+0000","last_active":"2024-09-12T01:22:15.183784+0000","last_peered":"2024-09-12T01:22:15.183784+0000","last_clean":"2024-09-12T01:22:15.183784+0000","last_became_active":"2024-09-12T00:35:45.932615+0000","last_became_peered":"2024-09-12T00:35:45.932615+0000","last_unstale":"2024-09-12T01:22:15.183784+0000","last_undegraded":"2024-09-12T01:22:15.183784+0000","last_fullsized":"2024-09-12T01:22:15.183784+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'421","last_scrub_stamp":"2024-09-12T01:22:15.183600+0000","last_deep_scrub":"265'421","last_deep_scrub_stamp":"2024-09-12T01:22:15.183600+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.183600+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:05.389393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2107,"num_read_kb":1905,"num_write":744,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'291","reported_seq":960,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.448034+0000","last_change":"2024-09-12T01:22:08.448034+0000","last_active":"2024-09-12T01:22:08.448034+0000","last_peered":"2024-09-12T01:22:08.448034+0000","last_clean":"2024-09-12T01:22:08.448034+0000","last_became_active":"2024-09-12T00:35:43.922005+0000","last_became_peered":"2024-09-12T00:35:43.922005+0000","last_unstale":"2024-09-12T01:22:08.448034+0000","last_undegraded":"2024-09-12T01:22:08.448034+0000","last_fullsized":"2024-09-12T01:22:08.448034+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'291","last_scrub_stamp":"2024-09-12T01:22:08.447802+0000","last_deep_scrub":"265'291","last_deep_scrub_stamp":"2024-09-12T01:22:08.447802+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.447802+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:44.780769+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":535,"num_read_kb":1388,"num_write":997,"num_write_kb":25405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'246","reported_seq":873,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.721615+0000","last_change":"2024-09-12T01:22:19.721615+0000","last_active":"2024-09-12T01:22:19.721615+0000","last_peered":"2024-09-12T01:22:19.721615+0000","last_clean":"2024-09-12T01:22:19.721615+0000","last_became_active":"2024-09-12T00:35:45.940153+0000","last_became_peered":"2024-09-12T00:35:45.940153+0000","last_unstale":"2024-09-12T01:22:19.721615+0000","last_undegraded":"2024-09-12T01:22:19.721615+0000","last_fullsized":"2024-09-12T01:22:19.721615+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'246","last_scrub_stamp":"2024-09-12T01:22:19.721431+0000","last_deep_scrub":"265'246","last_deep_scrub_stamp":"2024-09-12T01:22:19.721431+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.721431+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:39.443952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1055,"num_read_kb":856,"num_write":397,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'353","reported_seq":969,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.429300+0000","last_change":"2024-09-12T01:22:11.429300+0000","last_active":"2024-09-12T01:22:11.429300+0000","last_peered":"2024-09-12T01:22:11.429300+0000","last_clean":"2024-09-12T01:22:11.429300+0000","last_became_active":"2024-09-12T00:36:17.267594+0000","last_became_peered":"2024-09-12T00:36:17.267594+0000","last_unstale":"2024-09-12T01:22:11.429300+0000","last_undegraded":"2024-09-12T01:22:11.429300+0000","last_fullsized":"2024-09-12T01:22:11.429300+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'353","last_scrub_stamp":"2024-09-12T01:22:11.429005+0000","last_deep_scrub":"265'353","last_deep_scrub_stamp":"2024-09-12T01:22:11.429005+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.429005+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:45.151943+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436874,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":471,"num_read_kb":41052,"num_write":1136,"num_write_kb":25796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"265'93","reported_seq":678,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.152389+0000","last_change":"2024-09-12T01:22:14.152389+0000","last_active":"2024-09-12T01:22:14.152389+0000","last_peered":"2024-09-12T01:22:14.152389+0000","last_clean":"2024-09-12T01:22:14.152389+0000","last_became_active":"2024-09-12T00:35:45.945534+0000","last_became_peered":"2024-09-12T00:35:45.945534+0000","last_unstale":"2024-09-12T01:22:14.152389+0000","last_undegraded":"2024-09-12T01:22:14.152389+0000","last_fullsized":"2024-09-12T01:22:14.152389+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'93","last_scrub_stamp":"2024-09-12T01:22:14.152209+0000","last_deep_scrub":"265'93","last_deep_scrub_stamp":"2024-09-12T01:22:14.152209+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.152209+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:25.890852+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":411,"num_read_kb":349,"num_write":136,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'324","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.602990+0000","last_change":"2024-09-12T01:22:08.602990+0000","last_active":"2024-09-12T01:22:08.602990+0000","last_peered":"2024-09-12T01:22:08.602990+0000","last_clean":"2024-09-12T01:22:08.602990+0000","last_became_active":"2024-09-12T00:35:43.934068+0000","last_became_peered":"2024-09-12T00:35:43.934068+0000","last_unstale":"2024-09-12T01:22:08.602990+0000","last_undegraded":"2024-09-12T01:22:08.602990+0000","last_fullsized":"2024-09-12T01:22:08.602990+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T01:22:08.602769+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T01:22:08.602769+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.602769+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:18.211995+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":780267,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":473,"num_read_kb":16449,"num_write":1046,"num_write_kb":32400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'160","reported_seq":804,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.624197+0000","last_change":"2024-09-12T01:22:22.624197+0000","last_active":"2024-09-12T01:22:22.624197+0000","last_peered":"2024-09-12T01:22:22.624197+0000","last_clean":"2024-09-12T01:22:22.624197+0000","last_became_active":"2024-09-12T00:35:45.944423+0000","last_became_peered":"2024-09-12T00:35:45.944423+0000","last_unstale":"2024-09-12T01:22:22.624197+0000","last_undegraded":"2024-09-12T01:22:22.624197+0000","last_fullsized":"2024-09-12T01:22:22.624197+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'160","last_scrub_stamp":"2024-09-12T01:22:22.623982+0000","last_deep_scrub":"265'160","last_deep_scrub_stamp":"2024-09-12T01:22:22.623982+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.623982+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:20.633894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":713,"num_read_kb":599,"num_write":226,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"265'346","reported_seq":1024,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.595018+0000","last_change":"2024-09-12T01:22:09.595018+0000","last_active":"2024-09-12T01:22:09.595018+0000","last_peered":"2024-09-12T01:22:09.595018+0000","last_clean":"2024-09-12T01:22:09.595018+0000","last_became_active":"2024-09-12T00:35:43.937104+0000","last_became_peered":"2024-09-12T00:35:43.937104+0000","last_unstale":"2024-09-12T01:22:09.595018+0000","last_undegraded":"2024-09-12T01:22:09.595018+0000","last_fullsized":"2024-09-12T01:22:09.595018+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'346","last_scrub_stamp":"2024-09-12T01:22:09.594896+0000","last_deep_scrub":"265'346","last_deep_scrub_stamp":"2024-09-12T01:22:09.594896+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.594896+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:28.710562+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262271,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":572,"num_read_kb":63038,"num_write":1116,"num_write_kb":29306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'252","reported_seq":855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.042216+0000","last_change":"2024-09-12T01:22:17.042216+0000","last_active":"2024-09-12T01:22:17.042216+0000","last_peered":"2024-09-12T01:22:17.042216+0000","last_clean":"2024-09-12T01:22:17.042216+0000","last_became_active":"2024-09-12T00:35:45.957860+0000","last_became_peered":"2024-09-12T00:35:45.957860+0000","last_unstale":"2024-09-12T01:22:17.042216+0000","last_undegraded":"2024-09-12T01:22:17.042216+0000","last_fullsized":"2024-09-12T01:22:17.042216+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'252","last_scrub_stamp":"2024-09-12T01:22:17.042033+0000","last_deep_scrub":"265'252","last_deep_scrub_stamp":"2024-09-12T01:22:17.042033+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.042033+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:06.623032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1076,"num_read_kb":859,"num_write":407,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":266,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'346","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.234790+0000","last_change":"2024-09-12T01:22:09.234790+0000","last_active":"2024-09-12T01:22:09.234790+0000","last_peered":"2024-09-12T01:22:09.234790+0000","last_clean":"2024-09-12T01:22:09.234790+0000","last_became_active":"2024-09-12T00:35:43.929027+0000","last_became_peered":"2024-09-12T00:35:43.929027+0000","last_unstale":"2024-09-12T01:22:09.234790+0000","last_undegraded":"2024-09-12T01:22:09.234790+0000","last_fullsized":"2024-09-12T01:22:09.234790+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'346","last_scrub_stamp":"2024-09-12T01:22:09.234559+0000","last_deep_scrub":"265'346","last_deep_scrub_stamp":"2024-09-12T01:22:09.234559+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.234559+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:22.211508+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":588,"num_read_kb":747,"num_write":1224,"num_write_kb":5740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'102","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.588099+0000","last_change":"2024-09-12T01:22:20.588099+0000","last_active":"2024-09-12T01:22:20.588099+0000","last_peered":"2024-09-12T01:22:20.588099+0000","last_clean":"2024-09-12T01:22:20.588099+0000","last_became_active":"2024-09-12T00:35:45.948581+0000","last_became_peered":"2024-09-12T00:35:45.948581+0000","last_unstale":"2024-09-12T01:22:20.588099+0000","last_undegraded":"2024-09-12T01:22:20.588099+0000","last_fullsized":"2024-09-12T01:22:20.588099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'102","last_scrub_stamp":"2024-09-12T01:22:20.587828+0000","last_deep_scrub":"265'102","last_deep_scrub_stamp":"2024-09-12T01:22:20.587828+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.587828+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:41.592609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":463,"num_read_kb":395,"num_write":145,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"265'337","reported_seq":976,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.202666+0000","last_change":"2024-09-12T01:22:09.202666+0000","last_active":"2024-09-12T01:22:09.202666+0000","last_peered":"2024-09-12T01:22:09.202666+0000","last_clean":"2024-09-12T01:22:09.202666+0000","last_became_active":"2024-09-12T00:35:43.941155+0000","last_became_peered":"2024-09-12T00:35:43.941155+0000","last_unstale":"2024-09-12T01:22:09.202666+0000","last_undegraded":"2024-09-12T01:22:09.202666+0000","last_fullsized":"2024-09-12T01:22:09.202666+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'337","last_scrub_stamp":"2024-09-12T01:22:09.202393+0000","last_deep_scrub":"265'337","last_deep_scrub_stamp":"2024-09-12T01:22:09.202393+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.202393+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:57.460847+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":4200,"num_write":1081,"num_write_kb":60173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"265'210","reported_seq":851,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.155108+0000","last_change":"2024-09-12T01:22:15.155108+0000","last_active":"2024-09-12T01:22:15.155108+0000","last_peered":"2024-09-12T01:22:15.155108+0000","last_clean":"2024-09-12T01:22:15.155108+0000","last_became_active":"2024-09-12T00:35:45.946047+0000","last_became_peered":"2024-09-12T00:35:45.946047+0000","last_unstale":"2024-09-12T01:22:15.155108+0000","last_undegraded":"2024-09-12T01:22:15.155108+0000","last_fullsized":"2024-09-12T01:22:15.155108+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'210","last_scrub_stamp":"2024-09-12T01:22:15.154905+0000","last_deep_scrub":"265'210","last_deep_scrub_stamp":"2024-09-12T01:22:15.154905+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.154905+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:58.436758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":932,"num_read_kb":766,"num_write":302,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'323","reported_seq":970,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.593629+0000","last_change":"2024-09-12T01:22:11.593629+0000","last_active":"2024-09-12T01:22:11.593629+0000","last_peered":"2024-09-12T01:22:11.593629+0000","last_clean":"2024-09-12T01:22:11.593629+0000","last_became_active":"2024-09-12T00:35:43.923685+0000","last_became_peered":"2024-09-12T00:35:43.923685+0000","last_unstale":"2024-09-12T01:22:11.593629+0000","last_undegraded":"2024-09-12T01:22:11.593629+0000","last_fullsized":"2024-09-12T01:22:11.593629+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'323","last_scrub_stamp":"2024-09-12T01:22:11.593437+0000","last_deep_scrub":"265'323","last_deep_scrub_stamp":"2024-09-12T01:22:11.593437+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.593437+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:28.420949+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524322,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":440,"num_read_kb":73837,"num_write":961,"num_write_kb":48353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'100","reported_seq":687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.511606+0000","last_change":"2024-09-12T01:22:20.511454+0000","last_active":"2024-09-12T01:22:20.511606+0000","last_peered":"2024-09-12T01:22:20.511606+0000","last_clean":"2024-09-12T01:22:20.511606+0000","last_became_active":"2024-09-12T00:35:45.941986+0000","last_became_peered":"2024-09-12T00:35:45.941986+0000","last_unstale":"2024-09-12T01:22:20.511606+0000","last_undegraded":"2024-09-12T01:22:20.511606+0000","last_fullsized":"2024-09-12T01:22:20.511606+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'100","last_scrub_stamp":"2024-09-12T01:22:20.511244+0000","last_deep_scrub":"265'100","last_deep_scrub_stamp":"2024-09-12T01:22:20.511244+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.511244+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:50.075824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":455,"num_read_kb":381,"num_write":169,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'340","reported_seq":1062,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.780884+0000","last_change":"2024-09-12T01:22:11.780884+0000","last_active":"2024-09-12T01:22:11.780884+0000","last_peered":"2024-09-12T01:22:11.780884+0000","last_clean":"2024-09-12T01:22:11.780884+0000","last_became_active":"2024-09-12T00:35:43.911654+0000","last_became_peered":"2024-09-12T00:35:43.911654+0000","last_unstale":"2024-09-12T01:22:11.780884+0000","last_undegraded":"2024-09-12T01:22:11.780884+0000","last_fullsized":"2024-09-12T01:22:11.780884+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'340","last_scrub_stamp":"2024-09-12T01:22:11.780673+0000","last_deep_scrub":"265'340","last_deep_scrub_stamp":"2024-09-12T01:22:11.780673+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.780673+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:55.696701+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262180,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":572,"num_read_kb":5667,"num_write":1085,"num_write_kb":32435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'262","reported_seq":861,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.999977+0000","last_change":"2024-09-12T01:22:19.999817+0000","last_active":"2024-09-12T01:22:19.999977+0000","last_peered":"2024-09-12T01:22:19.999977+0000","last_clean":"2024-09-12T01:22:19.999977+0000","last_became_active":"2024-09-12T00:35:45.926462+0000","last_became_peered":"2024-09-12T00:35:45.926462+0000","last_unstale":"2024-09-12T01:22:19.999977+0000","last_undegraded":"2024-09-12T01:22:19.999977+0000","last_fullsized":"2024-09-12T01:22:19.999977+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'262","last_scrub_stamp":"2024-09-12T01:22:19.999635+0000","last_deep_scrub":"265'262","last_deep_scrub_stamp":"2024-09-12T01:22:19.999635+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.999635+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:24.196701+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1050,"num_read_kb":836,"num_write":420,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'331","reported_seq":1014,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.620507+0000","last_change":"2024-09-12T01:22:10.620366+0000","last_active":"2024-09-12T01:22:10.620507+0000","last_peered":"2024-09-12T01:22:10.620507+0000","last_clean":"2024-09-12T01:22:10.620507+0000","last_became_active":"2024-09-12T00:35:43.936883+0000","last_became_peered":"2024-09-12T00:35:43.936883+0000","last_unstale":"2024-09-12T01:22:10.620507+0000","last_undegraded":"2024-09-12T01:22:10.620507+0000","last_fullsized":"2024-09-12T01:22:10.620507+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'331","last_scrub_stamp":"2024-09-12T01:22:10.620182+0000","last_deep_scrub":"265'331","last_deep_scrub_stamp":"2024-09-12T01:22:10.620182+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.620182+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:09.832438+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2075264,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":536,"num_read_kb":80814,"num_write":1042,"num_write_kb":32955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"265'151","reported_seq":745,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.482818+0000","last_change":"2024-09-12T01:22:05.482818+0000","last_active":"2024-09-12T01:22:05.482818+0000","last_peered":"2024-09-12T01:22:05.482818+0000","last_clean":"2024-09-12T01:22:05.482818+0000","last_became_active":"2024-09-12T00:35:45.958997+0000","last_became_peered":"2024-09-12T00:35:45.958997+0000","last_unstale":"2024-09-12T01:22:05.482818+0000","last_undegraded":"2024-09-12T01:22:05.482818+0000","last_fullsized":"2024-09-12T01:22:05.482818+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'151","last_scrub_stamp":"2024-09-12T01:22:05.482621+0000","last_deep_scrub":"265'151","last_deep_scrub_stamp":"2024-09-12T01:22:05.482621+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.482621+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:24.195434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":623,"num_read_kb":511,"num_write":250,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'381","reported_seq":1048,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.784189+0000","last_change":"2024-09-12T01:22:12.784028+0000","last_active":"2024-09-12T01:22:12.784189+0000","last_peered":"2024-09-12T01:22:12.784189+0000","last_clean":"2024-09-12T01:22:12.784189+0000","last_became_active":"2024-09-12T00:35:43.942591+0000","last_became_peered":"2024-09-12T00:35:43.942591+0000","last_unstale":"2024-09-12T01:22:12.784189+0000","last_undegraded":"2024-09-12T01:22:12.784189+0000","last_fullsized":"2024-09-12T01:22:12.784189+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'381","last_scrub_stamp":"2024-09-12T01:22:12.783792+0000","last_deep_scrub":"265'381","last_deep_scrub_stamp":"2024-09-12T01:22:12.783792+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.783792+0000","objects_scrubbed":11,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:25.661993+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":894961,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":508,"num_read_kb":28251,"num_write":1134,"num_write_kb":59925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"265'83","reported_seq":670,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.041734+0000","last_change":"2024-09-12T01:22:19.041603+0000","last_active":"2024-09-12T01:22:19.041734+0000","last_peered":"2024-09-12T01:22:19.041734+0000","last_clean":"2024-09-12T01:22:19.041734+0000","last_became_active":"2024-09-12T00:35:45.954252+0000","last_became_peered":"2024-09-12T00:35:45.954252+0000","last_unstale":"2024-09-12T01:22:19.041734+0000","last_undegraded":"2024-09-12T01:22:19.041734+0000","last_fullsized":"2024-09-12T01:22:19.041734+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'83","last_scrub_stamp":"2024-09-12T01:22:19.041424+0000","last_deep_scrub":"265'83","last_deep_scrub_stamp":"2024-09-12T01:22:19.041424+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.041424+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:10.207954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":370,"num_read_kb":310,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'387","reported_seq":1049,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.572240+0000","last_change":"2024-09-12T01:22:09.572102+0000","last_active":"2024-09-12T01:22:09.572240+0000","last_peered":"2024-09-12T01:22:09.572240+0000","last_clean":"2024-09-12T01:22:09.572240+0000","last_became_active":"2024-09-12T00:35:43.952828+0000","last_became_peered":"2024-09-12T00:35:43.952828+0000","last_unstale":"2024-09-12T01:22:09.572240+0000","last_undegraded":"2024-09-12T01:22:09.572240+0000","last_fullsized":"2024-09-12T01:22:09.572240+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'387","last_scrub_stamp":"2024-09-12T01:22:09.571904+0000","last_deep_scrub":"265'387","last_deep_scrub_stamp":"2024-09-12T01:22:09.571904+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.571904+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:32.922872+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":611,"num_read_kb":10107,"num_write":1280,"num_write_kb":30495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'4193","reported_seq":4827,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.469924+0000","last_change":"2024-09-12T01:22:18.469762+0000","last_active":"2024-09-12T01:22:18.469924+0000","last_peered":"2024-09-12T01:22:18.469924+0000","last_clean":"2024-09-12T01:22:18.469924+0000","last_became_active":"2024-09-12T00:35:45.949770+0000","last_became_peered":"2024-09-12T00:35:45.949770+0000","last_unstale":"2024-09-12T01:22:18.469924+0000","last_undegraded":"2024-09-12T01:22:18.469924+0000","last_fullsized":"2024-09-12T01:22:18.469924+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4193","last_scrub_stamp":"2024-09-12T01:22:18.469588+0000","last_deep_scrub":"265'4193","last_deep_scrub_stamp":"2024-09-12T01:22:18.469588+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.469588+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":3000,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:27.939587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16900,"num_read_kb":14167,"num_write":6311,"num_write_kb":3148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'355","reported_seq":1009,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.209366+0000","last_change":"2024-09-12T01:22:10.209104+0000","last_active":"2024-09-12T01:22:10.209366+0000","last_peered":"2024-09-12T01:22:10.209366+0000","last_clean":"2024-09-12T01:22:10.209366+0000","last_became_active":"2024-09-12T00:35:43.944721+0000","last_became_peered":"2024-09-12T00:35:43.944721+0000","last_unstale":"2024-09-12T01:22:10.209366+0000","last_undegraded":"2024-09-12T01:22:10.209366+0000","last_fullsized":"2024-09-12T01:22:10.209366+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'355","last_scrub_stamp":"2024-09-12T01:22:10.208841+0000","last_deep_scrub":"265'355","last_deep_scrub_stamp":"2024-09-12T01:22:10.208841+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.208841+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:01.036663+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730131,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":532,"num_read_kb":12444,"num_write":1159,"num_write_kb":48295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'222","reported_seq":866,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.539944+0000","last_change":"2024-09-12T01:22:16.539740+0000","last_active":"2024-09-12T01:22:16.539944+0000","last_peered":"2024-09-12T01:22:16.539944+0000","last_clean":"2024-09-12T01:22:16.539944+0000","last_became_active":"2024-09-12T00:35:45.939921+0000","last_became_peered":"2024-09-12T00:35:45.939921+0000","last_unstale":"2024-09-12T01:22:16.539944+0000","last_undegraded":"2024-09-12T01:22:16.539944+0000","last_fullsized":"2024-09-12T01:22:16.539944+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'222","last_scrub_stamp":"2024-09-12T01:22:16.539565+0000","last_deep_scrub":"265'222","last_deep_scrub_stamp":"2024-09-12T01:22:16.539565+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.539565+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:08.131916+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":991,"num_read_kb":821,"num_write":345,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":504,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'347","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.536922+0000","last_change":"2024-09-12T01:22:13.536922+0000","last_active":"2024-09-12T01:22:13.536922+0000","last_peered":"2024-09-12T01:22:13.536922+0000","last_clean":"2024-09-12T01:22:13.536922+0000","last_became_active":"2024-09-12T00:35:43.942772+0000","last_became_peered":"2024-09-12T00:35:43.942772+0000","last_unstale":"2024-09-12T01:22:13.536922+0000","last_undegraded":"2024-09-12T01:22:13.536922+0000","last_fullsized":"2024-09-12T01:22:13.536922+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T01:22:13.536675+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T01:22:13.536675+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.536675+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:15.728162+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2329981,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":472,"num_read_kb":15742,"num_write":1095,"num_write_kb":41173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'153","reported_seq":780,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:23.587385+0000","last_change":"2024-09-12T01:22:23.587221+0000","last_active":"2024-09-12T01:22:23.587385+0000","last_peered":"2024-09-12T01:22:23.587385+0000","last_clean":"2024-09-12T01:22:23.587385+0000","last_became_active":"2024-09-12T00:35:45.937998+0000","last_became_peered":"2024-09-12T00:35:45.937998+0000","last_unstale":"2024-09-12T01:22:23.587385+0000","last_undegraded":"2024-09-12T01:22:23.587385+0000","last_fullsized":"2024-09-12T01:22:23.587385+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'153","last_scrub_stamp":"2024-09-12T01:22:23.587043+0000","last_deep_scrub":"265'153","last_deep_scrub_stamp":"2024-09-12T01:22:23.587043+0000","last_clean_scrub_stamp":"2024-09-12T01:22:23.587043+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:08.881855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":680,"num_read_kb":568,"num_write":226,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'362","reported_seq":1072,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.488740+0000","last_change":"2024-09-12T01:22:07.488496+0000","last_active":"2024-09-12T01:22:07.488740+0000","last_peered":"2024-09-12T01:22:07.488740+0000","last_clean":"2024-09-12T01:22:07.488740+0000","last_became_active":"2024-09-12T00:35:43.940876+0000","last_became_peered":"2024-09-12T00:35:43.940876+0000","last_unstale":"2024-09-12T01:22:07.488740+0000","last_undegraded":"2024-09-12T01:22:07.488740+0000","last_fullsized":"2024-09-12T01:22:07.488740+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'362","last_scrub_stamp":"2024-09-12T01:22:07.488235+0000","last_deep_scrub":"265'362","last_deep_scrub_stamp":"2024-09-12T01:22:07.488235+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.488235+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:21.148458+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":724,"num_read_kb":28886,"num_write":1110,"num_write_kb":16361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'147","reported_seq":792,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.458525+0000","last_change":"2024-09-12T01:22:20.458525+0000","last_active":"2024-09-12T01:22:20.458525+0000","last_peered":"2024-09-12T01:22:20.458525+0000","last_clean":"2024-09-12T01:22:20.458525+0000","last_became_active":"2024-09-12T00:35:45.948028+0000","last_became_peered":"2024-09-12T00:35:45.948028+0000","last_unstale":"2024-09-12T01:22:20.458525+0000","last_undegraded":"2024-09-12T01:22:20.458525+0000","last_fullsized":"2024-09-12T01:22:20.458525+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'147","last_scrub_stamp":"2024-09-12T01:22:20.458339+0000","last_deep_scrub":"265'147","last_deep_scrub_stamp":"2024-09-12T01:22:20.458339+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.458339+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:06.018727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":702,"num_read_kb":590,"num_write":208,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4004,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'347","reported_seq":1033,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.813763+0000","last_change":"2024-09-12T01:22:13.813608+0000","last_active":"2024-09-12T01:22:13.813763+0000","last_peered":"2024-09-12T01:22:13.813763+0000","last_clean":"2024-09-12T01:22:13.813763+0000","last_became_active":"2024-09-12T00:35:43.950791+0000","last_became_peered":"2024-09-12T00:35:43.950791+0000","last_unstale":"2024-09-12T01:22:13.813763+0000","last_undegraded":"2024-09-12T01:22:13.813763+0000","last_fullsized":"2024-09-12T01:22:13.813763+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T01:22:13.813378+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T01:22:13.813378+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.813378+0000","objects_scrubbed":10,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:26.242258+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5529046,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":579,"num_read_kb":37013,"num_write":1080,"num_write_kb":45879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'300","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.828572+0000","last_change":"2024-09-12T01:22:14.828375+0000","last_active":"2024-09-12T01:22:14.828572+0000","last_peered":"2024-09-12T01:22:14.828572+0000","last_clean":"2024-09-12T01:22:14.828572+0000","last_became_active":"2024-09-12T00:35:43.931367+0000","last_became_peered":"2024-09-12T00:35:43.931367+0000","last_unstale":"2024-09-12T01:22:14.828572+0000","last_undegraded":"2024-09-12T01:22:14.828572+0000","last_fullsized":"2024-09-12T01:22:14.828572+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'300","last_scrub_stamp":"2024-09-12T01:22:14.828161+0000","last_deep_scrub":"265'300","last_deep_scrub_stamp":"2024-09-12T01:22:14.828161+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.828161+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:57.972569+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":466,"num_read_kb":37317,"num_write":980,"num_write_kb":22412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'445","reported_seq":1082,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:24.476301+0000","last_change":"2024-09-12T01:22:24.476301+0000","last_active":"2024-09-12T01:22:24.476301+0000","last_peered":"2024-09-12T01:22:24.476301+0000","last_clean":"2024-09-12T01:22:24.476301+0000","last_became_active":"2024-09-12T00:35:45.941136+0000","last_became_peered":"2024-09-12T00:35:45.941136+0000","last_unstale":"2024-09-12T01:22:24.476301+0000","last_undegraded":"2024-09-12T01:22:24.476301+0000","last_fullsized":"2024-09-12T01:22:24.476301+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'445","last_scrub_stamp":"2024-09-12T01:22:24.476113+0000","last_deep_scrub":"265'445","last_deep_scrub_stamp":"2024-09-12T01:22:24.476113+0000","last_clean_scrub_stamp":"2024-09-12T01:22:24.476113+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:41.227716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1924,"num_read_kb":1655,"num_write":712,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3143,"num_omap_keys":13,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'347","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.229317+0000","last_change":"2024-09-12T01:22:17.229188+0000","last_active":"2024-09-12T01:22:17.229317+0000","last_peered":"2024-09-12T01:22:17.229317+0000","last_clean":"2024-09-12T01:22:17.229317+0000","last_became_active":"2024-09-12T00:35:43.936772+0000","last_became_peered":"2024-09-12T00:35:43.936772+0000","last_unstale":"2024-09-12T01:22:17.229317+0000","last_undegraded":"2024-09-12T01:22:17.229317+0000","last_fullsized":"2024-09-12T01:22:17.229317+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T01:22:17.228996+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T01:22:17.228996+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.228996+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:58.587295+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":514466,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":11206,"num_write":1103,"num_write_kb":22250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'123","reported_seq":737,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.713240+0000","last_change":"2024-09-12T01:22:21.713240+0000","last_active":"2024-09-12T01:22:21.713240+0000","last_peered":"2024-09-12T01:22:21.713240+0000","last_clean":"2024-09-12T01:22:21.713240+0000","last_became_active":"2024-09-12T00:35:45.933748+0000","last_became_peered":"2024-09-12T00:35:45.933748+0000","last_unstale":"2024-09-12T01:22:21.713240+0000","last_undegraded":"2024-09-12T01:22:21.713240+0000","last_fullsized":"2024-09-12T01:22:21.713240+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'123","last_scrub_stamp":"2024-09-12T01:22:21.713057+0000","last_deep_scrub":"265'123","last_deep_scrub_stamp":"2024-09-12T01:22:21.713057+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.713057+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:00.223366+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":571,"num_read_kb":478,"num_write":188,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5965,"num_read_kb":4303,"num_write":1960,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6228,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":933,"ondisk_log_size":933,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":15013,"num_read_kb":14673,"num_write":16730,"num_write_kb":4883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2934,"num_omap_keys":19,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2153,"ondisk_log_size":2153,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":588,"ondisk_log_size":588,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1547252,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":17692,"num_read_kb":36824,"num_write":14761,"num_write_kb":11530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":683124,"num_omap_keys":1560,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1852,"ondisk_log_size":1852,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2433,"num_read_kb":2900,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102034,"num_read_kb":85265,"num_write":36996,"num_write_kb":18612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43837,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3949,"ondisk_log_size":3949,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":940,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":73603174,"num_objects":366,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":366,"num_whiteouts":0,"num_read":35859,"num_read_kb":1958475,"num_write":71400,"num_write_kb":2147647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":148455424,"data_stored":147206348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3894,"ondisk_log_size":3894,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":174261,"num_write":154,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":179336,"num_write":154,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424510017,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":135984,"kb_used_data":36832,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94235856,"statfs":{"total":96636764160,"available":96497516544,"internally_reserved":0,"allocated":37715968,"data_stored":35946887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510016,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280192,"kb_used_data":32432,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":94091648,"statfs":{"total":96636764160,"available":96349847552,"internally_reserved":0,"allocated":33210368,"data_stored":31432953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":253688263},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510018,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109536,"kb_used_data":10384,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94262304,"statfs":{"total":96636764160,"available":96524599296,"internally_reserved":0,"allocated":10633216,"data_stored":9073175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510017,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249396,"kb_used_data":29412,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94122444,"statfs":{"total":96636764160,"available":96381382656,"internally_reserved":0,"allocated":30117888,"data_stored":28384468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":225245637},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542720,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250016,"kb_used_data":20304,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94121824,"statfs":{"total":96636764160,"available":96380747776,"internally_reserved":0,"allocated":20791296,"data_stored":19046587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235207114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542719,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":228608,"kb_used_data":16944,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94143232,"statfs":{"total":96636764160,"available":96402669568,"internally_reserved":0,"allocated":17350656,"data_stored":15759617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":216725958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542720,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89728,"kb_used_data":14128,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94282112,"statfs":{"total":96636764160,"available":96544882688,"internally_reserved":0,"allocated":14467072,"data_stored":12799537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575423,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59444,"kb_used_data":14372,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94312396,"statfs":{"total":96636764160,"available":96575893504,"internally_reserved":0,"allocated":14716928,"data_stored":13117126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25833472,"data_stored":25645853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6983680,"data_stored":6928219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11079680,"data_stored":10970794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29499392,"data_stored":29284181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10829824,"data_stored":10653176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34000896,"data_stored":33800787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13717504,"data_stored":13613541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16510976,"data_stored":16309797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":4558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":6362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:23:06.876 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:23:06.876 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:23:06.877 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:23:06.877 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T01:03:39.536130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=3, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=22, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:23:06.881 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:23:26.882 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:23:27.239 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:23:27.255 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-12T01:23:27.271 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":1700,"stamp":"2024-09-12T01:23:25.201737+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75758925,"num_objects":722,"num_object_clones":0,"num_object_copies":1444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":722,"num_whiteouts":0,"num_read":179342,"num_read_kb":2456104,"num_write":142298,"num_write_kb":2416867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":737251,"num_omap_keys":1780,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13666,"ondisk_log_size":13666,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1402904,"kb_used_data":174808,"kb_used_omap":12,"kb_used_meta":1227955,"kb_avail":753571816,"statfs":{"total":773094113280,"available":771657539584,"internally_reserved":0,"allocated":179003392,"data_stored":165560350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1257426480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008404"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:50.514128+0000","last_change":"2024-09-12T01:22:50.514128+0000","last_active":"2024-09-12T01:22:50.514128+0000","last_peered":"2024-09-12T01:22:50.514128+0000","last_clean":"2024-09-12T01:22:50.514128+0000","last_became_active":"2024-09-12T01:03:40.584744+0000","last_became_peered":"2024-09-12T01:03:40.584744+0000","last_unstale":"2024-09-12T01:22:50.514128+0000","last_undegraded":"2024-09-12T01:22:50.514128+0000","last_fullsized":"2024-09-12T01:22:50.514128+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:50.513942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:50.513942+0000","last_clean_scrub_stamp":"2024-09-12T01:22:50.513942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:14.485943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:48.501154+0000","last_change":"2024-09-12T01:22:48.501154+0000","last_active":"2024-09-12T01:22:48.501154+0000","last_peered":"2024-09-12T01:22:48.501154+0000","last_clean":"2024-09-12T01:22:48.501154+0000","last_became_active":"2024-09-12T00:52:40.345120+0000","last_became_peered":"2024-09-12T00:52:40.345120+0000","last_unstale":"2024-09-12T01:22:48.501154+0000","last_undegraded":"2024-09-12T01:22:48.501154+0000","last_fullsized":"2024-09-12T01:22:48.501154+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:48.500952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:48.500952+0000","last_clean_scrub_stamp":"2024-09-12T01:22:48.500952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:17.500848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"265'3","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:53.753350+0000","last_change":"2024-09-12T01:22:53.753350+0000","last_active":"2024-09-12T01:22:53.753350+0000","last_peered":"2024-09-12T01:22:53.753350+0000","last_clean":"2024-09-12T01:22:53.753350+0000","last_became_active":"2024-09-12T00:52:37.276676+0000","last_became_peered":"2024-09-12T00:52:37.276676+0000","last_unstale":"2024-09-12T01:22:53.753350+0000","last_undegraded":"2024-09-12T01:22:53.753350+0000","last_fullsized":"2024-09-12T01:22:53.753350+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:22:53.753131+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:22:53.753131+0000","last_clean_scrub_stamp":"2024-09-12T01:22:53.753131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:47.954002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'38","reported_seq":164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:45.359825+0000","last_change":"2024-09-12T01:22:45.359825+0000","last_active":"2024-09-12T01:22:45.359825+0000","last_peered":"2024-09-12T01:22:45.359825+0000","last_clean":"2024-09-12T01:22:45.359825+0000","last_became_active":"2024-09-12T00:51:04.998763+0000","last_became_peered":"2024-09-12T00:51:04.998763+0000","last_unstale":"2024-09-12T01:22:45.359825+0000","last_undegraded":"2024-09-12T01:22:45.359825+0000","last_fullsized":"2024-09-12T01:22:45.359825+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'38","last_scrub_stamp":"2024-09-12T01:22:45.359617+0000","last_deep_scrub":"265'38","last_deep_scrub_stamp":"2024-09-12T01:22:45.359617+0000","last_clean_scrub_stamp":"2024-09-12T01:22:45.359617+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:42.475697+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":142,"num_write":56,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:32.349358+0000","last_change":"2024-09-12T01:22:32.349358+0000","last_active":"2024-09-12T01:22:32.349358+0000","last_peered":"2024-09-12T01:22:32.349358+0000","last_clean":"2024-09-12T01:22:32.349358+0000","last_became_active":"2024-09-12T01:03:40.581266+0000","last_became_peered":"2024-09-12T01:03:40.581266+0000","last_unstale":"2024-09-12T01:22:32.349358+0000","last_undegraded":"2024-09-12T01:22:32.349358+0000","last_fullsized":"2024-09-12T01:22:32.349358+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:32.349170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:32.349170+0000","last_clean_scrub_stamp":"2024-09-12T01:22:32.349170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:03.847107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"265'2","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:52.892905+0000","last_change":"2024-09-12T01:22:52.892905+0000","last_active":"2024-09-12T01:22:52.892905+0000","last_peered":"2024-09-12T01:22:52.892905+0000","last_clean":"2024-09-12T01:22:52.892905+0000","last_became_active":"2024-09-12T00:52:40.344674+0000","last_became_peered":"2024-09-12T00:52:40.344674+0000","last_unstale":"2024-09-12T01:22:52.892905+0000","last_undegraded":"2024-09-12T01:22:52.892905+0000","last_fullsized":"2024-09-12T01:22:52.892905+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:52.892701+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:52.892701+0000","last_clean_scrub_stamp":"2024-09-12T01:22:52.892701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:37.944983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":10,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'6","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:38.213077+0000","last_change":"2024-09-12T01:22:38.212886+0000","last_active":"2024-09-12T01:22:38.213077+0000","last_peered":"2024-09-12T01:22:38.213077+0000","last_clean":"2024-09-12T01:22:38.213077+0000","last_became_active":"2024-09-12T00:52:37.294438+0000","last_became_peered":"2024-09-12T00:52:37.294438+0000","last_unstale":"2024-09-12T01:22:38.213077+0000","last_undegraded":"2024-09-12T01:22:38.213077+0000","last_fullsized":"2024-09-12T01:22:38.213077+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:22:38.212701+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:22:38.212701+0000","last_clean_scrub_stamp":"2024-09-12T01:22:38.212701+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:19.389441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'42","reported_seq":173,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:24.384515+0000","last_change":"2024-09-12T01:22:24.384364+0000","last_active":"2024-09-12T01:22:24.384515+0000","last_peered":"2024-09-12T01:22:24.384515+0000","last_clean":"2024-09-12T01:22:24.384515+0000","last_became_active":"2024-09-12T00:51:04.961677+0000","last_became_peered":"2024-09-12T00:51:04.961677+0000","last_unstale":"2024-09-12T01:22:24.384515+0000","last_undegraded":"2024-09-12T01:22:24.384515+0000","last_fullsized":"2024-09-12T01:22:24.384515+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'42","last_scrub_stamp":"2024-09-12T01:22:24.384181+0000","last_deep_scrub":"265'42","last_deep_scrub_stamp":"2024-09-12T01:22:24.384181+0000","last_clean_scrub_stamp":"2024-09-12T01:22:24.384181+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:21.287887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":168,"num_write":72,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:41.001246+0000","last_change":"2024-09-12T01:22:41.001116+0000","last_active":"2024-09-12T01:22:41.001246+0000","last_peered":"2024-09-12T01:22:41.001246+0000","last_clean":"2024-09-12T01:22:41.001246+0000","last_became_active":"2024-09-12T01:03:40.576550+0000","last_became_peered":"2024-09-12T01:03:40.576550+0000","last_unstale":"2024-09-12T01:22:41.001246+0000","last_undegraded":"2024-09-12T01:22:41.001246+0000","last_fullsized":"2024-09-12T01:22:41.001246+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:41.000931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:41.000931+0000","last_clean_scrub_stamp":"2024-09-12T01:22:41.000931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:53.971314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"265'5","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:58.201220+0000","last_change":"2024-09-12T01:22:58.201220+0000","last_active":"2024-09-12T01:22:58.201220+0000","last_peered":"2024-09-12T01:22:58.201220+0000","last_clean":"2024-09-12T01:22:58.201220+0000","last_became_active":"2024-09-12T00:52:40.337945+0000","last_became_peered":"2024-09-12T00:52:40.337945+0000","last_unstale":"2024-09-12T01:22:58.201220+0000","last_undegraded":"2024-09-12T01:22:58.201220+0000","last_fullsized":"2024-09-12T01:22:58.201220+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:22:58.201029+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:22:58.201029+0000","last_clean_scrub_stamp":"2024-09-12T01:22:58.201029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:43.070973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:28.466021+0000","last_change":"2024-09-12T01:22:28.465858+0000","last_active":"2024-09-12T01:22:28.466021+0000","last_peered":"2024-09-12T01:22:28.466021+0000","last_clean":"2024-09-12T01:22:28.466021+0000","last_became_active":"2024-09-12T00:52:37.296335+0000","last_became_peered":"2024-09-12T00:52:37.296335+0000","last_unstale":"2024-09-12T01:22:28.466021+0000","last_undegraded":"2024-09-12T01:22:28.466021+0000","last_fullsized":"2024-09-12T01:22:28.466021+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:28.465685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:28.465685+0000","last_clean_scrub_stamp":"2024-09-12T01:22:28.465685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:34.410427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'30","reported_seq":136,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:55.201692+0000","last_change":"2024-09-12T01:22:55.201692+0000","last_active":"2024-09-12T01:22:55.201692+0000","last_peered":"2024-09-12T01:22:55.201692+0000","last_clean":"2024-09-12T01:22:55.201692+0000","last_became_active":"2024-09-12T00:51:04.992519+0000","last_became_peered":"2024-09-12T00:51:04.992519+0000","last_unstale":"2024-09-12T01:22:55.201692+0000","last_undegraded":"2024-09-12T01:22:55.201692+0000","last_fullsized":"2024-09-12T01:22:55.201692+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'30","last_scrub_stamp":"2024-09-12T01:22:55.201504+0000","last_deep_scrub":"265'30","last_deep_scrub_stamp":"2024-09-12T01:22:55.201504+0000","last_clean_scrub_stamp":"2024-09-12T01:22:55.201504+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:05.738274+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":105,"num_write":58,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:23:05.820567+0000","last_change":"2024-09-12T01:23:05.820432+0000","last_active":"2024-09-12T01:23:05.820567+0000","last_peered":"2024-09-12T01:23:05.820567+0000","last_clean":"2024-09-12T01:23:05.820567+0000","last_became_active":"2024-09-12T01:03:40.586582+0000","last_became_peered":"2024-09-12T01:03:40.586582+0000","last_unstale":"2024-09-12T01:23:05.820567+0000","last_undegraded":"2024-09-12T01:23:05.820567+0000","last_fullsized":"2024-09-12T01:23:05.820567+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:23:05.820245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:23:05.820245+0000","last_clean_scrub_stamp":"2024-09-12T01:23:05.820245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:35.268229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'5","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:57.204136+0000","last_change":"2024-09-12T01:22:57.203884+0000","last_active":"2024-09-12T01:22:57.204136+0000","last_peered":"2024-09-12T01:22:57.204136+0000","last_clean":"2024-09-12T01:22:57.204136+0000","last_became_active":"2024-09-12T00:53:18.615877+0000","last_became_peered":"2024-09-12T00:53:18.615877+0000","last_unstale":"2024-09-12T01:22:57.204136+0000","last_undegraded":"2024-09-12T01:22:57.204136+0000","last_fullsized":"2024-09-12T01:22:57.204136+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:22:57.203642+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:22:57.203642+0000","last_clean_scrub_stamp":"2024-09-12T01:22:57.203642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:53.963630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6184,"num_write":5,"num_write_kb":6184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:46.804105+0000","last_change":"2024-09-12T01:22:46.804105+0000","last_active":"2024-09-12T01:22:46.804105+0000","last_peered":"2024-09-12T01:22:46.804105+0000","last_clean":"2024-09-12T01:22:46.804105+0000","last_became_active":"2024-09-12T00:52:37.270357+0000","last_became_peered":"2024-09-12T00:52:37.270357+0000","last_unstale":"2024-09-12T01:22:46.804105+0000","last_undegraded":"2024-09-12T01:22:46.804105+0000","last_fullsized":"2024-09-12T01:22:46.804105+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:46.803902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:46.803902+0000","last_clean_scrub_stamp":"2024-09-12T01:22:46.803902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:56.127839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'29","reported_seq":133,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:51.719446+0000","last_change":"2024-09-12T01:22:51.719446+0000","last_active":"2024-09-12T01:22:51.719446+0000","last_peered":"2024-09-12T01:22:51.719446+0000","last_clean":"2024-09-12T01:22:51.719446+0000","last_became_active":"2024-09-12T00:51:04.994459+0000","last_became_peered":"2024-09-12T00:51:04.994459+0000","last_unstale":"2024-09-12T01:22:51.719446+0000","last_undegraded":"2024-09-12T01:22:51.719446+0000","last_fullsized":"2024-09-12T01:22:51.719446+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'29","last_scrub_stamp":"2024-09-12T01:22:51.719252+0000","last_deep_scrub":"265'29","last_deep_scrub_stamp":"2024-09-12T01:22:51.719252+0000","last_clean_scrub_stamp":"2024-09-12T01:22:51.719252+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:16.492199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":61,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:23:06.775811+0000","last_change":"2024-09-12T01:23:06.775811+0000","last_active":"2024-09-12T01:23:06.775811+0000","last_peered":"2024-09-12T01:23:06.775811+0000","last_clean":"2024-09-12T01:23:06.775811+0000","last_became_active":"2024-09-12T01:03:40.593614+0000","last_became_peered":"2024-09-12T01:03:40.593614+0000","last_unstale":"2024-09-12T01:23:06.775811+0000","last_undegraded":"2024-09-12T01:23:06.775811+0000","last_fullsized":"2024-09-12T01:23:06.775811+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:23:06.775631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:23:06.775631+0000","last_clean_scrub_stamp":"2024-09-12T01:23:06.775631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:23.934896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"265'6","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:47.534095+0000","last_change":"2024-09-12T01:22:47.534095+0000","last_active":"2024-09-12T01:22:47.534095+0000","last_peered":"2024-09-12T01:22:47.534095+0000","last_clean":"2024-09-12T01:22:47.534095+0000","last_became_active":"2024-09-12T00:52:40.356507+0000","last_became_peered":"2024-09-12T00:52:40.356507+0000","last_unstale":"2024-09-12T01:22:47.534095+0000","last_undegraded":"2024-09-12T01:22:47.534095+0000","last_fullsized":"2024-09-12T01:22:47.534095+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:22:47.533916+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:22:47.533916+0000","last_clean_scrub_stamp":"2024-09-12T01:22:47.533916+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:42.533506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":17408,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:54.185237+0000","last_change":"2024-09-12T01:22:54.185237+0000","last_active":"2024-09-12T01:22:54.185237+0000","last_peered":"2024-09-12T01:22:54.185237+0000","last_clean":"2024-09-12T01:22:54.185237+0000","last_became_active":"2024-09-12T00:52:37.293298+0000","last_became_peered":"2024-09-12T00:52:37.293298+0000","last_unstale":"2024-09-12T01:22:54.185237+0000","last_undegraded":"2024-09-12T01:22:54.185237+0000","last_fullsized":"2024-09-12T01:22:54.185237+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:54.185020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:54.185020+0000","last_clean_scrub_stamp":"2024-09-12T01:22:54.185020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:47.787147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"262'30","reported_seq":145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:50.732675+0000","last_change":"2024-09-12T01:22:50.732675+0000","last_active":"2024-09-12T01:22:50.732675+0000","last_peered":"2024-09-12T01:22:50.732675+0000","last_clean":"2024-09-12T01:22:50.732675+0000","last_became_active":"2024-09-12T00:51:04.995863+0000","last_became_peered":"2024-09-12T00:51:04.995863+0000","last_unstale":"2024-09-12T01:22:50.732675+0000","last_undegraded":"2024-09-12T01:22:50.732675+0000","last_fullsized":"2024-09-12T01:22:50.732675+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'30","last_scrub_stamp":"2024-09-12T01:22:50.732470+0000","last_deep_scrub":"262'30","last_deep_scrub_stamp":"2024-09-12T01:22:50.732470+0000","last_clean_scrub_stamp":"2024-09-12T01:22:50.732470+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:28.389976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":123,"num_write":48,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:46.190105+0000","last_change":"2024-09-12T01:22:46.190105+0000","last_active":"2024-09-12T01:22:46.190105+0000","last_peered":"2024-09-12T01:22:46.190105+0000","last_clean":"2024-09-12T01:22:46.190105+0000","last_became_active":"2024-09-12T01:03:40.575481+0000","last_became_peered":"2024-09-12T01:03:40.575481+0000","last_unstale":"2024-09-12T01:22:46.190105+0000","last_undegraded":"2024-09-12T01:22:46.190105+0000","last_fullsized":"2024-09-12T01:22:46.190105+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:46.190030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:46.190030+0000","last_clean_scrub_stamp":"2024-09-12T01:22:46.190030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:06.052250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:39.046247+0000","last_change":"2024-09-12T01:22:39.046247+0000","last_active":"2024-09-12T01:22:39.046247+0000","last_peered":"2024-09-12T01:22:39.046247+0000","last_clean":"2024-09-12T01:22:39.046247+0000","last_became_active":"2024-09-12T00:52:40.349826+0000","last_became_peered":"2024-09-12T00:52:40.349826+0000","last_unstale":"2024-09-12T01:22:39.046247+0000","last_undegraded":"2024-09-12T01:22:39.046247+0000","last_fullsized":"2024-09-12T01:22:39.046247+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:39.046063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:39.046063+0000","last_clean_scrub_stamp":"2024-09-12T01:22:39.046063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:06.281154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"265'18","reported_seq":94,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:45.817476+0000","last_change":"2024-09-12T01:22:45.817476+0000","last_active":"2024-09-12T01:22:45.817476+0000","last_peered":"2024-09-12T01:22:45.817476+0000","last_clean":"2024-09-12T01:22:45.817476+0000","last_became_active":"2024-09-12T00:52:37.283600+0000","last_became_peered":"2024-09-12T00:52:37.283600+0000","last_unstale":"2024-09-12T01:22:45.817476+0000","last_undegraded":"2024-09-12T01:22:45.817476+0000","last_fullsized":"2024-09-12T01:22:45.817476+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'18","last_scrub_stamp":"2024-09-12T01:22:45.817299+0000","last_deep_scrub":"265'18","last_deep_scrub_stamp":"2024-09-12T01:22:45.817299+0000","last_clean_scrub_stamp":"2024-09-12T01:22:45.817299+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:37.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":56328,"num_write":28,"num_write_kb":20484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"265'59","reported_seq":214,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:34.091688+0000","last_change":"2024-09-12T01:22:34.091688+0000","last_active":"2024-09-12T01:22:34.091688+0000","last_peered":"2024-09-12T01:22:34.091688+0000","last_clean":"2024-09-12T01:22:34.091688+0000","last_became_active":"2024-09-12T00:51:04.982228+0000","last_became_peered":"2024-09-12T00:51:04.982228+0000","last_unstale":"2024-09-12T01:22:34.091688+0000","last_undegraded":"2024-09-12T01:22:34.091688+0000","last_fullsized":"2024-09-12T01:22:34.091688+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'59","last_scrub_stamp":"2024-09-12T01:22:34.091468+0000","last_deep_scrub":"265'59","last_deep_scrub_stamp":"2024-09-12T01:22:34.091468+0000","last_clean_scrub_stamp":"2024-09-12T01:22:34.091468+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:07.136953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":210,"num_write":106,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'2","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:23:00.561872+0000","last_change":"2024-09-12T01:23:00.561872+0000","last_active":"2024-09-12T01:23:00.561872+0000","last_peered":"2024-09-12T01:23:00.561872+0000","last_clean":"2024-09-12T01:23:00.561872+0000","last_became_active":"2024-09-12T01:03:40.568346+0000","last_became_peered":"2024-09-12T01:03:40.568346+0000","last_unstale":"2024-09-12T01:23:00.561872+0000","last_undegraded":"2024-09-12T01:23:00.561872+0000","last_fullsized":"2024-09-12T01:23:00.561872+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:23:00.561702+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:23:00.561702+0000","last_clean_scrub_stamp":"2024-09-12T01:23:00.561702+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:25.545679+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"265'3","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:42.018175+0000","last_change":"2024-09-12T01:22:42.017990+0000","last_active":"2024-09-12T01:22:42.018175+0000","last_peered":"2024-09-12T01:22:42.018175+0000","last_clean":"2024-09-12T01:22:42.018175+0000","last_became_active":"2024-09-12T00:52:40.339627+0000","last_became_peered":"2024-09-12T00:52:40.339627+0000","last_unstale":"2024-09-12T01:22:42.018175+0000","last_undegraded":"2024-09-12T01:22:42.018175+0000","last_fullsized":"2024-09-12T01:22:42.018175+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:22:42.017810+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:22:42.017810+0000","last_clean_scrub_stamp":"2024-09-12T01:22:42.017810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:57.124541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"262'3","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:44.847036+0000","last_change":"2024-09-12T01:22:44.847036+0000","last_active":"2024-09-12T01:22:44.847036+0000","last_peered":"2024-09-12T01:22:44.847036+0000","last_clean":"2024-09-12T01:22:44.847036+0000","last_became_active":"2024-09-12T00:52:37.283199+0000","last_became_peered":"2024-09-12T00:52:37.283199+0000","last_unstale":"2024-09-12T01:22:44.847036+0000","last_undegraded":"2024-09-12T01:22:44.847036+0000","last_fullsized":"2024-09-12T01:22:44.847036+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T01:22:44.846819+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T01:22:44.846819+0000","last_clean_scrub_stamp":"2024-09-12T01:22:44.846819+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:28.445555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"265'5","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:48.281462+0000","last_change":"2024-09-12T01:22:48.281462+0000","last_active":"2024-09-12T01:22:48.281462+0000","last_peered":"2024-09-12T01:22:48.281462+0000","last_clean":"2024-09-12T01:22:48.281462+0000","last_became_active":"2024-09-12T00:51:04.981675+0000","last_became_peered":"2024-09-12T00:51:04.981675+0000","last_unstale":"2024-09-12T01:22:48.281462+0000","last_undegraded":"2024-09-12T01:22:48.281462+0000","last_fullsized":"2024-09-12T01:22:48.281462+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:22:48.281224+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:22:48.281224+0000","last_clean_scrub_stamp":"2024-09-12T01:22:48.281224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:20.576199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:23:01.549719+0000","last_change":"2024-09-12T01:23:01.549719+0000","last_active":"2024-09-12T01:23:01.549719+0000","last_peered":"2024-09-12T01:23:01.549719+0000","last_clean":"2024-09-12T01:23:01.549719+0000","last_became_active":"2024-09-12T01:03:40.576430+0000","last_became_peered":"2024-09-12T01:03:40.576430+0000","last_unstale":"2024-09-12T01:23:01.549719+0000","last_undegraded":"2024-09-12T01:23:01.549719+0000","last_fullsized":"2024-09-12T01:23:01.549719+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:23:01.549542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:23:01.549542+0000","last_clean_scrub_stamp":"2024-09-12T01:23:01.549542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:13.381812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:23:00.864625+0000","last_change":"2024-09-12T01:23:00.864625+0000","last_active":"2024-09-12T01:23:00.864625+0000","last_peered":"2024-09-12T01:23:00.864625+0000","last_clean":"2024-09-12T01:23:00.864625+0000","last_became_active":"2024-09-12T00:52:40.345995+0000","last_became_peered":"2024-09-12T00:52:40.345995+0000","last_unstale":"2024-09-12T01:23:00.864625+0000","last_undegraded":"2024-09-12T01:23:00.864625+0000","last_fullsized":"2024-09-12T01:23:00.864625+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:23:00.864431+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:23:00.864431+0000","last_clean_scrub_stamp":"2024-09-12T01:23:00.864431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:59.063296+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'2","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:52.195359+0000","last_change":"2024-09-12T01:22:52.195359+0000","last_active":"2024-09-12T01:22:52.195359+0000","last_peered":"2024-09-12T01:22:52.195359+0000","last_clean":"2024-09-12T01:22:52.195359+0000","last_became_active":"2024-09-12T00:52:37.299604+0000","last_became_peered":"2024-09-12T00:52:37.299604+0000","last_unstale":"2024-09-12T01:22:52.195359+0000","last_undegraded":"2024-09-12T01:22:52.195359+0000","last_fullsized":"2024-09-12T01:22:52.195359+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:52.195168+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:52.195168+0000","last_clean_scrub_stamp":"2024-09-12T01:22:52.195168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:17.326944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'41","reported_seq":166,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:31.285014+0000","last_change":"2024-09-12T01:22:31.284832+0000","last_active":"2024-09-12T01:22:31.285014+0000","last_peered":"2024-09-12T01:22:31.285014+0000","last_clean":"2024-09-12T01:22:31.285014+0000","last_became_active":"2024-09-12T00:51:04.968673+0000","last_became_peered":"2024-09-12T00:51:04.968673+0000","last_unstale":"2024-09-12T01:22:31.285014+0000","last_undegraded":"2024-09-12T01:22:31.285014+0000","last_fullsized":"2024-09-12T01:22:31.285014+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'41","last_scrub_stamp":"2024-09-12T01:22:31.284652+0000","last_deep_scrub":"265'41","last_deep_scrub_stamp":"2024-09-12T01:22:31.284652+0000","last_clean_scrub_stamp":"2024-09-12T01:22:31.284652+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:29.195882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":145,"num_write":79,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:45.181942+0000","last_change":"2024-09-12T01:22:45.181942+0000","last_active":"2024-09-12T01:22:45.181942+0000","last_peered":"2024-09-12T01:22:45.181942+0000","last_clean":"2024-09-12T01:22:45.181942+0000","last_became_active":"2024-09-12T01:03:40.590440+0000","last_became_peered":"2024-09-12T01:03:40.590440+0000","last_unstale":"2024-09-12T01:22:45.181942+0000","last_undegraded":"2024-09-12T01:22:45.181942+0000","last_fullsized":"2024-09-12T01:22:45.181942+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:45.181767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:45.181767+0000","last_clean_scrub_stamp":"2024-09-12T01:22:45.181767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:36.799367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:58.843714+0000","last_change":"2024-09-12T01:22:58.843714+0000","last_active":"2024-09-12T01:22:58.843714+0000","last_peered":"2024-09-12T01:22:58.843714+0000","last_clean":"2024-09-12T01:22:58.843714+0000","last_became_active":"2024-09-12T00:52:40.359069+0000","last_became_peered":"2024-09-12T00:52:40.359069+0000","last_unstale":"2024-09-12T01:22:58.843714+0000","last_undegraded":"2024-09-12T01:22:58.843714+0000","last_fullsized":"2024-09-12T01:22:58.843714+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:58.843517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:58.843517+0000","last_clean_scrub_stamp":"2024-09-12T01:22:58.843517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:16.651969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"262'5","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:45.529740+0000","last_change":"2024-09-12T01:22:45.529495+0000","last_active":"2024-09-12T01:22:45.529740+0000","last_peered":"2024-09-12T01:22:45.529740+0000","last_clean":"2024-09-12T01:22:45.529740+0000","last_became_active":"2024-09-12T00:52:37.273684+0000","last_became_peered":"2024-09-12T00:52:37.273684+0000","last_unstale":"2024-09-12T01:22:45.529740+0000","last_undegraded":"2024-09-12T01:22:45.529740+0000","last_fullsized":"2024-09-12T01:22:45.529740+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T01:22:45.529202+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T01:22:45.529202+0000","last_clean_scrub_stamp":"2024-09-12T01:22:45.529202+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:26.116702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":25602,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'50","reported_seq":191,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:44.366544+0000","last_change":"2024-09-12T01:22:44.366544+0000","last_active":"2024-09-12T01:22:44.366544+0000","last_peered":"2024-09-12T01:22:44.366544+0000","last_clean":"2024-09-12T01:22:44.366544+0000","last_became_active":"2024-09-12T00:51:04.993887+0000","last_became_peered":"2024-09-12T00:51:04.993887+0000","last_unstale":"2024-09-12T01:22:44.366544+0000","last_undegraded":"2024-09-12T01:22:44.366544+0000","last_fullsized":"2024-09-12T01:22:44.366544+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'50","last_scrub_stamp":"2024-09-12T01:22:44.366315+0000","last_deep_scrub":"265'50","last_deep_scrub_stamp":"2024-09-12T01:22:44.366315+0000","last_clean_scrub_stamp":"2024-09-12T01:22:44.366315+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:19.628033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":256,"num_read_kb":177,"num_write":91,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'2","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:30.402778+0000","last_change":"2024-09-12T01:22:30.402778+0000","last_active":"2024-09-12T01:22:30.402778+0000","last_peered":"2024-09-12T01:22:30.402778+0000","last_clean":"2024-09-12T01:22:30.402778+0000","last_became_active":"2024-09-12T01:03:40.580348+0000","last_became_peered":"2024-09-12T01:03:40.580348+0000","last_unstale":"2024-09-12T01:22:30.402778+0000","last_undegraded":"2024-09-12T01:22:30.402778+0000","last_fullsized":"2024-09-12T01:22:30.402778+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:30.402577+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:30.402577+0000","last_clean_scrub_stamp":"2024-09-12T01:22:30.402577+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:53.076131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"262'8","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:57.807400+0000","last_change":"2024-09-12T01:22:57.807266+0000","last_active":"2024-09-12T01:22:57.807400+0000","last_peered":"2024-09-12T01:22:57.807400+0000","last_clean":"2024-09-12T01:22:57.807400+0000","last_became_active":"2024-09-12T00:52:40.363347+0000","last_became_peered":"2024-09-12T00:52:40.363347+0000","last_unstale":"2024-09-12T01:22:57.807400+0000","last_undegraded":"2024-09-12T01:22:57.807400+0000","last_fullsized":"2024-09-12T01:22:57.807400+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-12T01:22:57.807079+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-12T01:22:57.807079+0000","last_clean_scrub_stamp":"2024-09-12T01:22:57.807079+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:27.531911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":21506,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:48.489603+0000","last_change":"2024-09-12T01:22:48.489603+0000","last_active":"2024-09-12T01:22:48.489603+0000","last_peered":"2024-09-12T01:22:48.489603+0000","last_clean":"2024-09-12T01:22:48.489603+0000","last_became_active":"2024-09-12T00:52:37.288074+0000","last_became_peered":"2024-09-12T00:52:37.288074+0000","last_unstale":"2024-09-12T01:22:48.489603+0000","last_undegraded":"2024-09-12T01:22:48.489603+0000","last_fullsized":"2024-09-12T01:22:48.489603+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:48.489418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:48.489418+0000","last_clean_scrub_stamp":"2024-09-12T01:22:48.489418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:52.796988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'39","reported_seq":164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:49.733840+0000","last_change":"2024-09-12T01:22:49.733840+0000","last_active":"2024-09-12T01:22:49.733840+0000","last_peered":"2024-09-12T01:22:49.733840+0000","last_clean":"2024-09-12T01:22:49.733840+0000","last_became_active":"2024-09-12T00:51:04.976345+0000","last_became_peered":"2024-09-12T00:51:04.976345+0000","last_unstale":"2024-09-12T01:22:49.733840+0000","last_undegraded":"2024-09-12T01:22:49.733840+0000","last_fullsized":"2024-09-12T01:22:49.733840+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'39","last_scrub_stamp":"2024-09-12T01:22:49.733654+0000","last_deep_scrub":"265'39","last_deep_scrub_stamp":"2024-09-12T01:22:49.733654+0000","last_clean_scrub_stamp":"2024-09-12T01:22:49.733654+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:36.176380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":155,"num_write":57,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:59.551772+0000","last_change":"2024-09-12T01:22:59.551772+0000","last_active":"2024-09-12T01:22:59.551772+0000","last_peered":"2024-09-12T01:22:59.551772+0000","last_clean":"2024-09-12T01:22:59.551772+0000","last_became_active":"2024-09-12T01:03:40.560777+0000","last_became_peered":"2024-09-12T01:03:40.560777+0000","last_unstale":"2024-09-12T01:22:59.551772+0000","last_undegraded":"2024-09-12T01:22:59.551772+0000","last_fullsized":"2024-09-12T01:22:59.551772+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:59.551493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:59.551493+0000","last_clean_scrub_stamp":"2024-09-12T01:22:59.551493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:44.958084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"265'3","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:23:02.873836+0000","last_change":"2024-09-12T01:23:02.873836+0000","last_active":"2024-09-12T01:23:02.873836+0000","last_peered":"2024-09-12T01:23:02.873836+0000","last_clean":"2024-09-12T01:23:02.873836+0000","last_became_active":"2024-09-12T00:52:40.352292+0000","last_became_peered":"2024-09-12T00:52:40.352292+0000","last_unstale":"2024-09-12T01:23:02.873836+0000","last_undegraded":"2024-09-12T01:23:02.873836+0000","last_fullsized":"2024-09-12T01:23:02.873836+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:23:02.873639+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:23:02.873639+0000","last_clean_scrub_stamp":"2024-09-12T01:23:02.873639+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:21.120757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:27.491057+0000","last_change":"2024-09-12T01:22:27.491057+0000","last_active":"2024-09-12T01:22:27.491057+0000","last_peered":"2024-09-12T01:22:27.491057+0000","last_clean":"2024-09-12T01:22:27.491057+0000","last_became_active":"2024-09-12T00:52:37.284325+0000","last_became_peered":"2024-09-12T00:52:37.284325+0000","last_unstale":"2024-09-12T01:22:27.491057+0000","last_undegraded":"2024-09-12T01:22:27.491057+0000","last_fullsized":"2024-09-12T01:22:27.491057+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:27.490874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:27.490874+0000","last_clean_scrub_stamp":"2024-09-12T01:22:27.490874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:46.906871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'20","reported_seq":110,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.383623+0000","last_change":"2024-09-12T01:22:17.383347+0000","last_active":"2024-09-12T01:22:17.383623+0000","last_peered":"2024-09-12T01:22:17.383623+0000","last_clean":"2024-09-12T01:22:17.383623+0000","last_became_active":"2024-09-12T00:51:04.961563+0000","last_became_peered":"2024-09-12T00:51:04.961563+0000","last_unstale":"2024-09-12T01:22:17.383623+0000","last_undegraded":"2024-09-12T01:22:17.383623+0000","last_fullsized":"2024-09-12T01:22:17.383623+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'20","last_scrub_stamp":"2024-09-12T01:22:17.383043+0000","last_deep_scrub":"265'20","last_deep_scrub_stamp":"2024-09-12T01:22:17.383043+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.383043+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:52.621490+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":68,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:51.482419+0000","last_change":"2024-09-12T01:22:51.482419+0000","last_active":"2024-09-12T01:22:51.482419+0000","last_peered":"2024-09-12T01:22:51.482419+0000","last_clean":"2024-09-12T01:22:51.482419+0000","last_became_active":"2024-09-12T01:03:40.580083+0000","last_became_peered":"2024-09-12T01:03:40.580083+0000","last_unstale":"2024-09-12T01:22:51.482419+0000","last_undegraded":"2024-09-12T01:22:51.482419+0000","last_fullsized":"2024-09-12T01:22:51.482419+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:51.482234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:51.482234+0000","last_clean_scrub_stamp":"2024-09-12T01:22:51.482234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:18.293740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'5","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:50.895235+0000","last_change":"2024-09-12T01:22:50.895235+0000","last_active":"2024-09-12T01:22:50.895235+0000","last_peered":"2024-09-12T01:22:50.895235+0000","last_clean":"2024-09-12T01:22:50.895235+0000","last_became_active":"2024-09-12T00:52:40.336368+0000","last_became_peered":"2024-09-12T00:52:40.336368+0000","last_unstale":"2024-09-12T01:22:50.895235+0000","last_undegraded":"2024-09-12T01:22:50.895235+0000","last_fullsized":"2024-09-12T01:22:50.895235+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:22:50.895043+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:22:50.895043+0000","last_clean_scrub_stamp":"2024-09-12T01:22:50.895043+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:31.330347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:49.240617+0000","last_change":"2024-09-12T01:22:49.240617+0000","last_active":"2024-09-12T01:22:49.240617+0000","last_peered":"2024-09-12T01:22:49.240617+0000","last_clean":"2024-09-12T01:22:49.240617+0000","last_became_active":"2024-09-12T00:52:37.295945+0000","last_became_peered":"2024-09-12T00:52:37.295945+0000","last_unstale":"2024-09-12T01:22:49.240617+0000","last_undegraded":"2024-09-12T01:22:49.240617+0000","last_fullsized":"2024-09-12T01:22:49.240617+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:49.240364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:49.240364+0000","last_clean_scrub_stamp":"2024-09-12T01:22:49.240364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:01.460782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"265'27","reported_seq":132,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:41.493365+0000","last_change":"2024-09-12T01:22:41.493365+0000","last_active":"2024-09-12T01:22:41.493365+0000","last_peered":"2024-09-12T01:22:41.493365+0000","last_clean":"2024-09-12T01:22:41.493365+0000","last_became_active":"2024-09-12T00:51:04.975831+0000","last_became_peered":"2024-09-12T00:51:04.975831+0000","last_unstale":"2024-09-12T01:22:41.493365+0000","last_undegraded":"2024-09-12T01:22:41.493365+0000","last_fullsized":"2024-09-12T01:22:41.493365+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'27","last_scrub_stamp":"2024-09-12T01:22:41.493085+0000","last_deep_scrub":"265'27","last_deep_scrub_stamp":"2024-09-12T01:22:41.493085+0000","last_clean_scrub_stamp":"2024-09-12T01:22:41.493085+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:56.711739+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":101,"num_write":53,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:23:04.837615+0000","last_change":"2024-09-12T01:23:04.837615+0000","last_active":"2024-09-12T01:23:04.837615+0000","last_peered":"2024-09-12T01:23:04.837615+0000","last_clean":"2024-09-12T01:23:04.837615+0000","last_became_active":"2024-09-12T01:03:40.579923+0000","last_became_peered":"2024-09-12T01:03:40.579923+0000","last_unstale":"2024-09-12T01:23:04.837615+0000","last_undegraded":"2024-09-12T01:23:04.837615+0000","last_fullsized":"2024-09-12T01:23:04.837615+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:23:04.837424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:23:04.837424+0000","last_clean_scrub_stamp":"2024-09-12T01:23:04.837424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:54.160009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:43.207623+0000","last_change":"2024-09-12T01:22:43.207483+0000","last_active":"2024-09-12T01:22:43.207623+0000","last_peered":"2024-09-12T01:22:43.207623+0000","last_clean":"2024-09-12T01:22:43.207623+0000","last_became_active":"2024-09-12T00:52:40.349363+0000","last_became_peered":"2024-09-12T00:52:40.349363+0000","last_unstale":"2024-09-12T01:22:43.207623+0000","last_undegraded":"2024-09-12T01:22:43.207623+0000","last_fullsized":"2024-09-12T01:22:43.207623+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:43.207311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:43.207311+0000","last_clean_scrub_stamp":"2024-09-12T01:22:43.207311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:47.937508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:43.893870+0000","last_change":"2024-09-12T01:22:43.893693+0000","last_active":"2024-09-12T01:22:43.893870+0000","last_peered":"2024-09-12T01:22:43.893870+0000","last_clean":"2024-09-12T01:22:43.893870+0000","last_became_active":"2024-09-12T00:52:37.270958+0000","last_became_peered":"2024-09-12T00:52:37.270958+0000","last_unstale":"2024-09-12T01:22:43.893870+0000","last_undegraded":"2024-09-12T01:22:43.893870+0000","last_fullsized":"2024-09-12T01:22:43.893870+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:43.893511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:43.893511+0000","last_clean_scrub_stamp":"2024-09-12T01:22:43.893511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:45.522023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'19","reported_seq":104,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:40.470884+0000","last_change":"2024-09-12T01:22:40.470884+0000","last_active":"2024-09-12T01:22:40.470884+0000","last_peered":"2024-09-12T01:22:40.470884+0000","last_clean":"2024-09-12T01:22:40.470884+0000","last_became_active":"2024-09-12T00:51:04.975763+0000","last_became_peered":"2024-09-12T00:51:04.975763+0000","last_unstale":"2024-09-12T01:22:40.470884+0000","last_undegraded":"2024-09-12T01:22:40.470884+0000","last_fullsized":"2024-09-12T01:22:40.470884+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'19","last_scrub_stamp":"2024-09-12T01:22:40.470688+0000","last_deep_scrub":"265'19","last_deep_scrub_stamp":"2024-09-12T01:22:40.470688+0000","last_clean_scrub_stamp":"2024-09-12T01:22:40.470688+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:44.316701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:23:01.163287+0000","last_change":"2024-09-12T01:23:01.163150+0000","last_active":"2024-09-12T01:23:01.163287+0000","last_peered":"2024-09-12T01:23:01.163287+0000","last_clean":"2024-09-12T01:23:01.163287+0000","last_became_active":"2024-09-12T01:03:40.581062+0000","last_became_peered":"2024-09-12T01:03:40.581062+0000","last_unstale":"2024-09-12T01:23:01.163287+0000","last_undegraded":"2024-09-12T01:23:01.163287+0000","last_fullsized":"2024-09-12T01:23:01.163287+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:23:01.162965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:23:01.162965+0000","last_clean_scrub_stamp":"2024-09-12T01:23:01.162965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:49.881618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'10","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:42.231590+0000","last_change":"2024-09-12T01:22:42.231395+0000","last_active":"2024-09-12T01:22:42.231590+0000","last_peered":"2024-09-12T01:22:42.231590+0000","last_clean":"2024-09-12T01:22:42.231590+0000","last_became_active":"2024-09-12T00:52:40.343871+0000","last_became_peered":"2024-09-12T00:52:40.343871+0000","last_unstale":"2024-09-12T01:22:42.231590+0000","last_undegraded":"2024-09-12T01:22:42.231590+0000","last_fullsized":"2024-09-12T01:22:42.231590+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-12T01:22:42.231221+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-12T01:22:42.231221+0000","last_clean_scrub_stamp":"2024-09-12T01:22:42.231221+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:49.732150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":22610,"num_write":15,"num_write_kb":6184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:52.728063+0000","last_change":"2024-09-12T01:22:52.727911+0000","last_active":"2024-09-12T01:22:52.728063+0000","last_peered":"2024-09-12T01:22:52.728063+0000","last_clean":"2024-09-12T01:22:52.728063+0000","last_became_active":"2024-09-12T00:52:37.276237+0000","last_became_peered":"2024-09-12T00:52:37.276237+0000","last_unstale":"2024-09-12T01:22:52.728063+0000","last_undegraded":"2024-09-12T01:22:52.728063+0000","last_fullsized":"2024-09-12T01:22:52.728063+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:52.727717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:52.727717+0000","last_clean_scrub_stamp":"2024-09-12T01:22:52.727717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:45.276702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'15","reported_seq":95,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:47.301103+0000","last_change":"2024-09-12T01:22:47.301103+0000","last_active":"2024-09-12T01:22:47.301103+0000","last_peered":"2024-09-12T01:22:47.301103+0000","last_clean":"2024-09-12T01:22:47.301103+0000","last_became_active":"2024-09-12T00:51:04.994606+0000","last_became_peered":"2024-09-12T00:51:04.994606+0000","last_unstale":"2024-09-12T01:22:47.301103+0000","last_undegraded":"2024-09-12T01:22:47.301103+0000","last_fullsized":"2024-09-12T01:22:47.301103+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'15","last_scrub_stamp":"2024-09-12T01:22:47.300879+0000","last_deep_scrub":"265'15","last_deep_scrub_stamp":"2024-09-12T01:22:47.300879+0000","last_clean_scrub_stamp":"2024-09-12T01:22:47.300879+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:47.259624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"265'2","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:23:02.147834+0000","last_change":"2024-09-12T01:23:02.147834+0000","last_active":"2024-09-12T01:23:02.147834+0000","last_peered":"2024-09-12T01:23:02.147834+0000","last_clean":"2024-09-12T01:23:02.147834+0000","last_became_active":"2024-09-12T01:03:40.581586+0000","last_became_peered":"2024-09-12T01:03:40.581586+0000","last_unstale":"2024-09-12T01:23:02.147834+0000","last_undegraded":"2024-09-12T01:23:02.147834+0000","last_fullsized":"2024-09-12T01:23:02.147834+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:23:02.147647+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:23:02.147647+0000","last_clean_scrub_stamp":"2024-09-12T01:23:02.147647+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:49.781836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'7","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:59.849501+0000","last_change":"2024-09-12T01:22:59.849298+0000","last_active":"2024-09-12T01:22:59.849501+0000","last_peered":"2024-09-12T01:22:59.849501+0000","last_clean":"2024-09-12T01:22:59.849501+0000","last_became_active":"2024-09-12T00:52:40.363072+0000","last_became_peered":"2024-09-12T00:52:40.363072+0000","last_unstale":"2024-09-12T01:22:59.849501+0000","last_undegraded":"2024-09-12T01:22:59.849501+0000","last_fullsized":"2024-09-12T01:22:59.849501+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T01:22:59.849107+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T01:22:59.849107+0000","last_clean_scrub_stamp":"2024-09-12T01:22:59.849107+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:30.866703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9232,"num_write":7,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:36.977562+0000","last_change":"2024-09-12T01:22:36.977341+0000","last_active":"2024-09-12T01:22:36.977562+0000","last_peered":"2024-09-12T01:22:36.977562+0000","last_clean":"2024-09-12T01:22:36.977562+0000","last_became_active":"2024-09-12T00:52:37.291045+0000","last_became_peered":"2024-09-12T00:52:37.291045+0000","last_unstale":"2024-09-12T01:22:36.977562+0000","last_undegraded":"2024-09-12T01:22:36.977562+0000","last_fullsized":"2024-09-12T01:22:36.977562+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:36.977080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:36.977080+0000","last_clean_scrub_stamp":"2024-09-12T01:22:36.977080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:27.874464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'47","reported_seq":186,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:42.924777+0000","last_change":"2024-09-12T01:22:42.924777+0000","last_active":"2024-09-12T01:22:42.924777+0000","last_peered":"2024-09-12T01:22:42.924777+0000","last_clean":"2024-09-12T01:22:42.924777+0000","last_became_active":"2024-09-12T00:51:04.980601+0000","last_became_peered":"2024-09-12T00:51:04.980601+0000","last_unstale":"2024-09-12T01:22:42.924777+0000","last_undegraded":"2024-09-12T01:22:42.924777+0000","last_fullsized":"2024-09-12T01:22:42.924777+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'47","last_scrub_stamp":"2024-09-12T01:22:42.924599+0000","last_deep_scrub":"265'47","last_deep_scrub_stamp":"2024-09-12T01:22:42.924599+0000","last_clean_scrub_stamp":"2024-09-12T01:22:42.924599+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:23.089967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":177,"num_write":81,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'2","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:23:03.884135+0000","last_change":"2024-09-12T01:23:03.884135+0000","last_active":"2024-09-12T01:23:03.884135+0000","last_peered":"2024-09-12T01:23:03.884135+0000","last_clean":"2024-09-12T01:23:03.884135+0000","last_became_active":"2024-09-12T01:03:40.579772+0000","last_became_peered":"2024-09-12T01:03:40.579772+0000","last_unstale":"2024-09-12T01:23:03.884135+0000","last_undegraded":"2024-09-12T01:23:03.884135+0000","last_fullsized":"2024-09-12T01:23:03.884135+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:23:03.883942+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:23:03.883942+0000","last_clean_scrub_stamp":"2024-09-12T01:23:03.883942+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:35.676688+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'3","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:38.026339+0000","last_change":"2024-09-12T01:22:38.026163+0000","last_active":"2024-09-12T01:22:38.026339+0000","last_peered":"2024-09-12T01:22:38.026339+0000","last_clean":"2024-09-12T01:22:38.026339+0000","last_became_active":"2024-09-12T00:52:40.347156+0000","last_became_peered":"2024-09-12T00:52:40.347156+0000","last_unstale":"2024-09-12T01:22:38.026339+0000","last_undegraded":"2024-09-12T01:22:38.026339+0000","last_fullsized":"2024-09-12T01:22:38.026339+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:22:38.025979+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:22:38.025979+0000","last_clean_scrub_stamp":"2024-09-12T01:22:38.025979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:31.526630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:43.571256+0000","last_change":"2024-09-12T01:22:43.571124+0000","last_active":"2024-09-12T01:22:43.571256+0000","last_peered":"2024-09-12T01:22:43.571256+0000","last_clean":"2024-09-12T01:22:43.571256+0000","last_became_active":"2024-09-12T00:52:37.290858+0000","last_became_peered":"2024-09-12T00:52:37.290858+0000","last_unstale":"2024-09-12T01:22:43.571256+0000","last_undegraded":"2024-09-12T01:22:43.571256+0000","last_fullsized":"2024-09-12T01:22:43.571256+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:43.570920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:43.570920+0000","last_clean_scrub_stamp":"2024-09-12T01:22:43.570920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:01.454178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'11","reported_seq":87,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:48.684768+0000","last_change":"2024-09-12T01:22:48.684768+0000","last_active":"2024-09-12T01:22:48.684768+0000","last_peered":"2024-09-12T01:22:48.684768+0000","last_clean":"2024-09-12T01:22:48.684768+0000","last_became_active":"2024-09-12T00:51:04.988521+0000","last_became_peered":"2024-09-12T00:51:04.988521+0000","last_unstale":"2024-09-12T01:22:48.684768+0000","last_undegraded":"2024-09-12T01:22:48.684768+0000","last_fullsized":"2024-09-12T01:22:48.684768+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'11","last_scrub_stamp":"2024-09-12T01:22:48.684584+0000","last_deep_scrub":"265'11","last_deep_scrub_stamp":"2024-09-12T01:22:48.684584+0000","last_clean_scrub_stamp":"2024-09-12T01:22:48.684584+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:03.630542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:29.444678+0000","last_change":"2024-09-12T01:22:29.444544+0000","last_active":"2024-09-12T01:22:29.444678+0000","last_peered":"2024-09-12T01:22:29.444678+0000","last_clean":"2024-09-12T01:22:29.444678+0000","last_became_active":"2024-09-12T01:03:40.591869+0000","last_became_peered":"2024-09-12T01:03:40.591869+0000","last_unstale":"2024-09-12T01:22:29.444678+0000","last_undegraded":"2024-09-12T01:22:29.444678+0000","last_fullsized":"2024-09-12T01:22:29.444678+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:29.444338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:29.444338+0000","last_clean_scrub_stamp":"2024-09-12T01:22:29.444338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:18.046980+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:54.773318+0000","last_change":"2024-09-12T01:22:54.773318+0000","last_active":"2024-09-12T01:22:54.773318+0000","last_peered":"2024-09-12T01:22:54.773318+0000","last_clean":"2024-09-12T01:22:54.773318+0000","last_became_active":"2024-09-12T00:52:40.344566+0000","last_became_peered":"2024-09-12T00:52:40.344566+0000","last_unstale":"2024-09-12T01:22:54.773318+0000","last_undegraded":"2024-09-12T01:22:54.773318+0000","last_fullsized":"2024-09-12T01:22:54.773318+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:54.773142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:54.773142+0000","last_clean_scrub_stamp":"2024-09-12T01:22:54.773142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:12.232776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:52.555945+0000","last_change":"2024-09-12T01:22:52.555945+0000","last_active":"2024-09-12T01:22:52.555945+0000","last_peered":"2024-09-12T01:22:52.555945+0000","last_clean":"2024-09-12T01:22:52.555945+0000","last_became_active":"2024-09-12T00:52:37.282987+0000","last_became_peered":"2024-09-12T00:52:37.282987+0000","last_unstale":"2024-09-12T01:22:52.555945+0000","last_undegraded":"2024-09-12T01:22:52.555945+0000","last_fullsized":"2024-09-12T01:22:52.555945+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:52.555759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:52.555759+0000","last_clean_scrub_stamp":"2024-09-12T01:22:52.555759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:53.858151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'40","reported_seq":165,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:47.702380+0000","last_change":"2024-09-12T01:22:47.702233+0000","last_active":"2024-09-12T01:22:47.702380+0000","last_peered":"2024-09-12T01:22:47.702380+0000","last_clean":"2024-09-12T01:22:47.702380+0000","last_became_active":"2024-09-12T00:51:05.001162+0000","last_became_peered":"2024-09-12T00:51:05.001162+0000","last_unstale":"2024-09-12T01:22:47.702380+0000","last_undegraded":"2024-09-12T01:22:47.702380+0000","last_fullsized":"2024-09-12T01:22:47.702380+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'40","last_scrub_stamp":"2024-09-12T01:22:47.702053+0000","last_deep_scrub":"265'40","last_deep_scrub_stamp":"2024-09-12T01:22:47.702053+0000","last_clean_scrub_stamp":"2024-09-12T01:22:47.702053+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:28.125705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":142,"num_write":73,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:56.554578+0000","last_change":"2024-09-12T01:22:56.554578+0000","last_active":"2024-09-12T01:22:56.554578+0000","last_peered":"2024-09-12T01:22:56.554578+0000","last_clean":"2024-09-12T01:22:56.554578+0000","last_became_active":"2024-09-12T01:03:40.551803+0000","last_became_peered":"2024-09-12T01:03:40.551803+0000","last_unstale":"2024-09-12T01:22:56.554578+0000","last_undegraded":"2024-09-12T01:22:56.554578+0000","last_fullsized":"2024-09-12T01:22:56.554578+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:56.554380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:56.554380+0000","last_clean_scrub_stamp":"2024-09-12T01:22:56.554380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:21.574134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:56.807127+0000","last_change":"2024-09-12T01:22:56.807127+0000","last_active":"2024-09-12T01:22:56.807127+0000","last_peered":"2024-09-12T01:22:56.807127+0000","last_clean":"2024-09-12T01:22:56.807127+0000","last_became_active":"2024-09-12T00:52:40.354387+0000","last_became_peered":"2024-09-12T00:52:40.354387+0000","last_unstale":"2024-09-12T01:22:56.807127+0000","last_undegraded":"2024-09-12T01:22:56.807127+0000","last_fullsized":"2024-09-12T01:22:56.807127+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:56.806940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:56.806940+0000","last_clean_scrub_stamp":"2024-09-12T01:22:56.806940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:46.117079+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:26.445283+0000","last_change":"2024-09-12T01:22:26.445283+0000","last_active":"2024-09-12T01:22:26.445283+0000","last_peered":"2024-09-12T01:22:26.445283+0000","last_clean":"2024-09-12T01:22:26.445283+0000","last_became_active":"2024-09-12T00:52:37.285154+0000","last_became_peered":"2024-09-12T00:52:37.285154+0000","last_unstale":"2024-09-12T01:22:26.445283+0000","last_undegraded":"2024-09-12T01:22:26.445283+0000","last_fullsized":"2024-09-12T01:22:26.445283+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:26.445055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:26.445055+0000","last_clean_scrub_stamp":"2024-09-12T01:22:26.445055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:23.861328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'61","reported_seq":221,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:41.550167+0000","last_change":"2024-09-12T01:22:41.550167+0000","last_active":"2024-09-12T01:22:41.550167+0000","last_peered":"2024-09-12T01:22:41.550167+0000","last_clean":"2024-09-12T01:22:41.550167+0000","last_became_active":"2024-09-12T00:51:04.975583+0000","last_became_peered":"2024-09-12T00:51:04.975583+0000","last_unstale":"2024-09-12T01:22:41.550167+0000","last_undegraded":"2024-09-12T01:22:41.550167+0000","last_fullsized":"2024-09-12T01:22:41.550167+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'61","last_scrub_stamp":"2024-09-12T01:22:41.549939+0000","last_deep_scrub":"265'61","last_deep_scrub_stamp":"2024-09-12T01:22:41.549939+0000","last_clean_scrub_stamp":"2024-09-12T01:22:41.549939+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:37.092779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":309,"num_read_kb":216,"num_write":105,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:40.030402+0000","last_change":"2024-09-12T01:22:40.030260+0000","last_active":"2024-09-12T01:22:40.030402+0000","last_peered":"2024-09-12T01:22:40.030402+0000","last_clean":"2024-09-12T01:22:40.030402+0000","last_became_active":"2024-09-12T01:03:40.569907+0000","last_became_peered":"2024-09-12T01:03:40.569907+0000","last_unstale":"2024-09-12T01:22:40.030402+0000","last_undegraded":"2024-09-12T01:22:40.030402+0000","last_fullsized":"2024-09-12T01:22:40.030402+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:40.030080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:40.030080+0000","last_clean_scrub_stamp":"2024-09-12T01:22:40.030080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:02.085149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:41.205229+0000","last_change":"2024-09-12T01:22:41.205229+0000","last_active":"2024-09-12T01:22:41.205229+0000","last_peered":"2024-09-12T01:22:41.205229+0000","last_clean":"2024-09-12T01:22:41.205229+0000","last_became_active":"2024-09-12T00:52:40.342703+0000","last_became_peered":"2024-09-12T00:52:40.342703+0000","last_unstale":"2024-09-12T01:22:41.205229+0000","last_undegraded":"2024-09-12T01:22:41.205229+0000","last_fullsized":"2024-09-12T01:22:41.205229+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:41.205045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:41.205045+0000","last_clean_scrub_stamp":"2024-09-12T01:22:41.205045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:57.444570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"265'6","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:46.344526+0000","last_change":"2024-09-12T01:22:46.344526+0000","last_active":"2024-09-12T01:22:46.344526+0000","last_peered":"2024-09-12T01:22:46.344526+0000","last_clean":"2024-09-12T01:22:46.344526+0000","last_became_active":"2024-09-12T00:52:37.292449+0000","last_became_peered":"2024-09-12T00:52:37.292449+0000","last_unstale":"2024-09-12T01:22:46.344526+0000","last_undegraded":"2024-09-12T01:22:46.344526+0000","last_fullsized":"2024-09-12T01:22:46.344526+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:22:46.344345+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:22:46.344345+0000","last_clean_scrub_stamp":"2024-09-12T01:22:46.344345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:11.188496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'117","reported_seq":413,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:33.077945+0000","last_change":"2024-09-12T01:22:33.077685+0000","last_active":"2024-09-12T01:22:33.077945+0000","last_peered":"2024-09-12T01:22:33.077945+0000","last_clean":"2024-09-12T01:22:33.077945+0000","last_became_active":"2024-09-12T00:51:04.984495+0000","last_became_peered":"2024-09-12T00:51:04.984495+0000","last_unstale":"2024-09-12T01:22:33.077945+0000","last_undegraded":"2024-09-12T01:22:33.077945+0000","last_fullsized":"2024-09-12T01:22:33.077945+0000","mapping_epoch":252,"log_start":"265'100","ondisk_log_start":"265'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'117","last_scrub_stamp":"2024-09-12T01:22:33.077397+0000","last_deep_scrub":"265'117","last_deep_scrub_stamp":"2024-09-12T01:22:33.077397+0000","last_clean_scrub_stamp":"2024-09-12T01:22:33.077397+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:07.359308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":690,"num_read_kb":506,"num_write":167,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3728,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:55.574666+0000","last_change":"2024-09-12T01:22:55.574423+0000","last_active":"2024-09-12T01:22:55.574666+0000","last_peered":"2024-09-12T01:22:55.574666+0000","last_clean":"2024-09-12T01:22:55.574666+0000","last_became_active":"2024-09-12T01:03:40.566107+0000","last_became_peered":"2024-09-12T01:03:40.566107+0000","last_unstale":"2024-09-12T01:22:55.574666+0000","last_undegraded":"2024-09-12T01:22:55.574666+0000","last_fullsized":"2024-09-12T01:22:55.574666+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:55.574215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:55.574215+0000","last_clean_scrub_stamp":"2024-09-12T01:22:55.574215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:29.430902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:55.759751+0000","last_change":"2024-09-12T01:22:55.759751+0000","last_active":"2024-09-12T01:22:55.759751+0000","last_peered":"2024-09-12T01:22:55.759751+0000","last_clean":"2024-09-12T01:22:55.759751+0000","last_became_active":"2024-09-12T00:52:40.367188+0000","last_became_peered":"2024-09-12T00:52:40.367188+0000","last_unstale":"2024-09-12T01:22:55.759751+0000","last_undegraded":"2024-09-12T01:22:55.759751+0000","last_fullsized":"2024-09-12T01:22:55.759751+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:55.759565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:55.759565+0000","last_clean_scrub_stamp":"2024-09-12T01:22:55.759565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:46.645933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"265'2","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:37.216787+0000","last_change":"2024-09-12T01:22:37.216787+0000","last_active":"2024-09-12T01:22:37.216787+0000","last_peered":"2024-09-12T01:22:37.216787+0000","last_clean":"2024-09-12T01:22:37.216787+0000","last_became_active":"2024-09-12T00:52:37.281129+0000","last_became_peered":"2024-09-12T00:52:37.281129+0000","last_unstale":"2024-09-12T01:22:37.216787+0000","last_undegraded":"2024-09-12T01:22:37.216787+0000","last_fullsized":"2024-09-12T01:22:37.216787+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:37.216601+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:37.216601+0000","last_clean_scrub_stamp":"2024-09-12T01:22:37.216601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:14.358131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"265'9","reported_seq":81,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.365423+0000","last_change":"2024-09-12T01:22:21.365181+0000","last_active":"2024-09-12T01:22:21.365423+0000","last_peered":"2024-09-12T01:22:21.365423+0000","last_clean":"2024-09-12T01:22:21.365423+0000","last_became_active":"2024-09-12T00:51:04.983577+0000","last_became_peered":"2024-09-12T00:51:04.983577+0000","last_unstale":"2024-09-12T01:22:21.365423+0000","last_undegraded":"2024-09-12T01:22:21.365423+0000","last_fullsized":"2024-09-12T01:22:21.365423+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-12T01:22:21.364947+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-12T01:22:21.364947+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.364947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:01.811632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:23:01.857554+0000","last_change":"2024-09-12T01:23:01.857554+0000","last_active":"2024-09-12T01:23:01.857554+0000","last_peered":"2024-09-12T01:23:01.857554+0000","last_clean":"2024-09-12T01:23:01.857554+0000","last_became_active":"2024-09-12T01:03:40.589838+0000","last_became_peered":"2024-09-12T01:03:40.589838+0000","last_unstale":"2024-09-12T01:23:01.857554+0000","last_undegraded":"2024-09-12T01:23:01.857554+0000","last_fullsized":"2024-09-12T01:23:01.857554+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:23:01.857368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:23:01.857368+0000","last_clean_scrub_stamp":"2024-09-12T01:23:01.857368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:50.474399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:48.852646+0000","last_change":"2024-09-12T01:22:48.852505+0000","last_active":"2024-09-12T01:22:48.852646+0000","last_peered":"2024-09-12T01:22:48.852646+0000","last_clean":"2024-09-12T01:22:48.852646+0000","last_became_active":"2024-09-12T00:52:40.356802+0000","last_became_peered":"2024-09-12T00:52:40.356802+0000","last_unstale":"2024-09-12T01:22:48.852646+0000","last_undegraded":"2024-09-12T01:22:48.852646+0000","last_fullsized":"2024-09-12T01:22:48.852646+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:48.852311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:48.852311+0000","last_clean_scrub_stamp":"2024-09-12T01:22:48.852311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:03.441631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"265'6","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:51.218647+0000","last_change":"2024-09-12T01:22:51.218495+0000","last_active":"2024-09-12T01:22:51.218647+0000","last_peered":"2024-09-12T01:22:51.218647+0000","last_clean":"2024-09-12T01:22:51.218647+0000","last_became_active":"2024-09-12T00:52:37.293564+0000","last_became_peered":"2024-09-12T00:52:37.293564+0000","last_unstale":"2024-09-12T01:22:51.218647+0000","last_undegraded":"2024-09-12T01:22:51.218647+0000","last_fullsized":"2024-09-12T01:22:51.218647+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:22:51.218309+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:22:51.218309+0000","last_clean_scrub_stamp":"2024-09-12T01:22:51.218309+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:04.960161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3128,"num_write":6,"num_write_kb":3128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"262'16","reported_seq":102,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:42.390141+0000","last_change":"2024-09-12T01:22:42.390141+0000","last_active":"2024-09-12T01:22:42.390141+0000","last_peered":"2024-09-12T01:22:42.390141+0000","last_clean":"2024-09-12T01:22:42.390141+0000","last_became_active":"2024-09-12T00:51:04.981091+0000","last_became_peered":"2024-09-12T00:51:04.981091+0000","last_unstale":"2024-09-12T01:22:42.390141+0000","last_undegraded":"2024-09-12T01:22:42.390141+0000","last_fullsized":"2024-09-12T01:22:42.390141+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'16","last_scrub_stamp":"2024-09-12T01:22:42.389938+0000","last_deep_scrub":"262'16","last_deep_scrub_stamp":"2024-09-12T01:22:42.389938+0000","last_clean_scrub_stamp":"2024-09-12T01:22:42.389938+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:56.771573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:58.543899+0000","last_change":"2024-09-12T01:22:58.543899+0000","last_active":"2024-09-12T01:22:58.543899+0000","last_peered":"2024-09-12T01:22:58.543899+0000","last_clean":"2024-09-12T01:22:58.543899+0000","last_became_active":"2024-09-12T01:03:40.565926+0000","last_became_peered":"2024-09-12T01:03:40.565926+0000","last_unstale":"2024-09-12T01:22:58.543899+0000","last_undegraded":"2024-09-12T01:22:58.543899+0000","last_fullsized":"2024-09-12T01:22:58.543899+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:58.543713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:58.543713+0000","last_clean_scrub_stamp":"2024-09-12T01:22:58.543713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:16.372257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:51.528845+0000","last_change":"2024-09-12T01:22:51.528717+0000","last_active":"2024-09-12T01:22:51.528845+0000","last_peered":"2024-09-12T01:22:51.528845+0000","last_clean":"2024-09-12T01:22:51.528845+0000","last_became_active":"2024-09-12T00:52:40.340423+0000","last_became_peered":"2024-09-12T00:52:40.340423+0000","last_unstale":"2024-09-12T01:22:51.528845+0000","last_undegraded":"2024-09-12T01:22:51.528845+0000","last_fullsized":"2024-09-12T01:22:51.528845+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:51.528547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:51.528547+0000","last_clean_scrub_stamp":"2024-09-12T01:22:51.528547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:23.791022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"265'5","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:35.244335+0000","last_change":"2024-09-12T01:22:35.244190+0000","last_active":"2024-09-12T01:22:35.244335+0000","last_peered":"2024-09-12T01:22:35.244335+0000","last_clean":"2024-09-12T01:22:35.244335+0000","last_became_active":"2024-09-12T00:52:37.293885+0000","last_became_peered":"2024-09-12T00:52:37.293885+0000","last_unstale":"2024-09-12T01:22:35.244335+0000","last_undegraded":"2024-09-12T01:22:35.244335+0000","last_fullsized":"2024-09-12T01:22:35.244335+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:22:35.244010+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:22:35.244010+0000","last_clean_scrub_stamp":"2024-09-12T01:22:35.244010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:14.998143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'39","reported_seq":159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:44.538267+0000","last_change":"2024-09-12T01:22:44.538267+0000","last_active":"2024-09-12T01:22:44.538267+0000","last_peered":"2024-09-12T01:22:44.538267+0000","last_clean":"2024-09-12T01:22:44.538267+0000","last_became_active":"2024-09-12T00:51:04.988252+0000","last_became_peered":"2024-09-12T00:51:04.988252+0000","last_unstale":"2024-09-12T01:22:44.538267+0000","last_undegraded":"2024-09-12T01:22:44.538267+0000","last_fullsized":"2024-09-12T01:22:44.538267+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'39","last_scrub_stamp":"2024-09-12T01:22:44.538040+0000","last_deep_scrub":"265'39","last_deep_scrub_stamp":"2024-09-12T01:22:44.538040+0000","last_clean_scrub_stamp":"2024-09-12T01:22:44.538040+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:14.183876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":135,"num_write":72,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'2","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:57.575183+0000","last_change":"2024-09-12T01:22:57.575183+0000","last_active":"2024-09-12T01:22:57.575183+0000","last_peered":"2024-09-12T01:22:57.575183+0000","last_clean":"2024-09-12T01:22:57.575183+0000","last_became_active":"2024-09-12T01:03:40.580376+0000","last_became_peered":"2024-09-12T01:03:40.580376+0000","last_unstale":"2024-09-12T01:22:57.575183+0000","last_undegraded":"2024-09-12T01:22:57.575183+0000","last_fullsized":"2024-09-12T01:22:57.575183+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:57.574996+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:57.574996+0000","last_clean_scrub_stamp":"2024-09-12T01:22:57.574996+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:32.185418+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:40.195327+0000","last_change":"2024-09-12T01:22:40.195327+0000","last_active":"2024-09-12T01:22:40.195327+0000","last_peered":"2024-09-12T01:22:40.195327+0000","last_clean":"2024-09-12T01:22:40.195327+0000","last_became_active":"2024-09-12T00:52:40.337359+0000","last_became_peered":"2024-09-12T00:52:40.337359+0000","last_unstale":"2024-09-12T01:22:40.195327+0000","last_undegraded":"2024-09-12T01:22:40.195327+0000","last_fullsized":"2024-09-12T01:22:40.195327+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:40.195153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:40.195153+0000","last_clean_scrub_stamp":"2024-09-12T01:22:40.195153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:37.029617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"265'5","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:53.212970+0000","last_change":"2024-09-12T01:22:53.212797+0000","last_active":"2024-09-12T01:22:53.212970+0000","last_peered":"2024-09-12T01:22:53.212970+0000","last_clean":"2024-09-12T01:22:53.212970+0000","last_became_active":"2024-09-12T00:52:37.299461+0000","last_became_peered":"2024-09-12T00:52:37.299461+0000","last_unstale":"2024-09-12T01:22:53.212970+0000","last_undegraded":"2024-09-12T01:22:53.212970+0000","last_fullsized":"2024-09-12T01:22:53.212970+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:22:53.212616+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:22:53.212616+0000","last_clean_scrub_stamp":"2024-09-12T01:22:53.212616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:00.920627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5125,"num_write":10,"num_write_kb":5125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'113","reported_seq":404,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:46.667740+0000","last_change":"2024-09-12T01:22:46.667740+0000","last_active":"2024-09-12T01:22:46.667740+0000","last_peered":"2024-09-12T01:22:46.667740+0000","last_clean":"2024-09-12T01:22:46.667740+0000","last_became_active":"2024-09-12T00:51:04.975690+0000","last_became_peered":"2024-09-12T00:51:04.975690+0000","last_unstale":"2024-09-12T01:22:46.667740+0000","last_undegraded":"2024-09-12T01:22:46.667740+0000","last_fullsized":"2024-09-12T01:22:46.667740+0000","mapping_epoch":252,"log_start":"265'100","ondisk_log_start":"265'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'113","last_scrub_stamp":"2024-09-12T01:22:46.667485+0000","last_deep_scrub":"265'113","last_deep_scrub_stamp":"2024-09-12T01:22:46.667485+0000","last_clean_scrub_stamp":"2024-09-12T01:22:46.667485+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:56.640759+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":675,"num_read_kb":541,"num_write":147,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2500,"num_omap_keys":5,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:23:03.171554+0000","last_change":"2024-09-12T01:23:03.171554+0000","last_active":"2024-09-12T01:23:03.171554+0000","last_peered":"2024-09-12T01:23:03.171554+0000","last_clean":"2024-09-12T01:23:03.171554+0000","last_became_active":"2024-09-12T01:03:40.585894+0000","last_became_peered":"2024-09-12T01:03:40.585894+0000","last_unstale":"2024-09-12T01:23:03.171554+0000","last_undegraded":"2024-09-12T01:23:03.171554+0000","last_fullsized":"2024-09-12T01:23:03.171554+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:23:03.171370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:23:03.171370+0000","last_clean_scrub_stamp":"2024-09-12T01:23:03.171370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:10.286885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"262'3","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:50.522730+0000","last_change":"2024-09-12T01:22:50.522572+0000","last_active":"2024-09-12T01:22:50.522730+0000","last_peered":"2024-09-12T01:22:50.522730+0000","last_clean":"2024-09-12T01:22:50.522730+0000","last_became_active":"2024-09-12T00:52:40.355113+0000","last_became_peered":"2024-09-12T00:52:40.355113+0000","last_unstale":"2024-09-12T01:22:50.522730+0000","last_undegraded":"2024-09-12T01:22:50.522730+0000","last_fullsized":"2024-09-12T01:22:50.522730+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T01:22:50.522319+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T01:22:50.522319+0000","last_clean_scrub_stamp":"2024-09-12T01:22:50.522319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:33.444240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'3","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:41.955963+0000","last_change":"2024-09-12T01:22:41.955963+0000","last_active":"2024-09-12T01:22:41.955963+0000","last_peered":"2024-09-12T01:22:41.955963+0000","last_clean":"2024-09-12T01:22:41.955963+0000","last_became_active":"2024-09-12T00:52:37.280444+0000","last_became_peered":"2024-09-12T00:52:37.280444+0000","last_unstale":"2024-09-12T01:22:41.955963+0000","last_undegraded":"2024-09-12T01:22:41.955963+0000","last_fullsized":"2024-09-12T01:22:41.955963+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:22:41.955790+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:22:41.955790+0000","last_clean_scrub_stamp":"2024-09-12T01:22:41.955790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:07.749444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'48","reported_seq":189,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:32.107529+0000","last_change":"2024-09-12T01:22:32.107529+0000","last_active":"2024-09-12T01:22:32.107529+0000","last_peered":"2024-09-12T01:22:32.107529+0000","last_clean":"2024-09-12T01:22:32.107529+0000","last_became_active":"2024-09-12T00:51:04.984384+0000","last_became_peered":"2024-09-12T00:51:04.984384+0000","last_unstale":"2024-09-12T01:22:32.107529+0000","last_undegraded":"2024-09-12T01:22:32.107529+0000","last_fullsized":"2024-09-12T01:22:32.107529+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'48","last_scrub_stamp":"2024-09-12T01:22:32.107337+0000","last_deep_scrub":"265'48","last_deep_scrub_stamp":"2024-09-12T01:22:32.107337+0000","last_clean_scrub_stamp":"2024-09-12T01:22:32.107337+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:27.215513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":174,"num_write":98,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:53.562098+0000","last_change":"2024-09-12T01:22:53.562098+0000","last_active":"2024-09-12T01:22:53.562098+0000","last_peered":"2024-09-12T01:22:53.562098+0000","last_clean":"2024-09-12T01:22:53.562098+0000","last_became_active":"2024-09-12T01:03:40.565972+0000","last_became_peered":"2024-09-12T01:03:40.565972+0000","last_unstale":"2024-09-12T01:22:53.562098+0000","last_undegraded":"2024-09-12T01:22:53.562098+0000","last_fullsized":"2024-09-12T01:22:53.562098+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:53.561905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:53.561905+0000","last_clean_scrub_stamp":"2024-09-12T01:22:53.561905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:10.302712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"262'2","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:56.234634+0000","last_change":"2024-09-12T01:22:56.234634+0000","last_active":"2024-09-12T01:22:56.234634+0000","last_peered":"2024-09-12T01:22:56.234634+0000","last_clean":"2024-09-12T01:22:56.234634+0000","last_became_active":"2024-09-12T00:52:40.352178+0000","last_became_peered":"2024-09-12T00:52:40.352178+0000","last_unstale":"2024-09-12T01:22:56.234634+0000","last_undegraded":"2024-09-12T01:22:56.234634+0000","last_fullsized":"2024-09-12T01:22:56.234634+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T01:22:56.234405+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T01:22:56.234405+0000","last_clean_scrub_stamp":"2024-09-12T01:22:56.234405+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:34.775365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:47.529115+0000","last_change":"2024-09-12T01:22:47.529115+0000","last_active":"2024-09-12T01:22:47.529115+0000","last_peered":"2024-09-12T01:22:47.529115+0000","last_clean":"2024-09-12T01:22:47.529115+0000","last_became_active":"2024-09-12T00:52:37.280679+0000","last_became_peered":"2024-09-12T00:52:37.280679+0000","last_unstale":"2024-09-12T01:22:47.529115+0000","last_undegraded":"2024-09-12T01:22:47.529115+0000","last_fullsized":"2024-09-12T01:22:47.529115+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:47.528907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:47.528907+0000","last_clean_scrub_stamp":"2024-09-12T01:22:47.528907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:56.331674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'2","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:40.367300+0000","last_change":"2024-09-12T01:22:40.367300+0000","last_active":"2024-09-12T01:22:40.367300+0000","last_peered":"2024-09-12T01:22:40.367300+0000","last_clean":"2024-09-12T01:22:40.367300+0000","last_became_active":"2024-09-12T00:51:04.996736+0000","last_became_peered":"2024-09-12T00:51:04.996736+0000","last_unstale":"2024-09-12T01:22:40.367300+0000","last_undegraded":"2024-09-12T01:22:40.367300+0000","last_fullsized":"2024-09-12T01:22:40.367300+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:40.367022+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:40.367022+0000","last_clean_scrub_stamp":"2024-09-12T01:22:40.367022+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:54.019658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:49.541630+0000","last_change":"2024-09-12T01:22:49.541630+0000","last_active":"2024-09-12T01:22:49.541630+0000","last_peered":"2024-09-12T01:22:49.541630+0000","last_clean":"2024-09-12T01:22:49.541630+0000","last_became_active":"2024-09-12T01:03:40.576752+0000","last_became_peered":"2024-09-12T01:03:40.576752+0000","last_unstale":"2024-09-12T01:22:49.541630+0000","last_undegraded":"2024-09-12T01:22:49.541630+0000","last_fullsized":"2024-09-12T01:22:49.541630+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:49.541441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:49.541441+0000","last_clean_scrub_stamp":"2024-09-12T01:22:49.541441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:13.305717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"262'8","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:50.212219+0000","last_change":"2024-09-12T01:22:50.212219+0000","last_active":"2024-09-12T01:22:50.212219+0000","last_peered":"2024-09-12T01:22:50.212219+0000","last_clean":"2024-09-12T01:22:50.212219+0000","last_became_active":"2024-09-12T00:52:40.338378+0000","last_became_peered":"2024-09-12T00:52:40.338378+0000","last_unstale":"2024-09-12T01:22:50.212219+0000","last_undegraded":"2024-09-12T01:22:50.212219+0000","last_fullsized":"2024-09-12T01:22:50.212219+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-12T01:22:50.212015+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-12T01:22:50.212015+0000","last_clean_scrub_stamp":"2024-09-12T01:22:50.212015+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:27.082457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'6","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:25.407022+0000","last_change":"2024-09-12T01:22:25.407022+0000","last_active":"2024-09-12T01:22:25.407022+0000","last_peered":"2024-09-12T01:22:25.407022+0000","last_clean":"2024-09-12T01:22:25.407022+0000","last_became_active":"2024-09-12T00:52:37.284206+0000","last_became_peered":"2024-09-12T00:52:37.284206+0000","last_unstale":"2024-09-12T01:22:25.407022+0000","last_undegraded":"2024-09-12T01:22:25.407022+0000","last_fullsized":"2024-09-12T01:22:25.407022+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:22:25.406833+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:22:25.406833+0000","last_clean_scrub_stamp":"2024-09-12T01:22:25.406833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:01.812060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'21","reported_seq":114,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:31.080122+0000","last_change":"2024-09-12T01:22:31.080122+0000","last_active":"2024-09-12T01:22:31.080122+0000","last_peered":"2024-09-12T01:22:31.080122+0000","last_clean":"2024-09-12T01:22:31.080122+0000","last_became_active":"2024-09-12T00:51:04.983165+0000","last_became_peered":"2024-09-12T00:51:04.983165+0000","last_unstale":"2024-09-12T01:22:31.080122+0000","last_undegraded":"2024-09-12T01:22:31.080122+0000","last_fullsized":"2024-09-12T01:22:31.080122+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'21","last_scrub_stamp":"2024-09-12T01:22:31.079934+0000","last_deep_scrub":"265'21","last_deep_scrub_stamp":"2024-09-12T01:22:31.079934+0000","last_clean_scrub_stamp":"2024-09-12T01:22:31.079934+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:01.034206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":73,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:44.210029+0000","last_change":"2024-09-12T01:22:44.210029+0000","last_active":"2024-09-12T01:22:44.210029+0000","last_peered":"2024-09-12T01:22:44.210029+0000","last_clean":"2024-09-12T01:22:44.210029+0000","last_became_active":"2024-09-12T01:03:40.578825+0000","last_became_peered":"2024-09-12T01:03:40.578825+0000","last_unstale":"2024-09-12T01:22:44.210029+0000","last_undegraded":"2024-09-12T01:22:44.210029+0000","last_fullsized":"2024-09-12T01:22:44.210029+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:44.209845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:44.209845+0000","last_clean_scrub_stamp":"2024-09-12T01:22:44.209845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:49.070408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"265'3","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:49.515630+0000","last_change":"2024-09-12T01:22:49.515501+0000","last_active":"2024-09-12T01:22:49.515630+0000","last_peered":"2024-09-12T01:22:49.515630+0000","last_clean":"2024-09-12T01:22:49.515630+0000","last_became_active":"2024-09-12T00:52:40.352922+0000","last_became_peered":"2024-09-12T00:52:40.352922+0000","last_unstale":"2024-09-12T01:22:49.515630+0000","last_undegraded":"2024-09-12T01:22:49.515630+0000","last_fullsized":"2024-09-12T01:22:49.515630+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:22:49.515347+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:22:49.515347+0000","last_clean_scrub_stamp":"2024-09-12T01:22:49.515347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:01.262620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'3","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:44.554368+0000","last_change":"2024-09-12T01:22:44.554208+0000","last_active":"2024-09-12T01:22:44.554368+0000","last_peered":"2024-09-12T01:22:44.554368+0000","last_clean":"2024-09-12T01:22:44.554368+0000","last_became_active":"2024-09-12T00:52:37.280548+0000","last_became_peered":"2024-09-12T00:52:37.280548+0000","last_unstale":"2024-09-12T01:22:44.554368+0000","last_undegraded":"2024-09-12T01:22:44.554368+0000","last_fullsized":"2024-09-12T01:22:44.554368+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T01:22:44.554022+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T01:22:44.554022+0000","last_clean_scrub_stamp":"2024-09-12T01:22:44.554022+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:50.358571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'10","reported_seq":85,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:39.485140+0000","last_change":"2024-09-12T01:22:39.485140+0000","last_active":"2024-09-12T01:22:39.485140+0000","last_peered":"2024-09-12T01:22:39.485140+0000","last_clean":"2024-09-12T01:22:39.485140+0000","last_became_active":"2024-09-12T00:51:04.994904+0000","last_became_peered":"2024-09-12T00:51:04.994904+0000","last_unstale":"2024-09-12T01:22:39.485140+0000","last_undegraded":"2024-09-12T01:22:39.485140+0000","last_fullsized":"2024-09-12T01:22:39.485140+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-12T01:22:39.484956+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-12T01:22:39.484956+0000","last_clean_scrub_stamp":"2024-09-12T01:22:39.484956+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:47.260111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":34,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:51.923286+0000","last_change":"2024-09-12T01:22:51.923286+0000","last_active":"2024-09-12T01:22:51.923286+0000","last_peered":"2024-09-12T01:22:51.923286+0000","last_clean":"2024-09-12T01:22:51.923286+0000","last_became_active":"2024-09-12T01:03:40.576442+0000","last_became_peered":"2024-09-12T01:03:40.576442+0000","last_unstale":"2024-09-12T01:22:51.923286+0000","last_undegraded":"2024-09-12T01:22:51.923286+0000","last_fullsized":"2024-09-12T01:22:51.923286+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:51.923103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:51.923103+0000","last_clean_scrub_stamp":"2024-09-12T01:22:51.923103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:29.364701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"265'6","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:49.884143+0000","last_change":"2024-09-12T01:22:49.883998+0000","last_active":"2024-09-12T01:22:49.884143+0000","last_peered":"2024-09-12T01:22:49.884143+0000","last_clean":"2024-09-12T01:22:49.884143+0000","last_became_active":"2024-09-12T00:52:40.345375+0000","last_became_peered":"2024-09-12T00:52:40.345375+0000","last_unstale":"2024-09-12T01:22:49.884143+0000","last_undegraded":"2024-09-12T01:22:49.884143+0000","last_fullsized":"2024-09-12T01:22:49.884143+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:22:49.883811+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:22:49.883811+0000","last_clean_scrub_stamp":"2024-09-12T01:22:49.883811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:35.715106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"262'5","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:46.534936+0000","last_change":"2024-09-12T01:22:46.534784+0000","last_active":"2024-09-12T01:22:46.534936+0000","last_peered":"2024-09-12T01:22:46.534936+0000","last_clean":"2024-09-12T01:22:46.534936+0000","last_became_active":"2024-09-12T00:52:37.282005+0000","last_became_peered":"2024-09-12T00:52:37.282005+0000","last_unstale":"2024-09-12T01:22:46.534936+0000","last_undegraded":"2024-09-12T01:22:46.534936+0000","last_fullsized":"2024-09-12T01:22:46.534936+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T01:22:46.534547+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T01:22:46.534547+0000","last_clean_scrub_stamp":"2024-09-12T01:22:46.534547+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:29.126571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":5,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"265'13","reported_seq":91,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:32.297808+0000","last_change":"2024-09-12T01:22:32.297808+0000","last_active":"2024-09-12T01:22:32.297808+0000","last_peered":"2024-09-12T01:22:32.297808+0000","last_clean":"2024-09-12T01:22:32.297808+0000","last_became_active":"2024-09-12T00:51:04.990945+0000","last_became_peered":"2024-09-12T00:51:04.990945+0000","last_unstale":"2024-09-12T01:22:32.297808+0000","last_undegraded":"2024-09-12T01:22:32.297808+0000","last_fullsized":"2024-09-12T01:22:32.297808+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'13","last_scrub_stamp":"2024-09-12T01:22:32.297522+0000","last_deep_scrub":"265'13","last_deep_scrub_stamp":"2024-09-12T01:22:32.297522+0000","last_clean_scrub_stamp":"2024-09-12T01:22:32.297522+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:38.583047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"265'2","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:31.394987+0000","last_change":"2024-09-12T01:22:31.394811+0000","last_active":"2024-09-12T01:22:31.394987+0000","last_peered":"2024-09-12T01:22:31.394987+0000","last_clean":"2024-09-12T01:22:31.394987+0000","last_became_active":"2024-09-12T01:03:40.581227+0000","last_became_peered":"2024-09-12T01:03:40.581227+0000","last_unstale":"2024-09-12T01:22:31.394987+0000","last_undegraded":"2024-09-12T01:22:31.394987+0000","last_fullsized":"2024-09-12T01:22:31.394987+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:31.394614+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:31.394614+0000","last_clean_scrub_stamp":"2024-09-12T01:22:31.394614+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:55.398951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:39.225501+0000","last_change":"2024-09-12T01:22:39.225501+0000","last_active":"2024-09-12T01:22:39.225501+0000","last_peered":"2024-09-12T01:22:39.225501+0000","last_clean":"2024-09-12T01:22:39.225501+0000","last_became_active":"2024-09-12T00:52:40.340078+0000","last_became_peered":"2024-09-12T00:52:40.340078+0000","last_unstale":"2024-09-12T01:22:39.225501+0000","last_undegraded":"2024-09-12T01:22:39.225501+0000","last_fullsized":"2024-09-12T01:22:39.225501+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:39.225310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:39.225310+0000","last_clean_scrub_stamp":"2024-09-12T01:22:39.225310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:20.437110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"262'5","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:42.492563+0000","last_change":"2024-09-12T01:22:42.492563+0000","last_active":"2024-09-12T01:22:42.492563+0000","last_peered":"2024-09-12T01:22:42.492563+0000","last_clean":"2024-09-12T01:22:42.492563+0000","last_became_active":"2024-09-12T00:52:37.277753+0000","last_became_peered":"2024-09-12T00:52:37.277753+0000","last_unstale":"2024-09-12T01:22:42.492563+0000","last_undegraded":"2024-09-12T01:22:42.492563+0000","last_fullsized":"2024-09-12T01:22:42.492563+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T01:22:42.492372+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T01:22:42.492372+0000","last_clean_scrub_stamp":"2024-09-12T01:22:42.492372+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:18.929803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"254'7","reported_seq":79,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:42.599498+0000","last_change":"2024-09-12T01:22:42.599498+0000","last_active":"2024-09-12T01:22:42.599498+0000","last_peered":"2024-09-12T01:22:42.599498+0000","last_clean":"2024-09-12T01:22:42.599498+0000","last_became_active":"2024-09-12T00:51:04.956754+0000","last_became_peered":"2024-09-12T00:51:04.956754+0000","last_unstale":"2024-09-12T01:22:42.599498+0000","last_undegraded":"2024-09-12T01:22:42.599498+0000","last_fullsized":"2024-09-12T01:22:42.599498+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"254'7","last_scrub_stamp":"2024-09-12T01:22:42.599303+0000","last_deep_scrub":"254'7","last_deep_scrub_stamp":"2024-09-12T01:22:42.599303+0000","last_clean_scrub_stamp":"2024-09-12T01:22:42.599303+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:17.291713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":30,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:59.193608+0000","last_change":"2024-09-12T01:22:59.193369+0000","last_active":"2024-09-12T01:22:59.193608+0000","last_peered":"2024-09-12T01:22:59.193608+0000","last_clean":"2024-09-12T01:22:59.193608+0000","last_became_active":"2024-09-12T01:03:40.583308+0000","last_became_peered":"2024-09-12T01:03:40.583308+0000","last_unstale":"2024-09-12T01:22:59.193608+0000","last_undegraded":"2024-09-12T01:22:59.193608+0000","last_fullsized":"2024-09-12T01:22:59.193608+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:59.193167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:59.193167+0000","last_clean_scrub_stamp":"2024-09-12T01:22:59.193167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:46.236216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'6","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:46.493862+0000","last_change":"2024-09-12T01:22:46.493725+0000","last_active":"2024-09-12T01:22:46.493862+0000","last_peered":"2024-09-12T01:22:46.493862+0000","last_clean":"2024-09-12T01:22:46.493862+0000","last_became_active":"2024-09-12T00:52:40.332913+0000","last_became_peered":"2024-09-12T00:52:40.332913+0000","last_unstale":"2024-09-12T01:22:46.493862+0000","last_undegraded":"2024-09-12T01:22:46.493862+0000","last_fullsized":"2024-09-12T01:22:46.493862+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:22:46.493474+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:22:46.493474+0000","last_clean_scrub_stamp":"2024-09-12T01:22:46.493474+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:34.535106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"265'3","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:45.549110+0000","last_change":"2024-09-12T01:22:45.549110+0000","last_active":"2024-09-12T01:22:45.549110+0000","last_peered":"2024-09-12T01:22:45.549110+0000","last_clean":"2024-09-12T01:22:45.549110+0000","last_became_active":"2024-09-12T00:52:37.282758+0000","last_became_peered":"2024-09-12T00:52:37.282758+0000","last_unstale":"2024-09-12T01:22:45.549110+0000","last_undegraded":"2024-09-12T01:22:45.549110+0000","last_fullsized":"2024-09-12T01:22:45.549110+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:22:45.548934+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:22:45.548934+0000","last_clean_scrub_stamp":"2024-09-12T01:22:45.548934+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:40.125683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'71","reported_seq":253,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:40.940513+0000","last_change":"2024-09-12T01:22:40.940513+0000","last_active":"2024-09-12T01:22:40.940513+0000","last_peered":"2024-09-12T01:22:40.940513+0000","last_clean":"2024-09-12T01:22:40.940513+0000","last_became_active":"2024-09-12T00:51:04.982747+0000","last_became_peered":"2024-09-12T00:51:04.982747+0000","last_unstale":"2024-09-12T01:22:40.940513+0000","last_undegraded":"2024-09-12T01:22:40.940513+0000","last_fullsized":"2024-09-12T01:22:40.940513+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'71","last_scrub_stamp":"2024-09-12T01:22:40.940337+0000","last_deep_scrub":"265'71","last_deep_scrub_stamp":"2024-09-12T01:22:40.940337+0000","last_clean_scrub_stamp":"2024-09-12T01:22:40.940337+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:33.997706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":369,"num_read_kb":267,"num_write":124,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:23:00.176177+0000","last_change":"2024-09-12T01:23:00.176177+0000","last_active":"2024-09-12T01:23:00.176177+0000","last_peered":"2024-09-12T01:23:00.176177+0000","last_clean":"2024-09-12T01:23:00.176177+0000","last_became_active":"2024-09-12T01:03:40.571968+0000","last_became_peered":"2024-09-12T01:03:40.571968+0000","last_unstale":"2024-09-12T01:23:00.176177+0000","last_undegraded":"2024-09-12T01:23:00.176177+0000","last_fullsized":"2024-09-12T01:23:00.176177+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:23:00.175995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:23:00.175995+0000","last_clean_scrub_stamp":"2024-09-12T01:23:00.175995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:57.742195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'7","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:36.013174+0000","last_change":"2024-09-12T01:22:36.013174+0000","last_active":"2024-09-12T01:22:36.013174+0000","last_peered":"2024-09-12T01:22:36.013174+0000","last_clean":"2024-09-12T01:22:36.013174+0000","last_became_active":"2024-09-12T00:52:40.359434+0000","last_became_peered":"2024-09-12T00:52:40.359434+0000","last_unstale":"2024-09-12T01:22:36.013174+0000","last_undegraded":"2024-09-12T01:22:36.013174+0000","last_fullsized":"2024-09-12T01:22:36.013174+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T01:22:36.012999+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T01:22:36.012999+0000","last_clean_scrub_stamp":"2024-09-12T01:22:36.012999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:39.219563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":12,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'6","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:34.270661+0000","last_change":"2024-09-12T01:22:34.270661+0000","last_active":"2024-09-12T01:22:34.270661+0000","last_peered":"2024-09-12T01:22:34.270661+0000","last_clean":"2024-09-12T01:22:34.270661+0000","last_became_active":"2024-09-12T00:52:37.291369+0000","last_became_peered":"2024-09-12T00:52:37.291369+0000","last_unstale":"2024-09-12T01:22:34.270661+0000","last_undegraded":"2024-09-12T01:22:34.270661+0000","last_fullsized":"2024-09-12T01:22:34.270661+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:22:34.270471+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:22:34.270471+0000","last_clean_scrub_stamp":"2024-09-12T01:22:34.270471+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:30.065536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'35","reported_seq":145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:30.057750+0000","last_change":"2024-09-12T01:22:30.057750+0000","last_active":"2024-09-12T01:22:30.057750+0000","last_peered":"2024-09-12T01:22:30.057750+0000","last_clean":"2024-09-12T01:22:30.057750+0000","last_became_active":"2024-09-12T00:51:04.990179+0000","last_became_peered":"2024-09-12T00:51:04.990179+0000","last_unstale":"2024-09-12T01:22:30.057750+0000","last_undegraded":"2024-09-12T01:22:30.057750+0000","last_fullsized":"2024-09-12T01:22:30.057750+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'35","last_scrub_stamp":"2024-09-12T01:22:30.057517+0000","last_deep_scrub":"265'35","last_deep_scrub_stamp":"2024-09-12T01:22:30.057517+0000","last_clean_scrub_stamp":"2024-09-12T01:22:30.057517+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:37.573193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":108,"num_write":67,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:54.584333+0000","last_change":"2024-09-12T01:22:54.584333+0000","last_active":"2024-09-12T01:22:54.584333+0000","last_peered":"2024-09-12T01:22:54.584333+0000","last_clean":"2024-09-12T01:22:54.584333+0000","last_became_active":"2024-09-12T01:03:40.573928+0000","last_became_peered":"2024-09-12T01:03:40.573928+0000","last_unstale":"2024-09-12T01:22:54.584333+0000","last_undegraded":"2024-09-12T01:22:54.584333+0000","last_fullsized":"2024-09-12T01:22:54.584333+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:54.584152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:54.584152+0000","last_clean_scrub_stamp":"2024-09-12T01:22:54.584152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:26.256330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:47.810080+0000","last_change":"2024-09-12T01:22:47.810080+0000","last_active":"2024-09-12T01:22:47.810080+0000","last_peered":"2024-09-12T01:22:47.810080+0000","last_clean":"2024-09-12T01:22:47.810080+0000","last_became_active":"2024-09-12T00:52:40.348494+0000","last_became_peered":"2024-09-12T00:52:40.348494+0000","last_unstale":"2024-09-12T01:22:47.810080+0000","last_undegraded":"2024-09-12T01:22:47.810080+0000","last_fullsized":"2024-09-12T01:22:47.810080+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:47.809899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:47.809899+0000","last_clean_scrub_stamp":"2024-09-12T01:22:47.809899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:42.801544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'2","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:35.053445+0000","last_change":"2024-09-12T01:22:35.053445+0000","last_active":"2024-09-12T01:22:35.053445+0000","last_peered":"2024-09-12T01:22:35.053445+0000","last_clean":"2024-09-12T01:22:35.053445+0000","last_became_active":"2024-09-12T00:52:37.278285+0000","last_became_peered":"2024-09-12T00:52:37.278285+0000","last_unstale":"2024-09-12T01:22:35.053445+0000","last_undegraded":"2024-09-12T01:22:35.053445+0000","last_fullsized":"2024-09-12T01:22:35.053445+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T01:22:35.053225+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T01:22:35.053225+0000","last_clean_scrub_stamp":"2024-09-12T01:22:35.053225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:02.281428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'29","reported_seq":134,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:37.474735+0000","last_change":"2024-09-12T01:22:37.474569+0000","last_active":"2024-09-12T01:22:37.474735+0000","last_peered":"2024-09-12T01:22:37.474735+0000","last_clean":"2024-09-12T01:22:37.474735+0000","last_became_active":"2024-09-12T00:51:04.984999+0000","last_became_peered":"2024-09-12T00:51:04.984999+0000","last_unstale":"2024-09-12T01:22:37.474735+0000","last_undegraded":"2024-09-12T01:22:37.474735+0000","last_fullsized":"2024-09-12T01:22:37.474735+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'29","last_scrub_stamp":"2024-09-12T01:22:37.474379+0000","last_deep_scrub":"265'29","last_deep_scrub_stamp":"2024-09-12T01:22:37.474379+0000","last_clean_scrub_stamp":"2024-09-12T01:22:37.474379+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:27.806721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":53,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'333","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.526698+0000","last_change":"2024-09-12T01:22:17.526698+0000","last_active":"2024-09-12T01:22:17.526698+0000","last_peered":"2024-09-12T01:22:17.526698+0000","last_clean":"2024-09-12T01:22:17.526698+0000","last_became_active":"2024-09-12T00:35:43.947816+0000","last_became_peered":"2024-09-12T00:35:43.947816+0000","last_unstale":"2024-09-12T01:22:17.526698+0000","last_undegraded":"2024-09-12T01:22:17.526698+0000","last_fullsized":"2024-09-12T01:22:17.526698+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-12T01:22:17.526459+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-12T01:22:17.526459+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.526459+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:45.054333+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1291295,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":33235,"num_write":1076,"num_write_kb":21608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'253","reported_seq":885,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.685991+0000","last_change":"2024-09-12T01:22:22.685823+0000","last_active":"2024-09-12T01:22:22.685991+0000","last_peered":"2024-09-12T01:22:22.685991+0000","last_clean":"2024-09-12T01:22:22.685991+0000","last_became_active":"2024-09-12T00:35:45.925856+0000","last_became_peered":"2024-09-12T00:35:45.925856+0000","last_unstale":"2024-09-12T01:22:22.685991+0000","last_undegraded":"2024-09-12T01:22:22.685991+0000","last_fullsized":"2024-09-12T01:22:22.685991+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'253","last_scrub_stamp":"2024-09-12T01:22:22.685653+0000","last_deep_scrub":"265'253","last_deep_scrub_stamp":"2024-09-12T01:22:22.685653+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.685653+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:53.425516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1075,"num_read_kb":882,"num_write":373,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'379","reported_seq":1051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.216236+0000","last_change":"2024-09-12T01:22:10.216236+0000","last_active":"2024-09-12T01:22:10.216236+0000","last_peered":"2024-09-12T01:22:10.216236+0000","last_clean":"2024-09-12T01:22:10.216236+0000","last_became_active":"2024-09-12T00:35:43.933088+0000","last_became_peered":"2024-09-12T00:35:43.933088+0000","last_unstale":"2024-09-12T01:22:10.216236+0000","last_undegraded":"2024-09-12T01:22:10.216236+0000","last_fullsized":"2024-09-12T01:22:10.216236+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'379","last_scrub_stamp":"2024-09-12T01:22:10.215975+0000","last_deep_scrub":"265'379","last_deep_scrub_stamp":"2024-09-12T01:22:10.215975+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.215975+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:43.999693+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":567,"num_read_kb":47488,"num_write":1216,"num_write_kb":29880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'45","reported_seq":588,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.419298+0000","last_change":"2024-09-12T01:22:21.419078+0000","last_active":"2024-09-12T01:22:21.419298+0000","last_peered":"2024-09-12T01:22:21.419298+0000","last_clean":"2024-09-12T01:22:21.419298+0000","last_became_active":"2024-09-12T00:35:45.947212+0000","last_became_peered":"2024-09-12T00:35:45.947212+0000","last_unstale":"2024-09-12T01:22:21.419298+0000","last_undegraded":"2024-09-12T01:22:21.419298+0000","last_fullsized":"2024-09-12T01:22:21.419298+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'45","last_scrub_stamp":"2024-09-12T01:22:21.418869+0000","last_deep_scrub":"265'45","last_deep_scrub_stamp":"2024-09-12T01:22:21.418869+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.418869+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:50:21.799809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":168,"num_write":71,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'336","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.537484+0000","last_change":"2024-09-12T01:22:12.537484+0000","last_active":"2024-09-12T01:22:12.537484+0000","last_peered":"2024-09-12T01:22:12.537484+0000","last_clean":"2024-09-12T01:22:12.537484+0000","last_became_active":"2024-09-12T00:35:43.926443+0000","last_became_peered":"2024-09-12T00:35:43.926443+0000","last_unstale":"2024-09-12T01:22:12.537484+0000","last_undegraded":"2024-09-12T01:22:12.537484+0000","last_fullsized":"2024-09-12T01:22:12.537484+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'336","last_scrub_stamp":"2024-09-12T01:22:12.537222+0000","last_deep_scrub":"265'336","last_deep_scrub_stamp":"2024-09-12T01:22:12.537222+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.537222+0000","objects_scrubbed":9,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:43.392767+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262209,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":553,"num_read_kb":98039,"num_write":1093,"num_write_kb":58371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'116","reported_seq":738,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.906557+0000","last_change":"2024-09-12T01:22:21.906406+0000","last_active":"2024-09-12T01:22:21.906557+0000","last_peered":"2024-09-12T01:22:21.906557+0000","last_clean":"2024-09-12T01:22:21.906557+0000","last_became_active":"2024-09-12T00:35:45.930987+0000","last_became_peered":"2024-09-12T00:35:45.930987+0000","last_unstale":"2024-09-12T01:22:21.906557+0000","last_undegraded":"2024-09-12T01:22:21.906557+0000","last_fullsized":"2024-09-12T01:22:21.906557+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'116","last_scrub_stamp":"2024-09-12T01:22:21.906229+0000","last_deep_scrub":"265'116","last_deep_scrub_stamp":"2024-09-12T01:22:21.906229+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.906229+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:48.016467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":522,"num_read_kb":443,"num_write":187,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'383","reported_seq":1063,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.820355+0000","last_change":"2024-09-12T01:22:15.820355+0000","last_active":"2024-09-12T01:22:15.820355+0000","last_peered":"2024-09-12T01:22:15.820355+0000","last_clean":"2024-09-12T01:22:15.820355+0000","last_became_active":"2024-09-12T00:35:43.914356+0000","last_became_peered":"2024-09-12T00:35:43.914356+0000","last_unstale":"2024-09-12T01:22:15.820355+0000","last_undegraded":"2024-09-12T01:22:15.820355+0000","last_fullsized":"2024-09-12T01:22:15.820355+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'383","last_scrub_stamp":"2024-09-12T01:22:15.820094+0000","last_deep_scrub":"265'383","last_deep_scrub_stamp":"2024-09-12T01:22:15.820094+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.820094+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:01.760407+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6370276,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":596,"num_read_kb":17763,"num_write":1203,"num_write_kb":54335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'197","reported_seq":803,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.513576+0000","last_change":"2024-09-12T01:22:17.513443+0000","last_active":"2024-09-12T01:22:17.513576+0000","last_peered":"2024-09-12T01:22:17.513576+0000","last_clean":"2024-09-12T01:22:17.513576+0000","last_became_active":"2024-09-12T00:35:45.942567+0000","last_became_peered":"2024-09-12T00:35:45.942567+0000","last_unstale":"2024-09-12T01:22:17.513576+0000","last_undegraded":"2024-09-12T01:22:17.513576+0000","last_fullsized":"2024-09-12T01:22:17.513576+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'197","last_scrub_stamp":"2024-09-12T01:22:17.513255+0000","last_deep_scrub":"265'197","last_deep_scrub_stamp":"2024-09-12T01:22:17.513255+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.513255+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:58.319165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":861,"num_read_kb":699,"num_write":314,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'348","reported_seq":1014,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.507780+0000","last_change":"2024-09-12T01:22:16.507635+0000","last_active":"2024-09-12T01:22:16.507780+0000","last_peered":"2024-09-12T01:22:16.507780+0000","last_clean":"2024-09-12T01:22:16.507780+0000","last_became_active":"2024-09-12T00:35:43.944644+0000","last_became_peered":"2024-09-12T00:35:43.944644+0000","last_unstale":"2024-09-12T01:22:16.507780+0000","last_undegraded":"2024-09-12T01:22:16.507780+0000","last_fullsized":"2024-09-12T01:22:16.507780+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-12T01:22:16.507410+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-12T01:22:16.507410+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.507410+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:46.731365+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289155,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":589,"num_read_kb":29244,"num_write":1174,"num_write_kb":25136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'342","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.112383+0000","last_change":"2024-09-12T01:22:17.112383+0000","last_active":"2024-09-12T01:22:17.112383+0000","last_peered":"2024-09-12T01:22:17.112383+0000","last_clean":"2024-09-12T01:22:17.112383+0000","last_became_active":"2024-09-12T00:35:45.943110+0000","last_became_peered":"2024-09-12T00:35:45.943110+0000","last_unstale":"2024-09-12T01:22:17.112383+0000","last_undegraded":"2024-09-12T01:22:17.112383+0000","last_fullsized":"2024-09-12T01:22:17.112383+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T01:22:17.112199+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T01:22:17.112199+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.112199+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:44.660281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1719,"num_read_kb":1451,"num_write":623,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'340","reported_seq":959,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.812082+0000","last_change":"2024-09-12T01:22:16.811940+0000","last_active":"2024-09-12T01:22:16.812082+0000","last_peered":"2024-09-12T01:22:16.812082+0000","last_clean":"2024-09-12T01:22:16.812082+0000","last_became_active":"2024-09-12T00:35:43.929553+0000","last_became_peered":"2024-09-12T00:35:43.929553+0000","last_unstale":"2024-09-12T01:22:16.812082+0000","last_undegraded":"2024-09-12T01:22:16.812082+0000","last_fullsized":"2024-09-12T01:22:16.812082+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'340","last_scrub_stamp":"2024-09-12T01:22:16.811714+0000","last_deep_scrub":"265'340","last_deep_scrub_stamp":"2024-09-12T01:22:16.811714+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.811714+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:09.205040+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8021586,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":453,"num_read_kb":14436,"num_write":1125,"num_write_kb":49786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'350","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:23.861032+0000","last_change":"2024-09-12T01:22:23.861032+0000","last_active":"2024-09-12T01:22:23.861032+0000","last_peered":"2024-09-12T01:22:23.861032+0000","last_clean":"2024-09-12T01:22:23.861032+0000","last_became_active":"2024-09-12T00:35:45.934193+0000","last_became_peered":"2024-09-12T00:35:45.934193+0000","last_unstale":"2024-09-12T01:22:23.861032+0000","last_undegraded":"2024-09-12T01:22:23.861032+0000","last_fullsized":"2024-09-12T01:22:23.861032+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'350","last_scrub_stamp":"2024-09-12T01:22:23.860857+0000","last_deep_scrub":"265'350","last_deep_scrub_stamp":"2024-09-12T01:22:23.860857+0000","last_clean_scrub_stamp":"2024-09-12T01:22:23.860857+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:53.109892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1452,"num_read_kb":1165,"num_write":550,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'395","reported_seq":1085,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.543992+0000","last_change":"2024-09-12T01:22:15.543860+0000","last_active":"2024-09-12T01:22:15.543992+0000","last_peered":"2024-09-12T01:22:15.543992+0000","last_clean":"2024-09-12T01:22:15.543992+0000","last_became_active":"2024-09-12T00:35:43.942199+0000","last_became_peered":"2024-09-12T00:35:43.942199+0000","last_unstale":"2024-09-12T01:22:15.543992+0000","last_undegraded":"2024-09-12T01:22:15.543992+0000","last_fullsized":"2024-09-12T01:22:15.543992+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'395","last_scrub_stamp":"2024-09-12T01:22:15.543686+0000","last_deep_scrub":"265'395","last_deep_scrub_stamp":"2024-09-12T01:22:15.543686+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.543686+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:08.555732+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":650,"num_read_kb":42927,"num_write":1209,"num_write_kb":42524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'254","reported_seq":925,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:23.654827+0000","last_change":"2024-09-12T01:22:23.654827+0000","last_active":"2024-09-12T01:22:23.654827+0000","last_peered":"2024-09-12T01:22:23.654827+0000","last_clean":"2024-09-12T01:22:23.654827+0000","last_became_active":"2024-09-12T00:35:45.937211+0000","last_became_peered":"2024-09-12T00:35:45.937211+0000","last_unstale":"2024-09-12T01:22:23.654827+0000","last_undegraded":"2024-09-12T01:22:23.654827+0000","last_fullsized":"2024-09-12T01:22:23.654827+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'254","last_scrub_stamp":"2024-09-12T01:22:23.654583+0000","last_deep_scrub":"265'254","last_deep_scrub_stamp":"2024-09-12T01:22:23.654583+0000","last_clean_scrub_stamp":"2024-09-12T01:22:23.654583+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:22.042826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1131,"num_read_kb":929,"num_write":387,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'365","reported_seq":1057,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.610451+0000","last_change":"2024-09-12T01:22:15.610299+0000","last_active":"2024-09-12T01:22:15.610451+0000","last_peered":"2024-09-12T01:22:15.610451+0000","last_clean":"2024-09-12T01:22:15.610451+0000","last_became_active":"2024-09-12T00:35:43.918653+0000","last_became_peered":"2024-09-12T00:35:43.918653+0000","last_unstale":"2024-09-12T01:22:15.610451+0000","last_undegraded":"2024-09-12T01:22:15.610451+0000","last_fullsized":"2024-09-12T01:22:15.610451+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T01:22:15.610082+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T01:22:15.610082+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.610082+0000","objects_scrubbed":8,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:31.364055+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262196,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":641,"num_read_kb":7519,"num_write":1239,"num_write_kb":32586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'269","reported_seq":937,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.447841+0000","last_change":"2024-09-12T01:22:10.447841+0000","last_active":"2024-09-12T01:22:10.447841+0000","last_peered":"2024-09-12T01:22:10.447841+0000","last_clean":"2024-09-12T01:22:10.447841+0000","last_became_active":"2024-09-12T00:35:45.941814+0000","last_became_peered":"2024-09-12T00:35:45.941814+0000","last_unstale":"2024-09-12T01:22:10.447841+0000","last_undegraded":"2024-09-12T01:22:10.447841+0000","last_fullsized":"2024-09-12T01:22:10.447841+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'269","last_scrub_stamp":"2024-09-12T01:22:10.447618+0000","last_deep_scrub":"265'269","last_deep_scrub_stamp":"2024-09-12T01:22:10.447618+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.447618+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:20.433161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1198,"num_read_kb":983,"num_write":434,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'104","reported_seq":687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.952536+0000","last_change":"2024-09-12T01:22:20.952362+0000","last_active":"2024-09-12T01:22:20.952536+0000","last_peered":"2024-09-12T01:22:20.952536+0000","last_clean":"2024-09-12T01:22:20.952536+0000","last_became_active":"2024-09-12T00:35:45.929168+0000","last_became_peered":"2024-09-12T00:35:45.929168+0000","last_unstale":"2024-09-12T01:22:20.952536+0000","last_undegraded":"2024-09-12T01:22:20.952536+0000","last_fullsized":"2024-09-12T01:22:20.952536+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'104","last_scrub_stamp":"2024-09-12T01:22:20.952183+0000","last_deep_scrub":"265'104","last_deep_scrub_stamp":"2024-09-12T01:22:20.952183+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.952183+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:31.113426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":468,"num_read_kb":393,"num_write":157,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'374","reported_seq":1031,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.525467+0000","last_change":"2024-09-12T01:22:14.525467+0000","last_active":"2024-09-12T01:22:14.525467+0000","last_peered":"2024-09-12T01:22:14.525467+0000","last_clean":"2024-09-12T01:22:14.525467+0000","last_became_active":"2024-09-12T00:35:43.949857+0000","last_became_peered":"2024-09-12T00:35:43.949857+0000","last_unstale":"2024-09-12T01:22:14.525467+0000","last_undegraded":"2024-09-12T01:22:14.525467+0000","last_fullsized":"2024-09-12T01:22:14.525467+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T01:22:14.525234+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T01:22:14.525234+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.525234+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:51.992259+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":541,"num_read_kb":3399,"num_write":1114,"num_write_kb":43442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'111","reported_seq":693,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.429442+0000","last_change":"2024-09-12T01:22:19.429285+0000","last_active":"2024-09-12T01:22:19.429442+0000","last_peered":"2024-09-12T01:22:19.429442+0000","last_clean":"2024-09-12T01:22:19.429442+0000","last_became_active":"2024-09-12T00:35:45.947366+0000","last_became_peered":"2024-09-12T00:35:45.947366+0000","last_unstale":"2024-09-12T01:22:19.429442+0000","last_undegraded":"2024-09-12T01:22:19.429442+0000","last_fullsized":"2024-09-12T01:22:19.429442+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'111","last_scrub_stamp":"2024-09-12T01:22:19.429104+0000","last_deep_scrub":"265'111","last_deep_scrub_stamp":"2024-09-12T01:22:19.429104+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.429104+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:52.961560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":482,"num_read_kb":394,"num_write":173,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'368","reported_seq":1051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.214862+0000","last_change":"2024-09-12T01:22:12.214862+0000","last_active":"2024-09-12T01:22:12.214862+0000","last_peered":"2024-09-12T01:22:12.214862+0000","last_clean":"2024-09-12T01:22:12.214862+0000","last_became_active":"2024-09-12T00:35:43.926027+0000","last_became_peered":"2024-09-12T00:35:43.926027+0000","last_unstale":"2024-09-12T01:22:12.214862+0000","last_undegraded":"2024-09-12T01:22:12.214862+0000","last_fullsized":"2024-09-12T01:22:12.214862+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'368","last_scrub_stamp":"2024-09-12T01:22:12.214580+0000","last_deep_scrub":"265'368","last_deep_scrub_stamp":"2024-09-12T01:22:12.214580+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.214580+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:50.008326+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":574,"num_read_kb":69210,"num_write":1266,"num_write_kb":64702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'169","reported_seq":786,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.751016+0000","last_change":"2024-09-12T01:22:20.750840+0000","last_active":"2024-09-12T01:22:20.751016+0000","last_peered":"2024-09-12T01:22:20.751016+0000","last_clean":"2024-09-12T01:22:20.751016+0000","last_became_active":"2024-09-12T00:35:45.932116+0000","last_became_peered":"2024-09-12T00:35:45.932116+0000","last_unstale":"2024-09-12T01:22:20.751016+0000","last_undegraded":"2024-09-12T01:22:20.751016+0000","last_fullsized":"2024-09-12T01:22:20.751016+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'169","last_scrub_stamp":"2024-09-12T01:22:20.750664+0000","last_deep_scrub":"265'169","last_deep_scrub_stamp":"2024-09-12T01:22:20.750664+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.750664+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:56.693844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":828,"num_read_kb":701,"num_write":304,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'373","reported_seq":1069,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.243782+0000","last_change":"2024-09-12T01:22:11.243782+0000","last_active":"2024-09-12T01:22:11.243782+0000","last_peered":"2024-09-12T01:22:11.243782+0000","last_clean":"2024-09-12T01:22:11.243782+0000","last_became_active":"2024-09-12T00:36:17.045217+0000","last_became_peered":"2024-09-12T00:36:17.045217+0000","last_unstale":"2024-09-12T01:22:11.243782+0000","last_undegraded":"2024-09-12T01:22:11.243782+0000","last_fullsized":"2024-09-12T01:22:11.243782+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T01:22:11.243529+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T01:22:11.243529+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.243529+0000","objects_scrubbed":8,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:11.316579+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460235,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":599,"num_read_kb":9912,"num_write":1094,"num_write_kb":33583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'100","reported_seq":659,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.371858+0000","last_change":"2024-09-12T01:22:12.371858+0000","last_active":"2024-09-12T01:22:12.371858+0000","last_peered":"2024-09-12T01:22:12.371858+0000","last_clean":"2024-09-12T01:22:12.371858+0000","last_became_active":"2024-09-12T00:35:45.939261+0000","last_became_peered":"2024-09-12T00:35:45.939261+0000","last_unstale":"2024-09-12T01:22:12.371858+0000","last_undegraded":"2024-09-12T01:22:12.371858+0000","last_fullsized":"2024-09-12T01:22:12.371858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'100","last_scrub_stamp":"2024-09-12T01:22:12.371622+0000","last_deep_scrub":"265'100","last_deep_scrub_stamp":"2024-09-12T01:22:12.371622+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.371622+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:46.453737+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":439,"num_read_kb":359,"num_write":158,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'344","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.047647+0000","last_change":"2024-09-12T01:22:08.047647+0000","last_active":"2024-09-12T01:22:08.047647+0000","last_peered":"2024-09-12T01:22:08.047647+0000","last_clean":"2024-09-12T01:22:08.047647+0000","last_became_active":"2024-09-12T00:35:43.949045+0000","last_became_peered":"2024-09-12T00:35:43.949045+0000","last_unstale":"2024-09-12T01:22:08.047647+0000","last_undegraded":"2024-09-12T01:22:08.047647+0000","last_fullsized":"2024-09-12T01:22:08.047647+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'344","last_scrub_stamp":"2024-09-12T01:22:08.047386+0000","last_deep_scrub":"265'344","last_deep_scrub_stamp":"2024-09-12T01:22:08.047386+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.047386+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:24.278106+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289432,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":556,"num_read_kb":18745,"num_write":1038,"num_write_kb":46080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'126","reported_seq":733,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.474888+0000","last_change":"2024-09-12T01:22:06.474888+0000","last_active":"2024-09-12T01:22:06.474888+0000","last_peered":"2024-09-12T01:22:06.474888+0000","last_clean":"2024-09-12T01:22:06.474888+0000","last_became_active":"2024-09-12T00:35:45.942814+0000","last_became_peered":"2024-09-12T00:35:45.942814+0000","last_unstale":"2024-09-12T01:22:06.474888+0000","last_undegraded":"2024-09-12T01:22:06.474888+0000","last_fullsized":"2024-09-12T01:22:06.474888+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'126","last_scrub_stamp":"2024-09-12T01:22:06.474688+0000","last_deep_scrub":"265'126","last_deep_scrub_stamp":"2024-09-12T01:22:06.474688+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.474688+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:09.883585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":574,"num_read_kb":483,"num_write":214,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'325","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.633517+0000","last_change":"2024-09-12T01:22:12.633517+0000","last_active":"2024-09-12T01:22:12.633517+0000","last_peered":"2024-09-12T01:22:12.633517+0000","last_clean":"2024-09-12T01:22:12.633517+0000","last_became_active":"2024-09-12T00:35:43.939128+0000","last_became_peered":"2024-09-12T00:35:43.939128+0000","last_unstale":"2024-09-12T01:22:12.633517+0000","last_undegraded":"2024-09-12T01:22:12.633517+0000","last_fullsized":"2024-09-12T01:22:12.633517+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'325","last_scrub_stamp":"2024-09-12T01:22:12.633317+0000","last_deep_scrub":"265'325","last_deep_scrub_stamp":"2024-09-12T01:22:12.633317+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.633317+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:15.440772+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":453,"num_read_kb":9693,"num_write":1061,"num_write_kb":13466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'4124","reported_seq":4728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.894824+0000","last_change":"2024-09-12T01:22:22.894824+0000","last_active":"2024-09-12T01:22:22.894824+0000","last_peered":"2024-09-12T01:22:22.894824+0000","last_clean":"2024-09-12T01:22:22.894824+0000","last_became_active":"2024-09-12T00:35:45.943253+0000","last_became_peered":"2024-09-12T00:35:45.943253+0000","last_unstale":"2024-09-12T01:22:22.894824+0000","last_undegraded":"2024-09-12T01:22:22.894824+0000","last_fullsized":"2024-09-12T01:22:22.894824+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4124","last_scrub_stamp":"2024-09-12T01:22:22.894642+0000","last_deep_scrub":"265'4124","last_deep_scrub_stamp":"2024-09-12T01:22:22.894642+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.894642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":3000,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:05.132607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16581,"num_read_kb":13903,"num_write":6185,"num_write_kb":3084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'358","reported_seq":1028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.573973+0000","last_change":"2024-09-12T01:22:10.573810+0000","last_active":"2024-09-12T01:22:10.573973+0000","last_peered":"2024-09-12T01:22:10.573973+0000","last_clean":"2024-09-12T01:22:10.573973+0000","last_became_active":"2024-09-12T00:35:43.933191+0000","last_became_peered":"2024-09-12T00:35:43.933191+0000","last_unstale":"2024-09-12T01:22:10.573973+0000","last_undegraded":"2024-09-12T01:22:10.573973+0000","last_fullsized":"2024-09-12T01:22:10.573973+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T01:22:10.573611+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T01:22:10.573611+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.573611+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:05.894738+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":549,"num_read_kb":44649,"num_write":1012,"num_write_kb":28437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'151","reported_seq":674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:38.865862+0000","last_change":"2024-09-12T01:22:38.865862+0000","last_active":"2024-09-12T01:22:38.865862+0000","last_peered":"2024-09-12T01:22:38.865862+0000","last_clean":"2024-09-12T01:22:38.865862+0000","last_became_active":"2024-09-12T00:35:53.981609+0000","last_became_peered":"2024-09-12T00:35:53.981609+0000","last_unstale":"2024-09-12T01:22:38.865862+0000","last_undegraded":"2024-09-12T01:22:38.865862+0000","last_fullsized":"2024-09-12T01:22:38.865862+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'151","last_scrub_stamp":"2024-09-12T01:22:38.865633+0000","last_deep_scrub":"265'151","last_deep_scrub_stamp":"2024-09-12T01:22:38.865633+0000","last_clean_scrub_stamp":"2024-09-12T01:22:38.865633+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:44.587924+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":187,"num_read_kb":176,"num_write":375,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'259","reported_seq":911,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.620747+0000","last_change":"2024-09-12T01:22:17.620618+0000","last_active":"2024-09-12T01:22:17.620747+0000","last_peered":"2024-09-12T01:22:17.620747+0000","last_clean":"2024-09-12T01:22:17.620747+0000","last_became_active":"2024-09-12T00:35:45.948575+0000","last_became_peered":"2024-09-12T00:35:45.948575+0000","last_unstale":"2024-09-12T01:22:17.620747+0000","last_undegraded":"2024-09-12T01:22:17.620747+0000","last_fullsized":"2024-09-12T01:22:17.620747+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'259","last_scrub_stamp":"2024-09-12T01:22:17.620446+0000","last_deep_scrub":"265'259","last_deep_scrub_stamp":"2024-09-12T01:22:17.620446+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.620446+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:30.407262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1199,"num_read_kb":1005,"num_write":430,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"265'290","reported_seq":896,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.507460+0000","last_change":"2024-09-12T01:22:12.507305+0000","last_active":"2024-09-12T01:22:12.507460+0000","last_peered":"2024-09-12T01:22:12.507460+0000","last_clean":"2024-09-12T01:22:12.507460+0000","last_became_active":"2024-09-12T00:35:43.956812+0000","last_became_peered":"2024-09-12T00:35:43.956812+0000","last_unstale":"2024-09-12T01:22:12.507460+0000","last_undegraded":"2024-09-12T01:22:12.507460+0000","last_fullsized":"2024-09-12T01:22:12.507460+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'290","last_scrub_stamp":"2024-09-12T01:22:12.507085+0000","last_deep_scrub":"265'290","last_deep_scrub_stamp":"2024-09-12T01:22:12.507085+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.507085+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:34.635767+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":413,"num_read_kb":399,"num_write":958,"num_write_kb":26614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:26.662866+0000","last_change":"2024-09-12T01:22:26.662866+0000","last_active":"2024-09-12T01:22:26.662866+0000","last_peered":"2024-09-12T01:22:26.662866+0000","last_clean":"2024-09-12T01:22:26.662866+0000","last_became_active":"2024-09-12T00:35:47.933249+0000","last_became_peered":"2024-09-12T00:35:47.933249+0000","last_unstale":"2024-09-12T01:22:26.662866+0000","last_undegraded":"2024-09-12T01:22:26.662866+0000","last_fullsized":"2024-09-12T01:22:26.662866+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:26.662691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:26.662691+0000","last_clean_scrub_stamp":"2024-09-12T01:22:26.662691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:33.845596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'344","reported_seq":960,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:26.488910+0000","last_change":"2024-09-12T01:22:26.488910+0000","last_active":"2024-09-12T01:22:26.488910+0000","last_peered":"2024-09-12T01:22:26.488910+0000","last_clean":"2024-09-12T01:22:26.488910+0000","last_became_active":"2024-09-12T00:35:49.951438+0000","last_became_peered":"2024-09-12T00:35:49.951438+0000","last_unstale":"2024-09-12T01:22:26.488910+0000","last_undegraded":"2024-09-12T01:22:26.488910+0000","last_fullsized":"2024-09-12T01:22:26.488910+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'344","last_scrub_stamp":"2024-09-12T01:22:26.488626+0000","last_deep_scrub":"265'344","last_deep_scrub_stamp":"2024-09-12T01:22:26.488626+0000","last_clean_scrub_stamp":"2024-09-12T01:22:26.488626+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:38.093876+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44615,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":554,"num_read_kb":1150,"num_write":438,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:35.418249+0000","last_change":"2024-09-12T01:22:35.418249+0000","last_active":"2024-09-12T01:22:35.418249+0000","last_peered":"2024-09-12T01:22:35.418249+0000","last_clean":"2024-09-12T01:22:35.418249+0000","last_became_active":"2024-09-12T00:35:51.984350+0000","last_became_peered":"2024-09-12T00:35:51.984350+0000","last_unstale":"2024-09-12T01:22:35.418249+0000","last_undegraded":"2024-09-12T01:22:35.418249+0000","last_fullsized":"2024-09-12T01:22:35.418249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:35.418076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:35.418076+0000","last_clean_scrub_stamp":"2024-09-12T01:22:35.418076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:53.339786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'206","reported_seq":813,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:39.554559+0000","last_change":"2024-09-12T01:22:39.554559+0000","last_active":"2024-09-12T01:22:39.554559+0000","last_peered":"2024-09-12T01:22:39.554559+0000","last_clean":"2024-09-12T01:22:39.554559+0000","last_became_active":"2024-09-12T00:35:53.995513+0000","last_became_peered":"2024-09-12T00:35:53.995513+0000","last_unstale":"2024-09-12T01:22:39.554559+0000","last_undegraded":"2024-09-12T01:22:39.554559+0000","last_fullsized":"2024-09-12T01:22:39.554559+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'206","last_scrub_stamp":"2024-09-12T01:22:39.554345+0000","last_deep_scrub":"265'206","last_deep_scrub_stamp":"2024-09-12T01:22:39.554345+0000","last_clean_scrub_stamp":"2024-09-12T01:22:39.554345+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:17.258884+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":409,"num_read_kb":360,"num_write":396,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'241","reported_seq":876,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.747102+0000","last_change":"2024-09-12T01:22:18.747102+0000","last_active":"2024-09-12T01:22:18.747102+0000","last_peered":"2024-09-12T01:22:18.747102+0000","last_clean":"2024-09-12T01:22:18.747102+0000","last_became_active":"2024-09-12T00:35:45.939962+0000","last_became_peered":"2024-09-12T00:35:45.939962+0000","last_unstale":"2024-09-12T01:22:18.747102+0000","last_undegraded":"2024-09-12T01:22:18.747102+0000","last_fullsized":"2024-09-12T01:22:18.747102+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'241","last_scrub_stamp":"2024-09-12T01:22:18.746925+0000","last_deep_scrub":"265'241","last_deep_scrub_stamp":"2024-09-12T01:22:18.746925+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.746925+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:11.880068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1036,"num_read_kb":844,"num_write":371,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'378","reported_seq":1091,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:02.751401+0000","last_change":"2024-09-12T01:22:02.751301+0000","last_active":"2024-09-12T01:22:02.751401+0000","last_peered":"2024-09-12T01:22:02.751401+0000","last_clean":"2024-09-12T01:22:02.751401+0000","last_became_active":"2024-09-12T00:35:43.944705+0000","last_became_peered":"2024-09-12T00:35:43.944705+0000","last_unstale":"2024-09-12T01:22:02.751401+0000","last_undegraded":"2024-09-12T01:22:02.751401+0000","last_fullsized":"2024-09-12T01:22:02.751401+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'378","last_scrub_stamp":"2024-09-12T01:22:02.751158+0000","last_deep_scrub":"265'378","last_deep_scrub_stamp":"2024-09-12T01:22:02.751158+0000","last_clean_scrub_stamp":"2024-09-12T01:22:02.751158+0000","objects_scrubbed":10,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:41.394968+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1344150,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":792,"num_read_kb":8209,"num_write":1184,"num_write_kb":28685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:26.485367+0000","last_change":"2024-09-12T01:22:26.485115+0000","last_active":"2024-09-12T01:22:26.485367+0000","last_peered":"2024-09-12T01:22:26.485367+0000","last_clean":"2024-09-12T01:22:26.485367+0000","last_became_active":"2024-09-12T00:35:47.945971+0000","last_became_peered":"2024-09-12T00:35:47.945971+0000","last_unstale":"2024-09-12T01:22:26.485367+0000","last_undegraded":"2024-09-12T01:22:26.485367+0000","last_fullsized":"2024-09-12T01:22:26.485367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:26.484886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:26.484886+0000","last_clean_scrub_stamp":"2024-09-12T01:22:26.484886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:48.584060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'97","reported_seq":637,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:30.939730+0000","last_change":"2024-09-12T01:22:30.939730+0000","last_active":"2024-09-12T01:22:30.939730+0000","last_peered":"2024-09-12T01:22:30.939730+0000","last_clean":"2024-09-12T01:22:30.939730+0000","last_became_active":"2024-09-12T00:35:49.938374+0000","last_became_peered":"2024-09-12T00:35:49.938374+0000","last_unstale":"2024-09-12T01:22:30.939730+0000","last_undegraded":"2024-09-12T01:22:30.939730+0000","last_fullsized":"2024-09-12T01:22:30.939730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'97","last_scrub_stamp":"2024-09-12T01:22:30.939542+0000","last_deep_scrub":"265'97","last_deep_scrub_stamp":"2024-09-12T01:22:30.939542+0000","last_clean_scrub_stamp":"2024-09-12T01:22:30.939542+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:36.378496+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:34.956608+0000","last_change":"2024-09-12T01:22:34.956608+0000","last_active":"2024-09-12T01:22:34.956608+0000","last_peered":"2024-09-12T01:22:34.956608+0000","last_clean":"2024-09-12T01:22:34.956608+0000","last_became_active":"2024-09-12T00:35:51.974659+0000","last_became_peered":"2024-09-12T00:35:51.974659+0000","last_unstale":"2024-09-12T01:22:34.956608+0000","last_undegraded":"2024-09-12T01:22:34.956608+0000","last_fullsized":"2024-09-12T01:22:34.956608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:34.956422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:34.956422+0000","last_clean_scrub_stamp":"2024-09-12T01:22:34.956422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:02.049351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'118","reported_seq":658,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:34.461707+0000","last_change":"2024-09-12T01:22:34.461563+0000","last_active":"2024-09-12T01:22:34.461707+0000","last_peered":"2024-09-12T01:22:34.461707+0000","last_clean":"2024-09-12T01:22:34.461707+0000","last_became_active":"2024-09-12T00:35:53.992311+0000","last_became_peered":"2024-09-12T00:35:53.992311+0000","last_unstale":"2024-09-12T01:22:34.461707+0000","last_undegraded":"2024-09-12T01:22:34.461707+0000","last_fullsized":"2024-09-12T01:22:34.461707+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'118","last_scrub_stamp":"2024-09-12T01:22:34.461375+0000","last_deep_scrub":"265'118","last_deep_scrub_stamp":"2024-09-12T01:22:34.461375+0000","last_clean_scrub_stamp":"2024-09-12T01:22:34.461375+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:20.457415+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":265,"num_read_kb":226,"num_write":268,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'268","reported_seq":921,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.573840+0000","last_change":"2024-09-12T01:22:15.573840+0000","last_active":"2024-09-12T01:22:15.573840+0000","last_peered":"2024-09-12T01:22:15.573840+0000","last_clean":"2024-09-12T01:22:15.573840+0000","last_became_active":"2024-09-12T00:35:45.941543+0000","last_became_peered":"2024-09-12T00:35:45.941543+0000","last_unstale":"2024-09-12T01:22:15.573840+0000","last_undegraded":"2024-09-12T01:22:15.573840+0000","last_fullsized":"2024-09-12T01:22:15.573840+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'268","last_scrub_stamp":"2024-09-12T01:22:15.573638+0000","last_deep_scrub":"265'268","last_deep_scrub_stamp":"2024-09-12T01:22:15.573638+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.573638+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:55.006640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1165,"num_read_kb":955,"num_write":416,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'393","reported_seq":1116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.480162+0000","last_change":"2024-09-12T01:22:11.480017+0000","last_active":"2024-09-12T01:22:11.480162+0000","last_peered":"2024-09-12T01:22:11.480162+0000","last_clean":"2024-09-12T01:22:11.480162+0000","last_became_active":"2024-09-12T00:35:43.952543+0000","last_became_peered":"2024-09-12T00:35:43.952543+0000","last_unstale":"2024-09-12T01:22:11.480162+0000","last_undegraded":"2024-09-12T01:22:11.480162+0000","last_fullsized":"2024-09-12T01:22:11.480162+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'393","last_scrub_stamp":"2024-09-12T01:22:11.479778+0000","last_deep_scrub":"265'393","last_deep_scrub_stamp":"2024-09-12T01:22:11.479778+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.479778+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:16.175100+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262200,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":772,"num_read_kb":780,"num_write":1221,"num_write_kb":19641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:27.520990+0000","last_change":"2024-09-12T01:22:27.520990+0000","last_active":"2024-09-12T01:22:27.520990+0000","last_peered":"2024-09-12T01:22:27.520990+0000","last_clean":"2024-09-12T01:22:27.520990+0000","last_became_active":"2024-09-12T00:35:47.933896+0000","last_became_peered":"2024-09-12T00:35:47.933896+0000","last_unstale":"2024-09-12T01:22:27.520990+0000","last_undegraded":"2024-09-12T01:22:27.520990+0000","last_fullsized":"2024-09-12T01:22:27.520990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:27.520810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:27.520810+0000","last_clean_scrub_stamp":"2024-09-12T01:22:27.520810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:28.480023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'120","reported_seq":671,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.374781+0000","last_change":"2024-09-12T01:22:18.374611+0000","last_active":"2024-09-12T01:22:18.374781+0000","last_peered":"2024-09-12T01:22:18.374781+0000","last_clean":"2024-09-12T01:22:18.374781+0000","last_became_active":"2024-09-12T00:35:49.936846+0000","last_became_peered":"2024-09-12T00:35:49.936846+0000","last_unstale":"2024-09-12T01:22:18.374781+0000","last_undegraded":"2024-09-12T01:22:18.374781+0000","last_fullsized":"2024-09-12T01:22:18.374781+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'120","last_scrub_stamp":"2024-09-12T01:22:18.374419+0000","last_deep_scrub":"265'120","last_deep_scrub_stamp":"2024-09-12T01:22:18.374419+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.374419+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:24.935816+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":139,"num_read_kb":131,"num_write":92,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'774","reported_seq":2297,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:34.414268+0000","last_change":"2024-09-12T01:22:34.414268+0000","last_active":"2024-09-12T01:22:34.414268+0000","last_peered":"2024-09-12T01:22:34.414268+0000","last_clean":"2024-09-12T01:22:34.414268+0000","last_became_active":"2024-09-12T00:35:51.979288+0000","last_became_peered":"2024-09-12T00:35:51.979288+0000","last_unstale":"2024-09-12T01:22:34.414268+0000","last_undegraded":"2024-09-12T01:22:34.414268+0000","last_fullsized":"2024-09-12T01:22:34.414268+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'774","last_scrub_stamp":"2024-09-12T01:22:34.414083+0000","last_deep_scrub":"265'774","last_deep_scrub_stamp":"2024-09-12T01:22:34.414083+0000","last_clean_scrub_stamp":"2024-09-12T01:22:34.414083+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:12.647174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'192","reported_seq":1024,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:39.899169+0000","last_change":"2024-09-12T01:22:39.899169+0000","last_active":"2024-09-12T01:22:39.899169+0000","last_peered":"2024-09-12T01:22:39.899169+0000","last_clean":"2024-09-12T01:22:39.899169+0000","last_became_active":"2024-09-12T00:35:54.013299+0000","last_became_peered":"2024-09-12T00:35:54.013299+0000","last_unstale":"2024-09-12T01:22:39.899169+0000","last_undegraded":"2024-09-12T01:22:39.899169+0000","last_fullsized":"2024-09-12T01:22:39.899169+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'192","last_scrub_stamp":"2024-09-12T01:22:39.898987+0000","last_deep_scrub":"265'192","last_deep_scrub_stamp":"2024-09-12T01:22:39.898987+0000","last_clean_scrub_stamp":"2024-09-12T01:22:39.898987+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:19.052550+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":837,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":580,"num_read_kb":578,"num_write":407,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'105","reported_seq":685,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.602937+0000","last_change":"2024-09-12T01:22:19.602937+0000","last_active":"2024-09-12T01:22:19.602937+0000","last_peered":"2024-09-12T01:22:19.602937+0000","last_clean":"2024-09-12T01:22:19.602937+0000","last_became_active":"2024-09-12T00:35:45.954858+0000","last_became_peered":"2024-09-12T00:35:45.954858+0000","last_unstale":"2024-09-12T01:22:19.602937+0000","last_undegraded":"2024-09-12T01:22:19.602937+0000","last_fullsized":"2024-09-12T01:22:19.602937+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'105","last_scrub_stamp":"2024-09-12T01:22:19.602704+0000","last_deep_scrub":"265'105","last_deep_scrub_stamp":"2024-09-12T01:22:19.602704+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.602704+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:45.698367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":470,"num_read_kb":391,"num_write":166,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'358","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.148076+0000","last_change":"2024-09-12T01:22:06.147932+0000","last_active":"2024-09-12T01:22:06.148076+0000","last_peered":"2024-09-12T01:22:06.148076+0000","last_clean":"2024-09-12T01:22:06.148076+0000","last_became_active":"2024-09-12T00:35:43.930867+0000","last_became_peered":"2024-09-12T00:35:43.930867+0000","last_unstale":"2024-09-12T01:22:06.148076+0000","last_undegraded":"2024-09-12T01:22:06.148076+0000","last_fullsized":"2024-09-12T01:22:06.148076+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T01:22:06.147754+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T01:22:06.147754+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.147754+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:37.175214+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291487,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":529,"num_read_kb":73816,"num_write":1070,"num_write_kb":41341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:27.679002+0000","last_change":"2024-09-12T01:22:27.679002+0000","last_active":"2024-09-12T01:22:27.679002+0000","last_peered":"2024-09-12T01:22:27.679002+0000","last_clean":"2024-09-12T01:22:27.679002+0000","last_became_active":"2024-09-12T00:35:47.930883+0000","last_became_peered":"2024-09-12T00:35:47.930883+0000","last_unstale":"2024-09-12T01:22:27.679002+0000","last_undegraded":"2024-09-12T01:22:27.679002+0000","last_fullsized":"2024-09-12T01:22:27.679002+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:27.678814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:27.678814+0000","last_clean_scrub_stamp":"2024-09-12T01:22:27.678814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:33.971827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'294","reported_seq":874,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:32.456344+0000","last_change":"2024-09-12T01:22:32.456344+0000","last_active":"2024-09-12T01:22:32.456344+0000","last_peered":"2024-09-12T01:22:32.456344+0000","last_clean":"2024-09-12T01:22:32.456344+0000","last_became_active":"2024-09-12T00:35:50.029236+0000","last_became_peered":"2024-09-12T00:35:50.029236+0000","last_unstale":"2024-09-12T01:22:32.456344+0000","last_undegraded":"2024-09-12T01:22:32.456344+0000","last_fullsized":"2024-09-12T01:22:32.456344+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'294","last_scrub_stamp":"2024-09-12T01:22:32.456135+0000","last_deep_scrub":"265'294","last_deep_scrub_stamp":"2024-09-12T01:22:32.456135+0000","last_clean_scrub_stamp":"2024-09-12T01:22:32.456135+0000","objects_scrubbed":5,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:06.127377+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54671,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":1128,"num_write":386,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'787","reported_seq":2341,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:39.692783+0000","last_change":"2024-09-12T01:22:39.692615+0000","last_active":"2024-09-12T01:22:39.692783+0000","last_peered":"2024-09-12T01:22:39.692783+0000","last_clean":"2024-09-12T01:22:39.692783+0000","last_became_active":"2024-09-12T00:35:51.983271+0000","last_became_peered":"2024-09-12T00:35:51.983271+0000","last_unstale":"2024-09-12T01:22:39.692783+0000","last_undegraded":"2024-09-12T01:22:39.692783+0000","last_fullsized":"2024-09-12T01:22:39.692783+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'787","last_scrub_stamp":"2024-09-12T01:22:39.692436+0000","last_deep_scrub":"265'787","last_deep_scrub_stamp":"2024-09-12T01:22:39.692436+0000","last_clean_scrub_stamp":"2024-09-12T01:22:39.692436+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:11.098708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'260","reported_seq":940,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.783023+0000","last_change":"2024-09-12T01:22:17.783023+0000","last_active":"2024-09-12T01:22:17.783023+0000","last_peered":"2024-09-12T01:22:17.783023+0000","last_clean":"2024-09-12T01:22:17.783023+0000","last_became_active":"2024-09-12T00:35:45.940073+0000","last_became_peered":"2024-09-12T00:35:45.940073+0000","last_unstale":"2024-09-12T01:22:17.783023+0000","last_undegraded":"2024-09-12T01:22:17.783023+0000","last_fullsized":"2024-09-12T01:22:17.783023+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'260","last_scrub_stamp":"2024-09-12T01:22:17.782804+0000","last_deep_scrub":"265'260","last_deep_scrub_stamp":"2024-09-12T01:22:17.782804+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.782804+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:47.983931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1192,"num_read_kb":982,"num_write":401,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'356","reported_seq":1074,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.438890+0000","last_change":"2024-09-12T01:22:09.438750+0000","last_active":"2024-09-12T01:22:09.438890+0000","last_peered":"2024-09-12T01:22:09.438890+0000","last_clean":"2024-09-12T01:22:09.438890+0000","last_became_active":"2024-09-12T00:35:43.956814+0000","last_became_peered":"2024-09-12T00:35:43.956814+0000","last_unstale":"2024-09-12T01:22:09.438890+0000","last_undegraded":"2024-09-12T01:22:09.438890+0000","last_fullsized":"2024-09-12T01:22:09.438890+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T01:22:09.438513+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T01:22:09.438513+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.438513+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:18.913267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":767,"num_read_kb":6356,"num_write":996,"num_write_kb":17273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:23.361207+0000","last_change":"2024-09-12T01:22:23.361207+0000","last_active":"2024-09-12T01:22:23.361207+0000","last_peered":"2024-09-12T01:22:23.361207+0000","last_clean":"2024-09-12T01:22:23.361207+0000","last_became_active":"2024-09-12T00:35:47.944913+0000","last_became_peered":"2024-09-12T00:35:47.944913+0000","last_unstale":"2024-09-12T01:22:23.361207+0000","last_undegraded":"2024-09-12T01:22:23.361207+0000","last_fullsized":"2024-09-12T01:22:23.361207+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:23.360974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:23.360974+0000","last_clean_scrub_stamp":"2024-09-12T01:22:23.360974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:40.017227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'358","reported_seq":981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:30.677483+0000","last_change":"2024-09-12T01:22:30.677483+0000","last_active":"2024-09-12T01:22:30.677483+0000","last_peered":"2024-09-12T01:22:30.677483+0000","last_clean":"2024-09-12T01:22:30.677483+0000","last_became_active":"2024-09-12T00:35:50.027282+0000","last_became_peered":"2024-09-12T00:35:50.027282+0000","last_unstale":"2024-09-12T01:22:30.677483+0000","last_undegraded":"2024-09-12T01:22:30.677483+0000","last_fullsized":"2024-09-12T01:22:30.677483+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T01:22:30.677282+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T01:22:30.677282+0000","last_clean_scrub_stamp":"2024-09-12T01:22:30.677282+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:10.624962+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45216,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":563,"num_read_kb":1133,"num_write":440,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:26.211375+0000","last_change":"2024-09-12T01:22:26.211253+0000","last_active":"2024-09-12T01:22:26.211375+0000","last_peered":"2024-09-12T01:22:26.211375+0000","last_clean":"2024-09-12T01:22:26.211375+0000","last_became_active":"2024-09-12T00:35:51.971491+0000","last_became_peered":"2024-09-12T00:35:51.971491+0000","last_unstale":"2024-09-12T01:22:26.211375+0000","last_undegraded":"2024-09-12T01:22:26.211375+0000","last_fullsized":"2024-09-12T01:22:26.211375+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:26.211085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:26.211085+0000","last_clean_scrub_stamp":"2024-09-12T01:22:26.211085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:51.214576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'559","reported_seq":1382,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:35.568496+0000","last_change":"2024-09-12T01:22:35.568496+0000","last_active":"2024-09-12T01:22:35.568496+0000","last_peered":"2024-09-12T01:22:35.568496+0000","last_clean":"2024-09-12T01:22:35.568496+0000","last_became_active":"2024-09-12T00:35:53.996514+0000","last_became_peered":"2024-09-12T00:35:53.996514+0000","last_unstale":"2024-09-12T01:22:35.568496+0000","last_undegraded":"2024-09-12T01:22:35.568496+0000","last_fullsized":"2024-09-12T01:22:35.568496+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'559","last_scrub_stamp":"2024-09-12T01:22:35.568268+0000","last_deep_scrub":"265'559","last_deep_scrub_stamp":"2024-09-12T01:22:35.568268+0000","last_clean_scrub_stamp":"2024-09-12T01:22:35.568268+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:59.901744+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1307,"num_read_kb":1296,"num_write":1166,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'136","reported_seq":748,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.018297+0000","last_change":"2024-09-12T01:22:10.018297+0000","last_active":"2024-09-12T01:22:10.018297+0000","last_peered":"2024-09-12T01:22:10.018297+0000","last_clean":"2024-09-12T01:22:10.018297+0000","last_became_active":"2024-09-12T00:35:45.943083+0000","last_became_peered":"2024-09-12T00:35:45.943083+0000","last_unstale":"2024-09-12T01:22:10.018297+0000","last_undegraded":"2024-09-12T01:22:10.018297+0000","last_fullsized":"2024-09-12T01:22:10.018297+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'136","last_scrub_stamp":"2024-09-12T01:22:10.018112+0000","last_deep_scrub":"265'136","last_deep_scrub_stamp":"2024-09-12T01:22:10.018112+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.018112+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:19.240513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":650,"num_read_kb":541,"num_write":222,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'345","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.455683+0000","last_change":"2024-09-12T01:22:08.455546+0000","last_active":"2024-09-12T01:22:08.455683+0000","last_peered":"2024-09-12T01:22:08.455683+0000","last_clean":"2024-09-12T01:22:08.455683+0000","last_became_active":"2024-09-12T00:35:43.953664+0000","last_became_peered":"2024-09-12T00:35:43.953664+0000","last_unstale":"2024-09-12T01:22:08.455683+0000","last_undegraded":"2024-09-12T01:22:08.455683+0000","last_fullsized":"2024-09-12T01:22:08.455683+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'345","last_scrub_stamp":"2024-09-12T01:22:08.455336+0000","last_deep_scrub":"265'345","last_deep_scrub_stamp":"2024-09-12T01:22:08.455336+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.455336+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:59.956866+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288989,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":479,"num_read_kb":49556,"num_write":1051,"num_write_kb":45556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.362512+0000","last_change":"2024-09-12T01:22:16.362512+0000","last_active":"2024-09-12T01:22:16.362512+0000","last_peered":"2024-09-12T01:22:16.362512+0000","last_clean":"2024-09-12T01:22:16.362512+0000","last_became_active":"2024-09-12T00:35:47.936972+0000","last_became_peered":"2024-09-12T00:35:47.936972+0000","last_unstale":"2024-09-12T01:22:16.362512+0000","last_undegraded":"2024-09-12T01:22:16.362512+0000","last_fullsized":"2024-09-12T01:22:16.362512+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:16.362319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:16.362319+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.362319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:40.167192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'271","reported_seq":852,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:29.582178+0000","last_change":"2024-09-12T01:22:29.582048+0000","last_active":"2024-09-12T01:22:29.582178+0000","last_peered":"2024-09-12T01:22:29.582178+0000","last_clean":"2024-09-12T01:22:29.582178+0000","last_became_active":"2024-09-12T00:35:49.954568+0000","last_became_peered":"2024-09-12T00:35:49.954568+0000","last_unstale":"2024-09-12T01:22:29.582178+0000","last_undegraded":"2024-09-12T01:22:29.582178+0000","last_fullsized":"2024-09-12T01:22:29.582178+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'271","last_scrub_stamp":"2024-09-12T01:22:29.581862+0000","last_deep_scrub":"265'271","last_deep_scrub_stamp":"2024-09-12T01:22:29.581862+0000","last_clean_scrub_stamp":"2024-09-12T01:22:29.581862+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:38.518669+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45999,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":441,"num_read_kb":1004,"num_write":356,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:36.620871+0000","last_change":"2024-09-12T01:22:36.620871+0000","last_active":"2024-09-12T01:22:36.620871+0000","last_peered":"2024-09-12T01:22:36.620871+0000","last_clean":"2024-09-12T01:22:36.620871+0000","last_became_active":"2024-09-12T00:35:51.981326+0000","last_became_peered":"2024-09-12T00:35:51.981326+0000","last_unstale":"2024-09-12T01:22:36.620871+0000","last_undegraded":"2024-09-12T01:22:36.620871+0000","last_fullsized":"2024-09-12T01:22:36.620871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:36.620663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:36.620663+0000","last_clean_scrub_stamp":"2024-09-12T01:22:36.620663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:23.602336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'2396","reported_seq":4238,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:27.139385+0000","last_change":"2024-09-12T01:22:27.139385+0000","last_active":"2024-09-12T01:22:27.139385+0000","last_peered":"2024-09-12T01:22:27.139385+0000","last_clean":"2024-09-12T01:22:27.139385+0000","last_became_active":"2024-09-12T00:35:53.975054+0000","last_became_peered":"2024-09-12T00:35:53.975054+0000","last_unstale":"2024-09-12T01:22:27.139385+0000","last_undegraded":"2024-09-12T01:22:27.139385+0000","last_fullsized":"2024-09-12T01:22:27.139385+0000","mapping_epoch":34,"log_start":"265'2300","ondisk_log_start":"265'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2396","last_scrub_stamp":"2024-09-12T01:22:27.139196+0000","last_deep_scrub":"265'2396","last_deep_scrub_stamp":"2024-09-12T01:22:27.139196+0000","last_clean_scrub_stamp":"2024-09-12T01:22:27.139196+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":2300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:34.088010+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6031,"num_read_kb":6023,"num_write":4852,"num_write_kb":1786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'134","reported_seq":758,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.095091+0000","last_change":"2024-09-12T01:22:20.095091+0000","last_active":"2024-09-12T01:22:20.095091+0000","last_peered":"2024-09-12T01:22:20.095091+0000","last_clean":"2024-09-12T01:22:20.095091+0000","last_became_active":"2024-09-12T00:35:45.953664+0000","last_became_peered":"2024-09-12T00:35:45.953664+0000","last_unstale":"2024-09-12T01:22:20.095091+0000","last_undegraded":"2024-09-12T01:22:20.095091+0000","last_fullsized":"2024-09-12T01:22:20.095091+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'134","last_scrub_stamp":"2024-09-12T01:22:20.094911+0000","last_deep_scrub":"265'134","last_deep_scrub_stamp":"2024-09-12T01:22:20.094911+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.094911+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:20.389870+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":607,"num_read_kb":511,"num_write":198,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'330","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.447041+0000","last_change":"2024-09-12T01:22:10.446889+0000","last_active":"2024-09-12T01:22:10.447041+0000","last_peered":"2024-09-12T01:22:10.447041+0000","last_clean":"2024-09-12T01:22:10.447041+0000","last_became_active":"2024-09-12T00:35:43.942454+0000","last_became_peered":"2024-09-12T00:35:43.942454+0000","last_unstale":"2024-09-12T01:22:10.447041+0000","last_undegraded":"2024-09-12T01:22:10.447041+0000","last_fullsized":"2024-09-12T01:22:10.447041+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'330","last_scrub_stamp":"2024-09-12T01:22:10.446675+0000","last_deep_scrub":"265'330","last_deep_scrub_stamp":"2024-09-12T01:22:10.446675+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.446675+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:23.036504+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":618,"num_read_kb":3434,"num_write":1027,"num_write_kb":23754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.383130+0000","last_change":"2024-09-12T01:22:13.382878+0000","last_active":"2024-09-12T01:22:13.383130+0000","last_peered":"2024-09-12T01:22:13.383130+0000","last_clean":"2024-09-12T01:22:13.383130+0000","last_became_active":"2024-09-12T00:35:47.942189+0000","last_became_peered":"2024-09-12T00:35:47.942189+0000","last_unstale":"2024-09-12T01:22:13.383130+0000","last_undegraded":"2024-09-12T01:22:13.383130+0000","last_fullsized":"2024-09-12T01:22:13.383130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:13.382636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:13.382636+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.382636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:49.972499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'327","reported_seq":930,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:28.329109+0000","last_change":"2024-09-12T01:22:28.329109+0000","last_active":"2024-09-12T01:22:28.329109+0000","last_peered":"2024-09-12T01:22:28.329109+0000","last_clean":"2024-09-12T01:22:28.329109+0000","last_became_active":"2024-09-12T00:35:49.942480+0000","last_became_peered":"2024-09-12T00:35:49.942480+0000","last_unstale":"2024-09-12T01:22:28.329109+0000","last_undegraded":"2024-09-12T01:22:28.329109+0000","last_fullsized":"2024-09-12T01:22:28.329109+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'327","last_scrub_stamp":"2024-09-12T01:22:28.328925+0000","last_deep_scrub":"265'327","last_deep_scrub_stamp":"2024-09-12T01:22:28.328925+0000","last_clean_scrub_stamp":"2024-09-12T01:22:28.328925+0000","objects_scrubbed":9,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:14.895378+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48782,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":529,"num_read_kb":1149,"num_write":428,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'773","reported_seq":2446,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:30.491240+0000","last_change":"2024-09-12T01:22:30.491240+0000","last_active":"2024-09-12T01:22:30.491240+0000","last_peered":"2024-09-12T01:22:30.491240+0000","last_clean":"2024-09-12T01:22:30.491240+0000","last_became_active":"2024-09-12T00:35:51.984968+0000","last_became_peered":"2024-09-12T00:35:51.984968+0000","last_unstale":"2024-09-12T01:22:30.491240+0000","last_undegraded":"2024-09-12T01:22:30.491240+0000","last_fullsized":"2024-09-12T01:22:30.491240+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'773","last_scrub_stamp":"2024-09-12T01:22:30.491048+0000","last_deep_scrub":"265'773","last_deep_scrub_stamp":"2024-09-12T01:22:30.491048+0000","last_clean_scrub_stamp":"2024-09-12T01:22:30.491048+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:09.682841+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'109","reported_seq":608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:37.466320+0000","last_change":"2024-09-12T01:22:37.466320+0000","last_active":"2024-09-12T01:22:37.466320+0000","last_peered":"2024-09-12T01:22:37.466320+0000","last_clean":"2024-09-12T01:22:37.466320+0000","last_became_active":"2024-09-12T00:35:53.992664+0000","last_became_peered":"2024-09-12T00:35:53.992664+0000","last_unstale":"2024-09-12T01:22:37.466320+0000","last_undegraded":"2024-09-12T01:22:37.466320+0000","last_fullsized":"2024-09-12T01:22:37.466320+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'109","last_scrub_stamp":"2024-09-12T01:22:37.466134+0000","last_deep_scrub":"265'109","last_deep_scrub_stamp":"2024-09-12T01:22:37.466134+0000","last_clean_scrub_stamp":"2024-09-12T01:22:37.466134+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:02.774735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":110,"num_write":262,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'190","reported_seq":806,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.525199+0000","last_change":"2024-09-12T01:22:14.525068+0000","last_active":"2024-09-12T01:22:14.525199+0000","last_peered":"2024-09-12T01:22:14.525199+0000","last_clean":"2024-09-12T01:22:14.525199+0000","last_became_active":"2024-09-12T00:35:45.939817+0000","last_became_peered":"2024-09-12T00:35:45.939817+0000","last_unstale":"2024-09-12T01:22:14.525199+0000","last_undegraded":"2024-09-12T01:22:14.525199+0000","last_fullsized":"2024-09-12T01:22:14.525199+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'190","last_scrub_stamp":"2024-09-12T01:22:14.524892+0000","last_deep_scrub":"265'190","last_deep_scrub_stamp":"2024-09-12T01:22:14.524892+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.524892+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:07.182122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":809,"num_read_kb":663,"num_write":268,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'374","reported_seq":1037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.814407+0000","last_change":"2024-09-12T01:22:07.814217+0000","last_active":"2024-09-12T01:22:07.814407+0000","last_peered":"2024-09-12T01:22:07.814407+0000","last_clean":"2024-09-12T01:22:07.814407+0000","last_became_active":"2024-09-12T00:35:43.912282+0000","last_became_peered":"2024-09-12T00:35:43.912282+0000","last_unstale":"2024-09-12T01:22:07.814407+0000","last_undegraded":"2024-09-12T01:22:07.814407+0000","last_fullsized":"2024-09-12T01:22:07.814407+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T01:22:07.813838+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T01:22:07.813838+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.813838+0000","objects_scrubbed":15,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:43.752646+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6327796,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":526,"num_read_kb":19021,"num_write":1167,"num_write_kb":32789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.373561+0000","last_change":"2024-09-12T01:22:14.373561+0000","last_active":"2024-09-12T01:22:14.373561+0000","last_peered":"2024-09-12T01:22:14.373561+0000","last_clean":"2024-09-12T01:22:14.373561+0000","last_became_active":"2024-09-12T00:35:47.946636+0000","last_became_peered":"2024-09-12T00:35:47.946636+0000","last_unstale":"2024-09-12T01:22:14.373561+0000","last_undegraded":"2024-09-12T01:22:14.373561+0000","last_fullsized":"2024-09-12T01:22:14.373561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:14.373377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:14.373377+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.373377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:28.908478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'514","reported_seq":1159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:25.513379+0000","last_change":"2024-09-12T01:22:25.513379+0000","last_active":"2024-09-12T01:22:25.513379+0000","last_peered":"2024-09-12T01:22:25.513379+0000","last_clean":"2024-09-12T01:22:25.513379+0000","last_became_active":"2024-09-12T00:35:49.950845+0000","last_became_peered":"2024-09-12T00:35:49.950845+0000","last_unstale":"2024-09-12T01:22:25.513379+0000","last_undegraded":"2024-09-12T01:22:25.513379+0000","last_fullsized":"2024-09-12T01:22:25.513379+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'514","last_scrub_stamp":"2024-09-12T01:22:25.513159+0000","last_deep_scrub":"265'514","last_deep_scrub_stamp":"2024-09-12T01:22:25.513159+0000","last_clean_scrub_stamp":"2024-09-12T01:22:25.513159+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:09.891812+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100676,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":870,"num_read_kb":2075,"num_write":716,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.408954+0000","last_change":"2024-09-12T01:22:19.408954+0000","last_active":"2024-09-12T01:22:19.408954+0000","last_peered":"2024-09-12T01:22:19.408954+0000","last_clean":"2024-09-12T01:22:19.408954+0000","last_became_active":"2024-09-12T00:35:51.978188+0000","last_became_peered":"2024-09-12T00:35:51.978188+0000","last_unstale":"2024-09-12T01:22:19.408954+0000","last_undegraded":"2024-09-12T01:22:19.408954+0000","last_fullsized":"2024-09-12T01:22:19.408954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:19.408763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:19.408763+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.408763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:33.873801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'135","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:28.249753+0000","last_change":"2024-09-12T01:22:28.249753+0000","last_active":"2024-09-12T01:22:28.249753+0000","last_peered":"2024-09-12T01:22:28.249753+0000","last_clean":"2024-09-12T01:22:28.249753+0000","last_became_active":"2024-09-12T00:35:53.985635+0000","last_became_peered":"2024-09-12T00:35:53.985635+0000","last_unstale":"2024-09-12T01:22:28.249753+0000","last_undegraded":"2024-09-12T01:22:28.249753+0000","last_fullsized":"2024-09-12T01:22:28.249753+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'135","last_scrub_stamp":"2024-09-12T01:22:28.249558+0000","last_deep_scrub":"265'135","last_deep_scrub_stamp":"2024-09-12T01:22:28.249558+0000","last_clean_scrub_stamp":"2024-09-12T01:22:28.249558+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:56.700780+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":203,"num_read_kb":181,"num_write":311,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'153","reported_seq":757,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.992581+0000","last_change":"2024-09-12T01:22:10.992417+0000","last_active":"2024-09-12T01:22:10.992581+0000","last_peered":"2024-09-12T01:22:10.992581+0000","last_clean":"2024-09-12T01:22:10.992581+0000","last_became_active":"2024-09-12T00:35:45.938135+0000","last_became_peered":"2024-09-12T00:35:45.938135+0000","last_unstale":"2024-09-12T01:22:10.992581+0000","last_undegraded":"2024-09-12T01:22:10.992581+0000","last_fullsized":"2024-09-12T01:22:10.992581+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'153","last_scrub_stamp":"2024-09-12T01:22:10.992236+0000","last_deep_scrub":"265'153","last_deep_scrub_stamp":"2024-09-12T01:22:10.992236+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.992236+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:32.291897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":684,"num_read_kb":556,"num_write":242,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'387","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.627437+0000","last_change":"2024-09-12T01:22:05.627241+0000","last_active":"2024-09-12T01:22:05.627437+0000","last_peered":"2024-09-12T01:22:05.627437+0000","last_clean":"2024-09-12T01:22:05.627437+0000","last_became_active":"2024-09-12T00:35:43.936713+0000","last_became_peered":"2024-09-12T00:35:43.936713+0000","last_unstale":"2024-09-12T01:22:05.627437+0000","last_undegraded":"2024-09-12T01:22:05.627437+0000","last_fullsized":"2024-09-12T01:22:05.627437+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'387","last_scrub_stamp":"2024-09-12T01:22:05.626966+0000","last_deep_scrub":"265'387","last_deep_scrub_stamp":"2024-09-12T01:22:05.626966+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.626966+0000","objects_scrubbed":8,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:33.798620+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730170,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":551,"num_read_kb":26422,"num_write":1213,"num_write_kb":29680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.334320+0000","last_change":"2024-09-12T01:22:15.334177+0000","last_active":"2024-09-12T01:22:15.334320+0000","last_peered":"2024-09-12T01:22:15.334320+0000","last_clean":"2024-09-12T01:22:15.334320+0000","last_became_active":"2024-09-12T00:35:47.938604+0000","last_became_peered":"2024-09-12T00:35:47.938604+0000","last_unstale":"2024-09-12T01:22:15.334320+0000","last_undegraded":"2024-09-12T01:22:15.334320+0000","last_fullsized":"2024-09-12T01:22:15.334320+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:15.333992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:15.333992+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.333992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:44.787901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'314","reported_seq":906,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:28.929398+0000","last_change":"2024-09-12T01:22:28.929248+0000","last_active":"2024-09-12T01:22:28.929398+0000","last_peered":"2024-09-12T01:22:28.929398+0000","last_clean":"2024-09-12T01:22:28.929398+0000","last_became_active":"2024-09-12T00:35:49.940679+0000","last_became_peered":"2024-09-12T00:35:49.940679+0000","last_unstale":"2024-09-12T01:22:28.929398+0000","last_undegraded":"2024-09-12T01:22:28.929398+0000","last_fullsized":"2024-09-12T01:22:28.929398+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'314","last_scrub_stamp":"2024-09-12T01:22:28.929055+0000","last_deep_scrub":"265'314","last_deep_scrub_stamp":"2024-09-12T01:22:28.929055+0000","last_clean_scrub_stamp":"2024-09-12T01:22:28.929055+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:39.328379+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52849,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":502,"num_read_kb":1074,"num_write":450,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:35.488735+0000","last_change":"2024-09-12T01:22:35.488571+0000","last_active":"2024-09-12T01:22:35.488735+0000","last_peered":"2024-09-12T01:22:35.488735+0000","last_clean":"2024-09-12T01:22:35.488735+0000","last_became_active":"2024-09-12T00:35:51.977807+0000","last_became_peered":"2024-09-12T00:35:51.977807+0000","last_unstale":"2024-09-12T01:22:35.488735+0000","last_undegraded":"2024-09-12T01:22:35.488735+0000","last_fullsized":"2024-09-12T01:22:35.488735+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:35.488385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:35.488385+0000","last_clean_scrub_stamp":"2024-09-12T01:22:35.488385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:18.337507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'103","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:40.706935+0000","last_change":"2024-09-12T01:22:40.706935+0000","last_active":"2024-09-12T01:22:40.706935+0000","last_peered":"2024-09-12T01:22:40.706935+0000","last_clean":"2024-09-12T01:22:40.706935+0000","last_became_active":"2024-09-12T00:35:54.003115+0000","last_became_peered":"2024-09-12T00:35:54.003115+0000","last_unstale":"2024-09-12T01:22:40.706935+0000","last_undegraded":"2024-09-12T01:22:40.706935+0000","last_fullsized":"2024-09-12T01:22:40.706935+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'103","last_scrub_stamp":"2024-09-12T01:22:40.706706+0000","last_deep_scrub":"265'103","last_deep_scrub_stamp":"2024-09-12T01:22:40.706706+0000","last_clean_scrub_stamp":"2024-09-12T01:22:40.706706+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:58.838187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":131,"num_write":237,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'498","reported_seq":1290,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.028238+0000","last_change":"2024-09-12T01:22:12.027976+0000","last_active":"2024-09-12T01:22:12.028238+0000","last_peered":"2024-09-12T01:22:12.028238+0000","last_clean":"2024-09-12T01:22:12.028238+0000","last_became_active":"2024-09-12T00:35:45.929526+0000","last_became_peered":"2024-09-12T00:35:45.929526+0000","last_unstale":"2024-09-12T01:22:12.028238+0000","last_undegraded":"2024-09-12T01:22:12.028238+0000","last_fullsized":"2024-09-12T01:22:12.028238+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'498","last_scrub_stamp":"2024-09-12T01:22:12.027707+0000","last_deep_scrub":"265'498","last_deep_scrub_stamp":"2024-09-12T01:22:12.027707+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.027707+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:44.755420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2425,"num_read_kb":2075,"num_write":878,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'279","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.151970+0000","last_change":"2024-09-12T01:22:07.151970+0000","last_active":"2024-09-12T01:22:07.151970+0000","last_peered":"2024-09-12T01:22:07.151970+0000","last_clean":"2024-09-12T01:22:07.151970+0000","last_became_active":"2024-09-12T00:35:43.944483+0000","last_became_peered":"2024-09-12T00:35:43.944483+0000","last_unstale":"2024-09-12T01:22:07.151970+0000","last_undegraded":"2024-09-12T01:22:07.151970+0000","last_fullsized":"2024-09-12T01:22:07.151970+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'279","last_scrub_stamp":"2024-09-12T01:22:07.151758+0000","last_deep_scrub":"265'279","last_deep_scrub_stamp":"2024-09-12T01:22:07.151758+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.151758+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:49.773260+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":355,"num_read_kb":347,"num_write":887,"num_write_kb":15629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.223498+0000","last_change":"2024-09-12T01:22:20.223262+0000","last_active":"2024-09-12T01:22:20.223498+0000","last_peered":"2024-09-12T01:22:20.223498+0000","last_clean":"2024-09-12T01:22:20.223498+0000","last_became_active":"2024-09-12T00:35:47.943382+0000","last_became_peered":"2024-09-12T00:35:47.943382+0000","last_unstale":"2024-09-12T01:22:20.223498+0000","last_undegraded":"2024-09-12T01:22:20.223498+0000","last_fullsized":"2024-09-12T01:22:20.223498+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:20.223057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:20.223057+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.223057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:18.669022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'325","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:23.351440+0000","last_change":"2024-09-12T01:22:23.351291+0000","last_active":"2024-09-12T01:22:23.351440+0000","last_peered":"2024-09-12T01:22:23.351440+0000","last_clean":"2024-09-12T01:22:23.351440+0000","last_became_active":"2024-09-12T00:35:49.949283+0000","last_became_peered":"2024-09-12T00:35:49.949283+0000","last_unstale":"2024-09-12T01:22:23.351440+0000","last_undegraded":"2024-09-12T01:22:23.351440+0000","last_fullsized":"2024-09-12T01:22:23.351440+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'325","last_scrub_stamp":"2024-09-12T01:22:23.351105+0000","last_deep_scrub":"265'325","last_deep_scrub_stamp":"2024-09-12T01:22:23.351105+0000","last_clean_scrub_stamp":"2024-09-12T01:22:23.351105+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:06.372682+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52286,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":532,"num_read_kb":1204,"num_write":436,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'725","reported_seq":2265,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.400555+0000","last_change":"2024-09-12T01:22:20.400295+0000","last_active":"2024-09-12T01:22:20.400555+0000","last_peered":"2024-09-12T01:22:20.400555+0000","last_clean":"2024-09-12T01:22:20.400555+0000","last_became_active":"2024-09-12T00:35:51.979162+0000","last_became_peered":"2024-09-12T00:35:51.979162+0000","last_unstale":"2024-09-12T01:22:20.400555+0000","last_undegraded":"2024-09-12T01:22:20.400555+0000","last_fullsized":"2024-09-12T01:22:20.400555+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'725","last_scrub_stamp":"2024-09-12T01:22:20.400017+0000","last_deep_scrub":"265'725","last_deep_scrub_stamp":"2024-09-12T01:22:20.400017+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.400017+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:36.962961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'118","reported_seq":614,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:30.283677+0000","last_change":"2024-09-12T01:22:30.283677+0000","last_active":"2024-09-12T01:22:30.283677+0000","last_peered":"2024-09-12T01:22:30.283677+0000","last_clean":"2024-09-12T01:22:30.283677+0000","last_became_active":"2024-09-12T00:35:53.981735+0000","last_became_peered":"2024-09-12T00:35:53.981735+0000","last_unstale":"2024-09-12T01:22:30.283677+0000","last_undegraded":"2024-09-12T01:22:30.283677+0000","last_fullsized":"2024-09-12T01:22:30.283677+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'118","last_scrub_stamp":"2024-09-12T01:22:30.283443+0000","last_deep_scrub":"265'118","last_deep_scrub_stamp":"2024-09-12T01:22:30.283443+0000","last_clean_scrub_stamp":"2024-09-12T01:22:30.283443+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:32.130551+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":92,"num_write":265,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'349","reported_seq":1048,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.978802+0000","last_change":"2024-09-12T01:22:12.978642+0000","last_active":"2024-09-12T01:22:12.978802+0000","last_peered":"2024-09-12T01:22:12.978802+0000","last_clean":"2024-09-12T01:22:12.978802+0000","last_became_active":"2024-09-12T00:35:45.953935+0000","last_became_peered":"2024-09-12T00:35:45.953935+0000","last_unstale":"2024-09-12T01:22:12.978802+0000","last_undegraded":"2024-09-12T01:22:12.978802+0000","last_fullsized":"2024-09-12T01:22:12.978802+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'349","last_scrub_stamp":"2024-09-12T01:22:12.978442+0000","last_deep_scrub":"265'349","last_deep_scrub_stamp":"2024-09-12T01:22:12.978442+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.978442+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:16.697478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1509,"num_read_kb":1228,"num_write":558,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'331","reported_seq":990,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.065472+0000","last_change":"2024-09-12T01:22:05.065472+0000","last_active":"2024-09-12T01:22:05.065472+0000","last_peered":"2024-09-12T01:22:05.065472+0000","last_clean":"2024-09-12T01:22:05.065472+0000","last_became_active":"2024-09-12T00:35:43.929559+0000","last_became_peered":"2024-09-12T00:35:43.929559+0000","last_unstale":"2024-09-12T01:22:05.065472+0000","last_undegraded":"2024-09-12T01:22:05.065472+0000","last_fullsized":"2024-09-12T01:22:05.065472+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'331","last_scrub_stamp":"2024-09-12T01:22:05.065301+0000","last_deep_scrub":"265'331","last_deep_scrub_stamp":"2024-09-12T01:22:05.065301+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.065301+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:54.088835+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2025256,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":451,"num_read_kb":47620,"num_write":929,"num_write_kb":27870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"265'4","reported_seq":1473,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:25.625045+0000","last_change":"2024-09-12T01:22:25.624904+0000","last_active":"2024-09-12T01:22:25.625045+0000","last_peered":"2024-09-12T01:22:25.625045+0000","last_clean":"2024-09-12T01:22:25.625045+0000","last_became_active":"2024-09-12T00:35:47.936026+0000","last_became_peered":"2024-09-12T00:35:47.936026+0000","last_unstale":"2024-09-12T01:22:25.625045+0000","last_undegraded":"2024-09-12T01:22:25.625045+0000","last_fullsized":"2024-09-12T01:22:25.625045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T01:22:25.624719+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T01:22:25.624719+0000","last_clean_scrub_stamp":"2024-09-12T01:22:25.624719+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:27.524698+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":965,"num_read_kb":965,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'85","reported_seq":609,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:30.595385+0000","last_change":"2024-09-12T01:22:30.595229+0000","last_active":"2024-09-12T01:22:30.595385+0000","last_peered":"2024-09-12T01:22:30.595385+0000","last_clean":"2024-09-12T01:22:30.595385+0000","last_became_active":"2024-09-12T00:35:50.027161+0000","last_became_peered":"2024-09-12T00:35:50.027161+0000","last_unstale":"2024-09-12T01:22:30.595385+0000","last_undegraded":"2024-09-12T01:22:30.595385+0000","last_fullsized":"2024-09-12T01:22:30.595385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'85","last_scrub_stamp":"2024-09-12T01:22:30.595013+0000","last_deep_scrub":"265'85","last_deep_scrub_stamp":"2024-09-12T01:22:30.595013+0000","last_clean_scrub_stamp":"2024-09-12T01:22:30.595013+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:04.958322+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'774","reported_seq":6328,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:24.099872+0000","last_change":"2024-09-12T01:22:24.099738+0000","last_active":"2024-09-12T01:22:24.099872+0000","last_peered":"2024-09-12T01:22:24.099872+0000","last_clean":"2024-09-12T01:22:24.099872+0000","last_became_active":"2024-09-12T00:35:51.976947+0000","last_became_peered":"2024-09-12T00:35:51.976947+0000","last_unstale":"2024-09-12T01:22:24.099872+0000","last_undegraded":"2024-09-12T01:22:24.099872+0000","last_fullsized":"2024-09-12T01:22:24.099872+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'774","last_scrub_stamp":"2024-09-12T01:22:24.099561+0000","last_deep_scrub":"265'774","last_deep_scrub_stamp":"2024-09-12T01:22:24.099561+0000","last_clean_scrub_stamp":"2024-09-12T01:22:24.099561+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:55.033935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'157","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:36.943142+0000","last_change":"2024-09-12T01:22:36.943142+0000","last_active":"2024-09-12T01:22:36.943142+0000","last_peered":"2024-09-12T01:22:36.943142+0000","last_clean":"2024-09-12T01:22:36.943142+0000","last_became_active":"2024-09-12T00:35:53.994715+0000","last_became_peered":"2024-09-12T00:35:53.994715+0000","last_unstale":"2024-09-12T01:22:36.943142+0000","last_undegraded":"2024-09-12T01:22:36.943142+0000","last_fullsized":"2024-09-12T01:22:36.943142+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'157","last_scrub_stamp":"2024-09-12T01:22:36.942957+0000","last_deep_scrub":"265'157","last_deep_scrub_stamp":"2024-09-12T01:22:36.942957+0000","last_clean_scrub_stamp":"2024-09-12T01:22:36.942957+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:47.928655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":132,"num_read_kb":125,"num_write":372,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'159","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.435354+0000","last_change":"2024-09-12T01:22:09.435354+0000","last_active":"2024-09-12T01:22:09.435354+0000","last_peered":"2024-09-12T01:22:09.435354+0000","last_clean":"2024-09-12T01:22:09.435354+0000","last_became_active":"2024-09-12T00:36:17.049999+0000","last_became_peered":"2024-09-12T00:36:17.049999+0000","last_unstale":"2024-09-12T01:22:09.435354+0000","last_undegraded":"2024-09-12T01:22:09.435354+0000","last_fullsized":"2024-09-12T01:22:09.435354+0000","mapping_epoch":37,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'159","last_scrub_stamp":"2024-09-12T01:22:09.435171+0000","last_deep_scrub":"265'159","last_deep_scrub_stamp":"2024-09-12T01:22:09.435171+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.435171+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:31.966275+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":667,"num_read_kb":538,"num_write":243,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8078,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"265'365","reported_seq":1125,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:04.666087+0000","last_change":"2024-09-12T01:22:04.665974+0000","last_active":"2024-09-12T01:22:04.666087+0000","last_peered":"2024-09-12T01:22:04.666087+0000","last_clean":"2024-09-12T01:22:04.666087+0000","last_became_active":"2024-09-12T00:35:43.931562+0000","last_became_peered":"2024-09-12T00:35:43.931562+0000","last_unstale":"2024-09-12T01:22:04.666087+0000","last_undegraded":"2024-09-12T01:22:04.666087+0000","last_fullsized":"2024-09-12T01:22:04.666087+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T01:22:04.665854+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T01:22:04.665854+0000","last_clean_scrub_stamp":"2024-09-12T01:22:04.665854+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:17.732533+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992276,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":678,"num_read_kb":113913,"num_write":1161,"num_write_kb":34109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:25.865335+0000","last_change":"2024-09-12T01:22:25.865212+0000","last_active":"2024-09-12T01:22:25.865335+0000","last_peered":"2024-09-12T01:22:25.865335+0000","last_clean":"2024-09-12T01:22:25.865335+0000","last_became_active":"2024-09-12T00:35:47.930147+0000","last_became_peered":"2024-09-12T00:35:47.930147+0000","last_unstale":"2024-09-12T01:22:25.865335+0000","last_undegraded":"2024-09-12T01:22:25.865335+0000","last_fullsized":"2024-09-12T01:22:25.865335+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:25.865042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:25.865042+0000","last_clean_scrub_stamp":"2024-09-12T01:22:25.865042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:36.302789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'353","reported_seq":965,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:31.632321+0000","last_change":"2024-09-12T01:22:31.632246+0000","last_active":"2024-09-12T01:22:31.632321+0000","last_peered":"2024-09-12T01:22:31.632321+0000","last_clean":"2024-09-12T01:22:31.632321+0000","last_became_active":"2024-09-12T00:35:49.938597+0000","last_became_peered":"2024-09-12T00:35:49.938597+0000","last_unstale":"2024-09-12T01:22:31.632321+0000","last_undegraded":"2024-09-12T01:22:31.632321+0000","last_fullsized":"2024-09-12T01:22:31.632321+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'353","last_scrub_stamp":"2024-09-12T01:22:31.632135+0000","last_deep_scrub":"265'353","last_deep_scrub_stamp":"2024-09-12T01:22:31.632135+0000","last_clean_scrub_stamp":"2024-09-12T01:22:31.632135+0000","objects_scrubbed":8,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:04.456182+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46738,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":571,"num_read_kb":1203,"num_write":454,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.084790+0000","last_change":"2024-09-12T01:22:22.084666+0000","last_active":"2024-09-12T01:22:22.084790+0000","last_peered":"2024-09-12T01:22:22.084790+0000","last_clean":"2024-09-12T01:22:22.084790+0000","last_became_active":"2024-09-12T00:35:51.967708+0000","last_became_peered":"2024-09-12T00:35:51.967708+0000","last_unstale":"2024-09-12T01:22:22.084790+0000","last_undegraded":"2024-09-12T01:22:22.084790+0000","last_fullsized":"2024-09-12T01:22:22.084790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:22.084485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:22.084485+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.084485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:12.944518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'119","reported_seq":616,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:33.290424+0000","last_change":"2024-09-12T01:22:33.290424+0000","last_active":"2024-09-12T01:22:33.290424+0000","last_peered":"2024-09-12T01:22:33.290424+0000","last_clean":"2024-09-12T01:22:33.290424+0000","last_became_active":"2024-09-12T00:35:53.997893+0000","last_became_peered":"2024-09-12T00:35:53.997893+0000","last_unstale":"2024-09-12T01:22:33.290424+0000","last_undegraded":"2024-09-12T01:22:33.290424+0000","last_fullsized":"2024-09-12T01:22:33.290424+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'119","last_scrub_stamp":"2024-09-12T01:22:33.290100+0000","last_deep_scrub":"265'119","last_deep_scrub_stamp":"2024-09-12T01:22:33.290100+0000","last_clean_scrub_stamp":"2024-09-12T01:22:33.290100+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:58.599965+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":114,"num_write":260,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'95","reported_seq":687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.199979+0000","last_change":"2024-09-12T01:22:13.199979+0000","last_active":"2024-09-12T01:22:13.199979+0000","last_peered":"2024-09-12T01:22:13.199979+0000","last_clean":"2024-09-12T01:22:13.199979+0000","last_became_active":"2024-09-12T00:35:45.941291+0000","last_became_peered":"2024-09-12T00:35:45.941291+0000","last_unstale":"2024-09-12T01:22:13.199979+0000","last_undegraded":"2024-09-12T01:22:13.199979+0000","last_fullsized":"2024-09-12T01:22:13.199979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'95","last_scrub_stamp":"2024-09-12T01:22:13.199797+0000","last_deep_scrub":"265'95","last_deep_scrub_stamp":"2024-09-12T01:22:13.199797+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.199797+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:29.571782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":459,"num_read_kb":386,"num_write":145,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":621,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.470742+0000","last_change":"2024-09-12T01:22:05.470742+0000","last_active":"2024-09-12T01:22:05.470742+0000","last_peered":"2024-09-12T01:22:05.470742+0000","last_clean":"2024-09-12T01:22:05.470742+0000","last_became_active":"2024-09-12T00:35:25.096843+0000","last_became_peered":"2024-09-12T00:35:25.096843+0000","last_unstale":"2024-09-12T01:22:05.470742+0000","last_undegraded":"2024-09-12T01:22:05.470742+0000","last_fullsized":"2024-09-12T01:22:05.470742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-12T01:22:05.470506+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-12T01:22:05.470506+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.470506+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:45.363711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.800395+0000","last_change":"2024-09-12T01:22:09.800395+0000","last_active":"2024-09-12T01:22:09.800395+0000","last_peered":"2024-09-12T01:22:09.800395+0000","last_clean":"2024-09-12T01:22:09.800395+0000","last_became_active":"2024-09-12T00:35:29.668145+0000","last_became_peered":"2024-09-12T00:35:29.668145+0000","last_unstale":"2024-09-12T01:22:09.800395+0000","last_undegraded":"2024-09-12T01:22:09.800395+0000","last_fullsized":"2024-09-12T01:22:09.800395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:09.800200+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:09.800200+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.800200+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:15.267436+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0011070749999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'322","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:03.609476+0000","last_change":"2024-09-12T01:22:03.609476+0000","last_active":"2024-09-12T01:22:03.609476+0000","last_peered":"2024-09-12T01:22:03.609476+0000","last_clean":"2024-09-12T01:22:03.609476+0000","last_became_active":"2024-09-12T00:35:43.916969+0000","last_became_peered":"2024-09-12T00:35:43.916969+0000","last_unstale":"2024-09-12T01:22:03.609476+0000","last_undegraded":"2024-09-12T01:22:03.609476+0000","last_fullsized":"2024-09-12T01:22:03.609476+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T01:22:03.609346+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T01:22:03.609346+0000","last_clean_scrub_stamp":"2024-09-12T01:22:03.609346+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:29.571575+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568993,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":119474,"num_write":1014,"num_write_kb":17296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.373693+0000","last_change":"2024-09-12T01:22:22.373693+0000","last_active":"2024-09-12T01:22:22.373693+0000","last_peered":"2024-09-12T01:22:22.373693+0000","last_clean":"2024-09-12T01:22:22.373693+0000","last_became_active":"2024-09-12T00:35:47.942643+0000","last_became_peered":"2024-09-12T00:35:47.942643+0000","last_unstale":"2024-09-12T01:22:22.373693+0000","last_undegraded":"2024-09-12T01:22:22.373693+0000","last_fullsized":"2024-09-12T01:22:22.373693+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:22.373489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:22.373489+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.373489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:26.791309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'703","reported_seq":1418,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:29.671617+0000","last_change":"2024-09-12T01:22:29.671617+0000","last_active":"2024-09-12T01:22:29.671617+0000","last_peered":"2024-09-12T01:22:29.671617+0000","last_clean":"2024-09-12T01:22:29.671617+0000","last_became_active":"2024-09-12T00:35:49.957694+0000","last_became_peered":"2024-09-12T00:35:49.957694+0000","last_unstale":"2024-09-12T01:22:29.671617+0000","last_undegraded":"2024-09-12T01:22:29.671617+0000","last_fullsized":"2024-09-12T01:22:29.671617+0000","mapping_epoch":30,"log_start":"265'600","ondisk_log_start":"265'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'703","last_scrub_stamp":"2024-09-12T01:22:29.671389+0000","last_deep_scrub":"265'703","last_deep_scrub_stamp":"2024-09-12T01:22:29.671389+0000","last_clean_scrub_stamp":"2024-09-12T01:22:29.671389+0000","objects_scrubbed":7,"log_size":103,"log_dups_size":600,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:45.223736+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144071,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1382,"num_read_kb":3079,"num_write":1308,"num_write_kb":1154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":107698,"num_omap_keys":260,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:31.484104+0000","last_change":"2024-09-12T01:22:31.484104+0000","last_active":"2024-09-12T01:22:31.484104+0000","last_peered":"2024-09-12T01:22:31.484104+0000","last_clean":"2024-09-12T01:22:31.484104+0000","last_became_active":"2024-09-12T00:35:51.977282+0000","last_became_peered":"2024-09-12T00:35:51.977282+0000","last_unstale":"2024-09-12T01:22:31.484104+0000","last_undegraded":"2024-09-12T01:22:31.484104+0000","last_fullsized":"2024-09-12T01:22:31.484104+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:31.483918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:31.483918+0000","last_clean_scrub_stamp":"2024-09-12T01:22:31.483918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:49.029998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'208","reported_seq":925,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:28.107049+0000","last_change":"2024-09-12T01:22:28.107049+0000","last_active":"2024-09-12T01:22:28.107049+0000","last_peered":"2024-09-12T01:22:28.107049+0000","last_clean":"2024-09-12T01:22:28.107049+0000","last_became_active":"2024-09-12T00:35:53.997354+0000","last_became_peered":"2024-09-12T00:35:53.997354+0000","last_unstale":"2024-09-12T01:22:28.107049+0000","last_undegraded":"2024-09-12T01:22:28.107049+0000","last_fullsized":"2024-09-12T01:22:28.107049+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'208","last_scrub_stamp":"2024-09-12T01:22:28.106812+0000","last_deep_scrub":"265'208","last_deep_scrub_stamp":"2024-09-12T01:22:28.106812+0000","last_clean_scrub_stamp":"2024-09-12T01:22:28.106812+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:03.140844+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":471,"num_write":454,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'239","reported_seq":905,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.549409+0000","last_change":"2024-09-12T01:22:11.549409+0000","last_active":"2024-09-12T01:22:11.549409+0000","last_peered":"2024-09-12T01:22:11.549409+0000","last_clean":"2024-09-12T01:22:11.549409+0000","last_became_active":"2024-09-12T00:35:45.945766+0000","last_became_peered":"2024-09-12T00:35:45.945766+0000","last_unstale":"2024-09-12T01:22:11.549409+0000","last_undegraded":"2024-09-12T01:22:11.549409+0000","last_fullsized":"2024-09-12T01:22:11.549409+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'239","last_scrub_stamp":"2024-09-12T01:22:11.549218+0000","last_deep_scrub":"265'239","last_deep_scrub_stamp":"2024-09-12T01:22:11.549218+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.549218+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:53.581793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1032,"num_read_kb":857,"num_write":339,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.466487+0000","last_change":"2024-09-12T01:22:06.466487+0000","last_active":"2024-09-12T01:22:06.466487+0000","last_peered":"2024-09-12T01:22:06.466487+0000","last_clean":"2024-09-12T01:22:06.466487+0000","last_became_active":"2024-09-12T00:35:29.671287+0000","last_became_peered":"2024-09-12T00:35:29.671287+0000","last_unstale":"2024-09-12T01:22:06.466487+0000","last_undegraded":"2024-09-12T01:22:06.466487+0000","last_fullsized":"2024-09-12T01:22:06.466487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:06.466276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:06.466276+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.466276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:01.838180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075002000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'404","reported_seq":1121,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:03.716502+0000","last_change":"2024-09-12T01:22:03.716502+0000","last_active":"2024-09-12T01:22:03.716502+0000","last_peered":"2024-09-12T01:22:03.716502+0000","last_clean":"2024-09-12T01:22:03.716502+0000","last_became_active":"2024-09-12T00:35:43.945335+0000","last_became_peered":"2024-09-12T00:35:43.945335+0000","last_unstale":"2024-09-12T01:22:03.716502+0000","last_undegraded":"2024-09-12T01:22:03.716502+0000","last_fullsized":"2024-09-12T01:22:03.716502+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'404","last_scrub_stamp":"2024-09-12T01:22:03.716386+0000","last_deep_scrub":"265'404","last_deep_scrub_stamp":"2024-09-12T01:22:03.716386+0000","last_clean_scrub_stamp":"2024-09-12T01:22:03.716386+0000","objects_scrubbed":7,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:53.096747+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":682,"num_read_kb":63013,"num_write":1485,"num_write_kb":40970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:24.648574+0000","last_change":"2024-09-12T01:22:24.648574+0000","last_active":"2024-09-12T01:22:24.648574+0000","last_peered":"2024-09-12T01:22:24.648574+0000","last_clean":"2024-09-12T01:22:24.648574+0000","last_became_active":"2024-09-12T00:35:47.925704+0000","last_became_peered":"2024-09-12T00:35:47.925704+0000","last_unstale":"2024-09-12T01:22:24.648574+0000","last_undegraded":"2024-09-12T01:22:24.648574+0000","last_fullsized":"2024-09-12T01:22:24.648574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:24.648314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:24.648314+0000","last_clean_scrub_stamp":"2024-09-12T01:22:24.648314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:34.513335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1270","reported_seq":2773,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:23.233400+0000","last_change":"2024-09-12T01:22:23.233400+0000","last_active":"2024-09-12T01:22:23.233400+0000","last_peered":"2024-09-12T01:22:23.233400+0000","last_clean":"2024-09-12T01:22:23.233400+0000","last_became_active":"2024-09-12T00:35:49.947643+0000","last_became_peered":"2024-09-12T00:35:49.947643+0000","last_unstale":"2024-09-12T01:22:23.233400+0000","last_undegraded":"2024-09-12T01:22:23.233400+0000","last_fullsized":"2024-09-12T01:22:23.233400+0000","mapping_epoch":30,"log_start":"265'1200","ondisk_log_start":"265'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1270","last_scrub_stamp":"2024-09-12T01:22:23.233211+0000","last_deep_scrub":"265'1270","last_deep_scrub_stamp":"2024-09-12T01:22:23.233211+0000","last_clean_scrub_stamp":"2024-09-12T01:22:23.233211+0000","objects_scrubbed":12,"log_size":70,"log_dups_size":1200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:51.857102+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144243,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2043,"num_read_kb":3859,"num_write":1128,"num_write_kb":966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:33.403165+0000","last_change":"2024-09-12T01:22:33.403165+0000","last_active":"2024-09-12T01:22:33.403165+0000","last_peered":"2024-09-12T01:22:33.403165+0000","last_clean":"2024-09-12T01:22:33.403165+0000","last_became_active":"2024-09-12T00:35:51.981240+0000","last_became_peered":"2024-09-12T00:35:51.981240+0000","last_unstale":"2024-09-12T01:22:33.403165+0000","last_undegraded":"2024-09-12T01:22:33.403165+0000","last_fullsized":"2024-09-12T01:22:33.403165+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:33.402987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:33.402987+0000","last_clean_scrub_stamp":"2024-09-12T01:22:33.402987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:18.450569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'137","reported_seq":653,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:36.253508+0000","last_change":"2024-09-12T01:22:36.253508+0000","last_active":"2024-09-12T01:22:36.253508+0000","last_peered":"2024-09-12T01:22:36.253508+0000","last_clean":"2024-09-12T01:22:36.253508+0000","last_became_active":"2024-09-12T00:35:54.013658+0000","last_became_peered":"2024-09-12T00:35:54.013658+0000","last_unstale":"2024-09-12T01:22:36.253508+0000","last_undegraded":"2024-09-12T01:22:36.253508+0000","last_fullsized":"2024-09-12T01:22:36.253508+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'137","last_scrub_stamp":"2024-09-12T01:22:36.253219+0000","last_deep_scrub":"265'137","last_deep_scrub_stamp":"2024-09-12T01:22:36.253219+0000","last_clean_scrub_stamp":"2024-09-12T01:22:36.253219+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:39.667502+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":184,"num_read_kb":167,"num_write":336,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'142","reported_seq":780,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.143929+0000","last_change":"2024-09-12T01:22:13.143929+0000","last_active":"2024-09-12T01:22:13.143929+0000","last_peered":"2024-09-12T01:22:13.143929+0000","last_clean":"2024-09-12T01:22:13.143929+0000","last_became_active":"2024-09-12T00:35:45.929073+0000","last_became_peered":"2024-09-12T00:35:45.929073+0000","last_unstale":"2024-09-12T01:22:13.143929+0000","last_undegraded":"2024-09-12T01:22:13.143929+0000","last_fullsized":"2024-09-12T01:22:13.143929+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'142","last_scrub_stamp":"2024-09-12T01:22:13.143744+0000","last_deep_scrub":"265'142","last_deep_scrub_stamp":"2024-09-12T01:22:13.143744+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.143744+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:36.562063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":635,"num_read_kb":540,"num_write":217,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:03.482812+0000","last_change":"2024-09-12T01:22:03.482812+0000","last_active":"2024-09-12T01:22:03.482812+0000","last_peered":"2024-09-12T01:22:03.482812+0000","last_clean":"2024-09-12T01:22:03.482812+0000","last_became_active":"2024-09-12T00:35:29.699432+0000","last_became_peered":"2024-09-12T00:35:29.699432+0000","last_unstale":"2024-09-12T01:22:03.482812+0000","last_undegraded":"2024-09-12T01:22:03.482812+0000","last_fullsized":"2024-09-12T01:22:03.482812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:03.482726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:03.482726+0000","last_clean_scrub_stamp":"2024-09-12T01:22:03.482726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:09.949801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099979400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'347","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.188799+0000","last_change":"2024-09-12T01:22:05.188799+0000","last_active":"2024-09-12T01:22:05.188799+0000","last_peered":"2024-09-12T01:22:05.188799+0000","last_clean":"2024-09-12T01:22:05.188799+0000","last_became_active":"2024-09-12T00:35:43.928667+0000","last_became_peered":"2024-09-12T00:35:43.928667+0000","last_unstale":"2024-09-12T01:22:05.188799+0000","last_undegraded":"2024-09-12T01:22:05.188799+0000","last_fullsized":"2024-09-12T01:22:05.188799+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T01:22:05.188675+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T01:22:05.188675+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.188675+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:11.123392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174664,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":503,"num_read_kb":16533,"num_write":1052,"num_write_kb":18962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"265'2","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.378468+0000","last_change":"2024-09-12T01:22:22.378468+0000","last_active":"2024-09-12T01:22:22.378468+0000","last_peered":"2024-09-12T01:22:22.378468+0000","last_clean":"2024-09-12T01:22:22.378468+0000","last_became_active":"2024-09-12T00:35:47.944385+0000","last_became_peered":"2024-09-12T00:35:47.944385+0000","last_unstale":"2024-09-12T01:22:22.378468+0000","last_undegraded":"2024-09-12T01:22:22.378468+0000","last_fullsized":"2024-09-12T01:22:22.378468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:22.378275+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:22.378275+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.378275+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:11.673153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'235","reported_seq":1338,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:27.344418+0000","last_change":"2024-09-12T01:22:27.344418+0000","last_active":"2024-09-12T01:22:27.344418+0000","last_peered":"2024-09-12T01:22:27.344418+0000","last_clean":"2024-09-12T01:22:27.344418+0000","last_became_active":"2024-09-12T00:35:50.025610+0000","last_became_peered":"2024-09-12T00:35:50.025610+0000","last_unstale":"2024-09-12T01:22:27.344418+0000","last_undegraded":"2024-09-12T01:22:27.344418+0000","last_fullsized":"2024-09-12T01:22:27.344418+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'235","last_scrub_stamp":"2024-09-12T01:22:27.344190+0000","last_deep_scrub":"265'235","last_deep_scrub_stamp":"2024-09-12T01:22:27.344190+0000","last_clean_scrub_stamp":"2024-09-12T01:22:27.344190+0000","objects_scrubbed":9,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:09.545564+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":183,"num_read_kb":174,"num_write":155,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:29.469905+0000","last_change":"2024-09-12T01:22:29.469905+0000","last_active":"2024-09-12T01:22:29.469905+0000","last_peered":"2024-09-12T01:22:29.469905+0000","last_clean":"2024-09-12T01:22:29.469905+0000","last_became_active":"2024-09-12T00:35:51.973593+0000","last_became_peered":"2024-09-12T00:35:51.973593+0000","last_unstale":"2024-09-12T01:22:29.469905+0000","last_undegraded":"2024-09-12T01:22:29.469905+0000","last_fullsized":"2024-09-12T01:22:29.469905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:29.469717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:29.469717+0000","last_clean_scrub_stamp":"2024-09-12T01:22:29.469717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:49.513054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'275","reported_seq":887,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:41.720062+0000","last_change":"2024-09-12T01:22:41.719874+0000","last_active":"2024-09-12T01:22:41.720062+0000","last_peered":"2024-09-12T01:22:41.720062+0000","last_clean":"2024-09-12T01:22:41.720062+0000","last_became_active":"2024-09-12T00:35:53.994828+0000","last_became_peered":"2024-09-12T00:35:53.994828+0000","last_unstale":"2024-09-12T01:22:41.720062+0000","last_undegraded":"2024-09-12T01:22:41.720062+0000","last_fullsized":"2024-09-12T01:22:41.720062+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'275","last_scrub_stamp":"2024-09-12T01:22:41.719695+0000","last_deep_scrub":"265'275","last_deep_scrub_stamp":"2024-09-12T01:22:41.719695+0000","last_clean_scrub_stamp":"2024-09-12T01:22:41.719695+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:43.529849+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":532,"num_read_kb":546,"num_write":608,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'101","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.159831+0000","last_change":"2024-09-12T01:22:12.159831+0000","last_active":"2024-09-12T01:22:12.159831+0000","last_peered":"2024-09-12T01:22:12.159831+0000","last_clean":"2024-09-12T01:22:12.159831+0000","last_became_active":"2024-09-12T00:35:45.932642+0000","last_became_peered":"2024-09-12T00:35:45.932642+0000","last_unstale":"2024-09-12T01:22:12.159831+0000","last_undegraded":"2024-09-12T01:22:12.159831+0000","last_fullsized":"2024-09-12T01:22:12.159831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'101","last_scrub_stamp":"2024-09-12T01:22:12.159645+0000","last_deep_scrub":"265'101","last_deep_scrub_stamp":"2024-09-12T01:22:12.159645+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.159645+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:07.949915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":466,"num_read_kb":396,"num_write":153,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:04.843329+0000","last_change":"2024-09-12T01:22:04.843329+0000","last_active":"2024-09-12T01:22:04.843329+0000","last_peered":"2024-09-12T01:22:04.843329+0000","last_clean":"2024-09-12T01:22:04.843329+0000","last_became_active":"2024-09-12T00:35:29.664963+0000","last_became_peered":"2024-09-12T00:35:29.664963+0000","last_unstale":"2024-09-12T01:22:04.843329+0000","last_undegraded":"2024-09-12T01:22:04.843329+0000","last_fullsized":"2024-09-12T01:22:04.843329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:22:04.843146+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:22:04.843146+0000","last_clean_scrub_stamp":"2024-09-12T01:22:04.843146+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:56.597168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0020842569999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'294","reported_seq":972,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:04.048022+0000","last_change":"2024-09-12T01:22:04.048022+0000","last_active":"2024-09-12T01:22:04.048022+0000","last_peered":"2024-09-12T01:22:04.048022+0000","last_clean":"2024-09-12T01:22:04.048022+0000","last_became_active":"2024-09-12T00:35:43.930731+0000","last_became_peered":"2024-09-12T00:35:43.930731+0000","last_unstale":"2024-09-12T01:22:04.048022+0000","last_undegraded":"2024-09-12T01:22:04.048022+0000","last_fullsized":"2024-09-12T01:22:04.048022+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'294","last_scrub_stamp":"2024-09-12T01:22:04.047797+0000","last_deep_scrub":"265'294","last_deep_scrub_stamp":"2024-09-12T01:22:04.047797+0000","last_clean_scrub_stamp":"2024-09-12T01:22:04.047797+0000","objects_scrubbed":5,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:39.342877+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":688153,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":45060,"num_write":1094,"num_write_kb":33877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.462404+0000","last_change":"2024-09-12T01:22:21.462404+0000","last_active":"2024-09-12T01:22:21.462404+0000","last_peered":"2024-09-12T01:22:21.462404+0000","last_clean":"2024-09-12T01:22:21.462404+0000","last_became_active":"2024-09-12T00:35:47.939055+0000","last_became_peered":"2024-09-12T00:35:47.939055+0000","last_unstale":"2024-09-12T01:22:21.462404+0000","last_undegraded":"2024-09-12T01:22:21.462404+0000","last_fullsized":"2024-09-12T01:22:21.462404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:21.462198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:21.462198+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.462198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:09.095594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'124","reported_seq":669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:28.563444+0000","last_change":"2024-09-12T01:22:28.563444+0000","last_active":"2024-09-12T01:22:28.563444+0000","last_peered":"2024-09-12T01:22:28.563444+0000","last_clean":"2024-09-12T01:22:28.563444+0000","last_became_active":"2024-09-12T00:35:49.948258+0000","last_became_peered":"2024-09-12T00:35:49.948258+0000","last_unstale":"2024-09-12T01:22:28.563444+0000","last_undegraded":"2024-09-12T01:22:28.563444+0000","last_fullsized":"2024-09-12T01:22:28.563444+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'124","last_scrub_stamp":"2024-09-12T01:22:28.563234+0000","last_deep_scrub":"265'124","last_deep_scrub_stamp":"2024-09-12T01:22:28.563234+0000","last_clean_scrub_stamp":"2024-09-12T01:22:28.563234+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:25.266630+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3226,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.048163+0000","last_change":"2024-09-12T01:22:21.048163+0000","last_active":"2024-09-12T01:22:21.048163+0000","last_peered":"2024-09-12T01:22:21.048163+0000","last_clean":"2024-09-12T01:22:21.048163+0000","last_became_active":"2024-09-12T00:35:51.974302+0000","last_became_peered":"2024-09-12T00:35:51.974302+0000","last_unstale":"2024-09-12T01:22:21.048163+0000","last_undegraded":"2024-09-12T01:22:21.048163+0000","last_fullsized":"2024-09-12T01:22:21.048163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:21.047984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:21.047984+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.047984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:34.374068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'144","reported_seq":715,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:36.547164+0000","last_change":"2024-09-12T01:22:36.547164+0000","last_active":"2024-09-12T01:22:36.547164+0000","last_peered":"2024-09-12T01:22:36.547164+0000","last_clean":"2024-09-12T01:22:36.547164+0000","last_became_active":"2024-09-12T00:35:53.995254+0000","last_became_peered":"2024-09-12T00:35:53.995254+0000","last_unstale":"2024-09-12T01:22:36.547164+0000","last_undegraded":"2024-09-12T01:22:36.547164+0000","last_fullsized":"2024-09-12T01:22:36.547164+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'144","last_scrub_stamp":"2024-09-12T01:22:36.546872+0000","last_deep_scrub":"265'144","last_deep_scrub_stamp":"2024-09-12T01:22:36.546872+0000","last_clean_scrub_stamp":"2024-09-12T01:22:36.546872+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:16.036809+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1272,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":285,"num_read_kb":262,"num_write":355,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'53","reported_seq":599,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.173036+0000","last_change":"2024-09-12T01:22:11.173036+0000","last_active":"2024-09-12T01:22:11.173036+0000","last_peered":"2024-09-12T01:22:11.173036+0000","last_clean":"2024-09-12T01:22:11.173036+0000","last_became_active":"2024-09-12T00:35:45.936061+0000","last_became_peered":"2024-09-12T00:35:45.936061+0000","last_unstale":"2024-09-12T01:22:11.173036+0000","last_undegraded":"2024-09-12T01:22:11.173036+0000","last_fullsized":"2024-09-12T01:22:11.173036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'53","last_scrub_stamp":"2024-09-12T01:22:11.172855+0000","last_deep_scrub":"265'53","last_deep_scrub_stamp":"2024-09-12T01:22:11.172855+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.172855+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:11.840647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":179,"num_write":83,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"265'358","reported_seq":1020,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.848155+0000","last_change":"2024-09-12T01:22:05.848155+0000","last_active":"2024-09-12T01:22:05.848155+0000","last_peered":"2024-09-12T01:22:05.848155+0000","last_clean":"2024-09-12T01:22:05.848155+0000","last_became_active":"2024-09-12T00:36:17.051542+0000","last_became_peered":"2024-09-12T00:36:17.051542+0000","last_unstale":"2024-09-12T01:22:05.848155+0000","last_undegraded":"2024-09-12T01:22:05.848155+0000","last_fullsized":"2024-09-12T01:22:05.848155+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T01:22:05.847893+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T01:22:05.847893+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.847893+0000","objects_scrubbed":9,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:51.384435+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730210,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":479,"num_read_kb":44411,"num_write":1031,"num_write_kb":33814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:03.236128+0000","last_change":"2024-09-12T01:22:03.236128+0000","last_active":"2024-09-12T01:22:03.236128+0000","last_peered":"2024-09-12T01:22:03.236128+0000","last_clean":"2024-09-12T01:22:03.236128+0000","last_became_active":"2024-09-12T00:35:29.700869+0000","last_became_peered":"2024-09-12T00:35:29.700869+0000","last_unstale":"2024-09-12T01:22:03.236128+0000","last_undegraded":"2024-09-12T01:22:03.236128+0000","last_fullsized":"2024-09-12T01:22:03.236128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:03.235936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:03.235936+0000","last_clean_scrub_stamp":"2024-09-12T01:22:03.235936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:19.598037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00099003299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"265'6","reported_seq":988,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.474373+0000","last_change":"2024-09-12T01:22:18.474373+0000","last_active":"2024-09-12T01:22:18.474373+0000","last_peered":"2024-09-12T01:22:18.474373+0000","last_clean":"2024-09-12T01:22:18.474373+0000","last_became_active":"2024-09-12T00:35:47.946690+0000","last_became_peered":"2024-09-12T00:35:47.946690+0000","last_unstale":"2024-09-12T01:22:18.474373+0000","last_undegraded":"2024-09-12T01:22:18.474373+0000","last_fullsized":"2024-09-12T01:22:18.474373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:22:18.474192+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:22:18.474192+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.474192+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:24.840674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'579","reported_seq":1257,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:23.516688+0000","last_change":"2024-09-12T01:22:23.516688+0000","last_active":"2024-09-12T01:22:23.516688+0000","last_peered":"2024-09-12T01:22:23.516688+0000","last_clean":"2024-09-12T01:22:23.516688+0000","last_became_active":"2024-09-12T00:35:49.948095+0000","last_became_peered":"2024-09-12T00:35:49.948095+0000","last_unstale":"2024-09-12T01:22:23.516688+0000","last_undegraded":"2024-09-12T01:22:23.516688+0000","last_fullsized":"2024-09-12T01:22:23.516688+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'579","last_scrub_stamp":"2024-09-12T01:22:23.516444+0000","last_deep_scrub":"265'579","last_deep_scrub_stamp":"2024-09-12T01:22:23.516444+0000","last_clean_scrub_stamp":"2024-09-12T01:22:23.516444+0000","objects_scrubbed":11,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:57.103924+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93682,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1577,"num_read_kb":2692,"num_write":2050,"num_write_kb":1874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506876,"num_omap_keys":1146,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:33.956023+0000","last_change":"2024-09-12T01:22:33.956023+0000","last_active":"2024-09-12T01:22:33.956023+0000","last_peered":"2024-09-12T01:22:33.956023+0000","last_clean":"2024-09-12T01:22:33.956023+0000","last_became_active":"2024-09-12T00:35:51.967708+0000","last_became_peered":"2024-09-12T00:35:51.967708+0000","last_unstale":"2024-09-12T01:22:33.956023+0000","last_undegraded":"2024-09-12T01:22:33.956023+0000","last_fullsized":"2024-09-12T01:22:33.956023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:33.955853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:33.955853+0000","last_clean_scrub_stamp":"2024-09-12T01:22:33.955853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:22.354853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'151","reported_seq":656,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:41.354125+0000","last_change":"2024-09-12T01:22:41.353982+0000","last_active":"2024-09-12T01:22:41.354125+0000","last_peered":"2024-09-12T01:22:41.354125+0000","last_clean":"2024-09-12T01:22:41.354125+0000","last_became_active":"2024-09-12T00:35:54.014321+0000","last_became_peered":"2024-09-12T00:35:54.014321+0000","last_unstale":"2024-09-12T01:22:41.354125+0000","last_undegraded":"2024-09-12T01:22:41.354125+0000","last_fullsized":"2024-09-12T01:22:41.354125+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'151","last_scrub_stamp":"2024-09-12T01:22:41.353793+0000","last_deep_scrub":"265'151","last_deep_scrub_stamp":"2024-09-12T01:22:41.353793+0000","last_clean_scrub_stamp":"2024-09-12T01:22:41.353793+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:58.356575+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":134,"num_write":336,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'165","reported_seq":795,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.492877+0000","last_change":"2024-09-12T01:22:13.492877+0000","last_active":"2024-09-12T01:22:13.492877+0000","last_peered":"2024-09-12T01:22:13.492877+0000","last_clean":"2024-09-12T01:22:13.492877+0000","last_became_active":"2024-09-12T00:35:45.936178+0000","last_became_peered":"2024-09-12T00:35:45.936178+0000","last_unstale":"2024-09-12T01:22:13.492877+0000","last_undegraded":"2024-09-12T01:22:13.492877+0000","last_fullsized":"2024-09-12T01:22:13.492877+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'165","last_scrub_stamp":"2024-09-12T01:22:13.492696+0000","last_deep_scrub":"265'165","last_deep_scrub_stamp":"2024-09-12T01:22:13.492696+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.492696+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:10.154787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":595,"num_write":226,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'368","reported_seq":1010,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.263121+0000","last_change":"2024-09-12T01:22:07.263121+0000","last_active":"2024-09-12T01:22:07.263121+0000","last_peered":"2024-09-12T01:22:07.263121+0000","last_clean":"2024-09-12T01:22:07.263121+0000","last_became_active":"2024-09-12T00:35:43.928834+0000","last_became_peered":"2024-09-12T00:35:43.928834+0000","last_unstale":"2024-09-12T01:22:07.263121+0000","last_undegraded":"2024-09-12T01:22:07.263121+0000","last_fullsized":"2024-09-12T01:22:07.263121+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'368","last_scrub_stamp":"2024-09-12T01:22:07.262920+0000","last_deep_scrub":"265'368","last_deep_scrub_stamp":"2024-09-12T01:22:07.262920+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.262920+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:21.291964+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262157,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":503,"num_read_kb":29317,"num_write":1237,"num_write_kb":48953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.474150+0000","last_change":"2024-09-12T01:22:07.474150+0000","last_active":"2024-09-12T01:22:07.474150+0000","last_peered":"2024-09-12T01:22:07.474150+0000","last_clean":"2024-09-12T01:22:07.474150+0000","last_became_active":"2024-09-12T00:35:29.697973+0000","last_became_peered":"2024-09-12T00:35:29.697973+0000","last_unstale":"2024-09-12T01:22:07.474150+0000","last_undegraded":"2024-09-12T01:22:07.474150+0000","last_fullsized":"2024-09-12T01:22:07.474150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:07.473953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:07.473953+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.473953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:28.515287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083354399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.108138+0000","last_change":"2024-09-12T01:22:16.108138+0000","last_active":"2024-09-12T01:22:16.108138+0000","last_peered":"2024-09-12T01:22:16.108138+0000","last_clean":"2024-09-12T01:22:16.108138+0000","last_became_active":"2024-09-12T00:35:47.940014+0000","last_became_peered":"2024-09-12T00:35:47.940014+0000","last_unstale":"2024-09-12T01:22:16.108138+0000","last_undegraded":"2024-09-12T01:22:16.108138+0000","last_fullsized":"2024-09-12T01:22:16.108138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:16.107962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:16.107962+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.107962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:31.152033+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'194","reported_seq":766,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:24.261102+0000","last_change":"2024-09-12T01:22:24.261102+0000","last_active":"2024-09-12T01:22:24.261102+0000","last_peered":"2024-09-12T01:22:24.261102+0000","last_clean":"2024-09-12T01:22:24.261102+0000","last_became_active":"2024-09-12T00:35:50.028173+0000","last_became_peered":"2024-09-12T00:35:50.028173+0000","last_unstale":"2024-09-12T01:22:24.261102+0000","last_undegraded":"2024-09-12T01:22:24.261102+0000","last_fullsized":"2024-09-12T01:22:24.261102+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'194","last_scrub_stamp":"2024-09-12T01:22:24.260921+0000","last_deep_scrub":"265'194","last_deep_scrub_stamp":"2024-09-12T01:22:24.260921+0000","last_clean_scrub_stamp":"2024-09-12T01:22:24.260921+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:12.858541+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":223,"num_read_kb":207,"num_write":158,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'792","reported_seq":2688,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:33.634447+0000","last_change":"2024-09-12T01:22:33.634447+0000","last_active":"2024-09-12T01:22:33.634447+0000","last_peered":"2024-09-12T01:22:33.634447+0000","last_clean":"2024-09-12T01:22:33.634447+0000","last_became_active":"2024-09-12T00:35:51.977203+0000","last_became_peered":"2024-09-12T00:35:51.977203+0000","last_unstale":"2024-09-12T01:22:33.634447+0000","last_undegraded":"2024-09-12T01:22:33.634447+0000","last_fullsized":"2024-09-12T01:22:33.634447+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'792","last_scrub_stamp":"2024-09-12T01:22:33.634257+0000","last_deep_scrub":"265'792","last_deep_scrub_stamp":"2024-09-12T01:22:33.634257+0000","last_clean_scrub_stamp":"2024-09-12T01:22:33.634257+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:23.055471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'115","reported_seq":622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:42.704158+0000","last_change":"2024-09-12T01:22:42.704003+0000","last_active":"2024-09-12T01:22:42.704158+0000","last_peered":"2024-09-12T01:22:42.704158+0000","last_clean":"2024-09-12T01:22:42.704158+0000","last_became_active":"2024-09-12T00:35:54.014699+0000","last_became_peered":"2024-09-12T00:35:54.014699+0000","last_unstale":"2024-09-12T01:22:42.704158+0000","last_undegraded":"2024-09-12T01:22:42.704158+0000","last_fullsized":"2024-09-12T01:22:42.704158+0000","mapping_epoch":34,"log_start":"265'101","ondisk_log_start":"265'101","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'115","last_scrub_stamp":"2024-09-12T01:22:42.703797+0000","last_deep_scrub":"265'115","last_deep_scrub_stamp":"2024-09-12T01:22:42.703797+0000","last_clean_scrub_stamp":"2024-09-12T01:22:42.703797+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":101,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:20.247818+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1113,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":127,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'102","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.632609+0000","last_change":"2024-09-12T01:22:13.632609+0000","last_active":"2024-09-12T01:22:13.632609+0000","last_peered":"2024-09-12T01:22:13.632609+0000","last_clean":"2024-09-12T01:22:13.632609+0000","last_became_active":"2024-09-12T00:35:45.942032+0000","last_became_peered":"2024-09-12T00:35:45.942032+0000","last_unstale":"2024-09-12T01:22:13.632609+0000","last_undegraded":"2024-09-12T01:22:13.632609+0000","last_fullsized":"2024-09-12T01:22:13.632609+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'102","last_scrub_stamp":"2024-09-12T01:22:13.632428+0000","last_deep_scrub":"265'102","last_deep_scrub_stamp":"2024-09-12T01:22:13.632428+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.632428+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:15.552919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":475,"num_read_kb":403,"num_write":145,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'328","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.648763+0000","last_change":"2024-09-12T01:22:06.648628+0000","last_active":"2024-09-12T01:22:06.648763+0000","last_peered":"2024-09-12T01:22:06.648763+0000","last_clean":"2024-09-12T01:22:06.648763+0000","last_became_active":"2024-09-12T00:35:43.953619+0000","last_became_peered":"2024-09-12T00:35:43.953619+0000","last_unstale":"2024-09-12T01:22:06.648763+0000","last_undegraded":"2024-09-12T01:22:06.648763+0000","last_fullsized":"2024-09-12T01:22:06.648763+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'328","last_scrub_stamp":"2024-09-12T01:22:06.648414+0000","last_deep_scrub":"265'328","last_deep_scrub_stamp":"2024-09-12T01:22:06.648414+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.648414+0000","objects_scrubbed":10,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:28.512834+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2238687,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":418,"num_read_kb":24307,"num_write":963,"num_write_kb":33018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:04.229689+0000","last_change":"2024-09-12T01:22:04.229626+0000","last_active":"2024-09-12T01:22:04.229689+0000","last_peered":"2024-09-12T01:22:04.229689+0000","last_clean":"2024-09-12T01:22:04.229689+0000","last_became_active":"2024-09-12T00:35:29.671727+0000","last_became_peered":"2024-09-12T00:35:29.671727+0000","last_unstale":"2024-09-12T01:22:04.229689+0000","last_undegraded":"2024-09-12T01:22:04.229689+0000","last_fullsized":"2024-09-12T01:22:04.229689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:04.229530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:04.229530+0000","last_clean_scrub_stamp":"2024-09-12T01:22:04.229530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:25.823105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010553139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:24.880194+0000","last_change":"2024-09-12T01:22:24.880194+0000","last_active":"2024-09-12T01:22:24.880194+0000","last_peered":"2024-09-12T01:22:24.880194+0000","last_clean":"2024-09-12T01:22:24.880194+0000","last_became_active":"2024-09-12T00:35:47.936452+0000","last_became_peered":"2024-09-12T00:35:47.936452+0000","last_unstale":"2024-09-12T01:22:24.880194+0000","last_undegraded":"2024-09-12T01:22:24.880194+0000","last_fullsized":"2024-09-12T01:22:24.880194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:24.880010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:24.880010+0000","last_clean_scrub_stamp":"2024-09-12T01:22:24.880010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:03.823274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'119","reported_seq":672,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:29.955037+0000","last_change":"2024-09-12T01:22:29.955037+0000","last_active":"2024-09-12T01:22:29.955037+0000","last_peered":"2024-09-12T01:22:29.955037+0000","last_clean":"2024-09-12T01:22:29.955037+0000","last_became_active":"2024-09-12T00:35:49.940788+0000","last_became_peered":"2024-09-12T00:35:49.940788+0000","last_unstale":"2024-09-12T01:22:29.955037+0000","last_undegraded":"2024-09-12T01:22:29.955037+0000","last_fullsized":"2024-09-12T01:22:29.955037+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'119","last_scrub_stamp":"2024-09-12T01:22:29.954843+0000","last_deep_scrub":"265'119","last_deep_scrub_stamp":"2024-09-12T01:22:29.954843+0000","last_clean_scrub_stamp":"2024-09-12T01:22:29.954843+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:39.091136+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'790","reported_seq":2425,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:38.715465+0000","last_change":"2024-09-12T01:22:38.715465+0000","last_active":"2024-09-12T01:22:38.715465+0000","last_peered":"2024-09-12T01:22:38.715465+0000","last_clean":"2024-09-12T01:22:38.715465+0000","last_became_active":"2024-09-12T00:35:51.979997+0000","last_became_peered":"2024-09-12T00:35:51.979997+0000","last_unstale":"2024-09-12T01:22:38.715465+0000","last_undegraded":"2024-09-12T01:22:38.715465+0000","last_fullsized":"2024-09-12T01:22:38.715465+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'790","last_scrub_stamp":"2024-09-12T01:22:38.715284+0000","last_deep_scrub":"265'790","last_deep_scrub_stamp":"2024-09-12T01:22:38.715284+0000","last_clean_scrub_stamp":"2024-09-12T01:22:38.715284+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:32.689881+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'283","reported_seq":809,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:32.456438+0000","last_change":"2024-09-12T01:22:32.456292+0000","last_active":"2024-09-12T01:22:32.456438+0000","last_peered":"2024-09-12T01:22:32.456438+0000","last_clean":"2024-09-12T01:22:32.456438+0000","last_became_active":"2024-09-12T00:35:53.992431+0000","last_became_peered":"2024-09-12T00:35:53.992431+0000","last_unstale":"2024-09-12T01:22:32.456438+0000","last_undegraded":"2024-09-12T01:22:32.456438+0000","last_fullsized":"2024-09-12T01:22:32.456438+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'283","last_scrub_stamp":"2024-09-12T01:22:32.456102+0000","last_deep_scrub":"265'283","last_deep_scrub_stamp":"2024-09-12T01:22:32.456102+0000","last_clean_scrub_stamp":"2024-09-12T01:22:32.456102+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:50.473537+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":344,"num_read_kb":342,"num_write":602,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'372","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.008846+0000","last_change":"2024-09-12T01:22:09.008846+0000","last_active":"2024-09-12T01:22:09.008846+0000","last_peered":"2024-09-12T01:22:09.008846+0000","last_clean":"2024-09-12T01:22:09.008846+0000","last_became_active":"2024-09-12T00:35:45.928789+0000","last_became_peered":"2024-09-12T00:35:45.928789+0000","last_unstale":"2024-09-12T01:22:09.008846+0000","last_undegraded":"2024-09-12T01:22:09.008846+0000","last_fullsized":"2024-09-12T01:22:09.008846+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'372","last_scrub_stamp":"2024-09-12T01:22:09.008671+0000","last_deep_scrub":"265'372","last_deep_scrub_stamp":"2024-09-12T01:22:09.008671+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.008671+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:49.407471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1634,"num_read_kb":1297,"num_write":639,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'367","reported_seq":1053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.642660+0000","last_change":"2024-09-12T01:22:05.642522+0000","last_active":"2024-09-12T01:22:05.642660+0000","last_peered":"2024-09-12T01:22:05.642660+0000","last_clean":"2024-09-12T01:22:05.642660+0000","last_became_active":"2024-09-12T00:35:43.932994+0000","last_became_peered":"2024-09-12T00:35:43.932994+0000","last_unstale":"2024-09-12T01:22:05.642660+0000","last_undegraded":"2024-09-12T01:22:05.642660+0000","last_fullsized":"2024-09-12T01:22:05.642660+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T01:22:05.642296+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T01:22:05.642296+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.642296+0000","objects_scrubbed":7,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:09.276375+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":624,"num_read_kb":1635,"num_write":1170,"num_write_kb":36329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.086998+0000","last_change":"2024-09-12T01:22:05.086834+0000","last_active":"2024-09-12T01:22:05.086998+0000","last_peered":"2024-09-12T01:22:05.086998+0000","last_clean":"2024-09-12T01:22:05.086998+0000","last_became_active":"2024-09-12T00:35:29.670571+0000","last_became_peered":"2024-09-12T00:35:29.670571+0000","last_unstale":"2024-09-12T01:22:05.086998+0000","last_undegraded":"2024-09-12T01:22:05.086998+0000","last_fullsized":"2024-09-12T01:22:05.086998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:05.086601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:05.086601+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.086601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:50.763843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012596770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:24.551946+0000","last_change":"2024-09-12T01:22:24.551946+0000","last_active":"2024-09-12T01:22:24.551946+0000","last_peered":"2024-09-12T01:22:24.551946+0000","last_clean":"2024-09-12T01:22:24.551946+0000","last_became_active":"2024-09-12T00:35:47.933798+0000","last_became_peered":"2024-09-12T00:35:47.933798+0000","last_unstale":"2024-09-12T01:22:24.551946+0000","last_undegraded":"2024-09-12T01:22:24.551946+0000","last_fullsized":"2024-09-12T01:22:24.551946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:24.551752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:24.551752+0000","last_clean_scrub_stamp":"2024-09-12T01:22:24.551752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:04.069854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'731","reported_seq":1463,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:26.328699+0000","last_change":"2024-09-12T01:22:26.328699+0000","last_active":"2024-09-12T01:22:26.328699+0000","last_peered":"2024-09-12T01:22:26.328699+0000","last_clean":"2024-09-12T01:22:26.328699+0000","last_became_active":"2024-09-12T00:35:50.028341+0000","last_became_peered":"2024-09-12T00:35:50.028341+0000","last_unstale":"2024-09-12T01:22:26.328699+0000","last_undegraded":"2024-09-12T01:22:26.328699+0000","last_fullsized":"2024-09-12T01:22:26.328699+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'731","last_scrub_stamp":"2024-09-12T01:22:26.328474+0000","last_deep_scrub":"265'731","last_deep_scrub_stamp":"2024-09-12T01:22:26.328474+0000","last_clean_scrub_stamp":"2024-09-12T01:22:26.328474+0000","objects_scrubbed":9,"log_size":31,"log_dups_size":700,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:51.278555+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139080,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1312,"num_read_kb":3096,"num_write":1068,"num_write_kb":883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:35.628105+0000","last_change":"2024-09-12T01:22:35.628105+0000","last_active":"2024-09-12T01:22:35.628105+0000","last_peered":"2024-09-12T01:22:35.628105+0000","last_clean":"2024-09-12T01:22:35.628105+0000","last_became_active":"2024-09-12T00:35:51.974473+0000","last_became_peered":"2024-09-12T00:35:51.974473+0000","last_unstale":"2024-09-12T01:22:35.628105+0000","last_undegraded":"2024-09-12T01:22:35.628105+0000","last_fullsized":"2024-09-12T01:22:35.628105+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:35.627930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:35.627930+0000","last_clean_scrub_stamp":"2024-09-12T01:22:35.627930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:26.729104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'110","reported_seq":621,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:38.553012+0000","last_change":"2024-09-12T01:22:38.552872+0000","last_active":"2024-09-12T01:22:38.553012+0000","last_peered":"2024-09-12T01:22:38.553012+0000","last_clean":"2024-09-12T01:22:38.553012+0000","last_became_active":"2024-09-12T00:35:53.995431+0000","last_became_peered":"2024-09-12T00:35:53.995431+0000","last_unstale":"2024-09-12T01:22:38.553012+0000","last_undegraded":"2024-09-12T01:22:38.553012+0000","last_fullsized":"2024-09-12T01:22:38.553012+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'110","last_scrub_stamp":"2024-09-12T01:22:38.552693+0000","last_deep_scrub":"265'110","last_deep_scrub_stamp":"2024-09-12T01:22:38.552693+0000","last_clean_scrub_stamp":"2024-09-12T01:22:38.552693+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:36.943299+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":133,"num_write":267,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'117","reported_seq":675,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:38.458955+0000","last_change":"2024-09-12T01:22:38.458955+0000","last_active":"2024-09-12T01:22:38.458955+0000","last_peered":"2024-09-12T01:22:38.458955+0000","last_clean":"2024-09-12T01:22:38.458955+0000","last_became_active":"2024-09-12T00:35:54.002052+0000","last_became_peered":"2024-09-12T00:35:54.002052+0000","last_unstale":"2024-09-12T01:22:38.458955+0000","last_undegraded":"2024-09-12T01:22:38.458955+0000","last_fullsized":"2024-09-12T01:22:38.458955+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'117","last_scrub_stamp":"2024-09-12T01:22:38.458747+0000","last_deep_scrub":"265'117","last_deep_scrub_stamp":"2024-09-12T01:22:38.458747+0000","last_clean_scrub_stamp":"2024-09-12T01:22:38.458747+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:01.695518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":193,"num_write":267,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'96","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.014091+0000","last_change":"2024-09-12T01:22:14.013931+0000","last_active":"2024-09-12T01:22:14.014091+0000","last_peered":"2024-09-12T01:22:14.014091+0000","last_clean":"2024-09-12T01:22:14.014091+0000","last_became_active":"2024-09-12T00:35:45.954079+0000","last_became_peered":"2024-09-12T00:35:45.954079+0000","last_unstale":"2024-09-12T01:22:14.014091+0000","last_undegraded":"2024-09-12T01:22:14.014091+0000","last_fullsized":"2024-09-12T01:22:14.014091+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'96","last_scrub_stamp":"2024-09-12T01:22:14.013751+0000","last_deep_scrub":"265'96","last_deep_scrub_stamp":"2024-09-12T01:22:14.013751+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.013751+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:36.327183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":455,"num_read_kb":391,"num_write":154,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'442","reported_seq":1149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.033389+0000","last_change":"2024-09-12T01:22:07.033238+0000","last_active":"2024-09-12T01:22:07.033389+0000","last_peered":"2024-09-12T01:22:07.033389+0000","last_clean":"2024-09-12T01:22:07.033389+0000","last_became_active":"2024-09-12T00:35:43.947940+0000","last_became_peered":"2024-09-12T00:35:43.947940+0000","last_unstale":"2024-09-12T01:22:07.033389+0000","last_undegraded":"2024-09-12T01:22:07.033389+0000","last_fullsized":"2024-09-12T01:22:07.033389+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'442","last_scrub_stamp":"2024-09-12T01:22:07.032998+0000","last_deep_scrub":"265'442","last_deep_scrub_stamp":"2024-09-12T01:22:07.032998+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.032998+0000","objects_scrubbed":7,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:14.761183+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":799,"num_read_kb":4159,"num_write":1267,"num_write_kb":17308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.199735+0000","last_change":"2024-09-12T01:22:22.199456+0000","last_active":"2024-09-12T01:22:22.199735+0000","last_peered":"2024-09-12T01:22:22.199735+0000","last_clean":"2024-09-12T01:22:22.199735+0000","last_became_active":"2024-09-12T00:35:47.929844+0000","last_became_peered":"2024-09-12T00:35:47.929844+0000","last_unstale":"2024-09-12T01:22:22.199735+0000","last_undegraded":"2024-09-12T01:22:22.199735+0000","last_fullsized":"2024-09-12T01:22:22.199735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:22.199245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:22.199245+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.199245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:59.906791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'293","reported_seq":878,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:31.567824+0000","last_change":"2024-09-12T01:22:31.567655+0000","last_active":"2024-09-12T01:22:31.567824+0000","last_peered":"2024-09-12T01:22:31.567824+0000","last_clean":"2024-09-12T01:22:31.567824+0000","last_became_active":"2024-09-12T00:35:49.947136+0000","last_became_peered":"2024-09-12T00:35:49.947136+0000","last_unstale":"2024-09-12T01:22:31.567824+0000","last_undegraded":"2024-09-12T01:22:31.567824+0000","last_fullsized":"2024-09-12T01:22:31.567824+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'293","last_scrub_stamp":"2024-09-12T01:22:31.567462+0000","last_deep_scrub":"265'293","last_deep_scrub_stamp":"2024-09-12T01:22:31.567462+0000","last_clean_scrub_stamp":"2024-09-12T01:22:31.567462+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:50.917955+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43778,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":475,"num_read_kb":1081,"num_write":388,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:37.663678+0000","last_change":"2024-09-12T01:22:37.663678+0000","last_active":"2024-09-12T01:22:37.663678+0000","last_peered":"2024-09-12T01:22:37.663678+0000","last_clean":"2024-09-12T01:22:37.663678+0000","last_became_active":"2024-09-12T00:35:51.980092+0000","last_became_peered":"2024-09-12T00:35:51.980092+0000","last_unstale":"2024-09-12T01:22:37.663678+0000","last_undegraded":"2024-09-12T01:22:37.663678+0000","last_fullsized":"2024-09-12T01:22:37.663678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:37.663482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:37.663482+0000","last_clean_scrub_stamp":"2024-09-12T01:22:37.663482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:26.318770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'134","reported_seq":642,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:45.701951+0000","last_change":"2024-09-12T01:22:45.701951+0000","last_active":"2024-09-12T01:22:45.701951+0000","last_peered":"2024-09-12T01:22:45.701951+0000","last_clean":"2024-09-12T01:22:45.701951+0000","last_became_active":"2024-09-12T00:35:53.992579+0000","last_became_peered":"2024-09-12T00:35:53.992579+0000","last_unstale":"2024-09-12T01:22:45.701951+0000","last_undegraded":"2024-09-12T01:22:45.701951+0000","last_fullsized":"2024-09-12T01:22:45.701951+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'134","last_scrub_stamp":"2024-09-12T01:22:45.701762+0000","last_deep_scrub":"265'134","last_deep_scrub_stamp":"2024-09-12T01:22:45.701762+0000","last_clean_scrub_stamp":"2024-09-12T01:22:45.701762+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:53.241636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":139,"num_write":341,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'161","reported_seq":754,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.226485+0000","last_change":"2024-09-12T01:22:16.226327+0000","last_active":"2024-09-12T01:22:16.226485+0000","last_peered":"2024-09-12T01:22:16.226485+0000","last_clean":"2024-09-12T01:22:16.226485+0000","last_became_active":"2024-09-12T00:35:45.957614+0000","last_became_peered":"2024-09-12T00:35:45.957614+0000","last_unstale":"2024-09-12T01:22:16.226485+0000","last_undegraded":"2024-09-12T01:22:16.226485+0000","last_fullsized":"2024-09-12T01:22:16.226485+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'161","last_scrub_stamp":"2024-09-12T01:22:16.226150+0000","last_deep_scrub":"265'161","last_deep_scrub_stamp":"2024-09-12T01:22:16.226150+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.226150+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:34.804768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":661,"num_read_kb":539,"num_write":259,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'367","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.238457+0000","last_change":"2024-09-12T01:22:06.238323+0000","last_active":"2024-09-12T01:22:06.238457+0000","last_peered":"2024-09-12T01:22:06.238457+0000","last_clean":"2024-09-12T01:22:06.238457+0000","last_became_active":"2024-09-12T00:36:17.269377+0000","last_became_peered":"2024-09-12T00:36:17.269377+0000","last_unstale":"2024-09-12T01:22:06.238457+0000","last_undegraded":"2024-09-12T01:22:06.238457+0000","last_fullsized":"2024-09-12T01:22:06.238457+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T01:22:06.238069+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T01:22:06.238069+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.238069+0000","objects_scrubbed":8,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:52.160763+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":513,"num_read_kb":25436,"num_write":1264,"num_write_kb":33386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:25.513194+0000","last_change":"2024-09-12T01:22:25.512967+0000","last_active":"2024-09-12T01:22:25.513194+0000","last_peered":"2024-09-12T01:22:25.513194+0000","last_clean":"2024-09-12T01:22:25.513194+0000","last_became_active":"2024-09-12T00:35:47.941493+0000","last_became_peered":"2024-09-12T00:35:47.941493+0000","last_unstale":"2024-09-12T01:22:25.513194+0000","last_undegraded":"2024-09-12T01:22:25.513194+0000","last_fullsized":"2024-09-12T01:22:25.513194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:25.512683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:25.512683+0000","last_clean_scrub_stamp":"2024-09-12T01:22:25.512683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:08.462610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'49","reported_seq":554,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:28.434070+0000","last_change":"2024-09-12T01:22:28.433811+0000","last_active":"2024-09-12T01:22:28.434070+0000","last_peered":"2024-09-12T01:22:28.434070+0000","last_clean":"2024-09-12T01:22:28.434070+0000","last_became_active":"2024-09-12T00:35:49.949331+0000","last_became_peered":"2024-09-12T00:35:49.949331+0000","last_unstale":"2024-09-12T01:22:28.434070+0000","last_undegraded":"2024-09-12T01:22:28.434070+0000","last_fullsized":"2024-09-12T01:22:28.434070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'49","last_scrub_stamp":"2024-09-12T01:22:28.433586+0000","last_deep_scrub":"265'49","last_deep_scrub_stamp":"2024-09-12T01:22:28.433586+0000","last_clean_scrub_stamp":"2024-09-12T01:22:28.433586+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:36.448449+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:31.424851+0000","last_change":"2024-09-12T01:22:31.424654+0000","last_active":"2024-09-12T01:22:31.424851+0000","last_peered":"2024-09-12T01:22:31.424851+0000","last_clean":"2024-09-12T01:22:31.424851+0000","last_became_active":"2024-09-12T00:35:51.977211+0000","last_became_peered":"2024-09-12T00:35:51.977211+0000","last_unstale":"2024-09-12T01:22:31.424851+0000","last_undegraded":"2024-09-12T01:22:31.424851+0000","last_fullsized":"2024-09-12T01:22:31.424851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:31.424473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:31.424473+0000","last_clean_scrub_stamp":"2024-09-12T01:22:31.424473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:12.683310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'215","reported_seq":734,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:36.499140+0000","last_change":"2024-09-12T01:22:36.498896+0000","last_active":"2024-09-12T01:22:36.499140+0000","last_peered":"2024-09-12T01:22:36.499140+0000","last_clean":"2024-09-12T01:22:36.499140+0000","last_became_active":"2024-09-12T00:35:53.985696+0000","last_became_peered":"2024-09-12T00:35:53.985696+0000","last_unstale":"2024-09-12T01:22:36.499140+0000","last_undegraded":"2024-09-12T01:22:36.499140+0000","last_fullsized":"2024-09-12T01:22:36.499140+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'215","last_scrub_stamp":"2024-09-12T01:22:36.498588+0000","last_deep_scrub":"265'215","last_deep_scrub_stamp":"2024-09-12T01:22:36.498588+0000","last_clean_scrub_stamp":"2024-09-12T01:22:36.498588+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:50.703674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":288,"num_read_kb":283,"num_write":478,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'116","reported_seq":729,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.632662+0000","last_change":"2024-09-12T01:22:16.632479+0000","last_active":"2024-09-12T01:22:16.632662+0000","last_peered":"2024-09-12T01:22:16.632662+0000","last_clean":"2024-09-12T01:22:16.632662+0000","last_became_active":"2024-09-12T00:35:45.942161+0000","last_became_peered":"2024-09-12T00:35:45.942161+0000","last_unstale":"2024-09-12T01:22:16.632662+0000","last_undegraded":"2024-09-12T01:22:16.632662+0000","last_fullsized":"2024-09-12T01:22:16.632662+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'116","last_scrub_stamp":"2024-09-12T01:22:16.632298+0000","last_deep_scrub":"265'116","last_deep_scrub_stamp":"2024-09-12T01:22:16.632298+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.632298+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:43.861761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":566,"num_read_kb":479,"num_write":187,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'295","reported_seq":903,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.806007+0000","last_change":"2024-09-12T01:22:06.806007+0000","last_active":"2024-09-12T01:22:06.806007+0000","last_peered":"2024-09-12T01:22:06.806007+0000","last_clean":"2024-09-12T01:22:06.806007+0000","last_became_active":"2024-09-12T00:35:43.950660+0000","last_became_peered":"2024-09-12T00:35:43.950660+0000","last_unstale":"2024-09-12T01:22:06.806007+0000","last_undegraded":"2024-09-12T01:22:06.806007+0000","last_fullsized":"2024-09-12T01:22:06.806007+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'295","last_scrub_stamp":"2024-09-12T01:22:06.805784+0000","last_deep_scrub":"265'295","last_deep_scrub_stamp":"2024-09-12T01:22:06.805784+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.805784+0000","objects_scrubbed":6,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:35.026312+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110814,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":386,"num_read_kb":2177,"num_write":879,"num_write_kb":8684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:24.345750+0000","last_change":"2024-09-12T01:22:24.345499+0000","last_active":"2024-09-12T01:22:24.345750+0000","last_peered":"2024-09-12T01:22:24.345750+0000","last_clean":"2024-09-12T01:22:24.345750+0000","last_became_active":"2024-09-12T00:35:47.945819+0000","last_became_peered":"2024-09-12T00:35:47.945819+0000","last_unstale":"2024-09-12T01:22:24.345750+0000","last_undegraded":"2024-09-12T01:22:24.345750+0000","last_fullsized":"2024-09-12T01:22:24.345750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:24.345289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:24.345289+0000","last_clean_scrub_stamp":"2024-09-12T01:22:24.345289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:11.155693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'353","reported_seq":948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:32.576801+0000","last_change":"2024-09-12T01:22:32.576642+0000","last_active":"2024-09-12T01:22:32.576801+0000","last_peered":"2024-09-12T01:22:32.576801+0000","last_clean":"2024-09-12T01:22:32.576801+0000","last_became_active":"2024-09-12T00:35:49.954646+0000","last_became_peered":"2024-09-12T00:35:49.954646+0000","last_unstale":"2024-09-12T01:22:32.576801+0000","last_undegraded":"2024-09-12T01:22:32.576801+0000","last_fullsized":"2024-09-12T01:22:32.576801+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'353","last_scrub_stamp":"2024-09-12T01:22:32.576449+0000","last_deep_scrub":"265'353","last_deep_scrub_stamp":"2024-09-12T01:22:32.576449+0000","last_clean_scrub_stamp":"2024-09-12T01:22:32.576449+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:35.618352+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66883,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":574,"num_read_kb":1344,"num_write":472,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:23.056635+0000","last_change":"2024-09-12T01:22:23.056469+0000","last_active":"2024-09-12T01:22:23.056635+0000","last_peered":"2024-09-12T01:22:23.056635+0000","last_clean":"2024-09-12T01:22:23.056635+0000","last_became_active":"2024-09-12T00:35:51.973993+0000","last_became_peered":"2024-09-12T00:35:51.973993+0000","last_unstale":"2024-09-12T01:22:23.056635+0000","last_undegraded":"2024-09-12T01:22:23.056635+0000","last_fullsized":"2024-09-12T01:22:23.056635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:23.056293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:23.056293+0000","last_clean_scrub_stamp":"2024-09-12T01:22:23.056293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:08.652989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'105","reported_seq":620,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:40.570695+0000","last_change":"2024-09-12T01:22:40.570482+0000","last_active":"2024-09-12T01:22:40.570695+0000","last_peered":"2024-09-12T01:22:40.570695+0000","last_clean":"2024-09-12T01:22:40.570695+0000","last_became_active":"2024-09-12T00:35:54.001337+0000","last_became_peered":"2024-09-12T00:35:54.001337+0000","last_unstale":"2024-09-12T01:22:40.570695+0000","last_undegraded":"2024-09-12T01:22:40.570695+0000","last_fullsized":"2024-09-12T01:22:40.570695+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'105","last_scrub_stamp":"2024-09-12T01:22:40.570295+0000","last_deep_scrub":"265'105","last_deep_scrub_stamp":"2024-09-12T01:22:40.570295+0000","last_clean_scrub_stamp":"2024-09-12T01:22:40.570295+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:19.687708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":126,"num_write":245,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'4114","reported_seq":4744,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.616911+0000","last_change":"2024-09-12T01:22:14.616655+0000","last_active":"2024-09-12T01:22:14.616911+0000","last_peered":"2024-09-12T01:22:14.616911+0000","last_clean":"2024-09-12T01:22:14.616911+0000","last_became_active":"2024-09-12T00:35:45.938175+0000","last_became_peered":"2024-09-12T00:35:45.938175+0000","last_unstale":"2024-09-12T01:22:14.616911+0000","last_undegraded":"2024-09-12T01:22:14.616911+0000","last_fullsized":"2024-09-12T01:22:14.616911+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4114","last_scrub_stamp":"2024-09-12T01:22:14.616416+0000","last_deep_scrub":"265'4114","last_deep_scrub_stamp":"2024-09-12T01:22:14.616416+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.616416+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":3000,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:57.910210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16557,"num_read_kb":13901,"num_write":6164,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'313","reported_seq":924,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.637162+0000","last_change":"2024-09-12T01:22:06.637162+0000","last_active":"2024-09-12T01:22:06.637162+0000","last_peered":"2024-09-12T01:22:06.637162+0000","last_clean":"2024-09-12T01:22:06.637162+0000","last_became_active":"2024-09-12T00:35:43.935194+0000","last_became_peered":"2024-09-12T00:35:43.935194+0000","last_unstale":"2024-09-12T01:22:06.637162+0000","last_undegraded":"2024-09-12T01:22:06.637162+0000","last_fullsized":"2024-09-12T01:22:06.637162+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'313","last_scrub_stamp":"2024-09-12T01:22:06.636919+0000","last_deep_scrub":"265'313","last_deep_scrub_stamp":"2024-09-12T01:22:06.636919+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.636919+0000","objects_scrubbed":8,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:10.162623+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992287,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":416,"num_read_kb":10375,"num_write":976,"num_write_kb":15779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.098190+0000","last_change":"2024-09-12T01:22:19.097959+0000","last_active":"2024-09-12T01:22:19.098190+0000","last_peered":"2024-09-12T01:22:19.098190+0000","last_clean":"2024-09-12T01:22:19.098190+0000","last_became_active":"2024-09-12T00:35:47.944477+0000","last_became_peered":"2024-09-12T00:35:47.944477+0000","last_unstale":"2024-09-12T01:22:19.098190+0000","last_undegraded":"2024-09-12T01:22:19.098190+0000","last_fullsized":"2024-09-12T01:22:19.098190+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:19.097750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:19.097750+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.097750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:03.784360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'278","reported_seq":854,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:29.360131+0000","last_change":"2024-09-12T01:22:29.359974+0000","last_active":"2024-09-12T01:22:29.360131+0000","last_peered":"2024-09-12T01:22:29.360131+0000","last_clean":"2024-09-12T01:22:29.360131+0000","last_became_active":"2024-09-12T00:35:49.941948+0000","last_became_peered":"2024-09-12T00:35:49.941948+0000","last_unstale":"2024-09-12T01:22:29.360131+0000","last_undegraded":"2024-09-12T01:22:29.360131+0000","last_fullsized":"2024-09-12T01:22:29.360131+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'278","last_scrub_stamp":"2024-09-12T01:22:29.359800+0000","last_deep_scrub":"265'278","last_deep_scrub_stamp":"2024-09-12T01:22:29.359800+0000","last_clean_scrub_stamp":"2024-09-12T01:22:29.359800+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:28.047217+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45730,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":1073,"num_write":372,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:39.410275+0000","last_change":"2024-09-12T01:22:39.410275+0000","last_active":"2024-09-12T01:22:39.410275+0000","last_peered":"2024-09-12T01:22:39.410275+0000","last_clean":"2024-09-12T01:22:39.410275+0000","last_became_active":"2024-09-12T00:35:51.975124+0000","last_became_peered":"2024-09-12T00:35:51.975124+0000","last_unstale":"2024-09-12T01:22:39.410275+0000","last_undegraded":"2024-09-12T01:22:39.410275+0000","last_fullsized":"2024-09-12T01:22:39.410275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:39.410096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:39.410096+0000","last_clean_scrub_stamp":"2024-09-12T01:22:39.410096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:06.295932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'251","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.166216+0000","last_change":"2024-09-12T01:22:14.166216+0000","last_active":"2024-09-12T01:22:14.166216+0000","last_peered":"2024-09-12T01:22:14.166216+0000","last_clean":"2024-09-12T01:22:14.166216+0000","last_became_active":"2024-09-12T00:35:45.941357+0000","last_became_peered":"2024-09-12T00:35:45.941357+0000","last_unstale":"2024-09-12T01:22:14.166216+0000","last_undegraded":"2024-09-12T01:22:14.166216+0000","last_fullsized":"2024-09-12T01:22:14.166216+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'251","last_scrub_stamp":"2024-09-12T01:22:14.165990+0000","last_deep_scrub":"265'251","last_deep_scrub_stamp":"2024-09-12T01:22:14.165990+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.165990+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:23.409041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1115,"num_read_kb":918,"num_write":405,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'305","reported_seq":932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.627274+0000","last_change":"2024-09-12T01:22:08.627274+0000","last_active":"2024-09-12T01:22:08.627274+0000","last_peered":"2024-09-12T01:22:08.627274+0000","last_clean":"2024-09-12T01:22:08.627274+0000","last_became_active":"2024-09-12T00:35:43.933037+0000","last_became_peered":"2024-09-12T00:35:43.933037+0000","last_unstale":"2024-09-12T01:22:08.627274+0000","last_undegraded":"2024-09-12T01:22:08.627274+0000","last_fullsized":"2024-09-12T01:22:08.627274+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'305","last_scrub_stamp":"2024-09-12T01:22:08.627056+0000","last_deep_scrub":"265'305","last_deep_scrub_stamp":"2024-09-12T01:22:08.627056+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.627056+0000","objects_scrubbed":9,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:16.887003+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730132,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":468,"num_read_kb":7309,"num_write":980,"num_write_kb":23054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"265'4","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.489438+0000","last_change":"2024-09-12T01:22:22.489438+0000","last_active":"2024-09-12T01:22:22.489438+0000","last_peered":"2024-09-12T01:22:22.489438+0000","last_clean":"2024-09-12T01:22:22.489438+0000","last_became_active":"2024-09-12T00:35:47.941749+0000","last_became_peered":"2024-09-12T00:35:47.941749+0000","last_unstale":"2024-09-12T01:22:22.489438+0000","last_undegraded":"2024-09-12T01:22:22.489438+0000","last_fullsized":"2024-09-12T01:22:22.489438+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T01:22:22.489259+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T01:22:22.489259+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.489259+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:29.570374+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'511","reported_seq":1151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:25.222545+0000","last_change":"2024-09-12T01:22:25.222400+0000","last_active":"2024-09-12T01:22:25.222545+0000","last_peered":"2024-09-12T01:22:25.222545+0000","last_clean":"2024-09-12T01:22:25.222545+0000","last_became_active":"2024-09-12T00:35:49.947963+0000","last_became_peered":"2024-09-12T00:35:49.947963+0000","last_unstale":"2024-09-12T01:22:25.222545+0000","last_undegraded":"2024-09-12T01:22:25.222545+0000","last_fullsized":"2024-09-12T01:22:25.222545+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'511","last_scrub_stamp":"2024-09-12T01:22:25.222213+0000","last_deep_scrub":"265'511","last_deep_scrub_stamp":"2024-09-12T01:22:25.222213+0000","last_clean_scrub_stamp":"2024-09-12T01:22:25.222213+0000","objects_scrubbed":7,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:10.494053+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95771,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":915,"num_read_kb":2195,"num_write":792,"num_write_kb":711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:34.608873+0000","last_change":"2024-09-12T01:22:34.608743+0000","last_active":"2024-09-12T01:22:34.608873+0000","last_peered":"2024-09-12T01:22:34.608873+0000","last_clean":"2024-09-12T01:22:34.608873+0000","last_became_active":"2024-09-12T00:35:51.968209+0000","last_became_peered":"2024-09-12T00:35:51.968209+0000","last_unstale":"2024-09-12T01:22:34.608873+0000","last_undegraded":"2024-09-12T01:22:34.608873+0000","last_fullsized":"2024-09-12T01:22:34.608873+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:34.608572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:34.608572+0000","last_clean_scrub_stamp":"2024-09-12T01:22:34.608572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:49.342386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'162","reported_seq":666,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:43.708300+0000","last_change":"2024-09-12T01:22:43.708300+0000","last_active":"2024-09-12T01:22:43.708300+0000","last_peered":"2024-09-12T01:22:43.708300+0000","last_clean":"2024-09-12T01:22:43.708300+0000","last_became_active":"2024-09-12T00:35:54.012958+0000","last_became_peered":"2024-09-12T00:35:54.012958+0000","last_unstale":"2024-09-12T01:22:43.708300+0000","last_undegraded":"2024-09-12T01:22:43.708300+0000","last_fullsized":"2024-09-12T01:22:43.708300+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'162","last_scrub_stamp":"2024-09-12T01:22:43.708111+0000","last_deep_scrub":"265'162","last_deep_scrub_stamp":"2024-09-12T01:22:43.708111+0000","last_clean_scrub_stamp":"2024-09-12T01:22:43.708111+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:19.855855+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1092,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":166,"num_read_kb":178,"num_write":351,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'60","reported_seq":622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.501893+0000","last_change":"2024-09-12T01:22:19.501893+0000","last_active":"2024-09-12T01:22:19.501893+0000","last_peered":"2024-09-12T01:22:19.501893+0000","last_clean":"2024-09-12T01:22:19.501893+0000","last_became_active":"2024-09-12T00:35:45.945952+0000","last_became_peered":"2024-09-12T00:35:45.945952+0000","last_unstale":"2024-09-12T01:22:19.501893+0000","last_undegraded":"2024-09-12T01:22:19.501893+0000","last_fullsized":"2024-09-12T01:22:19.501893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'60","last_scrub_stamp":"2024-09-12T01:22:19.501688+0000","last_deep_scrub":"265'60","last_deep_scrub_stamp":"2024-09-12T01:22:19.501688+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.501688+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:13.144748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":234,"num_write":86,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'360","reported_seq":1024,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.256391+0000","last_change":"2024-09-12T01:22:08.256391+0000","last_active":"2024-09-12T01:22:08.256391+0000","last_peered":"2024-09-12T01:22:08.256391+0000","last_clean":"2024-09-12T01:22:08.256391+0000","last_became_active":"2024-09-12T00:35:43.928779+0000","last_became_peered":"2024-09-12T00:35:43.928779+0000","last_unstale":"2024-09-12T01:22:08.256391+0000","last_undegraded":"2024-09-12T01:22:08.256391+0000","last_fullsized":"2024-09-12T01:22:08.256391+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'360","last_scrub_stamp":"2024-09-12T01:22:08.256185+0000","last_deep_scrub":"265'360","last_deep_scrub_stamp":"2024-09-12T01:22:08.256185+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.256185+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:19.743658+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":507,"num_read_kb":67515,"num_write":1156,"num_write_kb":41697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.071518+0000","last_change":"2024-09-12T01:22:18.071518+0000","last_active":"2024-09-12T01:22:18.071518+0000","last_peered":"2024-09-12T01:22:18.071518+0000","last_clean":"2024-09-12T01:22:18.071518+0000","last_became_active":"2024-09-12T00:35:47.944056+0000","last_became_peered":"2024-09-12T00:35:47.944056+0000","last_unstale":"2024-09-12T01:22:18.071518+0000","last_undegraded":"2024-09-12T01:22:18.071518+0000","last_fullsized":"2024-09-12T01:22:18.071518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:18.071303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:18.071303+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.071303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:52.172452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'278","reported_seq":867,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:30.395165+0000","last_change":"2024-09-12T01:22:30.395019+0000","last_active":"2024-09-12T01:22:30.395165+0000","last_peered":"2024-09-12T01:22:30.395165+0000","last_clean":"2024-09-12T01:22:30.395165+0000","last_became_active":"2024-09-12T00:35:49.946226+0000","last_became_peered":"2024-09-12T00:35:49.946226+0000","last_unstale":"2024-09-12T01:22:30.395165+0000","last_undegraded":"2024-09-12T01:22:30.395165+0000","last_fullsized":"2024-09-12T01:22:30.395165+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'278","last_scrub_stamp":"2024-09-12T01:22:30.394752+0000","last_deep_scrub":"265'278","last_deep_scrub_stamp":"2024-09-12T01:22:30.394752+0000","last_clean_scrub_stamp":"2024-09-12T01:22:30.394752+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:13.222756+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48166,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":461,"num_read_kb":978,"num_write":376,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:29.229297+0000","last_change":"2024-09-12T01:22:29.229069+0000","last_active":"2024-09-12T01:22:29.229297+0000","last_peered":"2024-09-12T01:22:29.229297+0000","last_clean":"2024-09-12T01:22:29.229297+0000","last_became_active":"2024-09-12T00:35:51.963735+0000","last_became_peered":"2024-09-12T00:35:51.963735+0000","last_unstale":"2024-09-12T01:22:29.229297+0000","last_undegraded":"2024-09-12T01:22:29.229297+0000","last_fullsized":"2024-09-12T01:22:29.229297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:29.228872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:29.228872+0000","last_clean_scrub_stamp":"2024-09-12T01:22:29.228872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:08.991987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'202","reported_seq":717,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:29.088205+0000","last_change":"2024-09-12T01:22:29.087918+0000","last_active":"2024-09-12T01:22:29.088205+0000","last_peered":"2024-09-12T01:22:29.088205+0000","last_clean":"2024-09-12T01:22:29.088205+0000","last_became_active":"2024-09-12T00:35:53.990488+0000","last_became_peered":"2024-09-12T00:35:53.990488+0000","last_unstale":"2024-09-12T01:22:29.088205+0000","last_undegraded":"2024-09-12T01:22:29.088205+0000","last_fullsized":"2024-09-12T01:22:29.088205+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'202","last_scrub_stamp":"2024-09-12T01:22:29.087658+0000","last_deep_scrub":"265'202","last_deep_scrub_stamp":"2024-09-12T01:22:29.087658+0000","last_clean_scrub_stamp":"2024-09-12T01:22:29.087658+0000","objects_scrubbed":6,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:44.322341+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1821,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":235,"num_read_kb":229,"num_write":573,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'191","reported_seq":797,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.619761+0000","last_change":"2024-09-12T01:22:21.619589+0000","last_active":"2024-09-12T01:22:21.619761+0000","last_peered":"2024-09-12T01:22:21.619761+0000","last_clean":"2024-09-12T01:22:21.619761+0000","last_became_active":"2024-09-12T00:35:45.940529+0000","last_became_peered":"2024-09-12T00:35:45.940529+0000","last_unstale":"2024-09-12T01:22:21.619761+0000","last_undegraded":"2024-09-12T01:22:21.619761+0000","last_fullsized":"2024-09-12T01:22:21.619761+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'191","last_scrub_stamp":"2024-09-12T01:22:21.619383+0000","last_deep_scrub":"265'191","last_deep_scrub_stamp":"2024-09-12T01:22:21.619383+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.619383+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:56.738297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":840,"num_read_kb":692,"num_write":286,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'348","reported_seq":1111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:06.077113+0000","last_change":"2024-09-12T01:22:06.076975+0000","last_active":"2024-09-12T01:22:06.077113+0000","last_peered":"2024-09-12T01:22:06.077113+0000","last_clean":"2024-09-12T01:22:06.077113+0000","last_became_active":"2024-09-12T00:35:43.927426+0000","last_became_peered":"2024-09-12T00:35:43.927426+0000","last_unstale":"2024-09-12T01:22:06.077113+0000","last_undegraded":"2024-09-12T01:22:06.077113+0000","last_fullsized":"2024-09-12T01:22:06.077113+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-12T01:22:06.076783+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-12T01:22:06.076783+0000","last_clean_scrub_stamp":"2024-09-12T01:22:06.076783+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:53.298954+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":824,"num_read_kb":46781,"num_write":1113,"num_write_kb":16393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:27.899401+0000","last_change":"2024-09-12T01:22:27.899248+0000","last_active":"2024-09-12T01:22:27.899401+0000","last_peered":"2024-09-12T01:22:27.899401+0000","last_clean":"2024-09-12T01:22:27.899401+0000","last_became_active":"2024-09-12T00:35:47.933189+0000","last_became_peered":"2024-09-12T00:35:47.933189+0000","last_unstale":"2024-09-12T01:22:27.899401+0000","last_undegraded":"2024-09-12T01:22:27.899401+0000","last_fullsized":"2024-09-12T01:22:27.899401+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:27.899074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:27.899074+0000","last_clean_scrub_stamp":"2024-09-12T01:22:27.899074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:10.975721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'290","reported_seq":877,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:34.612507+0000","last_change":"2024-09-12T01:22:34.612507+0000","last_active":"2024-09-12T01:22:34.612507+0000","last_peered":"2024-09-12T01:22:34.612507+0000","last_clean":"2024-09-12T01:22:34.612507+0000","last_became_active":"2024-09-12T00:35:50.029579+0000","last_became_peered":"2024-09-12T00:35:50.029579+0000","last_unstale":"2024-09-12T01:22:34.612507+0000","last_undegraded":"2024-09-12T01:22:34.612507+0000","last_fullsized":"2024-09-12T01:22:34.612507+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'290","last_scrub_stamp":"2024-09-12T01:22:34.612310+0000","last_deep_scrub":"265'290","last_deep_scrub_stamp":"2024-09-12T01:22:34.612310+0000","last_clean_scrub_stamp":"2024-09-12T01:22:34.612310+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:27.497705+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47233,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":1083,"num_write":390,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:27.239752+0000","last_change":"2024-09-12T01:22:27.239752+0000","last_active":"2024-09-12T01:22:27.239752+0000","last_peered":"2024-09-12T01:22:27.239752+0000","last_clean":"2024-09-12T01:22:27.239752+0000","last_became_active":"2024-09-12T00:35:51.971682+0000","last_became_peered":"2024-09-12T00:35:51.971682+0000","last_unstale":"2024-09-12T01:22:27.239752+0000","last_undegraded":"2024-09-12T01:22:27.239752+0000","last_fullsized":"2024-09-12T01:22:27.239752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:27.239567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:27.239567+0000","last_clean_scrub_stamp":"2024-09-12T01:22:27.239567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:32.246865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'105","reported_seq":605,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:37.592662+0000","last_change":"2024-09-12T01:22:37.592662+0000","last_active":"2024-09-12T01:22:37.592662+0000","last_peered":"2024-09-12T01:22:37.592662+0000","last_clean":"2024-09-12T01:22:37.592662+0000","last_became_active":"2024-09-12T00:35:53.995464+0000","last_became_peered":"2024-09-12T00:35:53.995464+0000","last_unstale":"2024-09-12T01:22:37.592662+0000","last_undegraded":"2024-09-12T01:22:37.592662+0000","last_fullsized":"2024-09-12T01:22:37.592662+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'105","last_scrub_stamp":"2024-09-12T01:22:37.592475+0000","last_deep_scrub":"265'105","last_deep_scrub_stamp":"2024-09-12T01:22:37.592475+0000","last_clean_scrub_stamp":"2024-09-12T01:22:37.592475+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:47.712231+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":101,"num_write":247,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'298","reported_seq":967,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:04.495474+0000","last_change":"2024-09-12T01:22:04.495379+0000","last_active":"2024-09-12T01:22:04.495474+0000","last_peered":"2024-09-12T01:22:04.495474+0000","last_clean":"2024-09-12T01:22:04.495474+0000","last_became_active":"2024-09-12T00:35:45.947244+0000","last_became_peered":"2024-09-12T00:35:45.947244+0000","last_unstale":"2024-09-12T01:22:04.495474+0000","last_undegraded":"2024-09-12T01:22:04.495474+0000","last_fullsized":"2024-09-12T01:22:04.495474+0000","mapping_epoch":26,"log_start":"251'200","ondisk_log_start":"251'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'298","last_scrub_stamp":"2024-09-12T01:22:04.495267+0000","last_deep_scrub":"265'298","last_deep_scrub_stamp":"2024-09-12T01:22:04.495267+0000","last_clean_scrub_stamp":"2024-09-12T01:22:04.495267+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:57.480955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1444,"num_read_kb":1250,"num_write":453,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25755,"num_omap_keys":101,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'357","reported_seq":1122,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:04.679637+0000","last_change":"2024-09-12T01:22:04.679571+0000","last_active":"2024-09-12T01:22:04.679637+0000","last_peered":"2024-09-12T01:22:04.679637+0000","last_clean":"2024-09-12T01:22:04.679637+0000","last_became_active":"2024-09-12T00:35:43.947420+0000","last_became_peered":"2024-09-12T00:35:43.947420+0000","last_unstale":"2024-09-12T01:22:04.679637+0000","last_undegraded":"2024-09-12T01:22:04.679637+0000","last_fullsized":"2024-09-12T01:22:04.679637+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'357","last_scrub_stamp":"2024-09-12T01:22:04.679464+0000","last_deep_scrub":"265'357","last_deep_scrub_stamp":"2024-09-12T01:22:04.679464+0000","last_clean_scrub_stamp":"2024-09-12T01:22:04.679464+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:02.092461+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262187,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":720,"num_read_kb":19884,"num_write":1159,"num_write_kb":29921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.244297+0000","last_change":"2024-09-12T01:22:21.244173+0000","last_active":"2024-09-12T01:22:21.244297+0000","last_peered":"2024-09-12T01:22:21.244297+0000","last_clean":"2024-09-12T01:22:21.244297+0000","last_became_active":"2024-09-12T00:35:47.935440+0000","last_became_peered":"2024-09-12T00:35:47.935440+0000","last_unstale":"2024-09-12T01:22:21.244297+0000","last_undegraded":"2024-09-12T01:22:21.244297+0000","last_fullsized":"2024-09-12T01:22:21.244297+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:21.244002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:21.244002+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.244002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:57.645912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'97","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:32.944551+0000","last_change":"2024-09-12T01:22:32.944551+0000","last_active":"2024-09-12T01:22:32.944551+0000","last_peered":"2024-09-12T01:22:32.944551+0000","last_clean":"2024-09-12T01:22:32.944551+0000","last_became_active":"2024-09-12T00:35:50.025145+0000","last_became_peered":"2024-09-12T00:35:50.025145+0000","last_unstale":"2024-09-12T01:22:32.944551+0000","last_undegraded":"2024-09-12T01:22:32.944551+0000","last_fullsized":"2024-09-12T01:22:32.944551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'97","last_scrub_stamp":"2024-09-12T01:22:32.944314+0000","last_deep_scrub":"265'97","last_deep_scrub_stamp":"2024-09-12T01:22:32.944314+0000","last_clean_scrub_stamp":"2024-09-12T01:22:32.944314+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:03.585579+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":97,"num_read_kb":88,"num_write":76,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'773","reported_seq":2399,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:26.156659+0000","last_change":"2024-09-12T01:22:26.156659+0000","last_active":"2024-09-12T01:22:26.156659+0000","last_peered":"2024-09-12T01:22:26.156659+0000","last_clean":"2024-09-12T01:22:26.156659+0000","last_became_active":"2024-09-12T00:35:51.967797+0000","last_became_peered":"2024-09-12T00:35:51.967797+0000","last_unstale":"2024-09-12T01:22:26.156659+0000","last_undegraded":"2024-09-12T01:22:26.156659+0000","last_fullsized":"2024-09-12T01:22:26.156659+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'773","last_scrub_stamp":"2024-09-12T01:22:26.156438+0000","last_deep_scrub":"265'773","last_deep_scrub_stamp":"2024-09-12T01:22:26.156438+0000","last_clean_scrub_stamp":"2024-09-12T01:22:26.156438+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:20.370270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'103","reported_seq":612,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:36.458506+0000","last_change":"2024-09-12T01:22:36.458366+0000","last_active":"2024-09-12T01:22:36.458506+0000","last_peered":"2024-09-12T01:22:36.458506+0000","last_clean":"2024-09-12T01:22:36.458506+0000","last_became_active":"2024-09-12T00:35:54.002318+0000","last_became_peered":"2024-09-12T00:35:54.002318+0000","last_unstale":"2024-09-12T01:22:36.458506+0000","last_undegraded":"2024-09-12T01:22:36.458506+0000","last_fullsized":"2024-09-12T01:22:36.458506+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'103","last_scrub_stamp":"2024-09-12T01:22:36.458187+0000","last_deep_scrub":"265'103","last_deep_scrub_stamp":"2024-09-12T01:22:36.458187+0000","last_clean_scrub_stamp":"2024-09-12T01:22:36.458187+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:43.305634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":119,"num_write":243,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'135","reported_seq":749,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.027491+0000","last_change":"2024-09-12T01:22:16.027357+0000","last_active":"2024-09-12T01:22:16.027491+0000","last_peered":"2024-09-12T01:22:16.027491+0000","last_clean":"2024-09-12T01:22:16.027491+0000","last_became_active":"2024-09-12T00:35:45.935880+0000","last_became_peered":"2024-09-12T00:35:45.935880+0000","last_unstale":"2024-09-12T01:22:16.027491+0000","last_undegraded":"2024-09-12T01:22:16.027491+0000","last_fullsized":"2024-09-12T01:22:16.027491+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'135","last_scrub_stamp":"2024-09-12T01:22:16.027180+0000","last_deep_scrub":"265'135","last_deep_scrub_stamp":"2024-09-12T01:22:16.027180+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.027180+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:04.144948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":617,"num_read_kb":515,"num_write":204,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'358","reported_seq":1009,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.839042+0000","last_change":"2024-09-12T01:22:08.838790+0000","last_active":"2024-09-12T01:22:08.839042+0000","last_peered":"2024-09-12T01:22:08.839042+0000","last_clean":"2024-09-12T01:22:08.839042+0000","last_became_active":"2024-09-12T00:35:43.931008+0000","last_became_peered":"2024-09-12T00:35:43.931008+0000","last_unstale":"2024-09-12T01:22:08.839042+0000","last_undegraded":"2024-09-12T01:22:08.839042+0000","last_fullsized":"2024-09-12T01:22:08.839042+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T01:22:08.838501+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T01:22:08.838501+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.838501+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:11.131001+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730252,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":516,"num_read_kb":33271,"num_write":1211,"num_write_kb":48012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:25.340530+0000","last_change":"2024-09-12T01:22:25.340400+0000","last_active":"2024-09-12T01:22:25.340530+0000","last_peered":"2024-09-12T01:22:25.340530+0000","last_clean":"2024-09-12T01:22:25.340530+0000","last_became_active":"2024-09-12T00:35:47.950328+0000","last_became_peered":"2024-09-12T00:35:47.950328+0000","last_unstale":"2024-09-12T01:22:25.340530+0000","last_undegraded":"2024-09-12T01:22:25.340530+0000","last_fullsized":"2024-09-12T01:22:25.340530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:25.340222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:25.340222+0000","last_clean_scrub_stamp":"2024-09-12T01:22:25.340222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:23.703380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'331","reported_seq":944,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:32.676301+0000","last_change":"2024-09-12T01:22:32.676301+0000","last_active":"2024-09-12T01:22:32.676301+0000","last_peered":"2024-09-12T01:22:32.676301+0000","last_clean":"2024-09-12T01:22:32.676301+0000","last_became_active":"2024-09-12T00:35:49.938536+0000","last_became_peered":"2024-09-12T00:35:49.938536+0000","last_unstale":"2024-09-12T01:22:32.676301+0000","last_undegraded":"2024-09-12T01:22:32.676301+0000","last_fullsized":"2024-09-12T01:22:32.676301+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'331","last_scrub_stamp":"2024-09-12T01:22:32.676177+0000","last_deep_scrub":"265'331","last_deep_scrub_stamp":"2024-09-12T01:22:32.676177+0000","last_clean_scrub_stamp":"2024-09-12T01:22:32.676177+0000","objects_scrubbed":11,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:23.698139+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46352,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":532,"num_read_kb":1127,"num_write":424,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:33.484728+0000","last_change":"2024-09-12T01:22:33.484728+0000","last_active":"2024-09-12T01:22:33.484728+0000","last_peered":"2024-09-12T01:22:33.484728+0000","last_clean":"2024-09-12T01:22:33.484728+0000","last_became_active":"2024-09-12T00:35:51.964446+0000","last_became_peered":"2024-09-12T00:35:51.964446+0000","last_unstale":"2024-09-12T01:22:33.484728+0000","last_undegraded":"2024-09-12T01:22:33.484728+0000","last_fullsized":"2024-09-12T01:22:33.484728+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:33.484539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:33.484539+0000","last_clean_scrub_stamp":"2024-09-12T01:22:33.484539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:58.707395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'140","reported_seq":660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:43.527637+0000","last_change":"2024-09-12T01:22:43.527637+0000","last_active":"2024-09-12T01:22:43.527637+0000","last_peered":"2024-09-12T01:22:43.527637+0000","last_clean":"2024-09-12T01:22:43.527637+0000","last_became_active":"2024-09-12T00:35:53.997969+0000","last_became_peered":"2024-09-12T00:35:53.997969+0000","last_unstale":"2024-09-12T01:22:43.527637+0000","last_undegraded":"2024-09-12T01:22:43.527637+0000","last_fullsized":"2024-09-12T01:22:43.527637+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'140","last_scrub_stamp":"2024-09-12T01:22:43.527440+0000","last_deep_scrub":"265'140","last_deep_scrub_stamp":"2024-09-12T01:22:43.527440+0000","last_clean_scrub_stamp":"2024-09-12T01:22:43.527440+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:22.757047+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":591,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":213,"num_read_kb":189,"num_write":344,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'118","reported_seq":711,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.065572+0000","last_change":"2024-09-12T01:22:18.065435+0000","last_active":"2024-09-12T01:22:18.065572+0000","last_peered":"2024-09-12T01:22:18.065572+0000","last_clean":"2024-09-12T01:22:18.065572+0000","last_became_active":"2024-09-12T00:35:45.937597+0000","last_became_peered":"2024-09-12T00:35:45.937597+0000","last_unstale":"2024-09-12T01:22:18.065572+0000","last_undegraded":"2024-09-12T01:22:18.065572+0000","last_fullsized":"2024-09-12T01:22:18.065572+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'118","last_scrub_stamp":"2024-09-12T01:22:18.065264+0000","last_deep_scrub":"265'118","last_deep_scrub_stamp":"2024-09-12T01:22:18.065264+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.065264+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:09.449396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":514,"num_read_kb":428,"num_write":167,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'305","reported_seq":908,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.754906+0000","last_change":"2024-09-12T01:22:10.754730+0000","last_active":"2024-09-12T01:22:10.754906+0000","last_peered":"2024-09-12T01:22:10.754906+0000","last_clean":"2024-09-12T01:22:10.754906+0000","last_became_active":"2024-09-12T00:35:43.913717+0000","last_became_peered":"2024-09-12T00:35:43.913717+0000","last_unstale":"2024-09-12T01:22:10.754906+0000","last_undegraded":"2024-09-12T01:22:10.754906+0000","last_fullsized":"2024-09-12T01:22:10.754906+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'305","last_scrub_stamp":"2024-09-12T01:22:10.754524+0000","last_deep_scrub":"265'305","last_deep_scrub_stamp":"2024-09-12T01:22:10.754524+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.754524+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:56.169168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":6749,"num_write":932,"num_write_kb":25345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:28.704533+0000","last_change":"2024-09-12T01:22:28.704366+0000","last_active":"2024-09-12T01:22:28.704533+0000","last_peered":"2024-09-12T01:22:28.704533+0000","last_clean":"2024-09-12T01:22:28.704533+0000","last_became_active":"2024-09-12T00:35:47.940170+0000","last_became_peered":"2024-09-12T00:35:47.940170+0000","last_unstale":"2024-09-12T01:22:28.704533+0000","last_undegraded":"2024-09-12T01:22:28.704533+0000","last_fullsized":"2024-09-12T01:22:28.704533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:28.704185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:28.704185+0000","last_clean_scrub_stamp":"2024-09-12T01:22:28.704185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:03.267354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'281","reported_seq":857,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:27.485365+0000","last_change":"2024-09-12T01:22:27.485365+0000","last_active":"2024-09-12T01:22:27.485365+0000","last_peered":"2024-09-12T01:22:27.485365+0000","last_clean":"2024-09-12T01:22:27.485365+0000","last_became_active":"2024-09-12T00:35:49.952570+0000","last_became_peered":"2024-09-12T00:35:49.952570+0000","last_unstale":"2024-09-12T01:22:27.485365+0000","last_undegraded":"2024-09-12T01:22:27.485365+0000","last_fullsized":"2024-09-12T01:22:27.485365+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'281","last_scrub_stamp":"2024-09-12T01:22:27.485160+0000","last_deep_scrub":"265'281","last_deep_scrub_stamp":"2024-09-12T01:22:27.485160+0000","last_clean_scrub_stamp":"2024-09-12T01:22:27.485160+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:19.061870+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47159,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":464,"num_read_kb":1078,"num_write":380,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:25.109601+0000","last_change":"2024-09-12T01:22:25.109601+0000","last_active":"2024-09-12T01:22:25.109601+0000","last_peered":"2024-09-12T01:22:25.109601+0000","last_clean":"2024-09-12T01:22:25.109601+0000","last_became_active":"2024-09-12T00:35:51.973732+0000","last_became_peered":"2024-09-12T00:35:51.973732+0000","last_unstale":"2024-09-12T01:22:25.109601+0000","last_undegraded":"2024-09-12T01:22:25.109601+0000","last_fullsized":"2024-09-12T01:22:25.109601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:25.109424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:25.109424+0000","last_clean_scrub_stamp":"2024-09-12T01:22:25.109424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:23.761850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'195","reported_seq":716,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:44.708585+0000","last_change":"2024-09-12T01:22:44.708585+0000","last_active":"2024-09-12T01:22:44.708585+0000","last_peered":"2024-09-12T01:22:44.708585+0000","last_clean":"2024-09-12T01:22:44.708585+0000","last_became_active":"2024-09-12T00:35:54.016028+0000","last_became_peered":"2024-09-12T00:35:54.016028+0000","last_unstale":"2024-09-12T01:22:44.708585+0000","last_undegraded":"2024-09-12T01:22:44.708585+0000","last_fullsized":"2024-09-12T01:22:44.708585+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'195","last_scrub_stamp":"2024-09-12T01:22:44.708346+0000","last_deep_scrub":"265'195","last_deep_scrub_stamp":"2024-09-12T01:22:44.708346+0000","last_clean_scrub_stamp":"2024-09-12T01:22:44.708346+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:01.384781+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":175,"num_read_kb":171,"num_write":438,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'198","reported_seq":819,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.646649+0000","last_change":"2024-09-12T01:22:18.646649+0000","last_active":"2024-09-12T01:22:18.646649+0000","last_peered":"2024-09-12T01:22:18.646649+0000","last_clean":"2024-09-12T01:22:18.646649+0000","last_became_active":"2024-09-12T00:35:45.941396+0000","last_became_peered":"2024-09-12T00:35:45.941396+0000","last_unstale":"2024-09-12T01:22:18.646649+0000","last_undegraded":"2024-09-12T01:22:18.646649+0000","last_fullsized":"2024-09-12T01:22:18.646649+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'198","last_scrub_stamp":"2024-09-12T01:22:18.646473+0000","last_deep_scrub":"265'198","last_deep_scrub_stamp":"2024-09-12T01:22:18.646473+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.646473+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:34.987983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":858,"num_read_kb":711,"num_write":323,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'462","reported_seq":1346,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.610259+0000","last_change":"2024-09-12T01:22:07.610259+0000","last_active":"2024-09-12T01:22:07.610259+0000","last_peered":"2024-09-12T01:22:07.610259+0000","last_clean":"2024-09-12T01:22:07.610259+0000","last_became_active":"2024-09-12T00:35:43.942359+0000","last_became_peered":"2024-09-12T00:35:43.942359+0000","last_unstale":"2024-09-12T01:22:07.610259+0000","last_undegraded":"2024-09-12T01:22:07.610259+0000","last_fullsized":"2024-09-12T01:22:07.610259+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'462","last_scrub_stamp":"2024-09-12T01:22:07.610037+0000","last_deep_scrub":"265'462","last_deep_scrub_stamp":"2024-09-12T01:22:07.610037+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.610037+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:31.652109+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1122,"num_read_kb":58431,"num_write":1508,"num_write_kb":72479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:26.881687+0000","last_change":"2024-09-12T01:22:26.881687+0000","last_active":"2024-09-12T01:22:26.881687+0000","last_peered":"2024-09-12T01:22:26.881687+0000","last_clean":"2024-09-12T01:22:26.881687+0000","last_became_active":"2024-09-12T00:35:47.940501+0000","last_became_peered":"2024-09-12T00:35:47.940501+0000","last_unstale":"2024-09-12T01:22:26.881687+0000","last_undegraded":"2024-09-12T01:22:26.881687+0000","last_fullsized":"2024-09-12T01:22:26.881687+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:26.881512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:26.881512+0000","last_clean_scrub_stamp":"2024-09-12T01:22:26.881512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:26.697220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'231","reported_seq":800,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:33.617371+0000","last_change":"2024-09-12T01:22:33.617118+0000","last_active":"2024-09-12T01:22:33.617371+0000","last_peered":"2024-09-12T01:22:33.617371+0000","last_clean":"2024-09-12T01:22:33.617371+0000","last_became_active":"2024-09-12T00:35:49.955264+0000","last_became_peered":"2024-09-12T00:35:49.955264+0000","last_unstale":"2024-09-12T01:22:33.617371+0000","last_undegraded":"2024-09-12T01:22:33.617371+0000","last_fullsized":"2024-09-12T01:22:33.617371+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'231","last_scrub_stamp":"2024-09-12T01:22:33.616855+0000","last_deep_scrub":"265'231","last_deep_scrub_stamp":"2024-09-12T01:22:33.616855+0000","last_clean_scrub_stamp":"2024-09-12T01:22:33.616855+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:39.383012+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44002,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":385,"num_read_kb":903,"num_write":312,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:35.958644+0000","last_change":"2024-09-12T01:22:35.958478+0000","last_active":"2024-09-12T01:22:35.958644+0000","last_peered":"2024-09-12T01:22:35.958644+0000","last_clean":"2024-09-12T01:22:35.958644+0000","last_became_active":"2024-09-12T00:35:51.961691+0000","last_became_peered":"2024-09-12T00:35:51.961691+0000","last_unstale":"2024-09-12T01:22:35.958644+0000","last_undegraded":"2024-09-12T01:22:35.958644+0000","last_fullsized":"2024-09-12T01:22:35.958644+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:35.958302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:35.958302+0000","last_clean_scrub_stamp":"2024-09-12T01:22:35.958302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:53.107582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'199","reported_seq":1664,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:38.475707+0000","last_change":"2024-09-12T01:22:38.475707+0000","last_active":"2024-09-12T01:22:38.475707+0000","last_peered":"2024-09-12T01:22:38.475707+0000","last_clean":"2024-09-12T01:22:38.475707+0000","last_became_active":"2024-09-12T00:35:53.991532+0000","last_became_peered":"2024-09-12T00:35:53.991532+0000","last_unstale":"2024-09-12T01:22:38.475707+0000","last_undegraded":"2024-09-12T01:22:38.475707+0000","last_fullsized":"2024-09-12T01:22:38.475707+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'199","last_scrub_stamp":"2024-09-12T01:22:38.475475+0000","last_deep_scrub":"265'199","last_deep_scrub_stamp":"2024-09-12T01:22:38.475475+0000","last_clean_scrub_stamp":"2024-09-12T01:22:38.475475+0000","objects_scrubbed":5,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:31.432500+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1185,"num_read_kb":1184,"num_write":442,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'185","reported_seq":804,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.985260+0000","last_change":"2024-09-12T01:22:14.985260+0000","last_active":"2024-09-12T01:22:14.985260+0000","last_peered":"2024-09-12T01:22:14.985260+0000","last_clean":"2024-09-12T01:22:14.985260+0000","last_became_active":"2024-09-12T00:35:45.954474+0000","last_became_peered":"2024-09-12T00:35:45.954474+0000","last_unstale":"2024-09-12T01:22:14.985260+0000","last_undegraded":"2024-09-12T01:22:14.985260+0000","last_fullsized":"2024-09-12T01:22:14.985260+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'185","last_scrub_stamp":"2024-09-12T01:22:14.985076+0000","last_deep_scrub":"265'185","last_deep_scrub_stamp":"2024-09-12T01:22:14.985076+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.985076+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:20.057452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":774,"num_read_kb":643,"num_write":252,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'374","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.636292+0000","last_change":"2024-09-12T01:22:07.636292+0000","last_active":"2024-09-12T01:22:07.636292+0000","last_peered":"2024-09-12T01:22:07.636292+0000","last_clean":"2024-09-12T01:22:07.636292+0000","last_became_active":"2024-09-12T00:35:43.934998+0000","last_became_peered":"2024-09-12T00:35:43.934998+0000","last_unstale":"2024-09-12T01:22:07.636292+0000","last_undegraded":"2024-09-12T01:22:07.636292+0000","last_fullsized":"2024-09-12T01:22:07.636292+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T01:22:07.636085+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T01:22:07.636085+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.636085+0000","objects_scrubbed":6,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:58.942568+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":520,"num_read_kb":15471,"num_write":1132,"num_write_kb":44978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"265'2","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.266105+0000","last_change":"2024-09-12T01:22:18.266105+0000","last_active":"2024-09-12T01:22:18.266105+0000","last_peered":"2024-09-12T01:22:18.266105+0000","last_clean":"2024-09-12T01:22:18.266105+0000","last_became_active":"2024-09-12T00:35:47.928424+0000","last_became_peered":"2024-09-12T00:35:47.928424+0000","last_unstale":"2024-09-12T01:22:18.266105+0000","last_undegraded":"2024-09-12T01:22:18.266105+0000","last_fullsized":"2024-09-12T01:22:18.266105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:22:18.265915+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:22:18.265915+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.265915+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:57.030554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'303","reported_seq":910,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:31.988147+0000","last_change":"2024-09-12T01:22:31.988009+0000","last_active":"2024-09-12T01:22:31.988147+0000","last_peered":"2024-09-12T01:22:31.988147+0000","last_clean":"2024-09-12T01:22:31.988147+0000","last_became_active":"2024-09-12T00:35:49.933165+0000","last_became_peered":"2024-09-12T00:35:49.933165+0000","last_unstale":"2024-09-12T01:22:31.988147+0000","last_undegraded":"2024-09-12T01:22:31.988147+0000","last_fullsized":"2024-09-12T01:22:31.988147+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'303","last_scrub_stamp":"2024-09-12T01:22:31.987769+0000","last_deep_scrub":"265'303","last_deep_scrub_stamp":"2024-09-12T01:22:31.987769+0000","last_clean_scrub_stamp":"2024-09-12T01:22:31.987769+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:32.048586+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49116,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":493,"num_read_kb":1065,"num_write":392,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:43.408667+0000","last_change":"2024-09-12T01:22:43.408422+0000","last_active":"2024-09-12T01:22:43.408667+0000","last_peered":"2024-09-12T01:22:43.408667+0000","last_clean":"2024-09-12T01:22:43.408667+0000","last_became_active":"2024-09-12T00:35:51.984756+0000","last_became_peered":"2024-09-12T00:35:51.984756+0000","last_unstale":"2024-09-12T01:22:43.408667+0000","last_undegraded":"2024-09-12T01:22:43.408667+0000","last_fullsized":"2024-09-12T01:22:43.408667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:22:43.408199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:22:43.408199+0000","last_clean_scrub_stamp":"2024-09-12T01:22:43.408199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:33.896156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'191","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:37.917931+0000","last_change":"2024-09-12T01:22:37.917782+0000","last_active":"2024-09-12T01:22:37.917931+0000","last_peered":"2024-09-12T01:22:37.917931+0000","last_clean":"2024-09-12T01:22:37.917931+0000","last_became_active":"2024-09-12T00:35:53.985486+0000","last_became_peered":"2024-09-12T00:35:53.985486+0000","last_unstale":"2024-09-12T01:22:37.917931+0000","last_undegraded":"2024-09-12T01:22:37.917931+0000","last_fullsized":"2024-09-12T01:22:37.917931+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'191","last_scrub_stamp":"2024-09-12T01:22:37.917552+0000","last_deep_scrub":"265'191","last_deep_scrub_stamp":"2024-09-12T01:22:37.917552+0000","last_clean_scrub_stamp":"2024-09-12T01:22:37.917552+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:54.809592+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1062,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":193,"num_read_kb":167,"num_write":361,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'182","reported_seq":732,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.261888+0000","last_change":"2024-09-12T01:22:19.261888+0000","last_active":"2024-09-12T01:22:19.261888+0000","last_peered":"2024-09-12T01:22:19.261888+0000","last_clean":"2024-09-12T01:22:19.261888+0000","last_became_active":"2024-09-12T00:35:45.957698+0000","last_became_peered":"2024-09-12T00:35:45.957698+0000","last_unstale":"2024-09-12T01:22:19.261888+0000","last_undegraded":"2024-09-12T01:22:19.261888+0000","last_fullsized":"2024-09-12T01:22:19.261888+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'182","last_scrub_stamp":"2024-09-12T01:22:19.261702+0000","last_deep_scrub":"265'182","last_deep_scrub_stamp":"2024-09-12T01:22:19.261702+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.261702+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:20.463886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":768,"num_read_kb":623,"num_write":277,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'396","reported_seq":1075,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.181416+0000","last_change":"2024-09-12T01:22:08.181416+0000","last_active":"2024-09-12T01:22:08.181416+0000","last_peered":"2024-09-12T01:22:08.181416+0000","last_clean":"2024-09-12T01:22:08.181416+0000","last_became_active":"2024-09-12T00:35:43.937281+0000","last_became_peered":"2024-09-12T00:35:43.937281+0000","last_unstale":"2024-09-12T01:22:08.181416+0000","last_undegraded":"2024-09-12T01:22:08.181416+0000","last_fullsized":"2024-09-12T01:22:08.181416+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'396","last_scrub_stamp":"2024-09-12T01:22:08.181179+0000","last_deep_scrub":"265'396","last_deep_scrub_stamp":"2024-09-12T01:22:08.181179+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.181179+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:58.834889+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550668,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":606,"num_read_kb":52877,"num_write":1364,"num_write_kb":41162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'421","reported_seq":1118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.183784+0000","last_change":"2024-09-12T01:22:15.183784+0000","last_active":"2024-09-12T01:22:15.183784+0000","last_peered":"2024-09-12T01:22:15.183784+0000","last_clean":"2024-09-12T01:22:15.183784+0000","last_became_active":"2024-09-12T00:35:45.932615+0000","last_became_peered":"2024-09-12T00:35:45.932615+0000","last_unstale":"2024-09-12T01:22:15.183784+0000","last_undegraded":"2024-09-12T01:22:15.183784+0000","last_fullsized":"2024-09-12T01:22:15.183784+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'421","last_scrub_stamp":"2024-09-12T01:22:15.183600+0000","last_deep_scrub":"265'421","last_deep_scrub_stamp":"2024-09-12T01:22:15.183600+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.183600+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:05.389393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2107,"num_read_kb":1905,"num_write":744,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'291","reported_seq":960,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.448034+0000","last_change":"2024-09-12T01:22:08.448034+0000","last_active":"2024-09-12T01:22:08.448034+0000","last_peered":"2024-09-12T01:22:08.448034+0000","last_clean":"2024-09-12T01:22:08.448034+0000","last_became_active":"2024-09-12T00:35:43.922005+0000","last_became_peered":"2024-09-12T00:35:43.922005+0000","last_unstale":"2024-09-12T01:22:08.448034+0000","last_undegraded":"2024-09-12T01:22:08.448034+0000","last_fullsized":"2024-09-12T01:22:08.448034+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'291","last_scrub_stamp":"2024-09-12T01:22:08.447802+0000","last_deep_scrub":"265'291","last_deep_scrub_stamp":"2024-09-12T01:22:08.447802+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.447802+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:44.780769+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":535,"num_read_kb":1388,"num_write":997,"num_write_kb":25405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'246","reported_seq":873,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.721615+0000","last_change":"2024-09-12T01:22:19.721615+0000","last_active":"2024-09-12T01:22:19.721615+0000","last_peered":"2024-09-12T01:22:19.721615+0000","last_clean":"2024-09-12T01:22:19.721615+0000","last_became_active":"2024-09-12T00:35:45.940153+0000","last_became_peered":"2024-09-12T00:35:45.940153+0000","last_unstale":"2024-09-12T01:22:19.721615+0000","last_undegraded":"2024-09-12T01:22:19.721615+0000","last_fullsized":"2024-09-12T01:22:19.721615+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'246","last_scrub_stamp":"2024-09-12T01:22:19.721431+0000","last_deep_scrub":"265'246","last_deep_scrub_stamp":"2024-09-12T01:22:19.721431+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.721431+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:39.443952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1055,"num_read_kb":856,"num_write":397,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'353","reported_seq":969,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.429300+0000","last_change":"2024-09-12T01:22:11.429300+0000","last_active":"2024-09-12T01:22:11.429300+0000","last_peered":"2024-09-12T01:22:11.429300+0000","last_clean":"2024-09-12T01:22:11.429300+0000","last_became_active":"2024-09-12T00:36:17.267594+0000","last_became_peered":"2024-09-12T00:36:17.267594+0000","last_unstale":"2024-09-12T01:22:11.429300+0000","last_undegraded":"2024-09-12T01:22:11.429300+0000","last_fullsized":"2024-09-12T01:22:11.429300+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'353","last_scrub_stamp":"2024-09-12T01:22:11.429005+0000","last_deep_scrub":"265'353","last_deep_scrub_stamp":"2024-09-12T01:22:11.429005+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.429005+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:45.151943+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436874,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":471,"num_read_kb":41052,"num_write":1136,"num_write_kb":25796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"265'93","reported_seq":678,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.152389+0000","last_change":"2024-09-12T01:22:14.152389+0000","last_active":"2024-09-12T01:22:14.152389+0000","last_peered":"2024-09-12T01:22:14.152389+0000","last_clean":"2024-09-12T01:22:14.152389+0000","last_became_active":"2024-09-12T00:35:45.945534+0000","last_became_peered":"2024-09-12T00:35:45.945534+0000","last_unstale":"2024-09-12T01:22:14.152389+0000","last_undegraded":"2024-09-12T01:22:14.152389+0000","last_fullsized":"2024-09-12T01:22:14.152389+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'93","last_scrub_stamp":"2024-09-12T01:22:14.152209+0000","last_deep_scrub":"265'93","last_deep_scrub_stamp":"2024-09-12T01:22:14.152209+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.152209+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:25.890852+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":411,"num_read_kb":349,"num_write":136,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'324","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:08.602990+0000","last_change":"2024-09-12T01:22:08.602990+0000","last_active":"2024-09-12T01:22:08.602990+0000","last_peered":"2024-09-12T01:22:08.602990+0000","last_clean":"2024-09-12T01:22:08.602990+0000","last_became_active":"2024-09-12T00:35:43.934068+0000","last_became_peered":"2024-09-12T00:35:43.934068+0000","last_unstale":"2024-09-12T01:22:08.602990+0000","last_undegraded":"2024-09-12T01:22:08.602990+0000","last_fullsized":"2024-09-12T01:22:08.602990+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T01:22:08.602769+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T01:22:08.602769+0000","last_clean_scrub_stamp":"2024-09-12T01:22:08.602769+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:18.211995+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":780267,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":473,"num_read_kb":16449,"num_write":1046,"num_write_kb":32400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'160","reported_seq":804,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:22.624197+0000","last_change":"2024-09-12T01:22:22.624197+0000","last_active":"2024-09-12T01:22:22.624197+0000","last_peered":"2024-09-12T01:22:22.624197+0000","last_clean":"2024-09-12T01:22:22.624197+0000","last_became_active":"2024-09-12T00:35:45.944423+0000","last_became_peered":"2024-09-12T00:35:45.944423+0000","last_unstale":"2024-09-12T01:22:22.624197+0000","last_undegraded":"2024-09-12T01:22:22.624197+0000","last_fullsized":"2024-09-12T01:22:22.624197+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'160","last_scrub_stamp":"2024-09-12T01:22:22.623982+0000","last_deep_scrub":"265'160","last_deep_scrub_stamp":"2024-09-12T01:22:22.623982+0000","last_clean_scrub_stamp":"2024-09-12T01:22:22.623982+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:20.633894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":713,"num_read_kb":599,"num_write":226,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"265'346","reported_seq":1025,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.595118+0000","last_change":"2024-09-12T01:22:09.595018+0000","last_active":"2024-09-12T01:22:09.595118+0000","last_peered":"2024-09-12T01:22:09.595118+0000","last_clean":"2024-09-12T01:22:09.595118+0000","last_became_active":"2024-09-12T00:35:43.937104+0000","last_became_peered":"2024-09-12T00:35:43.937104+0000","last_unstale":"2024-09-12T01:22:09.595118+0000","last_undegraded":"2024-09-12T01:22:09.595118+0000","last_fullsized":"2024-09-12T01:22:09.595118+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'346","last_scrub_stamp":"2024-09-12T01:22:09.594896+0000","last_deep_scrub":"265'346","last_deep_scrub_stamp":"2024-09-12T01:22:09.594896+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.594896+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:28.710562+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262271,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":572,"num_read_kb":63038,"num_write":1116,"num_write_kb":29306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'252","reported_seq":855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.042216+0000","last_change":"2024-09-12T01:22:17.042216+0000","last_active":"2024-09-12T01:22:17.042216+0000","last_peered":"2024-09-12T01:22:17.042216+0000","last_clean":"2024-09-12T01:22:17.042216+0000","last_became_active":"2024-09-12T00:35:45.957860+0000","last_became_peered":"2024-09-12T00:35:45.957860+0000","last_unstale":"2024-09-12T01:22:17.042216+0000","last_undegraded":"2024-09-12T01:22:17.042216+0000","last_fullsized":"2024-09-12T01:22:17.042216+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'252","last_scrub_stamp":"2024-09-12T01:22:17.042033+0000","last_deep_scrub":"265'252","last_deep_scrub_stamp":"2024-09-12T01:22:17.042033+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.042033+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:06.623032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1076,"num_read_kb":859,"num_write":407,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":266,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'346","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.234936+0000","last_change":"2024-09-12T01:22:09.234790+0000","last_active":"2024-09-12T01:22:09.234936+0000","last_peered":"2024-09-12T01:22:09.234936+0000","last_clean":"2024-09-12T01:22:09.234936+0000","last_became_active":"2024-09-12T00:35:43.929027+0000","last_became_peered":"2024-09-12T00:35:43.929027+0000","last_unstale":"2024-09-12T01:22:09.234936+0000","last_undegraded":"2024-09-12T01:22:09.234936+0000","last_fullsized":"2024-09-12T01:22:09.234936+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'346","last_scrub_stamp":"2024-09-12T01:22:09.234559+0000","last_deep_scrub":"265'346","last_deep_scrub_stamp":"2024-09-12T01:22:09.234559+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.234559+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:22.211508+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":588,"num_read_kb":747,"num_write":1224,"num_write_kb":5740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'102","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.588099+0000","last_change":"2024-09-12T01:22:20.588099+0000","last_active":"2024-09-12T01:22:20.588099+0000","last_peered":"2024-09-12T01:22:20.588099+0000","last_clean":"2024-09-12T01:22:20.588099+0000","last_became_active":"2024-09-12T00:35:45.948581+0000","last_became_peered":"2024-09-12T00:35:45.948581+0000","last_unstale":"2024-09-12T01:22:20.588099+0000","last_undegraded":"2024-09-12T01:22:20.588099+0000","last_fullsized":"2024-09-12T01:22:20.588099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'102","last_scrub_stamp":"2024-09-12T01:22:20.587828+0000","last_deep_scrub":"265'102","last_deep_scrub_stamp":"2024-09-12T01:22:20.587828+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.587828+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:41.592609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":463,"num_read_kb":395,"num_write":145,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"265'337","reported_seq":976,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.202666+0000","last_change":"2024-09-12T01:22:09.202666+0000","last_active":"2024-09-12T01:22:09.202666+0000","last_peered":"2024-09-12T01:22:09.202666+0000","last_clean":"2024-09-12T01:22:09.202666+0000","last_became_active":"2024-09-12T00:35:43.941155+0000","last_became_peered":"2024-09-12T00:35:43.941155+0000","last_unstale":"2024-09-12T01:22:09.202666+0000","last_undegraded":"2024-09-12T01:22:09.202666+0000","last_fullsized":"2024-09-12T01:22:09.202666+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'337","last_scrub_stamp":"2024-09-12T01:22:09.202393+0000","last_deep_scrub":"265'337","last_deep_scrub_stamp":"2024-09-12T01:22:09.202393+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.202393+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:57.460847+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":4200,"num_write":1081,"num_write_kb":60173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"265'210","reported_seq":851,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:15.155108+0000","last_change":"2024-09-12T01:22:15.155108+0000","last_active":"2024-09-12T01:22:15.155108+0000","last_peered":"2024-09-12T01:22:15.155108+0000","last_clean":"2024-09-12T01:22:15.155108+0000","last_became_active":"2024-09-12T00:35:45.946047+0000","last_became_peered":"2024-09-12T00:35:45.946047+0000","last_unstale":"2024-09-12T01:22:15.155108+0000","last_undegraded":"2024-09-12T01:22:15.155108+0000","last_fullsized":"2024-09-12T01:22:15.155108+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'210","last_scrub_stamp":"2024-09-12T01:22:15.154905+0000","last_deep_scrub":"265'210","last_deep_scrub_stamp":"2024-09-12T01:22:15.154905+0000","last_clean_scrub_stamp":"2024-09-12T01:22:15.154905+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:58.436758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":932,"num_read_kb":766,"num_write":302,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'323","reported_seq":971,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.593805+0000","last_change":"2024-09-12T01:22:11.593629+0000","last_active":"2024-09-12T01:22:11.593805+0000","last_peered":"2024-09-12T01:22:11.593805+0000","last_clean":"2024-09-12T01:22:11.593805+0000","last_became_active":"2024-09-12T00:35:43.923685+0000","last_became_peered":"2024-09-12T00:35:43.923685+0000","last_unstale":"2024-09-12T01:22:11.593805+0000","last_undegraded":"2024-09-12T01:22:11.593805+0000","last_fullsized":"2024-09-12T01:22:11.593805+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'323","last_scrub_stamp":"2024-09-12T01:22:11.593437+0000","last_deep_scrub":"265'323","last_deep_scrub_stamp":"2024-09-12T01:22:11.593437+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.593437+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:28.420949+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524322,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":440,"num_read_kb":73837,"num_write":961,"num_write_kb":48353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'100","reported_seq":687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.511606+0000","last_change":"2024-09-12T01:22:20.511454+0000","last_active":"2024-09-12T01:22:20.511606+0000","last_peered":"2024-09-12T01:22:20.511606+0000","last_clean":"2024-09-12T01:22:20.511606+0000","last_became_active":"2024-09-12T00:35:45.941986+0000","last_became_peered":"2024-09-12T00:35:45.941986+0000","last_unstale":"2024-09-12T01:22:20.511606+0000","last_undegraded":"2024-09-12T01:22:20.511606+0000","last_fullsized":"2024-09-12T01:22:20.511606+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'100","last_scrub_stamp":"2024-09-12T01:22:20.511244+0000","last_deep_scrub":"265'100","last_deep_scrub_stamp":"2024-09-12T01:22:20.511244+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.511244+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:50.075824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":455,"num_read_kb":381,"num_write":169,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'340","reported_seq":1062,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:11.780884+0000","last_change":"2024-09-12T01:22:11.780884+0000","last_active":"2024-09-12T01:22:11.780884+0000","last_peered":"2024-09-12T01:22:11.780884+0000","last_clean":"2024-09-12T01:22:11.780884+0000","last_became_active":"2024-09-12T00:35:43.911654+0000","last_became_peered":"2024-09-12T00:35:43.911654+0000","last_unstale":"2024-09-12T01:22:11.780884+0000","last_undegraded":"2024-09-12T01:22:11.780884+0000","last_fullsized":"2024-09-12T01:22:11.780884+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'340","last_scrub_stamp":"2024-09-12T01:22:11.780673+0000","last_deep_scrub":"265'340","last_deep_scrub_stamp":"2024-09-12T01:22:11.780673+0000","last_clean_scrub_stamp":"2024-09-12T01:22:11.780673+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:55.696701+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262180,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":572,"num_read_kb":5667,"num_write":1085,"num_write_kb":32435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'262","reported_seq":861,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.999977+0000","last_change":"2024-09-12T01:22:19.999817+0000","last_active":"2024-09-12T01:22:19.999977+0000","last_peered":"2024-09-12T01:22:19.999977+0000","last_clean":"2024-09-12T01:22:19.999977+0000","last_became_active":"2024-09-12T00:35:45.926462+0000","last_became_peered":"2024-09-12T00:35:45.926462+0000","last_unstale":"2024-09-12T01:22:19.999977+0000","last_undegraded":"2024-09-12T01:22:19.999977+0000","last_fullsized":"2024-09-12T01:22:19.999977+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'262","last_scrub_stamp":"2024-09-12T01:22:19.999635+0000","last_deep_scrub":"265'262","last_deep_scrub_stamp":"2024-09-12T01:22:19.999635+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.999635+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:24.196701+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1050,"num_read_kb":836,"num_write":420,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'331","reported_seq":1014,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.620507+0000","last_change":"2024-09-12T01:22:10.620366+0000","last_active":"2024-09-12T01:22:10.620507+0000","last_peered":"2024-09-12T01:22:10.620507+0000","last_clean":"2024-09-12T01:22:10.620507+0000","last_became_active":"2024-09-12T00:35:43.936883+0000","last_became_peered":"2024-09-12T00:35:43.936883+0000","last_unstale":"2024-09-12T01:22:10.620507+0000","last_undegraded":"2024-09-12T01:22:10.620507+0000","last_fullsized":"2024-09-12T01:22:10.620507+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'331","last_scrub_stamp":"2024-09-12T01:22:10.620182+0000","last_deep_scrub":"265'331","last_deep_scrub_stamp":"2024-09-12T01:22:10.620182+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.620182+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:09.832438+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2075264,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":536,"num_read_kb":80814,"num_write":1042,"num_write_kb":32955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"265'151","reported_seq":746,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:05.482943+0000","last_change":"2024-09-12T01:22:05.482818+0000","last_active":"2024-09-12T01:22:05.482943+0000","last_peered":"2024-09-12T01:22:05.482943+0000","last_clean":"2024-09-12T01:22:05.482943+0000","last_became_active":"2024-09-12T00:35:45.958997+0000","last_became_peered":"2024-09-12T00:35:45.958997+0000","last_unstale":"2024-09-12T01:22:05.482943+0000","last_undegraded":"2024-09-12T01:22:05.482943+0000","last_fullsized":"2024-09-12T01:22:05.482943+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'151","last_scrub_stamp":"2024-09-12T01:22:05.482621+0000","last_deep_scrub":"265'151","last_deep_scrub_stamp":"2024-09-12T01:22:05.482621+0000","last_clean_scrub_stamp":"2024-09-12T01:22:05.482621+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:24.195434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":623,"num_read_kb":511,"num_write":250,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'381","reported_seq":1048,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:12.784189+0000","last_change":"2024-09-12T01:22:12.784028+0000","last_active":"2024-09-12T01:22:12.784189+0000","last_peered":"2024-09-12T01:22:12.784189+0000","last_clean":"2024-09-12T01:22:12.784189+0000","last_became_active":"2024-09-12T00:35:43.942591+0000","last_became_peered":"2024-09-12T00:35:43.942591+0000","last_unstale":"2024-09-12T01:22:12.784189+0000","last_undegraded":"2024-09-12T01:22:12.784189+0000","last_fullsized":"2024-09-12T01:22:12.784189+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'381","last_scrub_stamp":"2024-09-12T01:22:12.783792+0000","last_deep_scrub":"265'381","last_deep_scrub_stamp":"2024-09-12T01:22:12.783792+0000","last_clean_scrub_stamp":"2024-09-12T01:22:12.783792+0000","objects_scrubbed":11,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:25.661993+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":894961,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":508,"num_read_kb":28251,"num_write":1134,"num_write_kb":59925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"265'83","reported_seq":670,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:19.041734+0000","last_change":"2024-09-12T01:22:19.041603+0000","last_active":"2024-09-12T01:22:19.041734+0000","last_peered":"2024-09-12T01:22:19.041734+0000","last_clean":"2024-09-12T01:22:19.041734+0000","last_became_active":"2024-09-12T00:35:45.954252+0000","last_became_peered":"2024-09-12T00:35:45.954252+0000","last_unstale":"2024-09-12T01:22:19.041734+0000","last_undegraded":"2024-09-12T01:22:19.041734+0000","last_fullsized":"2024-09-12T01:22:19.041734+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'83","last_scrub_stamp":"2024-09-12T01:22:19.041424+0000","last_deep_scrub":"265'83","last_deep_scrub_stamp":"2024-09-12T01:22:19.041424+0000","last_clean_scrub_stamp":"2024-09-12T01:22:19.041424+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:10.207954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":370,"num_read_kb":310,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'387","reported_seq":1049,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:09.572240+0000","last_change":"2024-09-12T01:22:09.572102+0000","last_active":"2024-09-12T01:22:09.572240+0000","last_peered":"2024-09-12T01:22:09.572240+0000","last_clean":"2024-09-12T01:22:09.572240+0000","last_became_active":"2024-09-12T00:35:43.952828+0000","last_became_peered":"2024-09-12T00:35:43.952828+0000","last_unstale":"2024-09-12T01:22:09.572240+0000","last_undegraded":"2024-09-12T01:22:09.572240+0000","last_fullsized":"2024-09-12T01:22:09.572240+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'387","last_scrub_stamp":"2024-09-12T01:22:09.571904+0000","last_deep_scrub":"265'387","last_deep_scrub_stamp":"2024-09-12T01:22:09.571904+0000","last_clean_scrub_stamp":"2024-09-12T01:22:09.571904+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:32.922872+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":611,"num_read_kb":10107,"num_write":1280,"num_write_kb":30495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'4193","reported_seq":4827,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:18.469924+0000","last_change":"2024-09-12T01:22:18.469762+0000","last_active":"2024-09-12T01:22:18.469924+0000","last_peered":"2024-09-12T01:22:18.469924+0000","last_clean":"2024-09-12T01:22:18.469924+0000","last_became_active":"2024-09-12T00:35:45.949770+0000","last_became_peered":"2024-09-12T00:35:45.949770+0000","last_unstale":"2024-09-12T01:22:18.469924+0000","last_undegraded":"2024-09-12T01:22:18.469924+0000","last_fullsized":"2024-09-12T01:22:18.469924+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4193","last_scrub_stamp":"2024-09-12T01:22:18.469588+0000","last_deep_scrub":"265'4193","last_deep_scrub_stamp":"2024-09-12T01:22:18.469588+0000","last_clean_scrub_stamp":"2024-09-12T01:22:18.469588+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":3000,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:27.939587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16900,"num_read_kb":14167,"num_write":6311,"num_write_kb":3148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'355","reported_seq":1009,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:10.209366+0000","last_change":"2024-09-12T01:22:10.209104+0000","last_active":"2024-09-12T01:22:10.209366+0000","last_peered":"2024-09-12T01:22:10.209366+0000","last_clean":"2024-09-12T01:22:10.209366+0000","last_became_active":"2024-09-12T00:35:43.944721+0000","last_became_peered":"2024-09-12T00:35:43.944721+0000","last_unstale":"2024-09-12T01:22:10.209366+0000","last_undegraded":"2024-09-12T01:22:10.209366+0000","last_fullsized":"2024-09-12T01:22:10.209366+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'355","last_scrub_stamp":"2024-09-12T01:22:10.208841+0000","last_deep_scrub":"265'355","last_deep_scrub_stamp":"2024-09-12T01:22:10.208841+0000","last_clean_scrub_stamp":"2024-09-12T01:22:10.208841+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:01.036663+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730131,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":532,"num_read_kb":12444,"num_write":1159,"num_write_kb":48295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'222","reported_seq":866,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:16.539944+0000","last_change":"2024-09-12T01:22:16.539740+0000","last_active":"2024-09-12T01:22:16.539944+0000","last_peered":"2024-09-12T01:22:16.539944+0000","last_clean":"2024-09-12T01:22:16.539944+0000","last_became_active":"2024-09-12T00:35:45.939921+0000","last_became_peered":"2024-09-12T00:35:45.939921+0000","last_unstale":"2024-09-12T01:22:16.539944+0000","last_undegraded":"2024-09-12T01:22:16.539944+0000","last_fullsized":"2024-09-12T01:22:16.539944+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'222","last_scrub_stamp":"2024-09-12T01:22:16.539565+0000","last_deep_scrub":"265'222","last_deep_scrub_stamp":"2024-09-12T01:22:16.539565+0000","last_clean_scrub_stamp":"2024-09-12T01:22:16.539565+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:08.131916+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":991,"num_read_kb":821,"num_write":345,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":504,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'347","reported_seq":985,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.537190+0000","last_change":"2024-09-12T01:22:13.536922+0000","last_active":"2024-09-12T01:22:13.537190+0000","last_peered":"2024-09-12T01:22:13.537190+0000","last_clean":"2024-09-12T01:22:13.537190+0000","last_became_active":"2024-09-12T00:35:43.942772+0000","last_became_peered":"2024-09-12T00:35:43.942772+0000","last_unstale":"2024-09-12T01:22:13.537190+0000","last_undegraded":"2024-09-12T01:22:13.537190+0000","last_fullsized":"2024-09-12T01:22:13.537190+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T01:22:13.536675+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T01:22:13.536675+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.536675+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:15.728162+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2329981,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":472,"num_read_kb":15742,"num_write":1095,"num_write_kb":41173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'153","reported_seq":780,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:23.587385+0000","last_change":"2024-09-12T01:22:23.587221+0000","last_active":"2024-09-12T01:22:23.587385+0000","last_peered":"2024-09-12T01:22:23.587385+0000","last_clean":"2024-09-12T01:22:23.587385+0000","last_became_active":"2024-09-12T00:35:45.937998+0000","last_became_peered":"2024-09-12T00:35:45.937998+0000","last_unstale":"2024-09-12T01:22:23.587385+0000","last_undegraded":"2024-09-12T01:22:23.587385+0000","last_fullsized":"2024-09-12T01:22:23.587385+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'153","last_scrub_stamp":"2024-09-12T01:22:23.587043+0000","last_deep_scrub":"265'153","last_deep_scrub_stamp":"2024-09-12T01:22:23.587043+0000","last_clean_scrub_stamp":"2024-09-12T01:22:23.587043+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:08.881855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":680,"num_read_kb":568,"num_write":226,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'362","reported_seq":1072,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:07.488740+0000","last_change":"2024-09-12T01:22:07.488496+0000","last_active":"2024-09-12T01:22:07.488740+0000","last_peered":"2024-09-12T01:22:07.488740+0000","last_clean":"2024-09-12T01:22:07.488740+0000","last_became_active":"2024-09-12T00:35:43.940876+0000","last_became_peered":"2024-09-12T00:35:43.940876+0000","last_unstale":"2024-09-12T01:22:07.488740+0000","last_undegraded":"2024-09-12T01:22:07.488740+0000","last_fullsized":"2024-09-12T01:22:07.488740+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'362","last_scrub_stamp":"2024-09-12T01:22:07.488235+0000","last_deep_scrub":"265'362","last_deep_scrub_stamp":"2024-09-12T01:22:07.488235+0000","last_clean_scrub_stamp":"2024-09-12T01:22:07.488235+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:21.148458+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":724,"num_read_kb":28886,"num_write":1110,"num_write_kb":16361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'147","reported_seq":792,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:20.458525+0000","last_change":"2024-09-12T01:22:20.458525+0000","last_active":"2024-09-12T01:22:20.458525+0000","last_peered":"2024-09-12T01:22:20.458525+0000","last_clean":"2024-09-12T01:22:20.458525+0000","last_became_active":"2024-09-12T00:35:45.948028+0000","last_became_peered":"2024-09-12T00:35:45.948028+0000","last_unstale":"2024-09-12T01:22:20.458525+0000","last_undegraded":"2024-09-12T01:22:20.458525+0000","last_fullsized":"2024-09-12T01:22:20.458525+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'147","last_scrub_stamp":"2024-09-12T01:22:20.458339+0000","last_deep_scrub":"265'147","last_deep_scrub_stamp":"2024-09-12T01:22:20.458339+0000","last_clean_scrub_stamp":"2024-09-12T01:22:20.458339+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:06.018727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":702,"num_read_kb":590,"num_write":208,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4004,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'347","reported_seq":1033,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:13.813763+0000","last_change":"2024-09-12T01:22:13.813608+0000","last_active":"2024-09-12T01:22:13.813763+0000","last_peered":"2024-09-12T01:22:13.813763+0000","last_clean":"2024-09-12T01:22:13.813763+0000","last_became_active":"2024-09-12T00:35:43.950791+0000","last_became_peered":"2024-09-12T00:35:43.950791+0000","last_unstale":"2024-09-12T01:22:13.813763+0000","last_undegraded":"2024-09-12T01:22:13.813763+0000","last_fullsized":"2024-09-12T01:22:13.813763+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T01:22:13.813378+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T01:22:13.813378+0000","last_clean_scrub_stamp":"2024-09-12T01:22:13.813378+0000","objects_scrubbed":10,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:26.242258+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5529046,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":579,"num_read_kb":37013,"num_write":1080,"num_write_kb":45879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'300","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:14.828572+0000","last_change":"2024-09-12T01:22:14.828375+0000","last_active":"2024-09-12T01:22:14.828572+0000","last_peered":"2024-09-12T01:22:14.828572+0000","last_clean":"2024-09-12T01:22:14.828572+0000","last_became_active":"2024-09-12T00:35:43.931367+0000","last_became_peered":"2024-09-12T00:35:43.931367+0000","last_unstale":"2024-09-12T01:22:14.828572+0000","last_undegraded":"2024-09-12T01:22:14.828572+0000","last_fullsized":"2024-09-12T01:22:14.828572+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'300","last_scrub_stamp":"2024-09-12T01:22:14.828161+0000","last_deep_scrub":"265'300","last_deep_scrub_stamp":"2024-09-12T01:22:14.828161+0000","last_clean_scrub_stamp":"2024-09-12T01:22:14.828161+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:57.972569+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":466,"num_read_kb":37317,"num_write":980,"num_write_kb":22412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'445","reported_seq":1082,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:24.476301+0000","last_change":"2024-09-12T01:22:24.476301+0000","last_active":"2024-09-12T01:22:24.476301+0000","last_peered":"2024-09-12T01:22:24.476301+0000","last_clean":"2024-09-12T01:22:24.476301+0000","last_became_active":"2024-09-12T00:35:45.941136+0000","last_became_peered":"2024-09-12T00:35:45.941136+0000","last_unstale":"2024-09-12T01:22:24.476301+0000","last_undegraded":"2024-09-12T01:22:24.476301+0000","last_fullsized":"2024-09-12T01:22:24.476301+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'445","last_scrub_stamp":"2024-09-12T01:22:24.476113+0000","last_deep_scrub":"265'445","last_deep_scrub_stamp":"2024-09-12T01:22:24.476113+0000","last_clean_scrub_stamp":"2024-09-12T01:22:24.476113+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:41.227716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1924,"num_read_kb":1655,"num_write":712,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3143,"num_omap_keys":13,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'347","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:17.229317+0000","last_change":"2024-09-12T01:22:17.229188+0000","last_active":"2024-09-12T01:22:17.229317+0000","last_peered":"2024-09-12T01:22:17.229317+0000","last_clean":"2024-09-12T01:22:17.229317+0000","last_became_active":"2024-09-12T00:35:43.936772+0000","last_became_peered":"2024-09-12T00:35:43.936772+0000","last_unstale":"2024-09-12T01:22:17.229317+0000","last_undegraded":"2024-09-12T01:22:17.229317+0000","last_fullsized":"2024-09-12T01:22:17.229317+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T01:22:17.228996+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T01:22:17.228996+0000","last_clean_scrub_stamp":"2024-09-12T01:22:17.228996+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:58.587295+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":514466,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":11206,"num_write":1103,"num_write_kb":22250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'123","reported_seq":737,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:22:21.713240+0000","last_change":"2024-09-12T01:22:21.713240+0000","last_active":"2024-09-12T01:22:21.713240+0000","last_peered":"2024-09-12T01:22:21.713240+0000","last_clean":"2024-09-12T01:22:21.713240+0000","last_became_active":"2024-09-12T00:35:45.933748+0000","last_became_peered":"2024-09-12T00:35:45.933748+0000","last_unstale":"2024-09-12T01:22:21.713240+0000","last_undegraded":"2024-09-12T01:22:21.713240+0000","last_fullsized":"2024-09-12T01:22:21.713240+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'123","last_scrub_stamp":"2024-09-12T01:22:21.713057+0000","last_deep_scrub":"265'123","last_deep_scrub_stamp":"2024-09-12T01:22:21.713057+0000","last_clean_scrub_stamp":"2024-09-12T01:22:21.713057+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:00.223366+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":571,"num_read_kb":478,"num_write":188,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5965,"num_read_kb":4303,"num_write":1960,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6228,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":933,"ondisk_log_size":933,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":15013,"num_read_kb":14673,"num_write":16730,"num_write_kb":4883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2934,"num_omap_keys":19,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2153,"ondisk_log_size":2153,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":588,"ondisk_log_size":588,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1547252,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":17692,"num_read_kb":36824,"num_write":14761,"num_write_kb":11530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":683124,"num_omap_keys":1560,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1852,"ondisk_log_size":1852,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2433,"num_read_kb":2900,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102034,"num_read_kb":85265,"num_write":36996,"num_write_kb":18612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43837,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3949,"ondisk_log_size":3949,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":73603174,"num_objects":366,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":366,"num_whiteouts":0,"num_read":35859,"num_read_kb":1958475,"num_write":71400,"num_write_kb":2147647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":148455424,"data_stored":147206348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3894,"ondisk_log_size":3894,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":174261,"num_write":154,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":179336,"num_write":154,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424510021,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":135984,"kb_used_data":36832,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94235856,"statfs":{"total":96636764160,"available":96497516544,"internally_reserved":0,"allocated":37715968,"data_stored":35946887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510020,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280192,"kb_used_data":32432,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":94091648,"statfs":{"total":96636764160,"available":96349847552,"internally_reserved":0,"allocated":33210368,"data_stored":31432953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":253688263},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510022,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109536,"kb_used_data":10384,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94262304,"statfs":{"total":96636764160,"available":96524599296,"internally_reserved":0,"allocated":10633216,"data_stored":9073175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510021,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249396,"kb_used_data":29412,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94122444,"statfs":{"total":96636764160,"available":96381382656,"internally_reserved":0,"allocated":30117888,"data_stored":28384468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":225245637},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542724,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250016,"kb_used_data":20304,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94121824,"statfs":{"total":96636764160,"available":96380747776,"internally_reserved":0,"allocated":20791296,"data_stored":19046587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235207114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542723,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":228608,"kb_used_data":16944,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94143232,"statfs":{"total":96636764160,"available":96402669568,"internally_reserved":0,"allocated":17350656,"data_stored":15759617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":216725958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542724,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89728,"kb_used_data":14128,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94282112,"statfs":{"total":96636764160,"available":96544882688,"internally_reserved":0,"allocated":14467072,"data_stored":12799537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575427,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59444,"kb_used_data":14372,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94312396,"statfs":{"total":96636764160,"available":96575893504,"internally_reserved":0,"allocated":14716928,"data_stored":13117126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25833472,"data_stored":25645853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6983680,"data_stored":6928219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11079680,"data_stored":10970794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29499392,"data_stored":29284181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10829824,"data_stored":10653176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34000896,"data_stored":33800787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13717504,"data_stored":13613541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16510976,"data_stored":16309797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":4558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":6362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:23:27.291 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T01:23:27.630 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T01:23:27.630 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T01:23:27.630 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T01:23:27.631 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:23:27.727 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T01:23:27.727 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T01:23:27.727 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:23:30.258 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-12T01:23:33.829 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T01:23:33.830 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T01:23:33.830 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:23:33.904 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T01:23:33.904 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T01:23:33.904 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:23:36.166 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-12T01:23:36.166 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-12T01:23:40.006 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T01:23:40.006 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T01:23:40.006 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:23:40.077 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T01:23:40.078 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T01:23:40.078 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:23:40.171 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T01:23:40.172 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T01:23:40.172 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:23:40.264 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T01:23:40.264 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T01:23:40.264 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:23:40.365 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T01:23:40.365 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T01:23:40.366 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T01:23:40.366 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:23:40.394 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T01:23:40.394 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T01:23:40.394 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:23:40.425 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T01:23:40.426 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T01:23:40.426 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T01:23:40.426 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:23:40.472 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T01:23:40.473 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T01:23:40.473 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:23:40.534 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T01:23:40.535 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T01:23:40.535 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:23:40.556 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T01:23:40.556 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T01:23:40.556 DEBUG:teuthology.orchestra.run.smithi070:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T01:23:40.592 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-12T01:23:40.593 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T01:23:40.898 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-12T01:23:40.898 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T01:23:41.060 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-12T01:23:41.060 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T01:23:41.167 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-12T01:23:41.213 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-12T01:23:41.213 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T01:23:41.378 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi187.front.sepia.ceph.com 2024-09-12T01:23:41.379 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T01:23:41.836 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi187.front.sepia.ceph.com 2024-09-12T01:23:41.836 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T01:23:42.043 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi187.front.sepia.ceph.com 2024-09-12T01:23:42.043 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T01:23:42.195 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi187.front.sepia.ceph.com 2024-09-12T01:23:42.195 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T01:23:42.343 INFO:tasks.ceph:Archiving mon data... 2024-09-12T01:23:42.345 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901873/data/mon.a.tgz 2024-09-12T01:23:42.345 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-09-12T01:23:42.351 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.uYxYF0inqV 2024-09-12T01:23:42.351 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.uYxYF0inqV 2024-09-12T01:23:42.531 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.uYxYF0inqV 2024-09-12T01:23:42.593 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.uYxYF0inqV is 521KB 2024-09-12T01:23:42.659 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.uYxYF0inqV 2024-09-12T01:23:42.664 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901873/data/mon.c.tgz 2024-09-12T01:23:42.665 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-09-12T01:23:42.713 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.eMXc50TaxQ 2024-09-12T01:23:42.714 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.eMXc50TaxQ 2024-09-12T01:23:42.897 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.eMXc50TaxQ 2024-09-12T01:23:42.961 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.eMXc50TaxQ is 537KB 2024-09-12T01:23:43.023 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.eMXc50TaxQ 2024-09-12T01:23:43.028 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901873/data/mon.b.tgz 2024-09-12T01:23:43.029 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2024-09-12T01:23:43.035 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.zKglNDKraX 2024-09-12T01:23:43.035 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.zKglNDKraX 2024-09-12T01:23:43.223 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.zKglNDKraX 2024-09-12T01:23:43.288 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.zKglNDKraX is 537KB 2024-09-12T01:23:43.349 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.zKglNDKraX 2024-09-12T01:23:43.355 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T01:23:43.355 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T01:23:43.357 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T01:23:43.418 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T01:23:43.459 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T01:23:43.459 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T01:23:43.461 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901873/remote/smithi070/crash 2024-09-12T01:23:43.462 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T01:23:43.476 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901873/remote/smithi187/crash 2024-09-12T01:23:43.477 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T01:23:43.515 INFO:tasks.ceph:Compressing logs... 2024-09-12T01:23:43.516 DEBUG:teuthology.orchestra.run.smithi070:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:23:43.523 DEBUG:teuthology.orchestra.run.smithi187:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:23:43.547 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31282.log 2024-09-12T01:23:43.547 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110277.log 2024-09-12T01:23:43.548 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31282.log.gz 2024-09-12T01:23:43.548 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63015.log 2024-09-12T01:23:43.549 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.110277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33049.log 2024-09-12T01:23:43.549 INFO:teuthology.orchestra.run.smithi070.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.110277.log.gz 2024-09-12T01:23:43.549 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.63015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56553.log 2024-09-12T01:23:43.549 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.33049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121487.log 2024-09-12T01:23:43.551 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56553.log: gzip 20.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.56553.log.gz --verbose 2024-09-12T01:23:43.551 INFO:teuthology.orchestra.run.smithi070.stderr: -- /var/log/ceph/ceph-client.admin.157576.log 2024-09-12T01:23:43.551 INFO:teuthology.orchestra.run.smithi070.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.0.33049.log.gz 2024-09-12T01:23:43.551 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103196.log 2024-09-12T01:23:43.551 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.121487.log: /var/log/ceph/ceph-client.admin.157576.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63015.log.gz 2024-09-12T01:23:43.551 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157576.log.gz 2024-09-12T01:23:43.552 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30957.log 2024-09-12T01:23:43.552 INFO:teuthology.orchestra.run.smithi070.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.121487.log.gz 2024-09-12T01:23:43.552 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.103196.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T01:23:43.552 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30957.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.103196.log.gz 2024-09-12T01:23:43.552 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30957.log.gz 2024-09-12T01:23:43.552 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105556.log 2024-09-12T01:23:43.556 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31035.log 2024-09-12T01:23:43.556 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.105556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182937.log 2024-09-12T01:23:43.556 INFO:teuthology.orchestra.run.smithi070.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.105556.log.gz 2024-09-12T01:23:43.556 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31035.log.gz 2024-09-12T01:23:43.556 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65808.log 2024-09-12T01:23:43.556 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146269.log 2024-09-12T01:23:43.556 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.182937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182937.log.gz 2024-09-12T01:23:43.556 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45192.log 2024-09-12T01:23:43.556 INFO:teuthology.orchestra.run.smithi070.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.65808.log.gz 2024-09-12T01:23:43.557 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.146269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140369.log 2024-09-12T01:23:43.557 INFO:teuthology.orchestra.run.smithi070.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.146269.log.gz 2024-09-12T01:23:43.557 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.45192.log: -- /var/log/ceph/ceph-client.admin.131519.log 2024-09-12T01:23:43.557 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.140369.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.45192.log.gz 2024-09-12T01:23:43.557 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T01:23:43.557 INFO:teuthology.orchestra.run.smithi070.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.140369.log.gz 2024-09-12T01:23:43.557 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.131519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164269.log 2024-09-12T01:23:43.557 INFO:teuthology.orchestra.run.smithi070.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.131519.log.gz/var/log/ceph/ceph-mgr.y.log: 2024-09-12T01:23:43.557 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183197.log 2024-09-12T01:23:43.557 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.164269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53552.log 2024-09-12T01:23:43.557 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.183197.log: 91.8% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183197.log.gz -- replaced with /var/log/ceph/ceph-client.admin.164269.log.gz 2024-09-12T01:23:43.557 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-12T01:23:43.557 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55984.log 2024-09-12T01:23:43.562 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182989.log 2024-09-12T01:23:43.562 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53552.log: /var/log/ceph/ceph-client.admin.55984.log: 57.4% -- replaced with /var/log/ceph/ceph-client.admin.55984.log.gz 2024-09-12T01:23:43.562 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179616.log 2024-09-12T01:23:43.563 INFO:teuthology.orchestra.run.smithi070.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.53552.log.gz 2024-09-12T01:23:43.563 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127389.log/var/log/ceph/ceph-client.admin.182989.log: 2024-09-12T01:23:43.563 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182989.log.gz 2024-09-12T01:23:43.563 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.179616.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179616.log.gz 2024-09-12T01:23:43.563 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112047.log 2024-09-12T01:23:43.564 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.127389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127979.log 2024-09-12T01:23:43.564 INFO:teuthology.orchestra.run.smithi070.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.127389.log.gz 2024-09-12T01:23:43.564 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.112047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178413.log 2024-09-12T01:23:43.564 INFO:teuthology.orchestra.run.smithi070.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.112047.log.gz 2024-09-12T01:23:43.564 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.127979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183067.log 2024-09-12T01:23:43.564 INFO:teuthology.orchestra.run.smithi070.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.127979.log.gz 2024-09-12T01:23:43.564 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89031.log/var/log/ceph/ceph-client.admin.178413.log: 2024-09-12T01:23:43.565 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.183067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183067.log.gz 2024-09-12T01:23:43.565 INFO:teuthology.orchestra.run.smithi070.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.178413.log.gz 2024-09-12T01:23:43.565 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108507.log 2024-09-12T01:23:43.565 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56009.log 2024-09-12T01:23:43.565 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.89031.log: /var/log/ceph/ceph-client.admin.108507.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.89031.log.gz 2024-09-12T01:23:43.565 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30983.log 2024-09-12T01:23:43.566 INFO:teuthology.orchestra.run.smithi070.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.108507.log.gz 2024-09-12T01:23:43.566 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83131.log 2024-09-12T01:23:43.566 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56009.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T01:23:43.566 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30983.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.56009.log.gz 2024-09-12T01:23:43.566 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30983.log.gz 2024-09-12T01:23:43.566 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.83131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42732.log 2024-09-12T01:23:43.566 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80771.log 2024-09-12T01:23:43.607 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84901.log 2024-09-12T01:23:43.607 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42732.log.gz 2024-09-12T01:23:43.607 INFO:teuthology.orchestra.run.smithi070.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.83131.log.gz 2024-09-12T01:23:43.607 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.80771.log: -- /var/log/ceph/ceph-client.admin.149219.log 2024-09-12T01:23:43.607 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.84901.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.80771.log.gz 2024-09-12T01:23:43.608 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101426.log 2024-09-12T01:23:43.608 INFO:teuthology.orchestra.run.smithi070.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84901.log.gz 2024-09-12T01:23:43.608 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176951.log 2024-09-12T01:23:43.608 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.149219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136829.log 2024-09-12T01:23:43.608 INFO:teuthology.orchestra.run.smithi070.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.149219.log.gz/var/log/ceph/ceph-client.admin.101426.log: 2024-09-12T01:23:43.608 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.176951.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.101426.log.gz 2024-09-12T01:23:43.609 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183249.log 2024-09-12T01:23:43.609 INFO:teuthology.orchestra.run.smithi070.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.176951.log.gz 2024-09-12T01:23:43.609 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.136829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154551.log 2024-09-12T01:23:43.609 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.183249.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183249.log.gz 2024-09-12T01:23:43.609 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134469.log 2024-09-12T01:23:43.609 INFO:teuthology.orchestra.run.smithi070.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.136829.log.gz 2024-09-12T01:23:43.609 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48142.log 2024-09-12T01:23:43.609 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.154551.log: /var/log/ceph/ceph-client.admin.134469.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.154551.log.gz 2024-09-12T01:23:43.609 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30887.log 2024-09-12T01:23:43.609 INFO:teuthology.orchestra.run.smithi070.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.134469.log.gz 2024-09-12T01:23:43.609 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59145.log 2024-09-12T01:23:43.609 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48142.log: /var/log/ceph/ceph-client.admin.30887.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.48142.log.gz 2024-09-12T01:23:43.610 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30887.log.gz 2024-09-12T01:23:43.610 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180329.log 2024-09-12T01:23:43.610 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75461.log 2024-09-12T01:23:43.610 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.180329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180329.log.gz 2024-09-12T01:23:43.610 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85491.log 2024-09-12T01:23:43.610 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153371.log 2024-09-12T01:23:43.610 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.75461.log: /var/log/ceph/ceph-client.admin.85491.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.75461.log.gz 2024-09-12T01:23:43.610 INFO:teuthology.orchestra.run.smithi070.stderr:gzip 82.2% -- replaced with /var/log/ceph/ceph-client.admin.85491.log.gz 2024-09-12T01:23:43.610 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.139189.log 2024-09-12T01:23:43.610 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.153371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31495.log 2024-09-12T01:23:43.610 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.139189.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.153371.log.gz 2024-09-12T01:23:43.610 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167498.log 2024-09-12T01:23:43.610 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31495.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31495.log.gz 2024-09-12T01:23:43.610 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31294.log 2024-09-12T01:23:43.611 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.167498.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.139189.log.gz 2024-09-12T01:23:43.611 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26697.log 2024-09-12T01:23:43.611 INFO:teuthology.orchestra.run.smithi070.stderr:gzip/var/log/ceph/ceph-client.admin.31294.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.167498.log.gz 2024-09-12T01:23:43.611 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31294.log.gz 2024-09-12T01:23:43.611 INFO:teuthology.orchestra.run.smithi070.stderr: -- /var/log/ceph/ceph-client.admin.163552.log 2024-09-12T01:23:43.611 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26697.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26697.log.gz 2024-09-12T01:23:43.611 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182963.log 2024-09-12T01:23:43.611 INFO:teuthology.orchestra.run.smithi070.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.59145.log.gz 2024-09-12T01:23:43.611 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.163552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113817.log 2024-09-12T01:23:43.611 INFO:teuthology.orchestra.run.smithi070.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.163552.log.gz 2024-09-12T01:23:43.611 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.182963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32950.log 2024-09-12T01:23:43.611 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182963.log.gz 2024-09-12T01:23:43.611 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31503.log 2024-09-12T01:23:43.612 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.113817.log: /var/log/ceph/ceph-client.admin.32950.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.113817.log.gz 2024-09-12T01:23:43.612 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32950.log.gz 2024-09-12T01:23:43.612 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147449.log 2024-09-12T01:23:43.612 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93754.log 2024-09-12T01:23:43.612 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31503.log.gz 2024-09-12T01:23:43.612 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.147449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174001.log 2024-09-12T01:23:43.612 INFO:teuthology.orchestra.run.smithi070.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.147449.log.gz/var/log/ceph/ceph-client.admin.93754.log: 2024-09-12T01:23:43.612 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26931.log 2024-09-12T01:23:43.612 INFO:teuthology.orchestra.run.smithi070.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.93754.log.gz 2024-09-12T01:23:43.612 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.174001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94344.log 2024-09-12T01:23:43.612 INFO:teuthology.orchestra.run.smithi070.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.0.174001.log.gz 2024-09-12T01:23:43.612 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.26931.log: -- /var/log/ceph/ceph-client.admin.31893.log 2024-09-12T01:23:43.613 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26931.log.gz 2024-09-12T01:23:43.613 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.94344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31280.log 2024-09-12T01:23:43.613 INFO:teuthology.orchestra.run.smithi070.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.94344.log.gz 2024-09-12T01:23:43.613 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31088.log 2024-09-12T01:23:43.613 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31893.log.gz 2024-09-12T01:23:43.613 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31009.log 2024-09-12T01:23:43.613 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31280.log.gz 2024-09-12T01:23:43.613 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31088.log.gz 2024-09-12T01:23:43.613 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T01:23:43.613 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114997.log 2024-09-12T01:23:43.613 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31009.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31009.log.gz 2024-09-12T01:23:43.613 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183015.log 2024-09-12T01:23:43.613 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.114997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.159679.log 2024-09-12T01:23:43.614 INFO:teuthology.orchestra.run.smithi070.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.114997.log.gz 2024-09-12T01:23:43.614 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.183015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153961.log 2024-09-12T01:23:43.614 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183015.log.gz 2024-09-12T01:23:43.614 INFO:teuthology.orchestra.run.smithi070.stderr:gzip/var/log/ceph/ceph-client.0.159679.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.156371.log 2024-09-12T01:23:43.614 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.153961.log: 84.5% -- replaced with /var/log/ceph/ceph-client.0.159679.log.gz 2024-09-12T01:23:43.614 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142729.log 81.5% -- replaced with /var/log/ceph/ceph-client.admin.153961.log.gz 2024-09-12T01:23:43.614 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-12T01:23:43.614 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.156371.log: gzip -5 82.7% -- replaced with /var/log/ceph/ceph-client.admin.156371.log.gz 2024-09-12T01:23:43.614 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53502.log 2024-09-12T01:23:43.614 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.142729.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.142729.log.gz 2024-09-12T01:23:43.614 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120307.log 2024-09-12T01:23:43.614 INFO:teuthology.orchestra.run.smithi070.stderr:gzip/var/log/ceph/ceph-client.admin.53502.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.162374.log 2024-09-12T01:23:43.614 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53502.log.gz 2024-09-12T01:23:43.615 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.120307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31732.log 2024-09-12T01:23:43.615 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.162374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88441.log 2024-09-12T01:23:43.615 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31732.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.162374.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31732.log.gz 2024-09-12T01:23:43.615 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-12T01:23:43.615 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104966.log 2024-09-12T01:23:43.615 INFO:teuthology.orchestra.run.smithi070.stderr: 95.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T01:23:43.615 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183301.log 2024-09-12T01:23:43.615 INFO:teuthology.orchestra.run.smithi070.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.120307.log.gz 2024-09-12T01:23:43.615 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.88441.log: /var/log/ceph/ceph-client.admin.104966.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.88441.log.gz 2024-09-12T01:23:43.615 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66989.log 2024-09-12T01:23:43.615 INFO:teuthology.orchestra.run.smithi070.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.104966.log.gz 2024-09-12T01:23:43.615 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.183301.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T01:23:43.615 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183301.log.gz 2024-09-12T01:23:43.616 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168099.log 2024-09-12T01:23:43.616 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43372.log 2024-09-12T01:23:43.616 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.168099.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33026.log 2024-09-12T01:23:43.616 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66989.log.gz 2024-09-12T01:23:43.616 INFO:teuthology.orchestra.run.smithi070.stderr: 84.7%/var/log/ceph/ceph-client.admin.43372.log: -- replaced with /var/log/ceph/ceph-client.0.168099.log.gz 2024-09-12T01:23:43.616 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182911.log 2024-09-12T01:23:43.616 INFO:teuthology.orchestra.run.smithi070.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.43372.log.gz 2024-09-12T01:23:43.616 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160271.log 2024-09-12T01:23:43.616 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33026.log.gz 2024-09-12T01:23:43.616 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.182911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177541.log 2024-09-12T01:23:43.616 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182911.log.gz 2024-09-12T01:23:43.616 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.160271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42782.log 2024-09-12T01:23:43.616 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.177541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183327.log 2024-09-12T01:23:43.616 INFO:teuthology.orchestra.run.smithi070.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.0.177541.log.gz 2024-09-12T01:23:43.617 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26844.log 2024-09-12T01:23:43.617 INFO:teuthology.orchestra.run.smithi070.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.42782.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183041.log 2024-09-12T01:23:43.617 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-12T01:23:43.617 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.183327.log: /var/log/ceph/ceph-client.admin.26844.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183327.log.gz 2024-09-12T01:23:43.617 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26844.log.gz 2024-09-12T01:23:43.617 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102606.log 2024-09-12T01:23:43.617 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.183041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86081.log 2024-09-12T01:23:43.617 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183041.log.gz 2024-09-12T01:23:43.617 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.102606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31288.log 2024-09-12T01:23:43.617 INFO:teuthology.orchestra.run.smithi070.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.102606.log.gz 2024-09-12T01:23:43.617 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36582.log 2024-09-12T01:23:43.617 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.86081.log: /var/log/ceph/ceph-client.admin.31288.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31288.log.gz 2024-09-12T01:23:43.618 INFO:teuthology.orchestra.run.smithi070.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.86081.log.gz 2024-09-12T01:23:43.618 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119127.log 2024-09-12T01:23:43.618 INFO:teuthology.orchestra.run.smithi070.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.160271.log.gz 2024-09-12T01:23:43.618 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.36582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34821.log 2024-09-12T01:23:43.618 INFO:teuthology.orchestra.run.smithi070.stderr: 44.2% -- replaced with /var/log/ceph/ceph-client.0.36582.log.gz 2024-09-12T01:23:43.618 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.119127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171051.log 2024-09-12T01:23:43.618 INFO:teuthology.orchestra.run.smithi070.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.119127.log.gz 2024-09-12T01:23:43.618 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.34821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129749.log 2024-09-12T01:23:43.618 INFO:teuthology.orchestra.run.smithi070.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.34821.log.gz 2024-09-12T01:23:43.618 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.171051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30912.log 2024-09-12T01:23:43.618 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.129749.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.171051.log.gz 2024-09-12T01:23:43.618 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130339.log 2024-09-12T01:23:43.618 INFO:teuthology.orchestra.run.smithi070.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.129749.log.gz 2024-09-12T01:23:43.618 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96114.log 2024-09-12T01:23:43.619 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30912.log.gz 2024-09-12T01:23:43.619 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.130339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45142.log 2024-09-12T01:23:43.619 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.96114.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.130339.log.gz 2024-09-12T01:23:43.619 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77231.log 2024-09-12T01:23:43.619 INFO:teuthology.orchestra.run.smithi070.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96114.log.gz 2024-09-12T01:23:43.619 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94934.log 2024-09-12T01:23:43.619 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45142.log.gz 2024-09-12T01:23:43.619 INFO:teuthology.orchestra.run.smithi070.stderr:gzip/var/log/ceph/ceph-client.admin.77231.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.68761.log 2024-09-12T01:23:43.619 INFO:teuthology.orchestra.run.smithi070.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.77231.log.gz 2024-09-12T01:23:43.619 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.94934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143909.log 2024-09-12T01:23:43.619 INFO:teuthology.orchestra.run.smithi070.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.94934.log.gz 2024-09-12T01:23:43.619 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.68761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89621.log 2024-09-12T01:23:43.619 INFO:teuthology.orchestra.run.smithi070.stderr: 23.5% -- replaced with /var/log/ceph/ceph-client.admin.68761.log.gz 2024-09-12T01:23:43.620 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.143909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180355.log 2024-09-12T01:23:43.620 INFO:teuthology.orchestra.run.smithi070.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.143909.log.gz 2024-09-12T01:23:43.620 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.89621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86671.log 2024-09-12T01:23:43.620 INFO:teuthology.orchestra.run.smithi070.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.89621.log.gz 2024-09-12T01:23:43.620 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.180355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169279.log 2024-09-12T01:23:43.620 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180355.log.gz 2024-09-12T01:23:43.620 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.86671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150989.log 2024-09-12T01:23:43.620 INFO:teuthology.orchestra.run.smithi070.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.86671.log.gz 2024-09-12T01:23:43.620 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.169279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144499.log 2024-09-12T01:23:43.620 INFO:teuthology.orchestra.run.smithi070.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.0.169279.log.gz 2024-09-12T01:23:43.621 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.150989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180279.log 2024-09-12T01:23:43.621 INFO:teuthology.orchestra.run.smithi070.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.150989.log.gz 2024-09-12T01:23:43.621 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.144499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63661.log 2024-09-12T01:23:43.621 INFO:teuthology.orchestra.run.smithi070.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.144499.log.gz/var/log/ceph/ceph-client.admin.180279.log: 2024-09-12T01:23:43.621 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168689.log 2024-09-12T01:23:43.621 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180279.log.gz 2024-09-12T01:23:43.621 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.63661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42757.log 2024-09-12T01:23:43.621 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.168689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56616.log 2024-09-12T01:23:43.621 INFO:teuthology.orchestra.run.smithi070.stderr: 84.7%/var/log/ceph/ceph-client.admin.42757.log: -- replaced with /var/log/ceph/ceph-client.0.168689.log.gz 2024-09-12T01:23:43.621 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31502.log 2024-09-12T01:23:43.621 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42757.log.gz 2024-09-12T01:23:43.621 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135649.log 2024-09-12T01:23:43.621 INFO:teuthology.orchestra.run.smithi070.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63661.log.gz/var/log/ceph/ceph-client.admin.56616.log: 2024-09-12T01:23:43.622 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48732.log 2024-09-12T01:23:43.622 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31502.log.gz 2024-09-12T01:23:43.622 INFO:teuthology.orchestra.run.smithi070.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.56616.log.gz 2024-09-12T01:23:43.622 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.135649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152781.log 2024-09-12T01:23:43.622 INFO:teuthology.orchestra.run.smithi070.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.135649.log.gz 2024-09-12T01:23:43.622 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128569.log 2024-09-12T01:23:43.622 INFO:teuthology.orchestra.run.smithi070.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.48732.log.gz 2024-09-12T01:23:43.622 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.152781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145089.log 2024-09-12T01:23:43.622 INFO:teuthology.orchestra.run.smithi070.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.152781.log.gz 2024-09-12T01:23:43.622 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.128569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31693.log 2024-09-12T01:23:43.622 INFO:teuthology.orchestra.run.smithi070.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.128569.log.gz 2024-09-12T01:23:43.622 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.145089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157551.log 2024-09-12T01:23:43.622 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31481.log 2024-09-12T01:23:43.622 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31693.log.gz 2024-09-12T01:23:43.623 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.157551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51732.log 2024-09-12T01:23:43.623 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157551.log.gz 2024-09-12T01:23:43.623 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61080.log 2024-09-12T01:23:43.623 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31481.log.gz 2024-09-12T01:23:43.623 INFO:teuthology.orchestra.run.smithi070.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.145089.log.gz 2024-09-12T01:23:43.623 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31689.log 2024-09-12T01:23:43.623 INFO:teuthology.orchestra.run.smithi070.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.51732.log.gz 2024-09-12T01:23:43.623 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.61080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155141.log 2024-09-12T01:23:43.623 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50502.log 2024-09-12T01:23:43.624 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31689.log.gz 2024-09-12T01:23:43.624 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.155141.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T01:23:43.624 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50502.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.155141.log.gz 2024-09-12T01:23:43.624 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31945.log 2024-09-12T01:23:43.624 INFO:teuthology.orchestra.run.smithi070.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.50502.log.gz 2024-09-12T01:23:43.624 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.3.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.61080.log.gz 2024-09-12T01:23:43.634 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26767.log 2024-09-12T01:23:43.634 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T01:23:43.634 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.26767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26767.log.gz 2024-09-12T01:23:43.634 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T01:23:43.634 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26863.log 2024-09-12T01:23:43.634 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T01:23:43.634 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.26863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26791.log 2024-09-12T01:23:43.634 INFO:teuthology.orchestra.run.smithi187.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26863.log.gz 2024-09-12T01:23:43.634 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26695.log 2024-09-12T01:23:43.634 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.26791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26791.log.gz 2024-09-12T01:23:43.634 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26815.log 2024-09-12T01:23:43.635 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26719.log 2024-09-12T01:23:43.635 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.26695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26695.log.gz 2024-09-12T01:23:43.635 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.26815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26815.log.gz 2024-09-12T01:23:43.635 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T01:23:43.635 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T01:23:43.635 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.26719.log: /var/log/ceph/ceph-mgr.x.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26719.log.gz 2024-09-12T01:23:43.635 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26839.log 2024-09-12T01:23:43.635 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26743.log 2024-09-12T01:23:43.635 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.26839.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T01:23:43.635 INFO:teuthology.orchestra.run.smithi187.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26839.log.gz 2024-09-12T01:23:43.635 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.26743.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T01:23:43.635 INFO:teuthology.orchestra.run.smithi187.stderr: -- replaced with /var/log/ceph/ceph-client.admin.26743.log.gz 2024-09-12T01:23:43.635 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T01:23:43.636 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 90.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T01:23:43.636 INFO:teuthology.orchestra.run.smithi187.stderr: 87.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T01:23:43.646 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98474.log 2024-09-12T01:23:43.646 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149809.log 2024-09-12T01:23:43.646 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31945.log.gz 2024-09-12T01:23:43.646 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.98474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180256.log 2024-09-12T01:23:43.646 INFO:teuthology.orchestra.run.smithi070.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.98474.log.gz 2024-09-12T01:23:43.646 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166909.log 2024-09-12T01:23:43.646 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.149809.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.149809.log.gz 2024-09-12T01:23:43.646 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.180256.log: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.180256.log.gz 2024-09-12T01:23:43.646 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33000.log 2024-09-12T01:23:43.646 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.166909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31685.log 2024-09-12T01:23:43.647 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171641.log 2024-09-12T01:23:43.647 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33000.log.gz 2024-09-12T01:23:43.647 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31685.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31685.log.gz 2024-09-12T01:23:43.647 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109097.log 2024-09-12T01:23:43.647 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.171641.log: 90.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175181.log 2024-09-12T01:23:43.647 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.166909.log.gz 2024-09-12T01:23:43.647 INFO:teuthology.orchestra.run.smithi070.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.0.171641.log.gz 2024-09-12T01:23:43.647 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.109097.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.109097.log.gz 2024-09-12T01:23:43.647 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183379.log 2024-09-12T01:23:43.647 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.175181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143319.log 2024-09-12T01:23:43.647 INFO:teuthology.orchestra.run.smithi070.stderr: 84.8%/var/log/ceph/ceph-client.admin.183379.log: -- replaced with /var/log/ceph/ceph-client.0.175181.log.gz 2024-09-12T01:23:43.647 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172821.log 2024-09-12T01:23:43.647 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183379.log.gz 2024-09-12T01:23:43.647 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.143319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107917.log 2024-09-12T01:23:43.648 INFO:teuthology.orchestra.run.smithi070.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.143319.log.gz 2024-09-12T01:23:43.648 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.172821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40372.log 2024-09-12T01:23:43.648 INFO:teuthology.orchestra.run.smithi070.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.0.172821.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56580.log 2024-09-12T01:23:43.648 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-12T01:23:43.648 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.107917.log: /var/log/ceph/ceph-client.admin.40372.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.107917.log.gz 2024-09-12T01:23:43.648 INFO:teuthology.orchestra.run.smithi070.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.40372.log.gz 2024-09-12T01:23:43.648 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140959.log 2024-09-12T01:23:43.648 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87261.log 2024-09-12T01:23:43.648 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56580.log: /var/log/ceph/ceph-client.admin.140959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68809.log 2024-09-12T01:23:43.648 INFO:teuthology.orchestra.run.smithi070.stderr: 21.6% -- replaced with /var/log/ceph/ceph-client.admin.56580.log.gz 2024-09-12T01:23:43.648 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.87261.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.140959.log.gz 2024-09-12T01:23:43.648 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175771.log 2024-09-12T01:23:43.648 INFO:teuthology.orchestra.run.smithi070.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.87261.log.gz 2024-09-12T01:23:43.649 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.68809.log: 84.6% -- replaced with /var/log/ceph/ceph-client.0.68809.log.gz 2024-09-12T01:23:43.649 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135059.log 2024-09-12T01:23:43.649 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.175771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30937.log 2024-09-12T01:23:43.649 INFO:teuthology.orchestra.run.smithi070.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.0.175771.log.gz/var/log/ceph/ceph-client.admin.135059.log: 2024-09-12T01:23:43.649 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59790.log 2024-09-12T01:23:43.649 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30937.log.gz 2024-09-12T01:23:43.649 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-12T01:23:43.649 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114407.log 2024-09-12T01:23:43.649 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59790.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.135059.log.gz 2024-09-12T01:23:43.649 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-12T01:23:43.649 INFO:teuthology.orchestra.run.smithi070.stderr: 93.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49322.log 2024-09-12T01:23:43.649 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59790.log.gz 2024-09-12T01:23:43.649 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170461.log 2024-09-12T01:23:43.649 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.114407.log: /var/log/ceph/ceph-client.admin.49322.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T01:23:43.650 INFO:teuthology.orchestra.run.smithi070.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.49322.log.gz 2024-09-12T01:23:43.650 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.170461.log: 81.2% -- replaced with /var/log/ceph/ceph-client.0.170461.log.gz 2024-09-12T01:23:43.650 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138009.log 2024-09-12T01:23:43.650 INFO:teuthology.orchestra.run.smithi070.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.114407.log.gz 2024-09-12T01:23:43.650 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181574.log 2024-09-12T01:23:43.650 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.138009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55623.log 2024-09-12T01:23:43.650 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.181574.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.138009.log.gz 2024-09-12T01:23:43.650 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87851.log 2024-09-12T01:23:43.650 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55623.log: 56.7% -- replaced with /var/log/ceph/ceph-client.admin.55623.log.gz 2024-09-12T01:23:43.650 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42142.log 2024-09-12T01:23:43.650 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.87851.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.87851.log.gz 2024-09-12T01:23:43.650 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136239.log 2024-09-12T01:23:43.650 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42142.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.42142.log.gz 2024-09-12T01:23:43.650 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126799.log 2024-09-12T01:23:43.651 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.136239.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.136239.log.gz 2024-09-12T01:23:43.651 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66397.log 2024-09-12T01:23:43.651 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.126799.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.126799.log.gz 2024-09-12T01:23:43.651 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118537.log 2024-09-12T01:23:43.651 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66397.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.66397.log.gz 2024-09-12T01:23:43.651 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34231.log 2024-09-12T01:23:43.651 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.118537.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118537.log.gz 2024-09-12T01:23:43.651 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79001.log 2024-09-12T01:23:43.651 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.34231.log: 81.7% -- replaced with /var/log/ceph/ceph-client.0.34231.log.gz 2024-09-12T01:23:43.651 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106736.log 2024-09-12T01:23:43.651 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.79001.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.79001.log.gz 2024-09-12T01:23:43.651 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90801.log 2024-09-12T01:23:43.651 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.106736.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.106736.log.gz 2024-09-12T01:23:43.655 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165447.log 2024-09-12T01:23:43.655 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.90801.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.90801.log.gz 2024-09-12T01:23:43.655 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71331.log 2024-09-12T01:23:43.655 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.165447.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.165447.log.gz 2024-09-12T01:23:43.655 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80181.log 2024-09-12T01:23:43.655 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.71331.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.71331.log.gz 2024-09-12T01:23:43.655 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31477.log 2024-09-12T01:23:43.655 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.80181.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.80181.log.gz 2024-09-12T01:23:43.656 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76641.log 2024-09-12T01:23:43.656 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31477.log.gz 2024-09-12T01:23:43.656 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31729.log 2024-09-12T01:23:43.656 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.76641.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.76641.log.gz 2024-09-12T01:23:43.656 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146859.log 2024-09-12T01:23:43.656 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31729.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31729.log.gz 2024-09-12T01:23:43.656 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52912.log 2024-09-12T01:23:43.657 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.146859.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.146859.log.gz 2024-09-12T01:23:43.657 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162963.log 2024-09-12T01:23:43.659 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52912.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.52912.log.gz 2024-09-12T01:23:43.659 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117357.log 2024-09-12T01:23:43.661 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.162963.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.162963.log.gz 2024-09-12T01:23:43.661 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107326.log 2024-09-12T01:23:43.661 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.117357.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.117357.log.gz 2024-09-12T01:23:43.661 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145679.log 2024-09-12T01:23:43.666 INFO:teuthology.orchestra.run.smithi070.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.0.181574.log.gz 2024-09-12T01:23:43.666 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.107326.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.107326.log.gz 2024-09-12T01:23:43.666 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31731.log 2024-09-12T01:23:43.666 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.145679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113227.log 2024-09-12T01:23:43.666 INFO:teuthology.orchestra.run.smithi070.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.145679.log.gz 2024-09-12T01:23:43.667 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31731.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61725.log 2024-09-12T01:23:43.667 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31731.log.gz 2024-09-12T01:23:43.667 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.113227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95524.log 2024-09-12T01:23:43.667 INFO:teuthology.orchestra.run.smithi070.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.113227.log.gz 2024-09-12T01:23:43.667 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54142.log 2024-09-12T01:23:43.667 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.61725.log: /var/log/ceph/ceph-client.admin.95524.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.95524.log.gz 2024-09-12T01:23:43.677 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31087.log 2024-09-12T01:23:43.679 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54142.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.54142.log.gz 2024-09-12T01:23:43.679 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138599.log 2024-09-12T01:23:43.680 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31087.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31087.log.gz 2024-09-12T01:23:43.682 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55385.log 2024-09-12T01:23:43.682 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.138599.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.138599.log.gz 2024-09-12T01:23:43.682 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69399.log 2024-09-12T01:23:43.682 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55385.log: 57.1% -- replaced with /var/log/ceph/ceph-client.admin.55385.log.gz 2024-09-12T01:23:43.683 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139779.log 2024-09-12T01:23:43.685 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.69399.log: 84.6% -- replaced with /var/log/ceph/ceph-client.0.69399.log.gz 2024-09-12T01:23:43.685 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T01:23:43.685 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.139779.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.139779.log.gz 2024-09-12T01:23:43.686 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137419.log 2024-09-12T01:23:43.690 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.log: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.61725.log.gz 2024-09-12T01:23:43.693 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55932.log 2024-09-12T01:23:43.694 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.137419.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.137419.log.gz 2024-09-12T01:23:43.694 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31919.log 2024-09-12T01:23:43.695 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55932.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55932.log.gz 2024-09-12T01:23:43.695 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46962.log 2024-09-12T01:23:43.696 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31919.log: 0.0% 93.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T01:23:43.696 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31919.log.gz 2024-09-12T01:23:43.696 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183119.log 2024-09-12T01:23:43.697 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155731.log 2024-09-12T01:23:43.699 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46962.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.46962.log.gz 2024-09-12T01:23:43.699 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.183119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183119.log.gz 2024-09-12T01:23:43.699 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122669.log 2024-09-12T01:23:43.699 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.155731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174591.log 2024-09-12T01:23:43.699 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155731.log.gz 2024-09-12T01:23:43.699 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.122669.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.122669.log.gz 2024-09-12T01:23:43.700 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109687.log 2024-09-12T01:23:43.700 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99654.log 2024-09-12T01:23:43.700 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.174591.log: /var/log/ceph/ceph-client.admin.109687.log: 84.5% -- replaced with /var/log/ceph/ceph-client.0.174591.log.gz 2024-09-12T01:23:43.701 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82541.log 2024-09-12T01:23:43.701 INFO:teuthology.orchestra.run.smithi070.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.109687.log.gz 2024-09-12T01:23:43.702 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.99654.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.99654.log.gz 2024-09-12T01:23:43.702 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72511.log 2024-09-12T01:23:43.703 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46372.log 2024-09-12T01:23:43.704 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.82541.log: /var/log/ceph/ceph-client.admin.72511.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.82541.log.gz 2024-09-12T01:23:43.704 INFO:teuthology.orchestra.run.smithi070.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.72511.log.gz 2024-09-12T01:23:43.704 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91391.log 2024-09-12T01:23:43.705 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78411.log 2024-09-12T01:23:43.705 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46372.log: /var/log/ceph/ceph-client.admin.91391.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.46372.log.gz 2024-09-12T01:23:43.705 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37166.log 2024-09-12T01:23:43.706 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.78411.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.91391.log.gz 2024-09-12T01:23:43.706 INFO:teuthology.orchestra.run.smithi070.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.78411.log.gz 2024-09-12T01:23:43.706 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157601.log 2024-09-12T01:23:43.707 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51092.log 2024-09-12T01:23:43.707 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.37166.log: /var/log/ceph/ceph-client.admin.157601.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.37166.log.gz 2024-09-12T01:23:43.707 INFO:teuthology.orchestra.run.smithi070.stderr:gzip 89.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.157601.log.gz --verbose 2024-09-12T01:23:43.708 INFO:teuthology.orchestra.run.smithi070.stderr: -- /var/log/ceph/ceph-client.admin.31069.log 2024-09-12T01:23:43.708 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51092.log.gz 2024-09-12T01:23:43.708 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183534.log 2024-09-12T01:23:43.709 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180977.log 2024-09-12T01:23:43.709 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31069.log.gz 2024-09-12T01:23:43.710 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.183534.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74281.log 2024-09-12T01:23:43.710 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.183534.log.gz 2024-09-12T01:23:43.710 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.180977.log: 81.1% -- replaced with /var/log/ceph/ceph-client.0.180977.log.gz 2024-09-12T01:23:43.711 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169871.log 2024-09-12T01:23:43.711 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133289.log 2024-09-12T01:23:43.712 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.74281.log: /var/log/ceph/ceph-client.0.169871.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.74281.log.gz 2024-09-12T01:23:43.712 INFO:teuthology.orchestra.run.smithi070.stderr: 84.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152759.log 2024-09-12T01:23:43.712 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.0.169871.log.gz 2024-09-12T01:23:43.712 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.133289.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.133289.log.gz 2024-09-12T01:23:43.713 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96704.log 2024-09-12T01:23:43.713 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124439.log 2024-09-12T01:23:43.714 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.152759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152759.log.gz 2024-09-12T01:23:43.714 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.96704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141549.log 2024-09-12T01:23:43.714 INFO:teuthology.orchestra.run.smithi070.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.96704.log.gz 2024-09-12T01:23:43.714 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.124439.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.124439.log.gz 2024-09-12T01:23:43.715 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123849.log 2024-09-12T01:23:43.715 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183457.log 2024-09-12T01:23:43.716 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.141549.log: /var/log/ceph/ceph-client.admin.123849.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.141549.log.gz 2024-09-12T01:23:43.716 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126209.log 2024-09-12T01:23:43.716 INFO:teuthology.orchestra.run.smithi070.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.123849.log.gz 2024-09-12T01:23:43.716 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.183457.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183457.log.gz 2024-09-12T01:23:43.717 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T01:23:43.717 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183483.log 2024-09-12T01:23:43.718 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.126209.log: /var/log/ceph/ceph-mon.c.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.126209.log.gz 2024-09-12T01:23:43.718 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129159.log 2024-09-12T01:23:43.718 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.183483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183483.log.gz 2024-09-12T01:23:43.719 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183171.log 2024-09-12T01:23:43.719 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.129159.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.129159.log.gz 2024-09-12T01:23:43.719 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55890.log 2024-09-12T01:23:43.720 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.183171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183171.log.gz 2024-09-12T01:23:43.721 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31733.log 2024-09-12T01:23:43.721 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55890.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.55890.log.gz 2024-09-12T01:23:43.722 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116177.log 2024-09-12T01:23:43.724 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31733.log.gz 2024-09-12T01:23:43.724 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164858.log 2024-09-12T01:23:43.724 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.116177.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.116177.log.gz 2024-09-12T01:23:43.725 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155756.log 2024-09-12T01:23:43.725 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.164858.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.164858.log.gz 2024-09-12T01:23:43.725 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31295.log 2024-09-12T01:23:43.726 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.155756.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155756.log.gz 2024-09-12T01:23:43.726 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110867.log 2024-09-12T01:23:43.727 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31295.log.gz 2024-09-12T01:23:43.728 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151579.log 2024-09-12T01:23:43.728 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.110867.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110867.log.gz 2024-09-12T01:23:43.729 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31504.log 2024-09-12T01:23:43.730 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.151579.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.151579.log.gz 2024-09-12T01:23:43.730 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49912.log 2024-09-12T01:23:43.731 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31504.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31504.log.gz 2024-09-12T01:23:43.731 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125029.log 2024-09-12T01:23:43.732 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49912.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.49912.log.gz 2024-09-12T01:23:43.732 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100244.log 2024-09-12T01:23:43.733 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.125029.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125029.log.gz 2024-09-12T01:23:43.733 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31086.log 2024-09-12T01:23:43.734 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.100244.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.100244.log.gz 2024-09-12T01:23:43.734 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104376.log 2024-09-12T01:23:43.735 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31086.log.gz 2024-09-12T01:23:43.736 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32976.log 2024-09-12T01:23:43.736 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.104376.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.104376.log.gz 2024-09-12T01:23:43.737 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100834.log 2024-09-12T01:23:43.738 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.32976.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32976.log.gz 2024-09-12T01:23:43.738 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125619.log 2024-09-12T01:23:43.739 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.100834.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.100834.log.gz 2024-09-12T01:23:43.739 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31730.log 2024-09-12T01:23:43.740 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.125619.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.125619.log.gz 2024-09-12T01:23:43.740 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180304.log 2024-09-12T01:23:43.741 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31730.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31730.log.gz 2024-09-12T01:23:43.741 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T01:23:43.742 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.180304.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180304.log.gz 2024-09-12T01:23:43.742 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57205.log 2024-09-12T01:23:43.757 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39096.log 2024-09-12T01:23:43.765 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31289.log 2024-09-12T01:23:43.766 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39096.log: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.39096.log.gz 2024-09-12T01:23:43.773 INFO:teuthology.orchestra.run.smithi070.stderr: 94.0%gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T01:23:43.774 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31289.log.gz 2024-09-12T01:23:43.781 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172231.log 2024-09-12T01:23:43.785 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.audit.log: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.57205.log.gz 2024-09-12T01:23:43.797 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T01:23:43.813 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81951.log 2024-09-12T01:23:43.813 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.172231.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.172231.log.gz 2024-09-12T01:23:43.821 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68170.log 2024-09-12T01:23:43.821 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.81951.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.81951.log.gz 2024-09-12T01:23:43.829 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70076.log 2024-09-12T01:23:43.829 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.68170.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.68170.log.gz 2024-09-12T01:23:43.837 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132699.log 2024-09-12T01:23:43.840 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.70076.log: 92.0% -- replaced with /var/log/ceph/ceph-client.0.70076.log.gz 2024-09-12T01:23:43.845 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47552.log 2024-09-12T01:23:43.845 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.132699.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.132699.log.gz 2024-09-12T01:23:43.853 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70037.log 2024-09-12T01:23:43.853 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47552.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.47552.log.gz 2024-09-12T01:23:43.869 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33647.log 2024-09-12T01:23:43.869 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.70037.log: 52.7% -- replaced with /var/log/ceph/ceph-client.admin.70037.log.gz 2024-09-12T01:23:43.881 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183431.log 2024-09-12T01:23:43.881 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.33647.log: 44.2% -- replaced with /var/log/ceph/ceph-client.0.33647.log.gz 2024-09-12T01:23:43.889 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133879.log 2024-09-12T01:23:43.889 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.183431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183431.log.gz 2024-09-12T01:23:43.895 INFO:teuthology.orchestra.run.smithi070.stderr: 94.5% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T01:23:43.895 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31297.log 2024-09-12T01:23:43.896 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.133879.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.133879.log.gz 2024-09-12T01:23:43.896 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79591.log 2024-09-12T01:23:43.897 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31297.log.gz 2024-09-12T01:23:43.897 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176361.log 2024-09-12T01:23:43.898 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.79591.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.79591.log.gz 2024-09-12T01:23:43.898 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156961.log 2024-09-12T01:23:43.899 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.176361.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.176361.log.gz 2024-09-12T01:23:43.899 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31083.log 2024-09-12T01:23:43.900 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.156961.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.156961.log.gz 2024-09-12T01:23:43.901 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71921.log 2024-09-12T01:23:43.901 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31083.log.gz 2024-09-12T01:23:43.902 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112637.log 2024-09-12T01:23:43.902 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.71921.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.71921.log.gz 2024-09-12T01:23:43.902 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119717.log 2024-09-12T01:23:43.903 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.112637.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112637.log.gz 2024-09-12T01:23:43.903 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31505.log 2024-09-12T01:23:43.904 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.119717.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.119717.log.gz 2024-09-12T01:23:43.904 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35998.log 2024-09-12T01:23:43.905 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31505.log.gz 2024-09-12T01:23:43.905 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161785.log 2024-09-12T01:23:43.906 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.35998.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.35998.log.gz 2024-09-12T01:23:43.906 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45782.log 2024-09-12T01:23:43.908 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.161785.log: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.161785.log.gz 2024-09-12T01:23:43.908 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182885.log 2024-09-12T01:23:43.909 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45782.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.45782.log.gz 2024-09-12T01:23:43.909 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183353.log 2024-09-12T01:23:43.909 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.182885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182885.log.gz 2024-09-12T01:23:43.910 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21902.log 2024-09-12T01:23:43.910 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.183353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183353.log.gz 2024-09-12T01:23:43.911 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93164.log 2024-09-12T01:23:43.911 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.tmp-client.admin.21902.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21902.log.gz 2024-09-12T01:23:43.911 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117947.log 2024-09-12T01:23:43.912 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.93164.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93164.log.gz 2024-09-12T01:23:43.912 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155781.log 2024-09-12T01:23:43.913 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.117947.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.117947.log.gz 2024-09-12T01:23:43.913 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103786.log 2024-09-12T01:23:43.914 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.155781.log: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.155781.log.gz 2024-09-12T01:23:43.914 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51117.log 2024-09-12T01:23:43.915 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.103786.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.103786.log.gz 2024-09-12T01:23:43.916 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41552.log 2024-09-12T01:23:43.916 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51117.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51117.log.gz 2024-09-12T01:23:43.916 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180380.log 2024-09-12T01:23:43.917 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.41552.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.41552.log.gz 2024-09-12T01:23:43.917 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130929.log 2024-09-12T01:23:43.918 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.180380.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.180380.log.gz 2024-09-12T01:23:43.918 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76051.log 2024-09-12T01:23:43.919 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.130929.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.130929.log.gz 2024-09-12T01:23:43.919 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43962.log 2024-09-12T01:23:43.920 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.76051.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.76051.log.gz 2024-09-12T01:23:43.921 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31500.log 2024-09-12T01:23:43.921 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43962.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.43962.log.gz 2024-09-12T01:23:43.921 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44552.log 2024-09-12T01:23:43.922 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31500.log.gz 2024-09-12T01:23:43.922 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158781.log 2024-09-12T01:23:43.922 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44552.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.44552.log.gz 2024-09-12T01:23:43.924 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84311.log 2024-09-12T01:23:43.925 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.158781.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.158781.log.gz 2024-09-12T01:23:43.925 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92571.log 2024-09-12T01:23:43.925 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.84311.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.84311.log.gz 2024-09-12T01:23:43.925 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67579.log 2024-09-12T01:23:43.926 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.92571.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.92571.log.gz 2024-09-12T01:23:43.926 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132109.log 2024-09-12T01:23:43.926 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67579.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.67579.log.gz 2024-09-12T01:23:43.927 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55957.log 2024-09-12T01:23:43.927 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.132109.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.132109.log.gz 2024-09-12T01:23:43.927 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54732.log 2024-09-12T01:23:43.941 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160860.log 2024-09-12T01:23:43.941 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54732.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.54732.log.gz 2024-09-12T01:23:43.944 INFO:teuthology.orchestra.run.smithi070.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55957.log.gz 2024-09-12T01:23:43.944 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183275.log 2024-09-12T01:23:43.945 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.160860.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.160860.log.gz 2024-09-12T01:23:43.946 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120897.log 2024-09-12T01:23:43.946 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.183275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183275.log.gz 2024-09-12T01:23:43.946 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179003.log 2024-09-12T01:23:43.947 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.120897.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.120897.log.gz 2024-09-12T01:23:43.947 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31089.log 2024-09-12T01:23:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.179003.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.179003.log.gz 2024-09-12T01:23:43.949 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51142.log 2024-09-12T01:23:43.949 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31089.log.gz 2024-09-12T01:23:43.949 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58499.log 2024-09-12T01:23:43.950 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51142.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.51142.log.gz 2024-09-12T01:23:43.950 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91981.log 2024-09-12T01:23:43.957 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116767.log 2024-09-12T01:23:43.957 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.91981.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.91981.log.gz 2024-09-12T01:23:43.958 INFO:teuthology.orchestra.run.smithi070.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.58499.log.gz 2024-09-12T01:23:43.959 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142139.log 2024-09-12T01:23:43.959 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.116767.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.116767.log.gz 2024-09-12T01:23:43.959 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31084.log 2024-09-12T01:23:43.960 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.142139.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.142139.log.gz 2024-09-12T01:23:43.961 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39698.log 2024-09-12T01:23:43.961 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31084.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31084.log.gz 2024-09-12T01:23:43.961 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99064.log 2024-09-12T01:23:43.962 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39698.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.39698.log.gz 2024-09-12T01:23:43.962 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55702.log 2024-09-12T01:23:43.964 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.99064.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.99064.log.gz 2024-09-12T01:23:43.964 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102016.log 2024-09-12T01:23:43.964 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55702.log: 47.2% -- replaced with /var/log/ceph/ceph-client.admin.55702.log.gz 2024-09-12T01:23:43.965 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30802.log 2024-09-12T01:23:43.966 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.102016.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.102016.log.gz 2024-09-12T01:23:43.966 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62370.log 2024-09-12T01:23:43.966 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30802.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30802.log.gz 2024-09-12T01:23:43.966 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115587.log 2024-09-12T01:23:43.968 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.62370.log: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.62370.log.gz 2024-09-12T01:23:43.969 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35408.log 2024-09-12T01:23:43.970 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.115587.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.115587.log.gz 2024-09-12T01:23:43.970 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53527.log 2024-09-12T01:23:43.970 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.35408.log: 80.9% -- replaced with /var/log/ceph/ceph-client.0.35408.log.gz 2024-09-12T01:23:43.971 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173411.log 2024-09-12T01:23:43.971 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53527.log.gz 2024-09-12T01:23:43.972 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37750.log 2024-09-12T01:23:43.972 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.173411.log: 81.1% -- replaced with /var/log/ceph/ceph-client.0.173411.log.gz 2024-09-12T01:23:43.972 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166036.log 2024-09-12T01:23:43.973 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.37750.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.37750.log.gz 2024-09-12T01:23:43.973 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179666.log 2024-09-12T01:23:43.974 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.166036.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.166036.log.gz 2024-09-12T01:23:43.974 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83721.log 2024-09-12T01:23:43.975 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.179666.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.179666.log.gz 2024-09-12T01:23:43.976 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183223.log 2024-09-12T01:23:43.976 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.83721.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.83721.log.gz 2024-09-12T01:23:43.977 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31269.log 2024-09-12T01:23:43.977 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.183223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183223.log.gz 2024-09-12T01:23:43.978 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52322.log 2024-09-12T01:23:43.978 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31269.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31269.log.gz 2024-09-12T01:23:43.979 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148039.log 2024-09-12T01:23:43.979 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52322.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.52322.log.gz 2024-09-12T01:23:43.979 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148629.log 2024-09-12T01:23:43.981 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.148039.log: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.148039.log.gz 2024-09-12T01:23:43.981 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183093.log 2024-09-12T01:23:43.982 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.148629.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.148629.log.gz 2024-09-12T01:23:43.983 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77821.log 2024-09-12T01:23:43.983 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.183093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183093.log.gz 2024-09-12T01:23:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97884.log 2024-09-12T01:23:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.77821.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.77821.log.gz 2024-09-12T01:23:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123259.log 2024-09-12T01:23:43.985 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.97884.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.97884.log.gz 2024-09-12T01:23:43.985 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73101.log 2024-09-12T01:23:43.986 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.123259.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.123259.log.gz 2024-09-12T01:23:43.986 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179641.log 2024-09-12T01:23:43.987 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.73101.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.73101.log.gz 2024-09-12T01:23:43.987 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106146.log 2024-09-12T01:23:43.988 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.179641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179641.log.gz 2024-09-12T01:23:43.988 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31077.log 2024-09-12T01:23:43.990 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.106146.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.106146.log.gz 2024-09-12T01:23:43.991 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179593.log 2024-09-12T01:23:43.991 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31077.log.gz 2024-09-12T01:23:43.992 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97294.log 2024-09-12T01:23:43.992 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.179593.log: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.179593.log.gz 2024-09-12T01:23:43.992 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60435.log 2024-09-12T01:23:43.993 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.97294.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.97294.log.gz 2024-09-12T01:23:43.993 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183510.log 2024-09-12T01:23:43.995 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.60435.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.60435.log.gz 2024-09-12T01:23:43.996 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183405.log 2024-09-12T01:23:43.996 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.183510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183510.log.gz 2024-09-12T01:23:43.996 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70666.log 2024-09-12T01:23:43.997 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.183405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183405.log.gz 2024-09-12T01:23:43.997 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90211.log 2024-09-12T01:23:43.998 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.70666.log: 80.9% -- replaced with /var/log/ceph/ceph-client.0.70666.log.gz 2024-09-12T01:23:43.998 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122079.log 2024-09-12T01:23:43.999 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.90211.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.90211.log.gz 2024-09-12T01:23:43.999 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64308.log 2024-09-12T01:23:44.000 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.122079.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.122079.log.gz 2024-09-12T01:23:44.000 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111457.log 2024-09-12T01:23:44.004 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.64308.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.64308.log.gz 2024-09-12T01:23:44.005 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74871.log 2024-09-12T01:23:44.005 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.111457.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.111457.log.gz 2024-09-12T01:23:44.006 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183145.log 2024-09-12T01:23:44.006 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.74871.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.74871.log.gz 2024-09-12T01:23:44.006 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150399.log 2024-09-12T01:23:44.008 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.183145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183145.log.gz 2024-09-12T01:23:44.008 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40962.log 2024-09-12T01:23:44.009 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.150399.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.150399.log.gz 2024-09-12T01:23:44.009 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81361.log 2024-09-12T01:23:44.009 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.40962.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.40962.log.gz 2024-09-12T01:23:44.009 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73691.log 2024-09-12T01:23:44.010 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.81361.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.81361.log.gz 2024-09-12T01:23:44.010 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45167.log 2024-09-12T01:23:44.011 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.73691.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.73691.log.gz 2024-09-12T01:23:44.011 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158191.log 2024-09-12T01:23:44.012 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45167.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45167.log.gz 2024-09-12T01:23:44.013 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57854.log 2024-09-12T01:23:44.013 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.158191.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.158191.log.gz 2024-09-12T01:23:44.014 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64959.log 2024-09-12T01:23:44.015 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57854.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.57854.log.gz 2024-09-12T01:23:44.015 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152169.log 2024-09-12T01:23:44.016 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.64959.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.64959.log.gz 2024-09-12T01:23:44.017 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.152169.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.152169.log.gz 2024-09-12T01:23:44.088 INFO:teuthology.orchestra.run.smithi187.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T01:23:44.633 INFO:teuthology.orchestra.run.smithi187.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T01:23:44.712 INFO:teuthology.orchestra.run.smithi070.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T01:23:46.037 INFO:teuthology.orchestra.run.smithi070.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T01:23:46.468 INFO:teuthology.orchestra.run.smithi070.stderr: 93.6% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T01:23:48.086 INFO:teuthology.orchestra.run.smithi070.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T01:23:50.732 INFO:teuthology.orchestra.run.smithi187.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T01:23:51.274 INFO:teuthology.orchestra.run.smithi070.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T01:23:51.297 INFO:teuthology.orchestra.run.smithi187.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T01:23:52.444 INFO:teuthology.orchestra.run.smithi187.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T01:23:55.833 INFO:teuthology.orchestra.run.smithi070.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T01:23:56.919 INFO:teuthology.orchestra.run.smithi187.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T01:23:56.921 INFO:teuthology.orchestra.run.smithi187.stderr: 2024-09-12T01:23:56.921 INFO:teuthology.orchestra.run.smithi187.stderr:real 0m13.351s 2024-09-12T01:23:56.921 INFO:teuthology.orchestra.run.smithi187.stderr:user 0m37.214s 2024-09-12T01:23:56.921 INFO:teuthology.orchestra.run.smithi187.stderr:sys 0m1.309s 2024-09-12T01:24:00.969 INFO:teuthology.orchestra.run.smithi070.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T01:24:00.971 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-12T01:24:00.971 INFO:teuthology.orchestra.run.smithi070.stderr:real 0m17.447s 2024-09-12T01:24:00.971 INFO:teuthology.orchestra.run.smithi070.stderr:user 0m46.976s 2024-09-12T01:24:00.971 INFO:teuthology.orchestra.run.smithi070.stderr:sys 0m1.857s 2024-09-12T01:24:00.972 INFO:tasks.ceph:Archiving logs... 2024-09-12T01:24:00.973 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901873/remote/smithi070/log 2024-09-12T01:24:00.974 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:24:06.700 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901873/remote/smithi187/log 2024-09-12T01:24:06.700 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:24:11.378 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T01:24:11.391 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T01:24:11.391 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:24:11.394 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:24:11.489 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T01:24:11.501 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T01:24:11.501 DEBUG:teuthology.orchestra.run.smithi070:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:24:11.503 DEBUG:teuthology.orchestra.run.smithi187:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:24:11.514 INFO:teuthology.orchestra.run.smithi070.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T01:24:11.515 INFO:teuthology.orchestra.run.smithi070.stdout:============================================================================== 2024-09-12T01:24:11.515 INFO:teuthology.orchestra.run.smithi070.stdout:*hv01.front.sepi 67.205.162.81 3 u 38 64 377 0.093 -2.708 0.322 2024-09-12T01:24:11.515 INFO:teuthology.orchestra.run.smithi070.stdout:+hv02.front.sepi 63.231.80.2 3 u 33 64 377 0.077 -3.526 0.464 2024-09-12T01:24:11.515 INFO:teuthology.orchestra.run.smithi070.stdout:+hv03.front.sepi 74.6.168.72 3 u 29 64 377 0.090 -5.947 0.445 2024-09-12T01:24:11.515 INFO:teuthology.orchestra.run.smithi070.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-12T01:24:11.516 INFO:teuthology.orchestra.run.smithi187.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T01:24:11.516 INFO:teuthology.orchestra.run.smithi187.stdout:============================================================================== 2024-09-12T01:24:11.517 INFO:teuthology.orchestra.run.smithi187.stdout:*hv01.front.sepi 67.205.162.81 3 u 37 64 377 0.077 -1.304 0.453 2024-09-12T01:24:11.517 INFO:teuthology.orchestra.run.smithi187.stdout:+hv02.front.sepi 63.231.80.2 3 u 35 64 377 0.094 -2.074 0.445 2024-09-12T01:24:11.517 INFO:teuthology.orchestra.run.smithi187.stdout:+hv03.front.sepi 74.6.168.72 3 u 41 64 377 0.101 -4.171 0.212 2024-09-12T01:24:11.517 INFO:teuthology.orchestra.run.smithi187.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-12T01:24:11.517 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T01:24:11.539 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T01:24:11.539 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T01:24:11.549 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T01:24:11.563 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T01:24:11.575 INFO:teuthology.task.internal:Duration was 3573.777659 seconds 2024-09-12T01:24:11.575 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T01:24:11.586 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T01:24:11.586 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:24:11.588 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:24:11.625 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T01:24:11.625 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi070.front.sepia.ceph.com 2024-09-12T01:24:11.625 DEBUG:teuthology.orchestra.run.smithi070:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:24:11.675 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi187.front.sepia.ceph.com 2024-09-12T01:24:11.675 DEBUG:teuthology.orchestra.run.smithi187:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:24:11.685 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T01:24:11.685 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:24:11.722 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:24:11.752 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T01:24:11.753 DEBUG:teuthology.orchestra.run.smithi070:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:24:11.790 DEBUG:teuthology.orchestra.run.smithi187:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:24:11.851 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T01:24:11.863 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T01:24:11.864 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:24:11.874 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:24:11.885 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T01:24:11.898 DEBUG:teuthology.orchestra.run.smithi070:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:24:11.918 DEBUG:teuthology.orchestra.run.smithi187:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:24:11.927 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = core 2024-09-12T01:24:11.936 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = core 2024-09-12T01:24:11.953 DEBUG:teuthology.orchestra.run.smithi070:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:24:11.984 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:24:11.985 DEBUG:teuthology.orchestra.run.smithi187:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:24:11.998 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:24:11.998 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T01:24:12.010 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T01:24:12.011 DEBUG:teuthology.misc:Transferring archived files from smithi070:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901873/remote/smithi070 2024-09-12T01:24:12.011 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:24:12.050 DEBUG:teuthology.misc:Transferring archived files from smithi187:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901873/remote/smithi187 2024-09-12T01:24:12.050 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:24:12.071 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T01:24:12.071 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:24:12.087 DEBUG:teuthology.orchestra.run.smithi187:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:24:12.115 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T01:24:12.129 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T01:24:12.129 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T01:24:12.169 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T01:24:12.170 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:24:12.172 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:24:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: 658636 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:24 /home/ubuntu/cephtest 2024-09-12T01:24:12.179 INFO:teuthology.orchestra.run.smithi187.stdout: 658636 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:24 /home/ubuntu/cephtest 2024-09-12T01:24:12.180 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T01:24:12.193 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T01:24:12.219 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} duration: 3573.7776589393616 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T01:24:12.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T01:24:12.304 INFO:teuthology.run:pass